2024-09-14T10:34:47.878 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-14T10:34:47.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T10:34:47.997 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904124 branch: main description: rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904124' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 valgrind: - --tool=memcheck - --max-threads=1024 compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: true frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 9419 sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded targets: smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI2xqMlrcMhTARmLob4WmHY5kinJvWPo7MQ0VteaeSjS1ZUpsId588/ztIA8+ALG+1Et7Mg+s1GzBeBgvAExl50= smithi118.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAWdEnjFFPeynWUahxm8MRE4vjfqor2c7FpeToRU9GQwvWW8kNDNrq65rzBI1prg/Dkk1hhJD0QRqoyoBVbvDLY= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_20:40:18 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-14T10:34:47.997 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa; will attempt to use it 2024-09-14T10:34:47.998 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa/tasks 2024-09-14T10:34:47.998 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-14T10:34:47.999 INFO:teuthology.task.internal:Checking packages... 2024-09-14T10:34:48.021 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8' 2024-09-14T10:34:48.021 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-14T10:34:48.021 INFO:teuthology.packaging:ref: None 2024-09-14T10:34:48.021 INFO:teuthology.packaging:tag: None 2024-09-14T10:34:48.021 INFO:teuthology.packaging:branch: main 2024-09-14T10:34:48.021 INFO:teuthology.packaging:sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:34:48.022 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-09-14T10:34:48.238 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4926.g1c941a66 2024-09-14T10:34:48.240 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-14T10:34:48.245 INFO:teuthology.task.internal:no buildpackages task found 2024-09-14T10:34:48.245 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-14T10:34:48.356 INFO:teuthology.task.internal:Saving configuration 2024-09-14T10:34:48.374 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-14T10:34:48.545 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-14T10:34:48.571 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904124', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:29:11.761910', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI2xqMlrcMhTARmLob4WmHY5kinJvWPo7MQ0VteaeSjS1ZUpsId588/ztIA8+ALG+1Et7Mg+s1GzBeBgvAExl50='} 2024-09-14T10:34:48.594 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904124', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:29:11.760224', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAWdEnjFFPeynWUahxm8MRE4vjfqor2c7FpeToRU9GQwvWW8kNDNrq65rzBI1prg/Dkk1hhJD0QRqoyoBVbvDLY='} 2024-09-14T10:34:48.594 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-14T10:34:48.676 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T10:34:48.676 INFO:teuthology.task.internal:roles: ubuntu@smithi118.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T10:34:48.676 INFO:teuthology.run_tasks:Running task console_log... 2024-09-14T10:34:48.941 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f401d1803a0>, signals=[15]) 2024-09-14T10:34:48.941 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-14T10:34:48.997 INFO:teuthology.task.internal:Opening connections... 2024-09-14T10:34:48.997 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2024-09-14T10:34:48.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:34:49.078 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi118.front.sepia.ceph.com 2024-09-14T10:34:49.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:34:49.155 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-14T10:34:49.163 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2024-09-14T10:34:49.182 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2024-09-14T10:34:49.182 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2024-09-14T10:34:49.240 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2024-09-14T10:34:49.240 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9" 2024-09-14T10:34:49.240 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2024-09-14T10:34:49.240 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2024-09-14T10:34:49.240 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9" 2024-09-14T10:34:49.240 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9" 2024-09-14T10:34:49.240 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T10:34:49.240 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2024-09-14T10:34:49.240 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon" 2024-09-14T10:34:49.240 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T10:34:49.241 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2024-09-14T10:34:49.241 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T10:34:49.241 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T10:34:49.241 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T10:34:49.242 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2024-09-14T10:34:49.268 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2024-09-14T10:34:49.286 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2024-09-14T10:34:49.287 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2024-09-14T10:34:49.345 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream" 2024-09-14T10:34:49.345 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="9" 2024-09-14T10:34:49.345 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos" 2024-09-14T10:34:49.345 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora" 2024-09-14T10:34:49.345 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="9" 2024-09-14T10:34:49.345 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el9" 2024-09-14T10:34:49.345 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T10:34:49.346 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2024-09-14T10:34:49.346 INFO:teuthology.orchestra.run.smithi118.stdout:LOGO="fedora-logo-icon" 2024-09-14T10:34:49.346 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T10:34:49.346 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/" 2024-09-14T10:34:49.346 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T10:34:49.346 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T10:34:49.346 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T10:34:49.346 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2024-09-14T10:34:49.376 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-14T10:34:49.385 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-14T10:34:49.535 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-14T10:34:49.535 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2024-09-14T10:34:49.538 DEBUG:teuthology.orchestra.run.smithi118:> test '!' -e /home/ubuntu/cephtest 2024-09-14T10:34:49.555 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-14T10:34:49.648 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-14T10:34:49.648 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2024-09-14T10:34:49.651 DEBUG:teuthology.orchestra.run.smithi118:> test -z $(ls -A /var/lib/ceph) 2024-09-14T10:34:49.684 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-14T10:34:49.852 INFO:teuthology.run_tasks:Running task kernel... 2024-09-14T10:34:49.973 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-14T10:34:49.973 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-14T10:34:49.973 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T10:34:49.974 DEBUG:teuthology.orchestra.run.smithi118:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T10:34:49.990 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:34:49.991 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-09-14T10:34:49.992 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:34:49.992 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2024-09-14T10:34:50.049 INFO:teuthology.orchestra.run.smithi050.stdout:5.14.0-503.el9.x86_64 2024-09-14T10:34:50.049 INFO:teuthology.task.kernel:Running kernel on smithi050: 5.14.0-503.el9.x86_64 2024-09-14T10:34:50.049 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum install -y kernel 2024-09-14T10:34:50.050 INFO:teuthology.orchestra.run.smithi118.stdout:5.14.0-503.el9.x86_64 2024-09-14T10:34:50.051 INFO:teuthology.task.kernel:Running kernel on smithi118: 5.14.0-503.el9.x86_64 2024-09-14T10:34:50.051 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum install -y kernel 2024-09-14T10:34:52.529 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-14T10:34:52.857 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-14T10:34:54.555 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-14T10:34:55.241 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - AppStream 16 MB/s | 20 MB 00:01 2024-09-14T10:34:59.981 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.5 MB 00:01 2024-09-14T10:35:01.008 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.5 MB 00:01 2024-09-14T10:35:01.448 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 86 kB/s | 19 kB 00:00 2024-09-14T10:35:02.244 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-14T10:35:02.367 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - Extras packages 126 kB/s | 19 kB 00:00 2024-09-14T10:35:03.530 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-14T10:35:07.934 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-14T10:35:08.986 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-14T10:35:10.057 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T10:35:10.057 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T10:35:10.173 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-09-14T10:35:10.181 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-09-14T10:35:10.181 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2024-09-14T10:35:10.181 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-09-14T10:35:10.182 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-09-14T10:35:10.182 INFO:teuthology.orchestra.run.smithi050.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T10:35:10.182 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2024-09-14T10:35:10.182 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T10:35:10.182 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T10:35:10.182 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T10:35:10.182 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:35:10.182 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-09-14T10:35:10.182 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-09-14T10:35:10.182 INFO:teuthology.orchestra.run.smithi050.stdout:Install 4 Packages 2024-09-14T10:35:10.182 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:35:10.183 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 79 M 2024-09-14T10:35:10.183 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 126 M 2024-09-14T10:35:10.183 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-09-14T10:35:10.518 INFO:teuthology.orchestra.run.smithi050.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 290 kB/s | 23 kB 00:00 2024-09-14T10:35:11.042 INFO:teuthology.orchestra.run.smithi118.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T10:35:11.042 INFO:teuthology.orchestra.run.smithi118.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T10:35:11.140 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-14T10:35:11.151 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-14T10:35:11.151 INFO:teuthology.orchestra.run.smithi118.stdout: Package Architecture Version Repository Size 2024-09-14T10:35:11.151 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-14T10:35:11.151 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-09-14T10:35:11.151 INFO:teuthology.orchestra.run.smithi118.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T10:35:11.151 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2024-09-14T10:35:11.151 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T10:35:11.151 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T10:35:11.151 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T10:35:11.151 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:35:11.151 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-09-14T10:35:11.152 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-14T10:35:11.152 INFO:teuthology.orchestra.run.smithi118.stdout:Install 4 Packages 2024-09-14T10:35:11.152 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:35:11.152 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 79 M 2024-09-14T10:35:11.152 INFO:teuthology.orchestra.run.smithi118.stdout:Installed size: 126 M 2024-09-14T10:35:11.153 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-09-14T10:35:11.369 INFO:teuthology.orchestra.run.smithi050.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-09-14T10:35:11.479 INFO:teuthology.orchestra.run.smithi118.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 74 kB/s | 23 kB 00:00 2024-09-14T10:35:11.719 INFO:teuthology.orchestra.run.smithi050.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 27 MB/s | 35 MB 00:01 2024-09-14T10:35:12.278 INFO:teuthology.orchestra.run.smithi050.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 16 MB/s | 29 MB 00:01 2024-09-14T10:35:12.278 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:35:12.278 INFO:teuthology.orchestra.run.smithi050.stdout:Total 38 MB/s | 79 MB 00:02 2024-09-14T10:35:12.989 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-09-14T10:35:13.370 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-09-14T10:35:13.370 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-09-14T10:35:14.381 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-09-14T10:35:14.381 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-09-14T10:35:16.845 INFO:teuthology.orchestra.run.smithi118.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 2.8 MB/s | 16 MB 00:05 2024-09-14T10:35:16.976 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-09-14T10:35:17.751 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T10:35:17.848 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:35:20.640 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:35:20.784 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:35:25.904 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:35:25.944 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:35:31.088 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:35:46.091 INFO:teuthology.orchestra.run.smithi118.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 845 kB/s | 29 MB 00:34 2024-09-14T10:35:51.899 INFO:teuthology.orchestra.run.smithi118.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 868 kB/s | 35 MB 00:40 2024-09-14T10:35:51.899 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:35:51.900 INFO:teuthology.orchestra.run.smithi118.stdout:Total 1.9 MB/s | 79 MB 00:40 2024-09-14T10:35:52.577 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-09-14T10:35:52.919 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-09-14T10:35:52.919 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-09-14T10:35:53.885 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-09-14T10:35:53.885 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-09-14T10:35:56.349 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-09-14T10:35:57.071 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T10:35:57.157 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:35:59.940 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:36:00.088 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:36:04.899 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:36:05.022 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:36:09.854 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:36:10.212 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:36:10.254 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:36:10.633 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:36:10.633 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T10:36:10.633 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:36:10.633 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:36:11.647 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:36:11.648 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:36:11.648 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-09-14T10:36:11.648 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T10:36:11.648 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T10:36:11.648 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T10:36:11.648 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T10:36:11.648 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:36:11.648 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-09-14T10:36:12.015 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T10:36:12.117 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T10:36:12.117 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T10:36:12.117 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T10:36:12.117 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T10:36:12.117 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T10:36:12.117 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-14T10:36:12.118 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi050.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T10:36:12.118 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T10:36:12.175 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T10:36:12.176 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T10:36:12.176 DEBUG:teuthology.orchestra.run.smithi050:> sudo rpm -qi grub2-tools 2024-09-14T10:36:12.211 INFO:teuthology.orchestra.run.smithi050.stdout:Name : grub2-tools 2024-09-14T10:36:12.211 INFO:teuthology.orchestra.run.smithi050.stdout:Epoch : 1 2024-09-14T10:36:12.211 INFO:teuthology.orchestra.run.smithi050.stdout:Version : 2.06 2024-09-14T10:36:12.211 INFO:teuthology.orchestra.run.smithi050.stdout:Release : 82.el9 2024-09-14T10:36:12.211 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: x86_64 2024-09-14T10:36:12.211 INFO:teuthology.orchestra.run.smithi050.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T10:36:12.211 INFO:teuthology.orchestra.run.smithi050.stdout:Group : Unspecified 2024-09-14T10:36:12.211 INFO:teuthology.orchestra.run.smithi050.stdout:Size : 8274670 2024-09-14T10:36:12.212 INFO:teuthology.orchestra.run.smithi050.stdout:License : GPLv3+ 2024-09-14T10:36:12.212 INFO:teuthology.orchestra.run.smithi050.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T10:36:12.212 INFO:teuthology.orchestra.run.smithi050.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T10:36:12.212 INFO:teuthology.orchestra.run.smithi050.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T10:36:12.212 INFO:teuthology.orchestra.run.smithi050.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T10:36:12.212 INFO:teuthology.orchestra.run.smithi050.stdout:Packager : builder@centos.org 2024-09-14T10:36:12.212 INFO:teuthology.orchestra.run.smithi050.stdout:Vendor : CentOS 2024-09-14T10:36:12.212 INFO:teuthology.orchestra.run.smithi050.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T10:36:12.212 INFO:teuthology.orchestra.run.smithi050.stdout:Summary : Support tools for GRUB. 2024-09-14T10:36:12.212 INFO:teuthology.orchestra.run.smithi050.stdout:Description : 2024-09-14T10:36:12.212 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:36:12.212 INFO:teuthology.orchestra.run.smithi050.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T10:36:12.212 INFO:teuthology.orchestra.run.smithi050.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T10:36:12.213 INFO:teuthology.orchestra.run.smithi050.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T10:36:12.213 INFO:teuthology.orchestra.run.smithi050.stdout:hardware devices. 2024-09-14T10:36:12.213 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:36:12.213 INFO:teuthology.orchestra.run.smithi050.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T10:36:12.213 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T10:36:12.214 INFO:teuthology.task.kernel:Updating grub on smithi050 to boot 5.14.0-505.el9.x86_64 2024-09-14T10:36:12.214 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T10:36:12.932 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2024-09-14T10:36:14.355 INFO:teuthology.orchestra.run.smithi050.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T10:36:14.380 INFO:teuthology.orchestra.run.smithi050.stderr:done 2024-09-14T10:36:14.385 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-09-14T10:36:14.440 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.2h62tEPG6V 2024-09-14T10:36:14.441 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.2h62tEPG6V 2024-09-14T10:36:14.518 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.2h62tEPG6V 2024-09-14T10:36:14.655 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.2h62tEPG6V is 6KB 2024-09-14T10:36:14.675 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.2h62tEPG6V 2024-09-14T10:36:14.689 DEBUG:teuthology.orchestra.run.smithi050:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T10:36:14.752 INFO:teuthology.orchestra.run.smithi050.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T10:36:14.752 INFO:teuthology.orchestra.run.smithi050.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T10:36:14.752 INFO:teuthology.orchestra.run.smithi050.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T10:36:14.752 INFO:teuthology.orchestra.run.smithi050.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T10:36:14.753 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T10:36:14.898 DEBUG:teuthology.orchestra.run.smithi050:> sudo shutdown -r now 2024-09-14T10:36:44.900 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-14T10:36:44.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-14T10:36:44.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:36:48.953 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:36:48.991 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:36:49.283 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:36:49.283 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T10:36:49.283 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:36:49.283 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:36:50.093 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:36:50.093 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:36:50.093 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-09-14T10:36:50.093 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T10:36:50.094 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T10:36:50.094 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T10:36:50.094 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T10:36:50.094 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:36:50.094 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-14T10:36:50.464 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T10:36:50.555 INFO:teuthology.orchestra.run.smithi118.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T10:36:50.555 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T10:36:50.555 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T10:36:50.556 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T10:36:50.556 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T10:36:50.556 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-14T10:36:50.556 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi118.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T10:36:50.556 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T10:36:50.615 INFO:teuthology.orchestra.run.smithi118.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T10:36:50.615 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T10:36:50.615 DEBUG:teuthology.orchestra.run.smithi118:> sudo rpm -qi grub2-tools 2024-09-14T10:36:50.652 INFO:teuthology.orchestra.run.smithi118.stdout:Name : grub2-tools 2024-09-14T10:36:50.653 INFO:teuthology.orchestra.run.smithi118.stdout:Epoch : 1 2024-09-14T10:36:50.653 INFO:teuthology.orchestra.run.smithi118.stdout:Version : 2.06 2024-09-14T10:36:50.653 INFO:teuthology.orchestra.run.smithi118.stdout:Release : 82.el9 2024-09-14T10:36:50.653 INFO:teuthology.orchestra.run.smithi118.stdout:Architecture: x86_64 2024-09-14T10:36:50.653 INFO:teuthology.orchestra.run.smithi118.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T10:36:50.653 INFO:teuthology.orchestra.run.smithi118.stdout:Group : Unspecified 2024-09-14T10:36:50.653 INFO:teuthology.orchestra.run.smithi118.stdout:Size : 8274670 2024-09-14T10:36:50.653 INFO:teuthology.orchestra.run.smithi118.stdout:License : GPLv3+ 2024-09-14T10:36:50.653 INFO:teuthology.orchestra.run.smithi118.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T10:36:50.653 INFO:teuthology.orchestra.run.smithi118.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T10:36:50.653 INFO:teuthology.orchestra.run.smithi118.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T10:36:50.654 INFO:teuthology.orchestra.run.smithi118.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T10:36:50.654 INFO:teuthology.orchestra.run.smithi118.stdout:Packager : builder@centos.org 2024-09-14T10:36:50.654 INFO:teuthology.orchestra.run.smithi118.stdout:Vendor : CentOS 2024-09-14T10:36:50.654 INFO:teuthology.orchestra.run.smithi118.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T10:36:50.654 INFO:teuthology.orchestra.run.smithi118.stdout:Summary : Support tools for GRUB. 2024-09-14T10:36:50.654 INFO:teuthology.orchestra.run.smithi118.stdout:Description : 2024-09-14T10:36:50.654 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:36:50.654 INFO:teuthology.orchestra.run.smithi118.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T10:36:50.654 INFO:teuthology.orchestra.run.smithi118.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T10:36:50.654 INFO:teuthology.orchestra.run.smithi118.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T10:36:50.654 INFO:teuthology.orchestra.run.smithi118.stdout:hardware devices. 2024-09-14T10:36:50.654 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:36:50.655 INFO:teuthology.orchestra.run.smithi118.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T10:36:50.655 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T10:36:50.656 INFO:teuthology.task.kernel:Updating grub on smithi118 to boot 5.14.0-505.el9.x86_64 2024-09-14T10:36:50.656 DEBUG:teuthology.orchestra.run.smithi118:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T10:36:51.330 INFO:teuthology.orchestra.run.smithi118.stderr:Generating grub configuration file ... 2024-09-14T10:36:52.652 INFO:teuthology.orchestra.run.smithi118.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T10:36:52.685 INFO:teuthology.orchestra.run.smithi118.stderr:done 2024-09-14T10:36:52.686 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2024-09-14T10:36:52.702 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.jP0CKuDgwX 2024-09-14T10:36:52.702 DEBUG:teuthology.orchestra.run.smithi118:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.jP0CKuDgwX 2024-09-14T10:36:52.769 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.jP0CKuDgwX 2024-09-14T10:36:52.914 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.jP0CKuDgwX is 6KB 2024-09-14T10:36:52.963 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.jP0CKuDgwX 2024-09-14T10:36:52.978 DEBUG:teuthology.orchestra.run.smithi118:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T10:36:53.040 INFO:teuthology.orchestra.run.smithi118.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T10:36:53.040 INFO:teuthology.orchestra.run.smithi118.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T10:36:53.041 INFO:teuthology.orchestra.run.smithi118.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T10:36:53.041 INFO:teuthology.orchestra.run.smithi118.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T10:36:53.042 DEBUG:teuthology.orchestra.run.smithi118:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T10:36:53.192 DEBUG:teuthology.orchestra.run.smithi118:> sudo shutdown -r now 2024-09-14T10:37:23.225 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-14T10:37:23.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-14T10:37:23.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:37:44.925 DEBUG:teuthology.orchestra.remote:timed out 2024-09-14T10:37:53.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-14T10:37:53.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:37:54.287 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-09-14T10:37:54.665 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-14T10:37:54.665 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-14T10:37:54.665 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-09-14T10:37:54.680 INFO:teuthology.orchestra.run.smithi050.stdout:5.14.0-505.el9.x86_64 2024-09-14T10:37:54.681 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T10:37:54.681 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T10:37:54.681 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T10:37:55.682 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-14T10:37:55.683 DEBUG:teuthology.orchestra.run.smithi050:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T10:37:55.793 INFO:teuthology.orchestra.run.smithi050.stdout:ttyS1 2024-09-14T10:37:55.810 DEBUG:teuthology.parallel:result is None 2024-09-14T10:37:57.697 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-09-14T10:38:06.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-14T10:38:06.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:39:06.701 DEBUG:teuthology.orchestra.remote:timed out 2024-09-14T10:39:18.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-14T10:39:18.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:39:19.117 DEBUG:teuthology.orchestra.run.smithi118:> true 2024-09-14T10:39:19.484 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-14T10:39:19.484 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-14T10:39:19.484 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2024-09-14T10:39:19.501 INFO:teuthology.orchestra.run.smithi118.stdout:5.14.0-505.el9.x86_64 2024-09-14T10:39:19.501 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T10:39:19.501 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T10:39:19.502 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T10:39:20.502 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-14T10:39:20.502 DEBUG:teuthology.orchestra.run.smithi118:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T10:39:20.574 INFO:teuthology.orchestra.run.smithi118.stdout:ttyS1 2024-09-14T10:39:20.594 DEBUG:teuthology.parallel:result is None 2024-09-14T10:39:20.594 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-14T10:39:20.601 INFO:teuthology.task.internal:Creating test directory... 2024-09-14T10:39:20.602 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T10:39:20.605 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T10:39:20.623 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-14T10:39:20.718 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-14T10:39:20.802 INFO:teuthology.task.internal:Creating archive directory... 2024-09-14T10:39:20.803 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T10:39:20.805 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T10:39:20.838 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-14T10:39:20.896 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-14T10:39:20.896 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T10:39:20.900 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T10:39:20.933 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:39:20.937 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:39:20.945 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:39:20.949 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:39:20.950 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-14T10:39:21.052 INFO:teuthology.task.internal:Configuring sudo... 2024-09-14T10:39:21.053 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T10:39:21.055 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T10:39:21.083 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-14T10:39:21.266 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-14T10:39:21.266 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T10:39:21.269 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T10:39:21.286 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:39:21.375 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:39:21.421 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:39:21.503 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:39:21.551 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:39:21.552 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T10:39:21.621 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:39:21.663 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:39:21.731 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:39:21.770 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:39:21.818 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-14T10:39:21.818 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T10:39:21.885 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2024-09-14T10:39:21.890 DEBUG:teuthology.orchestra.run.smithi118:> sudo service rsyslog restart 2024-09-14T10:39:21.941 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T10:39:21.992 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T10:39:22.300 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-14T10:39:22.308 INFO:teuthology.task.internal:Starting timer... 2024-09-14T10:39:22.308 INFO:teuthology.run_tasks:Running task pcp... 2024-09-14T10:39:22.461 INFO:teuthology.run_tasks:Running task selinux... 2024-09-14T10:39:22.582 DEBUG:teuthology.orchestra.run.smithi050:> sudo service auditd rotate 2024-09-14T10:39:22.710 INFO:teuthology.orchestra.run.smithi050.stdout:Rotating logs: 2024-09-14T10:39:22.712 DEBUG:teuthology.orchestra.run.smithi118:> sudo service auditd rotate 2024-09-14T10:39:22.782 INFO:teuthology.orchestra.run.smithi118.stdout:Rotating logs: 2024-09-14T10:39:22.786 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-14T10:39:22.786 DEBUG:teuthology.orchestra.run.smithi050:> /usr/sbin/getenforce 2024-09-14T10:39:22.814 INFO:teuthology.orchestra.run.smithi050.stdout:Permissive 2024-09-14T10:39:22.814 DEBUG:teuthology.orchestra.run.smithi118:> /usr/sbin/getenforce 2024-09-14T10:39:22.853 INFO:teuthology.orchestra.run.smithi118.stdout:Permissive 2024-09-14T10:39:22.853 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi050.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi118.front.sepia.ceph.com': 'permissive'} 2024-09-14T10:39:22.854 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T10:39:22.885 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:39:22.885 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T10:39:22.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:39:22.923 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-14T10:39:22.924 DEBUG:teuthology.orchestra.run.smithi050:> sudo /usr/sbin/setenforce permissive 2024-09-14T10:39:22.970 DEBUG:teuthology.orchestra.run.smithi118:> sudo /usr/sbin/setenforce permissive 2024-09-14T10:39:23.007 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-14T10:39:23.016 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-14T10:39:23.029 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-14T10:39:23.031 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi050.front.sepia.ceph.com,smithi118.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-14T10:43:11.991 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi118.front.sepia.ceph.com')] 2024-09-14T10:43:11.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-14T10:43:11.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:43:12.074 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-09-14T10:43:12.161 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-14T10:43:12.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-14T10:43:12.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:43:12.236 DEBUG:teuthology.orchestra.run.smithi118:> true 2024-09-14T10:43:12.316 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-14T10:43:12.317 INFO:teuthology.run_tasks:Running task clock... 2024-09-14T10:43:12.327 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-14T10:43:12.327 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T10:43:12.327 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T10:43:12.330 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T10:43:12.330 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T10:43:12.358 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T10:43:12.373 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T10:43:12.385 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T10:43:12.398 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: ntpd: command not found 2024-09-14T10:43:12.399 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T10:43:12.410 INFO:teuthology.orchestra.run.smithi050.stdout:506 Cannot talk to daemon 2024-09-14T10:43:12.423 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: ntpd: command not found 2024-09-14T10:43:12.425 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T10:43:12.434 INFO:teuthology.orchestra.run.smithi118.stdout:506 Cannot talk to daemon 2024-09-14T10:43:12.439 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T10:43:12.448 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T10:43:12.462 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T10:43:12.504 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2024-09-14T10:43:12.509 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T10:43:12.509 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2024-09-14T10:43:12.509 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:43:12.509 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:43:12.509 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:43:12.509 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:43:12.519 INFO:teuthology.orchestra.run.smithi118.stderr:bash: line 1: ntpq: command not found 2024-09-14T10:43:12.524 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T10:43:12.524 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2024-09-14T10:43:12.524 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:43:12.524 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:43:12.524 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:43:12.524 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:43:12.524 INFO:teuthology.run_tasks:Running task install... 2024-09-14T10:43:12.532 DEBUG:teuthology.task.install:project ceph 2024-09-14T10:43:12.533 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}} 2024-09-14T10:43:12.533 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'} 2024-09-14T10:43:12.533 INFO:teuthology.task.install:Using flavor: default 2024-09-14T10:43:12.538 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-14T10:43:12.538 INFO:teuthology.task.install:extra packages: [] 2024-09-14T10:43:12.539 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'tag': None, 'wait_for_package': False} 2024-09-14T10:43:12.539 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:43:12.541 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'tag': None, 'wait_for_package': False} 2024-09-14T10:43:12.541 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:43:12.685 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/ 2024-09-14T10:43:12.685 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4907.ga2782315 2024-09-14T10:43:12.695 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/ 2024-09-14T10:43:12.696 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4907.ga2782315 2024-09-14T10:43:12.795 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T10:43:12.795 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:43:12.795 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T10:43:12.803 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T10:43:12.803 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-14T10:43:12.803 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T10:43:12.822 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-14T10:43:12.823 DEBUG:teuthology.orchestra.run.smithi050:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T10:43:12.829 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-14T10:43:12.829 DEBUG:teuthology.orchestra.run.smithi118:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T10:43:12.889 DEBUG:teuthology.orchestra.run.smithi050:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T10:43:12.894 DEBUG:teuthology.orchestra.run.smithi118:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T10:43:12.967 DEBUG:teuthology.orchestra.run.smithi050:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T10:43:12.969 DEBUG:teuthology.orchestra.run.smithi118:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T10:43:13.032 INFO:teuthology.orchestra.run.smithi050.stdout:check_obsoletes = 1 2024-09-14T10:43:13.033 INFO:teuthology.orchestra.run.smithi118.stdout:check_obsoletes = 1 2024-09-14T10:43:13.034 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum clean all 2024-09-14T10:43:13.035 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum clean all 2024-09-14T10:43:13.272 INFO:teuthology.orchestra.run.smithi050.stdout:45 files removed 2024-09-14T10:43:13.284 INFO:teuthology.orchestra.run.smithi118.stdout:45 files removed 2024-09-14T10:43:13.300 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-14T10:43:13.311 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-14T10:43:13.859 INFO:teuthology.orchestra.run.smithi118.stdout:ceph packages for x86_64 321 kB/s | 84 kB 00:00 2024-09-14T10:43:13.868 INFO:teuthology.orchestra.run.smithi050.stdout:ceph packages for x86_64 312 kB/s | 84 kB 00:00 2024-09-14T10:43:14.143 INFO:teuthology.orchestra.run.smithi118.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-09-14T10:43:14.152 INFO:teuthology.orchestra.run.smithi050.stdout:ceph noarch packages 102 kB/s | 24 kB 00:00 2024-09-14T10:43:14.410 INFO:teuthology.orchestra.run.smithi118.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-09-14T10:43:14.420 INFO:teuthology.orchestra.run.smithi050.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-14T10:43:15.036 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-14T10:43:15.168 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-14T10:43:18.163 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-09-14T10:43:24.177 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 20 MB 00:07 2024-09-14T10:43:24.205 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.5 MB 00:02 2024-09-14T10:43:25.748 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 19 kB 00:00 2024-09-14T10:43:26.602 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-14T10:43:29.012 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - CRB 6.3 MB/s | 6.5 MB 00:01 2024-09-14T10:43:30.446 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - Extras packages 90 kB/s | 19 kB 00:00 2024-09-14T10:43:31.667 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-14T10:43:32.258 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-14T10:43:34.686 INFO:teuthology.orchestra.run.smithi050.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T10:43:34.687 INFO:teuthology.orchestra.run.smithi050.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T10:43:34.787 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-09-14T10:43:34.813 INFO:teuthology.orchestra.run.smithi050.stdout:====================================================================================================== 2024-09-14T10:43:34.813 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2024-09-14T10:43:34.813 INFO:teuthology.orchestra.run.smithi050.stdout:====================================================================================================== 2024-09-14T10:43:34.813 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-09-14T10:43:34.813 INFO:teuthology.orchestra.run.smithi050.stdout: ceph x86_64 2:19.3.0-4907.ga2782315.el9 ceph 6.6 k 2024-09-14T10:43:34.813 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T10:43:34.813 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 900 k 2024-09-14T10:43:34.813 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4907.ga2782315.el9 ceph 145 k 2024-09-14T10:43:34.813 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr x86_64 2:19.3.0-4907.ga2782315.el9 ceph 1.5 M 2024-09-14T10:43:34.813 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 154 k 2024-09-14T10:43:34.813 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 14 M 2024-09-14T10:43:34.813 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 7.4 M 2024-09-14T10:43:34.814 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 49 k 2024-09-14T10:43:34.814 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 11 M 2024-09-14T10:43:34.814 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test x86_64 2:19.3.0-4907.ga2782315.el9 ceph 50 M 2024-09-14T10:43:34.814 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 285 k 2024-09-14T10:43:34.814 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 784 k 2024-09-14T10:43:34.814 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 32 k 2024-09-14T10:43:34.814 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 756 k 2024-09-14T10:43:34.814 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 127 k 2024-09-14T10:43:34.814 INFO:teuthology.orchestra.run.smithi050.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-14T10:43:34.814 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T10:43:34.814 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados x86_64 2:19.3.0-4907.ga2782315.el9 ceph 320 k 2024-09-14T10:43:34.814 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 305 k 2024-09-14T10:43:34.814 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 99 k 2024-09-14T10:43:34.814 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 85 k 2024-09-14T10:43:34.815 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T10:43:34.815 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 171 k 2024-09-14T10:43:34.815 INFO:teuthology.orchestra.run.smithi050.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-14T10:43:34.815 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrading: 2024-09-14T10:43:34.815 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.5 M 2024-09-14T10:43:34.815 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T10:43:34.815 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2024-09-14T10:43:34.815 INFO:teuthology.orchestra.run.smithi050.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-14T10:43:34.815 INFO:teuthology.orchestra.run.smithi050.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T10:43:34.815 INFO:teuthology.orchestra.run.smithi050.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-14T10:43:34.815 INFO:teuthology.orchestra.run.smithi050.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-14T10:43:34.815 INFO:teuthology.orchestra.run.smithi050.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-14T10:43:34.815 INFO:teuthology.orchestra.run.smithi050.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-14T10:43:34.816 INFO:teuthology.orchestra.run.smithi050.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-14T10:43:34.816 INFO:teuthology.orchestra.run.smithi050.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-14T10:43:34.816 INFO:teuthology.orchestra.run.smithi050.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-14T10:43:34.816 INFO:teuthology.orchestra.run.smithi050.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-14T10:43:34.816 INFO:teuthology.orchestra.run.smithi050.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-14T10:43:34.816 INFO:teuthology.orchestra.run.smithi050.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-14T10:43:34.816 INFO:teuthology.orchestra.run.smithi050.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-14T10:43:34.816 INFO:teuthology.orchestra.run.smithi050.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-14T10:43:34.816 INFO:teuthology.orchestra.run.smithi050.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-14T10:43:34.816 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T10:43:34.816 INFO:teuthology.orchestra.run.smithi050.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-14T10:43:34.816 INFO:teuthology.orchestra.run.smithi050.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-14T10:43:34.816 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 22 M 2024-09-14T10:43:34.817 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 34 k 2024-09-14T10:43:34.817 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds x86_64 2:19.3.0-4907.ga2782315.el9 ceph 2.4 M 2024-09-14T10:43:34.817 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 291 k 2024-09-14T10:43:34.817 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon x86_64 2:19.3.0-4907.ga2782315.el9 ceph 4.8 M 2024-09-14T10:43:34.817 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 17 M 2024-09-14T10:43:34.817 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 16 k 2024-09-14T10:43:34.817 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux x86_64 2:19.3.0-4907.ga2782315.el9 ceph 25 k 2024-09-14T10:43:34.817 INFO:teuthology.orchestra.run.smithi050.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-14T10:43:34.817 INFO:teuthology.orchestra.run.smithi050.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-14T10:43:34.817 INFO:teuthology.orchestra.run.smithi050.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-14T10:43:34.817 INFO:teuthology.orchestra.run.smithi050.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-14T10:43:34.817 INFO:teuthology.orchestra.run.smithi050.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-14T10:43:34.817 INFO:teuthology.orchestra.run.smithi050.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-14T10:43:34.817 INFO:teuthology.orchestra.run.smithi050.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-14T10:43:34.817 INFO:teuthology.orchestra.run.smithi050.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-14T10:43:34.818 INFO:teuthology.orchestra.run.smithi050.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-14T10:43:34.818 INFO:teuthology.orchestra.run.smithi050.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-14T10:43:34.818 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T10:43:34.818 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T10:43:34.818 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T10:43:34.818 INFO:teuthology.orchestra.run.smithi050.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T10:43:34.818 INFO:teuthology.orchestra.run.smithi050.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-14T10:43:34.818 INFO:teuthology.orchestra.run.smithi050.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-14T10:43:34.818 INFO:teuthology.orchestra.run.smithi050.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-14T10:43:34.818 INFO:teuthology.orchestra.run.smithi050.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-14T10:43:34.818 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T10:43:34.818 INFO:teuthology.orchestra.run.smithi050.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-14T10:43:34.818 INFO:teuthology.orchestra.run.smithi050.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T10:43:34.819 INFO:teuthology.orchestra.run.smithi050.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-14T10:43:34.819 INFO:teuthology.orchestra.run.smithi050.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-14T10:43:34.819 INFO:teuthology.orchestra.run.smithi050.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-14T10:43:34.819 INFO:teuthology.orchestra.run.smithi050.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-14T10:43:34.819 INFO:teuthology.orchestra.run.smithi050.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-14T10:43:34.819 INFO:teuthology.orchestra.run.smithi050.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-14T10:43:34.819 INFO:teuthology.orchestra.run.smithi050.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-14T10:43:34.819 INFO:teuthology.orchestra.run.smithi050.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-14T10:43:34.819 INFO:teuthology.orchestra.run.smithi050.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-14T10:43:34.819 INFO:teuthology.orchestra.run.smithi050.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-14T10:43:34.819 INFO:teuthology.orchestra.run.smithi050.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-14T10:43:34.819 INFO:teuthology.orchestra.run.smithi050.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-14T10:43:34.819 INFO:teuthology.orchestra.run.smithi050.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-14T10:43:34.819 INFO:teuthology.orchestra.run.smithi050.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-14T10:43:34.820 INFO:teuthology.orchestra.run.smithi050.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-14T10:43:34.820 INFO:teuthology.orchestra.run.smithi050.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-14T10:43:34.820 INFO:teuthology.orchestra.run.smithi050.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-14T10:43:34.820 INFO:teuthology.orchestra.run.smithi050.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-14T10:43:34.820 INFO:teuthology.orchestra.run.smithi050.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-14T10:43:34.820 INFO:teuthology.orchestra.run.smithi050.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-14T10:43:34.820 INFO:teuthology.orchestra.run.smithi050.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-14T10:43:34.820 INFO:teuthology.orchestra.run.smithi050.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-14T10:43:34.820 INFO:teuthology.orchestra.run.smithi050.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-14T10:43:34.820 INFO:teuthology.orchestra.run.smithi050.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-14T10:43:34.820 INFO:teuthology.orchestra.run.smithi050.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-14T10:43:34.820 INFO:teuthology.orchestra.run.smithi050.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-14T10:43:34.821 INFO:teuthology.orchestra.run.smithi050.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-14T10:43:34.821 INFO:teuthology.orchestra.run.smithi050.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-14T10:43:34.821 INFO:teuthology.orchestra.run.smithi050.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-14T10:43:34.821 INFO:teuthology.orchestra.run.smithi050.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-14T10:43:34.821 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T10:43:34.821 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T10:43:34.821 INFO:teuthology.orchestra.run.smithi050.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-14T10:43:34.821 INFO:teuthology.orchestra.run.smithi050.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-14T10:43:34.821 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T10:43:34.821 INFO:teuthology.orchestra.run.smithi050.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-14T10:43:34.821 INFO:teuthology.orchestra.run.smithi050.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-14T10:43:34.821 INFO:teuthology.orchestra.run.smithi050.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-14T10:43:34.821 INFO:teuthology.orchestra.run.smithi050.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-14T10:43:34.821 INFO:teuthology.orchestra.run.smithi050.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-14T10:43:34.822 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T10:43:34.822 INFO:teuthology.orchestra.run.smithi050.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-14T10:43:34.822 INFO:teuthology.orchestra.run.smithi050.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-14T10:43:34.822 INFO:teuthology.orchestra.run.smithi050.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-14T10:43:34.822 INFO:teuthology.orchestra.run.smithi050.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-14T10:43:34.822 INFO:teuthology.orchestra.run.smithi050.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-14T10:43:34.822 INFO:teuthology.orchestra.run.smithi050.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-14T10:43:34.822 INFO:teuthology.orchestra.run.smithi050.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-14T10:43:34.822 INFO:teuthology.orchestra.run.smithi050.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T10:43:34.822 INFO:teuthology.orchestra.run.smithi050.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-14T10:43:34.822 INFO:teuthology.orchestra.run.smithi050.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T10:43:34.822 INFO:teuthology.orchestra.run.smithi050.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-14T10:43:34.822 INFO:teuthology.orchestra.run.smithi050.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-14T10:43:34.822 INFO:teuthology.orchestra.run.smithi050.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-14T10:43:34.823 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T10:43:34.823 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T10:43:34.823 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T10:43:34.823 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 508 k 2024-09-14T10:43:34.823 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T10:43:34.823 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T10:43:34.823 INFO:teuthology.orchestra.run.smithi050.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-14T10:43:34.823 INFO:teuthology.orchestra.run.smithi050.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-14T10:43:34.823 INFO:teuthology.orchestra.run.smithi050.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-14T10:43:34.823 INFO:teuthology.orchestra.run.smithi050.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-14T10:43:34.823 INFO:teuthology.orchestra.run.smithi050.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-14T10:43:34.823 INFO:teuthology.orchestra.run.smithi050.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-14T10:43:34.823 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T10:43:34.824 INFO:teuthology.orchestra.run.smithi050.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-14T10:43:34.824 INFO:teuthology.orchestra.run.smithi050.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-14T10:43:34.824 INFO:teuthology.orchestra.run.smithi050.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-14T10:43:34.824 INFO:teuthology.orchestra.run.smithi050.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-14T10:43:34.824 INFO:teuthology.orchestra.run.smithi050.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-14T10:43:34.824 INFO:teuthology.orchestra.run.smithi050.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-14T10:43:34.824 INFO:teuthology.orchestra.run.smithi050.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-14T10:43:34.824 INFO:teuthology.orchestra.run.smithi050.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-14T10:43:34.824 INFO:teuthology.orchestra.run.smithi050.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-14T10:43:34.824 INFO:teuthology.orchestra.run.smithi050.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-14T10:43:34.824 INFO:teuthology.orchestra.run.smithi050.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-14T10:43:34.824 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T10:43:34.824 INFO:teuthology.orchestra.run.smithi050.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T10:43:34.824 INFO:teuthology.orchestra.run.smithi050.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T10:43:34.824 INFO:teuthology.orchestra.run.smithi050.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-14T10:43:34.825 INFO:teuthology.orchestra.run.smithi050.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T10:43:34.825 INFO:teuthology.orchestra.run.smithi050.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-14T10:43:34.825 INFO:teuthology.orchestra.run.smithi050.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-14T10:43:34.825 INFO:teuthology.orchestra.run.smithi050.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-14T10:43:34.825 INFO:teuthology.orchestra.run.smithi050.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-14T10:43:34.825 INFO:teuthology.orchestra.run.smithi050.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-14T10:43:34.825 INFO:teuthology.orchestra.run.smithi050.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-14T10:43:34.825 INFO:teuthology.orchestra.run.smithi050.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-14T10:43:34.825 INFO:teuthology.orchestra.run.smithi050.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-14T10:43:34.825 INFO:teuthology.orchestra.run.smithi050.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-14T10:43:34.825 INFO:teuthology.orchestra.run.smithi050.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-14T10:43:34.825 INFO:teuthology.orchestra.run.smithi050.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-14T10:43:34.825 INFO:teuthology.orchestra.run.smithi050.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T10:43:34.826 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T10:43:34.826 INFO:teuthology.orchestra.run.smithi050.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-14T10:43:34.826 INFO:teuthology.orchestra.run.smithi050.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-14T10:43:34.826 INFO:teuthology.orchestra.run.smithi050.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-14T10:43:34.826 INFO:teuthology.orchestra.run.smithi050.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-14T10:43:34.826 INFO:teuthology.orchestra.run.smithi050.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-14T10:43:34.826 INFO:teuthology.orchestra.run.smithi050.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-14T10:43:34.826 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T10:43:34.826 INFO:teuthology.orchestra.run.smithi050.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-14T10:43:34.826 INFO:teuthology.orchestra.run.smithi050.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-14T10:43:34.826 INFO:teuthology.orchestra.run.smithi050.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-14T10:43:34.826 INFO:teuthology.orchestra.run.smithi050.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-14T10:43:34.826 INFO:teuthology.orchestra.run.smithi050.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-14T10:43:34.827 INFO:teuthology.orchestra.run.smithi050.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-14T10:43:34.827 INFO:teuthology.orchestra.run.smithi050.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-14T10:43:34.827 INFO:teuthology.orchestra.run.smithi050.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-14T10:43:34.827 INFO:teuthology.orchestra.run.smithi050.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-14T10:43:34.827 INFO:teuthology.orchestra.run.smithi050.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-14T10:43:34.827 INFO:teuthology.orchestra.run.smithi050.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-14T10:43:34.827 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T10:43:34.827 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T10:43:34.827 INFO:teuthology.orchestra.run.smithi050.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-14T10:43:34.827 INFO:teuthology.orchestra.run.smithi050.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-14T10:43:34.827 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T10:43:34.827 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T10:43:34.827 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T10:43:34.827 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T10:43:34.828 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 45 k 2024-09-14T10:43:34.828 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 143 k 2024-09-14T10:43:34.828 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T10:43:34.828 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T10:43:34.828 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T10:43:34.828 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T10:43:34.828 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T10:43:34.828 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T10:43:34.828 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T10:43:34.828 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T10:43:34.828 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T10:43:34.828 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T10:43:34.828 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T10:43:34.828 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-14T10:43:34.829 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T10:43:34.829 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T10:43:34.829 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T10:43:34.829 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T10:43:34.829 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T10:43:34.829 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T10:43:34.829 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T10:43:34.829 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T10:43:34.829 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T10:43:34.829 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T10:43:34.829 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T10:43:34.829 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T10:43:34.829 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T10:43:34.829 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T10:43:34.829 INFO:teuthology.orchestra.run.smithi050.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T10:43:34.830 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T10:43:34.830 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T10:43:34.830 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T10:43:34.830 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T10:43:34.830 INFO:teuthology.orchestra.run.smithi050.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T10:43:34.830 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T10:43:34.830 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T10:43:34.830 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T10:43:34.830 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T10:43:34.830 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T10:43:34.830 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T10:43:34.830 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T10:43:34.831 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T10:43:34.831 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T10:43:34.831 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T10:43:34.831 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T10:43:34.831 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T10:43:34.831 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T10:43:34.831 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T10:43:34.831 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T10:43:34.831 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T10:43:34.831 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T10:43:34.831 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T10:43:34.831 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T10:43:34.832 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T10:43:34.832 INFO:teuthology.orchestra.run.smithi050.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T10:43:34.832 INFO:teuthology.orchestra.run.smithi050.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T10:43:34.832 INFO:teuthology.orchestra.run.smithi050.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-14T10:43:34.832 INFO:teuthology.orchestra.run.smithi050.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-14T10:43:34.832 INFO:teuthology.orchestra.run.smithi050.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-14T10:43:34.832 INFO:teuthology.orchestra.run.smithi050.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T10:43:34.832 INFO:teuthology.orchestra.run.smithi050.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-14T10:43:34.832 INFO:teuthology.orchestra.run.smithi050.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T10:43:34.832 INFO:teuthology.orchestra.run.smithi050.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-14T10:43:34.832 INFO:teuthology.orchestra.run.smithi050.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-14T10:43:34.833 INFO:teuthology.orchestra.run.smithi050.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-14T10:43:34.833 INFO:teuthology.orchestra.run.smithi050.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-14T10:43:34.833 INFO:teuthology.orchestra.run.smithi050.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-14T10:43:34.833 INFO:teuthology.orchestra.run.smithi050.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-14T10:43:34.833 INFO:teuthology.orchestra.run.smithi050.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-14T10:43:34.833 INFO:teuthology.orchestra.run.smithi050.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-14T10:43:34.833 INFO:teuthology.orchestra.run.smithi050.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-14T10:43:34.833 INFO:teuthology.orchestra.run.smithi050.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-14T10:43:34.833 INFO:teuthology.orchestra.run.smithi050.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-14T10:43:34.833 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T10:43:34.833 INFO:teuthology.orchestra.run.smithi050.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-14T10:43:34.834 INFO:teuthology.orchestra.run.smithi050.stdout:Installing weak dependencies: 2024-09-14T10:43:34.834 INFO:teuthology.orchestra.run.smithi050.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-14T10:43:34.834 INFO:teuthology.orchestra.run.smithi050.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-14T10:43:34.834 INFO:teuthology.orchestra.run.smithi050.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-14T10:43:34.834 INFO:teuthology.orchestra.run.smithi050.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-14T10:43:34.834 INFO:teuthology.orchestra.run.smithi050.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-14T10:43:34.834 INFO:teuthology.orchestra.run.smithi050.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-14T10:43:34.834 INFO:teuthology.orchestra.run.smithi050.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-14T10:43:34.834 INFO:teuthology.orchestra.run.smithi050.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-14T10:43:34.834 INFO:teuthology.orchestra.run.smithi050.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-14T10:43:34.834 INFO:teuthology.orchestra.run.smithi050.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-14T10:43:34.834 INFO:teuthology.orchestra.run.smithi050.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-14T10:43:34.834 INFO:teuthology.orchestra.run.smithi050.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-14T10:43:34.835 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T10:43:34.835 INFO:teuthology.orchestra.run.smithi050.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-14T10:43:34.835 INFO:teuthology.orchestra.run.smithi050.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-14T10:43:34.835 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:43:34.835 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-09-14T10:43:34.835 INFO:teuthology.orchestra.run.smithi050.stdout:====================================================================================================== 2024-09-14T10:43:34.835 INFO:teuthology.orchestra.run.smithi050.stdout:Install 284 Packages 2024-09-14T10:43:34.835 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrade 2 Packages 2024-09-14T10:43:34.835 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:43:34.836 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 327 M 2024-09-14T10:43:34.836 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-09-14T10:43:35.560 INFO:teuthology.orchestra.run.smithi050.stdout:(1/286): ceph-19.3.0-4907.ga2782315.el9.x86_64. 49 kB/s | 6.6 kB 00:00 2024-09-14T10:43:35.793 INFO:teuthology.orchestra.run.smithi050.stdout:(2/286): ceph-fuse-19.3.0-4907.ga2782315.el9.x8 3.8 MB/s | 900 kB 00:00 2024-09-14T10:43:35.910 INFO:teuthology.orchestra.run.smithi050.stdout:(3/286): ceph-base-19.3.0-4907.ga2782315.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-14T10:43:35.935 INFO:teuthology.orchestra.run.smithi050.stdout:(4/286): ceph-immutable-object-cache-19.3.0-490 1.0 MB/s | 145 kB 00:00 2024-09-14T10:43:36.027 INFO:teuthology.orchestra.run.smithi050.stdout:(5/286): ceph-mds-19.3.0-4907.ga2782315.el9.x86 20 MB/s | 2.4 MB 00:00 2024-09-14T10:43:36.077 INFO:teuthology.orchestra.run.smithi050.stdout:(6/286): ceph-mgr-19.3.0-4907.ga2782315.el9.x86 11 MB/s | 1.5 MB 00:00 2024-09-14T10:43:36.303 INFO:teuthology.orchestra.run.smithi050.stdout:(7/286): ceph-mon-19.3.0-4907.ga2782315.el9.x86 17 MB/s | 4.8 MB 00:00 2024-09-14T10:43:36.761 INFO:teuthology.orchestra.run.smithi050.stdout:(8/286): ceph-common-19.3.0-4907.ga2782315.el9. 16 MB/s | 22 MB 00:01 2024-09-14T10:43:36.795 INFO:teuthology.orchestra.run.smithi050.stdout:(9/286): ceph-selinux-19.3.0-4907.ga2782315.el9 763 kB/s | 25 kB 00:00 2024-09-14T10:43:36.920 INFO:teuthology.orchestra.run.smithi050.stdout:(10/286): ceph-radosgw-19.3.0-4907.ga2782315.el 18 MB/s | 11 MB 00:00 2024-09-14T10:43:36.987 INFO:teuthology.orchestra.run.smithi050.stdout:(11/286): libcephfs-devel-19.3.0-4907.ga2782315 478 kB/s | 32 kB 00:00 2024-09-14T10:43:37.106 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-14T10:43:37.171 INFO:teuthology.orchestra.run.smithi050.stdout:(12/286): libcephfs2-19.3.0-4907.ga2782315.el9. 4.0 MB/s | 756 kB 00:00 2024-09-14T10:43:37.321 INFO:teuthology.orchestra.run.smithi050.stdout:(13/286): libcephsqlite-19.3.0-4907.ga2782315.e 1.1 MB/s | 161 kB 00:00 2024-09-14T10:43:37.371 INFO:teuthology.orchestra.run.smithi050.stdout:(14/286): librados-devel-19.3.0-4907.ga2782315. 2.5 MB/s | 127 kB 00:00 2024-09-14T10:43:37.547 INFO:teuthology.orchestra.run.smithi050.stdout:(15/286): ceph-osd-19.3.0-4907.ga2782315.el9.x8 12 MB/s | 17 MB 00:01 2024-09-14T10:43:37.607 INFO:teuthology.orchestra.run.smithi050.stdout:(16/286): libradosstriper1-19.3.0-4907.ga278231 2.1 MB/s | 508 kB 00:00 2024-09-14T10:43:37.656 INFO:teuthology.orchestra.run.smithi050.stdout:(17/286): python3-ceph-argparse-19.3.0-4907.ga2 935 kB/s | 45 kB 00:00 2024-09-14T10:43:37.731 INFO:teuthology.orchestra.run.smithi050.stdout:(18/286): python3-ceph-common-19.3.0-4907.ga278 1.9 MB/s | 143 kB 00:00 2024-09-14T10:43:37.798 INFO:teuthology.orchestra.run.smithi050.stdout:(19/286): python3-cephfs-19.3.0-4907.ga2782315. 2.4 MB/s | 161 kB 00:00 2024-09-14T10:43:37.882 INFO:teuthology.orchestra.run.smithi050.stdout:(20/286): python3-rados-19.3.0-4907.ga2782315.e 3.8 MB/s | 320 kB 00:00 2024-09-14T10:43:37.999 INFO:teuthology.orchestra.run.smithi050.stdout:(21/286): librgw2-19.3.0-4907.ga2782315.el9.x86 12 MB/s | 5.5 MB 00:00 2024-09-14T10:43:38.024 INFO:teuthology.orchestra.run.smithi050.stdout:(22/286): python3-rbd-19.3.0-4907.ga2782315.el9 2.1 MB/s | 305 kB 00:00 2024-09-14T10:43:38.049 INFO:teuthology.orchestra.run.smithi050.stdout:(23/286): python3-rgw-19.3.0-4907.ga2782315.el9 1.9 MB/s | 99 kB 00:00 2024-09-14T10:43:38.074 INFO:teuthology.orchestra.run.smithi050.stdout:(24/286): rbd-fuse-19.3.0-4907.ga2782315.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-14T10:43:38.125 INFO:teuthology.orchestra.run.smithi050.stdout:(25/286): rbd-nbd-19.3.0-4907.ga2782315.el9.x86 3.3 MB/s | 171 kB 00:00 2024-09-14T10:43:38.191 INFO:teuthology.orchestra.run.smithi050.stdout:(26/286): ceph-grafana-dashboards-19.3.0-4907.g 516 kB/s | 34 kB 00:00 2024-09-14T10:43:38.284 INFO:teuthology.orchestra.run.smithi050.stdout:(27/286): rbd-mirror-19.3.0-4907.ga2782315.el9. 14 MB/s | 3.2 MB 00:00 2024-09-14T10:43:38.309 INFO:teuthology.orchestra.run.smithi050.stdout:(28/286): ceph-mgr-cephadm-19.3.0-4907.ga278231 1.3 MB/s | 154 kB 00:00 2024-09-14T10:43:38.684 INFO:teuthology.orchestra.run.smithi050.stdout:(29/286): ceph-mgr-diskprediction-local-19.3.0- 20 MB/s | 7.4 MB 00:00 2024-09-14T10:43:39.151 INFO:teuthology.orchestra.run.smithi050.stdout:(30/286): ceph-test-19.3.0-4907.ga2782315.el9.x 21 MB/s | 50 MB 00:02 2024-09-14T10:43:39.176 INFO:teuthology.orchestra.run.smithi050.stdout:(31/286): ceph-mgr-modules-core-19.3.0-4907.ga2 591 kB/s | 291 kB 00:00 2024-09-14T10:43:39.202 INFO:teuthology.orchestra.run.smithi050.stdout:(32/286): ceph-mgr-rook-19.3.0-4907.ga2782315.e 992 kB/s | 49 kB 00:00 2024-09-14T10:43:39.227 INFO:teuthology.orchestra.run.smithi050.stdout:(33/286): ceph-prometheus-alerts-19.3.0-4907.ga 328 kB/s | 16 kB 00:00 2024-09-14T10:43:39.252 INFO:teuthology.orchestra.run.smithi050.stdout:(34/286): ceph-volume-19.3.0-4907.ga2782315.el9 5.6 MB/s | 285 kB 00:00 2024-09-14T10:43:39.294 INFO:teuthology.orchestra.run.smithi050.stdout:(35/286): cephadm-19.3.0-4907.ga2782315.el9.noa 12 MB/s | 784 kB 00:00 2024-09-14T10:43:39.428 INFO:teuthology.orchestra.run.smithi050.stdout:(36/286): bluez-libs-5.56-6.el9.x86_64.rpm 635 kB/s | 85 kB 00:00 2024-09-14T10:43:39.453 INFO:teuthology.orchestra.run.smithi050.stdout:(37/286): ModemManager-glib-1.20.2-1.el9.x86_64 1.6 MB/s | 335 kB 00:00 2024-09-14T10:43:39.486 INFO:teuthology.orchestra.run.smithi118.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T10:43:39.487 INFO:teuthology.orchestra.run.smithi118.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T10:43:39.580 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-14T10:43:39.595 INFO:teuthology.orchestra.run.smithi050.stdout:(38/286): ceph-mgr-dashboard-19.3.0-4907.ga2782 11 MB/s | 14 MB 00:01 2024-09-14T10:43:39.601 INFO:teuthology.orchestra.run.smithi118.stdout:====================================================================================================== 2024-09-14T10:43:39.601 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2024-09-14T10:43:39.601 INFO:teuthology.orchestra.run.smithi118.stdout:====================================================================================================== 2024-09-14T10:43:39.601 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-09-14T10:43:39.601 INFO:teuthology.orchestra.run.smithi118.stdout: ceph x86_64 2:19.3.0-4907.ga2782315.el9 ceph 6.6 k 2024-09-14T10:43:39.601 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T10:43:39.602 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 900 k 2024-09-14T10:43:39.602 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4907.ga2782315.el9 ceph 145 k 2024-09-14T10:43:39.602 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr x86_64 2:19.3.0-4907.ga2782315.el9 ceph 1.5 M 2024-09-14T10:43:39.602 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 154 k 2024-09-14T10:43:39.602 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 14 M 2024-09-14T10:43:39.602 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 7.4 M 2024-09-14T10:43:39.602 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 49 k 2024-09-14T10:43:39.602 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 11 M 2024-09-14T10:43:39.602 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test x86_64 2:19.3.0-4907.ga2782315.el9 ceph 50 M 2024-09-14T10:43:39.602 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 285 k 2024-09-14T10:43:39.603 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 784 k 2024-09-14T10:43:39.603 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 32 k 2024-09-14T10:43:39.603 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 756 k 2024-09-14T10:43:39.603 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 127 k 2024-09-14T10:43:39.603 INFO:teuthology.orchestra.run.smithi118.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-14T10:43:39.603 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T10:43:39.603 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados x86_64 2:19.3.0-4907.ga2782315.el9 ceph 320 k 2024-09-14T10:43:39.603 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 305 k 2024-09-14T10:43:39.603 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 99 k 2024-09-14T10:43:39.603 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 85 k 2024-09-14T10:43:39.603 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T10:43:39.603 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 171 k 2024-09-14T10:43:39.604 INFO:teuthology.orchestra.run.smithi118.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-14T10:43:39.604 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrading: 2024-09-14T10:43:39.604 INFO:teuthology.orchestra.run.smithi118.stdout: librados2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.5 M 2024-09-14T10:43:39.604 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T10:43:39.604 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2024-09-14T10:43:39.604 INFO:teuthology.orchestra.run.smithi118.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-14T10:43:39.604 INFO:teuthology.orchestra.run.smithi118.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T10:43:39.604 INFO:teuthology.orchestra.run.smithi118.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-14T10:43:39.604 INFO:teuthology.orchestra.run.smithi118.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-14T10:43:39.604 INFO:teuthology.orchestra.run.smithi118.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-14T10:43:39.604 INFO:teuthology.orchestra.run.smithi118.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-14T10:43:39.605 INFO:teuthology.orchestra.run.smithi118.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-14T10:43:39.605 INFO:teuthology.orchestra.run.smithi118.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-14T10:43:39.605 INFO:teuthology.orchestra.run.smithi118.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-14T10:43:39.605 INFO:teuthology.orchestra.run.smithi118.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-14T10:43:39.605 INFO:teuthology.orchestra.run.smithi118.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-14T10:43:39.605 INFO:teuthology.orchestra.run.smithi118.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-14T10:43:39.605 INFO:teuthology.orchestra.run.smithi118.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-14T10:43:39.605 INFO:teuthology.orchestra.run.smithi118.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-14T10:43:39.605 INFO:teuthology.orchestra.run.smithi118.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-14T10:43:39.605 INFO:teuthology.orchestra.run.smithi118.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T10:43:39.605 INFO:teuthology.orchestra.run.smithi118.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-14T10:43:39.605 INFO:teuthology.orchestra.run.smithi118.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-14T10:43:39.605 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 22 M 2024-09-14T10:43:39.605 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 34 k 2024-09-14T10:43:39.606 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds x86_64 2:19.3.0-4907.ga2782315.el9 ceph 2.4 M 2024-09-14T10:43:39.606 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 291 k 2024-09-14T10:43:39.606 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon x86_64 2:19.3.0-4907.ga2782315.el9 ceph 4.8 M 2024-09-14T10:43:39.606 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 17 M 2024-09-14T10:43:39.606 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 16 k 2024-09-14T10:43:39.606 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux x86_64 2:19.3.0-4907.ga2782315.el9 ceph 25 k 2024-09-14T10:43:39.606 INFO:teuthology.orchestra.run.smithi118.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-14T10:43:39.606 INFO:teuthology.orchestra.run.smithi118.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-14T10:43:39.606 INFO:teuthology.orchestra.run.smithi118.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-14T10:43:39.606 INFO:teuthology.orchestra.run.smithi118.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-14T10:43:39.606 INFO:teuthology.orchestra.run.smithi118.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-14T10:43:39.606 INFO:teuthology.orchestra.run.smithi118.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-14T10:43:39.606 INFO:teuthology.orchestra.run.smithi118.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-14T10:43:39.607 INFO:teuthology.orchestra.run.smithi118.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-14T10:43:39.607 INFO:teuthology.orchestra.run.smithi118.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-14T10:43:39.607 INFO:teuthology.orchestra.run.smithi118.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-14T10:43:39.607 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T10:43:39.607 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T10:43:39.607 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T10:43:39.607 INFO:teuthology.orchestra.run.smithi118.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T10:43:39.607 INFO:teuthology.orchestra.run.smithi118.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-14T10:43:39.607 INFO:teuthology.orchestra.run.smithi118.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-14T10:43:39.607 INFO:teuthology.orchestra.run.smithi118.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-14T10:43:39.607 INFO:teuthology.orchestra.run.smithi118.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-14T10:43:39.607 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T10:43:39.607 INFO:teuthology.orchestra.run.smithi118.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-14T10:43:39.607 INFO:teuthology.orchestra.run.smithi118.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T10:43:39.607 INFO:teuthology.orchestra.run.smithi118.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-14T10:43:39.608 INFO:teuthology.orchestra.run.smithi118.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-14T10:43:39.608 INFO:teuthology.orchestra.run.smithi118.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-14T10:43:39.608 INFO:teuthology.orchestra.run.smithi118.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-14T10:43:39.608 INFO:teuthology.orchestra.run.smithi118.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-14T10:43:39.608 INFO:teuthology.orchestra.run.smithi118.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-14T10:43:39.608 INFO:teuthology.orchestra.run.smithi118.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-14T10:43:39.608 INFO:teuthology.orchestra.run.smithi118.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-14T10:43:39.608 INFO:teuthology.orchestra.run.smithi118.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-14T10:43:39.608 INFO:teuthology.orchestra.run.smithi118.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-14T10:43:39.608 INFO:teuthology.orchestra.run.smithi118.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-14T10:43:39.608 INFO:teuthology.orchestra.run.smithi118.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-14T10:43:39.608 INFO:teuthology.orchestra.run.smithi118.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-14T10:43:39.608 INFO:teuthology.orchestra.run.smithi118.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-14T10:43:39.609 INFO:teuthology.orchestra.run.smithi118.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-14T10:43:39.609 INFO:teuthology.orchestra.run.smithi118.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-14T10:43:39.609 INFO:teuthology.orchestra.run.smithi118.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-14T10:43:39.609 INFO:teuthology.orchestra.run.smithi118.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-14T10:43:39.609 INFO:teuthology.orchestra.run.smithi118.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-14T10:43:39.609 INFO:teuthology.orchestra.run.smithi118.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-14T10:43:39.609 INFO:teuthology.orchestra.run.smithi118.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-14T10:43:39.610 INFO:teuthology.orchestra.run.smithi118.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-14T10:43:39.610 INFO:teuthology.orchestra.run.smithi118.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-14T10:43:39.610 INFO:teuthology.orchestra.run.smithi118.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-14T10:43:39.610 INFO:teuthology.orchestra.run.smithi118.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-14T10:43:39.610 INFO:teuthology.orchestra.run.smithi118.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-14T10:43:39.610 INFO:teuthology.orchestra.run.smithi118.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-14T10:43:39.610 INFO:teuthology.orchestra.run.smithi118.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-14T10:43:39.610 INFO:teuthology.orchestra.run.smithi118.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-14T10:43:39.611 INFO:teuthology.orchestra.run.smithi118.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-14T10:43:39.611 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T10:43:39.611 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T10:43:39.611 INFO:teuthology.orchestra.run.smithi118.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-14T10:43:39.611 INFO:teuthology.orchestra.run.smithi118.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-14T10:43:39.611 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T10:43:39.611 INFO:teuthology.orchestra.run.smithi118.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-14T10:43:39.611 INFO:teuthology.orchestra.run.smithi118.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-14T10:43:39.611 INFO:teuthology.orchestra.run.smithi118.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-14T10:43:39.611 INFO:teuthology.orchestra.run.smithi118.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-14T10:43:39.612 INFO:teuthology.orchestra.run.smithi118.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-14T10:43:39.612 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T10:43:39.612 INFO:teuthology.orchestra.run.smithi118.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-14T10:43:39.612 INFO:teuthology.orchestra.run.smithi118.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-14T10:43:39.612 INFO:teuthology.orchestra.run.smithi118.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-14T10:43:39.612 INFO:teuthology.orchestra.run.smithi118.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-14T10:43:39.612 INFO:teuthology.orchestra.run.smithi118.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-14T10:43:39.612 INFO:teuthology.orchestra.run.smithi118.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-14T10:43:39.612 INFO:teuthology.orchestra.run.smithi118.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-14T10:43:39.612 INFO:teuthology.orchestra.run.smithi118.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T10:43:39.612 INFO:teuthology.orchestra.run.smithi118.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-14T10:43:39.613 INFO:teuthology.orchestra.run.smithi118.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T10:43:39.613 INFO:teuthology.orchestra.run.smithi118.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-14T10:43:39.613 INFO:teuthology.orchestra.run.smithi118.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-14T10:43:39.613 INFO:teuthology.orchestra.run.smithi118.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-14T10:43:39.613 INFO:teuthology.orchestra.run.smithi118.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T10:43:39.613 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T10:43:39.613 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T10:43:39.613 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 508 k 2024-09-14T10:43:39.613 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T10:43:39.613 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T10:43:39.613 INFO:teuthology.orchestra.run.smithi118.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-14T10:43:39.613 INFO:teuthology.orchestra.run.smithi118.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-14T10:43:39.614 INFO:teuthology.orchestra.run.smithi118.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-14T10:43:39.614 INFO:teuthology.orchestra.run.smithi118.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-14T10:43:39.614 INFO:teuthology.orchestra.run.smithi118.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-14T10:43:39.614 INFO:teuthology.orchestra.run.smithi118.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-14T10:43:39.614 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T10:43:39.614 INFO:teuthology.orchestra.run.smithi118.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-14T10:43:39.614 INFO:teuthology.orchestra.run.smithi118.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-14T10:43:39.615 INFO:teuthology.orchestra.run.smithi118.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-14T10:43:39.615 INFO:teuthology.orchestra.run.smithi118.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-14T10:43:39.615 INFO:teuthology.orchestra.run.smithi118.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-14T10:43:39.615 INFO:teuthology.orchestra.run.smithi118.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-14T10:43:39.615 INFO:teuthology.orchestra.run.smithi118.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-14T10:43:39.615 INFO:teuthology.orchestra.run.smithi118.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-14T10:43:39.615 INFO:teuthology.orchestra.run.smithi118.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-14T10:43:39.615 INFO:teuthology.orchestra.run.smithi118.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-14T10:43:39.615 INFO:teuthology.orchestra.run.smithi118.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-14T10:43:39.615 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T10:43:39.615 INFO:teuthology.orchestra.run.smithi118.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T10:43:39.616 INFO:teuthology.orchestra.run.smithi118.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T10:43:39.616 INFO:teuthology.orchestra.run.smithi118.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-14T10:43:39.616 INFO:teuthology.orchestra.run.smithi118.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T10:43:39.616 INFO:teuthology.orchestra.run.smithi118.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-14T10:43:39.616 INFO:teuthology.orchestra.run.smithi118.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-14T10:43:39.616 INFO:teuthology.orchestra.run.smithi118.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-14T10:43:39.616 INFO:teuthology.orchestra.run.smithi118.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-14T10:43:39.616 INFO:teuthology.orchestra.run.smithi118.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-14T10:43:39.616 INFO:teuthology.orchestra.run.smithi118.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-14T10:43:39.616 INFO:teuthology.orchestra.run.smithi118.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-14T10:43:39.616 INFO:teuthology.orchestra.run.smithi118.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-14T10:43:39.616 INFO:teuthology.orchestra.run.smithi118.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-14T10:43:39.617 INFO:teuthology.orchestra.run.smithi118.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-14T10:43:39.617 INFO:teuthology.orchestra.run.smithi118.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-14T10:43:39.617 INFO:teuthology.orchestra.run.smithi118.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T10:43:39.617 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T10:43:39.617 INFO:teuthology.orchestra.run.smithi118.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-14T10:43:39.617 INFO:teuthology.orchestra.run.smithi118.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-14T10:43:39.617 INFO:teuthology.orchestra.run.smithi118.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-14T10:43:39.617 INFO:teuthology.orchestra.run.smithi118.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-14T10:43:39.617 INFO:teuthology.orchestra.run.smithi118.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-14T10:43:39.617 INFO:teuthology.orchestra.run.smithi118.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-14T10:43:39.617 INFO:teuthology.orchestra.run.smithi118.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T10:43:39.617 INFO:teuthology.orchestra.run.smithi118.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-14T10:43:39.617 INFO:teuthology.orchestra.run.smithi118.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-14T10:43:39.617 INFO:teuthology.orchestra.run.smithi118.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-14T10:43:39.618 INFO:teuthology.orchestra.run.smithi118.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-14T10:43:39.618 INFO:teuthology.orchestra.run.smithi118.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-14T10:43:39.618 INFO:teuthology.orchestra.run.smithi118.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-14T10:43:39.618 INFO:teuthology.orchestra.run.smithi118.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-14T10:43:39.618 INFO:teuthology.orchestra.run.smithi118.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-14T10:43:39.618 INFO:teuthology.orchestra.run.smithi118.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-14T10:43:39.618 INFO:teuthology.orchestra.run.smithi118.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-14T10:43:39.618 INFO:teuthology.orchestra.run.smithi118.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-14T10:43:39.618 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T10:43:39.618 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T10:43:39.618 INFO:teuthology.orchestra.run.smithi118.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-14T10:43:39.618 INFO:teuthology.orchestra.run.smithi118.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-14T10:43:39.619 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T10:43:39.619 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T10:43:39.619 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T10:43:39.619 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T10:43:39.619 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 45 k 2024-09-14T10:43:39.619 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 143 k 2024-09-14T10:43:39.619 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T10:43:39.619 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T10:43:39.619 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T10:43:39.619 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T10:43:39.619 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T10:43:39.619 INFO:teuthology.orchestra.run.smithi118.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T10:43:39.619 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T10:43:39.619 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T10:43:39.620 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T10:43:39.620 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T10:43:39.620 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T10:43:39.620 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-14T10:43:39.620 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T10:43:39.620 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T10:43:39.620 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T10:43:39.620 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T10:43:39.620 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T10:43:39.620 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T10:43:39.620 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T10:43:39.621 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T10:43:39.621 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T10:43:39.621 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T10:43:39.621 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T10:43:39.621 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T10:43:39.621 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T10:43:39.621 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T10:43:39.621 INFO:teuthology.orchestra.run.smithi118.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T10:43:39.621 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T10:43:39.621 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T10:43:39.621 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T10:43:39.621 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T10:43:39.621 INFO:teuthology.orchestra.run.smithi118.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T10:43:39.622 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T10:43:39.622 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T10:43:39.622 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T10:43:39.622 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T10:43:39.622 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T10:43:39.622 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T10:43:39.622 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T10:43:39.622 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T10:43:39.622 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T10:43:39.622 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T10:43:39.622 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T10:43:39.622 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T10:43:39.622 INFO:teuthology.orchestra.run.smithi118.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T10:43:39.622 INFO:teuthology.orchestra.run.smithi118.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T10:43:39.623 INFO:teuthology.orchestra.run.smithi118.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T10:43:39.623 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T10:43:39.623 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T10:43:39.623 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T10:43:39.623 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T10:43:39.623 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T10:43:39.623 INFO:teuthology.orchestra.run.smithi118.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T10:43:39.623 INFO:teuthology.orchestra.run.smithi118.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T10:43:39.623 INFO:teuthology.orchestra.run.smithi118.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-14T10:43:39.623 INFO:teuthology.orchestra.run.smithi118.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-14T10:43:39.623 INFO:teuthology.orchestra.run.smithi118.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-14T10:43:39.623 INFO:teuthology.orchestra.run.smithi118.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T10:43:39.623 INFO:teuthology.orchestra.run.smithi118.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-14T10:43:39.624 INFO:teuthology.orchestra.run.smithi118.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T10:43:39.624 INFO:teuthology.orchestra.run.smithi118.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-14T10:43:39.624 INFO:teuthology.orchestra.run.smithi118.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-14T10:43:39.624 INFO:teuthology.orchestra.run.smithi118.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-14T10:43:39.624 INFO:teuthology.orchestra.run.smithi118.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-14T10:43:39.624 INFO:teuthology.orchestra.run.smithi118.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-14T10:43:39.624 INFO:teuthology.orchestra.run.smithi118.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-14T10:43:39.624 INFO:teuthology.orchestra.run.smithi118.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-14T10:43:39.624 INFO:teuthology.orchestra.run.smithi118.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-14T10:43:39.624 INFO:teuthology.orchestra.run.smithi118.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-14T10:43:39.624 INFO:teuthology.orchestra.run.smithi118.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-14T10:43:39.624 INFO:teuthology.orchestra.run.smithi118.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-14T10:43:39.624 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T10:43:39.624 INFO:teuthology.orchestra.run.smithi118.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-14T10:43:39.625 INFO:teuthology.orchestra.run.smithi118.stdout:Installing weak dependencies: 2024-09-14T10:43:39.625 INFO:teuthology.orchestra.run.smithi118.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-14T10:43:39.625 INFO:teuthology.orchestra.run.smithi118.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-14T10:43:39.625 INFO:teuthology.orchestra.run.smithi118.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-14T10:43:39.625 INFO:teuthology.orchestra.run.smithi118.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-14T10:43:39.625 INFO:teuthology.orchestra.run.smithi118.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-14T10:43:39.625 INFO:teuthology.orchestra.run.smithi118.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-14T10:43:39.625 INFO:teuthology.orchestra.run.smithi118.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-14T10:43:39.625 INFO:teuthology.orchestra.run.smithi118.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-14T10:43:39.625 INFO:teuthology.orchestra.run.smithi118.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-14T10:43:39.625 INFO:teuthology.orchestra.run.smithi118.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-14T10:43:39.625 INFO:teuthology.orchestra.run.smithi118.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-14T10:43:39.625 INFO:teuthology.orchestra.run.smithi118.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-14T10:43:39.625 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T10:43:39.626 INFO:teuthology.orchestra.run.smithi118.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-14T10:43:39.626 INFO:teuthology.orchestra.run.smithi118.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-14T10:43:39.626 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:43:39.626 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-09-14T10:43:39.626 INFO:teuthology.orchestra.run.smithi118.stdout:====================================================================================================== 2024-09-14T10:43:39.626 INFO:teuthology.orchestra.run.smithi118.stdout:Install 284 Packages 2024-09-14T10:43:39.626 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrade 2 Packages 2024-09-14T10:43:39.626 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:43:39.627 INFO:teuthology.orchestra.run.smithi050.stdout:(39/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 257 kB/s | 49 kB 00:00 2024-09-14T10:43:39.627 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 327 M 2024-09-14T10:43:39.627 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-09-14T10:43:39.645 INFO:teuthology.orchestra.run.smithi050.stdout:(40/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 1.3 MB/s | 262 kB 00:00 2024-09-14T10:43:39.671 INFO:teuthology.orchestra.run.smithi050.stdout:(41/286): fuse-2.9.9-16.el9.x86_64.rpm 1.0 MB/s | 80 kB 00:00 2024-09-14T10:43:39.696 INFO:teuthology.orchestra.run.smithi050.stdout:(42/286): libpciaccess-0.16-7.el9.x86_64.rpm 537 kB/s | 27 kB 00:00 2024-09-14T10:43:39.738 INFO:teuthology.orchestra.run.smithi050.stdout:(43/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 2.2 MB/s | 94 kB 00:00 2024-09-14T10:43:39.763 INFO:teuthology.orchestra.run.smithi050.stdout:(44/286): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-14T10:43:39.797 INFO:teuthology.orchestra.run.smithi050.stdout:(45/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-14T10:43:39.847 INFO:teuthology.orchestra.run.smithi050.stdout:(46/286): libgfortran-11.5.0-2.el9.x86_64.rpm 3.5 MB/s | 801 kB 00:00 2024-09-14T10:43:39.864 INFO:teuthology.orchestra.run.smithi050.stdout:(47/286): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-14T10:43:39.906 INFO:teuthology.orchestra.run.smithi050.stdout:(48/286): python3-pycparser-2.20-6.el9.noarch.r 2.2 MB/s | 135 kB 00:00 2024-09-14T10:43:39.940 INFO:teuthology.orchestra.run.smithi050.stdout:(49/286): python3-cryptography-36.0.1-4.el9.x86 6.9 MB/s | 1.2 MB 00:00 2024-09-14T10:43:39.965 INFO:teuthology.orchestra.run.smithi050.stdout:(50/286): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-09-14T10:43:39.990 INFO:teuthology.orchestra.run.smithi050.stdout:(51/286): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-14T10:43:40.141 INFO:teuthology.orchestra.run.smithi050.stdout:(52/286): adwaita-cursor-theme-40.1.1-3.el9.noa 3.2 MB/s | 650 kB 00:00 2024-09-14T10:43:40.174 INFO:teuthology.orchestra.run.smithi050.stdout:(53/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 2.8 MB/s | 523 kB 00:00 2024-09-14T10:43:40.199 INFO:teuthology.orchestra.run.smithi050.stdout:(54/286): apache-commons-cli-1.4-17.el9.noarch. 1.2 MB/s | 71 kB 00:00 2024-09-14T10:43:40.224 INFO:teuthology.orchestra.run.smithi050.stdout:(55/286): apache-commons-codec-1.15-7.el9.noarc 5.9 MB/s | 302 kB 00:00 2024-09-14T10:43:40.251 INFO:teuthology.orchestra.run.smithi050.stdout:(56/286): apache-commons-io-2.8.0-8.el9.noarch. 5.5 MB/s | 283 kB 00:00 2024-09-14T10:43:40.284 INFO:teuthology.orchestra.run.smithi050.stdout:(57/286): apache-commons-lang3-3.12.0-6.el9.noa 9.3 MB/s | 559 kB 00:00 2024-09-14T10:43:40.301 INFO:teuthology.orchestra.run.smithi050.stdout:(58/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-09-14T10:43:40.326 INFO:teuthology.orchestra.run.smithi050.stdout:(59/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 4.6 MB/s | 195 kB 00:00 2024-09-14T10:43:40.351 INFO:teuthology.orchestra.run.smithi050.stdout:(60/286): atinject-1.0.3-6.el9.noarch.rpm 464 kB/s | 23 kB 00:00 2024-09-14T10:43:40.376 INFO:teuthology.orchestra.run.smithi050.stdout:(61/286): atk-2.36.0-5.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-14T10:43:40.401 INFO:teuthology.orchestra.run.smithi050.stdout:(62/286): avahi-glib-0.8-21.el9.x86_64.rpm 296 kB/s | 15 kB 00:00 2024-09-14T10:43:40.427 INFO:teuthology.orchestra.run.smithi050.stdout:(63/286): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-14T10:43:40.452 INFO:teuthology.orchestra.run.smithi050.stdout:(64/286): cdi-api-2.0.2-6.el9.noarch.rpm 1.0 MB/s | 53 kB 00:00 2024-09-14T10:43:40.469 INFO:teuthology.orchestra.run.smithi050.stdout:(65/286): colord-libs-1.4.5-4.el9.x86_64.rpm 5.3 MB/s | 229 kB 00:00 2024-09-14T10:43:40.474 INFO:teuthology.orchestra.run.smithi118.stdout:(1/286): ceph-19.3.0-4907.ga2782315.el9.x86_64. 49 kB/s | 6.6 kB 00:00 2024-09-14T10:43:40.494 INFO:teuthology.orchestra.run.smithi050.stdout:(66/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.4 MB/s | 61 kB 00:00 2024-09-14T10:43:40.519 INFO:teuthology.orchestra.run.smithi050.stdout:(67/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 564 kB/s | 28 kB 00:00 2024-09-14T10:43:40.545 INFO:teuthology.orchestra.run.smithi050.stdout:(68/286): dconf-0.40.0-6.el9.x86_64.rpm 2.2 MB/s | 113 kB 00:00 2024-09-14T10:43:40.578 INFO:teuthology.orchestra.run.smithi050.stdout:(69/286): exempi-2.6.0-0.2.20211007gite23c213.e 8.8 MB/s | 525 kB 00:00 2024-09-14T10:43:40.620 INFO:teuthology.orchestra.run.smithi050.stdout:(70/286): exiv2-0.27.5-2.el9.x86_64.rpm 13 MB/s | 980 kB 00:00 2024-09-14T10:43:40.654 INFO:teuthology.orchestra.run.smithi050.stdout:(71/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 10 MB/s | 781 kB 00:00 2024-09-14T10:43:40.679 INFO:teuthology.orchestra.run.smithi050.stdout:(72/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 5.4 MB/s | 325 kB 00:00 2024-09-14T10:43:40.705 INFO:teuthology.orchestra.run.smithi050.stdout:(73/286): flac-libs-1.3.3-12.el9.x86_64.rpm 4.2 MB/s | 218 kB 00:00 2024-09-14T10:43:40.724 INFO:teuthology.orchestra.run.smithi118.stdout:(2/286): ceph-fuse-19.3.0-4907.ga2782315.el9.x8 3.5 MB/s | 900 kB 00:00 2024-09-14T10:43:40.755 INFO:teuthology.orchestra.run.smithi050.stdout:(74/286): flatpak-1.12.9-1.el9.x86_64.rpm 23 MB/s | 1.7 MB 00:00 2024-09-14T10:43:40.780 INFO:teuthology.orchestra.run.smithi050.stdout:(75/286): flatpak-selinux-1.12.9-1.el9.noarch.r 288 kB/s | 22 kB 00:00 2024-09-14T10:43:40.805 INFO:teuthology.orchestra.run.smithi050.stdout:(76/286): flatpak-session-helper-1.12.9-1.el9.x 1.4 MB/s | 73 kB 00:00 2024-09-14T10:43:40.825 INFO:teuthology.orchestra.run.smithi118.stdout:(3/286): ceph-base-19.3.0-4907.ga2782315.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-14T10:43:40.830 INFO:teuthology.orchestra.run.smithi050.stdout:(77/286): flexiblas-3.0.4-8.el9.x86_64.rpm 653 kB/s | 33 kB 00:00 2024-09-14T10:43:40.859 INFO:teuthology.orchestra.run.smithi118.stdout:(4/286): ceph-immutable-object-cache-19.3.0-490 1.1 MB/s | 145 kB 00:00 2024-09-14T10:43:40.906 INFO:teuthology.orchestra.run.smithi050.stdout:(78/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 30 MB/s | 3.0 MB 00:00 2024-09-14T10:43:40.932 INFO:teuthology.orchestra.run.smithi050.stdout:(79/286): flexiblas-openblas-openmp-3.0.4-8.el9 181 kB/s | 18 kB 00:00 2024-09-14T10:43:40.934 INFO:teuthology.orchestra.run.smithi118.stdout:(5/286): ceph-mds-19.3.0-4907.ga2782315.el9.x86 22 MB/s | 2.4 MB 00:00 2024-09-14T10:43:40.957 INFO:teuthology.orchestra.run.smithi050.stdout:(80/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.7 MB/s | 89 kB 00:00 2024-09-14T10:43:40.982 INFO:teuthology.orchestra.run.smithi050.stdout:(81/286): geoclue2-2.6.0-7.el9.x86_64.rpm 2.4 MB/s | 124 kB 00:00 2024-09-14T10:43:41.007 INFO:teuthology.orchestra.run.smithi050.stdout:(82/286): giflib-5.2.1-9.el9.x86_64.rpm 966 kB/s | 49 kB 00:00 2024-09-14T10:43:41.033 INFO:teuthology.orchestra.run.smithi050.stdout:(83/286): google-guice-4.2.3-9.el9.noarch.rpm 9.2 MB/s | 473 kB 00:00 2024-09-14T10:43:41.076 INFO:teuthology.orchestra.run.smithi118.stdout:(6/286): ceph-mgr-19.3.0-4907.ga2782315.el9.x86 7.0 MB/s | 1.5 MB 00:00 2024-09-14T10:43:41.158 INFO:teuthology.orchestra.run.smithi050.stdout:(84/286): adwaita-icon-theme-40.1.1-3.el9.noarc 10 MB/s | 12 MB 00:01 2024-09-14T10:43:41.175 INFO:teuthology.orchestra.run.smithi050.stdout:(85/286): graphene-1.10.6-2.el9.x86_64.rpm 385 kB/s | 64 kB 00:00 2024-09-14T10:43:41.193 INFO:teuthology.orchestra.run.smithi118.stdout:(7/286): ceph-mon-19.3.0-4907.ga2782315.el9.x86 19 MB/s | 4.8 MB 00:00 2024-09-14T10:43:41.200 INFO:teuthology.orchestra.run.smithi050.stdout:(86/286): gsm-1.0.19-6.el9.x86_64.rpm 204 kB/s | 34 kB 00:00 2024-09-14T10:43:41.242 INFO:teuthology.orchestra.run.smithi050.stdout:(87/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 17 MB/s | 1.4 MB 00:00 2024-09-14T10:43:41.267 INFO:teuthology.orchestra.run.smithi050.stdout:(88/286): gtk-update-icon-cache-3.24.31-5.el9.x 497 kB/s | 33 kB 00:00 2024-09-14T10:43:41.318 INFO:teuthology.orchestra.run.smithi050.stdout:(89/286): gstreamer1-plugins-base-1.22.1-2.el9. 16 MB/s | 2.2 MB 00:00 2024-09-14T10:43:41.385 INFO:teuthology.orchestra.run.smithi050.stdout:(90/286): guava-30.1-6.el9.noarch.rpm 20 MB/s | 2.3 MB 00:00 2024-09-14T10:43:41.410 INFO:teuthology.orchestra.run.smithi050.stdout:(91/286): hicolor-icon-theme-0.17-13.el9.noarch 2.3 MB/s | 219 kB 00:00 2024-09-14T10:43:41.485 INFO:teuthology.orchestra.run.smithi050.stdout:(92/286): gtk3-3.24.31-5.el9.x86_64.rpm 20 MB/s | 4.9 MB 00:00 2024-09-14T10:43:41.519 INFO:teuthology.orchestra.run.smithi050.stdout:(93/286): httpcomponents-client-4.5.13-3.el9.no 4.8 MB/s | 657 kB 00:00 2024-09-14T10:43:41.543 INFO:teuthology.orchestra.run.smithi118.stdout:(8/286): ceph-common-19.3.0-4907.ga2782315.el9. 18 MB/s | 22 MB 00:01 2024-09-14T10:43:41.544 INFO:teuthology.orchestra.run.smithi050.stdout:(94/286): httpcomponents-core-4.4.13-7.el9.noar 4.6 MB/s | 632 kB 00:00 2024-09-14T10:43:41.569 INFO:teuthology.orchestra.run.smithi050.stdout:(95/286): jakarta-annotations-1.3.5-13.el9.noar 897 kB/s | 45 kB 00:00 2024-09-14T10:43:41.585 INFO:teuthology.orchestra.run.smithi118.stdout:(9/286): ceph-selinux-19.3.0-4907.ga2782315.el9 608 kB/s | 25 kB 00:00 2024-09-14T10:43:41.594 INFO:teuthology.orchestra.run.smithi050.stdout:(96/286): jansi-2.3.3-6.el9.x86_64.rpm 2.1 MB/s | 110 kB 00:00 2024-09-14T10:43:41.620 INFO:teuthology.orchestra.run.smithi050.stdout:(97/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 8.1 MB/s | 413 kB 00:00 2024-09-14T10:43:41.720 INFO:teuthology.orchestra.run.smithi050.stdout:(98/286): iso-codes-4.6.0-3.el9.noarch.rpm 15 MB/s | 3.5 MB 00:00 2024-09-14T10:43:41.752 INFO:teuthology.orchestra.run.smithi118.stdout:(10/286): ceph-radosgw-19.3.0-4907.ga2782315.el 20 MB/s | 11 MB 00:00 2024-09-14T10:43:41.779 INFO:teuthology.orchestra.run.smithi050.stdout:(99/286): java-11-openjdk-devel-11.0.20.1.1-2.e 18 MB/s | 3.3 MB 00:00 2024-09-14T10:43:41.785 INFO:teuthology.orchestra.run.smithi118.stdout:(11/286): libcephfs-devel-19.3.0-4907.ga2782315 958 kB/s | 32 kB 00:00 2024-09-14T10:43:41.804 INFO:teuthology.orchestra.run.smithi050.stdout:(100/286): javapackages-filesystem-6.0.0-4.el9. 156 kB/s | 13 kB 00:00 2024-09-14T10:43:41.829 INFO:teuthology.orchestra.run.smithi050.stdout:(101/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 1.0 MB/s | 53 kB 00:00 2024-09-14T10:43:41.854 INFO:teuthology.orchestra.run.smithi050.stdout:(102/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 478 kB/s | 24 kB 00:00 2024-09-14T10:43:41.869 INFO:teuthology.orchestra.run.smithi118.stdout:(12/286): libcephfs2-19.3.0-4907.ga2782315.el9. 8.9 MB/s | 756 kB 00:00 2024-09-14T10:43:41.880 INFO:teuthology.orchestra.run.smithi050.stdout:(103/286): jsoup-1.13.1-10.el9.noarch.rpm 7.3 MB/s | 377 kB 00:00 2024-09-14T10:43:41.905 INFO:teuthology.orchestra.run.smithi050.stdout:(104/286): jsr-305-3.0.2-6.el9.noarch.rpm 710 kB/s | 35 kB 00:00 2024-09-14T10:43:41.930 INFO:teuthology.orchestra.run.smithi050.stdout:(105/286): lcms2-2.12-3.el9.x86_64.rpm 3.3 MB/s | 168 kB 00:00 2024-09-14T10:43:41.947 INFO:teuthology.orchestra.run.smithi050.stdout:(106/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 265 kB/s | 11 kB 00:00 2024-09-14T10:43:41.964 INFO:teuthology.orchestra.run.smithi050.stdout:(107/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 724 kB/s | 24 kB 00:00 2024-09-14T10:43:41.981 INFO:teuthology.orchestra.run.smithi050.stdout:(108/286): libXcursor-1.2.0-7.el9.x86_64.rpm 912 kB/s | 31 kB 00:00 2024-09-14T10:43:41.998 INFO:teuthology.orchestra.run.smithi050.stdout:(109/286): libXdamage-1.1.5-7.el9.x86_64.rpm 677 kB/s | 23 kB 00:00 2024-09-14T10:43:42.015 INFO:teuthology.orchestra.run.smithi050.stdout:(110/286): libXfixes-5.0.3-16.el9.x86_64.rpm 591 kB/s | 20 kB 00:00 2024-09-14T10:43:42.029 INFO:teuthology.orchestra.run.smithi118.stdout:(13/286): libcephsqlite-19.3.0-4907.ga2782315.e 1.0 MB/s | 161 kB 00:00 2024-09-14T10:43:42.040 INFO:teuthology.orchestra.run.smithi050.stdout:(111/286): libXi-1.7.10-8.el9.x86_64.rpm 946 kB/s | 40 kB 00:00 2024-09-14T10:43:42.066 INFO:teuthology.orchestra.run.smithi050.stdout:(112/286): libXinerama-1.1.4-10.el9.x86_64.rpm 300 kB/s | 15 kB 00:00 2024-09-14T10:43:42.091 INFO:teuthology.orchestra.run.smithi050.stdout:(113/286): libXrandr-1.5.2-8.el9.x86_64.rpm 565 kB/s | 28 kB 00:00 2024-09-14T10:43:42.111 INFO:teuthology.orchestra.run.smithi118.stdout:(14/286): librados-devel-19.3.0-4907.ga2782315. 1.6 MB/s | 127 kB 00:00 2024-09-14T10:43:42.116 INFO:teuthology.orchestra.run.smithi050.stdout:(114/286): libXtst-1.2.3-16.el9.x86_64.rpm 428 kB/s | 21 kB 00:00 2024-09-14T10:43:42.144 INFO:teuthology.orchestra.run.smithi050.stdout:(115/286): libXv-1.0.11-16.el9.x86_64.rpm 381 kB/s | 19 kB 00:00 2024-09-14T10:43:42.167 INFO:teuthology.orchestra.run.smithi050.stdout:(116/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 376 kB/s | 19 kB 00:00 2024-09-14T10:43:42.192 INFO:teuthology.orchestra.run.smithi050.stdout:(117/286): libasyncns-0.8-22.el9.x86_64.rpm 608 kB/s | 30 kB 00:00 2024-09-14T10:43:42.217 INFO:teuthology.orchestra.run.smithi050.stdout:(118/286): libcanberra-0.30-27.el9.x86_64.rpm 1.7 MB/s | 86 kB 00:00 2024-09-14T10:43:42.243 INFO:teuthology.orchestra.run.smithi050.stdout:(119/286): libcanberra-gtk3-0.30-27.el9.x86_64. 632 kB/s | 32 kB 00:00 2024-09-14T10:43:42.268 INFO:teuthology.orchestra.run.smithi050.stdout:(120/286): libdrm-2.4.121-1.el9.x86_64.rpm 3.1 MB/s | 161 kB 00:00 2024-09-14T10:43:42.293 INFO:teuthology.orchestra.run.smithi050.stdout:(121/286): libepoxy-1.5.5-4.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-09-14T10:43:42.318 INFO:teuthology.orchestra.run.smithi050.stdout:(122/286): libexif-0.6.22-6.el9.x86_64.rpm 8.5 MB/s | 435 kB 00:00 2024-09-14T10:43:42.337 INFO:teuthology.orchestra.run.smithi118.stdout:(15/286): ceph-osd-19.3.0-4907.ga2782315.el9.x8 14 MB/s | 17 MB 00:01 2024-09-14T10:43:42.344 INFO:teuthology.orchestra.run.smithi050.stdout:(123/286): libfontenc-1.1.3-17.el9.x86_64.rpm 616 kB/s | 31 kB 00:00 2024-09-14T10:43:42.369 INFO:teuthology.orchestra.run.smithi050.stdout:(124/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2024-09-14T10:43:42.370 INFO:teuthology.orchestra.run.smithi118.stdout:(16/286): libradosstriper1-19.3.0-4907.ga278231 1.9 MB/s | 508 kB 00:00 2024-09-14T10:43:42.395 INFO:teuthology.orchestra.run.smithi050.stdout:(125/286): libglvnd-1.3.4-1.el9.x86_64.rpm 2.6 MB/s | 135 kB 00:00 2024-09-14T10:43:42.420 INFO:teuthology.orchestra.run.smithi050.stdout:(126/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 732 kB/s | 37 kB 00:00 2024-09-14T10:43:42.421 INFO:teuthology.orchestra.run.smithi118.stdout:(17/286): python3-ceph-argparse-19.3.0-4907.ga2 902 kB/s | 45 kB 00:00 2024-09-14T10:43:42.445 INFO:teuthology.orchestra.run.smithi050.stdout:(127/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.8 MB/s | 142 kB 00:00 2024-09-14T10:43:42.470 INFO:teuthology.orchestra.run.smithi050.stdout:(128/286): libgsf-1.14.47-5.el9.x86_64.rpm 5.0 MB/s | 256 kB 00:00 2024-09-14T10:43:42.495 INFO:teuthology.orchestra.run.smithi050.stdout:(129/286): libgxps-0.3.2-3.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-09-14T10:43:42.513 INFO:teuthology.orchestra.run.smithi118.stdout:(18/286): python3-ceph-common-19.3.0-4907.ga278 1.5 MB/s | 143 kB 00:00 2024-09-14T10:43:42.521 INFO:teuthology.orchestra.run.smithi050.stdout:(130/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-14T10:43:42.546 INFO:teuthology.orchestra.run.smithi050.stdout:(131/286): libldac-2.0.2.3-10.el9.x86_64.rpm 825 kB/s | 41 kB 00:00 2024-09-14T10:43:42.571 INFO:teuthology.orchestra.run.smithi050.stdout:(132/286): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-14T10:43:42.597 INFO:teuthology.orchestra.run.smithi050.stdout:(133/286): libnotify-0.7.9-8.el9.x86_64.rpm 870 kB/s | 44 kB 00:00 2024-09-14T10:43:42.605 INFO:teuthology.orchestra.run.smithi118.stdout:(19/286): librgw2-19.3.0-4907.ga2782315.el9.x86 21 MB/s | 5.5 MB 00:00 2024-09-14T10:43:42.622 INFO:teuthology.orchestra.run.smithi050.stdout:(134/286): libogg-1.3.4-6.el9.x86_64.rpm 669 kB/s | 34 kB 00:00 2024-09-14T10:43:42.630 INFO:teuthology.orchestra.run.smithi118.stdout:(20/286): python3-cephfs-19.3.0-4907.ga2782315. 1.3 MB/s | 161 kB 00:00 2024-09-14T10:43:42.647 INFO:teuthology.orchestra.run.smithi050.stdout:(135/286): libosinfo-1.10.0-1.el9.x86_64.rpm 6.2 MB/s | 319 kB 00:00 2024-09-14T10:43:42.655 INFO:teuthology.orchestra.run.smithi118.stdout:(21/286): python3-rados-19.3.0-4907.ga2782315.e 6.3 MB/s | 320 kB 00:00 2024-09-14T10:43:42.672 INFO:teuthology.orchestra.run.smithi050.stdout:(136/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-14T10:43:42.681 INFO:teuthology.orchestra.run.smithi118.stdout:(22/286): python3-rbd-19.3.0-4907.ga2782315.el9 5.9 MB/s | 305 kB 00:00 2024-09-14T10:43:42.706 INFO:teuthology.orchestra.run.smithi118.stdout:(23/286): python3-rgw-19.3.0-4907.ga2782315.el9 1.9 MB/s | 99 kB 00:00 2024-09-14T10:43:42.732 INFO:teuthology.orchestra.run.smithi118.stdout:(24/286): rbd-fuse-19.3.0-4907.ga2782315.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-14T10:43:42.773 INFO:teuthology.orchestra.run.smithi050.stdout:(137/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 361 kB/s | 45 kB 00:00 2024-09-14T10:43:42.790 INFO:teuthology.orchestra.run.smithi118.stdout:(25/286): rbd-nbd-19.3.0-4907.ga2782315.el9.x86 2.9 MB/s | 171 kB 00:00 2024-09-14T10:43:42.807 INFO:teuthology.orchestra.run.smithi050.stdout:(138/286): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-09-14T10:43:42.832 INFO:teuthology.orchestra.run.smithi050.stdout:(139/286): libsbc-1.4-9.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-09-14T10:43:42.857 INFO:teuthology.orchestra.run.smithi118.stdout:(26/286): rbd-mirror-19.3.0-4907.ga2782315.el9. 21 MB/s | 3.2 MB 00:00 2024-09-14T10:43:42.866 INFO:teuthology.orchestra.run.smithi050.stdout:(140/286): libsndfile-1.0.31-8.el9.x86_64.rpm 3.5 MB/s | 206 kB 00:00 2024-09-14T10:43:42.883 INFO:teuthology.orchestra.run.smithi118.stdout:(27/286): ceph-grafana-dashboards-19.3.0-4907.g 372 kB/s | 34 kB 00:00 2024-09-14T10:43:42.891 INFO:teuthology.orchestra.run.smithi050.stdout:(141/286): libtheora-1.1.1-31.el9.x86_64.rpm 2.7 MB/s | 164 kB 00:00 2024-09-14T10:43:42.908 INFO:teuthology.orchestra.run.smithi118.stdout:(28/286): ceph-mgr-cephadm-19.3.0-4907.ga278231 3.0 MB/s | 154 kB 00:00 2024-09-14T10:43:42.916 INFO:teuthology.orchestra.run.smithi050.stdout:(142/286): libtiff-4.4.0-13.el9.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2024-09-14T10:43:42.941 INFO:teuthology.orchestra.run.smithi050.stdout:(143/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 709 kB/s | 36 kB 00:00 2024-09-14T10:43:42.969 INFO:teuthology.orchestra.run.smithi050.stdout:(144/286): libtracker-sparql-3.1.2-3.el9.x86_64 6.3 MB/s | 324 kB 00:00 2024-09-14T10:43:42.992 INFO:teuthology.orchestra.run.smithi050.stdout:(145/286): libvisual-0.4.0-34.el9.x86_64.rpm 2.8 MB/s | 144 kB 00:00 2024-09-14T10:43:43.017 INFO:teuthology.orchestra.run.smithi050.stdout:(146/286): libvorbis-1.3.7-5.el9.x86_64.rpm 3.8 MB/s | 193 kB 00:00 2024-09-14T10:43:43.034 INFO:teuthology.orchestra.run.smithi050.stdout:(147/286): libwayland-client-1.21.0-1.el9.x86_6 796 kB/s | 33 kB 00:00 2024-09-14T10:43:43.051 INFO:teuthology.orchestra.run.smithi050.stdout:(148/286): libwayland-cursor-1.21.0-1.el9.x86_6 580 kB/s | 19 kB 00:00 2024-09-14T10:43:43.068 INFO:teuthology.orchestra.run.smithi050.stdout:(149/286): libwayland-egl-1.21.0-1.el9.x86_64.r 383 kB/s | 13 kB 00:00 2024-09-14T10:43:43.085 INFO:teuthology.orchestra.run.smithi050.stdout:(150/286): libwayland-server-1.21.0-1.el9.x86_6 1.2 MB/s | 42 kB 00:00 2024-09-14T10:43:43.119 INFO:teuthology.orchestra.run.smithi050.stdout:(151/286): libwebp-1.2.0-8.el9.x86_64.rpm 5.4 MB/s | 277 kB 00:00 2024-09-14T10:43:43.144 INFO:teuthology.orchestra.run.smithi050.stdout:(152/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.2 MB/s | 133 kB 00:00 2024-09-14T10:43:43.169 INFO:teuthology.orchestra.run.smithi050.stdout:(153/286): libxshmfence-1.3-10.el9.x86_64.rpm 251 kB/s | 13 kB 00:00 2024-09-14T10:43:43.194 INFO:teuthology.orchestra.run.smithi050.stdout:(154/286): low-memory-monitor-2.1-4.el9.x86_64. 717 kB/s | 36 kB 00:00 2024-09-14T10:43:43.228 INFO:teuthology.orchestra.run.smithi050.stdout:(155/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-14T10:43:43.253 INFO:teuthology.orchestra.run.smithi050.stdout:(156/286): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-14T10:43:43.287 INFO:teuthology.orchestra.run.smithi050.stdout:(157/286): lua-posix-35.0-8.el9.x86_64.rpm 2.5 MB/s | 151 kB 00:00 2024-09-14T10:43:43.312 INFO:teuthology.orchestra.run.smithi050.stdout:(158/286): maven-3.6.3-15.el9.noarch.rpm 303 kB/s | 18 kB 00:00 2024-09-14T10:43:43.354 INFO:teuthology.orchestra.run.smithi050.stdout:(159/286): maven-lib-3.6.3-15.el9.noarch.rpm 22 MB/s | 1.5 MB 00:00 2024-09-14T10:43:43.380 INFO:teuthology.orchestra.run.smithi050.stdout:(160/286): maven-openjdk11-3.6.3-15.el9.noarch. 134 kB/s | 9.0 kB 00:00 2024-09-14T10:43:43.417 INFO:teuthology.orchestra.run.smithi118.stdout:(29/286): ceph-mgr-diskprediction-local-19.3.0- 15 MB/s | 7.4 MB 00:00 2024-09-14T10:43:43.421 INFO:teuthology.orchestra.run.smithi050.stdout:(161/286): maven-resolver-1.6.1-10.el9.noarch.r 7.6 MB/s | 517 kB 00:00 2024-09-14T10:43:43.447 INFO:teuthology.orchestra.run.smithi050.stdout:(162/286): maven-shared-utils-3.3.4-3.el9.noarc 2.2 MB/s | 151 kB 00:00 2024-09-14T10:43:43.472 INFO:teuthology.orchestra.run.smithi050.stdout:(163/286): maven-wagon-3.4.2-7.el9.noarch.rpm 2.2 MB/s | 112 kB 00:00 2024-09-14T10:43:43.514 INFO:teuthology.orchestra.run.smithi050.stdout:(164/286): mesa-filesystem-24.1.2-3.el9.x86_64. 270 kB/s | 11 kB 00:00 2024-09-14T10:43:43.556 INFO:teuthology.orchestra.run.smithi050.stdout:(165/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 3.3 MB/s | 139 kB 00:00 2024-09-14T10:43:43.617 INFO:teuthology.orchestra.run.smithi118.stdout:(30/286): ceph-mgr-dashboard-19.3.0-4907.ga2782 19 MB/s | 14 MB 00:00 2024-09-14T10:43:43.651 INFO:teuthology.orchestra.run.smithi118.stdout:(31/286): ceph-mgr-modules-core-19.3.0-4907.ga2 1.2 MB/s | 291 kB 00:00 2024-09-14T10:43:43.673 INFO:teuthology.orchestra.run.smithi050.stdout:(166/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 39 MB/s | 8.8 MB 00:00 2024-09-14T10:43:43.676 INFO:teuthology.orchestra.run.smithi118.stdout:(32/286): ceph-mgr-rook-19.3.0-4907.ga2782315.e 843 kB/s | 49 kB 00:00 2024-09-14T10:43:43.698 INFO:teuthology.orchestra.run.smithi050.stdout:(167/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 1.2 MB/s | 171 kB 00:00 2024-09-14T10:43:43.701 INFO:teuthology.orchestra.run.smithi118.stdout:(33/286): ceph-prometheus-alerts-19.3.0-4907.ga 327 kB/s | 16 kB 00:00 2024-09-14T10:43:43.724 INFO:teuthology.orchestra.run.smithi050.stdout:(168/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 724 kB/s | 36 kB 00:00 2024-09-14T10:43:43.727 INFO:teuthology.orchestra.run.smithi118.stdout:(34/286): ceph-volume-19.3.0-4907.ga2782315.el9 5.5 MB/s | 285 kB 00:00 2024-09-14T10:43:43.749 INFO:teuthology.orchestra.run.smithi050.stdout:(169/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 915 kB/s | 46 kB 00:00 2024-09-14T10:43:43.760 INFO:teuthology.orchestra.run.smithi118.stdout:(35/286): cephadm-19.3.0-4907.ga2782315.el9.noa 13 MB/s | 784 kB 00:00 2024-09-14T10:43:43.774 INFO:teuthology.orchestra.run.smithi050.stdout:(170/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 643 kB/s | 32 kB 00:00 2024-09-14T10:43:43.800 INFO:teuthology.orchestra.run.smithi050.stdout:(171/286): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-14T10:43:43.841 INFO:teuthology.orchestra.run.smithi050.stdout:(172/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 3.8 MB/s | 163 kB 00:00 2024-09-14T10:43:43.886 INFO:teuthology.orchestra.run.smithi118.stdout:(36/286): bluez-libs-5.56-6.el9.x86_64.rpm 678 kB/s | 85 kB 00:00 2024-09-14T10:43:43.911 INFO:teuthology.orchestra.run.smithi118.stdout:(37/286): ModemManager-glib-1.20.2-1.el9.x86_64 1.8 MB/s | 335 kB 00:00 2024-09-14T10:43:43.917 INFO:teuthology.orchestra.run.smithi050.stdout:(173/286): openblas-openmp-0.3.26-2.el9.x86_64. 35 MB/s | 4.9 MB 00:00 2024-09-14T10:43:43.928 INFO:teuthology.orchestra.run.smithi118.stdout:(38/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-09-14T10:43:43.942 INFO:teuthology.orchestra.run.smithi050.stdout:(174/286): opus-1.3.1-10.el9.x86_64.rpm 1.9 MB/s | 200 kB 00:00 2024-09-14T10:43:43.967 INFO:teuthology.orchestra.run.smithi050.stdout:(175/286): orc-0.4.31-8.el9.x86_64.rpm 3.6 MB/s | 183 kB 00:00 2024-09-14T10:43:44.001 INFO:teuthology.orchestra.run.smithi050.stdout:(176/286): osinfo-db-20240701-2.el9.noarch.rpm 8.9 MB/s | 531 kB 00:00 2024-09-14T10:43:44.026 INFO:teuthology.orchestra.run.smithi050.stdout:(177/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.2 MB/s | 74 kB 00:00 2024-09-14T10:43:44.052 INFO:teuthology.orchestra.run.smithi050.stdout:(178/286): ostree-libs-2024.7-2.el9.x86_64.rpm 9.1 MB/s | 468 kB 00:00 2024-09-14T10:43:44.077 INFO:teuthology.orchestra.run.smithi050.stdout:(179/286): p11-kit-server-0.25.3-2.el9.x86_64.r 4.8 MB/s | 246 kB 00:00 2024-09-14T10:43:44.094 INFO:teuthology.orchestra.run.smithi050.stdout:(180/286): pipewire-1.0.1-1.el9.x86_64.rpm 2.5 MB/s | 107 kB 00:00 2024-09-14T10:43:44.119 INFO:teuthology.orchestra.run.smithi050.stdout:(181/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 1.3 MB/s | 57 kB 00:00 2024-09-14T10:43:44.146 INFO:teuthology.orchestra.run.smithi050.stdout:(182/286): pipewire-jack-audio-connection-kit-1 177 kB/s | 9.1 kB 00:00 2024-09-14T10:43:44.171 INFO:teuthology.orchestra.run.smithi050.stdout:(183/286): pipewire-jack-audio-connection-kit-l 2.6 MB/s | 135 kB 00:00 2024-09-14T10:43:44.221 INFO:teuthology.orchestra.run.smithi050.stdout:(184/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 26 MB/s | 1.9 MB 00:00 2024-09-14T10:43:44.246 INFO:teuthology.orchestra.run.smithi050.stdout:(185/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 2.5 MB/s | 192 kB 00:00 2024-09-14T10:43:44.271 INFO:teuthology.orchestra.run.smithi050.stdout:(186/286): plexus-cipher-1.7-27.el9.noarch.rpm 517 kB/s | 26 kB 00:00 2024-09-14T10:43:44.297 INFO:teuthology.orchestra.run.smithi050.stdout:(187/286): plexus-classworlds-2.6.0-11.el9.noar 1.2 MB/s | 60 kB 00:00 2024-09-14T10:43:44.322 INFO:teuthology.orchestra.run.smithi050.stdout:(188/286): plexus-containers-component-annotati 365 kB/s | 18 kB 00:00 2024-09-14T10:43:44.347 INFO:teuthology.orchestra.run.smithi050.stdout:(189/286): plexus-interpolation-1.26-11.el9.noa 1.6 MB/s | 80 kB 00:00 2024-09-14T10:43:44.373 INFO:teuthology.orchestra.run.smithi050.stdout:(190/286): plexus-sec-dispatcher-1.4-37.el9.noa 670 kB/s | 34 kB 00:00 2024-09-14T10:43:44.398 INFO:teuthology.orchestra.run.smithi050.stdout:(191/286): plexus-utils-3.3.0-10.el9.noarch.rpm 4.9 MB/s | 254 kB 00:00 2024-09-14T10:43:44.429 INFO:teuthology.orchestra.run.smithi118.stdout:(39/286): ceph-test-19.3.0-4907.ga2782315.el9.x 18 MB/s | 50 MB 00:02 2024-09-14T10:43:44.440 INFO:teuthology.orchestra.run.smithi050.stdout:(192/286): poppler-21.01.0-21.el9.x86_64.rpm 16 MB/s | 1.1 MB 00:00 2024-09-14T10:43:44.462 INFO:teuthology.orchestra.run.smithi118.stdout:(40/286): fuse-2.9.9-16.el9.x86_64.rpm 149 kB/s | 80 kB 00:00 2024-09-14T10:43:44.487 INFO:teuthology.orchestra.run.smithi118.stdout:(41/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 455 kB/s | 262 kB 00:00 2024-09-14T10:43:44.490 INFO:teuthology.orchestra.run.smithi050.stdout:(193/286): poppler-data-0.4.9-9.el9.noarch.rpm 20 MB/s | 1.9 MB 00:00 2024-09-14T10:43:44.504 INFO:teuthology.orchestra.run.smithi118.stdout:(42/286): libpciaccess-0.16-7.el9.x86_64.rpm 645 kB/s | 27 kB 00:00 2024-09-14T10:43:44.515 INFO:teuthology.orchestra.run.smithi050.stdout:(194/286): poppler-glib-21.01.0-21.el9.x86_64.r 2.0 MB/s | 152 kB 00:00 2024-09-14T10:43:44.549 INFO:teuthology.orchestra.run.smithi050.stdout:(195/286): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-09-14T10:43:44.554 INFO:teuthology.orchestra.run.smithi118.stdout:(43/286): libquadmath-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-14T10:43:44.583 INFO:teuthology.orchestra.run.smithi050.stdout:(196/286): publicsuffix-list-20210518-3.el9.noa 1.2 MB/s | 83 kB 00:00 2024-09-14T10:43:44.597 INFO:teuthology.orchestra.run.smithi118.stdout:(44/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.0 MB/s | 94 kB 00:00 2024-09-14T10:43:44.622 INFO:teuthology.orchestra.run.smithi118.stdout:(45/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-14T10:43:44.625 INFO:teuthology.orchestra.run.smithi050.stdout:(197/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 8.8 MB/s | 679 kB 00:00 2024-09-14T10:43:44.655 INFO:teuthology.orchestra.run.smithi118.stdout:(46/286): libgfortran-11.5.0-2.el9.x86_64.rpm 3.5 MB/s | 801 kB 00:00 2024-09-14T10:43:44.667 INFO:teuthology.orchestra.run.smithi050.stdout:(198/286): python3-devel-3.9.19-8.el9.x86_64.rp 5.7 MB/s | 245 kB 00:00 2024-09-14T10:43:44.681 INFO:teuthology.orchestra.run.smithi118.stdout:(47/286): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-14T10:43:44.706 INFO:teuthology.orchestra.run.smithi118.stdout:(48/286): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-14T10:43:44.740 INFO:teuthology.orchestra.run.smithi118.stdout:(49/286): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-14T10:43:44.765 INFO:teuthology.orchestra.run.smithi118.stdout:(50/286): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-14T10:43:44.807 INFO:teuthology.orchestra.run.smithi118.stdout:(51/286): python3-cryptography-36.0.1-4.el9.x86 5.8 MB/s | 1.2 MB 00:00 2024-09-14T10:43:44.941 INFO:teuthology.orchestra.run.smithi118.stdout:(52/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 3.8 MB/s | 523 kB 00:00 2024-09-14T10:43:44.966 INFO:teuthology.orchestra.run.smithi118.stdout:(53/286): adwaita-cursor-theme-40.1.1-3.el9.noa 2.8 MB/s | 650 kB 00:00 2024-09-14T10:43:45.025 INFO:teuthology.orchestra.run.smithi118.stdout:(54/286): apache-commons-cli-1.4-17.el9.noarch. 847 kB/s | 71 kB 00:00 2024-09-14T10:43:45.026 INFO:teuthology.orchestra.run.smithi050.stdout:(199/286): java-11-openjdk-headless-11.0.20.1.1 11 MB/s | 39 MB 00:03 2024-09-14T10:43:45.050 INFO:teuthology.orchestra.run.smithi118.stdout:(55/286): apache-commons-codec-1.15-7.el9.noarc 3.5 MB/s | 302 kB 00:00 2024-09-14T10:43:45.051 INFO:teuthology.orchestra.run.smithi050.stdout:(200/286): python3-jinja2-2.11.3-6.el9.noarch.r 648 kB/s | 248 kB 00:00 2024-09-14T10:43:45.076 INFO:teuthology.orchestra.run.smithi050.stdout:(201/286): python3-jsonpatch-1.21-16.el9.noarch 512 kB/s | 26 kB 00:00 2024-09-14T10:43:45.101 INFO:teuthology.orchestra.run.smithi050.stdout:(202/286): python3-jsonpointer-2.0-4.el9.noarch 380 kB/s | 19 kB 00:00 2024-09-14T10:43:45.109 INFO:teuthology.orchestra.run.smithi118.stdout:(56/286): apache-commons-io-2.8.0-8.el9.noarch. 3.3 MB/s | 283 kB 00:00 2024-09-14T10:43:45.118 INFO:teuthology.orchestra.run.smithi050.stdout:(203/286): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-09-14T10:43:45.143 INFO:teuthology.orchestra.run.smithi118.stdout:(57/286): apache-commons-lang3-3.12.0-6.el9.noa 5.9 MB/s | 559 kB 00:00 2024-09-14T10:43:45.176 INFO:teuthology.orchestra.run.smithi118.stdout:(58/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.3 MB/s | 87 kB 00:00 2024-09-14T10:43:45.194 INFO:teuthology.orchestra.run.smithi050.stdout:(204/286): python3-babel-2.9.1-2.el9.noarch.rpm 9.8 MB/s | 6.0 MB 00:00 2024-09-14T10:43:45.219 INFO:teuthology.orchestra.run.smithi050.stdout:(205/286): python3-markupsafe-1.1.1-12.el9.x86_ 297 kB/s | 35 kB 00:00 2024-09-14T10:43:45.261 INFO:teuthology.orchestra.run.smithi050.stdout:(206/286): python3-oauthlib-3.1.1-5.el9.noarch. 5.3 MB/s | 222 kB 00:00 2024-09-14T10:43:45.286 INFO:teuthology.orchestra.run.smithi050.stdout:(207/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 3.7 MB/s | 250 kB 00:00 2024-09-14T10:43:45.302 INFO:teuthology.orchestra.run.smithi118.stdout:(59/286): adwaita-icon-theme-40.1.1-3.el9.noarc 22 MB/s | 12 MB 00:00 2024-09-14T10:43:45.311 INFO:teuthology.orchestra.run.smithi050.stdout:(208/286): python3-packaging-20.9-5.el9.noarch. 1.5 MB/s | 77 kB 00:00 2024-09-14T10:43:45.327 INFO:teuthology.orchestra.run.smithi118.stdout:(60/286): atinject-1.0.3-6.el9.noarch.rpm 155 kB/s | 23 kB 00:00 2024-09-14T10:43:45.336 INFO:teuthology.orchestra.run.smithi050.stdout:(209/286): python3-prettytable-0.7.2-27.el9.noa 841 kB/s | 42 kB 00:00 2024-09-14T10:43:45.352 INFO:teuthology.orchestra.run.smithi118.stdout:(61/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 933 kB/s | 195 kB 00:00 2024-09-14T10:43:45.362 INFO:teuthology.orchestra.run.smithi050.stdout:(210/286): python3-protobuf-3.14.0-13.el9.noarc 5.3 MB/s | 269 kB 00:00 2024-09-14T10:43:45.490 INFO:teuthology.orchestra.run.smithi050.stdout:(211/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 3.1 MB/s | 159 kB 00:00 2024-09-14T10:43:45.490 INFO:teuthology.orchestra.run.smithi050.stdout:(212/286): python3-pyasn1-modules-0.4.8-6.el9.n 5.4 MB/s | 279 kB 00:00 2024-09-14T10:43:45.490 INFO:teuthology.orchestra.run.smithi050.stdout:(213/286): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-14T10:43:45.490 INFO:teuthology.orchestra.run.smithi050.stdout:(214/286): python3-requests-oauthlib-1.3.0-12.e 1.0 MB/s | 54 kB 00:00 2024-09-14T10:43:45.490 INFO:teuthology.orchestra.run.smithi118.stdout:(62/286): atk-2.36.0-5.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-14T10:43:45.490 INFO:teuthology.orchestra.run.smithi118.stdout:(63/286): avahi-glib-0.8-21.el9.x86_64.rpm 222 kB/s | 15 kB 00:00 2024-09-14T10:43:45.490 INFO:teuthology.orchestra.run.smithi118.stdout:(64/286): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-14T10:43:45.490 INFO:teuthology.orchestra.run.smithi118.stdout:(65/286): cdi-api-2.0.2-6.el9.noarch.rpm 906 kB/s | 53 kB 00:00 2024-09-14T10:43:45.491 INFO:teuthology.orchestra.run.smithi118.stdout:(66/286): colord-libs-1.4.5-4.el9.x86_64.rpm 3.3 MB/s | 229 kB 00:00 2024-09-14T10:43:45.491 INFO:teuthology.orchestra.run.smithi118.stdout:(67/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.0 MB/s | 61 kB 00:00 2024-09-14T10:43:45.504 INFO:teuthology.orchestra.run.smithi118.stdout:(68/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 420 kB/s | 28 kB 00:00 2024-09-14T10:43:45.530 INFO:teuthology.orchestra.run.smithi118.stdout:(69/286): dconf-0.40.0-6.el9.x86_64.rpm 1.6 MB/s | 113 kB 00:00 2024-09-14T10:43:45.530 INFO:teuthology.orchestra.run.smithi050.stdout:(215/286): python3-numpy-1.20.1-5.el9.x86_64.rp 12 MB/s | 5.1 MB 00:00 2024-09-14T10:43:45.555 INFO:teuthology.orchestra.run.smithi050.stdout:(216/286): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-09-14T10:43:45.563 INFO:teuthology.orchestra.run.smithi118.stdout:(70/286): exempi-2.6.0-0.2.20211007gite23c213.e 6.1 MB/s | 525 kB 00:00 2024-09-14T10:43:45.580 INFO:teuthology.orchestra.run.smithi050.stdout:(217/286): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-14T10:43:45.597 INFO:teuthology.orchestra.run.smithi118.stdout:(71/286): exiv2-0.27.5-2.el9.x86_64.rpm 10 MB/s | 980 kB 00:00 2024-09-14T10:43:45.605 INFO:teuthology.orchestra.run.smithi050.stdout:(218/286): qatlib-service-24.02.0-1.el9.x86_64. 714 kB/s | 36 kB 00:00 2024-09-14T10:43:45.623 INFO:teuthology.orchestra.run.smithi050.stdout:(219/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-14T10:43:45.630 INFO:teuthology.orchestra.run.smithi118.stdout:(72/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 7.6 MB/s | 781 kB 00:00 2024-09-14T10:43:45.639 INFO:teuthology.orchestra.run.smithi050.stdout:(220/286): rtkit-0.11-29.el9.x86_64.rpm 1.6 MB/s | 56 kB 00:00 2024-09-14T10:43:45.664 INFO:teuthology.orchestra.run.smithi118.stdout:(73/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 3.2 MB/s | 325 kB 00:00 2024-09-14T10:43:45.673 INFO:teuthology.orchestra.run.smithi050.stdout:(221/286): sisu-0.3.4-10.el9.noarch.rpm 10 MB/s | 510 kB 00:00 2024-09-14T10:43:45.689 INFO:teuthology.orchestra.run.smithi118.stdout:(74/286): flac-libs-1.3.3-12.el9.x86_64.rpm 2.3 MB/s | 218 kB 00:00 2024-09-14T10:43:45.698 INFO:teuthology.orchestra.run.smithi050.stdout:(222/286): slf4j-1.7.30-13.el9.noarch.rpm 1.2 MB/s | 69 kB 00:00 2024-09-14T10:43:45.723 INFO:teuthology.orchestra.run.smithi050.stdout:(223/286): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-14T10:43:45.731 INFO:teuthology.orchestra.run.smithi118.stdout:(75/286): flatpak-1.12.9-1.el9.x86_64.rpm 17 MB/s | 1.7 MB 00:00 2024-09-14T10:43:45.748 INFO:teuthology.orchestra.run.smithi118.stdout:(76/286): flatpak-selinux-1.12.9-1.el9.noarch.r 258 kB/s | 22 kB 00:00 2024-09-14T10:43:45.757 INFO:teuthology.orchestra.run.smithi050.stdout:(224/286): sound-theme-freedesktop-0.8-17.el9.n 6.4 MB/s | 383 kB 00:00 2024-09-14T10:43:45.782 INFO:teuthology.orchestra.run.smithi118.stdout:(77/286): flatpak-session-helper-1.12.9-1.el9.x 792 kB/s | 73 kB 00:00 2024-09-14T10:43:45.799 INFO:teuthology.orchestra.run.smithi118.stdout:(78/286): flexiblas-3.0.4-8.el9.x86_64.rpm 488 kB/s | 33 kB 00:00 2024-09-14T10:43:45.807 INFO:teuthology.orchestra.run.smithi050.stdout:(225/286): totem-pl-parser-3.26.6-2.el9.x86_64. 1.8 MB/s | 152 kB 00:00 2024-09-14T10:43:45.841 INFO:teuthology.orchestra.run.smithi050.stdout:(226/286): tracker-3.1.2-3.el9.x86_64.rpm 6.5 MB/s | 555 kB 00:00 2024-09-14T10:43:45.857 INFO:teuthology.orchestra.run.smithi118.stdout:(79/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 27 MB/s | 3.0 MB 00:00 2024-09-14T10:43:45.874 INFO:teuthology.orchestra.run.smithi118.stdout:(80/286): flexiblas-openblas-openmp-3.0.4-8.el9 197 kB/s | 18 kB 00:00 2024-09-14T10:43:45.883 INFO:teuthology.orchestra.run.smithi050.stdout:(227/286): tracker-miners-3.1.2-4.el9.x86_64.rp 12 MB/s | 944 kB 00:00 2024-09-14T10:43:45.900 INFO:teuthology.orchestra.run.smithi118.stdout:(81/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 882 kB/s | 89 kB 00:00 2024-09-14T10:43:45.909 INFO:teuthology.orchestra.run.smithi050.stdout:(228/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 794 kB/s | 53 kB 00:00 2024-09-14T10:43:45.925 INFO:teuthology.orchestra.run.smithi118.stdout:(82/286): geoclue2-2.6.0-7.el9.x86_64.rpm 1.8 MB/s | 124 kB 00:00 2024-09-14T10:43:45.934 INFO:teuthology.orchestra.run.smithi050.stdout:(229/286): tzdata-java-2024a-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-14T10:43:45.950 INFO:teuthology.orchestra.run.smithi118.stdout:(83/286): giflib-5.2.1-9.el9.x86_64.rpm 641 kB/s | 49 kB 00:00 2024-09-14T10:43:45.959 INFO:teuthology.orchestra.run.smithi050.stdout:(230/286): upower-0.99.11-11.el9.x86_64.rpm 3.4 MB/s | 173 kB 00:00 2024-09-14T10:43:45.976 INFO:teuthology.orchestra.run.smithi118.stdout:(84/286): google-guice-4.2.3-9.el9.noarch.rpm 6.1 MB/s | 473 kB 00:00 2024-09-14T10:43:45.984 INFO:teuthology.orchestra.run.smithi050.stdout:(231/286): webrtc-audio-processing-0.3.1-8.el9. 6.0 MB/s | 306 kB 00:00 2024-09-14T10:43:46.001 INFO:teuthology.orchestra.run.smithi118.stdout:(85/286): graphene-1.10.6-2.el9.x86_64.rpm 853 kB/s | 64 kB 00:00 2024-09-14T10:43:46.009 INFO:teuthology.orchestra.run.smithi050.stdout:(232/286): wireplumber-0.4.14-1.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-14T10:43:46.026 INFO:teuthology.orchestra.run.smithi118.stdout:(86/286): gsm-1.0.19-6.el9.x86_64.rpm 450 kB/s | 34 kB 00:00 2024-09-14T10:43:46.035 INFO:teuthology.orchestra.run.smithi050.stdout:(233/286): wireplumber-libs-0.4.14-1.el9.x86_64 7.0 MB/s | 358 kB 00:00 2024-09-14T10:43:46.060 INFO:teuthology.orchestra.run.smithi050.stdout:(234/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 846 kB/s | 42 kB 00:00 2024-09-14T10:43:46.068 INFO:teuthology.orchestra.run.smithi118.stdout:(87/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-09-14T10:43:46.086 INFO:teuthology.orchestra.run.smithi050.stdout:(235/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 7.5 MB/s | 385 kB 00:00 2024-09-14T10:43:46.111 INFO:teuthology.orchestra.run.smithi050.stdout:(236/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.6 MB/s | 134 kB 00:00 2024-09-14T10:43:46.127 INFO:teuthology.orchestra.run.smithi118.stdout:(88/286): gstreamer1-plugins-base-1.22.1-2.el9. 18 MB/s | 2.2 MB 00:00 2024-09-14T10:43:46.145 INFO:teuthology.orchestra.run.smithi050.stdout:(237/286): xkeyboard-config-2.33-2.el9.noarch.r 14 MB/s | 859 kB 00:00 2024-09-14T10:43:46.152 INFO:teuthology.orchestra.run.smithi118.stdout:(89/286): gtk-update-icon-cache-3.24.31-5.el9.x 263 kB/s | 33 kB 00:00 2024-09-14T10:43:46.170 INFO:teuthology.orchestra.run.smithi050.stdout:(238/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-14T10:43:46.203 INFO:teuthology.orchestra.run.smithi050.stdout:(239/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 8.4 MB/s | 505 kB 00:00 2024-09-14T10:43:46.219 INFO:teuthology.orchestra.run.smithi118.stdout:(90/286): guava-30.1-6.el9.noarch.rpm 25 MB/s | 2.3 MB 00:00 2024-09-14T10:43:46.229 INFO:teuthology.orchestra.run.smithi050.stdout:(240/286): lua-devel-5.4.4-4.el9.x86_64.rpm 381 kB/s | 22 kB 00:00 2024-09-14T10:43:46.244 INFO:teuthology.orchestra.run.smithi118.stdout:(91/286): hicolor-icon-theme-0.17-13.el9.noarch 2.3 MB/s | 219 kB 00:00 2024-09-14T10:43:46.287 INFO:teuthology.orchestra.run.smithi050.stdout:(241/286): protobuf-compiler-3.14.0-13.el9.x86_ 10 MB/s | 863 kB 00:00 2024-09-14T10:43:46.328 INFO:teuthology.orchestra.run.smithi118.stdout:(92/286): gtk3-3.24.31-5.el9.x86_64.rpm 19 MB/s | 4.9 MB 00:00 2024-09-14T10:43:46.338 INFO:teuthology.orchestra.run.smithi050.stdout:(242/286): abseil-cpp-20211102.0-3.el9.x86_64.r 4.9 MB/s | 548 kB 00:00 2024-09-14T10:43:46.362 INFO:teuthology.orchestra.run.smithi118.stdout:(93/286): httpcomponents-core-4.4.13-7.el9.noar 5.3 MB/s | 632 kB 00:00 2024-09-14T10:43:46.363 INFO:teuthology.orchestra.run.smithi050.stdout:(243/286): grpc-data-1.46.7-10.el9.noarch.rpm 785 kB/s | 19 kB 00:00 2024-09-14T10:43:46.387 INFO:teuthology.orchestra.run.smithi118.stdout:(94/286): httpcomponents-client-4.5.13-3.el9.no 3.8 MB/s | 657 kB 00:00 2024-09-14T10:43:46.388 INFO:teuthology.orchestra.run.smithi050.stdout:(244/286): gperftools-libs-2.9.1-3.el9.x86_64.r 3.1 MB/s | 308 kB 00:00 2024-09-14T10:43:46.413 INFO:teuthology.orchestra.run.smithi050.stdout:(245/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-14T10:43:46.439 INFO:teuthology.orchestra.run.smithi050.stdout:(246/286): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-14T10:43:46.463 INFO:teuthology.orchestra.run.smithi118.stdout:(95/286): iso-codes-4.6.0-3.el9.noarch.rpm 26 MB/s | 3.5 MB 00:00 2024-09-14T10:43:46.464 INFO:teuthology.orchestra.run.smithi050.stdout:(247/286): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-14T10:43:46.479 INFO:teuthology.orchestra.run.smithi118.stdout:(96/286): jakarta-annotations-1.3.5-13.el9.noar 384 kB/s | 45 kB 00:00 2024-09-14T10:43:46.489 INFO:teuthology.orchestra.run.smithi050.stdout:(248/286): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-14T10:43:46.513 INFO:teuthology.orchestra.run.smithi118.stdout:(97/286): jansi-2.3.3-6.el9.x86_64.rpm 874 kB/s | 110 kB 00:00 2024-09-14T10:43:46.531 INFO:teuthology.orchestra.run.smithi050.stdout:(249/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-14T10:43:46.547 INFO:teuthology.orchestra.run.smithi118.stdout:(98/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 4.8 MB/s | 413 kB 00:00 2024-09-14T10:43:46.573 INFO:teuthology.orchestra.run.smithi050.stdout:(250/286): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-14T10:43:46.598 INFO:teuthology.orchestra.run.smithi050.stdout:(251/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-14T10:43:46.624 INFO:teuthology.orchestra.run.smithi050.stdout:(252/286): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-14T10:43:46.647 INFO:teuthology.orchestra.run.smithi118.stdout:(99/286): java-11-openjdk-devel-11.0.20.1.1-2.e 20 MB/s | 3.3 MB 00:00 2024-09-14T10:43:46.649 INFO:teuthology.orchestra.run.smithi050.stdout:(253/286): python3-certifi-2023.05.07-4.el9.noa 562 kB/s | 14 kB 00:00 2024-09-14T10:43:46.664 INFO:teuthology.orchestra.run.smithi118.stdout:(100/286): javapackages-filesystem-6.0.0-4.el9. 111 kB/s | 13 kB 00:00 2024-09-14T10:43:46.706 INFO:teuthology.orchestra.run.smithi118.stdout:(101/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 908 kB/s | 53 kB 00:00 2024-09-14T10:43:46.723 INFO:teuthology.orchestra.run.smithi118.stdout:(102/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 410 kB/s | 24 kB 00:00 2024-09-14T10:43:46.782 INFO:teuthology.orchestra.run.smithi118.stdout:(103/286): jsoup-1.13.1-10.el9.noarch.rpm 4.9 MB/s | 377 kB 00:00 2024-09-14T10:43:46.798 INFO:teuthology.orchestra.run.smithi118.stdout:(104/286): jsr-305-3.0.2-6.el9.noarch.rpm 472 kB/s | 35 kB 00:00 2024-09-14T10:43:46.816 INFO:teuthology.orchestra.run.smithi050.stdout:(254/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-09-14T10:43:46.850 INFO:teuthology.orchestra.run.smithi050.stdout:(255/286): python3-cheroot-8.6.0-4.el9.noarch.r 857 kB/s | 172 kB 00:00 2024-09-14T10:43:46.857 INFO:teuthology.orchestra.run.smithi118.stdout:(105/286): lcms2-2.12-3.el9.x86_64.rpm 2.2 MB/s | 168 kB 00:00 2024-09-14T10:43:46.874 INFO:teuthology.orchestra.run.smithi118.stdout:(106/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 147 kB/s | 11 kB 00:00 2024-09-14T10:43:46.883 INFO:teuthology.orchestra.run.smithi050.stdout:(256/286): python3-google-auth-2.34.0-1.el9.noa 6.9 MB/s | 220 kB 00:00 2024-09-14T10:43:46.908 INFO:teuthology.orchestra.run.smithi118.stdout:(107/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 483 kB/s | 24 kB 00:00 2024-09-14T10:43:46.917 INFO:teuthology.orchestra.run.smithi050.stdout:(257/286): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-09-14T10:43:46.933 INFO:teuthology.orchestra.run.smithi118.stdout:(108/286): libXcursor-1.2.0-7.el9.x86_64.rpm 524 kB/s | 31 kB 00:00 2024-09-14T10:43:46.984 INFO:teuthology.orchestra.run.smithi118.stdout:(109/286): libXdamage-1.1.5-7.el9.x86_64.rpm 302 kB/s | 23 kB 00:00 2024-09-14T10:43:46.984 INFO:teuthology.orchestra.run.smithi050.stdout:(258/286): libarrow-9.0.0-11.el9.x86_64.rpm 7.1 MB/s | 4.4 MB 00:00 2024-09-14T10:43:47.001 INFO:teuthology.orchestra.run.smithi118.stdout:(110/286): libXfixes-5.0.3-16.el9.x86_64.rpm 294 kB/s | 20 kB 00:00 2024-09-14T10:43:47.009 INFO:teuthology.orchestra.run.smithi050.stdout:(259/286): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-09-14T10:43:47.035 INFO:teuthology.orchestra.run.smithi050.stdout:(260/286): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-14T10:43:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:(261/286): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-14T10:43:47.085 INFO:teuthology.orchestra.run.smithi050.stdout:(262/286): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-14T10:43:47.110 INFO:teuthology.orchestra.run.smithi050.stdout:(263/286): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-14T10:43:47.135 INFO:teuthology.orchestra.run.smithi050.stdout:(264/286): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-14T10:43:47.161 INFO:teuthology.orchestra.run.smithi050.stdout:(265/286): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-14T10:43:47.186 INFO:teuthology.orchestra.run.smithi050.stdout:(266/286): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-14T10:43:47.212 INFO:teuthology.orchestra.run.smithi050.stdout:(267/286): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-14T10:43:47.245 INFO:teuthology.orchestra.run.smithi050.stdout:(268/286): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-14T10:43:47.279 INFO:teuthology.orchestra.run.smithi050.stdout:(269/286): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-14T10:43:47.304 INFO:teuthology.orchestra.run.smithi050.stdout:(270/286): python3-portend-3.1.0-2.el9.noarch.r 282 kB/s | 16 kB 00:00 2024-09-14T10:43:47.346 INFO:teuthology.orchestra.run.smithi050.stdout:(271/286): python3-grpcio-1.46.7-10.el9.x86_64. 4.4 MB/s | 2.0 MB 00:00 2024-09-14T10:43:47.371 INFO:teuthology.orchestra.run.smithi050.stdout:(272/286): python3-repoze-lru-0.7-16.el9.noarch 461 kB/s | 31 kB 00:00 2024-09-14T10:43:47.396 INFO:teuthology.orchestra.run.smithi050.stdout:(273/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 976 kB/s | 90 kB 00:00 2024-09-14T10:43:47.421 INFO:teuthology.orchestra.run.smithi050.stdout:(274/286): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-14T10:43:47.447 INFO:teuthology.orchestra.run.smithi050.stdout:(275/286): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-14T10:43:47.451 INFO:teuthology.orchestra.run.smithi118.stdout:(111/286): java-11-openjdk-headless-11.0.20.1.1 42 MB/s | 39 MB 00:00 2024-09-14T10:43:47.472 INFO:teuthology.orchestra.run.smithi050.stdout:(276/286): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-14T10:43:47.476 INFO:teuthology.orchestra.run.smithi118.stdout:(112/286): libXinerama-1.1.4-10.el9.x86_64.rpm 32 kB/s | 15 kB 00:00 2024-09-14T10:43:47.493 INFO:teuthology.orchestra.run.smithi118.stdout:(113/286): libXi-1.7.10-8.el9.x86_64.rpm 78 kB/s | 40 kB 00:00 2024-09-14T10:43:47.497 INFO:teuthology.orchestra.run.smithi050.stdout:(277/286): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-09-14T10:43:47.510 INFO:teuthology.orchestra.run.smithi118.stdout:(114/286): libXrandr-1.5.2-8.el9.x86_64.rpm 486 kB/s | 28 kB 00:00 2024-09-14T10:43:47.523 INFO:teuthology.orchestra.run.smithi050.stdout:(278/286): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-14T10:43:47.527 INFO:teuthology.orchestra.run.smithi118.stdout:(115/286): libXtst-1.2.3-16.el9.x86_64.rpm 424 kB/s | 21 kB 00:00 2024-09-14T10:43:47.548 INFO:teuthology.orchestra.run.smithi050.stdout:(279/286): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-14T10:43:47.552 INFO:teuthology.orchestra.run.smithi118.stdout:(116/286): libXv-1.0.11-16.el9.x86_64.rpm 324 kB/s | 19 kB 00:00 2024-09-14T10:43:47.573 INFO:teuthology.orchestra.run.smithi050.stdout:(280/286): python3-zc-lockfile-2.0-10.el9.noarc 400 kB/s | 20 kB 00:00 2024-09-14T10:43:47.577 INFO:teuthology.orchestra.run.smithi118.stdout:(117/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 279 kB/s | 19 kB 00:00 2024-09-14T10:43:47.598 INFO:teuthology.orchestra.run.smithi050.stdout:(281/286): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-14T10:43:47.603 INFO:teuthology.orchestra.run.smithi118.stdout:(118/286): libasyncns-0.8-22.el9.x86_64.rpm 403 kB/s | 30 kB 00:00 2024-09-14T10:43:47.628 INFO:teuthology.orchestra.run.smithi118.stdout:(119/286): libcanberra-0.30-27.el9.x86_64.rpm 1.1 MB/s | 86 kB 00:00 2024-09-14T10:43:47.632 INFO:teuthology.orchestra.run.smithi050.stdout:(282/286): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-14T10:43:47.653 INFO:teuthology.orchestra.run.smithi118.stdout:(120/286): libcanberra-gtk3-0.30-27.el9.x86_64. 422 kB/s | 32 kB 00:00 2024-09-14T10:43:47.657 INFO:teuthology.orchestra.run.smithi050.stdout:(283/286): s3cmd-2.4.0-1.el9.noarch.rpm 2.4 MB/s | 206 kB 00:00 2024-09-14T10:43:47.679 INFO:teuthology.orchestra.run.smithi118.stdout:(121/286): libdrm-2.4.121-1.el9.x86_64.rpm 2.1 MB/s | 161 kB 00:00 2024-09-14T10:43:47.704 INFO:teuthology.orchestra.run.smithi118.stdout:(122/286): libepoxy-1.5.5-4.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2024-09-14T10:43:47.707 INFO:teuthology.orchestra.run.smithi050.stdout:(284/286): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-14T10:43:47.738 INFO:teuthology.orchestra.run.smithi118.stdout:(123/286): libexif-0.6.22-6.el9.x86_64.rpm 5.1 MB/s | 435 kB 00:00 2024-09-14T10:43:47.763 INFO:teuthology.orchestra.run.smithi118.stdout:(124/286): libfontenc-1.1.3-17.el9.x86_64.rpm 370 kB/s | 31 kB 00:00 2024-09-14T10:43:47.788 INFO:teuthology.orchestra.run.smithi118.stdout:(125/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 985 kB/s | 83 kB 00:00 2024-09-14T10:43:47.814 INFO:teuthology.orchestra.run.smithi118.stdout:(126/286): libglvnd-1.3.4-1.el9.x86_64.rpm 1.7 MB/s | 135 kB 00:00 2024-09-14T10:43:47.839 INFO:teuthology.orchestra.run.smithi118.stdout:(127/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 485 kB/s | 37 kB 00:00 2024-09-14T10:43:47.864 INFO:teuthology.orchestra.run.smithi118.stdout:(128/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.8 MB/s | 142 kB 00:00 2024-09-14T10:43:47.890 INFO:teuthology.orchestra.run.smithi118.stdout:(129/286): libgsf-1.14.47-5.el9.x86_64.rpm 3.3 MB/s | 256 kB 00:00 2024-09-14T10:43:47.923 INFO:teuthology.orchestra.run.smithi118.stdout:(130/286): libgxps-0.3.2-3.el9.x86_64.rpm 941 kB/s | 79 kB 00:00 2024-09-14T10:43:47.933 INFO:teuthology.orchestra.run.smithi050.stdout:(285/286): librbd1-19.3.0-4907.ga2782315.el9.x8 12 MB/s | 3.2 MB 00:00 2024-09-14T10:43:47.948 INFO:teuthology.orchestra.run.smithi118.stdout:(131/286): libldac-2.0.2.3-10.el9.x86_64.rpm 706 kB/s | 41 kB 00:00 2024-09-14T10:43:47.974 INFO:teuthology.orchestra.run.smithi118.stdout:(132/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 562 kB/s | 61 kB 00:00 2024-09-14T10:43:47.983 INFO:teuthology.orchestra.run.smithi050.stdout:(286/286): librados2-19.3.0-4907.ga2782315.el9. 11 MB/s | 3.5 MB 00:00 2024-09-14T10:43:47.990 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:43:47.990 INFO:teuthology.orchestra.run.smithi050.stdout:Total 25 MB/s | 327 MB 00:13 2024-09-14T10:43:47.999 INFO:teuthology.orchestra.run.smithi118.stdout:(133/286): libnbd-1.20.2-2.el9.x86_64.rpm 2.2 MB/s | 171 kB 00:00 2024-09-14T10:43:48.024 INFO:teuthology.orchestra.run.smithi118.stdout:(134/286): libnotify-0.7.9-8.el9.x86_64.rpm 577 kB/s | 44 kB 00:00 2024-09-14T10:43:48.050 INFO:teuthology.orchestra.run.smithi118.stdout:(135/286): libogg-1.3.4-6.el9.x86_64.rpm 445 kB/s | 34 kB 00:00 2024-09-14T10:43:48.075 INFO:teuthology.orchestra.run.smithi118.stdout:(136/286): libosinfo-1.10.0-1.el9.x86_64.rpm 4.1 MB/s | 319 kB 00:00 2024-09-14T10:43:48.131 INFO:teuthology.orchestra.run.smithi118.stdout:(137/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.5 MB/s | 160 kB 00:00 2024-09-14T10:43:48.151 INFO:teuthology.orchestra.run.smithi118.stdout:(138/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 449 kB/s | 45 kB 00:00 2024-09-14T10:43:48.176 INFO:teuthology.orchestra.run.smithi118.stdout:(139/286): librdkafka-1.6.1-102.el9.x86_64.rpm 6.4 MB/s | 662 kB 00:00 2024-09-14T10:43:48.193 INFO:teuthology.orchestra.run.smithi118.stdout:(140/286): libsbc-1.4-9.el9.x86_64.rpm 722 kB/s | 45 kB 00:00 2024-09-14T10:43:48.227 INFO:teuthology.orchestra.run.smithi118.stdout:(141/286): libsndfile-1.0.31-8.el9.x86_64.rpm 2.7 MB/s | 206 kB 00:00 2024-09-14T10:43:48.261 INFO:teuthology.orchestra.run.smithi118.stdout:(142/286): libtheora-1.1.1-31.el9.x86_64.rpm 1.9 MB/s | 164 kB 00:00 2024-09-14T10:43:48.286 INFO:teuthology.orchestra.run.smithi118.stdout:(143/286): libtiff-4.4.0-13.el9.x86_64.rpm 2.1 MB/s | 198 kB 00:00 2024-09-14T10:43:48.302 INFO:teuthology.orchestra.run.smithi118.stdout:(144/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 471 kB/s | 36 kB 00:00 2024-09-14T10:43:48.328 INFO:teuthology.orchestra.run.smithi118.stdout:(145/286): libtracker-sparql-3.1.2-3.el9.x86_64 4.7 MB/s | 324 kB 00:00 2024-09-14T10:43:48.350 INFO:teuthology.orchestra.run.smithi118.stdout:(146/286): libvisual-0.4.0-34.el9.x86_64.rpm 2.2 MB/s | 144 kB 00:00 2024-09-14T10:43:48.375 INFO:teuthology.orchestra.run.smithi118.stdout:(147/286): libvorbis-1.3.7-5.el9.x86_64.rpm 2.6 MB/s | 193 kB 00:00 2024-09-14T10:43:48.400 INFO:teuthology.orchestra.run.smithi118.stdout:(148/286): libwayland-client-1.21.0-1.el9.x86_6 464 kB/s | 33 kB 00:00 2024-09-14T10:43:48.425 INFO:teuthology.orchestra.run.smithi118.stdout:(149/286): libwayland-cursor-1.21.0-1.el9.x86_6 257 kB/s | 19 kB 00:00 2024-09-14T10:43:48.459 INFO:teuthology.orchestra.run.smithi118.stdout:(150/286): libwayland-server-1.21.0-1.el9.x86_6 712 kB/s | 42 kB 00:00 2024-09-14T10:43:48.476 INFO:teuthology.orchestra.run.smithi118.stdout:(151/286): libwayland-egl-1.21.0-1.el9.x86_64.r 128 kB/s | 13 kB 00:00 2024-09-14T10:43:48.510 INFO:teuthology.orchestra.run.smithi118.stdout:(152/286): libwebp-1.2.0-8.el9.x86_64.rpm 3.2 MB/s | 277 kB 00:00 2024-09-14T10:43:48.527 INFO:teuthology.orchestra.run.smithi118.stdout:(153/286): libxshmfence-1.3-10.el9.x86_64.rpm 249 kB/s | 13 kB 00:00 2024-09-14T10:43:48.552 INFO:teuthology.orchestra.run.smithi118.stdout:(154/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.4 MB/s | 133 kB 00:00 2024-09-14T10:43:48.569 INFO:teuthology.orchestra.run.smithi118.stdout:(155/286): low-memory-monitor-2.1-4.el9.x86_64. 609 kB/s | 36 kB 00:00 2024-09-14T10:43:48.595 INFO:teuthology.orchestra.run.smithi118.stdout:(156/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 292 kB 00:00 2024-09-14T10:43:48.620 INFO:teuthology.orchestra.run.smithi118.stdout:(157/286): lua-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 188 kB 00:00 2024-09-14T10:43:48.645 INFO:teuthology.orchestra.run.smithi118.stdout:(158/286): lua-posix-35.0-8.el9.x86_64.rpm 1.9 MB/s | 151 kB 00:00 2024-09-14T10:43:48.662 INFO:teuthology.orchestra.run.smithi118.stdout:(159/286): maven-3.6.3-15.el9.noarch.rpm 263 kB/s | 18 kB 00:00 2024-09-14T10:43:48.696 INFO:teuthology.orchestra.run.smithi118.stdout:(160/286): maven-openjdk11-3.6.3-15.el9.noarch. 180 kB/s | 9.0 kB 00:00 2024-09-14T10:43:48.738 INFO:teuthology.orchestra.run.smithi118.stdout:(161/286): maven-lib-3.6.3-15.el9.noarch.rpm 13 MB/s | 1.5 MB 00:00 2024-09-14T10:43:48.763 INFO:teuthology.orchestra.run.smithi118.stdout:(162/286): maven-shared-utils-3.3.4-3.el9.noarc 2.2 MB/s | 151 kB 00:00 2024-09-14T10:43:48.797 INFO:teuthology.orchestra.run.smithi118.stdout:(163/286): maven-resolver-1.6.1-10.el9.noarch.r 3.8 MB/s | 517 kB 00:00 2024-09-14T10:43:48.822 INFO:teuthology.orchestra.run.smithi118.stdout:(164/286): maven-wagon-3.4.2-7.el9.noarch.rpm 1.3 MB/s | 112 kB 00:00 2024-09-14T10:43:48.847 INFO:teuthology.orchestra.run.smithi118.stdout:(165/286): mesa-filesystem-24.1.2-3.el9.x86_64. 224 kB/s | 11 kB 00:00 2024-09-14T10:43:48.881 INFO:teuthology.orchestra.run.smithi118.stdout:(166/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.3 MB/s | 139 kB 00:00 2024-09-14T10:43:48.914 INFO:teuthology.orchestra.run.smithi118.stdout:(167/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 2.5 MB/s | 171 kB 00:00 2024-09-14T10:43:49.031 INFO:teuthology.orchestra.run.smithi118.stdout:(168/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 33 MB/s | 8.8 MB 00:00 2024-09-14T10:43:49.057 INFO:teuthology.orchestra.run.smithi118.stdout:(169/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 206 kB/s | 36 kB 00:00 2024-09-14T10:43:49.082 INFO:teuthology.orchestra.run.smithi118.stdout:(170/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 274 kB/s | 46 kB 00:00 2024-09-14T10:43:49.107 INFO:teuthology.orchestra.run.smithi118.stdout:(171/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 429 kB/s | 32 kB 00:00 2024-09-14T10:43:49.149 INFO:teuthology.orchestra.run.smithi118.stdout:(172/286): openblas-0.3.26-2.el9.x86_64.rpm 577 kB/s | 38 kB 00:00 2024-09-14T10:43:49.183 INFO:teuthology.orchestra.run.smithi118.stdout:(173/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 2.1 MB/s | 163 kB 00:00 2024-09-14T10:43:49.217 INFO:teuthology.orchestra.run.smithi118.stdout:(174/286): opus-1.3.1-10.el9.x86_64.rpm 2.9 MB/s | 200 kB 00:00 2024-09-14T10:43:49.259 INFO:teuthology.orchestra.run.smithi118.stdout:(175/286): orc-0.4.31-8.el9.x86_64.rpm 2.4 MB/s | 183 kB 00:00 2024-09-14T10:43:49.334 INFO:teuthology.orchestra.run.smithi118.stdout:(176/286): openblas-openmp-0.3.26-2.el9.x86_64. 20 MB/s | 4.9 MB 00:00 2024-09-14T10:43:49.359 INFO:teuthology.orchestra.run.smithi118.stdout:(177/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 736 kB/s | 74 kB 00:00 2024-09-14T10:43:49.385 INFO:teuthology.orchestra.run.smithi118.stdout:(178/286): osinfo-db-20240701-2.el9.noarch.rpm 3.1 MB/s | 531 kB 00:00 2024-09-14T10:43:49.418 INFO:teuthology.orchestra.run.smithi118.stdout:(179/286): ostree-libs-2024.7-2.el9.x86_64.rpm 5.5 MB/s | 468 kB 00:00 2024-09-14T10:43:49.452 INFO:teuthology.orchestra.run.smithi118.stdout:(180/286): p11-kit-server-0.25.3-2.el9.x86_64.r 2.6 MB/s | 246 kB 00:00 2024-09-14T10:43:49.477 INFO:teuthology.orchestra.run.smithi118.stdout:(181/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 974 kB/s | 57 kB 00:00 2024-09-14T10:43:49.502 INFO:teuthology.orchestra.run.smithi118.stdout:(182/286): pipewire-1.0.1-1.el9.x86_64.rpm 904 kB/s | 107 kB 00:00 2024-09-14T10:43:49.519 INFO:teuthology.orchestra.run.smithi118.stdout:(183/286): pipewire-jack-audio-connection-kit-1 136 kB/s | 9.1 kB 00:00 2024-09-14T10:43:49.545 INFO:teuthology.orchestra.run.smithi118.stdout:(184/286): pipewire-jack-audio-connection-kit-l 2.0 MB/s | 135 kB 00:00 2024-09-14T10:43:49.595 INFO:teuthology.orchestra.run.smithi118.stdout:(185/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 21 MB/s | 1.9 MB 00:00 2024-09-14T10:43:49.612 INFO:teuthology.orchestra.run.smithi118.stdout:(186/286): plexus-cipher-1.7-27.el9.noarch.rpm 386 kB/s | 26 kB 00:00 2024-09-14T10:43:49.637 INFO:teuthology.orchestra.run.smithi118.stdout:(187/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 1.6 MB/s | 192 kB 00:00 2024-09-14T10:43:49.654 INFO:teuthology.orchestra.run.smithi118.stdout:(188/286): plexus-classworlds-2.6.0-11.el9.noar 1.0 MB/s | 60 kB 00:00 2024-09-14T10:43:49.671 INFO:teuthology.orchestra.run.smithi118.stdout:(189/286): plexus-containers-component-annotati 311 kB/s | 18 kB 00:00 2024-09-14T10:43:49.696 INFO:teuthology.orchestra.run.smithi118.stdout:(190/286): plexus-interpolation-1.26-11.el9.noa 1.3 MB/s | 80 kB 00:00 2024-09-14T10:43:49.722 INFO:teuthology.orchestra.run.smithi118.stdout:(191/286): plexus-sec-dispatcher-1.4-37.el9.noa 500 kB/s | 34 kB 00:00 2024-09-14T10:43:49.805 INFO:teuthology.orchestra.run.smithi118.stdout:(192/286): poppler-21.01.0-21.el9.x86_64.rpm 9.8 MB/s | 1.1 MB 00:00 2024-09-14T10:43:49.856 INFO:teuthology.orchestra.run.smithi118.stdout:(193/286): poppler-data-0.4.9-9.el9.noarch.rpm 14 MB/s | 1.9 MB 00:00 2024-09-14T10:43:49.881 INFO:teuthology.orchestra.run.smithi118.stdout:(194/286): poppler-glib-21.01.0-21.el9.x86_64.r 2.0 MB/s | 152 kB 00:00 2024-09-14T10:43:49.940 INFO:teuthology.orchestra.run.smithi118.stdout:(195/286): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-14T10:43:49.965 INFO:teuthology.orchestra.run.smithi118.stdout:(196/286): publicsuffix-list-20210518-3.el9.noa 990 kB/s | 83 kB 00:00 2024-09-14T10:43:50.007 INFO:teuthology.orchestra.run.smithi118.stdout:(197/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 9.9 MB/s | 679 kB 00:00 2024-09-14T10:43:50.074 INFO:teuthology.orchestra.run.smithi118.stdout:(198/286): python3-devel-3.9.19-8.el9.x86_64.rp 3.6 MB/s | 245 kB 00:00 2024-09-14T10:43:50.132 INFO:teuthology.orchestra.run.smithi118.stdout:(199/286): python3-jinja2-2.11.3-6.el9.noarch.r 4.2 MB/s | 248 kB 00:00 2024-09-14T10:43:50.216 INFO:teuthology.orchestra.run.smithi118.stdout:(200/286): python3-babel-2.9.1-2.el9.noarch.rpm 24 MB/s | 6.0 MB 00:00 2024-09-14T10:43:50.241 INFO:teuthology.orchestra.run.smithi118.stdout:(201/286): python3-jsonpatch-1.21-16.el9.noarch 236 kB/s | 26 kB 00:00 2024-09-14T10:43:50.275 INFO:teuthology.orchestra.run.smithi118.stdout:(202/286): python3-jsonpointer-2.0-4.el9.noarch 327 kB/s | 19 kB 00:00 2024-09-14T10:43:50.309 INFO:teuthology.orchestra.run.smithi118.stdout:(203/286): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-14T10:43:50.334 INFO:teuthology.orchestra.run.smithi118.stdout:(204/286): python3-markupsafe-1.1.1-12.el9.x86_ 595 kB/s | 35 kB 00:00 2024-09-14T10:43:50.384 INFO:teuthology.orchestra.run.smithi118.stdout:(205/286): plexus-utils-3.3.0-10.el9.noarch.rpm 356 kB/s | 254 kB 00:00 2024-09-14T10:43:50.418 INFO:teuthology.orchestra.run.smithi118.stdout:(206/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 2.9 MB/s | 250 kB 00:00 2024-09-14T10:43:50.444 INFO:teuthology.orchestra.run.smithi118.stdout:(207/286): python3-oauthlib-3.1.1-5.el9.noarch. 3.7 MB/s | 222 kB 00:00 2024-09-14T10:43:50.486 INFO:teuthology.orchestra.run.smithi118.stdout:(208/286): python3-packaging-20.9-5.el9.noarch. 1.1 MB/s | 77 kB 00:00 2024-09-14T10:43:50.511 INFO:teuthology.orchestra.run.smithi118.stdout:(209/286): python3-prettytable-0.7.2-27.el9.noa 631 kB/s | 42 kB 00:00 2024-09-14T10:43:50.578 INFO:teuthology.orchestra.run.smithi118.stdout:(210/286): python3-numpy-1.20.1-5.el9.x86_64.rp 19 MB/s | 5.1 MB 00:00 2024-09-14T10:43:50.603 INFO:teuthology.orchestra.run.smithi118.stdout:(211/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.7 MB/s | 159 kB 00:00 2024-09-14T10:43:50.628 INFO:teuthology.orchestra.run.smithi118.stdout:(212/286): python3-protobuf-3.14.0-13.el9.noarc 1.8 MB/s | 269 kB 00:00 2024-09-14T10:43:50.662 INFO:teuthology.orchestra.run.smithi118.stdout:(213/286): python3-pyasn1-modules-0.4.8-6.el9.n 3.2 MB/s | 279 kB 00:00 2024-09-14T10:43:50.687 INFO:teuthology.orchestra.run.smithi118.stdout:(214/286): python3-pytz-2021.1-5.el9.noarch.rpm 606 kB/s | 51 kB 00:00 2024-09-14T10:43:50.712 INFO:teuthology.orchestra.run.smithi118.stdout:(215/286): python3-requests-oauthlib-1.3.0-12.e 641 kB/s | 54 kB 00:00 2024-09-14T10:43:50.746 INFO:teuthology.orchestra.run.smithi118.stdout:(216/286): python3-toml-0.10.2-6.el9.noarch.rpm 713 kB/s | 42 kB 00:00 2024-09-14T10:43:50.780 INFO:teuthology.orchestra.run.smithi118.stdout:(217/286): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-14T10:43:50.805 INFO:teuthology.orchestra.run.smithi118.stdout:(218/286): qatlib-service-24.02.0-1.el9.x86_64. 614 kB/s | 36 kB 00:00 2024-09-14T10:43:50.847 INFO:teuthology.orchestra.run.smithi118.stdout:(219/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 710 kB/s | 47 kB 00:00 2024-09-14T10:43:50.872 INFO:teuthology.orchestra.run.smithi118.stdout:(220/286): rtkit-0.11-29.el9.x86_64.rpm 837 kB/s | 56 kB 00:00 2024-09-14T10:43:50.914 INFO:teuthology.orchestra.run.smithi118.stdout:(221/286): sisu-0.3.4-10.el9.noarch.rpm 7.5 MB/s | 510 kB 00:00 2024-09-14T10:43:50.940 INFO:teuthology.orchestra.run.smithi118.stdout:(222/286): slf4j-1.7.30-13.el9.noarch.rpm 1.0 MB/s | 69 kB 00:00 2024-09-14T10:43:50.982 INFO:teuthology.orchestra.run.smithi118.stdout:(223/286): socat-1.7.4.1-6.el9.x86_64.rpm 4.4 MB/s | 304 kB 00:00 2024-09-14T10:43:51.024 INFO:teuthology.orchestra.run.smithi118.stdout:(224/286): sound-theme-freedesktop-0.8-17.el9.n 4.5 MB/s | 383 kB 00:00 2024-09-14T10:43:51.049 INFO:teuthology.orchestra.run.smithi118.stdout:(225/286): totem-pl-parser-3.26.6-2.el9.x86_64. 2.2 MB/s | 152 kB 00:00 2024-09-14T10:43:51.216 INFO:teuthology.orchestra.run.smithi118.stdout:(226/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-14T10:43:51.250 INFO:teuthology.orchestra.run.smithi118.stdout:(227/286): tracker-3.1.2-3.el9.x86_64.rpm 2.4 MB/s | 555 kB 00:00 2024-09-14T10:43:51.267 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-09-14T10:43:51.275 INFO:teuthology.orchestra.run.smithi118.stdout:(228/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 911 kB/s | 53 kB 00:00 2024-09-14T10:43:51.317 INFO:teuthology.orchestra.run.smithi118.stdout:(229/286): tracker-miners-3.1.2-4.el9.x86_64.rp 3.4 MB/s | 944 kB 00:00 2024-09-14T10:43:51.342 INFO:teuthology.orchestra.run.smithi118.stdout:(230/286): upower-0.99.11-11.el9.x86_64.rpm 2.5 MB/s | 173 kB 00:00 2024-09-14T10:43:51.368 INFO:teuthology.orchestra.run.smithi118.stdout:(231/286): tzdata-java-2024a-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-14T10:43:51.393 INFO:teuthology.orchestra.run.smithi118.stdout:(232/286): webrtc-audio-processing-0.3.1-8.el9. 4.0 MB/s | 306 kB 00:00 2024-09-14T10:43:51.435 INFO:teuthology.orchestra.run.smithi118.stdout:(233/286): wireplumber-0.4.14-1.el9.x86_64.rpm 1.0 MB/s | 96 kB 00:00 2024-09-14T10:43:51.461 INFO:teuthology.orchestra.run.smithi118.stdout:(234/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 632 kB/s | 42 kB 00:00 2024-09-14T10:43:51.473 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-09-14T10:43:51.473 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-09-14T10:43:51.486 INFO:teuthology.orchestra.run.smithi118.stdout:(235/286): wireplumber-libs-0.4.14-1.el9.x86_64 3.0 MB/s | 358 kB 00:00 2024-09-14T10:43:51.511 INFO:teuthology.orchestra.run.smithi118.stdout:(236/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 5.0 MB/s | 385 kB 00:00 2024-09-14T10:43:51.536 INFO:teuthology.orchestra.run.smithi118.stdout:(237/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.7 MB/s | 134 kB 00:00 2024-09-14T10:43:51.570 INFO:teuthology.orchestra.run.smithi118.stdout:(238/286): xkeyboard-config-2.33-2.el9.noarch.r 10 MB/s | 859 kB 00:00 2024-09-14T10:43:51.595 INFO:teuthology.orchestra.run.smithi118.stdout:(239/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 760 kB/s | 64 kB 00:00 2024-09-14T10:43:51.629 INFO:teuthology.orchestra.run.smithi118.stdout:(240/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 5.4 MB/s | 505 kB 00:00 2024-09-14T10:43:51.688 INFO:teuthology.orchestra.run.smithi118.stdout:(241/286): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-14T10:43:51.721 INFO:teuthology.orchestra.run.smithi118.stdout:(242/286): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-14T10:43:51.746 INFO:teuthology.orchestra.run.smithi118.stdout:(243/286): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-14T10:43:51.881 INFO:teuthology.orchestra.run.smithi118.stdout:(244/286): libarrow-9.0.0-11.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-09-14T10:43:51.922 INFO:teuthology.orchestra.run.smithi118.stdout:(245/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 977 kB/s | 26 kB 00:00 2024-09-14T10:43:51.956 INFO:teuthology.orchestra.run.smithi118.stdout:(246/286): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-14T10:43:51.981 INFO:teuthology.orchestra.run.smithi118.stdout:(247/286): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-14T10:43:52.006 INFO:teuthology.orchestra.run.smithi118.stdout:(248/286): luarocks-3.9.2-5.el9.noarch.rpm 6.4 MB/s | 151 kB 00:00 2024-09-14T10:43:52.048 INFO:teuthology.orchestra.run.smithi118.stdout:(249/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-14T10:43:52.090 INFO:teuthology.orchestra.run.smithi118.stdout:(250/286): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-14T10:43:52.115 INFO:teuthology.orchestra.run.smithi118.stdout:(251/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-14T10:43:52.141 INFO:teuthology.orchestra.run.smithi118.stdout:(252/286): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-14T10:43:52.166 INFO:teuthology.orchestra.run.smithi118.stdout:(253/286): python3-certifi-2023.05.07-4.el9.noa 564 kB/s | 14 kB 00:00 2024-09-14T10:43:52.270 INFO:teuthology.orchestra.run.smithi118.stdout:(254/286): python3-cheroot-8.6.0-4.el9.noarch.r 1.6 MB/s | 172 kB 00:00 2024-09-14T10:43:52.292 INFO:teuthology.orchestra.run.smithi118.stdout:(255/286): lua-devel-5.4.4-4.el9.x86_64.rpm 31 kB/s | 22 kB 00:00 2024-09-14T10:43:52.325 INFO:teuthology.orchestra.run.smithi118.stdout:(256/286): python3-cherrypy-18.6.1-2.el9.noarch 6.3 MB/s | 358 kB 00:00 2024-09-14T10:43:52.367 INFO:teuthology.orchestra.run.smithi118.stdout:(257/286): python3-google-auth-2.34.0-1.el9.noa 2.9 MB/s | 220 kB 00:00 2024-09-14T10:43:52.401 INFO:teuthology.orchestra.run.smithi118.stdout:(258/286): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-14T10:43:52.426 INFO:teuthology.orchestra.run.smithi118.stdout:(259/286): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-14T10:43:52.477 INFO:teuthology.orchestra.run.smithi118.stdout:(260/286): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-09-14T10:43:52.502 INFO:teuthology.orchestra.run.smithi118.stdout:(261/286): python3-jaraco-classes-3.2.1-5.el9.n 234 kB/s | 18 kB 00:00 2024-09-14T10:43:52.528 INFO:teuthology.orchestra.run.smithi118.stdout:(262/286): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-09-14T10:43:52.553 INFO:teuthology.orchestra.run.smithi118.stdout:(263/286): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-14T10:43:52.578 INFO:teuthology.orchestra.run.smithi118.stdout:(264/286): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-14T10:43:52.604 INFO:teuthology.orchestra.run.smithi118.stdout:(265/286): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-14T10:43:52.629 INFO:teuthology.orchestra.run.smithi118.stdout:(266/286): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-14T10:43:52.654 INFO:teuthology.orchestra.run.smithi118.stdout:(267/286): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-14T10:43:52.688 INFO:teuthology.orchestra.run.smithi118.stdout:(268/286): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-14T10:43:52.772 INFO:teuthology.orchestra.run.smithi118.stdout:(269/286): protobuf-compiler-3.14.0-13.el9.x86_ 734 kB/s | 863 kB 00:01 2024-09-14T10:43:52.805 INFO:teuthology.orchestra.run.smithi118.stdout:(270/286): python3-portend-3.1.0-2.el9.noarch.r 140 kB/s | 16 kB 00:00 2024-09-14T10:43:52.839 INFO:teuthology.orchestra.run.smithi118.stdout:(271/286): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-14T10:43:52.872 INFO:teuthology.orchestra.run.smithi118.stdout:(272/286): python3-kubernetes-26.1.0-2.el9.noar 3.2 MB/s | 1.0 MB 00:00 2024-09-14T10:43:52.898 INFO:teuthology.orchestra.run.smithi118.stdout:(273/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 714 kB/s | 90 kB 00:00 2024-09-14T10:43:52.923 INFO:teuthology.orchestra.run.smithi118.stdout:(274/286): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-14T10:43:52.948 INFO:teuthology.orchestra.run.smithi118.stdout:(275/286): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-14T10:43:52.974 INFO:teuthology.orchestra.run.smithi118.stdout:(276/286): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-14T10:43:52.999 INFO:teuthology.orchestra.run.smithi118.stdout:(277/286): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-09-14T10:43:53.033 INFO:teuthology.orchestra.run.smithi118.stdout:(278/286): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-14T10:43:53.058 INFO:teuthology.orchestra.run.smithi118.stdout:(279/286): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-14T10:43:53.083 INFO:teuthology.orchestra.run.smithi118.stdout:(280/286): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-14T10:43:53.108 INFO:teuthology.orchestra.run.smithi118.stdout:(281/286): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-14T10:43:53.134 INFO:teuthology.orchestra.run.smithi118.stdout:(282/286): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-14T10:43:53.168 INFO:teuthology.orchestra.run.smithi118.stdout:(283/286): python3-werkzeug-2.0.3-3.el9.1.noarc 2.5 MB/s | 427 kB 00:00 2024-09-14T10:43:53.218 INFO:teuthology.orchestra.run.smithi118.stdout:(284/286): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-14T10:43:53.451 INFO:teuthology.orchestra.run.smithi118.stdout:(285/286): librbd1-19.3.0-4907.ga2782315.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-14T10:43:53.502 INFO:teuthology.orchestra.run.smithi118.stdout:(286/286): librados2-19.3.0-4907.ga2782315.el9. 9.4 MB/s | 3.5 MB 00:00 2024-09-14T10:43:53.509 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:43:53.509 INFO:teuthology.orchestra.run.smithi118.stdout:Total 24 MB/s | 327 MB 00:13 2024-09-14T10:43:54.908 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-09-14T10:43:54.908 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-09-14T10:43:56.721 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-09-14T10:43:56.906 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-09-14T10:43:56.906 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-09-14T10:44:00.149 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-09-14T10:44:00.149 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-09-14T10:44:05.243 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-14T10:44:05.432 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-14T10:44:05.597 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-09-14T10:44:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-14T10:44:05.753 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-14T10:44:05.900 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-14T10:44:05.937 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-14T10:44:05.990 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-14T10:44:06.040 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-14T10:44:06.065 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-14T10:44:06.112 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-14T10:44:06.536 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-14T10:44:06.599 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T10:44:06.750 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T10:44:06.784 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T10:44:06.877 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T10:44:06.905 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T10:44:06.957 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-14T10:44:06.989 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-14T10:44:07.015 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-14T10:44:07.041 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-14T10:44:07.073 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-14T10:44:07.105 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-14T10:44:07.132 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-14T10:44:07.160 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-14T10:44:07.336 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-14T10:44:07.491 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-14T10:44:07.525 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-14T10:44:07.562 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-14T10:44:07.598 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T10:44:07.689 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T10:44:07.724 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T10:44:07.787 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T10:44:07.820 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-14T10:44:07.850 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T10:44:07.873 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T10:44:08.072 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T10:44:08.118 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T10:44:08.235 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-14T10:44:08.265 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-14T10:44:08.302 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-14T10:44:08.375 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-14T10:44:08.432 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-14T10:44:08.471 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-14T10:44:08.515 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-14T10:44:08.555 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-14T10:44:08.582 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-14T10:44:08.606 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-14T10:44:08.632 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-14T10:44:08.662 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-14T10:44:08.694 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-14T10:44:08.718 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-14T10:44:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-14T10:44:08.808 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T10:44:08.909 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T10:44:08.969 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-14T10:44:08.998 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-14T10:44:09.061 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-14T10:44:09.094 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-14T10:44:09.126 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-14T10:44:09.207 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-14T10:44:09.245 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 52/288 2024-09-14T10:44:09.289 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 53/288 2024-09-14T10:44:09.339 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 54/288 2024-09-14T10:44:09.420 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-14T10:44:09.568 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-14T10:44:09.644 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-14T10:44:10.219 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-14T10:44:10.299 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-14T10:44:10.316 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-14T10:44:10.352 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-14T10:44:10.425 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-14T10:44:10.458 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-14T10:44:10.466 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-14T10:44:10.503 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-14T10:44:10.532 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-14T10:44:10.608 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-14T10:44:10.614 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-09-14T10:44:10.651 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-14T10:44:10.692 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-14T10:44:10.703 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-14T10:44:10.728 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-14T10:44:10.730 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-14T10:44:10.766 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 69/288 2024-09-14T10:44:10.798 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-14T10:44:10.830 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-14T10:44:10.873 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-14T10:44:10.923 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-14T10:44:10.932 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-14T10:44:10.966 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-14T10:44:11.002 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-14T10:44:11.025 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-14T10:44:11.084 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-14T10:44:11.100 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-14T10:44:11.125 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-14T10:44:11.150 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-14T10:44:11.169 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-14T10:44:11.202 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-14T10:44:11.244 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-14T10:44:11.280 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-14T10:44:11.316 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-14T10:44:11.364 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-14T10:44:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-14T10:44:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-14T10:44:11.615 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-14T10:44:11.622 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-14T10:44:11.660 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-14T10:44:11.676 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T10:44:11.703 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-14T10:44:11.799 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T10:44:11.812 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-14T10:44:11.844 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T10:44:11.844 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-14T10:44:11.910 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-14T10:44:11.943 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T10:44:11.950 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-14T10:44:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-14T10:44:11.982 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T10:44:12.029 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-14T10:44:12.061 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-14T10:44:12.074 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-14T10:44:12.101 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-14T10:44:12.126 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-14T10:44:12.158 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-14T10:44:12.190 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-14T10:44:12.202 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-14T10:44:12.218 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-14T10:44:12.244 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-14T10:44:12.246 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-14T10:44:12.426 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-14T10:44:12.473 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-14T10:44:12.520 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-14T10:44:12.560 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-14T10:44:12.572 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-14T10:44:12.590 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-14T10:44:12.615 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-14T10:44:12.634 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-14T10:44:12.653 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-14T10:44:12.659 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T10:44:12.674 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T10:44:12.674 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-14T10:44:12.674 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:44:12.705 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T10:44:12.802 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T10:44:12.840 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T10:44:12.873 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-14T10:44:12.894 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T10:44:12.928 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-14T10:44:12.954 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-14T10:44:12.958 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T10:44:12.982 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T10:44:13.009 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-14T10:44:13.033 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T10:44:13.059 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T10:44:13.084 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-14T10:44:13.187 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T10:44:13.218 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T10:44:13.340 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-14T10:44:13.374 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-14T10:44:13.409 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-14T10:44:13.484 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-14T10:44:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T10:44:13.536 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-14T10:44:13.563 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T10:44:13.579 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T10:44:13.579 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-14T10:44:13.579 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:44:13.584 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-14T10:44:13.620 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-14T10:44:13.627 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-14T10:44:13.652 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-14T10:44:13.655 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-14T10:44:13.679 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-14T10:44:13.689 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-14T10:44:13.704 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-14T10:44:13.730 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-14T10:44:13.741 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-14T10:44:13.758 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-14T10:44:13.781 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-14T10:44:13.790 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-14T10:44:13.823 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-14T10:44:13.866 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-14T10:44:13.877 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-14T10:44:13.902 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T10:44:13.929 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-14T10:44:13.967 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-14T10:44:13.969 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T10:44:14.029 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-14T10:44:14.059 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-14T10:44:14.080 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-14T10:44:14.111 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-14T10:44:14.145 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-14T10:44:14.155 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-14T10:44:14.195 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-14T10:44:14.273 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-14T10:44:14.314 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 52/288 2024-09-14T10:44:14.358 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 53/288 2024-09-14T10:44:14.399 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 54/288 2024-09-14T10:44:14.475 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-14T10:44:14.620 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-14T10:44:14.672 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-14T10:44:14.944 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-14T10:44:14.991 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-14T10:44:15.024 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-14T10:44:15.132 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-14T10:44:15.175 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-14T10:44:15.223 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-14T10:44:15.301 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-14T10:44:15.338 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-14T10:44:15.388 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-14T10:44:15.414 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-14T10:44:15.430 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-14T10:44:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-14T10:44:15.474 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-14T10:44:15.505 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-14T10:44:15.534 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-14T10:44:15.605 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-14T10:44:15.637 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-14T10:44:15.670 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-14T10:44:15.705 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-14T10:44:15.743 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 69/288 2024-09-14T10:44:15.776 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-14T10:44:15.817 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-14T10:44:15.867 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-14T10:44:15.925 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-14T10:44:15.961 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-14T10:44:15.998 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-14T10:44:16.030 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-14T10:44:16.091 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-14T10:44:16.091 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-14T10:44:16.125 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-14T10:44:16.160 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-14T10:44:16.162 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-14T10:44:16.201 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-14T10:44:16.235 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-14T10:44:16.275 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-14T10:44:16.311 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-14T10:44:16.358 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-14T10:44:16.432 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-14T10:44:16.432 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-14T10:44:16.432 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-14T10:44:16.445 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-14T10:44:16.504 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-14T10:44:16.585 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-14T10:44:16.639 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-14T10:44:16.689 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-14T10:44:16.802 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-14T10:44:16.839 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-14T10:44:16.881 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-14T10:44:16.913 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-14T10:44:16.938 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-14T10:44:17.023 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-14T10:44:17.150 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-14T10:44:17.199 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-14T10:44:17.226 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-14T10:44:17.345 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-14T10:44:17.421 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-14T10:44:17.459 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-14T10:44:17.491 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-14T10:44:17.521 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-14T10:44:17.562 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-14T10:44:17.591 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T10:44:17.604 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T10:44:17.604 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-14T10:44:17.604 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:44:17.796 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-14T10:44:17.874 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-14T10:44:17.932 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-14T10:44:17.956 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T10:44:17.981 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T10:44:18.008 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-14T10:44:18.440 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T10:44:18.479 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T10:44:18.493 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T10:44:18.493 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-14T10:44:18.493 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:44:18.535 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-14T10:44:18.570 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-14T10:44:18.603 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-14T10:44:18.645 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-14T10:44:18.679 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-14T10:44:18.713 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-14T10:44:18.767 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-14T10:44:18.793 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-14T10:44:18.810 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-14T10:44:18.849 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-14T10:44:18.866 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-14T10:44:18.904 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-14T10:44:18.924 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-14T10:44:18.952 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T10:44:18.954 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-14T10:44:18.964 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T10:44:18.964 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-14T10:44:18.964 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:44:19.010 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-14T10:44:19.024 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-14T10:44:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-14T10:44:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-14T10:44:19.423 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-14T10:44:19.472 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T10:44:19.574 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T10:44:19.605 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 146/288 2024-09-14T10:44:19.636 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-14T10:44:19.666 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-14T10:44:19.728 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-14T10:44:19.747 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-14T10:44:19.765 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-14T10:44:19.799 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-14T10:44:19.799 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-14T10:44:19.832 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-14T10:44:19.843 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-14T10:44:19.863 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T10:44:19.943 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-14T10:44:19.993 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-14T10:44:20.172 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T10:44:20.190 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-14T10:44:20.207 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-14T10:44:20.230 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-14T10:44:20.235 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-14T10:44:20.260 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-14T10:44:20.274 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-14T10:44:20.286 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-14T10:44:20.311 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-14T10:44:20.336 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-14T10:44:20.365 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-14T10:44:20.401 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-14T10:44:20.452 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-14T10:44:20.485 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-14T10:44:20.533 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-14T10:44:20.568 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-14T10:44:20.784 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-14T10:44:20.847 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-14T10:44:20.909 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-14T10:44:20.952 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-14T10:44:20.993 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-14T10:44:21.078 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-14T10:44:21.181 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-14T10:44:21.208 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-14T10:44:21.220 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-14T10:44:21.275 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-14T10:44:21.287 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-14T10:44:21.299 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-14T10:44:21.337 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-14T10:44:21.414 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-14T10:44:21.461 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-14T10:44:21.492 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T10:44:21.514 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T10:44:21.548 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-14T10:44:21.574 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-14T10:44:21.608 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-14T10:44:21.628 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T10:44:21.976 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-14T10:44:22.092 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-14T10:44:23.383 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-14T10:44:23.471 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-14T10:44:23.531 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-14T10:44:23.565 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-14T10:44:23.592 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-14T10:44:23.622 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T10:44:23.634 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T10:44:23.634 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-14T10:44:23.634 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:44:23.699 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-14T10:44:23.734 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-14T10:44:23.763 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-14T10:44:24.089 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-14T10:44:24.134 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T10:44:24.226 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T10:44:24.258 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 146/288 2024-09-14T10:44:24.290 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-14T10:44:24.319 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-14T10:44:24.388 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-14T10:44:24.419 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-14T10:44:24.445 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-14T10:44:24.492 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-14T10:44:24.517 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T10:44:24.814 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T10:44:24.861 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-14T10:44:24.889 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-14T10:44:24.914 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-14T10:44:24.940 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-14T10:44:24.991 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-14T10:44:25.016 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-14T10:44:25.053 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-14T10:44:25.089 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-14T10:44:25.131 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-14T10:44:25.164 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-14T10:44:25.212 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-14T10:44:25.248 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-14T10:44:25.719 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-14T10:44:25.850 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-14T10:44:25.916 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-14T10:44:25.941 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-14T10:44:25.969 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-14T10:44:26.055 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-14T10:44:26.104 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-14T10:44:26.134 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T10:44:26.155 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T10:44:26.188 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-14T10:44:26.215 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-14T10:44:26.255 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-14T10:44:26.278 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T10:44:33.878 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T10:44:33.921 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-14T10:44:33.957 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-14T10:44:34.005 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-14T10:44:34.039 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-14T10:44:34.076 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-14T10:44:34.599 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-14T10:44:34.622 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T10:44:34.703 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T10:44:34.732 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 185/288 2024-09-14T10:44:37.232 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T10:44:37.267 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T10:44:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T10:44:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T10:44:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T10:44:37.976 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T10:44:37.976 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T10:44:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:44:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T10:44:38.497 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T10:44:38.549 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-14T10:44:38.586 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-14T10:44:38.631 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-14T10:44:38.669 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-14T10:44:38.706 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-14T10:44:39.228 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-14T10:44:39.260 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T10:44:39.332 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T10:44:39.371 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 185/288 2024-09-14T10:44:41.719 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T10:44:41.770 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T10:44:42.334 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T10:44:42.374 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T10:44:42.466 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T10:44:42.466 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T10:44:42.467 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T10:44:42.467 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:44:42.500 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T10:44:47.910 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T10:44:47.910 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /sys 2024-09-14T10:44:47.910 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /proc 2024-09-14T10:44:47.910 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /mnt 2024-09-14T10:44:47.910 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /var/tmp 2024-09-14T10:44:47.910 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /home 2024-09-14T10:44:47.910 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /root 2024-09-14T10:44:47.910 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /tmp 2024-09-14T10:44:47.910 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:44:48.084 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T10:44:48.101 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T10:44:48.101 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:44:48.102 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T10:44:48.102 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:44:49.643 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T10:44:49.672 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T10:44:49.672 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:44:49.672 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T10:44:49.673 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T10:44:49.673 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T10:44:49.673 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:44:49.911 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T10:44:49.936 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T10:44:49.936 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:44:49.936 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T10:44:49.936 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T10:44:49.936 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T10:44:49.936 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:44:50.403 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T10:44:50.428 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T10:44:50.429 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:44:50.429 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T10:44:50.429 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T10:44:50.429 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T10:44:50.429 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:44:50.534 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-14T10:44:52.103 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T10:44:52.103 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /sys 2024-09-14T10:44:52.103 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /proc 2024-09-14T10:44:52.103 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /mnt 2024-09-14T10:44:52.103 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /var/tmp 2024-09-14T10:44:52.103 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /home 2024-09-14T10:44:52.103 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /root 2024-09-14T10:44:52.104 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /tmp 2024-09-14T10:44:52.104 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:44:52.300 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T10:44:52.316 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T10:44:52.316 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:44:52.317 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T10:44:52.317 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:44:53.606 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-14T10:44:53.722 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-14T10:44:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-14T10:44:53.784 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T10:44:53.812 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T10:44:53.812 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:44:53.812 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T10:44:53.812 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T10:44:53.812 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T10:44:53.812 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:44:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-14T10:44:54.043 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T10:44:54.066 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T10:44:54.066 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:44:54.066 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T10:44:54.066 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T10:44:54.066 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T10:44:54.066 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:44:54.142 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-14T10:44:54.191 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-14T10:44:54.266 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-14T10:44:54.481 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-14T10:44:54.527 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T10:44:54.550 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T10:44:54.550 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:44:54.550 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T10:44:54.551 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T10:44:54.551 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T10:44:54.551 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:44:54.633 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-14T10:44:54.653 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-14T10:44:54.677 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-14T10:44:54.710 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-14T10:44:55.614 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-14T10:44:55.658 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T10:44:56.122 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T10:44:56.165 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-14T10:44:56.196 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-14T10:44:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-14T10:44:56.259 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-14T10:44:56.296 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-14T10:44:56.323 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-14T10:44:56.349 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-14T10:44:56.375 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-14T10:44:56.399 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-14T10:44:56.426 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-14T10:44:56.451 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-14T10:44:56.487 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-14T10:44:56.517 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-14T10:44:56.545 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-14T10:44:56.581 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-14T10:44:56.617 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-14T10:44:56.647 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-14T10:44:56.682 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-14T10:44:56.716 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-14T10:44:56.753 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-14T10:44:56.792 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-14T10:44:56.835 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-14T10:44:56.879 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-14T10:44:56.910 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-14T10:44:56.941 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-14T10:44:56.999 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-14T10:44:57.027 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-14T10:44:57.057 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-14T10:44:57.086 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-14T10:44:57.112 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-14T10:44:57.290 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-14T10:44:57.329 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-14T10:44:57.355 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-14T10:44:57.384 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-14T10:44:57.415 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-14T10:44:57.548 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-14T10:44:57.576 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-14T10:44:57.641 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-14T10:44:57.696 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-14T10:44:57.711 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-14T10:44:57.745 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T10:44:57.777 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-14T10:44:57.842 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-14T10:44:57.879 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T10:44:57.917 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T10:44:57.933 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T10:44:57.962 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-14T10:44:57.985 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-14T10:44:58.037 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-14T10:44:58.083 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-14T10:44:58.161 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-14T10:44:58.252 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-14T10:44:58.352 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T10:44:58.381 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T10:44:58.398 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T10:44:58.398 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-14T10:44:58.399 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:44:58.408 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-14T10:44:58.452 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-14T10:44:58.494 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-14T10:44:58.643 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-14T10:44:58.721 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-14T10:44:58.774 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-14T10:44:58.811 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-14T10:44:58.836 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-14T10:44:59.296 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T10:44:59.331 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T10:44:59.347 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-14T10:44:59.349 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T10:44:59.401 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T10:44:59.756 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T10:44:59.799 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-14T10:44:59.830 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-14T10:44:59.858 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-14T10:44:59.893 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-14T10:44:59.905 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T10:44:59.930 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-14T10:44:59.957 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-14T10:44:59.983 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-14T10:44:59.999 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T10:45:00.009 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-14T10:45:00.031 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T10:45:00.034 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-14T10:45:00.060 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-14T10:45:00.061 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T10:45:00.085 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-14T10:45:00.112 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-14T10:45:00.143 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-14T10:45:00.171 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-14T10:45:00.214 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-14T10:45:00.250 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-14T10:45:00.273 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-14T10:45:00.281 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-14T10:45:00.315 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-14T10:45:00.340 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-14T10:45:00.350 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-14T10:45:00.365 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T10:45:00.386 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-14T10:45:00.387 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T10:45:00.425 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T10:45:00.425 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-14T10:45:00.459 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-14T10:45:00.492 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T10:45:00.503 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-14T10:45:00.527 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T10:45:00.535 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-14T10:45:00.538 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T10:45:00.559 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-14T10:45:00.569 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T10:45:00.595 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T10:45:00.611 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-14T10:45:00.620 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-14T10:45:00.653 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-14T10:45:00.691 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-14T10:45:00.729 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-14T10:45:00.755 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-14T10:45:00.921 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-14T10:45:00.972 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-14T10:45:00.998 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-14T10:45:01.025 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-14T10:45:01.058 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-14T10:45:01.077 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T10:45:01.101 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T10:45:01.135 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 266/288 2024-09-14T10:45:01.183 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-14T10:45:01.213 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 267/288 2024-09-14T10:45:01.248 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-14T10:45:01.250 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T10:45:01.335 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-14T10:45:01.372 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T10:45:01.498 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T10:45:01.561 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T10:45:01.577 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T10:45:01.610 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-14T10:45:01.629 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-14T10:45:02.093 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T10:45:02.125 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T10:45:02.142 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T10:45:02.142 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-14T10:45:02.142 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:02.393 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-14T10:45:02.463 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-14T10:45:02.510 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-14T10:45:02.547 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-14T10:45:02.572 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-14T10:45:03.003 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T10:45:03.035 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T10:45:03.051 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T10:45:03.567 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T10:45:03.646 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T10:45:03.696 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T10:45:03.726 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T10:45:03.927 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-14T10:45:03.983 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-14T10:45:04.019 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T10:45:04.041 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T10:45:04.086 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T10:45:04.153 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T10:45:04.189 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T10:45:04.200 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T10:45:04.231 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T10:45:04.250 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T10:45:04.274 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-14T10:45:04.647 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T10:45:04.678 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T10:45:04.705 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T10:45:04.706 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T10:45:04.739 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 266/288 2024-09-14T10:45:04.804 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 267/288 2024-09-14T10:45:04.830 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T10:45:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T10:45:05.749 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T10:45:05.871 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T10:45:06.036 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 271/288 2024-09-14T10:45:06.067 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T10:45:06.092 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T10:45:06.093 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:45:06.093 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T10:45:06.093 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T10:45:06.093 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T10:45:06.093 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:06.143 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T10:45:06.155 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T10:45:06.177 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 274/288 2024-09-14T10:45:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-14T10:45:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-14T10:45:06.295 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T10:45:06.312 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T10:45:06.312 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-14T10:45:06.312 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:07.321 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T10:45:07.347 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T10:45:07.347 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:45:07.347 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T10:45:07.347 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:45:07.347 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:45:07.347 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:07.389 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T10:45:07.413 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T10:45:07.413 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:45:07.413 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T10:45:07.413 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:07.748 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T10:45:07.773 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T10:45:07.773 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:45:07.774 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T10:45:07.774 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T10:45:07.774 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T10:45:07.774 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:08.039 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T10:45:08.104 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T10:45:09.069 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T10:45:09.112 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T10:45:09.228 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T10:45:09.391 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 271/288 2024-09-14T10:45:09.431 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T10:45:09.454 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T10:45:09.454 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:45:09.455 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T10:45:09.455 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T10:45:09.455 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T10:45:09.455 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:09.507 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T10:45:09.518 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T10:45:09.541 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 274/288 2024-09-14T10:45:09.570 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-14T10:45:09.618 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-14T10:45:09.643 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T10:45:09.658 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T10:45:09.659 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-14T10:45:09.659 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:10.627 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T10:45:10.650 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T10:45:10.651 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:45:10.651 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T10:45:10.651 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:45:10.651 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:45:10.651 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:10.704 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T10:45:10.726 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T10:45:10.726 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:45:10.726 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T10:45:10.726 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:11.053 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T10:45:11.077 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T10:45:11.077 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:45:11.077 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T10:45:11.077 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T10:45:11.077 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T10:45:11.077 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:12.788 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 281/288 2024-09-14T10:45:12.830 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 282/288 2024-09-14T10:45:12.861 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 283/288 2024-09-14T10:45:12.969 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 284/288 2024-09-14T10:45:13.031 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T10:45:13.060 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-14T10:45:13.060 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T10:45:13.156 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T10:45:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:45:13.227 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:45:13.255 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-14T10:45:13.261 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-14T10:45:13.271 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-14T10:45:13.282 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-14T10:45:13.282 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T10:45:13.282 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T10:45:13.282 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:13.354 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T10:45:13.427 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T10:45:15.799 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 281/288 2024-09-14T10:45:15.840 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 282/288 2024-09-14T10:45:15.872 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 283/288 2024-09-14T10:45:15.976 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 284/288 2024-09-14T10:45:16.041 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T10:45:16.072 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-14T10:45:16.072 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T10:45:16.164 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T10:45:16.164 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:45:16.255 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:45:16.278 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-14T10:45:16.285 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-14T10:45:16.294 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-14T10:45:16.304 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-14T10:45:16.304 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T10:45:16.304 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T10:45:16.304 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:16.361 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T10:45:16.431 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T10:45:23.222 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:45:23.222 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 1/288 2024-09-14T10:45:23.222 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2/288 2024-09-14T10:45:23.222 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 3/288 2024-09-14T10:45:23.222 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 4/288 2024-09-14T10:45:23.222 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 5/288 2024-09-14T10:45:23.222 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 6/288 2024-09-14T10:45:23.222 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 7/288 2024-09-14T10:45:23.222 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 8/288 2024-09-14T10:45:23.223 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 9/288 2024-09-14T10:45:23.223 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T10:45:23.223 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T10:45:23.223 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T10:45:23.223 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 13/288 2024-09-14T10:45:23.223 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 14/288 2024-09-14T10:45:23.223 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 15/288 2024-09-14T10:45:23.223 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 16/288 2024-09-14T10:45:23.223 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 17/288 2024-09-14T10:45:23.223 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 18/288 2024-09-14T10:45:23.223 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 19/288 2024-09-14T10:45:23.223 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 20/288 2024-09-14T10:45:23.223 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 21/288 2024-09-14T10:45:23.223 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 22/288 2024-09-14T10:45:23.223 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 23/288 2024-09-14T10:45:23.224 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 24/288 2024-09-14T10:45:23.224 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T10:45:23.224 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 26/288 2024-09-14T10:45:23.224 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 27/288 2024-09-14T10:45:23.248 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 28/288 2024-09-14T10:45:23.248 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 29/288 2024-09-14T10:45:23.248 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 30/288 2024-09-14T10:45:23.248 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 31/288 2024-09-14T10:45:23.248 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 32/288 2024-09-14T10:45:23.249 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 33/288 2024-09-14T10:45:23.249 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 34/288 2024-09-14T10:45:23.249 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 35/288 2024-09-14T10:45:23.249 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 36/288 2024-09-14T10:45:23.249 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-14T10:45:23.249 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-14T10:45:23.249 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-14T10:45:23.249 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-14T10:45:23.249 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-14T10:45:23.249 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-14T10:45:23.249 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-14T10:45:23.249 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-14T10:45:23.250 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-14T10:45:23.250 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-14T10:45:23.250 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-14T10:45:23.250 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-14T10:45:23.250 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-14T10:45:23.250 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-14T10:45:23.250 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-14T10:45:23.250 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-14T10:45:23.250 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-14T10:45:23.250 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-14T10:45:23.250 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-14T10:45:23.250 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-14T10:45:23.250 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-14T10:45:23.250 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-14T10:45:23.251 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-14T10:45:23.251 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-14T10:45:23.251 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-14T10:45:23.251 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-14T10:45:23.251 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-14T10:45:23.251 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-14T10:45:23.251 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-14T10:45:23.251 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-14T10:45:23.251 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-14T10:45:23.251 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-14T10:45:23.251 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-14T10:45:23.251 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-14T10:45:23.251 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-14T10:45:23.252 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-14T10:45:23.252 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-14T10:45:23.252 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-14T10:45:23.252 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-14T10:45:23.252 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-14T10:45:23.252 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-14T10:45:23.252 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-14T10:45:23.252 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-14T10:45:23.252 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-14T10:45:23.252 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-14T10:45:23.252 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-14T10:45:23.252 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-14T10:45:23.253 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-14T10:45:23.253 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-14T10:45:23.253 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-14T10:45:23.253 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-14T10:45:23.253 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-14T10:45:23.253 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-14T10:45:23.253 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-14T10:45:23.253 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-14T10:45:23.253 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-14T10:45:23.253 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-14T10:45:23.253 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-14T10:45:23.253 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-14T10:45:23.253 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-14T10:45:23.253 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-14T10:45:23.254 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-14T10:45:23.254 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-14T10:45:23.254 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-14T10:45:23.254 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-14T10:45:23.254 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-14T10:45:23.254 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-14T10:45:23.254 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-14T10:45:23.254 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-14T10:45:23.254 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-14T10:45:23.254 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-14T10:45:23.254 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-14T10:45:23.254 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-14T10:45:23.254 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-14T10:45:23.254 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-14T10:45:23.255 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-14T10:45:23.255 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-14T10:45:23.255 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-14T10:45:23.255 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-14T10:45:23.255 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-14T10:45:23.255 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-14T10:45:23.255 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-14T10:45:23.255 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-14T10:45:23.255 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-14T10:45:23.255 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-14T10:45:23.255 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-14T10:45:23.255 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-14T10:45:23.255 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-14T10:45:23.255 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-14T10:45:23.256 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-14T10:45:23.256 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-14T10:45:23.256 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-14T10:45:23.256 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-14T10:45:23.256 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-14T10:45:23.256 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-14T10:45:23.256 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-14T10:45:23.256 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-14T10:45:23.256 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-14T10:45:23.256 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-14T10:45:23.256 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-14T10:45:23.256 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-14T10:45:23.256 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-14T10:45:23.257 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-14T10:45:23.257 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-14T10:45:23.257 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-14T10:45:23.257 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-14T10:45:23.257 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-14T10:45:23.257 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-14T10:45:23.257 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-14T10:45:23.257 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-14T10:45:23.257 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-14T10:45:23.257 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-14T10:45:23.257 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-14T10:45:23.257 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-14T10:45:23.257 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-14T10:45:23.257 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-14T10:45:23.258 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-14T10:45:23.258 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-14T10:45:23.258 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-14T10:45:23.258 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-14T10:45:23.258 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-14T10:45:23.258 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-14T10:45:23.258 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-14T10:45:23.258 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-14T10:45:23.258 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-14T10:45:23.258 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-14T10:45:23.258 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-14T10:45:23.258 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-14T10:45:23.258 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-14T10:45:23.258 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-14T10:45:23.259 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-14T10:45:23.259 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-14T10:45:23.259 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-14T10:45:23.259 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-14T10:45:23.259 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-14T10:45:23.259 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-14T10:45:23.259 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-14T10:45:23.259 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-14T10:45:23.259 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-14T10:45:23.259 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-14T10:45:23.259 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-14T10:45:23.259 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-14T10:45:23.259 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-14T10:45:23.259 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-14T10:45:23.260 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-14T10:45:23.260 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-14T10:45:23.260 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-14T10:45:23.260 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-14T10:45:23.260 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-14T10:45:23.260 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-14T10:45:23.260 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-14T10:45:23.260 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-14T10:45:23.260 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-14T10:45:23.260 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-14T10:45:23.260 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-14T10:45:23.260 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-14T10:45:23.260 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-14T10:45:23.261 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-14T10:45:23.261 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-14T10:45:23.261 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-14T10:45:23.261 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-14T10:45:23.261 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-14T10:45:23.261 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-14T10:45:23.261 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-14T10:45:23.261 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-14T10:45:23.261 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-14T10:45:23.261 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-14T10:45:23.261 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-14T10:45:23.261 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-14T10:45:23.261 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-14T10:45:23.261 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-14T10:45:23.262 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-14T10:45:23.262 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-14T10:45:23.262 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-14T10:45:23.262 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-14T10:45:23.262 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-14T10:45:23.262 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-14T10:45:23.262 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-14T10:45:23.262 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-14T10:45:23.262 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-14T10:45:23.262 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-14T10:45:23.262 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-14T10:45:23.262 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-14T10:45:23.262 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-14T10:45:23.262 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-14T10:45:23.263 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-14T10:45:23.263 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-14T10:45:23.263 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-14T10:45:23.263 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-14T10:45:23.263 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-14T10:45:23.263 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-14T10:45:23.263 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-14T10:45:23.263 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-14T10:45:23.263 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-14T10:45:23.263 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-14T10:45:23.263 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-14T10:45:23.263 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-14T10:45:23.263 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-14T10:45:23.263 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-14T10:45:23.264 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-14T10:45:23.264 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-14T10:45:23.264 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-14T10:45:23.264 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-14T10:45:23.264 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-14T10:45:23.264 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-14T10:45:23.264 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-14T10:45:23.264 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-14T10:45:23.264 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-14T10:45:23.264 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-14T10:45:23.264 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-14T10:45:23.264 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-14T10:45:23.264 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-14T10:45:23.265 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-14T10:45:23.265 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-14T10:45:23.265 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-14T10:45:23.265 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-14T10:45:23.265 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-14T10:45:23.265 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-14T10:45:23.265 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-14T10:45:23.265 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-14T10:45:23.265 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-14T10:45:23.265 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-14T10:45:23.265 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-14T10:45:23.265 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-14T10:45:23.265 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-14T10:45:23.265 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-14T10:45:23.265 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-14T10:45:23.266 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-14T10:45:23.266 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-14T10:45:23.266 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-14T10:45:23.266 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-14T10:45:23.266 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-14T10:45:23.266 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-14T10:45:23.266 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-14T10:45:23.266 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-14T10:45:23.266 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-14T10:45:23.266 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-14T10:45:23.266 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-14T10:45:23.266 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-14T10:45:23.266 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-14T10:45:23.266 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-14T10:45:23.267 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-14T10:45:23.267 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-14T10:45:23.267 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-14T10:45:23.267 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-14T10:45:23.267 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-14T10:45:23.267 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-14T10:45:23.267 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-14T10:45:23.267 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T10:45:23.267 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-14T10:45:23.267 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 287/288 2024-09-14T10:45:26.700 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:45:26.700 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:26.701 INFO:teuthology.orchestra.run.smithi050.stdout:Upgraded: 2024-09-14T10:45:26.701 INFO:teuthology.orchestra.run.smithi050.stdout: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.701 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.701 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-09-14T10:45:26.701 INFO:teuthology.orchestra.run.smithi050.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-14T10:45:26.701 INFO:teuthology.orchestra.run.smithi050.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T10:45:26.701 INFO:teuthology.orchestra.run.smithi050.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-14T10:45:26.701 INFO:teuthology.orchestra.run.smithi050.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-14T10:45:26.701 INFO:teuthology.orchestra.run.smithi050.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-14T10:45:26.701 INFO:teuthology.orchestra.run.smithi050.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-14T10:45:26.701 INFO:teuthology.orchestra.run.smithi050.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-14T10:45:26.701 INFO:teuthology.orchestra.run.smithi050.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-14T10:45:26.701 INFO:teuthology.orchestra.run.smithi050.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-14T10:45:26.701 INFO:teuthology.orchestra.run.smithi050.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-14T10:45:26.702 INFO:teuthology.orchestra.run.smithi050.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-14T10:45:26.702 INFO:teuthology.orchestra.run.smithi050.stdout: atinject-1.0.3-6.el9.noarch 2024-09-14T10:45:26.702 INFO:teuthology.orchestra.run.smithi050.stdout: atk-2.36.0-5.el9.x86_64 2024-09-14T10:45:26.702 INFO:teuthology.orchestra.run.smithi050.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-14T10:45:26.702 INFO:teuthology.orchestra.run.smithi050.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-14T10:45:26.702 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T10:45:26.702 INFO:teuthology.orchestra.run.smithi050.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-14T10:45:26.702 INFO:teuthology.orchestra.run.smithi050.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-14T10:45:26.702 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.702 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.702 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.702 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.702 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:45:26.702 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.702 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.703 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.703 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:45:26.703 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:45:26.703 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:45:26.703 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:45:26.703 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:45:26.703 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.703 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.703 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:45:26.703 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.703 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.703 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.703 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:45:26.703 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:45:26.703 INFO:teuthology.orchestra.run.smithi050.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-14T10:45:26.704 INFO:teuthology.orchestra.run.smithi050.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-14T10:45:26.704 INFO:teuthology.orchestra.run.smithi050.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-14T10:45:26.704 INFO:teuthology.orchestra.run.smithi050.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-14T10:45:26.704 INFO:teuthology.orchestra.run.smithi050.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-14T10:45:26.704 INFO:teuthology.orchestra.run.smithi050.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-14T10:45:26.704 INFO:teuthology.orchestra.run.smithi050.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-14T10:45:26.704 INFO:teuthology.orchestra.run.smithi050.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-14T10:45:26.704 INFO:teuthology.orchestra.run.smithi050.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-14T10:45:26.704 INFO:teuthology.orchestra.run.smithi050.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-14T10:45:26.704 INFO:teuthology.orchestra.run.smithi050.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-14T10:45:26.704 INFO:teuthology.orchestra.run.smithi050.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-14T10:45:26.704 INFO:teuthology.orchestra.run.smithi050.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-14T10:45:26.704 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T10:45:26.704 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T10:45:26.704 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T10:45:26.705 INFO:teuthology.orchestra.run.smithi050.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-14T10:45:26.705 INFO:teuthology.orchestra.run.smithi050.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-14T10:45:26.705 INFO:teuthology.orchestra.run.smithi050.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-14T10:45:26.705 INFO:teuthology.orchestra.run.smithi050.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-14T10:45:26.705 INFO:teuthology.orchestra.run.smithi050.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-14T10:45:26.705 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T10:45:26.705 INFO:teuthology.orchestra.run.smithi050.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-14T10:45:26.705 INFO:teuthology.orchestra.run.smithi050.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T10:45:26.705 INFO:teuthology.orchestra.run.smithi050.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-14T10:45:26.705 INFO:teuthology.orchestra.run.smithi050.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-14T10:45:26.705 INFO:teuthology.orchestra.run.smithi050.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-14T10:45:26.705 INFO:teuthology.orchestra.run.smithi050.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-14T10:45:26.705 INFO:teuthology.orchestra.run.smithi050.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-14T10:45:26.705 INFO:teuthology.orchestra.run.smithi050.stdout: guava-30.1-6.el9.noarch 2024-09-14T10:45:26.706 INFO:teuthology.orchestra.run.smithi050.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-14T10:45:26.706 INFO:teuthology.orchestra.run.smithi050.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-14T10:45:26.706 INFO:teuthology.orchestra.run.smithi050.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-14T10:45:26.706 INFO:teuthology.orchestra.run.smithi050.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-14T10:45:26.706 INFO:teuthology.orchestra.run.smithi050.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-14T10:45:26.706 INFO:teuthology.orchestra.run.smithi050.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-14T10:45:26.706 INFO:teuthology.orchestra.run.smithi050.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T10:45:26.706 INFO:teuthology.orchestra.run.smithi050.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T10:45:26.706 INFO:teuthology.orchestra.run.smithi050.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T10:45:26.706 INFO:teuthology.orchestra.run.smithi050.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-14T10:45:26.706 INFO:teuthology.orchestra.run.smithi050.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-14T10:45:26.706 INFO:teuthology.orchestra.run.smithi050.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-14T10:45:26.706 INFO:teuthology.orchestra.run.smithi050.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-14T10:45:26.706 INFO:teuthology.orchestra.run.smithi050.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-14T10:45:26.706 INFO:teuthology.orchestra.run.smithi050.stdout: lcms2-2.12-3.el9.x86_64 2024-09-14T10:45:26.707 INFO:teuthology.orchestra.run.smithi050.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-14T10:45:26.707 INFO:teuthology.orchestra.run.smithi050.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-14T10:45:26.707 INFO:teuthology.orchestra.run.smithi050.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-14T10:45:26.707 INFO:teuthology.orchestra.run.smithi050.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-14T10:45:26.707 INFO:teuthology.orchestra.run.smithi050.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-14T10:45:26.707 INFO:teuthology.orchestra.run.smithi050.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-14T10:45:26.707 INFO:teuthology.orchestra.run.smithi050.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-14T10:45:26.707 INFO:teuthology.orchestra.run.smithi050.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-14T10:45:26.707 INFO:teuthology.orchestra.run.smithi050.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-14T10:45:26.707 INFO:teuthology.orchestra.run.smithi050.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-14T10:45:26.707 INFO:teuthology.orchestra.run.smithi050.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-14T10:45:26.707 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T10:45:26.707 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T10:45:26.707 INFO:teuthology.orchestra.run.smithi050.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-14T10:45:26.707 INFO:teuthology.orchestra.run.smithi050.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-14T10:45:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-14T10:45:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-14T10:45:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-14T10:45:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-14T10:45:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-14T10:45:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-14T10:45:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T10:45:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-14T10:45:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-14T10:45:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-14T10:45:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-14T10:45:26.709 INFO:teuthology.orchestra.run.smithi050.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-14T10:45:26.709 INFO:teuthology.orchestra.run.smithi050.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-14T10:45:26.709 INFO:teuthology.orchestra.run.smithi050.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-14T10:45:26.709 INFO:teuthology.orchestra.run.smithi050.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T10:45:26.709 INFO:teuthology.orchestra.run.smithi050.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-14T10:45:26.709 INFO:teuthology.orchestra.run.smithi050.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T10:45:26.709 INFO:teuthology.orchestra.run.smithi050.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-14T10:45:26.709 INFO:teuthology.orchestra.run.smithi050.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-14T10:45:26.709 INFO:teuthology.orchestra.run.smithi050.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-14T10:45:26.709 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T10:45:26.709 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T10:45:26.709 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T10:45:26.709 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.709 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.709 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T10:45:26.710 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.710 INFO:teuthology.orchestra.run.smithi050.stdout: libsbc-1.4-9.el9.x86_64 2024-09-14T10:45:26.710 INFO:teuthology.orchestra.run.smithi050.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-14T10:45:26.710 INFO:teuthology.orchestra.run.smithi050.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-14T10:45:26.710 INFO:teuthology.orchestra.run.smithi050.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-14T10:45:26.710 INFO:teuthology.orchestra.run.smithi050.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-14T10:45:26.710 INFO:teuthology.orchestra.run.smithi050.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-14T10:45:26.710 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T10:45:26.710 INFO:teuthology.orchestra.run.smithi050.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-14T10:45:26.710 INFO:teuthology.orchestra.run.smithi050.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-14T10:45:26.710 INFO:teuthology.orchestra.run.smithi050.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-14T10:45:26.710 INFO:teuthology.orchestra.run.smithi050.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-14T10:45:26.710 INFO:teuthology.orchestra.run.smithi050.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-14T10:45:26.710 INFO:teuthology.orchestra.run.smithi050.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-14T10:45:26.711 INFO:teuthology.orchestra.run.smithi050.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-14T10:45:26.711 INFO:teuthology.orchestra.run.smithi050.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-14T10:45:26.711 INFO:teuthology.orchestra.run.smithi050.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-14T10:45:26.711 INFO:teuthology.orchestra.run.smithi050.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-14T10:45:26.711 INFO:teuthology.orchestra.run.smithi050.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-14T10:45:26.711 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T10:45:26.711 INFO:teuthology.orchestra.run.smithi050.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T10:45:26.711 INFO:teuthology.orchestra.run.smithi050.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T10:45:26.711 INFO:teuthology.orchestra.run.smithi050.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-14T10:45:26.711 INFO:teuthology.orchestra.run.smithi050.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T10:45:26.711 INFO:teuthology.orchestra.run.smithi050.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-14T10:45:26.711 INFO:teuthology.orchestra.run.smithi050.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-14T10:45:26.711 INFO:teuthology.orchestra.run.smithi050.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-14T10:45:26.711 INFO:teuthology.orchestra.run.smithi050.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-14T10:45:26.711 INFO:teuthology.orchestra.run.smithi050.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-14T10:45:26.711 INFO:teuthology.orchestra.run.smithi050.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-14T10:45:26.712 INFO:teuthology.orchestra.run.smithi050.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-14T10:45:26.712 INFO:teuthology.orchestra.run.smithi050.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-14T10:45:26.712 INFO:teuthology.orchestra.run.smithi050.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-14T10:45:26.712 INFO:teuthology.orchestra.run.smithi050.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-14T10:45:26.712 INFO:teuthology.orchestra.run.smithi050.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-14T10:45:26.712 INFO:teuthology.orchestra.run.smithi050.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-14T10:45:26.712 INFO:teuthology.orchestra.run.smithi050.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-14T10:45:26.712 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T10:45:26.712 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T10:45:26.712 INFO:teuthology.orchestra.run.smithi050.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-14T10:45:26.712 INFO:teuthology.orchestra.run.smithi050.stdout: opus-1.3.1-10.el9.x86_64 2024-09-14T10:45:26.712 INFO:teuthology.orchestra.run.smithi050.stdout: orc-0.4.31-8.el9.x86_64 2024-09-14T10:45:26.712 INFO:teuthology.orchestra.run.smithi050.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-14T10:45:26.712 INFO:teuthology.orchestra.run.smithi050.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-14T10:45:26.712 INFO:teuthology.orchestra.run.smithi050.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-14T10:45:26.713 INFO:teuthology.orchestra.run.smithi050.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-14T10:45:26.713 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T10:45:26.713 INFO:teuthology.orchestra.run.smithi050.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-14T10:45:26.713 INFO:teuthology.orchestra.run.smithi050.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-14T10:45:26.713 INFO:teuthology.orchestra.run.smithi050.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-14T10:45:26.713 INFO:teuthology.orchestra.run.smithi050.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-14T10:45:26.713 INFO:teuthology.orchestra.run.smithi050.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-14T10:45:26.713 INFO:teuthology.orchestra.run.smithi050.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-14T10:45:26.713 INFO:teuthology.orchestra.run.smithi050.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-14T10:45:26.713 INFO:teuthology.orchestra.run.smithi050.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-14T10:45:26.713 INFO:teuthology.orchestra.run.smithi050.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-14T10:45:26.713 INFO:teuthology.orchestra.run.smithi050.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-14T10:45:26.713 INFO:teuthology.orchestra.run.smithi050.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-14T10:45:26.713 INFO:teuthology.orchestra.run.smithi050.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-14T10:45:26.713 INFO:teuthology.orchestra.run.smithi050.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-14T10:45:26.713 INFO:teuthology.orchestra.run.smithi050.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-14T10:45:26.714 INFO:teuthology.orchestra.run.smithi050.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-14T10:45:26.714 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T10:45:26.714 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T10:45:26.714 INFO:teuthology.orchestra.run.smithi050.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-14T10:45:26.714 INFO:teuthology.orchestra.run.smithi050.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-14T10:45:26.714 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T10:45:26.714 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T10:45:26.714 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T10:45:26.714 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T10:45:26.714 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.714 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.714 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.714 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T10:45:26.714 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T10:45:26.714 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T10:45:26.715 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T10:45:26.715 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T10:45:26.715 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T10:45:26.715 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T10:45:26.715 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T10:45:26.715 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T10:45:26.715 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T10:45:26.715 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T10:45:26.715 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T10:45:26.715 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T10:45:26.715 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T10:45:26.715 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T10:45:26.715 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T10:45:26.715 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T10:45:26.715 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T10:45:26.716 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T10:45:26.716 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T10:45:26.716 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T10:45:26.716 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T10:45:26.716 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T10:45:26.716 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T10:45:26.716 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T10:45:26.716 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T10:45:26.716 INFO:teuthology.orchestra.run.smithi050.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T10:45:26.716 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T10:45:26.716 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T10:45:26.716 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T10:45:26.716 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T10:45:26.716 INFO:teuthology.orchestra.run.smithi050.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T10:45:26.716 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T10:45:26.717 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T10:45:26.717 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T10:45:26.717 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T10:45:26.717 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T10:45:26.717 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.717 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.717 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T10:45:26.717 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T10:45:26.717 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T10:45:26.717 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.717 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T10:45:26.717 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T10:45:26.717 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T10:45:26.717 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T10:45:26.718 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T10:45:26.718 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T10:45:26.718 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T10:45:26.718 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T10:45:26.718 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T10:45:26.718 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T10:45:26.718 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T10:45:26.718 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T10:45:26.718 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T10:45:26.718 INFO:teuthology.orchestra.run.smithi050.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T10:45:26.718 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.718 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.719 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:26.719 INFO:teuthology.orchestra.run.smithi050.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T10:45:26.719 INFO:teuthology.orchestra.run.smithi050.stdout: rtkit-0.11-29.el9.x86_64 2024-09-14T10:45:26.719 INFO:teuthology.orchestra.run.smithi050.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-14T10:45:26.719 INFO:teuthology.orchestra.run.smithi050.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-14T10:45:26.719 INFO:teuthology.orchestra.run.smithi050.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-14T10:45:26.719 INFO:teuthology.orchestra.run.smithi050.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T10:45:26.719 INFO:teuthology.orchestra.run.smithi050.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-14T10:45:26.719 INFO:teuthology.orchestra.run.smithi050.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T10:45:26.719 INFO:teuthology.orchestra.run.smithi050.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-14T10:45:26.719 INFO:teuthology.orchestra.run.smithi050.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-14T10:45:26.720 INFO:teuthology.orchestra.run.smithi050.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-14T10:45:26.720 INFO:teuthology.orchestra.run.smithi050.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-14T10:45:26.720 INFO:teuthology.orchestra.run.smithi050.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-14T10:45:26.720 INFO:teuthology.orchestra.run.smithi050.stdout: upower-0.99.11-11.el9.x86_64 2024-09-14T10:45:26.720 INFO:teuthology.orchestra.run.smithi050.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-14T10:45:26.720 INFO:teuthology.orchestra.run.smithi050.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-14T10:45:26.720 INFO:teuthology.orchestra.run.smithi050.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-14T10:45:26.720 INFO:teuthology.orchestra.run.smithi050.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-14T10:45:26.720 INFO:teuthology.orchestra.run.smithi050.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-14T10:45:26.720 INFO:teuthology.orchestra.run.smithi050.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-14T10:45:26.720 INFO:teuthology.orchestra.run.smithi050.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-14T10:45:26.720 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T10:45:26.721 INFO:teuthology.orchestra.run.smithi050.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-14T10:45:26.721 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:26.721 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-09-14T10:45:27.241 DEBUG:teuthology.parallel:result is None 2024-09-14T10:45:28.067 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:45:28.068 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 1/288 2024-09-14T10:45:28.068 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2/288 2024-09-14T10:45:28.068 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 3/288 2024-09-14T10:45:28.068 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 4/288 2024-09-14T10:45:28.068 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 5/288 2024-09-14T10:45:28.068 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 6/288 2024-09-14T10:45:28.068 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 7/288 2024-09-14T10:45:28.068 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 8/288 2024-09-14T10:45:28.068 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 9/288 2024-09-14T10:45:28.068 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T10:45:28.068 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T10:45:28.069 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T10:45:28.069 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 13/288 2024-09-14T10:45:28.069 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 14/288 2024-09-14T10:45:28.069 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 15/288 2024-09-14T10:45:28.069 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 16/288 2024-09-14T10:45:28.069 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 17/288 2024-09-14T10:45:28.069 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 18/288 2024-09-14T10:45:28.069 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 19/288 2024-09-14T10:45:28.069 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 20/288 2024-09-14T10:45:28.069 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 21/288 2024-09-14T10:45:28.069 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 22/288 2024-09-14T10:45:28.069 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 23/288 2024-09-14T10:45:28.069 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 24/288 2024-09-14T10:45:28.069 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T10:45:28.069 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 26/288 2024-09-14T10:45:28.070 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 27/288 2024-09-14T10:45:28.070 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 28/288 2024-09-14T10:45:28.070 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 29/288 2024-09-14T10:45:28.070 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 30/288 2024-09-14T10:45:28.093 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 31/288 2024-09-14T10:45:28.093 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 32/288 2024-09-14T10:45:28.093 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 33/288 2024-09-14T10:45:28.093 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 34/288 2024-09-14T10:45:28.093 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 35/288 2024-09-14T10:45:28.093 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 36/288 2024-09-14T10:45:28.093 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-14T10:45:28.093 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-14T10:45:28.093 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-14T10:45:28.093 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-14T10:45:28.093 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-14T10:45:28.094 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-14T10:45:28.094 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-14T10:45:28.094 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-14T10:45:28.094 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-14T10:45:28.094 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-14T10:45:28.094 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-14T10:45:28.094 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-14T10:45:28.094 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-14T10:45:28.094 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-14T10:45:28.094 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-14T10:45:28.094 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-14T10:45:28.094 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-14T10:45:28.094 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-14T10:45:28.095 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-14T10:45:28.095 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-14T10:45:28.095 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-14T10:45:28.095 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-14T10:45:28.095 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-14T10:45:28.095 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-14T10:45:28.095 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-14T10:45:28.095 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-14T10:45:28.095 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-14T10:45:28.095 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-14T10:45:28.096 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-14T10:45:28.096 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-14T10:45:28.096 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-14T10:45:28.096 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-14T10:45:28.096 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-14T10:45:28.096 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-14T10:45:28.096 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-14T10:45:28.096 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-14T10:45:28.096 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-14T10:45:28.096 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-14T10:45:28.096 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-14T10:45:28.096 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-14T10:45:28.096 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-14T10:45:28.097 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-14T10:45:28.097 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-14T10:45:28.097 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-14T10:45:28.097 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-14T10:45:28.097 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-14T10:45:28.097 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-14T10:45:28.097 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-14T10:45:28.097 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-14T10:45:28.097 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-14T10:45:28.097 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-14T10:45:28.097 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-14T10:45:28.097 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-14T10:45:28.097 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-14T10:45:28.098 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-14T10:45:28.098 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-14T10:45:28.098 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-14T10:45:28.098 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-14T10:45:28.098 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-14T10:45:28.098 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-14T10:45:28.098 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-14T10:45:28.098 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-14T10:45:28.098 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-14T10:45:28.098 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-14T10:45:28.098 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-14T10:45:28.098 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-14T10:45:28.098 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-14T10:45:28.099 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-14T10:45:28.099 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-14T10:45:28.099 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-14T10:45:28.099 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-14T10:45:28.099 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-14T10:45:28.099 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-14T10:45:28.099 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-14T10:45:28.099 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-14T10:45:28.099 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-14T10:45:28.099 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-14T10:45:28.099 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-14T10:45:28.099 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-14T10:45:28.099 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-14T10:45:28.100 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-14T10:45:28.100 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-14T10:45:28.100 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-14T10:45:28.100 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-14T10:45:28.100 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-14T10:45:28.100 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-14T10:45:28.100 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-14T10:45:28.100 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-14T10:45:28.100 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-14T10:45:28.100 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-14T10:45:28.100 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-14T10:45:28.100 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-14T10:45:28.100 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-14T10:45:28.100 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-14T10:45:28.101 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-14T10:45:28.101 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-14T10:45:28.101 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-14T10:45:28.101 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-14T10:45:28.101 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-14T10:45:28.101 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-14T10:45:28.101 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-14T10:45:28.101 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-14T10:45:28.101 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-14T10:45:28.101 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-14T10:45:28.101 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-14T10:45:28.101 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-14T10:45:28.102 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-14T10:45:28.102 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-14T10:45:28.102 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-14T10:45:28.102 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-14T10:45:28.102 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-14T10:45:28.102 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-14T10:45:28.102 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-14T10:45:28.102 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-14T10:45:28.102 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-14T10:45:28.102 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-14T10:45:28.102 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-14T10:45:28.102 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-14T10:45:28.102 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-14T10:45:28.102 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-14T10:45:28.103 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-14T10:45:28.103 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-14T10:45:28.103 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-14T10:45:28.103 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-14T10:45:28.103 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-14T10:45:28.103 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-14T10:45:28.103 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-14T10:45:28.103 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-14T10:45:28.103 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-14T10:45:28.104 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-14T10:45:28.104 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-14T10:45:28.104 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-14T10:45:28.104 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-14T10:45:28.104 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-14T10:45:28.104 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-14T10:45:28.104 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-14T10:45:28.104 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-14T10:45:28.104 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-14T10:45:28.104 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-14T10:45:28.104 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-14T10:45:28.104 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-14T10:45:28.104 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-14T10:45:28.105 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-14T10:45:28.105 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-14T10:45:28.105 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-14T10:45:28.105 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-14T10:45:28.105 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-14T10:45:28.105 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-14T10:45:28.105 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-14T10:45:28.105 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-14T10:45:28.105 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-14T10:45:28.105 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-14T10:45:28.105 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-14T10:45:28.105 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-14T10:45:28.105 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-14T10:45:28.106 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-14T10:45:28.106 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-14T10:45:28.106 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-14T10:45:28.106 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-14T10:45:28.106 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-14T10:45:28.106 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-14T10:45:28.106 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-14T10:45:28.106 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-14T10:45:28.106 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-14T10:45:28.106 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-14T10:45:28.106 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-14T10:45:28.106 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-14T10:45:28.106 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-14T10:45:28.106 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-14T10:45:28.107 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-14T10:45:28.107 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-14T10:45:28.107 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-14T10:45:28.107 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-14T10:45:28.107 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-14T10:45:28.107 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-14T10:45:28.107 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-14T10:45:28.107 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-14T10:45:28.107 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-14T10:45:28.107 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-14T10:45:28.107 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-14T10:45:28.107 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-14T10:45:28.107 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-14T10:45:28.107 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-14T10:45:28.108 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-14T10:45:28.108 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-14T10:45:28.108 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-14T10:45:28.108 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-14T10:45:28.108 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-14T10:45:28.108 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-14T10:45:28.108 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-14T10:45:28.108 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-14T10:45:28.108 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-14T10:45:28.108 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-14T10:45:28.108 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-14T10:45:28.108 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-14T10:45:28.108 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-14T10:45:28.108 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-14T10:45:28.109 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-14T10:45:28.109 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-14T10:45:28.109 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-14T10:45:28.109 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-14T10:45:28.109 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-14T10:45:28.109 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-14T10:45:28.109 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-14T10:45:28.109 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-14T10:45:28.109 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-14T10:45:28.109 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-14T10:45:28.109 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-14T10:45:28.109 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-14T10:45:28.109 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-14T10:45:28.109 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-14T10:45:28.110 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-14T10:45:28.110 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-14T10:45:28.110 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-14T10:45:28.110 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-14T10:45:28.110 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-14T10:45:28.110 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-14T10:45:28.110 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-14T10:45:28.110 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-14T10:45:28.110 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-14T10:45:28.110 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-14T10:45:28.110 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-14T10:45:28.110 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-14T10:45:28.110 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-14T10:45:28.110 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-14T10:45:28.110 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-14T10:45:28.110 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-14T10:45:28.111 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-14T10:45:28.111 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-14T10:45:28.111 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-14T10:45:28.111 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-14T10:45:28.111 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-14T10:45:28.111 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-14T10:45:28.111 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-14T10:45:28.111 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-14T10:45:28.111 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-14T10:45:28.111 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-14T10:45:28.111 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-14T10:45:28.111 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-14T10:45:28.111 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-14T10:45:28.112 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-14T10:45:28.112 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-14T10:45:28.112 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-14T10:45:28.112 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-14T10:45:28.112 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-14T10:45:28.112 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-14T10:45:28.112 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-14T10:45:28.112 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-14T10:45:28.112 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T10:45:28.112 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-14T10:45:28.112 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 287/288 2024-09-14T10:45:31.626 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:45:31.626 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:31.626 INFO:teuthology.orchestra.run.smithi118.stdout:Upgraded: 2024-09-14T10:45:31.626 INFO:teuthology.orchestra.run.smithi118.stdout: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.627 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.627 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-09-14T10:45:31.627 INFO:teuthology.orchestra.run.smithi118.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-14T10:45:31.627 INFO:teuthology.orchestra.run.smithi118.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T10:45:31.627 INFO:teuthology.orchestra.run.smithi118.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-14T10:45:31.627 INFO:teuthology.orchestra.run.smithi118.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-14T10:45:31.627 INFO:teuthology.orchestra.run.smithi118.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-14T10:45:31.627 INFO:teuthology.orchestra.run.smithi118.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-14T10:45:31.627 INFO:teuthology.orchestra.run.smithi118.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-14T10:45:31.627 INFO:teuthology.orchestra.run.smithi118.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-14T10:45:31.627 INFO:teuthology.orchestra.run.smithi118.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-14T10:45:31.627 INFO:teuthology.orchestra.run.smithi118.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-14T10:45:31.627 INFO:teuthology.orchestra.run.smithi118.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-14T10:45:31.628 INFO:teuthology.orchestra.run.smithi118.stdout: atinject-1.0.3-6.el9.noarch 2024-09-14T10:45:31.628 INFO:teuthology.orchestra.run.smithi118.stdout: atk-2.36.0-5.el9.x86_64 2024-09-14T10:45:31.628 INFO:teuthology.orchestra.run.smithi118.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-14T10:45:31.628 INFO:teuthology.orchestra.run.smithi118.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-14T10:45:31.628 INFO:teuthology.orchestra.run.smithi118.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T10:45:31.628 INFO:teuthology.orchestra.run.smithi118.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-14T10:45:31.628 INFO:teuthology.orchestra.run.smithi118.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-14T10:45:31.628 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.628 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.628 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.628 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.629 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:45:31.629 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.629 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.629 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.629 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:45:31.629 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:45:31.629 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:45:31.629 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:45:31.629 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:45:31.629 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.629 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.629 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:45:31.630 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.630 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.630 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.630 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:45:31.630 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:45:31.630 INFO:teuthology.orchestra.run.smithi118.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-14T10:45:31.630 INFO:teuthology.orchestra.run.smithi118.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-14T10:45:31.630 INFO:teuthology.orchestra.run.smithi118.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-14T10:45:31.630 INFO:teuthology.orchestra.run.smithi118.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-14T10:45:31.630 INFO:teuthology.orchestra.run.smithi118.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-14T10:45:31.630 INFO:teuthology.orchestra.run.smithi118.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-14T10:45:31.630 INFO:teuthology.orchestra.run.smithi118.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-14T10:45:31.630 INFO:teuthology.orchestra.run.smithi118.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-14T10:45:31.630 INFO:teuthology.orchestra.run.smithi118.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-14T10:45:31.631 INFO:teuthology.orchestra.run.smithi118.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-14T10:45:31.631 INFO:teuthology.orchestra.run.smithi118.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-14T10:45:31.631 INFO:teuthology.orchestra.run.smithi118.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-14T10:45:31.631 INFO:teuthology.orchestra.run.smithi118.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-14T10:45:31.631 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T10:45:31.631 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T10:45:31.631 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T10:45:31.631 INFO:teuthology.orchestra.run.smithi118.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-14T10:45:31.631 INFO:teuthology.orchestra.run.smithi118.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-14T10:45:31.631 INFO:teuthology.orchestra.run.smithi118.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-14T10:45:31.631 INFO:teuthology.orchestra.run.smithi118.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-14T10:45:31.631 INFO:teuthology.orchestra.run.smithi118.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-14T10:45:31.631 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T10:45:31.632 INFO:teuthology.orchestra.run.smithi118.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-14T10:45:31.632 INFO:teuthology.orchestra.run.smithi118.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T10:45:31.632 INFO:teuthology.orchestra.run.smithi118.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-14T10:45:31.632 INFO:teuthology.orchestra.run.smithi118.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-14T10:45:31.632 INFO:teuthology.orchestra.run.smithi118.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-14T10:45:31.632 INFO:teuthology.orchestra.run.smithi118.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-14T10:45:31.632 INFO:teuthology.orchestra.run.smithi118.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-14T10:45:31.632 INFO:teuthology.orchestra.run.smithi118.stdout: guava-30.1-6.el9.noarch 2024-09-14T10:45:31.632 INFO:teuthology.orchestra.run.smithi118.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-14T10:45:31.632 INFO:teuthology.orchestra.run.smithi118.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-14T10:45:31.632 INFO:teuthology.orchestra.run.smithi118.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-14T10:45:31.632 INFO:teuthology.orchestra.run.smithi118.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-14T10:45:31.632 INFO:teuthology.orchestra.run.smithi118.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-14T10:45:31.633 INFO:teuthology.orchestra.run.smithi118.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-14T10:45:31.633 INFO:teuthology.orchestra.run.smithi118.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T10:45:31.633 INFO:teuthology.orchestra.run.smithi118.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T10:45:31.633 INFO:teuthology.orchestra.run.smithi118.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T10:45:31.633 INFO:teuthology.orchestra.run.smithi118.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-14T10:45:31.633 INFO:teuthology.orchestra.run.smithi118.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-14T10:45:31.633 INFO:teuthology.orchestra.run.smithi118.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-14T10:45:31.633 INFO:teuthology.orchestra.run.smithi118.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-14T10:45:31.633 INFO:teuthology.orchestra.run.smithi118.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-14T10:45:31.633 INFO:teuthology.orchestra.run.smithi118.stdout: lcms2-2.12-3.el9.x86_64 2024-09-14T10:45:31.633 INFO:teuthology.orchestra.run.smithi118.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-14T10:45:31.633 INFO:teuthology.orchestra.run.smithi118.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-14T10:45:31.633 INFO:teuthology.orchestra.run.smithi118.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-14T10:45:31.633 INFO:teuthology.orchestra.run.smithi118.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-14T10:45:31.634 INFO:teuthology.orchestra.run.smithi118.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-14T10:45:31.634 INFO:teuthology.orchestra.run.smithi118.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-14T10:45:31.634 INFO:teuthology.orchestra.run.smithi118.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-14T10:45:31.634 INFO:teuthology.orchestra.run.smithi118.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-14T10:45:31.634 INFO:teuthology.orchestra.run.smithi118.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-14T10:45:31.634 INFO:teuthology.orchestra.run.smithi118.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-14T10:45:31.634 INFO:teuthology.orchestra.run.smithi118.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-14T10:45:31.634 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T10:45:31.634 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T10:45:31.634 INFO:teuthology.orchestra.run.smithi118.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-14T10:45:31.634 INFO:teuthology.orchestra.run.smithi118.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-14T10:45:31.634 INFO:teuthology.orchestra.run.smithi118.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-14T10:45:31.634 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.635 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.635 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.635 INFO:teuthology.orchestra.run.smithi118.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-14T10:45:31.635 INFO:teuthology.orchestra.run.smithi118.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-14T10:45:31.635 INFO:teuthology.orchestra.run.smithi118.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-14T10:45:31.635 INFO:teuthology.orchestra.run.smithi118.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-14T10:45:31.635 INFO:teuthology.orchestra.run.smithi118.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-14T10:45:31.635 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T10:45:31.635 INFO:teuthology.orchestra.run.smithi118.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-14T10:45:31.635 INFO:teuthology.orchestra.run.smithi118.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-14T10:45:31.635 INFO:teuthology.orchestra.run.smithi118.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-14T10:45:31.635 INFO:teuthology.orchestra.run.smithi118.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-14T10:45:31.635 INFO:teuthology.orchestra.run.smithi118.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-14T10:45:31.635 INFO:teuthology.orchestra.run.smithi118.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-14T10:45:31.636 INFO:teuthology.orchestra.run.smithi118.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-14T10:45:31.636 INFO:teuthology.orchestra.run.smithi118.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T10:45:31.636 INFO:teuthology.orchestra.run.smithi118.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-14T10:45:31.636 INFO:teuthology.orchestra.run.smithi118.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T10:45:31.636 INFO:teuthology.orchestra.run.smithi118.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-14T10:45:31.636 INFO:teuthology.orchestra.run.smithi118.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-14T10:45:31.636 INFO:teuthology.orchestra.run.smithi118.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-14T10:45:31.636 INFO:teuthology.orchestra.run.smithi118.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T10:45:31.636 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T10:45:31.636 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T10:45:31.636 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.636 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.637 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T10:45:31.637 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.637 INFO:teuthology.orchestra.run.smithi118.stdout: libsbc-1.4-9.el9.x86_64 2024-09-14T10:45:31.637 INFO:teuthology.orchestra.run.smithi118.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-14T10:45:31.637 INFO:teuthology.orchestra.run.smithi118.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-14T10:45:31.637 INFO:teuthology.orchestra.run.smithi118.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-14T10:45:31.637 INFO:teuthology.orchestra.run.smithi118.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-14T10:45:31.637 INFO:teuthology.orchestra.run.smithi118.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-14T10:45:31.637 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T10:45:31.638 INFO:teuthology.orchestra.run.smithi118.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-14T10:45:31.638 INFO:teuthology.orchestra.run.smithi118.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-14T10:45:31.638 INFO:teuthology.orchestra.run.smithi118.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-14T10:45:31.638 INFO:teuthology.orchestra.run.smithi118.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-14T10:45:31.638 INFO:teuthology.orchestra.run.smithi118.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-14T10:45:31.638 INFO:teuthology.orchestra.run.smithi118.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-14T10:45:31.638 INFO:teuthology.orchestra.run.smithi118.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-14T10:45:31.638 INFO:teuthology.orchestra.run.smithi118.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-14T10:45:31.638 INFO:teuthology.orchestra.run.smithi118.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-14T10:45:31.638 INFO:teuthology.orchestra.run.smithi118.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-14T10:45:31.638 INFO:teuthology.orchestra.run.smithi118.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-14T10:45:31.638 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T10:45:31.638 INFO:teuthology.orchestra.run.smithi118.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T10:45:31.639 INFO:teuthology.orchestra.run.smithi118.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T10:45:31.639 INFO:teuthology.orchestra.run.smithi118.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-14T10:45:31.639 INFO:teuthology.orchestra.run.smithi118.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T10:45:31.639 INFO:teuthology.orchestra.run.smithi118.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-14T10:45:31.639 INFO:teuthology.orchestra.run.smithi118.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-14T10:45:31.639 INFO:teuthology.orchestra.run.smithi118.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-14T10:45:31.639 INFO:teuthology.orchestra.run.smithi118.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-14T10:45:31.639 INFO:teuthology.orchestra.run.smithi118.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-14T10:45:31.639 INFO:teuthology.orchestra.run.smithi118.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-14T10:45:31.639 INFO:teuthology.orchestra.run.smithi118.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-14T10:45:31.639 INFO:teuthology.orchestra.run.smithi118.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-14T10:45:31.639 INFO:teuthology.orchestra.run.smithi118.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-14T10:45:31.639 INFO:teuthology.orchestra.run.smithi118.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-14T10:45:31.639 INFO:teuthology.orchestra.run.smithi118.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-14T10:45:31.640 INFO:teuthology.orchestra.run.smithi118.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-14T10:45:31.640 INFO:teuthology.orchestra.run.smithi118.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-14T10:45:31.640 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T10:45:31.640 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T10:45:31.640 INFO:teuthology.orchestra.run.smithi118.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-14T10:45:31.640 INFO:teuthology.orchestra.run.smithi118.stdout: opus-1.3.1-10.el9.x86_64 2024-09-14T10:45:31.640 INFO:teuthology.orchestra.run.smithi118.stdout: orc-0.4.31-8.el9.x86_64 2024-09-14T10:45:31.640 INFO:teuthology.orchestra.run.smithi118.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-14T10:45:31.640 INFO:teuthology.orchestra.run.smithi118.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-14T10:45:31.640 INFO:teuthology.orchestra.run.smithi118.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-14T10:45:31.640 INFO:teuthology.orchestra.run.smithi118.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-14T10:45:31.640 INFO:teuthology.orchestra.run.smithi118.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T10:45:31.640 INFO:teuthology.orchestra.run.smithi118.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-14T10:45:31.641 INFO:teuthology.orchestra.run.smithi118.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-14T10:45:31.641 INFO:teuthology.orchestra.run.smithi118.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-14T10:45:31.641 INFO:teuthology.orchestra.run.smithi118.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-14T10:45:31.641 INFO:teuthology.orchestra.run.smithi118.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-14T10:45:31.641 INFO:teuthology.orchestra.run.smithi118.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-14T10:45:31.641 INFO:teuthology.orchestra.run.smithi118.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-14T10:45:31.641 INFO:teuthology.orchestra.run.smithi118.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-14T10:45:31.641 INFO:teuthology.orchestra.run.smithi118.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-14T10:45:31.641 INFO:teuthology.orchestra.run.smithi118.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-14T10:45:31.641 INFO:teuthology.orchestra.run.smithi118.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-14T10:45:31.641 INFO:teuthology.orchestra.run.smithi118.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-14T10:45:31.641 INFO:teuthology.orchestra.run.smithi118.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-14T10:45:31.641 INFO:teuthology.orchestra.run.smithi118.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-14T10:45:31.642 INFO:teuthology.orchestra.run.smithi118.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-14T10:45:31.642 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T10:45:31.642 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T10:45:31.642 INFO:teuthology.orchestra.run.smithi118.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-14T10:45:31.642 INFO:teuthology.orchestra.run.smithi118.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-14T10:45:31.642 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T10:45:31.642 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T10:45:31.642 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T10:45:31.642 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T10:45:31.642 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.642 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.642 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.643 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T10:45:31.643 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T10:45:31.643 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T10:45:31.643 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T10:45:31.643 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T10:45:31.643 INFO:teuthology.orchestra.run.smithi118.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T10:45:31.643 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T10:45:31.643 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T10:45:31.643 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T10:45:31.643 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T10:45:31.643 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T10:45:31.643 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T10:45:31.643 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T10:45:31.643 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T10:45:31.643 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T10:45:31.644 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T10:45:31.644 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T10:45:31.644 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T10:45:31.644 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T10:45:31.644 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T10:45:31.644 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T10:45:31.644 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T10:45:31.644 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T10:45:31.644 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T10:45:31.644 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T10:45:31.644 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T10:45:31.644 INFO:teuthology.orchestra.run.smithi118.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T10:45:31.644 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T10:45:31.645 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T10:45:31.645 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T10:45:31.645 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T10:45:31.645 INFO:teuthology.orchestra.run.smithi118.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T10:45:31.645 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T10:45:31.645 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T10:45:31.645 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T10:45:31.645 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T10:45:31.645 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T10:45:31.645 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.645 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.645 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T10:45:31.645 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T10:45:31.645 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T10:45:31.646 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.646 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T10:45:31.646 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T10:45:31.646 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T10:45:31.646 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T10:45:31.646 INFO:teuthology.orchestra.run.smithi118.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T10:45:31.646 INFO:teuthology.orchestra.run.smithi118.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T10:45:31.646 INFO:teuthology.orchestra.run.smithi118.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T10:45:31.646 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T10:45:31.646 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T10:45:31.646 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T10:45:31.646 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T10:45:31.646 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T10:45:31.647 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T10:45:31.647 INFO:teuthology.orchestra.run.smithi118.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T10:45:31.647 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.647 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.647 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:45:31.647 INFO:teuthology.orchestra.run.smithi118.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T10:45:31.647 INFO:teuthology.orchestra.run.smithi118.stdout: rtkit-0.11-29.el9.x86_64 2024-09-14T10:45:31.647 INFO:teuthology.orchestra.run.smithi118.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-14T10:45:31.647 INFO:teuthology.orchestra.run.smithi118.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-14T10:45:31.647 INFO:teuthology.orchestra.run.smithi118.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-14T10:45:31.647 INFO:teuthology.orchestra.run.smithi118.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T10:45:31.647 INFO:teuthology.orchestra.run.smithi118.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-14T10:45:31.647 INFO:teuthology.orchestra.run.smithi118.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T10:45:31.647 INFO:teuthology.orchestra.run.smithi118.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-14T10:45:31.648 INFO:teuthology.orchestra.run.smithi118.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-14T10:45:31.648 INFO:teuthology.orchestra.run.smithi118.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-14T10:45:31.648 INFO:teuthology.orchestra.run.smithi118.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-14T10:45:31.648 INFO:teuthology.orchestra.run.smithi118.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-14T10:45:31.648 INFO:teuthology.orchestra.run.smithi118.stdout: upower-0.99.11-11.el9.x86_64 2024-09-14T10:45:31.648 INFO:teuthology.orchestra.run.smithi118.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-14T10:45:31.648 INFO:teuthology.orchestra.run.smithi118.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-14T10:45:31.648 INFO:teuthology.orchestra.run.smithi118.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-14T10:45:31.648 INFO:teuthology.orchestra.run.smithi118.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-14T10:45:31.648 INFO:teuthology.orchestra.run.smithi118.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-14T10:45:31.648 INFO:teuthology.orchestra.run.smithi118.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-14T10:45:31.648 INFO:teuthology.orchestra.run.smithi118.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-14T10:45:31.648 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T10:45:31.649 INFO:teuthology.orchestra.run.smithi118.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-14T10:45:31.649 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:31.649 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-14T10:45:32.066 DEBUG:teuthology.parallel:result is None 2024-09-14T10:45:32.067 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:45:32.215 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T10:45:32.297 INFO:teuthology.orchestra.run.smithi050.stdout:19.3.0-4907.ga2782315.el9 2024-09-14T10:45:32.298 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907.ga2782315.el9 2024-09-14T10:45:32.298 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907.ga2782315 is installed. 2024-09-14T10:45:32.300 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:45:32.441 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T10:45:32.538 INFO:teuthology.orchestra.run.smithi118.stdout:19.3.0-4907.ga2782315.el9 2024-09-14T10:45:32.539 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907.ga2782315.el9 2024-09-14T10:45:32.539 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907.ga2782315 is installed. 2024-09-14T10:45:32.541 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-14T10:45:32.541 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:45:32.541 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T10:45:32.591 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-14T10:45:32.592 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T10:45:32.633 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-14T10:45:32.633 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:45:32.633 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T10:45:32.678 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T10:45:32.760 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-14T10:45:32.760 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T10:45:32.798 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T10:45:32.877 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-14T10:45:32.878 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:45:32.878 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T10:45:32.921 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T10:45:33.002 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-14T10:45:33.002 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T10:45:33.042 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T10:45:33.120 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-14T10:45:33.120 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:45:33.120 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T10:45:33.162 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T10:45:33.243 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-14T10:45:33.243 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T10:45:33.281 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T10:45:33.361 INFO:teuthology.run_tasks:Running task ceph... 2024-09-14T10:45:33.439 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-14T10:45:33.440 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /var/log/ceph 2024-09-14T10:45:33.444 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 777 /var/log/ceph 2024-09-14T10:45:33.482 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-14T10:45:33.482 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T10:45:33.523 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T10:45:33.561 INFO:tasks.ceph:Creating extra log directories... 2024-09-14T10:45:33.562 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T10:45:33.604 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T10:45:33.656 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-14T10:45:33.656 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-14T10:45:33.656 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904124', 'branch': 'main', 'description': 'rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7904124', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': True, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 9419, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded', 'targets': {'smithi050.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI2xqMlrcMhTARmLob4WmHY5kinJvWPo7MQ0VteaeSjS1ZUpsId588/ztIA8+ALG+1Et7Mg+s1GzBeBgvAExl50=', 'smithi118.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAWdEnjFFPeynWUahxm8MRE4vjfqor2c7FpeToRU9GQwvWW8kNDNrq65rzBI1prg/Dkk1hhJD0QRqoyoBVbvDLY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_20:40:18', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-14T10:45:33.657 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T10:45:33.684 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T10:45:33.713 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T10:45:33.754 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T10:45:33.792 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:45:33.792 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T10:45:33.862 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T10:45:33.862 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2024-09-14T10:45:33.931 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T10:45:33.932 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:45:33.932 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-14T10:45:33.932 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:45:33.932 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:45:33.932 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-14 10:45:14.462250357 +0000 2024-09-14T10:45:33.932 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-14 10:42:51.627549394 +0000 2024-09-14T10:45:33.932 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-14 10:42:51.627549394 +0000 2024-09-14T10:45:33.932 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-09-14 10:42:51.627549394 +0000 2024-09-14T10:45:33.932 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T10:45:34.009 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-14T10:45:34.009 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-14T10:45:34.010 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 9.9817e-05 s, 5.1 MB/s 2024-09-14T10:45:34.011 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T10:45:34.081 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2024-09-14T10:45:34.152 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T10:45:34.152 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:45:34.152 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-14T10:45:34.152 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:45:34.152 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:45:34.152 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-14 10:45:14.462250357 +0000 2024-09-14T10:45:34.152 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-14 10:42:51.949540924 +0000 2024-09-14T10:45:34.152 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-14 10:42:51.949540924 +0000 2024-09-14T10:45:34.152 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-09-14 10:42:51.949540924 +0000 2024-09-14T10:45:34.152 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T10:45:34.230 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-14T10:45:34.230 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-14T10:45:34.230 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000102478 s, 5.0 MB/s 2024-09-14T10:45:34.232 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T10:45:34.302 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2024-09-14T10:45:34.372 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T10:45:34.372 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:45:34.373 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-14T10:45:34.373 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:45:34.373 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:45:34.373 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-14 10:45:14.462250357 +0000 2024-09-14T10:45:34.373 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-14 10:42:52.264532642 +0000 2024-09-14T10:45:34.373 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-14 10:42:52.264532642 +0000 2024-09-14T10:45:34.373 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-09-14 10:42:52.264532642 +0000 2024-09-14T10:45:34.373 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T10:45:34.450 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-14T10:45:34.451 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-14T10:45:34.451 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 8.7455e-05 s, 5.9 MB/s 2024-09-14T10:45:34.452 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T10:45:34.522 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2024-09-14T10:45:34.592 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T10:45:34.592 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:45:34.592 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-14T10:45:34.592 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:45:34.592 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:45:34.592 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-14 10:45:14.463250332 +0000 2024-09-14T10:45:34.592 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-14 10:42:52.592524018 +0000 2024-09-14T10:45:34.593 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-14 10:42:52.592524018 +0000 2024-09-14T10:45:34.593 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-09-14 10:42:52.592524018 +0000 2024-09-14T10:45:34.593 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T10:45:34.670 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-14T10:45:34.670 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-14T10:45:34.670 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000105834 s, 4.8 MB/s 2024-09-14T10:45:34.671 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T10:45:34.742 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:45:34.742 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-14T10:45:34.742 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T10:45:34.778 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T10:45:34.778 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_1 2024-09-14T10:45:34.850 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T10:45:34.850 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:45:34.850 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-14T10:45:34.850 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:45:34.850 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:45:34.850 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-09-14 10:45:17.529030952 +0000 2024-09-14T10:45:34.850 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-09-14 10:42:51.612614635 +0000 2024-09-14T10:45:34.850 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-09-14 10:42:51.612614635 +0000 2024-09-14T10:45:34.850 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-09-14 10:42:51.612614635 +0000 2024-09-14T10:45:34.851 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T10:45:34.930 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-09-14T10:45:34.930 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-09-14T10:45:34.931 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000116094 s, 4.4 MB/s 2024-09-14T10:45:34.932 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T10:45:35.005 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_2 2024-09-14T10:45:35.077 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T10:45:35.077 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:45:35.077 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-14T10:45:35.077 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:45:35.078 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:45:35.078 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-09-14 10:45:17.530030929 +0000 2024-09-14T10:45:35.078 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-09-14 10:42:51.938607077 +0000 2024-09-14T10:45:35.078 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-09-14 10:42:51.938607077 +0000 2024-09-14T10:45:35.078 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-09-14 10:42:51.938607077 +0000 2024-09-14T10:45:35.079 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T10:45:35.156 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-09-14T10:45:35.156 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-09-14T10:45:35.156 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000110787 s, 4.6 MB/s 2024-09-14T10:45:35.158 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T10:45:35.229 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_3 2024-09-14T10:45:35.297 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T10:45:35.298 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:45:35.298 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-14T10:45:35.298 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:45:35.298 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:45:35.298 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-09-14 10:45:17.530030929 +0000 2024-09-14T10:45:35.298 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-09-14 10:42:52.259599636 +0000 2024-09-14T10:45:35.298 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-09-14 10:42:52.259599636 +0000 2024-09-14T10:45:35.298 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-09-14 10:42:52.259599636 +0000 2024-09-14T10:45:35.298 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T10:45:35.374 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-09-14T10:45:35.374 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-09-14T10:45:35.374 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000120625 s, 4.2 MB/s 2024-09-14T10:45:35.375 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T10:45:35.445 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_4 2024-09-14T10:45:35.513 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T10:45:35.513 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:45:35.514 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-14T10:45:35.514 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:45:35.514 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:45:35.514 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-09-14 10:45:17.530030929 +0000 2024-09-14T10:45:35.514 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-09-14 10:42:52.579592221 +0000 2024-09-14T10:45:35.514 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-09-14 10:42:52.579592221 +0000 2024-09-14T10:45:35.514 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-09-14 10:42:52.579592221 +0000 2024-09-14T10:45:35.514 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T10:45:35.590 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-09-14T10:45:35.590 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-09-14T10:45:35.590 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000104659 s, 4.9 MB/s 2024-09-14T10:45:35.591 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T10:45:35.662 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:45:35.662 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T10:45:35.662 INFO:tasks.ceph:Generating config... 2024-09-14T10:45:35.663 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-14T10:45:35.663 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-14T10:45:35.664 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-14T10:45:35.664 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-14T10:45:35.664 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-14T10:45:35.664 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T10:45:35.664 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-14T10:45:35.664 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2024-09-14T10:45:35.664 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2024-09-14T10:45:35.664 INFO:tasks.ceph:[client] rgw enable ops log = True 2024-09-14T10:45:35.664 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-09-14T10:45:35.664 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-09-14T10:45:35.664 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-14T10:45:35.664 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-14T10:45:35.664 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-14T10:45:35.664 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-14T10:45:35.665 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-14T10:45:35.665 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-14T10:45:35.665 INFO:tasks.ceph:[client] setuser = ceph 2024-09-14T10:45:35.665 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-14T10:45:35.665 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-14T10:45:35.665 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-09-14T10:45:35.665 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-14T10:45:35.665 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-14T10:45:35.665 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-14T10:45:35.665 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-14T10:45:35.665 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-14T10:45:35.665 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-14T10:45:35.665 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-14T10:45:35.666 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-14T10:45:35.666 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-14T10:45:35.666 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-14T10:45:35.666 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-14T10:45:35.666 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-14T10:45:35.666 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-14T10:45:35.666 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-14T10:45:35.666 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-14T10:45:35.666 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-14T10:45:35.666 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-14T10:45:35.666 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-14T10:45:35.666 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-14T10:45:35.666 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-14T10:45:35.666 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-14T10:45:35.666 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-14T10:45:35.667 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-14T10:45:35.667 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-14T10:45:35.667 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-14T10:45:35.667 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-14T10:45:35.667 INFO:tasks.ceph:Setting up mon.a... 2024-09-14T10:45:35.667 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-14T10:45:35.740 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.keyring 2024-09-14T10:45:35.742 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-14T10:45:35.803 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T10:45:35.843 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.50'), ('mon.c', '[v2:172.21.15.50:3301,v1:172.21.15.50:6790]'), ('mon.b', '172.21.15.118')] 2024-09-14T10:45:35.844 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.50,[v2:172.21.15.50:3301,v1:172.21.15.50:6790],172.21.15.118', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-14T10:45:35.845 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:45:35.845 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T10:45:35.913 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.50 --addv c '[v2:172.21.15.50:3301,v1:172.21.15.50:6790]' --add b 172.21.15.118 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:45:36.014 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:45:36.015 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:45:36.015 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:45:36.015 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: generated fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T10:45:36.015 INFO:teuthology.orchestra.run.smithi050.stdout:setting min_mon_release = quincy 2024-09-14T10:45:36.015 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 0 2024-09-14T10:45:36.016 INFO:teuthology.orchestra.run.smithi050.stdout:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T10:45:36.016 INFO:teuthology.orchestra.run.smithi050.stdout:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T10:45:36.016 INFO:teuthology.orchestra.run.smithi050.stdout:created 2024-09-14T10:45:36.017992+0000 2024-09-14T10:45:36.016 INFO:teuthology.orchestra.run.smithi050.stdout:min_mon_release 17 (quincy) 2024-09-14T10:45:36.016 INFO:teuthology.orchestra.run.smithi050.stdout:election_strategy: 1 2024-09-14T10:45:36.016 INFO:teuthology.orchestra.run.smithi050.stdout:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T10:45:36.016 INFO:teuthology.orchestra.run.smithi050.stdout:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T10:45:36.016 INFO:teuthology.orchestra.run.smithi050.stdout:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T10:45:36.016 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-14T10:45:36.017 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T10:45:36.046 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b6566dc9-5665-4f7c-861a-3125c3883e3a... 2024-09-14T10:45:36.047 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T10:45:36.089 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T10:45:36.146 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2024-09-14T10:45:36.146 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2024-09-14T10:45:36.146 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T10:45:36.146 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2024-09-14T10:45:36.146 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.146 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2024-09-14T10:45:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2024-09-14T10:45:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2024-09-14T10:45:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2024-09-14T10:45:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2024-09-14T10:45:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2024-09-14T10:45:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T10:45:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2024-09-14T10:45:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T10:45:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T10:45:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2024-09-14T10:45:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2024-09-14T10:45:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2024-09-14T10:45:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2024-09-14T10:45:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2024-09-14T10:45:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2024-09-14T10:45:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2024-09-14T10:45:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2024-09-14T10:45:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T10:45:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T10:45:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2024-09-14T10:45:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T10:45:36.149 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.149 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2024-09-14T10:45:36.149 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.149 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2024-09-14T10:45:36.149 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.149 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2024-09-14T10:45:36.149 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2024-09-14T10:45:36.149 INFO:teuthology.orchestra.run.smithi050.stdout: mon health detail to clog = false 2024-09-14T10:45:36.149 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = "172.21.15.50,[v2:172.21.15.50:3301,v1:172.21.15.50:6790],172.21.15.118" 2024-09-14T10:45:36.149 INFO:teuthology.orchestra.run.smithi050.stdout: mon client directed command retry = 5 2024-09-14T10:45:36.149 INFO:teuthology.orchestra.run.smithi050.stdout: ms inject socket failures = 5000 2024-09-14T10:45:36.149 INFO:teuthology.orchestra.run.smithi050.stdout: osd heartbeat grace = 40 2024-09-14T10:45:36.149 INFO:teuthology.orchestra.run.smithi050.stdout: osd_max_pg_log_entries = 10 2024-09-14T10:45:36.149 INFO:teuthology.orchestra.run.smithi050.stdout: osd_min_pg_log_entries = 10 2024-09-14T10:45:36.149 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T10:45:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.150 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2024-09-14T10:45:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2024-09-14T10:45:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2024-09-14T10:45:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2024-09-14T10:45:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: osd mclock profile = high_recovery_ops 2024-09-14T10:45:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2024-09-14T10:45:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2024-09-14T10:45:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2024-09-14T10:45:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2024-09-14T10:45:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2024-09-14T10:45:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug trim objects = true 2024-09-14T10:45:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2024-09-14T10:45:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2024-09-14T10:45:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2024-09-14T10:45:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2024-09-14T10:45:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2024-09-14T10:45:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2024-09-14T10:45:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2024-09-14T10:45:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2024-09-14T10:45:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2024-09-14T10:45:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: bdev async discard = True 2024-09-14T10:45:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: bdev enable discard = True 2024-09-14T10:45:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore allocator = bitmap 2024-09-14T10:45:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore block size = 96636764160 2024-09-14T10:45:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore fsck on mount = True 2024-09-14T10:45:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluefs = 1/20 2024-09-14T10:45:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluestore = 1/20 2024-09-14T10:45:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-14T10:45:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: debug objclass = 20 2024-09-14T10:45:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 20 2024-09-14T10:45:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: debug rocksdb = 4/10 2024-09-14T10:45:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T10:45:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd full ratio = 0.9 2024-09-14T10:45:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd nearfull ratio = 0.8 2024-09-14T10:45:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: osd failsafe full ratio = 0.95 2024-09-14T10:45:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: osd fast shutdown = False 2024-09-14T10:45:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: osd objectstore = bluestore 2024-09-14T10:45:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: osd shutdown pgref assert = True 2024-09-14T10:45:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.153 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2024-09-14T10:45:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-14T10:45:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2024-09-14T10:45:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-09-14T10:45:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-09-14T10:45:36.154 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:45:36.154 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:45:36.154 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2024-09-14T10:45:36.154 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.154 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2024-09-14T10:45:36.154 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-14T10:45:36.154 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-09-14T10:45:36.154 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2024-09-14T10:45:36.154 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-09-14T10:45:36.154 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2024-09-14T10:45:36.154 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2024-09-14T10:45:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:45:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2024-09-14T10:45:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2024-09-14T10:45:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:45:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T10:45:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T10:45:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T10:45:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T10:45:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T10:45:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T10:45:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.156 INFO:teuthology.orchestra.run.smithi050.stdout: # 1m isn't quite enough 2024-09-14T10:45:36.156 INFO:teuthology.orchestra.run.smithi050.stdout: mon_down_mkfs_grace = 2m 2024-09-14T10:45:36.156 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.156 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_filestore_osds = false 2024-09-14T10:45:36.156 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd crush smoke test = False 2024-09-14T10:45:36.156 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:45:36.156 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2024-09-14T10:45:36.156 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2024-09-14T10:45:36.156 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = True 2024-09-14T10:45:36.156 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2024-09-14T10:45:36.156 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T10:45:36.156 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T10:45:36.156 INFO:teuthology.orchestra.run.smithi050.stdout: debug rgw = 20 2024-09-14T10:45:36.156 INFO:teuthology.orchestra.run.smithi050.stdout: debug rgw notification = 20 2024-09-14T10:45:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: rgw bucket counters cache = True 2024-09-14T10:45:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: rgw crypt require ssl = False 2024-09-14T10:45:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: rgw crypt s3 kms backend = testing 2024-09-14T10:45:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T10:45:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-14T10:45:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-14T10:45:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: rgw d3n l1 local datacache enabled = True 2024-09-14T10:45:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: rgw max chunk size = 4194304 2024-09-14T10:45:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: rgw obj stripe size = 6291456 2024-09-14T10:45:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: rgw reshard progress judge interval = 10 2024-09-14T10:45:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: rgw s3 auth use sts = True 2024-09-14T10:45:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T10:45:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: rgw torrent flag = True 2024-09-14T10:45:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: rgw user counters cache = True 2024-09-14T10:45:36.158 INFO:teuthology.orchestra.run.smithi050.stdout: setgroup = ceph 2024-09-14T10:45:36.158 INFO:teuthology.orchestra.run.smithi050.stdout: setuser = ceph 2024-09-14T10:45:36.158 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2024-09-14T10:45:36.158 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.c] 2024-09-14T10:45:36.158 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.b] 2024-09-14T10:45:36.160 INFO:teuthology.orchestra.run.smithi118.stdout:[global] 2024-09-14T10:45:36.160 INFO:teuthology.orchestra.run.smithi118.stdout: chdir = "" 2024-09-14T10:45:36.160 INFO:teuthology.orchestra.run.smithi118.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T10:45:36.160 INFO:teuthology.orchestra.run.smithi118.stdout: auth supported = cephx 2024-09-14T10:45:36.160 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.160 INFO:teuthology.orchestra.run.smithi118.stdout: filestore xattr use omap = true 2024-09-14T10:45:36.160 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.160 INFO:teuthology.orchestra.run.smithi118.stdout: mon clock drift allowed = 1.000 2024-09-14T10:45:36.160 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.160 INFO:teuthology.orchestra.run.smithi118.stdout: osd crush chooseleaf type = 0 2024-09-14T10:45:36.160 INFO:teuthology.orchestra.run.smithi118.stdout: auth debug = true 2024-09-14T10:45:36.160 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.161 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on old message = true 2024-09-14T10:45:36.161 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on bug = true 2024-09-14T10:45:36.161 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.161 INFO:teuthology.orchestra.run.smithi118.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T10:45:36.161 INFO:teuthology.orchestra.run.smithi118.stdout: mon pg warn max object skew = 0 2024-09-14T10:45:36.161 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.161 INFO:teuthology.orchestra.run.smithi118.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T10:45:36.161 INFO:teuthology.orchestra.run.smithi118.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T10:45:36.161 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.161 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default size = 2 2024-09-14T10:45:36.161 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.161 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow primary affinity = true 2024-09-14T10:45:36.161 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow pg remap = true 2024-09-14T10:45:36.161 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on legacy crush tunables = false 2024-09-14T10:45:36.162 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on crush straw calc version zero = false 2024-09-14T10:45:36.162 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on no sortbitwise = false 2024-09-14T10:45:36.162 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on osd down out interval zero = false 2024-09-14T10:45:36.162 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on too few osds = false 2024-09-14T10:45:36.162 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T10:45:36.162 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T10:45:36.162 INFO:teuthology.orchestra.run.smithi118.stdout: mon_allow_pool_size_one = true 2024-09-14T10:45:36.162 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.162 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T10:45:36.162 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.162 INFO:teuthology.orchestra.run.smithi118.stdout: osd default data pool replay window = 5 2024-09-14T10:45:36.162 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.162 INFO:teuthology.orchestra.run.smithi118.stdout: mon allow pool delete = true 2024-09-14T10:45:36.163 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.163 INFO:teuthology.orchestra.run.smithi118.stdout: mon cluster log file level = debug 2024-09-14T10:45:36.163 INFO:teuthology.orchestra.run.smithi118.stdout: debug asserts on shutdown = true 2024-09-14T10:45:36.163 INFO:teuthology.orchestra.run.smithi118.stdout: mon health detail to clog = false 2024-09-14T10:45:36.163 INFO:teuthology.orchestra.run.smithi118.stdout: mon host = "172.21.15.50,[v2:172.21.15.50:3301,v1:172.21.15.50:6790],172.21.15.118" 2024-09-14T10:45:36.163 INFO:teuthology.orchestra.run.smithi118.stdout: mon client directed command retry = 5 2024-09-14T10:45:36.163 INFO:teuthology.orchestra.run.smithi118.stdout: ms inject socket failures = 5000 2024-09-14T10:45:36.163 INFO:teuthology.orchestra.run.smithi118.stdout: osd heartbeat grace = 40 2024-09-14T10:45:36.163 INFO:teuthology.orchestra.run.smithi118.stdout: osd_max_pg_log_entries = 10 2024-09-14T10:45:36.163 INFO:teuthology.orchestra.run.smithi118.stdout: osd_min_pg_log_entries = 10 2024-09-14T10:45:36.163 INFO:teuthology.orchestra.run.smithi118.stdout: fsid = b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T10:45:36.163 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.163 INFO:teuthology.orchestra.run.smithi118.stdout:[osd] 2024-09-14T10:45:36.163 INFO:teuthology.orchestra.run.smithi118.stdout: osd journal size = 100 2024-09-14T10:45:36.164 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.164 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub load threshold = 5.0 2024-09-14T10:45:36.164 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub max interval = 600 2024-09-14T10:45:36.164 INFO:teuthology.orchestra.run.smithi118.stdout: osd mclock profile = high_recovery_ops 2024-09-14T10:45:36.164 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.164 INFO:teuthology.orchestra.run.smithi118.stdout: osd recover clone overlap = true 2024-09-14T10:45:36.164 INFO:teuthology.orchestra.run.smithi118.stdout: osd recovery max chunk = 1048576 2024-09-14T10:45:36.164 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.164 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug shutdown = true 2024-09-14T10:45:36.165 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug op order = true 2024-09-14T10:45:36.165 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug verify stray on activate = true 2024-09-14T10:45:36.165 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug trim objects = true 2024-09-14T10:45:36.165 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.165 INFO:teuthology.orchestra.run.smithi118.stdout: osd open classes on start = true 2024-09-14T10:45:36.165 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug pg log writeout = true 2024-09-14T10:45:36.165 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.165 INFO:teuthology.orchestra.run.smithi118.stdout: osd deep scrub update digest min age = 30 2024-09-14T10:45:36.165 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.165 INFO:teuthology.orchestra.run.smithi118.stdout: osd map max advance = 10 2024-09-14T10:45:36.165 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.165 INFO:teuthology.orchestra.run.smithi118.stdout: journal zero on create = true 2024-09-14T10:45:36.165 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.165 INFO:teuthology.orchestra.run.smithi118.stdout: filestore ondisk finisher threads = 3 2024-09-14T10:45:36.165 INFO:teuthology.orchestra.run.smithi118.stdout: filestore apply finisher threads = 3 2024-09-14T10:45:36.166 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.166 INFO:teuthology.orchestra.run.smithi118.stdout: bdev debug aio = true 2024-09-14T10:45:36.166 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug misdirected ops = true 2024-09-14T10:45:36.166 INFO:teuthology.orchestra.run.smithi118.stdout: bdev async discard = True 2024-09-14T10:45:36.166 INFO:teuthology.orchestra.run.smithi118.stdout: bdev enable discard = True 2024-09-14T10:45:36.166 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore allocator = bitmap 2024-09-14T10:45:36.166 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore block size = 96636764160 2024-09-14T10:45:36.166 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore fsck on mount = True 2024-09-14T10:45:36.166 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluefs = 1/20 2024-09-14T10:45:36.166 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluestore = 1/20 2024-09-14T10:45:36.166 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-09-14T10:45:36.166 INFO:teuthology.orchestra.run.smithi118.stdout: debug objclass = 20 2024-09-14T10:45:36.166 INFO:teuthology.orchestra.run.smithi118.stdout: debug osd = 20 2024-09-14T10:45:36.166 INFO:teuthology.orchestra.run.smithi118.stdout: debug rocksdb = 4/10 2024-09-14T10:45:36.166 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T10:45:36.167 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd full ratio = 0.9 2024-09-14T10:45:36.167 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd nearfull ratio = 0.8 2024-09-14T10:45:36.167 INFO:teuthology.orchestra.run.smithi118.stdout: osd failsafe full ratio = 0.95 2024-09-14T10:45:36.167 INFO:teuthology.orchestra.run.smithi118.stdout: osd fast shutdown = False 2024-09-14T10:45:36.167 INFO:teuthology.orchestra.run.smithi118.stdout: osd objectstore = bluestore 2024-09-14T10:45:36.167 INFO:teuthology.orchestra.run.smithi118.stdout: osd shutdown pgref assert = True 2024-09-14T10:45:36.167 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.167 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr] 2024-09-14T10:45:36.167 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-09-14T10:45:36.167 INFO:teuthology.orchestra.run.smithi118.stdout: debug mgr = 20 2024-09-14T10:45:36.167 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2024-09-14T10:45:36.167 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2024-09-14T10:45:36.167 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:45:36.167 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:45:36.168 INFO:teuthology.orchestra.run.smithi118.stdout: mgr/telemetry/nag = false 2024-09-14T10:45:36.168 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.168 INFO:teuthology.orchestra.run.smithi118.stdout:[mon] 2024-09-14T10:45:36.168 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-09-14T10:45:36.168 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2024-09-14T10:45:36.168 INFO:teuthology.orchestra.run.smithi118.stdout: debug paxos = 20 2024-09-14T10:45:36.168 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2024-09-14T10:45:36.168 INFO:teuthology.orchestra.run.smithi118.stdout: mon data avail warn = 5 2024-09-14T10:45:36.168 INFO:teuthology.orchestra.run.smithi118.stdout: mon mgr mkfs grace = 240 2024-09-14T10:45:36.168 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:45:36.168 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd reporter subtree level = osd 2024-09-14T10:45:36.168 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd prime pg temp = true 2024-09-14T10:45:36.168 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:45:36.168 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.168 INFO:teuthology.orchestra.run.smithi118.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T10:45:36.169 INFO:teuthology.orchestra.run.smithi118.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T10:45:36.169 INFO:teuthology.orchestra.run.smithi118.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T10:45:36.169 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.169 INFO:teuthology.orchestra.run.smithi118.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T10:45:36.169 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T10:45:36.169 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T10:45:36.169 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.169 INFO:teuthology.orchestra.run.smithi118.stdout: # 1m isn't quite enough 2024-09-14T10:45:36.169 INFO:teuthology.orchestra.run.smithi118.stdout: mon_down_mkfs_grace = 2m 2024-09-14T10:45:36.169 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.169 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_filestore_osds = false 2024-09-14T10:45:36.169 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd crush smoke test = False 2024-09-14T10:45:36.169 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-14T10:45:36.169 INFO:teuthology.orchestra.run.smithi118.stdout:[client] 2024-09-14T10:45:36.169 INFO:teuthology.orchestra.run.smithi118.stdout: rgw cache enabled = true 2024-09-14T10:45:36.170 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable ops log = True 2024-09-14T10:45:36.170 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable usage log = true 2024-09-14T10:45:36.170 INFO:teuthology.orchestra.run.smithi118.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T10:45:36.170 INFO:teuthology.orchestra.run.smithi118.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T10:45:36.170 INFO:teuthology.orchestra.run.smithi118.stdout: debug rgw = 20 2024-09-14T10:45:36.170 INFO:teuthology.orchestra.run.smithi118.stdout: debug rgw notification = 20 2024-09-14T10:45:36.170 INFO:teuthology.orchestra.run.smithi118.stdout: rgw bucket counters cache = True 2024-09-14T10:45:36.170 INFO:teuthology.orchestra.run.smithi118.stdout: rgw crypt require ssl = False 2024-09-14T10:45:36.170 INFO:teuthology.orchestra.run.smithi118.stdout: rgw crypt s3 kms backend = testing 2024-09-14T10:45:36.170 INFO:teuthology.orchestra.run.smithi118.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T10:45:36.170 INFO:teuthology.orchestra.run.smithi118.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-14T10:45:36.170 INFO:teuthology.orchestra.run.smithi118.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-14T10:45:36.170 INFO:teuthology.orchestra.run.smithi118.stdout: rgw d3n l1 local datacache enabled = True 2024-09-14T10:45:36.170 INFO:teuthology.orchestra.run.smithi118.stdout: rgw max chunk size = 4194304 2024-09-14T10:45:36.171 INFO:teuthology.orchestra.run.smithi118.stdout: rgw obj stripe size = 6291456 2024-09-14T10:45:36.171 INFO:teuthology.orchestra.run.smithi118.stdout: rgw reshard progress judge interval = 10 2024-09-14T10:45:36.171 INFO:teuthology.orchestra.run.smithi118.stdout: rgw s3 auth use sts = True 2024-09-14T10:45:36.171 INFO:teuthology.orchestra.run.smithi118.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T10:45:36.171 INFO:teuthology.orchestra.run.smithi118.stdout: rgw torrent flag = True 2024-09-14T10:45:36.171 INFO:teuthology.orchestra.run.smithi118.stdout: rgw user counters cache = True 2024-09-14T10:45:36.171 INFO:teuthology.orchestra.run.smithi118.stdout: setgroup = ceph 2024-09-14T10:45:36.171 INFO:teuthology.orchestra.run.smithi118.stdout: setuser = ceph 2024-09-14T10:45:36.171 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.a] 2024-09-14T10:45:36.171 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.c] 2024-09-14T10:45:36.171 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.b] 2024-09-14T10:45:36.171 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-14T10:45:36.172 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-14T10:45:36.242 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-14T10:45:36.242 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:45:36.242 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-14T10:45:36.271 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:45:36.271 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-14T10:45:36.341 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi050.front.sepia.ceph.com 2024-09-14T10:45:36.341 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:45:36.341 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T10:45:36.341 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T10:45:36.431 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:45:36.432 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:45:36.501 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi118.front.sepia.ceph.com 2024-09-14T10:45:36.501 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-14T10:45:36.501 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T10:45:36.502 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T10:45:36.550 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-14T10:45:36.550 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:45:36.619 INFO:tasks.ceph:Setting up mon nodes... 2024-09-14T10:45:36.619 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-14T10:45:36.619 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T10:45:36.686 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T10:45:36.689 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T10:45:36.796 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T10:45:36.799 INFO:tasks.ceph:Setting up mds nodes... 2024-09-14T10:45:36.799 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-14T10:45:36.799 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-14T10:45:36.857 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-14T10:45:36.870 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-14T10:45:36.924 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-14T10:45:36.937 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-14T10:45:36.938 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T10:45:36.938 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-14T10:45:36.977 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:45:36.978 INFO:tasks.ceph:role: osd.0 2024-09-14T10:45:36.978 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-14T10:45:36.978 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T10:45:37.056 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:45:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:45:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:45:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:45:37.057 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:45:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:45:37.058 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:45:37.058 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:45:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:45:37.058 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:45:37.090 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-09-14T10:45:37.092 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-09-14T10:45:37.092 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-14T10:45:37.177 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-14T10:45:37.261 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-14T10:45:37.301 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:45:37.301 INFO:tasks.ceph:role: osd.1 2024-09-14T10:45:37.302 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-14T10:45:37.302 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T10:45:37.381 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:45:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:45:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:45:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:45:37.381 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:45:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:45:37.382 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:45:37.382 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:45:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:45:37.382 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:45:37.412 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-09-14T10:45:37.415 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-09-14T10:45:37.415 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-14T10:45:37.498 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-14T10:45:37.584 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-14T10:45:37.664 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:45:37.664 INFO:tasks.ceph:role: osd.2 2024-09-14T10:45:37.664 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-14T10:45:37.665 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T10:45:37.748 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:45:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:45:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:45:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:45:37.748 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:45:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:45:37.748 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:45:37.748 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:45:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:45:37.749 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:45:37.780 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-09-14T10:45:37.782 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-09-14T10:45:37.783 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-14T10:45:37.867 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-14T10:45:37.911 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-14T10:45:37.952 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:45:37.952 INFO:tasks.ceph:role: osd.3 2024-09-14T10:45:37.952 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-14T10:45:37.952 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T10:45:38.032 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:45:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:45:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:45:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:45:38.032 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:45:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:45:38.033 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:45:38.033 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:45:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:45:38.033 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:45:38.065 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-09-14T10:45:38.067 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-09-14T10:45:38.067 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-14T10:45:38.156 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-14T10:45:38.199 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:45:38.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:45:38.334+0000 7f9deb80d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-14T10:45:38.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:45:38.334+0000 7f9deb80d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-14T10:45:38.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:45:38.334+0000 7f9deb80d640 -1 bdev(0x555a2b6bd800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-14T10:45:38.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:45:38.334+0000 7f9deb80d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-14T10:45:41.497 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-14T10:45:41.544 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:45:41.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:45:41.609+0000 7f1dd10e8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-14T10:45:41.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:45:41.610+0000 7f1dd10e8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-14T10:45:41.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:45:41.610+0000 7f1dd10e8640 -1 bdev(0x557e5130d800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-14T10:45:41.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:45:41.610+0000 7f1dd10e8640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-14T10:45:44.774 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-14T10:45:44.820 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:45:44.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:45:44.886+0000 7f3c9fc0c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-14T10:45:44.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:45:44.886+0000 7f3c9fc0c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-14T10:45:44.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:45:44.886+0000 7f3c9fc0c640 -1 bdev(0x5651bbd59800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-14T10:45:44.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:45:44.886+0000 7f3c9fc0c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-14T10:45:47.804 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-14T10:45:47.853 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:45:47.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:45:47.920+0000 7ff26ec1c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-14T10:45:47.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:45:47.920+0000 7ff26ec1c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-14T10:45:47.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:45:47.920+0000 7ff26ec1c640 -1 bdev(0x55659ccaf800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-14T10:45:47.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:45:47.921+0000 7ff26ec1c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-14T10:45:50.838 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-14T10:45:50.884 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-14T10:45:50.929 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:45:50.929 INFO:tasks.ceph:role: osd.4 2024-09-14T10:45:50.929 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com 2024-09-14T10:45:50.929 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T10:45:51.010 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:45:51.010 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:45:51.010 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:45:51.010 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:45:51.010 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:45:51.010 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:45:51.010 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:45:51.010 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:45:51.010 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:45:51.010 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:45:51.042 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-09-14T10:45:51.044 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-09-14T10:45:51.044 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-14T10:45:51.127 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-14T10:45:51.214 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-14T10:45:51.293 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:45:51.293 INFO:tasks.ceph:role: osd.5 2024-09-14T10:45:51.293 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com 2024-09-14T10:45:51.293 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T10:45:51.370 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:45:51.370 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:45:51.370 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:45:51.371 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:45:51.371 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:45:51.371 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:45:51.371 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:45:51.371 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:45:51.371 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:45:51.371 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:45:51.403 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-09-14T10:45:51.405 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-09-14T10:45:51.405 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-14T10:45:51.493 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-14T10:45:51.535 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-14T10:45:51.614 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:45:51.614 INFO:tasks.ceph:role: osd.6 2024-09-14T10:45:51.614 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com 2024-09-14T10:45:51.615 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T10:45:51.695 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:45:51.695 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:45:51.695 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:45:51.695 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:45:51.695 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:45:51.695 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:45:51.696 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:45:51.696 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:45:51.696 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:45:51.696 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:45:51.729 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-09-14T10:45:51.731 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-09-14T10:45:51.731 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-14T10:45:51.812 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-14T10:45:51.894 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-14T10:45:51.974 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:45:51.974 INFO:tasks.ceph:role: osd.7 2024-09-14T10:45:51.974 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com 2024-09-14T10:45:51.974 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T10:45:52.051 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:45:52.051 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:45:52.051 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:45:52.052 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:45:52.052 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:45:52.052 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:45:52.052 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:45:52.052 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:45:52.052 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:45:52.052 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:45:52.084 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-09-14T10:45:52.085 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-09-14T10:45:52.086 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-14T10:45:52.172 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-14T10:45:52.213 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:45:52.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-14T10:45:52.325+0000 7ff597132640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-14T10:45:52.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-14T10:45:52.325+0000 7ff597132640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-14T10:45:52.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-14T10:45:52.325+0000 7ff597132640 -1 bdev(0x55781771d800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-14T10:45:52.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-14T10:45:52.325+0000 7ff597132640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-14T10:45:55.719 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-14T10:45:55.766 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:45:55.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-14T10:45:55.836+0000 7f5bc902c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-14T10:45:55.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-14T10:45:55.837+0000 7f5bc902c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-14T10:45:55.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-14T10:45:55.837+0000 7f5bc902c640 -1 bdev(0x557678b37800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-14T10:45:55.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-14T10:45:55.837+0000 7f5bc902c640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-14T10:45:58.755 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-14T10:45:58.803 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:45:58.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-14T10:45:58.876+0000 7f0f4a82c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-14T10:45:58.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-14T10:45:58.876+0000 7f0f4a82c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-14T10:45:58.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-14T10:45:58.876+0000 7f0f4a82c640 -1 bdev(0x55d880a41800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-14T10:45:58.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-14T10:45:58.877+0000 7f0f4a82c640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-14T10:46:02.048 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-14T10:46:02.089 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:46:02.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-14T10:46:02.191+0000 7fc8dd887640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-14T10:46:02.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-14T10:46:02.191+0000 7fc8dd887640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-14T10:46:02.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-14T10:46:02.191+0000 7fc8dd887640 -1 bdev(0x55c33c2bf800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-14T10:46:02.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-14T10:46:02.191+0000 7fc8dd887640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-14T10:46:05.104 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-14T10:46:05.148 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-14T10:46:05.148 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:46:05.148 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-14T10:46:05.196 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:46:05.197 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-14T10:46:05.281 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:46:05.282 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-14T10:46:05.366 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:46:05.366 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-14T10:46:05.447 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:46:05.447 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-14T10:46:05.528 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-14T10:46:05.528 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-14T10:46:05.572 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-14T10:46:05.573 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-14T10:46:05.655 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-14T10:46:05.655 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-14T10:46:05.735 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-14T10:46:05.735 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-14T10:46:05.816 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-14T10:46:05.816 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-14T10:46:05.896 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:46:05.896 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-14T10:46:05.929 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-14T10:46:05.929 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-14T10:46:05.965 INFO:tasks.ceph:Adding keys to all mons... 2024-09-14T10:46:05.965 DEBUG:teuthology.orchestra.run.smithi050:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T10:46:05.972 DEBUG:teuthology.orchestra.run.smithi118:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T10:46:06.010 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.y] 2024-09-14T10:46:06.011 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBQaeVmDRgZKRAAM2CLT/m8QKgxWqjy3C6CKQ== 2024-09-14T10:46:06.011 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.0] 2024-09-14T10:46:06.011 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBSaeVmP/MBFBAAWTnP+SbrQV4tBqj1i/9BDw== 2024-09-14T10:46:06.011 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.1] 2024-09-14T10:46:06.011 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBVaeVmZ9BwJBAA7DlLqOBhP+0BrwmN/MGVgA== 2024-09-14T10:46:06.011 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.2] 2024-09-14T10:46:06.011 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBYaeVmS63oNBAA8AgoxEf9iE6CDowASLnSTQ== 2024-09-14T10:46:06.011 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.3] 2024-09-14T10:46:06.011 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBbaeVm3U72NhAAXARZC8d4WNK1PikMwhvw3A== 2024-09-14T10:46:06.012 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.x] 2024-09-14T10:46:06.012 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBQaeVmdNmgLxAAFuwG+KT1PmklPfK+KuGwWw== 2024-09-14T10:46:06.012 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.4] 2024-09-14T10:46:06.012 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBgaeVmHm9uExAAvAmwYu3NwgX7T5vqT1Lx4Q== 2024-09-14T10:46:06.012 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.5] 2024-09-14T10:46:06.012 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBjaeVmMzjtMRAAsGQ5r1KGrJeqfn63UIBkQQ== 2024-09-14T10:46:06.012 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.6] 2024-09-14T10:46:06.012 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBmaeVm0bBKNBAAERom8aGmAL2+QUM0Nc7ASw== 2024-09-14T10:46:06.012 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.7] 2024-09-14T10:46:06.012 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBqaeVmhC1uCxAA6v2oTO3YKaab9okF6IhdPw== 2024-09-14T10:46:06.012 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-09-14T10:46:06.012 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBQaeVmyns6MxAAiXuj6guee5W6Zxdb7Lgg3g== 2024-09-14T10:46:06.012 INFO:teuthology.orchestra.run.smithi050.stdout:[client.1] 2024-09-14T10:46:06.013 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBQaeVmUetJNxAA4xbfaX3aif8BVzBGotaW9A== 2024-09-14T10:46:06.041 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.y] 2024-09-14T10:46:06.041 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBQaeVmDRgZKRAAM2CLT/m8QKgxWqjy3C6CKQ== 2024-09-14T10:46:06.041 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.0] 2024-09-14T10:46:06.041 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBSaeVmP/MBFBAAWTnP+SbrQV4tBqj1i/9BDw== 2024-09-14T10:46:06.041 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.1] 2024-09-14T10:46:06.041 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBVaeVmZ9BwJBAA7DlLqOBhP+0BrwmN/MGVgA== 2024-09-14T10:46:06.041 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.2] 2024-09-14T10:46:06.041 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBYaeVmS63oNBAA8AgoxEf9iE6CDowASLnSTQ== 2024-09-14T10:46:06.041 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.3] 2024-09-14T10:46:06.042 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBbaeVm3U72NhAAXARZC8d4WNK1PikMwhvw3A== 2024-09-14T10:46:06.042 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.x] 2024-09-14T10:46:06.042 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBQaeVmdNmgLxAAFuwG+KT1PmklPfK+KuGwWw== 2024-09-14T10:46:06.042 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.4] 2024-09-14T10:46:06.042 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBgaeVmHm9uExAAvAmwYu3NwgX7T5vqT1Lx4Q== 2024-09-14T10:46:06.042 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.5] 2024-09-14T10:46:06.042 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBjaeVmMzjtMRAAsGQ5r1KGrJeqfn63UIBkQQ== 2024-09-14T10:46:06.042 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.6] 2024-09-14T10:46:06.042 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBmaeVm0bBKNBAAERom8aGmAL2+QUM0Nc7ASw== 2024-09-14T10:46:06.042 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.7] 2024-09-14T10:46:06.042 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBqaeVmhC1uCxAA6v2oTO3YKaab9okF6IhdPw== 2024-09-14T10:46:06.042 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2024-09-14T10:46:06.042 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBQaeVmyns6MxAAiXuj6guee5W6Zxdb7Lgg3g== 2024-09-14T10:46:06.042 INFO:teuthology.orchestra.run.smithi118.stdout:[client.1] 2024-09-14T10:46:06.042 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBQaeVmUetJNxAA4xbfaX3aif8BVzBGotaW9A== 2024-09-14T10:46:06.043 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T10:46:06.056 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T10:46:06.148 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:46:06.150 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:46:06.215 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:46:06.218 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:46:06.283 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:46:06.285 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:46:06.350 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:46:06.352 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:46:06.417 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T10:46:06.419 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T10:46:06.484 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:46:06.486 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:46:06.551 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:46:06.553 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:46:06.618 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:46:06.620 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:46:06.684 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:46:06.687 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:46:06.754 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T10:46:06.756 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T10:46:06.823 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T10:46:06.826 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T10:46:06.894 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-14T10:46:06.894 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-14T10:46:06.934 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T10:46:07.046 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-14T10:46:07.085 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-14T10:46:07.166 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T10:46:07.278 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-14T10:46:07.318 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-14T10:46:07.357 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T10:46:07.468 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-14T10:46:07.507 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:46:07.509 DEBUG:teuthology.orchestra.run.smithi118:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:46:07.575 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-14T10:46:07.575 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-14T10:46:07.576 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-14T10:46:07.580 INFO:tasks.ceph.mon.a:Started 2024-09-14T10:46:07.581 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-14T10:46:07.581 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-14T10:46:07.583 INFO:tasks.ceph.mon.c:Started 2024-09-14T10:46:07.583 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-14T10:46:07.583 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-14T10:46:07.618 INFO:tasks.ceph.mon.b:Started 2024-09-14T10:46:07.619 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-14T10:46:07.619 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-14T10:46:07.619 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-14T10:46:07.621 INFO:tasks.ceph.mgr.y:Started 2024-09-14T10:46:07.621 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-14T10:46:07.621 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-14T10:46:07.623 INFO:tasks.ceph.mgr.x:Started 2024-09-14T10:46:07.623 DEBUG:tasks.ceph:set 0 configs 2024-09-14T10:46:07.624 INFO:tasks.ceph:Setting crush tunables to default 2024-09-14T10:46:07.624 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd crush tunables default 2024-09-14T10:46:12.997 INFO:teuthology.orchestra.run.smithi050.stderr:adjusted tunables profile to default 2024-09-14T10:46:13.010 INFO:tasks.ceph:check_enable_crimson: False 2024-09-14T10:46:13.010 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-14T10:46:13.010 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:46:13.010 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-14T10:46:13.051 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:46:13.051 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-14T10:46:13.132 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:46:13.132 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-14T10:46:13.212 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:46:13.212 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-14T10:46:13.292 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-14T10:46:13.292 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-14T10:46:13.330 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-14T10:46:13.330 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-14T10:46:13.408 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-14T10:46:13.409 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-14T10:46:13.487 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-14T10:46:13.487 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-14T10:46:13.567 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new c1ac493c-919c-4291-ab67-463ffca0664f 0 2024-09-14T10:46:13.800 INFO:teuthology.orchestra.run.smithi118.stdout:0 2024-09-14T10:46:13.811 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 8cfeb747-e219-4d25-a8f5-5019198a7753 1 2024-09-14T10:46:14.006 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-09-14T10:46:14.022 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new cc3e2a8a-a85e-49d1-90c5-d2c75de969c0 2 2024-09-14T10:46:14.216 INFO:teuthology.orchestra.run.smithi118.stdout:2 2024-09-14T10:46:14.227 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 3d9aa8c6-8083-4e43-9263-d1383d8b7014 3 2024-09-14T10:46:14.421 INFO:teuthology.orchestra.run.smithi118.stdout:3 2024-09-14T10:46:14.432 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 430fa3f7-80b3-4d5e-8b5d-fab67c96b795 4 2024-09-14T10:46:14.627 INFO:teuthology.orchestra.run.smithi118.stdout:4 2024-09-14T10:46:14.638 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 622fe333-dbe0-4de8-b564-1b46a13d9a2b 5 2024-09-14T10:46:14.831 INFO:teuthology.orchestra.run.smithi118.stdout:5 2024-09-14T10:46:14.847 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 0b69cf26-b62b-4423-bd98-0b3daf3ff809 6 2024-09-14T10:46:15.043 INFO:teuthology.orchestra.run.smithi118.stdout:6 2024-09-14T10:46:15.054 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 7fdbee68-c48f-4c02-8074-f7a5d8d62cf7 7 2024-09-14T10:46:15.249 INFO:teuthology.orchestra.run.smithi118.stdout:7 2024-09-14T10:46:15.261 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-14T10:46:15.261 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-14T10:46:15.263 INFO:tasks.ceph.osd.0:Started 2024-09-14T10:46:15.263 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-14T10:46:15.263 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-14T10:46:15.265 INFO:tasks.ceph.osd.1:Started 2024-09-14T10:46:15.266 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-14T10:46:15.266 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-14T10:46:15.268 INFO:tasks.ceph.osd.2:Started 2024-09-14T10:46:15.268 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-14T10:46:15.268 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-14T10:46:15.270 INFO:tasks.ceph.osd.3:Started 2024-09-14T10:46:15.270 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-14T10:46:15.271 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-14T10:46:15.273 INFO:tasks.ceph.osd.4:Started 2024-09-14T10:46:15.273 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-14T10:46:15.273 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-14T10:46:15.275 INFO:tasks.ceph.osd.5:Started 2024-09-14T10:46:15.275 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-14T10:46:15.276 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-14T10:46:15.280 INFO:tasks.ceph.osd.6:Started 2024-09-14T10:46:15.280 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-14T10:46:15.280 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-14T10:46:15.282 INFO:tasks.ceph.osd.7:Started 2024-09-14T10:46:15.283 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T10:46:15.510 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:46:15.510 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":10,"fsid":"b6566dc9-5665-4f7c-861a-3125c3883e3a","created":"2024-09-14T10:46:12.903412+0000","modified":"2024-09-14T10:46:15.250285+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T10:46:15.250285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c1ac493c-919c-4291-ab67-463ffca0664f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8cfeb747-e219-4d25-a8f5-5019198a7753","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cc3e2a8a-a85e-49d1-90c5-d2c75de969c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3d9aa8c6-8083-4e43-9263-d1383d8b7014","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"430fa3f7-80b3-4d5e-8b5d-fab67c96b795","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"622fe333-dbe0-4de8-b564-1b46a13d9a2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0b69cf26-b62b-4423-bd98-0b3daf3ff809","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7fdbee68-c48f-4c02-8074-f7a5d8d62cf7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:46:15.521 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-14T10:46:15.521 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-14T10:46:16.266 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-14T10:46:16.267+0000 7f2e211bf640 -1 Falling back to public interface 2024-09-14T10:46:16.310 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-09-14T10:46:16.311+0000 7ff0567db640 -1 Falling back to public interface 2024-09-14T10:46:16.328 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T10:46:16.502 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-14T10:46:16.503+0000 7f18c8610640 -1 Falling back to public interface 2024-09-14T10:46:16.506 INFO:teuthology.misc.health.smithi050.stdout: 2024-09-14T10:46:16.507 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":10,"fsid":"b6566dc9-5665-4f7c-861a-3125c3883e3a","created":"2024-09-14T10:46:12.903412+0000","modified":"2024-09-14T10:46:15.250285+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T10:46:15.250285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c1ac493c-919c-4291-ab67-463ffca0664f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8cfeb747-e219-4d25-a8f5-5019198a7753","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cc3e2a8a-a85e-49d1-90c5-d2c75de969c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3d9aa8c6-8083-4e43-9263-d1383d8b7014","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"430fa3f7-80b3-4d5e-8b5d-fab67c96b795","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"622fe333-dbe0-4de8-b564-1b46a13d9a2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0b69cf26-b62b-4423-bd98-0b3daf3ff809","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7fdbee68-c48f-4c02-8074-f7a5d8d62cf7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:46:16.517 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T10:46:16.559 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-09-14T10:46:16.560+0000 7f614df4f640 -1 Falling back to public interface 2024-09-14T10:46:16.742 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-14T10:46:16.743+0000 7f97b8b4b640 -1 Falling back to public interface 2024-09-14T10:46:16.791 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-14T10:46:16.792+0000 7f912b3fd640 -1 Falling back to public interface 2024-09-14T10:46:17.041 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-09-14T10:46:17.042+0000 7fbfa77dd640 -1 Falling back to public interface 2024-09-14T10:46:17.311 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-09-14T10:46:17.313+0000 7f75efc0c640 -1 Falling back to public interface 2024-09-14T10:46:18.197 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-09-14T10:46:18.197+0000 7f6c8b99e640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-14T10:46:18.197 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-09-14T10:46:18.198+0000 7f6c8b99e640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-14T10:46:20.091 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-09-14T10:46:20.092+0000 7ff0567db640 -1 osd.5 0 log_to_monitors true 2024-09-14T10:46:20.324 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-09-14T10:46:20.326+0000 7f614df4f640 -1 osd.6 0 log_to_monitors true 2024-09-14T10:46:20.332 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-14T10:46:20.333+0000 7f2e211bf640 -1 osd.1 0 log_to_monitors true 2024-09-14T10:46:20.511 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-14T10:46:20.512+0000 7f97b8b4b640 -1 osd.0 0 log_to_monitors true 2024-09-14T10:46:20.604 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-14T10:46:20.605+0000 7f912b3fd640 -1 osd.3 0 log_to_monitors true 2024-09-14T10:46:20.779 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-14T10:46:20.781+0000 7f18c8610640 -1 osd.2 0 log_to_monitors true 2024-09-14T10:46:20.819 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-09-14T10:46:20.821+0000 7fbfa77dd640 -1 osd.4 0 log_to_monitors true 2024-09-14T10:46:21.370 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-09-14T10:46:21.372+0000 7f75efc0c640 -1 osd.7 0 log_to_monitors true 2024-09-14T10:46:21.881 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-09-14T10:46:21.883+0000 7ff05276f640 -1 osd.5 0 waiting for initial osdmap 2024-09-14T10:46:21.896 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-09-14T10:46:21.898+0000 7ff04a58e640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:46:23.016 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-09-14T10:46:23.018+0000 7f6149ee3640 -1 osd.6 0 waiting for initial osdmap 2024-09-14T10:46:23.039 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-09-14T10:46:23.041+0000 7f6141d02640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:46:23.324 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T10:46:23.648 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-14T10:46:23.649+0000 7f97b4adf640 -1 osd.0 0 waiting for initial osdmap 2024-09-14T10:46:23.663 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-14T10:46:23.664+0000 7f97ac8fe640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:46:23.724 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-14T10:46:23.725+0000 7f9127391640 -1 osd.3 0 waiting for initial osdmap 2024-09-14T10:46:23.738 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-14T10:46:23.740+0000 7f911f1b0640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:46:23.793 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-14T10:46:23.794+0000 7f18c3f03640 -1 osd.2 0 waiting for initial osdmap 2024-09-14T10:46:23.803 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-14T10:46:23.804+0000 7f2e1d153640 -1 osd.1 0 waiting for initial osdmap 2024-09-14T10:46:23.809 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-14T10:46:23.810+0000 7f18bbd22640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:46:23.817 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-14T10:46:23.819+0000 7f2e14f72640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:46:23.852 INFO:teuthology.misc.health.smithi050.stdout: 2024-09-14T10:46:23.852 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":14,"fsid":"b6566dc9-5665-4f7c-861a-3125c3883e3a","created":"2024-09-14T10:46:12.903412+0000","modified":"2024-09-14T10:46:23.204138+0000","last_up_change":"2024-09-14T10:46:23.204138+0000","last_in_change":"2024-09-14T10:46:15.250285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c1ac493c-919c-4291-ab67-463ffca0664f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8cfeb747-e219-4d25-a8f5-5019198a7753","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cc3e2a8a-a85e-49d1-90c5-d2c75de969c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3d9aa8c6-8083-4e43-9263-d1383d8b7014","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"430fa3f7-80b3-4d5e-8b5d-fab67c96b795","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"622fe333-dbe0-4de8-b564-1b46a13d9a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":287234102},{"type":"v1","addr":"172.21.15.118:6801","nonce":287234102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":287234102},{"type":"v1","addr":"172.21.15.118:6803","nonce":287234102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":287234102},{"type":"v1","addr":"172.21.15.118:6807","nonce":287234102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":287234102},{"type":"v1","addr":"172.21.15.118:6805","nonce":287234102}]},"public_addr":"172.21.15.118:6801/287234102","cluster_addr":"172.21.15.118:6803/287234102","heartbeat_back_addr":"172.21.15.118:6807/287234102","heartbeat_front_addr":"172.21.15.118:6805/287234102","state":["exists","up"]},{"osd":6,"uuid":"0b69cf26-b62b-4423-bd98-0b3daf3ff809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2553505309},{"type":"v1","addr":"172.21.15.118:6809","nonce":2553505309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2553505309},{"type":"v1","addr":"172.21.15.118:6811","nonce":2553505309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2553505309},{"type":"v1","addr":"172.21.15.118:6815","nonce":2553505309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2553505309},{"type":"v1","addr":"172.21.15.118:6813","nonce":2553505309}]},"public_addr":"172.21.15.118:6809/2553505309","cluster_addr":"172.21.15.118:6811/2553505309","heartbeat_back_addr":"172.21.15.118:6815/2553505309","heartbeat_front_addr":"172.21.15.118:6813/2553505309","state":["exists","up"]},{"osd":7,"uuid":"7fdbee68-c48f-4c02-8074-f7a5d8d62cf7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.101749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:46:23.864 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-09-14T10:46:24.033 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-09-14T10:46:24.035+0000 7f75eb523640 -1 osd.7 0 waiting for initial osdmap 2024-09-14T10:46:24.047 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-09-14T10:46:24.049+0000 7f75e3342640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:46:24.149 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-09-14T10:46:24.151+0000 7fbfa3771640 -1 osd.4 0 waiting for initial osdmap 2024-09-14T10:46:24.164 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-09-14T10:46:24.166+0000 7fbf9b590640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:46:30.671 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T10:46:30.992 INFO:teuthology.misc.health.smithi050.stdout: 2024-09-14T10:46:30.992 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":18,"fsid":"b6566dc9-5665-4f7c-861a-3125c3883e3a","created":"2024-09-14T10:46:12.903412+0000","modified":"2024-09-14T10:46:27.239306+0000","last_up_change":"2024-09-14T10:46:24.220378+0000","last_in_change":"2024-09-14T10:46:15.250285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:46:25.206041+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1ac493c-919c-4291-ab67-463ffca0664f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":1957449887},{"type":"v1","addr":"172.21.15.50:6817","nonce":1957449887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1957449887},{"type":"v1","addr":"172.21.15.50:6819","nonce":1957449887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1957449887},{"type":"v1","addr":"172.21.15.50:6823","nonce":1957449887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1957449887},{"type":"v1","addr":"172.21.15.50:6821","nonce":1957449887}]},"public_addr":"172.21.15.50:6817/1957449887","cluster_addr":"172.21.15.50:6819/1957449887","heartbeat_back_addr":"172.21.15.50:6823/1957449887","heartbeat_front_addr":"172.21.15.50:6821/1957449887","state":["exists","up"]},{"osd":1,"uuid":"8cfeb747-e219-4d25-a8f5-5019198a7753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2565843969},{"type":"v1","addr":"172.21.15.50:6801","nonce":2565843969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2565843969},{"type":"v1","addr":"172.21.15.50:6803","nonce":2565843969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2565843969},{"type":"v1","addr":"172.21.15.50:6807","nonce":2565843969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2565843969},{"type":"v1","addr":"172.21.15.50:6805","nonce":2565843969}]},"public_addr":"172.21.15.50:6801/2565843969","cluster_addr":"172.21.15.50:6803/2565843969","heartbeat_back_addr":"172.21.15.50:6807/2565843969","heartbeat_front_addr":"172.21.15.50:6805/2565843969","state":["exists","up"]},{"osd":2,"uuid":"cc3e2a8a-a85e-49d1-90c5-d2c75de969c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3787956460},{"type":"v1","addr":"172.21.15.50:6809","nonce":3787956460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3787956460},{"type":"v1","addr":"172.21.15.50:6811","nonce":3787956460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3787956460},{"type":"v1","addr":"172.21.15.50:6815","nonce":3787956460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3787956460},{"type":"v1","addr":"172.21.15.50:6813","nonce":3787956460}]},"public_addr":"172.21.15.50:6809/3787956460","cluster_addr":"172.21.15.50:6811/3787956460","heartbeat_back_addr":"172.21.15.50:6815/3787956460","heartbeat_front_addr":"172.21.15.50:6813/3787956460","state":["exists","up"]},{"osd":3,"uuid":"3d9aa8c6-8083-4e43-9263-d1383d8b7014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":856974303},{"type":"v1","addr":"172.21.15.50:6825","nonce":856974303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":856974303},{"type":"v1","addr":"172.21.15.50:6827","nonce":856974303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":856974303},{"type":"v1","addr":"172.21.15.50:6831","nonce":856974303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":856974303},{"type":"v1","addr":"172.21.15.50:6829","nonce":856974303}]},"public_addr":"172.21.15.50:6825/856974303","cluster_addr":"172.21.15.50:6827/856974303","heartbeat_back_addr":"172.21.15.50:6831/856974303","heartbeat_front_addr":"172.21.15.50:6829/856974303","state":["exists","up"]},{"osd":4,"uuid":"430fa3f7-80b3-4d5e-8b5d-fab67c96b795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4154782182},{"type":"v1","addr":"172.21.15.118:6817","nonce":4154782182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4154782182},{"type":"v1","addr":"172.21.15.118:6819","nonce":4154782182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4154782182},{"type":"v1","addr":"172.21.15.118:6823","nonce":4154782182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4154782182},{"type":"v1","addr":"172.21.15.118:6821","nonce":4154782182}]},"public_addr":"172.21.15.118:6817/4154782182","cluster_addr":"172.21.15.118:6819/4154782182","heartbeat_back_addr":"172.21.15.118:6823/4154782182","heartbeat_front_addr":"172.21.15.118:6821/4154782182","state":["exists","up"]},{"osd":5,"uuid":"622fe333-dbe0-4de8-b564-1b46a13d9a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":287234102},{"type":"v1","addr":"172.21.15.118:6801","nonce":287234102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":287234102},{"type":"v1","addr":"172.21.15.118:6803","nonce":287234102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":287234102},{"type":"v1","addr":"172.21.15.118:6807","nonce":287234102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":287234102},{"type":"v1","addr":"172.21.15.118:6805","nonce":287234102}]},"public_addr":"172.21.15.118:6801/287234102","cluster_addr":"172.21.15.118:6803/287234102","heartbeat_back_addr":"172.21.15.118:6807/287234102","heartbeat_front_addr":"172.21.15.118:6805/287234102","state":["exists","up"]},{"osd":6,"uuid":"0b69cf26-b62b-4423-bd98-0b3daf3ff809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2553505309},{"type":"v1","addr":"172.21.15.118:6809","nonce":2553505309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2553505309},{"type":"v1","addr":"172.21.15.118:6811","nonce":2553505309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2553505309},{"type":"v1","addr":"172.21.15.118:6815","nonce":2553505309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2553505309},{"type":"v1","addr":"172.21.15.118:6813","nonce":2553505309}]},"public_addr":"172.21.15.118:6809/2553505309","cluster_addr":"172.21.15.118:6811/2553505309","heartbeat_back_addr":"172.21.15.118:6815/2553505309","heartbeat_front_addr":"172.21.15.118:6813/2553505309","state":["exists","up"]},{"osd":7,"uuid":"7fdbee68-c48f-4c02-8074-f7a5d8d62cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1082138742},{"type":"v1","addr":"172.21.15.118:6827","nonce":1082138742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1082138742},{"type":"v1","addr":"172.21.15.118:6829","nonce":1082138742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1082138742},{"type":"v1","addr":"172.21.15.118:6833","nonce":1082138742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1082138742},{"type":"v1","addr":"172.21.15.118:6831","nonce":1082138742}]},"public_addr":"172.21.15.118:6827/1082138742","cluster_addr":"172.21.15.118:6829/1082138742","heartbeat_back_addr":"172.21.15.118:6833/1082138742","heartbeat_front_addr":"172.21.15.118:6831/1082138742","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.565488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.305425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.771505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.626204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.828150+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.101749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.333748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:22.339822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:46:31.004 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-14T10:46:31.004 INFO:tasks.ceph:Creating RBD pool 2024-09-14T10:46:31.004 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-14T10:46:32.254 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'rbd' created 2024-09-14T10:46:32.271 DEBUG:teuthology.orchestra.run.smithi050:> rbd --cluster ceph pool init rbd 2024-09-14T10:46:32.340 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:32.341 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:35.282 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-14T10:46:35.282 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-14T10:46:35.283 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-14T10:46:35.610 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:46:35.622 INFO:teuthology.orchestra.run.smithi050.stdout:[{"version":9,"timestamp":"2024-09-14T10:46:24.152977+0000","name":"","changes":[{"name":"osd.4/osd_mclock_max_capacity_iops_ssd","new_value":"5983.980406"}]}] 2024-09-14T10:46:35.622 INFO:tasks.ceph_manager:config epoch is 9 2024-09-14T10:46:35.622 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-14T10:46:35.623 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-14T10:46:35.623 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-14T10:46:35.992 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:46:36.003 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3146386534},{"type":"v1","addr":"172.21.15.118:6825","nonce":3146386534}]},"active_addr":"172.21.15.118:6825/3146386534","active_change":"2024-09-14T10:46:17.185858+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":2646435562}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":2881744317}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":1019844494}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":321058789}]}]} 2024-09-14T10:46:36.007 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-14T10:46:36.007 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T10:46:36.008 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T10:46:36.326 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:46:36.326 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":22,"fsid":"b6566dc9-5665-4f7c-861a-3125c3883e3a","created":"2024-09-14T10:46:12.903412+0000","modified":"2024-09-14T10:46:35.267309+0000","last_up_change":"2024-09-14T10:46:24.220378+0000","last_in_change":"2024-09-14T10:46:15.250285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:46:25.206041+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T10:46:31.320712+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1ac493c-919c-4291-ab67-463ffca0664f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":1957449887},{"type":"v1","addr":"172.21.15.50:6817","nonce":1957449887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1957449887},{"type":"v1","addr":"172.21.15.50:6819","nonce":1957449887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1957449887},{"type":"v1","addr":"172.21.15.50:6823","nonce":1957449887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1957449887},{"type":"v1","addr":"172.21.15.50:6821","nonce":1957449887}]},"public_addr":"172.21.15.50:6817/1957449887","cluster_addr":"172.21.15.50:6819/1957449887","heartbeat_back_addr":"172.21.15.50:6823/1957449887","heartbeat_front_addr":"172.21.15.50:6821/1957449887","state":["exists","up"]},{"osd":1,"uuid":"8cfeb747-e219-4d25-a8f5-5019198a7753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2565843969},{"type":"v1","addr":"172.21.15.50:6801","nonce":2565843969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2565843969},{"type":"v1","addr":"172.21.15.50:6803","nonce":2565843969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2565843969},{"type":"v1","addr":"172.21.15.50:6807","nonce":2565843969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2565843969},{"type":"v1","addr":"172.21.15.50:6805","nonce":2565843969}]},"public_addr":"172.21.15.50:6801/2565843969","cluster_addr":"172.21.15.50:6803/2565843969","heartbeat_back_addr":"172.21.15.50:6807/2565843969","heartbeat_front_addr":"172.21.15.50:6805/2565843969","state":["exists","up"]},{"osd":2,"uuid":"cc3e2a8a-a85e-49d1-90c5-d2c75de969c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3787956460},{"type":"v1","addr":"172.21.15.50:6809","nonce":3787956460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3787956460},{"type":"v1","addr":"172.21.15.50:6811","nonce":3787956460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3787956460},{"type":"v1","addr":"172.21.15.50:6815","nonce":3787956460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3787956460},{"type":"v1","addr":"172.21.15.50:6813","nonce":3787956460}]},"public_addr":"172.21.15.50:6809/3787956460","cluster_addr":"172.21.15.50:6811/3787956460","heartbeat_back_addr":"172.21.15.50:6815/3787956460","heartbeat_front_addr":"172.21.15.50:6813/3787956460","state":["exists","up"]},{"osd":3,"uuid":"3d9aa8c6-8083-4e43-9263-d1383d8b7014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":856974303},{"type":"v1","addr":"172.21.15.50:6825","nonce":856974303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":856974303},{"type":"v1","addr":"172.21.15.50:6827","nonce":856974303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":856974303},{"type":"v1","addr":"172.21.15.50:6831","nonce":856974303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":856974303},{"type":"v1","addr":"172.21.15.50:6829","nonce":856974303}]},"public_addr":"172.21.15.50:6825/856974303","cluster_addr":"172.21.15.50:6827/856974303","heartbeat_back_addr":"172.21.15.50:6831/856974303","heartbeat_front_addr":"172.21.15.50:6829/856974303","state":["exists","up"]},{"osd":4,"uuid":"430fa3f7-80b3-4d5e-8b5d-fab67c96b795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4154782182},{"type":"v1","addr":"172.21.15.118:6817","nonce":4154782182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4154782182},{"type":"v1","addr":"172.21.15.118:6819","nonce":4154782182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4154782182},{"type":"v1","addr":"172.21.15.118:6823","nonce":4154782182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4154782182},{"type":"v1","addr":"172.21.15.118:6821","nonce":4154782182}]},"public_addr":"172.21.15.118:6817/4154782182","cluster_addr":"172.21.15.118:6819/4154782182","heartbeat_back_addr":"172.21.15.118:6823/4154782182","heartbeat_front_addr":"172.21.15.118:6821/4154782182","state":["exists","up"]},{"osd":5,"uuid":"622fe333-dbe0-4de8-b564-1b46a13d9a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":287234102},{"type":"v1","addr":"172.21.15.118:6801","nonce":287234102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":287234102},{"type":"v1","addr":"172.21.15.118:6803","nonce":287234102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":287234102},{"type":"v1","addr":"172.21.15.118:6807","nonce":287234102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":287234102},{"type":"v1","addr":"172.21.15.118:6805","nonce":287234102}]},"public_addr":"172.21.15.118:6801/287234102","cluster_addr":"172.21.15.118:6803/287234102","heartbeat_back_addr":"172.21.15.118:6807/287234102","heartbeat_front_addr":"172.21.15.118:6805/287234102","state":["exists","up"]},{"osd":6,"uuid":"0b69cf26-b62b-4423-bd98-0b3daf3ff809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2553505309},{"type":"v1","addr":"172.21.15.118:6809","nonce":2553505309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2553505309},{"type":"v1","addr":"172.21.15.118:6811","nonce":2553505309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2553505309},{"type":"v1","addr":"172.21.15.118:6815","nonce":2553505309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2553505309},{"type":"v1","addr":"172.21.15.118:6813","nonce":2553505309}]},"public_addr":"172.21.15.118:6809/2553505309","cluster_addr":"172.21.15.118:6811/2553505309","heartbeat_back_addr":"172.21.15.118:6815/2553505309","heartbeat_front_addr":"172.21.15.118:6813/2553505309","state":["exists","up"]},{"osd":7,"uuid":"7fdbee68-c48f-4c02-8074-f7a5d8d62cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1082138742},{"type":"v1","addr":"172.21.15.118:6827","nonce":1082138742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1082138742},{"type":"v1","addr":"172.21.15.118:6829","nonce":1082138742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1082138742},{"type":"v1","addr":"172.21.15.118:6833","nonce":1082138742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1082138742},{"type":"v1","addr":"172.21.15.118:6831","nonce":1082138742}]},"public_addr":"172.21.15.118:6827/1082138742","cluster_addr":"172.21.15.118:6829/1082138742","heartbeat_back_addr":"172.21.15.118:6833/1082138742","heartbeat_front_addr":"172.21.15.118:6831/1082138742","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.565488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.305425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.771505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.626204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.828150+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.101749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.333748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:22.339822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:46:36.340 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T10:46:36.340 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T10:46:36.653 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:46:36.654 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":22,"fsid":"b6566dc9-5665-4f7c-861a-3125c3883e3a","created":"2024-09-14T10:46:12.903412+0000","modified":"2024-09-14T10:46:35.267309+0000","last_up_change":"2024-09-14T10:46:24.220378+0000","last_in_change":"2024-09-14T10:46:15.250285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:46:25.206041+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T10:46:31.320712+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1ac493c-919c-4291-ab67-463ffca0664f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":1957449887},{"type":"v1","addr":"172.21.15.50:6817","nonce":1957449887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1957449887},{"type":"v1","addr":"172.21.15.50:6819","nonce":1957449887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1957449887},{"type":"v1","addr":"172.21.15.50:6823","nonce":1957449887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1957449887},{"type":"v1","addr":"172.21.15.50:6821","nonce":1957449887}]},"public_addr":"172.21.15.50:6817/1957449887","cluster_addr":"172.21.15.50:6819/1957449887","heartbeat_back_addr":"172.21.15.50:6823/1957449887","heartbeat_front_addr":"172.21.15.50:6821/1957449887","state":["exists","up"]},{"osd":1,"uuid":"8cfeb747-e219-4d25-a8f5-5019198a7753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2565843969},{"type":"v1","addr":"172.21.15.50:6801","nonce":2565843969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2565843969},{"type":"v1","addr":"172.21.15.50:6803","nonce":2565843969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2565843969},{"type":"v1","addr":"172.21.15.50:6807","nonce":2565843969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2565843969},{"type":"v1","addr":"172.21.15.50:6805","nonce":2565843969}]},"public_addr":"172.21.15.50:6801/2565843969","cluster_addr":"172.21.15.50:6803/2565843969","heartbeat_back_addr":"172.21.15.50:6807/2565843969","heartbeat_front_addr":"172.21.15.50:6805/2565843969","state":["exists","up"]},{"osd":2,"uuid":"cc3e2a8a-a85e-49d1-90c5-d2c75de969c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3787956460},{"type":"v1","addr":"172.21.15.50:6809","nonce":3787956460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3787956460},{"type":"v1","addr":"172.21.15.50:6811","nonce":3787956460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3787956460},{"type":"v1","addr":"172.21.15.50:6815","nonce":3787956460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3787956460},{"type":"v1","addr":"172.21.15.50:6813","nonce":3787956460}]},"public_addr":"172.21.15.50:6809/3787956460","cluster_addr":"172.21.15.50:6811/3787956460","heartbeat_back_addr":"172.21.15.50:6815/3787956460","heartbeat_front_addr":"172.21.15.50:6813/3787956460","state":["exists","up"]},{"osd":3,"uuid":"3d9aa8c6-8083-4e43-9263-d1383d8b7014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":856974303},{"type":"v1","addr":"172.21.15.50:6825","nonce":856974303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":856974303},{"type":"v1","addr":"172.21.15.50:6827","nonce":856974303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":856974303},{"type":"v1","addr":"172.21.15.50:6831","nonce":856974303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":856974303},{"type":"v1","addr":"172.21.15.50:6829","nonce":856974303}]},"public_addr":"172.21.15.50:6825/856974303","cluster_addr":"172.21.15.50:6827/856974303","heartbeat_back_addr":"172.21.15.50:6831/856974303","heartbeat_front_addr":"172.21.15.50:6829/856974303","state":["exists","up"]},{"osd":4,"uuid":"430fa3f7-80b3-4d5e-8b5d-fab67c96b795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4154782182},{"type":"v1","addr":"172.21.15.118:6817","nonce":4154782182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4154782182},{"type":"v1","addr":"172.21.15.118:6819","nonce":4154782182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4154782182},{"type":"v1","addr":"172.21.15.118:6823","nonce":4154782182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4154782182},{"type":"v1","addr":"172.21.15.118:6821","nonce":4154782182}]},"public_addr":"172.21.15.118:6817/4154782182","cluster_addr":"172.21.15.118:6819/4154782182","heartbeat_back_addr":"172.21.15.118:6823/4154782182","heartbeat_front_addr":"172.21.15.118:6821/4154782182","state":["exists","up"]},{"osd":5,"uuid":"622fe333-dbe0-4de8-b564-1b46a13d9a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":287234102},{"type":"v1","addr":"172.21.15.118:6801","nonce":287234102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":287234102},{"type":"v1","addr":"172.21.15.118:6803","nonce":287234102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":287234102},{"type":"v1","addr":"172.21.15.118:6807","nonce":287234102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":287234102},{"type":"v1","addr":"172.21.15.118:6805","nonce":287234102}]},"public_addr":"172.21.15.118:6801/287234102","cluster_addr":"172.21.15.118:6803/287234102","heartbeat_back_addr":"172.21.15.118:6807/287234102","heartbeat_front_addr":"172.21.15.118:6805/287234102","state":["exists","up"]},{"osd":6,"uuid":"0b69cf26-b62b-4423-bd98-0b3daf3ff809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2553505309},{"type":"v1","addr":"172.21.15.118:6809","nonce":2553505309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2553505309},{"type":"v1","addr":"172.21.15.118:6811","nonce":2553505309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2553505309},{"type":"v1","addr":"172.21.15.118:6815","nonce":2553505309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2553505309},{"type":"v1","addr":"172.21.15.118:6813","nonce":2553505309}]},"public_addr":"172.21.15.118:6809/2553505309","cluster_addr":"172.21.15.118:6811/2553505309","heartbeat_back_addr":"172.21.15.118:6815/2553505309","heartbeat_front_addr":"172.21.15.118:6813/2553505309","state":["exists","up"]},{"osd":7,"uuid":"7fdbee68-c48f-4c02-8074-f7a5d8d62cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1082138742},{"type":"v1","addr":"172.21.15.118:6827","nonce":1082138742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1082138742},{"type":"v1","addr":"172.21.15.118:6829","nonce":1082138742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1082138742},{"type":"v1","addr":"172.21.15.118:6833","nonce":1082138742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1082138742},{"type":"v1","addr":"172.21.15.118:6831","nonce":1082138742}]},"public_addr":"172.21.15.118:6827/1082138742","cluster_addr":"172.21.15.118:6829/1082138742","heartbeat_back_addr":"172.21.15.118:6833/1082138742","heartbeat_front_addr":"172.21.15.118:6831/1082138742","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.565488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.305425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.771505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.626204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.828150+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.101749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.333748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:22.339822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:46:36.667 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T10:46:36.667 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T10:46:36.668 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T10:46:36.668 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T10:46:36.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-14T10:46:36.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-14T10:46:36.670 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-14T10:46:36.670 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-14T10:46:36.941 INFO:teuthology.orchestra.run.smithi050.stdout:64424509447 2024-09-14T10:46:36.941 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T10:46:36.950 INFO:teuthology.orchestra.run.smithi050.stdout:64424509446 2024-09-14T10:46:36.951 INFO:teuthology.orchestra.run.smithi050.stdout:64424509446 2024-09-14T10:46:36.951 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T10:46:36.952 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T10:46:36.953 INFO:teuthology.orchestra.run.smithi050.stdout:60129542149 2024-09-14T10:46:36.953 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T10:46:36.954 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2024-09-14T10:46:36.954 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T10:46:36.955 INFO:teuthology.orchestra.run.smithi050.stdout:64424509445 2024-09-14T10:46:36.956 INFO:teuthology.orchestra.run.smithi050.stdout:64424509445 2024-09-14T10:46:36.956 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T10:46:36.957 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T10:46:36.958 INFO:teuthology.orchestra.run.smithi050.stdout:64424509445 2024-09-14T10:46:36.958 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T10:46:37.522 INFO:teuthology.orchestra.run.smithi050.stdout:64424509447 2024-09-14T10:46:37.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.2 2024-09-14T10:46:37.542 DEBUG:teuthology.parallel:result is None 2024-09-14T10:46:37.598 INFO:teuthology.orchestra.run.smithi050.stdout:64424509445 2024-09-14T10:46:37.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.0 2024-09-14T10:46:37.612 DEBUG:teuthology.parallel:result is None 2024-09-14T10:46:37.636 INFO:teuthology.orchestra.run.smithi050.stdout:64424509446 2024-09-14T10:46:37.636 INFO:teuthology.orchestra.run.smithi050.stdout:60129542149 2024-09-14T10:46:37.639 INFO:teuthology.orchestra.run.smithi050.stdout:55834574854 2024-09-14T10:46:37.657 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.7 2024-09-14T10:46:37.658 DEBUG:teuthology.parallel:result is None 2024-09-14T10:46:37.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.6 2024-09-14T10:46:37.660 DEBUG:teuthology.parallel:result is None 2024-09-14T10:46:37.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-09-14T10:46:37.661 DEBUG:teuthology.parallel:result is None 2024-09-14T10:46:37.661 INFO:teuthology.orchestra.run.smithi050.stdout:64424509446 2024-09-14T10:46:37.664 INFO:teuthology.orchestra.run.smithi050.stdout:64424509445 2024-09-14T10:46:37.671 INFO:teuthology.orchestra.run.smithi050.stdout:64424509445 2024-09-14T10:46:37.677 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.4 2024-09-14T10:46:37.678 DEBUG:teuthology.parallel:result is None 2024-09-14T10:46:37.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.3 2024-09-14T10:46:37.681 DEBUG:teuthology.parallel:result is None 2024-09-14T10:46:37.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.1 2024-09-14T10:46:37.685 DEBUG:teuthology.parallel:result is None 2024-09-14T10:46:37.685 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T10:46:37.686 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:46:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:46:38.037 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-14T10:46:38.049 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-14T10:46:37.687898+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":264912,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":261811,"kb_avail":754709808,"statfs":{"total":773094113280,"available":772822843392,"internally_reserved":0,"allocated":2965504,"data_stored":1786134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":268095025},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.494543"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:46:35.277273+0000","last_change":"2024-09-14T10:46:35.277572+0000","last_active":"2024-09-14T10:46:35.277273+0000","last_peered":"2024-09-14T10:46:35.277273+0000","last_clean":"2024-09-14T10:46:35.277273+0000","last_became_active":"2024-09-14T10:46:33.265515+0000","last_became_peered":"2024-09-14T10:46:33.265515+0000","last_unstale":"2024-09-14T10:46:35.277273+0000","last_undegraded":"2024-09-14T10:46:35.277273+0000","last_fullsized":"2024-09-14T10:46:35.277273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:42.848687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061284299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:46:35.332752+0000","last_change":"2024-09-14T10:46:35.333032+0000","last_active":"2024-09-14T10:46:35.332752+0000","last_peered":"2024-09-14T10:46:35.332752+0000","last_clean":"2024-09-14T10:46:35.332752+0000","last_became_active":"2024-09-14T10:46:33.262218+0000","last_became_peered":"2024-09-14T10:46:33.262218+0000","last_unstale":"2024-09-14T10:46:35.332752+0000","last_undegraded":"2024-09-14T10:46:35.332752+0000","last_fullsized":"2024-09-14T10:46:35.332752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:37.487991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072314099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:46:35.277608+0000","last_change":"2024-09-14T10:46:35.277870+0000","last_active":"2024-09-14T10:46:35.277608+0000","last_peered":"2024-09-14T10:46:35.277608+0000","last_clean":"2024-09-14T10:46:35.277608+0000","last_became_active":"2024-09-14T10:46:33.265512+0000","last_became_peered":"2024-09-14T10:46:33.265512+0000","last_unstale":"2024-09-14T10:46:35.277608+0000","last_undegraded":"2024-09-14T10:46:35.277608+0000","last_fullsized":"2024-09-14T10:46:35.277608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:38.583783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088449000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:46:35.332810+0000","last_change":"2024-09-14T10:46:35.333110+0000","last_active":"2024-09-14T10:46:35.332810+0000","last_peered":"2024-09-14T10:46:35.332810+0000","last_clean":"2024-09-14T10:46:35.332810+0000","last_became_active":"2024-09-14T10:46:33.296049+0000","last_became_peered":"2024-09-14T10:46:33.296049+0000","last_unstale":"2024-09-14T10:46:35.332810+0000","last_undegraded":"2024-09-14T10:46:35.332810+0000","last_fullsized":"2024-09-14T10:46:35.332810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:58.526433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000560203,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:46:35.278266+0000","last_change":"2024-09-14T10:46:35.278266+0000","last_active":"2024-09-14T10:46:35.278266+0000","last_peered":"2024-09-14T10:46:35.278266+0000","last_clean":"2024-09-14T10:46:35.278266+0000","last_became_active":"2024-09-14T10:46:33.296172+0000","last_became_peered":"2024-09-14T10:46:33.296172+0000","last_unstale":"2024-09-14T10:46:35.278266+0000","last_undegraded":"2024-09-14T10:46:35.278266+0000","last_fullsized":"2024-09-14T10:46:35.278266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:36.394821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00125464,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:46:35.332655+0000","last_change":"2024-09-14T10:46:35.332938+0000","last_active":"2024-09-14T10:46:35.332655+0000","last_peered":"2024-09-14T10:46:35.332655+0000","last_clean":"2024-09-14T10:46:35.332655+0000","last_became_active":"2024-09-14T10:46:33.265185+0000","last_became_peered":"2024-09-14T10:46:33.265185+0000","last_unstale":"2024-09-14T10:46:35.332655+0000","last_undegraded":"2024-09-14T10:46:35.332655+0000","last_fullsized":"2024-09-14T10:46:35.332655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:20.170242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000550246,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:46:35.277306+0000","last_change":"2024-09-14T10:46:35.277550+0000","last_active":"2024-09-14T10:46:35.277306+0000","last_peered":"2024-09-14T10:46:35.277306+0000","last_clean":"2024-09-14T10:46:35.277306+0000","last_became_active":"2024-09-14T10:46:33.265619+0000","last_became_peered":"2024-09-14T10:46:33.265619+0000","last_unstale":"2024-09-14T10:46:35.277306+0000","last_undegraded":"2024-09-14T10:46:35.277306+0000","last_fullsized":"2024-09-14T10:46:35.277306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:56.062295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058478399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:46:35.277662+0000","last_change":"2024-09-14T10:46:35.277926+0000","last_active":"2024-09-14T10:46:35.277662+0000","last_peered":"2024-09-14T10:46:35.277662+0000","last_clean":"2024-09-14T10:46:35.277662+0000","last_became_active":"2024-09-14T10:46:33.413305+0000","last_became_peered":"2024-09-14T10:46:33.413305+0000","last_unstale":"2024-09-14T10:46:35.277662+0000","last_undegraded":"2024-09-14T10:46:35.277662+0000","last_fullsized":"2024-09-14T10:46:35.277662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:13.605387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092058099999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:46:35.273579+0000","last_change":"2024-09-14T10:46:26.241804+0000","last_active":"2024-09-14T10:46:35.273579+0000","last_peered":"2024-09-14T10:46:35.273579+0000","last_clean":"2024-09-14T10:46:35.273579+0000","last_became_active":"2024-09-14T10:46:26.241454+0000","last_became_peered":"2024-09-14T10:46:26.241454+0000","last_unstale":"2024-09-14T10:46:35.273579+0000","last_undegraded":"2024-09-14T10:46:35.273579+0000","last_fullsized":"2024-09-14T10:46:35.273579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:25.229371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:25.229371+0000","last_clean_scrub_stamp":"2024-09-14T10:46:25.229371+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:49.754841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":221184,"data_stored":75670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":221184,"data_stored":75670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":225280,"data_stored":75689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":75670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":815104,"data_stored":666038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":75670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35580,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336260,"statfs":{"total":96636764160,"available":96600330240,"internally_reserved":0,"allocated":225280,"data_stored":75689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36152,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335688,"statfs":{"total":96636764160,"available":96599744512,"internally_reserved":0,"allocated":815104,"data_stored":666038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:46:38.050 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:46:38.366 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:46:38.367 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-14T10:46:38.379 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-14T10:46:37.687898+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":264912,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":261811,"kb_avail":754709808,"statfs":{"total":773094113280,"available":772822843392,"internally_reserved":0,"allocated":2965504,"data_stored":1786134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":268095025},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.494543"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:46:35.277273+0000","last_change":"2024-09-14T10:46:35.277572+0000","last_active":"2024-09-14T10:46:35.277273+0000","last_peered":"2024-09-14T10:46:35.277273+0000","last_clean":"2024-09-14T10:46:35.277273+0000","last_became_active":"2024-09-14T10:46:33.265515+0000","last_became_peered":"2024-09-14T10:46:33.265515+0000","last_unstale":"2024-09-14T10:46:35.277273+0000","last_undegraded":"2024-09-14T10:46:35.277273+0000","last_fullsized":"2024-09-14T10:46:35.277273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:42.848687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061284299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:46:35.332752+0000","last_change":"2024-09-14T10:46:35.333032+0000","last_active":"2024-09-14T10:46:35.332752+0000","last_peered":"2024-09-14T10:46:35.332752+0000","last_clean":"2024-09-14T10:46:35.332752+0000","last_became_active":"2024-09-14T10:46:33.262218+0000","last_became_peered":"2024-09-14T10:46:33.262218+0000","last_unstale":"2024-09-14T10:46:35.332752+0000","last_undegraded":"2024-09-14T10:46:35.332752+0000","last_fullsized":"2024-09-14T10:46:35.332752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:37.487991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072314099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:46:35.277608+0000","last_change":"2024-09-14T10:46:35.277870+0000","last_active":"2024-09-14T10:46:35.277608+0000","last_peered":"2024-09-14T10:46:35.277608+0000","last_clean":"2024-09-14T10:46:35.277608+0000","last_became_active":"2024-09-14T10:46:33.265512+0000","last_became_peered":"2024-09-14T10:46:33.265512+0000","last_unstale":"2024-09-14T10:46:35.277608+0000","last_undegraded":"2024-09-14T10:46:35.277608+0000","last_fullsized":"2024-09-14T10:46:35.277608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:38.583783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088449000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:46:35.332810+0000","last_change":"2024-09-14T10:46:35.333110+0000","last_active":"2024-09-14T10:46:35.332810+0000","last_peered":"2024-09-14T10:46:35.332810+0000","last_clean":"2024-09-14T10:46:35.332810+0000","last_became_active":"2024-09-14T10:46:33.296049+0000","last_became_peered":"2024-09-14T10:46:33.296049+0000","last_unstale":"2024-09-14T10:46:35.332810+0000","last_undegraded":"2024-09-14T10:46:35.332810+0000","last_fullsized":"2024-09-14T10:46:35.332810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:58.526433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000560203,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:46:35.278266+0000","last_change":"2024-09-14T10:46:35.278266+0000","last_active":"2024-09-14T10:46:35.278266+0000","last_peered":"2024-09-14T10:46:35.278266+0000","last_clean":"2024-09-14T10:46:35.278266+0000","last_became_active":"2024-09-14T10:46:33.296172+0000","last_became_peered":"2024-09-14T10:46:33.296172+0000","last_unstale":"2024-09-14T10:46:35.278266+0000","last_undegraded":"2024-09-14T10:46:35.278266+0000","last_fullsized":"2024-09-14T10:46:35.278266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:36.394821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00125464,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:46:35.332655+0000","last_change":"2024-09-14T10:46:35.332938+0000","last_active":"2024-09-14T10:46:35.332655+0000","last_peered":"2024-09-14T10:46:35.332655+0000","last_clean":"2024-09-14T10:46:35.332655+0000","last_became_active":"2024-09-14T10:46:33.265185+0000","last_became_peered":"2024-09-14T10:46:33.265185+0000","last_unstale":"2024-09-14T10:46:35.332655+0000","last_undegraded":"2024-09-14T10:46:35.332655+0000","last_fullsized":"2024-09-14T10:46:35.332655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:20.170242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000550246,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:46:35.277306+0000","last_change":"2024-09-14T10:46:35.277550+0000","last_active":"2024-09-14T10:46:35.277306+0000","last_peered":"2024-09-14T10:46:35.277306+0000","last_clean":"2024-09-14T10:46:35.277306+0000","last_became_active":"2024-09-14T10:46:33.265619+0000","last_became_peered":"2024-09-14T10:46:33.265619+0000","last_unstale":"2024-09-14T10:46:35.277306+0000","last_undegraded":"2024-09-14T10:46:35.277306+0000","last_fullsized":"2024-09-14T10:46:35.277306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:56.062295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058478399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:46:35.277662+0000","last_change":"2024-09-14T10:46:35.277926+0000","last_active":"2024-09-14T10:46:35.277662+0000","last_peered":"2024-09-14T10:46:35.277662+0000","last_clean":"2024-09-14T10:46:35.277662+0000","last_became_active":"2024-09-14T10:46:33.413305+0000","last_became_peered":"2024-09-14T10:46:33.413305+0000","last_unstale":"2024-09-14T10:46:35.277662+0000","last_undegraded":"2024-09-14T10:46:35.277662+0000","last_fullsized":"2024-09-14T10:46:35.277662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:13.605387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092058099999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:46:35.273579+0000","last_change":"2024-09-14T10:46:26.241804+0000","last_active":"2024-09-14T10:46:35.273579+0000","last_peered":"2024-09-14T10:46:35.273579+0000","last_clean":"2024-09-14T10:46:35.273579+0000","last_became_active":"2024-09-14T10:46:26.241454+0000","last_became_peered":"2024-09-14T10:46:26.241454+0000","last_unstale":"2024-09-14T10:46:35.273579+0000","last_undegraded":"2024-09-14T10:46:35.273579+0000","last_fullsized":"2024-09-14T10:46:35.273579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:25.229371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:25.229371+0000","last_clean_scrub_stamp":"2024-09-14T10:46:25.229371+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:49.754841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":221184,"data_stored":75670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":221184,"data_stored":75670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":225280,"data_stored":75689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":75670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":815104,"data_stored":666038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":75670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35580,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336260,"statfs":{"total":96636764160,"available":96600330240,"internally_reserved":0,"allocated":225280,"data_stored":75689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36152,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335688,"statfs":{"total":96636764160,"available":96599744512,"internally_reserved":0,"allocated":815104,"data_stored":666038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:46:38.380 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T10:46:38.380 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-14T10:46:38.380 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-14T10:46:38.380 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-14T10:46:38.728 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T10:46:38.728 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-14T10:46:38.741 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-14T10:46:38.741 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-14T10:46:38.753 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-09-14T10:46:38.754 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-14T10:46:38.783 DEBUG:teuthology.orchestra.run.smithi050:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-09-14T10:46:38.956 INFO:teuthology.orchestra.run.smithi050.stderr:...........+......+...+....+...+..+......+.+...+...+...+.....+......+......+.......+......+.....+.+...+........+............+.+..............+..........+...+++++++++++++++++++++++++++++++++++++++++++++*........+.+......+..+.+......+......+.....+...+......+.+.....+.........+.+++++++++++++++++++++++++++++++++++++++++++++*........+.........+..+..........+.........+...........+............+.......+.....+....+......+.....+............................+........+............+.+...............+++++ 2024-09-14T10:46:39.128 INFO:teuthology.orchestra.run.smithi050.stderr:..........+....+..+.+.........+...+........+.......+..+..................+.............+++++++++++++++++++++++++++++++++++++++++++++*.......+.........+...+....+++++++++++++++++++++++++++++++++++++++++++++*..................+..........+.....+.......+........................+..+.........+...+..........+..+....+............+.........+........+......+............+....+...+..+..................+.............+..+.............+..............+..........+..................+........+...+....+.....+......+...............+.......+............+.....................+..+.......+..+....+.........+......+.....+...............+.+.....+...+.+..+...............+.......+..+++++ 2024-09-14T10:46:39.153 INFO:teuthology.orchestra.run.smithi050.stderr:----- 2024-09-14T10:46:39.162 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2024-09-14T10:46:39.220 DEBUG:teuthology.orchestra.run.smithi050:> sudo update-ca-trust 2024-09-14T10:46:40.306 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-14T10:46:40.336 DEBUG:teuthology.orchestra.run.smithi050:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi050.front.sepia.ceph.com 2024-09-14T10:46:40.444 INFO:teuthology.orchestra.run.smithi050.stderr:..+.+...+..+.............+......+..+.......+..+.+..............+....+..+.......+.....+.+.....+......+................+.....+...+.......+.........+......+.....+++++++++++++++++++++++++++++++++++++++*......+..+.+..+............+.+.........+.....+...+...+.+........+++++++++++++++++++++++++++++++++++++++*.......+....+...+..+......+...+....+..+...+..........+......+..+.......+...+..+.+......+...+..+....+.....+......+......+.........+.+............++++++ 2024-09-14T10:46:40.444 INFO:teuthology.orchestra.run.smithi050.stderr:....+.+++++++++++++++++++++++++++++++++++++++*.+..+....+......+........+++++++++++++++++++++++++++++++++++++++*.....+.+.....+.+..............+.+...+.....+.+.....+.......+.....+..........+..+...+.......+......+..+...+....+..+.+.........+.....+.........+....+......+.....+....+.....+............+.+.....+...................+...+..+......++++++ 2024-09-14T10:46:40.444 INFO:teuthology.orchestra.run.smithi050.stderr:----- 2024-09-14T10:46:40.444 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:46:40.444 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-14T10:46:40.513 DEBUG:teuthology.orchestra.run.smithi050:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-14T10:46:40.592 INFO:teuthology.orchestra.run.smithi050.stderr:Certificate request self-signature ok 2024-09-14T10:46:40.592 INFO:teuthology.orchestra.run.smithi050.stderr:subject=CN=smithi050.front.sepia.ceph.com 2024-09-14T10:46:40.602 DEBUG:teuthology.orchestra.run.smithi050:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-14T10:46:40.672 DEBUG:teuthology.orchestra.run.smithi050:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-14T10:46:40.743 INFO:teuthology.orchestra.run.smithi050.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-09-14T10:46:40.744 DEBUG:teuthology.orchestra.run.smithi050:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-14T10:46:40.813 INFO:teuthology.run_tasks:Running task rgw... 2024-09-14T10:46:40.839 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-09-14T10:46:40.839 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-14T10:46:40.839 INFO:tasks.rgw:Creating data pools 2024-09-14T10:46:40.840 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-14T10:46:40.840 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-09-14T10:46:41.303 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-14T10:46:43.292 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'default.rgw.buckets.data' created 2024-09-14T10:46:43.325 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-14T10:46:44.294 INFO:teuthology.orchestra.run.smithi050.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-14T10:46:44.342 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-14T10:46:45.318 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'default.rgw.buckets.index' created 2024-09-14T10:46:45.342 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-14T10:46:46.319 INFO:teuthology.orchestra.run.smithi050.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-14T10:46:46.357 DEBUG:tasks.rgw:Pools created 2024-09-14T10:46:46.357 INFO:tasks.rgw:Configuring compression type = random 2024-09-14T10:46:46.358 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T10:46:46.358 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T10:46:46.358 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T10:46:46.465 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:46.465 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:48.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.383+0000 7ff929153640 0 -- 172.21.15.50:0/41300030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556891b38ce0 msgr2=0x556891b3f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:46:48.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.388+0000 7ff92a155640 0 -- 172.21.15.50:0/4168657915 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x556891b3c590 msgr2=0x556891a17de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:46:48.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.392+0000 7ff92be63800 20 rados->read ofs=0 len=0 2024-09-14T10:46:48.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.395+0000 7ff92be63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:48.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.395+0000 7ff92be63800 20 realm 2024-09-14T10:46:48.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.395+0000 7ff92be63800 20 rados->read ofs=0 len=0 2024-09-14T10:46:48.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.395+0000 7ff92be63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:48.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.395+0000 7ff92be63800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:46:48.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.395+0000 7ff92be63800 20 rados->read ofs=0 len=0 2024-09-14T10:46:48.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.395+0000 7ff92be63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:48.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.395+0000 7ff92be63800 20 rados->read ofs=0 len=0 2024-09-14T10:46:48.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.396+0000 7ff92be63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:48.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.396+0000 7ff92be63800 20 rados->read ofs=0 len=0 2024-09-14T10:46:48.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.397+0000 7ff92be63800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:46:48.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.397+0000 7ff92be63800 20 searching for the correct realm 2024-09-14T10:46:48.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.409+0000 7ff92be63800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:46:48.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.409+0000 7ff92be63800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:46:48.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.409+0000 7ff92be63800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:46:48.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.409+0000 7ff92be63800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:46:48.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.409+0000 7ff92be63800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:46:48.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.409+0000 7ff92be63800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:46:48.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.409+0000 7ff92be63800 20 rados->read ofs=0 len=0 2024-09-14T10:46:48.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.409+0000 7ff92be63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:48.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.409+0000 7ff92be63800 20 rados->read ofs=0 len=0 2024-09-14T10:46:48.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.410+0000 7ff92be63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:48.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.410+0000 7ff92be63800 20 rados->read ofs=0 len=0 2024-09-14T10:46:48.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.410+0000 7ff92be63800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:46:48.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.410+0000 7ff92be63800 20 zone default found 2024-09-14T10:46:48.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.410+0000 7ff92be63800 4 Realm: () 2024-09-14T10:46:48.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.410+0000 7ff92be63800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:46:48.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.410+0000 7ff92be63800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:46:48.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.410+0000 7ff92be63800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:46:48.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.410+0000 7ff92be63800 20 zonegroup default 2024-09-14T10:46:48.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.410+0000 7ff92be63800 20 rados->read ofs=0 len=0 2024-09-14T10:46:48.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.410+0000 7ff92be63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:48.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:48.410+0000 7ff92be63800 20 rados->read ofs=0 len=0 2024-09-14T10:46:50.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:50.366+0000 7ff92be63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:50.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:50.366+0000 7ff92be63800 20 rados->read ofs=0 len=0 2024-09-14T10:46:50.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:50.367+0000 7ff92be63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:50.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:50.367+0000 7ff92be63800 20 started sync module instance, tier type = 2024-09-14T10:46:50.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:50.367+0000 7ff92be63800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:46:52.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.383+0000 7ff92be63800 20 add_watcher() i=0 2024-09-14T10:46:52.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.383+0000 7ff92be63800 20 add_watcher() i=1 2024-09-14T10:46:52.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.383+0000 7ff92be63800 20 add_watcher() i=2 2024-09-14T10:46:52.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.383+0000 7ff92be63800 20 add_watcher() i=3 2024-09-14T10:46:52.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.383+0000 7ff92be63800 20 add_watcher() i=4 2024-09-14T10:46:52.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.383+0000 7ff92be63800 20 add_watcher() i=5 2024-09-14T10:46:52.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.384+0000 7ff92be63800 20 add_watcher() i=6 2024-09-14T10:46:52.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.385+0000 7ff92be63800 20 add_watcher() i=7 2024-09-14T10:46:52.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.385+0000 7ff92be63800 2 all 8 watchers are set, enabling cache 2024-09-14T10:46:52.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.385+0000 7ff92be63800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-14T10:46:52.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.385+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-14T10:46:52.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.385+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.385+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-14T10:46:52.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.385+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-14T10:46:52.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.385+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.386+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-14T10:46:52.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.386+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-14T10:46:52.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.386+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.386+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-14T10:46:52.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.386+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-14T10:46:52.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.386+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.386+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-14T10:46:52.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.386+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-14T10:46:52.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.386+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.387+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-14T10:46:52.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.387+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-14T10:46:52.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.387+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.387+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-14T10:46:52.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.387+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-14T10:46:52.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.387+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.387+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-14T10:46:52.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.387+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-14T10:46:52.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.387+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.387+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-14T10:46:52.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.387+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-14T10:46:52.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.387+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.388+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-14T10:46:52.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.388+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-14T10:46:52.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.388+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.388+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-14T10:46:52.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.388+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-14T10:46:52.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.388+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.388+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-14T10:46:52.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.388+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-14T10:46:52.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.388+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.388+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-14T10:46:52.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.388+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-14T10:46:52.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.388+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.389+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-14T10:46:52.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.389+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-14T10:46:52.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.389+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.389+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-14T10:46:52.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.389+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-14T10:46:52.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.389+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.389+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-14T10:46:52.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.389+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-14T10:46:52.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.389+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.389+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-14T10:46:52.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.390+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-14T10:46:52.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.390+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.390+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-14T10:46:52.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.390+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-14T10:46:52.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.390+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.390+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-14T10:46:52.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.390+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-14T10:46:52.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.390+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.390+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-14T10:46:52.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.390+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-14T10:46:52.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.390+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.391+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-14T10:46:52.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.391+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-14T10:46:52.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.391+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.391+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-14T10:46:52.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.391+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-14T10:46:52.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.391+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.391+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-14T10:46:52.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.391+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-14T10:46:52.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.391+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.391+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-14T10:46:52.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.391+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-14T10:46:52.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.391+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.391+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-14T10:46:52.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.391+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-14T10:46:52.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.391+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.392+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-14T10:46:52.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.392+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-14T10:46:52.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.392+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.392+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-14T10:46:52.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.392+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-14T10:46:52.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.392+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.392+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-14T10:46:52.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.392+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-14T10:46:52.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.392+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.392+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-14T10:46:52.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.392+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-14T10:46:52.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.392+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.393+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-14T10:46:52.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.393+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-14T10:46:52.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.393+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.393+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-14T10:46:52.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.393+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-14T10:46:52.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.393+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.393+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-14T10:46:52.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.393+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-14T10:46:52.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.393+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.394+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-14T10:46:52.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.394+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-14T10:46:52.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.394+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.394+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-14T10:46:52.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.394+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-14T10:46:52.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.394+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.394+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-14T10:46:52.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.394+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-14T10:46:52.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.394+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.394+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-14T10:46:52.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.394+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-14T10:46:52.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.394+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.395+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-14T10:46:52.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.395+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-14T10:46:52.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.395+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.395+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-14T10:46:52.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.395+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-14T10:46:52.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.395+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.395+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-14T10:46:52.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.395+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-14T10:46:52.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.395+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.396+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-14T10:46:52.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.396+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-14T10:46:52.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.396+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.396+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-14T10:46:52.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.396+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-14T10:46:52.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.396+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.396+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-14T10:46:52.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.396+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-14T10:46:52.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.396+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.396+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-14T10:46:52.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.396+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-14T10:46:52.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.396+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.397+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-14T10:46:52.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.397+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-14T10:46:52.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.397+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.398+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-14T10:46:52.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.398+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-14T10:46:52.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.398+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.398+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-14T10:46:52.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.398+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-14T10:46:52.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.398+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.398+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-14T10:46:52.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.398+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-14T10:46:52.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.398+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.398+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-14T10:46:52.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.398+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-14T10:46:52.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.399+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.399+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-14T10:46:52.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.399+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-14T10:46:52.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.399+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.399+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-14T10:46:52.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.399+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-14T10:46:52.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.399+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.399+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-14T10:46:52.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.399+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-14T10:46:52.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.399+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.399+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-14T10:46:52.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.399+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-14T10:46:52.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.399+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.400+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-14T10:46:52.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.400+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-14T10:46:52.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.400+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.400+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-14T10:46:52.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.400+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-14T10:46:52.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.400+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.400+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-14T10:46:52.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.400+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-14T10:46:52.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.400+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.400+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-14T10:46:52.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.400+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-14T10:46:52.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.400+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.401+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-14T10:46:52.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.401+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-14T10:46:52.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.401+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.401+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-14T10:46:52.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.401+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-14T10:46:52.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.401+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.401+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-14T10:46:52.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.401+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-14T10:46:52.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.401+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.402+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-14T10:46:52.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.402+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-14T10:46:52.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.402+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.402+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-14T10:46:52.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.402+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-14T10:46:52.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.402+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.402+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-14T10:46:52.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.402+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-14T10:46:52.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.402+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.402+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-14T10:46:52.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.402+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-14T10:46:52.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.402+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.403+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-14T10:46:52.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.403+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-14T10:46:52.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.403+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.403+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-14T10:46:52.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.403+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-14T10:46:52.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.403+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.403+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-14T10:46:52.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.403+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-14T10:46:52.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.403+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.403+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-14T10:46:52.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.403+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-14T10:46:52.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.403+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.404+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-14T10:46:52.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.404+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-14T10:46:52.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.404+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.404+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-14T10:46:52.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.404+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-14T10:46:52.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.404+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.404+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-14T10:46:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.404+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-14T10:46:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.404+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.404+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-14T10:46:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.404+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-14T10:46:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.404+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.405+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-14T10:46:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.405+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-14T10:46:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.405+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.405+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-14T10:46:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.405+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-14T10:46:52.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.405+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.405+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-14T10:46:52.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.405+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-14T10:46:52.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.405+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.406+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-14T10:46:52.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.406+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-14T10:46:52.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.406+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.406+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-14T10:46:52.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.406+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-14T10:46:52.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.406+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.406+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-14T10:46:52.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.406+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-14T10:46:52.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.406+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.406+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-14T10:46:52.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.406+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-14T10:46:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.406+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.407+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-14T10:46:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.407+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-14T10:46:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.407+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.407+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-14T10:46:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.407+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-14T10:46:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.407+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.407+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-14T10:46:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.407+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-14T10:46:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.407+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.407+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-14T10:46:52.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.407+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-14T10:46:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.407+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.408+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-14T10:46:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.408+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-14T10:46:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.408+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.408+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-14T10:46:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.408+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-14T10:46:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.408+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.408+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-14T10:46:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.408+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-14T10:46:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.408+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.409+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-14T10:46:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.409+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-14T10:46:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.409+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.409+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-14T10:46:52.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.409+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-14T10:46:52.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.409+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.409+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-14T10:46:52.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.409+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-14T10:46:52.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.409+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.410+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-14T10:46:52.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.410+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-14T10:46:52.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.410+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.410+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-14T10:46:52.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.410+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-14T10:46:52.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.410+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.410+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-14T10:46:52.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.410+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-14T10:46:52.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.410+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.410+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-14T10:46:52.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.410+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-14T10:46:52.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.410+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.411+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-14T10:46:52.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.411+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-14T10:46:52.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.411+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.411+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-14T10:46:52.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.411+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-14T10:46:52.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.411+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.411+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-14T10:46:52.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.411+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-14T10:46:52.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.411+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.412+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-14T10:46:52.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.412+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-14T10:46:52.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.412+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.412+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-14T10:46:52.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.412+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-14T10:46:52.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.412+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.412+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-14T10:46:52.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.412+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-14T10:46:52.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.412+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.412+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-14T10:46:52.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.412+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-14T10:46:52.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.412+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.413+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-14T10:46:52.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.413+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-14T10:46:52.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.413+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.413+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-14T10:46:52.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.413+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-14T10:46:52.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.413+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.413+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-14T10:46:52.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.413+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-14T10:46:52.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.413+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.414+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-14T10:46:52.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.414+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-14T10:46:52.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.414+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.414+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-14T10:46:52.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.414+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-14T10:46:52.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.414+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.414+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-14T10:46:52.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.414+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-14T10:46:52.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.414+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.414+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-14T10:46:52.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.414+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-14T10:46:52.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.414+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.415+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-14T10:46:52.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.415+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-14T10:46:52.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.415+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.415+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-14T10:46:52.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.415+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-14T10:46:52.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.415+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.415+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-14T10:46:52.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.415+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-14T10:46:52.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.415+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.415+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-14T10:46:52.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.415+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-14T10:46:52.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.415+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.416+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-14T10:46:52.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.416+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-14T10:46:52.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.416+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.416+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-14T10:46:52.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.416+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-14T10:46:52.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.416+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.416+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-14T10:46:52.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.416+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-14T10:46:52.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.416+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.416+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-14T10:46:52.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.416+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-14T10:46:52.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.416+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.417+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-14T10:46:52.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.417+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-14T10:46:52.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.417+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.417+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-14T10:46:52.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.417+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-14T10:46:52.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.417+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.417+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-14T10:46:52.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.417+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-14T10:46:52.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.417+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.417+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-14T10:46:52.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.417+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-14T10:46:52.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.417+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.418+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-14T10:46:52.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.418+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-14T10:46:52.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.418+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.418+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-14T10:46:52.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.418+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-14T10:46:52.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.418+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.418+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-14T10:46:52.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.418+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-14T10:46:52.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.418+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.419+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-14T10:46:52.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.419+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-14T10:46:52.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.419+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.419+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-14T10:46:52.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.419+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-14T10:46:52.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.419+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.419+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-14T10:46:52.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.419+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-14T10:46:52.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.419+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.419+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-14T10:46:52.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.419+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-14T10:46:52.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.419+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.420+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-14T10:46:52.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.420+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-14T10:46:52.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.420+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.420+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-14T10:46:52.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.420+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-14T10:46:52.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.420+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.420+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-14T10:46:52.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.420+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-14T10:46:52.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.420+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.420+0000 7ff92be63800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-14T10:46:52.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.420+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-14T10:46:52.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.422+0000 7ff92be63800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:46:52.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.425+0000 7ff7d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:52.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.425+0000 7ff92be63800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:52.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:52.425+0000 7ff92be63800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:55.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.372+0000 7ff92be63800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-14T10:46:55.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.372+0000 7ff92be63800 5 note: GC not initialized 2024-09-14T10:46:55.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.373+0000 7ff92be63800 20 init_complete bucket index max shards: 11 2024-09-14T10:46:55.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.373+0000 7ff92be63800 20 Filter name: none 2024-09-14T10:46:55.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.373+0000 7ff73bfff640 20 reqs_thread_entry: start 2024-09-14T10:46:55.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.373+0000 7ff7d27fc640 20 reqs_thread_entry: start 2024-09-14T10:46:55.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.400+0000 7ff7d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:55.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.403+0000 7ff92be63800 20 remove_watcher() i=0 2024-09-14T10:46:55.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.403+0000 7ff92be63800 2 removed watcher, disabling cache 2024-09-14T10:46:55.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.405+0000 7ff92be63800 20 remove_watcher() i=1 2024-09-14T10:46:55.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.406+0000 7ff92be63800 20 remove_watcher() i=2 2024-09-14T10:46:55.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.407+0000 7ff92be63800 20 remove_watcher() i=3 2024-09-14T10:46:55.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.408+0000 7ff92be63800 20 remove_watcher() i=4 2024-09-14T10:46:55.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.409+0000 7ff92be63800 20 remove_watcher() i=5 2024-09-14T10:46:55.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.411+0000 7ff92be63800 20 remove_watcher() i=6 2024-09-14T10:46:55.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.412+0000 7ff92be63800 20 remove_watcher() i=7 2024-09-14T10:46:55.436 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-14T10:46:55.437 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T10:46:55.437 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T10:46:55.437 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T10:46:55.437 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-14T10:46:55.505 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:55.505 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:55.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.534+0000 7f7ce6746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:55.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.534+0000 7f7ce6746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:55.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.539+0000 7f7b5a7fc640 20 reqs_thread_entry: start 2024-09-14T10:46:55.553 INFO:teuthology.orchestra.run.smithi050.stdout:{"id":"c28b75ff-2576-4ab1-a211-5d2fca133105","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T10:46:55.554 DEBUG:tasks.util.rgw: json result: {'id': 'c28b75ff-2576-4ab1-a211-5d2fca133105', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T10:46:55.554 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T10:46:55.554 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T10:46:55.554 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T10:46:55.611 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:55.611 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:55.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.649+0000 7f41bec0f800 20 rados->read ofs=0 len=0 2024-09-14T10:46:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.651+0000 7f41bec0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.651+0000 7f41bec0f800 20 realm 2024-09-14T10:46:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.651+0000 7f41bec0f800 20 rados->read ofs=0 len=0 2024-09-14T10:46:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.651+0000 7f41bec0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.651+0000 7f41bec0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:46:55.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.651+0000 7f41bec0f800 20 rados->read ofs=0 len=0 2024-09-14T10:46:55.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.651+0000 7f41bec0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:55.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.651+0000 7f41bec0f800 20 rados->read ofs=0 len=0 2024-09-14T10:46:55.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.652+0000 7f41bec0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:55.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.652+0000 7f41bec0f800 20 rados->read ofs=0 len=0 2024-09-14T10:46:55.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.653+0000 7f41bec0f800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-14T10:46:55.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.653+0000 7f41bec0f800 20 searching for the correct realm 2024-09-14T10:46:55.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.654+0000 7f41ba348640 0 -- 172.21.15.50:0/4188808210 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x7f41a4003bd0 msgr2=0x7f41b40333f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:46:55.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.859+0000 7f41bab49640 0 -- 172.21.15.50:0/4188808210 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x7f4084084a00 msgr2=0x7f4084086e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:46:55.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.866+0000 7f41bec0f800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:46:55.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.866+0000 7f41bec0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:46:55.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.866+0000 7f41bec0f800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:46:55.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.866+0000 7f41bec0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:46:55.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.866+0000 7f41bec0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:46:55.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.866+0000 7f41bec0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:46:55.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.866+0000 7f41bec0f800 20 rados->read ofs=0 len=0 2024-09-14T10:46:55.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.866+0000 7f41bec0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:55.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.866+0000 7f41bec0f800 20 rados->read ofs=0 len=0 2024-09-14T10:46:55.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.866+0000 7f41bec0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:55.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.866+0000 7f41bec0f800 20 rados->read ofs=0 len=0 2024-09-14T10:46:55.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.867+0000 7f41bec0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:46:55.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.867+0000 7f41bec0f800 20 zone default found 2024-09-14T10:46:55.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.867+0000 7f41bec0f800 4 Realm: () 2024-09-14T10:46:55.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.867+0000 7f41bec0f800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:46:55.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.867+0000 7f41bec0f800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:46:55.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.867+0000 7f41bec0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:46:55.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.867+0000 7f41bec0f800 20 zonegroup default 2024-09-14T10:46:55.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.867+0000 7f41bec0f800 20 rados->read ofs=0 len=0 2024-09-14T10:46:55.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.867+0000 7f41bec0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:55.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.867+0000 7f41bec0f800 20 rados->read ofs=0 len=0 2024-09-14T10:46:55.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.867+0000 7f41bec0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:55.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.867+0000 7f41bec0f800 20 rados->read ofs=0 len=0 2024-09-14T10:46:55.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.868+0000 7f41bec0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:55.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.868+0000 7f41bec0f800 20 started sync module instance, tier type = 2024-09-14T10:46:55.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.868+0000 7f41bec0f800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:46:55.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.878+0000 7f41bec0f800 20 add_watcher() i=0 2024-09-14T10:46:55.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.878+0000 7f41bec0f800 20 add_watcher() i=1 2024-09-14T10:46:55.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.878+0000 7f41bec0f800 20 add_watcher() i=2 2024-09-14T10:46:55.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.878+0000 7f41bec0f800 20 add_watcher() i=3 2024-09-14T10:46:55.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.878+0000 7f41bec0f800 20 add_watcher() i=4 2024-09-14T10:46:55.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.878+0000 7f41bec0f800 20 add_watcher() i=5 2024-09-14T10:46:55.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.878+0000 7f41bec0f800 20 add_watcher() i=6 2024-09-14T10:46:55.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.879+0000 7f41bec0f800 20 add_watcher() i=7 2024-09-14T10:46:55.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.879+0000 7f41bec0f800 2 all 8 watchers are set, enabling cache 2024-09-14T10:46:55.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.882+0000 7f4070fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:55.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.882+0000 7f41bec0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:55.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.882+0000 7f41bec0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:55.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.882+0000 7f41bec0f800 5 note: GC not initialized 2024-09-14T10:46:55.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.882+0000 7f3feb7fe640 20 reqs_thread_entry: start 2024-09-14T10:46:55.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.882+0000 7f41bec0f800 20 init_complete bucket index max shards: 11 2024-09-14T10:46:55.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.882+0000 7f41bec0f800 20 Filter name: none 2024-09-14T10:46:55.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.882+0000 7f3fe97fa640 20 reqs_thread_entry: start 2024-09-14T10:46:55.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.893+0000 7f4070fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.895+0000 7f41bec0f800 20 remove_watcher() i=0 2024-09-14T10:46:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.895+0000 7f41bec0f800 2 removed watcher, disabling cache 2024-09-14T10:46:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.896+0000 7f41bec0f800 20 remove_watcher() i=1 2024-09-14T10:46:55.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.897+0000 7f41bec0f800 20 remove_watcher() i=2 2024-09-14T10:46:55.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.898+0000 7f41bec0f800 20 remove_watcher() i=3 2024-09-14T10:46:55.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.899+0000 7f41bec0f800 20 remove_watcher() i=4 2024-09-14T10:46:55.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.901+0000 7f41bec0f800 20 remove_watcher() i=5 2024-09-14T10:46:55.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.902+0000 7f41bec0f800 20 remove_watcher() i=6 2024-09-14T10:46:55.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:55.903+0000 7f41bec0f800 20 remove_watcher() i=7 2024-09-14T10:46:55.913 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-14T10:46:55.914 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T10:46:55.914 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-14T10:46:55.914 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-14T10:46:55.914 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-14T10:46:55.979 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:55.979 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:56.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.007+0000 7fa3a6739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:56.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.007+0000 7fa3a6739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:56.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.011+0000 7fa264fe1640 20 reqs_thread_entry: start 2024-09-14T10:46:56.027 INFO:teuthology.orchestra.run.smithi050.stdout:{"id":"c28b75ff-2576-4ab1-a211-5d2fca133105","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T10:46:56.027 DEBUG:tasks.util.rgw: json result: {'id': 'c28b75ff-2576-4ab1-a211-5d2fca133105', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T10:46:56.027 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2024-09-14T10:46:56.027 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p /tmp/rgw_datacache 2024-09-14T10:46:56.056 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a+rwx /tmp/rgw_datacache 2024-09-14T10:46:56.136 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T10:46:56.136 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T10:46:56.136 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T10:46:56.234 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:56.234 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:56.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.271+0000 7ffada135800 20 rados->read ofs=0 len=0 2024-09-14T10:46:56.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.272+0000 7ffada135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:56.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.272+0000 7ffada135800 20 realm 2024-09-14T10:46:56.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.272+0000 7ffada135800 20 rados->read ofs=0 len=0 2024-09-14T10:46:56.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.273+0000 7ffada135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:56.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.273+0000 7ffada135800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:46:56.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.273+0000 7ffada135800 20 rados->read ofs=0 len=0 2024-09-14T10:46:56.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.273+0000 7ffada135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:56.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.273+0000 7ffada135800 20 rados->read ofs=0 len=0 2024-09-14T10:46:56.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.274+0000 7ffada135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:56.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.274+0000 7ffada135800 20 rados->read ofs=0 len=0 2024-09-14T10:46:56.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.274+0000 7ffada135800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-14T10:46:56.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.274+0000 7ffada135800 20 searching for the correct realm 2024-09-14T10:46:56.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.278+0000 7ffad5620640 0 -- 172.21.15.50:0/2139731948 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7ffad00bb2a0 msgr2=0x7ffad00ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:46:56.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.483+0000 7ffad6622640 0 -- 172.21.15.50:0/2139731948 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x558b58f6a350 msgr2=0x558b58f6c7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:46:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.487+0000 7ffada135800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:46:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.487+0000 7ffada135800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:46:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.487+0000 7ffada135800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:46:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.487+0000 7ffada135800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:46:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.487+0000 7ffada135800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:46:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.487+0000 7ffada135800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:46:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.487+0000 7ffada135800 20 rados->read ofs=0 len=0 2024-09-14T10:46:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.488+0000 7ffada135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.488+0000 7ffada135800 20 rados->read ofs=0 len=0 2024-09-14T10:46:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.488+0000 7ffada135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.488+0000 7ffada135800 20 rados->read ofs=0 len=0 2024-09-14T10:46:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.488+0000 7ffada135800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:46:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.488+0000 7ffada135800 20 zone default found 2024-09-14T10:46:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.488+0000 7ffada135800 4 Realm: () 2024-09-14T10:46:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.488+0000 7ffada135800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:46:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.488+0000 7ffada135800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:46:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.488+0000 7ffada135800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:46:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.488+0000 7ffada135800 20 zonegroup default 2024-09-14T10:46:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.488+0000 7ffada135800 20 rados->read ofs=0 len=0 2024-09-14T10:46:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.489+0000 7ffada135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.489+0000 7ffada135800 20 rados->read ofs=0 len=0 2024-09-14T10:46:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.489+0000 7ffada135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.489+0000 7ffada135800 20 rados->read ofs=0 len=0 2024-09-14T10:46:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.490+0000 7ffada135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.490+0000 7ffada135800 20 started sync module instance, tier type = 2024-09-14T10:46:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.490+0000 7ffada135800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:46:56.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.500+0000 7ffada135800 20 add_watcher() i=0 2024-09-14T10:46:56.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.500+0000 7ffada135800 20 add_watcher() i=1 2024-09-14T10:46:56.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.500+0000 7ffada135800 20 add_watcher() i=2 2024-09-14T10:46:56.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.500+0000 7ffada135800 20 add_watcher() i=3 2024-09-14T10:46:56.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.500+0000 7ffada135800 20 add_watcher() i=4 2024-09-14T10:46:56.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.500+0000 7ffada135800 20 add_watcher() i=5 2024-09-14T10:46:56.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.500+0000 7ffada135800 20 add_watcher() i=6 2024-09-14T10:46:56.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.501+0000 7ffada135800 20 add_watcher() i=7 2024-09-14T10:46:56.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.501+0000 7ffada135800 2 all 8 watchers are set, enabling cache 2024-09-14T10:46:56.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.503+0000 7ff9877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:56.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.503+0000 7ffada135800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:56.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.503+0000 7ffada135800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:56.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.503+0000 7ffada135800 5 note: GC not initialized 2024-09-14T10:46:56.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.503+0000 7ff9867fc640 20 reqs_thread_entry: start 2024-09-14T10:46:56.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.503+0000 7ffada135800 20 init_complete bucket index max shards: 11 2024-09-14T10:46:56.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.503+0000 7ffada135800 20 Filter name: none 2024-09-14T10:46:56.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.503+0000 7ff8f7fff640 20 reqs_thread_entry: start 2024-09-14T10:46:56.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.514+0000 7ff9877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:56.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.517+0000 7ffada135800 20 remove_watcher() i=0 2024-09-14T10:46:56.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.517+0000 7ffada135800 2 removed watcher, disabling cache 2024-09-14T10:46:56.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.518+0000 7ffada135800 20 remove_watcher() i=1 2024-09-14T10:46:56.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.519+0000 7ffada135800 20 remove_watcher() i=2 2024-09-14T10:46:56.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.520+0000 7ffada135800 20 remove_watcher() i=3 2024-09-14T10:46:56.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.521+0000 7ffada135800 20 remove_watcher() i=4 2024-09-14T10:46:56.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.522+0000 7ffada135800 20 remove_watcher() i=5 2024-09-14T10:46:56.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.523+0000 7ffada135800 20 remove_watcher() i=6 2024-09-14T10:46:56.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.525+0000 7ffada135800 20 remove_watcher() i=7 2024-09-14T10:46:56.535 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-14T10:46:56.535 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T10:46:56.535 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-14T10:46:56.536 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T10:46:56.536 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T10:46:56.536 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-14T10:46:56.599 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:56.600 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:56.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.628+0000 7f43d0f1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:56.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.628+0000 7f43d0f1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:56.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.632+0000 7f422affd640 20 reqs_thread_entry: start 2024-09-14T10:46:56.646 INFO:teuthology.orchestra.run.smithi050.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-14T10:46:56.646 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-14T10:46:56.646 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T10:46:56.646 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T10:46:56.646 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-14T10:46:56.712 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:56.712 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:56.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.741+0000 7fcc21b2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:56.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.741+0000 7fcc21b2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:56.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.745+0000 7fca53fff640 20 reqs_thread_entry: start 2024-09-14T10:46:56.760 INFO:teuthology.orchestra.run.smithi050.stdout:{"id":"c28b75ff-2576-4ab1-a211-5d2fca133105","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T10:46:56.761 DEBUG:tasks.util.rgw: json result: {'id': 'c28b75ff-2576-4ab1-a211-5d2fca133105', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T10:46:56.761 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-14T10:46:56.761 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T10:46:56.761 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T10:46:56.761 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-14T10:46:56.825 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:56.825 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:56.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.853+0000 7f85b2463800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:56.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.853+0000 7f85b2463800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:56.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.856+0000 7f846e7fc640 20 reqs_thread_entry: start 2024-09-14T10:46:56.870 INFO:teuthology.orchestra.run.smithi050.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-14T10:46:56.871 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-14T10:46:56.871 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T10:46:56.871 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T10:46:56.871 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-14T10:46:56.938 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:56.938 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:56.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.966+0000 7f6f9d522800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:56.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.966+0000 7f6f9d522800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:56.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T10:46:56.970+0000 7f6dd77fe640 20 reqs_thread_entry: start 2024-09-14T10:46:56.986 INFO:teuthology.orchestra.run.smithi050.stdout:{"id":"c28b75ff-2576-4ab1-a211-5d2fca133105","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T10:46:56.986 DEBUG:tasks.util.rgw: json result: {'id': 'c28b75ff-2576-4ab1-a211-5d2fca133105', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T10:46:56.987 INFO:tasks.rgw:Starting rgw... 2024-09-14T10:46:56.987 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-09-14T10:46:56.987 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-14T10:46:56.987 DEBUG:teuthology.orchestra.run.smithi050:> sudo echo -n https://smithi050.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-14T10:46:57.028 INFO:teuthology.orchestra.run.smithi050.stdout:https://smithi050.front.sepia.ceph.com:443 2024-09-14T10:46:57.028 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-14T10:46:57.108 DEBUG:teuthology.orchestra.run.smithi050:> sudo keytool -import -alias smithi050.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-09-14T10:46:57.325 INFO:teuthology.orchestra.run.smithi050.stderr:Warning: use -cacerts option to access cacerts keystore 2024-09-14T10:46:57.479 INFO:teuthology.orchestra.run.smithi050.stderr:Certificate was added to keystore 2024-09-14T10:46:57.503 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-09-14T10:46:57.503 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-14T10:46:57.504 DEBUG:teuthology.orchestra.run.smithi050:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-14T10:46:57.506 INFO:tasks.rgw.client.0:Started 2024-09-14T10:46:57.506 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi050.front.sepia.ceph.com:443/ 2024-09-14T10:46:57.506 DEBUG:teuthology.orchestra.run.smithi050:> curl https://smithi050.front.sepia.ceph.com:443/ 2024-09-14T10:46:57.549 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:46:57.550 INFO:teuthology.orchestra.run.smithi050.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:46:57.550 INFO:teuthology.orchestra.run.smithi050.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:46:57.550 INFO:teuthology.orchestra.run.smithi050.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:46:57.550 INFO:teuthology.orchestra.run.smithi050.stderr:curl: (7) Failed to connect to smithi050.front.sepia.ceph.com port 443: Connection refused 2024-09-14T10:46:58.551 DEBUG:teuthology.orchestra.run.smithi050:> curl https://smithi050.front.sepia.ceph.com:443/ 2024-09-14T10:46:58.587 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:46:58.588 INFO:teuthology.orchestra.run.smithi050.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:46:58.588 INFO:teuthology.orchestra.run.smithi050.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:46:58.588 INFO:teuthology.orchestra.run.smithi050.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:46:58.588 INFO:teuthology.orchestra.run.smithi050.stderr:curl: (7) Failed to connect to smithi050.front.sepia.ceph.com port 443: Connection refused 2024-09-14T10:47:00.589 DEBUG:teuthology.orchestra.run.smithi050:> curl https://smithi050.front.sepia.ceph.com:443/ 2024-09-14T10:47:00.625 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:47:00.625 INFO:teuthology.orchestra.run.smithi050.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:47:00.626 INFO:teuthology.orchestra.run.smithi050.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:47:00.626 INFO:teuthology.orchestra.run.smithi050.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:47:00.626 INFO:teuthology.orchestra.run.smithi050.stderr:curl: (7) Failed to connect to smithi050.front.sepia.ceph.com port 443: Connection refused 2024-09-14T10:47:04.627 DEBUG:teuthology.orchestra.run.smithi050:> curl https://smithi050.front.sepia.ceph.com:443/ 2024-09-14T10:47:04.661 INFO:teuthology.orchestra.run.smithi050.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:47:04.661 INFO:teuthology.orchestra.run.smithi050.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:47:04.663 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:47:04.663 INFO:teuthology.orchestra.run.smithi050.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:47:04.663 INFO:teuthology.orchestra.run.smithi050.stderr:curl: (7) Failed to connect to smithi050.front.sepia.ceph.com port 443: Connection refused 2024-09-14T10:47:12.665 DEBUG:teuthology.orchestra.run.smithi050:> curl https://smithi050.front.sepia.ceph.com:443/ 2024-09-14T10:47:12.701 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:47:12.702 INFO:teuthology.orchestra.run.smithi050.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:47:12.702 INFO:teuthology.orchestra.run.smithi050.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:47:12.702 INFO:teuthology.orchestra.run.smithi050.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:47:12.702 INFO:teuthology.orchestra.run.smithi050.stderr:curl: (7) Failed to connect to smithi050.front.sepia.ceph.com port 443: Connection refused 2024-09-14T10:47:21.769 INFO:tasks.rgw.client.0.smithi050.stdout:2024-09-14T10:47:21.490+0000 a1c2240 -1 ssl_private_key was not found: rgw/cert//default.key 2024-09-14T10:47:28.703 DEBUG:teuthology.orchestra.run.smithi050:> curl https://smithi050.front.sepia.ceph.com:443/ 2024-09-14T10:47:28.744 INFO:teuthology.orchestra.run.smithi050.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:47:28.744 INFO:teuthology.orchestra.run.smithi050.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:47:29.779 INFO:teuthology.orchestra.run.smithi050.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 180 0 --:--:-- 0:00:01 --:--:-- 180 2024-09-14T10:47:29.780 INFO:teuthology.orchestra.run.smithi050.stdout:anonymous 2024-09-14T10:47:29.781 INFO:teuthology.run_tasks:Running task tox... 2024-09-14T10:47:29.794 INFO:tasks.tox:Deploying tox from pip... 2024-09-14T10:47:29.795 DEBUG:teuthology.orchestra.run.smithi050:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-14T10:47:32.195 DEBUG:teuthology.orchestra.run.smithi050:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-14T10:47:32.738 INFO:teuthology.orchestra.run.smithi050.stdout:Collecting tox==3.15.0 2024-09-14T10:47:32.789 INFO:teuthology.orchestra.run.smithi050.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-14T10:47:32.917 INFO:teuthology.orchestra.run.smithi050.stdout:Collecting toml>=0.9.4 2024-09-14T10:47:32.931 INFO:teuthology.orchestra.run.smithi050.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-14T10:47:33.226 INFO:teuthology.orchestra.run.smithi050.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-14T10:47:33.242 INFO:teuthology.orchestra.run.smithi050.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-14T10:47:33.477 INFO:teuthology.orchestra.run.smithi050.stdout:Collecting six<2,>=1.14.0 2024-09-14T10:47:33.491 INFO:teuthology.orchestra.run.smithi050.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T10:47:33.582 INFO:teuthology.orchestra.run.smithi050.stdout:Collecting pluggy<1,>=0.12.0 2024-09-14T10:47:33.595 INFO:teuthology.orchestra.run.smithi050.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-14T10:47:33.697 INFO:teuthology.orchestra.run.smithi050.stdout:Collecting filelock<4,>=3.0.0 2024-09-14T10:47:33.711 INFO:teuthology.orchestra.run.smithi050.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-14T10:47:33.807 INFO:teuthology.orchestra.run.smithi050.stdout:Collecting packaging>=14 2024-09-14T10:47:33.821 INFO:teuthology.orchestra.run.smithi050.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-14T10:47:33.908 INFO:teuthology.orchestra.run.smithi050.stdout:Collecting py<2,>=1.4.17 2024-09-14T10:47:33.922 INFO:teuthology.orchestra.run.smithi050.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-14T10:47:34.065 INFO:teuthology.orchestra.run.smithi050.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-14T10:47:34.079 INFO:teuthology.orchestra.run.smithi050.stdout: Downloading platformdirs-4.3.3-py3-none-any.whl (18 kB) 2024-09-14T10:47:34.177 INFO:teuthology.orchestra.run.smithi050.stdout:Collecting distlib<1,>=0.3.7 2024-09-14T10:47:34.190 INFO:teuthology.orchestra.run.smithi050.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-14T10:47:34.326 INFO:teuthology.orchestra.run.smithi050.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-14T10:47:35.175 INFO:teuthology.orchestra.run.smithi050.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.3 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-14T10:47:35.381 INFO:teuthology.orchestra.run.smithi050.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-14T10:47:35.382 INFO:teuthology.orchestra.run.smithi050.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-14T10:47:35.444 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T10:47:35.461 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:47:35.461 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T10:47:35.461 DEBUG:teuthology.orchestra.run.smithi050:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:47:35.491 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:47:35.492 INFO:teuthology.orchestra.run.smithi050.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T10:47:35.492 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:47:35.561 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T10:47:35.561 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T10:47:35.631 INFO:tasks.workunit:timeout=3h 2024-09-14T10:47:35.631 INFO:tasks.workunit:cleanup=True 2024-09-14T10:47:35.632 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:47:35.702 INFO:tasks.workunit.client.0.smithi050.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T10:48:32.670 INFO:tasks.workunit.client.0.smithi050.stderr:Updating files: 94% (12217/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T10:48:33.221 INFO:tasks.workunit.client.0.smithi050.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T10:48:33.221 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:48:33.221 INFO:tasks.workunit.client.0.smithi050.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T10:48:33.221 INFO:tasks.workunit.client.0.smithi050.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T10:48:33.221 INFO:tasks.workunit.client.0.smithi050.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T10:48:33.222 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:48:33.222 INFO:tasks.workunit.client.0.smithi050.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T10:48:33.222 INFO:tasks.workunit.client.0.smithi050.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T10:48:33.222 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:48:33.222 INFO:tasks.workunit.client.0.smithi050.stderr: git switch -c 2024-09-14T10:48:33.222 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:48:33.222 INFO:tasks.workunit.client.0.smithi050.stderr:Or undo this operation with: 2024-09-14T10:48:33.222 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:48:33.222 INFO:tasks.workunit.client.0.smithi050.stderr: git switch - 2024-09-14T10:48:33.222 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:48:33.222 INFO:tasks.workunit.client.0.smithi050.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T10:48:33.222 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:48:33.222 INFO:tasks.workunit.client.0.smithi050.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T10:48:33.224 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T10:48:33.305 INFO:tasks.workunit.client.0.smithi050.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T10:48:33.307 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T10:48:33.307 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T10:48:33.895 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T10:48:33.966 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T10:48:34.006 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T10:48:34.008 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T10:48:34.008 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T10:48:34.047 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T10:48:34.051 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:48:34.051 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T10:48:34.121 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2024-09-14T10:48:34.122 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2024-09-14T10:48:34.122 DEBUG:teuthology.orchestra.run.smithi050:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-14T10:48:34.196 INFO:tasks.workunit.client.0.smithi050.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-14T10:48:34.197 INFO:tasks.workunit.client.0.smithi050.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T10:48:34.197 INFO:tasks.workunit.client.0.smithi050.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T10:48:36.611 INFO:tasks.workunit.client.0.smithi050.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T10:48:36.611 INFO:tasks.workunit.client.0.smithi050.stderr:++ deactivate nondestructive 2024-09-14T10:48:36.611 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -n '' ']' 2024-09-14T10:48:36.611 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -n '' ']' 2024-09-14T10:48:36.611 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T10:48:36.611 INFO:tasks.workunit.client.0.smithi050.stderr:++ hash -r 2024-09-14T10:48:36.612 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -n '' ']' 2024-09-14T10:48:36.612 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset VIRTUAL_ENV 2024-09-14T10:48:36.612 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T10:48:36.612 INFO:tasks.workunit.client.0.smithi050.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T10:48:36.612 INFO:tasks.workunit.client.0.smithi050.stderr:++ export VIRTUAL_ENV 2024-09-14T10:48:36.612 INFO:tasks.workunit.client.0.smithi050.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T10:48:36.612 INFO:tasks.workunit.client.0.smithi050.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T10:48:36.612 INFO:tasks.workunit.client.0.smithi050.stderr:++ export PATH 2024-09-14T10:48:36.613 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -n '' ']' 2024-09-14T10:48:36.613 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2024-09-14T10:48:36.613 INFO:tasks.workunit.client.0.smithi050.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T10:48:36.613 INFO:tasks.workunit.client.0.smithi050.stderr:++ PS1='(rgw) ' 2024-09-14T10:48:36.613 INFO:tasks.workunit.client.0.smithi050.stderr:++ export PS1 2024-09-14T10:48:36.613 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T10:48:36.613 INFO:tasks.workunit.client.0.smithi050.stderr:++ hash -r 2024-09-14T10:48:36.613 INFO:tasks.workunit.client.0.smithi050.stderr:+ pip install pip --upgrade 2024-09-14T10:48:36.849 INFO:tasks.workunit.client.0.smithi050.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T10:48:37.040 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting pip 2024-09-14T10:48:37.101 INFO:tasks.workunit.client.0.smithi050.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T10:48:37.260 INFO:tasks.workunit.client.0.smithi050.stdout:Installing collected packages: pip 2024-09-14T10:48:37.260 INFO:tasks.workunit.client.0.smithi050.stdout: Attempting uninstall: pip 2024-09-14T10:48:37.260 INFO:tasks.workunit.client.0.smithi050.stdout: Found existing installation: pip 21.3.1 2024-09-14T10:48:37.424 INFO:tasks.workunit.client.0.smithi050.stdout: Uninstalling pip-21.3.1: 2024-09-14T10:48:37.430 INFO:tasks.workunit.client.0.smithi050.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T10:48:38.212 INFO:tasks.workunit.client.0.smithi050.stdout:Successfully installed pip-24.2 2024-09-14T10:48:38.448 INFO:tasks.workunit.client.0.smithi050.stderr:+ pip install configobj 2024-09-14T10:48:38.833 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting configobj 2024-09-14T10:48:38.876 INFO:tasks.workunit.client.0.smithi050.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl.metadata (3.4 kB) 2024-09-14T10:48:38.999 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting six (from configobj) 2024-09-14T10:48:39.013 INFO:tasks.workunit.client.0.smithi050.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T10:48:39.077 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2024-09-14T10:48:39.149 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T10:48:39.213 INFO:tasks.workunit.client.0.smithi050.stdout:Installing collected packages: six, configobj 2024-09-14T10:48:39.339 INFO:tasks.workunit.client.0.smithi050.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2024-09-14T10:48:39.387 INFO:tasks.workunit.client.0.smithi050.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-09-14T10:48:39.420 INFO:tasks.workunit.client.0.smithi050.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2024-09-14T10:48:39.420 INFO:tasks.workunit.client.0.smithi050.stderr:DEBUG:root:exec_cmd(pwd) 2024-09-14T10:48:39.422 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:command succeeded 2024-09-14T10:48:39.422 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2024-09-14T10:48:39.422 INFO:tasks.workunit.client.0.smithi050.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:48:39.422 INFO:tasks.workunit.client.0.smithi050.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2024-09-14T10:48:39.465 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:command succeeded 2024-09-14T10:48:39.465 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:b'tcp 0 0 0.0.0.0:443 0.0.0.0:* LISTEN 45140/valgrind \ntcp6 0 0 :::443 :::* LISTEN 45140/valgrind \n' 2024-09-14T10:48:39.465 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:radosgw port: 443 2024-09-14T10:48:39.465 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2024-09-14T10:48:39.465 INFO:tasks.workunit.client.0.smithi050.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2024-09-14T10:48:39.487 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:command succeeded 2024-09-14T10:48:39.487 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:b'' 2024-09-14T10:48:39.488 INFO:tasks.workunit.client.0.smithi050.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2024-09-14T10:48:39.648 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:command succeeded 2024-09-14T10:48:39.648 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn",\n "active": true,\n "create_date": "2024-09-14T10:48:39.599010Z"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": [],\n "account_id": "",\n "path": "/",\n "create_date": "2024-09-14T10:48:39.598994Z",\n "tags": [],\n "group_ids": []\n}\n\n' 2024-09-14T10:48:39.648 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:Creating s3cmd config... 2024-09-14T10:48:39.648 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:proto for s3cmd config is https 2024-09-14T10:48:39.648 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:s3cmd config written 2024-09-14T10:48:39.648 INFO:tasks.workunit.client.0.smithi050.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2024-09-14T10:48:40.294 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:command succeeded 2024-09-14T10:48:40.294 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2024-09-14T10:48:40.294 INFO:tasks.workunit.client.0.smithi050.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2024-09-14T10:48:42.755 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:command succeeded 2024-09-14T10:48:42.755 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 2.2 seconds, 3.24 MB/s) [1 of 1]\n" 2024-09-14T10:48:42.755 INFO:tasks.workunit.client.0.smithi050.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2024-09-14T10:48:44.070 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:command succeeded 2024-09-14T10:48:44.071 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 1.0 seconds, 7.09 MB/s)\n" 2024-09-14T10:48:44.071 INFO:tasks.workunit.client.0.smithi050.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2024-09-14T10:48:44.400 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:command succeeded 2024-09-14T10:48:44.401 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7340376,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "name": "DatacacheUser",\n "permission": {\n "flags": 15\n }\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "compression": {\n "compression_type": "snappy",\n "orig_size": 7340032,\n "blocks": [\n {\n "old_ofs": 0,\n "new_ofs": 0,\n "len": 4194500\n },\n {\n "old_ofs": 4194304,\n "new_ofs": 4194500,\n "len": 3145876\n }\n ]\n },\n "etag": "c8727601f773582fb1575d91f83e9560",\n "tag": "c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3581296027198366116",\n "manifest": {\n "objs": [],\n "obj_size": 7340376,\n "explicit_objs": false,\n "head_size": 0,\n "max_head_size": 0,\n "prefix": ".ORgnUu8pezOc-0XsoAXvF5yID5thDY7_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 0,\n "part_size": 0,\n "stripe_max_size": 6291456,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1",\n "bucket_id": "c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 6291456,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1",\n "bucket_id": "c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".ORgnUu8pezOc-0XsoAXvF5yID5thDY7_0",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 0,\n "stripe_ofs": 6291456,\n "ofs": 7340376,\n "stripe_size": 1048920,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1",\n "bucket_id": "c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".ORgnUu8pezOc-0XsoAXvF5yID5thDY7_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "mtime": "2024-09-14T10:48:42.652198Z",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3581296027198366116",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1726310919/ctime:1726310919/gid:1333/gname:ubuntu/md5:c8727601f773582fb1575d91f83e9560/mode:33188/mtime:1726310919/uid:1000/uname:ubuntu"\n }\n}\n' 2024-09-14T10:48:44.401 INFO:tasks.workunit.client.0.smithi050.stderr:DEBUG:root:Cached object name is: .ORgnUu8pezOc-0XsoAXvF5yID5thDY7_ 2024-09-14T10:48:44.401 INFO:tasks.workunit.client.0.smithi050.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2024-09-14T10:48:44.404 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:command succeeded 2024-09-14T10:48:44.404 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:b'0\n' 2024-09-14T10:48:44.404 INFO:tasks.workunit.client.0.smithi050.stderr:DEBUG:root:Check cache dir content: 0 2024-09-14T10:48:44.404 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:NOTICE: datacache test object not found, inspect if datacache was bypassed or disabled during this check. 2024-09-14T10:48:44.404 INFO:tasks.workunit.client.0.smithi050.stderr:INFO:root:Completed Datacache tests 2024-09-14T10:48:44.410 INFO:tasks.workunit.client.0.smithi050.stderr:+ deactivate 2024-09-14T10:48:44.410 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T10:48:44.410 INFO:tasks.workunit.client.0.smithi050.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T10:48:44.410 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2024-09-14T10:48:44.410 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T10:48:44.410 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -n '' ']' 2024-09-14T10:48:44.411 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T10:48:44.411 INFO:tasks.workunit.client.0.smithi050.stderr:+ hash -r 2024-09-14T10:48:44.411 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -n '' ']' 2024-09-14T10:48:44.411 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset VIRTUAL_ENV 2024-09-14T10:48:44.411 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T10:48:44.411 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset -f deactivate 2024-09-14T10:48:44.411 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo OK. 2024-09-14T10:48:44.412 INFO:tasks.workunit.client.0.smithi050.stdout:OK. 2024-09-14T10:48:44.412 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:48:44.412 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:48:44.495 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2024-09-14T10:48:44.495 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T10:48:44.846 DEBUG:teuthology.parallel:result is None 2024-09-14T10:48:44.846 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T10:48:44.885 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T10:48:44.886 DEBUG:teuthology.orchestra.run.smithi050:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:48:44.967 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T10:48:44.967 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T10:48:44.977 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:48:44.977 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T10:48:44.978 DEBUG:teuthology.orchestra.run.smithi050:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:48:45.038 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:48:45.038 INFO:teuthology.orchestra.run.smithi050.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T10:48:45.038 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:48:45.109 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T10:48:45.109 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T10:48:45.178 INFO:tasks.workunit:timeout=3h 2024-09-14T10:48:45.178 INFO:tasks.workunit:cleanup=True 2024-09-14T10:48:45.179 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:48:45.250 INFO:tasks.workunit.client.0.smithi050.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T10:49:41.696 INFO:tasks.workunit.client.0.smithi050.stderr:Updating files: 94% (12198/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T10:49:42.257 INFO:tasks.workunit.client.0.smithi050.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T10:49:42.257 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:49:42.257 INFO:tasks.workunit.client.0.smithi050.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T10:49:42.257 INFO:tasks.workunit.client.0.smithi050.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T10:49:42.257 INFO:tasks.workunit.client.0.smithi050.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T10:49:42.257 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:49:42.257 INFO:tasks.workunit.client.0.smithi050.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T10:49:42.257 INFO:tasks.workunit.client.0.smithi050.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T10:49:42.257 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:49:42.257 INFO:tasks.workunit.client.0.smithi050.stderr: git switch -c 2024-09-14T10:49:42.257 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:49:42.257 INFO:tasks.workunit.client.0.smithi050.stderr:Or undo this operation with: 2024-09-14T10:49:42.258 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:49:42.258 INFO:tasks.workunit.client.0.smithi050.stderr: git switch - 2024-09-14T10:49:42.258 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:49:42.258 INFO:tasks.workunit.client.0.smithi050.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T10:49:42.258 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:49:42.258 INFO:tasks.workunit.client.0.smithi050.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T10:49:42.259 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T10:49:42.329 INFO:tasks.workunit.client.0.smithi050.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T10:49:42.332 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T10:49:42.332 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T10:49:42.383 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T10:49:42.433 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T10:49:42.475 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T10:49:42.476 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T10:49:42.476 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T10:49:42.515 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T10:49:42.519 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:49:42.519 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T10:49:42.590 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-14T10:49:42.591 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-14T10:49:42.591 DEBUG:teuthology.orchestra.run.smithi050:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T10:49:42.664 INFO:tasks.workunit.client.0.smithi050.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T10:49:42.665 INFO:tasks.workunit.client.0.smithi050.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T10:49:42.665 INFO:tasks.workunit.client.0.smithi050.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T10:49:45.065 INFO:tasks.workunit.client.0.smithi050.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T10:49:45.065 INFO:tasks.workunit.client.0.smithi050.stderr:++ deactivate nondestructive 2024-09-14T10:49:45.065 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -n '' ']' 2024-09-14T10:49:45.065 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -n '' ']' 2024-09-14T10:49:45.065 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T10:49:45.065 INFO:tasks.workunit.client.0.smithi050.stderr:++ hash -r 2024-09-14T10:49:45.065 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -n '' ']' 2024-09-14T10:49:45.065 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset VIRTUAL_ENV 2024-09-14T10:49:45.065 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T10:49:45.065 INFO:tasks.workunit.client.0.smithi050.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T10:49:45.066 INFO:tasks.workunit.client.0.smithi050.stderr:++ export VIRTUAL_ENV 2024-09-14T10:49:45.066 INFO:tasks.workunit.client.0.smithi050.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T10:49:45.067 INFO:tasks.workunit.client.0.smithi050.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T10:49:45.067 INFO:tasks.workunit.client.0.smithi050.stderr:++ export PATH 2024-09-14T10:49:45.067 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -n '' ']' 2024-09-14T10:49:45.067 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2024-09-14T10:49:45.067 INFO:tasks.workunit.client.0.smithi050.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T10:49:45.067 INFO:tasks.workunit.client.0.smithi050.stderr:++ PS1='(rgw) ' 2024-09-14T10:49:45.067 INFO:tasks.workunit.client.0.smithi050.stderr:++ export PS1 2024-09-14T10:49:45.067 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T10:49:45.067 INFO:tasks.workunit.client.0.smithi050.stderr:++ hash -r 2024-09-14T10:49:45.067 INFO:tasks.workunit.client.0.smithi050.stderr:+ pip install pip --upgrade 2024-09-14T10:49:45.304 INFO:tasks.workunit.client.0.smithi050.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T10:49:45.479 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting pip 2024-09-14T10:49:45.484 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T10:49:45.531 INFO:tasks.workunit.client.0.smithi050.stdout:Installing collected packages: pip 2024-09-14T10:49:45.532 INFO:tasks.workunit.client.0.smithi050.stdout: Attempting uninstall: pip 2024-09-14T10:49:45.532 INFO:tasks.workunit.client.0.smithi050.stdout: Found existing installation: pip 21.3.1 2024-09-14T10:49:45.699 INFO:tasks.workunit.client.0.smithi050.stdout: Uninstalling pip-21.3.1: 2024-09-14T10:49:45.704 INFO:tasks.workunit.client.0.smithi050.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T10:49:46.475 INFO:tasks.workunit.client.0.smithi050.stdout:Successfully installed pip-24.2 2024-09-14T10:49:46.524 INFO:tasks.workunit.client.0.smithi050.stderr:+ pip install boto3 2024-09-14T10:49:47.401 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting boto3 2024-09-14T10:49:47.456 INFO:tasks.workunit.client.0.smithi050.stdout: Downloading boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T10:49:48.093 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T10:49:48.107 INFO:tasks.workunit.client.0.smithi050.stdout: Downloading botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T10:49:48.236 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T10:49:48.250 INFO:tasks.workunit.client.0.smithi050.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T10:49:48.376 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T10:49:48.390 INFO:tasks.workunit.client.0.smithi050.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T10:49:48.494 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T10:49:48.508 INFO:tasks.workunit.client.0.smithi050.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T10:49:48.666 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T10:49:48.680 INFO:tasks.workunit.client.0.smithi050.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T10:49:48.926 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T10:49:48.927 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T10:49:48.944 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T10:49:49.017 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T10:49:49.223 INFO:tasks.workunit.client.0.smithi050.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.5/12.5 MB 63.7 MB/s eta 0:00:00 2024-09-14T10:49:49.237 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T10:49:49.293 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T10:49:49.360 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T10:49:49.427 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T10:49:49.482 INFO:tasks.workunit.client.0.smithi050.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T10:49:49.560 INFO:tasks.workunit.client.0.smithi050.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T10:49:50.636 INFO:tasks.workunit.client.0.smithi050.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T10:49:50.751 INFO:tasks.workunit.client.0.smithi050.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-14T10:49:50.889 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-14T10:49:50.925 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:49:50.925 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:49:50.965 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.967+0000 7ff8a3cb9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:50.967 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.969+0000 7ff8a3cb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:50.967 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.969+0000 7ff8a3cb9800 20 realm 2024-09-14T10:49:50.967 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.969+0000 7ff8a3cb9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:50.967 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.969+0000 7ff8a3cb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:50.967 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.969+0000 7ff8a3cb9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:49:50.967 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.969+0000 7ff8a3cb9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:50.968 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.969+0000 7ff8a3cb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:50.968 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.969+0000 7ff8a3cb9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:50.968 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.970+0000 7ff8a3cb9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:50.968 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.970+0000 7ff8a3cb9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:50.968 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.971+0000 7ff8a3cb9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:49:50.969 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.971+0000 7ff8a3cb9800 20 searching for the correct realm 2024-09-14T10:49:50.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.974+0000 7ff8a17a3640 0 -- 172.21.15.50:0/2374010334 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x7ff89c017020 msgr2=0x7ff89c061fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:49:50.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.978+0000 7ff8a17a3640 0 -- 172.21.15.50:0/2374010334 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7ff89c099b90 msgr2=0x7ff89c085160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:50.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.983+0000 7ff8a3cb9800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:49:50.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.983+0000 7ff8a3cb9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:49:50.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.983+0000 7ff8a3cb9800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:49:50.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.983+0000 7ff8a3cb9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:49:50.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.983+0000 7ff8a3cb9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:49:50.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.983+0000 7ff8a3cb9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:49:50.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.983+0000 7ff8a3cb9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:50.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.983+0000 7ff8a3cb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:50.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.983+0000 7ff8a3cb9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:50.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.983+0000 7ff8a3cb9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:50.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.983+0000 7ff8a3cb9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:50.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.984+0000 7ff8a3cb9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:49:50.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.984+0000 7ff8a3cb9800 20 zone default found 2024-09-14T10:49:50.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.984+0000 7ff8a3cb9800 4 Realm: () 2024-09-14T10:49:50.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.984+0000 7ff8a3cb9800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:49:50.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.984+0000 7ff8a3cb9800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:49:50.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.984+0000 7ff8a3cb9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:49:50.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.984+0000 7ff8a3cb9800 20 zonegroup default 2024-09-14T10:49:50.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.984+0000 7ff8a3cb9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:50.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.984+0000 7ff8a3cb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:50.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.984+0000 7ff8a3cb9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:50.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.984+0000 7ff8a3cb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:50.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.984+0000 7ff8a3cb9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:50.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.985+0000 7ff8a3cb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:50.985 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.985+0000 7ff8a3cb9800 20 started sync module instance, tier type = 2024-09-14T10:49:50.985 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.985+0000 7ff8a3cb9800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:49:50.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.994+0000 7ff8a3cb9800 20 add_watcher() i=0 2024-09-14T10:49:50.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.994+0000 7ff8a3cb9800 20 add_watcher() i=1 2024-09-14T10:49:50.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.994+0000 7ff8a3cb9800 20 add_watcher() i=2 2024-09-14T10:49:50.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.994+0000 7ff8a3cb9800 20 add_watcher() i=3 2024-09-14T10:49:50.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.994+0000 7ff8a3cb9800 20 add_watcher() i=4 2024-09-14T10:49:50.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.994+0000 7ff8a3cb9800 20 add_watcher() i=5 2024-09-14T10:49:50.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.994+0000 7ff8a3cb9800 20 add_watcher() i=6 2024-09-14T10:49:50.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.995+0000 7ff8a3cb9800 20 add_watcher() i=7 2024-09-14T10:49:50.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.995+0000 7ff8a3cb9800 2 all 8 watchers are set, enabling cache 2024-09-14T10:49:50.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.997+0000 7ff757fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:50.996 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.997+0000 7ff8a3cb9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:49:50.996 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.997+0000 7ff8a3cb9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:49:50.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.998+0000 7ff8a3cb9800 5 note: GC not initialized 2024-09-14T10:49:50.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.998+0000 7ff756fe5640 20 reqs_thread_entry: start 2024-09-14T10:49:50.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.998+0000 7ff8a3cb9800 20 init_complete bucket index max shards: 11 2024-09-14T10:49:50.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.998+0000 7ff8a3cb9800 20 Filter name: none 2024-09-14T10:49:50.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.998+0000 7ff754fe1640 20 reqs_thread_entry: start 2024-09-14T10:49:50.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.998+0000 7ff8a3cb9800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-14T10:49:50.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.998+0000 7ff8a3cb9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:50.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.998+0000 7ff8a3cb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:50.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.998+0000 7ff8a3cb9800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-14T10:49:50.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.998+0000 7ff8a3cb9800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T10:49:50.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.998+0000 7ff8a3cb9800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-14T10:49:50.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.998+0000 7ff8a3cb9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:50.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.999+0000 7ff8a3cb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:50.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.999+0000 7ff8a3cb9800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-14T10:49:50.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.999+0000 7ff8a3cb9800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T10:49:50.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.999+0000 7ff8a3cb9800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T10:49:50.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:50.999+0000 7ff8a3cb9800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T10:49:50.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:51.000+0000 7ff8a3cb9800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T10:49:50.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:51.000+0000 7ff8a3cb9800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T10:49:50.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:51.000+0000 7ff8a3cb9800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-14T10:49:50.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:51.000+0000 7ff784ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 171798691841 cookie 94711115890928 notifier 4577 bl.length()=593 2024-09-14T10:49:50.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:51.000+0000 7ff784ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T10:49:50.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:51.000+0000 7ff784ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T10:49:51.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:51.003+0000 7ff8a3cb9800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T10:49:51.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:51.003+0000 7ff8a3cb9800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T10:49:51.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:51.003+0000 7ff8a3cb9800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-14T10:49:51.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:51.003+0000 7ff784ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 171798691840 cookie 94711115884880 notifier 4577 bl.length()=186 2024-09-14T10:49:51.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:51.003+0000 7ff784ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T10:49:51.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:51.003+0000 7ff784ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T10:49:51.003 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:51.006+0000 7ff757fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:51.006 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:51.008+0000 7ff8a3cb9800 20 remove_watcher() i=0 2024-09-14T10:49:51.006 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:51.008+0000 7ff8a3cb9800 2 removed watcher, disabling cache 2024-09-14T10:49:51.007 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:51.009+0000 7ff8a3cb9800 20 remove_watcher() i=1 2024-09-14T10:49:51.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:51.010+0000 7ff8a3cb9800 20 remove_watcher() i=2 2024-09-14T10:49:51.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:51.011+0000 7ff8a3cb9800 20 remove_watcher() i=3 2024-09-14T10:49:51.010 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:51.012+0000 7ff8a3cb9800 20 remove_watcher() i=4 2024-09-14T10:49:51.011 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:51.013+0000 7ff8a3cb9800 20 remove_watcher() i=5 2024-09-14T10:49:51.012 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:51.014+0000 7ff8a3cb9800 20 remove_watcher() i=6 2024-09-14T10:49:51.013 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:51.015+0000 7ff8a3cb9800 20 remove_watcher() i=7 2024-09-14T10:49:51.216 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:51.216 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:51.266 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:51.266 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:51.338 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:51.338 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:51.388 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:51.388 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:51.458 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:51.458 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:51.484 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:51.484 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:51.555 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:51.555 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:51.580 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:51.580 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:51.672 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:51.672 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:51.785 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:51.785 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:51.821 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:51.821 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:51.877 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:51.878 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:51.904 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:51.904 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:51.992 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:51.992 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:52.017 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:52.018 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:52.073 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:52.073 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:52.097 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: recalculated bucket check stats are correct 2024-09-14T10:49:52.097 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:49:52.099 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T10:49:52.129 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:49:52.129 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:49:52.169 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.171+0000 7f573080f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.172+0000 7f573080f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:52.171 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.172+0000 7f573080f800 20 realm 2024-09-14T10:49:52.171 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.172+0000 7f573080f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.171 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.173+0000 7f573080f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:52.171 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.173+0000 7f573080f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:49:52.171 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.173+0000 7f573080f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.171 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.173+0000 7f573080f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:52.171 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.173+0000 7f573080f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.173+0000 7f573080f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:52.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.174+0000 7f573080f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.174+0000 7f573080f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:49:52.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.174+0000 7f573080f800 20 searching for the correct realm 2024-09-14T10:49:52.175 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.177+0000 7f572b791640 0 -- 172.21.15.50:0/114059383 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f572406b3b0 msgr2=0x7f57240659f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:52.380 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.382+0000 7f572c793640 0 -- 172.21.15.50:0/114059383 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5563853a14d0 msgr2=0x5563853a3960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:52.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.387+0000 7f573080f800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:49:52.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.387+0000 7f573080f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:49:52.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.387+0000 7f573080f800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:49:52.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.387+0000 7f573080f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:49:52.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.387+0000 7f573080f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:49:52.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.387+0000 7f573080f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:49:52.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.387+0000 7f573080f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.387+0000 7f573080f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:52.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.387+0000 7f573080f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.387 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.388+0000 7f573080f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:52.387 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.388+0000 7f573080f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.387 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.388+0000 7f573080f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:49:52.387 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.388+0000 7f573080f800 20 zone default found 2024-09-14T10:49:52.387 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.388+0000 7f573080f800 4 Realm: () 2024-09-14T10:49:52.387 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.388+0000 7f573080f800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:49:52.387 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.388+0000 7f573080f800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:49:52.387 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.388+0000 7f573080f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:49:52.387 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.388+0000 7f573080f800 20 zonegroup default 2024-09-14T10:49:52.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.388+0000 7f573080f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.388+0000 7f573080f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:52.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.388+0000 7f573080f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.389+0000 7f573080f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:52.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.389+0000 7f573080f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.389+0000 7f573080f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:52.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.389+0000 7f573080f800 20 started sync module instance, tier type = 2024-09-14T10:49:52.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.389+0000 7f573080f800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:49:52.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.399+0000 7f573080f800 20 add_watcher() i=0 2024-09-14T10:49:52.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.399+0000 7f573080f800 20 add_watcher() i=1 2024-09-14T10:49:52.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.399+0000 7f573080f800 20 add_watcher() i=2 2024-09-14T10:49:52.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.399+0000 7f573080f800 20 add_watcher() i=3 2024-09-14T10:49:52.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.399+0000 7f573080f800 20 add_watcher() i=4 2024-09-14T10:49:52.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.399+0000 7f573080f800 20 add_watcher() i=5 2024-09-14T10:49:52.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.399+0000 7f573080f800 20 add_watcher() i=6 2024-09-14T10:49:52.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.401+0000 7f573080f800 20 add_watcher() i=7 2024-09-14T10:49:52.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.401+0000 7f573080f800 2 all 8 watchers are set, enabling cache 2024-09-14T10:49:52.400 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.402+0000 7f55e27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:52.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.403+0000 7f573080f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:49:52.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.403+0000 7f573080f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:49:52.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.403+0000 7f573080f800 5 note: GC not initialized 2024-09-14T10:49:52.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.403+0000 7f55e17e2640 20 reqs_thread_entry: start 2024-09-14T10:49:52.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.403+0000 7f573080f800 20 init_complete bucket index max shards: 11 2024-09-14T10:49:52.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.403+0000 7f573080f800 20 Filter name: none 2024-09-14T10:49:52.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.403+0000 7f55da7fc640 20 reqs_thread_entry: start 2024-09-14T10:49:52.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.403+0000 7f573080f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:49:52.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.403+0000 7f573080f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.404+0000 7f573080f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:49:52.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.404+0000 7f573080f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:49:52.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.404+0000 7f573080f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:49:52.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.404+0000 7f573080f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 : miss 2024-09-14T10:49:52.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.404+0000 7f573080f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.405+0000 7f573080f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:49:52.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.405+0000 7f573080f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 info.flags=0x17 2024-09-14T10:49:52.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.405+0000 7f573080f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 to cache LRU end 2024-09-14T10:49:52.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.405+0000 7f573080f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:49:52.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.405+0000 7f573080f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:49:52.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.405+0000 7f573080f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 2024-09-14T10:49:52.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.405+0000 7f573080f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.0 2024-09-14T10:49:52.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.405+0000 7f573080f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:49:52.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.406+0000 7f573080f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.2 2024-09-14T10:49:52.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.406+0000 7f573080f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.3 2024-09-14T10:49:52.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.407+0000 7f573080f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.4 2024-09-14T10:49:52.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.407+0000 7f573080f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:49:52.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.408+0000 7f573080f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.6 2024-09-14T10:49:52.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.408+0000 7f573080f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.7 2024-09-14T10:49:52.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.409+0000 7f573080f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:49:52.407 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.409+0000 7f573080f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.9 2024-09-14T10:49:52.408 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.410+0000 7f573080f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:49:52.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.416+0000 7f55e27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:52.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.418+0000 7f573080f800 20 remove_watcher() i=0 2024-09-14T10:49:52.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.418+0000 7f573080f800 2 removed watcher, disabling cache 2024-09-14T10:49:52.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.419+0000 7f573080f800 20 remove_watcher() i=1 2024-09-14T10:49:52.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.420+0000 7f573080f800 20 remove_watcher() i=2 2024-09-14T10:49:52.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.422+0000 7f573080f800 20 remove_watcher() i=3 2024-09-14T10:49:52.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.423+0000 7f573080f800 20 remove_watcher() i=4 2024-09-14T10:49:52.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.424+0000 7f573080f800 20 remove_watcher() i=5 2024-09-14T10:49:52.423 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.425+0000 7f573080f800 20 remove_watcher() i=6 2024-09-14T10:49:52.424 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.426+0000 7f573080f800 20 remove_watcher() i=7 2024-09-14T10:49:52.437 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T10:49:52.466 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:49:52.466 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:49:52.506 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.508+0000 7ff296e98800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.510+0000 7ff296e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:52.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.510+0000 7ff296e98800 20 realm 2024-09-14T10:49:52.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.510+0000 7ff296e98800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.510+0000 7ff296e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:52.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.510+0000 7ff296e98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:49:52.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.510+0000 7ff296e98800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.511+0000 7ff296e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:52.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.511+0000 7ff296e98800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.511+0000 7ff296e98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:52.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.511+0000 7ff296e98800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.510 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.512+0000 7ff296e98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:49:52.510 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.512+0000 7ff296e98800 20 searching for the correct realm 2024-09-14T10:49:52.513 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.515+0000 7ff294181640 0 -- 172.21.15.50:0/3369536607 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7ff28c06f670 msgr2=0x7ff28c09ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:52.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.721+0000 7ff295183640 0 -- 172.21.15.50:0/3369536607 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x56198be06bd0 msgr2=0x56198be09020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:52.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.726+0000 7ff296e98800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:49:52.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.726+0000 7ff296e98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:49:52.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.726+0000 7ff296e98800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:49:52.724 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.726+0000 7ff296e98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:49:52.724 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.726+0000 7ff296e98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:49:52.724 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.726+0000 7ff296e98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:49:52.724 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.726+0000 7ff296e98800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.726+0000 7ff296e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:52.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.726+0000 7ff296e98800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.726+0000 7ff296e98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:52.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.726+0000 7ff296e98800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.727+0000 7ff296e98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:49:52.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.727+0000 7ff296e98800 20 zone default found 2024-09-14T10:49:52.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.727+0000 7ff296e98800 4 Realm: () 2024-09-14T10:49:52.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.727+0000 7ff296e98800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:49:52.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.727+0000 7ff296e98800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:49:52.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.727+0000 7ff296e98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:49:52.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.727+0000 7ff296e98800 20 zonegroup default 2024-09-14T10:49:52.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.727+0000 7ff296e98800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.727+0000 7ff296e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:52.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.727+0000 7ff296e98800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.727+0000 7ff296e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:52.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.727+0000 7ff296e98800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.727+0000 7ff296e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:52.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.727+0000 7ff296e98800 20 started sync module instance, tier type = 2024-09-14T10:49:52.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.727+0000 7ff296e98800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:49:52.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.737+0000 7ff296e98800 20 add_watcher() i=0 2024-09-14T10:49:52.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.737+0000 7ff296e98800 20 add_watcher() i=1 2024-09-14T10:49:52.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.737+0000 7ff296e98800 20 add_watcher() i=2 2024-09-14T10:49:52.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.737+0000 7ff296e98800 20 add_watcher() i=3 2024-09-14T10:49:52.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.737+0000 7ff296e98800 20 add_watcher() i=4 2024-09-14T10:49:52.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.737+0000 7ff296e98800 20 add_watcher() i=5 2024-09-14T10:49:52.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.737+0000 7ff296e98800 20 add_watcher() i=6 2024-09-14T10:49:52.736 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.738+0000 7ff296e98800 20 add_watcher() i=7 2024-09-14T10:49:52.736 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.738+0000 7ff296e98800 2 all 8 watchers are set, enabling cache 2024-09-14T10:49:52.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.740+0000 7ff14afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:52.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.741+0000 7ff296e98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:49:52.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.741+0000 7ff296e98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:49:52.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.741+0000 7ff296e98800 5 note: GC not initialized 2024-09-14T10:49:52.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.741+0000 7ff149fe3640 20 reqs_thread_entry: start 2024-09-14T10:49:52.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.741+0000 7ff296e98800 20 init_complete bucket index max shards: 11 2024-09-14T10:49:52.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.741+0000 7ff296e98800 20 Filter name: none 2024-09-14T10:49:52.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.741+0000 7ff0bb7fe640 20 reqs_thread_entry: start 2024-09-14T10:49:52.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.741+0000 7ff296e98800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.742+0000 7ff296e98800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:49:52.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.742+0000 7ff296e98800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.742+0000 7ff296e98800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:49:52.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.742+0000 7ff296e98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:49:52.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.742+0000 7ff296e98800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.742+0000 7ff296e98800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:49:52.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.742+0000 7ff296e98800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.743+0000 7ff296e98800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:49:52.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.743+0000 7ff296e98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:49:52.742 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.745+0000 7ff14afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:52.744 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.747+0000 7ff296e98800 20 remove_watcher() i=0 2024-09-14T10:49:52.745 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.747+0000 7ff296e98800 2 removed watcher, disabling cache 2024-09-14T10:49:52.745 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.748+0000 7ff296e98800 20 remove_watcher() i=1 2024-09-14T10:49:52.747 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.749+0000 7ff296e98800 20 remove_watcher() i=2 2024-09-14T10:49:52.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.750+0000 7ff296e98800 20 remove_watcher() i=3 2024-09-14T10:49:52.749 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.751+0000 7ff296e98800 20 remove_watcher() i=4 2024-09-14T10:49:52.750 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.753+0000 7ff296e98800 20 remove_watcher() i=5 2024-09-14T10:49:52.751 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.754+0000 7ff296e98800 20 remove_watcher() i=6 2024-09-14T10:49:52.752 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.755+0000 7ff296e98800 20 remove_watcher() i=7 2024-09-14T10:49:52.764 INFO:tasks.workunit.client.0.smithi050.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 99, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-14T10:49:52.764 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-14T10:49:52.764 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:49:52.765 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T10:49:52.799 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:49:52.799 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:49:52.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.840+0000 7f6e52d35800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.842+0000 7f6e52d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:52.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.842+0000 7f6e52d35800 20 realm 2024-09-14T10:49:52.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.842+0000 7f6e52d35800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.842+0000 7f6e52d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:52.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.842+0000 7f6e52d35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:49:52.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.842+0000 7f6e52d35800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.842+0000 7f6e52d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:52.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.842+0000 7f6e52d35800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.843+0000 7f6e52d35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:52.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.843+0000 7f6e52d35800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.843+0000 7f6e52d35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:49:52.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.843+0000 7f6e52d35800 20 searching for the correct realm 2024-09-14T10:49:52.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.847+0000 7f6e4ea21640 0 -- 172.21.15.50:0/3498065568 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x7f6e48061040 msgr2=0x7f6e4806a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:52.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.850+0000 7f6e4ea21640 0 -- 172.21.15.50:0/3498065568 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f6e48069400 msgr2=0x7f6e48069880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:52.852 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.854+0000 7f6e52d35800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:49:52.852 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.854+0000 7f6e52d35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:49:52.852 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.854+0000 7f6e52d35800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:49:52.852 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.854+0000 7f6e52d35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:49:52.852 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.854+0000 7f6e52d35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:49:52.853 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.854+0000 7f6e52d35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:49:52.853 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.854+0000 7f6e52d35800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.853 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.854+0000 7f6e52d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:52.853 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.854+0000 7f6e52d35800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.854 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.855+0000 7f6e52d35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:52.854 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.855+0000 7f6e52d35800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.854 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.855+0000 7f6e52d35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:49:52.854 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.855+0000 7f6e52d35800 20 zone default found 2024-09-14T10:49:52.854 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.855+0000 7f6e52d35800 4 Realm: () 2024-09-14T10:49:52.854 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.855+0000 7f6e52d35800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:49:52.854 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.855+0000 7f6e52d35800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:49:52.854 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.855+0000 7f6e52d35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:49:52.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.855+0000 7f6e52d35800 20 zonegroup default 2024-09-14T10:49:52.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.855+0000 7f6e52d35800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.855+0000 7f6e52d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:52.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.855+0000 7f6e52d35800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.856+0000 7f6e52d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:52.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.856+0000 7f6e52d35800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.856+0000 7f6e52d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:52.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.856+0000 7f6e52d35800 20 started sync module instance, tier type = 2024-09-14T10:49:52.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.856+0000 7f6e52d35800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:49:52.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.865+0000 7f6e52d35800 20 add_watcher() i=0 2024-09-14T10:49:52.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.865+0000 7f6e52d35800 20 add_watcher() i=1 2024-09-14T10:49:52.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.865+0000 7f6e52d35800 20 add_watcher() i=2 2024-09-14T10:49:52.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.865+0000 7f6e52d35800 20 add_watcher() i=3 2024-09-14T10:49:52.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.865+0000 7f6e52d35800 20 add_watcher() i=4 2024-09-14T10:49:52.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.865+0000 7f6e52d35800 20 add_watcher() i=5 2024-09-14T10:49:52.864 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.865+0000 7f6e52d35800 20 add_watcher() i=6 2024-09-14T10:49:52.864 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.866+0000 7f6e52d35800 20 add_watcher() i=7 2024-09-14T10:49:52.864 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.866+0000 7f6e52d35800 2 all 8 watchers are set, enabling cache 2024-09-14T10:49:52.866 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.868+0000 7f6d057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:52.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.869+0000 7f6e52d35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:49:52.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.869+0000 7f6e52d35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:49:52.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.869+0000 7f6e52d35800 5 note: GC not initialized 2024-09-14T10:49:52.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.869+0000 7f6c7ffff640 20 reqs_thread_entry: start 2024-09-14T10:49:52.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.869+0000 7f6e52d35800 20 init_complete bucket index max shards: 11 2024-09-14T10:49:52.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.869+0000 7f6e52d35800 20 Filter name: none 2024-09-14T10:49:52.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.869+0000 7f6c7dffb640 20 reqs_thread_entry: start 2024-09-14T10:49:52.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.869+0000 7f6e52d35800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:49:52.868 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.869+0000 7f6e52d35800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.870+0000 7f6e52d35800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:49:52.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.870+0000 7f6e52d35800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:49:52.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.870+0000 7f6e52d35800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:49:52.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.870+0000 7f6e52d35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 : miss 2024-09-14T10:49:52.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.870+0000 7f6e52d35800 20 rados->read ofs=0 len=0 2024-09-14T10:49:52.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.870+0000 7f6e52d35800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:49:52.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.870+0000 7f6e52d35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 info.flags=0x17 2024-09-14T10:49:52.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.870+0000 7f6e52d35800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 to cache LRU end 2024-09-14T10:49:52.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.870+0000 7f6e52d35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:49:52.870 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.870+0000 7f6e52d35800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:49:52.870 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.870+0000 7f6e52d35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 2024-09-14T10:49:52.870 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.870+0000 7f6e52d35800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.0 2024-09-14T10:49:52.870 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.871+0000 7f6e52d35800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T10:49:52.870 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.871+0000 7f6e52d35800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:49:52.870 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.871+0000 7f6e52d35800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T10:49:52.870 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.871+0000 7f6e52d35800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.2 2024-09-14T10:49:52.871 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.871+0000 7f6e52d35800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T10:49:52.871 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.871+0000 7f6e52d35800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.3 2024-09-14T10:49:52.872 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.872+0000 7f6e52d35800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T10:49:52.872 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.872+0000 7f6e52d35800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.4 2024-09-14T10:49:52.872 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.872+0000 7f6e52d35800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T10:49:52.872 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.872+0000 7f6e52d35800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:49:52.872 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.873+0000 7f6e52d35800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T10:49:52.872 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.873+0000 7f6e52d35800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.6 2024-09-14T10:49:52.872 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.873+0000 7f6e52d35800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T10:49:52.872 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.873+0000 7f6e52d35800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.7 2024-09-14T10:49:52.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.874+0000 7f6e52d35800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T10:49:52.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.874+0000 7f6e52d35800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:49:52.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.875+0000 7f6e52d35800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T10:49:52.874 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.875+0000 7f6e52d35800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.9 2024-09-14T10:49:52.874 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.875+0000 7f6e52d35800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T10:49:52.874 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.875+0000 7f6e52d35800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:49:52.874 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.875+0000 7f6e52d35800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T10:49:52.874 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.875+0000 7f6e52d35800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T10:49:52.874 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.876+0000 7f6d057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:52.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.879+0000 7f6e52d35800 20 remove_watcher() i=0 2024-09-14T10:49:52.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.879+0000 7f6e52d35800 2 removed watcher, disabling cache 2024-09-14T10:49:52.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.880+0000 7f6e52d35800 20 remove_watcher() i=1 2024-09-14T10:49:52.879 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.881+0000 7f6e52d35800 20 remove_watcher() i=2 2024-09-14T10:49:52.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.882+0000 7f6e52d35800 20 remove_watcher() i=3 2024-09-14T10:49:52.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.883+0000 7f6e52d35800 20 remove_watcher() i=4 2024-09-14T10:49:52.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.884+0000 7f6e52d35800 20 remove_watcher() i=5 2024-09-14T10:49:52.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.885+0000 7f6e52d35800 20 remove_watcher() i=6 2024-09-14T10:49:52.884 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:52.887+0000 7f6e52d35800 20 remove_watcher() i=7 2024-09-14T10:49:52.897 INFO:tasks.workunit.client.0.smithi050.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T10:49:53.311 INFO:tasks.workunit.client.0.smithi050.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T10:49:54.725 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:54.726 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:54.827 INFO:tasks.workunit.client.0.smithi050.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:49:54.829 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T10:49:54.862 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:49:54.863 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:49:54.904 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:54.906+0000 7f6ab2a0f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:54.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:54.909+0000 7f6ab2a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:54.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:54.909+0000 7f6ab2a0f800 20 realm 2024-09-14T10:49:54.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:54.909+0000 7f6ab2a0f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:54.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:54.909+0000 7f6ab2a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:54.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:54.909+0000 7f6ab2a0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:49:54.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:54.909+0000 7f6ab2a0f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:54.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:54.909+0000 7f6ab2a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:54.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:54.909+0000 7f6ab2a0f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:54.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:54.910+0000 7f6ab2a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:54.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:54.910+0000 7f6ab2a0f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:54.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:54.911+0000 7f6ab2a0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:49:54.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:54.911+0000 7f6ab2a0f800 20 searching for the correct realm 2024-09-14T10:49:54.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:54.914+0000 7f6aad991640 0 -- 172.21.15.50:0/895982820 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f6aa8065030 msgr2=0x7f6aa806dbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:55.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.120+0000 7f6aae993640 0 -- 172.21.15.50:0/895982820 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55e1b3154bd0 msgr2=0x55e1b3156fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:55.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.125+0000 7f6ab2a0f800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:49:55.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.125+0000 7f6ab2a0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:49:55.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.125+0000 7f6ab2a0f800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:49:55.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.125+0000 7f6ab2a0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:49:55.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.125+0000 7f6ab2a0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:49:55.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.125+0000 7f6ab2a0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:49:55.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.126+0000 7f6ab2a0f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.126+0000 7f6ab2a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:55.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.126+0000 7f6ab2a0f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.126+0000 7f6ab2a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:55.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.126+0000 7f6ab2a0f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.126+0000 7f6ab2a0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:49:55.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.126+0000 7f6ab2a0f800 20 zone default found 2024-09-14T10:49:55.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.126+0000 7f6ab2a0f800 4 Realm: () 2024-09-14T10:49:55.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.126+0000 7f6ab2a0f800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:49:55.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.126+0000 7f6ab2a0f800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:49:55.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.126+0000 7f6ab2a0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:49:55.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.126+0000 7f6ab2a0f800 20 zonegroup default 2024-09-14T10:49:55.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.126+0000 7f6ab2a0f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.127+0000 7f6ab2a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:55.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.127+0000 7f6ab2a0f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.127+0000 7f6ab2a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:55.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.127+0000 7f6ab2a0f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.128+0000 7f6ab2a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:55.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.128+0000 7f6ab2a0f800 20 started sync module instance, tier type = 2024-09-14T10:49:55.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.128+0000 7f6ab2a0f800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:49:55.135 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.138+0000 7f6ab2a0f800 20 add_watcher() i=0 2024-09-14T10:49:55.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.138+0000 7f6ab2a0f800 20 add_watcher() i=1 2024-09-14T10:49:55.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.138+0000 7f6ab2a0f800 20 add_watcher() i=2 2024-09-14T10:49:55.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.138+0000 7f6ab2a0f800 20 add_watcher() i=3 2024-09-14T10:49:55.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.138+0000 7f6ab2a0f800 20 add_watcher() i=4 2024-09-14T10:49:55.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.138+0000 7f6ab2a0f800 20 add_watcher() i=5 2024-09-14T10:49:55.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.138+0000 7f6ab2a0f800 20 add_watcher() i=6 2024-09-14T10:49:55.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.139+0000 7f6ab2a0f800 20 add_watcher() i=7 2024-09-14T10:49:55.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.139+0000 7f6ab2a0f800 2 all 8 watchers are set, enabling cache 2024-09-14T10:49:55.138 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.141+0000 7f6964fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:55.139 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.141+0000 7f6ab2a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:49:55.139 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.141+0000 7f6ab2a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:49:55.140 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.141+0000 7f6ab2a0f800 5 note: GC not initialized 2024-09-14T10:49:55.140 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.141+0000 7f68df7fe640 20 reqs_thread_entry: start 2024-09-14T10:49:55.140 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.141+0000 7f6ab2a0f800 20 init_complete bucket index max shards: 11 2024-09-14T10:49:55.140 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.142+0000 7f6ab2a0f800 20 Filter name: none 2024-09-14T10:49:55.140 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.142+0000 7f68dd7fa640 20 reqs_thread_entry: start 2024-09-14T10:49:55.140 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.142+0000 7f6ab2a0f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.141 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.142+0000 7f6ab2a0f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:49:55.141 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.142+0000 7f6ab2a0f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.143+0000 7f6ab2a0f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:49:55.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.143+0000 7f6ab2a0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:49:55.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.143+0000 7f6ab2a0f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:49:55.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.143+0000 7f6ab2a0f800 20 INFO: main: starting shard=0 2024-09-14T10:49:55.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.143+0000 7f6ab2a0f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.0 2024-09-14T10:49:55.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.143+0000 7f6ab2a0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.143+0000 7f6ab2a0f800 20 INFO: main: starting shard=1 2024-09-14T10:49:55.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.143+0000 7f6ab2a0f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:49:55.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.144+0000 7f6ab2a0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.144+0000 7f6ab2a0f800 20 INFO: main: starting shard=2 2024-09-14T10:49:55.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.144+0000 7f6ab2a0f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.2 2024-09-14T10:49:55.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.144+0000 7f6ab2a0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.144+0000 7f6ab2a0f800 20 INFO: main: starting shard=3 2024-09-14T10:49:55.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.144+0000 7f6ab2a0f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.3 2024-09-14T10:49:55.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.145+0000 7f6ab2a0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.145+0000 7f6ab2a0f800 20 INFO: main: starting shard=4 2024-09-14T10:49:55.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.145+0000 7f6ab2a0f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.4 2024-09-14T10:49:55.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.146+0000 7f6ab2a0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.146+0000 7f6ab2a0f800 20 INFO: main: starting shard=5 2024-09-14T10:49:55.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.146+0000 7f6ab2a0f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:49:55.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.146+0000 7f6ab2a0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.146+0000 7f6ab2a0f800 20 INFO: main: starting shard=6 2024-09-14T10:49:55.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.146+0000 7f6ab2a0f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.6 2024-09-14T10:49:55.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.146+0000 7f6ab2a0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.146+0000 7f6ab2a0f800 20 INFO: main: starting shard=7 2024-09-14T10:49:55.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.147+0000 7f6ab2a0f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.7 2024-09-14T10:49:55.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.147+0000 7f6ab2a0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.147+0000 7f6ab2a0f800 20 INFO: main: starting shard=8 2024-09-14T10:49:55.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.147+0000 7f6ab2a0f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:49:55.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.148+0000 7f6ab2a0f800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T10:49:55.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.148+0000 7f6ab2a0f800 20 INFO: main: starting shard=9 2024-09-14T10:49:55.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.148+0000 7f6ab2a0f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.9 2024-09-14T10:49:55.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.149+0000 7f6ab2a0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.149+0000 7f6ab2a0f800 20 INFO: main: starting shard=10 2024-09-14T10:49:55.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.149+0000 7f6ab2a0f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:49:55.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.149+0000 7f6ab2a0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.149+0000 7f6ab2a0f800 20 INFO: main: done 2024-09-14T10:49:55.148 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.150+0000 7f6964fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:55.150 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.153+0000 7f6ab2a0f800 20 remove_watcher() i=0 2024-09-14T10:49:55.150 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.153+0000 7f6ab2a0f800 2 removed watcher, disabling cache 2024-09-14T10:49:55.152 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.154+0000 7f6ab2a0f800 20 remove_watcher() i=1 2024-09-14T10:49:55.153 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.155+0000 7f6ab2a0f800 20 remove_watcher() i=2 2024-09-14T10:49:55.154 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.156+0000 7f6ab2a0f800 20 remove_watcher() i=3 2024-09-14T10:49:55.155 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.157+0000 7f6ab2a0f800 20 remove_watcher() i=4 2024-09-14T10:49:55.156 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.159+0000 7f6ab2a0f800 20 remove_watcher() i=5 2024-09-14T10:49:55.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.160+0000 7f6ab2a0f800 20 remove_watcher() i=6 2024-09-14T10:49:55.158 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.161+0000 7f6ab2a0f800 20 remove_watcher() i=7 2024-09-14T10:49:55.173 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:55.173 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:55.199 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:55.199 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:55.287 INFO:tasks.workunit.client.0.smithi050.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:49:55.288 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T10:49:55.322 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:49:55.322 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:49:55.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.363+0000 7f591692a800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.365+0000 7f591692a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:55.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.365+0000 7f591692a800 20 realm 2024-09-14T10:49:55.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.365+0000 7f591692a800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.366+0000 7f591692a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:55.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.366+0000 7f591692a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:49:55.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.366+0000 7f591692a800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.366+0000 7f591692a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:55.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.366+0000 7f591692a800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.366+0000 7f591692a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:55.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.366+0000 7f591692a800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.365 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.367+0000 7f591692a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:49:55.365 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.367+0000 7f591692a800 20 searching for the correct realm 2024-09-14T10:49:55.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.371+0000 7f5911e1d640 0 -- 172.21.15.50:0/1273451333 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f590c094e10 msgr2=0x7f590c078a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:55.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.375+0000 7f5911e1d640 0 -- 172.21.15.50:0/1273451333 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x555a75b238b0 msgr2=0x555a75b25d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:55.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.379+0000 7f591692a800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:49:55.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.379+0000 7f591692a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:49:55.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.379+0000 7f591692a800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:49:55.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.379+0000 7f591692a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:49:55.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.379+0000 7f591692a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:49:55.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.379+0000 7f591692a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:49:55.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.379+0000 7f591692a800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.379+0000 7f591692a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:55.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.379+0000 7f591692a800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.378 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.379+0000 7f591692a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:55.378 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.379+0000 7f591692a800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.380+0000 7f591692a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:49:55.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.380+0000 7f591692a800 20 zone default found 2024-09-14T10:49:55.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.380+0000 7f591692a800 4 Realm: () 2024-09-14T10:49:55.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.380+0000 7f591692a800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:49:55.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.380+0000 7f591692a800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:49:55.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.380+0000 7f591692a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:49:55.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.380+0000 7f591692a800 20 zonegroup default 2024-09-14T10:49:55.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.380+0000 7f591692a800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.380+0000 7f591692a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:55.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.380+0000 7f591692a800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.380+0000 7f591692a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:55.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.380+0000 7f591692a800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.380+0000 7f591692a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:55.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.381+0000 7f591692a800 20 started sync module instance, tier type = 2024-09-14T10:49:55.380 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.381+0000 7f591692a800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:49:55.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.390+0000 7f591692a800 20 add_watcher() i=0 2024-09-14T10:49:55.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.390+0000 7f591692a800 20 add_watcher() i=1 2024-09-14T10:49:55.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.390+0000 7f591692a800 20 add_watcher() i=2 2024-09-14T10:49:55.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.390+0000 7f591692a800 20 add_watcher() i=3 2024-09-14T10:49:55.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.390+0000 7f591692a800 20 add_watcher() i=4 2024-09-14T10:49:55.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.390+0000 7f591692a800 20 add_watcher() i=5 2024-09-14T10:49:55.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.390+0000 7f591692a800 20 add_watcher() i=6 2024-09-14T10:49:55.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.391+0000 7f591692a800 20 add_watcher() i=7 2024-09-14T10:49:55.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.391+0000 7f591692a800 2 all 8 watchers are set, enabling cache 2024-09-14T10:49:55.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.393+0000 7f57c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:55.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.393+0000 7f591692a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:49:55.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.393+0000 7f591692a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:49:55.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.393+0000 7f591692a800 5 note: GC not initialized 2024-09-14T10:49:55.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.393+0000 7f57437fe640 20 reqs_thread_entry: start 2024-09-14T10:49:55.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.393+0000 7f591692a800 20 init_complete bucket index max shards: 11 2024-09-14T10:49:55.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.394+0000 7f591692a800 20 Filter name: none 2024-09-14T10:49:55.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.394+0000 7f57417fa640 20 reqs_thread_entry: start 2024-09-14T10:49:55.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.394+0000 7f591692a800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.394+0000 7f591692a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:49:55.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.394+0000 7f591692a800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.394+0000 7f591692a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:49:55.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.394+0000 7f591692a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:49:55.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.394+0000 7f591692a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:49:55.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.394+0000 7f591692a800 20 INFO: main: starting shard=0 2024-09-14T10:49:55.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.394+0000 7f591692a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.0 2024-09-14T10:49:55.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.395+0000 7f591692a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.395+0000 7f591692a800 20 INFO: main: starting shard=1 2024-09-14T10:49:55.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.395+0000 7f591692a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:49:55.394 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.396+0000 7f591692a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.394 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.396+0000 7f591692a800 20 INFO: main: starting shard=2 2024-09-14T10:49:55.394 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.396+0000 7f591692a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.2 2024-09-14T10:49:55.394 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.396+0000 7f591692a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.396+0000 7f591692a800 20 INFO: main: starting shard=3 2024-09-14T10:49:55.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.396+0000 7f591692a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.3 2024-09-14T10:49:55.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.397+0000 7f591692a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.397+0000 7f591692a800 20 INFO: main: starting shard=4 2024-09-14T10:49:55.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.397+0000 7f591692a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.4 2024-09-14T10:49:55.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.397+0000 7f591692a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.397+0000 7f591692a800 20 INFO: main: starting shard=5 2024-09-14T10:49:55.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.397+0000 7f591692a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:49:55.396 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.398+0000 7f591692a800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T10:49:55.396 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.398+0000 7f591692a800 20 INFO: main: starting shard=6 2024-09-14T10:49:55.396 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.398+0000 7f591692a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.6 2024-09-14T10:49:55.396 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.398+0000 7f591692a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.396 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.398+0000 7f591692a800 20 INFO: main: starting shard=7 2024-09-14T10:49:55.396 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.398+0000 7f591692a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.7 2024-09-14T10:49:55.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.399+0000 7f591692a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.399+0000 7f591692a800 20 INFO: main: starting shard=8 2024-09-14T10:49:55.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.399+0000 7f591692a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:49:55.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.400+0000 7f591692a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.400+0000 7f591692a800 20 INFO: main: starting shard=9 2024-09-14T10:49:55.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.400+0000 7f591692a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.9 2024-09-14T10:49:55.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.400+0000 7f591692a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.400+0000 7f591692a800 20 INFO: main: starting shard=10 2024-09-14T10:49:55.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.400+0000 7f591692a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:49:55.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.401+0000 7f591692a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.401+0000 7f591692a800 20 INFO: main: done 2024-09-14T10:49:55.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.402+0000 7f57c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:55.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.404+0000 7f591692a800 20 remove_watcher() i=0 2024-09-14T10:49:55.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.404+0000 7f591692a800 2 removed watcher, disabling cache 2024-09-14T10:49:55.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.405+0000 7f591692a800 20 remove_watcher() i=1 2024-09-14T10:49:55.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.406+0000 7f591692a800 20 remove_watcher() i=2 2024-09-14T10:49:55.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.407+0000 7f591692a800 20 remove_watcher() i=3 2024-09-14T10:49:55.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.408+0000 7f591692a800 20 remove_watcher() i=4 2024-09-14T10:49:55.407 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.409+0000 7f591692a800 20 remove_watcher() i=5 2024-09-14T10:49:55.408 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.411+0000 7f591692a800 20 remove_watcher() i=6 2024-09-14T10:49:55.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.412+0000 7f591692a800 20 remove_watcher() i=7 2024-09-14T10:49:55.423 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:55.423 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:55.447 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:55.447 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:55.536 INFO:tasks.workunit.client.0.smithi050.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:49:55.537 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T10:49:55.570 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:49:55.570 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:49:55.609 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.612+0000 7f440da11800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.613+0000 7f440da11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:55.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.613+0000 7f440da11800 20 realm 2024-09-14T10:49:55.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.613+0000 7f440da11800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.614+0000 7f440da11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:55.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.614+0000 7f440da11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:49:55.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.614+0000 7f440da11800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.614+0000 7f440da11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:55.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.614+0000 7f440da11800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.615+0000 7f440da11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:55.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.615+0000 7f440da11800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.615+0000 7f440da11800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:49:55.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.615+0000 7f440da11800 20 searching for the correct realm 2024-09-14T10:49:55.616 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.618+0000 7f4408947640 0 -- 172.21.15.50:0/2945852046 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f4404055920 msgr2=0x7f440407e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:49:55.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.824+0000 7f4409949640 0 -- 172.21.15.50:0/2945852046 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55731f549730 msgr2=0x55731f54bba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:55.827 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.829+0000 7f440da11800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:49:55.827 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.829+0000 7f440da11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:49:55.827 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.829+0000 7f440da11800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:49:55.827 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.829+0000 7f440da11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:49:55.827 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.829+0000 7f440da11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:49:55.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.829+0000 7f440da11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:49:55.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.829+0000 7f440da11800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.829+0000 7f440da11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:55.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.829+0000 7f440da11800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.829+0000 7f440da11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:55.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.829+0000 7f440da11800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.830+0000 7f440da11800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:49:55.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.830+0000 7f440da11800 20 zone default found 2024-09-14T10:49:55.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.830+0000 7f440da11800 4 Realm: () 2024-09-14T10:49:55.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.830+0000 7f440da11800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:49:55.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.830+0000 7f440da11800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:49:55.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.830+0000 7f440da11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:49:55.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.830+0000 7f440da11800 20 zonegroup default 2024-09-14T10:49:55.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.830+0000 7f440da11800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.830+0000 7f440da11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:55.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.830+0000 7f440da11800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.831+0000 7f440da11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:55.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.831+0000 7f440da11800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.831+0000 7f440da11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:55.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.831+0000 7f440da11800 20 started sync module instance, tier type = 2024-09-14T10:49:55.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.831+0000 7f440da11800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:49:55.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.840+0000 7f440da11800 20 add_watcher() i=0 2024-09-14T10:49:55.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.840+0000 7f440da11800 20 add_watcher() i=1 2024-09-14T10:49:55.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.840+0000 7f440da11800 20 add_watcher() i=2 2024-09-14T10:49:55.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.840+0000 7f440da11800 20 add_watcher() i=3 2024-09-14T10:49:55.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.840+0000 7f440da11800 20 add_watcher() i=4 2024-09-14T10:49:55.839 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.840+0000 7f440da11800 20 add_watcher() i=5 2024-09-14T10:49:55.839 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.840+0000 7f440da11800 20 add_watcher() i=6 2024-09-14T10:49:55.839 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.841+0000 7f440da11800 20 add_watcher() i=7 2024-09-14T10:49:55.839 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.841+0000 7f440da11800 2 all 8 watchers are set, enabling cache 2024-09-14T10:49:55.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.843+0000 7f42bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:55.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.843+0000 7f440da11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:49:55.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.843+0000 7f440da11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:49:55.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.843+0000 7f440da11800 5 note: GC not initialized 2024-09-14T10:49:55.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.843+0000 7f42be7e4640 20 reqs_thread_entry: start 2024-09-14T10:49:55.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.844+0000 7f440da11800 20 init_complete bucket index max shards: 11 2024-09-14T10:49:55.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.844+0000 7f440da11800 20 Filter name: none 2024-09-14T10:49:55.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.844+0000 7f422ffff640 20 reqs_thread_entry: start 2024-09-14T10:49:55.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.844+0000 7f440da11800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.844+0000 7f440da11800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:49:55.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.844+0000 7f440da11800 20 rados->read ofs=0 len=0 2024-09-14T10:49:55.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.845+0000 7f440da11800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:49:55.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.845+0000 7f440da11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:49:55.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.845+0000 7f440da11800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:49:55.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.845+0000 7f440da11800 20 INFO: main: starting shard=0 2024-09-14T10:49:55.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.845+0000 7f440da11800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.0 2024-09-14T10:49:55.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.845+0000 7f440da11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.844 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.845+0000 7f440da11800 20 INFO: main: starting shard=1 2024-09-14T10:49:55.844 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.845+0000 7f440da11800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:49:55.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.846+0000 7f440da11800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T10:49:55.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.846+0000 7f440da11800 20 INFO: main: starting shard=2 2024-09-14T10:49:55.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.846+0000 7f440da11800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.2 2024-09-14T10:49:55.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.846+0000 7f440da11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.846+0000 7f440da11800 20 INFO: main: starting shard=3 2024-09-14T10:49:55.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.846+0000 7f440da11800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.3 2024-09-14T10:49:55.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.846+0000 7f440da11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.846+0000 7f440da11800 20 INFO: main: starting shard=4 2024-09-14T10:49:55.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.846+0000 7f440da11800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.4 2024-09-14T10:49:55.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.847+0000 7f440da11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.847+0000 7f440da11800 20 INFO: main: starting shard=5 2024-09-14T10:49:55.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.847+0000 7f440da11800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:49:55.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.848+0000 7f440da11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.848+0000 7f440da11800 20 INFO: main: starting shard=6 2024-09-14T10:49:55.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.848+0000 7f440da11800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.6 2024-09-14T10:49:55.847 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.848+0000 7f440da11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.847 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.848+0000 7f440da11800 20 INFO: main: starting shard=7 2024-09-14T10:49:55.847 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.848+0000 7f440da11800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.7 2024-09-14T10:49:55.847 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.849+0000 7f440da11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.847 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.849+0000 7f440da11800 20 INFO: main: starting shard=8 2024-09-14T10:49:55.847 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.849+0000 7f440da11800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:49:55.847 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.849+0000 7f440da11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.849+0000 7f440da11800 20 INFO: main: starting shard=9 2024-09-14T10:49:55.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.849+0000 7f440da11800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.9 2024-09-14T10:49:55.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.850+0000 7f440da11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.850+0000 7f440da11800 20 INFO: main: starting shard=10 2024-09-14T10:49:55.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.850+0000 7f440da11800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:49:55.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.850+0000 7f440da11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:55.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.850+0000 7f440da11800 20 INFO: main: done 2024-09-14T10:49:55.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.851+0000 7f42bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:55.851 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.853+0000 7f440da11800 20 remove_watcher() i=0 2024-09-14T10:49:55.851 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.853+0000 7f440da11800 2 removed watcher, disabling cache 2024-09-14T10:49:55.852 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.854+0000 7f440da11800 20 remove_watcher() i=1 2024-09-14T10:49:55.854 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.856+0000 7f440da11800 20 remove_watcher() i=2 2024-09-14T10:49:55.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.857+0000 7f440da11800 20 remove_watcher() i=3 2024-09-14T10:49:55.856 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.858+0000 7f440da11800 20 remove_watcher() i=4 2024-09-14T10:49:55.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.859+0000 7f440da11800 20 remove_watcher() i=5 2024-09-14T10:49:55.858 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.860+0000 7f440da11800 20 remove_watcher() i=6 2024-09-14T10:49:55.859 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:55.861+0000 7f440da11800 20 remove_watcher() i=7 2024-09-14T10:49:55.873 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:55.873 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:55.898 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:55.898 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:55.985 INFO:tasks.workunit.client.0.smithi050.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:49:55.986 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T10:49:56.020 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:49:56.020 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:49:56.059 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.061+0000 7f0e92487800 20 rados->read ofs=0 len=0 2024-09-14T10:49:56.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.063+0000 7f0e92487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:56.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.063+0000 7f0e92487800 20 realm 2024-09-14T10:49:56.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.063+0000 7f0e92487800 20 rados->read ofs=0 len=0 2024-09-14T10:49:56.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.063+0000 7f0e92487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:56.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.063+0000 7f0e92487800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:49:56.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.063+0000 7f0e92487800 20 rados->read ofs=0 len=0 2024-09-14T10:49:56.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.064+0000 7f0e92487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:56.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.064+0000 7f0e92487800 20 rados->read ofs=0 len=0 2024-09-14T10:49:56.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.064+0000 7f0e92487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:56.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.064+0000 7f0e92487800 20 rados->read ofs=0 len=0 2024-09-14T10:49:56.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.065+0000 7f0e92487800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:49:56.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.065+0000 7f0e92487800 20 searching for the correct realm 2024-09-14T10:49:56.066 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.068+0000 7f0e8f770640 0 -- 172.21.15.50:0/3552517591 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f0e88076480 msgr2=0x7f0e88041a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:56.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.273+0000 7f0e8f770640 0 -- 172.21.15.50:0/3552517591 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55ff8a94b910 msgr2=0x55ff8a94dd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:56.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.277+0000 7f0e92487800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:49:56.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.277+0000 7f0e92487800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:49:56.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.277+0000 7f0e92487800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:49:56.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.277+0000 7f0e92487800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:49:56.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.277+0000 7f0e92487800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:49:56.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.277+0000 7f0e92487800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:49:56.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.277+0000 7f0e92487800 20 rados->read ofs=0 len=0 2024-09-14T10:49:56.276 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.277+0000 7f0e92487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:56.276 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.277+0000 7f0e92487800 20 rados->read ofs=0 len=0 2024-09-14T10:49:56.276 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.278+0000 7f0e92487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:56.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.278+0000 7f0e92487800 20 rados->read ofs=0 len=0 2024-09-14T10:49:56.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.278+0000 7f0e92487800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:49:56.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.278+0000 7f0e92487800 20 zone default found 2024-09-14T10:49:56.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.278+0000 7f0e92487800 4 Realm: () 2024-09-14T10:49:56.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.278+0000 7f0e92487800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:49:56.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.278+0000 7f0e92487800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:49:56.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.278+0000 7f0e92487800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:49:56.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.278+0000 7f0e92487800 20 zonegroup default 2024-09-14T10:49:56.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.278+0000 7f0e92487800 20 rados->read ofs=0 len=0 2024-09-14T10:49:56.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.278+0000 7f0e92487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:56.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.278+0000 7f0e92487800 20 rados->read ofs=0 len=0 2024-09-14T10:49:56.278 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.279+0000 7f0e92487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:56.278 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.279+0000 7f0e92487800 20 rados->read ofs=0 len=0 2024-09-14T10:49:56.278 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.279+0000 7f0e92487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:56.278 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.279+0000 7f0e92487800 20 started sync module instance, tier type = 2024-09-14T10:49:56.278 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.279+0000 7f0e92487800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:49:56.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.288+0000 7f0e92487800 20 add_watcher() i=0 2024-09-14T10:49:56.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.288+0000 7f0e92487800 20 add_watcher() i=1 2024-09-14T10:49:56.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.288+0000 7f0e92487800 20 add_watcher() i=2 2024-09-14T10:49:56.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.288+0000 7f0e92487800 20 add_watcher() i=3 2024-09-14T10:49:56.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.288+0000 7f0e92487800 20 add_watcher() i=4 2024-09-14T10:49:56.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.288+0000 7f0e92487800 20 add_watcher() i=5 2024-09-14T10:49:56.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.288+0000 7f0e92487800 20 add_watcher() i=6 2024-09-14T10:49:56.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.289+0000 7f0e92487800 20 add_watcher() i=7 2024-09-14T10:49:56.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.289+0000 7f0e92487800 2 all 8 watchers are set, enabling cache 2024-09-14T10:49:56.289 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.291+0000 7f0d45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:56.289 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.291+0000 7f0e92487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:49:56.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.291+0000 7f0e92487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:49:56.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.291+0000 7f0e92487800 5 note: GC not initialized 2024-09-14T10:49:56.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.291+0000 7f0d44fe1640 20 reqs_thread_entry: start 2024-09-14T10:49:56.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.291+0000 7f0e92487800 20 init_complete bucket index max shards: 11 2024-09-14T10:49:56.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.292+0000 7f0e92487800 20 Filter name: none 2024-09-14T10:49:56.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.292+0000 7f0cbe7fc640 20 reqs_thread_entry: start 2024-09-14T10:49:56.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.292+0000 7f0e92487800 20 rados->read ofs=0 len=0 2024-09-14T10:49:56.291 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.292+0000 7f0e92487800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:49:56.291 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.292+0000 7f0e92487800 20 rados->read ofs=0 len=0 2024-09-14T10:49:56.291 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.293+0000 7f0e92487800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:49:56.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.293+0000 7f0e92487800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:49:56.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.293+0000 7f0e92487800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:49:56.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.293+0000 7f0e92487800 20 INFO: main: starting shard=0 2024-09-14T10:49:56.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.293+0000 7f0e92487800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.0 2024-09-14T10:49:56.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.293+0000 7f0e92487800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:56.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.293+0000 7f0e92487800 20 INFO: main: starting shard=1 2024-09-14T10:49:56.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.293+0000 7f0e92487800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:49:56.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.294+0000 7f0e92487800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:56.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.294+0000 7f0e92487800 20 INFO: main: starting shard=2 2024-09-14T10:49:56.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.294+0000 7f0e92487800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.2 2024-09-14T10:49:56.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.294+0000 7f0e92487800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:56.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.294+0000 7f0e92487800 20 INFO: main: starting shard=3 2024-09-14T10:49:56.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.294+0000 7f0e92487800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.3 2024-09-14T10:49:56.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.294+0000 7f0e92487800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:56.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.294+0000 7f0e92487800 20 INFO: main: starting shard=4 2024-09-14T10:49:56.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.294+0000 7f0e92487800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.4 2024-09-14T10:49:56.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.295+0000 7f0e92487800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:56.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.295+0000 7f0e92487800 20 INFO: main: starting shard=5 2024-09-14T10:49:56.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.295+0000 7f0e92487800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:49:56.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.296+0000 7f0e92487800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:56.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.296+0000 7f0e92487800 20 INFO: main: starting shard=6 2024-09-14T10:49:56.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.296+0000 7f0e92487800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.6 2024-09-14T10:49:56.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.296+0000 7f0e92487800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:56.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.296+0000 7f0e92487800 20 INFO: main: starting shard=7 2024-09-14T10:49:56.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.296+0000 7f0e92487800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.7 2024-09-14T10:49:56.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.297+0000 7f0e92487800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:56.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.297+0000 7f0e92487800 20 INFO: main: starting shard=8 2024-09-14T10:49:56.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.297+0000 7f0e92487800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:49:56.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.298+0000 7f0e92487800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:56.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.298+0000 7f0e92487800 20 INFO: main: starting shard=9 2024-09-14T10:49:56.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.298+0000 7f0e92487800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.9 2024-09-14T10:49:56.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.298+0000 7f0e92487800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:56.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.298+0000 7f0e92487800 20 INFO: main: starting shard=10 2024-09-14T10:49:56.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.298+0000 7f0e92487800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:49:56.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.299+0000 7f0e92487800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T10:49:56.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.299+0000 7f0e92487800 20 INFO: main: done 2024-09-14T10:49:56.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.300+0000 7f0d45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:56.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.302+0000 7f0e92487800 20 remove_watcher() i=0 2024-09-14T10:49:56.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.302+0000 7f0e92487800 2 removed watcher, disabling cache 2024-09-14T10:49:56.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.303+0000 7f0e92487800 20 remove_watcher() i=1 2024-09-14T10:49:56.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.304+0000 7f0e92487800 20 remove_watcher() i=2 2024-09-14T10:49:56.303 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.305+0000 7f0e92487800 20 remove_watcher() i=3 2024-09-14T10:49:56.304 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.306+0000 7f0e92487800 20 remove_watcher() i=4 2024-09-14T10:49:56.305 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.307+0000 7f0e92487800 20 remove_watcher() i=5 2024-09-14T10:49:56.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.308+0000 7f0e92487800 20 remove_watcher() i=6 2024-09-14T10:49:56.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:56.309+0000 7f0e92487800 20 remove_watcher() i=7 2024-09-14T10:49:56.322 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:56.322 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:56.349 INFO:tasks.workunit.client.0.smithi050.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T10:49:56.760 INFO:tasks.workunit.client.0.smithi050.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T10:49:57.183 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-14T10:49:57.184 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:49:57.185 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T10:49:57.218 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:49:57.218 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:49:57.258 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.260+0000 7f0ae2c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:57.259 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.262+0000 7f0ae2c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:57.260 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.262+0000 7f0ae2c2f800 20 realm 2024-09-14T10:49:57.260 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.262+0000 7f0ae2c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:57.260 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.262+0000 7f0ae2c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:57.260 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.262+0000 7f0ae2c2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:49:57.260 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.262+0000 7f0ae2c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:57.261 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.262+0000 7f0ae2c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:57.261 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.262+0000 7f0ae2c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:57.261 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.263+0000 7f0ae2c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:57.261 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.263+0000 7f0ae2c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:57.262 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.264+0000 7f0ae2c2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:49:57.262 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.264+0000 7f0ae2c2f800 20 searching for the correct realm 2024-09-14T10:49:57.265 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.267+0000 7f0adff1f640 0 -- 172.21.15.50:0/257021410 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f0ad800e040 msgr2=0x7f0ad806fc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:57.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.473+0000 7f0ae0f21640 0 -- 172.21.15.50:0/257021410 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x562451c45790 msgr2=0x562451c47c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:57.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.477+0000 7f0ae2c2f800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:49:57.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.477+0000 7f0ae2c2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:49:57.476 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.477+0000 7f0ae2c2f800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:49:57.476 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.477+0000 7f0ae2c2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:49:57.476 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.477+0000 7f0ae2c2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:49:57.476 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.477+0000 7f0ae2c2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:49:57.476 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.477+0000 7f0ae2c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:57.476 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.478+0000 7f0ae2c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:57.476 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.478+0000 7f0ae2c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:57.477 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.478+0000 7f0ae2c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:57.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.478+0000 7f0ae2c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:57.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.478+0000 7f0ae2c2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:49:57.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.478+0000 7f0ae2c2f800 20 zone default found 2024-09-14T10:49:57.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.478+0000 7f0ae2c2f800 4 Realm: () 2024-09-14T10:49:57.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.478+0000 7f0ae2c2f800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:49:57.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.478+0000 7f0ae2c2f800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:49:57.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.478+0000 7f0ae2c2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:49:57.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.478+0000 7f0ae2c2f800 20 zonegroup default 2024-09-14T10:49:57.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.478+0000 7f0ae2c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:57.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.479+0000 7f0ae2c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:57.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.479+0000 7f0ae2c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:57.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.479+0000 7f0ae2c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:57.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.479+0000 7f0ae2c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:57.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.479+0000 7f0ae2c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:57.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.479+0000 7f0ae2c2f800 20 started sync module instance, tier type = 2024-09-14T10:49:57.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.479+0000 7f0ae2c2f800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:49:57.487 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.490+0000 7f0ae2c2f800 20 add_watcher() i=0 2024-09-14T10:49:57.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.490+0000 7f0ae2c2f800 20 add_watcher() i=1 2024-09-14T10:49:57.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.490+0000 7f0ae2c2f800 20 add_watcher() i=2 2024-09-14T10:49:57.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.490+0000 7f0ae2c2f800 20 add_watcher() i=3 2024-09-14T10:49:57.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.490+0000 7f0ae2c2f800 20 add_watcher() i=4 2024-09-14T10:49:57.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.490+0000 7f0ae2c2f800 20 add_watcher() i=5 2024-09-14T10:49:57.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.490+0000 7f0ae2c2f800 20 add_watcher() i=6 2024-09-14T10:49:57.489 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.492+0000 7f0ae2c2f800 20 add_watcher() i=7 2024-09-14T10:49:57.489 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.492+0000 7f0ae2c2f800 2 all 8 watchers are set, enabling cache 2024-09-14T10:49:57.491 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.494+0000 7f0996fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:57.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.494+0000 7f0ae2c2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:49:57.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.494+0000 7f0ae2c2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:49:57.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.494+0000 7f0ae2c2f800 5 note: GC not initialized 2024-09-14T10:49:57.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.494+0000 7f0995fdb640 20 reqs_thread_entry: start 2024-09-14T10:49:57.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.494+0000 7f0ae2c2f800 20 init_complete bucket index max shards: 11 2024-09-14T10:49:57.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.494+0000 7f0ae2c2f800 20 Filter name: none 2024-09-14T10:49:57.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.494+0000 7f09077fe640 20 reqs_thread_entry: start 2024-09-14T10:49:57.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.495+0000 7f0ae2c2f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:49:57.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.495+0000 7f0ae2c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:57.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.495+0000 7f0ae2c2f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:49:57.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.495+0000 7f0ae2c2f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:49:57.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.495+0000 7f0ae2c2f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:49:57.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.495+0000 7f0ae2c2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 : miss 2024-09-14T10:49:57.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.495+0000 7f0ae2c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:49:57.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.495+0000 7f0ae2c2f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:49:57.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.495+0000 7f0ae2c2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 info.flags=0x17 2024-09-14T10:49:57.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.495+0000 7f0ae2c2f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 to cache LRU end 2024-09-14T10:49:57.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.495+0000 7f0ae2c2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:49:57.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.495+0000 7f0ae2c2f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:49:57.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.495+0000 7f0ae2c2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 2024-09-14T10:49:57.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.496+0000 7f0ae2c2f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.0 2024-09-14T10:49:57.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.496+0000 7f0ae2c2f800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T10:49:57.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.496+0000 7f0ae2c2f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:49:57.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.496+0000 7f0ae2c2f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.2 2024-09-14T10:49:57.496 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.497+0000 7f0ae2c2f800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T10:49:57.496 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.497+0000 7f0ae2c2f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.3 2024-09-14T10:49:57.496 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.497+0000 7f0ae2c2f800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T10:49:57.496 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.497+0000 7f0ae2c2f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.4 2024-09-14T10:49:57.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.498+0000 7f0ae2c2f800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T10:49:57.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.498+0000 7f0ae2c2f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:49:57.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.499+0000 7f0ae2c2f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.6 2024-09-14T10:49:57.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.499+0000 7f0ae2c2f800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T10:49:57.498 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.499+0000 7f0ae2c2f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.7 2024-09-14T10:49:57.498 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.500+0000 7f0ae2c2f800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T10:49:57.498 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.500+0000 7f0ae2c2f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:49:57.498 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.500+0000 7f0ae2c2f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.9 2024-09-14T10:49:57.499 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.502+0000 7f0ae2c2f800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T10:49:57.500 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.502+0000 7f0ae2c2f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:49:57.500 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.502+0000 7f0ae2c2f800 1 NOTICE: finished shard 1 (1 entries found) 2024-09-14T10:49:57.500 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.502+0000 7f0ae2c2f800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-14T10:49:57.500 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.502+0000 7f0ae2c2f800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-14T10:49:57.500 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.502+0000 7f0ae2c2f800 1 NOTICE: finished shard 10 (1 entries found) 2024-09-14T10:49:57.501 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.502+0000 7f0ae2c2f800 1 NOTICE: finished all shards (4 entries found) 2024-09-14T10:49:57.501 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.503+0000 7f0996fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:57.503 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.506+0000 7f0ae2c2f800 20 remove_watcher() i=0 2024-09-14T10:49:57.503 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.506+0000 7f0ae2c2f800 2 removed watcher, disabling cache 2024-09-14T10:49:57.504 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.507+0000 7f0ae2c2f800 20 remove_watcher() i=1 2024-09-14T10:49:57.505 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.508+0000 7f0ae2c2f800 20 remove_watcher() i=2 2024-09-14T10:49:57.506 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.509+0000 7f0ae2c2f800 20 remove_watcher() i=3 2024-09-14T10:49:57.507 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.510+0000 7f0ae2c2f800 20 remove_watcher() i=4 2024-09-14T10:49:57.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.511+0000 7f0ae2c2f800 20 remove_watcher() i=5 2024-09-14T10:49:57.510 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.512+0000 7f0ae2c2f800 20 remove_watcher() i=6 2024-09-14T10:49:57.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.513+0000 7f0ae2c2f800 20 remove_watcher() i=7 2024-09-14T10:49:57.522 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: unlinked entries are not listable 2024-09-14T10:49:57.522 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:49:57.525 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:57.525 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:57.650 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-14T10:49:57.650 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:49:57.652 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:57.652 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:57.721 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:57.721 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:57.782 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-14T10:49:57.782 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:49:57.783 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T10:49:57.819 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:49:57.819 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:49:57.859 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.861+0000 7fddb1daf800 20 rados->read ofs=0 len=0 2024-09-14T10:49:57.862 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.863+0000 7fddb1daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:57.862 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.863+0000 7fddb1daf800 20 realm 2024-09-14T10:49:57.862 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.863+0000 7fddb1daf800 20 rados->read ofs=0 len=0 2024-09-14T10:49:57.862 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.863+0000 7fddb1daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:57.862 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.863+0000 7fddb1daf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:49:57.862 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.863+0000 7fddb1daf800 20 rados->read ofs=0 len=0 2024-09-14T10:49:57.862 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.864+0000 7fddb1daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:57.862 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.864+0000 7fddb1daf800 20 rados->read ofs=0 len=0 2024-09-14T10:49:57.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.864+0000 7fddb1daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:57.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.864+0000 7fddb1daf800 20 rados->read ofs=0 len=0 2024-09-14T10:49:57.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.865+0000 7fddb1daf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:49:57.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.865+0000 7fddb1daf800 20 searching for the correct realm 2024-09-14T10:49:57.866 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:57.868+0000 7fddaf098640 0 -- 172.21.15.50:0/3161335671 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fdda8066310 msgr2=0x7fdda806a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:58.071 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.073+0000 7fddaf098640 0 -- 172.21.15.50:0/3161335671 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55a666dec780 msgr2=0x55a666deeb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:58.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.078+0000 7fddb1daf800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:49:58.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.078+0000 7fddb1daf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:49:58.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.078+0000 7fddb1daf800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:49:58.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.078+0000 7fddb1daf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:49:58.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.078+0000 7fddb1daf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:49:58.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.078+0000 7fddb1daf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:49:58.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.078+0000 7fddb1daf800 20 rados->read ofs=0 len=0 2024-09-14T10:49:58.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.078+0000 7fddb1daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:58.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.078+0000 7fddb1daf800 20 rados->read ofs=0 len=0 2024-09-14T10:49:58.077 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.078+0000 7fddb1daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:58.077 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.078+0000 7fddb1daf800 20 rados->read ofs=0 len=0 2024-09-14T10:49:58.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.079+0000 7fddb1daf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:49:58.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.079+0000 7fddb1daf800 20 zone default found 2024-09-14T10:49:58.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.079+0000 7fddb1daf800 4 Realm: () 2024-09-14T10:49:58.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.079+0000 7fddb1daf800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:49:58.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.079+0000 7fddb1daf800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:49:58.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.079+0000 7fddb1daf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:49:58.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.079+0000 7fddb1daf800 20 zonegroup default 2024-09-14T10:49:58.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.079+0000 7fddb1daf800 20 rados->read ofs=0 len=0 2024-09-14T10:49:58.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.079+0000 7fddb1daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:58.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.079+0000 7fddb1daf800 20 rados->read ofs=0 len=0 2024-09-14T10:49:58.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.079+0000 7fddb1daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:58.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.079+0000 7fddb1daf800 20 rados->read ofs=0 len=0 2024-09-14T10:49:58.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.080+0000 7fddb1daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:58.079 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.080+0000 7fddb1daf800 20 started sync module instance, tier type = 2024-09-14T10:49:58.079 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.080+0000 7fddb1daf800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:49:58.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.090+0000 7fddb1daf800 20 add_watcher() i=0 2024-09-14T10:49:58.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.090+0000 7fddb1daf800 20 add_watcher() i=1 2024-09-14T10:49:58.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.090+0000 7fddb1daf800 20 add_watcher() i=2 2024-09-14T10:49:58.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.090+0000 7fddb1daf800 20 add_watcher() i=3 2024-09-14T10:49:58.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.090+0000 7fddb1daf800 20 add_watcher() i=4 2024-09-14T10:49:58.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.090+0000 7fddb1daf800 20 add_watcher() i=5 2024-09-14T10:49:58.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.090+0000 7fddb1daf800 20 add_watcher() i=6 2024-09-14T10:49:58.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.091+0000 7fddb1daf800 20 add_watcher() i=7 2024-09-14T10:49:58.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.091+0000 7fddb1daf800 2 all 8 watchers are set, enabling cache 2024-09-14T10:49:58.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.093+0000 7fdc65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:58.092 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.093+0000 7fddb1daf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:49:58.092 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.093+0000 7fddb1daf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:49:58.092 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.093+0000 7fddb1daf800 5 note: GC not initialized 2024-09-14T10:49:58.092 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.094+0000 7fdc64fe1640 20 reqs_thread_entry: start 2024-09-14T10:49:58.092 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.094+0000 7fddb1daf800 20 init_complete bucket index max shards: 11 2024-09-14T10:49:58.092 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.094+0000 7fddb1daf800 20 Filter name: none 2024-09-14T10:49:58.092 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.094+0000 7fdbde7fc640 20 reqs_thread_entry: start 2024-09-14T10:49:58.092 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.094+0000 7fddb1daf800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:49:58.092 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.094+0000 7fddb1daf800 20 rados->read ofs=0 len=0 2024-09-14T10:49:58.093 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.095+0000 7fddb1daf800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:49:58.093 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.095+0000 7fddb1daf800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:49:58.093 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.095+0000 7fddb1daf800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:49:58.094 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.095+0000 7fddb1daf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 : miss 2024-09-14T10:49:58.094 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.095+0000 7fddb1daf800 20 rados->read ofs=0 len=0 2024-09-14T10:49:58.094 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.095+0000 7fddb1daf800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:49:58.094 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.095+0000 7fddb1daf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 info.flags=0x17 2024-09-14T10:49:58.094 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.095+0000 7fddb1daf800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 to cache LRU end 2024-09-14T10:49:58.094 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.095+0000 7fddb1daf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:49:58.094 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.095+0000 7fddb1daf800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:49:58.094 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.095+0000 7fddb1daf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 2024-09-14T10:49:58.094 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.095+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.0 2024-09-14T10:49:58.094 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.095+0000 7fddb1daf800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T10:49:58.094 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.095+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:49:58.095 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.096+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.2 2024-09-14T10:49:58.095 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.097+0000 7fddb1daf800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T10:49:58.095 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.097+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.3 2024-09-14T10:49:58.095 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.097+0000 7fddb1daf800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T10:49:58.095 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.097+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.4 2024-09-14T10:49:58.096 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.098+0000 7fddb1daf800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T10:49:58.096 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.098+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:49:58.096 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.098+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.6 2024-09-14T10:49:58.096 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.099+0000 7fddb1daf800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T10:49:58.096 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.099+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.7 2024-09-14T10:49:58.097 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.099+0000 7fddb1daf800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T10:49:58.097 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.099+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:49:58.097 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.100+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.9 2024-09-14T10:49:58.098 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.100+0000 7fddb1daf800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T10:49:58.098 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.100+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:49:58.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.101+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:49:58.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.101+0000 7fddb1daf800 20 get_obj_state: octx=0x55a666b60300 obj=check-bucket:e state=0x55a666e2d6f8 s->prefetch_data=0 2024-09-14T10:49:58.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.101+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:49:58.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.101+0000 7fddb1daf800 20 get_obj_state: octx=0x55a666b88c10 obj=check-bucket:d state=0x55a666e279d8 s->prefetch_data=0 2024-09-14T10:49:58.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.101+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:49:58.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.102+0000 7fddb1daf800 20 get_obj_state: octx=0x55a666e27150 obj=check-bucket:c state=0x55a666e2c288 s->prefetch_data=0 2024-09-14T10:49:58.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.102+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:49:58.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.102+0000 7fddb1daf800 20 get_obj_state: octx=0x55a666ec7040 obj=check-bucket:f state=0x55a666e296c8 s->prefetch_data=0 2024-09-14T10:49:58.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.102+0000 7fddb1daf800 20 get_obj_state: setting s->obj_tag to zcr3z9l9wt808q81vnmhx4tyjlg9bhnk 2024-09-14T10:49:58.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.102+0000 7fddb1daf800 20 get_obj_state_impl: setting s->olh_tag to glbzlniaqckdejaq1nv3e8v7ihllnr5p 2024-09-14T10:49:58.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.102+0000 7fddb1daf800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=glbzlniaqckdejaq1nv3e8v7ihllnr5p 2024-09-14T10:49:58.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.102+0000 7fddb1daf800 20 get_obj_state: setting s->obj_tag to ccqt920l8q090zie87a8d2kznseh4h0k 2024-09-14T10:49:58.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.102+0000 7fddb1daf800 20 get_obj_state_impl: setting s->olh_tag to ngelml0z7oe9ylo6o4fqydvl1u6tslor 2024-09-14T10:49:58.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.102+0000 7fddb1daf800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ngelml0z7oe9ylo6o4fqydvl1u6tslor 2024-09-14T10:49:58.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.102+0000 7fddb1daf800 20 get_obj_state: setting s->obj_tag to eyvcjyj6iww7n1dtfbidwdv3dkmrpp2a 2024-09-14T10:49:58.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.102+0000 7fddb1daf800 20 get_obj_state_impl: setting s->olh_tag to 9zrpq59k0wpft80vq5nmyg1wg67ezg0u 2024-09-14T10:49:58.102 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.102+0000 7fddb1daf800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=9zrpq59k0wpft80vq5nmyg1wg67ezg0u 2024-09-14T10:49:58.102 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.103+0000 7fddb1daf800 20 get_obj_state: setting s->obj_tag to qm5xmw2pc5bqy3j922x3mtzzxpr4qgbo 2024-09-14T10:49:58.102 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.103+0000 7fddb1daf800 20 get_obj_state_impl: setting s->olh_tag to 25afjbbl0zemkvelsypin3hme7fc7iaz 2024-09-14T10:49:58.102 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.103+0000 7fddb1daf800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=25afjbbl0zemkvelsypin3hme7fc7iaz 2024-09-14T10:49:58.102 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.104+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:49:58.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.104+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:49:58.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.104+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:49:58.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.105+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:49:58.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.106+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:49:58.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.106+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:49:58.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.107+0000 7fddb1daf800 20 olh_log_entry: epoch=3 op=3 key=d[lUsaAqozjSqkFRCScROQ234I8fJ8C7m] 2024-09-14T10:49:58.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.107+0000 7fddb1daf800 20 get_obj_state: octx=0x55a666b88c10 obj=check-bucket:_:lUsaAqozjSqkFRCScROQ234I8fJ8C7m_d state=0x55a666ee0ca8 s->prefetch_data=0 2024-09-14T10:49:58.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.107+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:49:58.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.107+0000 7fddb1daf800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T10:49:58.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.107+0000 7fddb1daf800 20 olh_log_entry: epoch=2 op=3 key=f[FCpG5DNY65FOLf1yQAh8S88QXVGjubn] 2024-09-14T10:49:58.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.107+0000 7fddb1daf800 20 get_obj_state: octx=0x55a666ec7040 obj=check-bucket:_:FCpG5DNY65FOLf1yQAh8S88QXVGjubn_f state=0x55a666ed9e78 s->prefetch_data=0 2024-09-14T10:49:58.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.107+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:49:58.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.107+0000 7fddb1daf800 10 manifest: total_size = 11 2024-09-14T10:49:58.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.107+0000 7fddb1daf800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13068699967680119272 2024-09-14T10:49:58.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.107+0000 7fddb1daf800 20 get_obj_state: octx=0x55a666b88c10 obj=check-bucket:_:lUsaAqozjSqkFRCScROQ234I8fJ8C7m_d state=0x55a666ee0ca8 s->prefetch_data=0 2024-09-14T10:49:58.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.107+0000 7fddb1daf800 20 prepare_atomic_modification: state is not atomic. state=0x55a666ee0ca8 2024-09-14T10:49:58.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.107+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:49:58.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.107+0000 7fddb1daf800 20 olh_log_entry: epoch=3 op=3 key=c[3ACZ-oW3pFGxF3PSjlbjGTa6LmrYUBZ] 2024-09-14T10:49:58.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.107+0000 7fddb1daf800 20 get_obj_state: octx=0x55a666e27150 obj=check-bucket:_:3ACZ-oW3pFGxF3PSjlbjGTa6LmrYUBZ_c state=0x55a666ee4838 s->prefetch_data=0 2024-09-14T10:49:58.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.107+0000 7fddb1daf800 10 manifest: total_size = 22 2024-09-14T10:49:58.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.107+0000 7fddb1daf800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3533167318645515113 2024-09-14T10:49:58.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.107+0000 7fddb1daf800 20 get_obj_state: octx=0x55a666ec7040 obj=check-bucket:_:FCpG5DNY65FOLf1yQAh8S88QXVGjubn_f state=0x55a666ed9e78 s->prefetch_data=0 2024-09-14T10:49:58.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.107+0000 7fddb1daf800 20 prepare_atomic_modification: state is not atomic. state=0x55a666ed9e78 2024-09-14T10:49:58.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.107+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:49:58.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.107+0000 7fddb1daf800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T10:49:58.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.107+0000 7fddb1daf800 20 olh_log_entry: epoch=2 op=3 key=e[J8ABi5xiL6Qe2D4aF4RqtvGpc4y9XPE] 2024-09-14T10:49:58.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.107+0000 7fddb1daf800 20 get_obj_state: octx=0x55a666b60300 obj=check-bucket:_:J8ABi5xiL6Qe2D4aF4RqtvGpc4y9XPE_e state=0x55a666efa108 s->prefetch_data=0 2024-09-14T10:49:58.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.108+0000 7fddb1daf800 10 manifest: total_size = 12 2024-09-14T10:49:58.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.108+0000 7fddb1daf800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16945832219153673810 2024-09-14T10:49:58.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.108+0000 7fddb1daf800 20 get_obj_state: octx=0x55a666e27150 obj=check-bucket:_:3ACZ-oW3pFGxF3PSjlbjGTa6LmrYUBZ_c state=0x55a666ee4838 s->prefetch_data=0 2024-09-14T10:49:58.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.108+0000 7fddb1daf800 20 prepare_atomic_modification: state is not atomic. state=0x55a666ee4838 2024-09-14T10:49:58.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.108+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:49:58.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.108+0000 7fddb1daf800 10 manifest: total_size = 9 2024-09-14T10:49:58.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.108+0000 7fddb1daf800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13802694005820915424 2024-09-14T10:49:58.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.108+0000 7fddb1daf800 20 get_obj_state: octx=0x55a666b60300 obj=check-bucket:_:J8ABi5xiL6Qe2D4aF4RqtvGpc4y9XPE_e state=0x55a666efa108 s->prefetch_data=0 2024-09-14T10:49:58.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.108+0000 7fddb1daf800 20 prepare_atomic_modification: state is not atomic. state=0x55a666efa108 2024-09-14T10:49:58.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.108+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:49:58.109 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.110+0000 7fddb1daf800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:49:58.109 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.110+0000 7fddb1daf800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-14T10:49:58.109 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.110+0000 7fddb1daf800 0 deleting objects inline since gc isn't initialized 2024-09-14T10:49:58.109 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.110+0000 7fddb1daf800 5 delete_objs_inline: removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2__shadow:lUsaAqozjSqkFRCScROQ234I8fJ8C7m_.-D8nlGY5G3KarbWS7b1IwlAIbuJlamq_0 2024-09-14T10:49:58.109 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.110+0000 7fddb1daf800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:49:58.109 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.110+0000 7fddb1daf800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T10:49:58.109 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.110+0000 7fddb1daf800 0 deleting objects inline since gc isn't initialized 2024-09-14T10:49:58.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.110+0000 7fddb1daf800 5 delete_objs_inline: removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2__shadow:FCpG5DNY65FOLf1yQAh8S88QXVGjubn_.9SjMaybuI7NxzsNwQc51Pvjdhebqs5R_0 2024-09-14T10:49:58.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.112+0000 7fddb1daf800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:49:58.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.112+0000 7fddb1daf800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-14T10:49:58.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.112+0000 7fddb1daf800 0 deleting objects inline since gc isn't initialized 2024-09-14T10:49:58.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.112+0000 7fddb1daf800 5 delete_objs_inline: removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2__shadow:3ACZ-oW3pFGxF3PSjlbjGTa6LmrYUBZ_.fE470JXlAyKDYwW6js0bK08VRmIVqvF_0 2024-09-14T10:49:58.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.112+0000 7fddb1daf800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:49:58.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.113+0000 7fddb1daf800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:49:58.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.113+0000 7fddb1daf800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-14T10:49:58.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.113+0000 7fddb1daf800 0 deleting objects inline since gc isn't initialized 2024-09-14T10:49:58.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.113+0000 7fdc8e7fc640 20 handle_completion(): completion ok for obj=d[lUsaAqozjSqkFRCScROQ234I8fJ8C7m] 2024-09-14T10:49:58.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.113+0000 7fddb1daf800 5 delete_objs_inline: removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2__shadow:J8ABi5xiL6Qe2D4aF4RqtvGpc4y9XPE_.dC1_QakxnKvqShTyuTnSoUVphyYnsTn_0 2024-09-14T10:49:58.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.113+0000 7fddb1daf800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:49:58.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.113+0000 7fdc8e7fc640 20 handle_completion(): completion ok for obj=f[FCpG5DNY65FOLf1yQAh8S88QXVGjubn] 2024-09-14T10:49:58.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.114+0000 7fddb1daf800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:49:58.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.114+0000 7fddb1daf800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:49:58.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.114+0000 7fdc8effd640 20 handle_completion(): completion ok for obj=c[3ACZ-oW3pFGxF3PSjlbjGTa6LmrYUBZ] 2024-09-14T10:49:58.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.114+0000 7fdc8e7fc640 20 handle_completion(): completion ok for obj=e[J8ABi5xiL6Qe2D4aF4RqtvGpc4y9XPE] 2024-09-14T10:49:58.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.115+0000 7fddb1daf800 20 get_obj_state: octx=0x55a666ec7040 obj=check-bucket:f state=0x55a666e296c8 s->prefetch_data=0 2024-09-14T10:49:58.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.115+0000 7fddb1daf800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=25afjbbl0zemkvelsypin3hme7fc7iaz 2024-09-14T10:49:58.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.115+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:49:58.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.116+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:49:58.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.116+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:49:58.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.116+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:49:58.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.116+0000 7fddb1daf800 20 get_obj_state: octx=0x55a666b60300 obj=check-bucket:e state=0x55a666e2d6f8 s->prefetch_data=0 2024-09-14T10:49:58.115 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.116+0000 7fddb1daf800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=glbzlniaqckdejaq1nv3e8v7ihllnr5p 2024-09-14T10:49:58.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.117+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:49:58.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.117+0000 7fddb1daf800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T10:49:58.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.118+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:49:58.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.118+0000 7fddb1daf800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T10:49:58.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.118+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:49:58.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.119+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:49:58.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.119+0000 7fddb1daf800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-14T10:49:58.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.120+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:49:58.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.121+0000 7fddb1daf800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:49:58.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.121+0000 7fddb1daf800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-14T10:49:58.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.121+0000 7fddb1daf800 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T10:49:58.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.122+0000 7fdc65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:58.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.124+0000 7fddb1daf800 20 remove_watcher() i=0 2024-09-14T10:49:58.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.124+0000 7fddb1daf800 2 removed watcher, disabling cache 2024-09-14T10:49:58.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.124+0000 7fddb1daf800 20 remove_watcher() i=1 2024-09-14T10:49:58.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.125+0000 7fddb1daf800 20 remove_watcher() i=2 2024-09-14T10:49:58.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.126+0000 7fddb1daf800 20 remove_watcher() i=3 2024-09-14T10:49:58.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.127+0000 7fddb1daf800 20 remove_watcher() i=4 2024-09-14T10:49:58.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.129+0000 7fddb1daf800 20 remove_watcher() i=5 2024-09-14T10:49:58.129 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.130+0000 7fddb1daf800 20 remove_watcher() i=6 2024-09-14T10:49:58.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.131+0000 7fddb1daf800 20 remove_watcher() i=7 2024-09-14T10:49:58.144 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:58.144 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:58.165 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:58.165 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:58.187 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:58.187 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:58.208 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:58.208 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:58.228 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-14T10:49:58.228 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:49:58.229 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:58.229 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:58.308 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:58.308 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:58.331 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:58.331 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:58.358 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:58.358 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:58.383 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:58.383 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:58.407 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-14T10:49:58.407 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:49:58.408 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T10:49:58.442 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:49:58.442 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:49:58.482 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.483+0000 7fd3ee613800 20 rados->read ofs=0 len=0 2024-09-14T10:49:58.483 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.484+0000 7fd3ee613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:58.484 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.484+0000 7fd3ee613800 20 realm 2024-09-14T10:49:58.484 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.484+0000 7fd3ee613800 20 rados->read ofs=0 len=0 2024-09-14T10:49:58.484 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.485+0000 7fd3ee613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:58.484 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.485+0000 7fd3ee613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:49:58.484 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.485+0000 7fd3ee613800 20 rados->read ofs=0 len=0 2024-09-14T10:49:58.484 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.485+0000 7fd3ee613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:58.484 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.485+0000 7fd3ee613800 20 rados->read ofs=0 len=0 2024-09-14T10:49:58.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.485+0000 7fd3ee613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:58.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.485+0000 7fd3ee613800 20 rados->read ofs=0 len=0 2024-09-14T10:49:58.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.486+0000 7fd3ee613800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:49:58.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.486+0000 7fd3ee613800 20 searching for the correct realm 2024-09-14T10:49:58.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.489+0000 7fd3e9547640 0 -- 172.21.15.50:0/2357056618 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fd3e4066410 msgr2=0x7fd3e4064580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:58.694 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.695+0000 7fd3ea549640 0 -- 172.21.15.50:0/2357056618 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55f6d5929f10 msgr2=0x55f6d592c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:58.698 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.699+0000 7fd3ee613800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:49:58.698 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.699+0000 7fd3ee613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:49:58.698 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.699+0000 7fd3ee613800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:49:58.698 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.699+0000 7fd3ee613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:49:58.698 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.699+0000 7fd3ee613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:49:58.698 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.699+0000 7fd3ee613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:49:58.698 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.699+0000 7fd3ee613800 20 rados->read ofs=0 len=0 2024-09-14T10:49:58.699 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.700+0000 7fd3ee613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:58.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.700+0000 7fd3ee613800 20 rados->read ofs=0 len=0 2024-09-14T10:49:58.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.700+0000 7fd3ee613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:58.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.700+0000 7fd3ee613800 20 rados->read ofs=0 len=0 2024-09-14T10:49:58.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.700+0000 7fd3ee613800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:49:58.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.700+0000 7fd3ee613800 20 zone default found 2024-09-14T10:49:58.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.700+0000 7fd3ee613800 4 Realm: () 2024-09-14T10:49:58.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.700+0000 7fd3ee613800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:49:58.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.700+0000 7fd3ee613800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:49:58.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.700+0000 7fd3ee613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:49:58.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.700+0000 7fd3ee613800 20 zonegroup default 2024-09-14T10:49:58.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.700+0000 7fd3ee613800 20 rados->read ofs=0 len=0 2024-09-14T10:49:58.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.700+0000 7fd3ee613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:58.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.700+0000 7fd3ee613800 20 rados->read ofs=0 len=0 2024-09-14T10:49:58.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.701+0000 7fd3ee613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:58.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.701+0000 7fd3ee613800 20 rados->read ofs=0 len=0 2024-09-14T10:49:58.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.701+0000 7fd3ee613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:58.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.701+0000 7fd3ee613800 20 started sync module instance, tier type = 2024-09-14T10:49:58.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.701+0000 7fd3ee613800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:49:58.709 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.711+0000 7fd3ee613800 20 add_watcher() i=0 2024-09-14T10:49:58.709 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.711+0000 7fd3ee613800 20 add_watcher() i=1 2024-09-14T10:49:58.709 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.711+0000 7fd3ee613800 20 add_watcher() i=2 2024-09-14T10:49:58.709 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.711+0000 7fd3ee613800 20 add_watcher() i=3 2024-09-14T10:49:58.710 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.711+0000 7fd3ee613800 20 add_watcher() i=4 2024-09-14T10:49:58.710 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.711+0000 7fd3ee613800 20 add_watcher() i=5 2024-09-14T10:49:58.710 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.711+0000 7fd3ee613800 20 add_watcher() i=6 2024-09-14T10:49:58.710 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.712+0000 7fd3ee613800 20 add_watcher() i=7 2024-09-14T10:49:58.710 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.712+0000 7fd3ee613800 2 all 8 watchers are set, enabling cache 2024-09-14T10:49:58.712 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.714+0000 7fd29bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:58.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.714+0000 7fd3ee613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:49:58.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.714+0000 7fd3ee613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:49:58.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.714+0000 7fd3ee613800 5 note: GC not initialized 2024-09-14T10:49:58.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.714+0000 7fd29affd640 20 reqs_thread_entry: start 2024-09-14T10:49:58.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.714+0000 7fd3ee613800 20 init_complete bucket index max shards: 11 2024-09-14T10:49:58.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.714+0000 7fd3ee613800 20 Filter name: none 2024-09-14T10:49:58.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.715+0000 7fd298ff9640 20 reqs_thread_entry: start 2024-09-14T10:49:58.715 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.715+0000 7fd3ee613800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:49:58.715 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.715+0000 7fd3ee613800 20 rados->read ofs=0 len=0 2024-09-14T10:49:58.715 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.715+0000 7fd3ee613800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:49:58.715 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.715+0000 7fd3ee613800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:49:58.715 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.715+0000 7fd3ee613800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:49:58.715 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.715+0000 7fd3ee613800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 : miss 2024-09-14T10:49:58.715 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.715+0000 7fd3ee613800 20 rados->read ofs=0 len=0 2024-09-14T10:49:58.716 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.715+0000 7fd3ee613800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:49:58.717 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.715+0000 7fd3ee613800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 info.flags=0x17 2024-09-14T10:49:58.717 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.715+0000 7fd3ee613800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 to cache LRU end 2024-09-14T10:49:58.717 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.715+0000 7fd3ee613800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:49:58.717 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.715+0000 7fd3ee613800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:49:58.717 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.715+0000 7fd3ee613800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 2024-09-14T10:49:58.717 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.716+0000 7fd3ee613800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.0 2024-09-14T10:49:58.717 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.716+0000 7fd3ee613800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T10:49:58.717 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.716+0000 7fd3ee613800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:49:58.717 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.716+0000 7fd3ee613800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T10:49:58.717 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.716+0000 7fd3ee613800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.2 2024-09-14T10:49:58.717 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.717+0000 7fd3ee613800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T10:49:58.718 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.717+0000 7fd3ee613800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.3 2024-09-14T10:49:58.718 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.717+0000 7fd3ee613800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T10:49:58.718 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.717+0000 7fd3ee613800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.4 2024-09-14T10:49:58.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.718+0000 7fd3ee613800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T10:49:58.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.718+0000 7fd3ee613800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:49:58.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.719+0000 7fd3ee613800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T10:49:58.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.719+0000 7fd3ee613800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.6 2024-09-14T10:49:58.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.719+0000 7fd3ee613800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T10:49:58.720 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.719+0000 7fd3ee613800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.7 2024-09-14T10:49:58.720 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.720+0000 7fd3ee613800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T10:49:58.720 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.720+0000 7fd3ee613800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:49:58.720 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.720+0000 7fd3ee613800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T10:49:58.720 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.720+0000 7fd3ee613800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.9 2024-09-14T10:49:58.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.721+0000 7fd3ee613800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T10:49:58.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.721+0000 7fd3ee613800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:49:58.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.721+0000 7fd3ee613800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T10:49:58.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.721+0000 7fd3ee613800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T10:49:58.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.722+0000 7fd29bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:58.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.724+0000 7fd3ee613800 20 remove_watcher() i=0 2024-09-14T10:49:58.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.724+0000 7fd3ee613800 2 removed watcher, disabling cache 2024-09-14T10:49:58.724 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.726+0000 7fd3ee613800 20 remove_watcher() i=1 2024-09-14T10:49:58.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.726+0000 7fd3ee613800 20 remove_watcher() i=2 2024-09-14T10:49:58.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.727+0000 7fd3ee613800 20 remove_watcher() i=3 2024-09-14T10:49:58.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.729+0000 7fd3ee613800 20 remove_watcher() i=4 2024-09-14T10:49:58.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.730+0000 7fd3ee613800 20 remove_watcher() i=5 2024-09-14T10:49:58.730 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.731+0000 7fd3ee613800 20 remove_watcher() i=6 2024-09-14T10:49:58.731 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:58.732+0000 7fd3ee613800 20 remove_watcher() i=7 2024-09-14T10:49:58.746 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:58.746 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:58.887 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:49:58.887 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:49:58.938 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T10:49:58.970 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:49:58.970 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:49:59.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.208+0000 7eff93add640 0 --2- 172.21.15.50:0/2220178665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d069cb850 0x7efe5c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T10:49:59.211 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.213+0000 7eff97d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.215+0000 7eff97d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:59.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.215+0000 7eff97d2e800 20 realm 2024-09-14T10:49:59.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.215+0000 7eff97d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.215+0000 7eff97d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:59.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.215+0000 7eff97d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:49:59.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.215+0000 7eff97d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.215+0000 7eff97d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:59.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.215+0000 7eff97d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.216+0000 7eff97d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:59.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.216+0000 7eff97d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.217+0000 7eff97d2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:49:59.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.217+0000 7eff97d2e800 20 searching for the correct realm 2024-09-14T10:49:59.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.217+0000 7eff942de640 0 -- 172.21.15.50:0/2547356266 >> [v2:172.21.15.118:6816/4154782182,v1:172.21.15.118:6817/4154782182] conn(0x559d069f5c50 msgr2=0x559d069f8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:59.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.423+0000 7eff942de640 0 -- 172.21.15.50:0/2547356266 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x559d069e9420 msgr2=0x559d069eb8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:59.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.431+0000 7eff97d2e800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:49:59.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.431+0000 7eff97d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:49:59.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.431+0000 7eff97d2e800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:49:59.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.431+0000 7eff97d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:49:59.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.431+0000 7eff97d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:49:59.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.431+0000 7eff97d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:49:59.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.431+0000 7eff97d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.431+0000 7eff97d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:59.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.431+0000 7eff97d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.431+0000 7eff97d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:59.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.431+0000 7eff97d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.432 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.432+0000 7eff97d2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:49:59.432 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.432+0000 7eff97d2e800 20 zone default found 2024-09-14T10:49:59.432 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.432+0000 7eff97d2e800 4 Realm: () 2024-09-14T10:49:59.432 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.432+0000 7eff97d2e800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:49:59.432 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.432+0000 7eff97d2e800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:49:59.432 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.432+0000 7eff97d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:49:59.432 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.432+0000 7eff97d2e800 20 zonegroup default 2024-09-14T10:49:59.432 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.432+0000 7eff97d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.432 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.432+0000 7eff97d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:59.432 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.432+0000 7eff97d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.432 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.433+0000 7eff97d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:59.432 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.433+0000 7eff97d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.433+0000 7eff97d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:59.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.433+0000 7eff97d2e800 20 started sync module instance, tier type = 2024-09-14T10:49:59.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.433+0000 7eff97d2e800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:49:59.442 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.444+0000 7eff97d2e800 20 add_watcher() i=0 2024-09-14T10:49:59.442 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.444+0000 7eff97d2e800 20 add_watcher() i=1 2024-09-14T10:49:59.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.444+0000 7eff97d2e800 20 add_watcher() i=2 2024-09-14T10:49:59.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.444+0000 7eff97d2e800 20 add_watcher() i=3 2024-09-14T10:49:59.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.444+0000 7eff97d2e800 20 add_watcher() i=4 2024-09-14T10:49:59.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.444+0000 7eff97d2e800 20 add_watcher() i=5 2024-09-14T10:49:59.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.444+0000 7eff97d2e800 20 add_watcher() i=6 2024-09-14T10:49:59.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.445+0000 7eff97d2e800 20 add_watcher() i=7 2024-09-14T10:49:59.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.445+0000 7eff97d2e800 2 all 8 watchers are set, enabling cache 2024-09-14T10:49:59.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.447+0000 7efe49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:59.446 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.447+0000 7eff97d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:49:59.446 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.447+0000 7eff97d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:49:59.447 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.447+0000 7eff97d2e800 5 note: GC not initialized 2024-09-14T10:49:59.447 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.447+0000 7efe48fe1640 20 reqs_thread_entry: start 2024-09-14T10:49:59.447 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.447+0000 7eff97d2e800 20 init_complete bucket index max shards: 11 2024-09-14T10:49:59.447 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.447+0000 7eff97d2e800 20 Filter name: none 2024-09-14T10:49:59.447 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.448+0000 7efdc27fc640 20 reqs_thread_entry: start 2024-09-14T10:49:59.447 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.448+0000 7eff97d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.448+0000 7eff97d2e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:49:59.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.448+0000 7eff97d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.448+0000 7eff97d2e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:49:59.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.449+0000 7eff97d2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:49:59.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.449+0000 7eff97d2e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:49:59.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.449+0000 7eff97d2e800 20 INFO: main: starting shard=0 2024-09-14T10:49:59.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.449+0000 7eff97d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.0 2024-09-14T10:49:59.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.449+0000 7eff97d2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:59.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.449+0000 7eff97d2e800 20 INFO: main: starting shard=1 2024-09-14T10:49:59.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.449+0000 7eff97d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:49:59.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.450+0000 7eff97d2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:59.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.450+0000 7eff97d2e800 20 INFO: main: starting shard=2 2024-09-14T10:49:59.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.450+0000 7eff97d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.2 2024-09-14T10:49:59.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.450+0000 7eff97d2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:59.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.450+0000 7eff97d2e800 20 INFO: main: starting shard=3 2024-09-14T10:49:59.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.450+0000 7eff97d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.3 2024-09-14T10:49:59.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.451+0000 7eff97d2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:59.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.451+0000 7eff97d2e800 20 INFO: main: starting shard=4 2024-09-14T10:49:59.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.451+0000 7eff97d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.4 2024-09-14T10:49:59.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.452+0000 7eff97d2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:59.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.452+0000 7eff97d2e800 20 INFO: main: starting shard=5 2024-09-14T10:49:59.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.452+0000 7eff97d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:49:59.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.452+0000 7eff97d2e800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T10:49:59.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.452+0000 7eff97d2e800 20 INFO: main: starting shard=6 2024-09-14T10:49:59.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.452+0000 7eff97d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.6 2024-09-14T10:49:59.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.453+0000 7eff97d2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:59.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.453+0000 7eff97d2e800 20 INFO: main: starting shard=7 2024-09-14T10:49:59.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.453+0000 7eff97d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.7 2024-09-14T10:49:59.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.453+0000 7eff97d2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:59.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.453+0000 7eff97d2e800 20 INFO: main: starting shard=8 2024-09-14T10:49:59.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.453+0000 7eff97d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:49:59.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.454+0000 7eff97d2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:59.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.454+0000 7eff97d2e800 20 INFO: main: starting shard=9 2024-09-14T10:49:59.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.454+0000 7eff97d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.9 2024-09-14T10:49:59.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.455+0000 7eff97d2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:59.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.455+0000 7eff97d2e800 20 INFO: main: starting shard=10 2024-09-14T10:49:59.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.455+0000 7eff97d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:49:59.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.456+0000 7eff97d2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:59.455 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.456+0000 7eff97d2e800 20 INFO: main: done 2024-09-14T10:49:59.455 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.457+0000 7efe49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:59.458 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.459+0000 7eff97d2e800 20 remove_watcher() i=0 2024-09-14T10:49:59.458 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.459+0000 7eff97d2e800 2 removed watcher, disabling cache 2024-09-14T10:49:59.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.460+0000 7eff97d2e800 20 remove_watcher() i=1 2024-09-14T10:49:59.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.461+0000 7eff97d2e800 20 remove_watcher() i=2 2024-09-14T10:49:59.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.463+0000 7eff97d2e800 20 remove_watcher() i=3 2024-09-14T10:49:59.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.464+0000 7eff97d2e800 20 remove_watcher() i=4 2024-09-14T10:49:59.464 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.465+0000 7eff97d2e800 20 remove_watcher() i=5 2024-09-14T10:49:59.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.466+0000 7eff97d2e800 20 remove_watcher() i=6 2024-09-14T10:49:59.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.467+0000 7eff97d2e800 20 remove_watcher() i=7 2024-09-14T10:49:59.479 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T10:49:59.512 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:49:59.512 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:49:59.551 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.552+0000 7f2934ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.553 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.554+0000 7f2934ab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:59.553 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.554+0000 7f2934ab9800 20 realm 2024-09-14T10:49:59.553 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.554+0000 7f2934ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.553 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.554+0000 7f2934ab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:59.553 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.554+0000 7f2934ab9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:49:59.553 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.554+0000 7f2934ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.553 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.554+0000 7f2934ab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:59.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.554+0000 7f2934ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.555+0000 7f2934ab9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:59.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.555+0000 7f2934ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.555+0000 7f2934ab9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:49:59.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.555+0000 7f2934ab9800 20 searching for the correct realm 2024-09-14T10:49:59.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.558+0000 7f2931da2640 0 -- 172.21.15.50:0/3687192251 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f292c030930 msgr2=0x7f292c01f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:59.762 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.764+0000 7f2932da4640 0 -- 172.21.15.50:0/3687192251 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x561a769fcec0 msgr2=0x561a769ff320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:59.767 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.768+0000 7f2934ab9800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:49:59.767 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.768+0000 7f2934ab9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:49:59.767 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.768+0000 7f2934ab9800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:49:59.767 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.768+0000 7f2934ab9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:49:59.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.768+0000 7f2934ab9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:49:59.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.768+0000 7f2934ab9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:49:59.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.768+0000 7f2934ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.769+0000 7f2934ab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:59.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.769+0000 7f2934ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.769+0000 7f2934ab9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:59.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.769+0000 7f2934ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.770+0000 7f2934ab9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:49:59.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.770+0000 7f2934ab9800 20 zone default found 2024-09-14T10:49:59.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.770+0000 7f2934ab9800 4 Realm: () 2024-09-14T10:49:59.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.770+0000 7f2934ab9800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:49:59.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.770+0000 7f2934ab9800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:49:59.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.770+0000 7f2934ab9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:49:59.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.770+0000 7f2934ab9800 20 zonegroup default 2024-09-14T10:49:59.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.770+0000 7f2934ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.770+0000 7f2934ab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:59.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.770+0000 7f2934ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.770+0000 7f2934ab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:59.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.770+0000 7f2934ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.771+0000 7f2934ab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:59.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.771+0000 7f2934ab9800 20 started sync module instance, tier type = 2024-09-14T10:49:59.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.771+0000 7f2934ab9800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:49:59.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.781+0000 7f2934ab9800 20 add_watcher() i=0 2024-09-14T10:49:59.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.781+0000 7f2934ab9800 20 add_watcher() i=1 2024-09-14T10:49:59.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.781+0000 7f2934ab9800 20 add_watcher() i=2 2024-09-14T10:49:59.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.781+0000 7f2934ab9800 20 add_watcher() i=3 2024-09-14T10:49:59.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.781+0000 7f2934ab9800 20 add_watcher() i=4 2024-09-14T10:49:59.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.781+0000 7f2934ab9800 20 add_watcher() i=5 2024-09-14T10:49:59.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.781+0000 7f2934ab9800 20 add_watcher() i=6 2024-09-14T10:49:59.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.782+0000 7f2934ab9800 20 add_watcher() i=7 2024-09-14T10:49:59.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.782+0000 7f2934ab9800 2 all 8 watchers are set, enabling cache 2024-09-14T10:49:59.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.784+0000 7f27e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:59.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.784+0000 7f2934ab9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:49:59.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.784+0000 7f2934ab9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:49:59.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.784+0000 7f2934ab9800 5 note: GC not initialized 2024-09-14T10:49:59.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.784+0000 7f27637fe640 20 reqs_thread_entry: start 2024-09-14T10:49:59.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.784+0000 7f2934ab9800 20 init_complete bucket index max shards: 11 2024-09-14T10:49:59.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.784+0000 7f2934ab9800 20 Filter name: none 2024-09-14T10:49:59.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.784+0000 7f27617fa640 20 reqs_thread_entry: start 2024-09-14T10:49:59.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.784+0000 7f2934ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.785+0000 7f2934ab9800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:49:59.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.785+0000 7f2934ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.785+0000 7f2934ab9800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:49:59.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.785+0000 7f2934ab9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:49:59.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.785+0000 7f2934ab9800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:49:59.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.785+0000 7f2934ab9800 20 INFO: main: starting shard=0 2024-09-14T10:49:59.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.785+0000 7f2934ab9800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.0 2024-09-14T10:49:59.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.786+0000 7f2934ab9800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:59.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.786+0000 7f2934ab9800 20 INFO: main: starting shard=1 2024-09-14T10:49:59.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.786+0000 7f2934ab9800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:49:59.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.786+0000 7f2934ab9800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:59.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.786+0000 7f2934ab9800 20 INFO: main: starting shard=2 2024-09-14T10:49:59.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.786+0000 7f2934ab9800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.2 2024-09-14T10:49:59.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.787+0000 7f2934ab9800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:59.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.787+0000 7f2934ab9800 20 INFO: main: starting shard=3 2024-09-14T10:49:59.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.787+0000 7f2934ab9800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.3 2024-09-14T10:49:59.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.787+0000 7f2934ab9800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:59.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.787+0000 7f2934ab9800 20 INFO: main: starting shard=4 2024-09-14T10:49:59.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.787+0000 7f2934ab9800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.4 2024-09-14T10:49:59.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.788+0000 7f2934ab9800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:59.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.788+0000 7f2934ab9800 20 INFO: main: starting shard=5 2024-09-14T10:49:59.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.788+0000 7f2934ab9800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:49:59.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.789+0000 7f2934ab9800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:59.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.789+0000 7f2934ab9800 20 INFO: main: starting shard=6 2024-09-14T10:49:59.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.789+0000 7f2934ab9800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.6 2024-09-14T10:49:59.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.789+0000 7f2934ab9800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:59.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.789+0000 7f2934ab9800 20 INFO: main: starting shard=7 2024-09-14T10:49:59.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.789+0000 7f2934ab9800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.7 2024-09-14T10:49:59.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.790+0000 7f2934ab9800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:59.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.790+0000 7f2934ab9800 20 INFO: main: starting shard=8 2024-09-14T10:49:59.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.790+0000 7f2934ab9800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:49:59.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.790+0000 7f2934ab9800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T10:49:59.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.790+0000 7f2934ab9800 20 INFO: main: starting shard=9 2024-09-14T10:49:59.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.790+0000 7f2934ab9800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.9 2024-09-14T10:49:59.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.791+0000 7f2934ab9800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:59.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.791+0000 7f2934ab9800 20 INFO: main: starting shard=10 2024-09-14T10:49:59.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.791+0000 7f2934ab9800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:49:59.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.792+0000 7f2934ab9800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:49:59.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.792+0000 7f2934ab9800 20 INFO: main: done 2024-09-14T10:49:59.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.793+0000 7f27e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:59.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.795+0000 7f2934ab9800 20 remove_watcher() i=0 2024-09-14T10:49:59.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.795+0000 7f2934ab9800 2 removed watcher, disabling cache 2024-09-14T10:49:59.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.796+0000 7f2934ab9800 20 remove_watcher() i=1 2024-09-14T10:49:59.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.797+0000 7f2934ab9800 20 remove_watcher() i=2 2024-09-14T10:49:59.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.798+0000 7f2934ab9800 20 remove_watcher() i=3 2024-09-14T10:49:59.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.800+0000 7f2934ab9800 20 remove_watcher() i=4 2024-09-14T10:49:59.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.801+0000 7f2934ab9800 20 remove_watcher() i=5 2024-09-14T10:49:59.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.802+0000 7f2934ab9800 20 remove_watcher() i=6 2024-09-14T10:49:59.802 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.803+0000 7f2934ab9800 20 remove_watcher() i=7 2024-09-14T10:49:59.813 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-14T10:49:59.813 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:49:59.814 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T10:49:59.846 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:49:59.846 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:49:59.886 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.887+0000 7f27ab33a800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.889+0000 7f27ab33a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:59.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.889+0000 7f27ab33a800 20 realm 2024-09-14T10:49:59.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.889+0000 7f27ab33a800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.889+0000 7f27ab33a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:59.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.889+0000 7f27ab33a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:49:59.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.889+0000 7f27ab33a800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.890+0000 7f27ab33a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:59.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.890+0000 7f27ab33a800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.890+0000 7f27ab33a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:59.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.890+0000 7f27ab33a800 20 rados->read ofs=0 len=0 2024-09-14T10:49:59.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.891+0000 7f27ab33a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:49:59.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.891+0000 7f27ab33a800 20 searching for the correct realm 2024-09-14T10:49:59.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:49:59.894+0000 7f27a68ba640 0 -- 172.21.15.50:0/2224460429 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f27a00aa810 msgr2=0x7f27a00b33d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:50:00.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.101+0000 7f27a68ba640 0 -- 172.21.15.50:0/2224460429 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x555c2565c5f0 msgr2=0x555c2565ea40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:50:00.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.105+0000 7f27ab33a800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:50:00.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.105+0000 7f27ab33a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:50:00.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.105+0000 7f27ab33a800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:50:00.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.105+0000 7f27ab33a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:50:00.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.105+0000 7f27ab33a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:50:00.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.105+0000 7f27ab33a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:50:00.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.105+0000 7f27ab33a800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.105+0000 7f27ab33a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.105+0000 7f27ab33a800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.106+0000 7f27ab33a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:50:00.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.106+0000 7f27ab33a800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.106+0000 7f27ab33a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:50:00.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.106+0000 7f27ab33a800 20 zone default found 2024-09-14T10:50:00.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.106+0000 7f27ab33a800 4 Realm: () 2024-09-14T10:50:00.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.106+0000 7f27ab33a800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:50:00.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.106+0000 7f27ab33a800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:50:00.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.106+0000 7f27ab33a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:50:00.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.106+0000 7f27ab33a800 20 zonegroup default 2024-09-14T10:50:00.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.106+0000 7f27ab33a800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.106+0000 7f27ab33a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.106+0000 7f27ab33a800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.107+0000 7f27ab33a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.107+0000 7f27ab33a800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.107+0000 7f27ab33a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.107+0000 7f27ab33a800 20 started sync module instance, tier type = 2024-09-14T10:50:00.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.107+0000 7f27ab33a800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:50:00.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.117+0000 7f27ab33a800 20 add_watcher() i=0 2024-09-14T10:50:00.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.117+0000 7f27ab33a800 20 add_watcher() i=1 2024-09-14T10:50:00.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.117+0000 7f27ab33a800 20 add_watcher() i=2 2024-09-14T10:50:00.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.117+0000 7f27ab33a800 20 add_watcher() i=3 2024-09-14T10:50:00.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.117+0000 7f27ab33a800 20 add_watcher() i=4 2024-09-14T10:50:00.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.117+0000 7f27ab33a800 20 add_watcher() i=5 2024-09-14T10:50:00.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.117+0000 7f27ab33a800 20 add_watcher() i=6 2024-09-14T10:50:00.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.118+0000 7f27ab33a800 20 add_watcher() i=7 2024-09-14T10:50:00.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.118+0000 7f27ab33a800 2 all 8 watchers are set, enabling cache 2024-09-14T10:50:00.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.120+0000 7f265dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:50:00.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.120+0000 7f27ab33a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:50:00.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.120+0000 7f27ab33a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:50:00.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.120+0000 7f27ab33a800 5 note: GC not initialized 2024-09-14T10:50:00.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.120+0000 7f265cfe1640 20 reqs_thread_entry: start 2024-09-14T10:50:00.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.120+0000 7f27ab33a800 20 init_complete bucket index max shards: 11 2024-09-14T10:50:00.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.120+0000 7f27ab33a800 20 Filter name: none 2024-09-14T10:50:00.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.121+0000 7f25d67fc640 20 reqs_thread_entry: start 2024-09-14T10:50:00.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.121+0000 7f27ab33a800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:50:00.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.121+0000 7f27ab33a800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.121+0000 7f27ab33a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:50:00.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.121+0000 7f27ab33a800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:50:00.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.121+0000 7f27ab33a800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:50:00.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.121+0000 7f27ab33a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 : miss 2024-09-14T10:50:00.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.121+0000 7f27ab33a800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.121+0000 7f27ab33a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:50:00.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.121+0000 7f27ab33a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 info.flags=0x17 2024-09-14T10:50:00.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.121+0000 7f27ab33a800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 to cache LRU end 2024-09-14T10:50:00.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.121+0000 7f27ab33a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:50:00.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.121+0000 7f27ab33a800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:50:00.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.121+0000 7f27ab33a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 2024-09-14T10:50:00.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.122+0000 7f27ab33a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.0 2024-09-14T10:50:00.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.122+0000 7f27ab33a800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T10:50:00.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.122+0000 7f27ab33a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:50:00.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.122+0000 7f27ab33a800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T10:50:00.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.122+0000 7f27ab33a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.2 2024-09-14T10:50:00.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.123+0000 7f27ab33a800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T10:50:00.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.123+0000 7f27ab33a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.3 2024-09-14T10:50:00.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.123+0000 7f27ab33a800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T10:50:00.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.123+0000 7f27ab33a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.4 2024-09-14T10:50:00.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.124+0000 7f27ab33a800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T10:50:00.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.124+0000 7f27ab33a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:50:00.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.125+0000 7f27ab33a800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-14T10:50:00.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.125+0000 7f27ab33a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.6 2024-09-14T10:50:00.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.125+0000 7f27ab33a800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T10:50:00.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.125+0000 7f27ab33a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.7 2024-09-14T10:50:00.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.125+0000 7f27ab33a800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T10:50:00.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.125+0000 7f27ab33a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:50:00.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.126+0000 7f27ab33a800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-14T10:50:00.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.126+0000 7f27ab33a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.9 2024-09-14T10:50:00.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.127+0000 7f27ab33a800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T10:50:00.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.127+0000 7f27ab33a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:50:00.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.127+0000 7f27ab33a800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T10:50:00.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.127+0000 7f27ab33a800 1 NOTICE: finished all shards (2 entries found) 2024-09-14T10:50:00.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.128+0000 7f265dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:50:00.129 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.131+0000 7f27ab33a800 20 remove_watcher() i=0 2024-09-14T10:50:00.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.131+0000 7f27ab33a800 2 removed watcher, disabling cache 2024-09-14T10:50:00.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.132+0000 7f27ab33a800 20 remove_watcher() i=1 2024-09-14T10:50:00.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.133+0000 7f27ab33a800 20 remove_watcher() i=2 2024-09-14T10:50:00.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.134+0000 7f27ab33a800 20 remove_watcher() i=3 2024-09-14T10:50:00.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.135+0000 7f27ab33a800 20 remove_watcher() i=4 2024-09-14T10:50:00.135 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.136+0000 7f27ab33a800 20 remove_watcher() i=5 2024-09-14T10:50:00.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.137+0000 7f27ab33a800 20 remove_watcher() i=6 2024-09-14T10:50:00.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.139+0000 7f27ab33a800 20 remove_watcher() i=7 2024-09-14T10:50:00.149 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-14T10:50:00.149 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:50:00.151 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T10:50:00.184 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:50:00.184 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:50:00.224 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.225+0000 7f03e413d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.227+0000 7f03e413d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.227+0000 7f03e413d800 20 realm 2024-09-14T10:50:00.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.227+0000 7f03e413d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.227+0000 7f03e413d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.227+0000 7f03e413d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:50:00.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.227+0000 7f03e413d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.227+0000 7f03e413d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.227+0000 7f03e413d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.227 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.228+0000 7f03e413d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:50:00.227 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.228+0000 7f03e413d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.229+0000 7f03e413d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:50:00.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.229+0000 7f03e413d800 20 searching for the correct realm 2024-09-14T10:50:00.231 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.232+0000 7f03df629640 0 -- 172.21.15.50:0/3967631534 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f03d802b950 msgr2=0x7f03d802a430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:50:00.436 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.437+0000 7f03e062b640 0 -- 172.21.15.50:0/3967631534 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55b85a3fc4e0 msgr2=0x55b85a3fe970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:50:00.442 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.441+0000 7f03e413d800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:50:00.442 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.441+0000 7f03e413d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:50:00.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.441+0000 7f03e413d800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:50:00.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.441+0000 7f03e413d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:50:00.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.441+0000 7f03e413d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:50:00.444 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.441+0000 7f03e413d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:50:00.444 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.441+0000 7f03e413d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.444 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.442+0000 7f03e413d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.444 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.442+0000 7f03e413d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.442+0000 7f03e413d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:50:00.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.442+0000 7f03e413d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.443+0000 7f03e413d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:50:00.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.443+0000 7f03e413d800 20 zone default found 2024-09-14T10:50:00.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.443+0000 7f03e413d800 4 Realm: () 2024-09-14T10:50:00.446 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.443+0000 7f03e413d800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:50:00.446 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.443+0000 7f03e413d800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:50:00.446 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.443+0000 7f03e413d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:50:00.446 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.443+0000 7f03e413d800 20 zonegroup default 2024-09-14T10:50:00.446 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.443+0000 7f03e413d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.446 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.443+0000 7f03e413d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.447 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.443+0000 7f03e413d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.447 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.443+0000 7f03e413d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.447 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.443+0000 7f03e413d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.444+0000 7f03e413d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.444+0000 7f03e413d800 20 started sync module instance, tier type = 2024-09-14T10:50:00.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.444+0000 7f03e413d800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:50:00.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.454+0000 7f03e413d800 20 add_watcher() i=0 2024-09-14T10:50:00.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.454+0000 7f03e413d800 20 add_watcher() i=1 2024-09-14T10:50:00.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.454+0000 7f03e413d800 20 add_watcher() i=2 2024-09-14T10:50:00.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.454+0000 7f03e413d800 20 add_watcher() i=3 2024-09-14T10:50:00.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.454+0000 7f03e413d800 20 add_watcher() i=4 2024-09-14T10:50:00.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.454+0000 7f03e413d800 20 add_watcher() i=5 2024-09-14T10:50:00.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.454+0000 7f03e413d800 20 add_watcher() i=6 2024-09-14T10:50:00.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.455+0000 7f03e413d800 20 add_watcher() i=7 2024-09-14T10:50:00.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.455+0000 7f03e413d800 2 all 8 watchers are set, enabling cache 2024-09-14T10:50:00.457 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.457+0000 7f0295fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:50:00.457 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.457+0000 7f03e413d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:50:00.457 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.457+0000 7f03e413d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:50:00.457 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.457+0000 7f03e413d800 5 note: GC not initialized 2024-09-14T10:50:00.457 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.457+0000 7f0294fe1640 20 reqs_thread_entry: start 2024-09-14T10:50:00.457 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.458+0000 7f03e413d800 20 init_complete bucket index max shards: 11 2024-09-14T10:50:00.457 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.458+0000 7f03e413d800 20 Filter name: none 2024-09-14T10:50:00.458 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.458+0000 7f020e7fc640 20 reqs_thread_entry: start 2024-09-14T10:50:00.458 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.458+0000 7f03e413d800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:50:00.458 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.458+0000 7f03e413d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.458 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.458+0000 7f03e413d800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:50:00.458 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.458+0000 7f03e413d800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:50:00.458 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.458+0000 7f03e413d800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:50:00.458 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.458+0000 7f03e413d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 : miss 2024-09-14T10:50:00.458 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.458+0000 7f03e413d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.459+0000 7f03e413d800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:50:00.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.459+0000 7f03e413d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 info.flags=0x17 2024-09-14T10:50:00.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.459+0000 7f03e413d800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 to cache LRU end 2024-09-14T10:50:00.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.459+0000 7f03e413d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:50:00.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.459+0000 7f03e413d800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:50:00.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.459+0000 7f03e413d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 2024-09-14T10:50:00.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.459+0000 7f03e413d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.0 2024-09-14T10:50:00.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.459+0000 7f03e413d800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T10:50:00.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.459+0000 7f03e413d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:50:00.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.460+0000 7f03e413d800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-14T10:50:00.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.460+0000 7f03e413d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.2 2024-09-14T10:50:00.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.460+0000 7f03e413d800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T10:50:00.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.460+0000 7f03e413d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.3 2024-09-14T10:50:00.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.461+0000 7f03e413d800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T10:50:00.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.461+0000 7f03e413d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.4 2024-09-14T10:50:00.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.461+0000 7f03e413d800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T10:50:00.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.461+0000 7f03e413d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:50:00.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.462+0000 7f03e413d800 20 get_obj_state: octx=0x55b85a16f2e0 obj=check-bucket:d state=0x55b85a43b008 s->prefetch_data=0 2024-09-14T10:50:00.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.462+0000 7f03e413d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.6 2024-09-14T10:50:00.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.462+0000 7f03e413d800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T10:50:00.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.462+0000 7f03e413d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.7 2024-09-14T10:50:00.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.463+0000 7f03e413d800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T10:50:00.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.463+0000 7f03e413d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:50:00.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.463+0000 7f03e413d800 20 get_obj_state: octx=0x55b85a197bf0 obj=check-bucket:c state=0x55b85a43be78 s->prefetch_data=0 2024-09-14T10:50:00.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.463+0000 7f03e413d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.9 2024-09-14T10:50:00.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.464+0000 7f03e413d800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T10:50:00.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.464+0000 7f03e413d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:50:00.464 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.465+0000 7f03e413d800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-14T10:50:00.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.465+0000 7f03e413d800 20 get_obj_state: setting s->obj_tag to ccqt920l8q090zie87a8d2kznseh4h0k 2024-09-14T10:50:00.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.465+0000 7f03e413d800 20 get_obj_state_impl: setting s->olh_tag to ngelml0z7oe9ylo6o4fqydvl1u6tslor 2024-09-14T10:50:00.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.465+0000 7f03e413d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:50:00.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.465+0000 7f03e413d800 20 get_obj_state: setting s->obj_tag to eyvcjyj6iww7n1dtfbidwdv3dkmrpp2a 2024-09-14T10:50:00.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.465+0000 7f03e413d800 20 get_obj_state_impl: setting s->olh_tag to 9zrpq59k0wpft80vq5nmyg1wg67ezg0u 2024-09-14T10:50:00.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.465+0000 7f03e413d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:50:00.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.465+0000 7f03e413d800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-14T10:50:00.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.465+0000 7f03e413d800 20 olh_log_entry: epoch=4 op=3 key=d[mhnwTcRa7ge11QVkYxkieStZwi1jH1z] 2024-09-14T10:50:00.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.465+0000 7f03e413d800 20 get_obj_state: octx=0x55b85a474bb0 obj=check-bucket:_:mhnwTcRa7ge11QVkYxkieStZwi1jH1z_d state=0x55b85a4995f8 s->prefetch_data=0 2024-09-14T10:50:00.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.465+0000 7f03e413d800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-14T10:50:00.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.465+0000 7f03e413d800 20 olh_log_entry: epoch=4 op=3 key=c[Gt9WlxuxLNWgjM.NB5yFAUjhQPbF24Q] 2024-09-14T10:50:00.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.465+0000 7f03e413d800 20 get_obj_state: octx=0x55b85a494bb0 obj=check-bucket:_:Gt9WlxuxLNWgjM.NB5yFAUjhQPbF24Q_c state=0x55b85a4a2e68 s->prefetch_data=0 2024-09-14T10:50:00.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.467+0000 7f03e413d800 20 get_obj_state: octx=0x55b85a494bb0 obj=check-bucket:c state=0x55b85a49d6d8 s->prefetch_data=0 2024-09-14T10:50:00.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.467+0000 7f03e413d800 20 get_obj_state: octx=0x55b85a474bb0 obj=check-bucket:d state=0x55b85a435de8 s->prefetch_data=0 2024-09-14T10:50:00.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.468+0000 7f03e413d800 20 get_obj_state: setting s->obj_tag to eyvcjyj6iww7n1dtfbidwdv3dkmrpp2a 2024-09-14T10:50:00.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.468+0000 7f03e413d800 20 get_obj_state_impl: setting s->olh_tag to 9zrpq59k0wpft80vq5nmyg1wg67ezg0u 2024-09-14T10:50:00.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.468+0000 7f03e413d800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=9zrpq59k0wpft80vq5nmyg1wg67ezg0u 2024-09-14T10:50:00.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.468+0000 7f03e413d800 20 get_obj_state: setting s->obj_tag to ccqt920l8q090zie87a8d2kznseh4h0k 2024-09-14T10:50:00.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.468+0000 7f03e413d800 20 get_obj_state_impl: setting s->olh_tag to ngelml0z7oe9ylo6o4fqydvl1u6tslor 2024-09-14T10:50:00.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.468+0000 7f03e413d800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ngelml0z7oe9ylo6o4fqydvl1u6tslor 2024-09-14T10:50:00.469 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.471+0000 7f03e413d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:50:00.470 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.471+0000 7f03e413d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:50:00.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.473+0000 7f03e413d800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T10:50:00.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.473+0000 7f03e413d800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T10:50:00.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.473+0000 7f03e413d800 1 NOTICE: finished all shards (2 entries removed) 2024-09-14T10:50:00.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.474+0000 7f0295fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:50:00.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.476+0000 7f03e413d800 20 remove_watcher() i=0 2024-09-14T10:50:00.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.476+0000 7f03e413d800 2 removed watcher, disabling cache 2024-09-14T10:50:00.476 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.477+0000 7f03e413d800 20 remove_watcher() i=1 2024-09-14T10:50:00.477 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.478+0000 7f03e413d800 20 remove_watcher() i=2 2024-09-14T10:50:00.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.479+0000 7f03e413d800 20 remove_watcher() i=3 2024-09-14T10:50:00.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.480+0000 7f03e413d800 20 remove_watcher() i=4 2024-09-14T10:50:00.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.481+0000 7f03e413d800 20 remove_watcher() i=5 2024-09-14T10:50:00.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.482+0000 7f03e413d800 20 remove_watcher() i=6 2024-09-14T10:50:00.482 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.484+0000 7f03e413d800 20 remove_watcher() i=7 2024-09-14T10:50:00.495 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T10:50:00.527 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:50:00.527 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:50:00.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.568+0000 7f0594c94800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.570+0000 7f0594c94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.570+0000 7f0594c94800 20 realm 2024-09-14T10:50:00.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.570+0000 7f0594c94800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.570+0000 7f0594c94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.570+0000 7f0594c94800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:50:00.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.570+0000 7f0594c94800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.570+0000 7f0594c94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.570+0000 7f0594c94800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.571+0000 7f0594c94800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:50:00.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.571+0000 7f0594c94800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.572+0000 7f0594c94800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:50:00.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.572+0000 7f0594c94800 20 searching for the correct realm 2024-09-14T10:50:00.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.575+0000 7f059277e640 0 -- 172.21.15.50:0/977281567 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x7f058c055410 msgr2=0x7f058c055890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:50:00.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.781+0000 7f059277e640 0 -- 172.21.15.50:0/977281567 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f058c093410 msgr2=0x7f058c093890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:50:00.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.786+0000 7f0594c94800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:50:00.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.786+0000 7f0594c94800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:50:00.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.786+0000 7f0594c94800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:50:00.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.786+0000 7f0594c94800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:50:00.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.786+0000 7f0594c94800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:50:00.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.786+0000 7f0594c94800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:50:00.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.786+0000 7f0594c94800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.786+0000 7f0594c94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.786+0000 7f0594c94800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.786+0000 7f0594c94800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:50:00.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.786+0000 7f0594c94800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.787+0000 7f0594c94800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:50:00.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.787+0000 7f0594c94800 20 zone default found 2024-09-14T10:50:00.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.787+0000 7f0594c94800 4 Realm: () 2024-09-14T10:50:00.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.787+0000 7f0594c94800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:50:00.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.787+0000 7f0594c94800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:50:00.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.787+0000 7f0594c94800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:50:00.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.787+0000 7f0594c94800 20 zonegroup default 2024-09-14T10:50:00.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.787+0000 7f0594c94800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.787+0000 7f0594c94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.787+0000 7f0594c94800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.787+0000 7f0594c94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.787+0000 7f0594c94800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.788+0000 7f0594c94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.788+0000 7f0594c94800 20 started sync module instance, tier type = 2024-09-14T10:50:00.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.788+0000 7f0594c94800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:50:00.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.798+0000 7f0594c94800 20 add_watcher() i=0 2024-09-14T10:50:00.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.798+0000 7f0594c94800 20 add_watcher() i=1 2024-09-14T10:50:00.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.798+0000 7f0594c94800 20 add_watcher() i=2 2024-09-14T10:50:00.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.798+0000 7f0594c94800 20 add_watcher() i=3 2024-09-14T10:50:00.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.798+0000 7f0594c94800 20 add_watcher() i=4 2024-09-14T10:50:00.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.798+0000 7f0594c94800 20 add_watcher() i=5 2024-09-14T10:50:00.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.798+0000 7f0594c94800 20 add_watcher() i=6 2024-09-14T10:50:00.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.799+0000 7f0594c94800 20 add_watcher() i=7 2024-09-14T10:50:00.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.799+0000 7f0594c94800 2 all 8 watchers are set, enabling cache 2024-09-14T10:50:00.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.801+0000 7f0448fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:50:00.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.801+0000 7f0594c94800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:50:00.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.801+0000 7f0594c94800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:50:00.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.801+0000 7f0594c94800 5 note: GC not initialized 2024-09-14T10:50:00.802 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.801+0000 7f03c37fe640 20 reqs_thread_entry: start 2024-09-14T10:50:00.802 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.802+0000 7f0594c94800 20 init_complete bucket index max shards: 11 2024-09-14T10:50:00.802 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.802+0000 7f0594c94800 20 Filter name: none 2024-09-14T10:50:00.802 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.802+0000 7f03c17fa640 20 reqs_thread_entry: start 2024-09-14T10:50:00.802 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.802+0000 7f0594c94800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.802+0000 7f0594c94800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:50:00.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.802+0000 7f0594c94800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.803+0000 7f0594c94800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:50:00.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.803+0000 7f0594c94800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:50:00.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.803+0000 7f0594c94800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:50:00.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.803+0000 7f0594c94800 20 INFO: main: starting shard=0 2024-09-14T10:50:00.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.803+0000 7f0594c94800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.0 2024-09-14T10:50:00.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.803+0000 7f0594c94800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:00.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.803+0000 7f0594c94800 20 INFO: main: starting shard=1 2024-09-14T10:50:00.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.803+0000 7f0594c94800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:50:00.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.804+0000 7f0594c94800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:00.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.804+0000 7f0594c94800 20 INFO: main: starting shard=2 2024-09-14T10:50:00.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.804+0000 7f0594c94800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.2 2024-09-14T10:50:00.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.805+0000 7f0594c94800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:00.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.805+0000 7f0594c94800 20 INFO: main: starting shard=3 2024-09-14T10:50:00.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.805+0000 7f0594c94800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.3 2024-09-14T10:50:00.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.805+0000 7f0594c94800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:00.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.805+0000 7f0594c94800 20 INFO: main: starting shard=4 2024-09-14T10:50:00.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.805+0000 7f0594c94800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.4 2024-09-14T10:50:00.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.806+0000 7f0594c94800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:00.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.806+0000 7f0594c94800 20 INFO: main: starting shard=5 2024-09-14T10:50:00.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.806+0000 7f0594c94800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:50:00.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.806+0000 7f0594c94800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:00.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.806+0000 7f0594c94800 20 INFO: main: starting shard=6 2024-09-14T10:50:00.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.806+0000 7f0594c94800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.6 2024-09-14T10:50:00.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.806+0000 7f0594c94800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:00.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.806+0000 7f0594c94800 20 INFO: main: starting shard=7 2024-09-14T10:50:00.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.806+0000 7f0594c94800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.7 2024-09-14T10:50:00.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.807+0000 7f0594c94800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:00.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.807+0000 7f0594c94800 20 INFO: main: starting shard=8 2024-09-14T10:50:00.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.807+0000 7f0594c94800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:50:00.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.808+0000 7f0594c94800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:00.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.808+0000 7f0594c94800 20 INFO: main: starting shard=9 2024-09-14T10:50:00.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.808+0000 7f0594c94800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.9 2024-09-14T10:50:00.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.808+0000 7f0594c94800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:00.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.808+0000 7f0594c94800 20 INFO: main: starting shard=10 2024-09-14T10:50:00.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.808+0000 7f0594c94800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:50:00.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.809+0000 7f0594c94800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:00.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.809+0000 7f0594c94800 20 INFO: main: done 2024-09-14T10:50:00.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.810+0000 7f0448fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:50:00.811 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.812+0000 7f0594c94800 20 remove_watcher() i=0 2024-09-14T10:50:00.811 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.812+0000 7f0594c94800 2 removed watcher, disabling cache 2024-09-14T10:50:00.812 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.813+0000 7f0594c94800 20 remove_watcher() i=1 2024-09-14T10:50:00.813 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.814+0000 7f0594c94800 20 remove_watcher() i=2 2024-09-14T10:50:00.814 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.815+0000 7f0594c94800 20 remove_watcher() i=3 2024-09-14T10:50:00.815 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.816+0000 7f0594c94800 20 remove_watcher() i=4 2024-09-14T10:50:00.816 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.818+0000 7f0594c94800 20 remove_watcher() i=5 2024-09-14T10:50:00.817 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.819+0000 7f0594c94800 20 remove_watcher() i=6 2024-09-14T10:50:00.818 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.820+0000 7f0594c94800 20 remove_watcher() i=7 2024-09-14T10:50:00.831 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T10:50:00.863 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:50:00.863 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:50:00.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.904+0000 7f42dbb2e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.904 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.905+0000 7f42dbb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.905 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.905+0000 7f42dbb2e800 20 realm 2024-09-14T10:50:00.905 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.905+0000 7f42dbb2e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.905 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.906+0000 7f42dbb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.905 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.906+0000 7f42dbb2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:50:00.905 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.906+0000 7f42dbb2e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.906+0000 7f42dbb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.906+0000 7f42dbb2e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.907+0000 7f42dbb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:50:00.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.907+0000 7f42dbb2e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.907+0000 7f42dbb2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:50:00.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.907+0000 7f42dbb2e800 20 searching for the correct realm 2024-09-14T10:50:00.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.910+0000 7f42d70dc640 0 -- 172.21.15.50:0/2117355303 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f42d006ea10 msgr2=0x7f42d007f050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:50:00.913 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.914+0000 7f42d80de640 0 -- 172.21.15.50:0/2117355303 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x560a7faeea40 msgr2=0x560a7faf0eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:50:00.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.918+0000 7f42dbb2e800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:50:00.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.918+0000 7f42dbb2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:50:00.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.918+0000 7f42dbb2e800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:50:00.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.918+0000 7f42dbb2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:50:00.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.918+0000 7f42dbb2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:50:00.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.918+0000 7f42dbb2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:50:00.918 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.918+0000 7f42dbb2e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.918 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.918+0000 7f42dbb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.918 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.918+0000 7f42dbb2e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.918 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.918+0000 7f42dbb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:50:00.918 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.918+0000 7f42dbb2e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.919+0000 7f42dbb2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:50:00.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.919+0000 7f42dbb2e800 20 zone default found 2024-09-14T10:50:00.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.919+0000 7f42dbb2e800 4 Realm: () 2024-09-14T10:50:00.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.919+0000 7f42dbb2e800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:50:00.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.919+0000 7f42dbb2e800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:50:00.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.919+0000 7f42dbb2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:50:00.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.919+0000 7f42dbb2e800 20 zonegroup default 2024-09-14T10:50:00.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.919+0000 7f42dbb2e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.919+0000 7f42dbb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.919+0000 7f42dbb2e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.919+0000 7f42dbb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.919+0000 7f42dbb2e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.920+0000 7f42dbb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:00.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.920+0000 7f42dbb2e800 20 started sync module instance, tier type = 2024-09-14T10:50:00.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.920+0000 7f42dbb2e800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:50:00.927 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.928+0000 7f42dbb2e800 20 add_watcher() i=0 2024-09-14T10:50:00.927 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.928+0000 7f42dbb2e800 20 add_watcher() i=1 2024-09-14T10:50:00.927 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.928+0000 7f42dbb2e800 20 add_watcher() i=2 2024-09-14T10:50:00.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.928+0000 7f42dbb2e800 20 add_watcher() i=3 2024-09-14T10:50:00.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.928+0000 7f42dbb2e800 20 add_watcher() i=4 2024-09-14T10:50:00.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.928+0000 7f42dbb2e800 20 add_watcher() i=5 2024-09-14T10:50:00.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.928+0000 7f42dbb2e800 20 add_watcher() i=6 2024-09-14T10:50:00.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.930+0000 7f42dbb2e800 20 add_watcher() i=7 2024-09-14T10:50:00.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.930+0000 7f42dbb2e800 2 all 8 watchers are set, enabling cache 2024-09-14T10:50:00.930 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.931+0000 7f418dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:50:00.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.932+0000 7f42dbb2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:50:00.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.932+0000 7f42dbb2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:50:00.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.932+0000 7f42dbb2e800 5 note: GC not initialized 2024-09-14T10:50:00.932 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.932+0000 7f418cfe1640 20 reqs_thread_entry: start 2024-09-14T10:50:00.932 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.932+0000 7f42dbb2e800 20 init_complete bucket index max shards: 11 2024-09-14T10:50:00.932 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.932+0000 7f42dbb2e800 20 Filter name: none 2024-09-14T10:50:00.932 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.932+0000 7f41067fc640 20 reqs_thread_entry: start 2024-09-14T10:50:00.932 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.932+0000 7f42dbb2e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.933 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.933+0000 7f42dbb2e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:50:00.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.933+0000 7f42dbb2e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:00.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.934+0000 7f42dbb2e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:50:00.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.934+0000 7f42dbb2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:50:00.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.934+0000 7f42dbb2e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:50:00.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.934+0000 7f42dbb2e800 20 INFO: main: starting shard=0 2024-09-14T10:50:00.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.934+0000 7f42dbb2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.0 2024-09-14T10:50:00.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.934+0000 7f42dbb2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:00.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.934+0000 7f42dbb2e800 20 INFO: main: starting shard=1 2024-09-14T10:50:00.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.934+0000 7f42dbb2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:50:00.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.935+0000 7f42dbb2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:00.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.935+0000 7f42dbb2e800 20 INFO: main: starting shard=2 2024-09-14T10:50:00.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.935+0000 7f42dbb2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.2 2024-09-14T10:50:00.935 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.935+0000 7f42dbb2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:00.935 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.935+0000 7f42dbb2e800 20 INFO: main: starting shard=3 2024-09-14T10:50:00.935 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.935+0000 7f42dbb2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.3 2024-09-14T10:50:00.935 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.935+0000 7f42dbb2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:00.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.935+0000 7f42dbb2e800 20 INFO: main: starting shard=4 2024-09-14T10:50:00.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.935+0000 7f42dbb2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.4 2024-09-14T10:50:00.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.936+0000 7f42dbb2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:00.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.936+0000 7f42dbb2e800 20 INFO: main: starting shard=5 2024-09-14T10:50:00.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.936+0000 7f42dbb2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:50:00.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.936+0000 7f42dbb2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:00.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.936+0000 7f42dbb2e800 20 INFO: main: starting shard=6 2024-09-14T10:50:00.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.936+0000 7f42dbb2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.6 2024-09-14T10:50:00.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.937+0000 7f42dbb2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:00.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.937+0000 7f42dbb2e800 20 INFO: main: starting shard=7 2024-09-14T10:50:00.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.937+0000 7f42dbb2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.7 2024-09-14T10:50:00.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.938+0000 7f42dbb2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:00.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.938+0000 7f42dbb2e800 20 INFO: main: starting shard=8 2024-09-14T10:50:00.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.938+0000 7f42dbb2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:50:00.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.938+0000 7f42dbb2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:00.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.938+0000 7f42dbb2e800 20 INFO: main: starting shard=9 2024-09-14T10:50:00.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.938+0000 7f42dbb2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.9 2024-09-14T10:50:00.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.939+0000 7f42dbb2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:00.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.939+0000 7f42dbb2e800 20 INFO: main: starting shard=10 2024-09-14T10:50:00.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.939+0000 7f42dbb2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:50:00.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.939+0000 7f42dbb2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:00.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.939+0000 7f42dbb2e800 20 INFO: main: done 2024-09-14T10:50:00.939 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.940+0000 7f418dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:50:00.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.942+0000 7f42dbb2e800 20 remove_watcher() i=0 2024-09-14T10:50:00.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.942+0000 7f42dbb2e800 2 removed watcher, disabling cache 2024-09-14T10:50:00.942 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.943+0000 7f42dbb2e800 20 remove_watcher() i=1 2024-09-14T10:50:00.943 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.945+0000 7f42dbb2e800 20 remove_watcher() i=2 2024-09-14T10:50:00.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.946+0000 7f42dbb2e800 20 remove_watcher() i=3 2024-09-14T10:50:00.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.947+0000 7f42dbb2e800 20 remove_watcher() i=4 2024-09-14T10:50:00.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.948+0000 7f42dbb2e800 20 remove_watcher() i=5 2024-09-14T10:50:00.948 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.949+0000 7f42dbb2e800 20 remove_watcher() i=6 2024-09-14T10:50:00.948 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:00.950+0000 7f42dbb2e800 20 remove_watcher() i=7 2024-09-14T10:50:00.960 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-14T10:50:00.960 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:50:00.961 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T10:50:00.993 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:50:00.993 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:50:01.033 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.034+0000 7f1e0a32a800 20 rados->read ofs=0 len=0 2024-09-14T10:50:01.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.035+0000 7f1e0a32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:01.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.035+0000 7f1e0a32a800 20 realm 2024-09-14T10:50:01.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.035+0000 7f1e0a32a800 20 rados->read ofs=0 len=0 2024-09-14T10:50:01.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.035+0000 7f1e0a32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:01.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.035+0000 7f1e0a32a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:50:01.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.035+0000 7f1e0a32a800 20 rados->read ofs=0 len=0 2024-09-14T10:50:01.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.036+0000 7f1e0a32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:01.036 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.036+0000 7f1e0a32a800 20 rados->read ofs=0 len=0 2024-09-14T10:50:01.036 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.036+0000 7f1e0a32a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:50:01.036 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.036+0000 7f1e0a32a800 20 rados->read ofs=0 len=0 2024-09-14T10:50:01.036 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.037+0000 7f1e0a32a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:50:01.036 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.037+0000 7f1e0a32a800 20 searching for the correct realm 2024-09-14T10:50:01.037 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.038+0000 7f1e060da640 0 -- 172.21.15.50:0/2987894982 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x7f1e0003d060 msgr2=0x7f1e000662e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:50:01.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.243+0000 7f1e068db640 0 -- 172.21.15.50:0/2987894982 >> [v2:172.21.15.118:6826/1082138742,v1:172.21.15.118:6827/1082138742] conn(0x7f1df80471c0 msgr2=0x7f1df8087f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:50:01.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.451+0000 7f1e0a32a800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:50:01.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.451+0000 7f1e0a32a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:50:01.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.451+0000 7f1e0a32a800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:50:01.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.451+0000 7f1e0a32a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:50:01.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.451+0000 7f1e0a32a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:50:01.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.451+0000 7f1e0a32a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:50:01.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.451+0000 7f1e0a32a800 20 rados->read ofs=0 len=0 2024-09-14T10:50:01.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.452+0000 7f1e0a32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:01.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.452+0000 7f1e0a32a800 20 rados->read ofs=0 len=0 2024-09-14T10:50:01.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.452+0000 7f1e0a32a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:50:01.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.452+0000 7f1e0a32a800 20 rados->read ofs=0 len=0 2024-09-14T10:50:01.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.452+0000 7f1e0a32a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:50:01.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.452+0000 7f1e0a32a800 20 zone default found 2024-09-14T10:50:01.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.453+0000 7f1e0a32a800 4 Realm: () 2024-09-14T10:50:01.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.453+0000 7f1e0a32a800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:50:01.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.453+0000 7f1e0a32a800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:50:01.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.453+0000 7f1e0a32a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:50:01.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.453+0000 7f1e0a32a800 20 zonegroup default 2024-09-14T10:50:01.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.453+0000 7f1e0a32a800 20 rados->read ofs=0 len=0 2024-09-14T10:50:01.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.453+0000 7f1e0a32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:01.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.453+0000 7f1e0a32a800 20 rados->read ofs=0 len=0 2024-09-14T10:50:01.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.453+0000 7f1e0a32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:01.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.453+0000 7f1e0a32a800 20 rados->read ofs=0 len=0 2024-09-14T10:50:01.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.454+0000 7f1e0a32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:01.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.454+0000 7f1e0a32a800 20 started sync module instance, tier type = 2024-09-14T10:50:01.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.454+0000 7f1e0a32a800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:50:01.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.464+0000 7f1e0a32a800 20 add_watcher() i=0 2024-09-14T10:50:01.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.464+0000 7f1e0a32a800 20 add_watcher() i=1 2024-09-14T10:50:01.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.464+0000 7f1e0a32a800 20 add_watcher() i=2 2024-09-14T10:50:01.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.464+0000 7f1e0a32a800 20 add_watcher() i=3 2024-09-14T10:50:01.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.464+0000 7f1e0a32a800 20 add_watcher() i=4 2024-09-14T10:50:01.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.464+0000 7f1e0a32a800 20 add_watcher() i=5 2024-09-14T10:50:01.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.464+0000 7f1e0a32a800 20 add_watcher() i=6 2024-09-14T10:50:01.464 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.465+0000 7f1e0a32a800 20 add_watcher() i=7 2024-09-14T10:50:01.464 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.465+0000 7f1e0a32a800 2 all 8 watchers are set, enabling cache 2024-09-14T10:50:01.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.467+0000 7f1cbcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:50:01.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.467+0000 7f1e0a32a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:50:01.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.467+0000 7f1e0a32a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:50:01.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.467+0000 7f1e0a32a800 5 note: GC not initialized 2024-09-14T10:50:01.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.468+0000 7f1c377fe640 20 reqs_thread_entry: start 2024-09-14T10:50:01.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.468+0000 7f1e0a32a800 20 init_complete bucket index max shards: 11 2024-09-14T10:50:01.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.468+0000 7f1e0a32a800 20 Filter name: none 2024-09-14T10:50:01.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.468+0000 7f1c357fa640 20 reqs_thread_entry: start 2024-09-14T10:50:01.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.468+0000 7f1e0a32a800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:50:01.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.468+0000 7f1e0a32a800 20 rados->read ofs=0 len=0 2024-09-14T10:50:01.469 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.469+0000 7f1e0a32a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:50:01.469 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.469+0000 7f1e0a32a800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:50:01.469 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.469+0000 7f1e0a32a800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:50:01.469 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.469+0000 7f1e0a32a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 : miss 2024-09-14T10:50:01.469 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.469+0000 7f1e0a32a800 20 rados->read ofs=0 len=0 2024-09-14T10:50:01.470 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.469+0000 7f1e0a32a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:50:01.470 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.469+0000 7f1e0a32a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 info.flags=0x17 2024-09-14T10:50:01.470 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.469+0000 7f1e0a32a800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 to cache LRU end 2024-09-14T10:50:01.470 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.469+0000 7f1e0a32a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:50:01.470 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.469+0000 7f1e0a32a800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:50:01.470 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.469+0000 7f1e0a32a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 2024-09-14T10:50:01.470 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.469+0000 7f1e0a32a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.0 2024-09-14T10:50:01.470 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.470+0000 7f1e0a32a800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T10:50:01.470 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.470+0000 7f1e0a32a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:50:01.470 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.470+0000 7f1e0a32a800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T10:50:01.470 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.470+0000 7f1e0a32a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.2 2024-09-14T10:50:01.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.471+0000 7f1e0a32a800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T10:50:01.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.471+0000 7f1e0a32a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.3 2024-09-14T10:50:01.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.471+0000 7f1e0a32a800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T10:50:01.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.471+0000 7f1e0a32a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.4 2024-09-14T10:50:01.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.472+0000 7f1e0a32a800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T10:50:01.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.472+0000 7f1e0a32a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:50:01.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.473+0000 7f1e0a32a800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T10:50:01.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.473+0000 7f1e0a32a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.6 2024-09-14T10:50:01.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.473+0000 7f1e0a32a800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T10:50:01.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.473+0000 7f1e0a32a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.7 2024-09-14T10:50:01.473 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.474+0000 7f1e0a32a800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T10:50:01.473 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.474+0000 7f1e0a32a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:50:01.474 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.475+0000 7f1e0a32a800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T10:50:01.474 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.475+0000 7f1e0a32a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.9 2024-09-14T10:50:01.474 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.475+0000 7f1e0a32a800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T10:50:01.474 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.475+0000 7f1e0a32a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:50:01.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.476+0000 7f1e0a32a800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T10:50:01.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.476+0000 7f1e0a32a800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T10:50:01.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.477+0000 7f1cbcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:50:01.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.479+0000 7f1e0a32a800 20 remove_watcher() i=0 2024-09-14T10:50:01.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.479+0000 7f1e0a32a800 2 removed watcher, disabling cache 2024-09-14T10:50:01.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.480+0000 7f1e0a32a800 20 remove_watcher() i=1 2024-09-14T10:50:01.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.481+0000 7f1e0a32a800 20 remove_watcher() i=2 2024-09-14T10:50:01.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.482+0000 7f1e0a32a800 20 remove_watcher() i=3 2024-09-14T10:50:01.482 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.484+0000 7f1e0a32a800 20 remove_watcher() i=4 2024-09-14T10:50:01.483 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.485+0000 7f1e0a32a800 20 remove_watcher() i=5 2024-09-14T10:50:01.484 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.486+0000 7f1e0a32a800 20 remove_watcher() i=6 2024-09-14T10:50:01.486 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:01.487+0000 7f1e0a32a800 20 remove_watcher() i=7 2024-09-14T10:50:01.498 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-14T10:50:01.498 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:50:01.500 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:01.501 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:01.529 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:01.530 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:01.554 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:01.554 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:01.627 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-14T10:50:01.627 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:50:01.628 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:01.628 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:01.701 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:01.701 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:01.923 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:01.923 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:01.985 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:01.985 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:02.010 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:02.010 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:02.066 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:02.066 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:02.091 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:02.091 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:02.145 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:02.145 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:02.170 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:02.170 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:02.223 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:02.223 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:02.248 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:02.248 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:02.302 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:02.302 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:02.327 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:02.327 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:02.381 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:02.381 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:02.408 INFO:tasks.workunit.client.0.smithi050.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T10:50:02.822 INFO:tasks.workunit.client.0.smithi050.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T10:50:04.235 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:04.235 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:04.327 INFO:tasks.workunit.client.0.smithi050.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:50:04.329 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T10:50:04.363 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:50:04.363 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:50:04.408 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.409+0000 7fd917a11800 20 rados->read ofs=0 len=0 2024-09-14T10:50:04.410 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.411+0000 7fd917a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:04.410 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.411+0000 7fd917a11800 20 realm 2024-09-14T10:50:04.410 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.411+0000 7fd917a11800 20 rados->read ofs=0 len=0 2024-09-14T10:50:04.411 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.411+0000 7fd917a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:04.411 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.411+0000 7fd917a11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:50:04.411 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.411+0000 7fd917a11800 20 rados->read ofs=0 len=0 2024-09-14T10:50:04.411 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.411+0000 7fd917a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:04.411 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.411+0000 7fd917a11800 20 rados->read ofs=0 len=0 2024-09-14T10:50:04.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.412+0000 7fd917a11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:50:04.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.412+0000 7fd917a11800 20 rados->read ofs=0 len=0 2024-09-14T10:50:04.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.413+0000 7fd917a11800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:50:04.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.413+0000 7fd917a11800 20 searching for the correct realm 2024-09-14T10:50:04.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.416+0000 7fd912921640 0 -- 172.21.15.50:0/3480166948 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fd90c017920 msgr2=0x7fd90c0153f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:50:04.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.621+0000 7fd913122640 0 -- 172.21.15.50:0/3480166948 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7fd90c03d950 msgr2=0x7fd90c03c3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:50:04.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.627+0000 7fd917a11800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:50:04.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.627+0000 7fd917a11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:50:04.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.627+0000 7fd917a11800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:50:04.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.627+0000 7fd917a11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:50:04.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.627+0000 7fd917a11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:50:04.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.627+0000 7fd917a11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:50:04.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.627+0000 7fd917a11800 20 rados->read ofs=0 len=0 2024-09-14T10:50:04.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.627+0000 7fd917a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:04.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.627+0000 7fd917a11800 20 rados->read ofs=0 len=0 2024-09-14T10:50:04.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.627+0000 7fd917a11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:50:04.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.627+0000 7fd917a11800 20 rados->read ofs=0 len=0 2024-09-14T10:50:04.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.628+0000 7fd917a11800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:50:04.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.628+0000 7fd917a11800 20 zone default found 2024-09-14T10:50:04.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.628+0000 7fd917a11800 4 Realm: () 2024-09-14T10:50:04.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.628+0000 7fd917a11800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:50:04.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.628+0000 7fd917a11800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:50:04.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.628+0000 7fd917a11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:50:04.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.628+0000 7fd917a11800 20 zonegroup default 2024-09-14T10:50:04.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.628+0000 7fd917a11800 20 rados->read ofs=0 len=0 2024-09-14T10:50:04.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.628+0000 7fd917a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:04.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.628+0000 7fd917a11800 20 rados->read ofs=0 len=0 2024-09-14T10:50:04.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.629+0000 7fd917a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:04.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.629+0000 7fd917a11800 20 rados->read ofs=0 len=0 2024-09-14T10:50:04.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.629+0000 7fd917a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:04.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.629+0000 7fd917a11800 20 started sync module instance, tier type = 2024-09-14T10:50:04.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.629+0000 7fd917a11800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:50:04.638 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.640+0000 7fd917a11800 20 add_watcher() i=0 2024-09-14T10:50:04.638 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.640+0000 7fd917a11800 20 add_watcher() i=1 2024-09-14T10:50:04.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.640+0000 7fd917a11800 20 add_watcher() i=2 2024-09-14T10:50:04.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.640+0000 7fd917a11800 20 add_watcher() i=3 2024-09-14T10:50:04.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.640+0000 7fd917a11800 20 add_watcher() i=4 2024-09-14T10:50:04.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.640+0000 7fd917a11800 20 add_watcher() i=5 2024-09-14T10:50:04.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.640+0000 7fd917a11800 20 add_watcher() i=6 2024-09-14T10:50:04.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.641+0000 7fd917a11800 20 add_watcher() i=7 2024-09-14T10:50:04.640 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.641+0000 7fd917a11800 2 all 8 watchers are set, enabling cache 2024-09-14T10:50:04.641 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.643+0000 7fd7c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:50:04.644 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.643+0000 7fd917a11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:50:04.644 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.643+0000 7fd917a11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:50:04.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.643+0000 7fd917a11800 5 note: GC not initialized 2024-09-14T10:50:04.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.643+0000 7fd7c8fe1640 20 reqs_thread_entry: start 2024-09-14T10:50:04.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.643+0000 7fd917a11800 20 init_complete bucket index max shards: 11 2024-09-14T10:50:04.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.643+0000 7fd917a11800 20 Filter name: none 2024-09-14T10:50:04.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.644+0000 7fd7427fc640 20 reqs_thread_entry: start 2024-09-14T10:50:04.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.644+0000 7fd917a11800 20 rados->read ofs=0 len=0 2024-09-14T10:50:04.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.644+0000 7fd917a11800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:50:04.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.644+0000 7fd917a11800 20 rados->read ofs=0 len=0 2024-09-14T10:50:04.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.644+0000 7fd917a11800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:50:04.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.645+0000 7fd917a11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:50:04.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.645+0000 7fd917a11800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:50:04.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.645+0000 7fd917a11800 20 INFO: main: starting shard=0 2024-09-14T10:50:04.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.645+0000 7fd917a11800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.0 2024-09-14T10:50:04.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.645+0000 7fd917a11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:04.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.645+0000 7fd917a11800 20 INFO: main: starting shard=1 2024-09-14T10:50:04.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.645+0000 7fd917a11800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:50:04.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.646+0000 7fd917a11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:04.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.646+0000 7fd917a11800 20 INFO: main: starting shard=2 2024-09-14T10:50:04.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.646+0000 7fd917a11800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.2 2024-09-14T10:50:04.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.646+0000 7fd917a11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:04.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.646+0000 7fd917a11800 20 INFO: main: starting shard=3 2024-09-14T10:50:04.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.646+0000 7fd917a11800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.3 2024-09-14T10:50:04.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.647+0000 7fd917a11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:04.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.647+0000 7fd917a11800 20 INFO: main: starting shard=4 2024-09-14T10:50:04.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.647+0000 7fd917a11800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.4 2024-09-14T10:50:04.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.647+0000 7fd917a11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:04.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.647+0000 7fd917a11800 20 INFO: main: starting shard=5 2024-09-14T10:50:04.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.647+0000 7fd917a11800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:50:04.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.648+0000 7fd917a11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:04.648 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.648+0000 7fd917a11800 20 INFO: main: starting shard=6 2024-09-14T10:50:04.648 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.648+0000 7fd917a11800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.6 2024-09-14T10:50:04.648 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.648+0000 7fd917a11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:04.648 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.648+0000 7fd917a11800 20 INFO: main: starting shard=7 2024-09-14T10:50:04.648 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.648+0000 7fd917a11800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.7 2024-09-14T10:50:04.648 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.649+0000 7fd917a11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:04.648 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.649+0000 7fd917a11800 20 INFO: main: starting shard=8 2024-09-14T10:50:04.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.649+0000 7fd917a11800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:50:04.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.650+0000 7fd917a11800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T10:50:04.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.650+0000 7fd917a11800 20 INFO: main: starting shard=9 2024-09-14T10:50:04.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.650+0000 7fd917a11800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.9 2024-09-14T10:50:04.650 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.651+0000 7fd917a11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:04.650 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.651+0000 7fd917a11800 20 INFO: main: starting shard=10 2024-09-14T10:50:04.650 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.651+0000 7fd917a11800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:50:04.650 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.651+0000 7fd917a11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:04.650 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.651+0000 7fd917a11800 20 INFO: main: done 2024-09-14T10:50:04.651 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.652+0000 7fd7c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:50:04.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.655+0000 7fd917a11800 20 remove_watcher() i=0 2024-09-14T10:50:04.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.655+0000 7fd917a11800 2 removed watcher, disabling cache 2024-09-14T10:50:04.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.656+0000 7fd917a11800 20 remove_watcher() i=1 2024-09-14T10:50:04.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.657+0000 7fd917a11800 20 remove_watcher() i=2 2024-09-14T10:50:04.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.658+0000 7fd917a11800 20 remove_watcher() i=3 2024-09-14T10:50:04.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.659+0000 7fd917a11800 20 remove_watcher() i=4 2024-09-14T10:50:04.659 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.660+0000 7fd917a11800 20 remove_watcher() i=5 2024-09-14T10:50:04.660 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.661+0000 7fd917a11800 20 remove_watcher() i=6 2024-09-14T10:50:04.661 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.663+0000 7fd917a11800 20 remove_watcher() i=7 2024-09-14T10:50:04.675 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:04.675 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:04.701 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:04.701 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:04.725 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:04.725 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:04.812 INFO:tasks.workunit.client.0.smithi050.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:50:04.813 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T10:50:04.847 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:50:04.847 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:50:04.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.888+0000 7f2635c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:50:04.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.890+0000 7f2635c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:04.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.890+0000 7f2635c2f800 20 realm 2024-09-14T10:50:04.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.890+0000 7f2635c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:50:04.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.890+0000 7f2635c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:04.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.890+0000 7f2635c2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:50:04.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.890+0000 7f2635c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:50:04.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.890+0000 7f2635c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:04.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.890+0000 7f2635c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:50:04.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.891+0000 7f2635c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:50:04.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.891+0000 7f2635c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:50:04.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.892+0000 7f2635c2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:50:04.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.892+0000 7f2635c2f800 20 searching for the correct realm 2024-09-14T10:50:04.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:04.895+0000 7f2632f18640 0 -- 172.21.15.50:0/401045559 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f262c024040 msgr2=0x7f262c034930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:50:05.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.101+0000 7f2633f1a640 0 -- 172.21.15.50:0/401045559 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55b4fa9e8a00 msgr2=0x55b4fa9eae80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:50:05.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.105+0000 7f2635c2f800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:50:05.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.105+0000 7f2635c2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:50:05.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.105+0000 7f2635c2f800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:50:05.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.105+0000 7f2635c2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:50:05.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.105+0000 7f2635c2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:50:05.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.105+0000 7f2635c2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:50:05.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.105+0000 7f2635c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.106+0000 7f2635c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:05.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.106+0000 7f2635c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.106+0000 7f2635c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:50:05.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.106+0000 7f2635c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.106+0000 7f2635c2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:50:05.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.106+0000 7f2635c2f800 20 zone default found 2024-09-14T10:50:05.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.106+0000 7f2635c2f800 4 Realm: () 2024-09-14T10:50:05.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.106+0000 7f2635c2f800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:50:05.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.106+0000 7f2635c2f800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:50:05.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.106+0000 7f2635c2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:50:05.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.106+0000 7f2635c2f800 20 zonegroup default 2024-09-14T10:50:05.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.106+0000 7f2635c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.107+0000 7f2635c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:05.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.107+0000 7f2635c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.107+0000 7f2635c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:05.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.107+0000 7f2635c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.107+0000 7f2635c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:05.109 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.107+0000 7f2635c2f800 20 started sync module instance, tier type = 2024-09-14T10:50:05.109 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.107+0000 7f2635c2f800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:50:05.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.118+0000 7f2635c2f800 20 add_watcher() i=0 2024-09-14T10:50:05.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.118+0000 7f2635c2f800 20 add_watcher() i=1 2024-09-14T10:50:05.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.118+0000 7f2635c2f800 20 add_watcher() i=2 2024-09-14T10:50:05.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.118+0000 7f2635c2f800 20 add_watcher() i=3 2024-09-14T10:50:05.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.118+0000 7f2635c2f800 20 add_watcher() i=4 2024-09-14T10:50:05.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.118+0000 7f2635c2f800 20 add_watcher() i=5 2024-09-14T10:50:05.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.118+0000 7f2635c2f800 20 add_watcher() i=6 2024-09-14T10:50:05.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.119+0000 7f2635c2f800 20 add_watcher() i=7 2024-09-14T10:50:05.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.119+0000 7f2635c2f800 2 all 8 watchers are set, enabling cache 2024-09-14T10:50:05.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.121+0000 7f24e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:50:05.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.121+0000 7f2635c2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:50:05.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.121+0000 7f2635c2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:50:05.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.121+0000 7f2635c2f800 5 note: GC not initialized 2024-09-14T10:50:05.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.121+0000 7f24e8fe1640 20 reqs_thread_entry: start 2024-09-14T10:50:05.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.122+0000 7f2635c2f800 20 init_complete bucket index max shards: 11 2024-09-14T10:50:05.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.122+0000 7f2635c2f800 20 Filter name: none 2024-09-14T10:50:05.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.122+0000 7f24627fc640 20 reqs_thread_entry: start 2024-09-14T10:50:05.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.122+0000 7f2635c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.122+0000 7f2635c2f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:50:05.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.122+0000 7f2635c2f800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.123+0000 7f2635c2f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:50:05.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.123+0000 7f2635c2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:50:05.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.123+0000 7f2635c2f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:50:05.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.123+0000 7f2635c2f800 20 INFO: main: starting shard=0 2024-09-14T10:50:05.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.123+0000 7f2635c2f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.0 2024-09-14T10:50:05.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.123+0000 7f2635c2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:05.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.123+0000 7f2635c2f800 20 INFO: main: starting shard=1 2024-09-14T10:50:05.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.123+0000 7f2635c2f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:50:05.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.124+0000 7f2635c2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:05.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.124+0000 7f2635c2f800 20 INFO: main: starting shard=2 2024-09-14T10:50:05.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.124+0000 7f2635c2f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.2 2024-09-14T10:50:05.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.124+0000 7f2635c2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:05.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.124+0000 7f2635c2f800 20 INFO: main: starting shard=3 2024-09-14T10:50:05.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.124+0000 7f2635c2f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.3 2024-09-14T10:50:05.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.124+0000 7f2635c2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:05.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.124+0000 7f2635c2f800 20 INFO: main: starting shard=4 2024-09-14T10:50:05.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.124+0000 7f2635c2f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.4 2024-09-14T10:50:05.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.125+0000 7f2635c2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:05.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.125+0000 7f2635c2f800 20 INFO: main: starting shard=5 2024-09-14T10:50:05.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.125+0000 7f2635c2f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:50:05.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.126+0000 7f2635c2f800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T10:50:05.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.126+0000 7f2635c2f800 20 INFO: main: starting shard=6 2024-09-14T10:50:05.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.126+0000 7f2635c2f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.6 2024-09-14T10:50:05.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.126+0000 7f2635c2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:05.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.126+0000 7f2635c2f800 20 INFO: main: starting shard=7 2024-09-14T10:50:05.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.126+0000 7f2635c2f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.7 2024-09-14T10:50:05.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.127+0000 7f2635c2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:05.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.127+0000 7f2635c2f800 20 INFO: main: starting shard=8 2024-09-14T10:50:05.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.127+0000 7f2635c2f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:50:05.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.127+0000 7f2635c2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:05.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.127+0000 7f2635c2f800 20 INFO: main: starting shard=9 2024-09-14T10:50:05.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.127+0000 7f2635c2f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.9 2024-09-14T10:50:05.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.128+0000 7f2635c2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:05.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.128+0000 7f2635c2f800 20 INFO: main: starting shard=10 2024-09-14T10:50:05.129 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.128+0000 7f2635c2f800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:50:05.129 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.128+0000 7f2635c2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:05.129 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.128+0000 7f2635c2f800 20 INFO: main: done 2024-09-14T10:50:05.129 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.129+0000 7f24e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:50:05.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.131+0000 7f2635c2f800 20 remove_watcher() i=0 2024-09-14T10:50:05.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.131+0000 7f2635c2f800 2 removed watcher, disabling cache 2024-09-14T10:50:05.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.132+0000 7f2635c2f800 20 remove_watcher() i=1 2024-09-14T10:50:05.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.134+0000 7f2635c2f800 20 remove_watcher() i=2 2024-09-14T10:50:05.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.135+0000 7f2635c2f800 20 remove_watcher() i=3 2024-09-14T10:50:05.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.136+0000 7f2635c2f800 20 remove_watcher() i=4 2024-09-14T10:50:05.135 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.137+0000 7f2635c2f800 20 remove_watcher() i=5 2024-09-14T10:50:05.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.138+0000 7f2635c2f800 20 remove_watcher() i=6 2024-09-14T10:50:05.138 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.139+0000 7f2635c2f800 20 remove_watcher() i=7 2024-09-14T10:50:05.152 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:05.152 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:05.176 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:05.176 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:05.200 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:05.201 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:05.287 INFO:tasks.workunit.client.0.smithi050.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:50:05.288 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T10:50:05.320 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:50:05.320 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:50:05.359 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.361+0000 7f0cd1726800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.363+0000 7f0cd1726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:05.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.363+0000 7f0cd1726800 20 realm 2024-09-14T10:50:05.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.363+0000 7f0cd1726800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.363+0000 7f0cd1726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:05.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.363+0000 7f0cd1726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:50:05.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.363+0000 7f0cd1726800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.363+0000 7f0cd1726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:05.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.363+0000 7f0cd1726800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.364+0000 7f0cd1726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:50:05.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.364+0000 7f0cd1726800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.365+0000 7f0cd1726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:50:05.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.365+0000 7f0cd1726800 20 searching for the correct realm 2024-09-14T10:50:05.366 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.367+0000 7f0cccbd8640 0 -- 172.21.15.50:0/739895542 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f0cc80a9120 msgr2=0x7f0cc80b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:50:05.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.572+0000 7f0ccdbda640 0 -- 172.21.15.50:0/739895542 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x559029fb7810 msgr2=0x559029fb9c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:50:05.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.576+0000 7f0cd1726800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:50:05.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.576+0000 7f0cd1726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:50:05.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.576+0000 7f0cd1726800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:50:05.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.576+0000 7f0cd1726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:50:05.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.576+0000 7f0cd1726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:50:05.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.576+0000 7f0cd1726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:50:05.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.576+0000 7f0cd1726800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.576+0000 7f0cd1726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:05.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.576+0000 7f0cd1726800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.577+0000 7f0cd1726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:50:05.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.577+0000 7f0cd1726800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.577+0000 7f0cd1726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:50:05.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.577+0000 7f0cd1726800 20 zone default found 2024-09-14T10:50:05.581 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.577+0000 7f0cd1726800 4 Realm: () 2024-09-14T10:50:05.581 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.577+0000 7f0cd1726800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:50:05.581 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.577+0000 7f0cd1726800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:50:05.581 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.577+0000 7f0cd1726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:50:05.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.577+0000 7f0cd1726800 20 zonegroup default 2024-09-14T10:50:05.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.577+0000 7f0cd1726800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.577+0000 7f0cd1726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:05.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.577+0000 7f0cd1726800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.578+0000 7f0cd1726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:05.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.578+0000 7f0cd1726800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.578+0000 7f0cd1726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:05.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.578+0000 7f0cd1726800 20 started sync module instance, tier type = 2024-09-14T10:50:05.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.578+0000 7f0cd1726800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:50:05.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.587+0000 7f0cd1726800 20 add_watcher() i=0 2024-09-14T10:50:05.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.587+0000 7f0cd1726800 20 add_watcher() i=1 2024-09-14T10:50:05.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.587+0000 7f0cd1726800 20 add_watcher() i=2 2024-09-14T10:50:05.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.587+0000 7f0cd1726800 20 add_watcher() i=3 2024-09-14T10:50:05.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.587+0000 7f0cd1726800 20 add_watcher() i=4 2024-09-14T10:50:05.587 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.587+0000 7f0cd1726800 20 add_watcher() i=5 2024-09-14T10:50:05.587 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.587+0000 7f0cd1726800 20 add_watcher() i=6 2024-09-14T10:50:05.587 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.588+0000 7f0cd1726800 20 add_watcher() i=7 2024-09-14T10:50:05.587 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.588+0000 7f0cd1726800 2 all 8 watchers are set, enabling cache 2024-09-14T10:50:05.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.590+0000 7f0b837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:50:05.590 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.591+0000 7f0cd1726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:50:05.590 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.591+0000 7f0cd1726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:50:05.590 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.591+0000 7f0cd1726800 5 note: GC not initialized 2024-09-14T10:50:05.591 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.591+0000 7f0b827e4640 20 reqs_thread_entry: start 2024-09-14T10:50:05.591 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.591+0000 7f0cd1726800 20 init_complete bucket index max shards: 11 2024-09-14T10:50:05.591 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.591+0000 7f0cd1726800 20 Filter name: none 2024-09-14T10:50:05.591 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.591+0000 7f0af3fff640 20 reqs_thread_entry: start 2024-09-14T10:50:05.591 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.591+0000 7f0cd1726800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.592 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.592+0000 7f0cd1726800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:50:05.592 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.592+0000 7f0cd1726800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.592+0000 7f0cd1726800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:50:05.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.592+0000 7f0cd1726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:50:05.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.592+0000 7f0cd1726800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:50:05.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.592+0000 7f0cd1726800 20 INFO: main: starting shard=0 2024-09-14T10:50:05.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.592+0000 7f0cd1726800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.0 2024-09-14T10:50:05.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.593+0000 7f0cd1726800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:05.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.593+0000 7f0cd1726800 20 INFO: main: starting shard=1 2024-09-14T10:50:05.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.593+0000 7f0cd1726800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:50:05.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.593+0000 7f0cd1726800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T10:50:05.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.593+0000 7f0cd1726800 20 INFO: main: starting shard=2 2024-09-14T10:50:05.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.593+0000 7f0cd1726800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.2 2024-09-14T10:50:05.594 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.594+0000 7f0cd1726800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:05.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.594+0000 7f0cd1726800 20 INFO: main: starting shard=3 2024-09-14T10:50:05.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.594+0000 7f0cd1726800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.3 2024-09-14T10:50:05.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.594+0000 7f0cd1726800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:05.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.594+0000 7f0cd1726800 20 INFO: main: starting shard=4 2024-09-14T10:50:05.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.594+0000 7f0cd1726800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.4 2024-09-14T10:50:05.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.595+0000 7f0cd1726800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:05.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.595+0000 7f0cd1726800 20 INFO: main: starting shard=5 2024-09-14T10:50:05.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.595+0000 7f0cd1726800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:50:05.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.595+0000 7f0cd1726800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:05.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.595+0000 7f0cd1726800 20 INFO: main: starting shard=6 2024-09-14T10:50:05.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.595+0000 7f0cd1726800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.6 2024-09-14T10:50:05.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.596+0000 7f0cd1726800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:05.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.596+0000 7f0cd1726800 20 INFO: main: starting shard=7 2024-09-14T10:50:05.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.596+0000 7f0cd1726800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.7 2024-09-14T10:50:05.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.596+0000 7f0cd1726800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:05.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.596+0000 7f0cd1726800 20 INFO: main: starting shard=8 2024-09-14T10:50:05.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.596+0000 7f0cd1726800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:50:05.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.597+0000 7f0cd1726800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:05.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.597+0000 7f0cd1726800 20 INFO: main: starting shard=9 2024-09-14T10:50:05.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.597+0000 7f0cd1726800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.9 2024-09-14T10:50:05.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.597+0000 7f0cd1726800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:05.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.597+0000 7f0cd1726800 20 INFO: main: starting shard=10 2024-09-14T10:50:05.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.597+0000 7f0cd1726800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:50:05.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.598+0000 7f0cd1726800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:05.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.598+0000 7f0cd1726800 20 INFO: main: done 2024-09-14T10:50:05.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.599+0000 7f0b837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:50:05.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.601+0000 7f0cd1726800 20 remove_watcher() i=0 2024-09-14T10:50:05.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.601+0000 7f0cd1726800 2 removed watcher, disabling cache 2024-09-14T10:50:05.600 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.602+0000 7f0cd1726800 20 remove_watcher() i=1 2024-09-14T10:50:05.601 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.603+0000 7f0cd1726800 20 remove_watcher() i=2 2024-09-14T10:50:05.602 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.604+0000 7f0cd1726800 20 remove_watcher() i=3 2024-09-14T10:50:05.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.605+0000 7f0cd1726800 20 remove_watcher() i=4 2024-09-14T10:50:05.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.606+0000 7f0cd1726800 20 remove_watcher() i=5 2024-09-14T10:50:05.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.607+0000 7f0cd1726800 20 remove_watcher() i=6 2024-09-14T10:50:05.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.608+0000 7f0cd1726800 20 remove_watcher() i=7 2024-09-14T10:50:05.620 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:05.621 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:05.644 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:05.644 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:05.730 INFO:tasks.workunit.client.0.smithi050.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:50:05.731 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T10:50:05.763 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:50:05.763 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:50:05.803 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.804+0000 7f658f72e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.806+0000 7f658f72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:05.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.806+0000 7f658f72e800 20 realm 2024-09-14T10:50:05.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.806+0000 7f658f72e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.806+0000 7f658f72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:05.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.806+0000 7f658f72e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:50:05.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.806+0000 7f658f72e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.806+0000 7f658f72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:05.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.806+0000 7f658f72e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.807+0000 7f658f72e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:50:05.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.807+0000 7f658f72e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:05.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.808+0000 7f658f72e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:50:05.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.808+0000 7f658f72e800 20 searching for the correct realm 2024-09-14T10:50:05.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:05.811+0000 7f658acdc640 0 -- 172.21.15.50:0/1865859855 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f65840725c0 msgr2=0x7f658409fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:50:06.015 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.016+0000 7f658acdc640 0 -- 172.21.15.50:0/1865859855 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55dab3255ea0 msgr2=0x55dab3258290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:50:06.019 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.020+0000 7f658f72e800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:50:06.019 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.020+0000 7f658f72e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:50:06.019 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.020+0000 7f658f72e800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:50:06.019 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.020+0000 7f658f72e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:50:06.020 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.020+0000 7f658f72e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:50:06.020 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.020+0000 7f658f72e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:50:06.020 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.020+0000 7f658f72e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:06.020 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.021+0000 7f658f72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:06.020 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.021+0000 7f658f72e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:06.021 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.021+0000 7f658f72e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:50:06.021 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.021+0000 7f658f72e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:06.021 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.021+0000 7f658f72e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:50:06.021 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.021+0000 7f658f72e800 20 zone default found 2024-09-14T10:50:06.021 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.021+0000 7f658f72e800 4 Realm: () 2024-09-14T10:50:06.021 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.021+0000 7f658f72e800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:50:06.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.021+0000 7f658f72e800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:50:06.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.021+0000 7f658f72e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:50:06.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.021+0000 7f658f72e800 20 zonegroup default 2024-09-14T10:50:06.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.021+0000 7f658f72e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:06.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.021+0000 7f658f72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:06.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.021+0000 7f658f72e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:06.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.022+0000 7f658f72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:06.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.022+0000 7f658f72e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:06.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.022+0000 7f658f72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:06.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.022+0000 7f658f72e800 20 started sync module instance, tier type = 2024-09-14T10:50:06.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.022+0000 7f658f72e800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:50:06.030 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.031+0000 7f658f72e800 20 add_watcher() i=0 2024-09-14T10:50:06.030 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.031+0000 7f658f72e800 20 add_watcher() i=1 2024-09-14T10:50:06.030 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.031+0000 7f658f72e800 20 add_watcher() i=2 2024-09-14T10:50:06.030 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.031+0000 7f658f72e800 20 add_watcher() i=3 2024-09-14T10:50:06.030 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.031+0000 7f658f72e800 20 add_watcher() i=4 2024-09-14T10:50:06.030 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.031+0000 7f658f72e800 20 add_watcher() i=5 2024-09-14T10:50:06.030 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.031+0000 7f658f72e800 20 add_watcher() i=6 2024-09-14T10:50:06.031 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.032+0000 7f658f72e800 20 add_watcher() i=7 2024-09-14T10:50:06.031 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.032+0000 7f658f72e800 2 all 8 watchers are set, enabling cache 2024-09-14T10:50:06.032 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.034+0000 7f6441fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:50:06.033 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.034+0000 7f658f72e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:50:06.033 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.034+0000 7f658f72e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:50:06.033 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.034+0000 7f658f72e800 5 note: GC not initialized 2024-09-14T10:50:06.033 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.034+0000 7f6440fe1640 20 reqs_thread_entry: start 2024-09-14T10:50:06.034 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.034+0000 7f658f72e800 20 init_complete bucket index max shards: 11 2024-09-14T10:50:06.034 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.034+0000 7f658f72e800 20 Filter name: none 2024-09-14T10:50:06.034 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.035+0000 7f63ba7fc640 20 reqs_thread_entry: start 2024-09-14T10:50:06.034 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.035+0000 7f658f72e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:06.034 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.035+0000 7f658f72e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:50:06.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.035+0000 7f658f72e800 20 rados->read ofs=0 len=0 2024-09-14T10:50:06.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.035+0000 7f658f72e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:50:06.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.035+0000 7f658f72e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:50:06.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.035+0000 7f658f72e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:50:06.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.035+0000 7f658f72e800 20 INFO: main: starting shard=0 2024-09-14T10:50:06.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.035+0000 7f658f72e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.0 2024-09-14T10:50:06.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.036+0000 7f658f72e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:06.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.036+0000 7f658f72e800 20 INFO: main: starting shard=1 2024-09-14T10:50:06.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.036+0000 7f658f72e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:50:06.036 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.036+0000 7f658f72e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:06.036 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.036+0000 7f658f72e800 20 INFO: main: starting shard=2 2024-09-14T10:50:06.036 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.036+0000 7f658f72e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.2 2024-09-14T10:50:06.036 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.037+0000 7f658f72e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:06.036 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.037+0000 7f658f72e800 20 INFO: main: starting shard=3 2024-09-14T10:50:06.036 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.037+0000 7f658f72e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.3 2024-09-14T10:50:06.036 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.037+0000 7f658f72e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:06.037 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.037+0000 7f658f72e800 20 INFO: main: starting shard=4 2024-09-14T10:50:06.037 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.037+0000 7f658f72e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.4 2024-09-14T10:50:06.037 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.038+0000 7f658f72e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:06.037 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.038+0000 7f658f72e800 20 INFO: main: starting shard=5 2024-09-14T10:50:06.037 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.038+0000 7f658f72e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:50:06.038 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.038+0000 7f658f72e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:06.038 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.038+0000 7f658f72e800 20 INFO: main: starting shard=6 2024-09-14T10:50:06.038 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.038+0000 7f658f72e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.6 2024-09-14T10:50:06.038 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.038+0000 7f658f72e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:06.038 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.038+0000 7f658f72e800 20 INFO: main: starting shard=7 2024-09-14T10:50:06.038 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.038+0000 7f658f72e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.7 2024-09-14T10:50:06.038 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.039+0000 7f658f72e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:06.038 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.039+0000 7f658f72e800 20 INFO: main: starting shard=8 2024-09-14T10:50:06.039 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.039+0000 7f658f72e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:50:06.039 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.040+0000 7f658f72e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:06.039 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.040+0000 7f658f72e800 20 INFO: main: starting shard=9 2024-09-14T10:50:06.039 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.040+0000 7f658f72e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.9 2024-09-14T10:50:06.039 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.040+0000 7f658f72e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:50:06.039 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.040+0000 7f658f72e800 20 INFO: main: starting shard=10 2024-09-14T10:50:06.040 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.040+0000 7f658f72e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:50:06.040 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.041+0000 7f658f72e800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T10:50:06.040 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.041+0000 7f658f72e800 20 INFO: main: done 2024-09-14T10:50:06.040 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.042+0000 7f6441fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:50:06.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.044+0000 7f658f72e800 20 remove_watcher() i=0 2024-09-14T10:50:06.043 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.044+0000 7f658f72e800 2 removed watcher, disabling cache 2024-09-14T10:50:06.043 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.045+0000 7f658f72e800 20 remove_watcher() i=1 2024-09-14T10:50:06.044 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.046+0000 7f658f72e800 20 remove_watcher() i=2 2024-09-14T10:50:06.045 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.047+0000 7f658f72e800 20 remove_watcher() i=3 2024-09-14T10:50:06.046 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.048+0000 7f658f72e800 20 remove_watcher() i=4 2024-09-14T10:50:06.048 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.049+0000 7f658f72e800 20 remove_watcher() i=5 2024-09-14T10:50:06.048 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.050+0000 7f658f72e800 20 remove_watcher() i=6 2024-09-14T10:50:06.049 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.051+0000 7f658f72e800 20 remove_watcher() i=7 2024-09-14T10:50:06.064 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:06.064 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:06.088 INFO:tasks.workunit.client.0.smithi050.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T10:50:06.497 INFO:tasks.workunit.client.0.smithi050.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T10:50:06.907 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T10:50:06.937 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:50:06.938 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:50:06.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.978+0000 7f4c5d932800 20 rados->read ofs=0 len=0 2024-09-14T10:50:06.978 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.979+0000 7f4c5d932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:06.978 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.979+0000 7f4c5d932800 20 realm 2024-09-14T10:50:06.978 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.979+0000 7f4c5d932800 20 rados->read ofs=0 len=0 2024-09-14T10:50:06.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.979+0000 7f4c5d932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:06.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.979+0000 7f4c5d932800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:50:06.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.979+0000 7f4c5d932800 20 rados->read ofs=0 len=0 2024-09-14T10:50:06.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.979+0000 7f4c5d932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:06.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.980+0000 7f4c5d932800 20 rados->read ofs=0 len=0 2024-09-14T10:50:06.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.980+0000 7f4c5d932800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:50:06.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.980+0000 7f4c5d932800 20 rados->read ofs=0 len=0 2024-09-14T10:50:06.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.981+0000 7f4c5d932800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:50:06.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.981+0000 7f4c5d932800 20 searching for the correct realm 2024-09-14T10:50:06.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:06.984+0000 7f4c58dbb640 0 -- 172.21.15.50:0/2541897898 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f4c5406e380 msgr2=0x7f4c5408b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:50:07.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.190+0000 7f4c59dbd640 0 -- 172.21.15.50:0/2541897898 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5647e7411e00 msgr2=0x5647e74142a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:50:07.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.194+0000 7f4c5d932800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:50:07.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.194+0000 7f4c5d932800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:50:07.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.194+0000 7f4c5d932800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:50:07.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.194+0000 7f4c5d932800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:50:07.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.194+0000 7f4c5d932800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:50:07.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.194+0000 7f4c5d932800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:50:07.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.194+0000 7f4c5d932800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.194+0000 7f4c5d932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:07.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.194+0000 7f4c5d932800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.194 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.194+0000 7f4c5d932800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:50:07.194 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.194+0000 7f4c5d932800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.195+0000 7f4c5d932800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:50:07.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.195+0000 7f4c5d932800 20 zone default found 2024-09-14T10:50:07.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.195+0000 7f4c5d932800 4 Realm: () 2024-09-14T10:50:07.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.195+0000 7f4c5d932800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:50:07.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.195+0000 7f4c5d932800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:50:07.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.195+0000 7f4c5d932800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:50:07.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.195+0000 7f4c5d932800 20 zonegroup default 2024-09-14T10:50:07.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.195+0000 7f4c5d932800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.195+0000 7f4c5d932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:07.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.195+0000 7f4c5d932800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.195+0000 7f4c5d932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:07.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.195+0000 7f4c5d932800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.195+0000 7f4c5d932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:07.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.195+0000 7f4c5d932800 20 started sync module instance, tier type = 2024-09-14T10:50:07.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.195+0000 7f4c5d932800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:50:07.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.204+0000 7f4c5d932800 20 add_watcher() i=0 2024-09-14T10:50:07.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.204+0000 7f4c5d932800 20 add_watcher() i=1 2024-09-14T10:50:07.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.204+0000 7f4c5d932800 20 add_watcher() i=2 2024-09-14T10:50:07.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.204+0000 7f4c5d932800 20 add_watcher() i=3 2024-09-14T10:50:07.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.204+0000 7f4c5d932800 20 add_watcher() i=4 2024-09-14T10:50:07.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.204+0000 7f4c5d932800 20 add_watcher() i=5 2024-09-14T10:50:07.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.204+0000 7f4c5d932800 20 add_watcher() i=6 2024-09-14T10:50:07.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.205+0000 7f4c5d932800 20 add_watcher() i=7 2024-09-14T10:50:07.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.205+0000 7f4c5d932800 2 all 8 watchers are set, enabling cache 2024-09-14T10:50:07.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.207+0000 7f4b0f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:50:07.206 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.207+0000 7f4c5d932800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:50:07.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.207+0000 7f4c5d932800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:50:07.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.207+0000 7f4c5d932800 5 note: GC not initialized 2024-09-14T10:50:07.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.207+0000 7f4b0e7e4640 20 reqs_thread_entry: start 2024-09-14T10:50:07.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.207+0000 7f4c5d932800 20 init_complete bucket index max shards: 11 2024-09-14T10:50:07.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.207+0000 7f4c5d932800 20 Filter name: none 2024-09-14T10:50:07.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.207+0000 7f4a7ffff640 20 reqs_thread_entry: start 2024-09-14T10:50:07.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.208+0000 7f4c5d932800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:50:07.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.208+0000 7f4c5d932800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.208 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.208+0000 7f4c5d932800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:50:07.208 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.208+0000 7f4c5d932800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:50:07.208 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.208+0000 7f4c5d932800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:50:07.208 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.208+0000 7f4c5d932800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 : miss 2024-09-14T10:50:07.208 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.208+0000 7f4c5d932800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.208+0000 7f4c5d932800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:50:07.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.208+0000 7f4c5d932800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 info.flags=0x17 2024-09-14T10:50:07.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.208+0000 7f4c5d932800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 to cache LRU end 2024-09-14T10:50:07.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.208+0000 7f4c5d932800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:50:07.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.208+0000 7f4c5d932800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:50:07.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.208+0000 7f4c5d932800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 2024-09-14T10:50:07.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.209+0000 7f4c5d932800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.0 2024-09-14T10:50:07.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.209+0000 7f4c5d932800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:50:07.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.210+0000 7f4c5d932800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.2 2024-09-14T10:50:07.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.210+0000 7f4c5d932800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.3 2024-09-14T10:50:07.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.211+0000 7f4c5d932800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.4 2024-09-14T10:50:07.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.211+0000 7f4c5d932800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:50:07.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.212+0000 7f4c5d932800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.6 2024-09-14T10:50:07.211 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.212+0000 7f4c5d932800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.7 2024-09-14T10:50:07.211 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.213+0000 7f4c5d932800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:50:07.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.213+0000 7f4c5d932800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.9 2024-09-14T10:50:07.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.214+0000 7f4c5d932800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:50:07.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.220+0000 7f4b0f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:50:07.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.222+0000 7f4c5d932800 20 remove_watcher() i=0 2024-09-14T10:50:07.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.222+0000 7f4c5d932800 2 removed watcher, disabling cache 2024-09-14T10:50:07.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.223+0000 7f4c5d932800 20 remove_watcher() i=1 2024-09-14T10:50:07.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.224+0000 7f4c5d932800 20 remove_watcher() i=2 2024-09-14T10:50:07.224 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.225+0000 7f4c5d932800 20 remove_watcher() i=3 2024-09-14T10:50:07.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.226+0000 7f4c5d932800 20 remove_watcher() i=4 2024-09-14T10:50:07.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.227+0000 7f4c5d932800 20 remove_watcher() i=5 2024-09-14T10:50:07.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.228+0000 7f4c5d932800 20 remove_watcher() i=6 2024-09-14T10:50:07.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.229+0000 7f4c5d932800 20 remove_watcher() i=7 2024-09-14T10:50:07.240 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T10:50:07.276 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:50:07.276 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:50:07.316 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.317+0000 7fdeeb6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.319+0000 7fdeeb6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:07.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.319+0000 7fdeeb6bb800 20 realm 2024-09-14T10:50:07.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.319+0000 7fdeeb6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.319+0000 7fdeeb6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:07.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.319+0000 7fdeeb6bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:50:07.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.319+0000 7fdeeb6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.320+0000 7fdeeb6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:07.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.320+0000 7fdeeb6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.320+0000 7fdeeb6bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:50:07.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.320+0000 7fdeeb6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.321+0000 7fdeeb6bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:50:07.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.321+0000 7fdeeb6bb800 20 searching for the correct realm 2024-09-14T10:50:07.323 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.324+0000 7fdee89a4640 0 -- 172.21.15.50:0/1720115055 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fdee400e040 msgr2=0x7fdee4067a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:50:07.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.327+0000 7fdee89a4640 0 -- 172.21.15.50:0/1720115055 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55b56f22a540 msgr2=0x55b56f22c970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:50:07.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.331+0000 7fdeeb6bb800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:50:07.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.331+0000 7fdeeb6bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:50:07.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.331+0000 7fdeeb6bb800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:50:07.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.331+0000 7fdeeb6bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:50:07.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.331+0000 7fdeeb6bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:50:07.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.331+0000 7fdeeb6bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:50:07.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.331+0000 7fdeeb6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.331+0000 7fdeeb6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:07.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.331+0000 7fdeeb6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.331+0000 7fdeeb6bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:50:07.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.331+0000 7fdeeb6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.331+0000 7fdeeb6bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:50:07.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.331+0000 7fdeeb6bb800 20 zone default found 2024-09-14T10:50:07.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.331+0000 7fdeeb6bb800 4 Realm: () 2024-09-14T10:50:07.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.331+0000 7fdeeb6bb800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:50:07.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.331+0000 7fdeeb6bb800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:50:07.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.331+0000 7fdeeb6bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:50:07.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.331+0000 7fdeeb6bb800 20 zonegroup default 2024-09-14T10:50:07.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.331+0000 7fdeeb6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.332+0000 7fdeeb6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:07.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.332+0000 7fdeeb6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.332+0000 7fdeeb6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:07.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.332+0000 7fdeeb6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.332+0000 7fdeeb6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:07.333 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.332+0000 7fdeeb6bb800 20 started sync module instance, tier type = 2024-09-14T10:50:07.333 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.332+0000 7fdeeb6bb800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:50:07.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.341+0000 7fdeeb6bb800 20 add_watcher() i=0 2024-09-14T10:50:07.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.341+0000 7fdeeb6bb800 20 add_watcher() i=1 2024-09-14T10:50:07.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.341+0000 7fdeeb6bb800 20 add_watcher() i=2 2024-09-14T10:50:07.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.341+0000 7fdeeb6bb800 20 add_watcher() i=3 2024-09-14T10:50:07.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.341+0000 7fdeeb6bb800 20 add_watcher() i=4 2024-09-14T10:50:07.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.341+0000 7fdeeb6bb800 20 add_watcher() i=5 2024-09-14T10:50:07.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.341+0000 7fdeeb6bb800 20 add_watcher() i=6 2024-09-14T10:50:07.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.342+0000 7fdeeb6bb800 20 add_watcher() i=7 2024-09-14T10:50:07.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.342+0000 7fdeeb6bb800 2 all 8 watchers are set, enabling cache 2024-09-14T10:50:07.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.344+0000 7fdd9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:50:07.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.344+0000 7fdeeb6bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:50:07.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.344+0000 7fdeeb6bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:50:07.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.344+0000 7fdeeb6bb800 5 note: GC not initialized 2024-09-14T10:50:07.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.345+0000 7fdd9e7e4640 20 reqs_thread_entry: start 2024-09-14T10:50:07.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.345+0000 7fdeeb6bb800 20 init_complete bucket index max shards: 11 2024-09-14T10:50:07.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.345+0000 7fdeeb6bb800 20 Filter name: none 2024-09-14T10:50:07.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.345+0000 7fdd0ffff640 20 reqs_thread_entry: start 2024-09-14T10:50:07.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.345+0000 7fdeeb6bb800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:50:07.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.345+0000 7fdeeb6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.346+0000 7fdeeb6bb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:50:07.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.346+0000 7fdeeb6bb800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:50:07.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.346+0000 7fdeeb6bb800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:50:07.346 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.346+0000 7fdeeb6bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 : miss 2024-09-14T10:50:07.346 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.346+0000 7fdeeb6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.346 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.346+0000 7fdeeb6bb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:50:07.346 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.346+0000 7fdeeb6bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 info.flags=0x17 2024-09-14T10:50:07.346 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.346+0000 7fdeeb6bb800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 to cache LRU end 2024-09-14T10:50:07.346 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.346+0000 7fdeeb6bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:50:07.346 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.346+0000 7fdeeb6bb800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:50:07.346 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.346+0000 7fdeeb6bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2 2024-09-14T10:50:07.346 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.346+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.0 2024-09-14T10:50:07.346 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.347+0000 7fdeeb6bb800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T10:50:07.346 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.347+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:50:07.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.347+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.2 2024-09-14T10:50:07.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.347+0000 7fdeeb6bb800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T10:50:07.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.347+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.3 2024-09-14T10:50:07.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.348+0000 7fdeeb6bb800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T10:50:07.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.348+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.4 2024-09-14T10:50:07.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.349+0000 7fdeeb6bb800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T10:50:07.348 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.349+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:50:07.348 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.349+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.6 2024-09-14T10:50:07.348 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.350+0000 7fdeeb6bb800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T10:50:07.348 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.350+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.7 2024-09-14T10:50:07.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.350+0000 7fdeeb6bb800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T10:50:07.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.350+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:50:07.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.351+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.9 2024-09-14T10:50:07.350 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.351+0000 7fdeeb6bb800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T10:50:07.350 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.351+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:50:07.350 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.352+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:50:07.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.352+0000 7fdeeb6bb800 20 get_obj_state: octx=0x55b56ef9f300 obj=check-bucket:e state=0x55b56f264e68 s->prefetch_data=0 2024-09-14T10:50:07.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.352+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:50:07.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.352+0000 7fdeeb6bb800 20 get_obj_state: octx=0x55b56efc7c10 obj=check-bucket:d state=0x55b56f26e318 s->prefetch_data=0 2024-09-14T10:50:07.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.352+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:50:07.352 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.353+0000 7fdeeb6bb800 20 get_obj_state: octx=0x55b56f267870 obj=check-bucket:c state=0x55b56f304b78 s->prefetch_data=0 2024-09-14T10:50:07.352 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.353+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:50:07.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.353+0000 7fdeeb6bb800 20 get_obj_state: octx=0x55b56f265bc0 obj=check-bucket:f state=0x55b56f26a478 s->prefetch_data=0 2024-09-14T10:50:07.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.353+0000 7fdeeb6bb800 20 get_obj_state: setting s->obj_tag to pcugws4ho40w1mp2hqmuxwcihfq8mwzq 2024-09-14T10:50:07.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.353+0000 7fdeeb6bb800 20 get_obj_state_impl: setting s->olh_tag to zsqx4htlxwom0040xev5r18odvtt004r 2024-09-14T10:50:07.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.353+0000 7fdeeb6bb800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zsqx4htlxwom0040xev5r18odvtt004r 2024-09-14T10:50:07.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.353+0000 7fdeeb6bb800 20 get_obj_state: setting s->obj_tag to 2lm2r15w6i6jzjyo24fr2mvkvfurwv7j 2024-09-14T10:50:07.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.353+0000 7fdeeb6bb800 20 get_obj_state_impl: setting s->olh_tag to fzsqrwokh2j1d3ezquggizeyr5w16v79 2024-09-14T10:50:07.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.353+0000 7fdeeb6bb800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fzsqrwokh2j1d3ezquggizeyr5w16v79 2024-09-14T10:50:07.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.353+0000 7fdeeb6bb800 20 get_obj_state: setting s->obj_tag to 3tdwy02wevhxxolc0b0mztyaseigopg5 2024-09-14T10:50:07.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.353+0000 7fdeeb6bb800 20 get_obj_state_impl: setting s->olh_tag to c4q9rhp3mdkybrr19q0anqpaf5rn0tsh 2024-09-14T10:50:07.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.353+0000 7fdeeb6bb800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=c4q9rhp3mdkybrr19q0anqpaf5rn0tsh 2024-09-14T10:50:07.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.353+0000 7fdeeb6bb800 20 get_obj_state: setting s->obj_tag to tbwkpwwbmo83qhd06j0vtl7ucboihnkk 2024-09-14T10:50:07.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.353+0000 7fdeeb6bb800 20 get_obj_state_impl: setting s->olh_tag to syef19ls2k8h177yh9a7rdxmwnfjw8rh 2024-09-14T10:50:07.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.353+0000 7fdeeb6bb800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=syef19ls2k8h177yh9a7rdxmwnfjw8rh 2024-09-14T10:50:07.360 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.355+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:50:07.360 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.355+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:50:07.360 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.355+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:50:07.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.356+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:50:07.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.357+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:50:07.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.357+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:50:07.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.357+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:50:07.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.357+0000 7fdeeb6bb800 20 olh_log_entry: epoch=3 op=3 key=d[ZNme3b4X151iyTRoip1yBkKL2hHAA3X] 2024-09-14T10:50:07.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.357+0000 7fdeeb6bb800 20 get_obj_state: octx=0x55b56efc7c10 obj=check-bucket:_:ZNme3b4X151iyTRoip1yBkKL2hHAA3X_d state=0x55b56f319cf8 s->prefetch_data=0 2024-09-14T10:50:07.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.357+0000 7fdeeb6bb800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T10:50:07.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.357+0000 7fdeeb6bb800 20 olh_log_entry: epoch=2 op=3 key=e[bqyax3Dp-USrWAAAKu7uRFcY0un0TwW] 2024-09-14T10:50:07.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.357+0000 7fdeeb6bb800 20 get_obj_state: octx=0x55b56ef9f300 obj=check-bucket:_:bqyax3Dp-USrWAAAKu7uRFcY0un0TwW_e state=0x55b56f31b108 s->prefetch_data=0 2024-09-14T10:50:07.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.358+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:50:07.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.358+0000 7fdeeb6bb800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T10:50:07.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.358+0000 7fdeeb6bb800 20 olh_log_entry: epoch=2 op=3 key=f[--iJ0-n3Wqh4WHlwy8YgdNTEd-KJgUY] 2024-09-14T10:50:07.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.358+0000 7fdeeb6bb800 20 get_obj_state: octx=0x55b56f265bc0 obj=check-bucket:_:--iJ0-n3Wqh4WHlwy8YgdNTEd-KJgUY_f state=0x55b56f329238 s->prefetch_data=0 2024-09-14T10:50:07.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.358+0000 7fdeeb6bb800 10 manifest: total_size = 22 2024-09-14T10:50:07.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.358+0000 7fdeeb6bb800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9029780783073842328 2024-09-14T10:50:07.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.358+0000 7fdeeb6bb800 20 get_obj_state: octx=0x55b56efc7c10 obj=check-bucket:_:ZNme3b4X151iyTRoip1yBkKL2hHAA3X_d state=0x55b56f319cf8 s->prefetch_data=0 2024-09-14T10:50:07.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.358+0000 7fdeeb6bb800 20 prepare_atomic_modification: state is not atomic. state=0x55b56f319cf8 2024-09-14T10:50:07.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.358+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:50:07.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.358+0000 7fdeeb6bb800 20 olh_log_entry: epoch=3 op=3 key=c[wBaPgS3AjuzBz1Z6pa9JGByka4aTnmM] 2024-09-14T10:50:07.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.358+0000 7fdeeb6bb800 20 get_obj_state: octx=0x55b56f267870 obj=check-bucket:_:wBaPgS3AjuzBz1Z6pa9JGByka4aTnmM_c state=0x55b56f332a88 s->prefetch_data=0 2024-09-14T10:50:07.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.358+0000 7fdeeb6bb800 10 manifest: total_size = 22 2024-09-14T10:50:07.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.358+0000 7fdeeb6bb800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17874278845589763912 2024-09-14T10:50:07.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.358+0000 7fdeeb6bb800 20 get_obj_state: octx=0x55b56ef9f300 obj=check-bucket:_:bqyax3Dp-USrWAAAKu7uRFcY0un0TwW_e state=0x55b56f31b108 s->prefetch_data=0 2024-09-14T10:50:07.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.358+0000 7fdeeb6bb800 20 prepare_atomic_modification: state is not atomic. state=0x55b56f31b108 2024-09-14T10:50:07.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.358+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:50:07.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.358+0000 7fdeeb6bb800 10 manifest: total_size = 22 2024-09-14T10:50:07.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.358+0000 7fdeeb6bb800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6872233328529853011 2024-09-14T10:50:07.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.358+0000 7fdeeb6bb800 20 get_obj_state: octx=0x55b56f265bc0 obj=check-bucket:_:--iJ0-n3Wqh4WHlwy8YgdNTEd-KJgUY_f state=0x55b56f329238 s->prefetch_data=0 2024-09-14T10:50:07.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.358+0000 7fdeeb6bb800 20 prepare_atomic_modification: state is not atomic. state=0x55b56f329238 2024-09-14T10:50:07.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.358+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:50:07.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.359+0000 7fdeeb6bb800 10 manifest: total_size = 11 2024-09-14T10:50:07.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.359+0000 7fdeeb6bb800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1070537950290470099 2024-09-14T10:50:07.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.359+0000 7fdeeb6bb800 20 get_obj_state: octx=0x55b56f267870 obj=check-bucket:_:wBaPgS3AjuzBz1Z6pa9JGByka4aTnmM_c state=0x55b56f332a88 s->prefetch_data=0 2024-09-14T10:50:07.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.359+0000 7fdeeb6bb800 20 prepare_atomic_modification: state is not atomic. state=0x55b56f332a88 2024-09-14T10:50:07.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.359+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:50:07.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.361+0000 7fdeeb6bb800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:50:07.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.361+0000 7fdeeb6bb800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T10:50:07.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.361+0000 7fdeeb6bb800 0 deleting objects inline since gc isn't initialized 2024-09-14T10:50:07.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.361+0000 7fdeeb6bb800 5 delete_objs_inline: removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2__shadow:ZNme3b4X151iyTRoip1yBkKL2hHAA3X_.v2mwS_bvijnRiDLpTWVs8JTXyf_sE_I_0 2024-09-14T10:50:07.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.361+0000 7fdeeb6bb800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:50:07.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.361+0000 7fdeeb6bb800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T10:50:07.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.361+0000 7fdeeb6bb800 0 deleting objects inline since gc isn't initialized 2024-09-14T10:50:07.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.361+0000 7fdeeb6bb800 5 delete_objs_inline: removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2__shadow:bqyax3Dp-USrWAAAKu7uRFcY0un0TwW_.CcaRILcfMxYoqiMO48giGJlJiq0dmjl_0 2024-09-14T10:50:07.366 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.362+0000 7fdeeb6bb800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:50:07.366 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.362+0000 7fdeeb6bb800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T10:50:07.366 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.362+0000 7fdeeb6bb800 0 deleting objects inline since gc isn't initialized 2024-09-14T10:50:07.366 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.362+0000 7fdeeb6bb800 5 delete_objs_inline: removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2__shadow:--iJ0-n3Wqh4WHlwy8YgdNTEd-KJgUY_.lhxEP8fN6FfskFLdKUvZittW_jb45PX_0 2024-09-14T10:50:07.366 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.363+0000 7fdeeb6bb800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:50:07.366 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.363+0000 7fdeeb6bb800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-14T10:50:07.366 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.363+0000 7fdeeb6bb800 0 deleting objects inline since gc isn't initialized 2024-09-14T10:50:07.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.363+0000 7fdeeb6bb800 5 delete_objs_inline: removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2__shadow:wBaPgS3AjuzBz1Z6pa9JGByka4aTnmM_.HjFuaWM9676B_VccIE8PXM5RN66qs9F_0 2024-09-14T10:50:07.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.363+0000 7fddccff9640 20 handle_completion(): completion ok for obj=e[bqyax3Dp-USrWAAAKu7uRFcY0un0TwW] 2024-09-14T10:50:07.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.363+0000 7fdeeb6bb800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:50:07.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.364+0000 7fdeeb6bb800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:50:07.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.364+0000 7fddbbfff640 20 handle_completion(): completion ok for obj=d[ZNme3b4X151iyTRoip1yBkKL2hHAA3X] 2024-09-14T10:50:07.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.364+0000 7fddbbfff640 20 handle_completion(): completion ok for obj=f[--iJ0-n3Wqh4WHlwy8YgdNTEd-KJgUY] 2024-09-14T10:50:07.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.364+0000 7fddccff9640 20 handle_completion(): completion ok for obj=c[wBaPgS3AjuzBz1Z6pa9JGByka4aTnmM] 2024-09-14T10:50:07.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.365+0000 7fdeeb6bb800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:50:07.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.365+0000 7fdeeb6bb800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:50:07.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.366+0000 7fdeeb6bb800 20 get_obj_state: octx=0x55b56ef9f300 obj=check-bucket:e state=0x55b56f264e68 s->prefetch_data=0 2024-09-14T10:50:07.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.366+0000 7fdeeb6bb800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zsqx4htlxwom0040xev5r18odvtt004r 2024-09-14T10:50:07.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.366+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:50:07.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.366+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:50:07.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.366+0000 7fdeeb6bb800 20 get_obj_state: octx=0x55b56f265bc0 obj=check-bucket:f state=0x55b56f26a478 s->prefetch_data=0 2024-09-14T10:50:07.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.366+0000 7fdeeb6bb800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=syef19ls2k8h177yh9a7rdxmwnfjw8rh 2024-09-14T10:50:07.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.366+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:50:07.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.366+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:50:07.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.368+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.5 2024-09-14T10:50:07.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.368+0000 7fdeeb6bb800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T10:50:07.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.368+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.8 2024-09-14T10:50:07.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.368+0000 7fdeeb6bb800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T10:50:07.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.370+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:50:07.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.370+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:50:07.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.371+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.1 2024-09-14T10:50:07.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.371+0000 7fdeeb6bb800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-14T10:50:07.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.371+0000 7fdeeb6bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2.10 2024-09-14T10:50:07.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.372+0000 7fdeeb6bb800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-14T10:50:07.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.372+0000 7fdeeb6bb800 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T10:50:07.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.372+0000 7fdd9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:50:07.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.375+0000 7fdeeb6bb800 20 remove_watcher() i=0 2024-09-14T10:50:07.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.375+0000 7fdeeb6bb800 2 removed watcher, disabling cache 2024-09-14T10:50:07.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.375+0000 7fdeeb6bb800 20 remove_watcher() i=1 2024-09-14T10:50:07.375 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.377+0000 7fdeeb6bb800 20 remove_watcher() i=2 2024-09-14T10:50:07.376 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.377+0000 7fdeeb6bb800 20 remove_watcher() i=3 2024-09-14T10:50:07.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.378+0000 7fdeeb6bb800 20 remove_watcher() i=4 2024-09-14T10:50:07.378 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.379+0000 7fdeeb6bb800 20 remove_watcher() i=5 2024-09-14T10:50:07.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.380+0000 7fdeeb6bb800 20 remove_watcher() i=6 2024-09-14T10:50:07.380 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.381+0000 7fdeeb6bb800 20 remove_watcher() i=7 2024-09-14T10:50:07.394 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:07.394 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:07.432 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:07.432 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:07.618 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T10:50:07.648 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:50:07.648 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:50:07.687 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.688+0000 7f163660d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.689 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.690+0000 7f163660d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:07.689 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.690+0000 7f163660d800 20 realm 2024-09-14T10:50:07.689 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.690+0000 7f163660d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.689 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.690+0000 7f163660d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:07.690 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.690+0000 7f163660d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:50:07.690 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.690+0000 7f163660d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.690 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.690+0000 7f163660d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:07.690 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.690+0000 7f163660d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.690 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.691+0000 7f163660d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:50:07.690 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.691+0000 7f163660d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:07.691 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.692+0000 7f163660d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:50:07.691 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.692+0000 7f163660d800 20 searching for the correct realm 2024-09-14T10:50:07.894 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:07.895+0000 7f16338f6640 0 -- 172.21.15.50:0/2883628031 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f162c0bb980 msgr2=0x7f162c0b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:50:08.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.301+0000 7f16338f6640 0 -- 172.21.15.50:0/2883628031 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55663cb900f0 msgr2=0x55663cb925b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:50:08.305 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.306+0000 7f163660d800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:50:08.305 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.306+0000 7f163660d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:50:08.305 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.306+0000 7f163660d800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:50:08.305 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.306+0000 7f163660d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:50:08.305 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.306+0000 7f163660d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:50:08.305 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.306+0000 7f163660d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:50:08.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.306+0000 7f163660d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:08.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.307+0000 7f163660d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:08.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.307+0000 7f163660d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:08.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.307+0000 7f163660d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:50:08.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.307+0000 7f163660d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:08.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.308+0000 7f163660d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:50:08.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.308+0000 7f163660d800 20 zone default found 2024-09-14T10:50:08.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.308+0000 7f163660d800 4 Realm: () 2024-09-14T10:50:08.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.308+0000 7f163660d800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:50:08.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.308+0000 7f163660d800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:50:08.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.308+0000 7f163660d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:50:08.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.308+0000 7f163660d800 20 zonegroup default 2024-09-14T10:50:08.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.308+0000 7f163660d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:08.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.308+0000 7f163660d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:08.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.308+0000 7f163660d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:08.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.308+0000 7f163660d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:08.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.308+0000 7f163660d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:08.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.309+0000 7f163660d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:50:08.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.309+0000 7f163660d800 20 started sync module instance, tier type = 2024-09-14T10:50:08.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.309+0000 7f163660d800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:50:08.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.320+0000 7f163660d800 20 add_watcher() i=0 2024-09-14T10:50:08.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.320+0000 7f163660d800 20 add_watcher() i=1 2024-09-14T10:50:08.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.320+0000 7f163660d800 20 add_watcher() i=2 2024-09-14T10:50:08.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.320+0000 7f163660d800 20 add_watcher() i=3 2024-09-14T10:50:08.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.320+0000 7f163660d800 20 add_watcher() i=4 2024-09-14T10:50:08.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.320+0000 7f163660d800 20 add_watcher() i=5 2024-09-14T10:50:08.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.320+0000 7f163660d800 20 add_watcher() i=6 2024-09-14T10:50:08.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.321+0000 7f163660d800 20 add_watcher() i=7 2024-09-14T10:50:08.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.321+0000 7f163660d800 2 all 8 watchers are set, enabling cache 2024-09-14T10:50:08.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.323+0000 7f14eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:50:08.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.323+0000 7f163660d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:50:08.323 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.323+0000 7f163660d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:50:08.323 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.323+0000 7f163660d800 5 note: GC not initialized 2024-09-14T10:50:08.323 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.324+0000 7f14e9fdb640 20 reqs_thread_entry: start 2024-09-14T10:50:08.323 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.324+0000 7f163660d800 20 init_complete bucket index max shards: 11 2024-09-14T10:50:08.323 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.324+0000 7f163660d800 20 Filter name: none 2024-09-14T10:50:08.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.324+0000 7f145b7fe640 20 reqs_thread_entry: start 2024-09-14T10:50:08.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.324+0000 7f163660d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:08.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.324+0000 7f163660d800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:50:08.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.325+0000 7f163660d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:08.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.325+0000 7f163660d800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:50:08.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.325+0000 7f163660d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:50:08.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.325+0000 7f163660d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:08.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.325+0000 7f163660d800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:50:08.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.325+0000 7f163660d800 20 rados->read ofs=0 len=0 2024-09-14T10:50:08.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.326+0000 7f163660d800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:50:08.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.326+0000 7f163660d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:50:08.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.328+0000 7f14eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:50:08.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.331+0000 7f163660d800 20 remove_watcher() i=0 2024-09-14T10:50:08.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.331+0000 7f163660d800 2 removed watcher, disabling cache 2024-09-14T10:50:08.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.332+0000 7f163660d800 20 remove_watcher() i=1 2024-09-14T10:50:08.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.333+0000 7f163660d800 20 remove_watcher() i=2 2024-09-14T10:50:08.333 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.334+0000 7f163660d800 20 remove_watcher() i=3 2024-09-14T10:50:08.334 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.335+0000 7f163660d800 20 remove_watcher() i=4 2024-09-14T10:50:08.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.337+0000 7f163660d800 20 remove_watcher() i=5 2024-09-14T10:50:08.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.338+0000 7f163660d800 20 remove_watcher() i=6 2024-09-14T10:50:08.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:50:08.339+0000 7f163660d800 20 remove_watcher() i=7 2024-09-14T10:50:08.350 INFO:tasks.workunit.client.0.smithi050.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T10:50:08.350 INFO:tasks.workunit.client.0.smithi050.stderr:Deleting bucket check-bucket 2024-09-14T10:50:08.352 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:08.352 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:08.387 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:50:08.388 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T10:50:08.594 INFO:tasks.workunit.client.0.smithi050.stderr:Completed bucket check tests 2024-09-14T10:50:08.594 INFO:tasks.workunit.client.0.smithi050.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-14T10:50:08.594 INFO:tasks.workunit.client.0.smithi050.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-14T10:50:08.594 INFO:tasks.workunit.client.0.smithi050.stdout:connected to https://localhost:443 2024-09-14T10:50:08.659 INFO:tasks.workunit.client.0.smithi050.stderr:+ deactivate 2024-09-14T10:50:08.659 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T10:50:08.659 INFO:tasks.workunit.client.0.smithi050.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T10:50:08.659 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2024-09-14T10:50:08.659 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T10:50:08.659 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -n '' ']' 2024-09-14T10:50:08.660 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T10:50:08.660 INFO:tasks.workunit.client.0.smithi050.stderr:+ hash -r 2024-09-14T10:50:08.660 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -n '' ']' 2024-09-14T10:50:08.660 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset VIRTUAL_ENV 2024-09-14T10:50:08.660 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T10:50:08.660 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset -f deactivate 2024-09-14T10:50:08.660 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo OK. 2024-09-14T10:50:08.661 INFO:tasks.workunit.client.0.smithi050.stdout:OK. 2024-09-14T10:50:08.661 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:50:08.661 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:50:08.716 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-14T10:50:08.716 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T10:50:09.077 DEBUG:teuthology.parallel:result is None 2024-09-14T10:50:09.078 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T10:50:09.118 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T10:50:09.118 DEBUG:teuthology.orchestra.run.smithi050:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:50:09.187 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T10:50:09.187 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T10:50:09.202 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:50:09.202 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T10:50:09.202 DEBUG:teuthology.orchestra.run.smithi050:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:50:09.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:50:09.258 INFO:teuthology.orchestra.run.smithi050.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T10:50:09.258 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:50:09.328 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T10:50:09.329 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T10:50:09.398 INFO:tasks.workunit:timeout=3h 2024-09-14T10:50:09.399 INFO:tasks.workunit:cleanup=True 2024-09-14T10:50:09.399 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:50:09.469 INFO:tasks.workunit.client.0.smithi050.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T10:51:06.959 INFO:tasks.workunit.client.0.smithi050.stderr:Updating files: 94% (12184/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T10:51:07.643 INFO:tasks.workunit.client.0.smithi050.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T10:51:07.644 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:51:07.644 INFO:tasks.workunit.client.0.smithi050.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T10:51:07.644 INFO:tasks.workunit.client.0.smithi050.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T10:51:07.644 INFO:tasks.workunit.client.0.smithi050.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T10:51:07.644 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:51:07.644 INFO:tasks.workunit.client.0.smithi050.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T10:51:07.644 INFO:tasks.workunit.client.0.smithi050.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T10:51:07.644 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:51:07.644 INFO:tasks.workunit.client.0.smithi050.stderr: git switch -c 2024-09-14T10:51:07.644 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:51:07.644 INFO:tasks.workunit.client.0.smithi050.stderr:Or undo this operation with: 2024-09-14T10:51:07.644 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:51:07.645 INFO:tasks.workunit.client.0.smithi050.stderr: git switch - 2024-09-14T10:51:07.645 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:51:07.645 INFO:tasks.workunit.client.0.smithi050.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T10:51:07.645 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T10:51:07.645 INFO:tasks.workunit.client.0.smithi050.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T10:51:07.646 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T10:51:07.716 INFO:tasks.workunit.client.0.smithi050.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T10:51:07.719 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T10:51:07.719 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T10:51:07.768 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T10:51:07.820 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T10:51:07.861 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T10:51:07.862 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T10:51:07.863 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T10:51:07.902 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T10:51:07.906 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T10:51:07.906 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T10:51:07.976 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-14T10:51:07.977 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-14T10:51:07.977 DEBUG:teuthology.orchestra.run.smithi050:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-14T10:51:08.061 INFO:tasks.workunit.client.0.smithi050.stdout:Running main() from gmock_main.cc 2024-09-14T10:51:08.061 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T10:51:08.061 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment set-up. 2024-09-14T10:51:08.061 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 11 tests from ClsLock 2024-09-14T10:51:08.061 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-14T10:51:09.909 INFO:tasks.workunit.client.0.smithi050.stdout:lock: mylock 2024-09-14T10:51:09.909 INFO:tasks.workunit.client.0.smithi050.stdout: lock_type: exclusive 2024-09-14T10:51:09.909 INFO:tasks.workunit.client.0.smithi050.stdout: tag: 2024-09-14T10:51:09.909 INFO:tasks.workunit.client.0.smithi050.stdout: lockers: 2024-09-14T10:51:09.910 INFO:tasks.workunit.client.0.smithi050.stdout: client.5021 expiration=2024-09-14T10:53:09.907697+0000 addr=v1:172.21.15.50:0/3401402837 cookie= 2024-09-14T10:51:09.913 INFO:tasks.workunit.client.0.smithi050.stdout:lock: mylock 2024-09-14T10:51:09.913 INFO:tasks.workunit.client.0.smithi050.stdout: lock_type: shared 2024-09-14T10:51:09.913 INFO:tasks.workunit.client.0.smithi050.stdout: tag: 2024-09-14T10:51:09.913 INFO:tasks.workunit.client.0.smithi050.stdout: lockers: 2024-09-14T10:51:09.914 INFO:tasks.workunit.client.0.smithi050.stdout: client.5021 expiration=2024-09-14T10:53:09.914818+0000 addr=v1:172.21.15.50:0/3401402837 cookie= 2024-09-14T10:51:09.914 INFO:tasks.workunit.client.0.smithi050.stdout: client.5024 expiration=0.000000 addr=v1:172.21.15.50:0/511327191 cookie= 2024-09-14T10:51:09.914 INFO:tasks.workunit.client.0.smithi050.stdout:lock: mylock 2024-09-14T10:51:09.914 INFO:tasks.workunit.client.0.smithi050.stdout: lock_type: shared 2024-09-14T10:51:09.915 INFO:tasks.workunit.client.0.smithi050.stdout: tag: 2024-09-14T10:51:09.915 INFO:tasks.workunit.client.0.smithi050.stdout: lockers: 2024-09-14T10:51:09.915 INFO:tasks.workunit.client.0.smithi050.stdout: client.5024 expiration=0.000000 addr=v1:172.21.15.50:0/511327191 cookie= 2024-09-14T10:51:10.888 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] ClsLock.TestMultiLocking (2828 ms) 2024-09-14T10:51:10.889 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] ClsLock.TestMeta 2024-09-14T10:51:13.341 INFO:tasks.workunit.client.0.smithi050.stdout:lock: mylock 2024-09-14T10:51:13.341 INFO:tasks.workunit.client.0.smithi050.stdout: lock_type: shared 2024-09-14T10:51:13.341 INFO:tasks.workunit.client.0.smithi050.stdout: tag: 2024-09-14T10:51:13.341 INFO:tasks.workunit.client.0.smithi050.stdout: lockers: 2024-09-14T10:51:13.341 INFO:tasks.workunit.client.0.smithi050.stdout: client.5036 expiration=0.000000 addr=v1:172.21.15.50:0/4017566558 cookie= 2024-09-14T10:51:13.344 INFO:tasks.workunit.client.0.smithi050.stdout:lock: mylock 2024-09-14T10:51:13.344 INFO:tasks.workunit.client.0.smithi050.stdout: lock_type: exclusive 2024-09-14T10:51:13.344 INFO:tasks.workunit.client.0.smithi050.stdout: tag: new_tag 2024-09-14T10:51:13.344 INFO:tasks.workunit.client.0.smithi050.stdout: lockers: 2024-09-14T10:51:13.344 INFO:tasks.workunit.client.0.smithi050.stdout: client.5226 expiration=0.000000 addr=v1:172.21.15.50:0/128189539 cookie= 2024-09-14T10:51:13.902 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] ClsLock.TestMeta (3013 ms) 2024-09-14T10:51:13.902 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] ClsLock.TestCookie 2024-09-14T10:51:15.922 INFO:tasks.workunit.client.0.smithi050.stdout:lock: mylock 2024-09-14T10:51:15.922 INFO:tasks.workunit.client.0.smithi050.stdout: lock_type: exclusive 2024-09-14T10:51:15.922 INFO:tasks.workunit.client.0.smithi050.stdout: tag: 2024-09-14T10:51:15.922 INFO:tasks.workunit.client.0.smithi050.stdout: lockers: 2024-09-14T10:51:15.924 INFO:tasks.workunit.client.0.smithi050.stdout:lock: mylock 2024-09-14T10:51:15.924 INFO:tasks.workunit.client.0.smithi050.stdout: lock_type: shared 2024-09-14T10:51:15.924 INFO:tasks.workunit.client.0.smithi050.stdout: tag: 2024-09-14T10:51:15.924 INFO:tasks.workunit.client.0.smithi050.stdout: lockers: 2024-09-14T10:51:15.924 INFO:tasks.workunit.client.0.smithi050.stdout: client.5235 expiration=0.000000 addr=v1:172.21.15.50:0/1059134635 cookie= 2024-09-14T10:51:15.924 INFO:tasks.workunit.client.0.smithi050.stdout: client.5235 expiration=0.000000 addr=v1:172.21.15.50:0/1059134635 cookie=new cookie 2024-09-14T10:51:16.916 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] ClsLock.TestCookie (3014 ms) 2024-09-14T10:51:16.916 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-14T10:51:19.935 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] ClsLock.TestMultipleLocks (3019 ms) 2024-09-14T10:51:19.935 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-14T10:51:27.351 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] ClsLock.TestLockDuration (7415 ms) 2024-09-14T10:51:27.351 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-14T10:51:30.366 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] ClsLock.TestAssertLocked (3014 ms) 2024-09-14T10:51:30.366 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-14T10:51:33.378 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] ClsLock.TestSetCookie (3013 ms) 2024-09-14T10:51:33.378 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] ClsLock.TestRenew 2024-09-14T10:51:54.423 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] ClsLock.TestRenew (21046 ms) 2024-09-14T10:51:54.424 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-14T10:52:01.456 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7030 ms) 2024-09-14T10:52:01.456 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-14T10:52:09.489 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8035 ms) 2024-09-14T10:52:09.489 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-14T10:52:17.517 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8027 ms) 2024-09-14T10:52:17.517 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 11 tests from ClsLock (69455 ms total) 2024-09-14T10:52:17.517 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T10:52:17.517 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment tear-down 2024-09-14T10:52:17.517 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] 11 tests from 1 test suite ran. (69456 ms total) 2024-09-14T10:52:17.517 INFO:tasks.workunit.client.0.smithi050.stdout:[ PASSED ] 11 tests. 2024-09-14T10:52:17.520 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:52:17.521 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:52:17.567 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-14T10:52:17.568 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-14T10:52:17.569 DEBUG:teuthology.orchestra.run.smithi050:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-14T10:52:17.616 INFO:tasks.workunit.client.0.smithi050.stdout:Running main() from gmock_main.cc 2024-09-14T10:52:17.616 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T10:52:17.616 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment set-up. 2024-09-14T10:52:17.616 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 4 tests from cls_log 2024-09-14T10:52:17.616 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-14T10:52:20.530 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_log.test_log_add_same_time (2915 ms) 2024-09-14T10:52:20.531 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-14T10:52:23.556 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_log.test_log_add_different_time (3022 ms) 2024-09-14T10:52:23.556 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_log.trim_by_time 2024-09-14T10:52:26.566 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_log.trim_by_time (3013 ms) 2024-09-14T10:52:26.567 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-14T10:52:29.582 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_log.trim_by_marker (3015 ms) 2024-09-14T10:52:29.582 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 4 tests from cls_log (11965 ms total) 2024-09-14T10:52:29.582 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T10:52:29.582 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment tear-down 2024-09-14T10:52:29.583 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] 4 tests from 1 test suite ran. (11965 ms total) 2024-09-14T10:52:29.583 INFO:tasks.workunit.client.0.smithi050.stdout:[ PASSED ] 4 tests. 2024-09-14T10:52:29.585 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:52:29.585 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:52:29.630 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-14T10:52:29.631 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-14T10:52:29.631 DEBUG:teuthology.orchestra.run.smithi050:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-14T10:52:29.719 INFO:tasks.workunit.client.0.smithi050.stdout:Running main() from gmock_main.cc 2024-09-14T10:52:29.719 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T10:52:29.719 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment set-up. 2024-09-14T10:52:29.719 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 10 tests from cls_refcount 2024-09-14T10:52:29.719 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-14T10:52:32.598 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_refcount.test_implicit (2879 ms) 2024-09-14T10:52:32.598 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-14T10:52:35.612 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3015 ms) 2024-09-14T10:52:35.612 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-14T10:52:43.701 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_refcount.test_put_snap (8088 ms) 2024-09-14T10:52:43.701 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-14T10:52:46.725 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_refcount.test_explicit (3024 ms) 2024-09-14T10:52:46.725 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_refcount.set 2024-09-14T10:52:49.742 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_refcount.set (3017 ms) 2024-09-14T10:52:49.743 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-14T10:52:56.764 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_refcount.test_implicit_ec (7022 ms) 2024-09-14T10:52:56.764 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-14T10:53:03.807 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7044 ms) 2024-09-14T10:53:03.808 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-14T10:53:16.855 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_refcount.test_put_snap_ec (13048 ms) 2024-09-14T10:53:16.856 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-14T10:53:23.888 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_refcount.test_explicit_ec (7032 ms) 2024-09-14T10:53:23.888 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_refcount.set_ec 2024-09-14T10:53:30.917 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_refcount.set_ec (7029 ms) 2024-09-14T10:53:30.918 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 10 tests from cls_refcount (61198 ms total) 2024-09-14T10:53:30.918 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T10:53:30.918 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment tear-down 2024-09-14T10:53:30.918 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] 10 tests from 1 test suite ran. (61198 ms total) 2024-09-14T10:53:30.918 INFO:tasks.workunit.client.0.smithi050.stdout:[ PASSED ] 10 tests. 2024-09-14T10:53:30.920 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:53:30.920 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:53:30.967 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-14T10:53:30.968 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-14T10:53:30.968 DEBUG:teuthology.orchestra.run.smithi050:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-14T10:53:31.016 INFO:tasks.workunit.client.0.smithi050.stdout:Running main() from gmock_main.cc 2024-09-14T10:53:31.017 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-14T10:53:31.017 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment set-up. 2024-09-14T10:53:31.017 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 18 tests from cls_rgw 2024-09-14T10:53:32.922 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw.index_basic 2024-09-14T10:53:32.968 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw.index_basic (45 ms) 2024-09-14T10:53:32.968 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-14T10:53:32.997 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (30 ms) 2024-09-14T10:53:32.998 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-14T10:53:33.036 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw.index_remove_object (39 ms) 2024-09-14T10:53:33.036 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-14T10:53:34.488 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw.index_suggest (1452 ms) 2024-09-14T10:53:34.658 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-14T10:53:34.659 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw.index_suggest_complete (7 ms) 2024-09-14T10:53:34.659 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw.index_list 2024-09-14T10:53:34.659 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw.index_list (23 ms) 2024-09-14T10:53:34.659 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-14T10:53:57.402 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw.index_list_delimited (22883 ms) 2024-09-14T10:53:57.402 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw.bi_list 2024-09-14T10:53:57.492 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw.bi_list (91 ms) 2024-09-14T10:53:57.492 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw.gc_set 2024-09-14T10:53:57.505 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw.gc_set (12 ms) 2024-09-14T10:53:57.505 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw.gc_list 2024-09-14T10:53:57.517 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw.gc_list (12 ms) 2024-09-14T10:53:57.517 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-14T10:54:05.990 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw.gc_defer (8474 ms) 2024-09-14T10:54:05.991 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-14T10:54:06.099 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw.usage_basic (109 ms) 2024-09-14T10:54:06.100 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-14T10:54:06.105 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw.usage_clear_no_obj (5 ms) 2024-09-14T10:54:06.105 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-14T10:54:06.198 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw.usage_clear (93 ms) 2024-09-14T10:54:06.198 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-14T10:54:06.247 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw.bi_log_trim (49 ms) 2024-09-14T10:54:06.247 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-14T10:54:06.262 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw.index_racing_removes (14 ms) 2024-09-14T10:54:06.262 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-14T10:54:06.283 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw.reshardlog_list (22 ms) 2024-09-14T10:54:06.284 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-14T10:54:06.296 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw.reshardlog_num (13 ms) 2024-09-14T10:54:06.995 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 18 tests from cls_rgw (33374 ms total) 2024-09-14T10:54:06.995 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T10:54:06.995 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment tear-down 2024-09-14T10:54:06.995 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] 18 tests from 1 test suite ran. (35977 ms total) 2024-09-14T10:54:06.995 INFO:tasks.workunit.client.0.smithi050.stdout:[ PASSED ] 18 tests. 2024-09-14T10:54:06.997 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:54:06.998 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:54:07.042 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-14T10:54:07.043 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-14T10:54:07.043 DEBUG:teuthology.orchestra.run.smithi050:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-14T10:54:07.130 INFO:tasks.workunit.client.0.smithi050.stdout:Running main() from gmock_main.cc 2024-09-14T10:54:07.130 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T10:54:07.130 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment set-up. 2024-09-14T10:54:07.130 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-14T10:54:07.130 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw_gc.init 2024-09-14T10:54:09.015 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw_gc.init (1886 ms) 2024-09-14T10:54:09.016 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-14T10:54:09.027 INFO:tasks.workunit.client.0.smithi050.stderr:[ ] list info tag = chain-0 2024-09-14T10:54:09.028 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (12 ms) 2024-09-14T10:54:09.028 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-14T10:54:09.033 INFO:tasks.workunit.client.0.smithi050.stderr:[ ] next_marker is: = 0/4263 2024-09-14T10:54:09.034 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (6 ms) 2024-09-14T10:54:09.034 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-14T10:54:09.042 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (9 ms) 2024-09-14T10:54:09.043 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-14T10:54:09.050 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (8 ms) 2024-09-14T10:54:09.051 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-14T10:54:09.059 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (9 ms) 2024-09-14T10:54:09.059 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-14T10:54:09.066 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (7 ms) 2024-09-14T10:54:09.067 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-14T10:54:09.073 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (7 ms) 2024-09-14T10:54:09.074 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-14T10:54:10.020 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw_gc.finalize (946 ms) 2024-09-14T10:54:10.020 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 9 tests from cls_rgw_gc (2890 ms total) 2024-09-14T10:54:10.020 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T10:54:10.020 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment tear-down 2024-09-14T10:54:10.020 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] 9 tests from 1 test suite ran. (2890 ms total) 2024-09-14T10:54:10.020 INFO:tasks.workunit.client.0.smithi050.stdout:[ PASSED ] 9 tests. 2024-09-14T10:54:10.022 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:54:10.022 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:54:10.068 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-14T10:54:10.069 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-14T10:54:10.070 DEBUG:teuthology.orchestra.run.smithi050:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-14T10:54:10.166 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:54:10.166 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:54:10.167 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] Running 1 test from 1 test suite. 2024-09-14T10:54:10.167 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment set-up. 2024-09-14T10:54:12.021 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 1 test from cls_rgw_stats 2024-09-14T10:54:12.022 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-14T10:54:12.031 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.032+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~QW24BPSK824Z.0 size=1048576 2024-09-14T10:54:12.033 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.034+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~QW24BPSK824Z.1 size=402250 2024-09-14T10:54:12.033 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.034+0000 7faa01046780 1 > prepared multipart upload key=GG02P21TFKIM upload=QW24BPSK824Z tag=YPZDTHZV4RHK type=write size=2499402 2024-09-14T10:54:12.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.036+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=SZ2CL3OSG5S2 type=del size=2727897 2024-09-14T10:54:12.036 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.038+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=L8LN05YT2Q2A type=del size=1729705 2024-09-14T10:54:12.038 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.039+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=TN13PB40DAA7 type=write size=66785 2024-09-14T10:54:12.040 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.041+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=UENFO4TJ07FK type=del size=3179485 2024-09-14T10:54:12.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.044+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~9HU9FJYJY5N4.0 size=1048576 2024-09-14T10:54:12.044 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.045+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~9HU9FJYJY5N4.1 size=1048576 2024-09-14T10:54:12.045 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.046+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~9HU9FJYJY5N4.2 size=908933 2024-09-14T10:54:12.045 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.046+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=9HU9FJYJY5N4 tag=R2ETP3NY74X8 type=write size=4054661 2024-09-14T10:54:12.048 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.050+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~4TXEY1YWJXWM.0 size=1048576 2024-09-14T10:54:12.050 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.051+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~4TXEY1YWJXWM.1 size=363060 2024-09-14T10:54:12.050 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.051+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=4TXEY1YWJXWM tag=SPB1VOHNCSX9 type=write size=2460212 2024-09-14T10:54:12.051 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.052+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=Y8QBHS0OJAY8 type=write size=736938 2024-09-14T10:54:12.054 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.056+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~1RBQIXUMNYBM.0 size=465607 2024-09-14T10:54:12.055 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.056+0000 7faa01046780 1 > prepared multipart upload key=GG02P21TFKIM upload=1RBQIXUMNYBM tag=PDIA6W4CIYJS type=write size=1514183 2024-09-14T10:54:12.057 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.059+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~K3JJLH5R7R6K.0 size=1048576 2024-09-14T10:54:12.059 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.060+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~K3JJLH5R7R6K.1 size=1048576 2024-09-14T10:54:12.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.061+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~K3JJLH5R7R6K.2 size=507073 2024-09-14T10:54:12.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.061+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=K3JJLH5R7R6K tag=8SPVP2982T0I type=write size=3652801 2024-09-14T10:54:12.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.064+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~T0G8LVT83CNO.0 size=968140 2024-09-14T10:54:12.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.064+0000 7faa01046780 1 > prepared multipart upload key=SJ02N8472YDM upload=T0G8LVT83CNO tag=WDRGRIU3RVOR type=write size=2016716 2024-09-14T10:54:12.065 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.067+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~Z01050WU32VB.0 size=974563 2024-09-14T10:54:12.066 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.067+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=Z01050WU32VB tag=B9TL7EQQY165 type=write size=2023139 2024-09-14T10:54:12.067 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.068+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=A656Q1LSRSPQ type=del size=1294560 2024-09-14T10:54:12.069 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.070+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=B2NMJ0G2PVI4 type=del size=1435552 2024-09-14T10:54:12.072 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.073+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~TGVEXN3T2C75.0 size=1048576 2024-09-14T10:54:12.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.074+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~TGVEXN3T2C75.1 size=988278 2024-09-14T10:54:12.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.074+0000 7faa01046780 1 > prepared multipart upload key=3UEX0IPM4CPY upload=TGVEXN3T2C75 tag=FQNE6UVB2HH0 type=write size=3085430 2024-09-14T10:54:12.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.075+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=6E2B7FL64JBJ type=write size=776243 2024-09-14T10:54:12.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.077+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~QW24BPSK824Z.0 size=1048576 2024-09-14T10:54:12.077 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.078+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~QW24BPSK824Z.1 size=402250 2024-09-14T10:54:12.079 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.080+0000 7faa01046780 1 < completed multipart upload key=GG02P21TFKIM upload=QW24BPSK824Z tag=YPZDTHZV4RHK type=write size=2499402 2024-09-14T10:54:12.082 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.083+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~MOCKGYF72PNA.0 size=1048576 2024-09-14T10:54:12.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.084+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~MOCKGYF72PNA.1 size=988204 2024-09-14T10:54:12.084 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.084+0000 7faa01046780 1 > prepared multipart upload key=3UEX0IPM4CPY upload=MOCKGYF72PNA tag=R5N9K6TSY0DK type=write size=3085356 2024-09-14T10:54:12.086 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.088+0000 7faa01046780 1 < suggested update operation key=CKMDOO75UZGE tag=SZ2CL3OSG5S2 type=del size=2727897 2024-09-14T10:54:12.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.089+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=92K8UI18FM0T type=del size=2636589 2024-09-14T10:54:12.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.091+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=L8LN05YT2Q2A type=del 2024-09-14T10:54:12.093 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.094+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~9MZBN6HK70AI.0 size=1048576 2024-09-14T10:54:12.094 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.096+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~9MZBN6HK70AI.1 size=1048576 2024-09-14T10:54:12.095 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.096+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~9MZBN6HK70AI.2 size=835716 2024-09-14T10:54:12.095 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.096+0000 7faa01046780 1 > prepared multipart upload key=3UEX0IPM4CPY upload=9MZBN6HK70AI tag=HM3DRQ406TZQ type=write size=3981444 2024-09-14T10:54:12.097 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.098+0000 7faa01046780 1 < completed write operation key=V905BR1VWUCV tag=TN13PB40DAA7 type=write size=66785 2024-09-14T10:54:12.098 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.099+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=BZPTNX9YWUCQ type=del size=610693 2024-09-14T10:54:12.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.101+0000 7faa01046780 1 < completed delete operation key=V5T3AN9D7DH6 tag=UENFO4TJ07FK type=del 2024-09-14T10:54:12.102 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.104+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=5G3ODKPG85EI type=del size=890946 2024-09-14T10:54:12.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.106+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~9HU9FJYJY5N4.0 size=1048576 2024-09-14T10:54:12.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.107+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~9HU9FJYJY5N4.1 size=1048576 2024-09-14T10:54:12.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.108+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~9HU9FJYJY5N4.2 size=908933 2024-09-14T10:54:12.109 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.110+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=9HU9FJYJY5N4 tag=R2ETP3NY74X8 type=write size=4054661 2024-09-14T10:54:12.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.112+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=J5C4MZU19ICJ type=del size=3985294 2024-09-14T10:54:12.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.113+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~4TXEY1YWJXWM.0 size=1048576 2024-09-14T10:54:12.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.114+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~4TXEY1YWJXWM.1 size=363060 2024-09-14T10:54:12.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.117+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=4TXEY1YWJXWM tag=SPB1VOHNCSX9 type=write size=2460212 2024-09-14T10:54:12.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.118+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=QC8R2KINO72V type=write size=696936 2024-09-14T10:54:12.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.121+0000 7faa01046780 1 < suggested remove operation key=NXIPG4HR9ZYY tag=Y8QBHS0OJAY8 type=write 2024-09-14T10:54:12.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.124+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~7FA25V97E67C.0 size=1048576 2024-09-14T10:54:12.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.125+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~7FA25V97E67C.1 size=494285 2024-09-14T10:54:12.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.125+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=7FA25V97E67C tag=WHRVGDVLIL4Q type=write size=2591437 2024-09-14T10:54:12.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.127+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~1RBQIXUMNYBM.0 size=465607 2024-09-14T10:54:12.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.129+0000 7faa01046780 1 < completed multipart upload key=GG02P21TFKIM upload=1RBQIXUMNYBM tag=PDIA6W4CIYJS type=write size=1514183 2024-09-14T10:54:12.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.132+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~2KITE0C4ZKXK.0 size=609615 2024-09-14T10:54:12.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.132+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=2KITE0C4ZKXK tag=6KWQNHK7GB8V type=write size=1658191 2024-09-14T10:54:12.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.133+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~K3JJLH5R7R6K.0 size=1048576 2024-09-14T10:54:12.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.134+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~K3JJLH5R7R6K.1 size=1048576 2024-09-14T10:54:12.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.136+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~K3JJLH5R7R6K.2 size=507073 2024-09-14T10:54:12.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.138+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=K3JJLH5R7R6K tag=8SPVP2982T0I type=write size=3652801 2024-09-14T10:54:12.139 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.141+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~LL25LTMS3T4C.0 size=1048576 2024-09-14T10:54:12.141 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.142+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~LL25LTMS3T4C.1 size=1031093 2024-09-14T10:54:12.141 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.142+0000 7faa01046780 1 > prepared multipart upload key=X9DUVQBBLUTF upload=LL25LTMS3T4C tag=9SEO0511Z8Z0 type=write size=3128245 2024-09-14T10:54:12.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.144+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~T0G8LVT83CNO.0 size=968140 2024-09-14T10:54:12.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.146+0000 7faa01046780 1 < completed multipart upload key=SJ02N8472YDM upload=T0G8LVT83CNO tag=WDRGRIU3RVOR type=write size=2016716 2024-09-14T10:54:12.148 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.149+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~GGM5FI5MTHWE.0 size=1048576 2024-09-14T10:54:12.149 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.150+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~GGM5FI5MTHWE.1 size=758560 2024-09-14T10:54:12.149 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.150+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=GGM5FI5MTHWE tag=ZGCPJDDC0C8X type=write size=2855712 2024-09-14T10:54:12.150 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.152+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~Z01050WU32VB.0 size=974563 2024-09-14T10:54:12.153 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.154+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=Z01050WU32VB tag=B9TL7EQQY165 type=write size=2023139 2024-09-14T10:54:12.155 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.157+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~HXYI6GXO8IC0.0 size=276249 2024-09-14T10:54:12.156 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.157+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=HXYI6GXO8IC0 tag=4JDFALB4QK9Z type=write size=1324825 2024-09-14T10:54:12.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.158+0000 7faa01046780 1 < completed delete operation key=V5T3AN9D7DH6 tag=A656Q1LSRSPQ type=del 2024-09-14T10:54:12.158 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.160+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=AN6FZ5PNNY7E type=del size=778226 2024-09-14T10:54:12.160 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.161+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=B2NMJ0G2PVI4 type=del 2024-09-14T10:54:12.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.163+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=9JX152J1NGGG type=del size=3742419 2024-09-14T10:54:12.163 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.165+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~TGVEXN3T2C75.0 size=1048576 2024-09-14T10:54:12.164 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.165+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~TGVEXN3T2C75.1 size=988278 2024-09-14T10:54:12.166 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.168+0000 7faa01046780 1 < completed multipart upload key=3UEX0IPM4CPY upload=TGVEXN3T2C75 tag=FQNE6UVB2HH0 type=write size=3085430 2024-09-14T10:54:12.169 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.170+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~3D4GDG02Q6A9.0 size=555800 2024-09-14T10:54:12.169 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.170+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=3D4GDG02Q6A9 tag=Z76WKDEN7ZFC type=write size=1604376 2024-09-14T10:54:12.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.172+0000 7faa01046780 1 < completed write operation key=F872GLVQDCX6 tag=6E2B7FL64JBJ type=write size=776243 2024-09-14T10:54:12.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.173+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=D7L9GA5DY2L6 type=del size=1226377 2024-09-14T10:54:12.173 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.174+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~MOCKGYF72PNA.0 size=1048576 2024-09-14T10:54:12.174 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.175+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~MOCKGYF72PNA.1 size=988204 2024-09-14T10:54:12.176 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.178+0000 7faa01046780 1 < completed multipart upload key=3UEX0IPM4CPY upload=MOCKGYF72PNA tag=R5N9K6TSY0DK type=write size=3085356 2024-09-14T10:54:12.179 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.180+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~MIA0TF6FMPM8.0 size=206268 2024-09-14T10:54:12.179 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.180+0000 7faa01046780 1 > prepared multipart upload key=PS2QU1UZUYHE upload=MIA0TF6FMPM8 tag=S29F4XWT96IC type=write size=1254844 2024-09-14T10:54:12.180 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.182+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=92K8UI18FM0T type=del 2024-09-14T10:54:12.183 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.184+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=JSZS90P6ZCA7 type=del size=321248 2024-09-14T10:54:12.185 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.185+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~9MZBN6HK70AI.0 size=1048576 2024-09-14T10:54:12.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.186+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~9MZBN6HK70AI.1 size=1048576 2024-09-14T10:54:12.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.186+0000 7faa01046780 1 < canceled part key=_multipart_3UEX0IPM4CPY.2~9MZBN6HK70AI.2 size=835716 2024-09-14T10:54:12.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.189+0000 7faa01046780 1 < canceled multipart upload key=3UEX0IPM4CPY upload=9MZBN6HK70AI tag=HM3DRQ406TZQ type=write size=3981444 2024-09-14T10:54:12.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.191+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=FZY7SDYAF18J type=del size=1490006 2024-09-14T10:54:12.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.192+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=BZPTNX9YWUCQ type=del 2024-09-14T10:54:12.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.194+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~N2H6FYUT4YSQ.0 size=1048576 2024-09-14T10:54:12.194 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.195+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~N2H6FYUT4YSQ.1 size=1048576 2024-09-14T10:54:12.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.196+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~N2H6FYUT4YSQ.2 size=646026 2024-09-14T10:54:12.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.196+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=N2H6FYUT4YSQ tag=I4KKEU3GZBCU type=write size=3791754 2024-09-14T10:54:12.198 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.199+0000 7faa01046780 1 < suggested remove operation key=PBRZNGSOLJ8E tag=5G3ODKPG85EI type=del 2024-09-14T10:54:12.199 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.200+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=M8HOUYLWRZSY type=write size=358300 2024-09-14T10:54:12.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.202+0000 7faa01046780 1 < completed delete operation key=KDUTH9PIR3FI tag=J5C4MZU19ICJ type=del 2024-09-14T10:54:12.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.203+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=J709HTKKQV4E type=write size=332731 2024-09-14T10:54:12.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.204+0000 7faa01046780 1 < completed write operation key=3FSH0OFMF54V tag=QC8R2KINO72V type=write size=696936 2024-09-14T10:54:12.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.206+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=UMJBKX0K9SLD type=del size=489982 2024-09-14T10:54:12.206 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.207+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~7FA25V97E67C.0 size=1048576 2024-09-14T10:54:12.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.208+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~7FA25V97E67C.1 size=494285 2024-09-14T10:54:12.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.210+0000 7faa01046780 1 < completed multipart upload key=0XVVSUIOBQPL upload=7FA25V97E67C tag=WHRVGDVLIL4Q type=write size=2591437 2024-09-14T10:54:12.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.212+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=ME4QB39AKED1 type=del size=2180042 2024-09-14T10:54:12.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.213+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~2KITE0C4ZKXK.0 size=609615 2024-09-14T10:54:12.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.215+0000 7faa01046780 1 < completed multipart upload key=U8TE0XNK9YKM upload=2KITE0C4ZKXK tag=6KWQNHK7GB8V type=write size=1658191 2024-09-14T10:54:12.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.217+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=PWNM7OSO65GV type=del size=2070185 2024-09-14T10:54:12.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.218+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~LL25LTMS3T4C.0 size=1048576 2024-09-14T10:54:12.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.219+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~LL25LTMS3T4C.1 size=1031093 2024-09-14T10:54:12.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.221+0000 7faa01046780 1 < completed multipart upload key=X9DUVQBBLUTF upload=LL25LTMS3T4C tag=9SEO0511Z8Z0 type=write size=3128245 2024-09-14T10:54:12.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.222+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=1KJOA07WVYJ5 type=del size=2470396 2024-09-14T10:54:12.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.224+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~GGM5FI5MTHWE.0 size=1048576 2024-09-14T10:54:12.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.225+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~GGM5FI5MTHWE.1 size=758560 2024-09-14T10:54:12.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.227+0000 7faa01046780 1 < completed multipart upload key=0XVVSUIOBQPL upload=GGM5FI5MTHWE tag=ZGCPJDDC0C8X type=write size=2855712 2024-09-14T10:54:12.227 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.229+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=O8P1KH6LYM3Q type=del size=917343 2024-09-14T10:54:12.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.230+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~HXYI6GXO8IC0.0 size=276249 2024-09-14T10:54:12.231 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.232+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=HXYI6GXO8IC0 tag=4JDFALB4QK9Z type=write size=1324825 2024-09-14T10:54:12.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.235+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~AREH6BOK0YH8.0 size=14144 2024-09-14T10:54:12.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.235+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=AREH6BOK0YH8 tag=7NAVN2UBZ4W0 type=write size=1062720 2024-09-14T10:54:12.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.238+0000 7faa01046780 1 < suggested update operation key=KDUTH9PIR3FI tag=AN6FZ5PNNY7E type=del size=778226 2024-09-14T10:54:12.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.240+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~4P3D4QHYRE3Q.0 size=1048576 2024-09-14T10:54:12.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.241+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~4P3D4QHYRE3Q.1 size=608828 2024-09-14T10:54:12.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.241+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=4P3D4QHYRE3Q tag=FFZBB00LQAQ6 type=write size=2705980 2024-09-14T10:54:12.241 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.242+0000 7faa01046780 1 < completed delete operation key=PTDE6D7OIU1A tag=9JX152J1NGGG type=del 2024-09-14T10:54:12.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.244+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=9K7OK66Z2MR6 type=del size=267711 2024-09-14T10:54:12.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.245+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~3D4GDG02Q6A9.0 size=555800 2024-09-14T10:54:12.246 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.247+0000 7faa01046780 1 < completed multipart upload key=CKMDOO75UZGE upload=3D4GDG02Q6A9 tag=Z76WKDEN7ZFC type=write size=1604376 2024-09-14T10:54:12.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.249+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=1ZE4HONBLHGZ type=del size=3865237 2024-09-14T10:54:12.251 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.253+0000 7faa01046780 1 < suggested update operation key=NXIPG4HR9ZYY tag=D7L9GA5DY2L6 type=del size=1226377 2024-09-14T10:54:12.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.255+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~13MEIGOF21UG.0 size=829153 2024-09-14T10:54:12.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.255+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=13MEIGOF21UG tag=KHRC91OPFPDP type=write size=1877729 2024-09-14T10:54:12.256 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.257+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~MIA0TF6FMPM8.0 size=206268 2024-09-14T10:54:12.258 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.260+0000 7faa01046780 1 < completed multipart upload key=PS2QU1UZUYHE upload=MIA0TF6FMPM8 tag=S29F4XWT96IC type=write size=1254844 2024-09-14T10:54:12.260 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.262+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=O6EX577M2H1N type=del size=447679 2024-09-14T10:54:12.261 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.263+0000 7faa01046780 1 < completed delete operation key=V5T3AN9D7DH6 tag=JSZS90P6ZCA7 type=del 2024-09-14T10:54:12.263 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.264+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=J2C3MB0INEUT type=write size=550841 2024-09-14T10:54:12.265 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.267+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=FZY7SDYAF18J type=del 2024-09-14T10:54:12.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.268+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=Q0LJ5KPTMXY9 type=del size=1601059 2024-09-14T10:54:12.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.268+0000 7faa01046780 1 < canceled part key=_multipart_HUBZAFMSCCNC.2~N2H6FYUT4YSQ.0 size=1048576 2024-09-14T10:54:12.268 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.269+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~N2H6FYUT4YSQ.1 size=1048576 2024-09-14T10:54:12.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.270+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~N2H6FYUT4YSQ.2 size=646026 2024-09-14T10:54:12.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.273+0000 7faa01046780 1 < canceled multipart upload key=HUBZAFMSCCNC upload=N2H6FYUT4YSQ tag=I4KKEU3GZBCU type=write size=3791754 2024-09-14T10:54:12.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.274+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=UV8YQ94NVOB1 type=del size=474701 2024-09-14T10:54:12.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.277+0000 7faa01046780 1 < completed write operation key=S3BGVJ9N9S4P tag=M8HOUYLWRZSY type=write size=358300 2024-09-14T10:54:12.276 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.277+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=RHE0RT5CDNF2 type=del size=1124827 2024-09-14T10:54:12.278 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.279+0000 7faa01046780 1 < completed write operation key=ZY0BY3G9NREC tag=J709HTKKQV4E type=write size=332731 2024-09-14T10:54:12.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.281+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~XTQRVS7GC0OC.0 size=467721 2024-09-14T10:54:12.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.281+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=XTQRVS7GC0OC tag=IJ5FANGK024A type=write size=1516297 2024-09-14T10:54:12.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.283+0000 7faa01046780 1 < canceled operation key=V905BR1VWUCV tag=UMJBKX0K9SLD type=del size=489982 2024-09-14T10:54:12.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.284+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=TM50CFGIDZEK type=del size=1147516 2024-09-14T10:54:12.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.287+0000 7faa01046780 1 < suggested remove operation key=CKMDOO75UZGE tag=ME4QB39AKED1 type=del 2024-09-14T10:54:12.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.290+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~NWQ2UVXBJZ3Y.0 size=1048576 2024-09-14T10:54:12.289 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.291+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~NWQ2UVXBJZ3Y.1 size=1048576 2024-09-14T10:54:12.291 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.293+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~NWQ2UVXBJZ3Y.2 size=1016136 2024-09-14T10:54:12.291 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.293+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=NWQ2UVXBJZ3Y tag=NZJ3C81XMYVT type=write size=4161864 2024-09-14T10:54:12.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.294+0000 7faa01046780 1 < completed delete operation key=U8TE0XNK9YKM tag=PWNM7OSO65GV type=del 2024-09-14T10:54:12.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.295+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=6DWCQ9HESWSR type=del size=3363800 2024-09-14T10:54:12.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.296+0000 7faa01046780 1 < completed delete operation key=GG02P21TFKIM tag=1KJOA07WVYJ5 type=del 2024-09-14T10:54:12.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.299+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~K6Z3E2TIT4OW.0 size=666400 2024-09-14T10:54:12.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.299+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=K6Z3E2TIT4OW tag=IGIJFHZST430 type=write size=1714976 2024-09-14T10:54:12.299 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.300+0000 7faa01046780 1 < completed delete operation key=3FSH0OFMF54V tag=O8P1KH6LYM3Q type=del 2024-09-14T10:54:12.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.304+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~VUMAQJKTIU5Z.0 size=1048576 2024-09-14T10:54:12.303 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.305+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~VUMAQJKTIU5Z.1 size=1048576 2024-09-14T10:54:12.304 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.305+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~VUMAQJKTIU5Z.2 size=392594 2024-09-14T10:54:12.304 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.305+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=VUMAQJKTIU5Z tag=UPJW73DIYZQ8 type=write size=3538322 2024-09-14T10:54:12.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.307+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~AREH6BOK0YH8.0 size=14144 2024-09-14T10:54:12.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.309+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=AREH6BOK0YH8 tag=7NAVN2UBZ4W0 type=write size=1062720 2024-09-14T10:54:12.311 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.312+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~238W5JMKNRJJ.0 size=253672 2024-09-14T10:54:12.311 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.312+0000 7faa01046780 1 > prepared multipart upload key=LF41PL7DFSJI upload=238W5JMKNRJJ tag=7G0S2YKIQPPT type=write size=1302248 2024-09-14T10:54:12.311 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.312+0000 7faa01046780 1 < canceled part key=_multipart_HYAGNAOWK8LF.2~4P3D4QHYRE3Q.0 size=1048576 2024-09-14T10:54:12.312 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.313+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~4P3D4QHYRE3Q.1 size=608828 2024-09-14T10:54:12.315 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.317+0000 7faa01046780 1 < canceled multipart upload key=HYAGNAOWK8LF upload=4P3D4QHYRE3Q tag=FFZBB00LQAQ6 type=write size=2705980 2024-09-14T10:54:12.317 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.318+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=PLEAP06XO100 type=del size=2716971 2024-09-14T10:54:12.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.320+0000 7faa01046780 1 < completed delete operation key=U8TE0XNK9YKM tag=9K7OK66Z2MR6 type=del 2024-09-14T10:54:12.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.321+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=U2R56AKV6ZDJ type=del size=2479518 2024-09-14T10:54:12.323 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.324+0000 7faa01046780 1 < suggested remove operation key=PS2QU1UZUYHE tag=1ZE4HONBLHGZ type=del 2024-09-14T10:54:12.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.326+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=RQDJONO5DQM0 type=del size=2752870 2024-09-14T10:54:12.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.327+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~13MEIGOF21UG.0 size=829153 2024-09-14T10:54:12.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.329+0000 7faa01046780 1 < completed multipart upload key=Y4CB0HIN0750 upload=13MEIGOF21UG tag=KHRC91OPFPDP type=write size=1877729 2024-09-14T10:54:12.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.330+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=D631BUP7P41R type=write size=613973 2024-09-14T10:54:12.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.332+0000 7faa01046780 1 < completed delete operation key=V5T3AN9D7DH6 tag=O6EX577M2H1N type=del 2024-09-14T10:54:12.334 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.335+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~P1KAWNLDK3SQ.0 size=1030427 2024-09-14T10:54:12.334 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.335+0000 7faa01046780 1 > prepared multipart upload key=X9DUVQBBLUTF upload=P1KAWNLDK3SQ tag=D3AJ3H0TH968 type=write size=2079003 2024-09-14T10:54:12.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.336+0000 7faa01046780 1 < completed write operation key=XH8GHY9YRGTP tag=J2C3MB0INEUT type=write size=550841 2024-09-14T10:54:12.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.338+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=94EZJOKI0EF1 type=del size=2108776 2024-09-14T10:54:12.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.339+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=Q0LJ5KPTMXY9 type=del 2024-09-14T10:54:12.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.340+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=IHE3UMDNGY88 type=del size=3569482 2024-09-14T10:54:12.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.342+0000 7faa01046780 1 < completed delete operation key=0XVVSUIOBQPL tag=UV8YQ94NVOB1 type=del 2024-09-14T10:54:12.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.344+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~WCSHQXE7VH57.0 size=152762 2024-09-14T10:54:12.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.344+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=WCSHQXE7VH57 tag=1XJ2Q0JHKGPZ type=write size=1201338 2024-09-14T10:54:12.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.346+0000 7faa01046780 1 < completed delete operation key=PBRZNGSOLJ8E tag=RHE0RT5CDNF2 type=del 2024-09-14T10:54:12.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.348+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~38Y4H37EVBNJ.0 size=582051 2024-09-14T10:54:12.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.348+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=38Y4H37EVBNJ tag=LN62BRFESVAQ type=write size=1630627 2024-09-14T10:54:12.348 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.350+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~XTQRVS7GC0OC.0 size=467721 2024-09-14T10:54:12.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.352+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=XTQRVS7GC0OC tag=IJ5FANGK024A type=write size=1516297 2024-09-14T10:54:12.352 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.353+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=S1E35DSJ4FB3 type=del size=1001912 2024-09-14T10:54:12.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.354+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=TM50CFGIDZEK type=del 2024-09-14T10:54:12.355 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.356+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=T01XD60B77GG type=write size=146030 2024-09-14T10:54:12.355 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.356+0000 7faa01046780 1 < canceled part key=_multipart_HYAGNAOWK8LF.2~NWQ2UVXBJZ3Y.0 size=1048576 2024-09-14T10:54:12.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.357+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~NWQ2UVXBJZ3Y.1 size=1048576 2024-09-14T10:54:12.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.357+0000 7faa01046780 1 < canceled part key=_multipart_HYAGNAOWK8LF.2~NWQ2UVXBJZ3Y.2 size=1016136 2024-09-14T10:54:12.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.360+0000 7faa01046780 1 < canceled multipart upload key=HYAGNAOWK8LF upload=NWQ2UVXBJZ3Y tag=NZJ3C81XMYVT type=write size=4161864 2024-09-14T10:54:12.360 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.361+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=0IP2I3C05IFY type=del size=2270936 2024-09-14T10:54:12.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.362+0000 7faa01046780 1 < canceled operation key=Q33ET1AN14NG tag=6DWCQ9HESWSR type=del size=3363800 2024-09-14T10:54:12.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.364+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=8TUUSVD0KOO1 type=write size=876385 2024-09-14T10:54:12.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.365+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~K6Z3E2TIT4OW.0 size=666400 2024-09-14T10:54:12.366 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.368+0000 7faa01046780 1 < completed multipart upload key=0OL3SF5IWDMH upload=K6Z3E2TIT4OW tag=IGIJFHZST430 type=write size=1714976 2024-09-14T10:54:12.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.370+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~HXUGMJJE40CQ.0 size=1048576 2024-09-14T10:54:12.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.371+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~HXUGMJJE40CQ.1 size=1048576 2024-09-14T10:54:12.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.372+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~HXUGMJJE40CQ.2 size=620358 2024-09-14T10:54:12.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.372+0000 7faa01046780 1 > prepared multipart upload key=SJ02N8472YDM upload=HXUGMJJE40CQ tag=T791UQNBY5VX type=write size=3766086 2024-09-14T10:54:12.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.373+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~VUMAQJKTIU5Z.0 size=1048576 2024-09-14T10:54:12.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.374+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~VUMAQJKTIU5Z.1 size=1048576 2024-09-14T10:54:12.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.375+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~VUMAQJKTIU5Z.2 size=392594 2024-09-14T10:54:12.376 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.377+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=VUMAQJKTIU5Z tag=UPJW73DIYZQ8 type=write size=3538322 2024-09-14T10:54:12.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.379+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=60UJIPVY3238 type=del size=3289295 2024-09-14T10:54:12.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.380+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~238W5JMKNRJJ.0 size=253672 2024-09-14T10:54:12.381 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.382+0000 7faa01046780 1 < completed multipart upload key=LF41PL7DFSJI upload=238W5JMKNRJJ tag=7G0S2YKIQPPT type=write size=1302248 2024-09-14T10:54:12.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.385+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~4HVPM780DSO2.0 size=1048576 2024-09-14T10:54:12.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.386+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~4HVPM780DSO2.1 size=1048576 2024-09-14T10:54:12.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.387+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~4HVPM780DSO2.2 size=449385 2024-09-14T10:54:12.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.387+0000 7faa01046780 1 > prepared multipart upload key=ZY0BY3G9NREC upload=4HVPM780DSO2 tag=IB12FIGU1S2P type=write size=3595113 2024-09-14T10:54:12.387 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.388+0000 7faa01046780 1 < completed delete operation key=GG02P21TFKIM tag=PLEAP06XO100 type=del 2024-09-14T10:54:12.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.390+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=0WGTVNK761HD type=del size=2388708 2024-09-14T10:54:12.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.391+0000 7faa01046780 1 < canceled operation key=FOJGGEQZD7YW tag=U2R56AKV6ZDJ type=del size=2479518 2024-09-14T10:54:12.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.392+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=3W8A01HG99E2 type=del size=1299535 2024-09-14T10:54:12.394 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.396+0000 7faa01046780 1 < suggested update operation key=ZY0BY3G9NREC tag=RQDJONO5DQM0 type=del size=2752870 2024-09-14T10:54:12.396 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.397+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~CF6R98AVSG3V.0 size=1048576 2024-09-14T10:54:12.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.399+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~CF6R98AVSG3V.1 size=1048576 2024-09-14T10:54:12.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.400+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~CF6R98AVSG3V.2 size=473195 2024-09-14T10:54:12.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.400+0000 7faa01046780 1 > prepared multipart upload key=GG02P21TFKIM upload=CF6R98AVSG3V tag=YLXK1ET8MK1E type=write size=3618923 2024-09-14T10:54:12.400 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.401+0000 7faa01046780 1 < canceled operation key=Q33ET1AN14NG tag=D631BUP7P41R type=write size=613973 2024-09-14T10:54:12.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.403+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=XNJ943P3N4K2 type=del size=3040570 2024-09-14T10:54:12.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.403+0000 7faa01046780 1 < canceled part key=_multipart_X9DUVQBBLUTF.2~P1KAWNLDK3SQ.0 size=1030427 2024-09-14T10:54:12.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.406+0000 7faa01046780 1 < canceled multipart upload key=X9DUVQBBLUTF upload=P1KAWNLDK3SQ tag=D3AJ3H0TH968 type=write size=2079003 2024-09-14T10:54:12.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.408+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~VDBCSTSEVRQZ.0 size=293559 2024-09-14T10:54:12.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.408+0000 7faa01046780 1 > prepared multipart upload key=GG02P21TFKIM upload=VDBCSTSEVRQZ tag=XV30YZ7XV59O type=write size=1342135 2024-09-14T10:54:12.408 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.410+0000 7faa01046780 1 < completed delete operation key=PTDE6D7OIU1A tag=94EZJOKI0EF1 type=del 2024-09-14T10:54:12.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.411+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=GS0MLJKYOKLR type=del size=3614514 2024-09-14T10:54:12.411 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.412+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=IHE3UMDNGY88 type=del 2024-09-14T10:54:12.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.414+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=P56IUG75BUZY type=del size=4100901 2024-09-14T10:54:12.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.416+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~WCSHQXE7VH57.0 size=152762 2024-09-14T10:54:12.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.418+0000 7faa01046780 1 < completed multipart upload key=S3BGVJ9N9S4P upload=WCSHQXE7VH57 tag=1XJ2Q0JHKGPZ type=write size=1201338 2024-09-14T10:54:12.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.420+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=SR5U6O8N23NN type=del size=3459732 2024-09-14T10:54:12.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.421+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~38Y4H37EVBNJ.0 size=582051 2024-09-14T10:54:12.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.424+0000 7faa01046780 1 < completed multipart upload key=HYAGNAOWK8LF upload=38Y4H37EVBNJ tag=LN62BRFESVAQ type=write size=1630627 2024-09-14T10:54:12.423 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.424+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=M1P7JHHLKGYM type=del size=2905775 2024-09-14T10:54:12.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.426+0000 7faa01046780 1 < completed delete operation key=U8TE0XNK9YKM tag=S1E35DSJ4FB3 type=del 2024-09-14T10:54:12.427 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.429+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~OW1I57VKVRIB.0 size=1048576 2024-09-14T10:54:12.428 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.429+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~OW1I57VKVRIB.1 size=1048576 2024-09-14T10:54:12.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.431+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~OW1I57VKVRIB.2 size=1015228 2024-09-14T10:54:12.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.431+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=OW1I57VKVRIB tag=U1TI9LDRO5B0 type=write size=4160956 2024-09-14T10:54:12.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.432+0000 7faa01046780 1 < completed write operation key=F872GLVQDCX6 tag=T01XD60B77GG type=write size=146030 2024-09-14T10:54:12.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.435+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~Y6ADTN74CZMN.0 size=515206 2024-09-14T10:54:12.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.435+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=Y6ADTN74CZMN tag=NL4L8RY2PE2M type=write size=1563782 2024-09-14T10:54:12.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.436+0000 7faa01046780 1 < completed delete operation key=TDNQZ8Y1C6X2 tag=0IP2I3C05IFY type=del 2024-09-14T10:54:12.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.438+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~6J2JXAVN8BAM.0 size=1048576 2024-09-14T10:54:12.438 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.439+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~6J2JXAVN8BAM.1 size=91356 2024-09-14T10:54:12.438 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.439+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=6J2JXAVN8BAM tag=I3TCP38TD9HR type=write size=2188508 2024-09-14T10:54:12.440 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.441+0000 7faa01046780 1 < completed write operation key=V11YJWHT4OOD tag=8TUUSVD0KOO1 type=write size=876385 2024-09-14T10:54:12.442 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.443+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~W4K028S1JS7X.0 size=1048576 2024-09-14T10:54:12.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.444+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~W4K028S1JS7X.1 size=411035 2024-09-14T10:54:12.444 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.444+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=W4K028S1JS7X tag=Y4Y0FGSUAJWF type=write size=2508187 2024-09-14T10:54:12.446 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.447+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~HXUGMJJE40CQ.0 size=1048576 2024-09-14T10:54:12.447 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.448+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~HXUGMJJE40CQ.1 size=1048576 2024-09-14T10:54:12.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.450+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~HXUGMJJE40CQ.2 size=620358 2024-09-14T10:54:12.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.452+0000 7faa01046780 1 < completed multipart upload key=SJ02N8472YDM upload=HXUGMJJE40CQ tag=T791UQNBY5VX type=write size=3766086 2024-09-14T10:54:12.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.453+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=TUS34WJ24TK4 type=write size=606771 2024-09-14T10:54:12.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.455+0000 7faa01046780 1 < completed delete operation key=PTDE6D7OIU1A tag=60UJIPVY3238 type=del 2024-09-14T10:54:12.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.456+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=NZKKPRRMWNM0 type=del size=1205294 2024-09-14T10:54:12.456 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.458+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~4HVPM780DSO2.0 size=1048576 2024-09-14T10:54:12.457 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.458+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~4HVPM780DSO2.1 size=1048576 2024-09-14T10:54:12.458 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.460+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~4HVPM780DSO2.2 size=449385 2024-09-14T10:54:12.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.462+0000 7faa01046780 1 < completed multipart upload key=ZY0BY3G9NREC upload=4HVPM780DSO2 tag=IB12FIGU1S2P type=write size=3595113 2024-09-14T10:54:12.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.464+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~O6F4VUTM45G5.0 size=1048576 2024-09-14T10:54:12.464 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.466+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~O6F4VUTM45G5.1 size=1048576 2024-09-14T10:54:12.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.466+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~O6F4VUTM45G5.2 size=736599 2024-09-14T10:54:12.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.466+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=O6F4VUTM45G5 tag=0T320LXQEVQF type=write size=3882327 2024-09-14T10:54:12.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.468+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=0WGTVNK761HD type=del 2024-09-14T10:54:12.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.469+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=6B8HBR3K141E type=del size=1375946 2024-09-14T10:54:12.469 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.471+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=3W8A01HG99E2 type=del 2024-09-14T10:54:12.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.472+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=QUEPRWI9EPDA type=del size=3264352 2024-09-14T10:54:12.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.472+0000 7faa01046780 1 < canceled part key=_multipart_GG02P21TFKIM.2~CF6R98AVSG3V.0 size=1048576 2024-09-14T10:54:12.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.473+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~CF6R98AVSG3V.1 size=1048576 2024-09-14T10:54:12.473 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.475+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~CF6R98AVSG3V.2 size=473195 2024-09-14T10:54:12.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.477+0000 7faa01046780 1 < canceled multipart upload key=GG02P21TFKIM upload=CF6R98AVSG3V tag=YLXK1ET8MK1E type=write size=3618923 2024-09-14T10:54:12.477 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.479+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=4OWXBRYKIJAK type=write size=760598 2024-09-14T10:54:12.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.480+0000 7faa01046780 1 < completed delete operation key=XH8GHY9YRGTP tag=XNJ943P3N4K2 type=del 2024-09-14T10:54:12.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.481+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=OIHL9DRCYLIB type=write size=688166 2024-09-14T10:54:12.482 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.483+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~VDBCSTSEVRQZ.0 size=293559 2024-09-14T10:54:12.484 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.485+0000 7faa01046780 1 < completed multipart upload key=GG02P21TFKIM upload=VDBCSTSEVRQZ tag=XV30YZ7XV59O type=write size=1342135 2024-09-14T10:54:12.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.487+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=5TX1UCOTNKEB type=write size=82138 2024-09-14T10:54:12.487 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.488+0000 7faa01046780 1 < completed delete operation key=LF41PL7DFSJI tag=GS0MLJKYOKLR type=del 2024-09-14T10:54:12.489 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.491+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~AAW17RXQFXR2.0 size=1048576 2024-09-14T10:54:12.490 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.492+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~AAW17RXQFXR2.1 size=869426 2024-09-14T10:54:12.490 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.492+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=AAW17RXQFXR2 tag=FALC00EI3FW6 type=write size=2966578 2024-09-14T10:54:12.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.494+0000 7faa01046780 1 < suggested update operation key=0OL3SF5IWDMH tag=P56IUG75BUZY type=del size=4100901 2024-09-14T10:54:12.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.496+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=SS1DGCIHPWW1 type=del size=3905165 2024-09-14T10:54:12.496 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.498+0000 7faa01046780 1 < completed delete operation key=NXIPG4HR9ZYY tag=SR5U6O8N23NN type=del 2024-09-14T10:54:12.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.499+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=LO4O88RZ1S7M type=write size=601253 2024-09-14T10:54:12.498 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.500+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=M1P7JHHLKGYM type=del 2024-09-14T10:54:12.500 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.501+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=8IZ02VLN5NNB type=del size=3534671 2024-09-14T10:54:12.501 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.503+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~OW1I57VKVRIB.0 size=1048576 2024-09-14T10:54:12.502 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.504+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~OW1I57VKVRIB.1 size=1048576 2024-09-14T10:54:12.504 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.505+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~OW1I57VKVRIB.2 size=1015228 2024-09-14T10:54:12.506 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.507+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=OW1I57VKVRIB tag=U1TI9LDRO5B0 type=write size=4160956 2024-09-14T10:54:12.507 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.509+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=BQKYUMFZTC8X type=write size=847809 2024-09-14T10:54:12.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.511+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~Y6ADTN74CZMN.0 size=515206 2024-09-14T10:54:12.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.512+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=Y6ADTN74CZMN tag=NL4L8RY2PE2M type=write size=1563782 2024-09-14T10:54:12.513 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.514+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~CZ48KZCA5DW0.0 size=1048576 2024-09-14T10:54:12.514 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.515+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~CZ48KZCA5DW0.1 size=713782 2024-09-14T10:54:12.515 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.515+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=CZ48KZCA5DW0 tag=ZZ2L73Q0XEOU type=write size=2810934 2024-09-14T10:54:12.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.518+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~6J2JXAVN8BAM.0 size=1048576 2024-09-14T10:54:12.517 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.519+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~6J2JXAVN8BAM.1 size=91356 2024-09-14T10:54:12.519 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.520+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=6J2JXAVN8BAM tag=I3TCP38TD9HR type=write size=2188508 2024-09-14T10:54:12.522 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.523+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~G6HYEOTWKUV6.0 size=1048576 2024-09-14T10:54:12.523 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.524+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~G6HYEOTWKUV6.1 size=1048576 2024-09-14T10:54:12.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.525+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~G6HYEOTWKUV6.2 size=440045 2024-09-14T10:54:12.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.525+0000 7faa01046780 1 > prepared multipart upload key=F06QWEOYNQX4 upload=G6HYEOTWKUV6 tag=P6G45A03OSZZ type=write size=3585773 2024-09-14T10:54:12.526 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.527+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~W4K028S1JS7X.0 size=1048576 2024-09-14T10:54:12.527 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.528+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~W4K028S1JS7X.1 size=411035 2024-09-14T10:54:12.529 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.531+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=W4K028S1JS7X tag=Y4Y0FGSUAJWF type=write size=2508187 2024-09-14T10:54:12.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.533+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~WK80RIZBENDU.0 size=1048576 2024-09-14T10:54:12.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.534+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~WK80RIZBENDU.1 size=850340 2024-09-14T10:54:12.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.534+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=WK80RIZBENDU tag=XLPYJZRRI7GF type=write size=2947492 2024-09-14T10:54:12.535 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.536+0000 7faa01046780 1 < completed write operation key=Y4CB0HIN0750 tag=TUS34WJ24TK4 type=write size=606771 2024-09-14T10:54:12.538 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.539+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~YXRJIQHBXEOO.0 size=1048576 2024-09-14T10:54:12.539 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.540+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~YXRJIQHBXEOO.1 size=448004 2024-09-14T10:54:12.539 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.540+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=YXRJIQHBXEOO tag=ERAW2AF2YCLA type=write size=2545156 2024-09-14T10:54:12.540 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.541+0000 7faa01046780 1 < completed delete operation key=PBRZNGSOLJ8E tag=NZKKPRRMWNM0 type=del 2024-09-14T10:54:12.543 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.544+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~2Y1TPV8YPCSV.0 size=976189 2024-09-14T10:54:12.543 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.544+0000 7faa01046780 1 > prepared multipart upload key=LF41PL7DFSJI upload=2Y1TPV8YPCSV tag=Z1ZU8AL2HXT6 type=write size=2024765 2024-09-14T10:54:12.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.545+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~O6F4VUTM45G5.0 size=1048576 2024-09-14T10:54:12.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.545+0000 7faa01046780 1 < canceled part key=_multipart_0XVVSUIOBQPL.2~O6F4VUTM45G5.1 size=1048576 2024-09-14T10:54:12.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.547+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~O6F4VUTM45G5.2 size=736599 2024-09-14T10:54:12.548 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.550+0000 7faa01046780 1 < canceled multipart upload key=0XVVSUIOBQPL upload=O6F4VUTM45G5 tag=0T320LXQEVQF type=write size=3882327 2024-09-14T10:54:12.551 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.552+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~BX4R6247CIV5.0 size=615892 2024-09-14T10:54:12.551 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.552+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=BX4R6247CIV5 tag=TKH5J068Z1AZ type=write size=1664468 2024-09-14T10:54:12.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.553+0000 7faa01046780 1 < completed delete operation key=3UEX0IPM4CPY tag=6B8HBR3K141E type=del 2024-09-14T10:54:12.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.556+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~2V6V1E403DJO.0 size=1048576 2024-09-14T10:54:12.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.558+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~2V6V1E403DJO.1 size=805862 2024-09-14T10:54:12.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.558+0000 7faa01046780 1 > prepared multipart upload key=PBRZNGSOLJ8E upload=2V6V1E403DJO tag=39EGZSBB18GW type=write size=2903014 2024-09-14T10:54:12.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.560+0000 7faa01046780 1 < completed delete operation key=X9DUVQBBLUTF tag=QUEPRWI9EPDA type=del 2024-09-14T10:54:12.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.560+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=U5T8JTFH0IHP type=write size=826719 2024-09-14T10:54:12.562 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.564+0000 7faa01046780 1 < suggested remove operation key=NXIPG4HR9ZYY tag=4OWXBRYKIJAK type=write 2024-09-14T10:54:12.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.565+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=4OE9USKJHI99 type=del size=1869120 2024-09-14T10:54:12.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.569+0000 7faa01046780 1 < suggested update operation key=Y4CB0HIN0750 tag=OIHL9DRCYLIB type=write size=688166 2024-09-14T10:54:12.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.572+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~HLBGHS3DK9NK.0 size=1048576 2024-09-14T10:54:12.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.572+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~HLBGHS3DK9NK.1 size=1044184 2024-09-14T10:54:12.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.572+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=HLBGHS3DK9NK tag=RH0UQ2OTXZWO type=write size=3141336 2024-09-14T10:54:12.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.575+0000 7faa01046780 1 < canceled operation key=PBRZNGSOLJ8E tag=5TX1UCOTNKEB type=write size=82138 2024-09-14T10:54:12.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.576+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~OX6VDC3XHGDC.0 size=820329 2024-09-14T10:54:12.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.576+0000 7faa01046780 1 > prepared multipart upload key=VIO703UXIJXV upload=OX6VDC3XHGDC tag=WU4R6IXR4P68 type=write size=1868905 2024-09-14T10:54:12.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.579+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~AAW17RXQFXR2.0 size=1048576 2024-09-14T10:54:12.579 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.580+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~AAW17RXQFXR2.1 size=869426 2024-09-14T10:54:12.581 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.582+0000 7faa01046780 1 < completed multipart upload key=S3BGVJ9N9S4P upload=AAW17RXQFXR2 tag=FALC00EI3FW6 type=write size=2966578 2024-09-14T10:54:12.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.584+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~F38ZSODE96G0.0 size=1048576 2024-09-14T10:54:12.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.585+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~F38ZSODE96G0.1 size=1048576 2024-09-14T10:54:12.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.586+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~F38ZSODE96G0.2 size=804034 2024-09-14T10:54:12.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.586+0000 7faa01046780 1 > prepared multipart upload key=X9DUVQBBLUTF upload=F38ZSODE96G0 tag=P01O9KKXE0F4 type=write size=3949762 2024-09-14T10:54:12.588 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.589+0000 7faa01046780 1 < suggested update operation key=F872GLVQDCX6 tag=SS1DGCIHPWW1 type=del size=3905165 2024-09-14T10:54:12.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.591+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=0H9XW7U32OV5 type=del size=3790813 2024-09-14T10:54:12.591 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.592+0000 7faa01046780 1 < completed write operation key=ZY0BY3G9NREC tag=LO4O88RZ1S7M type=write size=601253 2024-09-14T10:54:12.592 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.593+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=C756YPO3Q23R type=del size=3929465 2024-09-14T10:54:12.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.595+0000 7faa01046780 -1 < failed to complete operation key=F872GLVQDCX6 tag=8IZ02VLN5NNB type=del size=3534671: (22) Invalid argument 2024-09-14T10:54:12.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.596+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=TRROKE4JT91Z type=del size=3243250 2024-09-14T10:54:12.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.598+0000 7faa01046780 1 < completed write operation key=0OL3SF5IWDMH tag=BQKYUMFZTC8X type=write size=847809 2024-09-14T10:54:12.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.601+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~X8WVSM2SDU63.0 size=1048576 2024-09-14T10:54:12.601 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.602+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~X8WVSM2SDU63.1 size=237072 2024-09-14T10:54:12.601 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.602+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=X8WVSM2SDU63 tag=3PLY0ME3U19F type=write size=2334224 2024-09-14T10:54:12.602 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.603+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~CZ48KZCA5DW0.0 size=1048576 2024-09-14T10:54:12.603 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.605+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~CZ48KZCA5DW0.1 size=713782 2024-09-14T10:54:12.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.607+0000 7faa01046780 1 < completed multipart upload key=S3BGVJ9N9S4P upload=CZ48KZCA5DW0 tag=ZZ2L73Q0XEOU type=write size=2810934 2024-09-14T10:54:12.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.609+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~IKZU7CAARETU.0 size=1048576 2024-09-14T10:54:12.609 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.610+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~IKZU7CAARETU.1 size=1048576 2024-09-14T10:54:12.610 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.612+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~IKZU7CAARETU.2 size=177939 2024-09-14T10:54:12.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.612+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=IKZU7CAARETU tag=L6YKH6TEN4ZS type=write size=3323667 2024-09-14T10:54:12.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.614+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~G6HYEOTWKUV6.0 size=1048576 2024-09-14T10:54:12.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.614+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~G6HYEOTWKUV6.1 size=1048576 2024-09-14T10:54:12.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.616+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~G6HYEOTWKUV6.2 size=440045 2024-09-14T10:54:12.616 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.617+0000 7faa01046780 1 < completed multipart upload key=F06QWEOYNQX4 upload=G6HYEOTWKUV6 tag=P6G45A03OSZZ type=write size=3585773 2024-09-14T10:54:12.618 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.619+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=BQ2NYJQI4RGI type=del size=829607 2024-09-14T10:54:12.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.620+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~WK80RIZBENDU.0 size=1048576 2024-09-14T10:54:12.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.621+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~WK80RIZBENDU.1 size=850340 2024-09-14T10:54:12.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.624+0000 7faa01046780 1 < completed multipart upload key=0OL3SF5IWDMH upload=WK80RIZBENDU tag=XLPYJZRRI7GF type=write size=2947492 2024-09-14T10:54:12.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.625+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=A4FONK8DFVXI type=del size=181754 2024-09-14T10:54:12.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.627+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~YXRJIQHBXEOO.0 size=1048576 2024-09-14T10:54:12.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.628+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~YXRJIQHBXEOO.1 size=448004 2024-09-14T10:54:12.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.631+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=YXRJIQHBXEOO tag=ERAW2AF2YCLA type=write size=2545156 2024-09-14T10:54:12.630 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.632+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=XR3FNMU609JE type=del size=4004075 2024-09-14T10:54:12.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.633+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~2Y1TPV8YPCSV.0 size=976189 2024-09-14T10:54:12.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.635+0000 7faa01046780 1 < completed multipart upload key=LF41PL7DFSJI upload=2Y1TPV8YPCSV tag=Z1ZU8AL2HXT6 type=write size=2024765 2024-09-14T10:54:12.637 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.638+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~TPSWDE9D14DP.0 size=1048576 2024-09-14T10:54:12.638 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.639+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~TPSWDE9D14DP.1 size=1048576 2024-09-14T10:54:12.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.640+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~TPSWDE9D14DP.2 size=741065 2024-09-14T10:54:12.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.640+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=TPSWDE9D14DP tag=63REFS20NXOI type=write size=3886793 2024-09-14T10:54:12.640 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.641+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~BX4R6247CIV5.0 size=615892 2024-09-14T10:54:12.642 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.643+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=BX4R6247CIV5 tag=TKH5J068Z1AZ type=write size=1664468 2024-09-14T10:54:12.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.645+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=CHG35M1C22W8 type=del size=2703391 2024-09-14T10:54:12.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.646+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~2V6V1E403DJO.0 size=1048576 2024-09-14T10:54:12.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.647+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~2V6V1E403DJO.1 size=805862 2024-09-14T10:54:12.648 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.649+0000 7faa01046780 1 < completed multipart upload key=PBRZNGSOLJ8E upload=2V6V1E403DJO tag=39EGZSBB18GW type=write size=2903014 2024-09-14T10:54:12.651 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.652+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~4T2R3AGUQT5E.0 size=1048576 2024-09-14T10:54:12.652 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.654+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~4T2R3AGUQT5E.1 size=793736 2024-09-14T10:54:12.652 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.654+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=4T2R3AGUQT5E tag=HIPABFJKL3J3 type=write size=2890888 2024-09-14T10:54:12.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.654+0000 7faa01046780 1 < completed write operation key=0XVVSUIOBQPL tag=U5T8JTFH0IHP type=write size=826719 2024-09-14T10:54:12.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.658+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~LLTNA2UML4J4.0 size=402686 2024-09-14T10:54:12.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.658+0000 7faa01046780 1 > prepared multipart upload key=F872GLVQDCX6 upload=LLTNA2UML4J4 tag=8CHX3J2JX8L2 type=write size=1451262 2024-09-14T10:54:12.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.659+0000 7faa01046780 1 < completed delete operation key=PS2QU1UZUYHE tag=4OE9USKJHI99 type=del 2024-09-14T10:54:12.660 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.661+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~V2F4V5E8N5N6.0 size=1048576 2024-09-14T10:54:12.661 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.662+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~V2F4V5E8N5N6.1 size=1048576 2024-09-14T10:54:12.662 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.663+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~V2F4V5E8N5N6.2 size=879651 2024-09-14T10:54:12.662 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.663+0000 7faa01046780 1 > prepared multipart upload key=V11YJWHT4OOD upload=V2F4V5E8N5N6 tag=0CFR0HHEL4CU type=write size=4025379 2024-09-14T10:54:12.663 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.665+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~HLBGHS3DK9NK.0 size=1048576 2024-09-14T10:54:12.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.665+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~HLBGHS3DK9NK.1 size=1044184 2024-09-14T10:54:12.666 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.667+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=HLBGHS3DK9NK tag=RH0UQ2OTXZWO type=write size=3141336 2024-09-14T10:54:12.668 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.669+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=8BONT8TXZCCC type=del size=3103992 2024-09-14T10:54:12.669 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.670+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~OX6VDC3XHGDC.0 size=820329 2024-09-14T10:54:12.671 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.673+0000 7faa01046780 1 < completed multipart upload key=VIO703UXIJXV upload=OX6VDC3XHGDC tag=WU4R6IXR4P68 type=write size=1868905 2024-09-14T10:54:12.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.675+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=0DUA80PBQ9ED type=del size=1132710 2024-09-14T10:54:12.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.675+0000 7faa01046780 1 < canceled part key=_multipart_X9DUVQBBLUTF.2~F38ZSODE96G0.0 size=1048576 2024-09-14T10:54:12.674 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.675+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~F38ZSODE96G0.1 size=1048576 2024-09-14T10:54:12.675 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.677+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~F38ZSODE96G0.2 size=804034 2024-09-14T10:54:12.678 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.679+0000 7faa01046780 1 < canceled multipart upload key=X9DUVQBBLUTF upload=F38ZSODE96G0 tag=P01O9KKXE0F4 type=write size=3949762 2024-09-14T10:54:12.680 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.681+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~MG3GYFD32TEC.0 size=1048576 2024-09-14T10:54:12.685 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.682+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~MG3GYFD32TEC.1 size=822321 2024-09-14T10:54:12.686 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.682+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=MG3GYFD32TEC tag=P8FRH5N3M6JL type=write size=2919473 2024-09-14T10:54:12.686 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.684+0000 7faa01046780 1 < completed delete operation key=XH8GHY9YRGTP tag=0H9XW7U32OV5 type=del 2024-09-14T10:54:12.686 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.687+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~ZI3PUTJEYLOU.0 size=1048576 2024-09-14T10:54:12.686 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.687+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~ZI3PUTJEYLOU.1 size=1048576 2024-09-14T10:54:12.688 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.689+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~ZI3PUTJEYLOU.2 size=597728 2024-09-14T10:54:12.688 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.689+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=ZI3PUTJEYLOU tag=F4RKROIN0UKM type=write size=3743456 2024-09-14T10:54:12.690 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.691+0000 7faa01046780 1 < suggested update operation key=HYAGNAOWK8LF tag=C756YPO3Q23R type=del size=3929465 2024-09-14T10:54:12.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.694+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~6SS8IFF3Q12D.0 size=1048576 2024-09-14T10:54:12.694 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.695+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~6SS8IFF3Q12D.1 size=54219 2024-09-14T10:54:12.694 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.695+0000 7faa01046780 1 > prepared multipart upload key=SJ02N8472YDM upload=6SS8IFF3Q12D tag=HOUJUYJNY6W1 type=write size=2151371 2024-09-14T10:54:12.695 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.696+0000 7faa01046780 1 < completed delete operation key=0XVVSUIOBQPL tag=TRROKE4JT91Z type=del 2024-09-14T10:54:12.696 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.698+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=573Y0W95H4J1 type=del size=3056314 2024-09-14T10:54:12.697 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.698+0000 7faa01046780 1 < canceled part key=_multipart_NXIPG4HR9ZYY.2~X8WVSM2SDU63.0 size=1048576 2024-09-14T10:54:12.698 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.699+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~X8WVSM2SDU63.1 size=237072 2024-09-14T10:54:12.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.702+0000 7faa01046780 1 < canceled multipart upload key=NXIPG4HR9ZYY upload=X8WVSM2SDU63 tag=3PLY0ME3U19F type=write size=2334224 2024-09-14T10:54:12.702 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.704+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=JY06DIWAR27L type=del size=1222994 2024-09-14T10:54:12.702 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.704+0000 7faa01046780 1 < canceled part key=_multipart_PTDE6D7OIU1A.2~IKZU7CAARETU.0 size=1048576 2024-09-14T10:54:12.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.705+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~IKZU7CAARETU.1 size=1048576 2024-09-14T10:54:12.705 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.706+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~IKZU7CAARETU.2 size=177939 2024-09-14T10:54:12.707 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.708+0000 7faa01046780 1 < canceled multipart upload key=PTDE6D7OIU1A upload=IKZU7CAARETU tag=L6YKH6TEN4ZS type=write size=3323667 2024-09-14T10:54:12.708 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.710+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=GYQCBO8O3Y4F type=del size=3092468 2024-09-14T10:54:12.710 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.711+0000 7faa01046780 1 < completed delete operation key=PTDE6D7OIU1A tag=BQ2NYJQI4RGI type=del 2024-09-14T10:54:12.711 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.712+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=OOF7GFHK61D3 type=del size=3843106 2024-09-14T10:54:12.713 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.714+0000 7faa01046780 1 < completed delete operation key=KDUTH9PIR3FI tag=A4FONK8DFVXI type=del 2024-09-14T10:54:12.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.715+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=OPJUI3X1CAQ5 type=del size=2152472 2024-09-14T10:54:12.715 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.717+0000 7faa01046780 1 < completed delete operation key=BBDTPL35W4W0 tag=XR3FNMU609JE type=del 2024-09-14T10:54:12.718 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.719+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~XZNVMPB4WHJ2.0 size=1048576 2024-09-14T10:54:12.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.720+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~XZNVMPB4WHJ2.1 size=1048576 2024-09-14T10:54:12.720 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.721+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~XZNVMPB4WHJ2.2 size=254458 2024-09-14T10:54:12.720 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.721+0000 7faa01046780 1 > prepared multipart upload key=SJ02N8472YDM upload=XZNVMPB4WHJ2 tag=9MXKZPIMKDCH type=write size=3400186 2024-09-14T10:54:12.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.723+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~TPSWDE9D14DP.0 size=1048576 2024-09-14T10:54:12.722 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.724+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~TPSWDE9D14DP.1 size=1048576 2024-09-14T10:54:12.724 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.725+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~TPSWDE9D14DP.2 size=741065 2024-09-14T10:54:12.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.728+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=TPSWDE9D14DP tag=63REFS20NXOI type=write size=3886793 2024-09-14T10:54:12.728 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.730+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~4U011FFRAONB.0 size=838879 2024-09-14T10:54:12.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.730+0000 7faa01046780 1 > prepared multipart upload key=TDNQZ8Y1C6X2 upload=4U011FFRAONB tag=6J9MV9PD93FG type=write size=1887455 2024-09-14T10:54:12.730 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.731+0000 7faa01046780 1 < completed delete operation key=V11YJWHT4OOD tag=CHG35M1C22W8 type=del 2024-09-14T10:54:12.731 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.733+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=C9FVRDR9YWDP type=del size=977960 2024-09-14T10:54:12.733 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.734+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~4T2R3AGUQT5E.0 size=1048576 2024-09-14T10:54:12.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.735+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~4T2R3AGUQT5E.1 size=793736 2024-09-14T10:54:12.736 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.737+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=4T2R3AGUQT5E tag=HIPABFJKL3J3 type=write size=2890888 2024-09-14T10:54:12.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.739+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~Y7PDPJGREJ57.0 size=1048576 2024-09-14T10:54:12.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.740+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~Y7PDPJGREJ57.1 size=347396 2024-09-14T10:54:12.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.740+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=Y7PDPJGREJ57 tag=K29WNJNFXBVY type=write size=2444548 2024-09-14T10:54:12.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.742+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~LLTNA2UML4J4.0 size=402686 2024-09-14T10:54:12.743 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.744+0000 7faa01046780 1 < completed multipart upload key=F872GLVQDCX6 upload=LLTNA2UML4J4 tag=8CHX3J2JX8L2 type=write size=1451262 2024-09-14T10:54:12.745 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.746+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=PABX410NJ40P type=write size=455452 2024-09-14T10:54:12.746 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.747+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~V2F4V5E8N5N6.0 size=1048576 2024-09-14T10:54:12.747 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.748+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~V2F4V5E8N5N6.1 size=1048576 2024-09-14T10:54:12.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.749+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~V2F4V5E8N5N6.2 size=879651 2024-09-14T10:54:12.750 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.751+0000 7faa01046780 1 < completed multipart upload key=V11YJWHT4OOD upload=V2F4V5E8N5N6 tag=0CFR0HHEL4CU type=write size=4025379 2024-09-14T10:54:12.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.754+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~R96PHIT3NSQ0.0 size=734101 2024-09-14T10:54:12.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.754+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=R96PHIT3NSQ0 tag=KA8K3E9RMFZV type=write size=1782677 2024-09-14T10:54:12.754 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.755+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=8BONT8TXZCCC type=del 2024-09-14T10:54:12.757 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.759+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~5DA0M9Q84741.0 size=1048576 2024-09-14T10:54:12.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.759+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~5DA0M9Q84741.1 size=137727 2024-09-14T10:54:12.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.759+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=5DA0M9Q84741 tag=CHYK865NJZHE type=write size=2234879 2024-09-14T10:54:12.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.761+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=0DUA80PBQ9ED type=del 2024-09-14T10:54:12.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.762+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=40O8GEV80OLC type=del size=951984 2024-09-14T10:54:12.763 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.764+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~MG3GYFD32TEC.0 size=1048576 2024-09-14T10:54:12.763 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.764+0000 7faa01046780 1 < canceled part key=_multipart_HYAGNAOWK8LF.2~MG3GYFD32TEC.1 size=822321 2024-09-14T10:54:12.765 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.766+0000 7faa01046780 1 < canceled multipart upload key=HYAGNAOWK8LF upload=MG3GYFD32TEC tag=P8FRH5N3M6JL type=write size=2919473 2024-09-14T10:54:12.766 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.767+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=RGXAY5EIHCIB type=del size=1211015 2024-09-14T10:54:12.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.769+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~ZI3PUTJEYLOU.0 size=1048576 2024-09-14T10:54:12.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.770+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~ZI3PUTJEYLOU.1 size=1048576 2024-09-14T10:54:12.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.772+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~ZI3PUTJEYLOU.2 size=597728 2024-09-14T10:54:12.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.775+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=ZI3PUTJEYLOU tag=F4RKROIN0UKM type=write size=3743456 2024-09-14T10:54:12.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.777+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~2H5SPG08G6QB.0 size=1048576 2024-09-14T10:54:12.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.778+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~2H5SPG08G6QB.1 size=26744 2024-09-14T10:54:12.777 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.778+0000 7faa01046780 1 > prepared multipart upload key=SJ02N8472YDM upload=2H5SPG08G6QB tag=YYGLKXH5R0S8 type=write size=2123896 2024-09-14T10:54:12.777 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.778+0000 7faa01046780 1 < canceled part key=_multipart_SJ02N8472YDM.2~6SS8IFF3Q12D.0 size=1048576 2024-09-14T10:54:12.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.779+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~6SS8IFF3Q12D.1 size=54219 2024-09-14T10:54:12.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.782+0000 7faa01046780 1 < canceled multipart upload key=SJ02N8472YDM upload=6SS8IFF3Q12D tag=HOUJUYJNY6W1 type=write size=2151371 2024-09-14T10:54:12.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.784+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~V7EQI3YV64OR.0 size=1048576 2024-09-14T10:54:12.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.785+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~V7EQI3YV64OR.1 size=856950 2024-09-14T10:54:12.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.785+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=V7EQI3YV64OR tag=E69D6NTM9MWT type=write size=2954102 2024-09-14T10:54:12.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.788+0000 7faa01046780 1 < suggested remove operation key=XDJAK0XYQNF0 tag=573Y0W95H4J1 type=del 2024-09-14T10:54:12.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.790+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~J84YHSUE67UL.0 size=1048576 2024-09-14T10:54:12.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.791+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~J84YHSUE67UL.1 size=612713 2024-09-14T10:54:12.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.791+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=J84YHSUE67UL tag=U939IMGWG8TM type=write size=2709865 2024-09-14T10:54:12.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.793+0000 7faa01046780 1 < completed delete operation key=ZY0BY3G9NREC tag=JY06DIWAR27L type=del 2024-09-14T10:54:12.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.795+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~QT8CIL5UKKPX.0 size=619128 2024-09-14T10:54:12.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.795+0000 7faa01046780 1 > prepared multipart upload key=VIO703UXIJXV upload=QT8CIL5UKKPX tag=DAS6T3EW9WQ2 type=write size=1667704 2024-09-14T10:54:12.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.797+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=GYQCBO8O3Y4F type=del 2024-09-14T10:54:12.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.800+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~01PLK6YABWP1.0 size=1048576 2024-09-14T10:54:12.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.801+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~01PLK6YABWP1.1 size=713109 2024-09-14T10:54:12.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.801+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=01PLK6YABWP1 tag=0G1RTAAFWWEK type=write size=2810261 2024-09-14T10:54:12.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.802+0000 7faa01046780 1 < canceled operation key=ZY0BY3G9NREC tag=OOF7GFHK61D3 type=del size=3843106 2024-09-14T10:54:12.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.805+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~U3U0GMCO3DUW.0 size=718814 2024-09-14T10:54:12.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.805+0000 7faa01046780 1 > prepared multipart upload key=X9DUVQBBLUTF upload=U3U0GMCO3DUW tag=0O08FAVV1VZR type=write size=1767390 2024-09-14T10:54:12.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.808+0000 7faa01046780 1 < suggested remove operation key=XH8GHY9YRGTP tag=OPJUI3X1CAQ5 type=del 2024-09-14T10:54:12.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.810+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~R2M0FY442RZ5.0 size=985402 2024-09-14T10:54:12.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.810+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=R2M0FY442RZ5 tag=RPIGCIOEM5VS type=write size=2033978 2024-09-14T10:54:12.811 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.812+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~XZNVMPB4WHJ2.0 size=1048576 2024-09-14T10:54:12.812 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.813+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~XZNVMPB4WHJ2.1 size=1048576 2024-09-14T10:54:12.813 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.814+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~XZNVMPB4WHJ2.2 size=254458 2024-09-14T10:54:12.815 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.817+0000 7faa01046780 1 < completed multipart upload key=SJ02N8472YDM upload=XZNVMPB4WHJ2 tag=9MXKZPIMKDCH type=write size=3400186 2024-09-14T10:54:12.818 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.819+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~DWINX1NA8IDG.0 size=1048576 2024-09-14T10:54:12.819 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.820+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~DWINX1NA8IDG.1 size=1048576 2024-09-14T10:54:12.820 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.821+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~DWINX1NA8IDG.2 size=247294 2024-09-14T10:54:12.820 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.821+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=DWINX1NA8IDG tag=PFXIGYNM6TOV type=write size=3393022 2024-09-14T10:54:12.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.823+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~4U011FFRAONB.0 size=838879 2024-09-14T10:54:12.824 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.825+0000 7faa01046780 1 < completed multipart upload key=TDNQZ8Y1C6X2 upload=4U011FFRAONB tag=6J9MV9PD93FG type=write size=1887455 2024-09-14T10:54:12.827 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.828+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~4ZRJWSEJOQE2.0 size=1048576 2024-09-14T10:54:12.827 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.829+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~4ZRJWSEJOQE2.1 size=1048576 2024-09-14T10:54:12.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.831+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~4ZRJWSEJOQE2.2 size=953757 2024-09-14T10:54:12.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.831+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=4ZRJWSEJOQE2 tag=625DALLN52ZX type=write size=4099485 2024-09-14T10:54:12.831 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.832+0000 7faa01046780 1 < completed delete operation key=VIO703UXIJXV tag=C9FVRDR9YWDP type=del 2024-09-14T10:54:12.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.835+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~UM20RIK4ZPYO.0 size=1048576 2024-09-14T10:54:12.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.836+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~UM20RIK4ZPYO.1 size=524960 2024-09-14T10:54:12.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.836+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=UM20RIK4ZPYO tag=MMD10MOJJ1AC type=write size=2622112 2024-09-14T10:54:12.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.837+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~Y7PDPJGREJ57.0 size=1048576 2024-09-14T10:54:12.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.838+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~Y7PDPJGREJ57.1 size=347396 2024-09-14T10:54:12.839 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.841+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=Y7PDPJGREJ57 tag=K29WNJNFXBVY type=write size=2444548 2024-09-14T10:54:12.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.842+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=CYE3YJT7PWVJ type=write size=1007048 2024-09-14T10:54:12.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.843+0000 7faa01046780 1 < completed write operation key=V5T3AN9D7DH6 tag=PABX410NJ40P type=write size=455452 2024-09-14T10:54:12.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.846+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~UYHB4GAIQ585.0 size=1048576 2024-09-14T10:54:12.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.847+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~UYHB4GAIQ585.1 size=1048576 2024-09-14T10:54:12.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.848+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~UYHB4GAIQ585.2 size=728821 2024-09-14T10:54:12.847 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.848+0000 7faa01046780 1 > prepared multipart upload key=X9DUVQBBLUTF upload=UYHB4GAIQ585 tag=C14Z010RU8XS type=write size=3874549 2024-09-14T10:54:12.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.849+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~R96PHIT3NSQ0.0 size=734101 2024-09-14T10:54:12.850 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.852+0000 7faa01046780 1 < completed multipart upload key=V5T3AN9D7DH6 upload=R96PHIT3NSQ0 tag=KA8K3E9RMFZV type=write size=1782677 2024-09-14T10:54:12.853 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.855+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~VZZ7IE5R9XFZ.0 size=1048576 2024-09-14T10:54:12.854 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.855+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~VZZ7IE5R9XFZ.1 size=1048576 2024-09-14T10:54:12.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.856+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~VZZ7IE5R9XFZ.2 size=146976 2024-09-14T10:54:12.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.856+0000 7faa01046780 1 > prepared multipart upload key=FOJGGEQZD7YW upload=VZZ7IE5R9XFZ tag=88Z694TFCSZI type=write size=3292704 2024-09-14T10:54:12.856 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.857+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~5DA0M9Q84741.0 size=1048576 2024-09-14T10:54:12.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.859+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~5DA0M9Q84741.1 size=137727 2024-09-14T10:54:12.860 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.862+0000 7faa01046780 1 < completed multipart upload key=0XVVSUIOBQPL upload=5DA0M9Q84741 tag=CHYK865NJZHE type=write size=2234879 2024-09-14T10:54:12.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.863+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=IVHN9AKLP070 type=del size=122818 2024-09-14T10:54:12.864 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.866+0000 7faa01046780 1 < suggested update operation key=X9DUVQBBLUTF tag=40O8GEV80OLC type=del size=951984 2024-09-14T10:54:12.865 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.867+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=HYYTJL6FG1JT type=del size=2435081 2024-09-14T10:54:12.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.868+0000 7faa01046780 1 < completed delete operation key=PS2QU1UZUYHE tag=RGXAY5EIHCIB type=del 2024-09-14T10:54:12.868 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.869+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=00ENULQ9ANMQ type=del size=3108673 2024-09-14T10:54:12.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.871+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~2H5SPG08G6QB.0 size=1048576 2024-09-14T10:54:12.870 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.872+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~2H5SPG08G6QB.1 size=26744 2024-09-14T10:54:12.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.874+0000 7faa01046780 1 < completed multipart upload key=SJ02N8472YDM upload=2H5SPG08G6QB tag=YYGLKXH5R0S8 type=write size=2123896 2024-09-14T10:54:12.874 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.876+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=T4NDQ4BYWVZR type=write size=770006 2024-09-14T10:54:12.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.877+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~V7EQI3YV64OR.0 size=1048576 2024-09-14T10:54:12.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.879+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~V7EQI3YV64OR.1 size=856950 2024-09-14T10:54:12.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.881+0000 7faa01046780 1 < completed multipart upload key=U8TE0XNK9YKM upload=V7EQI3YV64OR tag=E69D6NTM9MWT type=write size=2954102 2024-09-14T10:54:12.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.883+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~NDNCDM1VL9CI.0 size=389278 2024-09-14T10:54:12.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.883+0000 7faa01046780 1 > prepared multipart upload key=F06QWEOYNQX4 upload=NDNCDM1VL9CI tag=K0YB6XJYFW1Y type=write size=1437854 2024-09-14T10:54:12.884 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.885+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~J84YHSUE67UL.0 size=1048576 2024-09-14T10:54:12.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.886+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~J84YHSUE67UL.1 size=612713 2024-09-14T10:54:12.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.889+0000 7faa01046780 1 < completed multipart upload key=V5T3AN9D7DH6 upload=J84YHSUE67UL tag=U939IMGWG8TM type=write size=2709865 2024-09-14T10:54:12.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.890+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=Z50CFOIEYOGM type=del size=2177869 2024-09-14T10:54:12.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.892+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~QT8CIL5UKKPX.0 size=619128 2024-09-14T10:54:12.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.894+0000 7faa01046780 1 < completed multipart upload key=VIO703UXIJXV upload=QT8CIL5UKKPX tag=DAS6T3EW9WQ2 type=write size=1667704 2024-09-14T10:54:12.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.897+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~3DG4WT5Z2MGR.0 size=1048576 2024-09-14T10:54:12.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.898+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~3DG4WT5Z2MGR.1 size=1047442 2024-09-14T10:54:12.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.898+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=3DG4WT5Z2MGR tag=O97FBL10QC60 type=write size=3144594 2024-09-14T10:54:12.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.898+0000 7faa01046780 1 < canceled part key=_multipart_V905BR1VWUCV.2~01PLK6YABWP1.0 size=1048576 2024-09-14T10:54:12.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.898+0000 7faa01046780 1 < canceled part key=_multipart_V905BR1VWUCV.2~01PLK6YABWP1.1 size=713109 2024-09-14T10:54:12.899 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.900+0000 7faa01046780 1 < canceled multipart upload key=V905BR1VWUCV upload=01PLK6YABWP1 tag=0G1RTAAFWWEK type=write size=2810261 2024-09-14T10:54:12.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.902+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=YNZZFOYU9VZ9 type=del size=1385672 2024-09-14T10:54:12.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.904+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~U3U0GMCO3DUW.0 size=718814 2024-09-14T10:54:12.905 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.906+0000 7faa01046780 1 < completed multipart upload key=X9DUVQBBLUTF upload=U3U0GMCO3DUW tag=0O08FAVV1VZR type=write size=1767390 2024-09-14T10:54:12.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.908+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=7IT4V7TG26UO type=del size=1010330 2024-09-14T10:54:12.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.910+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~R2M0FY442RZ5.0 size=985402 2024-09-14T10:54:12.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.912+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=R2M0FY442RZ5 tag=RPIGCIOEM5VS type=write size=2033978 2024-09-14T10:54:12.914 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.915+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~K7D6BYMK62WC.0 size=588199 2024-09-14T10:54:12.914 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.915+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=K7D6BYMK62WC tag=ODSV960N00Q2 type=write size=1636775 2024-09-14T10:54:12.915 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.917+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~DWINX1NA8IDG.0 size=1048576 2024-09-14T10:54:12.916 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.917+0000 7faa01046780 1 < canceled part key=_multipart_V905BR1VWUCV.2~DWINX1NA8IDG.1 size=1048576 2024-09-14T10:54:12.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.918+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~DWINX1NA8IDG.2 size=247294 2024-09-14T10:54:12.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.920+0000 7faa01046780 1 < canceled multipart upload key=V905BR1VWUCV upload=DWINX1NA8IDG tag=PFXIGYNM6TOV type=write size=3393022 2024-09-14T10:54:12.922 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.924+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~AYSFQO4024T2.0 size=1048576 2024-09-14T10:54:12.923 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.925+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~AYSFQO4024T2.1 size=1048576 2024-09-14T10:54:12.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.925+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~AYSFQO4024T2.2 size=162925 2024-09-14T10:54:12.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.925+0000 7faa01046780 1 > prepared multipart upload key=LF41PL7DFSJI upload=AYSFQO4024T2 tag=HW04MI5JHWD1 type=write size=3308653 2024-09-14T10:54:12.925 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.926+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~4ZRJWSEJOQE2.0 size=1048576 2024-09-14T10:54:12.926 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.928+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~4ZRJWSEJOQE2.1 size=1048576 2024-09-14T10:54:12.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.929+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~4ZRJWSEJOQE2.2 size=953757 2024-09-14T10:54:12.930 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.931+0000 7faa01046780 1 < completed multipart upload key=0OL3SF5IWDMH upload=4ZRJWSEJOQE2 tag=625DALLN52ZX type=write size=4099485 2024-09-14T10:54:12.932 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.933+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=EMM6L0QLUZHJ type=del size=1467793 2024-09-14T10:54:12.933 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.934+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~UM20RIK4ZPYO.0 size=1048576 2024-09-14T10:54:12.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.936+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~UM20RIK4ZPYO.1 size=524960 2024-09-14T10:54:12.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.938+0000 7faa01046780 1 < completed multipart upload key=KDUTH9PIR3FI upload=UM20RIK4ZPYO tag=MMD10MOJJ1AC type=write size=2622112 2024-09-14T10:54:12.939 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.941+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~ROT1ZHXI3SPJ.0 size=1048576 2024-09-14T10:54:12.940 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.942+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~ROT1ZHXI3SPJ.1 size=648046 2024-09-14T10:54:12.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.942+0000 7faa01046780 1 > prepared multipart upload key=TDNQZ8Y1C6X2 upload=ROT1ZHXI3SPJ tag=K39NCB5GY1W5 type=write size=2745198 2024-09-14T10:54:12.942 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.943+0000 7faa01046780 1 < completed write operation key=0XVVSUIOBQPL tag=CYE3YJT7PWVJ type=write size=1007048 2024-09-14T10:54:12.943 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.945+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=FLXN8C23E6TC type=del size=2825088 2024-09-14T10:54:12.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.946+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~UYHB4GAIQ585.0 size=1048576 2024-09-14T10:54:12.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.947+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~UYHB4GAIQ585.1 size=1048576 2024-09-14T10:54:12.947 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.949+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~UYHB4GAIQ585.2 size=728821 2024-09-14T10:54:12.950 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.951+0000 7faa01046780 1 < completed multipart upload key=X9DUVQBBLUTF upload=UYHB4GAIQ585 tag=C14Z010RU8XS type=write size=3874549 2024-09-14T10:54:12.952 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.953+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=3FOXJ64NTJIN type=del size=828145 2024-09-14T10:54:12.953 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.954+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~VZZ7IE5R9XFZ.0 size=1048576 2024-09-14T10:54:12.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.956+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~VZZ7IE5R9XFZ.1 size=1048576 2024-09-14T10:54:12.956 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.957+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~VZZ7IE5R9XFZ.2 size=146976 2024-09-14T10:54:12.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.959+0000 7faa01046780 1 < completed multipart upload key=FOJGGEQZD7YW upload=VZZ7IE5R9XFZ tag=88Z694TFCSZI type=write size=3292704 2024-09-14T10:54:12.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.961+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=5ONMROPFOAJ3 type=write size=494611 2024-09-14T10:54:12.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.963+0000 7faa01046780 1 < canceled operation key=TDNQZ8Y1C6X2 tag=IVHN9AKLP070 type=del size=122818 2024-09-14T10:54:12.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.964+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=23GI0NZRC2X8 type=del size=3740166 2024-09-14T10:54:12.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.965+0000 7faa01046780 1 < completed delete operation key=V11YJWHT4OOD tag=HYYTJL6FG1JT type=del 2024-09-14T10:54:12.965 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.967+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=7R0MLW1X1SBC type=del size=2400751 2024-09-14T10:54:12.968 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.970+0000 7faa01046780 1 < suggested remove operation key=Q33ET1AN14NG tag=00ENULQ9ANMQ type=del 2024-09-14T10:54:12.970 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.971+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=03M2E5EN14U9 type=del size=901090 2024-09-14T10:54:12.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.973+0000 7faa01046780 1 < completed write operation key=F872GLVQDCX6 tag=T4NDQ4BYWVZR type=write size=770006 2024-09-14T10:54:12.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.976+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~2CY2R94SLOPV.0 size=1048576 2024-09-14T10:54:12.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.976+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~2CY2R94SLOPV.1 size=483201 2024-09-14T10:54:12.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.976+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=2CY2R94SLOPV tag=8CEJLC8KCSRI type=write size=2580353 2024-09-14T10:54:12.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.978+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~NDNCDM1VL9CI.0 size=389278 2024-09-14T10:54:12.978 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.980+0000 7faa01046780 1 < completed multipart upload key=F06QWEOYNQX4 upload=NDNCDM1VL9CI tag=K0YB6XJYFW1Y type=write size=1437854 2024-09-14T10:54:12.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.981+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=2PZ4CIPYHIBJ type=del size=3261069 2024-09-14T10:54:12.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.983+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=Z50CFOIEYOGM type=del 2024-09-14T10:54:12.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.985+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~FE89XA11XXQG.0 size=1038376 2024-09-14T10:54:12.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.985+0000 7faa01046780 1 > prepared multipart upload key=X9DUVQBBLUTF upload=FE89XA11XXQG tag=KO1SSGJOZXCK type=write size=2086952 2024-09-14T10:54:12.985 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.987+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~3DG4WT5Z2MGR.0 size=1048576 2024-09-14T10:54:12.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.988+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~3DG4WT5Z2MGR.1 size=1047442 2024-09-14T10:54:12.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.990+0000 7faa01046780 1 < completed multipart upload key=U8TE0XNK9YKM upload=3DG4WT5Z2MGR tag=O97FBL10QC60 type=write size=3144594 2024-09-14T10:54:12.990 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.991+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=4JCVY3F3T29Y type=write size=632957 2024-09-14T10:54:12.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.992+0000 7faa01046780 1 < completed delete operation key=U8TE0XNK9YKM tag=YNZZFOYU9VZ9 type=del 2024-09-14T10:54:12.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.995+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~LOX5TVG2V2LG.0 size=825328 2024-09-14T10:54:12.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.995+0000 7faa01046780 1 > prepared multipart upload key=V11YJWHT4OOD upload=LOX5TVG2V2LG tag=ZFMPS2FID8S6 type=write size=1873904 2024-09-14T10:54:12.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.995+0000 7faa01046780 -1 < no bi entry to suggest for operation key=Q33ET1AN14NG tag=7IT4V7TG26UO type=del size=1010330: (2) No such file or directory 2024-09-14T10:54:12.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.997+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=NUTZ97KDEQJI type=write size=552069 2024-09-14T10:54:12.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:12.998+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~K7D6BYMK62WC.0 size=588199 2024-09-14T10:54:12.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.000+0000 7faa01046780 1 < completed multipart upload key=Y4CB0HIN0750 upload=K7D6BYMK62WC tag=ODSV960N00Q2 type=write size=1636775 2024-09-14T10:54:13.000 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.001+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=OQJE88EXZ0AC type=del size=948281 2024-09-14T10:54:13.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.003+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~AYSFQO4024T2.0 size=1048576 2024-09-14T10:54:13.002 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.004+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~AYSFQO4024T2.1 size=1048576 2024-09-14T10:54:13.004 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.005+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~AYSFQO4024T2.2 size=162925 2024-09-14T10:54:13.006 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.007+0000 7faa01046780 1 < completed multipart upload key=LF41PL7DFSJI upload=AYSFQO4024T2 tag=HW04MI5JHWD1 type=write size=3308653 2024-09-14T10:54:13.007 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.008+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=PJR8APEP5WP0 type=write size=185025 2024-09-14T10:54:13.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.010+0000 7faa01046780 1 < completed delete operation key=BBDTPL35W4W0 tag=EMM6L0QLUZHJ type=del 2024-09-14T10:54:13.010 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.011+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=UJH01PQQ4OLI type=write size=72424 2024-09-14T10:54:13.011 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.013+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~ROT1ZHXI3SPJ.0 size=1048576 2024-09-14T10:54:13.012 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.014+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~ROT1ZHXI3SPJ.1 size=648046 2024-09-14T10:54:13.015 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.016+0000 7faa01046780 1 < completed multipart upload key=TDNQZ8Y1C6X2 upload=ROT1ZHXI3SPJ tag=K39NCB5GY1W5 type=write size=2745198 2024-09-14T10:54:13.021 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.022+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~D0HKC368WJBU.0 size=486217 2024-09-14T10:54:13.021 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.022+0000 7faa01046780 1 > prepared multipart upload key=VIO703UXIJXV upload=D0HKC368WJBU tag=L9BEM5SH358X type=write size=1534793 2024-09-14T10:54:13.023 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.024+0000 7faa01046780 1 < canceled operation key=XDJAK0XYQNF0 tag=FLXN8C23E6TC type=del size=2825088 2024-09-14T10:54:13.024 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.025+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=OU3HE5ZE3ZTB type=del size=2980765 2024-09-14T10:54:13.026 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.027+0000 7faa01046780 1 < completed delete operation key=KDUTH9PIR3FI tag=3FOXJ64NTJIN type=del 2024-09-14T10:54:13.028 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.029+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~9Z7M4A5RSVZ5.0 size=1048576 2024-09-14T10:54:13.029 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.030+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~9Z7M4A5RSVZ5.1 size=1048576 2024-09-14T10:54:13.030 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.031+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~9Z7M4A5RSVZ5.2 size=49182 2024-09-14T10:54:13.030 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.031+0000 7faa01046780 1 > prepared multipart upload key=X9DUVQBBLUTF upload=9Z7M4A5RSVZ5 tag=QATSPHBW0SQG type=write size=3194910 2024-09-14T10:54:13.031 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.032+0000 7faa01046780 1 < completed write operation key=F06QWEOYNQX4 tag=5ONMROPFOAJ3 type=write size=494611 2024-09-14T10:54:13.032 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.034+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=MQ6NBUZRD19H type=del size=2143018 2024-09-14T10:54:13.034 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.035+0000 7faa01046780 1 < completed delete operation key=0OL3SF5IWDMH tag=23GI0NZRC2X8 type=del 2024-09-14T10:54:13.036 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.037+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=D9QVCVV2AXZP type=del size=3570852 2024-09-14T10:54:13.037 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.038+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=7R0MLW1X1SBC type=del 2024-09-14T10:54:13.040 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.041+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~9M6UKHNX4LH2.0 size=1048576 2024-09-14T10:54:13.041 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.042+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~9M6UKHNX4LH2.1 size=87579 2024-09-14T10:54:13.041 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.042+0000 7faa01046780 1 > prepared multipart upload key=VIO703UXIJXV upload=9M6UKHNX4LH2 tag=FSJFGTZQ3CYV type=write size=2184731 2024-09-14T10:54:13.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.044+0000 7faa01046780 1 < completed delete operation key=3UEX0IPM4CPY tag=03M2E5EN14U9 type=del 2024-09-14T10:54:13.046 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.047+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~3GXLH60VIBSN.0 size=1048576 2024-09-14T10:54:13.046 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.048+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~3GXLH60VIBSN.1 size=80116 2024-09-14T10:54:13.047 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.048+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=3GXLH60VIBSN tag=G6Z32UFMG06C type=write size=2177268 2024-09-14T10:54:13.048 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.049+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~2CY2R94SLOPV.0 size=1048576 2024-09-14T10:54:13.049 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.051+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~2CY2R94SLOPV.1 size=483201 2024-09-14T10:54:13.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.053+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=2CY2R94SLOPV tag=8CEJLC8KCSRI type=write size=2580353 2024-09-14T10:54:13.055 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.056+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~PZSTPSN7EF8B.0 size=934068 2024-09-14T10:54:13.055 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.056+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=PZSTPSN7EF8B tag=DN00LTLQ9HC4 type=write size=1982644 2024-09-14T10:54:13.058 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.059+0000 7faa01046780 1 < suggested update operation key=HUBZAFMSCCNC tag=2PZ4CIPYHIBJ type=del size=3261069 2024-09-14T10:54:13.059 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.061+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=TJNIE458S3C6 type=write size=194292 2024-09-14T10:54:13.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.061+0000 7faa01046780 1 < canceled part key=_multipart_X9DUVQBBLUTF.2~FE89XA11XXQG.0 size=1038376 2024-09-14T10:54:13.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.064+0000 7faa01046780 1 < canceled multipart upload key=X9DUVQBBLUTF upload=FE89XA11XXQG tag=KO1SSGJOZXCK type=write size=2086952 2024-09-14T10:54:13.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.065+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=AHHD09VMXKLD type=del size=418467 2024-09-14T10:54:13.066 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.067+0000 7faa01046780 1 < completed write operation key=F06QWEOYNQX4 tag=4JCVY3F3T29Y type=write size=632957 2024-09-14T10:54:13.068 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.069+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=JUGDN3U52NS4 type=del size=3643947 2024-09-14T10:54:13.069 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.070+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~LOX5TVG2V2LG.0 size=825328 2024-09-14T10:54:13.072 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.073+0000 7faa01046780 1 < completed multipart upload key=V11YJWHT4OOD upload=LOX5TVG2V2LG tag=ZFMPS2FID8S6 type=write size=1873904 2024-09-14T10:54:13.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.076+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~2S9TMZAVI27T.0 size=1048576 2024-09-14T10:54:13.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.078+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~2S9TMZAVI27T.1 size=772495 2024-09-14T10:54:13.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.078+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=2S9TMZAVI27T tag=7U8WYVFDNY95 type=write size=2869647 2024-09-14T10:54:13.077 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.080+0000 7faa01046780 1 < completed write operation key=CKMDOO75UZGE tag=NUTZ97KDEQJI type=write size=552069 2024-09-14T10:54:13.081 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.082+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~1ZWS4GCR0820.0 size=1048576 2024-09-14T10:54:13.082 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.083+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~1ZWS4GCR0820.1 size=1048576 2024-09-14T10:54:13.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.084+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~1ZWS4GCR0820.2 size=780050 2024-09-14T10:54:13.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.084+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=1ZWS4GCR0820 tag=RGAYEDDXDL6E type=write size=3925778 2024-09-14T10:54:13.086 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.088+0000 7faa01046780 1 < suggested remove operation key=V11YJWHT4OOD tag=OQJE88EXZ0AC type=del 2024-09-14T10:54:13.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.090+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~IB30QYD854IW.0 size=745891 2024-09-14T10:54:13.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.090+0000 7faa01046780 1 > prepared multipart upload key=VIO703UXIJXV upload=IB30QYD854IW tag=Y9IDCMCGEANZ type=write size=1794467 2024-09-14T10:54:13.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.091+0000 7faa01046780 1 < completed write operation key=Q33ET1AN14NG tag=PJR8APEP5WP0 type=write size=185025 2024-09-14T10:54:13.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.092+0000 7faa01046780 1 > prepared operation key=SJ02N8472YDM tag=13RGARUP8YIY type=del size=2417420 2024-09-14T10:54:13.093 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.094+0000 7faa01046780 1 < completed write operation key=V5T3AN9D7DH6 tag=UJH01PQQ4OLI type=write size=72424 2024-09-14T10:54:13.095 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.096+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~5VJ3B1UUZCDR.0 size=122399 2024-09-14T10:54:13.095 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.096+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=5VJ3B1UUZCDR tag=JA8IG7SCOHWC type=write size=1170975 2024-09-14T10:54:13.096 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.097+0000 7faa01046780 1 < canceled part key=_multipart_VIO703UXIJXV.2~D0HKC368WJBU.0 size=486217 2024-09-14T10:54:13.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.100+0000 7faa01046780 1 < canceled multipart upload key=VIO703UXIJXV upload=D0HKC368WJBU tag=L9BEM5SH358X type=write size=1534793 2024-09-14T10:54:13.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.101+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=NCYZWS5F557L type=del size=3808927 2024-09-14T10:54:13.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.103+0000 7faa01046780 1 < completed delete operation key=PS2QU1UZUYHE tag=OU3HE5ZE3ZTB type=del 2024-09-14T10:54:13.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.104+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=N221U6NC847N type=del size=3575348 2024-09-14T10:54:13.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.105+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~9Z7M4A5RSVZ5.0 size=1048576 2024-09-14T10:54:13.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.107+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~9Z7M4A5RSVZ5.1 size=1048576 2024-09-14T10:54:13.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.108+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~9Z7M4A5RSVZ5.2 size=49182 2024-09-14T10:54:13.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.110+0000 7faa01046780 1 < completed multipart upload key=X9DUVQBBLUTF upload=9Z7M4A5RSVZ5 tag=QATSPHBW0SQG type=write size=3194910 2024-09-14T10:54:13.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.111+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=43KHSVVFU4B6 type=del size=407983 2024-09-14T10:54:13.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.112+0000 7faa01046780 -1 < failed to complete operation key=HUBZAFMSCCNC tag=MQ6NBUZRD19H type=del size=2143018: (22) Invalid argument 2024-09-14T10:54:13.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.115+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~2UFJWA07IXSK.0 size=1048576 2024-09-14T10:54:13.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.116+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~2UFJWA07IXSK.1 size=955354 2024-09-14T10:54:13.115 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.116+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=2UFJWA07IXSK tag=3S6YBM1SZ331 type=write size=3052506 2024-09-14T10:54:13.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.117+0000 7faa01046780 1 < completed delete operation key=0XVVSUIOBQPL tag=D9QVCVV2AXZP type=del 2024-09-14T10:54:13.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.119+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=3T0JJZAW33PU type=del size=3262085 2024-09-14T10:54:13.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.120+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~9M6UKHNX4LH2.0 size=1048576 2024-09-14T10:54:13.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.121+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~9M6UKHNX4LH2.1 size=87579 2024-09-14T10:54:13.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.123+0000 7faa01046780 1 < completed multipart upload key=VIO703UXIJXV upload=9M6UKHNX4LH2 tag=FSJFGTZQ3CYV type=write size=2184731 2024-09-14T10:54:13.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.126+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~5880P85FZ72W.0 size=1048576 2024-09-14T10:54:13.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.127+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~5880P85FZ72W.1 size=1048576 2024-09-14T10:54:13.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.128+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~5880P85FZ72W.2 size=847726 2024-09-14T10:54:13.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.128+0000 7faa01046780 1 > prepared multipart upload key=3UEX0IPM4CPY upload=5880P85FZ72W tag=EO6I9ULCO60I type=write size=3993454 2024-09-14T10:54:13.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.130+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~3GXLH60VIBSN.0 size=1048576 2024-09-14T10:54:13.129 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.131+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~3GXLH60VIBSN.1 size=80116 2024-09-14T10:54:13.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.133+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=3GXLH60VIBSN tag=G6Z32UFMG06C type=write size=2177268 2024-09-14T10:54:13.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.135+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=8SYDLYF1RPAM type=del size=594856 2024-09-14T10:54:13.135 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.136+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~PZSTPSN7EF8B.0 size=934068 2024-09-14T10:54:13.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.139+0000 7faa01046780 1 < completed multipart upload key=KDUTH9PIR3FI upload=PZSTPSN7EF8B tag=DN00LTLQ9HC4 type=write size=1982644 2024-09-14T10:54:13.139 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.140+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=NKZZFH9NPAPL type=del size=3365334 2024-09-14T10:54:13.140 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.141+0000 7faa01046780 1 < completed write operation key=0OL3SF5IWDMH tag=TJNIE458S3C6 type=write size=194292 2024-09-14T10:54:13.141 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.142+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=IPMT8VVMUGCU type=del size=181057 2024-09-14T10:54:13.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.144+0000 7faa01046780 1 < canceled operation key=Y4CB0HIN0750 tag=AHHD09VMXKLD type=del size=418467 2024-09-14T10:54:13.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.145+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=MU4EJG6CAI4Q type=del size=610204 2024-09-14T10:54:13.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.147+0000 7faa01046780 1 < completed delete operation key=PTDE6D7OIU1A tag=JUGDN3U52NS4 type=del 2024-09-14T10:54:13.148 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.149+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~LJEGOV9D92FB.0 size=1048576 2024-09-14T10:54:13.149 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.150+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~LJEGOV9D92FB.1 size=221116 2024-09-14T10:54:13.149 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.150+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=LJEGOV9D92FB tag=3R9J9UZ24D4C type=write size=2318268 2024-09-14T10:54:13.150 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.151+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~2S9TMZAVI27T.0 size=1048576 2024-09-14T10:54:13.151 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.152+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~2S9TMZAVI27T.1 size=772495 2024-09-14T10:54:13.153 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.155+0000 7faa01046780 1 < completed multipart upload key=0XVVSUIOBQPL upload=2S9TMZAVI27T tag=7U8WYVFDNY95 type=write size=2869647 2024-09-14T10:54:13.156 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.158+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~61YS995VQWZY.0 size=1048576 2024-09-14T10:54:13.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.159+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~61YS995VQWZY.1 size=1048576 2024-09-14T10:54:13.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.160+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~61YS995VQWZY.2 size=196785 2024-09-14T10:54:13.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.160+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=61YS995VQWZY tag=O8N4NSUCCE34 type=write size=3342513 2024-09-14T10:54:13.160 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.161+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~1ZWS4GCR0820.0 size=1048576 2024-09-14T10:54:13.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.162+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~1ZWS4GCR0820.1 size=1048576 2024-09-14T10:54:13.163 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.164+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~1ZWS4GCR0820.2 size=780050 2024-09-14T10:54:13.165 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.166+0000 7faa01046780 1 < completed multipart upload key=0XVVSUIOBQPL upload=1ZWS4GCR0820 tag=RGAYEDDXDL6E type=write size=3925778 2024-09-14T10:54:13.167 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.168+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=K6M51UNPU09J type=del size=1623513 2024-09-14T10:54:13.169 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.170+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~IB30QYD854IW.0 size=745891 2024-09-14T10:54:13.171 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.173+0000 7faa01046780 1 < completed multipart upload key=VIO703UXIJXV upload=IB30QYD854IW tag=Y9IDCMCGEANZ type=write size=1794467 2024-09-14T10:54:13.173 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.175+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=BWOEBG96MSRW type=del size=1040088 2024-09-14T10:54:13.174 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.175+0000 7faa01046780 1 < completed delete operation key=SJ02N8472YDM tag=13RGARUP8YIY type=del 2024-09-14T10:54:13.177 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.178+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~29JN6Q8GP86F.0 size=73331 2024-09-14T10:54:13.177 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.178+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=29JN6Q8GP86F tag=P58R8X2OACT2 type=write size=1121907 2024-09-14T10:54:13.178 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.180+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~5VJ3B1UUZCDR.0 size=122399 2024-09-14T10:54:13.181 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.183+0000 7faa01046780 1 < completed multipart upload key=KDUTH9PIR3FI upload=5VJ3B1UUZCDR tag=JA8IG7SCOHWC type=write size=1170975 2024-09-14T10:54:13.184 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.185+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~14RJK9OQ5WAL.0 size=1048576 2024-09-14T10:54:13.185 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.186+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~14RJK9OQ5WAL.1 size=121666 2024-09-14T10:54:13.185 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.186+0000 7faa01046780 1 > prepared multipart upload key=TDNQZ8Y1C6X2 upload=14RJK9OQ5WAL tag=Q6E9JOO11ZM4 type=write size=2218818 2024-09-14T10:54:13.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.188+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=NCYZWS5F557L type=del 2024-09-14T10:54:13.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.190+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~4G077I4FCYKL.0 size=1048576 2024-09-14T10:54:13.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.191+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~4G077I4FCYKL.1 size=142814 2024-09-14T10:54:13.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.191+0000 7faa01046780 1 > prepared multipart upload key=F872GLVQDCX6 upload=4G077I4FCYKL tag=98J2XA9XB1V9 type=write size=2239966 2024-09-14T10:54:13.194 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.195+0000 7faa01046780 1 < suggested remove operation key=X9DUVQBBLUTF tag=N221U6NC847N type=del 2024-09-14T10:54:13.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.196+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=VIC25EI1DSW0 type=del size=1842400 2024-09-14T10:54:13.199 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.200+0000 7faa01046780 1 < suggested remove operation key=0XVVSUIOBQPL tag=43KHSVVFU4B6 type=del 2024-09-14T10:54:13.200 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.201+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=D0O2OF8EZ8ZS type=del size=2701342 2024-09-14T10:54:13.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.203+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~2UFJWA07IXSK.0 size=1048576 2024-09-14T10:54:13.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.203+0000 7faa01046780 1 < canceled part key=_multipart_PTDE6D7OIU1A.2~2UFJWA07IXSK.1 size=955354 2024-09-14T10:54:13.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.205+0000 7faa01046780 1 < canceled multipart upload key=PTDE6D7OIU1A upload=2UFJWA07IXSK tag=3S6YBM1SZ331 type=write size=3052506 2024-09-14T10:54:13.206 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.207+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=B99GG7V0QDIU type=del size=1420767 2024-09-14T10:54:13.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.208+0000 7faa01046780 1 < canceled operation key=F872GLVQDCX6 tag=3T0JJZAW33PU type=del size=3262085 2024-09-14T10:54:13.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.210+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=HO1VE5FRL209 type=del size=2992437 2024-09-14T10:54:13.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.211+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~5880P85FZ72W.0 size=1048576 2024-09-14T10:54:13.211 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.212+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~5880P85FZ72W.1 size=1048576 2024-09-14T10:54:13.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.213+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~5880P85FZ72W.2 size=847726 2024-09-14T10:54:13.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.216+0000 7faa01046780 1 < completed multipart upload key=3UEX0IPM4CPY upload=5880P85FZ72W tag=EO6I9ULCO60I type=write size=3993454 2024-09-14T10:54:13.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.217+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=IWIQ2U6QFLFK type=del size=2816491 2024-09-14T10:54:13.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.219+0000 7faa01046780 1 < completed delete operation key=PS2QU1UZUYHE tag=8SYDLYF1RPAM type=del 2024-09-14T10:54:13.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.220+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=XFSHSOT4XS8Z type=del size=1911601 2024-09-14T10:54:13.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.222+0000 7faa01046780 1 < canceled operation key=XH8GHY9YRGTP tag=NKZZFH9NPAPL type=del size=3365334 2024-09-14T10:54:13.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.223+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=BE0NEH5X9HXY type=del size=3151848 2024-09-14T10:54:13.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.226+0000 7faa01046780 1 < suggested update operation key=KDUTH9PIR3FI tag=IPMT8VVMUGCU type=del size=181057 2024-09-14T10:54:13.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.227+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=ORUXRSNLSE7V type=write size=367534 2024-09-14T10:54:13.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.230+0000 7faa01046780 1 < completed delete operation key=BBDTPL35W4W0 tag=MU4EJG6CAI4Q type=del 2024-09-14T10:54:13.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.231+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=28ZEVDV5URHA type=del size=3433275 2024-09-14T10:54:13.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.232+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~LJEGOV9D92FB.0 size=1048576 2024-09-14T10:54:13.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.234+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~LJEGOV9D92FB.1 size=221116 2024-09-14T10:54:13.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.236+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=LJEGOV9D92FB tag=3R9J9UZ24D4C type=write size=2318268 2024-09-14T10:54:13.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.239+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~IZLB1Z2JTKKK.0 size=1048576 2024-09-14T10:54:13.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.239+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~IZLB1Z2JTKKK.1 size=458118 2024-09-14T10:54:13.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.239+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=IZLB1Z2JTKKK tag=3B8GOIEUSIC2 type=write size=2555270 2024-09-14T10:54:13.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.241+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~61YS995VQWZY.0 size=1048576 2024-09-14T10:54:13.241 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.242+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~61YS995VQWZY.1 size=1048576 2024-09-14T10:54:13.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.243+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~61YS995VQWZY.2 size=196785 2024-09-14T10:54:13.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.245+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=61YS995VQWZY tag=O8N4NSUCCE34 type=write size=3342513 2024-09-14T10:54:13.245 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.246+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=Q2I1J7TNF5NU type=del size=1695528 2024-09-14T10:54:13.246 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.248+0000 7faa01046780 1 < completed delete operation key=V11YJWHT4OOD tag=K6M51UNPU09J type=del 2024-09-14T10:54:13.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.250+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~H8SUTKZEOPXM.0 size=1048576 2024-09-14T10:54:13.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.251+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~H8SUTKZEOPXM.1 size=1048576 2024-09-14T10:54:13.251 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.252+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~H8SUTKZEOPXM.2 size=1041227 2024-09-14T10:54:13.251 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.252+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=H8SUTKZEOPXM tag=ERUQW5AYZ7ZJ type=write size=4186955 2024-09-14T10:54:13.253 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.254+0000 7faa01046780 1 < completed delete operation key=PS2QU1UZUYHE tag=BWOEBG96MSRW type=del 2024-09-14T10:54:13.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.255+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=2ICN9KISTYBK type=del size=160442 2024-09-14T10:54:13.255 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.257+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~29JN6Q8GP86F.0 size=73331 2024-09-14T10:54:13.257 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.259+0000 7faa01046780 1 < completed multipart upload key=CKMDOO75UZGE upload=29JN6Q8GP86F tag=P58R8X2OACT2 type=write size=1121907 2024-09-14T10:54:13.260 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.261+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~AG0G4J56IYMR.0 size=1048576 2024-09-14T10:54:13.261 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.262+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~AG0G4J56IYMR.1 size=334218 2024-09-14T10:54:13.261 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.262+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=AG0G4J56IYMR tag=F6IJP4AYSJOC type=write size=2431370 2024-09-14T10:54:13.263 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.264+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~14RJK9OQ5WAL.0 size=1048576 2024-09-14T10:54:13.264 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.265+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~14RJK9OQ5WAL.1 size=121666 2024-09-14T10:54:13.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.267+0000 7faa01046780 1 < completed multipart upload key=TDNQZ8Y1C6X2 upload=14RJK9OQ5WAL tag=Q6E9JOO11ZM4 type=write size=2218818 2024-09-14T10:54:13.268 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.270+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~XK8Z758DKBZ6.0 size=323340 2024-09-14T10:54:13.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.270+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=XK8Z758DKBZ6 tag=1V9NIBH0F21Y type=write size=1371916 2024-09-14T10:54:13.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.271+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~4G077I4FCYKL.0 size=1048576 2024-09-14T10:54:13.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.272+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~4G077I4FCYKL.1 size=142814 2024-09-14T10:54:13.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.274+0000 7faa01046780 1 < completed multipart upload key=F872GLVQDCX6 upload=4G077I4FCYKL tag=98J2XA9XB1V9 type=write size=2239966 2024-09-14T10:54:13.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.277+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~U9JU6QZH28FZ.0 size=1048576 2024-09-14T10:54:13.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.278+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~U9JU6QZH28FZ.1 size=90096 2024-09-14T10:54:13.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.278+0000 7faa01046780 1 > prepared multipart upload key=GG02P21TFKIM upload=U9JU6QZH28FZ tag=L9054NRB7SQN type=write size=2187248 2024-09-14T10:54:13.278 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.280+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=VIC25EI1DSW0 type=del 2024-09-14T10:54:13.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.282+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=8L235BDN256E type=write size=610339 2024-09-14T10:54:13.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.282+0000 7faa01046780 -1 < failed to complete operation key=KDUTH9PIR3FI tag=D0O2OF8EZ8ZS type=del size=2701342: (22) Invalid argument 2024-09-14T10:54:13.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.285+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~06Q40RBHR8T5.0 size=1048576 2024-09-14T10:54:13.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.286+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~06Q40RBHR8T5.1 size=294099 2024-09-14T10:54:13.285 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.286+0000 7faa01046780 1 > prepared multipart upload key=ZY0BY3G9NREC upload=06Q40RBHR8T5 tag=A6WFIMNE69HP type=write size=2391251 2024-09-14T10:54:13.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.288+0000 7faa01046780 1 < suggested remove operation key=F06QWEOYNQX4 tag=B99GG7V0QDIU type=del 2024-09-14T10:54:13.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.289+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=O6BRA5L4IR24 type=del size=186678 2024-09-14T10:54:13.289 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.291+0000 7faa01046780 1 < completed delete operation key=U8TE0XNK9YKM tag=HO1VE5FRL209 type=del 2024-09-14T10:54:13.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.294+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~8FDB5E0GFOU0.0 size=1048576 2024-09-14T10:54:13.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.295+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~8FDB5E0GFOU0.1 size=1048576 2024-09-14T10:54:13.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.296+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~8FDB5E0GFOU0.2 size=651030 2024-09-14T10:54:13.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.296+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=8FDB5E0GFOU0 tag=KKTABBYUZWX0 type=write size=3796758 2024-09-14T10:54:13.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.298+0000 7faa01046780 1 < suggested remove operation key=X9DUVQBBLUTF tag=IWIQ2U6QFLFK type=del 2024-09-14T10:54:13.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.300+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=C01YJI101GQM type=del size=3376239 2024-09-14T10:54:13.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.301+0000 7faa01046780 1 < completed delete operation key=XH8GHY9YRGTP tag=XFSHSOT4XS8Z type=del 2024-09-14T10:54:13.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.303+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~M7RW4XFYRKY0.0 size=1048576 2024-09-14T10:54:13.303 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.305+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~M7RW4XFYRKY0.1 size=967693 2024-09-14T10:54:13.304 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.305+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=M7RW4XFYRKY0 tag=M51LXGF780EI type=write size=3064845 2024-09-14T10:54:13.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.308+0000 7faa01046780 1 < suggested update operation key=0OL3SF5IWDMH tag=BE0NEH5X9HXY type=del size=3151848 2024-09-14T10:54:13.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.310+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~1GGDMAUX7SCM.0 size=1048576 2024-09-14T10:54:13.310 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.311+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~1GGDMAUX7SCM.1 size=527903 2024-09-14T10:54:13.310 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.311+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=1GGDMAUX7SCM tag=ACS8L92IAQY9 type=write size=2625055 2024-09-14T10:54:13.311 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.312+0000 7faa01046780 1 < completed write operation key=V5T3AN9D7DH6 tag=ORUXRSNLSE7V type=write size=367534 2024-09-14T10:54:13.312 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.314+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=HSEGF4GXD4IR type=del size=3075839 2024-09-14T10:54:13.315 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.316+0000 7faa01046780 1 < suggested update operation key=0XVVSUIOBQPL tag=28ZEVDV5URHA type=del size=3433275 2024-09-14T10:54:13.317 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.319+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~QKMVTB9Q7X70.0 size=1048576 2024-09-14T10:54:13.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.320+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~QKMVTB9Q7X70.1 size=1048576 2024-09-14T10:54:13.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.321+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~QKMVTB9Q7X70.2 size=767930 2024-09-14T10:54:13.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.321+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=QKMVTB9Q7X70 tag=2AELTUVXPMYN type=write size=3913658 2024-09-14T10:54:13.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.322+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~IZLB1Z2JTKKK.0 size=1048576 2024-09-14T10:54:13.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.323+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~IZLB1Z2JTKKK.1 size=458118 2024-09-14T10:54:13.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.326+0000 7faa01046780 1 < completed multipart upload key=CKMDOO75UZGE upload=IZLB1Z2JTKKK tag=3B8GOIEUSIC2 type=write size=2555270 2024-09-14T10:54:13.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.327+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=W0HEXILW46M6 type=del size=2558029 2024-09-14T10:54:13.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.330+0000 7faa01046780 1 < suggested remove operation key=CKMDOO75UZGE tag=Q2I1J7TNF5NU type=del 2024-09-14T10:54:13.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.333+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~CRMFEOBJOA8U.0 size=1048576 2024-09-14T10:54:13.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.334+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~CRMFEOBJOA8U.1 size=923581 2024-09-14T10:54:13.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.334+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=CRMFEOBJOA8U tag=4YSEB67KLR7U type=write size=3020733 2024-09-14T10:54:13.334 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.335+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~H8SUTKZEOPXM.0 size=1048576 2024-09-14T10:54:13.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.336+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~H8SUTKZEOPXM.1 size=1048576 2024-09-14T10:54:13.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.337+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~H8SUTKZEOPXM.2 size=1041227 2024-09-14T10:54:13.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.339+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=H8SUTKZEOPXM tag=ERUQW5AYZ7ZJ type=write size=4186955 2024-09-14T10:54:13.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.342+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~N62TFMLG84RA.0 size=1048576 2024-09-14T10:54:13.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.343+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~N62TFMLG84RA.1 size=1025764 2024-09-14T10:54:13.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.343+0000 7faa01046780 1 > prepared multipart upload key=VIO703UXIJXV upload=N62TFMLG84RA tag=4FQGWVWRNAMS type=write size=3122916 2024-09-14T10:54:13.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.344+0000 7faa01046780 1 < completed delete operation key=BBDTPL35W4W0 tag=2ICN9KISTYBK type=del 2024-09-14T10:54:13.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.345+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=89DDXK14GJRP type=del size=1304490 2024-09-14T10:54:13.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.346+0000 7faa01046780 1 < canceled part key=_multipart_S3BGVJ9N9S4P.2~AG0G4J56IYMR.0 size=1048576 2024-09-14T10:54:13.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.347+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~AG0G4J56IYMR.1 size=334218 2024-09-14T10:54:13.348 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.350+0000 7faa01046780 1 < canceled multipart upload key=S3BGVJ9N9S4P upload=AG0G4J56IYMR tag=F6IJP4AYSJOC type=write size=2431370 2024-09-14T10:54:13.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.350+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=2DBW64MUKR9D type=del size=2065503 2024-09-14T10:54:13.350 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.352+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~XK8Z758DKBZ6.0 size=323340 2024-09-14T10:54:13.352 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.354+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=XK8Z758DKBZ6 tag=1V9NIBH0F21Y type=write size=1371916 2024-09-14T10:54:13.354 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.355+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=JOO1A5LYMZKG type=del size=803657 2024-09-14T10:54:13.354 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.355+0000 7faa01046780 1 < canceled part key=_multipart_GG02P21TFKIM.2~U9JU6QZH28FZ.0 size=1048576 2024-09-14T10:54:13.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.357+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~U9JU6QZH28FZ.1 size=90096 2024-09-14T10:54:13.359 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.361+0000 7faa01046780 1 < canceled multipart upload key=GG02P21TFKIM upload=U9JU6QZH28FZ tag=L9054NRB7SQN type=write size=2187248 2024-09-14T10:54:13.360 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.361+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=56S2QNZIGS7O type=del size=1644635 2024-09-14T10:54:13.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.363+0000 7faa01046780 1 < completed write operation key=S3BGVJ9N9S4P tag=8L235BDN256E type=write size=610339 2024-09-14T10:54:13.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.364+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=SZXDSHRD4J75 type=del size=266110 2024-09-14T10:54:13.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.365+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~06Q40RBHR8T5.0 size=1048576 2024-09-14T10:54:13.365 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.367+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~06Q40RBHR8T5.1 size=294099 2024-09-14T10:54:13.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.370+0000 7faa01046780 1 < completed multipart upload key=ZY0BY3G9NREC upload=06Q40RBHR8T5 tag=A6WFIMNE69HP type=write size=2391251 2024-09-14T10:54:13.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.370+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=35WMALO0ZSQP type=del size=2405887 2024-09-14T10:54:13.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.372+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=O6BRA5L4IR24 type=del 2024-09-14T10:54:13.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.373+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=03Y12HZAWZEF type=write size=872466 2024-09-14T10:54:13.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.374+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~8FDB5E0GFOU0.0 size=1048576 2024-09-14T10:54:13.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.375+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~8FDB5E0GFOU0.1 size=1048576 2024-09-14T10:54:13.375 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.376+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~8FDB5E0GFOU0.2 size=651030 2024-09-14T10:54:13.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.378+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=8FDB5E0GFOU0 tag=KKTABBYUZWX0 type=write size=3796758 2024-09-14T10:54:13.378 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.379+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=SQZ5NF6O83R9 type=write size=2054 2024-09-14T10:54:13.380 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.382+0000 7faa01046780 1 < suggested remove operation key=Y4CB0HIN0750 tag=C01YJI101GQM type=del 2024-09-14T10:54:13.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.384+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~BZBURH05CT3V.0 size=364574 2024-09-14T10:54:13.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.384+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=BZBURH05CT3V tag=SRV7GSDKWRTY type=write size=1413150 2024-09-14T10:54:13.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.385+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~M7RW4XFYRKY0.0 size=1048576 2024-09-14T10:54:13.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.386+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~M7RW4XFYRKY0.1 size=967693 2024-09-14T10:54:13.387 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.388+0000 7faa01046780 1 < completed multipart upload key=CKMDOO75UZGE upload=M7RW4XFYRKY0 tag=M51LXGF780EI type=write size=3064845 2024-09-14T10:54:13.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.390+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~9NW5UBCNPVY4.0 size=999169 2024-09-14T10:54:13.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.390+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=9NW5UBCNPVY4 tag=0PMA1M2V10NV type=write size=2047745 2024-09-14T10:54:13.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.392+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~1GGDMAUX7SCM.0 size=1048576 2024-09-14T10:54:13.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.392+0000 7faa01046780 1 < canceled part key=_multipart_Y4CB0HIN0750.2~1GGDMAUX7SCM.1 size=527903 2024-09-14T10:54:13.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.394+0000 7faa01046780 1 < canceled multipart upload key=Y4CB0HIN0750 upload=1GGDMAUX7SCM tag=ACS8L92IAQY9 type=write size=2625055 2024-09-14T10:54:13.394 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.395+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=W90UEHG85601 type=del size=3862910 2024-09-14T10:54:13.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.397+0000 7faa01046780 -1 < failed to complete operation key=Y4CB0HIN0750 tag=HSEGF4GXD4IR type=del size=3075839: (22) Invalid argument 2024-09-14T10:54:13.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.398+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=XR4MB2RBBQ7G type=del size=3364944 2024-09-14T10:54:13.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.399+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~QKMVTB9Q7X70.0 size=1048576 2024-09-14T10:54:13.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.400+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~QKMVTB9Q7X70.1 size=1048576 2024-09-14T10:54:13.400 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.402+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~QKMVTB9Q7X70.2 size=767930 2024-09-14T10:54:13.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.404+0000 7faa01046780 1 < completed multipart upload key=CKMDOO75UZGE upload=QKMVTB9Q7X70 tag=2AELTUVXPMYN type=write size=3913658 2024-09-14T10:54:13.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.405+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=FBY4GGTY3GZT type=write size=389340 2024-09-14T10:54:13.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.406+0000 7faa01046780 1 < canceled operation key=BBDTPL35W4W0 tag=W0HEXILW46M6 type=del size=2558029 2024-09-14T10:54:13.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.408+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=4BL4S51AUKLS type=del size=139095 2024-09-14T10:54:13.408 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.409+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~CRMFEOBJOA8U.0 size=1048576 2024-09-14T10:54:13.408 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.409+0000 7faa01046780 1 < canceled part key=_multipart_HUBZAFMSCCNC.2~CRMFEOBJOA8U.1 size=923581 2024-09-14T10:54:13.410 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.412+0000 7faa01046780 1 < canceled multipart upload key=HUBZAFMSCCNC upload=CRMFEOBJOA8U tag=4YSEB67KLR7U type=write size=3020733 2024-09-14T10:54:13.411 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.413+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=TMQZIBFMUVR2 type=del size=1317346 2024-09-14T10:54:13.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.414+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~N62TFMLG84RA.0 size=1048576 2024-09-14T10:54:13.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.415+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~N62TFMLG84RA.1 size=1025764 2024-09-14T10:54:13.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.417+0000 7faa01046780 1 < completed multipart upload key=VIO703UXIJXV upload=N62TFMLG84RA tag=4FQGWVWRNAMS type=write size=3122916 2024-09-14T10:54:13.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.418+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=5ZIATQL243PG type=del size=1120226 2024-09-14T10:54:13.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.420+0000 7faa01046780 1 < canceled operation key=GG02P21TFKIM tag=89DDXK14GJRP type=del size=1304490 2024-09-14T10:54:13.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.423+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~IIPN572XPDYF.0 size=81910 2024-09-14T10:54:13.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.423+0000 7faa01046780 1 > prepared multipart upload key=VIO703UXIJXV upload=IIPN572XPDYF tag=F5L86BD9G5AI type=write size=1130486 2024-09-14T10:54:13.424 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.425+0000 7faa01046780 1 < suggested update operation key=KDUTH9PIR3FI tag=2DBW64MUKR9D type=del size=2065503 2024-09-14T10:54:13.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.427+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=0S1936GZ9II7 type=del size=283831 2024-09-14T10:54:13.429 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.430+0000 7faa01046780 1 < suggested update operation key=XDJAK0XYQNF0 tag=JOO1A5LYMZKG type=del size=803657 2024-09-14T10:54:13.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.431+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=R1NIY3XUB2TQ type=del size=806261 2024-09-14T10:54:13.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.433+0000 7faa01046780 1 < completed delete operation key=HYAGNAOWK8LF tag=56S2QNZIGS7O type=del 2024-09-14T10:54:13.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.435+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~08YCRWYWP686.0 size=1048576 2024-09-14T10:54:13.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.436+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~08YCRWYWP686.1 size=97362 2024-09-14T10:54:13.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.436+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=08YCRWYWP686 tag=O4Q89JMQ1S4D type=write size=2194514 2024-09-14T10:54:13.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.438+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=SZXDSHRD4J75 type=del 2024-09-14T10:54:13.439 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.440+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~624RGFE3V4GK.0 size=1048576 2024-09-14T10:54:13.440 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.441+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~624RGFE3V4GK.1 size=1048576 2024-09-14T10:54:13.441 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.442+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~624RGFE3V4GK.2 size=653303 2024-09-14T10:54:13.441 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.442+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=624RGFE3V4GK tag=2IPZE77WCOSA type=write size=3799031 2024-09-14T10:54:13.442 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.444+0000 7faa01046780 1 < completed delete operation key=HYAGNAOWK8LF tag=35WMALO0ZSQP type=del 2024-09-14T10:54:13.444 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.445+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=09D335IVQU0C type=del size=435727 2024-09-14T10:54:13.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.447+0000 7faa01046780 1 < completed write operation key=S3BGVJ9N9S4P tag=03Y12HZAWZEF type=write size=872466 2024-09-14T10:54:13.447 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.448+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=NPBXC0F9Y8Z0 type=del size=408530 2024-09-14T10:54:13.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.450+0000 7faa01046780 1 < completed write operation key=FOJGGEQZD7YW tag=SQZ5NF6O83R9 type=write size=2054 2024-09-14T10:54:13.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.452+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=TZNX7PXGRAR6 type=del size=4052772 2024-09-14T10:54:13.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.452+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~BZBURH05CT3V.0 size=364574 2024-09-14T10:54:13.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.455+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=BZBURH05CT3V tag=SRV7GSDKWRTY type=write size=1413150 2024-09-14T10:54:13.455 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.456+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=23N8JIG71QGX type=write size=841411 2024-09-14T10:54:13.455 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.456+0000 7faa01046780 1 < canceled part key=_multipart_3FSH0OFMF54V.2~9NW5UBCNPVY4.0 size=999169 2024-09-14T10:54:13.457 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.459+0000 7faa01046780 1 < canceled multipart upload key=3FSH0OFMF54V upload=9NW5UBCNPVY4 tag=0PMA1M2V10NV type=write size=2047745 2024-09-14T10:54:13.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.461+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~BW6J6DUMY5P4.0 size=1048576 2024-09-14T10:54:13.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.462+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~BW6J6DUMY5P4.1 size=1041929 2024-09-14T10:54:13.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.462+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=BW6J6DUMY5P4 tag=7C46V91YP2XT type=write size=3139081 2024-09-14T10:54:13.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.464+0000 7faa01046780 1 < canceled operation key=0OL3SF5IWDMH tag=W90UEHG85601 type=del size=3862910 2024-09-14T10:54:13.464 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.465+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=IPDGERKQD8BH type=del size=4152077 2024-09-14T10:54:13.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.468+0000 7faa01046780 1 < suggested remove operation key=F872GLVQDCX6 tag=XR4MB2RBBQ7G type=del 2024-09-14T10:54:13.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.469+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=HHLVGTF10JBW type=del size=606019 2024-09-14T10:54:13.469 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.470+0000 7faa01046780 1 < completed write operation key=V11YJWHT4OOD tag=FBY4GGTY3GZT type=write size=389340 2024-09-14T10:54:13.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.473+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~L7HIX8CDMP5H.0 size=1048576 2024-09-14T10:54:13.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.474+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~L7HIX8CDMP5H.1 size=68945 2024-09-14T10:54:13.473 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.474+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=L7HIX8CDMP5H tag=WA0MBAB0V2WF type=write size=2166097 2024-09-14T10:54:13.474 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.475+0000 7faa01046780 1 < completed delete operation key=3FSH0OFMF54V tag=4BL4S51AUKLS type=del 2024-09-14T10:54:13.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.476+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=HSKB1VKRN72E type=del size=2967855 2024-09-14T10:54:13.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.480+0000 7faa01046780 1 < suggested remove operation key=FOJGGEQZD7YW tag=TMQZIBFMUVR2 type=del 2024-09-14T10:54:13.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.481+0000 7faa01046780 1 > prepared operation key=SJ02N8472YDM tag=7F80BIAN0CTL type=write size=20471 2024-09-14T10:54:13.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.483+0000 7faa01046780 1 < completed delete operation key=HYAGNAOWK8LF tag=5ZIATQL243PG type=del 2024-09-14T10:54:13.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.486+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~HAF7YAR9K7AH.0 size=1048576 2024-09-14T10:54:13.486 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.487+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~HAF7YAR9K7AH.1 size=1048576 2024-09-14T10:54:13.487 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.488+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~HAF7YAR9K7AH.2 size=923526 2024-09-14T10:54:13.487 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.488+0000 7faa01046780 1 > prepared multipart upload key=SJ02N8472YDM upload=HAF7YAR9K7AH tag=MOCK3W9BP274 type=write size=4069254 2024-09-14T10:54:13.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.489+0000 7faa01046780 1 < canceled part key=_multipart_VIO703UXIJXV.2~IIPN572XPDYF.0 size=81910 2024-09-14T10:54:13.490 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.491+0000 7faa01046780 1 < canceled multipart upload key=VIO703UXIJXV upload=IIPN572XPDYF tag=F5L86BD9G5AI type=write size=1130486 2024-09-14T10:54:13.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.494+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~YC7NXLOX74UK.0 size=1048576 2024-09-14T10:54:13.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.495+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~YC7NXLOX74UK.1 size=1048576 2024-09-14T10:54:13.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.496+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~YC7NXLOX74UK.2 size=565591 2024-09-14T10:54:13.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.496+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=YC7NXLOX74UK tag=GYJ54YXEHY80 type=write size=3711319 2024-09-14T10:54:13.496 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.497+0000 7faa01046780 1 < completed delete operation key=GG02P21TFKIM tag=0S1936GZ9II7 type=del 2024-09-14T10:54:13.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.499+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=2PYDQ8FY6XM8 type=del size=3259067 2024-09-14T10:54:13.499 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.500+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=R1NIY3XUB2TQ type=del 2024-09-14T10:54:13.500 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.502+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=GDZ2LBYFNPVM type=del size=503422 2024-09-14T10:54:13.502 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.503+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~08YCRWYWP686.0 size=1048576 2024-09-14T10:54:13.503 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.504+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~08YCRWYWP686.1 size=97362 2024-09-14T10:54:13.505 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.506+0000 7faa01046780 1 < completed multipart upload key=0OL3SF5IWDMH upload=08YCRWYWP686 tag=O4Q89JMQ1S4D type=write size=2194514 2024-09-14T10:54:13.507 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.509+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~6KN1ZS8R42MA.0 size=1048576 2024-09-14T10:54:13.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.510+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~6KN1ZS8R42MA.1 size=299234 2024-09-14T10:54:13.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.510+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=6KN1ZS8R42MA tag=ZX1VB6EHNHJD type=write size=2396386 2024-09-14T10:54:13.510 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.511+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~624RGFE3V4GK.0 size=1048576 2024-09-14T10:54:13.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.512+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~624RGFE3V4GK.1 size=1048576 2024-09-14T10:54:13.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.512+0000 7faa01046780 1 < canceled part key=_multipart_HUBZAFMSCCNC.2~624RGFE3V4GK.2 size=653303 2024-09-14T10:54:13.513 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.514+0000 7faa01046780 1 < canceled multipart upload key=HUBZAFMSCCNC upload=624RGFE3V4GK tag=2IPZE77WCOSA type=write size=3799031 2024-09-14T10:54:13.514 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.516+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=WCBVJETYDJNT type=del size=2531152 2024-09-14T10:54:13.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.517+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=09D335IVQU0C type=del 2024-09-14T10:54:13.517 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.519+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=5X4RQ0ZFQ8Z0 type=del size=1180116 2024-09-14T10:54:13.518 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.520+0000 7faa01046780 1 < completed delete operation key=NXIPG4HR9ZYY tag=NPBXC0F9Y8Z0 type=del 2024-09-14T10:54:13.520 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.521+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=YBZQE0RLAMW6 type=del size=1971585 2024-09-14T10:54:13.521 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.523+0000 7faa01046780 1 < completed delete operation key=3FSH0OFMF54V tag=TZNX7PXGRAR6 type=del 2024-09-14T10:54:13.523 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.524+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=8HVS73P3G9KP type=del size=819276 2024-09-14T10:54:13.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.526+0000 7faa01046780 1 < completed write operation key=Y4CB0HIN0750 tag=23N8JIG71QGX type=write size=841411 2024-09-14T10:54:13.526 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.527+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=R4IGQW5TWNAL type=del size=1992200 2024-09-14T10:54:13.527 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.529+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~BW6J6DUMY5P4.0 size=1048576 2024-09-14T10:54:13.528 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.530+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~BW6J6DUMY5P4.1 size=1041929 2024-09-14T10:54:13.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.532+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=BW6J6DUMY5P4 tag=7C46V91YP2XT type=write size=3139081 2024-09-14T10:54:13.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.533+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=KHKMAPCEG81O type=write size=320074 2024-09-14T10:54:13.534 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.535+0000 7faa01046780 1 < canceled operation key=PBRZNGSOLJ8E tag=IPDGERKQD8BH type=del size=4152077 2024-09-14T10:54:13.535 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.536+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=PX9T4U6LY3SD type=del size=809260 2024-09-14T10:54:13.536 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.538+0000 7faa01046780 1 < completed delete operation key=V11YJWHT4OOD tag=HHLVGTF10JBW type=del 2024-09-14T10:54:13.539 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.540+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~C0VT13Q2VT3F.0 size=1048576 2024-09-14T10:54:13.540 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.542+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~C0VT13Q2VT3F.1 size=269907 2024-09-14T10:54:13.540 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.542+0000 7faa01046780 1 > prepared multipart upload key=SJ02N8472YDM upload=C0VT13Q2VT3F tag=VLXVFWXNN813 type=write size=2367059 2024-09-14T10:54:13.542 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.543+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~L7HIX8CDMP5H.0 size=1048576 2024-09-14T10:54:13.543 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.544+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~L7HIX8CDMP5H.1 size=68945 2024-09-14T10:54:13.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.546+0000 7faa01046780 1 < completed multipart upload key=KDUTH9PIR3FI upload=L7HIX8CDMP5H tag=WA0MBAB0V2WF type=write size=2166097 2024-09-14T10:54:13.547 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.548+0000 7faa01046780 1 > prepared operation key=SJ02N8472YDM tag=CY9RHS8NJEKI type=del size=2806492 2024-09-14T10:54:13.548 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.549+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=HSKB1VKRN72E type=del 2024-09-14T10:54:13.551 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.552+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~JM7BJ6PLRZ2S.0 size=9331 2024-09-14T10:54:13.551 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.552+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=JM7BJ6PLRZ2S tag=KNKN2G6U4R47 type=write size=1057907 2024-09-14T10:54:13.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.554+0000 7faa01046780 1 < completed write operation key=SJ02N8472YDM tag=7F80BIAN0CTL type=write size=20471 2024-09-14T10:54:13.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.556+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~P7Q2T8ERLYLX.0 size=1048576 2024-09-14T10:54:13.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.557+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~P7Q2T8ERLYLX.1 size=1024489 2024-09-14T10:54:13.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.557+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=P7Q2T8ERLYLX tag=CUO7UEQEK5AK type=write size=3121641 2024-09-14T10:54:13.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.558+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~HAF7YAR9K7AH.0 size=1048576 2024-09-14T10:54:13.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.559+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~HAF7YAR9K7AH.1 size=1048576 2024-09-14T10:54:13.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.559+0000 7faa01046780 1 < canceled part key=_multipart_SJ02N8472YDM.2~HAF7YAR9K7AH.2 size=923526 2024-09-14T10:54:13.561 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.562+0000 7faa01046780 1 < canceled multipart upload key=SJ02N8472YDM upload=HAF7YAR9K7AH tag=MOCK3W9BP274 type=write size=4069254 2024-09-14T10:54:13.562 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.563+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=88RWMI176VMM type=del size=3618921 2024-09-14T10:54:13.562 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.564+0000 7faa01046780 1 < canceled part key=_multipart_S3BGVJ9N9S4P.2~YC7NXLOX74UK.0 size=1048576 2024-09-14T10:54:13.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.565+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~YC7NXLOX74UK.1 size=1048576 2024-09-14T10:54:13.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.566+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~YC7NXLOX74UK.2 size=565591 2024-09-14T10:54:13.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.569+0000 7faa01046780 1 < canceled multipart upload key=S3BGVJ9N9S4P upload=YC7NXLOX74UK tag=GYJ54YXEHY80 type=write size=3711319 2024-09-14T10:54:13.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.571+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~4NIXUV2LACLF.0 size=1048576 2024-09-14T10:54:13.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.572+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~4NIXUV2LACLF.1 size=582529 2024-09-14T10:54:13.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.572+0000 7faa01046780 1 > prepared multipart upload key=ZY0BY3G9NREC upload=4NIXUV2LACLF tag=8K6RJPNNV54U type=write size=2679681 2024-09-14T10:54:13.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.573+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=2PYDQ8FY6XM8 type=del 2024-09-14T10:54:13.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.574+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=AR63VBCP4XUF type=del size=2471540 2024-09-14T10:54:13.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.576+0000 7faa01046780 1 < completed delete operation key=XH8GHY9YRGTP tag=GDZ2LBYFNPVM type=del 2024-09-14T10:54:13.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.577+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=8DQK8YELFP9I type=del size=506083 2024-09-14T10:54:13.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.579+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~6KN1ZS8R42MA.0 size=1048576 2024-09-14T10:54:13.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.580+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~6KN1ZS8R42MA.1 size=299234 2024-09-14T10:54:13.581 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.583+0000 7faa01046780 1 < completed multipart upload key=U8TE0XNK9YKM upload=6KN1ZS8R42MA tag=ZX1VB6EHNHJD type=write size=2396386 2024-09-14T10:54:13.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.583+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=13V5GQBT6H5D type=del size=503456 2024-09-14T10:54:13.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.585+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=WCBVJETYDJNT type=del 2024-09-14T10:54:13.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.587+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~1XEKJLL5VYC9.0 size=579629 2024-09-14T10:54:13.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.587+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=1XEKJLL5VYC9 tag=14HLPTM2T8RN type=write size=1628205 2024-09-14T10:54:13.587 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.589+0000 7faa01046780 1 < completed delete operation key=PS2QU1UZUYHE tag=5X4RQ0ZFQ8Z0 type=del 2024-09-14T10:54:13.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.590+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=JUBSI9GAHD33 type=del size=1200737 2024-09-14T10:54:13.590 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.591+0000 7faa01046780 1 < canceled operation key=V905BR1VWUCV tag=YBZQE0RLAMW6 type=del size=1971585 2024-09-14T10:54:13.591 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.593+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=DJSZSQV3DNZN type=write size=665073 2024-09-14T10:54:13.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.594+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=8HVS73P3G9KP type=del 2024-09-14T10:54:13.594 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.595+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=8NOP4II7YPS5 type=write size=930508 2024-09-14T10:54:13.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.597+0000 7faa01046780 1 < completed delete operation key=Q33ET1AN14NG tag=R4IGQW5TWNAL type=del 2024-09-14T10:54:13.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.598+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=3JC2ABSPDA5R type=del size=3508201 2024-09-14T10:54:13.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.601+0000 7faa01046780 1 < suggested remove operation key=PS2QU1UZUYHE tag=KHKMAPCEG81O type=write 2024-09-14T10:54:13.601 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.603+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=AK9UQ5WM6IU7 type=del size=658029 2024-09-14T10:54:13.602 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.603+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=PX9T4U6LY3SD type=del 2024-09-14T10:54:13.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.606+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~3RJBH4L7QDVQ.0 size=1048576 2024-09-14T10:54:13.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.607+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~3RJBH4L7QDVQ.1 size=1048576 2024-09-14T10:54:13.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.608+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~3RJBH4L7QDVQ.2 size=436785 2024-09-14T10:54:13.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.608+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=3RJBH4L7QDVQ tag=XZ1HEBEZJKRT type=write size=3582513 2024-09-14T10:54:13.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.610+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~C0VT13Q2VT3F.0 size=1048576 2024-09-14T10:54:13.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.610+0000 7faa01046780 1 < canceled part key=_multipart_SJ02N8472YDM.2~C0VT13Q2VT3F.1 size=269907 2024-09-14T10:54:13.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.612+0000 7faa01046780 1 < canceled multipart upload key=SJ02N8472YDM upload=C0VT13Q2VT3F tag=VLXVFWXNN813 type=write size=2367059 2024-09-14T10:54:13.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.614+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=GE81W0UPN507 type=del size=386333 2024-09-14T10:54:13.615 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.616+0000 7faa01046780 1 < canceled operation key=SJ02N8472YDM tag=CY9RHS8NJEKI type=del size=2806492 2024-09-14T10:54:13.616 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.617+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=XJ4X3VAH6MU9 type=del size=315125 2024-09-14T10:54:13.617 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.619+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~JM7BJ6PLRZ2S.0 size=9331 2024-09-14T10:54:13.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.621+0000 7faa01046780 1 < completed multipart upload key=S3BGVJ9N9S4P upload=JM7BJ6PLRZ2S tag=KNKN2G6U4R47 type=write size=1057907 2024-09-14T10:54:13.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.622+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=7PV1QAWQJROS type=del size=3834489 2024-09-14T10:54:13.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.624+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~P7Q2T8ERLYLX.0 size=1048576 2024-09-14T10:54:13.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.624+0000 7faa01046780 1 < canceled part key=_multipart_CKMDOO75UZGE.2~P7Q2T8ERLYLX.1 size=1024489 2024-09-14T10:54:13.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.626+0000 7faa01046780 1 < canceled multipart upload key=CKMDOO75UZGE upload=P7Q2T8ERLYLX tag=CUO7UEQEK5AK type=write size=3121641 2024-09-14T10:54:13.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.629+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~7BR7SHZ1T09L.0 size=1048576 2024-09-14T10:54:13.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.630+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~7BR7SHZ1T09L.1 size=844607 2024-09-14T10:54:13.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.630+0000 7faa01046780 1 > prepared multipart upload key=3UEX0IPM4CPY upload=7BR7SHZ1T09L tag=OC9UM6AZEFK2 type=write size=2941759 2024-09-14T10:54:13.630 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.631+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=88RWMI176VMM type=del 2024-09-14T10:54:13.633 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.634+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~9G55CIOA1WNK.0 size=1048576 2024-09-14T10:54:13.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.636+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~9G55CIOA1WNK.1 size=585152 2024-09-14T10:54:13.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.636+0000 7faa01046780 1 > prepared multipart upload key=PBRZNGSOLJ8E upload=9G55CIOA1WNK tag=39A0ICWSC74E type=write size=2682304 2024-09-14T10:54:13.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.637+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~4NIXUV2LACLF.0 size=1048576 2024-09-14T10:54:13.636 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.637+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~4NIXUV2LACLF.1 size=582529 2024-09-14T10:54:13.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.640+0000 7faa01046780 1 < completed multipart upload key=ZY0BY3G9NREC upload=4NIXUV2LACLF tag=8K6RJPNNV54U type=write size=2679681 2024-09-14T10:54:13.641 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.642+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~PJXYTHV54QR1.0 size=1048576 2024-09-14T10:54:13.642 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.643+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~PJXYTHV54QR1.1 size=1048576 2024-09-14T10:54:13.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.644+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~PJXYTHV54QR1.2 size=488672 2024-09-14T10:54:13.644 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.644+0000 7faa01046780 1 > prepared multipart upload key=LF41PL7DFSJI upload=PJXYTHV54QR1 tag=NHLSSM3M6L3C type=write size=3634400 2024-09-14T10:54:13.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.646+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=AR63VBCP4XUF type=del 2024-09-14T10:54:13.648 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.649+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~JSE5RWZS0KHC.0 size=1048576 2024-09-14T10:54:13.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.651+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~JSE5RWZS0KHC.1 size=171903 2024-09-14T10:54:13.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.651+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=JSE5RWZS0KHC tag=R1CFIU86N42S type=write size=2269055 2024-09-14T10:54:13.650 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.651+0000 7faa01046780 1 < completed delete operation key=HYAGNAOWK8LF tag=8DQK8YELFP9I type=del 2024-09-14T10:54:13.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.655+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~OR47WH7T90AW.0 size=1048576 2024-09-14T10:54:13.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.655+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~OR47WH7T90AW.1 size=1048576 2024-09-14T10:54:13.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.656+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~OR47WH7T90AW.2 size=466456 2024-09-14T10:54:13.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.656+0000 7faa01046780 1 > prepared multipart upload key=F06QWEOYNQX4 upload=OR47WH7T90AW tag=OP5N49ZQRUNV type=write size=3612184 2024-09-14T10:54:13.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.659+0000 7faa01046780 1 < suggested update operation key=BBDTPL35W4W0 tag=13V5GQBT6H5D type=del size=503456 2024-09-14T10:54:13.659 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.660+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=CBDXZLY3DCAZ type=del size=513065 2024-09-14T10:54:13.660 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.661+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~1XEKJLL5VYC9.0 size=579629 2024-09-14T10:54:13.662 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.663+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=1XEKJLL5VYC9 tag=14HLPTM2T8RN type=write size=1628205 2024-09-14T10:54:13.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.665+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=0NSAV7U68L5H type=del size=3263719 2024-09-14T10:54:13.665 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.666+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=JUBSI9GAHD33 type=del 2024-09-14T10:54:13.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.668+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=SZCKTSXQ0U3S type=del size=1082632 2024-09-14T10:54:13.668 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.669+0000 7faa01046780 1 < completed write operation key=V11YJWHT4OOD tag=DJSZSQV3DNZN type=write size=665073 2024-09-14T10:54:13.670 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.671+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=Z1JZOSNO1V10 type=del size=535289 2024-09-14T10:54:13.671 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.673+0000 7faa01046780 1 < completed write operation key=3UEX0IPM4CPY tag=8NOP4II7YPS5 type=write size=930508 2024-09-14T10:54:13.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.674+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=I7LDYXIV2JI1 type=write size=756193 2024-09-14T10:54:13.675 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.677+0000 7faa01046780 1 < suggested remove operation key=3FSH0OFMF54V tag=3JC2ABSPDA5R type=del 2024-09-14T10:54:13.677 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.678+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=H2YTOGX1TS2X type=del size=4184739 2024-09-14T10:54:13.678 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.681+0000 7faa01046780 1 < completed delete operation key=PS2QU1UZUYHE tag=AK9UQ5WM6IU7 type=del 2024-09-14T10:54:13.681 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.682+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~UZ6NOHCTWM1S.0 size=1048576 2024-09-14T10:54:13.682 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.684+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~UZ6NOHCTWM1S.1 size=1048576 2024-09-14T10:54:13.683 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.685+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~UZ6NOHCTWM1S.2 size=757171 2024-09-14T10:54:13.684 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.685+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=UZ6NOHCTWM1S tag=PIPGV82QHOGU type=write size=3902899 2024-09-14T10:54:13.685 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.687+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~3RJBH4L7QDVQ.0 size=1048576 2024-09-14T10:54:13.686 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.687+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~3RJBH4L7QDVQ.1 size=1048576 2024-09-14T10:54:13.687 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.689+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~3RJBH4L7QDVQ.2 size=436785 2024-09-14T10:54:13.690 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.691+0000 7faa01046780 1 < completed multipart upload key=0XVVSUIOBQPL upload=3RJBH4L7QDVQ tag=XZ1HEBEZJKRT type=write size=3582513 2024-09-14T10:54:13.692 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.694+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~RTZQ1TE5YK75.0 size=551635 2024-09-14T10:54:13.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.694+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=RTZQ1TE5YK75 tag=ESMVQRDS0Q07 type=write size=1600211 2024-09-14T10:54:13.694 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.695+0000 7faa01046780 1 < completed delete operation key=V905BR1VWUCV tag=GE81W0UPN507 type=del 2024-09-14T10:54:13.696 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.697+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=H87OJG2SQS73 type=write size=57016 2024-09-14T10:54:13.697 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.698+0000 7faa01046780 1 < canceled operation key=FOJGGEQZD7YW tag=XJ4X3VAH6MU9 type=del size=315125 2024-09-14T10:54:13.698 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.700+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=KCUQHQMX4GUG type=del size=1134369 2024-09-14T10:54:13.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.701+0000 7faa01046780 1 < completed delete operation key=GG02P21TFKIM tag=7PV1QAWQJROS type=del 2024-09-14T10:54:13.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.704+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~DA3H8N04EIVF.0 size=1048576 2024-09-14T10:54:13.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.706+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~DA3H8N04EIVF.1 size=1048576 2024-09-14T10:54:13.705 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.707+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~DA3H8N04EIVF.2 size=891298 2024-09-14T10:54:13.705 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.707+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=DA3H8N04EIVF tag=IQX152N454IB type=write size=4037026 2024-09-14T10:54:13.707 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.708+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~7BR7SHZ1T09L.0 size=1048576 2024-09-14T10:54:13.708 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.709+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~7BR7SHZ1T09L.1 size=844607 2024-09-14T10:54:13.710 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.712+0000 7faa01046780 1 < completed multipart upload key=3UEX0IPM4CPY upload=7BR7SHZ1T09L tag=OC9UM6AZEFK2 type=write size=2941759 2024-09-14T10:54:13.712 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.713+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=MN1MRF409QS1 type=del size=1813316 2024-09-14T10:54:13.713 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.714+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~9G55CIOA1WNK.0 size=1048576 2024-09-14T10:54:13.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.716+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~9G55CIOA1WNK.1 size=585152 2024-09-14T10:54:13.717 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.718+0000 7faa01046780 1 < completed multipart upload key=PBRZNGSOLJ8E upload=9G55CIOA1WNK tag=39A0ICWSC74E type=write size=2682304 2024-09-14T10:54:13.718 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.719+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=PCJB3JXXAKD6 type=del size=3688734 2024-09-14T10:54:13.720 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.721+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~PJXYTHV54QR1.0 size=1048576 2024-09-14T10:54:13.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.723+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~PJXYTHV54QR1.1 size=1048576 2024-09-14T10:54:13.722 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.724+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~PJXYTHV54QR1.2 size=488672 2024-09-14T10:54:13.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.727+0000 7faa01046780 1 < completed multipart upload key=LF41PL7DFSJI upload=PJXYTHV54QR1 tag=NHLSSM3M6L3C type=write size=3634400 2024-09-14T10:54:13.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.728+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~QYZBM2F483VV.0 size=211376 2024-09-14T10:54:13.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.728+0000 7faa01046780 1 > prepared multipart upload key=F06QWEOYNQX4 upload=QYZBM2F483VV tag=U6EMADMXQJ58 type=write size=1259952 2024-09-14T10:54:13.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.731+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~JSE5RWZS0KHC.0 size=1048576 2024-09-14T10:54:13.730 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.732+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~JSE5RWZS0KHC.1 size=171903 2024-09-14T10:54:13.732 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.733+0000 7faa01046780 1 < completed multipart upload key=Y4CB0HIN0750 upload=JSE5RWZS0KHC tag=R1CFIU86N42S type=write size=2269055 2024-09-14T10:54:13.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.735+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=1SXPY0MOXCNG type=del size=1033475 2024-09-14T10:54:13.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.737+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~OR47WH7T90AW.0 size=1048576 2024-09-14T10:54:13.737 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.738+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~OR47WH7T90AW.1 size=1048576 2024-09-14T10:54:13.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.740+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~OR47WH7T90AW.2 size=466456 2024-09-14T10:54:13.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.741+0000 7faa01046780 1 < completed multipart upload key=F06QWEOYNQX4 upload=OR47WH7T90AW tag=OP5N49ZQRUNV type=write size=3612184 2024-09-14T10:54:13.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.742+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=YYB02ZGQ4KYH type=del size=1526034 2024-09-14T10:54:13.743 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.744+0000 7faa01046780 1 < canceled operation key=Y4CB0HIN0750 tag=CBDXZLY3DCAZ type=del size=513065 2024-09-14T10:54:13.745 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.747+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=C1ZHDM0FZ6QZ type=write size=557920 2024-09-14T10:54:13.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.749+0000 7faa01046780 1 < suggested remove operation key=VIO703UXIJXV tag=0NSAV7U68L5H type=del 2024-09-14T10:54:13.750 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.751+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~W7AH5PU04HV8.0 size=1048576 2024-09-14T10:54:13.751 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.752+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~W7AH5PU04HV8.1 size=1048576 2024-09-14T10:54:13.752 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.753+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~W7AH5PU04HV8.2 size=165414 2024-09-14T10:54:13.752 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.753+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=W7AH5PU04HV8 tag=4HOXHY6J2G6I type=write size=3311142 2024-09-14T10:54:13.755 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.756+0000 7faa01046780 1 < suggested update operation key=KDUTH9PIR3FI tag=SZCKTSXQ0U3S type=del size=1082632 2024-09-14T10:54:13.756 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.757+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=XF5HFPC0VKZO type=del size=3012256 2024-09-14T10:54:13.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.759+0000 7faa01046780 1 < completed delete operation key=PBRZNGSOLJ8E tag=Z1JZOSNO1V10 type=del 2024-09-14T10:54:13.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.761+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~2R6MQY5MR6J2.0 size=1048576 2024-09-14T10:54:13.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.763+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~2R6MQY5MR6J2.1 size=1048576 2024-09-14T10:54:13.762 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.764+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~2R6MQY5MR6J2.2 size=793917 2024-09-14T10:54:13.763 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.764+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=2R6MQY5MR6J2 tag=BNKS5E5YE1MS type=write size=3939645 2024-09-14T10:54:13.764 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.765+0000 7faa01046780 1 < completed write operation key=V11YJWHT4OOD tag=I7LDYXIV2JI1 type=write size=756193 2024-09-14T10:54:13.766 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.767+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~E0USERL574LT.0 size=1048576 2024-09-14T10:54:13.767 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.769+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~E0USERL574LT.1 size=1048576 2024-09-14T10:54:13.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.770+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~E0USERL574LT.2 size=579065 2024-09-14T10:54:13.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.770+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=E0USERL574LT tag=Y13NMXK9BWVN type=write size=3724793 2024-09-14T10:54:13.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.772+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=H2YTOGX1TS2X type=del 2024-09-14T10:54:13.771 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.772+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=A28BG8PDSZ6P type=write size=888303 2024-09-14T10:54:13.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.774+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~UZ6NOHCTWM1S.0 size=1048576 2024-09-14T10:54:13.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.775+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~UZ6NOHCTWM1S.1 size=1048576 2024-09-14T10:54:13.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.777+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~UZ6NOHCTWM1S.2 size=757171 2024-09-14T10:54:13.777 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.778+0000 7faa01046780 1 < completed multipart upload key=Y4CB0HIN0750 upload=UZ6NOHCTWM1S tag=PIPGV82QHOGU type=write size=3902899 2024-09-14T10:54:13.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.780+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=75MP5HLW3B0T type=del size=1188422 2024-09-14T10:54:13.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.781+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~RTZQ1TE5YK75.0 size=551635 2024-09-14T10:54:13.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.784+0000 7faa01046780 1 < completed multipart upload key=HUBZAFMSCCNC upload=RTZQ1TE5YK75 tag=ESMVQRDS0Q07 type=write size=1600211 2024-09-14T10:54:13.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.784+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=YWXUCXHRBO64 type=del size=2934997 2024-09-14T10:54:13.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.786+0000 7faa01046780 1 < completed write operation key=ZY0BY3G9NREC tag=H87OJG2SQS73 type=write size=57016 2024-09-14T10:54:13.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.787+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=ZKPS8RKOTODI type=del size=1118422 2024-09-14T10:54:13.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.789+0000 7faa01046780 1 < completed delete operation key=3UEX0IPM4CPY tag=KCUQHQMX4GUG type=del 2024-09-14T10:54:13.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.791+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~9PWTYSUMH9IS.0 size=1048576 2024-09-14T10:54:13.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.792+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~9PWTYSUMH9IS.1 size=1048576 2024-09-14T10:54:13.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.793+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~9PWTYSUMH9IS.2 size=702922 2024-09-14T10:54:13.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.793+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=9PWTYSUMH9IS tag=HDY4ZSI1YFSV type=write size=3848650 2024-09-14T10:54:13.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.794+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~DA3H8N04EIVF.0 size=1048576 2024-09-14T10:54:13.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.795+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~DA3H8N04EIVF.1 size=1048576 2024-09-14T10:54:13.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.796+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~DA3H8N04EIVF.2 size=891298 2024-09-14T10:54:13.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.799+0000 7faa01046780 1 < completed multipart upload key=S3BGVJ9N9S4P upload=DA3H8N04EIVF tag=IQX152N454IB type=write size=4037026 2024-09-14T10:54:13.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.800+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=RB5BWQ820YI1 type=del size=3672833 2024-09-14T10:54:13.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.802+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=MN1MRF409QS1 type=del 2024-09-14T10:54:13.802 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.803+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=2HQBJR3Z16C0 type=del size=3638237 2024-09-14T10:54:13.803 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.804+0000 7faa01046780 1 < completed delete operation key=Q33ET1AN14NG tag=PCJB3JXXAKD6 type=del 2024-09-14T10:54:13.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.806+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=CEY0JYH2VADB type=del size=968579 2024-09-14T10:54:13.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.807+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~QYZBM2F483VV.0 size=211376 2024-09-14T10:54:13.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.810+0000 7faa01046780 1 < completed multipart upload key=F06QWEOYNQX4 upload=QYZBM2F483VV tag=U6EMADMXQJ58 type=write size=1259952 2024-09-14T10:54:13.811 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.813+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~76N8UTRRUOQU.0 size=1048576 2024-09-14T10:54:13.812 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.814+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~76N8UTRRUOQU.1 size=107076 2024-09-14T10:54:13.812 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.814+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=76N8UTRRUOQU tag=4LQELNIBGVPZ type=write size=2204228 2024-09-14T10:54:13.813 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.815+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=1SXPY0MOXCNG type=del 2024-09-14T10:54:13.816 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.817+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~VHRT1EUFUM92.0 size=1048576 2024-09-14T10:54:13.817 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.818+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~VHRT1EUFUM92.1 size=112542 2024-09-14T10:54:13.817 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.818+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=VHRT1EUFUM92 tag=34XVRKL9DOU8 type=write size=2209694 2024-09-14T10:54:13.820 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.821+0000 7faa01046780 1 < suggested update operation key=HYAGNAOWK8LF tag=YYB02ZGQ4KYH type=del size=1526034 2024-09-14T10:54:13.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.824+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~LMQD709D7MZ7.0 size=779667 2024-09-14T10:54:13.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.824+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=LMQD709D7MZ7 tag=8L50FW235NA3 type=write size=1828243 2024-09-14T10:54:13.824 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.825+0000 7faa01046780 1 < completed write operation key=S3BGVJ9N9S4P tag=C1ZHDM0FZ6QZ type=write size=557920 2024-09-14T10:54:13.827 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.828+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~PBULICTOARR0.0 size=1048576 2024-09-14T10:54:13.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.829+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~PBULICTOARR0.1 size=1048576 2024-09-14T10:54:13.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.830+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~PBULICTOARR0.2 size=272091 2024-09-14T10:54:13.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.830+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=PBULICTOARR0 tag=15X7E04D81P8 type=write size=3417819 2024-09-14T10:54:13.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.831+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~W7AH5PU04HV8.0 size=1048576 2024-09-14T10:54:13.831 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.832+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~W7AH5PU04HV8.1 size=1048576 2024-09-14T10:54:13.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.834+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~W7AH5PU04HV8.2 size=165414 2024-09-14T10:54:13.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.836+0000 7faa01046780 1 < completed multipart upload key=XDJAK0XYQNF0 upload=W7AH5PU04HV8 tag=4HOXHY6J2G6I type=write size=3311142 2024-09-14T10:54:13.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.838+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=OTQGQ3ZN50G0 type=del size=1704948 2024-09-14T10:54:13.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.839+0000 7faa01046780 1 < completed delete operation key=0XVVSUIOBQPL tag=XF5HFPC0VKZO type=del 2024-09-14T10:54:13.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.841+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~T21I65VNQE7S.0 size=1048576 2024-09-14T10:54:13.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.843+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~T21I65VNQE7S.1 size=563055 2024-09-14T10:54:13.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.843+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=T21I65VNQE7S tag=HKH9JGBHJB57 type=write size=2660207 2024-09-14T10:54:13.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.844+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~2R6MQY5MR6J2.0 size=1048576 2024-09-14T10:54:13.844 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.845+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~2R6MQY5MR6J2.1 size=1048576 2024-09-14T10:54:13.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.846+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~2R6MQY5MR6J2.2 size=793917 2024-09-14T10:54:13.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.850+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=2R6MQY5MR6J2 tag=BNKS5E5YE1MS type=write size=3939645 2024-09-14T10:54:13.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.850+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=AIOX2VL7WS3H type=del size=297900 2024-09-14T10:54:13.851 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.852+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~E0USERL574LT.0 size=1048576 2024-09-14T10:54:13.851 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.852+0000 7faa01046780 1 < canceled part key=_multipart_KDUTH9PIR3FI.2~E0USERL574LT.1 size=1048576 2024-09-14T10:54:13.852 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.854+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~E0USERL574LT.2 size=579065 2024-09-14T10:54:13.854 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.856+0000 7faa01046780 1 < canceled multipart upload key=KDUTH9PIR3FI upload=E0USERL574LT tag=Y13NMXK9BWVN type=write size=3724793 2024-09-14T10:54:13.856 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.857+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=6UL0M5J04ZT6 type=write size=138607 2024-09-14T10:54:13.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.859+0000 7faa01046780 1 < completed write operation key=Y4CB0HIN0750 tag=A28BG8PDSZ6P type=write size=888303 2024-09-14T10:54:13.859 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.860+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=1MKC34NXLL33 type=del size=3264373 2024-09-14T10:54:13.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.863+0000 7faa01046780 1 < suggested update operation key=GG02P21TFKIM tag=75MP5HLW3B0T type=del size=1188422 2024-09-14T10:54:13.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.864+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=1XEVCE29R4HC type=del size=2133425 2024-09-14T10:54:13.866 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.867+0000 7faa01046780 1 < suggested update operation key=PTDE6D7OIU1A tag=YWXUCXHRBO64 type=del size=2934997 2024-09-14T10:54:13.868 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.870+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~EG0275C99AGO.0 size=1048576 2024-09-14T10:54:13.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.871+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~EG0275C99AGO.1 size=1048576 2024-09-14T10:54:13.870 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.872+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~EG0275C99AGO.2 size=16011 2024-09-14T10:54:13.871 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.872+0000 7faa01046780 1 > prepared multipart upload key=TDNQZ8Y1C6X2 upload=EG0275C99AGO tag=3PTN5Z2LNLFH type=write size=3161739 2024-09-14T10:54:13.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.874+0000 7faa01046780 1 < completed delete operation key=Q33ET1AN14NG tag=ZKPS8RKOTODI type=del 2024-09-14T10:54:13.874 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.876+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=TX49U57M2RP3 type=del size=2898609 2024-09-14T10:54:13.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.877+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~9PWTYSUMH9IS.0 size=1048576 2024-09-14T10:54:13.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.878+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~9PWTYSUMH9IS.1 size=1048576 2024-09-14T10:54:13.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.878+0000 7faa01046780 1 < canceled part key=_multipart_CKMDOO75UZGE.2~9PWTYSUMH9IS.2 size=702922 2024-09-14T10:54:13.879 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.880+0000 7faa01046780 1 < canceled multipart upload key=CKMDOO75UZGE upload=9PWTYSUMH9IS tag=HDY4ZSI1YFSV type=write size=3848650 2024-09-14T10:54:13.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.883+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~7WLR6KES6OOF.0 size=1048576 2024-09-14T10:54:13.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.884+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~7WLR6KES6OOF.1 size=362758 2024-09-14T10:54:13.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.884+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=7WLR6KES6OOF tag=IHLFNWCU5K52 type=write size=2459910 2024-09-14T10:54:13.884 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.885+0000 7faa01046780 1 < completed delete operation key=V11YJWHT4OOD tag=RB5BWQ820YI1 type=del 2024-09-14T10:54:13.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.887+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=3997V9H0M3Z3 type=del size=19833 2024-09-14T10:54:13.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.888+0000 7faa01046780 1 < completed delete operation key=F872GLVQDCX6 tag=2HQBJR3Z16C0 type=del 2024-09-14T10:54:13.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.889+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=EY52KF1DJ7Y2 type=del size=2349333 2024-09-14T10:54:13.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.891+0000 7faa01046780 1 < completed delete operation key=X9DUVQBBLUTF tag=CEY0JYH2VADB type=del 2024-09-14T10:54:13.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.892+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=A8E1JIE058KI type=write size=58004 2024-09-14T10:54:13.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.894+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~76N8UTRRUOQU.0 size=1048576 2024-09-14T10:54:13.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.894+0000 7faa01046780 1 < canceled part key=_multipart_CKMDOO75UZGE.2~76N8UTRRUOQU.1 size=107076 2024-09-14T10:54:13.894 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.896+0000 7faa01046780 1 < canceled multipart upload key=CKMDOO75UZGE upload=76N8UTRRUOQU tag=4LQELNIBGVPZ type=write size=2204228 2024-09-14T10:54:13.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.898+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~OHV33WC8OF45.0 size=744160 2024-09-14T10:54:13.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.898+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=OHV33WC8OF45 tag=5V2OQTVYCG9F type=write size=1792736 2024-09-14T10:54:13.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.901+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~VHRT1EUFUM92.0 size=1048576 2024-09-14T10:54:13.900 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.902+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~VHRT1EUFUM92.1 size=112542 2024-09-14T10:54:13.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.903+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=VHRT1EUFUM92 tag=34XVRKL9DOU8 type=write size=2209694 2024-09-14T10:54:13.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.905+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=ZZOZWUROYFIM type=del size=1676912 2024-09-14T10:54:13.905 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.906+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~LMQD709D7MZ7.0 size=779667 2024-09-14T10:54:13.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.908+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=LMQD709D7MZ7 tag=8L50FW235NA3 type=write size=1828243 2024-09-14T10:54:13.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.910+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=DGG890W36HKD type=del size=3061756 2024-09-14T10:54:13.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.911+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~PBULICTOARR0.0 size=1048576 2024-09-14T10:54:13.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.912+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~PBULICTOARR0.1 size=1048576 2024-09-14T10:54:13.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.913+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~PBULICTOARR0.2 size=272091 2024-09-14T10:54:13.914 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.916+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=PBULICTOARR0 tag=15X7E04D81P8 type=write size=3417819 2024-09-14T10:54:13.916 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.917+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=U26JBRYJYM9W type=del size=3530279 2024-09-14T10:54:13.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.919+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=OTQGQ3ZN50G0 type=del 2024-09-14T10:54:13.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.920+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=PJRYTVNV27C3 type=del size=4162837 2024-09-14T10:54:13.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.922+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~T21I65VNQE7S.0 size=1048576 2024-09-14T10:54:13.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.923+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~T21I65VNQE7S.1 size=563055 2024-09-14T10:54:13.923 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.925+0000 7faa01046780 1 < completed multipart upload key=XDJAK0XYQNF0 upload=T21I65VNQE7S tag=HKH9JGBHJB57 type=write size=2660207 2024-09-14T10:54:13.926 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.927+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~IDGVLG2A33FY.0 size=300901 2024-09-14T10:54:13.926 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.927+0000 7faa01046780 1 > prepared multipart upload key=X9DUVQBBLUTF upload=IDGVLG2A33FY tag=730LCOITSEDL type=write size=1349477 2024-09-14T10:54:13.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.929+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=AIOX2VL7WS3H type=del 2024-09-14T10:54:13.929 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.930+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=JND9D8LQNMYC type=del size=3302244 2024-09-14T10:54:13.930 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.932+0000 7faa01046780 1 < completed write operation key=V5T3AN9D7DH6 tag=6UL0M5J04ZT6 type=write size=138607 2024-09-14T10:54:13.932 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.933+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=5FM18OIZYUHV type=del size=301134 2024-09-14T10:54:13.933 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.934+0000 7faa01046780 1 < completed delete operation key=X9DUVQBBLUTF tag=1MKC34NXLL33 type=del 2024-09-14T10:54:13.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.937+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~7N00E2DBAKRY.0 size=1048576 2024-09-14T10:54:13.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.938+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~7N00E2DBAKRY.1 size=1048576 2024-09-14T10:54:13.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.939+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~7N00E2DBAKRY.2 size=192080 2024-09-14T10:54:13.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.939+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=7N00E2DBAKRY tag=YBJAHHMKP2KQ type=write size=3337808 2024-09-14T10:54:13.940 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.941+0000 7faa01046780 1 < completed delete operation key=V11YJWHT4OOD tag=1XEVCE29R4HC type=del 2024-09-14T10:54:13.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.943+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=PCUZAV4GXV6L type=del size=169293 2024-09-14T10:54:13.942 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.943+0000 7faa01046780 1 < canceled part key=_multipart_TDNQZ8Y1C6X2.2~EG0275C99AGO.0 size=1048576 2024-09-14T10:54:13.942 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.943+0000 7faa01046780 1 < canceled part key=_multipart_TDNQZ8Y1C6X2.2~EG0275C99AGO.1 size=1048576 2024-09-14T10:54:13.942 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.943+0000 7faa01046780 1 < canceled part key=_multipart_TDNQZ8Y1C6X2.2~EG0275C99AGO.2 size=16011 2024-09-14T10:54:13.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.946+0000 7faa01046780 1 < canceled multipart upload key=TDNQZ8Y1C6X2 upload=EG0275C99AGO tag=3PTN5Z2LNLFH type=write size=3161739 2024-09-14T10:54:13.948 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.949+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=CL8ZT19CJ3M2 type=del size=4045536 2024-09-14T10:54:13.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.952+0000 7faa01046780 1 < suggested remove operation key=V905BR1VWUCV tag=TX49U57M2RP3 type=del 2024-09-14T10:54:13.952 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.953+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=YODFI6IDL9ZZ type=del size=2868212 2024-09-14T10:54:13.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.955+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~7WLR6KES6OOF.0 size=1048576 2024-09-14T10:54:13.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.956+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~7WLR6KES6OOF.1 size=362758 2024-09-14T10:54:13.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.959+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=7WLR6KES6OOF tag=IHLFNWCU5K52 type=write size=2459910 2024-09-14T10:54:13.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.960+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=NZ6694STZCVC type=write size=275776 2024-09-14T10:54:13.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.961+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=3997V9H0M3Z3 type=del 2024-09-14T10:54:13.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.962+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=YRJG0TCA2W2P type=del size=544403 2024-09-14T10:54:13.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.965+0000 7faa01046780 1 < suggested remove operation key=TDNQZ8Y1C6X2 tag=EY52KF1DJ7Y2 type=del 2024-09-14T10:54:13.965 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.966+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=O1GB8VWK0HQK type=del size=456168 2024-09-14T10:54:13.966 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.967+0000 7faa01046780 1 < completed write operation key=F06QWEOYNQX4 tag=A8E1JIE058KI type=write size=58004 2024-09-14T10:54:13.967 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.969+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=UPIST48TP0QL type=write size=304931 2024-09-14T10:54:13.969 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.970+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~OHV33WC8OF45.0 size=744160 2024-09-14T10:54:13.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.973+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=OHV33WC8OF45 tag=5V2OQTVYCG9F type=write size=1792736 2024-09-14T10:54:13.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.975+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~63VO0JOUYA5A.0 size=1048576 2024-09-14T10:54:13.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.976+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~63VO0JOUYA5A.1 size=1048576 2024-09-14T10:54:13.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.977+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~63VO0JOUYA5A.2 size=862078 2024-09-14T10:54:13.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.977+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=63VO0JOUYA5A tag=052TCX1AX50Y type=write size=4007806 2024-09-14T10:54:13.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.979+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=ZZOZWUROYFIM type=del 2024-09-14T10:54:13.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.980+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=2J69LIFM8LW3 type=del size=967642 2024-09-14T10:54:13.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.982+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=DGG890W36HKD type=del 2024-09-14T10:54:13.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.984+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~OGUP6RC40NWI.0 size=1048576 2024-09-14T10:54:13.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.985+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~OGUP6RC40NWI.1 size=1048576 2024-09-14T10:54:13.985 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.986+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~OGUP6RC40NWI.2 size=236135 2024-09-14T10:54:13.985 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.986+0000 7faa01046780 1 > prepared multipart upload key=GG02P21TFKIM upload=OGUP6RC40NWI tag=SL4XX1DFJY7C type=write size=3381863 2024-09-14T10:54:13.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.988+0000 7faa01046780 1 < completed delete operation key=Q33ET1AN14NG tag=U26JBRYJYM9W type=del 2024-09-14T10:54:13.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.989+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=9QH0AA7FREJR type=del size=2112277 2024-09-14T10:54:13.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.991+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=PJRYTVNV27C3 type=del 2024-09-14T10:54:13.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.993+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~5D2Q2577XNM1.0 size=1048576 2024-09-14T10:54:13.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.994+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~5D2Q2577XNM1.1 size=1048576 2024-09-14T10:54:13.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.995+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~5D2Q2577XNM1.2 size=187946 2024-09-14T10:54:13.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.995+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=5D2Q2577XNM1 tag=7UR3RT60M423 type=write size=3333674 2024-09-14T10:54:13.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:13.997+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~IDGVLG2A33FY.0 size=300901 2024-09-14T10:54:13.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.000+0000 7faa01046780 1 < completed multipart upload key=X9DUVQBBLUTF upload=IDGVLG2A33FY tag=730LCOITSEDL type=write size=1349477 2024-09-14T10:54:13.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.000+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=OA7MIPPR2CI0 type=del size=618043 2024-09-14T10:54:14.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.002+0000 7faa01046780 1 < completed delete operation key=VIO703UXIJXV tag=JND9D8LQNMYC type=del 2024-09-14T10:54:14.003 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.004+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~FEV3MLVICRPJ.0 size=1048576 2024-09-14T10:54:14.005 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.006+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~FEV3MLVICRPJ.1 size=1048576 2024-09-14T10:54:14.006 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.008+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~FEV3MLVICRPJ.2 size=366159 2024-09-14T10:54:14.007 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.008+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=FEV3MLVICRPJ tag=A5NDBH5E3AWT type=write size=3511887 2024-09-14T10:54:14.007 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.009+0000 7faa01046780 1 < canceled operation key=KDUTH9PIR3FI tag=5FM18OIZYUHV type=del size=301134 2024-09-14T10:54:14.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.011+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=MSFVODRWHVU0 type=del size=2486311 2024-09-14T10:54:14.011 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.013+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~7N00E2DBAKRY.0 size=1048576 2024-09-14T10:54:14.012 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.013+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~7N00E2DBAKRY.1 size=1048576 2024-09-14T10:54:14.013 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.014+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~7N00E2DBAKRY.2 size=192080 2024-09-14T10:54:14.015 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.016+0000 7faa01046780 1 < completed multipart upload key=CKMDOO75UZGE upload=7N00E2DBAKRY tag=YBJAHHMKP2KQ type=write size=3337808 2024-09-14T10:54:14.017 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.018+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=US7X6NN7RWYR type=del size=3546723 2024-09-14T10:54:14.018 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.019+0000 7faa01046780 1 < completed delete operation key=X9DUVQBBLUTF tag=PCUZAV4GXV6L type=del 2024-09-14T10:54:14.020 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.022+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~9TQ17Z6SNICS.0 size=8743 2024-09-14T10:54:14.021 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.022+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=9TQ17Z6SNICS tag=5Y7Q0OS3LO1Z type=write size=1057319 2024-09-14T10:54:14.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.023+0000 7faa01046780 1 < completed delete operation key=3FSH0OFMF54V tag=CL8ZT19CJ3M2 type=del 2024-09-14T10:54:14.024 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.025+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~KDLQUC5GUVX0.0 size=1048576 2024-09-14T10:54:14.025 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.027+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~KDLQUC5GUVX0.1 size=974187 2024-09-14T10:54:14.026 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.027+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=KDLQUC5GUVX0 tag=PN0ZA511FP9P type=write size=3071339 2024-09-14T10:54:14.028 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.029+0000 7faa01046780 1 < suggested update operation key=PBRZNGSOLJ8E tag=YODFI6IDL9ZZ type=del size=2868212 2024-09-14T10:54:14.030 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.031+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=PV0FUE6C8I0J type=del size=3493370 2024-09-14T10:54:14.031 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.032+0000 7faa01046780 1 < completed write operation key=KDUTH9PIR3FI tag=NZ6694STZCVC type=write size=275776 2024-09-14T10:54:14.033 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.035+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~8NCFUQK0RK8M.0 size=1048576 2024-09-14T10:54:14.037 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.039+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~8NCFUQK0RK8M.1 size=1048576 2024-09-14T10:54:14.039 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.040+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~8NCFUQK0RK8M.2 size=158540 2024-09-14T10:54:14.039 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.040+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=8NCFUQK0RK8M tag=PS9ZQCP14KUT type=write size=3304268 2024-09-14T10:54:14.040 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.042+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=YRJG0TCA2W2P type=del 2024-09-14T10:54:14.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.043+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=I688FJMMH8TG type=del size=3068261 2024-09-14T10:54:14.043 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.044+0000 7faa01046780 1 < completed delete operation key=BBDTPL35W4W0 tag=O1GB8VWK0HQK type=del 2024-09-14T10:54:14.044 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.046+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=XHB2G7WMGAKK type=del size=4175632 2024-09-14T10:54:14.046 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.047+0000 7faa01046780 1 < completed write operation key=XDJAK0XYQNF0 tag=UPIST48TP0QL type=write size=304931 2024-09-14T10:54:14.047 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.048+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=3Q6C0QDTPUR7 type=write size=23476 2024-09-14T10:54:14.048 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.050+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~63VO0JOUYA5A.0 size=1048576 2024-09-14T10:54:14.049 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.051+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~63VO0JOUYA5A.1 size=1048576 2024-09-14T10:54:14.051 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.052+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~63VO0JOUYA5A.2 size=862078 2024-09-14T10:54:14.053 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.054+0000 7faa01046780 1 < completed multipart upload key=U8TE0XNK9YKM upload=63VO0JOUYA5A tag=052TCX1AX50Y type=write size=4007806 2024-09-14T10:54:14.054 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.055+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=07F51PZ9FWMN type=write size=179370 2024-09-14T10:54:14.056 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.057+0000 7faa01046780 1 < completed delete operation key=F872GLVQDCX6 tag=2J69LIFM8LW3 type=del 2024-09-14T10:54:14.058 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.059+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~K8ABUQTWPMBG.0 size=1048576 2024-09-14T10:54:14.059 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.060+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~K8ABUQTWPMBG.1 size=1048576 2024-09-14T10:54:14.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.061+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~K8ABUQTWPMBG.2 size=903139 2024-09-14T10:54:14.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.061+0000 7faa01046780 1 > prepared multipart upload key=PS2QU1UZUYHE upload=K8ABUQTWPMBG tag=8IMHJ38PXPBI type=write size=4048867 2024-09-14T10:54:14.061 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.063+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~OGUP6RC40NWI.0 size=1048576 2024-09-14T10:54:14.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.064+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~OGUP6RC40NWI.1 size=1048576 2024-09-14T10:54:14.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.065+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~OGUP6RC40NWI.2 size=236135 2024-09-14T10:54:14.066 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.067+0000 7faa01046780 1 < completed multipart upload key=GG02P21TFKIM upload=OGUP6RC40NWI tag=SL4XX1DFJY7C type=write size=3381863 2024-09-14T10:54:14.067 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.068+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=UADJF0C9NB7E type=del size=872176 2024-09-14T10:54:14.068 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.070+0000 7faa01046780 1 < canceled operation key=NXIPG4HR9ZYY tag=9QH0AA7FREJR type=del size=2112277 2024-09-14T10:54:14.070 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.071+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=Z5WU8LGKZQ2T type=del size=1697379 2024-09-14T10:54:14.071 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.073+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~5D2Q2577XNM1.0 size=1048576 2024-09-14T10:54:14.072 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.074+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~5D2Q2577XNM1.1 size=1048576 2024-09-14T10:54:14.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.075+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~5D2Q2577XNM1.2 size=187946 2024-09-14T10:54:14.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.077+0000 7faa01046780 1 < completed multipart upload key=0OL3SF5IWDMH upload=5D2Q2577XNM1 tag=7UR3RT60M423 type=write size=3333674 2024-09-14T10:54:14.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.080+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~6J5JREYBJ5B9.0 size=940340 2024-09-14T10:54:14.079 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.080+0000 7faa01046780 1 > prepared multipart upload key=V11YJWHT4OOD upload=6J5JREYBJ5B9 tag=1GH76WR45JE4 type=write size=1988916 2024-09-14T10:54:14.081 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.083+0000 7faa01046780 1 < suggested remove operation key=U8TE0XNK9YKM tag=OA7MIPPR2CI0 type=del 2024-09-14T10:54:14.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.084+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=55RTZMT5PYGY type=del size=2514495 2024-09-14T10:54:14.084 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.085+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~FEV3MLVICRPJ.0 size=1048576 2024-09-14T10:54:14.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.086+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~FEV3MLVICRPJ.1 size=1048576 2024-09-14T10:54:14.086 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.088+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~FEV3MLVICRPJ.2 size=366159 2024-09-14T10:54:14.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.091+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=FEV3MLVICRPJ tag=A5NDBH5E3AWT type=write size=3511887 2024-09-14T10:54:14.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.093+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~EN9UH0ZLTE1R.0 size=1048576 2024-09-14T10:54:14.093 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.094+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~EN9UH0ZLTE1R.1 size=1048576 2024-09-14T10:54:14.093 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.095+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~EN9UH0ZLTE1R.2 size=24515 2024-09-14T10:54:14.093 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.095+0000 7faa01046780 1 > prepared multipart upload key=V11YJWHT4OOD upload=EN9UH0ZLTE1R tag=1WH7DTXKNUY8 type=write size=3170243 2024-09-14T10:54:14.095 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.096+0000 7faa01046780 1 < completed delete operation key=VIO703UXIJXV tag=MSFVODRWHVU0 type=del 2024-09-14T10:54:14.097 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.098+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~1XPQESGK5K5Q.0 size=667586 2024-09-14T10:54:14.097 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.098+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=1XPQESGK5K5Q tag=IQRLEVCL6UMS type=write size=1716162 2024-09-14T10:54:14.098 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.100+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=US7X6NN7RWYR type=del 2024-09-14T10:54:14.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.103+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~PBS71CZQMV49.0 size=1048576 2024-09-14T10:54:14.102 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.104+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~PBS71CZQMV49.1 size=599858 2024-09-14T10:54:14.102 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.104+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=PBS71CZQMV49 tag=67KQBXZND4V0 type=write size=2697010 2024-09-14T10:54:14.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.104+0000 7faa01046780 1 < canceled part key=_multipart_HUBZAFMSCCNC.2~9TQ17Z6SNICS.0 size=8743 2024-09-14T10:54:14.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.106+0000 7faa01046780 1 < canceled multipart upload key=HUBZAFMSCCNC upload=9TQ17Z6SNICS tag=5Y7Q0OS3LO1Z type=write size=1057319 2024-09-14T10:54:14.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.107+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=OL5KVUBN75Z9 type=del size=3140351 2024-09-14T10:54:14.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.109+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~KDLQUC5GUVX0.0 size=1048576 2024-09-14T10:54:14.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.110+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~KDLQUC5GUVX0.1 size=974187 2024-09-14T10:54:14.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.113+0000 7faa01046780 1 < completed multipart upload key=KDUTH9PIR3FI upload=KDLQUC5GUVX0 tag=PN0ZA511FP9P type=write size=3071339 2024-09-14T10:54:14.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.115+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~6VEO5W7KEGGK.0 size=1048576 2024-09-14T10:54:14.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.115+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~6VEO5W7KEGGK.1 size=433479 2024-09-14T10:54:14.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.115+0000 7faa01046780 1 > prepared multipart upload key=F06QWEOYNQX4 upload=6VEO5W7KEGGK tag=OX22KEAX1QSC type=write size=2530631 2024-09-14T10:54:14.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.118+0000 7faa01046780 1 < completed delete operation key=PBRZNGSOLJ8E tag=PV0FUE6C8I0J type=del 2024-09-14T10:54:14.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.120+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~IQO6VSP4X428.0 size=1048576 2024-09-14T10:54:14.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.121+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~IQO6VSP4X428.1 size=1048576 2024-09-14T10:54:14.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.122+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~IQO6VSP4X428.2 size=422434 2024-09-14T10:54:14.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.122+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=IQO6VSP4X428 tag=2064VKZBNDR1 type=write size=3568162 2024-09-14T10:54:14.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.122+0000 7faa01046780 1 < canceled part key=_multipart_Y4CB0HIN0750.2~8NCFUQK0RK8M.0 size=1048576 2024-09-14T10:54:14.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.123+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~8NCFUQK0RK8M.1 size=1048576 2024-09-14T10:54:14.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.125+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~8NCFUQK0RK8M.2 size=158540 2024-09-14T10:54:14.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.128+0000 7faa01046780 1 < canceled multipart upload key=Y4CB0HIN0750 upload=8NCFUQK0RK8M tag=PS9ZQCP14KUT type=write size=3304268 2024-09-14T10:54:14.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.129+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=2MCTT9HN7TF6 type=del size=3790863 2024-09-14T10:54:14.129 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.130+0000 7faa01046780 1 < completed delete operation key=XH8GHY9YRGTP tag=I688FJMMH8TG type=del 2024-09-14T10:54:14.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.133+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~I7B04DBAMYU9.0 size=102201 2024-09-14T10:54:14.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.133+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=I7B04DBAMYU9 tag=LXTOQG2HGKO0 type=write size=1150777 2024-09-14T10:54:14.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.137+0000 7faa01046780 1 < suggested remove operation key=0OL3SF5IWDMH tag=XHB2G7WMGAKK type=del 2024-09-14T10:54:14.139 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.140+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~DWXGUK77WZ9A.0 size=1048576 2024-09-14T10:54:14.140 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.141+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~DWXGUK77WZ9A.1 size=1048576 2024-09-14T10:54:14.141 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.142+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~DWXGUK77WZ9A.2 size=73300 2024-09-14T10:54:14.141 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.142+0000 7faa01046780 1 > prepared multipart upload key=PBRZNGSOLJ8E upload=DWXGUK77WZ9A tag=FK7V06WUY87D type=write size=3219028 2024-09-14T10:54:14.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.143+0000 7faa01046780 -1 < failed to complete operation key=U8TE0XNK9YKM tag=3Q6C0QDTPUR7 type=write size=23476: (22) Invalid argument 2024-09-14T10:54:14.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.146+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~ZLH4Q01JJ3B4.0 size=717191 2024-09-14T10:54:14.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.146+0000 7faa01046780 1 > prepared multipart upload key=X9DUVQBBLUTF upload=ZLH4Q01JJ3B4 tag=IK34TO1B5YNY type=write size=1765767 2024-09-14T10:54:14.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.147+0000 7faa01046780 1 < completed write operation key=XH8GHY9YRGTP tag=07F51PZ9FWMN type=write size=179370 2024-09-14T10:54:14.149 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.150+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~J45ORRNKL7I5.0 size=1048576 2024-09-14T10:54:14.150 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.151+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~J45ORRNKL7I5.1 size=579024 2024-09-14T10:54:14.150 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.151+0000 7faa01046780 1 > prepared multipart upload key=PBRZNGSOLJ8E upload=J45ORRNKL7I5 tag=X4NCHGJEQXW7 type=write size=2676176 2024-09-14T10:54:14.151 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.152+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~K8ABUQTWPMBG.0 size=1048576 2024-09-14T10:54:14.152 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.153+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~K8ABUQTWPMBG.1 size=1048576 2024-09-14T10:54:14.153 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.155+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~K8ABUQTWPMBG.2 size=903139 2024-09-14T10:54:14.155 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.157+0000 7faa01046780 1 < completed multipart upload key=PS2QU1UZUYHE upload=K8ABUQTWPMBG tag=8IMHJ38PXPBI type=write size=4048867 2024-09-14T10:54:14.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.158+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=NJLYWBI0780K type=del size=2645340 2024-09-14T10:54:14.158 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.159+0000 7faa01046780 1 < completed delete operation key=ZY0BY3G9NREC tag=UADJF0C9NB7E type=del 2024-09-14T10:54:14.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.163+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~AORP96RFAQCY.0 size=1048576 2024-09-14T10:54:14.162 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.163+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~AORP96RFAQCY.1 size=1048576 2024-09-14T10:54:14.163 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.164+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~AORP96RFAQCY.2 size=3862 2024-09-14T10:54:14.163 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.164+0000 7faa01046780 1 > prepared multipart upload key=X9DUVQBBLUTF upload=AORP96RFAQCY tag=A12QZKZ626FG type=write size=3149590 2024-09-14T10:54:14.164 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.166+0000 7faa01046780 1 < canceled operation key=XDJAK0XYQNF0 tag=Z5WU8LGKZQ2T type=del size=1697379 2024-09-14T10:54:14.167 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.168+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~P17F6TISBUQF.0 size=1048576 2024-09-14T10:54:14.168 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.169+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~P17F6TISBUQF.1 size=18738 2024-09-14T10:54:14.168 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.169+0000 7faa01046780 1 > prepared multipart upload key=SJ02N8472YDM upload=P17F6TISBUQF tag=NZJ1PCXG8DMP type=write size=2115890 2024-09-14T10:54:14.168 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.170+0000 7faa01046780 1 < canceled part key=_multipart_V11YJWHT4OOD.2~6J5JREYBJ5B9.0 size=940340 2024-09-14T10:54:14.171 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.172+0000 7faa01046780 1 < canceled multipart upload key=V11YJWHT4OOD upload=6J5JREYBJ5B9 tag=1GH76WR45JE4 type=write size=1988916 2024-09-14T10:54:14.173 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.174+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~L67OZ2A2ZUR0.0 size=1048576 2024-09-14T10:54:14.174 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.175+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~L67OZ2A2ZUR0.1 size=1048576 2024-09-14T10:54:14.176 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.177+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~L67OZ2A2ZUR0.2 size=159947 2024-09-14T10:54:14.176 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.177+0000 7faa01046780 1 > prepared multipart upload key=F872GLVQDCX6 upload=L67OZ2A2ZUR0 tag=RBT3X62AW164 type=write size=3305675 2024-09-14T10:54:14.179 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.180+0000 7faa01046780 1 < suggested remove operation key=XDJAK0XYQNF0 tag=55RTZMT5PYGY type=del 2024-09-14T10:54:14.181 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.183+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~K1O8F16TH18P.0 size=1048576 2024-09-14T10:54:14.183 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.183+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~K1O8F16TH18P.1 size=909196 2024-09-14T10:54:14.183 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.183+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=K1O8F16TH18P tag=IIUHXWWQ11TP type=write size=3006348 2024-09-14T10:54:14.184 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.185+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~EN9UH0ZLTE1R.0 size=1048576 2024-09-14T10:54:14.184 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.185+0000 7faa01046780 1 < canceled part key=_multipart_V11YJWHT4OOD.2~EN9UH0ZLTE1R.1 size=1048576 2024-09-14T10:54:14.185 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.186+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~EN9UH0ZLTE1R.2 size=24515 2024-09-14T10:54:14.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.189+0000 7faa01046780 1 < canceled multipart upload key=V11YJWHT4OOD upload=EN9UH0ZLTE1R tag=1WH7DTXKNUY8 type=write size=3170243 2024-09-14T10:54:14.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.190+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=AZ0VB3V17UXS type=write size=648823 2024-09-14T10:54:14.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.192+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~1XPQESGK5K5Q.0 size=667586 2024-09-14T10:54:14.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.194+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=1XPQESGK5K5Q tag=IQRLEVCL6UMS type=write size=1716162 2024-09-14T10:54:14.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.198+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~6HW15Q1WNVBL.0 size=630228 2024-09-14T10:54:14.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.198+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=6HW15Q1WNVBL tag=Y3XRW6B7OEZM type=write size=1678804 2024-09-14T10:54:14.197 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.198+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~PBS71CZQMV49.0 size=1048576 2024-09-14T10:54:14.197 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.198+0000 7faa01046780 1 < canceled part key=_multipart_HUBZAFMSCCNC.2~PBS71CZQMV49.1 size=599858 2024-09-14T10:54:14.199 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.201+0000 7faa01046780 1 < canceled multipart upload key=HUBZAFMSCCNC upload=PBS71CZQMV49 tag=67KQBXZND4V0 type=write size=2697010 2024-09-14T10:54:14.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.202+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=VJDH7CQSBOD9 type=del size=3476745 2024-09-14T10:54:14.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.204+0000 7faa01046780 1 < completed delete operation key=V11YJWHT4OOD tag=OL5KVUBN75Z9 type=del 2024-09-14T10:54:14.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.207+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~5GN9R73UESQU.0 size=957670 2024-09-14T10:54:14.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.207+0000 7faa01046780 1 > prepared multipart upload key=GG02P21TFKIM upload=5GN9R73UESQU tag=QHZZSBAR67GX type=write size=2006246 2024-09-14T10:54:14.206 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.208+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~6VEO5W7KEGGK.0 size=1048576 2024-09-14T10:54:14.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.209+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~6VEO5W7KEGGK.1 size=433479 2024-09-14T10:54:14.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.212+0000 7faa01046780 1 < completed multipart upload key=F06QWEOYNQX4 upload=6VEO5W7KEGGK tag=OX22KEAX1QSC type=write size=2530631 2024-09-14T10:54:14.211 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.213+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=WV48QG53IQ09 type=del size=1450148 2024-09-14T10:54:14.213 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.214+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~IQO6VSP4X428.0 size=1048576 2024-09-14T10:54:14.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.215+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~IQO6VSP4X428.1 size=1048576 2024-09-14T10:54:14.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.216+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~IQO6VSP4X428.2 size=422434 2024-09-14T10:54:14.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.219+0000 7faa01046780 1 < completed multipart upload key=S3BGVJ9N9S4P upload=IQO6VSP4X428 tag=2064VKZBNDR1 type=write size=3568162 2024-09-14T10:54:14.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.220+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=O01S36XLJEPB type=del size=3684224 2024-09-14T10:54:14.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.223+0000 7faa01046780 1 < suggested remove operation key=HUBZAFMSCCNC tag=2MCTT9HN7TF6 type=del 2024-09-14T10:54:14.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.224+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=WEC4UKZPL0OY type=del size=2736120 2024-09-14T10:54:14.224 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.226+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~I7B04DBAMYU9.0 size=102201 2024-09-14T10:54:14.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.228+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=I7B04DBAMYU9 tag=LXTOQG2HGKO0 type=write size=1150777 2024-09-14T10:54:14.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.229+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=BKFDE5HV6231 type=del size=3837704 2024-09-14T10:54:14.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.230+0000 7faa01046780 1 < canceled part key=_multipart_PBRZNGSOLJ8E.2~DWXGUK77WZ9A.0 size=1048576 2024-09-14T10:54:14.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.231+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~DWXGUK77WZ9A.1 size=1048576 2024-09-14T10:54:14.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.231+0000 7faa01046780 1 < canceled part key=_multipart_PBRZNGSOLJ8E.2~DWXGUK77WZ9A.2 size=73300 2024-09-14T10:54:14.231 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.233+0000 7faa01046780 1 < canceled multipart upload key=PBRZNGSOLJ8E upload=DWXGUK77WZ9A tag=FK7V06WUY87D type=write size=3219028 2024-09-14T10:54:14.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.235+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~63IIKWLJCY1V.0 size=1048576 2024-09-14T10:54:14.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.236+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~63IIKWLJCY1V.1 size=1048576 2024-09-14T10:54:14.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.237+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~63IIKWLJCY1V.2 size=901337 2024-09-14T10:54:14.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.237+0000 7faa01046780 1 > prepared multipart upload key=PBRZNGSOLJ8E upload=63IIKWLJCY1V tag=040YIU87TXFC type=write size=4047065 2024-09-14T10:54:14.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.239+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~ZLH4Q01JJ3B4.0 size=717191 2024-09-14T10:54:14.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.241+0000 7faa01046780 1 < completed multipart upload key=X9DUVQBBLUTF upload=ZLH4Q01JJ3B4 tag=IK34TO1B5YNY type=write size=1765767 2024-09-14T10:54:14.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.243+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~2EU9S8G09DKK.0 size=1048576 2024-09-14T10:54:14.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.244+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~2EU9S8G09DKK.1 size=1048576 2024-09-14T10:54:14.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.245+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~2EU9S8G09DKK.2 size=1027463 2024-09-14T10:54:14.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.245+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=2EU9S8G09DKK tag=SPVE0KP6F79V type=write size=4173191 2024-09-14T10:54:14.245 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.247+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~J45ORRNKL7I5.0 size=1048576 2024-09-14T10:54:14.247 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.248+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~J45ORRNKL7I5.1 size=579024 2024-09-14T10:54:14.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.250+0000 7faa01046780 1 < completed multipart upload key=PBRZNGSOLJ8E upload=J45ORRNKL7I5 tag=X4NCHGJEQXW7 type=write size=2676176 2024-09-14T10:54:14.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.252+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=QD9GI7LOA2VF type=del size=749540 2024-09-14T10:54:14.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.253+0000 7faa01046780 -1 < failed to complete operation key=XDJAK0XYQNF0 tag=NJLYWBI0780K type=del size=2645340: (22) Invalid argument 2024-09-14T10:54:14.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.255+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=2ILFBQW30C6L type=write size=659834 2024-09-14T10:54:14.255 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.256+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~AORP96RFAQCY.0 size=1048576 2024-09-14T10:54:14.256 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.258+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~AORP96RFAQCY.1 size=1048576 2024-09-14T10:54:14.257 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.259+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~AORP96RFAQCY.2 size=3862 2024-09-14T10:54:14.260 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.261+0000 7faa01046780 1 < completed multipart upload key=X9DUVQBBLUTF upload=AORP96RFAQCY tag=A12QZKZ626FG type=write size=3149590 2024-09-14T10:54:14.264 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.266+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~7GQONYO8O9SP.0 size=1048576 2024-09-14T10:54:14.265 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.267+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~7GQONYO8O9SP.1 size=494555 2024-09-14T10:54:14.265 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.267+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=7GQONYO8O9SP tag=FAYJ5ZTFH1GE type=write size=2591707 2024-09-14T10:54:14.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.268+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~P17F6TISBUQF.0 size=1048576 2024-09-14T10:54:14.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.269+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~P17F6TISBUQF.1 size=18738 2024-09-14T10:54:14.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.271+0000 7faa01046780 1 < completed multipart upload key=SJ02N8472YDM upload=P17F6TISBUQF tag=NZJ1PCXG8DMP type=write size=2115890 2024-09-14T10:54:14.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.272+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=3D7X01P06VOU type=del size=2594257 2024-09-14T10:54:14.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.274+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~L67OZ2A2ZUR0.0 size=1048576 2024-09-14T10:54:14.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.275+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~L67OZ2A2ZUR0.1 size=1048576 2024-09-14T10:54:14.274 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.276+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~L67OZ2A2ZUR0.2 size=159947 2024-09-14T10:54:14.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.279+0000 7faa01046780 1 < completed multipart upload key=F872GLVQDCX6 upload=L67OZ2A2ZUR0 tag=RBT3X62AW164 type=write size=3305675 2024-09-14T10:54:14.278 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.279+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=OFWG8LF1299U type=del size=808323 2024-09-14T10:54:14.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.281+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~K1O8F16TH18P.0 size=1048576 2024-09-14T10:54:14.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.283+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~K1O8F16TH18P.1 size=909196 2024-09-14T10:54:14.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.285+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=K1O8F16TH18P tag=IIUHXWWQ11TP type=write size=3006348 2024-09-14T10:54:14.285 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.286+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=ZAQ3R2RBOYSL type=del size=1708390 2024-09-14T10:54:14.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.288+0000 7faa01046780 1 < completed write operation key=HYAGNAOWK8LF tag=AZ0VB3V17UXS type=write size=648823 2024-09-14T10:54:14.289 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.290+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=Y31FHHW6K9V0 type=del size=1151541 2024-09-14T10:54:14.291 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.293+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~6HW15Q1WNVBL.0 size=630228 2024-09-14T10:54:14.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.295+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=6HW15Q1WNVBL tag=Y3XRW6B7OEZM type=write size=1678804 2024-09-14T10:54:14.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.296+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=3IUN645682IX type=del size=2064967 2024-09-14T10:54:14.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.298+0000 7faa01046780 1 < completed delete operation key=F872GLVQDCX6 tag=VJDH7CQSBOD9 type=del 2024-09-14T10:54:14.299 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.300+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~KVRDCLKKV6LM.0 size=1048576 2024-09-14T10:54:14.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.301+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~KVRDCLKKV6LM.1 size=1048576 2024-09-14T10:54:14.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.303+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~KVRDCLKKV6LM.2 size=279559 2024-09-14T10:54:14.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.303+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=KVRDCLKKV6LM tag=34TGPZN9KXXJ type=write size=3425287 2024-09-14T10:54:14.303 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.304+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~5GN9R73UESQU.0 size=957670 2024-09-14T10:54:14.305 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.306+0000 7faa01046780 1 < completed multipart upload key=GG02P21TFKIM upload=5GN9R73UESQU tag=QHZZSBAR67GX type=write size=2006246 2024-09-14T10:54:14.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.308+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=28NVL2FB3HJ2 type=del size=2416414 2024-09-14T10:54:14.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.309+0000 7faa01046780 1 < completed delete operation key=XH8GHY9YRGTP tag=WV48QG53IQ09 type=del 2024-09-14T10:54:14.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.310+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=OO6UBXELVXTR type=del size=2295418 2024-09-14T10:54:14.311 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.312+0000 7faa01046780 -1 < failed to complete operation key=HUBZAFMSCCNC tag=O01S36XLJEPB type=del size=3684224: (22) Invalid argument 2024-09-14T10:54:14.313 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.314+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~79A2HLI2M91A.0 size=1048576 2024-09-14T10:54:14.314 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.315+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~79A2HLI2M91A.1 size=1048576 2024-09-14T10:54:14.315 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.316+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~79A2HLI2M91A.2 size=861253 2024-09-14T10:54:14.315 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.316+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=79A2HLI2M91A tag=XH6EUY7MC05U type=write size=4006981 2024-09-14T10:54:14.317 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.318+0000 7faa01046780 1 < canceled operation key=GG02P21TFKIM tag=WEC4UKZPL0OY type=del size=2736120 2024-09-14T10:54:14.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.321+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~9XHI35TCOHBX.0 size=1048576 2024-09-14T10:54:14.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.323+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~9XHI35TCOHBX.1 size=1048576 2024-09-14T10:54:14.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.323+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~9XHI35TCOHBX.2 size=529712 2024-09-14T10:54:14.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.323+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=9XHI35TCOHBX tag=HGJXYLV59CGV type=write size=3675440 2024-09-14T10:54:14.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.325+0000 7faa01046780 1 < canceled operation key=TDNQZ8Y1C6X2 tag=BKFDE5HV6231 type=del size=3837704 2024-09-14T10:54:14.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.327+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=M0JZD353TTGZ type=del size=3757911 2024-09-14T10:54:14.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.328+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~63IIKWLJCY1V.0 size=1048576 2024-09-14T10:54:14.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.329+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~63IIKWLJCY1V.1 size=1048576 2024-09-14T10:54:14.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.331+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~63IIKWLJCY1V.2 size=901337 2024-09-14T10:54:14.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.334+0000 7faa01046780 1 < completed multipart upload key=PBRZNGSOLJ8E upload=63IIKWLJCY1V tag=040YIU87TXFC type=write size=4047065 2024-09-14T10:54:14.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.336+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~NVY6HES3302F.0 size=844934 2024-09-14T10:54:14.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.336+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=NVY6HES3302F tag=6QOKC297XO9D type=write size=1893510 2024-09-14T10:54:14.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.337+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~2EU9S8G09DKK.0 size=1048576 2024-09-14T10:54:14.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.338+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~2EU9S8G09DKK.1 size=1048576 2024-09-14T10:54:14.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.340+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~2EU9S8G09DKK.2 size=1027463 2024-09-14T10:54:14.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.342+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=2EU9S8G09DKK tag=SPVE0KP6F79V type=write size=4173191 2024-09-14T10:54:14.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.344+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~K27SVUL38N22.0 size=1048576 2024-09-14T10:54:14.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.345+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~K27SVUL38N22.1 size=940559 2024-09-14T10:54:14.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.345+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=K27SVUL38N22 tag=O4F3T76ZHUK8 type=write size=3037711 2024-09-14T10:54:14.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.347+0000 7faa01046780 1 < completed delete operation key=LF41PL7DFSJI tag=QD9GI7LOA2VF type=del 2024-09-14T10:54:14.348 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.349+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~D05J42N8FWF6.0 size=1048576 2024-09-14T10:54:14.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.350+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~D05J42N8FWF6.1 size=570976 2024-09-14T10:54:14.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.350+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=D05J42N8FWF6 tag=3S6DHN2UJPE3 type=write size=2668128 2024-09-14T10:54:14.350 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.351+0000 7faa01046780 1 < completed write operation key=V11YJWHT4OOD tag=2ILFBQW30C6L type=write size=659834 2024-09-14T10:54:14.352 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.353+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=GLXVEIEJNCL0 type=del size=3318029 2024-09-14T10:54:14.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.354+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~7GQONYO8O9SP.0 size=1048576 2024-09-14T10:54:14.354 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.355+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~7GQONYO8O9SP.1 size=494555 2024-09-14T10:54:14.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.358+0000 7faa01046780 1 < completed multipart upload key=0XVVSUIOBQPL upload=7GQONYO8O9SP tag=FAYJ5ZTFH1GE type=write size=2591707 2024-09-14T10:54:14.359 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.360+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~PKRZIIREGJRO.0 size=1048576 2024-09-14T10:54:14.360 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.361+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~PKRZIIREGJRO.1 size=46192 2024-09-14T10:54:14.360 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.361+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=PKRZIIREGJRO tag=2SHDBNVV6EQU type=write size=2143344 2024-09-14T10:54:14.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.362+0000 7faa01046780 1 < completed delete operation key=TDNQZ8Y1C6X2 tag=3D7X01P06VOU type=del 2024-09-14T10:54:14.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.366+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~2N8WI67TKNO3.0 size=1048576 2024-09-14T10:54:14.365 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.367+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~2N8WI67TKNO3.1 size=584091 2024-09-14T10:54:14.365 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.367+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=2N8WI67TKNO3 tag=GRRDX9ODVD1K type=write size=2681243 2024-09-14T10:54:14.366 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.367+0000 7faa01046780 1 < canceled operation key=VIO703UXIJXV tag=OFWG8LF1299U type=del size=808323 2024-09-14T10:54:14.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.371+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~Q5T9T5V9ZS7Z.0 size=1048576 2024-09-14T10:54:14.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.371+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~Q5T9T5V9ZS7Z.1 size=1048576 2024-09-14T10:54:14.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.372+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~Q5T9T5V9ZS7Z.2 size=285022 2024-09-14T10:54:14.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.372+0000 7faa01046780 1 > prepared multipart upload key=PS2QU1UZUYHE upload=Q5T9T5V9ZS7Z tag=5S8WBCMDZV3E type=write size=3430750 2024-09-14T10:54:14.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.374+0000 7faa01046780 1 < completed delete operation key=PS2QU1UZUYHE tag=ZAQ3R2RBOYSL type=del 2024-09-14T10:54:14.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.375+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=X48QM047BAEH type=del size=3465476 2024-09-14T10:54:14.375 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.376+0000 7faa01046780 1 < completed delete operation key=VIO703UXIJXV tag=Y31FHHW6K9V0 type=del 2024-09-14T10:54:14.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.379+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~JZADJAX0GYGW.0 size=1048576 2024-09-14T10:54:14.378 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.380+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~JZADJAX0GYGW.1 size=470357 2024-09-14T10:54:14.378 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.380+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=JZADJAX0GYGW tag=SQCZCW5JO935 type=write size=2567509 2024-09-14T10:54:14.381 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.382+0000 7faa01046780 1 < suggested update operation key=F872GLVQDCX6 tag=3IUN645682IX type=del size=2064967 2024-09-14T10:54:14.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.384+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=RIQB1GVLZPPQ type=write size=749397 2024-09-14T10:54:14.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.384+0000 7faa01046780 1 < canceled part key=_multipart_V5T3AN9D7DH6.2~KVRDCLKKV6LM.0 size=1048576 2024-09-14T10:54:14.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.385+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~KVRDCLKKV6LM.1 size=1048576 2024-09-14T10:54:14.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.386+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~KVRDCLKKV6LM.2 size=279559 2024-09-14T10:54:14.387 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.388+0000 7faa01046780 1 < canceled multipart upload key=V5T3AN9D7DH6 upload=KVRDCLKKV6LM tag=34TGPZN9KXXJ type=write size=3425287 2024-09-14T10:54:14.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.391+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~NQ44C78BM1Y6.0 size=1048576 2024-09-14T10:54:14.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.392+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~NQ44C78BM1Y6.1 size=749209 2024-09-14T10:54:14.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.392+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=NQ44C78BM1Y6 tag=MML25RS1H53B type=write size=2846361 2024-09-14T10:54:14.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.394+0000 7faa01046780 1 < completed delete operation key=LF41PL7DFSJI tag=28NVL2FB3HJ2 type=del 2024-09-14T10:54:14.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.397+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~1V1WPT8O3H7H.0 size=1048576 2024-09-14T10:54:14.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.398+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~1V1WPT8O3H7H.1 size=743709 2024-09-14T10:54:14.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.398+0000 7faa01046780 1 > prepared multipart upload key=F06QWEOYNQX4 upload=1V1WPT8O3H7H tag=C7NTU0NNL018 type=write size=2840861 2024-09-14T10:54:14.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.399+0000 7faa01046780 1 < completed delete operation key=0XVVSUIOBQPL tag=OO6UBXELVXTR type=del 2024-09-14T10:54:14.400 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.402+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=KWD4EMPV0N0V type=del size=1257169 2024-09-14T10:54:14.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.403+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~79A2HLI2M91A.0 size=1048576 2024-09-14T10:54:14.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.404+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~79A2HLI2M91A.1 size=1048576 2024-09-14T10:54:14.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.406+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~79A2HLI2M91A.2 size=861253 2024-09-14T10:54:14.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.408+0000 7faa01046780 1 < completed multipart upload key=KDUTH9PIR3FI upload=79A2HLI2M91A tag=XH6EUY7MC05U type=write size=4006981 2024-09-14T10:54:14.407 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.409+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=NSG4GB97I6RB type=del size=34545 2024-09-14T10:54:14.408 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.410+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~9XHI35TCOHBX.0 size=1048576 2024-09-14T10:54:14.410 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.411+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~9XHI35TCOHBX.1 size=1048576 2024-09-14T10:54:14.411 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.413+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~9XHI35TCOHBX.2 size=529712 2024-09-14T10:54:14.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.415+0000 7faa01046780 1 < completed multipart upload key=U8TE0XNK9YKM upload=9XHI35TCOHBX tag=HGJXYLV59CGV type=write size=3675440 2024-09-14T10:54:14.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.416+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=LTX2Z0ZSBXNP type=del size=221204 2024-09-14T10:54:14.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.417+0000 7faa01046780 1 < completed delete operation key=V11YJWHT4OOD tag=M0JZD353TTGZ type=del 2024-09-14T10:54:14.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.419+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=6ZB5U1367I50 type=write size=474943 2024-09-14T10:54:14.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.421+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~NVY6HES3302F.0 size=844934 2024-09-14T10:54:14.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.422+0000 7faa01046780 1 < completed multipart upload key=CKMDOO75UZGE upload=NVY6HES3302F tag=6QOKC297XO9D type=write size=1893510 2024-09-14T10:54:14.424 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.426+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~HZPU3HN3741J.0 size=1048576 2024-09-14T10:54:14.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.427+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~HZPU3HN3741J.1 size=665252 2024-09-14T10:54:14.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.427+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=HZPU3HN3741J tag=P5VMF9XSZAEX type=write size=2762404 2024-09-14T10:54:14.426 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.427+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~K27SVUL38N22.0 size=1048576 2024-09-14T10:54:14.427 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.428+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~K27SVUL38N22.1 size=940559 2024-09-14T10:54:14.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.432+0000 7faa01046780 1 < completed multipart upload key=0OL3SF5IWDMH upload=K27SVUL38N22 tag=O4F3T76ZHUK8 type=write size=3037711 2024-09-14T10:54:14.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.433+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=0NX6ZWIATH4S type=del size=3301529 2024-09-14T10:54:14.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.434+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~D05J42N8FWF6.0 size=1048576 2024-09-14T10:54:14.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.436+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~D05J42N8FWF6.1 size=570976 2024-09-14T10:54:14.436 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.438+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=D05J42N8FWF6 tag=3S6DHN2UJPE3 type=write size=2668128 2024-09-14T10:54:14.439 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.440+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~C3VGU9NRGEX7.0 size=217720 2024-09-14T10:54:14.439 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.440+0000 7faa01046780 1 > prepared multipart upload key=3UEX0IPM4CPY upload=C3VGU9NRGEX7 tag=8PZ8KELXK40T type=write size=1266296 2024-09-14T10:54:14.441 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.443+0000 7faa01046780 1 < suggested remove operation key=HUBZAFMSCCNC tag=GLXVEIEJNCL0 type=del 2024-09-14T10:54:14.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.444+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=GJTSUJ5HN3LD type=del size=3134639 2024-09-14T10:54:14.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.446+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~PKRZIIREGJRO.0 size=1048576 2024-09-14T10:54:14.446 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.448+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~PKRZIIREGJRO.1 size=46192 2024-09-14T10:54:14.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.451+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=PKRZIIREGJRO tag=2SHDBNVV6EQU type=write size=2143344 2024-09-14T10:54:14.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.453+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~OLYV63ZFHWLL.0 size=260878 2024-09-14T10:54:14.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.453+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=OLYV63ZFHWLL tag=84ZIGGY8PY4T type=write size=1309454 2024-09-14T10:54:14.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.455+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~2N8WI67TKNO3.0 size=1048576 2024-09-14T10:54:14.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.455+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~2N8WI67TKNO3.1 size=584091 2024-09-14T10:54:14.456 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.458+0000 7faa01046780 1 < completed multipart upload key=S3BGVJ9N9S4P upload=2N8WI67TKNO3 tag=GRRDX9ODVD1K type=write size=2681243 2024-09-14T10:54:14.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.462+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~SWLUSY7P5GQ9.0 size=1048576 2024-09-14T10:54:14.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.462+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~SWLUSY7P5GQ9.1 size=1048576 2024-09-14T10:54:14.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.463+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~SWLUSY7P5GQ9.2 size=574723 2024-09-14T10:54:14.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.463+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=SWLUSY7P5GQ9 tag=9UPVBQL0NHRK type=write size=3720451 2024-09-14T10:54:14.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.465+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~Q5T9T5V9ZS7Z.0 size=1048576 2024-09-14T10:54:14.464 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.466+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~Q5T9T5V9ZS7Z.1 size=1048576 2024-09-14T10:54:14.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.467+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~Q5T9T5V9ZS7Z.2 size=285022 2024-09-14T10:54:14.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.470+0000 7faa01046780 1 < completed multipart upload key=PS2QU1UZUYHE upload=Q5T9T5V9ZS7Z tag=5S8WBCMDZV3E type=write size=3430750 2024-09-14T10:54:14.469 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.471+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=NWVWP2F5333X type=del size=3706943 2024-09-14T10:54:14.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.472+0000 7faa01046780 1 < canceled operation key=V11YJWHT4OOD tag=X48QM047BAEH type=del size=3465476 2024-09-14T10:54:14.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.474+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=ESMN7DEU6YBU type=del size=14948 2024-09-14T10:54:14.474 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.476+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~JZADJAX0GYGW.0 size=1048576 2024-09-14T10:54:14.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.476+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~JZADJAX0GYGW.1 size=470357 2024-09-14T10:54:14.477 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.479+0000 7faa01046780 1 < completed multipart upload key=V5T3AN9D7DH6 upload=JZADJAX0GYGW tag=SQCZCW5JO935 type=write size=2567509 2024-09-14T10:54:14.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.481+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~S83EQTTLE52U.0 size=1048576 2024-09-14T10:54:14.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.483+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~S83EQTTLE52U.1 size=1048576 2024-09-14T10:54:14.482 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.483+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~S83EQTTLE52U.2 size=354890 2024-09-14T10:54:14.482 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.483+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=S83EQTTLE52U tag=9N56WUHEP5BH type=write size=3500618 2024-09-14T10:54:14.483 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.485+0000 7faa01046780 1 < completed write operation key=0OL3SF5IWDMH tag=RIQB1GVLZPPQ type=write size=749397 2024-09-14T10:54:14.486 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.488+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~UQR0VHUOG6UN.0 size=1048576 2024-09-14T10:54:14.487 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.488+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~UQR0VHUOG6UN.1 size=373314 2024-09-14T10:54:14.487 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.488+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=UQR0VHUOG6UN tag=3VVTK4RFPCTZ type=write size=2470466 2024-09-14T10:54:14.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.489+0000 7faa01046780 1 < canceled part key=_multipart_BBDTPL35W4W0.2~NQ44C78BM1Y6.0 size=1048576 2024-09-14T10:54:14.489 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.490+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~NQ44C78BM1Y6.1 size=749209 2024-09-14T10:54:14.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.492+0000 7faa01046780 1 < canceled multipart upload key=BBDTPL35W4W0 upload=NQ44C78BM1Y6 tag=MML25RS1H53B type=write size=2846361 2024-09-14T10:54:14.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.494+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=7AJQKQCTK718 type=del size=2392484 2024-09-14T10:54:14.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.495+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~1V1WPT8O3H7H.0 size=1048576 2024-09-14T10:54:14.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.496+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~1V1WPT8O3H7H.1 size=743709 2024-09-14T10:54:14.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.499+0000 7faa01046780 1 < completed multipart upload key=F06QWEOYNQX4 upload=1V1WPT8O3H7H tag=C7NTU0NNL018 type=write size=2840861 2024-09-14T10:54:14.500 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.501+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~IBR7H3MWP7UM.0 size=990495 2024-09-14T10:54:14.500 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.501+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=IBR7H3MWP7UM tag=NEBVVPITHORM type=write size=2039071 2024-09-14T10:54:14.501 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.503+0000 7faa01046780 1 < completed delete operation key=BBDTPL35W4W0 tag=KWD4EMPV0N0V type=del 2024-09-14T10:54:14.504 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.505+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~6DPAGX8GIOSK.0 size=797066 2024-09-14T10:54:14.504 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.505+0000 7faa01046780 1 > prepared multipart upload key=VIO703UXIJXV upload=6DPAGX8GIOSK tag=6GNNCIUOBIUP type=write size=1845642 2024-09-14T10:54:14.507 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.508+0000 7faa01046780 1 < suggested remove operation key=0XVVSUIOBQPL tag=NSG4GB97I6RB type=del 2024-09-14T10:54:14.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.509+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=5I9DWZ0L5KWF type=del size=822155 2024-09-14T10:54:14.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.511+0000 7faa01046780 1 < canceled operation key=XDJAK0XYQNF0 tag=LTX2Z0ZSBXNP type=del size=221204 2024-09-14T10:54:14.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.512+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=G2PVFBTUF9U3 type=del size=3877588 2024-09-14T10:54:14.512 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.513+0000 7faa01046780 -1 < failed to complete operation key=0XVVSUIOBQPL tag=6ZB5U1367I50 type=write size=474943: (22) Invalid argument 2024-09-14T10:54:14.515 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.516+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~TS28SWD7YWMT.0 size=793745 2024-09-14T10:54:14.515 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.516+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=TS28SWD7YWMT tag=ID3CU63ND1VT type=write size=1842321 2024-09-14T10:54:14.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.517+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~HZPU3HN3741J.0 size=1048576 2024-09-14T10:54:14.517 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.519+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~HZPU3HN3741J.1 size=665252 2024-09-14T10:54:14.520 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.522+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=HZPU3HN3741J tag=P5VMF9XSZAEX type=write size=2762404 2024-09-14T10:54:14.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.525+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~K7MCX0AG8663.0 size=411751 2024-09-14T10:54:14.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.525+0000 7faa01046780 1 > prepared multipart upload key=VIO703UXIJXV upload=K7MCX0AG8663 tag=8RFYMXYGJ6BN type=write size=1460327 2024-09-14T10:54:14.526 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.528+0000 7faa01046780 1 < suggested remove operation key=U8TE0XNK9YKM tag=0NX6ZWIATH4S type=del 2024-09-14T10:54:14.528 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.529+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=B0PPGD1B0JO4 type=del size=3202092 2024-09-14T10:54:14.528 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.529+0000 7faa01046780 1 < canceled part key=_multipart_3UEX0IPM4CPY.2~C3VGU9NRGEX7.0 size=217720 2024-09-14T10:54:14.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.532+0000 7faa01046780 1 < canceled multipart upload key=3UEX0IPM4CPY upload=C3VGU9NRGEX7 tag=8PZ8KELXK40T type=write size=1266296 2024-09-14T10:54:14.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.534+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~HV5320GE6745.0 size=1048576 2024-09-14T10:54:14.534 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.535+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~HV5320GE6745.1 size=984087 2024-09-14T10:54:14.534 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.535+0000 7faa01046780 1 > prepared multipart upload key=SJ02N8472YDM upload=HV5320GE6745 tag=QDO8A7J1Q3FA type=write size=3081239 2024-09-14T10:54:14.535 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.536+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=GJTSUJ5HN3LD type=del 2024-09-14T10:54:14.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.538+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=7SIKMKRA97B6 type=write size=536399 2024-09-14T10:54:14.538 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.539+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~OLYV63ZFHWLL.0 size=260878 2024-09-14T10:54:14.540 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.542+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=OLYV63ZFHWLL tag=84ZIGGY8PY4T type=write size=1309454 2024-09-14T10:54:14.543 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.544+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~TQ186OJ2AYS5.0 size=1048576 2024-09-14T10:54:14.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.545+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~TQ186OJ2AYS5.1 size=1048576 2024-09-14T10:54:14.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.547+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~TQ186OJ2AYS5.2 size=114282 2024-09-14T10:54:14.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.547+0000 7faa01046780 1 > prepared multipart upload key=GG02P21TFKIM upload=TQ186OJ2AYS5 tag=1PE2XWJQDHB4 type=write size=3260010 2024-09-14T10:54:14.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.547+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~SWLUSY7P5GQ9.0 size=1048576 2024-09-14T10:54:14.547 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.549+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~SWLUSY7P5GQ9.1 size=1048576 2024-09-14T10:54:14.548 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.550+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~SWLUSY7P5GQ9.2 size=574723 2024-09-14T10:54:14.551 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.552+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=SWLUSY7P5GQ9 tag=9UPVBQL0NHRK type=write size=3720451 2024-09-14T10:54:14.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.553+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=39W2DHJTOCOL type=del size=3834214 2024-09-14T10:54:14.553 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.555+0000 7faa01046780 1 < canceled operation key=GG02P21TFKIM tag=NWVWP2F5333X type=del size=3706943 2024-09-14T10:54:14.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.557+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=ER2H310QPTJ7 type=del size=1537905 2024-09-14T10:54:14.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.558+0000 7faa01046780 1 < completed delete operation key=VIO703UXIJXV tag=ESMN7DEU6YBU type=del 2024-09-14T10:54:14.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.560+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=RX2JA2B3XOAX type=del size=2458079 2024-09-14T10:54:14.560 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.561+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~S83EQTTLE52U.0 size=1048576 2024-09-14T10:54:14.561 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.562+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~S83EQTTLE52U.1 size=1048576 2024-09-14T10:54:14.562 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.563+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~S83EQTTLE52U.2 size=354890 2024-09-14T10:54:14.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.567+0000 7faa01046780 1 < completed multipart upload key=KDUTH9PIR3FI upload=S83EQTTLE52U tag=9N56WUHEP5BH type=write size=3500618 2024-09-14T10:54:14.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.568+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~6FQYUB59CVHO.0 size=1048576 2024-09-14T10:54:14.568 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.570+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~6FQYUB59CVHO.1 size=369736 2024-09-14T10:54:14.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.570+0000 7faa01046780 1 > prepared multipart upload key=VIO703UXIJXV upload=6FQYUB59CVHO tag=JIUZ4YDDSL1S type=write size=2466888 2024-09-14T10:54:14.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.571+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~UQR0VHUOG6UN.0 size=1048576 2024-09-14T10:54:14.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.572+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~UQR0VHUOG6UN.1 size=373314 2024-09-14T10:54:14.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.575+0000 7faa01046780 1 < completed multipart upload key=Y4CB0HIN0750 upload=UQR0VHUOG6UN tag=3VVTK4RFPCTZ type=write size=2470466 2024-09-14T10:54:14.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.577+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=P8H10IJ2V8C4 type=del size=3467251 2024-09-14T10:54:14.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.578+0000 7faa01046780 1 < completed delete operation key=X9DUVQBBLUTF tag=7AJQKQCTK718 type=del 2024-09-14T10:54:14.579 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.580+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~BSUI6JNRB75I.0 size=1048576 2024-09-14T10:54:14.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.581+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~BSUI6JNRB75I.1 size=695930 2024-09-14T10:54:14.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.581+0000 7faa01046780 1 > prepared multipart upload key=ZY0BY3G9NREC upload=BSUI6JNRB75I tag=M1V41HD2H0OQ type=write size=2793082 2024-09-14T10:54:14.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.584+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~IBR7H3MWP7UM.0 size=990495 2024-09-14T10:54:14.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.585+0000 7faa01046780 1 < completed multipart upload key=0XVVSUIOBQPL upload=IBR7H3MWP7UM tag=NEBVVPITHORM type=write size=2039071 2024-09-14T10:54:14.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.586+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=W2PFGB2E547K type=write size=398716 2024-09-14T10:54:14.587 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.588+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~6DPAGX8GIOSK.0 size=797066 2024-09-14T10:54:14.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.591+0000 7faa01046780 1 < completed multipart upload key=VIO703UXIJXV upload=6DPAGX8GIOSK tag=6GNNCIUOBIUP type=write size=1845642 2024-09-14T10:54:14.591 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.592+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=9N71DEE46NJJ type=del size=675264 2024-09-14T10:54:14.592 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.593+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=5I9DWZ0L5KWF type=del 2024-09-14T10:54:14.594 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.595+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=3ZSSS1ND1MTU type=del size=1870144 2024-09-14T10:54:14.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.598+0000 7faa01046780 1 < suggested remove operation key=TDNQZ8Y1C6X2 tag=G2PVFBTUF9U3 type=del 2024-09-14T10:54:14.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.599+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=W1F6R3HLLJIK type=del size=4143857 2024-09-14T10:54:14.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.601+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~TS28SWD7YWMT.0 size=793745 2024-09-14T10:54:14.602 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.603+0000 7faa01046780 1 < completed multipart upload key=HYAGNAOWK8LF upload=TS28SWD7YWMT tag=ID3CU63ND1VT type=write size=1842321 2024-09-14T10:54:14.603 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.605+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=JVR0Z9NH1DSU type=del size=2536055 2024-09-14T10:54:14.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.606+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~K7MCX0AG8663.0 size=411751 2024-09-14T10:54:14.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.609+0000 7faa01046780 1 < completed multipart upload key=VIO703UXIJXV upload=K7MCX0AG8663 tag=8RFYMXYGJ6BN type=write size=1460327 2024-09-14T10:54:14.609 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.610+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=AL4EXYJ2EFIE type=del size=563385 2024-09-14T10:54:14.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.614+0000 7faa01046780 1 < suggested update operation key=PBRZNGSOLJ8E tag=B0PPGD1B0JO4 type=del size=3202092 2024-09-14T10:54:14.615 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.617+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~CN4JO4GKYGUR.0 size=1048576 2024-09-14T10:54:14.616 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.618+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~CN4JO4GKYGUR.1 size=197421 2024-09-14T10:54:14.617 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.618+0000 7faa01046780 1 > prepared multipart upload key=FOJGGEQZD7YW upload=CN4JO4GKYGUR tag=8VQTMKSZM67I type=write size=2294573 2024-09-14T10:54:14.618 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.620+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~HV5320GE6745.0 size=1048576 2024-09-14T10:54:14.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.620+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~HV5320GE6745.1 size=984087 2024-09-14T10:54:14.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.623+0000 7faa01046780 1 < completed multipart upload key=SJ02N8472YDM upload=HV5320GE6745 tag=QDO8A7J1Q3FA type=write size=3081239 2024-09-14T10:54:14.623 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.625+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=8NWEGIG5YY45 type=del size=2599834 2024-09-14T10:54:14.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.626+0000 7faa01046780 -1 < failed to complete operation key=PBRZNGSOLJ8E tag=7SIKMKRA97B6 type=write size=536399: (22) Invalid argument 2024-09-14T10:54:14.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.628+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~31T98DU00TZG.0 size=1048576 2024-09-14T10:54:14.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.629+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~31T98DU00TZG.1 size=1048576 2024-09-14T10:54:14.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.631+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~31T98DU00TZG.2 size=666958 2024-09-14T10:54:14.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.631+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=31T98DU00TZG tag=EMQMJ29CHYYY type=write size=3812686 2024-09-14T10:54:14.631 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.633+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~TQ186OJ2AYS5.0 size=1048576 2024-09-14T10:54:14.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.633+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~TQ186OJ2AYS5.1 size=1048576 2024-09-14T10:54:14.633 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.634+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~TQ186OJ2AYS5.2 size=114282 2024-09-14T10:54:14.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.636+0000 7faa01046780 1 < completed multipart upload key=GG02P21TFKIM upload=TQ186OJ2AYS5 tag=1PE2XWJQDHB4 type=write size=3260010 2024-09-14T10:54:14.638 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.639+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~J1EQTH5Q2XY1.0 size=1048576 2024-09-14T10:54:14.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.641+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~J1EQTH5Q2XY1.1 size=157417 2024-09-14T10:54:14.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.641+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=J1EQTH5Q2XY1 tag=RXTM1IYE4UBP type=write size=2254569 2024-09-14T10:54:14.641 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.642+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=39W2DHJTOCOL type=del 2024-09-14T10:54:14.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.645+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~ZAW9PI5F3N17.0 size=1048576 2024-09-14T10:54:14.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.646+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~ZAW9PI5F3N17.1 size=405165 2024-09-14T10:54:14.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.646+0000 7faa01046780 1 > prepared multipart upload key=FOJGGEQZD7YW upload=ZAW9PI5F3N17 tag=UKHV2NQX2R08 type=write size=2502317 2024-09-14T10:54:14.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.647+0000 7faa01046780 1 < completed delete operation key=BBDTPL35W4W0 tag=ER2H310QPTJ7 type=del 2024-09-14T10:54:14.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.651+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~Y14TJZDVKGUA.0 size=377288 2024-09-14T10:54:14.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.651+0000 7faa01046780 1 > prepared multipart upload key=PS2QU1UZUYHE upload=Y14TJZDVKGUA tag=6HGQAX8QWPUG type=write size=1425864 2024-09-14T10:54:14.650 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.651+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=RX2JA2B3XOAX type=del 2024-09-14T10:54:14.651 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.653+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=WG7F47CZ5Z9L type=del size=959372 2024-09-14T10:54:14.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.654+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~6FQYUB59CVHO.0 size=1048576 2024-09-14T10:54:14.654 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.655+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~6FQYUB59CVHO.1 size=369736 2024-09-14T10:54:14.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.660+0000 7faa01046780 1 < completed multipart upload key=VIO703UXIJXV upload=6FQYUB59CVHO tag=JIUZ4YDDSL1S type=write size=2466888 2024-09-14T10:54:14.660 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.662+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~8QESYT2U2Z71.0 size=1048576 2024-09-14T10:54:14.662 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.663+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~8QESYT2U2Z71.1 size=586434 2024-09-14T10:54:14.662 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.663+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=8QESYT2U2Z71 tag=BSXX87KMUQ3D type=write size=2683586 2024-09-14T10:54:14.663 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.664+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=P8H10IJ2V8C4 type=del 2024-09-14T10:54:14.665 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.666+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=NXDHJS6NSPSG type=del size=1967535 2024-09-14T10:54:14.666 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.667+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~BSUI6JNRB75I.0 size=1048576 2024-09-14T10:54:14.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.668+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~BSUI6JNRB75I.1 size=695930 2024-09-14T10:54:14.669 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.671+0000 7faa01046780 1 < completed multipart upload key=ZY0BY3G9NREC upload=BSUI6JNRB75I tag=M1V41HD2H0OQ type=write size=2793082 2024-09-14T10:54:14.672 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.673+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~UTKSB64TAFYF.0 size=1048576 2024-09-14T10:54:14.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.674+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~UTKSB64TAFYF.1 size=449279 2024-09-14T10:54:14.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.674+0000 7faa01046780 1 > prepared multipart upload key=V11YJWHT4OOD upload=UTKSB64TAFYF tag=IJEJ4BMX3NKU type=write size=2546431 2024-09-14T10:54:14.674 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.676+0000 7faa01046780 1 < completed write operation key=0OL3SF5IWDMH tag=W2PFGB2E547K type=write size=398716 2024-09-14T10:54:14.676 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.677+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=1N2IQR4TKIKI type=del size=653036 2024-09-14T10:54:14.678 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.680+0000 7faa01046780 1 < completed delete operation key=XH8GHY9YRGTP tag=9N71DEE46NJJ type=del 2024-09-14T10:54:14.679 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.681+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=87GO89EC1WBE type=del size=2416785 2024-09-14T10:54:14.681 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.682+0000 7faa01046780 1 < completed delete operation key=KDUTH9PIR3FI tag=3ZSSS1ND1MTU type=del 2024-09-14T10:54:14.684 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.686+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~YTJ2H9EH6FPO.0 size=1048576 2024-09-14T10:54:14.685 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.686+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~YTJ2H9EH6FPO.1 size=659267 2024-09-14T10:54:14.685 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.686+0000 7faa01046780 1 > prepared multipart upload key=X9DUVQBBLUTF upload=YTJ2H9EH6FPO tag=UT2FD0C8OHGW type=write size=2756419 2024-09-14T10:54:14.686 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.688+0000 7faa01046780 1 < completed delete operation key=3UEX0IPM4CPY tag=W1F6R3HLLJIK type=del 2024-09-14T10:54:14.690 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.691+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~KBK643ZGE0FN.0 size=1048576 2024-09-14T10:54:14.691 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.692+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~KBK643ZGE0FN.1 size=1048576 2024-09-14T10:54:14.692 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.693+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~KBK643ZGE0FN.2 size=562129 2024-09-14T10:54:14.692 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.693+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=KBK643ZGE0FN tag=H4IYLBSF9I1E type=write size=3707857 2024-09-14T10:54:14.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.695+0000 7faa01046780 1 < completed delete operation key=NXIPG4HR9ZYY tag=JVR0Z9NH1DSU type=del 2024-09-14T10:54:14.695 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.696+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=421P2BB7OUZ1 type=del size=3571834 2024-09-14T10:54:14.697 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.698+0000 7faa01046780 1 < completed delete operation key=V905BR1VWUCV tag=AL4EXYJ2EFIE type=del 2024-09-14T10:54:14.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.701+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~DEWL1J3F9IKV.0 size=747740 2024-09-14T10:54:14.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.701+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=DEWL1J3F9IKV tag=15VHWQN7HNVP type=write size=1796316 2024-09-14T10:54:14.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.703+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~CN4JO4GKYGUR.0 size=1048576 2024-09-14T10:54:14.702 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.704+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~CN4JO4GKYGUR.1 size=197421 2024-09-14T10:54:14.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.706+0000 7faa01046780 1 < completed multipart upload key=FOJGGEQZD7YW upload=CN4JO4GKYGUR tag=8VQTMKSZM67I type=write size=2294573 2024-09-14T10:54:14.706 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.707+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=IXZ678DFPNPY type=del size=2546405 2024-09-14T10:54:14.708 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.710+0000 7faa01046780 1 < completed delete operation key=3FSH0OFMF54V tag=8NWEGIG5YY45 type=del 2024-09-14T10:54:14.709 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.711+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=GR980NWBPRTB type=del size=1027762 2024-09-14T10:54:14.711 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.712+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~31T98DU00TZG.0 size=1048576 2024-09-14T10:54:14.712 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.713+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~31T98DU00TZG.1 size=1048576 2024-09-14T10:54:14.713 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.715+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~31T98DU00TZG.2 size=666958 2024-09-14T10:54:14.716 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.718+0000 7faa01046780 1 < completed multipart upload key=0OL3SF5IWDMH upload=31T98DU00TZG tag=EMQMJ29CHYYY type=write size=3812686 2024-09-14T10:54:14.718 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.719+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=AL1PR1RZHDED type=del size=454932 2024-09-14T10:54:14.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.720+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~J1EQTH5Q2XY1.0 size=1048576 2024-09-14T10:54:14.720 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.722+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~J1EQTH5Q2XY1.1 size=157417 2024-09-14T10:54:14.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.725+0000 7faa01046780 1 < completed multipart upload key=KDUTH9PIR3FI upload=J1EQTH5Q2XY1 tag=RXTM1IYE4UBP type=write size=2254569 2024-09-14T10:54:14.728 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.728+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~A2N4FV6VUCZY.0 size=1048576 2024-09-14T10:54:14.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.729+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~A2N4FV6VUCZY.1 size=1048576 2024-09-14T10:54:14.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.730+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~A2N4FV6VUCZY.2 size=864450 2024-09-14T10:54:14.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.730+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=A2N4FV6VUCZY tag=GYGM64SSHTBE type=write size=4010178 2024-09-14T10:54:14.730 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.731+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~ZAW9PI5F3N17.0 size=1048576 2024-09-14T10:54:14.731 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.732+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~ZAW9PI5F3N17.1 size=405165 2024-09-14T10:54:14.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.735+0000 7faa01046780 1 < completed multipart upload key=FOJGGEQZD7YW upload=ZAW9PI5F3N17 tag=UKHV2NQX2R08 type=write size=2502317 2024-09-14T10:54:14.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.737+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=Y4UPVTB8IQ7G type=del size=3967090 2024-09-14T10:54:14.737 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.738+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~Y14TJZDVKGUA.0 size=377288 2024-09-14T10:54:14.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.740+0000 7faa01046780 1 < completed multipart upload key=PS2QU1UZUYHE upload=Y14TJZDVKGUA tag=6HGQAX8QWPUG type=write size=1425864 2024-09-14T10:54:14.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.741+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=S33AYQ0QY3S9 type=del size=313158 2024-09-14T10:54:14.742 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.743+0000 7faa01046780 1 < completed delete operation key=BBDTPL35W4W0 tag=WG7F47CZ5Z9L type=del 2024-09-14T10:54:14.743 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.744+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=MR3X5GVV7RIG type=del size=1493739 2024-09-14T10:54:14.744 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.746+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~8QESYT2U2Z71.0 size=1048576 2024-09-14T10:54:14.745 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.747+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~8QESYT2U2Z71.1 size=586434 2024-09-14T10:54:14.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.749+0000 7faa01046780 1 < completed multipart upload key=0XVVSUIOBQPL upload=8QESYT2U2Z71 tag=BSXX87KMUQ3D type=write size=2683586 2024-09-14T10:54:14.749 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.751+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=FN1C3RXKEHV7 type=del size=785619 2024-09-14T10:54:14.751 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.752+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=NXDHJS6NSPSG type=del 2024-09-14T10:54:14.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.754+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=4H5R7YP2V77Z type=del size=1222675 2024-09-14T10:54:14.754 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.756+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~UTKSB64TAFYF.0 size=1048576 2024-09-14T10:54:14.755 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.757+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~UTKSB64TAFYF.1 size=449279 2024-09-14T10:54:14.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.760+0000 7faa01046780 1 < completed multipart upload key=V11YJWHT4OOD upload=UTKSB64TAFYF tag=IJEJ4BMX3NKU type=write size=2546431 2024-09-14T10:54:14.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.761+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~M81Q5C6D9O5L.0 size=1048576 2024-09-14T10:54:14.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.763+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~M81Q5C6D9O5L.1 size=1048576 2024-09-14T10:54:14.763 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.764+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~M81Q5C6D9O5L.2 size=897651 2024-09-14T10:54:14.763 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.764+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=M81Q5C6D9O5L tag=01L5FENVWTWE type=write size=4043379 2024-09-14T10:54:14.764 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.766+0000 7faa01046780 1 < completed delete operation key=BBDTPL35W4W0 tag=1N2IQR4TKIKI type=del 2024-09-14T10:54:14.766 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.767+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=2Y7GZ3NYPUK3 type=del size=866724 2024-09-14T10:54:14.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.770+0000 7faa01046780 1 < suggested remove operation key=BBDTPL35W4W0 tag=87GO89EC1WBE type=del 2024-09-14T10:54:14.771 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.772+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~5FFQUAV8ZGU6.0 size=1048576 2024-09-14T10:54:14.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.773+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~5FFQUAV8ZGU6.1 size=655064 2024-09-14T10:54:14.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.773+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=5FFQUAV8ZGU6 tag=S12GUGQKZ8ZI type=write size=2752216 2024-09-14T10:54:14.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.775+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~YTJ2H9EH6FPO.0 size=1048576 2024-09-14T10:54:14.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.776+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~YTJ2H9EH6FPO.1 size=659267 2024-09-14T10:54:14.777 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.779+0000 7faa01046780 1 < completed multipart upload key=X9DUVQBBLUTF upload=YTJ2H9EH6FPO tag=UT2FD0C8OHGW type=write size=2756419 2024-09-14T10:54:14.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.780+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=8VYFK4RQ7GXP type=del size=113729 2024-09-14T10:54:14.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.782+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~KBK643ZGE0FN.0 size=1048576 2024-09-14T10:54:14.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.783+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~KBK643ZGE0FN.1 size=1048576 2024-09-14T10:54:14.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.783+0000 7faa01046780 1 < canceled part key=_multipart_V5T3AN9D7DH6.2~KBK643ZGE0FN.2 size=562129 2024-09-14T10:54:14.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.785+0000 7faa01046780 1 < canceled multipart upload key=V5T3AN9D7DH6 upload=KBK643ZGE0FN tag=H4IYLBSF9I1E type=write size=3707857 2024-09-14T10:54:14.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.786+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=VTFLGEYLNLO2 type=write size=567549 2024-09-14T10:54:14.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.788+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=421P2BB7OUZ1 type=del 2024-09-14T10:54:14.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.790+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=KTRYOW3PWEAG type=del size=1656401 2024-09-14T10:54:14.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.791+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~DEWL1J3F9IKV.0 size=747740 2024-09-14T10:54:14.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.794+0000 7faa01046780 1 < completed multipart upload key=V5T3AN9D7DH6 upload=DEWL1J3F9IKV tag=15VHWQN7HNVP type=write size=1796316 2024-09-14T10:54:14.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.796+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=65608W7VGNB4 type=write size=425681 2024-09-14T10:54:14.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.797+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=IXZ678DFPNPY type=del 2024-09-14T10:54:14.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.799+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=WKML6KNXZH7B type=write size=783062 2024-09-14T10:54:14.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.800+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=GR980NWBPRTB type=del 2024-09-14T10:54:14.802 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.804+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~U8UBLX8M6YQT.0 size=50216 2024-09-14T10:54:14.802 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.804+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=U8UBLX8M6YQT tag=C89JG52XGB3Q type=write size=1098792 2024-09-14T10:54:14.803 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.805+0000 7faa01046780 1 < completed delete operation key=X9DUVQBBLUTF tag=AL1PR1RZHDED type=del 2024-09-14T10:54:14.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.808+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~G0I2SK6OIK2D.0 size=1048576 2024-09-14T10:54:14.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.808+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~G0I2SK6OIK2D.1 size=990807 2024-09-14T10:54:14.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.808+0000 7faa01046780 1 > prepared multipart upload key=ZY0BY3G9NREC upload=G0I2SK6OIK2D tag=QRH8GQ67U0G0 type=write size=3087959 2024-09-14T10:54:14.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.810+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~A2N4FV6VUCZY.0 size=1048576 2024-09-14T10:54:14.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.811+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~A2N4FV6VUCZY.1 size=1048576 2024-09-14T10:54:14.811 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.813+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~A2N4FV6VUCZY.2 size=864450 2024-09-14T10:54:14.813 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.815+0000 7faa01046780 1 < completed multipart upload key=S3BGVJ9N9S4P upload=A2N4FV6VUCZY tag=GYGM64SSHTBE type=write size=4010178 2024-09-14T10:54:14.816 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.817+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~FXSRBO47BGIR.0 size=968348 2024-09-14T10:54:14.816 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.817+0000 7faa01046780 1 > prepared multipart upload key=FOJGGEQZD7YW upload=FXSRBO47BGIR tag=9IC640EBKRWD type=write size=2016924 2024-09-14T10:54:14.819 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.820+0000 7faa01046780 1 < suggested remove operation key=3UEX0IPM4CPY tag=Y4UPVTB8IQ7G type=del 2024-09-14T10:54:14.820 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.821+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=9VCRG4JDCBOW type=del size=7175 2024-09-14T10:54:14.821 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.822+0000 7faa01046780 1 < completed delete operation key=XH8GHY9YRGTP tag=S33AYQ0QY3S9 type=del 2024-09-14T10:54:14.824 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.825+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~FY00WPZGB2FU.0 size=1048576 2024-09-14T10:54:14.825 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.826+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~FY00WPZGB2FU.1 size=909180 2024-09-14T10:54:14.825 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.826+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=FY00WPZGB2FU tag=8J0E6XDSCH8K type=write size=3006332 2024-09-14T10:54:14.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.830+0000 7faa01046780 1 < suggested update operation key=F06QWEOYNQX4 tag=MR3X5GVV7RIG type=del size=1493739 2024-09-14T10:54:14.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.831+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=C5V0ZW6ZRYAC type=del size=836873 2024-09-14T10:54:14.831 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.832+0000 7faa01046780 1 < completed delete operation key=Q33ET1AN14NG tag=FN1C3RXKEHV7 type=del 2024-09-14T10:54:14.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.834+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=ETKQK1HWS9UH type=del size=1804665 2024-09-14T10:54:14.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.835+0000 7faa01046780 1 < completed delete operation key=0OL3SF5IWDMH tag=4H5R7YP2V77Z type=del 2024-09-14T10:54:14.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.838+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~8H622VU94J7T.0 size=1048576 2024-09-14T10:54:14.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.839+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~8H622VU94J7T.1 size=304234 2024-09-14T10:54:14.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.839+0000 7faa01046780 1 > prepared multipart upload key=FOJGGEQZD7YW upload=8H622VU94J7T tag=6AQ1H08PKGX0 type=write size=2401386 2024-09-14T10:54:14.839 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.841+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~M81Q5C6D9O5L.0 size=1048576 2024-09-14T10:54:14.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.841+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~M81Q5C6D9O5L.1 size=1048576 2024-09-14T10:54:14.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.843+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~M81Q5C6D9O5L.2 size=897651 2024-09-14T10:54:14.844 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.846+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=M81Q5C6D9O5L tag=01L5FENVWTWE type=write size=4043379 2024-09-14T10:54:14.847 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.848+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~M44FLQV7C87P.0 size=1048576 2024-09-14T10:54:14.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.849+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~M44FLQV7C87P.1 size=1048576 2024-09-14T10:54:14.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.850+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~M44FLQV7C87P.2 size=850329 2024-09-14T10:54:14.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.850+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=M44FLQV7C87P tag=DUO01CJ5SLEP type=write size=3996057 2024-09-14T10:54:14.850 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.852+0000 7faa01046780 -1 < failed to complete operation key=BBDTPL35W4W0 tag=2Y7GZ3NYPUK3 type=del size=866724: (22) Invalid argument 2024-09-14T10:54:14.853 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.855+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~E6BR9U4LDD85.0 size=1048576 2024-09-14T10:54:14.854 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.855+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~E6BR9U4LDD85.1 size=1048576 2024-09-14T10:54:14.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.857+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~E6BR9U4LDD85.2 size=410671 2024-09-14T10:54:14.856 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.857+0000 7faa01046780 1 > prepared multipart upload key=VIO703UXIJXV upload=E6BR9U4LDD85 tag=F5NPXDV8L7QD type=write size=3556399 2024-09-14T10:54:14.856 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.857+0000 7faa01046780 1 < canceled part key=_multipart_V5T3AN9D7DH6.2~5FFQUAV8ZGU6.0 size=1048576 2024-09-14T10:54:14.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.858+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~5FFQUAV8ZGU6.1 size=655064 2024-09-14T10:54:14.859 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.861+0000 7faa01046780 1 < canceled multipart upload key=V5T3AN9D7DH6 upload=5FFQUAV8ZGU6 tag=S12GUGQKZ8ZI type=write size=2752216 2024-09-14T10:54:14.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.862+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=J4CVKCU4VTVY type=del size=114936 2024-09-14T10:54:14.862 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.863+0000 7faa01046780 1 < completed delete operation key=PBRZNGSOLJ8E tag=8VYFK4RQ7GXP type=del 2024-09-14T10:54:14.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.865+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=73K9VLGX2PD3 type=write size=411915 2024-09-14T10:54:14.865 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.866+0000 7faa01046780 1 < completed write operation key=CKMDOO75UZGE tag=VTFLGEYLNLO2 type=write size=567549 2024-09-14T10:54:14.866 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.868+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=2DPGLOZHSBBY type=del size=3122523 2024-09-14T10:54:14.868 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.869+0000 7faa01046780 1 < completed delete operation key=ZY0BY3G9NREC tag=KTRYOW3PWEAG type=del 2024-09-14T10:54:14.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.871+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=Y11M0Q2Q2BBL type=del size=1998827 2024-09-14T10:54:14.871 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.872+0000 7faa01046780 1 < completed write operation key=FOJGGEQZD7YW tag=65608W7VGNB4 type=write size=425681 2024-09-14T10:54:14.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.874+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~OHCBLTXRDV5K.0 size=1048576 2024-09-14T10:54:14.874 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.876+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~OHCBLTXRDV5K.1 size=1048576 2024-09-14T10:54:14.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.877+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~OHCBLTXRDV5K.2 size=377308 2024-09-14T10:54:14.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.877+0000 7faa01046780 1 > prepared multipart upload key=3UEX0IPM4CPY upload=OHCBLTXRDV5K tag=7ZW7F2QPFQES type=write size=3523036 2024-09-14T10:54:14.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.878+0000 7faa01046780 1 < completed write operation key=LF41PL7DFSJI tag=WKML6KNXZH7B type=write size=783062 2024-09-14T10:54:14.879 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.880+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=VR8NLFN1PQA7 type=del size=2569193 2024-09-14T10:54:14.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.881+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~U8UBLX8M6YQT.0 size=50216 2024-09-14T10:54:14.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.883+0000 7faa01046780 1 < completed multipart upload key=U8TE0XNK9YKM upload=U8UBLX8M6YQT tag=C89JG52XGB3Q type=write size=1098792 2024-09-14T10:54:14.884 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.885+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=JV62CXB7M7SP type=write size=439169 2024-09-14T10:54:14.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.886+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~G0I2SK6OIK2D.0 size=1048576 2024-09-14T10:54:14.886 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.888+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~G0I2SK6OIK2D.1 size=990807 2024-09-14T10:54:14.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.890+0000 7faa01046780 1 < completed multipart upload key=ZY0BY3G9NREC upload=G0I2SK6OIK2D tag=QRH8GQ67U0G0 type=write size=3087959 2024-09-14T10:54:14.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.893+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~CBZ215JK9XIS.0 size=844177 2024-09-14T10:54:14.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.893+0000 7faa01046780 1 > prepared multipart upload key=SJ02N8472YDM upload=CBZ215JK9XIS tag=DOZLJEDL4JCA type=write size=1892753 2024-09-14T10:54:14.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.894+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~FXSRBO47BGIR.0 size=968348 2024-09-14T10:54:14.895 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.896+0000 7faa01046780 1 < completed multipart upload key=FOJGGEQZD7YW upload=FXSRBO47BGIR tag=9IC640EBKRWD type=write size=2016924 2024-09-14T10:54:14.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.899+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=ZPXROFXUD66M type=del size=305940 2024-09-14T10:54:14.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.899+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=9VCRG4JDCBOW type=del 2024-09-14T10:54:14.900 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.901+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=13I06SOW3BLQ type=write size=847720 2024-09-14T10:54:14.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.902+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~FY00WPZGB2FU.0 size=1048576 2024-09-14T10:54:14.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.904+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~FY00WPZGB2FU.1 size=909180 2024-09-14T10:54:14.905 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.907+0000 7faa01046780 1 < completed multipart upload key=HYAGNAOWK8LF upload=FY00WPZGB2FU tag=8J0E6XDSCH8K type=write size=3006332 2024-09-14T10:54:14.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.908+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~1FZC6WM64TYV.0 size=493581 2024-09-14T10:54:14.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.908+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=1FZC6WM64TYV tag=RNGV7EPMX1ZD type=write size=1542157 2024-09-14T10:54:14.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.911+0000 7faa01046780 1 < completed delete operation key=0XVVSUIOBQPL tag=C5V0ZW6ZRYAC type=del 2024-09-14T10:54:14.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.914+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~LN2I43TAG6TR.0 size=143092 2024-09-14T10:54:14.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.914+0000 7faa01046780 1 > prepared multipart upload key=F06QWEOYNQX4 upload=LN2I43TAG6TR tag=SA6T8SGNNGCG type=write size=1191668 2024-09-14T10:54:14.913 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.915+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=ETKQK1HWS9UH type=del 2024-09-14T10:54:14.915 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.916+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=PK2O90QS4VFI type=del size=3360313 2024-09-14T10:54:14.916 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.918+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~8H622VU94J7T.0 size=1048576 2024-09-14T10:54:14.916 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.918+0000 7faa01046780 1 < canceled part key=_multipart_FOJGGEQZD7YW.2~8H622VU94J7T.1 size=304234 2024-09-14T10:54:14.918 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.920+0000 7faa01046780 1 < canceled multipart upload key=FOJGGEQZD7YW upload=8H622VU94J7T tag=6AQ1H08PKGX0 type=write size=2401386 2024-09-14T10:54:14.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.921+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=A8Z6JHQ3Q2YQ type=del size=2488706 2024-09-14T10:54:14.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.921+0000 7faa01046780 1 < canceled part key=_multipart_0OL3SF5IWDMH.2~M44FLQV7C87P.0 size=1048576 2024-09-14T10:54:14.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.922+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~M44FLQV7C87P.1 size=1048576 2024-09-14T10:54:14.922 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.924+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~M44FLQV7C87P.2 size=850329 2024-09-14T10:54:14.925 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.926+0000 7faa01046780 1 < canceled multipart upload key=0OL3SF5IWDMH upload=M44FLQV7C87P tag=DUO01CJ5SLEP type=write size=3996057 2024-09-14T10:54:14.927 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.928+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=BEK2J5B1R61W type=del size=3630274 2024-09-14T10:54:14.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.930+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~E6BR9U4LDD85.0 size=1048576 2024-09-14T10:54:14.929 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.931+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~E6BR9U4LDD85.1 size=1048576 2024-09-14T10:54:14.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.933+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~E6BR9U4LDD85.2 size=410671 2024-09-14T10:54:14.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.934+0000 7faa01046780 1 < completed multipart upload key=VIO703UXIJXV upload=E6BR9U4LDD85 tag=F5NPXDV8L7QD type=write size=3556399 2024-09-14T10:54:14.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.936+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=KTV05RYWJPGT type=write size=478988 2024-09-14T10:54:14.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.937+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=J4CVKCU4VTVY type=del 2024-09-14T10:54:14.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.939+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=12LEQSSDUWPL type=del size=3343520 2024-09-14T10:54:14.939 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.941+0000 7faa01046780 1 < completed write operation key=BBDTPL35W4W0 tag=73K9VLGX2PD3 type=write size=411915 2024-09-14T10:54:14.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.942+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=VUS1JCXW7MRL type=write size=98622 2024-09-14T10:54:14.942 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.944+0000 7faa01046780 1 < completed delete operation key=GG02P21TFKIM tag=2DPGLOZHSBBY type=del 2024-09-14T10:54:14.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.946+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~KGFKRHFADOSY.0 size=1048576 2024-09-14T10:54:14.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.948+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~KGFKRHFADOSY.1 size=946658 2024-09-14T10:54:14.947 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.948+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=KGFKRHFADOSY tag=54IN7GV71I47 type=write size=3043810 2024-09-14T10:54:14.948 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.950+0000 7faa01046780 1 < canceled operation key=HUBZAFMSCCNC tag=Y11M0Q2Q2BBL type=del size=1998827 2024-09-14T10:54:14.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.952+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~H1RS0ZF5JC7W.0 size=703671 2024-09-14T10:54:14.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.952+0000 7faa01046780 1 > prepared multipart upload key=ZY0BY3G9NREC upload=H1RS0ZF5JC7W tag=W1UUMUNOKALY type=write size=1752247 2024-09-14T10:54:14.953 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.954+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~OHCBLTXRDV5K.0 size=1048576 2024-09-14T10:54:14.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.955+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~OHCBLTXRDV5K.1 size=1048576 2024-09-14T10:54:14.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.956+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~OHCBLTXRDV5K.2 size=377308 2024-09-14T10:54:14.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.959+0000 7faa01046780 1 < completed multipart upload key=3UEX0IPM4CPY upload=OHCBLTXRDV5K tag=7ZW7F2QPFQES type=write size=3523036 2024-09-14T10:54:14.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.962+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~2VK887DY7BMK.0 size=1048576 2024-09-14T10:54:14.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.962+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~2VK887DY7BMK.1 size=1048576 2024-09-14T10:54:14.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.964+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~2VK887DY7BMK.2 size=1024291 2024-09-14T10:54:14.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.964+0000 7faa01046780 1 > prepared multipart upload key=TDNQZ8Y1C6X2 upload=2VK887DY7BMK tag=ARZF1BHBBR8E type=write size=4170019 2024-09-14T10:54:14.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.965+0000 7faa01046780 1 < canceled operation key=KDUTH9PIR3FI tag=VR8NLFN1PQA7 type=del size=2569193 2024-09-14T10:54:14.966 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.968+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~H31Y99K6LYXG.0 size=1048576 2024-09-14T10:54:14.967 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.969+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~H31Y99K6LYXG.1 size=1048576 2024-09-14T10:54:14.968 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.970+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~H31Y99K6LYXG.2 size=1018632 2024-09-14T10:54:14.969 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.970+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=H31Y99K6LYXG tag=2OHW73VYZ2RF type=write size=4164360 2024-09-14T10:54:14.970 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.971+0000 7faa01046780 1 < completed write operation key=V11YJWHT4OOD tag=JV62CXB7M7SP type=write size=439169 2024-09-14T10:54:14.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.974+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~IFYRMRYBAAOW.0 size=1048576 2024-09-14T10:54:14.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.975+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~IFYRMRYBAAOW.1 size=1048576 2024-09-14T10:54:14.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.976+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~IFYRMRYBAAOW.2 size=667232 2024-09-14T10:54:14.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.976+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=IFYRMRYBAAOW tag=LV4CUO9YZGFO type=write size=3812960 2024-09-14T10:54:14.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.977+0000 7faa01046780 1 < canceled part key=_multipart_SJ02N8472YDM.2~CBZ215JK9XIS.0 size=844177 2024-09-14T10:54:14.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.978+0000 7faa01046780 1 < canceled multipart upload key=SJ02N8472YDM upload=CBZ215JK9XIS tag=DOZLJEDL4JCA type=write size=1892753 2024-09-14T10:54:14.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.980+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=9U18EUYK04UX type=del size=1571314 2024-09-14T10:54:14.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.983+0000 7faa01046780 1 < suggested update operation key=KDUTH9PIR3FI tag=ZPXROFXUD66M type=del size=305940 2024-09-14T10:54:14.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.985+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=FVNXZZI6PECK type=write size=500231 2024-09-14T10:54:14.985 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.986+0000 7faa01046780 1 < completed write operation key=XDJAK0XYQNF0 tag=13I06SOW3BLQ type=write size=847720 2024-09-14T10:54:14.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.988+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=GC19QFE0L257 type=del size=2211005 2024-09-14T10:54:14.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.989+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~1FZC6WM64TYV.0 size=493581 2024-09-14T10:54:14.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.991+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=1FZC6WM64TYV tag=RNGV7EPMX1ZD type=write size=1542157 2024-09-14T10:54:14.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.994+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~J3M9R4U0TCEY.0 size=1048576 2024-09-14T10:54:14.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.995+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~J3M9R4U0TCEY.1 size=1048576 2024-09-14T10:54:14.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.996+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~J3M9R4U0TCEY.2 size=426215 2024-09-14T10:54:14.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.996+0000 7faa01046780 1 > prepared multipart upload key=FOJGGEQZD7YW upload=J3M9R4U0TCEY tag=FOF2Q8IO8I54 type=write size=3571943 2024-09-14T10:54:14.996 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:14.997+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~LN2I43TAG6TR.0 size=143092 2024-09-14T10:54:14.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.000+0000 7faa01046780 1 < completed multipart upload key=F06QWEOYNQX4 upload=LN2I43TAG6TR tag=SA6T8SGNNGCG type=write size=1191668 2024-09-14T10:54:15.000 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.001+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=C61M2LS2BM92 type=del size=1291348 2024-09-14T10:54:15.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.003+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=PK2O90QS4VFI type=del 2024-09-14T10:54:15.003 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.004+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=NBBN53M5VM20 type=del size=3145934 2024-09-14T10:54:15.004 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.006+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=A8Z6JHQ3Q2YQ type=del 2024-09-14T10:54:15.006 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.007+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=KZ231AU0K1GD type=del size=331677 2024-09-14T10:54:15.007 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.008+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=BEK2J5B1R61W type=del 2024-09-14T10:54:15.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.010+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=OQ3FKDJV8YYK type=del size=3344064 2024-09-14T10:54:15.010 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.011+0000 7faa01046780 1 < completed write operation key=LF41PL7DFSJI tag=KTV05RYWJPGT type=write size=478988 2024-09-14T10:54:15.011 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.013+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=N5WI1RKAUV1W type=write size=695811 2024-09-14T10:54:15.014 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.016+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=12LEQSSDUWPL type=del 2024-09-14T10:54:15.016 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.017+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=4CEVDTBFMPRV type=del size=3131565 2024-09-14T10:54:15.017 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.019+0000 7faa01046780 1 < completed write operation key=X9DUVQBBLUTF tag=VUS1JCXW7MRL type=write size=98622 2024-09-14T10:54:15.020 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.021+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~QGPFBBJE5SOU.0 size=741076 2024-09-14T10:54:15.020 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.021+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=QGPFBBJE5SOU tag=26DOJQ15UUJD type=write size=1789652 2024-09-14T10:54:15.021 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.023+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~KGFKRHFADOSY.0 size=1048576 2024-09-14T10:54:15.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.024+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~KGFKRHFADOSY.1 size=946658 2024-09-14T10:54:15.025 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.026+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=KGFKRHFADOSY tag=54IN7GV71I47 type=write size=3043810 2024-09-14T10:54:15.027 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.029+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~3S5NFQIQ7DZQ.0 size=1048576 2024-09-14T10:54:15.029 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.030+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~3S5NFQIQ7DZQ.1 size=355494 2024-09-14T10:54:15.029 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.030+0000 7faa01046780 1 > prepared multipart upload key=X9DUVQBBLUTF upload=3S5NFQIQ7DZQ tag=EZ2UZWP9F5OV type=write size=2452646 2024-09-14T10:54:15.030 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.031+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~H1RS0ZF5JC7W.0 size=703671 2024-09-14T10:54:15.032 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.034+0000 7faa01046780 1 < completed multipart upload key=ZY0BY3G9NREC upload=H1RS0ZF5JC7W tag=W1UUMUNOKALY type=write size=1752247 2024-09-14T10:54:15.034 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.036+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=73OM7MBF97X1 type=del size=2907056 2024-09-14T10:54:15.036 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.037+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~2VK887DY7BMK.0 size=1048576 2024-09-14T10:54:15.037 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.038+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~2VK887DY7BMK.1 size=1048576 2024-09-14T10:54:15.038 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.039+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~2VK887DY7BMK.2 size=1024291 2024-09-14T10:54:15.040 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.041+0000 7faa01046780 1 < completed multipart upload key=TDNQZ8Y1C6X2 upload=2VK887DY7BMK tag=ARZF1BHBBR8E type=write size=4170019 2024-09-14T10:54:15.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.044+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~BUTT5MCOTR8U.0 size=1048576 2024-09-14T10:54:15.044 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.045+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~BUTT5MCOTR8U.1 size=1048576 2024-09-14T10:54:15.045 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.046+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~BUTT5MCOTR8U.2 size=865033 2024-09-14T10:54:15.045 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.046+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=BUTT5MCOTR8U tag=MXARF0V988TL type=write size=4010761 2024-09-14T10:54:15.046 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.047+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~H31Y99K6LYXG.0 size=1048576 2024-09-14T10:54:15.047 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.048+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~H31Y99K6LYXG.1 size=1048576 2024-09-14T10:54:15.048 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.050+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~H31Y99K6LYXG.2 size=1018632 2024-09-14T10:54:15.051 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.052+0000 7faa01046780 1 < completed multipart upload key=XDJAK0XYQNF0 upload=H31Y99K6LYXG tag=2OHW73VYZ2RF type=write size=4164360 2024-09-14T10:54:15.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.053+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=QG8UAJM767V2 type=del size=1456596 2024-09-14T10:54:15.053 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.055+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~IFYRMRYBAAOW.0 size=1048576 2024-09-14T10:54:15.054 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.056+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~IFYRMRYBAAOW.1 size=1048576 2024-09-14T10:54:15.055 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.057+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~IFYRMRYBAAOW.2 size=667232 2024-09-14T10:54:15.058 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.060+0000 7faa01046780 1 < completed multipart upload key=S3BGVJ9N9S4P upload=IFYRMRYBAAOW tag=LV4CUO9YZGFO type=write size=3812960 2024-09-14T10:54:15.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.063+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~OGJQHY0XVLC7.0 size=222003 2024-09-14T10:54:15.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.063+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=OGJQHY0XVLC7 tag=7GXOJC46A414 type=write size=1270579 2024-09-14T10:54:15.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.064+0000 7faa01046780 1 < completed delete operation key=0XVVSUIOBQPL tag=9U18EUYK04UX type=del 2024-09-14T10:54:15.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.066+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=UGMUVW3SG5BS type=del size=360384 2024-09-14T10:54:15.067 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.068+0000 7faa01046780 1 < suggested remove operation key=XH8GHY9YRGTP tag=FVNXZZI6PECK type=write 2024-09-14T10:54:15.069 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.070+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=A5CVUX1YA1RR type=del size=1780126 2024-09-14T10:54:15.071 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.072+0000 7faa01046780 1 < suggested remove operation key=NXIPG4HR9ZYY tag=GC19QFE0L257 type=del 2024-09-14T10:54:15.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.075+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~BPHWQEASOJ53.0 size=1048576 2024-09-14T10:54:15.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.076+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~BPHWQEASOJ53.1 size=1048576 2024-09-14T10:54:15.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.077+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~BPHWQEASOJ53.2 size=1033800 2024-09-14T10:54:15.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.077+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=BPHWQEASOJ53 tag=F9YOERYCU7KB type=write size=4179528 2024-09-14T10:54:15.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.077+0000 7faa01046780 1 < canceled part key=_multipart_FOJGGEQZD7YW.2~J3M9R4U0TCEY.0 size=1048576 2024-09-14T10:54:15.077 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.078+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~J3M9R4U0TCEY.1 size=1048576 2024-09-14T10:54:15.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.079+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~J3M9R4U0TCEY.2 size=426215 2024-09-14T10:54:15.081 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.082+0000 7faa01046780 1 < canceled multipart upload key=FOJGGEQZD7YW upload=J3M9R4U0TCEY tag=FOF2Q8IO8I54 type=write size=3571943 2024-09-14T10:54:15.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.084+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~FKLMNGNBHM15.0 size=231240 2024-09-14T10:54:15.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.084+0000 7faa01046780 1 > prepared multipart upload key=PBRZNGSOLJ8E upload=FKLMNGNBHM15 tag=KGCREFPJ7HAM type=write size=1279816 2024-09-14T10:54:15.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.086+0000 7faa01046780 1 < completed delete operation key=3UEX0IPM4CPY tag=C61M2LS2BM92 type=del 2024-09-14T10:54:15.086 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.087+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=6OLYWBN7B7DP type=del size=2823331 2024-09-14T10:54:15.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.089+0000 7faa01046780 1 < suggested remove operation key=X9DUVQBBLUTF tag=NBBN53M5VM20 type=del 2024-09-14T10:54:15.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.091+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=OSOQ5D262N8D type=del size=1220664 2024-09-14T10:54:15.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.092+0000 7faa01046780 1 < completed delete operation key=V11YJWHT4OOD tag=KZ231AU0K1GD type=del 2024-09-14T10:54:15.092 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.093+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=QYYSHDYGUXA3 type=write size=789482 2024-09-14T10:54:15.093 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.095+0000 7faa01046780 1 < completed delete operation key=VIO703UXIJXV tag=OQ3FKDJV8YYK type=del 2024-09-14T10:54:15.096 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.097+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~RX5A4AITK6VJ.0 size=1048576 2024-09-14T10:54:15.097 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.098+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~RX5A4AITK6VJ.1 size=1048576 2024-09-14T10:54:15.098 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.099+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~RX5A4AITK6VJ.2 size=350601 2024-09-14T10:54:15.098 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.099+0000 7faa01046780 1 > prepared multipart upload key=FOJGGEQZD7YW upload=RX5A4AITK6VJ tag=RXOCF3YPDBTF type=write size=3496329 2024-09-14T10:54:15.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.101+0000 7faa01046780 1 < completed write operation key=ZY0BY3G9NREC tag=N5WI1RKAUV1W type=write size=695811 2024-09-14T10:54:15.102 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.104+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~NQML5YYZ64UA.0 size=1048576 2024-09-14T10:54:15.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.105+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~NQML5YYZ64UA.1 size=1048576 2024-09-14T10:54:15.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.106+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~NQML5YYZ64UA.2 size=441912 2024-09-14T10:54:15.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.106+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=NQML5YYZ64UA tag=O4XDFC0DB134 type=write size=3587640 2024-09-14T10:54:15.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.107+0000 7faa01046780 1 < completed delete operation key=LF41PL7DFSJI tag=4CEVDTBFMPRV type=del 2024-09-14T10:54:15.109 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.110+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~8WBY42L8XEUV.0 size=1048576 2024-09-14T10:54:15.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.112+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~8WBY42L8XEUV.1 size=120841 2024-09-14T10:54:15.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.112+0000 7faa01046780 1 > prepared multipart upload key=F872GLVQDCX6 upload=8WBY42L8XEUV tag=10O6AZZTTYFN type=write size=2217993 2024-09-14T10:54:15.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.112+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~QGPFBBJE5SOU.0 size=741076 2024-09-14T10:54:15.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.115+0000 7faa01046780 1 < completed multipart upload key=HYAGNAOWK8LF upload=QGPFBBJE5SOU tag=26DOJQ15UUJD type=write size=1789652 2024-09-14T10:54:15.115 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.117+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=ZG1H5IKR22TS type=del size=2772521 2024-09-14T10:54:15.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.117+0000 7faa01046780 1 < canceled part key=_multipart_X9DUVQBBLUTF.2~3S5NFQIQ7DZQ.0 size=1048576 2024-09-14T10:54:15.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.118+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~3S5NFQIQ7DZQ.1 size=355494 2024-09-14T10:54:15.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.120+0000 7faa01046780 1 < canceled multipart upload key=X9DUVQBBLUTF upload=3S5NFQIQ7DZQ tag=EZ2UZWP9F5OV type=write size=2452646 2024-09-14T10:54:15.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.121+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=L0QS93PEFDB1 type=del size=1927995 2024-09-14T10:54:15.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.123+0000 7faa01046780 1 < completed delete operation key=V905BR1VWUCV tag=73OM7MBF97X1 type=del 2024-09-14T10:54:15.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.125+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~4DNI8W03G100.0 size=1048576 2024-09-14T10:54:15.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.127+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~4DNI8W03G100.1 size=953498 2024-09-14T10:54:15.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.127+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=4DNI8W03G100 tag=8XG06RQW54CB type=write size=3050650 2024-09-14T10:54:15.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.128+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~BUTT5MCOTR8U.0 size=1048576 2024-09-14T10:54:15.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.129+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~BUTT5MCOTR8U.1 size=1048576 2024-09-14T10:54:15.129 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.131+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~BUTT5MCOTR8U.2 size=865033 2024-09-14T10:54:15.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.133+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=BUTT5MCOTR8U tag=MXARF0V988TL type=write size=4010761 2024-09-14T10:54:15.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.134+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=NX8UATNMNQJE type=write size=318774 2024-09-14T10:54:15.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.135+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=QG8UAJM767V2 type=del 2024-09-14T10:54:15.135 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.137+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=BLAZPA2XC8S1 type=write size=694103 2024-09-14T10:54:15.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.138+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~OGJQHY0XVLC7.0 size=222003 2024-09-14T10:54:15.139 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.140+0000 7faa01046780 1 < completed multipart upload key=U8TE0XNK9YKM upload=OGJQHY0XVLC7 tag=7GXOJC46A414 type=write size=1270579 2024-09-14T10:54:15.141 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.143+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~CKJATUCW6K52.0 size=1048576 2024-09-14T10:54:15.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.144+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~CKJATUCW6K52.1 size=686553 2024-09-14T10:54:15.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.144+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=CKJATUCW6K52 tag=297YFOTE54FR type=write size=2783705 2024-09-14T10:54:15.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.145+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=UGMUVW3SG5BS type=del 2024-09-14T10:54:15.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.148+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~YITWRBN5UEE4.0 size=1048576 2024-09-14T10:54:15.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.149+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~YITWRBN5UEE4.1 size=689811 2024-09-14T10:54:15.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.149+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=YITWRBN5UEE4 tag=ZPNAQC175RIN type=write size=2786963 2024-09-14T10:54:15.149 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.150+0000 7faa01046780 1 < completed delete operation key=VIO703UXIJXV tag=A5CVUX1YA1RR type=del 2024-09-14T10:54:15.151 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.152+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~49ZS9JC1UUCC.0 size=1048576 2024-09-14T10:54:15.152 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.154+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~49ZS9JC1UUCC.1 size=955786 2024-09-14T10:54:15.152 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.154+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=49ZS9JC1UUCC tag=XA4PMUFNA4D1 type=write size=3052938 2024-09-14T10:54:15.154 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.155+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~BPHWQEASOJ53.0 size=1048576 2024-09-14T10:54:15.154 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.155+0000 7faa01046780 1 < canceled part key=_multipart_HYAGNAOWK8LF.2~BPHWQEASOJ53.1 size=1048576 2024-09-14T10:54:15.155 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.156+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~BPHWQEASOJ53.2 size=1033800 2024-09-14T10:54:15.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.158+0000 7faa01046780 1 < canceled multipart upload key=HYAGNAOWK8LF upload=BPHWQEASOJ53 tag=F9YOERYCU7KB type=write size=4179528 2024-09-14T10:54:15.158 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.160+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=SYL5NMUHSXS4 type=del size=870078 2024-09-14T10:54:15.160 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.161+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~FKLMNGNBHM15.0 size=231240 2024-09-14T10:54:15.162 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.163+0000 7faa01046780 1 < completed multipart upload key=PBRZNGSOLJ8E upload=FKLMNGNBHM15 tag=KGCREFPJ7HAM type=write size=1279816 2024-09-14T10:54:15.163 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.165+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=SJ10834JKE3B type=del size=1464268 2024-09-14T10:54:15.165 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.166+0000 7faa01046780 1 < canceled operation key=Y4CB0HIN0750 tag=6OLYWBN7B7DP type=del size=2823331 2024-09-14T10:54:15.167 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.168+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=PPLPJPZZ0YYB type=write size=278828 2024-09-14T10:54:15.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.172+0000 7faa01046780 1 < suggested update operation key=LF41PL7DFSJI tag=OSOQ5D262N8D type=del size=1220664 2024-09-14T10:54:15.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.173+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=XI97W5BDSPLB type=del size=2697717 2024-09-14T10:54:15.174 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.175+0000 7faa01046780 1 < completed write operation key=3FSH0OFMF54V tag=QYYSHDYGUXA3 type=write size=789482 2024-09-14T10:54:15.177 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.178+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~ICB0M3TY21F6.0 size=1048576 2024-09-14T10:54:15.177 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.179+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~ICB0M3TY21F6.1 size=1048576 2024-09-14T10:54:15.179 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.180+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~ICB0M3TY21F6.2 size=597288 2024-09-14T10:54:15.179 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.180+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=ICB0M3TY21F6 tag=OW6J0D9USBVB type=write size=3743016 2024-09-14T10:54:15.180 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.181+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~RX5A4AITK6VJ.0 size=1048576 2024-09-14T10:54:15.181 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.183+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~RX5A4AITK6VJ.1 size=1048576 2024-09-14T10:54:15.183 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.184+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~RX5A4AITK6VJ.2 size=350601 2024-09-14T10:54:15.185 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.187+0000 7faa01046780 1 < completed multipart upload key=FOJGGEQZD7YW upload=RX5A4AITK6VJ tag=RXOCF3YPDBTF type=write size=3496329 2024-09-14T10:54:15.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.190+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~FZ72N0UU3DL1.0 size=895535 2024-09-14T10:54:15.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.190+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=FZ72N0UU3DL1 tag=SKPN078VS7M6 type=write size=1944111 2024-09-14T10:54:15.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.190+0000 7faa01046780 1 < canceled part key=_multipart_0OL3SF5IWDMH.2~NQML5YYZ64UA.0 size=1048576 2024-09-14T10:54:15.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.192+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~NQML5YYZ64UA.1 size=1048576 2024-09-14T10:54:15.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.193+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~NQML5YYZ64UA.2 size=441912 2024-09-14T10:54:15.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.196+0000 7faa01046780 1 < canceled multipart upload key=0OL3SF5IWDMH upload=NQML5YYZ64UA tag=O4XDFC0DB134 type=write size=3587640 2024-09-14T10:54:15.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.197+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=QXP92ZFSCIC0 type=del size=434332 2024-09-14T10:54:15.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.198+0000 7faa01046780 1 < canceled part key=_multipart_F872GLVQDCX6.2~8WBY42L8XEUV.0 size=1048576 2024-09-14T10:54:15.198 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.200+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~8WBY42L8XEUV.1 size=120841 2024-09-14T10:54:15.200 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.202+0000 7faa01046780 1 < canceled multipart upload key=F872GLVQDCX6 upload=8WBY42L8XEUV tag=10O6AZZTTYFN type=write size=2217993 2024-09-14T10:54:15.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.204+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=XPT7Q5HA3UHK type=write size=141665 2024-09-14T10:54:15.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.205+0000 7faa01046780 1 < completed delete operation key=PBRZNGSOLJ8E tag=ZG1H5IKR22TS type=del 2024-09-14T10:54:15.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.206+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=TMCVVZ0YFQ0Z type=del size=1292319 2024-09-14T10:54:15.206 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.207+0000 7faa01046780 1 < completed delete operation key=Q33ET1AN14NG tag=L0QS93PEFDB1 type=del 2024-09-14T10:54:15.208 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.209+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=4UF0H5AHANQX type=del size=965283 2024-09-14T10:54:15.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.210+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~4DNI8W03G100.0 size=1048576 2024-09-14T10:54:15.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.212+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~4DNI8W03G100.1 size=953498 2024-09-14T10:54:15.213 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.215+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=4DNI8W03G100 tag=8XG06RQW54CB type=write size=3050650 2024-09-14T10:54:15.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.216+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=BJO43X6NO3QW type=del size=1832357 2024-09-14T10:54:15.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.217+0000 7faa01046780 1 < canceled operation key=Y4CB0HIN0750 tag=NX8UATNMNQJE type=write size=318774 2024-09-14T10:54:15.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.218+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=ZQXMANLIBDO6 type=write size=191269 2024-09-14T10:54:15.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.220+0000 7faa01046780 1 < completed write operation key=3UEX0IPM4CPY tag=BLAZPA2XC8S1 type=write size=694103 2024-09-14T10:54:15.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.222+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~5GZE6N8THWQA.0 size=247003 2024-09-14T10:54:15.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.222+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=5GZE6N8THWQA tag=OHN9JJT7XAX1 type=write size=1295579 2024-09-14T10:54:15.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.224+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~CKJATUCW6K52.0 size=1048576 2024-09-14T10:54:15.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.225+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~CKJATUCW6K52.1 size=686553 2024-09-14T10:54:15.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.227+0000 7faa01046780 1 < completed multipart upload key=CKMDOO75UZGE upload=CKJATUCW6K52 tag=297YFOTE54FR type=write size=2783705 2024-09-14T10:54:15.227 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.228+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=SB5CXMSVG2OC type=del size=85272 2024-09-14T10:54:15.227 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.229+0000 7faa01046780 1 < canceled part key=_multipart_HUBZAFMSCCNC.2~YITWRBN5UEE4.0 size=1048576 2024-09-14T10:54:15.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.230+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~YITWRBN5UEE4.1 size=689811 2024-09-14T10:54:15.231 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.232+0000 7faa01046780 1 < canceled multipart upload key=HUBZAFMSCCNC upload=YITWRBN5UEE4 tag=ZPNAQC175RIN type=write size=2786963 2024-09-14T10:54:15.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.233+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=IBU47ZHQIPON type=del size=2503030 2024-09-14T10:54:15.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.234+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~49ZS9JC1UUCC.0 size=1048576 2024-09-14T10:54:15.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.236+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~49ZS9JC1UUCC.1 size=955786 2024-09-14T10:54:15.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.239+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=49ZS9JC1UUCC tag=XA4PMUFNA4D1 type=write size=3052938 2024-09-14T10:54:15.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.240+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=48YCGZH87S0N type=write size=665591 2024-09-14T10:54:15.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.242+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=SYL5NMUHSXS4 type=del 2024-09-14T10:54:15.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.245+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~48BGI6T0ID3T.0 size=254611 2024-09-14T10:54:15.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.245+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=48BGI6T0ID3T tag=D6WNSAJNS6CC type=write size=1303187 2024-09-14T10:54:15.245 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.246+0000 7faa01046780 1 < completed delete operation key=KDUTH9PIR3FI tag=SJ10834JKE3B type=del 2024-09-14T10:54:15.247 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.248+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=9HB1W2S7371D type=del size=1009424 2024-09-14T10:54:15.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.250+0000 7faa01046780 1 < completed write operation key=F872GLVQDCX6 tag=PPLPJPZZ0YYB type=write size=278828 2024-09-14T10:54:15.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.251+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=CH107U1U0HDU type=del size=2632849 2024-09-14T10:54:15.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.253+0000 7faa01046780 1 < completed delete operation key=GG02P21TFKIM tag=XI97W5BDSPLB type=del 2024-09-14T10:54:15.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.255+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=F2MQN5FZXYN2 type=del size=929427 2024-09-14T10:54:15.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.255+0000 7faa01046780 1 < canceled part key=_multipart_0XVVSUIOBQPL.2~ICB0M3TY21F6.0 size=1048576 2024-09-14T10:54:15.255 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.256+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~ICB0M3TY21F6.1 size=1048576 2024-09-14T10:54:15.257 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.258+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~ICB0M3TY21F6.2 size=597288 2024-09-14T10:54:15.259 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.260+0000 7faa01046780 1 < canceled multipart upload key=0XVVSUIOBQPL upload=ICB0M3TY21F6 tag=OW6J0D9USBVB type=write size=3743016 2024-09-14T10:54:15.261 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.262+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=K2ZDFD6JOORE type=del size=1237861 2024-09-14T10:54:15.262 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.263+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~FZ72N0UU3DL1.0 size=895535 2024-09-14T10:54:15.264 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.266+0000 7faa01046780 1 < completed multipart upload key=Y4CB0HIN0750 upload=FZ72N0UU3DL1 tag=SKPN078VS7M6 type=write size=1944111 2024-09-14T10:54:15.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.267+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=762NVTEQ653X type=del size=3522191 2024-09-14T10:54:15.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.270+0000 7faa01046780 1 < suggested remove operation key=TDNQZ8Y1C6X2 tag=QXP92ZFSCIC0 type=del 2024-09-14T10:54:15.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.273+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~FXK1HF3R7W9J.0 size=1048576 2024-09-14T10:54:15.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.274+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~FXK1HF3R7W9J.1 size=1048576 2024-09-14T10:54:15.274 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.276+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~FXK1HF3R7W9J.2 size=691533 2024-09-14T10:54:15.274 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.276+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=FXK1HF3R7W9J tag=VNS1BEWJ6MQO type=write size=3837261 2024-09-14T10:54:15.276 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.278+0000 7faa01046780 1 < suggested remove operation key=0OL3SF5IWDMH tag=XPT7Q5HA3UHK type=write 2024-09-14T10:54:15.278 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.279+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=9JX5OOBOY0DA type=write size=490085 2024-09-14T10:54:15.279 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.280+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=TMCVVZ0YFQ0Z type=del 2024-09-14T10:54:15.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.282+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=NOASQJHR6WB3 type=del size=944219 2024-09-14T10:54:15.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.284+0000 7faa01046780 1 < suggested update operation key=ZY0BY3G9NREC tag=4UF0H5AHANQX type=del size=965283 2024-09-14T10:54:15.285 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.286+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=7G9S3PV3J4B8 type=write size=534416 2024-09-14T10:54:15.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.289+0000 7faa01046780 1 < suggested remove operation key=PTDE6D7OIU1A tag=BJO43X6NO3QW type=del 2024-09-14T10:54:15.289 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.291+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=ZGH4Y2JGMKIV type=del size=2061780 2024-09-14T10:54:15.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.292+0000 7faa01046780 1 < completed write operation key=3UEX0IPM4CPY tag=ZQXMANLIBDO6 type=write size=191269 2024-09-14T10:54:15.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.294+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~4JIAU0EJJXXL.0 size=86509 2024-09-14T10:54:15.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.294+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=4JIAU0EJJXXL tag=E3TGSO6N57YZ type=write size=1135085 2024-09-14T10:54:15.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.296+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~5GZE6N8THWQA.0 size=247003 2024-09-14T10:54:15.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.299+0000 7faa01046780 1 < completed multipart upload key=Y4CB0HIN0750 upload=5GZE6N8THWQA tag=OHN9JJT7XAX1 type=write size=1295579 2024-09-14T10:54:15.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.299+0000 7faa01046780 1 > prepared operation key=SJ02N8472YDM tag=93SOKS305E8R type=del size=1097326 2024-09-14T10:54:15.299 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.301+0000 7faa01046780 1 < completed delete operation key=V905BR1VWUCV tag=SB5CXMSVG2OC type=del 2024-09-14T10:54:15.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.302+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=H67B8UB7NAQT type=del size=2546050 2024-09-14T10:54:15.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.303+0000 7faa01046780 1 < completed delete operation key=VIO703UXIJXV tag=IBU47ZHQIPON type=del 2024-09-14T10:54:15.304 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.305+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=TRXKZ3TC2BOR type=del size=87382 2024-09-14T10:54:15.305 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.307+0000 7faa01046780 1 < completed write operation key=FOJGGEQZD7YW tag=48YCGZH87S0N type=write size=665591 2024-09-14T10:54:15.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.309+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~2D9625K95WZH.0 size=1048576 2024-09-14T10:54:15.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.310+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~2D9625K95WZH.1 size=677486 2024-09-14T10:54:15.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.310+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=2D9625K95WZH tag=XXGSC6GSA72Y type=write size=2774638 2024-09-14T10:54:15.311 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.312+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~48BGI6T0ID3T.0 size=254611 2024-09-14T10:54:15.313 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.314+0000 7faa01046780 1 < completed multipart upload key=KDUTH9PIR3FI upload=48BGI6T0ID3T tag=D6WNSAJNS6CC type=write size=1303187 2024-09-14T10:54:15.314 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.315+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=1EQJGODFV31X type=del size=700103 2024-09-14T10:54:15.316 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.317+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=9HB1W2S7371D type=del 2024-09-14T10:54:15.317 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.318+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=34448D3JODDK type=del size=4125214 2024-09-14T10:54:15.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.320+0000 7faa01046780 1 < completed delete operation key=NXIPG4HR9ZYY tag=CH107U1U0HDU type=del 2024-09-14T10:54:15.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.322+0000 7faa01046780 1 > prepared operation key=SJ02N8472YDM tag=D3BD4RXO2O7C type=del size=763106 2024-09-14T10:54:15.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.323+0000 7faa01046780 1 < completed delete operation key=LF41PL7DFSJI tag=F2MQN5FZXYN2 type=del 2024-09-14T10:54:15.323 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.325+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=NWY8M2XOJN9D type=del size=726295 2024-09-14T10:54:15.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.326+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=K2ZDFD6JOORE type=del 2024-09-14T10:54:15.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.328+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=R9K25BERS4IT type=del size=170972 2024-09-14T10:54:15.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.329+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=762NVTEQ653X type=del 2024-09-14T10:54:15.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.333+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~I6ODAAHSF9AF.0 size=1048576 2024-09-14T10:54:15.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.334+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~I6ODAAHSF9AF.1 size=963740 2024-09-14T10:54:15.333 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.334+0000 7faa01046780 1 > prepared multipart upload key=GG02P21TFKIM upload=I6ODAAHSF9AF tag=01WAV9ZQWWVF type=write size=3060892 2024-09-14T10:54:15.334 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.335+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~FXK1HF3R7W9J.0 size=1048576 2024-09-14T10:54:15.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.337+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~FXK1HF3R7W9J.1 size=1048576 2024-09-14T10:54:15.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.338+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~FXK1HF3R7W9J.2 size=691533 2024-09-14T10:54:15.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.340+0000 7faa01046780 1 < completed multipart upload key=V5T3AN9D7DH6 upload=FXK1HF3R7W9J tag=VNS1BEWJ6MQO type=write size=3837261 2024-09-14T10:54:15.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.341+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=4ECGHO0LD70F type=del size=3822105 2024-09-14T10:54:15.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.342+0000 7faa01046780 1 < completed write operation key=3UEX0IPM4CPY tag=9JX5OOBOY0DA type=write size=490085 2024-09-14T10:54:15.346 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.344+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=PWUC8AKI97MM type=del size=1694858 2024-09-14T10:54:15.346 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.346+0000 7faa01046780 1 < suggested update operation key=X9DUVQBBLUTF tag=NOASQJHR6WB3 type=del size=944219 2024-09-14T10:54:15.346 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.348+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=MS66QBFPKYQK type=del size=232003 2024-09-14T10:54:15.348 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.350+0000 7faa01046780 1 < completed write operation key=3FSH0OFMF54V tag=7G9S3PV3J4B8 type=write size=534416 2024-09-14T10:54:15.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.351+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=CPGUMN1BH2NU type=del size=284001 2024-09-14T10:54:15.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.352+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=ZGH4Y2JGMKIV type=del 2024-09-14T10:54:15.352 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.353+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=8TM739ZJPQNO type=write size=796955 2024-09-14T10:54:15.354 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.355+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~4JIAU0EJJXXL.0 size=86509 2024-09-14T10:54:15.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.358+0000 7faa01046780 1 < completed multipart upload key=0OL3SF5IWDMH upload=4JIAU0EJJXXL tag=E3TGSO6N57YZ type=write size=1135085 2024-09-14T10:54:15.359 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.361+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~E18XSY8JGNWJ.0 size=1048576 2024-09-14T10:54:15.360 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.362+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~E18XSY8JGNWJ.1 size=1048576 2024-09-14T10:54:15.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.362+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~E18XSY8JGNWJ.2 size=393506 2024-09-14T10:54:15.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.362+0000 7faa01046780 1 > prepared multipart upload key=ZY0BY3G9NREC upload=E18XSY8JGNWJ tag=DG3M0SXT85NA type=write size=3539234 2024-09-14T10:54:15.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.364+0000 7faa01046780 1 < completed delete operation key=SJ02N8472YDM tag=93SOKS305E8R type=del 2024-09-14T10:54:15.365 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.367+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~HOAZMMUHCVHG.0 size=347395 2024-09-14T10:54:15.365 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.367+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=HOAZMMUHCVHG tag=CCV5NI27FN1F type=write size=1395971 2024-09-14T10:54:15.366 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.368+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=H67B8UB7NAQT type=del 2024-09-14T10:54:15.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.371+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~NX1OE6MV0PQV.0 size=1048576 2024-09-14T10:54:15.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.371+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~NX1OE6MV0PQV.1 size=1048576 2024-09-14T10:54:15.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.373+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~NX1OE6MV0PQV.2 size=476478 2024-09-14T10:54:15.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.373+0000 7faa01046780 1 > prepared multipart upload key=SJ02N8472YDM upload=NX1OE6MV0PQV tag=CFJCYIUTILJQ type=write size=3622206 2024-09-14T10:54:15.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.375+0000 7faa01046780 1 < suggested update operation key=V11YJWHT4OOD tag=TRXKZ3TC2BOR type=del size=87382 2024-09-14T10:54:15.376 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.377+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=BLA2VNQAJLIF type=del size=2168890 2024-09-14T10:54:15.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.378+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~2D9625K95WZH.0 size=1048576 2024-09-14T10:54:15.378 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.379+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~2D9625K95WZH.1 size=677486 2024-09-14T10:54:15.380 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.382+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=2D9625K95WZH tag=XXGSC6GSA72Y type=write size=2774638 2024-09-14T10:54:15.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.383+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=MTO0O0BYIZAC type=del size=540928 2024-09-14T10:54:15.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.385+0000 7faa01046780 1 < completed delete operation key=V905BR1VWUCV tag=1EQJGODFV31X type=del 2024-09-14T10:54:15.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.386+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=2OWPCP4F0GTH type=del size=3225433 2024-09-14T10:54:15.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.387+0000 7faa01046780 1 < completed delete operation key=HYAGNAOWK8LF tag=34448D3JODDK type=del 2024-09-14T10:54:15.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.390+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~33FGCB8IXJ6U.0 size=1048576 2024-09-14T10:54:15.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.391+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~33FGCB8IXJ6U.1 size=969525 2024-09-14T10:54:15.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.391+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=33FGCB8IXJ6U tag=NNMLZDOQYC5Y type=write size=3066677 2024-09-14T10:54:15.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.393+0000 7faa01046780 1 < completed delete operation key=SJ02N8472YDM tag=D3BD4RXO2O7C type=del 2024-09-14T10:54:15.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.394+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=GC28N542SIHX type=del size=310811 2024-09-14T10:54:15.394 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.396+0000 7faa01046780 1 < canceled operation key=LF41PL7DFSJI tag=NWY8M2XOJN9D type=del size=726295 2024-09-14T10:54:15.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.398+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~7D0ZZXPJEIN3.0 size=360909 2024-09-14T10:54:15.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.398+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=7D0ZZXPJEIN3 tag=8W95KELJ7C47 type=write size=1409485 2024-09-14T10:54:15.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.400+0000 7faa01046780 1 < completed delete operation key=VIO703UXIJXV tag=R9K25BERS4IT type=del 2024-09-14T10:54:15.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.402+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~MVTPIDF4AULL.0 size=317671 2024-09-14T10:54:15.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.402+0000 7faa01046780 1 > prepared multipart upload key=FOJGGEQZD7YW upload=MVTPIDF4AULL tag=RCR3CLJ7UPR2 type=write size=1366247 2024-09-14T10:54:15.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.404+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~I6ODAAHSF9AF.0 size=1048576 2024-09-14T10:54:15.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.405+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~I6ODAAHSF9AF.1 size=963740 2024-09-14T10:54:15.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.408+0000 7faa01046780 1 < completed multipart upload key=GG02P21TFKIM upload=I6ODAAHSF9AF tag=01WAV9ZQWWVF type=write size=3060892 2024-09-14T10:54:15.407 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.409+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=FCO2RCW05CJ4 type=del size=1713813 2024-09-14T10:54:15.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.410+0000 7faa01046780 1 < canceled operation key=3FSH0OFMF54V tag=4ECGHO0LD70F type=del size=3822105 2024-09-14T10:54:15.410 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.412+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=3Z62P874R554 type=del size=2087763 2024-09-14T10:54:15.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.413+0000 7faa01046780 1 < completed delete operation key=PBRZNGSOLJ8E tag=PWUC8AKI97MM type=del 2024-09-14T10:54:15.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.415+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~8OR36YNP3OUK.0 size=1048576 2024-09-14T10:54:15.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.416+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~8OR36YNP3OUK.1 size=73407 2024-09-14T10:54:15.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.417+0000 7faa01046780 1 > prepared multipart upload key=V11YJWHT4OOD upload=8OR36YNP3OUK tag=J68X9CXP4CWC type=write size=2170559 2024-09-14T10:54:15.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.418+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=MS66QBFPKYQK type=del 2024-09-14T10:54:15.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.420+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=L3UCVZ5ET4YO type=write size=283052 2024-09-14T10:54:15.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.421+0000 7faa01046780 -1 < failed to complete operation key=V11YJWHT4OOD tag=CPGUMN1BH2NU type=del size=284001: (22) Invalid argument 2024-09-14T10:54:15.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.423+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=1DKWT150NIO1 type=del size=2573405 2024-09-14T10:54:15.423 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.425+0000 7faa01046780 1 < completed write operation key=S3BGVJ9N9S4P tag=8TM739ZJPQNO type=write size=796955 2024-09-14T10:54:15.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.427+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=TS4GSQCGE7YH type=del size=3959488 2024-09-14T10:54:15.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.427+0000 7faa01046780 1 < canceled part key=_multipart_ZY0BY3G9NREC.2~E18XSY8JGNWJ.0 size=1048576 2024-09-14T10:54:15.427 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.428+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~E18XSY8JGNWJ.1 size=1048576 2024-09-14T10:54:15.428 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.429+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~E18XSY8JGNWJ.2 size=393506 2024-09-14T10:54:15.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.432+0000 7faa01046780 1 < canceled multipart upload key=ZY0BY3G9NREC upload=E18XSY8JGNWJ tag=DG3M0SXT85NA type=write size=3539234 2024-09-14T10:54:15.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.433+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=4K0I2Q5V252E type=del size=2579692 2024-09-14T10:54:15.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.434+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~HOAZMMUHCVHG.0 size=347395 2024-09-14T10:54:15.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.437+0000 7faa01046780 1 < completed multipart upload key=U8TE0XNK9YKM upload=HOAZMMUHCVHG tag=CCV5NI27FN1F type=write size=1395971 2024-09-14T10:54:15.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.438+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=2JHUQR8H1WPL type=del size=1336286 2024-09-14T10:54:15.438 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.439+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~NX1OE6MV0PQV.0 size=1048576 2024-09-14T10:54:15.439 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.440+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~NX1OE6MV0PQV.1 size=1048576 2024-09-14T10:54:15.440 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.441+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~NX1OE6MV0PQV.2 size=476478 2024-09-14T10:54:15.442 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.444+0000 7faa01046780 1 < completed multipart upload key=SJ02N8472YDM upload=NX1OE6MV0PQV tag=CFJCYIUTILJQ type=write size=3622206 2024-09-14T10:54:15.444 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.445+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=YAJ4ZNMAU196 type=del size=3564559 2024-09-14T10:54:15.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.447+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=BLA2VNQAJLIF type=del 2024-09-14T10:54:15.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.449+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~DQA4OZL963SS.0 size=1048576 2024-09-14T10:54:15.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.450+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~DQA4OZL963SS.1 size=136905 2024-09-14T10:54:15.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.450+0000 7faa01046780 1 > prepared multipart upload key=PS2QU1UZUYHE upload=DQA4OZL963SS tag=J5VRB9UEF16V type=write size=2234057 2024-09-14T10:54:15.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.452+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=MTO0O0BYIZAC type=del 2024-09-14T10:54:15.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.454+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=Y2YERPK9NUG9 type=del size=719132 2024-09-14T10:54:15.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.455+0000 7faa01046780 1 < canceled operation key=TDNQZ8Y1C6X2 tag=2OWPCP4F0GTH type=del size=3225433 2024-09-14T10:54:15.455 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.456+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=CB89PFDAHTXR type=del size=1389702 2024-09-14T10:54:15.456 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.457+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~33FGCB8IXJ6U.0 size=1048576 2024-09-14T10:54:15.457 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.458+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~33FGCB8IXJ6U.1 size=969525 2024-09-14T10:54:15.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.461+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=33FGCB8IXJ6U tag=NNMLZDOQYC5Y type=write size=3066677 2024-09-14T10:54:15.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.462+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=74ZA52IQJPV4 type=del size=421267 2024-09-14T10:54:15.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.464+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=GC28N542SIHX type=del 2024-09-14T10:54:15.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.466+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=XR1MU9ZZTSZT type=del size=1901918 2024-09-14T10:54:15.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.468+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~7D0ZZXPJEIN3.0 size=360909 2024-09-14T10:54:15.469 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.470+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=7D0ZZXPJEIN3 tag=8W95KELJ7C47 type=write size=1409485 2024-09-14T10:54:15.470 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.471+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=PR1FMC9B8ODZ type=del size=640753 2024-09-14T10:54:15.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.473+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~MVTPIDF4AULL.0 size=317671 2024-09-14T10:54:15.474 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.475+0000 7faa01046780 1 < completed multipart upload key=FOJGGEQZD7YW upload=MVTPIDF4AULL tag=RCR3CLJ7UPR2 type=write size=1366247 2024-09-14T10:54:15.476 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.478+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~9T22FCDHEI84.0 size=628012 2024-09-14T10:54:15.477 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.478+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=9T22FCDHEI84 tag=VZSH44MRK6VR type=write size=1676588 2024-09-14T10:54:15.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.481+0000 7faa01046780 1 < suggested update operation key=V5T3AN9D7DH6 tag=FCO2RCW05CJ4 type=del size=1713813 2024-09-14T10:54:15.482 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.483+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~VQ4B4NVXS9OX.0 size=1048576 2024-09-14T10:54:15.483 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.484+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~VQ4B4NVXS9OX.1 size=1048576 2024-09-14T10:54:15.484 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.485+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~VQ4B4NVXS9OX.2 size=531818 2024-09-14T10:54:15.484 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.485+0000 7faa01046780 1 > prepared multipart upload key=ZY0BY3G9NREC upload=VQ4B4NVXS9OX tag=3JYHBLW2ZSG8 type=write size=3677546 2024-09-14T10:54:15.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.487+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=3Z62P874R554 type=del 2024-09-14T10:54:15.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.489+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~D2M2RMP8PJ34.0 size=1048576 2024-09-14T10:54:15.489 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.490+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~D2M2RMP8PJ34.1 size=1037985 2024-09-14T10:54:15.489 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.490+0000 7faa01046780 1 > prepared multipart upload key=SJ02N8472YDM upload=D2M2RMP8PJ34 tag=5F3NL9L5ZJFS type=write size=3135137 2024-09-14T10:54:15.490 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.492+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~8OR36YNP3OUK.0 size=1048576 2024-09-14T10:54:15.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.493+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~8OR36YNP3OUK.1 size=73407 2024-09-14T10:54:15.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.495+0000 7faa01046780 1 < completed multipart upload key=V11YJWHT4OOD upload=8OR36YNP3OUK tag=J68X9CXP4CWC type=write size=2170559 2024-09-14T10:54:15.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.497+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=U3GKNALMI5F9 type=write size=727504 2024-09-14T10:54:15.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.498+0000 7faa01046780 1 < completed write operation key=PS2QU1UZUYHE tag=L3UCVZ5ET4YO type=write size=283052 2024-09-14T10:54:15.500 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.501+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~0EY156WAWFN7.0 size=1048576 2024-09-14T10:54:15.501 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.502+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~0EY156WAWFN7.1 size=185790 2024-09-14T10:54:15.501 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.502+0000 7faa01046780 1 > prepared multipart upload key=VIO703UXIJXV upload=0EY156WAWFN7 tag=ZTF2EIP02UL4 type=write size=2282942 2024-09-14T10:54:15.504 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.505+0000 7faa01046780 1 < suggested update operation key=V11YJWHT4OOD tag=1DKWT150NIO1 type=del size=2573405 2024-09-14T10:54:15.505 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.506+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=W6LSE3XXWRVL type=del size=3095322 2024-09-14T10:54:15.507 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.509+0000 7faa01046780 1 < canceled operation key=U8TE0XNK9YKM tag=TS4GSQCGE7YH type=del size=3959488 2024-09-14T10:54:15.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.509+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=0RG5I4YCTMU1 type=write size=777931 2024-09-14T10:54:15.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.512+0000 7faa01046780 1 < suggested update operation key=V905BR1VWUCV tag=4K0I2Q5V252E type=del size=2579692 2024-09-14T10:54:15.514 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.515+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~A0A16I2Z4U7U.0 size=1048576 2024-09-14T10:54:15.515 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.517+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~A0A16I2Z4U7U.1 size=1048576 2024-09-14T10:54:15.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.518+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~A0A16I2Z4U7U.2 size=10408 2024-09-14T10:54:15.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.518+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=A0A16I2Z4U7U tag=E5VHMJ5ZIMBJ type=write size=3156136 2024-09-14T10:54:15.519 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.520+0000 7faa01046780 1 < suggested remove operation key=XH8GHY9YRGTP tag=2JHUQR8H1WPL type=del 2024-09-14T10:54:15.520 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.521+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=FPT389P4ZRVV type=del size=3570857 2024-09-14T10:54:15.522 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.523+0000 7faa01046780 1 < completed delete operation key=0OL3SF5IWDMH tag=YAJ4ZNMAU196 type=del 2024-09-14T10:54:15.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.527+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~VKHZ41Y0QDEH.0 size=1048576 2024-09-14T10:54:15.526 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.528+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~VKHZ41Y0QDEH.1 size=793947 2024-09-14T10:54:15.526 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.528+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=VKHZ41Y0QDEH tag=28VBYEKD23B8 type=write size=2891099 2024-09-14T10:54:15.527 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.528+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~DQA4OZL963SS.0 size=1048576 2024-09-14T10:54:15.528 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.530+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~DQA4OZL963SS.1 size=136905 2024-09-14T10:54:15.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.532+0000 7faa01046780 1 < completed multipart upload key=PS2QU1UZUYHE upload=DQA4OZL963SS tag=J5VRB9UEF16V type=write size=2234057 2024-09-14T10:54:15.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.533+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=02LJRE9CG416 type=del size=380222 2024-09-14T10:54:15.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.534+0000 7faa01046780 1 < completed delete operation key=U8TE0XNK9YKM tag=Y2YERPK9NUG9 type=del 2024-09-14T10:54:15.536 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.537+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~U376CHRACWNW.0 size=1048576 2024-09-14T10:54:15.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.538+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~U376CHRACWNW.1 size=463645 2024-09-14T10:54:15.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.538+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=U376CHRACWNW tag=B0BHN0XU8C3V type=write size=2560797 2024-09-14T10:54:15.538 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.540+0000 7faa01046780 1 < completed delete operation key=GG02P21TFKIM tag=CB89PFDAHTXR type=del 2024-09-14T10:54:15.540 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.541+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=9PV24S7L1WFB type=write size=156112 2024-09-14T10:54:15.541 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.543+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=74ZA52IQJPV4 type=del 2024-09-14T10:54:15.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.545+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~EH1KFORR3RXP.0 size=1048576 2024-09-14T10:54:15.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.546+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~EH1KFORR3RXP.1 size=1048576 2024-09-14T10:54:15.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.547+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~EH1KFORR3RXP.2 size=947222 2024-09-14T10:54:15.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.547+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=EH1KFORR3RXP tag=WBGR1V8B6TRB type=write size=4092950 2024-09-14T10:54:15.548 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.550+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=XR1MU9ZZTSZT type=del 2024-09-14T10:54:15.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.550+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=DVJM6B7GT8G5 type=write size=246841 2024-09-14T10:54:15.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.554+0000 7faa01046780 1 < suggested update operation key=CKMDOO75UZGE tag=PR1FMC9B8ODZ type=del size=640753 2024-09-14T10:54:15.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.555+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=Z5YCMS47RCXD type=write size=1046329 2024-09-14T10:54:15.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.556+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~9T22FCDHEI84.0 size=628012 2024-09-14T10:54:15.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.559+0000 7faa01046780 1 < completed multipart upload key=0XVVSUIOBQPL upload=9T22FCDHEI84 tag=VZSH44MRK6VR type=write size=1676588 2024-09-14T10:54:15.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.561+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~DF1NY5SW4A9G.0 size=1048576 2024-09-14T10:54:15.560 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.562+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~DF1NY5SW4A9G.1 size=100451 2024-09-14T10:54:15.561 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.562+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=DF1NY5SW4A9G tag=UXL6A16WNM3X type=write size=2197603 2024-09-14T10:54:15.562 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.563+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~VQ4B4NVXS9OX.0 size=1048576 2024-09-14T10:54:15.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.564+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~VQ4B4NVXS9OX.1 size=1048576 2024-09-14T10:54:15.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.565+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~VQ4B4NVXS9OX.2 size=531818 2024-09-14T10:54:15.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.568+0000 7faa01046780 1 < completed multipart upload key=ZY0BY3G9NREC upload=VQ4B4NVXS9OX tag=3JYHBLW2ZSG8 type=write size=3677546 2024-09-14T10:54:15.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.569+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=MBSPQ5RQ7KQ3 type=del size=2450628 2024-09-14T10:54:15.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.570+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~D2M2RMP8PJ34.0 size=1048576 2024-09-14T10:54:15.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.571+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~D2M2RMP8PJ34.1 size=1037985 2024-09-14T10:54:15.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.573+0000 7faa01046780 1 < completed multipart upload key=SJ02N8472YDM upload=D2M2RMP8PJ34 tag=5F3NL9L5ZJFS type=write size=3135137 2024-09-14T10:54:15.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.575+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=5KLM063ENK5E type=write size=968271 2024-09-14T10:54:15.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.576+0000 7faa01046780 1 < completed write operation key=NXIPG4HR9ZYY tag=U3GKNALMI5F9 type=write size=727504 2024-09-14T10:54:15.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.579+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~X5SH931FUPYY.0 size=1048576 2024-09-14T10:54:15.579 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.580+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~X5SH931FUPYY.1 size=469119 2024-09-14T10:54:15.579 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.580+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=X5SH931FUPYY tag=COAV3AWMKQ3Y type=write size=2566271 2024-09-14T10:54:15.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.581+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~0EY156WAWFN7.0 size=1048576 2024-09-14T10:54:15.581 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.582+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~0EY156WAWFN7.1 size=185790 2024-09-14T10:54:15.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.585+0000 7faa01046780 1 < completed multipart upload key=VIO703UXIJXV upload=0EY156WAWFN7 tag=ZTF2EIP02UL4 type=write size=2282942 2024-09-14T10:54:15.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.587+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~J7CRR4NMV1PR.0 size=1048576 2024-09-14T10:54:15.587 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.588+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~J7CRR4NMV1PR.1 size=1048576 2024-09-14T10:54:15.588 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.589+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~J7CRR4NMV1PR.2 size=725093 2024-09-14T10:54:15.588 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.589+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=J7CRR4NMV1PR tag=3P08DKZ1UPBO type=write size=3870821 2024-09-14T10:54:15.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.591+0000 7faa01046780 1 < completed delete operation key=PBRZNGSOLJ8E tag=W6LSE3XXWRVL type=del 2024-09-14T10:54:15.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.594+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~DYIDF3AYSSTI.0 size=1048576 2024-09-14T10:54:15.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.595+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~DYIDF3AYSSTI.1 size=1048576 2024-09-14T10:54:15.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.596+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~DYIDF3AYSSTI.2 size=131372 2024-09-14T10:54:15.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.596+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=DYIDF3AYSSTI tag=PK5P8NTJ9KQD type=write size=3277100 2024-09-14T10:54:15.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.597+0000 7faa01046780 1 < canceled operation key=0OL3SF5IWDMH tag=0RG5I4YCTMU1 type=write size=777931 2024-09-14T10:54:15.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.600+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=AJ1XEP0VDDSR type=write size=101585 2024-09-14T10:54:15.600 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.601+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~A0A16I2Z4U7U.0 size=1048576 2024-09-14T10:54:15.600 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.602+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~A0A16I2Z4U7U.1 size=1048576 2024-09-14T10:54:15.601 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.603+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~A0A16I2Z4U7U.2 size=10408 2024-09-14T10:54:15.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.606+0000 7faa01046780 1 < completed multipart upload key=S3BGVJ9N9S4P upload=A0A16I2Z4U7U tag=E5VHMJ5ZIMBJ type=write size=3156136 2024-09-14T10:54:15.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.608+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=81QO4Y6PP6IL type=write size=264777 2024-09-14T10:54:15.609 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.609+0000 7faa01046780 1 < completed delete operation key=3UEX0IPM4CPY tag=FPT389P4ZRVV type=del 2024-09-14T10:54:15.609 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.610+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=5CH4S98KJVN7 type=del size=1561332 2024-09-14T10:54:15.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.612+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~VKHZ41Y0QDEH.0 size=1048576 2024-09-14T10:54:15.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.613+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~VKHZ41Y0QDEH.1 size=793947 2024-09-14T10:54:15.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.615+0000 7faa01046780 1 < completed multipart upload key=HYAGNAOWK8LF upload=VKHZ41Y0QDEH tag=28VBYEKD23B8 type=write size=2891099 2024-09-14T10:54:15.616 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.617+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=L7BTBXJGY9MN type=del size=3750456 2024-09-14T10:54:15.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.620+0000 7faa01046780 1 < suggested update operation key=V905BR1VWUCV tag=02LJRE9CG416 type=del size=380222 2024-09-14T10:54:15.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.621+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=E0MH95MSA999 type=del size=3427826 2024-09-14T10:54:15.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.623+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~U376CHRACWNW.0 size=1048576 2024-09-14T10:54:15.623 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.624+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~U376CHRACWNW.1 size=463645 2024-09-14T10:54:15.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.626+0000 7faa01046780 1 < completed multipart upload key=U8TE0XNK9YKM upload=U376CHRACWNW tag=B0BHN0XU8C3V type=write size=2560797 2024-09-14T10:54:15.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.628+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=6N6JHDS9ZVQ2 type=del size=938299 2024-09-14T10:54:15.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.630+0000 7faa01046780 1 < completed write operation key=Y4CB0HIN0750 tag=9PV24S7L1WFB type=write size=156112 2024-09-14T10:54:15.631 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.633+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~OFVWGJC4K9GZ.0 size=1048576 2024-09-14T10:54:15.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.633+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~OFVWGJC4K9GZ.1 size=315650 2024-09-14T10:54:15.633 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.633+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=OFVWGJC4K9GZ tag=6V4J0Q7MRX3M type=write size=2412802 2024-09-14T10:54:15.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.635+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~EH1KFORR3RXP.0 size=1048576 2024-09-14T10:54:15.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.637+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~EH1KFORR3RXP.1 size=1048576 2024-09-14T10:54:15.637 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.639+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~EH1KFORR3RXP.2 size=947222 2024-09-14T10:54:15.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.640+0000 7faa01046780 1 < completed multipart upload key=XDJAK0XYQNF0 upload=EH1KFORR3RXP tag=WBGR1V8B6TRB type=write size=4092950 2024-09-14T10:54:15.641 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.642+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=SZTFBDK7MFV7 type=del size=2659042 2024-09-14T10:54:15.644 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.645+0000 7faa01046780 1 < suggested remove operation key=3UEX0IPM4CPY tag=DVJM6B7GT8G5 type=write 2024-09-14T10:54:15.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.646+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=8HO9C9IIM0X1 type=write size=452616 2024-09-14T10:54:15.648 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.649+0000 7faa01046780 1 < suggested update operation key=BBDTPL35W4W0 tag=Z5YCMS47RCXD type=write size=1046329 2024-09-14T10:54:15.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.651+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=EI05DQ57FL10 type=write size=317353 2024-09-14T10:54:15.651 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.652+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~DF1NY5SW4A9G.0 size=1048576 2024-09-14T10:54:15.652 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.653+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~DF1NY5SW4A9G.1 size=100451 2024-09-14T10:54:15.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.656+0000 7faa01046780 1 < completed multipart upload key=XDJAK0XYQNF0 upload=DF1NY5SW4A9G tag=UXL6A16WNM3X type=write size=2197603 2024-09-14T10:54:15.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.657+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=VSC2PDTUVE9P type=write size=156637 2024-09-14T10:54:15.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.659+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=MBSPQ5RQ7KQ3 type=del 2024-09-14T10:54:15.660 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.661+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~UXATQFWDADQS.0 size=1048576 2024-09-14T10:54:15.661 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.662+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~UXATQFWDADQS.1 size=1048576 2024-09-14T10:54:15.662 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.664+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~UXATQFWDADQS.2 size=296395 2024-09-14T10:54:15.662 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.664+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=UXATQFWDADQS tag=DVVZY79I531H type=write size=3442123 2024-09-14T10:54:15.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.665+0000 7faa01046780 1 < completed write operation key=X9DUVQBBLUTF tag=5KLM063ENK5E type=write size=968271 2024-09-14T10:54:15.666 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.667+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~ZS8V2BE090WJ.0 size=1048576 2024-09-14T10:54:15.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.669+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~ZS8V2BE090WJ.1 size=1048576 2024-09-14T10:54:15.668 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.670+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~ZS8V2BE090WJ.2 size=43018 2024-09-14T10:54:15.669 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.670+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=ZS8V2BE090WJ tag=L8BHFDQZTHS9 type=write size=3188746 2024-09-14T10:54:15.670 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.671+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~X5SH931FUPYY.0 size=1048576 2024-09-14T10:54:15.670 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.671+0000 7faa01046780 1 < canceled part key=_multipart_3FSH0OFMF54V.2~X5SH931FUPYY.1 size=469119 2024-09-14T10:54:15.672 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.674+0000 7faa01046780 1 < canceled multipart upload key=3FSH0OFMF54V upload=X5SH931FUPYY tag=COAV3AWMKQ3Y type=write size=2566271 2024-09-14T10:54:15.674 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.675+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=49T7CQZDDQ6F type=del size=3890389 2024-09-14T10:54:15.675 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.677+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~J7CRR4NMV1PR.0 size=1048576 2024-09-14T10:54:15.677 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.679+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~J7CRR4NMV1PR.1 size=1048576 2024-09-14T10:54:15.677 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.679+0000 7faa01046780 1 < canceled part key=_multipart_Q33ET1AN14NG.2~J7CRR4NMV1PR.2 size=725093 2024-09-14T10:54:15.679 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.680+0000 7faa01046780 1 < canceled multipart upload key=Q33ET1AN14NG upload=J7CRR4NMV1PR tag=3P08DKZ1UPBO type=write size=3870821 2024-09-14T10:54:15.682 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.683+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~PDFYEGI0G70O.0 size=1048576 2024-09-14T10:54:15.683 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.685+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~PDFYEGI0G70O.1 size=157233 2024-09-14T10:54:15.683 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.685+0000 7faa01046780 1 > prepared multipart upload key=PBRZNGSOLJ8E upload=PDFYEGI0G70O tag=Q8YQSO8GA603 type=write size=2254385 2024-09-14T10:54:15.684 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.685+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~DYIDF3AYSSTI.0 size=1048576 2024-09-14T10:54:15.685 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.686+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~DYIDF3AYSSTI.1 size=1048576 2024-09-14T10:54:15.686 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.688+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~DYIDF3AYSSTI.2 size=131372 2024-09-14T10:54:15.689 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.691+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=DYIDF3AYSSTI tag=PK5P8NTJ9KQD type=write size=3277100 2024-09-14T10:54:15.690 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.691+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=VZH0M8AG88MJ type=del size=38152 2024-09-14T10:54:15.692 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.693+0000 7faa01046780 1 < completed write operation key=XDJAK0XYQNF0 tag=AJ1XEP0VDDSR type=write size=101585 2024-09-14T10:54:15.694 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.696+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~125PA945PWU2.0 size=1048576 2024-09-14T10:54:15.696 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.697+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~125PA945PWU2.1 size=1048576 2024-09-14T10:54:15.697 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.698+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~125PA945PWU2.2 size=895287 2024-09-14T10:54:15.697 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.698+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=125PA945PWU2 tag=4ZQ37DHOA2OX type=write size=4041015 2024-09-14T10:54:15.699 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.701+0000 7faa01046780 1 < suggested update operation key=S3BGVJ9N9S4P tag=81QO4Y6PP6IL type=write size=264777 2024-09-14T10:54:15.702 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.703+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~8LL4HYNSTW62.0 size=1024387 2024-09-14T10:54:15.702 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.703+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=8LL4HYNSTW62 tag=HGGT3NI029BK type=write size=2072963 2024-09-14T10:54:15.703 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.705+0000 7faa01046780 1 < completed delete operation key=V5T3AN9D7DH6 tag=5CH4S98KJVN7 type=del 2024-09-14T10:54:15.706 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.708+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~MUE1WB34J23B.0 size=1048576 2024-09-14T10:54:15.707 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.709+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~MUE1WB34J23B.1 size=548662 2024-09-14T10:54:15.707 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.709+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=MUE1WB34J23B tag=0BV4F6UN1RGW type=write size=2645814 2024-09-14T10:54:15.708 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.710+0000 7faa01046780 1 < completed delete operation key=GG02P21TFKIM tag=L7BTBXJGY9MN type=del 2024-09-14T10:54:15.711 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.713+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~IUNFB9J598QC.0 size=1048576 2024-09-14T10:54:15.712 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.713+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~IUNFB9J598QC.1 size=238199 2024-09-14T10:54:15.712 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.713+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=IUNFB9J598QC tag=32SX7L8NNMO1 type=write size=2335351 2024-09-14T10:54:15.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.715+0000 7faa01046780 1 < completed delete operation key=PBRZNGSOLJ8E tag=E0MH95MSA999 type=del 2024-09-14T10:54:15.716 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.718+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~ZQ1T2JYURVB7.0 size=289263 2024-09-14T10:54:15.716 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.718+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=ZQ1T2JYURVB7 tag=4MJ65YXM7I3K type=write size=1337839 2024-09-14T10:54:15.717 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.719+0000 7faa01046780 1 < completed delete operation key=V5T3AN9D7DH6 tag=6N6JHDS9ZVQ2 type=del 2024-09-14T10:54:15.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.721+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=O59QK28EZ6J5 type=write size=346350 2024-09-14T10:54:15.720 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.721+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~OFVWGJC4K9GZ.0 size=1048576 2024-09-14T10:54:15.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.723+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~OFVWGJC4K9GZ.1 size=315650 2024-09-14T10:54:15.724 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.726+0000 7faa01046780 1 < completed multipart upload key=XDJAK0XYQNF0 upload=OFVWGJC4K9GZ tag=6V4J0Q7MRX3M type=write size=2412802 2024-09-14T10:54:15.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.727+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=Y6ZQEG9S8NXN type=del size=2142002 2024-09-14T10:54:15.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.729+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=SZTFBDK7MFV7 type=del 2024-09-14T10:54:15.730 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.731+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~EHLSBXIT02AV.0 size=1048576 2024-09-14T10:54:15.731 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.732+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~EHLSBXIT02AV.1 size=1048576 2024-09-14T10:54:15.732 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.733+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~EHLSBXIT02AV.2 size=334439 2024-09-14T10:54:15.732 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.733+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=EHLSBXIT02AV tag=VTA5ZWCJ45SG type=write size=3480167 2024-09-14T10:54:15.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.736+0000 7faa01046780 1 < suggested update operation key=HUBZAFMSCCNC tag=8HO9C9IIM0X1 type=write size=452616 2024-09-14T10:54:15.736 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.737+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=889X2E59QENC type=del size=2061891 2024-09-14T10:54:15.737 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.739+0000 7faa01046780 1 < canceled operation key=PS2QU1UZUYHE tag=EI05DQ57FL10 type=write size=317353 2024-09-14T10:54:15.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.740+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=ELLRSKU1PL8W type=write size=200468 2024-09-14T10:54:15.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.742+0000 7faa01046780 1 < completed write operation key=BBDTPL35W4W0 tag=VSC2PDTUVE9P type=write size=156637 2024-09-14T10:54:15.743 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.745+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~AEBVGJEJ8CS5.0 size=1048576 2024-09-14T10:54:15.744 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.745+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~AEBVGJEJ8CS5.1 size=361851 2024-09-14T10:54:15.744 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.745+0000 7faa01046780 1 > prepared multipart upload key=PBRZNGSOLJ8E upload=AEBVGJEJ8CS5 tag=6V99BLFC4P3X type=write size=2459003 2024-09-14T10:54:15.746 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.747+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~UXATQFWDADQS.0 size=1048576 2024-09-14T10:54:15.747 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.748+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~UXATQFWDADQS.1 size=1048576 2024-09-14T10:54:15.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.749+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~UXATQFWDADQS.2 size=296395 2024-09-14T10:54:15.752 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.752+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=UXATQFWDADQS tag=DVVZY79I531H type=write size=3442123 2024-09-14T10:54:15.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.753+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=CE6DKB1B5ZA3 type=write size=549549 2024-09-14T10:54:15.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.755+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~ZS8V2BE090WJ.0 size=1048576 2024-09-14T10:54:15.755 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.756+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~ZS8V2BE090WJ.1 size=1048576 2024-09-14T10:54:15.756 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.758+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~ZS8V2BE090WJ.2 size=43018 2024-09-14T10:54:15.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.760+0000 7faa01046780 1 < completed multipart upload key=HUBZAFMSCCNC upload=ZS8V2BE090WJ tag=L8BHFDQZTHS9 type=write size=3188746 2024-09-14T10:54:15.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.761+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=WE4M2RH3EFI1 type=del size=4126521 2024-09-14T10:54:15.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.762+0000 7faa01046780 1 < canceled operation key=VIO703UXIJXV tag=49T7CQZDDQ6F type=del size=3890389 2024-09-14T10:54:15.763 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.764+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=5SFQAC5LKOM0 type=write size=266208 2024-09-14T10:54:15.764 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.765+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~PDFYEGI0G70O.0 size=1048576 2024-09-14T10:54:15.765 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.766+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~PDFYEGI0G70O.1 size=157233 2024-09-14T10:54:15.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.769+0000 7faa01046780 1 < completed multipart upload key=PBRZNGSOLJ8E upload=PDFYEGI0G70O tag=Q8YQSO8GA603 type=write size=2254385 2024-09-14T10:54:15.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.770+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=A5RNIG9OKPX8 type=del size=1687692 2024-09-14T10:54:15.771 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.772+0000 7faa01046780 1 < completed delete operation key=KDUTH9PIR3FI tag=VZH0M8AG88MJ type=del 2024-09-14T10:54:15.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.773+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=GLU45M5UB9QZ type=del size=1465001 2024-09-14T10:54:15.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.775+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~125PA945PWU2.0 size=1048576 2024-09-14T10:54:15.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.776+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~125PA945PWU2.1 size=1048576 2024-09-14T10:54:15.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.776+0000 7faa01046780 1 < canceled part key=_multipart_V905BR1VWUCV.2~125PA945PWU2.2 size=895287 2024-09-14T10:54:15.777 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.779+0000 7faa01046780 1 < canceled multipart upload key=V905BR1VWUCV upload=125PA945PWU2 tag=4ZQ37DHOA2OX type=write size=4041015 2024-09-14T10:54:15.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.780+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=CIT30H09XI0W type=del size=120946 2024-09-14T10:54:15.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.782+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~8LL4HYNSTW62.0 size=1024387 2024-09-14T10:54:15.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.784+0000 7faa01046780 1 < completed multipart upload key=HUBZAFMSCCNC upload=8LL4HYNSTW62 tag=HGGT3NI029BK type=write size=2072963 2024-09-14T10:54:15.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.787+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~BMK5HIR0D9BB.0 size=1048576 2024-09-14T10:54:15.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.788+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~BMK5HIR0D9BB.1 size=993314 2024-09-14T10:54:15.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.788+0000 7faa01046780 1 > prepared multipart upload key=3UEX0IPM4CPY upload=BMK5HIR0D9BB tag=SQJ35FAIMDIJ type=write size=3090466 2024-09-14T10:54:15.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.790+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~MUE1WB34J23B.0 size=1048576 2024-09-14T10:54:15.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.791+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~MUE1WB34J23B.1 size=548662 2024-09-14T10:54:15.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.793+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=MUE1WB34J23B tag=0BV4F6UN1RGW type=write size=2645814 2024-09-14T10:54:15.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.794+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=97F6YE378S6J type=del size=1603539 2024-09-14T10:54:15.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.795+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~IUNFB9J598QC.0 size=1048576 2024-09-14T10:54:15.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.796+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~IUNFB9J598QC.1 size=238199 2024-09-14T10:54:15.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.799+0000 7faa01046780 1 < completed multipart upload key=HYAGNAOWK8LF upload=IUNFB9J598QC tag=32SX7L8NNMO1 type=write size=2335351 2024-09-14T10:54:15.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.802+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~0V0G6N86VSMY.0 size=930949 2024-09-14T10:54:15.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.802+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=0V0G6N86VSMY tag=3H1BVRPBYL1O type=write size=1979525 2024-09-14T10:54:15.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.803+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~ZQ1T2JYURVB7.0 size=289263 2024-09-14T10:54:15.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.805+0000 7faa01046780 1 < completed multipart upload key=U8TE0XNK9YKM upload=ZQ1T2JYURVB7 tag=4MJ65YXM7I3K type=write size=1337839 2024-09-14T10:54:15.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.806+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=X3X454YV6R3U type=del size=789771 2024-09-14T10:54:15.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.808+0000 7faa01046780 1 < completed write operation key=FOJGGEQZD7YW tag=O59QK28EZ6J5 type=write size=346350 2024-09-14T10:54:15.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.809+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=H69XDDN45ASN type=del size=2962828 2024-09-14T10:54:15.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.812+0000 7faa01046780 1 < suggested update operation key=ZY0BY3G9NREC tag=Y6ZQEG9S8NXN type=del size=2142002 2024-09-14T10:54:15.812 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.813+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=QQ23C2H0HI3O type=del size=1631373 2024-09-14T10:54:15.813 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.815+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~EHLSBXIT02AV.0 size=1048576 2024-09-14T10:54:15.814 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.816+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~EHLSBXIT02AV.1 size=1048576 2024-09-14T10:54:15.815 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.817+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~EHLSBXIT02AV.2 size=334439 2024-09-14T10:54:15.818 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.819+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=EHLSBXIT02AV tag=VTA5ZWCJ45SG type=write size=3480167 2024-09-14T10:54:15.821 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.821+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~FHP4OPRC6VI3.0 size=1048576 2024-09-14T10:54:15.821 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.822+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~FHP4OPRC6VI3.1 size=1048576 2024-09-14T10:54:15.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.823+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~FHP4OPRC6VI3.2 size=322098 2024-09-14T10:54:15.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.823+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=FHP4OPRC6VI3 tag=F2XWGOM8JIBJ type=write size=3467826 2024-09-14T10:54:15.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.825+0000 7faa01046780 1 < completed delete operation key=X9DUVQBBLUTF tag=889X2E59QENC type=del 2024-09-14T10:54:15.826 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.827+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~6P2P3WBTVNM8.0 size=739958 2024-09-14T10:54:15.826 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.827+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=6P2P3WBTVNM8 tag=3I1ZJ3DDCKLL type=write size=1788534 2024-09-14T10:54:15.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.829+0000 7faa01046780 1 < completed write operation key=VIO703UXIJXV tag=ELLRSKU1PL8W type=write size=200468 2024-09-14T10:54:15.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.830+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=J8AVGWVJPMYA type=write size=542171 2024-09-14T10:54:15.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.832+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~AEBVGJEJ8CS5.0 size=1048576 2024-09-14T10:54:15.831 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.833+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~AEBVGJEJ8CS5.1 size=361851 2024-09-14T10:54:15.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.835+0000 7faa01046780 1 < completed multipart upload key=PBRZNGSOLJ8E upload=AEBVGJEJ8CS5 tag=6V99BLFC4P3X type=write size=2459003 2024-09-14T10:54:15.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.836+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=H11UNQ84ZWIQ type=del size=3401322 2024-09-14T10:54:15.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.838+0000 7faa01046780 1 < completed write operation key=X9DUVQBBLUTF tag=CE6DKB1B5ZA3 type=write size=549549 2024-09-14T10:54:15.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.839+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=I84PCQ2OMPW1 type=del size=307884 2024-09-14T10:54:15.839 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.841+0000 7faa01046780 1 < completed delete operation key=PS2QU1UZUYHE tag=WE4M2RH3EFI1 type=del 2024-09-14T10:54:15.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.842+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=J6HT4XSMSTPR type=del size=3958415 2024-09-14T10:54:15.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.843+0000 7faa01046780 1 < completed write operation key=S3BGVJ9N9S4P tag=5SFQAC5LKOM0 type=write size=266208 2024-09-14T10:54:15.844 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.846+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~TJD6W88GILY8.0 size=1048576 2024-09-14T10:54:15.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.847+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~TJD6W88GILY8.1 size=1037846 2024-09-14T10:54:15.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.847+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=TJD6W88GILY8 tag=IYUJH4X8SUDC type=write size=3134998 2024-09-14T10:54:15.847 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.848+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=A5RNIG9OKPX8 type=del 2024-09-14T10:54:15.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.850+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~V2060AZVFQV4.0 size=557756 2024-09-14T10:54:15.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.850+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=V2060AZVFQV4 tag=76X3IR0NC7GC type=write size=1606332 2024-09-14T10:54:15.852 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.853+0000 7faa01046780 1 < suggested update operation key=ZY0BY3G9NREC tag=GLU45M5UB9QZ type=del size=1465001 2024-09-14T10:54:15.853 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.855+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=5R8U4MQ8YK2E type=del size=1647083 2024-09-14T10:54:15.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.859+0000 7faa01046780 1 < suggested update operation key=3FSH0OFMF54V tag=CIT30H09XI0W type=del size=120946 2024-09-14T10:54:15.860 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.861+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~T3DY84KQ71QK.0 size=1048576 2024-09-14T10:54:15.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.862+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~T3DY84KQ71QK.1 size=1048576 2024-09-14T10:54:15.862 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.863+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~T3DY84KQ71QK.2 size=619568 2024-09-14T10:54:15.862 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.863+0000 7faa01046780 1 > prepared multipart upload key=TDNQZ8Y1C6X2 upload=T3DY84KQ71QK tag=ATDWWVKS6J80 type=write size=3765296 2024-09-14T10:54:15.864 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.865+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~BMK5HIR0D9BB.0 size=1048576 2024-09-14T10:54:15.865 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.866+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~BMK5HIR0D9BB.1 size=993314 2024-09-14T10:54:15.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.868+0000 7faa01046780 1 < completed multipart upload key=3UEX0IPM4CPY upload=BMK5HIR0D9BB tag=SQJ35FAIMDIJ type=write size=3090466 2024-09-14T10:54:15.868 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.869+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=8B0323LD8ICQ type=write size=398011 2024-09-14T10:54:15.870 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.871+0000 7faa01046780 1 < completed delete operation key=LF41PL7DFSJI tag=97F6YE378S6J type=del 2024-09-14T10:54:15.871 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.872+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=7706LRFSM7KC type=del size=665426 2024-09-14T10:54:15.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.874+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~0V0G6N86VSMY.0 size=930949 2024-09-14T10:54:15.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.876+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=0V0G6N86VSMY tag=3H1BVRPBYL1O type=write size=1979525 2024-09-14T10:54:15.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.878+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~X8FZMV7I7JEB.0 size=1048576 2024-09-14T10:54:15.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.880+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~X8FZMV7I7JEB.1 size=485063 2024-09-14T10:54:15.879 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.880+0000 7faa01046780 1 > prepared multipart upload key=GG02P21TFKIM upload=X8FZMV7I7JEB tag=1VU6K75UEZB4 type=write size=2582215 2024-09-14T10:54:15.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.881+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=X3X454YV6R3U type=del 2024-09-14T10:54:15.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.885+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~C0I4LXOLXPOQ.0 size=1048576 2024-09-14T10:54:15.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.885+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~C0I4LXOLXPOQ.1 size=1048576 2024-09-14T10:54:15.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.886+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~C0I4LXOLXPOQ.2 size=240146 2024-09-14T10:54:15.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.886+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=C0I4LXOLXPOQ tag=R2QGJJT4TPAG type=write size=3385874 2024-09-14T10:54:15.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.887+0000 7faa01046780 1 < canceled operation key=KDUTH9PIR3FI tag=H69XDDN45ASN type=del size=2962828 2024-09-14T10:54:15.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.891+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~X4720AHD5Y3W.0 size=466695 2024-09-14T10:54:15.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.891+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=X4720AHD5Y3W tag=4SQ8YZCQLPZ5 type=write size=1515271 2024-09-14T10:54:15.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.891+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=QQ23C2H0HI3O type=del 2024-09-14T10:54:15.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.894+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~4SG7IK513IUH.0 size=1048576 2024-09-14T10:54:15.894 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.895+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~4SG7IK513IUH.1 size=692547 2024-09-14T10:54:15.894 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.895+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=4SG7IK513IUH tag=VJ97ET7DK4VM type=write size=2789699 2024-09-14T10:54:15.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.897+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~FHP4OPRC6VI3.0 size=1048576 2024-09-14T10:54:15.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.898+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~FHP4OPRC6VI3.1 size=1048576 2024-09-14T10:54:15.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.899+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~FHP4OPRC6VI3.2 size=322098 2024-09-14T10:54:15.900 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.901+0000 7faa01046780 1 < completed multipart upload key=HUBZAFMSCCNC upload=FHP4OPRC6VI3 tag=F2XWGOM8JIBJ type=write size=3467826 2024-09-14T10:54:15.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.903+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=E472GK7XANWW type=del size=1669140 2024-09-14T10:54:15.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.904+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~6P2P3WBTVNM8.0 size=739958 2024-09-14T10:54:15.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.907+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=6P2P3WBTVNM8 tag=3I1ZJ3DDCKLL type=write size=1788534 2024-09-14T10:54:15.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.909+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~SIAGJRFEF9B6.0 size=1048576 2024-09-14T10:54:15.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.911+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~SIAGJRFEF9B6.1 size=208121 2024-09-14T10:54:15.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.911+0000 7faa01046780 1 > prepared multipart upload key=3UEX0IPM4CPY upload=SIAGJRFEF9B6 tag=Q09VA1B6OC8F type=write size=2305273 2024-09-14T10:54:15.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.912+0000 7faa01046780 1 < completed write operation key=S3BGVJ9N9S4P tag=J8AVGWVJPMYA type=write size=542171 2024-09-14T10:54:15.913 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.914+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=1BLFAAWKSTUR type=del size=1143667 2024-09-14T10:54:15.914 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.915+0000 7faa01046780 1 < completed delete operation key=NXIPG4HR9ZYY tag=H11UNQ84ZWIQ type=del 2024-09-14T10:54:15.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.918+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~G36J9TU9S5A7.0 size=1048576 2024-09-14T10:54:15.918 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.919+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~G36J9TU9S5A7.1 size=1048576 2024-09-14T10:54:15.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.920+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~G36J9TU9S5A7.2 size=809985 2024-09-14T10:54:15.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.920+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=G36J9TU9S5A7 tag=JY1GKEI73ZJ4 type=write size=3955713 2024-09-14T10:54:15.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.922+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=I84PCQ2OMPW1 type=del 2024-09-14T10:54:15.922 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.923+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=CMHNM0RAM1YB type=del size=3556596 2024-09-14T10:54:15.923 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.925+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=J6HT4XSMSTPR type=del 2024-09-14T10:54:15.925 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.926+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=SS4FOHK04QT1 type=write size=636563 2024-09-14T10:54:15.926 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.928+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~TJD6W88GILY8.0 size=1048576 2024-09-14T10:54:15.927 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.929+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~TJD6W88GILY8.1 size=1037846 2024-09-14T10:54:15.930 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.931+0000 7faa01046780 1 < completed multipart upload key=Y4CB0HIN0750 upload=TJD6W88GILY8 tag=IYUJH4X8SUDC type=write size=3134998 2024-09-14T10:54:15.933 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.934+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~QH2AP7YAVIDF.0 size=1048576 2024-09-14T10:54:15.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.935+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~QH2AP7YAVIDF.1 size=170912 2024-09-14T10:54:15.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.935+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=QH2AP7YAVIDF tag=WVK3NXSKZX62 type=write size=2268064 2024-09-14T10:54:15.935 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.936+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~V2060AZVFQV4.0 size=557756 2024-09-14T10:54:15.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.940+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=V2060AZVFQV4 tag=76X3IR0NC7GC type=write size=1606332 2024-09-14T10:54:15.940 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.942+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~06PCXVYF04NI.0 size=1048576 2024-09-14T10:54:15.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.943+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~06PCXVYF04NI.1 size=889860 2024-09-14T10:54:15.942 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.943+0000 7faa01046780 1 > prepared multipart upload key=VIO703UXIJXV upload=06PCXVYF04NI tag=UA4Z2JPL17WR type=write size=2987012 2024-09-14T10:54:15.943 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.944+0000 7faa01046780 1 < completed delete operation key=PS2QU1UZUYHE tag=5R8U4MQ8YK2E type=del 2024-09-14T10:54:15.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.947+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~R7ASI9HRQUTH.0 size=1048576 2024-09-14T10:54:15.947 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.948+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~R7ASI9HRQUTH.1 size=1048576 2024-09-14T10:54:15.948 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.949+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~R7ASI9HRQUTH.2 size=377155 2024-09-14T10:54:15.948 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.949+0000 7faa01046780 1 > prepared multipart upload key=F872GLVQDCX6 upload=R7ASI9HRQUTH tag=ZZSI842GK3MJ type=write size=3522883 2024-09-14T10:54:15.949 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.950+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~T3DY84KQ71QK.0 size=1048576 2024-09-14T10:54:15.952 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.951+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~T3DY84KQ71QK.1 size=1048576 2024-09-14T10:54:15.952 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.953+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~T3DY84KQ71QK.2 size=619568 2024-09-14T10:54:15.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.955+0000 7faa01046780 1 < completed multipart upload key=TDNQZ8Y1C6X2 upload=T3DY84KQ71QK tag=ATDWWVKS6J80 type=write size=3765296 2024-09-14T10:54:15.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.957+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=6S229PSUB2WT type=del size=1255153 2024-09-14T10:54:15.956 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.958+0000 7faa01046780 1 < completed write operation key=PTDE6D7OIU1A tag=8B0323LD8ICQ type=write size=398011 2024-09-14T10:54:15.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.959+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=Y36IWENV6CQC type=del size=1894547 2024-09-14T10:54:15.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.960+0000 7faa01046780 1 < completed delete operation key=0XVVSUIOBQPL tag=7706LRFSM7KC type=del 2024-09-14T10:54:15.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.962+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=PXRJX0RA9ZRM type=del size=734923 2024-09-14T10:54:15.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.963+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~X8FZMV7I7JEB.0 size=1048576 2024-09-14T10:54:15.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.965+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~X8FZMV7I7JEB.1 size=485063 2024-09-14T10:54:15.966 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.967+0000 7faa01046780 1 < completed multipart upload key=GG02P21TFKIM upload=X8FZMV7I7JEB tag=1VU6K75UEZB4 type=write size=2582215 2024-09-14T10:54:15.968 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.969+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~3RXN3B5U3G3M.0 size=1048576 2024-09-14T10:54:15.969 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.970+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~3RXN3B5U3G3M.1 size=1048576 2024-09-14T10:54:15.970 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.972+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~3RXN3B5U3G3M.2 size=1028358 2024-09-14T10:54:15.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.972+0000 7faa01046780 1 > prepared multipart upload key=ZY0BY3G9NREC upload=3RXN3B5U3G3M tag=2YGJ94L4AJ0G type=write size=4174086 2024-09-14T10:54:15.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.973+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~C0I4LXOLXPOQ.0 size=1048576 2024-09-14T10:54:15.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.974+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~C0I4LXOLXPOQ.1 size=1048576 2024-09-14T10:54:15.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.975+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~C0I4LXOLXPOQ.2 size=240146 2024-09-14T10:54:15.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.978+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=C0I4LXOLXPOQ tag=R2QGJJT4TPAG type=write size=3385874 2024-09-14T10:54:15.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.980+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~V322JA6NM28V.0 size=133747 2024-09-14T10:54:15.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.980+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=V322JA6NM28V tag=GA2IFCOAI11T type=write size=1182323 2024-09-14T10:54:15.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.981+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~X4720AHD5Y3W.0 size=466695 2024-09-14T10:54:15.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.984+0000 7faa01046780 1 < completed multipart upload key=HYAGNAOWK8LF upload=X4720AHD5Y3W tag=4SQ8YZCQLPZ5 type=write size=1515271 2024-09-14T10:54:15.985 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.987+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=7Y2D99ZBN08E type=write size=401470 2024-09-14T10:54:15.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.988+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~4SG7IK513IUH.0 size=1048576 2024-09-14T10:54:15.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.989+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~4SG7IK513IUH.1 size=692547 2024-09-14T10:54:15.990 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.991+0000 7faa01046780 1 < completed multipart upload key=HUBZAFMSCCNC upload=4SG7IK513IUH tag=VJ97ET7DK4VM type=write size=2789699 2024-09-14T10:54:15.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.994+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~ZEFSGAURR3F0.0 size=207832 2024-09-14T10:54:15.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.994+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=ZEFSGAURR3F0 tag=U4F54IBIY2Q0 type=write size=1256408 2024-09-14T10:54:15.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.996+0000 7faa01046780 1 < completed delete operation key=Q33ET1AN14NG tag=E472GK7XANWW type=del 2024-09-14T10:54:15.996 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.997+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=GU61YNHCNYWB type=del size=55928 2024-09-14T10:54:15.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.998+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~SIAGJRFEF9B6.0 size=1048576 2024-09-14T10:54:15.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:15.998+0000 7faa01046780 1 < canceled part key=_multipart_3UEX0IPM4CPY.2~SIAGJRFEF9B6.1 size=208121 2024-09-14T10:54:15.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.001+0000 7faa01046780 1 < canceled multipart upload key=3UEX0IPM4CPY upload=SIAGJRFEF9B6 tag=Q09VA1B6OC8F type=write size=2305273 2024-09-14T10:54:16.002 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.003+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~Q02RY7C2ULQ2.0 size=45426 2024-09-14T10:54:16.002 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.003+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=Q02RY7C2ULQ2 tag=DMQXKQLVREIX type=write size=1094002 2024-09-14T10:54:16.005 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.006+0000 7faa01046780 1 < suggested remove operation key=HUBZAFMSCCNC tag=1BLFAAWKSTUR type=del 2024-09-14T10:54:16.006 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.007+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=DUKRF8I68MRS type=del size=830287 2024-09-14T10:54:16.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.009+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~G36J9TU9S5A7.0 size=1048576 2024-09-14T10:54:16.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.009+0000 7faa01046780 1 < canceled part key=_multipart_V905BR1VWUCV.2~G36J9TU9S5A7.1 size=1048576 2024-09-14T10:54:16.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.010+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~G36J9TU9S5A7.2 size=809985 2024-09-14T10:54:16.011 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.013+0000 7faa01046780 1 < canceled multipart upload key=V905BR1VWUCV upload=G36J9TU9S5A7 tag=JY1GKEI73ZJ4 type=write size=3955713 2024-09-14T10:54:16.013 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.014+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=8QIMUY7K0SUT type=write size=141714 2024-09-14T10:54:16.014 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.015+0000 7faa01046780 1 < completed delete operation key=PS2QU1UZUYHE tag=CMHNM0RAM1YB type=del 2024-09-14T10:54:16.015 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.016+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=YLK7T753JZME type=del size=49826 2024-09-14T10:54:16.018 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.020+0000 7faa01046780 1 < suggested remove operation key=Q33ET1AN14NG tag=SS4FOHK04QT1 type=write 2024-09-14T10:54:16.020 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.021+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=YYBZ2CEZNYYS type=del size=982233 2024-09-14T10:54:16.021 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.022+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~QH2AP7YAVIDF.0 size=1048576 2024-09-14T10:54:16.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.023+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~QH2AP7YAVIDF.1 size=170912 2024-09-14T10:54:16.024 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.026+0000 7faa01046780 1 < completed multipart upload key=CKMDOO75UZGE upload=QH2AP7YAVIDF tag=WVK3NXSKZX62 type=write size=2268064 2024-09-14T10:54:16.027 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.029+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~45G6Z9W7HENQ.0 size=873924 2024-09-14T10:54:16.027 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.029+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=45G6Z9W7HENQ tag=FCO4CUZMYLPV type=write size=1922500 2024-09-14T10:54:16.028 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.030+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~06PCXVYF04NI.0 size=1048576 2024-09-14T10:54:16.029 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.031+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~06PCXVYF04NI.1 size=889860 2024-09-14T10:54:16.032 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.033+0000 7faa01046780 1 < completed multipart upload key=VIO703UXIJXV upload=06PCXVYF04NI tag=UA4Z2JPL17WR type=write size=2987012 2024-09-14T10:54:16.033 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.035+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=RDN27DZ43AWR type=write size=888514 2024-09-14T10:54:16.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.036+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~R7ASI9HRQUTH.0 size=1048576 2024-09-14T10:54:16.036 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.037+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~R7ASI9HRQUTH.1 size=1048576 2024-09-14T10:54:16.037 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.038+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~R7ASI9HRQUTH.2 size=377155 2024-09-14T10:54:16.039 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.040+0000 7faa01046780 1 < completed multipart upload key=F872GLVQDCX6 upload=R7ASI9HRQUTH tag=ZZSI842GK3MJ type=write size=3522883 2024-09-14T10:54:16.040 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.042+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=2TJMYUC7DXQ7 type=del size=444408 2024-09-14T10:54:16.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.043+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=6S229PSUB2WT type=del 2024-09-14T10:54:16.044 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.045+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~9US0CHMF54ZJ.0 size=86795 2024-09-14T10:54:16.044 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.045+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=9US0CHMF54ZJ tag=MHAH1DGT4QAB type=write size=1135371 2024-09-14T10:54:16.045 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.047+0000 7faa01046780 -1 < failed to complete operation key=HUBZAFMSCCNC tag=Y36IWENV6CQC type=del size=1894547: (22) Invalid argument 2024-09-14T10:54:16.047 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.048+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=CRVK0VD6BYMR type=del size=3035013 2024-09-14T10:54:16.048 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.050+0000 7faa01046780 1 < completed delete operation key=X9DUVQBBLUTF tag=PXRJX0RA9ZRM type=del 2024-09-14T10:54:16.050 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.051+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=XLOSULTBTYU0 type=del size=1952678 2024-09-14T10:54:16.051 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.052+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~3RXN3B5U3G3M.0 size=1048576 2024-09-14T10:54:16.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.054+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~3RXN3B5U3G3M.1 size=1048576 2024-09-14T10:54:16.053 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.055+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~3RXN3B5U3G3M.2 size=1028358 2024-09-14T10:54:16.056 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.058+0000 7faa01046780 1 < completed multipart upload key=ZY0BY3G9NREC upload=3RXN3B5U3G3M tag=2YGJ94L4AJ0G type=write size=4174086 2024-09-14T10:54:16.059 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.061+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~CWFE6T9JDVKG.0 size=1048576 2024-09-14T10:54:16.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.061+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~CWFE6T9JDVKG.1 size=1048576 2024-09-14T10:54:16.061 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.062+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~CWFE6T9JDVKG.2 size=133058 2024-09-14T10:54:16.061 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.062+0000 7faa01046780 1 > prepared multipart upload key=X9DUVQBBLUTF upload=CWFE6T9JDVKG tag=FBXZ0LQO3N39 type=write size=3278786 2024-09-14T10:54:16.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.063+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~V322JA6NM28V.0 size=133747 2024-09-14T10:54:16.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.066+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=V322JA6NM28V tag=GA2IFCOAI11T type=write size=1182323 2024-09-14T10:54:16.066 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.067+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=08W0HCXDWO6B type=del size=2181892 2024-09-14T10:54:16.068 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.069+0000 7faa01046780 1 < completed write operation key=NXIPG4HR9ZYY tag=7Y2D99ZBN08E type=write size=401470 2024-09-14T10:54:16.069 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.070+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=XW4LFT79FE1J type=del size=3904279 2024-09-14T10:54:16.071 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.072+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~ZEFSGAURR3F0.0 size=207832 2024-09-14T10:54:16.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.075+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=ZEFSGAURR3F0 tag=U4F54IBIY2Q0 type=write size=1256408 2024-09-14T10:54:16.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.076+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=EDFHN2DOPWGX type=del size=3010999 2024-09-14T10:54:16.077 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.079+0000 7faa01046780 1 < completed delete operation key=BBDTPL35W4W0 tag=GU61YNHCNYWB type=del 2024-09-14T10:54:16.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.080+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=H9W48PGP9SL4 type=del size=233751 2024-09-14T10:54:16.080 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.082+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~Q02RY7C2ULQ2.0 size=45426 2024-09-14T10:54:16.082 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.084+0000 7faa01046780 1 < completed multipart upload key=V5T3AN9D7DH6 upload=Q02RY7C2ULQ2 tag=DMQXKQLVREIX type=write size=1094002 2024-09-14T10:54:16.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.087+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~07JZ7AEYX6DK.0 size=239316 2024-09-14T10:54:16.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.087+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=07JZ7AEYX6DK tag=788WEC0A9K64 type=write size=1287892 2024-09-14T10:54:16.087 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.088+0000 7faa01046780 1 < completed delete operation key=KDUTH9PIR3FI tag=DUKRF8I68MRS type=del 2024-09-14T10:54:16.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.089+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=XCAA0XS06CZ7 type=del size=4071176 2024-09-14T10:54:16.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.092+0000 7faa01046780 1 < completed write operation key=HYAGNAOWK8LF tag=8QIMUY7K0SUT type=write size=141714 2024-09-14T10:54:16.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.092+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=WCD6W6S45FX9 type=del size=618898 2024-09-14T10:54:16.094 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.096+0000 7faa01046780 1 < suggested update operation key=VIO703UXIJXV tag=YLK7T753JZME type=del size=49826 2024-09-14T10:54:16.096 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.098+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=FV0RNGR8EJY2 type=del size=2701913 2024-09-14T10:54:16.097 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.098+0000 7faa01046780 1 < completed delete operation key=0XVVSUIOBQPL tag=YYBZ2CEZNYYS type=del 2024-09-14T10:54:16.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.101+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=C4E7JT0OYKCZ type=write size=314461 2024-09-14T10:54:16.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.101+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~45G6Z9W7HENQ.0 size=873924 2024-09-14T10:54:16.102 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.104+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=45G6Z9W7HENQ tag=FCO4CUZMYLPV type=write size=1922500 2024-09-14T10:54:16.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.107+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~JQUEMS43CX4Y.0 size=1048576 2024-09-14T10:54:16.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.107+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~JQUEMS43CX4Y.1 size=1019401 2024-09-14T10:54:16.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.107+0000 7faa01046780 1 > prepared multipart upload key=PBRZNGSOLJ8E upload=JQUEMS43CX4Y tag=2METZ6TPOYAD type=write size=3116553 2024-09-14T10:54:16.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.110+0000 7faa01046780 1 < completed write operation key=Q33ET1AN14NG tag=RDN27DZ43AWR type=write size=888514 2024-09-14T10:54:16.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.112+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=19FO7XMRAQVX type=del size=1580336 2024-09-14T10:54:16.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.114+0000 7faa01046780 1 < suggested update operation key=0OL3SF5IWDMH tag=2TJMYUC7DXQ7 type=del size=444408 2024-09-14T10:54:16.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.115+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=FLXT6CP8VTZM type=write size=543353 2024-09-14T10:54:16.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.116+0000 7faa01046780 1 < canceled part key=_multipart_KDUTH9PIR3FI.2~9US0CHMF54ZJ.0 size=86795 2024-09-14T10:54:16.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.118+0000 7faa01046780 1 < canceled multipart upload key=KDUTH9PIR3FI upload=9US0CHMF54ZJ tag=MHAH1DGT4QAB type=write size=1135371 2024-09-14T10:54:16.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.121+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~28MQJN1R7W53.0 size=1048576 2024-09-14T10:54:16.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.122+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~28MQJN1R7W53.1 size=605487 2024-09-14T10:54:16.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.122+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=28MQJN1R7W53 tag=MWAFPZPYTZ58 type=write size=2702639 2024-09-14T10:54:16.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.124+0000 7faa01046780 1 < completed delete operation key=V11YJWHT4OOD tag=CRVK0VD6BYMR type=del 2024-09-14T10:54:16.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.126+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~8F8295DQD9LY.0 size=767054 2024-09-14T10:54:16.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.126+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=8F8295DQD9LY tag=9EG8GMNU27Z9 type=write size=1815630 2024-09-14T10:54:16.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.129+0000 7faa01046780 1 < suggested update operation key=S3BGVJ9N9S4P tag=XLOSULTBTYU0 type=del size=1952678 2024-09-14T10:54:16.129 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.130+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=ZN1EUM7OK9KA type=del size=3497945 2024-09-14T10:54:16.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.133+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~CWFE6T9JDVKG.0 size=1048576 2024-09-14T10:54:16.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.133+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~CWFE6T9JDVKG.1 size=1048576 2024-09-14T10:54:16.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.134+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~CWFE6T9JDVKG.2 size=133058 2024-09-14T10:54:16.135 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.136+0000 7faa01046780 1 < completed multipart upload key=X9DUVQBBLUTF upload=CWFE6T9JDVKG tag=FBXZ0LQO3N39 type=write size=3278786 2024-09-14T10:54:16.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.138+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=69IU7DXT1UM0 type=del size=179258 2024-09-14T10:54:16.138 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.139+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=08W0HCXDWO6B type=del 2024-09-14T10:54:16.139 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.141+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=U4HT25WIOFE8 type=del size=2798417 2024-09-14T10:54:16.141 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.142+0000 7faa01046780 1 < completed delete operation key=TDNQZ8Y1C6X2 tag=XW4LFT79FE1J type=del 2024-09-14T10:54:16.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.144+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=51BTA5P043AA type=del size=1240061 2024-09-14T10:54:16.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.145+0000 7faa01046780 1 < completed delete operation key=U8TE0XNK9YKM tag=EDFHN2DOPWGX type=del 2024-09-14T10:54:16.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.146+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=8V00RYDTPJRG type=del size=3798484 2024-09-14T10:54:16.148 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.149+0000 7faa01046780 1 < suggested update operation key=LF41PL7DFSJI tag=H9W48PGP9SL4 type=del size=233751 2024-09-14T10:54:16.150 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.152+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=XV2VISIPPD3R type=del size=4179199 2024-09-14T10:54:16.151 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.152+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~07JZ7AEYX6DK.0 size=239316 2024-09-14T10:54:16.153 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.155+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=07JZ7AEYX6DK tag=788WEC0A9K64 type=write size=1287892 2024-09-14T10:54:16.156 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.157+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~WPNK5OB7VK1M.0 size=468592 2024-09-14T10:54:16.156 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.157+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=WPNK5OB7VK1M tag=Y0B0NDY7AW9P type=write size=1517168 2024-09-14T10:54:16.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.159+0000 7faa01046780 1 < completed delete operation key=V905BR1VWUCV tag=XCAA0XS06CZ7 type=del 2024-09-14T10:54:16.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.162+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~DPJP8V6OP1VS.0 size=545355 2024-09-14T10:54:16.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.162+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=DPJP8V6OP1VS tag=8YDG8L7SMVBC type=write size=1593931 2024-09-14T10:54:16.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.163+0000 7faa01046780 1 < completed delete operation key=BBDTPL35W4W0 tag=WCD6W6S45FX9 type=del 2024-09-14T10:54:16.164 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.165+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~YV1QD85XBUEM.0 size=1048576 2024-09-14T10:54:16.165 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.166+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~YV1QD85XBUEM.1 size=504378 2024-09-14T10:54:16.165 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.166+0000 7faa01046780 1 > prepared multipart upload key=PBRZNGSOLJ8E upload=YV1QD85XBUEM tag=6DW5GYUX9A43 type=write size=2601530 2024-09-14T10:54:16.168 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.169+0000 7faa01046780 1 < suggested remove operation key=V5T3AN9D7DH6 tag=FV0RNGR8EJY2 type=del 2024-09-14T10:54:16.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.172+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=1BHCP4M09PDM type=del size=4130166 2024-09-14T10:54:16.171 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.172+0000 7faa01046780 1 < completed write operation key=3UEX0IPM4CPY tag=C4E7JT0OYKCZ type=write size=314461 2024-09-14T10:54:16.173 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.175+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~YFEUAN7QQ3E1.0 size=1048576 2024-09-14T10:54:16.174 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.176+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~YFEUAN7QQ3E1.1 size=1048576 2024-09-14T10:54:16.176 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.177+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~YFEUAN7QQ3E1.2 size=246272 2024-09-14T10:54:16.176 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.177+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=YFEUAN7QQ3E1 tag=WV4L09R8N3ZW type=write size=3392000 2024-09-14T10:54:16.177 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.178+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~JQUEMS43CX4Y.0 size=1048576 2024-09-14T10:54:16.178 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.179+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~JQUEMS43CX4Y.1 size=1019401 2024-09-14T10:54:16.181 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.182+0000 7faa01046780 1 < completed multipart upload key=PBRZNGSOLJ8E upload=JQUEMS43CX4Y tag=2METZ6TPOYAD type=write size=3116553 2024-09-14T10:54:16.182 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.184+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=VG3YI8D71XEM type=del size=2255229 2024-09-14T10:54:16.185 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.187+0000 7faa01046780 1 < suggested remove operation key=HYAGNAOWK8LF tag=19FO7XMRAQVX type=del 2024-09-14T10:54:16.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.189+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~H5US2EI6P0ND.0 size=1048576 2024-09-14T10:54:16.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.190+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~H5US2EI6P0ND.1 size=1048576 2024-09-14T10:54:16.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.192+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~H5US2EI6P0ND.2 size=484526 2024-09-14T10:54:16.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.192+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=H5US2EI6P0ND tag=24B3OD4V811D type=write size=3630254 2024-09-14T10:54:16.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.193+0000 7faa01046780 1 < completed write operation key=3UEX0IPM4CPY tag=FLXT6CP8VTZM type=write size=543353 2024-09-14T10:54:16.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.194+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=XRNMY09EJOVG type=del size=3799836 2024-09-14T10:54:16.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.196+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~28MQJN1R7W53.0 size=1048576 2024-09-14T10:54:16.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.197+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~28MQJN1R7W53.1 size=605487 2024-09-14T10:54:16.198 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.199+0000 7faa01046780 1 < completed multipart upload key=Y4CB0HIN0750 upload=28MQJN1R7W53 tag=MWAFPZPYTZ58 type=write size=2702639 2024-09-14T10:54:16.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.202+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~XZ0SIY20C2WE.0 size=1048576 2024-09-14T10:54:16.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.203+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~XZ0SIY20C2WE.1 size=1048576 2024-09-14T10:54:16.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.204+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~XZ0SIY20C2WE.2 size=82633 2024-09-14T10:54:16.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.204+0000 7faa01046780 1 > prepared multipart upload key=SJ02N8472YDM upload=XZ0SIY20C2WE tag=8VV12V08IFQ5 type=write size=3228361 2024-09-14T10:54:16.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.205+0000 7faa01046780 1 < canceled part key=_multipart_U8TE0XNK9YKM.2~8F8295DQD9LY.0 size=767054 2024-09-14T10:54:16.206 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.207+0000 7faa01046780 1 < canceled multipart upload key=U8TE0XNK9YKM upload=8F8295DQD9LY tag=9EG8GMNU27Z9 type=write size=1815630 2024-09-14T10:54:16.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.208+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=74HFDM0SS0EF type=del size=3907180 2024-09-14T10:54:16.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.211+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=ZN1EUM7OK9KA type=del 2024-09-14T10:54:16.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.211+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=OT30EGFR17XD type=del size=2700373 2024-09-14T10:54:16.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.213+0000 7faa01046780 1 < completed delete operation key=BBDTPL35W4W0 tag=69IU7DXT1UM0 type=del 2024-09-14T10:54:16.213 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.215+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=QVCGT300IYOU type=del size=2180722 2024-09-14T10:54:16.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.216+0000 7faa01046780 1 < completed delete operation key=U8TE0XNK9YKM tag=U4HT25WIOFE8 type=del 2024-09-14T10:54:16.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.219+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~FOR3F4W2PR9W.0 size=788739 2024-09-14T10:54:16.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.219+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=FOR3F4W2PR9W tag=F05VFRMFRSPE type=write size=1837315 2024-09-14T10:54:16.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.220+0000 7faa01046780 1 < completed delete operation key=PBRZNGSOLJ8E tag=51BTA5P043AA type=del 2024-09-14T10:54:16.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.223+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~L7XI0KFQVF3R.0 size=1048576 2024-09-14T10:54:16.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.224+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~L7XI0KFQVF3R.1 size=358717 2024-09-14T10:54:16.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.224+0000 7faa01046780 1 > prepared multipart upload key=PBRZNGSOLJ8E upload=L7XI0KFQVF3R tag=HH91GA98Y6HC type=write size=2455869 2024-09-14T10:54:16.224 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.225+0000 7faa01046780 -1 < failed to complete operation key=V5T3AN9D7DH6 tag=8V00RYDTPJRG type=del size=3798484: (22) Invalid argument 2024-09-14T10:54:16.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.228+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~GBI0XC0LDFJH.0 size=814593 2024-09-14T10:54:16.227 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.228+0000 7faa01046780 1 > prepared multipart upload key=F872GLVQDCX6 upload=GBI0XC0LDFJH tag=VV2J1Q6QFJ1E type=write size=1863169 2024-09-14T10:54:16.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.229+0000 7faa01046780 1 < completed delete operation key=V11YJWHT4OOD tag=XV2VISIPPD3R type=del 2024-09-14T10:54:16.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.231+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=3ZACPHJ87451 type=del size=3685253 2024-09-14T10:54:16.231 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.232+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~WPNK5OB7VK1M.0 size=468592 2024-09-14T10:54:16.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.235+0000 7faa01046780 1 < completed multipart upload key=0OL3SF5IWDMH upload=WPNK5OB7VK1M tag=Y0B0NDY7AW9P type=write size=1517168 2024-09-14T10:54:16.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.236+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=UD2RGSNWAE34 type=del size=2986987 2024-09-14T10:54:16.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.237+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~DPJP8V6OP1VS.0 size=545355 2024-09-14T10:54:16.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.239+0000 7faa01046780 1 < completed multipart upload key=0OL3SF5IWDMH upload=DPJP8V6OP1VS tag=8YDG8L7SMVBC type=write size=1593931 2024-09-14T10:54:16.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.242+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~JSFDZUPLNUG4.0 size=1048576 2024-09-14T10:54:16.241 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.243+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~JSFDZUPLNUG4.1 size=799595 2024-09-14T10:54:16.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.243+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=JSFDZUPLNUG4 tag=2U97KK4UZXNU type=write size=2896747 2024-09-14T10:54:16.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.244+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~YV1QD85XBUEM.0 size=1048576 2024-09-14T10:54:16.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.245+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~YV1QD85XBUEM.1 size=504378 2024-09-14T10:54:16.246 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.247+0000 7faa01046780 1 < completed multipart upload key=PBRZNGSOLJ8E upload=YV1QD85XBUEM tag=6DW5GYUX9A43 type=write size=2601530 2024-09-14T10:54:16.247 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.249+0000 7faa01046780 1 > prepared operation key=SJ02N8472YDM tag=SDOI3FA4XHHK type=del size=654033 2024-09-14T10:54:16.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.250+0000 7faa01046780 1 < completed delete operation key=3UEX0IPM4CPY tag=1BHCP4M09PDM type=del 2024-09-14T10:54:16.253 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.254+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~QGE8ZAHKZD6X.0 size=868124 2024-09-14T10:54:16.253 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.254+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=QGE8ZAHKZD6X tag=LXX5APV4CAGS type=write size=1916700 2024-09-14T10:54:16.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.256+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~YFEUAN7QQ3E1.0 size=1048576 2024-09-14T10:54:16.256 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.257+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~YFEUAN7QQ3E1.1 size=1048576 2024-09-14T10:54:16.257 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.259+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~YFEUAN7QQ3E1.2 size=246272 2024-09-14T10:54:16.259 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.261+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=YFEUAN7QQ3E1 tag=WV4L09R8N3ZW type=write size=3392000 2024-09-14T10:54:16.262 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.263+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~GIY9PQ5Q3SX3.0 size=1048576 2024-09-14T10:54:16.263 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.264+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~GIY9PQ5Q3SX3.1 size=1048576 2024-09-14T10:54:16.264 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.265+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~GIY9PQ5Q3SX3.2 size=426340 2024-09-14T10:54:16.264 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.265+0000 7faa01046780 1 > prepared multipart upload key=F872GLVQDCX6 upload=GIY9PQ5Q3SX3 tag=ELUME3ZTCK6J type=write size=3572068 2024-09-14T10:54:16.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.267+0000 7faa01046780 1 < completed delete operation key=LF41PL7DFSJI tag=VG3YI8D71XEM type=del 2024-09-14T10:54:16.268 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.270+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~8HVYOTDBOW3S.0 size=1048576 2024-09-14T10:54:16.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.270+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~8HVYOTDBOW3S.1 size=898295 2024-09-14T10:54:16.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.270+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=8HVYOTDBOW3S tag=C05IHH14ICXY type=write size=2995447 2024-09-14T10:54:16.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.273+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~H5US2EI6P0ND.0 size=1048576 2024-09-14T10:54:16.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.274+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~H5US2EI6P0ND.1 size=1048576 2024-09-14T10:54:16.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.274+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~H5US2EI6P0ND.2 size=484526 2024-09-14T10:54:16.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.276+0000 7faa01046780 1 < completed multipart upload key=KDUTH9PIR3FI upload=H5US2EI6P0ND tag=24B3OD4V811D type=write size=3630254 2024-09-14T10:54:16.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.278+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=BNNZ6YXUVE77 type=del size=2796088 2024-09-14T10:54:16.278 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.279+0000 7faa01046780 1 < completed delete operation key=V905BR1VWUCV tag=XRNMY09EJOVG type=del 2024-09-14T10:54:16.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.282+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~H1XUZ6LKTULS.0 size=812055 2024-09-14T10:54:16.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.282+0000 7faa01046780 1 > prepared multipart upload key=SJ02N8472YDM upload=H1XUZ6LKTULS tag=D5YPRP77AKES type=write size=1860631 2024-09-14T10:54:16.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.284+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~XZ0SIY20C2WE.0 size=1048576 2024-09-14T10:54:16.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.285+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~XZ0SIY20C2WE.1 size=1048576 2024-09-14T10:54:16.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.286+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~XZ0SIY20C2WE.2 size=82633 2024-09-14T10:54:16.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.288+0000 7faa01046780 1 < completed multipart upload key=SJ02N8472YDM upload=XZ0SIY20C2WE tag=8VV12V08IFQ5 type=write size=3228361 2024-09-14T10:54:16.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.289+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=TRQAS4YNF2S1 type=write size=861891 2024-09-14T10:54:16.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.291+0000 7faa01046780 1 < completed delete operation key=3FSH0OFMF54V tag=74HFDM0SS0EF type=del 2024-09-14T10:54:16.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.293+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~PA03EXVH1DNM.0 size=1045317 2024-09-14T10:54:16.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.293+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=PA03EXVH1DNM tag=O4PQ2ZT2989C type=write size=2093893 2024-09-14T10:54:16.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.295+0000 7faa01046780 1 < canceled operation key=U8TE0XNK9YKM tag=OT30EGFR17XD type=del size=2700373 2024-09-14T10:54:16.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.297+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~85VTQF6QTRBR.0 size=447781 2024-09-14T10:54:16.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.297+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=85VTQF6QTRBR tag=CNHAF0V2W64Q type=write size=1496357 2024-09-14T10:54:16.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.298+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=QVCGT300IYOU type=del 2024-09-14T10:54:16.299 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.301+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~4V2G4WFU5G02.0 size=1048576 2024-09-14T10:54:16.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.302+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~4V2G4WFU5G02.1 size=1048576 2024-09-14T10:54:16.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.303+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~4V2G4WFU5G02.2 size=86118 2024-09-14T10:54:16.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.303+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=4V2G4WFU5G02 tag=3ZISAJJFM9Q3 type=write size=3231846 2024-09-14T10:54:16.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.303+0000 7faa01046780 1 < canceled part key=_multipart_PTDE6D7OIU1A.2~FOR3F4W2PR9W.0 size=788739 2024-09-14T10:54:16.304 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.305+0000 7faa01046780 1 < canceled multipart upload key=PTDE6D7OIU1A upload=FOR3F4W2PR9W tag=F05VFRMFRSPE type=write size=1837315 2024-09-14T10:54:16.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.309+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~4B2E7WEUD6RQ.0 size=1048576 2024-09-14T10:54:16.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.310+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~4B2E7WEUD6RQ.1 size=186091 2024-09-14T10:54:16.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.310+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=4B2E7WEUD6RQ tag=848BTPOS6OYS type=write size=2283243 2024-09-14T10:54:16.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.311+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~L7XI0KFQVF3R.0 size=1048576 2024-09-14T10:54:16.310 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.312+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~L7XI0KFQVF3R.1 size=358717 2024-09-14T10:54:16.313 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.314+0000 7faa01046780 1 < completed multipart upload key=PBRZNGSOLJ8E upload=L7XI0KFQVF3R tag=HH91GA98Y6HC type=write size=2455869 2024-09-14T10:54:16.314 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.315+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=DKDOLTQJ3O0U type=del size=1055200 2024-09-14T10:54:16.314 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.316+0000 7faa01046780 1 < canceled part key=_multipart_F872GLVQDCX6.2~GBI0XC0LDFJH.0 size=814593 2024-09-14T10:54:16.317 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.318+0000 7faa01046780 1 < canceled multipart upload key=F872GLVQDCX6 upload=GBI0XC0LDFJH tag=VV2J1Q6QFJ1E type=write size=1863169 2024-09-14T10:54:16.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.319+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=FUD3075ZJ68S type=del size=945270 2024-09-14T10:54:16.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.321+0000 7faa01046780 1 < completed delete operation key=3FSH0OFMF54V tag=3ZACPHJ87451 type=del 2024-09-14T10:54:16.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.324+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~30474LNXVKTP.0 size=718764 2024-09-14T10:54:16.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.324+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=30474LNXVKTP tag=MEPQATU7YEBI type=write size=1767340 2024-09-14T10:54:16.323 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.325+0000 7faa01046780 1 < canceled operation key=XDJAK0XYQNF0 tag=UD2RGSNWAE34 type=del size=2986987 2024-09-14T10:54:16.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.327+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=YTVLF9XFD8GX type=write size=554109 2024-09-14T10:54:16.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.327+0000 7faa01046780 1 < canceled part key=_multipart_HUBZAFMSCCNC.2~JSFDZUPLNUG4.0 size=1048576 2024-09-14T10:54:16.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.327+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~JSFDZUPLNUG4.1 size=799595 2024-09-14T10:54:16.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.331+0000 7faa01046780 1 < canceled multipart upload key=HUBZAFMSCCNC upload=JSFDZUPLNUG4 tag=2U97KK4UZXNU type=write size=2896747 2024-09-14T10:54:16.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.332+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=ZGEWRJSGZ10E type=write size=25720 2024-09-14T10:54:16.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.332+0000 7faa01046780 1 < completed delete operation key=SJ02N8472YDM tag=SDOI3FA4XHHK type=del 2024-09-14T10:54:16.334 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.336+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~VAL0WYX78LXA.0 size=1048576 2024-09-14T10:54:16.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.336+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~VAL0WYX78LXA.1 size=1048576 2024-09-14T10:54:16.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.337+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~VAL0WYX78LXA.2 size=579169 2024-09-14T10:54:16.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.337+0000 7faa01046780 1 > prepared multipart upload key=V11YJWHT4OOD upload=VAL0WYX78LXA tag=K2SBZCYQ7ZCS type=write size=3724897 2024-09-14T10:54:16.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.338+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~QGE8ZAHKZD6X.0 size=868124 2024-09-14T10:54:16.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.341+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=QGE8ZAHKZD6X tag=LXX5APV4CAGS type=write size=1916700 2024-09-14T10:54:16.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.342+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=1OJ9DV37H51E type=write size=605552 2024-09-14T10:54:16.342 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.344+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~GIY9PQ5Q3SX3.0 size=1048576 2024-09-14T10:54:16.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.345+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~GIY9PQ5Q3SX3.1 size=1048576 2024-09-14T10:54:16.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.346+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~GIY9PQ5Q3SX3.2 size=426340 2024-09-14T10:54:16.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.348+0000 7faa01046780 1 < completed multipart upload key=F872GLVQDCX6 upload=GIY9PQ5Q3SX3 tag=ELUME3ZTCK6J type=write size=3572068 2024-09-14T10:54:16.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.350+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=283O0C843QHR type=del size=264111 2024-09-14T10:54:16.350 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.351+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~8HVYOTDBOW3S.0 size=1048576 2024-09-14T10:54:16.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.352+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~8HVYOTDBOW3S.1 size=898295 2024-09-14T10:54:16.354 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.355+0000 7faa01046780 1 < completed multipart upload key=Y4CB0HIN0750 upload=8HVYOTDBOW3S tag=C05IHH14ICXY type=write size=2995447 2024-09-14T10:54:16.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.358+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~U7J1DJ9PFWGK.0 size=571594 2024-09-14T10:54:16.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.358+0000 7faa01046780 1 > prepared multipart upload key=LF41PL7DFSJI upload=U7J1DJ9PFWGK tag=7KNA581EU7IU type=write size=1620170 2024-09-14T10:54:16.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.359+0000 7faa01046780 1 < completed delete operation key=Q33ET1AN14NG tag=BNNZ6YXUVE77 type=del 2024-09-14T10:54:16.359 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.360+0000 7faa01046780 1 > prepared operation key=SJ02N8472YDM tag=I7BVYUB0AAB0 type=del size=2818083 2024-09-14T10:54:16.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.362+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~H1XUZ6LKTULS.0 size=812055 2024-09-14T10:54:16.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.364+0000 7faa01046780 1 < completed multipart upload key=SJ02N8472YDM upload=H1XUZ6LKTULS tag=D5YPRP77AKES type=write size=1860631 2024-09-14T10:54:16.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.366+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=UG8AXFIESLP6 type=del size=3212791 2024-09-14T10:54:16.366 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.367+0000 7faa01046780 1 < completed write operation key=PS2QU1UZUYHE tag=TRQAS4YNF2S1 type=write size=861891 2024-09-14T10:54:16.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.369+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=AJ1IJAJPFRB1 type=del size=533724 2024-09-14T10:54:16.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.370+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~PA03EXVH1DNM.0 size=1045317 2024-09-14T10:54:16.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.373+0000 7faa01046780 1 < completed multipart upload key=CKMDOO75UZGE upload=PA03EXVH1DNM tag=O4PQ2ZT2989C type=write size=2093893 2024-09-14T10:54:16.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.374+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=JJT6HF4SOI0M type=del size=3348657 2024-09-14T10:54:16.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.375+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~85VTQF6QTRBR.0 size=447781 2024-09-14T10:54:16.376 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.378+0000 7faa01046780 1 < completed multipart upload key=0XVVSUIOBQPL upload=85VTQF6QTRBR tag=CNHAF0V2W64Q type=write size=1496357 2024-09-14T10:54:16.378 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.379+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=JGCZGTIE6TUG type=del size=2952123 2024-09-14T10:54:16.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.381+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~4V2G4WFU5G02.0 size=1048576 2024-09-14T10:54:16.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.381+0000 7faa01046780 1 < canceled part key=_multipart_0XVVSUIOBQPL.2~4V2G4WFU5G02.1 size=1048576 2024-09-14T10:54:16.380 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.381+0000 7faa01046780 1 < canceled part key=_multipart_0XVVSUIOBQPL.2~4V2G4WFU5G02.2 size=86118 2024-09-14T10:54:16.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.384+0000 7faa01046780 1 < canceled multipart upload key=0XVVSUIOBQPL upload=4V2G4WFU5G02 tag=3ZISAJJFM9Q3 type=write size=3231846 2024-09-14T10:54:16.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.385+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=E74XCRU7DR6O type=del size=3783101 2024-09-14T10:54:16.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.386+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~4B2E7WEUD6RQ.0 size=1048576 2024-09-14T10:54:16.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.388+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~4B2E7WEUD6RQ.1 size=186091 2024-09-14T10:54:16.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.390+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=4B2E7WEUD6RQ tag=848BTPOS6OYS type=write size=2283243 2024-09-14T10:54:16.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.393+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~GQWDO8V75TLQ.0 size=1048576 2024-09-14T10:54:16.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.394+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~GQWDO8V75TLQ.1 size=604061 2024-09-14T10:54:16.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.394+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=GQWDO8V75TLQ tag=8SL9AEQVLGHF type=write size=2701213 2024-09-14T10:54:16.394 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.395+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=DKDOLTQJ3O0U type=del 2024-09-14T10:54:16.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.396+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=F7EVQF4VHZAH type=del size=1538463 2024-09-14T10:54:16.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.398+0000 7faa01046780 1 < completed delete operation key=U8TE0XNK9YKM tag=FUD3075ZJ68S type=del 2024-09-14T10:54:16.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.399+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=JKCFWS5ZV1EI type=del size=3890381 2024-09-14T10:54:16.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.401+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~30474LNXVKTP.0 size=718764 2024-09-14T10:54:16.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.404+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=30474LNXVKTP tag=MEPQATU7YEBI type=write size=1767340 2024-09-14T10:54:16.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.405+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=FITVIT43D57M type=del size=3056013 2024-09-14T10:54:16.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.406+0000 7faa01046780 1 < completed write operation key=V5T3AN9D7DH6 tag=YTVLF9XFD8GX type=write size=554109 2024-09-14T10:54:16.407 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.409+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~NSTBN9ICBRGQ.0 size=944370 2024-09-14T10:54:16.408 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.409+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=NSTBN9ICBRGQ tag=M5GTT00KOHUX type=write size=1992946 2024-09-14T10:54:16.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.411+0000 7faa01046780 1 < completed write operation key=LF41PL7DFSJI tag=ZGEWRJSGZ10E type=write size=25720 2024-09-14T10:54:16.410 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.412+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=7M95TFYZ5Z5P type=write size=139336 2024-09-14T10:54:16.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.413+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~VAL0WYX78LXA.0 size=1048576 2024-09-14T10:54:16.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.414+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~VAL0WYX78LXA.1 size=1048576 2024-09-14T10:54:16.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.415+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~VAL0WYX78LXA.2 size=579169 2024-09-14T10:54:16.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.418+0000 7faa01046780 1 < completed multipart upload key=V11YJWHT4OOD upload=VAL0WYX78LXA tag=K2SBZCYQ7ZCS type=write size=3724897 2024-09-14T10:54:16.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.419+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=6DWCQXS845IY type=del size=3405965 2024-09-14T10:54:16.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.421+0000 7faa01046780 1 < completed write operation key=PS2QU1UZUYHE tag=1OJ9DV37H51E type=write size=605552 2024-09-14T10:54:16.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.423+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=N37EU8DWZ166 type=del size=3476782 2024-09-14T10:54:16.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.423+0000 7faa01046780 1 < completed delete operation key=HYAGNAOWK8LF tag=283O0C843QHR type=del 2024-09-14T10:54:16.424 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.426+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=N3RP56BA6E6V type=del size=3174030 2024-09-14T10:54:16.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.427+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~U7J1DJ9PFWGK.0 size=571594 2024-09-14T10:54:16.428 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.429+0000 7faa01046780 1 < completed multipart upload key=LF41PL7DFSJI upload=U7J1DJ9PFWGK tag=7KNA581EU7IU type=write size=1620170 2024-09-14T10:54:16.429 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.431+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=AOWE4P01U6HC type=write size=352061 2024-09-14T10:54:16.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.432+0000 7faa01046780 1 < completed delete operation key=SJ02N8472YDM tag=I7BVYUB0AAB0 type=del 2024-09-14T10:54:16.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.434+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~7GW56LYHHTQM.0 size=1048576 2024-09-14T10:54:16.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.436+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~7GW56LYHHTQM.1 size=1048576 2024-09-14T10:54:16.436 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.438+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~7GW56LYHHTQM.2 size=543380 2024-09-14T10:54:16.436 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.438+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=7GW56LYHHTQM tag=VGG5DQQOI4MA type=write size=3689108 2024-09-14T10:54:16.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.438+0000 7faa01046780 1 < completed delete operation key=U8TE0XNK9YKM tag=UG8AXFIESLP6 type=del 2024-09-14T10:54:16.439 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.441+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~LQWCYHKY1CLT.0 size=1048576 2024-09-14T10:54:16.441 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.442+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~LQWCYHKY1CLT.1 size=1043357 2024-09-14T10:54:16.441 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.442+0000 7faa01046780 1 > prepared multipart upload key=FOJGGEQZD7YW upload=LQWCYHKY1CLT tag=XJ8HL0RAZY2K type=write size=3140509 2024-09-14T10:54:16.442 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.443+0000 7faa01046780 1 < completed delete operation key=PBRZNGSOLJ8E tag=AJ1IJAJPFRB1 type=del 2024-09-14T10:54:16.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.445+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=J4WPLGOFQY1R type=del size=518233 2024-09-14T10:54:16.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.446+0000 7faa01046780 1 < completed delete operation key=PTDE6D7OIU1A tag=JJT6HF4SOI0M type=del 2024-09-14T10:54:16.447 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.449+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~SKURCDD1YGDV.0 size=59276 2024-09-14T10:54:16.447 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.449+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=SKURCDD1YGDV tag=6ZSYKCK13K3J type=write size=1107852 2024-09-14T10:54:16.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.450+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=JGCZGTIE6TUG type=del 2024-09-14T10:54:16.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.453+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~0JQEDM83BKOY.0 size=1048576 2024-09-14T10:54:16.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.454+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~0JQEDM83BKOY.1 size=154280 2024-09-14T10:54:16.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.454+0000 7faa01046780 1 > prepared multipart upload key=V11YJWHT4OOD upload=0JQEDM83BKOY tag=EVM1O94IS4SG type=write size=2251432 2024-09-14T10:54:16.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.455+0000 7faa01046780 1 < canceled operation key=VIO703UXIJXV tag=E74XCRU7DR6O type=del size=3783101 2024-09-14T10:54:16.455 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.457+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=IVWJTDQPX5C4 type=write size=281634 2024-09-14T10:54:16.457 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.458+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~GQWDO8V75TLQ.0 size=1048576 2024-09-14T10:54:16.458 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.460+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~GQWDO8V75TLQ.1 size=604061 2024-09-14T10:54:16.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.462+0000 7faa01046780 1 < completed multipart upload key=V5T3AN9D7DH6 upload=GQWDO8V75TLQ tag=8SL9AEQVLGHF type=write size=2701213 2024-09-14T10:54:16.464 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.466+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~1PONBSB3JX7X.0 size=1048576 2024-09-14T10:54:16.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.467+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~1PONBSB3JX7X.1 size=356105 2024-09-14T10:54:16.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.467+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=1PONBSB3JX7X tag=I77O12TSHH7H type=write size=2453257 2024-09-14T10:54:16.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.471+0000 7faa01046780 1 < suggested remove operation key=ZY0BY3G9NREC tag=F7EVQF4VHZAH type=del 2024-09-14T10:54:16.470 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.471+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=7XOSKBM1YYH0 type=del size=1454474 2024-09-14T10:54:16.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.474+0000 7faa01046780 1 < completed delete operation key=3UEX0IPM4CPY tag=JKCFWS5ZV1EI type=del 2024-09-14T10:54:16.473 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.475+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=65V1BWQGH6EU type=write size=246404 2024-09-14T10:54:16.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.476+0000 7faa01046780 1 < completed delete operation key=0XVVSUIOBQPL tag=FITVIT43D57M type=del 2024-09-14T10:54:16.476 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.478+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=STU2YF2DS187 type=del size=3341981 2024-09-14T10:54:16.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.479+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~NSTBN9ICBRGQ.0 size=944370 2024-09-14T10:54:16.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.482+0000 7faa01046780 1 < completed multipart upload key=V5T3AN9D7DH6 upload=NSTBN9ICBRGQ tag=M5GTT00KOHUX type=write size=1992946 2024-09-14T10:54:16.482 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.484+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=VVJTA4H3T3W8 type=del size=578627 2024-09-14T10:54:16.483 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.484+0000 7faa01046780 1 < canceled operation key=Y4CB0HIN0750 tag=7M95TFYZ5Z5P type=write size=139336 2024-09-14T10:54:16.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.487+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=8IIJ7LDAM3ZP type=del size=1802110 2024-09-14T10:54:16.487 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.490+0000 7faa01046780 1 < suggested update operation key=V905BR1VWUCV tag=6DWCQXS845IY type=del size=3405965 2024-09-14T10:54:16.490 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.492+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~ROESXFA7UAAH.0 size=1048576 2024-09-14T10:54:16.491 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.492+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~ROESXFA7UAAH.1 size=1048576 2024-09-14T10:54:16.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.494+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~ROESXFA7UAAH.2 size=827217 2024-09-14T10:54:16.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.494+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=ROESXFA7UAAH tag=1TGRO5SRSRQW type=write size=3972945 2024-09-14T10:54:16.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.495+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=N37EU8DWZ166 type=del 2024-09-14T10:54:16.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.496+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=F50SKE26Z9WC type=del size=1660886 2024-09-14T10:54:16.496 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.499+0000 7faa01046780 1 < completed delete operation key=PTDE6D7OIU1A tag=N3RP56BA6E6V type=del 2024-09-14T10:54:16.498 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.499+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=C58SB90S5ZHP type=del size=2278025 2024-09-14T10:54:16.499 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.501+0000 7faa01046780 1 < completed write operation key=3FSH0OFMF54V tag=AOWE4P01U6HC type=write size=352061 2024-09-14T10:54:16.502 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.503+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~SRPPHFXQ97E2.0 size=1048576 2024-09-14T10:54:16.503 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.504+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~SRPPHFXQ97E2.1 size=1048576 2024-09-14T10:54:16.504 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.506+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~SRPPHFXQ97E2.2 size=969496 2024-09-14T10:54:16.504 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.506+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=SRPPHFXQ97E2 tag=UKJL36ARX1ZS type=write size=4115224 2024-09-14T10:54:16.506 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.507+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~7GW56LYHHTQM.0 size=1048576 2024-09-14T10:54:16.507 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.509+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~7GW56LYHHTQM.1 size=1048576 2024-09-14T10:54:16.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.511+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~7GW56LYHHTQM.2 size=543380 2024-09-14T10:54:16.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.512+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=7GW56LYHHTQM tag=VGG5DQQOI4MA type=write size=3689108 2024-09-14T10:54:16.514 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.515+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~ZUONJ50ZEFG2.0 size=1048576 2024-09-14T10:54:16.515 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.516+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~ZUONJ50ZEFG2.1 size=1048576 2024-09-14T10:54:16.517 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.520+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~ZUONJ50ZEFG2.2 size=35830 2024-09-14T10:54:16.517 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.520+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=ZUONJ50ZEFG2 tag=344262YEF3NN type=write size=3181558 2024-09-14T10:54:16.519 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.520+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~LQWCYHKY1CLT.0 size=1048576 2024-09-14T10:54:16.519 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.520+0000 7faa01046780 1 < canceled part key=_multipart_FOJGGEQZD7YW.2~LQWCYHKY1CLT.1 size=1043357 2024-09-14T10:54:16.521 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.523+0000 7faa01046780 1 < canceled multipart upload key=FOJGGEQZD7YW upload=LQWCYHKY1CLT tag=XJ8HL0RAZY2K type=write size=3140509 2024-09-14T10:54:16.523 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.525+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=BMTWV3SVFO9X type=del size=2779193 2024-09-14T10:54:16.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.526+0000 7faa01046780 1 < completed delete operation key=KDUTH9PIR3FI tag=J4WPLGOFQY1R type=del 2024-09-14T10:54:16.526 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.528+0000 7faa01046780 1 > prepared operation key=SJ02N8472YDM tag=CGLBQ51RTM8L type=del size=512500 2024-09-14T10:54:16.527 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.529+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~SKURCDD1YGDV.0 size=59276 2024-09-14T10:54:16.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.532+0000 7faa01046780 1 < completed multipart upload key=CKMDOO75UZGE upload=SKURCDD1YGDV tag=6ZSYKCK13K3J type=write size=1107852 2024-09-14T10:54:16.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.534+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~4IAGFI46UHKQ.0 size=1048576 2024-09-14T10:54:16.534 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.535+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~4IAGFI46UHKQ.1 size=821676 2024-09-14T10:54:16.534 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.535+0000 7faa01046780 1 > prepared multipart upload key=LF41PL7DFSJI upload=4IAGFI46UHKQ tag=O3CFONM45UBW type=write size=2918828 2024-09-14T10:54:16.535 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.536+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~0JQEDM83BKOY.0 size=1048576 2024-09-14T10:54:16.536 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.537+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~0JQEDM83BKOY.1 size=154280 2024-09-14T10:54:16.538 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.539+0000 7faa01046780 1 < completed multipart upload key=V11YJWHT4OOD upload=0JQEDM83BKOY tag=EVM1O94IS4SG type=write size=2251432 2024-09-14T10:54:16.541 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.542+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~SJJ35RLB5PKC.0 size=1048576 2024-09-14T10:54:16.542 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.543+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~SJJ35RLB5PKC.1 size=1048576 2024-09-14T10:54:16.543 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.544+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~SJJ35RLB5PKC.2 size=933553 2024-09-14T10:54:16.543 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.544+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=SJJ35RLB5PKC tag=P7MIN5HY26FY type=write size=4079281 2024-09-14T10:54:16.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.547+0000 7faa01046780 1 < suggested update operation key=V11YJWHT4OOD tag=IVWJTDQPX5C4 type=write size=281634 2024-09-14T10:54:16.548 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.549+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~LHWYQ0GMWB4U.0 size=654803 2024-09-14T10:54:16.548 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.549+0000 7faa01046780 1 > prepared multipart upload key=F06QWEOYNQX4 upload=LHWYQ0GMWB4U tag=WOOS49OZ1OMU type=write size=1703379 2024-09-14T10:54:16.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.551+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~1PONBSB3JX7X.0 size=1048576 2024-09-14T10:54:16.550 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.552+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~1PONBSB3JX7X.1 size=356105 2024-09-14T10:54:16.553 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.555+0000 7faa01046780 1 < completed multipart upload key=U8TE0XNK9YKM upload=1PONBSB3JX7X tag=I77O12TSHH7H type=write size=2453257 2024-09-14T10:54:16.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.555+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=TAZ53I1JO2DM type=write size=948059 2024-09-14T10:54:16.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.557+0000 7faa01046780 1 < completed delete operation key=0OL3SF5IWDMH tag=7XOSKBM1YYH0 type=del 2024-09-14T10:54:16.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.560+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~EJUFO96JIMYD.0 size=1048576 2024-09-14T10:54:16.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.561+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~EJUFO96JIMYD.1 size=821651 2024-09-14T10:54:16.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.561+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=EJUFO96JIMYD tag=4D11HZ90ALG5 type=write size=2918803 2024-09-14T10:54:16.561 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.563+0000 7faa01046780 1 < canceled operation key=HUBZAFMSCCNC tag=65V1BWQGH6EU type=write size=246404 2024-09-14T10:54:16.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.564+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=NVXWDERESO29 type=del size=3933005 2024-09-14T10:54:16.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.568+0000 7faa01046780 1 < suggested update operation key=U8TE0XNK9YKM tag=STU2YF2DS187 type=del size=3341981 2024-09-14T10:54:16.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.568+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=OXWZNQ8F3G2C type=del size=3458003 2024-09-14T10:54:16.568 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.570+0000 7faa01046780 1 < completed delete operation key=VIO703UXIJXV tag=VVJTA4H3T3W8 type=del 2024-09-14T10:54:16.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.571+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=BHG2R50G729U type=del size=2746306 2024-09-14T10:54:16.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.575+0000 7faa01046780 1 < suggested remove operation key=S3BGVJ9N9S4P tag=8IIJ7LDAM3ZP type=del 2024-09-14T10:54:16.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.575+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=1MQ140YC9HHB type=del size=1933577 2024-09-14T10:54:16.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.577+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~ROESXFA7UAAH.0 size=1048576 2024-09-14T10:54:16.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.579+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~ROESXFA7UAAH.1 size=1048576 2024-09-14T10:54:16.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.579+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~ROESXFA7UAAH.2 size=827217 2024-09-14T10:54:16.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.582+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=ROESXFA7UAAH tag=1TGRO5SRSRQW type=write size=3972945 2024-09-14T10:54:16.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.585+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~QL1M5101752D.0 size=1048576 2024-09-14T10:54:16.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.586+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~QL1M5101752D.1 size=1048576 2024-09-14T10:54:16.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.587+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~QL1M5101752D.2 size=46125 2024-09-14T10:54:16.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.587+0000 7faa01046780 1 > prepared multipart upload key=FOJGGEQZD7YW upload=QL1M5101752D tag=LPPGMFVPRX3A type=write size=3191853 2024-09-14T10:54:16.587 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.588+0000 7faa01046780 1 < canceled operation key=FOJGGEQZD7YW tag=F50SKE26Z9WC type=del size=1660886 2024-09-14T10:54:16.588 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.590+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=BUNR1ZOL6GY9 type=del size=3611693 2024-09-14T10:54:16.591 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.593+0000 7faa01046780 1 < suggested update operation key=XDJAK0XYQNF0 tag=C58SB90S5ZHP type=del size=2278025 2024-09-14T10:54:16.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.594+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=VALDZ3AXLFFI type=del size=2519975 2024-09-14T10:54:16.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.594+0000 7faa01046780 1 < canceled part key=_multipart_Q33ET1AN14NG.2~SRPPHFXQ97E2.0 size=1048576 2024-09-14T10:54:16.594 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.596+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~SRPPHFXQ97E2.1 size=1048576 2024-09-14T10:54:16.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.597+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~SRPPHFXQ97E2.2 size=969496 2024-09-14T10:54:16.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.599+0000 7faa01046780 1 < canceled multipart upload key=Q33ET1AN14NG upload=SRPPHFXQ97E2 tag=UKJL36ARX1ZS type=write size=4115224 2024-09-14T10:54:16.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.601+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=1WI6YJLK84PM type=del size=2528910 2024-09-14T10:54:16.602 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.603+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~ZUONJ50ZEFG2.0 size=1048576 2024-09-14T10:54:16.602 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.604+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~ZUONJ50ZEFG2.1 size=1048576 2024-09-14T10:54:16.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.606+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~ZUONJ50ZEFG2.2 size=35830 2024-09-14T10:54:16.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.607+0000 7faa01046780 1 < completed multipart upload key=0OL3SF5IWDMH upload=ZUONJ50ZEFG2 tag=344262YEF3NN type=write size=3181558 2024-09-14T10:54:16.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.609+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=ES78BNHD7407 type=write size=14255 2024-09-14T10:54:16.610 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.612+0000 7faa01046780 1 < canceled operation key=PS2QU1UZUYHE tag=BMTWV3SVFO9X type=del size=2779193 2024-09-14T10:54:16.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.613+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=M8254RACXKFH type=del size=3903336 2024-09-14T10:54:16.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.614+0000 7faa01046780 1 < completed delete operation key=SJ02N8472YDM tag=CGLBQ51RTM8L type=del 2024-09-14T10:54:16.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.616+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=B18XPUBM0L7P type=del size=220643 2024-09-14T10:54:16.616 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.618+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~4IAGFI46UHKQ.0 size=1048576 2024-09-14T10:54:16.617 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.618+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~4IAGFI46UHKQ.1 size=821676 2024-09-14T10:54:16.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.622+0000 7faa01046780 1 < completed multipart upload key=LF41PL7DFSJI upload=4IAGFI46UHKQ tag=O3CFONM45UBW type=write size=2918828 2024-09-14T10:54:16.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.622+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=8KDMT6UNJW51 type=del size=2573699 2024-09-14T10:54:16.623 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.624+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~SJJ35RLB5PKC.0 size=1048576 2024-09-14T10:54:16.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.626+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~SJJ35RLB5PKC.1 size=1048576 2024-09-14T10:54:16.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.627+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~SJJ35RLB5PKC.2 size=933553 2024-09-14T10:54:16.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.630+0000 7faa01046780 1 < completed multipart upload key=S3BGVJ9N9S4P upload=SJJ35RLB5PKC tag=P7MIN5HY26FY type=write size=4079281 2024-09-14T10:54:16.630 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.632+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~BZXAUXVD76UZ.0 size=1048576 2024-09-14T10:54:16.631 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.633+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~BZXAUXVD76UZ.1 size=231412 2024-09-14T10:54:16.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.633+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=BZXAUXVD76UZ tag=NK73JZHWTNDV type=write size=2328564 2024-09-14T10:54:16.633 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.634+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~LHWYQ0GMWB4U.0 size=654803 2024-09-14T10:54:16.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.636+0000 7faa01046780 1 < completed multipart upload key=F06QWEOYNQX4 upload=LHWYQ0GMWB4U tag=WOOS49OZ1OMU type=write size=1703379 2024-09-14T10:54:16.637 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.639+0000 7faa01046780 1 > prepared operation key=SJ02N8472YDM tag=27BFTL3AKGCP type=del size=689911 2024-09-14T10:54:16.640 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.641+0000 7faa01046780 1 < suggested update operation key=0OL3SF5IWDMH tag=TAZ53I1JO2DM type=write size=948059 2024-09-14T10:54:16.641 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.643+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=Z2EM1BVPHO02 type=write size=427332 2024-09-14T10:54:16.642 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.643+0000 7faa01046780 1 < canceled part key=_multipart_XDJAK0XYQNF0.2~EJUFO96JIMYD.0 size=1048576 2024-09-14T10:54:16.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.644+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~EJUFO96JIMYD.1 size=821651 2024-09-14T10:54:16.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.646+0000 7faa01046780 1 < canceled multipart upload key=XDJAK0XYQNF0 upload=EJUFO96JIMYD tag=4D11HZ90ALG5 type=write size=2918803 2024-09-14T10:54:16.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.648+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=YDXBQHZIRYE8 type=del size=599156 2024-09-14T10:54:16.650 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.651+0000 7faa01046780 1 < suggested update operation key=3UEX0IPM4CPY tag=NVXWDERESO29 type=del size=3933005 2024-09-14T10:54:16.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.655+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~SC3LKF60ET24.0 size=1048576 2024-09-14T10:54:16.654 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.657+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~SC3LKF60ET24.1 size=235497 2024-09-14T10:54:16.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.657+0000 7faa01046780 1 > prepared multipart upload key=GG02P21TFKIM upload=SC3LKF60ET24 tag=576ZIV342AM4 type=write size=2332649 2024-09-14T10:54:16.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.657+0000 7faa01046780 1 < completed delete operation key=V11YJWHT4OOD tag=OXWZNQ8F3G2C type=del 2024-09-14T10:54:16.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.659+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=QL0ZSBLJFSBQ type=del size=2586269 2024-09-14T10:54:16.660 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.661+0000 7faa01046780 1 < suggested update operation key=NXIPG4HR9ZYY tag=BHG2R50G729U type=del size=2746306 2024-09-14T10:54:16.663 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.664+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~6B01NATEQFT0.0 size=1048576 2024-09-14T10:54:16.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.665+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~6B01NATEQFT0.1 size=1048576 2024-09-14T10:54:16.665 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.667+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~6B01NATEQFT0.2 size=574438 2024-09-14T10:54:16.665 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.667+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=6B01NATEQFT0 tag=1I46RBMA1ZDO type=write size=3720166 2024-09-14T10:54:16.666 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.667+0000 7faa01046780 -1 < failed to complete operation key=0OL3SF5IWDMH tag=1MQ140YC9HHB type=del size=1933577: (22) Invalid argument 2024-09-14T10:54:16.669 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.670+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~60G2Y801MBWJ.0 size=967140 2024-09-14T10:54:16.669 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.670+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=60G2Y801MBWJ tag=S0O1DRVPW0GK type=write size=2015716 2024-09-14T10:54:16.670 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.671+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~QL1M5101752D.0 size=1048576 2024-09-14T10:54:16.671 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.673+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~QL1M5101752D.1 size=1048576 2024-09-14T10:54:16.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.674+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~QL1M5101752D.2 size=46125 2024-09-14T10:54:16.675 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.677+0000 7faa01046780 1 < completed multipart upload key=FOJGGEQZD7YW upload=QL1M5101752D tag=LPPGMFVPRX3A type=write size=3191853 2024-09-14T10:54:16.676 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.678+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=0QYXSN8VK6JQ type=write size=374514 2024-09-14T10:54:16.678 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.680+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=BUNR1ZOL6GY9 type=del 2024-09-14T10:54:16.679 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.680+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=PFD76WJPJ4X3 type=del size=639565 2024-09-14T10:54:16.681 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.683+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=VALDZ3AXLFFI type=del 2024-09-14T10:54:16.682 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.684+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=3CHFBQCLCBTN type=del size=289091 2024-09-14T10:54:16.686 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.687+0000 7faa01046780 1 < suggested update operation key=HUBZAFMSCCNC tag=1WI6YJLK84PM type=del size=2528910 2024-09-14T10:54:16.688 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.690+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=4SEA3X85LJ62 type=write size=424479 2024-09-14T10:54:16.689 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.690+0000 7faa01046780 1 < completed write operation key=CKMDOO75UZGE tag=ES78BNHD7407 type=write size=14255 2024-09-14T10:54:16.691 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.692+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=1D6VWE57CDLV type=del size=3809534 2024-09-14T10:54:16.692 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.694+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=M8254RACXKFH type=del 2024-09-14T10:54:16.695 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.697+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~5TOREM79KU7I.0 size=1048576 2024-09-14T10:54:16.697 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.699+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~5TOREM79KU7I.1 size=86103 2024-09-14T10:54:16.697 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.699+0000 7faa01046780 1 > prepared multipart upload key=VIO703UXIJXV upload=5TOREM79KU7I tag=TK07B80S7S6Q type=write size=2183255 2024-09-14T10:54:16.698 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.699+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=B18XPUBM0L7P type=del 2024-09-14T10:54:16.699 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.701+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=SUA9I7S0MYM7 type=write size=102672 2024-09-14T10:54:16.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.702+0000 7faa01046780 1 < completed delete operation key=V5T3AN9D7DH6 tag=8KDMT6UNJW51 type=del 2024-09-14T10:54:16.703 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.704+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=FX6Q486ZOMP5 type=del size=376542 2024-09-14T10:54:16.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.706+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~BZXAUXVD76UZ.0 size=1048576 2024-09-14T10:54:16.706 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.708+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~BZXAUXVD76UZ.1 size=231412 2024-09-14T10:54:16.708 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.710+0000 7faa01046780 1 < completed multipart upload key=S3BGVJ9N9S4P upload=BZXAUXVD76UZ tag=NK73JZHWTNDV type=write size=2328564 2024-09-14T10:54:16.711 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.713+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~ZE149O3EM838.0 size=1048576 2024-09-14T10:54:16.712 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.714+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~ZE149O3EM838.1 size=1048576 2024-09-14T10:54:16.713 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.714+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~ZE149O3EM838.2 size=988093 2024-09-14T10:54:16.713 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.714+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=ZE149O3EM838 tag=107UVN4AZTIG type=write size=4133821 2024-09-14T10:54:16.716 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.718+0000 7faa01046780 1 < suggested remove operation key=SJ02N8472YDM tag=27BFTL3AKGCP type=del 2024-09-14T10:54:16.718 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.720+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~RG3P5YXJ4BU9.0 size=1048576 2024-09-14T10:54:16.720 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.721+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~RG3P5YXJ4BU9.1 size=350803 2024-09-14T10:54:16.720 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.721+0000 7faa01046780 1 > prepared multipart upload key=FOJGGEQZD7YW upload=RG3P5YXJ4BU9 tag=GO3GHO8LPX1J type=write size=2447955 2024-09-14T10:54:16.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.722+0000 7faa01046780 1 < canceled operation key=PTDE6D7OIU1A tag=Z2EM1BVPHO02 type=write size=427332 2024-09-14T10:54:16.722 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.724+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=RU2140PQCKZ4 type=del size=1276083 2024-09-14T10:54:16.724 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.725+0000 7faa01046780 -1 < failed to complete operation key=HUBZAFMSCCNC tag=YDXBQHZIRYE8 type=del size=599156: (22) Invalid argument 2024-09-14T10:54:16.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.727+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=AAFDMJ6ZYMV0 type=del size=2253261 2024-09-14T10:54:16.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.728+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~SC3LKF60ET24.0 size=1048576 2024-09-14T10:54:16.728 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.729+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~SC3LKF60ET24.1 size=235497 2024-09-14T10:54:16.730 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.732+0000 7faa01046780 1 < completed multipart upload key=GG02P21TFKIM upload=SC3LKF60ET24 tag=576ZIV342AM4 type=write size=2332649 2024-09-14T10:54:16.732 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.734+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=F8B0XWPI9ML7 type=del size=2239817 2024-09-14T10:54:16.733 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.735+0000 7faa01046780 1 < completed delete operation key=F872GLVQDCX6 tag=QL0ZSBLJFSBQ type=del 2024-09-14T10:54:16.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.737+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=P81B63WWOS56 type=del size=1918933 2024-09-14T10:54:16.736 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.737+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~6B01NATEQFT0.0 size=1048576 2024-09-14T10:54:16.737 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.739+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~6B01NATEQFT0.1 size=1048576 2024-09-14T10:54:16.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.740+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~6B01NATEQFT0.2 size=574438 2024-09-14T10:54:16.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.743+0000 7faa01046780 1 < completed multipart upload key=XDJAK0XYQNF0 upload=6B01NATEQFT0 tag=1I46RBMA1ZDO type=write size=3720166 2024-09-14T10:54:16.743 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.744+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~1XSQCBZFN0V2.0 size=1048576 2024-09-14T10:54:16.744 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.745+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~1XSQCBZFN0V2.1 size=595340 2024-09-14T10:54:16.744 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.745+0000 7faa01046780 1 > prepared multipart upload key=V11YJWHT4OOD upload=1XSQCBZFN0V2 tag=33KGHFC3CCCT type=write size=2692492 2024-09-14T10:54:16.745 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.746+0000 7faa01046780 1 < canceled part key=_multipart_S3BGVJ9N9S4P.2~60G2Y801MBWJ.0 size=967140 2024-09-14T10:54:16.747 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.748+0000 7faa01046780 1 < canceled multipart upload key=S3BGVJ9N9S4P upload=60G2Y801MBWJ tag=S0O1DRVPW0GK type=write size=2015716 2024-09-14T10:54:16.749 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.750+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~MNRXU2YMXJMH.0 size=87715 2024-09-14T10:54:16.749 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.750+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=MNRXU2YMXJMH tag=KVW3MF0N8OOL type=write size=1136291 2024-09-14T10:54:16.751 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.753+0000 7faa01046780 1 < completed write operation key=F06QWEOYNQX4 tag=0QYXSN8VK6JQ type=write size=374514 2024-09-14T10:54:16.752 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.753+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=30R3U9KD0O92 type=del size=3285504 2024-09-14T10:54:16.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.754+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=PFD76WJPJ4X3 type=del 2024-09-14T10:54:16.755 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.756+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=W5SDZDAMG4BO type=del size=2530833 2024-09-14T10:54:16.756 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.757+0000 7faa01046780 1 < completed delete operation key=VIO703UXIJXV tag=3CHFBQCLCBTN type=del 2024-09-14T10:54:16.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.759+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=0Q7QU5I7CIWY type=del size=349160 2024-09-14T10:54:16.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.760+0000 7faa01046780 1 < completed write operation key=CKMDOO75UZGE tag=4SEA3X85LJ62 type=write size=424479 2024-09-14T10:54:16.762 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.764+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~NDA5NNKNKYA1.0 size=1048576 2024-09-14T10:54:16.763 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.764+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~NDA5NNKNKYA1.1 size=1048576 2024-09-14T10:54:16.764 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.765+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~NDA5NNKNKYA1.2 size=610175 2024-09-14T10:54:16.764 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.765+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=NDA5NNKNKYA1 tag=FG3I8Y5C8MWK type=write size=3755903 2024-09-14T10:54:16.765 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.766+0000 7faa01046780 1 < completed delete operation key=V11YJWHT4OOD tag=1D6VWE57CDLV type=del 2024-09-14T10:54:16.767 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.769+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=B72KU9DHLEU1 type=del size=2841000 2024-09-14T10:54:16.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.769+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~5TOREM79KU7I.0 size=1048576 2024-09-14T10:54:16.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.770+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~5TOREM79KU7I.1 size=86103 2024-09-14T10:54:16.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.773+0000 7faa01046780 1 < completed multipart upload key=VIO703UXIJXV upload=5TOREM79KU7I tag=TK07B80S7S6Q type=write size=2183255 2024-09-14T10:54:16.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.774+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=XZ0HZ8Q4QEA3 type=del size=3475922 2024-09-14T10:54:16.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.779+0000 7faa01046780 1 < suggested update operation key=0XVVSUIOBQPL tag=SUA9I7S0MYM7 type=write size=102672 2024-09-14T10:54:16.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.780+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=7VVXI1QUTWC3 type=del size=1575785 2024-09-14T10:54:16.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.781+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=FX6Q486ZOMP5 type=del 2024-09-14T10:54:16.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.782+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=QZYQFCL0527R type=del size=3824443 2024-09-14T10:54:16.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.784+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~ZE149O3EM838.0 size=1048576 2024-09-14T10:54:16.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.785+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~ZE149O3EM838.1 size=1048576 2024-09-14T10:54:16.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.786+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~ZE149O3EM838.2 size=988093 2024-09-14T10:54:16.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.789+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=ZE149O3EM838 tag=107UVN4AZTIG type=write size=4133821 2024-09-14T10:54:16.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.791+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=SNWIFBLGTLQX type=del size=3577889 2024-09-14T10:54:16.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.792+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~RG3P5YXJ4BU9.0 size=1048576 2024-09-14T10:54:16.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.793+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~RG3P5YXJ4BU9.1 size=350803 2024-09-14T10:54:16.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.797+0000 7faa01046780 1 < completed multipart upload key=FOJGGEQZD7YW upload=RG3P5YXJ4BU9 tag=GO3GHO8LPX1J type=write size=2447955 2024-09-14T10:54:16.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.798+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~RCRXOH77LWAA.0 size=1048576 2024-09-14T10:54:16.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.801+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~RCRXOH77LWAA.1 size=1048576 2024-09-14T10:54:16.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.801+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~RCRXOH77LWAA.2 size=565310 2024-09-14T10:54:16.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.801+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=RCRXOH77LWAA tag=1ADJ6WUX7G9J type=write size=3711038 2024-09-14T10:54:16.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.802+0000 7faa01046780 1 < completed delete operation key=XH8GHY9YRGTP tag=RU2140PQCKZ4 type=del 2024-09-14T10:54:16.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.806+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~5UHXI05DOS21.0 size=1048576 2024-09-14T10:54:16.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.807+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~5UHXI05DOS21.1 size=1048576 2024-09-14T10:54:16.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.808+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~5UHXI05DOS21.2 size=673834 2024-09-14T10:54:16.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.808+0000 7faa01046780 1 > prepared multipart upload key=PBRZNGSOLJ8E upload=5UHXI05DOS21 tag=DG5ZC172TGUV type=write size=3819562 2024-09-14T10:54:16.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.809+0000 7faa01046780 -1 < failed to complete operation key=0XVVSUIOBQPL tag=AAFDMJ6ZYMV0 type=del size=2253261: (22) Invalid argument 2024-09-14T10:54:16.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.811+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=TNBBLTB48WBX type=del size=4045999 2024-09-14T10:54:16.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.811+0000 7faa01046780 1 < canceled operation key=NXIPG4HR9ZYY tag=F8B0XWPI9ML7 type=del size=2239817 2024-09-14T10:54:16.811 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.812+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=WT4DZQRBGJ7C type=del size=1152476 2024-09-14T10:54:16.813 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.814+0000 7faa01046780 1 < canceled operation key=F06QWEOYNQX4 tag=P81B63WWOS56 type=del size=1918933 2024-09-14T10:54:16.814 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.815+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=G72OAT73DV6U type=del size=3496153 2024-09-14T10:54:16.814 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.816+0000 7faa01046780 1 < canceled part key=_multipart_V11YJWHT4OOD.2~1XSQCBZFN0V2.0 size=1048576 2024-09-14T10:54:16.815 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.817+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~1XSQCBZFN0V2.1 size=595340 2024-09-14T10:54:16.818 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.819+0000 7faa01046780 1 < canceled multipart upload key=V11YJWHT4OOD upload=1XSQCBZFN0V2 tag=33KGHFC3CCCT type=write size=2692492 2024-09-14T10:54:16.819 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.820+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=AJL4S44RMV19 type=del size=3339069 2024-09-14T10:54:16.820 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.822+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~MNRXU2YMXJMH.0 size=87715 2024-09-14T10:54:16.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.825+0000 7faa01046780 1 < completed multipart upload key=0XVVSUIOBQPL upload=MNRXU2YMXJMH tag=KVW3MF0N8OOL type=write size=1136291 2024-09-14T10:54:16.824 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.825+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=IG8XU6TNIXEY type=write size=622873 2024-09-14T10:54:16.825 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.828+0000 7faa01046780 1 < canceled operation key=V5T3AN9D7DH6 tag=30R3U9KD0O92 type=del size=3285504 2024-09-14T10:54:16.827 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.829+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=XBK0R32EEF4E type=write size=952843 2024-09-14T10:54:16.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.829+0000 7faa01046780 1 < completed delete operation key=PTDE6D7OIU1A tag=W5SDZDAMG4BO type=del 2024-09-14T10:54:16.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.831+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=C7JO8DRS9FZP type=del size=3733238 2024-09-14T10:54:16.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.835+0000 7faa01046780 1 < suggested remove operation key=X9DUVQBBLUTF tag=0Q7QU5I7CIWY type=del 2024-09-14T10:54:16.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.837+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~ALIPUHI19KEE.0 size=623918 2024-09-14T10:54:16.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.837+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=ALIPUHI19KEE tag=8VO1RRMUPGNM type=write size=1672494 2024-09-14T10:54:16.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.838+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~NDA5NNKNKYA1.0 size=1048576 2024-09-14T10:54:16.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.839+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~NDA5NNKNKYA1.1 size=1048576 2024-09-14T10:54:16.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.839+0000 7faa01046780 1 < canceled part key=_multipart_NXIPG4HR9ZYY.2~NDA5NNKNKYA1.2 size=610175 2024-09-14T10:54:16.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.842+0000 7faa01046780 1 < canceled multipart upload key=NXIPG4HR9ZYY upload=NDA5NNKNKYA1 tag=FG3I8Y5C8MWK type=write size=3755903 2024-09-14T10:54:16.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.844+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=RG6304C90EF5 type=write size=709546 2024-09-14T10:54:16.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.845+0000 7faa01046780 1 < completed delete operation key=Q33ET1AN14NG tag=B72KU9DHLEU1 type=del 2024-09-14T10:54:16.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.847+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=FT94327EYPP9 type=del size=3374540 2024-09-14T10:54:16.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.847+0000 7faa01046780 1 < completed delete operation key=VIO703UXIJXV tag=XZ0HZ8Q4QEA3 type=del 2024-09-14T10:54:16.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.850+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=MR7F1B9U6VHI type=del size=3482813 2024-09-14T10:54:16.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.850+0000 7faa01046780 1 < completed delete operation key=0OL3SF5IWDMH tag=7VVXI1QUTWC3 type=del 2024-09-14T10:54:16.850 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.851+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=YZ808XEXSPAW type=del size=2314567 2024-09-14T10:54:16.852 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.854+0000 7faa01046780 1 < completed delete operation key=ZY0BY3G9NREC tag=QZYQFCL0527R type=del 2024-09-14T10:54:16.853 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.854+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=BZIZJ4ERRO3T type=write size=879013 2024-09-14T10:54:16.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.856+0000 7faa01046780 1 < completed delete operation key=HYAGNAOWK8LF tag=SNWIFBLGTLQX type=del 2024-09-14T10:54:16.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.859+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~LZNITP5QS3R0.0 size=281835 2024-09-14T10:54:16.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.859+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=LZNITP5QS3R0 tag=CNTN2OBBJH3P type=write size=1330411 2024-09-14T10:54:16.859 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.860+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~RCRXOH77LWAA.0 size=1048576 2024-09-14T10:54:16.860 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.861+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~RCRXOH77LWAA.1 size=1048576 2024-09-14T10:54:16.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.863+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~RCRXOH77LWAA.2 size=565310 2024-09-14T10:54:16.864 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.866+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=RCRXOH77LWAA tag=1ADJ6WUX7G9J type=write size=3711038 2024-09-14T10:54:16.865 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.866+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=SH96397O85R7 type=write size=64762 2024-09-14T10:54:16.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.868+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~5UHXI05DOS21.0 size=1048576 2024-09-14T10:54:16.868 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.869+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~5UHXI05DOS21.1 size=1048576 2024-09-14T10:54:16.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.871+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~5UHXI05DOS21.2 size=673834 2024-09-14T10:54:16.871 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.873+0000 7faa01046780 1 < completed multipart upload key=PBRZNGSOLJ8E upload=5UHXI05DOS21 tag=DG5ZC172TGUV type=write size=3819562 2024-09-14T10:54:16.874 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.875+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~OWQVUITE8JYZ.0 size=1048576 2024-09-14T10:54:16.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.876+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~OWQVUITE8JYZ.1 size=1048576 2024-09-14T10:54:16.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.877+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~OWQVUITE8JYZ.2 size=72594 2024-09-14T10:54:16.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.877+0000 7faa01046780 1 > prepared multipart upload key=X9DUVQBBLUTF upload=OWQVUITE8JYZ tag=E1JRV5NTZYE7 type=write size=3218322 2024-09-14T10:54:16.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.879+0000 7faa01046780 1 < completed delete operation key=PTDE6D7OIU1A tag=TNBBLTB48WBX type=del 2024-09-14T10:54:16.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.882+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~4080NW6TEXLI.0 size=2435 2024-09-14T10:54:16.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.882+0000 7faa01046780 1 > prepared multipart upload key=FOJGGEQZD7YW upload=4080NW6TEXLI tag=ISGD16RSWOZZ type=write size=1051011 2024-09-14T10:54:16.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.885+0000 7faa01046780 1 < suggested remove operation key=X9DUVQBBLUTF tag=WT4DZQRBGJ7C type=del 2024-09-14T10:54:16.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.887+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=XHJ81SV70HB3 type=del size=322187 2024-09-14T10:54:16.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.888+0000 7faa01046780 1 < completed delete operation key=VIO703UXIJXV tag=G72OAT73DV6U type=del 2024-09-14T10:54:16.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.890+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~NT9G8780XEJI.0 size=892813 2024-09-14T10:54:16.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.890+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=NT9G8780XEJI tag=EEJIZGMPBME9 type=write size=1941389 2024-09-14T10:54:16.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.894+0000 7faa01046780 1 < suggested update operation key=NXIPG4HR9ZYY tag=AJL4S44RMV19 type=del size=3339069 2024-09-14T10:54:16.894 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.895+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=WR1NWFHCHW0X type=del size=4157269 2024-09-14T10:54:16.895 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.898+0000 7faa01046780 1 < canceled operation key=U8TE0XNK9YKM tag=IG8XU6TNIXEY type=write size=622873 2024-09-14T10:54:16.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.899+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~AV4QQPTC7BI1.0 size=1048576 2024-09-14T10:54:16.899 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.902+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~AV4QQPTC7BI1.1 size=1048576 2024-09-14T10:54:16.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.903+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~AV4QQPTC7BI1.2 size=568617 2024-09-14T10:54:16.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.903+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=AV4QQPTC7BI1 tag=8H2OZ9VO5YJR type=write size=3714345 2024-09-14T10:54:16.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.903+0000 7faa01046780 1 < completed write operation key=HUBZAFMSCCNC tag=XBK0R32EEF4E type=write size=952843 2024-09-14T10:54:16.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.905+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=OPK8LS8KWMTW type=del size=2337700 2024-09-14T10:54:16.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.907+0000 7faa01046780 1 < suggested update operation key=U8TE0XNK9YKM tag=C7JO8DRS9FZP type=del size=3733238 2024-09-14T10:54:16.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.910+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~U44XTVIE6XTB.0 size=1048576 2024-09-14T10:54:16.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.911+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~U44XTVIE6XTB.1 size=826704 2024-09-14T10:54:16.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.911+0000 7faa01046780 1 > prepared multipart upload key=ZY0BY3G9NREC upload=U44XTVIE6XTB tag=XKEGT7LRX3UL type=write size=2923856 2024-09-14T10:54:16.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.913+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~ALIPUHI19KEE.0 size=623918 2024-09-14T10:54:16.914 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.916+0000 7faa01046780 1 < completed multipart upload key=XDJAK0XYQNF0 upload=ALIPUHI19KEE tag=8VO1RRMUPGNM type=write size=1672494 2024-09-14T10:54:16.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.919+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~B7JQSB4C3F2W.0 size=487350 2024-09-14T10:54:16.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.919+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=B7JQSB4C3F2W tag=SUUFKZA261FU type=write size=1535926 2024-09-14T10:54:16.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.920+0000 7faa01046780 1 < completed write operation key=CKMDOO75UZGE tag=RG6304C90EF5 type=write size=709546 2024-09-14T10:54:16.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.922+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~MOVPIXCITJZQ.0 size=971721 2024-09-14T10:54:16.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.922+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=MOVPIXCITJZQ tag=SLSLJ0YXHABU type=write size=2020297 2024-09-14T10:54:16.923 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.924+0000 7faa01046780 1 < completed delete operation key=PTDE6D7OIU1A tag=FT94327EYPP9 type=del 2024-09-14T10:54:16.926 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.928+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=A0HSG7N9VN9I type=write size=33112 2024-09-14T10:54:16.927 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.928+0000 7faa01046780 1 < completed delete operation key=GG02P21TFKIM tag=MR7F1B9U6VHI type=del 2024-09-14T10:54:16.929 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.931+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=QUJSRLGD5UGH type=write size=845817 2024-09-14T10:54:16.930 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.931+0000 7faa01046780 1 < completed delete operation key=GG02P21TFKIM tag=YZ808XEXSPAW type=del 2024-09-14T10:54:16.932 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.935+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~VCJPS4A2CE6D.0 size=1048576 2024-09-14T10:54:16.933 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.935+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~VCJPS4A2CE6D.1 size=211674 2024-09-14T10:54:16.933 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.935+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=VCJPS4A2CE6D tag=U3LZSF35SSLQ type=write size=2308826 2024-09-14T10:54:16.935 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.937+0000 7faa01046780 -1 < failed to complete operation key=X9DUVQBBLUTF tag=BZIZJ4ERRO3T type=write size=879013: (22) Invalid argument 2024-09-14T10:54:16.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.937+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=D2WPFMZJ3B9M type=write size=290144 2024-09-14T10:54:16.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.939+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~LZNITP5QS3R0.0 size=281835 2024-09-14T10:54:16.940 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.941+0000 7faa01046780 1 < completed multipart upload key=HYAGNAOWK8LF upload=LZNITP5QS3R0 tag=CNTN2OBBJH3P type=write size=1330411 2024-09-14T10:54:16.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.942+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=CZGFW0OQF71V type=del size=4075961 2024-09-14T10:54:16.942 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.945+0000 7faa01046780 -1 < failed to complete operation key=NXIPG4HR9ZYY tag=SH96397O85R7 type=write size=64762: (22) Invalid argument 2024-09-14T10:54:16.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.946+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~IXSJNMG5O7QM.0 size=430464 2024-09-14T10:54:16.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.946+0000 7faa01046780 1 > prepared multipart upload key=SJ02N8472YDM upload=IXSJNMG5O7QM tag=6D9C2O1NSUFF type=write size=1479040 2024-09-14T10:54:16.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.947+0000 7faa01046780 1 < canceled part key=_multipart_X9DUVQBBLUTF.2~OWQVUITE8JYZ.0 size=1048576 2024-09-14T10:54:16.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.947+0000 7faa01046780 1 < canceled part key=_multipart_X9DUVQBBLUTF.2~OWQVUITE8JYZ.1 size=1048576 2024-09-14T10:54:16.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.948+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~OWQVUITE8JYZ.2 size=72594 2024-09-14T10:54:16.949 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.951+0000 7faa01046780 1 < canceled multipart upload key=X9DUVQBBLUTF upload=OWQVUITE8JYZ tag=E1JRV5NTZYE7 type=write size=3218322 2024-09-14T10:54:16.952 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.953+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~0FMF4JF204LS.0 size=2338 2024-09-14T10:54:16.952 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.953+0000 7faa01046780 1 > prepared multipart upload key=V11YJWHT4OOD upload=0FMF4JF204LS tag=394SR1GE4OD7 type=write size=1050914 2024-09-14T10:54:16.953 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.955+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~4080NW6TEXLI.0 size=2435 2024-09-14T10:54:16.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.958+0000 7faa01046780 1 < completed multipart upload key=FOJGGEQZD7YW upload=4080NW6TEXLI tag=ISGD16RSWOZZ type=write size=1051011 2024-09-14T10:54:16.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.959+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=CP27IP2XZ321 type=del size=1199215 2024-09-14T10:54:16.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.961+0000 7faa01046780 1 < completed delete operation key=F872GLVQDCX6 tag=XHJ81SV70HB3 type=del 2024-09-14T10:54:16.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.961+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=S1R7EE35BE1I type=del size=2952517 2024-09-14T10:54:16.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.964+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~NT9G8780XEJI.0 size=892813 2024-09-14T10:54:16.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.966+0000 7faa01046780 1 < completed multipart upload key=0XVVSUIOBQPL upload=NT9G8780XEJI tag=EEJIZGMPBME9 type=write size=1941389 2024-09-14T10:54:16.965 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.966+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=VVW2SI84KJYZ type=del size=858560 2024-09-14T10:54:16.967 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.968+0000 7faa01046780 1 < completed delete operation key=GG02P21TFKIM tag=WR1NWFHCHW0X type=del 2024-09-14T10:54:16.969 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.970+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~1IN627R3X75G.0 size=1048576 2024-09-14T10:54:16.970 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.972+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~1IN627R3X75G.1 size=1048576 2024-09-14T10:54:16.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.973+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~1IN627R3X75G.2 size=379035 2024-09-14T10:54:16.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.973+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=1IN627R3X75G tag=EOM78TES3YQ0 type=write size=3524763 2024-09-14T10:54:16.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.974+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~AV4QQPTC7BI1.0 size=1048576 2024-09-14T10:54:16.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.976+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~AV4QQPTC7BI1.1 size=1048576 2024-09-14T10:54:16.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.976+0000 7faa01046780 1 < canceled part key=_multipart_BBDTPL35W4W0.2~AV4QQPTC7BI1.2 size=568617 2024-09-14T10:54:16.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.979+0000 7faa01046780 1 < canceled multipart upload key=BBDTPL35W4W0 upload=AV4QQPTC7BI1 tag=8H2OZ9VO5YJR type=write size=3714345 2024-09-14T10:54:16.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.980+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=T9UKFFX9MBJ0 type=del size=73811 2024-09-14T10:54:16.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.984+0000 7faa01046780 1 < suggested update operation key=ZY0BY3G9NREC tag=OPK8LS8KWMTW type=del size=2337700 2024-09-14T10:54:16.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.985+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=6ZVOKT9004KP type=write size=266041 2024-09-14T10:54:16.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.986+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~U44XTVIE6XTB.0 size=1048576 2024-09-14T10:54:16.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.987+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~U44XTVIE6XTB.1 size=826704 2024-09-14T10:54:16.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.991+0000 7faa01046780 1 < completed multipart upload key=ZY0BY3G9NREC upload=U44XTVIE6XTB tag=XKEGT7LRX3UL type=write size=2923856 2024-09-14T10:54:16.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.993+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=YS0ZYB50MCHP type=del size=2975741 2024-09-14T10:54:16.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.994+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~B7JQSB4C3F2W.0 size=487350 2024-09-14T10:54:16.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.997+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=B7JQSB4C3F2W tag=SUUFKZA261FU type=write size=1535926 2024-09-14T10:54:16.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.999+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=OD6EMUWJ7VDJ type=del size=658831 2024-09-14T10:54:16.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:16.999+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~MOVPIXCITJZQ.0 size=971721 2024-09-14T10:54:17.000 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.001+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=MOVPIXCITJZQ tag=SLSLJ0YXHABU type=write size=2020297 2024-09-14T10:54:17.003 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.005+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~R750TQM9DSOW.0 size=1048576 2024-09-14T10:54:17.004 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.005+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~R750TQM9DSOW.1 size=400399 2024-09-14T10:54:17.004 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.005+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=R750TQM9DSOW tag=VLA8V04N2QM6 type=write size=2497551 2024-09-14T10:54:17.005 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.008+0000 7faa01046780 1 < completed write operation key=FOJGGEQZD7YW tag=A0HSG7N9VN9I type=write size=33112 2024-09-14T10:54:17.007 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.008+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=9W6WK5G9Y228 type=del size=299671 2024-09-14T10:54:17.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.010+0000 7faa01046780 1 < completed write operation key=FOJGGEQZD7YW tag=QUJSRLGD5UGH type=write size=845817 2024-09-14T10:54:17.011 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.013+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~9FNOYZA5ITPD.0 size=1048576 2024-09-14T10:54:17.013 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.015+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~9FNOYZA5ITPD.1 size=462776 2024-09-14T10:54:17.013 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.015+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=9FNOYZA5ITPD tag=I05ZGWA1I2CF type=write size=2559928 2024-09-14T10:54:17.014 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.015+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~VCJPS4A2CE6D.0 size=1048576 2024-09-14T10:54:17.015 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.017+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~VCJPS4A2CE6D.1 size=211674 2024-09-14T10:54:17.018 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.019+0000 7faa01046780 1 < completed multipart upload key=HUBZAFMSCCNC upload=VCJPS4A2CE6D tag=U3LZSF35SSLQ type=write size=2308826 2024-09-14T10:54:17.020 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.022+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~E6M9COAZPQA4.0 size=1048576 2024-09-14T10:54:17.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.024+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~E6M9COAZPQA4.1 size=151989 2024-09-14T10:54:17.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.024+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=E6M9COAZPQA4 tag=21PRRAFFB6CB type=write size=2249141 2024-09-14T10:54:17.023 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.025+0000 7faa01046780 1 < completed write operation key=S3BGVJ9N9S4P tag=D2WPFMZJ3B9M type=write size=290144 2024-09-14T10:54:17.026 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.028+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~WY5H811Y9OV9.0 size=827733 2024-09-14T10:54:17.026 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.028+0000 7faa01046780 1 > prepared multipart upload key=SJ02N8472YDM upload=WY5H811Y9OV9 tag=L8GEI3J1N7TH type=write size=1876309 2024-09-14T10:54:17.028 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.030+0000 7faa01046780 1 < completed delete operation key=GG02P21TFKIM tag=CZGFW0OQF71V type=del 2024-09-14T10:54:17.029 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.031+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=VK8MD1K4BY51 type=del size=1955402 2024-09-14T10:54:17.031 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.033+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~IXSJNMG5O7QM.0 size=430464 2024-09-14T10:54:17.034 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.036+0000 7faa01046780 1 < completed multipart upload key=SJ02N8472YDM upload=IXSJNMG5O7QM tag=6D9C2O1NSUFF type=write size=1479040 2024-09-14T10:54:17.036 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.037+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~EC646JSQ1STY.0 size=514693 2024-09-14T10:54:17.036 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.037+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=EC646JSQ1STY tag=Z9U4W9HF0HRK type=write size=1563269 2024-09-14T10:54:17.038 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.040+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~0FMF4JF204LS.0 size=2338 2024-09-14T10:54:17.040 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.041+0000 7faa01046780 1 < completed multipart upload key=V11YJWHT4OOD upload=0FMF4JF204LS tag=394SR1GE4OD7 type=write size=1050914 2024-09-14T10:54:17.041 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.044+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=HX1DOK9X3L6I type=del size=2110746 2024-09-14T10:54:17.043 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.044+0000 7faa01046780 1 < completed delete operation key=KDUTH9PIR3FI tag=CP27IP2XZ321 type=del 2024-09-14T10:54:17.045 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.047+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~L7N604NMBZUG.0 size=269307 2024-09-14T10:54:17.046 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.047+0000 7faa01046780 1 > prepared multipart upload key=FOJGGEQZD7YW upload=L7N604NMBZUG tag=5JU5VAVVS2DB type=write size=1317883 2024-09-14T10:54:17.047 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.048+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=S1R7EE35BE1I type=del 2024-09-14T10:54:17.050 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.051+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~IE7NTZGQMY5T.0 size=1048576 2024-09-14T10:54:17.051 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.052+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~IE7NTZGQMY5T.1 size=936787 2024-09-14T10:54:17.051 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.052+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=IE7NTZGQMY5T tag=YVZ53XXVC4SA type=write size=3033939 2024-09-14T10:54:17.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.053+0000 7faa01046780 1 < completed delete operation key=TDNQZ8Y1C6X2 tag=VVW2SI84KJYZ type=del 2024-09-14T10:54:17.054 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.056+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=KOLK8D0INGKI type=del size=2060912 2024-09-14T10:54:17.055 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.056+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~1IN627R3X75G.0 size=1048576 2024-09-14T10:54:17.056 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.058+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~1IN627R3X75G.1 size=1048576 2024-09-14T10:54:17.058 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.059+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~1IN627R3X75G.2 size=379035 2024-09-14T10:54:17.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.061+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=1IN627R3X75G tag=EOM78TES3YQ0 type=write size=3524763 2024-09-14T10:54:17.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.065+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~CDW3BF5DFYTI.0 size=188577 2024-09-14T10:54:17.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.065+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=CDW3BF5DFYTI tag=6JND8M0TEIV5 type=write size=1237153 2024-09-14T10:54:17.065 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.067+0000 7faa01046780 1 < completed delete operation key=F872GLVQDCX6 tag=T9UKFFX9MBJ0 type=del 2024-09-14T10:54:17.066 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.068+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=25OX7O2GCMQZ type=del size=1751042 2024-09-14T10:54:17.068 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.070+0000 7faa01046780 1 < completed write operation key=NXIPG4HR9ZYY tag=6ZVOKT9004KP type=write size=266041 2024-09-14T10:54:17.069 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.071+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=8Y29EPES57NG type=del size=1693973 2024-09-14T10:54:17.071 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.073+0000 7faa01046780 1 < completed delete operation key=3UEX0IPM4CPY tag=YS0ZYB50MCHP type=del 2024-09-14T10:54:17.072 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.074+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=AVE1YKCPNBVM type=del size=596280 2024-09-14T10:54:17.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.076+0000 7faa01046780 1 < completed delete operation key=0XVVSUIOBQPL tag=OD6EMUWJ7VDJ type=del 2024-09-14T10:54:17.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.077+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=BE0M3C8NW9Q0 type=del size=3686757 2024-09-14T10:54:17.077 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.079+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~R750TQM9DSOW.0 size=1048576 2024-09-14T10:54:17.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.079+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~R750TQM9DSOW.1 size=400399 2024-09-14T10:54:17.080 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.081+0000 7faa01046780 1 < completed multipart upload key=CKMDOO75UZGE upload=R750TQM9DSOW tag=VLA8V04N2QM6 type=write size=2497551 2024-09-14T10:54:17.081 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.083+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=ZJHDCPXJMGBO type=del size=3283073 2024-09-14T10:54:17.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.084+0000 7faa01046780 1 < completed delete operation key=KDUTH9PIR3FI tag=9W6WK5G9Y228 type=del 2024-09-14T10:54:17.084 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.086+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=DHF7MTX04VV2 type=del size=3483790 2024-09-14T10:54:17.086 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.087+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~9FNOYZA5ITPD.0 size=1048576 2024-09-14T10:54:17.087 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.088+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~9FNOYZA5ITPD.1 size=462776 2024-09-14T10:54:17.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.090+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=9FNOYZA5ITPD tag=I05ZGWA1I2CF type=write size=2559928 2024-09-14T10:54:17.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.092+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=UGGQRZCQM6UJ type=del size=2332000 2024-09-14T10:54:17.092 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.094+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~E6M9COAZPQA4.0 size=1048576 2024-09-14T10:54:17.093 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.094+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~E6M9COAZPQA4.1 size=151989 2024-09-14T10:54:17.096 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.098+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=E6M9COAZPQA4 tag=21PRRAFFB6CB type=write size=2249141 2024-09-14T10:54:17.097 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.098+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=WSHFR1HDA8QF type=del size=235872 2024-09-14T10:54:17.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.100+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~WY5H811Y9OV9.0 size=827733 2024-09-14T10:54:17.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.102+0000 7faa01046780 1 < completed multipart upload key=SJ02N8472YDM upload=WY5H811Y9OV9 tag=L8GEI3J1N7TH type=write size=1876309 2024-09-14T10:54:17.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.106+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~VYGLY8XLA6AY.0 size=136062 2024-09-14T10:54:17.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.106+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=VYGLY8XLA6AY tag=3ZLIR0W7YTDS type=write size=1184638 2024-09-14T10:54:17.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.106+0000 7faa01046780 1 < completed delete operation key=NXIPG4HR9ZYY tag=VK8MD1K4BY51 type=del 2024-09-14T10:54:17.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.110+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~AL4Y4BJWT4V7.0 size=523716 2024-09-14T10:54:17.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.110+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=AL4Y4BJWT4V7 tag=VO5KY5R46QUZ type=write size=1572292 2024-09-14T10:54:17.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.110+0000 7faa01046780 1 < canceled part key=_multipart_0OL3SF5IWDMH.2~EC646JSQ1STY.0 size=514693 2024-09-14T10:54:17.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.112+0000 7faa01046780 1 < canceled multipart upload key=0OL3SF5IWDMH upload=EC646JSQ1STY tag=Z9U4W9HF0HRK type=write size=1563269 2024-09-14T10:54:17.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.115+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~6XAIUOYIGILR.0 size=479998 2024-09-14T10:54:17.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.115+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=6XAIUOYIGILR tag=55AEMAG0T9IW type=write size=1528574 2024-09-14T10:54:17.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.118+0000 7faa01046780 1 < suggested update operation key=VIO703UXIJXV tag=HX1DOK9X3L6I type=del size=2110746 2024-09-14T10:54:17.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.119+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~RYMNPLG2JZ7U.0 size=1048576 2024-09-14T10:54:17.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.120+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~RYMNPLG2JZ7U.1 size=418334 2024-09-14T10:54:17.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.120+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=RYMNPLG2JZ7U tag=5UEDKCNFAAT8 type=write size=2515486 2024-09-14T10:54:17.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.123+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~L7N604NMBZUG.0 size=269307 2024-09-14T10:54:17.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.124+0000 7faa01046780 1 < completed multipart upload key=FOJGGEQZD7YW upload=L7N604NMBZUG tag=5JU5VAVVS2DB type=write size=1317883 2024-09-14T10:54:17.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.128+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~WMGY1RUBVYEG.0 size=1048576 2024-09-14T10:54:17.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.129+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~WMGY1RUBVYEG.1 size=259611 2024-09-14T10:54:17.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.129+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=WMGY1RUBVYEG tag=FFKN9VMYWSI1 type=write size=2356763 2024-09-14T10:54:17.129 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.131+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~IE7NTZGQMY5T.0 size=1048576 2024-09-14T10:54:17.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.132+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~IE7NTZGQMY5T.1 size=936787 2024-09-14T10:54:17.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.134+0000 7faa01046780 1 < completed multipart upload key=S3BGVJ9N9S4P upload=IE7NTZGQMY5T tag=YVZ53XXVC4SA type=write size=3033939 2024-09-14T10:54:17.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.134+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=UCV1BN645YTN type=del size=2631155 2024-09-14T10:54:17.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.136+0000 7faa01046780 1 < completed delete operation key=ZY0BY3G9NREC tag=KOLK8D0INGKI type=del 2024-09-14T10:54:17.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.139+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~JF2GFOL86YP0.0 size=1048576 2024-09-14T10:54:17.138 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.139+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~JF2GFOL86YP0.1 size=865546 2024-09-14T10:54:17.138 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.139+0000 7faa01046780 1 > prepared multipart upload key=X9DUVQBBLUTF upload=JF2GFOL86YP0 tag=CDVA6IT6WBHP type=write size=2962698 2024-09-14T10:54:17.139 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.142+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~CDW3BF5DFYTI.0 size=188577 2024-09-14T10:54:17.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.144+0000 7faa01046780 1 < completed multipart upload key=HYAGNAOWK8LF upload=CDW3BF5DFYTI tag=6JND8M0TEIV5 type=write size=1237153 2024-09-14T10:54:17.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.146+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~W5O3XC1RSESP.0 size=1048576 2024-09-14T10:54:17.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.147+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~W5O3XC1RSESP.1 size=1048576 2024-09-14T10:54:17.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.148+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~W5O3XC1RSESP.2 size=980643 2024-09-14T10:54:17.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.148+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=W5O3XC1RSESP tag=J90AQJJN7JUR type=write size=4126371 2024-09-14T10:54:17.148 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.149+0000 7faa01046780 1 < completed delete operation key=GG02P21TFKIM tag=25OX7O2GCMQZ type=del 2024-09-14T10:54:17.150 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.152+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~YW5FYF31RX4H.0 size=1048576 2024-09-14T10:54:17.151 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.153+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~YW5FYF31RX4H.1 size=3486 2024-09-14T10:54:17.151 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.153+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=YW5FYF31RX4H tag=LIBKSVK6TOIC type=write size=2100638 2024-09-14T10:54:17.153 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.155+0000 7faa01046780 1 < canceled operation key=ZY0BY3G9NREC tag=8Y29EPES57NG type=del size=1693973 2024-09-14T10:54:17.154 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.156+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=I3W5ELK8OFGF type=write size=653562 2024-09-14T10:54:17.156 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.158+0000 7faa01046780 1 < completed delete operation key=V905BR1VWUCV tag=AVE1YKCPNBVM type=del 2024-09-14T10:54:17.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.158+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=NJ4K8ORKNH6C type=del size=2285056 2024-09-14T10:54:17.158 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.160+0000 7faa01046780 1 < completed delete operation key=TDNQZ8Y1C6X2 tag=BE0M3C8NW9Q0 type=del 2024-09-14T10:54:17.160 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.161+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=F400G5DK5PV5 type=write size=823749 2024-09-14T10:54:17.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.163+0000 7faa01046780 1 < completed delete operation key=0OL3SF5IWDMH tag=ZJHDCPXJMGBO type=del 2024-09-14T10:54:17.164 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.166+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~7BPGE8V0ND80.0 size=1048576 2024-09-14T10:54:17.165 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.166+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~7BPGE8V0ND80.1 size=1048576 2024-09-14T10:54:17.166 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.167+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~7BPGE8V0ND80.2 size=762299 2024-09-14T10:54:17.166 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.167+0000 7faa01046780 1 > prepared multipart upload key=ZY0BY3G9NREC upload=7BPGE8V0ND80 tag=PFMI4QVPRGOQ type=write size=3908027 2024-09-14T10:54:17.169 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.171+0000 7faa01046780 1 < suggested remove operation key=V11YJWHT4OOD tag=DHF7MTX04VV2 type=del 2024-09-14T10:54:17.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.172+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=35LT2IKL7H2T type=del size=2490664 2024-09-14T10:54:17.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.174+0000 7faa01046780 1 < completed delete operation key=U8TE0XNK9YKM tag=UGGQRZCQM6UJ type=del 2024-09-14T10:54:17.174 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.175+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~DE1AOLAPVI0E.0 size=1048576 2024-09-14T10:54:17.175 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.176+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~DE1AOLAPVI0E.1 size=1036511 2024-09-14T10:54:17.175 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.176+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=DE1AOLAPVI0E tag=AOWLX0236LDF type=write size=3133663 2024-09-14T10:54:17.176 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.179+0000 7faa01046780 1 < completed delete operation key=V5T3AN9D7DH6 tag=WSHFR1HDA8QF type=del 2024-09-14T10:54:17.178 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.179+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=L3F0UVHAFTDP type=write size=972264 2024-09-14T10:54:17.179 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.181+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~VYGLY8XLA6AY.0 size=136062 2024-09-14T10:54:17.181 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.184+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=VYGLY8XLA6AY tag=3ZLIR0W7YTDS type=write size=1184638 2024-09-14T10:54:17.184 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.185+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~G1LQYORTQY0V.0 size=725138 2024-09-14T10:54:17.184 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.185+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=G1LQYORTQY0V tag=ZYUFRP3S8T7F type=write size=1773714 2024-09-14T10:54:17.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.188+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~AL4Y4BJWT4V7.0 size=523716 2024-09-14T10:54:17.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.190+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=AL4Y4BJWT4V7 tag=VO5KY5R46QUZ type=write size=1572292 2024-09-14T10:54:17.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.190+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=228PAFUH9SJS type=write size=422728 2024-09-14T10:54:17.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.193+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~6XAIUOYIGILR.0 size=479998 2024-09-14T10:54:17.194 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.197+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=6XAIUOYIGILR tag=55AEMAG0T9IW type=write size=1528574 2024-09-14T10:54:17.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.197+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=KS0QLFE5QUSY type=del size=1683379 2024-09-14T10:54:17.197 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.199+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~RYMNPLG2JZ7U.0 size=1048576 2024-09-14T10:54:17.199 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.200+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~RYMNPLG2JZ7U.1 size=418334 2024-09-14T10:54:17.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.202+0000 7faa01046780 1 < completed multipart upload key=CKMDOO75UZGE upload=RYMNPLG2JZ7U tag=5UEDKCNFAAT8 type=write size=2515486 2024-09-14T10:54:17.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.203+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=L1USW9HILTNQ type=del size=2615126 2024-09-14T10:54:17.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.205+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~WMGY1RUBVYEG.0 size=1048576 2024-09-14T10:54:17.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.206+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~WMGY1RUBVYEG.1 size=259611 2024-09-14T10:54:17.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.208+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=WMGY1RUBVYEG tag=FFKN9VMYWSI1 type=write size=2356763 2024-09-14T10:54:17.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.211+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=M4TPN2I68G0O type=del size=2129260 2024-09-14T10:54:17.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.212+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=UCV1BN645YTN type=del 2024-09-14T10:54:17.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.214+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=XVU70AIJS32I type=del size=1009713 2024-09-14T10:54:17.213 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.216+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~JF2GFOL86YP0.0 size=1048576 2024-09-14T10:54:17.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.217+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~JF2GFOL86YP0.1 size=865546 2024-09-14T10:54:17.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.220+0000 7faa01046780 1 < completed multipart upload key=X9DUVQBBLUTF upload=JF2GFOL86YP0 tag=CDVA6IT6WBHP type=write size=2962698 2024-09-14T10:54:17.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.221+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=NVY6VSSUIOQZ type=del size=2842735 2024-09-14T10:54:17.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.223+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~W5O3XC1RSESP.0 size=1048576 2024-09-14T10:54:17.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.224+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~W5O3XC1RSESP.1 size=1048576 2024-09-14T10:54:17.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.225+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~W5O3XC1RSESP.2 size=980643 2024-09-14T10:54:17.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.228+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=W5O3XC1RSESP tag=J90AQJJN7JUR type=write size=4126371 2024-09-14T10:54:17.227 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.230+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=3KM0NO4ST22M type=del size=601120 2024-09-14T10:54:17.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.230+0000 7faa01046780 1 < canceled part key=_multipart_HUBZAFMSCCNC.2~YW5FYF31RX4H.0 size=1048576 2024-09-14T10:54:17.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.232+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~YW5FYF31RX4H.1 size=3486 2024-09-14T10:54:17.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.234+0000 7faa01046780 1 < canceled multipart upload key=HUBZAFMSCCNC upload=YW5FYF31RX4H tag=LIBKSVK6TOIC type=write size=2100638 2024-09-14T10:54:17.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.237+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~3YLLOD6ZDD31.0 size=933959 2024-09-14T10:54:17.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.237+0000 7faa01046780 1 > prepared multipart upload key=F872GLVQDCX6 upload=3YLLOD6ZDD31 tag=08PP4BICI294 type=write size=1982535 2024-09-14T10:54:17.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.238+0000 7faa01046780 1 < completed write operation key=X9DUVQBBLUTF tag=I3W5ELK8OFGF type=write size=653562 2024-09-14T10:54:17.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.240+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~AVA5N2X76FUD.0 size=1048576 2024-09-14T10:54:17.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.242+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~AVA5N2X76FUD.1 size=1048576 2024-09-14T10:54:17.241 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.244+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~AVA5N2X76FUD.2 size=709473 2024-09-14T10:54:17.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.244+0000 7faa01046780 1 > prepared multipart upload key=F06QWEOYNQX4 upload=AVA5N2X76FUD tag=HBZIFU91HBGY type=write size=3855201 2024-09-14T10:54:17.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.245+0000 7faa01046780 1 < canceled operation key=HUBZAFMSCCNC tag=NJ4K8ORKNH6C type=del size=2285056 2024-09-14T10:54:17.246 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.248+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~Y5BX0S2MN125.0 size=1048576 2024-09-14T10:54:17.247 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.249+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~Y5BX0S2MN125.1 size=1048576 2024-09-14T10:54:17.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.251+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~Y5BX0S2MN125.2 size=103887 2024-09-14T10:54:17.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.251+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=Y5BX0S2MN125 tag=GVKBR58WRSZY type=write size=3249615 2024-09-14T10:54:17.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.254+0000 7faa01046780 1 < suggested update operation key=V5T3AN9D7DH6 tag=F400G5DK5PV5 type=write size=823749 2024-09-14T10:54:17.255 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.257+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~QNMZ2CPC3CGG.0 size=202619 2024-09-14T10:54:17.255 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.257+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=QNMZ2CPC3CGG tag=AJ5FD4SZ7W9Q type=write size=1251195 2024-09-14T10:54:17.256 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.258+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~7BPGE8V0ND80.0 size=1048576 2024-09-14T10:54:17.257 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.260+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~7BPGE8V0ND80.1 size=1048576 2024-09-14T10:54:17.259 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.261+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~7BPGE8V0ND80.2 size=762299 2024-09-14T10:54:17.262 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.264+0000 7faa01046780 1 < completed multipart upload key=ZY0BY3G9NREC upload=7BPGE8V0ND80 tag=PFMI4QVPRGOQ type=write size=3908027 2024-09-14T10:54:17.263 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.264+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=ZF7W7LT4BC98 type=del size=1923698 2024-09-14T10:54:17.265 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.267+0000 7faa01046780 1 < completed delete operation key=3FSH0OFMF54V tag=35LT2IKL7H2T type=del 2024-09-14T10:54:17.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.269+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=MILTYGDHTFG3 type=del size=3282046 2024-09-14T10:54:17.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.271+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~DE1AOLAPVI0E.0 size=1048576 2024-09-14T10:54:17.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.271+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~DE1AOLAPVI0E.1 size=1036511 2024-09-14T10:54:17.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.273+0000 7faa01046780 1 < completed multipart upload key=0OL3SF5IWDMH upload=DE1AOLAPVI0E tag=AOWLX0236LDF type=write size=3133663 2024-09-14T10:54:17.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.275+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=GHVY6XSWDDUZ type=del size=933411 2024-09-14T10:54:17.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.277+0000 7faa01046780 1 < completed write operation key=KDUTH9PIR3FI tag=L3F0UVHAFTDP type=write size=972264 2024-09-14T10:54:17.276 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.278+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=P2J8V2JX3D9H type=del size=4066184 2024-09-14T10:54:17.278 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.279+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~G1LQYORTQY0V.0 size=725138 2024-09-14T10:54:17.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.282+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=G1LQYORTQY0V tag=ZYUFRP3S8T7F type=write size=1773714 2024-09-14T10:54:17.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.284+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~GS2W11MX76UO.0 size=595555 2024-09-14T10:54:17.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.284+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=GS2W11MX76UO tag=YUJ6L7811EOS type=write size=1644131 2024-09-14T10:54:17.285 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.287+0000 7faa01046780 1 < completed write operation key=V11YJWHT4OOD tag=228PAFUH9SJS type=write size=422728 2024-09-14T10:54:17.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.288+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~K52XY5VE7SKN.0 size=1048576 2024-09-14T10:54:17.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.289+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~K52XY5VE7SKN.1 size=1048576 2024-09-14T10:54:17.289 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.292+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~K52XY5VE7SKN.2 size=267333 2024-09-14T10:54:17.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.292+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=K52XY5VE7SKN tag=U2URC5ARG9K6 type=write size=3413061 2024-09-14T10:54:17.291 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.292+0000 7faa01046780 1 < completed delete operation key=LF41PL7DFSJI tag=KS0QLFE5QUSY type=del 2024-09-14T10:54:17.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.295+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~XAUQQA8JP3A2.0 size=1048576 2024-09-14T10:54:17.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.297+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~XAUQQA8JP3A2.1 size=1048576 2024-09-14T10:54:17.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.298+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~XAUQQA8JP3A2.2 size=532871 2024-09-14T10:54:17.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.298+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=XAUQQA8JP3A2 tag=ASNA8P9AA29D type=write size=3678599 2024-09-14T10:54:17.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.299+0000 7faa01046780 1 < completed delete operation key=0OL3SF5IWDMH tag=L1USW9HILTNQ type=del 2024-09-14T10:54:17.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.302+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~I305163OBOG1.0 size=1048576 2024-09-14T10:54:17.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.303+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~I305163OBOG1.1 size=1048576 2024-09-14T10:54:17.303 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.305+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~I305163OBOG1.2 size=798579 2024-09-14T10:54:17.304 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.305+0000 7faa01046780 1 > prepared multipart upload key=GG02P21TFKIM upload=I305163OBOG1 tag=58L433P9Q2PZ type=write size=3944307 2024-09-14T10:54:17.305 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.307+0000 7faa01046780 1 < completed delete operation key=VIO703UXIJXV tag=M4TPN2I68G0O type=del 2024-09-14T10:54:17.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.308+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=TUVGZENVED6N type=del size=363940 2024-09-14T10:54:17.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.309+0000 7faa01046780 1 < completed delete operation key=ZY0BY3G9NREC tag=XVU70AIJS32I type=del 2024-09-14T10:54:17.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.310+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=KJI8XEU7UVOJ type=del size=1960869 2024-09-14T10:54:17.310 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.312+0000 7faa01046780 1 < canceled operation key=Y4CB0HIN0750 tag=NVY6VSSUIOQZ type=del size=2842735 2024-09-14T10:54:17.312 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.313+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=6RW0FEMY6CAE type=write size=526537 2024-09-14T10:54:17.313 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.315+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=3KM0NO4ST22M type=del 2024-09-14T10:54:17.315 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.316+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=9QXJK301HH89 type=del size=188037 2024-09-14T10:54:17.315 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.317+0000 7faa01046780 1 < canceled part key=_multipart_F872GLVQDCX6.2~3YLLOD6ZDD31.0 size=933959 2024-09-14T10:54:17.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.320+0000 7faa01046780 1 < canceled multipart upload key=F872GLVQDCX6 upload=3YLLOD6ZDD31 tag=08PP4BICI294 type=write size=1982535 2024-09-14T10:54:17.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.320+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=A4FP9KLHSPK7 type=del size=2620207 2024-09-14T10:54:17.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.323+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~AVA5N2X76FUD.0 size=1048576 2024-09-14T10:54:17.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.324+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~AVA5N2X76FUD.1 size=1048576 2024-09-14T10:54:17.323 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.324+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~AVA5N2X76FUD.2 size=709473 2024-09-14T10:54:17.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.327+0000 7faa01046780 1 < completed multipart upload key=F06QWEOYNQX4 upload=AVA5N2X76FUD tag=HBZIFU91HBGY type=write size=3855201 2024-09-14T10:54:17.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.329+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=I5XN8VDMFYOH type=del size=1898561 2024-09-14T10:54:17.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.330+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~Y5BX0S2MN125.0 size=1048576 2024-09-14T10:54:17.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.332+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~Y5BX0S2MN125.1 size=1048576 2024-09-14T10:54:17.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.332+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~Y5BX0S2MN125.2 size=103887 2024-09-14T10:54:17.334 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.335+0000 7faa01046780 1 < completed multipart upload key=Y4CB0HIN0750 upload=Y5BX0S2MN125 tag=GVKBR58WRSZY type=write size=3249615 2024-09-14T10:54:17.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.336+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=9S5VVAOLWNO5 type=del size=3589505 2024-09-14T10:54:17.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.338+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~QNMZ2CPC3CGG.0 size=202619 2024-09-14T10:54:17.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.340+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=QNMZ2CPC3CGG tag=AJ5FD4SZ7W9Q type=write size=1251195 2024-09-14T10:54:17.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.343+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~T9SISWNTSN35.0 size=714635 2024-09-14T10:54:17.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.343+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=T9SISWNTSN35 tag=ERJOTVSWYLKX type=write size=1763211 2024-09-14T10:54:17.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.345+0000 7faa01046780 1 < completed delete operation key=PBRZNGSOLJ8E tag=ZF7W7LT4BC98 type=del 2024-09-14T10:54:17.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.345+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=SK2G77N2RS9H type=del size=31469 2024-09-14T10:54:17.346 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.347+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=MILTYGDHTFG3 type=del 2024-09-14T10:54:17.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.348+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=O0YUQ8KNLXWE type=del size=1935956 2024-09-14T10:54:17.348 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.349+0000 7faa01046780 1 < completed delete operation key=X9DUVQBBLUTF tag=GHVY6XSWDDUZ type=del 2024-09-14T10:54:17.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.351+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=7J6R9FY2FOMF type=del size=366009 2024-09-14T10:54:17.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.353+0000 7faa01046780 1 < completed delete operation key=BBDTPL35W4W0 tag=P2J8V2JX3D9H type=del 2024-09-14T10:54:17.352 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.354+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=G0KMUXFW1AD8 type=del size=3102588 2024-09-14T10:54:17.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.354+0000 7faa01046780 1 < canceled part key=_multipart_HUBZAFMSCCNC.2~GS2W11MX76UO.0 size=595555 2024-09-14T10:54:17.355 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.357+0000 7faa01046780 1 < canceled multipart upload key=HUBZAFMSCCNC upload=GS2W11MX76UO tag=YUJ6L7811EOS type=write size=1644131 2024-09-14T10:54:17.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.359+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~QQ1NBR50HB2X.0 size=986634 2024-09-14T10:54:17.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.359+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=QQ1NBR50HB2X tag=K4MWM5Z1I0WN type=write size=2035210 2024-09-14T10:54:17.359 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.361+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~K52XY5VE7SKN.0 size=1048576 2024-09-14T10:54:17.359 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.361+0000 7faa01046780 1 < canceled part key=_multipart_KDUTH9PIR3FI.2~K52XY5VE7SKN.1 size=1048576 2024-09-14T10:54:17.360 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.362+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~K52XY5VE7SKN.2 size=267333 2024-09-14T10:54:17.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.364+0000 7faa01046780 1 < canceled multipart upload key=KDUTH9PIR3FI upload=K52XY5VE7SKN tag=U2URC5ARG9K6 type=write size=3413061 2024-09-14T10:54:17.365 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.367+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~GELYPW8HIIA8.0 size=1048576 2024-09-14T10:54:17.366 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.367+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~GELYPW8HIIA8.1 size=1048576 2024-09-14T10:54:17.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.369+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~GELYPW8HIIA8.2 size=572074 2024-09-14T10:54:17.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.369+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=GELYPW8HIIA8 tag=9Y0GRFNK2CTI type=write size=3717802 2024-09-14T10:54:17.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.371+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~XAUQQA8JP3A2.0 size=1048576 2024-09-14T10:54:17.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.372+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~XAUQQA8JP3A2.1 size=1048576 2024-09-14T10:54:17.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.372+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~XAUQQA8JP3A2.2 size=532871 2024-09-14T10:54:17.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.375+0000 7faa01046780 1 < completed multipart upload key=0XVVSUIOBQPL upload=XAUQQA8JP3A2 tag=ASNA8P9AA29D type=write size=3678599 2024-09-14T10:54:17.375 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.378+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~Y5P6C7EOPZJ5.0 size=291660 2024-09-14T10:54:17.376 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.378+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=Y5P6C7EOPZJ5 tag=UHEW9FT41NSD type=write size=1340236 2024-09-14T10:54:17.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.379+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~I305163OBOG1.0 size=1048576 2024-09-14T10:54:17.378 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.380+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~I305163OBOG1.1 size=1048576 2024-09-14T10:54:17.380 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.382+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~I305163OBOG1.2 size=798579 2024-09-14T10:54:17.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.384+0000 7faa01046780 1 < completed multipart upload key=GG02P21TFKIM upload=I305163OBOG1 tag=58L433P9Q2PZ type=write size=3944307 2024-09-14T10:54:17.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.386+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~0IMJYOGQAF6M.0 size=1048576 2024-09-14T10:54:17.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.388+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~0IMJYOGQAF6M.1 size=1048576 2024-09-14T10:54:17.387 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.389+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~0IMJYOGQAF6M.2 size=70926 2024-09-14T10:54:17.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.389+0000 7faa01046780 1 > prepared multipart upload key=V11YJWHT4OOD upload=0IMJYOGQAF6M tag=WNX2IJPRQR5A type=write size=3216654 2024-09-14T10:54:17.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.392+0000 7faa01046780 1 < suggested remove operation key=TDNQZ8Y1C6X2 tag=TUVGZENVED6N type=del 2024-09-14T10:54:17.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.393+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=0EYZZIDW537B type=del size=3874111 2024-09-14T10:54:17.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.394+0000 7faa01046780 1 < completed delete operation key=LF41PL7DFSJI tag=KJI8XEU7UVOJ type=del 2024-09-14T10:54:17.396 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.396+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=UJEFI29OPEDA type=del size=2864029 2024-09-14T10:54:17.396 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.397+0000 7faa01046780 1 < canceled operation key=XDJAK0XYQNF0 tag=6RW0FEMY6CAE type=write size=526537 2024-09-14T10:54:17.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.400+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~1WEBOVL0DHG2.0 size=1032649 2024-09-14T10:54:17.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.400+0000 7faa01046780 1 > prepared multipart upload key=FOJGGEQZD7YW upload=1WEBOVL0DHG2 tag=BRJQFJHWYC45 type=write size=2081225 2024-09-14T10:54:17.400 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.402+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=9QXJK301HH89 type=del 2024-09-14T10:54:17.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.404+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~I9UVGRMVTZNS.0 size=930328 2024-09-14T10:54:17.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.404+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=I9UVGRMVTZNS tag=FO1QBU7BVSOW type=write size=1978904 2024-09-14T10:54:17.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.406+0000 7faa01046780 1 < suggested update operation key=Y4CB0HIN0750 tag=A4FP9KLHSPK7 type=del size=2620207 2024-09-14T10:54:17.407 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.409+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=OXMJFMR27I2Z type=del size=2167689 2024-09-14T10:54:17.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.411+0000 7faa01046780 1 < suggested update operation key=KDUTH9PIR3FI tag=I5XN8VDMFYOH type=del size=1898561 2024-09-14T10:54:17.411 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.413+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=6HX1S82NUGBE type=del size=953341 2024-09-14T10:54:17.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.413+0000 7faa01046780 1 < completed delete operation key=3UEX0IPM4CPY tag=9S5VVAOLWNO5 type=del 2024-09-14T10:54:17.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.416+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=OVNYD9DS9RML type=del size=1777415 2024-09-14T10:54:17.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.417+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~T9SISWNTSN35.0 size=714635 2024-09-14T10:54:17.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.418+0000 7faa01046780 1 < completed multipart upload key=KDUTH9PIR3FI upload=T9SISWNTSN35 tag=ERJOTVSWYLKX type=write size=1763211 2024-09-14T10:54:17.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.422+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~CNGBPTEK04JM.0 size=615408 2024-09-14T10:54:17.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.422+0000 7faa01046780 1 > prepared multipart upload key=LF41PL7DFSJI upload=CNGBPTEK04JM tag=BN8LCYL35Y1I type=write size=1663984 2024-09-14T10:54:17.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.422+0000 7faa01046780 -1 < failed to complete operation key=KDUTH9PIR3FI tag=SK2G77N2RS9H type=del size=31469: (22) Invalid argument 2024-09-14T10:54:17.424 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.426+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~YF4SHZJZI6OC.0 size=1048576 2024-09-14T10:54:17.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.426+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~YF4SHZJZI6OC.1 size=1048576 2024-09-14T10:54:17.426 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.428+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~YF4SHZJZI6OC.2 size=748550 2024-09-14T10:54:17.426 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.428+0000 7faa01046780 1 > prepared multipart upload key=SJ02N8472YDM upload=YF4SHZJZI6OC tag=L9UZYN0343AT type=write size=3894278 2024-09-14T10:54:17.429 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.430+0000 7faa01046780 1 < suggested remove operation key=PS2QU1UZUYHE tag=O0YUQ8KNLXWE type=del 2024-09-14T10:54:17.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.433+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=KEIX13ZIOH75 type=write size=687495 2024-09-14T10:54:17.432 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.433+0000 7faa01046780 1 < completed delete operation key=HYAGNAOWK8LF tag=7J6R9FY2FOMF type=del 2024-09-14T10:54:17.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.437+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~GV1B0DEM1OCW.0 size=1048576 2024-09-14T10:54:17.436 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.437+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~GV1B0DEM1OCW.1 size=347813 2024-09-14T10:54:17.436 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.437+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=GV1B0DEM1OCW tag=GUXOBGT042C8 type=write size=2444965 2024-09-14T10:54:17.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.440+0000 7faa01046780 1 < canceled operation key=X9DUVQBBLUTF tag=G0KMUXFW1AD8 type=del size=3102588 2024-09-14T10:54:17.439 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.441+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=3HLJXHBOXZBR type=del size=2490730 2024-09-14T10:54:17.441 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.443+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~QQ1NBR50HB2X.0 size=986634 2024-09-14T10:54:17.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.444+0000 7faa01046780 1 < completed multipart upload key=HUBZAFMSCCNC upload=QQ1NBR50HB2X tag=K4MWM5Z1I0WN type=write size=2035210 2024-09-14T10:54:17.444 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.446+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=4V1MFGD2M1GR type=del size=2903728 2024-09-14T10:54:17.446 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.448+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~GELYPW8HIIA8.0 size=1048576 2024-09-14T10:54:17.447 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.448+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~GELYPW8HIIA8.1 size=1048576 2024-09-14T10:54:17.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.449+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~GELYPW8HIIA8.2 size=572074 2024-09-14T10:54:17.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.452+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=GELYPW8HIIA8 tag=9Y0GRFNK2CTI type=write size=3717802 2024-09-14T10:54:17.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.455+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~MYD2SGAMNHS3.0 size=745043 2024-09-14T10:54:17.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.455+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=MYD2SGAMNHS3 tag=8NX8JCHYAYP7 type=write size=1793619 2024-09-14T10:54:17.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.456+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~Y5P6C7EOPZJ5.0 size=291660 2024-09-14T10:54:17.457 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.459+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=Y5P6C7EOPZJ5 tag=UHEW9FT41NSD type=write size=1340236 2024-09-14T10:54:17.458 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.460+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=UGF0J5102DC1 type=write size=224290 2024-09-14T10:54:17.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.460+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~0IMJYOGQAF6M.0 size=1048576 2024-09-14T10:54:17.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.461+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~0IMJYOGQAF6M.1 size=1048576 2024-09-14T10:54:17.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.462+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~0IMJYOGQAF6M.2 size=70926 2024-09-14T10:54:17.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.467+0000 7faa01046780 1 < completed multipart upload key=V11YJWHT4OOD upload=0IMJYOGQAF6M tag=WNX2IJPRQR5A type=write size=3216654 2024-09-14T10:54:17.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.467+0000 7faa01046780 1 > prepared operation key=SJ02N8472YDM tag=5G3V0D02JK7L type=write size=1000914 2024-09-14T10:54:17.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.470+0000 7faa01046780 1 < completed delete operation key=ZY0BY3G9NREC tag=0EYZZIDW537B type=del 2024-09-14T10:54:17.469 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.470+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=4WI44P0AYJ6D type=del size=2374023 2024-09-14T10:54:17.470 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.472+0000 7faa01046780 1 < completed delete operation key=0XVVSUIOBQPL tag=UJEFI29OPEDA type=del 2024-09-14T10:54:17.473 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.475+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~MGU3012NIU1E.0 size=1048576 2024-09-14T10:54:17.474 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.476+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~MGU3012NIU1E.1 size=1048576 2024-09-14T10:54:17.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.476+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~MGU3012NIU1E.2 size=576055 2024-09-14T10:54:17.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.476+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=MGU3012NIU1E tag=QQ0NL5QG93W9 type=write size=3721783 2024-09-14T10:54:17.476 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.479+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~1WEBOVL0DHG2.0 size=1032649 2024-09-14T10:54:17.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.481+0000 7faa01046780 1 < completed multipart upload key=FOJGGEQZD7YW upload=1WEBOVL0DHG2 tag=BRJQFJHWYC45 type=write size=2081225 2024-09-14T10:54:17.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.481+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=IX8DWFIWYDRE type=del size=3733130 2024-09-14T10:54:17.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.482+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~I9UVGRMVTZNS.0 size=930328 2024-09-14T10:54:17.484 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.486+0000 7faa01046780 1 < completed multipart upload key=KDUTH9PIR3FI upload=I9UVGRMVTZNS tag=FO1QBU7BVSOW type=write size=1978904 2024-09-14T10:54:17.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.486+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=2DGMFY4QF4W4 type=del size=1490228 2024-09-14T10:54:17.487 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.489+0000 7faa01046780 1 < completed delete operation key=U8TE0XNK9YKM tag=OXMJFMR27I2Z type=del 2024-09-14T10:54:17.489 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.490+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~ZNYNMCK6B6QG.0 size=1048576 2024-09-14T10:54:17.490 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.491+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~ZNYNMCK6B6QG.1 size=1048576 2024-09-14T10:54:17.491 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.493+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~ZNYNMCK6B6QG.2 size=426528 2024-09-14T10:54:17.491 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.493+0000 7faa01046780 1 > prepared multipart upload key=PBRZNGSOLJ8E upload=ZNYNMCK6B6QG tag=DJN2M2LBKGY2 type=write size=3572256 2024-09-14T10:54:17.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.495+0000 7faa01046780 -1 < failed to complete operation key=PS2QU1UZUYHE tag=6HX1S82NUGBE type=del size=953341: (22) Invalid argument 2024-09-14T10:54:17.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.495+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=D2W1Q1R9ZOUF type=write size=934685 2024-09-14T10:54:17.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.496+0000 7faa01046780 1 < canceled operation key=HYAGNAOWK8LF tag=OVNYD9DS9RML type=del size=1777415 2024-09-14T10:54:17.498 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.500+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~DFUEDJWHTRQM.0 size=185893 2024-09-14T10:54:17.498 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.500+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=DFUEDJWHTRQM tag=H8Z7DXP3MOSO type=write size=1234469 2024-09-14T10:54:17.499 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.502+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~CNGBPTEK04JM.0 size=615408 2024-09-14T10:54:17.501 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.503+0000 7faa01046780 1 < completed multipart upload key=LF41PL7DFSJI upload=CNGBPTEK04JM tag=BN8LCYL35Y1I type=write size=1663984 2024-09-14T10:54:17.504 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.506+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~6TD6DJ8R8NRK.0 size=31179 2024-09-14T10:54:17.504 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.506+0000 7faa01046780 1 > prepared multipart upload key=SJ02N8472YDM upload=6TD6DJ8R8NRK tag=58UFB4LK9PSK type=write size=1079755 2024-09-14T10:54:17.505 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.506+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~YF4SHZJZI6OC.0 size=1048576 2024-09-14T10:54:17.506 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.507+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~YF4SHZJZI6OC.1 size=1048576 2024-09-14T10:54:17.507 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.510+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~YF4SHZJZI6OC.2 size=748550 2024-09-14T10:54:17.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.512+0000 7faa01046780 1 < completed multipart upload key=SJ02N8472YDM upload=YF4SHZJZI6OC tag=L9UZYN0343AT type=write size=3894278 2024-09-14T10:54:17.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.512+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=A2Z52SKKWXX3 type=write size=237509 2024-09-14T10:54:17.512 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.513+0000 7faa01046780 1 < completed write operation key=V5T3AN9D7DH6 tag=KEIX13ZIOH75 type=write size=687495 2024-09-14T10:54:17.514 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.516+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=QR1250QRO1MZ type=del size=3774498 2024-09-14T10:54:17.515 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.516+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~GV1B0DEM1OCW.0 size=1048576 2024-09-14T10:54:17.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.517+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~GV1B0DEM1OCW.1 size=347813 2024-09-14T10:54:17.518 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.519+0000 7faa01046780 1 < completed multipart upload key=Y4CB0HIN0750 upload=GV1B0DEM1OCW tag=GUXOBGT042C8 type=write size=2444965 2024-09-14T10:54:17.521 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.523+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~5RUF38BAK3TC.0 size=1048576 2024-09-14T10:54:17.522 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.523+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~5RUF38BAK3TC.1 size=914573 2024-09-14T10:54:17.522 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.523+0000 7faa01046780 1 > prepared multipart upload key=ZY0BY3G9NREC upload=5RUF38BAK3TC tag=8ET1BLU91FEU type=write size=3011725 2024-09-14T10:54:17.523 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.526+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=3HLJXHBOXZBR type=del 2024-09-14T10:54:17.525 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.526+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=K0J1KNDB76E9 type=del size=3790212 2024-09-14T10:54:17.527 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.529+0000 7faa01046780 1 < canceled operation key=BBDTPL35W4W0 tag=4V1MFGD2M1GR type=del size=2903728 2024-09-14T10:54:17.528 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.530+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=3FDX1INF2BLC type=write size=1038393 2024-09-14T10:54:17.529 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.531+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~MYD2SGAMNHS3.0 size=745043 2024-09-14T10:54:17.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.534+0000 7faa01046780 1 < completed multipart upload key=S3BGVJ9N9S4P upload=MYD2SGAMNHS3 tag=8NX8JCHYAYP7 type=write size=1793619 2024-09-14T10:54:17.534 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.535+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~AVZF1NR4E5G6.0 size=484889 2024-09-14T10:54:17.534 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.535+0000 7faa01046780 1 > prepared multipart upload key=V11YJWHT4OOD upload=AVZF1NR4E5G6 tag=411YNLDI7OK1 type=write size=1533465 2024-09-14T10:54:17.536 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.537+0000 7faa01046780 1 < completed write operation key=0OL3SF5IWDMH tag=UGF0J5102DC1 type=write size=224290 2024-09-14T10:54:17.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.538+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=SA2BN6P85JP0 type=del size=3859734 2024-09-14T10:54:17.539 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.541+0000 7faa01046780 1 < suggested update operation key=SJ02N8472YDM tag=5G3V0D02JK7L type=write size=1000914 2024-09-14T10:54:17.542 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.544+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~EWV2MG2I30PE.0 size=1048576 2024-09-14T10:54:17.543 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.545+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~EWV2MG2I30PE.1 size=488147 2024-09-14T10:54:17.543 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.545+0000 7faa01046780 1 > prepared multipart upload key=LF41PL7DFSJI upload=EWV2MG2I30PE tag=EPGLV9BH3TIE type=write size=2585299 2024-09-14T10:54:17.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.545+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=4WI44P0AYJ6D type=del 2024-09-14T10:54:17.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.547+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=V9P5032GY3T0 type=del size=4045098 2024-09-14T10:54:17.547 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.549+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~MGU3012NIU1E.0 size=1048576 2024-09-14T10:54:17.548 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.549+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~MGU3012NIU1E.1 size=1048576 2024-09-14T10:54:17.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.551+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~MGU3012NIU1E.2 size=576055 2024-09-14T10:54:17.551 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.553+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=MGU3012NIU1E tag=QQ0NL5QG93W9 type=write size=3721783 2024-09-14T10:54:17.553 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.555+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=W93DNNVQU0TK type=del size=3373744 2024-09-14T10:54:17.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.555+0000 7faa01046780 1 < completed delete operation key=0XVVSUIOBQPL tag=IX8DWFIWYDRE type=del 2024-09-14T10:54:17.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.557+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=Y1GB1QME2RI5 type=write size=344585 2024-09-14T10:54:17.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.558+0000 7faa01046780 1 < canceled operation key=V11YJWHT4OOD tag=2DGMFY4QF4W4 type=del size=1490228 2024-09-14T10:54:17.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.560+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=LE5NW7WAR4WP type=del size=3848256 2024-09-14T10:54:17.560 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.562+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~ZNYNMCK6B6QG.0 size=1048576 2024-09-14T10:54:17.560 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.562+0000 7faa01046780 1 < canceled part key=_multipart_PBRZNGSOLJ8E.2~ZNYNMCK6B6QG.1 size=1048576 2024-09-14T10:54:17.561 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.563+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~ZNYNMCK6B6QG.2 size=426528 2024-09-14T10:54:17.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.564+0000 7faa01046780 1 < canceled multipart upload key=PBRZNGSOLJ8E upload=ZNYNMCK6B6QG tag=DJN2M2LBKGY2 type=write size=3572256 2024-09-14T10:54:17.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.567+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~92MG48TSW7V5.0 size=1048576 2024-09-14T10:54:17.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.569+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~92MG48TSW7V5.1 size=528124 2024-09-14T10:54:17.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.569+0000 7faa01046780 1 > prepared multipart upload key=PBRZNGSOLJ8E upload=92MG48TSW7V5 tag=ALZUQ7SG5SVP type=write size=2625276 2024-09-14T10:54:17.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.570+0000 7faa01046780 1 < suggested update operation key=U8TE0XNK9YKM tag=D2W1Q1R9ZOUF type=write size=934685 2024-09-14T10:54:17.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.572+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=W7KW55H0SOQS type=del size=3731359 2024-09-14T10:54:17.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.574+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~DFUEDJWHTRQM.0 size=185893 2024-09-14T10:54:17.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.575+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=DFUEDJWHTRQM tag=H8Z7DXP3MOSO type=write size=1234469 2024-09-14T10:54:17.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.578+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=CNVLZ16CQAQX type=del size=1577770 2024-09-14T10:54:17.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.578+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~6TD6DJ8R8NRK.0 size=31179 2024-09-14T10:54:17.579 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.580+0000 7faa01046780 1 < completed multipart upload key=SJ02N8472YDM upload=6TD6DJ8R8NRK tag=58UFB4LK9PSK type=write size=1079755 2024-09-14T10:54:17.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.582+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=W4LIS5JNYTSI type=del size=1367282 2024-09-14T10:54:17.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.585+0000 7faa01046780 1 < suggested update operation key=HUBZAFMSCCNC tag=A2Z52SKKWXX3 type=write size=237509 2024-09-14T10:54:17.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.585+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=F692ITGWX7AW type=del size=3072749 2024-09-14T10:54:17.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.588+0000 7faa01046780 1 < completed delete operation key=X9DUVQBBLUTF tag=QR1250QRO1MZ type=del 2024-09-14T10:54:17.587 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.588+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=97GKLZ4G1MWF type=del size=3081431 2024-09-14T10:54:17.588 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.589+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~5RUF38BAK3TC.0 size=1048576 2024-09-14T10:54:17.588 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.589+0000 7faa01046780 1 < canceled part key=_multipart_ZY0BY3G9NREC.2~5RUF38BAK3TC.1 size=914573 2024-09-14T10:54:17.591 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.594+0000 7faa01046780 1 < canceled multipart upload key=ZY0BY3G9NREC upload=5RUF38BAK3TC tag=8ET1BLU91FEU type=write size=3011725 2024-09-14T10:54:17.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.594+0000 7faa01046780 1 > prepared operation key=SJ02N8472YDM tag=WIJZRHKK1OVN type=del size=2811960 2024-09-14T10:54:17.594 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.595+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=K0J1KNDB76E9 type=del 2024-09-14T10:54:17.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.599+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~ZRXAPIXTY6JV.0 size=1048576 2024-09-14T10:54:17.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.600+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~ZRXAPIXTY6JV.1 size=111055 2024-09-14T10:54:17.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.600+0000 7faa01046780 1 > prepared multipart upload key=VIO703UXIJXV upload=ZRXAPIXTY6JV tag=KKOO9JUGSDQQ type=write size=2208207 2024-09-14T10:54:17.600 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.601+0000 7faa01046780 1 < suggested remove operation key=CKMDOO75UZGE tag=3FDX1INF2BLC type=write 2024-09-14T10:54:17.602 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.604+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~F22CL1YBWFFA.0 size=1048576 2024-09-14T10:54:17.603 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.606+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~F22CL1YBWFFA.1 size=1048576 2024-09-14T10:54:17.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.607+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~F22CL1YBWFFA.2 size=570110 2024-09-14T10:54:17.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.607+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=F22CL1YBWFFA tag=R3WH49JNWF4H type=write size=3715838 2024-09-14T10:54:17.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.607+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~AVZF1NR4E5G6.0 size=484889 2024-09-14T10:54:17.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.610+0000 7faa01046780 1 < completed multipart upload key=V11YJWHT4OOD upload=AVZF1NR4E5G6 tag=411YNLDI7OK1 type=write size=1533465 2024-09-14T10:54:17.610 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.611+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=C4YF92OZPS8O type=del size=2233030 2024-09-14T10:54:17.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.612+0000 7faa01046780 1 < completed delete operation key=Q33ET1AN14NG tag=SA2BN6P85JP0 type=del 2024-09-14T10:54:17.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.616+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~IPGQC4L88ZQN.0 size=1048576 2024-09-14T10:54:17.615 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.617+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~IPGQC4L88ZQN.1 size=1048576 2024-09-14T10:54:17.616 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.618+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~IPGQC4L88ZQN.2 size=368353 2024-09-14T10:54:17.616 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.618+0000 7faa01046780 1 > prepared multipart upload key=X9DUVQBBLUTF upload=IPGQC4L88ZQN tag=RQ0EP4SY67M4 type=write size=3514081 2024-09-14T10:54:17.617 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.618+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~EWV2MG2I30PE.0 size=1048576 2024-09-14T10:54:17.618 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.619+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~EWV2MG2I30PE.1 size=488147 2024-09-14T10:54:17.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.623+0000 7faa01046780 1 < completed multipart upload key=LF41PL7DFSJI upload=EWV2MG2I30PE tag=EPGLV9BH3TIE type=write size=2585299 2024-09-14T10:54:17.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.624+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=AYKA2Q98VF15 type=write size=974980 2024-09-14T10:54:17.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.626+0000 7faa01046780 1 < suggested remove operation key=V905BR1VWUCV tag=V9P5032GY3T0 type=del 2024-09-14T10:54:17.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.629+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~W1C1U1C6RPGV.0 size=1048576 2024-09-14T10:54:17.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.629+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~W1C1U1C6RPGV.1 size=1048576 2024-09-14T10:54:17.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.630+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~W1C1U1C6RPGV.2 size=589486 2024-09-14T10:54:17.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.630+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=W1C1U1C6RPGV tag=2L47YVM519EW type=write size=3735214 2024-09-14T10:54:17.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.633+0000 7faa01046780 1 < suggested update operation key=S3BGVJ9N9S4P tag=W93DNNVQU0TK type=del size=3373744 2024-09-14T10:54:17.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.637+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~S7U7D8I683XA.0 size=1048576 2024-09-14T10:54:17.636 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.638+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~S7U7D8I683XA.1 size=205353 2024-09-14T10:54:17.636 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.638+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=S7U7D8I683XA tag=SMK3MGES6TN5 type=write size=2302505 2024-09-14T10:54:17.637 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.640+0000 7faa01046780 1 < completed write operation key=Y4CB0HIN0750 tag=Y1GB1QME2RI5 type=write size=344585 2024-09-14T10:54:17.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.641+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=9ZY41HCTCN04 type=del size=1894986 2024-09-14T10:54:17.640 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.641+0000 7faa01046780 1 < completed delete operation key=PTDE6D7OIU1A tag=LE5NW7WAR4WP type=del 2024-09-14T10:54:17.641 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.644+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=WNYPJCH8WCIR type=del size=2627515 2024-09-14T10:54:17.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.644+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~92MG48TSW7V5.0 size=1048576 2024-09-14T10:54:17.644 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.646+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~92MG48TSW7V5.1 size=528124 2024-09-14T10:54:17.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.647+0000 7faa01046780 1 < completed multipart upload key=PBRZNGSOLJ8E upload=92MG48TSW7V5 tag=ALZUQ7SG5SVP type=write size=2625276 2024-09-14T10:54:17.648 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.650+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=589ENPXXAP6Y type=del size=2262496 2024-09-14T10:54:17.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.651+0000 7faa01046780 1 < completed delete operation key=PBRZNGSOLJ8E tag=W7KW55H0SOQS type=del 2024-09-14T10:54:17.651 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.653+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~ZTFI13UA03O1.0 size=1048576 2024-09-14T10:54:17.652 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.654+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~ZTFI13UA03O1.1 size=1048576 2024-09-14T10:54:17.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.656+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~ZTFI13UA03O1.2 size=269515 2024-09-14T10:54:17.654 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.656+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=ZTFI13UA03O1 tag=61A9LPQLVYY9 type=write size=3415243 2024-09-14T10:54:17.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.657+0000 7faa01046780 1 < completed delete operation key=HYAGNAOWK8LF tag=CNVLZ16CQAQX type=del 2024-09-14T10:54:17.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.658+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~39EQVTBZ7ZQC.0 size=1048576 2024-09-14T10:54:17.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.660+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~39EQVTBZ7ZQC.1 size=1048576 2024-09-14T10:54:17.659 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.662+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~39EQVTBZ7ZQC.2 size=38471 2024-09-14T10:54:17.659 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.662+0000 7faa01046780 1 > prepared multipart upload key=LF41PL7DFSJI upload=39EQVTBZ7ZQC tag=R1ZXJ9MP6VD8 type=write size=3184199 2024-09-14T10:54:17.661 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.663+0000 7faa01046780 1 < completed delete operation key=XH8GHY9YRGTP tag=W4LIS5JNYTSI type=del 2024-09-14T10:54:17.662 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.663+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=5V4CGBCWGSHK type=del size=3367760 2024-09-14T10:54:17.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.666+0000 7faa01046780 1 < completed delete operation key=F872GLVQDCX6 tag=F692ITGWX7AW type=del 2024-09-14T10:54:17.666 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.667+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~EZUK8RD03CUV.0 size=1018422 2024-09-14T10:54:17.666 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.667+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=EZUK8RD03CUV tag=EQ0F3BCBFOI5 type=write size=2066998 2024-09-14T10:54:17.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.669+0000 7faa01046780 1 < completed delete operation key=GG02P21TFKIM tag=97GKLZ4G1MWF type=del 2024-09-14T10:54:17.669 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.670+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=LO3ZBHZHW2WR type=write size=868574 2024-09-14T10:54:17.670 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.671+0000 7faa01046780 1 < completed delete operation key=SJ02N8472YDM tag=WIJZRHKK1OVN type=del 2024-09-14T10:54:17.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.675+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~4B8O8OE0TIE6.0 size=1048576 2024-09-14T10:54:17.674 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.676+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~4B8O8OE0TIE6.1 size=1048576 2024-09-14T10:54:17.675 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.677+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~4B8O8OE0TIE6.2 size=643738 2024-09-14T10:54:17.675 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.677+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=4B8O8OE0TIE6 tag=QJX7MGAD0VUW type=write size=3789466 2024-09-14T10:54:17.676 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.677+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~ZRXAPIXTY6JV.0 size=1048576 2024-09-14T10:54:17.677 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.679+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~ZRXAPIXTY6JV.1 size=111055 2024-09-14T10:54:17.680 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.682+0000 7faa01046780 1 < completed multipart upload key=VIO703UXIJXV upload=ZRXAPIXTY6JV tag=KKOO9JUGSDQQ type=write size=2208207 2024-09-14T10:54:17.681 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.682+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=HDRIULWU6X76 type=del size=71065 2024-09-14T10:54:17.682 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.684+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~F22CL1YBWFFA.0 size=1048576 2024-09-14T10:54:17.684 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.686+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~F22CL1YBWFFA.1 size=1048576 2024-09-14T10:54:17.685 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.687+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~F22CL1YBWFFA.2 size=570110 2024-09-14T10:54:17.687 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.689+0000 7faa01046780 1 < completed multipart upload key=0XVVSUIOBQPL upload=F22CL1YBWFFA tag=R3WH49JNWF4H type=write size=3715838 2024-09-14T10:54:17.689 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.691+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=SGT8HPYDQFLK type=del size=3778110 2024-09-14T10:54:17.690 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.691+0000 7faa01046780 1 < completed delete operation key=3UEX0IPM4CPY tag=C4YF92OZPS8O type=del 2024-09-14T10:54:17.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.695+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~PDIXSXL9S5TF.0 size=1048576 2024-09-14T10:54:17.694 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.695+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~PDIXSXL9S5TF.1 size=984836 2024-09-14T10:54:17.694 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.695+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=PDIXSXL9S5TF tag=KO8BZCASXCP2 type=write size=3081988 2024-09-14T10:54:17.695 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.698+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~IPGQC4L88ZQN.0 size=1048576 2024-09-14T10:54:17.697 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.698+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~IPGQC4L88ZQN.1 size=1048576 2024-09-14T10:54:17.698 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.699+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~IPGQC4L88ZQN.2 size=368353 2024-09-14T10:54:17.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.702+0000 7faa01046780 1 < completed multipart upload key=X9DUVQBBLUTF upload=IPGQC4L88ZQN tag=RQ0EP4SY67M4 type=write size=3514081 2024-09-14T10:54:17.702 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.704+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=8CT0WXW1D3JU type=del size=3240891 2024-09-14T10:54:17.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.706+0000 7faa01046780 1 < suggested remove operation key=NXIPG4HR9ZYY tag=AYKA2Q98VF15 type=write 2024-09-14T10:54:17.706 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.708+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=CQEBUUGWCALY type=write size=639625 2024-09-14T10:54:17.706 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.708+0000 7faa01046780 1 < canceled part key=_multipart_Y4CB0HIN0750.2~W1C1U1C6RPGV.0 size=1048576 2024-09-14T10:54:17.707 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.708+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~W1C1U1C6RPGV.1 size=1048576 2024-09-14T10:54:17.708 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.709+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~W1C1U1C6RPGV.2 size=589486 2024-09-14T10:54:17.710 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.713+0000 7faa01046780 1 < canceled multipart upload key=Y4CB0HIN0750 upload=W1C1U1C6RPGV tag=2L47YVM519EW type=write size=3735214 2024-09-14T10:54:17.712 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.714+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=3FRULPUDFV4W type=del size=2063371 2024-09-14T10:54:17.713 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.715+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~S7U7D8I683XA.0 size=1048576 2024-09-14T10:54:17.715 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.717+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~S7U7D8I683XA.1 size=205353 2024-09-14T10:54:17.718 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.720+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=S7U7D8I683XA tag=SMK3MGES6TN5 type=write size=2302505 2024-09-14T10:54:17.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.721+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=LQ4CBAESP05V type=del size=3230337 2024-09-14T10:54:17.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.722+0000 7faa01046780 1 < canceled operation key=3UEX0IPM4CPY tag=9ZY41HCTCN04 type=del size=1894986 2024-09-14T10:54:17.722 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.724+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=PVZXOXD9N9VC type=del size=468383 2024-09-14T10:54:17.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.726+0000 7faa01046780 1 < suggested update operation key=U8TE0XNK9YKM tag=WNYPJCH8WCIR type=del size=2627515 2024-09-14T10:54:17.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.729+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=502PZKZ9YMU4 type=del size=1393048 2024-09-14T10:54:17.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.731+0000 7faa01046780 1 < suggested update operation key=F06QWEOYNQX4 tag=589ENPXXAP6Y type=del size=2262496 2024-09-14T10:54:17.731 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.733+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=YKVI40SHWTK3 type=del size=3861675 2024-09-14T10:54:17.732 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.734+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~ZTFI13UA03O1.0 size=1048576 2024-09-14T10:54:17.733 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.734+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~ZTFI13UA03O1.1 size=1048576 2024-09-14T10:54:17.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.735+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~ZTFI13UA03O1.2 size=269515 2024-09-14T10:54:17.736 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.738+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=ZTFI13UA03O1 tag=61A9LPQLVYY9 type=write size=3415243 2024-09-14T10:54:17.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.739+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=VMRESHH2QLBB type=del size=1932288 2024-09-14T10:54:17.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.742+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~39EQVTBZ7ZQC.0 size=1048576 2024-09-14T10:54:17.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.743+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~39EQVTBZ7ZQC.1 size=1048576 2024-09-14T10:54:17.742 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.744+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~39EQVTBZ7ZQC.2 size=38471 2024-09-14T10:54:17.744 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.747+0000 7faa01046780 1 < completed multipart upload key=LF41PL7DFSJI upload=39EQVTBZ7ZQC tag=R1ZXJ9MP6VD8 type=write size=3184199 2024-09-14T10:54:17.746 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.748+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=ZFPFFDW63JFD type=del size=4013429 2024-09-14T10:54:17.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.750+0000 7faa01046780 1 < completed delete operation key=PTDE6D7OIU1A tag=5V4CGBCWGSHK type=del 2024-09-14T10:54:17.749 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.751+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=29J62HUUCDDR type=write size=410807 2024-09-14T10:54:17.751 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.752+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~EZUK8RD03CUV.0 size=1018422 2024-09-14T10:54:17.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.754+0000 7faa01046780 1 < completed multipart upload key=XDJAK0XYQNF0 upload=EZUK8RD03CUV tag=EQ0F3BCBFOI5 type=write size=2066998 2024-09-14T10:54:17.754 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.755+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=SJMDY8971ICS type=del size=3736287 2024-09-14T10:54:17.755 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.757+0000 7faa01046780 -1 < failed to complete operation key=U8TE0XNK9YKM tag=LO3ZBHZHW2WR type=write size=868574: (22) Invalid argument 2024-09-14T10:54:17.757 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.759+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=0UA77S2HW85T type=write size=638428 2024-09-14T10:54:17.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.759+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~4B8O8OE0TIE6.0 size=1048576 2024-09-14T10:54:17.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.761+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~4B8O8OE0TIE6.1 size=1048576 2024-09-14T10:54:17.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.763+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~4B8O8OE0TIE6.2 size=643738 2024-09-14T10:54:17.763 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.765+0000 7faa01046780 1 < completed multipart upload key=KDUTH9PIR3FI upload=4B8O8OE0TIE6 tag=QJX7MGAD0VUW type=write size=3789466 2024-09-14T10:54:17.765 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.767+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~JWQLYJNYEHRO.0 size=473908 2024-09-14T10:54:17.765 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.767+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=JWQLYJNYEHRO tag=TTS23Z0KPZFY type=write size=1522484 2024-09-14T10:54:17.767 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.769+0000 7faa01046780 1 < completed delete operation key=0OL3SF5IWDMH tag=HDRIULWU6X76 type=del 2024-09-14T10:54:17.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.770+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=EBQ2LG7R558S type=del size=649965 2024-09-14T10:54:17.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.772+0000 7faa01046780 1 < completed delete operation key=V905BR1VWUCV tag=SGT8HPYDQFLK type=del 2024-09-14T10:54:17.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.773+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=VI6F829FVIM7 type=del size=3915026 2024-09-14T10:54:17.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.774+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~PDIXSXL9S5TF.0 size=1048576 2024-09-14T10:54:17.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.776+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~PDIXSXL9S5TF.1 size=984836 2024-09-14T10:54:17.777 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.779+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=PDIXSXL9S5TF tag=KO8BZCASXCP2 type=write size=3081988 2024-09-14T10:54:17.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.781+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~R6T48Q8IJGLM.0 size=1048576 2024-09-14T10:54:17.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.782+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~R6T48Q8IJGLM.1 size=1048576 2024-09-14T10:54:17.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.783+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~R6T48Q8IJGLM.2 size=311792 2024-09-14T10:54:17.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.783+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=R6T48Q8IJGLM tag=LXWHKFL2D9CZ type=write size=3457520 2024-09-14T10:54:17.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.785+0000 7faa01046780 1 < completed delete operation key=PS2QU1UZUYHE tag=8CT0WXW1D3JU type=del 2024-09-14T10:54:17.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.786+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~IQQXBFC3JE6L.0 size=1048576 2024-09-14T10:54:17.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.787+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~IQQXBFC3JE6L.1 size=1048576 2024-09-14T10:54:17.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.788+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~IQQXBFC3JE6L.2 size=220202 2024-09-14T10:54:17.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.788+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=IQQXBFC3JE6L tag=QBDA3RZ2PUVQ type=write size=3365930 2024-09-14T10:54:17.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.791+0000 7faa01046780 1 < suggested remove operation key=3UEX0IPM4CPY tag=CQEBUUGWCALY type=write 2024-09-14T10:54:17.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.793+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=FNYIWET10PUQ type=del size=2723132 2024-09-14T10:54:17.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.795+0000 7faa01046780 1 < completed delete operation key=Q33ET1AN14NG tag=3FRULPUDFV4W type=del 2024-09-14T10:54:17.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.796+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~E3ZRJ4QXK42F.0 size=167656 2024-09-14T10:54:17.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.796+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=E3ZRJ4QXK42F tag=Y5KELD1WA3ZJ type=write size=1216232 2024-09-14T10:54:17.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.797+0000 7faa01046780 1 < canceled operation key=TDNQZ8Y1C6X2 tag=LQ4CBAESP05V type=del size=3230337 2024-09-14T10:54:17.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.800+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=054KMH32TCNM type=del size=1231536 2024-09-14T10:54:17.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.801+0000 7faa01046780 1 < suggested remove operation key=V11YJWHT4OOD tag=PVZXOXD9N9VC type=del 2024-09-14T10:54:17.802 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.804+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=S04C7KH1X4TQ type=write size=393634 2024-09-14T10:54:17.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.805+0000 7faa01046780 1 < suggested remove operation key=GG02P21TFKIM tag=502PZKZ9YMU4 type=del 2024-09-14T10:54:17.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.808+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=48ZY2PJ2SK95 type=del size=4178560 2024-09-14T10:54:17.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.811+0000 7faa01046780 1 < suggested remove operation key=XDJAK0XYQNF0 tag=YKVI40SHWTK3 type=del 2024-09-14T10:54:17.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.811+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=3O8DZMKMTAGZ type=del size=1688847 2024-09-14T10:54:17.813 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.815+0000 7faa01046780 1 < suggested update operation key=X9DUVQBBLUTF tag=VMRESHH2QLBB type=del size=1932288 2024-09-14T10:54:17.814 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.815+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=33IOLN6MC17N type=del size=1336652 2024-09-14T10:54:17.815 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.817+0000 7faa01046780 1 < completed delete operation key=BBDTPL35W4W0 tag=ZFPFFDW63JFD type=del 2024-09-14T10:54:17.817 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.819+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=DKJIHJZ48D2V type=del size=3299000 2024-09-14T10:54:17.818 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.820+0000 7faa01046780 1 < completed write operation key=Y4CB0HIN0750 tag=29J62HUUCDDR type=write size=410807 2024-09-14T10:54:17.821 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.823+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~RFTI9AJ9FC4I.0 size=672622 2024-09-14T10:54:17.821 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.823+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=RFTI9AJ9FC4I tag=2L6L4F9FITHD type=write size=1721198 2024-09-14T10:54:17.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.823+0000 7faa01046780 -1 < failed to complete operation key=X9DUVQBBLUTF tag=SJMDY8971ICS type=del size=3736287: (22) Invalid argument 2024-09-14T10:54:17.824 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.826+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=V7TJE15DT301 type=del size=3745502 2024-09-14T10:54:17.826 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.828+0000 7faa01046780 1 < suggested remove operation key=VIO703UXIJXV tag=0UA77S2HW85T type=write 2024-09-14T10:54:17.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.830+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=5GLO6R2L1M8Q type=write size=881034 2024-09-14T10:54:17.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.830+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~JWQLYJNYEHRO.0 size=473908 2024-09-14T10:54:17.831 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.833+0000 7faa01046780 1 < completed multipart upload key=HYAGNAOWK8LF upload=JWQLYJNYEHRO tag=TTS23Z0KPZFY type=write size=1522484 2024-09-14T10:54:17.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.834+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=ZDFYB0MHSNK0 type=del size=854111 2024-09-14T10:54:17.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.836+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=EBQ2LG7R558S type=del 2024-09-14T10:54:17.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.837+0000 7faa01046780 1 > prepared operation key=SJ02N8472YDM tag=45BTSK5SGNNL type=del size=2928200 2024-09-14T10:54:17.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.839+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=VI6F829FVIM7 type=del 2024-09-14T10:54:17.839 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.841+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=N0GJOAOEDCMW type=del size=3332034 2024-09-14T10:54:17.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.841+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~R6T48Q8IJGLM.0 size=1048576 2024-09-14T10:54:17.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.842+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~R6T48Q8IJGLM.1 size=1048576 2024-09-14T10:54:17.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.844+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~R6T48Q8IJGLM.2 size=311792 2024-09-14T10:54:17.844 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.845+0000 7faa01046780 1 < completed multipart upload key=Y4CB0HIN0750 upload=R6T48Q8IJGLM tag=LXWHKFL2D9CZ type=write size=3457520 2024-09-14T10:54:17.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.848+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~0O2TZMIV6U1Q.0 size=1048576 2024-09-14T10:54:17.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.851+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~0O2TZMIV6U1Q.1 size=830810 2024-09-14T10:54:17.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.851+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=0O2TZMIV6U1Q tag=95GUADYMINHE type=write size=2927962 2024-09-14T10:54:17.850 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.852+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~IQQXBFC3JE6L.0 size=1048576 2024-09-14T10:54:17.851 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.852+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~IQQXBFC3JE6L.1 size=1048576 2024-09-14T10:54:17.852 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.853+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~IQQXBFC3JE6L.2 size=220202 2024-09-14T10:54:17.854 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.856+0000 7faa01046780 1 < completed multipart upload key=U8TE0XNK9YKM upload=IQQXBFC3JE6L tag=QBDA3RZ2PUVQ type=write size=3365930 2024-09-14T10:54:17.856 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.857+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=QUNUWVA8J05E type=write size=883888 2024-09-14T10:54:17.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.859+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=FNYIWET10PUQ type=del 2024-09-14T10:54:17.859 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.861+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=GCF150XVFNVI type=del size=3120120 2024-09-14T10:54:17.860 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.861+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~E3ZRJ4QXK42F.0 size=167656 2024-09-14T10:54:17.862 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.864+0000 7faa01046780 1 < completed multipart upload key=HYAGNAOWK8LF upload=E3ZRJ4QXK42F tag=Y5KELD1WA3ZJ type=write size=1216232 2024-09-14T10:54:17.865 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.867+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~U7OQ1SAWMDX6.0 size=193826 2024-09-14T10:54:17.865 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.867+0000 7faa01046780 1 > prepared multipart upload key=3UEX0IPM4CPY upload=U7OQ1SAWMDX6 tag=HGPXLHD140Q4 type=write size=1242402 2024-09-14T10:54:17.866 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.867+0000 7faa01046780 -1 < failed to complete operation key=X9DUVQBBLUTF tag=054KMH32TCNM type=del size=1231536: (22) Invalid argument 2024-09-14T10:54:17.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.871+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~SRD5FL8FN44J.0 size=1048576 2024-09-14T10:54:17.870 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.871+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~SRD5FL8FN44J.1 size=857517 2024-09-14T10:54:17.870 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.871+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=SRD5FL8FN44J tag=FQJO364E2AHW type=write size=2954669 2024-09-14T10:54:17.871 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.872+0000 7faa01046780 1 < completed write operation key=TDNQZ8Y1C6X2 tag=S04C7KH1X4TQ type=write size=393634 2024-09-14T10:54:17.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.875+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~J4M4E733NXXH.0 size=665630 2024-09-14T10:54:17.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.875+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=J4M4E733NXXH tag=8J714SCJEULS type=write size=1714206 2024-09-14T10:54:17.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.877+0000 7faa01046780 1 < completed delete operation key=KDUTH9PIR3FI tag=48ZY2PJ2SK95 type=del 2024-09-14T10:54:17.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.880+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~YT31K3I4OE2W.0 size=1048576 2024-09-14T10:54:17.879 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.881+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~YT31K3I4OE2W.1 size=1048576 2024-09-14T10:54:17.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.882+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~YT31K3I4OE2W.2 size=738535 2024-09-14T10:54:17.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.882+0000 7faa01046780 1 > prepared multipart upload key=3UEX0IPM4CPY upload=YT31K3I4OE2W tag=LBBUUBSE244X type=write size=3884263 2024-09-14T10:54:17.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.884+0000 7faa01046780 1 < suggested remove operation key=FOJGGEQZD7YW tag=3O8DZMKMTAGZ type=del 2024-09-14T10:54:17.884 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.885+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=2B37QKSS5N0A type=del size=3445030 2024-09-14T10:54:17.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.886+0000 7faa01046780 1 < completed delete operation key=V11YJWHT4OOD tag=33IOLN6MC17N type=del 2024-09-14T10:54:17.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.888+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=WYT5MEMDSBBJ type=del size=2983287 2024-09-14T10:54:17.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.889+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=DKJIHJZ48D2V type=del 2024-09-14T10:54:17.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.891+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=BN69FE7FDXUP type=del size=2644050 2024-09-14T10:54:17.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.892+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~RFTI9AJ9FC4I.0 size=672622 2024-09-14T10:54:17.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.895+0000 7faa01046780 1 < completed multipart upload key=Y4CB0HIN0750 upload=RFTI9AJ9FC4I tag=2L6L4F9FITHD type=write size=1721198 2024-09-14T10:54:17.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.896+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~43F3JOJYINWX.0 size=1048576 2024-09-14T10:54:17.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.897+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~43F3JOJYINWX.1 size=1048576 2024-09-14T10:54:17.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.898+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~43F3JOJYINWX.2 size=438726 2024-09-14T10:54:17.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.898+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=43F3JOJYINWX tag=WNXFGAP9FTO3 type=write size=3584454 2024-09-14T10:54:17.900 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.902+0000 7faa01046780 1 < suggested remove operation key=Q33ET1AN14NG tag=V7TJE15DT301 type=del 2024-09-14T10:54:17.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.905+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~3ZK84VDY0WAY.0 size=624808 2024-09-14T10:54:17.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.905+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=3ZK84VDY0WAY tag=5R3HSFJ39R65 type=write size=1673384 2024-09-14T10:54:17.904 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.906+0000 7faa01046780 1 < completed write operation key=XDJAK0XYQNF0 tag=5GLO6R2L1M8Q type=write size=881034 2024-09-14T10:54:17.905 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.906+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=TE58949MCXE0 type=del size=2997361 2024-09-14T10:54:17.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.910+0000 7faa01046780 1 < suggested remove operation key=HUBZAFMSCCNC tag=ZDFYB0MHSNK0 type=del 2024-09-14T10:54:17.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.910+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=XL1JDUTF4HS8 type=del size=3605796 2024-09-14T10:54:17.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.913+0000 7faa01046780 1 < completed delete operation key=SJ02N8472YDM tag=45BTSK5SGNNL type=del 2024-09-14T10:54:17.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.913+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=PQK4MO6OI98L type=del size=2465826 2024-09-14T10:54:17.914 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.916+0000 7faa01046780 1 < completed delete operation key=V905BR1VWUCV tag=N0GJOAOEDCMW type=del 2024-09-14T10:54:17.915 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.916+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=JIEEV8AG9WPE type=del size=2590269 2024-09-14T10:54:17.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.919+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~0O2TZMIV6U1Q.0 size=1048576 2024-09-14T10:54:17.918 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.920+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~0O2TZMIV6U1Q.1 size=830810 2024-09-14T10:54:17.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.923+0000 7faa01046780 1 < completed multipart upload key=XDJAK0XYQNF0 upload=0O2TZMIV6U1Q tag=95GUADYMINHE type=write size=2927962 2024-09-14T10:54:17.922 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.923+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=LFQT0SFIFJ0X type=del size=3544684 2024-09-14T10:54:17.923 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.924+0000 7faa01046780 -1 < no bi entry to suggest for operation key=HUBZAFMSCCNC tag=QUNUWVA8J05E type=write size=883888: (2) No such file or directory 2024-09-14T10:54:17.926 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.928+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~QT2NJY85AHMG.0 size=1048576 2024-09-14T10:54:17.927 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.929+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~QT2NJY85AHMG.1 size=409400 2024-09-14T10:54:17.927 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.929+0000 7faa01046780 1 > prepared multipart upload key=X9DUVQBBLUTF upload=QT2NJY85AHMG tag=RY4J0725ON54 type=write size=2506552 2024-09-14T10:54:17.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.931+0000 7faa01046780 1 < completed delete operation key=F872GLVQDCX6 tag=GCF150XVFNVI type=del 2024-09-14T10:54:17.930 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.932+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=7UEDAHO0PL97 type=del size=3950606 2024-09-14T10:54:17.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.934+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~U7OQ1SAWMDX6.0 size=193826 2024-09-14T10:54:17.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.936+0000 7faa01046780 1 < completed multipart upload key=3UEX0IPM4CPY upload=U7OQ1SAWMDX6 tag=HGPXLHD140Q4 type=write size=1242402 2024-09-14T10:54:17.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.937+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=KP2XO1VE2ZI0 type=del size=4000929 2024-09-14T10:54:17.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.938+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~SRD5FL8FN44J.0 size=1048576 2024-09-14T10:54:17.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.940+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~SRD5FL8FN44J.1 size=857517 2024-09-14T10:54:17.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.943+0000 7faa01046780 1 < completed multipart upload key=HUBZAFMSCCNC upload=SRD5FL8FN44J tag=FQJO364E2AHW type=write size=2954669 2024-09-14T10:54:17.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.946+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~NF8747KZXG4T.0 size=937859 2024-09-14T10:54:17.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.946+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=NF8747KZXG4T tag=XA7Z74NHZWI6 type=write size=1986435 2024-09-14T10:54:17.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.947+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~J4M4E733NXXH.0 size=665630 2024-09-14T10:54:17.948 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.950+0000 7faa01046780 1 < completed multipart upload key=HUBZAFMSCCNC upload=J4M4E733NXXH tag=8J714SCJEULS type=write size=1714206 2024-09-14T10:54:17.949 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.950+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=CSQOEMIB6YUI type=del size=54205 2024-09-14T10:54:17.950 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.952+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~YT31K3I4OE2W.0 size=1048576 2024-09-14T10:54:17.952 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.954+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~YT31K3I4OE2W.1 size=1048576 2024-09-14T10:54:17.952 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.954+0000 7faa01046780 1 < canceled part key=_multipart_3UEX0IPM4CPY.2~YT31K3I4OE2W.2 size=738535 2024-09-14T10:54:17.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.956+0000 7faa01046780 1 < canceled multipart upload key=3UEX0IPM4CPY upload=YT31K3I4OE2W tag=LBBUUBSE244X type=write size=3884263 2024-09-14T10:54:17.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.958+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=7KTLAQ2ZM3XN type=write size=785180 2024-09-14T10:54:17.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.961+0000 7faa01046780 1 < suggested update operation key=HUBZAFMSCCNC tag=2B37QKSS5N0A type=del size=3445030 2024-09-14T10:54:17.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.962+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~N7TOL6WK8D2F.0 size=1048576 2024-09-14T10:54:17.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.963+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~N7TOL6WK8D2F.1 size=1048576 2024-09-14T10:54:17.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.965+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~N7TOL6WK8D2F.2 size=638557 2024-09-14T10:54:17.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.965+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=N7TOL6WK8D2F tag=21D1TRU5WVRA type=write size=3784285 2024-09-14T10:54:17.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.966+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=WYT5MEMDSBBJ type=del 2024-09-14T10:54:17.966 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.967+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=O4R6MUZ9CW8E type=del size=432866 2024-09-14T10:54:17.969 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.971+0000 7faa01046780 1 < suggested update operation key=V11YJWHT4OOD tag=BN69FE7FDXUP type=del size=2644050 2024-09-14T10:54:17.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.973+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~XTNJC6BGH1HM.0 size=1048576 2024-09-14T10:54:17.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.975+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~XTNJC6BGH1HM.1 size=668221 2024-09-14T10:54:17.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.975+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=XTNJC6BGH1HM tag=C11CIU9AZ27Z type=write size=2765373 2024-09-14T10:54:17.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.976+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~43F3JOJYINWX.0 size=1048576 2024-09-14T10:54:17.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.978+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~43F3JOJYINWX.1 size=1048576 2024-09-14T10:54:17.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.979+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~43F3JOJYINWX.2 size=438726 2024-09-14T10:54:17.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.981+0000 7faa01046780 1 < completed multipart upload key=Y4CB0HIN0750 upload=43F3JOJYINWX tag=WNXFGAP9FTO3 type=write size=3584454 2024-09-14T10:54:17.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.984+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=U0DGLYQX2NHO type=write size=719805 2024-09-14T10:54:17.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.984+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~3ZK84VDY0WAY.0 size=624808 2024-09-14T10:54:17.985 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.986+0000 7faa01046780 1 < completed multipart upload key=XDJAK0XYQNF0 upload=3ZK84VDY0WAY tag=5R3HSFJ39R65 type=write size=1673384 2024-09-14T10:54:17.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.988+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=8IGQPO6OY6WK type=del size=1319588 2024-09-14T10:54:17.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.989+0000 7faa01046780 -1 < failed to complete operation key=HUBZAFMSCCNC tag=TE58949MCXE0 type=del size=2997361: (22) Invalid argument 2024-09-14T10:54:17.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.991+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=8NI24NL4GZVF type=del size=2922677 2024-09-14T10:54:17.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.992+0000 7faa01046780 1 < completed delete operation key=PTDE6D7OIU1A tag=XL1JDUTF4HS8 type=del 2024-09-14T10:54:17.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.994+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~FU92IUYCHRN2.0 size=718572 2024-09-14T10:54:17.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.994+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=FU92IUYCHRN2 tag=ZLCXBI4L3952 type=write size=1767148 2024-09-14T10:54:17.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.997+0000 7faa01046780 1 < completed delete operation key=ZY0BY3G9NREC tag=PQK4MO6OI98L type=del 2024-09-14T10:54:17.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:17.999+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~UN5UNK6K0OS3.0 size=1048576 2024-09-14T10:54:17.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.000+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~UN5UNK6K0OS3.1 size=1048576 2024-09-14T10:54:17.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.001+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~UN5UNK6K0OS3.2 size=446428 2024-09-14T10:54:17.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.001+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=UN5UNK6K0OS3 tag=SDGWKMQAPB2G type=write size=3592156 2024-09-14T10:54:18.000 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.001+0000 7faa01046780 1 < canceled operation key=V905BR1VWUCV tag=JIEEV8AG9WPE type=del size=2590269 2024-09-14T10:54:18.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.003+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=1COG0VFBY8NM type=del size=950605 2024-09-14T10:54:18.003 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.004+0000 7faa01046780 1 < completed delete operation key=V905BR1VWUCV tag=LFQT0SFIFJ0X type=del 2024-09-14T10:54:18.004 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.005+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=67MO2CZ9Z9T2 type=del size=3050125 2024-09-14T10:54:18.006 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.008+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~QT2NJY85AHMG.0 size=1048576 2024-09-14T10:54:18.007 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.008+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~QT2NJY85AHMG.1 size=409400 2024-09-14T10:54:18.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.010+0000 7faa01046780 1 < completed multipart upload key=X9DUVQBBLUTF upload=QT2NJY85AHMG tag=RY4J0725ON54 type=write size=2506552 2024-09-14T10:54:18.012 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.014+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~5QD0EZOPK3KF.0 size=1048576 2024-09-14T10:54:18.017 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.014+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~5QD0EZOPK3KF.1 size=1048576 2024-09-14T10:54:18.017 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.015+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~5QD0EZOPK3KF.2 size=438372 2024-09-14T10:54:18.017 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.015+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=5QD0EZOPK3KF tag=6L05CWBMGTVQ type=write size=3584100 2024-09-14T10:54:18.018 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.018+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=7UEDAHO0PL97 type=del 2024-09-14T10:54:18.018 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.019+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=J2HXWTIN29TK type=del size=834755 2024-09-14T10:54:18.019 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.020+0000 7faa01046780 1 < completed delete operation key=F872GLVQDCX6 tag=KP2XO1VE2ZI0 type=del 2024-09-14T10:54:18.021 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.022+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~U2ETG0FKSRNN.0 size=1048576 2024-09-14T10:54:18.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.024+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~U2ETG0FKSRNN.1 size=1048576 2024-09-14T10:54:18.023 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.026+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~U2ETG0FKSRNN.2 size=18159 2024-09-14T10:54:18.024 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.026+0000 7faa01046780 1 > prepared multipart upload key=SJ02N8472YDM upload=U2ETG0FKSRNN tag=W47X0UGQK3WQ type=write size=3163887 2024-09-14T10:54:18.025 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.027+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~NF8747KZXG4T.0 size=937859 2024-09-14T10:54:18.027 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.029+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=NF8747KZXG4T tag=XA7Z74NHZWI6 type=write size=1986435 2024-09-14T10:54:18.028 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.030+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=6PJ43MUQ57M9 type=del size=119541 2024-09-14T10:54:18.030 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.032+0000 7faa01046780 1 < canceled operation key=XDJAK0XYQNF0 tag=CSQOEMIB6YUI type=del size=54205 2024-09-14T10:54:18.032 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.033+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~34RNG6OR73E4.0 size=32277 2024-09-14T10:54:18.032 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.033+0000 7faa01046780 1 > prepared multipart upload key=LF41PL7DFSJI upload=34RNG6OR73E4 tag=705Y94U8WS7K type=write size=1080853 2024-09-14T10:54:18.033 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.036+0000 7faa01046780 1 < completed write operation key=0OL3SF5IWDMH tag=7KTLAQ2ZM3XN type=write size=785180 2024-09-14T10:54:18.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.037+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=WUHFNDCCTJ45 type=del size=1414811 2024-09-14T10:54:18.036 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.038+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~N7TOL6WK8D2F.0 size=1048576 2024-09-14T10:54:18.037 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.039+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~N7TOL6WK8D2F.1 size=1048576 2024-09-14T10:54:18.038 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.041+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~N7TOL6WK8D2F.2 size=638557 2024-09-14T10:54:18.041 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.043+0000 7faa01046780 1 < completed multipart upload key=XDJAK0XYQNF0 upload=N7TOL6WK8D2F tag=21D1TRU5WVRA type=write size=3784285 2024-09-14T10:54:18.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.043+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=WPGLC0RMOUVO type=del size=4016838 2024-09-14T10:54:18.043 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.045+0000 7faa01046780 1 < completed delete operation key=NXIPG4HR9ZYY tag=O4R6MUZ9CW8E type=del 2024-09-14T10:54:18.046 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.048+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~9YSHCN9U7JCB.0 size=1048576 2024-09-14T10:54:18.047 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.049+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~9YSHCN9U7JCB.1 size=32882 2024-09-14T10:54:18.047 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.049+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=9YSHCN9U7JCB tag=MN30470WQ10L type=write size=2130034 2024-09-14T10:54:18.049 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.051+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~XTNJC6BGH1HM.0 size=1048576 2024-09-14T10:54:18.050 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.052+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~XTNJC6BGH1HM.1 size=668221 2024-09-14T10:54:18.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.054+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=XTNJC6BGH1HM tag=C11CIU9AZ27Z type=write size=2765373 2024-09-14T10:54:18.054 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.056+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~J34CUP1F8EPL.0 size=1048576 2024-09-14T10:54:18.056 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.057+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~J34CUP1F8EPL.1 size=493308 2024-09-14T10:54:18.056 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.057+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=J34CUP1F8EPL tag=VGJVZUT8EM2W type=write size=2590460 2024-09-14T10:54:18.057 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.059+0000 7faa01046780 1 < completed write operation key=V5T3AN9D7DH6 tag=U0DGLYQX2NHO type=write size=719805 2024-09-14T10:54:18.059 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.062+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~V8YC981P0VLG.0 size=1048576 2024-09-14T10:54:18.061 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.062+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~V8YC981P0VLG.1 size=1048576 2024-09-14T10:54:18.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.063+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~V8YC981P0VLG.2 size=330362 2024-09-14T10:54:18.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.063+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=V8YC981P0VLG tag=JF7H7I174OLR type=write size=3476090 2024-09-14T10:54:18.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.064+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=8IGQPO6OY6WK type=del 2024-09-14T10:54:18.065 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.067+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=OAUFS3893UYU type=del size=1207143 2024-09-14T10:54:18.066 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.067+0000 7faa01046780 1 < completed delete operation key=U8TE0XNK9YKM tag=8NI24NL4GZVF type=del 2024-09-14T10:54:18.068 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.070+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~CRC13010MPKM.0 size=1048576 2024-09-14T10:54:18.070 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.072+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~CRC13010MPKM.1 size=1048576 2024-09-14T10:54:18.071 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.073+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~CRC13010MPKM.2 size=441968 2024-09-14T10:54:18.071 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.073+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=CRC13010MPKM tag=CEAX7ZRHHF09 type=write size=3587696 2024-09-14T10:54:18.072 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.073+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~FU92IUYCHRN2.0 size=718572 2024-09-14T10:54:18.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.076+0000 7faa01046780 1 < completed multipart upload key=S3BGVJ9N9S4P upload=FU92IUYCHRN2 tag=ZLCXBI4L3952 type=write size=1767148 2024-09-14T10:54:18.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.078+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=AVVIO35V3DC3 type=del size=1819502 2024-09-14T10:54:18.077 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.078+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~UN5UNK6K0OS3.0 size=1048576 2024-09-14T10:54:18.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.079+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~UN5UNK6K0OS3.1 size=1048576 2024-09-14T10:54:18.079 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.080+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~UN5UNK6K0OS3.2 size=446428 2024-09-14T10:54:18.081 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.083+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=UN5UNK6K0OS3 tag=SDGWKMQAPB2G type=write size=3592156 2024-09-14T10:54:18.084 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.086+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~V5G9D4SLAU53.0 size=176801 2024-09-14T10:54:18.084 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.086+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=V5G9D4SLAU53 tag=TTLHTCVHO6H8 type=write size=1225377 2024-09-14T10:54:18.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.088+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=1COG0VFBY8NM type=del 2024-09-14T10:54:18.087 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.088+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=AJNIPGEVH2MX type=del size=2463589 2024-09-14T10:54:18.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.090+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=67MO2CZ9Z9T2 type=del 2024-09-14T10:54:18.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.091+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=CR8Y1AMV5T27 type=del size=3492985 2024-09-14T10:54:18.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.092+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~5QD0EZOPK3KF.0 size=1048576 2024-09-14T10:54:18.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.092+0000 7faa01046780 1 < canceled part key=_multipart_3FSH0OFMF54V.2~5QD0EZOPK3KF.1 size=1048576 2024-09-14T10:54:18.093 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.094+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~5QD0EZOPK3KF.2 size=438372 2024-09-14T10:54:18.095 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.096+0000 7faa01046780 1 < canceled multipart upload key=3FSH0OFMF54V upload=5QD0EZOPK3KF tag=6L05CWBMGTVQ type=write size=3584100 2024-09-14T10:54:18.098 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.100+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~KL9BLKBAYBM4.0 size=1048576 2024-09-14T10:54:18.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.101+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~KL9BLKBAYBM4.1 size=1048576 2024-09-14T10:54:18.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.102+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~KL9BLKBAYBM4.2 size=387162 2024-09-14T10:54:18.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.102+0000 7faa01046780 1 > prepared multipart upload key=V11YJWHT4OOD upload=KL9BLKBAYBM4 tag=NHPIJH926OC8 type=write size=3532890 2024-09-14T10:54:18.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.102+0000 7faa01046780 1 < completed delete operation key=V905BR1VWUCV tag=J2HXWTIN29TK type=del 2024-09-14T10:54:18.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.104+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=ANPYANJ70YJL type=del size=2224739 2024-09-14T10:54:18.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.106+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~U2ETG0FKSRNN.0 size=1048576 2024-09-14T10:54:18.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.108+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~U2ETG0FKSRNN.1 size=1048576 2024-09-14T10:54:18.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.109+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~U2ETG0FKSRNN.2 size=18159 2024-09-14T10:54:18.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.113+0000 7faa01046780 1 < completed multipart upload key=SJ02N8472YDM upload=U2ETG0FKSRNN tag=W47X0UGQK3WQ type=write size=3163887 2024-09-14T10:54:18.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.113+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=FGCNSYBTNO0D type=del size=819425 2024-09-14T10:54:18.115 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.117+0000 7faa01046780 1 < suggested update operation key=XH8GHY9YRGTP tag=6PJ43MUQ57M9 type=del size=119541 2024-09-14T10:54:18.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.117+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=HQ0A8OP9S4BE type=del size=2640748 2024-09-14T10:54:18.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.118+0000 7faa01046780 1 < canceled part key=_multipart_LF41PL7DFSJI.2~34RNG6OR73E4.0 size=32277 2024-09-14T10:54:18.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.122+0000 7faa01046780 1 < canceled multipart upload key=LF41PL7DFSJI upload=34RNG6OR73E4 tag=705Y94U8WS7K type=write size=1080853 2024-09-14T10:54:18.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.123+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~2ODZTXR7CXKL.0 size=1048576 2024-09-14T10:54:18.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.124+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~2ODZTXR7CXKL.1 size=1048576 2024-09-14T10:54:18.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.126+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~2ODZTXR7CXKL.2 size=1041126 2024-09-14T10:54:18.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.126+0000 7faa01046780 1 > prepared multipart upload key=X9DUVQBBLUTF upload=2ODZTXR7CXKL tag=96G6CWKUKYQJ type=write size=4186854 2024-09-14T10:54:18.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.128+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=WUHFNDCCTJ45 type=del 2024-09-14T10:54:18.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.128+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=WRKFVJKQRAC0 type=write size=468736 2024-09-14T10:54:18.129 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.131+0000 7faa01046780 1 < completed delete operation key=PBRZNGSOLJ8E tag=WPGLC0RMOUVO type=del 2024-09-14T10:54:18.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.132+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=7AITFBOJH4NT type=del size=358274 2024-09-14T10:54:18.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.134+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~9YSHCN9U7JCB.0 size=1048576 2024-09-14T10:54:18.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.134+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~9YSHCN9U7JCB.1 size=32882 2024-09-14T10:54:18.135 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.138+0000 7faa01046780 1 < completed multipart upload key=KDUTH9PIR3FI upload=9YSHCN9U7JCB tag=MN30470WQ10L type=write size=2130034 2024-09-14T10:54:18.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.139+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=81B60GOK73H8 type=write size=467843 2024-09-14T10:54:18.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.139+0000 7faa01046780 1 < canceled part key=_multipart_3FSH0OFMF54V.2~J34CUP1F8EPL.0 size=1048576 2024-09-14T10:54:18.138 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.139+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~J34CUP1F8EPL.1 size=493308 2024-09-14T10:54:18.141 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.143+0000 7faa01046780 1 < canceled multipart upload key=3FSH0OFMF54V upload=J34CUP1F8EPL tag=VGJVZUT8EM2W type=write size=2590460 2024-09-14T10:54:18.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.143+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=N9AG8O1KMOKG type=del size=1488154 2024-09-14T10:54:18.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.146+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~V8YC981P0VLG.0 size=1048576 2024-09-14T10:54:18.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.146+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~V8YC981P0VLG.1 size=1048576 2024-09-14T10:54:18.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.148+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~V8YC981P0VLG.2 size=330362 2024-09-14T10:54:18.148 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.149+0000 7faa01046780 1 < completed multipart upload key=U8TE0XNK9YKM upload=V8YC981P0VLG tag=JF7H7I174OLR type=write size=3476090 2024-09-14T10:54:18.151 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.153+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~NC240AHJZXI0.0 size=1048576 2024-09-14T10:54:18.151 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.154+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~NC240AHJZXI0.1 size=1048576 2024-09-14T10:54:18.153 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.154+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~NC240AHJZXI0.2 size=746672 2024-09-14T10:54:18.153 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.154+0000 7faa01046780 1 > prepared multipart upload key=F06QWEOYNQX4 upload=NC240AHJZXI0 tag=RHL0H6ZXH94D type=write size=3892400 2024-09-14T10:54:18.154 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.155+0000 7faa01046780 1 < completed delete operation key=PBRZNGSOLJ8E tag=OAUFS3893UYU type=del 2024-09-14T10:54:18.155 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.157+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=8CO4AN879A4H type=del size=3169126 2024-09-14T10:54:18.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.159+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~CRC13010MPKM.0 size=1048576 2024-09-14T10:54:18.158 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.159+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~CRC13010MPKM.1 size=1048576 2024-09-14T10:54:18.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.160+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~CRC13010MPKM.2 size=441968 2024-09-14T10:54:18.162 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.164+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=CRC13010MPKM tag=CEAX7ZRHHF09 type=write size=3587696 2024-09-14T10:54:18.163 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.164+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=4SOSB4NGE1LD type=del size=3250580 2024-09-14T10:54:18.165 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.167+0000 7faa01046780 1 < completed delete operation key=GG02P21TFKIM tag=AVVIO35V3DC3 type=del 2024-09-14T10:54:18.167 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.170+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~3KHBV7VAWF93.0 size=661293 2024-09-14T10:54:18.168 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.170+0000 7faa01046780 1 > prepared multipart upload key=VIO703UXIJXV upload=3KHBV7VAWF93 tag=3O6RPYB20AEA type=write size=1709869 2024-09-14T10:54:18.169 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.170+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~V5G9D4SLAU53.0 size=176801 2024-09-14T10:54:18.171 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.173+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=V5G9D4SLAU53 tag=TTLHTCVHO6H8 type=write size=1225377 2024-09-14T10:54:18.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.174+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=GL9TZR2W849H type=del size=2235098 2024-09-14T10:54:18.174 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.175+0000 7faa01046780 1 < completed delete operation key=LF41PL7DFSJI tag=AJNIPGEVH2MX type=del 2024-09-14T10:54:18.175 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.177+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=DPQCNE2L4FMO type=del size=3009994 2024-09-14T10:54:18.177 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.178+0000 7faa01046780 1 < completed delete operation key=U8TE0XNK9YKM tag=CR8Y1AMV5T27 type=del 2024-09-14T10:54:18.179 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.181+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~J1MB0AR8BDSD.0 size=1048576 2024-09-14T10:54:18.180 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.182+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~J1MB0AR8BDSD.1 size=1048576 2024-09-14T10:54:18.181 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.183+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~J1MB0AR8BDSD.2 size=752939 2024-09-14T10:54:18.182 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.183+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=J1MB0AR8BDSD tag=EG2HYFQ2VA7P type=write size=3898667 2024-09-14T10:54:18.183 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.184+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~KL9BLKBAYBM4.0 size=1048576 2024-09-14T10:54:18.184 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.185+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~KL9BLKBAYBM4.1 size=1048576 2024-09-14T10:54:18.185 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.186+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~KL9BLKBAYBM4.2 size=387162 2024-09-14T10:54:18.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.190+0000 7faa01046780 1 < completed multipart upload key=V11YJWHT4OOD upload=KL9BLKBAYBM4 tag=NHPIJH926OC8 type=write size=3532890 2024-09-14T10:54:18.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.192+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~KUUHTHKE87RL.0 size=1048576 2024-09-14T10:54:18.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.194+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~KUUHTHKE87RL.1 size=1048576 2024-09-14T10:54:18.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.195+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~KUUHTHKE87RL.2 size=367029 2024-09-14T10:54:18.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.195+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=KUUHTHKE87RL tag=2UW6LK8AZM23 type=write size=3512757 2024-09-14T10:54:18.194 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.196+0000 7faa01046780 1 < completed delete operation key=HYAGNAOWK8LF tag=ANPYANJ70YJL type=del 2024-09-14T10:54:18.197 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.199+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~A8GYL8XU10RV.0 size=1048576 2024-09-14T10:54:18.198 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.200+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~A8GYL8XU10RV.1 size=1048576 2024-09-14T10:54:18.199 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.200+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~A8GYL8XU10RV.2 size=532242 2024-09-14T10:54:18.199 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.200+0000 7faa01046780 1 > prepared multipart upload key=F06QWEOYNQX4 upload=A8GYL8XU10RV tag=31LK7BI3EBI3 type=write size=3677970 2024-09-14T10:54:18.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.204+0000 7faa01046780 1 < suggested remove operation key=KDUTH9PIR3FI tag=FGCNSYBTNO0D type=del 2024-09-14T10:54:18.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.205+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=PXPONFGYQ0Z7 type=del size=1022919 2024-09-14T10:54:18.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.206+0000 7faa01046780 1 < completed delete operation key=PBRZNGSOLJ8E tag=HQ0A8OP9S4BE type=del 2024-09-14T10:54:18.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.208+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~M4P0NHJ53JIL.0 size=1048576 2024-09-14T10:54:18.208 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.210+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~M4P0NHJ53JIL.1 size=1048576 2024-09-14T10:54:18.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.211+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~M4P0NHJ53JIL.2 size=125683 2024-09-14T10:54:18.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.211+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=M4P0NHJ53JIL tag=BUWB5WN06Y0L type=write size=3271411 2024-09-14T10:54:18.211 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.213+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~2ODZTXR7CXKL.0 size=1048576 2024-09-14T10:54:18.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.214+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~2ODZTXR7CXKL.1 size=1048576 2024-09-14T10:54:18.213 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.214+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~2ODZTXR7CXKL.2 size=1041126 2024-09-14T10:54:18.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.218+0000 7faa01046780 1 < completed multipart upload key=X9DUVQBBLUTF upload=2ODZTXR7CXKL tag=96G6CWKUKYQJ type=write size=4186854 2024-09-14T10:54:18.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.219+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~DNAMG4U3DLTO.0 size=1048576 2024-09-14T10:54:18.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.221+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~DNAMG4U3DLTO.1 size=1048576 2024-09-14T10:54:18.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.223+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~DNAMG4U3DLTO.2 size=6722 2024-09-14T10:54:18.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.223+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=DNAMG4U3DLTO tag=VUWFX03OTP4E type=write size=3152450 2024-09-14T10:54:18.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.224+0000 7faa01046780 1 < completed write operation key=0OL3SF5IWDMH tag=WRKFVJKQRAC0 type=write size=468736 2024-09-14T10:54:18.224 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.226+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~BMR3R0VGABCN.0 size=1048576 2024-09-14T10:54:18.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.228+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~BMR3R0VGABCN.1 size=158626 2024-09-14T10:54:18.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.228+0000 7faa01046780 1 > prepared multipart upload key=LF41PL7DFSJI upload=BMR3R0VGABCN tag=0MWYZWT1G0F0 type=write size=2255778 2024-09-14T10:54:18.227 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.229+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=7AITFBOJH4NT type=del 2024-09-14T10:54:18.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.230+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=S075S4VTM5W7 type=del size=3134137 2024-09-14T10:54:18.231 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.233+0000 7faa01046780 1 < suggested remove operation key=XDJAK0XYQNF0 tag=81B60GOK73H8 type=write 2024-09-14T10:54:18.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.235+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~2DP5O34Q7UEV.0 size=1048576 2024-09-14T10:54:18.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.236+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~2DP5O34Q7UEV.1 size=1048576 2024-09-14T10:54:18.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.238+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~2DP5O34Q7UEV.2 size=78277 2024-09-14T10:54:18.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.238+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=2DP5O34Q7UEV tag=1RME4YI7YD5G type=write size=3224005 2024-09-14T10:54:18.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.238+0000 7faa01046780 1 < completed delete operation key=GG02P21TFKIM tag=N9AG8O1KMOKG type=del 2024-09-14T10:54:18.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.242+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=BHJT00U5T48Y type=del size=3029410 2024-09-14T10:54:18.241 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.242+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~NC240AHJZXI0.0 size=1048576 2024-09-14T10:54:18.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.244+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~NC240AHJZXI0.1 size=1048576 2024-09-14T10:54:18.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.245+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~NC240AHJZXI0.2 size=746672 2024-09-14T10:54:18.246 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.248+0000 7faa01046780 1 < completed multipart upload key=F06QWEOYNQX4 upload=NC240AHJZXI0 tag=RHL0H6ZXH94D type=write size=3892400 2024-09-14T10:54:18.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.251+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~A7A57TW0G1O0.0 size=1048576 2024-09-14T10:54:18.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.252+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~A7A57TW0G1O0.1 size=998557 2024-09-14T10:54:18.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.252+0000 7faa01046780 1 > prepared multipart upload key=GG02P21TFKIM upload=A7A57TW0G1O0 tag=FWN387MRGSEO type=write size=3095709 2024-09-14T10:54:18.251 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.253+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=8CO4AN879A4H type=del 2024-09-14T10:54:18.253 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.255+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=I54A15X32PDF type=del size=697613 2024-09-14T10:54:18.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.256+0000 7faa01046780 1 < completed delete operation key=V5T3AN9D7DH6 tag=4SOSB4NGE1LD type=del 2024-09-14T10:54:18.257 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.259+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~I6UYUZYMM564.0 size=1048576 2024-09-14T10:54:18.258 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.259+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~I6UYUZYMM564.1 size=451680 2024-09-14T10:54:18.258 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.259+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=I6UYUZYMM564 tag=FSBRKPMVRN7C type=write size=2548832 2024-09-14T10:54:18.259 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.262+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~3KHBV7VAWF93.0 size=661293 2024-09-14T10:54:18.262 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.264+0000 7faa01046780 1 < completed multipart upload key=VIO703UXIJXV upload=3KHBV7VAWF93 tag=3O6RPYB20AEA type=write size=1709869 2024-09-14T10:54:18.263 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.265+0000 7faa01046780 1 > prepared operation key=SJ02N8472YDM tag=L31BYE93EQH8 type=del size=2000837 2024-09-14T10:54:18.265 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.267+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=GL9TZR2W849H type=del 2024-09-14T10:54:18.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.268+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~F38CLSJLEY6S.0 size=1048576 2024-09-14T10:54:18.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.270+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~F38CLSJLEY6S.1 size=1048576 2024-09-14T10:54:18.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.272+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~F38CLSJLEY6S.2 size=891112 2024-09-14T10:54:18.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.272+0000 7faa01046780 1 > prepared multipart upload key=PBRZNGSOLJ8E upload=F38CLSJLEY6S tag=U7HSXFSTDQ39 type=write size=4036840 2024-09-14T10:54:18.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.272+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=DPQCNE2L4FMO type=del 2024-09-14T10:54:18.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.275+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=ONBJZAG0XQJW type=del size=227736 2024-09-14T10:54:18.274 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.275+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~J1MB0AR8BDSD.0 size=1048576 2024-09-14T10:54:18.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.277+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~J1MB0AR8BDSD.1 size=1048576 2024-09-14T10:54:18.276 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.279+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~J1MB0AR8BDSD.2 size=752939 2024-09-14T10:54:18.279 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.281+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=J1MB0AR8BDSD tag=EG2HYFQ2VA7P type=write size=3898667 2024-09-14T10:54:18.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.283+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=BJQF0KPOO0ZR type=del size=2297434 2024-09-14T10:54:18.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.283+0000 7faa01046780 1 < canceled part key=_multipart_HYAGNAOWK8LF.2~KUUHTHKE87RL.0 size=1048576 2024-09-14T10:54:18.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.285+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~KUUHTHKE87RL.1 size=1048576 2024-09-14T10:54:18.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.285+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~KUUHTHKE87RL.2 size=367029 2024-09-14T10:54:18.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.289+0000 7faa01046780 1 < canceled multipart upload key=HYAGNAOWK8LF upload=KUUHTHKE87RL tag=2UW6LK8AZM23 type=write size=3512757 2024-09-14T10:54:18.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.291+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=FMG8G2R7UU7S type=del size=2329067 2024-09-14T10:54:18.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.292+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~A8GYL8XU10RV.0 size=1048576 2024-09-14T10:54:18.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.292+0000 7faa01046780 1 < canceled part key=_multipart_F06QWEOYNQX4.2~A8GYL8XU10RV.1 size=1048576 2024-09-14T10:54:18.291 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.294+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~A8GYL8XU10RV.2 size=532242 2024-09-14T10:54:18.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.295+0000 7faa01046780 1 < canceled multipart upload key=F06QWEOYNQX4 upload=A8GYL8XU10RV tag=31LK7BI3EBI3 type=write size=3677970 2024-09-14T10:54:18.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.297+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=TXTNF7J5A665 type=del size=3652916 2024-09-14T10:54:18.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.297+0000 7faa01046780 1 < canceled operation key=F06QWEOYNQX4 tag=PXPONFGYQ0Z7 type=del size=1022919 2024-09-14T10:54:18.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.300+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=D3LDX6MUOZ15 type=del size=3528518 2024-09-14T10:54:18.299 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.300+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~M4P0NHJ53JIL.0 size=1048576 2024-09-14T10:54:18.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.301+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~M4P0NHJ53JIL.1 size=1048576 2024-09-14T10:54:18.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.303+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~M4P0NHJ53JIL.2 size=125683 2024-09-14T10:54:18.304 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.306+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=M4P0NHJ53JIL tag=BUWB5WN06Y0L type=write size=3271411 2024-09-14T10:54:18.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.308+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~KQ8KAGSLJDJA.0 size=261601 2024-09-14T10:54:18.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.308+0000 7faa01046780 1 > prepared multipart upload key=F06QWEOYNQX4 upload=KQ8KAGSLJDJA tag=HJ32WNJ9X96O type=write size=1310177 2024-09-14T10:54:18.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.310+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~DNAMG4U3DLTO.0 size=1048576 2024-09-14T10:54:18.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.310+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~DNAMG4U3DLTO.1 size=1048576 2024-09-14T10:54:18.310 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.312+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~DNAMG4U3DLTO.2 size=6722 2024-09-14T10:54:18.312 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.313+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=DNAMG4U3DLTO tag=VUWFX03OTP4E type=write size=3152450 2024-09-14T10:54:18.314 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.316+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=M5FC5EXAFWRR type=del size=3084745 2024-09-14T10:54:18.315 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.316+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~BMR3R0VGABCN.0 size=1048576 2024-09-14T10:54:18.316 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.319+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~BMR3R0VGABCN.1 size=158626 2024-09-14T10:54:18.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.321+0000 7faa01046780 1 < completed multipart upload key=LF41PL7DFSJI upload=BMR3R0VGABCN tag=0MWYZWT1G0F0 type=write size=2255778 2024-09-14T10:54:18.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.322+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=POBDW1ZZXUY6 type=write size=46841 2024-09-14T10:54:18.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.323+0000 7faa01046780 1 < completed delete operation key=X9DUVQBBLUTF tag=S075S4VTM5W7 type=del 2024-09-14T10:54:18.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.326+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~A8NX7GICIFCF.0 size=718140 2024-09-14T10:54:18.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.326+0000 7faa01046780 1 > prepared multipart upload key=3UEX0IPM4CPY upload=A8NX7GICIFCF tag=SIU4FUGCZVC6 type=write size=1766716 2024-09-14T10:54:18.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.327+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~2DP5O34Q7UEV.0 size=1048576 2024-09-14T10:54:18.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.329+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~2DP5O34Q7UEV.1 size=1048576 2024-09-14T10:54:18.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.330+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~2DP5O34Q7UEV.2 size=78277 2024-09-14T10:54:18.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.333+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=2DP5O34Q7UEV tag=1RME4YI7YD5G type=write size=3224005 2024-09-14T10:54:18.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.333+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=DWSIUAF3GXFZ type=del size=234305 2024-09-14T10:54:18.334 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.336+0000 7faa01046780 1 < canceled operation key=HUBZAFMSCCNC tag=BHJT00U5T48Y type=del size=3029410 2024-09-14T10:54:18.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.338+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~5FASJHNH1O6K.0 size=1048576 2024-09-14T10:54:18.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.338+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~5FASJHNH1O6K.1 size=22355 2024-09-14T10:54:18.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.338+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=5FASJHNH1O6K tag=PX87V5B3U1B8 type=write size=2119507 2024-09-14T10:54:18.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.341+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~A7A57TW0G1O0.0 size=1048576 2024-09-14T10:54:18.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.341+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~A7A57TW0G1O0.1 size=998557 2024-09-14T10:54:18.342 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.344+0000 7faa01046780 1 < completed multipart upload key=GG02P21TFKIM upload=A7A57TW0G1O0 tag=FWN387MRGSEO type=write size=3095709 2024-09-14T10:54:18.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.347+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~MVX1GQAMRBBX.0 size=576227 2024-09-14T10:54:18.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.347+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=MVX1GQAMRBBX tag=UDCGALK3BDOH type=write size=1624803 2024-09-14T10:54:18.346 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.347+0000 7faa01046780 1 < canceled operation key=PS2QU1UZUYHE tag=I54A15X32PDF type=del size=697613 2024-09-14T10:54:18.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.350+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=Z87NM0Z0KPH2 type=del size=637176 2024-09-14T10:54:18.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.351+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~I6UYUZYMM564.0 size=1048576 2024-09-14T10:54:18.350 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.351+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~I6UYUZYMM564.1 size=451680 2024-09-14T10:54:18.352 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.355+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=I6UYUZYMM564 tag=FSBRKPMVRN7C type=write size=2548832 2024-09-14T10:54:18.354 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.356+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=B0NW9CFKRPF5 type=del size=3435015 2024-09-14T10:54:18.355 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.356+0000 7faa01046780 1 < completed delete operation key=SJ02N8472YDM tag=L31BYE93EQH8 type=del 2024-09-14T10:54:18.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.360+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~ZRHECOJ6I6NW.0 size=1048576 2024-09-14T10:54:18.359 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.361+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~ZRHECOJ6I6NW.1 size=575726 2024-09-14T10:54:18.359 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.361+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=ZRHECOJ6I6NW tag=IFJDCYNQUTBR type=write size=2672878 2024-09-14T10:54:18.360 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.362+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~F38CLSJLEY6S.0 size=1048576 2024-09-14T10:54:18.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.364+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~F38CLSJLEY6S.1 size=1048576 2024-09-14T10:54:18.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.364+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~F38CLSJLEY6S.2 size=891112 2024-09-14T10:54:18.365 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.366+0000 7faa01046780 1 < completed multipart upload key=PBRZNGSOLJ8E upload=F38CLSJLEY6S tag=U7HSXFSTDQ39 type=write size=4036840 2024-09-14T10:54:18.366 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.368+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=3W748BULWQEY type=write size=83247 2024-09-14T10:54:18.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.369+0000 7faa01046780 1 < completed delete operation key=0OL3SF5IWDMH tag=ONBJZAG0XQJW type=del 2024-09-14T10:54:18.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.373+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~9NU9LNT2GILL.0 size=1048576 2024-09-14T10:54:18.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.373+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~9NU9LNT2GILL.1 size=45750 2024-09-14T10:54:18.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.373+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=9NU9LNT2GILL tag=1DH3YOI80MEA type=write size=2142902 2024-09-14T10:54:18.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.376+0000 7faa01046780 1 < canceled operation key=XH8GHY9YRGTP tag=BJQF0KPOO0ZR type=del size=2297434 2024-09-14T10:54:18.375 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.376+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=BPP5LQC64KJO type=write size=952858 2024-09-14T10:54:18.376 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.377+0000 7faa01046780 1 < completed delete operation key=3UEX0IPM4CPY tag=FMG8G2R7UU7S type=del 2024-09-14T10:54:18.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.380+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=0898XMEIKY65 type=del size=3501619 2024-09-14T10:54:18.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.380+0000 7faa01046780 1 < completed delete operation key=PBRZNGSOLJ8E tag=TXTNF7J5A665 type=del 2024-09-14T10:54:18.380 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.381+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=6CIRHLSVUPWS type=del size=3392006 2024-09-14T10:54:18.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.383+0000 7faa01046780 1 < completed delete operation key=LF41PL7DFSJI tag=D3LDX6MUOZ15 type=del 2024-09-14T10:54:18.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.385+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~VOGZX6LL2OY0.0 size=1048576 2024-09-14T10:54:18.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.386+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~VOGZX6LL2OY0.1 size=840986 2024-09-14T10:54:18.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.386+0000 7faa01046780 1 > prepared multipart upload key=FOJGGEQZD7YW upload=VOGZX6LL2OY0 tag=447EDUP1FHTM type=write size=2938138 2024-09-14T10:54:18.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.388+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~KQ8KAGSLJDJA.0 size=261601 2024-09-14T10:54:18.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.391+0000 7faa01046780 1 < completed multipart upload key=F06QWEOYNQX4 upload=KQ8KAGSLJDJA tag=HJ32WNJ9X96O type=write size=1310177 2024-09-14T10:54:18.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.394+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~0XH04ZP6226G.0 size=1048576 2024-09-14T10:54:18.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.395+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~0XH04ZP6226G.1 size=1048576 2024-09-14T10:54:18.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.396+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~0XH04ZP6226G.2 size=859933 2024-09-14T10:54:18.394 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.396+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=0XH04ZP6226G tag=KRCZUOLZQJ83 type=write size=4005661 2024-09-14T10:54:18.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.397+0000 7faa01046780 1 < completed delete operation key=PBRZNGSOLJ8E tag=M5FC5EXAFWRR type=del 2024-09-14T10:54:18.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.399+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~2Q8KVQC6GJ86.0 size=1048576 2024-09-14T10:54:18.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.399+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~2Q8KVQC6GJ86.1 size=1048576 2024-09-14T10:54:18.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.401+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~2Q8KVQC6GJ86.2 size=363047 2024-09-14T10:54:18.400 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.401+0000 7faa01046780 1 > prepared multipart upload key=VIO703UXIJXV upload=2Q8KVQC6GJ86 tag=8ZR6KJ46BQW8 type=write size=3508775 2024-09-14T10:54:18.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.402+0000 7faa01046780 1 < completed write operation key=3UEX0IPM4CPY tag=POBDW1ZZXUY6 type=write size=46841 2024-09-14T10:54:18.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.404+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=VZUTGLWUL6CL type=del size=823930 2024-09-14T10:54:18.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.405+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~A8NX7GICIFCF.0 size=718140 2024-09-14T10:54:18.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.408+0000 7faa01046780 1 < completed multipart upload key=3UEX0IPM4CPY upload=A8NX7GICIFCF tag=SIU4FUGCZVC6 type=write size=1766716 2024-09-14T10:54:18.408 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.411+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~PD9P2ZHX1CZT.0 size=1048576 2024-09-14T10:54:18.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.411+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~PD9P2ZHX1CZT.1 size=1048576 2024-09-14T10:54:18.410 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.413+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~PD9P2ZHX1CZT.2 size=991350 2024-09-14T10:54:18.411 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.413+0000 7faa01046780 1 > prepared multipart upload key=V11YJWHT4OOD upload=PD9P2ZHX1CZT tag=RANWQD2YFKM9 type=write size=4137078 2024-09-14T10:54:18.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.413+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=DWSIUAF3GXFZ type=del 2024-09-14T10:54:18.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.415+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=1D3EBQ9J6BL3 type=del size=3936495 2024-09-14T10:54:18.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.417+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~5FASJHNH1O6K.0 size=1048576 2024-09-14T10:54:18.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.418+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~5FASJHNH1O6K.1 size=22355 2024-09-14T10:54:18.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.420+0000 7faa01046780 1 < completed multipart upload key=CKMDOO75UZGE upload=5FASJHNH1O6K tag=PX87V5B3U1B8 type=write size=2119507 2024-09-14T10:54:18.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.421+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=6ZNOG29SO181 type=del size=1397032 2024-09-14T10:54:18.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.423+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~MVX1GQAMRBBX.0 size=576227 2024-09-14T10:54:18.423 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.425+0000 7faa01046780 1 < completed multipart upload key=HYAGNAOWK8LF upload=MVX1GQAMRBBX tag=UDCGALK3BDOH type=write size=1624803 2024-09-14T10:54:18.424 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.427+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=9R2NIPZQ9GFQ type=del size=32191 2024-09-14T10:54:18.426 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.428+0000 7faa01046780 1 < completed delete operation key=BBDTPL35W4W0 tag=Z87NM0Z0KPH2 type=del 2024-09-14T10:54:18.428 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.430+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~2LPRSSZ4S8RR.0 size=1048576 2024-09-14T10:54:18.429 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.432+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~2LPRSSZ4S8RR.1 size=1048576 2024-09-14T10:54:18.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.433+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~2LPRSSZ4S8RR.2 size=447743 2024-09-14T10:54:18.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.433+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=2LPRSSZ4S8RR tag=IJCI9K9YB5RL type=write size=3593471 2024-09-14T10:54:18.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.436+0000 7faa01046780 1 < suggested remove operation key=U8TE0XNK9YKM tag=B0NW9CFKRPF5 type=del 2024-09-14T10:54:18.436 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.437+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~8FPYE3EGYOGZ.0 size=1048576 2024-09-14T10:54:18.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.438+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~8FPYE3EGYOGZ.1 size=980067 2024-09-14T10:54:18.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.438+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=8FPYE3EGYOGZ tag=2RS4Z8XBT1Y9 type=write size=3077219 2024-09-14T10:54:18.439 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.440+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~ZRHECOJ6I6NW.0 size=1048576 2024-09-14T10:54:18.440 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.442+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~ZRHECOJ6I6NW.1 size=575726 2024-09-14T10:54:18.442 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.443+0000 7faa01046780 1 < completed multipart upload key=0OL3SF5IWDMH upload=ZRHECOJ6I6NW tag=IFJDCYNQUTBR type=write size=2672878 2024-09-14T10:54:18.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.447+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~KTF0TZ0WLBWC.0 size=1048576 2024-09-14T10:54:18.446 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.448+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~KTF0TZ0WLBWC.1 size=1048576 2024-09-14T10:54:18.447 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.449+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~KTF0TZ0WLBWC.2 size=302243 2024-09-14T10:54:18.447 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.449+0000 7faa01046780 1 > prepared multipart upload key=GG02P21TFKIM upload=KTF0TZ0WLBWC tag=7U7F4014QAA5 type=write size=3447971 2024-09-14T10:54:18.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.450+0000 7faa01046780 1 < completed write operation key=XDJAK0XYQNF0 tag=3W748BULWQEY type=write size=83247 2024-09-14T10:54:18.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.452+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=ESUECS4PK3LZ type=write size=698257 2024-09-14T10:54:18.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.452+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~9NU9LNT2GILL.0 size=1048576 2024-09-14T10:54:18.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.455+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~9NU9LNT2GILL.1 size=45750 2024-09-14T10:54:18.455 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.457+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=9NU9LNT2GILL tag=1DH3YOI80MEA type=write size=2142902 2024-09-14T10:54:18.456 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.458+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=VOM414SW6OGH type=del size=1821703 2024-09-14T10:54:18.457 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.460+0000 7faa01046780 1 < completed write operation key=F06QWEOYNQX4 tag=BPP5LQC64KJO type=write size=952858 2024-09-14T10:54:18.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.462+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~NHQF8NAA1VI0.0 size=1048576 2024-09-14T10:54:18.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.463+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~NHQF8NAA1VI0.1 size=641867 2024-09-14T10:54:18.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.463+0000 7faa01046780 1 > prepared multipart upload key=X9DUVQBBLUTF upload=NHQF8NAA1VI0 tag=52KMZNOGZ059 type=write size=2739019 2024-09-14T10:54:18.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.463+0000 7faa01046780 1 < canceled operation key=XDJAK0XYQNF0 tag=0898XMEIKY65 type=del size=3501619 2024-09-14T10:54:18.464 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.466+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=LZGJQ6S4UQ1X type=write size=635129 2024-09-14T10:54:18.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.467+0000 7faa01046780 1 < canceled operation key=F06QWEOYNQX4 tag=6CIRHLSVUPWS type=del size=3392006 2024-09-14T10:54:18.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.470+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~90EA0EBCOLOQ.0 size=164335 2024-09-14T10:54:18.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.470+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=90EA0EBCOLOQ tag=CKDI3RKTEA1O type=write size=1212911 2024-09-14T10:54:18.469 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.471+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~VOGZX6LL2OY0.0 size=1048576 2024-09-14T10:54:18.470 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.472+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~VOGZX6LL2OY0.1 size=840986 2024-09-14T10:54:18.473 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.475+0000 7faa01046780 1 < completed multipart upload key=FOJGGEQZD7YW upload=VOGZX6LL2OY0 tag=447EDUP1FHTM type=write size=2938138 2024-09-14T10:54:18.474 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.477+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=VNHOHS3ZT4DE type=del size=3054266 2024-09-14T10:54:18.476 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.478+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~0XH04ZP6226G.0 size=1048576 2024-09-14T10:54:18.477 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.479+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~0XH04ZP6226G.1 size=1048576 2024-09-14T10:54:18.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.479+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~0XH04ZP6226G.2 size=859933 2024-09-14T10:54:18.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.482+0000 7faa01046780 1 < completed multipart upload key=U8TE0XNK9YKM upload=0XH04ZP6226G tag=KRCZUOLZQJ83 type=write size=4005661 2024-09-14T10:54:18.483 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.485+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~5GCFXYYKCO1V.0 size=187660 2024-09-14T10:54:18.483 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.485+0000 7faa01046780 1 > prepared multipart upload key=ZY0BY3G9NREC upload=5GCFXYYKCO1V tag=CJN6NBKLVL3F type=write size=1236236 2024-09-14T10:54:18.483 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.485+0000 7faa01046780 1 < canceled part key=_multipart_VIO703UXIJXV.2~2Q8KVQC6GJ86.0 size=1048576 2024-09-14T10:54:18.483 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.485+0000 7faa01046780 1 < canceled part key=_multipart_VIO703UXIJXV.2~2Q8KVQC6GJ86.1 size=1048576 2024-09-14T10:54:18.484 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.485+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~2Q8KVQC6GJ86.2 size=363047 2024-09-14T10:54:18.486 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.489+0000 7faa01046780 1 < canceled multipart upload key=VIO703UXIJXV upload=2Q8KVQC6GJ86 tag=8ZR6KJ46BQW8 type=write size=3508775 2024-09-14T10:54:18.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.490+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=NLT4PFWEO8WH type=del size=2568029 2024-09-14T10:54:18.490 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.493+0000 7faa01046780 1 < suggested remove operation key=HUBZAFMSCCNC tag=VZUTGLWUL6CL type=del 2024-09-14T10:54:18.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.495+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~UYWIF7VW8UVF.0 size=1048576 2024-09-14T10:54:18.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.496+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~UYWIF7VW8UVF.1 size=1048576 2024-09-14T10:54:18.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.497+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~UYWIF7VW8UVF.2 size=484869 2024-09-14T10:54:18.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.497+0000 7faa01046780 1 > prepared multipart upload key=VIO703UXIJXV upload=UYWIF7VW8UVF tag=1V49K2RMMG06 type=write size=3630597 2024-09-14T10:54:18.498 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.500+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~PD9P2ZHX1CZT.0 size=1048576 2024-09-14T10:54:18.498 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.500+0000 7faa01046780 1 < canceled part key=_multipart_V11YJWHT4OOD.2~PD9P2ZHX1CZT.1 size=1048576 2024-09-14T10:54:18.499 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.501+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~PD9P2ZHX1CZT.2 size=991350 2024-09-14T10:54:18.501 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.502+0000 7faa01046780 1 < canceled multipart upload key=V11YJWHT4OOD upload=PD9P2ZHX1CZT tag=RANWQD2YFKM9 type=write size=4137078 2024-09-14T10:54:18.503 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.505+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=Z7WH41KDXIEY type=del size=2745552 2024-09-14T10:54:18.505 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.507+0000 7faa01046780 1 < suggested remove operation key=0XVVSUIOBQPL tag=1D3EBQ9J6BL3 type=del 2024-09-14T10:54:18.507 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.509+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=7O6DIKZXRV7F type=del size=1136998 2024-09-14T10:54:18.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.511+0000 7faa01046780 1 < suggested update operation key=3UEX0IPM4CPY tag=6ZNOG29SO181 type=del size=1397032 2024-09-14T10:54:18.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.513+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=NQCUR9SOMYUT type=del size=4165916 2024-09-14T10:54:18.512 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.513+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=9R2NIPZQ9GFQ type=del 2024-09-14T10:54:18.514 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.516+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=37TBKYHLZ4LI type=del size=2072450 2024-09-14T10:54:18.515 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.517+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~2LPRSSZ4S8RR.0 size=1048576 2024-09-14T10:54:18.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.517+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~2LPRSSZ4S8RR.1 size=1048576 2024-09-14T10:54:18.517 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.517+0000 7faa01046780 1 < canceled part key=_multipart_KDUTH9PIR3FI.2~2LPRSSZ4S8RR.2 size=447743 2024-09-14T10:54:18.518 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.521+0000 7faa01046780 1 < canceled multipart upload key=KDUTH9PIR3FI upload=2LPRSSZ4S8RR tag=IJCI9K9YB5RL type=write size=3593471 2024-09-14T10:54:18.521 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.523+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~9S4AACGVHQIQ.0 size=742276 2024-09-14T10:54:18.521 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.523+0000 7faa01046780 1 > prepared multipart upload key=3UEX0IPM4CPY upload=9S4AACGVHQIQ tag=KGVQKEKM2FGI type=write size=1790852 2024-09-14T10:54:18.522 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.523+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~8FPYE3EGYOGZ.0 size=1048576 2024-09-14T10:54:18.523 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.524+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~8FPYE3EGYOGZ.1 size=980067 2024-09-14T10:54:18.525 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.527+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=8FPYE3EGYOGZ tag=2RS4Z8XBT1Y9 type=write size=3077219 2024-09-14T10:54:18.527 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.528+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=LKHZVZDNO7ZI type=del size=2385688 2024-09-14T10:54:18.527 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.528+0000 7faa01046780 1 < canceled part key=_multipart_GG02P21TFKIM.2~KTF0TZ0WLBWC.0 size=1048576 2024-09-14T10:54:18.528 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.530+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~KTF0TZ0WLBWC.1 size=1048576 2024-09-14T10:54:18.529 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.531+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~KTF0TZ0WLBWC.2 size=302243 2024-09-14T10:54:18.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.534+0000 7faa01046780 1 < canceled multipart upload key=GG02P21TFKIM upload=KTF0TZ0WLBWC tag=7U7F4014QAA5 type=write size=3447971 2024-09-14T10:54:18.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.534+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=31PU13VCQ0J1 type=del size=322685 2024-09-14T10:54:18.534 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.535+0000 7faa01046780 1 < completed write operation key=S3BGVJ9N9S4P tag=ESUECS4PK3LZ type=write size=698257 2024-09-14T10:54:18.535 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.536+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=7PS8BQBCBNJX type=del size=1877166 2024-09-14T10:54:18.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.538+0000 7faa01046780 1 < completed delete operation key=KDUTH9PIR3FI tag=VOM414SW6OGH type=del 2024-09-14T10:54:18.539 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.541+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~CA1Y7113AXRS.0 size=1048576 2024-09-14T10:54:18.540 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.542+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~CA1Y7113AXRS.1 size=1048576 2024-09-14T10:54:18.541 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.543+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~CA1Y7113AXRS.2 size=196555 2024-09-14T10:54:18.541 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.543+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=CA1Y7113AXRS tag=N051EU2JUW0D type=write size=3342283 2024-09-14T10:54:18.542 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.544+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~NHQF8NAA1VI0.0 size=1048576 2024-09-14T10:54:18.543 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.545+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~NHQF8NAA1VI0.1 size=641867 2024-09-14T10:54:18.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.548+0000 7faa01046780 1 < completed multipart upload key=X9DUVQBBLUTF upload=NHQF8NAA1VI0 tag=52KMZNOGZ059 type=write size=2739019 2024-09-14T10:54:18.547 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.549+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=7KVHBHRT5FF6 type=del size=2718202 2024-09-14T10:54:18.548 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.550+0000 7faa01046780 1 < completed write operation key=F06QWEOYNQX4 tag=LZGJQ6S4UQ1X type=write size=635129 2024-09-14T10:54:18.550 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.553+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~M6W84OZT7KJ3.0 size=1048576 2024-09-14T10:54:18.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.554+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~M6W84OZT7KJ3.1 size=983591 2024-09-14T10:54:18.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.554+0000 7faa01046780 1 > prepared multipart upload key=TDNQZ8Y1C6X2 upload=M6W84OZT7KJ3 tag=XOU3XEHQF73J type=write size=3080743 2024-09-14T10:54:18.553 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.555+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~90EA0EBCOLOQ.0 size=164335 2024-09-14T10:54:18.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.556+0000 7faa01046780 1 < completed multipart upload key=XDJAK0XYQNF0 upload=90EA0EBCOLOQ tag=CKDI3RKTEA1O type=write size=1212911 2024-09-14T10:54:18.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.559+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=HRUUAM9EX88X type=del size=105102 2024-09-14T10:54:18.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.559+0000 7faa01046780 1 < completed delete operation key=F872GLVQDCX6 tag=VNHOHS3ZT4DE type=del 2024-09-14T10:54:18.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.561+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=L63LQARKG2MM type=del size=2511692 2024-09-14T10:54:18.561 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.563+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~5GCFXYYKCO1V.0 size=187660 2024-09-14T10:54:18.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.565+0000 7faa01046780 1 < completed multipart upload key=ZY0BY3G9NREC upload=5GCFXYYKCO1V tag=CJN6NBKLVL3F type=write size=1236236 2024-09-14T10:54:18.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.566+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=LW3LG8BI2ESW type=del size=731608 2024-09-14T10:54:18.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.567+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=NLT4PFWEO8WH type=del 2024-09-14T10:54:18.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.570+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~XF89FKFZ2ZGL.0 size=1048576 2024-09-14T10:54:18.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.572+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~XF89FKFZ2ZGL.1 size=1048576 2024-09-14T10:54:18.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.573+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~XF89FKFZ2ZGL.2 size=414080 2024-09-14T10:54:18.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.573+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=XF89FKFZ2ZGL tag=TYBA2FORA76Q type=write size=3559808 2024-09-14T10:54:18.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.574+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~UYWIF7VW8UVF.0 size=1048576 2024-09-14T10:54:18.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.575+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~UYWIF7VW8UVF.1 size=1048576 2024-09-14T10:54:18.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.577+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~UYWIF7VW8UVF.2 size=484869 2024-09-14T10:54:18.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.579+0000 7faa01046780 1 < completed multipart upload key=VIO703UXIJXV upload=UYWIF7VW8UVF tag=1V49K2RMMG06 type=write size=3630597 2024-09-14T10:54:18.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.580+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=WGLJB7MU6KFO type=del size=2466533 2024-09-14T10:54:18.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.582+0000 7faa01046780 1 < completed delete operation key=Q33ET1AN14NG tag=Z7WH41KDXIEY type=del 2024-09-14T10:54:18.581 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.584+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=OAIOCJ10XPAF type=del size=4163809 2024-09-14T10:54:18.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.587+0000 7faa01046780 1 < suggested remove operation key=VIO703UXIJXV tag=7O6DIKZXRV7F type=del 2024-09-14T10:54:18.587 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.589+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~C8BY7026DHHP.0 size=1048576 2024-09-14T10:54:18.588 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.590+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~C8BY7026DHHP.1 size=877784 2024-09-14T10:54:18.588 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.590+0000 7faa01046780 1 > prepared multipart upload key=ZY0BY3G9NREC upload=C8BY7026DHHP tag=9UGC3PM6ZZRO type=write size=2974936 2024-09-14T10:54:18.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.592+0000 7faa01046780 1 < completed delete operation key=HYAGNAOWK8LF tag=NQCUR9SOMYUT type=del 2024-09-14T10:54:18.591 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.593+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=HY1EFOFHKJYC type=del size=1560453 2024-09-14T10:54:18.592 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.593+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=37TBKYHLZ4LI type=del 2024-09-14T10:54:18.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.596+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~W3SDB1P7DU33.0 size=21955 2024-09-14T10:54:18.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.596+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=W3SDB1P7DU33 tag=N43AM42415D5 type=write size=1070531 2024-09-14T10:54:18.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.597+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~9S4AACGVHQIQ.0 size=742276 2024-09-14T10:54:18.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.600+0000 7faa01046780 1 < completed multipart upload key=3UEX0IPM4CPY upload=9S4AACGVHQIQ tag=KGVQKEKM2FGI type=write size=1790852 2024-09-14T10:54:18.600 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.602+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=3NMJ2XMSPZ02 type=del size=3371799 2024-09-14T10:54:18.601 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.603+0000 7faa01046780 -1 < failed to complete operation key=VIO703UXIJXV tag=LKHZVZDNO7ZI type=del size=2385688: (22) Invalid argument 2024-09-14T10:54:18.603 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.605+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=6JYXKLH58R9I type=del size=4180893 2024-09-14T10:54:18.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.606+0000 7faa01046780 1 < completed delete operation key=X9DUVQBBLUTF tag=31PU13VCQ0J1 type=del 2024-09-14T10:54:18.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.608+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=ILNG4Z540E6O type=del size=2775508 2024-09-14T10:54:18.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.609+0000 7faa01046780 1 < canceled operation key=S3BGVJ9N9S4P tag=7PS8BQBCBNJX type=del size=1877166 2024-09-14T10:54:18.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.611+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=0JMGUIE3I233 type=del size=154028 2024-09-14T10:54:18.610 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.612+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~CA1Y7113AXRS.0 size=1048576 2024-09-14T10:54:18.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.613+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~CA1Y7113AXRS.1 size=1048576 2024-09-14T10:54:18.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.613+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~CA1Y7113AXRS.2 size=196555 2024-09-14T10:54:18.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.617+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=CA1Y7113AXRS tag=N051EU2JUW0D type=write size=3342283 2024-09-14T10:54:18.616 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.618+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=DIC8ZDRA3MCN type=del size=1585642 2024-09-14T10:54:18.617 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.620+0000 7faa01046780 1 < completed delete operation key=3FSH0OFMF54V tag=7KVHBHRT5FF6 type=del 2024-09-14T10:54:18.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.621+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=ZG5ZJ0YIQNDS type=write size=533445 2024-09-14T10:54:18.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.622+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~M6W84OZT7KJ3.0 size=1048576 2024-09-14T10:54:18.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.623+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~M6W84OZT7KJ3.1 size=983591 2024-09-14T10:54:18.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.626+0000 7faa01046780 1 < completed multipart upload key=TDNQZ8Y1C6X2 upload=M6W84OZT7KJ3 tag=XOU3XEHQF73J type=write size=3080743 2024-09-14T10:54:18.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.630+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~7F3SOMTRNO3Z.0 size=1048576 2024-09-14T10:54:18.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.631+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~7F3SOMTRNO3Z.1 size=997970 2024-09-14T10:54:18.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.631+0000 7faa01046780 1 > prepared multipart upload key=GG02P21TFKIM upload=7F3SOMTRNO3Z tag=67DVRYYBCF63 type=write size=3095122 2024-09-14T10:54:18.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.634+0000 7faa01046780 1 < suggested remove operation key=LF41PL7DFSJI tag=HRUUAM9EX88X type=del 2024-09-14T10:54:18.636 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.635+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=I9GA2P43K3G2 type=del size=3755067 2024-09-14T10:54:18.637 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.635+0000 7faa01046780 1 < completed delete operation key=3FSH0OFMF54V tag=L63LQARKG2MM type=del 2024-09-14T10:54:18.637 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.639+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~BLARTCGKWTHI.0 size=1048576 2024-09-14T10:54:18.638 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.640+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~BLARTCGKWTHI.1 size=1048576 2024-09-14T10:54:18.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.641+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~BLARTCGKWTHI.2 size=426979 2024-09-14T10:54:18.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.641+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=BLARTCGKWTHI tag=47HWGUI94C0E type=write size=3572707 2024-09-14T10:54:18.642 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.644+0000 7faa01046780 1 < suggested remove operation key=0XVVSUIOBQPL tag=LW3LG8BI2ESW type=del 2024-09-14T10:54:18.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.646+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=H584WP2VLHIZ type=del size=2576009 2024-09-14T10:54:18.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.647+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~XF89FKFZ2ZGL.0 size=1048576 2024-09-14T10:54:18.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.648+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~XF89FKFZ2ZGL.1 size=1048576 2024-09-14T10:54:18.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.649+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~XF89FKFZ2ZGL.2 size=414080 2024-09-14T10:54:18.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.651+0000 7faa01046780 1 < completed multipart upload key=U8TE0XNK9YKM upload=XF89FKFZ2ZGL tag=TYBA2FORA76Q type=write size=3559808 2024-09-14T10:54:18.651 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.653+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=7ILFXRQD16W4 type=del size=3524092 2024-09-14T10:54:18.652 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.654+0000 7faa01046780 1 < completed delete operation key=3UEX0IPM4CPY tag=WGLJB7MU6KFO type=del 2024-09-14T10:54:18.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.656+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=7DBDE4CEF58S type=del size=2357336 2024-09-14T10:54:18.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.657+0000 7faa01046780 1 < completed delete operation key=ZY0BY3G9NREC tag=OAIOCJ10XPAF type=del 2024-09-14T10:54:18.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.659+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~FVOQM3HZ93GK.0 size=496096 2024-09-14T10:54:18.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.659+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=FVOQM3HZ93GK tag=3AL8AZ4RD7OS type=write size=1544672 2024-09-14T10:54:18.659 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.661+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~C8BY7026DHHP.0 size=1048576 2024-09-14T10:54:18.660 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.662+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~C8BY7026DHHP.1 size=877784 2024-09-14T10:54:18.662 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.664+0000 7faa01046780 1 < completed multipart upload key=ZY0BY3G9NREC upload=C8BY7026DHHP tag=9UGC3PM6ZZRO type=write size=2974936 2024-09-14T10:54:18.663 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.666+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=67Y1XQ4776VV type=del size=2717318 2024-09-14T10:54:18.665 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.667+0000 7faa01046780 1 < completed delete operation key=GG02P21TFKIM tag=HY1EFOFHKJYC type=del 2024-09-14T10:54:18.666 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.668+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=6T3KUU7BLDN7 type=write size=79165 2024-09-14T10:54:18.668 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.670+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~W3SDB1P7DU33.0 size=21955 2024-09-14T10:54:18.670 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.672+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=W3SDB1P7DU33 tag=N43AM42415D5 type=write size=1070531 2024-09-14T10:54:18.672 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.674+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=ZNV3GIX7VQZG type=del size=1316691 2024-09-14T10:54:18.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.675+0000 7faa01046780 -1 < failed to complete operation key=0XVVSUIOBQPL tag=3NMJ2XMSPZ02 type=del size=3371799: (22) Invalid argument 2024-09-14T10:54:18.675 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.677+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=7OZPTY8TFYT4 type=del size=1748709 2024-09-14T10:54:18.676 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.678+0000 7faa01046780 1 < completed delete operation key=PS2QU1UZUYHE tag=6JYXKLH58R9I type=del 2024-09-14T10:54:18.678 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.680+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=6D2X9RYZQK5N type=del size=547337 2024-09-14T10:54:18.679 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.681+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=ILNG4Z540E6O type=del 2024-09-14T10:54:18.682 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.684+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~Y7LCW0OW2FE8.0 size=698844 2024-09-14T10:54:18.682 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.684+0000 7faa01046780 1 > prepared multipart upload key=F872GLVQDCX6 upload=Y7LCW0OW2FE8 tag=1GDB5XJT4W40 type=write size=1747420 2024-09-14T10:54:18.684 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.686+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=0JMGUIE3I233 type=del 2024-09-14T10:54:18.685 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.687+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=M02R9PFW0363 type=del size=2727794 2024-09-14T10:54:18.688 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.690+0000 7faa01046780 1 < suggested update operation key=VIO703UXIJXV tag=DIC8ZDRA3MCN type=del size=1585642 2024-09-14T10:54:18.689 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.692+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=ORC850KEJ4FE type=del size=2848842 2024-09-14T10:54:18.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.695+0000 7faa01046780 1 < suggested remove operation key=0XVVSUIOBQPL tag=ZG5ZJ0YIQNDS type=write 2024-09-14T10:54:18.695 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.698+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~MY2V6EQMTW8B.0 size=1048576 2024-09-14T10:54:18.697 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.699+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~MY2V6EQMTW8B.1 size=891122 2024-09-14T10:54:18.697 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.699+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=MY2V6EQMTW8B tag=1G54PRUO8F9C type=write size=2988274 2024-09-14T10:54:18.698 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.700+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~7F3SOMTRNO3Z.0 size=1048576 2024-09-14T10:54:18.698 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.700+0000 7faa01046780 1 < canceled part key=_multipart_GG02P21TFKIM.2~7F3SOMTRNO3Z.1 size=997970 2024-09-14T10:54:18.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.703+0000 7faa01046780 1 < canceled multipart upload key=GG02P21TFKIM upload=7F3SOMTRNO3Z tag=67DVRYYBCF63 type=write size=3095122 2024-09-14T10:54:18.703 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.705+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~B4L5TGDEK49H.0 size=1048576 2024-09-14T10:54:18.705 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.707+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~B4L5TGDEK49H.1 size=1048576 2024-09-14T10:54:18.706 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.708+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~B4L5TGDEK49H.2 size=888831 2024-09-14T10:54:18.706 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.708+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=B4L5TGDEK49H tag=QJZDRNIOZMZN type=write size=4034559 2024-09-14T10:54:18.707 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.710+0000 7faa01046780 1 < completed delete operation key=U8TE0XNK9YKM tag=I9GA2P43K3G2 type=del 2024-09-14T10:54:18.710 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.712+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~R4OVFJGBHFIY.0 size=1048576 2024-09-14T10:54:18.711 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.713+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~R4OVFJGBHFIY.1 size=1048576 2024-09-14T10:54:18.712 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.714+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~R4OVFJGBHFIY.2 size=748630 2024-09-14T10:54:18.712 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.714+0000 7faa01046780 1 > prepared multipart upload key=PS2QU1UZUYHE upload=R4OVFJGBHFIY tag=1MGN09G23A3K type=write size=3894358 2024-09-14T10:54:18.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.716+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~BLARTCGKWTHI.0 size=1048576 2024-09-14T10:54:18.715 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.717+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~BLARTCGKWTHI.1 size=1048576 2024-09-14T10:54:18.716 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.718+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~BLARTCGKWTHI.2 size=426979 2024-09-14T10:54:18.718 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.720+0000 7faa01046780 1 < completed multipart upload key=HYAGNAOWK8LF upload=BLARTCGKWTHI tag=47HWGUI94C0E type=write size=3572707 2024-09-14T10:54:18.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.722+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=0G6GUV0D8OS1 type=del size=3675075 2024-09-14T10:54:18.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.723+0000 7faa01046780 1 < completed delete operation key=3UEX0IPM4CPY tag=H584WP2VLHIZ type=del 2024-09-14T10:54:18.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.726+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~TKDU3OPS309C.0 size=1048576 2024-09-14T10:54:18.724 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.727+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~TKDU3OPS309C.1 size=1048576 2024-09-14T10:54:18.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.728+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~TKDU3OPS309C.2 size=164421 2024-09-14T10:54:18.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.728+0000 7faa01046780 1 > prepared multipart upload key=PBRZNGSOLJ8E upload=TKDU3OPS309C tag=65DU44NKKNUD type=write size=3310149 2024-09-14T10:54:18.728 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.731+0000 7faa01046780 1 < suggested update operation key=U8TE0XNK9YKM tag=7ILFXRQD16W4 type=del size=3524092 2024-09-14T10:54:18.730 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.732+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=WON61Y2XB7JT type=del size=921202 2024-09-14T10:54:18.733 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.735+0000 7faa01046780 1 < suggested update operation key=XDJAK0XYQNF0 tag=7DBDE4CEF58S type=del size=2357336 2024-09-14T10:54:18.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.738+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~XWHBYK9SDIQJ.0 size=1048576 2024-09-14T10:54:18.737 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.739+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~XWHBYK9SDIQJ.1 size=1048576 2024-09-14T10:54:18.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.740+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~XWHBYK9SDIQJ.2 size=69246 2024-09-14T10:54:18.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.740+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=XWHBYK9SDIQJ tag=SWRK7K8IKSNJ type=write size=3214974 2024-09-14T10:54:18.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.742+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~FVOQM3HZ93GK.0 size=496096 2024-09-14T10:54:18.742 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.744+0000 7faa01046780 1 < completed multipart upload key=HUBZAFMSCCNC upload=FVOQM3HZ93GK tag=3AL8AZ4RD7OS type=write size=1544672 2024-09-14T10:54:18.743 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.746+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=J9RC6VZE1EG2 type=del size=3486767 2024-09-14T10:54:18.745 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.747+0000 7faa01046780 1 < completed delete operation key=BBDTPL35W4W0 tag=67Y1XQ4776VV type=del 2024-09-14T10:54:18.747 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.749+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~V4VS8M9O5NJK.0 size=496263 2024-09-14T10:54:18.747 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.750+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=V4VS8M9O5NJK tag=TB5PR5K5I69W type=write size=1544839 2024-09-14T10:54:18.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.750+0000 7faa01046780 -1 < no bi entry to suggest for operation key=0XVVSUIOBQPL tag=6T3KUU7BLDN7 type=write size=79165: (2) No such file or directory 2024-09-14T10:54:18.750 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.752+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~9GF919F83T6C.0 size=708697 2024-09-14T10:54:18.750 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.752+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=9GF919F83T6C tag=JXF0D9N7469S type=write size=1757273 2024-09-14T10:54:18.751 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.754+0000 7faa01046780 1 < completed delete operation key=GG02P21TFKIM tag=ZNV3GIX7VQZG type=del 2024-09-14T10:54:18.754 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.756+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~7GHTPMZFC8I2.0 size=1048576 2024-09-14T10:54:18.755 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.757+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~7GHTPMZFC8I2.1 size=348127 2024-09-14T10:54:18.755 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.757+0000 7faa01046780 1 > prepared multipart upload key=SJ02N8472YDM upload=7GHTPMZFC8I2 tag=VAJOZGY9YPMX type=write size=2445279 2024-09-14T10:54:18.756 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.758+0000 7faa01046780 1 < completed delete operation key=X9DUVQBBLUTF tag=7OZPTY8TFYT4 type=del 2024-09-14T10:54:18.757 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.760+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=YV8UK2IDR3G1 type=del size=4077268 2024-09-14T10:54:18.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.763+0000 7faa01046780 1 < suggested update operation key=VIO703UXIJXV tag=6D2X9RYZQK5N type=del size=547337 2024-09-14T10:54:18.762 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.765+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=8BD3UC3GDG48 type=write size=954119 2024-09-14T10:54:18.764 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.766+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~Y7LCW0OW2FE8.0 size=698844 2024-09-14T10:54:18.766 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.768+0000 7faa01046780 1 < completed multipart upload key=F872GLVQDCX6 upload=Y7LCW0OW2FE8 tag=1GDB5XJT4W40 type=write size=1747420 2024-09-14T10:54:18.767 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.770+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=POZ773ZZ17XO type=write size=543637 2024-09-14T10:54:18.771 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.773+0000 7faa01046780 1 < suggested update operation key=X9DUVQBBLUTF tag=M02R9PFW0363 type=del size=2727794 2024-09-14T10:54:18.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.775+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~BIQ94VGJ4L69.0 size=1048576 2024-09-14T10:54:18.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.777+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~BIQ94VGJ4L69.1 size=36619 2024-09-14T10:54:18.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.777+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=BIQ94VGJ4L69 tag=DEG3OXA339KX type=write size=2133771 2024-09-14T10:54:18.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.778+0000 7faa01046780 -1 < failed to complete operation key=VIO703UXIJXV tag=ORC850KEJ4FE type=del size=2848842: (22) Invalid argument 2024-09-14T10:54:18.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.781+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~9HUNLYQ9NJ37.0 size=1048576 2024-09-14T10:54:18.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.782+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~9HUNLYQ9NJ37.1 size=1048576 2024-09-14T10:54:18.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.783+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~9HUNLYQ9NJ37.2 size=66683 2024-09-14T10:54:18.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.783+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=9HUNLYQ9NJ37 tag=PRANUNWBFB3Y type=write size=3212411 2024-09-14T10:54:18.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.784+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~MY2V6EQMTW8B.0 size=1048576 2024-09-14T10:54:18.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.785+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~MY2V6EQMTW8B.1 size=891122 2024-09-14T10:54:18.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.788+0000 7faa01046780 1 < completed multipart upload key=KDUTH9PIR3FI upload=MY2V6EQMTW8B tag=1G54PRUO8F9C type=write size=2988274 2024-09-14T10:54:18.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.789+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=N37Z92PD06GM type=write size=108666 2024-09-14T10:54:18.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.790+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~B4L5TGDEK49H.0 size=1048576 2024-09-14T10:54:18.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.792+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~B4L5TGDEK49H.1 size=1048576 2024-09-14T10:54:18.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.793+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~B4L5TGDEK49H.2 size=888831 2024-09-14T10:54:18.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.795+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=B4L5TGDEK49H tag=QJZDRNIOZMZN type=write size=4034559 2024-09-14T10:54:18.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.796+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=7HDB0A119VTD type=del size=798042 2024-09-14T10:54:18.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.798+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~R4OVFJGBHFIY.0 size=1048576 2024-09-14T10:54:18.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.799+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~R4OVFJGBHFIY.1 size=1048576 2024-09-14T10:54:18.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.799+0000 7faa01046780 1 < canceled part key=_multipart_PS2QU1UZUYHE.2~R4OVFJGBHFIY.2 size=748630 2024-09-14T10:54:18.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.802+0000 7faa01046780 1 < canceled multipart upload key=PS2QU1UZUYHE upload=R4OVFJGBHFIY tag=1MGN09G23A3K type=write size=3894358 2024-09-14T10:54:18.802 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.804+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~Y30C8PL7N271.0 size=286199 2024-09-14T10:54:18.802 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.804+0000 7faa01046780 1 > prepared multipart upload key=FOJGGEQZD7YW upload=Y30C8PL7N271 tag=247DIKA5K72K type=write size=1334775 2024-09-14T10:54:18.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.808+0000 7faa01046780 1 < suggested update operation key=FOJGGEQZD7YW tag=0G6GUV0D8OS1 type=del size=3675075 2024-09-14T10:54:18.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.809+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=BN4D43AIANHN type=write size=653837 2024-09-14T10:54:18.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.811+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~TKDU3OPS309C.0 size=1048576 2024-09-14T10:54:18.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.812+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~TKDU3OPS309C.1 size=1048576 2024-09-14T10:54:18.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.812+0000 7faa01046780 1 < canceled part key=_multipart_PBRZNGSOLJ8E.2~TKDU3OPS309C.2 size=164421 2024-09-14T10:54:18.812 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.814+0000 7faa01046780 1 < canceled multipart upload key=PBRZNGSOLJ8E upload=TKDU3OPS309C tag=65DU44NKKNUD type=write size=3310149 2024-09-14T10:54:18.814 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.816+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~1DEX1DM7YD51.0 size=1048576 2024-09-14T10:54:18.815 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.818+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~1DEX1DM7YD51.1 size=1048576 2024-09-14T10:54:18.817 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.819+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~1DEX1DM7YD51.2 size=974953 2024-09-14T10:54:18.817 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.819+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=1DEX1DM7YD51 tag=ZJ61IB2Z5MCV type=write size=4120681 2024-09-14T10:54:18.818 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.820+0000 7faa01046780 -1 < failed to complete operation key=FOJGGEQZD7YW tag=WON61Y2XB7JT type=del size=921202: (22) Invalid argument 2024-09-14T10:54:18.819 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.822+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=BZ8779D2VUCE type=write size=760351 2024-09-14T10:54:18.821 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.823+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~XWHBYK9SDIQJ.0 size=1048576 2024-09-14T10:54:18.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.824+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~XWHBYK9SDIQJ.1 size=1048576 2024-09-14T10:54:18.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.826+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~XWHBYK9SDIQJ.2 size=69246 2024-09-14T10:54:18.826 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.828+0000 7faa01046780 1 < completed multipart upload key=U8TE0XNK9YKM upload=XWHBYK9SDIQJ tag=SWRK7K8IKSNJ type=write size=3214974 2024-09-14T10:54:18.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.831+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~694BKPK2K3XF.0 size=1048576 2024-09-14T10:54:18.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.832+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~694BKPK2K3XF.1 size=193455 2024-09-14T10:54:18.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.832+0000 7faa01046780 1 > prepared multipart upload key=TDNQZ8Y1C6X2 upload=694BKPK2K3XF tag=NVLA11HSWCX7 type=write size=2290607 2024-09-14T10:54:18.831 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.833+0000 7faa01046780 1 < completed delete operation key=3UEX0IPM4CPY tag=J9RC6VZE1EG2 type=del 2024-09-14T10:54:18.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.835+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=ZN1B79M35VXE type=del size=2598876 2024-09-14T10:54:18.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.836+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~V4VS8M9O5NJK.0 size=496263 2024-09-14T10:54:18.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.838+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=V4VS8M9O5NJK tag=TB5PR5K5I69W type=write size=1544839 2024-09-14T10:54:18.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.840+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=M6F1238UU9CS type=del size=4100192 2024-09-14T10:54:18.839 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.841+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~9GF919F83T6C.0 size=708697 2024-09-14T10:54:18.844 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.843+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=9GF919F83T6C tag=JXF0D9N7469S type=write size=1757273 2024-09-14T10:54:18.844 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.846+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~V02T9KO3CHHX.0 size=1048576 2024-09-14T10:54:18.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.847+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~V02T9KO3CHHX.1 size=49103 2024-09-14T10:54:18.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.847+0000 7faa01046780 1 > prepared multipart upload key=3UEX0IPM4CPY upload=V02T9KO3CHHX tag=4UTMS14BYLBP type=write size=2146255 2024-09-14T10:54:18.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.848+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~7GHTPMZFC8I2.0 size=1048576 2024-09-14T10:54:18.847 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.849+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~7GHTPMZFC8I2.1 size=348127 2024-09-14T10:54:18.850 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.852+0000 7faa01046780 1 < completed multipart upload key=SJ02N8472YDM upload=7GHTPMZFC8I2 tag=VAJOZGY9YPMX type=write size=2445279 2024-09-14T10:54:18.851 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.853+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=3YHTPI4ESUS6 type=write size=534293 2024-09-14T10:54:18.852 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.855+0000 7faa01046780 1 < completed delete operation key=PS2QU1UZUYHE tag=YV8UK2IDR3G1 type=del 2024-09-14T10:54:18.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.857+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~KGEAGU2500NL.0 size=1048576 2024-09-14T10:54:18.856 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.858+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~KGEAGU2500NL.1 size=1048576 2024-09-14T10:54:18.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.859+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~KGEAGU2500NL.2 size=864865 2024-09-14T10:54:18.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.859+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=KGEAGU2500NL tag=EPSR2EXJ6FCG type=write size=4010593 2024-09-14T10:54:18.858 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.860+0000 7faa01046780 1 < completed write operation key=F06QWEOYNQX4 tag=8BD3UC3GDG48 type=write size=954119 2024-09-14T10:54:18.860 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.862+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=4EE5RG5PO32K type=del size=3677428 2024-09-14T10:54:18.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.863+0000 7faa01046780 1 < canceled operation key=V5T3AN9D7DH6 tag=POZ773ZZ17XO type=write size=543637 2024-09-14T10:54:18.864 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.866+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~TWDB6LM2GWXS.0 size=910870 2024-09-14T10:54:18.864 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.866+0000 7faa01046780 1 > prepared multipart upload key=F06QWEOYNQX4 upload=TWDB6LM2GWXS tag=1VDJMBNJIX4S type=write size=1959446 2024-09-14T10:54:18.865 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.867+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~BIQ94VGJ4L69.0 size=1048576 2024-09-14T10:54:18.866 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.869+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~BIQ94VGJ4L69.1 size=36619 2024-09-14T10:54:18.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.871+0000 7faa01046780 1 < completed multipart upload key=S3BGVJ9N9S4P upload=BIQ94VGJ4L69 tag=DEG3OXA339KX type=write size=2133771 2024-09-14T10:54:18.871 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.873+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=7PWURTK9KVWA type=del size=3624057 2024-09-14T10:54:18.872 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.874+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~9HUNLYQ9NJ37.0 size=1048576 2024-09-14T10:54:18.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.875+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~9HUNLYQ9NJ37.1 size=1048576 2024-09-14T10:54:18.874 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.876+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~9HUNLYQ9NJ37.2 size=66683 2024-09-14T10:54:18.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.879+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=9HUNLYQ9NJ37 tag=PRANUNWBFB3Y type=write size=3212411 2024-09-14T10:54:18.879 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.881+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~U2N4B6O0V6MC.0 size=1048576 2024-09-14T10:54:18.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.882+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~U2N4B6O0V6MC.1 size=817298 2024-09-14T10:54:18.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.882+0000 7faa01046780 1 > prepared multipart upload key=PS2QU1UZUYHE upload=U2N4B6O0V6MC tag=FUCIVNMSL6PD type=write size=2914450 2024-09-14T10:54:18.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.884+0000 7faa01046780 1 < completed write operation key=V11YJWHT4OOD tag=N37Z92PD06GM type=write size=108666 2024-09-14T10:54:18.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.885+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=GTQ20JXVEDMO type=del size=2727337 2024-09-14T10:54:18.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.887+0000 7faa01046780 1 < completed delete operation key=0XVVSUIOBQPL tag=7HDB0A119VTD type=del 2024-09-14T10:54:18.886 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.888+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=VO9WZFNQW3MU type=del size=2628207 2024-09-14T10:54:18.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.889+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~Y30C8PL7N271.0 size=286199 2024-09-14T10:54:18.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.892+0000 7faa01046780 1 < completed multipart upload key=FOJGGEQZD7YW upload=Y30C8PL7N271 tag=247DIKA5K72K type=write size=1334775 2024-09-14T10:54:18.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.894+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=S8ISNHAO48PY type=del size=3109397 2024-09-14T10:54:18.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.895+0000 7faa01046780 1 < completed write operation key=V5T3AN9D7DH6 tag=BN4D43AIANHN type=write size=653837 2024-09-14T10:54:18.894 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.897+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=HCAM3C96S6KK type=del size=4054519 2024-09-14T10:54:18.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.898+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~1DEX1DM7YD51.0 size=1048576 2024-09-14T10:54:18.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.899+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~1DEX1DM7YD51.1 size=1048576 2024-09-14T10:54:18.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.900+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~1DEX1DM7YD51.2 size=974953 2024-09-14T10:54:18.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.903+0000 7faa01046780 1 < completed multipart upload key=0OL3SF5IWDMH upload=1DEX1DM7YD51 tag=ZJ61IB2Z5MCV type=write size=4120681 2024-09-14T10:54:18.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.904+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=WSHCDGZ5HPZG type=del size=2176728 2024-09-14T10:54:18.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.906+0000 7faa01046780 1 < completed write operation key=V11YJWHT4OOD tag=BZ8779D2VUCE type=write size=760351 2024-09-14T10:54:18.905 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.907+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=O2AZ8Z5PN23M type=del size=4106091 2024-09-14T10:54:18.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.908+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~694BKPK2K3XF.0 size=1048576 2024-09-14T10:54:18.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.909+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~694BKPK2K3XF.1 size=193455 2024-09-14T10:54:18.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.911+0000 7faa01046780 1 < completed multipart upload key=TDNQZ8Y1C6X2 upload=694BKPK2K3XF tag=NVLA11HSWCX7 type=write size=2290607 2024-09-14T10:54:18.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.913+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=RFCB5JMNEZJ5 type=del size=3162211 2024-09-14T10:54:18.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.914+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=ZN1B79M35VXE type=del 2024-09-14T10:54:18.915 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.917+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~KGAFXRAPVJ2H.0 size=636647 2024-09-14T10:54:18.915 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.917+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=KGAFXRAPVJ2H tag=S4LK0J20DMV3 type=write size=1685223 2024-09-14T10:54:18.916 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.918+0000 7faa01046780 1 < completed delete operation key=Q33ET1AN14NG tag=M6F1238UU9CS type=del 2024-09-14T10:54:18.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.919+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=2KPX2IUS308L type=del size=1593792 2024-09-14T10:54:18.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.920+0000 7faa01046780 1 < canceled part key=_multipart_3UEX0IPM4CPY.2~V02T9KO3CHHX.0 size=1048576 2024-09-14T10:54:18.918 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.921+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~V02T9KO3CHHX.1 size=49103 2024-09-14T10:54:18.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.923+0000 7faa01046780 1 < canceled multipart upload key=3UEX0IPM4CPY upload=V02T9KO3CHHX tag=4UTMS14BYLBP type=write size=2146255 2024-09-14T10:54:18.922 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.924+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=IJ8UL1TOHMLX type=del size=891914 2024-09-14T10:54:18.923 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.926+0000 7faa01046780 1 < canceled operation key=3FSH0OFMF54V tag=3YHTPI4ESUS6 type=write size=534293 2024-09-14T10:54:18.925 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.927+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=V5VAAL1BMCW0 type=del size=3737056 2024-09-14T10:54:18.926 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.928+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~KGEAGU2500NL.0 size=1048576 2024-09-14T10:54:18.927 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.929+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~KGEAGU2500NL.1 size=1048576 2024-09-14T10:54:18.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.931+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~KGEAGU2500NL.2 size=864865 2024-09-14T10:54:18.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.933+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=KGEAGU2500NL tag=EPSR2EXJ6FCG type=write size=4010593 2024-09-14T10:54:18.933 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.935+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=MBV152AMCV4T type=write size=915683 2024-09-14T10:54:18.933 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.936+0000 7faa01046780 1 < canceled operation key=CKMDOO75UZGE tag=4EE5RG5PO32K type=del size=3677428 2024-09-14T10:54:18.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.938+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~21ZA5IOEC6WM.0 size=343413 2024-09-14T10:54:18.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.938+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=21ZA5IOEC6WM tag=RTASI2P9GRN6 type=write size=1391989 2024-09-14T10:54:18.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.940+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~TWDB6LM2GWXS.0 size=910870 2024-09-14T10:54:18.940 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.942+0000 7faa01046780 1 < completed multipart upload key=F06QWEOYNQX4 upload=TWDB6LM2GWXS tag=1VDJMBNJIX4S type=write size=1959446 2024-09-14T10:54:18.943 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.945+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~HL6AJC3KQB9X.0 size=666374 2024-09-14T10:54:18.943 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.945+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=HL6AJC3KQB9X tag=FOBCE9ZTZGQ8 type=write size=1714950 2024-09-14T10:54:18.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.947+0000 7faa01046780 1 < completed delete operation key=PS2QU1UZUYHE tag=7PWURTK9KVWA type=del 2024-09-14T10:54:18.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.948+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=5J9NBDYB6IX2 type=del size=1284578 2024-09-14T10:54:18.948 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.950+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~U2N4B6O0V6MC.0 size=1048576 2024-09-14T10:54:18.949 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.951+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~U2N4B6O0V6MC.1 size=817298 2024-09-14T10:54:18.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.953+0000 7faa01046780 1 < completed multipart upload key=PS2QU1UZUYHE upload=U2N4B6O0V6MC tag=FUCIVNMSL6PD type=write size=2914450 2024-09-14T10:54:18.953 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.955+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=IDVDX27FJIJO type=write size=698908 2024-09-14T10:54:18.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.958+0000 7faa01046780 1 < suggested update operation key=TDNQZ8Y1C6X2 tag=GTQ20JXVEDMO type=del size=2727337 2024-09-14T10:54:18.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.959+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=DFGLN0TIXJF0 type=del size=2880310 2024-09-14T10:54:18.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.962+0000 7faa01046780 1 < suggested update operation key=V11YJWHT4OOD tag=VO9WZFNQW3MU type=del size=2628207 2024-09-14T10:54:18.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.963+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=6027GI928L2W type=del size=3945494 2024-09-14T10:54:18.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.966+0000 7faa01046780 1 < suggested update operation key=CKMDOO75UZGE tag=S8ISNHAO48PY type=del size=3109397 2024-09-14T10:54:18.965 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.967+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=YSCIDT92Q0T8 type=write size=293416 2024-09-14T10:54:18.966 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.968+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=HCAM3C96S6KK type=del 2024-09-14T10:54:18.967 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.970+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=UBOWKU3QAUNF type=del size=2135162 2024-09-14T10:54:18.969 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.971+0000 7faa01046780 1 < canceled operation key=FOJGGEQZD7YW tag=WSHCDGZ5HPZG type=del size=2176728 2024-09-14T10:54:18.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.973+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=IR6L3CYZBDIN type=del size=98366 2024-09-14T10:54:18.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.974+0000 7faa01046780 1 < completed delete operation key=X9DUVQBBLUTF tag=O2AZ8Z5PN23M type=del 2024-09-14T10:54:18.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.977+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~0G3PZXXDESG1.0 size=1048576 2024-09-14T10:54:18.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.978+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~0G3PZXXDESG1.1 size=57833 2024-09-14T10:54:18.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.978+0000 7faa01046780 1 > prepared multipart upload key=LF41PL7DFSJI upload=0G3PZXXDESG1 tag=631MNP9A3BR8 type=write size=2154985 2024-09-14T10:54:18.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.979+0000 7faa01046780 1 < completed delete operation key=X9DUVQBBLUTF tag=RFCB5JMNEZJ5 type=del 2024-09-14T10:54:18.978 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.981+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=3AD0G355UYCU type=del size=1048717 2024-09-14T10:54:18.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.982+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~KGAFXRAPVJ2H.0 size=636647 2024-09-14T10:54:18.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.984+0000 7faa01046780 1 < completed multipart upload key=Y4CB0HIN0750 upload=KGAFXRAPVJ2H tag=S4LK0J20DMV3 type=write size=1685223 2024-09-14T10:54:18.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.986+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=J103TERSQ1LB type=del size=3571041 2024-09-14T10:54:18.985 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.987+0000 7faa01046780 1 < completed delete operation key=LF41PL7DFSJI tag=2KPX2IUS308L type=del 2024-09-14T10:54:18.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.990+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~SRZ93QLY4134.0 size=387406 2024-09-14T10:54:18.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.990+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=SRZ93QLY4134 tag=338E2TA9T17A type=write size=1435982 2024-09-14T10:54:18.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.991+0000 7faa01046780 1 < completed delete operation key=LF41PL7DFSJI tag=IJ8UL1TOHMLX type=del 2024-09-14T10:54:18.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.993+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=2ZS3INCDQX0U type=del size=1985929 2024-09-14T10:54:18.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.996+0000 7faa01046780 1 < suggested remove operation key=F872GLVQDCX6 tag=V5VAAL1BMCW0 type=del 2024-09-14T10:54:18.996 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:18.999+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~6YZ3KR8MOE15.0 size=1048576 2024-09-14T10:54:18.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.000+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~6YZ3KR8MOE15.1 size=1048576 2024-09-14T10:54:18.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.001+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~6YZ3KR8MOE15.2 size=832624 2024-09-14T10:54:18.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.001+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=6YZ3KR8MOE15 tag=B4PDD6YRX8WD type=write size=3978352 2024-09-14T10:54:19.000 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.002+0000 7faa01046780 1 < completed write operation key=F06QWEOYNQX4 tag=MBV152AMCV4T type=write size=915683 2024-09-14T10:54:19.003 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.005+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~CRLUMN4BAT3W.0 size=515810 2024-09-14T10:54:19.003 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.005+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=CRLUMN4BAT3W tag=EEQ0AY8KRSZ8 type=write size=1564386 2024-09-14T10:54:19.004 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.006+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~21ZA5IOEC6WM.0 size=343413 2024-09-14T10:54:19.006 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.008+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=21ZA5IOEC6WM tag=RTASI2P9GRN6 type=write size=1391989 2024-09-14T10:54:19.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.010+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=XQRBG94WLWK8 type=del size=1979169 2024-09-14T10:54:19.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.012+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~HL6AJC3KQB9X.0 size=666374 2024-09-14T10:54:19.012 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.014+0000 7faa01046780 1 < completed multipart upload key=XDJAK0XYQNF0 upload=HL6AJC3KQB9X tag=FOBCE9ZTZGQ8 type=write size=1714950 2024-09-14T10:54:19.014 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.016+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~3BYU1KD7QS2J.0 size=83355 2024-09-14T10:54:19.014 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.016+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=3BYU1KD7QS2J tag=FL2YU8UP18U1 type=write size=1131931 2024-09-14T10:54:19.015 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.018+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=5J9NBDYB6IX2 type=del 2024-09-14T10:54:19.017 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.019+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=8AJELNGDXY5T type=del size=4018172 2024-09-14T10:54:19.018 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.020+0000 7faa01046780 -1 < failed to complete operation key=CKMDOO75UZGE tag=IDVDX27FJIJO type=write size=698908: (22) Invalid argument 2024-09-14T10:54:19.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.024+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~K62O0GUXILW1.0 size=1048576 2024-09-14T10:54:19.023 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.025+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~K62O0GUXILW1.1 size=1048576 2024-09-14T10:54:19.024 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.026+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~K62O0GUXILW1.2 size=493393 2024-09-14T10:54:19.024 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.026+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=K62O0GUXILW1 tag=4JKQ4EK4BD0B type=write size=3639121 2024-09-14T10:54:19.026 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.028+0000 7faa01046780 -1 < failed to complete operation key=V11YJWHT4OOD tag=DFGLN0TIXJF0 type=del size=2880310: (22) Invalid argument 2024-09-14T10:54:19.028 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.031+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~3W3QMPHG3REF.0 size=618528 2024-09-14T10:54:19.028 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.031+0000 7faa01046780 1 > prepared multipart upload key=V11YJWHT4OOD upload=3W3QMPHG3REF tag=E6M0UG6VL7WZ type=write size=1667104 2024-09-14T10:54:19.031 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.033+0000 7faa01046780 1 < suggested remove operation key=ZY0BY3G9NREC tag=6027GI928L2W type=del 2024-09-14T10:54:19.033 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.035+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=5TSCTRZQ9CWT type=write size=841879 2024-09-14T10:54:19.034 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.036+0000 7faa01046780 1 < completed write operation key=HUBZAFMSCCNC tag=YSCIDT92Q0T8 type=write size=293416 2024-09-14T10:54:19.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.037+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=Q83JC8SS2LY1 type=del size=3889574 2024-09-14T10:54:19.036 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.039+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=UBOWKU3QAUNF type=del 2024-09-14T10:54:19.038 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.040+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=L769AZFUKCHU type=write size=823821 2024-09-14T10:54:19.039 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.041+0000 7faa01046780 1 < completed delete operation key=V5T3AN9D7DH6 tag=IR6L3CYZBDIN type=del 2024-09-14T10:54:19.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.044+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~H0UG5IT2LE68.0 size=998916 2024-09-14T10:54:19.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.044+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=H0UG5IT2LE68 tag=WXQMIKPRHKZ5 type=write size=2047492 2024-09-14T10:54:19.043 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.045+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~0G3PZXXDESG1.0 size=1048576 2024-09-14T10:54:19.044 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.046+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~0G3PZXXDESG1.1 size=57833 2024-09-14T10:54:19.048 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.048+0000 7faa01046780 1 < completed multipart upload key=LF41PL7DFSJI upload=0G3PZXXDESG1 tag=631MNP9A3BR8 type=write size=2154985 2024-09-14T10:54:19.048 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.050+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=BAMWPZKXNK2R type=del size=3896911 2024-09-14T10:54:19.049 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.051+0000 7faa01046780 1 < completed delete operation key=KDUTH9PIR3FI tag=3AD0G355UYCU type=del 2024-09-14T10:54:19.051 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.054+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~VGPSHGNUBVQS.0 size=1048576 2024-09-14T10:54:19.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.055+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~VGPSHGNUBVQS.1 size=46965 2024-09-14T10:54:19.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.055+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=VGPSHGNUBVQS tag=5X86RNVBW0RZ type=write size=2144117 2024-09-14T10:54:19.054 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.056+0000 7faa01046780 1 < completed delete operation key=NXIPG4HR9ZYY tag=J103TERSQ1LB type=del 2024-09-14T10:54:19.055 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.057+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=C14A5700VX6W type=write size=587230 2024-09-14T10:54:19.057 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.059+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~SRZ93QLY4134.0 size=387406 2024-09-14T10:54:19.059 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.061+0000 7faa01046780 1 < completed multipart upload key=0XVVSUIOBQPL upload=SRZ93QLY4134 tag=338E2TA9T17A type=write size=1435982 2024-09-14T10:54:19.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.062+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=1HBTFARBUXOL type=del size=4124558 2024-09-14T10:54:19.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.065+0000 7faa01046780 1 < suggested remove operation key=F872GLVQDCX6 tag=2ZS3INCDQX0U type=del 2024-09-14T10:54:19.065 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.068+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~W431WU8S3BE5.0 size=257942 2024-09-14T10:54:19.065 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.068+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=W431WU8S3BE5 tag=WNAF1SG7B7FD type=write size=1306518 2024-09-14T10:54:19.066 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.069+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~6YZ3KR8MOE15.0 size=1048576 2024-09-14T10:54:19.068 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.070+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~6YZ3KR8MOE15.1 size=1048576 2024-09-14T10:54:19.069 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.071+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~6YZ3KR8MOE15.2 size=832624 2024-09-14T10:54:19.071 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.073+0000 7faa01046780 1 < completed multipart upload key=CKMDOO75UZGE upload=6YZ3KR8MOE15 tag=B4PDD6YRX8WD type=write size=3978352 2024-09-14T10:54:19.072 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.074+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=UUVHF2CWP2OP type=del size=1939670 2024-09-14T10:54:19.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.076+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~CRLUMN4BAT3W.0 size=515810 2024-09-14T10:54:19.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.078+0000 7faa01046780 1 < completed multipart upload key=V5T3AN9D7DH6 upload=CRLUMN4BAT3W tag=EEQ0AY8KRSZ8 type=write size=1564386 2024-09-14T10:54:19.079 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.081+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~WKHYZXEPQML1.0 size=1048576 2024-09-14T10:54:19.080 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.082+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~WKHYZXEPQML1.1 size=589057 2024-09-14T10:54:19.080 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.082+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=WKHYZXEPQML1 tag=S6L34DK433RL type=write size=2686209 2024-09-14T10:54:19.081 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.083+0000 7faa01046780 1 < completed delete operation key=TDNQZ8Y1C6X2 tag=XQRBG94WLWK8 type=del 2024-09-14T10:54:19.082 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.085+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=LT2X3ECQCUDS type=del size=1450032 2024-09-14T10:54:19.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.085+0000 7faa01046780 1 < canceled part key=_multipart_S3BGVJ9N9S4P.2~3BYU1KD7QS2J.0 size=83355 2024-09-14T10:54:19.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.088+0000 7faa01046780 1 < canceled multipart upload key=S3BGVJ9N9S4P upload=3BYU1KD7QS2J tag=FL2YU8UP18U1 type=write size=1131931 2024-09-14T10:54:19.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.090+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~5T1015ME9DEV.0 size=1048576 2024-09-14T10:54:19.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.091+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~5T1015ME9DEV.1 size=1048576 2024-09-14T10:54:19.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.092+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~5T1015ME9DEV.2 size=571892 2024-09-14T10:54:19.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.092+0000 7faa01046780 1 > prepared multipart upload key=F06QWEOYNQX4 upload=5T1015ME9DEV tag=SB6MMYZCDMS6 type=write size=3717620 2024-09-14T10:54:19.092 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.094+0000 7faa01046780 1 < completed delete operation key=TDNQZ8Y1C6X2 tag=8AJELNGDXY5T type=del 2024-09-14T10:54:19.094 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.096+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~T632H7XWZGBU.0 size=1048576 2024-09-14T10:54:19.095 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.097+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~T632H7XWZGBU.1 size=921810 2024-09-14T10:54:19.095 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.097+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=T632H7XWZGBU tag=YM7A529SRJAT type=write size=3018962 2024-09-14T10:54:19.097 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.099+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~K62O0GUXILW1.0 size=1048576 2024-09-14T10:54:19.097 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.100+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~K62O0GUXILW1.1 size=1048576 2024-09-14T10:54:19.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.101+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~K62O0GUXILW1.2 size=493393 2024-09-14T10:54:19.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.103+0000 7faa01046780 1 < completed multipart upload key=S3BGVJ9N9S4P upload=K62O0GUXILW1 tag=4JKQ4EK4BD0B type=write size=3639121 2024-09-14T10:54:19.102 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.104+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=R48BVP47IE5Z type=del size=3271145 2024-09-14T10:54:19.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.106+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~3W3QMPHG3REF.0 size=618528 2024-09-14T10:54:19.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.108+0000 7faa01046780 1 < completed multipart upload key=V11YJWHT4OOD upload=3W3QMPHG3REF tag=E6M0UG6VL7WZ type=write size=1667104 2024-09-14T10:54:19.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.110+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=Q85QM2AYX6O0 type=del size=3682008 2024-09-14T10:54:19.109 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.111+0000 7faa01046780 -1 < failed to complete operation key=F872GLVQDCX6 tag=5TSCTRZQ9CWT type=write size=841879: (22) Invalid argument 2024-09-14T10:54:19.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.112+0000 7faa01046780 1 > prepared operation key=SJ02N8472YDM tag=V5N3R6WPWFD8 type=write size=767893 2024-09-14T10:54:19.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.114+0000 7faa01046780 1 < canceled operation key=KDUTH9PIR3FI tag=Q83JC8SS2LY1 type=del size=3889574 2024-09-14T10:54:19.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.115+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=DAEULWOYAHPY type=del size=1352431 2024-09-14T10:54:19.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.116+0000 7faa01046780 1 < completed write operation key=KDUTH9PIR3FI tag=L769AZFUKCHU type=write size=823821 2024-09-14T10:54:19.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.118+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=08OSBZ42CBJV type=del size=2755368 2024-09-14T10:54:19.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.119+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~H0UG5IT2LE68.0 size=998916 2024-09-14T10:54:19.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.122+0000 7faa01046780 1 < completed multipart upload key=0OL3SF5IWDMH upload=H0UG5IT2LE68 tag=WXQMIKPRHKZ5 type=write size=2047492 2024-09-14T10:54:19.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.123+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=L3OW3ET6MSHU type=del size=3893142 2024-09-14T10:54:19.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.124+0000 7faa01046780 1 < completed delete operation key=VIO703UXIJXV tag=BAMWPZKXNK2R type=del 2024-09-14T10:54:19.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.127+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~YWA2PS2O9MFE.0 size=1021177 2024-09-14T10:54:19.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.127+0000 7faa01046780 1 > prepared multipart upload key=3UEX0IPM4CPY upload=YWA2PS2O9MFE tag=B23F885ZK10H type=write size=2069753 2024-09-14T10:54:19.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.128+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~VGPSHGNUBVQS.0 size=1048576 2024-09-14T10:54:19.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.129+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~VGPSHGNUBVQS.1 size=46965 2024-09-14T10:54:19.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.132+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=VGPSHGNUBVQS tag=5X86RNVBW0RZ type=write size=2144117 2024-09-14T10:54:19.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.133+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=1IPCQAZBDKN0 type=del size=3047137 2024-09-14T10:54:19.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.134+0000 7faa01046780 1 < completed write operation key=0XVVSUIOBQPL tag=C14A5700VX6W type=write size=587230 2024-09-14T10:54:19.135 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.137+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~7CLBIPKVQGOJ.0 size=797207 2024-09-14T10:54:19.135 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.137+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=7CLBIPKVQGOJ tag=KRB25NZE7ZHM type=write size=1845783 2024-09-14T10:54:19.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.138+0000 7faa01046780 1 < completed delete operation key=BBDTPL35W4W0 tag=1HBTFARBUXOL type=del 2024-09-14T10:54:19.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.140+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=2780YIUCVGWS type=write size=339129 2024-09-14T10:54:19.139 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.141+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~W431WU8S3BE5.0 size=257942 2024-09-14T10:54:19.141 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.144+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=W431WU8S3BE5 tag=WNAF1SG7B7FD type=write size=1306518 2024-09-14T10:54:19.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.146+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~IFP382ZFUIPI.0 size=1048576 2024-09-14T10:54:19.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.147+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~IFP382ZFUIPI.1 size=1048576 2024-09-14T10:54:19.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.148+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~IFP382ZFUIPI.2 size=303789 2024-09-14T10:54:19.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.148+0000 7faa01046780 1 > prepared multipart upload key=V11YJWHT4OOD upload=IFP382ZFUIPI tag=Q3BEQ8ZZRJJ1 type=write size=3449517 2024-09-14T10:54:19.148 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.150+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=UUVHF2CWP2OP type=del 2024-09-14T10:54:19.152 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.154+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~ZFAA252P79OP.0 size=1048576 2024-09-14T10:54:19.153 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.155+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~ZFAA252P79OP.1 size=1048576 2024-09-14T10:54:19.154 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.156+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~ZFAA252P79OP.2 size=1034622 2024-09-14T10:54:19.154 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.156+0000 7faa01046780 1 > prepared multipart upload key=X9DUVQBBLUTF upload=ZFAA252P79OP tag=NUT1TNJ3HOUT type=write size=4180350 2024-09-14T10:54:19.156 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.158+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~WKHYZXEPQML1.0 size=1048576 2024-09-14T10:54:19.156 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.158+0000 7faa01046780 1 < canceled part key=_multipart_Y4CB0HIN0750.2~WKHYZXEPQML1.1 size=589057 2024-09-14T10:54:19.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.160+0000 7faa01046780 1 < canceled multipart upload key=Y4CB0HIN0750 upload=WKHYZXEPQML1 tag=S6L34DK433RL type=write size=2686209 2024-09-14T10:54:19.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.161+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=QUQ1TJ1PKJB0 type=del size=3850034 2024-09-14T10:54:19.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.163+0000 7faa01046780 1 < completed delete operation key=V905BR1VWUCV tag=LT2X3ECQCUDS type=del 2024-09-14T10:54:19.163 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.166+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~H7G013CSSZ18.0 size=729537 2024-09-14T10:54:19.164 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.166+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=H7G013CSSZ18 tag=ID0MQ7FGZ6KU type=write size=1778113 2024-09-14T10:54:19.165 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.167+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~5T1015ME9DEV.0 size=1048576 2024-09-14T10:54:19.166 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.168+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~5T1015ME9DEV.1 size=1048576 2024-09-14T10:54:19.167 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.170+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~5T1015ME9DEV.2 size=571892 2024-09-14T10:54:19.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.172+0000 7faa01046780 1 < completed multipart upload key=F06QWEOYNQX4 upload=5T1015ME9DEV tag=SB6MMYZCDMS6 type=write size=3717620 2024-09-14T10:54:19.171 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.173+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=14E3TC2GK1QI type=del size=1870245 2024-09-14T10:54:19.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.175+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~T632H7XWZGBU.0 size=1048576 2024-09-14T10:54:19.173 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.176+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~T632H7XWZGBU.1 size=921810 2024-09-14T10:54:19.176 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.178+0000 7faa01046780 1 < completed multipart upload key=0OL3SF5IWDMH upload=T632H7XWZGBU tag=YM7A529SRJAT type=write size=3018962 2024-09-14T10:54:19.177 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.179+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=ZE9QJMP2NXMN type=del size=989048 2024-09-14T10:54:19.178 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.181+0000 7faa01046780 1 < completed delete operation key=LF41PL7DFSJI tag=R48BVP47IE5Z type=del 2024-09-14T10:54:19.181 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.183+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~0AXH6KMZ5GH0.0 size=1048576 2024-09-14T10:54:19.182 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.184+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~0AXH6KMZ5GH0.1 size=27898 2024-09-14T10:54:19.182 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.184+0000 7faa01046780 1 > prepared multipart upload key=GG02P21TFKIM upload=0AXH6KMZ5GH0 tag=QMZHOZQE945R type=write size=2125050 2024-09-14T10:54:19.183 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.185+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=Q85QM2AYX6O0 type=del 2024-09-14T10:54:19.184 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.187+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=B6LI5FWGIXXZ type=del size=2308826 2024-09-14T10:54:19.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.188+0000 7faa01046780 1 < completed write operation key=SJ02N8472YDM tag=V5N3R6WPWFD8 type=write size=767893 2024-09-14T10:54:19.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.190+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~DHBYZUN8J1WW.0 size=1048576 2024-09-14T10:54:19.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.191+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~DHBYZUN8J1WW.1 size=973365 2024-09-14T10:54:19.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.191+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=DHBYZUN8J1WW tag=RVSG1P6NXCN6 type=write size=3070517 2024-09-14T10:54:19.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.193+0000 7faa01046780 1 < completed delete operation key=XH8GHY9YRGTP tag=DAEULWOYAHPY type=del 2024-09-14T10:54:19.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.194+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=3LH23FO48UXL type=del size=454087 2024-09-14T10:54:19.194 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.196+0000 7faa01046780 1 < canceled operation key=HYAGNAOWK8LF tag=08OSBZ42CBJV type=del size=2755368 2024-09-14T10:54:19.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.197+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=EARBVZQW0EPU type=del size=173479 2024-09-14T10:54:19.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.198+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=L3OW3ET6MSHU type=del 2024-09-14T10:54:19.199 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.201+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~KZOI3YH4ZA4P.0 size=1048576 2024-09-14T10:54:19.200 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.202+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~KZOI3YH4ZA4P.1 size=1048576 2024-09-14T10:54:19.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.204+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~KZOI3YH4ZA4P.2 size=828312 2024-09-14T10:54:19.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.204+0000 7faa01046780 1 > prepared multipart upload key=F872GLVQDCX6 upload=KZOI3YH4ZA4P tag=08IRSTQ8NO6U type=write size=3974040 2024-09-14T10:54:19.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.205+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~YWA2PS2O9MFE.0 size=1021177 2024-09-14T10:54:19.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.207+0000 7faa01046780 1 < completed multipart upload key=3UEX0IPM4CPY upload=YWA2PS2O9MFE tag=B23F885ZK10H type=write size=2069753 2024-09-14T10:54:19.206 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.208+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=87V5LIWB0ZIN type=del size=105813 2024-09-14T10:54:19.208 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.211+0000 7faa01046780 1 < suggested update operation key=FOJGGEQZD7YW tag=1IPCQAZBDKN0 type=del size=3047137 2024-09-14T10:54:19.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.212+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=9XV845OCWN5V type=del size=1685809 2024-09-14T10:54:19.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.212+0000 7faa01046780 1 < canceled part key=_multipart_BBDTPL35W4W0.2~7CLBIPKVQGOJ.0 size=797207 2024-09-14T10:54:19.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.215+0000 7faa01046780 1 < canceled multipart upload key=BBDTPL35W4W0 upload=7CLBIPKVQGOJ tag=KRB25NZE7ZHM type=write size=1845783 2024-09-14T10:54:19.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.217+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~I0RGJA2MQAKN.0 size=959298 2024-09-14T10:54:19.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.217+0000 7faa01046780 1 > prepared multipart upload key=FOJGGEQZD7YW upload=I0RGJA2MQAKN tag=NUADWEOXS5RC type=write size=2007874 2024-09-14T10:54:19.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.219+0000 7faa01046780 1 < canceled operation key=NXIPG4HR9ZYY tag=2780YIUCVGWS type=write size=339129 2024-09-14T10:54:19.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.221+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~LVY37ENYS51N.0 size=846561 2024-09-14T10:54:19.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.221+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=LVY37ENYS51N tag=3DX6G872EPUQ type=write size=1895137 2024-09-14T10:54:19.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.222+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~IFP382ZFUIPI.0 size=1048576 2024-09-14T10:54:19.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.222+0000 7faa01046780 1 < canceled part key=_multipart_V11YJWHT4OOD.2~IFP382ZFUIPI.1 size=1048576 2024-09-14T10:54:19.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.223+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~IFP382ZFUIPI.2 size=303789 2024-09-14T10:54:19.224 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.226+0000 7faa01046780 1 < canceled multipart upload key=V11YJWHT4OOD upload=IFP382ZFUIPI tag=Q3BEQ8ZZRJJ1 type=write size=3449517 2024-09-14T10:54:19.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.227+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=AKB8VVC9AH3A type=del size=1646781 2024-09-14T10:54:19.227 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.229+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~ZFAA252P79OP.0 size=1048576 2024-09-14T10:54:19.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.230+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~ZFAA252P79OP.1 size=1048576 2024-09-14T10:54:19.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.231+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~ZFAA252P79OP.2 size=1034622 2024-09-14T10:54:19.231 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.233+0000 7faa01046780 1 < completed multipart upload key=X9DUVQBBLUTF upload=ZFAA252P79OP tag=NUT1TNJ3HOUT type=write size=4180350 2024-09-14T10:54:19.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.235+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=68EPNUJKI1CS type=del size=40394 2024-09-14T10:54:19.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.236+0000 7faa01046780 1 < completed delete operation key=3UEX0IPM4CPY tag=QUQ1TJ1PKJB0 type=del 2024-09-14T10:54:19.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.239+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~N34QQ1I0YUBK.0 size=1048576 2024-09-14T10:54:19.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.240+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~N34QQ1I0YUBK.1 size=195600 2024-09-14T10:54:19.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.240+0000 7faa01046780 1 > prepared multipart upload key=F06QWEOYNQX4 upload=N34QQ1I0YUBK tag=CXNHGVRMCXC4 type=write size=2292752 2024-09-14T10:54:19.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.242+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~H7G013CSSZ18.0 size=729537 2024-09-14T10:54:19.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.245+0000 7faa01046780 1 < completed multipart upload key=V5T3AN9D7DH6 upload=H7G013CSSZ18 tag=ID0MQ7FGZ6KU type=write size=1778113 2024-09-14T10:54:19.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.246+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=OTIX6NYT4FDH type=del size=3820781 2024-09-14T10:54:19.245 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.248+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=14E3TC2GK1QI type=del 2024-09-14T10:54:19.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.250+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~ALADIB28R94S.0 size=1048576 2024-09-14T10:54:19.253 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.252+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~ALADIB28R94S.1 size=600040 2024-09-14T10:54:19.253 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.252+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=ALADIB28R94S tag=OL1GEDFPFZBU type=write size=2697192 2024-09-14T10:54:19.253 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.253+0000 7faa01046780 1 < completed delete operation key=TDNQZ8Y1C6X2 tag=ZE9QJMP2NXMN type=del 2024-09-14T10:54:19.253 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.255+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=FNL0Z9OGD2YK type=del size=3507036 2024-09-14T10:54:19.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.256+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~0AXH6KMZ5GH0.0 size=1048576 2024-09-14T10:54:19.255 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.257+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~0AXH6KMZ5GH0.1 size=27898 2024-09-14T10:54:19.258 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.260+0000 7faa01046780 1 < completed multipart upload key=GG02P21TFKIM upload=0AXH6KMZ5GH0 tag=QMZHOZQE945R type=write size=2125050 2024-09-14T10:54:19.261 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.263+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~2OKM2GN6EQIL.0 size=1048576 2024-09-14T10:54:19.262 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.264+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~2OKM2GN6EQIL.1 size=1048576 2024-09-14T10:54:19.263 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.265+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~2OKM2GN6EQIL.2 size=312387 2024-09-14T10:54:19.263 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.265+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=2OKM2GN6EQIL tag=NJ0W0ZUJKYSO type=write size=3458115 2024-09-14T10:54:19.264 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.267+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=B6LI5FWGIXXZ type=del 2024-09-14T10:54:19.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.268+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=PF3JZZEXZPCL type=del size=714969 2024-09-14T10:54:19.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.269+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~DHBYZUN8J1WW.0 size=1048576 2024-09-14T10:54:19.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.271+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~DHBYZUN8J1WW.1 size=973365 2024-09-14T10:54:19.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.273+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=DHBYZUN8J1WW tag=RVSG1P6NXCN6 type=write size=3070517 2024-09-14T10:54:19.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.274+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=GG14CDVTT48O type=del size=3468728 2024-09-14T10:54:19.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.276+0000 7faa01046780 1 < completed delete operation key=3FSH0OFMF54V tag=3LH23FO48UXL type=del 2024-09-14T10:54:19.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.277+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=EKUXKTTU4V5O type=del size=2790257 2024-09-14T10:54:19.276 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.278+0000 7faa01046780 1 < canceled operation key=V905BR1VWUCV tag=EARBVZQW0EPU type=del size=173479 2024-09-14T10:54:19.279 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.281+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~3K9UYAMLL8PS.0 size=490125 2024-09-14T10:54:19.279 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.281+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=3K9UYAMLL8PS tag=OAAJY0L0WI6D type=write size=1538701 2024-09-14T10:54:19.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.283+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~KZOI3YH4ZA4P.0 size=1048576 2024-09-14T10:54:19.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.284+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~KZOI3YH4ZA4P.1 size=1048576 2024-09-14T10:54:19.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.285+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~KZOI3YH4ZA4P.2 size=828312 2024-09-14T10:54:19.285 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.288+0000 7faa01046780 1 < completed multipart upload key=F872GLVQDCX6 upload=KZOI3YH4ZA4P tag=08IRSTQ8NO6U type=write size=3974040 2024-09-14T10:54:19.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.289+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=3ZD0LPI5NVRM type=del size=2776574 2024-09-14T10:54:19.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.292+0000 7faa01046780 1 < suggested remove operation key=PBRZNGSOLJ8E tag=87V5LIWB0ZIN type=del 2024-09-14T10:54:19.291 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.293+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=T6LJY780963V type=del size=3652065 2024-09-14T10:54:19.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.295+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=9XV845OCWN5V type=del 2024-09-14T10:54:19.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.297+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~6N738ZMQY0HP.0 size=539017 2024-09-14T10:54:19.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.297+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=6N738ZMQY0HP tag=POVB3UCEF7J4 type=write size=1587593 2024-09-14T10:54:19.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.298+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~I0RGJA2MQAKN.0 size=959298 2024-09-14T10:54:19.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.300+0000 7faa01046780 1 < completed multipart upload key=FOJGGEQZD7YW upload=I0RGJA2MQAKN tag=NUADWEOXS5RC type=write size=2007874 2024-09-14T10:54:19.299 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.302+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=GE1Q73MBR4B0 type=del size=1296317 2024-09-14T10:54:19.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.303+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~LVY37ENYS51N.0 size=846561 2024-09-14T10:54:19.303 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.305+0000 7faa01046780 1 < completed multipart upload key=XDJAK0XYQNF0 upload=LVY37ENYS51N tag=3DX6G872EPUQ type=write size=1895137 2024-09-14T10:54:19.304 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.306+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=SXKB3JF1E97R type=del size=1853900 2024-09-14T10:54:19.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.309+0000 7faa01046780 1 < suggested remove operation key=TDNQZ8Y1C6X2 tag=AKB8VVC9AH3A type=del 2024-09-14T10:54:19.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.311+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~46YCAPM6AI4Z.0 size=1048576 2024-09-14T10:54:19.310 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.312+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~46YCAPM6AI4Z.1 size=1048576 2024-09-14T10:54:19.311 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.314+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~46YCAPM6AI4Z.2 size=585285 2024-09-14T10:54:19.311 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.314+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=46YCAPM6AI4Z tag=XNGQQZDYGAR0 type=write size=3731013 2024-09-14T10:54:19.313 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.315+0000 7faa01046780 1 < completed delete operation key=PTDE6D7OIU1A tag=68EPNUJKI1CS type=del 2024-09-14T10:54:19.314 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.316+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=C0T9YVY3JM91 type=del size=1808775 2024-09-14T10:54:19.316 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.318+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~N34QQ1I0YUBK.0 size=1048576 2024-09-14T10:54:19.317 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.319+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~N34QQ1I0YUBK.1 size=195600 2024-09-14T10:54:19.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.321+0000 7faa01046780 1 < completed multipart upload key=F06QWEOYNQX4 upload=N34QQ1I0YUBK tag=CXNHGVRMCXC4 type=write size=2292752 2024-09-14T10:54:19.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.322+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=TJP3H7X6R74F type=del size=544239 2024-09-14T10:54:19.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.324+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=OTIX6NYT4FDH type=del 2024-09-14T10:54:19.323 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.325+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=N8E03U38PG0L type=del size=3766396 2024-09-14T10:54:19.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.327+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~ALADIB28R94S.0 size=1048576 2024-09-14T10:54:19.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.328+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~ALADIB28R94S.1 size=600040 2024-09-14T10:54:19.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.330+0000 7faa01046780 1 < completed multipart upload key=HYAGNAOWK8LF upload=ALADIB28R94S tag=OL1GEDFPFZBU type=write size=2697192 2024-09-14T10:54:19.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.333+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~JKLYCAIQU0EA.0 size=1048576 2024-09-14T10:54:19.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.334+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~JKLYCAIQU0EA.1 size=220376 2024-09-14T10:54:19.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.334+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=JKLYCAIQU0EA tag=WVMXCOAKS7XW type=write size=2317528 2024-09-14T10:54:19.333 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.335+0000 7faa01046780 1 < completed delete operation key=XH8GHY9YRGTP tag=FNL0Z9OGD2YK type=del 2024-09-14T10:54:19.334 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.337+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=V6IR17UXQ3IL type=del size=2312671 2024-09-14T10:54:19.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.337+0000 7faa01046780 1 < canceled part key=_multipart_KDUTH9PIR3FI.2~2OKM2GN6EQIL.0 size=1048576 2024-09-14T10:54:19.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.337+0000 7faa01046780 1 < canceled part key=_multipart_KDUTH9PIR3FI.2~2OKM2GN6EQIL.1 size=1048576 2024-09-14T10:54:19.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.338+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~2OKM2GN6EQIL.2 size=312387 2024-09-14T10:54:19.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.340+0000 7faa01046780 1 < canceled multipart upload key=KDUTH9PIR3FI upload=2OKM2GN6EQIL tag=NJ0W0ZUJKYSO type=write size=3458115 2024-09-14T10:54:19.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.342+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~ZBKQ6INZVU7H.0 size=217672 2024-09-14T10:54:19.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.343+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=ZBKQ6INZVU7H tag=A91CPWGRXN7M type=write size=1266248 2024-09-14T10:54:19.342 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.344+0000 7faa01046780 1 < canceled operation key=PTDE6D7OIU1A tag=PF3JZZEXZPCL type=del size=714969 2024-09-14T10:54:19.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.345+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=3COHYIJ8IX6N type=del size=3304505 2024-09-14T10:54:19.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.347+0000 7faa01046780 1 < completed delete operation key=V11YJWHT4OOD tag=GG14CDVTT48O type=del 2024-09-14T10:54:19.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.349+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~GDL0Y5ZXP0FN.0 size=298330 2024-09-14T10:54:19.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.349+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=GDL0Y5ZXP0FN tag=GZLCDZQ0NTQA type=write size=1346906 2024-09-14T10:54:19.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.351+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=EKUXKTTU4V5O type=del 2024-09-14T10:54:19.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.353+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~SG1FZGT6ERZS.0 size=1048576 2024-09-14T10:54:19.352 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.354+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~SG1FZGT6ERZS.1 size=1048576 2024-09-14T10:54:19.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.356+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~SG1FZGT6ERZS.2 size=997193 2024-09-14T10:54:19.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.356+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=SG1FZGT6ERZS tag=292KRPGFIC26 type=write size=4142921 2024-09-14T10:54:19.355 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.357+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~3K9UYAMLL8PS.0 size=490125 2024-09-14T10:54:19.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.359+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=3K9UYAMLL8PS tag=OAAJY0L0WI6D type=write size=1538701 2024-09-14T10:54:19.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.360+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=IK8023SQIAMJ type=del size=3400062 2024-09-14T10:54:19.360 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.362+0000 7faa01046780 1 < completed delete operation key=V11YJWHT4OOD tag=3ZD0LPI5NVRM type=del 2024-09-14T10:54:19.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.363+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=O5D5ZT7S73SI type=write size=211675 2024-09-14T10:54:19.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.364+0000 7faa01046780 1 < completed delete operation key=KDUTH9PIR3FI tag=T6LJY780963V type=del 2024-09-14T10:54:19.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.366+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=4ED22Q0TOPXH type=del size=2065220 2024-09-14T10:54:19.365 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.367+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~6N738ZMQY0HP.0 size=539017 2024-09-14T10:54:19.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.369+0000 7faa01046780 1 < completed multipart upload key=U8TE0XNK9YKM upload=6N738ZMQY0HP tag=POVB3UCEF7J4 type=write size=1587593 2024-09-14T10:54:19.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.371+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=W19SR6TJ78R2 type=del size=1572100 2024-09-14T10:54:19.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.374+0000 7faa01046780 1 < suggested remove operation key=XH8GHY9YRGTP tag=GE1Q73MBR4B0 type=del 2024-09-14T10:54:19.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.376+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~KJAIFND8KGXE.0 size=769625 2024-09-14T10:54:19.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.376+0000 7faa01046780 1 > prepared multipart upload key=ZY0BY3G9NREC upload=KJAIFND8KGXE tag=MD9Y2MWWLZ4C type=write size=1818201 2024-09-14T10:54:19.376 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.378+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=SXKB3JF1E97R type=del 2024-09-14T10:54:19.378 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.380+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~7CBCXMAMWCF7.0 size=1048576 2024-09-14T10:54:19.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.381+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~7CBCXMAMWCF7.1 size=1048576 2024-09-14T10:54:19.380 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.383+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~7CBCXMAMWCF7.2 size=264644 2024-09-14T10:54:19.380 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.383+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=7CBCXMAMWCF7 tag=PLU2T2JYTCIW type=write size=3410372 2024-09-14T10:54:19.381 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.383+0000 7faa01046780 1 < canceled part key=_multipart_NXIPG4HR9ZYY.2~46YCAPM6AI4Z.0 size=1048576 2024-09-14T10:54:19.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.384+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~46YCAPM6AI4Z.1 size=1048576 2024-09-14T10:54:19.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.384+0000 7faa01046780 1 < canceled part key=_multipart_NXIPG4HR9ZYY.2~46YCAPM6AI4Z.2 size=585285 2024-09-14T10:54:19.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.386+0000 7faa01046780 1 < canceled multipart upload key=NXIPG4HR9ZYY upload=46YCAPM6AI4Z tag=XNGQQZDYGAR0 type=write size=3731013 2024-09-14T10:54:19.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.387+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=YVR4HKFLMLUO type=del size=866333 2024-09-14T10:54:19.387 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.389+0000 7faa01046780 1 < completed delete operation key=ZY0BY3G9NREC tag=C0T9YVY3JM91 type=del 2024-09-14T10:54:19.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.390+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=BDZ28ELF2TQG type=write size=210473 2024-09-14T10:54:19.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.392+0000 7faa01046780 1 < completed delete operation key=V905BR1VWUCV tag=TJP3H7X6R74F type=del 2024-09-14T10:54:19.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.394+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~DIY0S3V9UBBE.0 size=1048576 2024-09-14T10:54:19.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.395+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~DIY0S3V9UBBE.1 size=531726 2024-09-14T10:54:19.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.395+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=DIY0S3V9UBBE tag=MMS88F73B1SP type=write size=2628878 2024-09-14T10:54:19.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.397+0000 7faa01046780 1 < completed delete operation key=V5T3AN9D7DH6 tag=N8E03U38PG0L type=del 2024-09-14T10:54:19.396 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.398+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=43Q0B3205PKK type=write size=556821 2024-09-14T10:54:19.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.400+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~JKLYCAIQU0EA.0 size=1048576 2024-09-14T10:54:19.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.401+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~JKLYCAIQU0EA.1 size=220376 2024-09-14T10:54:19.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.403+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=JKLYCAIQU0EA tag=WVMXCOAKS7XW type=write size=2317528 2024-09-14T10:54:19.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.405+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=UEL40TP0SIB9 type=del size=2969338 2024-09-14T10:54:19.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.407+0000 7faa01046780 1 < suggested update operation key=V5T3AN9D7DH6 tag=V6IR17UXQ3IL type=del size=2312671 2024-09-14T10:54:19.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.409+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=NXQYAIF20NLG type=del size=1864476 2024-09-14T10:54:19.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.411+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~ZBKQ6INZVU7H.0 size=217672 2024-09-14T10:54:19.411 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.413+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=ZBKQ6INZVU7H tag=A91CPWGRXN7M type=write size=1266248 2024-09-14T10:54:19.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.414+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=92DEIROLGU9Y type=del size=2872762 2024-09-14T10:54:19.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.416+0000 7faa01046780 1 < completed delete operation key=F872GLVQDCX6 tag=3COHYIJ8IX6N type=del 2024-09-14T10:54:19.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.418+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~ZUA157UNOM5A.0 size=1048576 2024-09-14T10:54:19.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.419+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~ZUA157UNOM5A.1 size=1048576 2024-09-14T10:54:19.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.420+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~ZUA157UNOM5A.2 size=151168 2024-09-14T10:54:19.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.420+0000 7faa01046780 1 > prepared multipart upload key=PS2QU1UZUYHE upload=ZUA157UNOM5A tag=Q0NY1G58YOIF type=write size=3296896 2024-09-14T10:54:19.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.421+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~GDL0Y5ZXP0FN.0 size=298330 2024-09-14T10:54:19.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.423+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=GDL0Y5ZXP0FN tag=GZLCDZQ0NTQA type=write size=1346906 2024-09-14T10:54:19.423 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.425+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=SURVRJT3XIW3 type=del size=3817712 2024-09-14T10:54:19.423 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.425+0000 7faa01046780 1 < canceled part key=_multipart_U8TE0XNK9YKM.2~SG1FZGT6ERZS.0 size=1048576 2024-09-14T10:54:19.424 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.426+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~SG1FZGT6ERZS.1 size=1048576 2024-09-14T10:54:19.424 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.426+0000 7faa01046780 1 < canceled part key=_multipart_U8TE0XNK9YKM.2~SG1FZGT6ERZS.2 size=997193 2024-09-14T10:54:19.426 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.429+0000 7faa01046780 1 < canceled multipart upload key=U8TE0XNK9YKM upload=SG1FZGT6ERZS tag=292KRPGFIC26 type=write size=4142921 2024-09-14T10:54:19.427 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.430+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=DE7C30L6Q06L type=del size=2017862 2024-09-14T10:54:19.429 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.431+0000 7faa01046780 1 < completed delete operation key=X9DUVQBBLUTF tag=IK8023SQIAMJ type=del 2024-09-14T10:54:19.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.433+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=RK85ZXOZKN2I type=del size=1873391 2024-09-14T10:54:19.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.435+0000 7faa01046780 1 < suggested remove operation key=CKMDOO75UZGE tag=O5D5ZT7S73SI type=write 2024-09-14T10:54:19.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.438+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~9GOHVR1H7O3D.0 size=526381 2024-09-14T10:54:19.436 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.438+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=9GOHVR1H7O3D tag=83BDDZ0DCDRF type=write size=1574957 2024-09-14T10:54:19.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.439+0000 7faa01046780 1 < completed delete operation key=3FSH0OFMF54V tag=4ED22Q0TOPXH type=del 2024-09-14T10:54:19.439 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.442+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~JAJU4G2ACABH.0 size=1048576 2024-09-14T10:54:19.441 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.443+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~JAJU4G2ACABH.1 size=372690 2024-09-14T10:54:19.441 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.443+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=JAJU4G2ACABH tag=SZ8SQD0QWVG1 type=write size=2469842 2024-09-14T10:54:19.442 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.444+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=W19SR6TJ78R2 type=del 2024-09-14T10:54:19.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.446+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=JRGKPJMXDPE2 type=del size=518494 2024-09-14T10:54:19.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.447+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~KJAIFND8KGXE.0 size=769625 2024-09-14T10:54:19.447 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.450+0000 7faa01046780 1 < completed multipart upload key=ZY0BY3G9NREC upload=KJAIFND8KGXE tag=MD9Y2MWWLZ4C type=write size=1818201 2024-09-14T10:54:19.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.452+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~RDTQXVRH9FVF.0 size=254457 2024-09-14T10:54:19.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.452+0000 7faa01046780 1 > prepared multipart upload key=F872GLVQDCX6 upload=RDTQXVRH9FVF tag=1SGCI8GHNRN0 type=write size=1303033 2024-09-14T10:54:19.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.454+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~7CBCXMAMWCF7.0 size=1048576 2024-09-14T10:54:19.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.455+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~7CBCXMAMWCF7.1 size=1048576 2024-09-14T10:54:19.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.456+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~7CBCXMAMWCF7.2 size=264644 2024-09-14T10:54:19.456 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.458+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=7CBCXMAMWCF7 tag=PLU2T2JYTCIW type=write size=3410372 2024-09-14T10:54:19.458 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.461+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~6SG1BIVQWZ5D.0 size=1048576 2024-09-14T10:54:19.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.462+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~6SG1BIVQWZ5D.1 size=12624 2024-09-14T10:54:19.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.462+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=6SG1BIVQWZ5D tag=OJPJJDVQEM6D type=write size=2109776 2024-09-14T10:54:19.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.463+0000 7faa01046780 1 < completed delete operation key=Q33ET1AN14NG tag=YVR4HKFLMLUO type=del 2024-09-14T10:54:19.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.465+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~KII4917WY488.0 size=1048576 2024-09-14T10:54:19.464 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.467+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~KII4917WY488.1 size=901932 2024-09-14T10:54:19.464 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.467+0000 7faa01046780 1 > prepared multipart upload key=3UEX0IPM4CPY upload=KII4917WY488 tag=3OX0SFL3IQGD type=write size=2999084 2024-09-14T10:54:19.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.469+0000 7faa01046780 1 < suggested update operation key=0XVVSUIOBQPL tag=BDZ28ELF2TQG type=write size=210473 2024-09-14T10:54:19.470 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.472+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~GI223HTBE8PP.0 size=1048576 2024-09-14T10:54:19.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.473+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~GI223HTBE8PP.1 size=1048576 2024-09-14T10:54:19.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.474+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~GI223HTBE8PP.2 size=1047736 2024-09-14T10:54:19.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.474+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=GI223HTBE8PP tag=PSCA2I76VCLN type=write size=4193464 2024-09-14T10:54:19.473 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.475+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~DIY0S3V9UBBE.0 size=1048576 2024-09-14T10:54:19.473 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.475+0000 7faa01046780 1 < canceled part key=_multipart_Q33ET1AN14NG.2~DIY0S3V9UBBE.1 size=531726 2024-09-14T10:54:19.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.478+0000 7faa01046780 1 < canceled multipart upload key=Q33ET1AN14NG upload=DIY0S3V9UBBE tag=MMS88F73B1SP type=write size=2628878 2024-09-14T10:54:19.477 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.479+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=4CP27GZAE4XO type=del size=4006038 2024-09-14T10:54:19.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.482+0000 7faa01046780 1 < suggested remove operation key=Q33ET1AN14NG tag=43Q0B3205PKK type=write 2024-09-14T10:54:19.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.483+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=NMV367EX01W6 type=del size=2371127 2024-09-14T10:54:19.482 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.484+0000 7faa01046780 1 < completed delete operation key=LF41PL7DFSJI tag=UEL40TP0SIB9 type=del 2024-09-14T10:54:19.483 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.486+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=UAZQT8J50H1B type=write size=630157 2024-09-14T10:54:19.484 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.486+0000 7faa01046780 -1 < no bi entry to suggest for operation key=Q33ET1AN14NG tag=NXQYAIF20NLG type=del size=1864476: (2) No such file or directory 2024-09-14T10:54:19.486 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.488+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~3A2GNOPDON9G.0 size=482078 2024-09-14T10:54:19.486 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.488+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=3A2GNOPDON9G tag=M7PAEVXG8F7V type=write size=1530654 2024-09-14T10:54:19.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.490+0000 7faa01046780 1 < completed delete operation key=X9DUVQBBLUTF tag=92DEIROLGU9Y type=del 2024-09-14T10:54:19.490 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.492+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~ZMT9WFYZLICW.0 size=1048576 2024-09-14T10:54:19.491 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.493+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~ZMT9WFYZLICW.1 size=1048576 2024-09-14T10:54:19.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.494+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~ZMT9WFYZLICW.2 size=250384 2024-09-14T10:54:19.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.494+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=ZMT9WFYZLICW tag=5A4CQE2CX3VA type=write size=3396112 2024-09-14T10:54:19.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.496+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~ZUA157UNOM5A.0 size=1048576 2024-09-14T10:54:19.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.497+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~ZUA157UNOM5A.1 size=1048576 2024-09-14T10:54:19.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.498+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~ZUA157UNOM5A.2 size=151168 2024-09-14T10:54:19.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.500+0000 7faa01046780 1 < completed multipart upload key=PS2QU1UZUYHE upload=ZUA157UNOM5A tag=Q0NY1G58YOIF type=write size=3296896 2024-09-14T10:54:19.499 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.501+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=XD2T23KMLTCS type=del size=1027073 2024-09-14T10:54:19.500 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.502+0000 7faa01046780 1 < completed delete operation key=ZY0BY3G9NREC tag=SURVRJT3XIW3 type=del 2024-09-14T10:54:19.502 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.504+0000 7faa01046780 1 > prepared operation key=SJ02N8472YDM tag=H2RSWH65D61J type=write size=629128 2024-09-14T10:54:19.503 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.505+0000 7faa01046780 -1 < failed to complete operation key=Q33ET1AN14NG tag=DE7C30L6Q06L type=del size=2017862: (22) Invalid argument 2024-09-14T10:54:19.504 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.506+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=SKEKN22V7FRU type=del size=2731913 2024-09-14T10:54:19.506 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.508+0000 7faa01046780 1 < completed delete operation key=XH8GHY9YRGTP tag=RK85ZXOZKN2I type=del 2024-09-14T10:54:19.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.511+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~75OJYHG47BIH.0 size=1048576 2024-09-14T10:54:19.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.512+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~75OJYHG47BIH.1 size=1048576 2024-09-14T10:54:19.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.513+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~75OJYHG47BIH.2 size=626445 2024-09-14T10:54:19.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.513+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=75OJYHG47BIH tag=IPYQCHB00WSH type=write size=3772173 2024-09-14T10:54:19.512 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.514+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~9GOHVR1H7O3D.0 size=526381 2024-09-14T10:54:19.514 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.516+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=9GOHVR1H7O3D tag=83BDDZ0DCDRF type=write size=1574957 2024-09-14T10:54:19.515 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.517+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=133EP5BJUSW7 type=write size=1047492 2024-09-14T10:54:19.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.519+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~JAJU4G2ACABH.0 size=1048576 2024-09-14T10:54:19.517 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.520+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~JAJU4G2ACABH.1 size=372690 2024-09-14T10:54:19.519 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.522+0000 7faa01046780 1 < completed multipart upload key=CKMDOO75UZGE upload=JAJU4G2ACABH tag=SZ8SQD0QWVG1 type=write size=2469842 2024-09-14T10:54:19.522 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.524+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~XK79CZWC862Y.0 size=1048576 2024-09-14T10:54:19.523 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.525+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~XK79CZWC862Y.1 size=128257 2024-09-14T10:54:19.523 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.525+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=XK79CZWC862Y tag=A8VC331M0FZA type=write size=2225409 2024-09-14T10:54:19.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.526+0000 7faa01046780 1 < canceled operation key=FOJGGEQZD7YW tag=JRGKPJMXDPE2 type=del size=518494 2024-09-14T10:54:19.527 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.529+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~GFSA8F3TNPE9.0 size=102189 2024-09-14T10:54:19.527 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.529+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=GFSA8F3TNPE9 tag=ZMK5TDT6DTVJ type=write size=1150765 2024-09-14T10:54:19.528 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.530+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~RDTQXVRH9FVF.0 size=254457 2024-09-14T10:54:19.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.533+0000 7faa01046780 1 < completed multipart upload key=F872GLVQDCX6 upload=RDTQXVRH9FVF tag=1SGCI8GHNRN0 type=write size=1303033 2024-09-14T10:54:19.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.535+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=2UM4CXIUDH9A type=write size=695818 2024-09-14T10:54:19.534 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.537+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~6SG1BIVQWZ5D.0 size=1048576 2024-09-14T10:54:19.535 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.538+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~6SG1BIVQWZ5D.1 size=12624 2024-09-14T10:54:19.538 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.540+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=6SG1BIVQWZ5D tag=OJPJJDVQEM6D type=write size=2109776 2024-09-14T10:54:19.539 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.541+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=FU61XPY91AJY type=del size=1511465 2024-09-14T10:54:19.540 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.543+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~KII4917WY488.0 size=1048576 2024-09-14T10:54:19.541 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.544+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~KII4917WY488.1 size=901932 2024-09-14T10:54:19.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.546+0000 7faa01046780 1 < completed multipart upload key=3UEX0IPM4CPY upload=KII4917WY488 tag=3OX0SFL3IQGD type=write size=2999084 2024-09-14T10:54:19.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.547+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=KMOCWAU080PV type=del size=3399134 2024-09-14T10:54:19.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.548+0000 7faa01046780 1 < canceled part key=_multipart_XH8GHY9YRGTP.2~GI223HTBE8PP.0 size=1048576 2024-09-14T10:54:19.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.549+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~GI223HTBE8PP.1 size=1048576 2024-09-14T10:54:19.548 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.550+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~GI223HTBE8PP.2 size=1047736 2024-09-14T10:54:19.550 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.552+0000 7faa01046780 1 < canceled multipart upload key=XH8GHY9YRGTP upload=GI223HTBE8PP tag=PSCA2I76VCLN type=write size=4193464 2024-09-14T10:54:19.553 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.555+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~DN6SMDT0I7X1.0 size=459885 2024-09-14T10:54:19.553 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.555+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=DN6SMDT0I7X1 tag=N6UR77M0FCS5 type=write size=1508461 2024-09-14T10:54:19.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.556+0000 7faa01046780 1 < completed delete operation key=PBRZNGSOLJ8E tag=4CP27GZAE4XO type=del 2024-09-14T10:54:19.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.558+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=6R2QQ8SN7S5N type=del size=640616 2024-09-14T10:54:19.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.559+0000 7faa01046780 1 < completed delete operation key=V11YJWHT4OOD tag=NMV367EX01W6 type=del 2024-09-14T10:54:19.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.560+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=8S1GELR2GPH0 type=del size=4020712 2024-09-14T10:54:19.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.562+0000 7faa01046780 1 < completed write operation key=0OL3SF5IWDMH tag=UAZQT8J50H1B type=write size=630157 2024-09-14T10:54:19.561 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.563+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=I0PI8FG32F2P type=del size=473450 2024-09-14T10:54:19.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.565+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~3A2GNOPDON9G.0 size=482078 2024-09-14T10:54:19.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.567+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=3A2GNOPDON9G tag=M7PAEVXG8F7V type=write size=1530654 2024-09-14T10:54:19.568 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.570+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~1B02YKXN0H00.0 size=1048576 2024-09-14T10:54:19.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.571+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~1B02YKXN0H00.1 size=200673 2024-09-14T10:54:19.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.571+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=1B02YKXN0H00 tag=3VF5FDATIBPH type=write size=2297825 2024-09-14T10:54:19.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.573+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~ZMT9WFYZLICW.0 size=1048576 2024-09-14T10:54:19.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.574+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~ZMT9WFYZLICW.1 size=1048576 2024-09-14T10:54:19.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.575+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~ZMT9WFYZLICW.2 size=250384 2024-09-14T10:54:19.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.577+0000 7faa01046780 1 < completed multipart upload key=U8TE0XNK9YKM upload=ZMT9WFYZLICW tag=5A4CQE2CX3VA type=write size=3396112 2024-09-14T10:54:19.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.578+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=VEA6KREQFG20 type=del size=865653 2024-09-14T10:54:19.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.580+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=XD2T23KMLTCS type=del 2024-09-14T10:54:19.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.582+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~3TX5SSPYZ61Q.0 size=377431 2024-09-14T10:54:19.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.582+0000 7faa01046780 1 > prepared multipart upload key=ZY0BY3G9NREC upload=3TX5SSPYZ61Q tag=TWYAQ442MAN5 type=write size=1426007 2024-09-14T10:54:19.581 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.583+0000 7faa01046780 1 < completed write operation key=SJ02N8472YDM tag=H2RSWH65D61J type=write size=629128 2024-09-14T10:54:19.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.586+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~G4PNMWRWCS3I.0 size=1048576 2024-09-14T10:54:19.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.587+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~G4PNMWRWCS3I.1 size=422183 2024-09-14T10:54:19.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.587+0000 7faa01046780 1 > prepared multipart upload key=PS2QU1UZUYHE upload=G4PNMWRWCS3I tag=Y6GOMU6AIKJ7 type=write size=2519335 2024-09-14T10:54:19.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.588+0000 7faa01046780 1 < completed delete operation key=3FSH0OFMF54V tag=SKEKN22V7FRU type=del 2024-09-14T10:54:19.588 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.590+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~U2S3QJB6KN90.0 size=1038982 2024-09-14T10:54:19.588 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.590+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=U2S3QJB6KN90 tag=49V20F1Y0PR0 type=write size=2087558 2024-09-14T10:54:19.590 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.592+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~75OJYHG47BIH.0 size=1048576 2024-09-14T10:54:19.591 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.593+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~75OJYHG47BIH.1 size=1048576 2024-09-14T10:54:19.591 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.593+0000 7faa01046780 1 < canceled part key=_multipart_CKMDOO75UZGE.2~75OJYHG47BIH.2 size=626445 2024-09-14T10:54:19.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.595+0000 7faa01046780 1 < canceled multipart upload key=CKMDOO75UZGE upload=75OJYHG47BIH tag=IPYQCHB00WSH type=write size=3772173 2024-09-14T10:54:19.594 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.597+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=OOMJ3B6330X2 type=del size=449926 2024-09-14T10:54:19.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.598+0000 7faa01046780 1 < completed write operation key=3FSH0OFMF54V tag=133EP5BJUSW7 type=write size=1047492 2024-09-14T10:54:19.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.601+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~QI4N6GUN4WG5.0 size=1048576 2024-09-14T10:54:19.600 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.602+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~QI4N6GUN4WG5.1 size=2419 2024-09-14T10:54:19.600 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.602+0000 7faa01046780 1 > prepared multipart upload key=LF41PL7DFSJI upload=QI4N6GUN4WG5 tag=XDY2FLC9YM8H type=write size=2099571 2024-09-14T10:54:19.601 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.603+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~XK79CZWC862Y.0 size=1048576 2024-09-14T10:54:19.602 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.605+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~XK79CZWC862Y.1 size=128257 2024-09-14T10:54:19.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.607+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=XK79CZWC862Y tag=A8VC331M0FZA type=write size=2225409 2024-09-14T10:54:19.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.608+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=QQQLAYK3NBHR type=del size=1428454 2024-09-14T10:54:19.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.609+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~GFSA8F3TNPE9.0 size=102189 2024-09-14T10:54:19.609 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.611+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=GFSA8F3TNPE9 tag=ZMK5TDT6DTVJ type=write size=1150765 2024-09-14T10:54:19.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.614+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~Q2X6G0V4HE0L.0 size=1048576 2024-09-14T10:54:19.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.615+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~Q2X6G0V4HE0L.1 size=943387 2024-09-14T10:54:19.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.615+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=Q2X6G0V4HE0L tag=M3VH63GEGKZF type=write size=3040539 2024-09-14T10:54:19.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.617+0000 7faa01046780 1 < completed write operation key=VIO703UXIJXV tag=2UM4CXIUDH9A type=write size=695818 2024-09-14T10:54:19.617 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.619+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~MFY2EYKYWESJ.0 size=467262 2024-09-14T10:54:19.617 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.619+0000 7faa01046780 1 > prepared multipart upload key=V11YJWHT4OOD upload=MFY2EYKYWESJ tag=SD9H2RQPNDHQ type=write size=1515838 2024-09-14T10:54:19.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.622+0000 7faa01046780 1 < suggested remove operation key=PBRZNGSOLJ8E tag=FU61XPY91AJY type=del 2024-09-14T10:54:19.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.624+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=ML306X39Z530 type=del size=495781 2024-09-14T10:54:19.623 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.625+0000 7faa01046780 1 < completed delete operation key=KDUTH9PIR3FI tag=KMOCWAU080PV type=del 2024-09-14T10:54:19.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.626+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=09QVRJAHDGG0 type=del size=3787719 2024-09-14T10:54:19.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.628+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~DN6SMDT0I7X1.0 size=459885 2024-09-14T10:54:19.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.630+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=DN6SMDT0I7X1 tag=N6UR77M0FCS5 type=write size=1508461 2024-09-14T10:54:19.630 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.632+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=PVKFOL5AZT9V type=del size=3043673 2024-09-14T10:54:19.631 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.633+0000 7faa01046780 1 < completed delete operation key=3FSH0OFMF54V tag=6R2QQ8SN7S5N type=del 2024-09-14T10:54:19.633 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.635+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=JNS5Y7EPL8VP type=write size=311205 2024-09-14T10:54:19.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.636+0000 7faa01046780 -1 < failed to complete operation key=PBRZNGSOLJ8E tag=8S1GELR2GPH0 type=del size=4020712: (22) Invalid argument 2024-09-14T10:54:19.637 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.639+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~VV0DH1J3YAGS.0 size=109976 2024-09-14T10:54:19.637 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.639+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=VV0DH1J3YAGS tag=2I471VH1L77I type=write size=1158552 2024-09-14T10:54:19.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.641+0000 7faa01046780 1 < completed delete operation key=PS2QU1UZUYHE tag=I0PI8FG32F2P type=del 2024-09-14T10:54:19.641 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.644+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~Z48R9KCQ6ZP1.0 size=1048576 2024-09-14T10:54:19.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.645+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~Z48R9KCQ6ZP1.1 size=1048576 2024-09-14T10:54:19.644 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.646+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~Z48R9KCQ6ZP1.2 size=781597 2024-09-14T10:54:19.644 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.646+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=Z48R9KCQ6ZP1 tag=DRBDXW0L7HK5 type=write size=3927325 2024-09-14T10:54:19.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.647+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~1B02YKXN0H00.0 size=1048576 2024-09-14T10:54:19.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.647+0000 7faa01046780 1 < canceled part key=_multipart_XDJAK0XYQNF0.2~1B02YKXN0H00.1 size=200673 2024-09-14T10:54:19.648 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.650+0000 7faa01046780 1 < canceled multipart upload key=XDJAK0XYQNF0 upload=1B02YKXN0H00 tag=3VF5FDATIBPH type=write size=2297825 2024-09-14T10:54:19.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.652+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=R8VB2M7C1WK1 type=del size=3619670 2024-09-14T10:54:19.651 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.653+0000 7faa01046780 -1 < failed to complete operation key=PBRZNGSOLJ8E tag=VEA6KREQFG20 type=del size=865653: (22) Invalid argument 2024-09-14T10:54:19.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.656+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~4KY04AL06XAO.0 size=1048576 2024-09-14T10:54:19.654 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.657+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~4KY04AL06XAO.1 size=1048576 2024-09-14T10:54:19.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.658+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~4KY04AL06XAO.2 size=948069 2024-09-14T10:54:19.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.658+0000 7faa01046780 1 > prepared multipart upload key=V11YJWHT4OOD upload=4KY04AL06XAO tag=QH6I790YST10 type=write size=4093797 2024-09-14T10:54:19.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.659+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~3TX5SSPYZ61Q.0 size=377431 2024-09-14T10:54:19.660 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.662+0000 7faa01046780 1 < completed multipart upload key=ZY0BY3G9NREC upload=3TX5SSPYZ61Q tag=TWYAQ442MAN5 type=write size=1426007 2024-09-14T10:54:19.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.666+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~X20RLUM0OMVZ.0 size=33161 2024-09-14T10:54:19.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.666+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=X20RLUM0OMVZ tag=YOW3NOLX0OT7 type=write size=1081737 2024-09-14T10:54:19.665 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.667+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~G4PNMWRWCS3I.0 size=1048576 2024-09-14T10:54:19.666 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.668+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~G4PNMWRWCS3I.1 size=422183 2024-09-14T10:54:19.669 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.671+0000 7faa01046780 1 < completed multipart upload key=PS2QU1UZUYHE upload=G4PNMWRWCS3I tag=Y6GOMU6AIKJ7 type=write size=2519335 2024-09-14T10:54:19.671 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.673+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=5EIJLXQMVEHX type=del size=3767298 2024-09-14T10:54:19.672 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.674+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~U2S3QJB6KN90.0 size=1038982 2024-09-14T10:54:19.674 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.677+0000 7faa01046780 1 < completed multipart upload key=KDUTH9PIR3FI upload=U2S3QJB6KN90 tag=49V20F1Y0PR0 type=write size=2087558 2024-09-14T10:54:19.677 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.679+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~C22B1CCHREGQ.0 size=1048576 2024-09-14T10:54:19.678 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.681+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~C22B1CCHREGQ.1 size=1048576 2024-09-14T10:54:19.679 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.682+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~C22B1CCHREGQ.2 size=88934 2024-09-14T10:54:19.679 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.682+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=C22B1CCHREGQ tag=Q1TB0JPCJ5AZ type=write size=3234662 2024-09-14T10:54:19.681 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.684+0000 7faa01046780 1 < completed delete operation key=NXIPG4HR9ZYY tag=OOMJ3B6330X2 type=del 2024-09-14T10:54:19.683 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.685+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=J8JAQ6RX2R9Y type=del size=3163697 2024-09-14T10:54:19.684 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.686+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~QI4N6GUN4WG5.0 size=1048576 2024-09-14T10:54:19.685 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.688+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~QI4N6GUN4WG5.1 size=2419 2024-09-14T10:54:19.688 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.690+0000 7faa01046780 1 < completed multipart upload key=LF41PL7DFSJI upload=QI4N6GUN4WG5 tag=XDY2FLC9YM8H type=write size=2099571 2024-09-14T10:54:19.690 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.692+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=D3D8M9ZM2047 type=del size=2352902 2024-09-14T10:54:19.691 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.693+0000 7faa01046780 1 < completed delete operation key=V5T3AN9D7DH6 tag=QQQLAYK3NBHR type=del 2024-09-14T10:54:19.694 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.696+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~D48CQPARTGMN.0 size=1048576 2024-09-14T10:54:19.695 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.697+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~D48CQPARTGMN.1 size=105381 2024-09-14T10:54:19.695 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.697+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=D48CQPARTGMN tag=1O2Q0FQ9SXVT type=write size=2202533 2024-09-14T10:54:19.696 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.698+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~Q2X6G0V4HE0L.0 size=1048576 2024-09-14T10:54:19.697 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.700+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~Q2X6G0V4HE0L.1 size=943387 2024-09-14T10:54:19.699 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.702+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=Q2X6G0V4HE0L tag=M3VH63GEGKZF type=write size=3040539 2024-09-14T10:54:19.702 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.704+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~5W0OFXXCFNP1.0 size=1048576 2024-09-14T10:54:19.703 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.705+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~5W0OFXXCFNP1.1 size=1048576 2024-09-14T10:54:19.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.706+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~5W0OFXXCFNP1.2 size=433240 2024-09-14T10:54:19.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.706+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=5W0OFXXCFNP1 tag=H9M30AHT0LEP type=write size=3578968 2024-09-14T10:54:19.705 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.707+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~MFY2EYKYWESJ.0 size=467262 2024-09-14T10:54:19.707 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.709+0000 7faa01046780 1 < completed multipart upload key=V11YJWHT4OOD upload=MFY2EYKYWESJ tag=SD9H2RQPNDHQ type=write size=1515838 2024-09-14T10:54:19.710 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.712+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~0KL6EANTY649.0 size=1048576 2024-09-14T10:54:19.711 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.713+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~0KL6EANTY649.1 size=1048576 2024-09-14T10:54:19.712 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.714+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~0KL6EANTY649.2 size=215833 2024-09-14T10:54:19.712 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.714+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=0KL6EANTY649 tag=XZICP2KP3BYP type=write size=3361561 2024-09-14T10:54:19.713 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.715+0000 7faa01046780 1 < completed delete operation key=NXIPG4HR9ZYY tag=ML306X39Z530 type=del 2024-09-14T10:54:19.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.717+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=V8F1GZ5VVYDM type=del size=3420947 2024-09-14T10:54:19.716 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.718+0000 7faa01046780 1 < completed delete operation key=0OL3SF5IWDMH tag=09QVRJAHDGG0 type=del 2024-09-14T10:54:19.717 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.719+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=NF2RVWI7Y61Z type=write size=82495 2024-09-14T10:54:19.718 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.721+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=PVKFOL5AZT9V type=del 2024-09-14T10:54:19.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.723+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~3WUQMOC7UP0Y.0 size=93728 2024-09-14T10:54:19.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.723+0000 7faa01046780 1 > prepared multipart upload key=GG02P21TFKIM upload=3WUQMOC7UP0Y tag=GGZ3WBA56HYO type=write size=1142304 2024-09-14T10:54:19.722 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.724+0000 7faa01046780 1 < completed write operation key=PS2QU1UZUYHE tag=JNS5Y7EPL8VP type=write size=311205 2024-09-14T10:54:19.724 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.727+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~FRRXW87B0C6V.0 size=1048576 2024-09-14T10:54:19.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.728+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~FRRXW87B0C6V.1 size=1048576 2024-09-14T10:54:19.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.728+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~FRRXW87B0C6V.2 size=253247 2024-09-14T10:54:19.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.728+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=FRRXW87B0C6V tag=IJKB1T56OO3R type=write size=3398975 2024-09-14T10:54:19.728 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.730+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~VV0DH1J3YAGS.0 size=109976 2024-09-14T10:54:19.730 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.732+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=VV0DH1J3YAGS tag=2I471VH1L77I type=write size=1158552 2024-09-14T10:54:19.732 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.734+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~KT8L8DDM8IX6.0 size=1048576 2024-09-14T10:54:19.733 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.736+0000 7faa01046780 1 > prepared part key=_multipart_ZY0BY3G9NREC.2~KT8L8DDM8IX6.1 size=371520 2024-09-14T10:54:19.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.736+0000 7faa01046780 1 > prepared multipart upload key=ZY0BY3G9NREC upload=KT8L8DDM8IX6 tag=ASNTMPB67J8U type=write size=2468672 2024-09-14T10:54:19.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.737+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~Z48R9KCQ6ZP1.0 size=1048576 2024-09-14T10:54:19.736 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.739+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~Z48R9KCQ6ZP1.1 size=1048576 2024-09-14T10:54:19.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.740+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~Z48R9KCQ6ZP1.2 size=781597 2024-09-14T10:54:19.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.742+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=Z48R9KCQ6ZP1 tag=DRBDXW0L7HK5 type=write size=3927325 2024-09-14T10:54:19.742 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.744+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=P6EBKZ4GK1FC type=del size=186476 2024-09-14T10:54:19.744 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.746+0000 7faa01046780 1 < completed delete operation key=KDUTH9PIR3FI tag=R8VB2M7C1WK1 type=del 2024-09-14T10:54:19.745 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.748+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=AYH32TG8ZT5T type=del size=1069620 2024-09-14T10:54:19.747 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.749+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~4KY04AL06XAO.0 size=1048576 2024-09-14T10:54:19.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.751+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~4KY04AL06XAO.1 size=1048576 2024-09-14T10:54:19.750 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.752+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~4KY04AL06XAO.2 size=948069 2024-09-14T10:54:19.752 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.754+0000 7faa01046780 1 < completed multipart upload key=V11YJWHT4OOD upload=4KY04AL06XAO tag=QH6I790YST10 type=write size=4093797 2024-09-14T10:54:19.754 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.756+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~1N60M31GJ6XX.0 size=934030 2024-09-14T10:54:19.754 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.756+0000 7faa01046780 1 > prepared multipart upload key=PBRZNGSOLJ8E upload=1N60M31GJ6XX tag=2802NIUG71D1 type=write size=1982606 2024-09-14T10:54:19.755 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.758+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~X20RLUM0OMVZ.0 size=33161 2024-09-14T10:54:19.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.760+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=X20RLUM0OMVZ tag=YOW3NOLX0OT7 type=write size=1081737 2024-09-14T10:54:19.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.762+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~FRYPM3UMRZC5.0 size=1048576 2024-09-14T10:54:19.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.763+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~FRYPM3UMRZC5.1 size=1048576 2024-09-14T10:54:19.762 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.764+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~FRYPM3UMRZC5.2 size=141302 2024-09-14T10:54:19.762 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.764+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=FRYPM3UMRZC5 tag=C3IZA0PVT8XT type=write size=3287030 2024-09-14T10:54:19.764 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.766+0000 7faa01046780 1 < completed delete operation key=NXIPG4HR9ZYY tag=5EIJLXQMVEHX type=del 2024-09-14T10:54:19.765 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.767+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=NTYVR9EBL6H2 type=del size=1886715 2024-09-14T10:54:19.766 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.769+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~C22B1CCHREGQ.0 size=1048576 2024-09-14T10:54:19.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.770+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~C22B1CCHREGQ.1 size=1048576 2024-09-14T10:54:19.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.771+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~C22B1CCHREGQ.2 size=88934 2024-09-14T10:54:19.771 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.773+0000 7faa01046780 1 < completed multipart upload key=V5T3AN9D7DH6 upload=C22B1CCHREGQ tag=Q1TB0JPCJ5AZ type=write size=3234662 2024-09-14T10:54:19.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.776+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~HYB1USQ1LU0E.0 size=513741 2024-09-14T10:54:19.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.776+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=HYB1USQ1LU0E tag=YIN05ZCIT8Y6 type=write size=1562317 2024-09-14T10:54:19.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.779+0000 7faa01046780 1 < suggested update operation key=S3BGVJ9N9S4P tag=J8JAQ6RX2R9Y type=del size=3163697 2024-09-14T10:54:19.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.782+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~D8VEK7PS3TQ4.0 size=1048576 2024-09-14T10:54:19.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.783+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~D8VEK7PS3TQ4.1 size=725791 2024-09-14T10:54:19.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.783+0000 7faa01046780 1 > prepared multipart upload key=VIO703UXIJXV upload=D8VEK7PS3TQ4 tag=LPJ9T5T866LF type=write size=2822943 2024-09-14T10:54:19.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.784+0000 7faa01046780 1 < completed delete operation key=Q33ET1AN14NG tag=D3D8M9ZM2047 type=del 2024-09-14T10:54:19.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.787+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~QLMR16VWLPFD.0 size=244547 2024-09-14T10:54:19.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.787+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=QLMR16VWLPFD tag=EZV2Q7VOHRNC type=write size=1293123 2024-09-14T10:54:19.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.788+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~D48CQPARTGMN.0 size=1048576 2024-09-14T10:54:19.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.790+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~D48CQPARTGMN.1 size=105381 2024-09-14T10:54:19.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.792+0000 7faa01046780 1 < completed multipart upload key=V5T3AN9D7DH6 upload=D48CQPARTGMN tag=1O2Q0FQ9SXVT type=write size=2202533 2024-09-14T10:54:19.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.796+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~6MSWG2CWHQ3O.0 size=1048576 2024-09-14T10:54:19.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.797+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~6MSWG2CWHQ3O.1 size=1030070 2024-09-14T10:54:19.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.797+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=6MSWG2CWHQ3O tag=OWLB13M7UEH0 type=write size=3127222 2024-09-14T10:54:19.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.799+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~5W0OFXXCFNP1.0 size=1048576 2024-09-14T10:54:19.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.800+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~5W0OFXXCFNP1.1 size=1048576 2024-09-14T10:54:19.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.801+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~5W0OFXXCFNP1.2 size=433240 2024-09-14T10:54:19.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.803+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=5W0OFXXCFNP1 tag=H9M30AHT0LEP type=write size=3578968 2024-09-14T10:54:19.802 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.804+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=HW0ASV5YQ1U2 type=del size=2489897 2024-09-14T10:54:19.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.806+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~0KL6EANTY649.0 size=1048576 2024-09-14T10:54:19.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.807+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~0KL6EANTY649.1 size=1048576 2024-09-14T10:54:19.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.807+0000 7faa01046780 1 < canceled part key=_multipart_3FSH0OFMF54V.2~0KL6EANTY649.2 size=215833 2024-09-14T10:54:19.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.809+0000 7faa01046780 1 < canceled multipart upload key=3FSH0OFMF54V upload=0KL6EANTY649 tag=XZICP2KP3BYP type=write size=3361561 2024-09-14T10:54:19.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.811+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=IVV8K42X6QL9 type=del size=2407960 2024-09-14T10:54:19.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.812+0000 7faa01046780 1 < canceled operation key=XDJAK0XYQNF0 tag=V8F1GZ5VVYDM type=del size=3420947 2024-09-14T10:54:19.812 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.814+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=GWOFINOVECS7 type=del size=3000265 2024-09-14T10:54:19.814 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.815+0000 7faa01046780 1 < completed write operation key=XH8GHY9YRGTP tag=NF2RVWI7Y61Z type=write size=82495 2024-09-14T10:54:19.815 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.817+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=KGS2SSYSUAAY type=del size=1858763 2024-09-14T10:54:19.816 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.818+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~3WUQMOC7UP0Y.0 size=93728 2024-09-14T10:54:19.819 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.821+0000 7faa01046780 1 < completed multipart upload key=GG02P21TFKIM upload=3WUQMOC7UP0Y tag=GGZ3WBA56HYO type=write size=1142304 2024-09-14T10:54:19.821 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.823+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~7DMQ94FFTJ4K.0 size=1038036 2024-09-14T10:54:19.821 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.823+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=7DMQ94FFTJ4K tag=JBGHW76046RX type=write size=2086612 2024-09-14T10:54:19.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.825+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~FRRXW87B0C6V.0 size=1048576 2024-09-14T10:54:19.824 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.826+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~FRRXW87B0C6V.1 size=1048576 2024-09-14T10:54:19.825 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.827+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~FRRXW87B0C6V.2 size=253247 2024-09-14T10:54:19.827 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.830+0000 7faa01046780 1 < completed multipart upload key=0XVVSUIOBQPL upload=FRRXW87B0C6V tag=IJKB1T56OO3R type=write size=3398975 2024-09-14T10:54:19.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.831+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=UJ54C0R0OW8X type=del size=919929 2024-09-14T10:54:19.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.831+0000 7faa01046780 1 < canceled part key=_multipart_ZY0BY3G9NREC.2~KT8L8DDM8IX6.0 size=1048576 2024-09-14T10:54:19.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.832+0000 7faa01046780 1 < completed part key=_multipart_ZY0BY3G9NREC.2~KT8L8DDM8IX6.1 size=371520 2024-09-14T10:54:19.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.835+0000 7faa01046780 1 < canceled multipart upload key=ZY0BY3G9NREC upload=KT8L8DDM8IX6 tag=ASNTMPB67J8U type=write size=2468672 2024-09-14T10:54:19.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.837+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~EM0PDOGC6MD4.0 size=1042572 2024-09-14T10:54:19.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.837+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=EM0PDOGC6MD4 tag=7RQOWF8SPQZT type=write size=2091148 2024-09-14T10:54:19.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.839+0000 7faa01046780 1 < canceled operation key=PS2QU1UZUYHE tag=P6EBKZ4GK1FC type=del size=186476 2024-09-14T10:54:19.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.840+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=WWK9ZUIY4R92 type=del size=2222974 2024-09-14T10:54:19.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.843+0000 7faa01046780 1 < suggested remove operation key=Y4CB0HIN0750 tag=AYH32TG8ZT5T type=del 2024-09-14T10:54:19.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.846+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~Q9RY2SCEMYH0.0 size=52833 2024-09-14T10:54:19.844 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.846+0000 7faa01046780 1 > prepared multipart upload key=F06QWEOYNQX4 upload=Q9RY2SCEMYH0 tag=QJFHA70UKTSY type=write size=1101409 2024-09-14T10:54:19.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.847+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~1N60M31GJ6XX.0 size=934030 2024-09-14T10:54:19.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.850+0000 7faa01046780 1 < completed multipart upload key=PBRZNGSOLJ8E upload=1N60M31GJ6XX tag=2802NIUG71D1 type=write size=1982606 2024-09-14T10:54:19.850 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.852+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~YB7VI910B4MW.0 size=1048576 2024-09-14T10:54:19.851 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.853+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~YB7VI910B4MW.1 size=1048576 2024-09-14T10:54:19.852 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.854+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~YB7VI910B4MW.2 size=300262 2024-09-14T10:54:19.852 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.854+0000 7faa01046780 1 > prepared multipart upload key=V11YJWHT4OOD upload=YB7VI910B4MW tag=ZO976XGELU3I type=write size=3445990 2024-09-14T10:54:19.854 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.856+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~FRYPM3UMRZC5.0 size=1048576 2024-09-14T10:54:19.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.857+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~FRYPM3UMRZC5.1 size=1048576 2024-09-14T10:54:19.856 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.858+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~FRYPM3UMRZC5.2 size=141302 2024-09-14T10:54:19.858 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.861+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=FRYPM3UMRZC5 tag=C3IZA0PVT8XT type=write size=3287030 2024-09-14T10:54:19.860 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.862+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=E1FKF62T087F type=del size=3618075 2024-09-14T10:54:19.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.863+0000 7faa01046780 1 < completed delete operation key=TDNQZ8Y1C6X2 tag=NTYVR9EBL6H2 type=del 2024-09-14T10:54:19.864 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.866+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~EK6YLH89GKBG.0 size=360253 2024-09-14T10:54:19.864 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.866+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=EK6YLH89GKBG tag=6Z1T9I5I7SBG type=write size=1408829 2024-09-14T10:54:19.865 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.867+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~HYB1USQ1LU0E.0 size=513741 2024-09-14T10:54:19.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.869+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=HYB1USQ1LU0E tag=YIN05ZCIT8Y6 type=write size=1562317 2024-09-14T10:54:19.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.871+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=DZ630AJNJ0Z8 type=del size=3559394 2024-09-14T10:54:19.870 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.872+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~D8VEK7PS3TQ4.0 size=1048576 2024-09-14T10:54:19.871 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.874+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~D8VEK7PS3TQ4.1 size=725791 2024-09-14T10:54:19.874 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.876+0000 7faa01046780 1 < completed multipart upload key=VIO703UXIJXV upload=D8VEK7PS3TQ4 tag=LPJ9T5T866LF type=write size=2822943 2024-09-14T10:54:19.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.878+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=2DIZBVUNS7V4 type=del size=1755283 2024-09-14T10:54:19.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.879+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~QLMR16VWLPFD.0 size=244547 2024-09-14T10:54:19.879 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.881+0000 7faa01046780 1 < completed multipart upload key=Y4CB0HIN0750 upload=QLMR16VWLPFD tag=EZV2Q7VOHRNC type=write size=1293123 2024-09-14T10:54:19.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.883+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=LNO8S09R9H2R type=write size=378954 2024-09-14T10:54:19.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.884+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~6MSWG2CWHQ3O.0 size=1048576 2024-09-14T10:54:19.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.885+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~6MSWG2CWHQ3O.1 size=1030070 2024-09-14T10:54:19.886 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.888+0000 7faa01046780 1 < completed multipart upload key=0XVVSUIOBQPL upload=6MSWG2CWHQ3O tag=OWLB13M7UEH0 type=write size=3127222 2024-09-14T10:54:19.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.891+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~J6CLW9RSYCL9.0 size=463952 2024-09-14T10:54:19.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.891+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=J6CLW9RSYCL9 tag=HQK930CFMT6W type=write size=1512528 2024-09-14T10:54:19.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.892+0000 7faa01046780 1 < canceled operation key=Q33ET1AN14NG tag=HW0ASV5YQ1U2 type=del size=2489897 2024-09-14T10:54:19.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.894+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=CGLZ23H71O7B type=write size=94417 2024-09-14T10:54:19.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.895+0000 7faa01046780 1 < completed delete operation key=3UEX0IPM4CPY tag=IVV8K42X6QL9 type=del 2024-09-14T10:54:19.895 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.897+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=GG9ENRWYO28O type=del size=776979 2024-09-14T10:54:19.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.898+0000 7faa01046780 1 < completed delete operation key=V5T3AN9D7DH6 tag=GWOFINOVECS7 type=del 2024-09-14T10:54:19.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.900+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=5J7KVPG58UCO type=write size=932128 2024-09-14T10:54:19.899 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.901+0000 7faa01046780 1 < completed delete operation key=F872GLVQDCX6 tag=KGS2SSYSUAAY type=del 2024-09-14T10:54:19.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.904+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~SKX7SSCBEHQ3.0 size=1048576 2024-09-14T10:54:19.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.905+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~SKX7SSCBEHQ3.1 size=1048576 2024-09-14T10:54:19.904 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.906+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~SKX7SSCBEHQ3.2 size=299862 2024-09-14T10:54:19.904 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.906+0000 7faa01046780 1 > prepared multipart upload key=GG02P21TFKIM upload=SKX7SSCBEHQ3 tag=UVD1UHJ9ZWI3 type=write size=3445590 2024-09-14T10:54:19.905 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.907+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~7DMQ94FFTJ4K.0 size=1038036 2024-09-14T10:54:19.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.909+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=7DMQ94FFTJ4K tag=JBGHW76046RX type=write size=2086612 2024-09-14T10:54:19.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.911+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=PNOFBS99KRUI type=del size=1209496 2024-09-14T10:54:19.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.914+0000 7faa01046780 1 < suggested update operation key=3FSH0OFMF54V tag=UJ54C0R0OW8X type=del size=919929 2024-09-14T10:54:19.913 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.915+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=Q4NSD9IJ7YNH type=write size=273628 2024-09-14T10:54:19.915 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.917+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~EM0PDOGC6MD4.0 size=1042572 2024-09-14T10:54:19.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.920+0000 7faa01046780 1 < completed multipart upload key=HUBZAFMSCCNC upload=EM0PDOGC6MD4 tag=7RQOWF8SPQZT type=write size=2091148 2024-09-14T10:54:19.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.922+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~6UZ1OM12WNMY.0 size=942719 2024-09-14T10:54:19.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.922+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=6UZ1OM12WNMY tag=YU7U66G27133 type=write size=1991295 2024-09-14T10:54:19.922 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.924+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=WWK9ZUIY4R92 type=del 2024-09-14T10:54:19.923 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.925+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=3PHDZ11S571R type=del size=1639990 2024-09-14T10:54:19.926 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.928+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~Q9RY2SCEMYH0.0 size=52833 2024-09-14T10:54:19.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.930+0000 7faa01046780 1 < completed multipart upload key=F06QWEOYNQX4 upload=Q9RY2SCEMYH0 tag=QJFHA70UKTSY type=write size=1101409 2024-09-14T10:54:19.930 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.933+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~2YFLEKZCD8Z8.0 size=552989 2024-09-14T10:54:19.930 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.933+0000 7faa01046780 1 > prepared multipart upload key=X9DUVQBBLUTF upload=2YFLEKZCD8Z8 tag=KB04XNCBLJCJ type=write size=1601565 2024-09-14T10:54:19.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.933+0000 7faa01046780 1 < canceled part key=_multipart_V11YJWHT4OOD.2~YB7VI910B4MW.0 size=1048576 2024-09-14T10:54:19.932 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.934+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~YB7VI910B4MW.1 size=1048576 2024-09-14T10:54:19.933 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.935+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~YB7VI910B4MW.2 size=300262 2024-09-14T10:54:19.935 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.937+0000 7faa01046780 1 < canceled multipart upload key=V11YJWHT4OOD upload=YB7VI910B4MW tag=ZO976XGELU3I type=write size=3445990 2024-09-14T10:54:19.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.940+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~5UPVX91K5Q8I.0 size=773638 2024-09-14T10:54:19.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.940+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=5UPVX91K5Q8I tag=YVV7HB0OEEDO type=write size=1822214 2024-09-14T10:54:19.939 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.941+0000 7faa01046780 1 < completed delete operation key=0XVVSUIOBQPL tag=E1FKF62T087F type=del 2024-09-14T10:54:19.940 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.943+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=IQGIXCJWRNCQ type=del size=625820 2024-09-14T10:54:19.942 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.944+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~EK6YLH89GKBG.0 size=360253 2024-09-14T10:54:19.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.946+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=EK6YLH89GKBG tag=6Z1T9I5I7SBG type=write size=1408829 2024-09-14T10:54:19.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.948+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~AA83IPQFCZM9.0 size=33350 2024-09-14T10:54:19.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.948+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=AA83IPQFCZM9 tag=2RB1K6UVNZW1 type=write size=1081926 2024-09-14T10:54:19.947 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.950+0000 7faa01046780 1 < completed delete operation key=VIO703UXIJXV tag=DZ630AJNJ0Z8 type=del 2024-09-14T10:54:19.950 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.952+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~HMU9QRZLEDKO.0 size=1048576 2024-09-14T10:54:19.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.953+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~HMU9QRZLEDKO.1 size=1048576 2024-09-14T10:54:19.952 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.955+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~HMU9QRZLEDKO.2 size=242199 2024-09-14T10:54:19.952 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.955+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=HMU9QRZLEDKO tag=9JUE4V372GUE type=write size=3387927 2024-09-14T10:54:19.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.957+0000 7faa01046780 1 < suggested remove operation key=S3BGVJ9N9S4P tag=2DIZBVUNS7V4 type=del 2024-09-14T10:54:19.956 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.959+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=NXXX3Y8E71DM type=del size=1440413 2024-09-14T10:54:19.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.960+0000 7faa01046780 1 < completed write operation key=F06QWEOYNQX4 tag=LNO8S09R9H2R type=write size=378954 2024-09-14T10:54:19.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.961+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=SE9W7CYTMO4W type=del size=1370359 2024-09-14T10:54:19.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.963+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~J6CLW9RSYCL9.0 size=463952 2024-09-14T10:54:19.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.965+0000 7faa01046780 1 < completed multipart upload key=HYAGNAOWK8LF upload=J6CLW9RSYCL9 tag=HQK930CFMT6W type=write size=1512528 2024-09-14T10:54:19.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.966+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=UP58K2M5M26Q type=del size=832679 2024-09-14T10:54:19.966 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.969+0000 7faa01046780 1 < suggested update operation key=F872GLVQDCX6 tag=CGLZ23H71O7B type=write size=94417 2024-09-14T10:54:19.968 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.970+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=7DIFPPPULDG0 type=del size=1365951 2024-09-14T10:54:19.969 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.972+0000 7faa01046780 1 < completed delete operation key=X9DUVQBBLUTF tag=GG9ENRWYO28O type=del 2024-09-14T10:54:19.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.974+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~CXWC745WAJ5I.0 size=1048576 2024-09-14T10:54:19.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.975+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~CXWC745WAJ5I.1 size=1048576 2024-09-14T10:54:19.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.976+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~CXWC745WAJ5I.2 size=560710 2024-09-14T10:54:19.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.976+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=CXWC745WAJ5I tag=82U3W34HHRTD type=write size=3706438 2024-09-14T10:54:19.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.978+0000 7faa01046780 1 < canceled operation key=V5T3AN9D7DH6 tag=5J7KVPG58UCO type=write size=932128 2024-09-14T10:54:19.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.981+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~UGLCG61XX4M0.0 size=463587 2024-09-14T10:54:19.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.981+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=UGLCG61XX4M0 tag=9FQMO0QBINNJ type=write size=1512163 2024-09-14T10:54:19.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.982+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~SKX7SSCBEHQ3.0 size=1048576 2024-09-14T10:54:19.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.984+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~SKX7SSCBEHQ3.1 size=1048576 2024-09-14T10:54:19.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.985+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~SKX7SSCBEHQ3.2 size=299862 2024-09-14T10:54:19.985 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.987+0000 7faa01046780 1 < completed multipart upload key=GG02P21TFKIM upload=SKX7SSCBEHQ3 tag=UVD1UHJ9ZWI3 type=write size=3445590 2024-09-14T10:54:19.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.990+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~O7KXF6C3QKQ4.0 size=1048576 2024-09-14T10:54:19.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.991+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~O7KXF6C3QKQ4.1 size=955332 2024-09-14T10:54:19.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.991+0000 7faa01046780 1 > prepared multipart upload key=TDNQZ8Y1C6X2 upload=O7KXF6C3QKQ4 tag=1N27TBYPG5H3 type=write size=3052484 2024-09-14T10:54:19.990 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.992+0000 7faa01046780 -1 < failed to complete operation key=3FSH0OFMF54V tag=PNOFBS99KRUI type=del size=1209496: (22) Invalid argument 2024-09-14T10:54:19.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.994+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=97I7DRIZWP6O type=del size=947851 2024-09-14T10:54:19.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.995+0000 7faa01046780 1 < completed write operation key=0XVVSUIOBQPL tag=Q4NSD9IJ7YNH type=write size=273628 2024-09-14T10:54:19.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.997+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=H4ZA4SEKQTRP type=del size=2549312 2024-09-14T10:54:19.996 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:19.998+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~6UZ1OM12WNMY.0 size=942719 2024-09-14T10:54:19.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.000+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=6UZ1OM12WNMY tag=YU7U66G27133 type=write size=1991295 2024-09-14T10:54:19.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.002+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=LPIHOFG42KBZ type=del size=506710 2024-09-14T10:54:20.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.003+0000 7faa01046780 1 < completed delete operation key=X9DUVQBBLUTF tag=3PHDZ11S571R type=del 2024-09-14T10:54:20.002 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.005+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=TZ1R7YA7QKOD type=del size=564483 2024-09-14T10:54:20.004 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.006+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~2YFLEKZCD8Z8.0 size=552989 2024-09-14T10:54:20.006 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.008+0000 7faa01046780 1 < completed multipart upload key=X9DUVQBBLUTF upload=2YFLEKZCD8Z8 tag=KB04XNCBLJCJ type=write size=1601565 2024-09-14T10:54:20.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.010+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=BGYUW2JH3GWD type=del size=3945078 2024-09-14T10:54:20.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.011+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~5UPVX91K5Q8I.0 size=773638 2024-09-14T10:54:20.012 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.014+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=5UPVX91K5Q8I tag=YVV7HB0OEEDO type=write size=1822214 2024-09-14T10:54:20.013 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.015+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=CPPL7JBGCS2L type=del size=277548 2024-09-14T10:54:20.015 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.017+0000 7faa01046780 -1 < failed to complete operation key=S3BGVJ9N9S4P tag=IQGIXCJWRNCQ type=del size=625820: (22) Invalid argument 2024-09-14T10:54:20.016 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.018+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=Q7U3F6XUQRL4 type=del size=3684568 2024-09-14T10:54:20.018 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.020+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~AA83IPQFCZM9.0 size=33350 2024-09-14T10:54:20.019 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.022+0000 7faa01046780 1 < completed multipart upload key=HUBZAFMSCCNC upload=AA83IPQFCZM9 tag=2RB1K6UVNZW1 type=write size=1081926 2024-09-14T10:54:20.021 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.023+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=S6S2H7R7Y5L2 type=del size=3655916 2024-09-14T10:54:20.021 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.023+0000 7faa01046780 1 < canceled part key=_multipart_0OL3SF5IWDMH.2~HMU9QRZLEDKO.0 size=1048576 2024-09-14T10:54:20.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.024+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~HMU9QRZLEDKO.1 size=1048576 2024-09-14T10:54:20.023 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.025+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~HMU9QRZLEDKO.2 size=242199 2024-09-14T10:54:20.025 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.028+0000 7faa01046780 1 < canceled multipart upload key=0OL3SF5IWDMH upload=HMU9QRZLEDKO tag=9JUE4V372GUE type=write size=3387927 2024-09-14T10:54:20.027 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.029+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=V9S5ASTTR3D2 type=del size=3304567 2024-09-14T10:54:20.028 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.031+0000 7faa01046780 1 < completed delete operation key=ZY0BY3G9NREC tag=NXXX3Y8E71DM type=del 2024-09-14T10:54:20.030 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.032+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=NP01DCZMC0E1 type=del size=1882379 2024-09-14T10:54:20.032 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.035+0000 7faa01046780 1 < suggested update operation key=F06QWEOYNQX4 tag=SE9W7CYTMO4W type=del size=1370359 2024-09-14T10:54:20.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.037+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~EWP11B7Y3F6T.0 size=1048576 2024-09-14T10:54:20.036 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.038+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~EWP11B7Y3F6T.1 size=1048576 2024-09-14T10:54:20.037 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.039+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~EWP11B7Y3F6T.2 size=775590 2024-09-14T10:54:20.037 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.039+0000 7faa01046780 1 > prepared multipart upload key=GG02P21TFKIM upload=EWP11B7Y3F6T tag=UOI5AA1CSZFL type=write size=3921318 2024-09-14T10:54:20.038 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.040+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=UP58K2M5M26Q type=del 2024-09-14T10:54:20.040 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.042+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=PAPD2D1FB2HZ type=del size=2150160 2024-09-14T10:54:20.041 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.044+0000 7faa01046780 1 < canceled operation key=U8TE0XNK9YKM tag=7DIFPPPULDG0 type=del size=1365951 2024-09-14T10:54:20.043 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.045+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=W56FHG9GJYTB type=del size=2127098 2024-09-14T10:54:20.044 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.047+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~CXWC745WAJ5I.0 size=1048576 2024-09-14T10:54:20.045 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.048+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~CXWC745WAJ5I.1 size=1048576 2024-09-14T10:54:20.047 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.049+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~CXWC745WAJ5I.2 size=560710 2024-09-14T10:54:20.049 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.051+0000 7faa01046780 1 < completed multipart upload key=Y4CB0HIN0750 upload=CXWC745WAJ5I tag=82U3W34HHRTD type=write size=3706438 2024-09-14T10:54:20.051 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.053+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=3P25PRAIA5QJ type=del size=3055326 2024-09-14T10:54:20.051 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.053+0000 7faa01046780 1 < canceled part key=_multipart_BBDTPL35W4W0.2~UGLCG61XX4M0.0 size=463587 2024-09-14T10:54:20.053 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.055+0000 7faa01046780 1 < canceled multipart upload key=BBDTPL35W4W0 upload=UGLCG61XX4M0 tag=9FQMO0QBINNJ type=write size=1512163 2024-09-14T10:54:20.055 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.058+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=J8BEYXIGET4F type=del size=3315191 2024-09-14T10:54:20.057 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.059+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~O7KXF6C3QKQ4.0 size=1048576 2024-09-14T10:54:20.058 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.060+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~O7KXF6C3QKQ4.1 size=955332 2024-09-14T10:54:20.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.063+0000 7faa01046780 1 < completed multipart upload key=TDNQZ8Y1C6X2 upload=O7KXF6C3QKQ4 tag=1N27TBYPG5H3 type=write size=3052484 2024-09-14T10:54:20.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.064+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=UTZEXGU217KD type=del size=1305177 2024-09-14T10:54:20.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.065+0000 7faa01046780 1 < completed delete operation key=GG02P21TFKIM tag=97I7DRIZWP6O type=del 2024-09-14T10:54:20.065 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.067+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=ZOZP2Z6BTESX type=write size=391233 2024-09-14T10:54:20.068 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.068+0000 7faa01046780 1 < completed delete operation key=X9DUVQBBLUTF tag=H4ZA4SEKQTRP type=del 2024-09-14T10:54:20.068 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.069+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=3J3TJ2H0KN0G type=write size=779396 2024-09-14T10:54:20.069 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.071+0000 7faa01046780 1 < canceled operation key=0OL3SF5IWDMH tag=LPIHOFG42KBZ type=del size=506710 2024-09-14T10:54:20.072 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.074+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~QIDTJKCB9YRH.0 size=1048576 2024-09-14T10:54:20.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.075+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~QIDTJKCB9YRH.1 size=1031645 2024-09-14T10:54:20.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.075+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=QIDTJKCB9YRH tag=SRGMWUTP3S71 type=write size=3128797 2024-09-14T10:54:20.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.076+0000 7faa01046780 1 < completed delete operation key=LF41PL7DFSJI tag=TZ1R7YA7QKOD type=del 2024-09-14T10:54:20.077 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.079+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~ITWLYATUZCHX.0 size=1048576 2024-09-14T10:54:20.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.080+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~ITWLYATUZCHX.1 size=849375 2024-09-14T10:54:20.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.080+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=ITWLYATUZCHX tag=IQZAY7L8C5R9 type=write size=2946527 2024-09-14T10:54:20.079 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.081+0000 7faa01046780 1 < completed delete operation key=U8TE0XNK9YKM tag=BGYUW2JH3GWD type=del 2024-09-14T10:54:20.080 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.083+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=TC49WLAPG6K3 type=write size=764130 2024-09-14T10:54:20.082 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.084+0000 7faa01046780 1 < completed delete operation key=3FSH0OFMF54V tag=CPPL7JBGCS2L type=del 2024-09-14T10:54:20.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.085+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=TY55T586J68I type=del size=2897301 2024-09-14T10:54:20.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.087+0000 7faa01046780 1 < canceled operation key=PTDE6D7OIU1A tag=Q7U3F6XUQRL4 type=del size=3684568 2024-09-14T10:54:20.086 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.088+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=RO7QFYYOXOX2 type=write size=34675 2024-09-14T10:54:20.087 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.090+0000 7faa01046780 -1 < failed to complete operation key=F06QWEOYNQX4 tag=S6S2H7R7Y5L2 type=del size=3655916: (22) Invalid argument 2024-09-14T10:54:20.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.092+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~1F1V3GHGV3UQ.0 size=1048576 2024-09-14T10:54:20.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.093+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~1F1V3GHGV3UQ.1 size=25435 2024-09-14T10:54:20.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.093+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=1F1V3GHGV3UQ tag=X8S4QSRF3PFR type=write size=2122587 2024-09-14T10:54:20.093 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.095+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=V9S5ASTTR3D2 type=del 2024-09-14T10:54:20.095 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.098+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~VV5CXLHIXH9L.0 size=1048576 2024-09-14T10:54:20.096 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.099+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~VV5CXLHIXH9L.1 size=1048576 2024-09-14T10:54:20.097 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.100+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~VV5CXLHIXH9L.2 size=603387 2024-09-14T10:54:20.098 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.100+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=VV5CXLHIXH9L tag=9SUW1YDQF0BE type=write size=3749115 2024-09-14T10:54:20.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.101+0000 7faa01046780 1 < completed delete operation key=XH8GHY9YRGTP tag=NP01DCZMC0E1 type=del 2024-09-14T10:54:20.102 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.104+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~I6JLIQ3ZG9CL.0 size=1048576 2024-09-14T10:54:20.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.105+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~I6JLIQ3ZG9CL.1 size=58072 2024-09-14T10:54:20.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.105+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=I6JLIQ3ZG9CL tag=14IMMNABJ6DK type=write size=2155224 2024-09-14T10:54:20.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.107+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~EWP11B7Y3F6T.0 size=1048576 2024-09-14T10:54:20.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.108+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~EWP11B7Y3F6T.1 size=1048576 2024-09-14T10:54:20.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.109+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~EWP11B7Y3F6T.2 size=775590 2024-09-14T10:54:20.109 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.111+0000 7faa01046780 1 < completed multipart upload key=GG02P21TFKIM upload=EWP11B7Y3F6T tag=UOI5AA1CSZFL type=write size=3921318 2024-09-14T10:54:20.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.114+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~NFMDPRXVLX39.0 size=1048576 2024-09-14T10:54:20.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.115+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~NFMDPRXVLX39.1 size=959420 2024-09-14T10:54:20.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.115+0000 7faa01046780 1 > prepared multipart upload key=F06QWEOYNQX4 upload=NFMDPRXVLX39 tag=FTQW44KW3L6H type=write size=3056572 2024-09-14T10:54:20.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.116+0000 7faa01046780 1 < canceled operation key=F06QWEOYNQX4 tag=PAPD2D1FB2HZ type=del size=2150160 2024-09-14T10:54:20.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.118+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=8FQNO5RI551G type=del size=459055 2024-09-14T10:54:20.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.119+0000 7faa01046780 1 < completed delete operation key=XH8GHY9YRGTP tag=W56FHG9GJYTB type=del 2024-09-14T10:54:20.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.121+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=OP2HHHWMWGEO type=del size=2097363 2024-09-14T10:54:20.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.122+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=3P25PRAIA5QJ type=del 2024-09-14T10:54:20.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.124+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=052OO3ULMDLH type=del size=1080809 2024-09-14T10:54:20.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.125+0000 7faa01046780 1 < completed delete operation key=V905BR1VWUCV tag=J8BEYXIGET4F type=del 2024-09-14T10:54:20.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.127+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~3ZU1BRPM4V2K.0 size=543446 2024-09-14T10:54:20.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.127+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=3ZU1BRPM4V2K tag=362XJP3PHO3W type=write size=1592022 2024-09-14T10:54:20.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.129+0000 7faa01046780 1 < completed delete operation key=PBRZNGSOLJ8E tag=UTZEXGU217KD type=del 2024-09-14T10:54:20.129 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.132+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~MC5C4LT8IOYL.0 size=1048576 2024-09-14T10:54:20.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.133+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~MC5C4LT8IOYL.1 size=878787 2024-09-14T10:54:20.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.133+0000 7faa01046780 1 > prepared multipart upload key=GG02P21TFKIM upload=MC5C4LT8IOYL tag=J3C8MYVXL17J type=write size=2975939 2024-09-14T10:54:20.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.134+0000 7faa01046780 1 < completed write operation key=KDUTH9PIR3FI tag=ZOZP2Z6BTESX type=write size=391233 2024-09-14T10:54:20.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.136+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=P7NW007STWO3 type=del size=2405784 2024-09-14T10:54:20.135 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.137+0000 7faa01046780 1 < completed write operation key=3UEX0IPM4CPY tag=3J3TJ2H0KN0G type=write size=779396 2024-09-14T10:54:20.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.139+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~KDGRY9UGUWJS.0 size=182335 2024-09-14T10:54:20.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.139+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=KDGRY9UGUWJS tag=IRB9FU7YND74 type=write size=1230911 2024-09-14T10:54:20.138 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.141+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~QIDTJKCB9YRH.0 size=1048576 2024-09-14T10:54:20.138 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.141+0000 7faa01046780 1 < canceled part key=_multipart_U8TE0XNK9YKM.2~QIDTJKCB9YRH.1 size=1031645 2024-09-14T10:54:20.140 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.143+0000 7faa01046780 1 < canceled multipart upload key=U8TE0XNK9YKM upload=QIDTJKCB9YRH tag=SRGMWUTP3S71 type=write size=3128797 2024-09-14T10:54:20.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.145+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~1GCWXLFYYHHD.0 size=919024 2024-09-14T10:54:20.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.145+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=1GCWXLFYYHHD tag=0MKMD5XDFN2U type=write size=1967600 2024-09-14T10:54:20.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.147+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~ITWLYATUZCHX.0 size=1048576 2024-09-14T10:54:20.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.148+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~ITWLYATUZCHX.1 size=849375 2024-09-14T10:54:20.148 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.150+0000 7faa01046780 1 < completed multipart upload key=0OL3SF5IWDMH upload=ITWLYATUZCHX tag=IQZAY7L8C5R9 type=write size=2946527 2024-09-14T10:54:20.149 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.151+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=Q666OSE6CSKK type=write size=739704 2024-09-14T10:54:20.152 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.154+0000 7faa01046780 1 < suggested remove operation key=BBDTPL35W4W0 tag=TC49WLAPG6K3 type=write 2024-09-14T10:54:20.153 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.156+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=232A2HLD0KZQ type=del size=1827098 2024-09-14T10:54:20.155 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.157+0000 7faa01046780 1 < canceled operation key=Y4CB0HIN0750 tag=TY55T586J68I type=del size=2897301 2024-09-14T10:54:20.156 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.159+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=L5353T6IXJ5P type=del size=3872522 2024-09-14T10:54:20.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.162+0000 7faa01046780 1 < suggested remove operation key=F06QWEOYNQX4 tag=RO7QFYYOXOX2 type=write 2024-09-14T10:54:20.162 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.164+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~7AIGZKNPNN0R.0 size=1048576 2024-09-14T10:54:20.163 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.166+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~7AIGZKNPNN0R.1 size=1048576 2024-09-14T10:54:20.164 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.167+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~7AIGZKNPNN0R.2 size=645918 2024-09-14T10:54:20.165 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.167+0000 7faa01046780 1 > prepared multipart upload key=X9DUVQBBLUTF upload=7AIGZKNPNN0R tag=R7LT7XXEX6HM type=write size=3791646 2024-09-14T10:54:20.166 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.168+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~1F1V3GHGV3UQ.0 size=1048576 2024-09-14T10:54:20.167 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.169+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~1F1V3GHGV3UQ.1 size=25435 2024-09-14T10:54:20.169 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.172+0000 7faa01046780 1 < completed multipart upload key=HUBZAFMSCCNC upload=1F1V3GHGV3UQ tag=X8S4QSRF3PFR type=write size=2122587 2024-09-14T10:54:20.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.174+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~PF2VE4A077XJ.0 size=1048576 2024-09-14T10:54:20.173 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.175+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~PF2VE4A077XJ.1 size=1048576 2024-09-14T10:54:20.174 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.177+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~PF2VE4A077XJ.2 size=301121 2024-09-14T10:54:20.174 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.177+0000 7faa01046780 1 > prepared multipart upload key=F06QWEOYNQX4 upload=PF2VE4A077XJ tag=CZVKDV2RXV77 type=write size=3446849 2024-09-14T10:54:20.176 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.178+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~VV5CXLHIXH9L.0 size=1048576 2024-09-14T10:54:20.177 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.179+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~VV5CXLHIXH9L.1 size=1048576 2024-09-14T10:54:20.177 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.179+0000 7faa01046780 1 < canceled part key=_multipart_3FSH0OFMF54V.2~VV5CXLHIXH9L.2 size=603387 2024-09-14T10:54:20.179 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.182+0000 7faa01046780 1 < canceled multipart upload key=3FSH0OFMF54V upload=VV5CXLHIXH9L tag=9SUW1YDQF0BE type=write size=3749115 2024-09-14T10:54:20.182 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.184+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~X20TTUPJ58W1.0 size=1048576 2024-09-14T10:54:20.183 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.185+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~X20TTUPJ58W1.1 size=337972 2024-09-14T10:54:20.183 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.185+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=X20TTUPJ58W1 tag=FBDYX0WT48FR type=write size=2435124 2024-09-14T10:54:20.185 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.187+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~I6JLIQ3ZG9CL.0 size=1048576 2024-09-14T10:54:20.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.189+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~I6JLIQ3ZG9CL.1 size=58072 2024-09-14T10:54:20.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.191+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=I6JLIQ3ZG9CL tag=14IMMNABJ6DK type=write size=2155224 2024-09-14T10:54:20.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.193+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=T6TFQKZCPICH type=del size=3914915 2024-09-14T10:54:20.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.194+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~NFMDPRXVLX39.0 size=1048576 2024-09-14T10:54:20.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.195+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~NFMDPRXVLX39.1 size=959420 2024-09-14T10:54:20.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.198+0000 7faa01046780 1 < completed multipart upload key=F06QWEOYNQX4 upload=NFMDPRXVLX39 tag=FTQW44KW3L6H type=write size=3056572 2024-09-14T10:54:20.198 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.200+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~PA1J3VSEA1PQ.0 size=927092 2024-09-14T10:54:20.198 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.200+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=PA1J3VSEA1PQ tag=2DDHNXO6U6JV type=write size=1975668 2024-09-14T10:54:20.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.204+0000 7faa01046780 1 < suggested remove operation key=KDUTH9PIR3FI tag=8FQNO5RI551G type=del 2024-09-14T10:54:20.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.207+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~HED27IYSKB74.0 size=1048576 2024-09-14T10:54:20.206 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.208+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~HED27IYSKB74.1 size=1048576 2024-09-14T10:54:20.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.210+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~HED27IYSKB74.2 size=1036302 2024-09-14T10:54:20.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.210+0000 7faa01046780 1 > prepared multipart upload key=PS2QU1UZUYHE upload=HED27IYSKB74 tag=CESCTWVEALGP type=write size=4182030 2024-09-14T10:54:20.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.211+0000 7faa01046780 1 < canceled operation key=PTDE6D7OIU1A tag=OP2HHHWMWGEO type=del size=2097363 2024-09-14T10:54:20.211 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.213+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=Q4BL7BY9325S type=del size=3424449 2024-09-14T10:54:20.213 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.215+0000 7faa01046780 1 < completed delete operation key=V11YJWHT4OOD tag=052OO3ULMDLH type=del 2024-09-14T10:54:20.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.216+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=1QPJNPYUI0YK type=del size=2756833 2024-09-14T10:54:20.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.218+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~3ZU1BRPM4V2K.0 size=543446 2024-09-14T10:54:20.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.220+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=3ZU1BRPM4V2K tag=362XJP3PHO3W type=write size=1592022 2024-09-14T10:54:20.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.221+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=R8A6LJYWUENR type=del size=3072888 2024-09-14T10:54:20.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.223+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~MC5C4LT8IOYL.0 size=1048576 2024-09-14T10:54:20.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.224+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~MC5C4LT8IOYL.1 size=878787 2024-09-14T10:54:20.224 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.226+0000 7faa01046780 1 < completed multipart upload key=GG02P21TFKIM upload=MC5C4LT8IOYL tag=J3C8MYVXL17J type=write size=2975939 2024-09-14T10:54:20.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.228+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=0CZPPA7AMU9S type=del size=440335 2024-09-14T10:54:20.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.230+0000 7faa01046780 1 < canceled operation key=F872GLVQDCX6 tag=P7NW007STWO3 type=del size=2405784 2024-09-14T10:54:20.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.231+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=DAJ575X5P340 type=del size=1544451 2024-09-14T10:54:20.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.233+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~KDGRY9UGUWJS.0 size=182335 2024-09-14T10:54:20.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.235+0000 7faa01046780 1 < completed multipart upload key=KDUTH9PIR3FI upload=KDGRY9UGUWJS tag=IRB9FU7YND74 type=write size=1230911 2024-09-14T10:54:20.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.236+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=MSGDFQJ728QA type=del size=2297228 2024-09-14T10:54:20.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.238+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~1GCWXLFYYHHD.0 size=919024 2024-09-14T10:54:20.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.240+0000 7faa01046780 1 < completed multipart upload key=Y4CB0HIN0750 upload=1GCWXLFYYHHD tag=0MKMD5XDFN2U type=write size=1967600 2024-09-14T10:54:20.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.242+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=OJJXDXFNAFAW type=write size=956474 2024-09-14T10:54:20.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.245+0000 7faa01046780 1 < suggested remove operation key=TDNQZ8Y1C6X2 tag=Q666OSE6CSKK type=write 2024-09-14T10:54:20.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.247+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=4AUN863EB13Y type=del size=2142894 2024-09-14T10:54:20.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.248+0000 7faa01046780 1 < canceled operation key=3FSH0OFMF54V tag=232A2HLD0KZQ type=del size=1827098 2024-09-14T10:54:20.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.250+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=0N6ASXXS10VL type=write size=610270 2024-09-14T10:54:20.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.251+0000 7faa01046780 1 < completed delete operation key=V905BR1VWUCV tag=L5353T6IXJ5P type=del 2024-09-14T10:54:20.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.252+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=BWEJ187VWFQI type=write size=446458 2024-09-14T10:54:20.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.254+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~7AIGZKNPNN0R.0 size=1048576 2024-09-14T10:54:20.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.255+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~7AIGZKNPNN0R.1 size=1048576 2024-09-14T10:54:20.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.256+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~7AIGZKNPNN0R.2 size=645918 2024-09-14T10:54:20.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.258+0000 7faa01046780 1 < completed multipart upload key=X9DUVQBBLUTF upload=7AIGZKNPNN0R tag=R7LT7XXEX6HM type=write size=3791646 2024-09-14T10:54:20.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.260+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=JNBMP3YWYSW6 type=del size=245685 2024-09-14T10:54:20.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.261+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~PF2VE4A077XJ.0 size=1048576 2024-09-14T10:54:20.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.263+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~PF2VE4A077XJ.1 size=1048576 2024-09-14T10:54:20.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.263+0000 7faa01046780 1 < canceled part key=_multipart_F06QWEOYNQX4.2~PF2VE4A077XJ.2 size=301121 2024-09-14T10:54:20.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.265+0000 7faa01046780 1 < canceled multipart upload key=F06QWEOYNQX4 upload=PF2VE4A077XJ tag=CZVKDV2RXV77 type=write size=3446849 2024-09-14T10:54:20.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.267+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=00RT4CHLJXP2 type=del size=2499414 2024-09-14T10:54:20.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.268+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~X20TTUPJ58W1.0 size=1048576 2024-09-14T10:54:20.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.270+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~X20TTUPJ58W1.1 size=337972 2024-09-14T10:54:20.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.272+0000 7faa01046780 1 < completed multipart upload key=CKMDOO75UZGE upload=X20TTUPJ58W1 tag=FBDYX0WT48FR type=write size=2435124 2024-09-14T10:54:20.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.273+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=2ZY7IS8IWYZO type=del size=2755552 2024-09-14T10:54:20.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.276+0000 7faa01046780 1 < suggested remove operation key=0OL3SF5IWDMH tag=T6TFQKZCPICH type=del 2024-09-14T10:54:20.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.277+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=TIHQHBVJD11P type=del size=352745 2024-09-14T10:54:20.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.278+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~PA1J3VSEA1PQ.0 size=927092 2024-09-14T10:54:20.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.281+0000 7faa01046780 1 < completed multipart upload key=KDUTH9PIR3FI upload=PA1J3VSEA1PQ tag=2DDHNXO6U6JV type=write size=1975668 2024-09-14T10:54:20.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.282+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=901DAM48OH0Q type=del size=1022897 2024-09-14T10:54:20.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.284+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~HED27IYSKB74.0 size=1048576 2024-09-14T10:54:20.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.285+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~HED27IYSKB74.1 size=1048576 2024-09-14T10:54:20.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.286+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~HED27IYSKB74.2 size=1036302 2024-09-14T10:54:20.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.289+0000 7faa01046780 1 < completed multipart upload key=PS2QU1UZUYHE upload=HED27IYSKB74 tag=CESCTWVEALGP type=write size=4182030 2024-09-14T10:54:20.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.290+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=3T0UQ0C6GA8S type=del size=2079469 2024-09-14T10:54:20.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.292+0000 7faa01046780 1 < completed delete operation key=V5T3AN9D7DH6 tag=Q4BL7BY9325S type=del 2024-09-14T10:54:20.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.293+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=HX3XJ9787S00 type=del size=2118469 2024-09-14T10:54:20.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.295+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=1QPJNPYUI0YK type=del 2024-09-14T10:54:20.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.297+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~DD2MAOW9YC0S.0 size=872202 2024-09-14T10:54:20.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.297+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=DD2MAOW9YC0S tag=J5EM4R09RA8W type=write size=1920778 2024-09-14T10:54:20.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.299+0000 7faa01046780 1 < completed delete operation key=V905BR1VWUCV tag=R8A6LJYWUENR type=del 2024-09-14T10:54:20.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.301+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=BT27JB0YCU4L type=del size=2790025 2024-09-14T10:54:20.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.302+0000 7faa01046780 1 < canceled operation key=V11YJWHT4OOD tag=0CZPPA7AMU9S type=del size=440335 2024-09-14T10:54:20.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.304+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=OIRH7RM1QMG1 type=del size=4178302 2024-09-14T10:54:20.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.307+0000 7faa01046780 1 < suggested update operation key=HYAGNAOWK8LF tag=DAJ575X5P340 type=del size=1544451 2024-09-14T10:54:20.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.308+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=4ZF0U05O62TW type=write size=430863 2024-09-14T10:54:20.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.311+0000 7faa01046780 1 < suggested update operation key=0OL3SF5IWDMH tag=MSGDFQJ728QA type=del size=2297228 2024-09-14T10:54:20.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.314+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~3J74PQFONO15.0 size=335320 2024-09-14T10:54:20.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.314+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=3J74PQFONO15 tag=NAZA1N594NTM type=write size=1383896 2024-09-14T10:54:20.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.316+0000 7faa01046780 1 < completed write operation key=U8TE0XNK9YKM tag=OJJXDXFNAFAW type=write size=956474 2024-09-14T10:54:20.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.317+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=9EM8ZU8A6G7K type=del size=3463379 2024-09-14T10:54:20.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.318+0000 7faa01046780 1 < canceled operation key=3FSH0OFMF54V tag=4AUN863EB13Y type=del size=2142894 2024-09-14T10:54:20.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.320+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=RR285P9B2W2L type=del size=3638552 2024-09-14T10:54:20.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.322+0000 7faa01046780 1 < completed write operation key=X9DUVQBBLUTF tag=0N6ASXXS10VL type=write size=610270 2024-09-14T10:54:20.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.323+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=HKH5M1BC1CQC type=del size=3977256 2024-09-14T10:54:20.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.326+0000 7faa01046780 1 < suggested update operation key=FOJGGEQZD7YW tag=BWEJ187VWFQI type=write size=446458 2024-09-14T10:54:20.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.328+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=3UXWFPVNBE6I type=del size=3876493 2024-09-14T10:54:20.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.333+0000 7faa01046780 1 < suggested update operation key=HUBZAFMSCCNC tag=JNBMP3YWYSW6 type=del size=245685 2024-09-14T10:54:20.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.334+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=O41N86T8YWOP type=del size=810701 2024-09-14T10:54:20.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.337+0000 7faa01046780 1 < suggested remove operation key=GG02P21TFKIM tag=00RT4CHLJXP2 type=del 2024-09-14T10:54:20.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.340+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~N3Y6N6RYIW60.0 size=1048576 2024-09-14T10:54:20.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.341+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~N3Y6N6RYIW60.1 size=183715 2024-09-14T10:54:20.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.341+0000 7faa01046780 1 > prepared multipart upload key=TDNQZ8Y1C6X2 upload=N3Y6N6RYIW60 tag=J8VG4QUZKSZC type=write size=2280867 2024-09-14T10:54:20.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.343+0000 7faa01046780 1 < completed delete operation key=V905BR1VWUCV tag=2ZY7IS8IWYZO type=del 2024-09-14T10:54:20.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.345+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~BR9R97H3SD7R.0 size=38898 2024-09-14T10:54:20.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.345+0000 7faa01046780 1 > prepared multipart upload key=F872GLVQDCX6 upload=BR9R97H3SD7R tag=1FWHFP50UWYB type=write size=1087474 2024-09-14T10:54:20.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.348+0000 7faa01046780 1 < suggested update operation key=FOJGGEQZD7YW tag=TIHQHBVJD11P type=del size=352745 2024-09-14T10:54:20.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.350+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=2OK7Q2XUS3L7 type=write size=52121 2024-09-14T10:54:20.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.351+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=901DAM48OH0Q type=del 2024-09-14T10:54:20.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.353+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=PW3278KTA9DC type=del size=707431 2024-09-14T10:54:20.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.356+0000 7faa01046780 1 < suggested remove operation key=U8TE0XNK9YKM tag=3T0UQ0C6GA8S type=del 2024-09-14T10:54:20.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.358+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~AKA202NLGNXQ.0 size=1048576 2024-09-14T10:54:20.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.359+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~AKA202NLGNXQ.1 size=507074 2024-09-14T10:54:20.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.359+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=AKA202NLGNXQ tag=K1UIZHL2YGBH type=write size=2604226 2024-09-14T10:54:20.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.361+0000 7faa01046780 1 < canceled operation key=XDJAK0XYQNF0 tag=HX3XJ9787S00 type=del size=2118469 2024-09-14T10:54:20.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.363+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~74RH7J1LMNE1.0 size=1048576 2024-09-14T10:54:20.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.364+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~74RH7J1LMNE1.1 size=998912 2024-09-14T10:54:20.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.364+0000 7faa01046780 1 > prepared multipart upload key=FOJGGEQZD7YW upload=74RH7J1LMNE1 tag=V4V2QGEZA302 type=write size=3096064 2024-09-14T10:54:20.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.365+0000 7faa01046780 1 < canceled part key=_multipart_XH8GHY9YRGTP.2~DD2MAOW9YC0S.0 size=872202 2024-09-14T10:54:20.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.367+0000 7faa01046780 1 < canceled multipart upload key=XH8GHY9YRGTP upload=DD2MAOW9YC0S tag=J5EM4R09RA8W type=write size=1920778 2024-09-14T10:54:20.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.369+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=65G2PSHY6BFM type=write size=187832 2024-09-14T10:54:20.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.372+0000 7faa01046780 1 < suggested update operation key=BBDTPL35W4W0 tag=BT27JB0YCU4L type=del size=2790025 2024-09-14T10:54:20.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.375+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~CP4RBHGOAMFO.0 size=1048576 2024-09-14T10:54:20.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.376+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~CP4RBHGOAMFO.1 size=994150 2024-09-14T10:54:20.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.376+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=CP4RBHGOAMFO tag=1RM4M1VOVB3P type=write size=3091302 2024-09-14T10:54:20.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.377+0000 7faa01046780 -1 < failed to complete operation key=0OL3SF5IWDMH tag=OIRH7RM1QMG1 type=del size=4178302: (22) Invalid argument 2024-09-14T10:54:20.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.380+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~EIAITAMF9DX9.0 size=375575 2024-09-14T10:54:20.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.380+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=EIAITAMF9DX9 tag=HJPYI67RC13R type=write size=1424151 2024-09-14T10:54:20.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.381+0000 7faa01046780 1 < completed write operation key=3UEX0IPM4CPY tag=4ZF0U05O62TW type=write size=430863 2024-09-14T10:54:20.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.384+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~CYZ2T1EN154P.0 size=1015576 2024-09-14T10:54:20.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.384+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=CYZ2T1EN154P tag=3NCS9B6F2U3F type=write size=2064152 2024-09-14T10:54:20.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.385+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~3J74PQFONO15.0 size=335320 2024-09-14T10:54:20.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.387+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=3J74PQFONO15 tag=NAZA1N594NTM type=write size=1383896 2024-09-14T10:54:20.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.390+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~5O4Q5ZBY63A8.0 size=1048576 2024-09-14T10:54:20.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.391+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~5O4Q5ZBY63A8.1 size=1048576 2024-09-14T10:54:20.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.392+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~5O4Q5ZBY63A8.2 size=732912 2024-09-14T10:54:20.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.392+0000 7faa01046780 1 > prepared multipart upload key=GG02P21TFKIM upload=5O4Q5ZBY63A8 tag=C9MN1TEUR10J type=write size=3878640 2024-09-14T10:54:20.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.393+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=9EM8ZU8A6G7K type=del 2024-09-14T10:54:20.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.395+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=YPBZR4T2L84J type=del size=778088 2024-09-14T10:54:20.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.396+0000 7faa01046780 1 < completed delete operation key=3UEX0IPM4CPY tag=RR285P9B2W2L type=del 2024-09-14T10:54:20.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.399+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~3M624E4R2HGW.0 size=1048576 2024-09-14T10:54:20.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.400+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~3M624E4R2HGW.1 size=1048576 2024-09-14T10:54:20.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.401+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~3M624E4R2HGW.2 size=917476 2024-09-14T10:54:20.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.401+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=3M624E4R2HGW tag=R87MLM6ICZ28 type=write size=4063204 2024-09-14T10:54:20.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.402+0000 7faa01046780 1 < completed delete operation key=0OL3SF5IWDMH tag=HKH5M1BC1CQC type=del 2024-09-14T10:54:20.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.404+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=TR27ZBIDPQWR type=del size=3914144 2024-09-14T10:54:20.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.405+0000 7faa01046780 -1 < failed to complete operation key=U8TE0XNK9YKM tag=3UXWFPVNBE6I type=del size=3876493: (22) Invalid argument 2024-09-14T10:54:20.423 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.407+0000 7faa01046780 1 > prepared operation key=SJ02N8472YDM tag=A5E0UTPBFUQ8 type=del size=2435440 2024-09-14T10:54:20.423 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.408+0000 7faa01046780 1 < completed delete operation key=PBRZNGSOLJ8E tag=O41N86T8YWOP type=del 2024-09-14T10:54:20.423 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.409+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=P762BLQAKFQF type=write size=543085 2024-09-14T10:54:20.423 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.411+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~N3Y6N6RYIW60.0 size=1048576 2024-09-14T10:54:20.423 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.412+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~N3Y6N6RYIW60.1 size=183715 2024-09-14T10:54:20.423 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.414+0000 7faa01046780 1 < completed multipart upload key=TDNQZ8Y1C6X2 upload=N3Y6N6RYIW60 tag=J8VG4QUZKSZC type=write size=2280867 2024-09-14T10:54:20.423 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.415+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=ID2MPBM9C7RD type=write size=76558 2024-09-14T10:54:20.424 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.417+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~BR9R97H3SD7R.0 size=38898 2024-09-14T10:54:20.424 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.419+0000 7faa01046780 1 < completed multipart upload key=F872GLVQDCX6 upload=BR9R97H3SD7R tag=1FWHFP50UWYB type=write size=1087474 2024-09-14T10:54:20.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.420+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=P656L2VFWVM4 type=del size=2960809 2024-09-14T10:54:20.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.422+0000 7faa01046780 1 < canceled operation key=S3BGVJ9N9S4P tag=2OK7Q2XUS3L7 type=write size=52121 2024-09-14T10:54:20.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.423+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=6SFOET5HH2C7 type=del size=2059486 2024-09-14T10:54:20.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.425+0000 7faa01046780 1 < completed delete operation key=Q33ET1AN14NG tag=PW3278KTA9DC type=del 2024-09-14T10:54:20.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.427+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=9NLVGGNX6G7E type=del size=1545556 2024-09-14T10:54:20.426 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.428+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~AKA202NLGNXQ.0 size=1048576 2024-09-14T10:54:20.427 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.429+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~AKA202NLGNXQ.1 size=507074 2024-09-14T10:54:20.429 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.431+0000 7faa01046780 1 < completed multipart upload key=S3BGVJ9N9S4P upload=AKA202NLGNXQ tag=K1UIZHL2YGBH type=write size=2604226 2024-09-14T10:54:20.432 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.434+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~B7RPI5OR8MES.0 size=1048576 2024-09-14T10:54:20.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.435+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~B7RPI5OR8MES.1 size=207055 2024-09-14T10:54:20.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.435+0000 7faa01046780 1 > prepared multipart upload key=LF41PL7DFSJI upload=B7RPI5OR8MES tag=N332AWGQ9052 type=write size=2304207 2024-09-14T10:54:20.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.437+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~74RH7J1LMNE1.0 size=1048576 2024-09-14T10:54:20.436 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.438+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~74RH7J1LMNE1.1 size=998912 2024-09-14T10:54:20.438 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.440+0000 7faa01046780 1 < completed multipart upload key=FOJGGEQZD7YW upload=74RH7J1LMNE1 tag=V4V2QGEZA302 type=write size=3096064 2024-09-14T10:54:20.440 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.442+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=WR3LYMMMU2RY type=del size=2204738 2024-09-14T10:54:20.441 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.444+0000 7faa01046780 1 < completed write operation key=Y4CB0HIN0750 tag=65G2PSHY6BFM type=write size=187832 2024-09-14T10:54:20.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.446+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=PQKPCW0Z9YFD type=del size=2773151 2024-09-14T10:54:20.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.447+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~CP4RBHGOAMFO.0 size=1048576 2024-09-14T10:54:20.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.447+0000 7faa01046780 1 < canceled part key=_multipart_S3BGVJ9N9S4P.2~CP4RBHGOAMFO.1 size=994150 2024-09-14T10:54:20.447 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.450+0000 7faa01046780 1 < canceled multipart upload key=S3BGVJ9N9S4P upload=CP4RBHGOAMFO tag=1RM4M1VOVB3P type=write size=3091302 2024-09-14T10:54:20.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.451+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=ULMISTCF2VEB type=del size=1436364 2024-09-14T10:54:20.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.453+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~EIAITAMF9DX9.0 size=375575 2024-09-14T10:54:20.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.455+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=EIAITAMF9DX9 tag=HJPYI67RC13R type=write size=1424151 2024-09-14T10:54:20.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.456+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=7UIOJL1NXUQF type=write size=350282 2024-09-14T10:54:20.456 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.458+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~CYZ2T1EN154P.0 size=1015576 2024-09-14T10:54:20.458 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.460+0000 7faa01046780 1 < completed multipart upload key=U8TE0XNK9YKM upload=CYZ2T1EN154P tag=3NCS9B6F2U3F type=write size=2064152 2024-09-14T10:54:20.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.463+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~7AHIYNDWG8ZL.0 size=1048576 2024-09-14T10:54:20.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.464+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~7AHIYNDWG8ZL.1 size=302129 2024-09-14T10:54:20.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.464+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=7AHIYNDWG8ZL tag=T9L4UKXVN34Z type=write size=2399281 2024-09-14T10:54:20.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.467+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~5O4Q5ZBY63A8.0 size=1048576 2024-09-14T10:54:20.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.468+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~5O4Q5ZBY63A8.1 size=1048576 2024-09-14T10:54:20.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.469+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~5O4Q5ZBY63A8.2 size=732912 2024-09-14T10:54:20.470 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.472+0000 7faa01046780 1 < completed multipart upload key=GG02P21TFKIM upload=5O4Q5ZBY63A8 tag=C9MN1TEUR10J type=write size=3878640 2024-09-14T10:54:20.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.474+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~I3RX0L61RC2I.0 size=13368 2024-09-14T10:54:20.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.474+0000 7faa01046780 1 > prepared multipart upload key=PS2QU1UZUYHE upload=I3RX0L61RC2I tag=27L1MOUXMV7H type=write size=1061944 2024-09-14T10:54:20.473 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.476+0000 7faa01046780 1 < canceled operation key=Y4CB0HIN0750 tag=YPBZR4T2L84J type=del size=778088 2024-09-14T10:54:20.476 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.478+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~3JMO64MVD4KA.0 size=1048576 2024-09-14T10:54:20.477 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.479+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~3JMO64MVD4KA.1 size=1048576 2024-09-14T10:54:20.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.480+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~3JMO64MVD4KA.2 size=969510 2024-09-14T10:54:20.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.480+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=3JMO64MVD4KA tag=6059F5ZWL9EL type=write size=4115238 2024-09-14T10:54:20.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.482+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~3M624E4R2HGW.0 size=1048576 2024-09-14T10:54:20.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.483+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~3M624E4R2HGW.1 size=1048576 2024-09-14T10:54:20.482 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.484+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~3M624E4R2HGW.2 size=917476 2024-09-14T10:54:20.484 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.486+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=3M624E4R2HGW tag=R87MLM6ICZ28 type=write size=4063204 2024-09-14T10:54:20.486 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.489+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~9FRGU7K5VBQ3.0 size=1048576 2024-09-14T10:54:20.487 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.490+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~9FRGU7K5VBQ3.1 size=182322 2024-09-14T10:54:20.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.490+0000 7faa01046780 1 > prepared multipart upload key=PS2QU1UZUYHE upload=9FRGU7K5VBQ3 tag=XK76MTFVB2LR type=write size=2279474 2024-09-14T10:54:20.490 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.492+0000 7faa01046780 1 < suggested remove operation key=CKMDOO75UZGE tag=TR27ZBIDPQWR type=del 2024-09-14T10:54:20.491 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.494+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=MQ7E93P5PH2E type=del size=2733673 2024-09-14T10:54:20.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.495+0000 7faa01046780 1 < completed delete operation key=SJ02N8472YDM tag=A5E0UTPBFUQ8 type=del 2024-09-14T10:54:20.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.496+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=6T1M22BRP6MA type=del size=1830456 2024-09-14T10:54:20.496 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.498+0000 7faa01046780 1 < completed write operation key=3FSH0OFMF54V tag=P762BLQAKFQF type=write size=543085 2024-09-14T10:54:20.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.499+0000 7faa01046780 1 > prepared operation key=SJ02N8472YDM tag=TKOUA9TSG2EW type=del size=3540666 2024-09-14T10:54:20.498 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.501+0000 7faa01046780 1 < canceled operation key=GG02P21TFKIM tag=ID2MPBM9C7RD type=write size=76558 2024-09-14T10:54:20.500 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.502+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=YDSSOKPZHROR type=del size=74489 2024-09-14T10:54:20.501 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.503+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=P656L2VFWVM4 type=del 2024-09-14T10:54:20.503 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.506+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~L5HKBFJRUYOE.0 size=1048576 2024-09-14T10:54:20.504 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.507+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~L5HKBFJRUYOE.1 size=1048576 2024-09-14T10:54:20.505 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.508+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~L5HKBFJRUYOE.2 size=189393 2024-09-14T10:54:20.506 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.508+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=L5HKBFJRUYOE tag=ZEPGJ2S8PSAT type=write size=3335121 2024-09-14T10:54:20.507 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.509+0000 7faa01046780 1 < canceled operation key=S3BGVJ9N9S4P tag=6SFOET5HH2C7 type=del size=2059486 2024-09-14T10:54:20.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.510+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=50TUY1ZAOS9T type=del size=2446515 2024-09-14T10:54:20.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.513+0000 7faa01046780 1 < suggested remove operation key=PS2QU1UZUYHE tag=9NLVGGNX6G7E type=del 2024-09-14T10:54:20.512 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.515+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=O2BB6MMGRMSN type=del size=41887 2024-09-14T10:54:20.514 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.516+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~B7RPI5OR8MES.0 size=1048576 2024-09-14T10:54:20.515 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.518+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~B7RPI5OR8MES.1 size=207055 2024-09-14T10:54:20.518 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.520+0000 7faa01046780 1 < completed multipart upload key=LF41PL7DFSJI upload=B7RPI5OR8MES tag=N332AWGQ9052 type=write size=2304207 2024-09-14T10:54:20.519 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.522+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=773LFJAKXTTX type=del size=221757 2024-09-14T10:54:20.521 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.523+0000 7faa01046780 1 < completed delete operation key=3FSH0OFMF54V tag=WR3LYMMMU2RY type=del 2024-09-14T10:54:20.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.526+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~KW0OOJ8XSV70.0 size=759397 2024-09-14T10:54:20.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.526+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=KW0OOJ8XSV70 tag=4CFK305ROSY0 type=write size=1807973 2024-09-14T10:54:20.526 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.528+0000 7faa01046780 1 < completed delete operation key=F872GLVQDCX6 tag=PQKPCW0Z9YFD type=del 2024-09-14T10:54:20.528 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.530+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=DOWUH45RLSQO type=del size=1526619 2024-09-14T10:54:20.529 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.531+0000 7faa01046780 1 < completed delete operation key=V5T3AN9D7DH6 tag=ULMISTCF2VEB type=del 2024-09-14T10:54:20.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.533+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=FAUE61B7Y6YM type=del size=770464 2024-09-14T10:54:20.534 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.536+0000 7faa01046780 1 < suggested remove operation key=BBDTPL35W4W0 tag=7UIOJL1NXUQF type=write 2024-09-14T10:54:20.535 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.537+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=GQX6CBCQPJHY type=del size=787537 2024-09-14T10:54:20.536 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.539+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~7AHIYNDWG8ZL.0 size=1048576 2024-09-14T10:54:20.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.540+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~7AHIYNDWG8ZL.1 size=302129 2024-09-14T10:54:20.539 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.542+0000 7faa01046780 1 < completed multipart upload key=0XVVSUIOBQPL upload=7AHIYNDWG8ZL tag=T9L4UKXVN34Z type=write size=2399281 2024-09-14T10:54:20.541 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.543+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=L1FT8N8B0IWA type=del size=2774816 2024-09-14T10:54:20.542 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.545+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~I3RX0L61RC2I.0 size=13368 2024-09-14T10:54:20.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.547+0000 7faa01046780 1 < completed multipart upload key=PS2QU1UZUYHE upload=I3RX0L61RC2I tag=27L1MOUXMV7H type=write size=1061944 2024-09-14T10:54:20.547 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.549+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~17Y5LLBVC1I7.0 size=578150 2024-09-14T10:54:20.547 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.549+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=17Y5LLBVC1I7 tag=MNO1VOFK3Z0E type=write size=1626726 2024-09-14T10:54:20.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.551+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~3JMO64MVD4KA.0 size=1048576 2024-09-14T10:54:20.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.552+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~3JMO64MVD4KA.1 size=1048576 2024-09-14T10:54:20.551 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.553+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~3JMO64MVD4KA.2 size=969510 2024-09-14T10:54:20.553 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.555+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=3JMO64MVD4KA tag=6059F5ZWL9EL type=write size=4115238 2024-09-14T10:54:20.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.557+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=AJTHI3SYS42N type=del size=2118657 2024-09-14T10:54:20.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.557+0000 7faa01046780 1 < canceled part key=_multipart_PS2QU1UZUYHE.2~9FRGU7K5VBQ3.0 size=1048576 2024-09-14T10:54:20.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.558+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~9FRGU7K5VBQ3.1 size=182322 2024-09-14T10:54:20.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.560+0000 7faa01046780 1 < canceled multipart upload key=PS2QU1UZUYHE upload=9FRGU7K5VBQ3 tag=XK76MTFVB2LR type=write size=2279474 2024-09-14T10:54:20.561 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.563+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~UVBX4VRUV8XT.0 size=1048576 2024-09-14T10:54:20.562 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.564+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~UVBX4VRUV8XT.1 size=218604 2024-09-14T10:54:20.562 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.564+0000 7faa01046780 1 > prepared multipart upload key=LF41PL7DFSJI upload=UVBX4VRUV8XT tag=GBWNILXIGT8A type=write size=2315756 2024-09-14T10:54:20.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.566+0000 7faa01046780 1 < completed delete operation key=V5T3AN9D7DH6 tag=MQ7E93P5PH2E type=del 2024-09-14T10:54:20.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.569+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~JCYFPOGDZHOG.0 size=1048576 2024-09-14T10:54:20.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.570+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~JCYFPOGDZHOG.1 size=1048576 2024-09-14T10:54:20.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.571+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~JCYFPOGDZHOG.2 size=988289 2024-09-14T10:54:20.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.571+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=JCYFPOGDZHOG tag=EW3F8UH5V31Q type=write size=4134017 2024-09-14T10:54:20.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.573+0000 7faa01046780 1 < canceled operation key=LF41PL7DFSJI tag=6T1M22BRP6MA type=del size=1830456 2024-09-14T10:54:20.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.574+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=D3W2622URF40 type=del size=3202419 2024-09-14T10:54:20.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.576+0000 7faa01046780 1 < completed delete operation key=SJ02N8472YDM tag=TKOUA9TSG2EW type=del 2024-09-14T10:54:20.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.578+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~RMAJQJVHP90K.0 size=1048576 2024-09-14T10:54:20.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.580+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~RMAJQJVHP90K.1 size=583589 2024-09-14T10:54:20.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.580+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=RMAJQJVHP90K tag=1JA307IXQ22X type=write size=2680741 2024-09-14T10:54:20.579 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.581+0000 7faa01046780 1 < canceled operation key=S3BGVJ9N9S4P tag=YDSSOKPZHROR type=del size=74489 2024-09-14T10:54:20.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.583+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=HZ4T06KVQA0Z type=del size=1094613 2024-09-14T10:54:20.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.584+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~L5HKBFJRUYOE.0 size=1048576 2024-09-14T10:54:20.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.585+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~L5HKBFJRUYOE.1 size=1048576 2024-09-14T10:54:20.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.586+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~L5HKBFJRUYOE.2 size=189393 2024-09-14T10:54:20.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.589+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=L5HKBFJRUYOE tag=ZEPGJ2S8PSAT type=write size=3335121 2024-09-14T10:54:20.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.591+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~OP3AM852KOEG.0 size=950694 2024-09-14T10:54:20.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.591+0000 7faa01046780 1 > prepared multipart upload key=F872GLVQDCX6 upload=OP3AM852KOEG tag=O3NYK2PV8GKS type=write size=1999270 2024-09-14T10:54:20.591 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.593+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=50TUY1ZAOS9T type=del 2024-09-14T10:54:20.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.595+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~FSZ993BBGYFT.0 size=1048576 2024-09-14T10:54:20.594 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.596+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~FSZ993BBGYFT.1 size=186112 2024-09-14T10:54:20.594 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.596+0000 7faa01046780 1 > prepared multipart upload key=F872GLVQDCX6 upload=FSZ993BBGYFT tag=Q4RA1IXXME5K type=write size=2283264 2024-09-14T10:54:20.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.599+0000 7faa01046780 1 < completed delete operation key=HYAGNAOWK8LF tag=O2BB6MMGRMSN type=del 2024-09-14T10:54:20.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.601+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=KF2NEG9Q6ITY type=del size=1167518 2024-09-14T10:54:20.601 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.603+0000 7faa01046780 1 < suggested remove operation key=U8TE0XNK9YKM tag=773LFJAKXTTX type=del 2024-09-14T10:54:20.603 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.605+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=30XX5U183G70 type=del size=3368076 2024-09-14T10:54:20.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.606+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~KW0OOJ8XSV70.0 size=759397 2024-09-14T10:54:20.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.609+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=KW0OOJ8XSV70 tag=4CFK305ROSY0 type=write size=1807973 2024-09-14T10:54:20.609 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.611+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~6BE7RBFLAV0L.0 size=997001 2024-09-14T10:54:20.609 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.611+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=6BE7RBFLAV0L tag=Y2SECBO6VAVB type=write size=2045577 2024-09-14T10:54:20.610 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.613+0000 7faa01046780 1 < completed delete operation key=NXIPG4HR9ZYY tag=DOWUH45RLSQO type=del 2024-09-14T10:54:20.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.614+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=4XW9QJ7X0UCJ type=del size=4166504 2024-09-14T10:54:20.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.615+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=FAUE61B7Y6YM type=del 2024-09-14T10:54:20.615 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.617+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=1K2RNON09U18 type=del size=1675419 2024-09-14T10:54:20.616 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.619+0000 7faa01046780 1 < completed delete operation key=PBRZNGSOLJ8E tag=GQX6CBCQPJHY type=del 2024-09-14T10:54:20.618 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.620+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=K7PDTYT8M3FI type=del size=228255 2024-09-14T10:54:20.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.621+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=L1FT8N8B0IWA type=del 2024-09-14T10:54:20.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.623+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=8RJ6FYJ9VGF2 type=write size=844147 2024-09-14T10:54:20.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.624+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~17Y5LLBVC1I7.0 size=578150 2024-09-14T10:54:20.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.626+0000 7faa01046780 1 < completed multipart upload key=HUBZAFMSCCNC upload=17Y5LLBVC1I7 tag=MNO1VOFK3Z0E type=write size=1626726 2024-09-14T10:54:20.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.628+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=E9GMBDMYAWJT type=del size=3985569 2024-09-14T10:54:20.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.629+0000 7faa01046780 1 < completed delete operation key=V905BR1VWUCV tag=AJTHI3SYS42N type=del 2024-09-14T10:54:20.630 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.632+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~XOFGJW6PNJ7D.0 size=1048576 2024-09-14T10:54:20.631 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.633+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~XOFGJW6PNJ7D.1 size=898309 2024-09-14T10:54:20.631 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.633+0000 7faa01046780 1 > prepared multipart upload key=3UEX0IPM4CPY upload=XOFGJW6PNJ7D tag=2SY0Z810B2DF type=write size=2995461 2024-09-14T10:54:20.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.635+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~UVBX4VRUV8XT.0 size=1048576 2024-09-14T10:54:20.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.636+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~UVBX4VRUV8XT.1 size=218604 2024-09-14T10:54:20.636 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.638+0000 7faa01046780 1 < completed multipart upload key=LF41PL7DFSJI upload=UVBX4VRUV8XT tag=GBWNILXIGT8A type=write size=2315756 2024-09-14T10:54:20.637 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.640+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=78Q8LG4CTVM2 type=write size=886359 2024-09-14T10:54:20.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.641+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~JCYFPOGDZHOG.0 size=1048576 2024-09-14T10:54:20.640 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.642+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~JCYFPOGDZHOG.1 size=1048576 2024-09-14T10:54:20.640 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.642+0000 7faa01046780 1 < canceled part key=_multipart_CKMDOO75UZGE.2~JCYFPOGDZHOG.2 size=988289 2024-09-14T10:54:20.642 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.644+0000 7faa01046780 1 < canceled multipart upload key=CKMDOO75UZGE upload=JCYFPOGDZHOG tag=EW3F8UH5V31Q type=write size=4134017 2024-09-14T10:54:20.644 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.646+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=GM8BYZ7B2YQ9 type=del size=1543301 2024-09-14T10:54:20.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.647+0000 7faa01046780 -1 < failed to complete operation key=U8TE0XNK9YKM tag=D3W2622URF40 type=del size=3202419: (22) Invalid argument 2024-09-14T10:54:20.648 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.650+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~4PB90G07ROHL.0 size=1048576 2024-09-14T10:54:20.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.651+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~4PB90G07ROHL.1 size=1048576 2024-09-14T10:54:20.650 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.652+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~4PB90G07ROHL.2 size=233976 2024-09-14T10:54:20.650 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.652+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=4PB90G07ROHL tag=G4O9OVX6A1NP type=write size=3379704 2024-09-14T10:54:20.651 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.654+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~RMAJQJVHP90K.0 size=1048576 2024-09-14T10:54:20.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.655+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~RMAJQJVHP90K.1 size=583589 2024-09-14T10:54:20.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.657+0000 7faa01046780 1 < completed multipart upload key=HUBZAFMSCCNC upload=RMAJQJVHP90K tag=1JA307IXQ22X type=write size=2680741 2024-09-14T10:54:20.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.658+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=6OYVK1HH8Y2Y type=del size=4083954 2024-09-14T10:54:20.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.660+0000 7faa01046780 1 < completed delete operation key=NXIPG4HR9ZYY tag=HZ4T06KVQA0Z type=del 2024-09-14T10:54:20.659 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.661+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=GE833TY88C5W type=del size=741858 2024-09-14T10:54:20.661 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.663+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~OP3AM852KOEG.0 size=950694 2024-09-14T10:54:20.663 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.665+0000 7faa01046780 1 < completed multipart upload key=F872GLVQDCX6 upload=OP3AM852KOEG tag=O3NYK2PV8GKS type=write size=1999270 2024-09-14T10:54:20.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.666+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=AWTPOMXV508V type=del size=3395520 2024-09-14T10:54:20.666 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.668+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~FSZ993BBGYFT.0 size=1048576 2024-09-14T10:54:20.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.669+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~FSZ993BBGYFT.1 size=186112 2024-09-14T10:54:20.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.672+0000 7faa01046780 1 < completed multipart upload key=F872GLVQDCX6 upload=FSZ993BBGYFT tag=Q4RA1IXXME5K type=write size=2283264 2024-09-14T10:54:20.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.673+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=A2QTERZ07H80 type=del size=1751697 2024-09-14T10:54:20.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.675+0000 7faa01046780 1 < completed delete operation key=V5T3AN9D7DH6 tag=KF2NEG9Q6ITY type=del 2024-09-14T10:54:20.674 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.676+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=20FQGP9IT7RH type=del size=36156 2024-09-14T10:54:20.675 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.678+0000 7faa01046780 1 < completed delete operation key=VIO703UXIJXV tag=30XX5U183G70 type=del 2024-09-14T10:54:20.678 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.680+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~2LHZ0I5YQI2S.0 size=507317 2024-09-14T10:54:20.678 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.680+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=2LHZ0I5YQI2S tag=JZ6RZ4RXAQA1 type=write size=1555893 2024-09-14T10:54:20.679 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.681+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~6BE7RBFLAV0L.0 size=997001 2024-09-14T10:54:20.681 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.684+0000 7faa01046780 1 < completed multipart upload key=Y4CB0HIN0750 upload=6BE7RBFLAV0L tag=Y2SECBO6VAVB type=write size=2045577 2024-09-14T10:54:20.683 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.685+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=NGLYD5Q4MKAX type=del size=4031161 2024-09-14T10:54:20.684 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.686+0000 7faa01046780 1 < completed delete operation key=NXIPG4HR9ZYY tag=4XW9QJ7X0UCJ type=del 2024-09-14T10:54:20.686 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.688+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=F4OXML32I00C type=del size=3110545 2024-09-14T10:54:20.687 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.689+0000 7faa01046780 1 < completed delete operation key=V5T3AN9D7DH6 tag=1K2RNON09U18 type=del 2024-09-14T10:54:20.689 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.691+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=HDBR301C1PKA type=del size=2644659 2024-09-14T10:54:20.690 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.692+0000 7faa01046780 1 < completed delete operation key=X9DUVQBBLUTF tag=K7PDTYT8M3FI type=del 2024-09-14T10:54:20.692 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.694+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=C9CQ4O4SY1AQ type=del size=3064900 2024-09-14T10:54:20.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.696+0000 7faa01046780 1 < completed write operation key=BBDTPL35W4W0 tag=8RJ6FYJ9VGF2 type=write size=844147 2024-09-14T10:54:20.696 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.699+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~EWAQSVQMYOVY.0 size=1048576 2024-09-14T10:54:20.698 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.700+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~EWAQSVQMYOVY.1 size=1048576 2024-09-14T10:54:20.699 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.701+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~EWAQSVQMYOVY.2 size=718782 2024-09-14T10:54:20.699 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.701+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=EWAQSVQMYOVY tag=F17BWV7ZQAQW type=write size=3864510 2024-09-14T10:54:20.702 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.704+0000 7faa01046780 1 < suggested remove operation key=FOJGGEQZD7YW tag=E9GMBDMYAWJT type=del 2024-09-14T10:54:20.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.706+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=3NN0UAW5S00I type=del size=1920614 2024-09-14T10:54:20.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.706+0000 7faa01046780 1 < canceled part key=_multipart_3UEX0IPM4CPY.2~XOFGJW6PNJ7D.0 size=1048576 2024-09-14T10:54:20.705 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.707+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~XOFGJW6PNJ7D.1 size=898309 2024-09-14T10:54:20.707 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.710+0000 7faa01046780 1 < canceled multipart upload key=3UEX0IPM4CPY upload=XOFGJW6PNJ7D tag=2SY0Z810B2DF type=write size=2995461 2024-09-14T10:54:20.709 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.711+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=G7JGPNFJCY7C type=write size=576241 2024-09-14T10:54:20.710 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.713+0000 7faa01046780 1 < completed write operation key=PTDE6D7OIU1A tag=78Q8LG4CTVM2 type=write size=886359 2024-09-14T10:54:20.712 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.714+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=7ZLTCX22E1MS type=write size=346569 2024-09-14T10:54:20.713 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.716+0000 7faa01046780 1 < canceled operation key=0XVVSUIOBQPL tag=GM8BYZ7B2YQ9 type=del size=1543301 2024-09-14T10:54:20.715 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.717+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=1QKY49OZQX19 type=del size=2361970 2024-09-14T10:54:20.716 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.718+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~4PB90G07ROHL.0 size=1048576 2024-09-14T10:54:20.717 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.719+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~4PB90G07ROHL.1 size=1048576 2024-09-14T10:54:20.718 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.721+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~4PB90G07ROHL.2 size=233976 2024-09-14T10:54:20.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.723+0000 7faa01046780 1 < completed multipart upload key=0XVVSUIOBQPL upload=4PB90G07ROHL tag=G4O9OVX6A1NP type=write size=3379704 2024-09-14T10:54:20.722 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.724+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=WXW5XYCA68N0 type=write size=1033552 2024-09-14T10:54:20.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.726+0000 7faa01046780 1 < completed delete operation key=PS2QU1UZUYHE tag=6OYVK1HH8Y2Y type=del 2024-09-14T10:54:20.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.728+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~HMO18RC5726F.0 size=910047 2024-09-14T10:54:20.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.728+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=HMO18RC5726F tag=IZ92P09NOJ18 type=write size=1958623 2024-09-14T10:54:20.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.730+0000 7faa01046780 1 < canceled operation key=PS2QU1UZUYHE tag=GE833TY88C5W type=del size=741858 2024-09-14T10:54:20.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.731+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=7IAPLN5OGBRO type=del size=889057 2024-09-14T10:54:20.731 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.733+0000 7faa01046780 1 < completed delete operation key=TDNQZ8Y1C6X2 tag=AWTPOMXV508V type=del 2024-09-14T10:54:20.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.737+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~D2ZGYBZTOLJQ.0 size=239131 2024-09-14T10:54:20.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.737+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=D2ZGYBZTOLJQ tag=2994F30CU4RG type=write size=1287707 2024-09-14T10:54:20.736 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.738+0000 7faa01046780 1 < completed delete operation key=0XVVSUIOBQPL tag=A2QTERZ07H80 type=del 2024-09-14T10:54:20.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.740+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=CEDAJYY992BM type=write size=333257 2024-09-14T10:54:20.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.741+0000 7faa01046780 1 < completed delete operation key=Q33ET1AN14NG tag=20FQGP9IT7RH type=del 2024-09-14T10:54:20.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.744+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~3K1O320ZQ8ZU.0 size=915671 2024-09-14T10:54:20.742 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.744+0000 7faa01046780 1 > prepared multipart upload key=SJ02N8472YDM upload=3K1O320ZQ8ZU tag=I233I4FM6SV0 type=write size=1964247 2024-09-14T10:54:20.743 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.745+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~2LHZ0I5YQI2S.0 size=507317 2024-09-14T10:54:20.745 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.748+0000 7faa01046780 1 < completed multipart upload key=0OL3SF5IWDMH upload=2LHZ0I5YQI2S tag=JZ6RZ4RXAQA1 type=write size=1555893 2024-09-14T10:54:20.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.750+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~AXZXZPFB229U.0 size=1048576 2024-09-14T10:54:20.749 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.751+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~AXZXZPFB229U.1 size=330174 2024-09-14T10:54:20.749 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.751+0000 7faa01046780 1 > prepared multipart upload key=F872GLVQDCX6 upload=AXZXZPFB229U tag=9YM9AGTKKTV1 type=write size=2427326 2024-09-14T10:54:20.751 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.753+0000 7faa01046780 1 < completed delete operation key=GG02P21TFKIM tag=NGLYD5Q4MKAX type=del 2024-09-14T10:54:20.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.755+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~D8OE1KOVVMHL.0 size=1048576 2024-09-14T10:54:20.754 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.756+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~D8OE1KOVVMHL.1 size=800101 2024-09-14T10:54:20.754 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.756+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=D8OE1KOVVMHL tag=0UP03WRG9DXP type=write size=2897253 2024-09-14T10:54:20.756 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.758+0000 7faa01046780 1 < completed delete operation key=TDNQZ8Y1C6X2 tag=F4OXML32I00C type=del 2024-09-14T10:54:20.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.760+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~12SQUNFZ1ZR0.0 size=1048576 2024-09-14T10:54:20.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.761+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~12SQUNFZ1ZR0.1 size=1048576 2024-09-14T10:54:20.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.762+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~12SQUNFZ1ZR0.2 size=667983 2024-09-14T10:54:20.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.762+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=12SQUNFZ1ZR0 tag=CW0XU444WKWN type=write size=3813711 2024-09-14T10:54:20.762 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.764+0000 7faa01046780 -1 < failed to complete operation key=FOJGGEQZD7YW tag=HDBR301C1PKA type=del size=2644659: (22) Invalid argument 2024-09-14T10:54:20.763 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.765+0000 7faa01046780 1 > prepared operation key=SJ02N8472YDM tag=NQ5Q7ZFI5B8W type=write size=131225 2024-09-14T10:54:20.764 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.767+0000 7faa01046780 1 < completed delete operation key=HYAGNAOWK8LF tag=C9CQ4O4SY1AQ type=del 2024-09-14T10:54:20.766 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.768+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=BE2S4U104XNH type=del size=3719422 2024-09-14T10:54:20.767 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.769+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~EWAQSVQMYOVY.0 size=1048576 2024-09-14T10:54:20.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.770+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~EWAQSVQMYOVY.1 size=1048576 2024-09-14T10:54:20.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.772+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~EWAQSVQMYOVY.2 size=718782 2024-09-14T10:54:20.771 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.774+0000 7faa01046780 1 < completed multipart upload key=CKMDOO75UZGE upload=EWAQSVQMYOVY tag=F17BWV7ZQAQW type=write size=3864510 2024-09-14T10:54:20.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.776+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~S71XNF2STXN9.0 size=1048576 2024-09-14T10:54:20.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.777+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~S71XNF2STXN9.1 size=328678 2024-09-14T10:54:20.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.777+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=S71XNF2STXN9 tag=CS0JSMMQILDF type=write size=2425830 2024-09-14T10:54:20.777 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.779+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=3NN0UAW5S00I type=del 2024-09-14T10:54:20.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.781+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~SIBV68Q95FMU.0 size=637404 2024-09-14T10:54:20.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.781+0000 7faa01046780 1 > prepared multipart upload key=SJ02N8472YDM upload=SIBV68Q95FMU tag=FGKE0W2Y9EOZ type=write size=1685980 2024-09-14T10:54:20.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.783+0000 7faa01046780 1 < completed write operation key=S3BGVJ9N9S4P tag=G7JGPNFJCY7C type=write size=576241 2024-09-14T10:54:20.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.786+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~5185UZIDA3ZS.0 size=1048576 2024-09-14T10:54:20.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.787+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~5185UZIDA3ZS.1 size=1048576 2024-09-14T10:54:20.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.788+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~5185UZIDA3ZS.2 size=624490 2024-09-14T10:54:20.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.788+0000 7faa01046780 1 > prepared multipart upload key=SJ02N8472YDM upload=5185UZIDA3ZS tag=011RYN1ZQF7Z type=write size=3770218 2024-09-14T10:54:20.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.790+0000 7faa01046780 1 < suggested update operation key=3FSH0OFMF54V tag=7ZLTCX22E1MS type=write size=346569 2024-09-14T10:54:20.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.792+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=6O77PFFX16GL type=del size=2370414 2024-09-14T10:54:20.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.793+0000 7faa01046780 1 < completed delete operation key=PTDE6D7OIU1A tag=1QKY49OZQX19 type=del 2024-09-14T10:54:20.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.795+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=JVV1SU4O8TFO type=del size=3110220 2024-09-14T10:54:20.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.796+0000 7faa01046780 1 < completed write operation key=F06QWEOYNQX4 tag=WXW5XYCA68N0 type=write size=1033552 2024-09-14T10:54:20.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.799+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~X19KQ0N2ZWIN.0 size=1048576 2024-09-14T10:54:20.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.800+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~X19KQ0N2ZWIN.1 size=1048576 2024-09-14T10:54:20.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.801+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~X19KQ0N2ZWIN.2 size=200755 2024-09-14T10:54:20.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.801+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=X19KQ0N2ZWIN tag=1GBOSI83ZY9M type=write size=3346483 2024-09-14T10:54:20.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.803+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~HMO18RC5726F.0 size=910047 2024-09-14T10:54:20.803 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.805+0000 7faa01046780 1 < completed multipart upload key=XDJAK0XYQNF0 upload=HMO18RC5726F tag=IZ92P09NOJ18 type=write size=1958623 2024-09-14T10:54:20.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.806+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=C4SLB3HSK5UF type=del size=1068714 2024-09-14T10:54:20.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.808+0000 7faa01046780 1 < canceled operation key=VIO703UXIJXV tag=7IAPLN5OGBRO type=del size=889057 2024-09-14T10:54:20.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.810+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~FYOMQDDE35C7.0 size=1048576 2024-09-14T10:54:20.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.811+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~FYOMQDDE35C7.1 size=1048576 2024-09-14T10:54:20.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.812+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~FYOMQDDE35C7.2 size=980449 2024-09-14T10:54:20.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.812+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=FYOMQDDE35C7 tag=57XYGK67XRU5 type=write size=4126177 2024-09-14T10:54:20.811 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.814+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~D2ZGYBZTOLJQ.0 size=239131 2024-09-14T10:54:20.814 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.816+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=D2ZGYBZTOLJQ tag=2994F30CU4RG type=write size=1287707 2024-09-14T10:54:20.815 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.817+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=9E9S0H4WJIAI type=del size=2218713 2024-09-14T10:54:20.818 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.820+0000 7faa01046780 1 < suggested remove operation key=FOJGGEQZD7YW tag=CEDAJYY992BM type=write 2024-09-14T10:54:20.819 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.822+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=I1KWNVUUNPB7 type=write size=717149 2024-09-14T10:54:20.820 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.822+0000 7faa01046780 1 < canceled part key=_multipart_SJ02N8472YDM.2~3K1O320ZQ8ZU.0 size=915671 2024-09-14T10:54:20.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.824+0000 7faa01046780 1 < canceled multipart upload key=SJ02N8472YDM upload=3K1O320ZQ8ZU tag=I233I4FM6SV0 type=write size=1964247 2024-09-14T10:54:20.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.826+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=PUWFILF22L1Z type=del size=3417214 2024-09-14T10:54:20.825 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.827+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~AXZXZPFB229U.0 size=1048576 2024-09-14T10:54:20.826 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.828+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~AXZXZPFB229U.1 size=330174 2024-09-14T10:54:20.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.831+0000 7faa01046780 1 < completed multipart upload key=F872GLVQDCX6 upload=AXZXZPFB229U tag=9YM9AGTKKTV1 type=write size=2427326 2024-09-14T10:54:20.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.832+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=VZ792XSMFYWT type=del size=3517683 2024-09-14T10:54:20.831 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.833+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~D8OE1KOVVMHL.0 size=1048576 2024-09-14T10:54:20.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.835+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~D8OE1KOVVMHL.1 size=800101 2024-09-14T10:54:20.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.837+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=D8OE1KOVVMHL tag=0UP03WRG9DXP type=write size=2897253 2024-09-14T10:54:20.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.838+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=I9LNJRZ7QH5O type=write size=917704 2024-09-14T10:54:20.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.840+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~12SQUNFZ1ZR0.0 size=1048576 2024-09-14T10:54:20.839 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.841+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~12SQUNFZ1ZR0.1 size=1048576 2024-09-14T10:54:20.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.842+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~12SQUNFZ1ZR0.2 size=667983 2024-09-14T10:54:20.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.844+0000 7faa01046780 1 < completed multipart upload key=CKMDOO75UZGE upload=12SQUNFZ1ZR0 tag=CW0XU444WKWN type=write size=3813711 2024-09-14T10:54:20.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.846+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=4AZTK62YADH2 type=del size=497005 2024-09-14T10:54:20.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.847+0000 7faa01046780 1 < completed write operation key=SJ02N8472YDM tag=NQ5Q7ZFI5B8W type=write size=131225 2024-09-14T10:54:20.847 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.849+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~ZS94PYUOIBJL.0 size=1042275 2024-09-14T10:54:20.847 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.849+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=ZS94PYUOIBJL tag=V3URSLNEVRVW type=write size=2090851 2024-09-14T10:54:20.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.851+0000 7faa01046780 1 < completed delete operation key=X9DUVQBBLUTF tag=BE2S4U104XNH type=del 2024-09-14T10:54:20.850 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.853+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=DPLU71VMUFJ7 type=del size=4091646 2024-09-14T10:54:20.852 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.854+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~S71XNF2STXN9.0 size=1048576 2024-09-14T10:54:20.853 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.855+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~S71XNF2STXN9.1 size=328678 2024-09-14T10:54:20.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.858+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=S71XNF2STXN9 tag=CS0JSMMQILDF type=write size=2425830 2024-09-14T10:54:20.858 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.860+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~HTV80LIMBJRM.0 size=430020 2024-09-14T10:54:20.858 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.860+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=HTV80LIMBJRM tag=LF7DZ16UP0BP type=write size=1478596 2024-09-14T10:54:20.860 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.862+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~SIBV68Q95FMU.0 size=637404 2024-09-14T10:54:20.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.865+0000 7faa01046780 1 < completed multipart upload key=SJ02N8472YDM upload=SIBV68Q95FMU tag=FGKE0W2Y9EOZ type=write size=1685980 2024-09-14T10:54:20.865 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.867+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=SF8S6T2WMF8G type=del size=757411 2024-09-14T10:54:20.865 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.867+0000 7faa01046780 1 < canceled part key=_multipart_SJ02N8472YDM.2~5185UZIDA3ZS.0 size=1048576 2024-09-14T10:54:20.866 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.869+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~5185UZIDA3ZS.1 size=1048576 2024-09-14T10:54:20.866 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.869+0000 7faa01046780 1 < canceled part key=_multipart_SJ02N8472YDM.2~5185UZIDA3ZS.2 size=624490 2024-09-14T10:54:20.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.871+0000 7faa01046780 1 < canceled multipart upload key=SJ02N8472YDM upload=5185UZIDA3ZS tag=011RYN1ZQF7Z type=write size=3770218 2024-09-14T10:54:20.872 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.874+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~NOX2QO9XB9NR.0 size=1048576 2024-09-14T10:54:20.874 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.875+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~NOX2QO9XB9NR.1 size=346083 2024-09-14T10:54:20.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.875+0000 7faa01046780 1 > prepared multipart upload key=VIO703UXIJXV upload=NOX2QO9XB9NR tag=AGK71D133TBO type=write size=2443235 2024-09-14T10:54:20.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.879+0000 7faa01046780 1 < suggested update operation key=GG02P21TFKIM tag=6O77PFFX16GL type=del size=2370414 2024-09-14T10:54:20.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.880+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=GQJV8X1DWDLB type=del size=2449247 2024-09-14T10:54:20.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.883+0000 7faa01046780 1 < suggested remove operation key=3FSH0OFMF54V tag=JVV1SU4O8TFO type=del 2024-09-14T10:54:20.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.886+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~34HW66LZKM3V.0 size=1048576 2024-09-14T10:54:20.886 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.887+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~34HW66LZKM3V.1 size=1048576 2024-09-14T10:54:20.886 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.888+0000 7faa01046780 1 > prepared part key=_multipart_X9DUVQBBLUTF.2~34HW66LZKM3V.2 size=581545 2024-09-14T10:54:20.886 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.888+0000 7faa01046780 1 > prepared multipart upload key=X9DUVQBBLUTF upload=34HW66LZKM3V tag=WA6WO8X2WD2A type=write size=3727273 2024-09-14T10:54:20.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.890+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~X19KQ0N2ZWIN.0 size=1048576 2024-09-14T10:54:20.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.891+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~X19KQ0N2ZWIN.1 size=1048576 2024-09-14T10:54:20.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.892+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~X19KQ0N2ZWIN.2 size=200755 2024-09-14T10:54:20.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.895+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=X19KQ0N2ZWIN tag=1GBOSI83ZY9M type=write size=3346483 2024-09-14T10:54:20.894 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.896+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=0A9GUSI165YY type=del size=2135843 2024-09-14T10:54:20.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.898+0000 7faa01046780 1 < completed delete operation key=LF41PL7DFSJI tag=C4SLB3HSK5UF type=del 2024-09-14T10:54:20.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.900+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=YDEPQGI7Z0J7 type=del size=3438785 2024-09-14T10:54:20.900 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.902+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~FYOMQDDE35C7.0 size=1048576 2024-09-14T10:54:20.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.903+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~FYOMQDDE35C7.1 size=1048576 2024-09-14T10:54:20.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.905+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~FYOMQDDE35C7.2 size=980449 2024-09-14T10:54:20.905 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.907+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=FYOMQDDE35C7 tag=57XYGK67XRU5 type=write size=4126177 2024-09-14T10:54:20.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.910+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~3JAD4WAPETLP.0 size=1048576 2024-09-14T10:54:20.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.911+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~3JAD4WAPETLP.1 size=948192 2024-09-14T10:54:20.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.911+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=3JAD4WAPETLP tag=VBUYJWO98X97 type=write size=3045344 2024-09-14T10:54:20.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.914+0000 7faa01046780 1 < suggested update operation key=S3BGVJ9N9S4P tag=9E9S0H4WJIAI type=del size=2218713 2024-09-14T10:54:20.914 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.916+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~TXJ7E85QRV7C.0 size=1048576 2024-09-14T10:54:20.915 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.917+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~TXJ7E85QRV7C.1 size=1048576 2024-09-14T10:54:20.916 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.918+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~TXJ7E85QRV7C.2 size=773697 2024-09-14T10:54:20.916 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.918+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=TXJ7E85QRV7C tag=H6XDGMM7FQEQ type=write size=3919425 2024-09-14T10:54:20.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.920+0000 7faa01046780 1 < completed write operation key=V905BR1VWUCV tag=I1KWNVUUNPB7 type=write size=717149 2024-09-14T10:54:20.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.921+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=2YSPZXMTVIDA type=del size=31675 2024-09-14T10:54:20.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.922+0000 7faa01046780 1 < completed delete operation key=X9DUVQBBLUTF tag=PUWFILF22L1Z type=del 2024-09-14T10:54:20.922 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.924+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=I3OBFMI5AANQ type=del size=803685 2024-09-14T10:54:20.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.927+0000 7faa01046780 1 < suggested update operation key=U8TE0XNK9YKM tag=VZ792XSMFYWT type=del size=3517683 2024-09-14T10:54:20.926 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.928+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=DHDAE6FT29I0 type=del size=600914 2024-09-14T10:54:20.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.931+0000 7faa01046780 1 < suggested remove operation key=TDNQZ8Y1C6X2 tag=I9LNJRZ7QH5O type=write 2024-09-14T10:54:20.930 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.932+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=ZOFQWUP779N7 type=del size=2206839 2024-09-14T10:54:20.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.934+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=4AZTK62YADH2 type=del 2024-09-14T10:54:20.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.936+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~GLQ0ST0YM92O.0 size=1048576 2024-09-14T10:54:20.935 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.937+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~GLQ0ST0YM92O.1 size=832902 2024-09-14T10:54:20.935 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.937+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=GLQ0ST0YM92O tag=FB8MF7G251Q9 type=write size=2930054 2024-09-14T10:54:20.935 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.937+0000 7faa01046780 1 < canceled part key=_multipart_XH8GHY9YRGTP.2~ZS94PYUOIBJL.0 size=1042275 2024-09-14T10:54:20.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.940+0000 7faa01046780 1 < canceled multipart upload key=XH8GHY9YRGTP upload=ZS94PYUOIBJL tag=V3URSLNEVRVW type=write size=2090851 2024-09-14T10:54:20.939 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.941+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=3W5XXIS1JXZ3 type=write size=104317 2024-09-14T10:54:20.942 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.944+0000 7faa01046780 1 < suggested update operation key=V5T3AN9D7DH6 tag=DPLU71VMUFJ7 type=del size=4091646 2024-09-14T10:54:20.943 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.946+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=C39T2CJJOGGX type=write size=248905 2024-09-14T10:54:20.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.947+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~HTV80LIMBJRM.0 size=430020 2024-09-14T10:54:20.947 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.949+0000 7faa01046780 1 < completed multipart upload key=XDJAK0XYQNF0 upload=HTV80LIMBJRM tag=LF7DZ16UP0BP type=write size=1478596 2024-09-14T10:54:20.949 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.951+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=USWVDF07R7E3 type=write size=542757 2024-09-14T10:54:20.950 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.952+0000 7faa01046780 1 < completed delete operation key=NXIPG4HR9ZYY tag=SF8S6T2WMF8G type=del 2024-09-14T10:54:20.952 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.955+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~G6FBR7AQFEVD.0 size=1048576 2024-09-14T10:54:20.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.956+0000 7faa01046780 1 > prepared part key=_multipart_HUBZAFMSCCNC.2~G6FBR7AQFEVD.1 size=590131 2024-09-14T10:54:20.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.956+0000 7faa01046780 1 > prepared multipart upload key=HUBZAFMSCCNC upload=G6FBR7AQFEVD tag=LQS9XF4W7N75 type=write size=2687283 2024-09-14T10:54:20.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.958+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~NOX2QO9XB9NR.0 size=1048576 2024-09-14T10:54:20.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.958+0000 7faa01046780 1 < canceled part key=_multipart_VIO703UXIJXV.2~NOX2QO9XB9NR.1 size=346083 2024-09-14T10:54:20.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.960+0000 7faa01046780 1 < canceled multipart upload key=VIO703UXIJXV upload=NOX2QO9XB9NR tag=AGK71D133TBO type=write size=2443235 2024-09-14T10:54:20.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.963+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~YS1E6N540GFB.0 size=1048576 2024-09-14T10:54:20.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.964+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~YS1E6N540GFB.1 size=349676 2024-09-14T10:54:20.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.964+0000 7faa01046780 1 > prepared multipart upload key=3UEX0IPM4CPY upload=YS1E6N540GFB tag=BBP711AC684G type=write size=2446828 2024-09-14T10:54:20.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.965+0000 7faa01046780 1 < completed delete operation key=VIO703UXIJXV tag=GQJV8X1DWDLB type=del 2024-09-14T10:54:20.965 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.967+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=O4T0S9NZBP7Y type=write size=254473 2024-09-14T10:54:20.966 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.968+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~34HW66LZKM3V.0 size=1048576 2024-09-14T10:54:20.967 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.969+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~34HW66LZKM3V.1 size=1048576 2024-09-14T10:54:20.968 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.971+0000 7faa01046780 1 < completed part key=_multipart_X9DUVQBBLUTF.2~34HW66LZKM3V.2 size=581545 2024-09-14T10:54:20.970 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.973+0000 7faa01046780 1 < completed multipart upload key=X9DUVQBBLUTF upload=34HW66LZKM3V tag=WA6WO8X2WD2A type=write size=3727273 2024-09-14T10:54:20.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.974+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=6JIA74NYUFKL type=del size=3495421 2024-09-14T10:54:20.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.977+0000 7faa01046780 1 < suggested update operation key=KDUTH9PIR3FI tag=0A9GUSI165YY type=del size=2135843 2024-09-14T10:54:20.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.979+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=1903HNQARD8H type=del size=998636 2024-09-14T10:54:20.978 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.980+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=YDEPQGI7Z0J7 type=del 2024-09-14T10:54:20.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.983+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~Q1WJDD7TCT23.0 size=1048576 2024-09-14T10:54:20.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.984+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~Q1WJDD7TCT23.1 size=1048576 2024-09-14T10:54:20.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.985+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~Q1WJDD7TCT23.2 size=76182 2024-09-14T10:54:20.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.985+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=Q1WJDD7TCT23 tag=V1XUQU23PIL8 type=write size=3221910 2024-09-14T10:54:20.985 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.987+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~3JAD4WAPETLP.0 size=1048576 2024-09-14T10:54:20.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.988+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~3JAD4WAPETLP.1 size=948192 2024-09-14T10:54:20.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.991+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=3JAD4WAPETLP tag=VBUYJWO98X97 type=write size=3045344 2024-09-14T10:54:20.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.993+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~X28H1WYZF8N5.0 size=168732 2024-09-14T10:54:20.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.993+0000 7faa01046780 1 > prepared multipart upload key=TDNQZ8Y1C6X2 upload=X28H1WYZF8N5 tag=E7N0V0G3YOV8 type=write size=1217308 2024-09-14T10:54:20.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.995+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~TXJ7E85QRV7C.0 size=1048576 2024-09-14T10:54:20.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.995+0000 7faa01046780 1 < canceled part key=_multipart_V5T3AN9D7DH6.2~TXJ7E85QRV7C.1 size=1048576 2024-09-14T10:54:20.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.996+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~TXJ7E85QRV7C.2 size=773697 2024-09-14T10:54:20.996 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:20.998+0000 7faa01046780 1 < canceled multipart upload key=V5T3AN9D7DH6 upload=TXJ7E85QRV7C tag=H6XDGMM7FQEQ type=write size=3919425 2024-09-14T10:54:20.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.000+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=0LFFO7HJ32JV type=del size=4186498 2024-09-14T10:54:21.000 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.002+0000 7faa01046780 1 < completed delete operation key=3FSH0OFMF54V tag=2YSPZXMTVIDA type=del 2024-09-14T10:54:21.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.004+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=UEANNAS29MVC type=write size=974587 2024-09-14T10:54:21.003 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.005+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=I3OBFMI5AANQ type=del 2024-09-14T10:54:21.004 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.006+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=WKQQ02SZBURK type=del size=1589203 2024-09-14T10:54:21.006 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.008+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=DHDAE6FT29I0 type=del 2024-09-14T10:54:21.007 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.009+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=9LZ4BUZT29TJ type=del size=1316839 2024-09-14T10:54:21.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.011+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=ZOFQWUP779N7 type=del 2024-09-14T10:54:21.011 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.014+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~RUW344WCRXGY.0 size=1048576 2024-09-14T10:54:21.013 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.015+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~RUW344WCRXGY.1 size=1048576 2024-09-14T10:54:21.014 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.016+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~RUW344WCRXGY.2 size=68537 2024-09-14T10:54:21.014 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.016+0000 7faa01046780 1 > prepared multipart upload key=F872GLVQDCX6 upload=RUW344WCRXGY tag=ZK2WXJ2T5WYN type=write size=3214265 2024-09-14T10:54:21.015 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.018+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~GLQ0ST0YM92O.0 size=1048576 2024-09-14T10:54:21.016 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.019+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~GLQ0ST0YM92O.1 size=832902 2024-09-14T10:54:21.019 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.021+0000 7faa01046780 1 < completed multipart upload key=Y4CB0HIN0750 upload=GLQ0ST0YM92O tag=FB8MF7G251Q9 type=write size=2930054 2024-09-14T10:54:21.021 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.024+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~S5WCJY53U441.0 size=1048576 2024-09-14T10:54:21.023 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.025+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~S5WCJY53U441.1 size=856728 2024-09-14T10:54:21.023 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.025+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=S5WCJY53U441 tag=8Y5659LM9H8T type=write size=2953880 2024-09-14T10:54:21.024 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.026+0000 7faa01046780 1 < completed write operation key=U8TE0XNK9YKM tag=3W5XXIS1JXZ3 type=write size=104317 2024-09-14T10:54:21.027 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.029+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~7EIYJUSCL1HG.0 size=1048576 2024-09-14T10:54:21.028 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.030+0000 7faa01046780 1 > prepared part key=_multipart_SJ02N8472YDM.2~7EIYJUSCL1HG.1 size=900046 2024-09-14T10:54:21.028 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.030+0000 7faa01046780 1 > prepared multipart upload key=SJ02N8472YDM upload=7EIYJUSCL1HG tag=DDRCM1HHWMQJ type=write size=2997198 2024-09-14T10:54:21.029 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.032+0000 7faa01046780 1 < completed write operation key=U8TE0XNK9YKM tag=C39T2CJJOGGX type=write size=248905 2024-09-14T10:54:21.031 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.033+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=1KU3GGQXSEQR type=del size=1778519 2024-09-14T10:54:21.032 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.035+0000 7faa01046780 -1 < failed to complete operation key=KDUTH9PIR3FI tag=USWVDF07R7E3 type=write size=542757: (22) Invalid argument 2024-09-14T10:54:21.034 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.036+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=ZYMV8TTS3BIV type=del size=2315077 2024-09-14T10:54:21.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.038+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~G6FBR7AQFEVD.0 size=1048576 2024-09-14T10:54:21.037 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.039+0000 7faa01046780 1 < completed part key=_multipart_HUBZAFMSCCNC.2~G6FBR7AQFEVD.1 size=590131 2024-09-14T10:54:21.039 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.041+0000 7faa01046780 1 < completed multipart upload key=HUBZAFMSCCNC upload=G6FBR7AQFEVD tag=LQS9XF4W7N75 type=write size=2687283 2024-09-14T10:54:21.041 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.043+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=8F5M2TWI9AE2 type=del size=1480635 2024-09-14T10:54:21.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.045+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~YS1E6N540GFB.0 size=1048576 2024-09-14T10:54:21.043 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.046+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~YS1E6N540GFB.1 size=349676 2024-09-14T10:54:21.046 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.048+0000 7faa01046780 1 < completed multipart upload key=3UEX0IPM4CPY upload=YS1E6N540GFB tag=BBP711AC684G type=write size=2446828 2024-09-14T10:54:21.047 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.050+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=3Z2N67HRO3S5 type=del size=3516903 2024-09-14T10:54:21.049 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.051+0000 7faa01046780 1 < canceled operation key=PBRZNGSOLJ8E tag=O4T0S9NZBP7Y type=write size=254473 2024-09-14T10:54:21.050 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.052+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=3V212XGUKCQ1 type=del size=2524723 2024-09-14T10:54:21.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.054+0000 7faa01046780 1 < canceled operation key=CKMDOO75UZGE tag=6JIA74NYUFKL type=del size=3495421 2024-09-14T10:54:21.053 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.056+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=SNVBOSGA1KZ4 type=del size=2732466 2024-09-14T10:54:21.055 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.057+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=1903HNQARD8H type=del 2024-09-14T10:54:21.056 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.058+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=59BE0SK3WVDG type=del size=2666482 2024-09-14T10:54:21.058 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.060+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~Q1WJDD7TCT23.0 size=1048576 2024-09-14T10:54:21.059 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.061+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~Q1WJDD7TCT23.1 size=1048576 2024-09-14T10:54:21.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.062+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~Q1WJDD7TCT23.2 size=76182 2024-09-14T10:54:21.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.065+0000 7faa01046780 1 < completed multipart upload key=Y4CB0HIN0750 upload=Q1WJDD7TCT23 tag=V1XUQU23PIL8 type=write size=3221910 2024-09-14T10:54:21.065 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.067+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~1KTRHJEEDV0C.0 size=907263 2024-09-14T10:54:21.065 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.067+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=1KTRHJEEDV0C tag=4L0L9SQ8KU8Z type=write size=1955839 2024-09-14T10:54:21.066 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.069+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~X28H1WYZF8N5.0 size=168732 2024-09-14T10:54:21.069 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.071+0000 7faa01046780 1 < completed multipart upload key=TDNQZ8Y1C6X2 upload=X28H1WYZF8N5 tag=E7N0V0G3YOV8 type=write size=1217308 2024-09-14T10:54:21.070 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.072+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=PRSMP4LRR859 type=write size=599794 2024-09-14T10:54:21.072 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.074+0000 7faa01046780 1 < completed delete operation key=U8TE0XNK9YKM tag=0LFFO7HJ32JV type=del 2024-09-14T10:54:21.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.077+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~A77IAHQPFRDD.0 size=1048576 2024-09-14T10:54:21.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.078+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~A77IAHQPFRDD.1 size=1004706 2024-09-14T10:54:21.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.078+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=A77IAHQPFRDD tag=CICOEV474PG6 type=write size=3101858 2024-09-14T10:54:21.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.081+0000 7faa01046780 1 < suggested update operation key=Y4CB0HIN0750 tag=UEANNAS29MVC type=write size=974587 2024-09-14T10:54:21.080 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.082+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=B9OV5N2FYCD7 type=del size=3606430 2024-09-14T10:54:21.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.085+0000 7faa01046780 1 < suggested update operation key=3FSH0OFMF54V tag=WKQQ02SZBURK type=del size=1589203 2024-09-14T10:54:21.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.088+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~7YUQHX91UZYF.0 size=1048576 2024-09-14T10:54:21.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.090+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~7YUQHX91UZYF.1 size=1048576 2024-09-14T10:54:21.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.091+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~7YUQHX91UZYF.2 size=878807 2024-09-14T10:54:21.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.091+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=7YUQHX91UZYF tag=6MN78ZZK41KP type=write size=4024535 2024-09-14T10:54:21.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.093+0000 7faa01046780 1 < suggested remove operation key=NXIPG4HR9ZYY tag=9LZ4BUZT29TJ type=del 2024-09-14T10:54:21.093 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.095+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=INJF4OJQ2F74 type=del size=1687482 2024-09-14T10:54:21.094 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.096+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~RUW344WCRXGY.0 size=1048576 2024-09-14T10:54:21.095 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.097+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~RUW344WCRXGY.1 size=1048576 2024-09-14T10:54:21.096 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.099+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~RUW344WCRXGY.2 size=68537 2024-09-14T10:54:21.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.101+0000 7faa01046780 1 < completed multipart upload key=F872GLVQDCX6 upload=RUW344WCRXGY tag=ZK2WXJ2T5WYN type=write size=3214265 2024-09-14T10:54:21.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.103+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=S95GJ3VX09N8 type=del size=207579 2024-09-14T10:54:21.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.105+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~S5WCJY53U441.0 size=1048576 2024-09-14T10:54:21.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.106+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~S5WCJY53U441.1 size=856728 2024-09-14T10:54:21.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.109+0000 7faa01046780 1 < completed multipart upload key=0XVVSUIOBQPL upload=S5WCJY53U441 tag=8Y5659LM9H8T type=write size=2953880 2024-09-14T10:54:21.109 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.112+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~QMZXNX76T6XS.0 size=457755 2024-09-14T10:54:21.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.112+0000 7faa01046780 1 > prepared multipart upload key=3UEX0IPM4CPY upload=QMZXNX76T6XS tag=WEYJIE2D0H40 type=write size=1506331 2024-09-14T10:54:21.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.113+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~7EIYJUSCL1HG.0 size=1048576 2024-09-14T10:54:21.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.114+0000 7faa01046780 1 < completed part key=_multipart_SJ02N8472YDM.2~7EIYJUSCL1HG.1 size=900046 2024-09-14T10:54:21.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.117+0000 7faa01046780 1 < completed multipart upload key=SJ02N8472YDM upload=7EIYJUSCL1HG tag=DDRCM1HHWMQJ type=write size=2997198 2024-09-14T10:54:21.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.118+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=1NVIMONCYACC type=write size=567378 2024-09-14T10:54:21.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.120+0000 7faa01046780 1 < canceled operation key=VIO703UXIJXV tag=1KU3GGQXSEQR type=del size=1778519 2024-09-14T10:54:21.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.122+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~4L19KOW7WP61.0 size=165868 2024-09-14T10:54:21.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.122+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=4L19KOW7WP61 tag=R6A6WH8V20RN type=write size=1214444 2024-09-14T10:54:21.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.123+0000 7faa01046780 1 < completed delete operation key=V905BR1VWUCV tag=ZYMV8TTS3BIV type=del 2024-09-14T10:54:21.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.125+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=DVZAWH6Z2KFS type=write size=440223 2024-09-14T10:54:21.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.126+0000 7faa01046780 1 < completed delete operation key=F872GLVQDCX6 tag=8F5M2TWI9AE2 type=del 2024-09-14T10:54:21.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.128+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=L72Q9S7A0TDU type=del size=292036 2024-09-14T10:54:21.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.129+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=3Z2N67HRO3S5 type=del 2024-09-14T10:54:21.129 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.131+0000 7faa01046780 1 > prepared operation key=S3BGVJ9N9S4P tag=31UDSA9G3S70 type=del size=2621158 2024-09-14T10:54:21.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.132+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=3V212XGUKCQ1 type=del 2024-09-14T10:54:21.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.133+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=QGFJ7NIO6HA2 type=write size=323086 2024-09-14T10:54:21.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.136+0000 7faa01046780 1 < suggested update operation key=3FSH0OFMF54V tag=SNVBOSGA1KZ4 type=del size=2732466 2024-09-14T10:54:21.135 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.137+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=N8QQG8ERK3NT type=del size=2058783 2024-09-14T10:54:21.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.140+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=59BE0SK3WVDG type=del 2024-09-14T10:54:21.139 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.141+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=OKMQWZ5X64JQ type=write size=600724 2024-09-14T10:54:21.140 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.142+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~1KTRHJEEDV0C.0 size=907263 2024-09-14T10:54:21.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.145+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=1KTRHJEEDV0C tag=4L0L9SQ8KU8Z type=write size=1955839 2024-09-14T10:54:21.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.146+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=Z46EFWX1BJ3N type=write size=584701 2024-09-14T10:54:21.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.147+0000 7faa01046780 1 < completed write operation key=0OL3SF5IWDMH tag=PRSMP4LRR859 type=write size=599794 2024-09-14T10:54:21.148 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.150+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~A3VTWJQZ8SEH.0 size=1048576 2024-09-14T10:54:21.149 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.151+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~A3VTWJQZ8SEH.1 size=186281 2024-09-14T10:54:21.149 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.151+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=A3VTWJQZ8SEH tag=6DJLJ3L0AYHG type=write size=2283433 2024-09-14T10:54:21.149 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.151+0000 7faa01046780 1 < canceled part key=_multipart_V5T3AN9D7DH6.2~A77IAHQPFRDD.0 size=1048576 2024-09-14T10:54:21.150 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.152+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~A77IAHQPFRDD.1 size=1004706 2024-09-14T10:54:21.152 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.155+0000 7faa01046780 1 < canceled multipart upload key=V5T3AN9D7DH6 upload=A77IAHQPFRDD tag=CICOEV474PG6 type=write size=3101858 2024-09-14T10:54:21.154 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.156+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=M42YXTV54BY8 type=write size=599895 2024-09-14T10:54:21.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.159+0000 7faa01046780 1 < suggested update operation key=F872GLVQDCX6 tag=B9OV5N2FYCD7 type=del size=3606430 2024-09-14T10:54:21.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.161+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~B52U71B256TE.0 size=728406 2024-09-14T10:54:21.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.161+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=B52U71B256TE tag=VJJ4D574H93Q type=write size=1776982 2024-09-14T10:54:21.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.163+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~7YUQHX91UZYF.0 size=1048576 2024-09-14T10:54:21.162 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.164+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~7YUQHX91UZYF.1 size=1048576 2024-09-14T10:54:21.163 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.165+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~7YUQHX91UZYF.2 size=878807 2024-09-14T10:54:21.165 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.168+0000 7faa01046780 1 < completed multipart upload key=U8TE0XNK9YKM upload=7YUQHX91UZYF tag=6MN78ZZK41KP type=write size=4024535 2024-09-14T10:54:21.168 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.170+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~KQQ5DW4MWI0O.0 size=193418 2024-09-14T10:54:21.168 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.170+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=KQQ5DW4MWI0O tag=ZVGU6ZH9P2BO type=write size=1241994 2024-09-14T10:54:21.169 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.172+0000 7faa01046780 1 < canceled operation key=Q33ET1AN14NG tag=INJF4OJQ2F74 type=del size=1687482 2024-09-14T10:54:21.171 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.173+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=FYLDGR567ZTM type=del size=2212691 2024-09-14T10:54:21.174 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.176+0000 7faa01046780 1 < suggested update operation key=FOJGGEQZD7YW tag=S95GJ3VX09N8 type=del size=207579 2024-09-14T10:54:21.176 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.178+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=VF6IQ76YTG95 type=write size=634694 2024-09-14T10:54:21.177 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.179+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~QMZXNX76T6XS.0 size=457755 2024-09-14T10:54:21.179 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.182+0000 7faa01046780 1 < completed multipart upload key=3UEX0IPM4CPY upload=QMZXNX76T6XS tag=WEYJIE2D0H40 type=write size=1506331 2024-09-14T10:54:21.181 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.183+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=TIPOHC9PBH6P type=write size=709992 2024-09-14T10:54:21.183 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.185+0000 7faa01046780 1 < completed write operation key=ZY0BY3G9NREC tag=1NVIMONCYACC type=write size=567378 2024-09-14T10:54:21.185 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.188+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~N4PJ5KKJ41BZ.0 size=1048576 2024-09-14T10:54:21.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.189+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~N4PJ5KKJ41BZ.1 size=1048576 2024-09-14T10:54:21.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.190+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~N4PJ5KKJ41BZ.2 size=714469 2024-09-14T10:54:21.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.190+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=N4PJ5KKJ41BZ tag=JFH6TDIRZITB type=write size=3860197 2024-09-14T10:54:21.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.192+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~4L19KOW7WP61.0 size=165868 2024-09-14T10:54:21.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.194+0000 7faa01046780 1 < completed multipart upload key=CKMDOO75UZGE upload=4L19KOW7WP61 tag=R6A6WH8V20RN type=write size=1214444 2024-09-14T10:54:21.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.195+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=3MXWNJSW8HI4 type=del size=1277085 2024-09-14T10:54:21.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.197+0000 7faa01046780 1 < completed write operation key=V11YJWHT4OOD tag=DVZAWH6Z2KFS type=write size=440223 2024-09-14T10:54:21.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.198+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=R1V6X2BAQGVM type=del size=1728569 2024-09-14T10:54:21.198 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.200+0000 7faa01046780 1 < canceled operation key=S3BGVJ9N9S4P tag=L72Q9S7A0TDU type=del size=292036 2024-09-14T10:54:21.200 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.202+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~EENAKAH3DFRX.0 size=1048576 2024-09-14T10:54:21.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.203+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~EENAKAH3DFRX.1 size=891039 2024-09-14T10:54:21.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.203+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=EENAKAH3DFRX tag=INDEYNL4H3XI type=write size=2988191 2024-09-14T10:54:21.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.205+0000 7faa01046780 1 < completed delete operation key=S3BGVJ9N9S4P tag=31UDSA9G3S70 type=del 2024-09-14T10:54:21.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.206+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=IU05HM1LYXNT type=del size=1653715 2024-09-14T10:54:21.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.208+0000 7faa01046780 1 < completed write operation key=V5T3AN9D7DH6 tag=QGFJ7NIO6HA2 type=write size=323086 2024-09-14T10:54:21.208 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.210+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~0SSNABJ94KB4.0 size=1048576 2024-09-14T10:54:21.208 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.211+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~0SSNABJ94KB4.1 size=1048576 2024-09-14T10:54:21.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.212+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~0SSNABJ94KB4.2 size=475935 2024-09-14T10:54:21.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.212+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=0SSNABJ94KB4 tag=NQ22TQZKVOHP type=write size=3621663 2024-09-14T10:54:21.211 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.213+0000 7faa01046780 1 < canceled operation key=PBRZNGSOLJ8E tag=N8QQG8ERK3NT type=del size=2058783 2024-09-14T10:54:21.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.215+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=Y4PATBDTN7H4 type=del size=3535067 2024-09-14T10:54:21.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.216+0000 7faa01046780 1 < completed write operation key=CKMDOO75UZGE tag=OKMQWZ5X64JQ type=write size=600724 2024-09-14T10:54:21.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.217+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=KQ9924APUVRT type=write size=652330 2024-09-14T10:54:21.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.219+0000 7faa01046780 1 < completed write operation key=Y4CB0HIN0750 tag=Z46EFWX1BJ3N type=write size=584701 2024-09-14T10:54:21.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.221+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~V7PR2NPJ5879.0 size=1048576 2024-09-14T10:54:21.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.222+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~V7PR2NPJ5879.1 size=1048576 2024-09-14T10:54:21.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.223+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~V7PR2NPJ5879.2 size=359904 2024-09-14T10:54:21.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.223+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=V7PR2NPJ5879 tag=BAU6JSTNNWHP type=write size=3505632 2024-09-14T10:54:21.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.224+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~A3VTWJQZ8SEH.0 size=1048576 2024-09-14T10:54:21.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.225+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~A3VTWJQZ8SEH.1 size=186281 2024-09-14T10:54:21.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.227+0000 7faa01046780 1 < completed multipart upload key=CKMDOO75UZGE upload=A3VTWJQZ8SEH tag=6DJLJ3L0AYHG type=write size=2283433 2024-09-14T10:54:21.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.230+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~O9EXT3O5LSQP.0 size=1048576 2024-09-14T10:54:21.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.231+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~O9EXT3O5LSQP.1 size=371274 2024-09-14T10:54:21.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.231+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=O9EXT3O5LSQP tag=AR7EEK4LSUFR type=write size=2468426 2024-09-14T10:54:21.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.233+0000 7faa01046780 1 < completed write operation key=V905BR1VWUCV tag=M42YXTV54BY8 type=write size=599895 2024-09-14T10:54:21.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.234+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=40ZXI73X02SP type=write size=763325 2024-09-14T10:54:21.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.235+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~B52U71B256TE.0 size=728406 2024-09-14T10:54:21.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.238+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=B52U71B256TE tag=VJJ4D574H93Q type=write size=1776982 2024-09-14T10:54:21.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.240+0000 7faa01046780 1 > prepared part key=_multipart_Y4CB0HIN0750.2~WMEKCNSK0I3A.0 size=986556 2024-09-14T10:54:21.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.240+0000 7faa01046780 1 > prepared multipart upload key=Y4CB0HIN0750 upload=WMEKCNSK0I3A tag=UO5JLC92DY4T type=write size=2035132 2024-09-14T10:54:21.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.240+0000 7faa01046780 1 < canceled part key=_multipart_0XVVSUIOBQPL.2~KQQ5DW4MWI0O.0 size=193418 2024-09-14T10:54:21.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.242+0000 7faa01046780 1 < canceled multipart upload key=0XVVSUIOBQPL upload=KQQ5DW4MWI0O tag=ZVGU6ZH9P2BO type=write size=1241994 2024-09-14T10:54:21.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.244+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=40K63IZ02Z8Z type=write size=132813 2024-09-14T10:54:21.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.247+0000 7faa01046780 1 < suggested update operation key=V5T3AN9D7DH6 tag=FYLDGR567ZTM type=del size=2212691 2024-09-14T10:54:21.246 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.248+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=015DXICDQ1HB type=write size=888415 2024-09-14T10:54:21.247 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.249+0000 7faa01046780 1 < canceled operation key=TDNQZ8Y1C6X2 tag=VF6IQ76YTG95 type=write size=634694 2024-09-14T10:54:21.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.251+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=WCX7EGVSWUG0 type=del size=892617 2024-09-14T10:54:21.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.252+0000 7faa01046780 1 < completed write operation key=U8TE0XNK9YKM tag=TIPOHC9PBH6P type=write size=709992 2024-09-14T10:54:21.251 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.254+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=RT7JBY00ASVC type=del size=2408824 2024-09-14T10:54:21.253 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.255+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~N4PJ5KKJ41BZ.0 size=1048576 2024-09-14T10:54:21.253 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.255+0000 7faa01046780 1 < canceled part key=_multipart_KDUTH9PIR3FI.2~N4PJ5KKJ41BZ.1 size=1048576 2024-09-14T10:54:21.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.256+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~N4PJ5KKJ41BZ.2 size=714469 2024-09-14T10:54:21.256 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.259+0000 7faa01046780 1 < canceled multipart upload key=KDUTH9PIR3FI upload=N4PJ5KKJ41BZ tag=JFH6TDIRZITB type=write size=3860197 2024-09-14T10:54:21.258 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.260+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=05DHVDIE507G type=del size=3516147 2024-09-14T10:54:21.259 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.261+0000 7faa01046780 1 < canceled operation key=TDNQZ8Y1C6X2 tag=3MXWNJSW8HI4 type=del size=1277085 2024-09-14T10:54:21.261 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.264+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~9TJCFZ8DC6YE.0 size=36591 2024-09-14T10:54:21.262 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.264+0000 7faa01046780 1 > prepared multipart upload key=F872GLVQDCX6 upload=9TJCFZ8DC6YE tag=2UXX6H3FE0L4 type=write size=1085167 2024-09-14T10:54:21.263 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.265+0000 7faa01046780 1 < completed delete operation key=BBDTPL35W4W0 tag=R1V6X2BAQGVM type=del 2024-09-14T10:54:21.265 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.267+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=IFQG7A9Q8LTV type=del size=4027600 2024-09-14T10:54:21.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.269+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~EENAKAH3DFRX.0 size=1048576 2024-09-14T10:54:21.268 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.271+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~EENAKAH3DFRX.1 size=891039 2024-09-14T10:54:21.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.273+0000 7faa01046780 1 < completed multipart upload key=S3BGVJ9N9S4P upload=EENAKAH3DFRX tag=INDEYNL4H3XI type=write size=2988191 2024-09-14T10:54:21.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.275+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~17HN8D8EHZF4.0 size=923448 2024-09-14T10:54:21.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.275+0000 7faa01046780 1 > prepared multipart upload key=FOJGGEQZD7YW upload=17HN8D8EHZF4 tag=IR4V991LNF4X type=write size=1972024 2024-09-14T10:54:21.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.277+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=IU05HM1LYXNT type=del 2024-09-14T10:54:21.276 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.278+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=FYB7S5Y1KM19 type=del size=1165849 2024-09-14T10:54:21.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.280+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~0SSNABJ94KB4.0 size=1048576 2024-09-14T10:54:21.279 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.281+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~0SSNABJ94KB4.1 size=1048576 2024-09-14T10:54:21.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.282+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~0SSNABJ94KB4.2 size=475935 2024-09-14T10:54:21.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.284+0000 7faa01046780 1 < completed multipart upload key=V5T3AN9D7DH6 upload=0SSNABJ94KB4 tag=NQ22TQZKVOHP type=write size=3621663 2024-09-14T10:54:21.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.286+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=N9O4CNWDUR66 type=del size=1606892 2024-09-14T10:54:21.285 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.287+0000 7faa01046780 1 < completed delete operation key=XH8GHY9YRGTP tag=Y4PATBDTN7H4 type=del 2024-09-14T10:54:21.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.289+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~UTDW4KI8UY45.0 size=1048576 2024-09-14T10:54:21.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.291+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~UTDW4KI8UY45.1 size=1048576 2024-09-14T10:54:21.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.292+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~UTDW4KI8UY45.2 size=263005 2024-09-14T10:54:21.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.292+0000 7faa01046780 1 > prepared multipart upload key=PBRZNGSOLJ8E upload=UTDW4KI8UY45 tag=WDIU6IX7MK8U type=write size=3408733 2024-09-14T10:54:21.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.293+0000 7faa01046780 1 < completed write operation key=PBRZNGSOLJ8E tag=KQ9924APUVRT type=write size=652330 2024-09-14T10:54:21.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.296+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~V1WCL6J34UIF.0 size=1048576 2024-09-14T10:54:21.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.297+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~V1WCL6J34UIF.1 size=1048576 2024-09-14T10:54:21.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.298+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~V1WCL6J34UIF.2 size=57057 2024-09-14T10:54:21.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.298+0000 7faa01046780 1 > prepared multipart upload key=FOJGGEQZD7YW upload=V1WCL6J34UIF tag=2W48QMFLXEAL type=write size=3202785 2024-09-14T10:54:21.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.299+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~V7PR2NPJ5879.0 size=1048576 2024-09-14T10:54:21.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.299+0000 7faa01046780 1 < canceled part key=_multipart_S3BGVJ9N9S4P.2~V7PR2NPJ5879.1 size=1048576 2024-09-14T10:54:21.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.300+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~V7PR2NPJ5879.2 size=359904 2024-09-14T10:54:21.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.303+0000 7faa01046780 1 < canceled multipart upload key=S3BGVJ9N9S4P upload=V7PR2NPJ5879 tag=BAU6JSTNNWHP type=write size=3505632 2024-09-14T10:54:21.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.304+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=OPSVXRHGIYXA type=del size=3786381 2024-09-14T10:54:21.303 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.305+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~O9EXT3O5LSQP.0 size=1048576 2024-09-14T10:54:21.304 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.306+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~O9EXT3O5LSQP.1 size=371274 2024-09-14T10:54:21.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.309+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=O9EXT3O5LSQP tag=AR7EEK4LSUFR type=write size=2468426 2024-09-14T10:54:21.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.310+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=N57TKEOFKW83 type=write size=336274 2024-09-14T10:54:21.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.311+0000 7faa01046780 1 < completed write operation key=LF41PL7DFSJI tag=40ZXI73X02SP type=write size=763325 2024-09-14T10:54:21.311 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.314+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~QWAA1J7B78NJ.0 size=282904 2024-09-14T10:54:21.312 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.314+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=QWAA1J7B78NJ tag=LUOQJU1GW18L type=write size=1331480 2024-09-14T10:54:21.313 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.315+0000 7faa01046780 1 < completed part key=_multipart_Y4CB0HIN0750.2~WMEKCNSK0I3A.0 size=986556 2024-09-14T10:54:21.316 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.318+0000 7faa01046780 1 < completed multipart upload key=Y4CB0HIN0750 upload=WMEKCNSK0I3A tag=UO5JLC92DY4T type=write size=2035132 2024-09-14T10:54:21.317 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.319+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=ASZNK1GIKES3 type=write size=527789 2024-09-14T10:54:21.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.321+0000 7faa01046780 1 < completed write operation key=PBRZNGSOLJ8E tag=40K63IZ02Z8Z type=write size=132813 2024-09-14T10:54:21.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.322+0000 7faa01046780 1 > prepared operation key=SJ02N8472YDM tag=SBWZ1XFO1Y8Z type=del size=2150818 2024-09-14T10:54:21.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.324+0000 7faa01046780 1 < completed write operation key=0OL3SF5IWDMH tag=015DXICDQ1HB type=write size=888415 2024-09-14T10:54:21.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.326+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~15FFHFQO3GHU.0 size=1048576 2024-09-14T10:54:21.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.328+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~15FFHFQO3GHU.1 size=1048576 2024-09-14T10:54:21.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.329+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~15FFHFQO3GHU.2 size=189445 2024-09-14T10:54:21.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.329+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=15FFHFQO3GHU tag=1B249MEIKWU4 type=write size=3335173 2024-09-14T10:54:21.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.332+0000 7faa01046780 1 < suggested remove operation key=X9DUVQBBLUTF tag=WCX7EGVSWUG0 type=del 2024-09-14T10:54:21.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.335+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~LFETC2HVAO3G.0 size=780225 2024-09-14T10:54:21.333 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.335+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=LFETC2HVAO3G tag=OBADOR4GIO49 type=write size=1828801 2024-09-14T10:54:21.334 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.336+0000 7faa01046780 1 < completed delete operation key=NXIPG4HR9ZYY tag=RT7JBY00ASVC type=del 2024-09-14T10:54:21.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.338+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=ELHHJ37JW429 type=del size=745431 2024-09-14T10:54:21.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.341+0000 7faa01046780 1 < suggested update operation key=PS2QU1UZUYHE tag=05DHVDIE507G type=del size=3516147 2024-09-14T10:54:21.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.344+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~6KDN49U2KJJ9.0 size=1048576 2024-09-14T10:54:21.342 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.345+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~6KDN49U2KJJ9.1 size=1048576 2024-09-14T10:54:21.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.346+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~6KDN49U2KJJ9.2 size=682132 2024-09-14T10:54:21.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.346+0000 7faa01046780 1 > prepared multipart upload key=3UEX0IPM4CPY upload=6KDN49U2KJJ9 tag=SILH878SGK4D type=write size=3827860 2024-09-14T10:54:21.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.347+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~9TJCFZ8DC6YE.0 size=36591 2024-09-14T10:54:21.348 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.350+0000 7faa01046780 1 < completed multipart upload key=F872GLVQDCX6 upload=9TJCFZ8DC6YE tag=2UXX6H3FE0L4 type=write size=1085167 2024-09-14T10:54:21.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.351+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=0X8PY8FZLQJB type=del size=1688841 2024-09-14T10:54:21.352 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.354+0000 7faa01046780 1 < suggested update operation key=3UEX0IPM4CPY tag=IFQG7A9Q8LTV type=del size=4027600 2024-09-14T10:54:21.355 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.358+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~3CM02IW00L2Z.0 size=1048576 2024-09-14T10:54:21.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.359+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~3CM02IW00L2Z.1 size=1048576 2024-09-14T10:54:21.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.360+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~3CM02IW00L2Z.2 size=454679 2024-09-14T10:54:21.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.360+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=3CM02IW00L2Z tag=IYC3XVTVG7GY type=write size=3600407 2024-09-14T10:54:21.359 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.361+0000 7faa01046780 1 < canceled part key=_multipart_FOJGGEQZD7YW.2~17HN8D8EHZF4.0 size=923448 2024-09-14T10:54:21.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.363+0000 7faa01046780 1 < canceled multipart upload key=FOJGGEQZD7YW upload=17HN8D8EHZF4 tag=IR4V991LNF4X type=write size=1972024 2024-09-14T10:54:21.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.365+0000 7faa01046780 1 > prepared operation key=KDUTH9PIR3FI tag=2GVCTQMH2ZWH type=write size=171183 2024-09-14T10:54:21.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.366+0000 7faa01046780 -1 < failed to complete operation key=PS2QU1UZUYHE tag=FYB7S5Y1KM19 type=del size=1165849: (22) Invalid argument 2024-09-14T10:54:21.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.369+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~18G8KA0TTOMA.0 size=1048576 2024-09-14T10:54:21.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.370+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~18G8KA0TTOMA.1 size=188325 2024-09-14T10:54:21.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.370+0000 7faa01046780 1 > prepared multipart upload key=V11YJWHT4OOD upload=18G8KA0TTOMA tag=0UJWIN8SIOIS type=write size=2285477 2024-09-14T10:54:21.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.373+0000 7faa01046780 1 < suggested remove operation key=3FSH0OFMF54V tag=N9O4CNWDUR66 type=del 2024-09-14T10:54:21.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.375+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=E08ULRTQRBFE type=del size=721117 2024-09-14T10:54:21.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.376+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~UTDW4KI8UY45.0 size=1048576 2024-09-14T10:54:21.375 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.378+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~UTDW4KI8UY45.1 size=1048576 2024-09-14T10:54:21.376 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.379+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~UTDW4KI8UY45.2 size=263005 2024-09-14T10:54:21.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.381+0000 7faa01046780 1 < completed multipart upload key=PBRZNGSOLJ8E upload=UTDW4KI8UY45 tag=WDIU6IX7MK8U type=write size=3408733 2024-09-14T10:54:21.380 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.382+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=2JBBZ5IERCML type=del size=2514468 2024-09-14T10:54:21.381 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.383+0000 7faa01046780 1 < canceled part key=_multipart_FOJGGEQZD7YW.2~V1WCL6J34UIF.0 size=1048576 2024-09-14T10:54:21.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.384+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~V1WCL6J34UIF.1 size=1048576 2024-09-14T10:54:21.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.385+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~V1WCL6J34UIF.2 size=57057 2024-09-14T10:54:21.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.387+0000 7faa01046780 1 < canceled multipart upload key=FOJGGEQZD7YW upload=V1WCL6J34UIF tag=2W48QMFLXEAL type=write size=3202785 2024-09-14T10:54:21.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.389+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=UYFZK5JD1UEQ type=del size=1555039 2024-09-14T10:54:21.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.390+0000 7faa01046780 -1 < failed to complete operation key=3UEX0IPM4CPY tag=OPSVXRHGIYXA type=del size=3786381: (22) Invalid argument 2024-09-14T10:54:21.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.392+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=U9QVGXI6UA95 type=write size=554555 2024-09-14T10:54:21.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.393+0000 7faa01046780 1 < completed write operation key=0OL3SF5IWDMH tag=N57TKEOFKW83 type=write size=336274 2024-09-14T10:54:21.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.395+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=OJ3CRMSN197D type=del size=473816 2024-09-14T10:54:21.394 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.396+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~QWAA1J7B78NJ.0 size=282904 2024-09-14T10:54:21.396 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.398+0000 7faa01046780 1 < completed multipart upload key=V5T3AN9D7DH6 upload=QWAA1J7B78NJ tag=LUOQJU1GW18L type=write size=1331480 2024-09-14T10:54:21.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.400+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=8O5IXMTKFDLT type=del size=3159003 2024-09-14T10:54:21.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.402+0000 7faa01046780 1 < completed write operation key=HUBZAFMSCCNC tag=ASZNK1GIKES3 type=write size=527789 2024-09-14T10:54:21.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.403+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=CJJJ2IFHBBBV type=del size=917554 2024-09-14T10:54:21.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.406+0000 7faa01046780 1 < completed delete operation key=SJ02N8472YDM tag=SBWZ1XFO1Y8Z type=del 2024-09-14T10:54:21.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.407+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=XG14U3PU69HV type=del size=1839219 2024-09-14T10:54:21.407 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.409+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~15FFHFQO3GHU.0 size=1048576 2024-09-14T10:54:21.408 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.410+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~15FFHFQO3GHU.1 size=1048576 2024-09-14T10:54:21.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.411+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~15FFHFQO3GHU.2 size=189445 2024-09-14T10:54:21.411 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.413+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=15FFHFQO3GHU tag=1B249MEIKWU4 type=write size=3335173 2024-09-14T10:54:21.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.416+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~2651KVJGHJG0.0 size=3692 2024-09-14T10:54:21.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.416+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=2651KVJGHJG0 tag=7F2N5RKCLOWU type=write size=1052268 2024-09-14T10:54:21.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.417+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~LFETC2HVAO3G.0 size=780225 2024-09-14T10:54:21.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.420+0000 7faa01046780 1 < completed multipart upload key=HYAGNAOWK8LF upload=LFETC2HVAO3G tag=OBADOR4GIO49 type=write size=1828801 2024-09-14T10:54:21.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.422+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~IEBJKRZ3L1O4.0 size=606654 2024-09-14T10:54:21.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.422+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=IEBJKRZ3L1O4 tag=79MTG8CZ4O8Q type=write size=1655230 2024-09-14T10:54:21.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.423+0000 7faa01046780 1 < completed delete operation key=PTDE6D7OIU1A tag=ELHHJ37JW429 type=del 2024-09-14T10:54:21.424 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.426+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~Q21XTOZ5IJPP.0 size=1048576 2024-09-14T10:54:21.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.427+0000 7faa01046780 1 > prepared part key=_multipart_V905BR1VWUCV.2~Q21XTOZ5IJPP.1 size=228621 2024-09-14T10:54:21.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.427+0000 7faa01046780 1 > prepared multipart upload key=V905BR1VWUCV upload=Q21XTOZ5IJPP tag=VD10V9SZ5GPH type=write size=2325773 2024-09-14T10:54:21.426 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.429+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~6KDN49U2KJJ9.0 size=1048576 2024-09-14T10:54:21.427 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.430+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~6KDN49U2KJJ9.1 size=1048576 2024-09-14T10:54:21.428 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.430+0000 7faa01046780 1 < canceled part key=_multipart_3UEX0IPM4CPY.2~6KDN49U2KJJ9.2 size=682132 2024-09-14T10:54:21.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.432+0000 7faa01046780 1 < canceled multipart upload key=3UEX0IPM4CPY upload=6KDN49U2KJJ9 tag=SILH878SGK4D type=write size=3827860 2024-09-14T10:54:21.432 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.434+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~2CWA681SZ9WC.0 size=725561 2024-09-14T10:54:21.432 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.434+0000 7faa01046780 1 > prepared multipart upload key=FOJGGEQZD7YW upload=2CWA681SZ9WC tag=AJLJCJXG6J0A type=write size=1774137 2024-09-14T10:54:21.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.437+0000 7faa01046780 1 < suggested remove operation key=U8TE0XNK9YKM tag=0X8PY8FZLQJB type=del 2024-09-14T10:54:21.438 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.440+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~H0QWQEIJAGN1.0 size=1048576 2024-09-14T10:54:21.439 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.441+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~H0QWQEIJAGN1.1 size=194168 2024-09-14T10:54:21.439 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.441+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=H0QWQEIJAGN1 tag=5U41868W8ZVK type=write size=2291320 2024-09-14T10:54:21.440 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.443+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~3CM02IW00L2Z.0 size=1048576 2024-09-14T10:54:21.442 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.444+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~3CM02IW00L2Z.1 size=1048576 2024-09-14T10:54:21.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.445+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~3CM02IW00L2Z.2 size=454679 2024-09-14T10:54:21.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.447+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=3CM02IW00L2Z tag=IYC3XVTVG7GY type=write size=3600407 2024-09-14T10:54:21.446 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.449+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=TGOZDJQTQ2CO type=del size=1879280 2024-09-14T10:54:21.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.450+0000 7faa01046780 1 < completed write operation key=KDUTH9PIR3FI tag=2GVCTQMH2ZWH type=write size=171183 2024-09-14T10:54:21.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.452+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=RTE4ITFQ96E8 type=write size=148021 2024-09-14T10:54:21.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.453+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~18G8KA0TTOMA.0 size=1048576 2024-09-14T10:54:21.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.454+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~18G8KA0TTOMA.1 size=188325 2024-09-14T10:54:21.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.457+0000 7faa01046780 1 < completed multipart upload key=V11YJWHT4OOD upload=18G8KA0TTOMA tag=0UJWIN8SIOIS type=write size=2285477 2024-09-14T10:54:21.456 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.458+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=FJ49Y8K7ZUXY type=del size=2800219 2024-09-14T10:54:21.457 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.460+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=E08ULRTQRBFE type=del 2024-09-14T10:54:21.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.461+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=8PRFUCOQ2S1P type=del size=54162 2024-09-14T10:54:21.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.463+0000 7faa01046780 1 < completed delete operation key=3UEX0IPM4CPY tag=2JBBZ5IERCML type=del 2024-09-14T10:54:21.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.464+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=N2DR0D3X0Q1A type=del size=4075665 2024-09-14T10:54:21.464 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.466+0000 7faa01046780 1 < completed delete operation key=0OL3SF5IWDMH tag=UYFZK5JD1UEQ type=del 2024-09-14T10:54:21.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.468+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=GIKR0A780X9M type=del size=541280 2024-09-14T10:54:21.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.469+0000 7faa01046780 1 < completed write operation key=XH8GHY9YRGTP tag=U9QVGXI6UA95 type=write size=554555 2024-09-14T10:54:21.469 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.472+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~9Y18HU32LDT2.0 size=1048576 2024-09-14T10:54:21.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.473+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~9Y18HU32LDT2.1 size=1048576 2024-09-14T10:54:21.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.474+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~9Y18HU32LDT2.2 size=213416 2024-09-14T10:54:21.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.474+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=9Y18HU32LDT2 tag=WMBDFZ2RAF6N type=write size=3359144 2024-09-14T10:54:21.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.477+0000 7faa01046780 1 < suggested update operation key=XDJAK0XYQNF0 tag=OJ3CRMSN197D type=del size=473816 2024-09-14T10:54:21.476 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.478+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=W62C0MTWE6MA type=del size=4036604 2024-09-14T10:54:21.477 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.479+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=8O5IXMTKFDLT type=del 2024-09-14T10:54:21.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.482+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~3B6Z0MB8YYID.0 size=1048576 2024-09-14T10:54:21.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.483+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~3B6Z0MB8YYID.1 size=295343 2024-09-14T10:54:21.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.483+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=3B6Z0MB8YYID tag=6II85037OIOP type=write size=2392495 2024-09-14T10:54:21.483 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.486+0000 7faa01046780 1 < suggested remove operation key=TDNQZ8Y1C6X2 tag=CJJJ2IFHBBBV type=del 2024-09-14T10:54:21.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.487+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=NC99WMO3AZ0H type=del size=2240450 2024-09-14T10:54:21.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.490+0000 7faa01046780 1 < suggested update operation key=HYAGNAOWK8LF tag=XG14U3PU69HV type=del size=1839219 2024-09-14T10:54:21.491 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.493+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~399R6J519DUJ.0 size=725250 2024-09-14T10:54:21.491 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.493+0000 7faa01046780 1 > prepared multipart upload key=PBRZNGSOLJ8E upload=399R6J519DUJ tag=QW5U67W3E9T1 type=write size=1773826 2024-09-14T10:54:21.491 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.493+0000 7faa01046780 1 < canceled part key=_multipart_HYAGNAOWK8LF.2~2651KVJGHJG0.0 size=3692 2024-09-14T10:54:21.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.496+0000 7faa01046780 1 < canceled multipart upload key=HYAGNAOWK8LF upload=2651KVJGHJG0 tag=7F2N5RKCLOWU type=write size=1052268 2024-09-14T10:54:21.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.498+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~NCIQ65P521E9.0 size=1048576 2024-09-14T10:54:21.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.499+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~NCIQ65P521E9.1 size=372870 2024-09-14T10:54:21.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.499+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=NCIQ65P521E9 tag=T3QIUEU7TJDH type=write size=2470022 2024-09-14T10:54:21.498 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.501+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~IEBJKRZ3L1O4.0 size=606654 2024-09-14T10:54:21.501 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.503+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=IEBJKRZ3L1O4 tag=79MTG8CZ4O8Q type=write size=1655230 2024-09-14T10:54:21.502 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.504+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=S24A23B9TVH7 type=write size=270223 2024-09-14T10:54:21.503 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.506+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~Q21XTOZ5IJPP.0 size=1048576 2024-09-14T10:54:21.504 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.507+0000 7faa01046780 1 < completed part key=_multipart_V905BR1VWUCV.2~Q21XTOZ5IJPP.1 size=228621 2024-09-14T10:54:21.507 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.509+0000 7faa01046780 1 < completed multipart upload key=V905BR1VWUCV upload=Q21XTOZ5IJPP tag=VD10V9SZ5GPH type=write size=2325773 2024-09-14T10:54:21.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.510+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=G9WH4QZ3ZO9R type=del size=1094630 2024-09-14T10:54:21.510 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.512+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~2CWA681SZ9WC.0 size=725561 2024-09-14T10:54:21.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.514+0000 7faa01046780 1 < completed multipart upload key=FOJGGEQZD7YW upload=2CWA681SZ9WC tag=AJLJCJXG6J0A type=write size=1774137 2024-09-14T10:54:21.514 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.516+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~0I5N6R4IHY9M.0 size=354340 2024-09-14T10:54:21.514 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.516+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=0I5N6R4IHY9M tag=DQ33U41GV2GD type=write size=1402916 2024-09-14T10:54:21.515 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.518+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~H0QWQEIJAGN1.0 size=1048576 2024-09-14T10:54:21.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.519+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~H0QWQEIJAGN1.1 size=194168 2024-09-14T10:54:21.518 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.521+0000 7faa01046780 1 < completed multipart upload key=0OL3SF5IWDMH upload=H0QWQEIJAGN1 tag=5U41868W8ZVK type=write size=2291320 2024-09-14T10:54:21.520 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.522+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=C3J8ZQ89RPBP type=write size=268008 2024-09-14T10:54:21.522 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.524+0000 7faa01046780 1 < completed delete operation key=PTDE6D7OIU1A tag=TGOZDJQTQ2CO type=del 2024-09-14T10:54:21.523 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.525+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=71JOS6TXLE1Q type=del size=3991882 2024-09-14T10:54:21.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.527+0000 7faa01046780 -1 < failed to complete operation key=TDNQZ8Y1C6X2 tag=RTE4ITFQ96E8 type=write size=148021: (22) Invalid argument 2024-09-14T10:54:21.527 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.529+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~Z2NBUXM1MGU2.0 size=408942 2024-09-14T10:54:21.527 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.529+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=Z2NBUXM1MGU2 tag=9CYQ67S04MNF type=write size=1457518 2024-09-14T10:54:21.529 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.531+0000 7faa01046780 1 < canceled operation key=CKMDOO75UZGE tag=FJ49Y8K7ZUXY type=del size=2800219 2024-09-14T10:54:21.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.532+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=DUUO55T0T30N type=del size=3986578 2024-09-14T10:54:21.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.534+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=8PRFUCOQ2S1P type=del 2024-09-14T10:54:21.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.536+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=4M94OOPHDJD1 type=del size=3438650 2024-09-14T10:54:21.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.539+0000 7faa01046780 1 < suggested update operation key=V905BR1VWUCV tag=N2DR0D3X0Q1A type=del size=4075665 2024-09-14T10:54:21.540 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.542+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~UPEHTN4I781D.0 size=1048576 2024-09-14T10:54:21.541 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.543+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~UPEHTN4I781D.1 size=1048576 2024-09-14T10:54:21.542 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.544+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~UPEHTN4I781D.2 size=968353 2024-09-14T10:54:21.542 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.544+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=UPEHTN4I781D tag=7K0DQIM76N8X type=write size=4114081 2024-09-14T10:54:21.543 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.546+0000 7faa01046780 1 < completed delete operation key=VIO703UXIJXV tag=GIKR0A780X9M type=del 2024-09-14T10:54:21.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.548+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~E6QFNGG9GZZS.0 size=1048576 2024-09-14T10:54:21.547 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.550+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~E6QFNGG9GZZS.1 size=1048576 2024-09-14T10:54:21.548 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.551+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~E6QFNGG9GZZS.2 size=910082 2024-09-14T10:54:21.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.551+0000 7faa01046780 1 > prepared multipart upload key=PBRZNGSOLJ8E upload=E6QFNGG9GZZS tag=FLOLKJUTL3AO type=write size=4055810 2024-09-14T10:54:21.551 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.553+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~9Y18HU32LDT2.0 size=1048576 2024-09-14T10:54:21.551 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.554+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~9Y18HU32LDT2.1 size=1048576 2024-09-14T10:54:21.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.555+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~9Y18HU32LDT2.2 size=213416 2024-09-14T10:54:21.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.557+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=9Y18HU32LDT2 tag=WMBDFZ2RAF6N type=write size=3359144 2024-09-14T10:54:21.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.560+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~KPPIKMPBX7BD.0 size=1048576 2024-09-14T10:54:21.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.561+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~KPPIKMPBX7BD.1 size=1048576 2024-09-14T10:54:21.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.562+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~KPPIKMPBX7BD.2 size=586088 2024-09-14T10:54:21.560 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.562+0000 7faa01046780 1 > prepared multipart upload key=V11YJWHT4OOD upload=KPPIKMPBX7BD tag=O49NUG0VXKTC type=write size=3731816 2024-09-14T10:54:21.561 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.563+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=W62C0MTWE6MA type=del 2024-09-14T10:54:21.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.565+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=HOXMDF7S79DT type=del size=4145199 2024-09-14T10:54:21.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.566+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~3B6Z0MB8YYID.0 size=1048576 2024-09-14T10:54:21.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.566+0000 7faa01046780 1 < canceled part key=_multipart_V5T3AN9D7DH6.2~3B6Z0MB8YYID.1 size=295343 2024-09-14T10:54:21.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.568+0000 7faa01046780 1 < canceled multipart upload key=V5T3AN9D7DH6 upload=3B6Z0MB8YYID tag=6II85037OIOP type=write size=2392495 2024-09-14T10:54:21.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.570+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=8IF2QEM3N85B type=write size=174758 2024-09-14T10:54:21.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.571+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=NC99WMO3AZ0H type=del 2024-09-14T10:54:21.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.573+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=M7FU4AEZ67DU type=del size=3201032 2024-09-14T10:54:21.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.574+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~399R6J519DUJ.0 size=725250 2024-09-14T10:54:21.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.576+0000 7faa01046780 1 < completed multipart upload key=PBRZNGSOLJ8E upload=399R6J519DUJ tag=QW5U67W3E9T1 type=write size=1773826 2024-09-14T10:54:21.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.578+0000 7faa01046780 1 > prepared operation key=SJ02N8472YDM tag=906KAAMY2504 type=del size=2732222 2024-09-14T10:54:21.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.579+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~NCIQ65P521E9.0 size=1048576 2024-09-14T10:54:21.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.580+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~NCIQ65P521E9.1 size=372870 2024-09-14T10:54:21.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.583+0000 7faa01046780 1 < completed multipart upload key=V5T3AN9D7DH6 upload=NCIQ65P521E9 tag=T3QIUEU7TJDH type=write size=2470022 2024-09-14T10:54:21.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.585+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~QI77NFHVQUWM.0 size=1048576 2024-09-14T10:54:21.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.586+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~QI77NFHVQUWM.1 size=951593 2024-09-14T10:54:21.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.586+0000 7faa01046780 1 > prepared multipart upload key=TDNQZ8Y1C6X2 upload=QI77NFHVQUWM tag=5NC0HXME2YU2 type=write size=3048745 2024-09-14T10:54:21.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.588+0000 7faa01046780 1 < completed write operation key=ZY0BY3G9NREC tag=S24A23B9TVH7 type=write size=270223 2024-09-14T10:54:21.587 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.589+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=IU5G11X1YSQP type=del size=3270760 2024-09-14T10:54:21.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.591+0000 7faa01046780 1 < completed delete operation key=V5T3AN9D7DH6 tag=G9WH4QZ3ZO9R type=del 2024-09-14T10:54:21.591 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.593+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~USYIZ32GYZ0X.0 size=1048576 2024-09-14T10:54:21.592 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.595+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~USYIZ32GYZ0X.1 size=698228 2024-09-14T10:54:21.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.595+0000 7faa01046780 1 > prepared multipart upload key=TDNQZ8Y1C6X2 upload=USYIZ32GYZ0X tag=W3LB19IBRU17 type=write size=2795380 2024-09-14T10:54:21.594 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.596+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~0I5N6R4IHY9M.0 size=354340 2024-09-14T10:54:21.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.599+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=0I5N6R4IHY9M tag=DQ33U41GV2GD type=write size=1402916 2024-09-14T10:54:21.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.600+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=GQDIDPZOWXHH type=del size=3025687 2024-09-14T10:54:21.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.602+0000 7faa01046780 1 < completed write operation key=FOJGGEQZD7YW tag=C3J8ZQ89RPBP type=write size=268008 2024-09-14T10:54:21.601 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.603+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=IULE93AYL65Z type=write size=1000848 2024-09-14T10:54:21.602 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.604+0000 7faa01046780 1 < completed delete operation key=0OL3SF5IWDMH tag=71JOS6TXLE1Q type=del 2024-09-14T10:54:21.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.607+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~GVJ36A6AB606.0 size=1048576 2024-09-14T10:54:21.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.608+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~GVJ36A6AB606.1 size=792412 2024-09-14T10:54:21.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.608+0000 7faa01046780 1 > prepared multipart upload key=GG02P21TFKIM upload=GVJ36A6AB606 tag=RI3X4TA7ULB3 type=write size=2889564 2024-09-14T10:54:21.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.609+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~Z2NBUXM1MGU2.0 size=408942 2024-09-14T10:54:21.609 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.611+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=Z2NBUXM1MGU2 tag=9CYQ67S04MNF type=write size=1457518 2024-09-14T10:54:21.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.614+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~J10OSXM478EC.0 size=1048576 2024-09-14T10:54:21.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.616+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~J10OSXM478EC.1 size=801813 2024-09-14T10:54:21.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.616+0000 7faa01046780 1 > prepared multipart upload key=F872GLVQDCX6 upload=J10OSXM478EC tag=60BE8YNGAW81 type=write size=2898965 2024-09-14T10:54:21.615 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.617+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=DUUO55T0T30N type=del 2024-09-14T10:54:21.616 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.618+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=C1KP3PSLAQA9 type=del size=2297479 2024-09-14T10:54:21.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.621+0000 7faa01046780 1 < suggested remove operation key=F06QWEOYNQX4 tag=4M94OOPHDJD1 type=del 2024-09-14T10:54:21.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.623+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=YGKXFK226YGP type=write size=134138 2024-09-14T10:54:21.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.624+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~UPEHTN4I781D.0 size=1048576 2024-09-14T10:54:21.623 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.625+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~UPEHTN4I781D.1 size=1048576 2024-09-14T10:54:21.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.626+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~UPEHTN4I781D.2 size=968353 2024-09-14T10:54:21.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.629+0000 7faa01046780 1 < completed multipart upload key=XDJAK0XYQNF0 upload=UPEHTN4I781D tag=7K0DQIM76N8X type=write size=4114081 2024-09-14T10:54:21.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.630+0000 7faa01046780 1 > prepared operation key=SJ02N8472YDM tag=P4FRG4A3V5A6 type=write size=114152 2024-09-14T10:54:21.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.632+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~E6QFNGG9GZZS.0 size=1048576 2024-09-14T10:54:21.631 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.633+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~E6QFNGG9GZZS.1 size=1048576 2024-09-14T10:54:21.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.634+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~E6QFNGG9GZZS.2 size=910082 2024-09-14T10:54:21.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.636+0000 7faa01046780 1 < completed multipart upload key=PBRZNGSOLJ8E upload=E6QFNGG9GZZS tag=FLOLKJUTL3AO type=write size=4055810 2024-09-14T10:54:21.636 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.639+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~I6WMXPKO9306.0 size=1048576 2024-09-14T10:54:21.637 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.640+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~I6WMXPKO9306.1 size=1048576 2024-09-14T10:54:21.638 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.641+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~I6WMXPKO9306.2 size=755196 2024-09-14T10:54:21.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.641+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=I6WMXPKO9306 tag=Y0NDIY4PXYFX type=write size=3900924 2024-09-14T10:54:21.640 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.642+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~KPPIKMPBX7BD.0 size=1048576 2024-09-14T10:54:21.641 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.643+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~KPPIKMPBX7BD.1 size=1048576 2024-09-14T10:54:21.642 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.645+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~KPPIKMPBX7BD.2 size=586088 2024-09-14T10:54:21.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.647+0000 7faa01046780 1 < completed multipart upload key=V11YJWHT4OOD upload=KPPIKMPBX7BD tag=O49NUG0VXKTC type=write size=3731816 2024-09-14T10:54:21.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.648+0000 7faa01046780 1 > prepared operation key=SJ02N8472YDM tag=S7HQK60LSE8L type=del size=2163924 2024-09-14T10:54:21.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.652+0000 7faa01046780 1 < suggested update operation key=V11YJWHT4OOD tag=HOXMDF7S79DT type=del size=4145199 2024-09-14T10:54:21.651 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.653+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=8XZ1IL0NJHOV type=del size=2144769 2024-09-14T10:54:21.652 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.654+0000 7faa01046780 1 < completed write operation key=0OL3SF5IWDMH tag=8IF2QEM3N85B type=write size=174758 2024-09-14T10:54:21.654 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.656+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=WVACDWZTCOT5 type=del size=1118925 2024-09-14T10:54:21.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.657+0000 7faa01046780 1 < completed delete operation key=TDNQZ8Y1C6X2 tag=M7FU4AEZ67DU type=del 2024-09-14T10:54:21.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.660+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~RM0PUOG10AO5.0 size=1048576 2024-09-14T10:54:21.659 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.661+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~RM0PUOG10AO5.1 size=1048576 2024-09-14T10:54:21.660 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.662+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~RM0PUOG10AO5.2 size=74831 2024-09-14T10:54:21.660 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.662+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=RM0PUOG10AO5 tag=0F9DZ17IDVR4 type=write size=3220559 2024-09-14T10:54:21.661 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.664+0000 7faa01046780 1 < completed delete operation key=SJ02N8472YDM tag=906KAAMY2504 type=del 2024-09-14T10:54:21.663 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.665+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=N4HWYQHFHM7Q type=write size=148294 2024-09-14T10:54:21.663 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.665+0000 7faa01046780 1 < canceled part key=_multipart_TDNQZ8Y1C6X2.2~QI77NFHVQUWM.0 size=1048576 2024-09-14T10:54:21.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.666+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~QI77NFHVQUWM.1 size=951593 2024-09-14T10:54:21.668 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.670+0000 7faa01046780 1 < canceled multipart upload key=TDNQZ8Y1C6X2 upload=QI77NFHVQUWM tag=5NC0HXME2YU2 type=write size=3048745 2024-09-14T10:54:21.670 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.673+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~MFWI6VJOIXCT.0 size=397478 2024-09-14T10:54:21.671 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.673+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=MFWI6VJOIXCT tag=4EZJ6C9ONACS type=write size=1446054 2024-09-14T10:54:21.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.675+0000 7faa01046780 1 < suggested update operation key=NXIPG4HR9ZYY tag=IU5G11X1YSQP type=del size=3270760 2024-09-14T10:54:21.675 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.678+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=1BKUMYPIZ0ZW type=write size=293818 2024-09-14T10:54:21.676 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.678+0000 7faa01046780 1 < canceled part key=_multipart_TDNQZ8Y1C6X2.2~USYIZ32GYZ0X.0 size=1048576 2024-09-14T10:54:21.677 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.679+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~USYIZ32GYZ0X.1 size=698228 2024-09-14T10:54:21.679 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.681+0000 7faa01046780 1 < canceled multipart upload key=TDNQZ8Y1C6X2 upload=USYIZ32GYZ0X tag=W3LB19IBRU17 type=write size=2795380 2024-09-14T10:54:21.681 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.684+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~L6FV5HE94E3O.0 size=1048576 2024-09-14T10:54:21.682 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.685+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~L6FV5HE94E3O.1 size=1048576 2024-09-14T10:54:21.684 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.686+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~L6FV5HE94E3O.2 size=453870 2024-09-14T10:54:21.684 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.686+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=L6FV5HE94E3O tag=QJHC0K1R5QE6 type=write size=3599598 2024-09-14T10:54:21.685 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.687+0000 7faa01046780 1 < completed delete operation key=F872GLVQDCX6 tag=GQDIDPZOWXHH type=del 2024-09-14T10:54:21.686 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.689+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=Q87S6BKSPD1R type=del size=2497424 2024-09-14T10:54:21.688 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.690+0000 7faa01046780 1 < completed write operation key=XDJAK0XYQNF0 tag=IULE93AYL65Z type=write size=1000848 2024-09-14T10:54:21.689 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.691+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=KFDOFCQBYKGN type=write size=99814 2024-09-14T10:54:21.691 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.693+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~GVJ36A6AB606.0 size=1048576 2024-09-14T10:54:21.692 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.694+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~GVJ36A6AB606.1 size=792412 2024-09-14T10:54:21.694 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.696+0000 7faa01046780 1 < completed multipart upload key=GG02P21TFKIM upload=GVJ36A6AB606 tag=RI3X4TA7ULB3 type=write size=2889564 2024-09-14T10:54:21.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.699+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~IY2G42EI14QL.0 size=1048576 2024-09-14T10:54:21.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.700+0000 7faa01046780 1 > prepared part key=_multipart_0XVVSUIOBQPL.2~IY2G42EI14QL.1 size=799476 2024-09-14T10:54:21.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.700+0000 7faa01046780 1 > prepared multipart upload key=0XVVSUIOBQPL upload=IY2G42EI14QL tag=Z9UFLQXC087Q type=write size=2896628 2024-09-14T10:54:21.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.702+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~J10OSXM478EC.0 size=1048576 2024-09-14T10:54:21.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.702+0000 7faa01046780 1 < canceled part key=_multipart_F872GLVQDCX6.2~J10OSXM478EC.1 size=801813 2024-09-14T10:54:21.702 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.704+0000 7faa01046780 1 < canceled multipart upload key=F872GLVQDCX6 upload=J10OSXM478EC tag=60BE8YNGAW81 type=write size=2898965 2024-09-14T10:54:21.705 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.707+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~3UZZESPMS2H4.0 size=1048576 2024-09-14T10:54:21.705 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.708+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~3UZZESPMS2H4.1 size=350050 2024-09-14T10:54:21.706 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.708+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=3UZZESPMS2H4 tag=03RPCY0GF31T type=write size=2447202 2024-09-14T10:54:21.707 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.709+0000 7faa01046780 1 < canceled operation key=Q33ET1AN14NG tag=C1KP3PSLAQA9 type=del size=2297479 2024-09-14T10:54:21.708 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.711+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=LZ13KIR1G9AC type=del size=2384858 2024-09-14T10:54:21.710 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.712+0000 7faa01046780 1 < completed write operation key=LF41PL7DFSJI tag=YGKXFK226YGP type=write size=134138 2024-09-14T10:54:21.711 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.713+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=XPCLMMM1B7W0 type=write size=456301 2024-09-14T10:54:21.712 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.714+0000 7faa01046780 1 < completed write operation key=SJ02N8472YDM tag=P4FRG4A3V5A6 type=write size=114152 2024-09-14T10:54:21.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.716+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=92C00LCYX8P2 type=del size=1432858 2024-09-14T10:54:21.715 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.717+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~I6WMXPKO9306.0 size=1048576 2024-09-14T10:54:21.716 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.719+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~I6WMXPKO9306.1 size=1048576 2024-09-14T10:54:21.717 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.720+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~I6WMXPKO9306.2 size=755196 2024-09-14T10:54:21.720 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.722+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=I6WMXPKO9306 tag=Y0NDIY4PXYFX type=write size=3900924 2024-09-14T10:54:21.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.723+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=D7T1PCSRU5H6 type=del size=446985 2024-09-14T10:54:21.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.725+0000 7faa01046780 1 < completed delete operation key=SJ02N8472YDM tag=S7HQK60LSE8L type=del 2024-09-14T10:54:21.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.728+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~LJEH8Z4CZ4C2.0 size=1048576 2024-09-14T10:54:21.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.729+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~LJEH8Z4CZ4C2.1 size=1048576 2024-09-14T10:54:21.728 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.730+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~LJEH8Z4CZ4C2.2 size=855444 2024-09-14T10:54:21.728 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.730+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=LJEH8Z4CZ4C2 tag=02J7JE319L9X type=write size=4001172 2024-09-14T10:54:21.730 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.732+0000 7faa01046780 1 < completed delete operation key=X9DUVQBBLUTF tag=8XZ1IL0NJHOV type=del 2024-09-14T10:54:21.733 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.735+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~9RJGIG3UKT7T.0 size=1048576 2024-09-14T10:54:21.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.736+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~9RJGIG3UKT7T.1 size=1048576 2024-09-14T10:54:21.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.738+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~9RJGIG3UKT7T.2 size=822129 2024-09-14T10:54:21.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.738+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=9RJGIG3UKT7T tag=2IT16WGRRYBK type=write size=3967857 2024-09-14T10:54:21.737 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.739+0000 7faa01046780 1 < completed delete operation key=3FSH0OFMF54V tag=WVACDWZTCOT5 type=del 2024-09-14T10:54:21.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.742+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~ISGTPEFOU7SG.0 size=59617 2024-09-14T10:54:21.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.742+0000 7faa01046780 1 > prepared multipart upload key=TDNQZ8Y1C6X2 upload=ISGTPEFOU7SG tag=E92D1H3RDY4X type=write size=1108193 2024-09-14T10:54:21.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.744+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~RM0PUOG10AO5.0 size=1048576 2024-09-14T10:54:21.743 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.745+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~RM0PUOG10AO5.1 size=1048576 2024-09-14T10:54:21.744 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.746+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~RM0PUOG10AO5.2 size=74831 2024-09-14T10:54:21.746 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.748+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=RM0PUOG10AO5 tag=0F9DZ17IDVR4 type=write size=3220559 2024-09-14T10:54:21.749 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.751+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~J9TATKJWASG5.0 size=108276 2024-09-14T10:54:21.749 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.751+0000 7faa01046780 1 > prepared multipart upload key=F06QWEOYNQX4 upload=J9TATKJWASG5 tag=0WAIP2LNJY9N type=write size=1156852 2024-09-14T10:54:21.750 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.753+0000 7faa01046780 1 < completed write operation key=PTDE6D7OIU1A tag=N4HWYQHFHM7Q type=write size=148294 2024-09-14T10:54:21.752 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.754+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=J9JSCV0EDOOR type=del size=2216272 2024-09-14T10:54:21.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.756+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~MFWI6VJOIXCT.0 size=397478 2024-09-14T10:54:21.756 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.758+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=MFWI6VJOIXCT tag=4EZJ6C9ONACS type=write size=1446054 2024-09-14T10:54:21.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.760+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~AAOPD1S1WP2Q.0 size=1048576 2024-09-14T10:54:21.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.761+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~AAOPD1S1WP2Q.1 size=317262 2024-09-14T10:54:21.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.761+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=AAOPD1S1WP2Q tag=ETG5NH4BQ0LS type=write size=2414414 2024-09-14T10:54:21.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.763+0000 7faa01046780 1 < completed write operation key=PS2QU1UZUYHE tag=1BKUMYPIZ0ZW type=write size=293818 2024-09-14T10:54:21.762 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.764+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=QB0356E6YQ0N type=write size=723677 2024-09-14T10:54:21.763 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.766+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~L6FV5HE94E3O.0 size=1048576 2024-09-14T10:54:21.764 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.767+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~L6FV5HE94E3O.1 size=1048576 2024-09-14T10:54:21.766 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.768+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~L6FV5HE94E3O.2 size=453870 2024-09-14T10:54:21.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.770+0000 7faa01046780 1 < completed multipart upload key=XDJAK0XYQNF0 upload=L6FV5HE94E3O tag=QJHC0K1R5QE6 type=write size=3599598 2024-09-14T10:54:21.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.772+0000 7faa01046780 1 > prepared operation key=SJ02N8472YDM tag=ULMQ18G47T8L type=del size=3553875 2024-09-14T10:54:21.771 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.773+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=Q87S6BKSPD1R type=del 2024-09-14T10:54:21.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.776+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~5WQ26ZO5DDZW.0 size=503232 2024-09-14T10:54:21.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.776+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=5WQ26ZO5DDZW tag=I29BDVHSHU45 type=write size=1551808 2024-09-14T10:54:21.777 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.779+0000 7faa01046780 1 < suggested update operation key=V905BR1VWUCV tag=KFDOFCQBYKGN type=write size=99814 2024-09-14T10:54:21.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.782+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~ZS0CXFMJXGVV.0 size=1048576 2024-09-14T10:54:21.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.783+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~ZS0CXFMJXGVV.1 size=385197 2024-09-14T10:54:21.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.783+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=ZS0CXFMJXGVV tag=RXPYMOKFT75A type=write size=2482349 2024-09-14T10:54:21.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.784+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~IY2G42EI14QL.0 size=1048576 2024-09-14T10:54:21.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.785+0000 7faa01046780 1 < completed part key=_multipart_0XVVSUIOBQPL.2~IY2G42EI14QL.1 size=799476 2024-09-14T10:54:21.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.788+0000 7faa01046780 1 < completed multipart upload key=0XVVSUIOBQPL upload=IY2G42EI14QL tag=Z9UFLQXC087Q type=write size=2896628 2024-09-14T10:54:21.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.789+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=5B2WVQBZCWFO type=del size=2599186 2024-09-14T10:54:21.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.791+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~3UZZESPMS2H4.0 size=1048576 2024-09-14T10:54:21.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.792+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~3UZZESPMS2H4.1 size=350050 2024-09-14T10:54:21.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.795+0000 7faa01046780 1 < completed multipart upload key=XDJAK0XYQNF0 upload=3UZZESPMS2H4 tag=03RPCY0GF31T type=write size=2447202 2024-09-14T10:54:21.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.796+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=FZ3CM7WETFEU type=del size=402616 2024-09-14T10:54:21.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.799+0000 7faa01046780 1 < suggested update operation key=CKMDOO75UZGE tag=LZ13KIR1G9AC type=del size=2384858 2024-09-14T10:54:21.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.803+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~JTHEMTY8YCAO.0 size=1048576 2024-09-14T10:54:21.802 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.804+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~JTHEMTY8YCAO.1 size=341792 2024-09-14T10:54:21.802 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.804+0000 7faa01046780 1 > prepared multipart upload key=PBRZNGSOLJ8E upload=JTHEMTY8YCAO tag=SBAQ8ZEFJ4YP type=write size=2438944 2024-09-14T10:54:21.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.806+0000 7faa01046780 1 < canceled operation key=FOJGGEQZD7YW tag=XPCLMMM1B7W0 type=write size=456301 2024-09-14T10:54:21.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.809+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~SHVC5S3OJ13P.0 size=764393 2024-09-14T10:54:21.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.809+0000 7faa01046780 1 > prepared multipart upload key=LF41PL7DFSJI upload=SHVC5S3OJ13P tag=A2JDJCEG1897 type=write size=1812969 2024-09-14T10:54:21.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.810+0000 7faa01046780 1 < completed delete operation key=PTDE6D7OIU1A tag=92C00LCYX8P2 type=del 2024-09-14T10:54:21.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.812+0000 7faa01046780 1 > prepared operation key=V11YJWHT4OOD tag=39LVBS1NU52H type=write size=918217 2024-09-14T10:54:21.812 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.814+0000 7faa01046780 1 < suggested remove operation key=VIO703UXIJXV tag=D7T1PCSRU5H6 type=del 2024-09-14T10:54:21.813 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.816+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=00DO50X0F0D0 type=del size=1850273 2024-09-14T10:54:21.815 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.817+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~LJEH8Z4CZ4C2.0 size=1048576 2024-09-14T10:54:21.815 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.817+0000 7faa01046780 1 < canceled part key=_multipart_XH8GHY9YRGTP.2~LJEH8Z4CZ4C2.1 size=1048576 2024-09-14T10:54:21.816 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.819+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~LJEH8Z4CZ4C2.2 size=855444 2024-09-14T10:54:21.819 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.821+0000 7faa01046780 1 < canceled multipart upload key=XH8GHY9YRGTP upload=LJEH8Z4CZ4C2 tag=02J7JE319L9X type=write size=4001172 2024-09-14T10:54:21.820 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.823+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=YTDR42STZ501 type=del size=3548879 2024-09-14T10:54:21.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.824+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~9RJGIG3UKT7T.0 size=1048576 2024-09-14T10:54:21.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.825+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~9RJGIG3UKT7T.1 size=1048576 2024-09-14T10:54:21.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.825+0000 7faa01046780 1 < canceled part key=_multipart_S3BGVJ9N9S4P.2~9RJGIG3UKT7T.2 size=822129 2024-09-14T10:54:21.825 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.827+0000 7faa01046780 1 < canceled multipart upload key=S3BGVJ9N9S4P upload=9RJGIG3UKT7T tag=2IT16WGRRYBK type=write size=3967857 2024-09-14T10:54:21.826 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.829+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=28Y4WOK9D02W type=write size=169095 2024-09-14T10:54:21.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.830+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~ISGTPEFOU7SG.0 size=59617 2024-09-14T10:54:21.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.832+0000 7faa01046780 1 < completed multipart upload key=TDNQZ8Y1C6X2 upload=ISGTPEFOU7SG tag=E92D1H3RDY4X type=write size=1108193 2024-09-14T10:54:21.831 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.834+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=64IAYP2WDD3X type=del size=425180 2024-09-14T10:54:21.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.835+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~J9TATKJWASG5.0 size=108276 2024-09-14T10:54:21.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.838+0000 7faa01046780 1 < completed multipart upload key=F06QWEOYNQX4 upload=J9TATKJWASG5 tag=0WAIP2LNJY9N type=write size=1156852 2024-09-14T10:54:21.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.839+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=2KJJAKZUM1VU type=del size=1872240 2024-09-14T10:54:21.839 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.841+0000 7faa01046780 1 < completed delete operation key=GG02P21TFKIM tag=J9JSCV0EDOOR type=del 2024-09-14T10:54:21.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.844+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~OZNDUE6YC31G.0 size=1048576 2024-09-14T10:54:21.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.845+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~OZNDUE6YC31G.1 size=1048576 2024-09-14T10:54:21.844 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.846+0000 7faa01046780 1 > prepared part key=_multipart_3FSH0OFMF54V.2~OZNDUE6YC31G.2 size=136999 2024-09-14T10:54:21.844 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.846+0000 7faa01046780 1 > prepared multipart upload key=3FSH0OFMF54V upload=OZNDUE6YC31G tag=HD4DL2UVUSJ9 type=write size=3282727 2024-09-14T10:54:21.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.848+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~AAOPD1S1WP2Q.0 size=1048576 2024-09-14T10:54:21.847 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.849+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~AAOPD1S1WP2Q.1 size=317262 2024-09-14T10:54:21.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.851+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=AAOPD1S1WP2Q tag=ETG5NH4BQ0LS type=write size=2414414 2024-09-14T10:54:21.851 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.853+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=K15Q8MYZP8NC type=del size=4125466 2024-09-14T10:54:21.852 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.855+0000 7faa01046780 1 < completed write operation key=F872GLVQDCX6 tag=QB0356E6YQ0N type=write size=723677 2024-09-14T10:54:21.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.858+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~Q5IUQJDU0RGT.0 size=1048576 2024-09-14T10:54:21.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.859+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~Q5IUQJDU0RGT.1 size=1048576 2024-09-14T10:54:21.858 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.860+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~Q5IUQJDU0RGT.2 size=1007378 2024-09-14T10:54:21.858 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.860+0000 7faa01046780 1 > prepared multipart upload key=3UEX0IPM4CPY upload=Q5IUQJDU0RGT tag=EZ4LFNA0QOQT type=write size=4153106 2024-09-14T10:54:21.860 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.862+0000 7faa01046780 1 < completed delete operation key=SJ02N8472YDM tag=ULMQ18G47T8L type=del 2024-09-14T10:54:21.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.863+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=7P607JZ9SXZM type=del size=2808462 2024-09-14T10:54:21.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.865+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~5WQ26ZO5DDZW.0 size=503232 2024-09-14T10:54:21.865 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.867+0000 7faa01046780 1 < completed multipart upload key=V5T3AN9D7DH6 upload=5WQ26ZO5DDZW tag=I29BDVHSHU45 type=write size=1551808 2024-09-14T10:54:21.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.869+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=C40DRVXRRWTG type=del size=450149 2024-09-14T10:54:21.868 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.871+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~ZS0CXFMJXGVV.0 size=1048576 2024-09-14T10:54:21.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.872+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~ZS0CXFMJXGVV.1 size=385197 2024-09-14T10:54:21.872 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.874+0000 7faa01046780 1 < completed multipart upload key=XDJAK0XYQNF0 upload=ZS0CXFMJXGVV tag=RXPYMOKFT75A type=write size=2482349 2024-09-14T10:54:21.874 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.876+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=2X9XGS7BFHQJ type=del size=79445 2024-09-14T10:54:21.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.878+0000 7faa01046780 1 < completed delete operation key=3FSH0OFMF54V tag=5B2WVQBZCWFO type=del 2024-09-14T10:54:21.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.881+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~WVGX0F0W5FY0.0 size=1048576 2024-09-14T10:54:21.879 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.882+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~WVGX0F0W5FY0.1 size=1048576 2024-09-14T10:54:21.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.883+0000 7faa01046780 1 > prepared part key=_multipart_PTDE6D7OIU1A.2~WVGX0F0W5FY0.2 size=790504 2024-09-14T10:54:21.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.883+0000 7faa01046780 1 > prepared multipart upload key=PTDE6D7OIU1A upload=WVGX0F0W5FY0 tag=HKKO7P5QZ62L type=write size=3936232 2024-09-14T10:54:21.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.884+0000 7faa01046780 1 < canceled operation key=0XVVSUIOBQPL tag=FZ3CM7WETFEU type=del size=402616 2024-09-14T10:54:21.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.886+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=8EQAK29SK6W2 type=del size=861688 2024-09-14T10:54:21.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.887+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~JTHEMTY8YCAO.0 size=1048576 2024-09-14T10:54:21.886 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.888+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~JTHEMTY8YCAO.1 size=341792 2024-09-14T10:54:21.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.890+0000 7faa01046780 1 < completed multipart upload key=PBRZNGSOLJ8E upload=JTHEMTY8YCAO tag=SBAQ8ZEFJ4YP type=write size=2438944 2024-09-14T10:54:21.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.892+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=K6T1DBXPE6H0 type=del size=1141587 2024-09-14T10:54:21.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.893+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~SHVC5S3OJ13P.0 size=764393 2024-09-14T10:54:21.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.896+0000 7faa01046780 1 < completed multipart upload key=LF41PL7DFSJI upload=SHVC5S3OJ13P tag=A2JDJCEG1897 type=write size=1812969 2024-09-14T10:54:21.895 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.897+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=PRYWC0AELZC3 type=del size=796127 2024-09-14T10:54:21.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.899+0000 7faa01046780 1 < completed write operation key=V11YJWHT4OOD tag=39LVBS1NU52H type=write size=918217 2024-09-14T10:54:21.899 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.901+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~M0R5JODBLYRA.0 size=1048576 2024-09-14T10:54:21.900 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.902+0000 7faa01046780 1 > prepared part key=_multipart_F06QWEOYNQX4.2~M0R5JODBLYRA.1 size=63388 2024-09-14T10:54:21.900 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.902+0000 7faa01046780 1 > prepared multipart upload key=F06QWEOYNQX4 upload=M0R5JODBLYRA tag=I4QQ9XUYT8GY type=write size=2160540 2024-09-14T10:54:21.905 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.904+0000 7faa01046780 1 < completed delete operation key=V5T3AN9D7DH6 tag=00DO50X0F0D0 type=del 2024-09-14T10:54:21.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.905+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=YZ3SE472UY3W type=del size=3608385 2024-09-14T10:54:21.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.907+0000 7faa01046780 1 < completed delete operation key=BBDTPL35W4W0 tag=YTDR42STZ501 type=del 2024-09-14T10:54:21.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.908+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=GK1GXU3XA8V0 type=del size=2196269 2024-09-14T10:54:21.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.909+0000 7faa01046780 1 < completed write operation key=BBDTPL35W4W0 tag=28Y4WOK9D02W type=write size=169095 2024-09-14T10:54:21.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.911+0000 7faa01046780 1 > prepared operation key=SJ02N8472YDM tag=1WFDFK84XHWH type=del size=777341 2024-09-14T10:54:21.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.912+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=64IAYP2WDD3X type=del 2024-09-14T10:54:21.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.913+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=F7I71Y0R2YKC type=del size=1172456 2024-09-14T10:54:21.913 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.915+0000 7faa01046780 1 < completed delete operation key=U8TE0XNK9YKM tag=2KJJAKZUM1VU type=del 2024-09-14T10:54:21.915 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.917+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~6KF909A138GP.0 size=320255 2024-09-14T10:54:21.915 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.917+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=6KF909A138GP tag=KHM34A33VY02 type=write size=1368831 2024-09-14T10:54:21.916 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.919+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~OZNDUE6YC31G.0 size=1048576 2024-09-14T10:54:21.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.920+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~OZNDUE6YC31G.1 size=1048576 2024-09-14T10:54:21.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.921+0000 7faa01046780 1 < completed part key=_multipart_3FSH0OFMF54V.2~OZNDUE6YC31G.2 size=136999 2024-09-14T10:54:21.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.923+0000 7faa01046780 1 < completed multipart upload key=3FSH0OFMF54V upload=OZNDUE6YC31G tag=HD4DL2UVUSJ9 type=write size=3282727 2024-09-14T10:54:21.922 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.924+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=KOCEC951WJRH type=del size=3426668 2024-09-14T10:54:21.925 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.927+0000 7faa01046780 1 < suggested update operation key=3UEX0IPM4CPY tag=K15Q8MYZP8NC type=del size=4125466 2024-09-14T10:54:21.926 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.928+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=MROCW74RC6Q3 type=del size=2825085 2024-09-14T10:54:21.927 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.930+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~Q5IUQJDU0RGT.0 size=1048576 2024-09-14T10:54:21.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.931+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~Q5IUQJDU0RGT.1 size=1048576 2024-09-14T10:54:21.930 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.932+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~Q5IUQJDU0RGT.2 size=1007378 2024-09-14T10:54:21.932 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.934+0000 7faa01046780 1 < completed multipart upload key=3UEX0IPM4CPY upload=Q5IUQJDU0RGT tag=EZ4LFNA0QOQT type=write size=4153106 2024-09-14T10:54:21.933 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.935+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=34B1V8QVLZP8 type=del size=3338229 2024-09-14T10:54:21.935 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.938+0000 7faa01046780 1 < completed delete operation key=F872GLVQDCX6 tag=7P607JZ9SXZM type=del 2024-09-14T10:54:21.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.939+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=YP0Z29M1LZ8Z type=write size=252480 2024-09-14T10:54:21.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.940+0000 7faa01046780 1 < completed delete operation key=HYAGNAOWK8LF tag=C40DRVXRRWTG type=del 2024-09-14T10:54:21.939 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.942+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=RFLN1PF0NHJJ type=del size=3425606 2024-09-14T10:54:21.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.943+0000 7faa01046780 1 < completed delete operation key=0XVVSUIOBQPL tag=2X9XGS7BFHQJ type=del 2024-09-14T10:54:21.942 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.944+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=JTXGFPHHB7QR type=del size=1032315 2024-09-14T10:54:21.943 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.946+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~WVGX0F0W5FY0.0 size=1048576 2024-09-14T10:54:21.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.947+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~WVGX0F0W5FY0.1 size=1048576 2024-09-14T10:54:21.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.948+0000 7faa01046780 1 < completed part key=_multipart_PTDE6D7OIU1A.2~WVGX0F0W5FY0.2 size=790504 2024-09-14T10:54:21.948 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.950+0000 7faa01046780 1 < completed multipart upload key=PTDE6D7OIU1A upload=WVGX0F0W5FY0 tag=HKKO7P5QZ62L type=write size=3936232 2024-09-14T10:54:21.949 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.952+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=VT3OADUXCFUH type=del size=4033211 2024-09-14T10:54:21.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.953+0000 7faa01046780 1 < completed delete operation key=0OL3SF5IWDMH tag=8EQAK29SK6W2 type=del 2024-09-14T10:54:21.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.956+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~GO3HDQ9720F5.0 size=1048576 2024-09-14T10:54:21.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.957+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~GO3HDQ9720F5.1 size=1048576 2024-09-14T10:54:21.956 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.958+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~GO3HDQ9720F5.2 size=114140 2024-09-14T10:54:21.956 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.958+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=GO3HDQ9720F5 tag=CD99LCINFI3M type=write size=3259868 2024-09-14T10:54:21.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.961+0000 7faa01046780 1 < suggested update operation key=GG02P21TFKIM tag=K6T1DBXPE6H0 type=del size=1141587 2024-09-14T10:54:21.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.963+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=7TOWN27FZ6OZ type=del size=39824 2024-09-14T10:54:21.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.966+0000 7faa01046780 1 < suggested remove operation key=XDJAK0XYQNF0 tag=PRYWC0AELZC3 type=del 2024-09-14T10:54:21.966 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.968+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~485LSP1V5K7P.0 size=1048576 2024-09-14T10:54:21.967 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.969+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~485LSP1V5K7P.1 size=822100 2024-09-14T10:54:21.967 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.969+0000 7faa01046780 1 > prepared multipart upload key=VIO703UXIJXV upload=485LSP1V5K7P tag=ZJ6FTRHM0O0X type=write size=2919252 2024-09-14T10:54:21.968 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.971+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~M0R5JODBLYRA.0 size=1048576 2024-09-14T10:54:21.969 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.972+0000 7faa01046780 1 < completed part key=_multipart_F06QWEOYNQX4.2~M0R5JODBLYRA.1 size=63388 2024-09-14T10:54:21.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.974+0000 7faa01046780 1 < completed multipart upload key=F06QWEOYNQX4 upload=M0R5JODBLYRA tag=I4QQ9XUYT8GY type=write size=2160540 2024-09-14T10:54:21.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.976+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=RCYSD8MB6GQW type=del size=1152244 2024-09-14T10:54:21.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.979+0000 7faa01046780 1 < suggested update operation key=NXIPG4HR9ZYY tag=YZ3SE472UY3W type=del size=3608385 2024-09-14T10:54:21.978 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.980+0000 7faa01046780 1 > prepared operation key=V5T3AN9D7DH6 tag=37UYQKT9FHTR type=del size=642842 2024-09-14T10:54:21.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.981+0000 7faa01046780 -1 < failed to complete operation key=XDJAK0XYQNF0 tag=GK1GXU3XA8V0 type=del size=2196269: (22) Invalid argument 2024-09-14T10:54:21.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.983+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=GIIUTGBD3MFK type=del size=1423582 2024-09-14T10:54:21.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.985+0000 7faa01046780 1 < suggested remove operation key=SJ02N8472YDM tag=1WFDFK84XHWH type=del 2024-09-14T10:54:21.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.987+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=JHDLWKEEHVKX type=write size=137875 2024-09-14T10:54:21.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.988+0000 7faa01046780 1 < completed delete operation key=F872GLVQDCX6 tag=F7I71Y0R2YKC type=del 2024-09-14T10:54:21.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.989+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=B0O79S893446 type=del size=265886 2024-09-14T10:54:21.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.991+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~6KF909A138GP.0 size=320255 2024-09-14T10:54:21.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.993+0000 7faa01046780 1 < completed multipart upload key=KDUTH9PIR3FI upload=6KF909A138GP tag=KHM34A33VY02 type=write size=1368831 2024-09-14T10:54:21.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.994+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=AN1VONN2JZRI type=del size=3799706 2024-09-14T10:54:21.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.996+0000 7faa01046780 1 < canceled operation key=BBDTPL35W4W0 tag=KOCEC951WJRH type=del size=3426668 2024-09-14T10:54:21.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.997+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=A0JG5XJHZYXN type=write size=633021 2024-09-14T10:54:21.996 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:21.999+0000 7faa01046780 1 < completed delete operation key=V5T3AN9D7DH6 tag=MROCW74RC6Q3 type=del 2024-09-14T10:54:21.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.000+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=CIXDV0RT45ST type=write size=877113 2024-09-14T10:54:21.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.001+0000 7faa01046780 1 < completed delete operation key=3FSH0OFMF54V tag=34B1V8QVLZP8 type=del 2024-09-14T10:54:22.002 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.004+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~VNM6EUIKH0FY.0 size=1048576 2024-09-14T10:54:22.002 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.005+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~VNM6EUIKH0FY.1 size=621256 2024-09-14T10:54:22.003 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.005+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=VNM6EUIKH0FY tag=A20FA4A1UMRD type=write size=2718408 2024-09-14T10:54:22.004 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.006+0000 7faa01046780 1 < completed write operation key=XH8GHY9YRGTP tag=YP0Z29M1LZ8Z type=write size=252480 2024-09-14T10:54:22.005 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.007+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=D42USTN8LMD2 type=del size=2080211 2024-09-14T10:54:22.007 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.009+0000 7faa01046780 1 < completed delete operation key=TDNQZ8Y1C6X2 tag=RFLN1PF0NHJJ type=del 2024-09-14T10:54:22.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.010+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=EZ5CVTX50VGG type=del size=3487805 2024-09-14T10:54:22.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.012+0000 7faa01046780 1 < completed delete operation key=U8TE0XNK9YKM tag=JTXGFPHHB7QR type=del 2024-09-14T10:54:22.012 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.014+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~3VXXMWJTMWJ7.0 size=688092 2024-09-14T10:54:22.012 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.014+0000 7faa01046780 1 > prepared multipart upload key=F872GLVQDCX6 upload=3VXXMWJTMWJ7 tag=APOKTJB3IQ22 type=write size=1736668 2024-09-14T10:54:22.013 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.016+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=VT3OADUXCFUH type=del 2024-09-14T10:54:22.015 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.017+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=GA35YXY21KY4 type=write size=582002 2024-09-14T10:54:22.016 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.019+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~GO3HDQ9720F5.0 size=1048576 2024-09-14T10:54:22.018 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.020+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~GO3HDQ9720F5.1 size=1048576 2024-09-14T10:54:22.018 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.020+0000 7faa01046780 1 < canceled part key=_multipart_S3BGVJ9N9S4P.2~GO3HDQ9720F5.2 size=114140 2024-09-14T10:54:22.020 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.022+0000 7faa01046780 1 < canceled multipart upload key=S3BGVJ9N9S4P upload=GO3HDQ9720F5 tag=CD99LCINFI3M type=write size=3259868 2024-09-14T10:54:22.021 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.024+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=223N6WI0MY02 type=del size=193922 2024-09-14T10:54:22.023 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.025+0000 7faa01046780 1 < completed delete operation key=Q33ET1AN14NG tag=7TOWN27FZ6OZ type=del 2024-09-14T10:54:22.025 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.027+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=HFXX7AZKMZC6 type=write size=468704 2024-09-14T10:54:22.026 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.028+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~485LSP1V5K7P.0 size=1048576 2024-09-14T10:54:22.027 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.029+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~485LSP1V5K7P.1 size=822100 2024-09-14T10:54:22.029 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.032+0000 7faa01046780 1 < completed multipart upload key=VIO703UXIJXV upload=485LSP1V5K7P tag=ZJ6FTRHM0O0X type=write size=2919252 2024-09-14T10:54:22.031 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.033+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=13FJRX9KVQQX type=del size=1128969 2024-09-14T10:54:22.032 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.035+0000 7faa01046780 1 < canceled operation key=0XVVSUIOBQPL tag=RCYSD8MB6GQW type=del size=1152244 2024-09-14T10:54:22.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.037+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~X3MJL77CJ69A.0 size=1048576 2024-09-14T10:54:22.036 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.038+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~X3MJL77CJ69A.1 size=1048576 2024-09-14T10:54:22.037 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.039+0000 7faa01046780 1 > prepared part key=_multipart_VIO703UXIJXV.2~X3MJL77CJ69A.2 size=821113 2024-09-14T10:54:22.037 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.039+0000 7faa01046780 1 > prepared multipart upload key=VIO703UXIJXV upload=X3MJL77CJ69A tag=EVBH9RTIL2T3 type=write size=3966841 2024-09-14T10:54:22.038 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.041+0000 7faa01046780 1 < completed delete operation key=V5T3AN9D7DH6 tag=37UYQKT9FHTR type=del 2024-09-14T10:54:22.040 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.042+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=VJ8SS5R1N0MQ type=del size=3959609 2024-09-14T10:54:22.041 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.044+0000 7faa01046780 1 < completed delete operation key=0XVVSUIOBQPL tag=GIIUTGBD3MFK type=del 2024-09-14T10:54:22.043 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.045+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=FPI67ZDW8FOE type=del size=1975098 2024-09-14T10:54:22.045 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.047+0000 7faa01046780 1 < completed write operation key=PTDE6D7OIU1A tag=JHDLWKEEHVKX type=write size=137875 2024-09-14T10:54:22.047 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.049+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=QJ264MFY1S2F type=del size=3546152 2024-09-14T10:54:22.048 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.050+0000 7faa01046780 1 < canceled operation key=0OL3SF5IWDMH tag=B0O79S893446 type=del size=265886 2024-09-14T10:54:22.050 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.052+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=C3AT406VSW1K type=write size=285772 2024-09-14T10:54:22.051 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.054+0000 7faa01046780 1 < completed delete operation key=PBRZNGSOLJ8E tag=AN1VONN2JZRI type=del 2024-09-14T10:54:22.053 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.055+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=MQ25RDXBUDRO type=del size=2760775 2024-09-14T10:54:22.054 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.057+0000 7faa01046780 1 < canceled operation key=HYAGNAOWK8LF tag=A0JG5XJHZYXN type=write size=633021 2024-09-14T10:54:22.056 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.058+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=JIV1VBX353QJ type=del size=2684203 2024-09-14T10:54:22.057 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.060+0000 7faa01046780 1 < completed write operation key=PBRZNGSOLJ8E tag=CIXDV0RT45ST type=write size=877113 2024-09-14T10:54:22.059 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.061+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=WKO5RDCZYZHT type=del size=176716 2024-09-14T10:54:22.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.063+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~VNM6EUIKH0FY.0 size=1048576 2024-09-14T10:54:22.061 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.064+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~VNM6EUIKH0FY.1 size=621256 2024-09-14T10:54:22.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.066+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=VNM6EUIKH0FY tag=A20FA4A1UMRD type=write size=2718408 2024-09-14T10:54:22.065 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.067+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=XV5HP9J2B3WZ type=del size=1101069 2024-09-14T10:54:22.067 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.069+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=D42USTN8LMD2 type=del 2024-09-14T10:54:22.068 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.071+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=PGMKP05UOPNO type=del size=4193613 2024-09-14T10:54:22.070 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.072+0000 7faa01046780 1 < completed delete operation key=VIO703UXIJXV tag=EZ5CVTX50VGG type=del 2024-09-14T10:54:22.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.075+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=PO6CF44EMRHQ type=write size=371092 2024-09-14T10:54:22.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.075+0000 7faa01046780 1 < canceled part key=_multipart_F872GLVQDCX6.2~3VXXMWJTMWJ7.0 size=688092 2024-09-14T10:54:22.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.078+0000 7faa01046780 1 < canceled multipart upload key=F872GLVQDCX6 upload=3VXXMWJTMWJ7 tag=APOKTJB3IQ22 type=write size=1736668 2024-09-14T10:54:22.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.081+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~9ZTK3OUNHRK8.0 size=302202 2024-09-14T10:54:22.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.081+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=9ZTK3OUNHRK8 tag=0DFJIUPCM9OD type=write size=1350778 2024-09-14T10:54:22.081 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.084+0000 7faa01046780 1 < suggested update operation key=ZY0BY3G9NREC tag=GA35YXY21KY4 type=write size=582002 2024-09-14T10:54:22.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.085+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=Y6LIWJJZ84M6 type=del size=3201594 2024-09-14T10:54:22.084 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.087+0000 7faa01046780 1 < canceled operation key=NXIPG4HR9ZYY tag=223N6WI0MY02 type=del size=193922 2024-09-14T10:54:22.086 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.088+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=XOZTHR180STJ type=del size=333136 2024-09-14T10:54:22.087 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.090+0000 7faa01046780 1 < completed write operation key=Y4CB0HIN0750 tag=HFXX7AZKMZC6 type=write size=468704 2024-09-14T10:54:22.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.091+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=CM2RN2X1CCBD type=del size=3742960 2024-09-14T10:54:22.092 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.094+0000 7faa01046780 1 < suggested update operation key=ZY0BY3G9NREC tag=13FJRX9KVQQX type=del size=1128969 2024-09-14T10:54:22.093 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.095+0000 7faa01046780 1 > prepared operation key=3UEX0IPM4CPY tag=NBMF5DMVEM50 type=del size=2542977 2024-09-14T10:54:22.094 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.096+0000 7faa01046780 1 < canceled part key=_multipart_VIO703UXIJXV.2~X3MJL77CJ69A.0 size=1048576 2024-09-14T10:54:22.095 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.097+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~X3MJL77CJ69A.1 size=1048576 2024-09-14T10:54:22.096 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.099+0000 7faa01046780 1 < completed part key=_multipart_VIO703UXIJXV.2~X3MJL77CJ69A.2 size=821113 2024-09-14T10:54:22.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.101+0000 7faa01046780 1 < canceled multipart upload key=VIO703UXIJXV upload=X3MJL77CJ69A tag=EVBH9RTIL2T3 type=write size=3966841 2024-09-14T10:54:22.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.103+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=JG6JX0YGRQWX type=del size=166408 2024-09-14T10:54:22.102 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.104+0000 7faa01046780 1 < completed delete operation key=0OL3SF5IWDMH tag=VJ8SS5R1N0MQ type=del 2024-09-14T10:54:22.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.105+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=C9JFHD26LB7I type=del size=3649186 2024-09-14T10:54:22.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.107+0000 7faa01046780 1 < canceled operation key=0OL3SF5IWDMH tag=FPI67ZDW8FOE type=del size=1975098 2024-09-14T10:54:22.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.108+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=V2NDA2QEOCS8 type=del size=3425431 2024-09-14T10:54:22.109 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.111+0000 7faa01046780 1 < suggested remove operation key=XH8GHY9YRGTP tag=QJ264MFY1S2F type=del 2024-09-14T10:54:22.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.113+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~PK6Q42NRJL0S.0 size=1048576 2024-09-14T10:54:22.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.114+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~PK6Q42NRJL0S.1 size=1048576 2024-09-14T10:54:22.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.115+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~PK6Q42NRJL0S.2 size=956494 2024-09-14T10:54:22.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.115+0000 7faa01046780 1 > prepared multipart upload key=PBRZNGSOLJ8E upload=PK6Q42NRJL0S tag=KY181NLOHFKT type=write size=4102222 2024-09-14T10:54:22.115 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.117+0000 7faa01046780 1 < completed write operation key=XDJAK0XYQNF0 tag=C3AT406VSW1K type=write size=285772 2024-09-14T10:54:22.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.119+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~OEMCV9XNH7MX.0 size=1048576 2024-09-14T10:54:22.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.120+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~OEMCV9XNH7MX.1 size=1048576 2024-09-14T10:54:22.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.122+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~OEMCV9XNH7MX.2 size=105100 2024-09-14T10:54:22.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.122+0000 7faa01046780 1 > prepared multipart upload key=V11YJWHT4OOD upload=OEMCV9XNH7MX tag=GQ1N3ODNAVX0 type=write size=3250828 2024-09-14T10:54:22.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.123+0000 7faa01046780 1 < completed delete operation key=U8TE0XNK9YKM tag=MQ25RDXBUDRO type=del 2024-09-14T10:54:22.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.124+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=WGQF39YW809X type=write size=136908 2024-09-14T10:54:22.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.126+0000 7faa01046780 1 < completed delete operation key=NXIPG4HR9ZYY tag=JIV1VBX353QJ type=del 2024-09-14T10:54:22.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.128+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~2TCQB7RM1U83.0 size=1048576 2024-09-14T10:54:22.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.129+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~2TCQB7RM1U83.1 size=159120 2024-09-14T10:54:22.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.129+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=2TCQB7RM1U83 tag=G4DMA3G6XQBS type=write size=2256272 2024-09-14T10:54:22.129 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.131+0000 7faa01046780 1 < completed delete operation key=F06QWEOYNQX4 tag=WKO5RDCZYZHT type=del 2024-09-14T10:54:22.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.134+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~RMSI24HVYDPY.0 size=1048576 2024-09-14T10:54:22.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.135+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~RMSI24HVYDPY.1 size=1048576 2024-09-14T10:54:22.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.136+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~RMSI24HVYDPY.2 size=1031245 2024-09-14T10:54:22.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.136+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=RMSI24HVYDPY tag=2R8S1G34ICDA type=write size=4176973 2024-09-14T10:54:22.135 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.138+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=XV5HP9J2B3WZ type=del 2024-09-14T10:54:22.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.139+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=0FJVA80ODW9Q type=del size=3169480 2024-09-14T10:54:22.139 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.141+0000 7faa01046780 1 < completed delete operation key=LF41PL7DFSJI tag=PGMKP05UOPNO type=del 2024-09-14T10:54:22.140 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.143+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=43QS8BDWGV8H type=del size=2940022 2024-09-14T10:54:22.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.144+0000 7faa01046780 1 < completed write operation key=FOJGGEQZD7YW tag=PO6CF44EMRHQ type=write size=371092 2024-09-14T10:54:22.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.147+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~QDBLVRQHOXIQ.0 size=1048576 2024-09-14T10:54:22.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.148+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~QDBLVRQHOXIQ.1 size=842094 2024-09-14T10:54:22.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.148+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=QDBLVRQHOXIQ tag=3MYSPKAQVQGG type=write size=2939246 2024-09-14T10:54:22.148 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.150+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~9ZTK3OUNHRK8.0 size=302202 2024-09-14T10:54:22.150 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.152+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=9ZTK3OUNHRK8 tag=0DFJIUPCM9OD type=write size=1350778 2024-09-14T10:54:22.152 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.155+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~JTY8YOGDTGAW.0 size=1048576 2024-09-14T10:54:22.153 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.156+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~JTY8YOGDTGAW.1 size=1048576 2024-09-14T10:54:22.154 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.157+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~JTY8YOGDTGAW.2 size=1007132 2024-09-14T10:54:22.155 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.157+0000 7faa01046780 1 > prepared multipart upload key=LF41PL7DFSJI upload=JTY8YOGDTGAW tag=QKW2OESERXIE type=write size=4152860 2024-09-14T10:54:22.156 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.158+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=Y6LIWJJZ84M6 type=del 2024-09-14T10:54:22.158 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.161+0000 7faa01046780 1 > prepared part key=_multipart_NXIPG4HR9ZYY.2~Q2V5BV7M5MXP.0 size=286516 2024-09-14T10:54:22.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.161+0000 7faa01046780 1 > prepared multipart upload key=NXIPG4HR9ZYY upload=Q2V5BV7M5MXP tag=XESJH0UBRY44 type=write size=1335092 2024-09-14T10:54:22.160 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.162+0000 7faa01046780 1 < completed delete operation key=V905BR1VWUCV tag=XOZTHR180STJ type=del 2024-09-14T10:54:22.162 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.165+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~76WDZN39SLE9.0 size=1048576 2024-09-14T10:54:22.163 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.166+0000 7faa01046780 1 > prepared part key=_multipart_Q33ET1AN14NG.2~76WDZN39SLE9.1 size=38619 2024-09-14T10:54:22.163 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.166+0000 7faa01046780 1 > prepared multipart upload key=Q33ET1AN14NG upload=76WDZN39SLE9 tag=S07NS9E360UE type=write size=2135771 2024-09-14T10:54:22.165 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.167+0000 7faa01046780 1 < completed delete operation key=XDJAK0XYQNF0 tag=CM2RN2X1CCBD type=del 2024-09-14T10:54:22.166 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.169+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=4GE7IEPRLJ46 type=del size=2295281 2024-09-14T10:54:22.168 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.170+0000 7faa01046780 1 < completed delete operation key=3UEX0IPM4CPY tag=NBMF5DMVEM50 type=del 2024-09-14T10:54:22.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.173+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~SRTUSD15XW6S.0 size=1048576 2024-09-14T10:54:22.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.174+0000 7faa01046780 1 > prepared part key=_multipart_F872GLVQDCX6.2~SRTUSD15XW6S.1 size=369000 2024-09-14T10:54:22.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.174+0000 7faa01046780 1 > prepared multipart upload key=F872GLVQDCX6 upload=SRTUSD15XW6S tag=IRER2GLYC3Z2 type=write size=2466152 2024-09-14T10:54:22.173 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.175+0000 7faa01046780 -1 < failed to complete operation key=XH8GHY9YRGTP tag=JG6JX0YGRQWX type=del size=166408: (22) Invalid argument 2024-09-14T10:54:22.174 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.177+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=4GTNMCXVDUL6 type=del size=3154752 2024-09-14T10:54:22.176 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.178+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=C9JFHD26LB7I type=del 2024-09-14T10:54:22.178 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.181+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~94LW4W7Y7M8G.0 size=96679 2024-09-14T10:54:22.179 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.181+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=94LW4W7Y7M8G tag=G2AWEJM3VP6A type=write size=1145255 2024-09-14T10:54:22.181 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.183+0000 7faa01046780 1 < suggested update operation key=0XVVSUIOBQPL tag=V2NDA2QEOCS8 type=del size=3425431 2024-09-14T10:54:22.185 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.187+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~76C84DRM47SX.0 size=1048576 2024-09-14T10:54:22.185 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.188+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~76C84DRM47SX.1 size=100180 2024-09-14T10:54:22.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.188+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=76C84DRM47SX tag=8G0FWTT2PS1W type=write size=2197332 2024-09-14T10:54:22.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.189+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~PK6Q42NRJL0S.0 size=1048576 2024-09-14T10:54:22.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.190+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~PK6Q42NRJL0S.1 size=1048576 2024-09-14T10:54:22.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.191+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~PK6Q42NRJL0S.2 size=956494 2024-09-14T10:54:22.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.194+0000 7faa01046780 1 < completed multipart upload key=PBRZNGSOLJ8E upload=PK6Q42NRJL0S tag=KY181NLOHFKT type=write size=4102222 2024-09-14T10:54:22.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.197+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~JI500VHT1K1T.0 size=1048576 2024-09-14T10:54:22.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.198+0000 7faa01046780 1 > prepared part key=_multipart_FOJGGEQZD7YW.2~JI500VHT1K1T.1 size=451593 2024-09-14T10:54:22.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.198+0000 7faa01046780 1 > prepared multipart upload key=FOJGGEQZD7YW upload=JI500VHT1K1T tag=9PJBATLGBFUJ type=write size=2548745 2024-09-14T10:54:22.197 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.200+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~OEMCV9XNH7MX.0 size=1048576 2024-09-14T10:54:22.198 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.201+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~OEMCV9XNH7MX.1 size=1048576 2024-09-14T10:54:22.199 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.202+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~OEMCV9XNH7MX.2 size=105100 2024-09-14T10:54:22.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.204+0000 7faa01046780 1 < completed multipart upload key=V11YJWHT4OOD upload=OEMCV9XNH7MX tag=GQ1N3ODNAVX0 type=write size=3250828 2024-09-14T10:54:22.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.206+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=0NCD5G1P8OSQ type=del size=2562216 2024-09-14T10:54:22.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.207+0000 7faa01046780 1 < canceled operation key=Y4CB0HIN0750 tag=WGQF39YW809X type=write size=136908 2024-09-14T10:54:22.206 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.209+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=MP3J713O9N1R type=write size=224440 2024-09-14T10:54:22.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.211+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~2TCQB7RM1U83.0 size=1048576 2024-09-14T10:54:22.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.212+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~2TCQB7RM1U83.1 size=159120 2024-09-14T10:54:22.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.215+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=2TCQB7RM1U83 tag=G4DMA3G6XQBS type=write size=2256272 2024-09-14T10:54:22.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.216+0000 7faa01046780 1 > prepared operation key=0XVVSUIOBQPL tag=HGMUXWTRPLA4 type=del size=2512913 2024-09-14T10:54:22.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.217+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~RMSI24HVYDPY.0 size=1048576 2024-09-14T10:54:22.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.219+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~RMSI24HVYDPY.1 size=1048576 2024-09-14T10:54:22.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.220+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~RMSI24HVYDPY.2 size=1031245 2024-09-14T10:54:22.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.222+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=RMSI24HVYDPY tag=2R8S1G34ICDA type=write size=4176973 2024-09-14T10:54:22.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.223+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=YT52NSK2OM0L type=del size=157029 2024-09-14T10:54:22.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.225+0000 7faa01046780 1 < canceled operation key=ZY0BY3G9NREC tag=0FJVA80ODW9Q type=del size=3169480 2024-09-14T10:54:22.224 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.226+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=DHXXUL99YH6W type=write size=968276 2024-09-14T10:54:22.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.227+0000 7faa01046780 1 < completed delete operation key=F872GLVQDCX6 tag=43QS8BDWGV8H type=del 2024-09-14T10:54:22.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.230+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~7VBEN61QG8AM.0 size=1048576 2024-09-14T10:54:22.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.231+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~7VBEN61QG8AM.1 size=1048576 2024-09-14T10:54:22.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.232+0000 7faa01046780 1 > prepared part key=_multipart_V11YJWHT4OOD.2~7VBEN61QG8AM.2 size=630290 2024-09-14T10:54:22.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.232+0000 7faa01046780 1 > prepared multipart upload key=V11YJWHT4OOD upload=7VBEN61QG8AM tag=WJ2KUR9PA5CZ type=write size=3776018 2024-09-14T10:54:22.231 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.233+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~QDBLVRQHOXIQ.0 size=1048576 2024-09-14T10:54:22.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.234+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~QDBLVRQHOXIQ.1 size=842094 2024-09-14T10:54:22.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.236+0000 7faa01046780 1 < completed multipart upload key=HYAGNAOWK8LF upload=QDBLVRQHOXIQ tag=3MYSPKAQVQGG type=write size=2939246 2024-09-14T10:54:22.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.239+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~SI9ICGCHPFAN.0 size=1048576 2024-09-14T10:54:22.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.240+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~SI9ICGCHPFAN.1 size=1048576 2024-09-14T10:54:22.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.241+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~SI9ICGCHPFAN.2 size=998744 2024-09-14T10:54:22.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.241+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=SI9ICGCHPFAN tag=Y82YE6B2XN88 type=write size=4144472 2024-09-14T10:54:22.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.243+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~JTY8YOGDTGAW.0 size=1048576 2024-09-14T10:54:22.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.244+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~JTY8YOGDTGAW.1 size=1048576 2024-09-14T10:54:22.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.245+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~JTY8YOGDTGAW.2 size=1007132 2024-09-14T10:54:22.245 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.247+0000 7faa01046780 1 < completed multipart upload key=LF41PL7DFSJI upload=JTY8YOGDTGAW tag=QKW2OESERXIE type=write size=4152860 2024-09-14T10:54:22.247 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.249+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=YJGDG6IW4IX2 type=write size=6958 2024-09-14T10:54:22.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.250+0000 7faa01046780 1 < completed part key=_multipart_NXIPG4HR9ZYY.2~Q2V5BV7M5MXP.0 size=286516 2024-09-14T10:54:22.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.253+0000 7faa01046780 1 < completed multipart upload key=NXIPG4HR9ZYY upload=Q2V5BV7M5MXP tag=XESJH0UBRY44 type=write size=1335092 2024-09-14T10:54:22.253 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.255+0000 7faa01046780 1 > prepared part key=_multipart_LF41PL7DFSJI.2~HUK0LG6HWLHZ.0 size=352974 2024-09-14T10:54:22.253 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.255+0000 7faa01046780 1 > prepared multipart upload key=LF41PL7DFSJI upload=HUK0LG6HWLHZ tag=2NLMQRRUAEWF type=write size=1401550 2024-09-14T10:54:22.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.257+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~76WDZN39SLE9.0 size=1048576 2024-09-14T10:54:22.255 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.258+0000 7faa01046780 1 < completed part key=_multipart_Q33ET1AN14NG.2~76WDZN39SLE9.1 size=38619 2024-09-14T10:54:22.258 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.260+0000 7faa01046780 1 < completed multipart upload key=Q33ET1AN14NG upload=76WDZN39SLE9 tag=S07NS9E360UE type=write size=2135771 2024-09-14T10:54:22.259 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.261+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=BP28LH58OD1U type=del size=2588232 2024-09-14T10:54:22.260 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.262+0000 7faa01046780 1 < canceled operation key=FOJGGEQZD7YW tag=4GE7IEPRLJ46 type=del size=2295281 2024-09-14T10:54:22.262 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.265+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~P3W6KZJQB71K.0 size=932258 2024-09-14T10:54:22.263 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.265+0000 7faa01046780 1 > prepared multipart upload key=TDNQZ8Y1C6X2 upload=P3W6KZJQB71K tag=GET8HDXMTYF4 type=write size=1980834 2024-09-14T10:54:22.264 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.266+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~SRTUSD15XW6S.0 size=1048576 2024-09-14T10:54:22.265 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.267+0000 7faa01046780 1 < completed part key=_multipart_F872GLVQDCX6.2~SRTUSD15XW6S.1 size=369000 2024-09-14T10:54:22.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.269+0000 7faa01046780 1 < completed multipart upload key=F872GLVQDCX6 upload=SRTUSD15XW6S tag=IRER2GLYC3Z2 type=write size=2466152 2024-09-14T10:54:22.268 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.271+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=LE54RF00Z3EE type=del size=3560312 2024-09-14T10:54:22.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.272+0000 7faa01046780 1 < completed delete operation key=PS2QU1UZUYHE tag=4GTNMCXVDUL6 type=del 2024-09-14T10:54:22.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.274+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~3N2VUNLLJ4IU.0 size=1048576 2024-09-14T10:54:22.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.276+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~3N2VUNLLJ4IU.1 size=304117 2024-09-14T10:54:22.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.276+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=3N2VUNLLJ4IU tag=7LXFD5B89GLT type=write size=2401269 2024-09-14T10:54:22.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.277+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~94LW4W7Y7M8G.0 size=96679 2024-09-14T10:54:22.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.279+0000 7faa01046780 1 < completed multipart upload key=0OL3SF5IWDMH upload=94LW4W7Y7M8G tag=G2AWEJM3VP6A type=write size=1145255 2024-09-14T10:54:22.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.282+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~DJM64KR4I3TM.0 size=1048576 2024-09-14T10:54:22.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.283+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~DJM64KR4I3TM.1 size=341172 2024-09-14T10:54:22.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.283+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=DJM64KR4I3TM tag=8XBAOOQ2000J type=write size=2438324 2024-09-14T10:54:22.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.284+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~76C84DRM47SX.0 size=1048576 2024-09-14T10:54:22.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.286+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~76C84DRM47SX.1 size=100180 2024-09-14T10:54:22.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.288+0000 7faa01046780 1 < completed multipart upload key=XDJAK0XYQNF0 upload=76C84DRM47SX tag=8G0FWTT2PS1W type=write size=2197332 2024-09-14T10:54:22.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.291+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~70E30ANBPY0O.0 size=382633 2024-09-14T10:54:22.289 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.291+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=70E30ANBPY0O tag=A7W4Z2M7E2N0 type=write size=1431209 2024-09-14T10:54:22.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.292+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~JI500VHT1K1T.0 size=1048576 2024-09-14T10:54:22.291 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.293+0000 7faa01046780 1 < completed part key=_multipart_FOJGGEQZD7YW.2~JI500VHT1K1T.1 size=451593 2024-09-14T10:54:22.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.296+0000 7faa01046780 1 < completed multipart upload key=FOJGGEQZD7YW upload=JI500VHT1K1T tag=9PJBATLGBFUJ type=write size=2548745 2024-09-14T10:54:22.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.297+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=94S7ZH0L4IFQ type=del size=2073376 2024-09-14T10:54:22.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.298+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=0NCD5G1P8OSQ type=del 2024-09-14T10:54:22.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.300+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=FC7C4681F7S3 type=write size=363073 2024-09-14T10:54:22.299 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.301+0000 7faa01046780 1 < canceled operation key=LF41PL7DFSJI tag=MP3J713O9N1R type=write size=224440 2024-09-14T10:54:22.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.303+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=D4RDSW16K8H4 type=del size=1671737 2024-09-14T10:54:22.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.304+0000 7faa01046780 1 < completed delete operation key=0XVVSUIOBQPL tag=HGMUXWTRPLA4 type=del 2024-09-14T10:54:22.303 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.305+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=VFR4Y9JTQWD3 type=del size=11347 2024-09-14T10:54:22.305 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.307+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=YT52NSK2OM0L type=del 2024-09-14T10:54:22.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.308+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=2HNO16UT0170 type=del size=3977055 2024-09-14T10:54:22.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.310+0000 7faa01046780 1 < completed write operation key=XDJAK0XYQNF0 tag=DHXXUL99YH6W type=write size=968276 2024-09-14T10:54:22.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.311+0000 7faa01046780 1 > prepared operation key=X9DUVQBBLUTF tag=2ZKZRMZLI1O9 type=write size=779679 2024-09-14T10:54:22.312 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.313+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~7VBEN61QG8AM.0 size=1048576 2024-09-14T10:54:22.312 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.314+0000 7faa01046780 1 < completed part key=_multipart_V11YJWHT4OOD.2~7VBEN61QG8AM.1 size=1048576 2024-09-14T10:54:22.313 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.314+0000 7faa01046780 1 < canceled part key=_multipart_V11YJWHT4OOD.2~7VBEN61QG8AM.2 size=630290 2024-09-14T10:54:22.313 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.316+0000 7faa01046780 1 < canceled multipart upload key=V11YJWHT4OOD upload=7VBEN61QG8AM tag=WJ2KUR9PA5CZ type=write size=3776018 2024-09-14T10:54:22.315 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.317+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=02B793YV3KQX type=del size=2608089 2024-09-14T10:54:22.316 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.319+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~SI9ICGCHPFAN.0 size=1048576 2024-09-14T10:54:22.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.320+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~SI9ICGCHPFAN.1 size=1048576 2024-09-14T10:54:22.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.321+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~SI9ICGCHPFAN.2 size=998744 2024-09-14T10:54:22.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.323+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=SI9ICGCHPFAN tag=Y82YE6B2XN88 type=write size=4144472 2024-09-14T10:54:22.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.324+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=E1MM7NHCR2ML type=del size=725421 2024-09-14T10:54:22.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.327+0000 7faa01046780 1 < suggested update operation key=ZY0BY3G9NREC tag=YJGDG6IW4IX2 type=write size=6958 2024-09-14T10:54:22.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.328+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=NV0B382PC0MM type=del size=3018648 2024-09-14T10:54:22.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.330+0000 7faa01046780 1 < completed part key=_multipart_LF41PL7DFSJI.2~HUK0LG6HWLHZ.0 size=352974 2024-09-14T10:54:22.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.332+0000 7faa01046780 1 < completed multipart upload key=LF41PL7DFSJI upload=HUK0LG6HWLHZ tag=2NLMQRRUAEWF type=write size=1401550 2024-09-14T10:54:22.333 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.335+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~64KYJ8LW8DHG.0 size=1048576 2024-09-14T10:54:22.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.337+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~64KYJ8LW8DHG.1 size=1048576 2024-09-14T10:54:22.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.338+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~64KYJ8LW8DHG.2 size=550352 2024-09-14T10:54:22.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.338+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=64KYJ8LW8DHG tag=R8IY3FY37CO3 type=write size=3696080 2024-09-14T10:54:22.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.340+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=BP28LH58OD1U type=del 2024-09-14T10:54:22.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.341+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=8ETUGEZAIIIT type=del size=3675321 2024-09-14T10:54:22.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.342+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~P3W6KZJQB71K.0 size=932258 2024-09-14T10:54:22.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.345+0000 7faa01046780 1 < completed multipart upload key=TDNQZ8Y1C6X2 upload=P3W6KZJQB71K tag=GET8HDXMTYF4 type=write size=1980834 2024-09-14T10:54:22.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.346+0000 7faa01046780 1 > prepared operation key=3FSH0OFMF54V tag=T5F3JMTBPP0A type=del size=17654 2024-09-14T10:54:22.346 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.348+0000 7faa01046780 1 < completed delete operation key=PTDE6D7OIU1A tag=LE54RF00Z3EE type=del 2024-09-14T10:54:22.348 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.350+0000 7faa01046780 1 > prepared part key=_multipart_GG02P21TFKIM.2~E2X5XYT3IFXC.0 size=139013 2024-09-14T10:54:22.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.350+0000 7faa01046780 1 > prepared multipart upload key=GG02P21TFKIM upload=E2X5XYT3IFXC tag=9SHPG1RBEGOI type=write size=1187589 2024-09-14T10:54:22.350 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.352+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~3N2VUNLLJ4IU.0 size=1048576 2024-09-14T10:54:22.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.353+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~3N2VUNLLJ4IU.1 size=304117 2024-09-14T10:54:22.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.355+0000 7faa01046780 1 < completed multipart upload key=KDUTH9PIR3FI upload=3N2VUNLLJ4IU tag=7LXFD5B89GLT type=write size=2401269 2024-09-14T10:54:22.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.358+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~M69WI3W9ZMY7.0 size=32634 2024-09-14T10:54:22.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.358+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=M69WI3W9ZMY7 tag=29NZ8MTGDC0A type=write size=1081210 2024-09-14T10:54:22.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.358+0000 7faa01046780 1 < canceled part key=_multipart_HYAGNAOWK8LF.2~DJM64KR4I3TM.0 size=1048576 2024-09-14T10:54:22.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.359+0000 7faa01046780 1 < completed part key=_multipart_HYAGNAOWK8LF.2~DJM64KR4I3TM.1 size=341172 2024-09-14T10:54:22.360 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.362+0000 7faa01046780 1 < canceled multipart upload key=HYAGNAOWK8LF upload=DJM64KR4I3TM tag=8XBAOOQ2000J type=write size=2438324 2024-09-14T10:54:22.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.363+0000 7faa01046780 1 > prepared operation key=U8TE0XNK9YKM tag=66N0AMTMTDAO type=write size=790063 2024-09-14T10:54:22.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.364+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~70E30ANBPY0O.0 size=382633 2024-09-14T10:54:22.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.367+0000 7faa01046780 1 < completed multipart upload key=CKMDOO75UZGE upload=70E30ANBPY0O tag=A7W4Z2M7E2N0 type=write size=1431209 2024-09-14T10:54:22.366 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.368+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=P6UMZF8X0R0W type=del size=3901102 2024-09-14T10:54:22.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.369+0000 7faa01046780 1 < completed delete operation key=PS2QU1UZUYHE tag=94S7ZH0L4IFQ type=del 2024-09-14T10:54:22.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.372+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~T0N9TWBEZHPR.0 size=1048576 2024-09-14T10:54:22.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.373+0000 7faa01046780 1 > prepared part key=_multipart_0OL3SF5IWDMH.2~T0N9TWBEZHPR.1 size=753602 2024-09-14T10:54:22.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.373+0000 7faa01046780 1 > prepared multipart upload key=0OL3SF5IWDMH upload=T0N9TWBEZHPR tag=32D5PMVBSPMW type=write size=2850754 2024-09-14T10:54:22.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.374+0000 7faa01046780 1 < completed write operation key=GG02P21TFKIM tag=FC7C4681F7S3 type=write size=363073 2024-09-14T10:54:22.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.376+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=PN286QZR080G type=del size=2411811 2024-09-14T10:54:22.376 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.378+0000 7faa01046780 1 < completed delete operation key=LF41PL7DFSJI tag=D4RDSW16K8H4 type=del 2024-09-14T10:54:22.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.379+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=WH7H1WTWVXVP type=del size=3697491 2024-09-14T10:54:22.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.382+0000 7faa01046780 1 < suggested remove operation key=PBRZNGSOLJ8E tag=VFR4Y9JTQWD3 type=del 2024-09-14T10:54:22.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.384+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~MZCOG3N4FLU5.0 size=1048576 2024-09-14T10:54:22.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.385+0000 7faa01046780 1 > prepared part key=_multipart_TDNQZ8Y1C6X2.2~MZCOG3N4FLU5.1 size=95568 2024-09-14T10:54:22.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.385+0000 7faa01046780 1 > prepared multipart upload key=TDNQZ8Y1C6X2 upload=MZCOG3N4FLU5 tag=WUHHJSIOY0SI type=write size=2192720 2024-09-14T10:54:22.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.387+0000 7faa01046780 1 < suggested remove operation key=3FSH0OFMF54V tag=2HNO16UT0170 type=del 2024-09-14T10:54:22.387 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.389+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=1JJZODE9GM7V type=del size=997196 2024-09-14T10:54:22.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.391+0000 7faa01046780 1 < canceled operation key=X9DUVQBBLUTF tag=2ZKZRMZLI1O9 type=write size=779679 2024-09-14T10:54:22.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.393+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~GPNKS1QWT675.0 size=1048576 2024-09-14T10:54:22.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.394+0000 7faa01046780 1 > prepared part key=_multipart_CKMDOO75UZGE.2~GPNKS1QWT675.1 size=397872 2024-09-14T10:54:22.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.394+0000 7faa01046780 1 > prepared multipart upload key=CKMDOO75UZGE upload=GPNKS1QWT675 tag=JX7VC9WRJSTN type=write size=2495024 2024-09-14T10:54:22.394 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.397+0000 7faa01046780 1 < suggested remove operation key=NXIPG4HR9ZYY tag=02B793YV3KQX type=del 2024-09-14T10:54:22.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.399+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~QLM2IVUCM669.0 size=1048576 2024-09-14T10:54:22.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.400+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~QLM2IVUCM669.1 size=421828 2024-09-14T10:54:22.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.400+0000 7faa01046780 1 > prepared multipart upload key=3UEX0IPM4CPY upload=QLM2IVUCM669 tag=1UK6FELS604Z type=write size=2518980 2024-09-14T10:54:22.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.402+0000 7faa01046780 1 < canceled operation key=Q33ET1AN14NG tag=E1MM7NHCR2ML type=del size=725421 2024-09-14T10:54:22.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.404+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~I7VIH5C1C1D0.0 size=1048576 2024-09-14T10:54:22.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.405+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~I7VIH5C1C1D0.1 size=817747 2024-09-14T10:54:22.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.405+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=I7VIH5C1C1D0 tag=BOH9RX4WDK2P type=write size=2914899 2024-09-14T10:54:22.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.407+0000 7faa01046780 1 < completed delete operation key=PTDE6D7OIU1A tag=NV0B382PC0MM type=del 2024-09-14T10:54:22.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.408+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=A2HI74KICAK4 type=del size=2355660 2024-09-14T10:54:22.407 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.409+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~64KYJ8LW8DHG.0 size=1048576 2024-09-14T10:54:22.408 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.410+0000 7faa01046780 1 < completed part key=_multipart_U8TE0XNK9YKM.2~64KYJ8LW8DHG.1 size=1048576 2024-09-14T10:54:22.408 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.410+0000 7faa01046780 1 < canceled part key=_multipart_U8TE0XNK9YKM.2~64KYJ8LW8DHG.2 size=550352 2024-09-14T10:54:22.411 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.413+0000 7faa01046780 1 < canceled multipart upload key=U8TE0XNK9YKM upload=64KYJ8LW8DHG tag=R8IY3FY37CO3 type=write size=3696080 2024-09-14T10:54:22.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.415+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=T73E9B7423W6 type=del size=3539240 2024-09-14T10:54:22.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.416+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=8ETUGEZAIIIT type=del 2024-09-14T10:54:22.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.419+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~BIE3TIO1HA6V.0 size=232825 2024-09-14T10:54:22.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.419+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=BIE3TIO1HA6V tag=X520U72PX9SB type=write size=1281401 2024-09-14T10:54:22.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.420+0000 7faa01046780 -1 < failed to complete operation key=3FSH0OFMF54V tag=T5F3JMTBPP0A type=del size=17654: (22) Invalid argument 2024-09-14T10:54:22.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.422+0000 7faa01046780 1 > prepared operation key=NXIPG4HR9ZYY tag=F3CRTDA8LYQ5 type=write size=190447 2024-09-14T10:54:22.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.423+0000 7faa01046780 1 < completed part key=_multipart_GG02P21TFKIM.2~E2X5XYT3IFXC.0 size=139013 2024-09-14T10:54:22.423 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.425+0000 7faa01046780 1 < completed multipart upload key=GG02P21TFKIM upload=E2X5XYT3IFXC tag=9SHPG1RBEGOI type=write size=1187589 2024-09-14T10:54:22.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.427+0000 7faa01046780 1 > prepared operation key=PTDE6D7OIU1A tag=K92UBXAY29FZ type=del size=339611 2024-09-14T10:54:22.426 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.429+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~M69WI3W9ZMY7.0 size=32634 2024-09-14T10:54:22.429 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.431+0000 7faa01046780 1 < completed multipart upload key=S3BGVJ9N9S4P upload=M69WI3W9ZMY7 tag=29NZ8MTGDC0A type=write size=1081210 2024-09-14T10:54:22.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.434+0000 7faa01046780 1 > prepared part key=_multipart_KDUTH9PIR3FI.2~J3MNWN4ZKVX9.0 size=696900 2024-09-14T10:54:22.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.434+0000 7faa01046780 1 > prepared multipart upload key=KDUTH9PIR3FI upload=J3MNWN4ZKVX9 tag=SS86W2OCCBVN type=write size=1745476 2024-09-14T10:54:22.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.435+0000 7faa01046780 1 < completed write operation key=U8TE0XNK9YKM tag=66N0AMTMTDAO type=write size=790063 2024-09-14T10:54:22.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.436+0000 7faa01046780 1 > prepared operation key=TDNQZ8Y1C6X2 tag=9YG0Y26HB9YU type=del size=597799 2024-09-14T10:54:22.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.438+0000 7faa01046780 1 < completed delete operation key=Q33ET1AN14NG tag=P6UMZF8X0R0W type=del 2024-09-14T10:54:22.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.439+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=6IZQ0DVHDF2X type=del size=3301253 2024-09-14T10:54:22.438 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.440+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~T0N9TWBEZHPR.0 size=1048576 2024-09-14T10:54:22.440 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.442+0000 7faa01046780 1 < completed part key=_multipart_0OL3SF5IWDMH.2~T0N9TWBEZHPR.1 size=753602 2024-09-14T10:54:22.442 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.444+0000 7faa01046780 1 < completed multipart upload key=0OL3SF5IWDMH upload=T0N9TWBEZHPR tag=32D5PMVBSPMW type=write size=2850754 2024-09-14T10:54:22.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.446+0000 7faa01046780 1 > prepared operation key=0OL3SF5IWDMH tag=P07JLFLKK7TG type=del size=2925235 2024-09-14T10:54:22.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.447+0000 7faa01046780 1 < completed delete operation key=BBDTPL35W4W0 tag=PN286QZR080G type=del 2024-09-14T10:54:22.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.450+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~4MB5W0WI79ID.0 size=1048576 2024-09-14T10:54:22.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.451+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~4MB5W0WI79ID.1 size=780474 2024-09-14T10:54:22.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.451+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=4MB5W0WI79ID tag=HB00JP806U5V type=write size=2877626 2024-09-14T10:54:22.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.452+0000 7faa01046780 1 < completed delete operation key=HUBZAFMSCCNC tag=WH7H1WTWVXVP type=del 2024-09-14T10:54:22.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.454+0000 7faa01046780 1 > prepared operation key=F06QWEOYNQX4 tag=VZQZATMH019U type=del size=2731017 2024-09-14T10:54:22.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.454+0000 7faa01046780 1 < canceled part key=_multipart_TDNQZ8Y1C6X2.2~MZCOG3N4FLU5.0 size=1048576 2024-09-14T10:54:22.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.455+0000 7faa01046780 1 < completed part key=_multipart_TDNQZ8Y1C6X2.2~MZCOG3N4FLU5.1 size=95568 2024-09-14T10:54:22.455 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.458+0000 7faa01046780 1 < canceled multipart upload key=TDNQZ8Y1C6X2 upload=MZCOG3N4FLU5 tag=WUHHJSIOY0SI type=write size=2192720 2024-09-14T10:54:22.457 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.459+0000 7faa01046780 1 > prepared operation key=CKMDOO75UZGE tag=95U12RP8PUG9 type=del size=517321 2024-09-14T10:54:22.458 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.460+0000 7faa01046780 1 < completed delete operation key=GG02P21TFKIM tag=1JJZODE9GM7V type=del 2024-09-14T10:54:22.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.462+0000 7faa01046780 1 > prepared operation key=BBDTPL35W4W0 tag=JWADXHZDP94J type=del size=506820 2024-09-14T10:54:22.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.464+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~GPNKS1QWT675.0 size=1048576 2024-09-14T10:54:22.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.465+0000 7faa01046780 1 < completed part key=_multipart_CKMDOO75UZGE.2~GPNKS1QWT675.1 size=397872 2024-09-14T10:54:22.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.467+0000 7faa01046780 1 < completed multipart upload key=CKMDOO75UZGE upload=GPNKS1QWT675 tag=JX7VC9WRJSTN type=write size=2495024 2024-09-14T10:54:22.469 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.471+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~L84FB5WF3VQQ.0 size=580667 2024-09-14T10:54:22.469 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.471+0000 7faa01046780 1 > prepared multipart upload key=PS2QU1UZUYHE upload=L84FB5WF3VQQ tag=JLEJZNYBF8JX type=write size=1629243 2024-09-14T10:54:22.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.473+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~QLM2IVUCM669.0 size=1048576 2024-09-14T10:54:22.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.474+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~QLM2IVUCM669.1 size=421828 2024-09-14T10:54:22.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.477+0000 7faa01046780 1 < completed multipart upload key=3UEX0IPM4CPY upload=QLM2IVUCM669 tag=1UK6FELS604Z type=write size=2518980 2024-09-14T10:54:22.477 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.479+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=CQR82R2G3ANZ type=del size=3303553 2024-09-14T10:54:22.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.480+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~I7VIH5C1C1D0.0 size=1048576 2024-09-14T10:54:22.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.481+0000 7faa01046780 1 < completed part key=_multipart_V5T3AN9D7DH6.2~I7VIH5C1C1D0.1 size=817747 2024-09-14T10:54:22.482 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.484+0000 7faa01046780 1 < completed multipart upload key=V5T3AN9D7DH6 upload=I7VIH5C1C1D0 tag=BOH9RX4WDK2P type=write size=2914899 2024-09-14T10:54:22.483 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.486+0000 7faa01046780 1 > prepared operation key=ZY0BY3G9NREC tag=FYGFGHY4W054 type=del size=1458199 2024-09-14T10:54:22.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.487+0000 7faa01046780 1 < completed delete operation key=PS2QU1UZUYHE tag=A2HI74KICAK4 type=del 2024-09-14T10:54:22.487 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.489+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=HFUA39R3MTTR type=del size=2551307 2024-09-14T10:54:22.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.490+0000 7faa01046780 1 < completed delete operation key=BBDTPL35W4W0 tag=T73E9B7423W6 type=del 2024-09-14T10:54:22.490 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.493+0000 7faa01046780 1 > prepared part key=_multipart_XDJAK0XYQNF0.2~7IYYKR18Y6IL.0 size=519151 2024-09-14T10:54:22.491 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.493+0000 7faa01046780 1 > prepared multipart upload key=XDJAK0XYQNF0 upload=7IYYKR18Y6IL tag=TVIR34UACI4P type=write size=1567727 2024-09-14T10:54:22.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.494+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~BIE3TIO1HA6V.0 size=232825 2024-09-14T10:54:22.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.496+0000 7faa01046780 1 < completed multipart upload key=KDUTH9PIR3FI upload=BIE3TIO1HA6V tag=X520U72PX9SB type=write size=1281401 2024-09-14T10:54:22.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.499+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~JTDQ2LMAXC4Q.0 size=1048576 2024-09-14T10:54:22.498 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.500+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~JTDQ2LMAXC4Q.1 size=77726 2024-09-14T10:54:22.498 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.500+0000 7faa01046780 1 > prepared multipart upload key=PBRZNGSOLJ8E upload=JTDQ2LMAXC4Q tag=6TCQCDT5W5MZ type=write size=2174878 2024-09-14T10:54:22.499 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.501+0000 7faa01046780 1 < completed write operation key=NXIPG4HR9ZYY tag=F3CRTDA8LYQ5 type=write size=190447 2024-09-14T10:54:22.500 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.503+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=WY8VWMMS8COR type=del size=1828593 2024-09-14T10:54:22.502 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.504+0000 7faa01046780 1 < canceled operation key=PTDE6D7OIU1A tag=K92UBXAY29FZ type=del size=339611 2024-09-14T10:54:22.503 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.505+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=88TWLCXIADCL type=write size=282047 2024-09-14T10:54:22.504 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.507+0000 7faa01046780 1 < completed part key=_multipart_KDUTH9PIR3FI.2~J3MNWN4ZKVX9.0 size=696900 2024-09-14T10:54:22.506 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.509+0000 7faa01046780 1 < completed multipart upload key=KDUTH9PIR3FI upload=J3MNWN4ZKVX9 tag=SS86W2OCCBVN type=write size=1745476 2024-09-14T10:54:22.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.510+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=LHNKRV9DHRG1 type=del size=2127736 2024-09-14T10:54:22.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.511+0000 7faa01046780 1 < completed delete operation key=TDNQZ8Y1C6X2 tag=9YG0Y26HB9YU type=del 2024-09-14T10:54:22.512 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.514+0000 7faa01046780 1 > prepared part key=_multipart_S3BGVJ9N9S4P.2~ZEFCAFPQYYT2.0 size=622939 2024-09-14T10:54:22.512 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.514+0000 7faa01046780 1 > prepared multipart upload key=S3BGVJ9N9S4P upload=ZEFCAFPQYYT2 tag=Z6OF6WAELOV0 type=write size=1671515 2024-09-14T10:54:22.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.515+0000 7faa01046780 1 < completed delete operation key=Y4CB0HIN0750 tag=6IZQ0DVHDF2X type=del 2024-09-14T10:54:22.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.518+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~B7EIP2P2D0Q2.0 size=858063 2024-09-14T10:54:22.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.518+0000 7faa01046780 1 > prepared multipart upload key=3UEX0IPM4CPY upload=B7EIP2P2D0Q2 tag=4YVNPDMI1DYU type=write size=1906639 2024-09-14T10:54:22.518 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.521+0000 7faa01046780 1 < suggested update operation key=0OL3SF5IWDMH tag=P07JLFLKK7TG type=del size=2925235 2024-09-14T10:54:22.521 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.523+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~XRIAP8GH5EGQ.0 size=1048576 2024-09-14T10:54:22.522 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.524+0000 7faa01046780 1 > prepared part key=_multipart_BBDTPL35W4W0.2~XRIAP8GH5EGQ.1 size=945690 2024-09-14T10:54:22.522 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.524+0000 7faa01046780 1 > prepared multipart upload key=BBDTPL35W4W0 upload=XRIAP8GH5EGQ tag=JFTOYQR24PYY type=write size=3042842 2024-09-14T10:54:22.523 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.525+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~4MB5W0WI79ID.0 size=1048576 2024-09-14T10:54:22.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.526+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~4MB5W0WI79ID.1 size=780474 2024-09-14T10:54:22.526 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.529+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=4MB5W0WI79ID tag=HB00JP806U5V type=write size=2877626 2024-09-14T10:54:22.528 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.530+0000 7faa01046780 1 > prepared operation key=PBRZNGSOLJ8E tag=FJ09571B122M type=del size=724199 2024-09-14T10:54:22.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.533+0000 7faa01046780 1 < suggested remove operation key=F06QWEOYNQX4 tag=VZQZATMH019U type=del 2024-09-14T10:54:22.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.534+0000 7faa01046780 1 > prepared operation key=Q33ET1AN14NG tag=FMGI6DSF4CIK type=del size=1725231 2024-09-14T10:54:22.534 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.536+0000 7faa01046780 1 < completed delete operation key=CKMDOO75UZGE tag=95U12RP8PUG9 type=del 2024-09-14T10:54:22.535 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.537+0000 7faa01046780 1 > prepared operation key=FOJGGEQZD7YW tag=YB0MLEYGQNLS type=del size=1957275 2024-09-14T10:54:22.536 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.539+0000 7faa01046780 1 < completed delete operation key=BBDTPL35W4W0 tag=JWADXHZDP94J type=del 2024-09-14T10:54:22.539 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.541+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~38771E1HW54W.0 size=504251 2024-09-14T10:54:22.539 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.541+0000 7faa01046780 1 > prepared multipart upload key=PS2QU1UZUYHE upload=38771E1HW54W tag=JBPT52OPGJ6D type=write size=1552827 2024-09-14T10:54:22.540 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.542+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~L84FB5WF3VQQ.0 size=580667 2024-09-14T10:54:22.542 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.545+0000 7faa01046780 1 < completed multipart upload key=PS2QU1UZUYHE upload=L84FB5WF3VQQ tag=JLEJZNYBF8JX type=write size=1629243 2024-09-14T10:54:22.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.547+0000 7faa01046780 1 > prepared part key=_multipart_XH8GHY9YRGTP.2~2O9PCED1I4YT.0 size=305822 2024-09-14T10:54:22.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.547+0000 7faa01046780 1 > prepared multipart upload key=XH8GHY9YRGTP upload=2O9PCED1I4YT tag=UOTDL0GNQG0J type=write size=1354398 2024-09-14T10:54:22.547 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.549+0000 7faa01046780 1 < completed delete operation key=XH8GHY9YRGTP tag=CQR82R2G3ANZ type=del 2024-09-14T10:54:22.548 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.551+0000 7faa01046780 1 > prepared operation key=F872GLVQDCX6 tag=JLCF4CDRLRT4 type=del size=1079426 2024-09-14T10:54:22.550 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.552+0000 7faa01046780 1 < completed delete operation key=ZY0BY3G9NREC tag=FYGFGHY4W054 type=del 2024-09-14T10:54:22.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.555+0000 7faa01046780 1 > prepared part key=_multipart_PBRZNGSOLJ8E.2~4NWYYXW040X7.0 size=214912 2024-09-14T10:54:22.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.555+0000 7faa01046780 1 > prepared multipart upload key=PBRZNGSOLJ8E upload=4NWYYXW040X7 tag=237RLBX18L2S type=write size=1263488 2024-09-14T10:54:22.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.556+0000 7faa01046780 1 < canceled operation key=HYAGNAOWK8LF tag=HFUA39R3MTTR type=del size=2551307 2024-09-14T10:54:22.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.558+0000 7faa01046780 1 > prepared operation key=Y4CB0HIN0750 tag=YY695LKOASLR type=del size=549340 2024-09-14T10:54:22.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.559+0000 7faa01046780 1 < completed part key=_multipart_XDJAK0XYQNF0.2~7IYYKR18Y6IL.0 size=519151 2024-09-14T10:54:22.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.561+0000 7faa01046780 1 < completed multipart upload key=XDJAK0XYQNF0 upload=7IYYKR18Y6IL tag=TVIR34UACI4P type=write size=1567727 2024-09-14T10:54:22.561 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.563+0000 7faa01046780 1 > prepared operation key=V905BR1VWUCV tag=E3U96XIMSBZZ type=del size=1011665 2024-09-14T10:54:22.562 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.564+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~JTDQ2LMAXC4Q.0 size=1048576 2024-09-14T10:54:22.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.566+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~JTDQ2LMAXC4Q.1 size=77726 2024-09-14T10:54:22.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.568+0000 7faa01046780 1 < completed multipart upload key=PBRZNGSOLJ8E upload=JTDQ2LMAXC4Q tag=6TCQCDT5W5MZ type=write size=2174878 2024-09-14T10:54:22.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.569+0000 7faa01046780 1 > prepared operation key=XDJAK0XYQNF0 tag=AK9S4MV6K0SL type=del size=1307987 2024-09-14T10:54:22.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.571+0000 7faa01046780 1 < completed delete operation key=LF41PL7DFSJI tag=WY8VWMMS8COR type=del 2024-09-14T10:54:22.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.574+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~GJI0MS4IXJB6.0 size=1048576 2024-09-14T10:54:22.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.575+0000 7faa01046780 1 > prepared part key=_multipart_3UEX0IPM4CPY.2~GJI0MS4IXJB6.1 size=327815 2024-09-14T10:54:22.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.575+0000 7faa01046780 1 > prepared multipart upload key=3UEX0IPM4CPY upload=GJI0MS4IXJB6 tag=Y7NXFP8V0HSF type=write size=2424967 2024-09-14T10:54:22.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.578+0000 7faa01046780 1 < suggested update operation key=PS2QU1UZUYHE tag=88TWLCXIADCL type=write size=282047 2024-09-14T10:54:22.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.580+0000 7faa01046780 1 > prepared operation key=VIO703UXIJXV tag=33V7JJGNG9YJ type=del size=1674080 2024-09-14T10:54:22.581 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.583+0000 7faa01046780 1 < suggested update operation key=VIO703UXIJXV tag=LHNKRV9DHRG1 type=del size=2127736 2024-09-14T10:54:22.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.586+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~LTBZ5LMDNXQH.0 size=193896 2024-09-14T10:54:22.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.586+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=LTBZ5LMDNXQH tag=71B31998VY3Y type=write size=1242472 2024-09-14T10:54:22.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.587+0000 7faa01046780 1 < completed part key=_multipart_S3BGVJ9N9S4P.2~ZEFCAFPQYYT2.0 size=622939 2024-09-14T10:54:22.587 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.589+0000 7faa01046780 1 < completed multipart upload key=S3BGVJ9N9S4P upload=ZEFCAFPQYYT2 tag=Z6OF6WAELOV0 type=write size=1671515 2024-09-14T10:54:22.588 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.591+0000 7faa01046780 1 > prepared operation key=XH8GHY9YRGTP tag=1QKX3C38LRC2 type=write size=419203 2024-09-14T10:54:22.590 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.592+0000 7faa01046780 1 < completed part key=_multipart_3UEX0IPM4CPY.2~B7EIP2P2D0Q2.0 size=858063 2024-09-14T10:54:22.592 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.594+0000 7faa01046780 1 < completed multipart upload key=3UEX0IPM4CPY upload=B7EIP2P2D0Q2 tag=4YVNPDMI1DYU type=write size=1906639 2024-09-14T10:54:22.594 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.597+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~ZAFC6TQ5VF30.0 size=1048576 2024-09-14T10:54:22.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.598+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~ZAFC6TQ5VF30.1 size=1048576 2024-09-14T10:54:22.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.599+0000 7faa01046780 1 > prepared part key=_multipart_HYAGNAOWK8LF.2~ZAFC6TQ5VF30.2 size=871651 2024-09-14T10:54:22.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.599+0000 7faa01046780 1 > prepared multipart upload key=HYAGNAOWK8LF upload=ZAFC6TQ5VF30 tag=AC2B5TAJF9QS type=write size=4017379 2024-09-14T10:54:22.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.600+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~XRIAP8GH5EGQ.0 size=1048576 2024-09-14T10:54:22.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.601+0000 7faa01046780 1 < completed part key=_multipart_BBDTPL35W4W0.2~XRIAP8GH5EGQ.1 size=945690 2024-09-14T10:54:22.602 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.604+0000 7faa01046780 1 < completed multipart upload key=BBDTPL35W4W0 upload=XRIAP8GH5EGQ tag=JFTOYQR24PYY type=write size=3042842 2024-09-14T10:54:22.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.607+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~GY0HRJ94COWM.0 size=1048576 2024-09-14T10:54:22.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.608+0000 7faa01046780 1 > prepared part key=_multipart_V5T3AN9D7DH6.2~GY0HRJ94COWM.1 size=96610 2024-09-14T10:54:22.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.608+0000 7faa01046780 1 > prepared multipart upload key=V5T3AN9D7DH6 upload=GY0HRJ94COWM tag=PDBCPY5XNK9E type=write size=2193762 2024-09-14T10:54:22.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.610+0000 7faa01046780 1 < completed delete operation key=PBRZNGSOLJ8E tag=FJ09571B122M type=del 2024-09-14T10:54:22.609 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.611+0000 7faa01046780 1 > prepared operation key=GG02P21TFKIM tag=CZ9XHIK89PT9 type=del size=2636707 2024-09-14T10:54:22.610 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.613+0000 7faa01046780 1 < completed delete operation key=Q33ET1AN14NG tag=FMGI6DSF4CIK type=del 2024-09-14T10:54:22.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.614+0000 7faa01046780 1 > prepared operation key=HYAGNAOWK8LF tag=ZEO2M14B89LA type=del size=3920817 2024-09-14T10:54:22.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.616+0000 7faa01046780 1 < completed delete operation key=FOJGGEQZD7YW tag=YB0MLEYGQNLS type=del 2024-09-14T10:54:22.617 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.619+0000 7faa01046780 1 > prepared part key=_multipart_U8TE0XNK9YKM.2~YL32VBI60JKP.0 size=796646 2024-09-14T10:54:22.617 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.619+0000 7faa01046780 1 > prepared multipart upload key=U8TE0XNK9YKM upload=YL32VBI60JKP tag=HX20DA6W7O7X type=write size=1845222 2024-09-14T10:54:22.618 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.621+0000 7faa01046780 1 < completed part key=_multipart_PS2QU1UZUYHE.2~38771E1HW54W.0 size=504251 2024-09-14T10:54:22.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.623+0000 7faa01046780 1 < completed multipart upload key=PS2QU1UZUYHE upload=38771E1HW54W tag=JBPT52OPGJ6D type=write size=1552827 2024-09-14T10:54:22.623 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.626+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~7UMHFR29ODW7.0 size=1048576 2024-09-14T10:54:22.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.627+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~7UMHFR29ODW7.1 size=1048576 2024-09-14T10:54:22.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.628+0000 7faa01046780 1 > prepared part key=_multipart_PS2QU1UZUYHE.2~7UMHFR29ODW7.2 size=547128 2024-09-14T10:54:22.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.628+0000 7faa01046780 1 > prepared multipart upload key=PS2QU1UZUYHE upload=7UMHFR29ODW7 tag=DZNT9SSJZDZ0 type=write size=3692856 2024-09-14T10:54:22.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.629+0000 7faa01046780 1 < completed part key=_multipart_XH8GHY9YRGTP.2~2O9PCED1I4YT.0 size=305822 2024-09-14T10:54:22.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.632+0000 7faa01046780 1 < completed multipart upload key=XH8GHY9YRGTP upload=2O9PCED1I4YT tag=UOTDL0GNQG0J type=write size=1354398 2024-09-14T10:54:22.631 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.633+0000 7faa01046780 1 > prepared operation key=LF41PL7DFSJI tag=S06FCR6YRJDE type=del size=1771213 2024-09-14T10:54:22.633 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.635+0000 7faa01046780 1 < completed delete operation key=F872GLVQDCX6 tag=JLCF4CDRLRT4 type=del 2024-09-14T10:54:22.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.636+0000 7faa01046780 1 > prepared operation key=HUBZAFMSCCNC tag=3NRNH2O60PCP type=del size=3917046 2024-09-14T10:54:22.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.638+0000 7faa01046780 1 < completed part key=_multipart_PBRZNGSOLJ8E.2~4NWYYXW040X7.0 size=214912 2024-09-14T10:54:22.638 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.640+0000 7faa01046780 1 < completed multipart upload key=PBRZNGSOLJ8E upload=4NWYYXW040X7 tag=237RLBX18L2S type=write size=1263488 2024-09-14T10:54:22.640 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:54:22.642+0000 7faa01046780 1 > prepared operation key=PS2QU1UZUYHE tag=FJ4R6K31YUE2 type=del size=770510 2024-09-14T10:54:22.640 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] cls_rgw_stats.simulate (10620 ms) 2024-09-14T10:54:22.640 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 1 test from cls_rgw_stats (10620 ms total) 2024-09-14T10:54:22.640 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T10:54:22.640 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment tear-down 2024-09-14T10:54:22.768 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] 1 test from 1 test suite ran. (12601 ms total) 2024-09-14T10:54:22.768 INFO:tasks.workunit.client.0.smithi050.stdout:[ PASSED ] 1 test. 2024-09-14T10:54:22.772 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:54:22.772 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:54:22.857 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-14T10:54:22.858 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-14T10:54:22.858 DEBUG:teuthology.orchestra.run.smithi050:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-14T10:54:22.906 INFO:tasks.workunit.client.0.smithi050.stdout:Running main() from gmock_main.cc 2024-09-14T10:54:22.906 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-14T10:54:22.906 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment set-up. 2024-09-14T10:54:24.784 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 31 tests from CmpOmap 2024-09-14T10:54:24.785 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-14T10:54:24.797 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (14 ms) 2024-09-14T10:54:24.797 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-14T10:54:24.801 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (3 ms) 2024-09-14T10:54:24.801 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-14T10:54:24.804 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-14T10:54:24.804 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-14T10:54:24.807 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (3 ms) 2024-09-14T10:54:24.807 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-14T10:54:24.813 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_vals_str (7 ms) 2024-09-14T10:54:24.813 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-14T10:54:24.820 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_vals_u64 (7 ms) 2024-09-14T10:54:24.820 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-14T10:54:24.823 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (3 ms) 2024-09-14T10:54:24.823 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-14T10:54:24.826 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (2 ms) 2024-09-14T10:54:24.826 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-14T10:54:24.830 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (5 ms) 2024-09-14T10:54:24.830 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-14T10:54:24.834 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (3 ms) 2024-09-14T10:54:24.834 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-14T10:54:24.834 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-14T10:54:24.834 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-14T10:54:24.835 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-14T10:54:24.835 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-14T10:54:24.841 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (6 ms) 2024-09-14T10:54:24.841 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-14T10:54:24.848 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (7 ms) 2024-09-14T10:54:24.848 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-14T10:54:24.854 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (5 ms) 2024-09-14T10:54:24.854 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-14T10:54:24.860 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (7 ms) 2024-09-14T10:54:24.861 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-14T10:54:24.870 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_set_vals_str (9 ms) 2024-09-14T10:54:24.870 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-14T10:54:24.877 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (8 ms) 2024-09-14T10:54:24.877 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-14T10:54:24.880 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (3 ms) 2024-09-14T10:54:24.880 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-14T10:54:24.883 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (2 ms) 2024-09-14T10:54:24.883 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-14T10:54:24.883 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-09-14T10:54:24.884 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-14T10:54:24.884 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2024-09-14T10:54:24.884 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-14T10:54:24.891 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (6 ms) 2024-09-14T10:54:24.891 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-14T10:54:24.897 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (7 ms) 2024-09-14T10:54:24.897 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-14T10:54:24.904 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (7 ms) 2024-09-14T10:54:24.904 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-14T10:54:24.912 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (7 ms) 2024-09-14T10:54:24.912 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-14T10:54:24.914 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-09-14T10:54:24.914 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-14T10:54:24.917 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-09-14T10:54:24.917 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-14T10:54:24.918 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-14T10:54:24.918 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-14T10:54:24.918 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (1 ms) 2024-09-14T10:54:24.918 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-14T10:54:24.926 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (8 ms) 2024-09-14T10:54:24.926 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 31 tests from CmpOmap (143 ms total) 2024-09-14T10:54:24.926 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T10:54:24.927 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment tear-down 2024-09-14T10:54:25.793 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] 31 tests from 1 test suite ran. (2887 ms total) 2024-09-14T10:54:25.793 INFO:tasks.workunit.client.0.smithi050.stdout:[ PASSED ] 31 tests. 2024-09-14T10:54:25.797 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:54:25.797 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:54:25.841 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-14T10:54:25.842 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-14T10:54:25.842 DEBUG:teuthology.orchestra.run.smithi050:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-14T10:54:25.890 INFO:tasks.workunit.client.0.smithi050.stdout:Running main() from gmock_main.cc 2024-09-14T10:54:25.890 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T10:54:25.890 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment set-up. 2024-09-14T10:54:25.890 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-14T10:54:25.890 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-14T10:54:28.807 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2917 ms) 2024-09-14T10:54:28.807 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-14T10:54:31.836 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3029 ms) 2024-09-14T10:54:31.836 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-14T10:54:34.851 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestCls2PCQueue.Reserve (3015 ms) 2024-09-14T10:54:34.851 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-14T10:54:37.870 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3019 ms) 2024-09-14T10:54:37.870 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-14T10:54:40.880 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestCls2PCQueue.Commit (3011 ms) 2024-09-14T10:54:41.121 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-14T10:54:43.899 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestCls2PCQueue.Stats (3018 ms) 2024-09-14T10:54:43.899 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-14T10:54:47.921 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4023 ms) 2024-09-14T10:54:47.922 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-14T10:54:50.934 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestCls2PCQueue.Abort (3012 ms) 2024-09-14T10:54:50.935 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-14T10:54:53.945 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestCls2PCQueue.ReserveError (3011 ms) 2024-09-14T10:54:53.945 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-14T10:54:56.975 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestCls2PCQueue.CommitError (3030 ms) 2024-09-14T10:54:56.975 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-14T10:55:00.004 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestCls2PCQueue.AbortError (3030 ms) 2024-09-14T10:55:00.005 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-14T10:55:03.015 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3010 ms) 2024-09-14T10:55:03.016 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-14T10:55:06.044 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3029 ms) 2024-09-14T10:55:06.044 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-14T10:55:09.060 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3013 ms) 2024-09-14T10:55:09.060 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-14T10:55:12.073 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3016 ms) 2024-09-14T10:55:12.073 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-14T10:55:15.099 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3026 ms) 2024-09-14T10:55:15.100 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-14T10:55:18.123 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3024 ms) 2024-09-14T10:55:18.123 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-14T10:55:21.128 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestCls2PCQueue.Cleanup (3006 ms) 2024-09-14T10:55:21.128 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-14T10:55:32.426 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestCls2PCQueue.MultiProducer (11297 ms) 2024-09-14T10:55:32.426 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-14T10:55:35.446 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3020 ms) 2024-09-14T10:55:35.446 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-14T10:55:49.478 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (14032 ms) 2024-09-14T10:55:49.478 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-14T10:55:53.500 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4023 ms) 2024-09-14T10:55:53.501 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-14T10:55:58.519 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (5017 ms) 2024-09-14T10:55:58.520 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-14T10:56:03.554 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5036 ms) 2024-09-14T10:56:03.554 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 24 tests from TestCls2PCQueue (97664 ms total) 2024-09-14T10:56:03.554 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T10:56:03.554 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment tear-down 2024-09-14T10:56:03.554 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] 24 tests from 1 test suite ran. (97664 ms total) 2024-09-14T10:56:03.555 INFO:tasks.workunit.client.0.smithi050.stdout:[ PASSED ] 24 tests. 2024-09-14T10:56:03.557 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:56:03.557 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:56:03.598 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-14T10:56:03.600 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-14T10:56:03.600 DEBUG:teuthology.orchestra.run.smithi050:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-14T10:56:03.692 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:03.692 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:03.693 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T10:56:03.693 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment set-up. 2024-09-14T10:56:05.558 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 4 tests from ClsAccount 2024-09-14T10:56:05.558 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] ClsAccount.add 2024-09-14T10:56:05.582 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] ClsAccount.add (25 ms) 2024-09-14T10:56:05.582 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] ClsAccount.get 2024-09-14T10:56:05.587 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] ClsAccount.get (5 ms) 2024-09-14T10:56:05.588 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] ClsAccount.rm 2024-09-14T10:56:05.595 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] ClsAccount.rm (8 ms) 2024-09-14T10:56:05.595 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] ClsAccount.list 2024-09-14T10:56:05.609 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] ClsAccount.list (14 ms) 2024-09-14T10:56:05.609 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 4 tests from ClsAccount (52 ms total) 2024-09-14T10:56:05.610 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T10:56:05.610 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment tear-down 2024-09-14T10:56:06.560 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] 4 tests from 1 test suite ran. (2868 ms total) 2024-09-14T10:56:06.560 INFO:tasks.workunit.client.0.smithi050.stdout:[ PASSED ] 4 tests. 2024-09-14T10:56:06.564 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:56:06.564 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:56:06.611 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-14T10:56:06.612 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-14T10:56:06.612 DEBUG:teuthology.orchestra.run.smithi050:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-14T10:56:06.668 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:06.668 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:06.668 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-14T10:56:06.668 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment set-up. 2024-09-14T10:56:08.587 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 6 tests from rgw_gc_log 2024-09-14T10:56:08.587 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-14T10:56:08.602 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] rgw_gc_log.init_existing_queue (15 ms) 2024-09-14T10:56:08.602 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-14T10:56:08.605 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] rgw_gc_log.init_existing_omap (4 ms) 2024-09-14T10:56:08.605 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-14T10:56:09.375 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (769 ms) 2024-09-14T10:56:09.375 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-14T10:56:09.376 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (1 ms) 2024-09-14T10:56:09.376 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-14T10:56:09.378 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2024-09-14T10:56:09.379 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-14T10:56:09.381 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] rgw_gc_log.defer2_before_init (3 ms) 2024-09-14T10:56:09.381 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 6 tests from rgw_gc_log (795 ms total) 2024-09-14T10:56:09.381 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T10:56:09.381 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment tear-down 2024-09-14T10:56:09.590 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] 6 tests from 1 test suite ran. (2921 ms total) 2024-09-14T10:56:09.590 INFO:tasks.workunit.client.0.smithi050.stdout:[ PASSED ] 6 tests. 2024-09-14T10:56:09.594 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:56:09.594 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:56:09.639 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-14T10:56:09.641 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-14T10:56:09.641 DEBUG:teuthology.orchestra.run.smithi050:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-14T10:56:09.701 INFO:tasks.workunit.client.0.smithi050.stdout:Running main() from gmock_main.cc 2024-09-14T10:56:09.702 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T10:56:09.702 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment set-up. 2024-09-14T10:56:09.702 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 4 tests from TestRGWObj 2024-09-14T10:56:09.702 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestRGWObj.underscore 2024-09-14T10:56:09.702 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: _obj 2024-09-14T10:56:09.702 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: _obj 2024-09-14T10:56:09.702 INFO:tasks.workunit.client.0.smithi050.stdout:stripped: _obj ns= i= 2024-09-14T10:56:09.702 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: _obj 2024-09-14T10:56:09.702 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: _obj 2024-09-14T10:56:09.702 INFO:tasks.workunit.client.0.smithi050.stdout:stripped: _obj ns= i= 2024-09-14T10:56:09.702 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: _obj 2024-09-14T10:56:09.702 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: _obj 2024-09-14T10:56:09.703 INFO:tasks.workunit.client.0.smithi050.stdout:stripped: _obj ns= i= 2024-09-14T10:56:09.703 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.703 INFO:tasks.workunit.client.0.smithi050.stdout: "obj1": { 2024-09-14T10:56:09.703 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.703 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.703 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.703 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.703 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.703 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.703 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.703 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.703 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.703 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.703 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.704 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.704 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_obj", 2024-09-14T10:56:09.704 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.704 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.704 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.704 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.704 INFO:tasks.workunit.client.0.smithi050.stdout: "obj2": { 2024-09-14T10:56:09.704 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.704 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.704 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.704 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.704 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.704 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.704 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.705 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.705 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.705 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.705 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.705 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.705 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_obj", 2024-09-14T10:56:09.705 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.705 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.705 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.705 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.705 INFO:tasks.workunit.client.0.smithi050.stdout: "obj3": { 2024-09-14T10:56:09.705 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.705 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.705 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.706 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.706 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.706 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.706 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.706 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.706 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.706 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.706 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.706 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.706 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_obj", 2024-09-14T10:56:09.706 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.706 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.706 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.706 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.707 INFO:tasks.workunit.client.0.smithi050.stdout: "obj3-2": { 2024-09-14T10:56:09.707 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.707 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.707 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.707 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.707 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.707 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.707 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.707 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.707 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.707 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.707 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.707 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.707 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_obj", 2024-09-14T10:56:09.708 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.708 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.708 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.708 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.708 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.708 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: _obj 2024-09-14T10:56:09.708 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: _obj 2024-09-14T10:56:09.708 INFO:tasks.workunit.client.0.smithi050.stdout:stripped: _obj ns=ns i= 2024-09-14T10:56:09.708 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: _obj 2024-09-14T10:56:09.708 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: _obj 2024-09-14T10:56:09.708 INFO:tasks.workunit.client.0.smithi050.stdout:stripped: _obj ns=ns i= 2024-09-14T10:56:09.708 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: _obj 2024-09-14T10:56:09.708 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: _obj 2024-09-14T10:56:09.709 INFO:tasks.workunit.client.0.smithi050.stdout:stripped: _obj ns=ns i= 2024-09-14T10:56:09.709 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.709 INFO:tasks.workunit.client.0.smithi050.stdout: "obj1": { 2024-09-14T10:56:09.709 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.709 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.709 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.709 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.709 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.709 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.709 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.709 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.709 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.709 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.710 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.710 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.710 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_obj", 2024-09-14T10:56:09.710 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.710 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.710 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.710 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.710 INFO:tasks.workunit.client.0.smithi050.stdout: "obj2": { 2024-09-14T10:56:09.710 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.710 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.710 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.710 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.710 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.710 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.711 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.711 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.711 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.711 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.711 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.711 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.711 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_obj", 2024-09-14T10:56:09.711 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.711 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.711 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.711 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.711 INFO:tasks.workunit.client.0.smithi050.stdout: "obj3": { 2024-09-14T10:56:09.711 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.712 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.712 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.712 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.712 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.712 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.712 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.712 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.712 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.712 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.712 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.712 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.713 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_obj", 2024-09-14T10:56:09.713 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.713 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.713 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.713 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.713 INFO:tasks.workunit.client.0.smithi050.stdout: "obj3-2": { 2024-09-14T10:56:09.713 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.713 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.713 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.713 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.713 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.713 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.713 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.713 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.714 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.714 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.714 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.714 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.714 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_obj", 2024-09-14T10:56:09.714 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.714 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.714 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.714 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.715 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.715 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: _obj[v1] 2024-09-14T10:56:09.715 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: _obj[v1] 2024-09-14T10:56:09.715 INFO:tasks.workunit.client.0.smithi050.stdout:stripped: _obj ns= i=v1 2024-09-14T10:56:09.715 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: _obj[v1] 2024-09-14T10:56:09.715 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: _obj[v1] 2024-09-14T10:56:09.715 INFO:tasks.workunit.client.0.smithi050.stdout:stripped: _obj ns= i=v1 2024-09-14T10:56:09.715 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: _obj[v1] 2024-09-14T10:56:09.715 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: _obj[v1] 2024-09-14T10:56:09.715 INFO:tasks.workunit.client.0.smithi050.stdout:stripped: _obj ns= i=v1 2024-09-14T10:56:09.715 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.716 INFO:tasks.workunit.client.0.smithi050.stdout: "obj1": { 2024-09-14T10:56:09.716 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.716 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.716 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.716 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.716 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.716 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.716 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.716 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.716 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.716 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.716 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.716 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.717 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_obj", 2024-09-14T10:56:09.717 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "v1", 2024-09-14T10:56:09.717 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.717 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.717 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.717 INFO:tasks.workunit.client.0.smithi050.stdout: "obj2": { 2024-09-14T10:56:09.717 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.717 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.717 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.717 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.718 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.718 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.718 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.718 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.718 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.718 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.718 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.718 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.718 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_obj", 2024-09-14T10:56:09.718 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "v1", 2024-09-14T10:56:09.718 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.718 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.718 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.718 INFO:tasks.workunit.client.0.smithi050.stdout: "obj3": { 2024-09-14T10:56:09.719 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.719 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.719 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.719 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.719 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.719 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.719 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.719 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.719 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.719 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.720 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.720 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.720 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_obj", 2024-09-14T10:56:09.720 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.720 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.720 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.720 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.720 INFO:tasks.workunit.client.0.smithi050.stdout: "obj3-2": { 2024-09-14T10:56:09.720 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.720 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.721 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.721 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.721 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.721 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.721 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.721 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.721 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.721 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.721 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.721 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.721 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_obj", 2024-09-14T10:56:09.721 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "v1", 2024-09-14T10:56:09.722 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.722 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.722 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.722 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.722 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: _obj[v1] 2024-09-14T10:56:09.722 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: _obj[v1] 2024-09-14T10:56:09.722 INFO:tasks.workunit.client.0.smithi050.stdout:stripped: _obj ns=ns i=v1 2024-09-14T10:56:09.722 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: _obj[v1] 2024-09-14T10:56:09.722 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: _obj[v1] 2024-09-14T10:56:09.723 INFO:tasks.workunit.client.0.smithi050.stdout:stripped: _obj ns=ns i=v1 2024-09-14T10:56:09.723 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: _obj[v1] 2024-09-14T10:56:09.723 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: _obj[v1] 2024-09-14T10:56:09.723 INFO:tasks.workunit.client.0.smithi050.stdout:stripped: _obj ns=ns i=v1 2024-09-14T10:56:09.723 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.723 INFO:tasks.workunit.client.0.smithi050.stdout: "obj1": { 2024-09-14T10:56:09.723 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.723 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.723 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.723 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.723 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.724 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.724 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.724 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.724 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.724 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.724 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.724 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.724 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_obj", 2024-09-14T10:56:09.724 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "v1", 2024-09-14T10:56:09.724 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.724 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.724 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.724 INFO:tasks.workunit.client.0.smithi050.stdout: "obj2": { 2024-09-14T10:56:09.724 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.725 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.725 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.725 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.725 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.725 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.725 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.725 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.725 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.725 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.725 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.725 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.725 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_obj", 2024-09-14T10:56:09.725 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "v1", 2024-09-14T10:56:09.725 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.725 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.726 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.726 INFO:tasks.workunit.client.0.smithi050.stdout: "obj3": { 2024-09-14T10:56:09.726 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.726 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.726 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.726 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.726 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.726 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.726 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.726 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.726 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.726 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.726 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.727 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.727 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_obj", 2024-09-14T10:56:09.727 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.727 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.727 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.727 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.727 INFO:tasks.workunit.client.0.smithi050.stdout: "obj3-2": { 2024-09-14T10:56:09.727 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.727 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.727 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.727 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.727 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.727 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.727 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.728 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.728 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.728 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.728 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.728 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.728 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_obj", 2024-09-14T10:56:09.728 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "v1", 2024-09-14T10:56:09.728 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.728 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.728 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.728 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.728 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-14T10:56:09.729 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-14T10:56:09.729 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: obj 2024-09-14T10:56:09.729 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: obj 2024-09-14T10:56:09.729 INFO:tasks.workunit.client.0.smithi050.stdout:stripped: obj ns= i= 2024-09-14T10:56:09.729 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: obj 2024-09-14T10:56:09.729 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: obj 2024-09-14T10:56:09.729 INFO:tasks.workunit.client.0.smithi050.stdout:stripped: obj ns= i= 2024-09-14T10:56:09.729 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: obj 2024-09-14T10:56:09.729 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: obj 2024-09-14T10:56:09.729 INFO:tasks.workunit.client.0.smithi050.stdout:stripped: obj ns= i= 2024-09-14T10:56:09.729 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.729 INFO:tasks.workunit.client.0.smithi050.stdout: "obj1": { 2024-09-14T10:56:09.729 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.729 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.729 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.730 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.730 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.730 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.730 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.730 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.730 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.730 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.730 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.730 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.730 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "obj", 2024-09-14T10:56:09.730 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.730 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.730 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.731 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.731 INFO:tasks.workunit.client.0.smithi050.stdout: "obj2": { 2024-09-14T10:56:09.731 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.731 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.731 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.731 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.731 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.731 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.731 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.731 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.731 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.731 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.731 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.731 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.732 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "obj", 2024-09-14T10:56:09.732 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.732 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.732 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.732 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.732 INFO:tasks.workunit.client.0.smithi050.stdout: "obj3": { 2024-09-14T10:56:09.732 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.732 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.732 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.732 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.732 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.732 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.732 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.733 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.733 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.733 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.733 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.733 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.733 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "obj", 2024-09-14T10:56:09.733 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.733 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.733 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.733 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.733 INFO:tasks.workunit.client.0.smithi050.stdout: "obj3-2": { 2024-09-14T10:56:09.733 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.733 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.733 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.733 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.734 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.734 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.734 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.734 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.734 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.734 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.734 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.734 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.734 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "obj", 2024-09-14T10:56:09.734 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.734 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.734 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.734 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.734 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.734 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: obj 2024-09-14T10:56:09.735 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: obj 2024-09-14T10:56:09.735 INFO:tasks.workunit.client.0.smithi050.stdout:stripped: obj ns=ns i= 2024-09-14T10:56:09.735 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: obj 2024-09-14T10:56:09.735 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: obj 2024-09-14T10:56:09.735 INFO:tasks.workunit.client.0.smithi050.stdout:stripped: obj ns=ns i= 2024-09-14T10:56:09.735 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: obj 2024-09-14T10:56:09.735 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: obj 2024-09-14T10:56:09.735 INFO:tasks.workunit.client.0.smithi050.stdout:stripped: obj ns=ns i= 2024-09-14T10:56:09.735 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.735 INFO:tasks.workunit.client.0.smithi050.stdout: "obj1": { 2024-09-14T10:56:09.735 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.735 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.735 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.735 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.735 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.736 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.736 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.736 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.736 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.736 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.736 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.736 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.736 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "obj", 2024-09-14T10:56:09.736 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.736 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.736 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.736 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.736 INFO:tasks.workunit.client.0.smithi050.stdout: "obj2": { 2024-09-14T10:56:09.737 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.737 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.737 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.737 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.737 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.737 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.737 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.737 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.737 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.737 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.737 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.737 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.737 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "obj", 2024-09-14T10:56:09.737 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.737 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.738 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.738 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.738 INFO:tasks.workunit.client.0.smithi050.stdout: "obj3": { 2024-09-14T10:56:09.738 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.738 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.738 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.738 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.738 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.738 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.738 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.738 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.738 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.738 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.738 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.739 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.739 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "obj", 2024-09-14T10:56:09.739 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.739 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.739 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.739 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.739 INFO:tasks.workunit.client.0.smithi050.stdout: "obj3-2": { 2024-09-14T10:56:09.739 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.739 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.739 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.739 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.739 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.739 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.740 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.740 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.740 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.740 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.740 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.740 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.740 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "obj", 2024-09-14T10:56:09.740 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.740 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.740 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.740 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.740 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.740 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: obj[v1] 2024-09-14T10:56:09.740 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: obj[v1] 2024-09-14T10:56:09.741 INFO:tasks.workunit.client.0.smithi050.stdout:stripped: obj ns= i=v1 2024-09-14T10:56:09.741 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: obj[v1] 2024-09-14T10:56:09.741 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: obj[v1] 2024-09-14T10:56:09.741 INFO:tasks.workunit.client.0.smithi050.stdout:stripped: obj ns= i=v1 2024-09-14T10:56:09.741 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: obj[v1] 2024-09-14T10:56:09.741 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: obj[v1] 2024-09-14T10:56:09.741 INFO:tasks.workunit.client.0.smithi050.stdout:stripped: obj ns= i=v1 2024-09-14T10:56:09.741 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.741 INFO:tasks.workunit.client.0.smithi050.stdout: "obj1": { 2024-09-14T10:56:09.741 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.741 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.741 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.741 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.741 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.742 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.742 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.742 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.742 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.742 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.742 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.742 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.742 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "obj", 2024-09-14T10:56:09.742 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "v1", 2024-09-14T10:56:09.742 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.742 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.742 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.742 INFO:tasks.workunit.client.0.smithi050.stdout: "obj2": { 2024-09-14T10:56:09.742 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.743 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.743 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.743 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.743 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.743 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.743 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.743 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.743 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.744 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.744 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.744 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.744 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "obj", 2024-09-14T10:56:09.744 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "v1", 2024-09-14T10:56:09.744 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.744 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.744 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.744 INFO:tasks.workunit.client.0.smithi050.stdout: "obj3": { 2024-09-14T10:56:09.744 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.744 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.744 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.745 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.745 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.745 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.745 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.745 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.745 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.745 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.745 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.745 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.745 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "obj", 2024-09-14T10:56:09.745 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.745 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.745 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.746 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.746 INFO:tasks.workunit.client.0.smithi050.stdout: "obj3-2": { 2024-09-14T10:56:09.746 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.746 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.746 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.746 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.746 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.746 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.746 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.746 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.746 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.746 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.746 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.746 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.746 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "obj", 2024-09-14T10:56:09.747 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "v1", 2024-09-14T10:56:09.747 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.747 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.747 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.747 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.747 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: obj[v1] 2024-09-14T10:56:09.747 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: obj[v1] 2024-09-14T10:56:09.747 INFO:tasks.workunit.client.0.smithi050.stdout:stripped: obj ns=ns i=v1 2024-09-14T10:56:09.747 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: obj[v1] 2024-09-14T10:56:09.747 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: obj[v1] 2024-09-14T10:56:09.747 INFO:tasks.workunit.client.0.smithi050.stdout:stripped: obj ns=ns i=v1 2024-09-14T10:56:09.747 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: obj[v1] 2024-09-14T10:56:09.747 INFO:tasks.workunit.client.0.smithi050.stdout:parsed: obj[v1] 2024-09-14T10:56:09.747 INFO:tasks.workunit.client.0.smithi050.stdout:stripped: obj ns=ns i=v1 2024-09-14T10:56:09.748 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.748 INFO:tasks.workunit.client.0.smithi050.stdout: "obj1": { 2024-09-14T10:56:09.748 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.748 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.748 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.748 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.748 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.748 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.748 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.748 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.748 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.748 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.748 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.748 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.749 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "obj", 2024-09-14T10:56:09.749 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "v1", 2024-09-14T10:56:09.749 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.749 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.749 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.749 INFO:tasks.workunit.client.0.smithi050.stdout: "obj2": { 2024-09-14T10:56:09.749 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.749 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.749 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.749 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.749 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.749 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.749 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.749 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.750 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.750 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.750 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.750 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.750 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "obj", 2024-09-14T10:56:09.750 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "v1", 2024-09-14T10:56:09.750 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.750 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.750 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.750 INFO:tasks.workunit.client.0.smithi050.stdout: "obj3": { 2024-09-14T10:56:09.750 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.750 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.750 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.750 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.751 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.751 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.751 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.751 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.751 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.751 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.751 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.751 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.751 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "obj", 2024-09-14T10:56:09.751 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.751 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.751 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.751 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.751 INFO:tasks.workunit.client.0.smithi050.stdout: "obj3-2": { 2024-09-14T10:56:09.752 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.752 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.752 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.752 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.752 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.752 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.752 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.752 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.752 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.752 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.752 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.752 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.752 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "obj", 2024-09-14T10:56:09.753 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "v1", 2024-09-14T10:56:09.753 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.753 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.753 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.753 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.753 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-14T10:56:09.753 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-14T10:56:09.753 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.753 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.753 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.753 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.753 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.753 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.753 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.754 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.754 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.754 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.754 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.754 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.754 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.754 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.754 INFO:tasks.workunit.client.0.smithi050.stdout: "obj": { 2024-09-14T10:56:09.754 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.754 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.754 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.754 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.754 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.754 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.755 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.755 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.755 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.755 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.755 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.755 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.755 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "myobj", 2024-09-14T10:56:09.755 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.755 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.755 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.755 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.755 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.755 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.755 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.755 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": "default-placement.data", 2024-09-14T10:56:09.756 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker_myobj", 2024-09-14T10:56:09.756 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.756 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.756 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.756 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.756 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.756 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.756 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.756 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.756 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.756 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.756 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.756 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.757 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.757 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.757 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.757 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.757 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.757 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "myobj", 2024-09-14T10:56:09.757 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.757 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.757 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.757 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.757 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.758 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.758 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.758 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.758 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.758 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.758 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.758 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.758 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.759 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.759 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.759 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.759 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.759 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.759 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.759 INFO:tasks.workunit.client.0.smithi050.stdout: "obj": { 2024-09-14T10:56:09.759 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.759 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.759 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.759 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.759 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.759 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.760 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.760 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.760 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.760 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.760 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.760 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.760 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "myobj", 2024-09-14T10:56:09.760 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.760 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.760 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.760 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.760 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.761 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.761 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.761 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.761 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker_myobj", 2024-09-14T10:56:09.761 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.761 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.761 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.761 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.761 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.761 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.761 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.761 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.762 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.762 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.762 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.762 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.762 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.762 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.762 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.762 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.762 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.762 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "myobj", 2024-09-14T10:56:09.762 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.762 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.762 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.762 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.763 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.763 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.763 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.763 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.763 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.763 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.763 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.763 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.763 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.764 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.764 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.764 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.764 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.764 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.764 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.764 INFO:tasks.workunit.client.0.smithi050.stdout: "obj": { 2024-09-14T10:56:09.764 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.764 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.764 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.764 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.764 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.764 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.765 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.765 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.765 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.765 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.765 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.765 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.765 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "myobj", 2024-09-14T10:56:09.765 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.765 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.765 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.765 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.765 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.766 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.766 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.766 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": "default-placement.data", 2024-09-14T10:56:09.766 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__ns_myobj", 2024-09-14T10:56:09.766 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.766 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.766 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.766 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.766 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.766 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.766 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.766 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.767 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.767 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.767 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.767 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.767 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.767 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.767 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.767 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.768 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.768 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "myobj", 2024-09-14T10:56:09.768 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.768 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.768 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.768 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.768 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.769 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.769 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.769 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.769 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.769 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.769 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.770 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.770 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.770 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.770 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.770 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.770 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.770 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.770 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.770 INFO:tasks.workunit.client.0.smithi050.stdout: "obj": { 2024-09-14T10:56:09.771 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.771 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.771 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.771 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.771 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.771 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.771 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.771 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.771 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.772 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.772 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.772 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.772 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "myobj", 2024-09-14T10:56:09.772 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.772 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.772 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.772 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.773 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.773 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.773 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.773 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.773 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__ns_myobj", 2024-09-14T10:56:09.773 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.773 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.773 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.773 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.774 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.774 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.774 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.774 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.774 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.774 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.774 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.774 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.774 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.775 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.775 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.775 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.775 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.775 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "myobj", 2024-09-14T10:56:09.775 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.775 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.775 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.776 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.776 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.776 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.776 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.776 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.776 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.776 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.776 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.777 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.777 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.777 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.777 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.777 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.777 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.777 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.777 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.777 INFO:tasks.workunit.client.0.smithi050.stdout: "obj": { 2024-09-14T10:56:09.778 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.778 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.778 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.778 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.778 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.778 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.778 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.778 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.779 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.779 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.779 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.779 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.779 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "myobj", 2024-09-14T10:56:09.779 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.779 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.779 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.780 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.780 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.780 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.780 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.780 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": "default-placement.data", 2024-09-14T10:56:09.780 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__:inst_myobj", 2024-09-14T10:56:09.780 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.781 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.781 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.781 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.781 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.781 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.781 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.781 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.781 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.781 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.782 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.782 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.782 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.782 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.782 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.782 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.782 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.783 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "myobj", 2024-09-14T10:56:09.783 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.783 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.783 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.783 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.783 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.783 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.783 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.784 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.784 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.784 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.784 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.784 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.784 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.784 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.784 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.785 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.785 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.785 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.785 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.785 INFO:tasks.workunit.client.0.smithi050.stdout: "obj": { 2024-09-14T10:56:09.785 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.785 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.785 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.785 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.786 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.786 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.786 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.786 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.786 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.786 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.786 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.786 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.786 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "myobj", 2024-09-14T10:56:09.787 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.787 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.787 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.787 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.787 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.787 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.787 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.787 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.787 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__:inst_myobj", 2024-09-14T10:56:09.787 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.787 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.787 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.787 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.787 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.787 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.788 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.788 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.788 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.788 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.788 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.788 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.788 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.788 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.788 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.788 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.788 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.788 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "myobj", 2024-09-14T10:56:09.788 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.789 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.789 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.789 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.789 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.789 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.789 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.789 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.789 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.789 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.789 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.789 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.789 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.789 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.789 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.790 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.790 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.790 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.790 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.790 INFO:tasks.workunit.client.0.smithi050.stdout: "obj": { 2024-09-14T10:56:09.790 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.790 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.790 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.790 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.790 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.790 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.790 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.790 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.790 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.791 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.791 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.791 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.791 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "myobj", 2024-09-14T10:56:09.791 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.791 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.791 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.791 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.791 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.791 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.791 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.791 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": "default-placement.data", 2024-09-14T10:56:09.791 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T10:56:09.791 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.792 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.792 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.792 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.792 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.792 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.792 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.792 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.792 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.792 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.792 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.792 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.792 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.792 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.793 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.793 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.793 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.793 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "myobj", 2024-09-14T10:56:09.793 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.793 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.793 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.793 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.793 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.793 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.793 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.793 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.794 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.794 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.794 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.794 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.794 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.794 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.794 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.794 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.794 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.794 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.794 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.794 INFO:tasks.workunit.client.0.smithi050.stdout: "obj": { 2024-09-14T10:56:09.794 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.795 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.795 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.795 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.795 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.795 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.795 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.795 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.795 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.795 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.795 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.795 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.795 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "myobj", 2024-09-14T10:56:09.795 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.796 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.796 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.796 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.796 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.796 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.796 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.796 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.796 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T10:56:09.796 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.796 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.796 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.797 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.797 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.797 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.797 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.797 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.797 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.797 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.797 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.797 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.797 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.797 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.797 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.797 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.798 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.798 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "myobj", 2024-09-14T10:56:09.798 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.798 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.798 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.798 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.798 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.798 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.798 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.798 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.798 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.798 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.798 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.798 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.799 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.799 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.799 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.799 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.799 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.799 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.799 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.799 INFO:tasks.workunit.client.0.smithi050.stdout: "obj": { 2024-09-14T10:56:09.799 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.799 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.799 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.799 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.799 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.799 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.799 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.800 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.800 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.800 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.800 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.800 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.800 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj", 2024-09-14T10:56:09.800 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.800 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.800 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.800 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.801 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.801 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.801 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.801 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": "default-placement.data", 2024-09-14T10:56:09.801 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker___myobj", 2024-09-14T10:56:09.801 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "marker__myobj" 2024-09-14T10:56:09.801 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.801 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.802 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.802 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.802 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.802 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.802 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.802 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.802 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.802 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.802 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.802 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.802 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.802 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.802 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.803 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.803 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj", 2024-09-14T10:56:09.803 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.803 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.803 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.803 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.803 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.803 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.803 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.803 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.803 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.804 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.804 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.804 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.804 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.804 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.804 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.804 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.804 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.804 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.804 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.804 INFO:tasks.workunit.client.0.smithi050.stdout: "obj": { 2024-09-14T10:56:09.804 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.804 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.804 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.805 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.805 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.805 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.805 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.805 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.805 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.805 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.806 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.806 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.806 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj", 2024-09-14T10:56:09.806 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.806 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.806 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.806 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.806 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.806 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.806 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.806 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.806 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker___myobj", 2024-09-14T10:56:09.806 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "marker__myobj" 2024-09-14T10:56:09.807 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.807 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.807 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.807 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.807 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.807 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.807 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.807 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.807 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.807 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.807 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.807 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.807 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.807 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.808 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.808 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.808 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj", 2024-09-14T10:56:09.808 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.808 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.808 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.808 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.808 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.808 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.808 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.808 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.808 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.809 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.809 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.809 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.809 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.809 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.809 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.809 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.809 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.809 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.809 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.809 INFO:tasks.workunit.client.0.smithi050.stdout: "obj": { 2024-09-14T10:56:09.809 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.809 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.810 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.810 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.810 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.810 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.810 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.810 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.810 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.810 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.810 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.810 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.810 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj", 2024-09-14T10:56:09.810 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.810 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.810 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.811 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.811 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.811 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.811 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.811 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": "default-placement.data", 2024-09-14T10:56:09.811 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__ns__myobj", 2024-09-14T10:56:09.811 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.811 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.811 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.811 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.811 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.811 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.811 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.811 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.811 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.812 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.812 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.812 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.812 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.812 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.812 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.812 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.812 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.812 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj", 2024-09-14T10:56:09.812 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.812 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.812 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.812 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.813 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.813 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.813 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.813 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.813 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.813 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.813 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.813 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.813 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.813 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.813 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.813 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.813 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.813 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.813 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.814 INFO:tasks.workunit.client.0.smithi050.stdout: "obj": { 2024-09-14T10:56:09.814 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.814 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.814 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.814 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.814 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.814 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.814 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.814 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.814 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.814 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.814 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.814 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.814 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj", 2024-09-14T10:56:09.815 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.815 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.815 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.815 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.815 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.815 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.815 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.815 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.815 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__ns__myobj", 2024-09-14T10:56:09.815 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.815 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.815 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.815 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.816 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.816 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.816 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.816 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.816 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.816 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.816 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.816 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.816 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.816 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.816 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.816 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.816 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.816 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj", 2024-09-14T10:56:09.817 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.817 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.817 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.817 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.817 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.817 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.817 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.817 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.817 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.817 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.817 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.817 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.817 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.818 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.818 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.818 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.818 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.818 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.818 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.818 INFO:tasks.workunit.client.0.smithi050.stdout: "obj": { 2024-09-14T10:56:09.818 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.818 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.819 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.819 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.819 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.819 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.819 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.819 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.819 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.819 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.819 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.819 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.819 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj", 2024-09-14T10:56:09.820 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.820 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.820 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.820 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.820 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.820 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.820 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.820 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": "default-placement.data", 2024-09-14T10:56:09.820 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__:inst__myobj", 2024-09-14T10:56:09.820 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "marker__myobj" 2024-09-14T10:56:09.820 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.820 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.820 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.820 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.821 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.821 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.821 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.821 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.821 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.821 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.821 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.821 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.821 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.821 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.821 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.821 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.821 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj", 2024-09-14T10:56:09.821 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.822 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.822 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.822 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.822 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.822 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.822 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.822 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.822 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.822 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.822 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.822 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.822 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.822 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.822 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.823 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.823 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.823 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.823 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.823 INFO:tasks.workunit.client.0.smithi050.stdout: "obj": { 2024-09-14T10:56:09.823 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.823 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.823 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.823 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.824 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.824 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.824 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.824 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.824 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.824 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.824 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.824 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.824 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj", 2024-09-14T10:56:09.824 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.824 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.824 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.824 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.825 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.825 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.825 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.825 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.825 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__:inst__myobj", 2024-09-14T10:56:09.825 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "marker__myobj" 2024-09-14T10:56:09.825 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.825 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.825 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.825 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.825 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.825 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.826 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.826 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.826 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.826 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.826 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.826 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.826 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.826 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.826 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.826 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.826 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj", 2024-09-14T10:56:09.826 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.826 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.826 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.827 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.827 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.827 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.827 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.827 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.827 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.827 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.827 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.827 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.827 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.827 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.827 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.827 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.827 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.828 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.828 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.828 INFO:tasks.workunit.client.0.smithi050.stdout: "obj": { 2024-09-14T10:56:09.828 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.828 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.828 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.828 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.828 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.828 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.828 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.828 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.828 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.829 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.829 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.829 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.829 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj", 2024-09-14T10:56:09.829 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.829 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.829 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.829 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.829 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.829 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.829 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.829 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": "default-placement.data", 2024-09-14T10:56:09.829 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T10:56:09.830 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.830 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.830 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.830 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.830 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.830 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.830 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.830 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.830 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.830 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.830 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.830 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.830 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.831 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.831 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.831 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.831 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.831 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj", 2024-09-14T10:56:09.831 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.831 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.831 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.831 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.831 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.831 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.832 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.832 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.832 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.832 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.832 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.832 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.832 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.832 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.832 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.832 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.832 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.832 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.832 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.833 INFO:tasks.workunit.client.0.smithi050.stdout: "obj": { 2024-09-14T10:56:09.833 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.833 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.833 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.833 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.833 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.833 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.833 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.833 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.833 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.833 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.833 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.833 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.833 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj", 2024-09-14T10:56:09.834 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.834 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.834 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.834 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.834 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.834 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.834 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.834 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.834 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T10:56:09.834 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.834 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.834 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.834 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.834 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.835 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.835 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.835 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.835 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.835 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.835 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.835 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.835 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.835 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.835 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.835 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.835 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.835 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj", 2024-09-14T10:56:09.835 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.836 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.836 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.836 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.836 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.836 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.836 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.836 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.836 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.836 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.836 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.836 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.836 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.836 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.836 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.837 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.837 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.837 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.837 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.837 INFO:tasks.workunit.client.0.smithi050.stdout: "obj": { 2024-09-14T10:56:09.837 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.837 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.837 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.837 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.837 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.837 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.837 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.838 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.838 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.838 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.838 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.838 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.838 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj_", 2024-09-14T10:56:09.838 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.838 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.838 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.838 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.838 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.838 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.838 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.838 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": "default-placement.data", 2024-09-14T10:56:09.839 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker___myobj_", 2024-09-14T10:56:09.839 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "marker__myobj_" 2024-09-14T10:56:09.839 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.839 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.839 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.839 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.839 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.839 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.839 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.839 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.840 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.840 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.840 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.840 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.840 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.840 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.840 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.840 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.840 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj_", 2024-09-14T10:56:09.840 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.840 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.840 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.840 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.841 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.841 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.841 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.841 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.841 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.841 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.841 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.841 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.841 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.841 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.841 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.841 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.841 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.841 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.841 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.842 INFO:tasks.workunit.client.0.smithi050.stdout: "obj": { 2024-09-14T10:56:09.842 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.842 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.842 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.842 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.842 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.842 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.842 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.842 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.842 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.842 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.842 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.842 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.842 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj_", 2024-09-14T10:56:09.843 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.843 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.843 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.843 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.843 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.843 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.843 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.844 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.844 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker___myobj_", 2024-09-14T10:56:09.844 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "marker__myobj_" 2024-09-14T10:56:09.844 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.844 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.844 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.845 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.845 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.845 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.845 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.845 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.845 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.845 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.845 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.845 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.845 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.845 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.845 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.845 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.846 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj_", 2024-09-14T10:56:09.846 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.846 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.846 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.846 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.846 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.846 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.846 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.846 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.846 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.846 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.846 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.846 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.846 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.847 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.847 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.847 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.847 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.847 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.847 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.847 INFO:tasks.workunit.client.0.smithi050.stdout: "obj": { 2024-09-14T10:56:09.847 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.847 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.847 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.847 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.847 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.847 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.847 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.848 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.848 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.848 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.848 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.848 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.848 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj_", 2024-09-14T10:56:09.848 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.848 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.848 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.848 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.848 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.848 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.848 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.849 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": "default-placement.data", 2024-09-14T10:56:09.849 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__ns__myobj_", 2024-09-14T10:56:09.849 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.849 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.849 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.849 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.849 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.849 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.849 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.849 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.849 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.850 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.850 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.850 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.850 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.850 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.850 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.850 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.850 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.850 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj_", 2024-09-14T10:56:09.850 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.850 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.850 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.850 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.851 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.851 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.851 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.851 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.851 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.851 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.851 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.851 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.851 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.851 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.851 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.851 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.851 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.852 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.852 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.852 INFO:tasks.workunit.client.0.smithi050.stdout: "obj": { 2024-09-14T10:56:09.852 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.852 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.852 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.852 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.852 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.852 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.852 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.852 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.852 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.852 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.853 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.853 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.853 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj_", 2024-09-14T10:56:09.853 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.853 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.853 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.853 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.853 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.853 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.853 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.853 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.853 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__ns__myobj_", 2024-09-14T10:56:09.853 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.854 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.854 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.854 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.854 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.854 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.854 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.854 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.854 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.854 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.854 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.854 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.854 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.854 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.855 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.855 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.855 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.855 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj_", 2024-09-14T10:56:09.855 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.855 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.855 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.855 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.855 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.855 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.855 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.856 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.856 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.856 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.856 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.856 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.856 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.856 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.856 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.856 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.856 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.856 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.856 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.857 INFO:tasks.workunit.client.0.smithi050.stdout: "obj": { 2024-09-14T10:56:09.857 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.857 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.857 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.857 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.857 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.857 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.857 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.857 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.857 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.858 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.858 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.858 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.858 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj_", 2024-09-14T10:56:09.858 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.858 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.859 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.859 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.859 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.859 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.859 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.860 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": "default-placement.data", 2024-09-14T10:56:09.860 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T10:56:09.860 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "marker__myobj_" 2024-09-14T10:56:09.860 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.860 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.860 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.860 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.860 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.860 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.860 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.860 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.860 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.861 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.861 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.861 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.861 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.861 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.861 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.861 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.861 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj_", 2024-09-14T10:56:09.861 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.861 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.861 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.861 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.861 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.862 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.862 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.862 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.862 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.862 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.862 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.862 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.862 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.862 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.862 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.862 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.862 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.862 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.862 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.862 INFO:tasks.workunit.client.0.smithi050.stdout: "obj": { 2024-09-14T10:56:09.863 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.863 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.863 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.863 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.863 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.863 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.863 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.863 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.863 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.863 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.863 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.863 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.863 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj_", 2024-09-14T10:56:09.864 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.864 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.864 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.864 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.864 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.864 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.864 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.864 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.864 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T10:56:09.864 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "marker__myobj_" 2024-09-14T10:56:09.864 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.864 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.864 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.864 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.865 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.865 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.865 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.865 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.865 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.865 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.865 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.865 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.865 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.865 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.865 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.865 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.865 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj_", 2024-09-14T10:56:09.866 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.866 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.866 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.866 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.866 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.866 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.866 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.866 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.867 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.867 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.867 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.867 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.867 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.867 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.867 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.867 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.867 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.867 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.867 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.867 INFO:tasks.workunit.client.0.smithi050.stdout: "obj": { 2024-09-14T10:56:09.868 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.868 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.868 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.868 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.868 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.868 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.868 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.868 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.868 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.868 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.868 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.868 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.868 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj_", 2024-09-14T10:56:09.869 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.869 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.869 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.869 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.869 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.869 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.869 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.869 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": "default-placement.data", 2024-09-14T10:56:09.869 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T10:56:09.869 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.869 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.869 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.869 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.869 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.870 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.870 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "test", 2024-09-14T10:56:09.870 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.870 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.870 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.870 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.870 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": "", 2024-09-14T10:56:09.870 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.870 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": "" 2024-09-14T10:56:09.870 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.870 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.870 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.871 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj_", 2024-09-14T10:56:09.871 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.871 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.871 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.871 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.871 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.871 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.871 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.871 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.871 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.871 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.871 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.871 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.872 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.872 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.872 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.872 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.872 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.872 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.872 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.872 INFO:tasks.workunit.client.0.smithi050.stdout: "obj": { 2024-09-14T10:56:09.872 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.872 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.872 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.872 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.873 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.873 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.873 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.873 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.873 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.873 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.873 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.873 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.873 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj_", 2024-09-14T10:56:09.873 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.873 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.873 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.873 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.874 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.874 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.874 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.874 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.874 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T10:56:09.874 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.874 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.874 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.874 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.874 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.874 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.874 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.874 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.874 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.875 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.875 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.875 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.875 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.875 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.875 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.875 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.875 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.875 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj_", 2024-09-14T10:56:09.875 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.875 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.875 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.875 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.876 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.876 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-09-14T10:56:09.876 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-14T10:56:09.876 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.876 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.876 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.876 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker_myobj", 2024-09-14T10:56:09.876 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.876 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.876 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.876 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.876 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.876 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.876 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.877 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.877 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.877 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.877 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.877 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.877 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.877 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.877 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.877 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.877 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.877 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "myobj", 2024-09-14T10:56:09.877 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.877 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.877 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.878 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.878 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.878 INFO:tasks.workunit.client.0.smithi050.stdout:raw=.data-pool:marker_myobj 2024-09-14T10:56:09.878 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.878 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj2": { 2024-09-14T10:56:09.878 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.878 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker_myobj", 2024-09-14T10:56:09.878 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.878 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.878 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.878 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.878 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj2": { 2024-09-14T10:56:09.878 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.878 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.879 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.879 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.879 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.879 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.879 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.879 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.879 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.879 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.879 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.879 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.879 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "myobj", 2024-09-14T10:56:09.879 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.879 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.879 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.880 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.880 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.880 INFO:tasks.workunit.client.0.smithi050.stdout:raw2=.data-pool:marker_myobj 2024-09-14T10:56:09.880 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.880 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.880 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.880 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__ns_myobj", 2024-09-14T10:56:09.880 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.881 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.881 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.881 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.881 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.881 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.881 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.881 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.881 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.881 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.881 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.881 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.881 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.881 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.882 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.882 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.882 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.882 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "myobj", 2024-09-14T10:56:09.882 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.882 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.882 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.882 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.882 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.882 INFO:tasks.workunit.client.0.smithi050.stdout:raw=.data-pool:marker__ns_myobj 2024-09-14T10:56:09.882 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.882 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj2": { 2024-09-14T10:56:09.882 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.882 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__ns_myobj", 2024-09-14T10:56:09.883 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.883 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.883 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.883 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.883 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj2": { 2024-09-14T10:56:09.883 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.883 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.883 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.883 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.883 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.883 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.884 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.884 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.884 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.884 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.884 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.884 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.884 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "myobj", 2024-09-14T10:56:09.884 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.884 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.885 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.885 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.885 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.885 INFO:tasks.workunit.client.0.smithi050.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-14T10:56:09.885 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.885 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.885 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.886 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__:inst_myobj", 2024-09-14T10:56:09.886 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.886 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.886 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.886 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.886 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.886 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.886 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.886 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.886 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.886 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.886 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.887 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.887 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.887 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.887 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.887 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.887 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.887 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "myobj", 2024-09-14T10:56:09.887 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.887 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.887 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.887 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.887 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.887 INFO:tasks.workunit.client.0.smithi050.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-14T10:56:09.888 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.888 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj2": { 2024-09-14T10:56:09.888 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.888 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__:inst_myobj", 2024-09-14T10:56:09.888 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.888 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.888 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.888 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.888 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj2": { 2024-09-14T10:56:09.888 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.888 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.888 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.888 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.889 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.889 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.889 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.889 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.889 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.889 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.889 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.889 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.889 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "myobj", 2024-09-14T10:56:09.889 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.889 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.889 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.890 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.890 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.890 INFO:tasks.workunit.client.0.smithi050.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-14T10:56:09.890 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.890 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.890 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.890 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T10:56:09.890 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.890 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.890 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.890 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.890 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.890 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.891 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.891 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.891 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.891 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.891 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.891 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.891 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.891 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.891 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.891 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.892 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.892 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "myobj", 2024-09-14T10:56:09.892 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.892 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.892 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.892 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.892 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.892 INFO:tasks.workunit.client.0.smithi050.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-14T10:56:09.892 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.892 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj2": { 2024-09-14T10:56:09.892 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.892 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T10:56:09.892 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.892 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.893 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.893 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.893 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj2": { 2024-09-14T10:56:09.893 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.893 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.893 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.893 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.893 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.893 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.893 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.894 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.894 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.894 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.894 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.894 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.894 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "myobj", 2024-09-14T10:56:09.894 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.895 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.895 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.895 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.895 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.895 INFO:tasks.workunit.client.0.smithi050.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-14T10:56:09.895 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.895 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.895 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.895 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker___myobj", 2024-09-14T10:56:09.895 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "marker__myobj" 2024-09-14T10:56:09.895 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.896 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.896 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.896 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.896 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.896 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.896 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.897 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.897 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.897 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.897 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.897 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.897 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.898 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.898 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.898 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.898 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj", 2024-09-14T10:56:09.898 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.899 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.899 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.899 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.899 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.899 INFO:tasks.workunit.client.0.smithi050.stdout:raw=.data-pool:marker___myobj 2024-09-14T10:56:09.899 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.899 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj2": { 2024-09-14T10:56:09.899 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.899 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker___myobj", 2024-09-14T10:56:09.899 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "marker__myobj" 2024-09-14T10:56:09.899 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.899 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.899 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.900 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj2": { 2024-09-14T10:56:09.900 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.900 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.900 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.900 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.900 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.901 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.901 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.901 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.901 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.901 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.902 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.902 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.902 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj", 2024-09-14T10:56:09.902 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.902 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.902 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.903 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.903 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.903 INFO:tasks.workunit.client.0.smithi050.stdout:raw2=.data-pool:marker___myobj 2024-09-14T10:56:09.903 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.903 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.903 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.903 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__ns__myobj", 2024-09-14T10:56:09.903 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.903 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.903 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.904 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.904 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.904 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.904 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.904 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.905 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.905 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.905 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.905 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.905 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.906 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.906 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.906 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.906 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.906 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj", 2024-09-14T10:56:09.906 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.907 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.907 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.907 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.907 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.907 INFO:tasks.workunit.client.0.smithi050.stdout:raw=.data-pool:marker__ns__myobj 2024-09-14T10:56:09.907 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.907 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj2": { 2024-09-14T10:56:09.907 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.908 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__ns__myobj", 2024-09-14T10:56:09.908 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.908 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.908 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.908 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.908 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj2": { 2024-09-14T10:56:09.908 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.908 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.908 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.909 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.909 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.909 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.909 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.909 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.909 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.909 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.909 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.909 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.909 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj", 2024-09-14T10:56:09.909 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.909 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.909 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.910 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.910 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.910 INFO:tasks.workunit.client.0.smithi050.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-14T10:56:09.910 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.910 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.910 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.910 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__:inst__myobj", 2024-09-14T10:56:09.910 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "marker__myobj" 2024-09-14T10:56:09.910 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.910 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.910 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.910 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.910 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.910 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.911 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.911 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.911 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.911 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.911 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.911 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.911 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.911 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.911 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.911 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.911 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj", 2024-09-14T10:56:09.911 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.911 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.912 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.912 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.912 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.912 INFO:tasks.workunit.client.0.smithi050.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-14T10:56:09.912 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.912 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj2": { 2024-09-14T10:56:09.912 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.912 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__:inst__myobj", 2024-09-14T10:56:09.912 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "marker__myobj" 2024-09-14T10:56:09.912 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.912 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.912 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.913 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj2": { 2024-09-14T10:56:09.913 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.913 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.913 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.913 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.913 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.913 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.913 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.913 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.914 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.914 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.914 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.914 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.914 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj", 2024-09-14T10:56:09.914 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.914 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.914 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.914 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.914 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.914 INFO:tasks.workunit.client.0.smithi050.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-14T10:56:09.915 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.915 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.915 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.915 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T10:56:09.915 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.915 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.915 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.915 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.915 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.915 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.915 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.915 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.915 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.915 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.916 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.916 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.916 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.916 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.916 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.916 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.916 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.916 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj", 2024-09-14T10:56:09.916 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.916 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.916 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.916 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.916 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.917 INFO:tasks.workunit.client.0.smithi050.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-14T10:56:09.917 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.917 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj2": { 2024-09-14T10:56:09.917 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.917 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T10:56:09.917 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.917 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.917 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.917 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.917 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj2": { 2024-09-14T10:56:09.917 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.917 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.917 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.917 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.918 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.918 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.918 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.918 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.918 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.918 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.918 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.918 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.918 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj", 2024-09-14T10:56:09.918 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.918 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.919 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.919 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.919 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.919 INFO:tasks.workunit.client.0.smithi050.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-14T10:56:09.919 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.919 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.919 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.919 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker___myobj_", 2024-09-14T10:56:09.919 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "marker__myobj_" 2024-09-14T10:56:09.919 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.919 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.919 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.919 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.919 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.920 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.920 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.920 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.920 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.920 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.920 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.920 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.920 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.920 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.920 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.920 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.920 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj_", 2024-09-14T10:56:09.920 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.921 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.921 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.921 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.921 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.921 INFO:tasks.workunit.client.0.smithi050.stdout:raw=.data-pool:marker___myobj_ 2024-09-14T10:56:09.921 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.921 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj2": { 2024-09-14T10:56:09.921 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.921 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker___myobj_", 2024-09-14T10:56:09.921 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "marker__myobj_" 2024-09-14T10:56:09.921 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.921 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.921 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.921 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj2": { 2024-09-14T10:56:09.922 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.922 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.922 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.922 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.922 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.922 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.922 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.922 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.922 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.922 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.922 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.923 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.923 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj_", 2024-09-14T10:56:09.923 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.923 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.923 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.923 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.923 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.923 INFO:tasks.workunit.client.0.smithi050.stdout:raw2=.data-pool:marker___myobj_ 2024-09-14T10:56:09.923 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.923 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.923 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.923 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__ns__myobj_", 2024-09-14T10:56:09.923 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.924 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.924 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.924 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.924 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.924 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.924 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.924 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.924 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.924 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.924 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.924 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.924 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.924 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.925 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.925 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.925 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.925 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj_", 2024-09-14T10:56:09.925 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.925 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.925 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.925 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.925 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.925 INFO:tasks.workunit.client.0.smithi050.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-14T10:56:09.925 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.925 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj2": { 2024-09-14T10:56:09.925 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.925 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__ns__myobj_", 2024-09-14T10:56:09.926 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.926 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.926 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.926 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.926 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj2": { 2024-09-14T10:56:09.926 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.926 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.926 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.926 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.926 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.926 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.926 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.926 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.926 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.927 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.927 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.927 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.927 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj_", 2024-09-14T10:56:09.927 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "", 2024-09-14T10:56:09.927 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.927 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.927 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.927 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.927 INFO:tasks.workunit.client.0.smithi050.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-14T10:56:09.927 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.927 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.927 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.927 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T10:56:09.927 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "marker__myobj_" 2024-09-14T10:56:09.928 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.928 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.928 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.928 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.928 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.928 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.928 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.928 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.928 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.928 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.928 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.928 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.928 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.929 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.929 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.929 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.929 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj_", 2024-09-14T10:56:09.929 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.929 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.929 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.929 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.929 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.929 INFO:tasks.workunit.client.0.smithi050.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-14T10:56:09.929 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.929 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj2": { 2024-09-14T10:56:09.929 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.930 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T10:56:09.930 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "marker__myobj_" 2024-09-14T10:56:09.930 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.930 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.930 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.930 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj2": { 2024-09-14T10:56:09.930 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.930 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.930 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.930 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.930 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.930 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.930 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.930 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.930 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.931 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.931 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.931 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.931 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj_", 2024-09-14T10:56:09.931 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.931 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "" 2024-09-14T10:56:09.931 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.931 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.931 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.931 INFO:tasks.workunit.client.0.smithi050.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-14T10:56:09.931 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.931 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj": { 2024-09-14T10:56:09.932 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.932 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T10:56:09.932 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.932 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.932 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.932 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.932 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj": { 2024-09-14T10:56:09.932 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.932 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.932 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.932 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.933 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.933 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.933 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.933 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.933 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.933 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.933 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.933 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.933 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj_", 2024-09-14T10:56:09.933 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.933 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.933 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.933 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.933 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.934 INFO:tasks.workunit.client.0.smithi050.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-14T10:56:09.934 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.934 INFO:tasks.workunit.client.0.smithi050.stdout: "raw_obj2": { 2024-09-14T10:56:09.934 INFO:tasks.workunit.client.0.smithi050.stdout: "pool": ".data-pool", 2024-09-14T10:56:09.934 INFO:tasks.workunit.client.0.smithi050.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T10:56:09.934 INFO:tasks.workunit.client.0.smithi050.stdout: "loc": "" 2024-09-14T10:56:09.934 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.934 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.934 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:09.934 INFO:tasks.workunit.client.0.smithi050.stdout: "new_obj2": { 2024-09-14T10:56:09.934 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket": { 2024-09-14T10:56:09.934 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "ebtest", 2024-09-14T10:56:09.934 INFO:tasks.workunit.client.0.smithi050.stdout: "marker": "marker", 2024-09-14T10:56:09.934 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_id": "bucket-id", 2024-09-14T10:56:09.934 INFO:tasks.workunit.client.0.smithi050.stdout: "tenant": "", 2024-09-14T10:56:09.935 INFO:tasks.workunit.client.0.smithi050.stdout: "explicit_placement": { 2024-09-14T10:56:09.935 INFO:tasks.workunit.client.0.smithi050.stdout: "data_pool": ".data-pool", 2024-09-14T10:56:09.935 INFO:tasks.workunit.client.0.smithi050.stdout: "data_extra_pool": "", 2024-09-14T10:56:09.935 INFO:tasks.workunit.client.0.smithi050.stdout: "index_pool": ".index-pool" 2024-09-14T10:56:09.935 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.935 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:09.935 INFO:tasks.workunit.client.0.smithi050.stdout: "key": { 2024-09-14T10:56:09.935 INFO:tasks.workunit.client.0.smithi050.stdout: "name": "_myobj_", 2024-09-14T10:56:09.935 INFO:tasks.workunit.client.0.smithi050.stdout: "instance": "inst", 2024-09-14T10:56:09.935 INFO:tasks.workunit.client.0.smithi050.stdout: "ns": "ns" 2024-09-14T10:56:09.935 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.935 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:09.935 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:09.935 INFO:tasks.workunit.client.0.smithi050.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-14T10:56:09.936 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-14T10:56:09.936 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-14T10:56:09.936 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T10:56:09.936 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment tear-down 2024-09-14T10:56:09.936 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-14T10:56:09.936 INFO:tasks.workunit.client.0.smithi050.stdout:[ PASSED ] 4 tests. 2024-09-14T10:56:09.936 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:56:09.936 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:56:09.978 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-14T10:56:09.979 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-14T10:56:09.979 DEBUG:teuthology.orchestra.run.smithi050:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-14T10:56:10.099 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:10.100 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:10.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.146+0000 7fb66280f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:10.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.148+0000 7fb66280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:10.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.148+0000 7fb66280f800 20 realm 2024-09-14T10:56:10.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.148+0000 7fb66280f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:10.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.148+0000 7fb66280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:10.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.148+0000 7fb66280f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:56:10.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.148+0000 7fb66280f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:10.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.148+0000 7fb66280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:10.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.148+0000 7fb66280f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:10.148 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.149+0000 7fb66280f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:10.148 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.149+0000 7fb66280f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:10.149 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.150+0000 7fb66280f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:56:10.149 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.150+0000 7fb66280f800 20 searching for the correct realm 2024-09-14T10:56:10.152 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.153+0000 7fb65faff640 0 -- 172.21.15.50:0/2532846194 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fb658086b00 msgr2=0x7fb65806ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:56:10.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.365+0000 7fb660b01640 0 -- 172.21.15.50:0/2532846194 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x562027e53530 msgr2=0x562027e559d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:56:10.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.370+0000 7fb66280f800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T10:56:10.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.370+0000 7fb66280f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:56:10.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.370+0000 7fb66280f800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T10:56:10.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.370+0000 7fb66280f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:56:10.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.370+0000 7fb66280f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:56:10.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.370+0000 7fb66280f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:56:10.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.370+0000 7fb66280f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:10.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.370+0000 7fb66280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:10.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.370+0000 7fb66280f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:10.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.370+0000 7fb66280f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:10.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.370+0000 7fb66280f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:10.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.371+0000 7fb66280f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:56:10.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.371+0000 7fb66280f800 20 zone default found 2024-09-14T10:56:10.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.371+0000 7fb66280f800 4 Realm: () 2024-09-14T10:56:10.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.371+0000 7fb66280f800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T10:56:10.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.371+0000 7fb66280f800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T10:56:10.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.371+0000 7fb66280f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:56:10.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.371+0000 7fb66280f800 20 zonegroup default 2024-09-14T10:56:10.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.371+0000 7fb66280f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:10.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.371+0000 7fb66280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:10.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.371+0000 7fb66280f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:10.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.371+0000 7fb66280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:10.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.371+0000 7fb66280f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:10.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.372+0000 7fb66280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:10.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.372+0000 7fb66280f800 20 started sync module instance, tier type = 2024-09-14T10:56:10.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.372+0000 7fb66280f800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T10:56:10.381 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.382+0000 7fb66280f800 20 add_watcher() i=0 2024-09-14T10:56:10.381 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.382+0000 7fb66280f800 20 add_watcher() i=1 2024-09-14T10:56:10.381 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.382+0000 7fb66280f800 20 add_watcher() i=2 2024-09-14T10:56:10.381 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.382+0000 7fb66280f800 20 add_watcher() i=3 2024-09-14T10:56:10.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.382+0000 7fb66280f800 20 add_watcher() i=4 2024-09-14T10:56:10.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.382+0000 7fb66280f800 20 add_watcher() i=5 2024-09-14T10:56:10.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.382+0000 7fb66280f800 20 add_watcher() i=6 2024-09-14T10:56:10.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.383+0000 7fb66280f800 20 add_watcher() i=7 2024-09-14T10:56:10.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.383+0000 7fb66280f800 2 all 8 watchers are set, enabling cache 2024-09-14T10:56:10.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.385+0000 7fb516fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:10.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.386+0000 7fb66280f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:10.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.386+0000 7fb66280f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:10.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.386+0000 7fb66280f800 5 note: GC not initialized 2024-09-14T10:56:10.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.386+0000 7fb515fdb640 20 reqs_thread_entry: start 2024-09-14T10:56:10.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.386+0000 7fb66280f800 20 init_complete bucket index max shards: 11 2024-09-14T10:56:10.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.386+0000 7fb66280f800 20 Filter name: none 2024-09-14T10:56:10.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.386+0000 7fb4877fe640 20 reqs_thread_entry: start 2024-09-14T10:56:10.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.386+0000 7fb66280f800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-14T10:56:10.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.387+0000 7fb66280f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:10.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.387+0000 7fb66280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:10.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.387+0000 7fb66280f800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-14T10:56:10.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.387+0000 7fb66280f800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T10:56:10.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.387+0000 7fb66280f800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-14T10:56:10.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.387+0000 7fb66280f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:10.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.387+0000 7fb66280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:10.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.387+0000 7fb66280f800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-14T10:56:10.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.387+0000 7fb66280f800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T10:56:10.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.387+0000 7fb66280f800 10 cache get: name=default.rgw.meta+users.keys+QHW3QoZA7Zs7VrIXYp7wms8xF9U= : miss 2024-09-14T10:56:10.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.387+0000 7fb66280f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:10.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.388+0000 7fb66280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:10.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.388+0000 7fb66280f800 10 cache put: name=default.rgw.meta+users.keys+QHW3QoZA7Zs7VrIXYp7wms8xF9U= info.flags=0x0 2024-09-14T10:56:10.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.388+0000 7fb66280f800 10 adding default.rgw.meta+users.keys+QHW3QoZA7Zs7VrIXYp7wms8xF9U= to cache LRU end 2024-09-14T10:56:10.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.388+0000 7fb66280f800 10 cache get: name=default.rgw.meta+users.keys+QHW3QoZA7Zs7VrIXYp7wms8xF9U= : hit (negative entry) 2024-09-14T10:56:10.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.388+0000 7fb66280f800 10 cache get: name=default.rgw.meta+users.keys+QHW3QoZA7Zs7VrIXYp7wms8xF9U= : hit (negative entry) 2024-09-14T10:56:10.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.389+0000 7fb66280f800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T10:56:10.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.389+0000 7fb66280f800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T10:56:10.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.389+0000 7fb66280f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-14T10:56:10.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.389+0000 7fb5377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791298 cookie 94696108281984 notifier 5309 bl.length()=697 2024-09-14T10:56:10.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.389+0000 7fb5377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T10:56:10.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.389+0000 7fb5377fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T10:56:10.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.392+0000 7fb66280f800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T10:56:10.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.392+0000 7fb66280f800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T10:56:10.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.392+0000 7fb66280f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-14T10:56:10.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.392+0000 7fb5377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791299 cookie 94696108338560 notifier 5309 bl.length()=194 2024-09-14T10:56:10.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.392+0000 7fb5377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T10:56:10.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.392+0000 7fb5377fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T10:56:10.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.396+0000 7fb66280f800 10 cache put: name=default.rgw.meta+users.keys+QHW3QoZA7Zs7VrIXYp7wms8xF9U= info.flags=0x7 2024-09-14T10:56:10.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.396+0000 7fb66280f800 10 moving default.rgw.meta+users.keys+QHW3QoZA7Zs7VrIXYp7wms8xF9U= to cache LRU end 2024-09-14T10:56:10.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.396+0000 7fb66280f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:QHW3QoZA7Zs7VrIXYp7wms8xF9U=, ofs0, ns] 2024-09-14T10:56:10.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.396+0000 7fb5377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791298 cookie 94696108344960 notifier 5309 bl.length()=203 2024-09-14T10:56:10.396 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.396+0000 7fb5377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+QHW3QoZA7Zs7VrIXYp7wms8xF9U= info.flags=0x7 2024-09-14T10:56:10.396 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.396+0000 7fb5377fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+QHW3QoZA7Zs7VrIXYp7wms8xF9U= to cache LRU end 2024-09-14T10:56:10.396 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T10:56:10.396 INFO:tasks.workunit.client.0.smithi050.stdout: "user_id": "ceph-test-librgw-file", 2024-09-14T10:56:10.397 INFO:tasks.workunit.client.0.smithi050.stdout: "display_name": "librgw test user", 2024-09-14T10:56:10.397 INFO:tasks.workunit.client.0.smithi050.stdout: "email": "librgw@example.com", 2024-09-14T10:56:10.397 INFO:tasks.workunit.client.0.smithi050.stdout: "suspended": 0, 2024-09-14T10:56:10.397 INFO:tasks.workunit.client.0.smithi050.stdout: "max_buckets": 1000, 2024-09-14T10:56:10.397 INFO:tasks.workunit.client.0.smithi050.stdout: "subusers": [], 2024-09-14T10:56:10.397 INFO:tasks.workunit.client.0.smithi050.stdout: "keys": [ 2024-09-14T10:56:10.397 INFO:tasks.workunit.client.0.smithi050.stdout: { 2024-09-14T10:56:10.397 INFO:tasks.workunit.client.0.smithi050.stdout: "user": "ceph-test-librgw-file", 2024-09-14T10:56:10.397 INFO:tasks.workunit.client.0.smithi050.stdout: "access_key": "QHW3QoZA7Zs7VrIXYp7wms8xF9U=", 2024-09-14T10:56:10.397 INFO:tasks.workunit.client.0.smithi050.stdout: "secret_key": "k/HzYPYuY5MoAt9KTrHmMIb6PZFZKq4D6ihQ2GUmGPAVWiYfSU1yaw==", 2024-09-14T10:56:10.397 INFO:tasks.workunit.client.0.smithi050.stdout: "active": true, 2024-09-14T10:56:10.397 INFO:tasks.workunit.client.0.smithi050.stdout: "create_date": "2024-09-14T10:56:10.389470Z" 2024-09-14T10:56:10.398 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T10:56:10.398 INFO:tasks.workunit.client.0.smithi050.stdout: ], 2024-09-14T10:56:10.398 INFO:tasks.workunit.client.0.smithi050.stdout: "swift_keys": [], 2024-09-14T10:56:10.398 INFO:tasks.workunit.client.0.smithi050.stdout: "caps": [], 2024-09-14T10:56:10.398 INFO:tasks.workunit.client.0.smithi050.stdout: "op_mask": "read, write, delete", 2024-09-14T10:56:10.398 INFO:tasks.workunit.client.0.smithi050.stdout: "default_placement": "", 2024-09-14T10:56:10.398 INFO:tasks.workunit.client.0.smithi050.stdout: "default_storage_class": "", 2024-09-14T10:56:10.398 INFO:tasks.workunit.client.0.smithi050.stdout: "placement_tags": [], 2024-09-14T10:56:10.398 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_quota": { 2024-09-14T10:56:10.398 INFO:tasks.workunit.client.0.smithi050.stdout: "enabled": false, 2024-09-14T10:56:10.398 INFO:tasks.workunit.client.0.smithi050.stdout: "check_on_raw": false, 2024-09-14T10:56:10.398 INFO:tasks.workunit.client.0.smithi050.stdout: "max_size": -1, 2024-09-14T10:56:10.398 INFO:tasks.workunit.client.0.smithi050.stdout: "max_size_kb": 0, 2024-09-14T10:56:10.398 INFO:tasks.workunit.client.0.smithi050.stdout: "max_objects": -1 2024-09-14T10:56:10.399 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:10.399 INFO:tasks.workunit.client.0.smithi050.stdout: "user_quota": { 2024-09-14T10:56:10.399 INFO:tasks.workunit.client.0.smithi050.stdout: "enabled": false, 2024-09-14T10:56:10.399 INFO:tasks.workunit.client.0.smithi050.stdout: "check_on_raw": false, 2024-09-14T10:56:10.399 INFO:tasks.workunit.client.0.smithi050.stdout: "max_size": -1, 2024-09-14T10:56:10.399 INFO:tasks.workunit.client.0.smithi050.stdout: "max_size_kb": 0, 2024-09-14T10:56:10.399 INFO:tasks.workunit.client.0.smithi050.stdout: "max_objects": -1 2024-09-14T10:56:10.399 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T10:56:10.399 INFO:tasks.workunit.client.0.smithi050.stdout: "temp_url_keys": [], 2024-09-14T10:56:10.399 INFO:tasks.workunit.client.0.smithi050.stdout: "type": "rgw", 2024-09-14T10:56:10.399 INFO:tasks.workunit.client.0.smithi050.stdout: "mfa_ids": [], 2024-09-14T10:56:10.399 INFO:tasks.workunit.client.0.smithi050.stdout: "account_id": "", 2024-09-14T10:56:10.399 INFO:tasks.workunit.client.0.smithi050.stdout: "path": "/", 2024-09-14T10:56:10.399 INFO:tasks.workunit.client.0.smithi050.stdout: "create_date": "2024-09-14T10:56:10.389459Z", 2024-09-14T10:56:10.400 INFO:tasks.workunit.client.0.smithi050.stdout: "tags": [], 2024-09-14T10:56:10.400 INFO:tasks.workunit.client.0.smithi050.stdout: "group_ids": [] 2024-09-14T10:56:10.400 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T10:56:10.400 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T10:56:10.400 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.398+0000 7fb516fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:10.400 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.401+0000 7fb66280f800 20 remove_watcher() i=0 2024-09-14T10:56:10.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.401+0000 7fb66280f800 2 removed watcher, disabling cache 2024-09-14T10:56:10.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.402+0000 7fb66280f800 20 remove_watcher() i=1 2024-09-14T10:56:10.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.403+0000 7fb66280f800 20 remove_watcher() i=2 2024-09-14T10:56:10.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.404+0000 7fb66280f800 20 remove_watcher() i=3 2024-09-14T10:56:10.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.405+0000 7fb66280f800 20 remove_watcher() i=4 2024-09-14T10:56:10.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.406+0000 7fb66280f800 20 remove_watcher() i=5 2024-09-14T10:56:10.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.407+0000 7fb66280f800 20 remove_watcher() i=6 2024-09-14T10:56:10.407 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:10.408+0000 7fb66280f800 20 remove_watcher() i=7 2024-09-14T10:56:10.418 INFO:tasks.workunit.client.0.smithi050.stdout:phase 1.1 2024-09-14T10:56:10.442 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T10:56:10.442 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment set-up. 2024-09-14T10:56:10.442 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 24 tests from LibRGW 2024-09-14T10:56:10.442 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.INIT 2024-09-14T10:56:10.451 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:10.452 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:10.836 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.INIT (396 ms) 2024-09-14T10:56:10.836 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T10:56:10.838 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-14T10:56:10.838 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T10:56:10.838 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T10:56:10.838 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T10:56:10.848 INFO:tasks.workunit.client.0.smithi050.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-14T10:56:10.854 INFO:tasks.workunit.client.0.smithi050.stdout:creating: nfsroot:foo/f1 2024-09-14T10:56:10.857 INFO:tasks.workunit.client.0.smithi050.stdout:creating: nfsroot:foo/f2 2024-09-14T10:56:10.860 INFO:tasks.workunit.client.0.smithi050.stdout:creating: nfsroot:foo/bar/f1 2024-09-14T10:56:10.863 INFO:tasks.workunit.client.0.smithi050.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-14T10:56:10.867 INFO:tasks.workunit.client.0.smithi050.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-14T10:56:10.870 INFO:tasks.workunit.client.0.smithi050.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-14T10:56:10.873 INFO:tasks.workunit.client.0.smithi050.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-14T10:56:10.875 INFO:tasks.workunit.client.0.smithi050.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-14T10:56:10.878 INFO:tasks.workunit.client.0.smithi050.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-14T10:56:10.881 INFO:tasks.workunit.client.0.smithi050.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-14T10:56:10.884 INFO:tasks.workunit.client.0.smithi050.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-14T10:56:10.887 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.SETUP_HIER1 (49 ms) 2024-09-14T10:56:10.887 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T10:56:10.997 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.SETUP_DIRS1 (110 ms) 2024-09-14T10:56:10.997 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T10:56:10.997 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T10:56:10.997 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T10:56:11.015 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (19 ms) 2024-09-14T10:56:11.015 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T10:56:11.061 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (46 ms) 2024-09-14T10:56:11.061 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T10:56:11.061 INFO:tasks.workunit.client.0.smithi050.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-14T10:56:11.068 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (6 ms) 2024-09-14T10:56:11.068 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T10:56:11.068 INFO:tasks.workunit.client.0.smithi050.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-14T10:56:11.075 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (7 ms) 2024-09-14T10:56:11.075 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T10:56:11.075 INFO:tasks.workunit.client.0.smithi050.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T10:56:11.075 INFO:tasks.workunit.client.0.smithi050.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T10:56:11.075 INFO:tasks.workunit.client.0.smithi050.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T10:56:11.075 INFO:tasks.workunit.client.0.smithi050.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T10:56:11.075 INFO:tasks.workunit.client.0.smithi050.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T10:56:11.075 INFO:tasks.workunit.client.0.smithi050.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T10:56:11.076 INFO:tasks.workunit.client.0.smithi050.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T10:56:11.076 INFO:tasks.workunit.client.0.smithi050.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T10:56:11.076 INFO:tasks.workunit.client.0.smithi050.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T10:56:11.076 INFO:tasks.workunit.client.0.smithi050.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T10:56:11.076 INFO:tasks.workunit.client.0.smithi050.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T10:56:11.076 INFO:tasks.workunit.client.0.smithi050.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T10:56:11.076 INFO:tasks.workunit.client.0.smithi050.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T10:56:11.076 INFO:tasks.workunit.client.0.smithi050.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T10:56:11.076 INFO:tasks.workunit.client.0.smithi050.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T10:56:11.076 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T10:56:11.076 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T10:56:11.076 INFO:tasks.workunit.client.0.smithi050.stdout:read back objects in /bdirs1/dir_0 2024-09-14T10:56:11.076 INFO:tasks.workunit.client.0.smithi050.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T10:56:11.077 INFO:tasks.workunit.client.0.smithi050.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T10:56:11.077 INFO:tasks.workunit.client.0.smithi050.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T10:56:11.078 INFO:tasks.workunit.client.0.smithi050.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T10:56:11.078 INFO:tasks.workunit.client.0.smithi050.stdout:read back objects in /bdirs1/dir_1 2024-09-14T10:56:11.078 INFO:tasks.workunit.client.0.smithi050.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T10:56:11.079 INFO:tasks.workunit.client.0.smithi050.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T10:56:11.079 INFO:tasks.workunit.client.0.smithi050.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T10:56:11.081 INFO:tasks.workunit.client.0.smithi050.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T10:56:11.081 INFO:tasks.workunit.client.0.smithi050.stdout:read back objects in /bdirs1/dir_2 2024-09-14T10:56:11.081 INFO:tasks.workunit.client.0.smithi050.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T10:56:11.082 INFO:tasks.workunit.client.0.smithi050.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T10:56:11.082 INFO:tasks.workunit.client.0.smithi050.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T10:56:11.084 INFO:tasks.workunit.client.0.smithi050.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T10:56:11.084 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.READ_DIRS1 (9 ms) 2024-09-14T10:56:11.084 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T10:56:11.264 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.READF_SETUP1 (181 ms) 2024-09-14T10:56:11.264 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T10:56:11.265 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T10:56:11.265 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T10:56:11.265 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T10:56:11.265 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T10:56:11.265 INFO:tasks.workunit.client.0.smithi050.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T10:56:11.265 INFO:tasks.workunit.client.0.smithi050.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T10:56:11.265 INFO:tasks.workunit.client.0.smithi050.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T10:56:11.265 INFO:tasks.workunit.client.0.smithi050.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T10:56:11.265 INFO:tasks.workunit.client.0.smithi050.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T10:56:11.265 INFO:tasks.workunit.client.0.smithi050.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T10:56:11.265 INFO:tasks.workunit.client.0.smithi050.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T10:56:11.265 INFO:tasks.workunit.client.0.smithi050.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T10:56:11.265 INFO:tasks.workunit.client.0.smithi050.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T10:56:11.265 INFO:tasks.workunit.client.0.smithi050.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T10:56:11.266 INFO:tasks.workunit.client.0.smithi050.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T10:56:11.266 INFO:tasks.workunit.client.0.smithi050.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T10:56:11.266 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T10:56:11.266 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T10:56:11.273 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T10:56:11.274 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T10:56:11.277 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T10:56:11.279 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T10:56:11.282 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T10:56:11.282 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T10:56:11.283 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T10:56:11.283 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T10:56:11.284 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T10:56:11.284 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T10:56:11.285 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T10:56:11.287 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T10:56:11.287 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T10:56:11.287 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T10:56:11.287 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo (foo): DIR 2024-09-14T10:56:11.287 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot (nfsroot): DIR 2024-09-14T10:56:11.287 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.HIER1 (22 ms) 2024-09-14T10:56:11.287 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T10:56:11.287 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T10:56:11.287 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T10:56:11.287 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T10:56:11.287 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T10:56:11.287 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T10:56:11.288 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T10:56:11.288 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T10:56:11.288 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T10:56:11.288 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T10:56:11.288 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T10:56:11.288 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T10:56:11.288 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T10:56:11.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:11.288+0000 7f91e49278c0 -1 shutting down 2024-09-14T10:56:11.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:11.289+0000 7f90bc8bd640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65028, si_uid : 1000, si_addr0x3e80000fe04, si_status0 2024-09-14T10:56:41.019 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.SHUTDOWN (29732 ms) 2024-09-14T10:56:41.020 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 24 tests from LibRGW (30578 ms total) 2024-09-14T10:56:41.020 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T10:56:41.020 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment tear-down 2024-09-14T10:56:41.020 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] 24 tests from 1 test suite ran. (30578 ms total) 2024-09-14T10:56:41.020 INFO:tasks.workunit.client.0.smithi050.stdout:[ PASSED ] 24 tests. 2024-09-14T10:56:41.025 INFO:tasks.workunit.client.0.smithi050.stdout:phase 1.2 2024-09-14T10:56:41.050 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T10:56:41.050 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment set-up. 2024-09-14T10:56:41.050 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 24 tests from LibRGW 2024-09-14T10:56:41.051 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.INIT 2024-09-14T10:56:41.059 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:41.059 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:41.448 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.INIT (397 ms) 2024-09-14T10:56:41.448 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T10:56:41.449 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-14T10:56:41.449 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T10:56:41.450 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T10:56:41.450 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T10:56:41.450 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-14T10:56:41.450 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T10:56:41.450 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-14T10:56:41.450 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T10:56:41.450 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T10:56:41.450 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T10:56:41.450 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T10:56:41.450 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T10:56:41.450 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T10:56:41.450 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T10:56:41.450 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T10:56:41.450 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T10:56:41.451 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T10:56:41.451 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T10:56:41.451 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T10:56:41.451 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T10:56:41.451 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-14T10:56:41.451 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T10:56:41.451 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T10:56:41.451 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T10:56:41.451 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T10:56:41.451 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T10:56:41.451 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T10:56:41.451 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T10:56:41.451 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T10:56:41.451 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T10:56:41.452 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-14T10:56:41.452 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T10:56:41.452 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T10:56:41.452 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T10:56:41.452 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T10:56:41.452 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T10:56:41.452 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T10:56:41.452 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T10:56:41.452 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T10:56:41.452 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T10:56:41.452 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T10:56:41.452 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T10:56:41.452 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T10:56:41.452 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T10:56:41.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:41.450+0000 7f62d93208c0 -1 shutting down 2024-09-14T10:56:41.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:56:41.451+0000 7f61b1204640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65647, si_uid : 1000, si_addr0x3e80001006f, si_status0 2024-09-14T10:57:11.838 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.SHUTDOWN (30389 ms) 2024-09-14T10:57:11.838 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 24 tests from LibRGW (30787 ms total) 2024-09-14T10:57:11.838 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T10:57:11.838 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment tear-down 2024-09-14T10:57:11.839 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] 24 tests from 1 test suite ran. (30787 ms total) 2024-09-14T10:57:11.839 INFO:tasks.workunit.client.0.smithi050.stdout:[ PASSED ] 24 tests. 2024-09-14T10:57:11.844 INFO:tasks.workunit.client.0.smithi050.stdout:phase 1.3 2024-09-14T10:57:11.870 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T10:57:11.870 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment set-up. 2024-09-14T10:57:11.870 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 24 tests from LibRGW 2024-09-14T10:57:11.871 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.INIT 2024-09-14T10:57:11.881 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:11.881 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:12.281 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.INIT (412 ms) 2024-09-14T10:57:12.281 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T10:57:12.282 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MOUNT_NOROOT (0 ms) 2024-09-14T10:57:12.282 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T10:57:12.282 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T10:57:12.282 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T10:57:12.288 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.SETUP_HIER1 (6 ms) 2024-09-14T10:57:12.288 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T10:57:12.353 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.SETUP_DIRS1 (66 ms) 2024-09-14T10:57:12.354 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T10:57:12.354 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T10:57:12.354 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T10:57:12.354 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T10:57:12.354 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T10:57:12.354 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T10:57:12.354 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T10:57:12.354 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T10:57:12.354 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T10:57:12.354 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T10:57:12.354 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T10:57:12.355 INFO:tasks.workunit.client.0.smithi050.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T10:57:12.355 INFO:tasks.workunit.client.0.smithi050.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T10:57:12.355 INFO:tasks.workunit.client.0.smithi050.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T10:57:12.355 INFO:tasks.workunit.client.0.smithi050.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T10:57:12.355 INFO:tasks.workunit.client.0.smithi050.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T10:57:12.355 INFO:tasks.workunit.client.0.smithi050.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T10:57:12.355 INFO:tasks.workunit.client.0.smithi050.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T10:57:12.355 INFO:tasks.workunit.client.0.smithi050.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T10:57:12.355 INFO:tasks.workunit.client.0.smithi050.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T10:57:12.355 INFO:tasks.workunit.client.0.smithi050.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T10:57:12.355 INFO:tasks.workunit.client.0.smithi050.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T10:57:12.355 INFO:tasks.workunit.client.0.smithi050.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T10:57:12.355 INFO:tasks.workunit.client.0.smithi050.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T10:57:12.356 INFO:tasks.workunit.client.0.smithi050.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T10:57:12.356 INFO:tasks.workunit.client.0.smithi050.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T10:57:12.356 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T10:57:12.356 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T10:57:12.356 INFO:tasks.workunit.client.0.smithi050.stdout:read back objects in /bdirs1/dir_0 2024-09-14T10:57:12.356 INFO:tasks.workunit.client.0.smithi050.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T10:57:12.356 INFO:tasks.workunit.client.0.smithi050.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T10:57:12.356 INFO:tasks.workunit.client.0.smithi050.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T10:57:12.357 INFO:tasks.workunit.client.0.smithi050.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T10:57:12.357 INFO:tasks.workunit.client.0.smithi050.stdout:read back objects in /bdirs1/dir_1 2024-09-14T10:57:12.357 INFO:tasks.workunit.client.0.smithi050.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T10:57:12.358 INFO:tasks.workunit.client.0.smithi050.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T10:57:12.358 INFO:tasks.workunit.client.0.smithi050.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T10:57:12.360 INFO:tasks.workunit.client.0.smithi050.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T10:57:12.360 INFO:tasks.workunit.client.0.smithi050.stdout:read back objects in /bdirs1/dir_2 2024-09-14T10:57:12.360 INFO:tasks.workunit.client.0.smithi050.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T10:57:12.361 INFO:tasks.workunit.client.0.smithi050.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T10:57:12.361 INFO:tasks.workunit.client.0.smithi050.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T10:57:12.363 INFO:tasks.workunit.client.0.smithi050.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T10:57:12.363 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.READ_DIRS1 (9 ms) 2024-09-14T10:57:12.363 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T10:57:12.363 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T10:57:12.363 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T10:57:12.363 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T10:57:12.363 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T10:57:12.363 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T10:57:12.363 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T10:57:12.364 INFO:tasks.workunit.client.0.smithi050.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T10:57:12.364 INFO:tasks.workunit.client.0.smithi050.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T10:57:12.364 INFO:tasks.workunit.client.0.smithi050.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T10:57:12.364 INFO:tasks.workunit.client.0.smithi050.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T10:57:12.364 INFO:tasks.workunit.client.0.smithi050.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T10:57:12.364 INFO:tasks.workunit.client.0.smithi050.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T10:57:12.364 INFO:tasks.workunit.client.0.smithi050.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T10:57:12.364 INFO:tasks.workunit.client.0.smithi050.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T10:57:12.364 INFO:tasks.workunit.client.0.smithi050.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T10:57:12.364 INFO:tasks.workunit.client.0.smithi050.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T10:57:12.364 INFO:tasks.workunit.client.0.smithi050.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T10:57:12.365 INFO:tasks.workunit.client.0.smithi050.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T10:57:12.365 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T10:57:12.365 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T10:57:12.371 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T10:57:12.371 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T10:57:12.374 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T10:57:12.376 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T10:57:12.379 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T10:57:12.379 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T10:57:12.380 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T10:57:12.380 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T10:57:12.381 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T10:57:12.381 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T10:57:12.382 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T10:57:12.384 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T10:57:12.384 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T10:57:12.384 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T10:57:12.384 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot/foo (foo): DIR 2024-09-14T10:57:12.384 INFO:tasks.workunit.client.0.smithi050.stdout:/nfsroot (nfsroot): DIR 2024-09-14T10:57:12.385 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.HIER1 (21 ms) 2024-09-14T10:57:12.385 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T10:57:12.385 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T10:57:12.385 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T10:57:12.385 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T10:57:12.385 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T10:57:12.385 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T10:57:12.385 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T10:57:12.385 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T10:57:12.385 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T10:57:12.385 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T10:57:12.385 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T10:57:12.385 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.UMOUNT (1 ms) 2024-09-14T10:57:12.385 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T10:57:12.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:57:12.386+0000 7f2d059208c0 -1 shutting down 2024-09-14T10:57:12.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:57:12.388+0000 7f2bdd804640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66267, si_uid : 1000, si_addr0x3e8000102db, si_status0 2024-09-14T10:57:42.549 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.SHUTDOWN (30164 ms) 2024-09-14T10:57:42.550 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 24 tests from LibRGW (30679 ms total) 2024-09-14T10:57:42.550 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T10:57:42.550 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment tear-down 2024-09-14T10:57:42.550 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] 24 tests from 1 test suite ran. (30679 ms total) 2024-09-14T10:57:42.550 INFO:tasks.workunit.client.0.smithi050.stdout:[ PASSED ] 24 tests. 2024-09-14T10:57:42.556 INFO:tasks.workunit.client.0.smithi050.stdout:phase 2.1 2024-09-14T10:57:42.582 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T10:57:42.582 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment set-up. 2024-09-14T10:57:42.582 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 9 tests from LibRGW 2024-09-14T10:57:42.582 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.INIT 2024-09-14T10:57:42.591 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:42.592 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:42.986 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.INIT (404 ms) 2024-09-14T10:57:42.986 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T10:57:42.986 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T10:57:42.986 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T10:57:42.998 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.CREATE_BUCKET (11 ms) 2024-09-14T10:57:42.998 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T10:57:42.998 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T10:57:42.998 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T10:57:43.009 INFO:tasks.workunit.client.0.smithi050.stdout:created: sorrydave0 2024-09-14T10:57:43.020 INFO:tasks.workunit.client.0.smithi050.stdout:created: sorrydave1 2024-09-14T10:57:43.030 INFO:tasks.workunit.client.0.smithi050.stdout:created: sorrydave2 2024-09-14T10:57:43.040 INFO:tasks.workunit.client.0.smithi050.stdout:created: sorrydave3 2024-09-14T10:57:43.052 INFO:tasks.workunit.client.0.smithi050.stdout:created: sorrydave4 2024-09-14T10:57:43.060 INFO:tasks.workunit.client.0.smithi050.stdout:created: sorrydave5 2024-09-14T10:57:43.070 INFO:tasks.workunit.client.0.smithi050.stdout:created: sorrydave6 2024-09-14T10:57:43.080 INFO:tasks.workunit.client.0.smithi050.stdout:created: sorrydave7 2024-09-14T10:57:43.090 INFO:tasks.workunit.client.0.smithi050.stdout:created: sorrydave8 2024-09-14T10:57:43.100 INFO:tasks.workunit.client.0.smithi050.stdout:created: sorrydave9 2024-09-14T10:57:43.100 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (103 ms) 2024-09-14T10:57:43.101 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T10:57:43.403 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (302 ms) 2024-09-14T10:57:43.403 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T10:57:43.403 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T10:57:43.403 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T10:57:43.403 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T10:57:43.403 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T10:57:43.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:57:43.405+0000 7fbfdf73b8c0 -1 shutting down 2024-09-14T10:57:43.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:57:43.406+0000 7fbeb9478640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66886, si_uid : 1000, si_addr0x3e800010546, si_status0 2024-09-14T10:58:13.326 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.SHUTDOWN (29923 ms) 2024-09-14T10:58:13.327 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 9 tests from LibRGW (30744 ms total) 2024-09-14T10:58:13.327 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T10:58:13.327 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment tear-down 2024-09-14T10:58:13.327 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] 9 tests from 1 test suite ran. (30744 ms total) 2024-09-14T10:58:13.327 INFO:tasks.workunit.client.0.smithi050.stdout:[ PASSED ] 9 tests. 2024-09-14T10:58:13.333 INFO:tasks.workunit.client.0.smithi050.stdout:phase 2.2 2024-09-14T10:58:13.359 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T10:58:13.359 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment set-up. 2024-09-14T10:58:13.360 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 9 tests from LibRGW 2024-09-14T10:58:13.360 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.INIT 2024-09-14T10:58:13.369 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:58:13.369 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:58:13.556 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.INIT (196 ms) 2024-09-14T10:58:13.556 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T10:58:13.557 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T10:58:13.557 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T10:58:13.557 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T10:58:13.557 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T10:58:13.589 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.DELETE_BUCKET (32 ms) 2024-09-14T10:58:13.589 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T10:58:13.598 INFO:tasks.workunit.client.0.smithi050.stdout:created: sorrydave0 2024-09-14T10:58:13.609 INFO:tasks.workunit.client.0.smithi050.stdout:created: sorrydave1 2024-09-14T10:58:13.620 INFO:tasks.workunit.client.0.smithi050.stdout:created: sorrydave2 2024-09-14T10:58:13.630 INFO:tasks.workunit.client.0.smithi050.stdout:created: sorrydave3 2024-09-14T10:58:13.641 INFO:tasks.workunit.client.0.smithi050.stdout:created: sorrydave4 2024-09-14T10:58:13.651 INFO:tasks.workunit.client.0.smithi050.stdout:created: sorrydave5 2024-09-14T10:58:13.662 INFO:tasks.workunit.client.0.smithi050.stdout:created: sorrydave6 2024-09-14T10:58:13.672 INFO:tasks.workunit.client.0.smithi050.stdout:created: sorrydave7 2024-09-14T10:58:13.683 INFO:tasks.workunit.client.0.smithi050.stdout:created: sorrydave8 2024-09-14T10:58:13.693 INFO:tasks.workunit.client.0.smithi050.stdout:created: sorrydave9 2024-09-14T10:58:13.693 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (104 ms) 2024-09-14T10:58:13.693 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T10:58:13.997 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (304 ms) 2024-09-14T10:58:13.997 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T10:58:13.997 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T10:58:13.997 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T10:58:13.998 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T10:58:13.998 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T10:58:13.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:58:13.998+0000 7f201e70c8c0 -1 shutting down 2024-09-14T10:58:13.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:58:13.999+0000 7f1ef844b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67506, si_uid : 1000, si_addr0x3e8000107b2, si_status0 2024-09-14T10:58:43.942 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.SHUTDOWN (29944 ms) 2024-09-14T10:58:43.942 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 9 tests from LibRGW (30582 ms total) 2024-09-14T10:58:43.942 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T10:58:43.942 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment tear-down 2024-09-14T10:58:43.942 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] 9 tests from 1 test suite ran. (30582 ms total) 2024-09-14T10:58:43.942 INFO:tasks.workunit.client.0.smithi050.stdout:[ PASSED ] 9 tests. 2024-09-14T10:58:43.948 INFO:tasks.workunit.client.0.smithi050.stdout:phase 3.1 2024-09-14T10:58:44.283 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T10:58:44.283 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment set-up. 2024-09-14T10:58:44.283 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 13 tests from LibRGW 2024-09-14T10:58:44.283 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.INIT 2024-09-14T10:58:44.293 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:58:44.293 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:58:44.471 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.INIT (187 ms) 2024-09-14T10:58:44.471 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T10:58:44.473 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T10:58:44.473 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T10:58:44.482 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.CREATE_BUCKET (11 ms) 2024-09-14T10:58:44.482 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T10:58:44.486 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-09-14T10:58:44.486 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T10:58:44.487 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-14T10:58:44.487 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T10:58:44.924 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.LARGE1 (436 ms) 2024-09-14T10:58:44.924 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T10:58:44.968 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.LARGE2 (44 ms) 2024-09-14T10:58:44.968 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T10:58:44.968 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T10:58:44.968 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T10:58:44.968 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T10:58:44.968 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T10:58:44.968 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T10:58:44.968 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T10:58:44.968 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T10:58:44.968 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T10:58:44.969 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T10:58:44.969 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T10:58:44.969 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:58:44.969+0000 7f244a91f8c0 -1 shutting down 2024-09-14T10:58:44.969 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:58:44.970+0000 7f2322865640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68125, si_uid : 1000, si_addr0x3e800010a1d, si_status0 2024-09-14T10:59:14.886 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.SHUTDOWN (29918 ms) 2024-09-14T10:59:14.886 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 13 tests from LibRGW (30602 ms total) 2024-09-14T10:59:14.886 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T10:59:14.886 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment tear-down 2024-09-14T10:59:14.886 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] 13 tests from 1 test suite ran. (30602 ms total) 2024-09-14T10:59:14.886 INFO:tasks.workunit.client.0.smithi050.stdout:[ PASSED ] 13 tests. 2024-09-14T10:59:14.893 INFO:tasks.workunit.client.0.smithi050.stdout:phase 3.2 2024-09-14T10:59:15.223 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T10:59:15.223 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment set-up. 2024-09-14T10:59:15.223 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 13 tests from LibRGW 2024-09-14T10:59:15.223 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.INIT 2024-09-14T10:59:15.231 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:59:15.231 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:59:15.614 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.INIT (391 ms) 2024-09-14T10:59:15.614 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T10:59:15.614 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T10:59:15.615 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T10:59:15.615 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T10:59:15.615 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T10:59:15.620 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-14T10:59:15.620 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T10:59:15.624 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-14T10:59:15.625 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T10:59:15.679 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.LARGE1 (54 ms) 2024-09-14T10:59:15.679 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T10:59:15.679 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-14T10:59:15.679 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T10:59:15.679 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T10:59:15.679 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T10:59:15.683 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.DELETE_OBJECT (4 ms) 2024-09-14T10:59:15.683 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T10:59:15.713 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.DELETE_BUCKET (30 ms) 2024-09-14T10:59:15.713 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T10:59:15.713 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T10:59:15.713 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T10:59:15.713 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T10:59:15.713 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T10:59:15.713 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:59:15.714+0000 7fd4bf70c8c0 -1 shutting down 2024-09-14T10:59:15.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:59:15.715+0000 7fd39944b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68744, si_uid : 1000, si_addr0x3e800010c88, si_status0 2024-09-14T10:59:45.783 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.SHUTDOWN (30070 ms) 2024-09-14T10:59:45.783 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 13 tests from LibRGW (30560 ms total) 2024-09-14T10:59:45.783 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T10:59:45.783 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment tear-down 2024-09-14T10:59:45.783 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] 13 tests from 1 test suite ran. (30560 ms total) 2024-09-14T10:59:45.783 INFO:tasks.workunit.client.0.smithi050.stdout:[ PASSED ] 13 tests. 2024-09-14T10:59:45.790 INFO:tasks.workunit.client.0.smithi050.stdout:phase 4.1 2024-09-14T10:59:45.820 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T10:59:45.820 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment set-up. 2024-09-14T10:59:45.820 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 11 tests from LibRGW 2024-09-14T10:59:45.821 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T10:59:45.821 INFO:tasks.workunit.client.0.smithi050.stdout:read i1: 64001 2024-09-14T10:59:45.821 INFO:tasks.workunit.client.0.smithi050.stdout:read s1: blunderbuss 2024-09-14T10:59:45.821 INFO:tasks.workunit.client.0.smithi050.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T10:59:45.821 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.INIT 2024-09-14T10:59:45.832 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:59:45.832 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:59:46.224 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.INIT (404 ms) 2024-09-14T10:59:46.224 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T10:59:46.225 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T10:59:46.225 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T10:59:46.243 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (18 ms) 2024-09-14T10:59:46.243 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T10:59:46.836 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_0 2024-09-14T10:59:46.836 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_1 2024-09-14T10:59:46.837 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_2 2024-09-14T10:59:46.837 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_3 2024-09-14T10:59:46.837 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_4 2024-09-14T10:59:46.837 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_5 2024-09-14T10:59:46.837 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_6 2024-09-14T10:59:46.837 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_7 2024-09-14T10:59:46.837 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_8 2024-09-14T10:59:46.837 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_9 2024-09-14T10:59:46.837 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_10 2024-09-14T10:59:46.837 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_11 2024-09-14T10:59:46.837 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_12 2024-09-14T10:59:46.837 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_13 2024-09-14T10:59:46.837 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_14 2024-09-14T10:59:46.838 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_15 2024-09-14T10:59:46.838 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_16 2024-09-14T10:59:46.838 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_17 2024-09-14T10:59:46.838 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_18 2024-09-14T10:59:46.838 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_19 2024-09-14T10:59:46.838 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_20 2024-09-14T10:59:46.838 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_21 2024-09-14T10:59:46.838 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_22 2024-09-14T10:59:46.838 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_23 2024-09-14T10:59:46.838 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_24 2024-09-14T10:59:46.838 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_25 2024-09-14T10:59:46.838 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_26 2024-09-14T10:59:46.838 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_27 2024-09-14T10:59:46.839 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_28 2024-09-14T10:59:46.839 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_29 2024-09-14T10:59:46.839 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_30 2024-09-14T10:59:46.839 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_31 2024-09-14T10:59:46.839 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_32 2024-09-14T10:59:46.839 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_33 2024-09-14T10:59:46.839 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_34 2024-09-14T10:59:46.839 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_35 2024-09-14T10:59:46.839 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_36 2024-09-14T10:59:46.839 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_37 2024-09-14T10:59:46.839 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_38 2024-09-14T10:59:46.839 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_39 2024-09-14T10:59:46.839 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_40 2024-09-14T10:59:46.840 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_41 2024-09-14T10:59:46.840 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_42 2024-09-14T10:59:46.840 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_43 2024-09-14T10:59:46.840 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_44 2024-09-14T10:59:46.840 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_45 2024-09-14T10:59:46.840 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_46 2024-09-14T10:59:46.840 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_47 2024-09-14T10:59:46.840 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_48 2024-09-14T10:59:46.840 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_49 2024-09-14T10:59:46.840 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_50 2024-09-14T10:59:46.840 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_51 2024-09-14T10:59:46.841 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_52 2024-09-14T10:59:46.841 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_53 2024-09-14T10:59:46.841 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_54 2024-09-14T10:59:46.841 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_55 2024-09-14T10:59:46.841 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_56 2024-09-14T10:59:46.841 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_57 2024-09-14T10:59:46.841 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_58 2024-09-14T10:59:46.841 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_59 2024-09-14T10:59:46.841 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_60 2024-09-14T10:59:46.841 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_61 2024-09-14T10:59:46.841 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_62 2024-09-14T10:59:46.841 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_63 2024-09-14T10:59:46.841 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_64 2024-09-14T10:59:46.842 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_65 2024-09-14T10:59:46.842 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_66 2024-09-14T10:59:46.842 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_67 2024-09-14T10:59:46.842 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_68 2024-09-14T10:59:46.842 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_69 2024-09-14T10:59:46.842 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_70 2024-09-14T10:59:46.842 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_71 2024-09-14T10:59:46.842 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_72 2024-09-14T10:59:46.842 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_73 2024-09-14T10:59:46.842 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_74 2024-09-14T10:59:46.842 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_75 2024-09-14T10:59:46.842 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_76 2024-09-14T10:59:46.843 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_77 2024-09-14T10:59:46.843 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_78 2024-09-14T10:59:46.843 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_79 2024-09-14T10:59:46.843 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_80 2024-09-14T10:59:46.843 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_81 2024-09-14T10:59:46.843 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_82 2024-09-14T10:59:46.843 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_83 2024-09-14T10:59:46.843 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_84 2024-09-14T10:59:46.843 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_85 2024-09-14T10:59:46.843 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_86 2024-09-14T10:59:46.843 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_87 2024-09-14T10:59:46.843 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_88 2024-09-14T10:59:46.843 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_89 2024-09-14T10:59:46.843 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_90 2024-09-14T10:59:46.844 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_91 2024-09-14T10:59:46.844 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_92 2024-09-14T10:59:46.844 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_93 2024-09-14T10:59:46.844 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_94 2024-09-14T10:59:46.844 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_95 2024-09-14T10:59:46.844 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_96 2024-09-14T10:59:46.844 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_97 2024-09-14T10:59:46.844 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_98 2024-09-14T10:59:46.844 INFO:tasks.workunit.client.0.smithi050.stdout:created: dmarker:f_99 2024-09-14T10:59:46.844 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (594 ms) 2024-09-14T10:59:46.844 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T10:59:46.846 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-14T10:59:46.846 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-14T10:59:46.846 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T10:59:46.846 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T10:59:46.846 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T10:59:46.846 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T10:59:46.846 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T10:59:46.846 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T10:59:46.846 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T10:59:46.846 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T10:59:46.846 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T10:59:46.847 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T10:59:46.847 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T10:59:46.847 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T10:59:46.847 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T10:59:46.847 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T10:59:46.847 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T10:59:46.847 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T10:59:46.847 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T10:59:46.847 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T10:59:46.847 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T10:59:46.847 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T10:59:46.847 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T10:59:46.847 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T10:59:46.847 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T10:59:46.848 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T10:59:46.848 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T10:59:46.848 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T10:59:46.848 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T10:59:46.848 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T10:59:46.848 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T10:59:46.848 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T10:59:46.848 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T10:59:46.848 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T10:59:46.849 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T10:59:46.849 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T10:59:46.849 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T10:59:46.849 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T10:59:46.849 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T10:59:46.849 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T10:59:46.849 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T10:59:46.849 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T10:59:46.849 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T10:59:46.849 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T10:59:46.849 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T10:59:46.849 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T10:59:46.849 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T10:59:46.850 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T10:59:46.850 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T10:59:46.850 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T10:59:46.850 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T10:59:46.850 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T10:59:46.850 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T10:59:46.850 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T10:59:46.850 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T10:59:46.850 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T10:59:46.850 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T10:59:46.850 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T10:59:46.850 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T10:59:46.850 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T10:59:46.851 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T10:59:46.851 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T10:59:46.851 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T10:59:46.851 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T10:59:46.851 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T10:59:46.851 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T10:59:46.851 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T10:59:46.851 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T10:59:46.851 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T10:59:46.851 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T10:59:46.851 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T10:59:46.851 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T10:59:46.852 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T10:59:46.852 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T10:59:46.852 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T10:59:46.852 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T10:59:46.852 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T10:59:46.852 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T10:59:46.852 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T10:59:46.852 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T10:59:46.852 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T10:59:46.852 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T10:59:46.852 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T10:59:46.852 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T10:59:46.852 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T10:59:46.852 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T10:59:46.853 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T10:59:46.853 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T10:59:46.853 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T10:59:46.853 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T10:59:46.853 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T10:59:46.853 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T10:59:46.853 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T10:59:46.853 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T10:59:46.853 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T10:59:46.853 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T10:59:46.853 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T10:59:46.853 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T10:59:46.853 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T10:59:46.853 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T10:59:46.854 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T10:59:46.854 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T10:59:46.854 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MARKER1_READDIR (2 ms) 2024-09-14T10:59:46.854 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T10:59:46.854 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T10:59:46.854 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T10:59:46.854 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T10:59:46.854 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T10:59:46.854 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T10:59:46.854 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T10:59:46.854 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T10:59:46.854 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T10:59:46.855 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T10:59:46.855 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T10:59:46.855 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T10:59:46.855 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T10:59:46.855 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T10:59:46.855 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T10:59:46.855 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T10:59:46.855 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T10:59:46.855 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T10:59:46.855 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T10:59:46.855 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T10:59:46.855 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T10:59:46.855 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T10:59:46.856 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T10:59:46.856 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T10:59:46.856 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T10:59:46.856 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T10:59:46.856 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T10:59:46.856 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T10:59:46.856 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T10:59:46.856 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T10:59:46.856 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T10:59:46.856 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T10:59:46.856 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T10:59:46.856 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T10:59:46.856 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T10:59:46.857 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T10:59:46.857 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T10:59:46.857 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T10:59:46.857 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T10:59:46.857 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T10:59:46.857 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T10:59:46.857 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T10:59:46.857 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T10:59:46.857 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T10:59:46.857 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T10:59:46.857 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T10:59:46.857 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T10:59:46.857 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T10:59:46.857 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T10:59:46.858 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T10:59:46.858 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T10:59:46.858 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T10:59:46.858 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T10:59:46.858 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T10:59:46.858 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T10:59:46.858 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T10:59:46.858 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T10:59:46.858 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T10:59:46.858 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T10:59:46.858 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T10:59:46.858 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T10:59:46.859 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T10:59:46.859 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T10:59:46.859 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T10:59:46.859 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T10:59:46.859 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T10:59:46.859 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T10:59:46.859 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T10:59:46.859 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T10:59:46.859 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T10:59:46.859 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T10:59:46.859 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T10:59:46.859 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T10:59:46.859 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T10:59:46.859 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T10:59:46.860 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T10:59:46.860 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T10:59:46.860 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T10:59:46.860 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T10:59:46.860 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T10:59:46.860 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T10:59:46.860 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T10:59:46.860 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T10:59:46.860 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T10:59:46.860 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T10:59:46.860 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T10:59:46.860 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T10:59:46.861 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T10:59:46.861 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T10:59:46.861 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T10:59:46.861 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T10:59:46.861 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T10:59:46.861 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T10:59:46.861 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T10:59:46.861 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T10:59:46.861 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T10:59:46.861 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T10:59:46.861 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T10:59:46.861 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T10:59:46.861 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T10:59:46.862 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T10:59:46.862 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-14T10:59:46.862 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T10:59:46.862 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T10:59:46.862 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T10:59:46.862 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T10:59:46.862 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T10:59:46.862 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T10:59:46.862 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T10:59:46.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:59:46.843+0000 7f4453f248c0 -1 shutting down 2024-09-14T10:59:46.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T10:59:46.844+0000 7f432be9a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69363, si_uid : 1000, si_addr0x3e800010ef3, si_status0 2024-09-14T11:00:16.662 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.SHUTDOWN (29820 ms) 2024-09-14T11:00:16.662 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 11 tests from LibRGW (30841 ms total) 2024-09-14T11:00:16.662 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T11:00:16.662 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment tear-down 2024-09-14T11:00:16.662 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] 11 tests from 1 test suite ran. (30841 ms total) 2024-09-14T11:00:16.662 INFO:tasks.workunit.client.0.smithi050.stdout:[ PASSED ] 11 tests. 2024-09-14T11:00:16.668 INFO:tasks.workunit.client.0.smithi050.stdout:phase 4.2 2024-09-14T11:00:16.694 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:00:16.694 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment set-up. 2024-09-14T11:00:16.695 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 11 tests from LibRGW 2024-09-14T11:00:16.695 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T11:00:16.695 INFO:tasks.workunit.client.0.smithi050.stdout:read i1: 64001 2024-09-14T11:00:16.695 INFO:tasks.workunit.client.0.smithi050.stdout:read s1: blunderbuss 2024-09-14T11:00:16.695 INFO:tasks.workunit.client.0.smithi050.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T11:00:16.695 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:00:16.703 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:00:16.703 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:00:17.094 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.INIT (400 ms) 2024-09-14T11:00:17.094 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:00:17.095 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:00:17.095 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:00:17.105 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (10 ms) 2024-09-14T11:00:17.105 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:00:17.105 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:00:17.105 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:00:17.105 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:00:17.105 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T11:00:17.107 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:00:17.107 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:00:17.107 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:00:17.108 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:00:17.108 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:00:17.108 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:00:17.108 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:00:17.108 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:00:17.108 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:00:17.108 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:00:17.108 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:00:17.108 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:00:17.108 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:00:17.108 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:00:17.108 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:00:17.108 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:00:17.109 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:00:17.109 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:00:17.109 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:00:17.109 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:00:17.109 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:00:17.109 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:00:17.109 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:00:17.109 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:00:17.109 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:00:17.109 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:00:17.109 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:00:17.109 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:00:17.109 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:00:17.109 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:00:17.110 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:00:17.110 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:00:17.110 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:00:17.110 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:00:17.110 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:00:17.110 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:00:17.110 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:00:17.110 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:00:17.110 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:00:17.110 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:00:17.110 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:00:17.110 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:00:17.110 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:00:17.111 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:00:17.111 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:00:17.111 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:00:17.111 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:00:17.111 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:00:17.111 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:00:17.111 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:00:17.111 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:00:17.111 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:00:17.111 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:00:17.111 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:00:17.111 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:00:17.111 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:00:17.112 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:00:17.112 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:00:17.112 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:00:17.112 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:00:17.112 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:00:17.112 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:00:17.112 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:00:17.112 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:00:17.112 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:00:17.112 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:00:17.113 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:00:17.113 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:00:17.113 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:00:17.113 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:00:17.113 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:00:17.113 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:00:17.113 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:00:17.113 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:00:17.113 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:00:17.113 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:00:17.113 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:00:17.113 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:00:17.113 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:00:17.114 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:00:17.114 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:00:17.114 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:00:17.114 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:00:17.114 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:00:17.114 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:00:17.114 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:00:17.114 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:00:17.114 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:00:17.114 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:00:17.114 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:00:17.114 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:00:17.114 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:00:17.114 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:00:17.114 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:00:17.115 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:00:17.115 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:00:17.115 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:00:17.115 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:00:17.115 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:00:17.115 INFO:tasks.workunit.client.0.smithi050.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:00:17.115 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2024-09-14T11:00:17.115 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:00:17.115 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:00:17.115 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:00:17.115 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:00:17.116 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:00:17.116 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:00:17.116 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:00:17.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:00:17.109+0000 7f3e048a48c0 -1 shutting down 2024-09-14T11:00:17.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:00:17.110+0000 7f3cde5e1640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69996, si_uid : 1000, si_addr0x3e80001116c, si_status0 2024-09-14T11:00:47.232 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.SHUTDOWN (30124 ms) 2024-09-14T11:00:47.233 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 11 tests from LibRGW (30537 ms total) 2024-09-14T11:00:47.233 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T11:00:47.233 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment tear-down 2024-09-14T11:00:47.233 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] 11 tests from 1 test suite ran. (30537 ms total) 2024-09-14T11:00:47.233 INFO:tasks.workunit.client.0.smithi050.stdout:[ PASSED ] 11 tests. 2024-09-14T11:00:47.238 INFO:tasks.workunit.client.0.smithi050.stdout:phase 5.1 2024-09-14T11:00:47.274 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T11:00:47.274 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment set-up. 2024-09-14T11:00:47.275 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 19 tests from LibRGW 2024-09-14T11:00:47.275 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:00:47.285 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:00:47.285 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:00:47.679 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.INIT (405 ms) 2024-09-14T11:00:47.679 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:00:47.680 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:00:47.680 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:00:47.691 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.CREATE_BUCKET (11 ms) 2024-09-14T11:00:47.691 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:00:47.696 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-14T11:00:47.696 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T11:00:47.696 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T11:00:47.696 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:00:47.698 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-14T11:00:47.698 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T11:00:47.698 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T11:00:47.698 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T11:00:47.703 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.PUT_OBJECT (5 ms) 2024-09-14T11:00:47.703 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T11:00:47.705 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.GET_OBJECT (1 ms) 2024-09-14T11:00:47.705 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:00:47.705 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:00:47.705 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T11:00:47.705 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T11:00:47.705 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T11:00:47.705 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T11:00:47.705 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.READV 2024-09-14T11:00:47.706 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T11:00:47.706 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T11:00:47.706 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T11:00:47.706 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:00:47.706 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T11:00:47.706 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:00:47.706 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:00:47.706 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:00:47.706 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:00:47.706 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:00:47.706 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:00:47.706 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:00:47.707 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:00:47.706+0000 7f7da1f528c0 -1 shutting down 2024-09-14T11:00:47.707 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:00:47.707+0000 7f7c7bc91640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70616, si_uid : 1000, si_addr0x3e8000113d8, si_status0 2024-09-14T11:01:17.902 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.SHUTDOWN (30196 ms) 2024-09-14T11:01:17.902 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 19 tests from LibRGW (30626 ms total) 2024-09-14T11:01:17.902 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T11:01:17.902 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment tear-down 2024-09-14T11:01:17.902 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] 19 tests from 1 test suite ran. (30626 ms total) 2024-09-14T11:01:17.902 INFO:tasks.workunit.client.0.smithi050.stdout:[ PASSED ] 19 tests. 2024-09-14T11:01:17.908 INFO:tasks.workunit.client.0.smithi050.stdout:phase 5.2 2024-09-14T11:01:17.943 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T11:01:17.943 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment set-up. 2024-09-14T11:01:17.943 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 19 tests from LibRGW 2024-09-14T11:01:17.943 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:01:17.951 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:01:17.951 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:01:18.340 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.INIT (397 ms) 2024-09-14T11:01:18.340 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:01:18.341 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:01:18.341 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:01:18.341 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:01:18.341 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:01:18.348 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-14T11:01:18.348 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T11:01:18.348 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T11:01:18.348 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:01:18.348 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-14T11:01:18.348 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T11:01:18.348 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T11:01:18.348 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T11:01:18.348 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-14T11:01:18.348 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T11:01:18.348 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-14T11:01:18.349 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:01:18.349 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:01:18.349 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T11:01:18.349 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T11:01:18.349 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T11:01:18.349 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T11:01:18.349 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.READV 2024-09-14T11:01:18.349 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T11:01:18.349 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T11:01:18.349 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T11:01:18.349 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:01:18.353 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.DELETE_OBJECT (6 ms) 2024-09-14T11:01:18.353 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:01:18.384 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.DELETE_BUCKET (30 ms) 2024-09-14T11:01:18.384 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:01:18.384 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:01:18.384 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:01:18.384 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:01:18.384 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:01:18.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:01:18.385+0000 7f62f18308c0 -1 shutting down 2024-09-14T11:01:18.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:01:18.386+0000 7f61c6ee0640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71251, si_uid : 1000, si_addr0x3e800011653, si_status0 2024-09-14T11:01:48.689 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.SHUTDOWN (30304 ms) 2024-09-14T11:01:48.689 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 19 tests from LibRGW (30744 ms total) 2024-09-14T11:01:48.689 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T11:01:48.689 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment tear-down 2024-09-14T11:01:48.689 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] 19 tests from 1 test suite ran. (30745 ms total) 2024-09-14T11:01:48.689 INFO:tasks.workunit.client.0.smithi050.stdout:[ PASSED ] 19 tests. 2024-09-14T11:01:48.695 INFO:tasks.workunit.client.0.smithi050.stdout:phase 6.1 2024-09-14T11:01:48.722 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T11:01:48.722 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment set-up. 2024-09-14T11:01:48.722 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 10 tests from LibRGW 2024-09-14T11:01:48.723 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:01:48.728 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:01:48.729 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:01:49.129 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.INIT (408 ms) 2024-09-14T11:01:49.129 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:01:49.129 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:01:49.129 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-14T11:01:49.152 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.CREATE_BUCKETS (22 ms) 2024-09-14T11:01:49.152 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-14T11:01:49.159 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (8 ms) 2024-09-14T11:01:49.160 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-14T11:01:49.179 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.TOPDIR_RENAME (19 ms) 2024-09-14T11:01:49.179 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-14T11:01:49.202 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.SUBDIR_RENAME (24 ms) 2024-09-14T11:01:49.203 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-14T11:01:49.226 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (24 ms) 2024-09-14T11:01:49.227 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:01:49.227 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:01:49.227 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:01:49.227 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:01:49.227 INFO:tasks.workunit.client.0.smithi050.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:01:49.227 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:01:49.227+0000 7f31c1cc38c0 -1 shutting down 2024-09-14T11:01:49.227 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:01:49.228+0000 7f3098bf3640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71870, si_uid : 1000, si_addr0x3e8000118be, si_status0 2024-09-14T11:02:19.356 INFO:tasks.workunit.client.0.smithi050.stdout:[ OK ] LibRGW.SHUTDOWN (30129 ms) 2024-09-14T11:02:19.356 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] 10 tests from LibRGW (30635 ms total) 2024-09-14T11:02:19.356 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T11:02:19.356 INFO:tasks.workunit.client.0.smithi050.stdout:[----------] Global test environment tear-down 2024-09-14T11:02:19.356 INFO:tasks.workunit.client.0.smithi050.stdout:[==========] 10 tests from 1 test suite ran. (30635 ms total) 2024-09-14T11:02:19.356 INFO:tasks.workunit.client.0.smithi050.stdout:[ PASSED ] 10 tests. 2024-09-14T11:02:19.363 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:02:19.364 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:02:19.412 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-14T11:02:19.413 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-14T11:02:19.413 DEBUG:teuthology.orchestra.run.smithi050:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-14T11:02:19.450 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z ']' 2024-09-14T11:02:19.451 INFO:tasks.workunit.client.0.smithi050.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:02:19.451 INFO:tasks.workunit.client.0.smithi050.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:02:19.451 INFO:tasks.workunit.client.0.smithi050.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:02:19.451 INFO:tasks.workunit.client.0.smithi050.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:02:19.451 INFO:tasks.workunit.client.0.smithi050.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-14T11:02:19.489 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:19.489 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:19.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.533+0000 7f27aa812800 20 rados->read ofs=0 len=0 2024-09-14T11:02:19.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.534+0000 7f27aa812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:19.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.534+0000 7f27aa812800 20 realm 2024-09-14T11:02:19.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.534+0000 7f27aa812800 20 rados->read ofs=0 len=0 2024-09-14T11:02:19.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.535+0000 7f27aa812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:19.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.535+0000 7f27aa812800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:19.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.535+0000 7f27aa812800 20 rados->read ofs=0 len=0 2024-09-14T11:02:19.534 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.535+0000 7f27aa812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:19.534 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.535+0000 7f27aa812800 20 rados->read ofs=0 len=0 2024-09-14T11:02:19.535 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.536+0000 7f27aa812800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:19.535 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.536+0000 7f27aa812800 20 rados->read ofs=0 len=0 2024-09-14T11:02:19.535 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.536+0000 7f27aa812800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:19.535 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.536+0000 7f27aa812800 20 searching for the correct realm 2024-09-14T11:02:19.535 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.538+0000 7f27a5ecb640 0 -- 172.21.15.50:0/1283255313 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x7f27a0080040 msgr2=0x7f27a0060940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:19.540 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.542+0000 7f27a66cc640 0 -- 172.21.15.50:0/1283255313 >> [v2:172.21.15.118:6826/1082138742,v1:172.21.15.118:6827/1082138742] conn(0x7f2798035040 msgr2=0x7f2798070440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:19.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.750+0000 7f27aa812800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:02:19.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.750+0000 7f27aa812800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:19.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.750+0000 7f27aa812800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:02:19.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.750+0000 7f27aa812800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:19.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.750+0000 7f27aa812800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:19.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.750+0000 7f27aa812800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:19.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.750+0000 7f27aa812800 20 rados->read ofs=0 len=0 2024-09-14T11:02:19.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.750+0000 7f27aa812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:19.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.750+0000 7f27aa812800 20 rados->read ofs=0 len=0 2024-09-14T11:02:19.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.751+0000 7f27aa812800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:19.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.751+0000 7f27aa812800 20 rados->read ofs=0 len=0 2024-09-14T11:02:19.886 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.751+0000 7f27aa812800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:19.886 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.751+0000 7f27aa812800 20 zone default found 2024-09-14T11:02:19.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.751+0000 7f27aa812800 4 Realm: () 2024-09-14T11:02:19.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.751+0000 7f27aa812800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:02:19.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.751+0000 7f27aa812800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:02:19.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.751+0000 7f27aa812800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:19.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.751+0000 7f27aa812800 20 zonegroup default 2024-09-14T11:02:19.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.751+0000 7f27aa812800 20 rados->read ofs=0 len=0 2024-09-14T11:02:19.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.751+0000 7f27aa812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:19.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.751+0000 7f27aa812800 20 rados->read ofs=0 len=0 2024-09-14T11:02:19.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.752+0000 7f27aa812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:19.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.752+0000 7f27aa812800 20 rados->read ofs=0 len=0 2024-09-14T11:02:19.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.752+0000 7f27aa812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:19.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.752+0000 7f27aa812800 20 started sync module instance, tier type = 2024-09-14T11:02:19.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.752+0000 7f27aa812800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:02:19.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.762+0000 7f27aa812800 20 add_watcher() i=0 2024-09-14T11:02:19.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.762+0000 7f27aa812800 20 add_watcher() i=1 2024-09-14T11:02:19.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.762+0000 7f27aa812800 20 add_watcher() i=2 2024-09-14T11:02:19.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.762+0000 7f27aa812800 20 add_watcher() i=3 2024-09-14T11:02:19.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.762+0000 7f27aa812800 20 add_watcher() i=4 2024-09-14T11:02:19.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.762+0000 7f27aa812800 20 add_watcher() i=5 2024-09-14T11:02:19.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.762+0000 7f27aa812800 20 add_watcher() i=6 2024-09-14T11:02:19.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.763+0000 7f27aa812800 20 add_watcher() i=7 2024-09-14T11:02:19.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.763+0000 7f27aa812800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:19.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.764+0000 7f26577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:19.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.765+0000 7f27aa812800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:19.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.765+0000 7f27aa812800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:19.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.765+0000 7f27aa812800 5 note: GC not initialized 2024-09-14T11:02:19.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.765+0000 7f26567fc640 20 reqs_thread_entry: start 2024-09-14T11:02:19.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.765+0000 7f27aa812800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:19.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.765+0000 7f27aa812800 20 Filter name: none 2024-09-14T11:02:19.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.765+0000 7f25cbfff640 20 reqs_thread_entry: start 2024-09-14T11:02:19.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.765+0000 7f27aa812800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-14T11:02:19.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.765+0000 7f27aa812800 20 rados->read ofs=0 len=0 2024-09-14T11:02:19.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.766+0000 7f27aa812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:19.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.766+0000 7f27aa812800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-14T11:02:19.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.766+0000 7f27aa812800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:02:19.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.766+0000 7f27aa812800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-14T11:02:19.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.766+0000 7f27aa812800 20 rados->read ofs=0 len=0 2024-09-14T11:02:19.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.766+0000 7f27aa812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:19.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.766+0000 7f27aa812800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-14T11:02:19.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.766+0000 7f27aa812800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:02:19.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.766+0000 7f27aa812800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-14T11:02:19.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.766+0000 7f27aa812800 20 rados->read ofs=0 len=0 2024-09-14T11:02:19.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.766+0000 7f27aa812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:19.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.766+0000 7f27aa812800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-14T11:02:19.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.766+0000 7f27aa812800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:02:19.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.766+0000 7f27aa812800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T11:02:19.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.767+0000 7f27aa812800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T11:02:19.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.768+0000 7f27aa812800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T11:02:19.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.768+0000 7f27aa812800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:02:19.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.768+0000 7f27aa812800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-14T11:02:19.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.769+0000 7f26897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791365 cookie 94360449222592 notifier 5835 bl.length()=677 2024-09-14T11:02:19.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.769+0000 7f26897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T11:02:19.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.769+0000 7f26897fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:02:19.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.772+0000 7f27aa812800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T11:02:19.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.772+0000 7f27aa812800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:02:19.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.772+0000 7f27aa812800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-14T11:02:19.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.772+0000 7f26897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791304 cookie 94360449199984 notifier 5835 bl.length()=187 2024-09-14T11:02:19.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.772+0000 7f26897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T11:02:19.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.772+0000 7f26897fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:02:19.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.775+0000 7f27aa812800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T11:02:19.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.775+0000 7f27aa812800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:02:19.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.775+0000 7f27aa812800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-14T11:02:19.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.775+0000 7f2688ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791305 cookie 94360449199984 notifier 5835 bl.length()=197 2024-09-14T11:02:19.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.775+0000 7f2688ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T11:02:19.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.775+0000 7f2688ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:02:19.892 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T11:02:19.893 INFO:tasks.workunit.client.0.smithi050.stdout: "user_id": "ceph-test-maven", 2024-09-14T11:02:19.893 INFO:tasks.workunit.client.0.smithi050.stdout: "display_name": "maven test user", 2024-09-14T11:02:19.893 INFO:tasks.workunit.client.0.smithi050.stdout: "email": "sigv4@example.com", 2024-09-14T11:02:19.893 INFO:tasks.workunit.client.0.smithi050.stdout: "suspended": 0, 2024-09-14T11:02:19.893 INFO:tasks.workunit.client.0.smithi050.stdout: "max_buckets": 1000, 2024-09-14T11:02:19.893 INFO:tasks.workunit.client.0.smithi050.stdout: "subusers": [], 2024-09-14T11:02:19.893 INFO:tasks.workunit.client.0.smithi050.stdout: "keys": [ 2024-09-14T11:02:19.893 INFO:tasks.workunit.client.0.smithi050.stdout: { 2024-09-14T11:02:19.893 INFO:tasks.workunit.client.0.smithi050.stdout: "user": "ceph-test-maven", 2024-09-14T11:02:19.893 INFO:tasks.workunit.client.0.smithi050.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-14T11:02:19.894 INFO:tasks.workunit.client.0.smithi050.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-14T11:02:19.894 INFO:tasks.workunit.client.0.smithi050.stdout: "active": true, 2024-09-14T11:02:19.894 INFO:tasks.workunit.client.0.smithi050.stdout: "create_date": "2024-09-14T11:02:19.767380Z" 2024-09-14T11:02:19.894 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T11:02:19.894 INFO:tasks.workunit.client.0.smithi050.stdout: ], 2024-09-14T11:02:19.894 INFO:tasks.workunit.client.0.smithi050.stdout: "swift_keys": [], 2024-09-14T11:02:19.894 INFO:tasks.workunit.client.0.smithi050.stdout: "caps": [], 2024-09-14T11:02:19.894 INFO:tasks.workunit.client.0.smithi050.stdout: "op_mask": "read, write, delete", 2024-09-14T11:02:19.894 INFO:tasks.workunit.client.0.smithi050.stdout: "default_placement": "", 2024-09-14T11:02:19.894 INFO:tasks.workunit.client.0.smithi050.stdout: "default_storage_class": "", 2024-09-14T11:02:19.894 INFO:tasks.workunit.client.0.smithi050.stdout: "placement_tags": [], 2024-09-14T11:02:19.894 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_quota": { 2024-09-14T11:02:19.894 INFO:tasks.workunit.client.0.smithi050.stdout: "enabled": false, 2024-09-14T11:02:19.895 INFO:tasks.workunit.client.0.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:02:19.895 INFO:tasks.workunit.client.0.smithi050.stdout: "max_size": -1, 2024-09-14T11:02:19.895 INFO:tasks.workunit.client.0.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:02:19.895 INFO:tasks.workunit.client.0.smithi050.stdout: "max_objects": -1 2024-09-14T11:02:19.895 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T11:02:19.895 INFO:tasks.workunit.client.0.smithi050.stdout: "user_quota": { 2024-09-14T11:02:19.895 INFO:tasks.workunit.client.0.smithi050.stdout: "enabled": false, 2024-09-14T11:02:19.895 INFO:tasks.workunit.client.0.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:02:19.895 INFO:tasks.workunit.client.0.smithi050.stdout: "max_size": -1, 2024-09-14T11:02:19.895 INFO:tasks.workunit.client.0.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:02:19.895 INFO:tasks.workunit.client.0.smithi050.stdout: "max_objects": -1 2024-09-14T11:02:19.895 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T11:02:19.895 INFO:tasks.workunit.client.0.smithi050.stdout: "temp_url_keys": [], 2024-09-14T11:02:19.896 INFO:tasks.workunit.client.0.smithi050.stdout: "type": "rgw", 2024-09-14T11:02:19.896 INFO:tasks.workunit.client.0.smithi050.stdout: "mfa_ids": [], 2024-09-14T11:02:19.896 INFO:tasks.workunit.client.0.smithi050.stdout: "account_id": "", 2024-09-14T11:02:19.896 INFO:tasks.workunit.client.0.smithi050.stdout: "path": "/", 2024-09-14T11:02:19.896 INFO:tasks.workunit.client.0.smithi050.stdout: "create_date": "2024-09-14T11:02:19.767366Z", 2024-09-14T11:02:19.896 INFO:tasks.workunit.client.0.smithi050.stdout: "tags": [], 2024-09-14T11:02:19.896 INFO:tasks.workunit.client.0.smithi050.stdout: "group_ids": [] 2024-09-14T11:02:19.896 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T11:02:19.896 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T11:02:19.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.778+0000 7f26577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:19.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.780+0000 7f27aa812800 20 remove_watcher() i=0 2024-09-14T11:02:19.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.780+0000 7f27aa812800 2 removed watcher, disabling cache 2024-09-14T11:02:19.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.781+0000 7f27aa812800 20 remove_watcher() i=1 2024-09-14T11:02:19.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.782+0000 7f27aa812800 20 remove_watcher() i=2 2024-09-14T11:02:19.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.783+0000 7f27aa812800 20 remove_watcher() i=3 2024-09-14T11:02:19.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.784+0000 7f27aa812800 20 remove_watcher() i=4 2024-09-14T11:02:19.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.785+0000 7f27aa812800 20 remove_watcher() i=5 2024-09-14T11:02:19.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.786+0000 7f27aa812800 20 remove_watcher() i=6 2024-09-14T11:02:19.899 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:02:19.788+0000 7f27aa812800 20 remove_watcher() i=7 2024-09-14T11:02:19.899 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z ']' 2024-09-14T11:02:19.899 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-14T11:02:19.899 INFO:tasks.workunit.client.0.smithi050.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-14T11:02:19.899 INFO:tasks.workunit.client.0.smithi050.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi050.front.sepia.ceph.com:443 2024-09-14T11:02:19.899 INFO:tasks.workunit.client.0.smithi050.stderr:+ RGW_HTTP_ENDPOINT_URL=https://smithi050.front.sepia.ceph.com:443 2024-09-14T11:02:19.899 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-14T11:02:19.899 INFO:tasks.workunit.client.0.smithi050.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-14T11:02:19.899 INFO:tasks.workunit.client.0.smithi050.stderr:+ ./mvnw clean package 2024-09-14T11:02:19.899 INFO:tasks.workunit.client.0.smithi050.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T11:02:21.277 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] Scanning for projects... 2024-09-14T11:02:21.389 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-14T11:02:21.471 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 66 kB/s) 2024-09-14T11:02:21.485 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-14T11:02:21.526 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 17/83 kB Progress (1): 18/83 kB Progress (1): 19/83 kB Progress (1): 21/83 kB Progress (1): 22/83 kB Progress (1): 23/83 kB Progress (1): 25/83 kB Progress (1): 26/83 kB Progress (1): 28/83 kB Progress (1): 29/83 kB Progress (1): 30/83 kB Progress (1): 32/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.0 MB/s) 2024-09-14T11:02:21.538 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-14T11:02:21.558 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 4.0 MB/s) 2024-09-14T11:02:21.585 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] 2024-09-14T11:02:21.585 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T11:02:21.585 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] Building jcksum 1.0 2024-09-14T11:02:21.585 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] from pom.xml 2024-09-14T11:02:21.586 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T11:02:21.588 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-14T11:02:21.603 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 332 kB/s) 2024-09-14T11:02:21.609 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-14T11:02:21.626 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 582 kB/s) 2024-09-14T11:02:21.630 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-14T11:02:21.645 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.8 MB/s) 2024-09-14T11:02:21.652 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-14T11:02:21.669 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.2 MB/s) 2024-09-14T11:02:21.685 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-14T11:02:21.699 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 15/36 kB Progress (1): 31/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.0 MB/s) 2024-09-14T11:02:21.708 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-14T11:02:21.723 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 544 kB/s) 2024-09-14T11:02:21.726 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-14T11:02:21.742 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 506 kB/s) 2024-09-14T11:02:21.745 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-14T11:02:21.762 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.8 MB/s) 2024-09-14T11:02:21.768 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-14T11:02:21.784 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.3 MB/s) 2024-09-14T11:02:21.791 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-14T11:02:21.806 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.9 MB/s) 2024-09-14T11:02:21.811 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-14T11:02:21.826 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 654 kB/s) 2024-09-14T11:02:21.832 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-14T11:02:21.850 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.9 MB/s) 2024-09-14T11:02:21.858 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-14T11:02:21.874 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 332 kB/s) 2024-09-14T11:02:21.876 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-14T11:02:21.891 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.5 MB/s) 2024-09-14T11:02:21.896 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-14T11:02:21.912 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 3.1 MB/s) 2024-09-14T11:02:21.918 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-14T11:02:21.935 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.5 MB/s) 2024-09-14T11:02:21.943 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-14T11:02:21.959 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 352 kB/s) 2024-09-14T11:02:21.964 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-14T11:02:21.979 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 3.0 MB/s) 2024-09-14T11:02:21.987 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-14T11:02:22.002 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 451 kB/s) 2024-09-14T11:02:22.005 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-14T11:02:22.020 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 660 kB/s) 2024-09-14T11:02:22.022 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-14T11:02:22.038 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.9 MB/s) 2024-09-14T11:02:22.041 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-14T11:02:22.056 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.4 MB/s) 2024-09-14T11:02:22.062 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-14T11:02:22.077 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.8 MB/s) 2024-09-14T11:02:22.091 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-14T11:02:22.106 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 435 kB/s) 2024-09-14T11:02:22.108 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-14T11:02:22.122 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.4 MB/s) 2024-09-14T11:02:22.127 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-14T11:02:22.142 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.3 MB/s) 2024-09-14T11:02:22.149 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-14T11:02:22.164 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 267 kB/s) 2024-09-14T11:02:22.167 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-14T11:02:22.183 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 104 kB/s) 2024-09-14T11:02:22.185 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-14T11:02:22.200 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 149 kB/s) 2024-09-14T11:02:22.206 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-14T11:02:22.221 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 243 kB/s) 2024-09-14T11:02:22.225 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-14T11:02:22.240 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 215 kB/s) 2024-09-14T11:02:22.245 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-14T11:02:22.259 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 731 kB/s) 2024-09-14T11:02:22.265 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-14T11:02:22.281 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 105 kB/s) 2024-09-14T11:02:22.286 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-14T11:02:22.302 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 239 kB/s) 2024-09-14T11:02:22.307 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-14T11:02:22.322 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 327 kB/s) 2024-09-14T11:02:22.326 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-14T11:02:22.341 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 77 kB/s) 2024-09-14T11:02:22.343 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-14T11:02:22.357 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 274 kB/s) 2024-09-14T11:02:22.358 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-14T11:02:22.372 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 986 kB/s) 2024-09-14T11:02:22.375 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-14T11:02:22.389 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 262 kB/s) 2024-09-14T11:02:22.394 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-14T11:02:22.409 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 153 kB/s) 2024-09-14T11:02:22.413 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-14T11:02:22.427 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 208 kB/s) 2024-09-14T11:02:22.432 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-14T11:02:22.447 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 494 kB/s) 2024-09-14T11:02:22.453 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-14T11:02:22.467 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 364 kB/s) 2024-09-14T11:02:22.472 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-14T11:02:22.486 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 249 kB/s) 2024-09-14T11:02:22.491 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-14T11:02:22.507 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 293 kB/s) 2024-09-14T11:02:22.510 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-14T11:02:22.525 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 150 kB/s) 2024-09-14T11:02:22.530 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-14T11:02:22.544 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 429 kB/s) 2024-09-14T11:02:22.551 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-14T11:02:22.564 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 433 kB/s) 2024-09-14T11:02:22.569 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-14T11:02:22.584 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 198 kB/s) 2024-09-14T11:02:22.589 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-14T11:02:22.604 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 232 kB/s) 2024-09-14T11:02:22.610 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-14T11:02:22.624 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 272 kB/s) 2024-09-14T11:02:22.627 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-14T11:02:22.641 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 118 kB/s) 2024-09-14T11:02:22.645 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-14T11:02:22.659 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 472 kB/s) 2024-09-14T11:02:22.662 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-14T11:02:22.677 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.2 MB/s) 2024-09-14T11:02:22.680 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-14T11:02:22.694 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.3 MB/s) 2024-09-14T11:02:22.698 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-14T11:02:22.712 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.1 MB/s) 2024-09-14T11:02:22.717 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-14T11:02:22.731 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 355 kB/s) 2024-09-14T11:02:22.733 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-14T11:02:22.747 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 940 kB/s) 2024-09-14T11:02:22.752 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-14T11:02:22.766 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 931 kB/s) 2024-09-14T11:02:22.769 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-14T11:02:22.786 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 4.2 MB/s) 2024-09-14T11:02:22.793 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-14T11:02:22.808 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.0 MB/s) 2024-09-14T11:02:22.813 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-14T11:02:22.827 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.1 MB/s) 2024-09-14T11:02:22.829 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-14T11:02:22.845 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 5.0 MB/s) 2024-09-14T11:02:22.849 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-14T11:02:22.864 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.3 MB/s) 2024-09-14T11:02:22.867 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-14T11:02:22.882 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.4 MB/s) 2024-09-14T11:02:22.885 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-14T11:02:22.901 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.9 MB/s) 2024-09-14T11:02:22.906 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-14T11:02:22.921 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 274 kB/s) 2024-09-14T11:02:22.922 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-14T11:02:22.937 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 986 kB/s) 2024-09-14T11:02:22.940 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-14T11:02:22.954 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 214 kB/s) 2024-09-14T11:02:22.956 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-14T11:02:22.970 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 227 kB/s) 2024-09-14T11:02:22.972 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-14T11:02:22.986 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 145 kB/s) 2024-09-14T11:02:22.988 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-14T11:02:23.002 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 202 kB/s) 2024-09-14T11:02:23.004 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-14T11:02:23.018 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 109 kB/s) 2024-09-14T11:02:23.020 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-14T11:02:23.034 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 215 kB/s) 2024-09-14T11:02:23.036 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-14T11:02:23.051 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 229 kB/s) 2024-09-14T11:02:23.053 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-14T11:02:23.067 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 229 kB/s) 2024-09-14T11:02:23.070 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-14T11:02:23.083 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 73 kB/s) 2024-09-14T11:02:23.087 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-14T11:02:23.102 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 64 kB/s) 2024-09-14T11:02:23.104 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-14T11:02:23.121 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 218 kB/s) 2024-09-14T11:02:23.121 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-14T11:02:23.135 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 217 kB/s) 2024-09-14T11:02:23.137 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-14T11:02:23.153 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 202 kB/s) 2024-09-14T11:02:23.155 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-14T11:02:23.169 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 245 kB/s) 2024-09-14T11:02:23.171 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-14T11:02:23.185 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 216 kB/s) 2024-09-14T11:02:23.203 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-14T11:02:23.283 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 41 MB/s) 2024-09-14T11:02:23.285 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-14T11:02:23.285 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-14T11:02:23.285 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-14T11:02:23.285 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-14T11:02:23.286 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-14T11:02:23.304 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/98 kB Progress (1): 33/98 kB Progress (1): 49/98 kB Progress (1): 63/98 kB Progress (1): 79/98 kB Progress (1): 95/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 4.9 MB/s) 2024-09-14T11:02:23.304 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-14T11:02:23.318 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 501 kB/s) 2024-09-14T11:02:23.318 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-14T11:02:23.338 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.4/49 kB Progress (2): 1.4/49 kB | 1.4/35 kB Progress (2): 2.8/49 kB | 1.4/35 kB Progress (3): 2.8/49 kB | 1.4/35 kB | 1.4/71 kB Progress (3): 4.1/49 kB | 1.4/35 kB | 1.4/71 kB Progress (3): 4.1/49 kB | 2.8/35 kB | 1.4/71 kB Progress (4): 4.1/49 kB | 2.8/35 kB | 1.4/71 kB | 1.4/16 kB Progress (4): 4.1/49 kB | 4.1/35 kB | 1.4/71 kB | 1.4/16 kB Progress (4): 5.5/49 kB | 4.1/35 kB | 1.4/71 kB | 1.4/16 kB Progress (4): 5.5/49 kB | 4.1/35 kB | 2.8/71 kB | 1.4/16 kB Progress (4): 6.9/49 kB | 4.1/35 kB | 2.8/71 kB | 1.4/16 kB Progress (4): 6.9/49 kB | 4.1/35 kB | 4.1/71 kB | 1.4/16 kB Progress (4): 6.9/49 kB | 5.5/35 kB | 4.1/71 kB | 1.4/16 kB Progress (4): 6.9/49 kB | 5.5/35 kB | 4.1/71 kB | 2.8/16 kB Progress (4): 6.9/49 kB | 6.9/35 kB | 4.1/71 kB | 2.8/16 kB Progress (4): 6.9/49 kB | 6.9/35 kB | 5.5/71 kB | 2.8/16 kB Progress (4): 8.3/49 kB | 6.9/35 kB | 5.5/71 kB | 2.8/16 kB Progress (4): 8.3/49 kB | 6.9/35 kB | 6.9/71 kB | 2.8/16 kB Progress (4): 9.7/49 kB | 6.9/35 kB | 6.9/71 kB | 2.8/16 kB Progress (4): 9.7/49 kB | 8.3/35 kB | 6.9/71 kB | 2.8/16 kB Progress (4): 9.7/49 kB | 8.3/35 kB | 6.9/71 kB | 4.1/16 kB Progress (4): 11/49 kB | 8.3/35 kB | 6.9/71 kB | 4.1/16 kB Progress (4): 11/49 kB | 8.3/35 kB | 8.3/71 kB | 4.1/16 kB Progress (4): 11/49 kB | 8.3/35 kB | 8.3/71 kB | 5.5/16 kB Progress (4): 11/49 kB | 9.7/35 kB | 8.3/71 kB | 5.5/16 kB Progress (4): 11/49 kB | 9.7/35 kB | 8.3/71 kB | 6.9/16 kB Progress (4): 12/49 kB | 9.7/35 kB | 8.3/71 kB | 6.9/16 kB Progress (4): 12/49 kB | 9.7/35 kB | 9.7/71 kB | 6.9/16 kB Progress (4): 12/49 kB | 9.7/35 kB | 9.7/71 kB | 8.3/16 kB Progress (4): 12/49 kB | 11/35 kB | 9.7/71 kB | 8.3/16 kB Progress (4): 12/49 kB | 11/35 kB | 9.7/71 kB | 9.7/16 kB Progress (4): 12/49 kB | 11/35 kB | 11/71 kB | 9.7/16 kB Progress (4): 14/49 kB | 11/35 kB | 11/71 kB | 9.7/16 kB Progress (4): 14/49 kB | 11/35 kB | 12/71 kB | 9.7/16 kB Progress (5): 14/49 kB | 11/35 kB | 12/71 kB | 9.7/16 kB | 16/782 kB Progress (5): 14/49 kB | 12/35 kB | 12/71 kB | 9.7/16 kB | 16/782 kB Progress (5): 14/49 kB | 12/35 kB | 12/71 kB | 11/16 kB | 16/782 kB Progress (5): 14/49 kB | 14/35 kB | 12/71 kB | 11/16 kB | 16/782 kB Progress (5): 14/49 kB | 14/35 kB | 12/71 kB | 11/16 kB | 33/782 kB Progress (5): 14/49 kB | 15/35 kB | 12/71 kB | 11/16 kB | 33/782 kB Progress (5): 14/49 kB | 15/35 kB | 14/71 kB | 11/16 kB | 33/782 kB Progress (5): 15/49 kB | 15/35 kB | 14/71 kB | 11/16 kB | 33/782 kB Progress (5): 15/49 kB | 15/35 kB | 14/71 kB | 11/16 kB | 49/782 kB Progress (5): 15/49 kB | 15/35 kB | 15/71 kB | 11/16 kB | 49/782 kB Progress (5): 15/49 kB | 16/35 kB | 15/71 kB | 11/16 kB | 49/782 kB Progress (5): 15/49 kB | 16/35 kB | 15/71 kB | 12/16 kB | 49/782 kB Progress (5): 15/49 kB | 18/35 kB | 15/71 kB | 12/16 kB | 49/782 kB Progress (5): 15/49 kB | 18/35 kB | 16/71 kB | 12/16 kB | 49/782 kB Progress (5): 16/49 kB | 18/35 kB | 16/71 kB | 12/16 kB | 49/782 kB Progress (5): 16/49 kB | 18/35 kB | 18/71 kB | 12/16 kB | 49/782 kB Progress (5): 18/49 kB | 18/35 kB | 18/71 kB | 12/16 kB | 49/782 kB Progress (5): 18/49 kB | 19/35 kB | 18/71 kB | 12/16 kB | 49/782 kB Progress (5): 18/49 kB | 19/35 kB | 18/71 kB | 12/16 kB | 65/782 kB Progress (5): 18/49 kB | 19/35 kB | 18/71 kB | 14/16 kB | 65/782 kB Progress (5): 18/49 kB | 21/35 kB | 18/71 kB | 14/16 kB | 65/782 kB Progress (5): 19/49 kB | 21/35 kB | 18/71 kB | 14/16 kB | 65/782 kB Progress (5): 19/49 kB | 21/35 kB | 19/71 kB | 14/16 kB | 65/782 kB Progress (5): 19/49 kB | 22/35 kB | 19/71 kB | 14/16 kB | 65/782 kB Progress (5): 19/49 kB | 22/35 kB | 19/71 kB | 15/16 kB | 65/782 kB Progress (5): 19/49 kB | 23/35 kB | 19/71 kB | 15/16 kB | 65/782 kB Progress (5): 19/49 kB | 23/35 kB | 19/71 kB | 15/16 kB | 82/782 kB Progress (5): 19/49 kB | 23/35 kB | 21/71 kB | 15/16 kB | 82/782 kB Progress (5): 21/49 kB | 23/35 kB | 21/71 kB | 15/16 kB | 82/782 kB Progress (5): 21/49 kB | 23/35 kB | 22/71 kB | 15/16 kB | 82/782 kB Progress (5): 21/49 kB | 25/35 kB | 22/71 kB | 15/16 kB | 82/782 kB Progress (5): 21/49 kB | 25/35 kB | 22/71 kB | 16 kB | 82/782 kB Progress (5): 21/49 kB | 26/35 kB | 22/71 kB | 16 kB | 82/782 kB Progress (5): 21/49 kB | 26/35 kB | 23/71 kB | 16 kB | 82/782 kB Progress (5): 22/49 kB | 26/35 kB | 23/71 kB | 16 kB | 82/782 kB Progress (5): 22/49 kB | 26/35 kB | 25/71 kB | 16 kB | 82/782 kB Progress (5): 22/49 kB | 27/35 kB | 25/71 kB | 16 kB | 82/782 kB Progress (5): 22/49 kB | 27/35 kB | 25/71 kB | 16 kB | 98/782 kB Progress (5): 22/49 kB | 29/35 kB | 25/71 kB | 16 kB | 98/782 kB Progress (5): 22/49 kB | 29/35 kB | 26/71 kB | 16 kB | 98/782 kB Progress (5): 23/49 kB | 29/35 kB | 26/71 kB | 16 kB | 98/782 kB Progress (5): 23/49 kB | 29/35 kB | 27/71 kB | 16 kB | 98/782 kB Progress (5): 23/49 kB | 30/35 kB | 27/71 kB | 16 kB | 98/782 kB Progress (5): 23/49 kB | 30/35 kB | 29/71 kB | 16 kB | 98/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 310 kB/s) 2024-09-14T11:02:23.338 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (4): 23/49 kB | 30/35 kB | 30/71 kB | 98/782 kB Progress (4): 23/49 kB | 30/35 kB | 30/71 kB | 115/782 kB Progress (4): 25/49 kB | 30/35 kB | 30/71 kB | 115/782 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-14T11:02:23.343 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (4): 26/49 kB | 30/35 kB | 30/71 kB | 115/782 kB Progress (4): 27/49 kB | 30/35 kB | 30/71 kB | 115/782 kB Progress (4): 27/49 kB | 30/35 kB | 30/71 kB | 131/782 kB Progress (4): 29/49 kB | 30/35 kB | 30/71 kB | 131/782 kB Progress (4): 30/49 kB | 30/35 kB | 30/71 kB | 131/782 kB Progress (4): 30/49 kB | 30/35 kB | 30/71 kB | 147/782 kB Progress (4): 30/49 kB | 30/35 kB | 30/71 kB | 164/782 kB Progress (4): 30/49 kB | 30/35 kB | 30/71 kB | 180/782 kB Progress (4): 30/49 kB | 30/35 kB | 30/71 kB | 197/782 kB Progress (4): 30/49 kB | 30/35 kB | 30/71 kB | 213/782 kB Progress (4): 30/49 kB | 30/35 kB | 30/71 kB | 229/782 kB Progress (4): 30/49 kB | 30/35 kB | 30/71 kB | 246/782 kB Progress (4): 30/49 kB | 30/35 kB | 30/71 kB | 262/782 kB Progress (4): 30/49 kB | 30/35 kB | 30/71 kB | 278/782 kB Progress (4): 30/49 kB | 30/35 kB | 30/71 kB | 295/782 kB Progress (4): 32/49 kB | 30/35 kB | 30/71 kB | 295/782 kB Progress (4): 32/49 kB | 32/35 kB | 30/71 kB | 295/782 kB Progress (4): 32/49 kB | 32/35 kB | 32/71 kB | 295/782 kB Progress (4): 32/49 kB | 33/35 kB | 32/71 kB | 295/782 kB Progress (4): 33/49 kB | 33/35 kB | 32/71 kB | 295/782 kB Progress (4): 33/49 kB | 33/35 kB | 32/71 kB | 311/782 kB Progress (4): 33/49 kB | 34/35 kB | 32/71 kB | 311/782 kB Progress (4): 33/49 kB | 34/35 kB | 33/71 kB | 311/782 kB Progress (4): 33/49 kB | 35 kB | 33/71 kB | 311/782 kB Progress (4): 34/49 kB | 35 kB | 33/71 kB | 311/782 kB Progress (4): 34/49 kB | 35 kB | 34/71 kB | 311/782 kB Progress (4): 36/49 kB | 35 kB | 34/71 kB | 311/782 kB Progress (4): 36/49 kB | 35 kB | 36/71 kB | 311/782 kB Progress (4): 37/49 kB | 35 kB | 36/71 kB | 311/782 kB Progress (4): 37/49 kB | 35 kB | 36/71 kB | 328/782 kB Progress (4): 38/49 kB | 35 kB | 36/71 kB | 328/782 kB Progress (4): 38/49 kB | 35 kB | 37/71 kB | 328/782 kB Progress (4): 40/49 kB | 35 kB | 37/71 kB | 328/782 kB Progress (4): 40/49 kB | 35 kB | 38/71 kB | 328/782 kB Progress (4): 41/49 kB | 35 kB | 38/71 kB | 328/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 617 kB/s) 2024-09-14T11:02:23.344 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (3): 41/49 kB | 40/71 kB | 328/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-14T11:02:23.344 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (3): 43/49 kB | 40/71 kB | 328/782 kB Progress (3): 43/49 kB | 40/71 kB | 344/782 kB Progress (3): 44/49 kB | 40/71 kB | 344/782 kB Progress (3): 44/49 kB | 41/71 kB | 344/782 kB Progress (3): 45/49 kB | 41/71 kB | 344/782 kB Progress (3): 45/49 kB | 43/71 kB | 344/782 kB Progress (3): 45/49 kB | 43/71 kB | 360/782 kB Progress (3): 45/49 kB | 44/71 kB | 360/782 kB Progress (3): 45/49 kB | 45/71 kB | 360/782 kB Progress (3): 45/49 kB | 47/71 kB | 360/782 kB Progress (3): 45/49 kB | 47/71 kB | 377/782 kB Progress (3): 45/49 kB | 48/71 kB | 377/782 kB Progress (3): 45/49 kB | 49/71 kB | 377/782 kB Progress (3): 45/49 kB | 49/71 kB | 393/782 kB Progress (3): 47/49 kB | 49/71 kB | 393/782 kB Progress (3): 48/49 kB | 49/71 kB | 393/782 kB Progress (3): 49 kB | 49/71 kB | 393/782 kB Progress (3): 49 kB | 49/71 kB | 410/782 kB Progress (3): 49 kB | 49/71 kB | 426/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 834 kB/s) 2024-09-14T11:02:23.344 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-14T11:02:23.351 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (2): 49/71 kB | 442/782 kB Progress (2): 49/71 kB | 459/782 kB Progress (2): 49/71 kB | 475/782 kB Progress (2): 49/71 kB | 491/782 kB Progress (2): 49/71 kB | 508/782 kB Progress (2): 49/71 kB | 524/782 kB Progress (2): 49/71 kB | 541/782 kB Progress (2): 49/71 kB | 557/782 kB Progress (2): 49/71 kB | 573/782 kB Progress (2): 49/71 kB | 590/782 kB Progress (2): 49/71 kB | 606/782 kB Progress (2): 49/71 kB | 623/782 kB Progress (2): 49/71 kB | 639/782 kB Progress (3): 49/71 kB | 639/782 kB | 1.4/11 kB Progress (3): 49/71 kB | 639/782 kB | 2.8/11 kB Progress (3): 49/71 kB | 655/782 kB | 2.8/11 kB Progress (3): 49/71 kB | 655/782 kB | 4.1/11 kB Progress (3): 49/71 kB | 655/782 kB | 5.5/11 kB Progress (3): 49/71 kB | 655/782 kB | 6.9/11 kB Progress (3): 49/71 kB | 655/782 kB | 8.3/11 kB Progress (3): 49/71 kB | 672/782 kB | 8.3/11 kB Progress (3): 49/71 kB | 672/782 kB | 9.7/11 kB Progress (3): 49/71 kB | 688/782 kB | 9.7/11 kB Progress (3): 49/71 kB | 688/782 kB | 11/11 kB Progress (3): 49/71 kB | 688/782 kB | 11 kB Progress (3): 49/71 kB | 704/782 kB | 11 kB Progress (3): 49/71 kB | 721/782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 172 kB/s) 2024-09-14T11:02:23.351 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-14T11:02:23.353 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (2): 49/71 kB | 737/782 kB Progress (2): 49/71 kB | 754/782 kB Progress (2): 66/71 kB | 754/782 kB Progress (2): 66/71 kB | 770/782 kB Progress (2): 71 kB | 770/782 kB Progress (2): 71 kB | 782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 12 MB/s) 2024-09-14T11:02:23.353 INFO:tasks.workunit.client.0.smithi050.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 1.0 MB/s) 2024-09-14T11:02:23.353 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-14T11:02:23.354 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-14T11:02:23.360 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.4/205 kB Progress (1): 2.8/205 kB Progress (1): 4.1/205 kB Progress (1): 5.5/205 kB Progress (1): 6.9/205 kB Progress (1): 8.3/205 kB Progress (1): 9.7/205 kB Progress (1): 11/205 kB Progress (1): 12/205 kB Progress (1): 14/205 kB Progress (1): 15/205 kB Progress (1): 16/205 kB Progress (1): 33/205 kB Progress (2): 33/205 kB | 16/30 kB Progress (2): 33/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 408 kB/s) 2024-09-14T11:02:23.360 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-14T11:02:23.369 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (2): 33/205 kB | 1.4/81 kB Progress (2): 33/205 kB | 2.8/81 kB Progress (2): 33/205 kB | 4.1/81 kB Progress (2): 33/205 kB | 5.5/81 kB Progress (2): 33/205 kB | 6.9/81 kB Progress (2): 33/205 kB | 8.3/81 kB Progress (2): 33/205 kB | 9.7/81 kB Progress (2): 33/205 kB | 11/81 kB Progress (2): 33/205 kB | 12/81 kB Progress (2): 33/205 kB | 14/81 kB Progress (2): 33/205 kB | 15/81 kB Progress (2): 33/205 kB | 16/81 kB Progress (2): 49/205 kB | 16/81 kB Progress (3): 49/205 kB | 16/81 kB | 16/798 kB Progress (4): 49/205 kB | 16/81 kB | 16/798 kB | 13 kB Progress (4): 49/205 kB | 16/81 kB | 33/798 kB | 13 kB Progress (4): 66/205 kB | 16/81 kB | 33/798 kB | 13 kB Progress (4): 66/205 kB | 16/81 kB | 49/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 161 kB/s) 2024-09-14T11:02:23.369 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-14T11:02:23.393 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (3): 66/205 kB | 16/81 kB | 66/798 kB Progress (3): 66/205 kB | 16/81 kB | 82/798 kB Progress (3): 66/205 kB | 16/81 kB | 98/798 kB Progress (3): 82/205 kB | 16/81 kB | 98/798 kB Progress (3): 82/205 kB | 16/81 kB | 111/798 kB Progress (3): 82/205 kB | 16/81 kB | 128/798 kB Progress (3): 82/205 kB | 16/81 kB | 144/798 kB Progress (3): 98/205 kB | 16/81 kB | 144/798 kB Progress (3): 98/205 kB | 16/81 kB | 160/798 kB Progress (3): 98/205 kB | 16/81 kB | 177/798 kB Progress (3): 98/205 kB | 16/81 kB | 193/798 kB Progress (3): 114/205 kB | 16/81 kB | 193/798 kB Progress (3): 131/205 kB | 16/81 kB | 193/798 kB Progress (3): 131/205 kB | 16/81 kB | 209/798 kB Progress (3): 131/205 kB | 16/81 kB | 226/798 kB Progress (3): 131/205 kB | 16/81 kB | 242/798 kB Progress (3): 131/205 kB | 16/81 kB | 259/798 kB Progress (3): 131/205 kB | 16/81 kB | 275/798 kB Progress (3): 131/205 kB | 16/81 kB | 291/798 kB Progress (3): 131/205 kB | 16/81 kB | 308/798 kB Progress (4): 131/205 kB | 16/81 kB | 308/798 kB | 16/182 kB Progress (4): 131/205 kB | 16/81 kB | 324/798 kB | 16/182 kB Progress (4): 131/205 kB | 16/81 kB | 341/798 kB | 16/182 kB Progress (4): 131/205 kB | 16/81 kB | 357/798 kB | 16/182 kB Progress (4): 131/205 kB | 16/81 kB | 373/798 kB | 16/182 kB Progress (4): 131/205 kB | 16/81 kB | 373/798 kB | 33/182 kB Progress (4): 131/205 kB | 16/81 kB | 390/798 kB | 33/182 kB Progress (4): 131/205 kB | 16/81 kB | 406/798 kB | 33/182 kB Progress (4): 131/205 kB | 16/81 kB | 422/798 kB | 33/182 kB Progress (4): 131/205 kB | 33/81 kB | 422/798 kB | 33/182 kB Progress (4): 131/205 kB | 33/81 kB | 422/798 kB | 49/182 kB Progress (4): 131/205 kB | 33/81 kB | 439/798 kB | 49/182 kB Progress (4): 131/205 kB | 33/81 kB | 455/798 kB | 49/182 kB Progress (4): 131/205 kB | 33/81 kB | 472/798 kB | 49/182 kB Progress (4): 131/205 kB | 33/81 kB | 488/798 kB | 49/182 kB Progress (4): 131/205 kB | 49/81 kB | 488/798 kB | 49/182 kB Progress (4): 131/205 kB | 49/81 kB | 504/798 kB | 49/182 kB Progress (4): 147/205 kB | 49/81 kB | 504/798 kB | 49/182 kB Progress (4): 147/205 kB | 49/81 kB | 521/798 kB | 49/182 kB Progress (4): 147/205 kB | 66/81 kB | 521/798 kB | 49/182 kB Progress (4): 147/205 kB | 66/81 kB | 521/798 kB | 62/182 kB Progress (4): 147/205 kB | 66/81 kB | 537/798 kB | 62/182 kB Progress (4): 147/205 kB | 81 kB | 537/798 kB | 62/182 kB Progress (4): 147/205 kB | 81 kB | 537/798 kB | 78/182 kB Progress (4): 147/205 kB | 81 kB | 554/798 kB | 78/182 kB Progress (4): 147/205 kB | 81 kB | 554/798 kB | 94/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 767 kB/s) 2024-09-14T11:02:23.393 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (3): 163/205 kB | 554/798 kB | 94/182 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-14T11:02:23.397 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (3): 163/205 kB | 570/798 kB | 94/182 kB Progress (3): 180/205 kB | 570/798 kB | 94/182 kB Progress (3): 180/205 kB | 586/798 kB | 94/182 kB Progress (4): 180/205 kB | 586/798 kB | 94/182 kB | 16/151 kB Progress (4): 196/205 kB | 586/798 kB | 94/182 kB | 16/151 kB Progress (4): 196/205 kB | 603/798 kB | 94/182 kB | 16/151 kB Progress (4): 196/205 kB | 603/798 kB | 111/182 kB | 16/151 kB Progress (4): 205 kB | 603/798 kB | 111/182 kB | 16/151 kB Progress (4): 205 kB | 603/798 kB | 111/182 kB | 33/151 kB Progress (4): 205 kB | 619/798 kB | 111/182 kB | 33/151 kB Progress (4): 205 kB | 619/798 kB | 127/182 kB | 33/151 kB Progress (4): 205 kB | 619/798 kB | 127/182 kB | 49/151 kB Progress (4): 205 kB | 635/798 kB | 127/182 kB | 49/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 1.9 MB/s) 2024-09-14T11:02:23.397 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (3): 635/798 kB | 143/182 kB | 49/151 kB Progress (3): 635/798 kB | 143/182 kB | 62/151 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-14T11:02:23.397 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (3): 652/798 kB | 143/182 kB | 62/151 kB Progress (3): 652/798 kB | 160/182 kB | 62/151 kB Progress (3): 668/798 kB | 160/182 kB | 62/151 kB Progress (3): 668/798 kB | 160/182 kB | 79/151 kB Progress (3): 668/798 kB | 176/182 kB | 79/151 kB Progress (3): 685/798 kB | 176/182 kB | 79/151 kB Progress (3): 685/798 kB | 182 kB | 79/151 kB Progress (3): 701/798 kB | 182 kB | 79/151 kB Progress (3): 701/798 kB | 182 kB | 95/151 kB Progress (3): 701/798 kB | 182 kB | 99/151 kB Progress (3): 717/798 kB | 182 kB | 99/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.7 MB/s) 2024-09-14T11:02:23.397 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-14T11:02:23.398 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (2): 734/798 kB | 99/151 kB Progress (2): 750/798 kB | 99/151 kB Progress (2): 766/798 kB | 99/151 kB Progress (2): 766/798 kB | 116/151 kB Progress (2): 783/798 kB | 116/151 kB Progress (2): 798 kB | 116/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 7.1 MB/s) 2024-09-14T11:02:23.398 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 132/151 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-14T11:02:23.399 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 144/151 kB Progress (1): 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.3 MB/s) 2024-09-14T11:02:23.399 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-14T11:02:23.408 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 225 kB/s) 2024-09-14T11:02:23.408 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-14T11:02:23.409 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 15/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 246 kB/s) 2024-09-14T11:02:23.409 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-14T11:02:23.412 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/385 kB Progress (1): 33/385 kB Progress (1): 49/385 kB Progress (1): 66/385 kB Progress (1): 82/385 kB Progress (2): 82/385 kB | 13 kB Progress (2): 98/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 104 kB/s) 2024-09-14T11:02:23.412 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-14T11:02:23.415 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 114/385 kB Progress (1): 131/385 kB Progress (2): 131/385 kB | 16/75 kB Progress (2): 147/385 kB | 16/75 kB Progress (2): 147/385 kB | 33/75 kB Progress (2): 164/385 kB | 33/75 kB Progress (2): 164/385 kB | 49/75 kB Progress (2): 164/385 kB | 61/75 kB Progress (2): 180/385 kB | 61/75 kB Progress (2): 180/385 kB | 75 kB Progress (2): 196/385 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 587 kB/s) 2024-09-14T11:02:23.415 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 213/385 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-14T11:02:23.425 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 229/385 kB Progress (1): 245/385 kB Progress (2): 245/385 kB | 16/780 kB Progress (2): 262/385 kB | 16/780 kB Progress (2): 262/385 kB | 33/780 kB Progress (2): 278/385 kB | 33/780 kB Progress (2): 295/385 kB | 33/780 kB Progress (2): 295/385 kB | 49/780 kB Progress (2): 311/385 kB | 49/780 kB Progress (2): 311/385 kB | 62/780 kB Progress (2): 327/385 kB | 62/780 kB Progress (3): 327/385 kB | 62/780 kB | 16/329 kB Progress (3): 344/385 kB | 62/780 kB | 16/329 kB Progress (3): 344/385 kB | 62/780 kB | 33/329 kB Progress (3): 344/385 kB | 79/780 kB | 33/329 kB Progress (3): 360/385 kB | 79/780 kB | 33/329 kB Progress (3): 360/385 kB | 79/780 kB | 49/329 kB Progress (3): 376/385 kB | 79/780 kB | 49/329 kB Progress (3): 376/385 kB | 79/780 kB | 58/329 kB Progress (3): 376/385 kB | 79/780 kB | 62/329 kB Progress (3): 385 kB | 79/780 kB | 62/329 kB Progress (3): 385 kB | 95/780 kB | 62/329 kB Progress (3): 385 kB | 95/780 kB | 78/329 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.8 MB/s) 2024-09-14T11:02:23.425 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (2): 95/780 kB | 95/329 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-14T11:02:23.436 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (2): 111/780 kB | 95/329 kB Progress (2): 111/780 kB | 111/329 kB Progress (3): 111/780 kB | 111/329 kB | 16/501 kB Progress (3): 111/780 kB | 127/329 kB | 16/501 kB Progress (3): 111/780 kB | 127/329 kB | 33/501 kB Progress (3): 111/780 kB | 144/329 kB | 33/501 kB Progress (3): 111/780 kB | 144/329 kB | 49/501 kB Progress (3): 111/780 kB | 160/329 kB | 49/501 kB Progress (3): 111/780 kB | 160/329 kB | 66/501 kB Progress (3): 111/780 kB | 176/329 kB | 66/501 kB Progress (3): 111/780 kB | 176/329 kB | 82/501 kB Progress (3): 111/780 kB | 181/329 kB | 82/501 kB Progress (3): 111/780 kB | 193/329 kB | 82/501 kB Progress (3): 111/780 kB | 193/329 kB | 98/501 kB Progress (3): 111/780 kB | 209/329 kB | 98/501 kB Progress (3): 111/780 kB | 209/329 kB | 115/501 kB Progress (3): 111/780 kB | 226/329 kB | 115/501 kB Progress (3): 111/780 kB | 226/329 kB | 131/501 kB Progress (3): 111/780 kB | 242/329 kB | 131/501 kB Progress (3): 111/780 kB | 258/329 kB | 131/501 kB Progress (4): 111/780 kB | 258/329 kB | 131/501 kB | 16/354 kB Progress (4): 111/780 kB | 258/329 kB | 147/501 kB | 16/354 kB Progress (4): 111/780 kB | 275/329 kB | 147/501 kB | 16/354 kB Progress (4): 111/780 kB | 275/329 kB | 147/501 kB | 33/354 kB Progress (4): 111/780 kB | 275/329 kB | 164/501 kB | 33/354 kB Progress (4): 111/780 kB | 275/329 kB | 164/501 kB | 49/354 kB Progress (4): 111/780 kB | 275/329 kB | 180/501 kB | 49/354 kB Progress (4): 111/780 kB | 275/329 kB | 180/501 kB | 66/354 kB Progress (4): 111/780 kB | 275/329 kB | 197/501 kB | 66/354 kB Progress (4): 111/780 kB | 275/329 kB | 197/501 kB | 78/354 kB Progress (4): 111/780 kB | 275/329 kB | 213/501 kB | 78/354 kB Progress (4): 111/780 kB | 275/329 kB | 213/501 kB | 94/354 kB Progress (4): 111/780 kB | 275/329 kB | 229/501 kB | 94/354 kB Progress (4): 111/780 kB | 275/329 kB | 229/501 kB | 111/354 kB Progress (4): 111/780 kB | 275/329 kB | 246/501 kB | 111/354 kB Progress (4): 111/780 kB | 275/329 kB | 246/501 kB | 127/354 kB Progress (4): 111/780 kB | 275/329 kB | 262/501 kB | 127/354 kB Progress (4): 111/780 kB | 275/329 kB | 262/501 kB | 143/354 kB Progress (4): 111/780 kB | 275/329 kB | 279/501 kB | 143/354 kB Progress (4): 111/780 kB | 275/329 kB | 279/501 kB | 160/354 kB Progress (4): 111/780 kB | 275/329 kB | 295/501 kB | 160/354 kB Progress (4): 111/780 kB | 275/329 kB | 295/501 kB | 176/354 kB Progress (4): 111/780 kB | 275/329 kB | 311/501 kB | 176/354 kB Progress (4): 128/780 kB | 275/329 kB | 311/501 kB | 176/354 kB Progress (4): 128/780 kB | 275/329 kB | 311/501 kB | 193/354 kB Progress (4): 128/780 kB | 275/329 kB | 328/501 kB | 193/354 kB Progress (4): 144/780 kB | 275/329 kB | 328/501 kB | 193/354 kB Progress (4): 144/780 kB | 275/329 kB | 328/501 kB | 209/354 kB Progress (4): 161/780 kB | 275/329 kB | 328/501 kB | 209/354 kB Progress (4): 161/780 kB | 275/329 kB | 344/501 kB | 209/354 kB Progress (4): 161/780 kB | 275/329 kB | 360/501 kB | 209/354 kB Progress (4): 177/780 kB | 275/329 kB | 360/501 kB | 209/354 kB Progress (4): 177/780 kB | 275/329 kB | 377/501 kB | 209/354 kB Progress (4): 177/780 kB | 275/329 kB | 393/501 kB | 209/354 kB Progress (4): 177/780 kB | 275/329 kB | 410/501 kB | 209/354 kB Progress (4): 177/780 kB | 275/329 kB | 426/501 kB | 209/354 kB Progress (4): 177/780 kB | 291/329 kB | 426/501 kB | 209/354 kB Progress (4): 193/780 kB | 291/329 kB | 426/501 kB | 209/354 kB Progress (4): 193/780 kB | 291/329 kB | 442/501 kB | 209/354 kB Progress (4): 193/780 kB | 303/329 kB | 442/501 kB | 209/354 kB Progress (4): 193/780 kB | 303/329 kB | 459/501 kB | 209/354 kB Progress (4): 193/780 kB | 320/329 kB | 459/501 kB | 209/354 kB Progress (4): 210/780 kB | 320/329 kB | 459/501 kB | 209/354 kB Progress (4): 210/780 kB | 324/329 kB | 459/501 kB | 209/354 kB Progress (4): 210/780 kB | 324/329 kB | 475/501 kB | 209/354 kB Progress (4): 210/780 kB | 329 kB | 475/501 kB | 209/354 kB Progress (4): 210/780 kB | 329 kB | 492/501 kB | 209/354 kB Progress (4): 226/780 kB | 329 kB | 492/501 kB | 209/354 kB Progress (4): 226/780 kB | 329 kB | 501 kB | 209/354 kB Progress (4): 242/780 kB | 329 kB | 501 kB | 209/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.2 MB/s) 2024-09-14T11:02:23.437 INFO:tasks.workunit.client.0.smithi050.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.4 MB/s) 2024-09-14T11:02:23.437 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-14T11:02:23.437 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-14T11:02:23.440 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (2): 259/780 kB | 209/354 kB Progress (2): 275/780 kB | 209/354 kB Progress (2): 292/780 kB | 209/354 kB Progress (2): 308/780 kB | 209/354 kB Progress (3): 308/780 kB | 209/354 kB | 15/41 kB Progress (3): 308/780 kB | 209/354 kB | 31/41 kB Progress (3): 308/780 kB | 225/354 kB | 31/41 kB Progress (3): 308/780 kB | 225/354 kB | 41 kB Progress (3): 308/780 kB | 242/354 kB | 41 kB Progress (3): 308/780 kB | 258/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 269 kB/s) 2024-09-14T11:02:23.441 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-14T11:02:23.442 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (2): 308/780 kB | 274/354 kB Progress (2): 308/780 kB | 291/354 kB Progress (2): 308/780 kB | 307/354 kB Progress (2): 308/780 kB | 324/354 kB Progress (2): 308/780 kB | 340/354 kB Progress (2): 308/780 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.3 MB/s) 2024-09-14T11:02:23.442 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-14T11:02:23.451 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 324/780 kB Progress (1): 341/780 kB Progress (1): 357/780 kB Progress (1): 374/780 kB Progress (1): 390/780 kB Progress (1): 406/780 kB Progress (1): 423/780 kB Progress (1): 439/780 kB Progress (1): 455/780 kB Progress (1): 472/780 kB Progress (1): 488/780 kB Progress (1): 505/780 kB Progress (1): 521/780 kB Progress (1): 537/780 kB Progress (1): 554/780 kB Progress (1): 570/780 kB Progress (1): 587/780 kB Progress (1): 603/780 kB Progress (1): 619/780 kB Progress (1): 636/780 kB Progress (1): 652/780 kB Progress (1): 668/780 kB Progress (2): 668/780 kB | 6.4 kB Progress (2): 685/780 kB | 6.4 kB Progress (2): 701/780 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 39 kB/s) 2024-09-14T11:02:23.451 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-14T11:02:23.457 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 718/780 kB Progress (2): 718/780 kB | 16/586 kB Progress (2): 734/780 kB | 16/586 kB Progress (2): 734/780 kB | 33/586 kB Progress (2): 750/780 kB | 33/586 kB Progress (2): 750/780 kB | 49/586 kB Progress (2): 767/780 kB | 49/586 kB Progress (2): 767/780 kB | 62/586 kB Progress (2): 767/780 kB | 78/586 kB Progress (2): 767/780 kB | 95/586 kB Progress (2): 767/780 kB | 111/586 kB Progress (2): 767/780 kB | 127/586 kB Progress (2): 767/780 kB | 144/586 kB Progress (2): 767/780 kB | 160/586 kB Progress (2): 767/780 kB | 176/586 kB Progress (2): 767/780 kB | 193/586 kB Progress (2): 767/780 kB | 209/586 kB Progress (2): 767/780 kB | 226/586 kB Progress (2): 767/780 kB | 242/586 kB Progress (2): 767/780 kB | 250/586 kB Progress (2): 767/780 kB | 267/586 kB Progress (3): 767/780 kB | 267/586 kB | 16/211 kB Progress (3): 767/780 kB | 283/586 kB | 16/211 kB Progress (3): 767/780 kB | 291/586 kB | 16/211 kB Progress (3): 767/780 kB | 291/586 kB | 33/211 kB Progress (3): 780 kB | 291/586 kB | 33/211 kB Progress (3): 780 kB | 308/586 kB | 33/211 kB Progress (4): 780 kB | 308/586 kB | 33/211 kB | 14 kB Progress (4): 780 kB | 308/586 kB | 49/211 kB | 14 kB Progress (4): 780 kB | 324/586 kB | 49/211 kB | 14 kB Progress (4): 780 kB | 324/586 kB | 66/211 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 85 kB/s) 2024-09-14T11:02:23.457 INFO:tasks.workunit.client.0.smithi050.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.6 MB/s) 2024-09-14T11:02:23.457 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-14T11:02:23.457 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-14T11:02:23.460 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (2): 340/586 kB | 66/211 kB Progress (2): 340/586 kB | 81/211 kB Progress (2): 357/586 kB | 81/211 kB Progress (2): 357/586 kB | 98/211 kB Progress (2): 373/586 kB | 98/211 kB Progress (2): 373/586 kB | 114/211 kB Progress (2): 389/586 kB | 114/211 kB Progress (2): 389/586 kB | 131/211 kB Progress (2): 406/586 kB | 131/211 kB Progress (2): 406/586 kB | 147/211 kB Progress (2): 422/586 kB | 147/211 kB Progress (2): 422/586 kB | 163/211 kB Progress (2): 439/586 kB | 163/211 kB Progress (2): 439/586 kB | 180/211 kB Progress (2): 455/586 kB | 180/211 kB Progress (2): 455/586 kB | 196/211 kB Progress (2): 471/586 kB | 196/211 kB Progress (2): 471/586 kB | 211 kB Progress (2): 488/586 kB | 211 kB Progress (2): 504/586 kB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.2 MB/s) 2024-09-14T11:02:23.461 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-14T11:02:23.462 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 521/586 kB Progress (1): 537/586 kB Progress (1): 553/586 kB Progress (1): 570/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.3 MB/s) 2024-09-14T11:02:23.462 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-14T11:02:23.466 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 15/106 kB Progress (1): 31/106 kB Progress (1): 48/106 kB Progress (1): 64/106 kB Progress (1): 81/106 kB Progress (1): 94/106 kB Progress (1): 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 594 kB/s) 2024-09-14T11:02:23.467 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:02:23.470 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 37 kB/s) 2024-09-14T11:02:23.470 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-14T11:02:23.476 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 63/245 kB Progress (1): 79/245 kB Progress (1): 95/245 kB Progress (1): 112/245 kB Progress (1): 128/245 kB Progress (1): 145/245 kB Progress (1): 161/245 kB Progress (1): 177/245 kB Progress (2): 177/245 kB | 16/205 kB Progress (2): 194/245 kB | 16/205 kB Progress (2): 194/245 kB | 31/205 kB Progress (2): 210/245 kB | 31/205 kB Progress (2): 210/245 kB | 48/205 kB Progress (2): 210/245 kB | 64/205 kB Progress (2): 226/245 kB | 64/205 kB Progress (2): 226/245 kB | 81/205 kB Progress (2): 226/245 kB | 97/205 kB Progress (2): 243/245 kB | 97/205 kB Progress (2): 245 kB | 97/205 kB Progress (2): 245 kB | 113/205 kB Progress (2): 245 kB | 130/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.3 MB/s) 2024-09-14T11:02:23.476 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-14T11:02:23.477 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (2): 130/205 kB | 15 kB Progress (2): 146/205 kB | 15 kB Progress (2): 162/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 81 kB/s) 2024-09-14T11:02:23.477 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-14T11:02:23.478 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 179/205 kB Progress (1): 195/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.1 MB/s) 2024-09-14T11:02:23.479 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-14T11:02:23.480 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 85 kB/s) 2024-09-14T11:02:23.480 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-14T11:02:23.484 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 32 kB/s) 2024-09-14T11:02:23.491 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Progress (2): 23 kB | 16/24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 111 kB/s) 2024-09-14T11:02:23.492 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 118 kB/s) 2024-09-14T11:02:23.493 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 85 kB/s) 2024-09-14T11:02:23.497 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 65/184 kB Progress (1): 81/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 147/184 kB Progress (1): 163/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 875 kB/s) 2024-09-14T11:02:23.520 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] 2024-09-14T11:02:23.520 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-14T11:02:23.526 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-14T11:02:23.542 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 364 kB/s) 2024-09-14T11:02:23.545 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-14T11:02:23.560 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 318 kB/s) 2024-09-14T11:02:23.562 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-14T11:02:23.577 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 3.1 MB/s) 2024-09-14T11:02:23.582 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-14T11:02:23.596 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 1.0 MB/s) 2024-09-14T11:02:23.603 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-14T11:02:23.619 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 62/153 kB Progress (1): 78/153 kB Progress (1): 95/153 kB Progress (1): 111/153 kB Progress (1): 127/153 kB Progress (1): 144/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 9.6 MB/s) 2024-09-14T11:02:23.619 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-14T11:02:23.637 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/215 kB Progress (1): 32/215 kB Progress (1): 49/215 kB Progress (1): 65/215 kB Progress (1): 81/215 kB Progress (1): 98/215 kB Progress (1): 114/215 kB Progress (1): 131/215 kB Progress (1): 147/215 kB Progress (1): 163/215 kB Progress (1): 180/215 kB Progress (1): 196/215 kB Progress (1): 212/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 11 MB/s) 2024-09-14T11:02:23.685 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] 2024-09-14T11:02:23.685 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T11:02:23.688 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-14T11:02:23.702 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 190 kB/s) 2024-09-14T11:02:23.704 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-14T11:02:23.718 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.6 MB/s) 2024-09-14T11:02:23.721 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-14T11:02:23.737 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 626 kB/s) 2024-09-14T11:02:23.738 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-14T11:02:23.752 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.8 MB/s) 2024-09-14T11:02:23.756 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-14T11:02:23.769 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 431 kB/s) 2024-09-14T11:02:23.771 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-14T11:02:23.785 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 230 kB/s) 2024-09-14T11:02:23.789 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-14T11:02:23.803 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 44 kB/s) 2024-09-14T11:02:23.805 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-14T11:02:23.818 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-14T11:02:23.820 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-14T11:02:23.833 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.0 MB/s) 2024-09-14T11:02:23.835 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-14T11:02:23.849 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 229 kB/s) 2024-09-14T11:02:23.851 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-14T11:02:23.865 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 597 kB/s) 2024-09-14T11:02:23.867 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-14T11:02:23.881 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 597 kB/s) 2024-09-14T11:02:23.884 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-14T11:02:23.898 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 616 kB/s) 2024-09-14T11:02:23.902 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-14T11:02:23.916 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.4 MB/s) 2024-09-14T11:02:23.921 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-14T11:02:23.936 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 340 kB/s) 2024-09-14T11:02:23.939 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-14T11:02:23.953 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.2 MB/s) 2024-09-14T11:02:23.959 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-14T11:02:23.972 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 364 kB/s) 2024-09-14T11:02:23.977 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-14T11:02:23.992 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.7 MB/s) 2024-09-14T11:02:23.992 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-14T11:02:23.992 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-14T11:02:23.992 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-14T11:02:23.992 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-14T11:02:23.993 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-14T11:02:24.007 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 16/55 kB Progress (3): 2.5 kB | 16/55 kB | 16/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 178 kB/s) 2024-09-14T11:02:24.007 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-14T11:02:24.007 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (2): 33/55 kB | 16/41 kB Progress (2): 33/55 kB | 33/41 kB Progress (3): 33/55 kB | 33/41 kB | 16/269 kB Progress (3): 33/55 kB | 41 kB | 16/269 kB Progress (3): 49/55 kB | 41 kB | 16/269 kB Progress (3): 49/55 kB | 41 kB | 33/269 kB Progress (3): 55 kB | 41 kB | 33/269 kB Progress (4): 55 kB | 41 kB | 33/269 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.7 MB/s) 2024-09-14T11:02:24.007 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (3): 55 kB | 49/269 kB | 8.5 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-14T11:02:24.007 INFO:tasks.workunit.client.0.smithi050.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.7 MB/s) 2024-09-14T11:02:24.007 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (2): 65/269 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 565 kB/s) 2024-09-14T11:02:24.010 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 82/269 kB Progress (1): 98/269 kB Progress (1): 114/269 kB Progress (1): 131/269 kB Progress (1): 147/269 kB Progress (1): 163/269 kB Progress (1): 180/269 kB Progress (1): 196/269 kB Progress (1): 213/269 kB Progress (1): 229/269 kB Progress (1): 245/269 kB Progress (1): 262/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 15 MB/s) 2024-09-14T11:02:24.024 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/327 kB Progress (1): 33/327 kB Progress (1): 49/327 kB Progress (1): 65/327 kB Progress (1): 81/327 kB Progress (1): 98/327 kB Progress (1): 114/327 kB Progress (1): 130/327 kB Progress (1): 147/327 kB Progress (1): 163/327 kB Progress (1): 179/327 kB Progress (2): 179/327 kB | 16/587 kB Progress (2): 196/327 kB | 16/587 kB Progress (2): 196/327 kB | 32/587 kB Progress (2): 212/327 kB | 32/587 kB Progress (2): 212/327 kB | 49/587 kB Progress (2): 229/327 kB | 49/587 kB Progress (2): 229/327 kB | 65/587 kB Progress (2): 245/327 kB | 65/587 kB Progress (2): 245/327 kB | 81/587 kB Progress (2): 261/327 kB | 81/587 kB Progress (2): 261/327 kB | 98/587 kB Progress (2): 278/327 kB | 98/587 kB Progress (2): 278/327 kB | 114/587 kB Progress (2): 294/327 kB | 114/587 kB Progress (2): 294/327 kB | 130/587 kB Progress (2): 311/327 kB | 130/587 kB Progress (2): 311/327 kB | 147/587 kB Progress (2): 327/327 kB | 147/587 kB Progress (2): 327 kB | 147/587 kB Progress (2): 327 kB | 163/587 kB Progress (2): 327 kB | 180/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 11 MB/s) 2024-09-14T11:02:24.033 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 196/587 kB Progress (1): 212/587 kB Progress (1): 219/587 kB Progress (1): 236/587 kB Progress (1): 252/587 kB Progress (1): 268/587 kB Progress (1): 285/587 kB Progress (1): 301/587 kB Progress (1): 318/587 kB Progress (1): 334/587 kB Progress (1): 350/587 kB Progress (1): 367/587 kB Progress (1): 383/587 kB Progress (1): 399/587 kB Progress (1): 416/587 kB Progress (1): 432/587 kB Progress (1): 449/587 kB Progress (1): 465/587 kB Progress (1): 475/587 kB Progress (1): 491/587 kB Progress (1): 508/587 kB Progress (1): 524/587 kB Progress (1): 541/587 kB Progress (1): 557/587 kB Progress (1): 573/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 14 MB/s) 2024-09-14T11:02:24.064 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T11:02:24.064 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] 2024-09-14T11:02:24.064 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T11:02:24.068 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-14T11:02:24.082 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 316 kB/s) 2024-09-14T11:02:24.084 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-14T11:02:24.101 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 374 kB/s) 2024-09-14T11:02:24.102 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-14T11:02:24.116 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-14T11:02:24.118 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-14T11:02:24.132 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 998 kB/s) 2024-09-14T11:02:24.135 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-14T11:02:24.149 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 58 kB/s) 2024-09-14T11:02:24.150 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-14T11:02:24.164 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 303 kB/s) 2024-09-14T11:02:24.165 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-14T11:02:24.179 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-14T11:02:24.182 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-14T11:02:24.197 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 355 kB/s) 2024-09-14T11:02:24.198 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-14T11:02:24.212 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 319 kB/s) 2024-09-14T11:02:24.214 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-14T11:02:24.228 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 169 kB/s) 2024-09-14T11:02:24.230 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-14T11:02:24.245 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 806 kB/s) 2024-09-14T11:02:24.246 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-14T11:02:24.260 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.2 MB/s) 2024-09-14T11:02:24.262 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-14T11:02:24.276 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 469 kB/s) 2024-09-14T11:02:24.278 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-14T11:02:24.293 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 76 kB/s) 2024-09-14T11:02:24.294 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-14T11:02:24.308 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 8.2/8.4 kB Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 599 kB/s) 2024-09-14T11:02:24.310 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-14T11:02:24.324 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 191 kB/s) 2024-09-14T11:02:24.327 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-14T11:02:24.341 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 402 kB/s) 2024-09-14T11:02:24.343 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-14T11:02:24.357 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 81 kB/s) 2024-09-14T11:02:24.360 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-14T11:02:24.374 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 55 kB/s) 2024-09-14T11:02:24.376 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-14T11:02:24.390 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 2.7/6.0 kB Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 402 kB/s) 2024-09-14T11:02:24.392 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-14T11:02:24.406 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.8 MB/s) 2024-09-14T11:02:24.408 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-14T11:02:24.422 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 86 kB/s) 2024-09-14T11:02:24.424 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-14T11:02:24.438 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 94 kB/s) 2024-09-14T11:02:24.444 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-14T11:02:24.458 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 967 kB/s) 2024-09-14T11:02:24.459 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-14T11:02:24.459 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-14T11:02:24.459 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-14T11:02:24.459 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-14T11:02:24.459 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-14T11:02:24.478 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/27 kB Progress (3): 4.2 kB | 16/27 kB | 16/55 kB Progress (4): 4.2 kB | 16/27 kB | 16/55 kB | 16/122 kB Progress (4): 4.2 kB | 27 kB | 16/55 kB | 16/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 301 kB/s) 2024-09-14T11:02:24.478 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (4): 27 kB | 16/55 kB | 16/122 kB | 16/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-14T11:02:24.479 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (4): 27 kB | 33/55 kB | 16/122 kB | 16/334 kB Progress (4): 27 kB | 33/55 kB | 33/122 kB | 16/334 kB Progress (4): 27 kB | 33/55 kB | 33/122 kB | 33/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.8 MB/s) 2024-09-14T11:02:24.479 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-14T11:02:24.479 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (3): 49/55 kB | 33/122 kB | 33/334 kB Progress (3): 49/55 kB | 33/122 kB | 49/334 kB Progress (3): 49/55 kB | 49/122 kB | 49/334 kB Progress (3): 55 kB | 49/122 kB | 49/334 kB Progress (3): 55 kB | 49/122 kB | 65/334 kB Progress (3): 55 kB | 64/122 kB | 65/334 kB Progress (3): 55 kB | 64/122 kB | 81/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.6 MB/s) 2024-09-14T11:02:24.479 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-14T11:02:24.479 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (2): 80/122 kB | 81/334 kB Progress (2): 80/122 kB | 98/334 kB Progress (2): 96/122 kB | 98/334 kB Progress (2): 96/122 kB | 114/334 kB Progress (2): 113/122 kB | 114/334 kB Progress (2): 113/122 kB | 130/334 kB Progress (2): 122 kB | 130/334 kB Progress (2): 122 kB | 147/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 7.2 MB/s) 2024-09-14T11:02:24.479 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 163/334 kB Progress (1): 180/334 kB Progress (1): 196/334 kB Progress (1): 212/334 kB Progress (1): 229/334 kB Progress (1): 245/334 kB Progress (1): 261/334 kB Progress (1): 278/334 kB Progress (1): 294/334 kB Progress (1): 311/334 kB Progress (1): 327/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 17 MB/s) 2024-09-14T11:02:24.488 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/267 kB Progress (2): 16/267 kB | 4.7 kB Progress (2): 33/267 kB | 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 172 kB/s) 2024-09-14T11:02:24.489 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 49/267 kB Progress (2): 49/267 kB | 15/23 kB Progress (2): 66/267 kB | 15/23 kB Progress (2): 66/267 kB | 23 kB Progress (2): 80/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 814 kB/s) 2024-09-14T11:02:24.490 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 96/267 kB Progress (1): 112/267 kB Progress (1): 129/267 kB Progress (1): 145/267 kB Progress (1): 162/267 kB Progress (1): 178/267 kB Progress (1): 194/267 kB Progress (1): 211/267 kB Progress (1): 227/267 kB Progress (1): 244/267 kB Progress (1): 260/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.6 MB/s) 2024-09-14T11:02:24.547 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-14T11:02:24.547 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-14T11:02:25.202 INFO:tasks.workunit.client.0.smithi050.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T11:02:25.202 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] 2024-09-14T11:02:25.203 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T11:02:25.206 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T11:02:25.206 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] 2024-09-14T11:02:25.206 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T11:02:25.211 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-14T11:02:25.211 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-14T11:02:25.380 INFO:tasks.workunit.client.0.smithi050.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T11:02:25.381 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] 2024-09-14T11:02:25.381 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T11:02:25.382 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-14T11:02:25.395 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 446 kB/s) 2024-09-14T11:02:25.398 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-14T11:02:25.413 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 252 kB/s) 2024-09-14T11:02:25.415 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-14T11:02:25.429 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 233 kB/s) 2024-09-14T11:02:25.433 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-14T11:02:25.447 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 271 kB/s) 2024-09-14T11:02:25.450 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-14T11:02:25.464 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 236 kB/s) 2024-09-14T11:02:25.467 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-14T11:02:25.481 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 318 kB/s) 2024-09-14T11:02:25.484 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-14T11:02:25.498 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 126 kB/s) 2024-09-14T11:02:25.501 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-14T11:02:25.515 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 169 kB/s) 2024-09-14T11:02:25.516 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-14T11:02:25.532 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.0 MB/s) 2024-09-14T11:02:25.534 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-14T11:02:25.548 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 135 kB/s) 2024-09-14T11:02:25.551 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-14T11:02:25.565 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-14T11:02:25.568 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-14T11:02:25.585 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 168 kB/s) 2024-09-14T11:02:25.585 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-14T11:02:25.598 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.5 MB/s) 2024-09-14T11:02:25.600 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-14T11:02:25.615 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.7 MB/s) 2024-09-14T11:02:25.617 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-14T11:02:25.631 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.2 MB/s) 2024-09-14T11:02:25.633 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-14T11:02:25.647 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-14T11:02:25.649 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-14T11:02:25.663 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 2.0 MB/s) 2024-09-14T11:02:25.665 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-14T11:02:25.680 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 576 kB/s) 2024-09-14T11:02:25.682 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-14T11:02:25.697 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 155 kB/s) 2024-09-14T11:02:25.699 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-14T11:02:25.713 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 185 kB/s) 2024-09-14T11:02:25.716 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-14T11:02:25.729 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 110 kB/s) 2024-09-14T11:02:25.730 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-14T11:02:25.744 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-14T11:02:25.746 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-14T11:02:25.759 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.5 MB/s) 2024-09-14T11:02:25.761 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-14T11:02:25.775 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 483 kB/s) 2024-09-14T11:02:25.777 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-14T11:02:25.791 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 969 kB/s) 2024-09-14T11:02:25.793 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-14T11:02:25.807 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 212 kB/s) 2024-09-14T11:02:25.808 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-14T11:02:25.821 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 523 kB/s) 2024-09-14T11:02:25.822 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-14T11:02:25.836 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 600 kB/s) 2024-09-14T11:02:25.838 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-14T11:02:25.852 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 159 kB/s) 2024-09-14T11:02:25.854 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-14T11:02:25.868 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 159 kB/s) 2024-09-14T11:02:25.871 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-14T11:02:25.885 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 216 kB/s) 2024-09-14T11:02:25.888 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-14T11:02:25.903 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-14T11:02:25.905 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-14T11:02:25.919 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 1.0 MB/s) 2024-09-14T11:02:25.921 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-14T11:02:25.936 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 959 kB/s) 2024-09-14T11:02:25.937 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-14T11:02:25.951 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 368 kB/s) 2024-09-14T11:02:25.952 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-14T11:02:25.967 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 448 kB/s) 2024-09-14T11:02:25.968 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-14T11:02:25.982 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.3/32 kB Progress (1): 18/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.2 MB/s) 2024-09-14T11:02:25.985 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-14T11:02:25.999 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 2.7/17 kB Progress (1): 12/17 kB Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-14T11:02:26.000 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-14T11:02:26.014 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-14T11:02:26.017 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-14T11:02:26.030 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 54 kB/s) 2024-09-14T11:02:26.032 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-14T11:02:26.045 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 370 kB/s) 2024-09-14T11:02:26.047 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-14T11:02:26.061 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 565 kB/s) 2024-09-14T11:02:26.063 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-14T11:02:26.077 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 214 kB/s) 2024-09-14T11:02:26.080 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-14T11:02:26.093 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 304 kB/s) 2024-09-14T11:02:26.096 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-14T11:02:26.111 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 147 kB/s) 2024-09-14T11:02:26.113 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-14T11:02:26.127 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 248 kB/s) 2024-09-14T11:02:26.129 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-14T11:02:26.143 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 781 kB/s) 2024-09-14T11:02:26.145 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-14T11:02:26.159 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 2.3/13 kB Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 962 kB/s) 2024-09-14T11:02:26.160 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-14T11:02:26.174 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.3 MB/s) 2024-09-14T11:02:26.177 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-14T11:02:26.190 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 26 kB/s) 2024-09-14T11:02:26.192 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-14T11:02:26.206 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 469 kB/s) 2024-09-14T11:02:26.207 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-14T11:02:26.221 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 564 kB/s) 2024-09-14T11:02:26.223 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-14T11:02:26.236 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 345 kB/s) 2024-09-14T11:02:26.239 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-14T11:02:26.254 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 522 kB/s) 2024-09-14T11:02:26.256 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-14T11:02:26.270 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.5 MB/s) 2024-09-14T11:02:26.272 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-14T11:02:26.287 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 15/78 kB Progress (1): 31/78 kB Progress (1): 48/78 kB Progress (1): 64/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 5.2 MB/s) 2024-09-14T11:02:26.292 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-14T11:02:26.306 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.7 MB/s) 2024-09-14T11:02:26.309 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-14T11:02:26.323 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 404 kB/s) 2024-09-14T11:02:26.325 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-14T11:02:26.339 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 329 kB/s) 2024-09-14T11:02:26.341 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-14T11:02:26.354 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 228 kB/s) 2024-09-14T11:02:26.356 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-14T11:02:26.371 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 2.0 MB/s) 2024-09-14T11:02:26.374 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-14T11:02:26.388 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 169 kB/s) 2024-09-14T11:02:26.394 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-14T11:02:26.413 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 17 MB/s) 2024-09-14T11:02:26.414 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-14T11:02:26.414 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-14T11:02:26.414 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-14T11:02:26.414 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-14T11:02:26.414 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-14T11:02:26.429 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/171 kB Progress (1): 33/171 kB Progress (1): 49/171 kB Progress (2): 49/171 kB | 16/26 kB Progress (2): 49/171 kB | 26 kB Progress (3): 49/171 kB | 26 kB | 8.2 kB Progress (3): 64/171 kB | 26 kB | 8.2 kB Progress (4): 64/171 kB | 26 kB | 8.2 kB | 16/118 kB Progress (5): 64/171 kB | 26 kB | 8.2 kB | 16/118 kB | 14 kB Progress (5): 81/171 kB | 26 kB | 8.2 kB | 16/118 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.8 MB/s) 2024-09-14T11:02:26.429 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (4): 81/171 kB | 8.2 kB | 33/118 kB | 14 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-14T11:02:26.430 INFO:tasks.workunit.client.0.smithi050.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 584 kB/s) 2024-09-14T11:02:26.430 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-14T11:02:26.430 INFO:tasks.workunit.client.0.smithi050.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 971 kB/s) 2024-09-14T11:02:26.430 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (2): 97/171 kB | 33/118 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-14T11:02:26.431 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (2): 97/171 kB | 49/118 kB Progress (2): 113/171 kB | 49/118 kB Progress (2): 113/171 kB | 64/118 kB Progress (2): 130/171 kB | 64/118 kB Progress (2): 130/171 kB | 80/118 kB Progress (2): 146/171 kB | 80/118 kB Progress (2): 146/171 kB | 97/118 kB Progress (2): 163/171 kB | 97/118 kB Progress (2): 163/171 kB | 113/118 kB Progress (2): 171 kB | 113/118 kB Progress (2): 171 kB | 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.9 MB/s) 2024-09-14T11:02:26.431 INFO:tasks.workunit.client.0.smithi050.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 9.5 MB/s) 2024-09-14T11:02:26.431 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-14T11:02:26.431 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-14T11:02:26.446 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/136 kB Progress (2): 16/136 kB | 16/146 kB Progress (2): 33/136 kB | 16/146 kB Progress (2): 33/136 kB | 33/146 kB Progress (2): 49/136 kB | 33/146 kB Progress (3): 49/136 kB | 33/146 kB | 16/61 kB Progress (3): 49/136 kB | 49/146 kB | 16/61 kB Progress (3): 66/136 kB | 49/146 kB | 16/61 kB Progress (3): 66/136 kB | 49/146 kB | 33/61 kB Progress (3): 66/136 kB | 66/146 kB | 33/61 kB Progress (3): 82/136 kB | 66/146 kB | 33/61 kB Progress (3): 82/136 kB | 66/146 kB | 49/61 kB Progress (3): 82/136 kB | 82/146 kB | 49/61 kB Progress (3): 98/136 kB | 82/146 kB | 49/61 kB Progress (3): 98/136 kB | 82/146 kB | 61 kB Progress (3): 98/136 kB | 98/146 kB | 61 kB Progress (3): 115/136 kB | 98/146 kB | 61 kB Progress (4): 115/136 kB | 98/146 kB | 61 kB | 16/501 kB Progress (4): 115/136 kB | 115/146 kB | 61 kB | 16/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 2.0 MB/s) 2024-09-14T11:02:26.446 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (3): 131/136 kB | 115/146 kB | 16/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-14T11:02:26.446 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (4): 131/136 kB | 115/146 kB | 16/501 kB | 16/58 kB Progress (4): 131/136 kB | 115/146 kB | 33/501 kB | 16/58 kB Progress (4): 136 kB | 115/146 kB | 33/501 kB | 16/58 kB Progress (4): 136 kB | 131/146 kB | 33/501 kB | 16/58 kB Progress (4): 136 kB | 131/146 kB | 33/501 kB | 33/58 kB Progress (4): 136 kB | 131/146 kB | 49/501 kB | 33/58 kB Progress (4): 136 kB | 146 kB | 49/501 kB | 33/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.4 MB/s) 2024-09-14T11:02:26.447 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-14T11:02:26.447 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (3): 146 kB | 49/501 kB | 49/58 kB Progress (3): 146 kB | 66/501 kB | 49/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.7 MB/s) 2024-09-14T11:02:26.447 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (2): 66/501 kB | 58 kB Progress (2): 82/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.8 MB/s) 2024-09-14T11:02:26.451 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 98/501 kB Progress (1): 114/501 kB Progress (1): 130/501 kB Progress (1): 147/501 kB Progress (1): 163/501 kB Progress (1): 179/501 kB Progress (1): 196/501 kB Progress (1): 212/501 kB Progress (1): 229/501 kB Progress (1): 245/501 kB Progress (1): 261/501 kB Progress (1): 278/501 kB Progress (1): 294/501 kB Progress (1): 310/501 kB Progress (1): 327/501 kB Progress (1): 343/501 kB Progress (1): 360/501 kB Progress (1): 376/501 kB Progress (1): 392/501 kB Progress (1): 409/501 kB Progress (1): 425/501 kB Progress (1): 442/501 kB Progress (1): 458/501 kB Progress (1): 474/501 kB Progress (1): 491/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 13 MB/s) 2024-09-14T11:02:26.461 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (2): 49/124 kB | 0/2.4 MB Progress (2): 66/124 kB | 0/2.4 MB Progress (2): 66/124 kB | 0/2.4 MB Progress (2): 82/124 kB | 0/2.4 MB Progress (2): 82/124 kB | 0/2.4 MB Progress (2): 98/124 kB | 0/2.4 MB Progress (2): 98/124 kB | 0.1/2.4 MB Progress (2): 115/124 kB | 0.1/2.4 MB Progress (2): 115/124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.6 MB/s) 2024-09-14T11:02:26.493 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 30 MB/s) 2024-09-14T11:02:26.564 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] 2024-09-14T11:02:26.564 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-14T11:02:26.567 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-14T11:02:26.580 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 320 kB/s) 2024-09-14T11:02:26.582 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-14T11:02:26.596 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 376 kB/s) 2024-09-14T11:02:26.597 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-14T11:02:26.611 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.2 MB/s) 2024-09-14T11:02:26.613 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-14T11:02:26.627 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.6 MB/s) 2024-09-14T11:02:26.629 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-14T11:02:26.643 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 370 kB/s) 2024-09-14T11:02:26.645 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-14T11:02:26.659 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 280 kB/s) 2024-09-14T11:02:26.661 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-14T11:02:26.676 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 430 kB/s) 2024-09-14T11:02:26.677 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-14T11:02:26.691 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 447 kB/s) 2024-09-14T11:02:26.693 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-14T11:02:26.708 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-14T11:02:26.711 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-14T11:02:26.725 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 1.0 MB/s) 2024-09-14T11:02:26.727 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-14T11:02:26.740 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 146 kB/s) 2024-09-14T11:02:26.742 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-14T11:02:26.756 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 632 kB/s) 2024-09-14T11:02:26.758 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-14T11:02:26.772 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.8 MB/s) 2024-09-14T11:02:26.777 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-14T11:02:26.791 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.6 MB/s) 2024-09-14T11:02:26.792 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-14T11:02:26.792 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-14T11:02:26.793 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-14T11:02:26.793 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-14T11:02:26.793 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-14T11:02:26.810 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/26 kB Progress (2): 16/26 kB | 16/211 kB Progress (3): 16/26 kB | 16/211 kB | 0/1.0 MB Progress (4): 16/26 kB | 16/211 kB | 0/1.0 MB | 16/79 kB Progress (4): 26 kB | 16/211 kB | 0/1.0 MB | 16/79 kB Progress (4): 26 kB | 33/211 kB | 0/1.0 MB | 16/79 kB Progress (4): 26 kB | 33/211 kB | 0/1.0 MB | 16/79 kB Progress (4): 26 kB | 49/211 kB | 0/1.0 MB | 16/79 kB Progress (4): 26 kB | 49/211 kB | 0/1.0 MB | 33/79 kB Progress (5): 26 kB | 49/211 kB | 0/1.0 MB | 33/79 kB | 16/58 kB Progress (5): 26 kB | 49/211 kB | 0/1.0 MB | 33/79 kB | 16/58 kB Progress (5): 26 kB | 63/211 kB | 0/1.0 MB | 33/79 kB | 16/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.7 MB/s) 2024-09-14T11:02:26.810 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-14T11:02:26.810 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (4): 63/211 kB | 0/1.0 MB | 48/79 kB | 16/58 kB Progress (4): 63/211 kB | 0/1.0 MB | 48/79 kB | 33/58 kB Progress (4): 63/211 kB | 0.1/1.0 MB | 48/79 kB | 33/58 kB Progress (4): 79/211 kB | 0.1/1.0 MB | 48/79 kB | 33/58 kB Progress (4): 79/211 kB | 0.1/1.0 MB | 48/79 kB | 49/58 kB Progress (4): 95/211 kB | 0.1/1.0 MB | 48/79 kB | 49/58 kB Progress (4): 95/211 kB | 0.1/1.0 MB | 48/79 kB | 49/58 kB Progress (4): 95/211 kB | 0.1/1.0 MB | 64/79 kB | 49/58 kB Progress (4): 95/211 kB | 0.1/1.0 MB | 64/79 kB | 58 kB Progress (4): 112/211 kB | 0.1/1.0 MB | 64/79 kB | 58 kB Progress (4): 112/211 kB | 0.1/1.0 MB | 64/79 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.6 MB/s) 2024-09-14T11:02:26.810 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (3): 128/211 kB | 0.1/1.0 MB | 64/79 kB Progress (3): 128/211 kB | 0.1/1.0 MB | 79 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-14T11:02:26.810 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (3): 128/211 kB | 0.1/1.0 MB | 79 kB Progress (3): 145/211 kB | 0.1/1.0 MB | 79 kB Progress (3): 145/211 kB | 0.1/1.0 MB | 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.7 MB/s) 2024-09-14T11:02:26.810 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (2): 161/211 kB | 0.1/1.0 MB Progress (2): 177/211 kB | 0.1/1.0 MB Progress (2): 177/211 kB | 0.1/1.0 MB Progress (2): 194/211 kB | 0.1/1.0 MB Progress (2): 194/211 kB | 0.2/1.0 MB Progress (2): 210/211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 12 MB/s) 2024-09-14T11:02:26.825 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (2): 0.7/1.0 MB | 16/116 kB Progress (2): 0.7/1.0 MB | 16/116 kB Progress (2): 0.7/1.0 MB | 32/116 kB Progress (2): 0.7/1.0 MB | 32/116 kB Progress (2): 0.7/1.0 MB | 49/116 kB Progress (2): 0.7/1.0 MB | 49/116 kB Progress (2): 0.7/1.0 MB | 65/116 kB Progress (2): 0.8/1.0 MB | 65/116 kB Progress (2): 0.8/1.0 MB | 81/116 kB Progress (2): 0.8/1.0 MB | 81/116 kB Progress (2): 0.8/1.0 MB | 98/116 kB Progress (2): 0.8/1.0 MB | 114/116 kB Progress (2): 0.8/1.0 MB | 116 kB Progress (2): 0.8/1.0 MB | 116 kB Progress (2): 0.8/1.0 MB | 116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.7 MB/s) 2024-09-14T11:02:26.827 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 0.8/1.0 MB Progress (2): 0.8/1.0 MB | 15/267 kB Progress (2): 0.8/1.0 MB | 15/267 kB Progress (2): 0.8/1.0 MB | 31/267 kB Progress (2): 0.8/1.0 MB | 48/267 kB Progress (2): 0.8/1.0 MB | 48/267 kB Progress (2): 0.8/1.0 MB | 64/267 kB Progress (2): 0.8/1.0 MB | 79/267 kB Progress (2): 0.9/1.0 MB | 79/267 kB Progress (2): 0.9/1.0 MB | 96/267 kB Progress (2): 0.9/1.0 MB | 96/267 kB Progress (2): 0.9/1.0 MB | 112/267 kB Progress (2): 0.9/1.0 MB | 128/267 kB Progress (2): 0.9/1.0 MB | 128/267 kB Progress (2): 0.9/1.0 MB | 145/267 kB Progress (2): 0.9/1.0 MB | 145/267 kB Progress (2): 0.9/1.0 MB | 161/267 kB Progress (2): 0.9/1.0 MB | 178/267 kB Progress (2): 0.9/1.0 MB | 178/267 kB Progress (2): 0.9/1.0 MB | 194/267 kB Progress (2): 0.9/1.0 MB | 194/267 kB Progress (2): 0.9/1.0 MB | 210/267 kB Progress (2): 1.0/1.0 MB | 210/267 kB Progress (2): 1.0/1.0 MB | 227/267 kB Progress (2): 1.0/1.0 MB | 243/267 kB Progress (2): 1.0/1.0 MB | 243/267 kB Progress (2): 1.0/1.0 MB | 260/267 kB Progress (2): 1.0/1.0 MB | 267 kB Progress (2): 1.0/1.0 MB | 267 kB Progress (2): 1.0/1.0 MB | 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.4 MB/s) 2024-09-14T11:02:26.828 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 28 MB/s) 2024-09-14T11:02:26.972 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-14T11:02:26.999 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:02:26.999 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] BUILD SUCCESS 2024-09-14T11:02:26.999 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:02:27.000 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] Total time: 5.755 s 2024-09-14T11:02:27.000 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] Finished at: 2024-09-14T11:02:27Z 2024-09-14T11:02:27.000 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:02:27.022 INFO:tasks.workunit.client.0.smithi050.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-14T11:02:27.031 INFO:tasks.workunit.client.0.smithi050.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T11:02:28.052 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] Scanning for projects... 2024-09-14T11:02:28.142 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] 2024-09-14T11:02:28.142 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T11:02:28.142 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] Building jcksum 1.0 2024-09-14T11:02:28.142 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] from pom.xml 2024-09-14T11:02:28.142 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T11:02:28.431 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] 2024-09-14T11:02:28.431 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T11:02:28.521 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T11:02:28.522 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] 2024-09-14T11:02:28.522 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T11:02:28.616 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T11:02:28.616 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] 2024-09-14T11:02:28.616 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T11:02:28.618 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T11:02:28.618 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] 2024-09-14T11:02:28.619 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T11:02:28.623 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T11:02:28.623 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] 2024-09-14T11:02:28.623 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T11:02:28.812 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-14T11:02:29.003 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-14T11:02:29.200 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 23 kB/s) 2024-09-14T11:02:29.209 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-14T11:02:29.226 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 145 kB/s) 2024-09-14T11:02:29.231 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-14T11:02:29.248 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 176 kB/s) 2024-09-14T11:02:29.252 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-14T11:02:29.268 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 189 kB/s) 2024-09-14T11:02:29.271 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-14T11:02:29.287 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 200 kB/s) 2024-09-14T11:02:29.289 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-14T11:02:29.305 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 105 kB/s) 2024-09-14T11:02:29.308 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-14T11:02:29.323 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 177 kB/s) 2024-09-14T11:02:29.328 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-14T11:02:29.349 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.3 MB/s) 2024-09-14T11:02:29.351 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-14T11:02:29.351 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-14T11:02:29.351 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-14T11:02:29.352 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-14T11:02:29.353 INFO:tasks.workunit.client.0.smithi050.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-14T11:02:29.391 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 16/189 kB Progress (1): 33/189 kB Progress (1): 49/189 kB Progress (1): 66/189 kB Progress (1): 79/189 kB Progress (1): 96/189 kB Progress (1): 112/189 kB Progress (1): 128/189 kB Progress (1): 145/189 kB Progress (1): 161/189 kB Progress (1): 178/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 4.6 MB/s) 2024-09-14T11:02:29.405 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 1.4/169 kB Progress (2): 1.4/169 kB | 1.4/7.7 kB Progress (3): 1.4/169 kB | 1.4/7.7 kB | 1.4/18 kB Progress (4): 1.4/169 kB | 1.4/7.7 kB | 1.4/18 kB | 1.4/103 kB Progress (4): 1.4/169 kB | 1.4/7.7 kB | 2.8/18 kB | 1.4/103 kB Progress (4): 1.4/169 kB | 2.8/7.7 kB | 2.8/18 kB | 1.4/103 kB Progress (4): 2.8/169 kB | 2.8/7.7 kB | 2.8/18 kB | 1.4/103 kB Progress (4): 2.8/169 kB | 4.1/7.7 kB | 2.8/18 kB | 1.4/103 kB Progress (4): 2.8/169 kB | 4.1/7.7 kB | 4.1/18 kB | 1.4/103 kB Progress (4): 2.8/169 kB | 4.1/7.7 kB | 4.1/18 kB | 2.8/103 kB Progress (4): 2.8/169 kB | 4.1/7.7 kB | 5.5/18 kB | 2.8/103 kB Progress (4): 2.8/169 kB | 5.5/7.7 kB | 5.5/18 kB | 2.8/103 kB Progress (4): 4.1/169 kB | 5.5/7.7 kB | 5.5/18 kB | 2.8/103 kB Progress (4): 4.1/169 kB | 6.9/7.7 kB | 5.5/18 kB | 2.8/103 kB Progress (4): 4.1/169 kB | 6.9/7.7 kB | 6.9/18 kB | 2.8/103 kB Progress (4): 4.1/169 kB | 6.9/7.7 kB | 6.9/18 kB | 4.1/103 kB Progress (4): 4.1/169 kB | 6.9/7.7 kB | 8.3/18 kB | 4.1/103 kB Progress (4): 4.1/169 kB | 7.7 kB | 8.3/18 kB | 4.1/103 kB Progress (4): 5.5/169 kB | 7.7 kB | 8.3/18 kB | 4.1/103 kB Progress (4): 5.5/169 kB | 7.7 kB | 9.7/18 kB | 4.1/103 kB Progress (4): 5.5/169 kB | 7.7 kB | 9.7/18 kB | 5.5/103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 139 kB/s) 2024-09-14T11:02:29.410 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (3): 5.5/169 kB | 11/18 kB | 5.5/103 kB Progress (3): 6.9/169 kB | 11/18 kB | 5.5/103 kB Progress (3): 6.9/169 kB | 12/18 kB | 5.5/103 kB Progress (3): 6.9/169 kB | 12/18 kB | 6.9/103 kB Progress (3): 6.9/169 kB | 14/18 kB | 6.9/103 kB Progress (3): 8.3/169 kB | 14/18 kB | 6.9/103 kB Progress (3): 8.3/169 kB | 15/18 kB | 6.9/103 kB Progress (3): 8.3/169 kB | 15/18 kB | 8.3/103 kB Progress (3): 8.3/169 kB | 17/18 kB | 8.3/103 kB Progress (3): 9.7/169 kB | 17/18 kB | 8.3/103 kB Progress (3): 9.7/169 kB | 18 kB | 8.3/103 kB Progress (3): 9.7/169 kB | 18 kB | 9.7/103 kB Progress (3): 11/169 kB | 18 kB | 9.7/103 kB Progress (3): 11/169 kB | 18 kB | 11/103 kB Progress (3): 12/169 kB | 18 kB | 11/103 kB Progress (3): 12/169 kB | 18 kB | 12/103 kB Progress (3): 14/169 kB | 18 kB | 12/103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 288 kB/s) 2024-09-14T11:02:29.436 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (2): 15/169 kB | 12/103 kB Progress (2): 15/169 kB | 14/103 kB Progress (2): 16/169 kB | 14/103 kB Progress (2): 16/169 kB | 15/103 kB Progress (2): 16/169 kB | 16/103 kB Progress (2): 33/169 kB | 16/103 kB Progress (2): 33/169 kB | 18/103 kB Progress (2): 33/169 kB | 19/103 kB Progress (2): 49/169 kB | 19/103 kB Progress (2): 49/169 kB | 21/103 kB Progress (2): 49/169 kB | 22/103 kB Progress (2): 49/169 kB | 23/103 kB Progress (2): 49/169 kB | 25/103 kB Progress (2): 49/169 kB | 26/103 kB Progress (2): 49/169 kB | 27/103 kB Progress (2): 49/169 kB | 29/103 kB Progress (2): 49/169 kB | 30/103 kB Progress (2): 49/169 kB | 32/103 kB Progress (2): 49/169 kB | 33/103 kB Progress (2): 49/169 kB | 34/103 kB Progress (2): 49/169 kB | 36/103 kB Progress (2): 49/169 kB | 37/103 kB Progress (2): 49/169 kB | 38/103 kB Progress (2): 49/169 kB | 40/103 kB Progress (2): 49/169 kB | 41/103 kB Progress (2): 49/169 kB | 43/103 kB Progress (2): 49/169 kB | 44/103 kB Progress (2): 49/169 kB | 45/103 kB Progress (2): 49/169 kB | 47/103 kB Progress (2): 49/169 kB | 48/103 kB Progress (2): 49/169 kB | 49/103 kB Progress (2): 49/169 kB | 51/103 kB Progress (2): 49/169 kB | 52/103 kB Progress (2): 49/169 kB | 54/103 kB Progress (2): 66/169 kB | 54/103 kB Progress (2): 66/169 kB | 55/103 kB Progress (2): 66/169 kB | 56/103 kB Progress (2): 66/169 kB | 58/103 kB Progress (2): 66/169 kB | 59/103 kB Progress (2): 82/169 kB | 59/103 kB Progress (2): 82/169 kB | 61/103 kB Progress (2): 82/169 kB | 62/103 kB Progress (2): 82/169 kB | 62/103 kB Progress (2): 82/169 kB | 79/103 kB Progress (2): 98/169 kB | 79/103 kB Progress (2): 98/169 kB | 95/103 kB Progress (2): 115/169 kB | 95/103 kB Progress (2): 115/169 kB | 103 kB Progress (2): 131/169 kB | 103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.2 MB/s) 2024-09-14T11:02:29.444 INFO:tasks.workunit.client.0.smithi050.stdout:Progress (1): 147/169 kB Progress (1): 164/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.8 MB/s) 2024-09-14T11:02:29.460 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] 2024-09-14T11:02:29.460 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] ------------------------------------------------------- 2024-09-14T11:02:29.460 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] T E S T S 2024-09-14T11:02:29.460 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] ------------------------------------------------------- 2024-09-14T11:02:29.897 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-14T11:02:30.030 INFO:tasks.workunit.client.0.smithi050.stdout:PutObjects.java: starting test run: 2024-09-14T11:02:30.030 INFO:tasks.workunit.client.0.smithi050.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:02:30.030 INFO:tasks.workunit.client.0.smithi050.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:02:30.030 INFO:tasks.workunit.client.0.smithi050.stdout: EndpointUrl=https://smithi050.front.sepia.ceph.com:443 2024-09-14T11:02:30.030 INFO:tasks.workunit.client.0.smithi050.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-14T11:02:30.127 INFO:tasks.workunit.client.0.smithi050.stdout:DEBUG: Environment Variables Read 2024-09-14T11:02:30.429 INFO:tasks.workunit.client.0.smithi050.stdout:DEBUG: S3 Client Initialized 2024-09-14T11:02:30.429 INFO:tasks.workunit.client.0.smithi050.stdout:DEBUG: Generating File 2024-09-14T11:02:30.429 INFO:tasks.workunit.client.0.smithi050.stdout:DEBUG: File Generated 2024-09-14T11:02:30.429 INFO:tasks.workunit.client.0.smithi050.stdout:DEBUG: Generating File 2024-09-14T11:02:30.430 INFO:tasks.workunit.client.0.smithi050.stdout:DEBUG: File Generated 2024-09-14T11:02:30.430 INFO:tasks.workunit.client.0.smithi050.stdout:DEBUG: Generating File 2024-09-14T11:02:30.529 INFO:tasks.workunit.client.0.smithi050.stdout:DEBUG: File Generated 2024-09-14T11:02:30.529 INFO:tasks.workunit.client.0.smithi050.stdout:DEBUG: Generating File 2024-09-14T11:02:30.529 INFO:tasks.workunit.client.0.smithi050.stdout:DEBUG: File Generated 2024-09-14T11:02:30.529 INFO:tasks.workunit.client.0.smithi050.stdout:DEBUG: Generating File 2024-09-14T11:02:30.530 INFO:tasks.workunit.client.0.smithi050.stdout:DEBUG: File Generated 2024-09-14T11:02:30.530 INFO:tasks.workunit.client.0.smithi050.stdout:DEBUG: Generating File 2024-09-14T11:02:30.530 INFO:tasks.workunit.client.0.smithi050.stdout:DEBUG: File Generated 2024-09-14T11:02:30.530 INFO:tasks.workunit.client.0.smithi050.stdout:DEBUG: Generated Big Files 2024-09-14T11:02:30.925 INFO:tasks.workunit.client.0.smithi050.stdout:HeadBucketResponse() 2024-09-14T11:02:30.925 INFO:tasks.workunit.client.0.smithi050.stdout:sheik is ready 2024-09-14T11:02:30.925 INFO:tasks.workunit.client.0.smithi050.stdout:DEBUG: Test Bucket Created 2024-09-14T11:02:31.029 INFO:tasks.workunit.client.0.smithi050.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-14T11:02:31.130 INFO:tasks.workunit.client.0.smithi050.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-14T11:02:31.230 INFO:tasks.workunit.client.0.smithi050.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-14T11:02:31.527 INFO:tasks.workunit.client.0.smithi050.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-14T11:02:31.530 INFO:tasks.workunit.client.0.smithi050.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-14T11:02:31.730 INFO:tasks.workunit.client.0.smithi050.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-14T11:02:32.031 INFO:tasks.workunit.client.0.smithi050.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-14T11:02:32.231 INFO:tasks.workunit.client.0.smithi050.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-14T11:02:32.932 INFO:tasks.workunit.client.0.smithi050.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-14T11:02:33.433 INFO:tasks.workunit.client.0.smithi050.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-14T11:02:37.339 INFO:tasks.workunit.client.0.smithi050.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-14T11:02:41.745 INFO:tasks.workunit.client.0.smithi050.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-14T11:03:18.754 INFO:tasks.workunit.client.0.smithi050.stdout:arg: file-0b 2024-09-14T11:03:18.755 INFO:tasks.workunit.client.0.smithi050.stdout:arg: file-8b 2024-09-14T11:03:18.756 INFO:tasks.workunit.client.0.smithi050.stdout:arg: file-200b 2024-09-14T11:03:18.757 INFO:tasks.workunit.client.0.smithi050.stdout:arg: file-21983b 2024-09-14T11:03:18.758 INFO:tasks.workunit.client.0.smithi050.stdout:arg: file-5519b 2024-09-14T11:03:18.759 INFO:tasks.workunit.client.0.smithi050.stdout:arg: file-204329b 2024-09-14T11:03:18.761 INFO:tasks.workunit.client.0.smithi050.stdout:arg: file-256k 2024-09-14T11:03:18.762 INFO:tasks.workunit.client.0.smithi050.stdout:arg: file-1m 2024-09-14T11:03:18.764 INFO:tasks.workunit.client.0.smithi050.stdout:arg: file-1038757b 2024-09-14T11:03:18.788 INFO:tasks.workunit.client.0.smithi050.stdout:putObjectFromFileCksum called with file-0b 2024-09-14T11:03:18.888 INFO:tasks.workunit.client.0.smithi050.stdout:PutObjectResponse 2024-09-14T11:03:18.988 INFO:tasks.workunit.client.0.smithi050.stdout:putObjectFromFileCksum called with file-8b 2024-09-14T11:03:18.988 INFO:tasks.workunit.client.0.smithi050.stdout:PutObjectResponse 2024-09-14T11:03:19.088 INFO:tasks.workunit.client.0.smithi050.stdout:putObjectFromFileCksum called with file-200b 2024-09-14T11:03:19.188 INFO:tasks.workunit.client.0.smithi050.stdout:PutObjectResponse 2024-09-14T11:03:19.289 INFO:tasks.workunit.client.0.smithi050.stdout:putObjectFromFileCksum called with file-21983b 2024-09-14T11:03:19.289 INFO:tasks.workunit.client.0.smithi050.stdout:PutObjectResponse 2024-09-14T11:03:19.388 INFO:tasks.workunit.client.0.smithi050.stdout:putObjectFromFileCksum called with file-5519b 2024-09-14T11:03:19.482 INFO:tasks.workunit.client.0.smithi050.stdout:PutObjectResponse 2024-09-14T11:03:19.489 INFO:tasks.workunit.client.0.smithi050.stdout:putObjectFromFileCksum called with file-204329b 2024-09-14T11:03:19.689 INFO:tasks.workunit.client.0.smithi050.stdout:PutObjectResponse 2024-09-14T11:03:19.789 INFO:tasks.workunit.client.0.smithi050.stdout:putObjectFromFileCksum called with file-256k 2024-09-14T11:03:19.970 INFO:tasks.workunit.client.0.smithi050.stdout:PutObjectResponse 2024-09-14T11:03:19.989 INFO:tasks.workunit.client.0.smithi050.stdout:putObjectFromFileCksum called with file-1m 2024-09-14T11:03:20.590 INFO:tasks.workunit.client.0.smithi050.stdout:PutObjectResponse 2024-09-14T11:03:20.790 INFO:tasks.workunit.client.0.smithi050.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-14T11:03:21.191 INFO:tasks.workunit.client.0.smithi050.stdout:PutObjectResponse 2024-09-14T11:03:21.391 INFO:tasks.workunit.client.0.smithi050.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-14T11:03:24.394 INFO:tasks.workunit.client.0.smithi050.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-14T11:03:29.199 INFO:tasks.workunit.client.0.smithi050.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-14T11:04:23.358 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 113.5 s -- in io.ceph.jcksum.PutObjects 2024-09-14T11:04:23.371 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] 2024-09-14T11:04:23.371 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] Results: 2024-09-14T11:04:23.372 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] 2024-09-14T11:04:23.372 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-14T11:04:23.372 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] 2024-09-14T11:04:23.373 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:04:23.373 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] BUILD SUCCESS 2024-09-14T11:04:23.373 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:04:23.374 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] Total time: 01:55 min 2024-09-14T11:04:23.374 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] Finished at: 2024-09-14T11:04:23Z 2024-09-14T11:04:23.374 INFO:tasks.workunit.client.0.smithi050.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:04:23.386 INFO:tasks.workunit.client.0.smithi050.stderr:+ exit 2024-09-14T11:04:23.387 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:04:23.387 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:04:23.467 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-14T11:04:23.467 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:04:23.859 DEBUG:teuthology.parallel:result is None 2024-09-14T11:04:23.860 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:04:23.899 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:04:23.899 DEBUG:teuthology.orchestra.run.smithi050:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:04:23.968 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:04:23.969 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:04:23.980 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:04:23.981 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:04:23.981 DEBUG:teuthology.orchestra.run.smithi050:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:04:24.039 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:04:24.040 INFO:teuthology.orchestra.run.smithi050.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:04:24.040 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:04:24.110 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:04:24.110 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:04:24.180 INFO:tasks.workunit:timeout=3h 2024-09-14T11:04:24.181 INFO:tasks.workunit:cleanup=True 2024-09-14T11:04:24.181 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:04:24.256 INFO:tasks.workunit.client.0.smithi050.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:05:21.194 INFO:tasks.workunit.client.0.smithi050.stderr:Updating files: 94% (12156/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:05:21.367 INFO:tasks.workunit.client.0.smithi050.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:05:21.368 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:05:21.368 INFO:tasks.workunit.client.0.smithi050.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:05:21.368 INFO:tasks.workunit.client.0.smithi050.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:05:21.368 INFO:tasks.workunit.client.0.smithi050.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:05:21.368 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:05:21.368 INFO:tasks.workunit.client.0.smithi050.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:05:21.368 INFO:tasks.workunit.client.0.smithi050.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:05:21.368 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:05:21.368 INFO:tasks.workunit.client.0.smithi050.stderr: git switch -c 2024-09-14T11:05:21.368 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:05:21.368 INFO:tasks.workunit.client.0.smithi050.stderr:Or undo this operation with: 2024-09-14T11:05:21.369 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:05:21.369 INFO:tasks.workunit.client.0.smithi050.stderr: git switch - 2024-09-14T11:05:21.369 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:05:21.369 INFO:tasks.workunit.client.0.smithi050.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:05:21.369 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:05:21.369 INFO:tasks.workunit.client.0.smithi050.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:05:21.370 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:05:21.440 INFO:tasks.workunit.client.0.smithi050.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:05:21.442 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:05:21.443 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:05:21.492 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:05:21.542 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:05:21.582 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:05:21.584 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:05:21.584 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:05:21.624 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:05:21.628 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T11:05:21.628 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:05:21.699 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-14T11:05:21.700 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-14T11:05:21.700 DEBUG:teuthology.orchestra.run.smithi050:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-14T11:05:21.775 INFO:tasks.workunit.client.0.smithi050.stdout:INFO: fully qualified domain name: smithi050.front.sepia.ceph.com 2024-09-14T11:05:21.775 INFO:tasks.workunit.client.0.smithi050.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-14T11:05:21.775 INFO:tasks.workunit.client.0.smithi050.stdout:== TESTING VERSIONED BUCKET == 2024-09-14T11:05:24.390 INFO:tasks.workunit.client.0.smithi050.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:05:24.579 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting pip 2024-09-14T11:05:24.585 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:05:24.632 INFO:tasks.workunit.client.0.smithi050.stdout:Installing collected packages: pip 2024-09-14T11:05:24.632 INFO:tasks.workunit.client.0.smithi050.stdout: Attempting uninstall: pip 2024-09-14T11:05:24.632 INFO:tasks.workunit.client.0.smithi050.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:05:24.800 INFO:tasks.workunit.client.0.smithi050.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:05:24.805 INFO:tasks.workunit.client.0.smithi050.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:05:25.583 INFO:tasks.workunit.client.0.smithi050.stdout:Successfully installed pip-24.2 2024-09-14T11:05:26.442 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting boto3 2024-09-14T11:05:26.443 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:05:27.056 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:05:27.057 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:05:27.110 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:05:27.111 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:05:27.165 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:05:27.166 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:05:27.216 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:05:27.217 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:05:27.294 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:05:27.296 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:05:27.555 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:05:27.556 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:05:27.561 INFO:tasks.workunit.client.0.smithi050.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:05:27.562 INFO:tasks.workunit.client.0.smithi050.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:05:27.572 INFO:tasks.workunit.client.0.smithi050.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:05:27.573 INFO:tasks.workunit.client.0.smithi050.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:05:27.574 INFO:tasks.workunit.client.0.smithi050.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:05:27.576 INFO:tasks.workunit.client.0.smithi050.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:05:27.577 INFO:tasks.workunit.client.0.smithi050.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:05:27.653 INFO:tasks.workunit.client.0.smithi050.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:05:28.735 INFO:tasks.workunit.client.0.smithi050.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:05:29.179 INFO:tasks.workunit.client.0.smithi050.stdout:INFO: creating user 2024-09-14T11:05:29.502 INFO:tasks.workunit.client.0.smithi050.stdout:{ 2024-09-14T11:05:29.502 INFO:tasks.workunit.client.0.smithi050.stdout: "user_id": "testid", 2024-09-14T11:05:29.502 INFO:tasks.workunit.client.0.smithi050.stdout: "display_name": "M. Tester", 2024-09-14T11:05:29.502 INFO:tasks.workunit.client.0.smithi050.stdout: "email": "tester@ceph.com", 2024-09-14T11:05:29.502 INFO:tasks.workunit.client.0.smithi050.stdout: "suspended": 0, 2024-09-14T11:05:29.502 INFO:tasks.workunit.client.0.smithi050.stdout: "max_buckets": 1000, 2024-09-14T11:05:29.502 INFO:tasks.workunit.client.0.smithi050.stdout: "subusers": [], 2024-09-14T11:05:29.502 INFO:tasks.workunit.client.0.smithi050.stdout: "keys": [ 2024-09-14T11:05:29.502 INFO:tasks.workunit.client.0.smithi050.stdout: { 2024-09-14T11:05:29.502 INFO:tasks.workunit.client.0.smithi050.stdout: "user": "testid", 2024-09-14T11:05:29.503 INFO:tasks.workunit.client.0.smithi050.stdout: "access_key": "0555b35654ad1656d804", 2024-09-14T11:05:29.503 INFO:tasks.workunit.client.0.smithi050.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-14T11:05:29.503 INFO:tasks.workunit.client.0.smithi050.stdout: "active": true, 2024-09-14T11:05:29.503 INFO:tasks.workunit.client.0.smithi050.stdout: "create_date": "2024-09-14T11:05:29.494865Z" 2024-09-14T11:05:29.503 INFO:tasks.workunit.client.0.smithi050.stdout: } 2024-09-14T11:05:29.503 INFO:tasks.workunit.client.0.smithi050.stdout: ], 2024-09-14T11:05:29.503 INFO:tasks.workunit.client.0.smithi050.stdout: "swift_keys": [], 2024-09-14T11:05:29.503 INFO:tasks.workunit.client.0.smithi050.stdout: "caps": [], 2024-09-14T11:05:29.503 INFO:tasks.workunit.client.0.smithi050.stdout: "op_mask": "read, write, delete", 2024-09-14T11:05:29.503 INFO:tasks.workunit.client.0.smithi050.stdout: "default_placement": "", 2024-09-14T11:05:29.503 INFO:tasks.workunit.client.0.smithi050.stdout: "default_storage_class": "", 2024-09-14T11:05:29.503 INFO:tasks.workunit.client.0.smithi050.stdout: "placement_tags": [], 2024-09-14T11:05:29.503 INFO:tasks.workunit.client.0.smithi050.stdout: "bucket_quota": { 2024-09-14T11:05:29.503 INFO:tasks.workunit.client.0.smithi050.stdout: "enabled": false, 2024-09-14T11:05:29.504 INFO:tasks.workunit.client.0.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:05:29.504 INFO:tasks.workunit.client.0.smithi050.stdout: "max_size": -1, 2024-09-14T11:05:29.504 INFO:tasks.workunit.client.0.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:05:29.504 INFO:tasks.workunit.client.0.smithi050.stdout: "max_objects": -1 2024-09-14T11:05:29.504 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T11:05:29.504 INFO:tasks.workunit.client.0.smithi050.stdout: "user_quota": { 2024-09-14T11:05:29.504 INFO:tasks.workunit.client.0.smithi050.stdout: "enabled": false, 2024-09-14T11:05:29.504 INFO:tasks.workunit.client.0.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:05:29.504 INFO:tasks.workunit.client.0.smithi050.stdout: "max_size": -1, 2024-09-14T11:05:29.504 INFO:tasks.workunit.client.0.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:05:29.504 INFO:tasks.workunit.client.0.smithi050.stdout: "max_objects": -1 2024-09-14T11:05:29.504 INFO:tasks.workunit.client.0.smithi050.stdout: }, 2024-09-14T11:05:29.504 INFO:tasks.workunit.client.0.smithi050.stdout: "temp_url_keys": [], 2024-09-14T11:05:29.504 INFO:tasks.workunit.client.0.smithi050.stdout: "type": "rgw", 2024-09-14T11:05:29.505 INFO:tasks.workunit.client.0.smithi050.stdout: "mfa_ids": [], 2024-09-14T11:05:29.505 INFO:tasks.workunit.client.0.smithi050.stdout: "account_id": "", 2024-09-14T11:05:29.505 INFO:tasks.workunit.client.0.smithi050.stdout: "path": "/", 2024-09-14T11:05:29.505 INFO:tasks.workunit.client.0.smithi050.stdout: "create_date": "2024-09-14T11:05:29.494854Z", 2024-09-14T11:05:29.505 INFO:tasks.workunit.client.0.smithi050.stdout: "tags": [], 2024-09-14T11:05:29.505 INFO:tasks.workunit.client.0.smithi050.stdout: "group_ids": [] 2024-09-14T11:05:29.505 INFO:tasks.workunit.client.0.smithi050.stdout:} 2024-09-14T11:05:29.505 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-14T11:05:38.282 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi050.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:05:38.282 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:05:38.338 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi050.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:05:38.338 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:05:38.384 INFO:tasks.workunit.client.0.smithi050.stderr:5+0 records in 2024-09-14T11:05:38.384 INFO:tasks.workunit.client.0.smithi050.stderr:5+0 records out 2024-09-14T11:05:38.384 INFO:tasks.workunit.client.0.smithi050.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0144238 s, 363 MB/s 2024-09-14T11:05:38.387 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi050.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:05:38.387 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:05:38.466 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi050.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:05:38.466 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:05:39.551 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi050.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:05:39.552 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:05:40.641 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi050.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:05:40.641 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:05:41.742 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi050.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:05:41.743 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:05:42.833 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi050.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:05:42.833 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:05:43.935 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi050.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:05:43.935 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:05:45.030 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi050.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:05:45.030 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:05:46.133 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi050.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:05:46.133 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:05:47.236 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi050.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:05:47.236 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:05:48.327 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi050.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:05:48.327 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:05:49.423 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi050.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:05:49.423 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:05:50.506 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi050.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:05:50.506 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:05:51.606 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi050.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:05:51.606 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:05:52.687 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi050.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:05:52.687 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:05:52.768 INFO:tasks.workunit.client.0.smithi050.stdout:bucket nams is reupload-bkt-106737 2024-09-14T11:05:52.768 INFO:tasks.workunit.client.0.smithi050.stdout:endpoint is https://smithi050.front.sepia.ceph.com:443 2024-09-14T11:05:52.769 INFO:tasks.workunit.client.0.smithi050.stdout:start UploadId=2~cpdgPgToXFdVN8ywTWrAi9i4NA54BUp 2024-09-14T11:05:52.769 INFO:tasks.workunit.client.0.smithi050.stdout:phase 1 uploaded part {'ETag': '"15cbe6c9afffef96f64d0e6625c9338e"', 'PartNumber': 1} 2024-09-14T11:05:52.769 INFO:tasks.workunit.client.0.smithi050.stdout:phase 1 uploaded part {'ETag': '"15cbe6c9afffef96f64d0e6625c9338e"', 'PartNumber': 2} 2024-09-14T11:05:52.769 INFO:tasks.workunit.client.0.smithi050.stdout:phase 2 uploaded part {'ETag': '"15cbe6c9afffef96f64d0e6625c9338e"', 'PartNumber': 1} 2024-09-14T11:05:52.769 INFO:tasks.workunit.client.0.smithi050.stdout:phase 2 uploaded part {'ETag': '"15cbe6c9afffef96f64d0e6625c9338e"', 'PartNumber': 1} 2024-09-14T11:05:52.769 INFO:tasks.workunit.client.0.smithi050.stdout:phase 2 uploaded part {'ETag': '"15cbe6c9afffef96f64d0e6625c9338e"', 'PartNumber': 1} 2024-09-14T11:05:52.769 INFO:tasks.workunit.client.0.smithi050.stdout:phase 2 uploaded part {'ETag': '"15cbe6c9afffef96f64d0e6625c9338e"', 'PartNumber': 1} 2024-09-14T11:05:52.769 INFO:tasks.workunit.client.0.smithi050.stdout:phase 2 uploaded part {'ETag': '"15cbe6c9afffef96f64d0e6625c9338e"', 'PartNumber': 1} 2024-09-14T11:05:52.769 INFO:tasks.workunit.client.0.smithi050.stdout:phase 2 uploaded part {'ETag': '"15cbe6c9afffef96f64d0e6625c9338e"', 'PartNumber': 1} 2024-09-14T11:05:52.769 INFO:tasks.workunit.client.0.smithi050.stdout:phase 2 uploaded part {'ETag': '"15cbe6c9afffef96f64d0e6625c9338e"', 'PartNumber': 1} 2024-09-14T11:05:52.769 INFO:tasks.workunit.client.0.smithi050.stdout:phase 2 uploaded part {'ETag': '"15cbe6c9afffef96f64d0e6625c9338e"', 'PartNumber': 1} 2024-09-14T11:05:52.769 INFO:tasks.workunit.client.0.smithi050.stdout:phase 2 uploaded part {'ETag': '"15cbe6c9afffef96f64d0e6625c9338e"', 'PartNumber': 1} 2024-09-14T11:05:52.769 INFO:tasks.workunit.client.0.smithi050.stdout:phase 2 uploaded part {'ETag': '"15cbe6c9afffef96f64d0e6625c9338e"', 'PartNumber': 1} 2024-09-14T11:05:52.770 INFO:tasks.workunit.client.0.smithi050.stdout:phase 2 uploaded part {'ETag': '"15cbe6c9afffef96f64d0e6625c9338e"', 'PartNumber': 1} 2024-09-14T11:05:52.770 INFO:tasks.workunit.client.0.smithi050.stdout:aborting multipart upload, parts=[{'ETag': '"15cbe6c9afffef96f64d0e6625c9338e"', 'PartNumber': 1}, {'ETag': '"15cbe6c9afffef96f64d0e6625c9338e"', 'PartNumber': 2}] 2024-09-14T11:05:54.219 INFO:tasks.workunit.client.0.smithi050.stdout:radosgw-admin bucket radoslist: 2024-09-14T11:05:54.285 INFO:tasks.workunit.client.0.smithi050.stdout:rados ls: 2024-09-14T11:05:54.290 INFO:tasks.workunit.client.0.smithi050.stdout:== PASSED == 2024-09-14T11:05:54.290 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:05:54.291 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:05:54.372 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-14T11:05:54.372 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:05:54.805 DEBUG:teuthology.parallel:result is None 2024-09-14T11:05:54.806 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:05:54.845 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:05:54.845 DEBUG:teuthology.orchestra.run.smithi050:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:05:54.916 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:05:54.916 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-14T11:05:54.934 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-14T11:05:54.934 INFO:tasks.ragweed:Downloading ragweed... 2024-09-14T11:05:54.935 INFO:tasks.ragweed:Using branch 'main' for ragweed 2024-09-14T11:05:54.935 DEBUG:teuthology.orchestra.run.smithi050:> git clone -b main https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:05:54.985 INFO:teuthology.orchestra.run.smithi050.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:05:55.014 INFO:teuthology.orchestra.run.smithi050.stderr:fatal: Remote branch main not found in upstream origin 2024-09-14T11:05:55.015 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-14T11:05:55.016 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-14T11:05:55.016 DEBUG:teuthology.orchestra.run.smithi050:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:05:55.086 INFO:teuthology.orchestra.run.smithi050.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:05:55.230 INFO:tasks.ragweed:Creating rgw users... 2024-09-14T11:05:55.231 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-14T11:05:55.231 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key BXTSXOPTETQHROKOTBGQ --secret CzUpowSpooGkaT+hQhZnltLKWWeHroPH/fhuzOFg+BFIdxWslYKaeg== --email ragweed.client.0+test@test.test --system false 2024-09-14T11:05:55.340 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:55.340 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:55.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.575+0000 7f53b9f92640 0 --2- 172.21.15.50:0/4085533425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a63e56a690 0x55a63e56aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:05:55.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.579+0000 7f53be813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.581+0000 7f53be813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.581+0000 7f53be813800 20 realm 2024-09-14T11:05:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.581+0000 7f53be813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.581+0000 7f53be813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.581+0000 7f53be813800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.581+0000 7f53be813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.581+0000 7f53be813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.581+0000 7f53be813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:55.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.582+0000 7f53be813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:55.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.582+0000 7f53be813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:55.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.583+0000 7f53be813800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:55.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.583+0000 7f53be813800 20 searching for the correct realm 2024-09-14T11:05:55.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.584+0000 7f53b9f92640 0 -- 172.21.15.50:0/3535757453 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x7f53b4055410 msgr2=0x7f53b4055830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:05:55.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.790+0000 7f53ba793640 0 -- 172.21.15.50:0/3535757453 >> [v2:172.21.15.118:6826/1082138742,v1:172.21.15.118:6827/1082138742] conn(0x7f53ac022070 msgr2=0x7f53ac07fac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:55.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.999+0000 7f53be813800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:05:55.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.999+0000 7f53be813800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:55.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.999+0000 7f53be813800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:05:55.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.999+0000 7f53be813800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:55.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.999+0000 7f53be813800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:55.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.999+0000 7f53be813800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:55.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.999+0000 7f53be813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:55.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.999+0000 7f53be813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:55.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.999+0000 7f53be813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:56.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.999+0000 7f53be813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:56.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:55.999+0000 7f53be813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:56.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.000+0000 7f53be813800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:56.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.000+0000 7f53be813800 20 zone default found 2024-09-14T11:05:56.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.000+0000 7f53be813800 4 Realm: () 2024-09-14T11:05:56.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.000+0000 7f53be813800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:05:56.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.000+0000 7f53be813800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:05:56.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.000+0000 7f53be813800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:56.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.000+0000 7f53be813800 20 zonegroup default 2024-09-14T11:05:56.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.000+0000 7f53be813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:56.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.000+0000 7f53be813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:56.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.000+0000 7f53be813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:56.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.001+0000 7f53be813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:56.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.001+0000 7f53be813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:56.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.001+0000 7f53be813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:56.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.001+0000 7f53be813800 20 started sync module instance, tier type = 2024-09-14T11:05:56.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.001+0000 7f53be813800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:05:56.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.012+0000 7f53be813800 20 add_watcher() i=0 2024-09-14T11:05:56.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.012+0000 7f53be813800 20 add_watcher() i=1 2024-09-14T11:05:56.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.012+0000 7f53be813800 20 add_watcher() i=2 2024-09-14T11:05:56.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.012+0000 7f53be813800 20 add_watcher() i=3 2024-09-14T11:05:56.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.012+0000 7f53be813800 20 add_watcher() i=4 2024-09-14T11:05:56.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.012+0000 7f53be813800 20 add_watcher() i=5 2024-09-14T11:05:56.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.012+0000 7f53be813800 20 add_watcher() i=6 2024-09-14T11:05:56.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.013+0000 7f53be813800 20 add_watcher() i=7 2024-09-14T11:05:56.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.013+0000 7f53be813800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:56.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.015+0000 7f526b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:56.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.015+0000 7f53be813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:56.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.015+0000 7f53be813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:56.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.015+0000 7f53be813800 5 note: GC not initialized 2024-09-14T11:05:56.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.016+0000 7f526a7fc640 20 reqs_thread_entry: start 2024-09-14T11:05:56.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.016+0000 7f53be813800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:56.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.016+0000 7f53be813800 20 Filter name: none 2024-09-14T11:05:56.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.016+0000 7f51dbfff640 20 reqs_thread_entry: start 2024-09-14T11:05:56.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.016+0000 7f53be813800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:05:56.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.016+0000 7f53be813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:56.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.017+0000 7f53be813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:56.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.017+0000 7f53be813800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-14T11:05:56.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.017+0000 7f53be813800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:05:56.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.017+0000 7f53be813800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-14T11:05:56.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.017+0000 7f53be813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:56.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.017+0000 7f53be813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:56.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.017+0000 7f53be813800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-14T11:05:56.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.017+0000 7f53be813800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:05:56.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.017+0000 7f53be813800 10 cache get: name=default.rgw.meta+users.keys+BXTSXOPTETQHROKOTBGQ : miss 2024-09-14T11:05:56.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.017+0000 7f53be813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:56.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.017+0000 7f53be813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:56.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.017+0000 7f53be813800 10 cache put: name=default.rgw.meta+users.keys+BXTSXOPTETQHROKOTBGQ info.flags=0x0 2024-09-14T11:05:56.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.017+0000 7f53be813800 10 adding default.rgw.meta+users.keys+BXTSXOPTETQHROKOTBGQ to cache LRU end 2024-09-14T11:05:56.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.018+0000 7f53be813800 10 cache get: name=default.rgw.meta+users.keys+BXTSXOPTETQHROKOTBGQ : hit (negative entry) 2024-09-14T11:05:56.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.018+0000 7f53be813800 10 cache get: name=default.rgw.meta+users.keys+BXTSXOPTETQHROKOTBGQ : hit (negative entry) 2024-09-14T11:05:56.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.019+0000 7f53be813800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:05:56.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.019+0000 7f53be813800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:05:56.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.019+0000 7f53be813800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:05:56.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.019+0000 7f529d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693243 cookie 94172498978192 notifier 5964 bl.length()=675 2024-09-14T11:05:56.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.019+0000 7f529d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:05:56.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.019+0000 7f529d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:05:56.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.023+0000 7f53be813800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:05:56.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.023+0000 7f53be813800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:05:56.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.023+0000 7f53be813800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:05:56.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.023+0000 7f529d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693194 cookie 94172498963408 notifier 5964 bl.length()=202 2024-09-14T11:05:56.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.023+0000 7f529d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:05:56.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.023+0000 7f529d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:05:56.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.027+0000 7f53be813800 10 cache put: name=default.rgw.meta+users.keys+BXTSXOPTETQHROKOTBGQ info.flags=0x7 2024-09-14T11:05:56.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.027+0000 7f53be813800 10 moving default.rgw.meta+users.keys+BXTSXOPTETQHROKOTBGQ to cache LRU end 2024-09-14T11:05:56.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.027+0000 7f53be813800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:BXTSXOPTETQHROKOTBGQ, ofs0, ns] 2024-09-14T11:05:56.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.027+0000 7f529cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693195 cookie 94172498963408 notifier 5964 bl.length()=190 2024-09-14T11:05:56.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.027+0000 7f529cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+BXTSXOPTETQHROKOTBGQ info.flags=0x7 2024-09-14T11:05:56.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.027+0000 7f529cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+BXTSXOPTETQHROKOTBGQ to cache LRU end 2024-09-14T11:05:56.027 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-14T11:05:56.027 INFO:teuthology.orchestra.run.smithi050.stdout: "user_id": "ragweed.client.0", 2024-09-14T11:05:56.027 INFO:teuthology.orchestra.run.smithi050.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-14T11:05:56.027 INFO:teuthology.orchestra.run.smithi050.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-14T11:05:56.027 INFO:teuthology.orchestra.run.smithi050.stdout: "suspended": 0, 2024-09-14T11:05:56.027 INFO:teuthology.orchestra.run.smithi050.stdout: "max_buckets": 1000, 2024-09-14T11:05:56.027 INFO:teuthology.orchestra.run.smithi050.stdout: "subusers": [], 2024-09-14T11:05:56.027 INFO:teuthology.orchestra.run.smithi050.stdout: "keys": [ 2024-09-14T11:05:56.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-14T11:05:56.027 INFO:teuthology.orchestra.run.smithi050.stdout: "user": "ragweed.client.0", 2024-09-14T11:05:56.028 INFO:teuthology.orchestra.run.smithi050.stdout: "access_key": "BXTSXOPTETQHROKOTBGQ", 2024-09-14T11:05:56.028 INFO:teuthology.orchestra.run.smithi050.stdout: "secret_key": "CzUpowSpooGkaT+hQhZnltLKWWeHroPH/fhuzOFg+BFIdxWslYKaeg==", 2024-09-14T11:05:56.028 INFO:teuthology.orchestra.run.smithi050.stdout: "active": true, 2024-09-14T11:05:56.028 INFO:teuthology.orchestra.run.smithi050.stdout: "create_date": "2024-09-14T11:05:56.019408Z" 2024-09-14T11:05:56.028 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-14T11:05:56.028 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-14T11:05:56.028 INFO:teuthology.orchestra.run.smithi050.stdout: "swift_keys": [], 2024-09-14T11:05:56.028 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": [], 2024-09-14T11:05:56.028 INFO:teuthology.orchestra.run.smithi050.stdout: "op_mask": "read, write, delete", 2024-09-14T11:05:56.028 INFO:teuthology.orchestra.run.smithi050.stdout: "default_placement": "", 2024-09-14T11:05:56.028 INFO:teuthology.orchestra.run.smithi050.stdout: "default_storage_class": "", 2024-09-14T11:05:56.028 INFO:teuthology.orchestra.run.smithi050.stdout: "placement_tags": [], 2024-09-14T11:05:56.028 INFO:teuthology.orchestra.run.smithi050.stdout: "bucket_quota": { 2024-09-14T11:05:56.029 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:05:56.029 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:05:56.029 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:05:56.029 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:05:56.029 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:05:56.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:05:56.029 INFO:teuthology.orchestra.run.smithi050.stdout: "user_quota": { 2024-09-14T11:05:56.029 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:05:56.029 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:05:56.029 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:05:56.029 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:05:56.029 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:05:56.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:05:56.029 INFO:teuthology.orchestra.run.smithi050.stdout: "temp_url_keys": [], 2024-09-14T11:05:56.030 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "rgw", 2024-09-14T11:05:56.030 INFO:teuthology.orchestra.run.smithi050.stdout: "mfa_ids": [], 2024-09-14T11:05:56.030 INFO:teuthology.orchestra.run.smithi050.stdout: "account_id": "", 2024-09-14T11:05:56.030 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-09-14T11:05:56.030 INFO:teuthology.orchestra.run.smithi050.stdout: "create_date": "2024-09-14T11:05:56.019381Z", 2024-09-14T11:05:56.030 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-14T11:05:56.030 INFO:teuthology.orchestra.run.smithi050.stdout: "group_ids": [] 2024-09-14T11:05:56.030 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-14T11:05:56.030 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:05:56.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.029+0000 7f526b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:56.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.032+0000 7f53be813800 20 remove_watcher() i=0 2024-09-14T11:05:56.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.032+0000 7f53be813800 2 removed watcher, disabling cache 2024-09-14T11:05:56.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.033+0000 7f53be813800 20 remove_watcher() i=1 2024-09-14T11:05:56.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.034+0000 7f53be813800 20 remove_watcher() i=2 2024-09-14T11:05:56.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.035+0000 7f53be813800 20 remove_watcher() i=3 2024-09-14T11:05:56.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.036+0000 7f53be813800 20 remove_watcher() i=4 2024-09-14T11:05:56.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.038+0000 7f53be813800 20 remove_watcher() i=5 2024-09-14T11:05:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.039+0000 7f53be813800 20 remove_watcher() i=6 2024-09-14T11:05:56.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.040+0000 7f53be813800 20 remove_watcher() i=7 2024-09-14T11:05:56.053 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-14T11:05:56.053 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key ZCJIJNWGIQDACWLYPPCO --secret 1ol/TwD4RV9TJZeXVdJZGP6Ho5UH/c1aPINIOggzR6QQTijo/W3cXg== --email sysuser.client.0+test@test.test --system true 2024-09-14T11:05:56.126 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:56.126 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:56.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.165+0000 7ffafa0b9800 20 rados->read ofs=0 len=0 2024-09-14T11:05:56.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.167+0000 7ffafa0b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:56.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.167+0000 7ffafa0b9800 20 realm 2024-09-14T11:05:56.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.167+0000 7ffafa0b9800 20 rados->read ofs=0 len=0 2024-09-14T11:05:56.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.167+0000 7ffafa0b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:56.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.167+0000 7ffafa0b9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:56.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.167+0000 7ffafa0b9800 20 rados->read ofs=0 len=0 2024-09-14T11:05:56.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.168+0000 7ffafa0b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:56.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.168+0000 7ffafa0b9800 20 rados->read ofs=0 len=0 2024-09-14T11:05:56.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.168+0000 7ffafa0b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:56.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.168+0000 7ffafa0b9800 20 rados->read ofs=0 len=0 2024-09-14T11:05:56.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.169+0000 7ffafa0b9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:56.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.169+0000 7ffafa0b9800 20 searching for the correct realm 2024-09-14T11:05:56.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.173+0000 7ffaeffff640 0 -- 172.21.15.50:0/3629604091 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7ffaf0029950 msgr2=0x7ffaf0037400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:05:56.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.379+0000 7ffaf83a4640 0 -- 172.21.15.50:0/3629604091 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5569f78153b0 msgr2=0x5569f7817820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:56.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.384+0000 7ffafa0b9800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:05:56.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.384+0000 7ffafa0b9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:56.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.384+0000 7ffafa0b9800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:05:56.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.384+0000 7ffafa0b9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:56.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.384+0000 7ffafa0b9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:56.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.384+0000 7ffafa0b9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:56.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.384+0000 7ffafa0b9800 20 rados->read ofs=0 len=0 2024-09-14T11:05:56.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.384+0000 7ffafa0b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:56.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.384+0000 7ffafa0b9800 20 rados->read ofs=0 len=0 2024-09-14T11:05:56.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.385+0000 7ffafa0b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:56.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.385+0000 7ffafa0b9800 20 rados->read ofs=0 len=0 2024-09-14T11:05:56.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.385+0000 7ffafa0b9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:56.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.385+0000 7ffafa0b9800 20 zone default found 2024-09-14T11:05:56.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.385+0000 7ffafa0b9800 4 Realm: () 2024-09-14T11:05:56.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.385+0000 7ffafa0b9800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:05:56.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.385+0000 7ffafa0b9800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:05:56.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.385+0000 7ffafa0b9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:56.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.385+0000 7ffafa0b9800 20 zonegroup default 2024-09-14T11:05:56.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.385+0000 7ffafa0b9800 20 rados->read ofs=0 len=0 2024-09-14T11:05:56.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.385+0000 7ffafa0b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:56.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.385+0000 7ffafa0b9800 20 rados->read ofs=0 len=0 2024-09-14T11:05:56.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.386+0000 7ffafa0b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:56.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.386+0000 7ffafa0b9800 20 rados->read ofs=0 len=0 2024-09-14T11:05:56.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.386+0000 7ffafa0b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:56.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.386+0000 7ffafa0b9800 20 started sync module instance, tier type = 2024-09-14T11:05:56.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.386+0000 7ffafa0b9800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:05:56.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.396+0000 7ffafa0b9800 20 add_watcher() i=0 2024-09-14T11:05:56.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.396+0000 7ffafa0b9800 20 add_watcher() i=1 2024-09-14T11:05:56.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.396+0000 7ffafa0b9800 20 add_watcher() i=2 2024-09-14T11:05:56.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.396+0000 7ffafa0b9800 20 add_watcher() i=3 2024-09-14T11:05:56.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.396+0000 7ffafa0b9800 20 add_watcher() i=4 2024-09-14T11:05:56.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.396+0000 7ffafa0b9800 20 add_watcher() i=5 2024-09-14T11:05:56.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.396+0000 7ffafa0b9800 20 add_watcher() i=6 2024-09-14T11:05:56.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.397+0000 7ffafa0b9800 20 add_watcher() i=7 2024-09-14T11:05:56.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.397+0000 7ffafa0b9800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:56.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.399+0000 7ff9adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:56.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.399+0000 7ffafa0b9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:56.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.399+0000 7ffafa0b9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:56.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.399+0000 7ffafa0b9800 5 note: GC not initialized 2024-09-14T11:05:56.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.400+0000 7ff9acfe1640 20 reqs_thread_entry: start 2024-09-14T11:05:56.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.400+0000 7ffafa0b9800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:56.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.400+0000 7ffafa0b9800 20 Filter name: none 2024-09-14T11:05:56.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.400+0000 7ff9267fc640 20 reqs_thread_entry: start 2024-09-14T11:05:56.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.400+0000 7ffafa0b9800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:05:56.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.400+0000 7ffafa0b9800 20 rados->read ofs=0 len=0 2024-09-14T11:05:56.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.400+0000 7ffafa0b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:56.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.400+0000 7ffafa0b9800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-14T11:05:56.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.400+0000 7ffafa0b9800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:05:56.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.400+0000 7ffafa0b9800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-14T11:05:56.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.400+0000 7ffafa0b9800 20 rados->read ofs=0 len=0 2024-09-14T11:05:56.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.401+0000 7ffafa0b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:56.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.401+0000 7ffafa0b9800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-14T11:05:56.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.401+0000 7ffafa0b9800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:05:56.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.401+0000 7ffafa0b9800 10 cache get: name=default.rgw.meta+users.keys+ZCJIJNWGIQDACWLYPPCO : miss 2024-09-14T11:05:56.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.401+0000 7ffafa0b9800 20 rados->read ofs=0 len=0 2024-09-14T11:05:56.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.401+0000 7ffafa0b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:56.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.401+0000 7ffafa0b9800 10 cache put: name=default.rgw.meta+users.keys+ZCJIJNWGIQDACWLYPPCO info.flags=0x0 2024-09-14T11:05:56.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.401+0000 7ffafa0b9800 10 adding default.rgw.meta+users.keys+ZCJIJNWGIQDACWLYPPCO to cache LRU end 2024-09-14T11:05:56.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.401+0000 7ffafa0b9800 10 cache get: name=default.rgw.meta+users.keys+ZCJIJNWGIQDACWLYPPCO : hit (negative entry) 2024-09-14T11:05:56.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.401+0000 7ffafa0b9800 10 cache get: name=default.rgw.meta+users.keys+ZCJIJNWGIQDACWLYPPCO : hit (negative entry) 2024-09-14T11:05:56.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.402+0000 7ffafa0b9800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:05:56.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.402+0000 7ffafa0b9800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:05:56.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.402+0000 7ffafa0b9800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:05:56.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.403+0000 7ff9d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693196 cookie 93913612382096 notifier 5982 bl.length()=675 2024-09-14T11:05:56.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.403+0000 7ff9d6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:05:56.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.403+0000 7ff9d6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:05:56.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.405+0000 7ffafa0b9800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:05:56.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.405+0000 7ffafa0b9800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:05:56.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.405+0000 7ffafa0b9800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:05:56.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.406+0000 7ff9d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693244 cookie 93913612447920 notifier 5982 bl.length()=202 2024-09-14T11:05:56.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.406+0000 7ff9d6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:05:56.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.406+0000 7ff9d6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:05:56.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.408+0000 7ffafa0b9800 10 cache put: name=default.rgw.meta+users.keys+ZCJIJNWGIQDACWLYPPCO info.flags=0x7 2024-09-14T11:05:56.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.408+0000 7ffafa0b9800 10 moving default.rgw.meta+users.keys+ZCJIJNWGIQDACWLYPPCO to cache LRU end 2024-09-14T11:05:56.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.408+0000 7ffafa0b9800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:ZCJIJNWGIQDACWLYPPCO, ofs0, ns] 2024-09-14T11:05:56.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.409+0000 7ff9d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693245 cookie 93913612447920 notifier 5982 bl.length()=190 2024-09-14T11:05:56.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.409+0000 7ff9d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ZCJIJNWGIQDACWLYPPCO info.flags=0x7 2024-09-14T11:05:56.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.409+0000 7ff9d67fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ZCJIJNWGIQDACWLYPPCO to cache LRU end 2024-09-14T11:05:56.409 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-14T11:05:56.409 INFO:teuthology.orchestra.run.smithi050.stdout: "user_id": "sysuser.client.0", 2024-09-14T11:05:56.409 INFO:teuthology.orchestra.run.smithi050.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-14T11:05:56.409 INFO:teuthology.orchestra.run.smithi050.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-14T11:05:56.409 INFO:teuthology.orchestra.run.smithi050.stdout: "suspended": 0, 2024-09-14T11:05:56.409 INFO:teuthology.orchestra.run.smithi050.stdout: "max_buckets": 1000, 2024-09-14T11:05:56.409 INFO:teuthology.orchestra.run.smithi050.stdout: "subusers": [], 2024-09-14T11:05:56.409 INFO:teuthology.orchestra.run.smithi050.stdout: "keys": [ 2024-09-14T11:05:56.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-14T11:05:56.409 INFO:teuthology.orchestra.run.smithi050.stdout: "user": "sysuser.client.0", 2024-09-14T11:05:56.409 INFO:teuthology.orchestra.run.smithi050.stdout: "access_key": "ZCJIJNWGIQDACWLYPPCO", 2024-09-14T11:05:56.409 INFO:teuthology.orchestra.run.smithi050.stdout: "secret_key": "1ol/TwD4RV9TJZeXVdJZGP6Ho5UH/c1aPINIOggzR6QQTijo/W3cXg==", 2024-09-14T11:05:56.410 INFO:teuthology.orchestra.run.smithi050.stdout: "active": true, 2024-09-14T11:05:56.410 INFO:teuthology.orchestra.run.smithi050.stdout: "create_date": "2024-09-14T11:05:56.402761Z" 2024-09-14T11:05:56.410 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-14T11:05:56.410 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-14T11:05:56.410 INFO:teuthology.orchestra.run.smithi050.stdout: "swift_keys": [], 2024-09-14T11:05:56.410 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": [], 2024-09-14T11:05:56.410 INFO:teuthology.orchestra.run.smithi050.stdout: "op_mask": "read, write, delete", 2024-09-14T11:05:56.410 INFO:teuthology.orchestra.run.smithi050.stdout: "system": true, 2024-09-14T11:05:56.410 INFO:teuthology.orchestra.run.smithi050.stdout: "default_placement": "", 2024-09-14T11:05:56.410 INFO:teuthology.orchestra.run.smithi050.stdout: "default_storage_class": "", 2024-09-14T11:05:56.410 INFO:teuthology.orchestra.run.smithi050.stdout: "placement_tags": [], 2024-09-14T11:05:56.410 INFO:teuthology.orchestra.run.smithi050.stdout: "bucket_quota": { 2024-09-14T11:05:56.410 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:05:56.411 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:05:56.411 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:05:56.411 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:05:56.411 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:05:56.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:05:56.411 INFO:teuthology.orchestra.run.smithi050.stdout: "user_quota": { 2024-09-14T11:05:56.411 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:05:56.411 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:05:56.411 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:05:56.411 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:05:56.411 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:05:56.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:05:56.411 INFO:teuthology.orchestra.run.smithi050.stdout: "temp_url_keys": [], 2024-09-14T11:05:56.412 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "rgw", 2024-09-14T11:05:56.412 INFO:teuthology.orchestra.run.smithi050.stdout: "mfa_ids": [], 2024-09-14T11:05:56.412 INFO:teuthology.orchestra.run.smithi050.stdout: "account_id": "", 2024-09-14T11:05:56.412 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-09-14T11:05:56.412 INFO:teuthology.orchestra.run.smithi050.stdout: "create_date": "2024-09-14T11:05:56.402749Z", 2024-09-14T11:05:56.412 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-14T11:05:56.412 INFO:teuthology.orchestra.run.smithi050.stdout: "group_ids": [] 2024-09-14T11:05:56.412 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-14T11:05:56.412 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:05:56.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.411+0000 7ff9adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:56.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.413+0000 7ffafa0b9800 20 remove_watcher() i=0 2024-09-14T11:05:56.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.413+0000 7ffafa0b9800 2 removed watcher, disabling cache 2024-09-14T11:05:56.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.414+0000 7ffafa0b9800 20 remove_watcher() i=1 2024-09-14T11:05:56.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.415+0000 7ffafa0b9800 20 remove_watcher() i=2 2024-09-14T11:05:56.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.416+0000 7ffafa0b9800 20 remove_watcher() i=3 2024-09-14T11:05:56.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.417+0000 7ffafa0b9800 20 remove_watcher() i=4 2024-09-14T11:05:56.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.418+0000 7ffafa0b9800 20 remove_watcher() i=5 2024-09-14T11:05:56.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.420+0000 7ffafa0b9800 20 remove_watcher() i=6 2024-09-14T11:05:56.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:05:56.421+0000 7ffafa0b9800 20 remove_watcher() i=7 2024-09-14T11:05:56.432 INFO:tasks.ragweed:Configuring ragweed... 2024-09-14T11:05:56.432 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T11:05:56.433 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-14T11:05:56.463 INFO:tasks.ragweed:Configuring boto... 2024-09-14T11:05:56.463 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T11:05:56.463 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-14T11:05:56.532 DEBUG:teuthology.orchestra.run.smithi050:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-14T11:05:56.728 INFO:teuthology.orchestra.run.smithi050.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-14T11:05:56.905 INFO:teuthology.orchestra.run.smithi050.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-14T11:05:57.501 INFO:teuthology.orchestra.run.smithi050.stdout:py installdeps: -rrequirements.txt 2024-09-14T11:06:04.058 INFO:teuthology.orchestra.run.smithi050.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-14T11:06:07.666 INFO:teuthology.orchestra.run.smithi050.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.0,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=ca0bfba5f265046783a822fbaabd969e3ccd921265f29fe68934596f85568927,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-14T11:06:07.666 INFO:teuthology.orchestra.run.smithi050.stdout:py run-test-pre: PYTHONHASHSEED='1628233580' 2024-09-14T11:06:07.666 INFO:teuthology.orchestra.run.smithi050.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-14T11:06:07.876 INFO:teuthology.orchestra.run.smithi050.stdout:============================= test session starts ============================== 2024-09-14T11:06:07.877 INFO:teuthology.orchestra.run.smithi050.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-14T11:06:07.877 INFO:teuthology.orchestra.run.smithi050.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T11:06:07.877 INFO:teuthology.orchestra.run.smithi050.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:06:07.877 INFO:teuthology.orchestra.run.smithi050.stdout:configfile: pytest.ini 2024-09-14T11:06:07.977 INFO:teuthology.orchestra.run.smithi050.stdout:collecting ... collected 9 items 2024-09-14T11:06:07.978 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:06:13.707 INFO:teuthology.orchestra.run.smithi050.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-14T11:06:20.532 INFO:teuthology.orchestra.run.smithi050.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-14T11:06:25.311 INFO:teuthology.orchestra.run.smithi050.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-14T11:06:33.405 INFO:teuthology.orchestra.run.smithi050.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-14T11:06:40.160 INFO:teuthology.orchestra.run.smithi050.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-14T11:06:56.044 INFO:teuthology.orchestra.run.smithi050.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-14T11:07:08.819 INFO:teuthology.orchestra.run.smithi050.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-14T11:07:23.218 INFO:teuthology.orchestra.run.smithi050.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-14T11:07:50.783 INFO:teuthology.orchestra.run.smithi050.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-14T11:07:50.784 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:07:50.784 INFO:teuthology.orchestra.run.smithi050.stdout:=============================== warnings summary =============================== 2024-09-14T11:07:50.784 INFO:teuthology.orchestra.run.smithi050.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-14T11:07:50.784 INFO:teuthology.orchestra.run.smithi050.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-14T11:07:50.784 INFO:teuthology.orchestra.run.smithi050.stdout: import imp 2024-09-14T11:07:50.784 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:07:50.784 INFO:teuthology.orchestra.run.smithi050.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-14T11:07:50.784 INFO:teuthology.orchestra.run.smithi050.stdout:=================== 9 passed, 1 warning in 102.91s (0:01:42) =================== 2024-09-14T11:07:50.814 INFO:teuthology.orchestra.run.smithi050.stdout:___________________________________ summary ____________________________________ 2024-09-14T11:07:50.814 INFO:teuthology.orchestra.run.smithi050.stdout: py: commands succeeded 2024-09-14T11:07:50.814 INFO:teuthology.orchestra.run.smithi050.stdout: congratulations :) 2024-09-14T11:07:50.832 INFO:tasks.ragweed:Cleaning up boto... 2024-09-14T11:07:50.833 DEBUG:teuthology.orchestra.run.smithi050:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-14T11:07:50.863 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-14T11:07:50.961 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:07:50.961 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:07:50.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:50.999+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.001+0000 7fbdec723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:51.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.001+0000 7fbdec723800 20 realm 2024-09-14T11:07:51.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.001+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.001+0000 7fbdec723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:51.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.001+0000 7fbdec723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:07:51.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.001+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.001+0000 7fbdec723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:51.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.001+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.002+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:51.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.002+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.003+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:07:51.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.003+0000 7fbdec723800 20 searching for the correct realm 2024-09-14T11:07:51.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.006+0000 7fbde7bad640 0 -- 172.21.15.50:0/1393452156 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fbde00c8d70 msgr2=0x7fbde00b1e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:51.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.211+0000 7fbde8baf640 0 -- 172.21.15.50:0/1393452156 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55b7d7d7abc0 msgr2=0x55b7d7d7d050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:51.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.216+0000 7fbdec723800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:07:51.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.216+0000 7fbdec723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:07:51.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.216+0000 7fbdec723800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:07:51.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.216+0000 7fbdec723800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:07:51.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.216+0000 7fbdec723800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:07:51.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.216+0000 7fbdec723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:07:51.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.216+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.216+0000 7fbdec723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:51.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.216+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.216+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:51.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.216+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.217+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:07:51.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.217+0000 7fbdec723800 20 zone default found 2024-09-14T11:07:51.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.217+0000 7fbdec723800 4 Realm: () 2024-09-14T11:07:51.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.217+0000 7fbdec723800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:07:51.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.217+0000 7fbdec723800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:07:51.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.217+0000 7fbdec723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:07:51.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.217+0000 7fbdec723800 20 zonegroup default 2024-09-14T11:07:51.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.217+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.217+0000 7fbdec723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:51.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.217+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.218+0000 7fbdec723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:51.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.218+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.218+0000 7fbdec723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:51.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.218+0000 7fbdec723800 20 started sync module instance, tier type = 2024-09-14T11:07:51.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.218+0000 7fbdec723800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:07:51.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.228+0000 7fbdec723800 20 add_watcher() i=0 2024-09-14T11:07:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.228+0000 7fbdec723800 20 add_watcher() i=1 2024-09-14T11:07:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.228+0000 7fbdec723800 20 add_watcher() i=2 2024-09-14T11:07:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.228+0000 7fbdec723800 20 add_watcher() i=3 2024-09-14T11:07:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.228+0000 7fbdec723800 20 add_watcher() i=4 2024-09-14T11:07:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.228+0000 7fbdec723800 20 add_watcher() i=5 2024-09-14T11:07:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.228+0000 7fbdec723800 20 add_watcher() i=6 2024-09-14T11:07:51.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.230+0000 7fbdec723800 20 add_watcher() i=7 2024-09-14T11:07:51.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.230+0000 7fbdec723800 2 all 8 watchers are set, enabling cache 2024-09-14T11:07:51.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.231+0000 7fbc9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:51.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.232+0000 7fbdec723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:07:51.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.232+0000 7fbdec723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:07:51.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.269+0000 7fbc9dfdb640 20 reqs_thread_entry: start 2024-09-14T11:07:51.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.269+0000 7fbdec723800 20 init_complete bucket index max shards: 11 2024-09-14T11:07:51.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.269+0000 7fbdec723800 20 Filter name: none 2024-09-14T11:07:51.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.269+0000 7fbc0f7fe640 20 reqs_thread_entry: start 2024-09-14T11:07:51.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.269+0000 7fbdec723800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:07:51.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.269+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.270+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:07:51.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.270+0000 7fbdec723800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-14T11:07:51.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.270+0000 7fbdec723800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:07:51.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.270+0000 7fbdec723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:07:51.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.270+0000 7fbdec723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5 : miss 2024-09-14T11:07:51.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.270+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.271+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=426 2024-09-14T11:07:51.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.271+0000 7fbdec723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5 info.flags=0x17 2024-09-14T11:07:51.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.271+0000 7fbdec723800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5 to cache LRU end 2024-09-14T11:07:51.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.271+0000 7fbdec723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:07:51.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.271+0000 7fbdec723800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:07:51.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.271+0000 7fbdec723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5 2024-09-14T11:07:51.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.272+0000 7fbdec723800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:07:51.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.272+0000 7fbdec723800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-14T11:07:51.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.272+0000 7fbdec723800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-14T11:07:51.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.273+0000 7fbdec723800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-14T11:07:51.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.273+0000 7fbdec723800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-14T11:07:51.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.273+0000 7fbdec723800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-14T11:07:51.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.273+0000 7fbdec723800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-14T11:07:51.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.274+0000 7fbdec723800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-14T11:07:51.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.275+0000 7fbdec723800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-14T11:07:51.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.276+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc00cba0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55b7d7e48388 s->prefetch_data=0 2024-09-14T11:07:51.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.276+0000 7fbdec723800 10 manifest: total_size = 7743 2024-09-14T11:07:51.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.276+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18013023058057876007 2024-09-14T11:07:51.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.276+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc00cba0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55b7d7e48388 s->prefetch_data=0 2024-09-14T11:07:51.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.276+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7e48388 2024-09-14T11:07:51.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.276+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5.1 2024-09-14T11:07:51.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.278+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.278+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=7743 stripe_ofs=7743 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.278+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18013023058057876007 2024-09-14T11:07:51.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.278+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.278+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5__shadow_.MEehKmWvm4Yxxmc1INEjYec7imJyuqr_0 2024-09-14T11:07:51.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.278+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:07:51.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.278+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.278+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18013023058057876007 2024-09-14T11:07:51.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.280+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:07:51.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.280+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc00cba0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55b7d7dd0518 s->prefetch_data=0 2024-09-14T11:07:51.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.280+0000 7fbdec723800 10 manifest: total_size = 12853 2024-09-14T11:07:51.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.280+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6402141229435967846 2024-09-14T11:07:51.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.280+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc00cba0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55b7d7dd0518 s->prefetch_data=0 2024-09-14T11:07:51.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.280+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dd0518 2024-09-14T11:07:51.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.280+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5.2 2024-09-14T11:07:51.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.283+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.283+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=12853 stripe_ofs=12853 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.283+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6402141229435967846 2024-09-14T11:07:51.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.283+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.283+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5__shadow_.uMOnYhFbG__2EusHneF_lZJUK4cdx44_0 2024-09-14T11:07:51.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.283+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:07:51.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.283+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.283+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6402141229435967846 2024-09-14T11:07:51.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.284+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-14T11:07:51.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.284+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc00cba0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55b7d7dd0518 s->prefetch_data=0 2024-09-14T11:07:51.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.285+0000 7fbdec723800 10 manifest: total_size = 7699 2024-09-14T11:07:51.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.285+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18129315400251047105 2024-09-14T11:07:51.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.285+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc00cba0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55b7d7dd0518 s->prefetch_data=0 2024-09-14T11:07:51.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.285+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dd0518 2024-09-14T11:07:51.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.285+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5.2 2024-09-14T11:07:51.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.287+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.287+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=7699 stripe_ofs=7699 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.287+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18129315400251047105 2024-09-14T11:07:51.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.287+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.287+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5__shadow_.je400QGZU1z2gFko4Usi80sZRTQBNiQ_0 2024-09-14T11:07:51.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.287+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:07:51.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.287+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.287+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18129315400251047105 2024-09-14T11:07:51.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.288+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-14T11:07:51.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.289+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7dd1710 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55b7d7dd0518 s->prefetch_data=0 2024-09-14T11:07:51.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.289+0000 7fbdec723800 10 manifest: total_size = 13128 2024-09-14T11:07:51.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.289+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1595887430788903042 2024-09-14T11:07:51.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.289+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7dd1710 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55b7d7dd0518 s->prefetch_data=0 2024-09-14T11:07:51.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.289+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dd0518 2024-09-14T11:07:51.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.289+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5.3 2024-09-14T11:07:51.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.291+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.291+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=13128 stripe_ofs=13128 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.291+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1595887430788903042 2024-09-14T11:07:51.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.291+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.291+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5__shadow_.CAO_TaFw2oOMzh6zBDVpCHWOj5IFAHv_0 2024-09-14T11:07:51.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.291+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:07:51.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.291+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.291+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1595887430788903042 2024-09-14T11:07:51.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.293+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc00ce10 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55b7d7dd0518 s->prefetch_data=0 2024-09-14T11:07:51.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.293+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-14T11:07:51.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.293+0000 7fbdec723800 10 manifest: total_size = 7673 2024-09-14T11:07:51.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.293+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17289625113572889339 2024-09-14T11:07:51.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.293+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc00ce10 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55b7d7dd0518 s->prefetch_data=0 2024-09-14T11:07:51.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.293+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dd0518 2024-09-14T11:07:51.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.293+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5.4 2024-09-14T11:07:51.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.295+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.295+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=7673 stripe_ofs=7673 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.295+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17289625113572889339 2024-09-14T11:07:51.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.295+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.295+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5__shadow_.LTl_MPmMQEu0zRNIp50OqyyIT7g2zDR_0 2024-09-14T11:07:51.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.295+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:07:51.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.295+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.295+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17289625113572889339 2024-09-14T11:07:51.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.297+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-14T11:07:51.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.297+0000 7fbdec723800 20 get_obj_state: octx=0x7fbdd801abf0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55b7d7dd0518 s->prefetch_data=0 2024-09-14T11:07:51.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.297+0000 7fbdec723800 10 manifest: total_size = 13592 2024-09-14T11:07:51.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.297+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6238541936918323431 2024-09-14T11:07:51.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.297+0000 7fbdec723800 20 get_obj_state: octx=0x7fbdd801abf0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55b7d7dd0518 s->prefetch_data=0 2024-09-14T11:07:51.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.297+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dd0518 2024-09-14T11:07:51.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.297+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5.4 2024-09-14T11:07:51.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.300+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.300+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=13592 stripe_ofs=13592 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.300+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6238541936918323431 2024-09-14T11:07:51.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.300+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.300+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5__shadow_.LB0LWSGukpkUmDwriRqffE0drmlF-y0_0 2024-09-14T11:07:51.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.300+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:07:51.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.300+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.300+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6238541936918323431 2024-09-14T11:07:51.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.301+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-14T11:07:51.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.301+0000 7fbdec723800 20 get_obj_state: octx=0x7fbde00b7cf0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55b7d7dd0518 s->prefetch_data=0 2024-09-14T11:07:51.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.302+0000 7fbdec723800 10 manifest: total_size = 12856 2024-09-14T11:07:51.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.302+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2903691111790917778 2024-09-14T11:07:51.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.302+0000 7fbdec723800 20 get_obj_state: octx=0x7fbde00b7cf0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55b7d7dd0518 s->prefetch_data=0 2024-09-14T11:07:51.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.302+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dd0518 2024-09-14T11:07:51.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.302+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5.5 2024-09-14T11:07:51.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.304+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.304+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=12856 stripe_ofs=12856 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.304+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2903691111790917778 2024-09-14T11:07:51.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.304+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.304+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5__shadow_.bg-XwhFx0WSJVKBk1kY1xpw57FpkqPL_0 2024-09-14T11:07:51.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.304+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:07:51.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.304+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.304+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2903691111790917778 2024-09-14T11:07:51.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.305+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-14T11:07:51.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.305+0000 7fbdec723800 20 get_obj_state: octx=0x7fbdd801abf0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55b7d7dd0518 s->prefetch_data=0 2024-09-14T11:07:51.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.306+0000 7fbdec723800 10 manifest: total_size = 5373 2024-09-14T11:07:51.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.306+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5078678217797253551 2024-09-14T11:07:51.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.306+0000 7fbdec723800 20 get_obj_state: octx=0x7fbdd801abf0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55b7d7dd0518 s->prefetch_data=0 2024-09-14T11:07:51.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.306+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dd0518 2024-09-14T11:07:51.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.306+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5.7 2024-09-14T11:07:51.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.309+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.309+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=5373 stripe_ofs=5373 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.309+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5078678217797253551 2024-09-14T11:07:51.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.309+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.309+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5__shadow_.FEIUJwGvmtehcwA9vlvQduZYi6_vupQ_0 2024-09-14T11:07:51.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.309+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:07:51.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.309+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.309+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5078678217797253551 2024-09-14T11:07:51.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.310+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-14T11:07:51.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.310+0000 7fbdec723800 20 get_obj_state: octx=0x7fbde00b7cf0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55b7d7dd0518 s->prefetch_data=0 2024-09-14T11:07:51.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.310+0000 7fbdec723800 10 manifest: total_size = 8755 2024-09-14T11:07:51.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.310+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12212026242388383530 2024-09-14T11:07:51.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.310+0000 7fbdec723800 20 get_obj_state: octx=0x7fbde00b7cf0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55b7d7dd0518 s->prefetch_data=0 2024-09-14T11:07:51.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.310+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dd0518 2024-09-14T11:07:51.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.310+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5.8 2024-09-14T11:07:51.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.313+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.313+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=8755 stripe_ofs=8755 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.313+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12212026242388383530 2024-09-14T11:07:51.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.313+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.313+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5__shadow_.BfhK__9xV2N-fHrMF33JKJk0W9IE7Bb_0 2024-09-14T11:07:51.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.313+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:07:51.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.313+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.313+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12212026242388383530 2024-09-14T11:07:51.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.314+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-14T11:07:51.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.314+0000 7fbdec723800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:07:51.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.314+0000 7fbdec723800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:07:51.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.315+0000 7fbdec723800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:07:51.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.315+0000 7fbdec723800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:07:51.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.315+0000 7fbdec723800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:07:51.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.315+0000 7fbdec723800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:07:51.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.315+0000 7fbdec723800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5])"; uploads.size()=0; is_truncated=0 2024-09-14T11:07:51.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.317+0000 7fbdec723800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-14T11:07:51.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.317+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.317+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=204 2024-09-14T11:07:51.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.317+0000 7fbdec723800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-14T11:07:51.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.317+0000 7fbdec723800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-14T11:07:51.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.318+0000 7fbdec723800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-14T11:07:51.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.318+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-14T11:07:51.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.319+0000 7fbcbf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496977 cookie 94248088617728 notifier 6012 bl.length()=162 2024-09-14T11:07:51.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.321+0000 7fbdec723800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5 from cache 2024-09-14T11:07:51.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.321+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5, ofs0, ns] 2024-09-14T11:07:51.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.321+0000 7fbcbf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497039 cookie 94248088693312 notifier 6012 bl.length()=219 2024-09-14T11:07:51.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.325+0000 7fbdec723800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5 : miss 2024-09-14T11:07:51.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.325+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.325+0000 7fbdec723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:51.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.325+0000 7fbdec723800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5 info.flags=0x0 2024-09-14T11:07:51.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.325+0000 7fbdec723800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5 to cache LRU end 2024-09-14T11:07:51.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.327+0000 7fbdec723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12 : miss 2024-09-14T11:07:51.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.327+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.328+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=457 2024-09-14T11:07:51.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.328+0000 7fbdec723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12 info.flags=0x17 2024-09-14T11:07:51.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.328+0000 7fbdec723800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12 to cache LRU end 2024-09-14T11:07:51.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.328+0000 7fbdec723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:07:51.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.328+0000 7fbdec723800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:07:51.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.328+0000 7fbdec723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12 2024-09-14T11:07:51.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.332+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:07:51.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.332+0000 7fbdec723800 20 get_obj_state: octx=0x7fbde007c150 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55b7d7dec6b8 s->prefetch_data=0 2024-09-14T11:07:51.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.333+0000 7fbdec723800 10 manifest: total_size = 26083 2024-09-14T11:07:51.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.333+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13144282124455761199 2024-09-14T11:07:51.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.333+0000 7fbdec723800 20 get_obj_state: octx=0x7fbde007c150 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55b7d7dec6b8 s->prefetch_data=0 2024-09-14T11:07:51.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.333+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dec6b8 2024-09-14T11:07:51.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.333+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12.10 2024-09-14T11:07:51.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.336+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=2 2024-09-14T11:07:51.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.336+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7672 2024-09-14T11:07:51.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.336+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7672 2024-09-14T11:07:51.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.336+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=2 2024-09-14T11:07:51.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.336+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6299128 part_ofs=7672 rule->part_size=7672 2024-09-14T11:07:51.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.336+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=15344 stripe_ofs=15344 part_ofs=15344 rule->part_size=7672 2024-09-14T11:07:51.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.336+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=2 2024-09-14T11:07:51.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.336+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6306800 part_ofs=15344 rule->part_size=7672 2024-09-14T11:07:51.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.336+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=23016 stripe_ofs=23016 part_ofs=23016 rule->part_size=3067 2024-09-14T11:07:51.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.336+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=2 2024-09-14T11:07:51.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.336+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6314472 part_ofs=23016 rule->part_size=3067 2024-09-14T11:07:51.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.336+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=26083 stripe_ofs=26083 part_ofs=26083 rule->part_size=3067 2024-09-14T11:07:51.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.336+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13144282124455761199 2024-09-14T11:07:51.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.336+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.336+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12__multipart_foo.2~BhCROLGbt7eyFkBa0Yq6jYLoc5xcj8C.1 2024-09-14T11:07:51.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.336+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-14T11:07:51.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.336+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12__multipart_foo.2~BhCROLGbt7eyFkBa0Yq6jYLoc5xcj8C.2 2024-09-14T11:07:51.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.336+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-14T11:07:51.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.336+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12__multipart_foo.2~BhCROLGbt7eyFkBa0Yq6jYLoc5xcj8C.3 2024-09-14T11:07:51.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.336+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-14T11:07:51.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.336+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12__multipart_foo.2~BhCROLGbt7eyFkBa0Yq6jYLoc5xcj8C.4 2024-09-14T11:07:51.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.336+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-14T11:07:51.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.336+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.336+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13144282124455761199 2024-09-14T11:07:51.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.337+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:07:51.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.337+0000 7fbdec723800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:07:51.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.338+0000 7fbdec723800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:07:51.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.338+0000 7fbdec723800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:07:51.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.338+0000 7fbdec723800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:07:51.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.338+0000 7fbdec723800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:07:51.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.338+0000 7fbdec723800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:07:51.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.338+0000 7fbdec723800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12])"; uploads.size()=0; is_truncated=0 2024-09-14T11:07:51.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.340+0000 7fbdec723800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-14T11:07:51.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.340+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.340+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=235 2024-09-14T11:07:51.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.340+0000 7fbdec723800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-14T11:07:51.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.340+0000 7fbdec723800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-14T11:07:51.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.341+0000 7fbdec723800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-14T11:07:51.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.341+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-14T11:07:51.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.342+0000 7fbcbf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497033 cookie 94248088619984 notifier 6012 bl.length()=191 2024-09-14T11:07:51.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.344+0000 7fbdec723800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12 from cache 2024-09-14T11:07:51.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.344+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12, ofs0, ns] 2024-09-14T11:07:51.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.345+0000 7fbcbeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497034 cookie 94248088688464 notifier 6012 bl.length()=249 2024-09-14T11:07:51.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.348+0000 7fbdec723800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12 : miss 2024-09-14T11:07:51.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.348+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.348+0000 7fbdec723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:51.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.348+0000 7fbdec723800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12 info.flags=0x0 2024-09-14T11:07:51.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.348+0000 7fbdec723800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12 to cache LRU end 2024-09-14T11:07:51.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.350+0000 7fbdec723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13 : miss 2024-09-14T11:07:51.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.350+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.351+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=464 2024-09-14T11:07:51.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.351+0000 7fbdec723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13 info.flags=0x17 2024-09-14T11:07:51.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.351+0000 7fbdec723800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13 to cache LRU end 2024-09-14T11:07:51.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.351+0000 7fbdec723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:07:51.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.351+0000 7fbdec723800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:07:51.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.351+0000 7fbdec723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13 2024-09-14T11:07:51.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.355+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:07:51.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.355+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7dc7f70 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55b7d7dc90d8 s->prefetch_data=0 2024-09-14T11:07:51.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.356+0000 7fbdec723800 10 manifest: total_size = 886297 2024-09-14T11:07:51.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.356+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8391506264715265748 2024-09-14T11:07:51.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.356+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7dc7f70 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55b7d7dc90d8 s->prefetch_data=0 2024-09-14T11:07:51.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.356+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc90d8 2024-09-14T11:07:51.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.356+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13.10 2024-09-14T11:07:51.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.358+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:07:51.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.358+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-14T11:07:51.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.358+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-14T11:07:51.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.358+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:07:51.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.358+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-14T11:07:51.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.358+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-14T11:07:51.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.358+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:07:51.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.358+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2024-09-14T11:07:51.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.358+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-14T11:07:51.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.358+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-14T11:07:51.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.358+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2024-09-14T11:07:51.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.358+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-14T11:07:51.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.358+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8391506264715265748 2024-09-14T11:07:51.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.358+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.358+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13__multipart_foo.2~4jm2dL2537ly5YkNb3t0tMattXx8fKg.1 2024-09-14T11:07:51.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.358+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-14T11:07:51.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.358+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13__multipart_foo.2~4jm2dL2537ly5YkNb3t0tMattXx8fKg.2 2024-09-14T11:07:51.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.358+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-14T11:07:51.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.358+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13__multipart_foo.2~4jm2dL2537ly5YkNb3t0tMattXx8fKg.3 2024-09-14T11:07:51.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.358+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-14T11:07:51.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.358+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13__multipart_foo.2~4jm2dL2537ly5YkNb3t0tMattXx8fKg.4 2024-09-14T11:07:51.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.358+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-14T11:07:51.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.358+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.358+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8391506264715265748 2024-09-14T11:07:51.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.359+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:07:51.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.360+0000 7fbdec723800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:07:51.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.360+0000 7fbdec723800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:07:51.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.360+0000 7fbdec723800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:07:51.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.360+0000 7fbdec723800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:07:51.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.360+0000 7fbdec723800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:07:51.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.360+0000 7fbdec723800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:07:51.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.360+0000 7fbdec723800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13])"; uploads.size()=0; is_truncated=0 2024-09-14T11:07:51.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.362+0000 7fbdec723800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-14T11:07:51.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.362+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.362+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=242 2024-09-14T11:07:51.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.362+0000 7fbdec723800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-14T11:07:51.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.362+0000 7fbdec723800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-14T11:07:51.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.363+0000 7fbdec723800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-14T11:07:51.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.363+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-14T11:07:51.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.363+0000 7fbcbf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496979 cookie 94248088681008 notifier 6012 bl.length()=198 2024-09-14T11:07:51.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.366+0000 7fbdec723800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13 from cache 2024-09-14T11:07:51.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.366+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13, ofs0, ns] 2024-09-14T11:07:51.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.366+0000 7fbcbeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497035 cookie 94248088619984 notifier 6012 bl.length()=256 2024-09-14T11:07:51.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.370+0000 7fbdec723800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13 : miss 2024-09-14T11:07:51.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.370+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.370+0000 7fbdec723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:51.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.370+0000 7fbdec723800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13 info.flags=0x0 2024-09-14T11:07:51.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.370+0000 7fbdec723800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13 to cache LRU end 2024-09-14T11:07:51.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.373+0000 7fbdec723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11 : miss 2024-09-14T11:07:51.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.373+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.373+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=459 2024-09-14T11:07:51.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.373+0000 7fbdec723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11 info.flags=0x17 2024-09-14T11:07:51.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.373+0000 7fbdec723800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11 to cache LRU end 2024-09-14T11:07:51.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.373+0000 7fbdec723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:07:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.373+0000 7fbdec723800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:07:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.373+0000 7fbdec723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11 2024-09-14T11:07:51.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.377+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo[LLs87UYtAITlUWeC2J5ydHO4T2HNuYz] 2024-09-14T11:07:51.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.377+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11.10 2024-09-14T11:07:51.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.377+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7dd40d0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55b7d7dc9078 s->prefetch_data=0 2024-09-14T11:07:51.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.378+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to 1qngzkt6zvfwsu4gvw58kltl7hwuhfl5 2024-09-14T11:07:51.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.378+0000 7fbdec723800 20 get_obj_state_impl: setting s->olh_tag to 3hehwuc2z9hisjwurrib5vlnuyxm82tx 2024-09-14T11:07:51.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.378+0000 7fbdec723800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=3hehwuc2z9hisjwurrib5vlnuyxm82tx 2024-09-14T11:07:51.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.379+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11.10 2024-09-14T11:07:51.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.380+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11.10 2024-09-14T11:07:51.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.380+0000 7fbdec723800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-14T11:07:51.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.380+0000 7fbdec723800 20 olh_log_entry: epoch=3 op=3 key=foo[LLs87UYtAITlUWeC2J5ydHO4T2HNuYz] 2024-09-14T11:07:51.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.380+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7dd40d0 obj=test-client.0-r-test-multipart-index-versioning.1:_:LLs87UYtAITlUWeC2J5ydHO4T2HNuYz_foo state=0x55b7d7de0388 s->prefetch_data=0 2024-09-14T11:07:51.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.381+0000 7fbdec723800 10 manifest: total_size = 886297 2024-09-14T11:07:51.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.381+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17917533110369099847 2024-09-14T11:07:51.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.381+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7dd40d0 obj=test-client.0-r-test-multipart-index-versioning.1:_:LLs87UYtAITlUWeC2J5ydHO4T2HNuYz_foo state=0x55b7d7de0388 s->prefetch_data=0 2024-09-14T11:07:51.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.381+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7de0388 2024-09-14T11:07:51.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.381+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11.10 2024-09-14T11:07:51.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.383+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:07:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.383+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-14T11:07:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.383+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-14T11:07:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.383+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:07:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.383+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-14T11:07:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.383+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-14T11:07:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.383+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:07:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.383+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2024-09-14T11:07:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.383+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-14T11:07:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.383+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-14T11:07:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.383+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2024-09-14T11:07:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.383+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-14T11:07:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.383+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17917533110369099847 2024-09-14T11:07:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.383+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.383+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11__multipart_foo.2~1o4VwvX6w_Pqa73xTdZwhNNBG1nMef9.1 2024-09-14T11:07:51.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.383+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-14T11:07:51.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.383+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11__multipart_foo.2~1o4VwvX6w_Pqa73xTdZwhNNBG1nMef9.2 2024-09-14T11:07:51.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.383+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-14T11:07:51.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.383+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11__multipart_foo.2~1o4VwvX6w_Pqa73xTdZwhNNBG1nMef9.3 2024-09-14T11:07:51.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.383+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-14T11:07:51.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.383+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11__multipart_foo.2~1o4VwvX6w_Pqa73xTdZwhNNBG1nMef9.4 2024-09-14T11:07:51.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.383+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-14T11:07:51.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.383+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.383+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17917533110369099847 2024-09-14T11:07:51.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.384+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=foo[LLs87UYtAITlUWeC2J5ydHO4T2HNuYz] 2024-09-14T11:07:51.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.386+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7dd40d0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55b7d7dc9078 s->prefetch_data=0 2024-09-14T11:07:51.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.387+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11.10 2024-09-14T11:07:51.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.389+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11.10 2024-09-14T11:07:51.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.389+0000 7fbdec723800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:07:51.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.389+0000 7fbdec723800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:07:51.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.389+0000 7fbdec723800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:07:51.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.389+0000 7fbdec723800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:07:51.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.389+0000 7fbdec723800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:07:51.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.389+0000 7fbdec723800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:07:51.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.389+0000 7fbdec723800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11])"; uploads.size()=0; is_truncated=0 2024-09-14T11:07:51.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.391+0000 7fbdec723800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-14T11:07:51.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.391+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.391+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=237 2024-09-14T11:07:51.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.391+0000 7fbdec723800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-14T11:07:51.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.391+0000 7fbdec723800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-14T11:07:51.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.392+0000 7fbdec723800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-14T11:07:51.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.392+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-14T11:07:51.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.392+0000 7fbcbeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496980 cookie 94248088681008 notifier 6012 bl.length()=193 2024-09-14T11:07:51.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.395+0000 7fbdec723800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11 from cache 2024-09-14T11:07:51.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.395+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11, ofs0, ns] 2024-09-14T11:07:51.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.396+0000 7fbcbf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497040 cookie 94248088697184 notifier 6012 bl.length()=251 2024-09-14T11:07:51.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.399+0000 7fbdec723800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11 : miss 2024-09-14T11:07:51.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.399+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.399+0000 7fbdec723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:51.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.399+0000 7fbdec723800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11 info.flags=0x0 2024-09-14T11:07:51.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.399+0000 7fbdec723800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11 to cache LRU end 2024-09-14T11:07:51.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.401+0000 7fbdec723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10 : miss 2024-09-14T11:07:51.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.401+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.401+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=449 2024-09-14T11:07:51.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.401+0000 7fbdec723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10 info.flags=0x17 2024-09-14T11:07:51.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.401+0000 7fbdec723800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10 to cache LRU end 2024-09-14T11:07:51.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.401+0000 7fbdec723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:07:51.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.401+0000 7fbdec723800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:07:51.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.401+0000 7fbdec723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10 2024-09-14T11:07:51.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.406+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:07:51.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.406+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7dd62c0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55b7d7dc9078 s->prefetch_data=0 2024-09-14T11:07:51.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.407+0000 7fbdec723800 10 manifest: total_size = 18874368 2024-09-14T11:07:51.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.407+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14929112258677367718 2024-09-14T11:07:51.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.407+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7dd62c0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55b7d7dc9078 s->prefetch_data=0 2024-09-14T11:07:51.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.407+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc9078 2024-09-14T11:07:51.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.407+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10.10 2024-09-14T11:07:51.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.409+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:07:51.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.409+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:07:51.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.409+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:07:51.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.409+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:07:51.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.409+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:07:51.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.409+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:07:51.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.409+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:07:51.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.409+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:07:51.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.409+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-14T11:07:51.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.409+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-14T11:07:51.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.409+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2024-09-14T11:07:51.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.409+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-14T11:07:51.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.409+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14929112258677367718 2024-09-14T11:07:51.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.409+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.409+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10__multipart_foo.2~-JPbnwwXKO-qWyGlwjO8n_1PMchWPAX.1 2024-09-14T11:07:51.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.409+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-14T11:07:51.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.409+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10__multipart_foo.2~-JPbnwwXKO-qWyGlwjO8n_1PMchWPAX.2 2024-09-14T11:07:51.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.409+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-14T11:07:51.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.409+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10__multipart_foo.2~-JPbnwwXKO-qWyGlwjO8n_1PMchWPAX.3 2024-09-14T11:07:51.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.409+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-14T11:07:51.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.409+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10__multipart_foo.2~-JPbnwwXKO-qWyGlwjO8n_1PMchWPAX.4 2024-09-14T11:07:51.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.409+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-14T11:07:51.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.409+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.409+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14929112258677367718 2024-09-14T11:07:51.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.410+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:07:51.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.410+0000 7fbdec723800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:07:51.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.410+0000 7fbdec723800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:07:51.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.411+0000 7fbdec723800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:07:51.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.411+0000 7fbdec723800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:07:51.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.411+0000 7fbdec723800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:07:51.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.411+0000 7fbdec723800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:07:51.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.411+0000 7fbdec723800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10])"; uploads.size()=0; is_truncated=0 2024-09-14T11:07:51.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.413+0000 7fbdec723800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-14T11:07:51.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.413+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.413+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=227 2024-09-14T11:07:51.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.413+0000 7fbdec723800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-14T11:07:51.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.413+0000 7fbdec723800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-14T11:07:51.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.414+0000 7fbdec723800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-14T11:07:51.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.414+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-14T11:07:51.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.415+0000 7fbcbf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497036 cookie 94248088688464 notifier 6012 bl.length()=183 2024-09-14T11:07:51.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.417+0000 7fbdec723800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10 from cache 2024-09-14T11:07:51.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.417+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10, ofs0, ns] 2024-09-14T11:07:51.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.418+0000 7fbcbeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497041 cookie 94248088682064 notifier 6012 bl.length()=241 2024-09-14T11:07:51.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.421+0000 7fbdec723800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10 : miss 2024-09-14T11:07:51.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.421+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.422+0000 7fbdec723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:51.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.422+0000 7fbdec723800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10 info.flags=0x0 2024-09-14T11:07:51.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.422+0000 7fbdec723800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10 to cache LRU end 2024-09-14T11:07:51.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.424+0000 7fbdec723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16 : miss 2024-09-14T11:07:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.424+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.424+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:07:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.424+0000 7fbdec723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16 info.flags=0x17 2024-09-14T11:07:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.424+0000 7fbdec723800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16 to cache LRU end 2024-09-14T11:07:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.424+0000 7fbdec723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:07:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.424+0000 7fbdec723800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:07:51.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.424+0000 7fbdec723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16 2024-09-14T11:07:51.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.424+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:07:51.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.425+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:07:51.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.425+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:07:51.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.426+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:07:51.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.426+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:07:51.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.426+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:07:51.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.427+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:07:51.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.427+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:07:51.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.427+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:07:51.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.427+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:07:51.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.427+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:07:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.428+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:07:51.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.428+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7d905b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55b7d7deb668 s->prefetch_data=0 2024-09-14T11:07:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.429+0000 7fbdec723800 10 manifest: total_size = 27202 2024-09-14T11:07:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.429+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to _3OWHmffnJrzTelu15m8GYglLajJYBRo 2024-09-14T11:07:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.429+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7d905b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55b7d7deb668 s->prefetch_data=0 2024-09-14T11:07:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.429+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7deb668 2024-09-14T11:07:51.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.429+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16.0 2024-09-14T11:07:51.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.431+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.431+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=27202 stripe_ofs=27202 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.431+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: _3OWHmffnJrzTelu15m8GYglLajJYBRo 2024-09-14T11:07:51.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.431+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.431+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16__shadow_.ZT6ThVnuJQo7RcL04N_16rT7M7TmkVQ_0 2024-09-14T11:07:51.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.431+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:07:51.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.431+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.431+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: _3OWHmffnJrzTelu15m8GYglLajJYBRo 2024-09-14T11:07:51.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.432+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc00cba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55b7d7dc9028 s->prefetch_data=0 2024-09-14T11:07:51.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.432+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:07:51.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.433+0000 7fbdec723800 10 manifest: total_size = 5242880 2024-09-14T11:07:51.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.433+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to _nD_rPoU3FjMOY2uQc0mzwbK3Hw5nkXi 2024-09-14T11:07:51.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.433+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc00cba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55b7d7dc9028 s->prefetch_data=0 2024-09-14T11:07:51.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.433+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc9028 2024-09-14T11:07:51.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.433+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16.2 2024-09-14T11:07:51.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.435+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.435+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.435+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: _nD_rPoU3FjMOY2uQc0mzwbK3Hw5nkXi 2024-09-14T11:07:51.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.435+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.435+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16__shadow_.-SKQeI0HXeE18Goi_UlTK_JhLeYEQRr_0 2024-09-14T11:07:51.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.435+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:07:51.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.435+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.435+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _nD_rPoU3FjMOY2uQc0mzwbK3Hw5nkXi 2024-09-14T11:07:51.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.437+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc03b970 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55b7d7dc9028 s->prefetch_data=0 2024-09-14T11:07:51.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.437+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:07:51.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.437+0000 7fbdec723800 10 manifest: total_size = 5242880 2024-09-14T11:07:51.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.437+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15533069296737314307 2024-09-14T11:07:51.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.437+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc03b970 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55b7d7dc9028 s->prefetch_data=0 2024-09-14T11:07:51.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.437+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc9028 2024-09-14T11:07:51.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.437+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16.3 2024-09-14T11:07:51.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.439+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.439+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.439+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15533069296737314307 2024-09-14T11:07:51.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.439+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.439+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16__shadow_.-BOvW_Ta_QdV89j_z4eE6-bjqKH-moL_0 2024-09-14T11:07:51.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.439+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-14T11:07:51.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.439+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.439+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15533069296737314307 2024-09-14T11:07:51.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.440+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc03b970 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55b7d7dc9028 s->prefetch_data=0 2024-09-14T11:07:51.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.440+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:07:51.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.441+0000 7fbdec723800 10 manifest: total_size = 5242880 2024-09-14T11:07:51.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.441+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to _xWgX2Xz-Cw1aX61uElBXs2oxl9hFrsf 2024-09-14T11:07:51.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.441+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc03b970 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55b7d7dc9028 s->prefetch_data=0 2024-09-14T11:07:51.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.441+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc9028 2024-09-14T11:07:51.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.441+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16.5 2024-09-14T11:07:51.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.443+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.443+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.443+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: _xWgX2Xz-Cw1aX61uElBXs2oxl9hFrsf 2024-09-14T11:07:51.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.443+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.443+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16__shadow_.DOSVPhmytqVNacnUOObuPIyOpUi00qq_0 2024-09-14T11:07:51.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.443+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:07:51.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.443+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.443+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: _xWgX2Xz-Cw1aX61uElBXs2oxl9hFrsf 2024-09-14T11:07:51.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.444+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:07:51.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.444+0000 7fbdec723800 20 get_obj_state: octx=0x7fbde007c150 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55b7d7dc9028 s->prefetch_data=0 2024-09-14T11:07:51.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.445+0000 7fbdec723800 10 manifest: total_size = 5242880 2024-09-14T11:07:51.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.445+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to _tSVAbx7BJSA7fbWXrvVQDNvuq6uL7x0 2024-09-14T11:07:51.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.445+0000 7fbdec723800 20 get_obj_state: octx=0x7fbde007c150 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55b7d7dc9028 s->prefetch_data=0 2024-09-14T11:07:51.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.445+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc9028 2024-09-14T11:07:51.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.445+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16.5 2024-09-14T11:07:51.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.447+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.447+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.447+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: _tSVAbx7BJSA7fbWXrvVQDNvuq6uL7x0 2024-09-14T11:07:51.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.447+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.447+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16__shadow_.fOaDXsbjghIHoekDGqgcf7ISKop2bmQ_0 2024-09-14T11:07:51.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.447+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:07:51.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.447+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.447+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: _tSVAbx7BJSA7fbWXrvVQDNvuq6uL7x0 2024-09-14T11:07:51.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.448+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:07:51.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.448+0000 7fbdec723800 20 get_obj_state: octx=0x7fbde00bd690 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55b7d7dc9028 s->prefetch_data=0 2024-09-14T11:07:51.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.449+0000 7fbdec723800 10 manifest: total_size = 27202 2024-09-14T11:07:51.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.449+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3853012297336642236 2024-09-14T11:07:51.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.449+0000 7fbdec723800 20 get_obj_state: octx=0x7fbde00bd690 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55b7d7dc9028 s->prefetch_data=0 2024-09-14T11:07:51.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.449+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc9028 2024-09-14T11:07:51.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.449+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16.5 2024-09-14T11:07:51.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.451+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.451+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=27202 stripe_ofs=27202 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.451+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3853012297336642236 2024-09-14T11:07:51.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.451+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.451+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16__shadow_.Poo_6n4s4wIF7PnpbQytAdeAt9KmqIX_0 2024-09-14T11:07:51.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.451+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-14T11:07:51.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.451+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.451+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3853012297336642236 2024-09-14T11:07:51.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.452+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:07:51.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.452+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc03b970 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55b7d7dc9028 s->prefetch_data=0 2024-09-14T11:07:51.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.453+0000 7fbdec723800 10 manifest: total_size = 5242880 2024-09-14T11:07:51.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.453+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to _qOrOlFHDsE3o04wVrXiha8teaTO4bZP 2024-09-14T11:07:51.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.453+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc03b970 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55b7d7dc9028 s->prefetch_data=0 2024-09-14T11:07:51.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.453+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc9028 2024-09-14T11:07:51.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.453+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16.7 2024-09-14T11:07:51.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.455+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.455+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.455+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: _qOrOlFHDsE3o04wVrXiha8teaTO4bZP 2024-09-14T11:07:51.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.455+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.455+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16__shadow_.1jvsjW78JxZuuljPUVRNmrlVfIrIi-0_0 2024-09-14T11:07:51.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.455+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:07:51.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.455+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.455+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _qOrOlFHDsE3o04wVrXiha8teaTO4bZP 2024-09-14T11:07:51.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.456+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:07:51.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.456+0000 7fbdec723800 20 get_obj_state: octx=0x7fbde007c150 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55b7d7dc9028 s->prefetch_data=0 2024-09-14T11:07:51.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.457+0000 7fbdec723800 10 manifest: total_size = 5242880 2024-09-14T11:07:51.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.457+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6721535853659562274 2024-09-14T11:07:51.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.457+0000 7fbdec723800 20 get_obj_state: octx=0x7fbde007c150 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55b7d7dc9028 s->prefetch_data=0 2024-09-14T11:07:51.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.457+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc9028 2024-09-14T11:07:51.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.457+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16.7 2024-09-14T11:07:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.459+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.459+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.459+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6721535853659562274 2024-09-14T11:07:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.459+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.459+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16__shadow_.OtfDSzHopE6vv3iI75qKgxYUFqDfnJT_0 2024-09-14T11:07:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.459+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-14T11:07:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.459+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.459+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6721535853659562274 2024-09-14T11:07:51.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.460+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:07:51.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.460+0000 7fbdec723800 20 get_obj_state: octx=0x7fbde00bd690 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55b7d7dc9028 s->prefetch_data=0 2024-09-14T11:07:51.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.460+0000 7fbdec723800 10 manifest: total_size = 27202 2024-09-14T11:07:51.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.460+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10225109306085646010 2024-09-14T11:07:51.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.460+0000 7fbdec723800 20 get_obj_state: octx=0x7fbde00bd690 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55b7d7dc9028 s->prefetch_data=0 2024-09-14T11:07:51.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.460+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc9028 2024-09-14T11:07:51.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.460+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16.7 2024-09-14T11:07:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.463+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.463+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=27202 stripe_ofs=27202 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.463+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10225109306085646010 2024-09-14T11:07:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.463+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.463+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16__shadow_.Poo_6n4s4wIF7PnpbQytAdeAt9KmqIX_0 2024-09-14T11:07:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.463+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-14T11:07:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.463+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.463+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10225109306085646010 2024-09-14T11:07:51.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.464+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:07:51.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.464+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc03b970 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55b7d7dc9028 s->prefetch_data=0 2024-09-14T11:07:51.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.464+0000 7fbdec723800 10 manifest: total_size = 5242880 2024-09-14T11:07:51.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.464+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11428621068554133429 2024-09-14T11:07:51.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.464+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc03b970 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55b7d7dc9028 s->prefetch_data=0 2024-09-14T11:07:51.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.464+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc9028 2024-09-14T11:07:51.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.464+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16.8 2024-09-14T11:07:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.467+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.467+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.467+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11428621068554133429 2024-09-14T11:07:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.467+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.467+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16__shadow_.OtfDSzHopE6vv3iI75qKgxYUFqDfnJT_0 2024-09-14T11:07:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.467+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-14T11:07:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.467+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.467+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11428621068554133429 2024-09-14T11:07:51.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.468+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:07:51.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.468+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc00cba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55b7d7dc9028 s->prefetch_data=0 2024-09-14T11:07:51.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.469+0000 7fbdec723800 10 manifest: total_size = 27202 2024-09-14T11:07:51.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.469+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to _4v3amauVK4phzGLeu-BVhd3HWHPdyb0 2024-09-14T11:07:51.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.469+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc00cba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55b7d7dc9028 s->prefetch_data=0 2024-09-14T11:07:51.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.469+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc9028 2024-09-14T11:07:51.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.469+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16.8 2024-09-14T11:07:51.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.471+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.471+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=27202 stripe_ofs=27202 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.471+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: _4v3amauVK4phzGLeu-BVhd3HWHPdyb0 2024-09-14T11:07:51.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.471+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.471+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16__shadow_.ltXKLMmzXGHYDRWRmtG1Z__5r4ma17a_0 2024-09-14T11:07:51.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.471+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:07:51.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.471+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.471+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _4v3amauVK4phzGLeu-BVhd3HWHPdyb0 2024-09-14T11:07:51.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.472+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:07:51.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.472+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc03b970 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55b7d7dc9028 s->prefetch_data=0 2024-09-14T11:07:51.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.472+0000 7fbdec723800 10 manifest: total_size = 5242880 2024-09-14T11:07:51.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.472+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11828557566274906188 2024-09-14T11:07:51.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.472+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc03b970 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55b7d7dc9028 s->prefetch_data=0 2024-09-14T11:07:51.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.472+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc9028 2024-09-14T11:07:51.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.472+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16.9 2024-09-14T11:07:51.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.475+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.475+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.475+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11828557566274906188 2024-09-14T11:07:51.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.475+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.475+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16__shadow_.-BOvW_Ta_QdV89j_z4eE6-bjqKH-moL_0 2024-09-14T11:07:51.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.475+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-14T11:07:51.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.475+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.475+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11828557566274906188 2024-09-14T11:07:51.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.476+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:07:51.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.477+0000 7fbdec723800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:07:51.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.477+0000 7fbdec723800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:07:51.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.478+0000 7fbdec723800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:07:51.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.478+0000 7fbdec723800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:07:51.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.478+0000 7fbdec723800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:07:51.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.478+0000 7fbdec723800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:07:51.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.478+0000 7fbdec723800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16])"; uploads.size()=0; is_truncated=0 2024-09-14T11:07:51.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.479+0000 7fbdec723800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-14T11:07:51.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.479+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.480+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=233 2024-09-14T11:07:51.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.480+0000 7fbdec723800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-14T11:07:51.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.480+0000 7fbdec723800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-14T11:07:51.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.481+0000 7fbdec723800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-14T11:07:51.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.481+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-14T11:07:51.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.481+0000 7fbcbeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496981 cookie 94248088681008 notifier 6012 bl.length()=189 2024-09-14T11:07:51.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.484+0000 7fbdec723800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16 from cache 2024-09-14T11:07:51.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.484+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16, ofs0, ns] 2024-09-14T11:07:51.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.484+0000 7fbcbeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497042 cookie 94248088697184 notifier 6012 bl.length()=247 2024-09-14T11:07:51.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.488+0000 7fbdec723800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16 : miss 2024-09-14T11:07:51.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.488+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.488+0000 7fbdec723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:51.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.488+0000 7fbdec723800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16 info.flags=0x0 2024-09-14T11:07:51.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.488+0000 7fbdec723800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16 to cache LRU end 2024-09-14T11:07:51.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.491+0000 7fbdec723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17 : miss 2024-09-14T11:07:51.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.491+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.491+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:07:51.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.491+0000 7fbdec723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17 info.flags=0x17 2024-09-14T11:07:51.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.491+0000 7fbdec723800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17 to cache LRU end 2024-09-14T11:07:51.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.491+0000 7fbdec723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:07:51.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.491+0000 7fbdec723800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:07:51.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.491+0000 7fbdec723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17 2024-09-14T11:07:51.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.491+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:07:51.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.492+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:07:51.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.493+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:07:51.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.494+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:07:51.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.494+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:07:51.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.494+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:07:51.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.494+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:07:51.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.494+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:07:51.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.495+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:07:51.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.495+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:07:51.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.495+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:07:51.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.495+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:07:51.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.496+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc00ce10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55b7d7dc8ff8 s->prefetch_data=0 2024-09-14T11:07:51.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.496+0000 7fbdec723800 10 manifest: total_size = 541681 2024-09-14T11:07:51.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.496+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to _3B5P5K9msbqMFppKjYKw7ly6ux174-4 2024-09-14T11:07:51.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.496+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc00ce10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55b7d7dc8ff8 s->prefetch_data=0 2024-09-14T11:07:51.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.496+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc8ff8 2024-09-14T11:07:51.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.496+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17.0 2024-09-14T11:07:51.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.498+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.498+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.499+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: _3B5P5K9msbqMFppKjYKw7ly6ux174-4 2024-09-14T11:07:51.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.499+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.499+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__shadow_.OWucWZCnFYIT2GDpk0cpoqDHBTOVtZl_0 2024-09-14T11:07:51.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.499+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:07:51.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.499+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.499+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _3B5P5K9msbqMFppKjYKw7ly6ux174-4 2024-09-14T11:07:51.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.500+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:07:51.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.500+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7dd0d20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55b7d7dc8ff8 s->prefetch_data=0 2024-09-14T11:07:51.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.500+0000 7fbdec723800 10 manifest: total_size = 11534336 2024-09-14T11:07:51.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.500+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to _wuZW78pjUvtfocM1OV5T_NaIv9rAsNi 2024-09-14T11:07:51.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.500+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7dd0d20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55b7d7dc8ff8 s->prefetch_data=0 2024-09-14T11:07:51.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.500+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc8ff8 2024-09-14T11:07:51.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.500+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17.2 2024-09-14T11:07:51.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.503+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.503+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.503+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.503+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.503+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: _wuZW78pjUvtfocM1OV5T_NaIv9rAsNi 2024-09-14T11:07:51.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.503+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.503+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__shadow_.-RXySKjYIKyLzb6BADWU-ZIL9Cu1DcT_0 2024-09-14T11:07:51.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.503+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:07:51.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.503+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__shadow_.-RXySKjYIKyLzb6BADWU-ZIL9Cu1DcT_1 2024-09-14T11:07:51.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.503+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:07:51.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.503+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.503+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _wuZW78pjUvtfocM1OV5T_NaIv9rAsNi 2024-09-14T11:07:51.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.504+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:07:51.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.504+0000 7fbdec723800 20 get_obj_state: octx=0x7fbde00bd690 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55b7d7dc8ff8 s->prefetch_data=0 2024-09-14T11:07:51.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.504+0000 7fbdec723800 10 manifest: total_size = 11534336 2024-09-14T11:07:51.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.504+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13298682246592334418 2024-09-14T11:07:51.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.504+0000 7fbdec723800 20 get_obj_state: octx=0x7fbde00bd690 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55b7d7dc8ff8 s->prefetch_data=0 2024-09-14T11:07:51.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.504+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc8ff8 2024-09-14T11:07:51.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.504+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17.3 2024-09-14T11:07:51.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.506+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:07:51.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.506+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:07:51.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.506+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:07:51.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.506+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:07:51.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.506+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:07:51.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.506+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:07:51.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.506+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:07:51.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.506+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:07:51.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.506+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:07:51.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.506+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13298682246592334418 2024-09-14T11:07:51.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.506+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.506+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-FROZEN.2~jMGeIzLkKIEiPrsrWc4GgGxUHr6naiZ.1 2024-09-14T11:07:51.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.507+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-14T11:07:51.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.507+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-FROZEN.2~jMGeIzLkKIEiPrsrWc4GgGxUHr6naiZ.2 2024-09-14T11:07:51.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.507+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-14T11:07:51.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.507+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-FROZEN.2~jMGeIzLkKIEiPrsrWc4GgGxUHr6naiZ.3 2024-09-14T11:07:51.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.507+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-14T11:07:51.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.507+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.507+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13298682246592334418 2024-09-14T11:07:51.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.508+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:07:51.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.508+0000 7fbdec723800 20 get_obj_state: octx=0x7fbdd8001180 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55b7d7dc8ff8 s->prefetch_data=0 2024-09-14T11:07:51.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.508+0000 7fbdec723800 10 manifest: total_size = 11534336 2024-09-14T11:07:51.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.508+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to _z_wjqiMQVmwmFeJtnemqeZaU3UQLYR8 2024-09-14T11:07:51.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.508+0000 7fbdec723800 20 get_obj_state: octx=0x7fbdd8001180 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55b7d7dc8ff8 s->prefetch_data=0 2024-09-14T11:07:51.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.508+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc8ff8 2024-09-14T11:07:51.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.508+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17.5 2024-09-14T11:07:51.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.510+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.510+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.510+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.510+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.510+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: _z_wjqiMQVmwmFeJtnemqeZaU3UQLYR8 2024-09-14T11:07:51.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.510+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.510+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__shadow_.E6bmTGdeciN1MqCzCxK6quWgwEc-IDX_0 2024-09-14T11:07:51.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.510+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:07:51.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.510+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__shadow_.E6bmTGdeciN1MqCzCxK6quWgwEc-IDX_1 2024-09-14T11:07:51.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.510+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-14T11:07:51.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.510+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.510+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _z_wjqiMQVmwmFeJtnemqeZaU3UQLYR8 2024-09-14T11:07:51.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.512+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:07:51.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.512+0000 7fbdec723800 20 get_obj_state: octx=0x7fbde00bd690 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55b7d7dc8ff8 s->prefetch_data=0 2024-09-14T11:07:51.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.512+0000 7fbdec723800 10 manifest: total_size = 11534336 2024-09-14T11:07:51.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.512+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to _6aeGc8oNey1pZOqOCRV9FWa6UxSUw49 2024-09-14T11:07:51.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.512+0000 7fbdec723800 20 get_obj_state: octx=0x7fbde00bd690 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55b7d7dc8ff8 s->prefetch_data=0 2024-09-14T11:07:51.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.512+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc8ff8 2024-09-14T11:07:51.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.512+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17.5 2024-09-14T11:07:51.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.516+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.516+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.516+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.516+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.516+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: _6aeGc8oNey1pZOqOCRV9FWa6UxSUw49 2024-09-14T11:07:51.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.516+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.516+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__shadow_.b5_mbvghoZu5NHJRDgqkB3BqMMA_0xz_0 2024-09-14T11:07:51.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.516+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:07:51.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.516+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__shadow_.b5_mbvghoZu5NHJRDgqkB3BqMMA_0xz_1 2024-09-14T11:07:51.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.516+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-14T11:07:51.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.516+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.516+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _6aeGc8oNey1pZOqOCRV9FWa6UxSUw49 2024-09-14T11:07:51.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.516+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:07:51.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.516+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc00ce10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55b7d7dc8ff8 s->prefetch_data=0 2024-09-14T11:07:51.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.517+0000 7fbdec723800 10 manifest: total_size = 541681 2024-09-14T11:07:51.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.517+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13981199601498846366 2024-09-14T11:07:51.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.517+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc00ce10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55b7d7dc8ff8 s->prefetch_data=0 2024-09-14T11:07:51.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.517+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc8ff8 2024-09-14T11:07:51.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.517+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17.5 2024-09-14T11:07:51.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.519+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:07:51.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.519+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-14T11:07:51.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.519+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-14T11:07:51.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.519+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:07:51.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.519+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-14T11:07:51.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.519+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-14T11:07:51.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.519+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-14T11:07:51.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.519+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=49187 2024-09-14T11:07:51.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.519+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-14T11:07:51.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.519+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13981199601498846366 2024-09-14T11:07:51.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.519+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.519+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-STANDARD.2~0jG6d4gwrfrm53JSkpLZl1StL3MBE2C.1 2024-09-14T11:07:51.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.519+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-14T11:07:51.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.519+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-STANDARD.2~0jG6d4gwrfrm53JSkpLZl1StL3MBE2C.2 2024-09-14T11:07:51.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.519+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-14T11:07:51.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.519+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-STANDARD.2~0jG6d4gwrfrm53JSkpLZl1StL3MBE2C.3 2024-09-14T11:07:51.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.519+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-14T11:07:51.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.519+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.519+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13981199601498846366 2024-09-14T11:07:51.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.520+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:07:51.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.520+0000 7fbdec723800 20 get_obj_state: octx=0x7fbdd8001180 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55b7d7dc8ff8 s->prefetch_data=0 2024-09-14T11:07:51.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.521+0000 7fbdec723800 10 manifest: total_size = 11534336 2024-09-14T11:07:51.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.521+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to _A3NaWN4383hYdxC7yer8aOO1SmIVZdE 2024-09-14T11:07:51.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.521+0000 7fbdec723800 20 get_obj_state: octx=0x7fbdd8001180 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55b7d7dc8ff8 s->prefetch_data=0 2024-09-14T11:07:51.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.521+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc8ff8 2024-09-14T11:07:51.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.521+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17.7 2024-09-14T11:07:51.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.523+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.523+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.523+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.523+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.523+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: _A3NaWN4383hYdxC7yer8aOO1SmIVZdE 2024-09-14T11:07:51.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.523+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.523+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__shadow_.q1ER_zf-LLOQoklZCMQQMZOQc00o5Ox_0 2024-09-14T11:07:51.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.523+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:07:51.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.523+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__shadow_.q1ER_zf-LLOQoklZCMQQMZOQc00o5Ox_1 2024-09-14T11:07:51.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.523+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:07:51.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.523+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.523+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _A3NaWN4383hYdxC7yer8aOO1SmIVZdE 2024-09-14T11:07:51.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.524+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:07:51.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.524+0000 7fbdec723800 20 get_obj_state: octx=0x7fbdd804e330 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55b7d7dc8ff8 s->prefetch_data=0 2024-09-14T11:07:51.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.525+0000 7fbdec723800 10 manifest: total_size = 11534336 2024-09-14T11:07:51.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.525+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11057791845662632237 2024-09-14T11:07:51.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.525+0000 7fbdec723800 20 get_obj_state: octx=0x7fbdd804e330 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55b7d7dc8ff8 s->prefetch_data=0 2024-09-14T11:07:51.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.525+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc8ff8 2024-09-14T11:07:51.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.525+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17.7 2024-09-14T11:07:51.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.527+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:07:51.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.527+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:07:51.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.527+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:07:51.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.527+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:07:51.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.527+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:07:51.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.527+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:07:51.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.527+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:07:51.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.527+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:07:51.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.527+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:07:51.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.527+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11057791845662632237 2024-09-14T11:07:51.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.527+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.527+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-LUKEWARM.2~CDRUTXG2lzRsIf4XGkea1lvh6F-PK1h.1 2024-09-14T11:07:51.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.527+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-14T11:07:51.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.527+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-LUKEWARM.2~CDRUTXG2lzRsIf4XGkea1lvh6F-PK1h.2 2024-09-14T11:07:51.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.527+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-14T11:07:51.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.527+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-LUKEWARM.2~CDRUTXG2lzRsIf4XGkea1lvh6F-PK1h.3 2024-09-14T11:07:51.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.527+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-14T11:07:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.527+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.527+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11057791845662632237 2024-09-14T11:07:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.528+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:07:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.528+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7d57520 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55b7d7dc8ff8 s->prefetch_data=0 2024-09-14T11:07:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.529+0000 7fbdec723800 10 manifest: total_size = 541681 2024-09-14T11:07:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.529+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2475078482169370415 2024-09-14T11:07:51.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.529+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7d57520 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55b7d7dc8ff8 s->prefetch_data=0 2024-09-14T11:07:51.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.529+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc8ff8 2024-09-14T11:07:51.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.529+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17.7 2024-09-14T11:07:51.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.531+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:07:51.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.531+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-14T11:07:51.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.531+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-14T11:07:51.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.531+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:07:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.531+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-14T11:07:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.531+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-14T11:07:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.531+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-14T11:07:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.531+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=49187 2024-09-14T11:07:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.531+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-14T11:07:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.531+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2475078482169370415 2024-09-14T11:07:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.531+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.531+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-STANDARD.2~0jG6d4gwrfrm53JSkpLZl1StL3MBE2C.1 2024-09-14T11:07:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.531+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-14T11:07:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.531+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-STANDARD.2~0jG6d4gwrfrm53JSkpLZl1StL3MBE2C.2 2024-09-14T11:07:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.531+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-14T11:07:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.531+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-STANDARD.2~0jG6d4gwrfrm53JSkpLZl1StL3MBE2C.3 2024-09-14T11:07:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.531+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-14T11:07:51.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.531+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.531+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2475078482169370415 2024-09-14T11:07:51.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.532+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:07:51.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.532+0000 7fbdec723800 20 get_obj_state: octx=0x7fbde00b2b80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55b7d7dc8ff8 s->prefetch_data=0 2024-09-14T11:07:51.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.533+0000 7fbdec723800 10 manifest: total_size = 11534336 2024-09-14T11:07:51.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.533+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3871475956472546270 2024-09-14T11:07:51.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.533+0000 7fbdec723800 20 get_obj_state: octx=0x7fbde00b2b80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55b7d7dc8ff8 s->prefetch_data=0 2024-09-14T11:07:51.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.533+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc8ff8 2024-09-14T11:07:51.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.533+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17.8 2024-09-14T11:07:51.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.535+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:07:51.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.535+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:07:51.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.535+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:07:51.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.535+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:07:51.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.535+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:07:51.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.535+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:07:51.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.535+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:07:51.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.535+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:07:51.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.535+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:07:51.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.535+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3871475956472546270 2024-09-14T11:07:51.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.535+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.535+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-LUKEWARM.2~CDRUTXG2lzRsIf4XGkea1lvh6F-PK1h.1 2024-09-14T11:07:51.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.535+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-14T11:07:51.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.535+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-LUKEWARM.2~CDRUTXG2lzRsIf4XGkea1lvh6F-PK1h.2 2024-09-14T11:07:51.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.535+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-14T11:07:51.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.535+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-LUKEWARM.2~CDRUTXG2lzRsIf4XGkea1lvh6F-PK1h.3 2024-09-14T11:07:51.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.535+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-14T11:07:51.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.535+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.535+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3871475956472546270 2024-09-14T11:07:51.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.536+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:07:51.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.536+0000 7fbdec723800 20 get_obj_state: octx=0x7fbdd804e330 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55b7d7dc8ff8 s->prefetch_data=0 2024-09-14T11:07:51.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.537+0000 7fbdec723800 10 manifest: total_size = 541681 2024-09-14T11:07:51.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.537+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to _RJero_JBsD7BaqhBz6HjikCGr2KyWKL 2024-09-14T11:07:51.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.537+0000 7fbdec723800 20 get_obj_state: octx=0x7fbdd804e330 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55b7d7dc8ff8 s->prefetch_data=0 2024-09-14T11:07:51.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.537+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc8ff8 2024-09-14T11:07:51.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.537+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17.8 2024-09-14T11:07:51.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.539+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.539+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.539+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: _RJero_JBsD7BaqhBz6HjikCGr2KyWKL 2024-09-14T11:07:51.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.539+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.539+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__shadow_.yZmV0PlYz67euE4Cch9kuGCdz71c5ZC_0 2024-09-14T11:07:51.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.539+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:07:51.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.539+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.539+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _RJero_JBsD7BaqhBz6HjikCGr2KyWKL 2024-09-14T11:07:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.540+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:07:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.540+0000 7fbdec723800 20 get_obj_state: octx=0x7fbdd8001180 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55b7d7dc8ff8 s->prefetch_data=0 2024-09-14T11:07:51.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.541+0000 7fbdec723800 10 manifest: total_size = 11534336 2024-09-14T11:07:51.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.541+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3790287000286336820 2024-09-14T11:07:51.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.541+0000 7fbdec723800 20 get_obj_state: octx=0x7fbdd8001180 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55b7d7dc8ff8 s->prefetch_data=0 2024-09-14T11:07:51.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.541+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dc8ff8 2024-09-14T11:07:51.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.541+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17.9 2024-09-14T11:07:51.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.543+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:07:51.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.543+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:07:51.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.543+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:07:51.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.543+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:07:51.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.543+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:07:51.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.543+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:07:51.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.543+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:07:51.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.543+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:07:51.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.543+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:07:51.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.543+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3790287000286336820 2024-09-14T11:07:51.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.543+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.543+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-FROZEN.2~jMGeIzLkKIEiPrsrWc4GgGxUHr6naiZ.1 2024-09-14T11:07:51.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.543+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-14T11:07:51.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.543+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-FROZEN.2~jMGeIzLkKIEiPrsrWc4GgGxUHr6naiZ.2 2024-09-14T11:07:51.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.543+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-14T11:07:51.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.543+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-FROZEN.2~jMGeIzLkKIEiPrsrWc4GgGxUHr6naiZ.3 2024-09-14T11:07:51.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.543+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-14T11:07:51.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.543+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.543+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3790287000286336820 2024-09-14T11:07:51.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.544+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:07:51.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.544+0000 7fbdec723800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:07:51.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.544+0000 7fbdec723800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:07:51.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.545+0000 7fbdec723800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:07:51.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.545+0000 7fbdec723800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:07:51.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.545+0000 7fbdec723800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:07:51.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.545+0000 7fbdec723800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:07:51.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.545+0000 7fbdec723800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17])"; uploads.size()=0; is_truncated=0 2024-09-14T11:07:51.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.547+0000 7fbdec723800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-14T11:07:51.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.547+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.547+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=243 2024-09-14T11:07:51.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.547+0000 7fbdec723800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-14T11:07:51.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.547+0000 7fbdec723800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-14T11:07:51.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.549+0000 7fbdec723800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-14T11:07:51.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.549+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-14T11:07:51.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.549+0000 7fbcbf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496972 cookie 94248088685824 notifier 6012 bl.length()=199 2024-09-14T11:07:51.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.552+0000 7fbdec723800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17 from cache 2024-09-14T11:07:51.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.552+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17, ofs0, ns] 2024-09-14T11:07:51.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.552+0000 7fbcbf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496982 cookie 94248088681008 notifier 6012 bl.length()=257 2024-09-14T11:07:51.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.555+0000 7fbdec723800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17 : miss 2024-09-14T11:07:51.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.555+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.556+0000 7fbdec723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:51.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.556+0000 7fbdec723800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17 info.flags=0x0 2024-09-14T11:07:51.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.556+0000 7fbdec723800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17 to cache LRU end 2024-09-14T11:07:51.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.558+0000 7fbdec723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15 : miss 2024-09-14T11:07:51.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.558+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.558+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:07:51.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.558+0000 7fbdec723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15 info.flags=0x17 2024-09-14T11:07:51.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.558+0000 7fbdec723800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15 to cache LRU end 2024-09-14T11:07:51.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.558+0000 7fbdec723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:07:51.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.558+0000 7fbdec723800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:07:51.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.558+0000 7fbdec723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15 2024-09-14T11:07:51.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.560+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:07:51.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.560+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:07:51.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.561+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:07:51.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.562+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7de8550 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55b7d7dec458 s->prefetch_data=0 2024-09-14T11:07:51.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.562+0000 7fbdec723800 10 manifest: total_size = 11534336 2024-09-14T11:07:51.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.562+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11519600288178634578 2024-09-14T11:07:51.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.562+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7de8550 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55b7d7dec458 s->prefetch_data=0 2024-09-14T11:07:51.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.562+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dec458 2024-09-14T11:07:51.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.562+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15.3 2024-09-14T11:07:51.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.565+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:07:51.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.565+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:07:51.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.565+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:07:51.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.565+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:07:51.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.565+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:07:51.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.565+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:07:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.565+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:07:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.565+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:07:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.565+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:07:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.565+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11519600288178634578 2024-09-14T11:07:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.565+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.565+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15__multipart_foo-FROZEN.2~d2D_LkAdXa_LpmZupJWggS22kj8cnKF.1 2024-09-14T11:07:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.565+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-14T11:07:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.565+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15__multipart_foo-FROZEN.2~d2D_LkAdXa_LpmZupJWggS22kj8cnKF.2 2024-09-14T11:07:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.565+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-14T11:07:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.565+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15__multipart_foo-FROZEN.2~d2D_LkAdXa_LpmZupJWggS22kj8cnKF.3 2024-09-14T11:07:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.565+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-14T11:07:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.565+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.565+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11519600288178634578 2024-09-14T11:07:51.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.566+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:07:51.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.566+0000 7fbdec723800 20 get_obj_state: octx=0x7fbde007c150 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55b7d7dec458 s->prefetch_data=0 2024-09-14T11:07:51.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.566+0000 7fbdec723800 10 manifest: total_size = 541681 2024-09-14T11:07:51.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.566+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6759393883595264595 2024-09-14T11:07:51.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.566+0000 7fbdec723800 20 get_obj_state: octx=0x7fbde007c150 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55b7d7dec458 s->prefetch_data=0 2024-09-14T11:07:51.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.566+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dec458 2024-09-14T11:07:51.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.566+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15.5 2024-09-14T11:07:51.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.569+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:07:51.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.569+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-14T11:07:51.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.569+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-14T11:07:51.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.569+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:07:51.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.569+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-14T11:07:51.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.569+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-14T11:07:51.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.569+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-14T11:07:51.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.569+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=49187 2024-09-14T11:07:51.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.569+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-14T11:07:51.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.569+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6759393883595264595 2024-09-14T11:07:51.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.569+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.569+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15__multipart_foo-STANDARD.2~ePCjjAHKMAH1sxbj5jX98_k7M0uP2nx.1 2024-09-14T11:07:51.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.569+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-14T11:07:51.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.569+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15__multipart_foo-STANDARD.2~ePCjjAHKMAH1sxbj5jX98_k7M0uP2nx.2 2024-09-14T11:07:51.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.569+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-14T11:07:51.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.569+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15__multipart_foo-STANDARD.2~ePCjjAHKMAH1sxbj5jX98_k7M0uP2nx.3 2024-09-14T11:07:51.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.569+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-14T11:07:51.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.569+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.569+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6759393883595264595 2024-09-14T11:07:51.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.570+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:07:51.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.570+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7e4a300 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55b7d7dec458 s->prefetch_data=0 2024-09-14T11:07:51.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.570+0000 7fbdec723800 10 manifest: total_size = 11534336 2024-09-14T11:07:51.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.570+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1642650797208660769 2024-09-14T11:07:51.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.570+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7e4a300 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55b7d7dec458 s->prefetch_data=0 2024-09-14T11:07:51.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.570+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dec458 2024-09-14T11:07:51.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.570+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15.7 2024-09-14T11:07:51.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.573+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:07:51.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.573+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:07:51.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.573+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:07:51.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.573+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:07:51.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.573+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:07:51.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.573+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:07:51.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.573+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:07:51.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.573+0000 7fbdec723800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:07:51.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.573+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:07:51.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.573+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1642650797208660769 2024-09-14T11:07:51.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.573+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.573+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15__multipart_foo-LUKEWARM.2~bbOdMGJV9NtfxLk9dUcc2DgrCbvAUJS.1 2024-09-14T11:07:51.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.573+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-14T11:07:51.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.573+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15__multipart_foo-LUKEWARM.2~bbOdMGJV9NtfxLk9dUcc2DgrCbvAUJS.2 2024-09-14T11:07:51.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.573+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-14T11:07:51.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.573+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15__multipart_foo-LUKEWARM.2~bbOdMGJV9NtfxLk9dUcc2DgrCbvAUJS.3 2024-09-14T11:07:51.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.573+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-14T11:07:51.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.573+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.573+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1642650797208660769 2024-09-14T11:07:51.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.574+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:07:51.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.574+0000 7fbdec723800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:07:51.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.574+0000 7fbdec723800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:07:51.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.575+0000 7fbdec723800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:07:51.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.575+0000 7fbdec723800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:07:51.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.575+0000 7fbdec723800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:07:51.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.575+0000 7fbdec723800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:07:51.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.575+0000 7fbdec723800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15])"; uploads.size()=0; is_truncated=0 2024-09-14T11:07:51.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.577+0000 7fbdec723800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-14T11:07:51.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.577+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.577+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=238 2024-09-14T11:07:51.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.577+0000 7fbdec723800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-14T11:07:51.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.577+0000 7fbdec723800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-14T11:07:51.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.578+0000 7fbdec723800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-14T11:07:51.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.578+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-14T11:07:51.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.578+0000 7fbcbf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497043 cookie 94248088682064 notifier 6012 bl.length()=194 2024-09-14T11:07:51.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.581+0000 7fbdec723800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15 from cache 2024-09-14T11:07:51.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.581+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15, ofs0, ns] 2024-09-14T11:07:51.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.581+0000 7fbcbf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496983 cookie 94248088681008 notifier 6012 bl.length()=252 2024-09-14T11:07:51.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.585+0000 7fbdec723800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15 : miss 2024-09-14T11:07:51.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.585+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.585+0000 7fbdec723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:51.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.585+0000 7fbdec723800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15 info.flags=0x0 2024-09-14T11:07:51.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.585+0000 7fbdec723800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15 to cache LRU end 2024-09-14T11:07:51.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.587+0000 7fbdec723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14 : miss 2024-09-14T11:07:51.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.587+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.588+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=450 2024-09-14T11:07:51.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.588+0000 7fbdec723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14 info.flags=0x17 2024-09-14T11:07:51.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.588+0000 7fbdec723800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14 to cache LRU end 2024-09-14T11:07:51.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.588+0000 7fbdec723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:07:51.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.588+0000 7fbdec723800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:07:51.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.588+0000 7fbdec723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14 2024-09-14T11:07:51.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.590+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:07:51.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.590+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:07:51.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.591+0000 7fbdec723800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:07:51.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.592+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7e4a300 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55b7d7dec888 s->prefetch_data=0 2024-09-14T11:07:51.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.593+0000 7fbdec723800 10 manifest: total_size = 10485760 2024-09-14T11:07:51.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.593+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2410705584116414409 2024-09-14T11:07:51.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.593+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7e4a300 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55b7d7dec888 s->prefetch_data=0 2024-09-14T11:07:51.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.593+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dec888 2024-09-14T11:07:51.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.593+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14.3 2024-09-14T11:07:51.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.595+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.595+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.595+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.595+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.595+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2410705584116414409 2024-09-14T11:07:51.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.595+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.595+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14__shadow_.VQdIjRQ5CHXncTMR-Hs6E0SszR4o6i9_0 2024-09-14T11:07:51.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.595+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-14T11:07:51.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.595+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14__shadow_.VQdIjRQ5CHXncTMR-Hs6E0SszR4o6i9_1 2024-09-14T11:07:51.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.595+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-14T11:07:51.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.595+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.595+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2410705584116414409 2024-09-14T11:07:51.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.597+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:07:51.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.597+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc03b970 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55b7d7dec888 s->prefetch_data=0 2024-09-14T11:07:51.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.597+0000 7fbdec723800 10 manifest: total_size = 53499 2024-09-14T11:07:51.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.597+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15172937508047999669 2024-09-14T11:07:51.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.597+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc03b970 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55b7d7dec888 s->prefetch_data=0 2024-09-14T11:07:51.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.597+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dec888 2024-09-14T11:07:51.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.597+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14.5 2024-09-14T11:07:51.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.600+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.600+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=53499 stripe_ofs=53499 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.600+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15172937508047999669 2024-09-14T11:07:51.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.600+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.600+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14__shadow_.tpGyov9A7z987N8nuqpm_sf39bpvVaR_0 2024-09-14T11:07:51.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.600+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-14T11:07:51.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.600+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.600+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15172937508047999669 2024-09-14T11:07:51.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.601+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:07:51.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.601+0000 7fbdec723800 20 get_obj_state: octx=0x7fbde007c150 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55b7d7dec888 s->prefetch_data=0 2024-09-14T11:07:51.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.601+0000 7fbdec723800 10 manifest: total_size = 10485760 2024-09-14T11:07:51.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.601+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7133817259882645450 2024-09-14T11:07:51.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.601+0000 7fbdec723800 20 get_obj_state: octx=0x7fbde007c150 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55b7d7dec888 s->prefetch_data=0 2024-09-14T11:07:51.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.601+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dec888 2024-09-14T11:07:51.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.601+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14.7 2024-09-14T11:07:51.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.604+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.604+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.604+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.604+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.604+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7133817259882645450 2024-09-14T11:07:51.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.604+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.604+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14__shadow_.IxJdE5SMKY_6udKk7BYCu0TFqT1XMFn_0 2024-09-14T11:07:51.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.604+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-14T11:07:51.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.604+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14__shadow_.IxJdE5SMKY_6udKk7BYCu0TFqT1XMFn_1 2024-09-14T11:07:51.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.604+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-14T11:07:51.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.604+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.604+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7133817259882645450 2024-09-14T11:07:51.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.605+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:07:51.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.605+0000 7fbdec723800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:07:51.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.605+0000 7fbdec723800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:07:51.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.606+0000 7fbdec723800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:07:51.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.606+0000 7fbdec723800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:07:51.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.606+0000 7fbdec723800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:07:51.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.606+0000 7fbdec723800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:07:51.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.606+0000 7fbdec723800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14])"; uploads.size()=0; is_truncated=0 2024-09-14T11:07:51.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.607+0000 7fbdec723800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-14T11:07:51.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.607+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.608+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=228 2024-09-14T11:07:51.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.608+0000 7fbdec723800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-14T11:07:51.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.608+0000 7fbdec723800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-14T11:07:51.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.609+0000 7fbdec723800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-14T11:07:51.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.609+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-14T11:07:51.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.609+0000 7fbcbeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496984 cookie 94248088681008 notifier 6012 bl.length()=184 2024-09-14T11:07:51.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.612+0000 7fbdec723800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14 from cache 2024-09-14T11:07:51.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.612+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14, ofs0, ns] 2024-09-14T11:07:51.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.612+0000 7fbcbf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497037 cookie 94248088619984 notifier 6012 bl.length()=242 2024-09-14T11:07:51.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.615+0000 7fbdec723800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14 : miss 2024-09-14T11:07:51.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.615+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.615+0000 7fbdec723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:51.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.615+0000 7fbdec723800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14 info.flags=0x0 2024-09-14T11:07:51.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.615+0000 7fbdec723800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14 to cache LRU end 2024-09-14T11:07:51.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.618+0000 7fbdec723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7 : miss 2024-09-14T11:07:51.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.618+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.618+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:07:51.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.618+0000 7fbdec723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7 info.flags=0x17 2024-09-14T11:07:51.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.618+0000 7fbdec723800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7 to cache LRU end 2024-09-14T11:07:51.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.618+0000 7fbdec723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:07:51.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.618+0000 7fbdec723800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:07:51.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.618+0000 7fbdec723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7 2024-09-14T11:07:51.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.619+0000 7fbdec723800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:07:51.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.619+0000 7fbdec723800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:07:51.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.620+0000 7fbdec723800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:07:51.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.621+0000 7fbdec723800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:07:51.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.622+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7de8550 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55b7d7dec458 s->prefetch_data=0 2024-09-14T11:07:51.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.622+0000 7fbdec723800 10 manifest: total_size = 0 2024-09-14T11:07:51.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.622+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5147733399135689732 2024-09-14T11:07:51.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.622+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7de8550 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55b7d7dec458 s->prefetch_data=0 2024-09-14T11:07:51.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.622+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dec458 2024-09-14T11:07:51.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.622+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7.2 2024-09-14T11:07:51.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.625+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7de8550 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55b7d7d62878 s->prefetch_data=0 2024-09-14T11:07:51.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.625+0000 7fbdec723800 10 manifest: total_size = 0 2024-09-14T11:07:51.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.625+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12613371871923986688 2024-09-14T11:07:51.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.625+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7de8550 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55b7d7d62878 s->prefetch_data=0 2024-09-14T11:07:51.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.625+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7d62878 2024-09-14T11:07:51.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.625+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7.3 2024-09-14T11:07:51.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.626+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:07:51.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.627+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7e4a200 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55b7d7d62878 s->prefetch_data=0 2024-09-14T11:07:51.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.628+0000 7fbdec723800 10 manifest: total_size = 0 2024-09-14T11:07:51.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.628+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4326581663524233921 2024-09-14T11:07:51.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.628+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7e4a200 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55b7d7d62878 s->prefetch_data=0 2024-09-14T11:07:51.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.628+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7d62878 2024-09-14T11:07:51.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.628+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7.6 2024-09-14T11:07:51.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.629+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:07:51.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.630+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc00ce10 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55b7d7d62878 s->prefetch_data=0 2024-09-14T11:07:51.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.631+0000 7fbdec723800 10 manifest: total_size = 0 2024-09-14T11:07:51.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.631+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10084729061199840442 2024-09-14T11:07:51.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.631+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc00ce10 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55b7d7d62878 s->prefetch_data=0 2024-09-14T11:07:51.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.631+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7d62878 2024-09-14T11:07:51.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.631+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7.8 2024-09-14T11:07:51.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.631+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:07:51.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.633+0000 7fbdec723800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:07:51.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.633+0000 7fbdec723800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:07:51.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.635+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:07:51.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.635+0000 7fbdec723800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:07:51.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.635+0000 7fbdec723800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:07:51.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.635+0000 7fbdec723800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:07:51.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.635+0000 7fbdec723800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:07:51.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.635+0000 7fbdec723800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7])"; uploads.size()=0; is_truncated=0 2024-09-14T11:07:51.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.637+0000 7fbdec723800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-14T11:07:51.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.637+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.637+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:07:51.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.637+0000 7fbdec723800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-14T11:07:51.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.637+0000 7fbdec723800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-14T11:07:51.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.638+0000 7fbdec723800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-14T11:07:51.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.638+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-14T11:07:51.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.639+0000 7fbcbeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497038 cookie 94248088619984 notifier 6012 bl.length()=181 2024-09-14T11:07:51.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.641+0000 7fbdec723800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7 from cache 2024-09-14T11:07:51.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.641+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7, ofs0, ns] 2024-09-14T11:07:51.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.642+0000 7fbcbeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497039 cookie 94248088619984 notifier 6012 bl.length()=238 2024-09-14T11:07:51.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.645+0000 7fbdec723800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7 : miss 2024-09-14T11:07:51.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.645+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.646+0000 7fbdec723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:51.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.646+0000 7fbdec723800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7 info.flags=0x0 2024-09-14T11:07:51.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.646+0000 7fbdec723800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7 to cache LRU end 2024-09-14T11:07:51.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.648+0000 7fbdec723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8 : miss 2024-09-14T11:07:51.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.648+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.648+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:07:51.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.648+0000 7fbdec723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8 info.flags=0x17 2024-09-14T11:07:51.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.648+0000 7fbdec723800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8 to cache LRU end 2024-09-14T11:07:51.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.648+0000 7fbdec723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:07:51.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.648+0000 7fbdec723800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:07:51.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.648+0000 7fbdec723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8 2024-09-14T11:07:51.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.649+0000 7fbdec723800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:07:51.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.650+0000 7fbdec723800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:07:51.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.651+0000 7fbdec723800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:07:51.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.652+0000 7fbdec723800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:07:51.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.652+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7e490a0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55b7d7e016e8 s->prefetch_data=0 2024-09-14T11:07:51.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.653+0000 7fbdec723800 10 manifest: total_size = 2078 2024-09-14T11:07:51.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.653+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10888861439105107786 2024-09-14T11:07:51.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.653+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7e490a0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55b7d7e016e8 s->prefetch_data=0 2024-09-14T11:07:51.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.653+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7e016e8 2024-09-14T11:07:51.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.653+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8.2 2024-09-14T11:07:51.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.655+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.655+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.655+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10888861439105107786 2024-09-14T11:07:51.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.655+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.655+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8__shadow_.J0fVIBuXdiUyS-0sKOmNQSbL0l3995f_0 2024-09-14T11:07:51.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.655+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:07:51.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.655+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.655+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10888861439105107786 2024-09-14T11:07:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.657+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:07:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.657+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7e49000 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55b7d7e016e8 s->prefetch_data=0 2024-09-14T11:07:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.657+0000 7fbdec723800 10 manifest: total_size = 24595 2024-09-14T11:07:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.657+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12727175284714484515 2024-09-14T11:07:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.657+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7e49000 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55b7d7e016e8 s->prefetch_data=0 2024-09-14T11:07:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.657+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7e016e8 2024-09-14T11:07:51.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.657+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8.3 2024-09-14T11:07:51.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.659+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.659+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.659+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12727175284714484515 2024-09-14T11:07:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.659+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.659+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8__shadow_.pzoh0wUyZwtkEPhx5pERpzeFULLvCa6_0 2024-09-14T11:07:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.659+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:07:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.659+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.659+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12727175284714484515 2024-09-14T11:07:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.661+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:07:51.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.661+0000 7fbdec723800 20 get_obj_state: octx=0x7fbdd804e330 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55b7d7e016e8 s->prefetch_data=0 2024-09-14T11:07:51.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.661+0000 7fbdec723800 10 manifest: total_size = 2078 2024-09-14T11:07:51.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.661+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5715470445443067381 2024-09-14T11:07:51.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.661+0000 7fbdec723800 20 get_obj_state: octx=0x7fbdd804e330 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55b7d7e016e8 s->prefetch_data=0 2024-09-14T11:07:51.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.661+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7e016e8 2024-09-14T11:07:51.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.661+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8.6 2024-09-14T11:07:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.663+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.663+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.663+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5715470445443067381 2024-09-14T11:07:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.663+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.663+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8__shadow_.2ppZVJWC8u375gUK8tV71iV_7Ys_qHi_0 2024-09-14T11:07:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.663+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:07:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.663+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.663+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5715470445443067381 2024-09-14T11:07:51.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.665+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:07:51.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.665+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7e490a0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55b7d7e016e8 s->prefetch_data=0 2024-09-14T11:07:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.665+0000 7fbdec723800 10 manifest: total_size = 2078 2024-09-14T11:07:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.665+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5286863150212645270 2024-09-14T11:07:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.665+0000 7fbdec723800 20 get_obj_state: octx=0x55b7d7e490a0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55b7d7e016e8 s->prefetch_data=0 2024-09-14T11:07:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.665+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7e016e8 2024-09-14T11:07:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.665+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8.8 2024-09-14T11:07:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.668+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.668+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.668+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5286863150212645270 2024-09-14T11:07:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.668+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.668+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8__shadow_.EHcUmSBlvL2m_Kl2JNUsI0YPqSJdc9b_0 2024-09-14T11:07:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.668+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:07:51.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.668+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.668+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5286863150212645270 2024-09-14T11:07:51.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.669+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:07:51.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.669+0000 7fbdec723800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:07:51.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.669+0000 7fbdec723800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:07:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.670+0000 7fbdec723800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:07:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.670+0000 7fbdec723800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:07:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.670+0000 7fbdec723800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:07:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.670+0000 7fbdec723800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:07:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.670+0000 7fbdec723800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8])"; uploads.size()=0; is_truncated=0 2024-09-14T11:07:51.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.672+0000 7fbdec723800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-14T11:07:51.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.672+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.672+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:07:51.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.672+0000 7fbdec723800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-14T11:07:51.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.672+0000 7fbdec723800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-14T11:07:51.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.673+0000 7fbdec723800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-14T11:07:51.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.673+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-14T11:07:51.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.673+0000 7fbcbf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497040 cookie 94248088619984 notifier 6012 bl.length()=181 2024-09-14T11:07:51.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.676+0000 7fbdec723800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8 from cache 2024-09-14T11:07:51.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.676+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8, ofs0, ns] 2024-09-14T11:07:51.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.676+0000 7fbcbf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497041 cookie 94248088619984 notifier 6012 bl.length()=238 2024-09-14T11:07:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.680+0000 7fbdec723800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8 : miss 2024-09-14T11:07:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.680+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.680+0000 7fbdec723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.680+0000 7fbdec723800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8 info.flags=0x0 2024-09-14T11:07:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.680+0000 7fbdec723800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8 to cache LRU end 2024-09-14T11:07:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.682+0000 7fbdec723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9 : miss 2024-09-14T11:07:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.682+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.683+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:07:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.683+0000 7fbdec723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9 info.flags=0x17 2024-09-14T11:07:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.683+0000 7fbdec723800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9 to cache LRU end 2024-09-14T11:07:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.683+0000 7fbdec723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:07:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.683+0000 7fbdec723800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:07:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.683+0000 7fbdec723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9 2024-09-14T11:07:51.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.684+0000 7fbdec723800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:07:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.684+0000 7fbdec723800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:07:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.685+0000 7fbdec723800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:07:51.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.686+0000 7fbdec723800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:07:51.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.687+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc00cba0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55b7d7dccdb8 s->prefetch_data=0 2024-09-14T11:07:51.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.687+0000 7fbdec723800 10 manifest: total_size = 55 2024-09-14T11:07:51.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.687+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17145054485412900029 2024-09-14T11:07:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.687+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc00cba0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55b7d7dccdb8 s->prefetch_data=0 2024-09-14T11:07:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.687+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dccdb8 2024-09-14T11:07:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.687+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9.2 2024-09-14T11:07:51.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.690+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.690+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.690+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17145054485412900029 2024-09-14T11:07:51.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.690+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.690+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9__shadow_.5jfwtGA-DtUS46Iwm0jH7FPLSiS-rf0_0 2024-09-14T11:07:51.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.690+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:07:51.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.690+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.690+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17145054485412900029 2024-09-14T11:07:51.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.692+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc00cba0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55b7d7d62828 s->prefetch_data=0 2024-09-14T11:07:51.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.692+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:07:51.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.692+0000 7fbdec723800 10 manifest: total_size = 55 2024-09-14T11:07:51.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.692+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3230243080144740178 2024-09-14T11:07:51.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.692+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc00cba0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55b7d7d62828 s->prefetch_data=0 2024-09-14T11:07:51.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.692+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7d62828 2024-09-14T11:07:51.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.692+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9.3 2024-09-14T11:07:51.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.695+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.695+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.695+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3230243080144740178 2024-09-14T11:07:51.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.695+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.695+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9__shadow_.tOV55VYttJ7iw4p78Gkot8BMmkZ7wCA_0 2024-09-14T11:07:51.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.695+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:07:51.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.695+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.695+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3230243080144740178 2024-09-14T11:07:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.697+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc00cba0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55b7d7d62828 s->prefetch_data=0 2024-09-14T11:07:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.697+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:07:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.697+0000 7fbdec723800 10 manifest: total_size = 1035 2024-09-14T11:07:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.697+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7549797980451308052 2024-09-14T11:07:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.697+0000 7fbdec723800 20 get_obj_state: octx=0x7fbddc00cba0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55b7d7d62828 s->prefetch_data=0 2024-09-14T11:07:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.697+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7d62828 2024-09-14T11:07:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.697+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9.6 2024-09-14T11:07:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.699+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.699+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.699+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7549797980451308052 2024-09-14T11:07:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.699+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.699+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9__shadow_.MJA5edrNOT0bVEDaXS3IbheKkEcH1o8_0 2024-09-14T11:07:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.699+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:07:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.699+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.699+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7549797980451308052 2024-09-14T11:07:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.700+0000 7fbcbf7fe640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:07:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.701+0000 7fbdec723800 20 get_obj_state: octx=0x7fbdd804e330 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55b7d7dccdb8 s->prefetch_data=0 2024-09-14T11:07:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.701+0000 7fbdec723800 10 manifest: total_size = 4134 2024-09-14T11:07:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.701+0000 7fbdec723800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2226245566687087476 2024-09-14T11:07:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.701+0000 7fbdec723800 20 get_obj_state: octx=0x7fbdd804e330 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55b7d7dccdb8 s->prefetch_data=0 2024-09-14T11:07:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.701+0000 7fbdec723800 20 prepare_atomic_modification: state is not atomic. state=0x55b7d7dccdb8 2024-09-14T11:07:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.701+0000 7fbdec723800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9.8 2024-09-14T11:07:51.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.704+0000 7fbdec723800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:07:51.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.704+0000 7fbdec723800 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-14T11:07:51.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.704+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2226245566687087476 2024-09-14T11:07:51.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.704+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:07:51.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.704+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9__shadow_.k_crTzDP4SB04zcE5r2YuPzTkenSX4P_0 2024-09-14T11:07:51.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.704+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:07:51.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.704+0000 7fbdec723800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:07:51.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.704+0000 7fbdec723800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2226245566687087476 2024-09-14T11:07:51.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.705+0000 7fbcbeffd640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:07:51.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.705+0000 7fbdec723800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:07:51.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.705+0000 7fbdec723800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:07:51.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.706+0000 7fbdec723800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:07:51.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.706+0000 7fbdec723800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:07:51.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.706+0000 7fbdec723800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:07:51.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.706+0000 7fbdec723800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:07:51.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.706+0000 7fbdec723800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9])"; uploads.size()=0; is_truncated=0 2024-09-14T11:07:51.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.708+0000 7fbdec723800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-14T11:07:51.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.708+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.708+0000 7fbdec723800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:07:51.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.708+0000 7fbdec723800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-14T11:07:51.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.708+0000 7fbdec723800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-14T11:07:51.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.710+0000 7fbdec723800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-14T11:07:51.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.710+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-14T11:07:51.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.710+0000 7fbcbf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497042 cookie 94248088619984 notifier 6012 bl.length()=181 2024-09-14T11:07:51.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.712+0000 7fbdec723800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9 from cache 2024-09-14T11:07:51.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.712+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9, ofs0, ns] 2024-09-14T11:07:51.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.713+0000 7fbcbeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497043 cookie 94248088619984 notifier 6012 bl.length()=238 2024-09-14T11:07:51.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.716+0000 7fbdec723800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9 : miss 2024-09-14T11:07:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.716+0000 7fbdec723800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.717+0000 7fbdec723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.717+0000 7fbdec723800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9 info.flags=0x0 2024-09-14T11:07:51.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.717+0000 7fbdec723800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9 to cache LRU end 2024-09-14T11:07:51.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.719+0000 7fbdec723800 10 removing key index: BXTSXOPTETQHROKOTBGQ 2024-09-14T11:07:51.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.719+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:BXTSXOPTETQHROKOTBGQ, ofs0, ns] 2024-09-14T11:07:51.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.720+0000 7fbcbf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496985 cookie 94248088681008 notifier 6012 bl.length()=170 2024-09-14T11:07:51.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.721+0000 7fbdec723800 10 removing email index: ragweed.client.0+test@test.test 2024-09-14T11:07:51.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.722+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:07:51.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.722+0000 7fbcbeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496986 cookie 94248088681008 notifier 6012 bl.length()=182 2024-09-14T11:07:51.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.723+0000 7fbdec723800 10 removing user buckets index 2024-09-14T11:07:51.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.724+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-14T11:07:51.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.724+0000 7fbcbeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497044 cookie 94248088682064 notifier 6012 bl.length()=173 2024-09-14T11:07:51.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.725+0000 7fbdec723800 10 removing user index: ragweed.client.0 2024-09-14T11:07:51.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.726+0000 7fbdec723800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-14T11:07:51.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.726+0000 7fbdec723800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:07:51.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.727+0000 7fbcbeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497044 cookie 94248088688464 notifier 6012 bl.length()=165 2024-09-14T11:07:51.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.730+0000 7fbc9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:51.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.732+0000 7fbdec723800 20 remove_watcher() i=0 2024-09-14T11:07:51.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.732+0000 7fbdec723800 2 removed watcher, disabling cache 2024-09-14T11:07:51.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.733+0000 7fbdec723800 20 remove_watcher() i=1 2024-09-14T11:07:51.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.734+0000 7fbdec723800 20 remove_watcher() i=2 2024-09-14T11:07:51.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.735+0000 7fbdec723800 20 remove_watcher() i=3 2024-09-14T11:07:51.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.736+0000 7fbdec723800 20 remove_watcher() i=4 2024-09-14T11:07:51.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.737+0000 7fbdec723800 20 remove_watcher() i=5 2024-09-14T11:07:51.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.738+0000 7fbdec723800 20 remove_watcher() i=6 2024-09-14T11:07:51.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.739+0000 7fbdec723800 20 remove_watcher() i=7 2024-09-14T11:07:51.750 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-14T11:07:51.808 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:07:51.808 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:07:51.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.845+0000 7f22db820800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.846+0000 7f22db820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:51.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.846+0000 7f22db820800 20 realm 2024-09-14T11:07:51.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.846+0000 7f22db820800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.847+0000 7f22db820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:51.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.847+0000 7f22db820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:07:51.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.847+0000 7f22db820800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.847+0000 7f22db820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:51.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.847+0000 7f22db820800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.847+0000 7f22db820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:51.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.847+0000 7f22db820800 20 rados->read ofs=0 len=0 2024-09-14T11:07:51.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.848+0000 7f22db820800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:07:51.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.848+0000 7f22db820800 20 searching for the correct realm 2024-09-14T11:07:51.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:51.851+0000 7f22d8b09640 0 -- 172.21.15.50:0/162891134 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f22d4017020 msgr2=0x7f22d406c060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:07:52.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.055+0000 7f22d9b0b640 0 -- 172.21.15.50:0/162891134 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x555d739230a0 msgr2=0x555d73925560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:52.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.059+0000 7f22db820800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:07:52.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.059+0000 7f22db820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:07:52.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.059+0000 7f22db820800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:07:52.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.059+0000 7f22db820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:07:52.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.059+0000 7f22db820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:07:52.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.059+0000 7f22db820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:07:52.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.059+0000 7f22db820800 20 rados->read ofs=0 len=0 2024-09-14T11:07:52.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.059+0000 7f22db820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:52.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.059+0000 7f22db820800 20 rados->read ofs=0 len=0 2024-09-14T11:07:52.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.060+0000 7f22db820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:52.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.060+0000 7f22db820800 20 rados->read ofs=0 len=0 2024-09-14T11:07:52.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.060+0000 7f22db820800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:07:52.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.060+0000 7f22db820800 20 zone default found 2024-09-14T11:07:52.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.060+0000 7f22db820800 4 Realm: () 2024-09-14T11:07:52.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.060+0000 7f22db820800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:07:52.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.060+0000 7f22db820800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:07:52.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.060+0000 7f22db820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:07:52.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.060+0000 7f22db820800 20 zonegroup default 2024-09-14T11:07:52.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.060+0000 7f22db820800 20 rados->read ofs=0 len=0 2024-09-14T11:07:52.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.060+0000 7f22db820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:52.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.060+0000 7f22db820800 20 rados->read ofs=0 len=0 2024-09-14T11:07:52.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.061+0000 7f22db820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:52.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.061+0000 7f22db820800 20 rados->read ofs=0 len=0 2024-09-14T11:07:52.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.061+0000 7f22db820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:52.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.061+0000 7f22db820800 20 started sync module instance, tier type = 2024-09-14T11:07:52.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.061+0000 7f22db820800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:07:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.070+0000 7f22db820800 20 add_watcher() i=0 2024-09-14T11:07:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.070+0000 7f22db820800 20 add_watcher() i=1 2024-09-14T11:07:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.070+0000 7f22db820800 20 add_watcher() i=2 2024-09-14T11:07:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.070+0000 7f22db820800 20 add_watcher() i=3 2024-09-14T11:07:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.070+0000 7f22db820800 20 add_watcher() i=4 2024-09-14T11:07:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.070+0000 7f22db820800 20 add_watcher() i=5 2024-09-14T11:07:52.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.070+0000 7f22db820800 20 add_watcher() i=6 2024-09-14T11:07:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.071+0000 7f22db820800 20 add_watcher() i=7 2024-09-14T11:07:52.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.071+0000 7f22db820800 2 all 8 watchers are set, enabling cache 2024-09-14T11:07:52.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.073+0000 7f218f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:52.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.073+0000 7f22db820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:07:52.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.073+0000 7f22db820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:07:52.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.110+0000 7f218e7e4640 20 reqs_thread_entry: start 2024-09-14T11:07:52.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.110+0000 7f22db820800 20 init_complete bucket index max shards: 11 2024-09-14T11:07:52.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.110+0000 7f22db820800 20 Filter name: none 2024-09-14T11:07:52.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.110+0000 7f20fffff640 20 reqs_thread_entry: start 2024-09-14T11:07:52.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.110+0000 7f22db820800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:07:52.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.110+0000 7f22db820800 20 rados->read ofs=0 len=0 2024-09-14T11:07:52.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.111+0000 7f22db820800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:07:52.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.111+0000 7f22db820800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-14T11:07:52.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.111+0000 7f22db820800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:07:52.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.111+0000 7f22db820800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:07:52.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.111+0000 7f22db820800 10 removing key index: ZCJIJNWGIQDACWLYPPCO 2024-09-14T11:07:52.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.112+0000 7f22db820800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:ZCJIJNWGIQDACWLYPPCO, ofs0, ns] 2024-09-14T11:07:52.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.112+0000 7f21bcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497045 cookie 93859859355808 notifier 5696 bl.length()=170 2024-09-14T11:07:52.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.114+0000 7f22db820800 10 removing email index: sysuser.client.0+test@test.test 2024-09-14T11:07:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.115+0000 7f22db820800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:07:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.115+0000 7f21abfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497046 cookie 93859859355808 notifier 5696 bl.length()=182 2024-09-14T11:07:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.116+0000 7f22db820800 10 removing user buckets index 2024-09-14T11:07:52.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.117+0000 7f22db820800 10 removing user index: sysuser.client.0 2024-09-14T11:07:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.118+0000 7f22db820800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-14T11:07:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.118+0000 7f22db820800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:07:52.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.119+0000 7f21abfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496987 cookie 93859859348240 notifier 5696 bl.length()=165 2024-09-14T11:07:52.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.123+0000 7f218f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:52.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.124+0000 7f22db820800 20 remove_watcher() i=0 2024-09-14T11:07:52.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.125+0000 7f22db820800 2 removed watcher, disabling cache 2024-09-14T11:07:52.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.125+0000 7f22db820800 20 remove_watcher() i=1 2024-09-14T11:07:52.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.127+0000 7f22db820800 20 remove_watcher() i=2 2024-09-14T11:07:52.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.128+0000 7f22db820800 20 remove_watcher() i=3 2024-09-14T11:07:52.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.129+0000 7f22db820800 20 remove_watcher() i=4 2024-09-14T11:07:52.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.130+0000 7f22db820800 20 remove_watcher() i=5 2024-09-14T11:07:52.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.131+0000 7f22db820800 20 remove_watcher() i=6 2024-09-14T11:07:52.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:07:52.132+0000 7f22db820800 20 remove_watcher() i=7 2024-09-14T11:07:52.143 INFO:tasks.ragweed:Removing ragweed... 2024-09-14T11:07:52.143 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:07:52.229 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:07:52.247 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:07:52.247 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:07:52.247 DEBUG:teuthology.orchestra.run.smithi050:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:07:52.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:07:52.277 INFO:teuthology.orchestra.run.smithi050.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:07:52.277 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:07:52.346 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:07:52.346 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:07:52.416 INFO:tasks.workunit:timeout=3h 2024-09-14T11:07:52.417 INFO:tasks.workunit:cleanup=True 2024-09-14T11:07:52.417 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:07:52.488 INFO:tasks.workunit.client.0.smithi050.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:08:49.528 INFO:tasks.workunit.client.0.smithi050.stderr:Updating files: 94% (12224/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:08:50.000 INFO:tasks.workunit.client.0.smithi050.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:08:50.001 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:08:50.001 INFO:tasks.workunit.client.0.smithi050.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:08:50.001 INFO:tasks.workunit.client.0.smithi050.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:08:50.001 INFO:tasks.workunit.client.0.smithi050.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:08:50.001 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:08:50.001 INFO:tasks.workunit.client.0.smithi050.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:08:50.001 INFO:tasks.workunit.client.0.smithi050.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:08:50.001 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:08:50.001 INFO:tasks.workunit.client.0.smithi050.stderr: git switch -c 2024-09-14T11:08:50.001 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:08:50.001 INFO:tasks.workunit.client.0.smithi050.stderr:Or undo this operation with: 2024-09-14T11:08:50.002 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:08:50.002 INFO:tasks.workunit.client.0.smithi050.stderr: git switch - 2024-09-14T11:08:50.002 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:08:50.002 INFO:tasks.workunit.client.0.smithi050.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:08:50.002 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:08:50.002 INFO:tasks.workunit.client.0.smithi050.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:08:50.004 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:08:50.074 INFO:tasks.workunit.client.0.smithi050.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:08:50.076 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:08:50.076 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:08:50.127 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:08:50.178 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:08:50.219 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:08:50.220 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:08:50.220 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:08:50.261 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:08:50.265 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T11:08:50.265 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:08:50.335 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-14T11:08:50.336 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-14T11:08:50.336 DEBUG:teuthology.orchestra.run.smithi050:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:08:50.409 INFO:tasks.workunit.client.0.smithi050.stderr:+ ulimit -c 0 2024-09-14T11:08:50.409 INFO:tasks.workunit.client.0.smithi050.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:08:50.410 INFO:tasks.workunit.client.0.smithi050.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:08:50.410 INFO:tasks.workunit.client.0.smithi050.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:08:52.799 INFO:tasks.workunit.client.0.smithi050.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:08:52.799 INFO:tasks.workunit.client.0.smithi050.stderr:++ deactivate nondestructive 2024-09-14T11:08:52.799 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -n '' ']' 2024-09-14T11:08:52.799 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -n '' ']' 2024-09-14T11:08:52.800 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:08:52.800 INFO:tasks.workunit.client.0.smithi050.stderr:++ hash -r 2024-09-14T11:08:52.800 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -n '' ']' 2024-09-14T11:08:52.800 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:08:52.800 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:08:52.800 INFO:tasks.workunit.client.0.smithi050.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:08:52.800 INFO:tasks.workunit.client.0.smithi050.stderr:++ export VIRTUAL_ENV 2024-09-14T11:08:52.800 INFO:tasks.workunit.client.0.smithi050.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:08:52.800 INFO:tasks.workunit.client.0.smithi050.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:08:52.801 INFO:tasks.workunit.client.0.smithi050.stderr:++ export PATH 2024-09-14T11:08:52.801 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -n '' ']' 2024-09-14T11:08:52.801 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2024-09-14T11:08:52.801 INFO:tasks.workunit.client.0.smithi050.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:08:52.801 INFO:tasks.workunit.client.0.smithi050.stderr:++ PS1='(rgw) ' 2024-09-14T11:08:52.801 INFO:tasks.workunit.client.0.smithi050.stderr:++ export PS1 2024-09-14T11:08:52.801 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:08:52.802 INFO:tasks.workunit.client.0.smithi050.stderr:++ hash -r 2024-09-14T11:08:52.802 INFO:tasks.workunit.client.0.smithi050.stderr:+ pip install pip --upgrade 2024-09-14T11:08:53.039 INFO:tasks.workunit.client.0.smithi050.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:08:53.222 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting pip 2024-09-14T11:08:53.228 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:08:53.275 INFO:tasks.workunit.client.0.smithi050.stdout:Installing collected packages: pip 2024-09-14T11:08:53.275 INFO:tasks.workunit.client.0.smithi050.stdout: Attempting uninstall: pip 2024-09-14T11:08:53.275 INFO:tasks.workunit.client.0.smithi050.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:08:53.438 INFO:tasks.workunit.client.0.smithi050.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:08:53.443 INFO:tasks.workunit.client.0.smithi050.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:08:54.218 INFO:tasks.workunit.client.0.smithi050.stdout:Successfully installed pip-24.2 2024-09-14T11:08:54.267 INFO:tasks.workunit.client.0.smithi050.stderr:+ pip install boto3 2024-09-14T11:08:55.074 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting boto3 2024-09-14T11:08:55.075 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:08:55.698 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:08:55.699 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:08:55.753 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:08:55.754 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:08:55.801 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:08:55.802 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:08:55.851 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:08:55.852 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:08:55.929 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:08:55.930 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:08:56.190 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:08:56.191 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:08:56.196 INFO:tasks.workunit.client.0.smithi050.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:08:56.197 INFO:tasks.workunit.client.0.smithi050.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:08:56.207 INFO:tasks.workunit.client.0.smithi050.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:08:56.208 INFO:tasks.workunit.client.0.smithi050.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:08:56.209 INFO:tasks.workunit.client.0.smithi050.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:08:56.211 INFO:tasks.workunit.client.0.smithi050.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:08:56.212 INFO:tasks.workunit.client.0.smithi050.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:08:56.289 INFO:tasks.workunit.client.0.smithi050.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:08:57.355 INFO:tasks.workunit.client.0.smithi050.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:08:57.476 INFO:tasks.workunit.client.0.smithi050.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-14T11:08:57.604 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-14T11:08:57.640 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:08:57.640 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:08:57.679 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:57.680+0000 7fcd9e12c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:57.681 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:57.682+0000 7fcd9e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:57.681 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:57.682+0000 7fcd9e12c800 20 realm 2024-09-14T11:08:57.681 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:57.682+0000 7fcd9e12c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:57.682 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:57.682+0000 7fcd9e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:57.682 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:57.682+0000 7fcd9e12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:08:57.682 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:57.682+0000 7fcd9e12c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:57.682 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:57.683+0000 7fcd9e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:57.682 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:57.683+0000 7fcd9e12c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:57.683 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:57.683+0000 7fcd9e12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:57.683 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:57.683+0000 7fcd9e12c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:57.683 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:57.684+0000 7fcd9e12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:08:57.683 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:57.684+0000 7fcd9e12c800 20 searching for the correct realm 2024-09-14T11:08:57.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:57.888+0000 7fcd9953d640 0 -- 172.21.15.50:0/761905029 >> [v2:172.21.15.50:6816/1957449887,v1:172.21.15.50:6817/1957449887] conn(0x5633dd5fa3e0 msgr2=0x5633dd5fc7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:08:57.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:57.892+0000 7fcd99d3e640 0 -- 172.21.15.50:0/761905029 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7fcd94048b70 msgr2=0x7fcd9408c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:08:58.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.100+0000 7fcd9e12c800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:08:58.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.100+0000 7fcd9e12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:08:58.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.100+0000 7fcd9e12c800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:08:58.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.100+0000 7fcd9e12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:08:58.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.100+0000 7fcd9e12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:08:58.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.100+0000 7fcd9e12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:08:58.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.101+0000 7fcd9e12c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.101+0000 7fcd9e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.101+0000 7fcd9e12c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.101+0000 7fcd9e12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:58.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.101+0000 7fcd9e12c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.102 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.102+0000 7fcd9e12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:08:58.102 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.102+0000 7fcd9e12c800 20 zone default found 2024-09-14T11:08:58.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.102+0000 7fcd9e12c800 4 Realm: () 2024-09-14T11:08:58.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.102+0000 7fcd9e12c800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:08:58.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.102+0000 7fcd9e12c800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:08:58.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.102+0000 7fcd9e12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:08:58.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.102+0000 7fcd9e12c800 20 zonegroup default 2024-09-14T11:08:58.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.102+0000 7fcd9e12c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.102+0000 7fcd9e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.102+0000 7fcd9e12c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.102+0000 7fcd9e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.102+0000 7fcd9e12c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.103+0000 7fcd9e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.103+0000 7fcd9e12c800 20 started sync module instance, tier type = 2024-09-14T11:08:58.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.103+0000 7fcd9e12c800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:08:58.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.114+0000 7fcd9e12c800 20 add_watcher() i=0 2024-09-14T11:08:58.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.114+0000 7fcd9e12c800 20 add_watcher() i=1 2024-09-14T11:08:58.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.114+0000 7fcd9e12c800 20 add_watcher() i=2 2024-09-14T11:08:58.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.114+0000 7fcd9e12c800 20 add_watcher() i=3 2024-09-14T11:08:58.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.114+0000 7fcd9e12c800 20 add_watcher() i=4 2024-09-14T11:08:58.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.114+0000 7fcd9e12c800 20 add_watcher() i=5 2024-09-14T11:08:58.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.114+0000 7fcd9e12c800 20 add_watcher() i=6 2024-09-14T11:08:58.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.115+0000 7fcd9e12c800 20 add_watcher() i=7 2024-09-14T11:08:58.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.115+0000 7fcd9e12c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:08:58.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.117+0000 7fcc4b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:08:58.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.118+0000 7fcd9e12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:08:58.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.118+0000 7fcd9e12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:08:58.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.118+0000 7fcd9e12c800 5 note: GC not initialized 2024-09-14T11:08:58.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.118+0000 7fcc4a7fc640 20 reqs_thread_entry: start 2024-09-14T11:08:58.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.118+0000 7fcd9e12c800 20 init_complete bucket index max shards: 11 2024-09-14T11:08:58.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.118+0000 7fcd9e12c800 20 Filter name: none 2024-09-14T11:08:58.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.118+0000 7fcbbbfff640 20 reqs_thread_entry: start 2024-09-14T11:08:58.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.118+0000 7fcd9e12c800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-14T11:08:58.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.118+0000 7fcd9e12c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.119+0000 7fcd9e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.119+0000 7fcd9e12c800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-14T11:08:58.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.119+0000 7fcd9e12c800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:08:58.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.119+0000 7fcd9e12c800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-14T11:08:58.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.119+0000 7fcd9e12c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.119+0000 7fcd9e12c800 20 rados_obj.operate() r=0 bl.length=22 2024-09-14T11:08:58.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.119+0000 7fcd9e12c800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2024-09-14T11:08:58.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.119+0000 7fcd9e12c800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:08:58.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.119+0000 7fcd9e12c800 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2024-09-14T11:08:58.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.119+0000 7fcd9e12c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.120+0000 7fcd9e12c800 20 rados_obj.operate() r=0 bl.length=420 2024-09-14T11:08:58.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.120+0000 7fcd9e12c800 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x13 2024-09-14T11:08:58.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.120+0000 7fcd9e12c800 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2024-09-14T11:08:58.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.120+0000 7fcd9e12c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:08:58.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.120+0000 7fcd9e12c800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2024-09-14T11:08:58.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.120+0000 7fcd9e12c800 20 get_user_info_from_index found 0 xattrs 2024-09-14T11:08:58.121 INFO:tasks.workunit.client.0.smithi050.stderr:could not create user: unable to parse parameters, duplicate key provided 2024-09-14T11:08:58.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.121+0000 7fcc4b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:08:58.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.123+0000 7fcd9e12c800 20 remove_watcher() i=0 2024-09-14T11:08:58.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.123+0000 7fcd9e12c800 2 removed watcher, disabling cache 2024-09-14T11:08:58.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.124+0000 7fcd9e12c800 20 remove_watcher() i=1 2024-09-14T11:08:58.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.126+0000 7fcd9e12c800 20 remove_watcher() i=2 2024-09-14T11:08:58.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.127+0000 7fcd9e12c800 20 remove_watcher() i=3 2024-09-14T11:08:58.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.128+0000 7fcd9e12c800 20 remove_watcher() i=4 2024-09-14T11:08:58.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.129+0000 7fcd9e12c800 20 remove_watcher() i=5 2024-09-14T11:08:58.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.131+0000 7fcd9e12c800 20 remove_watcher() i=6 2024-09-14T11:08:58.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:08:58.132+0000 7fcd9e12c800 20 remove_watcher() i=7 2024-09-14T11:09:07.012 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:07.013 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:07.062 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:07.062 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:07.110 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:07.110 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:07.158 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:07.159 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:07.189 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:07.189 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:07.251 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:07.251 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:07.306 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard add 2024-09-14T11:09:07.306 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:07.308 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:09:07.339 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:07.339 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:07.378 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.379+0000 7fe0aff46800 20 rados->read ofs=0 len=0 2024-09-14T11:09:07.380 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.381+0000 7fe0aff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:07.380 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.381+0000 7fe0aff46800 20 realm 2024-09-14T11:09:07.380 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.381+0000 7fe0aff46800 20 rados->read ofs=0 len=0 2024-09-14T11:09:07.380 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.381+0000 7fe0aff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:07.380 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.381+0000 7fe0aff46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:07.380 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.381+0000 7fe0aff46800 20 rados->read ofs=0 len=0 2024-09-14T11:09:07.381 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.381+0000 7fe0aff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:07.381 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.381+0000 7fe0aff46800 20 rados->read ofs=0 len=0 2024-09-14T11:09:07.381 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.382+0000 7fe0aff46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:07.381 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.382+0000 7fe0aff46800 20 rados->read ofs=0 len=0 2024-09-14T11:09:07.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.383+0000 7fe0aff46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:07.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.383+0000 7fe0aff46800 20 searching for the correct realm 2024-09-14T11:09:07.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.386+0000 7fe0ad236640 0 -- 172.21.15.50:0/2536702606 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fe0a8019430 msgr2=0x7fe0a80198b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:07.591 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.592+0000 7fe0ae238640 0 -- 172.21.15.50:0/2536702606 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x559b59b9eba0 msgr2=0x559b59ba1020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:07.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.596+0000 7fe0aff46800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:07.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.596+0000 7fe0aff46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:07.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.596+0000 7fe0aff46800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:07.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.596+0000 7fe0aff46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:07.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.596+0000 7fe0aff46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:07.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.596+0000 7fe0aff46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:07.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.597+0000 7fe0aff46800 20 rados->read ofs=0 len=0 2024-09-14T11:09:07.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.597+0000 7fe0aff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:07.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.597+0000 7fe0aff46800 20 rados->read ofs=0 len=0 2024-09-14T11:09:07.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.597+0000 7fe0aff46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:07.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.597+0000 7fe0aff46800 20 rados->read ofs=0 len=0 2024-09-14T11:09:07.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.598+0000 7fe0aff46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:07.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.598+0000 7fe0aff46800 20 zone default found 2024-09-14T11:09:07.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.598+0000 7fe0aff46800 4 Realm: () 2024-09-14T11:09:07.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.598+0000 7fe0aff46800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:07.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.598+0000 7fe0aff46800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:07.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.598+0000 7fe0aff46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:07.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.598+0000 7fe0aff46800 20 zonegroup default 2024-09-14T11:09:07.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.598+0000 7fe0aff46800 20 rados->read ofs=0 len=0 2024-09-14T11:09:07.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.598+0000 7fe0aff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:07.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.598+0000 7fe0aff46800 20 rados->read ofs=0 len=0 2024-09-14T11:09:07.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.598+0000 7fe0aff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:07.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.598+0000 7fe0aff46800 20 rados->read ofs=0 len=0 2024-09-14T11:09:07.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.599+0000 7fe0aff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:07.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.599+0000 7fe0aff46800 20 started sync module instance, tier type = 2024-09-14T11:09:07.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.599+0000 7fe0aff46800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:07.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.608+0000 7fe0aff46800 20 add_watcher() i=0 2024-09-14T11:09:07.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.608+0000 7fe0aff46800 20 add_watcher() i=1 2024-09-14T11:09:07.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.608+0000 7fe0aff46800 20 add_watcher() i=2 2024-09-14T11:09:07.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.608+0000 7fe0aff46800 20 add_watcher() i=3 2024-09-14T11:09:07.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.608+0000 7fe0aff46800 20 add_watcher() i=4 2024-09-14T11:09:07.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.608+0000 7fe0aff46800 20 add_watcher() i=5 2024-09-14T11:09:07.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.608+0000 7fe0aff46800 20 add_watcher() i=6 2024-09-14T11:09:07.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.609+0000 7fe0aff46800 20 add_watcher() i=7 2024-09-14T11:09:07.609 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.609+0000 7fe0aff46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:07.610 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.611+0000 7fdf5f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:07.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.612+0000 7fe0aff46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:07.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.612+0000 7fe0aff46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:07.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.612+0000 7fe0aff46800 5 note: GC not initialized 2024-09-14T11:09:07.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.612+0000 7fdf5e7fc640 20 reqs_thread_entry: start 2024-09-14T11:09:07.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.612+0000 7fe0aff46800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:07.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.612+0000 7fe0aff46800 20 Filter name: none 2024-09-14T11:09:07.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.612+0000 7fdecffff640 20 reqs_thread_entry: start 2024-09-14T11:09:07.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.612+0000 7fe0aff46800 20 rados->read ofs=0 len=0 2024-09-14T11:09:07.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.613+0000 7fe0aff46800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:09:07.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.613+0000 7fe0aff46800 20 rados->read ofs=0 len=0 2024-09-14T11:09:07.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.613+0000 7fe0aff46800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:09:07.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.613+0000 7fe0aff46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:07.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.613+0000 7fe0aff46800 20 rados->read ofs=0 len=0 2024-09-14T11:09:07.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.613+0000 7fe0aff46800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:09:07.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.613+0000 7fe0aff46800 20 rados->read ofs=0 len=0 2024-09-14T11:09:07.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.614+0000 7fe0aff46800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:09:07.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.614+0000 7fe0aff46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:07.615 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.616+0000 7fdf5f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:07.618 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.619+0000 7fe0aff46800 20 remove_watcher() i=0 2024-09-14T11:09:07.618 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.619+0000 7fe0aff46800 2 removed watcher, disabling cache 2024-09-14T11:09:07.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.620+0000 7fe0aff46800 20 remove_watcher() i=1 2024-09-14T11:09:07.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.621+0000 7fe0aff46800 20 remove_watcher() i=2 2024-09-14T11:09:07.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.622+0000 7fe0aff46800 20 remove_watcher() i=3 2024-09-14T11:09:07.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.623+0000 7fe0aff46800 20 remove_watcher() i=4 2024-09-14T11:09:07.623 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.624+0000 7fe0aff46800 20 remove_watcher() i=5 2024-09-14T11:09:07.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.625+0000 7fe0aff46800 20 remove_watcher() i=6 2024-09-14T11:09:07.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.627+0000 7fe0aff46800 20 remove_watcher() i=7 2024-09-14T11:09:07.637 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:07.637 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:09:07.637 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: a-bucket id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-14T11:09:07.638 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:07.639 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-14T11:09:07.671 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:07.671 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:07.711 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.712+0000 7f43c9739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:07.915 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.916+0000 7f43c9739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:07.915 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.916+0000 7f43c9739800 20 realm 2024-09-14T11:09:07.915 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.916+0000 7f43c9739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:07.915 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.916+0000 7f43c9739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:07.916 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.916+0000 7f43c9739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:07.916 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.916+0000 7f43c9739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:07.916 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.916+0000 7f43c9739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:07.916 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.916+0000 7f43c9739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:07.916 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.917+0000 7f43c9739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:07.916 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.917+0000 7f43c9739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:07.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.918+0000 7f43c9739800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:07.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.918+0000 7f43c9739800 20 searching for the correct realm 2024-09-14T11:09:07.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:07.921+0000 7f43bffff640 0 -- 172.21.15.50:0/3051274081 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f43c007cbe0 msgr2=0x7f43c0071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:09:08.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.127+0000 7f43c5bc8640 0 -- 172.21.15.50:0/3051274081 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x565348d50030 msgr2=0x565348d524a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:08.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.132+0000 7f43c9739800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:08.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.132+0000 7f43c9739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:08.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.132+0000 7f43c9739800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:08.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.132+0000 7f43c9739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:08.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.132+0000 7f43c9739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:08.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.132+0000 7f43c9739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:08.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.132+0000 7f43c9739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.132+0000 7f43c9739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:08.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.132+0000 7f43c9739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.132+0000 7f43c9739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:08.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.132+0000 7f43c9739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.133+0000 7f43c9739800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:08.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.133+0000 7f43c9739800 20 zone default found 2024-09-14T11:09:08.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.133+0000 7f43c9739800 4 Realm: () 2024-09-14T11:09:08.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.133+0000 7f43c9739800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:08.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.133+0000 7f43c9739800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:08.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.133+0000 7f43c9739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:08.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.133+0000 7f43c9739800 20 zonegroup default 2024-09-14T11:09:08.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.133+0000 7f43c9739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.133+0000 7f43c9739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:08.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.133+0000 7f43c9739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.133+0000 7f43c9739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:08.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.133+0000 7f43c9739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.134+0000 7f43c9739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:08.135 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.134+0000 7f43c9739800 20 started sync module instance, tier type = 2024-09-14T11:09:08.135 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.134+0000 7f43c9739800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:08.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.144+0000 7f43c9739800 20 add_watcher() i=0 2024-09-14T11:09:08.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.144+0000 7f43c9739800 20 add_watcher() i=1 2024-09-14T11:09:08.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.144+0000 7f43c9739800 20 add_watcher() i=2 2024-09-14T11:09:08.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.144+0000 7f43c9739800 20 add_watcher() i=3 2024-09-14T11:09:08.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.144+0000 7f43c9739800 20 add_watcher() i=4 2024-09-14T11:09:08.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.144+0000 7f43c9739800 20 add_watcher() i=5 2024-09-14T11:09:08.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.144+0000 7f43c9739800 20 add_watcher() i=6 2024-09-14T11:09:08.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.145+0000 7f43c9739800 20 add_watcher() i=7 2024-09-14T11:09:08.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.145+0000 7f43c9739800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:08.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.147+0000 7f427b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:08.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.147+0000 7f43c9739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:08.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.147+0000 7f43c9739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:08.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.147+0000 7f43c9739800 5 note: GC not initialized 2024-09-14T11:09:08.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.147+0000 7f427a7e4640 20 reqs_thread_entry: start 2024-09-14T11:09:08.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.148+0000 7f43c9739800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:08.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.148+0000 7f43c9739800 20 Filter name: none 2024-09-14T11:09:08.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.148+0000 7f41ebfff640 20 reqs_thread_entry: start 2024-09-14T11:09:08.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.148+0000 7f43c9739800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:09:08.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.148+0000 7f43c9739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.148 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.148+0000 7f43c9739800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:09:08.148 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.148+0000 7f43c9739800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:09:08.148 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.148+0000 7f43c9739800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:09:08.148 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.148+0000 7f43c9739800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : miss 2024-09-14T11:09:08.148 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.148+0000 7f43c9739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.149 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.149+0000 7f43c9739800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:09:08.149 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.149+0000 7f43c9739800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:09:08.149 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.149+0000 7f43c9739800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:09:08.149 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.149+0000 7f43c9739800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:09:08.149 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.149+0000 7f43c9739800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:09:08.149 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.149+0000 7f43c9739800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:09:08.150 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.151+0000 7f427b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:08.152 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.153+0000 7f43c9739800 20 remove_watcher() i=0 2024-09-14T11:09:08.152 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.153+0000 7f43c9739800 2 removed watcher, disabling cache 2024-09-14T11:09:08.153 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.154+0000 7f43c9739800 20 remove_watcher() i=1 2024-09-14T11:09:08.154 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.155+0000 7f43c9739800 20 remove_watcher() i=2 2024-09-14T11:09:08.156 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.156+0000 7f43c9739800 20 remove_watcher() i=3 2024-09-14T11:09:08.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.158+0000 7f43c9739800 20 remove_watcher() i=4 2024-09-14T11:09:08.158 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.159+0000 7f43c9739800 20 remove_watcher() i=5 2024-09-14T11:09:08.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.160+0000 7f43c9739800 20 remove_watcher() i=6 2024-09-14T11:09:08.160 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.161+0000 7f43c9739800 20 remove_watcher() i=7 2024-09-14T11:09:08.173 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin reshard list 2024-09-14T11:09:08.200 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:08.200 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:08.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.240+0000 7fd677a0d800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.242+0000 7fd677a0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:08.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.242+0000 7fd677a0d800 20 realm 2024-09-14T11:09:08.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.242+0000 7fd677a0d800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.243+0000 7fd677a0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:08.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.243+0000 7fd677a0d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:08.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.243+0000 7fd677a0d800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.243+0000 7fd677a0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:08.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.243+0000 7fd677a0d800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.244+0000 7fd677a0d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:08.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.244+0000 7fd677a0d800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.244+0000 7fd677a0d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:08.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.244+0000 7fd677a0d800 20 searching for the correct realm 2024-09-14T11:09:08.246 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.247+0000 7fd674cf6640 0 -- 172.21.15.50:0/3173767630 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fd670018040 msgr2=0x7fd6700890b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:09:08.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.453+0000 7fd674cf6640 0 -- 172.21.15.50:0/3173767630 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x560ae04dbe70 msgr2=0x560ae04de2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:08.457 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.457+0000 7fd677a0d800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:08.457 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.457+0000 7fd677a0d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:08.457 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.457+0000 7fd677a0d800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:08.457 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.457+0000 7fd677a0d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:08.457 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.457+0000 7fd677a0d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:08.457 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.457+0000 7fd677a0d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:08.458 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.457+0000 7fd677a0d800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.458 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.458+0000 7fd677a0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:08.458 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.458+0000 7fd677a0d800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.458 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.458+0000 7fd677a0d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:08.458 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.458+0000 7fd677a0d800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.458+0000 7fd677a0d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:08.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.458+0000 7fd677a0d800 20 zone default found 2024-09-14T11:09:08.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.458+0000 7fd677a0d800 4 Realm: () 2024-09-14T11:09:08.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.458+0000 7fd677a0d800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:08.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.458+0000 7fd677a0d800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:08.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.458+0000 7fd677a0d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:08.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.458+0000 7fd677a0d800 20 zonegroup default 2024-09-14T11:09:08.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.458+0000 7fd677a0d800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.459+0000 7fd677a0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:08.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.459+0000 7fd677a0d800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.459+0000 7fd677a0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:08.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.459+0000 7fd677a0d800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.459+0000 7fd677a0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:08.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.459+0000 7fd677a0d800 20 started sync module instance, tier type = 2024-09-14T11:09:08.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.459+0000 7fd677a0d800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:08.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.469+0000 7fd677a0d800 20 add_watcher() i=0 2024-09-14T11:09:08.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.469+0000 7fd677a0d800 20 add_watcher() i=1 2024-09-14T11:09:08.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.469+0000 7fd677a0d800 20 add_watcher() i=2 2024-09-14T11:09:08.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.469+0000 7fd677a0d800 20 add_watcher() i=3 2024-09-14T11:09:08.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.469+0000 7fd677a0d800 20 add_watcher() i=4 2024-09-14T11:09:08.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.469+0000 7fd677a0d800 20 add_watcher() i=5 2024-09-14T11:09:08.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.469+0000 7fd677a0d800 20 add_watcher() i=6 2024-09-14T11:09:08.469 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.470+0000 7fd677a0d800 20 add_watcher() i=7 2024-09-14T11:09:08.469 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.470+0000 7fd677a0d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:08.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.472+0000 7fd52bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:08.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.472+0000 7fd677a0d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:08.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.472+0000 7fd677a0d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:08.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.472+0000 7fd677a0d800 5 note: GC not initialized 2024-09-14T11:09:08.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.472+0000 7fd52afe5640 20 reqs_thread_entry: start 2024-09-14T11:09:08.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.472+0000 7fd677a0d800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:08.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.472+0000 7fd677a0d800 20 Filter name: none 2024-09-14T11:09:08.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.472+0000 7fd528fe1640 20 reqs_thread_entry: start 2024-09-14T11:09:08.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.480+0000 7fd52bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:08.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.482+0000 7fd677a0d800 20 remove_watcher() i=0 2024-09-14T11:09:08.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.482+0000 7fd677a0d800 2 removed watcher, disabling cache 2024-09-14T11:09:08.482 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.483+0000 7fd677a0d800 20 remove_watcher() i=1 2024-09-14T11:09:08.483 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.484+0000 7fd677a0d800 20 remove_watcher() i=2 2024-09-14T11:09:08.484 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.485+0000 7fd677a0d800 20 remove_watcher() i=3 2024-09-14T11:09:08.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.486+0000 7fd677a0d800 20 remove_watcher() i=4 2024-09-14T11:09:08.486 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.487+0000 7fd677a0d800 20 remove_watcher() i=5 2024-09-14T11:09:08.487 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.488+0000 7fd677a0d800 20 remove_watcher() i=6 2024-09-14T11:09:08.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.489+0000 7fd677a0d800 20 remove_watcher() i=7 2024-09-14T11:09:08.500 INFO:tasks.workunit.client.0.smithi050.stderr:bucket name a-bucket 2024-09-14T11:09:08.500 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard process 2024-09-14T11:09:08.500 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:08.501 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin reshard process 2024-09-14T11:09:08.528 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:08.528 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:08.568 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.569+0000 7fdab4739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.570+0000 7fdab4739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:08.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.570+0000 7fdab4739800 20 realm 2024-09-14T11:09:08.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.570+0000 7fdab4739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.570+0000 7fdab4739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:08.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.570+0000 7fdab4739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:08.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.570+0000 7fdab4739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.570+0000 7fdab4739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:08.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.570+0000 7fdab4739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.571+0000 7fdab4739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:08.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.571+0000 7fdab4739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.572+0000 7fdab4739800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:08.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.572+0000 7fdab4739800 20 searching for the correct realm 2024-09-14T11:09:08.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.575+0000 7fdaafbc6640 0 -- 172.21.15.50:0/154062961 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fdaa8062a50 msgr2=0x7fdaa807ba40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:08.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.781+0000 7fdab0bc8640 0 -- 172.21.15.50:0/154062961 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55f54e125530 msgr2=0x55f54e1279c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:08.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.786+0000 7fdab4739800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:08.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.786+0000 7fdab4739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:08.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.786+0000 7fdab4739800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:08.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.786+0000 7fdab4739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:08.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.786+0000 7fdab4739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:08.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.786+0000 7fdab4739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:08.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.786+0000 7fdab4739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.786+0000 7fdab4739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:08.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.786+0000 7fdab4739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.786+0000 7fdab4739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:08.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.787+0000 7fdab4739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.787+0000 7fdab4739800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:08.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.787+0000 7fdab4739800 20 zone default found 2024-09-14T11:09:08.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.787+0000 7fdab4739800 4 Realm: () 2024-09-14T11:09:08.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.787+0000 7fdab4739800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:08.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.787+0000 7fdab4739800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:08.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.787+0000 7fdab4739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:08.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.787+0000 7fdab4739800 20 zonegroup default 2024-09-14T11:09:08.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.787+0000 7fdab4739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.787+0000 7fdab4739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:08.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.787+0000 7fdab4739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.788+0000 7fdab4739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:08.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.788+0000 7fdab4739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.788+0000 7fdab4739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:08.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.788+0000 7fdab4739800 20 started sync module instance, tier type = 2024-09-14T11:09:08.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.788+0000 7fdab4739800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:08.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.798+0000 7fdab4739800 20 add_watcher() i=0 2024-09-14T11:09:08.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.798+0000 7fdab4739800 20 add_watcher() i=1 2024-09-14T11:09:08.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.798+0000 7fdab4739800 20 add_watcher() i=2 2024-09-14T11:09:08.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.798+0000 7fdab4739800 20 add_watcher() i=3 2024-09-14T11:09:08.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.798+0000 7fdab4739800 20 add_watcher() i=4 2024-09-14T11:09:08.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.798+0000 7fdab4739800 20 add_watcher() i=5 2024-09-14T11:09:08.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.798+0000 7fdab4739800 20 add_watcher() i=6 2024-09-14T11:09:08.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.799+0000 7fdab4739800 20 add_watcher() i=7 2024-09-14T11:09:08.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.799+0000 7fdab4739800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:08.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.801+0000 7fd966fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:08.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.801+0000 7fdab4739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:08.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.801+0000 7fdab4739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:08.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.801+0000 7fdab4739800 5 note: GC not initialized 2024-09-14T11:09:08.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.801+0000 7fd965fdb640 20 reqs_thread_entry: start 2024-09-14T11:09:08.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.802+0000 7fdab4739800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:08.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.802+0000 7fdab4739800 20 Filter name: none 2024-09-14T11:09:08.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.802+0000 7fd8d77fe640 20 reqs_thread_entry: start 2024-09-14T11:09:08.802 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.802+0000 7fdab4739800 20 processing logshard = reshard.0000000000 2024-09-14T11:09:08.803 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.804+0000 7fdab4739800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:09:08.803 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.804+0000 7fdab4739800 20 processing logshard = reshard.0000000001 2024-09-14T11:09:08.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.807+0000 7fdab4739800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:09:08.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.807+0000 7fdab4739800 20 processing logshard = reshard.0000000002 2024-09-14T11:09:08.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.809+0000 7fdab4739800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:09:08.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.809+0000 7fdab4739800 20 processing logshard = reshard.0000000003 2024-09-14T11:09:08.811 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.812+0000 7fdab4739800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:09:08.811 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.812+0000 7fdab4739800 20 processing logshard = reshard.0000000004 2024-09-14T11:09:08.814 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.815+0000 7fdab4739800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:09:08.814 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.815+0000 7fdab4739800 20 processing logshard = reshard.0000000005 2024-09-14T11:09:08.816 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.817+0000 7fdab4739800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:09:08.816 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.817+0000 7fdab4739800 20 processing logshard = reshard.0000000006 2024-09-14T11:09:08.818 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.819+0000 7fdab4739800 20 process_entry resharding a-bucket 2024-09-14T11:09:08.818 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.819+0000 7fdab4739800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:09:08.818 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.819+0000 7fdab4739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.818 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.819+0000 7fdab4739800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:09:08.818 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.819+0000 7fdab4739800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:09:08.818 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.819+0000 7fdab4739800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:09:08.819 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.819+0000 7fdab4739800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : miss 2024-09-14T11:09:08.819 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.819+0000 7fdab4739800 20 rados->read ofs=0 len=0 2024-09-14T11:09:08.819 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.819+0000 7fdab4739800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:09:08.819 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.819+0000 7fdab4739800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:09:08.819 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.819+0000 7fdab4739800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:09:08.819 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.819+0000 7fdab4739800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:09:08.820 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.819+0000 7fdab4739800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:09:08.820 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.819+0000 7fdab4739800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:09:08.825 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.826+0000 7fdab4739800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:09:08.826 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.826+0000 7fdab4739800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:09:08.826 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.826+0000 7fdab4739800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:09:08.826 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.826+0000 7fdab4739800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18, ofs0, ns] 2024-09-14T11:09:08.826 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.826+0000 7fd9877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497049 cookie 94512065177536 notifier 6123 bl.length()=911 2024-09-14T11:09:08.826 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.826+0000 7fd9877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:09:08.826 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.826+0000 7fd9877fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:09:08.826 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.826+0000 7fd9877fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:09:08.827 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.828+0000 7fdab4739800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_sources= new_sources= 2024-09-14T11:09:08.827 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.828+0000 7fdab4739800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential sources added=[] removed=[] 2024-09-14T11:09:08.827 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.828+0000 7fdab4739800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_dests= new_dests= 2024-09-14T11:09:08.827 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.828+0000 7fdab4739800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential dests added=[] removed=[] 2024-09-14T11:09:08.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.0 2024-09-14T11:09:08.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.0 2024-09-14T11:09:08.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.1 2024-09-14T11:09:08.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.1 2024-09-14T11:09:08.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.2 2024-09-14T11:09:08.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.2 2024-09-14T11:09:08.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.3 2024-09-14T11:09:08.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.3 2024-09-14T11:09:08.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.4 2024-09-14T11:09:08.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.4 2024-09-14T11:09:08.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.5 2024-09-14T11:09:08.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.5 2024-09-14T11:09:08.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.6 2024-09-14T11:09:08.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.6 2024-09-14T11:09:08.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.7 2024-09-14T11:09:08.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.7 2024-09-14T11:09:08.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.8 2024-09-14T11:09:08.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.8 2024-09-14T11:09:08.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.9 2024-09-14T11:09:08.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.9 2024-09-14T11:09:08.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.10 2024-09-14T11:09:08.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.10 2024-09-14T11:09:08.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.11 2024-09-14T11:09:08.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.11 2024-09-14T11:09:08.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.833+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.0 2024-09-14T11:09:08.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.834+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1 2024-09-14T11:09:08.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.834+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2 2024-09-14T11:09:08.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.835+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3 2024-09-14T11:09:08.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.835+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.4 2024-09-14T11:09:08.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.835+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.5 2024-09-14T11:09:08.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.836+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.6 2024-09-14T11:09:08.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.836+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.7 2024-09-14T11:09:08.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.837+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.8 2024-09-14T11:09:08.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.837+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.9 2024-09-14T11:09:08.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.837+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.10 2024-09-14T11:09:08.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.838+0000 7fdab4739800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:09:08.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.838+0000 7fdab4739800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:09:08.839 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.839+0000 7fdab4739800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:09:08.839 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.839+0000 7fdab4739800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:09:08.839 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.839+0000 7fdab4739800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:09:08.839 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.839+0000 7fdab4739800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18, ofs0, ns] 2024-09-14T11:09:08.839 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.839+0000 7fd9877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497050 cookie 94512065177536 notifier 6123 bl.length()=911 2024-09-14T11:09:08.839 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.839+0000 7fd9877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:09:08.839 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.839+0000 7fd9877fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:09:08.839 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.839+0000 7fd9877fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:09:08.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.841+0000 7fdab4739800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_sources= new_sources= 2024-09-14T11:09:08.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.841+0000 7fdab4739800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential sources added=[] removed=[] 2024-09-14T11:09:08.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.841+0000 7fdab4739800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_dests= new_dests= 2024-09-14T11:09:08.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.841+0000 7fdab4739800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential dests added=[] removed=[] 2024-09-14T11:09:08.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.844+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.0 2024-09-14T11:09:08.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.844+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1 2024-09-14T11:09:08.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.844+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2 2024-09-14T11:09:08.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.845+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3 2024-09-14T11:09:08.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.845+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.4 2024-09-14T11:09:08.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.845+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.5 2024-09-14T11:09:08.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.845+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.6 2024-09-14T11:09:08.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.846+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.7 2024-09-14T11:09:08.847 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.846+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.8 2024-09-14T11:09:08.847 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.846+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.9 2024-09-14T11:09:08.847 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.846+0000 7fdab4739800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.10 2024-09-14T11:09:08.847 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.847+0000 7fdab4739800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:09:08.847 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.847+0000 7fdab4739800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:09:08.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.848+0000 7fdab4739800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:09:08.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.848+0000 7fdab4739800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:09:08.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.848+0000 7fdab4739800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:09:08.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.848+0000 7fdab4739800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18, ofs0, ns] 2024-09-14T11:09:08.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.848+0000 7fd986ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497051 cookie 94512065177536 notifier 6123 bl.length()=879 2024-09-14T11:09:08.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.848+0000 7fd986ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:09:08.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.848+0000 7fd986ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:09:08.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.848+0000 7fd986ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:09:08.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.850+0000 7fdab4739800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_sources= new_sources= 2024-09-14T11:09:08.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.850+0000 7fdab4739800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential sources added=[] removed=[] 2024-09-14T11:09:08.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.850+0000 7fdab4739800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_dests= new_dests= 2024-09-14T11:09:08.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.850+0000 7fdab4739800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential dests added=[] removed=[] 2024-09-14T11:09:08.852 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.853+0000 7fdab4739800 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-14T11:09:08.853 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.854+0000 7fdab4739800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:09:08.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.856+0000 7fdab4739800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:09:08.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.856+0000 7fdab4739800 20 processing logshard = reshard.0000000007 2024-09-14T11:09:08.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.858+0000 7fdab4739800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:09:08.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.858+0000 7fdab4739800 20 processing logshard = reshard.0000000008 2024-09-14T11:09:08.859 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.860+0000 7fdab4739800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:09:08.859 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.860+0000 7fdab4739800 20 processing logshard = reshard.0000000009 2024-09-14T11:09:08.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.862+0000 7fdab4739800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:09:08.862 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.862+0000 7fdab4739800 20 processing logshard = reshard.0000000010 2024-09-14T11:09:08.864 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.865+0000 7fdab4739800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:09:08.864 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.865+0000 7fdab4739800 20 processing logshard = reshard.0000000011 2024-09-14T11:09:08.866 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.867+0000 7fdab4739800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:09:08.866 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.867+0000 7fdab4739800 20 processing logshard = reshard.0000000012 2024-09-14T11:09:08.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.870+0000 7fdab4739800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:09:08.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.870+0000 7fdab4739800 20 processing logshard = reshard.0000000013 2024-09-14T11:09:08.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.873+0000 7fdab4739800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:09:08.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.873+0000 7fdab4739800 20 processing logshard = reshard.0000000014 2024-09-14T11:09:08.874 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.875+0000 7fdab4739800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:09:08.874 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.875+0000 7fdab4739800 20 processing logshard = reshard.0000000015 2024-09-14T11:09:08.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.878+0000 7fdab4739800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:09:08.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.878+0000 7fd966fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:08.879 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.881+0000 7fdab4739800 20 remove_watcher() i=0 2024-09-14T11:09:08.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.881+0000 7fdab4739800 2 removed watcher, disabling cache 2024-09-14T11:09:08.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.882+0000 7fdab4739800 20 remove_watcher() i=1 2024-09-14T11:09:08.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.883+0000 7fdab4739800 20 remove_watcher() i=2 2024-09-14T11:09:08.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.884+0000 7fdab4739800 20 remove_watcher() i=3 2024-09-14T11:09:08.884 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.885+0000 7fdab4739800 20 remove_watcher() i=4 2024-09-14T11:09:08.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.886+0000 7fdab4739800 20 remove_watcher() i=5 2024-09-14T11:09:08.886 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.887+0000 7fdab4739800 20 remove_watcher() i=6 2024-09-14T11:09:08.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:08.888+0000 7fdab4739800 20 remove_watcher() i=7 2024-09-14T11:09:13.905 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:09:13.939 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:13.939 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:13.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:13.985+0000 7f40fb328800 20 rados->read ofs=0 len=0 2024-09-14T11:09:13.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:13.987+0000 7f40fb328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:13.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:13.987+0000 7f40fb328800 20 realm 2024-09-14T11:09:13.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:13.987+0000 7f40fb328800 20 rados->read ofs=0 len=0 2024-09-14T11:09:13.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:13.988+0000 7f40fb328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:13.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:13.988+0000 7f40fb328800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:13.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:13.988+0000 7f40fb328800 20 rados->read ofs=0 len=0 2024-09-14T11:09:13.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:13.988+0000 7f40fb328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:13.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:13.988+0000 7f40fb328800 20 rados->read ofs=0 len=0 2024-09-14T11:09:13.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:13.989+0000 7f40fb328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:13.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:13.989+0000 7f40fb328800 20 rados->read ofs=0 len=0 2024-09-14T11:09:13.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:13.989+0000 7f40fb328800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:13.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:13.989+0000 7f40fb328800 20 searching for the correct realm 2024-09-14T11:09:13.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:13.993+0000 7f40f686e640 0 -- 172.21.15.50:0/2669002885 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f40f00681c0 msgr2=0x7f40f006a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:14.198 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.199+0000 7f40f7870640 0 -- 172.21.15.50:0/2669002885 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x560fc13c8420 msgr2=0x560fc13ca890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:14.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.204+0000 7f40fb328800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:14.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.204+0000 7f40fb328800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:14.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.204+0000 7f40fb328800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:14.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.204+0000 7f40fb328800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:14.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.204+0000 7f40fb328800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:14.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.204+0000 7f40fb328800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:14.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.204+0000 7f40fb328800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.204+0000 7f40fb328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:14.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.204+0000 7f40fb328800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.205+0000 7f40fb328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:14.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.205+0000 7f40fb328800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.205+0000 7f40fb328800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:14.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.205+0000 7f40fb328800 20 zone default found 2024-09-14T11:09:14.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.205+0000 7f40fb328800 4 Realm: () 2024-09-14T11:09:14.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.205+0000 7f40fb328800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:14.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.205+0000 7f40fb328800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:14.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.205+0000 7f40fb328800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:14.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.205+0000 7f40fb328800 20 zonegroup default 2024-09-14T11:09:14.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.205+0000 7f40fb328800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.206+0000 7f40fb328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:14.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.206+0000 7f40fb328800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.206+0000 7f40fb328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:14.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.206+0000 7f40fb328800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.206+0000 7f40fb328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:14.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.206+0000 7f40fb328800 20 started sync module instance, tier type = 2024-09-14T11:09:14.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.206+0000 7f40fb328800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:14.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.216+0000 7f40fb328800 20 add_watcher() i=0 2024-09-14T11:09:14.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.216+0000 7f40fb328800 20 add_watcher() i=1 2024-09-14T11:09:14.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.216+0000 7f40fb328800 20 add_watcher() i=2 2024-09-14T11:09:14.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.216+0000 7f40fb328800 20 add_watcher() i=3 2024-09-14T11:09:14.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.216+0000 7f40fb328800 20 add_watcher() i=4 2024-09-14T11:09:14.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.216+0000 7f40fb328800 20 add_watcher() i=5 2024-09-14T11:09:14.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.216+0000 7f40fb328800 20 add_watcher() i=6 2024-09-14T11:09:14.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.218+0000 7f40fb328800 20 add_watcher() i=7 2024-09-14T11:09:14.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.218+0000 7f40fb328800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:14.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.219+0000 7f3fadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:14.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.220+0000 7f40fb328800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:14.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.220+0000 7f40fb328800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:14.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.220+0000 7f40fb328800 5 note: GC not initialized 2024-09-14T11:09:14.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.220+0000 7f3facfe1640 20 reqs_thread_entry: start 2024-09-14T11:09:14.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.220+0000 7f40fb328800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:14.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.220+0000 7f40fb328800 20 Filter name: none 2024-09-14T11:09:14.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.220+0000 7f3f267fc640 20 reqs_thread_entry: start 2024-09-14T11:09:14.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.220+0000 7f40fb328800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.221+0000 7f40fb328800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:09:14.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.221+0000 7f40fb328800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.221+0000 7f40fb328800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:09:14.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.221+0000 7f40fb328800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:14.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.221+0000 7f40fb328800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.221+0000 7f40fb328800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:09:14.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.221+0000 7f40fb328800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.222+0000 7f40fb328800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:09:14.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.222+0000 7f40fb328800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:14.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.224+0000 7f3fadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:14.224 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.226+0000 7f40fb328800 20 remove_watcher() i=0 2024-09-14T11:09:14.224 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.226+0000 7f40fb328800 2 removed watcher, disabling cache 2024-09-14T11:09:14.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.227+0000 7f40fb328800 20 remove_watcher() i=1 2024-09-14T11:09:14.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.228+0000 7f40fb328800 20 remove_watcher() i=2 2024-09-14T11:09:14.227 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.229+0000 7f40fb328800 20 remove_watcher() i=3 2024-09-14T11:09:14.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.230+0000 7f40fb328800 20 remove_watcher() i=4 2024-09-14T11:09:14.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.231+0000 7f40fb328800 20 remove_watcher() i=5 2024-09-14T11:09:14.231 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.233+0000 7f40fb328800 20 remove_watcher() i=6 2024-09-14T11:09:14.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.234+0000 7f40fb328800 20 remove_watcher() i=7 2024-09-14T11:09:14.244 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:14.245 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:09:14.245 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: a-bucket id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:09:14.245 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:14.245 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard add non empty bucket 2024-09-14T11:09:14.245 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:14.249 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:14.249 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:14.292 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:14.292 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:14.330 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:14.330 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:14.367 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:14.367 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:14.406 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:14.406 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:14.442 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:14.442 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:14.478 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:14.478 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:14.517 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:14.517 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:14.554 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:09:14.583 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:14.583 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:14.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.624+0000 7f92a373c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.626+0000 7f92a373c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:14.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.626+0000 7f92a373c800 20 realm 2024-09-14T11:09:14.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.626+0000 7f92a373c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.626+0000 7f92a373c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:14.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.626+0000 7f92a373c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:14.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.626+0000 7f92a373c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.627+0000 7f92a373c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:14.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.627+0000 7f92a373c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.627+0000 7f92a373c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:14.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.627+0000 7f92a373c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.628+0000 7f92a373c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:14.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.628+0000 7f92a373c800 20 searching for the correct realm 2024-09-14T11:09:14.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.631+0000 7f929ec80640 0 -- 172.21.15.50:0/81893965 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f9298070420 msgr2=0x7f929806fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:14.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.837+0000 7f929fc82640 0 -- 172.21.15.50:0/81893965 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x555f3440b100 msgr2=0x555f3440d5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:14.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.841+0000 7f92a373c800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:14.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.841+0000 7f92a373c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:14.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.841+0000 7f92a373c800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:14.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.841+0000 7f92a373c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:14.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.841+0000 7f92a373c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:14.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.841+0000 7f92a373c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:14.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.841+0000 7f92a373c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.842+0000 7f92a373c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:14.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.842+0000 7f92a373c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.842+0000 7f92a373c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:14.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.842+0000 7f92a373c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.842+0000 7f92a373c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:14.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.842+0000 7f92a373c800 20 zone default found 2024-09-14T11:09:14.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.842+0000 7f92a373c800 4 Realm: () 2024-09-14T11:09:14.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.842+0000 7f92a373c800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:14.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.842+0000 7f92a373c800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:14.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.842+0000 7f92a373c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:14.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.842+0000 7f92a373c800 20 zonegroup default 2024-09-14T11:09:14.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.842+0000 7f92a373c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.843+0000 7f92a373c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:14.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.843+0000 7f92a373c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.843+0000 7f92a373c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:14.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.843+0000 7f92a373c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.843+0000 7f92a373c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:14.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.843+0000 7f92a373c800 20 started sync module instance, tier type = 2024-09-14T11:09:14.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.843+0000 7f92a373c800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:14.851 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.853+0000 7f92a373c800 20 add_watcher() i=0 2024-09-14T11:09:14.851 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.853+0000 7f92a373c800 20 add_watcher() i=1 2024-09-14T11:09:14.851 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.853+0000 7f92a373c800 20 add_watcher() i=2 2024-09-14T11:09:14.851 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.853+0000 7f92a373c800 20 add_watcher() i=3 2024-09-14T11:09:14.851 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.853+0000 7f92a373c800 20 add_watcher() i=4 2024-09-14T11:09:14.851 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.853+0000 7f92a373c800 20 add_watcher() i=5 2024-09-14T11:09:14.851 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.853+0000 7f92a373c800 20 add_watcher() i=6 2024-09-14T11:09:14.852 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.854+0000 7f92a373c800 20 add_watcher() i=7 2024-09-14T11:09:14.852 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.854+0000 7f92a373c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:14.854 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.856+0000 7f9155fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:14.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.856+0000 7f92a373c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:14.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.856+0000 7f92a373c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:14.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.856+0000 7f92a373c800 5 note: GC not initialized 2024-09-14T11:09:14.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.856+0000 7f9154fe1640 20 reqs_thread_entry: start 2024-09-14T11:09:14.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.856+0000 7f92a373c800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:14.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.857+0000 7f92a373c800 20 Filter name: none 2024-09-14T11:09:14.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.857+0000 7f90ce7fc640 20 reqs_thread_entry: start 2024-09-14T11:09:14.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.857+0000 7f92a373c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.856 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.857+0000 7f92a373c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:09:14.856 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.857+0000 7f92a373c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.858+0000 7f92a373c800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:09:14.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.858+0000 7f92a373c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:14.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.858+0000 7f92a373c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.858+0000 7f92a373c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:09:14.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.858+0000 7f92a373c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.858+0000 7f92a373c800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:09:14.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.858+0000 7f92a373c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:14.858 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.860+0000 7f9155fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:14.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.863+0000 7f92a373c800 20 remove_watcher() i=0 2024-09-14T11:09:14.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.863+0000 7f92a373c800 2 removed watcher, disabling cache 2024-09-14T11:09:14.862 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.864+0000 7f92a373c800 20 remove_watcher() i=1 2024-09-14T11:09:14.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.865+0000 7f92a373c800 20 remove_watcher() i=2 2024-09-14T11:09:14.864 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.866+0000 7f92a373c800 20 remove_watcher() i=3 2024-09-14T11:09:14.865 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.867+0000 7f92a373c800 20 remove_watcher() i=4 2024-09-14T11:09:14.866 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.868+0000 7f92a373c800 20 remove_watcher() i=5 2024-09-14T11:09:14.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.869+0000 7f92a373c800 20 remove_watcher() i=6 2024-09-14T11:09:14.868 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.870+0000 7f92a373c800 20 remove_watcher() i=7 2024-09-14T11:09:14.880 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:14.880 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:09:14.880 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: a-bucket id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-14T11:09:14.880 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:14.881 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-14T11:09:14.913 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:14.913 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:14.952 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.953+0000 7f8fbe9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.953 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.955+0000 7f8fbe9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:14.953 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.955+0000 7f8fbe9af800 20 realm 2024-09-14T11:09:14.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.955+0000 7f8fbe9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.955+0000 7f8fbe9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:14.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.955+0000 7f8fbe9af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:14.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.955+0000 7f8fbe9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.955+0000 7f8fbe9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:14.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.955+0000 7f8fbe9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.956+0000 7f8fbe9af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:14.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.956+0000 7f8fbe9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:14.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.957+0000 7f8fbe9af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:14.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.957+0000 7f8fbe9af800 20 searching for the correct realm 2024-09-14T11:09:14.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:14.960+0000 7f8fbbc9f640 0 -- 172.21.15.50:0/943289257 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f8fb4034400 msgr2=0x7f8fb4034840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:15.164 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.166+0000 7f8fbcca1640 0 -- 172.21.15.50:0/943289257 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5642e88f2a90 msgr2=0x5642e88f4f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:15.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.171+0000 7f8fbe9af800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:15.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.171+0000 7f8fbe9af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:15.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.171+0000 7f8fbe9af800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:15.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.171+0000 7f8fbe9af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:15.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.171+0000 7f8fbe9af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:15.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.171+0000 7f8fbe9af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:15.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.171+0000 7f8fbe9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.171+0000 7f8fbe9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.171+0000 7f8fbe9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.172+0000 7f8fbe9af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:15.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.172+0000 7f8fbe9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.171 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.172+0000 7f8fbe9af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:15.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.172+0000 7f8fbe9af800 20 zone default found 2024-09-14T11:09:15.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.172+0000 7f8fbe9af800 4 Realm: () 2024-09-14T11:09:15.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.172+0000 7f8fbe9af800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:15.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.172+0000 7f8fbe9af800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:15.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.172+0000 7f8fbe9af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:15.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.172+0000 7f8fbe9af800 20 zonegroup default 2024-09-14T11:09:15.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.172+0000 7f8fbe9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.172+0000 7f8fbe9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.172+0000 7f8fbe9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.173+0000 7f8fbe9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.173+0000 7f8fbe9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.173+0000 7f8fbe9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.173 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.173+0000 7f8fbe9af800 20 started sync module instance, tier type = 2024-09-14T11:09:15.173 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.173+0000 7f8fbe9af800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:15.181 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.183+0000 7f8fbe9af800 20 add_watcher() i=0 2024-09-14T11:09:15.181 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.183+0000 7f8fbe9af800 20 add_watcher() i=1 2024-09-14T11:09:15.181 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.183+0000 7f8fbe9af800 20 add_watcher() i=2 2024-09-14T11:09:15.181 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.183+0000 7f8fbe9af800 20 add_watcher() i=3 2024-09-14T11:09:15.181 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.183+0000 7f8fbe9af800 20 add_watcher() i=4 2024-09-14T11:09:15.181 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.183+0000 7f8fbe9af800 20 add_watcher() i=5 2024-09-14T11:09:15.181 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.183+0000 7f8fbe9af800 20 add_watcher() i=6 2024-09-14T11:09:15.182 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.184+0000 7f8fbe9af800 20 add_watcher() i=7 2024-09-14T11:09:15.182 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.184+0000 7f8fbe9af800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:15.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.186+0000 7f8e72fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:15.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.186+0000 7f8fbe9af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:15.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.186+0000 7f8fbe9af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:15.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.186+0000 7f8fbe9af800 5 note: GC not initialized 2024-09-14T11:09:15.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.186+0000 7f8e71fdb640 20 reqs_thread_entry: start 2024-09-14T11:09:15.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.186+0000 7f8fbe9af800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:15.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.186+0000 7f8fbe9af800 20 Filter name: none 2024-09-14T11:09:15.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.187+0000 7f8de37fe640 20 reqs_thread_entry: start 2024-09-14T11:09:15.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.187+0000 7f8fbe9af800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:09:15.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.187+0000 7f8fbe9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.187+0000 7f8fbe9af800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:09:15.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.187+0000 7f8fbe9af800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:09:15.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.187+0000 7f8fbe9af800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:09:15.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.187+0000 7f8fbe9af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : miss 2024-09-14T11:09:15.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.187+0000 7f8fbe9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.187+0000 7f8fbe9af800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:09:15.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.187+0000 7f8fbe9af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:09:15.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.187+0000 7f8fbe9af800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:09:15.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.187+0000 7f8fbe9af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:09:15.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.187+0000 7f8fbe9af800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:09:15.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.187+0000 7f8fbe9af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:09:15.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.190+0000 7f8e72fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:15.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.192+0000 7f8fbe9af800 20 remove_watcher() i=0 2024-09-14T11:09:15.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.192+0000 7f8fbe9af800 2 removed watcher, disabling cache 2024-09-14T11:09:15.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.193+0000 7f8fbe9af800 20 remove_watcher() i=1 2024-09-14T11:09:15.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.194+0000 7f8fbe9af800 20 remove_watcher() i=2 2024-09-14T11:09:15.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.195+0000 7f8fbe9af800 20 remove_watcher() i=3 2024-09-14T11:09:15.194 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.196+0000 7f8fbe9af800 20 remove_watcher() i=4 2024-09-14T11:09:15.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.197+0000 7f8fbe9af800 20 remove_watcher() i=5 2024-09-14T11:09:15.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.198+0000 7f8fbe9af800 20 remove_watcher() i=6 2024-09-14T11:09:15.197 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.199+0000 7f8fbe9af800 20 remove_watcher() i=7 2024-09-14T11:09:15.211 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin reshard list 2024-09-14T11:09:15.238 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:15.238 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:15.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.279+0000 7fa01fd1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.279 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.281+0000 7fa01fd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.279 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.281+0000 7fa01fd1f800 20 realm 2024-09-14T11:09:15.279 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.281+0000 7fa01fd1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.279 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.281+0000 7fa01fd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.279 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.281+0000 7fa01fd1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:15.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.281+0000 7fa01fd1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.281+0000 7fa01fd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.281+0000 7fa01fd1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.282+0000 7fa01fd1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:15.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.282+0000 7fa01fd1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.282+0000 7fa01fd1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:15.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.282+0000 7fa01fd1f800 20 searching for the correct realm 2024-09-14T11:09:15.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.286+0000 7fa01b18a640 0 -- 172.21.15.50:0/3148209933 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fa014018910 msgr2=0x7fa014025400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:15.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.290+0000 7fa01c18c640 0 -- 172.21.15.50:0/3148209933 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x564f70a58d00 msgr2=0x564f70a5b140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:15.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.294+0000 7fa01fd1f800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:15.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.294+0000 7fa01fd1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:15.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.294+0000 7fa01fd1f800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:15.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.294+0000 7fa01fd1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:15.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.294+0000 7fa01fd1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:15.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.294+0000 7fa01fd1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:15.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.294+0000 7fa01fd1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.294+0000 7fa01fd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.294+0000 7fa01fd1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.294+0000 7fa01fd1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:15.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.294+0000 7fa01fd1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.294+0000 7fa01fd1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:15.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.294+0000 7fa01fd1f800 20 zone default found 2024-09-14T11:09:15.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.294+0000 7fa01fd1f800 4 Realm: () 2024-09-14T11:09:15.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.294+0000 7fa01fd1f800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:15.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.294+0000 7fa01fd1f800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:15.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.294+0000 7fa01fd1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:15.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.294+0000 7fa01fd1f800 20 zonegroup default 2024-09-14T11:09:15.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.294+0000 7fa01fd1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.295+0000 7fa01fd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.295+0000 7fa01fd1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.295+0000 7fa01fd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.295+0000 7fa01fd1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.295+0000 7fa01fd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.295+0000 7fa01fd1f800 20 started sync module instance, tier type = 2024-09-14T11:09:15.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.295+0000 7fa01fd1f800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:15.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.304+0000 7fa01fd1f800 20 add_watcher() i=0 2024-09-14T11:09:15.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.304+0000 7fa01fd1f800 20 add_watcher() i=1 2024-09-14T11:09:15.303 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.304+0000 7fa01fd1f800 20 add_watcher() i=2 2024-09-14T11:09:15.303 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.304+0000 7fa01fd1f800 20 add_watcher() i=3 2024-09-14T11:09:15.303 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.304+0000 7fa01fd1f800 20 add_watcher() i=4 2024-09-14T11:09:15.303 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.304+0000 7fa01fd1f800 20 add_watcher() i=5 2024-09-14T11:09:15.303 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.304+0000 7fa01fd1f800 20 add_watcher() i=6 2024-09-14T11:09:15.303 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.305+0000 7fa01fd1f800 20 add_watcher() i=7 2024-09-14T11:09:15.304 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.305+0000 7fa01fd1f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:15.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.307+0000 7f9ed1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:15.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.308+0000 7fa01fd1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:15.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.308+0000 7fa01fd1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:15.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.308+0000 7fa01fd1f800 5 note: GC not initialized 2024-09-14T11:09:15.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.308+0000 7f9ed0fe1640 20 reqs_thread_entry: start 2024-09-14T11:09:15.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.308+0000 7fa01fd1f800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:15.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.308+0000 7fa01fd1f800 20 Filter name: none 2024-09-14T11:09:15.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.308+0000 7f9e4a7fc640 20 reqs_thread_entry: start 2024-09-14T11:09:15.312 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.314+0000 7f9ed1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:15.315 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.317+0000 7fa01fd1f800 20 remove_watcher() i=0 2024-09-14T11:09:15.315 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.317+0000 7fa01fd1f800 2 removed watcher, disabling cache 2024-09-14T11:09:15.316 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.318+0000 7fa01fd1f800 20 remove_watcher() i=1 2024-09-14T11:09:15.317 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.319+0000 7fa01fd1f800 20 remove_watcher() i=2 2024-09-14T11:09:15.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.320+0000 7fa01fd1f800 20 remove_watcher() i=3 2024-09-14T11:09:15.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.321+0000 7fa01fd1f800 20 remove_watcher() i=4 2024-09-14T11:09:15.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.322+0000 7fa01fd1f800 20 remove_watcher() i=5 2024-09-14T11:09:15.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.323+0000 7fa01fd1f800 20 remove_watcher() i=6 2024-09-14T11:09:15.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.324+0000 7fa01fd1f800 20 remove_watcher() i=7 2024-09-14T11:09:15.334 INFO:tasks.workunit.client.0.smithi050.stderr:bucket name a-bucket 2024-09-14T11:09:15.334 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard process non empty bucket 2024-09-14T11:09:15.334 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:15.335 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin reshard process 2024-09-14T11:09:15.362 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:15.362 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:15.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.404+0000 7f53fcf25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.406+0000 7f53fcf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.406+0000 7f53fcf25800 20 realm 2024-09-14T11:09:15.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.406+0000 7f53fcf25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.406+0000 7f53fcf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.406+0000 7f53fcf25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:15.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.406+0000 7f53fcf25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.406+0000 7f53fcf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.406+0000 7f53fcf25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.407+0000 7f53fcf25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:15.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.407+0000 7f53fcf25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.407+0000 7f53fcf25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:15.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.408+0000 7f53fcf25800 20 searching for the correct realm 2024-09-14T11:09:15.408 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.410+0000 7f53f84a1640 0 -- 172.21.15.50:0/55232760 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f53f006d320 msgr2=0x7f53f006ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:15.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.615+0000 7f53f94a3640 0 -- 172.21.15.50:0/55232760 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55c0fe3da060 msgr2=0x55c0fe3dc4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:15.617 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.619+0000 7f53fcf25800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:15.617 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.619+0000 7f53fcf25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:15.617 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.619+0000 7f53fcf25800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:15.617 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.619+0000 7f53fcf25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:15.617 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.619+0000 7f53fcf25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:15.618 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.619+0000 7f53fcf25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:15.618 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.619+0000 7f53fcf25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.619+0000 7f53fcf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.619+0000 7f53fcf25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.620+0000 7f53fcf25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:15.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.620+0000 7f53fcf25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.620+0000 7f53fcf25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:15.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.620+0000 7f53fcf25800 20 zone default found 2024-09-14T11:09:15.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.620+0000 7f53fcf25800 4 Realm: () 2024-09-14T11:09:15.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.620+0000 7f53fcf25800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:15.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.620+0000 7f53fcf25800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:15.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.620+0000 7f53fcf25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:15.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.620+0000 7f53fcf25800 20 zonegroup default 2024-09-14T11:09:15.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.620+0000 7f53fcf25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.620+0000 7f53fcf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.620+0000 7f53fcf25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.621+0000 7f53fcf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.621+0000 7f53fcf25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.621+0000 7f53fcf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.621+0000 7f53fcf25800 20 started sync module instance, tier type = 2024-09-14T11:09:15.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.621+0000 7f53fcf25800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:15.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.630+0000 7f53fcf25800 20 add_watcher() i=0 2024-09-14T11:09:15.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.630+0000 7f53fcf25800 20 add_watcher() i=1 2024-09-14T11:09:15.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.630+0000 7f53fcf25800 20 add_watcher() i=2 2024-09-14T11:09:15.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.630+0000 7f53fcf25800 20 add_watcher() i=3 2024-09-14T11:09:15.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.630+0000 7f53fcf25800 20 add_watcher() i=4 2024-09-14T11:09:15.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.630+0000 7f53fcf25800 20 add_watcher() i=5 2024-09-14T11:09:15.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.630+0000 7f53fcf25800 20 add_watcher() i=6 2024-09-14T11:09:15.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.631+0000 7f53fcf25800 20 add_watcher() i=7 2024-09-14T11:09:15.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.631+0000 7f53fcf25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:15.631 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.633+0000 7f52af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:15.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.633+0000 7f53fcf25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:15.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.633+0000 7f53fcf25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:15.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.633+0000 7f53fcf25800 5 note: GC not initialized 2024-09-14T11:09:15.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.634+0000 7f52ae7e4640 20 reqs_thread_entry: start 2024-09-14T11:09:15.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.634+0000 7f53fcf25800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:15.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.634+0000 7f53fcf25800 20 Filter name: none 2024-09-14T11:09:15.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.634+0000 7f52a77fe640 20 reqs_thread_entry: start 2024-09-14T11:09:15.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.634+0000 7f53fcf25800 20 processing logshard = reshard.0000000000 2024-09-14T11:09:15.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.636+0000 7f53fcf25800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:09:15.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.636+0000 7f53fcf25800 20 processing logshard = reshard.0000000001 2024-09-14T11:09:15.637 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.639+0000 7f53fcf25800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:09:15.637 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.639+0000 7f53fcf25800 20 processing logshard = reshard.0000000002 2024-09-14T11:09:15.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.641+0000 7f53fcf25800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:09:15.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.641+0000 7f53fcf25800 20 processing logshard = reshard.0000000003 2024-09-14T11:09:15.642 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.644+0000 7f53fcf25800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:09:15.642 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.644+0000 7f53fcf25800 20 processing logshard = reshard.0000000004 2024-09-14T11:09:15.644 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.646+0000 7f53fcf25800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:09:15.644 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.646+0000 7f53fcf25800 20 processing logshard = reshard.0000000005 2024-09-14T11:09:15.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.649+0000 7f53fcf25800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:09:15.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.649+0000 7f53fcf25800 20 processing logshard = reshard.0000000006 2024-09-14T11:09:15.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.651+0000 7f53fcf25800 20 process_entry resharding a-bucket 2024-09-14T11:09:15.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.651+0000 7f53fcf25800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:09:15.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.651+0000 7f53fcf25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.651+0000 7f53fcf25800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:09:15.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.651+0000 7f53fcf25800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:09:15.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.651+0000 7f53fcf25800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:09:15.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.651+0000 7f53fcf25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : miss 2024-09-14T11:09:15.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.651+0000 7f53fcf25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.650 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.651+0000 7f53fcf25800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:09:15.650 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.651+0000 7f53fcf25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:09:15.650 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.651+0000 7f53fcf25800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:09:15.650 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.651+0000 7f53fcf25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:09:15.650 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.651+0000 7f53fcf25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:09:15.650 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.652+0000 7f53fcf25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:09:15.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.658+0000 7f53fcf25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:09:15.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.658+0000 7f53fcf25800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:09:15.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.658+0000 7f53fcf25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:09:15.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.658+0000 7f53fcf25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18, ofs0, ns] 2024-09-14T11:09:15.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.658+0000 7f52cffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497052 cookie 94287387606480 notifier 5870 bl.length()=911 2024-09-14T11:09:15.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.658+0000 7f52cffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:09:15.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.658+0000 7f52cffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:09:15.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.658+0000 7f52cffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:09:15.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.660+0000 7f53fcf25800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_sources= new_sources= 2024-09-14T11:09:15.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.660+0000 7f53fcf25800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential sources added=[] removed=[] 2024-09-14T11:09:15.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.660+0000 7f53fcf25800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_dests= new_dests= 2024-09-14T11:09:15.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.660+0000 7f53fcf25800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential dests added=[] removed=[] 2024-09-14T11:09:15.663 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:09:15.663 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:09:15.663 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:09:15.663 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:09:15.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:09:15.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:09:15.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:09:15.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:09:15.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:09:15.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:09:15.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:09:15.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:09:15.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:09:15.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:09:15.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:09:15.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:09:15.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:09:15.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:09:15.665 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:09:15.665 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:09:15.665 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:09:15.665 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:09:15.665 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:09:15.665 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:09:15.665 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:09:15.665 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:09:15.665 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.0 2024-09-14T11:09:15.665 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.0 2024-09-14T11:09:15.665 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.1 2024-09-14T11:09:15.665 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.665+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.1 2024-09-14T11:09:15.666 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.666+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.2 2024-09-14T11:09:15.666 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.666+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.2 2024-09-14T11:09:15.666 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.666+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.3 2024-09-14T11:09:15.666 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.666+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.3 2024-09-14T11:09:15.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.667+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.4 2024-09-14T11:09:15.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.667+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.4 2024-09-14T11:09:15.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.667+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.5 2024-09-14T11:09:15.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.667+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.5 2024-09-14T11:09:15.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.668+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.6 2024-09-14T11:09:15.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.668+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.6 2024-09-14T11:09:15.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.668+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.7 2024-09-14T11:09:15.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.668+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.7 2024-09-14T11:09:15.668 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.669+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.8 2024-09-14T11:09:15.668 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.669+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.8 2024-09-14T11:09:15.668 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.669+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.9 2024-09-14T11:09:15.668 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.669+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.9 2024-09-14T11:09:15.668 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.670+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.10 2024-09-14T11:09:15.668 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.670+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.10 2024-09-14T11:09:15.668 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.670+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.11 2024-09-14T11:09:15.668 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.670+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.11 2024-09-14T11:09:15.670 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.672+0000 7f53fcf25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:09:15.670 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.672+0000 7f53fcf25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:09:15.672 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.674+0000 7f53fcf25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:09:15.672 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.674+0000 7f53fcf25800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:09:15.672 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.674+0000 7f53fcf25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:09:15.672 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.674+0000 7f53fcf25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18, ofs0, ns] 2024-09-14T11:09:15.672 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.674+0000 7f52cf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497053 cookie 94287387606480 notifier 5870 bl.length()=911 2024-09-14T11:09:15.672 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.674+0000 7f52cf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:09:15.672 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.674+0000 7f52cf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:09:15.672 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.674+0000 7f52cf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:09:15.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.676+0000 7f53fcf25800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_sources= new_sources= 2024-09-14T11:09:15.674 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.676+0000 7f53fcf25800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential sources added=[] removed=[] 2024-09-14T11:09:15.674 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.676+0000 7f53fcf25800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_dests= new_dests= 2024-09-14T11:09:15.674 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.676+0000 7f53fcf25800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential dests added=[] removed=[] 2024-09-14T11:09:15.676 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.678+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.0 2024-09-14T11:09:15.676 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.678+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.0 2024-09-14T11:09:15.677 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.678+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.1 2024-09-14T11:09:15.677 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.678+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.1 2024-09-14T11:09:15.677 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.679+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.2 2024-09-14T11:09:15.677 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.679+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.2 2024-09-14T11:09:15.677 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.679+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.3 2024-09-14T11:09:15.677 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.679+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.3 2024-09-14T11:09:15.677 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.679+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.4 2024-09-14T11:09:15.678 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.679+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.4 2024-09-14T11:09:15.678 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.680+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.5 2024-09-14T11:09:15.678 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.680+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.5 2024-09-14T11:09:15.678 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.680+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.6 2024-09-14T11:09:15.678 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.680+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.6 2024-09-14T11:09:15.679 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.681+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.7 2024-09-14T11:09:15.679 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.681+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.7 2024-09-14T11:09:15.679 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.681+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.8 2024-09-14T11:09:15.679 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.681+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.8 2024-09-14T11:09:15.680 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.681+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.9 2024-09-14T11:09:15.680 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.681+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.9 2024-09-14T11:09:15.680 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.682+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.10 2024-09-14T11:09:15.680 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.682+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.10 2024-09-14T11:09:15.680 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.682+0000 7f53fcf25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.11 2024-09-14T11:09:15.681 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.682+0000 7f53fcf25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.1.11 2024-09-14T11:09:15.681 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.683+0000 7f53fcf25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:09:15.681 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.683+0000 7f53fcf25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:09:15.683 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.684+0000 7f53fcf25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:09:15.683 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.684+0000 7f53fcf25800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:09:15.683 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.684+0000 7f53fcf25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:09:15.683 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.684+0000 7f53fcf25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18, ofs0, ns] 2024-09-14T11:09:15.683 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.685+0000 7f52cffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497054 cookie 94287387606480 notifier 5870 bl.length()=879 2024-09-14T11:09:15.683 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.685+0000 7f52cffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:09:15.683 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.685+0000 7f52cffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:09:15.683 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.685+0000 7f52cffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:09:15.684 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.686+0000 7f53fcf25800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_sources= new_sources= 2024-09-14T11:09:15.684 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.686+0000 7f53fcf25800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential sources added=[] removed=[] 2024-09-14T11:09:15.684 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.686+0000 7f53fcf25800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_dests= new_dests= 2024-09-14T11:09:15.684 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.686+0000 7f53fcf25800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential dests added=[] removed=[] 2024-09-14T11:09:15.686 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.688+0000 7f53fcf25800 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-14T11:09:15.687 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.689+0000 7f53fcf25800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:09:15.689 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.692+0000 7f53fcf25800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:09:15.690 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.692+0000 7f53fcf25800 20 processing logshard = reshard.0000000007 2024-09-14T11:09:15.692 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.694+0000 7f53fcf25800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:09:15.692 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.694+0000 7f53fcf25800 20 processing logshard = reshard.0000000008 2024-09-14T11:09:15.694 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.696+0000 7f53fcf25800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:09:15.694 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.696+0000 7f53fcf25800 20 processing logshard = reshard.0000000009 2024-09-14T11:09:15.696 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.698+0000 7f53fcf25800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:09:15.696 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.698+0000 7f53fcf25800 20 processing logshard = reshard.0000000010 2024-09-14T11:09:15.699 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.701+0000 7f53fcf25800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:09:15.699 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.701+0000 7f53fcf25800 20 processing logshard = reshard.0000000011 2024-09-14T11:09:15.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.703+0000 7f53fcf25800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:09:15.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.703+0000 7f53fcf25800 20 processing logshard = reshard.0000000012 2024-09-14T11:09:15.703 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.705+0000 7f53fcf25800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:09:15.703 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.705+0000 7f53fcf25800 20 processing logshard = reshard.0000000013 2024-09-14T11:09:15.705 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.707+0000 7f53fcf25800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:09:15.706 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.707+0000 7f53fcf25800 20 processing logshard = reshard.0000000014 2024-09-14T11:09:15.708 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.710+0000 7f53fcf25800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:09:15.708 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.710+0000 7f53fcf25800 20 processing logshard = reshard.0000000015 2024-09-14T11:09:15.710 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.712+0000 7f53fcf25800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:09:15.711 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.713+0000 7f52af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:15.713 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.715+0000 7f53fcf25800 20 remove_watcher() i=0 2024-09-14T11:09:15.713 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.715+0000 7f53fcf25800 2 removed watcher, disabling cache 2024-09-14T11:09:15.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.716+0000 7f53fcf25800 20 remove_watcher() i=1 2024-09-14T11:09:15.715 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.717+0000 7f53fcf25800 20 remove_watcher() i=2 2024-09-14T11:09:15.716 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.718+0000 7f53fcf25800 20 remove_watcher() i=3 2024-09-14T11:09:15.717 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.719+0000 7f53fcf25800 20 remove_watcher() i=4 2024-09-14T11:09:15.718 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.720+0000 7f53fcf25800 20 remove_watcher() i=5 2024-09-14T11:09:15.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.721+0000 7f53fcf25800 20 remove_watcher() i=6 2024-09-14T11:09:15.720 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.722+0000 7f53fcf25800 20 remove_watcher() i=7 2024-09-14T11:09:15.735 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:09:15.764 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:15.764 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:15.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.806+0000 7f9985613800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.807+0000 7f9985613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.807+0000 7f9985613800 20 realm 2024-09-14T11:09:15.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.807+0000 7f9985613800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.807+0000 7f9985613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.807+0000 7f9985613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:15.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.807+0000 7f9985613800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.808+0000 7f9985613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.808+0000 7f9985613800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.808+0000 7f9985613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:15.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.808+0000 7f9985613800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.809+0000 7f9985613800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:15.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.809+0000 7f9985613800 20 searching for the correct realm 2024-09-14T11:09:15.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.812+0000 7f9980547640 0 -- 172.21.15.50:0/1155724990 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f9978023930 msgr2=0x7f9978008410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:15.814 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.816+0000 7f9981549640 0 -- 172.21.15.50:0/1155724990 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55c64f985fa0 msgr2=0x55c64f988420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:15.821 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.820+0000 7f9985613800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:15.821 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.820+0000 7f9985613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:15.821 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.820+0000 7f9985613800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:15.821 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.820+0000 7f9985613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:15.821 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.820+0000 7f9985613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:15.821 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.820+0000 7f9985613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:15.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.820+0000 7f9985613800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.820+0000 7f9985613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.820+0000 7f9985613800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.820+0000 7f9985613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:15.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.820+0000 7f9985613800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.821+0000 7f9985613800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:15.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.821+0000 7f9985613800 20 zone default found 2024-09-14T11:09:15.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.821+0000 7f9985613800 4 Realm: () 2024-09-14T11:09:15.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.821+0000 7f9985613800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:15.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.821+0000 7f9985613800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:15.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.821+0000 7f9985613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:15.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.821+0000 7f9985613800 20 zonegroup default 2024-09-14T11:09:15.824 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.821+0000 7f9985613800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.824 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.821+0000 7f9985613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.824 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.821+0000 7f9985613800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.824 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.821+0000 7f9985613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.824 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.821+0000 7f9985613800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.824 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.822+0000 7f9985613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:15.825 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.822+0000 7f9985613800 20 started sync module instance, tier type = 2024-09-14T11:09:15.825 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.822+0000 7f9985613800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:15.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.830+0000 7f9985613800 20 add_watcher() i=0 2024-09-14T11:09:15.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.830+0000 7f9985613800 20 add_watcher() i=1 2024-09-14T11:09:15.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.830+0000 7f9985613800 20 add_watcher() i=2 2024-09-14T11:09:15.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.830+0000 7f9985613800 20 add_watcher() i=3 2024-09-14T11:09:15.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.830+0000 7f9985613800 20 add_watcher() i=4 2024-09-14T11:09:15.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.830+0000 7f9985613800 20 add_watcher() i=5 2024-09-14T11:09:15.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.830+0000 7f9985613800 20 add_watcher() i=6 2024-09-14T11:09:15.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.831+0000 7f9985613800 20 add_watcher() i=7 2024-09-14T11:09:15.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.831+0000 7f9985613800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:15.831 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.833+0000 7f9836fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:15.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.833+0000 7f9985613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:15.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.833+0000 7f9985613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:15.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.833+0000 7f9985613800 5 note: GC not initialized 2024-09-14T11:09:15.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.833+0000 7f9835fe3640 20 reqs_thread_entry: start 2024-09-14T11:09:15.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.833+0000 7f9985613800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:15.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.833+0000 7f9985613800 20 Filter name: none 2024-09-14T11:09:15.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.834+0000 7f97a77fe640 20 reqs_thread_entry: start 2024-09-14T11:09:15.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.834+0000 7f9985613800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.834+0000 7f9985613800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:09:15.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.834+0000 7f9985613800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.834+0000 7f9985613800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:09:15.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.834+0000 7f9985613800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:15.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.834+0000 7f9985613800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.835+0000 7f9985613800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:09:15.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.835+0000 7f9985613800 20 rados->read ofs=0 len=0 2024-09-14T11:09:15.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.835+0000 7f9985613800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:09:15.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.835+0000 7f9985613800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:15.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.837+0000 7f9836fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:15.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.839+0000 7f9985613800 20 remove_watcher() i=0 2024-09-14T11:09:15.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.839+0000 7f9985613800 2 removed watcher, disabling cache 2024-09-14T11:09:15.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.840+0000 7f9985613800 20 remove_watcher() i=1 2024-09-14T11:09:15.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.840+0000 7f9985613800 20 remove_watcher() i=2 2024-09-14T11:09:15.839 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.841+0000 7f9985613800 20 remove_watcher() i=3 2024-09-14T11:09:15.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.843+0000 7f9985613800 20 remove_watcher() i=4 2024-09-14T11:09:15.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.844+0000 7f9985613800 20 remove_watcher() i=5 2024-09-14T11:09:15.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.845+0000 7f9985613800 20 remove_watcher() i=6 2024-09-14T11:09:15.844 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:15.846+0000 7f9985613800 20 remove_watcher() i=7 2024-09-14T11:09:15.855 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:15.855 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:09:15.855 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: a-bucket id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-14T11:09:15.856 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:15.856 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-14T11:09:15.856 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:15.857 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:15.858 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:15.908 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:15.908 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:15.970 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:15.970 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:16.008 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:16.009 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:16.043 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:16.043 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:16.080 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:16.080 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:16.117 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:16.117 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:16.155 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:16.155 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:16.192 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:16.192 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:16.229 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:16.229 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:16.265 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:16.265 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:16.302 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:16.302 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:16.342 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:16.342 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:16.378 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:16.378 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:16.415 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:16.415 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:16.451 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:16.451 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:16.487 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:16.487 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:16.524 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:16.524 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:16.560 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:16.560 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:16.597 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:16.597 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:16.633 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:16.634 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:16.670 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:16.670 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:16.705 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:09:16.735 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:16.735 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:16.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.776+0000 7f1ecc323800 20 rados->read ofs=0 len=0 2024-09-14T11:09:16.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.777+0000 7f1ecc323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:16.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.777+0000 7f1ecc323800 20 realm 2024-09-14T11:09:16.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.777+0000 7f1ecc323800 20 rados->read ofs=0 len=0 2024-09-14T11:09:16.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.778+0000 7f1ecc323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:16.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.778+0000 7f1ecc323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:16.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.778+0000 7f1ecc323800 20 rados->read ofs=0 len=0 2024-09-14T11:09:16.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.778+0000 7f1ecc323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:16.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.778+0000 7f1ecc323800 20 rados->read ofs=0 len=0 2024-09-14T11:09:16.777 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.778+0000 7f1ecc323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:16.777 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.779+0000 7f1ecc323800 20 rados->read ofs=0 len=0 2024-09-14T11:09:16.777 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.779+0000 7f1ecc323800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:16.777 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.779+0000 7f1ecc323800 20 searching for the correct realm 2024-09-14T11:09:16.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.782+0000 7f1ec8734640 0 -- 172.21.15.50:0/1204323566 >> [v2:172.21.15.118:6816/4154782182,v1:172.21.15.118:6817/4154782182] conn(0x55f3c5984830 msgr2=0x55f3c5986cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:16.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.785+0000 7f1ec7f33640 0 -- 172.21.15.50:0/1204323566 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f1ec003b040 msgr2=0x7f1ec003c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:16.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.992+0000 7f1ecc323800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:16.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.992+0000 7f1ecc323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:16.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.992+0000 7f1ecc323800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:16.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.992+0000 7f1ecc323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:16.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.992+0000 7f1ecc323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:16.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.992+0000 7f1ecc323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:16.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.992+0000 7f1ecc323800 20 rados->read ofs=0 len=0 2024-09-14T11:09:16.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.993+0000 7f1ecc323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:16.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.993+0000 7f1ecc323800 20 rados->read ofs=0 len=0 2024-09-14T11:09:16.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.993+0000 7f1ecc323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:16.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.993+0000 7f1ecc323800 20 rados->read ofs=0 len=0 2024-09-14T11:09:16.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.993+0000 7f1ecc323800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:16.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.993+0000 7f1ecc323800 20 zone default found 2024-09-14T11:09:16.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.993+0000 7f1ecc323800 4 Realm: () 2024-09-14T11:09:16.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.993+0000 7f1ecc323800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:16.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.993+0000 7f1ecc323800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:16.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.993+0000 7f1ecc323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:16.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.993+0000 7f1ecc323800 20 zonegroup default 2024-09-14T11:09:16.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.993+0000 7f1ecc323800 20 rados->read ofs=0 len=0 2024-09-14T11:09:16.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.994+0000 7f1ecc323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:16.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.994+0000 7f1ecc323800 20 rados->read ofs=0 len=0 2024-09-14T11:09:16.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.994+0000 7f1ecc323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:16.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.994+0000 7f1ecc323800 20 rados->read ofs=0 len=0 2024-09-14T11:09:16.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.994+0000 7f1ecc323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:16.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.994+0000 7f1ecc323800 20 started sync module instance, tier type = 2024-09-14T11:09:16.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:16.994+0000 7f1ecc323800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:17.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.003+0000 7f1ecc323800 20 add_watcher() i=0 2024-09-14T11:09:17.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.003+0000 7f1ecc323800 20 add_watcher() i=1 2024-09-14T11:09:17.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.003+0000 7f1ecc323800 20 add_watcher() i=2 2024-09-14T11:09:17.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.003+0000 7f1ecc323800 20 add_watcher() i=3 2024-09-14T11:09:17.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.003+0000 7f1ecc323800 20 add_watcher() i=4 2024-09-14T11:09:17.002 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.003+0000 7f1ecc323800 20 add_watcher() i=5 2024-09-14T11:09:17.002 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.003+0000 7f1ecc323800 20 add_watcher() i=6 2024-09-14T11:09:17.002 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.004+0000 7f1ecc323800 20 add_watcher() i=7 2024-09-14T11:09:17.002 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.004+0000 7f1ecc323800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:17.004 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.006+0000 7f1d7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:17.005 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.006+0000 7f1ecc323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:17.005 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.006+0000 7f1ecc323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:17.005 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.006+0000 7f1ecc323800 5 note: GC not initialized 2024-09-14T11:09:17.005 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.006+0000 7f1d7cfe1640 20 reqs_thread_entry: start 2024-09-14T11:09:17.005 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.006+0000 7f1ecc323800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:17.005 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.006+0000 7f1ecc323800 20 Filter name: none 2024-09-14T11:09:17.005 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.006+0000 7f1cf67fc640 20 reqs_thread_entry: start 2024-09-14T11:09:17.005 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.007+0000 7f1ecc323800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.006 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.007+0000 7f1ecc323800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:09:17.006 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.007+0000 7f1ecc323800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.006 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.008+0000 7f1ecc323800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:09:17.006 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.008+0000 7f1ecc323800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:17.006 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.008+0000 7f1ecc323800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.007 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.008+0000 7f1ecc323800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:09:17.007 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.008+0000 7f1ecc323800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.007 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.008+0000 7f1ecc323800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:09:17.007 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.008+0000 7f1ecc323800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:17.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.010+0000 7f1d7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:17.010 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.012+0000 7f1ecc323800 20 remove_watcher() i=0 2024-09-14T11:09:17.011 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.012+0000 7f1ecc323800 2 removed watcher, disabling cache 2024-09-14T11:09:17.011 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.013+0000 7f1ecc323800 20 remove_watcher() i=1 2024-09-14T11:09:17.013 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.015+0000 7f1ecc323800 20 remove_watcher() i=2 2024-09-14T11:09:17.013 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.015+0000 7f1ecc323800 20 remove_watcher() i=3 2024-09-14T11:09:17.014 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.016+0000 7f1ecc323800 20 remove_watcher() i=4 2024-09-14T11:09:17.015 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.017+0000 7f1ecc323800 20 remove_watcher() i=5 2024-09-14T11:09:17.016 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.018+0000 7f1ecc323800 20 remove_watcher() i=6 2024-09-14T11:09:17.017 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.019+0000 7f1ecc323800 20 remove_watcher() i=7 2024-09-14T11:09:17.029 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:17.029 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:09:17.029 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-init-index id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:09:17.029 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:17.030 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-14T11:09:17.065 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:17.066 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:17.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.106+0000 7fb208940800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.108+0000 7fb208940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:17.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.108+0000 7fb208940800 20 realm 2024-09-14T11:09:17.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.108+0000 7fb208940800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.108+0000 7fb208940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:17.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.108+0000 7fb208940800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:17.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.108+0000 7fb208940800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.108+0000 7fb208940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:17.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.108+0000 7fb208940800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.109+0000 7fb208940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:17.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.109+0000 7fb208940800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.109 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.110+0000 7fb208940800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:17.109 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.110+0000 7fb208940800 20 searching for the correct realm 2024-09-14T11:09:17.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.112+0000 7fb203ebf640 0 -- 172.21.15.50:0/3100752103 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fb1fc0871a0 msgr2=0x7fb1fc002020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:17.315 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.317+0000 7fb204ec1640 0 -- 172.21.15.50:0/3100752103 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5573ac906050 msgr2=0x5573ac9084c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:17.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.321+0000 7fb208940800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:17.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.321+0000 7fb208940800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:17.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.321+0000 7fb208940800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:17.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.321+0000 7fb208940800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:17.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.321+0000 7fb208940800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:17.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.321+0000 7fb208940800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:17.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.321+0000 7fb208940800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.321+0000 7fb208940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:17.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.321+0000 7fb208940800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.321+0000 7fb208940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:17.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.321+0000 7fb208940800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.322+0000 7fb208940800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:17.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.322+0000 7fb208940800 20 zone default found 2024-09-14T11:09:17.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.322+0000 7fb208940800 4 Realm: () 2024-09-14T11:09:17.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.322+0000 7fb208940800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:17.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.322+0000 7fb208940800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:17.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.322+0000 7fb208940800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:17.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.322+0000 7fb208940800 20 zonegroup default 2024-09-14T11:09:17.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.322+0000 7fb208940800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.322+0000 7fb208940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:17.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.322+0000 7fb208940800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.322+0000 7fb208940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:17.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.322+0000 7fb208940800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.323+0000 7fb208940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:17.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.323+0000 7fb208940800 20 started sync module instance, tier type = 2024-09-14T11:09:17.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.323+0000 7fb208940800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:17.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.331+0000 7fb208940800 20 add_watcher() i=0 2024-09-14T11:09:17.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.331+0000 7fb208940800 20 add_watcher() i=1 2024-09-14T11:09:17.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.331+0000 7fb208940800 20 add_watcher() i=2 2024-09-14T11:09:17.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.331+0000 7fb208940800 20 add_watcher() i=3 2024-09-14T11:09:17.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.331+0000 7fb208940800 20 add_watcher() i=4 2024-09-14T11:09:17.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.331+0000 7fb208940800 20 add_watcher() i=5 2024-09-14T11:09:17.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.331+0000 7fb208940800 20 add_watcher() i=6 2024-09-14T11:09:17.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.332+0000 7fb208940800 20 add_watcher() i=7 2024-09-14T11:09:17.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.332+0000 7fb208940800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:17.333 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.334+0000 7fb0bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:17.333 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.334+0000 7fb208940800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:17.333 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.334+0000 7fb208940800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:17.333 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.334+0000 7fb208940800 5 note: GC not initialized 2024-09-14T11:09:17.333 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.335+0000 7fb0b9fdb640 20 reqs_thread_entry: start 2024-09-14T11:09:17.333 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.335+0000 7fb208940800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:17.333 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.335+0000 7fb208940800 20 Filter name: none 2024-09-14T11:09:17.333 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.335+0000 7fb02b7fe640 20 reqs_thread_entry: start 2024-09-14T11:09:17.334 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.335+0000 7fb208940800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:09:17.334 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.335+0000 7fb208940800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.335+0000 7fb208940800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:09:17.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.335+0000 7fb208940800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:09:17.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.335+0000 7fb208940800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:09:17.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.335+0000 7fb208940800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 : miss 2024-09-14T11:09:17.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.335+0000 7fb208940800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.336+0000 7fb208940800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:09:17.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.336+0000 7fb208940800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 info.flags=0x17 2024-09-14T11:09:17.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.336+0000 7fb208940800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 to cache LRU end 2024-09-14T11:09:17.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.336+0000 7fb208940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:09:17.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.336+0000 7fb208940800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:17.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.336+0000 7fb208940800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 2024-09-14T11:09:17.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.337+0000 7fb208940800 -1 Injecting error=-5 at location=init_index 2024-09-14T11:09:17.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.337+0000 7fb208940800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-14T11:09:17.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.339+0000 7fb0bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:17.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.341+0000 7fb208940800 20 remove_watcher() i=0 2024-09-14T11:09:17.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.341+0000 7fb208940800 2 removed watcher, disabling cache 2024-09-14T11:09:17.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.342+0000 7fb208940800 20 remove_watcher() i=1 2024-09-14T11:09:17.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.343+0000 7fb208940800 20 remove_watcher() i=2 2024-09-14T11:09:17.342 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.344+0000 7fb208940800 20 remove_watcher() i=3 2024-09-14T11:09:17.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.345+0000 7fb208940800 20 remove_watcher() i=4 2024-09-14T11:09:17.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.346+0000 7fb208940800 20 remove_watcher() i=5 2024-09-14T11:09:17.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.347+0000 7fb208940800 20 remove_watcher() i=6 2024-09-14T11:09:17.346 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.348+0000 7fb208940800 20 remove_watcher() i=7 2024-09-14T11:09:17.359 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:09:17.388 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:17.388 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:17.427 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.429+0000 7f04c9faf800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.429 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.431+0000 7f04c9faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:17.429 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.431+0000 7f04c9faf800 20 realm 2024-09-14T11:09:17.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.431+0000 7f04c9faf800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.431+0000 7f04c9faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:17.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.431+0000 7f04c9faf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:17.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.431+0000 7f04c9faf800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.431+0000 7f04c9faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:17.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.431+0000 7f04c9faf800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.432+0000 7f04c9faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:17.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.432+0000 7f04c9faf800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.433+0000 7f04c9faf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:17.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.433+0000 7f04c9faf800 20 searching for the correct realm 2024-09-14T11:09:17.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.436+0000 7f04c7298640 0 -- 172.21.15.50:0/3938894579 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f04c006d040 msgr2=0x7f04c007b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:17.640 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.641+0000 7f04c829a640 0 -- 172.21.15.50:0/3938894579 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5567b418b880 msgr2=0x5567b418dd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:17.644 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.646+0000 7f04c9faf800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:17.644 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.646+0000 7f04c9faf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:17.644 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.646+0000 7f04c9faf800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:17.644 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.646+0000 7f04c9faf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:17.644 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.646+0000 7f04c9faf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:17.644 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.646+0000 7f04c9faf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:17.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.646+0000 7f04c9faf800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.646+0000 7f04c9faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:17.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.646+0000 7f04c9faf800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.646+0000 7f04c9faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:17.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.646+0000 7f04c9faf800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.647+0000 7f04c9faf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:17.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.647+0000 7f04c9faf800 20 zone default found 2024-09-14T11:09:17.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.647+0000 7f04c9faf800 4 Realm: () 2024-09-14T11:09:17.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.647+0000 7f04c9faf800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:17.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.647+0000 7f04c9faf800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:17.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.647+0000 7f04c9faf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:17.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.647+0000 7f04c9faf800 20 zonegroup default 2024-09-14T11:09:17.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.647+0000 7f04c9faf800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.647+0000 7f04c9faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:17.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.647+0000 7f04c9faf800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.647+0000 7f04c9faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:17.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.647+0000 7f04c9faf800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.648+0000 7f04c9faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:17.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.648+0000 7f04c9faf800 20 started sync module instance, tier type = 2024-09-14T11:09:17.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.648+0000 7f04c9faf800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:17.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.659+0000 7f04c9faf800 20 add_watcher() i=0 2024-09-14T11:09:17.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.659+0000 7f04c9faf800 20 add_watcher() i=1 2024-09-14T11:09:17.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.659+0000 7f04c9faf800 20 add_watcher() i=2 2024-09-14T11:09:17.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.659+0000 7f04c9faf800 20 add_watcher() i=3 2024-09-14T11:09:17.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.659+0000 7f04c9faf800 20 add_watcher() i=4 2024-09-14T11:09:17.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.659+0000 7f04c9faf800 20 add_watcher() i=5 2024-09-14T11:09:17.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.659+0000 7f04c9faf800 20 add_watcher() i=6 2024-09-14T11:09:17.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.660+0000 7f04c9faf800 20 add_watcher() i=7 2024-09-14T11:09:17.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.660+0000 7f04c9faf800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:17.659 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.661+0000 7f037dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:17.660 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.662+0000 7f04c9faf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:17.660 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.662+0000 7f04c9faf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:17.660 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.662+0000 7f04c9faf800 5 note: GC not initialized 2024-09-14T11:09:17.661 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.662+0000 7f037cfe1640 20 reqs_thread_entry: start 2024-09-14T11:09:17.661 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.662+0000 7f04c9faf800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:17.661 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.662+0000 7f04c9faf800 20 Filter name: none 2024-09-14T11:09:17.661 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.662+0000 7f02f67fc640 20 reqs_thread_entry: start 2024-09-14T11:09:17.661 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.662+0000 7f04c9faf800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.662 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.663+0000 7f04c9faf800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:09:17.662 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.663+0000 7f04c9faf800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.662 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.663+0000 7f04c9faf800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:09:17.662 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.663+0000 7f04c9faf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:17.662 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.663+0000 7f04c9faf800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.662 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.663+0000 7f04c9faf800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:09:17.663 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.663+0000 7f04c9faf800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.663 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.664+0000 7f04c9faf800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:09:17.663 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.664+0000 7f04c9faf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:17.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.666+0000 7f037dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:17.666 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.667+0000 7f04c9faf800 20 remove_watcher() i=0 2024-09-14T11:09:17.666 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.668+0000 7f04c9faf800 2 removed watcher, disabling cache 2024-09-14T11:09:17.666 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.668+0000 7f04c9faf800 20 remove_watcher() i=1 2024-09-14T11:09:17.668 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.670+0000 7f04c9faf800 20 remove_watcher() i=2 2024-09-14T11:09:17.669 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.671+0000 7f04c9faf800 20 remove_watcher() i=3 2024-09-14T11:09:17.670 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.672+0000 7f04c9faf800 20 remove_watcher() i=4 2024-09-14T11:09:17.671 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.673+0000 7f04c9faf800 20 remove_watcher() i=5 2024-09-14T11:09:17.672 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.674+0000 7f04c9faf800 20 remove_watcher() i=6 2024-09-14T11:09:17.672 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.674+0000 7f04c9faf800 20 remove_watcher() i=7 2024-09-14T11:09:17.684 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:17.685 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:09:17.685 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-init-index id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:09:17.685 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:17.687 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:17.687 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:17.721 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:17.721 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:17.779 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:09:17.813 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:17.813 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:17.852 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.854+0000 7f97e9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.854 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.856+0000 7f97e9c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:17.854 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.856+0000 7f97e9c0e800 20 realm 2024-09-14T11:09:17.854 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.856+0000 7f97e9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.854 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.856+0000 7f97e9c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:17.854 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.856+0000 7f97e9c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:17.854 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.856+0000 7f97e9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.856+0000 7f97e9c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:17.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.856+0000 7f97e9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.857+0000 7f97e9c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:17.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.857+0000 7f97e9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:17.856 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.857+0000 7f97e9c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:17.856 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.857+0000 7f97e9c0e800 20 searching for the correct realm 2024-09-14T11:09:17.858 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:17.860+0000 7f97e4a58640 0 -- 172.21.15.50:0/1456950234 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f97e0024bf0 msgr2=0x7f97e0018940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:18.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.064+0000 7f97e5259640 0 -- 172.21.15.50:0/1456950234 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f97e0047440 msgr2=0x7f97e00478a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:18.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.271+0000 7f97e9c0e800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:18.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.271+0000 7f97e9c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:18.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.271+0000 7f97e9c0e800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:18.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.271+0000 7f97e9c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:18.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.271+0000 7f97e9c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:18.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.271+0000 7f97e9c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:18.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.271+0000 7f97e9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:18.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.272+0000 7f97e9c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:18.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.272+0000 7f97e9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:18.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.272+0000 7f97e9c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:18.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.272+0000 7f97e9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:18.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.272+0000 7f97e9c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:18.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.272+0000 7f97e9c0e800 20 zone default found 2024-09-14T11:09:18.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.272+0000 7f97e9c0e800 4 Realm: () 2024-09-14T11:09:18.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.272+0000 7f97e9c0e800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:18.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.272+0000 7f97e9c0e800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:18.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.272+0000 7f97e9c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:18.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.272+0000 7f97e9c0e800 20 zonegroup default 2024-09-14T11:09:18.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.272+0000 7f97e9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:18.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.273+0000 7f97e9c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:18.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.273+0000 7f97e9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:18.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.273+0000 7f97e9c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:18.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.273+0000 7f97e9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:18.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.273+0000 7f97e9c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:18.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.273+0000 7f97e9c0e800 20 started sync module instance, tier type = 2024-09-14T11:09:18.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.273+0000 7f97e9c0e800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:18.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.284+0000 7f97e9c0e800 20 add_watcher() i=0 2024-09-14T11:09:18.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.284+0000 7f97e9c0e800 20 add_watcher() i=1 2024-09-14T11:09:18.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.284+0000 7f97e9c0e800 20 add_watcher() i=2 2024-09-14T11:09:18.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.284+0000 7f97e9c0e800 20 add_watcher() i=3 2024-09-14T11:09:18.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.284+0000 7f97e9c0e800 20 add_watcher() i=4 2024-09-14T11:09:18.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.284+0000 7f97e9c0e800 20 add_watcher() i=5 2024-09-14T11:09:18.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.284+0000 7f97e9c0e800 20 add_watcher() i=6 2024-09-14T11:09:18.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.285+0000 7f97e9c0e800 20 add_watcher() i=7 2024-09-14T11:09:18.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.285+0000 7f97e9c0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:18.285 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.287+0000 7f969b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:18.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.287+0000 7f97e9c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:18.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.287+0000 7f97e9c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:18.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.287+0000 7f97e9c0e800 5 note: GC not initialized 2024-09-14T11:09:18.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.288+0000 7f969a7e4640 20 reqs_thread_entry: start 2024-09-14T11:09:18.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.288+0000 7f97e9c0e800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:18.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.288+0000 7f97e9c0e800 20 Filter name: none 2024-09-14T11:09:18.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.288+0000 7f960bfff640 20 reqs_thread_entry: start 2024-09-14T11:09:18.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.288+0000 7f97e9c0e800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:09:18.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.288+0000 7f97e9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:18.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.288+0000 7f97e9c0e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:09:18.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.288+0000 7f97e9c0e800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:09:18.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.288+0000 7f97e9c0e800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:09:18.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.289+0000 7f97e9c0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 : miss 2024-09-14T11:09:18.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.289+0000 7f97e9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:18.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.289+0000 7f97e9c0e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:09:18.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.289+0000 7f97e9c0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 info.flags=0x17 2024-09-14T11:09:18.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.289+0000 7f97e9c0e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 to cache LRU end 2024-09-14T11:09:18.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.289+0000 7f97e9c0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:09:18.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.289+0000 7f97e9c0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:18.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.289+0000 7f97e9c0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 2024-09-14T11:09:18.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.294+0000 7f97e9c0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 info.flags=0x17 2024-09-14T11:09:18.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.294+0000 7f97e9c0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 to cache LRU end 2024-09-14T11:09:18.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.294+0000 7f97e9c0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:18.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.294+0000 7f97e9c0e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20, ofs0, ns] 2024-09-14T11:09:18.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.294+0000 7f96b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497049 cookie 94195581821584 notifier 5954 bl.length()=995 2024-09-14T11:09:18.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.294+0000 7f96b7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 info.flags=0x17 2024-09-14T11:09:18.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.294+0000 7f96b7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 to cache LRU end 2024-09-14T11:09:18.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.294+0000 7f96b7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:18.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.296+0000 7f97e9c0e800 20 handle_bi_update(): bucket=:error-at-init-index[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20]): orig_sources= new_sources= 2024-09-14T11:09:18.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.296+0000 7f97e9c0e800 20 handle_bi_update(): bucket=:error-at-init-index[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20]): potential sources added=[] removed=[] 2024-09-14T11:09:18.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.296+0000 7f97e9c0e800 20 handle_bi_update(): bucket=:error-at-init-index[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20]): orig_dests= new_dests= 2024-09-14T11:09:18.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.296+0000 7f97e9c0e800 20 handle_bi_update(): bucket=:error-at-init-index[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20]): potential dests added=[] removed=[] 2024-09-14T11:09:18.299 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1.0 2024-09-14T11:09:18.299 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1.0 2024-09-14T11:09:18.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1.1 2024-09-14T11:09:18.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1.1 2024-09-14T11:09:18.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1.2 2024-09-14T11:09:18.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1.2 2024-09-14T11:09:18.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1.3 2024-09-14T11:09:18.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1.3 2024-09-14T11:09:18.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1.4 2024-09-14T11:09:18.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1.4 2024-09-14T11:09:18.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1.5 2024-09-14T11:09:18.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1.5 2024-09-14T11:09:18.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1.6 2024-09-14T11:09:18.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1.6 2024-09-14T11:09:18.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1.7 2024-09-14T11:09:18.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1.7 2024-09-14T11:09:18.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1.8 2024-09-14T11:09:18.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1.8 2024-09-14T11:09:18.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1.9 2024-09-14T11:09:18.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1.9 2024-09-14T11:09:18.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1.10 2024-09-14T11:09:18.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1.10 2024-09-14T11:09:18.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1.11 2024-09-14T11:09:18.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1.11 2024-09-14T11:09:18.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.0 2024-09-14T11:09:18.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.301+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1 2024-09-14T11:09:18.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.302+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.2 2024-09-14T11:09:18.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.302+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.3 2024-09-14T11:09:18.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.303+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.4 2024-09-14T11:09:18.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.304+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.5 2024-09-14T11:09:18.303 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.304+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.6 2024-09-14T11:09:18.303 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.305+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.7 2024-09-14T11:09:18.303 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.305+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.8 2024-09-14T11:09:18.304 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.306+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.9 2024-09-14T11:09:18.304 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.306+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.10 2024-09-14T11:09:18.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.309+0000 7f97e9c0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 : hit (requested=0x17, cached=0x17) 2024-09-14T11:09:18.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.309+0000 7f97e9c0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 2024-09-14T11:09:18.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.310+0000 7f97e9c0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 info.flags=0x17 2024-09-14T11:09:18.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.310+0000 7f97e9c0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 to cache LRU end 2024-09-14T11:09:18.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.310+0000 7f97e9c0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:18.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.310+0000 7f97e9c0e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20, ofs0, ns] 2024-09-14T11:09:18.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.311+0000 7f96b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497050 cookie 94195581821584 notifier 5954 bl.length()=995 2024-09-14T11:09:18.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.311+0000 7f96b7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 info.flags=0x17 2024-09-14T11:09:18.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.311+0000 7f96b7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 to cache LRU end 2024-09-14T11:09:18.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.311+0000 7f96b7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:18.310 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.312+0000 7f97e9c0e800 20 handle_bi_update(): bucket=:error-at-init-index[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20]): orig_sources= new_sources= 2024-09-14T11:09:18.310 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.312+0000 7f97e9c0e800 20 handle_bi_update(): bucket=:error-at-init-index[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20]): potential sources added=[] removed=[] 2024-09-14T11:09:18.310 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.312+0000 7f97e9c0e800 20 handle_bi_update(): bucket=:error-at-init-index[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20]): orig_dests= new_dests= 2024-09-14T11:09:18.311 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.312+0000 7f97e9c0e800 20 handle_bi_update(): bucket=:error-at-init-index[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20]): potential dests added=[] removed=[] 2024-09-14T11:09:18.312 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.315+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.0 2024-09-14T11:09:18.313 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.315+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.1 2024-09-14T11:09:18.313 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.315+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.2 2024-09-14T11:09:18.313 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.316+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.3 2024-09-14T11:09:18.314 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.316+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.4 2024-09-14T11:09:18.314 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.316+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.5 2024-09-14T11:09:18.315 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.316+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.6 2024-09-14T11:09:18.315 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.317+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.7 2024-09-14T11:09:18.315 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.317+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.8 2024-09-14T11:09:18.315 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.317+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.9 2024-09-14T11:09:18.316 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.318+0000 7f97e9c0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20.10 2024-09-14T11:09:18.316 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.318+0000 7f97e9c0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 : hit (requested=0x17, cached=0x17) 2024-09-14T11:09:18.316 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.318+0000 7f97e9c0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 2024-09-14T11:09:18.317 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.319+0000 7f97e9c0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 info.flags=0x17 2024-09-14T11:09:18.317 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.319+0000 7f97e9c0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 to cache LRU end 2024-09-14T11:09:18.317 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.319+0000 7f97e9c0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:18.317 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.319+0000 7f97e9c0e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20, ofs0, ns] 2024-09-14T11:09:18.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.319+0000 7f96b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497051 cookie 94195581821584 notifier 5954 bl.length()=963 2024-09-14T11:09:18.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.319+0000 7f96b7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 info.flags=0x17 2024-09-14T11:09:18.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.319+0000 7f96b7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 to cache LRU end 2024-09-14T11:09:18.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.319+0000 7f96b7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:18.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.321+0000 7f97e9c0e800 20 handle_bi_update(): bucket=:error-at-init-index[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20]): orig_sources= new_sources= 2024-09-14T11:09:18.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.321+0000 7f97e9c0e800 20 handle_bi_update(): bucket=:error-at-init-index[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20]): potential sources added=[] removed=[] 2024-09-14T11:09:18.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.321+0000 7f97e9c0e800 20 handle_bi_update(): bucket=:error-at-init-index[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20]): orig_dests= new_dests= 2024-09-14T11:09:18.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.321+0000 7f97e9c0e800 20 handle_bi_update(): bucket=:error-at-init-index[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20]): potential dests added=[] removed=[] 2024-09-14T11:09:18.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.323+0000 7f97e9c0e800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-14T11:09:18.323 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.325+0000 7f969b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:18.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.327+0000 7f97e9c0e800 20 remove_watcher() i=0 2024-09-14T11:09:18.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.327+0000 7f97e9c0e800 2 removed watcher, disabling cache 2024-09-14T11:09:18.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.328+0000 7f97e9c0e800 20 remove_watcher() i=1 2024-09-14T11:09:18.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.329+0000 7f97e9c0e800 20 remove_watcher() i=2 2024-09-14T11:09:18.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.330+0000 7f97e9c0e800 20 remove_watcher() i=3 2024-09-14T11:09:18.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.331+0000 7f97e9c0e800 20 remove_watcher() i=4 2024-09-14T11:09:18.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.332+0000 7f97e9c0e800 20 remove_watcher() i=5 2024-09-14T11:09:18.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.333+0000 7f97e9c0e800 20 remove_watcher() i=6 2024-09-14T11:09:18.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.334+0000 7f97e9c0e800 20 remove_watcher() i=7 2024-09-14T11:09:18.345 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:09:18.374 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:18.375 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:18.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.418+0000 7f5684924800 20 rados->read ofs=0 len=0 2024-09-14T11:09:18.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.419+0000 7f5684924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:18.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.419+0000 7f5684924800 20 realm 2024-09-14T11:09:18.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.419+0000 7f5684924800 20 rados->read ofs=0 len=0 2024-09-14T11:09:18.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.419+0000 7f5684924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:18.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.419+0000 7f5684924800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:18.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.419+0000 7f5684924800 20 rados->read ofs=0 len=0 2024-09-14T11:09:18.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.420+0000 7f5684924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:18.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.420+0000 7f5684924800 20 rados->read ofs=0 len=0 2024-09-14T11:09:18.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.420+0000 7f5684924800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:18.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.420+0000 7f5684924800 20 rados->read ofs=0 len=0 2024-09-14T11:09:18.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.421+0000 7f5684924800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:18.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.421+0000 7f5684924800 20 searching for the correct realm 2024-09-14T11:09:18.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.424+0000 7f567fdd1640 0 -- 172.21.15.50:0/949978450 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f5678031930 msgr2=0x7f56780133d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:18.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.629+0000 7f5680dd3640 0 -- 172.21.15.50:0/949978450 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5647bdc94e70 msgr2=0x5647bdc972a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:18.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.633+0000 7f5684924800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:18.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.633+0000 7f5684924800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:18.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.633+0000 7f5684924800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:18.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.633+0000 7f5684924800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:18.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.633+0000 7f5684924800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:18.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.633+0000 7f5684924800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:18.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.633+0000 7f5684924800 20 rados->read ofs=0 len=0 2024-09-14T11:09:18.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.634+0000 7f5684924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:18.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.634+0000 7f5684924800 20 rados->read ofs=0 len=0 2024-09-14T11:09:18.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.634+0000 7f5684924800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:18.633 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.634+0000 7f5684924800 20 rados->read ofs=0 len=0 2024-09-14T11:09:18.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.634+0000 7f5684924800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:18.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.634+0000 7f5684924800 20 zone default found 2024-09-14T11:09:18.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.634+0000 7f5684924800 4 Realm: () 2024-09-14T11:09:18.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.634+0000 7f5684924800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:18.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.634+0000 7f5684924800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:18.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.634+0000 7f5684924800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:18.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.634+0000 7f5684924800 20 zonegroup default 2024-09-14T11:09:18.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.634+0000 7f5684924800 20 rados->read ofs=0 len=0 2024-09-14T11:09:18.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.634+0000 7f5684924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:18.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.634+0000 7f5684924800 20 rados->read ofs=0 len=0 2024-09-14T11:09:18.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.635+0000 7f5684924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:18.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.635+0000 7f5684924800 20 rados->read ofs=0 len=0 2024-09-14T11:09:18.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.635+0000 7f5684924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:18.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.635+0000 7f5684924800 20 started sync module instance, tier type = 2024-09-14T11:09:18.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.635+0000 7f5684924800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:18.642 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.644+0000 7f5684924800 20 add_watcher() i=0 2024-09-14T11:09:18.642 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.644+0000 7f5684924800 20 add_watcher() i=1 2024-09-14T11:09:18.642 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.644+0000 7f5684924800 20 add_watcher() i=2 2024-09-14T11:09:18.642 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.644+0000 7f5684924800 20 add_watcher() i=3 2024-09-14T11:09:18.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.644+0000 7f5684924800 20 add_watcher() i=4 2024-09-14T11:09:18.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.644+0000 7f5684924800 20 add_watcher() i=5 2024-09-14T11:09:18.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.644+0000 7f5684924800 20 add_watcher() i=6 2024-09-14T11:09:18.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.645+0000 7f5684924800 20 add_watcher() i=7 2024-09-14T11:09:18.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.645+0000 7f5684924800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:18.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.647+0000 7f5536fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:18.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.647+0000 7f5684924800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:18.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.647+0000 7f5684924800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:18.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.647+0000 7f5684924800 5 note: GC not initialized 2024-09-14T11:09:18.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.647+0000 7f5535fdb640 20 reqs_thread_entry: start 2024-09-14T11:09:18.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.647+0000 7f5684924800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:18.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.648+0000 7f5684924800 20 Filter name: none 2024-09-14T11:09:18.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.648+0000 7f54a77fe640 20 reqs_thread_entry: start 2024-09-14T11:09:18.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.648+0000 7f5684924800 20 rados->read ofs=0 len=0 2024-09-14T11:09:18.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.648+0000 7f5684924800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:09:18.648 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.648+0000 7f5684924800 20 rados->read ofs=0 len=0 2024-09-14T11:09:18.648 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.649+0000 7f5684924800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:09:18.648 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.649+0000 7f5684924800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:18.648 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.649+0000 7f5684924800 20 rados->read ofs=0 len=0 2024-09-14T11:09:18.648 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.649+0000 7f5684924800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:09:18.648 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.649+0000 7f5684924800 20 rados->read ofs=0 len=0 2024-09-14T11:09:18.648 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.649+0000 7f5684924800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:09:18.648 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.649+0000 7f5684924800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:18.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.651+0000 7f5536fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:18.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.655+0000 7f5684924800 20 remove_watcher() i=0 2024-09-14T11:09:18.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.655+0000 7f5684924800 2 removed watcher, disabling cache 2024-09-14T11:09:18.654 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.656+0000 7f5684924800 20 remove_watcher() i=1 2024-09-14T11:09:18.654 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.656+0000 7f5684924800 20 remove_watcher() i=2 2024-09-14T11:09:18.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.659+0000 7f5684924800 20 remove_watcher() i=3 2024-09-14T11:09:18.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.660+0000 7f5684924800 20 remove_watcher() i=4 2024-09-14T11:09:18.659 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.661+0000 7f5684924800 20 remove_watcher() i=5 2024-09-14T11:09:18.660 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.662+0000 7f5684924800 20 remove_watcher() i=6 2024-09-14T11:09:18.661 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:18.663+0000 7f5684924800 20 remove_watcher() i=7 2024-09-14T11:09:18.672 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:18.672 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:09:18.672 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-init-index id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:09:18.672 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:18.674 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:18.675 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:18.696 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:18.696 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:18.924 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:18.924 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:19.058 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-14T11:09:19.058 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:19.058 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:19.058 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:19.107 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:19.107 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:19.164 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:19.165 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:19.201 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:19.201 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:19.237 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:19.237 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:19.275 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:19.275 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:19.315 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:19.315 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:19.352 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:19.353 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:19.390 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:19.390 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:19.427 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:19.427 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:19.464 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:19.465 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:19.501 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:19.501 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:19.538 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:19.538 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:19.576 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:19.576 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:19.613 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:19.613 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:19.651 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:19.652 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:19.689 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:19.689 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:19.726 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:19.726 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:19.764 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:19.765 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:19.801 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:19.801 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:19.838 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:19.838 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:19.876 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:19.876 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:19.914 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:09:19.943 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:19.944 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:19.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:19.985+0000 7f93a1615800 20 rados->read ofs=0 len=0 2024-09-14T11:09:19.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:19.987+0000 7f93a1615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:19.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:19.987+0000 7f93a1615800 20 realm 2024-09-14T11:09:19.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:19.987+0000 7f93a1615800 20 rados->read ofs=0 len=0 2024-09-14T11:09:19.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:19.987+0000 7f93a1615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:19.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:19.987+0000 7f93a1615800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:19.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:19.987+0000 7f93a1615800 20 rados->read ofs=0 len=0 2024-09-14T11:09:19.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:19.987+0000 7f93a1615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:19.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:19.987+0000 7f93a1615800 20 rados->read ofs=0 len=0 2024-09-14T11:09:19.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:19.988+0000 7f93a1615800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:19.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:19.988+0000 7f93a1615800 20 rados->read ofs=0 len=0 2024-09-14T11:09:19.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:19.989+0000 7f93a1615800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:19.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:19.989+0000 7f93a1615800 20 searching for the correct realm 2024-09-14T11:09:19.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:19.991+0000 7f939cd92640 0 -- 172.21.15.50:0/160124886 >> [v2:172.21.15.50:6800/2565843969,v1:172.21.15.50:6801/2565843969] conn(0x55b37ad478d0 msgr2=0x55b37ad49cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:19.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:19.994+0000 7f939cd92640 0 -- 172.21.15.50:0/160124886 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f939806eb60 msgr2=0x7f9398002ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:20.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.200+0000 7f93a1615800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:20.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.200+0000 7f93a1615800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:20.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.200+0000 7f93a1615800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:20.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.200+0000 7f93a1615800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:20.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.200+0000 7f93a1615800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:20.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.200+0000 7f93a1615800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:20.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.200+0000 7f93a1615800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.200+0000 7f93a1615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:20.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.200+0000 7f93a1615800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.201+0000 7f93a1615800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:20.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.201+0000 7f93a1615800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.201+0000 7f93a1615800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:20.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.201+0000 7f93a1615800 20 zone default found 2024-09-14T11:09:20.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.201+0000 7f93a1615800 4 Realm: () 2024-09-14T11:09:20.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.201+0000 7f93a1615800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:20.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.201+0000 7f93a1615800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:20.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.201+0000 7f93a1615800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:20.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.201+0000 7f93a1615800 20 zonegroup default 2024-09-14T11:09:20.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.201+0000 7f93a1615800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.202+0000 7f93a1615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:20.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.202+0000 7f93a1615800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.202+0000 7f93a1615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:20.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.202+0000 7f93a1615800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.202+0000 7f93a1615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:20.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.202+0000 7f93a1615800 20 started sync module instance, tier type = 2024-09-14T11:09:20.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.202+0000 7f93a1615800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:20.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.211+0000 7f93a1615800 20 add_watcher() i=0 2024-09-14T11:09:20.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.211+0000 7f93a1615800 20 add_watcher() i=1 2024-09-14T11:09:20.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.211+0000 7f93a1615800 20 add_watcher() i=2 2024-09-14T11:09:20.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.211+0000 7f93a1615800 20 add_watcher() i=3 2024-09-14T11:09:20.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.211+0000 7f93a1615800 20 add_watcher() i=4 2024-09-14T11:09:20.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.211+0000 7f93a1615800 20 add_watcher() i=5 2024-09-14T11:09:20.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.211+0000 7f93a1615800 20 add_watcher() i=6 2024-09-14T11:09:20.211 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.212+0000 7f93a1615800 20 add_watcher() i=7 2024-09-14T11:09:20.211 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.212+0000 7f93a1615800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:20.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.214+0000 7f92537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:20.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.214+0000 7f93a1615800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:20.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.214+0000 7f93a1615800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:20.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.214+0000 7f93a1615800 5 note: GC not initialized 2024-09-14T11:09:20.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.214+0000 7f92527e4640 20 reqs_thread_entry: start 2024-09-14T11:09:20.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.214+0000 7f93a1615800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:20.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.214+0000 7f93a1615800 20 Filter name: none 2024-09-14T11:09:20.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.214+0000 7f924b7fe640 20 reqs_thread_entry: start 2024-09-14T11:09:20.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.215+0000 7f93a1615800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.215+0000 7f93a1615800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:09:20.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.215+0000 7f93a1615800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.215+0000 7f93a1615800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:09:20.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.215+0000 7f93a1615800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:20.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.215+0000 7f93a1615800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.216+0000 7f93a1615800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:09:20.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.216+0000 7f93a1615800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.216+0000 7f93a1615800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:09:20.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.216+0000 7f93a1615800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:20.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.218+0000 7f92537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:20.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.220+0000 7f93a1615800 20 remove_watcher() i=0 2024-09-14T11:09:20.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.220+0000 7f93a1615800 2 removed watcher, disabling cache 2024-09-14T11:09:20.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.221+0000 7f93a1615800 20 remove_watcher() i=1 2024-09-14T11:09:20.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.222+0000 7f93a1615800 20 remove_watcher() i=2 2024-09-14T11:09:20.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.223+0000 7f93a1615800 20 remove_watcher() i=3 2024-09-14T11:09:20.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.224+0000 7f93a1615800 20 remove_watcher() i=4 2024-09-14T11:09:20.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.225+0000 7f93a1615800 20 remove_watcher() i=5 2024-09-14T11:09:20.224 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.226+0000 7f93a1615800 20 remove_watcher() i=6 2024-09-14T11:09:20.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.227+0000 7f93a1615800 20 remove_watcher() i=7 2024-09-14T11:09:20.237 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:20.237 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:09:20.237 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-init-index id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:09:20.237 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:20.238 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-14T11:09:20.276 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:20.276 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:20.315 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.317+0000 7fa1eb926800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.317 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.318+0000 7fa1eb926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:20.317 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.318+0000 7fa1eb926800 20 realm 2024-09-14T11:09:20.317 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.318+0000 7fa1eb926800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.317 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.319+0000 7fa1eb926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:20.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.319+0000 7fa1eb926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:20.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.319+0000 7fa1eb926800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.319+0000 7fa1eb926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:20.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.319+0000 7fa1eb926800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.320+0000 7fa1eb926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:20.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.320+0000 7fa1eb926800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.320+0000 7fa1eb926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:20.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.320+0000 7fa1eb926800 20 searching for the correct realm 2024-09-14T11:09:20.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.323+0000 7fa1e6dd8640 0 -- 172.21.15.50:0/565956968 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fa1e002c420 msgr2=0x7fa1e002c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:20.526 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.528+0000 7fa1e7dda640 0 -- 172.21.15.50:0/565956968 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x558de7c5ec60 msgr2=0x558de7c61050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:20.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.531+0000 7fa1eb926800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:20.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.532+0000 7fa1eb926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:20.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.532+0000 7fa1eb926800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:20.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.532+0000 7fa1eb926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:20.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.532+0000 7fa1eb926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:20.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.532+0000 7fa1eb926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:20.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.532+0000 7fa1eb926800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.532+0000 7fa1eb926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:20.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.532+0000 7fa1eb926800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.532+0000 7fa1eb926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:20.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.532+0000 7fa1eb926800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.532+0000 7fa1eb926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:20.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.532+0000 7fa1eb926800 20 zone default found 2024-09-14T11:09:20.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.532+0000 7fa1eb926800 4 Realm: () 2024-09-14T11:09:20.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.532+0000 7fa1eb926800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:20.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.532+0000 7fa1eb926800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:20.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.532+0000 7fa1eb926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:20.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.532+0000 7fa1eb926800 20 zonegroup default 2024-09-14T11:09:20.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.533+0000 7fa1eb926800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.533+0000 7fa1eb926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:20.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.533+0000 7fa1eb926800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.533+0000 7fa1eb926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:20.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.533+0000 7fa1eb926800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.534+0000 7fa1eb926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:20.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.534+0000 7fa1eb926800 20 started sync module instance, tier type = 2024-09-14T11:09:20.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.534+0000 7fa1eb926800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:20.540 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.542+0000 7fa1eb926800 20 add_watcher() i=0 2024-09-14T11:09:20.540 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.542+0000 7fa1eb926800 20 add_watcher() i=1 2024-09-14T11:09:20.540 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.542+0000 7fa1eb926800 20 add_watcher() i=2 2024-09-14T11:09:20.540 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.542+0000 7fa1eb926800 20 add_watcher() i=3 2024-09-14T11:09:20.540 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.542+0000 7fa1eb926800 20 add_watcher() i=4 2024-09-14T11:09:20.541 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.542+0000 7fa1eb926800 20 add_watcher() i=5 2024-09-14T11:09:20.541 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.542+0000 7fa1eb926800 20 add_watcher() i=6 2024-09-14T11:09:20.541 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.543+0000 7fa1eb926800 20 add_watcher() i=7 2024-09-14T11:09:20.541 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.543+0000 7fa1eb926800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:20.543 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.545+0000 7fa09dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:20.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.545+0000 7fa1eb926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:20.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.545+0000 7fa1eb926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:20.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.545+0000 7fa1eb926800 5 note: GC not initialized 2024-09-14T11:09:20.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.545+0000 7fa09cfe1640 20 reqs_thread_entry: start 2024-09-14T11:09:20.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.546+0000 7fa1eb926800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:20.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.546+0000 7fa1eb926800 20 Filter name: none 2024-09-14T11:09:20.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.546+0000 7fa0167fc640 20 reqs_thread_entry: start 2024-09-14T11:09:20.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.546+0000 7fa1eb926800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:09:20.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.546+0000 7fa1eb926800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.546+0000 7fa1eb926800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:09:20.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.546+0000 7fa1eb926800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:09:20.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.546+0000 7fa1eb926800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:09:20.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.546+0000 7fa1eb926800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21 : miss 2024-09-14T11:09:20.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.546+0000 7fa1eb926800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.547+0000 7fa1eb926800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:09:20.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.547+0000 7fa1eb926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21 info.flags=0x17 2024-09-14T11:09:20.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.547+0000 7fa1eb926800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21 to cache LRU end 2024-09-14T11:09:20.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.547+0000 7fa1eb926800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:09:20.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.547+0000 7fa1eb926800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:20.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.547+0000 7fa1eb926800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21 2024-09-14T11:09:20.547 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.548+0000 7fa1eb926800 -1 Injecting error=-95 at location=init_index 2024-09-14T11:09:20.547 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.548+0000 7fa1eb926800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:09:20.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.552+0000 7fa1eb926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21 info.flags=0x17 2024-09-14T11:09:20.550 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.552+0000 7fa1eb926800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21 to cache LRU end 2024-09-14T11:09:20.550 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.552+0000 7fa1eb926800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:20.550 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.552+0000 7fa1eb926800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21, ofs0, ns] 2024-09-14T11:09:20.550 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.552+0000 7fa0caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497056 cookie 94067967337056 notifier 6366 bl.length()=995 2024-09-14T11:09:20.550 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.552+0000 7fa0caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21 info.flags=0x17 2024-09-14T11:09:20.550 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.552+0000 7fa0caffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21 to cache LRU end 2024-09-14T11:09:20.551 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.552+0000 7fa0caffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:20.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.554+0000 7fa1eb926800 20 handle_bi_update(): bucket=:error-at-init-index[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21]): orig_sources= new_sources= 2024-09-14T11:09:20.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.554+0000 7fa1eb926800 20 handle_bi_update(): bucket=:error-at-init-index[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21]): potential sources added=[] removed=[] 2024-09-14T11:09:20.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.554+0000 7fa1eb926800 20 handle_bi_update(): bucket=:error-at-init-index[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21]): orig_dests= new_dests= 2024-09-14T11:09:20.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.554+0000 7fa1eb926800 20 handle_bi_update(): bucket=:error-at-init-index[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21]): potential dests added=[] removed=[] 2024-09-14T11:09:20.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1.0 2024-09-14T11:09:20.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1.0 2024-09-14T11:09:20.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1.1 2024-09-14T11:09:20.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1.1 2024-09-14T11:09:20.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1.2 2024-09-14T11:09:20.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1.2 2024-09-14T11:09:20.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1.3 2024-09-14T11:09:20.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1.3 2024-09-14T11:09:20.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1.4 2024-09-14T11:09:20.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1.4 2024-09-14T11:09:20.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1.5 2024-09-14T11:09:20.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1.5 2024-09-14T11:09:20.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1.6 2024-09-14T11:09:20.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1.6 2024-09-14T11:09:20.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1.7 2024-09-14T11:09:20.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1.7 2024-09-14T11:09:20.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1.8 2024-09-14T11:09:20.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1.8 2024-09-14T11:09:20.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1.9 2024-09-14T11:09:20.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1.9 2024-09-14T11:09:20.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1.10 2024-09-14T11:09:20.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1.10 2024-09-14T11:09:20.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1.11 2024-09-14T11:09:20.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1.11 2024-09-14T11:09:20.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.556+0000 7fa1eb926800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.0 2024-09-14T11:09:20.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.557+0000 7fa1eb926800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.1 2024-09-14T11:09:20.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.557+0000 7fa1eb926800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.2 2024-09-14T11:09:20.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.558+0000 7fa1eb926800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.3 2024-09-14T11:09:20.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.558+0000 7fa1eb926800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.4 2024-09-14T11:09:20.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.558+0000 7fa1eb926800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.5 2024-09-14T11:09:20.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.559+0000 7fa1eb926800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.6 2024-09-14T11:09:20.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.560+0000 7fa1eb926800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.7 2024-09-14T11:09:20.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.560+0000 7fa1eb926800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.8 2024-09-14T11:09:20.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.561+0000 7fa1eb926800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.9 2024-09-14T11:09:20.560 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.561+0000 7fa1eb926800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21.10 2024-09-14T11:09:20.562 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.564+0000 7fa1eb926800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21 : hit (requested=0x17, cached=0x17) 2024-09-14T11:09:20.562 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.564+0000 7fa1eb926800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21 2024-09-14T11:09:20.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.565+0000 7fa1eb926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21 info.flags=0x17 2024-09-14T11:09:20.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.565+0000 7fa1eb926800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21 to cache LRU end 2024-09-14T11:09:20.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.565+0000 7fa1eb926800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:20.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.565+0000 7fa1eb926800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21, ofs0, ns] 2024-09-14T11:09:20.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.565+0000 7fa0ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497057 cookie 94067967337056 notifier 6366 bl.length()=963 2024-09-14T11:09:20.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.565+0000 7fa0ca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21 info.flags=0x17 2024-09-14T11:09:20.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.565+0000 7fa0ca7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21 to cache LRU end 2024-09-14T11:09:20.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.565+0000 7fa0ca7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:20.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.567+0000 7fa1eb926800 20 handle_bi_update(): bucket=:error-at-init-index[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21]): orig_sources= new_sources= 2024-09-14T11:09:20.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.567+0000 7fa1eb926800 20 handle_bi_update(): bucket=:error-at-init-index[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21]): potential sources added=[] removed=[] 2024-09-14T11:09:20.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.567+0000 7fa1eb926800 20 handle_bi_update(): bucket=:error-at-init-index[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21]): orig_dests= new_dests= 2024-09-14T11:09:20.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.567+0000 7fa1eb926800 20 handle_bi_update(): bucket=:error-at-init-index[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21]): potential dests added=[] removed=[] 2024-09-14T11:09:20.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.569+0000 7fa1eb926800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-14T11:09:20.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.571+0000 7fa09dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:20.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.574+0000 7fa1eb926800 20 remove_watcher() i=0 2024-09-14T11:09:20.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.574+0000 7fa1eb926800 2 removed watcher, disabling cache 2024-09-14T11:09:20.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.575+0000 7fa1eb926800 20 remove_watcher() i=1 2024-09-14T11:09:20.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.576+0000 7fa1eb926800 20 remove_watcher() i=2 2024-09-14T11:09:20.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.577+0000 7fa1eb926800 20 remove_watcher() i=3 2024-09-14T11:09:20.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.578+0000 7fa1eb926800 20 remove_watcher() i=4 2024-09-14T11:09:20.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.578+0000 7fa1eb926800 20 remove_watcher() i=5 2024-09-14T11:09:20.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.579+0000 7fa1eb926800 20 remove_watcher() i=6 2024-09-14T11:09:20.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.580+0000 7fa1eb926800 20 remove_watcher() i=7 2024-09-14T11:09:20.704 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:09:20.704 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:20.704 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:20.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.661+0000 7f808b298800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.663+0000 7f808b298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:20.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.663+0000 7f808b298800 20 realm 2024-09-14T11:09:20.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.663+0000 7f808b298800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.663+0000 7f808b298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:20.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.663+0000 7f808b298800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:20.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.663+0000 7f808b298800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.664+0000 7f808b298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:20.705 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.664+0000 7f808b298800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.705 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.664+0000 7f808b298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:20.705 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.664+0000 7f808b298800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.705 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.665+0000 7f808b298800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:20.705 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.665+0000 7f808b298800 20 searching for the correct realm 2024-09-14T11:09:20.705 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.668+0000 7f8088581640 0 -- 172.21.15.50:0/1286019383 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f808009e040 msgr2=0x7f80800b8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:20.871 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.873+0000 7f8088581640 0 -- 172.21.15.50:0/1286019383 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55e5b111e880 msgr2=0x55e5b1120d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:20.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.877+0000 7f808b298800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:20.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.877+0000 7f808b298800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:20.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.877+0000 7f808b298800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:20.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.877+0000 7f808b298800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:20.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.877+0000 7f808b298800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:20.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.877+0000 7f808b298800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:20.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.877+0000 7f808b298800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.877+0000 7f808b298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:20.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.877+0000 7f808b298800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.877+0000 7f808b298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:20.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.877+0000 7f808b298800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.877+0000 7f808b298800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:20.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.878+0000 7f808b298800 20 zone default found 2024-09-14T11:09:20.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.878+0000 7f808b298800 4 Realm: () 2024-09-14T11:09:20.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.878+0000 7f808b298800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:20.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.878+0000 7f808b298800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:20.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.878+0000 7f808b298800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:20.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.878+0000 7f808b298800 20 zonegroup default 2024-09-14T11:09:20.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.878+0000 7f808b298800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.878+0000 7f808b298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:20.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.878+0000 7f808b298800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.878+0000 7f808b298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:20.879 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.878+0000 7f808b298800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.879 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.878+0000 7f808b298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:20.879 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.878+0000 7f808b298800 20 started sync module instance, tier type = 2024-09-14T11:09:20.879 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.878+0000 7f808b298800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:20.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.886+0000 7f808b298800 20 add_watcher() i=0 2024-09-14T11:09:20.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.886+0000 7f808b298800 20 add_watcher() i=1 2024-09-14T11:09:20.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.886+0000 7f808b298800 20 add_watcher() i=2 2024-09-14T11:09:20.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.886+0000 7f808b298800 20 add_watcher() i=3 2024-09-14T11:09:20.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.886+0000 7f808b298800 20 add_watcher() i=4 2024-09-14T11:09:20.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.886+0000 7f808b298800 20 add_watcher() i=5 2024-09-14T11:09:20.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.886+0000 7f808b298800 20 add_watcher() i=6 2024-09-14T11:09:20.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.887+0000 7f808b298800 20 add_watcher() i=7 2024-09-14T11:09:20.886 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.887+0000 7f808b298800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:20.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.889+0000 7f7f3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:20.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.890+0000 7f808b298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:20.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.890+0000 7f808b298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:20.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.890+0000 7f808b298800 5 note: GC not initialized 2024-09-14T11:09:20.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.890+0000 7f7f3dfe3640 20 reqs_thread_entry: start 2024-09-14T11:09:20.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.890+0000 7f808b298800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:20.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.890+0000 7f808b298800 20 Filter name: none 2024-09-14T11:09:20.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.890+0000 7f7eaf7fe640 20 reqs_thread_entry: start 2024-09-14T11:09:20.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.890+0000 7f808b298800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.891+0000 7f808b298800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:09:20.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.891+0000 7f808b298800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.891+0000 7f808b298800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:09:20.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.891+0000 7f808b298800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:20.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.891+0000 7f808b298800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.891+0000 7f808b298800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:09:20.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.891+0000 7f808b298800 20 rados->read ofs=0 len=0 2024-09-14T11:09:20.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.892+0000 7f808b298800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:09:20.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.892+0000 7f808b298800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:20.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.894+0000 7f7f3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:20.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.895+0000 7f808b298800 20 remove_watcher() i=0 2024-09-14T11:09:20.894 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.895+0000 7f808b298800 2 removed watcher, disabling cache 2024-09-14T11:09:20.895 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.897+0000 7f808b298800 20 remove_watcher() i=1 2024-09-14T11:09:20.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.898+0000 7f808b298800 20 remove_watcher() i=2 2024-09-14T11:09:20.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.899+0000 7f808b298800 20 remove_watcher() i=3 2024-09-14T11:09:20.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.900+0000 7f808b298800 20 remove_watcher() i=4 2024-09-14T11:09:20.899 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.901+0000 7f808b298800 20 remove_watcher() i=5 2024-09-14T11:09:20.899 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.902+0000 7f808b298800 20 remove_watcher() i=6 2024-09-14T11:09:20.900 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:20.902+0000 7f808b298800 20 remove_watcher() i=7 2024-09-14T11:09:20.912 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:20.912 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:09:20.912 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-init-index id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:09:20.912 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:20.914 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:20.914 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:20.935 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:20.935 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:21.175 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:21.176 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:21.312 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard bucket with abort at init_index 2024-09-14T11:09:21.312 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:21.313 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:21.313 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:21.365 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:21.366 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:21.423 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:21.423 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:21.461 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:21.461 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:21.498 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:21.498 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:21.535 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:21.535 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:21.572 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:21.572 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:21.609 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:21.609 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:21.646 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:21.646 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:21.684 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:21.684 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:21.720 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:21.721 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:21.758 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:21.758 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:21.795 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:21.795 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:21.831 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:21.831 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:21.869 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:21.869 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:21.905 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:21.906 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:21.943 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:21.943 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:21.980 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:21.980 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:22.016 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:22.016 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:22.053 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:22.054 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:22.094 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:22.095 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:22.132 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:22.132 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:22.169 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:09:22.199 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:22.199 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:22.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:22.240+0000 7f6cb2b3c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:22.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:22.241+0000 7f6cb2b3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:22.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:22.241+0000 7f6cb2b3c800 20 realm 2024-09-14T11:09:22.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:22.241+0000 7f6cb2b3c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:22.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:22.242+0000 7f6cb2b3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:22.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:22.242+0000 7f6cb2b3c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:22.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:22.242+0000 7f6cb2b3c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:22.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:22.242+0000 7f6cb2b3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:22.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:22.242+0000 7f6cb2b3c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:22.241 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:22.243+0000 7f6cb2b3c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:22.241 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:22.243+0000 7f6cb2b3c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:22.241 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:22.243+0000 7f6cb2b3c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:22.241 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:22.243+0000 7f6cb2b3c800 20 searching for the correct realm 2024-09-14T11:09:22.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:22.246+0000 7f6cae080640 0 -- 172.21.15.50:0/1365592515 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f6ca8017070 msgr2=0x7f6ca8039940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:22.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:22.651+0000 7f6cae881640 0 -- 172.21.15.50:0/1365592515 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f6ca804b040 msgr2=0x7f6ca804b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:09:23.057 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.059+0000 7f6cb2b3c800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:23.057 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.059+0000 7f6cb2b3c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:23.057 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.059+0000 7f6cb2b3c800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:23.058 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.059+0000 7f6cb2b3c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:23.058 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.059+0000 7f6cb2b3c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:23.058 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.059+0000 7f6cb2b3c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:23.058 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.059+0000 7f6cb2b3c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.058 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.059+0000 7f6cb2b3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.058 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.059+0000 7f6cb2b3c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.059 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.060+0000 7f6cb2b3c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:23.059 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.060+0000 7f6cb2b3c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.059 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.060+0000 7f6cb2b3c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:23.059 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.060+0000 7f6cb2b3c800 20 zone default found 2024-09-14T11:09:23.059 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.060+0000 7f6cb2b3c800 4 Realm: () 2024-09-14T11:09:23.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.060+0000 7f6cb2b3c800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:23.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.060+0000 7f6cb2b3c800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:23.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.060+0000 7f6cb2b3c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:23.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.060+0000 7f6cb2b3c800 20 zonegroup default 2024-09-14T11:09:23.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.060+0000 7f6cb2b3c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.060+0000 7f6cb2b3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.060+0000 7f6cb2b3c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.061+0000 7f6cb2b3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.061+0000 7f6cb2b3c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.061+0000 7f6cb2b3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.061+0000 7f6cb2b3c800 20 started sync module instance, tier type = 2024-09-14T11:09:23.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.061+0000 7f6cb2b3c800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:23.069 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.071+0000 7f6cb2b3c800 20 add_watcher() i=0 2024-09-14T11:09:23.069 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.071+0000 7f6cb2b3c800 20 add_watcher() i=1 2024-09-14T11:09:23.069 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.071+0000 7f6cb2b3c800 20 add_watcher() i=2 2024-09-14T11:09:23.069 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.071+0000 7f6cb2b3c800 20 add_watcher() i=3 2024-09-14T11:09:23.069 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.071+0000 7f6cb2b3c800 20 add_watcher() i=4 2024-09-14T11:09:23.069 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.071+0000 7f6cb2b3c800 20 add_watcher() i=5 2024-09-14T11:09:23.069 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.071+0000 7f6cb2b3c800 20 add_watcher() i=6 2024-09-14T11:09:23.070 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.072+0000 7f6cb2b3c800 20 add_watcher() i=7 2024-09-14T11:09:23.070 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.072+0000 7f6cb2b3c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:23.072 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.074+0000 7f6b657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:23.072 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.074+0000 7f6cb2b3c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:23.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.074+0000 7f6cb2b3c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:23.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.074+0000 7f6cb2b3c800 5 note: GC not initialized 2024-09-14T11:09:23.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.074+0000 7f6adffff640 20 reqs_thread_entry: start 2024-09-14T11:09:23.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.074+0000 7f6cb2b3c800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:23.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.075+0000 7f6cb2b3c800 20 Filter name: none 2024-09-14T11:09:23.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.075+0000 7f6addffb640 20 reqs_thread_entry: start 2024-09-14T11:09:23.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.075+0000 7f6cb2b3c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.075+0000 7f6cb2b3c800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:09:23.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.075+0000 7f6cb2b3c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.076+0000 7f6cb2b3c800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:09:23.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.076+0000 7f6cb2b3c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:23.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.076+0000 7f6cb2b3c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.076+0000 7f6cb2b3c800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:09:23.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.076+0000 7f6cb2b3c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.077+0000 7f6cb2b3c800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:09:23.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.077+0000 7f6cb2b3c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:23.077 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.079+0000 7f6b657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:23.079 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.081+0000 7f6cb2b3c800 20 remove_watcher() i=0 2024-09-14T11:09:23.079 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.081+0000 7f6cb2b3c800 2 removed watcher, disabling cache 2024-09-14T11:09:23.080 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.082+0000 7f6cb2b3c800 20 remove_watcher() i=1 2024-09-14T11:09:23.082 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.084+0000 7f6cb2b3c800 20 remove_watcher() i=2 2024-09-14T11:09:23.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.085+0000 7f6cb2b3c800 20 remove_watcher() i=3 2024-09-14T11:09:23.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.086+0000 7f6cb2b3c800 20 remove_watcher() i=4 2024-09-14T11:09:23.086 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.088+0000 7f6cb2b3c800 20 remove_watcher() i=5 2024-09-14T11:09:23.087 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.089+0000 7f6cb2b3c800 20 remove_watcher() i=6 2024-09-14T11:09:23.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.090+0000 7f6cb2b3c800 20 remove_watcher() i=7 2024-09-14T11:09:23.102 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.102 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:09:23.102 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: abort-at-init-indext id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:09:23.103 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.104 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-14T11:09:23.142 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:23.142 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:23.184 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.186+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.188+0000 7f1f64412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.188+0000 7f1f64412800 20 realm 2024-09-14T11:09:23.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.188+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.188+0000 7f1f64412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.188+0000 7f1f64412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:23.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.188+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.188+0000 7f1f64412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.188+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.189+0000 7f1f64412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:23.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.189+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.190+0000 7f1f64412800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:23.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.190+0000 7f1f64412800 20 searching for the correct realm 2024-09-14T11:09:23.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.192+0000 7f1f603e1640 0 -- 172.21.15.50:0/3557204915 >> [v2:172.21.15.118:6816/4154782182,v1:172.21.15.118:6817/4154782182] conn(0x5586b1985aa0 msgr2=0x5586b1987f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:23.194 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.196+0000 7f1f5fbe0640 0 -- 172.21.15.50:0/3557204915 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f1f58046920 msgr2=0x7f1f580183a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:23.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.403+0000 7f1f64412800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:23.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.403+0000 7f1f64412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:23.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.403+0000 7f1f64412800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:23.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.403+0000 7f1f64412800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:23.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.403+0000 7f1f64412800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:23.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.403+0000 7f1f64412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:23.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.403+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.404+0000 7f1f64412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.404+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.404+0000 7f1f64412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:23.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.404+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.404+0000 7f1f64412800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:23.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.404+0000 7f1f64412800 20 zone default found 2024-09-14T11:09:23.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.404+0000 7f1f64412800 4 Realm: () 2024-09-14T11:09:23.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.404+0000 7f1f64412800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:23.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.404+0000 7f1f64412800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:23.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.404+0000 7f1f64412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:23.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.404+0000 7f1f64412800 20 zonegroup default 2024-09-14T11:09:23.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.404+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.405+0000 7f1f64412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.405+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.405+0000 7f1f64412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.405+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.405+0000 7f1f64412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.405+0000 7f1f64412800 20 started sync module instance, tier type = 2024-09-14T11:09:23.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.405+0000 7f1f64412800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:23.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.414+0000 7f1f64412800 20 add_watcher() i=0 2024-09-14T11:09:23.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.414+0000 7f1f64412800 20 add_watcher() i=1 2024-09-14T11:09:23.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.414+0000 7f1f64412800 20 add_watcher() i=2 2024-09-14T11:09:23.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.414+0000 7f1f64412800 20 add_watcher() i=3 2024-09-14T11:09:23.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.414+0000 7f1f64412800 20 add_watcher() i=4 2024-09-14T11:09:23.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.414+0000 7f1f64412800 20 add_watcher() i=5 2024-09-14T11:09:23.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.414+0000 7f1f64412800 20 add_watcher() i=6 2024-09-14T11:09:23.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.415+0000 7f1f64412800 20 add_watcher() i=7 2024-09-14T11:09:23.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.415+0000 7f1f64412800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:23.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.417+0000 7f1e15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:23.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.417+0000 7f1f64412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:23.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.417+0000 7f1f64412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:23.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.417+0000 7f1f64412800 5 note: GC not initialized 2024-09-14T11:09:23.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.417+0000 7f1e14fe1640 20 reqs_thread_entry: start 2024-09-14T11:09:23.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.417+0000 7f1f64412800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:23.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.417+0000 7f1f64412800 20 Filter name: none 2024-09-14T11:09:23.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.418+0000 7f1d8e7fc640 20 reqs_thread_entry: start 2024-09-14T11:09:23.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.418+0000 7f1f64412800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:09:23.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.418+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.418+0000 7f1f64412800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:09:23.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.418+0000 7f1f64412800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:09:23.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.418+0000 7f1f64412800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:09:23.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.418+0000 7f1f64412800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 : miss 2024-09-14T11:09:23.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.418+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.419+0000 7f1f64412800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:09:23.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.419+0000 7f1f64412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 info.flags=0x17 2024-09-14T11:09:23.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.419+0000 7f1f64412800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 to cache LRU end 2024-09-14T11:09:23.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.419+0000 7f1f64412800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:09:23.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.419+0000 7f1f64412800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:23.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.419+0000 7f1f64412800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 2024-09-14T11:09:23.418 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1f64412800 time 2024-09-14T11:09:23.421125+0000 2024-09-14T11:09:23.418 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:09:23.419 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:09:23.419 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1f6558c76a] 2024-09-14T11:09:23.419 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f1f6558c928] 2024-09-14T11:09:23.419 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5586af4cf0b1] 2024-09-14T11:09:23.419 INFO:tasks.workunit.client.0.smithi050.stderr: 4: radosgw-admin(+0xd882d4) [0x5586af9e22d4] 2024-09-14T11:09:23.420 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5586af4deefd] 2024-09-14T11:09:23.420 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:09:23.420 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1f64229590] 2024-09-14T11:09:23.420 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:09:23.420 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:09:23.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.421+0000 7f1f64412800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1f64412800 time 2024-09-14T11:09:23.421125+0000 2024-09-14T11:09:23.420 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:09:23.420 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.420 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:09:23.420 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1f6558c76a] 2024-09-14T11:09:23.420 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f1f6558c928] 2024-09-14T11:09:23.420 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5586af4cf0b1] 2024-09-14T11:09:23.420 INFO:tasks.workunit.client.0.smithi050.stderr: 4: radosgw-admin(+0xd882d4) [0x5586af9e22d4] 2024-09-14T11:09:23.421 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5586af4deefd] 2024-09-14T11:09:23.421 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:09:23.421 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1f64229590] 2024-09-14T11:09:23.421 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:09:23.421 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:09:23.421 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.421 INFO:tasks.workunit.client.0.smithi050.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:09:23.421 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f1f64412800 thread_name:radosgw-admin 2024-09-14T11:09:23.439 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:09:23.439 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1f6423e6f0] 2024-09-14T11:09:23.439 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1f6428b99c] 2024-09-14T11:09:23.439 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:09:23.440 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:09:23.440 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1f6558c7c4] 2024-09-14T11:09:23.440 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f1f6558c928] 2024-09-14T11:09:23.440 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5586af4cf0b1] 2024-09-14T11:09:23.440 INFO:tasks.workunit.client.0.smithi050.stderr: 8: radosgw-admin(+0xd882d4) [0x5586af9e22d4] 2024-09-14T11:09:23.440 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5586af4deefd] 2024-09-14T11:09:23.440 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:09:23.440 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1f64229590] 2024-09-14T11:09:23.440 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:09:23.440 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:09:23.440 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.422+0000 7f1f64412800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:09:23.440 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f1f64412800 thread_name:radosgw-admin 2024-09-14T11:09:23.440 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.441 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:09:23.441 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1f6423e6f0] 2024-09-14T11:09:23.441 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1f6428b99c] 2024-09-14T11:09:23.441 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:09:23.441 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:09:23.441 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1f6558c7c4] 2024-09-14T11:09:23.441 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f1f6558c928] 2024-09-14T11:09:23.441 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5586af4cf0b1] 2024-09-14T11:09:23.441 INFO:tasks.workunit.client.0.smithi050.stderr: 8: radosgw-admin(+0xd882d4) [0x5586af9e22d4] 2024-09-14T11:09:23.441 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5586af4deefd] 2024-09-14T11:09:23.441 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:09:23.441 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1f64229590] 2024-09-14T11:09:23.442 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:09:23.442 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:09:23.442 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:09:23.442 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.442 INFO:tasks.workunit.client.0.smithi050.stderr:--- begin dump of recent events --- 2024-09-14T11:09:23.442 INFO:tasks.workunit.client.0.smithi050.stderr: -499> 2024-09-14T11:09:23.168+0000 7f1e4de0b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:09:23.442 INFO:tasks.workunit.client.0.smithi050.stderr: -498> 2024-09-14T11:09:23.168+0000 7f1e4de0b640 10 monclient: dump: 2024-09-14T11:09:23.442 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:09:23.442 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:09:23.442 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.442 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.442 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:09:23.443 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.443 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:09:23.443 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:09:23.443 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:09:23.443 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.443 INFO:tasks.workunit.client.0.smithi050.stderr: -497> 2024-09-14T11:09:23.168+0000 7f1e4de0b640 10 monclient: _finish_auth 0 2024-09-14T11:09:23.443 INFO:tasks.workunit.client.0.smithi050.stderr: -496> 2024-09-14T11:09:23.168+0000 7f1e4de0b640 10 monclient: _check_auth_tickets 2024-09-14T11:09:23.443 INFO:tasks.workunit.client.0.smithi050.stderr: -495> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 monclient: authenticate success, global_id 6044 2024-09-14T11:09:23.443 INFO:tasks.workunit.client.0.smithi050.stderr: -494> 2024-09-14T11:09:23.168+0000 7f1e4de0b640 10 monclient: handle_config config(0 keys) 2024-09-14T11:09:23.443 INFO:tasks.workunit.client.0.smithi050.stderr: -493> 2024-09-14T11:09:23.168+0000 7f1f64412800 10 monclient: get_monmap_and_config success 2024-09-14T11:09:23.443 INFO:tasks.workunit.client.0.smithi050.stderr: -492> 2024-09-14T11:09:23.168+0000 7f1f64412800 4 set_mon_vals no callback set 2024-09-14T11:09:23.443 INFO:tasks.workunit.client.0.smithi050.stderr: -491> 2024-09-14T11:09:23.168+0000 7f1e4de0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:09:23.443 INFO:tasks.workunit.client.0.smithi050.stderr: -490> 2024-09-14T11:09:23.168+0000 7f1e4de0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:09:23.443 INFO:tasks.workunit.client.0.smithi050.stderr: -489> 2024-09-14T11:09:23.168+0000 7f1e4de0b640 10 monclient: dump: 2024-09-14T11:09:23.444 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:09:23.444 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:09:23.444 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.444 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.444 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:09:23.444 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.444 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:09:23.444 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:09:23.444 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:09:23.444 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.444 INFO:tasks.workunit.client.0.smithi050.stderr: -488> 2024-09-14T11:09:23.168+0000 7f1f64412800 10 monclient: shutdown 2024-09-14T11:09:23.444 INFO:tasks.workunit.client.0.smithi050.stderr: -487> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 asok(0x5586b166e270) unregister_commands rotate-key 2024-09-14T11:09:23.445 INFO:tasks.workunit.client.0.smithi050.stderr: -486> 2024-09-14T11:09:23.168+0000 7f1f64412800 10 monclient: build_initial_monmap 2024-09-14T11:09:23.445 INFO:tasks.workunit.client.0.smithi050.stderr: -485> 2024-09-14T11:09:23.168+0000 7f1f64412800 1 build_initial for_mkfs: 0 2024-09-14T11:09:23.445 INFO:tasks.workunit.client.0.smithi050.stderr: -484> 2024-09-14T11:09:23.168+0000 7f1f64412800 10 monclient: monmap: 2024-09-14T11:09:23.445 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:09:23.445 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:09:23.445 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:09:23.445 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:09:23.445 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:09:23.445 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.445 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:09:23.445 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:09:23.445 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:09:23.445 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.446 INFO:tasks.workunit.client.0.smithi050.stderr: -483> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding auth protocol: cephx 2024-09-14T11:09:23.446 INFO:tasks.workunit.client.0.smithi050.stderr: -482> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding auth protocol: cephx 2024-09-14T11:09:23.446 INFO:tasks.workunit.client.0.smithi050.stderr: -481> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding auth protocol: cephx 2024-09-14T11:09:23.446 INFO:tasks.workunit.client.0.smithi050.stderr: -480> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding con mode: secure 2024-09-14T11:09:23.446 INFO:tasks.workunit.client.0.smithi050.stderr: -479> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding con mode: crc 2024-09-14T11:09:23.446 INFO:tasks.workunit.client.0.smithi050.stderr: -478> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding con mode: secure 2024-09-14T11:09:23.446 INFO:tasks.workunit.client.0.smithi050.stderr: -477> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding con mode: crc 2024-09-14T11:09:23.446 INFO:tasks.workunit.client.0.smithi050.stderr: -476> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding con mode: secure 2024-09-14T11:09:23.446 INFO:tasks.workunit.client.0.smithi050.stderr: -475> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding con mode: crc 2024-09-14T11:09:23.446 INFO:tasks.workunit.client.0.smithi050.stderr: -474> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding con mode: crc 2024-09-14T11:09:23.446 INFO:tasks.workunit.client.0.smithi050.stderr: -473> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding con mode: secure 2024-09-14T11:09:23.446 INFO:tasks.workunit.client.0.smithi050.stderr: -472> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding con mode: crc 2024-09-14T11:09:23.446 INFO:tasks.workunit.client.0.smithi050.stderr: -471> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding con mode: secure 2024-09-14T11:09:23.447 INFO:tasks.workunit.client.0.smithi050.stderr: -470> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding con mode: crc 2024-09-14T11:09:23.447 INFO:tasks.workunit.client.0.smithi050.stderr: -469> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding con mode: secure 2024-09-14T11:09:23.447 INFO:tasks.workunit.client.0.smithi050.stderr: -468> 2024-09-14T11:09:23.169+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.447 INFO:tasks.workunit.client.0.smithi050.stderr: -467> 2024-09-14T11:09:23.169+0000 7f1f64412800 1 librados: starting msgr at 2024-09-14T11:09:23.447 INFO:tasks.workunit.client.0.smithi050.stderr: -466> 2024-09-14T11:09:23.169+0000 7f1f64412800 1 librados: starting objecter 2024-09-14T11:09:23.447 INFO:tasks.workunit.client.0.smithi050.stderr: -465> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 asok(0x5586b166e270) register_command objecter_requests hook 0x5586b1894f90 2024-09-14T11:09:23.447 INFO:tasks.workunit.client.0.smithi050.stderr: -464> 2024-09-14T11:09:23.169+0000 7f1f64412800 1 librados: setting wanted keys 2024-09-14T11:09:23.447 INFO:tasks.workunit.client.0.smithi050.stderr: -463> 2024-09-14T11:09:23.169+0000 7f1f64412800 1 librados: calling monclient init 2024-09-14T11:09:23.447 INFO:tasks.workunit.client.0.smithi050.stderr: -462> 2024-09-14T11:09:23.169+0000 7f1f64412800 10 monclient: init 2024-09-14T11:09:23.447 INFO:tasks.workunit.client.0.smithi050.stderr: -461> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding auth protocol: cephx 2024-09-14T11:09:23.447 INFO:tasks.workunit.client.0.smithi050.stderr: -460> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding auth protocol: cephx 2024-09-14T11:09:23.447 INFO:tasks.workunit.client.0.smithi050.stderr: -459> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding auth protocol: cephx 2024-09-14T11:09:23.447 INFO:tasks.workunit.client.0.smithi050.stderr: -458> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding con mode: secure 2024-09-14T11:09:23.448 INFO:tasks.workunit.client.0.smithi050.stderr: -457> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding con mode: crc 2024-09-14T11:09:23.448 INFO:tasks.workunit.client.0.smithi050.stderr: -456> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding con mode: secure 2024-09-14T11:09:23.448 INFO:tasks.workunit.client.0.smithi050.stderr: -455> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding con mode: crc 2024-09-14T11:09:23.448 INFO:tasks.workunit.client.0.smithi050.stderr: -454> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding con mode: secure 2024-09-14T11:09:23.448 INFO:tasks.workunit.client.0.smithi050.stderr: -453> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding con mode: crc 2024-09-14T11:09:23.448 INFO:tasks.workunit.client.0.smithi050.stderr: -452> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding con mode: crc 2024-09-14T11:09:23.448 INFO:tasks.workunit.client.0.smithi050.stderr: -451> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding con mode: secure 2024-09-14T11:09:23.448 INFO:tasks.workunit.client.0.smithi050.stderr: -450> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding con mode: crc 2024-09-14T11:09:23.448 INFO:tasks.workunit.client.0.smithi050.stderr: -449> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding con mode: secure 2024-09-14T11:09:23.448 INFO:tasks.workunit.client.0.smithi050.stderr: -448> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding con mode: crc 2024-09-14T11:09:23.448 INFO:tasks.workunit.client.0.smithi050.stderr: -447> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding con mode: secure 2024-09-14T11:09:23.448 INFO:tasks.workunit.client.0.smithi050.stderr: -446> 2024-09-14T11:09:23.169+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.449 INFO:tasks.workunit.client.0.smithi050.stderr: -445> 2024-09-14T11:09:23.169+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.449 INFO:tasks.workunit.client.0.smithi050.stderr: -444> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 asok(0x5586b166e270) register_command rotate-key hook 0x5586b188ea48 2024-09-14T11:09:23.449 INFO:tasks.workunit.client.0.smithi050.stderr: -443> 2024-09-14T11:09:23.169+0000 7f1f64412800 10 monclient: _reopen_session rank -1 2024-09-14T11:09:23.449 INFO:tasks.workunit.client.0.smithi050.stderr: -442> 2024-09-14T11:09:23.169+0000 7f1f64412800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:09:23.449 INFO:tasks.workunit.client.0.smithi050.stderr: -441> 2024-09-14T11:09:23.169+0000 7f1f64412800 10 monclient(hunting): picked mon.noname-a con 0x5586b173c400 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:09:23.449 INFO:tasks.workunit.client.0.smithi050.stderr: -440> 2024-09-14T11:09:23.169+0000 7f1f64412800 10 monclient(hunting): picked mon.noname-c con 0x5586b1746860 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:09:23.449 INFO:tasks.workunit.client.0.smithi050.stderr: -439> 2024-09-14T11:09:23.169+0000 7f1f64412800 10 monclient(hunting): picked mon.noname-b con 0x5586b18c0830 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:09:23.449 INFO:tasks.workunit.client.0.smithi050.stderr: -438> 2024-09-14T11:09:23.169+0000 7f1f64412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:09:23.449 INFO:tasks.workunit.client.0.smithi050.stderr: -437> 2024-09-14T11:09:23.169+0000 7f1f64412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:09:23.449 INFO:tasks.workunit.client.0.smithi050.stderr: -436> 2024-09-14T11:09:23.169+0000 7f1f64412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:09:23.449 INFO:tasks.workunit.client.0.smithi050.stderr: -435> 2024-09-14T11:09:23.169+0000 7f1f64412800 10 monclient(hunting): _renew_subs 2024-09-14T11:09:23.449 INFO:tasks.workunit.client.0.smithi050.stderr: -434> 2024-09-14T11:09:23.169+0000 7f1f64412800 10 monclient(hunting): authenticate will time out at 2215.806976s 2024-09-14T11:09:23.449 INFO:tasks.workunit.client.0.smithi050.stderr: -433> 2024-09-14T11:09:23.170+0000 7f1f5fbe0640 10 monclient(hunting): get_auth_request con 0x5586b173c400 auth_method 0 2024-09-14T11:09:23.450 INFO:tasks.workunit.client.0.smithi050.stderr: -432> 2024-09-14T11:09:23.170+0000 7f1f5fbe0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:09:23.450 INFO:tasks.workunit.client.0.smithi050.stderr: -431> 2024-09-14T11:09:23.170+0000 7f1f5fbe0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:09:23.450 INFO:tasks.workunit.client.0.smithi050.stderr: -430> 2024-09-14T11:09:23.170+0000 7f1f5fbe0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:09:23.450 INFO:tasks.workunit.client.0.smithi050.stderr: -429> 2024-09-14T11:09:23.170+0000 7f1f5f3df640 10 monclient(hunting): get_auth_request con 0x5586b1746860 auth_method 0 2024-09-14T11:09:23.450 INFO:tasks.workunit.client.0.smithi050.stderr: -428> 2024-09-14T11:09:23.170+0000 7f1f5f3df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:09:23.450 INFO:tasks.workunit.client.0.smithi050.stderr: -427> 2024-09-14T11:09:23.170+0000 7f1f5f3df640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:09:23.450 INFO:tasks.workunit.client.0.smithi050.stderr: -426> 2024-09-14T11:09:23.170+0000 7f1f5f3df640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:09:23.450 INFO:tasks.workunit.client.0.smithi050.stderr: -425> 2024-09-14T11:09:23.170+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:09:23.450 INFO:tasks.workunit.client.0.smithi050.stderr: -424> 2024-09-14T11:09:23.170+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:09:23.450 INFO:tasks.workunit.client.0.smithi050.stderr: -423> 2024-09-14T11:09:23.170+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:09:23.450 INFO:tasks.workunit.client.0.smithi050.stderr: -422> 2024-09-14T11:09:23.170+0000 7f1f5f3df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:09:23.450 INFO:tasks.workunit.client.0.smithi050.stderr: -421> 2024-09-14T11:09:23.170+0000 7f1f5f3df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:09:23.451 INFO:tasks.workunit.client.0.smithi050.stderr: -420> 2024-09-14T11:09:23.170+0000 7f1f5f3df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:09:23.451 INFO:tasks.workunit.client.0.smithi050.stderr: -419> 2024-09-14T11:09:23.170+0000 7f1f603e1640 10 monclient(hunting): get_auth_request con 0x5586b18c0830 auth_method 0 2024-09-14T11:09:23.451 INFO:tasks.workunit.client.0.smithi050.stderr: -418> 2024-09-14T11:09:23.170+0000 7f1f603e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:09:23.451 INFO:tasks.workunit.client.0.smithi050.stderr: -417> 2024-09-14T11:09:23.170+0000 7f1f603e1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:09:23.451 INFO:tasks.workunit.client.0.smithi050.stderr: -416> 2024-09-14T11:09:23.170+0000 7f1f603e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:09:23.451 INFO:tasks.workunit.client.0.smithi050.stderr: -415> 2024-09-14T11:09:23.170+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_done global_id 6417 payload 824 2024-09-14T11:09:23.451 INFO:tasks.workunit.client.0.smithi050.stderr: -414> 2024-09-14T11:09:23.170+0000 7f1f5fbe0640 10 monclient: _finish_hunting 0 2024-09-14T11:09:23.451 INFO:tasks.workunit.client.0.smithi050.stderr: -413> 2024-09-14T11:09:23.170+0000 7f1f5fbe0640 1 monclient: found mon.noname-a 2024-09-14T11:09:23.451 INFO:tasks.workunit.client.0.smithi050.stderr: -412> 2024-09-14T11:09:23.170+0000 7f1f5fbe0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:09:23.451 INFO:tasks.workunit.client.0.smithi050.stderr: -411> 2024-09-14T11:09:23.170+0000 7f1e47fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:09:23.451 INFO:tasks.workunit.client.0.smithi050.stderr: -410> 2024-09-14T11:09:23.170+0000 7f1e47fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:09:23.451 INFO:tasks.workunit.client.0.smithi050.stderr: -409> 2024-09-14T11:09:23.170+0000 7f1e47fff640 10 monclient: dump: 2024-09-14T11:09:23.451 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:09:23.452 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:09:23.452 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.452 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.452 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:09:23.452 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.452 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:09:23.452 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:09:23.452 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:09:23.452 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.452 INFO:tasks.workunit.client.0.smithi050.stderr: -408> 2024-09-14T11:09:23.170+0000 7f1e47fff640 10 monclient: _finish_auth 0 2024-09-14T11:09:23.452 INFO:tasks.workunit.client.0.smithi050.stderr: -407> 2024-09-14T11:09:23.170+0000 7f1e47fff640 10 monclient: _check_auth_tickets 2024-09-14T11:09:23.452 INFO:tasks.workunit.client.0.smithi050.stderr: -406> 2024-09-14T11:09:23.170+0000 7f1e47fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:09:23.452 INFO:tasks.workunit.client.0.smithi050.stderr: -405> 2024-09-14T11:09:23.170+0000 7f1f64412800 5 monclient: authenticate success, global_id 6417 2024-09-14T11:09:23.453 INFO:tasks.workunit.client.0.smithi050.stderr: -404> 2024-09-14T11:09:23.170+0000 7f1f64412800 10 monclient: _renew_subs 2024-09-14T11:09:23.453 INFO:tasks.workunit.client.0.smithi050.stderr: -403> 2024-09-14T11:09:23.170+0000 7f1f64412800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:09:23.453 INFO:tasks.workunit.client.0.smithi050.stderr: -402> 2024-09-14T11:09:23.170+0000 7f1e47fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:09:23.453 INFO:tasks.workunit.client.0.smithi050.stderr: -401> 2024-09-14T11:09:23.170+0000 7f1e47fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:09:23.453 INFO:tasks.workunit.client.0.smithi050.stderr: -400> 2024-09-14T11:09:23.170+0000 7f1e47fff640 10 monclient: dump: 2024-09-14T11:09:23.453 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:09:23.453 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:09:23.453 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.453 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.453 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:09:23.453 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.454 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:09:23.454 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:09:23.454 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:09:23.454 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.454 INFO:tasks.workunit.client.0.smithi050.stderr: -399> 2024-09-14T11:09:23.170+0000 7f1e4de0b640 4 set_mon_vals no callback set 2024-09-14T11:09:23.454 INFO:tasks.workunit.client.0.smithi050.stderr: -398> 2024-09-14T11:09:23.170+0000 7f1f64412800 10 monclient: _renew_subs 2024-09-14T11:09:23.454 INFO:tasks.workunit.client.0.smithi050.stderr: -397> 2024-09-14T11:09:23.170+0000 7f1f64412800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:09:23.454 INFO:tasks.workunit.client.0.smithi050.stderr: -396> 2024-09-14T11:09:23.170+0000 7f1f64412800 1 librados: init done 2024-09-14T11:09:23.454 INFO:tasks.workunit.client.0.smithi050.stderr: -395> 2024-09-14T11:09:23.172+0000 7f1e47fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:09:23.454 INFO:tasks.workunit.client.0.smithi050.stderr: -394> 2024-09-14T11:09:23.172+0000 7f1e47fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:09:23.454 INFO:tasks.workunit.client.0.smithi050.stderr: -393> 2024-09-14T11:09:23.172+0000 7f1e47fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:09:23.454 INFO:tasks.workunit.client.0.smithi050.stderr: -392> 2024-09-14T11:09:23.173+0000 7f1f5f3df640 10 monclient: get_auth_request con 0x7f1e48077230 auth_method 0 2024-09-14T11:09:23.454 INFO:tasks.workunit.client.0.smithi050.stderr: -391> 2024-09-14T11:09:23.173+0000 7f1f603e1640 10 monclient: get_auth_request con 0x5586b18d7710 auth_method 0 2024-09-14T11:09:23.455 INFO:tasks.workunit.client.0.smithi050.stderr: -390> 2024-09-14T11:09:23.174+0000 7f1f5fbe0640 10 monclient: get_auth_request con 0x5586b18da8f0 auth_method 0 2024-09-14T11:09:23.455 INFO:tasks.workunit.client.0.smithi050.stderr: -389> 2024-09-14T11:09:23.174+0000 7f1f5f3df640 10 monclient: get_auth_request con 0x5586b18deb70 auth_method 0 2024-09-14T11:09:23.455 INFO:tasks.workunit.client.0.smithi050.stderr: -388> 2024-09-14T11:09:23.176+0000 7f1f64412800 10 monclient: build_initial_monmap 2024-09-14T11:09:23.455 INFO:tasks.workunit.client.0.smithi050.stderr: -387> 2024-09-14T11:09:23.176+0000 7f1f64412800 1 build_initial for_mkfs: 0 2024-09-14T11:09:23.455 INFO:tasks.workunit.client.0.smithi050.stderr: -386> 2024-09-14T11:09:23.176+0000 7f1f64412800 10 monclient: monmap: 2024-09-14T11:09:23.455 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:09:23.455 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:09:23.455 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:09:23.455 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:09:23.455 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:09:23.455 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.455 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:09:23.455 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:09:23.456 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:09:23.456 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.456 INFO:tasks.workunit.client.0.smithi050.stderr: -385> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding auth protocol: cephx 2024-09-14T11:09:23.456 INFO:tasks.workunit.client.0.smithi050.stderr: -384> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding auth protocol: cephx 2024-09-14T11:09:23.456 INFO:tasks.workunit.client.0.smithi050.stderr: -383> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding auth protocol: cephx 2024-09-14T11:09:23.456 INFO:tasks.workunit.client.0.smithi050.stderr: -382> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding con mode: secure 2024-09-14T11:09:23.456 INFO:tasks.workunit.client.0.smithi050.stderr: -381> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding con mode: crc 2024-09-14T11:09:23.456 INFO:tasks.workunit.client.0.smithi050.stderr: -380> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding con mode: secure 2024-09-14T11:09:23.456 INFO:tasks.workunit.client.0.smithi050.stderr: -379> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding con mode: crc 2024-09-14T11:09:23.456 INFO:tasks.workunit.client.0.smithi050.stderr: -378> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding con mode: secure 2024-09-14T11:09:23.456 INFO:tasks.workunit.client.0.smithi050.stderr: -377> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding con mode: crc 2024-09-14T11:09:23.456 INFO:tasks.workunit.client.0.smithi050.stderr: -376> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding con mode: crc 2024-09-14T11:09:23.456 INFO:tasks.workunit.client.0.smithi050.stderr: -375> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding con mode: secure 2024-09-14T11:09:23.457 INFO:tasks.workunit.client.0.smithi050.stderr: -374> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding con mode: crc 2024-09-14T11:09:23.457 INFO:tasks.workunit.client.0.smithi050.stderr: -373> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding con mode: secure 2024-09-14T11:09:23.457 INFO:tasks.workunit.client.0.smithi050.stderr: -372> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding con mode: crc 2024-09-14T11:09:23.457 INFO:tasks.workunit.client.0.smithi050.stderr: -371> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding con mode: secure 2024-09-14T11:09:23.457 INFO:tasks.workunit.client.0.smithi050.stderr: -370> 2024-09-14T11:09:23.176+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.457 INFO:tasks.workunit.client.0.smithi050.stderr: -369> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 asok(0x5586b166e270) register_command objecter_requests cmddesc objecter_requests hook 0x5586b18e6f20 EEXIST 2024-09-14T11:09:23.457 INFO:tasks.workunit.client.0.smithi050.stderr: -368> 2024-09-14T11:09:23.176+0000 7f1f64412800 10 monclient: init 2024-09-14T11:09:23.457 INFO:tasks.workunit.client.0.smithi050.stderr: -367> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding auth protocol: cephx 2024-09-14T11:09:23.457 INFO:tasks.workunit.client.0.smithi050.stderr: -366> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding auth protocol: cephx 2024-09-14T11:09:23.457 INFO:tasks.workunit.client.0.smithi050.stderr: -365> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding auth protocol: cephx 2024-09-14T11:09:23.457 INFO:tasks.workunit.client.0.smithi050.stderr: -364> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding con mode: secure 2024-09-14T11:09:23.457 INFO:tasks.workunit.client.0.smithi050.stderr: -363> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding con mode: crc 2024-09-14T11:09:23.457 INFO:tasks.workunit.client.0.smithi050.stderr: -362> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding con mode: secure 2024-09-14T11:09:23.458 INFO:tasks.workunit.client.0.smithi050.stderr: -361> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding con mode: crc 2024-09-14T11:09:23.458 INFO:tasks.workunit.client.0.smithi050.stderr: -360> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding con mode: secure 2024-09-14T11:09:23.458 INFO:tasks.workunit.client.0.smithi050.stderr: -359> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding con mode: crc 2024-09-14T11:09:23.458 INFO:tasks.workunit.client.0.smithi050.stderr: -358> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding con mode: crc 2024-09-14T11:09:23.458 INFO:tasks.workunit.client.0.smithi050.stderr: -357> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding con mode: secure 2024-09-14T11:09:23.458 INFO:tasks.workunit.client.0.smithi050.stderr: -356> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding con mode: crc 2024-09-14T11:09:23.458 INFO:tasks.workunit.client.0.smithi050.stderr: -355> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding con mode: secure 2024-09-14T11:09:23.458 INFO:tasks.workunit.client.0.smithi050.stderr: -354> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding con mode: crc 2024-09-14T11:09:23.458 INFO:tasks.workunit.client.0.smithi050.stderr: -353> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding con mode: secure 2024-09-14T11:09:23.458 INFO:tasks.workunit.client.0.smithi050.stderr: -352> 2024-09-14T11:09:23.177+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.458 INFO:tasks.workunit.client.0.smithi050.stderr: -351> 2024-09-14T11:09:23.177+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.458 INFO:tasks.workunit.client.0.smithi050.stderr: -350> 2024-09-14T11:09:23.177+0000 7f1f64412800 5 asok(0x5586b166e270) register_command rotate-key cmddesc rotate-key hook 0x5586b18e2220 EEXIST 2024-09-14T11:09:23.458 INFO:tasks.workunit.client.0.smithi050.stderr: -349> 2024-09-14T11:09:23.177+0000 7f1f64412800 10 monclient: _reopen_session rank -1 2024-09-14T11:09:23.459 INFO:tasks.workunit.client.0.smithi050.stderr: -348> 2024-09-14T11:09:23.177+0000 7f1f64412800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:09:23.459 INFO:tasks.workunit.client.0.smithi050.stderr: -347> 2024-09-14T11:09:23.177+0000 7f1f64412800 10 monclient(hunting): picked mon.noname-a con 0x5586b190b240 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:09:23.459 INFO:tasks.workunit.client.0.smithi050.stderr: -346> 2024-09-14T11:09:23.177+0000 7f1f64412800 10 monclient(hunting): picked mon.noname-b con 0x5586b190b620 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:09:23.459 INFO:tasks.workunit.client.0.smithi050.stderr: -345> 2024-09-14T11:09:23.177+0000 7f1f64412800 10 monclient(hunting): picked mon.noname-c con 0x5586b1909f50 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:09:23.459 INFO:tasks.workunit.client.0.smithi050.stderr: -344> 2024-09-14T11:09:23.177+0000 7f1f64412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:09:23.459 INFO:tasks.workunit.client.0.smithi050.stderr: -343> 2024-09-14T11:09:23.177+0000 7f1f64412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:09:23.459 INFO:tasks.workunit.client.0.smithi050.stderr: -342> 2024-09-14T11:09:23.177+0000 7f1f64412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:09:23.459 INFO:tasks.workunit.client.0.smithi050.stderr: -341> 2024-09-14T11:09:23.177+0000 7f1f64412800 10 monclient(hunting): _renew_subs 2024-09-14T11:09:23.459 INFO:tasks.workunit.client.0.smithi050.stderr: -340> 2024-09-14T11:09:23.177+0000 7f1f64412800 10 monclient(hunting): authenticate will time out at 2215.814447s 2024-09-14T11:09:23.459 INFO:tasks.workunit.client.0.smithi050.stderr: -339> 2024-09-14T11:09:23.177+0000 7f1f603e1640 10 monclient(hunting): get_auth_request con 0x5586b1909f50 auth_method 0 2024-09-14T11:09:23.459 INFO:tasks.workunit.client.0.smithi050.stderr: -338> 2024-09-14T11:09:23.177+0000 7f1f603e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:09:23.459 INFO:tasks.workunit.client.0.smithi050.stderr: -337> 2024-09-14T11:09:23.177+0000 7f1f603e1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:09:23.459 INFO:tasks.workunit.client.0.smithi050.stderr: -336> 2024-09-14T11:09:23.177+0000 7f1f603e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:09:23.459 INFO:tasks.workunit.client.0.smithi050.stderr: -335> 2024-09-14T11:09:23.177+0000 7f1f5fbe0640 10 monclient(hunting): get_auth_request con 0x5586b190b240 auth_method 0 2024-09-14T11:09:23.460 INFO:tasks.workunit.client.0.smithi050.stderr: -334> 2024-09-14T11:09:23.177+0000 7f1f5fbe0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:09:23.460 INFO:tasks.workunit.client.0.smithi050.stderr: -333> 2024-09-14T11:09:23.177+0000 7f1f5fbe0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:09:23.460 INFO:tasks.workunit.client.0.smithi050.stderr: -332> 2024-09-14T11:09:23.177+0000 7f1f5fbe0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:09:23.460 INFO:tasks.workunit.client.0.smithi050.stderr: -331> 2024-09-14T11:09:23.177+0000 7f1f5f3df640 10 monclient(hunting): get_auth_request con 0x5586b190b620 auth_method 0 2024-09-14T11:09:23.460 INFO:tasks.workunit.client.0.smithi050.stderr: -330> 2024-09-14T11:09:23.177+0000 7f1f5f3df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:09:23.460 INFO:tasks.workunit.client.0.smithi050.stderr: -329> 2024-09-14T11:09:23.177+0000 7f1f5f3df640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:09:23.460 INFO:tasks.workunit.client.0.smithi050.stderr: -328> 2024-09-14T11:09:23.177+0000 7f1f5f3df640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:09:23.460 INFO:tasks.workunit.client.0.smithi050.stderr: -327> 2024-09-14T11:09:23.177+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:09:23.460 INFO:tasks.workunit.client.0.smithi050.stderr: -326> 2024-09-14T11:09:23.177+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:09:23.460 INFO:tasks.workunit.client.0.smithi050.stderr: -325> 2024-09-14T11:09:23.177+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:09:23.460 INFO:tasks.workunit.client.0.smithi050.stderr: -324> 2024-09-14T11:09:23.177+0000 7f1f603e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:09:23.460 INFO:tasks.workunit.client.0.smithi050.stderr: -323> 2024-09-14T11:09:23.177+0000 7f1f603e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:09:23.460 INFO:tasks.workunit.client.0.smithi050.stderr: -322> 2024-09-14T11:09:23.177+0000 7f1f603e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:09:23.461 INFO:tasks.workunit.client.0.smithi050.stderr: -321> 2024-09-14T11:09:23.177+0000 7f1f5f3df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:09:23.461 INFO:tasks.workunit.client.0.smithi050.stderr: -320> 2024-09-14T11:09:23.177+0000 7f1f5f3df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:09:23.461 INFO:tasks.workunit.client.0.smithi050.stderr: -319> 2024-09-14T11:09:23.177+0000 7f1f5f3df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:09:23.461 INFO:tasks.workunit.client.0.smithi050.stderr: -318> 2024-09-14T11:09:23.177+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_done global_id 6420 payload 824 2024-09-14T11:09:23.461 INFO:tasks.workunit.client.0.smithi050.stderr: -317> 2024-09-14T11:09:23.177+0000 7f1f5fbe0640 10 monclient: _finish_hunting 0 2024-09-14T11:09:23.461 INFO:tasks.workunit.client.0.smithi050.stderr: -316> 2024-09-14T11:09:23.177+0000 7f1f5fbe0640 1 monclient: found mon.noname-a 2024-09-14T11:09:23.461 INFO:tasks.workunit.client.0.smithi050.stderr: -315> 2024-09-14T11:09:23.177+0000 7f1f5fbe0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:09:23.461 INFO:tasks.workunit.client.0.smithi050.stderr: -314> 2024-09-14T11:09:23.178+0000 7f1e457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:09:23.461 INFO:tasks.workunit.client.0.smithi050.stderr: -313> 2024-09-14T11:09:23.178+0000 7f1e457fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:09:23.461 INFO:tasks.workunit.client.0.smithi050.stderr: -312> 2024-09-14T11:09:23.178+0000 7f1e457fa640 10 monclient: dump: 2024-09-14T11:09:23.461 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:09:23.461 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:09:23.462 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.462 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.462 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:09:23.462 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.462 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:09:23.462 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:09:23.462 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:09:23.462 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.462 INFO:tasks.workunit.client.0.smithi050.stderr: -311> 2024-09-14T11:09:23.178+0000 7f1e457fa640 10 monclient: _finish_auth 0 2024-09-14T11:09:23.462 INFO:tasks.workunit.client.0.smithi050.stderr: -310> 2024-09-14T11:09:23.178+0000 7f1e457fa640 10 monclient: _check_auth_tickets 2024-09-14T11:09:23.462 INFO:tasks.workunit.client.0.smithi050.stderr: -309> 2024-09-14T11:09:23.178+0000 7f1e457fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:09:23.462 INFO:tasks.workunit.client.0.smithi050.stderr: -308> 2024-09-14T11:09:23.178+0000 7f1e457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:09:23.462 INFO:tasks.workunit.client.0.smithi050.stderr: -307> 2024-09-14T11:09:23.178+0000 7f1e457fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:09:23.462 INFO:tasks.workunit.client.0.smithi050.stderr: -306> 2024-09-14T11:09:23.178+0000 7f1e457fa640 10 monclient: dump: 2024-09-14T11:09:23.463 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:09:23.463 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:09:23.463 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.463 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.463 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:09:23.463 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.463 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:09:23.463 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:09:23.463 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:09:23.463 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.463 INFO:tasks.workunit.client.0.smithi050.stderr: -305> 2024-09-14T11:09:23.178+0000 7f1f64412800 5 monclient: authenticate success, global_id 6420 2024-09-14T11:09:23.463 INFO:tasks.workunit.client.0.smithi050.stderr: -304> 2024-09-14T11:09:23.178+0000 7f1f64412800 10 monclient: _renew_subs 2024-09-14T11:09:23.463 INFO:tasks.workunit.client.0.smithi050.stderr: -303> 2024-09-14T11:09:23.178+0000 7f1f64412800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:09:23.463 INFO:tasks.workunit.client.0.smithi050.stderr: -302> 2024-09-14T11:09:23.178+0000 7f1f60be2640 4 set_mon_vals no callback set 2024-09-14T11:09:23.464 INFO:tasks.workunit.client.0.smithi050.stderr: -301> 2024-09-14T11:09:23.178+0000 7f1f64412800 10 monclient: _renew_subs 2024-09-14T11:09:23.464 INFO:tasks.workunit.client.0.smithi050.stderr: -300> 2024-09-14T11:09:23.178+0000 7f1f64412800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:09:23.464 INFO:tasks.workunit.client.0.smithi050.stderr: -299> 2024-09-14T11:09:23.180+0000 7f1e457fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:09:23.464 INFO:tasks.workunit.client.0.smithi050.stderr: -298> 2024-09-14T11:09:23.180+0000 7f1e457fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:09:23.464 INFO:tasks.workunit.client.0.smithi050.stderr: -297> 2024-09-14T11:09:23.180+0000 7f1e457fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:09:23.464 INFO:tasks.workunit.client.0.smithi050.stderr: -296> 2024-09-14T11:09:23.180+0000 7f1f5f3df640 10 monclient: get_auth_request con 0x7f1e38077140 auth_method 0 2024-09-14T11:09:23.464 INFO:tasks.workunit.client.0.smithi050.stderr: -295> 2024-09-14T11:09:23.180+0000 7f1f64412800 10 monclient: get_monmap_and_config 2024-09-14T11:09:23.464 INFO:tasks.workunit.client.0.smithi050.stderr: -294> 2024-09-14T11:09:23.180+0000 7f1f64412800 10 monclient: build_initial_monmap 2024-09-14T11:09:23.464 INFO:tasks.workunit.client.0.smithi050.stderr: -293> 2024-09-14T11:09:23.180+0000 7f1f64412800 1 build_initial for_mkfs: 0 2024-09-14T11:09:23.464 INFO:tasks.workunit.client.0.smithi050.stderr: -292> 2024-09-14T11:09:23.180+0000 7f1f64412800 10 monclient: monmap: 2024-09-14T11:09:23.464 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:09:23.464 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:09:23.465 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:09:23.465 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:09:23.465 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:09:23.465 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.465 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:09:23.465 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:09:23.465 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:09:23.465 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.465 INFO:tasks.workunit.client.0.smithi050.stderr: -291> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding auth protocol: cephx 2024-09-14T11:09:23.465 INFO:tasks.workunit.client.0.smithi050.stderr: -290> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding auth protocol: cephx 2024-09-14T11:09:23.465 INFO:tasks.workunit.client.0.smithi050.stderr: -289> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding auth protocol: cephx 2024-09-14T11:09:23.465 INFO:tasks.workunit.client.0.smithi050.stderr: -288> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding con mode: secure 2024-09-14T11:09:23.465 INFO:tasks.workunit.client.0.smithi050.stderr: -287> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding con mode: crc 2024-09-14T11:09:23.466 INFO:tasks.workunit.client.0.smithi050.stderr: -286> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding con mode: secure 2024-09-14T11:09:23.466 INFO:tasks.workunit.client.0.smithi050.stderr: -285> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding con mode: crc 2024-09-14T11:09:23.466 INFO:tasks.workunit.client.0.smithi050.stderr: -284> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding con mode: secure 2024-09-14T11:09:23.466 INFO:tasks.workunit.client.0.smithi050.stderr: -283> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding con mode: crc 2024-09-14T11:09:23.466 INFO:tasks.workunit.client.0.smithi050.stderr: -282> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding con mode: crc 2024-09-14T11:09:23.466 INFO:tasks.workunit.client.0.smithi050.stderr: -281> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding con mode: secure 2024-09-14T11:09:23.466 INFO:tasks.workunit.client.0.smithi050.stderr: -280> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding con mode: crc 2024-09-14T11:09:23.466 INFO:tasks.workunit.client.0.smithi050.stderr: -279> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding con mode: secure 2024-09-14T11:09:23.466 INFO:tasks.workunit.client.0.smithi050.stderr: -278> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding con mode: crc 2024-09-14T11:09:23.466 INFO:tasks.workunit.client.0.smithi050.stderr: -277> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding con mode: secure 2024-09-14T11:09:23.466 INFO:tasks.workunit.client.0.smithi050.stderr: -276> 2024-09-14T11:09:23.180+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.466 INFO:tasks.workunit.client.0.smithi050.stderr: -275> 2024-09-14T11:09:23.181+0000 7f1f64412800 10 monclient: init 2024-09-14T11:09:23.466 INFO:tasks.workunit.client.0.smithi050.stderr: -274> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding auth protocol: cephx 2024-09-14T11:09:23.467 INFO:tasks.workunit.client.0.smithi050.stderr: -273> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding auth protocol: cephx 2024-09-14T11:09:23.467 INFO:tasks.workunit.client.0.smithi050.stderr: -272> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding auth protocol: cephx 2024-09-14T11:09:23.467 INFO:tasks.workunit.client.0.smithi050.stderr: -271> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding con mode: secure 2024-09-14T11:09:23.467 INFO:tasks.workunit.client.0.smithi050.stderr: -270> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding con mode: crc 2024-09-14T11:09:23.467 INFO:tasks.workunit.client.0.smithi050.stderr: -269> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding con mode: secure 2024-09-14T11:09:23.467 INFO:tasks.workunit.client.0.smithi050.stderr: -268> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding con mode: crc 2024-09-14T11:09:23.467 INFO:tasks.workunit.client.0.smithi050.stderr: -267> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding con mode: secure 2024-09-14T11:09:23.467 INFO:tasks.workunit.client.0.smithi050.stderr: -266> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding con mode: crc 2024-09-14T11:09:23.467 INFO:tasks.workunit.client.0.smithi050.stderr: -265> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding con mode: crc 2024-09-14T11:09:23.467 INFO:tasks.workunit.client.0.smithi050.stderr: -264> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding con mode: secure 2024-09-14T11:09:23.467 INFO:tasks.workunit.client.0.smithi050.stderr: -263> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding con mode: crc 2024-09-14T11:09:23.467 INFO:tasks.workunit.client.0.smithi050.stderr: -262> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding con mode: secure 2024-09-14T11:09:23.467 INFO:tasks.workunit.client.0.smithi050.stderr: -261> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding con mode: crc 2024-09-14T11:09:23.467 INFO:tasks.workunit.client.0.smithi050.stderr: -260> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding con mode: secure 2024-09-14T11:09:23.468 INFO:tasks.workunit.client.0.smithi050.stderr: -259> 2024-09-14T11:09:23.181+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.468 INFO:tasks.workunit.client.0.smithi050.stderr: -258> 2024-09-14T11:09:23.181+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.468 INFO:tasks.workunit.client.0.smithi050.stderr: -257> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 asok(0x5586b166e270) register_command rotate-key cmddesc rotate-key hook 0x7fff771bab28 EEXIST 2024-09-14T11:09:23.468 INFO:tasks.workunit.client.0.smithi050.stderr: -256> 2024-09-14T11:09:23.181+0000 7f1f64412800 10 monclient: _reopen_session rank -1 2024-09-14T11:09:23.468 INFO:tasks.workunit.client.0.smithi050.stderr: -255> 2024-09-14T11:09:23.181+0000 7f1f64412800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:09:23.468 INFO:tasks.workunit.client.0.smithi050.stderr: -254> 2024-09-14T11:09:23.181+0000 7f1f64412800 10 monclient(hunting): picked mon.noname-b con 0x5586b195f470 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:09:23.468 INFO:tasks.workunit.client.0.smithi050.stderr: -253> 2024-09-14T11:09:23.181+0000 7f1f64412800 10 monclient(hunting): picked mon.noname-a con 0x5586b194fdc0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:09:23.468 INFO:tasks.workunit.client.0.smithi050.stderr: -252> 2024-09-14T11:09:23.181+0000 7f1f64412800 10 monclient(hunting): picked mon.noname-c con 0x5586b195a8a0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:09:23.468 INFO:tasks.workunit.client.0.smithi050.stderr: -251> 2024-09-14T11:09:23.181+0000 7f1f64412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:09:23.468 INFO:tasks.workunit.client.0.smithi050.stderr: -250> 2024-09-14T11:09:23.181+0000 7f1f64412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:09:23.468 INFO:tasks.workunit.client.0.smithi050.stderr: -249> 2024-09-14T11:09:23.181+0000 7f1f64412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:09:23.468 INFO:tasks.workunit.client.0.smithi050.stderr: -248> 2024-09-14T11:09:23.181+0000 7f1f64412800 10 monclient(hunting): _renew_subs 2024-09-14T11:09:23.468 INFO:tasks.workunit.client.0.smithi050.stderr: -247> 2024-09-14T11:09:23.181+0000 7f1f64412800 10 monclient(hunting): authenticate will time out at 2215.818672s 2024-09-14T11:09:23.469 INFO:tasks.workunit.client.0.smithi050.stderr: -246> 2024-09-14T11:09:23.181+0000 7f1f5f3df640 10 monclient(hunting): get_auth_request con 0x5586b194fdc0 auth_method 0 2024-09-14T11:09:23.469 INFO:tasks.workunit.client.0.smithi050.stderr: -245> 2024-09-14T11:09:23.181+0000 7f1f5f3df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:09:23.469 INFO:tasks.workunit.client.0.smithi050.stderr: -244> 2024-09-14T11:09:23.181+0000 7f1f5f3df640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:09:23.469 INFO:tasks.workunit.client.0.smithi050.stderr: -243> 2024-09-14T11:09:23.181+0000 7f1f5f3df640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:09:23.469 INFO:tasks.workunit.client.0.smithi050.stderr: -242> 2024-09-14T11:09:23.181+0000 7f1f603e1640 10 monclient(hunting): get_auth_request con 0x5586b195a8a0 auth_method 0 2024-09-14T11:09:23.469 INFO:tasks.workunit.client.0.smithi050.stderr: -241> 2024-09-14T11:09:23.181+0000 7f1f603e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:09:23.469 INFO:tasks.workunit.client.0.smithi050.stderr: -240> 2024-09-14T11:09:23.181+0000 7f1f603e1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:09:23.469 INFO:tasks.workunit.client.0.smithi050.stderr: -239> 2024-09-14T11:09:23.181+0000 7f1f603e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:09:23.469 INFO:tasks.workunit.client.0.smithi050.stderr: -238> 2024-09-14T11:09:23.181+0000 7f1f603e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:09:23.469 INFO:tasks.workunit.client.0.smithi050.stderr: -237> 2024-09-14T11:09:23.181+0000 7f1f603e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:09:23.469 INFO:tasks.workunit.client.0.smithi050.stderr: -236> 2024-09-14T11:09:23.181+0000 7f1f603e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:09:23.469 INFO:tasks.workunit.client.0.smithi050.stderr: -235> 2024-09-14T11:09:23.181+0000 7f1f5f3df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:09:23.470 INFO:tasks.workunit.client.0.smithi050.stderr: -234> 2024-09-14T11:09:23.181+0000 7f1f5f3df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:09:23.470 INFO:tasks.workunit.client.0.smithi050.stderr: -233> 2024-09-14T11:09:23.181+0000 7f1f5f3df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:09:23.470 INFO:tasks.workunit.client.0.smithi050.stderr: -232> 2024-09-14T11:09:23.181+0000 7f1f5fbe0640 10 monclient(hunting): get_auth_request con 0x5586b195f470 auth_method 0 2024-09-14T11:09:23.470 INFO:tasks.workunit.client.0.smithi050.stderr: -231> 2024-09-14T11:09:23.181+0000 7f1f5fbe0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:09:23.470 INFO:tasks.workunit.client.0.smithi050.stderr: -230> 2024-09-14T11:09:23.181+0000 7f1f5fbe0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:09:23.470 INFO:tasks.workunit.client.0.smithi050.stderr: -229> 2024-09-14T11:09:23.181+0000 7f1f5fbe0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:09:23.470 INFO:tasks.workunit.client.0.smithi050.stderr: -228> 2024-09-14T11:09:23.182+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:09:23.470 INFO:tasks.workunit.client.0.smithi050.stderr: -227> 2024-09-14T11:09:23.182+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:09:23.470 INFO:tasks.workunit.client.0.smithi050.stderr: -226> 2024-09-14T11:09:23.182+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:09:23.470 INFO:tasks.workunit.client.0.smithi050.stderr: -225> 2024-09-14T11:09:23.182+0000 7f1f603e1640 10 monclient(hunting): handle_auth_done global_id 6053 payload 274 2024-09-14T11:09:23.470 INFO:tasks.workunit.client.0.smithi050.stderr: -224> 2024-09-14T11:09:23.182+0000 7f1f603e1640 10 monclient: _finish_hunting 0 2024-09-14T11:09:23.470 INFO:tasks.workunit.client.0.smithi050.stderr: -223> 2024-09-14T11:09:23.182+0000 7f1f603e1640 1 monclient: found mon.noname-c 2024-09-14T11:09:23.471 INFO:tasks.workunit.client.0.smithi050.stderr: -222> 2024-09-14T11:09:23.182+0000 7f1f603e1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:09:23.471 INFO:tasks.workunit.client.0.smithi050.stderr: -221> 2024-09-14T11:09:23.182+0000 7f1e3effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:09:23.471 INFO:tasks.workunit.client.0.smithi050.stderr: -220> 2024-09-14T11:09:23.182+0000 7f1e3effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:09:23.471 INFO:tasks.workunit.client.0.smithi050.stderr: -219> 2024-09-14T11:09:23.182+0000 7f1e3effd640 10 monclient: dump: 2024-09-14T11:09:23.471 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:09:23.471 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:09:23.471 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.471 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.471 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:09:23.471 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.471 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:09:23.471 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:09:23.471 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:09:23.472 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.472 INFO:tasks.workunit.client.0.smithi050.stderr: -218> 2024-09-14T11:09:23.182+0000 7f1e3effd640 10 monclient: _finish_auth 0 2024-09-14T11:09:23.472 INFO:tasks.workunit.client.0.smithi050.stderr: -217> 2024-09-14T11:09:23.182+0000 7f1e3effd640 10 monclient: _check_auth_tickets 2024-09-14T11:09:23.472 INFO:tasks.workunit.client.0.smithi050.stderr: -216> 2024-09-14T11:09:23.182+0000 7f1e3effd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:09:23.472 INFO:tasks.workunit.client.0.smithi050.stderr: -215> 2024-09-14T11:09:23.182+0000 7f1e3effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:09:23.472 INFO:tasks.workunit.client.0.smithi050.stderr: -214> 2024-09-14T11:09:23.182+0000 7f1e3effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:09:23.472 INFO:tasks.workunit.client.0.smithi050.stderr: -213> 2024-09-14T11:09:23.182+0000 7f1e3effd640 10 monclient: dump: 2024-09-14T11:09:23.472 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:09:23.472 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:09:23.472 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.472 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.472 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:09:23.473 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.473 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:09:23.473 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:09:23.473 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:09:23.473 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.473 INFO:tasks.workunit.client.0.smithi050.stderr: -212> 2024-09-14T11:09:23.182+0000 7f1f64412800 5 monclient: authenticate success, global_id 6053 2024-09-14T11:09:23.473 INFO:tasks.workunit.client.0.smithi050.stderr: -211> 2024-09-14T11:09:23.182+0000 7f1f64412800 10 monclient: get_monmap_and_config success 2024-09-14T11:09:23.473 INFO:tasks.workunit.client.0.smithi050.stderr: -210> 2024-09-14T11:09:23.182+0000 7f1f64412800 4 set_mon_vals no callback set 2024-09-14T11:09:23.473 INFO:tasks.workunit.client.0.smithi050.stderr: -209> 2024-09-14T11:09:23.183+0000 7f1f64412800 10 monclient: shutdown 2024-09-14T11:09:23.473 INFO:tasks.workunit.client.0.smithi050.stderr: -208> 2024-09-14T11:09:23.183+0000 7f1f64412800 10 monclient: build_initial_monmap 2024-09-14T11:09:23.473 INFO:tasks.workunit.client.0.smithi050.stderr: -207> 2024-09-14T11:09:23.183+0000 7f1f64412800 1 build_initial for_mkfs: 0 2024-09-14T11:09:23.473 INFO:tasks.workunit.client.0.smithi050.stderr: -206> 2024-09-14T11:09:23.183+0000 7f1f64412800 10 monclient: monmap: 2024-09-14T11:09:23.473 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:09:23.474 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:09:23.474 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:09:23.474 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:09:23.474 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:09:23.474 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.474 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:09:23.474 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:09:23.474 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:09:23.474 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.474 INFO:tasks.workunit.client.0.smithi050.stderr: -205> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding auth protocol: cephx 2024-09-14T11:09:23.474 INFO:tasks.workunit.client.0.smithi050.stderr: -204> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding auth protocol: cephx 2024-09-14T11:09:23.474 INFO:tasks.workunit.client.0.smithi050.stderr: -203> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding auth protocol: cephx 2024-09-14T11:09:23.474 INFO:tasks.workunit.client.0.smithi050.stderr: -202> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding con mode: secure 2024-09-14T11:09:23.475 INFO:tasks.workunit.client.0.smithi050.stderr: -201> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding con mode: crc 2024-09-14T11:09:23.475 INFO:tasks.workunit.client.0.smithi050.stderr: -200> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding con mode: secure 2024-09-14T11:09:23.475 INFO:tasks.workunit.client.0.smithi050.stderr: -199> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding con mode: crc 2024-09-14T11:09:23.475 INFO:tasks.workunit.client.0.smithi050.stderr: -198> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding con mode: secure 2024-09-14T11:09:23.475 INFO:tasks.workunit.client.0.smithi050.stderr: -197> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding con mode: crc 2024-09-14T11:09:23.475 INFO:tasks.workunit.client.0.smithi050.stderr: -196> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding con mode: crc 2024-09-14T11:09:23.475 INFO:tasks.workunit.client.0.smithi050.stderr: -195> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding con mode: secure 2024-09-14T11:09:23.475 INFO:tasks.workunit.client.0.smithi050.stderr: -194> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding con mode: crc 2024-09-14T11:09:23.475 INFO:tasks.workunit.client.0.smithi050.stderr: -193> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding con mode: secure 2024-09-14T11:09:23.475 INFO:tasks.workunit.client.0.smithi050.stderr: -192> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding con mode: crc 2024-09-14T11:09:23.475 INFO:tasks.workunit.client.0.smithi050.stderr: -191> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding con mode: secure 2024-09-14T11:09:23.475 INFO:tasks.workunit.client.0.smithi050.stderr: -190> 2024-09-14T11:09:23.183+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.475 INFO:tasks.workunit.client.0.smithi050.stderr: -189> 2024-09-14T11:09:23.183+0000 7f1f64412800 1 librados: starting msgr at 2024-09-14T11:09:23.475 INFO:tasks.workunit.client.0.smithi050.stderr: -188> 2024-09-14T11:09:23.183+0000 7f1f64412800 1 librados: starting objecter 2024-09-14T11:09:23.476 INFO:tasks.workunit.client.0.smithi050.stderr: -187> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 asok(0x5586b166e270) register_command objecter_requests cmddesc objecter_requests hook 0x5586b19592c0 EEXIST 2024-09-14T11:09:23.476 INFO:tasks.workunit.client.0.smithi050.stderr: -186> 2024-09-14T11:09:23.183+0000 7f1f64412800 1 librados: setting wanted keys 2024-09-14T11:09:23.476 INFO:tasks.workunit.client.0.smithi050.stderr: -185> 2024-09-14T11:09:23.183+0000 7f1f64412800 1 librados: calling monclient init 2024-09-14T11:09:23.476 INFO:tasks.workunit.client.0.smithi050.stderr: -184> 2024-09-14T11:09:23.183+0000 7f1f64412800 10 monclient: init 2024-09-14T11:09:23.476 INFO:tasks.workunit.client.0.smithi050.stderr: -183> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding auth protocol: cephx 2024-09-14T11:09:23.476 INFO:tasks.workunit.client.0.smithi050.stderr: -182> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding auth protocol: cephx 2024-09-14T11:09:23.476 INFO:tasks.workunit.client.0.smithi050.stderr: -181> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding auth protocol: cephx 2024-09-14T11:09:23.476 INFO:tasks.workunit.client.0.smithi050.stderr: -180> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding con mode: secure 2024-09-14T11:09:23.476 INFO:tasks.workunit.client.0.smithi050.stderr: -179> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding con mode: crc 2024-09-14T11:09:23.476 INFO:tasks.workunit.client.0.smithi050.stderr: -178> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding con mode: secure 2024-09-14T11:09:23.476 INFO:tasks.workunit.client.0.smithi050.stderr: -177> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding con mode: crc 2024-09-14T11:09:23.476 INFO:tasks.workunit.client.0.smithi050.stderr: -176> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding con mode: secure 2024-09-14T11:09:23.477 INFO:tasks.workunit.client.0.smithi050.stderr: -175> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding con mode: crc 2024-09-14T11:09:23.477 INFO:tasks.workunit.client.0.smithi050.stderr: -174> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding con mode: crc 2024-09-14T11:09:23.477 INFO:tasks.workunit.client.0.smithi050.stderr: -173> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding con mode: secure 2024-09-14T11:09:23.477 INFO:tasks.workunit.client.0.smithi050.stderr: -172> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding con mode: crc 2024-09-14T11:09:23.477 INFO:tasks.workunit.client.0.smithi050.stderr: -171> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding con mode: secure 2024-09-14T11:09:23.477 INFO:tasks.workunit.client.0.smithi050.stderr: -170> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding con mode: crc 2024-09-14T11:09:23.477 INFO:tasks.workunit.client.0.smithi050.stderr: -169> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding con mode: secure 2024-09-14T11:09:23.477 INFO:tasks.workunit.client.0.smithi050.stderr: -168> 2024-09-14T11:09:23.183+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.477 INFO:tasks.workunit.client.0.smithi050.stderr: -167> 2024-09-14T11:09:23.184+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.477 INFO:tasks.workunit.client.0.smithi050.stderr: -166> 2024-09-14T11:09:23.184+0000 7f1f64412800 5 asok(0x5586b166e270) register_command rotate-key cmddesc rotate-key hook 0x5586b191fc48 EEXIST 2024-09-14T11:09:23.477 INFO:tasks.workunit.client.0.smithi050.stderr: -165> 2024-09-14T11:09:23.184+0000 7f1f64412800 10 monclient: _reopen_session rank -1 2024-09-14T11:09:23.477 INFO:tasks.workunit.client.0.smithi050.stderr: -164> 2024-09-14T11:09:23.184+0000 7f1f64412800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:09:23.477 INFO:tasks.workunit.client.0.smithi050.stderr: -163> 2024-09-14T11:09:23.184+0000 7f1f64412800 10 monclient(hunting): picked mon.noname-a con 0x5586b194fdc0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:09:23.478 INFO:tasks.workunit.client.0.smithi050.stderr: -162> 2024-09-14T11:09:23.184+0000 7f1f64412800 10 monclient(hunting): picked mon.noname-c con 0x5586b195a8a0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:09:23.478 INFO:tasks.workunit.client.0.smithi050.stderr: -161> 2024-09-14T11:09:23.184+0000 7f1f64412800 10 monclient(hunting): picked mon.noname-b con 0x5586b195f470 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:09:23.478 INFO:tasks.workunit.client.0.smithi050.stderr: -160> 2024-09-14T11:09:23.184+0000 7f1f64412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:09:23.478 INFO:tasks.workunit.client.0.smithi050.stderr: -159> 2024-09-14T11:09:23.184+0000 7f1f64412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:09:23.478 INFO:tasks.workunit.client.0.smithi050.stderr: -158> 2024-09-14T11:09:23.184+0000 7f1f64412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:09:23.478 INFO:tasks.workunit.client.0.smithi050.stderr: -157> 2024-09-14T11:09:23.184+0000 7f1f64412800 10 monclient(hunting): _renew_subs 2024-09-14T11:09:23.478 INFO:tasks.workunit.client.0.smithi050.stderr: -156> 2024-09-14T11:09:23.184+0000 7f1f64412800 10 monclient(hunting): authenticate will time out at 2215.821277s 2024-09-14T11:09:23.478 INFO:tasks.workunit.client.0.smithi050.stderr: -155> 2024-09-14T11:09:23.184+0000 7f1f5fbe0640 10 monclient(hunting): get_auth_request con 0x5586b194fdc0 auth_method 0 2024-09-14T11:09:23.478 INFO:tasks.workunit.client.0.smithi050.stderr: -154> 2024-09-14T11:09:23.184+0000 7f1f5fbe0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:09:23.478 INFO:tasks.workunit.client.0.smithi050.stderr: -153> 2024-09-14T11:09:23.184+0000 7f1f5fbe0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:09:23.478 INFO:tasks.workunit.client.0.smithi050.stderr: -152> 2024-09-14T11:09:23.184+0000 7f1f5fbe0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:09:23.478 INFO:tasks.workunit.client.0.smithi050.stderr: -151> 2024-09-14T11:09:23.184+0000 7f1f5f3df640 10 monclient(hunting): get_auth_request con 0x5586b195a8a0 auth_method 0 2024-09-14T11:09:23.479 INFO:tasks.workunit.client.0.smithi050.stderr: -150> 2024-09-14T11:09:23.184+0000 7f1f5f3df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:09:23.479 INFO:tasks.workunit.client.0.smithi050.stderr: -149> 2024-09-14T11:09:23.184+0000 7f1f5f3df640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:09:23.479 INFO:tasks.workunit.client.0.smithi050.stderr: -148> 2024-09-14T11:09:23.184+0000 7f1f5f3df640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:09:23.479 INFO:tasks.workunit.client.0.smithi050.stderr: -147> 2024-09-14T11:09:23.184+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:09:23.479 INFO:tasks.workunit.client.0.smithi050.stderr: -146> 2024-09-14T11:09:23.184+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:09:23.479 INFO:tasks.workunit.client.0.smithi050.stderr: -145> 2024-09-14T11:09:23.184+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:09:23.479 INFO:tasks.workunit.client.0.smithi050.stderr: -144> 2024-09-14T11:09:23.184+0000 7f1f603e1640 10 monclient(hunting): get_auth_request con 0x5586b195f470 auth_method 0 2024-09-14T11:09:23.479 INFO:tasks.workunit.client.0.smithi050.stderr: -143> 2024-09-14T11:09:23.184+0000 7f1f603e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:09:23.479 INFO:tasks.workunit.client.0.smithi050.stderr: -142> 2024-09-14T11:09:23.184+0000 7f1f603e1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:09:23.479 INFO:tasks.workunit.client.0.smithi050.stderr: -141> 2024-09-14T11:09:23.184+0000 7f1f603e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:09:23.479 INFO:tasks.workunit.client.0.smithi050.stderr: -140> 2024-09-14T11:09:23.184+0000 7f1f5f3df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:09:23.479 INFO:tasks.workunit.client.0.smithi050.stderr: -139> 2024-09-14T11:09:23.184+0000 7f1f5f3df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:09:23.479 INFO:tasks.workunit.client.0.smithi050.stderr: -138> 2024-09-14T11:09:23.184+0000 7f1f5f3df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:09:23.480 INFO:tasks.workunit.client.0.smithi050.stderr: -137> 2024-09-14T11:09:23.184+0000 7f1f603e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:09:23.480 INFO:tasks.workunit.client.0.smithi050.stderr: -136> 2024-09-14T11:09:23.184+0000 7f1f603e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:09:23.480 INFO:tasks.workunit.client.0.smithi050.stderr: -135> 2024-09-14T11:09:23.184+0000 7f1f603e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:09:23.480 INFO:tasks.workunit.client.0.smithi050.stderr: -134> 2024-09-14T11:09:23.184+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_done global_id 6426 payload 824 2024-09-14T11:09:23.480 INFO:tasks.workunit.client.0.smithi050.stderr: -133> 2024-09-14T11:09:23.184+0000 7f1f5fbe0640 10 monclient: _finish_hunting 0 2024-09-14T11:09:23.480 INFO:tasks.workunit.client.0.smithi050.stderr: -132> 2024-09-14T11:09:23.184+0000 7f1f5fbe0640 1 monclient: found mon.noname-a 2024-09-14T11:09:23.480 INFO:tasks.workunit.client.0.smithi050.stderr: -131> 2024-09-14T11:09:23.184+0000 7f1f5fbe0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:09:23.480 INFO:tasks.workunit.client.0.smithi050.stderr: -130> 2024-09-14T11:09:23.184+0000 7f1e3d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:09:23.480 INFO:tasks.workunit.client.0.smithi050.stderr: -129> 2024-09-14T11:09:23.184+0000 7f1e3d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:09:23.480 INFO:tasks.workunit.client.0.smithi050.stderr: -128> 2024-09-14T11:09:23.184+0000 7f1e3d7fa640 10 monclient: dump: 2024-09-14T11:09:23.480 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:09:23.481 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:09:23.481 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.481 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.481 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:09:23.481 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.481 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:09:23.481 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:09:23.481 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:09:23.481 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.481 INFO:tasks.workunit.client.0.smithi050.stderr: -127> 2024-09-14T11:09:23.184+0000 7f1e3d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:09:23.481 INFO:tasks.workunit.client.0.smithi050.stderr: -126> 2024-09-14T11:09:23.184+0000 7f1e3d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:09:23.481 INFO:tasks.workunit.client.0.smithi050.stderr: -125> 2024-09-14T11:09:23.184+0000 7f1e3d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:09:23.481 INFO:tasks.workunit.client.0.smithi050.stderr: -124> 2024-09-14T11:09:23.184+0000 7f1e3d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:09:23.482 INFO:tasks.workunit.client.0.smithi050.stderr: -123> 2024-09-14T11:09:23.185+0000 7f1e3d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:09:23.482 INFO:tasks.workunit.client.0.smithi050.stderr: -122> 2024-09-14T11:09:23.185+0000 7f1e3d7fa640 10 monclient: dump: 2024-09-14T11:09:23.482 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:09:23.482 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:09:23.482 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.482 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.482 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:09:23.482 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.482 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:09:23.482 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:09:23.482 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:09:23.482 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.482 INFO:tasks.workunit.client.0.smithi050.stderr: -121> 2024-09-14T11:09:23.185+0000 7f1f64412800 5 monclient: authenticate success, global_id 6426 2024-09-14T11:09:23.483 INFO:tasks.workunit.client.0.smithi050.stderr: -120> 2024-09-14T11:09:23.185+0000 7f1f64412800 10 monclient: _renew_subs 2024-09-14T11:09:23.483 INFO:tasks.workunit.client.0.smithi050.stderr: -119> 2024-09-14T11:09:23.184+0000 7f1e3effd640 4 set_mon_vals no callback set 2024-09-14T11:09:23.483 INFO:tasks.workunit.client.0.smithi050.stderr: -118> 2024-09-14T11:09:23.185+0000 7f1f64412800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:09:23.483 INFO:tasks.workunit.client.0.smithi050.stderr: -117> 2024-09-14T11:09:23.185+0000 7f1f64412800 10 monclient: _renew_subs 2024-09-14T11:09:23.483 INFO:tasks.workunit.client.0.smithi050.stderr: -116> 2024-09-14T11:09:23.185+0000 7f1f64412800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:09:23.483 INFO:tasks.workunit.client.0.smithi050.stderr: -115> 2024-09-14T11:09:23.185+0000 7f1f64412800 1 librados: init done 2024-09-14T11:09:23.483 INFO:tasks.workunit.client.0.smithi050.stderr: -114> 2024-09-14T11:09:23.185+0000 7f1f64412800 5 asok(0x5586b166e270) register_command cr dump hook 0x5586b19594e8 2024-09-14T11:09:23.483 INFO:tasks.workunit.client.0.smithi050.stderr: -113> 2024-09-14T11:09:23.186+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.483 INFO:tasks.workunit.client.0.smithi050.stderr: -112> 2024-09-14T11:09:23.187+0000 7f1e3d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:09:23.483 INFO:tasks.workunit.client.0.smithi050.stderr: -111> 2024-09-14T11:09:23.187+0000 7f1e3d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:09:23.483 INFO:tasks.workunit.client.0.smithi050.stderr: -110> 2024-09-14T11:09:23.187+0000 7f1e3d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:09:23.483 INFO:tasks.workunit.client.0.smithi050.stderr: -109> 2024-09-14T11:09:23.187+0000 7f1f5f3df640 10 monclient: get_auth_request con 0x7f1e28077260 auth_method 0 2024-09-14T11:09:23.484 INFO:tasks.workunit.client.0.smithi050.stderr: -108> 2024-09-14T11:09:23.187+0000 7f1f603e1640 10 monclient: get_auth_request con 0x5586b1979200 auth_method 0 2024-09-14T11:09:23.484 INFO:tasks.workunit.client.0.smithi050.stderr: -107> 2024-09-14T11:09:23.188+0000 7f1f64412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.484 INFO:tasks.workunit.client.0.smithi050.stderr: -106> 2024-09-14T11:09:23.188+0000 7f1f64412800 20 realm 2024-09-14T11:09:23.484 INFO:tasks.workunit.client.0.smithi050.stderr: -105> 2024-09-14T11:09:23.188+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.484 INFO:tasks.workunit.client.0.smithi050.stderr: -104> 2024-09-14T11:09:23.188+0000 7f1f64412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.484 INFO:tasks.workunit.client.0.smithi050.stderr: -103> 2024-09-14T11:09:23.188+0000 7f1f64412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:23.484 INFO:tasks.workunit.client.0.smithi050.stderr: -102> 2024-09-14T11:09:23.188+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.484 INFO:tasks.workunit.client.0.smithi050.stderr: -101> 2024-09-14T11:09:23.188+0000 7f1f64412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.484 INFO:tasks.workunit.client.0.smithi050.stderr: -100> 2024-09-14T11:09:23.188+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.484 INFO:tasks.workunit.client.0.smithi050.stderr: -99> 2024-09-14T11:09:23.188+0000 7f1f5fbe0640 10 monclient: get_auth_request con 0x5586b197d460 auth_method 0 2024-09-14T11:09:23.484 INFO:tasks.workunit.client.0.smithi050.stderr: -98> 2024-09-14T11:09:23.189+0000 7f1f64412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:23.484 INFO:tasks.workunit.client.0.smithi050.stderr: -97> 2024-09-14T11:09:23.189+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.485 INFO:tasks.workunit.client.0.smithi050.stderr: -96> 2024-09-14T11:09:23.189+0000 7f1f5f3df640 10 monclient: get_auth_request con 0x5586b1980ce0 auth_method 0 2024-09-14T11:09:23.485 INFO:tasks.workunit.client.0.smithi050.stderr: -95> 2024-09-14T11:09:23.190+0000 7f1f64412800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:23.485 INFO:tasks.workunit.client.0.smithi050.stderr: -94> 2024-09-14T11:09:23.190+0000 7f1f64412800 20 searching for the correct realm 2024-09-14T11:09:23.485 INFO:tasks.workunit.client.0.smithi050.stderr: -93> 2024-09-14T11:09:23.190+0000 7f1f603e1640 10 monclient: get_auth_request con 0x5586b1985aa0 auth_method 0 2024-09-14T11:09:23.485 INFO:tasks.workunit.client.0.smithi050.stderr: -92> 2024-09-14T11:09:23.191+0000 7f1f5fbe0640 10 monclient: get_auth_request con 0x7f1f5801a040 auth_method 0 2024-09-14T11:09:23.485 INFO:tasks.workunit.client.0.smithi050.stderr: -91> 2024-09-14T11:09:23.192+0000 7f1f603e1640 0 -- 172.21.15.50:0/3557204915 >> [v2:172.21.15.118:6816/4154782182,v1:172.21.15.118:6817/4154782182] conn(0x5586b1985aa0 msgr2=0x5586b1987f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:23.485 INFO:tasks.workunit.client.0.smithi050.stderr: -90> 2024-09-14T11:09:23.192+0000 7f1e3d7fa640 1 client.6426.objecter ms_handle_reset 0x5586b1985aa0 session 0x5586b1985420 osd.4 2024-09-14T11:09:23.485 INFO:tasks.workunit.client.0.smithi050.stderr: -89> 2024-09-14T11:09:23.193+0000 7f1e3d7fa640 10 monclient: _renew_subs 2024-09-14T11:09:23.485 INFO:tasks.workunit.client.0.smithi050.stderr: -88> 2024-09-14T11:09:23.193+0000 7f1e3d7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:09:23.485 INFO:tasks.workunit.client.0.smithi050.stderr: -87> 2024-09-14T11:09:23.193+0000 7f1f5f3df640 10 monclient: get_auth_request con 0x7f1f58025be0 auth_method 0 2024-09-14T11:09:23.485 INFO:tasks.workunit.client.0.smithi050.stderr: -86> 2024-09-14T11:09:23.193+0000 7f1f603e1640 10 monclient: get_auth_request con 0x7f1e28087570 auth_method 0 2024-09-14T11:09:23.485 INFO:tasks.workunit.client.0.smithi050.stderr: -85> 2024-09-14T11:09:23.195+0000 7f1f603e1640 10 monclient: get_auth_request con 0x7f1f5006b020 auth_method 0 2024-09-14T11:09:23.486 INFO:tasks.workunit.client.0.smithi050.stderr: -84> 2024-09-14T11:09:23.196+0000 7f1f5fbe0640 10 monclient: get_auth_request con 0x7f1f58046920 auth_method 0 2024-09-14T11:09:23.486 INFO:tasks.workunit.client.0.smithi050.stderr: -83> 2024-09-14T11:09:23.196+0000 7f1f5fbe0640 0 -- 172.21.15.50:0/3557204915 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f1f58046920 msgr2=0x7f1f580183a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:23.486 INFO:tasks.workunit.client.0.smithi050.stderr: -82> 2024-09-14T11:09:23.398+0000 7f1f5fbe0640 10 monclient: get_auth_request con 0x7f1f58046920 auth_method 0 2024-09-14T11:09:23.486 INFO:tasks.workunit.client.0.smithi050.stderr: -81> 2024-09-14T11:09:23.403+0000 7f1f64412800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:23.486 INFO:tasks.workunit.client.0.smithi050.stderr: -80> 2024-09-14T11:09:23.403+0000 7f1f64412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:23.486 INFO:tasks.workunit.client.0.smithi050.stderr: -79> 2024-09-14T11:09:23.403+0000 7f1f64412800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:23.486 INFO:tasks.workunit.client.0.smithi050.stderr: -78> 2024-09-14T11:09:23.403+0000 7f1f64412800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:23.486 INFO:tasks.workunit.client.0.smithi050.stderr: -77> 2024-09-14T11:09:23.403+0000 7f1f64412800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:23.486 INFO:tasks.workunit.client.0.smithi050.stderr: -76> 2024-09-14T11:09:23.403+0000 7f1f64412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:23.486 INFO:tasks.workunit.client.0.smithi050.stderr: -75> 2024-09-14T11:09:23.403+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.486 INFO:tasks.workunit.client.0.smithi050.stderr: -74> 2024-09-14T11:09:23.404+0000 7f1f64412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.486 INFO:tasks.workunit.client.0.smithi050.stderr: -73> 2024-09-14T11:09:23.404+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.487 INFO:tasks.workunit.client.0.smithi050.stderr: -72> 2024-09-14T11:09:23.404+0000 7f1f64412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:23.487 INFO:tasks.workunit.client.0.smithi050.stderr: -71> 2024-09-14T11:09:23.404+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.487 INFO:tasks.workunit.client.0.smithi050.stderr: -70> 2024-09-14T11:09:23.404+0000 7f1f64412800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:23.487 INFO:tasks.workunit.client.0.smithi050.stderr: -69> 2024-09-14T11:09:23.404+0000 7f1f64412800 20 zone default found 2024-09-14T11:09:23.487 INFO:tasks.workunit.client.0.smithi050.stderr: -68> 2024-09-14T11:09:23.404+0000 7f1f64412800 4 Realm: () 2024-09-14T11:09:23.487 INFO:tasks.workunit.client.0.smithi050.stderr: -67> 2024-09-14T11:09:23.404+0000 7f1f64412800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:23.487 INFO:tasks.workunit.client.0.smithi050.stderr: -66> 2024-09-14T11:09:23.404+0000 7f1f64412800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:23.487 INFO:tasks.workunit.client.0.smithi050.stderr: -65> 2024-09-14T11:09:23.404+0000 7f1f64412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:23.487 INFO:tasks.workunit.client.0.smithi050.stderr: -64> 2024-09-14T11:09:23.404+0000 7f1f64412800 20 zonegroup default 2024-09-14T11:09:23.487 INFO:tasks.workunit.client.0.smithi050.stderr: -63> 2024-09-14T11:09:23.404+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.487 INFO:tasks.workunit.client.0.smithi050.stderr: -62> 2024-09-14T11:09:23.405+0000 7f1f64412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.487 INFO:tasks.workunit.client.0.smithi050.stderr: -61> 2024-09-14T11:09:23.405+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.487 INFO:tasks.workunit.client.0.smithi050.stderr: -60> 2024-09-14T11:09:23.405+0000 7f1f64412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.488 INFO:tasks.workunit.client.0.smithi050.stderr: -59> 2024-09-14T11:09:23.405+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.488 INFO:tasks.workunit.client.0.smithi050.stderr: -58> 2024-09-14T11:09:23.405+0000 7f1f64412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.488 INFO:tasks.workunit.client.0.smithi050.stderr: -57> 2024-09-14T11:09:23.405+0000 7f1f64412800 20 started sync module instance, tier type = 2024-09-14T11:09:23.488 INFO:tasks.workunit.client.0.smithi050.stderr: -56> 2024-09-14T11:09:23.405+0000 7f1f64412800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:23.488 INFO:tasks.workunit.client.0.smithi050.stderr: -55> 2024-09-14T11:09:23.414+0000 7f1f64412800 20 add_watcher() i=0 2024-09-14T11:09:23.488 INFO:tasks.workunit.client.0.smithi050.stderr: -54> 2024-09-14T11:09:23.414+0000 7f1f64412800 20 add_watcher() i=1 2024-09-14T11:09:23.488 INFO:tasks.workunit.client.0.smithi050.stderr: -53> 2024-09-14T11:09:23.414+0000 7f1f64412800 20 add_watcher() i=2 2024-09-14T11:09:23.488 INFO:tasks.workunit.client.0.smithi050.stderr: -52> 2024-09-14T11:09:23.414+0000 7f1f64412800 20 add_watcher() i=3 2024-09-14T11:09:23.488 INFO:tasks.workunit.client.0.smithi050.stderr: -51> 2024-09-14T11:09:23.414+0000 7f1f64412800 20 add_watcher() i=4 2024-09-14T11:09:23.488 INFO:tasks.workunit.client.0.smithi050.stderr: -50> 2024-09-14T11:09:23.414+0000 7f1f64412800 20 add_watcher() i=5 2024-09-14T11:09:23.488 INFO:tasks.workunit.client.0.smithi050.stderr: -49> 2024-09-14T11:09:23.414+0000 7f1f64412800 20 add_watcher() i=6 2024-09-14T11:09:23.488 INFO:tasks.workunit.client.0.smithi050.stderr: -48> 2024-09-14T11:09:23.415+0000 7f1f64412800 20 add_watcher() i=7 2024-09-14T11:09:23.488 INFO:tasks.workunit.client.0.smithi050.stderr: -47> 2024-09-14T11:09:23.415+0000 7f1f64412800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:23.488 INFO:tasks.workunit.client.0.smithi050.stderr: -46> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding auth protocol: cephx 2024-09-14T11:09:23.489 INFO:tasks.workunit.client.0.smithi050.stderr: -45> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding auth protocol: cephx 2024-09-14T11:09:23.489 INFO:tasks.workunit.client.0.smithi050.stderr: -44> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding auth protocol: cephx 2024-09-14T11:09:23.489 INFO:tasks.workunit.client.0.smithi050.stderr: -43> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding con mode: secure 2024-09-14T11:09:23.489 INFO:tasks.workunit.client.0.smithi050.stderr: -42> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding con mode: crc 2024-09-14T11:09:23.489 INFO:tasks.workunit.client.0.smithi050.stderr: -41> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding con mode: secure 2024-09-14T11:09:23.489 INFO:tasks.workunit.client.0.smithi050.stderr: -40> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding con mode: crc 2024-09-14T11:09:23.489 INFO:tasks.workunit.client.0.smithi050.stderr: -39> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding con mode: secure 2024-09-14T11:09:23.489 INFO:tasks.workunit.client.0.smithi050.stderr: -38> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding con mode: crc 2024-09-14T11:09:23.489 INFO:tasks.workunit.client.0.smithi050.stderr: -37> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding con mode: crc 2024-09-14T11:09:23.489 INFO:tasks.workunit.client.0.smithi050.stderr: -36> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding con mode: secure 2024-09-14T11:09:23.489 INFO:tasks.workunit.client.0.smithi050.stderr: -35> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding con mode: crc 2024-09-14T11:09:23.489 INFO:tasks.workunit.client.0.smithi050.stderr: -34> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding con mode: secure 2024-09-14T11:09:23.490 INFO:tasks.workunit.client.0.smithi050.stderr: -33> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding con mode: crc 2024-09-14T11:09:23.490 INFO:tasks.workunit.client.0.smithi050.stderr: -32> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding con mode: secure 2024-09-14T11:09:23.490 INFO:tasks.workunit.client.0.smithi050.stderr: -31> 2024-09-14T11:09:23.417+0000 7f1e15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:23.490 INFO:tasks.workunit.client.0.smithi050.stderr: -30> 2024-09-14T11:09:23.417+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.490 INFO:tasks.workunit.client.0.smithi050.stderr: -29> 2024-09-14T11:09:23.417+0000 7f1f64412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:23.490 INFO:tasks.workunit.client.0.smithi050.stderr: -28> 2024-09-14T11:09:23.417+0000 7f1f64412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:23.490 INFO:tasks.workunit.client.0.smithi050.stderr: -27> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 asok(0x5586b166e270) register_command cache list hook 0x5586b1955b70 2024-09-14T11:09:23.490 INFO:tasks.workunit.client.0.smithi050.stderr: -26> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 asok(0x5586b166e270) register_command cache inspect hook 0x5586b1955b70 2024-09-14T11:09:23.490 INFO:tasks.workunit.client.0.smithi050.stderr: -25> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 asok(0x5586b166e270) register_command cache erase hook 0x5586b1955b70 2024-09-14T11:09:23.490 INFO:tasks.workunit.client.0.smithi050.stderr: -24> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 asok(0x5586b166e270) register_command cache zap hook 0x5586b1955b70 2024-09-14T11:09:23.490 INFO:tasks.workunit.client.0.smithi050.stderr: -23> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 note: GC not initialized 2024-09-14T11:09:23.490 INFO:tasks.workunit.client.0.smithi050.stderr: -22> 2024-09-14T11:09:23.417+0000 7f1e14fe1640 20 reqs_thread_entry: start 2024-09-14T11:09:23.491 INFO:tasks.workunit.client.0.smithi050.stderr: -21> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 asok(0x5586b166e270) register_command sync trace show hook 0x7f1f58017870 2024-09-14T11:09:23.491 INFO:tasks.workunit.client.0.smithi050.stderr: -20> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 asok(0x5586b166e270) register_command sync trace history hook 0x7f1f58017870 2024-09-14T11:09:23.491 INFO:tasks.workunit.client.0.smithi050.stderr: -19> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 asok(0x5586b166e270) register_command sync trace active hook 0x7f1f58017870 2024-09-14T11:09:23.491 INFO:tasks.workunit.client.0.smithi050.stderr: -18> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 asok(0x5586b166e270) register_command sync trace active_short hook 0x7f1f58017870 2024-09-14T11:09:23.491 INFO:tasks.workunit.client.0.smithi050.stderr: -17> 2024-09-14T11:09:23.417+0000 7f1f64412800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:23.491 INFO:tasks.workunit.client.0.smithi050.stderr: -16> 2024-09-14T11:09:23.417+0000 7f1f64412800 20 Filter name: none 2024-09-14T11:09:23.491 INFO:tasks.workunit.client.0.smithi050.stderr: -15> 2024-09-14T11:09:23.418+0000 7f1d8e7fc640 20 reqs_thread_entry: start 2024-09-14T11:09:23.491 INFO:tasks.workunit.client.0.smithi050.stderr: -14> 2024-09-14T11:09:23.418+0000 7f1f64412800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:09:23.491 INFO:tasks.workunit.client.0.smithi050.stderr: -13> 2024-09-14T11:09:23.418+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.491 INFO:tasks.workunit.client.0.smithi050.stderr: -12> 2024-09-14T11:09:23.418+0000 7f1f64412800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:09:23.491 INFO:tasks.workunit.client.0.smithi050.stderr: -11> 2024-09-14T11:09:23.418+0000 7f1f64412800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:09:23.491 INFO:tasks.workunit.client.0.smithi050.stderr: -10> 2024-09-14T11:09:23.418+0000 7f1f64412800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:09:23.491 INFO:tasks.workunit.client.0.smithi050.stderr: -9> 2024-09-14T11:09:23.418+0000 7f1f64412800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 : miss 2024-09-14T11:09:23.491 INFO:tasks.workunit.client.0.smithi050.stderr: -8> 2024-09-14T11:09:23.418+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.491 INFO:tasks.workunit.client.0.smithi050.stderr: -7> 2024-09-14T11:09:23.419+0000 7f1f64412800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:09:23.492 INFO:tasks.workunit.client.0.smithi050.stderr: -6> 2024-09-14T11:09:23.419+0000 7f1f64412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 info.flags=0x17 2024-09-14T11:09:23.492 INFO:tasks.workunit.client.0.smithi050.stderr: -5> 2024-09-14T11:09:23.419+0000 7f1f64412800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 to cache LRU end 2024-09-14T11:09:23.492 INFO:tasks.workunit.client.0.smithi050.stderr: -4> 2024-09-14T11:09:23.419+0000 7f1f64412800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:09:23.492 INFO:tasks.workunit.client.0.smithi050.stderr: -3> 2024-09-14T11:09:23.419+0000 7f1f64412800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:23.492 INFO:tasks.workunit.client.0.smithi050.stderr: -2> 2024-09-14T11:09:23.419+0000 7f1f64412800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 2024-09-14T11:09:23.492 INFO:tasks.workunit.client.0.smithi050.stderr: -1> 2024-09-14T11:09:23.421+0000 7f1f64412800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1f64412800 time 2024-09-14T11:09:23.421125+0000 2024-09-14T11:09:23.492 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:09:23.492 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.492 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:09:23.492 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1f6558c76a] 2024-09-14T11:09:23.492 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f1f6558c928] 2024-09-14T11:09:23.492 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5586af4cf0b1] 2024-09-14T11:09:23.492 INFO:tasks.workunit.client.0.smithi050.stderr: 4: radosgw-admin(+0xd882d4) [0x5586af9e22d4] 2024-09-14T11:09:23.493 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5586af4deefd] 2024-09-14T11:09:23.493 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:09:23.493 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1f64229590] 2024-09-14T11:09:23.493 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:09:23.493 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:09:23.493 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.493 INFO:tasks.workunit.client.0.smithi050.stderr: 0> 2024-09-14T11:09:23.422+0000 7f1f64412800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:09:23.493 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f1f64412800 thread_name:radosgw-admin 2024-09-14T11:09:23.493 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.493 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:09:23.493 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1f6423e6f0] 2024-09-14T11:09:23.493 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1f6428b99c] 2024-09-14T11:09:23.493 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:09:23.493 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:09:23.494 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1f6558c7c4] 2024-09-14T11:09:23.494 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f1f6558c928] 2024-09-14T11:09:23.494 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5586af4cf0b1] 2024-09-14T11:09:23.494 INFO:tasks.workunit.client.0.smithi050.stderr: 8: radosgw-admin(+0xd882d4) [0x5586af9e22d4] 2024-09-14T11:09:23.494 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5586af4deefd] 2024-09-14T11:09:23.494 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:09:23.494 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1f64229590] 2024-09-14T11:09:23.494 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:09:23.494 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:09:23.494 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:09:23.494 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.494 INFO:tasks.workunit.client.0.smithi050.stderr:--- logging levels --- 2024-09-14T11:09:23.495 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 none 2024-09-14T11:09:23.495 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 lockdep 2024-09-14T11:09:23.495 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 context 2024-09-14T11:09:23.495 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 crush 2024-09-14T11:09:23.495 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds 2024-09-14T11:09:23.495 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_balancer 2024-09-14T11:09:23.495 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_locker 2024-09-14T11:09:23.495 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log 2024-09-14T11:09:23.495 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log_expire 2024-09-14T11:09:23.495 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_migrator 2024-09-14T11:09:23.495 INFO:tasks.workunit.client.0.smithi050.stderr: 3/ 5 mds_quiesce 2024-09-14T11:09:23.495 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 buffer 2024-09-14T11:09:23.495 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 timer 2024-09-14T11:09:23.495 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 filer 2024-09-14T11:09:23.496 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 striper 2024-09-14T11:09:23.496 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 objecter 2024-09-14T11:09:23.496 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rados 2024-09-14T11:09:23.496 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd 2024-09-14T11:09:23.496 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_mirror 2024-09-14T11:09:23.496 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_replay 2024-09-14T11:09:23.496 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_pwl 2024-09-14T11:09:23.496 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 journaler 2024-09-14T11:09:23.496 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objectcacher 2024-09-14T11:09:23.496 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:09:23.496 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 client 2024-09-14T11:09:23.497 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 osd 2024-09-14T11:09:23.497 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 optracker 2024-09-14T11:09:23.497 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objclass 2024-09-14T11:09:23.497 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 filestore 2024-09-14T11:09:23.497 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 journal 2024-09-14T11:09:23.497 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 ms 2024-09-14T11:09:23.497 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mon 2024-09-14T11:09:23.497 INFO:tasks.workunit.client.0.smithi050.stderr: 0/10 monc 2024-09-14T11:09:23.497 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 paxos 2024-09-14T11:09:23.497 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 tp 2024-09-14T11:09:23.497 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 auth 2024-09-14T11:09:23.497 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 crypto 2024-09-14T11:09:23.497 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 finisher 2024-09-14T11:09:23.497 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 reserver 2024-09-14T11:09:23.498 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 heartbeatmap 2024-09-14T11:09:23.498 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 perfcounter 2024-09-14T11:09:23.498 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw 2024-09-14T11:09:23.498 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_sync 2024-09-14T11:09:23.498 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_datacache 2024-09-14T11:09:23.498 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_access 2024-09-14T11:09:23.498 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:09:23.498 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_flight 2024-09-14T11:09:23.498 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:09:23.498 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw_notification 2024-09-14T11:09:23.498 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 javaclient 2024-09-14T11:09:23.498 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 asok 2024-09-14T11:09:23.498 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 throttle 2024-09-14T11:09:23.498 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 refs 2024-09-14T11:09:23.499 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 compressor 2024-09-14T11:09:23.499 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluestore 2024-09-14T11:09:23.499 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluefs 2024-09-14T11:09:23.499 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 bdev 2024-09-14T11:09:23.499 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 kstore 2024-09-14T11:09:23.499 INFO:tasks.workunit.client.0.smithi050.stderr: 4/ 5 rocksdb 2024-09-14T11:09:23.499 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 fuse 2024-09-14T11:09:23.499 INFO:tasks.workunit.client.0.smithi050.stderr: 2/ 5 mgr 2024-09-14T11:09:23.499 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mgrc 2024-09-14T11:09:23.499 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 dpdk 2024-09-14T11:09:23.499 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 eventtrace 2024-09-14T11:09:23.499 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 prioritycache 2024-09-14T11:09:23.500 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 test 2024-09-14T11:09:23.500 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:09:23.500 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephsqlite 2024-09-14T11:09:23.500 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:09:23.500 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore 2024-09-14T11:09:23.500 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_onode 2024-09-14T11:09:23.500 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_odata 2024-09-14T11:09:23.500 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_omap 2024-09-14T11:09:23.500 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_tm 2024-09-14T11:09:23.500 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_t 2024-09-14T11:09:23.500 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:09:23.500 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_epm 2024-09-14T11:09:23.500 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_lba 2024-09-14T11:09:23.501 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:09:23.501 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cache 2024-09-14T11:09:23.501 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_journal 2024-09-14T11:09:23.501 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_device 2024-09-14T11:09:23.501 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_backref 2024-09-14T11:09:23.501 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 alienstore 2024-09-14T11:09:23.501 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mclock 2024-09-14T11:09:23.501 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cyanstore 2024-09-14T11:09:23.501 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 ceph_exporter 2024-09-14T11:09:23.501 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 memstore 2024-09-14T11:09:23.501 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 trace 2024-09-14T11:09:23.501 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 ceph_dedup 2024-09-14T11:09:23.502 INFO:tasks.workunit.client.0.smithi050.stderr: -2/-2 (syslog threshold) 2024-09-14T11:09:23.502 INFO:tasks.workunit.client.0.smithi050.stderr: 99/99 (stderr threshold) 2024-09-14T11:09:23.502 INFO:tasks.workunit.client.0.smithi050.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:09:23.502 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1d8e7fc640 / http_manager 2024-09-14T11:09:23.502 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1e14fe1640 / http_manager 2024-09-14T11:09:23.502 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1e15fe3640 / rgw_dt_lg_renew 2024-09-14T11:09:23.502 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1e3d7fa640 / ms_dispatch 2024-09-14T11:09:23.502 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1e3effd640 / io_context_pool 2024-09-14T11:09:23.502 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1e457fa640 / ms_dispatch 2024-09-14T11:09:23.502 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1e47fff640 / ms_dispatch 2024-09-14T11:09:23.502 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1e4de0b640 / io_context_pool 2024-09-14T11:09:23.502 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1f5f3df640 / msgr-worker-2 2024-09-14T11:09:23.502 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1f5fbe0640 / msgr-worker-1 2024-09-14T11:09:23.503 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1f603e1640 / msgr-worker-0 2024-09-14T11:09:23.503 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1f60be2640 / io_context_pool 2024-09-14T11:09:23.503 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1f64412800 / radosgw-admin 2024-09-14T11:09:23.503 INFO:tasks.workunit.client.0.smithi050.stderr: max_recent 500 2024-09-14T11:09:23.503 INFO:tasks.workunit.client.0.smithi050.stderr: max_new 1000 2024-09-14T11:09:23.503 INFO:tasks.workunit.client.0.smithi050.stderr: log_file /var/log/ceph/ceph-client.admin.91372.log 2024-09-14T11:09:23.503 INFO:tasks.workunit.client.0.smithi050.stderr:--- end dump of recent events --- 2024-09-14T11:09:23.503 INFO:tasks.workunit.client.0.smithi050.stderr:--- begin dump of recent events --- 2024-09-14T11:09:23.503 INFO:tasks.workunit.client.0.smithi050.stderr: -499> 2024-09-14T11:09:23.168+0000 7f1e4de0b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:09:23.503 INFO:tasks.workunit.client.0.smithi050.stderr: -498> 2024-09-14T11:09:23.168+0000 7f1e4de0b640 10 monclient: dump: 2024-09-14T11:09:23.503 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:09:23.503 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:09:23.503 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.503 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.504 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:09:23.504 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.504 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:09:23.504 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:09:23.504 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:09:23.504 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.504 INFO:tasks.workunit.client.0.smithi050.stderr: -497> 2024-09-14T11:09:23.168+0000 7f1e4de0b640 10 monclient: _finish_auth 0 2024-09-14T11:09:23.504 INFO:tasks.workunit.client.0.smithi050.stderr: -496> 2024-09-14T11:09:23.168+0000 7f1e4de0b640 10 monclient: _check_auth_tickets 2024-09-14T11:09:23.504 INFO:tasks.workunit.client.0.smithi050.stderr: -495> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 monclient: authenticate success, global_id 6044 2024-09-14T11:09:23.504 INFO:tasks.workunit.client.0.smithi050.stderr: -494> 2024-09-14T11:09:23.168+0000 7f1e4de0b640 10 monclient: handle_config config(0 keys) 2024-09-14T11:09:23.504 INFO:tasks.workunit.client.0.smithi050.stderr: -493> 2024-09-14T11:09:23.168+0000 7f1f64412800 10 monclient: get_monmap_and_config success 2024-09-14T11:09:23.504 INFO:tasks.workunit.client.0.smithi050.stderr: -492> 2024-09-14T11:09:23.168+0000 7f1f64412800 4 set_mon_vals no callback set 2024-09-14T11:09:23.504 INFO:tasks.workunit.client.0.smithi050.stderr: -491> 2024-09-14T11:09:23.168+0000 7f1e4de0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:09:23.505 INFO:tasks.workunit.client.0.smithi050.stderr: -490> 2024-09-14T11:09:23.168+0000 7f1e4de0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:09:23.505 INFO:tasks.workunit.client.0.smithi050.stderr: -489> 2024-09-14T11:09:23.168+0000 7f1e4de0b640 10 monclient: dump: 2024-09-14T11:09:23.505 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:09:23.505 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:09:23.505 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.505 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.505 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:09:23.505 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.505 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:09:23.505 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:09:23.505 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:09:23.505 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.506 INFO:tasks.workunit.client.0.smithi050.stderr: -488> 2024-09-14T11:09:23.168+0000 7f1f64412800 10 monclient: shutdown 2024-09-14T11:09:23.506 INFO:tasks.workunit.client.0.smithi050.stderr: -487> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 asok(0x5586b166e270) unregister_commands rotate-key 2024-09-14T11:09:23.506 INFO:tasks.workunit.client.0.smithi050.stderr: -486> 2024-09-14T11:09:23.168+0000 7f1f64412800 10 monclient: build_initial_monmap 2024-09-14T11:09:23.506 INFO:tasks.workunit.client.0.smithi050.stderr: -485> 2024-09-14T11:09:23.168+0000 7f1f64412800 1 build_initial for_mkfs: 0 2024-09-14T11:09:23.506 INFO:tasks.workunit.client.0.smithi050.stderr: -484> 2024-09-14T11:09:23.168+0000 7f1f64412800 10 monclient: monmap: 2024-09-14T11:09:23.506 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:09:23.506 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:09:23.506 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:09:23.506 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:09:23.506 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:09:23.506 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.506 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:09:23.506 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:09:23.506 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:09:23.506 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.507 INFO:tasks.workunit.client.0.smithi050.stderr: -483> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding auth protocol: cephx 2024-09-14T11:09:23.507 INFO:tasks.workunit.client.0.smithi050.stderr: -482> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding auth protocol: cephx 2024-09-14T11:09:23.507 INFO:tasks.workunit.client.0.smithi050.stderr: -481> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding auth protocol: cephx 2024-09-14T11:09:23.507 INFO:tasks.workunit.client.0.smithi050.stderr: -480> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding con mode: secure 2024-09-14T11:09:23.507 INFO:tasks.workunit.client.0.smithi050.stderr: -479> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding con mode: crc 2024-09-14T11:09:23.507 INFO:tasks.workunit.client.0.smithi050.stderr: -478> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding con mode: secure 2024-09-14T11:09:23.507 INFO:tasks.workunit.client.0.smithi050.stderr: -477> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding con mode: crc 2024-09-14T11:09:23.507 INFO:tasks.workunit.client.0.smithi050.stderr: -476> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding con mode: secure 2024-09-14T11:09:23.507 INFO:tasks.workunit.client.0.smithi050.stderr: -475> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding con mode: crc 2024-09-14T11:09:23.507 INFO:tasks.workunit.client.0.smithi050.stderr: -474> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding con mode: crc 2024-09-14T11:09:23.507 INFO:tasks.workunit.client.0.smithi050.stderr: -473> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding con mode: secure 2024-09-14T11:09:23.507 INFO:tasks.workunit.client.0.smithi050.stderr: -472> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding con mode: crc 2024-09-14T11:09:23.508 INFO:tasks.workunit.client.0.smithi050.stderr: -471> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding con mode: secure 2024-09-14T11:09:23.508 INFO:tasks.workunit.client.0.smithi050.stderr: -470> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding con mode: crc 2024-09-14T11:09:23.508 INFO:tasks.workunit.client.0.smithi050.stderr: -469> 2024-09-14T11:09:23.168+0000 7f1f64412800 5 AuthRegistry(0x5586b1894510) adding con mode: secure 2024-09-14T11:09:23.508 INFO:tasks.workunit.client.0.smithi050.stderr: -468> 2024-09-14T11:09:23.169+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.508 INFO:tasks.workunit.client.0.smithi050.stderr: -467> 2024-09-14T11:09:23.169+0000 7f1f64412800 1 librados: starting msgr at 2024-09-14T11:09:23.508 INFO:tasks.workunit.client.0.smithi050.stderr: -466> 2024-09-14T11:09:23.169+0000 7f1f64412800 1 librados: starting objecter 2024-09-14T11:09:23.508 INFO:tasks.workunit.client.0.smithi050.stderr: -465> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 asok(0x5586b166e270) register_command objecter_requests hook 0x5586b1894f90 2024-09-14T11:09:23.508 INFO:tasks.workunit.client.0.smithi050.stderr: -464> 2024-09-14T11:09:23.169+0000 7f1f64412800 1 librados: setting wanted keys 2024-09-14T11:09:23.508 INFO:tasks.workunit.client.0.smithi050.stderr: -463> 2024-09-14T11:09:23.169+0000 7f1f64412800 1 librados: calling monclient init 2024-09-14T11:09:23.508 INFO:tasks.workunit.client.0.smithi050.stderr: -462> 2024-09-14T11:09:23.169+0000 7f1f64412800 10 monclient: init 2024-09-14T11:09:23.508 INFO:tasks.workunit.client.0.smithi050.stderr: -461> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding auth protocol: cephx 2024-09-14T11:09:23.508 INFO:tasks.workunit.client.0.smithi050.stderr: -460> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding auth protocol: cephx 2024-09-14T11:09:23.508 INFO:tasks.workunit.client.0.smithi050.stderr: -459> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding auth protocol: cephx 2024-09-14T11:09:23.509 INFO:tasks.workunit.client.0.smithi050.stderr: -458> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding con mode: secure 2024-09-14T11:09:23.509 INFO:tasks.workunit.client.0.smithi050.stderr: -457> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding con mode: crc 2024-09-14T11:09:23.509 INFO:tasks.workunit.client.0.smithi050.stderr: -456> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding con mode: secure 2024-09-14T11:09:23.509 INFO:tasks.workunit.client.0.smithi050.stderr: -455> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding con mode: crc 2024-09-14T11:09:23.509 INFO:tasks.workunit.client.0.smithi050.stderr: -454> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding con mode: secure 2024-09-14T11:09:23.509 INFO:tasks.workunit.client.0.smithi050.stderr: -453> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding con mode: crc 2024-09-14T11:09:23.509 INFO:tasks.workunit.client.0.smithi050.stderr: -452> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding con mode: crc 2024-09-14T11:09:23.509 INFO:tasks.workunit.client.0.smithi050.stderr: -451> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding con mode: secure 2024-09-14T11:09:23.509 INFO:tasks.workunit.client.0.smithi050.stderr: -450> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding con mode: crc 2024-09-14T11:09:23.509 INFO:tasks.workunit.client.0.smithi050.stderr: -449> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding con mode: secure 2024-09-14T11:09:23.509 INFO:tasks.workunit.client.0.smithi050.stderr: -448> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding con mode: crc 2024-09-14T11:09:23.509 INFO:tasks.workunit.client.0.smithi050.stderr: -447> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 AuthRegistry(0x5586b188e900) adding con mode: secure 2024-09-14T11:09:23.510 INFO:tasks.workunit.client.0.smithi050.stderr: -446> 2024-09-14T11:09:23.169+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.510 INFO:tasks.workunit.client.0.smithi050.stderr: -445> 2024-09-14T11:09:23.169+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.510 INFO:tasks.workunit.client.0.smithi050.stderr: -444> 2024-09-14T11:09:23.169+0000 7f1f64412800 5 asok(0x5586b166e270) register_command rotate-key hook 0x5586b188ea48 2024-09-14T11:09:23.510 INFO:tasks.workunit.client.0.smithi050.stderr: -443> 2024-09-14T11:09:23.169+0000 7f1f64412800 10 monclient: _reopen_session rank -1 2024-09-14T11:09:23.510 INFO:tasks.workunit.client.0.smithi050.stderr: -442> 2024-09-14T11:09:23.169+0000 7f1f64412800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:09:23.510 INFO:tasks.workunit.client.0.smithi050.stderr: -441> 2024-09-14T11:09:23.169+0000 7f1f64412800 10 monclient(hunting): picked mon.noname-a con 0x5586b173c400 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:09:23.510 INFO:tasks.workunit.client.0.smithi050.stderr: -440> 2024-09-14T11:09:23.169+0000 7f1f64412800 10 monclient(hunting): picked mon.noname-c con 0x5586b1746860 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:09:23.510 INFO:tasks.workunit.client.0.smithi050.stderr: -439> 2024-09-14T11:09:23.169+0000 7f1f64412800 10 monclient(hunting): picked mon.noname-b con 0x5586b18c0830 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:09:23.510 INFO:tasks.workunit.client.0.smithi050.stderr: -438> 2024-09-14T11:09:23.169+0000 7f1f64412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:09:23.510 INFO:tasks.workunit.client.0.smithi050.stderr: -437> 2024-09-14T11:09:23.169+0000 7f1f64412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:09:23.510 INFO:tasks.workunit.client.0.smithi050.stderr: -436> 2024-09-14T11:09:23.169+0000 7f1f64412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:09:23.510 INFO:tasks.workunit.client.0.smithi050.stderr: -435> 2024-09-14T11:09:23.169+0000 7f1f64412800 10 monclient(hunting): _renew_subs 2024-09-14T11:09:23.510 INFO:tasks.workunit.client.0.smithi050.stderr: -434> 2024-09-14T11:09:23.169+0000 7f1f64412800 10 monclient(hunting): authenticate will time out at 2215.806976s 2024-09-14T11:09:23.511 INFO:tasks.workunit.client.0.smithi050.stderr: -433> 2024-09-14T11:09:23.170+0000 7f1f5fbe0640 10 monclient(hunting): get_auth_request con 0x5586b173c400 auth_method 0 2024-09-14T11:09:23.511 INFO:tasks.workunit.client.0.smithi050.stderr: -432> 2024-09-14T11:09:23.170+0000 7f1f5fbe0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:09:23.511 INFO:tasks.workunit.client.0.smithi050.stderr: -431> 2024-09-14T11:09:23.170+0000 7f1f5fbe0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:09:23.511 INFO:tasks.workunit.client.0.smithi050.stderr: -430> 2024-09-14T11:09:23.170+0000 7f1f5fbe0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:09:23.511 INFO:tasks.workunit.client.0.smithi050.stderr: -429> 2024-09-14T11:09:23.170+0000 7f1f5f3df640 10 monclient(hunting): get_auth_request con 0x5586b1746860 auth_method 0 2024-09-14T11:09:23.511 INFO:tasks.workunit.client.0.smithi050.stderr: -428> 2024-09-14T11:09:23.170+0000 7f1f5f3df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:09:23.511 INFO:tasks.workunit.client.0.smithi050.stderr: -427> 2024-09-14T11:09:23.170+0000 7f1f5f3df640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:09:23.511 INFO:tasks.workunit.client.0.smithi050.stderr: -426> 2024-09-14T11:09:23.170+0000 7f1f5f3df640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:09:23.511 INFO:tasks.workunit.client.0.smithi050.stderr: -425> 2024-09-14T11:09:23.170+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:09:23.511 INFO:tasks.workunit.client.0.smithi050.stderr: -424> 2024-09-14T11:09:23.170+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:09:23.511 INFO:tasks.workunit.client.0.smithi050.stderr: -423> 2024-09-14T11:09:23.170+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:09:23.511 INFO:tasks.workunit.client.0.smithi050.stderr: -422> 2024-09-14T11:09:23.170+0000 7f1f5f3df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:09:23.511 INFO:tasks.workunit.client.0.smithi050.stderr: -421> 2024-09-14T11:09:23.170+0000 7f1f5f3df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:09:23.512 INFO:tasks.workunit.client.0.smithi050.stderr: -420> 2024-09-14T11:09:23.170+0000 7f1f5f3df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:09:23.512 INFO:tasks.workunit.client.0.smithi050.stderr: -419> 2024-09-14T11:09:23.170+0000 7f1f603e1640 10 monclient(hunting): get_auth_request con 0x5586b18c0830 auth_method 0 2024-09-14T11:09:23.512 INFO:tasks.workunit.client.0.smithi050.stderr: -418> 2024-09-14T11:09:23.170+0000 7f1f603e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:09:23.512 INFO:tasks.workunit.client.0.smithi050.stderr: -417> 2024-09-14T11:09:23.170+0000 7f1f603e1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:09:23.512 INFO:tasks.workunit.client.0.smithi050.stderr: -416> 2024-09-14T11:09:23.170+0000 7f1f603e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:09:23.512 INFO:tasks.workunit.client.0.smithi050.stderr: -415> 2024-09-14T11:09:23.170+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_done global_id 6417 payload 824 2024-09-14T11:09:23.512 INFO:tasks.workunit.client.0.smithi050.stderr: -414> 2024-09-14T11:09:23.170+0000 7f1f5fbe0640 10 monclient: _finish_hunting 0 2024-09-14T11:09:23.512 INFO:tasks.workunit.client.0.smithi050.stderr: -413> 2024-09-14T11:09:23.170+0000 7f1f5fbe0640 1 monclient: found mon.noname-a 2024-09-14T11:09:23.512 INFO:tasks.workunit.client.0.smithi050.stderr: -412> 2024-09-14T11:09:23.170+0000 7f1f5fbe0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:09:23.512 INFO:tasks.workunit.client.0.smithi050.stderr: -411> 2024-09-14T11:09:23.170+0000 7f1e47fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:09:23.512 INFO:tasks.workunit.client.0.smithi050.stderr: -410> 2024-09-14T11:09:23.170+0000 7f1e47fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:09:23.512 INFO:tasks.workunit.client.0.smithi050.stderr: -409> 2024-09-14T11:09:23.170+0000 7f1e47fff640 10 monclient: dump: 2024-09-14T11:09:23.512 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:09:23.513 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:09:23.513 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.513 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.513 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:09:23.513 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.513 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:09:23.513 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:09:23.513 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:09:23.513 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.513 INFO:tasks.workunit.client.0.smithi050.stderr: -408> 2024-09-14T11:09:23.170+0000 7f1e47fff640 10 monclient: _finish_auth 0 2024-09-14T11:09:23.513 INFO:tasks.workunit.client.0.smithi050.stderr: -407> 2024-09-14T11:09:23.170+0000 7f1e47fff640 10 monclient: _check_auth_tickets 2024-09-14T11:09:23.513 INFO:tasks.workunit.client.0.smithi050.stderr: -406> 2024-09-14T11:09:23.170+0000 7f1e47fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:09:23.513 INFO:tasks.workunit.client.0.smithi050.stderr: -405> 2024-09-14T11:09:23.170+0000 7f1f64412800 5 monclient: authenticate success, global_id 6417 2024-09-14T11:09:23.514 INFO:tasks.workunit.client.0.smithi050.stderr: -404> 2024-09-14T11:09:23.170+0000 7f1f64412800 10 monclient: _renew_subs 2024-09-14T11:09:23.514 INFO:tasks.workunit.client.0.smithi050.stderr: -403> 2024-09-14T11:09:23.170+0000 7f1f64412800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:09:23.514 INFO:tasks.workunit.client.0.smithi050.stderr: -402> 2024-09-14T11:09:23.170+0000 7f1e47fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:09:23.514 INFO:tasks.workunit.client.0.smithi050.stderr: -401> 2024-09-14T11:09:23.170+0000 7f1e47fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:09:23.514 INFO:tasks.workunit.client.0.smithi050.stderr: -400> 2024-09-14T11:09:23.170+0000 7f1e47fff640 10 monclient: dump: 2024-09-14T11:09:23.514 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:09:23.514 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:09:23.514 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.514 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.514 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:09:23.514 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.514 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:09:23.514 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:09:23.515 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:09:23.515 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.515 INFO:tasks.workunit.client.0.smithi050.stderr: -399> 2024-09-14T11:09:23.170+0000 7f1e4de0b640 4 set_mon_vals no callback set 2024-09-14T11:09:23.515 INFO:tasks.workunit.client.0.smithi050.stderr: -398> 2024-09-14T11:09:23.170+0000 7f1f64412800 10 monclient: _renew_subs 2024-09-14T11:09:23.515 INFO:tasks.workunit.client.0.smithi050.stderr: -397> 2024-09-14T11:09:23.170+0000 7f1f64412800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:09:23.515 INFO:tasks.workunit.client.0.smithi050.stderr: -396> 2024-09-14T11:09:23.170+0000 7f1f64412800 1 librados: init done 2024-09-14T11:09:23.515 INFO:tasks.workunit.client.0.smithi050.stderr: -395> 2024-09-14T11:09:23.172+0000 7f1e47fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:09:23.515 INFO:tasks.workunit.client.0.smithi050.stderr: -394> 2024-09-14T11:09:23.172+0000 7f1e47fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:09:23.515 INFO:tasks.workunit.client.0.smithi050.stderr: -393> 2024-09-14T11:09:23.172+0000 7f1e47fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:09:23.515 INFO:tasks.workunit.client.0.smithi050.stderr: -392> 2024-09-14T11:09:23.173+0000 7f1f5f3df640 10 monclient: get_auth_request con 0x7f1e48077230 auth_method 0 2024-09-14T11:09:23.515 INFO:tasks.workunit.client.0.smithi050.stderr: -391> 2024-09-14T11:09:23.173+0000 7f1f603e1640 10 monclient: get_auth_request con 0x5586b18d7710 auth_method 0 2024-09-14T11:09:23.515 INFO:tasks.workunit.client.0.smithi050.stderr: -390> 2024-09-14T11:09:23.174+0000 7f1f5fbe0640 10 monclient: get_auth_request con 0x5586b18da8f0 auth_method 0 2024-09-14T11:09:23.515 INFO:tasks.workunit.client.0.smithi050.stderr: -389> 2024-09-14T11:09:23.174+0000 7f1f5f3df640 10 monclient: get_auth_request con 0x5586b18deb70 auth_method 0 2024-09-14T11:09:23.515 INFO:tasks.workunit.client.0.smithi050.stderr: -388> 2024-09-14T11:09:23.176+0000 7f1f64412800 10 monclient: build_initial_monmap 2024-09-14T11:09:23.516 INFO:tasks.workunit.client.0.smithi050.stderr: -387> 2024-09-14T11:09:23.176+0000 7f1f64412800 1 build_initial for_mkfs: 0 2024-09-14T11:09:23.516 INFO:tasks.workunit.client.0.smithi050.stderr: -386> 2024-09-14T11:09:23.176+0000 7f1f64412800 10 monclient: monmap: 2024-09-14T11:09:23.516 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:09:23.516 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:09:23.516 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:09:23.516 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:09:23.516 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:09:23.516 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.516 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:09:23.516 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:09:23.516 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:09:23.516 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.516 INFO:tasks.workunit.client.0.smithi050.stderr: -385> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding auth protocol: cephx 2024-09-14T11:09:23.516 INFO:tasks.workunit.client.0.smithi050.stderr: -384> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding auth protocol: cephx 2024-09-14T11:09:23.517 INFO:tasks.workunit.client.0.smithi050.stderr: -383> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding auth protocol: cephx 2024-09-14T11:09:23.517 INFO:tasks.workunit.client.0.smithi050.stderr: -382> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding con mode: secure 2024-09-14T11:09:23.517 INFO:tasks.workunit.client.0.smithi050.stderr: -381> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding con mode: crc 2024-09-14T11:09:23.517 INFO:tasks.workunit.client.0.smithi050.stderr: -380> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding con mode: secure 2024-09-14T11:09:23.517 INFO:tasks.workunit.client.0.smithi050.stderr: -379> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding con mode: crc 2024-09-14T11:09:23.517 INFO:tasks.workunit.client.0.smithi050.stderr: -378> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding con mode: secure 2024-09-14T11:09:23.517 INFO:tasks.workunit.client.0.smithi050.stderr: -377> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding con mode: crc 2024-09-14T11:09:23.517 INFO:tasks.workunit.client.0.smithi050.stderr: -376> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding con mode: crc 2024-09-14T11:09:23.517 INFO:tasks.workunit.client.0.smithi050.stderr: -375> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding con mode: secure 2024-09-14T11:09:23.517 INFO:tasks.workunit.client.0.smithi050.stderr: -374> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding con mode: crc 2024-09-14T11:09:23.517 INFO:tasks.workunit.client.0.smithi050.stderr: -373> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding con mode: secure 2024-09-14T11:09:23.517 INFO:tasks.workunit.client.0.smithi050.stderr: -372> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding con mode: crc 2024-09-14T11:09:23.517 INFO:tasks.workunit.client.0.smithi050.stderr: -371> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e39b0) adding con mode: secure 2024-09-14T11:09:23.518 INFO:tasks.workunit.client.0.smithi050.stderr: -370> 2024-09-14T11:09:23.176+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.518 INFO:tasks.workunit.client.0.smithi050.stderr: -369> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 asok(0x5586b166e270) register_command objecter_requests cmddesc objecter_requests hook 0x5586b18e6f20 EEXIST 2024-09-14T11:09:23.518 INFO:tasks.workunit.client.0.smithi050.stderr: -368> 2024-09-14T11:09:23.176+0000 7f1f64412800 10 monclient: init 2024-09-14T11:09:23.518 INFO:tasks.workunit.client.0.smithi050.stderr: -367> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding auth protocol: cephx 2024-09-14T11:09:23.518 INFO:tasks.workunit.client.0.smithi050.stderr: -366> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding auth protocol: cephx 2024-09-14T11:09:23.518 INFO:tasks.workunit.client.0.smithi050.stderr: -365> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding auth protocol: cephx 2024-09-14T11:09:23.518 INFO:tasks.workunit.client.0.smithi050.stderr: -364> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding con mode: secure 2024-09-14T11:09:23.518 INFO:tasks.workunit.client.0.smithi050.stderr: -363> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding con mode: crc 2024-09-14T11:09:23.518 INFO:tasks.workunit.client.0.smithi050.stderr: -362> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding con mode: secure 2024-09-14T11:09:23.518 INFO:tasks.workunit.client.0.smithi050.stderr: -361> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding con mode: crc 2024-09-14T11:09:23.518 INFO:tasks.workunit.client.0.smithi050.stderr: -360> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding con mode: secure 2024-09-14T11:09:23.518 INFO:tasks.workunit.client.0.smithi050.stderr: -359> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding con mode: crc 2024-09-14T11:09:23.518 INFO:tasks.workunit.client.0.smithi050.stderr: -358> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding con mode: crc 2024-09-14T11:09:23.518 INFO:tasks.workunit.client.0.smithi050.stderr: -357> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding con mode: secure 2024-09-14T11:09:23.519 INFO:tasks.workunit.client.0.smithi050.stderr: -356> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding con mode: crc 2024-09-14T11:09:23.519 INFO:tasks.workunit.client.0.smithi050.stderr: -355> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding con mode: secure 2024-09-14T11:09:23.519 INFO:tasks.workunit.client.0.smithi050.stderr: -354> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding con mode: crc 2024-09-14T11:09:23.519 INFO:tasks.workunit.client.0.smithi050.stderr: -353> 2024-09-14T11:09:23.176+0000 7f1f64412800 5 AuthRegistry(0x5586b18e20d8) adding con mode: secure 2024-09-14T11:09:23.519 INFO:tasks.workunit.client.0.smithi050.stderr: -352> 2024-09-14T11:09:23.177+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.519 INFO:tasks.workunit.client.0.smithi050.stderr: -351> 2024-09-14T11:09:23.177+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.519 INFO:tasks.workunit.client.0.smithi050.stderr: -350> 2024-09-14T11:09:23.177+0000 7f1f64412800 5 asok(0x5586b166e270) register_command rotate-key cmddesc rotate-key hook 0x5586b18e2220 EEXIST 2024-09-14T11:09:23.519 INFO:tasks.workunit.client.0.smithi050.stderr: -349> 2024-09-14T11:09:23.177+0000 7f1f64412800 10 monclient: _reopen_session rank -1 2024-09-14T11:09:23.519 INFO:tasks.workunit.client.0.smithi050.stderr: -348> 2024-09-14T11:09:23.177+0000 7f1f64412800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:09:23.519 INFO:tasks.workunit.client.0.smithi050.stderr: -347> 2024-09-14T11:09:23.177+0000 7f1f64412800 10 monclient(hunting): picked mon.noname-a con 0x5586b190b240 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:09:23.519 INFO:tasks.workunit.client.0.smithi050.stderr: -346> 2024-09-14T11:09:23.177+0000 7f1f64412800 10 monclient(hunting): picked mon.noname-b con 0x5586b190b620 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:09:23.520 INFO:tasks.workunit.client.0.smithi050.stderr: -345> 2024-09-14T11:09:23.177+0000 7f1f64412800 10 monclient(hunting): picked mon.noname-c con 0x5586b1909f50 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:09:23.520 INFO:tasks.workunit.client.0.smithi050.stderr: -344> 2024-09-14T11:09:23.177+0000 7f1f64412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:09:23.520 INFO:tasks.workunit.client.0.smithi050.stderr: -343> 2024-09-14T11:09:23.177+0000 7f1f64412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:09:23.520 INFO:tasks.workunit.client.0.smithi050.stderr: -342> 2024-09-14T11:09:23.177+0000 7f1f64412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:09:23.520 INFO:tasks.workunit.client.0.smithi050.stderr: -341> 2024-09-14T11:09:23.177+0000 7f1f64412800 10 monclient(hunting): _renew_subs 2024-09-14T11:09:23.520 INFO:tasks.workunit.client.0.smithi050.stderr: -340> 2024-09-14T11:09:23.177+0000 7f1f64412800 10 monclient(hunting): authenticate will time out at 2215.814447s 2024-09-14T11:09:23.520 INFO:tasks.workunit.client.0.smithi050.stderr: -339> 2024-09-14T11:09:23.177+0000 7f1f603e1640 10 monclient(hunting): get_auth_request con 0x5586b1909f50 auth_method 0 2024-09-14T11:09:23.520 INFO:tasks.workunit.client.0.smithi050.stderr: -338> 2024-09-14T11:09:23.177+0000 7f1f603e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:09:23.520 INFO:tasks.workunit.client.0.smithi050.stderr: -337> 2024-09-14T11:09:23.177+0000 7f1f603e1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:09:23.520 INFO:tasks.workunit.client.0.smithi050.stderr: -336> 2024-09-14T11:09:23.177+0000 7f1f603e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:09:23.520 INFO:tasks.workunit.client.0.smithi050.stderr: -335> 2024-09-14T11:09:23.177+0000 7f1f5fbe0640 10 monclient(hunting): get_auth_request con 0x5586b190b240 auth_method 0 2024-09-14T11:09:23.520 INFO:tasks.workunit.client.0.smithi050.stderr: -334> 2024-09-14T11:09:23.177+0000 7f1f5fbe0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:09:23.521 INFO:tasks.workunit.client.0.smithi050.stderr: -333> 2024-09-14T11:09:23.177+0000 7f1f5fbe0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:09:23.521 INFO:tasks.workunit.client.0.smithi050.stderr: -332> 2024-09-14T11:09:23.177+0000 7f1f5fbe0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:09:23.521 INFO:tasks.workunit.client.0.smithi050.stderr: -331> 2024-09-14T11:09:23.177+0000 7f1f5f3df640 10 monclient(hunting): get_auth_request con 0x5586b190b620 auth_method 0 2024-09-14T11:09:23.521 INFO:tasks.workunit.client.0.smithi050.stderr: -330> 2024-09-14T11:09:23.177+0000 7f1f5f3df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:09:23.521 INFO:tasks.workunit.client.0.smithi050.stderr: -329> 2024-09-14T11:09:23.177+0000 7f1f5f3df640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:09:23.521 INFO:tasks.workunit.client.0.smithi050.stderr: -328> 2024-09-14T11:09:23.177+0000 7f1f5f3df640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:09:23.521 INFO:tasks.workunit.client.0.smithi050.stderr: -327> 2024-09-14T11:09:23.177+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:09:23.521 INFO:tasks.workunit.client.0.smithi050.stderr: -326> 2024-09-14T11:09:23.177+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:09:23.521 INFO:tasks.workunit.client.0.smithi050.stderr: -325> 2024-09-14T11:09:23.177+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:09:23.521 INFO:tasks.workunit.client.0.smithi050.stderr: -324> 2024-09-14T11:09:23.177+0000 7f1f603e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:09:23.521 INFO:tasks.workunit.client.0.smithi050.stderr: -323> 2024-09-14T11:09:23.177+0000 7f1f603e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:09:23.521 INFO:tasks.workunit.client.0.smithi050.stderr: -322> 2024-09-14T11:09:23.177+0000 7f1f603e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:09:23.522 INFO:tasks.workunit.client.0.smithi050.stderr: -321> 2024-09-14T11:09:23.177+0000 7f1f5f3df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:09:23.522 INFO:tasks.workunit.client.0.smithi050.stderr: -320> 2024-09-14T11:09:23.177+0000 7f1f5f3df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:09:23.522 INFO:tasks.workunit.client.0.smithi050.stderr: -319> 2024-09-14T11:09:23.177+0000 7f1f5f3df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:09:23.522 INFO:tasks.workunit.client.0.smithi050.stderr: -318> 2024-09-14T11:09:23.177+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_done global_id 6420 payload 824 2024-09-14T11:09:23.522 INFO:tasks.workunit.client.0.smithi050.stderr: -317> 2024-09-14T11:09:23.177+0000 7f1f5fbe0640 10 monclient: _finish_hunting 0 2024-09-14T11:09:23.522 INFO:tasks.workunit.client.0.smithi050.stderr: -316> 2024-09-14T11:09:23.177+0000 7f1f5fbe0640 1 monclient: found mon.noname-a 2024-09-14T11:09:23.522 INFO:tasks.workunit.client.0.smithi050.stderr: -315> 2024-09-14T11:09:23.177+0000 7f1f5fbe0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:09:23.522 INFO:tasks.workunit.client.0.smithi050.stderr: -314> 2024-09-14T11:09:23.178+0000 7f1e457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:09:23.522 INFO:tasks.workunit.client.0.smithi050.stderr: -313> 2024-09-14T11:09:23.178+0000 7f1e457fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:09:23.522 INFO:tasks.workunit.client.0.smithi050.stderr: -312> 2024-09-14T11:09:23.178+0000 7f1e457fa640 10 monclient: dump: 2024-09-14T11:09:23.522 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:09:23.522 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:09:23.522 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.523 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.523 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:09:23.523 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.523 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:09:23.523 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:09:23.523 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:09:23.523 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.523 INFO:tasks.workunit.client.0.smithi050.stderr: -311> 2024-09-14T11:09:23.178+0000 7f1e457fa640 10 monclient: _finish_auth 0 2024-09-14T11:09:23.523 INFO:tasks.workunit.client.0.smithi050.stderr: -310> 2024-09-14T11:09:23.178+0000 7f1e457fa640 10 monclient: _check_auth_tickets 2024-09-14T11:09:23.523 INFO:tasks.workunit.client.0.smithi050.stderr: -309> 2024-09-14T11:09:23.178+0000 7f1e457fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:09:23.523 INFO:tasks.workunit.client.0.smithi050.stderr: -308> 2024-09-14T11:09:23.178+0000 7f1e457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:09:23.523 INFO:tasks.workunit.client.0.smithi050.stderr: -307> 2024-09-14T11:09:23.178+0000 7f1e457fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:09:23.523 INFO:tasks.workunit.client.0.smithi050.stderr: -306> 2024-09-14T11:09:23.178+0000 7f1e457fa640 10 monclient: dump: 2024-09-14T11:09:23.524 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:09:23.524 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:09:23.524 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.524 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.524 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:09:23.524 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.524 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:09:23.524 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:09:23.524 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:09:23.524 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.524 INFO:tasks.workunit.client.0.smithi050.stderr: -305> 2024-09-14T11:09:23.178+0000 7f1f64412800 5 monclient: authenticate success, global_id 6420 2024-09-14T11:09:23.524 INFO:tasks.workunit.client.0.smithi050.stderr: -304> 2024-09-14T11:09:23.178+0000 7f1f64412800 10 monclient: _renew_subs 2024-09-14T11:09:23.524 INFO:tasks.workunit.client.0.smithi050.stderr: -303> 2024-09-14T11:09:23.178+0000 7f1f64412800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:09:23.525 INFO:tasks.workunit.client.0.smithi050.stderr: -302> 2024-09-14T11:09:23.178+0000 7f1f60be2640 4 set_mon_vals no callback set 2024-09-14T11:09:23.525 INFO:tasks.workunit.client.0.smithi050.stderr: -301> 2024-09-14T11:09:23.178+0000 7f1f64412800 10 monclient: _renew_subs 2024-09-14T11:09:23.525 INFO:tasks.workunit.client.0.smithi050.stderr: -300> 2024-09-14T11:09:23.178+0000 7f1f64412800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:09:23.525 INFO:tasks.workunit.client.0.smithi050.stderr: -299> 2024-09-14T11:09:23.180+0000 7f1e457fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:09:23.525 INFO:tasks.workunit.client.0.smithi050.stderr: -298> 2024-09-14T11:09:23.180+0000 7f1e457fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:09:23.525 INFO:tasks.workunit.client.0.smithi050.stderr: -297> 2024-09-14T11:09:23.180+0000 7f1e457fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:09:23.525 INFO:tasks.workunit.client.0.smithi050.stderr: -296> 2024-09-14T11:09:23.180+0000 7f1f5f3df640 10 monclient: get_auth_request con 0x7f1e38077140 auth_method 0 2024-09-14T11:09:23.525 INFO:tasks.workunit.client.0.smithi050.stderr: -295> 2024-09-14T11:09:23.180+0000 7f1f64412800 10 monclient: get_monmap_and_config 2024-09-14T11:09:23.525 INFO:tasks.workunit.client.0.smithi050.stderr: -294> 2024-09-14T11:09:23.180+0000 7f1f64412800 10 monclient: build_initial_monmap 2024-09-14T11:09:23.525 INFO:tasks.workunit.client.0.smithi050.stderr: -293> 2024-09-14T11:09:23.180+0000 7f1f64412800 1 build_initial for_mkfs: 0 2024-09-14T11:09:23.525 INFO:tasks.workunit.client.0.smithi050.stderr: -292> 2024-09-14T11:09:23.180+0000 7f1f64412800 10 monclient: monmap: 2024-09-14T11:09:23.526 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:09:23.526 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:09:23.526 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:09:23.526 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:09:23.526 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:09:23.526 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.526 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:09:23.526 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:09:23.526 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:09:23.526 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.526 INFO:tasks.workunit.client.0.smithi050.stderr: -291> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding auth protocol: cephx 2024-09-14T11:09:23.526 INFO:tasks.workunit.client.0.smithi050.stderr: -290> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding auth protocol: cephx 2024-09-14T11:09:23.526 INFO:tasks.workunit.client.0.smithi050.stderr: -289> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding auth protocol: cephx 2024-09-14T11:09:23.527 INFO:tasks.workunit.client.0.smithi050.stderr: -288> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding con mode: secure 2024-09-14T11:09:23.527 INFO:tasks.workunit.client.0.smithi050.stderr: -287> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding con mode: crc 2024-09-14T11:09:23.527 INFO:tasks.workunit.client.0.smithi050.stderr: -286> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding con mode: secure 2024-09-14T11:09:23.527 INFO:tasks.workunit.client.0.smithi050.stderr: -285> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding con mode: crc 2024-09-14T11:09:23.527 INFO:tasks.workunit.client.0.smithi050.stderr: -284> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding con mode: secure 2024-09-14T11:09:23.527 INFO:tasks.workunit.client.0.smithi050.stderr: -283> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding con mode: crc 2024-09-14T11:09:23.527 INFO:tasks.workunit.client.0.smithi050.stderr: -282> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding con mode: crc 2024-09-14T11:09:23.527 INFO:tasks.workunit.client.0.smithi050.stderr: -281> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding con mode: secure 2024-09-14T11:09:23.527 INFO:tasks.workunit.client.0.smithi050.stderr: -280> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding con mode: crc 2024-09-14T11:09:23.527 INFO:tasks.workunit.client.0.smithi050.stderr: -279> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding con mode: secure 2024-09-14T11:09:23.527 INFO:tasks.workunit.client.0.smithi050.stderr: -278> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding con mode: crc 2024-09-14T11:09:23.527 INFO:tasks.workunit.client.0.smithi050.stderr: -277> 2024-09-14T11:09:23.180+0000 7f1f64412800 5 AuthRegistry(0x5586b192ae70) adding con mode: secure 2024-09-14T11:09:23.528 INFO:tasks.workunit.client.0.smithi050.stderr: -276> 2024-09-14T11:09:23.180+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.528 INFO:tasks.workunit.client.0.smithi050.stderr: -275> 2024-09-14T11:09:23.181+0000 7f1f64412800 10 monclient: init 2024-09-14T11:09:23.528 INFO:tasks.workunit.client.0.smithi050.stderr: -274> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding auth protocol: cephx 2024-09-14T11:09:23.528 INFO:tasks.workunit.client.0.smithi050.stderr: -273> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding auth protocol: cephx 2024-09-14T11:09:23.528 INFO:tasks.workunit.client.0.smithi050.stderr: -272> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding auth protocol: cephx 2024-09-14T11:09:23.528 INFO:tasks.workunit.client.0.smithi050.stderr: -271> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding con mode: secure 2024-09-14T11:09:23.528 INFO:tasks.workunit.client.0.smithi050.stderr: -270> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding con mode: crc 2024-09-14T11:09:23.528 INFO:tasks.workunit.client.0.smithi050.stderr: -269> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding con mode: secure 2024-09-14T11:09:23.528 INFO:tasks.workunit.client.0.smithi050.stderr: -268> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding con mode: crc 2024-09-14T11:09:23.528 INFO:tasks.workunit.client.0.smithi050.stderr: -267> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding con mode: secure 2024-09-14T11:09:23.528 INFO:tasks.workunit.client.0.smithi050.stderr: -266> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding con mode: crc 2024-09-14T11:09:23.528 INFO:tasks.workunit.client.0.smithi050.stderr: -265> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding con mode: crc 2024-09-14T11:09:23.528 INFO:tasks.workunit.client.0.smithi050.stderr: -264> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding con mode: secure 2024-09-14T11:09:23.529 INFO:tasks.workunit.client.0.smithi050.stderr: -263> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding con mode: crc 2024-09-14T11:09:23.529 INFO:tasks.workunit.client.0.smithi050.stderr: -262> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding con mode: secure 2024-09-14T11:09:23.529 INFO:tasks.workunit.client.0.smithi050.stderr: -261> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding con mode: crc 2024-09-14T11:09:23.529 INFO:tasks.workunit.client.0.smithi050.stderr: -260> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 AuthRegistry(0x7fff771ba9e0) adding con mode: secure 2024-09-14T11:09:23.529 INFO:tasks.workunit.client.0.smithi050.stderr: -259> 2024-09-14T11:09:23.181+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.529 INFO:tasks.workunit.client.0.smithi050.stderr: -258> 2024-09-14T11:09:23.181+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.529 INFO:tasks.workunit.client.0.smithi050.stderr: -257> 2024-09-14T11:09:23.181+0000 7f1f64412800 5 asok(0x5586b166e270) register_command rotate-key cmddesc rotate-key hook 0x7fff771bab28 EEXIST 2024-09-14T11:09:23.529 INFO:tasks.workunit.client.0.smithi050.stderr: -256> 2024-09-14T11:09:23.181+0000 7f1f64412800 10 monclient: _reopen_session rank -1 2024-09-14T11:09:23.529 INFO:tasks.workunit.client.0.smithi050.stderr: -255> 2024-09-14T11:09:23.181+0000 7f1f64412800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:09:23.529 INFO:tasks.workunit.client.0.smithi050.stderr: -254> 2024-09-14T11:09:23.181+0000 7f1f64412800 10 monclient(hunting): picked mon.noname-b con 0x5586b195f470 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:09:23.529 INFO:tasks.workunit.client.0.smithi050.stderr: -253> 2024-09-14T11:09:23.181+0000 7f1f64412800 10 monclient(hunting): picked mon.noname-a con 0x5586b194fdc0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:09:23.529 INFO:tasks.workunit.client.0.smithi050.stderr: -252> 2024-09-14T11:09:23.181+0000 7f1f64412800 10 monclient(hunting): picked mon.noname-c con 0x5586b195a8a0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:09:23.530 INFO:tasks.workunit.client.0.smithi050.stderr: -251> 2024-09-14T11:09:23.181+0000 7f1f64412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:09:23.530 INFO:tasks.workunit.client.0.smithi050.stderr: -250> 2024-09-14T11:09:23.181+0000 7f1f64412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:09:23.530 INFO:tasks.workunit.client.0.smithi050.stderr: -249> 2024-09-14T11:09:23.181+0000 7f1f64412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:09:23.530 INFO:tasks.workunit.client.0.smithi050.stderr: -248> 2024-09-14T11:09:23.181+0000 7f1f64412800 10 monclient(hunting): _renew_subs 2024-09-14T11:09:23.530 INFO:tasks.workunit.client.0.smithi050.stderr: -247> 2024-09-14T11:09:23.181+0000 7f1f64412800 10 monclient(hunting): authenticate will time out at 2215.818672s 2024-09-14T11:09:23.530 INFO:tasks.workunit.client.0.smithi050.stderr: -246> 2024-09-14T11:09:23.181+0000 7f1f5f3df640 10 monclient(hunting): get_auth_request con 0x5586b194fdc0 auth_method 0 2024-09-14T11:09:23.530 INFO:tasks.workunit.client.0.smithi050.stderr: -245> 2024-09-14T11:09:23.181+0000 7f1f5f3df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:09:23.530 INFO:tasks.workunit.client.0.smithi050.stderr: -244> 2024-09-14T11:09:23.181+0000 7f1f5f3df640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:09:23.530 INFO:tasks.workunit.client.0.smithi050.stderr: -243> 2024-09-14T11:09:23.181+0000 7f1f5f3df640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:09:23.530 INFO:tasks.workunit.client.0.smithi050.stderr: -242> 2024-09-14T11:09:23.181+0000 7f1f603e1640 10 monclient(hunting): get_auth_request con 0x5586b195a8a0 auth_method 0 2024-09-14T11:09:23.530 INFO:tasks.workunit.client.0.smithi050.stderr: -241> 2024-09-14T11:09:23.181+0000 7f1f603e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:09:23.530 INFO:tasks.workunit.client.0.smithi050.stderr: -240> 2024-09-14T11:09:23.181+0000 7f1f603e1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:09:23.530 INFO:tasks.workunit.client.0.smithi050.stderr: -239> 2024-09-14T11:09:23.181+0000 7f1f603e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:09:23.531 INFO:tasks.workunit.client.0.smithi050.stderr: -238> 2024-09-14T11:09:23.181+0000 7f1f603e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:09:23.531 INFO:tasks.workunit.client.0.smithi050.stderr: -237> 2024-09-14T11:09:23.181+0000 7f1f603e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:09:23.531 INFO:tasks.workunit.client.0.smithi050.stderr: -236> 2024-09-14T11:09:23.181+0000 7f1f603e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:09:23.531 INFO:tasks.workunit.client.0.smithi050.stderr: -235> 2024-09-14T11:09:23.181+0000 7f1f5f3df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:09:23.531 INFO:tasks.workunit.client.0.smithi050.stderr: -234> 2024-09-14T11:09:23.181+0000 7f1f5f3df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:09:23.531 INFO:tasks.workunit.client.0.smithi050.stderr: -233> 2024-09-14T11:09:23.181+0000 7f1f5f3df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:09:23.531 INFO:tasks.workunit.client.0.smithi050.stderr: -232> 2024-09-14T11:09:23.181+0000 7f1f5fbe0640 10 monclient(hunting): get_auth_request con 0x5586b195f470 auth_method 0 2024-09-14T11:09:23.531 INFO:tasks.workunit.client.0.smithi050.stderr: -231> 2024-09-14T11:09:23.181+0000 7f1f5fbe0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:09:23.531 INFO:tasks.workunit.client.0.smithi050.stderr: -230> 2024-09-14T11:09:23.181+0000 7f1f5fbe0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:09:23.531 INFO:tasks.workunit.client.0.smithi050.stderr: -229> 2024-09-14T11:09:23.181+0000 7f1f5fbe0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:09:23.531 INFO:tasks.workunit.client.0.smithi050.stderr: -228> 2024-09-14T11:09:23.182+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:09:23.531 INFO:tasks.workunit.client.0.smithi050.stderr: -227> 2024-09-14T11:09:23.182+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:09:23.532 INFO:tasks.workunit.client.0.smithi050.stderr: -226> 2024-09-14T11:09:23.182+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:09:23.532 INFO:tasks.workunit.client.0.smithi050.stderr: -225> 2024-09-14T11:09:23.182+0000 7f1f603e1640 10 monclient(hunting): handle_auth_done global_id 6053 payload 274 2024-09-14T11:09:23.532 INFO:tasks.workunit.client.0.smithi050.stderr: -224> 2024-09-14T11:09:23.182+0000 7f1f603e1640 10 monclient: _finish_hunting 0 2024-09-14T11:09:23.532 INFO:tasks.workunit.client.0.smithi050.stderr: -223> 2024-09-14T11:09:23.182+0000 7f1f603e1640 1 monclient: found mon.noname-c 2024-09-14T11:09:23.532 INFO:tasks.workunit.client.0.smithi050.stderr: -222> 2024-09-14T11:09:23.182+0000 7f1f603e1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:09:23.532 INFO:tasks.workunit.client.0.smithi050.stderr: -221> 2024-09-14T11:09:23.182+0000 7f1e3effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:09:23.532 INFO:tasks.workunit.client.0.smithi050.stderr: -220> 2024-09-14T11:09:23.182+0000 7f1e3effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:09:23.532 INFO:tasks.workunit.client.0.smithi050.stderr: -219> 2024-09-14T11:09:23.182+0000 7f1e3effd640 10 monclient: dump: 2024-09-14T11:09:23.532 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:09:23.532 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:09:23.532 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.532 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.532 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:09:23.533 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.533 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:09:23.533 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:09:23.533 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:09:23.533 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.533 INFO:tasks.workunit.client.0.smithi050.stderr: -218> 2024-09-14T11:09:23.182+0000 7f1e3effd640 10 monclient: _finish_auth 0 2024-09-14T11:09:23.533 INFO:tasks.workunit.client.0.smithi050.stderr: -217> 2024-09-14T11:09:23.182+0000 7f1e3effd640 10 monclient: _check_auth_tickets 2024-09-14T11:09:23.533 INFO:tasks.workunit.client.0.smithi050.stderr: -216> 2024-09-14T11:09:23.182+0000 7f1e3effd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:09:23.533 INFO:tasks.workunit.client.0.smithi050.stderr: -215> 2024-09-14T11:09:23.182+0000 7f1e3effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:09:23.533 INFO:tasks.workunit.client.0.smithi050.stderr: -214> 2024-09-14T11:09:23.182+0000 7f1e3effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:09:23.533 INFO:tasks.workunit.client.0.smithi050.stderr: -213> 2024-09-14T11:09:23.182+0000 7f1e3effd640 10 monclient: dump: 2024-09-14T11:09:23.533 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:09:23.533 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:09:23.534 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.534 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.534 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:09:23.534 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.534 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:09:23.534 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:09:23.534 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:09:23.534 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.534 INFO:tasks.workunit.client.0.smithi050.stderr: -212> 2024-09-14T11:09:23.182+0000 7f1f64412800 5 monclient: authenticate success, global_id 6053 2024-09-14T11:09:23.534 INFO:tasks.workunit.client.0.smithi050.stderr: -211> 2024-09-14T11:09:23.182+0000 7f1f64412800 10 monclient: get_monmap_and_config success 2024-09-14T11:09:23.534 INFO:tasks.workunit.client.0.smithi050.stderr: -210> 2024-09-14T11:09:23.182+0000 7f1f64412800 4 set_mon_vals no callback set 2024-09-14T11:09:23.534 INFO:tasks.workunit.client.0.smithi050.stderr: -209> 2024-09-14T11:09:23.183+0000 7f1f64412800 10 monclient: shutdown 2024-09-14T11:09:23.534 INFO:tasks.workunit.client.0.smithi050.stderr: -208> 2024-09-14T11:09:23.183+0000 7f1f64412800 10 monclient: build_initial_monmap 2024-09-14T11:09:23.535 INFO:tasks.workunit.client.0.smithi050.stderr: -207> 2024-09-14T11:09:23.183+0000 7f1f64412800 1 build_initial for_mkfs: 0 2024-09-14T11:09:23.535 INFO:tasks.workunit.client.0.smithi050.stderr: -206> 2024-09-14T11:09:23.183+0000 7f1f64412800 10 monclient: monmap: 2024-09-14T11:09:23.535 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:09:23.535 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:09:23.535 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:09:23.535 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:09:23.535 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:09:23.535 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.535 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:09:23.535 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:09:23.535 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:09:23.535 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.535 INFO:tasks.workunit.client.0.smithi050.stderr: -205> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding auth protocol: cephx 2024-09-14T11:09:23.535 INFO:tasks.workunit.client.0.smithi050.stderr: -204> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding auth protocol: cephx 2024-09-14T11:09:23.536 INFO:tasks.workunit.client.0.smithi050.stderr: -203> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding auth protocol: cephx 2024-09-14T11:09:23.536 INFO:tasks.workunit.client.0.smithi050.stderr: -202> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding con mode: secure 2024-09-14T11:09:23.536 INFO:tasks.workunit.client.0.smithi050.stderr: -201> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding con mode: crc 2024-09-14T11:09:23.536 INFO:tasks.workunit.client.0.smithi050.stderr: -200> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding con mode: secure 2024-09-14T11:09:23.536 INFO:tasks.workunit.client.0.smithi050.stderr: -199> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding con mode: crc 2024-09-14T11:09:23.536 INFO:tasks.workunit.client.0.smithi050.stderr: -198> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding con mode: secure 2024-09-14T11:09:23.536 INFO:tasks.workunit.client.0.smithi050.stderr: -197> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding con mode: crc 2024-09-14T11:09:23.536 INFO:tasks.workunit.client.0.smithi050.stderr: -196> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding con mode: crc 2024-09-14T11:09:23.536 INFO:tasks.workunit.client.0.smithi050.stderr: -195> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding con mode: secure 2024-09-14T11:09:23.536 INFO:tasks.workunit.client.0.smithi050.stderr: -194> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding con mode: crc 2024-09-14T11:09:23.536 INFO:tasks.workunit.client.0.smithi050.stderr: -193> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding con mode: secure 2024-09-14T11:09:23.537 INFO:tasks.workunit.client.0.smithi050.stderr: -192> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding con mode: crc 2024-09-14T11:09:23.537 INFO:tasks.workunit.client.0.smithi050.stderr: -191> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b19502b0) adding con mode: secure 2024-09-14T11:09:23.537 INFO:tasks.workunit.client.0.smithi050.stderr: -190> 2024-09-14T11:09:23.183+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.537 INFO:tasks.workunit.client.0.smithi050.stderr: -189> 2024-09-14T11:09:23.183+0000 7f1f64412800 1 librados: starting msgr at 2024-09-14T11:09:23.537 INFO:tasks.workunit.client.0.smithi050.stderr: -188> 2024-09-14T11:09:23.183+0000 7f1f64412800 1 librados: starting objecter 2024-09-14T11:09:23.537 INFO:tasks.workunit.client.0.smithi050.stderr: -187> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 asok(0x5586b166e270) register_command objecter_requests cmddesc objecter_requests hook 0x5586b19592c0 EEXIST 2024-09-14T11:09:23.537 INFO:tasks.workunit.client.0.smithi050.stderr: -186> 2024-09-14T11:09:23.183+0000 7f1f64412800 1 librados: setting wanted keys 2024-09-14T11:09:23.537 INFO:tasks.workunit.client.0.smithi050.stderr: -185> 2024-09-14T11:09:23.183+0000 7f1f64412800 1 librados: calling monclient init 2024-09-14T11:09:23.537 INFO:tasks.workunit.client.0.smithi050.stderr: -184> 2024-09-14T11:09:23.183+0000 7f1f64412800 10 monclient: init 2024-09-14T11:09:23.537 INFO:tasks.workunit.client.0.smithi050.stderr: -183> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding auth protocol: cephx 2024-09-14T11:09:23.537 INFO:tasks.workunit.client.0.smithi050.stderr: -182> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding auth protocol: cephx 2024-09-14T11:09:23.537 INFO:tasks.workunit.client.0.smithi050.stderr: -181> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding auth protocol: cephx 2024-09-14T11:09:23.537 INFO:tasks.workunit.client.0.smithi050.stderr: -180> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding con mode: secure 2024-09-14T11:09:23.538 INFO:tasks.workunit.client.0.smithi050.stderr: -179> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding con mode: crc 2024-09-14T11:09:23.538 INFO:tasks.workunit.client.0.smithi050.stderr: -178> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding con mode: secure 2024-09-14T11:09:23.538 INFO:tasks.workunit.client.0.smithi050.stderr: -177> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding con mode: crc 2024-09-14T11:09:23.538 INFO:tasks.workunit.client.0.smithi050.stderr: -176> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding con mode: secure 2024-09-14T11:09:23.538 INFO:tasks.workunit.client.0.smithi050.stderr: -175> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding con mode: crc 2024-09-14T11:09:23.538 INFO:tasks.workunit.client.0.smithi050.stderr: -174> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding con mode: crc 2024-09-14T11:09:23.538 INFO:tasks.workunit.client.0.smithi050.stderr: -173> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding con mode: secure 2024-09-14T11:09:23.538 INFO:tasks.workunit.client.0.smithi050.stderr: -172> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding con mode: crc 2024-09-14T11:09:23.538 INFO:tasks.workunit.client.0.smithi050.stderr: -171> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding con mode: secure 2024-09-14T11:09:23.538 INFO:tasks.workunit.client.0.smithi050.stderr: -170> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding con mode: crc 2024-09-14T11:09:23.538 INFO:tasks.workunit.client.0.smithi050.stderr: -169> 2024-09-14T11:09:23.183+0000 7f1f64412800 5 AuthRegistry(0x5586b191fb00) adding con mode: secure 2024-09-14T11:09:23.538 INFO:tasks.workunit.client.0.smithi050.stderr: -168> 2024-09-14T11:09:23.183+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.538 INFO:tasks.workunit.client.0.smithi050.stderr: -167> 2024-09-14T11:09:23.184+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.539 INFO:tasks.workunit.client.0.smithi050.stderr: -166> 2024-09-14T11:09:23.184+0000 7f1f64412800 5 asok(0x5586b166e270) register_command rotate-key cmddesc rotate-key hook 0x5586b191fc48 EEXIST 2024-09-14T11:09:23.539 INFO:tasks.workunit.client.0.smithi050.stderr: -165> 2024-09-14T11:09:23.184+0000 7f1f64412800 10 monclient: _reopen_session rank -1 2024-09-14T11:09:23.539 INFO:tasks.workunit.client.0.smithi050.stderr: -164> 2024-09-14T11:09:23.184+0000 7f1f64412800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:09:23.539 INFO:tasks.workunit.client.0.smithi050.stderr: -163> 2024-09-14T11:09:23.184+0000 7f1f64412800 10 monclient(hunting): picked mon.noname-a con 0x5586b194fdc0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:09:23.539 INFO:tasks.workunit.client.0.smithi050.stderr: -162> 2024-09-14T11:09:23.184+0000 7f1f64412800 10 monclient(hunting): picked mon.noname-c con 0x5586b195a8a0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:09:23.539 INFO:tasks.workunit.client.0.smithi050.stderr: -161> 2024-09-14T11:09:23.184+0000 7f1f64412800 10 monclient(hunting): picked mon.noname-b con 0x5586b195f470 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:09:23.539 INFO:tasks.workunit.client.0.smithi050.stderr: -160> 2024-09-14T11:09:23.184+0000 7f1f64412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:09:23.539 INFO:tasks.workunit.client.0.smithi050.stderr: -159> 2024-09-14T11:09:23.184+0000 7f1f64412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:09:23.539 INFO:tasks.workunit.client.0.smithi050.stderr: -158> 2024-09-14T11:09:23.184+0000 7f1f64412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:09:23.539 INFO:tasks.workunit.client.0.smithi050.stderr: -157> 2024-09-14T11:09:23.184+0000 7f1f64412800 10 monclient(hunting): _renew_subs 2024-09-14T11:09:23.539 INFO:tasks.workunit.client.0.smithi050.stderr: -156> 2024-09-14T11:09:23.184+0000 7f1f64412800 10 monclient(hunting): authenticate will time out at 2215.821277s 2024-09-14T11:09:23.539 INFO:tasks.workunit.client.0.smithi050.stderr: -155> 2024-09-14T11:09:23.184+0000 7f1f5fbe0640 10 monclient(hunting): get_auth_request con 0x5586b194fdc0 auth_method 0 2024-09-14T11:09:23.540 INFO:tasks.workunit.client.0.smithi050.stderr: -154> 2024-09-14T11:09:23.184+0000 7f1f5fbe0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:09:23.540 INFO:tasks.workunit.client.0.smithi050.stderr: -153> 2024-09-14T11:09:23.184+0000 7f1f5fbe0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:09:23.540 INFO:tasks.workunit.client.0.smithi050.stderr: -152> 2024-09-14T11:09:23.184+0000 7f1f5fbe0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:09:23.540 INFO:tasks.workunit.client.0.smithi050.stderr: -151> 2024-09-14T11:09:23.184+0000 7f1f5f3df640 10 monclient(hunting): get_auth_request con 0x5586b195a8a0 auth_method 0 2024-09-14T11:09:23.540 INFO:tasks.workunit.client.0.smithi050.stderr: -150> 2024-09-14T11:09:23.184+0000 7f1f5f3df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:09:23.540 INFO:tasks.workunit.client.0.smithi050.stderr: -149> 2024-09-14T11:09:23.184+0000 7f1f5f3df640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:09:23.540 INFO:tasks.workunit.client.0.smithi050.stderr: -148> 2024-09-14T11:09:23.184+0000 7f1f5f3df640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:09:23.540 INFO:tasks.workunit.client.0.smithi050.stderr: -147> 2024-09-14T11:09:23.184+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:09:23.540 INFO:tasks.workunit.client.0.smithi050.stderr: -146> 2024-09-14T11:09:23.184+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:09:23.540 INFO:tasks.workunit.client.0.smithi050.stderr: -145> 2024-09-14T11:09:23.184+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:09:23.540 INFO:tasks.workunit.client.0.smithi050.stderr: -144> 2024-09-14T11:09:23.184+0000 7f1f603e1640 10 monclient(hunting): get_auth_request con 0x5586b195f470 auth_method 0 2024-09-14T11:09:23.540 INFO:tasks.workunit.client.0.smithi050.stderr: -143> 2024-09-14T11:09:23.184+0000 7f1f603e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:09:23.540 INFO:tasks.workunit.client.0.smithi050.stderr: -142> 2024-09-14T11:09:23.184+0000 7f1f603e1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:09:23.541 INFO:tasks.workunit.client.0.smithi050.stderr: -141> 2024-09-14T11:09:23.184+0000 7f1f603e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:09:23.541 INFO:tasks.workunit.client.0.smithi050.stderr: -140> 2024-09-14T11:09:23.184+0000 7f1f5f3df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:09:23.541 INFO:tasks.workunit.client.0.smithi050.stderr: -139> 2024-09-14T11:09:23.184+0000 7f1f5f3df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:09:23.541 INFO:tasks.workunit.client.0.smithi050.stderr: -138> 2024-09-14T11:09:23.184+0000 7f1f5f3df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:09:23.541 INFO:tasks.workunit.client.0.smithi050.stderr: -137> 2024-09-14T11:09:23.184+0000 7f1f603e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:09:23.541 INFO:tasks.workunit.client.0.smithi050.stderr: -136> 2024-09-14T11:09:23.184+0000 7f1f603e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:09:23.541 INFO:tasks.workunit.client.0.smithi050.stderr: -135> 2024-09-14T11:09:23.184+0000 7f1f603e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:09:23.541 INFO:tasks.workunit.client.0.smithi050.stderr: -134> 2024-09-14T11:09:23.184+0000 7f1f5fbe0640 10 monclient(hunting): handle_auth_done global_id 6426 payload 824 2024-09-14T11:09:23.541 INFO:tasks.workunit.client.0.smithi050.stderr: -133> 2024-09-14T11:09:23.184+0000 7f1f5fbe0640 10 monclient: _finish_hunting 0 2024-09-14T11:09:23.541 INFO:tasks.workunit.client.0.smithi050.stderr: -132> 2024-09-14T11:09:23.184+0000 7f1f5fbe0640 1 monclient: found mon.noname-a 2024-09-14T11:09:23.541 INFO:tasks.workunit.client.0.smithi050.stderr: -131> 2024-09-14T11:09:23.184+0000 7f1f5fbe0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:09:23.541 INFO:tasks.workunit.client.0.smithi050.stderr: -130> 2024-09-14T11:09:23.184+0000 7f1e3d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:09:23.541 INFO:tasks.workunit.client.0.smithi050.stderr: -129> 2024-09-14T11:09:23.184+0000 7f1e3d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:09:23.542 INFO:tasks.workunit.client.0.smithi050.stderr: -128> 2024-09-14T11:09:23.184+0000 7f1e3d7fa640 10 monclient: dump: 2024-09-14T11:09:23.542 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:09:23.542 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:09:23.542 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.542 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.542 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:09:23.542 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.542 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:09:23.542 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:09:23.542 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:09:23.542 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.542 INFO:tasks.workunit.client.0.smithi050.stderr: -127> 2024-09-14T11:09:23.184+0000 7f1e3d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:09:23.543 INFO:tasks.workunit.client.0.smithi050.stderr: -126> 2024-09-14T11:09:23.184+0000 7f1e3d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:09:23.543 INFO:tasks.workunit.client.0.smithi050.stderr: -125> 2024-09-14T11:09:23.184+0000 7f1e3d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:09:23.543 INFO:tasks.workunit.client.0.smithi050.stderr: -124> 2024-09-14T11:09:23.184+0000 7f1e3d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:09:23.543 INFO:tasks.workunit.client.0.smithi050.stderr: -123> 2024-09-14T11:09:23.185+0000 7f1e3d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:09:23.543 INFO:tasks.workunit.client.0.smithi050.stderr: -122> 2024-09-14T11:09:23.185+0000 7f1e3d7fa640 10 monclient: dump: 2024-09-14T11:09:23.543 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:09:23.543 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:09:23.543 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.543 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:09:23.543 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:09:23.543 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:09:23.543 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:09:23.543 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:09:23.544 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:09:23.544 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.544 INFO:tasks.workunit.client.0.smithi050.stderr: -121> 2024-09-14T11:09:23.185+0000 7f1f64412800 5 monclient: authenticate success, global_id 6426 2024-09-14T11:09:23.544 INFO:tasks.workunit.client.0.smithi050.stderr: -120> 2024-09-14T11:09:23.185+0000 7f1f64412800 10 monclient: _renew_subs 2024-09-14T11:09:23.544 INFO:tasks.workunit.client.0.smithi050.stderr: -119> 2024-09-14T11:09:23.184+0000 7f1e3effd640 4 set_mon_vals no callback set 2024-09-14T11:09:23.544 INFO:tasks.workunit.client.0.smithi050.stderr: -118> 2024-09-14T11:09:23.185+0000 7f1f64412800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:09:23.544 INFO:tasks.workunit.client.0.smithi050.stderr: -117> 2024-09-14T11:09:23.185+0000 7f1f64412800 10 monclient: _renew_subs 2024-09-14T11:09:23.544 INFO:tasks.workunit.client.0.smithi050.stderr: -116> 2024-09-14T11:09:23.185+0000 7f1f64412800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:09:23.544 INFO:tasks.workunit.client.0.smithi050.stderr: -115> 2024-09-14T11:09:23.185+0000 7f1f64412800 1 librados: init done 2024-09-14T11:09:23.544 INFO:tasks.workunit.client.0.smithi050.stderr: -114> 2024-09-14T11:09:23.185+0000 7f1f64412800 5 asok(0x5586b166e270) register_command cr dump hook 0x5586b19594e8 2024-09-14T11:09:23.544 INFO:tasks.workunit.client.0.smithi050.stderr: -113> 2024-09-14T11:09:23.186+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.544 INFO:tasks.workunit.client.0.smithi050.stderr: -112> 2024-09-14T11:09:23.187+0000 7f1e3d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:09:23.545 INFO:tasks.workunit.client.0.smithi050.stderr: -111> 2024-09-14T11:09:23.187+0000 7f1e3d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:09:23.545 INFO:tasks.workunit.client.0.smithi050.stderr: -110> 2024-09-14T11:09:23.187+0000 7f1e3d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:09:23.545 INFO:tasks.workunit.client.0.smithi050.stderr: -109> 2024-09-14T11:09:23.187+0000 7f1f5f3df640 10 monclient: get_auth_request con 0x7f1e28077260 auth_method 0 2024-09-14T11:09:23.545 INFO:tasks.workunit.client.0.smithi050.stderr: -108> 2024-09-14T11:09:23.187+0000 7f1f603e1640 10 monclient: get_auth_request con 0x5586b1979200 auth_method 0 2024-09-14T11:09:23.545 INFO:tasks.workunit.client.0.smithi050.stderr: -107> 2024-09-14T11:09:23.188+0000 7f1f64412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.545 INFO:tasks.workunit.client.0.smithi050.stderr: -106> 2024-09-14T11:09:23.188+0000 7f1f64412800 20 realm 2024-09-14T11:09:23.545 INFO:tasks.workunit.client.0.smithi050.stderr: -105> 2024-09-14T11:09:23.188+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.545 INFO:tasks.workunit.client.0.smithi050.stderr: -104> 2024-09-14T11:09:23.188+0000 7f1f64412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.545 INFO:tasks.workunit.client.0.smithi050.stderr: -103> 2024-09-14T11:09:23.188+0000 7f1f64412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:23.545 INFO:tasks.workunit.client.0.smithi050.stderr: -102> 2024-09-14T11:09:23.188+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.545 INFO:tasks.workunit.client.0.smithi050.stderr: -101> 2024-09-14T11:09:23.188+0000 7f1f64412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.545 INFO:tasks.workunit.client.0.smithi050.stderr: -100> 2024-09-14T11:09:23.188+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.545 INFO:tasks.workunit.client.0.smithi050.stderr: -99> 2024-09-14T11:09:23.188+0000 7f1f5fbe0640 10 monclient: get_auth_request con 0x5586b197d460 auth_method 0 2024-09-14T11:09:23.545 INFO:tasks.workunit.client.0.smithi050.stderr: -98> 2024-09-14T11:09:23.189+0000 7f1f64412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:23.546 INFO:tasks.workunit.client.0.smithi050.stderr: -97> 2024-09-14T11:09:23.189+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.546 INFO:tasks.workunit.client.0.smithi050.stderr: -96> 2024-09-14T11:09:23.189+0000 7f1f5f3df640 10 monclient: get_auth_request con 0x5586b1980ce0 auth_method 0 2024-09-14T11:09:23.546 INFO:tasks.workunit.client.0.smithi050.stderr: -95> 2024-09-14T11:09:23.190+0000 7f1f64412800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:23.546 INFO:tasks.workunit.client.0.smithi050.stderr: -94> 2024-09-14T11:09:23.190+0000 7f1f64412800 20 searching for the correct realm 2024-09-14T11:09:23.546 INFO:tasks.workunit.client.0.smithi050.stderr: -93> 2024-09-14T11:09:23.190+0000 7f1f603e1640 10 monclient: get_auth_request con 0x5586b1985aa0 auth_method 0 2024-09-14T11:09:23.546 INFO:tasks.workunit.client.0.smithi050.stderr: -92> 2024-09-14T11:09:23.191+0000 7f1f5fbe0640 10 monclient: get_auth_request con 0x7f1f5801a040 auth_method 0 2024-09-14T11:09:23.546 INFO:tasks.workunit.client.0.smithi050.stderr: -91> 2024-09-14T11:09:23.192+0000 7f1f603e1640 0 -- 172.21.15.50:0/3557204915 >> [v2:172.21.15.118:6816/4154782182,v1:172.21.15.118:6817/4154782182] conn(0x5586b1985aa0 msgr2=0x5586b1987f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:23.546 INFO:tasks.workunit.client.0.smithi050.stderr: -90> 2024-09-14T11:09:23.192+0000 7f1e3d7fa640 1 client.6426.objecter ms_handle_reset 0x5586b1985aa0 session 0x5586b1985420 osd.4 2024-09-14T11:09:23.546 INFO:tasks.workunit.client.0.smithi050.stderr: -89> 2024-09-14T11:09:23.193+0000 7f1e3d7fa640 10 monclient: _renew_subs 2024-09-14T11:09:23.546 INFO:tasks.workunit.client.0.smithi050.stderr: -88> 2024-09-14T11:09:23.193+0000 7f1e3d7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:09:23.546 INFO:tasks.workunit.client.0.smithi050.stderr: -87> 2024-09-14T11:09:23.193+0000 7f1f5f3df640 10 monclient: get_auth_request con 0x7f1f58025be0 auth_method 0 2024-09-14T11:09:23.547 INFO:tasks.workunit.client.0.smithi050.stderr: -86> 2024-09-14T11:09:23.193+0000 7f1f603e1640 10 monclient: get_auth_request con 0x7f1e28087570 auth_method 0 2024-09-14T11:09:23.547 INFO:tasks.workunit.client.0.smithi050.stderr: -85> 2024-09-14T11:09:23.195+0000 7f1f603e1640 10 monclient: get_auth_request con 0x7f1f5006b020 auth_method 0 2024-09-14T11:09:23.547 INFO:tasks.workunit.client.0.smithi050.stderr: -84> 2024-09-14T11:09:23.196+0000 7f1f5fbe0640 10 monclient: get_auth_request con 0x7f1f58046920 auth_method 0 2024-09-14T11:09:23.547 INFO:tasks.workunit.client.0.smithi050.stderr: -83> 2024-09-14T11:09:23.196+0000 7f1f5fbe0640 0 -- 172.21.15.50:0/3557204915 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f1f58046920 msgr2=0x7f1f580183a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:23.547 INFO:tasks.workunit.client.0.smithi050.stderr: -82> 2024-09-14T11:09:23.398+0000 7f1f5fbe0640 10 monclient: get_auth_request con 0x7f1f58046920 auth_method 0 2024-09-14T11:09:23.547 INFO:tasks.workunit.client.0.smithi050.stderr: -81> 2024-09-14T11:09:23.403+0000 7f1f64412800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:23.547 INFO:tasks.workunit.client.0.smithi050.stderr: -80> 2024-09-14T11:09:23.403+0000 7f1f64412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:23.547 INFO:tasks.workunit.client.0.smithi050.stderr: -79> 2024-09-14T11:09:23.403+0000 7f1f64412800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:23.547 INFO:tasks.workunit.client.0.smithi050.stderr: -78> 2024-09-14T11:09:23.403+0000 7f1f64412800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:23.547 INFO:tasks.workunit.client.0.smithi050.stderr: -77> 2024-09-14T11:09:23.403+0000 7f1f64412800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:23.547 INFO:tasks.workunit.client.0.smithi050.stderr: -76> 2024-09-14T11:09:23.403+0000 7f1f64412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:23.547 INFO:tasks.workunit.client.0.smithi050.stderr: -75> 2024-09-14T11:09:23.403+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.548 INFO:tasks.workunit.client.0.smithi050.stderr: -74> 2024-09-14T11:09:23.404+0000 7f1f64412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.548 INFO:tasks.workunit.client.0.smithi050.stderr: -73> 2024-09-14T11:09:23.404+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.548 INFO:tasks.workunit.client.0.smithi050.stderr: -72> 2024-09-14T11:09:23.404+0000 7f1f64412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:23.548 INFO:tasks.workunit.client.0.smithi050.stderr: -71> 2024-09-14T11:09:23.404+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.548 INFO:tasks.workunit.client.0.smithi050.stderr: -70> 2024-09-14T11:09:23.404+0000 7f1f64412800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:23.548 INFO:tasks.workunit.client.0.smithi050.stderr: -69> 2024-09-14T11:09:23.404+0000 7f1f64412800 20 zone default found 2024-09-14T11:09:23.548 INFO:tasks.workunit.client.0.smithi050.stderr: -68> 2024-09-14T11:09:23.404+0000 7f1f64412800 4 Realm: () 2024-09-14T11:09:23.548 INFO:tasks.workunit.client.0.smithi050.stderr: -67> 2024-09-14T11:09:23.404+0000 7f1f64412800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:23.548 INFO:tasks.workunit.client.0.smithi050.stderr: -66> 2024-09-14T11:09:23.404+0000 7f1f64412800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:23.548 INFO:tasks.workunit.client.0.smithi050.stderr: -65> 2024-09-14T11:09:23.404+0000 7f1f64412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:23.548 INFO:tasks.workunit.client.0.smithi050.stderr: -64> 2024-09-14T11:09:23.404+0000 7f1f64412800 20 zonegroup default 2024-09-14T11:09:23.548 INFO:tasks.workunit.client.0.smithi050.stderr: -63> 2024-09-14T11:09:23.404+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.548 INFO:tasks.workunit.client.0.smithi050.stderr: -62> 2024-09-14T11:09:23.405+0000 7f1f64412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.549 INFO:tasks.workunit.client.0.smithi050.stderr: -61> 2024-09-14T11:09:23.405+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.549 INFO:tasks.workunit.client.0.smithi050.stderr: -60> 2024-09-14T11:09:23.405+0000 7f1f64412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.549 INFO:tasks.workunit.client.0.smithi050.stderr: -59> 2024-09-14T11:09:23.405+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.549 INFO:tasks.workunit.client.0.smithi050.stderr: -58> 2024-09-14T11:09:23.405+0000 7f1f64412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.549 INFO:tasks.workunit.client.0.smithi050.stderr: -57> 2024-09-14T11:09:23.405+0000 7f1f64412800 20 started sync module instance, tier type = 2024-09-14T11:09:23.549 INFO:tasks.workunit.client.0.smithi050.stderr: -56> 2024-09-14T11:09:23.405+0000 7f1f64412800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:23.549 INFO:tasks.workunit.client.0.smithi050.stderr: -55> 2024-09-14T11:09:23.414+0000 7f1f64412800 20 add_watcher() i=0 2024-09-14T11:09:23.549 INFO:tasks.workunit.client.0.smithi050.stderr: -54> 2024-09-14T11:09:23.414+0000 7f1f64412800 20 add_watcher() i=1 2024-09-14T11:09:23.549 INFO:tasks.workunit.client.0.smithi050.stderr: -53> 2024-09-14T11:09:23.414+0000 7f1f64412800 20 add_watcher() i=2 2024-09-14T11:09:23.549 INFO:tasks.workunit.client.0.smithi050.stderr: -52> 2024-09-14T11:09:23.414+0000 7f1f64412800 20 add_watcher() i=3 2024-09-14T11:09:23.549 INFO:tasks.workunit.client.0.smithi050.stderr: -51> 2024-09-14T11:09:23.414+0000 7f1f64412800 20 add_watcher() i=4 2024-09-14T11:09:23.549 INFO:tasks.workunit.client.0.smithi050.stderr: -50> 2024-09-14T11:09:23.414+0000 7f1f64412800 20 add_watcher() i=5 2024-09-14T11:09:23.549 INFO:tasks.workunit.client.0.smithi050.stderr: -49> 2024-09-14T11:09:23.414+0000 7f1f64412800 20 add_watcher() i=6 2024-09-14T11:09:23.550 INFO:tasks.workunit.client.0.smithi050.stderr: -48> 2024-09-14T11:09:23.415+0000 7f1f64412800 20 add_watcher() i=7 2024-09-14T11:09:23.550 INFO:tasks.workunit.client.0.smithi050.stderr: -47> 2024-09-14T11:09:23.415+0000 7f1f64412800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:23.550 INFO:tasks.workunit.client.0.smithi050.stderr: -46> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding auth protocol: cephx 2024-09-14T11:09:23.550 INFO:tasks.workunit.client.0.smithi050.stderr: -45> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding auth protocol: cephx 2024-09-14T11:09:23.550 INFO:tasks.workunit.client.0.smithi050.stderr: -44> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding auth protocol: cephx 2024-09-14T11:09:23.550 INFO:tasks.workunit.client.0.smithi050.stderr: -43> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding con mode: secure 2024-09-14T11:09:23.550 INFO:tasks.workunit.client.0.smithi050.stderr: -42> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding con mode: crc 2024-09-14T11:09:23.550 INFO:tasks.workunit.client.0.smithi050.stderr: -41> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding con mode: secure 2024-09-14T11:09:23.550 INFO:tasks.workunit.client.0.smithi050.stderr: -40> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding con mode: crc 2024-09-14T11:09:23.550 INFO:tasks.workunit.client.0.smithi050.stderr: -39> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding con mode: secure 2024-09-14T11:09:23.550 INFO:tasks.workunit.client.0.smithi050.stderr: -38> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding con mode: crc 2024-09-14T11:09:23.550 INFO:tasks.workunit.client.0.smithi050.stderr: -37> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding con mode: crc 2024-09-14T11:09:23.551 INFO:tasks.workunit.client.0.smithi050.stderr: -36> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding con mode: secure 2024-09-14T11:09:23.551 INFO:tasks.workunit.client.0.smithi050.stderr: -35> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding con mode: crc 2024-09-14T11:09:23.551 INFO:tasks.workunit.client.0.smithi050.stderr: -34> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding con mode: secure 2024-09-14T11:09:23.551 INFO:tasks.workunit.client.0.smithi050.stderr: -33> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding con mode: crc 2024-09-14T11:09:23.551 INFO:tasks.workunit.client.0.smithi050.stderr: -32> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 AuthRegistry(0x7fff771baec0) adding con mode: secure 2024-09-14T11:09:23.551 INFO:tasks.workunit.client.0.smithi050.stderr: -31> 2024-09-14T11:09:23.417+0000 7f1e15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:23.551 INFO:tasks.workunit.client.0.smithi050.stderr: -30> 2024-09-14T11:09:23.417+0000 7f1f64412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:09:23.551 INFO:tasks.workunit.client.0.smithi050.stderr: -29> 2024-09-14T11:09:23.417+0000 7f1f64412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:23.551 INFO:tasks.workunit.client.0.smithi050.stderr: -28> 2024-09-14T11:09:23.417+0000 7f1f64412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:23.551 INFO:tasks.workunit.client.0.smithi050.stderr: -27> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 asok(0x5586b166e270) register_command cache list hook 0x5586b1955b70 2024-09-14T11:09:23.551 INFO:tasks.workunit.client.0.smithi050.stderr: -26> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 asok(0x5586b166e270) register_command cache inspect hook 0x5586b1955b70 2024-09-14T11:09:23.551 INFO:tasks.workunit.client.0.smithi050.stderr: -25> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 asok(0x5586b166e270) register_command cache erase hook 0x5586b1955b70 2024-09-14T11:09:23.552 INFO:tasks.workunit.client.0.smithi050.stderr: -24> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 asok(0x5586b166e270) register_command cache zap hook 0x5586b1955b70 2024-09-14T11:09:23.552 INFO:tasks.workunit.client.0.smithi050.stderr: -23> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 note: GC not initialized 2024-09-14T11:09:23.552 INFO:tasks.workunit.client.0.smithi050.stderr: -22> 2024-09-14T11:09:23.417+0000 7f1e14fe1640 20 reqs_thread_entry: start 2024-09-14T11:09:23.552 INFO:tasks.workunit.client.0.smithi050.stderr: -21> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 asok(0x5586b166e270) register_command sync trace show hook 0x7f1f58017870 2024-09-14T11:09:23.552 INFO:tasks.workunit.client.0.smithi050.stderr: -20> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 asok(0x5586b166e270) register_command sync trace history hook 0x7f1f58017870 2024-09-14T11:09:23.552 INFO:tasks.workunit.client.0.smithi050.stderr: -19> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 asok(0x5586b166e270) register_command sync trace active hook 0x7f1f58017870 2024-09-14T11:09:23.552 INFO:tasks.workunit.client.0.smithi050.stderr: -18> 2024-09-14T11:09:23.417+0000 7f1f64412800 5 asok(0x5586b166e270) register_command sync trace active_short hook 0x7f1f58017870 2024-09-14T11:09:23.552 INFO:tasks.workunit.client.0.smithi050.stderr: -17> 2024-09-14T11:09:23.417+0000 7f1f64412800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:23.552 INFO:tasks.workunit.client.0.smithi050.stderr: -16> 2024-09-14T11:09:23.417+0000 7f1f64412800 20 Filter name: none 2024-09-14T11:09:23.552 INFO:tasks.workunit.client.0.smithi050.stderr: -15> 2024-09-14T11:09:23.418+0000 7f1d8e7fc640 20 reqs_thread_entry: start 2024-09-14T11:09:23.552 INFO:tasks.workunit.client.0.smithi050.stderr: -14> 2024-09-14T11:09:23.418+0000 7f1f64412800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:09:23.552 INFO:tasks.workunit.client.0.smithi050.stderr: -13> 2024-09-14T11:09:23.418+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.552 INFO:tasks.workunit.client.0.smithi050.stderr: -12> 2024-09-14T11:09:23.418+0000 7f1f64412800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:09:23.553 INFO:tasks.workunit.client.0.smithi050.stderr: -11> 2024-09-14T11:09:23.418+0000 7f1f64412800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:09:23.553 INFO:tasks.workunit.client.0.smithi050.stderr: -10> 2024-09-14T11:09:23.418+0000 7f1f64412800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:09:23.553 INFO:tasks.workunit.client.0.smithi050.stderr: -9> 2024-09-14T11:09:23.418+0000 7f1f64412800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 : miss 2024-09-14T11:09:23.553 INFO:tasks.workunit.client.0.smithi050.stderr: -8> 2024-09-14T11:09:23.418+0000 7f1f64412800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.553 INFO:tasks.workunit.client.0.smithi050.stderr: -7> 2024-09-14T11:09:23.419+0000 7f1f64412800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:09:23.553 INFO:tasks.workunit.client.0.smithi050.stderr: -6> 2024-09-14T11:09:23.419+0000 7f1f64412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 info.flags=0x17 2024-09-14T11:09:23.553 INFO:tasks.workunit.client.0.smithi050.stderr: -5> 2024-09-14T11:09:23.419+0000 7f1f64412800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 to cache LRU end 2024-09-14T11:09:23.553 INFO:tasks.workunit.client.0.smithi050.stderr: -4> 2024-09-14T11:09:23.419+0000 7f1f64412800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:09:23.553 INFO:tasks.workunit.client.0.smithi050.stderr: -3> 2024-09-14T11:09:23.419+0000 7f1f64412800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:23.553 INFO:tasks.workunit.client.0.smithi050.stderr: -2> 2024-09-14T11:09:23.419+0000 7f1f64412800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 2024-09-14T11:09:23.553 INFO:tasks.workunit.client.0.smithi050.stderr: -1> 2024-09-14T11:09:23.421+0000 7f1f64412800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1f64412800 time 2024-09-14T11:09:23.421125+0000 2024-09-14T11:09:23.553 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:09:23.553 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.554 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:09:23.554 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1f6558c76a] 2024-09-14T11:09:23.554 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f1f6558c928] 2024-09-14T11:09:23.554 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5586af4cf0b1] 2024-09-14T11:09:23.554 INFO:tasks.workunit.client.0.smithi050.stderr: 4: radosgw-admin(+0xd882d4) [0x5586af9e22d4] 2024-09-14T11:09:23.554 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5586af4deefd] 2024-09-14T11:09:23.554 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:09:23.554 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1f64229590] 2024-09-14T11:09:23.554 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:09:23.554 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:09:23.554 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.554 INFO:tasks.workunit.client.0.smithi050.stderr: 0> 2024-09-14T11:09:23.422+0000 7f1f64412800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:09:23.554 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f1f64412800 thread_name:radosgw-admin 2024-09-14T11:09:23.555 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.555 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:09:23.555 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1f6423e6f0] 2024-09-14T11:09:23.555 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1f6428b99c] 2024-09-14T11:09:23.555 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:09:23.555 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:09:23.555 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1f6558c7c4] 2024-09-14T11:09:23.555 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f1f6558c928] 2024-09-14T11:09:23.555 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5586af4cf0b1] 2024-09-14T11:09:23.555 INFO:tasks.workunit.client.0.smithi050.stderr: 8: radosgw-admin(+0xd882d4) [0x5586af9e22d4] 2024-09-14T11:09:23.555 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5586af4deefd] 2024-09-14T11:09:23.555 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:09:23.556 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1f64229590] 2024-09-14T11:09:23.556 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:09:23.556 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:09:23.556 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:09:23.556 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.556 INFO:tasks.workunit.client.0.smithi050.stderr:--- logging levels --- 2024-09-14T11:09:23.556 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 none 2024-09-14T11:09:23.556 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 lockdep 2024-09-14T11:09:23.556 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 context 2024-09-14T11:09:23.556 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 crush 2024-09-14T11:09:23.556 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds 2024-09-14T11:09:23.556 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_balancer 2024-09-14T11:09:23.556 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_locker 2024-09-14T11:09:23.556 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log 2024-09-14T11:09:23.557 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log_expire 2024-09-14T11:09:23.557 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_migrator 2024-09-14T11:09:23.557 INFO:tasks.workunit.client.0.smithi050.stderr: 3/ 5 mds_quiesce 2024-09-14T11:09:23.557 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 buffer 2024-09-14T11:09:23.557 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 timer 2024-09-14T11:09:23.557 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 filer 2024-09-14T11:09:23.557 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 striper 2024-09-14T11:09:23.557 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 objecter 2024-09-14T11:09:23.557 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rados 2024-09-14T11:09:23.557 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd 2024-09-14T11:09:23.557 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_mirror 2024-09-14T11:09:23.557 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_replay 2024-09-14T11:09:23.557 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_pwl 2024-09-14T11:09:23.558 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 journaler 2024-09-14T11:09:23.558 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objectcacher 2024-09-14T11:09:23.558 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:09:23.558 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 client 2024-09-14T11:09:23.558 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 osd 2024-09-14T11:09:23.558 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 optracker 2024-09-14T11:09:23.558 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objclass 2024-09-14T11:09:23.558 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 filestore 2024-09-14T11:09:23.558 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 journal 2024-09-14T11:09:23.558 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 ms 2024-09-14T11:09:23.558 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mon 2024-09-14T11:09:23.558 INFO:tasks.workunit.client.0.smithi050.stderr: 0/10 monc 2024-09-14T11:09:23.558 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 paxos 2024-09-14T11:09:23.558 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 tp 2024-09-14T11:09:23.559 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 auth 2024-09-14T11:09:23.559 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 crypto 2024-09-14T11:09:23.559 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 finisher 2024-09-14T11:09:23.559 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 reserver 2024-09-14T11:09:23.559 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 heartbeatmap 2024-09-14T11:09:23.559 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 perfcounter 2024-09-14T11:09:23.559 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw 2024-09-14T11:09:23.559 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_sync 2024-09-14T11:09:23.559 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_datacache 2024-09-14T11:09:23.559 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_access 2024-09-14T11:09:23.559 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:09:23.559 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_flight 2024-09-14T11:09:23.559 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:09:23.559 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw_notification 2024-09-14T11:09:23.560 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 javaclient 2024-09-14T11:09:23.560 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 asok 2024-09-14T11:09:23.560 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 throttle 2024-09-14T11:09:23.560 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 refs 2024-09-14T11:09:23.560 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 compressor 2024-09-14T11:09:23.560 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluestore 2024-09-14T11:09:23.560 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluefs 2024-09-14T11:09:23.560 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 bdev 2024-09-14T11:09:23.560 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 kstore 2024-09-14T11:09:23.560 INFO:tasks.workunit.client.0.smithi050.stderr: 4/ 5 rocksdb 2024-09-14T11:09:23.560 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 fuse 2024-09-14T11:09:23.560 INFO:tasks.workunit.client.0.smithi050.stderr: 2/ 5 mgr 2024-09-14T11:09:23.560 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mgrc 2024-09-14T11:09:23.561 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 dpdk 2024-09-14T11:09:23.561 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 eventtrace 2024-09-14T11:09:23.561 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 prioritycache 2024-09-14T11:09:23.561 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 test 2024-09-14T11:09:23.561 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:09:23.561 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephsqlite 2024-09-14T11:09:23.561 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:09:23.561 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore 2024-09-14T11:09:23.561 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_onode 2024-09-14T11:09:23.561 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_odata 2024-09-14T11:09:23.561 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_omap 2024-09-14T11:09:23.561 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_tm 2024-09-14T11:09:23.561 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_t 2024-09-14T11:09:23.561 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:09:23.562 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_epm 2024-09-14T11:09:23.562 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_lba 2024-09-14T11:09:23.562 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:09:23.562 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cache 2024-09-14T11:09:23.562 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_journal 2024-09-14T11:09:23.562 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_device 2024-09-14T11:09:23.562 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_backref 2024-09-14T11:09:23.562 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 alienstore 2024-09-14T11:09:23.562 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mclock 2024-09-14T11:09:23.562 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cyanstore 2024-09-14T11:09:23.562 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 ceph_exporter 2024-09-14T11:09:23.562 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 memstore 2024-09-14T11:09:23.563 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 trace 2024-09-14T11:09:23.563 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 ceph_dedup 2024-09-14T11:09:23.563 INFO:tasks.workunit.client.0.smithi050.stderr: -2/-2 (syslog threshold) 2024-09-14T11:09:23.563 INFO:tasks.workunit.client.0.smithi050.stderr: 99/99 (stderr threshold) 2024-09-14T11:09:23.563 INFO:tasks.workunit.client.0.smithi050.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:09:23.563 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1d8e7fc640 / http_manager 2024-09-14T11:09:23.563 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1e14fe1640 / http_manager 2024-09-14T11:09:23.563 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1e15fe3640 / rgw_dt_lg_renew 2024-09-14T11:09:23.563 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1e3d7fa640 / ms_dispatch 2024-09-14T11:09:23.563 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1e3effd640 / io_context_pool 2024-09-14T11:09:23.563 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1e457fa640 / ms_dispatch 2024-09-14T11:09:23.563 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1e47fff640 / ms_dispatch 2024-09-14T11:09:23.563 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1e4de0b640 / io_context_pool 2024-09-14T11:09:23.563 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1f5f3df640 / msgr-worker-2 2024-09-14T11:09:23.564 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1f5fbe0640 / msgr-worker-1 2024-09-14T11:09:23.564 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1f603e1640 / msgr-worker-0 2024-09-14T11:09:23.564 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1f60be2640 / io_context_pool 2024-09-14T11:09:23.564 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1f64412800 / radosgw-admin 2024-09-14T11:09:23.564 INFO:tasks.workunit.client.0.smithi050.stderr: max_recent 500 2024-09-14T11:09:23.564 INFO:tasks.workunit.client.0.smithi050.stderr: max_new 1000 2024-09-14T11:09:23.564 INFO:tasks.workunit.client.0.smithi050.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:09:23.422841Z_c21925a8-3f07-4a99-af9c-b5912c83f30e/log 2024-09-14T11:09:23.564 INFO:tasks.workunit.client.0.smithi050.stderr:--- end dump of recent events --- 2024-09-14T11:09:23.564 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:09:23.566 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:23.566 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:23.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.504+0000 7f168cf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.506+0000 7f168cf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.506+0000 7f168cf2c800 20 realm 2024-09-14T11:09:23.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.506+0000 7f168cf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.506+0000 7f168cf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.506+0000 7f168cf2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:23.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.506+0000 7f168cf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.506+0000 7f168cf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.506+0000 7f168cf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.507+0000 7f168cf2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:23.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.507+0000 7f168cf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.508+0000 7f168cf2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:23.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.508+0000 7f168cf2c800 20 searching for the correct realm 2024-09-14T11:09:23.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.511+0000 7f1683fff640 0 -- 172.21.15.50:0/2735478071 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f168406b040 msgr2=0x7f16840639f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:23.715 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.717+0000 7f1689346640 0 -- 172.21.15.50:0/2735478071 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5634bd669940 msgr2=0x5634bd66bd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:23.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.720+0000 7f168cf2c800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:23.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.720+0000 7f168cf2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:23.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.720+0000 7f168cf2c800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:23.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.720+0000 7f168cf2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:23.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.720+0000 7f168cf2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:23.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.720+0000 7f168cf2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:23.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.721+0000 7f168cf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.721+0000 7f168cf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.721+0000 7f168cf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.720 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.721+0000 7f168cf2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:23.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.721+0000 7f168cf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.721+0000 7f168cf2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:23.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.721+0000 7f168cf2c800 20 zone default found 2024-09-14T11:09:23.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.721+0000 7f168cf2c800 4 Realm: () 2024-09-14T11:09:23.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.721+0000 7f168cf2c800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:23.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.721+0000 7f168cf2c800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:23.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.721+0000 7f168cf2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:23.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.721+0000 7f168cf2c800 20 zonegroup default 2024-09-14T11:09:23.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.721+0000 7f168cf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.722+0000 7f168cf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.722+0000 7f168cf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.721 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.722+0000 7f168cf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.722 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.722+0000 7f168cf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.722 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.722+0000 7f168cf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.722 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.722+0000 7f168cf2c800 20 started sync module instance, tier type = 2024-09-14T11:09:23.722 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.722+0000 7f168cf2c800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:23.728 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.730+0000 7f168cf2c800 20 add_watcher() i=0 2024-09-14T11:09:23.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.730+0000 7f168cf2c800 20 add_watcher() i=1 2024-09-14T11:09:23.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.730+0000 7f168cf2c800 20 add_watcher() i=2 2024-09-14T11:09:23.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.730+0000 7f168cf2c800 20 add_watcher() i=3 2024-09-14T11:09:23.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.730+0000 7f168cf2c800 20 add_watcher() i=4 2024-09-14T11:09:23.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.730+0000 7f168cf2c800 20 add_watcher() i=5 2024-09-14T11:09:23.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.730+0000 7f168cf2c800 20 add_watcher() i=6 2024-09-14T11:09:23.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.731+0000 7f168cf2c800 20 add_watcher() i=7 2024-09-14T11:09:23.730 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.731+0000 7f168cf2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:23.732 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.733+0000 7f153f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:23.732 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.734+0000 7f168cf2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:23.732 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.734+0000 7f168cf2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:23.733 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.734+0000 7f168cf2c800 5 note: GC not initialized 2024-09-14T11:09:23.733 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.734+0000 7f153e7e4640 20 reqs_thread_entry: start 2024-09-14T11:09:23.733 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.734+0000 7f168cf2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:23.733 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.734+0000 7f168cf2c800 20 Filter name: none 2024-09-14T11:09:23.733 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.734+0000 7f15377fe640 20 reqs_thread_entry: start 2024-09-14T11:09:23.733 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.734+0000 7f168cf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.735+0000 7f168cf2c800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:09:23.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.735+0000 7f168cf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.735+0000 7f168cf2c800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:09:23.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.735+0000 7f168cf2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:23.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.735+0000 7f168cf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.735+0000 7f168cf2c800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:09:23.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.735+0000 7f168cf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.736+0000 7f168cf2c800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:09:23.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.736+0000 7f168cf2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:23.736 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.738+0000 7f153f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:23.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.740+0000 7f168cf2c800 20 remove_watcher() i=0 2024-09-14T11:09:23.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.740+0000 7f168cf2c800 2 removed watcher, disabling cache 2024-09-14T11:09:23.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.741+0000 7f168cf2c800 20 remove_watcher() i=1 2024-09-14T11:09:23.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.742+0000 7f168cf2c800 20 remove_watcher() i=2 2024-09-14T11:09:23.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.743+0000 7f168cf2c800 20 remove_watcher() i=3 2024-09-14T11:09:23.743 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.745+0000 7f168cf2c800 20 remove_watcher() i=4 2024-09-14T11:09:23.744 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.746+0000 7f168cf2c800 20 remove_watcher() i=5 2024-09-14T11:09:23.745 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.747+0000 7f168cf2c800 20 remove_watcher() i=6 2024-09-14T11:09:23.746 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.748+0000 7f168cf2c800 20 remove_watcher() i=7 2024-09-14T11:09:23.758 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.758 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:09:23.758 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: abort-at-init-indext id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:09:23.758 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:23.760 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:23.760 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:23.793 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:23.793 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:23.851 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:09:23.885 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:23.886 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:23.925 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.927+0000 7f7958820800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.927 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.928+0000 7f7958820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.927 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.928+0000 7f7958820800 20 realm 2024-09-14T11:09:23.927 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.928+0000 7f7958820800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.927 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.929+0000 7f7958820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.927 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.929+0000 7f7958820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:23.927 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.929+0000 7f7958820800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.927 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.929+0000 7f7958820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:23.927 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.929+0000 7f7958820800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.929+0000 7f7958820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:23.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.929+0000 7f7958820800 20 rados->read ofs=0 len=0 2024-09-14T11:09:23.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.930+0000 7f7958820800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:23.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.930+0000 7f7958820800 20 searching for the correct realm 2024-09-14T11:09:23.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:23.933+0000 7f7955b09640 0 -- 172.21.15.50:0/2908549088 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f79500796e0 msgr2=0x7f7950076e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:09:24.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.138+0000 7f7955b09640 0 -- 172.21.15.50:0/2908549088 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x564f04a00e00 msgr2=0x564f04a032c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:24.140 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.142+0000 7f7958820800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:24.140 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.142+0000 7f7958820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:24.140 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.142+0000 7f7958820800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:24.141 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.142+0000 7f7958820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:24.141 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.142+0000 7f7958820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:24.141 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.142+0000 7f7958820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:24.141 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.142+0000 7f7958820800 20 rados->read ofs=0 len=0 2024-09-14T11:09:24.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.143+0000 7f7958820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:24.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.143+0000 7f7958820800 20 rados->read ofs=0 len=0 2024-09-14T11:09:24.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.143+0000 7f7958820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:24.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.143+0000 7f7958820800 20 rados->read ofs=0 len=0 2024-09-14T11:09:24.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.143+0000 7f7958820800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:24.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.143+0000 7f7958820800 20 zone default found 2024-09-14T11:09:24.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.143+0000 7f7958820800 4 Realm: () 2024-09-14T11:09:24.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.144+0000 7f7958820800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:24.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.144+0000 7f7958820800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:24.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.144+0000 7f7958820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:24.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.144+0000 7f7958820800 20 zonegroup default 2024-09-14T11:09:24.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.144+0000 7f7958820800 20 rados->read ofs=0 len=0 2024-09-14T11:09:24.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.144+0000 7f7958820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:24.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.144+0000 7f7958820800 20 rados->read ofs=0 len=0 2024-09-14T11:09:24.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.144+0000 7f7958820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:24.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.144+0000 7f7958820800 20 rados->read ofs=0 len=0 2024-09-14T11:09:24.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.144+0000 7f7958820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:24.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.144+0000 7f7958820800 20 started sync module instance, tier type = 2024-09-14T11:09:24.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.144+0000 7f7958820800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:24.151 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.153+0000 7f7958820800 20 add_watcher() i=0 2024-09-14T11:09:24.151 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.153+0000 7f7958820800 20 add_watcher() i=1 2024-09-14T11:09:24.151 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.153+0000 7f7958820800 20 add_watcher() i=2 2024-09-14T11:09:24.151 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.153+0000 7f7958820800 20 add_watcher() i=3 2024-09-14T11:09:24.151 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.153+0000 7f7958820800 20 add_watcher() i=4 2024-09-14T11:09:24.151 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.153+0000 7f7958820800 20 add_watcher() i=5 2024-09-14T11:09:24.151 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.153+0000 7f7958820800 20 add_watcher() i=6 2024-09-14T11:09:24.152 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.154+0000 7f7958820800 20 add_watcher() i=7 2024-09-14T11:09:24.152 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.154+0000 7f7958820800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:24.153 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.155+0000 7f780cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:24.154 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.156+0000 7f7958820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:24.154 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.156+0000 7f7958820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:24.155 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.156+0000 7f7958820800 5 note: GC not initialized 2024-09-14T11:09:24.155 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.156+0000 7f77877fe640 20 reqs_thread_entry: start 2024-09-14T11:09:24.155 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.156+0000 7f7958820800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:24.155 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.156+0000 7f7958820800 20 Filter name: none 2024-09-14T11:09:24.155 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.156+0000 7f77857fa640 20 reqs_thread_entry: start 2024-09-14T11:09:24.155 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.156+0000 7f7958820800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:09:24.155 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.156+0000 7f7958820800 20 rados->read ofs=0 len=0 2024-09-14T11:09:24.156 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.157+0000 7f7958820800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:09:24.156 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.157+0000 7f7958820800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:09:24.156 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.157+0000 7f7958820800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:09:24.156 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.157+0000 7f7958820800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 : miss 2024-09-14T11:09:24.156 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.157+0000 7f7958820800 20 rados->read ofs=0 len=0 2024-09-14T11:09:24.156 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.157+0000 7f7958820800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:09:24.156 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.157+0000 7f7958820800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 info.flags=0x17 2024-09-14T11:09:24.156 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.157+0000 7f7958820800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 to cache LRU end 2024-09-14T11:09:24.156 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.157+0000 7f7958820800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:09:24.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.157+0000 7f7958820800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:24.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.157+0000 7f7958820800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 2024-09-14T11:09:24.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.158+0000 7f7958820800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 to be held by another RGW process; skipping for now 2024-09-14T11:09:24.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.159+0000 7f780cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:24.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.161+0000 7f7958820800 20 remove_watcher() i=0 2024-09-14T11:09:24.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.161+0000 7f7958820800 2 removed watcher, disabling cache 2024-09-14T11:09:24.160 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.162+0000 7f7958820800 20 remove_watcher() i=1 2024-09-14T11:09:24.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.163+0000 7f7958820800 20 remove_watcher() i=2 2024-09-14T11:09:24.162 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.164+0000 7f7958820800 20 remove_watcher() i=3 2024-09-14T11:09:24.163 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.165+0000 7f7958820800 20 remove_watcher() i=4 2024-09-14T11:09:24.164 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.166+0000 7f7958820800 20 remove_watcher() i=5 2024-09-14T11:09:24.165 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.167+0000 7f7958820800 20 remove_watcher() i=6 2024-09-14T11:09:24.166 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:24.169+0000 7f7958820800 20 remove_watcher() i=7 2024-09-14T11:09:24.177 INFO:tasks.workunit.client.0.smithi050.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:09:54.210 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:09:54.248 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:54.248 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:54.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.296+0000 7fadb4722800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.297+0000 7fadb4722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:54.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.297+0000 7fadb4722800 20 realm 2024-09-14T11:09:54.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.297+0000 7fadb4722800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.298+0000 7fadb4722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:54.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.298+0000 7fadb4722800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:54.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.298+0000 7fadb4722800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.298+0000 7fadb4722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:54.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.298+0000 7fadb4722800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.299+0000 7fadb4722800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:54.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.299+0000 7fadb4722800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.300+0000 7fadb4722800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:54.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.300+0000 7fadb4722800 20 searching for the correct realm 2024-09-14T11:09:54.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.303+0000 7fadafbd1640 0 -- 172.21.15.50:0/381487883 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fada8071be0 msgr2=0x7fada806de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:54.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.510+0000 7fadafbd1640 0 -- 172.21.15.50:0/381487883 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5582fcc38410 msgr2=0x5582fcc3a8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:54.513 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.515+0000 7fadb4722800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:54.513 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.515+0000 7fadb4722800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:54.513 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.515+0000 7fadb4722800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:54.514 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.515+0000 7fadb4722800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:54.514 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.515+0000 7fadb4722800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:54.514 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.515+0000 7fadb4722800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:54.514 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.515+0000 7fadb4722800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.514 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.515+0000 7fadb4722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:54.514 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.515+0000 7fadb4722800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.515 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.516+0000 7fadb4722800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:54.515 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.516+0000 7fadb4722800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.515 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.516+0000 7fadb4722800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:54.515 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.516+0000 7fadb4722800 20 zone default found 2024-09-14T11:09:54.515 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.516+0000 7fadb4722800 4 Realm: () 2024-09-14T11:09:54.515 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.516+0000 7fadb4722800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:54.515 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.516+0000 7fadb4722800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:54.515 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.516+0000 7fadb4722800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:54.515 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.516+0000 7fadb4722800 20 zonegroup default 2024-09-14T11:09:54.515 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.516+0000 7fadb4722800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.515 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.516+0000 7fadb4722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:54.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.516+0000 7fadb4722800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.517+0000 7fadb4722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:54.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.517+0000 7fadb4722800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.517+0000 7fadb4722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:54.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.517+0000 7fadb4722800 20 started sync module instance, tier type = 2024-09-14T11:09:54.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.517+0000 7fadb4722800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:54.525 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.527+0000 7fadb4722800 20 add_watcher() i=0 2024-09-14T11:09:54.526 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.527+0000 7fadb4722800 20 add_watcher() i=1 2024-09-14T11:09:54.526 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.527+0000 7fadb4722800 20 add_watcher() i=2 2024-09-14T11:09:54.526 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.527+0000 7fadb4722800 20 add_watcher() i=3 2024-09-14T11:09:54.526 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.527+0000 7fadb4722800 20 add_watcher() i=4 2024-09-14T11:09:54.526 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.527+0000 7fadb4722800 20 add_watcher() i=5 2024-09-14T11:09:54.526 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.527+0000 7fadb4722800 20 add_watcher() i=6 2024-09-14T11:09:54.526 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.528+0000 7fadb4722800 20 add_watcher() i=7 2024-09-14T11:09:54.526 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.528+0000 7fadb4722800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:54.528 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.530+0000 7fac667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:54.529 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.531+0000 7fadb4722800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:54.529 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.531+0000 7fadb4722800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:54.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.531+0000 7fadb4722800 5 note: GC not initialized 2024-09-14T11:09:54.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.531+0000 7fac657e2640 20 reqs_thread_entry: start 2024-09-14T11:09:54.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.531+0000 7fadb4722800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:54.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.531+0000 7fadb4722800 20 Filter name: none 2024-09-14T11:09:54.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.531+0000 7fabd6ffd640 20 reqs_thread_entry: start 2024-09-14T11:09:54.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.531+0000 7fadb4722800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:09:54.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.531+0000 7fadb4722800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.532+0000 7fadb4722800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:09:54.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.532+0000 7fadb4722800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:09:54.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.532+0000 7fadb4722800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:09:54.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.532+0000 7fadb4722800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 : miss 2024-09-14T11:09:54.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.532+0000 7fadb4722800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.532+0000 7fadb4722800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:09:54.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.532+0000 7fadb4722800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 info.flags=0x17 2024-09-14T11:09:54.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.532+0000 7fadb4722800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 to cache LRU end 2024-09-14T11:09:54.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.532+0000 7fadb4722800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:09:54.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.532+0000 7fadb4722800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:54.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.532+0000 7fadb4722800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 2024-09-14T11:09:54.536 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.538+0000 7fadb4722800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 info.flags=0x17 2024-09-14T11:09:54.536 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.538+0000 7fadb4722800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 to cache LRU end 2024-09-14T11:09:54.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.538+0000 7fadb4722800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:54.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.538+0000 7fadb4722800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22, ofs0, ns] 2024-09-14T11:09:54.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.539+0000 7fac8effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497061 cookie 94021074859456 notifier 6480 bl.length()=997 2024-09-14T11:09:54.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.539+0000 7fac8effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 info.flags=0x17 2024-09-14T11:09:54.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.539+0000 7fac8effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 to cache LRU end 2024-09-14T11:09:54.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.539+0000 7fac8effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:54.539 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.541+0000 7fadb4722800 20 handle_bi_update(): bucket=:abort-at-init-indext[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22]): orig_sources= new_sources= 2024-09-14T11:09:54.539 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.541+0000 7fadb4722800 20 handle_bi_update(): bucket=:abort-at-init-indext[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22]): potential sources added=[] removed=[] 2024-09-14T11:09:54.539 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.541+0000 7fadb4722800 20 handle_bi_update(): bucket=:abort-at-init-indext[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22]): orig_dests= new_dests= 2024-09-14T11:09:54.539 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.541+0000 7fadb4722800 20 handle_bi_update(): bucket=:abort-at-init-indext[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22]): potential dests added=[] removed=[] 2024-09-14T11:09:54.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1.0 2024-09-14T11:09:54.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1.0 2024-09-14T11:09:54.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1.1 2024-09-14T11:09:54.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1.1 2024-09-14T11:09:54.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1.2 2024-09-14T11:09:54.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1.2 2024-09-14T11:09:54.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1.3 2024-09-14T11:09:54.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1.3 2024-09-14T11:09:54.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1.4 2024-09-14T11:09:54.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1.4 2024-09-14T11:09:54.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1.5 2024-09-14T11:09:54.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1.5 2024-09-14T11:09:54.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1.6 2024-09-14T11:09:54.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1.6 2024-09-14T11:09:54.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1.7 2024-09-14T11:09:54.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1.7 2024-09-14T11:09:54.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1.8 2024-09-14T11:09:54.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1.8 2024-09-14T11:09:54.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1.9 2024-09-14T11:09:54.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1.9 2024-09-14T11:09:54.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1.10 2024-09-14T11:09:54.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1.10 2024-09-14T11:09:54.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1.11 2024-09-14T11:09:54.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1.11 2024-09-14T11:09:54.547 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.546+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.0 2024-09-14T11:09:54.547 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.547+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1 2024-09-14T11:09:54.547 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.547+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.2 2024-09-14T11:09:54.548 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.548+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.3 2024-09-14T11:09:54.548 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.548+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.4 2024-09-14T11:09:54.548 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.549+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.5 2024-09-14T11:09:54.548 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.549+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.6 2024-09-14T11:09:54.548 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.550+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.7 2024-09-14T11:09:54.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.551+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.8 2024-09-14T11:09:54.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.551+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.9 2024-09-14T11:09:54.550 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.552+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.10 2024-09-14T11:09:54.553 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.555+0000 7fadb4722800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:09:54.553 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.555+0000 7fadb4722800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 2024-09-14T11:09:54.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.556+0000 7fadb4722800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 info.flags=0x17 2024-09-14T11:09:54.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.556+0000 7fadb4722800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 to cache LRU end 2024-09-14T11:09:54.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.556+0000 7fadb4722800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:54.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.556+0000 7fadb4722800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22, ofs0, ns] 2024-09-14T11:09:54.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.557+0000 7fac8effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497062 cookie 94021074859456 notifier 6480 bl.length()=997 2024-09-14T11:09:54.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.557+0000 7fac8effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 info.flags=0x17 2024-09-14T11:09:54.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.557+0000 7fac8effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 to cache LRU end 2024-09-14T11:09:54.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.557+0000 7fac8effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:54.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.559+0000 7fadb4722800 20 handle_bi_update(): bucket=:abort-at-init-indext[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22]): orig_sources= new_sources= 2024-09-14T11:09:54.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.559+0000 7fadb4722800 20 handle_bi_update(): bucket=:abort-at-init-indext[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22]): potential sources added=[] removed=[] 2024-09-14T11:09:54.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.559+0000 7fadb4722800 20 handle_bi_update(): bucket=:abort-at-init-indext[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22]): orig_dests= new_dests= 2024-09-14T11:09:54.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.559+0000 7fadb4722800 20 handle_bi_update(): bucket=:abort-at-init-indext[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22]): potential dests added=[] removed=[] 2024-09-14T11:09:54.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.561+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.0 2024-09-14T11:09:54.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.561+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.1 2024-09-14T11:09:54.560 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.562+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.2 2024-09-14T11:09:54.560 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.562+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.3 2024-09-14T11:09:54.560 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.562+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.4 2024-09-14T11:09:54.561 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.563+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.5 2024-09-14T11:09:54.561 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.563+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.6 2024-09-14T11:09:54.561 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.563+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.7 2024-09-14T11:09:54.562 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.564+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.8 2024-09-14T11:09:54.562 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.564+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.9 2024-09-14T11:09:54.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.565+0000 7fadb4722800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22.10 2024-09-14T11:09:54.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.565+0000 7fadb4722800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:09:54.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.565+0000 7fadb4722800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 2024-09-14T11:09:54.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.566+0000 7fadb4722800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 info.flags=0x17 2024-09-14T11:09:54.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.566+0000 7fadb4722800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 to cache LRU end 2024-09-14T11:09:54.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.566+0000 7fadb4722800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:54.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.566+0000 7fadb4722800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22, ofs0, ns] 2024-09-14T11:09:54.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.567+0000 7fac8f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497063 cookie 94021074859456 notifier 6480 bl.length()=965 2024-09-14T11:09:54.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.567+0000 7fac8f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 info.flags=0x17 2024-09-14T11:09:54.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.567+0000 7fac8f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 to cache LRU end 2024-09-14T11:09:54.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.567+0000 7fac8f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:54.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.568+0000 7fadb4722800 20 handle_bi_update(): bucket=:abort-at-init-indext[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22]): orig_sources= new_sources= 2024-09-14T11:09:54.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.568+0000 7fadb4722800 20 handle_bi_update(): bucket=:abort-at-init-indext[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22]): potential sources added=[] removed=[] 2024-09-14T11:09:54.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.568+0000 7fadb4722800 20 handle_bi_update(): bucket=:abort-at-init-indext[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22]): orig_dests= new_dests= 2024-09-14T11:09:54.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.568+0000 7fadb4722800 20 handle_bi_update(): bucket=:abort-at-init-indext[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22]): potential dests added=[] removed=[] 2024-09-14T11:09:54.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.571+0000 7fadb4722800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-14T11:09:54.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.573+0000 7fac667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:54.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.575+0000 7fadb4722800 20 remove_watcher() i=0 2024-09-14T11:09:54.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.575+0000 7fadb4722800 2 removed watcher, disabling cache 2024-09-14T11:09:54.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.576+0000 7fadb4722800 20 remove_watcher() i=1 2024-09-14T11:09:54.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.577+0000 7fadb4722800 20 remove_watcher() i=2 2024-09-14T11:09:54.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.578+0000 7fadb4722800 20 remove_watcher() i=3 2024-09-14T11:09:54.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.579+0000 7fadb4722800 20 remove_watcher() i=4 2024-09-14T11:09:54.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.580+0000 7fadb4722800 20 remove_watcher() i=5 2024-09-14T11:09:54.579 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.581+0000 7fadb4722800 20 remove_watcher() i=6 2024-09-14T11:09:54.581 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.582+0000 7fadb4722800 20 remove_watcher() i=7 2024-09-14T11:09:54.595 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:09:54.624 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:54.625 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:54.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.666+0000 7f37acb35800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.666 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.668+0000 7f37acb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:54.666 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.668+0000 7f37acb35800 20 realm 2024-09-14T11:09:54.666 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.668+0000 7f37acb35800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.668+0000 7f37acb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:54.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.668+0000 7f37acb35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:54.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.668+0000 7f37acb35800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.668+0000 7f37acb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:54.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.668+0000 7f37acb35800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.669+0000 7f37acb35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:54.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.669+0000 7f37acb35800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.668 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.670+0000 7f37acb35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:54.668 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.670+0000 7f37acb35800 20 searching for the correct realm 2024-09-14T11:09:54.671 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.673+0000 7f37a80e3640 0 -- 172.21.15.50:0/994589113 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f37a0061040 msgr2=0x7f37a00bbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:09:54.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.879+0000 7f37a80e3640 0 -- 172.21.15.50:0/994589113 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x563249412b00 msgr2=0x563249414ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:54.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.883+0000 7f37acb35800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:54.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.883+0000 7f37acb35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:54.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.883+0000 7f37acb35800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:54.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.883+0000 7f37acb35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:54.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.883+0000 7f37acb35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:54.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.883+0000 7f37acb35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:54.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.883+0000 7f37acb35800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.883+0000 7f37acb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:54.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.883+0000 7f37acb35800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.883+0000 7f37acb35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:54.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.883+0000 7f37acb35800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.884+0000 7f37acb35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:54.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.884+0000 7f37acb35800 20 zone default found 2024-09-14T11:09:54.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.884+0000 7f37acb35800 4 Realm: () 2024-09-14T11:09:54.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.884+0000 7f37acb35800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:54.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.884+0000 7f37acb35800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:54.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.884+0000 7f37acb35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:54.884 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.884+0000 7f37acb35800 20 zonegroup default 2024-09-14T11:09:54.884 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.884+0000 7f37acb35800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.884 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.884+0000 7f37acb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:54.884 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.884+0000 7f37acb35800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.884 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.884+0000 7f37acb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:54.884 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.884+0000 7f37acb35800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.885+0000 7f37acb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:54.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.885+0000 7f37acb35800 20 started sync module instance, tier type = 2024-09-14T11:09:54.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.885+0000 7f37acb35800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:54.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.894+0000 7f37acb35800 20 add_watcher() i=0 2024-09-14T11:09:54.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.894+0000 7f37acb35800 20 add_watcher() i=1 2024-09-14T11:09:54.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.894+0000 7f37acb35800 20 add_watcher() i=2 2024-09-14T11:09:54.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.894+0000 7f37acb35800 20 add_watcher() i=3 2024-09-14T11:09:54.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.894+0000 7f37acb35800 20 add_watcher() i=4 2024-09-14T11:09:54.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.894+0000 7f37acb35800 20 add_watcher() i=5 2024-09-14T11:09:54.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.894+0000 7f37acb35800 20 add_watcher() i=6 2024-09-14T11:09:54.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.895+0000 7f37acb35800 20 add_watcher() i=7 2024-09-14T11:09:54.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.895+0000 7f37acb35800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:54.895 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.896+0000 7f365efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:54.895 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.897+0000 7f37acb35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:54.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.897+0000 7f37acb35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:54.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.897+0000 7f37acb35800 5 note: GC not initialized 2024-09-14T11:09:54.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.897+0000 7f365dfe3640 20 reqs_thread_entry: start 2024-09-14T11:09:54.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.897+0000 7f37acb35800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:54.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.897+0000 7f37acb35800 20 Filter name: none 2024-09-14T11:09:54.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.897+0000 7f35cf7fe640 20 reqs_thread_entry: start 2024-09-14T11:09:54.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.897+0000 7f37acb35800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.898+0000 7f37acb35800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:09:54.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.898+0000 7f37acb35800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.899+0000 7f37acb35800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:09:54.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.899+0000 7f37acb35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:54.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.899+0000 7f37acb35800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.899+0000 7f37acb35800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:09:54.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.899+0000 7f37acb35800 20 rados->read ofs=0 len=0 2024-09-14T11:09:54.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.899+0000 7f37acb35800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:09:54.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.899+0000 7f37acb35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:54.899 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.901+0000 7f365efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:54.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.904+0000 7f37acb35800 20 remove_watcher() i=0 2024-09-14T11:09:54.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.904+0000 7f37acb35800 2 removed watcher, disabling cache 2024-09-14T11:09:54.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.905+0000 7f37acb35800 20 remove_watcher() i=1 2024-09-14T11:09:54.904 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.906+0000 7f37acb35800 20 remove_watcher() i=2 2024-09-14T11:09:54.905 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.907+0000 7f37acb35800 20 remove_watcher() i=3 2024-09-14T11:09:54.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.908+0000 7f37acb35800 20 remove_watcher() i=4 2024-09-14T11:09:54.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.909+0000 7f37acb35800 20 remove_watcher() i=5 2024-09-14T11:09:54.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.910+0000 7f37acb35800 20 remove_watcher() i=6 2024-09-14T11:09:54.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:54.911+0000 7f37acb35800 20 remove_watcher() i=7 2024-09-14T11:09:54.921 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:54.921 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:09:54.921 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: abort-at-init-indext id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:09:54.921 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:54.923 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:54.923 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:54.941 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:54.941 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:55.179 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:55.179 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:55.319 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-14T11:09:55.320 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:55.321 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:55.321 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:55.371 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:55.371 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:55.429 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:55.429 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:55.468 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:55.469 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:55.506 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:55.507 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:55.545 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:55.545 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:55.582 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:55.582 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:55.620 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:55.620 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:55.657 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:55.657 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:55.694 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:55.694 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:55.731 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:55.731 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:55.768 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:55.768 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:55.805 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:55.806 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:55.842 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:55.842 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:55.879 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:55.880 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:55.915 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:55.915 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:55.953 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:55.953 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:55.990 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:55.991 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:56.027 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:56.027 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:56.064 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:56.064 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:56.101 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:56.102 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:56.139 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:56.139 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:56.180 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:09:56.212 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:56.212 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:56.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.250+0000 7f6fca013800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.251 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.252+0000 7f6fca013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:56.251 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.252+0000 7f6fca013800 20 realm 2024-09-14T11:09:56.251 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.252+0000 7f6fca013800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.251 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.253+0000 7f6fca013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:56.251 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.253+0000 7f6fca013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:56.251 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.253+0000 7f6fca013800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.251 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.253+0000 7f6fca013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:56.251 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.253+0000 7f6fca013800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.253+0000 7f6fca013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:56.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.253+0000 7f6fca013800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.254+0000 7f6fca013800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:56.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.254+0000 7f6fca013800 20 searching for the correct realm 2024-09-14T11:09:56.255 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.257+0000 7f6fc4f47640 0 -- 172.21.15.50:0/2807089365 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f6fc003d920 msgr2=0x7f6fc0018410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:56.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.463+0000 7f6fc5f49640 0 -- 172.21.15.50:0/2807089365 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x557bfe61fa60 msgr2=0x557bfe621f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:56.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.467+0000 7f6fca013800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:56.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.467+0000 7f6fca013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:56.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.467+0000 7f6fca013800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:56.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.467+0000 7f6fca013800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:56.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.467+0000 7f6fca013800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:56.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.467+0000 7f6fca013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:56.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.467+0000 7f6fca013800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.467+0000 7f6fca013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:56.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.467+0000 7f6fca013800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.467+0000 7f6fca013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:56.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.467+0000 7f6fca013800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.468+0000 7f6fca013800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:56.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.468+0000 7f6fca013800 20 zone default found 2024-09-14T11:09:56.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.468+0000 7f6fca013800 4 Realm: () 2024-09-14T11:09:56.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.468+0000 7f6fca013800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:56.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.468+0000 7f6fca013800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:56.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.468+0000 7f6fca013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:56.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.468+0000 7f6fca013800 20 zonegroup default 2024-09-14T11:09:56.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.468+0000 7f6fca013800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.468+0000 7f6fca013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:56.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.468+0000 7f6fca013800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.468+0000 7f6fca013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:56.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.468+0000 7f6fca013800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.469+0000 7f6fca013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:56.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.469+0000 7f6fca013800 20 started sync module instance, tier type = 2024-09-14T11:09:56.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.469+0000 7f6fca013800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:56.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.477+0000 7f6fca013800 20 add_watcher() i=0 2024-09-14T11:09:56.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.477+0000 7f6fca013800 20 add_watcher() i=1 2024-09-14T11:09:56.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.477+0000 7f6fca013800 20 add_watcher() i=2 2024-09-14T11:09:56.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.477+0000 7f6fca013800 20 add_watcher() i=3 2024-09-14T11:09:56.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.477+0000 7f6fca013800 20 add_watcher() i=4 2024-09-14T11:09:56.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.477+0000 7f6fca013800 20 add_watcher() i=5 2024-09-14T11:09:56.476 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.477+0000 7f6fca013800 20 add_watcher() i=6 2024-09-14T11:09:56.476 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.478+0000 7f6fca013800 20 add_watcher() i=7 2024-09-14T11:09:56.476 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.478+0000 7f6fca013800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:56.477 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.479+0000 7f6e7b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:56.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.480+0000 7f6fca013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:56.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.480+0000 7f6fca013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:56.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.480+0000 7f6fca013800 5 note: GC not initialized 2024-09-14T11:09:56.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.480+0000 7f6e7a7e4640 20 reqs_thread_entry: start 2024-09-14T11:09:56.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.480+0000 7f6fca013800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:56.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.480+0000 7f6fca013800 20 Filter name: none 2024-09-14T11:09:56.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.480+0000 7f6debfff640 20 reqs_thread_entry: start 2024-09-14T11:09:56.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.480+0000 7f6fca013800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.481+0000 7f6fca013800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:09:56.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.481+0000 7f6fca013800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.481+0000 7f6fca013800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:09:56.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.481+0000 7f6fca013800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:56.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.481+0000 7f6fca013800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.482+0000 7f6fca013800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:09:56.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.482+0000 7f6fca013800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.482+0000 7f6fca013800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:09:56.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.482+0000 7f6fca013800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:56.482 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.484+0000 7f6e7b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:56.484 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.486+0000 7f6fca013800 20 remove_watcher() i=0 2024-09-14T11:09:56.484 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.486+0000 7f6fca013800 2 removed watcher, disabling cache 2024-09-14T11:09:56.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.487+0000 7f6fca013800 20 remove_watcher() i=1 2024-09-14T11:09:56.486 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.488+0000 7f6fca013800 20 remove_watcher() i=2 2024-09-14T11:09:56.487 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.489+0000 7f6fca013800 20 remove_watcher() i=3 2024-09-14T11:09:56.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.490+0000 7f6fca013800 20 remove_watcher() i=4 2024-09-14T11:09:56.489 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.491+0000 7f6fca013800 20 remove_watcher() i=5 2024-09-14T11:09:56.489 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.491+0000 7f6fca013800 20 remove_watcher() i=6 2024-09-14T11:09:56.490 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.492+0000 7f6fca013800 20 remove_watcher() i=7 2024-09-14T11:09:56.502 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:56.502 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:09:56.503 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-set-target-layout id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:09:56.503 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:56.504 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-14T11:09:56.539 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:56.539 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:56.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.580+0000 7f115ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.582+0000 7f115ff0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:56.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.582+0000 7f115ff0c800 20 realm 2024-09-14T11:09:56.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.582+0000 7f115ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.582+0000 7f115ff0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:56.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.582+0000 7f115ff0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:56.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.582+0000 7f115ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.582+0000 7f115ff0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:56.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.582+0000 7f115ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.581 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.583+0000 7f115ff0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:56.581 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.583+0000 7f115ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.583+0000 7f115ff0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:56.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.583+0000 7f115ff0c800 20 searching for the correct realm 2024-09-14T11:09:56.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.586+0000 7f115d1f5640 0 -- 172.21.15.50:0/3626958492 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f115806fc60 msgr2=0x7f115806f040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:09:56.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.792+0000 7f115d1f5640 0 -- 172.21.15.50:0/3626958492 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55a366472750 msgr2=0x55a366474b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:56.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.796+0000 7f115ff0c800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:56.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.796+0000 7f115ff0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:56.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.796+0000 7f115ff0c800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:56.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.796+0000 7f115ff0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:56.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.796+0000 7f115ff0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:56.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.796+0000 7f115ff0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:56.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.796+0000 7f115ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.796+0000 7f115ff0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:56.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.796+0000 7f115ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.796+0000 7f115ff0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:56.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.796+0000 7f115ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.797+0000 7f115ff0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:56.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.797+0000 7f115ff0c800 20 zone default found 2024-09-14T11:09:56.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.797+0000 7f115ff0c800 4 Realm: () 2024-09-14T11:09:56.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.797+0000 7f115ff0c800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:56.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.797+0000 7f115ff0c800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:56.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.797+0000 7f115ff0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:56.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.797+0000 7f115ff0c800 20 zonegroup default 2024-09-14T11:09:56.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.797+0000 7f115ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.797+0000 7f115ff0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:56.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.797+0000 7f115ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.797+0000 7f115ff0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:56.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.797+0000 7f115ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.797+0000 7f115ff0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:56.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.797+0000 7f115ff0c800 20 started sync module instance, tier type = 2024-09-14T11:09:56.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.797+0000 7f115ff0c800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:56.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.806+0000 7f115ff0c800 20 add_watcher() i=0 2024-09-14T11:09:56.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.806+0000 7f115ff0c800 20 add_watcher() i=1 2024-09-14T11:09:56.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.806+0000 7f115ff0c800 20 add_watcher() i=2 2024-09-14T11:09:56.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.806+0000 7f115ff0c800 20 add_watcher() i=3 2024-09-14T11:09:56.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.806+0000 7f115ff0c800 20 add_watcher() i=4 2024-09-14T11:09:56.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.806+0000 7f115ff0c800 20 add_watcher() i=5 2024-09-14T11:09:56.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.806+0000 7f115ff0c800 20 add_watcher() i=6 2024-09-14T11:09:56.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.807+0000 7f115ff0c800 20 add_watcher() i=7 2024-09-14T11:09:56.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.807+0000 7f115ff0c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:56.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.809+0000 7f100f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:56.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.809+0000 7f115ff0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:56.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.809+0000 7f115ff0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:56.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.809+0000 7f115ff0c800 5 note: GC not initialized 2024-09-14T11:09:56.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.809+0000 7f100e7fc640 20 reqs_thread_entry: start 2024-09-14T11:09:56.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.809+0000 7f115ff0c800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:56.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.809+0000 7f115ff0c800 20 Filter name: none 2024-09-14T11:09:56.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.810+0000 7f0f7ffff640 20 reqs_thread_entry: start 2024-09-14T11:09:56.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.810+0000 7f115ff0c800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:09:56.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.810+0000 7f115ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.810+0000 7f115ff0c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:09:56.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.810+0000 7f115ff0c800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:09:56.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.810+0000 7f115ff0c800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:09:56.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.810+0000 7f115ff0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 : miss 2024-09-14T11:09:56.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.810+0000 7f115ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.811+0000 7f115ff0c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:09:56.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.811+0000 7f115ff0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 info.flags=0x17 2024-09-14T11:09:56.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.811+0000 7f115ff0c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 to cache LRU end 2024-09-14T11:09:56.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.811+0000 7f115ff0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:09:56.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.811+0000 7f115ff0c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:56.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.811+0000 7f115ff0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 2024-09-14T11:09:56.813 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.815+0000 7f115ff0c800 -1 Injecting error=-5 at location=set_target_layout 2024-09-14T11:09:56.813 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.815+0000 7f115ff0c800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-14T11:09:56.818 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.820+0000 7f100f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:56.820 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.822+0000 7f115ff0c800 20 remove_watcher() i=0 2024-09-14T11:09:56.820 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.822+0000 7f115ff0c800 2 removed watcher, disabling cache 2024-09-14T11:09:56.821 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.823+0000 7f115ff0c800 20 remove_watcher() i=1 2024-09-14T11:09:56.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.824+0000 7f115ff0c800 20 remove_watcher() i=2 2024-09-14T11:09:56.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.825+0000 7f115ff0c800 20 remove_watcher() i=3 2024-09-14T11:09:56.824 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.826+0000 7f115ff0c800 20 remove_watcher() i=4 2024-09-14T11:09:56.825 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.827+0000 7f115ff0c800 20 remove_watcher() i=5 2024-09-14T11:09:56.826 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.828+0000 7f115ff0c800 20 remove_watcher() i=6 2024-09-14T11:09:56.827 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.829+0000 7f115ff0c800 20 remove_watcher() i=7 2024-09-14T11:09:56.839 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:09:56.869 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:56.869 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:56.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.910+0000 7f7fc6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.912+0000 7f7fc6b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:56.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.912+0000 7f7fc6b25800 20 realm 2024-09-14T11:09:56.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.912+0000 7f7fc6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.912+0000 7f7fc6b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:56.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.912+0000 7f7fc6b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:56.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.912+0000 7f7fc6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.913+0000 7f7fc6b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:56.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.913+0000 7f7fc6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.913+0000 7f7fc6b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:56.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.913+0000 7f7fc6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.914+0000 7f7fc6b25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:56.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.914+0000 7f7fc6b25800 20 searching for the correct realm 2024-09-14T11:09:56.913 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:56.915+0000 7f7fc28a2640 0 -- 172.21.15.50:0/309307332 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x7f7fbc069c20 msgr2=0x7f7fbc067ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:09:57.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.120+0000 7f7fc30a3640 0 -- 172.21.15.50:0/309307332 >> [v2:172.21.15.118:6826/1082138742,v1:172.21.15.118:6827/1082138742] conn(0x7f7fb4033040 msgr2=0x7f7fb4026b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:57.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.327+0000 7f7fc6b25800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:57.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.327+0000 7f7fc6b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:57.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.327+0000 7f7fc6b25800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:57.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.327+0000 7f7fc6b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:57.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.327+0000 7f7fc6b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:57.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.327+0000 7f7fc6b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:57.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.327+0000 7f7fc6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:57.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.328+0000 7f7fc6b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:57.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.328+0000 7f7fc6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:57.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.328+0000 7f7fc6b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:57.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.328+0000 7f7fc6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:57.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.328+0000 7f7fc6b25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:57.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.328+0000 7f7fc6b25800 20 zone default found 2024-09-14T11:09:57.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.328+0000 7f7fc6b25800 4 Realm: () 2024-09-14T11:09:57.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.328+0000 7f7fc6b25800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:57.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.328+0000 7f7fc6b25800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:57.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.328+0000 7f7fc6b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:57.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.328+0000 7f7fc6b25800 20 zonegroup default 2024-09-14T11:09:57.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.328+0000 7f7fc6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:57.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.329+0000 7f7fc6b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:57.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.329+0000 7f7fc6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:57.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.329+0000 7f7fc6b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:57.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.329+0000 7f7fc6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:57.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.329+0000 7f7fc6b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:57.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.329+0000 7f7fc6b25800 20 started sync module instance, tier type = 2024-09-14T11:09:57.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.329+0000 7f7fc6b25800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:57.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.338+0000 7f7fc6b25800 20 add_watcher() i=0 2024-09-14T11:09:57.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.338+0000 7f7fc6b25800 20 add_watcher() i=1 2024-09-14T11:09:57.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.338+0000 7f7fc6b25800 20 add_watcher() i=2 2024-09-14T11:09:57.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.338+0000 7f7fc6b25800 20 add_watcher() i=3 2024-09-14T11:09:57.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.338+0000 7f7fc6b25800 20 add_watcher() i=4 2024-09-14T11:09:57.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.338+0000 7f7fc6b25800 20 add_watcher() i=5 2024-09-14T11:09:57.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.338+0000 7f7fc6b25800 20 add_watcher() i=6 2024-09-14T11:09:57.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.339+0000 7f7fc6b25800 20 add_watcher() i=7 2024-09-14T11:09:57.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.339+0000 7f7fc6b25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:57.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.341+0000 7f7e757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:57.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.342+0000 7f7fc6b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:57.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.342+0000 7f7fc6b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:57.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.342+0000 7f7fc6b25800 5 note: GC not initialized 2024-09-14T11:09:57.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.342+0000 7f7deffff640 20 reqs_thread_entry: start 2024-09-14T11:09:57.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.342+0000 7f7fc6b25800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:57.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.342+0000 7f7fc6b25800 20 Filter name: none 2024-09-14T11:09:57.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.342+0000 7f7dedffb640 20 reqs_thread_entry: start 2024-09-14T11:09:57.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.342+0000 7f7fc6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:57.342 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.343+0000 7f7fc6b25800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:09:57.342 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.343+0000 7f7fc6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:57.342 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.343+0000 7f7fc6b25800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:09:57.342 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.343+0000 7f7fc6b25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:57.342 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.343+0000 7f7fc6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:57.342 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.343+0000 7f7fc6b25800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:09:57.342 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.343+0000 7f7fc6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:57.342 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.344+0000 7f7fc6b25800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:09:57.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.344+0000 7f7fc6b25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:57.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.345+0000 7f7e757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:57.346 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.348+0000 7f7fc6b25800 20 remove_watcher() i=0 2024-09-14T11:09:57.346 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.348+0000 7f7fc6b25800 2 removed watcher, disabling cache 2024-09-14T11:09:57.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.349+0000 7f7fc6b25800 20 remove_watcher() i=1 2024-09-14T11:09:57.348 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.350+0000 7f7fc6b25800 20 remove_watcher() i=2 2024-09-14T11:09:57.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.351+0000 7f7fc6b25800 20 remove_watcher() i=3 2024-09-14T11:09:57.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.352+0000 7f7fc6b25800 20 remove_watcher() i=4 2024-09-14T11:09:57.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.353+0000 7f7fc6b25800 20 remove_watcher() i=5 2024-09-14T11:09:57.352 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.354+0000 7f7fc6b25800 20 remove_watcher() i=6 2024-09-14T11:09:57.352 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.354+0000 7f7fc6b25800 20 remove_watcher() i=7 2024-09-14T11:09:57.364 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:57.364 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:09:57.364 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-set-target-layout id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:09:57.364 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:57.366 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:57.366 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:57.400 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:57.400 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:57.458 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:09:57.490 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:57.490 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:57.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.532+0000 7fe182973800 20 rados->read ofs=0 len=0 2024-09-14T11:09:57.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.533+0000 7fe182973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:57.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.533+0000 7fe182973800 20 realm 2024-09-14T11:09:57.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.533+0000 7fe182973800 20 rados->read ofs=0 len=0 2024-09-14T11:09:57.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.533+0000 7fe182973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:57.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.533+0000 7fe182973800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:57.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.533+0000 7fe182973800 20 rados->read ofs=0 len=0 2024-09-14T11:09:57.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.533+0000 7fe182973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:57.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.533+0000 7fe182973800 20 rados->read ofs=0 len=0 2024-09-14T11:09:57.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.534+0000 7fe182973800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:57.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.534+0000 7fe182973800 20 rados->read ofs=0 len=0 2024-09-14T11:09:57.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.535+0000 7fe182973800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:57.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.535+0000 7fe182973800 20 searching for the correct realm 2024-09-14T11:09:57.535 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.537+0000 7fe17fc5c640 0 -- 172.21.15.50:0/321773944 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fe178084400 msgr2=0x7fe178084860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:09:57.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.742+0000 7fe180c5e640 0 -- 172.21.15.50:0/321773944 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55b50890de00 msgr2=0x55b5089101f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:57.744 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.746+0000 7fe182973800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:57.744 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.746+0000 7fe182973800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:57.744 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.746+0000 7fe182973800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:57.744 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.746+0000 7fe182973800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:57.744 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.746+0000 7fe182973800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:57.744 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.746+0000 7fe182973800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:57.744 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.746+0000 7fe182973800 20 rados->read ofs=0 len=0 2024-09-14T11:09:57.745 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.746+0000 7fe182973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:57.746 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.746+0000 7fe182973800 20 rados->read ofs=0 len=0 2024-09-14T11:09:57.746 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.747+0000 7fe182973800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:57.746 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.747+0000 7fe182973800 20 rados->read ofs=0 len=0 2024-09-14T11:09:57.746 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.747+0000 7fe182973800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:57.746 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.747+0000 7fe182973800 20 zone default found 2024-09-14T11:09:57.746 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.747+0000 7fe182973800 4 Realm: () 2024-09-14T11:09:57.746 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.747+0000 7fe182973800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:57.746 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.747+0000 7fe182973800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:57.746 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.747+0000 7fe182973800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:57.746 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.747+0000 7fe182973800 20 zonegroup default 2024-09-14T11:09:57.746 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.747+0000 7fe182973800 20 rados->read ofs=0 len=0 2024-09-14T11:09:57.746 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.747+0000 7fe182973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:57.747 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.747+0000 7fe182973800 20 rados->read ofs=0 len=0 2024-09-14T11:09:57.747 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.748+0000 7fe182973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:57.747 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.748+0000 7fe182973800 20 rados->read ofs=0 len=0 2024-09-14T11:09:57.747 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.748+0000 7fe182973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:57.747 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.748+0000 7fe182973800 20 started sync module instance, tier type = 2024-09-14T11:09:57.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.748+0000 7fe182973800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:57.755 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.757+0000 7fe182973800 20 add_watcher() i=0 2024-09-14T11:09:57.755 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.757+0000 7fe182973800 20 add_watcher() i=1 2024-09-14T11:09:57.755 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.757+0000 7fe182973800 20 add_watcher() i=2 2024-09-14T11:09:57.755 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.757+0000 7fe182973800 20 add_watcher() i=3 2024-09-14T11:09:57.756 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.757+0000 7fe182973800 20 add_watcher() i=4 2024-09-14T11:09:57.756 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.757+0000 7fe182973800 20 add_watcher() i=5 2024-09-14T11:09:57.756 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.757+0000 7fe182973800 20 add_watcher() i=6 2024-09-14T11:09:57.756 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.758+0000 7fe182973800 20 add_watcher() i=7 2024-09-14T11:09:57.756 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.758+0000 7fe182973800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:57.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.760+0000 7fe036fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:57.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.760+0000 7fe182973800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:57.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.760+0000 7fe182973800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:57.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.760+0000 7fe182973800 5 note: GC not initialized 2024-09-14T11:09:57.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.760+0000 7fe035fdb640 20 reqs_thread_entry: start 2024-09-14T11:09:57.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.760+0000 7fe182973800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:57.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.760+0000 7fe182973800 20 Filter name: none 2024-09-14T11:09:57.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.760+0000 7fdfa77fe640 20 reqs_thread_entry: start 2024-09-14T11:09:57.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.760+0000 7fe182973800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:09:57.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.760+0000 7fe182973800 20 rados->read ofs=0 len=0 2024-09-14T11:09:57.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.761+0000 7fe182973800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:09:57.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.761+0000 7fe182973800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:09:57.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.761+0000 7fe182973800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:09:57.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.761+0000 7fe182973800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 : miss 2024-09-14T11:09:57.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.761+0000 7fe182973800 20 rados->read ofs=0 len=0 2024-09-14T11:09:57.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.761+0000 7fe182973800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:09:57.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.761+0000 7fe182973800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 info.flags=0x17 2024-09-14T11:09:57.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.761+0000 7fe182973800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 to cache LRU end 2024-09-14T11:09:57.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.761+0000 7fe182973800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:09:57.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.761+0000 7fe182973800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:57.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.761+0000 7fe182973800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 2024-09-14T11:09:57.764 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.766+0000 7fe182973800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 info.flags=0x17 2024-09-14T11:09:57.765 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.766+0000 7fe182973800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 to cache LRU end 2024-09-14T11:09:57.765 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.766+0000 7fe182973800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:57.765 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.766+0000 7fe182973800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23, ofs0, ns] 2024-09-14T11:09:57.765 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.767+0000 7fe056ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497058 cookie 94236021226192 notifier 6579 bl.length()=1009 2024-09-14T11:09:57.765 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.767+0000 7fe056ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 info.flags=0x17 2024-09-14T11:09:57.765 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.767+0000 7fe056ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 to cache LRU end 2024-09-14T11:09:57.765 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.767+0000 7fe056ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:57.766 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.768+0000 7fe182973800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23]): orig_sources= new_sources= 2024-09-14T11:09:57.767 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.768+0000 7fe182973800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23]): potential sources added=[] removed=[] 2024-09-14T11:09:57.767 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.768+0000 7fe182973800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23]): orig_dests= new_dests= 2024-09-14T11:09:57.767 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.768+0000 7fe182973800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23]): potential dests added=[] removed=[] 2024-09-14T11:09:57.771 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1.0 2024-09-14T11:09:57.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1.0 2024-09-14T11:09:57.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1.1 2024-09-14T11:09:57.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1.1 2024-09-14T11:09:57.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1.2 2024-09-14T11:09:57.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1.2 2024-09-14T11:09:57.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1.3 2024-09-14T11:09:57.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1.3 2024-09-14T11:09:57.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1.4 2024-09-14T11:09:57.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1.4 2024-09-14T11:09:57.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1.5 2024-09-14T11:09:57.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1.5 2024-09-14T11:09:57.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1.6 2024-09-14T11:09:57.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1.6 2024-09-14T11:09:57.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1.7 2024-09-14T11:09:57.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1.7 2024-09-14T11:09:57.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1.8 2024-09-14T11:09:57.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1.8 2024-09-14T11:09:57.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1.9 2024-09-14T11:09:57.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1.9 2024-09-14T11:09:57.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1.10 2024-09-14T11:09:57.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1.10 2024-09-14T11:09:57.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1.11 2024-09-14T11:09:57.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1.11 2024-09-14T11:09:57.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.773+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.0 2024-09-14T11:09:57.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.774+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1 2024-09-14T11:09:57.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.774+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.2 2024-09-14T11:09:57.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.775+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.3 2024-09-14T11:09:57.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.775+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.4 2024-09-14T11:09:57.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.775+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.5 2024-09-14T11:09:57.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.776+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.6 2024-09-14T11:09:57.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.777+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.7 2024-09-14T11:09:57.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.777+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.8 2024-09-14T11:09:57.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.778+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.9 2024-09-14T11:09:57.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.778+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.10 2024-09-14T11:09:57.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.782+0000 7fe182973800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:09:57.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.782+0000 7fe182973800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 2024-09-14T11:09:57.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.783+0000 7fe182973800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 info.flags=0x17 2024-09-14T11:09:57.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.783+0000 7fe182973800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 to cache LRU end 2024-09-14T11:09:57.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.783+0000 7fe182973800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:57.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.783+0000 7fe182973800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23, ofs0, ns] 2024-09-14T11:09:57.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.783+0000 7fe056ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497059 cookie 94236021226192 notifier 6579 bl.length()=1009 2024-09-14T11:09:57.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.783+0000 7fe056ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 info.flags=0x17 2024-09-14T11:09:57.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.783+0000 7fe056ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 to cache LRU end 2024-09-14T11:09:57.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.783+0000 7fe056ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:57.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.785+0000 7fe182973800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23]): orig_sources= new_sources= 2024-09-14T11:09:57.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.785+0000 7fe182973800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23]): potential sources added=[] removed=[] 2024-09-14T11:09:57.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.785+0000 7fe182973800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23]): orig_dests= new_dests= 2024-09-14T11:09:57.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.785+0000 7fe182973800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23]): potential dests added=[] removed=[] 2024-09-14T11:09:57.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.788+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.0 2024-09-14T11:09:57.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.788+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.1 2024-09-14T11:09:57.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.789+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.2 2024-09-14T11:09:57.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.789+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.3 2024-09-14T11:09:57.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.789+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.4 2024-09-14T11:09:57.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.790+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.5 2024-09-14T11:09:57.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.790+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.6 2024-09-14T11:09:57.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.790+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.7 2024-09-14T11:09:57.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.791+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.8 2024-09-14T11:09:57.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.791+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.9 2024-09-14T11:09:57.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.791+0000 7fe182973800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23.10 2024-09-14T11:09:57.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.791+0000 7fe182973800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:09:57.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.792+0000 7fe182973800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 2024-09-14T11:09:57.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.793+0000 7fe182973800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 info.flags=0x17 2024-09-14T11:09:57.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.793+0000 7fe182973800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 to cache LRU end 2024-09-14T11:09:57.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.793+0000 7fe182973800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:57.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.793+0000 7fe182973800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23, ofs0, ns] 2024-09-14T11:09:57.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.793+0000 7fe0577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497060 cookie 94236021226192 notifier 6579 bl.length()=977 2024-09-14T11:09:57.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.793+0000 7fe0577fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 info.flags=0x17 2024-09-14T11:09:57.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.793+0000 7fe0577fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 to cache LRU end 2024-09-14T11:09:57.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.793+0000 7fe0577fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:09:57.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.795+0000 7fe182973800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23]): orig_sources= new_sources= 2024-09-14T11:09:57.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.795+0000 7fe182973800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23]): potential sources added=[] removed=[] 2024-09-14T11:09:57.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.795+0000 7fe182973800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23]): orig_dests= new_dests= 2024-09-14T11:09:57.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.795+0000 7fe182973800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23]): potential dests added=[] removed=[] 2024-09-14T11:09:57.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.797+0000 7fe182973800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:09:57.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.799+0000 7fe036fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:57.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.801+0000 7fe182973800 20 remove_watcher() i=0 2024-09-14T11:09:57.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.801+0000 7fe182973800 2 removed watcher, disabling cache 2024-09-14T11:09:57.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.802+0000 7fe182973800 20 remove_watcher() i=1 2024-09-14T11:09:57.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.803+0000 7fe182973800 20 remove_watcher() i=2 2024-09-14T11:09:57.802 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.804+0000 7fe182973800 20 remove_watcher() i=3 2024-09-14T11:09:57.803 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.805+0000 7fe182973800 20 remove_watcher() i=4 2024-09-14T11:09:57.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.806+0000 7fe182973800 20 remove_watcher() i=5 2024-09-14T11:09:57.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.807+0000 7fe182973800 20 remove_watcher() i=6 2024-09-14T11:09:57.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:57.808+0000 7fe182973800 20 remove_watcher() i=7 2024-09-14T11:09:57.818 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:09:57.847 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:57.847 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:58.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.091+0000 7f85ab719800 20 rados->read ofs=0 len=0 2024-09-14T11:09:58.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.093+0000 7f85ab719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:58.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.093+0000 7f85ab719800 20 realm 2024-09-14T11:09:58.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.093+0000 7f85ab719800 20 rados->read ofs=0 len=0 2024-09-14T11:09:58.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.093+0000 7f85ab719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:58.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.093+0000 7f85ab719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:58.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.093+0000 7f85ab719800 20 rados->read ofs=0 len=0 2024-09-14T11:09:58.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.093+0000 7f85ab719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:58.092 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.093+0000 7f85ab719800 20 rados->read ofs=0 len=0 2024-09-14T11:09:58.092 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.094+0000 7f85ab719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:58.092 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.094+0000 7f85ab719800 20 rados->read ofs=0 len=0 2024-09-14T11:09:58.093 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.095+0000 7f85ab719800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:58.093 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.095+0000 7f85ab719800 20 searching for the correct realm 2024-09-14T11:09:58.095 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.097+0000 7f85a920a640 0 -- 172.21.15.50:0/3008761805 >> [v2:172.21.15.50:6800/2565843969,v1:172.21.15.50:6801/2565843969] conn(0x564334ee3480 msgr2=0x564334ee5870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:58.098 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.100+0000 7f85a920a640 0 -- 172.21.15.50:0/3008761805 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f85a40b20e0 msgr2=0x7f85a404d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:09:58.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.307+0000 7f85ab719800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:58.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.307+0000 7f85ab719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:58.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.307+0000 7f85ab719800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:58.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.307+0000 7f85ab719800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:58.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.307+0000 7f85ab719800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:58.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.307+0000 7f85ab719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:58.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.307+0000 7f85ab719800 20 rados->read ofs=0 len=0 2024-09-14T11:09:58.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.307+0000 7f85ab719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:58.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.307+0000 7f85ab719800 20 rados->read ofs=0 len=0 2024-09-14T11:09:58.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.308+0000 7f85ab719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:58.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.308+0000 7f85ab719800 20 rados->read ofs=0 len=0 2024-09-14T11:09:58.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.308+0000 7f85ab719800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:58.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.308+0000 7f85ab719800 20 zone default found 2024-09-14T11:09:58.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.308+0000 7f85ab719800 4 Realm: () 2024-09-14T11:09:58.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.308+0000 7f85ab719800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:58.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.308+0000 7f85ab719800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:58.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.308+0000 7f85ab719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:58.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.308+0000 7f85ab719800 20 zonegroup default 2024-09-14T11:09:58.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.308+0000 7f85ab719800 20 rados->read ofs=0 len=0 2024-09-14T11:09:58.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.308+0000 7f85ab719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:58.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.308+0000 7f85ab719800 20 rados->read ofs=0 len=0 2024-09-14T11:09:58.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.309+0000 7f85ab719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:58.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.309+0000 7f85ab719800 20 rados->read ofs=0 len=0 2024-09-14T11:09:58.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.309+0000 7f85ab719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:58.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.309+0000 7f85ab719800 20 started sync module instance, tier type = 2024-09-14T11:09:58.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.309+0000 7f85ab719800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:58.316 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.318+0000 7f85ab719800 20 add_watcher() i=0 2024-09-14T11:09:58.316 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.318+0000 7f85ab719800 20 add_watcher() i=1 2024-09-14T11:09:58.316 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.318+0000 7f85ab719800 20 add_watcher() i=2 2024-09-14T11:09:58.316 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.318+0000 7f85ab719800 20 add_watcher() i=3 2024-09-14T11:09:58.316 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.318+0000 7f85ab719800 20 add_watcher() i=4 2024-09-14T11:09:58.316 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.318+0000 7f85ab719800 20 add_watcher() i=5 2024-09-14T11:09:58.316 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.318+0000 7f85ab719800 20 add_watcher() i=6 2024-09-14T11:09:58.317 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.319+0000 7f85ab719800 20 add_watcher() i=7 2024-09-14T11:09:58.317 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.319+0000 7f85ab719800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:58.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.320+0000 7f845f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:58.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.320+0000 7f85ab719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:58.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.320+0000 7f85ab719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:58.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.321+0000 7f85ab719800 5 note: GC not initialized 2024-09-14T11:09:58.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.321+0000 7f845e7e4640 20 reqs_thread_entry: start 2024-09-14T11:09:58.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.321+0000 7f85ab719800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:58.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.321+0000 7f85ab719800 20 Filter name: none 2024-09-14T11:09:58.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.321+0000 7f83cffff640 20 reqs_thread_entry: start 2024-09-14T11:09:58.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.321+0000 7f85ab719800 20 rados->read ofs=0 len=0 2024-09-14T11:09:58.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.322+0000 7f85ab719800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:09:58.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.322+0000 7f85ab719800 20 rados->read ofs=0 len=0 2024-09-14T11:09:58.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.322+0000 7f85ab719800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:09:58.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.322+0000 7f85ab719800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:58.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.322+0000 7f85ab719800 20 rados->read ofs=0 len=0 2024-09-14T11:09:58.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.323+0000 7f85ab719800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:09:58.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.323+0000 7f85ab719800 20 rados->read ofs=0 len=0 2024-09-14T11:09:58.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.323+0000 7f85ab719800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:09:58.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.323+0000 7f85ab719800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:58.323 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.325+0000 7f845f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:58.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.327+0000 7f85ab719800 20 remove_watcher() i=0 2024-09-14T11:09:58.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.327+0000 7f85ab719800 2 removed watcher, disabling cache 2024-09-14T11:09:58.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.328+0000 7f85ab719800 20 remove_watcher() i=1 2024-09-14T11:09:58.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.330+0000 7f85ab719800 20 remove_watcher() i=2 2024-09-14T11:09:58.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.331+0000 7f85ab719800 20 remove_watcher() i=3 2024-09-14T11:09:58.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.332+0000 7f85ab719800 20 remove_watcher() i=4 2024-09-14T11:09:58.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.333+0000 7f85ab719800 20 remove_watcher() i=5 2024-09-14T11:09:58.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.334+0000 7f85ab719800 20 remove_watcher() i=6 2024-09-14T11:09:58.333 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:58.334+0000 7f85ab719800 20 remove_watcher() i=7 2024-09-14T11:09:58.344 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:58.344 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:09:58.344 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-set-target-layout id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:09:58.345 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:58.346 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:58.347 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:58.369 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:58.369 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:58.601 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:58.601 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:58.732 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-14T11:09:58.732 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:58.732 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:58.733 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:58.783 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:58.783 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:58.841 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:58.841 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:58.877 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:58.877 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:58.913 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:58.914 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:58.951 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:58.951 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:58.988 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:58.989 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:59.025 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:59.026 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:59.063 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:59.063 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:59.099 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:59.099 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:59.135 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:59.135 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:59.174 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:59.174 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:59.211 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:59.211 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:59.248 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:59.248 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:59.286 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:59.287 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:59.323 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:59.324 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:59.360 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:59.361 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:59.397 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:59.397 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:59.432 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:59.432 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:59.469 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:59.469 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:59.506 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:59.506 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:59.544 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:09:59.545 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:09:59.583 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:09:59.612 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:59.612 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:59.652 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.654+0000 7f53f0128800 20 rados->read ofs=0 len=0 2024-09-14T11:09:59.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.656+0000 7f53f0128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:59.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.656+0000 7f53f0128800 20 realm 2024-09-14T11:09:59.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.656+0000 7f53f0128800 20 rados->read ofs=0 len=0 2024-09-14T11:09:59.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.656+0000 7f53f0128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:59.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.656+0000 7f53f0128800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:59.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.656+0000 7f53f0128800 20 rados->read ofs=0 len=0 2024-09-14T11:09:59.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.656+0000 7f53f0128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:59.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.656+0000 7f53f0128800 20 rados->read ofs=0 len=0 2024-09-14T11:09:59.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.657+0000 7f53f0128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:59.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.657+0000 7f53f0128800 20 rados->read ofs=0 len=0 2024-09-14T11:09:59.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.658+0000 7f53f0128800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:59.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.658+0000 7f53f0128800 20 searching for the correct realm 2024-09-14T11:09:59.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.660+0000 7f53eb64a640 0 -- 172.21.15.50:0/987380797 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f53e4066a40 msgr2=0x7f53e406f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:59.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.865+0000 7f53eb64a640 0 -- 172.21.15.50:0/987380797 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x563cff0e6c60 msgr2=0x563cff0e90b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:59.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.869+0000 7f53f0128800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:09:59.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.869+0000 7f53f0128800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:59.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.869+0000 7f53f0128800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:09:59.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.869+0000 7f53f0128800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:59.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.869+0000 7f53f0128800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:59.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.869+0000 7f53f0128800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:59.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.869+0000 7f53f0128800 20 rados->read ofs=0 len=0 2024-09-14T11:09:59.868 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.869+0000 7f53f0128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:59.868 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.869+0000 7f53f0128800 20 rados->read ofs=0 len=0 2024-09-14T11:09:59.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.869+0000 7f53f0128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:59.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.869+0000 7f53f0128800 20 rados->read ofs=0 len=0 2024-09-14T11:09:59.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.870+0000 7f53f0128800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:59.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.870+0000 7f53f0128800 20 zone default found 2024-09-14T11:09:59.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.870+0000 7f53f0128800 4 Realm: () 2024-09-14T11:09:59.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.870+0000 7f53f0128800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:09:59.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.870+0000 7f53f0128800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:09:59.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.870+0000 7f53f0128800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:59.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.870+0000 7f53f0128800 20 zonegroup default 2024-09-14T11:09:59.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.870+0000 7f53f0128800 20 rados->read ofs=0 len=0 2024-09-14T11:09:59.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.870+0000 7f53f0128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:59.870 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.870+0000 7f53f0128800 20 rados->read ofs=0 len=0 2024-09-14T11:09:59.870 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.870+0000 7f53f0128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:59.870 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.870+0000 7f53f0128800 20 rados->read ofs=0 len=0 2024-09-14T11:09:59.870 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.871+0000 7f53f0128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:59.870 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.871+0000 7f53f0128800 20 started sync module instance, tier type = 2024-09-14T11:09:59.870 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.871+0000 7f53f0128800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:09:59.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.879+0000 7f53f0128800 20 add_watcher() i=0 2024-09-14T11:09:59.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.879+0000 7f53f0128800 20 add_watcher() i=1 2024-09-14T11:09:59.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.879+0000 7f53f0128800 20 add_watcher() i=2 2024-09-14T11:09:59.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.879+0000 7f53f0128800 20 add_watcher() i=3 2024-09-14T11:09:59.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.879+0000 7f53f0128800 20 add_watcher() i=4 2024-09-14T11:09:59.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.879+0000 7f53f0128800 20 add_watcher() i=5 2024-09-14T11:09:59.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.879+0000 7f53f0128800 20 add_watcher() i=6 2024-09-14T11:09:59.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.880+0000 7f53f0128800 20 add_watcher() i=7 2024-09-14T11:09:59.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.880+0000 7f53f0128800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:59.879 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.881+0000 7f52a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:59.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.882+0000 7f53f0128800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:59.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.882+0000 7f53f0128800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:59.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.882+0000 7f53f0128800 5 note: GC not initialized 2024-09-14T11:09:59.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.882+0000 7f52a0fe1640 20 reqs_thread_entry: start 2024-09-14T11:09:59.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.882+0000 7f53f0128800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:59.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.882+0000 7f53f0128800 20 Filter name: none 2024-09-14T11:09:59.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.882+0000 7f521a7fc640 20 reqs_thread_entry: start 2024-09-14T11:09:59.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.882+0000 7f53f0128800 20 rados->read ofs=0 len=0 2024-09-14T11:09:59.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.883+0000 7f53f0128800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:09:59.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.883+0000 7f53f0128800 20 rados->read ofs=0 len=0 2024-09-14T11:09:59.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.883+0000 7f53f0128800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:09:59.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.883+0000 7f53f0128800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:59.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.883+0000 7f53f0128800 20 rados->read ofs=0 len=0 2024-09-14T11:09:59.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.884+0000 7f53f0128800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:09:59.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.884+0000 7f53f0128800 20 rados->read ofs=0 len=0 2024-09-14T11:09:59.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.884+0000 7f53f0128800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:09:59.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.884+0000 7f53f0128800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:59.884 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.886+0000 7f52a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:59.886 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.888+0000 7f53f0128800 20 remove_watcher() i=0 2024-09-14T11:09:59.886 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.888+0000 7f53f0128800 2 removed watcher, disabling cache 2024-09-14T11:09:59.886 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.889+0000 7f53f0128800 20 remove_watcher() i=1 2024-09-14T11:09:59.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.890+0000 7f53f0128800 20 remove_watcher() i=2 2024-09-14T11:09:59.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.890+0000 7f53f0128800 20 remove_watcher() i=3 2024-09-14T11:09:59.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.891+0000 7f53f0128800 20 remove_watcher() i=4 2024-09-14T11:09:59.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.892+0000 7f53f0128800 20 remove_watcher() i=5 2024-09-14T11:09:59.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.893+0000 7f53f0128800 20 remove_watcher() i=6 2024-09-14T11:09:59.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.894+0000 7f53f0128800 20 remove_watcher() i=7 2024-09-14T11:09:59.903 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:59.903 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:09:59.904 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-set-target-layout id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:09:59.904 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:09:59.905 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-14T11:09:59.942 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:59.942 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:59.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.983+0000 7faa62e16800 20 rados->read ofs=0 len=0 2024-09-14T11:09:59.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.985+0000 7faa62e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:59.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.985+0000 7faa62e16800 20 realm 2024-09-14T11:09:59.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.985+0000 7faa62e16800 20 rados->read ofs=0 len=0 2024-09-14T11:09:59.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.985+0000 7faa62e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:59.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.985+0000 7faa62e16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:59.985 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.985+0000 7faa62e16800 20 rados->read ofs=0 len=0 2024-09-14T11:09:59.985 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.985+0000 7faa62e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:59.985 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.985+0000 7faa62e16800 20 rados->read ofs=0 len=0 2024-09-14T11:09:59.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.986+0000 7faa62e16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:59.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.986+0000 7faa62e16800 20 rados->read ofs=0 len=0 2024-09-14T11:09:59.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.987+0000 7faa62e16800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:59.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.987+0000 7faa62e16800 20 searching for the correct realm 2024-09-14T11:09:59.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:09:59.990+0000 7faa5dde6640 0 -- 172.21.15.50:0/1831337573 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7faa58019940 msgr2=0x7faa58026400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:00.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.195+0000 7faa5e5e7640 0 -- 172.21.15.50:0/1831337573 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7faa5803b960 msgr2=0x7faa58018420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:00.200 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.200+0000 7faa62e16800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:10:00.200 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.200+0000 7faa62e16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:00.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.200+0000 7faa62e16800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:10:00.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.200+0000 7faa62e16800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:00.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.200+0000 7faa62e16800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:00.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.200+0000 7faa62e16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:00.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.200+0000 7faa62e16800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.200+0000 7faa62e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:00.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.200+0000 7faa62e16800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.200+0000 7faa62e16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:00.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.200+0000 7faa62e16800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.201+0000 7faa62e16800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:00.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.201+0000 7faa62e16800 20 zone default found 2024-09-14T11:10:00.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.201+0000 7faa62e16800 4 Realm: () 2024-09-14T11:10:00.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.201+0000 7faa62e16800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:10:00.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.201+0000 7faa62e16800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:10:00.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.201+0000 7faa62e16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:00.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.201+0000 7faa62e16800 20 zonegroup default 2024-09-14T11:10:00.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.201+0000 7faa62e16800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.201+0000 7faa62e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:00.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.201+0000 7faa62e16800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.201+0000 7faa62e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:00.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.201+0000 7faa62e16800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.202+0000 7faa62e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:00.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.202+0000 7faa62e16800 20 started sync module instance, tier type = 2024-09-14T11:10:00.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.202+0000 7faa62e16800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:10:00.208 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.210+0000 7faa62e16800 20 add_watcher() i=0 2024-09-14T11:10:00.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.210+0000 7faa62e16800 20 add_watcher() i=1 2024-09-14T11:10:00.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.210+0000 7faa62e16800 20 add_watcher() i=2 2024-09-14T11:10:00.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.210+0000 7faa62e16800 20 add_watcher() i=3 2024-09-14T11:10:00.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.210+0000 7faa62e16800 20 add_watcher() i=4 2024-09-14T11:10:00.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.210+0000 7faa62e16800 20 add_watcher() i=5 2024-09-14T11:10:00.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.210+0000 7faa62e16800 20 add_watcher() i=6 2024-09-14T11:10:00.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.211+0000 7faa62e16800 20 add_watcher() i=7 2024-09-14T11:10:00.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.211+0000 7faa62e16800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:00.211 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.213+0000 7fa914fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:00.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.214+0000 7faa62e16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:00.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.214+0000 7faa62e16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:00.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.214+0000 7faa62e16800 5 note: GC not initialized 2024-09-14T11:10:00.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.214+0000 7fa88f7fe640 20 reqs_thread_entry: start 2024-09-14T11:10:00.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.214+0000 7faa62e16800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:00.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.214+0000 7faa62e16800 20 Filter name: none 2024-09-14T11:10:00.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.214+0000 7fa88d7fa640 20 reqs_thread_entry: start 2024-09-14T11:10:00.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.214+0000 7faa62e16800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:10:00.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.214+0000 7faa62e16800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.215+0000 7faa62e16800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:10:00.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.215+0000 7faa62e16800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:10:00.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.215+0000 7faa62e16800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:10:00.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.215+0000 7faa62e16800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24 : miss 2024-09-14T11:10:00.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.215+0000 7faa62e16800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.215+0000 7faa62e16800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:10:00.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.215+0000 7faa62e16800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24 info.flags=0x17 2024-09-14T11:10:00.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.215+0000 7faa62e16800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24 to cache LRU end 2024-09-14T11:10:00.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.215+0000 7faa62e16800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:10:00.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.215+0000 7faa62e16800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:00.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.215+0000 7faa62e16800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24 2024-09-14T11:10:00.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.219+0000 7faa62e16800 -1 Injecting error=-125 at location=set_target_layout 2024-09-14T11:10:00.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.220+0000 7faa62e16800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24 info.flags=0x17 2024-09-14T11:10:00.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.220+0000 7faa62e16800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24 to cache LRU end 2024-09-14T11:10:00.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.220+0000 7faa62e16800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:00.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.220+0000 7faa62e16800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24, ofs0, ns] 2024-09-14T11:10:00.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.220+0000 7fa941ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497063 cookie 94301099264656 notifier 6639 bl.length()=1009 2024-09-14T11:10:00.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.220+0000 7fa941ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24 info.flags=0x17 2024-09-14T11:10:00.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.220+0000 7fa941ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24 to cache LRU end 2024-09-14T11:10:00.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.220+0000 7fa941ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:00.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.222+0000 7faa62e16800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24]): orig_sources= new_sources= 2024-09-14T11:10:00.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.222+0000 7faa62e16800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24]): potential sources added=[] removed=[] 2024-09-14T11:10:00.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.222+0000 7faa62e16800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24]): orig_dests= new_dests= 2024-09-14T11:10:00.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.222+0000 7faa62e16800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24]): potential dests added=[] removed=[] 2024-09-14T11:10:00.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1.0 2024-09-14T11:10:00.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1.0 2024-09-14T11:10:00.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1.1 2024-09-14T11:10:00.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1.1 2024-09-14T11:10:00.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1.2 2024-09-14T11:10:00.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1.2 2024-09-14T11:10:00.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1.3 2024-09-14T11:10:00.227 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1.3 2024-09-14T11:10:00.227 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1.4 2024-09-14T11:10:00.227 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1.4 2024-09-14T11:10:00.227 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1.5 2024-09-14T11:10:00.227 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1.5 2024-09-14T11:10:00.227 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1.6 2024-09-14T11:10:00.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1.6 2024-09-14T11:10:00.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1.7 2024-09-14T11:10:00.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1.7 2024-09-14T11:10:00.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1.8 2024-09-14T11:10:00.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1.8 2024-09-14T11:10:00.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1.9 2024-09-14T11:10:00.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1.9 2024-09-14T11:10:00.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1.10 2024-09-14T11:10:00.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1.10 2024-09-14T11:10:00.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1.11 2024-09-14T11:10:00.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1.11 2024-09-14T11:10:00.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.0 2024-09-14T11:10:00.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.227+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1 2024-09-14T11:10:00.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.228+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.2 2024-09-14T11:10:00.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.228+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.3 2024-09-14T11:10:00.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.228+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.4 2024-09-14T11:10:00.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.229+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.5 2024-09-14T11:10:00.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.230+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.6 2024-09-14T11:10:00.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.230+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.7 2024-09-14T11:10:00.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.231+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.8 2024-09-14T11:10:00.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.231+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.9 2024-09-14T11:10:00.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.232+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.10 2024-09-14T11:10:00.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.235+0000 7faa62e16800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:10:00.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.235+0000 7faa62e16800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24 2024-09-14T11:10:00.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.236+0000 7faa62e16800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24 info.flags=0x17 2024-09-14T11:10:00.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.236+0000 7faa62e16800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24 to cache LRU end 2024-09-14T11:10:00.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.236+0000 7faa62e16800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:00.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.236+0000 7faa62e16800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24, ofs0, ns] 2024-09-14T11:10:00.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.236+0000 7fa9417fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497064 cookie 94301099264656 notifier 6639 bl.length()=1009 2024-09-14T11:10:00.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.236+0000 7fa9417fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24 info.flags=0x17 2024-09-14T11:10:00.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.236+0000 7fa9417fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24 to cache LRU end 2024-09-14T11:10:00.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.236+0000 7fa9417fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:00.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.238+0000 7faa62e16800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24]): orig_sources= new_sources= 2024-09-14T11:10:00.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.238+0000 7faa62e16800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24]): potential sources added=[] removed=[] 2024-09-14T11:10:00.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.238+0000 7faa62e16800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24]): orig_dests= new_dests= 2024-09-14T11:10:00.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.238+0000 7faa62e16800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24]): potential dests added=[] removed=[] 2024-09-14T11:10:00.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.241+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.0 2024-09-14T11:10:00.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.241+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.1 2024-09-14T11:10:00.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.241+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.2 2024-09-14T11:10:00.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.241+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.3 2024-09-14T11:10:00.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.242+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.4 2024-09-14T11:10:00.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.242+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.5 2024-09-14T11:10:00.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.242+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.6 2024-09-14T11:10:00.241 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.243+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.7 2024-09-14T11:10:00.241 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.243+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.8 2024-09-14T11:10:00.241 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.243+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.9 2024-09-14T11:10:00.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.244+0000 7faa62e16800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24.10 2024-09-14T11:10:00.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.244+0000 7faa62e16800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:10:00.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.244+0000 7faa62e16800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24 2024-09-14T11:10:00.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.246+0000 7faa62e16800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24 info.flags=0x17 2024-09-14T11:10:00.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.246+0000 7faa62e16800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24 to cache LRU end 2024-09-14T11:10:00.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.246+0000 7faa62e16800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:00.245 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.246+0000 7faa62e16800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24, ofs0, ns] 2024-09-14T11:10:00.245 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.246+0000 7fa9417fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497065 cookie 94301099264656 notifier 6639 bl.length()=977 2024-09-14T11:10:00.245 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.246+0000 7fa9417fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24 info.flags=0x17 2024-09-14T11:10:00.245 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.246+0000 7fa9417fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24 to cache LRU end 2024-09-14T11:10:00.245 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.246+0000 7fa9417fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:00.246 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.247+0000 7faa62e16800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24]): orig_sources= new_sources= 2024-09-14T11:10:00.246 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.247+0000 7faa62e16800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24]): potential sources added=[] removed=[] 2024-09-14T11:10:00.246 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.247+0000 7faa62e16800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24]): orig_dests= new_dests= 2024-09-14T11:10:00.246 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.247+0000 7faa62e16800 20 handle_bi_update(): bucket=:error-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24]): potential dests added=[] removed=[] 2024-09-14T11:10:00.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.250+0000 7faa62e16800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:10:00.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.252+0000 7fa914fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:00.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.254+0000 7faa62e16800 20 remove_watcher() i=0 2024-09-14T11:10:00.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.254+0000 7faa62e16800 2 removed watcher, disabling cache 2024-09-14T11:10:00.253 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.255+0000 7faa62e16800 20 remove_watcher() i=1 2024-09-14T11:10:00.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.256+0000 7faa62e16800 20 remove_watcher() i=2 2024-09-14T11:10:00.255 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.257+0000 7faa62e16800 20 remove_watcher() i=3 2024-09-14T11:10:00.256 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.258+0000 7faa62e16800 20 remove_watcher() i=4 2024-09-14T11:10:00.257 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.259+0000 7faa62e16800 20 remove_watcher() i=5 2024-09-14T11:10:00.258 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.260+0000 7faa62e16800 20 remove_watcher() i=6 2024-09-14T11:10:00.259 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.261+0000 7faa62e16800 20 remove_watcher() i=7 2024-09-14T11:10:00.271 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:10:00.301 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:00.301 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:00.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.341+0000 7f639d92a800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.342 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.344+0000 7f639d92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:00.342 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.344+0000 7f639d92a800 20 realm 2024-09-14T11:10:00.342 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.344+0000 7f639d92a800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.342 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.344+0000 7f639d92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:00.342 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.344+0000 7f639d92a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:00.342 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.344+0000 7f639d92a800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.344+0000 7f639d92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:00.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.344+0000 7f639d92a800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.345+0000 7f639d92a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:00.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.345+0000 7f639d92a800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.346+0000 7f639d92a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:00.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.346+0000 7f639d92a800 20 searching for the correct realm 2024-09-14T11:10:00.346 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.348+0000 7f6398e1d640 0 -- 172.21.15.50:0/899805334 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f6394066670 msgr2=0x7f639408c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:00.551 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.553+0000 7f6399e1f640 0 -- 172.21.15.50:0/899805334 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55febf1cdea0 msgr2=0x55febf1d02b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:00.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.557+0000 7f639d92a800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:10:00.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.557+0000 7f639d92a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:00.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.557+0000 7f639d92a800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:10:00.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.557+0000 7f639d92a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:00.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.557+0000 7f639d92a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:00.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.557+0000 7f639d92a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:00.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.557+0000 7f639d92a800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.557+0000 7f639d92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:00.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.557+0000 7f639d92a800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.558+0000 7f639d92a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:00.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.558+0000 7f639d92a800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.558+0000 7f639d92a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:00.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.558+0000 7f639d92a800 20 zone default found 2024-09-14T11:10:00.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.558+0000 7f639d92a800 4 Realm: () 2024-09-14T11:10:00.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.558+0000 7f639d92a800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:10:00.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.558+0000 7f639d92a800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:10:00.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.558+0000 7f639d92a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:00.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.558+0000 7f639d92a800 20 zonegroup default 2024-09-14T11:10:00.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.558+0000 7f639d92a800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.558+0000 7f639d92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:00.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.558+0000 7f639d92a800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.559+0000 7f639d92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:00.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.559+0000 7f639d92a800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.559+0000 7f639d92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:00.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.559+0000 7f639d92a800 20 started sync module instance, tier type = 2024-09-14T11:10:00.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.559+0000 7f639d92a800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:10:00.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.567+0000 7f639d92a800 20 add_watcher() i=0 2024-09-14T11:10:00.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.567+0000 7f639d92a800 20 add_watcher() i=1 2024-09-14T11:10:00.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.567+0000 7f639d92a800 20 add_watcher() i=2 2024-09-14T11:10:00.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.567+0000 7f639d92a800 20 add_watcher() i=3 2024-09-14T11:10:00.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.567+0000 7f639d92a800 20 add_watcher() i=4 2024-09-14T11:10:00.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.567+0000 7f639d92a800 20 add_watcher() i=5 2024-09-14T11:10:00.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.567+0000 7f639d92a800 20 add_watcher() i=6 2024-09-14T11:10:00.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.568+0000 7f639d92a800 20 add_watcher() i=7 2024-09-14T11:10:00.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.568+0000 7f639d92a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:00.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.570+0000 7f624ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:00.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.570+0000 7f639d92a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:00.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.570+0000 7f639d92a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:00.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.570+0000 7f639d92a800 5 note: GC not initialized 2024-09-14T11:10:00.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.570+0000 7f624efe5640 20 reqs_thread_entry: start 2024-09-14T11:10:00.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.571+0000 7f639d92a800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:00.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.571+0000 7f639d92a800 20 Filter name: none 2024-09-14T11:10:00.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.571+0000 7f624cfe1640 20 reqs_thread_entry: start 2024-09-14T11:10:00.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.571+0000 7f639d92a800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.571+0000 7f639d92a800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:10:00.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.571+0000 7f639d92a800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.572+0000 7f639d92a800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:10:00.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.572+0000 7f639d92a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:00.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.572+0000 7f639d92a800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.572+0000 7f639d92a800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:10:00.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.572+0000 7f639d92a800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.572+0000 7f639d92a800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:10:00.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.573+0000 7f639d92a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:00.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.575+0000 7f624ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:00.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.577+0000 7f639d92a800 20 remove_watcher() i=0 2024-09-14T11:10:00.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.577+0000 7f639d92a800 2 removed watcher, disabling cache 2024-09-14T11:10:00.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.578+0000 7f639d92a800 20 remove_watcher() i=1 2024-09-14T11:10:00.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.579+0000 7f639d92a800 20 remove_watcher() i=2 2024-09-14T11:10:00.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.580+0000 7f639d92a800 20 remove_watcher() i=3 2024-09-14T11:10:00.579 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.581+0000 7f639d92a800 20 remove_watcher() i=4 2024-09-14T11:10:00.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.582+0000 7f639d92a800 20 remove_watcher() i=5 2024-09-14T11:10:00.581 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.583+0000 7f639d92a800 20 remove_watcher() i=6 2024-09-14T11:10:00.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:00.584+0000 7f639d92a800 20 remove_watcher() i=7 2024-09-14T11:10:00.593 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:00.593 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:10:00.593 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-set-target-layout id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:10:00.593 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:00.595 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:00.595 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:00.613 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:00.613 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:00.852 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:00.852 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:00.987 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-14T11:10:00.987 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:00.988 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:00.988 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:01.036 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:01.036 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:01.094 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:01.094 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:01.132 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:01.133 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:01.171 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:01.171 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:01.208 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:01.209 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:01.244 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:01.245 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:01.282 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:01.282 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:01.319 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:01.319 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:01.356 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:01.356 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:01.393 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:01.393 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:01.431 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:01.431 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:01.467 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:01.467 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:01.505 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:01.505 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:01.542 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:01.542 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:01.579 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:01.579 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:01.616 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:01.617 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:01.653 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:01.653 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:01.688 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:01.689 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:01.726 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:01.726 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:01.763 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:01.763 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:01.801 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:01.801 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:01.838 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:10:01.868 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:01.868 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:01.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:01.909+0000 7fe228146800 20 rados->read ofs=0 len=0 2024-09-14T11:10:01.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:01.911+0000 7fe228146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:01.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:01.911+0000 7fe228146800 20 realm 2024-09-14T11:10:01.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:01.911+0000 7fe228146800 20 rados->read ofs=0 len=0 2024-09-14T11:10:01.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:01.911+0000 7fe228146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:01.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:01.911+0000 7fe228146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:01.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:01.911+0000 7fe228146800 20 rados->read ofs=0 len=0 2024-09-14T11:10:01.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:01.911+0000 7fe228146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:01.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:01.911+0000 7fe228146800 20 rados->read ofs=0 len=0 2024-09-14T11:10:01.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:01.912+0000 7fe228146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:01.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:01.912+0000 7fe228146800 20 rados->read ofs=0 len=0 2024-09-14T11:10:01.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:01.913+0000 7fe228146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:01.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:01.913+0000 7fe228146800 20 searching for the correct realm 2024-09-14T11:10:01.913 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:01.915+0000 7fe22542f640 0 -- 172.21.15.50:0/3521425493 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fe21806b2d0 msgr2=0x7fe21806aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:02.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.120+0000 7fe226431640 0 -- 172.21.15.50:0/3521425493 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x56176e196a40 msgr2=0x56176e198f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:02.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.124+0000 7fe228146800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:10:02.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.124+0000 7fe228146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:02.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.124+0000 7fe228146800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:10:02.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.124+0000 7fe228146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:02.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.124+0000 7fe228146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:02.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.124+0000 7fe228146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:02.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.124+0000 7fe228146800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.124+0000 7fe228146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.124+0000 7fe228146800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.124+0000 7fe228146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:02.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.124+0000 7fe228146800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.124+0000 7fe228146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:02.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.124+0000 7fe228146800 20 zone default found 2024-09-14T11:10:02.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.124+0000 7fe228146800 4 Realm: () 2024-09-14T11:10:02.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.124+0000 7fe228146800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:10:02.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.124+0000 7fe228146800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:10:02.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.124+0000 7fe228146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:02.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.124+0000 7fe228146800 20 zonegroup default 2024-09-14T11:10:02.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.124+0000 7fe228146800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.125+0000 7fe228146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.125+0000 7fe228146800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.125+0000 7fe228146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.125+0000 7fe228146800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.125+0000 7fe228146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.125+0000 7fe228146800 20 started sync module instance, tier type = 2024-09-14T11:10:02.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.125+0000 7fe228146800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:10:02.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.134+0000 7fe228146800 20 add_watcher() i=0 2024-09-14T11:10:02.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.134+0000 7fe228146800 20 add_watcher() i=1 2024-09-14T11:10:02.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.134+0000 7fe228146800 20 add_watcher() i=2 2024-09-14T11:10:02.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.134+0000 7fe228146800 20 add_watcher() i=3 2024-09-14T11:10:02.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.134+0000 7fe228146800 20 add_watcher() i=4 2024-09-14T11:10:02.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.134+0000 7fe228146800 20 add_watcher() i=5 2024-09-14T11:10:02.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.134+0000 7fe228146800 20 add_watcher() i=6 2024-09-14T11:10:02.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.134+0000 7fe228146800 20 add_watcher() i=7 2024-09-14T11:10:02.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.134+0000 7fe228146800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:02.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.136+0000 7fe0d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:02.135 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.137+0000 7fe228146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:02.135 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.137+0000 7fe228146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:02.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.137+0000 7fe228146800 5 note: GC not initialized 2024-09-14T11:10:02.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.137+0000 7fe0d67fc640 20 reqs_thread_entry: start 2024-09-14T11:10:02.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.137+0000 7fe228146800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:02.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.137+0000 7fe228146800 20 Filter name: none 2024-09-14T11:10:02.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.137+0000 7fe047fff640 20 reqs_thread_entry: start 2024-09-14T11:10:02.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.137+0000 7fe228146800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.138+0000 7fe228146800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:10:02.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.138+0000 7fe228146800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.138+0000 7fe228146800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:10:02.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.138+0000 7fe228146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:02.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.138+0000 7fe228146800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.139+0000 7fe228146800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:10:02.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.139+0000 7fe228146800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.138 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.139+0000 7fe228146800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:10:02.138 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.139+0000 7fe228146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:02.139 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.141+0000 7fe0d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:02.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.143+0000 7fe228146800 20 remove_watcher() i=0 2024-09-14T11:10:02.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.143+0000 7fe228146800 2 removed watcher, disabling cache 2024-09-14T11:10:02.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.144+0000 7fe228146800 20 remove_watcher() i=1 2024-09-14T11:10:02.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.145+0000 7fe228146800 20 remove_watcher() i=2 2024-09-14T11:10:02.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.146+0000 7fe228146800 20 remove_watcher() i=3 2024-09-14T11:10:02.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.147+0000 7fe228146800 20 remove_watcher() i=4 2024-09-14T11:10:02.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.148+0000 7fe228146800 20 remove_watcher() i=5 2024-09-14T11:10:02.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.149+0000 7fe228146800 20 remove_watcher() i=6 2024-09-14T11:10:02.148 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.150+0000 7fe228146800 20 remove_watcher() i=7 2024-09-14T11:10:02.159 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.159 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:10:02.159 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: abort-at-set-target-layout id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:10:02.159 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.160 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-14T11:10:02.196 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:02.196 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:02.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.238+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.239+0000 7f6d67d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.239+0000 7f6d67d23800 20 realm 2024-09-14T11:10:02.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.239+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.239+0000 7f6d67d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.239+0000 7f6d67d23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:02.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.239+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.239+0000 7f6d67d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.239+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.240+0000 7f6d67d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:02.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.240+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.241+0000 7f6d67d23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:02.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.241+0000 7f6d67d23800 20 searching for the correct realm 2024-09-14T11:10:02.241 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.243+0000 7f6d6320b640 0 -- 172.21.15.50:0/2702551086 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f6d5c0c0610 msgr2=0x7f6d5c0b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:02.446 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.448+0000 7f6d63a0c640 0 -- 172.21.15.50:0/2702551086 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f6d5c0b69d0 msgr2=0x7f6d5c003090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:02.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.453+0000 7f6d67d23800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:10:02.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.453+0000 7f6d67d23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:02.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.453+0000 7f6d67d23800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:10:02.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.453+0000 7f6d67d23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:02.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.453+0000 7f6d67d23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:02.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.453+0000 7f6d67d23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:02.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.453+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.453+0000 7f6d67d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.453+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.454+0000 7f6d67d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:02.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.454+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.454+0000 7f6d67d23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:02.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.454+0000 7f6d67d23800 20 zone default found 2024-09-14T11:10:02.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.454+0000 7f6d67d23800 4 Realm: () 2024-09-14T11:10:02.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.454+0000 7f6d67d23800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:10:02.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.454+0000 7f6d67d23800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:10:02.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.454+0000 7f6d67d23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:02.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.454+0000 7f6d67d23800 20 zonegroup default 2024-09-14T11:10:02.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.454+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.454+0000 7f6d67d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.454+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.454+0000 7f6d67d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.455+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.455+0000 7f6d67d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.455 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.455+0000 7f6d67d23800 20 started sync module instance, tier type = 2024-09-14T11:10:02.455 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.455+0000 7f6d67d23800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:10:02.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.463+0000 7f6d67d23800 20 add_watcher() i=0 2024-09-14T11:10:02.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.463+0000 7f6d67d23800 20 add_watcher() i=1 2024-09-14T11:10:02.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.463+0000 7f6d67d23800 20 add_watcher() i=2 2024-09-14T11:10:02.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.463+0000 7f6d67d23800 20 add_watcher() i=3 2024-09-14T11:10:02.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.463+0000 7f6d67d23800 20 add_watcher() i=4 2024-09-14T11:10:02.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.463+0000 7f6d67d23800 20 add_watcher() i=5 2024-09-14T11:10:02.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.463+0000 7f6d67d23800 20 add_watcher() i=6 2024-09-14T11:10:02.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.464+0000 7f6d67d23800 20 add_watcher() i=7 2024-09-14T11:10:02.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.464+0000 7f6d67d23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:02.464 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.466+0000 7f6c19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:02.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.466+0000 7f6d67d23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:02.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.466+0000 7f6d67d23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:02.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.466+0000 7f6d67d23800 5 note: GC not initialized 2024-09-14T11:10:02.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.466+0000 7f6c18fe1640 20 reqs_thread_entry: start 2024-09-14T11:10:02.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.466+0000 7f6d67d23800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:02.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.467+0000 7f6d67d23800 20 Filter name: none 2024-09-14T11:10:02.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.467+0000 7f6b927fc640 20 reqs_thread_entry: start 2024-09-14T11:10:02.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.467+0000 7f6d67d23800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:10:02.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.467+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.467+0000 7f6d67d23800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:10:02.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.467+0000 7f6d67d23800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:10:02.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.467+0000 7f6d67d23800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:10:02.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.467+0000 7f6d67d23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 : miss 2024-09-14T11:10:02.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.467+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.467+0000 7f6d67d23800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:10:02.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.467+0000 7f6d67d23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 info.flags=0x17 2024-09-14T11:10:02.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.467+0000 7f6d67d23800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 to cache LRU end 2024-09-14T11:10:02.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.467+0000 7f6d67d23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:10:02.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.467+0000 7f6d67d23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:02.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.467+0000 7f6d67d23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 2024-09-14T11:10:02.469 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6d67d23800 time 2024-09-14T11:10:02.472021+0000 2024-09-14T11:10:02.469 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:10:02.470 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:10:02.470 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6d6938c76a] 2024-09-14T11:10:02.470 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6d6938c928] 2024-09-14T11:10:02.470 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d12cefe0b1] 2024-09-14T11:10:02.470 INFO:tasks.workunit.client.0.smithi050.stderr: 4: radosgw-admin(+0xd88418) [0x55d12d411418] 2024-09-14T11:10:02.470 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d12cf0defd] 2024-09-14T11:10:02.470 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:10:02.471 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6d68029590] 2024-09-14T11:10:02.471 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:10:02.471 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:10:02.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.472+0000 7f6d67d23800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6d67d23800 time 2024-09-14T11:10:02.472021+0000 2024-09-14T11:10:02.471 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:10:02.471 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.471 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:10:02.471 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6d6938c76a] 2024-09-14T11:10:02.471 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6d6938c928] 2024-09-14T11:10:02.471 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d12cefe0b1] 2024-09-14T11:10:02.471 INFO:tasks.workunit.client.0.smithi050.stderr: 4: radosgw-admin(+0xd88418) [0x55d12d411418] 2024-09-14T11:10:02.471 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d12cf0defd] 2024-09-14T11:10:02.471 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:10:02.472 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6d68029590] 2024-09-14T11:10:02.472 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:10:02.472 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:10:02.472 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.472 INFO:tasks.workunit.client.0.smithi050.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:10:02.472 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f6d67d23800 thread_name:radosgw-admin 2024-09-14T11:10:02.490 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:10:02.490 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6d6803e6f0] 2024-09-14T11:10:02.490 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6d6808b99c] 2024-09-14T11:10:02.490 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:10:02.490 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:10:02.490 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6d6938c7c4] 2024-09-14T11:10:02.490 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6d6938c928] 2024-09-14T11:10:02.490 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d12cefe0b1] 2024-09-14T11:10:02.490 INFO:tasks.workunit.client.0.smithi050.stderr: 8: radosgw-admin(+0xd88418) [0x55d12d411418] 2024-09-14T11:10:02.490 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d12cf0defd] 2024-09-14T11:10:02.490 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:10:02.490 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6d68029590] 2024-09-14T11:10:02.491 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:10:02.491 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:10:02.491 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.473+0000 7f6d67d23800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:10:02.491 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f6d67d23800 thread_name:radosgw-admin 2024-09-14T11:10:02.491 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.491 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:10:02.491 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6d6803e6f0] 2024-09-14T11:10:02.491 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6d6808b99c] 2024-09-14T11:10:02.491 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:10:02.491 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:10:02.491 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6d6938c7c4] 2024-09-14T11:10:02.491 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6d6938c928] 2024-09-14T11:10:02.491 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d12cefe0b1] 2024-09-14T11:10:02.492 INFO:tasks.workunit.client.0.smithi050.stderr: 8: radosgw-admin(+0xd88418) [0x55d12d411418] 2024-09-14T11:10:02.492 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d12cf0defd] 2024-09-14T11:10:02.492 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:10:02.492 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6d68029590] 2024-09-14T11:10:02.492 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:10:02.492 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:10:02.492 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:10:02.492 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.492 INFO:tasks.workunit.client.0.smithi050.stderr:--- begin dump of recent events --- 2024-09-14T11:10:02.492 INFO:tasks.workunit.client.0.smithi050.stderr: -499> 2024-09-14T11:10:02.219+0000 7f6c51e0b640 10 monclient: _finish_auth 0 2024-09-14T11:10:02.492 INFO:tasks.workunit.client.0.smithi050.stderr: -498> 2024-09-14T11:10:02.219+0000 7f6c51e0b640 10 monclient: _check_auth_tickets 2024-09-14T11:10:02.492 INFO:tasks.workunit.client.0.smithi050.stderr: -497> 2024-09-14T11:10:02.219+0000 7f6c51e0b640 10 monclient: handle_config config(0 keys) 2024-09-14T11:10:02.493 INFO:tasks.workunit.client.0.smithi050.stderr: -496> 2024-09-14T11:10:02.219+0000 7f6c51e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:02.493 INFO:tasks.workunit.client.0.smithi050.stderr: -495> 2024-09-14T11:10:02.219+0000 7f6c51e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:10:02.493 INFO:tasks.workunit.client.0.smithi050.stderr: -494> 2024-09-14T11:10:02.219+0000 7f6c51e0b640 10 monclient: dump: 2024-09-14T11:10:02.493 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:02.493 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:02.493 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.493 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.493 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:02.493 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.493 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:02.493 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:02.494 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:02.494 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.494 INFO:tasks.workunit.client.0.smithi050.stderr: -493> 2024-09-14T11:10:02.219+0000 7f6d67d23800 5 monclient: authenticate success, global_id 6681 2024-09-14T11:10:02.494 INFO:tasks.workunit.client.0.smithi050.stderr: -492> 2024-09-14T11:10:02.219+0000 7f6d67d23800 10 monclient: get_monmap_and_config success 2024-09-14T11:10:02.494 INFO:tasks.workunit.client.0.smithi050.stderr: -491> 2024-09-14T11:10:02.219+0000 7f6d67d23800 4 set_mon_vals no callback set 2024-09-14T11:10:02.494 INFO:tasks.workunit.client.0.smithi050.stderr: -490> 2024-09-14T11:10:02.220+0000 7f6d67d23800 10 monclient: shutdown 2024-09-14T11:10:02.494 INFO:tasks.workunit.client.0.smithi050.stderr: -489> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 asok(0x55d12e9fd270) unregister_commands rotate-key 2024-09-14T11:10:02.494 INFO:tasks.workunit.client.0.smithi050.stderr: -488> 2024-09-14T11:10:02.220+0000 7f6d67d23800 10 monclient: build_initial_monmap 2024-09-14T11:10:02.494 INFO:tasks.workunit.client.0.smithi050.stderr: -487> 2024-09-14T11:10:02.220+0000 7f6d67d23800 1 build_initial for_mkfs: 0 2024-09-14T11:10:02.494 INFO:tasks.workunit.client.0.smithi050.stderr: -486> 2024-09-14T11:10:02.220+0000 7f6d67d23800 10 monclient: monmap: 2024-09-14T11:10:02.494 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:10:02.494 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:10:02.494 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:10:02.495 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:10:02.495 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:10:02.495 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.495 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:10:02.495 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:10:02.495 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:10:02.495 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.495 INFO:tasks.workunit.client.0.smithi050.stderr: -485> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding auth protocol: cephx 2024-09-14T11:10:02.495 INFO:tasks.workunit.client.0.smithi050.stderr: -484> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding auth protocol: cephx 2024-09-14T11:10:02.495 INFO:tasks.workunit.client.0.smithi050.stderr: -483> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding auth protocol: cephx 2024-09-14T11:10:02.495 INFO:tasks.workunit.client.0.smithi050.stderr: -482> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding con mode: secure 2024-09-14T11:10:02.495 INFO:tasks.workunit.client.0.smithi050.stderr: -481> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding con mode: crc 2024-09-14T11:10:02.495 INFO:tasks.workunit.client.0.smithi050.stderr: -480> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding con mode: secure 2024-09-14T11:10:02.495 INFO:tasks.workunit.client.0.smithi050.stderr: -479> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding con mode: crc 2024-09-14T11:10:02.495 INFO:tasks.workunit.client.0.smithi050.stderr: -478> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding con mode: secure 2024-09-14T11:10:02.496 INFO:tasks.workunit.client.0.smithi050.stderr: -477> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding con mode: crc 2024-09-14T11:10:02.496 INFO:tasks.workunit.client.0.smithi050.stderr: -476> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding con mode: crc 2024-09-14T11:10:02.496 INFO:tasks.workunit.client.0.smithi050.stderr: -475> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding con mode: secure 2024-09-14T11:10:02.496 INFO:tasks.workunit.client.0.smithi050.stderr: -474> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding con mode: crc 2024-09-14T11:10:02.496 INFO:tasks.workunit.client.0.smithi050.stderr: -473> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding con mode: secure 2024-09-14T11:10:02.496 INFO:tasks.workunit.client.0.smithi050.stderr: -472> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding con mode: crc 2024-09-14T11:10:02.496 INFO:tasks.workunit.client.0.smithi050.stderr: -471> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding con mode: secure 2024-09-14T11:10:02.496 INFO:tasks.workunit.client.0.smithi050.stderr: -470> 2024-09-14T11:10:02.220+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.496 INFO:tasks.workunit.client.0.smithi050.stderr: -469> 2024-09-14T11:10:02.220+0000 7f6d67d23800 1 librados: starting msgr at 2024-09-14T11:10:02.496 INFO:tasks.workunit.client.0.smithi050.stderr: -468> 2024-09-14T11:10:02.220+0000 7f6d67d23800 1 librados: starting objecter 2024-09-14T11:10:02.496 INFO:tasks.workunit.client.0.smithi050.stderr: -467> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command objecter_requests hook 0x55d12ec22d90 2024-09-14T11:10:02.496 INFO:tasks.workunit.client.0.smithi050.stderr: -466> 2024-09-14T11:10:02.220+0000 7f6d67d23800 1 librados: setting wanted keys 2024-09-14T11:10:02.496 INFO:tasks.workunit.client.0.smithi050.stderr: -465> 2024-09-14T11:10:02.220+0000 7f6d67d23800 1 librados: calling monclient init 2024-09-14T11:10:02.497 INFO:tasks.workunit.client.0.smithi050.stderr: -464> 2024-09-14T11:10:02.220+0000 7f6d67d23800 10 monclient: init 2024-09-14T11:10:02.497 INFO:tasks.workunit.client.0.smithi050.stderr: -463> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding auth protocol: cephx 2024-09-14T11:10:02.497 INFO:tasks.workunit.client.0.smithi050.stderr: -462> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding auth protocol: cephx 2024-09-14T11:10:02.497 INFO:tasks.workunit.client.0.smithi050.stderr: -461> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding auth protocol: cephx 2024-09-14T11:10:02.497 INFO:tasks.workunit.client.0.smithi050.stderr: -460> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding con mode: secure 2024-09-14T11:10:02.497 INFO:tasks.workunit.client.0.smithi050.stderr: -459> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding con mode: crc 2024-09-14T11:10:02.497 INFO:tasks.workunit.client.0.smithi050.stderr: -458> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding con mode: secure 2024-09-14T11:10:02.497 INFO:tasks.workunit.client.0.smithi050.stderr: -457> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding con mode: crc 2024-09-14T11:10:02.497 INFO:tasks.workunit.client.0.smithi050.stderr: -456> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding con mode: secure 2024-09-14T11:10:02.497 INFO:tasks.workunit.client.0.smithi050.stderr: -455> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding con mode: crc 2024-09-14T11:10:02.497 INFO:tasks.workunit.client.0.smithi050.stderr: -454> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding con mode: crc 2024-09-14T11:10:02.497 INFO:tasks.workunit.client.0.smithi050.stderr: -453> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding con mode: secure 2024-09-14T11:10:02.497 INFO:tasks.workunit.client.0.smithi050.stderr: -452> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding con mode: crc 2024-09-14T11:10:02.497 INFO:tasks.workunit.client.0.smithi050.stderr: -451> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding con mode: secure 2024-09-14T11:10:02.498 INFO:tasks.workunit.client.0.smithi050.stderr: -450> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding con mode: crc 2024-09-14T11:10:02.498 INFO:tasks.workunit.client.0.smithi050.stderr: -449> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding con mode: secure 2024-09-14T11:10:02.498 INFO:tasks.workunit.client.0.smithi050.stderr: -448> 2024-09-14T11:10:02.221+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.498 INFO:tasks.workunit.client.0.smithi050.stderr: -447> 2024-09-14T11:10:02.221+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.498 INFO:tasks.workunit.client.0.smithi050.stderr: -446> 2024-09-14T11:10:02.221+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command rotate-key hook 0x55d12ec1ccc8 2024-09-14T11:10:02.498 INFO:tasks.workunit.client.0.smithi050.stderr: -445> 2024-09-14T11:10:02.221+0000 7f6d67d23800 10 monclient: _reopen_session rank -1 2024-09-14T11:10:02.498 INFO:tasks.workunit.client.0.smithi050.stderr: -444> 2024-09-14T11:10:02.221+0000 7f6d67d23800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:10:02.498 INFO:tasks.workunit.client.0.smithi050.stderr: -443> 2024-09-14T11:10:02.221+0000 7f6d67d23800 10 monclient(hunting): picked mon.noname-b con 0x55d12eaa8df0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:10:02.498 INFO:tasks.workunit.client.0.smithi050.stderr: -442> 2024-09-14T11:10:02.221+0000 7f6d67d23800 10 monclient(hunting): picked mon.noname-a con 0x55d12eb65f10 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:10:02.498 INFO:tasks.workunit.client.0.smithi050.stderr: -441> 2024-09-14T11:10:02.221+0000 7f6d67d23800 10 monclient(hunting): picked mon.noname-c con 0x55d12ec23880 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:10:02.498 INFO:tasks.workunit.client.0.smithi050.stderr: -440> 2024-09-14T11:10:02.221+0000 7f6d67d23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:02.498 INFO:tasks.workunit.client.0.smithi050.stderr: -439> 2024-09-14T11:10:02.221+0000 7f6d67d23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:02.498 INFO:tasks.workunit.client.0.smithi050.stderr: -438> 2024-09-14T11:10:02.221+0000 7f6d67d23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:02.498 INFO:tasks.workunit.client.0.smithi050.stderr: -437> 2024-09-14T11:10:02.221+0000 7f6d67d23800 10 monclient(hunting): _renew_subs 2024-09-14T11:10:02.499 INFO:tasks.workunit.client.0.smithi050.stderr: -436> 2024-09-14T11:10:02.221+0000 7f6d67d23800 10 monclient(hunting): authenticate will time out at 2254.858495s 2024-09-14T11:10:02.499 INFO:tasks.workunit.client.0.smithi050.stderr: -435> 2024-09-14T11:10:02.221+0000 7f6d6320b640 10 monclient(hunting): get_auth_request con 0x55d12eb65f10 auth_method 0 2024-09-14T11:10:02.499 INFO:tasks.workunit.client.0.smithi050.stderr: -434> 2024-09-14T11:10:02.221+0000 7f6d6320b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:02.499 INFO:tasks.workunit.client.0.smithi050.stderr: -433> 2024-09-14T11:10:02.221+0000 7f6d6320b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:02.499 INFO:tasks.workunit.client.0.smithi050.stderr: -432> 2024-09-14T11:10:02.221+0000 7f6d6320b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:02.499 INFO:tasks.workunit.client.0.smithi050.stderr: -431> 2024-09-14T11:10:02.221+0000 7f6d6420d640 10 monclient(hunting): get_auth_request con 0x55d12ec23880 auth_method 0 2024-09-14T11:10:02.499 INFO:tasks.workunit.client.0.smithi050.stderr: -430> 2024-09-14T11:10:02.221+0000 7f6d6420d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:02.499 INFO:tasks.workunit.client.0.smithi050.stderr: -429> 2024-09-14T11:10:02.221+0000 7f6d6420d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:02.499 INFO:tasks.workunit.client.0.smithi050.stderr: -428> 2024-09-14T11:10:02.221+0000 7f6d6420d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:02.499 INFO:tasks.workunit.client.0.smithi050.stderr: -427> 2024-09-14T11:10:02.221+0000 7f6d63a0c640 10 monclient(hunting): get_auth_request con 0x55d12eaa8df0 auth_method 0 2024-09-14T11:10:02.499 INFO:tasks.workunit.client.0.smithi050.stderr: -426> 2024-09-14T11:10:02.221+0000 7f6d63a0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:02.499 INFO:tasks.workunit.client.0.smithi050.stderr: -425> 2024-09-14T11:10:02.221+0000 7f6d63a0c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:02.499 INFO:tasks.workunit.client.0.smithi050.stderr: -424> 2024-09-14T11:10:02.221+0000 7f6d63a0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:02.499 INFO:tasks.workunit.client.0.smithi050.stderr: -423> 2024-09-14T11:10:02.221+0000 7f6d6320b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:02.500 INFO:tasks.workunit.client.0.smithi050.stderr: -422> 2024-09-14T11:10:02.221+0000 7f6d6320b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:02.500 INFO:tasks.workunit.client.0.smithi050.stderr: -421> 2024-09-14T11:10:02.221+0000 7f6d6320b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:02.500 INFO:tasks.workunit.client.0.smithi050.stderr: -420> 2024-09-14T11:10:02.221+0000 7f6d6420d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:02.500 INFO:tasks.workunit.client.0.smithi050.stderr: -419> 2024-09-14T11:10:02.221+0000 7f6d6420d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:02.500 INFO:tasks.workunit.client.0.smithi050.stderr: -418> 2024-09-14T11:10:02.221+0000 7f6d6420d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:02.500 INFO:tasks.workunit.client.0.smithi050.stderr: -417> 2024-09-14T11:10:02.221+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:02.500 INFO:tasks.workunit.client.0.smithi050.stderr: -416> 2024-09-14T11:10:02.221+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:02.500 INFO:tasks.workunit.client.0.smithi050.stderr: -415> 2024-09-14T11:10:02.221+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:02.500 INFO:tasks.workunit.client.0.smithi050.stderr: -414> 2024-09-14T11:10:02.221+0000 7f6d6320b640 10 monclient(hunting): handle_auth_done global_id 6684 payload 824 2024-09-14T11:10:02.500 INFO:tasks.workunit.client.0.smithi050.stderr: -413> 2024-09-14T11:10:02.221+0000 7f6d6320b640 10 monclient: _finish_hunting 0 2024-09-14T11:10:02.500 INFO:tasks.workunit.client.0.smithi050.stderr: -412> 2024-09-14T11:10:02.221+0000 7f6d6320b640 1 monclient: found mon.noname-a 2024-09-14T11:10:02.500 INFO:tasks.workunit.client.0.smithi050.stderr: -411> 2024-09-14T11:10:02.221+0000 7f6d6320b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:10:02.500 INFO:tasks.workunit.client.0.smithi050.stderr: -410> 2024-09-14T11:10:02.222+0000 7f6c4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:02.500 INFO:tasks.workunit.client.0.smithi050.stderr: -409> 2024-09-14T11:10:02.222+0000 7f6c4bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:10:02.501 INFO:tasks.workunit.client.0.smithi050.stderr: -408> 2024-09-14T11:10:02.222+0000 7f6c4bfff640 10 monclient: dump: 2024-09-14T11:10:02.501 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:02.501 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:02.501 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.501 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.501 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:02.501 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.501 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:02.501 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:02.501 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:02.501 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.501 INFO:tasks.workunit.client.0.smithi050.stderr: -407> 2024-09-14T11:10:02.222+0000 7f6c4bfff640 10 monclient: _finish_auth 0 2024-09-14T11:10:02.501 INFO:tasks.workunit.client.0.smithi050.stderr: -406> 2024-09-14T11:10:02.222+0000 7f6c4bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:10:02.502 INFO:tasks.workunit.client.0.smithi050.stderr: -405> 2024-09-14T11:10:02.222+0000 7f6c4bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:10:02.502 INFO:tasks.workunit.client.0.smithi050.stderr: -404> 2024-09-14T11:10:02.222+0000 7f6c4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:02.502 INFO:tasks.workunit.client.0.smithi050.stderr: -403> 2024-09-14T11:10:02.222+0000 7f6c4bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:10:02.502 INFO:tasks.workunit.client.0.smithi050.stderr: -402> 2024-09-14T11:10:02.222+0000 7f6c4bfff640 10 monclient: dump: 2024-09-14T11:10:02.502 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:02.502 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:02.502 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.502 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.502 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:02.502 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.502 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:02.502 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:02.502 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:02.502 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.503 INFO:tasks.workunit.client.0.smithi050.stderr: -401> 2024-09-14T11:10:02.222+0000 7f6d67d23800 5 monclient: authenticate success, global_id 6684 2024-09-14T11:10:02.503 INFO:tasks.workunit.client.0.smithi050.stderr: -400> 2024-09-14T11:10:02.222+0000 7f6d67d23800 10 monclient: _renew_subs 2024-09-14T11:10:02.503 INFO:tasks.workunit.client.0.smithi050.stderr: -399> 2024-09-14T11:10:02.222+0000 7f6c51e0b640 4 set_mon_vals no callback set 2024-09-14T11:10:02.503 INFO:tasks.workunit.client.0.smithi050.stderr: -398> 2024-09-14T11:10:02.222+0000 7f6d67d23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:10:02.503 INFO:tasks.workunit.client.0.smithi050.stderr: -397> 2024-09-14T11:10:02.222+0000 7f6d67d23800 10 monclient: _renew_subs 2024-09-14T11:10:02.503 INFO:tasks.workunit.client.0.smithi050.stderr: -396> 2024-09-14T11:10:02.222+0000 7f6d67d23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:10:02.503 INFO:tasks.workunit.client.0.smithi050.stderr: -395> 2024-09-14T11:10:02.222+0000 7f6d67d23800 1 librados: init done 2024-09-14T11:10:02.503 INFO:tasks.workunit.client.0.smithi050.stderr: -394> 2024-09-14T11:10:02.224+0000 7f6c4bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:10:02.503 INFO:tasks.workunit.client.0.smithi050.stderr: -393> 2024-09-14T11:10:02.224+0000 7f6c4bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:10:02.503 INFO:tasks.workunit.client.0.smithi050.stderr: -392> 2024-09-14T11:10:02.224+0000 7f6c4bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:10:02.503 INFO:tasks.workunit.client.0.smithi050.stderr: -391> 2024-09-14T11:10:02.224+0000 7f6d63a0c640 10 monclient: get_auth_request con 0x7f6c4c077230 auth_method 0 2024-09-14T11:10:02.503 INFO:tasks.workunit.client.0.smithi050.stderr: -390> 2024-09-14T11:10:02.225+0000 7f6d6420d640 10 monclient: get_auth_request con 0x55d12ec66970 auth_method 0 2024-09-14T11:10:02.503 INFO:tasks.workunit.client.0.smithi050.stderr: -389> 2024-09-14T11:10:02.225+0000 7f6d63a0c640 10 monclient: get_auth_request con 0x55d12ec69b50 auth_method 0 2024-09-14T11:10:02.503 INFO:tasks.workunit.client.0.smithi050.stderr: -388> 2024-09-14T11:10:02.226+0000 7f6d6320b640 10 monclient: get_auth_request con 0x55d12ec6def0 auth_method 0 2024-09-14T11:10:02.504 INFO:tasks.workunit.client.0.smithi050.stderr: -387> 2024-09-14T11:10:02.227+0000 7f6d67d23800 10 monclient: build_initial_monmap 2024-09-14T11:10:02.504 INFO:tasks.workunit.client.0.smithi050.stderr: -386> 2024-09-14T11:10:02.227+0000 7f6d67d23800 1 build_initial for_mkfs: 0 2024-09-14T11:10:02.504 INFO:tasks.workunit.client.0.smithi050.stderr: -385> 2024-09-14T11:10:02.227+0000 7f6d67d23800 10 monclient: monmap: 2024-09-14T11:10:02.504 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:10:02.504 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:10:02.504 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:10:02.504 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:10:02.504 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:10:02.504 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.504 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:10:02.504 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:10:02.504 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:10:02.504 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.505 INFO:tasks.workunit.client.0.smithi050.stderr: -384> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding auth protocol: cephx 2024-09-14T11:10:02.505 INFO:tasks.workunit.client.0.smithi050.stderr: -383> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding auth protocol: cephx 2024-09-14T11:10:02.505 INFO:tasks.workunit.client.0.smithi050.stderr: -382> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding auth protocol: cephx 2024-09-14T11:10:02.505 INFO:tasks.workunit.client.0.smithi050.stderr: -381> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding con mode: secure 2024-09-14T11:10:02.505 INFO:tasks.workunit.client.0.smithi050.stderr: -380> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding con mode: crc 2024-09-14T11:10:02.505 INFO:tasks.workunit.client.0.smithi050.stderr: -379> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding con mode: secure 2024-09-14T11:10:02.505 INFO:tasks.workunit.client.0.smithi050.stderr: -378> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding con mode: crc 2024-09-14T11:10:02.505 INFO:tasks.workunit.client.0.smithi050.stderr: -377> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding con mode: secure 2024-09-14T11:10:02.505 INFO:tasks.workunit.client.0.smithi050.stderr: -376> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding con mode: crc 2024-09-14T11:10:02.505 INFO:tasks.workunit.client.0.smithi050.stderr: -375> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding con mode: crc 2024-09-14T11:10:02.505 INFO:tasks.workunit.client.0.smithi050.stderr: -374> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding con mode: secure 2024-09-14T11:10:02.505 INFO:tasks.workunit.client.0.smithi050.stderr: -373> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding con mode: crc 2024-09-14T11:10:02.505 INFO:tasks.workunit.client.0.smithi050.stderr: -372> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding con mode: secure 2024-09-14T11:10:02.506 INFO:tasks.workunit.client.0.smithi050.stderr: -371> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding con mode: crc 2024-09-14T11:10:02.506 INFO:tasks.workunit.client.0.smithi050.stderr: -370> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding con mode: secure 2024-09-14T11:10:02.506 INFO:tasks.workunit.client.0.smithi050.stderr: -369> 2024-09-14T11:10:02.228+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.506 INFO:tasks.workunit.client.0.smithi050.stderr: -368> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command objecter_requests cmddesc objecter_requests hook 0x55d12ec763c0 EEXIST 2024-09-14T11:10:02.506 INFO:tasks.workunit.client.0.smithi050.stderr: -367> 2024-09-14T11:10:02.228+0000 7f6d67d23800 10 monclient: init 2024-09-14T11:10:02.506 INFO:tasks.workunit.client.0.smithi050.stderr: -366> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding auth protocol: cephx 2024-09-14T11:10:02.506 INFO:tasks.workunit.client.0.smithi050.stderr: -365> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding auth protocol: cephx 2024-09-14T11:10:02.506 INFO:tasks.workunit.client.0.smithi050.stderr: -364> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding auth protocol: cephx 2024-09-14T11:10:02.506 INFO:tasks.workunit.client.0.smithi050.stderr: -363> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding con mode: secure 2024-09-14T11:10:02.506 INFO:tasks.workunit.client.0.smithi050.stderr: -362> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding con mode: crc 2024-09-14T11:10:02.506 INFO:tasks.workunit.client.0.smithi050.stderr: -361> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding con mode: secure 2024-09-14T11:10:02.506 INFO:tasks.workunit.client.0.smithi050.stderr: -360> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding con mode: crc 2024-09-14T11:10:02.506 INFO:tasks.workunit.client.0.smithi050.stderr: -359> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding con mode: secure 2024-09-14T11:10:02.507 INFO:tasks.workunit.client.0.smithi050.stderr: -358> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding con mode: crc 2024-09-14T11:10:02.507 INFO:tasks.workunit.client.0.smithi050.stderr: -357> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding con mode: crc 2024-09-14T11:10:02.507 INFO:tasks.workunit.client.0.smithi050.stderr: -356> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding con mode: secure 2024-09-14T11:10:02.507 INFO:tasks.workunit.client.0.smithi050.stderr: -355> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding con mode: crc 2024-09-14T11:10:02.507 INFO:tasks.workunit.client.0.smithi050.stderr: -354> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding con mode: secure 2024-09-14T11:10:02.507 INFO:tasks.workunit.client.0.smithi050.stderr: -353> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding con mode: crc 2024-09-14T11:10:02.507 INFO:tasks.workunit.client.0.smithi050.stderr: -352> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding con mode: secure 2024-09-14T11:10:02.507 INFO:tasks.workunit.client.0.smithi050.stderr: -351> 2024-09-14T11:10:02.228+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.507 INFO:tasks.workunit.client.0.smithi050.stderr: -350> 2024-09-14T11:10:02.228+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.507 INFO:tasks.workunit.client.0.smithi050.stderr: -349> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command rotate-key cmddesc rotate-key hook 0x55d12ec715a0 EEXIST 2024-09-14T11:10:02.507 INFO:tasks.workunit.client.0.smithi050.stderr: -348> 2024-09-14T11:10:02.228+0000 7f6d67d23800 10 monclient: _reopen_session rank -1 2024-09-14T11:10:02.507 INFO:tasks.workunit.client.0.smithi050.stderr: -347> 2024-09-14T11:10:02.228+0000 7f6d67d23800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:10:02.507 INFO:tasks.workunit.client.0.smithi050.stderr: -346> 2024-09-14T11:10:02.229+0000 7f6d67d23800 10 monclient(hunting): picked mon.noname-c con 0x55d12ec9a6e0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:10:02.507 INFO:tasks.workunit.client.0.smithi050.stderr: -345> 2024-09-14T11:10:02.229+0000 7f6d67d23800 10 monclient(hunting): picked mon.noname-b con 0x55d12ec9aac0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:10:02.507 INFO:tasks.workunit.client.0.smithi050.stderr: -344> 2024-09-14T11:10:02.229+0000 7f6d67d23800 10 monclient(hunting): picked mon.noname-a con 0x55d12ec993f0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:10:02.508 INFO:tasks.workunit.client.0.smithi050.stderr: -343> 2024-09-14T11:10:02.229+0000 7f6d67d23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:02.508 INFO:tasks.workunit.client.0.smithi050.stderr: -342> 2024-09-14T11:10:02.229+0000 7f6d67d23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:02.508 INFO:tasks.workunit.client.0.smithi050.stderr: -341> 2024-09-14T11:10:02.229+0000 7f6d67d23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:02.508 INFO:tasks.workunit.client.0.smithi050.stderr: -340> 2024-09-14T11:10:02.229+0000 7f6d67d23800 10 monclient(hunting): _renew_subs 2024-09-14T11:10:02.508 INFO:tasks.workunit.client.0.smithi050.stderr: -339> 2024-09-14T11:10:02.229+0000 7f6d67d23800 10 monclient(hunting): authenticate will time out at 2254.866033s 2024-09-14T11:10:02.508 INFO:tasks.workunit.client.0.smithi050.stderr: -338> 2024-09-14T11:10:02.229+0000 7f6d6420d640 10 monclient(hunting): get_auth_request con 0x55d12ec993f0 auth_method 0 2024-09-14T11:10:02.508 INFO:tasks.workunit.client.0.smithi050.stderr: -337> 2024-09-14T11:10:02.229+0000 7f6d6420d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:02.508 INFO:tasks.workunit.client.0.smithi050.stderr: -336> 2024-09-14T11:10:02.229+0000 7f6d6420d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:02.508 INFO:tasks.workunit.client.0.smithi050.stderr: -335> 2024-09-14T11:10:02.229+0000 7f6d6420d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:02.508 INFO:tasks.workunit.client.0.smithi050.stderr: -334> 2024-09-14T11:10:02.229+0000 7f6d63a0c640 10 monclient(hunting): get_auth_request con 0x55d12ec9a6e0 auth_method 0 2024-09-14T11:10:02.508 INFO:tasks.workunit.client.0.smithi050.stderr: -333> 2024-09-14T11:10:02.229+0000 7f6d63a0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:02.508 INFO:tasks.workunit.client.0.smithi050.stderr: -332> 2024-09-14T11:10:02.229+0000 7f6d63a0c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:02.509 INFO:tasks.workunit.client.0.smithi050.stderr: -331> 2024-09-14T11:10:02.229+0000 7f6d63a0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:02.509 INFO:tasks.workunit.client.0.smithi050.stderr: -330> 2024-09-14T11:10:02.229+0000 7f6d6320b640 10 monclient(hunting): get_auth_request con 0x55d12ec9aac0 auth_method 0 2024-09-14T11:10:02.509 INFO:tasks.workunit.client.0.smithi050.stderr: -329> 2024-09-14T11:10:02.229+0000 7f6d6320b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:02.509 INFO:tasks.workunit.client.0.smithi050.stderr: -328> 2024-09-14T11:10:02.229+0000 7f6d6320b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:02.509 INFO:tasks.workunit.client.0.smithi050.stderr: -327> 2024-09-14T11:10:02.229+0000 7f6d6320b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:02.509 INFO:tasks.workunit.client.0.smithi050.stderr: -326> 2024-09-14T11:10:02.229+0000 7f6d6420d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:02.509 INFO:tasks.workunit.client.0.smithi050.stderr: -325> 2024-09-14T11:10:02.229+0000 7f6d6420d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:02.509 INFO:tasks.workunit.client.0.smithi050.stderr: -324> 2024-09-14T11:10:02.229+0000 7f6d6420d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:02.509 INFO:tasks.workunit.client.0.smithi050.stderr: -323> 2024-09-14T11:10:02.229+0000 7f6d6320b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:02.509 INFO:tasks.workunit.client.0.smithi050.stderr: -322> 2024-09-14T11:10:02.229+0000 7f6d6320b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:02.509 INFO:tasks.workunit.client.0.smithi050.stderr: -321> 2024-09-14T11:10:02.229+0000 7f6d6320b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:02.509 INFO:tasks.workunit.client.0.smithi050.stderr: -320> 2024-09-14T11:10:02.229+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:02.509 INFO:tasks.workunit.client.0.smithi050.stderr: -319> 2024-09-14T11:10:02.229+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:02.510 INFO:tasks.workunit.client.0.smithi050.stderr: -318> 2024-09-14T11:10:02.229+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:02.510 INFO:tasks.workunit.client.0.smithi050.stderr: -317> 2024-09-14T11:10:02.229+0000 7f6d6420d640 10 monclient(hunting): handle_auth_done global_id 6687 payload 824 2024-09-14T11:10:02.510 INFO:tasks.workunit.client.0.smithi050.stderr: -316> 2024-09-14T11:10:02.229+0000 7f6d6420d640 10 monclient: _finish_hunting 0 2024-09-14T11:10:02.510 INFO:tasks.workunit.client.0.smithi050.stderr: -315> 2024-09-14T11:10:02.229+0000 7f6d6420d640 1 monclient: found mon.noname-a 2024-09-14T11:10:02.510 INFO:tasks.workunit.client.0.smithi050.stderr: -314> 2024-09-14T11:10:02.229+0000 7f6d6420d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:10:02.510 INFO:tasks.workunit.client.0.smithi050.stderr: -313> 2024-09-14T11:10:02.229+0000 7f6c497fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:02.510 INFO:tasks.workunit.client.0.smithi050.stderr: -312> 2024-09-14T11:10:02.229+0000 7f6c497fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:10:02.510 INFO:tasks.workunit.client.0.smithi050.stderr: -311> 2024-09-14T11:10:02.229+0000 7f6c497fa640 10 monclient: dump: 2024-09-14T11:10:02.510 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:02.510 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:02.510 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.510 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.511 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:02.511 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.511 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:02.511 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:02.511 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:02.511 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.511 INFO:tasks.workunit.client.0.smithi050.stderr: -310> 2024-09-14T11:10:02.229+0000 7f6c497fa640 10 monclient: _finish_auth 0 2024-09-14T11:10:02.511 INFO:tasks.workunit.client.0.smithi050.stderr: -309> 2024-09-14T11:10:02.229+0000 7f6c497fa640 10 monclient: _check_auth_tickets 2024-09-14T11:10:02.511 INFO:tasks.workunit.client.0.smithi050.stderr: -308> 2024-09-14T11:10:02.229+0000 7f6c497fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:10:02.511 INFO:tasks.workunit.client.0.smithi050.stderr: -307> 2024-09-14T11:10:02.229+0000 7f6c497fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:02.511 INFO:tasks.workunit.client.0.smithi050.stderr: -306> 2024-09-14T11:10:02.229+0000 7f6c497fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:10:02.511 INFO:tasks.workunit.client.0.smithi050.stderr: -305> 2024-09-14T11:10:02.229+0000 7f6c497fa640 10 monclient: dump: 2024-09-14T11:10:02.511 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:02.512 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:02.512 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.512 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.512 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:02.512 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.512 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:02.512 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:02.512 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:02.512 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.512 INFO:tasks.workunit.client.0.smithi050.stderr: -304> 2024-09-14T11:10:02.229+0000 7f6d67d23800 5 monclient: authenticate success, global_id 6687 2024-09-14T11:10:02.512 INFO:tasks.workunit.client.0.smithi050.stderr: -303> 2024-09-14T11:10:02.229+0000 7f6d67d23800 10 monclient: _renew_subs 2024-09-14T11:10:02.512 INFO:tasks.workunit.client.0.smithi050.stderr: -302> 2024-09-14T11:10:02.229+0000 7f6d67d23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:10:02.512 INFO:tasks.workunit.client.0.smithi050.stderr: -301> 2024-09-14T11:10:02.229+0000 7f6d64a0e640 4 set_mon_vals no callback set 2024-09-14T11:10:02.512 INFO:tasks.workunit.client.0.smithi050.stderr: -300> 2024-09-14T11:10:02.229+0000 7f6d67d23800 10 monclient: _renew_subs 2024-09-14T11:10:02.513 INFO:tasks.workunit.client.0.smithi050.stderr: -299> 2024-09-14T11:10:02.229+0000 7f6d67d23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:10:02.513 INFO:tasks.workunit.client.0.smithi050.stderr: -298> 2024-09-14T11:10:02.232+0000 7f6c497fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:10:02.513 INFO:tasks.workunit.client.0.smithi050.stderr: -297> 2024-09-14T11:10:02.232+0000 7f6c497fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:10:02.513 INFO:tasks.workunit.client.0.smithi050.stderr: -296> 2024-09-14T11:10:02.232+0000 7f6c497fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:10:02.513 INFO:tasks.workunit.client.0.smithi050.stderr: -295> 2024-09-14T11:10:02.232+0000 7f6d63a0c640 10 monclient: get_auth_request con 0x7f6c3c077140 auth_method 0 2024-09-14T11:10:02.513 INFO:tasks.workunit.client.0.smithi050.stderr: -294> 2024-09-14T11:10:02.232+0000 7f6d67d23800 10 monclient: get_monmap_and_config 2024-09-14T11:10:02.513 INFO:tasks.workunit.client.0.smithi050.stderr: -293> 2024-09-14T11:10:02.232+0000 7f6d67d23800 10 monclient: build_initial_monmap 2024-09-14T11:10:02.513 INFO:tasks.workunit.client.0.smithi050.stderr: -292> 2024-09-14T11:10:02.232+0000 7f6d67d23800 1 build_initial for_mkfs: 0 2024-09-14T11:10:02.513 INFO:tasks.workunit.client.0.smithi050.stderr: -291> 2024-09-14T11:10:02.232+0000 7f6d67d23800 10 monclient: monmap: 2024-09-14T11:10:02.513 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:10:02.513 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:10:02.513 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:10:02.514 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:10:02.514 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:10:02.514 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.514 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:10:02.514 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:10:02.514 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:10:02.514 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.514 INFO:tasks.workunit.client.0.smithi050.stderr: -290> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding auth protocol: cephx 2024-09-14T11:10:02.514 INFO:tasks.workunit.client.0.smithi050.stderr: -289> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding auth protocol: cephx 2024-09-14T11:10:02.514 INFO:tasks.workunit.client.0.smithi050.stderr: -288> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding auth protocol: cephx 2024-09-14T11:10:02.514 INFO:tasks.workunit.client.0.smithi050.stderr: -287> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding con mode: secure 2024-09-14T11:10:02.514 INFO:tasks.workunit.client.0.smithi050.stderr: -286> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding con mode: crc 2024-09-14T11:10:02.514 INFO:tasks.workunit.client.0.smithi050.stderr: -285> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding con mode: secure 2024-09-14T11:10:02.514 INFO:tasks.workunit.client.0.smithi050.stderr: -284> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding con mode: crc 2024-09-14T11:10:02.515 INFO:tasks.workunit.client.0.smithi050.stderr: -283> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding con mode: secure 2024-09-14T11:10:02.515 INFO:tasks.workunit.client.0.smithi050.stderr: -282> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding con mode: crc 2024-09-14T11:10:02.515 INFO:tasks.workunit.client.0.smithi050.stderr: -281> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding con mode: crc 2024-09-14T11:10:02.515 INFO:tasks.workunit.client.0.smithi050.stderr: -280> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding con mode: secure 2024-09-14T11:10:02.515 INFO:tasks.workunit.client.0.smithi050.stderr: -279> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding con mode: crc 2024-09-14T11:10:02.515 INFO:tasks.workunit.client.0.smithi050.stderr: -278> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding con mode: secure 2024-09-14T11:10:02.515 INFO:tasks.workunit.client.0.smithi050.stderr: -277> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding con mode: crc 2024-09-14T11:10:02.515 INFO:tasks.workunit.client.0.smithi050.stderr: -276> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding con mode: secure 2024-09-14T11:10:02.515 INFO:tasks.workunit.client.0.smithi050.stderr: -275> 2024-09-14T11:10:02.232+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.515 INFO:tasks.workunit.client.0.smithi050.stderr: -274> 2024-09-14T11:10:02.232+0000 7f6d67d23800 10 monclient: init 2024-09-14T11:10:02.515 INFO:tasks.workunit.client.0.smithi050.stderr: -273> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding auth protocol: cephx 2024-09-14T11:10:02.515 INFO:tasks.workunit.client.0.smithi050.stderr: -272> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding auth protocol: cephx 2024-09-14T11:10:02.515 INFO:tasks.workunit.client.0.smithi050.stderr: -271> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding auth protocol: cephx 2024-09-14T11:10:02.515 INFO:tasks.workunit.client.0.smithi050.stderr: -270> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding con mode: secure 2024-09-14T11:10:02.515 INFO:tasks.workunit.client.0.smithi050.stderr: -269> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding con mode: crc 2024-09-14T11:10:02.516 INFO:tasks.workunit.client.0.smithi050.stderr: -268> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding con mode: secure 2024-09-14T11:10:02.516 INFO:tasks.workunit.client.0.smithi050.stderr: -267> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding con mode: crc 2024-09-14T11:10:02.516 INFO:tasks.workunit.client.0.smithi050.stderr: -266> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding con mode: secure 2024-09-14T11:10:02.516 INFO:tasks.workunit.client.0.smithi050.stderr: -265> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding con mode: crc 2024-09-14T11:10:02.516 INFO:tasks.workunit.client.0.smithi050.stderr: -264> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding con mode: crc 2024-09-14T11:10:02.516 INFO:tasks.workunit.client.0.smithi050.stderr: -263> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding con mode: secure 2024-09-14T11:10:02.516 INFO:tasks.workunit.client.0.smithi050.stderr: -262> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding con mode: crc 2024-09-14T11:10:02.516 INFO:tasks.workunit.client.0.smithi050.stderr: -261> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding con mode: secure 2024-09-14T11:10:02.516 INFO:tasks.workunit.client.0.smithi050.stderr: -260> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding con mode: crc 2024-09-14T11:10:02.516 INFO:tasks.workunit.client.0.smithi050.stderr: -259> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding con mode: secure 2024-09-14T11:10:02.516 INFO:tasks.workunit.client.0.smithi050.stderr: -258> 2024-09-14T11:10:02.233+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.516 INFO:tasks.workunit.client.0.smithi050.stderr: -257> 2024-09-14T11:10:02.233+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.516 INFO:tasks.workunit.client.0.smithi050.stderr: -256> 2024-09-14T11:10:02.233+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command rotate-key cmddesc rotate-key hook 0x7ffe207364c8 EEXIST 2024-09-14T11:10:02.517 INFO:tasks.workunit.client.0.smithi050.stderr: -255> 2024-09-14T11:10:02.233+0000 7f6d67d23800 10 monclient: _reopen_session rank -1 2024-09-14T11:10:02.517 INFO:tasks.workunit.client.0.smithi050.stderr: -254> 2024-09-14T11:10:02.233+0000 7f6d67d23800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:10:02.517 INFO:tasks.workunit.client.0.smithi050.stderr: -253> 2024-09-14T11:10:02.233+0000 7f6d67d23800 10 monclient(hunting): picked mon.noname-c con 0x55d12ecbe6e0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:10:02.517 INFO:tasks.workunit.client.0.smithi050.stderr: -252> 2024-09-14T11:10:02.233+0000 7f6d67d23800 10 monclient(hunting): picked mon.noname-b con 0x55d12ece9150 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:10:02.517 INFO:tasks.workunit.client.0.smithi050.stderr: -251> 2024-09-14T11:10:02.233+0000 7f6d67d23800 10 monclient(hunting): picked mon.noname-a con 0x55d12ecea500 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:10:02.517 INFO:tasks.workunit.client.0.smithi050.stderr: -250> 2024-09-14T11:10:02.233+0000 7f6d67d23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:02.517 INFO:tasks.workunit.client.0.smithi050.stderr: -249> 2024-09-14T11:10:02.233+0000 7f6d67d23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:02.517 INFO:tasks.workunit.client.0.smithi050.stderr: -248> 2024-09-14T11:10:02.233+0000 7f6d67d23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:02.517 INFO:tasks.workunit.client.0.smithi050.stderr: -247> 2024-09-14T11:10:02.233+0000 7f6d67d23800 10 monclient(hunting): _renew_subs 2024-09-14T11:10:02.517 INFO:tasks.workunit.client.0.smithi050.stderr: -246> 2024-09-14T11:10:02.233+0000 7f6d67d23800 10 monclient(hunting): authenticate will time out at 2254.870425s 2024-09-14T11:10:02.517 INFO:tasks.workunit.client.0.smithi050.stderr: -245> 2024-09-14T11:10:02.233+0000 7f6d63a0c640 10 monclient(hunting): get_auth_request con 0x55d12ecbe6e0 auth_method 0 2024-09-14T11:10:02.517 INFO:tasks.workunit.client.0.smithi050.stderr: -244> 2024-09-14T11:10:02.233+0000 7f6d63a0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:02.517 INFO:tasks.workunit.client.0.smithi050.stderr: -243> 2024-09-14T11:10:02.233+0000 7f6d63a0c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:02.517 INFO:tasks.workunit.client.0.smithi050.stderr: -242> 2024-09-14T11:10:02.233+0000 7f6d63a0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:02.518 INFO:tasks.workunit.client.0.smithi050.stderr: -241> 2024-09-14T11:10:02.233+0000 7f6d6420d640 10 monclient(hunting): get_auth_request con 0x55d12ecea500 auth_method 0 2024-09-14T11:10:02.518 INFO:tasks.workunit.client.0.smithi050.stderr: -240> 2024-09-14T11:10:02.233+0000 7f6d6420d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:02.518 INFO:tasks.workunit.client.0.smithi050.stderr: -239> 2024-09-14T11:10:02.233+0000 7f6d6420d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:02.518 INFO:tasks.workunit.client.0.smithi050.stderr: -238> 2024-09-14T11:10:02.233+0000 7f6d6420d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:02.518 INFO:tasks.workunit.client.0.smithi050.stderr: -237> 2024-09-14T11:10:02.233+0000 7f6d6320b640 10 monclient(hunting): get_auth_request con 0x55d12ece9150 auth_method 0 2024-09-14T11:10:02.518 INFO:tasks.workunit.client.0.smithi050.stderr: -236> 2024-09-14T11:10:02.233+0000 7f6d6320b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:02.518 INFO:tasks.workunit.client.0.smithi050.stderr: -235> 2024-09-14T11:10:02.233+0000 7f6d6320b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:02.518 INFO:tasks.workunit.client.0.smithi050.stderr: -234> 2024-09-14T11:10:02.233+0000 7f6d6320b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:02.518 INFO:tasks.workunit.client.0.smithi050.stderr: -233> 2024-09-14T11:10:02.233+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:02.518 INFO:tasks.workunit.client.0.smithi050.stderr: -232> 2024-09-14T11:10:02.233+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:02.518 INFO:tasks.workunit.client.0.smithi050.stderr: -231> 2024-09-14T11:10:02.233+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:02.518 INFO:tasks.workunit.client.0.smithi050.stderr: -230> 2024-09-14T11:10:02.233+0000 7f6d6420d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:02.518 INFO:tasks.workunit.client.0.smithi050.stderr: -229> 2024-09-14T11:10:02.233+0000 7f6d6420d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:02.518 INFO:tasks.workunit.client.0.smithi050.stderr: -228> 2024-09-14T11:10:02.233+0000 7f6d6420d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:02.518 INFO:tasks.workunit.client.0.smithi050.stderr: -227> 2024-09-14T11:10:02.233+0000 7f6d6320b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:02.519 INFO:tasks.workunit.client.0.smithi050.stderr: -226> 2024-09-14T11:10:02.233+0000 7f6d6320b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:02.519 INFO:tasks.workunit.client.0.smithi050.stderr: -225> 2024-09-14T11:10:02.233+0000 7f6d6320b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:02.519 INFO:tasks.workunit.client.0.smithi050.stderr: -224> 2024-09-14T11:10:02.233+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_done global_id 6290 payload 274 2024-09-14T11:10:02.519 INFO:tasks.workunit.client.0.smithi050.stderr: -223> 2024-09-14T11:10:02.233+0000 7f6d63a0c640 10 monclient: _finish_hunting 0 2024-09-14T11:10:02.519 INFO:tasks.workunit.client.0.smithi050.stderr: -222> 2024-09-14T11:10:02.233+0000 7f6d63a0c640 1 monclient: found mon.noname-c 2024-09-14T11:10:02.519 INFO:tasks.workunit.client.0.smithi050.stderr: -221> 2024-09-14T11:10:02.233+0000 7f6d63a0c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:10:02.519 INFO:tasks.workunit.client.0.smithi050.stderr: -220> 2024-09-14T11:10:02.234+0000 7f6c42ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:02.519 INFO:tasks.workunit.client.0.smithi050.stderr: -219> 2024-09-14T11:10:02.234+0000 7f6c42ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:10:02.519 INFO:tasks.workunit.client.0.smithi050.stderr: -218> 2024-09-14T11:10:02.234+0000 7f6c42ffd640 10 monclient: dump: 2024-09-14T11:10:02.519 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:02.519 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:02.519 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.519 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.520 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:02.520 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.520 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:02.520 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:02.520 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:02.520 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.520 INFO:tasks.workunit.client.0.smithi050.stderr: -217> 2024-09-14T11:10:02.234+0000 7f6c42ffd640 10 monclient: _finish_auth 0 2024-09-14T11:10:02.520 INFO:tasks.workunit.client.0.smithi050.stderr: -216> 2024-09-14T11:10:02.234+0000 7f6c42ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:10:02.520 INFO:tasks.workunit.client.0.smithi050.stderr: -215> 2024-09-14T11:10:02.234+0000 7f6c42ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:10:02.520 INFO:tasks.workunit.client.0.smithi050.stderr: -214> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 monclient: authenticate success, global_id 6290 2024-09-14T11:10:02.520 INFO:tasks.workunit.client.0.smithi050.stderr: -213> 2024-09-14T11:10:02.234+0000 7f6d67d23800 10 monclient: get_monmap_and_config success 2024-09-14T11:10:02.520 INFO:tasks.workunit.client.0.smithi050.stderr: -212> 2024-09-14T11:10:02.234+0000 7f6d67d23800 4 set_mon_vals no callback set 2024-09-14T11:10:02.520 INFO:tasks.workunit.client.0.smithi050.stderr: -211> 2024-09-14T11:10:02.234+0000 7f6c42ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:02.520 INFO:tasks.workunit.client.0.smithi050.stderr: -210> 2024-09-14T11:10:02.234+0000 7f6c42ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:10:02.521 INFO:tasks.workunit.client.0.smithi050.stderr: -209> 2024-09-14T11:10:02.234+0000 7f6c42ffd640 10 monclient: dump: 2024-09-14T11:10:02.521 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:02.521 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:02.521 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.521 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.521 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:02.521 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.521 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:02.521 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:02.521 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:02.521 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.521 INFO:tasks.workunit.client.0.smithi050.stderr: -208> 2024-09-14T11:10:02.234+0000 7f6d67d23800 10 monclient: shutdown 2024-09-14T11:10:02.521 INFO:tasks.workunit.client.0.smithi050.stderr: -207> 2024-09-14T11:10:02.234+0000 7f6d67d23800 10 monclient: build_initial_monmap 2024-09-14T11:10:02.521 INFO:tasks.workunit.client.0.smithi050.stderr: -206> 2024-09-14T11:10:02.234+0000 7f6d67d23800 1 build_initial for_mkfs: 0 2024-09-14T11:10:02.522 INFO:tasks.workunit.client.0.smithi050.stderr: -205> 2024-09-14T11:10:02.234+0000 7f6d67d23800 10 monclient: monmap: 2024-09-14T11:10:02.522 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:10:02.522 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:10:02.522 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:10:02.522 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:10:02.522 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:10:02.522 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.522 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:10:02.522 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:10:02.522 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:10:02.522 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.522 INFO:tasks.workunit.client.0.smithi050.stderr: -204> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding auth protocol: cephx 2024-09-14T11:10:02.522 INFO:tasks.workunit.client.0.smithi050.stderr: -203> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding auth protocol: cephx 2024-09-14T11:10:02.523 INFO:tasks.workunit.client.0.smithi050.stderr: -202> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding auth protocol: cephx 2024-09-14T11:10:02.523 INFO:tasks.workunit.client.0.smithi050.stderr: -201> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding con mode: secure 2024-09-14T11:10:02.523 INFO:tasks.workunit.client.0.smithi050.stderr: -200> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding con mode: crc 2024-09-14T11:10:02.523 INFO:tasks.workunit.client.0.smithi050.stderr: -199> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding con mode: secure 2024-09-14T11:10:02.523 INFO:tasks.workunit.client.0.smithi050.stderr: -198> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding con mode: crc 2024-09-14T11:10:02.523 INFO:tasks.workunit.client.0.smithi050.stderr: -197> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding con mode: secure 2024-09-14T11:10:02.523 INFO:tasks.workunit.client.0.smithi050.stderr: -196> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding con mode: crc 2024-09-14T11:10:02.523 INFO:tasks.workunit.client.0.smithi050.stderr: -195> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding con mode: crc 2024-09-14T11:10:02.523 INFO:tasks.workunit.client.0.smithi050.stderr: -194> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding con mode: secure 2024-09-14T11:10:02.523 INFO:tasks.workunit.client.0.smithi050.stderr: -193> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding con mode: crc 2024-09-14T11:10:02.523 INFO:tasks.workunit.client.0.smithi050.stderr: -192> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding con mode: secure 2024-09-14T11:10:02.523 INFO:tasks.workunit.client.0.smithi050.stderr: -191> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding con mode: crc 2024-09-14T11:10:02.523 INFO:tasks.workunit.client.0.smithi050.stderr: -190> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding con mode: secure 2024-09-14T11:10:02.523 INFO:tasks.workunit.client.0.smithi050.stderr: -189> 2024-09-14T11:10:02.235+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.524 INFO:tasks.workunit.client.0.smithi050.stderr: -188> 2024-09-14T11:10:02.235+0000 7f6d67d23800 1 librados: starting msgr at 2024-09-14T11:10:02.524 INFO:tasks.workunit.client.0.smithi050.stderr: -187> 2024-09-14T11:10:02.235+0000 7f6d67d23800 1 librados: starting objecter 2024-09-14T11:10:02.524 INFO:tasks.workunit.client.0.smithi050.stderr: -186> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command objecter_requests cmddesc objecter_requests hook 0x55d12ece8f80 EEXIST 2024-09-14T11:10:02.524 INFO:tasks.workunit.client.0.smithi050.stderr: -185> 2024-09-14T11:10:02.235+0000 7f6d67d23800 1 librados: setting wanted keys 2024-09-14T11:10:02.524 INFO:tasks.workunit.client.0.smithi050.stderr: -184> 2024-09-14T11:10:02.235+0000 7f6d67d23800 1 librados: calling monclient init 2024-09-14T11:10:02.524 INFO:tasks.workunit.client.0.smithi050.stderr: -183> 2024-09-14T11:10:02.235+0000 7f6d67d23800 10 monclient: init 2024-09-14T11:10:02.524 INFO:tasks.workunit.client.0.smithi050.stderr: -182> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding auth protocol: cephx 2024-09-14T11:10:02.524 INFO:tasks.workunit.client.0.smithi050.stderr: -181> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding auth protocol: cephx 2024-09-14T11:10:02.524 INFO:tasks.workunit.client.0.smithi050.stderr: -180> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding auth protocol: cephx 2024-09-14T11:10:02.524 INFO:tasks.workunit.client.0.smithi050.stderr: -179> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding con mode: secure 2024-09-14T11:10:02.524 INFO:tasks.workunit.client.0.smithi050.stderr: -178> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding con mode: crc 2024-09-14T11:10:02.524 INFO:tasks.workunit.client.0.smithi050.stderr: -177> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding con mode: secure 2024-09-14T11:10:02.524 INFO:tasks.workunit.client.0.smithi050.stderr: -176> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding con mode: crc 2024-09-14T11:10:02.524 INFO:tasks.workunit.client.0.smithi050.stderr: -175> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding con mode: secure 2024-09-14T11:10:02.525 INFO:tasks.workunit.client.0.smithi050.stderr: -174> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding con mode: crc 2024-09-14T11:10:02.525 INFO:tasks.workunit.client.0.smithi050.stderr: -173> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding con mode: crc 2024-09-14T11:10:02.525 INFO:tasks.workunit.client.0.smithi050.stderr: -172> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding con mode: secure 2024-09-14T11:10:02.525 INFO:tasks.workunit.client.0.smithi050.stderr: -171> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding con mode: crc 2024-09-14T11:10:02.525 INFO:tasks.workunit.client.0.smithi050.stderr: -170> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding con mode: secure 2024-09-14T11:10:02.525 INFO:tasks.workunit.client.0.smithi050.stderr: -169> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding con mode: crc 2024-09-14T11:10:02.525 INFO:tasks.workunit.client.0.smithi050.stderr: -168> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding con mode: secure 2024-09-14T11:10:02.525 INFO:tasks.workunit.client.0.smithi050.stderr: -167> 2024-09-14T11:10:02.235+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.525 INFO:tasks.workunit.client.0.smithi050.stderr: -166> 2024-09-14T11:10:02.235+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.525 INFO:tasks.workunit.client.0.smithi050.stderr: -165> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command rotate-key cmddesc rotate-key hook 0x55d12ecaf0e8 EEXIST 2024-09-14T11:10:02.525 INFO:tasks.workunit.client.0.smithi050.stderr: -164> 2024-09-14T11:10:02.235+0000 7f6d67d23800 10 monclient: _reopen_session rank -1 2024-09-14T11:10:02.525 INFO:tasks.workunit.client.0.smithi050.stderr: -163> 2024-09-14T11:10:02.235+0000 7f6d67d23800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:10:02.525 INFO:tasks.workunit.client.0.smithi050.stderr: -162> 2024-09-14T11:10:02.235+0000 7f6d67d23800 10 monclient(hunting): picked mon.noname-b con 0x55d12ecbe6e0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:10:02.525 INFO:tasks.workunit.client.0.smithi050.stderr: -161> 2024-09-14T11:10:02.235+0000 7f6d67d23800 10 monclient(hunting): picked mon.noname-c con 0x55d12ecea500 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:10:02.526 INFO:tasks.workunit.client.0.smithi050.stderr: -160> 2024-09-14T11:10:02.235+0000 7f6d67d23800 10 monclient(hunting): picked mon.noname-a con 0x55d12ece7250 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:10:02.526 INFO:tasks.workunit.client.0.smithi050.stderr: -159> 2024-09-14T11:10:02.235+0000 7f6d67d23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:02.526 INFO:tasks.workunit.client.0.smithi050.stderr: -158> 2024-09-14T11:10:02.235+0000 7f6d67d23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:02.526 INFO:tasks.workunit.client.0.smithi050.stderr: -157> 2024-09-14T11:10:02.235+0000 7f6d67d23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:02.526 INFO:tasks.workunit.client.0.smithi050.stderr: -156> 2024-09-14T11:10:02.235+0000 7f6d67d23800 10 monclient(hunting): _renew_subs 2024-09-14T11:10:02.526 INFO:tasks.workunit.client.0.smithi050.stderr: -155> 2024-09-14T11:10:02.235+0000 7f6d67d23800 10 monclient(hunting): authenticate will time out at 2254.872847s 2024-09-14T11:10:02.526 INFO:tasks.workunit.client.0.smithi050.stderr: -154> 2024-09-14T11:10:02.235+0000 7f6d6320b640 10 monclient(hunting): get_auth_request con 0x55d12ecea500 auth_method 0 2024-09-14T11:10:02.526 INFO:tasks.workunit.client.0.smithi050.stderr: -153> 2024-09-14T11:10:02.235+0000 7f6d6320b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:02.526 INFO:tasks.workunit.client.0.smithi050.stderr: -152> 2024-09-14T11:10:02.235+0000 7f6d6320b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:02.526 INFO:tasks.workunit.client.0.smithi050.stderr: -151> 2024-09-14T11:10:02.235+0000 7f6d6320b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:02.526 INFO:tasks.workunit.client.0.smithi050.stderr: -150> 2024-09-14T11:10:02.235+0000 7f6d6420d640 10 monclient(hunting): get_auth_request con 0x55d12ece7250 auth_method 0 2024-09-14T11:10:02.526 INFO:tasks.workunit.client.0.smithi050.stderr: -149> 2024-09-14T11:10:02.235+0000 7f6d6420d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:02.527 INFO:tasks.workunit.client.0.smithi050.stderr: -148> 2024-09-14T11:10:02.235+0000 7f6d6420d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:02.527 INFO:tasks.workunit.client.0.smithi050.stderr: -147> 2024-09-14T11:10:02.235+0000 7f6d6420d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:02.527 INFO:tasks.workunit.client.0.smithi050.stderr: -146> 2024-09-14T11:10:02.235+0000 7f6d63a0c640 10 monclient(hunting): get_auth_request con 0x55d12ecbe6e0 auth_method 0 2024-09-14T11:10:02.527 INFO:tasks.workunit.client.0.smithi050.stderr: -145> 2024-09-14T11:10:02.235+0000 7f6d63a0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:02.527 INFO:tasks.workunit.client.0.smithi050.stderr: -144> 2024-09-14T11:10:02.235+0000 7f6d63a0c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:02.527 INFO:tasks.workunit.client.0.smithi050.stderr: -143> 2024-09-14T11:10:02.235+0000 7f6d63a0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:02.527 INFO:tasks.workunit.client.0.smithi050.stderr: -142> 2024-09-14T11:10:02.236+0000 7f6d6320b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:02.527 INFO:tasks.workunit.client.0.smithi050.stderr: -141> 2024-09-14T11:10:02.236+0000 7f6d6320b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:02.527 INFO:tasks.workunit.client.0.smithi050.stderr: -140> 2024-09-14T11:10:02.236+0000 7f6d6320b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:02.527 INFO:tasks.workunit.client.0.smithi050.stderr: -139> 2024-09-14T11:10:02.236+0000 7f6d6420d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:02.527 INFO:tasks.workunit.client.0.smithi050.stderr: -138> 2024-09-14T11:10:02.236+0000 7f6d6420d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:02.527 INFO:tasks.workunit.client.0.smithi050.stderr: -137> 2024-09-14T11:10:02.236+0000 7f6d6420d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:02.527 INFO:tasks.workunit.client.0.smithi050.stderr: -136> 2024-09-14T11:10:02.236+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:02.528 INFO:tasks.workunit.client.0.smithi050.stderr: -135> 2024-09-14T11:10:02.236+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:02.528 INFO:tasks.workunit.client.0.smithi050.stderr: -134> 2024-09-14T11:10:02.236+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:02.528 INFO:tasks.workunit.client.0.smithi050.stderr: -133> 2024-09-14T11:10:02.236+0000 7f6d6420d640 10 monclient(hunting): handle_auth_done global_id 6693 payload 824 2024-09-14T11:10:02.528 INFO:tasks.workunit.client.0.smithi050.stderr: -132> 2024-09-14T11:10:02.236+0000 7f6d6420d640 10 monclient: _finish_hunting 0 2024-09-14T11:10:02.528 INFO:tasks.workunit.client.0.smithi050.stderr: -131> 2024-09-14T11:10:02.236+0000 7f6d6420d640 1 monclient: found mon.noname-a 2024-09-14T11:10:02.528 INFO:tasks.workunit.client.0.smithi050.stderr: -130> 2024-09-14T11:10:02.236+0000 7f6d6420d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:10:02.528 INFO:tasks.workunit.client.0.smithi050.stderr: -129> 2024-09-14T11:10:02.236+0000 7f6c417fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:02.528 INFO:tasks.workunit.client.0.smithi050.stderr: -128> 2024-09-14T11:10:02.236+0000 7f6c417fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:10:02.528 INFO:tasks.workunit.client.0.smithi050.stderr: -127> 2024-09-14T11:10:02.236+0000 7f6c417fa640 10 monclient: dump: 2024-09-14T11:10:02.528 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:02.528 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:02.528 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.528 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.528 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:02.529 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.529 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:02.529 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:02.529 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:02.529 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.529 INFO:tasks.workunit.client.0.smithi050.stderr: -126> 2024-09-14T11:10:02.236+0000 7f6c417fa640 10 monclient: _finish_auth 0 2024-09-14T11:10:02.529 INFO:tasks.workunit.client.0.smithi050.stderr: -125> 2024-09-14T11:10:02.236+0000 7f6c417fa640 10 monclient: _check_auth_tickets 2024-09-14T11:10:02.529 INFO:tasks.workunit.client.0.smithi050.stderr: -124> 2024-09-14T11:10:02.236+0000 7f6c417fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:10:02.529 INFO:tasks.workunit.client.0.smithi050.stderr: -123> 2024-09-14T11:10:02.236+0000 7f6c417fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:02.529 INFO:tasks.workunit.client.0.smithi050.stderr: -122> 2024-09-14T11:10:02.236+0000 7f6c417fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:10:02.529 INFO:tasks.workunit.client.0.smithi050.stderr: -121> 2024-09-14T11:10:02.236+0000 7f6c417fa640 10 monclient: dump: 2024-09-14T11:10:02.529 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:02.529 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:02.529 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.529 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.530 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:02.530 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.530 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:02.530 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:02.530 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:02.530 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.530 INFO:tasks.workunit.client.0.smithi050.stderr: -120> 2024-09-14T11:10:02.236+0000 7f6d67d23800 5 monclient: authenticate success, global_id 6693 2024-09-14T11:10:02.530 INFO:tasks.workunit.client.0.smithi050.stderr: -119> 2024-09-14T11:10:02.236+0000 7f6c42ffd640 4 set_mon_vals no callback set 2024-09-14T11:10:02.530 INFO:tasks.workunit.client.0.smithi050.stderr: -118> 2024-09-14T11:10:02.236+0000 7f6d67d23800 10 monclient: _renew_subs 2024-09-14T11:10:02.530 INFO:tasks.workunit.client.0.smithi050.stderr: -117> 2024-09-14T11:10:02.236+0000 7f6d67d23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:10:02.530 INFO:tasks.workunit.client.0.smithi050.stderr: -116> 2024-09-14T11:10:02.236+0000 7f6d67d23800 10 monclient: _renew_subs 2024-09-14T11:10:02.530 INFO:tasks.workunit.client.0.smithi050.stderr: -115> 2024-09-14T11:10:02.236+0000 7f6d67d23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:10:02.530 INFO:tasks.workunit.client.0.smithi050.stderr: -114> 2024-09-14T11:10:02.236+0000 7f6d67d23800 1 librados: init done 2024-09-14T11:10:02.530 INFO:tasks.workunit.client.0.smithi050.stderr: -113> 2024-09-14T11:10:02.236+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command cr dump hook 0x55d12ece0e88 2024-09-14T11:10:02.530 INFO:tasks.workunit.client.0.smithi050.stderr: -112> 2024-09-14T11:10:02.238+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.531 INFO:tasks.workunit.client.0.smithi050.stderr: -111> 2024-09-14T11:10:02.238+0000 7f6c417fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:10:02.531 INFO:tasks.workunit.client.0.smithi050.stderr: -110> 2024-09-14T11:10:02.238+0000 7f6c417fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:10:02.531 INFO:tasks.workunit.client.0.smithi050.stderr: -109> 2024-09-14T11:10:02.238+0000 7f6c417fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:10:02.531 INFO:tasks.workunit.client.0.smithi050.stderr: -108> 2024-09-14T11:10:02.238+0000 7f6d63a0c640 10 monclient: get_auth_request con 0x7f6c2c077230 auth_method 0 2024-09-14T11:10:02.531 INFO:tasks.workunit.client.0.smithi050.stderr: -107> 2024-09-14T11:10:02.238+0000 7f6d6320b640 10 monclient: get_auth_request con 0x55d12ed0a050 auth_method 0 2024-09-14T11:10:02.531 INFO:tasks.workunit.client.0.smithi050.stderr: -106> 2024-09-14T11:10:02.239+0000 7f6d67d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.531 INFO:tasks.workunit.client.0.smithi050.stderr: -105> 2024-09-14T11:10:02.239+0000 7f6d67d23800 20 realm 2024-09-14T11:10:02.531 INFO:tasks.workunit.client.0.smithi050.stderr: -104> 2024-09-14T11:10:02.239+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.531 INFO:tasks.workunit.client.0.smithi050.stderr: -103> 2024-09-14T11:10:02.239+0000 7f6d67d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.531 INFO:tasks.workunit.client.0.smithi050.stderr: -102> 2024-09-14T11:10:02.239+0000 7f6d67d23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:02.531 INFO:tasks.workunit.client.0.smithi050.stderr: -101> 2024-09-14T11:10:02.239+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.531 INFO:tasks.workunit.client.0.smithi050.stderr: -100> 2024-09-14T11:10:02.239+0000 7f6d67d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.531 INFO:tasks.workunit.client.0.smithi050.stderr: -99> 2024-09-14T11:10:02.239+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.532 INFO:tasks.workunit.client.0.smithi050.stderr: -98> 2024-09-14T11:10:02.239+0000 7f6d63a0c640 10 monclient: get_auth_request con 0x55d12ed0e2b0 auth_method 0 2024-09-14T11:10:02.532 INFO:tasks.workunit.client.0.smithi050.stderr: -97> 2024-09-14T11:10:02.240+0000 7f6d67d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:02.532 INFO:tasks.workunit.client.0.smithi050.stderr: -96> 2024-09-14T11:10:02.240+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.532 INFO:tasks.workunit.client.0.smithi050.stderr: -95> 2024-09-14T11:10:02.240+0000 7f6d6320b640 10 monclient: get_auth_request con 0x55d12ed11b10 auth_method 0 2024-09-14T11:10:02.532 INFO:tasks.workunit.client.0.smithi050.stderr: -94> 2024-09-14T11:10:02.241+0000 7f6d67d23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:02.532 INFO:tasks.workunit.client.0.smithi050.stderr: -93> 2024-09-14T11:10:02.241+0000 7f6d67d23800 20 searching for the correct realm 2024-09-14T11:10:02.532 INFO:tasks.workunit.client.0.smithi050.stderr: -92> 2024-09-14T11:10:02.241+0000 7f6d6420d640 10 monclient: get_auth_request con 0x55d12ed16850 auth_method 0 2024-09-14T11:10:02.532 INFO:tasks.workunit.client.0.smithi050.stderr: -91> 2024-09-14T11:10:02.242+0000 7f6d63a0c640 10 monclient: get_auth_request con 0x7f6d5c0ca0c0 auth_method 0 2024-09-14T11:10:02.532 INFO:tasks.workunit.client.0.smithi050.stderr: -90> 2024-09-14T11:10:02.243+0000 7f6d6320b640 0 -- 172.21.15.50:0/2702551086 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f6d5c0c0610 msgr2=0x7f6d5c0b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:02.532 INFO:tasks.workunit.client.0.smithi050.stderr: -89> 2024-09-14T11:10:02.444+0000 7f6d6320b640 10 monclient: get_auth_request con 0x7f6d5c0c0610 auth_method 0 2024-09-14T11:10:02.532 INFO:tasks.workunit.client.0.smithi050.stderr: -88> 2024-09-14T11:10:02.446+0000 7f6d6420d640 10 monclient: get_auth_request con 0x7f6d54059040 auth_method 0 2024-09-14T11:10:02.532 INFO:tasks.workunit.client.0.smithi050.stderr: -87> 2024-09-14T11:10:02.447+0000 7f6d63a0c640 10 monclient: get_auth_request con 0x7f6d5c0b69d0 auth_method 0 2024-09-14T11:10:02.532 INFO:tasks.workunit.client.0.smithi050.stderr: -86> 2024-09-14T11:10:02.448+0000 7f6d63a0c640 0 -- 172.21.15.50:0/2702551086 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f6d5c0b69d0 msgr2=0x7f6d5c003090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:02.533 INFO:tasks.workunit.client.0.smithi050.stderr: -85> 2024-09-14T11:10:02.448+0000 7f6c417fa640 1 client.6693.objecter ms_handle_reset 0x7f6d5c0b69d0 session 0x7f6d5c0b8240 osd.3 2024-09-14T11:10:02.533 INFO:tasks.workunit.client.0.smithi050.stderr: -84> 2024-09-14T11:10:02.448+0000 7f6c417fa640 10 monclient: _renew_subs 2024-09-14T11:10:02.533 INFO:tasks.workunit.client.0.smithi050.stderr: -83> 2024-09-14T11:10:02.448+0000 7f6c417fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:10:02.533 INFO:tasks.workunit.client.0.smithi050.stderr: -82> 2024-09-14T11:10:02.448+0000 7f6d63a0c640 10 monclient: get_auth_request con 0x7f6c2c0874e0 auth_method 0 2024-09-14T11:10:02.533 INFO:tasks.workunit.client.0.smithi050.stderr: -81> 2024-09-14T11:10:02.453+0000 7f6d67d23800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:10:02.533 INFO:tasks.workunit.client.0.smithi050.stderr: -80> 2024-09-14T11:10:02.453+0000 7f6d67d23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:02.533 INFO:tasks.workunit.client.0.smithi050.stderr: -79> 2024-09-14T11:10:02.453+0000 7f6d67d23800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:10:02.533 INFO:tasks.workunit.client.0.smithi050.stderr: -78> 2024-09-14T11:10:02.453+0000 7f6d67d23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:02.533 INFO:tasks.workunit.client.0.smithi050.stderr: -77> 2024-09-14T11:10:02.453+0000 7f6d67d23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:02.533 INFO:tasks.workunit.client.0.smithi050.stderr: -76> 2024-09-14T11:10:02.453+0000 7f6d67d23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:02.533 INFO:tasks.workunit.client.0.smithi050.stderr: -75> 2024-09-14T11:10:02.453+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.533 INFO:tasks.workunit.client.0.smithi050.stderr: -74> 2024-09-14T11:10:02.453+0000 7f6d67d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.533 INFO:tasks.workunit.client.0.smithi050.stderr: -73> 2024-09-14T11:10:02.453+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.533 INFO:tasks.workunit.client.0.smithi050.stderr: -72> 2024-09-14T11:10:02.454+0000 7f6d67d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:02.534 INFO:tasks.workunit.client.0.smithi050.stderr: -71> 2024-09-14T11:10:02.454+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.534 INFO:tasks.workunit.client.0.smithi050.stderr: -70> 2024-09-14T11:10:02.454+0000 7f6d67d23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:02.534 INFO:tasks.workunit.client.0.smithi050.stderr: -69> 2024-09-14T11:10:02.454+0000 7f6d67d23800 20 zone default found 2024-09-14T11:10:02.534 INFO:tasks.workunit.client.0.smithi050.stderr: -68> 2024-09-14T11:10:02.454+0000 7f6d67d23800 4 Realm: () 2024-09-14T11:10:02.534 INFO:tasks.workunit.client.0.smithi050.stderr: -67> 2024-09-14T11:10:02.454+0000 7f6d67d23800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:10:02.534 INFO:tasks.workunit.client.0.smithi050.stderr: -66> 2024-09-14T11:10:02.454+0000 7f6d67d23800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:10:02.534 INFO:tasks.workunit.client.0.smithi050.stderr: -65> 2024-09-14T11:10:02.454+0000 7f6d67d23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:02.534 INFO:tasks.workunit.client.0.smithi050.stderr: -64> 2024-09-14T11:10:02.454+0000 7f6d67d23800 20 zonegroup default 2024-09-14T11:10:02.534 INFO:tasks.workunit.client.0.smithi050.stderr: -63> 2024-09-14T11:10:02.454+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.534 INFO:tasks.workunit.client.0.smithi050.stderr: -62> 2024-09-14T11:10:02.454+0000 7f6d67d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.534 INFO:tasks.workunit.client.0.smithi050.stderr: -61> 2024-09-14T11:10:02.454+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.534 INFO:tasks.workunit.client.0.smithi050.stderr: -60> 2024-09-14T11:10:02.454+0000 7f6d67d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.534 INFO:tasks.workunit.client.0.smithi050.stderr: -59> 2024-09-14T11:10:02.455+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.534 INFO:tasks.workunit.client.0.smithi050.stderr: -58> 2024-09-14T11:10:02.455+0000 7f6d67d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.535 INFO:tasks.workunit.client.0.smithi050.stderr: -57> 2024-09-14T11:10:02.455+0000 7f6d67d23800 20 started sync module instance, tier type = 2024-09-14T11:10:02.535 INFO:tasks.workunit.client.0.smithi050.stderr: -56> 2024-09-14T11:10:02.455+0000 7f6d67d23800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:10:02.535 INFO:tasks.workunit.client.0.smithi050.stderr: -55> 2024-09-14T11:10:02.463+0000 7f6d67d23800 20 add_watcher() i=0 2024-09-14T11:10:02.535 INFO:tasks.workunit.client.0.smithi050.stderr: -54> 2024-09-14T11:10:02.463+0000 7f6d67d23800 20 add_watcher() i=1 2024-09-14T11:10:02.535 INFO:tasks.workunit.client.0.smithi050.stderr: -53> 2024-09-14T11:10:02.463+0000 7f6d67d23800 20 add_watcher() i=2 2024-09-14T11:10:02.535 INFO:tasks.workunit.client.0.smithi050.stderr: -52> 2024-09-14T11:10:02.463+0000 7f6d67d23800 20 add_watcher() i=3 2024-09-14T11:10:02.535 INFO:tasks.workunit.client.0.smithi050.stderr: -51> 2024-09-14T11:10:02.463+0000 7f6d67d23800 20 add_watcher() i=4 2024-09-14T11:10:02.535 INFO:tasks.workunit.client.0.smithi050.stderr: -50> 2024-09-14T11:10:02.463+0000 7f6d67d23800 20 add_watcher() i=5 2024-09-14T11:10:02.535 INFO:tasks.workunit.client.0.smithi050.stderr: -49> 2024-09-14T11:10:02.463+0000 7f6d67d23800 20 add_watcher() i=6 2024-09-14T11:10:02.535 INFO:tasks.workunit.client.0.smithi050.stderr: -48> 2024-09-14T11:10:02.464+0000 7f6d67d23800 20 add_watcher() i=7 2024-09-14T11:10:02.535 INFO:tasks.workunit.client.0.smithi050.stderr: -47> 2024-09-14T11:10:02.464+0000 7f6d67d23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:02.535 INFO:tasks.workunit.client.0.smithi050.stderr: -46> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding auth protocol: cephx 2024-09-14T11:10:02.535 INFO:tasks.workunit.client.0.smithi050.stderr: -45> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding auth protocol: cephx 2024-09-14T11:10:02.535 INFO:tasks.workunit.client.0.smithi050.stderr: -44> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding auth protocol: cephx 2024-09-14T11:10:02.536 INFO:tasks.workunit.client.0.smithi050.stderr: -43> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding con mode: secure 2024-09-14T11:10:02.536 INFO:tasks.workunit.client.0.smithi050.stderr: -42> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding con mode: crc 2024-09-14T11:10:02.536 INFO:tasks.workunit.client.0.smithi050.stderr: -41> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding con mode: secure 2024-09-14T11:10:02.536 INFO:tasks.workunit.client.0.smithi050.stderr: -40> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding con mode: crc 2024-09-14T11:10:02.536 INFO:tasks.workunit.client.0.smithi050.stderr: -39> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding con mode: secure 2024-09-14T11:10:02.536 INFO:tasks.workunit.client.0.smithi050.stderr: -38> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding con mode: crc 2024-09-14T11:10:02.536 INFO:tasks.workunit.client.0.smithi050.stderr: -37> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding con mode: crc 2024-09-14T11:10:02.536 INFO:tasks.workunit.client.0.smithi050.stderr: -36> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding con mode: secure 2024-09-14T11:10:02.536 INFO:tasks.workunit.client.0.smithi050.stderr: -35> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding con mode: crc 2024-09-14T11:10:02.536 INFO:tasks.workunit.client.0.smithi050.stderr: -34> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding con mode: secure 2024-09-14T11:10:02.536 INFO:tasks.workunit.client.0.smithi050.stderr: -33> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding con mode: crc 2024-09-14T11:10:02.536 INFO:tasks.workunit.client.0.smithi050.stderr: -32> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding con mode: secure 2024-09-14T11:10:02.536 INFO:tasks.workunit.client.0.smithi050.stderr: -31> 2024-09-14T11:10:02.466+0000 7f6c19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:02.536 INFO:tasks.workunit.client.0.smithi050.stderr: -30> 2024-09-14T11:10:02.466+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.537 INFO:tasks.workunit.client.0.smithi050.stderr: -29> 2024-09-14T11:10:02.466+0000 7f6d67d23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:02.537 INFO:tasks.workunit.client.0.smithi050.stderr: -28> 2024-09-14T11:10:02.466+0000 7f6d67d23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:02.537 INFO:tasks.workunit.client.0.smithi050.stderr: -27> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command cache list hook 0x55d12ece6bd0 2024-09-14T11:10:02.537 INFO:tasks.workunit.client.0.smithi050.stderr: -26> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command cache inspect hook 0x55d12ece6bd0 2024-09-14T11:10:02.537 INFO:tasks.workunit.client.0.smithi050.stderr: -25> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command cache erase hook 0x55d12ece6bd0 2024-09-14T11:10:02.537 INFO:tasks.workunit.client.0.smithi050.stderr: -24> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command cache zap hook 0x55d12ece6bd0 2024-09-14T11:10:02.537 INFO:tasks.workunit.client.0.smithi050.stderr: -23> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 note: GC not initialized 2024-09-14T11:10:02.537 INFO:tasks.workunit.client.0.smithi050.stderr: -22> 2024-09-14T11:10:02.466+0000 7f6c18fe1640 20 reqs_thread_entry: start 2024-09-14T11:10:02.537 INFO:tasks.workunit.client.0.smithi050.stderr: -21> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command sync trace show hook 0x7f6d5400e070 2024-09-14T11:10:02.537 INFO:tasks.workunit.client.0.smithi050.stderr: -20> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command sync trace history hook 0x7f6d5400e070 2024-09-14T11:10:02.537 INFO:tasks.workunit.client.0.smithi050.stderr: -19> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command sync trace active hook 0x7f6d5400e070 2024-09-14T11:10:02.537 INFO:tasks.workunit.client.0.smithi050.stderr: -18> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command sync trace active_short hook 0x7f6d5400e070 2024-09-14T11:10:02.537 INFO:tasks.workunit.client.0.smithi050.stderr: -17> 2024-09-14T11:10:02.466+0000 7f6d67d23800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:02.538 INFO:tasks.workunit.client.0.smithi050.stderr: -16> 2024-09-14T11:10:02.467+0000 7f6d67d23800 20 Filter name: none 2024-09-14T11:10:02.538 INFO:tasks.workunit.client.0.smithi050.stderr: -15> 2024-09-14T11:10:02.467+0000 7f6b927fc640 20 reqs_thread_entry: start 2024-09-14T11:10:02.538 INFO:tasks.workunit.client.0.smithi050.stderr: -14> 2024-09-14T11:10:02.467+0000 7f6d67d23800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:10:02.538 INFO:tasks.workunit.client.0.smithi050.stderr: -13> 2024-09-14T11:10:02.467+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.538 INFO:tasks.workunit.client.0.smithi050.stderr: -12> 2024-09-14T11:10:02.467+0000 7f6d67d23800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:10:02.538 INFO:tasks.workunit.client.0.smithi050.stderr: -11> 2024-09-14T11:10:02.467+0000 7f6d67d23800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:10:02.538 INFO:tasks.workunit.client.0.smithi050.stderr: -10> 2024-09-14T11:10:02.467+0000 7f6d67d23800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:10:02.538 INFO:tasks.workunit.client.0.smithi050.stderr: -9> 2024-09-14T11:10:02.467+0000 7f6d67d23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 : miss 2024-09-14T11:10:02.538 INFO:tasks.workunit.client.0.smithi050.stderr: -8> 2024-09-14T11:10:02.467+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.538 INFO:tasks.workunit.client.0.smithi050.stderr: -7> 2024-09-14T11:10:02.467+0000 7f6d67d23800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:10:02.538 INFO:tasks.workunit.client.0.smithi050.stderr: -6> 2024-09-14T11:10:02.467+0000 7f6d67d23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 info.flags=0x17 2024-09-14T11:10:02.538 INFO:tasks.workunit.client.0.smithi050.stderr: -5> 2024-09-14T11:10:02.467+0000 7f6d67d23800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 to cache LRU end 2024-09-14T11:10:02.538 INFO:tasks.workunit.client.0.smithi050.stderr: -4> 2024-09-14T11:10:02.467+0000 7f6d67d23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:10:02.539 INFO:tasks.workunit.client.0.smithi050.stderr: -3> 2024-09-14T11:10:02.467+0000 7f6d67d23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:02.539 INFO:tasks.workunit.client.0.smithi050.stderr: -2> 2024-09-14T11:10:02.467+0000 7f6d67d23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 2024-09-14T11:10:02.539 INFO:tasks.workunit.client.0.smithi050.stderr: -1> 2024-09-14T11:10:02.472+0000 7f6d67d23800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6d67d23800 time 2024-09-14T11:10:02.472021+0000 2024-09-14T11:10:02.539 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:10:02.539 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.539 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:10:02.539 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6d6938c76a] 2024-09-14T11:10:02.539 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6d6938c928] 2024-09-14T11:10:02.539 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d12cefe0b1] 2024-09-14T11:10:02.539 INFO:tasks.workunit.client.0.smithi050.stderr: 4: radosgw-admin(+0xd88418) [0x55d12d411418] 2024-09-14T11:10:02.539 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d12cf0defd] 2024-09-14T11:10:02.539 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:10:02.539 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6d68029590] 2024-09-14T11:10:02.540 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:10:02.540 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:10:02.540 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.540 INFO:tasks.workunit.client.0.smithi050.stderr: 0> 2024-09-14T11:10:02.473+0000 7f6d67d23800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:10:02.540 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f6d67d23800 thread_name:radosgw-admin 2024-09-14T11:10:02.540 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.540 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:10:02.540 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6d6803e6f0] 2024-09-14T11:10:02.540 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6d6808b99c] 2024-09-14T11:10:02.540 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:10:02.540 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:10:02.540 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6d6938c7c4] 2024-09-14T11:10:02.540 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6d6938c928] 2024-09-14T11:10:02.540 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d12cefe0b1] 2024-09-14T11:10:02.541 INFO:tasks.workunit.client.0.smithi050.stderr: 8: radosgw-admin(+0xd88418) [0x55d12d411418] 2024-09-14T11:10:02.541 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d12cf0defd] 2024-09-14T11:10:02.541 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:10:02.541 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6d68029590] 2024-09-14T11:10:02.541 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:10:02.541 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:10:02.541 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:10:02.541 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.541 INFO:tasks.workunit.client.0.smithi050.stderr:--- logging levels --- 2024-09-14T11:10:02.541 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 none 2024-09-14T11:10:02.541 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 lockdep 2024-09-14T11:10:02.541 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 context 2024-09-14T11:10:02.541 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 crush 2024-09-14T11:10:02.542 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds 2024-09-14T11:10:02.542 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_balancer 2024-09-14T11:10:02.542 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_locker 2024-09-14T11:10:02.542 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log 2024-09-14T11:10:02.542 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log_expire 2024-09-14T11:10:02.542 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_migrator 2024-09-14T11:10:02.542 INFO:tasks.workunit.client.0.smithi050.stderr: 3/ 5 mds_quiesce 2024-09-14T11:10:02.542 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 buffer 2024-09-14T11:10:02.542 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 timer 2024-09-14T11:10:02.542 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 filer 2024-09-14T11:10:02.542 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 striper 2024-09-14T11:10:02.542 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 objecter 2024-09-14T11:10:02.542 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rados 2024-09-14T11:10:02.543 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd 2024-09-14T11:10:02.543 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_mirror 2024-09-14T11:10:02.543 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_replay 2024-09-14T11:10:02.543 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_pwl 2024-09-14T11:10:02.543 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 journaler 2024-09-14T11:10:02.543 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objectcacher 2024-09-14T11:10:02.543 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:10:02.543 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 client 2024-09-14T11:10:02.543 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 osd 2024-09-14T11:10:02.543 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 optracker 2024-09-14T11:10:02.543 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objclass 2024-09-14T11:10:02.543 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 filestore 2024-09-14T11:10:02.543 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 journal 2024-09-14T11:10:02.543 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 ms 2024-09-14T11:10:02.544 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mon 2024-09-14T11:10:02.544 INFO:tasks.workunit.client.0.smithi050.stderr: 0/10 monc 2024-09-14T11:10:02.544 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 paxos 2024-09-14T11:10:02.544 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 tp 2024-09-14T11:10:02.544 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 auth 2024-09-14T11:10:02.544 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 crypto 2024-09-14T11:10:02.544 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 finisher 2024-09-14T11:10:02.544 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 reserver 2024-09-14T11:10:02.544 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 heartbeatmap 2024-09-14T11:10:02.544 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 perfcounter 2024-09-14T11:10:02.544 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw 2024-09-14T11:10:02.544 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_sync 2024-09-14T11:10:02.544 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_datacache 2024-09-14T11:10:02.544 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_access 2024-09-14T11:10:02.545 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:10:02.545 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_flight 2024-09-14T11:10:02.545 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:10:02.545 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw_notification 2024-09-14T11:10:02.545 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 javaclient 2024-09-14T11:10:02.545 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 asok 2024-09-14T11:10:02.545 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 throttle 2024-09-14T11:10:02.545 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 refs 2024-09-14T11:10:02.545 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 compressor 2024-09-14T11:10:02.545 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluestore 2024-09-14T11:10:02.546 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluefs 2024-09-14T11:10:02.546 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 bdev 2024-09-14T11:10:02.546 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 kstore 2024-09-14T11:10:02.546 INFO:tasks.workunit.client.0.smithi050.stderr: 4/ 5 rocksdb 2024-09-14T11:10:02.546 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 fuse 2024-09-14T11:10:02.546 INFO:tasks.workunit.client.0.smithi050.stderr: 2/ 5 mgr 2024-09-14T11:10:02.546 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mgrc 2024-09-14T11:10:02.546 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 dpdk 2024-09-14T11:10:02.546 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 eventtrace 2024-09-14T11:10:02.546 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 prioritycache 2024-09-14T11:10:02.546 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 test 2024-09-14T11:10:02.546 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:10:02.546 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephsqlite 2024-09-14T11:10:02.546 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:10:02.546 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore 2024-09-14T11:10:02.547 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_onode 2024-09-14T11:10:02.547 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_odata 2024-09-14T11:10:02.547 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_omap 2024-09-14T11:10:02.547 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_tm 2024-09-14T11:10:02.547 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_t 2024-09-14T11:10:02.547 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:10:02.547 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_epm 2024-09-14T11:10:02.547 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_lba 2024-09-14T11:10:02.547 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:10:02.547 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cache 2024-09-14T11:10:02.547 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_journal 2024-09-14T11:10:02.547 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_device 2024-09-14T11:10:02.547 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_backref 2024-09-14T11:10:02.547 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 alienstore 2024-09-14T11:10:02.547 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mclock 2024-09-14T11:10:02.548 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cyanstore 2024-09-14T11:10:02.548 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 ceph_exporter 2024-09-14T11:10:02.548 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 memstore 2024-09-14T11:10:02.548 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 trace 2024-09-14T11:10:02.548 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 ceph_dedup 2024-09-14T11:10:02.548 INFO:tasks.workunit.client.0.smithi050.stderr: -2/-2 (syslog threshold) 2024-09-14T11:10:02.548 INFO:tasks.workunit.client.0.smithi050.stderr: 99/99 (stderr threshold) 2024-09-14T11:10:02.548 INFO:tasks.workunit.client.0.smithi050.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:10:02.548 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6b927fc640 / http_manager 2024-09-14T11:10:02.548 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6c18fe1640 / http_manager 2024-09-14T11:10:02.548 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6c19fe3640 / rgw_dt_lg_renew 2024-09-14T11:10:02.548 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6c417fa640 / ms_dispatch 2024-09-14T11:10:02.548 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6c42ffd640 / io_context_pool 2024-09-14T11:10:02.548 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6c497fa640 / ms_dispatch 2024-09-14T11:10:02.548 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6c4bfff640 / ms_dispatch 2024-09-14T11:10:02.549 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6c51e0b640 / io_context_pool 2024-09-14T11:10:02.549 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6d6320b640 / msgr-worker-2 2024-09-14T11:10:02.549 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6d63a0c640 / msgr-worker-1 2024-09-14T11:10:02.549 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6d6420d640 / msgr-worker-0 2024-09-14T11:10:02.549 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6d64a0e640 / io_context_pool 2024-09-14T11:10:02.549 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6d67d23800 / radosgw-admin 2024-09-14T11:10:02.549 INFO:tasks.workunit.client.0.smithi050.stderr: max_recent 500 2024-09-14T11:10:02.549 INFO:tasks.workunit.client.0.smithi050.stderr: max_new 1000 2024-09-14T11:10:02.549 INFO:tasks.workunit.client.0.smithi050.stderr: log_file /var/log/ceph/ceph-client.admin.99618.log 2024-09-14T11:10:02.549 INFO:tasks.workunit.client.0.smithi050.stderr:--- end dump of recent events --- 2024-09-14T11:10:02.549 INFO:tasks.workunit.client.0.smithi050.stderr:--- begin dump of recent events --- 2024-09-14T11:10:02.549 INFO:tasks.workunit.client.0.smithi050.stderr: -499> 2024-09-14T11:10:02.219+0000 7f6c51e0b640 10 monclient: _finish_auth 0 2024-09-14T11:10:02.550 INFO:tasks.workunit.client.0.smithi050.stderr: -498> 2024-09-14T11:10:02.219+0000 7f6c51e0b640 10 monclient: _check_auth_tickets 2024-09-14T11:10:02.550 INFO:tasks.workunit.client.0.smithi050.stderr: -497> 2024-09-14T11:10:02.219+0000 7f6c51e0b640 10 monclient: handle_config config(0 keys) 2024-09-14T11:10:02.550 INFO:tasks.workunit.client.0.smithi050.stderr: -496> 2024-09-14T11:10:02.219+0000 7f6c51e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:02.550 INFO:tasks.workunit.client.0.smithi050.stderr: -495> 2024-09-14T11:10:02.219+0000 7f6c51e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:10:02.550 INFO:tasks.workunit.client.0.smithi050.stderr: -494> 2024-09-14T11:10:02.219+0000 7f6c51e0b640 10 monclient: dump: 2024-09-14T11:10:02.550 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:02.550 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:02.550 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.550 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.550 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:02.550 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.550 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:02.550 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:02.550 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:02.551 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.551 INFO:tasks.workunit.client.0.smithi050.stderr: -493> 2024-09-14T11:10:02.219+0000 7f6d67d23800 5 monclient: authenticate success, global_id 6681 2024-09-14T11:10:02.551 INFO:tasks.workunit.client.0.smithi050.stderr: -492> 2024-09-14T11:10:02.219+0000 7f6d67d23800 10 monclient: get_monmap_and_config success 2024-09-14T11:10:02.551 INFO:tasks.workunit.client.0.smithi050.stderr: -491> 2024-09-14T11:10:02.219+0000 7f6d67d23800 4 set_mon_vals no callback set 2024-09-14T11:10:02.551 INFO:tasks.workunit.client.0.smithi050.stderr: -490> 2024-09-14T11:10:02.220+0000 7f6d67d23800 10 monclient: shutdown 2024-09-14T11:10:02.551 INFO:tasks.workunit.client.0.smithi050.stderr: -489> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 asok(0x55d12e9fd270) unregister_commands rotate-key 2024-09-14T11:10:02.551 INFO:tasks.workunit.client.0.smithi050.stderr: -488> 2024-09-14T11:10:02.220+0000 7f6d67d23800 10 monclient: build_initial_monmap 2024-09-14T11:10:02.551 INFO:tasks.workunit.client.0.smithi050.stderr: -487> 2024-09-14T11:10:02.220+0000 7f6d67d23800 1 build_initial for_mkfs: 0 2024-09-14T11:10:02.551 INFO:tasks.workunit.client.0.smithi050.stderr: -486> 2024-09-14T11:10:02.220+0000 7f6d67d23800 10 monclient: monmap: 2024-09-14T11:10:02.551 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:10:02.551 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:10:02.551 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:10:02.551 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:10:02.551 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:10:02.552 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.552 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:10:02.552 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:10:02.552 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:10:02.552 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.552 INFO:tasks.workunit.client.0.smithi050.stderr: -485> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding auth protocol: cephx 2024-09-14T11:10:02.552 INFO:tasks.workunit.client.0.smithi050.stderr: -484> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding auth protocol: cephx 2024-09-14T11:10:02.552 INFO:tasks.workunit.client.0.smithi050.stderr: -483> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding auth protocol: cephx 2024-09-14T11:10:02.552 INFO:tasks.workunit.client.0.smithi050.stderr: -482> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding con mode: secure 2024-09-14T11:10:02.552 INFO:tasks.workunit.client.0.smithi050.stderr: -481> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding con mode: crc 2024-09-14T11:10:02.552 INFO:tasks.workunit.client.0.smithi050.stderr: -480> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding con mode: secure 2024-09-14T11:10:02.552 INFO:tasks.workunit.client.0.smithi050.stderr: -479> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding con mode: crc 2024-09-14T11:10:02.553 INFO:tasks.workunit.client.0.smithi050.stderr: -478> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding con mode: secure 2024-09-14T11:10:02.553 INFO:tasks.workunit.client.0.smithi050.stderr: -477> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding con mode: crc 2024-09-14T11:10:02.553 INFO:tasks.workunit.client.0.smithi050.stderr: -476> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding con mode: crc 2024-09-14T11:10:02.553 INFO:tasks.workunit.client.0.smithi050.stderr: -475> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding con mode: secure 2024-09-14T11:10:02.553 INFO:tasks.workunit.client.0.smithi050.stderr: -474> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding con mode: crc 2024-09-14T11:10:02.553 INFO:tasks.workunit.client.0.smithi050.stderr: -473> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding con mode: secure 2024-09-14T11:10:02.553 INFO:tasks.workunit.client.0.smithi050.stderr: -472> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding con mode: crc 2024-09-14T11:10:02.553 INFO:tasks.workunit.client.0.smithi050.stderr: -471> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec22560) adding con mode: secure 2024-09-14T11:10:02.553 INFO:tasks.workunit.client.0.smithi050.stderr: -470> 2024-09-14T11:10:02.220+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.553 INFO:tasks.workunit.client.0.smithi050.stderr: -469> 2024-09-14T11:10:02.220+0000 7f6d67d23800 1 librados: starting msgr at 2024-09-14T11:10:02.553 INFO:tasks.workunit.client.0.smithi050.stderr: -468> 2024-09-14T11:10:02.220+0000 7f6d67d23800 1 librados: starting objecter 2024-09-14T11:10:02.553 INFO:tasks.workunit.client.0.smithi050.stderr: -467> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command objecter_requests hook 0x55d12ec22d90 2024-09-14T11:10:02.553 INFO:tasks.workunit.client.0.smithi050.stderr: -466> 2024-09-14T11:10:02.220+0000 7f6d67d23800 1 librados: setting wanted keys 2024-09-14T11:10:02.553 INFO:tasks.workunit.client.0.smithi050.stderr: -465> 2024-09-14T11:10:02.220+0000 7f6d67d23800 1 librados: calling monclient init 2024-09-14T11:10:02.553 INFO:tasks.workunit.client.0.smithi050.stderr: -464> 2024-09-14T11:10:02.220+0000 7f6d67d23800 10 monclient: init 2024-09-14T11:10:02.554 INFO:tasks.workunit.client.0.smithi050.stderr: -463> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding auth protocol: cephx 2024-09-14T11:10:02.554 INFO:tasks.workunit.client.0.smithi050.stderr: -462> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding auth protocol: cephx 2024-09-14T11:10:02.554 INFO:tasks.workunit.client.0.smithi050.stderr: -461> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding auth protocol: cephx 2024-09-14T11:10:02.554 INFO:tasks.workunit.client.0.smithi050.stderr: -460> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding con mode: secure 2024-09-14T11:10:02.554 INFO:tasks.workunit.client.0.smithi050.stderr: -459> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding con mode: crc 2024-09-14T11:10:02.554 INFO:tasks.workunit.client.0.smithi050.stderr: -458> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding con mode: secure 2024-09-14T11:10:02.554 INFO:tasks.workunit.client.0.smithi050.stderr: -457> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding con mode: crc 2024-09-14T11:10:02.554 INFO:tasks.workunit.client.0.smithi050.stderr: -456> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding con mode: secure 2024-09-14T11:10:02.554 INFO:tasks.workunit.client.0.smithi050.stderr: -455> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding con mode: crc 2024-09-14T11:10:02.554 INFO:tasks.workunit.client.0.smithi050.stderr: -454> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding con mode: crc 2024-09-14T11:10:02.554 INFO:tasks.workunit.client.0.smithi050.stderr: -453> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding con mode: secure 2024-09-14T11:10:02.554 INFO:tasks.workunit.client.0.smithi050.stderr: -452> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding con mode: crc 2024-09-14T11:10:02.554 INFO:tasks.workunit.client.0.smithi050.stderr: -451> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding con mode: secure 2024-09-14T11:10:02.555 INFO:tasks.workunit.client.0.smithi050.stderr: -450> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding con mode: crc 2024-09-14T11:10:02.555 INFO:tasks.workunit.client.0.smithi050.stderr: -449> 2024-09-14T11:10:02.220+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec1cb80) adding con mode: secure 2024-09-14T11:10:02.555 INFO:tasks.workunit.client.0.smithi050.stderr: -448> 2024-09-14T11:10:02.221+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.555 INFO:tasks.workunit.client.0.smithi050.stderr: -447> 2024-09-14T11:10:02.221+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.555 INFO:tasks.workunit.client.0.smithi050.stderr: -446> 2024-09-14T11:10:02.221+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command rotate-key hook 0x55d12ec1ccc8 2024-09-14T11:10:02.555 INFO:tasks.workunit.client.0.smithi050.stderr: -445> 2024-09-14T11:10:02.221+0000 7f6d67d23800 10 monclient: _reopen_session rank -1 2024-09-14T11:10:02.555 INFO:tasks.workunit.client.0.smithi050.stderr: -444> 2024-09-14T11:10:02.221+0000 7f6d67d23800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:10:02.555 INFO:tasks.workunit.client.0.smithi050.stderr: -443> 2024-09-14T11:10:02.221+0000 7f6d67d23800 10 monclient(hunting): picked mon.noname-b con 0x55d12eaa8df0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:10:02.555 INFO:tasks.workunit.client.0.smithi050.stderr: -442> 2024-09-14T11:10:02.221+0000 7f6d67d23800 10 monclient(hunting): picked mon.noname-a con 0x55d12eb65f10 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:10:02.555 INFO:tasks.workunit.client.0.smithi050.stderr: -441> 2024-09-14T11:10:02.221+0000 7f6d67d23800 10 monclient(hunting): picked mon.noname-c con 0x55d12ec23880 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:10:02.555 INFO:tasks.workunit.client.0.smithi050.stderr: -440> 2024-09-14T11:10:02.221+0000 7f6d67d23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:02.555 INFO:tasks.workunit.client.0.smithi050.stderr: -439> 2024-09-14T11:10:02.221+0000 7f6d67d23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:02.555 INFO:tasks.workunit.client.0.smithi050.stderr: -438> 2024-09-14T11:10:02.221+0000 7f6d67d23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:02.556 INFO:tasks.workunit.client.0.smithi050.stderr: -437> 2024-09-14T11:10:02.221+0000 7f6d67d23800 10 monclient(hunting): _renew_subs 2024-09-14T11:10:02.556 INFO:tasks.workunit.client.0.smithi050.stderr: -436> 2024-09-14T11:10:02.221+0000 7f6d67d23800 10 monclient(hunting): authenticate will time out at 2254.858495s 2024-09-14T11:10:02.556 INFO:tasks.workunit.client.0.smithi050.stderr: -435> 2024-09-14T11:10:02.221+0000 7f6d6320b640 10 monclient(hunting): get_auth_request con 0x55d12eb65f10 auth_method 0 2024-09-14T11:10:02.556 INFO:tasks.workunit.client.0.smithi050.stderr: -434> 2024-09-14T11:10:02.221+0000 7f6d6320b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:02.556 INFO:tasks.workunit.client.0.smithi050.stderr: -433> 2024-09-14T11:10:02.221+0000 7f6d6320b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:02.556 INFO:tasks.workunit.client.0.smithi050.stderr: -432> 2024-09-14T11:10:02.221+0000 7f6d6320b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:02.556 INFO:tasks.workunit.client.0.smithi050.stderr: -431> 2024-09-14T11:10:02.221+0000 7f6d6420d640 10 monclient(hunting): get_auth_request con 0x55d12ec23880 auth_method 0 2024-09-14T11:10:02.556 INFO:tasks.workunit.client.0.smithi050.stderr: -430> 2024-09-14T11:10:02.221+0000 7f6d6420d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:02.556 INFO:tasks.workunit.client.0.smithi050.stderr: -429> 2024-09-14T11:10:02.221+0000 7f6d6420d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:02.556 INFO:tasks.workunit.client.0.smithi050.stderr: -428> 2024-09-14T11:10:02.221+0000 7f6d6420d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:02.556 INFO:tasks.workunit.client.0.smithi050.stderr: -427> 2024-09-14T11:10:02.221+0000 7f6d63a0c640 10 monclient(hunting): get_auth_request con 0x55d12eaa8df0 auth_method 0 2024-09-14T11:10:02.556 INFO:tasks.workunit.client.0.smithi050.stderr: -426> 2024-09-14T11:10:02.221+0000 7f6d63a0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:02.556 INFO:tasks.workunit.client.0.smithi050.stderr: -425> 2024-09-14T11:10:02.221+0000 7f6d63a0c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:02.557 INFO:tasks.workunit.client.0.smithi050.stderr: -424> 2024-09-14T11:10:02.221+0000 7f6d63a0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:02.557 INFO:tasks.workunit.client.0.smithi050.stderr: -423> 2024-09-14T11:10:02.221+0000 7f6d6320b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:02.557 INFO:tasks.workunit.client.0.smithi050.stderr: -422> 2024-09-14T11:10:02.221+0000 7f6d6320b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:02.557 INFO:tasks.workunit.client.0.smithi050.stderr: -421> 2024-09-14T11:10:02.221+0000 7f6d6320b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:02.557 INFO:tasks.workunit.client.0.smithi050.stderr: -420> 2024-09-14T11:10:02.221+0000 7f6d6420d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:02.557 INFO:tasks.workunit.client.0.smithi050.stderr: -419> 2024-09-14T11:10:02.221+0000 7f6d6420d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:02.557 INFO:tasks.workunit.client.0.smithi050.stderr: -418> 2024-09-14T11:10:02.221+0000 7f6d6420d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:02.557 INFO:tasks.workunit.client.0.smithi050.stderr: -417> 2024-09-14T11:10:02.221+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:02.557 INFO:tasks.workunit.client.0.smithi050.stderr: -416> 2024-09-14T11:10:02.221+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:02.557 INFO:tasks.workunit.client.0.smithi050.stderr: -415> 2024-09-14T11:10:02.221+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:02.557 INFO:tasks.workunit.client.0.smithi050.stderr: -414> 2024-09-14T11:10:02.221+0000 7f6d6320b640 10 monclient(hunting): handle_auth_done global_id 6684 payload 824 2024-09-14T11:10:02.557 INFO:tasks.workunit.client.0.smithi050.stderr: -413> 2024-09-14T11:10:02.221+0000 7f6d6320b640 10 monclient: _finish_hunting 0 2024-09-14T11:10:02.557 INFO:tasks.workunit.client.0.smithi050.stderr: -412> 2024-09-14T11:10:02.221+0000 7f6d6320b640 1 monclient: found mon.noname-a 2024-09-14T11:10:02.557 INFO:tasks.workunit.client.0.smithi050.stderr: -411> 2024-09-14T11:10:02.221+0000 7f6d6320b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:10:02.560 INFO:tasks.workunit.client.0.smithi050.stderr: -410> 2024-09-14T11:10:02.222+0000 7f6c4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:02.560 INFO:tasks.workunit.client.0.smithi050.stderr: -409> 2024-09-14T11:10:02.222+0000 7f6c4bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:10:02.560 INFO:tasks.workunit.client.0.smithi050.stderr: -408> 2024-09-14T11:10:02.222+0000 7f6c4bfff640 10 monclient: dump: 2024-09-14T11:10:02.560 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:02.560 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:02.561 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.561 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.561 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:02.561 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.561 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:02.561 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:02.561 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:02.561 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.561 INFO:tasks.workunit.client.0.smithi050.stderr: -407> 2024-09-14T11:10:02.222+0000 7f6c4bfff640 10 monclient: _finish_auth 0 2024-09-14T11:10:02.561 INFO:tasks.workunit.client.0.smithi050.stderr: -406> 2024-09-14T11:10:02.222+0000 7f6c4bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:10:02.561 INFO:tasks.workunit.client.0.smithi050.stderr: -405> 2024-09-14T11:10:02.222+0000 7f6c4bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:10:02.561 INFO:tasks.workunit.client.0.smithi050.stderr: -404> 2024-09-14T11:10:02.222+0000 7f6c4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:02.562 INFO:tasks.workunit.client.0.smithi050.stderr: -403> 2024-09-14T11:10:02.222+0000 7f6c4bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:10:02.562 INFO:tasks.workunit.client.0.smithi050.stderr: -402> 2024-09-14T11:10:02.222+0000 7f6c4bfff640 10 monclient: dump: 2024-09-14T11:10:02.562 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:02.562 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:02.562 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.562 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.562 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:02.562 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.562 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:02.562 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:02.562 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:02.562 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.562 INFO:tasks.workunit.client.0.smithi050.stderr: -401> 2024-09-14T11:10:02.222+0000 7f6d67d23800 5 monclient: authenticate success, global_id 6684 2024-09-14T11:10:02.563 INFO:tasks.workunit.client.0.smithi050.stderr: -400> 2024-09-14T11:10:02.222+0000 7f6d67d23800 10 monclient: _renew_subs 2024-09-14T11:10:02.563 INFO:tasks.workunit.client.0.smithi050.stderr: -399> 2024-09-14T11:10:02.222+0000 7f6c51e0b640 4 set_mon_vals no callback set 2024-09-14T11:10:02.563 INFO:tasks.workunit.client.0.smithi050.stderr: -398> 2024-09-14T11:10:02.222+0000 7f6d67d23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:10:02.563 INFO:tasks.workunit.client.0.smithi050.stderr: -397> 2024-09-14T11:10:02.222+0000 7f6d67d23800 10 monclient: _renew_subs 2024-09-14T11:10:02.563 INFO:tasks.workunit.client.0.smithi050.stderr: -396> 2024-09-14T11:10:02.222+0000 7f6d67d23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:10:02.563 INFO:tasks.workunit.client.0.smithi050.stderr: -395> 2024-09-14T11:10:02.222+0000 7f6d67d23800 1 librados: init done 2024-09-14T11:10:02.563 INFO:tasks.workunit.client.0.smithi050.stderr: -394> 2024-09-14T11:10:02.224+0000 7f6c4bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:10:02.563 INFO:tasks.workunit.client.0.smithi050.stderr: -393> 2024-09-14T11:10:02.224+0000 7f6c4bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:10:02.563 INFO:tasks.workunit.client.0.smithi050.stderr: -392> 2024-09-14T11:10:02.224+0000 7f6c4bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:10:02.563 INFO:tasks.workunit.client.0.smithi050.stderr: -391> 2024-09-14T11:10:02.224+0000 7f6d63a0c640 10 monclient: get_auth_request con 0x7f6c4c077230 auth_method 0 2024-09-14T11:10:02.563 INFO:tasks.workunit.client.0.smithi050.stderr: -390> 2024-09-14T11:10:02.225+0000 7f6d6420d640 10 monclient: get_auth_request con 0x55d12ec66970 auth_method 0 2024-09-14T11:10:02.563 INFO:tasks.workunit.client.0.smithi050.stderr: -389> 2024-09-14T11:10:02.225+0000 7f6d63a0c640 10 monclient: get_auth_request con 0x55d12ec69b50 auth_method 0 2024-09-14T11:10:02.563 INFO:tasks.workunit.client.0.smithi050.stderr: -388> 2024-09-14T11:10:02.226+0000 7f6d6320b640 10 monclient: get_auth_request con 0x55d12ec6def0 auth_method 0 2024-09-14T11:10:02.564 INFO:tasks.workunit.client.0.smithi050.stderr: -387> 2024-09-14T11:10:02.227+0000 7f6d67d23800 10 monclient: build_initial_monmap 2024-09-14T11:10:02.564 INFO:tasks.workunit.client.0.smithi050.stderr: -386> 2024-09-14T11:10:02.227+0000 7f6d67d23800 1 build_initial for_mkfs: 0 2024-09-14T11:10:02.564 INFO:tasks.workunit.client.0.smithi050.stderr: -385> 2024-09-14T11:10:02.227+0000 7f6d67d23800 10 monclient: monmap: 2024-09-14T11:10:02.564 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:10:02.564 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:10:02.564 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:10:02.564 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:10:02.564 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:10:02.564 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.564 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:10:02.564 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:10:02.564 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:10:02.564 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.565 INFO:tasks.workunit.client.0.smithi050.stderr: -384> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding auth protocol: cephx 2024-09-14T11:10:02.565 INFO:tasks.workunit.client.0.smithi050.stderr: -383> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding auth protocol: cephx 2024-09-14T11:10:02.565 INFO:tasks.workunit.client.0.smithi050.stderr: -382> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding auth protocol: cephx 2024-09-14T11:10:02.565 INFO:tasks.workunit.client.0.smithi050.stderr: -381> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding con mode: secure 2024-09-14T11:10:02.565 INFO:tasks.workunit.client.0.smithi050.stderr: -380> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding con mode: crc 2024-09-14T11:10:02.565 INFO:tasks.workunit.client.0.smithi050.stderr: -379> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding con mode: secure 2024-09-14T11:10:02.565 INFO:tasks.workunit.client.0.smithi050.stderr: -378> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding con mode: crc 2024-09-14T11:10:02.565 INFO:tasks.workunit.client.0.smithi050.stderr: -377> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding con mode: secure 2024-09-14T11:10:02.565 INFO:tasks.workunit.client.0.smithi050.stderr: -376> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding con mode: crc 2024-09-14T11:10:02.565 INFO:tasks.workunit.client.0.smithi050.stderr: -375> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding con mode: crc 2024-09-14T11:10:02.565 INFO:tasks.workunit.client.0.smithi050.stderr: -374> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding con mode: secure 2024-09-14T11:10:02.565 INFO:tasks.workunit.client.0.smithi050.stderr: -373> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding con mode: crc 2024-09-14T11:10:02.565 INFO:tasks.workunit.client.0.smithi050.stderr: -372> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding con mode: secure 2024-09-14T11:10:02.566 INFO:tasks.workunit.client.0.smithi050.stderr: -371> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding con mode: crc 2024-09-14T11:10:02.566 INFO:tasks.workunit.client.0.smithi050.stderr: -370> 2024-09-14T11:10:02.227+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec72f60) adding con mode: secure 2024-09-14T11:10:02.566 INFO:tasks.workunit.client.0.smithi050.stderr: -369> 2024-09-14T11:10:02.228+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.566 INFO:tasks.workunit.client.0.smithi050.stderr: -368> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command objecter_requests cmddesc objecter_requests hook 0x55d12ec763c0 EEXIST 2024-09-14T11:10:02.566 INFO:tasks.workunit.client.0.smithi050.stderr: -367> 2024-09-14T11:10:02.228+0000 7f6d67d23800 10 monclient: init 2024-09-14T11:10:02.566 INFO:tasks.workunit.client.0.smithi050.stderr: -366> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding auth protocol: cephx 2024-09-14T11:10:02.566 INFO:tasks.workunit.client.0.smithi050.stderr: -365> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding auth protocol: cephx 2024-09-14T11:10:02.566 INFO:tasks.workunit.client.0.smithi050.stderr: -364> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding auth protocol: cephx 2024-09-14T11:10:02.566 INFO:tasks.workunit.client.0.smithi050.stderr: -363> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding con mode: secure 2024-09-14T11:10:02.567 INFO:tasks.workunit.client.0.smithi050.stderr: -362> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding con mode: crc 2024-09-14T11:10:02.567 INFO:tasks.workunit.client.0.smithi050.stderr: -361> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding con mode: secure 2024-09-14T11:10:02.567 INFO:tasks.workunit.client.0.smithi050.stderr: -360> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding con mode: crc 2024-09-14T11:10:02.567 INFO:tasks.workunit.client.0.smithi050.stderr: -359> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding con mode: secure 2024-09-14T11:10:02.567 INFO:tasks.workunit.client.0.smithi050.stderr: -358> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding con mode: crc 2024-09-14T11:10:02.567 INFO:tasks.workunit.client.0.smithi050.stderr: -357> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding con mode: crc 2024-09-14T11:10:02.567 INFO:tasks.workunit.client.0.smithi050.stderr: -356> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding con mode: secure 2024-09-14T11:10:02.567 INFO:tasks.workunit.client.0.smithi050.stderr: -355> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding con mode: crc 2024-09-14T11:10:02.567 INFO:tasks.workunit.client.0.smithi050.stderr: -354> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding con mode: secure 2024-09-14T11:10:02.567 INFO:tasks.workunit.client.0.smithi050.stderr: -353> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding con mode: crc 2024-09-14T11:10:02.567 INFO:tasks.workunit.client.0.smithi050.stderr: -352> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 AuthRegistry(0x55d12ec71458) adding con mode: secure 2024-09-14T11:10:02.567 INFO:tasks.workunit.client.0.smithi050.stderr: -351> 2024-09-14T11:10:02.228+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.568 INFO:tasks.workunit.client.0.smithi050.stderr: -350> 2024-09-14T11:10:02.228+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.568 INFO:tasks.workunit.client.0.smithi050.stderr: -349> 2024-09-14T11:10:02.228+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command rotate-key cmddesc rotate-key hook 0x55d12ec715a0 EEXIST 2024-09-14T11:10:02.568 INFO:tasks.workunit.client.0.smithi050.stderr: -348> 2024-09-14T11:10:02.228+0000 7f6d67d23800 10 monclient: _reopen_session rank -1 2024-09-14T11:10:02.568 INFO:tasks.workunit.client.0.smithi050.stderr: -347> 2024-09-14T11:10:02.228+0000 7f6d67d23800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:10:02.568 INFO:tasks.workunit.client.0.smithi050.stderr: -346> 2024-09-14T11:10:02.229+0000 7f6d67d23800 10 monclient(hunting): picked mon.noname-c con 0x55d12ec9a6e0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:10:02.568 INFO:tasks.workunit.client.0.smithi050.stderr: -345> 2024-09-14T11:10:02.229+0000 7f6d67d23800 10 monclient(hunting): picked mon.noname-b con 0x55d12ec9aac0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:10:02.568 INFO:tasks.workunit.client.0.smithi050.stderr: -344> 2024-09-14T11:10:02.229+0000 7f6d67d23800 10 monclient(hunting): picked mon.noname-a con 0x55d12ec993f0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:10:02.568 INFO:tasks.workunit.client.0.smithi050.stderr: -343> 2024-09-14T11:10:02.229+0000 7f6d67d23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:02.568 INFO:tasks.workunit.client.0.smithi050.stderr: -342> 2024-09-14T11:10:02.229+0000 7f6d67d23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:02.568 INFO:tasks.workunit.client.0.smithi050.stderr: -341> 2024-09-14T11:10:02.229+0000 7f6d67d23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:02.568 INFO:tasks.workunit.client.0.smithi050.stderr: -340> 2024-09-14T11:10:02.229+0000 7f6d67d23800 10 monclient(hunting): _renew_subs 2024-09-14T11:10:02.568 INFO:tasks.workunit.client.0.smithi050.stderr: -339> 2024-09-14T11:10:02.229+0000 7f6d67d23800 10 monclient(hunting): authenticate will time out at 2254.866033s 2024-09-14T11:10:02.569 INFO:tasks.workunit.client.0.smithi050.stderr: -338> 2024-09-14T11:10:02.229+0000 7f6d6420d640 10 monclient(hunting): get_auth_request con 0x55d12ec993f0 auth_method 0 2024-09-14T11:10:02.569 INFO:tasks.workunit.client.0.smithi050.stderr: -337> 2024-09-14T11:10:02.229+0000 7f6d6420d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:02.569 INFO:tasks.workunit.client.0.smithi050.stderr: -336> 2024-09-14T11:10:02.229+0000 7f6d6420d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:02.569 INFO:tasks.workunit.client.0.smithi050.stderr: -335> 2024-09-14T11:10:02.229+0000 7f6d6420d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:02.569 INFO:tasks.workunit.client.0.smithi050.stderr: -334> 2024-09-14T11:10:02.229+0000 7f6d63a0c640 10 monclient(hunting): get_auth_request con 0x55d12ec9a6e0 auth_method 0 2024-09-14T11:10:02.569 INFO:tasks.workunit.client.0.smithi050.stderr: -333> 2024-09-14T11:10:02.229+0000 7f6d63a0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:02.569 INFO:tasks.workunit.client.0.smithi050.stderr: -332> 2024-09-14T11:10:02.229+0000 7f6d63a0c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:02.569 INFO:tasks.workunit.client.0.smithi050.stderr: -331> 2024-09-14T11:10:02.229+0000 7f6d63a0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:02.569 INFO:tasks.workunit.client.0.smithi050.stderr: -330> 2024-09-14T11:10:02.229+0000 7f6d6320b640 10 monclient(hunting): get_auth_request con 0x55d12ec9aac0 auth_method 0 2024-09-14T11:10:02.569 INFO:tasks.workunit.client.0.smithi050.stderr: -329> 2024-09-14T11:10:02.229+0000 7f6d6320b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:02.569 INFO:tasks.workunit.client.0.smithi050.stderr: -328> 2024-09-14T11:10:02.229+0000 7f6d6320b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:02.569 INFO:tasks.workunit.client.0.smithi050.stderr: -327> 2024-09-14T11:10:02.229+0000 7f6d6320b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:02.569 INFO:tasks.workunit.client.0.smithi050.stderr: -326> 2024-09-14T11:10:02.229+0000 7f6d6420d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:02.570 INFO:tasks.workunit.client.0.smithi050.stderr: -325> 2024-09-14T11:10:02.229+0000 7f6d6420d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:02.570 INFO:tasks.workunit.client.0.smithi050.stderr: -324> 2024-09-14T11:10:02.229+0000 7f6d6420d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:02.570 INFO:tasks.workunit.client.0.smithi050.stderr: -323> 2024-09-14T11:10:02.229+0000 7f6d6320b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:02.570 INFO:tasks.workunit.client.0.smithi050.stderr: -322> 2024-09-14T11:10:02.229+0000 7f6d6320b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:02.570 INFO:tasks.workunit.client.0.smithi050.stderr: -321> 2024-09-14T11:10:02.229+0000 7f6d6320b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:02.570 INFO:tasks.workunit.client.0.smithi050.stderr: -320> 2024-09-14T11:10:02.229+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:02.570 INFO:tasks.workunit.client.0.smithi050.stderr: -319> 2024-09-14T11:10:02.229+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:02.570 INFO:tasks.workunit.client.0.smithi050.stderr: -318> 2024-09-14T11:10:02.229+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:02.570 INFO:tasks.workunit.client.0.smithi050.stderr: -317> 2024-09-14T11:10:02.229+0000 7f6d6420d640 10 monclient(hunting): handle_auth_done global_id 6687 payload 824 2024-09-14T11:10:02.570 INFO:tasks.workunit.client.0.smithi050.stderr: -316> 2024-09-14T11:10:02.229+0000 7f6d6420d640 10 monclient: _finish_hunting 0 2024-09-14T11:10:02.570 INFO:tasks.workunit.client.0.smithi050.stderr: -315> 2024-09-14T11:10:02.229+0000 7f6d6420d640 1 monclient: found mon.noname-a 2024-09-14T11:10:02.570 INFO:tasks.workunit.client.0.smithi050.stderr: -314> 2024-09-14T11:10:02.229+0000 7f6d6420d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:10:02.570 INFO:tasks.workunit.client.0.smithi050.stderr: -313> 2024-09-14T11:10:02.229+0000 7f6c497fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:02.571 INFO:tasks.workunit.client.0.smithi050.stderr: -312> 2024-09-14T11:10:02.229+0000 7f6c497fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:10:02.571 INFO:tasks.workunit.client.0.smithi050.stderr: -311> 2024-09-14T11:10:02.229+0000 7f6c497fa640 10 monclient: dump: 2024-09-14T11:10:02.571 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:02.571 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:02.571 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.571 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.571 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:02.571 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.571 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:02.571 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:02.571 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:02.571 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.571 INFO:tasks.workunit.client.0.smithi050.stderr: -310> 2024-09-14T11:10:02.229+0000 7f6c497fa640 10 monclient: _finish_auth 0 2024-09-14T11:10:02.572 INFO:tasks.workunit.client.0.smithi050.stderr: -309> 2024-09-14T11:10:02.229+0000 7f6c497fa640 10 monclient: _check_auth_tickets 2024-09-14T11:10:02.572 INFO:tasks.workunit.client.0.smithi050.stderr: -308> 2024-09-14T11:10:02.229+0000 7f6c497fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:10:02.572 INFO:tasks.workunit.client.0.smithi050.stderr: -307> 2024-09-14T11:10:02.229+0000 7f6c497fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:02.572 INFO:tasks.workunit.client.0.smithi050.stderr: -306> 2024-09-14T11:10:02.229+0000 7f6c497fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:10:02.572 INFO:tasks.workunit.client.0.smithi050.stderr: -305> 2024-09-14T11:10:02.229+0000 7f6c497fa640 10 monclient: dump: 2024-09-14T11:10:02.572 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:02.572 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:02.572 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.572 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.572 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:02.572 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.572 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:02.572 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:02.572 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:02.573 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.573 INFO:tasks.workunit.client.0.smithi050.stderr: -304> 2024-09-14T11:10:02.229+0000 7f6d67d23800 5 monclient: authenticate success, global_id 6687 2024-09-14T11:10:02.573 INFO:tasks.workunit.client.0.smithi050.stderr: -303> 2024-09-14T11:10:02.229+0000 7f6d67d23800 10 monclient: _renew_subs 2024-09-14T11:10:02.573 INFO:tasks.workunit.client.0.smithi050.stderr: -302> 2024-09-14T11:10:02.229+0000 7f6d67d23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:10:02.573 INFO:tasks.workunit.client.0.smithi050.stderr: -301> 2024-09-14T11:10:02.229+0000 7f6d64a0e640 4 set_mon_vals no callback set 2024-09-14T11:10:02.573 INFO:tasks.workunit.client.0.smithi050.stderr: -300> 2024-09-14T11:10:02.229+0000 7f6d67d23800 10 monclient: _renew_subs 2024-09-14T11:10:02.573 INFO:tasks.workunit.client.0.smithi050.stderr: -299> 2024-09-14T11:10:02.229+0000 7f6d67d23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:10:02.573 INFO:tasks.workunit.client.0.smithi050.stderr: -298> 2024-09-14T11:10:02.232+0000 7f6c497fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:10:02.573 INFO:tasks.workunit.client.0.smithi050.stderr: -297> 2024-09-14T11:10:02.232+0000 7f6c497fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:10:02.573 INFO:tasks.workunit.client.0.smithi050.stderr: -296> 2024-09-14T11:10:02.232+0000 7f6c497fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:10:02.573 INFO:tasks.workunit.client.0.smithi050.stderr: -295> 2024-09-14T11:10:02.232+0000 7f6d63a0c640 10 monclient: get_auth_request con 0x7f6c3c077140 auth_method 0 2024-09-14T11:10:02.573 INFO:tasks.workunit.client.0.smithi050.stderr: -294> 2024-09-14T11:10:02.232+0000 7f6d67d23800 10 monclient: get_monmap_and_config 2024-09-14T11:10:02.573 INFO:tasks.workunit.client.0.smithi050.stderr: -293> 2024-09-14T11:10:02.232+0000 7f6d67d23800 10 monclient: build_initial_monmap 2024-09-14T11:10:02.574 INFO:tasks.workunit.client.0.smithi050.stderr: -292> 2024-09-14T11:10:02.232+0000 7f6d67d23800 1 build_initial for_mkfs: 0 2024-09-14T11:10:02.574 INFO:tasks.workunit.client.0.smithi050.stderr: -291> 2024-09-14T11:10:02.232+0000 7f6d67d23800 10 monclient: monmap: 2024-09-14T11:10:02.574 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:10:02.574 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:10:02.574 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:10:02.574 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:10:02.574 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:10:02.574 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.574 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:10:02.574 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:10:02.574 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:10:02.574 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.574 INFO:tasks.workunit.client.0.smithi050.stderr: -290> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding auth protocol: cephx 2024-09-14T11:10:02.574 INFO:tasks.workunit.client.0.smithi050.stderr: -289> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding auth protocol: cephx 2024-09-14T11:10:02.574 INFO:tasks.workunit.client.0.smithi050.stderr: -288> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding auth protocol: cephx 2024-09-14T11:10:02.575 INFO:tasks.workunit.client.0.smithi050.stderr: -287> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding con mode: secure 2024-09-14T11:10:02.575 INFO:tasks.workunit.client.0.smithi050.stderr: -286> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding con mode: crc 2024-09-14T11:10:02.575 INFO:tasks.workunit.client.0.smithi050.stderr: -285> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding con mode: secure 2024-09-14T11:10:02.575 INFO:tasks.workunit.client.0.smithi050.stderr: -284> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding con mode: crc 2024-09-14T11:10:02.575 INFO:tasks.workunit.client.0.smithi050.stderr: -283> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding con mode: secure 2024-09-14T11:10:02.575 INFO:tasks.workunit.client.0.smithi050.stderr: -282> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding con mode: crc 2024-09-14T11:10:02.575 INFO:tasks.workunit.client.0.smithi050.stderr: -281> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding con mode: crc 2024-09-14T11:10:02.575 INFO:tasks.workunit.client.0.smithi050.stderr: -280> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding con mode: secure 2024-09-14T11:10:02.575 INFO:tasks.workunit.client.0.smithi050.stderr: -279> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding con mode: crc 2024-09-14T11:10:02.575 INFO:tasks.workunit.client.0.smithi050.stderr: -278> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding con mode: secure 2024-09-14T11:10:02.575 INFO:tasks.workunit.client.0.smithi050.stderr: -277> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding con mode: crc 2024-09-14T11:10:02.575 INFO:tasks.workunit.client.0.smithi050.stderr: -276> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecba550) adding con mode: secure 2024-09-14T11:10:02.575 INFO:tasks.workunit.client.0.smithi050.stderr: -275> 2024-09-14T11:10:02.232+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.576 INFO:tasks.workunit.client.0.smithi050.stderr: -274> 2024-09-14T11:10:02.232+0000 7f6d67d23800 10 monclient: init 2024-09-14T11:10:02.576 INFO:tasks.workunit.client.0.smithi050.stderr: -273> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding auth protocol: cephx 2024-09-14T11:10:02.576 INFO:tasks.workunit.client.0.smithi050.stderr: -272> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding auth protocol: cephx 2024-09-14T11:10:02.576 INFO:tasks.workunit.client.0.smithi050.stderr: -271> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding auth protocol: cephx 2024-09-14T11:10:02.576 INFO:tasks.workunit.client.0.smithi050.stderr: -270> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding con mode: secure 2024-09-14T11:10:02.576 INFO:tasks.workunit.client.0.smithi050.stderr: -269> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding con mode: crc 2024-09-14T11:10:02.576 INFO:tasks.workunit.client.0.smithi050.stderr: -268> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding con mode: secure 2024-09-14T11:10:02.576 INFO:tasks.workunit.client.0.smithi050.stderr: -267> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding con mode: crc 2024-09-14T11:10:02.576 INFO:tasks.workunit.client.0.smithi050.stderr: -266> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding con mode: secure 2024-09-14T11:10:02.576 INFO:tasks.workunit.client.0.smithi050.stderr: -265> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding con mode: crc 2024-09-14T11:10:02.576 INFO:tasks.workunit.client.0.smithi050.stderr: -264> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding con mode: crc 2024-09-14T11:10:02.576 INFO:tasks.workunit.client.0.smithi050.stderr: -263> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding con mode: secure 2024-09-14T11:10:02.576 INFO:tasks.workunit.client.0.smithi050.stderr: -262> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding con mode: crc 2024-09-14T11:10:02.576 INFO:tasks.workunit.client.0.smithi050.stderr: -261> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding con mode: secure 2024-09-14T11:10:02.577 INFO:tasks.workunit.client.0.smithi050.stderr: -260> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding con mode: crc 2024-09-14T11:10:02.577 INFO:tasks.workunit.client.0.smithi050.stderr: -259> 2024-09-14T11:10:02.232+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736380) adding con mode: secure 2024-09-14T11:10:02.577 INFO:tasks.workunit.client.0.smithi050.stderr: -258> 2024-09-14T11:10:02.233+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.577 INFO:tasks.workunit.client.0.smithi050.stderr: -257> 2024-09-14T11:10:02.233+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.577 INFO:tasks.workunit.client.0.smithi050.stderr: -256> 2024-09-14T11:10:02.233+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command rotate-key cmddesc rotate-key hook 0x7ffe207364c8 EEXIST 2024-09-14T11:10:02.577 INFO:tasks.workunit.client.0.smithi050.stderr: -255> 2024-09-14T11:10:02.233+0000 7f6d67d23800 10 monclient: _reopen_session rank -1 2024-09-14T11:10:02.577 INFO:tasks.workunit.client.0.smithi050.stderr: -254> 2024-09-14T11:10:02.233+0000 7f6d67d23800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:10:02.577 INFO:tasks.workunit.client.0.smithi050.stderr: -253> 2024-09-14T11:10:02.233+0000 7f6d67d23800 10 monclient(hunting): picked mon.noname-c con 0x55d12ecbe6e0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:10:02.577 INFO:tasks.workunit.client.0.smithi050.stderr: -252> 2024-09-14T11:10:02.233+0000 7f6d67d23800 10 monclient(hunting): picked mon.noname-b con 0x55d12ece9150 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:10:02.577 INFO:tasks.workunit.client.0.smithi050.stderr: -251> 2024-09-14T11:10:02.233+0000 7f6d67d23800 10 monclient(hunting): picked mon.noname-a con 0x55d12ecea500 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:10:02.577 INFO:tasks.workunit.client.0.smithi050.stderr: -250> 2024-09-14T11:10:02.233+0000 7f6d67d23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:02.577 INFO:tasks.workunit.client.0.smithi050.stderr: -249> 2024-09-14T11:10:02.233+0000 7f6d67d23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:02.578 INFO:tasks.workunit.client.0.smithi050.stderr: -248> 2024-09-14T11:10:02.233+0000 7f6d67d23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:02.578 INFO:tasks.workunit.client.0.smithi050.stderr: -247> 2024-09-14T11:10:02.233+0000 7f6d67d23800 10 monclient(hunting): _renew_subs 2024-09-14T11:10:02.578 INFO:tasks.workunit.client.0.smithi050.stderr: -246> 2024-09-14T11:10:02.233+0000 7f6d67d23800 10 monclient(hunting): authenticate will time out at 2254.870425s 2024-09-14T11:10:02.578 INFO:tasks.workunit.client.0.smithi050.stderr: -245> 2024-09-14T11:10:02.233+0000 7f6d63a0c640 10 monclient(hunting): get_auth_request con 0x55d12ecbe6e0 auth_method 0 2024-09-14T11:10:02.578 INFO:tasks.workunit.client.0.smithi050.stderr: -244> 2024-09-14T11:10:02.233+0000 7f6d63a0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:02.578 INFO:tasks.workunit.client.0.smithi050.stderr: -243> 2024-09-14T11:10:02.233+0000 7f6d63a0c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:02.578 INFO:tasks.workunit.client.0.smithi050.stderr: -242> 2024-09-14T11:10:02.233+0000 7f6d63a0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:02.578 INFO:tasks.workunit.client.0.smithi050.stderr: -241> 2024-09-14T11:10:02.233+0000 7f6d6420d640 10 monclient(hunting): get_auth_request con 0x55d12ecea500 auth_method 0 2024-09-14T11:10:02.578 INFO:tasks.workunit.client.0.smithi050.stderr: -240> 2024-09-14T11:10:02.233+0000 7f6d6420d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:02.578 INFO:tasks.workunit.client.0.smithi050.stderr: -239> 2024-09-14T11:10:02.233+0000 7f6d6420d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:02.578 INFO:tasks.workunit.client.0.smithi050.stderr: -238> 2024-09-14T11:10:02.233+0000 7f6d6420d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:02.578 INFO:tasks.workunit.client.0.smithi050.stderr: -237> 2024-09-14T11:10:02.233+0000 7f6d6320b640 10 monclient(hunting): get_auth_request con 0x55d12ece9150 auth_method 0 2024-09-14T11:10:02.578 INFO:tasks.workunit.client.0.smithi050.stderr: -236> 2024-09-14T11:10:02.233+0000 7f6d6320b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:02.579 INFO:tasks.workunit.client.0.smithi050.stderr: -235> 2024-09-14T11:10:02.233+0000 7f6d6320b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:02.579 INFO:tasks.workunit.client.0.smithi050.stderr: -234> 2024-09-14T11:10:02.233+0000 7f6d6320b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:02.579 INFO:tasks.workunit.client.0.smithi050.stderr: -233> 2024-09-14T11:10:02.233+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:02.579 INFO:tasks.workunit.client.0.smithi050.stderr: -232> 2024-09-14T11:10:02.233+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:02.579 INFO:tasks.workunit.client.0.smithi050.stderr: -231> 2024-09-14T11:10:02.233+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:02.579 INFO:tasks.workunit.client.0.smithi050.stderr: -230> 2024-09-14T11:10:02.233+0000 7f6d6420d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:02.579 INFO:tasks.workunit.client.0.smithi050.stderr: -229> 2024-09-14T11:10:02.233+0000 7f6d6420d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:02.579 INFO:tasks.workunit.client.0.smithi050.stderr: -228> 2024-09-14T11:10:02.233+0000 7f6d6420d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:02.579 INFO:tasks.workunit.client.0.smithi050.stderr: -227> 2024-09-14T11:10:02.233+0000 7f6d6320b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:02.579 INFO:tasks.workunit.client.0.smithi050.stderr: -226> 2024-09-14T11:10:02.233+0000 7f6d6320b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:02.579 INFO:tasks.workunit.client.0.smithi050.stderr: -225> 2024-09-14T11:10:02.233+0000 7f6d6320b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:02.579 INFO:tasks.workunit.client.0.smithi050.stderr: -224> 2024-09-14T11:10:02.233+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_done global_id 6290 payload 274 2024-09-14T11:10:02.579 INFO:tasks.workunit.client.0.smithi050.stderr: -223> 2024-09-14T11:10:02.233+0000 7f6d63a0c640 10 monclient: _finish_hunting 0 2024-09-14T11:10:02.579 INFO:tasks.workunit.client.0.smithi050.stderr: -222> 2024-09-14T11:10:02.233+0000 7f6d63a0c640 1 monclient: found mon.noname-c 2024-09-14T11:10:02.580 INFO:tasks.workunit.client.0.smithi050.stderr: -221> 2024-09-14T11:10:02.233+0000 7f6d63a0c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:10:02.580 INFO:tasks.workunit.client.0.smithi050.stderr: -220> 2024-09-14T11:10:02.234+0000 7f6c42ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:02.580 INFO:tasks.workunit.client.0.smithi050.stderr: -219> 2024-09-14T11:10:02.234+0000 7f6c42ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:10:02.580 INFO:tasks.workunit.client.0.smithi050.stderr: -218> 2024-09-14T11:10:02.234+0000 7f6c42ffd640 10 monclient: dump: 2024-09-14T11:10:02.580 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:02.580 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:02.580 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.580 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.580 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:02.580 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.580 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:02.580 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:02.580 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:02.581 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.581 INFO:tasks.workunit.client.0.smithi050.stderr: -217> 2024-09-14T11:10:02.234+0000 7f6c42ffd640 10 monclient: _finish_auth 0 2024-09-14T11:10:02.581 INFO:tasks.workunit.client.0.smithi050.stderr: -216> 2024-09-14T11:10:02.234+0000 7f6c42ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:10:02.581 INFO:tasks.workunit.client.0.smithi050.stderr: -215> 2024-09-14T11:10:02.234+0000 7f6c42ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:10:02.581 INFO:tasks.workunit.client.0.smithi050.stderr: -214> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 monclient: authenticate success, global_id 6290 2024-09-14T11:10:02.581 INFO:tasks.workunit.client.0.smithi050.stderr: -213> 2024-09-14T11:10:02.234+0000 7f6d67d23800 10 monclient: get_monmap_and_config success 2024-09-14T11:10:02.581 INFO:tasks.workunit.client.0.smithi050.stderr: -212> 2024-09-14T11:10:02.234+0000 7f6d67d23800 4 set_mon_vals no callback set 2024-09-14T11:10:02.581 INFO:tasks.workunit.client.0.smithi050.stderr: -211> 2024-09-14T11:10:02.234+0000 7f6c42ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:02.581 INFO:tasks.workunit.client.0.smithi050.stderr: -210> 2024-09-14T11:10:02.234+0000 7f6c42ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:10:02.581 INFO:tasks.workunit.client.0.smithi050.stderr: -209> 2024-09-14T11:10:02.234+0000 7f6c42ffd640 10 monclient: dump: 2024-09-14T11:10:02.581 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:02.581 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:02.581 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.582 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.582 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:02.582 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.582 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:02.582 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:02.582 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:02.582 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.582 INFO:tasks.workunit.client.0.smithi050.stderr: -208> 2024-09-14T11:10:02.234+0000 7f6d67d23800 10 monclient: shutdown 2024-09-14T11:10:02.582 INFO:tasks.workunit.client.0.smithi050.stderr: -207> 2024-09-14T11:10:02.234+0000 7f6d67d23800 10 monclient: build_initial_monmap 2024-09-14T11:10:02.582 INFO:tasks.workunit.client.0.smithi050.stderr: -206> 2024-09-14T11:10:02.234+0000 7f6d67d23800 1 build_initial for_mkfs: 0 2024-09-14T11:10:02.582 INFO:tasks.workunit.client.0.smithi050.stderr: -205> 2024-09-14T11:10:02.234+0000 7f6d67d23800 10 monclient: monmap: 2024-09-14T11:10:02.582 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:10:02.582 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:10:02.583 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:10:02.583 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:10:02.583 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:10:02.583 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.583 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:10:02.583 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:10:02.583 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:10:02.583 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.583 INFO:tasks.workunit.client.0.smithi050.stderr: -204> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding auth protocol: cephx 2024-09-14T11:10:02.583 INFO:tasks.workunit.client.0.smithi050.stderr: -203> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding auth protocol: cephx 2024-09-14T11:10:02.583 INFO:tasks.workunit.client.0.smithi050.stderr: -202> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding auth protocol: cephx 2024-09-14T11:10:02.583 INFO:tasks.workunit.client.0.smithi050.stderr: -201> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding con mode: secure 2024-09-14T11:10:02.583 INFO:tasks.workunit.client.0.smithi050.stderr: -200> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding con mode: crc 2024-09-14T11:10:02.584 INFO:tasks.workunit.client.0.smithi050.stderr: -199> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding con mode: secure 2024-09-14T11:10:02.584 INFO:tasks.workunit.client.0.smithi050.stderr: -198> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding con mode: crc 2024-09-14T11:10:02.584 INFO:tasks.workunit.client.0.smithi050.stderr: -197> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding con mode: secure 2024-09-14T11:10:02.584 INFO:tasks.workunit.client.0.smithi050.stderr: -196> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding con mode: crc 2024-09-14T11:10:02.584 INFO:tasks.workunit.client.0.smithi050.stderr: -195> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding con mode: crc 2024-09-14T11:10:02.584 INFO:tasks.workunit.client.0.smithi050.stderr: -194> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding con mode: secure 2024-09-14T11:10:02.584 INFO:tasks.workunit.client.0.smithi050.stderr: -193> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding con mode: crc 2024-09-14T11:10:02.584 INFO:tasks.workunit.client.0.smithi050.stderr: -192> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding con mode: secure 2024-09-14T11:10:02.584 INFO:tasks.workunit.client.0.smithi050.stderr: -191> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding con mode: crc 2024-09-14T11:10:02.584 INFO:tasks.workunit.client.0.smithi050.stderr: -190> 2024-09-14T11:10:02.234+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecbf2c0) adding con mode: secure 2024-09-14T11:10:02.584 INFO:tasks.workunit.client.0.smithi050.stderr: -189> 2024-09-14T11:10:02.235+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.584 INFO:tasks.workunit.client.0.smithi050.stderr: -188> 2024-09-14T11:10:02.235+0000 7f6d67d23800 1 librados: starting msgr at 2024-09-14T11:10:02.584 INFO:tasks.workunit.client.0.smithi050.stderr: -187> 2024-09-14T11:10:02.235+0000 7f6d67d23800 1 librados: starting objecter 2024-09-14T11:10:02.585 INFO:tasks.workunit.client.0.smithi050.stderr: -186> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command objecter_requests cmddesc objecter_requests hook 0x55d12ece8f80 EEXIST 2024-09-14T11:10:02.585 INFO:tasks.workunit.client.0.smithi050.stderr: -185> 2024-09-14T11:10:02.235+0000 7f6d67d23800 1 librados: setting wanted keys 2024-09-14T11:10:02.585 INFO:tasks.workunit.client.0.smithi050.stderr: -184> 2024-09-14T11:10:02.235+0000 7f6d67d23800 1 librados: calling monclient init 2024-09-14T11:10:02.585 INFO:tasks.workunit.client.0.smithi050.stderr: -183> 2024-09-14T11:10:02.235+0000 7f6d67d23800 10 monclient: init 2024-09-14T11:10:02.585 INFO:tasks.workunit.client.0.smithi050.stderr: -182> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding auth protocol: cephx 2024-09-14T11:10:02.585 INFO:tasks.workunit.client.0.smithi050.stderr: -181> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding auth protocol: cephx 2024-09-14T11:10:02.585 INFO:tasks.workunit.client.0.smithi050.stderr: -180> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding auth protocol: cephx 2024-09-14T11:10:02.585 INFO:tasks.workunit.client.0.smithi050.stderr: -179> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding con mode: secure 2024-09-14T11:10:02.585 INFO:tasks.workunit.client.0.smithi050.stderr: -178> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding con mode: crc 2024-09-14T11:10:02.585 INFO:tasks.workunit.client.0.smithi050.stderr: -177> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding con mode: secure 2024-09-14T11:10:02.585 INFO:tasks.workunit.client.0.smithi050.stderr: -176> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding con mode: crc 2024-09-14T11:10:02.585 INFO:tasks.workunit.client.0.smithi050.stderr: -175> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding con mode: secure 2024-09-14T11:10:02.586 INFO:tasks.workunit.client.0.smithi050.stderr: -174> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding con mode: crc 2024-09-14T11:10:02.586 INFO:tasks.workunit.client.0.smithi050.stderr: -173> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding con mode: crc 2024-09-14T11:10:02.586 INFO:tasks.workunit.client.0.smithi050.stderr: -172> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding con mode: secure 2024-09-14T11:10:02.586 INFO:tasks.workunit.client.0.smithi050.stderr: -171> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding con mode: crc 2024-09-14T11:10:02.586 INFO:tasks.workunit.client.0.smithi050.stderr: -170> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding con mode: secure 2024-09-14T11:10:02.586 INFO:tasks.workunit.client.0.smithi050.stderr: -169> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding con mode: crc 2024-09-14T11:10:02.586 INFO:tasks.workunit.client.0.smithi050.stderr: -168> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 AuthRegistry(0x55d12ecaefa0) adding con mode: secure 2024-09-14T11:10:02.586 INFO:tasks.workunit.client.0.smithi050.stderr: -167> 2024-09-14T11:10:02.235+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.586 INFO:tasks.workunit.client.0.smithi050.stderr: -166> 2024-09-14T11:10:02.235+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.586 INFO:tasks.workunit.client.0.smithi050.stderr: -165> 2024-09-14T11:10:02.235+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command rotate-key cmddesc rotate-key hook 0x55d12ecaf0e8 EEXIST 2024-09-14T11:10:02.586 INFO:tasks.workunit.client.0.smithi050.stderr: -164> 2024-09-14T11:10:02.235+0000 7f6d67d23800 10 monclient: _reopen_session rank -1 2024-09-14T11:10:02.586 INFO:tasks.workunit.client.0.smithi050.stderr: -163> 2024-09-14T11:10:02.235+0000 7f6d67d23800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:10:02.586 INFO:tasks.workunit.client.0.smithi050.stderr: -162> 2024-09-14T11:10:02.235+0000 7f6d67d23800 10 monclient(hunting): picked mon.noname-b con 0x55d12ecbe6e0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:10:02.587 INFO:tasks.workunit.client.0.smithi050.stderr: -161> 2024-09-14T11:10:02.235+0000 7f6d67d23800 10 monclient(hunting): picked mon.noname-c con 0x55d12ecea500 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:10:02.587 INFO:tasks.workunit.client.0.smithi050.stderr: -160> 2024-09-14T11:10:02.235+0000 7f6d67d23800 10 monclient(hunting): picked mon.noname-a con 0x55d12ece7250 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:10:02.587 INFO:tasks.workunit.client.0.smithi050.stderr: -159> 2024-09-14T11:10:02.235+0000 7f6d67d23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:02.587 INFO:tasks.workunit.client.0.smithi050.stderr: -158> 2024-09-14T11:10:02.235+0000 7f6d67d23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:02.587 INFO:tasks.workunit.client.0.smithi050.stderr: -157> 2024-09-14T11:10:02.235+0000 7f6d67d23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:02.587 INFO:tasks.workunit.client.0.smithi050.stderr: -156> 2024-09-14T11:10:02.235+0000 7f6d67d23800 10 monclient(hunting): _renew_subs 2024-09-14T11:10:02.587 INFO:tasks.workunit.client.0.smithi050.stderr: -155> 2024-09-14T11:10:02.235+0000 7f6d67d23800 10 monclient(hunting): authenticate will time out at 2254.872847s 2024-09-14T11:10:02.587 INFO:tasks.workunit.client.0.smithi050.stderr: -154> 2024-09-14T11:10:02.235+0000 7f6d6320b640 10 monclient(hunting): get_auth_request con 0x55d12ecea500 auth_method 0 2024-09-14T11:10:02.587 INFO:tasks.workunit.client.0.smithi050.stderr: -153> 2024-09-14T11:10:02.235+0000 7f6d6320b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:02.587 INFO:tasks.workunit.client.0.smithi050.stderr: -152> 2024-09-14T11:10:02.235+0000 7f6d6320b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:02.587 INFO:tasks.workunit.client.0.smithi050.stderr: -151> 2024-09-14T11:10:02.235+0000 7f6d6320b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:02.587 INFO:tasks.workunit.client.0.smithi050.stderr: -150> 2024-09-14T11:10:02.235+0000 7f6d6420d640 10 monclient(hunting): get_auth_request con 0x55d12ece7250 auth_method 0 2024-09-14T11:10:02.587 INFO:tasks.workunit.client.0.smithi050.stderr: -149> 2024-09-14T11:10:02.235+0000 7f6d6420d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:02.588 INFO:tasks.workunit.client.0.smithi050.stderr: -148> 2024-09-14T11:10:02.235+0000 7f6d6420d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:02.588 INFO:tasks.workunit.client.0.smithi050.stderr: -147> 2024-09-14T11:10:02.235+0000 7f6d6420d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:02.588 INFO:tasks.workunit.client.0.smithi050.stderr: -146> 2024-09-14T11:10:02.235+0000 7f6d63a0c640 10 monclient(hunting): get_auth_request con 0x55d12ecbe6e0 auth_method 0 2024-09-14T11:10:02.588 INFO:tasks.workunit.client.0.smithi050.stderr: -145> 2024-09-14T11:10:02.235+0000 7f6d63a0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:02.588 INFO:tasks.workunit.client.0.smithi050.stderr: -144> 2024-09-14T11:10:02.235+0000 7f6d63a0c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:02.588 INFO:tasks.workunit.client.0.smithi050.stderr: -143> 2024-09-14T11:10:02.235+0000 7f6d63a0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:02.588 INFO:tasks.workunit.client.0.smithi050.stderr: -142> 2024-09-14T11:10:02.236+0000 7f6d6320b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:02.588 INFO:tasks.workunit.client.0.smithi050.stderr: -141> 2024-09-14T11:10:02.236+0000 7f6d6320b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:02.588 INFO:tasks.workunit.client.0.smithi050.stderr: -140> 2024-09-14T11:10:02.236+0000 7f6d6320b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:02.588 INFO:tasks.workunit.client.0.smithi050.stderr: -139> 2024-09-14T11:10:02.236+0000 7f6d6420d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:02.588 INFO:tasks.workunit.client.0.smithi050.stderr: -138> 2024-09-14T11:10:02.236+0000 7f6d6420d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:02.588 INFO:tasks.workunit.client.0.smithi050.stderr: -137> 2024-09-14T11:10:02.236+0000 7f6d6420d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:02.588 INFO:tasks.workunit.client.0.smithi050.stderr: -136> 2024-09-14T11:10:02.236+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:02.589 INFO:tasks.workunit.client.0.smithi050.stderr: -135> 2024-09-14T11:10:02.236+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:02.589 INFO:tasks.workunit.client.0.smithi050.stderr: -134> 2024-09-14T11:10:02.236+0000 7f6d63a0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:02.589 INFO:tasks.workunit.client.0.smithi050.stderr: -133> 2024-09-14T11:10:02.236+0000 7f6d6420d640 10 monclient(hunting): handle_auth_done global_id 6693 payload 824 2024-09-14T11:10:02.589 INFO:tasks.workunit.client.0.smithi050.stderr: -132> 2024-09-14T11:10:02.236+0000 7f6d6420d640 10 monclient: _finish_hunting 0 2024-09-14T11:10:02.589 INFO:tasks.workunit.client.0.smithi050.stderr: -131> 2024-09-14T11:10:02.236+0000 7f6d6420d640 1 monclient: found mon.noname-a 2024-09-14T11:10:02.589 INFO:tasks.workunit.client.0.smithi050.stderr: -130> 2024-09-14T11:10:02.236+0000 7f6d6420d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:10:02.589 INFO:tasks.workunit.client.0.smithi050.stderr: -129> 2024-09-14T11:10:02.236+0000 7f6c417fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:02.589 INFO:tasks.workunit.client.0.smithi050.stderr: -128> 2024-09-14T11:10:02.236+0000 7f6c417fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:10:02.589 INFO:tasks.workunit.client.0.smithi050.stderr: -127> 2024-09-14T11:10:02.236+0000 7f6c417fa640 10 monclient: dump: 2024-09-14T11:10:02.589 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:02.589 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:02.589 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.589 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.589 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:02.590 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.590 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:02.590 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:02.590 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:02.590 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.590 INFO:tasks.workunit.client.0.smithi050.stderr: -126> 2024-09-14T11:10:02.236+0000 7f6c417fa640 10 monclient: _finish_auth 0 2024-09-14T11:10:02.590 INFO:tasks.workunit.client.0.smithi050.stderr: -125> 2024-09-14T11:10:02.236+0000 7f6c417fa640 10 monclient: _check_auth_tickets 2024-09-14T11:10:02.590 INFO:tasks.workunit.client.0.smithi050.stderr: -124> 2024-09-14T11:10:02.236+0000 7f6c417fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:10:02.590 INFO:tasks.workunit.client.0.smithi050.stderr: -123> 2024-09-14T11:10:02.236+0000 7f6c417fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:02.590 INFO:tasks.workunit.client.0.smithi050.stderr: -122> 2024-09-14T11:10:02.236+0000 7f6c417fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:10:02.590 INFO:tasks.workunit.client.0.smithi050.stderr: -121> 2024-09-14T11:10:02.236+0000 7f6c417fa640 10 monclient: dump: 2024-09-14T11:10:02.590 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:02.590 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:02.591 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.591 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:02.591 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:02.591 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:02.591 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:02.591 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:02.591 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:02.591 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.591 INFO:tasks.workunit.client.0.smithi050.stderr: -120> 2024-09-14T11:10:02.236+0000 7f6d67d23800 5 monclient: authenticate success, global_id 6693 2024-09-14T11:10:02.591 INFO:tasks.workunit.client.0.smithi050.stderr: -119> 2024-09-14T11:10:02.236+0000 7f6c42ffd640 4 set_mon_vals no callback set 2024-09-14T11:10:02.591 INFO:tasks.workunit.client.0.smithi050.stderr: -118> 2024-09-14T11:10:02.236+0000 7f6d67d23800 10 monclient: _renew_subs 2024-09-14T11:10:02.591 INFO:tasks.workunit.client.0.smithi050.stderr: -117> 2024-09-14T11:10:02.236+0000 7f6d67d23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:10:02.591 INFO:tasks.workunit.client.0.smithi050.stderr: -116> 2024-09-14T11:10:02.236+0000 7f6d67d23800 10 monclient: _renew_subs 2024-09-14T11:10:02.592 INFO:tasks.workunit.client.0.smithi050.stderr: -115> 2024-09-14T11:10:02.236+0000 7f6d67d23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:10:02.592 INFO:tasks.workunit.client.0.smithi050.stderr: -114> 2024-09-14T11:10:02.236+0000 7f6d67d23800 1 librados: init done 2024-09-14T11:10:02.592 INFO:tasks.workunit.client.0.smithi050.stderr: -113> 2024-09-14T11:10:02.236+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command cr dump hook 0x55d12ece0e88 2024-09-14T11:10:02.592 INFO:tasks.workunit.client.0.smithi050.stderr: -112> 2024-09-14T11:10:02.238+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.592 INFO:tasks.workunit.client.0.smithi050.stderr: -111> 2024-09-14T11:10:02.238+0000 7f6c417fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:10:02.592 INFO:tasks.workunit.client.0.smithi050.stderr: -110> 2024-09-14T11:10:02.238+0000 7f6c417fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:10:02.592 INFO:tasks.workunit.client.0.smithi050.stderr: -109> 2024-09-14T11:10:02.238+0000 7f6c417fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:10:02.592 INFO:tasks.workunit.client.0.smithi050.stderr: -108> 2024-09-14T11:10:02.238+0000 7f6d63a0c640 10 monclient: get_auth_request con 0x7f6c2c077230 auth_method 0 2024-09-14T11:10:02.592 INFO:tasks.workunit.client.0.smithi050.stderr: -107> 2024-09-14T11:10:02.238+0000 7f6d6320b640 10 monclient: get_auth_request con 0x55d12ed0a050 auth_method 0 2024-09-14T11:10:02.592 INFO:tasks.workunit.client.0.smithi050.stderr: -106> 2024-09-14T11:10:02.239+0000 7f6d67d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.592 INFO:tasks.workunit.client.0.smithi050.stderr: -105> 2024-09-14T11:10:02.239+0000 7f6d67d23800 20 realm 2024-09-14T11:10:02.592 INFO:tasks.workunit.client.0.smithi050.stderr: -104> 2024-09-14T11:10:02.239+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.592 INFO:tasks.workunit.client.0.smithi050.stderr: -103> 2024-09-14T11:10:02.239+0000 7f6d67d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.593 INFO:tasks.workunit.client.0.smithi050.stderr: -102> 2024-09-14T11:10:02.239+0000 7f6d67d23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:02.593 INFO:tasks.workunit.client.0.smithi050.stderr: -101> 2024-09-14T11:10:02.239+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.593 INFO:tasks.workunit.client.0.smithi050.stderr: -100> 2024-09-14T11:10:02.239+0000 7f6d67d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.593 INFO:tasks.workunit.client.0.smithi050.stderr: -99> 2024-09-14T11:10:02.239+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.593 INFO:tasks.workunit.client.0.smithi050.stderr: -98> 2024-09-14T11:10:02.239+0000 7f6d63a0c640 10 monclient: get_auth_request con 0x55d12ed0e2b0 auth_method 0 2024-09-14T11:10:02.593 INFO:tasks.workunit.client.0.smithi050.stderr: -97> 2024-09-14T11:10:02.240+0000 7f6d67d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:02.593 INFO:tasks.workunit.client.0.smithi050.stderr: -96> 2024-09-14T11:10:02.240+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.593 INFO:tasks.workunit.client.0.smithi050.stderr: -95> 2024-09-14T11:10:02.240+0000 7f6d6320b640 10 monclient: get_auth_request con 0x55d12ed11b10 auth_method 0 2024-09-14T11:10:02.593 INFO:tasks.workunit.client.0.smithi050.stderr: -94> 2024-09-14T11:10:02.241+0000 7f6d67d23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:02.593 INFO:tasks.workunit.client.0.smithi050.stderr: -93> 2024-09-14T11:10:02.241+0000 7f6d67d23800 20 searching for the correct realm 2024-09-14T11:10:02.593 INFO:tasks.workunit.client.0.smithi050.stderr: -92> 2024-09-14T11:10:02.241+0000 7f6d6420d640 10 monclient: get_auth_request con 0x55d12ed16850 auth_method 0 2024-09-14T11:10:02.593 INFO:tasks.workunit.client.0.smithi050.stderr: -91> 2024-09-14T11:10:02.242+0000 7f6d63a0c640 10 monclient: get_auth_request con 0x7f6d5c0ca0c0 auth_method 0 2024-09-14T11:10:02.594 INFO:tasks.workunit.client.0.smithi050.stderr: -90> 2024-09-14T11:10:02.243+0000 7f6d6320b640 0 -- 172.21.15.50:0/2702551086 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f6d5c0c0610 msgr2=0x7f6d5c0b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:02.594 INFO:tasks.workunit.client.0.smithi050.stderr: -89> 2024-09-14T11:10:02.444+0000 7f6d6320b640 10 monclient: get_auth_request con 0x7f6d5c0c0610 auth_method 0 2024-09-14T11:10:02.594 INFO:tasks.workunit.client.0.smithi050.stderr: -88> 2024-09-14T11:10:02.446+0000 7f6d6420d640 10 monclient: get_auth_request con 0x7f6d54059040 auth_method 0 2024-09-14T11:10:02.594 INFO:tasks.workunit.client.0.smithi050.stderr: -87> 2024-09-14T11:10:02.447+0000 7f6d63a0c640 10 monclient: get_auth_request con 0x7f6d5c0b69d0 auth_method 0 2024-09-14T11:10:02.594 INFO:tasks.workunit.client.0.smithi050.stderr: -86> 2024-09-14T11:10:02.448+0000 7f6d63a0c640 0 -- 172.21.15.50:0/2702551086 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f6d5c0b69d0 msgr2=0x7f6d5c003090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:02.594 INFO:tasks.workunit.client.0.smithi050.stderr: -85> 2024-09-14T11:10:02.448+0000 7f6c417fa640 1 client.6693.objecter ms_handle_reset 0x7f6d5c0b69d0 session 0x7f6d5c0b8240 osd.3 2024-09-14T11:10:02.594 INFO:tasks.workunit.client.0.smithi050.stderr: -84> 2024-09-14T11:10:02.448+0000 7f6c417fa640 10 monclient: _renew_subs 2024-09-14T11:10:02.594 INFO:tasks.workunit.client.0.smithi050.stderr: -83> 2024-09-14T11:10:02.448+0000 7f6c417fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:10:02.594 INFO:tasks.workunit.client.0.smithi050.stderr: -82> 2024-09-14T11:10:02.448+0000 7f6d63a0c640 10 monclient: get_auth_request con 0x7f6c2c0874e0 auth_method 0 2024-09-14T11:10:02.594 INFO:tasks.workunit.client.0.smithi050.stderr: -81> 2024-09-14T11:10:02.453+0000 7f6d67d23800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:10:02.594 INFO:tasks.workunit.client.0.smithi050.stderr: -80> 2024-09-14T11:10:02.453+0000 7f6d67d23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:02.594 INFO:tasks.workunit.client.0.smithi050.stderr: -79> 2024-09-14T11:10:02.453+0000 7f6d67d23800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:10:02.594 INFO:tasks.workunit.client.0.smithi050.stderr: -78> 2024-09-14T11:10:02.453+0000 7f6d67d23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:02.595 INFO:tasks.workunit.client.0.smithi050.stderr: -77> 2024-09-14T11:10:02.453+0000 7f6d67d23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:02.595 INFO:tasks.workunit.client.0.smithi050.stderr: -76> 2024-09-14T11:10:02.453+0000 7f6d67d23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:02.595 INFO:tasks.workunit.client.0.smithi050.stderr: -75> 2024-09-14T11:10:02.453+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.595 INFO:tasks.workunit.client.0.smithi050.stderr: -74> 2024-09-14T11:10:02.453+0000 7f6d67d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.595 INFO:tasks.workunit.client.0.smithi050.stderr: -73> 2024-09-14T11:10:02.453+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.595 INFO:tasks.workunit.client.0.smithi050.stderr: -72> 2024-09-14T11:10:02.454+0000 7f6d67d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:02.595 INFO:tasks.workunit.client.0.smithi050.stderr: -71> 2024-09-14T11:10:02.454+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.595 INFO:tasks.workunit.client.0.smithi050.stderr: -70> 2024-09-14T11:10:02.454+0000 7f6d67d23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:02.595 INFO:tasks.workunit.client.0.smithi050.stderr: -69> 2024-09-14T11:10:02.454+0000 7f6d67d23800 20 zone default found 2024-09-14T11:10:02.595 INFO:tasks.workunit.client.0.smithi050.stderr: -68> 2024-09-14T11:10:02.454+0000 7f6d67d23800 4 Realm: () 2024-09-14T11:10:02.595 INFO:tasks.workunit.client.0.smithi050.stderr: -67> 2024-09-14T11:10:02.454+0000 7f6d67d23800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:10:02.595 INFO:tasks.workunit.client.0.smithi050.stderr: -66> 2024-09-14T11:10:02.454+0000 7f6d67d23800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:10:02.595 INFO:tasks.workunit.client.0.smithi050.stderr: -65> 2024-09-14T11:10:02.454+0000 7f6d67d23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:02.596 INFO:tasks.workunit.client.0.smithi050.stderr: -64> 2024-09-14T11:10:02.454+0000 7f6d67d23800 20 zonegroup default 2024-09-14T11:10:02.596 INFO:tasks.workunit.client.0.smithi050.stderr: -63> 2024-09-14T11:10:02.454+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.596 INFO:tasks.workunit.client.0.smithi050.stderr: -62> 2024-09-14T11:10:02.454+0000 7f6d67d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.596 INFO:tasks.workunit.client.0.smithi050.stderr: -61> 2024-09-14T11:10:02.454+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.596 INFO:tasks.workunit.client.0.smithi050.stderr: -60> 2024-09-14T11:10:02.454+0000 7f6d67d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.596 INFO:tasks.workunit.client.0.smithi050.stderr: -59> 2024-09-14T11:10:02.455+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.596 INFO:tasks.workunit.client.0.smithi050.stderr: -58> 2024-09-14T11:10:02.455+0000 7f6d67d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.596 INFO:tasks.workunit.client.0.smithi050.stderr: -57> 2024-09-14T11:10:02.455+0000 7f6d67d23800 20 started sync module instance, tier type = 2024-09-14T11:10:02.596 INFO:tasks.workunit.client.0.smithi050.stderr: -56> 2024-09-14T11:10:02.455+0000 7f6d67d23800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:10:02.596 INFO:tasks.workunit.client.0.smithi050.stderr: -55> 2024-09-14T11:10:02.463+0000 7f6d67d23800 20 add_watcher() i=0 2024-09-14T11:10:02.596 INFO:tasks.workunit.client.0.smithi050.stderr: -54> 2024-09-14T11:10:02.463+0000 7f6d67d23800 20 add_watcher() i=1 2024-09-14T11:10:02.596 INFO:tasks.workunit.client.0.smithi050.stderr: -53> 2024-09-14T11:10:02.463+0000 7f6d67d23800 20 add_watcher() i=2 2024-09-14T11:10:02.596 INFO:tasks.workunit.client.0.smithi050.stderr: -52> 2024-09-14T11:10:02.463+0000 7f6d67d23800 20 add_watcher() i=3 2024-09-14T11:10:02.597 INFO:tasks.workunit.client.0.smithi050.stderr: -51> 2024-09-14T11:10:02.463+0000 7f6d67d23800 20 add_watcher() i=4 2024-09-14T11:10:02.597 INFO:tasks.workunit.client.0.smithi050.stderr: -50> 2024-09-14T11:10:02.463+0000 7f6d67d23800 20 add_watcher() i=5 2024-09-14T11:10:02.597 INFO:tasks.workunit.client.0.smithi050.stderr: -49> 2024-09-14T11:10:02.463+0000 7f6d67d23800 20 add_watcher() i=6 2024-09-14T11:10:02.597 INFO:tasks.workunit.client.0.smithi050.stderr: -48> 2024-09-14T11:10:02.464+0000 7f6d67d23800 20 add_watcher() i=7 2024-09-14T11:10:02.597 INFO:tasks.workunit.client.0.smithi050.stderr: -47> 2024-09-14T11:10:02.464+0000 7f6d67d23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:02.597 INFO:tasks.workunit.client.0.smithi050.stderr: -46> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding auth protocol: cephx 2024-09-14T11:10:02.597 INFO:tasks.workunit.client.0.smithi050.stderr: -45> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding auth protocol: cephx 2024-09-14T11:10:02.597 INFO:tasks.workunit.client.0.smithi050.stderr: -44> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding auth protocol: cephx 2024-09-14T11:10:02.597 INFO:tasks.workunit.client.0.smithi050.stderr: -43> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding con mode: secure 2024-09-14T11:10:02.597 INFO:tasks.workunit.client.0.smithi050.stderr: -42> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding con mode: crc 2024-09-14T11:10:02.597 INFO:tasks.workunit.client.0.smithi050.stderr: -41> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding con mode: secure 2024-09-14T11:10:02.597 INFO:tasks.workunit.client.0.smithi050.stderr: -40> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding con mode: crc 2024-09-14T11:10:02.597 INFO:tasks.workunit.client.0.smithi050.stderr: -39> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding con mode: secure 2024-09-14T11:10:02.598 INFO:tasks.workunit.client.0.smithi050.stderr: -38> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding con mode: crc 2024-09-14T11:10:02.598 INFO:tasks.workunit.client.0.smithi050.stderr: -37> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding con mode: crc 2024-09-14T11:10:02.598 INFO:tasks.workunit.client.0.smithi050.stderr: -36> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding con mode: secure 2024-09-14T11:10:02.598 INFO:tasks.workunit.client.0.smithi050.stderr: -35> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding con mode: crc 2024-09-14T11:10:02.598 INFO:tasks.workunit.client.0.smithi050.stderr: -34> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding con mode: secure 2024-09-14T11:10:02.598 INFO:tasks.workunit.client.0.smithi050.stderr: -33> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding con mode: crc 2024-09-14T11:10:02.598 INFO:tasks.workunit.client.0.smithi050.stderr: -32> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 AuthRegistry(0x7ffe20736860) adding con mode: secure 2024-09-14T11:10:02.598 INFO:tasks.workunit.client.0.smithi050.stderr: -31> 2024-09-14T11:10:02.466+0000 7f6c19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:02.598 INFO:tasks.workunit.client.0.smithi050.stderr: -30> 2024-09-14T11:10:02.466+0000 7f6d67d23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:02.598 INFO:tasks.workunit.client.0.smithi050.stderr: -29> 2024-09-14T11:10:02.466+0000 7f6d67d23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:02.598 INFO:tasks.workunit.client.0.smithi050.stderr: -28> 2024-09-14T11:10:02.466+0000 7f6d67d23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:02.598 INFO:tasks.workunit.client.0.smithi050.stderr: -27> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command cache list hook 0x55d12ece6bd0 2024-09-14T11:10:02.598 INFO:tasks.workunit.client.0.smithi050.stderr: -26> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command cache inspect hook 0x55d12ece6bd0 2024-09-14T11:10:02.599 INFO:tasks.workunit.client.0.smithi050.stderr: -25> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command cache erase hook 0x55d12ece6bd0 2024-09-14T11:10:02.599 INFO:tasks.workunit.client.0.smithi050.stderr: -24> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command cache zap hook 0x55d12ece6bd0 2024-09-14T11:10:02.599 INFO:tasks.workunit.client.0.smithi050.stderr: -23> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 note: GC not initialized 2024-09-14T11:10:02.599 INFO:tasks.workunit.client.0.smithi050.stderr: -22> 2024-09-14T11:10:02.466+0000 7f6c18fe1640 20 reqs_thread_entry: start 2024-09-14T11:10:02.599 INFO:tasks.workunit.client.0.smithi050.stderr: -21> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command sync trace show hook 0x7f6d5400e070 2024-09-14T11:10:02.599 INFO:tasks.workunit.client.0.smithi050.stderr: -20> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command sync trace history hook 0x7f6d5400e070 2024-09-14T11:10:02.599 INFO:tasks.workunit.client.0.smithi050.stderr: -19> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command sync trace active hook 0x7f6d5400e070 2024-09-14T11:10:02.599 INFO:tasks.workunit.client.0.smithi050.stderr: -18> 2024-09-14T11:10:02.466+0000 7f6d67d23800 5 asok(0x55d12e9fd270) register_command sync trace active_short hook 0x7f6d5400e070 2024-09-14T11:10:02.599 INFO:tasks.workunit.client.0.smithi050.stderr: -17> 2024-09-14T11:10:02.466+0000 7f6d67d23800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:02.599 INFO:tasks.workunit.client.0.smithi050.stderr: -16> 2024-09-14T11:10:02.467+0000 7f6d67d23800 20 Filter name: none 2024-09-14T11:10:02.599 INFO:tasks.workunit.client.0.smithi050.stderr: -15> 2024-09-14T11:10:02.467+0000 7f6b927fc640 20 reqs_thread_entry: start 2024-09-14T11:10:02.599 INFO:tasks.workunit.client.0.smithi050.stderr: -14> 2024-09-14T11:10:02.467+0000 7f6d67d23800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:10:02.599 INFO:tasks.workunit.client.0.smithi050.stderr: -13> 2024-09-14T11:10:02.467+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.600 INFO:tasks.workunit.client.0.smithi050.stderr: -12> 2024-09-14T11:10:02.467+0000 7f6d67d23800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:10:02.600 INFO:tasks.workunit.client.0.smithi050.stderr: -11> 2024-09-14T11:10:02.467+0000 7f6d67d23800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:10:02.600 INFO:tasks.workunit.client.0.smithi050.stderr: -10> 2024-09-14T11:10:02.467+0000 7f6d67d23800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:10:02.600 INFO:tasks.workunit.client.0.smithi050.stderr: -9> 2024-09-14T11:10:02.467+0000 7f6d67d23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 : miss 2024-09-14T11:10:02.600 INFO:tasks.workunit.client.0.smithi050.stderr: -8> 2024-09-14T11:10:02.467+0000 7f6d67d23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.600 INFO:tasks.workunit.client.0.smithi050.stderr: -7> 2024-09-14T11:10:02.467+0000 7f6d67d23800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:10:02.600 INFO:tasks.workunit.client.0.smithi050.stderr: -6> 2024-09-14T11:10:02.467+0000 7f6d67d23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 info.flags=0x17 2024-09-14T11:10:02.600 INFO:tasks.workunit.client.0.smithi050.stderr: -5> 2024-09-14T11:10:02.467+0000 7f6d67d23800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 to cache LRU end 2024-09-14T11:10:02.600 INFO:tasks.workunit.client.0.smithi050.stderr: -4> 2024-09-14T11:10:02.467+0000 7f6d67d23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:10:02.600 INFO:tasks.workunit.client.0.smithi050.stderr: -3> 2024-09-14T11:10:02.467+0000 7f6d67d23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:02.600 INFO:tasks.workunit.client.0.smithi050.stderr: -2> 2024-09-14T11:10:02.467+0000 7f6d67d23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 2024-09-14T11:10:02.600 INFO:tasks.workunit.client.0.smithi050.stderr: -1> 2024-09-14T11:10:02.472+0000 7f6d67d23800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6d67d23800 time 2024-09-14T11:10:02.472021+0000 2024-09-14T11:10:02.600 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:10:02.601 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.601 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:10:02.601 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6d6938c76a] 2024-09-14T11:10:02.601 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6d6938c928] 2024-09-14T11:10:02.601 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d12cefe0b1] 2024-09-14T11:10:02.601 INFO:tasks.workunit.client.0.smithi050.stderr: 4: radosgw-admin(+0xd88418) [0x55d12d411418] 2024-09-14T11:10:02.601 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d12cf0defd] 2024-09-14T11:10:02.601 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:10:02.601 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6d68029590] 2024-09-14T11:10:02.601 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:10:02.601 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:10:02.601 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.601 INFO:tasks.workunit.client.0.smithi050.stderr: 0> 2024-09-14T11:10:02.473+0000 7f6d67d23800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:10:02.602 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f6d67d23800 thread_name:radosgw-admin 2024-09-14T11:10:02.602 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.602 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:10:02.602 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6d6803e6f0] 2024-09-14T11:10:02.602 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6d6808b99c] 2024-09-14T11:10:02.602 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:10:02.602 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:10:02.602 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6d6938c7c4] 2024-09-14T11:10:02.602 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6d6938c928] 2024-09-14T11:10:02.602 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d12cefe0b1] 2024-09-14T11:10:02.602 INFO:tasks.workunit.client.0.smithi050.stderr: 8: radosgw-admin(+0xd88418) [0x55d12d411418] 2024-09-14T11:10:02.602 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d12cf0defd] 2024-09-14T11:10:02.602 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:10:02.603 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6d68029590] 2024-09-14T11:10:02.603 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:10:02.603 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:10:02.603 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:10:02.603 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.603 INFO:tasks.workunit.client.0.smithi050.stderr:--- logging levels --- 2024-09-14T11:10:02.603 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 none 2024-09-14T11:10:02.603 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 lockdep 2024-09-14T11:10:02.603 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 context 2024-09-14T11:10:02.603 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 crush 2024-09-14T11:10:02.603 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds 2024-09-14T11:10:02.603 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_balancer 2024-09-14T11:10:02.603 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_locker 2024-09-14T11:10:02.604 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log 2024-09-14T11:10:02.604 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log_expire 2024-09-14T11:10:02.604 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_migrator 2024-09-14T11:10:02.604 INFO:tasks.workunit.client.0.smithi050.stderr: 3/ 5 mds_quiesce 2024-09-14T11:10:02.604 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 buffer 2024-09-14T11:10:02.604 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 timer 2024-09-14T11:10:02.604 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 filer 2024-09-14T11:10:02.604 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 striper 2024-09-14T11:10:02.604 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 objecter 2024-09-14T11:10:02.604 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rados 2024-09-14T11:10:02.604 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd 2024-09-14T11:10:02.604 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_mirror 2024-09-14T11:10:02.604 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_replay 2024-09-14T11:10:02.604 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_pwl 2024-09-14T11:10:02.605 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 journaler 2024-09-14T11:10:02.605 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objectcacher 2024-09-14T11:10:02.605 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:10:02.605 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 client 2024-09-14T11:10:02.605 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 osd 2024-09-14T11:10:02.605 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 optracker 2024-09-14T11:10:02.605 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objclass 2024-09-14T11:10:02.605 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 filestore 2024-09-14T11:10:02.605 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 journal 2024-09-14T11:10:02.605 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 ms 2024-09-14T11:10:02.605 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mon 2024-09-14T11:10:02.605 INFO:tasks.workunit.client.0.smithi050.stderr: 0/10 monc 2024-09-14T11:10:02.605 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 paxos 2024-09-14T11:10:02.606 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 tp 2024-09-14T11:10:02.606 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 auth 2024-09-14T11:10:02.606 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 crypto 2024-09-14T11:10:02.606 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 finisher 2024-09-14T11:10:02.606 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 reserver 2024-09-14T11:10:02.606 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 heartbeatmap 2024-09-14T11:10:02.606 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 perfcounter 2024-09-14T11:10:02.606 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw 2024-09-14T11:10:02.606 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_sync 2024-09-14T11:10:02.606 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_datacache 2024-09-14T11:10:02.606 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_access 2024-09-14T11:10:02.606 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:10:02.606 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_flight 2024-09-14T11:10:02.606 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:10:02.607 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw_notification 2024-09-14T11:10:02.607 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 javaclient 2024-09-14T11:10:02.607 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 asok 2024-09-14T11:10:02.607 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 throttle 2024-09-14T11:10:02.607 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 refs 2024-09-14T11:10:02.607 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 compressor 2024-09-14T11:10:02.607 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluestore 2024-09-14T11:10:02.607 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluefs 2024-09-14T11:10:02.607 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 bdev 2024-09-14T11:10:02.607 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 kstore 2024-09-14T11:10:02.607 INFO:tasks.workunit.client.0.smithi050.stderr: 4/ 5 rocksdb 2024-09-14T11:10:02.607 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 fuse 2024-09-14T11:10:02.607 INFO:tasks.workunit.client.0.smithi050.stderr: 2/ 5 mgr 2024-09-14T11:10:02.607 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mgrc 2024-09-14T11:10:02.608 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 dpdk 2024-09-14T11:10:02.608 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 eventtrace 2024-09-14T11:10:02.608 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 prioritycache 2024-09-14T11:10:02.608 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 test 2024-09-14T11:10:02.608 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:10:02.608 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephsqlite 2024-09-14T11:10:02.608 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:10:02.608 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore 2024-09-14T11:10:02.608 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_onode 2024-09-14T11:10:02.608 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_odata 2024-09-14T11:10:02.608 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_omap 2024-09-14T11:10:02.608 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_tm 2024-09-14T11:10:02.608 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_t 2024-09-14T11:10:02.608 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:10:02.609 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_epm 2024-09-14T11:10:02.609 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_lba 2024-09-14T11:10:02.609 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:10:02.609 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cache 2024-09-14T11:10:02.609 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_journal 2024-09-14T11:10:02.609 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_device 2024-09-14T11:10:02.609 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_backref 2024-09-14T11:10:02.609 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 alienstore 2024-09-14T11:10:02.609 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mclock 2024-09-14T11:10:02.609 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cyanstore 2024-09-14T11:10:02.609 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 ceph_exporter 2024-09-14T11:10:02.609 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 memstore 2024-09-14T11:10:02.609 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 trace 2024-09-14T11:10:02.610 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 ceph_dedup 2024-09-14T11:10:02.610 INFO:tasks.workunit.client.0.smithi050.stderr: -2/-2 (syslog threshold) 2024-09-14T11:10:02.610 INFO:tasks.workunit.client.0.smithi050.stderr: 99/99 (stderr threshold) 2024-09-14T11:10:02.610 INFO:tasks.workunit.client.0.smithi050.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:10:02.610 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6b927fc640 / http_manager 2024-09-14T11:10:02.610 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6c18fe1640 / http_manager 2024-09-14T11:10:02.610 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6c19fe3640 / rgw_dt_lg_renew 2024-09-14T11:10:02.610 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6c417fa640 / ms_dispatch 2024-09-14T11:10:02.610 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6c42ffd640 / io_context_pool 2024-09-14T11:10:02.610 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6c497fa640 / ms_dispatch 2024-09-14T11:10:02.610 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6c4bfff640 / ms_dispatch 2024-09-14T11:10:02.610 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6c51e0b640 / io_context_pool 2024-09-14T11:10:02.610 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6d6320b640 / msgr-worker-2 2024-09-14T11:10:02.611 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6d63a0c640 / msgr-worker-1 2024-09-14T11:10:02.611 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6d6420d640 / msgr-worker-0 2024-09-14T11:10:02.611 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6d64a0e640 / io_context_pool 2024-09-14T11:10:02.611 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6d67d23800 / radosgw-admin 2024-09-14T11:10:02.611 INFO:tasks.workunit.client.0.smithi050.stderr: max_recent 500 2024-09-14T11:10:02.611 INFO:tasks.workunit.client.0.smithi050.stderr: max_new 1000 2024-09-14T11:10:02.611 INFO:tasks.workunit.client.0.smithi050.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:10:02.473709Z_aa2f7e13-a935-4fee-93b8-b7ae90dec9c4/log 2024-09-14T11:10:02.611 INFO:tasks.workunit.client.0.smithi050.stderr:--- end dump of recent events --- 2024-09-14T11:10:02.611 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:10:02.613 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:02.613 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:02.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.550+0000 7fa1e7a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.553+0000 7fa1e7a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.553+0000 7fa1e7a2f800 20 realm 2024-09-14T11:10:02.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.553+0000 7fa1e7a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.553+0000 7fa1e7a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.553+0000 7fa1e7a2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:02.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.553+0000 7fa1e7a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.553+0000 7fa1e7a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.553+0000 7fa1e7a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.554+0000 7fa1e7a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:02.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.554+0000 7fa1e7a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.554+0000 7fa1e7a2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:02.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.554+0000 7fa1e7a2f800 20 searching for the correct realm 2024-09-14T11:10:02.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.557+0000 7fa1e4d1f640 0 -- 172.21.15.50:0/2483886176 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fa1e00b3d10 msgr2=0x7fa1e007c840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:02.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.762+0000 7fa1e4d1f640 0 -- 172.21.15.50:0/2483886176 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55b3e6a5caf0 msgr2=0x55b3e6a5eee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:02.767 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.766+0000 7fa1e7a2f800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:10:02.767 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.766+0000 7fa1e7a2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:02.767 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.766+0000 7fa1e7a2f800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:10:02.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.766+0000 7fa1e7a2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:02.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.766+0000 7fa1e7a2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:02.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.766+0000 7fa1e7a2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:02.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.766+0000 7fa1e7a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.766+0000 7fa1e7a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.766+0000 7fa1e7a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.767+0000 7fa1e7a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:02.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.767+0000 7fa1e7a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.767+0000 7fa1e7a2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:02.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.768+0000 7fa1e7a2f800 20 zone default found 2024-09-14T11:10:02.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.768+0000 7fa1e7a2f800 4 Realm: () 2024-09-14T11:10:02.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.768+0000 7fa1e7a2f800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:10:02.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.768+0000 7fa1e7a2f800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:10:02.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.768+0000 7fa1e7a2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:02.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.768+0000 7fa1e7a2f800 20 zonegroup default 2024-09-14T11:10:02.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.768+0000 7fa1e7a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.768+0000 7fa1e7a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.768+0000 7fa1e7a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.768+0000 7fa1e7a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.768+0000 7fa1e7a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.771 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.768+0000 7fa1e7a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.771 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.768+0000 7fa1e7a2f800 20 started sync module instance, tier type = 2024-09-14T11:10:02.771 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.768+0000 7fa1e7a2f800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:10:02.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.777+0000 7fa1e7a2f800 20 add_watcher() i=0 2024-09-14T11:10:02.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.777+0000 7fa1e7a2f800 20 add_watcher() i=1 2024-09-14T11:10:02.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.777+0000 7fa1e7a2f800 20 add_watcher() i=2 2024-09-14T11:10:02.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.777+0000 7fa1e7a2f800 20 add_watcher() i=3 2024-09-14T11:10:02.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.777+0000 7fa1e7a2f800 20 add_watcher() i=4 2024-09-14T11:10:02.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.777+0000 7fa1e7a2f800 20 add_watcher() i=5 2024-09-14T11:10:02.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.777+0000 7fa1e7a2f800 20 add_watcher() i=6 2024-09-14T11:10:02.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.778+0000 7fa1e7a2f800 20 add_watcher() i=7 2024-09-14T11:10:02.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.778+0000 7fa1e7a2f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:02.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.779+0000 7fa09bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:02.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.780+0000 7fa1e7a2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:02.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.780+0000 7fa1e7a2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:02.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.780+0000 7fa1e7a2f800 5 note: GC not initialized 2024-09-14T11:10:02.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.780+0000 7fa09afe5640 20 reqs_thread_entry: start 2024-09-14T11:10:02.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.780+0000 7fa1e7a2f800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:02.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.780+0000 7fa1e7a2f800 20 Filter name: none 2024-09-14T11:10:02.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.780+0000 7fa098fe1640 20 reqs_thread_entry: start 2024-09-14T11:10:02.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.780+0000 7fa1e7a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.781+0000 7fa1e7a2f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:10:02.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.781+0000 7fa1e7a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.781+0000 7fa1e7a2f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:10:02.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.781+0000 7fa1e7a2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:02.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.781+0000 7fa1e7a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.781+0000 7fa1e7a2f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:10:02.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.781+0000 7fa1e7a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.782+0000 7fa1e7a2f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:10:02.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.782+0000 7fa1e7a2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:02.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.783+0000 7fa09bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:02.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.786+0000 7fa1e7a2f800 20 remove_watcher() i=0 2024-09-14T11:10:02.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.786+0000 7fa1e7a2f800 2 removed watcher, disabling cache 2024-09-14T11:10:02.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.787+0000 7fa1e7a2f800 20 remove_watcher() i=1 2024-09-14T11:10:02.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.788+0000 7fa1e7a2f800 20 remove_watcher() i=2 2024-09-14T11:10:02.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.789+0000 7fa1e7a2f800 20 remove_watcher() i=3 2024-09-14T11:10:02.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.790+0000 7fa1e7a2f800 20 remove_watcher() i=4 2024-09-14T11:10:02.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.791+0000 7fa1e7a2f800 20 remove_watcher() i=5 2024-09-14T11:10:02.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.792+0000 7fa1e7a2f800 20 remove_watcher() i=6 2024-09-14T11:10:02.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.793+0000 7fa1e7a2f800 20 remove_watcher() i=7 2024-09-14T11:10:02.802 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.802 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:10:02.803 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: abort-at-set-target-layout id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:10:02.803 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:02.805 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:02.805 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:02.840 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:02.840 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:02.898 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:10:02.930 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:02.930 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:02.970 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.972+0000 7fd273535800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.973+0000 7fd273535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.973+0000 7fd273535800 20 realm 2024-09-14T11:10:02.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.973+0000 7fd273535800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.973+0000 7fd273535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.973+0000 7fd273535800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:02.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.973+0000 7fd273535800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.973+0000 7fd273535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.973+0000 7fd273535800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.974+0000 7fd273535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:02.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.974+0000 7fd273535800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.975+0000 7fd273535800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:02.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.975+0000 7fd273535800 20 searching for the correct realm 2024-09-14T11:10:02.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.978+0000 7fd26fa22640 0 -- 172.21.15.50:0/536671870 >> [v2:172.21.15.118:6816/4154782182,v1:172.21.15.118:6817/4154782182] conn(0x5610cd8788f0 msgr2=0x5610cd87adb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:02.978 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:02.980+0000 7fd26f221640 0 -- 172.21.15.50:0/536671870 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7fd268043420 msgr2=0x7fd2680438a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:03.185 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.187+0000 7fd273535800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:10:03.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.187+0000 7fd273535800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:03.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.187+0000 7fd273535800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:10:03.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.187+0000 7fd273535800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:03.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.187+0000 7fd273535800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:03.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.187+0000 7fd273535800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:03.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.187+0000 7fd273535800 20 rados->read ofs=0 len=0 2024-09-14T11:10:03.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.187+0000 7fd273535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:03.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.187+0000 7fd273535800 20 rados->read ofs=0 len=0 2024-09-14T11:10:03.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.188+0000 7fd273535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:03.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.188+0000 7fd273535800 20 rados->read ofs=0 len=0 2024-09-14T11:10:03.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.189+0000 7fd273535800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:03.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.189+0000 7fd273535800 20 zone default found 2024-09-14T11:10:03.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.189+0000 7fd273535800 4 Realm: () 2024-09-14T11:10:03.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.189+0000 7fd273535800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:10:03.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.189+0000 7fd273535800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:10:03.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.189+0000 7fd273535800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:03.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.189+0000 7fd273535800 20 zonegroup default 2024-09-14T11:10:03.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.189+0000 7fd273535800 20 rados->read ofs=0 len=0 2024-09-14T11:10:03.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.189+0000 7fd273535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:03.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.189+0000 7fd273535800 20 rados->read ofs=0 len=0 2024-09-14T11:10:03.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.189+0000 7fd273535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:03.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.189+0000 7fd273535800 20 rados->read ofs=0 len=0 2024-09-14T11:10:03.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.189+0000 7fd273535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:03.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.189+0000 7fd273535800 20 started sync module instance, tier type = 2024-09-14T11:10:03.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.189+0000 7fd273535800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:10:03.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.198+0000 7fd273535800 20 add_watcher() i=0 2024-09-14T11:10:03.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.198+0000 7fd273535800 20 add_watcher() i=1 2024-09-14T11:10:03.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.198+0000 7fd273535800 20 add_watcher() i=2 2024-09-14T11:10:03.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.198+0000 7fd273535800 20 add_watcher() i=3 2024-09-14T11:10:03.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.198+0000 7fd273535800 20 add_watcher() i=4 2024-09-14T11:10:03.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.198+0000 7fd273535800 20 add_watcher() i=5 2024-09-14T11:10:03.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.198+0000 7fd273535800 20 add_watcher() i=6 2024-09-14T11:10:03.197 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.199+0000 7fd273535800 20 add_watcher() i=7 2024-09-14T11:10:03.197 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.199+0000 7fd273535800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:03.199 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.200+0000 7fd125fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:03.199 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.201+0000 7fd273535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:03.199 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.201+0000 7fd273535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:03.199 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.201+0000 7fd273535800 5 note: GC not initialized 2024-09-14T11:10:03.199 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.201+0000 7fd124fe1640 20 reqs_thread_entry: start 2024-09-14T11:10:03.200 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.201+0000 7fd273535800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:03.200 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.201+0000 7fd273535800 20 Filter name: none 2024-09-14T11:10:03.200 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.201+0000 7fd09e7fc640 20 reqs_thread_entry: start 2024-09-14T11:10:03.200 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.201+0000 7fd273535800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:10:03.200 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.201+0000 7fd273535800 20 rados->read ofs=0 len=0 2024-09-14T11:10:03.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.202+0000 7fd273535800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:10:03.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.202+0000 7fd273535800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:10:03.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.202+0000 7fd273535800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:10:03.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.202+0000 7fd273535800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 : miss 2024-09-14T11:10:03.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.202+0000 7fd273535800 20 rados->read ofs=0 len=0 2024-09-14T11:10:03.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.202+0000 7fd273535800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:10:03.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.202+0000 7fd273535800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 info.flags=0x17 2024-09-14T11:10:03.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.202+0000 7fd273535800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 to cache LRU end 2024-09-14T11:10:03.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.202+0000 7fd273535800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:10:03.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.202+0000 7fd273535800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:03.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.202+0000 7fd273535800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 2024-09-14T11:10:03.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.203+0000 7fd273535800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 to be held by another RGW process; skipping for now 2024-09-14T11:10:03.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.204+0000 7fd125fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:03.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.206+0000 7fd273535800 20 remove_watcher() i=0 2024-09-14T11:10:03.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.206+0000 7fd273535800 2 removed watcher, disabling cache 2024-09-14T11:10:03.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.207+0000 7fd273535800 20 remove_watcher() i=1 2024-09-14T11:10:03.206 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.208+0000 7fd273535800 20 remove_watcher() i=2 2024-09-14T11:10:03.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.209+0000 7fd273535800 20 remove_watcher() i=3 2024-09-14T11:10:03.208 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.210+0000 7fd273535800 20 remove_watcher() i=4 2024-09-14T11:10:03.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.211+0000 7fd273535800 20 remove_watcher() i=5 2024-09-14T11:10:03.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.212+0000 7fd273535800 20 remove_watcher() i=6 2024-09-14T11:10:03.211 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:03.213+0000 7fd273535800 20 remove_watcher() i=7 2024-09-14T11:10:03.222 INFO:tasks.workunit.client.0.smithi050.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:10:33.226 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:10:33.265 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:33.265 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:33.311 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.313+0000 7f517fd39800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.313 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.315+0000 7f517fd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:33.313 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.315+0000 7f517fd39800 20 realm 2024-09-14T11:10:33.313 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.315+0000 7f517fd39800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.313 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.315+0000 7f517fd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:33.313 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.315+0000 7f517fd39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:33.313 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.315+0000 7f517fd39800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.314 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.315+0000 7f517fd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:33.314 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.315+0000 7f517fd39800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.314 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.316+0000 7f517fd39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:33.314 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.316+0000 7f517fd39800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.315 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.317+0000 7f517fd39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:33.315 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.317+0000 7f517fd39800 20 searching for the correct realm 2024-09-14T11:10:33.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.320+0000 7f517b224640 0 -- 172.21.15.50:0/4176348327 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f517401a040 msgr2=0x7f517402b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:33.525 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.527+0000 7f517c226640 0 -- 172.21.15.50:0/4176348327 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5570202c5bf0 msgr2=0x5570202c8030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:33.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.532+0000 7f517fd39800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:10:33.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.532+0000 7f517fd39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:33.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.532+0000 7f517fd39800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:10:33.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.532+0000 7f517fd39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:33.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.532+0000 7f517fd39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:33.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.532+0000 7f517fd39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:33.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.532+0000 7f517fd39800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.532+0000 7f517fd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:33.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.532+0000 7f517fd39800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.533+0000 7f517fd39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:33.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.533+0000 7f517fd39800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.533+0000 7f517fd39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:33.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.533+0000 7f517fd39800 20 zone default found 2024-09-14T11:10:33.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.533+0000 7f517fd39800 4 Realm: () 2024-09-14T11:10:33.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.533+0000 7f517fd39800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:10:33.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.533+0000 7f517fd39800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:10:33.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.533+0000 7f517fd39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:33.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.533+0000 7f517fd39800 20 zonegroup default 2024-09-14T11:10:33.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.533+0000 7f517fd39800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.533+0000 7f517fd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:33.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.533+0000 7f517fd39800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.534+0000 7f517fd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:33.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.534+0000 7f517fd39800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.534+0000 7f517fd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:33.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.534+0000 7f517fd39800 20 started sync module instance, tier type = 2024-09-14T11:10:33.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.534+0000 7f517fd39800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:10:33.543 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.544+0000 7f517fd39800 20 add_watcher() i=0 2024-09-14T11:10:33.543 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.544+0000 7f517fd39800 20 add_watcher() i=1 2024-09-14T11:10:33.543 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.544+0000 7f517fd39800 20 add_watcher() i=2 2024-09-14T11:10:33.543 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.544+0000 7f517fd39800 20 add_watcher() i=3 2024-09-14T11:10:33.543 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.544+0000 7f517fd39800 20 add_watcher() i=4 2024-09-14T11:10:33.543 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.544+0000 7f517fd39800 20 add_watcher() i=5 2024-09-14T11:10:33.543 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.544+0000 7f517fd39800 20 add_watcher() i=6 2024-09-14T11:10:33.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.546+0000 7f517fd39800 20 add_watcher() i=7 2024-09-14T11:10:33.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.546+0000 7f517fd39800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:33.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.548+0000 7f5031fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:33.547 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.548+0000 7f517fd39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:33.547 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.548+0000 7f517fd39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:33.547 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.548+0000 7f517fd39800 5 note: GC not initialized 2024-09-14T11:10:33.547 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.548+0000 7f5030fe1640 20 reqs_thread_entry: start 2024-09-14T11:10:33.547 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.548+0000 7f517fd39800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:33.547 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.548+0000 7f517fd39800 20 Filter name: none 2024-09-14T11:10:33.547 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.549+0000 7f4faa7fc640 20 reqs_thread_entry: start 2024-09-14T11:10:33.547 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.549+0000 7f517fd39800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:10:33.547 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.549+0000 7f517fd39800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.548 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.549+0000 7f517fd39800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:10:33.548 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.549+0000 7f517fd39800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:10:33.548 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.549+0000 7f517fd39800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:10:33.548 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.549+0000 7f517fd39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 : miss 2024-09-14T11:10:33.548 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.549+0000 7f517fd39800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.550+0000 7f517fd39800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:10:33.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.550+0000 7f517fd39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 info.flags=0x17 2024-09-14T11:10:33.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.550+0000 7f517fd39800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 to cache LRU end 2024-09-14T11:10:33.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.550+0000 7f517fd39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:10:33.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.550+0000 7f517fd39800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:33.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.550+0000 7f517fd39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 2024-09-14T11:10:33.553 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.555+0000 7f517fd39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 info.flags=0x17 2024-09-14T11:10:33.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.555+0000 7f517fd39800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 to cache LRU end 2024-09-14T11:10:33.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.555+0000 7f517fd39800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:33.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.555+0000 7f517fd39800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25, ofs0, ns] 2024-09-14T11:10:33.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.556+0000 7f505a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497068 cookie 93940064484160 notifier 6347 bl.length()=1009 2024-09-14T11:10:33.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.556+0000 7f505a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 info.flags=0x17 2024-09-14T11:10:33.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.556+0000 7f505a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 to cache LRU end 2024-09-14T11:10:33.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.556+0000 7f505a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:33.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.558+0000 7f517fd39800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25]): orig_sources= new_sources= 2024-09-14T11:10:33.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.558+0000 7f517fd39800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25]): potential sources added=[] removed=[] 2024-09-14T11:10:33.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.558+0000 7f517fd39800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25]): orig_dests= new_dests= 2024-09-14T11:10:33.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.558+0000 7f517fd39800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25]): potential dests added=[] removed=[] 2024-09-14T11:10:33.562 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1.0 2024-09-14T11:10:33.562 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1.0 2024-09-14T11:10:33.562 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1.1 2024-09-14T11:10:33.562 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1.1 2024-09-14T11:10:33.562 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1.2 2024-09-14T11:10:33.562 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1.2 2024-09-14T11:10:33.562 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1.3 2024-09-14T11:10:33.562 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1.3 2024-09-14T11:10:33.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1.4 2024-09-14T11:10:33.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1.4 2024-09-14T11:10:33.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1.5 2024-09-14T11:10:33.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1.5 2024-09-14T11:10:33.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1.6 2024-09-14T11:10:33.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1.6 2024-09-14T11:10:33.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1.7 2024-09-14T11:10:33.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1.7 2024-09-14T11:10:33.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1.8 2024-09-14T11:10:33.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1.8 2024-09-14T11:10:33.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1.9 2024-09-14T11:10:33.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1.9 2024-09-14T11:10:33.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1.10 2024-09-14T11:10:33.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1.10 2024-09-14T11:10:33.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1.11 2024-09-14T11:10:33.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1.11 2024-09-14T11:10:33.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.0 2024-09-14T11:10:33.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.564+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1 2024-09-14T11:10:33.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.565+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.2 2024-09-14T11:10:33.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.565+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.3 2024-09-14T11:10:33.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.566+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.4 2024-09-14T11:10:33.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.566+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.5 2024-09-14T11:10:33.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.567+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.6 2024-09-14T11:10:33.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.567+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.7 2024-09-14T11:10:33.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.568+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.8 2024-09-14T11:10:33.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.568+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.9 2024-09-14T11:10:33.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.569+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.10 2024-09-14T11:10:33.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.573+0000 7f517fd39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:10:33.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.573+0000 7f517fd39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 2024-09-14T11:10:33.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.574+0000 7f517fd39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 info.flags=0x17 2024-09-14T11:10:33.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.574+0000 7f517fd39800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 to cache LRU end 2024-09-14T11:10:33.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.574+0000 7f517fd39800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:33.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.574+0000 7f517fd39800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25, ofs0, ns] 2024-09-14T11:10:33.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.575+0000 7f505affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497069 cookie 93940064484160 notifier 6347 bl.length()=1009 2024-09-14T11:10:33.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.575+0000 7f505affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 info.flags=0x17 2024-09-14T11:10:33.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.575+0000 7f505affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 to cache LRU end 2024-09-14T11:10:33.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.575+0000 7f505affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:33.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.576+0000 7f517fd39800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25]): orig_sources= new_sources= 2024-09-14T11:10:33.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.576+0000 7f517fd39800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25]): potential sources added=[] removed=[] 2024-09-14T11:10:33.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.576+0000 7f517fd39800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25]): orig_dests= new_dests= 2024-09-14T11:10:33.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.576+0000 7f517fd39800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25]): potential dests added=[] removed=[] 2024-09-14T11:10:33.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.579+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.0 2024-09-14T11:10:33.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.580+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.1 2024-09-14T11:10:33.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.580+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.2 2024-09-14T11:10:33.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.580+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.3 2024-09-14T11:10:33.579 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.581+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.4 2024-09-14T11:10:33.579 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.581+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.5 2024-09-14T11:10:33.579 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.581+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.6 2024-09-14T11:10:33.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.582+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.7 2024-09-14T11:10:33.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.582+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.8 2024-09-14T11:10:33.581 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.582+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.9 2024-09-14T11:10:33.581 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.583+0000 7f517fd39800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25.10 2024-09-14T11:10:33.581 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.583+0000 7f517fd39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:10:33.581 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.583+0000 7f517fd39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 2024-09-14T11:10:33.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.584+0000 7f517fd39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 info.flags=0x17 2024-09-14T11:10:33.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.584+0000 7f517fd39800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 to cache LRU end 2024-09-14T11:10:33.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.584+0000 7f517fd39800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:33.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.584+0000 7f517fd39800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25, ofs0, ns] 2024-09-14T11:10:33.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.585+0000 7f505a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497070 cookie 93940064484160 notifier 6347 bl.length()=977 2024-09-14T11:10:33.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.585+0000 7f505a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 info.flags=0x17 2024-09-14T11:10:33.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.585+0000 7f505a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 to cache LRU end 2024-09-14T11:10:33.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.585+0000 7f505a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:33.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.586+0000 7f517fd39800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25]): orig_sources= new_sources= 2024-09-14T11:10:33.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.586+0000 7f517fd39800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25]): potential sources added=[] removed=[] 2024-09-14T11:10:33.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.586+0000 7f517fd39800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25]): orig_dests= new_dests= 2024-09-14T11:10:33.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.586+0000 7f517fd39800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25]): potential dests added=[] removed=[] 2024-09-14T11:10:33.587 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.589+0000 7f517fd39800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:10:33.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.591+0000 7f5031fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:33.591 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.593+0000 7f517fd39800 20 remove_watcher() i=0 2024-09-14T11:10:33.592 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.593+0000 7f517fd39800 2 removed watcher, disabling cache 2024-09-14T11:10:33.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.595+0000 7f517fd39800 20 remove_watcher() i=1 2024-09-14T11:10:33.594 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.596+0000 7f517fd39800 20 remove_watcher() i=2 2024-09-14T11:10:33.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.597+0000 7f517fd39800 20 remove_watcher() i=3 2024-09-14T11:10:33.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.598+0000 7f517fd39800 20 remove_watcher() i=4 2024-09-14T11:10:33.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.599+0000 7f517fd39800 20 remove_watcher() i=5 2024-09-14T11:10:33.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.600+0000 7f517fd39800 20 remove_watcher() i=6 2024-09-14T11:10:33.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.601+0000 7f517fd39800 20 remove_watcher() i=7 2024-09-14T11:10:33.613 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:10:33.643 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:33.644 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:33.684 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.686+0000 7feb88322800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.686 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.688+0000 7feb88322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:33.686 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.688+0000 7feb88322800 20 realm 2024-09-14T11:10:33.686 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.688+0000 7feb88322800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.686 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.688+0000 7feb88322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:33.686 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.688+0000 7feb88322800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:33.686 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.688+0000 7feb88322800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.686 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.688+0000 7feb88322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:33.687 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.688+0000 7feb88322800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.687 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.689+0000 7feb88322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:33.687 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.689+0000 7feb88322800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.688 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.690+0000 7feb88322800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:33.688 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.690+0000 7feb88322800 20 searching for the correct realm 2024-09-14T11:10:33.690 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.692+0000 7feb837d1640 0 -- 172.21.15.50:0/225771950 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7feb7c0ad2f0 msgr2=0x7feb7c0c1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:33.895 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.897+0000 7feb847d3640 0 -- 172.21.15.50:0/225771950 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55e10f44f4e0 msgr2=0x55e10f451930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:33.900 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.902+0000 7feb88322800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:10:33.900 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.902+0000 7feb88322800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:33.900 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.902+0000 7feb88322800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:10:33.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.902+0000 7feb88322800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:33.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.902+0000 7feb88322800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:33.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.902+0000 7feb88322800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:33.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.902+0000 7feb88322800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.902+0000 7feb88322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:33.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.902+0000 7feb88322800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.902+0000 7feb88322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:33.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.902+0000 7feb88322800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.903+0000 7feb88322800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:33.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.903+0000 7feb88322800 20 zone default found 2024-09-14T11:10:33.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.903+0000 7feb88322800 4 Realm: () 2024-09-14T11:10:33.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.903+0000 7feb88322800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:10:33.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.903+0000 7feb88322800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:10:33.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.903+0000 7feb88322800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:33.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.903+0000 7feb88322800 20 zonegroup default 2024-09-14T11:10:33.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.903+0000 7feb88322800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.903+0000 7feb88322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:33.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.903+0000 7feb88322800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.903+0000 7feb88322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:33.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.903+0000 7feb88322800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.904+0000 7feb88322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:33.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.904+0000 7feb88322800 20 started sync module instance, tier type = 2024-09-14T11:10:33.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.904+0000 7feb88322800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:10:33.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.913+0000 7feb88322800 20 add_watcher() i=0 2024-09-14T11:10:33.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.913+0000 7feb88322800 20 add_watcher() i=1 2024-09-14T11:10:33.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.913+0000 7feb88322800 20 add_watcher() i=2 2024-09-14T11:10:33.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.913+0000 7feb88322800 20 add_watcher() i=3 2024-09-14T11:10:33.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.913+0000 7feb88322800 20 add_watcher() i=4 2024-09-14T11:10:33.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.913+0000 7feb88322800 20 add_watcher() i=5 2024-09-14T11:10:33.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.913+0000 7feb88322800 20 add_watcher() i=6 2024-09-14T11:10:33.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.914+0000 7feb88322800 20 add_watcher() i=7 2024-09-14T11:10:33.913 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.914+0000 7feb88322800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:33.914 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.916+0000 7fea39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:33.915 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.916+0000 7feb88322800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:33.915 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.916+0000 7feb88322800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:33.915 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.917+0000 7feb88322800 5 note: GC not initialized 2024-09-14T11:10:33.915 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.917+0000 7fea38fe1640 20 reqs_thread_entry: start 2024-09-14T11:10:33.915 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.917+0000 7feb88322800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:33.916 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.917+0000 7feb88322800 20 Filter name: none 2024-09-14T11:10:33.916 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.917+0000 7fe9b27fc640 20 reqs_thread_entry: start 2024-09-14T11:10:33.916 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.917+0000 7feb88322800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.916 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.918+0000 7feb88322800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:10:33.916 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.918+0000 7feb88322800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.918+0000 7feb88322800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:10:33.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.918+0000 7feb88322800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:33.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.918+0000 7feb88322800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.918+0000 7feb88322800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:10:33.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.918+0000 7feb88322800 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.919+0000 7feb88322800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:10:33.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.919+0000 7feb88322800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:33.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.920+0000 7fea39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:33.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.923+0000 7feb88322800 20 remove_watcher() i=0 2024-09-14T11:10:33.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.923+0000 7feb88322800 2 removed watcher, disabling cache 2024-09-14T11:10:33.922 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.924+0000 7feb88322800 20 remove_watcher() i=1 2024-09-14T11:10:33.923 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.925+0000 7feb88322800 20 remove_watcher() i=2 2024-09-14T11:10:33.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.926+0000 7feb88322800 20 remove_watcher() i=3 2024-09-14T11:10:33.925 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.927+0000 7feb88322800 20 remove_watcher() i=4 2024-09-14T11:10:33.926 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.928+0000 7feb88322800 20 remove_watcher() i=5 2024-09-14T11:10:33.927 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.929+0000 7feb88322800 20 remove_watcher() i=6 2024-09-14T11:10:33.929 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:33.931+0000 7feb88322800 20 remove_watcher() i=7 2024-09-14T11:10:33.940 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:33.940 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:10:33.940 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: abort-at-set-target-layout id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:10:33.940 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:33.942 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:33.942 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:33.963 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:33.963 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:34.190 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:34.190 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:34.326 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-14T11:10:34.326 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:34.327 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:34.327 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:34.375 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:34.375 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:34.433 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:34.433 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:34.471 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:34.471 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:34.508 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:34.508 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:34.545 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:34.545 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:34.581 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:34.581 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:34.618 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:34.618 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:34.655 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:34.655 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:34.692 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:34.692 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:34.729 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:34.730 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:34.766 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:34.766 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:34.804 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:34.804 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:34.841 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:34.841 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:34.877 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:34.877 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:34.915 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:34.915 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:34.952 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:34.952 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:35.023 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:35.023 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:35.060 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:35.060 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:35.097 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:35.098 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:35.134 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:35.135 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:35.173 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:35.173 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:35.212 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:10:35.241 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:35.242 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:35.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.282+0000 7f280f528800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.284+0000 7f280f528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.284+0000 7f280f528800 20 realm 2024-09-14T11:10:35.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.284+0000 7f280f528800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.285+0000 7f280f528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.285+0000 7f280f528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:35.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.285+0000 7f280f528800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.285+0000 7f280f528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.285+0000 7f280f528800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.285 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.285+0000 7f280f528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:35.285 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.285+0000 7f280f528800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.285 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.286+0000 7f280f528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:35.285 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.286+0000 7f280f528800 20 searching for the correct realm 2024-09-14T11:10:35.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.289+0000 7f280aa6e640 0 -- 172.21.15.50:0/2139473465 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f2804016070 msgr2=0x7f28040778d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:35.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.494+0000 7f280ba70640 0 -- 172.21.15.50:0/2139473465 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x555d798b68b0 msgr2=0x555d798b8ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:35.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.499+0000 7f280f528800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:10:35.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.499+0000 7f280f528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:35.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.499+0000 7f280f528800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:10:35.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.499+0000 7f280f528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:35.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.499+0000 7f280f528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:35.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.499+0000 7f280f528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:35.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.499+0000 7f280f528800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.498 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.499+0000 7f280f528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.498 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.499+0000 7f280f528800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.498 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.499+0000 7f280f528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:35.498 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.499+0000 7f280f528800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.499 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.500+0000 7f280f528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:35.499 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.500+0000 7f280f528800 20 zone default found 2024-09-14T11:10:35.499 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.500+0000 7f280f528800 4 Realm: () 2024-09-14T11:10:35.499 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.500+0000 7f280f528800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:10:35.499 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.500+0000 7f280f528800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:10:35.499 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.500+0000 7f280f528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:35.499 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.500+0000 7f280f528800 20 zonegroup default 2024-09-14T11:10:35.499 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.500+0000 7f280f528800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.499 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.500+0000 7f280f528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.499 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.500+0000 7f280f528800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.500 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.501+0000 7f280f528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.500 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.501+0000 7f280f528800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.500 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.501+0000 7f280f528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.500 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.501+0000 7f280f528800 20 started sync module instance, tier type = 2024-09-14T11:10:35.500 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.501+0000 7f280f528800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:10:35.507 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.509+0000 7f280f528800 20 add_watcher() i=0 2024-09-14T11:10:35.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.509+0000 7f280f528800 20 add_watcher() i=1 2024-09-14T11:10:35.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.509+0000 7f280f528800 20 add_watcher() i=2 2024-09-14T11:10:35.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.509+0000 7f280f528800 20 add_watcher() i=3 2024-09-14T11:10:35.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.509+0000 7f280f528800 20 add_watcher() i=4 2024-09-14T11:10:35.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.509+0000 7f280f528800 20 add_watcher() i=5 2024-09-14T11:10:35.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.509+0000 7f280f528800 20 add_watcher() i=6 2024-09-14T11:10:35.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.510+0000 7f280f528800 20 add_watcher() i=7 2024-09-14T11:10:35.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.510+0000 7f280f528800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:35.510 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.512+0000 7f26c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:35.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.512+0000 7f280f528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:35.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.512+0000 7f280f528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:35.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.512+0000 7f280f528800 5 note: GC not initialized 2024-09-14T11:10:35.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.512+0000 7f26c0fe1640 20 reqs_thread_entry: start 2024-09-14T11:10:35.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.513+0000 7f280f528800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:35.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.513+0000 7f280f528800 20 Filter name: none 2024-09-14T11:10:35.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.513+0000 7f263a7fc640 20 reqs_thread_entry: start 2024-09-14T11:10:35.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.513+0000 7f280f528800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.513 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.513+0000 7f280f528800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:10:35.513 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.513+0000 7f280f528800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.513 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.514+0000 7f280f528800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:10:35.513 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.514+0000 7f280f528800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:35.513 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.514+0000 7f280f528800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.513 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.514+0000 7f280f528800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:10:35.513 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.514+0000 7f280f528800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.513 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.515+0000 7f280f528800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:10:35.513 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.515+0000 7f280f528800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:35.514 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.516+0000 7f26c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:35.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.518+0000 7f280f528800 20 remove_watcher() i=0 2024-09-14T11:10:35.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.518+0000 7f280f528800 2 removed watcher, disabling cache 2024-09-14T11:10:35.517 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.519+0000 7f280f528800 20 remove_watcher() i=1 2024-09-14T11:10:35.518 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.520+0000 7f280f528800 20 remove_watcher() i=2 2024-09-14T11:10:35.519 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.521+0000 7f280f528800 20 remove_watcher() i=3 2024-09-14T11:10:35.520 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.522+0000 7f280f528800 20 remove_watcher() i=4 2024-09-14T11:10:35.521 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.523+0000 7f280f528800 20 remove_watcher() i=5 2024-09-14T11:10:35.522 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.524+0000 7f280f528800 20 remove_watcher() i=6 2024-09-14T11:10:35.523 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.525+0000 7f280f528800 20 remove_watcher() i=7 2024-09-14T11:10:35.534 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:35.534 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:10:35.534 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-trim-reshard-log-entries id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:10:35.534 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:35.535 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-14T11:10:35.571 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:35.571 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:35.610 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.612+0000 7fddb9923800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.613+0000 7fddb9923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.613+0000 7fddb9923800 20 realm 2024-09-14T11:10:35.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.613+0000 7fddb9923800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.613+0000 7fddb9923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.613+0000 7fddb9923800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:35.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.613+0000 7fddb9923800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.613+0000 7fddb9923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.613+0000 7fddb9923800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.614+0000 7fddb9923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:35.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.614+0000 7fddb9923800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.615+0000 7fddb9923800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:35.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.615+0000 7fddb9923800 20 searching for the correct realm 2024-09-14T11:10:35.616 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.618+0000 7fddb4e0b640 0 -- 172.21.15.50:0/306774685 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fddb0065b50 msgr2=0x7fddb006e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:35.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.823+0000 7fddb5e0d640 0 -- 172.21.15.50:0/306774685 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x556b7ff0a5d0 msgr2=0x556b7ff0ca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:35.826 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.828+0000 7fddb9923800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:10:35.826 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.828+0000 7fddb9923800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:35.827 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.828+0000 7fddb9923800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:10:35.827 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.828+0000 7fddb9923800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:35.827 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.828+0000 7fddb9923800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:35.827 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.828+0000 7fddb9923800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:35.827 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.828+0000 7fddb9923800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.827 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.828+0000 7fddb9923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.827 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.828+0000 7fddb9923800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.829+0000 7fddb9923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:35.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.829+0000 7fddb9923800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.829+0000 7fddb9923800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:35.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.829+0000 7fddb9923800 20 zone default found 2024-09-14T11:10:35.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.829+0000 7fddb9923800 4 Realm: () 2024-09-14T11:10:35.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.829+0000 7fddb9923800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:10:35.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.829+0000 7fddb9923800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:10:35.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.829+0000 7fddb9923800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:35.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.829+0000 7fddb9923800 20 zonegroup default 2024-09-14T11:10:35.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.829+0000 7fddb9923800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.829+0000 7fddb9923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.829+0000 7fddb9923800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.830+0000 7fddb9923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.830+0000 7fddb9923800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.830+0000 7fddb9923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.830+0000 7fddb9923800 20 started sync module instance, tier type = 2024-09-14T11:10:35.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.830+0000 7fddb9923800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:10:35.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.839+0000 7fddb9923800 20 add_watcher() i=0 2024-09-14T11:10:35.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.839+0000 7fddb9923800 20 add_watcher() i=1 2024-09-14T11:10:35.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.839+0000 7fddb9923800 20 add_watcher() i=2 2024-09-14T11:10:35.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.839+0000 7fddb9923800 20 add_watcher() i=3 2024-09-14T11:10:35.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.839+0000 7fddb9923800 20 add_watcher() i=4 2024-09-14T11:10:35.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.839+0000 7fddb9923800 20 add_watcher() i=5 2024-09-14T11:10:35.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.839+0000 7fddb9923800 20 add_watcher() i=6 2024-09-14T11:10:35.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.840+0000 7fddb9923800 20 add_watcher() i=7 2024-09-14T11:10:35.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.840+0000 7fddb9923800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:35.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.842+0000 7fdc6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:35.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.842+0000 7fddb9923800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:35.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.842+0000 7fddb9923800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:35.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.842+0000 7fddb9923800 5 note: GC not initialized 2024-09-14T11:10:35.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.842+0000 7fdc6a7e4640 20 reqs_thread_entry: start 2024-09-14T11:10:35.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.843+0000 7fddb9923800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:35.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.843+0000 7fddb9923800 20 Filter name: none 2024-09-14T11:10:35.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.843+0000 7fdbdbfff640 20 reqs_thread_entry: start 2024-09-14T11:10:35.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.843+0000 7fddb9923800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:10:35.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.843+0000 7fddb9923800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.843+0000 7fddb9923800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:10:35.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.843+0000 7fddb9923800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:10:35.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.843+0000 7fddb9923800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:10:35.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.843+0000 7fddb9923800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 : miss 2024-09-14T11:10:35.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.843+0000 7fddb9923800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.844+0000 7fddb9923800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:10:35.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.844+0000 7fddb9923800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 info.flags=0x17 2024-09-14T11:10:35.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.844+0000 7fddb9923800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 to cache LRU end 2024-09-14T11:10:35.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.844+0000 7fddb9923800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:10:35.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.844+0000 7fddb9923800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:35.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.844+0000 7fddb9923800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 2024-09-14T11:10:35.847 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.849+0000 7fddb9923800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 info.flags=0x17 2024-09-14T11:10:35.847 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.849+0000 7fddb9923800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 to cache LRU end 2024-09-14T11:10:35.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.849+0000 7fddb9923800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:35.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.849+0000 7fddb9923800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26, ofs0, ns] 2024-09-14T11:10:35.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.850+0000 7fdc87fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 93920196406976 notifier 6401 bl.length()=1023 2024-09-14T11:10:35.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.850+0000 7fdc87fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 info.flags=0x17 2024-09-14T11:10:35.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.850+0000 7fdc87fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 to cache LRU end 2024-09-14T11:10:35.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.850+0000 7fdc87fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:35.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.851+0000 7fddb9923800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26]): orig_sources= new_sources= 2024-09-14T11:10:35.850 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.851+0000 7fddb9923800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26]): potential sources added=[] removed=[] 2024-09-14T11:10:35.850 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.851+0000 7fddb9923800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26]): orig_dests= new_dests= 2024-09-14T11:10:35.850 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.851+0000 7fddb9923800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26]): potential dests added=[] removed=[] 2024-09-14T11:10:35.850 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.851+0000 7fddb9923800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-14T11:10:35.850 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.851+0000 7fddb9923800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-14T11:10:35.851 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.853+0000 7fdc6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:35.854 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.856+0000 7fddb9923800 20 remove_watcher() i=0 2024-09-14T11:10:35.854 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.856+0000 7fddb9923800 2 removed watcher, disabling cache 2024-09-14T11:10:35.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.857+0000 7fddb9923800 20 remove_watcher() i=1 2024-09-14T11:10:35.856 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.858+0000 7fddb9923800 20 remove_watcher() i=2 2024-09-14T11:10:35.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.859+0000 7fddb9923800 20 remove_watcher() i=3 2024-09-14T11:10:35.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.860+0000 7fddb9923800 20 remove_watcher() i=4 2024-09-14T11:10:35.859 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.861+0000 7fddb9923800 20 remove_watcher() i=5 2024-09-14T11:10:35.860 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.862+0000 7fddb9923800 20 remove_watcher() i=6 2024-09-14T11:10:35.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.863+0000 7fddb9923800 20 remove_watcher() i=7 2024-09-14T11:10:35.873 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:10:35.902 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:35.902 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:35.942 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.943+0000 7f50c7f40800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.945+0000 7f50c7f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.945+0000 7f50c7f40800 20 realm 2024-09-14T11:10:35.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.945+0000 7f50c7f40800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.945+0000 7f50c7f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.945+0000 7f50c7f40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:35.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.945+0000 7f50c7f40800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.946+0000 7f50c7f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.946+0000 7f50c7f40800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.946+0000 7f50c7f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:35.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.946+0000 7f50c7f40800 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.947+0000 7f50c7f40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:35.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.947+0000 7f50c7f40800 20 searching for the correct realm 2024-09-14T11:10:35.948 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:35.950+0000 7f50bbfff640 0 -- 172.21.15.50:0/2638894953 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f50bc055920 msgr2=0x7f50bc083400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:36.154 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.156+0000 7f50c44c1640 0 -- 172.21.15.50:0/2638894953 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x562abc752ff0 msgr2=0x562abc755490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:36.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.160+0000 7f50c7f40800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:10:36.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.160+0000 7f50c7f40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:36.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.160+0000 7f50c7f40800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:10:36.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.160+0000 7f50c7f40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:36.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.160+0000 7f50c7f40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:36.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.160+0000 7f50c7f40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:36.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.160+0000 7f50c7f40800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.160+0000 7f50c7f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.160+0000 7f50c7f40800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.161+0000 7f50c7f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:36.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.161+0000 7f50c7f40800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.160 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.161+0000 7f50c7f40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:36.160 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.161+0000 7f50c7f40800 20 zone default found 2024-09-14T11:10:36.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.161+0000 7f50c7f40800 4 Realm: () 2024-09-14T11:10:36.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.161+0000 7f50c7f40800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:10:36.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.161+0000 7f50c7f40800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:10:36.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.161+0000 7f50c7f40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:36.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.161+0000 7f50c7f40800 20 zonegroup default 2024-09-14T11:10:36.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.161+0000 7f50c7f40800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.161+0000 7f50c7f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.161+0000 7f50c7f40800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.162+0000 7f50c7f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.162+0000 7f50c7f40800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.162+0000 7f50c7f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.162+0000 7f50c7f40800 20 started sync module instance, tier type = 2024-09-14T11:10:36.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.162+0000 7f50c7f40800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:10:36.169 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.171+0000 7f50c7f40800 20 add_watcher() i=0 2024-09-14T11:10:36.169 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.171+0000 7f50c7f40800 20 add_watcher() i=1 2024-09-14T11:10:36.169 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.171+0000 7f50c7f40800 20 add_watcher() i=2 2024-09-14T11:10:36.169 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.171+0000 7f50c7f40800 20 add_watcher() i=3 2024-09-14T11:10:36.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.171+0000 7f50c7f40800 20 add_watcher() i=4 2024-09-14T11:10:36.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.171+0000 7f50c7f40800 20 add_watcher() i=5 2024-09-14T11:10:36.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.171+0000 7f50c7f40800 20 add_watcher() i=6 2024-09-14T11:10:36.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.172+0000 7f50c7f40800 20 add_watcher() i=7 2024-09-14T11:10:36.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.172+0000 7f50c7f40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:36.173 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.175+0000 7f4f79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:36.178 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.176+0000 7f50c7f40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:36.178 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.176+0000 7f50c7f40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:36.178 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.176+0000 7f50c7f40800 5 note: GC not initialized 2024-09-14T11:10:36.178 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.176+0000 7f4f78fe1640 20 reqs_thread_entry: start 2024-09-14T11:10:36.178 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.176+0000 7f50c7f40800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:36.178 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.176+0000 7f50c7f40800 20 Filter name: none 2024-09-14T11:10:36.178 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.176+0000 7f4ef27fc640 20 reqs_thread_entry: start 2024-09-14T11:10:36.178 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.176+0000 7f50c7f40800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.178 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.177+0000 7f50c7f40800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:10:36.179 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.177+0000 7f50c7f40800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.179 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.177+0000 7f50c7f40800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:10:36.179 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.177+0000 7f50c7f40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:36.179 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.177+0000 7f50c7f40800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.179 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.177+0000 7f50c7f40800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:10:36.179 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.177+0000 7f50c7f40800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.179 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.178+0000 7f50c7f40800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:10:36.179 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.178+0000 7f50c7f40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:36.179 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.180+0000 7f4f79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:36.180 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.182+0000 7f50c7f40800 20 remove_watcher() i=0 2024-09-14T11:10:36.180 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.182+0000 7f50c7f40800 2 removed watcher, disabling cache 2024-09-14T11:10:36.181 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.183+0000 7f50c7f40800 20 remove_watcher() i=1 2024-09-14T11:10:36.182 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.184+0000 7f50c7f40800 20 remove_watcher() i=2 2024-09-14T11:10:36.183 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.185+0000 7f50c7f40800 20 remove_watcher() i=3 2024-09-14T11:10:36.184 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.186+0000 7f50c7f40800 20 remove_watcher() i=4 2024-09-14T11:10:36.185 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.187+0000 7f50c7f40800 20 remove_watcher() i=5 2024-09-14T11:10:36.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.188+0000 7f50c7f40800 20 remove_watcher() i=6 2024-09-14T11:10:36.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.189+0000 7f50c7f40800 20 remove_watcher() i=7 2024-09-14T11:10:36.198 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:36.199 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:10:36.199 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-trim-reshard-log-entries id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:10:36.199 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:36.200 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:36.200 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:36.236 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:36.236 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:36.294 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:10:36.326 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:36.327 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:36.366 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.368+0000 7f389052e800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.370+0000 7f389052e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.370+0000 7f389052e800 20 realm 2024-09-14T11:10:36.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.370+0000 7f389052e800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.370+0000 7f389052e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.370+0000 7f389052e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:36.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.370+0000 7f389052e800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.371+0000 7f389052e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.371+0000 7f389052e800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.371+0000 7f389052e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:36.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.371+0000 7f389052e800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.372+0000 7f389052e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:36.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.372+0000 7f389052e800 20 searching for the correct realm 2024-09-14T11:10:36.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.375+0000 7f388badc640 0 -- 172.21.15.50:0/1028131073 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f38840661f0 msgr2=0x7f388406a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:36.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.580+0000 7f388badc640 0 -- 172.21.15.50:0/1028131073 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5614c7ac6930 msgr2=0x5614c7ac8dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:36.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.583+0000 7f389052e800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:10:36.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.583+0000 7f389052e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:36.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.583+0000 7f389052e800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:10:36.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.583+0000 7f389052e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:36.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.584+0000 7f389052e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:36.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.584+0000 7f389052e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:36.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.584+0000 7f389052e800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.584+0000 7f389052e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.584+0000 7f389052e800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.584+0000 7f389052e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:36.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.584+0000 7f389052e800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.584+0000 7f389052e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:36.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.584+0000 7f389052e800 20 zone default found 2024-09-14T11:10:36.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.584+0000 7f389052e800 4 Realm: () 2024-09-14T11:10:36.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.584+0000 7f389052e800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:10:36.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.584+0000 7f389052e800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:10:36.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.584+0000 7f389052e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:36.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.584+0000 7f389052e800 20 zonegroup default 2024-09-14T11:10:36.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.584+0000 7f389052e800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.585+0000 7f389052e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.585+0000 7f389052e800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.585+0000 7f389052e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.585+0000 7f389052e800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.585+0000 7f389052e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.585+0000 7f389052e800 20 started sync module instance, tier type = 2024-09-14T11:10:36.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.585+0000 7f389052e800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:10:36.592 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.593+0000 7f389052e800 20 add_watcher() i=0 2024-09-14T11:10:36.592 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.593+0000 7f389052e800 20 add_watcher() i=1 2024-09-14T11:10:36.592 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.593+0000 7f389052e800 20 add_watcher() i=2 2024-09-14T11:10:36.592 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.593+0000 7f389052e800 20 add_watcher() i=3 2024-09-14T11:10:36.592 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.593+0000 7f389052e800 20 add_watcher() i=4 2024-09-14T11:10:36.592 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.593+0000 7f389052e800 20 add_watcher() i=5 2024-09-14T11:10:36.592 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.594+0000 7f389052e800 20 add_watcher() i=6 2024-09-14T11:10:36.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.595+0000 7f389052e800 20 add_watcher() i=7 2024-09-14T11:10:36.593 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.595+0000 7f389052e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:36.594 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.596+0000 7f3742fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:36.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.597+0000 7f389052e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:36.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.597+0000 7f389052e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:36.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.597+0000 7f389052e800 5 note: GC not initialized 2024-09-14T11:10:36.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.597+0000 7f3741fdb640 20 reqs_thread_entry: start 2024-09-14T11:10:36.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.597+0000 7f389052e800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:36.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.597+0000 7f389052e800 20 Filter name: none 2024-09-14T11:10:36.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.597+0000 7f36b37fe640 20 reqs_thread_entry: start 2024-09-14T11:10:36.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.597+0000 7f389052e800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:10:36.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.597+0000 7f389052e800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.598+0000 7f389052e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:10:36.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.598+0000 7f389052e800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:10:36.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.598+0000 7f389052e800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:10:36.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.598+0000 7f389052e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 : miss 2024-09-14T11:10:36.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.598+0000 7f389052e800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.598+0000 7f389052e800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:10:36.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.598+0000 7f389052e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 info.flags=0x17 2024-09-14T11:10:36.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.598+0000 7f389052e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 to cache LRU end 2024-09-14T11:10:36.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.598+0000 7f389052e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:10:36.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.598+0000 7f389052e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:36.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.598+0000 7f389052e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 2024-09-14T11:10:36.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.599+0000 7f389052e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:10:36.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.606+0000 7f389052e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 info.flags=0x17 2024-09-14T11:10:36.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.606+0000 7f389052e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 to cache LRU end 2024-09-14T11:10:36.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.606+0000 7f389052e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:36.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.606+0000 7f389052e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26, ofs0, ns] 2024-09-14T11:10:36.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.606+0000 7f3762ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496992 cookie 94647249367024 notifier 6437 bl.length()=1023 2024-09-14T11:10:36.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.606+0000 7f3762ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 info.flags=0x17 2024-09-14T11:10:36.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.606+0000 7f3762ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 to cache LRU end 2024-09-14T11:10:36.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.606+0000 7f3762ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:36.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.608+0000 7f389052e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26]): orig_sources= new_sources= 2024-09-14T11:10:36.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.608+0000 7f389052e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26]): potential sources added=[] removed=[] 2024-09-14T11:10:36.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.608+0000 7f389052e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26]): orig_dests= new_dests= 2024-09-14T11:10:36.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.608+0000 7f389052e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26]): potential dests added=[] removed=[] 2024-09-14T11:10:36.610 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2.0 2024-09-14T11:10:36.610 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2.0 2024-09-14T11:10:36.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2.1 2024-09-14T11:10:36.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2.1 2024-09-14T11:10:36.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2.2 2024-09-14T11:10:36.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2.2 2024-09-14T11:10:36.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2.3 2024-09-14T11:10:36.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2.3 2024-09-14T11:10:36.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2.4 2024-09-14T11:10:36.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2.4 2024-09-14T11:10:36.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2.5 2024-09-14T11:10:36.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2.5 2024-09-14T11:10:36.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2.6 2024-09-14T11:10:36.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2.6 2024-09-14T11:10:36.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2.7 2024-09-14T11:10:36.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2.7 2024-09-14T11:10:36.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2.8 2024-09-14T11:10:36.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2.8 2024-09-14T11:10:36.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2.9 2024-09-14T11:10:36.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2.9 2024-09-14T11:10:36.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2.10 2024-09-14T11:10:36.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2.10 2024-09-14T11:10:36.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2.11 2024-09-14T11:10:36.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2.11 2024-09-14T11:10:36.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.0 2024-09-14T11:10:36.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.612+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.1 2024-09-14T11:10:36.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.613+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2 2024-09-14T11:10:36.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.613+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.3 2024-09-14T11:10:36.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.614+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.4 2024-09-14T11:10:36.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.614+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.5 2024-09-14T11:10:36.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.615+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.6 2024-09-14T11:10:36.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.615+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.7 2024-09-14T11:10:36.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.615+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.8 2024-09-14T11:10:36.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.616+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.9 2024-09-14T11:10:36.615 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.617+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.10 2024-09-14T11:10:36.618 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.620+0000 7f389052e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 : hit (requested=0x17, cached=0x17) 2024-09-14T11:10:36.618 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.620+0000 7f389052e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 2024-09-14T11:10:36.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.621+0000 7f389052e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 info.flags=0x17 2024-09-14T11:10:36.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.621+0000 7f389052e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 to cache LRU end 2024-09-14T11:10:36.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.621+0000 7f389052e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:36.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.621+0000 7f389052e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26, ofs0, ns] 2024-09-14T11:10:36.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.621+0000 7f3762ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496993 cookie 94647249367024 notifier 6437 bl.length()=1023 2024-09-14T11:10:36.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.621+0000 7f3762ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 info.flags=0x17 2024-09-14T11:10:36.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.621+0000 7f3762ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 to cache LRU end 2024-09-14T11:10:36.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.621+0000 7f3762ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:36.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.623+0000 7f389052e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26]): orig_sources= new_sources= 2024-09-14T11:10:36.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.623+0000 7f389052e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26]): potential sources added=[] removed=[] 2024-09-14T11:10:36.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.623+0000 7f389052e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26]): orig_dests= new_dests= 2024-09-14T11:10:36.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.623+0000 7f389052e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26]): potential dests added=[] removed=[] 2024-09-14T11:10:36.623 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.625+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.0 2024-09-14T11:10:36.623 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.625+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.1 2024-09-14T11:10:36.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.626+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.2 2024-09-14T11:10:36.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.626+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.3 2024-09-14T11:10:36.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.626+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.4 2024-09-14T11:10:36.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.627+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.5 2024-09-14T11:10:36.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.627+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.6 2024-09-14T11:10:36.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.627+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.7 2024-09-14T11:10:36.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.627+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.8 2024-09-14T11:10:36.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.628+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.9 2024-09-14T11:10:36.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.628+0000 7f389052e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26.10 2024-09-14T11:10:36.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.628+0000 7f389052e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 : hit (requested=0x17, cached=0x17) 2024-09-14T11:10:36.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.628+0000 7f389052e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 2024-09-14T11:10:36.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.629+0000 7f389052e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 info.flags=0x17 2024-09-14T11:10:36.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.629+0000 7f389052e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 to cache LRU end 2024-09-14T11:10:36.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.629+0000 7f389052e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:36.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.629+0000 7f389052e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26, ofs0, ns] 2024-09-14T11:10:36.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.630+0000 7f37637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496994 cookie 94647249367024 notifier 6437 bl.length()=991 2024-09-14T11:10:36.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.630+0000 7f37637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 info.flags=0x17 2024-09-14T11:10:36.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.630+0000 7f37637fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 to cache LRU end 2024-09-14T11:10:36.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.630+0000 7f37637fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:36.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.631+0000 7f389052e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26]): orig_sources= new_sources= 2024-09-14T11:10:36.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.631+0000 7f389052e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26]): potential sources added=[] removed=[] 2024-09-14T11:10:36.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.631+0000 7f389052e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26]): orig_dests= new_dests= 2024-09-14T11:10:36.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.631+0000 7f389052e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26]): potential dests added=[] removed=[] 2024-09-14T11:10:36.631 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.633+0000 7f389052e800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:10:36.633 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.635+0000 7f3742fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:36.636 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.638+0000 7f389052e800 20 remove_watcher() i=0 2024-09-14T11:10:36.636 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.638+0000 7f389052e800 2 removed watcher, disabling cache 2024-09-14T11:10:36.637 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.639+0000 7f389052e800 20 remove_watcher() i=1 2024-09-14T11:10:36.638 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.640+0000 7f389052e800 20 remove_watcher() i=2 2024-09-14T11:10:36.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.641+0000 7f389052e800 20 remove_watcher() i=3 2024-09-14T11:10:36.640 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.642+0000 7f389052e800 20 remove_watcher() i=4 2024-09-14T11:10:36.641 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.643+0000 7f389052e800 20 remove_watcher() i=5 2024-09-14T11:10:36.642 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.644+0000 7f389052e800 20 remove_watcher() i=6 2024-09-14T11:10:36.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.645+0000 7f389052e800 20 remove_watcher() i=7 2024-09-14T11:10:36.656 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:10:36.685 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:36.686 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:36.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.727+0000 7f0ae2e20800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.729+0000 7f0ae2e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.729+0000 7f0ae2e20800 20 realm 2024-09-14T11:10:36.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.729+0000 7f0ae2e20800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.728 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.729+0000 7f0ae2e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.728 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.729+0000 7f0ae2e20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:36.728 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.729+0000 7f0ae2e20800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.728 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.729+0000 7f0ae2e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.728 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.729+0000 7f0ae2e20800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.730+0000 7f0ae2e20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:36.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.730+0000 7f0ae2e20800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.730+0000 7f0ae2e20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:36.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.730+0000 7f0ae2e20800 20 searching for the correct realm 2024-09-14T11:10:36.731 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.733+0000 7f0ae0109640 0 -- 172.21.15.50:0/300037298 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f0ad800f940 msgr2=0x7f0ad8020420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:36.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.939+0000 7f0ae110b640 0 -- 172.21.15.50:0/300037298 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x565316d96010 msgr2=0x565316d98400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:36.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.942+0000 7f0ae2e20800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:10:36.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.942+0000 7f0ae2e20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:36.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.942+0000 7f0ae2e20800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:10:36.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.942+0000 7f0ae2e20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:36.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.942+0000 7f0ae2e20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:36.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.942+0000 7f0ae2e20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:36.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.943+0000 7f0ae2e20800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.943+0000 7f0ae2e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.943+0000 7f0ae2e20800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.943 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.943+0000 7f0ae2e20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:36.943 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.943+0000 7f0ae2e20800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.943 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.943+0000 7f0ae2e20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:36.943 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.943+0000 7f0ae2e20800 20 zone default found 2024-09-14T11:10:36.943 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.943+0000 7f0ae2e20800 4 Realm: () 2024-09-14T11:10:36.943 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.943+0000 7f0ae2e20800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:10:36.943 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.943+0000 7f0ae2e20800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:10:36.943 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.943+0000 7f0ae2e20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:36.943 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.943+0000 7f0ae2e20800 20 zonegroup default 2024-09-14T11:10:36.943 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.943+0000 7f0ae2e20800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.944+0000 7f0ae2e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.944+0000 7f0ae2e20800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.944+0000 7f0ae2e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.944+0000 7f0ae2e20800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.944+0000 7f0ae2e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.944+0000 7f0ae2e20800 20 started sync module instance, tier type = 2024-09-14T11:10:36.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.944+0000 7f0ae2e20800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:10:36.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.952+0000 7f0ae2e20800 20 add_watcher() i=0 2024-09-14T11:10:36.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.953+0000 7f0ae2e20800 20 add_watcher() i=1 2024-09-14T11:10:36.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.953+0000 7f0ae2e20800 20 add_watcher() i=2 2024-09-14T11:10:36.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.953+0000 7f0ae2e20800 20 add_watcher() i=3 2024-09-14T11:10:36.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.953+0000 7f0ae2e20800 20 add_watcher() i=4 2024-09-14T11:10:36.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.953+0000 7f0ae2e20800 20 add_watcher() i=5 2024-09-14T11:10:36.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.953+0000 7f0ae2e20800 20 add_watcher() i=6 2024-09-14T11:10:36.952 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.954+0000 7f0ae2e20800 20 add_watcher() i=7 2024-09-14T11:10:36.952 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.954+0000 7f0ae2e20800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:36.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.956+0000 7f0996fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:36.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.956+0000 7f0ae2e20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:36.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.956+0000 7f0ae2e20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:36.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.956+0000 7f0ae2e20800 5 note: GC not initialized 2024-09-14T11:10:36.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.956+0000 7f0995fe3640 20 reqs_thread_entry: start 2024-09-14T11:10:36.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.956+0000 7f0ae2e20800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:36.956 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.956+0000 7f0ae2e20800 20 Filter name: none 2024-09-14T11:10:36.956 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.956+0000 7f09077fe640 20 reqs_thread_entry: start 2024-09-14T11:10:36.956 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.956+0000 7f0ae2e20800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.956 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.957+0000 7f0ae2e20800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:10:36.956 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.957+0000 7f0ae2e20800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.957+0000 7f0ae2e20800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:10:36.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.957+0000 7f0ae2e20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:36.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.957+0000 7f0ae2e20800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.958+0000 7f0ae2e20800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:10:36.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.958+0000 7f0ae2e20800 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.958+0000 7f0ae2e20800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:10:36.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.958+0000 7f0ae2e20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:36.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.960+0000 7f0996fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:36.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.962+0000 7f0ae2e20800 20 remove_watcher() i=0 2024-09-14T11:10:36.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.962+0000 7f0ae2e20800 2 removed watcher, disabling cache 2024-09-14T11:10:36.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.963+0000 7f0ae2e20800 20 remove_watcher() i=1 2024-09-14T11:10:36.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.964+0000 7f0ae2e20800 20 remove_watcher() i=2 2024-09-14T11:10:36.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.965+0000 7f0ae2e20800 20 remove_watcher() i=3 2024-09-14T11:10:36.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.966+0000 7f0ae2e20800 20 remove_watcher() i=4 2024-09-14T11:10:36.965 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.966+0000 7f0ae2e20800 20 remove_watcher() i=5 2024-09-14T11:10:36.965 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.967+0000 7f0ae2e20800 20 remove_watcher() i=6 2024-09-14T11:10:36.966 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:36.968+0000 7f0ae2e20800 20 remove_watcher() i=7 2024-09-14T11:10:36.978 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:36.978 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:10:36.978 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-trim-reshard-log-entries id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:10:36.978 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:36.980 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:36.980 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:37.002 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:37.003 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:37.237 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:37.237 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:37.370 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-14T11:10:37.371 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:37.371 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:37.371 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:37.420 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:37.420 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:37.477 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:37.478 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:37.514 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:37.514 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:37.550 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:37.551 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:37.587 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:37.588 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:37.623 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:37.623 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:37.661 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:37.661 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:37.698 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:37.698 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:37.735 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:37.736 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:37.778 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:37.778 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:37.814 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:37.814 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:37.851 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:37.851 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:37.888 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:37.888 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:37.924 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:37.924 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:37.963 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:37.963 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:38.000 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:38.000 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:38.037 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:38.037 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:38.075 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:38.075 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:38.112 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:38.112 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:38.148 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:38.148 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:38.187 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:38.187 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:38.224 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:10:38.253 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:38.253 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:38.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.294+0000 7f3de0940800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.296+0000 7f3de0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:38.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.296+0000 7f3de0940800 20 realm 2024-09-14T11:10:38.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.296+0000 7f3de0940800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.296+0000 7f3de0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:38.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.296+0000 7f3de0940800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:38.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.296+0000 7f3de0940800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.296+0000 7f3de0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:38.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.296+0000 7f3de0940800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.297+0000 7f3de0940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:38.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.297+0000 7f3de0940800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.297+0000 7f3de0940800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:38.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.297+0000 7f3de0940800 20 searching for the correct realm 2024-09-14T11:10:38.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.300+0000 7f3ddcec1640 0 -- 172.21.15.50:0/1379284385 >> [v2:172.21.15.118:6816/4154782182,v1:172.21.15.118:6817/4154782182] conn(0x5626304d4a50 msgr2=0x5626304d6f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:38.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.303+0000 7f3ddc6c0640 0 -- 172.21.15.50:0/1379284385 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f3dd403d940 msgr2=0x7f3dd403c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:38.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.510+0000 7f3de0940800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:10:38.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.510+0000 7f3de0940800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:38.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.510+0000 7f3de0940800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:10:38.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.510+0000 7f3de0940800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:38.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.510+0000 7f3de0940800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:38.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.510+0000 7f3de0940800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:38.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.510+0000 7f3de0940800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.511+0000 7f3de0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:38.510 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.511+0000 7f3de0940800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.510 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.511+0000 7f3de0940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:38.510 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.511+0000 7f3de0940800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.510 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.511+0000 7f3de0940800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:38.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.511+0000 7f3de0940800 20 zone default found 2024-09-14T11:10:38.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.511+0000 7f3de0940800 4 Realm: () 2024-09-14T11:10:38.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.511+0000 7f3de0940800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:10:38.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.511+0000 7f3de0940800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:10:38.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.511+0000 7f3de0940800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:38.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.511+0000 7f3de0940800 20 zonegroup default 2024-09-14T11:10:38.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.511+0000 7f3de0940800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.511+0000 7f3de0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:38.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.511+0000 7f3de0940800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.512+0000 7f3de0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:38.512 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.512+0000 7f3de0940800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.512 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.512+0000 7f3de0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:38.512 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.512+0000 7f3de0940800 20 started sync module instance, tier type = 2024-09-14T11:10:38.512 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.512+0000 7f3de0940800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:10:38.520 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.521+0000 7f3de0940800 20 add_watcher() i=0 2024-09-14T11:10:38.520 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.521+0000 7f3de0940800 20 add_watcher() i=1 2024-09-14T11:10:38.520 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.521+0000 7f3de0940800 20 add_watcher() i=2 2024-09-14T11:10:38.520 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.521+0000 7f3de0940800 20 add_watcher() i=3 2024-09-14T11:10:38.520 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.521+0000 7f3de0940800 20 add_watcher() i=4 2024-09-14T11:10:38.520 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.521+0000 7f3de0940800 20 add_watcher() i=5 2024-09-14T11:10:38.520 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.521+0000 7f3de0940800 20 add_watcher() i=6 2024-09-14T11:10:38.521 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.522+0000 7f3de0940800 20 add_watcher() i=7 2024-09-14T11:10:38.521 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.522+0000 7f3de0940800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:38.522 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.524+0000 7f3c92fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:38.523 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.525+0000 7f3de0940800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:38.523 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.525+0000 7f3de0940800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:38.523 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.525+0000 7f3de0940800 5 note: GC not initialized 2024-09-14T11:10:38.523 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.525+0000 7f3c91fdb640 20 reqs_thread_entry: start 2024-09-14T11:10:38.523 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.525+0000 7f3de0940800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:38.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.525+0000 7f3de0940800 20 Filter name: none 2024-09-14T11:10:38.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.525+0000 7f3c037fe640 20 reqs_thread_entry: start 2024-09-14T11:10:38.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.525+0000 7f3de0940800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.525 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.526+0000 7f3de0940800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:10:38.525 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.526+0000 7f3de0940800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.525 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.526+0000 7f3de0940800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:10:38.525 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.526+0000 7f3de0940800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:38.525 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.526+0000 7f3de0940800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.525 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.526+0000 7f3de0940800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:10:38.525 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.526+0000 7f3de0940800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.525 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.527+0000 7f3de0940800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:10:38.525 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.527+0000 7f3de0940800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:38.527 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.529+0000 7f3c92fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:38.529 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.531+0000 7f3de0940800 20 remove_watcher() i=0 2024-09-14T11:10:38.529 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.531+0000 7f3de0940800 2 removed watcher, disabling cache 2024-09-14T11:10:38.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.532+0000 7f3de0940800 20 remove_watcher() i=1 2024-09-14T11:10:38.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.533+0000 7f3de0940800 20 remove_watcher() i=2 2024-09-14T11:10:38.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.534+0000 7f3de0940800 20 remove_watcher() i=3 2024-09-14T11:10:38.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.535+0000 7f3de0940800 20 remove_watcher() i=4 2024-09-14T11:10:38.534 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.536+0000 7f3de0940800 20 remove_watcher() i=5 2024-09-14T11:10:38.535 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.537+0000 7f3de0940800 20 remove_watcher() i=6 2024-09-14T11:10:38.536 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.538+0000 7f3de0940800 20 remove_watcher() i=7 2024-09-14T11:10:38.547 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:38.548 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:10:38.548 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-trim-reshard-log-entries id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:10:38.548 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:38.549 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-14T11:10:38.586 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:38.587 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:38.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.628+0000 7f3cc0519800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.630+0000 7f3cc0519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:38.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.630+0000 7f3cc0519800 20 realm 2024-09-14T11:10:38.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.630+0000 7f3cc0519800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.630+0000 7f3cc0519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:38.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.630+0000 7f3cc0519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:38.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.630+0000 7f3cc0519800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.630+0000 7f3cc0519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:38.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.630+0000 7f3cc0519800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.630 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.631+0000 7f3cc0519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:38.630 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.631+0000 7f3cc0519800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.630 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.632+0000 7f3cc0519800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:38.630 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.632+0000 7f3cc0519800 20 searching for the correct realm 2024-09-14T11:10:38.633 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.634+0000 7f3cbd809640 0 -- 172.21.15.50:0/1632463370 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f3cb806e430 msgr2=0x7f3cb80693b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:38.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.839+0000 7f3cbe80b640 0 -- 172.21.15.50:0/1632463370 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x56515ed48430 msgr2=0x56515ed4a840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:38.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.842+0000 7f3cc0519800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:10:38.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.842+0000 7f3cc0519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:38.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.842+0000 7f3cc0519800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:10:38.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.842+0000 7f3cc0519800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:38.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.842+0000 7f3cc0519800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:38.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.842+0000 7f3cc0519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:38.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.842+0000 7f3cc0519800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.843+0000 7f3cc0519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:38.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.843+0000 7f3cc0519800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.843+0000 7f3cc0519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:38.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.843+0000 7f3cc0519800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.843+0000 7f3cc0519800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:38.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.843+0000 7f3cc0519800 20 zone default found 2024-09-14T11:10:38.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.843+0000 7f3cc0519800 4 Realm: () 2024-09-14T11:10:38.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.843+0000 7f3cc0519800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:10:38.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.843+0000 7f3cc0519800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:10:38.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.843+0000 7f3cc0519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:38.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.843+0000 7f3cc0519800 20 zonegroup default 2024-09-14T11:10:38.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.843+0000 7f3cc0519800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.844 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.844+0000 7f3cc0519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:38.844 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.844+0000 7f3cc0519800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.844 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.844+0000 7f3cc0519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:38.844 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.844+0000 7f3cc0519800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.844 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.844+0000 7f3cc0519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:38.844 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.844+0000 7f3cc0519800 20 started sync module instance, tier type = 2024-09-14T11:10:38.844 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.844+0000 7f3cc0519800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:10:38.851 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.853+0000 7f3cc0519800 20 add_watcher() i=0 2024-09-14T11:10:38.851 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.853+0000 7f3cc0519800 20 add_watcher() i=1 2024-09-14T11:10:38.851 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.853+0000 7f3cc0519800 20 add_watcher() i=2 2024-09-14T11:10:38.852 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.853+0000 7f3cc0519800 20 add_watcher() i=3 2024-09-14T11:10:38.852 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.853+0000 7f3cc0519800 20 add_watcher() i=4 2024-09-14T11:10:38.852 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.853+0000 7f3cc0519800 20 add_watcher() i=5 2024-09-14T11:10:38.852 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.853+0000 7f3cc0519800 20 add_watcher() i=6 2024-09-14T11:10:38.853 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.853+0000 7f3cc0519800 20 add_watcher() i=7 2024-09-14T11:10:38.853 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.853+0000 7f3cc0519800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:38.856 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.855+0000 7f3b74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:38.856 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.856+0000 7f3cc0519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:38.856 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.856+0000 7f3cc0519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:38.856 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.856+0000 7f3cc0519800 5 note: GC not initialized 2024-09-14T11:10:38.856 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.856+0000 7f3aef7fe640 20 reqs_thread_entry: start 2024-09-14T11:10:38.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.856+0000 7f3cc0519800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:38.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.856+0000 7f3cc0519800 20 Filter name: none 2024-09-14T11:10:38.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.856+0000 7f3aed7fa640 20 reqs_thread_entry: start 2024-09-14T11:10:38.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.856+0000 7f3cc0519800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:10:38.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.856+0000 7f3cc0519800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.857+0000 7f3cc0519800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:10:38.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.857+0000 7f3cc0519800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:10:38.858 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.857+0000 7f3cc0519800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:10:38.858 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.857+0000 7f3cc0519800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27 : miss 2024-09-14T11:10:38.858 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.857+0000 7f3cc0519800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.858 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.857+0000 7f3cc0519800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:10:38.858 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.857+0000 7f3cc0519800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27 info.flags=0x17 2024-09-14T11:10:38.858 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.857+0000 7f3cc0519800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27 to cache LRU end 2024-09-14T11:10:38.858 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.857+0000 7f3cc0519800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:10:38.859 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.857+0000 7f3cc0519800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:38.859 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.857+0000 7f3cc0519800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27 2024-09-14T11:10:38.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.862+0000 7f3cc0519800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27 info.flags=0x17 2024-09-14T11:10:38.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.862+0000 7f3cc0519800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27 to cache LRU end 2024-09-14T11:10:38.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.862+0000 7f3cc0519800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:38.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.862+0000 7f3cc0519800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27, ofs0, ns] 2024-09-14T11:10:38.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.863+0000 7f3ba1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496997 cookie 94907483394784 notifier 6488 bl.length()=1023 2024-09-14T11:10:38.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.863+0000 7f3ba1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27 info.flags=0x17 2024-09-14T11:10:38.862 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.863+0000 7f3ba1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27 to cache LRU end 2024-09-14T11:10:38.862 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.863+0000 7f3ba1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:38.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.864+0000 7f3cc0519800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27]): orig_sources= new_sources= 2024-09-14T11:10:38.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.864+0000 7f3cc0519800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27]): potential sources added=[] removed=[] 2024-09-14T11:10:38.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.864+0000 7f3cc0519800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27]): orig_dests= new_dests= 2024-09-14T11:10:38.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.864+0000 7f3cc0519800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27]): potential dests added=[] removed=[] 2024-09-14T11:10:38.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.864+0000 7f3cc0519800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-14T11:10:38.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.864+0000 7f3cc0519800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:10:38.865 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.866+0000 7f3cc0519800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1.0 2024-09-14T11:10:38.865 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.866+0000 7f3cc0519800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1.0 2024-09-14T11:10:38.865 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.866+0000 7f3cc0519800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1.1 2024-09-14T11:10:38.865 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.866+0000 7f3cc0519800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1.1 2024-09-14T11:10:38.865 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.866+0000 7f3cc0519800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1.2 2024-09-14T11:10:38.865 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.866+0000 7f3cc0519800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1.2 2024-09-14T11:10:38.866 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.866+0000 7f3cc0519800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1.3 2024-09-14T11:10:38.866 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.866+0000 7f3cc0519800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1.3 2024-09-14T11:10:38.866 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.866+0000 7f3cc0519800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1.4 2024-09-14T11:10:38.866 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.866+0000 7f3cc0519800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1.4 2024-09-14T11:10:38.866 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.866+0000 7f3cc0519800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1.5 2024-09-14T11:10:38.866 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.866+0000 7f3cc0519800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1.5 2024-09-14T11:10:38.866 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.866+0000 7f3cc0519800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1.6 2024-09-14T11:10:38.866 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.866+0000 7f3cc0519800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1.6 2024-09-14T11:10:38.866 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.866+0000 7f3cc0519800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1.7 2024-09-14T11:10:38.866 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.866+0000 7f3cc0519800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1.7 2024-09-14T11:10:38.866 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.866+0000 7f3cc0519800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1.8 2024-09-14T11:10:38.866 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.866+0000 7f3cc0519800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1.8 2024-09-14T11:10:38.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.866+0000 7f3cc0519800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1.9 2024-09-14T11:10:38.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.866+0000 7f3cc0519800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1.9 2024-09-14T11:10:38.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.866+0000 7f3cc0519800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1.10 2024-09-14T11:10:38.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.866+0000 7f3cc0519800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1.10 2024-09-14T11:10:38.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.866+0000 7f3cc0519800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1.11 2024-09-14T11:10:38.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.866+0000 7f3cc0519800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1.11 2024-09-14T11:10:38.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.867+0000 7f3cc0519800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.0 2024-09-14T11:10:38.868 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.867+0000 7f3cc0519800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.1 2024-09-14T11:10:38.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.867+0000 7f3cc0519800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.2 2024-09-14T11:10:38.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.868+0000 7f3cc0519800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.3 2024-09-14T11:10:38.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.869+0000 7f3cc0519800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.4 2024-09-14T11:10:38.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.869+0000 7f3cc0519800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.5 2024-09-14T11:10:38.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.870+0000 7f3cc0519800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.6 2024-09-14T11:10:38.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.870+0000 7f3cc0519800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.7 2024-09-14T11:10:38.869 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.871+0000 7f3cc0519800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.8 2024-09-14T11:10:38.870 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.872+0000 7f3cc0519800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.9 2024-09-14T11:10:38.870 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.872+0000 7f3cc0519800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27.10 2024-09-14T11:10:38.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.875+0000 7f3cc0519800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27 : hit (requested=0x17, cached=0x17) 2024-09-14T11:10:38.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.875+0000 7f3cc0519800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27 2024-09-14T11:10:38.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.876+0000 7f3cc0519800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27 info.flags=0x17 2024-09-14T11:10:38.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.876+0000 7f3cc0519800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27 to cache LRU end 2024-09-14T11:10:38.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.876+0000 7f3cc0519800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:38.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.876+0000 7f3cc0519800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27, ofs0, ns] 2024-09-14T11:10:38.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.876+0000 7f3ba1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496998 cookie 94907483394784 notifier 6488 bl.length()=991 2024-09-14T11:10:38.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.876+0000 7f3ba1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27 info.flags=0x17 2024-09-14T11:10:38.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.876+0000 7f3ba1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27 to cache LRU end 2024-09-14T11:10:38.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.876+0000 7f3ba1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:38.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.878+0000 7f3cc0519800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27]): orig_sources= new_sources= 2024-09-14T11:10:38.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.878+0000 7f3cc0519800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27]): potential sources added=[] removed=[] 2024-09-14T11:10:38.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.878+0000 7f3cc0519800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27]): orig_dests= new_dests= 2024-09-14T11:10:38.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.878+0000 7f3cc0519800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27]): potential dests added=[] removed=[] 2024-09-14T11:10:38.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.880+0000 7f3cc0519800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:10:38.880 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.882+0000 7f3b74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:38.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.884+0000 7f3cc0519800 20 remove_watcher() i=0 2024-09-14T11:10:38.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.884+0000 7f3cc0519800 2 removed watcher, disabling cache 2024-09-14T11:10:38.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.885+0000 7f3cc0519800 20 remove_watcher() i=1 2024-09-14T11:10:38.884 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.886+0000 7f3cc0519800 20 remove_watcher() i=2 2024-09-14T11:10:38.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.887+0000 7f3cc0519800 20 remove_watcher() i=3 2024-09-14T11:10:38.886 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.888+0000 7f3cc0519800 20 remove_watcher() i=4 2024-09-14T11:10:38.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.889+0000 7f3cc0519800 20 remove_watcher() i=5 2024-09-14T11:10:38.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.890+0000 7f3cc0519800 20 remove_watcher() i=6 2024-09-14T11:10:38.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.891+0000 7f3cc0519800 20 remove_watcher() i=7 2024-09-14T11:10:38.902 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:10:38.932 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:38.932 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:38.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.973+0000 7f6003f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.975+0000 7f6003f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:38.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.975+0000 7f6003f23800 20 realm 2024-09-14T11:10:38.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.975+0000 7f6003f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.975+0000 7f6003f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:38.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.975+0000 7f6003f23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:38.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.975+0000 7f6003f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.975+0000 7f6003f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:38.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.975+0000 7f6003f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.976+0000 7f6003f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:38.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.976+0000 7f6003f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.977+0000 7f6003f23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:38.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.977+0000 7f6003f23800 20 searching for the correct realm 2024-09-14T11:10:38.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.979+0000 7f600040d640 0 -- 172.21.15.50:0/3545551133 >> [v2:172.21.15.118:6816/4154782182,v1:172.21.15.118:6817/4154782182] conn(0x55a74af92f10 msgr2=0x55a74af953d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:38.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:38.982+0000 7f5fffc0c640 0 -- 172.21.15.50:0/3545551133 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f5ff8085830 msgr2=0x7f5ff808a740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:39.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.189+0000 7f6003f23800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:10:39.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.189+0000 7f6003f23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:39.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.189+0000 7f6003f23800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:10:39.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.189+0000 7f6003f23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:39.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.189+0000 7f6003f23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:39.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.189+0000 7f6003f23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:39.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.189+0000 7f6003f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:39.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.189+0000 7f6003f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:39.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.189+0000 7f6003f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:39.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.189+0000 7f6003f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:39.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.189+0000 7f6003f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:39.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.190+0000 7f6003f23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:39.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.190+0000 7f6003f23800 20 zone default found 2024-09-14T11:10:39.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.190+0000 7f6003f23800 4 Realm: () 2024-09-14T11:10:39.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.190+0000 7f6003f23800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:10:39.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.190+0000 7f6003f23800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:10:39.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.190+0000 7f6003f23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:39.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.190+0000 7f6003f23800 20 zonegroup default 2024-09-14T11:10:39.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.190+0000 7f6003f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:39.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.190+0000 7f6003f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:39.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.190+0000 7f6003f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:39.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.190+0000 7f6003f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:39.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.190+0000 7f6003f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:39.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.191+0000 7f6003f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:39.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.191+0000 7f6003f23800 20 started sync module instance, tier type = 2024-09-14T11:10:39.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.191+0000 7f6003f23800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:10:39.198 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.199+0000 7f6003f23800 20 add_watcher() i=0 2024-09-14T11:10:39.198 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.199+0000 7f6003f23800 20 add_watcher() i=1 2024-09-14T11:10:39.198 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.199+0000 7f6003f23800 20 add_watcher() i=2 2024-09-14T11:10:39.198 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.199+0000 7f6003f23800 20 add_watcher() i=3 2024-09-14T11:10:39.198 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.199+0000 7f6003f23800 20 add_watcher() i=4 2024-09-14T11:10:39.198 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.199+0000 7f6003f23800 20 add_watcher() i=5 2024-09-14T11:10:39.199 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.200+0000 7f6003f23800 20 add_watcher() i=6 2024-09-14T11:10:39.200 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.201+0000 7f6003f23800 20 add_watcher() i=7 2024-09-14T11:10:39.200 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.201+0000 7f6003f23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:39.201 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.203+0000 7f5eb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:39.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.203+0000 7f6003f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:39.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.203+0000 7f6003f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:39.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.203+0000 7f6003f23800 5 note: GC not initialized 2024-09-14T11:10:39.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.204+0000 7f5eb4fe1640 20 reqs_thread_entry: start 2024-09-14T11:10:39.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.204+0000 7f6003f23800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:39.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.204+0000 7f6003f23800 20 Filter name: none 2024-09-14T11:10:39.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.204+0000 7f5e2e7fc640 20 reqs_thread_entry: start 2024-09-14T11:10:39.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.204+0000 7f6003f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:39.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.204+0000 7f6003f23800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:10:39.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.204+0000 7f6003f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:39.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.205+0000 7f6003f23800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:10:39.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.205+0000 7f6003f23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:39.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.205+0000 7f6003f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:39.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.205+0000 7f6003f23800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:10:39.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.205+0000 7f6003f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:39.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.205+0000 7f6003f23800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:10:39.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.205+0000 7f6003f23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:39.206 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.207+0000 7f5eb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:39.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.209+0000 7f6003f23800 20 remove_watcher() i=0 2024-09-14T11:10:39.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.209+0000 7f6003f23800 2 removed watcher, disabling cache 2024-09-14T11:10:39.208 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.210+0000 7f6003f23800 20 remove_watcher() i=1 2024-09-14T11:10:39.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.211+0000 7f6003f23800 20 remove_watcher() i=2 2024-09-14T11:10:39.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.212+0000 7f6003f23800 20 remove_watcher() i=3 2024-09-14T11:10:39.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.214+0000 7f6003f23800 20 remove_watcher() i=4 2024-09-14T11:10:39.213 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.215+0000 7f6003f23800 20 remove_watcher() i=5 2024-09-14T11:10:39.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.216+0000 7f6003f23800 20 remove_watcher() i=6 2024-09-14T11:10:39.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:39.217+0000 7f6003f23800 20 remove_watcher() i=7 2024-09-14T11:10:39.227 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:39.227 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:10:39.227 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-trim-reshard-log-entries id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:10:39.227 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:39.229 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:39.229 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:39.250 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:39.250 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:39.485 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:39.486 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:39.618 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-14T11:10:39.619 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:39.621 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:39.621 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:39.668 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:39.668 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:39.726 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:39.726 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:39.766 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:39.766 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:39.802 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:39.802 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:39.839 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:39.839 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:39.876 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:39.876 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:39.913 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:39.913 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:39.950 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:39.950 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:39.987 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:39.988 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:40.025 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:40.025 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:40.061 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:40.061 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:40.099 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:40.099 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:40.136 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:40.136 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:40.173 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:40.173 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:40.210 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:40.210 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:40.250 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:40.250 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:40.287 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:40.287 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:40.323 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:40.324 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:40.361 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:40.361 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:40.398 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:40.399 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:40.435 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:40.436 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:40.474 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:10:40.503 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:40.503 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:40.542 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.544+0000 7f065ff22800 20 rados->read ofs=0 len=0 2024-09-14T11:10:40.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.546+0000 7f065ff22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:40.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.546+0000 7f065ff22800 20 realm 2024-09-14T11:10:40.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.546+0000 7f065ff22800 20 rados->read ofs=0 len=0 2024-09-14T11:10:40.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.546+0000 7f065ff22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:40.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.546+0000 7f065ff22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:40.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.546+0000 7f065ff22800 20 rados->read ofs=0 len=0 2024-09-14T11:10:40.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.547+0000 7f065ff22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:40.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.547+0000 7f065ff22800 20 rados->read ofs=0 len=0 2024-09-14T11:10:40.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.547+0000 7f065ff22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:40.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.547+0000 7f065ff22800 20 rados->read ofs=0 len=0 2024-09-14T11:10:40.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.548+0000 7f065ff22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:40.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.548+0000 7f065ff22800 20 searching for the correct realm 2024-09-14T11:10:40.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.551+0000 7f065b467640 0 -- 172.21.15.50:0/2638097483 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f06540283c0 msgr2=0x7f0654028840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:40.754 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.756+0000 7f065c469640 0 -- 172.21.15.50:0/2638097483 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55ec84645300 msgr2=0x55ec84647750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:40.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.760+0000 7f065ff22800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:10:40.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.760+0000 7f065ff22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:40.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.760+0000 7f065ff22800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:10:40.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.760+0000 7f065ff22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:40.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.760+0000 7f065ff22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:40.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.760+0000 7f065ff22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:40.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.760+0000 7f065ff22800 20 rados->read ofs=0 len=0 2024-09-14T11:10:40.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.761+0000 7f065ff22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:40.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.761+0000 7f065ff22800 20 rados->read ofs=0 len=0 2024-09-14T11:10:40.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.761+0000 7f065ff22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:40.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.761+0000 7f065ff22800 20 rados->read ofs=0 len=0 2024-09-14T11:10:40.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.761+0000 7f065ff22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:40.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.761+0000 7f065ff22800 20 zone default found 2024-09-14T11:10:40.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.761+0000 7f065ff22800 4 Realm: () 2024-09-14T11:10:40.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.761+0000 7f065ff22800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:10:40.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.761+0000 7f065ff22800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:10:40.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.761+0000 7f065ff22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:40.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.761+0000 7f065ff22800 20 zonegroup default 2024-09-14T11:10:40.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.761+0000 7f065ff22800 20 rados->read ofs=0 len=0 2024-09-14T11:10:40.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.762+0000 7f065ff22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:40.762 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.762+0000 7f065ff22800 20 rados->read ofs=0 len=0 2024-09-14T11:10:40.762 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.762+0000 7f065ff22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:40.762 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.762+0000 7f065ff22800 20 rados->read ofs=0 len=0 2024-09-14T11:10:40.762 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.762+0000 7f065ff22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:40.762 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.762+0000 7f065ff22800 20 started sync module instance, tier type = 2024-09-14T11:10:40.762 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.762+0000 7f065ff22800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:10:40.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.772+0000 7f065ff22800 20 add_watcher() i=0 2024-09-14T11:10:40.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.772+0000 7f065ff22800 20 add_watcher() i=1 2024-09-14T11:10:40.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.772+0000 7f065ff22800 20 add_watcher() i=2 2024-09-14T11:10:40.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.772+0000 7f065ff22800 20 add_watcher() i=3 2024-09-14T11:10:40.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.772+0000 7f065ff22800 20 add_watcher() i=4 2024-09-14T11:10:40.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.772+0000 7f065ff22800 20 add_watcher() i=5 2024-09-14T11:10:40.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.772+0000 7f065ff22800 20 add_watcher() i=6 2024-09-14T11:10:40.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.772+0000 7f065ff22800 20 add_watcher() i=7 2024-09-14T11:10:40.771 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.772+0000 7f065ff22800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:40.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.774+0000 7f0511fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:40.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.775+0000 7f065ff22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:40.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.775+0000 7f065ff22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:40.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.775+0000 7f065ff22800 5 note: GC not initialized 2024-09-14T11:10:40.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.775+0000 7f0510fe1640 20 reqs_thread_entry: start 2024-09-14T11:10:40.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.775+0000 7f065ff22800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:40.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.775+0000 7f065ff22800 20 Filter name: none 2024-09-14T11:10:40.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.775+0000 7f048a7fc640 20 reqs_thread_entry: start 2024-09-14T11:10:40.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.776+0000 7f065ff22800 20 rados->read ofs=0 len=0 2024-09-14T11:10:40.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.776+0000 7f065ff22800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:10:40.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.776+0000 7f065ff22800 20 rados->read ofs=0 len=0 2024-09-14T11:10:40.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.776+0000 7f065ff22800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:10:40.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.776+0000 7f065ff22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:40.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.776+0000 7f065ff22800 20 rados->read ofs=0 len=0 2024-09-14T11:10:40.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.777+0000 7f065ff22800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:10:40.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.777+0000 7f065ff22800 20 rados->read ofs=0 len=0 2024-09-14T11:10:40.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.777+0000 7f065ff22800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:10:40.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.777+0000 7f065ff22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:40.777 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.779+0000 7f0511fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:40.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.781+0000 7f065ff22800 20 remove_watcher() i=0 2024-09-14T11:10:40.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.781+0000 7f065ff22800 2 removed watcher, disabling cache 2024-09-14T11:10:40.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.782+0000 7f065ff22800 20 remove_watcher() i=1 2024-09-14T11:10:40.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.783+0000 7f065ff22800 20 remove_watcher() i=2 2024-09-14T11:10:40.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.784+0000 7f065ff22800 20 remove_watcher() i=3 2024-09-14T11:10:40.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.785+0000 7f065ff22800 20 remove_watcher() i=4 2024-09-14T11:10:40.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.786+0000 7f065ff22800 20 remove_watcher() i=5 2024-09-14T11:10:40.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.787+0000 7f065ff22800 20 remove_watcher() i=6 2024-09-14T11:10:40.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.788+0000 7f065ff22800 20 remove_watcher() i=7 2024-09-14T11:10:40.797 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:40.797 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:10:40.797 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: abort-at-trim-reshard-log-entries id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:10:40.798 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:40.799 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-14T11:10:40.833 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:40.834 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:40.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.875+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:40.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.876+0000 7f6ac7f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:40.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.876+0000 7f6ac7f26800 20 realm 2024-09-14T11:10:40.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.876+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:40.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.877+0000 7f6ac7f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:40.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.877+0000 7f6ac7f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:40.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.877+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:40.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.877+0000 7f6ac7f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:40.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.877+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:40.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.878+0000 7f6ac7f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:40.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.878+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:40.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.878+0000 7f6ac7f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:40.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.878+0000 7f6ac7f26800 20 searching for the correct realm 2024-09-14T11:10:40.879 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:40.881+0000 7f6ac33d8640 0 -- 172.21.15.50:0/3641330477 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f6abc06c0b0 msgr2=0x7f6abc070910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:41.084 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.086+0000 7f6ac33d8640 0 -- 172.21.15.50:0/3641330477 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x56294b9c7840 msgr2=0x56294b9c9cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:41.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.089+0000 7f6ac7f26800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:10:41.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.089+0000 7f6ac7f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:41.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.089+0000 7f6ac7f26800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:10:41.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.089+0000 7f6ac7f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:41.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.089+0000 7f6ac7f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:41.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.089+0000 7f6ac7f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:41.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.089+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.090+0000 7f6ac7f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.090+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.090+0000 7f6ac7f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:41.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.090+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.090+0000 7f6ac7f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:41.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.090+0000 7f6ac7f26800 20 zone default found 2024-09-14T11:10:41.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.090+0000 7f6ac7f26800 4 Realm: () 2024-09-14T11:10:41.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.090+0000 7f6ac7f26800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:10:41.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.090+0000 7f6ac7f26800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:10:41.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.090+0000 7f6ac7f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:41.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.090+0000 7f6ac7f26800 20 zonegroup default 2024-09-14T11:10:41.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.090+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.091+0000 7f6ac7f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.091+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.091+0000 7f6ac7f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.091+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.091+0000 7f6ac7f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.091+0000 7f6ac7f26800 20 started sync module instance, tier type = 2024-09-14T11:10:41.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.091+0000 7f6ac7f26800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:10:41.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.100+0000 7f6ac7f26800 20 add_watcher() i=0 2024-09-14T11:10:41.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.100+0000 7f6ac7f26800 20 add_watcher() i=1 2024-09-14T11:10:41.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.100+0000 7f6ac7f26800 20 add_watcher() i=2 2024-09-14T11:10:41.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.100+0000 7f6ac7f26800 20 add_watcher() i=3 2024-09-14T11:10:41.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.100+0000 7f6ac7f26800 20 add_watcher() i=4 2024-09-14T11:10:41.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.100+0000 7f6ac7f26800 20 add_watcher() i=5 2024-09-14T11:10:41.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.100+0000 7f6ac7f26800 20 add_watcher() i=6 2024-09-14T11:10:41.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.101+0000 7f6ac7f26800 20 add_watcher() i=7 2024-09-14T11:10:41.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.101+0000 7f6ac7f26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:41.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.103+0000 7f6979fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:41.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.104+0000 7f6ac7f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:41.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.104+0000 7f6ac7f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:41.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.104+0000 7f6ac7f26800 5 note: GC not initialized 2024-09-14T11:10:41.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.104+0000 7f6978fe1640 20 reqs_thread_entry: start 2024-09-14T11:10:41.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.104+0000 7f6ac7f26800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:41.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.104+0000 7f6ac7f26800 20 Filter name: none 2024-09-14T11:10:41.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.104+0000 7f68f27fc640 20 reqs_thread_entry: start 2024-09-14T11:10:41.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.104+0000 7f6ac7f26800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:10:41.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.104+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.105+0000 7f6ac7f26800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:10:41.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.105+0000 7f6ac7f26800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:10:41.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.105+0000 7f6ac7f26800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:10:41.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.105+0000 7f6ac7f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 : miss 2024-09-14T11:10:41.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.105+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.105+0000 7f6ac7f26800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:10:41.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.105+0000 7f6ac7f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 info.flags=0x17 2024-09-14T11:10:41.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.105+0000 7f6ac7f26800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 to cache LRU end 2024-09-14T11:10:41.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.105+0000 7f6ac7f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:10:41.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.105+0000 7f6ac7f26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:41.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.105+0000 7f6ac7f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 2024-09-14T11:10:41.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.110+0000 7f6ac7f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 info.flags=0x17 2024-09-14T11:10:41.108 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.110+0000 7f6ac7f26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 to cache LRU end 2024-09-14T11:10:41.109 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.110+0000 7f6ac7f26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:41.109 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.110+0000 7f6ac7f26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28, ofs0, ns] 2024-09-14T11:10:41.109 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.111+0000 7f69a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497073 cookie 94735362258224 notifier 6957 bl.length()=1023 2024-09-14T11:10:41.109 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.111+0000 7f69a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 info.flags=0x17 2024-09-14T11:10:41.109 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.111+0000 7f69a2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 to cache LRU end 2024-09-14T11:10:41.109 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.111+0000 7f69a2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:41.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.112+0000 7f6ac7f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28]): orig_sources= new_sources= 2024-09-14T11:10:41.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.112+0000 7f6ac7f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28]): potential sources added=[] removed=[] 2024-09-14T11:10:41.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.112+0000 7f6ac7f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28]): orig_dests= new_dests= 2024-09-14T11:10:41.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.112+0000 7f6ac7f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28]): potential dests added=[] removed=[] 2024-09-14T11:10:41.111 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6ac7f26800 time 2024-09-14T11:10:41.113212+0000 2024-09-14T11:10:41.111 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:10:41.112 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:10:41.112 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6ac958c76a] 2024-09-14T11:10:41.112 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6ac958c928] 2024-09-14T11:10:41.112 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56294a2e90b1] 2024-09-14T11:10:41.112 INFO:tasks.workunit.client.0.smithi050.stderr: 4: radosgw-admin(+0xd8900e) [0x56294a7fd00e] 2024-09-14T11:10:41.113 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56294a2f8efd] 2024-09-14T11:10:41.113 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:10:41.113 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6ac8229590] 2024-09-14T11:10:41.113 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:10:41.113 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:10:41.113 INFO:tasks.workunit.client.0.smithi050.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:10:41.114 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f6ac7f26800 thread_name:radosgw-admin 2024-09-14T11:10:41.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.113+0000 7f6ac7f26800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6ac7f26800 time 2024-09-14T11:10:41.113212+0000 2024-09-14T11:10:41.114 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:10:41.114 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.115 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:10:41.115 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6ac958c76a] 2024-09-14T11:10:41.115 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6ac958c928] 2024-09-14T11:10:41.115 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56294a2e90b1] 2024-09-14T11:10:41.115 INFO:tasks.workunit.client.0.smithi050.stderr: 4: radosgw-admin(+0xd8900e) [0x56294a7fd00e] 2024-09-14T11:10:41.115 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56294a2f8efd] 2024-09-14T11:10:41.115 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:10:41.115 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6ac8229590] 2024-09-14T11:10:41.115 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:10:41.115 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:10:41.115 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.130 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:10:41.130 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6ac823e6f0] 2024-09-14T11:10:41.131 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6ac828b99c] 2024-09-14T11:10:41.131 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:10:41.131 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:10:41.131 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6ac958c7c4] 2024-09-14T11:10:41.131 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6ac958c928] 2024-09-14T11:10:41.131 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56294a2e90b1] 2024-09-14T11:10:41.131 INFO:tasks.workunit.client.0.smithi050.stderr: 8: radosgw-admin(+0xd8900e) [0x56294a7fd00e] 2024-09-14T11:10:41.131 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56294a2f8efd] 2024-09-14T11:10:41.131 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:10:41.131 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6ac8229590] 2024-09-14T11:10:41.131 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:10:41.131 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:10:41.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.114+0000 7f6ac7f26800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:10:41.132 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f6ac7f26800 thread_name:radosgw-admin 2024-09-14T11:10:41.132 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.132 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:10:41.132 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6ac823e6f0] 2024-09-14T11:10:41.132 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6ac828b99c] 2024-09-14T11:10:41.132 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:10:41.132 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:10:41.132 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6ac958c7c4] 2024-09-14T11:10:41.132 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6ac958c928] 2024-09-14T11:10:41.132 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56294a2e90b1] 2024-09-14T11:10:41.132 INFO:tasks.workunit.client.0.smithi050.stderr: 8: radosgw-admin(+0xd8900e) [0x56294a7fd00e] 2024-09-14T11:10:41.133 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56294a2f8efd] 2024-09-14T11:10:41.133 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:10:41.133 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6ac8229590] 2024-09-14T11:10:41.133 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:10:41.133 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:10:41.133 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:10:41.133 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.133 INFO:tasks.workunit.client.0.smithi050.stderr:--- begin dump of recent events --- 2024-09-14T11:10:41.133 INFO:tasks.workunit.client.0.smithi050.stderr: -499> 2024-09-14T11:10:40.857+0000 7f69b1e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:41.133 INFO:tasks.workunit.client.0.smithi050.stderr: -498> 2024-09-14T11:10:40.857+0000 7f69b1e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:10:41.133 INFO:tasks.workunit.client.0.smithi050.stderr: -497> 2024-09-14T11:10:40.857+0000 7f69b1e0b640 10 monclient: dump: 2024-09-14T11:10:41.133 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:41.133 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:41.134 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.134 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.134 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:41.134 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.134 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:41.134 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:41.134 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:41.134 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.134 INFO:tasks.workunit.client.0.smithi050.stderr: -496> 2024-09-14T11:10:40.857+0000 7f6ac7f26800 5 monclient: authenticate success, global_id 6945 2024-09-14T11:10:41.134 INFO:tasks.workunit.client.0.smithi050.stderr: -495> 2024-09-14T11:10:40.857+0000 7f6ac7f26800 10 monclient: get_monmap_and_config success 2024-09-14T11:10:41.134 INFO:tasks.workunit.client.0.smithi050.stderr: -494> 2024-09-14T11:10:40.857+0000 7f6ac7f26800 4 set_mon_vals no callback set 2024-09-14T11:10:41.134 INFO:tasks.workunit.client.0.smithi050.stderr: -493> 2024-09-14T11:10:40.857+0000 7f6ac7f26800 10 monclient: shutdown 2024-09-14T11:10:41.134 INFO:tasks.workunit.client.0.smithi050.stderr: -492> 2024-09-14T11:10:40.857+0000 7f6ac7f26800 5 asok(0x56294b6bc270) unregister_commands rotate-key 2024-09-14T11:10:41.134 INFO:tasks.workunit.client.0.smithi050.stderr: -491> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 10 monclient: build_initial_monmap 2024-09-14T11:10:41.135 INFO:tasks.workunit.client.0.smithi050.stderr: -490> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 1 build_initial for_mkfs: 0 2024-09-14T11:10:41.135 INFO:tasks.workunit.client.0.smithi050.stderr: -489> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 10 monclient: monmap: 2024-09-14T11:10:41.135 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:10:41.135 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:10:41.135 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:10:41.135 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:10:41.135 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:10:41.135 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.135 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:10:41.135 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:10:41.135 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:10:41.135 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.135 INFO:tasks.workunit.client.0.smithi050.stderr: -488> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding auth protocol: cephx 2024-09-14T11:10:41.135 INFO:tasks.workunit.client.0.smithi050.stderr: -487> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding auth protocol: cephx 2024-09-14T11:10:41.135 INFO:tasks.workunit.client.0.smithi050.stderr: -486> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding auth protocol: cephx 2024-09-14T11:10:41.136 INFO:tasks.workunit.client.0.smithi050.stderr: -485> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding con mode: secure 2024-09-14T11:10:41.136 INFO:tasks.workunit.client.0.smithi050.stderr: -484> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding con mode: crc 2024-09-14T11:10:41.136 INFO:tasks.workunit.client.0.smithi050.stderr: -483> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding con mode: secure 2024-09-14T11:10:41.136 INFO:tasks.workunit.client.0.smithi050.stderr: -482> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding con mode: crc 2024-09-14T11:10:41.136 INFO:tasks.workunit.client.0.smithi050.stderr: -481> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding con mode: secure 2024-09-14T11:10:41.136 INFO:tasks.workunit.client.0.smithi050.stderr: -480> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding con mode: crc 2024-09-14T11:10:41.136 INFO:tasks.workunit.client.0.smithi050.stderr: -479> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding con mode: crc 2024-09-14T11:10:41.136 INFO:tasks.workunit.client.0.smithi050.stderr: -478> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding con mode: secure 2024-09-14T11:10:41.136 INFO:tasks.workunit.client.0.smithi050.stderr: -477> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding con mode: crc 2024-09-14T11:10:41.136 INFO:tasks.workunit.client.0.smithi050.stderr: -476> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding con mode: secure 2024-09-14T11:10:41.136 INFO:tasks.workunit.client.0.smithi050.stderr: -475> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding con mode: crc 2024-09-14T11:10:41.136 INFO:tasks.workunit.client.0.smithi050.stderr: -474> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding con mode: secure 2024-09-14T11:10:41.136 INFO:tasks.workunit.client.0.smithi050.stderr: -473> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.137 INFO:tasks.workunit.client.0.smithi050.stderr: -472> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 1 librados: starting msgr at 2024-09-14T11:10:41.137 INFO:tasks.workunit.client.0.smithi050.stderr: -471> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 1 librados: starting objecter 2024-09-14T11:10:41.137 INFO:tasks.workunit.client.0.smithi050.stderr: -470> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command objecter_requests hook 0x56294b8dfad0 2024-09-14T11:10:41.137 INFO:tasks.workunit.client.0.smithi050.stderr: -469> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 1 librados: setting wanted keys 2024-09-14T11:10:41.137 INFO:tasks.workunit.client.0.smithi050.stderr: -468> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 1 librados: calling monclient init 2024-09-14T11:10:41.137 INFO:tasks.workunit.client.0.smithi050.stderr: -467> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 10 monclient: init 2024-09-14T11:10:41.137 INFO:tasks.workunit.client.0.smithi050.stderr: -466> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding auth protocol: cephx 2024-09-14T11:10:41.137 INFO:tasks.workunit.client.0.smithi050.stderr: -465> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding auth protocol: cephx 2024-09-14T11:10:41.137 INFO:tasks.workunit.client.0.smithi050.stderr: -464> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding auth protocol: cephx 2024-09-14T11:10:41.137 INFO:tasks.workunit.client.0.smithi050.stderr: -463> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding con mode: secure 2024-09-14T11:10:41.137 INFO:tasks.workunit.client.0.smithi050.stderr: -462> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding con mode: crc 2024-09-14T11:10:41.137 INFO:tasks.workunit.client.0.smithi050.stderr: -461> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding con mode: secure 2024-09-14T11:10:41.137 INFO:tasks.workunit.client.0.smithi050.stderr: -460> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding con mode: crc 2024-09-14T11:10:41.137 INFO:tasks.workunit.client.0.smithi050.stderr: -459> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding con mode: secure 2024-09-14T11:10:41.138 INFO:tasks.workunit.client.0.smithi050.stderr: -458> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding con mode: crc 2024-09-14T11:10:41.138 INFO:tasks.workunit.client.0.smithi050.stderr: -457> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding con mode: crc 2024-09-14T11:10:41.138 INFO:tasks.workunit.client.0.smithi050.stderr: -456> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding con mode: secure 2024-09-14T11:10:41.138 INFO:tasks.workunit.client.0.smithi050.stderr: -455> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding con mode: crc 2024-09-14T11:10:41.138 INFO:tasks.workunit.client.0.smithi050.stderr: -454> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding con mode: secure 2024-09-14T11:10:41.138 INFO:tasks.workunit.client.0.smithi050.stderr: -453> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding con mode: crc 2024-09-14T11:10:41.138 INFO:tasks.workunit.client.0.smithi050.stderr: -452> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding con mode: secure 2024-09-14T11:10:41.138 INFO:tasks.workunit.client.0.smithi050.stderr: -451> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.138 INFO:tasks.workunit.client.0.smithi050.stderr: -450> 2024-09-14T11:10:40.859+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.138 INFO:tasks.workunit.client.0.smithi050.stderr: -449> 2024-09-14T11:10:40.859+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command rotate-key hook 0x56294b8dce18 2024-09-14T11:10:41.138 INFO:tasks.workunit.client.0.smithi050.stderr: -448> 2024-09-14T11:10:40.859+0000 7f6ac7f26800 10 monclient: _reopen_session rank -1 2024-09-14T11:10:41.138 INFO:tasks.workunit.client.0.smithi050.stderr: -447> 2024-09-14T11:10:40.859+0000 7f6ac7f26800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:10:41.138 INFO:tasks.workunit.client.0.smithi050.stderr: -446> 2024-09-14T11:10:40.859+0000 7f6ac7f26800 10 monclient(hunting): picked mon.noname-a con 0x56294b767df0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:10:41.139 INFO:tasks.workunit.client.0.smithi050.stderr: -445> 2024-09-14T11:10:40.859+0000 7f6ac7f26800 10 monclient(hunting): picked mon.noname-b con 0x56294b78a200 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:10:41.139 INFO:tasks.workunit.client.0.smithi050.stderr: -444> 2024-09-14T11:10:40.859+0000 7f6ac7f26800 10 monclient(hunting): picked mon.noname-c con 0x56294b825990 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:10:41.139 INFO:tasks.workunit.client.0.smithi050.stderr: -443> 2024-09-14T11:10:40.859+0000 7f6ac7f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:41.139 INFO:tasks.workunit.client.0.smithi050.stderr: -442> 2024-09-14T11:10:40.859+0000 7f6ac7f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:41.139 INFO:tasks.workunit.client.0.smithi050.stderr: -441> 2024-09-14T11:10:40.859+0000 7f6ac7f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:41.139 INFO:tasks.workunit.client.0.smithi050.stderr: -440> 2024-09-14T11:10:40.859+0000 7f6ac7f26800 10 monclient(hunting): _renew_subs 2024-09-14T11:10:41.139 INFO:tasks.workunit.client.0.smithi050.stderr: -439> 2024-09-14T11:10:40.859+0000 7f6ac7f26800 10 monclient(hunting): authenticate will time out at 2293.496189s 2024-09-14T11:10:41.139 INFO:tasks.workunit.client.0.smithi050.stderr: -438> 2024-09-14T11:10:40.859+0000 7f6ac3bd9640 10 monclient(hunting): get_auth_request con 0x56294b767df0 auth_method 0 2024-09-14T11:10:41.139 INFO:tasks.workunit.client.0.smithi050.stderr: -437> 2024-09-14T11:10:40.859+0000 7f6ac3bd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:41.139 INFO:tasks.workunit.client.0.smithi050.stderr: -436> 2024-09-14T11:10:40.859+0000 7f6ac3bd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:41.139 INFO:tasks.workunit.client.0.smithi050.stderr: -435> 2024-09-14T11:10:40.859+0000 7f6ac3bd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:41.139 INFO:tasks.workunit.client.0.smithi050.stderr: -434> 2024-09-14T11:10:40.859+0000 7f6ac43da640 10 monclient(hunting): get_auth_request con 0x56294b825990 auth_method 0 2024-09-14T11:10:41.140 INFO:tasks.workunit.client.0.smithi050.stderr: -433> 2024-09-14T11:10:40.859+0000 7f6ac43da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:41.140 INFO:tasks.workunit.client.0.smithi050.stderr: -432> 2024-09-14T11:10:40.859+0000 7f6ac43da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:41.140 INFO:tasks.workunit.client.0.smithi050.stderr: -431> 2024-09-14T11:10:40.859+0000 7f6ac43da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:41.140 INFO:tasks.workunit.client.0.smithi050.stderr: -430> 2024-09-14T11:10:40.859+0000 7f6ac3bd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:41.140 INFO:tasks.workunit.client.0.smithi050.stderr: -429> 2024-09-14T11:10:40.859+0000 7f6ac3bd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:41.140 INFO:tasks.workunit.client.0.smithi050.stderr: -428> 2024-09-14T11:10:40.859+0000 7f6ac3bd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:41.140 INFO:tasks.workunit.client.0.smithi050.stderr: -427> 2024-09-14T11:10:40.859+0000 7f6ac43da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:41.140 INFO:tasks.workunit.client.0.smithi050.stderr: -426> 2024-09-14T11:10:40.859+0000 7f6ac43da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:41.140 INFO:tasks.workunit.client.0.smithi050.stderr: -425> 2024-09-14T11:10:40.859+0000 7f6ac43da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:41.140 INFO:tasks.workunit.client.0.smithi050.stderr: -424> 2024-09-14T11:10:40.859+0000 7f6ac33d8640 10 monclient(hunting): get_auth_request con 0x56294b78a200 auth_method 0 2024-09-14T11:10:41.140 INFO:tasks.workunit.client.0.smithi050.stderr: -423> 2024-09-14T11:10:40.859+0000 7f6ac33d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:41.140 INFO:tasks.workunit.client.0.smithi050.stderr: -422> 2024-09-14T11:10:40.859+0000 7f6ac33d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:41.140 INFO:tasks.workunit.client.0.smithi050.stderr: -421> 2024-09-14T11:10:40.859+0000 7f6ac33d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:41.141 INFO:tasks.workunit.client.0.smithi050.stderr: -420> 2024-09-14T11:10:40.859+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:41.141 INFO:tasks.workunit.client.0.smithi050.stderr: -419> 2024-09-14T11:10:40.859+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:41.141 INFO:tasks.workunit.client.0.smithi050.stderr: -418> 2024-09-14T11:10:40.859+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:41.141 INFO:tasks.workunit.client.0.smithi050.stderr: -417> 2024-09-14T11:10:40.859+0000 7f6ac3bd9640 10 monclient(hunting): handle_auth_done global_id 6948 payload 824 2024-09-14T11:10:41.141 INFO:tasks.workunit.client.0.smithi050.stderr: -416> 2024-09-14T11:10:40.859+0000 7f6ac3bd9640 10 monclient: _finish_hunting 0 2024-09-14T11:10:41.141 INFO:tasks.workunit.client.0.smithi050.stderr: -415> 2024-09-14T11:10:40.859+0000 7f6ac3bd9640 1 monclient: found mon.noname-a 2024-09-14T11:10:41.141 INFO:tasks.workunit.client.0.smithi050.stderr: -414> 2024-09-14T11:10:40.859+0000 7f6ac3bd9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:10:41.141 INFO:tasks.workunit.client.0.smithi050.stderr: -413> 2024-09-14T11:10:40.859+0000 7f69abfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:41.141 INFO:tasks.workunit.client.0.smithi050.stderr: -412> 2024-09-14T11:10:40.859+0000 7f69abfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:10:41.141 INFO:tasks.workunit.client.0.smithi050.stderr: -411> 2024-09-14T11:10:40.859+0000 7f69abfff640 10 monclient: dump: 2024-09-14T11:10:41.141 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:41.141 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:41.141 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.142 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.142 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:41.142 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.142 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:41.142 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:41.142 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:41.142 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.142 INFO:tasks.workunit.client.0.smithi050.stderr: -410> 2024-09-14T11:10:40.860+0000 7f69abfff640 10 monclient: _finish_auth 0 2024-09-14T11:10:41.142 INFO:tasks.workunit.client.0.smithi050.stderr: -409> 2024-09-14T11:10:40.860+0000 7f69abfff640 10 monclient: _check_auth_tickets 2024-09-14T11:10:41.142 INFO:tasks.workunit.client.0.smithi050.stderr: -408> 2024-09-14T11:10:40.860+0000 7f6ac7f26800 5 monclient: authenticate success, global_id 6948 2024-09-14T11:10:41.142 INFO:tasks.workunit.client.0.smithi050.stderr: -407> 2024-09-14T11:10:40.860+0000 7f6ac7f26800 10 monclient: _renew_subs 2024-09-14T11:10:41.142 INFO:tasks.workunit.client.0.smithi050.stderr: -406> 2024-09-14T11:10:40.860+0000 7f6ac7f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:10:41.142 INFO:tasks.workunit.client.0.smithi050.stderr: -405> 2024-09-14T11:10:40.860+0000 7f69abfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:10:41.142 INFO:tasks.workunit.client.0.smithi050.stderr: -404> 2024-09-14T11:10:40.860+0000 7f69abfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:41.143 INFO:tasks.workunit.client.0.smithi050.stderr: -403> 2024-09-14T11:10:40.860+0000 7f69abfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:10:41.143 INFO:tasks.workunit.client.0.smithi050.stderr: -402> 2024-09-14T11:10:40.860+0000 7f69abfff640 10 monclient: dump: 2024-09-14T11:10:41.143 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:41.143 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:41.143 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.143 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.143 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:41.143 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.143 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:41.143 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:41.143 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:41.143 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.143 INFO:tasks.workunit.client.0.smithi050.stderr: -401> 2024-09-14T11:10:40.860+0000 7f69b1e0b640 4 set_mon_vals no callback set 2024-09-14T11:10:41.144 INFO:tasks.workunit.client.0.smithi050.stderr: -400> 2024-09-14T11:10:40.860+0000 7f6ac7f26800 10 monclient: _renew_subs 2024-09-14T11:10:41.144 INFO:tasks.workunit.client.0.smithi050.stderr: -399> 2024-09-14T11:10:40.860+0000 7f6ac7f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:10:41.144 INFO:tasks.workunit.client.0.smithi050.stderr: -398> 2024-09-14T11:10:40.860+0000 7f6ac7f26800 1 librados: init done 2024-09-14T11:10:41.144 INFO:tasks.workunit.client.0.smithi050.stderr: -397> 2024-09-14T11:10:40.862+0000 7f69abfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:10:41.144 INFO:tasks.workunit.client.0.smithi050.stderr: -396> 2024-09-14T11:10:40.862+0000 7f69abfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:10:41.144 INFO:tasks.workunit.client.0.smithi050.stderr: -395> 2024-09-14T11:10:40.862+0000 7f69abfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:10:41.144 INFO:tasks.workunit.client.0.smithi050.stderr: -394> 2024-09-14T11:10:40.862+0000 7f6ac33d8640 10 monclient: get_auth_request con 0x7f69ac077230 auth_method 0 2024-09-14T11:10:41.144 INFO:tasks.workunit.client.0.smithi050.stderr: -393> 2024-09-14T11:10:40.862+0000 7f6ac43da640 10 monclient: get_auth_request con 0x56294b903b00 auth_method 0 2024-09-14T11:10:41.144 INFO:tasks.workunit.client.0.smithi050.stderr: -392> 2024-09-14T11:10:40.863+0000 7f6ac3bd9640 10 monclient: get_auth_request con 0x56294b9282b0 auth_method 0 2024-09-14T11:10:41.144 INFO:tasks.workunit.client.0.smithi050.stderr: -391> 2024-09-14T11:10:40.864+0000 7f6ac33d8640 10 monclient: get_auth_request con 0x56294b92c950 auth_method 0 2024-09-14T11:10:41.144 INFO:tasks.workunit.client.0.smithi050.stderr: -390> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 10 monclient: build_initial_monmap 2024-09-14T11:10:41.144 INFO:tasks.workunit.client.0.smithi050.stderr: -389> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 1 build_initial for_mkfs: 0 2024-09-14T11:10:41.144 INFO:tasks.workunit.client.0.smithi050.stderr: -388> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 10 monclient: monmap: 2024-09-14T11:10:41.145 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:10:41.145 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:10:41.145 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:10:41.145 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:10:41.145 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:10:41.145 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.145 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:10:41.145 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:10:41.145 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:10:41.145 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.145 INFO:tasks.workunit.client.0.smithi050.stderr: -387> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding auth protocol: cephx 2024-09-14T11:10:41.145 INFO:tasks.workunit.client.0.smithi050.stderr: -386> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding auth protocol: cephx 2024-09-14T11:10:41.146 INFO:tasks.workunit.client.0.smithi050.stderr: -385> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding auth protocol: cephx 2024-09-14T11:10:41.146 INFO:tasks.workunit.client.0.smithi050.stderr: -384> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding con mode: secure 2024-09-14T11:10:41.146 INFO:tasks.workunit.client.0.smithi050.stderr: -383> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding con mode: crc 2024-09-14T11:10:41.146 INFO:tasks.workunit.client.0.smithi050.stderr: -382> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding con mode: secure 2024-09-14T11:10:41.146 INFO:tasks.workunit.client.0.smithi050.stderr: -381> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding con mode: crc 2024-09-14T11:10:41.146 INFO:tasks.workunit.client.0.smithi050.stderr: -380> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding con mode: secure 2024-09-14T11:10:41.146 INFO:tasks.workunit.client.0.smithi050.stderr: -379> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding con mode: crc 2024-09-14T11:10:41.146 INFO:tasks.workunit.client.0.smithi050.stderr: -378> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding con mode: crc 2024-09-14T11:10:41.147 INFO:tasks.workunit.client.0.smithi050.stderr: -377> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding con mode: secure 2024-09-14T11:10:41.147 INFO:tasks.workunit.client.0.smithi050.stderr: -376> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding con mode: crc 2024-09-14T11:10:41.147 INFO:tasks.workunit.client.0.smithi050.stderr: -375> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding con mode: secure 2024-09-14T11:10:41.147 INFO:tasks.workunit.client.0.smithi050.stderr: -374> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding con mode: crc 2024-09-14T11:10:41.147 INFO:tasks.workunit.client.0.smithi050.stderr: -373> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding con mode: secure 2024-09-14T11:10:41.147 INFO:tasks.workunit.client.0.smithi050.stderr: -372> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.148 INFO:tasks.workunit.client.0.smithi050.stderr: -371> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command objecter_requests cmddesc objecter_requests hook 0x56294b934c50 EEXIST 2024-09-14T11:10:41.148 INFO:tasks.workunit.client.0.smithi050.stderr: -370> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 10 monclient: init 2024-09-14T11:10:41.148 INFO:tasks.workunit.client.0.smithi050.stderr: -369> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding auth protocol: cephx 2024-09-14T11:10:41.148 INFO:tasks.workunit.client.0.smithi050.stderr: -368> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding auth protocol: cephx 2024-09-14T11:10:41.148 INFO:tasks.workunit.client.0.smithi050.stderr: -367> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding auth protocol: cephx 2024-09-14T11:10:41.148 INFO:tasks.workunit.client.0.smithi050.stderr: -366> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding con mode: secure 2024-09-14T11:10:41.148 INFO:tasks.workunit.client.0.smithi050.stderr: -365> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding con mode: crc 2024-09-14T11:10:41.148 INFO:tasks.workunit.client.0.smithi050.stderr: -364> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding con mode: secure 2024-09-14T11:10:41.148 INFO:tasks.workunit.client.0.smithi050.stderr: -363> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding con mode: crc 2024-09-14T11:10:41.148 INFO:tasks.workunit.client.0.smithi050.stderr: -362> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding con mode: secure 2024-09-14T11:10:41.148 INFO:tasks.workunit.client.0.smithi050.stderr: -361> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding con mode: crc 2024-09-14T11:10:41.148 INFO:tasks.workunit.client.0.smithi050.stderr: -360> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding con mode: crc 2024-09-14T11:10:41.149 INFO:tasks.workunit.client.0.smithi050.stderr: -359> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding con mode: secure 2024-09-14T11:10:41.149 INFO:tasks.workunit.client.0.smithi050.stderr: -358> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding con mode: crc 2024-09-14T11:10:41.149 INFO:tasks.workunit.client.0.smithi050.stderr: -357> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding con mode: secure 2024-09-14T11:10:41.149 INFO:tasks.workunit.client.0.smithi050.stderr: -356> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding con mode: crc 2024-09-14T11:10:41.149 INFO:tasks.workunit.client.0.smithi050.stderr: -355> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding con mode: secure 2024-09-14T11:10:41.149 INFO:tasks.workunit.client.0.smithi050.stderr: -354> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.149 INFO:tasks.workunit.client.0.smithi050.stderr: -353> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.149 INFO:tasks.workunit.client.0.smithi050.stderr: -352> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command rotate-key cmddesc rotate-key hook 0x56294b92fe30 EEXIST 2024-09-14T11:10:41.149 INFO:tasks.workunit.client.0.smithi050.stderr: -351> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 10 monclient: _reopen_session rank -1 2024-09-14T11:10:41.149 INFO:tasks.workunit.client.0.smithi050.stderr: -350> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:10:41.149 INFO:tasks.workunit.client.0.smithi050.stderr: -349> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 10 monclient(hunting): picked mon.noname-b con 0x56294b958f70 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:10:41.149 INFO:tasks.workunit.client.0.smithi050.stderr: -348> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 10 monclient(hunting): picked mon.noname-c con 0x56294b959350 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:10:41.149 INFO:tasks.workunit.client.0.smithi050.stderr: -347> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 10 monclient(hunting): picked mon.noname-a con 0x56294b957c80 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:10:41.150 INFO:tasks.workunit.client.0.smithi050.stderr: -346> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:41.150 INFO:tasks.workunit.client.0.smithi050.stderr: -345> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:41.150 INFO:tasks.workunit.client.0.smithi050.stderr: -344> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:41.150 INFO:tasks.workunit.client.0.smithi050.stderr: -343> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 10 monclient(hunting): _renew_subs 2024-09-14T11:10:41.150 INFO:tasks.workunit.client.0.smithi050.stderr: -342> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 10 monclient(hunting): authenticate will time out at 2293.503560s 2024-09-14T11:10:41.150 INFO:tasks.workunit.client.0.smithi050.stderr: -341> 2024-09-14T11:10:40.866+0000 7f6ac33d8640 10 monclient(hunting): get_auth_request con 0x56294b959350 auth_method 0 2024-09-14T11:10:41.150 INFO:tasks.workunit.client.0.smithi050.stderr: -340> 2024-09-14T11:10:40.866+0000 7f6ac33d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:41.150 INFO:tasks.workunit.client.0.smithi050.stderr: -339> 2024-09-14T11:10:40.866+0000 7f6ac33d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:41.150 INFO:tasks.workunit.client.0.smithi050.stderr: -338> 2024-09-14T11:10:40.866+0000 7f6ac33d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:41.150 INFO:tasks.workunit.client.0.smithi050.stderr: -337> 2024-09-14T11:10:40.866+0000 7f6ac43da640 10 monclient(hunting): get_auth_request con 0x56294b957c80 auth_method 0 2024-09-14T11:10:41.150 INFO:tasks.workunit.client.0.smithi050.stderr: -336> 2024-09-14T11:10:40.866+0000 7f6ac43da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:41.150 INFO:tasks.workunit.client.0.smithi050.stderr: -335> 2024-09-14T11:10:40.866+0000 7f6ac43da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:41.150 INFO:tasks.workunit.client.0.smithi050.stderr: -334> 2024-09-14T11:10:40.866+0000 7f6ac43da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:41.151 INFO:tasks.workunit.client.0.smithi050.stderr: -333> 2024-09-14T11:10:40.866+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:41.151 INFO:tasks.workunit.client.0.smithi050.stderr: -332> 2024-09-14T11:10:40.866+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:41.151 INFO:tasks.workunit.client.0.smithi050.stderr: -331> 2024-09-14T11:10:40.866+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:41.151 INFO:tasks.workunit.client.0.smithi050.stderr: -330> 2024-09-14T11:10:40.866+0000 7f6ac43da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:41.151 INFO:tasks.workunit.client.0.smithi050.stderr: -329> 2024-09-14T11:10:40.866+0000 7f6ac43da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:41.151 INFO:tasks.workunit.client.0.smithi050.stderr: -328> 2024-09-14T11:10:40.866+0000 7f6ac43da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:41.151 INFO:tasks.workunit.client.0.smithi050.stderr: -327> 2024-09-14T11:10:40.866+0000 7f6ac3bd9640 10 monclient(hunting): get_auth_request con 0x56294b958f70 auth_method 0 2024-09-14T11:10:41.151 INFO:tasks.workunit.client.0.smithi050.stderr: -326> 2024-09-14T11:10:40.866+0000 7f6ac3bd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:41.151 INFO:tasks.workunit.client.0.smithi050.stderr: -325> 2024-09-14T11:10:40.866+0000 7f6ac3bd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:41.151 INFO:tasks.workunit.client.0.smithi050.stderr: -324> 2024-09-14T11:10:40.866+0000 7f6ac3bd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:41.151 INFO:tasks.workunit.client.0.smithi050.stderr: -323> 2024-09-14T11:10:40.866+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_done global_id 6530 payload 824 2024-09-14T11:10:41.151 INFO:tasks.workunit.client.0.smithi050.stderr: -322> 2024-09-14T11:10:40.866+0000 7f6ac33d8640 10 monclient: _finish_hunting 0 2024-09-14T11:10:41.152 INFO:tasks.workunit.client.0.smithi050.stderr: -321> 2024-09-14T11:10:40.866+0000 7f6ac33d8640 1 monclient: found mon.noname-c 2024-09-14T11:10:41.152 INFO:tasks.workunit.client.0.smithi050.stderr: -320> 2024-09-14T11:10:40.866+0000 7f6ac33d8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:10:41.152 INFO:tasks.workunit.client.0.smithi050.stderr: -319> 2024-09-14T11:10:40.867+0000 7f69a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:41.152 INFO:tasks.workunit.client.0.smithi050.stderr: -318> 2024-09-14T11:10:40.867+0000 7f69a97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:10:41.152 INFO:tasks.workunit.client.0.smithi050.stderr: -317> 2024-09-14T11:10:40.867+0000 7f69a97fa640 10 monclient: dump: 2024-09-14T11:10:41.152 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:41.152 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:41.152 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.152 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.152 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:41.152 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.152 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:41.152 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:41.153 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:41.153 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.153 INFO:tasks.workunit.client.0.smithi050.stderr: -316> 2024-09-14T11:10:40.867+0000 7f69a97fa640 10 monclient: _finish_auth 0 2024-09-14T11:10:41.153 INFO:tasks.workunit.client.0.smithi050.stderr: -315> 2024-09-14T11:10:40.867+0000 7f69a97fa640 10 monclient: _check_auth_tickets 2024-09-14T11:10:41.153 INFO:tasks.workunit.client.0.smithi050.stderr: -314> 2024-09-14T11:10:40.867+0000 7f69a97fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:10:41.153 INFO:tasks.workunit.client.0.smithi050.stderr: -313> 2024-09-14T11:10:40.867+0000 7f69a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:41.153 INFO:tasks.workunit.client.0.smithi050.stderr: -312> 2024-09-14T11:10:40.867+0000 7f69a97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:10:41.153 INFO:tasks.workunit.client.0.smithi050.stderr: -311> 2024-09-14T11:10:40.867+0000 7f69a97fa640 10 monclient: dump: 2024-09-14T11:10:41.153 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:41.153 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:41.153 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.153 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.153 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:41.153 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.154 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:41.154 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:41.154 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:41.154 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.154 INFO:tasks.workunit.client.0.smithi050.stderr: -310> 2024-09-14T11:10:40.867+0000 7f6ac7f26800 5 monclient: authenticate success, global_id 6530 2024-09-14T11:10:41.154 INFO:tasks.workunit.client.0.smithi050.stderr: -309> 2024-09-14T11:10:40.867+0000 7f6ac7f26800 10 monclient: _renew_subs 2024-09-14T11:10:41.154 INFO:tasks.workunit.client.0.smithi050.stderr: -308> 2024-09-14T11:10:40.867+0000 7f6ac7f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:10:41.154 INFO:tasks.workunit.client.0.smithi050.stderr: -307> 2024-09-14T11:10:40.867+0000 7f6ac4bdb640 4 set_mon_vals no callback set 2024-09-14T11:10:41.154 INFO:tasks.workunit.client.0.smithi050.stderr: -306> 2024-09-14T11:10:40.867+0000 7f6ac7f26800 10 monclient: _renew_subs 2024-09-14T11:10:41.154 INFO:tasks.workunit.client.0.smithi050.stderr: -305> 2024-09-14T11:10:40.867+0000 7f6ac7f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:10:41.154 INFO:tasks.workunit.client.0.smithi050.stderr: -304> 2024-09-14T11:10:40.869+0000 7f69a97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:10:41.154 INFO:tasks.workunit.client.0.smithi050.stderr: -303> 2024-09-14T11:10:40.869+0000 7f69a97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:10:41.154 INFO:tasks.workunit.client.0.smithi050.stderr: -302> 2024-09-14T11:10:40.869+0000 7f69a97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:10:41.154 INFO:tasks.workunit.client.0.smithi050.stderr: -301> 2024-09-14T11:10:40.869+0000 7f6ac3bd9640 10 monclient: get_auth_request con 0x7f699c077140 auth_method 0 2024-09-14T11:10:41.155 INFO:tasks.workunit.client.0.smithi050.stderr: -300> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 10 monclient: get_monmap_and_config 2024-09-14T11:10:41.155 INFO:tasks.workunit.client.0.smithi050.stderr: -299> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 10 monclient: build_initial_monmap 2024-09-14T11:10:41.155 INFO:tasks.workunit.client.0.smithi050.stderr: -298> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 1 build_initial for_mkfs: 0 2024-09-14T11:10:41.155 INFO:tasks.workunit.client.0.smithi050.stderr: -297> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 10 monclient: monmap: 2024-09-14T11:10:41.155 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:10:41.155 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:10:41.155 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:10:41.155 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:10:41.155 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:10:41.155 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.155 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:10:41.155 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:10:41.156 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:10:41.156 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.156 INFO:tasks.workunit.client.0.smithi050.stderr: -296> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding auth protocol: cephx 2024-09-14T11:10:41.156 INFO:tasks.workunit.client.0.smithi050.stderr: -295> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding auth protocol: cephx 2024-09-14T11:10:41.156 INFO:tasks.workunit.client.0.smithi050.stderr: -294> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding auth protocol: cephx 2024-09-14T11:10:41.156 INFO:tasks.workunit.client.0.smithi050.stderr: -293> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding con mode: secure 2024-09-14T11:10:41.156 INFO:tasks.workunit.client.0.smithi050.stderr: -292> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding con mode: crc 2024-09-14T11:10:41.156 INFO:tasks.workunit.client.0.smithi050.stderr: -291> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding con mode: secure 2024-09-14T11:10:41.156 INFO:tasks.workunit.client.0.smithi050.stderr: -290> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding con mode: crc 2024-09-14T11:10:41.156 INFO:tasks.workunit.client.0.smithi050.stderr: -289> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding con mode: secure 2024-09-14T11:10:41.156 INFO:tasks.workunit.client.0.smithi050.stderr: -288> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding con mode: crc 2024-09-14T11:10:41.156 INFO:tasks.workunit.client.0.smithi050.stderr: -287> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding con mode: crc 2024-09-14T11:10:41.156 INFO:tasks.workunit.client.0.smithi050.stderr: -286> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding con mode: secure 2024-09-14T11:10:41.156 INFO:tasks.workunit.client.0.smithi050.stderr: -285> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding con mode: crc 2024-09-14T11:10:41.157 INFO:tasks.workunit.client.0.smithi050.stderr: -284> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding con mode: secure 2024-09-14T11:10:41.157 INFO:tasks.workunit.client.0.smithi050.stderr: -283> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding con mode: crc 2024-09-14T11:10:41.157 INFO:tasks.workunit.client.0.smithi050.stderr: -282> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding con mode: secure 2024-09-14T11:10:41.157 INFO:tasks.workunit.client.0.smithi050.stderr: -281> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.157 INFO:tasks.workunit.client.0.smithi050.stderr: -280> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 10 monclient: init 2024-09-14T11:10:41.157 INFO:tasks.workunit.client.0.smithi050.stderr: -279> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding auth protocol: cephx 2024-09-14T11:10:41.157 INFO:tasks.workunit.client.0.smithi050.stderr: -278> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding auth protocol: cephx 2024-09-14T11:10:41.157 INFO:tasks.workunit.client.0.smithi050.stderr: -277> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding auth protocol: cephx 2024-09-14T11:10:41.157 INFO:tasks.workunit.client.0.smithi050.stderr: -276> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding con mode: secure 2024-09-14T11:10:41.157 INFO:tasks.workunit.client.0.smithi050.stderr: -275> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding con mode: crc 2024-09-14T11:10:41.157 INFO:tasks.workunit.client.0.smithi050.stderr: -274> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding con mode: secure 2024-09-14T11:10:41.157 INFO:tasks.workunit.client.0.smithi050.stderr: -273> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding con mode: crc 2024-09-14T11:10:41.157 INFO:tasks.workunit.client.0.smithi050.stderr: -272> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding con mode: secure 2024-09-14T11:10:41.157 INFO:tasks.workunit.client.0.smithi050.stderr: -271> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding con mode: crc 2024-09-14T11:10:41.158 INFO:tasks.workunit.client.0.smithi050.stderr: -270> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding con mode: crc 2024-09-14T11:10:41.158 INFO:tasks.workunit.client.0.smithi050.stderr: -269> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding con mode: secure 2024-09-14T11:10:41.158 INFO:tasks.workunit.client.0.smithi050.stderr: -268> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding con mode: crc 2024-09-14T11:10:41.158 INFO:tasks.workunit.client.0.smithi050.stderr: -267> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding con mode: secure 2024-09-14T11:10:41.158 INFO:tasks.workunit.client.0.smithi050.stderr: -266> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding con mode: crc 2024-09-14T11:10:41.158 INFO:tasks.workunit.client.0.smithi050.stderr: -265> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding con mode: secure 2024-09-14T11:10:41.158 INFO:tasks.workunit.client.0.smithi050.stderr: -264> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.158 INFO:tasks.workunit.client.0.smithi050.stderr: -263> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.158 INFO:tasks.workunit.client.0.smithi050.stderr: -262> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command rotate-key cmddesc rotate-key hook 0x7ffd8dfdec18 EEXIST 2024-09-14T11:10:41.158 INFO:tasks.workunit.client.0.smithi050.stderr: -261> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 10 monclient: _reopen_session rank -1 2024-09-14T11:10:41.158 INFO:tasks.workunit.client.0.smithi050.stderr: -260> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:10:41.158 INFO:tasks.workunit.client.0.smithi050.stderr: -259> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 10 monclient(hunting): picked mon.noname-a con 0x56294b97d0c0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:10:41.158 INFO:tasks.workunit.client.0.smithi050.stderr: -258> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 10 monclient(hunting): picked mon.noname-c con 0x56294b9a7990 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:10:41.159 INFO:tasks.workunit.client.0.smithi050.stderr: -257> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 10 monclient(hunting): picked mon.noname-b con 0x56294b9a8e10 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:10:41.159 INFO:tasks.workunit.client.0.smithi050.stderr: -256> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:41.159 INFO:tasks.workunit.client.0.smithi050.stderr: -255> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:41.159 INFO:tasks.workunit.client.0.smithi050.stderr: -254> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:41.159 INFO:tasks.workunit.client.0.smithi050.stderr: -253> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 10 monclient(hunting): _renew_subs 2024-09-14T11:10:41.159 INFO:tasks.workunit.client.0.smithi050.stderr: -252> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 10 monclient(hunting): authenticate will time out at 2293.507776s 2024-09-14T11:10:41.159 INFO:tasks.workunit.client.0.smithi050.stderr: -251> 2024-09-14T11:10:40.870+0000 7f6ac3bd9640 10 monclient(hunting): get_auth_request con 0x56294b97d0c0 auth_method 0 2024-09-14T11:10:41.159 INFO:tasks.workunit.client.0.smithi050.stderr: -250> 2024-09-14T11:10:40.870+0000 7f6ac3bd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:41.159 INFO:tasks.workunit.client.0.smithi050.stderr: -249> 2024-09-14T11:10:40.870+0000 7f6ac3bd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:41.159 INFO:tasks.workunit.client.0.smithi050.stderr: -248> 2024-09-14T11:10:40.870+0000 7f6ac3bd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:41.159 INFO:tasks.workunit.client.0.smithi050.stderr: -247> 2024-09-14T11:10:40.870+0000 7f6ac33d8640 10 monclient(hunting): get_auth_request con 0x56294b9a7990 auth_method 0 2024-09-14T11:10:41.159 INFO:tasks.workunit.client.0.smithi050.stderr: -246> 2024-09-14T11:10:40.870+0000 7f6ac33d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:41.159 INFO:tasks.workunit.client.0.smithi050.stderr: -245> 2024-09-14T11:10:40.870+0000 7f6ac33d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:41.159 INFO:tasks.workunit.client.0.smithi050.stderr: -244> 2024-09-14T11:10:40.870+0000 7f6ac33d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:41.160 INFO:tasks.workunit.client.0.smithi050.stderr: -243> 2024-09-14T11:10:40.870+0000 7f6ac3bd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:41.160 INFO:tasks.workunit.client.0.smithi050.stderr: -242> 2024-09-14T11:10:40.870+0000 7f6ac3bd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:41.160 INFO:tasks.workunit.client.0.smithi050.stderr: -241> 2024-09-14T11:10:40.870+0000 7f6ac3bd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:41.160 INFO:tasks.workunit.client.0.smithi050.stderr: -240> 2024-09-14T11:10:40.870+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:41.160 INFO:tasks.workunit.client.0.smithi050.stderr: -239> 2024-09-14T11:10:40.870+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:41.160 INFO:tasks.workunit.client.0.smithi050.stderr: -238> 2024-09-14T11:10:40.870+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:41.160 INFO:tasks.workunit.client.0.smithi050.stderr: -237> 2024-09-14T11:10:40.871+0000 7f6ac3bd9640 10 monclient(hunting): handle_auth_done global_id 6954 payload 274 2024-09-14T11:10:41.160 INFO:tasks.workunit.client.0.smithi050.stderr: -236> 2024-09-14T11:10:40.871+0000 7f6ac3bd9640 10 monclient: _finish_hunting 0 2024-09-14T11:10:41.160 INFO:tasks.workunit.client.0.smithi050.stderr: -235> 2024-09-14T11:10:40.871+0000 7f6ac3bd9640 1 monclient: found mon.noname-a 2024-09-14T11:10:41.160 INFO:tasks.workunit.client.0.smithi050.stderr: -234> 2024-09-14T11:10:40.871+0000 7f6ac3bd9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:10:41.160 INFO:tasks.workunit.client.0.smithi050.stderr: -233> 2024-09-14T11:10:40.871+0000 7f69a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:41.160 INFO:tasks.workunit.client.0.smithi050.stderr: -232> 2024-09-14T11:10:40.871+0000 7f69a2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:10:41.160 INFO:tasks.workunit.client.0.smithi050.stderr: -231> 2024-09-14T11:10:40.871+0000 7f69a2ffd640 10 monclient: dump: 2024-09-14T11:10:41.161 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:41.161 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:41.161 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.161 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.161 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:41.161 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.161 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:41.161 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:41.161 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:41.161 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.161 INFO:tasks.workunit.client.0.smithi050.stderr: -230> 2024-09-14T11:10:40.871+0000 7f69a2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:10:41.161 INFO:tasks.workunit.client.0.smithi050.stderr: -229> 2024-09-14T11:10:40.871+0000 7f69a2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:10:41.161 INFO:tasks.workunit.client.0.smithi050.stderr: -228> 2024-09-14T11:10:40.871+0000 7f69a2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:10:41.162 INFO:tasks.workunit.client.0.smithi050.stderr: -227> 2024-09-14T11:10:40.871+0000 7f6ac7f26800 5 monclient: authenticate success, global_id 6954 2024-09-14T11:10:41.162 INFO:tasks.workunit.client.0.smithi050.stderr: -226> 2024-09-14T11:10:40.871+0000 7f6ac7f26800 10 monclient: get_monmap_and_config success 2024-09-14T11:10:41.162 INFO:tasks.workunit.client.0.smithi050.stderr: -225> 2024-09-14T11:10:40.871+0000 7f6ac7f26800 4 set_mon_vals no callback set 2024-09-14T11:10:41.162 INFO:tasks.workunit.client.0.smithi050.stderr: -224> 2024-09-14T11:10:40.871+0000 7f69a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:41.162 INFO:tasks.workunit.client.0.smithi050.stderr: -223> 2024-09-14T11:10:40.871+0000 7f69a2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:10:41.162 INFO:tasks.workunit.client.0.smithi050.stderr: -222> 2024-09-14T11:10:40.871+0000 7f69a2ffd640 10 monclient: dump: 2024-09-14T11:10:41.162 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:41.162 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:41.162 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.162 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.162 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:41.162 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.162 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:41.162 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:41.163 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:41.163 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.163 INFO:tasks.workunit.client.0.smithi050.stderr: -221> 2024-09-14T11:10:40.871+0000 7f6ac7f26800 10 monclient: shutdown 2024-09-14T11:10:41.163 INFO:tasks.workunit.client.0.smithi050.stderr: -220> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 10 monclient: build_initial_monmap 2024-09-14T11:10:41.163 INFO:tasks.workunit.client.0.smithi050.stderr: -219> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 1 build_initial for_mkfs: 0 2024-09-14T11:10:41.163 INFO:tasks.workunit.client.0.smithi050.stderr: -218> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 10 monclient: monmap: 2024-09-14T11:10:41.163 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:10:41.163 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:10:41.163 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:10:41.163 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:10:41.163 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:10:41.163 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.163 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:10:41.163 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:10:41.164 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:10:41.164 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.164 INFO:tasks.workunit.client.0.smithi050.stderr: -217> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding auth protocol: cephx 2024-09-14T11:10:41.164 INFO:tasks.workunit.client.0.smithi050.stderr: -216> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding auth protocol: cephx 2024-09-14T11:10:41.164 INFO:tasks.workunit.client.0.smithi050.stderr: -215> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding auth protocol: cephx 2024-09-14T11:10:41.164 INFO:tasks.workunit.client.0.smithi050.stderr: -214> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding con mode: secure 2024-09-14T11:10:41.164 INFO:tasks.workunit.client.0.smithi050.stderr: -213> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding con mode: crc 2024-09-14T11:10:41.164 INFO:tasks.workunit.client.0.smithi050.stderr: -212> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding con mode: secure 2024-09-14T11:10:41.164 INFO:tasks.workunit.client.0.smithi050.stderr: -211> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding con mode: crc 2024-09-14T11:10:41.164 INFO:tasks.workunit.client.0.smithi050.stderr: -210> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding con mode: secure 2024-09-14T11:10:41.164 INFO:tasks.workunit.client.0.smithi050.stderr: -209> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding con mode: crc 2024-09-14T11:10:41.164 INFO:tasks.workunit.client.0.smithi050.stderr: -208> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding con mode: crc 2024-09-14T11:10:41.164 INFO:tasks.workunit.client.0.smithi050.stderr: -207> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding con mode: secure 2024-09-14T11:10:41.165 INFO:tasks.workunit.client.0.smithi050.stderr: -206> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding con mode: crc 2024-09-14T11:10:41.165 INFO:tasks.workunit.client.0.smithi050.stderr: -205> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding con mode: secure 2024-09-14T11:10:41.165 INFO:tasks.workunit.client.0.smithi050.stderr: -204> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding con mode: crc 2024-09-14T11:10:41.165 INFO:tasks.workunit.client.0.smithi050.stderr: -203> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding con mode: secure 2024-09-14T11:10:41.165 INFO:tasks.workunit.client.0.smithi050.stderr: -202> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.165 INFO:tasks.workunit.client.0.smithi050.stderr: -201> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 1 librados: starting msgr at 2024-09-14T11:10:41.165 INFO:tasks.workunit.client.0.smithi050.stderr: -200> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 1 librados: starting objecter 2024-09-14T11:10:41.165 INFO:tasks.workunit.client.0.smithi050.stderr: -199> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command objecter_requests cmddesc objecter_requests hook 0x56294b9a77c0 EEXIST 2024-09-14T11:10:41.165 INFO:tasks.workunit.client.0.smithi050.stderr: -198> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 1 librados: setting wanted keys 2024-09-14T11:10:41.165 INFO:tasks.workunit.client.0.smithi050.stderr: -197> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 1 librados: calling monclient init 2024-09-14T11:10:41.165 INFO:tasks.workunit.client.0.smithi050.stderr: -196> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 10 monclient: init 2024-09-14T11:10:41.165 INFO:tasks.workunit.client.0.smithi050.stderr: -195> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding auth protocol: cephx 2024-09-14T11:10:41.165 INFO:tasks.workunit.client.0.smithi050.stderr: -194> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding auth protocol: cephx 2024-09-14T11:10:41.165 INFO:tasks.workunit.client.0.smithi050.stderr: -193> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding auth protocol: cephx 2024-09-14T11:10:41.166 INFO:tasks.workunit.client.0.smithi050.stderr: -192> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding con mode: secure 2024-09-14T11:10:41.166 INFO:tasks.workunit.client.0.smithi050.stderr: -191> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding con mode: crc 2024-09-14T11:10:41.166 INFO:tasks.workunit.client.0.smithi050.stderr: -190> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding con mode: secure 2024-09-14T11:10:41.166 INFO:tasks.workunit.client.0.smithi050.stderr: -189> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding con mode: crc 2024-09-14T11:10:41.166 INFO:tasks.workunit.client.0.smithi050.stderr: -188> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding con mode: secure 2024-09-14T11:10:41.166 INFO:tasks.workunit.client.0.smithi050.stderr: -187> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding con mode: crc 2024-09-14T11:10:41.166 INFO:tasks.workunit.client.0.smithi050.stderr: -186> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding con mode: crc 2024-09-14T11:10:41.166 INFO:tasks.workunit.client.0.smithi050.stderr: -185> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding con mode: secure 2024-09-14T11:10:41.166 INFO:tasks.workunit.client.0.smithi050.stderr: -184> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding con mode: crc 2024-09-14T11:10:41.166 INFO:tasks.workunit.client.0.smithi050.stderr: -183> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding con mode: secure 2024-09-14T11:10:41.166 INFO:tasks.workunit.client.0.smithi050.stderr: -182> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding con mode: crc 2024-09-14T11:10:41.166 INFO:tasks.workunit.client.0.smithi050.stderr: -181> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding con mode: secure 2024-09-14T11:10:41.166 INFO:tasks.workunit.client.0.smithi050.stderr: -180> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.166 INFO:tasks.workunit.client.0.smithi050.stderr: -179> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.166 INFO:tasks.workunit.client.0.smithi050.stderr: -178> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command rotate-key cmddesc rotate-key hook 0x56294b96d978 EEXIST 2024-09-14T11:10:41.166 INFO:tasks.workunit.client.0.smithi050.stderr: -177> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 10 monclient: _reopen_session rank -1 2024-09-14T11:10:41.167 INFO:tasks.workunit.client.0.smithi050.stderr: -176> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:10:41.167 INFO:tasks.workunit.client.0.smithi050.stderr: -175> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient(hunting): picked mon.noname-b con 0x56294b97d0c0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:10:41.167 INFO:tasks.workunit.client.0.smithi050.stderr: -174> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient(hunting): picked mon.noname-c con 0x56294b9a7990 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:10:41.167 INFO:tasks.workunit.client.0.smithi050.stderr: -173> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient(hunting): picked mon.noname-a con 0x56294b9a8e10 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:10:41.167 INFO:tasks.workunit.client.0.smithi050.stderr: -172> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:41.167 INFO:tasks.workunit.client.0.smithi050.stderr: -171> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:41.167 INFO:tasks.workunit.client.0.smithi050.stderr: -170> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:41.167 INFO:tasks.workunit.client.0.smithi050.stderr: -169> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient(hunting): _renew_subs 2024-09-14T11:10:41.167 INFO:tasks.workunit.client.0.smithi050.stderr: -168> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient(hunting): authenticate will time out at 2293.510057s 2024-09-14T11:10:41.167 INFO:tasks.workunit.client.0.smithi050.stderr: -167> 2024-09-14T11:10:40.873+0000 7f6ac33d8640 10 monclient(hunting): get_auth_request con 0x56294b9a7990 auth_method 0 2024-09-14T11:10:41.167 INFO:tasks.workunit.client.0.smithi050.stderr: -166> 2024-09-14T11:10:40.873+0000 7f6ac33d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:41.167 INFO:tasks.workunit.client.0.smithi050.stderr: -165> 2024-09-14T11:10:40.873+0000 7f6ac33d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:41.168 INFO:tasks.workunit.client.0.smithi050.stderr: -164> 2024-09-14T11:10:40.873+0000 7f6ac33d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:41.168 INFO:tasks.workunit.client.0.smithi050.stderr: -163> 2024-09-14T11:10:40.873+0000 7f6ac43da640 10 monclient(hunting): get_auth_request con 0x56294b9a8e10 auth_method 0 2024-09-14T11:10:41.168 INFO:tasks.workunit.client.0.smithi050.stderr: -162> 2024-09-14T11:10:40.873+0000 7f6ac43da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:41.168 INFO:tasks.workunit.client.0.smithi050.stderr: -161> 2024-09-14T11:10:40.873+0000 7f6ac43da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:41.168 INFO:tasks.workunit.client.0.smithi050.stderr: -160> 2024-09-14T11:10:40.873+0000 7f6ac43da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:41.168 INFO:tasks.workunit.client.0.smithi050.stderr: -159> 2024-09-14T11:10:40.873+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:41.168 INFO:tasks.workunit.client.0.smithi050.stderr: -158> 2024-09-14T11:10:40.873+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:41.168 INFO:tasks.workunit.client.0.smithi050.stderr: -157> 2024-09-14T11:10:40.873+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:41.168 INFO:tasks.workunit.client.0.smithi050.stderr: -156> 2024-09-14T11:10:40.873+0000 7f6ac43da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:41.168 INFO:tasks.workunit.client.0.smithi050.stderr: -155> 2024-09-14T11:10:40.873+0000 7f6ac43da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:41.168 INFO:tasks.workunit.client.0.smithi050.stderr: -154> 2024-09-14T11:10:40.873+0000 7f6ac43da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:41.168 INFO:tasks.workunit.client.0.smithi050.stderr: -153> 2024-09-14T11:10:40.873+0000 7f6ac3bd9640 10 monclient(hunting): get_auth_request con 0x56294b97d0c0 auth_method 0 2024-09-14T11:10:41.168 INFO:tasks.workunit.client.0.smithi050.stderr: -152> 2024-09-14T11:10:40.873+0000 7f6ac3bd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:41.168 INFO:tasks.workunit.client.0.smithi050.stderr: -151> 2024-09-14T11:10:40.873+0000 7f6ac3bd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:41.169 INFO:tasks.workunit.client.0.smithi050.stderr: -150> 2024-09-14T11:10:40.873+0000 7f6ac3bd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:41.169 INFO:tasks.workunit.client.0.smithi050.stderr: -149> 2024-09-14T11:10:40.873+0000 7f6ac3bd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:41.169 INFO:tasks.workunit.client.0.smithi050.stderr: -148> 2024-09-14T11:10:40.873+0000 7f6ac3bd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:41.169 INFO:tasks.workunit.client.0.smithi050.stderr: -147> 2024-09-14T11:10:40.873+0000 7f6ac3bd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:41.169 INFO:tasks.workunit.client.0.smithi050.stderr: -146> 2024-09-14T11:10:40.873+0000 7f6ac43da640 10 monclient(hunting): handle_auth_done global_id 6957 payload 824 2024-09-14T11:10:41.169 INFO:tasks.workunit.client.0.smithi050.stderr: -145> 2024-09-14T11:10:40.873+0000 7f6ac43da640 10 monclient: _finish_hunting 0 2024-09-14T11:10:41.169 INFO:tasks.workunit.client.0.smithi050.stderr: -144> 2024-09-14T11:10:40.873+0000 7f6ac43da640 1 monclient: found mon.noname-a 2024-09-14T11:10:41.169 INFO:tasks.workunit.client.0.smithi050.stderr: -143> 2024-09-14T11:10:40.873+0000 7f6ac43da640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:10:41.169 INFO:tasks.workunit.client.0.smithi050.stderr: -142> 2024-09-14T11:10:40.873+0000 7f69a17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:41.169 INFO:tasks.workunit.client.0.smithi050.stderr: -141> 2024-09-14T11:10:40.873+0000 7f69a17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:10:41.169 INFO:tasks.workunit.client.0.smithi050.stderr: -140> 2024-09-14T11:10:40.873+0000 7f69a17fa640 10 monclient: dump: 2024-09-14T11:10:41.169 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:41.169 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:41.170 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.170 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.170 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:41.170 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.170 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:41.170 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:41.170 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:41.170 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.170 INFO:tasks.workunit.client.0.smithi050.stderr: -139> 2024-09-14T11:10:40.873+0000 7f69a17fa640 10 monclient: _finish_auth 0 2024-09-14T11:10:41.170 INFO:tasks.workunit.client.0.smithi050.stderr: -138> 2024-09-14T11:10:40.873+0000 7f69a17fa640 10 monclient: _check_auth_tickets 2024-09-14T11:10:41.170 INFO:tasks.workunit.client.0.smithi050.stderr: -137> 2024-09-14T11:10:40.873+0000 7f69a17fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:10:41.170 INFO:tasks.workunit.client.0.smithi050.stderr: -136> 2024-09-14T11:10:40.873+0000 7f69a17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:41.170 INFO:tasks.workunit.client.0.smithi050.stderr: -135> 2024-09-14T11:10:40.873+0000 7f69a17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:10:41.171 INFO:tasks.workunit.client.0.smithi050.stderr: -134> 2024-09-14T11:10:40.873+0000 7f69a17fa640 10 monclient: dump: 2024-09-14T11:10:41.171 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:41.171 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:41.171 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.171 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.171 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:41.171 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.171 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:41.171 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:41.171 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:41.171 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.171 INFO:tasks.workunit.client.0.smithi050.stderr: -133> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 5 monclient: authenticate success, global_id 6957 2024-09-14T11:10:41.171 INFO:tasks.workunit.client.0.smithi050.stderr: -132> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient: _renew_subs 2024-09-14T11:10:41.171 INFO:tasks.workunit.client.0.smithi050.stderr: -131> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:10:41.171 INFO:tasks.workunit.client.0.smithi050.stderr: -130> 2024-09-14T11:10:40.873+0000 7f69a2ffd640 4 set_mon_vals no callback set 2024-09-14T11:10:41.172 INFO:tasks.workunit.client.0.smithi050.stderr: -129> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient: _renew_subs 2024-09-14T11:10:41.172 INFO:tasks.workunit.client.0.smithi050.stderr: -128> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:10:41.172 INFO:tasks.workunit.client.0.smithi050.stderr: -127> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 1 librados: init done 2024-09-14T11:10:41.172 INFO:tasks.workunit.client.0.smithi050.stderr: -126> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command cr dump hook 0x56294b99b778 2024-09-14T11:10:41.172 INFO:tasks.workunit.client.0.smithi050.stderr: -125> 2024-09-14T11:10:40.875+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.172 INFO:tasks.workunit.client.0.smithi050.stderr: -124> 2024-09-14T11:10:40.876+0000 7f69a17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:10:41.172 INFO:tasks.workunit.client.0.smithi050.stderr: -123> 2024-09-14T11:10:40.876+0000 7f69a17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:10:41.172 INFO:tasks.workunit.client.0.smithi050.stderr: -122> 2024-09-14T11:10:40.876+0000 7f69a17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:10:41.172 INFO:tasks.workunit.client.0.smithi050.stderr: -121> 2024-09-14T11:10:40.876+0000 7f6ac3bd9640 10 monclient: get_auth_request con 0x7f698c077230 auth_method 0 2024-09-14T11:10:41.172 INFO:tasks.workunit.client.0.smithi050.stderr: -120> 2024-09-14T11:10:40.876+0000 7f6ac33d8640 10 monclient: get_auth_request con 0x56294b9c7840 auth_method 0 2024-09-14T11:10:41.172 INFO:tasks.workunit.client.0.smithi050.stderr: -119> 2024-09-14T11:10:40.876+0000 7f6ac7f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.172 INFO:tasks.workunit.client.0.smithi050.stderr: -118> 2024-09-14T11:10:40.876+0000 7f6ac7f26800 20 realm 2024-09-14T11:10:41.172 INFO:tasks.workunit.client.0.smithi050.stderr: -117> 2024-09-14T11:10:40.876+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.172 INFO:tasks.workunit.client.0.smithi050.stderr: -116> 2024-09-14T11:10:40.877+0000 7f6ac7f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.173 INFO:tasks.workunit.client.0.smithi050.stderr: -115> 2024-09-14T11:10:40.877+0000 7f6ac7f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:41.173 INFO:tasks.workunit.client.0.smithi050.stderr: -114> 2024-09-14T11:10:40.877+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.173 INFO:tasks.workunit.client.0.smithi050.stderr: -113> 2024-09-14T11:10:40.877+0000 7f6ac7f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.173 INFO:tasks.workunit.client.0.smithi050.stderr: -112> 2024-09-14T11:10:40.877+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.173 INFO:tasks.workunit.client.0.smithi050.stderr: -111> 2024-09-14T11:10:40.877+0000 7f6ac3bd9640 10 monclient: get_auth_request con 0x56294b9cbad0 auth_method 0 2024-09-14T11:10:41.173 INFO:tasks.workunit.client.0.smithi050.stderr: -110> 2024-09-14T11:10:40.878+0000 7f6ac7f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:41.173 INFO:tasks.workunit.client.0.smithi050.stderr: -109> 2024-09-14T11:10:40.878+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.173 INFO:tasks.workunit.client.0.smithi050.stderr: -108> 2024-09-14T11:10:40.878+0000 7f6ac33d8640 10 monclient: get_auth_request con 0x56294b9cf330 auth_method 0 2024-09-14T11:10:41.173 INFO:tasks.workunit.client.0.smithi050.stderr: -107> 2024-09-14T11:10:40.878+0000 7f6ac7f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:41.173 INFO:tasks.workunit.client.0.smithi050.stderr: -106> 2024-09-14T11:10:40.878+0000 7f6ac7f26800 20 searching for the correct realm 2024-09-14T11:10:41.173 INFO:tasks.workunit.client.0.smithi050.stderr: -105> 2024-09-14T11:10:40.879+0000 7f6ac43da640 10 monclient: get_auth_request con 0x56294b9d4060 auth_method 0 2024-09-14T11:10:41.173 INFO:tasks.workunit.client.0.smithi050.stderr: -104> 2024-09-14T11:10:40.879+0000 7f6ac3bd9640 10 monclient: get_auth_request con 0x7f6abc025070 auth_method 0 2024-09-14T11:10:41.173 INFO:tasks.workunit.client.0.smithi050.stderr: -103> 2024-09-14T11:10:40.881+0000 7f6ac33d8640 10 monclient: get_auth_request con 0x7f6abc06c0b0 auth_method 0 2024-09-14T11:10:41.173 INFO:tasks.workunit.client.0.smithi050.stderr: -102> 2024-09-14T11:10:40.881+0000 7f6ac33d8640 0 -- 172.21.15.50:0/3641330477 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f6abc06c0b0 msgr2=0x7f6abc070910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:41.174 INFO:tasks.workunit.client.0.smithi050.stderr: -101> 2024-09-14T11:10:41.082+0000 7f6ac33d8640 10 monclient: get_auth_request con 0x7f6abc06c0b0 auth_method 0 2024-09-14T11:10:41.174 INFO:tasks.workunit.client.0.smithi050.stderr: -100> 2024-09-14T11:10:41.084+0000 7f6ac43da640 10 monclient: get_auth_request con 0x7f6ab406b020 auth_method 0 2024-09-14T11:10:41.174 INFO:tasks.workunit.client.0.smithi050.stderr: -99> 2024-09-14T11:10:41.085+0000 7f6ac3bd9640 10 monclient: get_auth_request con 0x7f6abc067d50 auth_method 0 2024-09-14T11:10:41.174 INFO:tasks.workunit.client.0.smithi050.stderr: -98> 2024-09-14T11:10:41.086+0000 7f6ac33d8640 0 -- 172.21.15.50:0/3641330477 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x56294b9c7840 msgr2=0x56294b9c9cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:41.174 INFO:tasks.workunit.client.0.smithi050.stderr: -97> 2024-09-14T11:10:41.086+0000 7f69a17fa640 1 client.6957.objecter ms_handle_reset 0x56294b9c7840 session 0x56294b9c71c0 osd.6 2024-09-14T11:10:41.174 INFO:tasks.workunit.client.0.smithi050.stderr: -96> 2024-09-14T11:10:41.086+0000 7f69a17fa640 10 monclient: _renew_subs 2024-09-14T11:10:41.174 INFO:tasks.workunit.client.0.smithi050.stderr: -95> 2024-09-14T11:10:41.086+0000 7f69a17fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:10:41.174 INFO:tasks.workunit.client.0.smithi050.stderr: -94> 2024-09-14T11:10:41.086+0000 7f6ac33d8640 10 monclient: get_auth_request con 0x7f698c087460 auth_method 0 2024-09-14T11:10:41.174 INFO:tasks.workunit.client.0.smithi050.stderr: -93> 2024-09-14T11:10:41.089+0000 7f6ac7f26800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:10:41.174 INFO:tasks.workunit.client.0.smithi050.stderr: -92> 2024-09-14T11:10:41.089+0000 7f6ac7f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:41.174 INFO:tasks.workunit.client.0.smithi050.stderr: -91> 2024-09-14T11:10:41.089+0000 7f6ac7f26800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:10:41.174 INFO:tasks.workunit.client.0.smithi050.stderr: -90> 2024-09-14T11:10:41.089+0000 7f6ac7f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:41.174 INFO:tasks.workunit.client.0.smithi050.stderr: -89> 2024-09-14T11:10:41.089+0000 7f6ac7f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:41.174 INFO:tasks.workunit.client.0.smithi050.stderr: -88> 2024-09-14T11:10:41.089+0000 7f6ac7f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:41.175 INFO:tasks.workunit.client.0.smithi050.stderr: -87> 2024-09-14T11:10:41.089+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.175 INFO:tasks.workunit.client.0.smithi050.stderr: -86> 2024-09-14T11:10:41.090+0000 7f6ac7f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.175 INFO:tasks.workunit.client.0.smithi050.stderr: -85> 2024-09-14T11:10:41.090+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.175 INFO:tasks.workunit.client.0.smithi050.stderr: -84> 2024-09-14T11:10:41.090+0000 7f6ac7f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:41.175 INFO:tasks.workunit.client.0.smithi050.stderr: -83> 2024-09-14T11:10:41.090+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.175 INFO:tasks.workunit.client.0.smithi050.stderr: -82> 2024-09-14T11:10:41.090+0000 7f6ac7f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:41.175 INFO:tasks.workunit.client.0.smithi050.stderr: -81> 2024-09-14T11:10:41.090+0000 7f6ac7f26800 20 zone default found 2024-09-14T11:10:41.175 INFO:tasks.workunit.client.0.smithi050.stderr: -80> 2024-09-14T11:10:41.090+0000 7f6ac7f26800 4 Realm: () 2024-09-14T11:10:41.175 INFO:tasks.workunit.client.0.smithi050.stderr: -79> 2024-09-14T11:10:41.090+0000 7f6ac7f26800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:10:41.175 INFO:tasks.workunit.client.0.smithi050.stderr: -78> 2024-09-14T11:10:41.090+0000 7f6ac7f26800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:10:41.175 INFO:tasks.workunit.client.0.smithi050.stderr: -77> 2024-09-14T11:10:41.090+0000 7f6ac7f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:41.175 INFO:tasks.workunit.client.0.smithi050.stderr: -76> 2024-09-14T11:10:41.090+0000 7f6ac7f26800 20 zonegroup default 2024-09-14T11:10:41.175 INFO:tasks.workunit.client.0.smithi050.stderr: -75> 2024-09-14T11:10:41.090+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.175 INFO:tasks.workunit.client.0.smithi050.stderr: -74> 2024-09-14T11:10:41.091+0000 7f6ac7f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.175 INFO:tasks.workunit.client.0.smithi050.stderr: -73> 2024-09-14T11:10:41.091+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.176 INFO:tasks.workunit.client.0.smithi050.stderr: -72> 2024-09-14T11:10:41.091+0000 7f6ac7f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.176 INFO:tasks.workunit.client.0.smithi050.stderr: -71> 2024-09-14T11:10:41.091+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.176 INFO:tasks.workunit.client.0.smithi050.stderr: -70> 2024-09-14T11:10:41.091+0000 7f6ac7f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.176 INFO:tasks.workunit.client.0.smithi050.stderr: -69> 2024-09-14T11:10:41.091+0000 7f6ac7f26800 20 started sync module instance, tier type = 2024-09-14T11:10:41.176 INFO:tasks.workunit.client.0.smithi050.stderr: -68> 2024-09-14T11:10:41.091+0000 7f6ac7f26800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:10:41.176 INFO:tasks.workunit.client.0.smithi050.stderr: -67> 2024-09-14T11:10:41.100+0000 7f6ac7f26800 20 add_watcher() i=0 2024-09-14T11:10:41.176 INFO:tasks.workunit.client.0.smithi050.stderr: -66> 2024-09-14T11:10:41.100+0000 7f6ac7f26800 20 add_watcher() i=1 2024-09-14T11:10:41.176 INFO:tasks.workunit.client.0.smithi050.stderr: -65> 2024-09-14T11:10:41.100+0000 7f6ac7f26800 20 add_watcher() i=2 2024-09-14T11:10:41.176 INFO:tasks.workunit.client.0.smithi050.stderr: -64> 2024-09-14T11:10:41.100+0000 7f6ac7f26800 20 add_watcher() i=3 2024-09-14T11:10:41.176 INFO:tasks.workunit.client.0.smithi050.stderr: -63> 2024-09-14T11:10:41.100+0000 7f6ac7f26800 20 add_watcher() i=4 2024-09-14T11:10:41.176 INFO:tasks.workunit.client.0.smithi050.stderr: -62> 2024-09-14T11:10:41.100+0000 7f6ac7f26800 20 add_watcher() i=5 2024-09-14T11:10:41.176 INFO:tasks.workunit.client.0.smithi050.stderr: -61> 2024-09-14T11:10:41.100+0000 7f6ac7f26800 20 add_watcher() i=6 2024-09-14T11:10:41.176 INFO:tasks.workunit.client.0.smithi050.stderr: -60> 2024-09-14T11:10:41.101+0000 7f6ac7f26800 20 add_watcher() i=7 2024-09-14T11:10:41.176 INFO:tasks.workunit.client.0.smithi050.stderr: -59> 2024-09-14T11:10:41.101+0000 7f6ac7f26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:41.177 INFO:tasks.workunit.client.0.smithi050.stderr: -58> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding auth protocol: cephx 2024-09-14T11:10:41.177 INFO:tasks.workunit.client.0.smithi050.stderr: -57> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding auth protocol: cephx 2024-09-14T11:10:41.177 INFO:tasks.workunit.client.0.smithi050.stderr: -56> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding auth protocol: cephx 2024-09-14T11:10:41.177 INFO:tasks.workunit.client.0.smithi050.stderr: -55> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding con mode: secure 2024-09-14T11:10:41.177 INFO:tasks.workunit.client.0.smithi050.stderr: -54> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding con mode: crc 2024-09-14T11:10:41.177 INFO:tasks.workunit.client.0.smithi050.stderr: -53> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding con mode: secure 2024-09-14T11:10:41.177 INFO:tasks.workunit.client.0.smithi050.stderr: -52> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding con mode: crc 2024-09-14T11:10:41.177 INFO:tasks.workunit.client.0.smithi050.stderr: -51> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding con mode: secure 2024-09-14T11:10:41.177 INFO:tasks.workunit.client.0.smithi050.stderr: -50> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding con mode: crc 2024-09-14T11:10:41.177 INFO:tasks.workunit.client.0.smithi050.stderr: -49> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding con mode: crc 2024-09-14T11:10:41.177 INFO:tasks.workunit.client.0.smithi050.stderr: -48> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding con mode: secure 2024-09-14T11:10:41.177 INFO:tasks.workunit.client.0.smithi050.stderr: -47> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding con mode: crc 2024-09-14T11:10:41.177 INFO:tasks.workunit.client.0.smithi050.stderr: -46> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding con mode: secure 2024-09-14T11:10:41.178 INFO:tasks.workunit.client.0.smithi050.stderr: -45> 2024-09-14T11:10:41.103+0000 7f6979fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:41.178 INFO:tasks.workunit.client.0.smithi050.stderr: -44> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding con mode: crc 2024-09-14T11:10:41.178 INFO:tasks.workunit.client.0.smithi050.stderr: -43> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding con mode: secure 2024-09-14T11:10:41.178 INFO:tasks.workunit.client.0.smithi050.stderr: -42> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.178 INFO:tasks.workunit.client.0.smithi050.stderr: -41> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:41.178 INFO:tasks.workunit.client.0.smithi050.stderr: -40> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:41.178 INFO:tasks.workunit.client.0.smithi050.stderr: -39> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command cache list hook 0x56294b9a2bf0 2024-09-14T11:10:41.178 INFO:tasks.workunit.client.0.smithi050.stderr: -38> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command cache inspect hook 0x56294b9a2bf0 2024-09-14T11:10:41.178 INFO:tasks.workunit.client.0.smithi050.stderr: -37> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command cache erase hook 0x56294b9a2bf0 2024-09-14T11:10:41.178 INFO:tasks.workunit.client.0.smithi050.stderr: -36> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command cache zap hook 0x56294b9a2bf0 2024-09-14T11:10:41.178 INFO:tasks.workunit.client.0.smithi050.stderr: -35> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 5 note: GC not initialized 2024-09-14T11:10:41.178 INFO:tasks.workunit.client.0.smithi050.stderr: -34> 2024-09-14T11:10:41.104+0000 7f6978fe1640 20 reqs_thread_entry: start 2024-09-14T11:10:41.178 INFO:tasks.workunit.client.0.smithi050.stderr: -33> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command sync trace show hook 0x7f6ab8004820 2024-09-14T11:10:41.179 INFO:tasks.workunit.client.0.smithi050.stderr: -32> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command sync trace history hook 0x7f6ab8004820 2024-09-14T11:10:41.179 INFO:tasks.workunit.client.0.smithi050.stderr: -31> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command sync trace active hook 0x7f6ab8004820 2024-09-14T11:10:41.179 INFO:tasks.workunit.client.0.smithi050.stderr: -30> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command sync trace active_short hook 0x7f6ab8004820 2024-09-14T11:10:41.179 INFO:tasks.workunit.client.0.smithi050.stderr: -29> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:41.179 INFO:tasks.workunit.client.0.smithi050.stderr: -28> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 20 Filter name: none 2024-09-14T11:10:41.179 INFO:tasks.workunit.client.0.smithi050.stderr: -27> 2024-09-14T11:10:41.104+0000 7f68f27fc640 20 reqs_thread_entry: start 2024-09-14T11:10:41.179 INFO:tasks.workunit.client.0.smithi050.stderr: -26> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:10:41.179 INFO:tasks.workunit.client.0.smithi050.stderr: -25> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.179 INFO:tasks.workunit.client.0.smithi050.stderr: -24> 2024-09-14T11:10:41.105+0000 7f6ac7f26800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:10:41.179 INFO:tasks.workunit.client.0.smithi050.stderr: -23> 2024-09-14T11:10:41.105+0000 7f6ac7f26800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:10:41.179 INFO:tasks.workunit.client.0.smithi050.stderr: -22> 2024-09-14T11:10:41.105+0000 7f6ac7f26800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:10:41.180 INFO:tasks.workunit.client.0.smithi050.stderr: -21> 2024-09-14T11:10:41.105+0000 7f6ac7f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 : miss 2024-09-14T11:10:41.180 INFO:tasks.workunit.client.0.smithi050.stderr: -20> 2024-09-14T11:10:41.105+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.180 INFO:tasks.workunit.client.0.smithi050.stderr: -19> 2024-09-14T11:10:41.105+0000 7f6ac7f26800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:10:41.180 INFO:tasks.workunit.client.0.smithi050.stderr: -18> 2024-09-14T11:10:41.105+0000 7f6ac7f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 info.flags=0x17 2024-09-14T11:10:41.180 INFO:tasks.workunit.client.0.smithi050.stderr: -17> 2024-09-14T11:10:41.105+0000 7f6ac7f26800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 to cache LRU end 2024-09-14T11:10:41.180 INFO:tasks.workunit.client.0.smithi050.stderr: -16> 2024-09-14T11:10:41.105+0000 7f6ac7f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:10:41.180 INFO:tasks.workunit.client.0.smithi050.stderr: -15> 2024-09-14T11:10:41.105+0000 7f6ac7f26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:41.180 INFO:tasks.workunit.client.0.smithi050.stderr: -14> 2024-09-14T11:10:41.105+0000 7f6ac7f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 2024-09-14T11:10:41.180 INFO:tasks.workunit.client.0.smithi050.stderr: -13> 2024-09-14T11:10:41.110+0000 7f6ac7f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 info.flags=0x17 2024-09-14T11:10:41.180 INFO:tasks.workunit.client.0.smithi050.stderr: -12> 2024-09-14T11:10:41.110+0000 7f6ac7f26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 to cache LRU end 2024-09-14T11:10:41.180 INFO:tasks.workunit.client.0.smithi050.stderr: -11> 2024-09-14T11:10:41.110+0000 7f6ac7f26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:41.180 INFO:tasks.workunit.client.0.smithi050.stderr: -10> 2024-09-14T11:10:41.110+0000 7f6ac7f26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28, ofs0, ns] 2024-09-14T11:10:41.180 INFO:tasks.workunit.client.0.smithi050.stderr: -9> 2024-09-14T11:10:41.111+0000 7f69a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497073 cookie 94735362258224 notifier 6957 bl.length()=1023 2024-09-14T11:10:41.180 INFO:tasks.workunit.client.0.smithi050.stderr: -8> 2024-09-14T11:10:41.111+0000 7f69a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 info.flags=0x17 2024-09-14T11:10:41.181 INFO:tasks.workunit.client.0.smithi050.stderr: -7> 2024-09-14T11:10:41.111+0000 7f69a2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 to cache LRU end 2024-09-14T11:10:41.181 INFO:tasks.workunit.client.0.smithi050.stderr: -6> 2024-09-14T11:10:41.111+0000 7f69a2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:41.181 INFO:tasks.workunit.client.0.smithi050.stderr: -5> 2024-09-14T11:10:41.112+0000 7f6ac7f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28]): orig_sources= new_sources= 2024-09-14T11:10:41.181 INFO:tasks.workunit.client.0.smithi050.stderr: -4> 2024-09-14T11:10:41.112+0000 7f6ac7f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28]): potential sources added=[] removed=[] 2024-09-14T11:10:41.181 INFO:tasks.workunit.client.0.smithi050.stderr: -3> 2024-09-14T11:10:41.112+0000 7f6ac7f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28]): orig_dests= new_dests= 2024-09-14T11:10:41.181 INFO:tasks.workunit.client.0.smithi050.stderr: -2> 2024-09-14T11:10:41.112+0000 7f6ac7f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28]): potential dests added=[] removed=[] 2024-09-14T11:10:41.181 INFO:tasks.workunit.client.0.smithi050.stderr: -1> 2024-09-14T11:10:41.113+0000 7f6ac7f26800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6ac7f26800 time 2024-09-14T11:10:41.113212+0000 2024-09-14T11:10:41.181 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:10:41.181 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.181 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:10:41.181 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6ac958c76a] 2024-09-14T11:10:41.181 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6ac958c928] 2024-09-14T11:10:41.181 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56294a2e90b1] 2024-09-14T11:10:41.181 INFO:tasks.workunit.client.0.smithi050.stderr: 4: radosgw-admin(+0xd8900e) [0x56294a7fd00e] 2024-09-14T11:10:41.182 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56294a2f8efd] 2024-09-14T11:10:41.182 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:10:41.182 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6ac8229590] 2024-09-14T11:10:41.182 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:10:41.182 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:10:41.182 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.182 INFO:tasks.workunit.client.0.smithi050.stderr: 0> 2024-09-14T11:10:41.114+0000 7f6ac7f26800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:10:41.182 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f6ac7f26800 thread_name:radosgw-admin 2024-09-14T11:10:41.182 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.182 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:10:41.182 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6ac823e6f0] 2024-09-14T11:10:41.182 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6ac828b99c] 2024-09-14T11:10:41.182 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:10:41.183 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:10:41.183 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6ac958c7c4] 2024-09-14T11:10:41.183 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6ac958c928] 2024-09-14T11:10:41.183 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56294a2e90b1] 2024-09-14T11:10:41.183 INFO:tasks.workunit.client.0.smithi050.stderr: 8: radosgw-admin(+0xd8900e) [0x56294a7fd00e] 2024-09-14T11:10:41.183 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56294a2f8efd] 2024-09-14T11:10:41.183 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:10:41.183 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6ac8229590] 2024-09-14T11:10:41.183 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:10:41.183 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:10:41.183 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:10:41.183 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.183 INFO:tasks.workunit.client.0.smithi050.stderr:--- logging levels --- 2024-09-14T11:10:41.183 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 none 2024-09-14T11:10:41.184 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 lockdep 2024-09-14T11:10:41.184 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 context 2024-09-14T11:10:41.184 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 crush 2024-09-14T11:10:41.184 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds 2024-09-14T11:10:41.184 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_balancer 2024-09-14T11:10:41.184 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_locker 2024-09-14T11:10:41.184 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log 2024-09-14T11:10:41.184 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log_expire 2024-09-14T11:10:41.184 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_migrator 2024-09-14T11:10:41.184 INFO:tasks.workunit.client.0.smithi050.stderr: 3/ 5 mds_quiesce 2024-09-14T11:10:41.184 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 buffer 2024-09-14T11:10:41.184 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 timer 2024-09-14T11:10:41.184 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 filer 2024-09-14T11:10:41.185 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 striper 2024-09-14T11:10:41.185 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 objecter 2024-09-14T11:10:41.185 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rados 2024-09-14T11:10:41.185 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd 2024-09-14T11:10:41.185 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_mirror 2024-09-14T11:10:41.185 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_replay 2024-09-14T11:10:41.185 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_pwl 2024-09-14T11:10:41.185 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 journaler 2024-09-14T11:10:41.185 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objectcacher 2024-09-14T11:10:41.185 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:10:41.185 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 client 2024-09-14T11:10:41.185 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 osd 2024-09-14T11:10:41.185 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 optracker 2024-09-14T11:10:41.186 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objclass 2024-09-14T11:10:41.186 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 filestore 2024-09-14T11:10:41.186 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 journal 2024-09-14T11:10:41.186 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 ms 2024-09-14T11:10:41.186 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mon 2024-09-14T11:10:41.186 INFO:tasks.workunit.client.0.smithi050.stderr: 0/10 monc 2024-09-14T11:10:41.186 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 paxos 2024-09-14T11:10:41.186 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 tp 2024-09-14T11:10:41.186 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 auth 2024-09-14T11:10:41.186 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 crypto 2024-09-14T11:10:41.186 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 finisher 2024-09-14T11:10:41.186 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 reserver 2024-09-14T11:10:41.186 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 heartbeatmap 2024-09-14T11:10:41.186 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 perfcounter 2024-09-14T11:10:41.187 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw 2024-09-14T11:10:41.187 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_sync 2024-09-14T11:10:41.187 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_datacache 2024-09-14T11:10:41.187 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_access 2024-09-14T11:10:41.187 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:10:41.187 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_flight 2024-09-14T11:10:41.187 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:10:41.187 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw_notification 2024-09-14T11:10:41.187 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 javaclient 2024-09-14T11:10:41.187 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 asok 2024-09-14T11:10:41.187 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 throttle 2024-09-14T11:10:41.187 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 refs 2024-09-14T11:10:41.187 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 compressor 2024-09-14T11:10:41.187 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluestore 2024-09-14T11:10:41.187 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluefs 2024-09-14T11:10:41.188 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 bdev 2024-09-14T11:10:41.188 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 kstore 2024-09-14T11:10:41.188 INFO:tasks.workunit.client.0.smithi050.stderr: 4/ 5 rocksdb 2024-09-14T11:10:41.188 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 fuse 2024-09-14T11:10:41.188 INFO:tasks.workunit.client.0.smithi050.stderr: 2/ 5 mgr 2024-09-14T11:10:41.188 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mgrc 2024-09-14T11:10:41.188 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 dpdk 2024-09-14T11:10:41.188 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 eventtrace 2024-09-14T11:10:41.188 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 prioritycache 2024-09-14T11:10:41.188 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 test 2024-09-14T11:10:41.188 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:10:41.188 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephsqlite 2024-09-14T11:10:41.188 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:10:41.189 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore 2024-09-14T11:10:41.189 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_onode 2024-09-14T11:10:41.189 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_odata 2024-09-14T11:10:41.189 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_omap 2024-09-14T11:10:41.189 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_tm 2024-09-14T11:10:41.189 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_t 2024-09-14T11:10:41.189 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:10:41.189 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_epm 2024-09-14T11:10:41.189 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_lba 2024-09-14T11:10:41.189 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:10:41.189 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cache 2024-09-14T11:10:41.189 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_journal 2024-09-14T11:10:41.189 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_device 2024-09-14T11:10:41.189 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_backref 2024-09-14T11:10:41.190 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 alienstore 2024-09-14T11:10:41.190 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mclock 2024-09-14T11:10:41.190 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cyanstore 2024-09-14T11:10:41.190 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 ceph_exporter 2024-09-14T11:10:41.190 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 memstore 2024-09-14T11:10:41.190 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 trace 2024-09-14T11:10:41.190 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 ceph_dedup 2024-09-14T11:10:41.190 INFO:tasks.workunit.client.0.smithi050.stderr: -2/-2 (syslog threshold) 2024-09-14T11:10:41.190 INFO:tasks.workunit.client.0.smithi050.stderr: 99/99 (stderr threshold) 2024-09-14T11:10:41.190 INFO:tasks.workunit.client.0.smithi050.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:10:41.190 INFO:tasks.workunit.client.0.smithi050.stderr: 7f68f27fc640 / http_manager 2024-09-14T11:10:41.190 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6978fe1640 / http_manager 2024-09-14T11:10:41.190 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6979fe3640 / rgw_dt_lg_renew 2024-09-14T11:10:41.191 INFO:tasks.workunit.client.0.smithi050.stderr: 7f69a17fa640 / ms_dispatch 2024-09-14T11:10:41.191 INFO:tasks.workunit.client.0.smithi050.stderr: 7f69a2ffd640 / io_context_pool 2024-09-14T11:10:41.191 INFO:tasks.workunit.client.0.smithi050.stderr: 7f69a97fa640 / ms_dispatch 2024-09-14T11:10:41.191 INFO:tasks.workunit.client.0.smithi050.stderr: 7f69abfff640 / ms_dispatch 2024-09-14T11:10:41.191 INFO:tasks.workunit.client.0.smithi050.stderr: 7f69b1e0b640 / io_context_pool 2024-09-14T11:10:41.191 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6ac33d8640 / msgr-worker-2 2024-09-14T11:10:41.191 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6ac3bd9640 / msgr-worker-1 2024-09-14T11:10:41.191 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6ac43da640 / msgr-worker-0 2024-09-14T11:10:41.191 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6ac4bdb640 / io_context_pool 2024-09-14T11:10:41.191 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6ac7f26800 / radosgw-admin 2024-09-14T11:10:41.191 INFO:tasks.workunit.client.0.smithi050.stderr: max_recent 500 2024-09-14T11:10:41.191 INFO:tasks.workunit.client.0.smithi050.stderr: max_new 1000 2024-09-14T11:10:41.191 INFO:tasks.workunit.client.0.smithi050.stderr: log_file /var/log/ceph/ceph-client.admin.107864.log 2024-09-14T11:10:41.191 INFO:tasks.workunit.client.0.smithi050.stderr:--- end dump of recent events --- 2024-09-14T11:10:41.192 INFO:tasks.workunit.client.0.smithi050.stderr:--- begin dump of recent events --- 2024-09-14T11:10:41.192 INFO:tasks.workunit.client.0.smithi050.stderr: -499> 2024-09-14T11:10:40.857+0000 7f69b1e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:41.192 INFO:tasks.workunit.client.0.smithi050.stderr: -498> 2024-09-14T11:10:40.857+0000 7f69b1e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:10:41.192 INFO:tasks.workunit.client.0.smithi050.stderr: -497> 2024-09-14T11:10:40.857+0000 7f69b1e0b640 10 monclient: dump: 2024-09-14T11:10:41.192 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:41.192 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:41.192 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.192 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.192 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:41.192 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.192 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:41.192 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:41.192 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:41.193 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.193 INFO:tasks.workunit.client.0.smithi050.stderr: -496> 2024-09-14T11:10:40.857+0000 7f6ac7f26800 5 monclient: authenticate success, global_id 6945 2024-09-14T11:10:41.193 INFO:tasks.workunit.client.0.smithi050.stderr: -495> 2024-09-14T11:10:40.857+0000 7f6ac7f26800 10 monclient: get_monmap_and_config success 2024-09-14T11:10:41.193 INFO:tasks.workunit.client.0.smithi050.stderr: -494> 2024-09-14T11:10:40.857+0000 7f6ac7f26800 4 set_mon_vals no callback set 2024-09-14T11:10:41.193 INFO:tasks.workunit.client.0.smithi050.stderr: -493> 2024-09-14T11:10:40.857+0000 7f6ac7f26800 10 monclient: shutdown 2024-09-14T11:10:41.193 INFO:tasks.workunit.client.0.smithi050.stderr: -492> 2024-09-14T11:10:40.857+0000 7f6ac7f26800 5 asok(0x56294b6bc270) unregister_commands rotate-key 2024-09-14T11:10:41.193 INFO:tasks.workunit.client.0.smithi050.stderr: -491> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 10 monclient: build_initial_monmap 2024-09-14T11:10:41.193 INFO:tasks.workunit.client.0.smithi050.stderr: -490> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 1 build_initial for_mkfs: 0 2024-09-14T11:10:41.193 INFO:tasks.workunit.client.0.smithi050.stderr: -489> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 10 monclient: monmap: 2024-09-14T11:10:41.193 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:10:41.193 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:10:41.193 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:10:41.193 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:10:41.193 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:10:41.194 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.194 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:10:41.194 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:10:41.194 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:10:41.194 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.194 INFO:tasks.workunit.client.0.smithi050.stderr: -488> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding auth protocol: cephx 2024-09-14T11:10:41.194 INFO:tasks.workunit.client.0.smithi050.stderr: -487> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding auth protocol: cephx 2024-09-14T11:10:41.194 INFO:tasks.workunit.client.0.smithi050.stderr: -486> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding auth protocol: cephx 2024-09-14T11:10:41.194 INFO:tasks.workunit.client.0.smithi050.stderr: -485> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding con mode: secure 2024-09-14T11:10:41.194 INFO:tasks.workunit.client.0.smithi050.stderr: -484> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding con mode: crc 2024-09-14T11:10:41.194 INFO:tasks.workunit.client.0.smithi050.stderr: -483> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding con mode: secure 2024-09-14T11:10:41.194 INFO:tasks.workunit.client.0.smithi050.stderr: -482> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding con mode: crc 2024-09-14T11:10:41.194 INFO:tasks.workunit.client.0.smithi050.stderr: -481> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding con mode: secure 2024-09-14T11:10:41.195 INFO:tasks.workunit.client.0.smithi050.stderr: -480> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding con mode: crc 2024-09-14T11:10:41.195 INFO:tasks.workunit.client.0.smithi050.stderr: -479> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding con mode: crc 2024-09-14T11:10:41.195 INFO:tasks.workunit.client.0.smithi050.stderr: -478> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding con mode: secure 2024-09-14T11:10:41.195 INFO:tasks.workunit.client.0.smithi050.stderr: -477> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding con mode: crc 2024-09-14T11:10:41.195 INFO:tasks.workunit.client.0.smithi050.stderr: -476> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding con mode: secure 2024-09-14T11:10:41.195 INFO:tasks.workunit.client.0.smithi050.stderr: -475> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding con mode: crc 2024-09-14T11:10:41.195 INFO:tasks.workunit.client.0.smithi050.stderr: -474> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8e26b0) adding con mode: secure 2024-09-14T11:10:41.195 INFO:tasks.workunit.client.0.smithi050.stderr: -473> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.195 INFO:tasks.workunit.client.0.smithi050.stderr: -472> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 1 librados: starting msgr at 2024-09-14T11:10:41.195 INFO:tasks.workunit.client.0.smithi050.stderr: -471> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 1 librados: starting objecter 2024-09-14T11:10:41.195 INFO:tasks.workunit.client.0.smithi050.stderr: -470> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command objecter_requests hook 0x56294b8dfad0 2024-09-14T11:10:41.195 INFO:tasks.workunit.client.0.smithi050.stderr: -469> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 1 librados: setting wanted keys 2024-09-14T11:10:41.195 INFO:tasks.workunit.client.0.smithi050.stderr: -468> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 1 librados: calling monclient init 2024-09-14T11:10:41.196 INFO:tasks.workunit.client.0.smithi050.stderr: -467> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 10 monclient: init 2024-09-14T11:10:41.196 INFO:tasks.workunit.client.0.smithi050.stderr: -466> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding auth protocol: cephx 2024-09-14T11:10:41.196 INFO:tasks.workunit.client.0.smithi050.stderr: -465> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding auth protocol: cephx 2024-09-14T11:10:41.196 INFO:tasks.workunit.client.0.smithi050.stderr: -464> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding auth protocol: cephx 2024-09-14T11:10:41.196 INFO:tasks.workunit.client.0.smithi050.stderr: -463> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding con mode: secure 2024-09-14T11:10:41.196 INFO:tasks.workunit.client.0.smithi050.stderr: -462> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding con mode: crc 2024-09-14T11:10:41.196 INFO:tasks.workunit.client.0.smithi050.stderr: -461> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding con mode: secure 2024-09-14T11:10:41.196 INFO:tasks.workunit.client.0.smithi050.stderr: -460> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding con mode: crc 2024-09-14T11:10:41.196 INFO:tasks.workunit.client.0.smithi050.stderr: -459> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding con mode: secure 2024-09-14T11:10:41.196 INFO:tasks.workunit.client.0.smithi050.stderr: -458> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding con mode: crc 2024-09-14T11:10:41.196 INFO:tasks.workunit.client.0.smithi050.stderr: -457> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding con mode: crc 2024-09-14T11:10:41.196 INFO:tasks.workunit.client.0.smithi050.stderr: -456> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding con mode: secure 2024-09-14T11:10:41.196 INFO:tasks.workunit.client.0.smithi050.stderr: -455> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding con mode: crc 2024-09-14T11:10:41.196 INFO:tasks.workunit.client.0.smithi050.stderr: -454> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding con mode: secure 2024-09-14T11:10:41.197 INFO:tasks.workunit.client.0.smithi050.stderr: -453> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding con mode: crc 2024-09-14T11:10:41.197 INFO:tasks.workunit.client.0.smithi050.stderr: -452> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 5 AuthRegistry(0x56294b8dccd0) adding con mode: secure 2024-09-14T11:10:41.197 INFO:tasks.workunit.client.0.smithi050.stderr: -451> 2024-09-14T11:10:40.858+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.197 INFO:tasks.workunit.client.0.smithi050.stderr: -450> 2024-09-14T11:10:40.859+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.197 INFO:tasks.workunit.client.0.smithi050.stderr: -449> 2024-09-14T11:10:40.859+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command rotate-key hook 0x56294b8dce18 2024-09-14T11:10:41.197 INFO:tasks.workunit.client.0.smithi050.stderr: -448> 2024-09-14T11:10:40.859+0000 7f6ac7f26800 10 monclient: _reopen_session rank -1 2024-09-14T11:10:41.197 INFO:tasks.workunit.client.0.smithi050.stderr: -447> 2024-09-14T11:10:40.859+0000 7f6ac7f26800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:10:41.197 INFO:tasks.workunit.client.0.smithi050.stderr: -446> 2024-09-14T11:10:40.859+0000 7f6ac7f26800 10 monclient(hunting): picked mon.noname-a con 0x56294b767df0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:10:41.197 INFO:tasks.workunit.client.0.smithi050.stderr: -445> 2024-09-14T11:10:40.859+0000 7f6ac7f26800 10 monclient(hunting): picked mon.noname-b con 0x56294b78a200 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:10:41.197 INFO:tasks.workunit.client.0.smithi050.stderr: -444> 2024-09-14T11:10:40.859+0000 7f6ac7f26800 10 monclient(hunting): picked mon.noname-c con 0x56294b825990 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:10:41.197 INFO:tasks.workunit.client.0.smithi050.stderr: -443> 2024-09-14T11:10:40.859+0000 7f6ac7f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:41.197 INFO:tasks.workunit.client.0.smithi050.stderr: -442> 2024-09-14T11:10:40.859+0000 7f6ac7f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:41.197 INFO:tasks.workunit.client.0.smithi050.stderr: -441> 2024-09-14T11:10:40.859+0000 7f6ac7f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:41.198 INFO:tasks.workunit.client.0.smithi050.stderr: -440> 2024-09-14T11:10:40.859+0000 7f6ac7f26800 10 monclient(hunting): _renew_subs 2024-09-14T11:10:41.198 INFO:tasks.workunit.client.0.smithi050.stderr: -439> 2024-09-14T11:10:40.859+0000 7f6ac7f26800 10 monclient(hunting): authenticate will time out at 2293.496189s 2024-09-14T11:10:41.198 INFO:tasks.workunit.client.0.smithi050.stderr: -438> 2024-09-14T11:10:40.859+0000 7f6ac3bd9640 10 monclient(hunting): get_auth_request con 0x56294b767df0 auth_method 0 2024-09-14T11:10:41.198 INFO:tasks.workunit.client.0.smithi050.stderr: -437> 2024-09-14T11:10:40.859+0000 7f6ac3bd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:41.198 INFO:tasks.workunit.client.0.smithi050.stderr: -436> 2024-09-14T11:10:40.859+0000 7f6ac3bd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:41.198 INFO:tasks.workunit.client.0.smithi050.stderr: -435> 2024-09-14T11:10:40.859+0000 7f6ac3bd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:41.198 INFO:tasks.workunit.client.0.smithi050.stderr: -434> 2024-09-14T11:10:40.859+0000 7f6ac43da640 10 monclient(hunting): get_auth_request con 0x56294b825990 auth_method 0 2024-09-14T11:10:41.198 INFO:tasks.workunit.client.0.smithi050.stderr: -433> 2024-09-14T11:10:40.859+0000 7f6ac43da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:41.198 INFO:tasks.workunit.client.0.smithi050.stderr: -432> 2024-09-14T11:10:40.859+0000 7f6ac43da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:41.198 INFO:tasks.workunit.client.0.smithi050.stderr: -431> 2024-09-14T11:10:40.859+0000 7f6ac43da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:41.198 INFO:tasks.workunit.client.0.smithi050.stderr: -430> 2024-09-14T11:10:40.859+0000 7f6ac3bd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:41.198 INFO:tasks.workunit.client.0.smithi050.stderr: -429> 2024-09-14T11:10:40.859+0000 7f6ac3bd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:41.198 INFO:tasks.workunit.client.0.smithi050.stderr: -428> 2024-09-14T11:10:40.859+0000 7f6ac3bd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:41.199 INFO:tasks.workunit.client.0.smithi050.stderr: -427> 2024-09-14T11:10:40.859+0000 7f6ac43da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:41.199 INFO:tasks.workunit.client.0.smithi050.stderr: -426> 2024-09-14T11:10:40.859+0000 7f6ac43da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:41.199 INFO:tasks.workunit.client.0.smithi050.stderr: -425> 2024-09-14T11:10:40.859+0000 7f6ac43da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:41.199 INFO:tasks.workunit.client.0.smithi050.stderr: -424> 2024-09-14T11:10:40.859+0000 7f6ac33d8640 10 monclient(hunting): get_auth_request con 0x56294b78a200 auth_method 0 2024-09-14T11:10:41.199 INFO:tasks.workunit.client.0.smithi050.stderr: -423> 2024-09-14T11:10:40.859+0000 7f6ac33d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:41.199 INFO:tasks.workunit.client.0.smithi050.stderr: -422> 2024-09-14T11:10:40.859+0000 7f6ac33d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:41.199 INFO:tasks.workunit.client.0.smithi050.stderr: -421> 2024-09-14T11:10:40.859+0000 7f6ac33d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:41.199 INFO:tasks.workunit.client.0.smithi050.stderr: -420> 2024-09-14T11:10:40.859+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:41.199 INFO:tasks.workunit.client.0.smithi050.stderr: -419> 2024-09-14T11:10:40.859+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:41.199 INFO:tasks.workunit.client.0.smithi050.stderr: -418> 2024-09-14T11:10:40.859+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:41.199 INFO:tasks.workunit.client.0.smithi050.stderr: -417> 2024-09-14T11:10:40.859+0000 7f6ac3bd9640 10 monclient(hunting): handle_auth_done global_id 6948 payload 824 2024-09-14T11:10:41.199 INFO:tasks.workunit.client.0.smithi050.stderr: -416> 2024-09-14T11:10:40.859+0000 7f6ac3bd9640 10 monclient: _finish_hunting 0 2024-09-14T11:10:41.199 INFO:tasks.workunit.client.0.smithi050.stderr: -415> 2024-09-14T11:10:40.859+0000 7f6ac3bd9640 1 monclient: found mon.noname-a 2024-09-14T11:10:41.199 INFO:tasks.workunit.client.0.smithi050.stderr: -414> 2024-09-14T11:10:40.859+0000 7f6ac3bd9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:10:41.200 INFO:tasks.workunit.client.0.smithi050.stderr: -413> 2024-09-14T11:10:40.859+0000 7f69abfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:41.200 INFO:tasks.workunit.client.0.smithi050.stderr: -412> 2024-09-14T11:10:40.859+0000 7f69abfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:10:41.200 INFO:tasks.workunit.client.0.smithi050.stderr: -411> 2024-09-14T11:10:40.859+0000 7f69abfff640 10 monclient: dump: 2024-09-14T11:10:41.200 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:41.200 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:41.200 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.200 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.200 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:41.200 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.200 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:41.200 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:41.200 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:41.201 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.201 INFO:tasks.workunit.client.0.smithi050.stderr: -410> 2024-09-14T11:10:40.860+0000 7f69abfff640 10 monclient: _finish_auth 0 2024-09-14T11:10:41.201 INFO:tasks.workunit.client.0.smithi050.stderr: -409> 2024-09-14T11:10:40.860+0000 7f69abfff640 10 monclient: _check_auth_tickets 2024-09-14T11:10:41.201 INFO:tasks.workunit.client.0.smithi050.stderr: -408> 2024-09-14T11:10:40.860+0000 7f6ac7f26800 5 monclient: authenticate success, global_id 6948 2024-09-14T11:10:41.201 INFO:tasks.workunit.client.0.smithi050.stderr: -407> 2024-09-14T11:10:40.860+0000 7f6ac7f26800 10 monclient: _renew_subs 2024-09-14T11:10:41.201 INFO:tasks.workunit.client.0.smithi050.stderr: -406> 2024-09-14T11:10:40.860+0000 7f6ac7f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:10:41.201 INFO:tasks.workunit.client.0.smithi050.stderr: -405> 2024-09-14T11:10:40.860+0000 7f69abfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:10:41.201 INFO:tasks.workunit.client.0.smithi050.stderr: -404> 2024-09-14T11:10:40.860+0000 7f69abfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:41.201 INFO:tasks.workunit.client.0.smithi050.stderr: -403> 2024-09-14T11:10:40.860+0000 7f69abfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:10:41.201 INFO:tasks.workunit.client.0.smithi050.stderr: -402> 2024-09-14T11:10:40.860+0000 7f69abfff640 10 monclient: dump: 2024-09-14T11:10:41.201 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:41.201 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:41.201 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.202 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.202 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:41.202 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.202 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:41.202 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:41.202 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:41.202 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.202 INFO:tasks.workunit.client.0.smithi050.stderr: -401> 2024-09-14T11:10:40.860+0000 7f69b1e0b640 4 set_mon_vals no callback set 2024-09-14T11:10:41.202 INFO:tasks.workunit.client.0.smithi050.stderr: -400> 2024-09-14T11:10:40.860+0000 7f6ac7f26800 10 monclient: _renew_subs 2024-09-14T11:10:41.202 INFO:tasks.workunit.client.0.smithi050.stderr: -399> 2024-09-14T11:10:40.860+0000 7f6ac7f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:10:41.202 INFO:tasks.workunit.client.0.smithi050.stderr: -398> 2024-09-14T11:10:40.860+0000 7f6ac7f26800 1 librados: init done 2024-09-14T11:10:41.202 INFO:tasks.workunit.client.0.smithi050.stderr: -397> 2024-09-14T11:10:40.862+0000 7f69abfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:10:41.202 INFO:tasks.workunit.client.0.smithi050.stderr: -396> 2024-09-14T11:10:40.862+0000 7f69abfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:10:41.202 INFO:tasks.workunit.client.0.smithi050.stderr: -395> 2024-09-14T11:10:40.862+0000 7f69abfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:10:41.203 INFO:tasks.workunit.client.0.smithi050.stderr: -394> 2024-09-14T11:10:40.862+0000 7f6ac33d8640 10 monclient: get_auth_request con 0x7f69ac077230 auth_method 0 2024-09-14T11:10:41.203 INFO:tasks.workunit.client.0.smithi050.stderr: -393> 2024-09-14T11:10:40.862+0000 7f6ac43da640 10 monclient: get_auth_request con 0x56294b903b00 auth_method 0 2024-09-14T11:10:41.203 INFO:tasks.workunit.client.0.smithi050.stderr: -392> 2024-09-14T11:10:40.863+0000 7f6ac3bd9640 10 monclient: get_auth_request con 0x56294b9282b0 auth_method 0 2024-09-14T11:10:41.203 INFO:tasks.workunit.client.0.smithi050.stderr: -391> 2024-09-14T11:10:40.864+0000 7f6ac33d8640 10 monclient: get_auth_request con 0x56294b92c950 auth_method 0 2024-09-14T11:10:41.203 INFO:tasks.workunit.client.0.smithi050.stderr: -390> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 10 monclient: build_initial_monmap 2024-09-14T11:10:41.203 INFO:tasks.workunit.client.0.smithi050.stderr: -389> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 1 build_initial for_mkfs: 0 2024-09-14T11:10:41.203 INFO:tasks.workunit.client.0.smithi050.stderr: -388> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 10 monclient: monmap: 2024-09-14T11:10:41.203 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:10:41.203 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:10:41.203 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:10:41.203 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:10:41.203 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:10:41.203 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.203 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:10:41.204 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:10:41.204 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:10:41.204 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.204 INFO:tasks.workunit.client.0.smithi050.stderr: -387> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding auth protocol: cephx 2024-09-14T11:10:41.204 INFO:tasks.workunit.client.0.smithi050.stderr: -386> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding auth protocol: cephx 2024-09-14T11:10:41.204 INFO:tasks.workunit.client.0.smithi050.stderr: -385> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding auth protocol: cephx 2024-09-14T11:10:41.204 INFO:tasks.workunit.client.0.smithi050.stderr: -384> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding con mode: secure 2024-09-14T11:10:41.204 INFO:tasks.workunit.client.0.smithi050.stderr: -383> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding con mode: crc 2024-09-14T11:10:41.204 INFO:tasks.workunit.client.0.smithi050.stderr: -382> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding con mode: secure 2024-09-14T11:10:41.204 INFO:tasks.workunit.client.0.smithi050.stderr: -381> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding con mode: crc 2024-09-14T11:10:41.204 INFO:tasks.workunit.client.0.smithi050.stderr: -380> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding con mode: secure 2024-09-14T11:10:41.204 INFO:tasks.workunit.client.0.smithi050.stderr: -379> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding con mode: crc 2024-09-14T11:10:41.204 INFO:tasks.workunit.client.0.smithi050.stderr: -378> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding con mode: crc 2024-09-14T11:10:41.204 INFO:tasks.workunit.client.0.smithi050.stderr: -377> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding con mode: secure 2024-09-14T11:10:41.205 INFO:tasks.workunit.client.0.smithi050.stderr: -376> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding con mode: crc 2024-09-14T11:10:41.205 INFO:tasks.workunit.client.0.smithi050.stderr: -375> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding con mode: secure 2024-09-14T11:10:41.205 INFO:tasks.workunit.client.0.smithi050.stderr: -374> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding con mode: crc 2024-09-14T11:10:41.205 INFO:tasks.workunit.client.0.smithi050.stderr: -373> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 AuthRegistry(0x56294b931720) adding con mode: secure 2024-09-14T11:10:41.205 INFO:tasks.workunit.client.0.smithi050.stderr: -372> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.205 INFO:tasks.workunit.client.0.smithi050.stderr: -371> 2024-09-14T11:10:40.865+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command objecter_requests cmddesc objecter_requests hook 0x56294b934c50 EEXIST 2024-09-14T11:10:41.205 INFO:tasks.workunit.client.0.smithi050.stderr: -370> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 10 monclient: init 2024-09-14T11:10:41.205 INFO:tasks.workunit.client.0.smithi050.stderr: -369> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding auth protocol: cephx 2024-09-14T11:10:41.205 INFO:tasks.workunit.client.0.smithi050.stderr: -368> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding auth protocol: cephx 2024-09-14T11:10:41.205 INFO:tasks.workunit.client.0.smithi050.stderr: -367> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding auth protocol: cephx 2024-09-14T11:10:41.205 INFO:tasks.workunit.client.0.smithi050.stderr: -366> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding con mode: secure 2024-09-14T11:10:41.205 INFO:tasks.workunit.client.0.smithi050.stderr: -365> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding con mode: crc 2024-09-14T11:10:41.205 INFO:tasks.workunit.client.0.smithi050.stderr: -364> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding con mode: secure 2024-09-14T11:10:41.205 INFO:tasks.workunit.client.0.smithi050.stderr: -363> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding con mode: crc 2024-09-14T11:10:41.206 INFO:tasks.workunit.client.0.smithi050.stderr: -362> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding con mode: secure 2024-09-14T11:10:41.206 INFO:tasks.workunit.client.0.smithi050.stderr: -361> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding con mode: crc 2024-09-14T11:10:41.206 INFO:tasks.workunit.client.0.smithi050.stderr: -360> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding con mode: crc 2024-09-14T11:10:41.206 INFO:tasks.workunit.client.0.smithi050.stderr: -359> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding con mode: secure 2024-09-14T11:10:41.206 INFO:tasks.workunit.client.0.smithi050.stderr: -358> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding con mode: crc 2024-09-14T11:10:41.206 INFO:tasks.workunit.client.0.smithi050.stderr: -357> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding con mode: secure 2024-09-14T11:10:41.206 INFO:tasks.workunit.client.0.smithi050.stderr: -356> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding con mode: crc 2024-09-14T11:10:41.206 INFO:tasks.workunit.client.0.smithi050.stderr: -355> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 AuthRegistry(0x56294b92fce8) adding con mode: secure 2024-09-14T11:10:41.206 INFO:tasks.workunit.client.0.smithi050.stderr: -354> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.206 INFO:tasks.workunit.client.0.smithi050.stderr: -353> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.206 INFO:tasks.workunit.client.0.smithi050.stderr: -352> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command rotate-key cmddesc rotate-key hook 0x56294b92fe30 EEXIST 2024-09-14T11:10:41.206 INFO:tasks.workunit.client.0.smithi050.stderr: -351> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 10 monclient: _reopen_session rank -1 2024-09-14T11:10:41.206 INFO:tasks.workunit.client.0.smithi050.stderr: -350> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:10:41.206 INFO:tasks.workunit.client.0.smithi050.stderr: -349> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 10 monclient(hunting): picked mon.noname-b con 0x56294b958f70 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:10:41.207 INFO:tasks.workunit.client.0.smithi050.stderr: -348> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 10 monclient(hunting): picked mon.noname-c con 0x56294b959350 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:10:41.207 INFO:tasks.workunit.client.0.smithi050.stderr: -347> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 10 monclient(hunting): picked mon.noname-a con 0x56294b957c80 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:10:41.207 INFO:tasks.workunit.client.0.smithi050.stderr: -346> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:41.207 INFO:tasks.workunit.client.0.smithi050.stderr: -345> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:41.207 INFO:tasks.workunit.client.0.smithi050.stderr: -344> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:41.207 INFO:tasks.workunit.client.0.smithi050.stderr: -343> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 10 monclient(hunting): _renew_subs 2024-09-14T11:10:41.207 INFO:tasks.workunit.client.0.smithi050.stderr: -342> 2024-09-14T11:10:40.866+0000 7f6ac7f26800 10 monclient(hunting): authenticate will time out at 2293.503560s 2024-09-14T11:10:41.207 INFO:tasks.workunit.client.0.smithi050.stderr: -341> 2024-09-14T11:10:40.866+0000 7f6ac33d8640 10 monclient(hunting): get_auth_request con 0x56294b959350 auth_method 0 2024-09-14T11:10:41.207 INFO:tasks.workunit.client.0.smithi050.stderr: -340> 2024-09-14T11:10:40.866+0000 7f6ac33d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:41.207 INFO:tasks.workunit.client.0.smithi050.stderr: -339> 2024-09-14T11:10:40.866+0000 7f6ac33d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:41.207 INFO:tasks.workunit.client.0.smithi050.stderr: -338> 2024-09-14T11:10:40.866+0000 7f6ac33d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:41.207 INFO:tasks.workunit.client.0.smithi050.stderr: -337> 2024-09-14T11:10:40.866+0000 7f6ac43da640 10 monclient(hunting): get_auth_request con 0x56294b957c80 auth_method 0 2024-09-14T11:10:41.208 INFO:tasks.workunit.client.0.smithi050.stderr: -336> 2024-09-14T11:10:40.866+0000 7f6ac43da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:41.208 INFO:tasks.workunit.client.0.smithi050.stderr: -335> 2024-09-14T11:10:40.866+0000 7f6ac43da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:41.208 INFO:tasks.workunit.client.0.smithi050.stderr: -334> 2024-09-14T11:10:40.866+0000 7f6ac43da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:41.208 INFO:tasks.workunit.client.0.smithi050.stderr: -333> 2024-09-14T11:10:40.866+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:41.208 INFO:tasks.workunit.client.0.smithi050.stderr: -332> 2024-09-14T11:10:40.866+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:41.208 INFO:tasks.workunit.client.0.smithi050.stderr: -331> 2024-09-14T11:10:40.866+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:41.208 INFO:tasks.workunit.client.0.smithi050.stderr: -330> 2024-09-14T11:10:40.866+0000 7f6ac43da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:41.208 INFO:tasks.workunit.client.0.smithi050.stderr: -329> 2024-09-14T11:10:40.866+0000 7f6ac43da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:41.208 INFO:tasks.workunit.client.0.smithi050.stderr: -328> 2024-09-14T11:10:40.866+0000 7f6ac43da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:41.208 INFO:tasks.workunit.client.0.smithi050.stderr: -327> 2024-09-14T11:10:40.866+0000 7f6ac3bd9640 10 monclient(hunting): get_auth_request con 0x56294b958f70 auth_method 0 2024-09-14T11:10:41.208 INFO:tasks.workunit.client.0.smithi050.stderr: -326> 2024-09-14T11:10:40.866+0000 7f6ac3bd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:41.208 INFO:tasks.workunit.client.0.smithi050.stderr: -325> 2024-09-14T11:10:40.866+0000 7f6ac3bd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:41.208 INFO:tasks.workunit.client.0.smithi050.stderr: -324> 2024-09-14T11:10:40.866+0000 7f6ac3bd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:41.208 INFO:tasks.workunit.client.0.smithi050.stderr: -323> 2024-09-14T11:10:40.866+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_done global_id 6530 payload 824 2024-09-14T11:10:41.209 INFO:tasks.workunit.client.0.smithi050.stderr: -322> 2024-09-14T11:10:40.866+0000 7f6ac33d8640 10 monclient: _finish_hunting 0 2024-09-14T11:10:41.209 INFO:tasks.workunit.client.0.smithi050.stderr: -321> 2024-09-14T11:10:40.866+0000 7f6ac33d8640 1 monclient: found mon.noname-c 2024-09-14T11:10:41.209 INFO:tasks.workunit.client.0.smithi050.stderr: -320> 2024-09-14T11:10:40.866+0000 7f6ac33d8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:10:41.209 INFO:tasks.workunit.client.0.smithi050.stderr: -319> 2024-09-14T11:10:40.867+0000 7f69a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:41.209 INFO:tasks.workunit.client.0.smithi050.stderr: -318> 2024-09-14T11:10:40.867+0000 7f69a97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:10:41.209 INFO:tasks.workunit.client.0.smithi050.stderr: -317> 2024-09-14T11:10:40.867+0000 7f69a97fa640 10 monclient: dump: 2024-09-14T11:10:41.209 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:41.209 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:41.209 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.209 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.209 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:41.209 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.209 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:41.209 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:41.210 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:41.210 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.210 INFO:tasks.workunit.client.0.smithi050.stderr: -316> 2024-09-14T11:10:40.867+0000 7f69a97fa640 10 monclient: _finish_auth 0 2024-09-14T11:10:41.210 INFO:tasks.workunit.client.0.smithi050.stderr: -315> 2024-09-14T11:10:40.867+0000 7f69a97fa640 10 monclient: _check_auth_tickets 2024-09-14T11:10:41.210 INFO:tasks.workunit.client.0.smithi050.stderr: -314> 2024-09-14T11:10:40.867+0000 7f69a97fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:10:41.210 INFO:tasks.workunit.client.0.smithi050.stderr: -313> 2024-09-14T11:10:40.867+0000 7f69a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:41.210 INFO:tasks.workunit.client.0.smithi050.stderr: -312> 2024-09-14T11:10:40.867+0000 7f69a97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:10:41.210 INFO:tasks.workunit.client.0.smithi050.stderr: -311> 2024-09-14T11:10:40.867+0000 7f69a97fa640 10 monclient: dump: 2024-09-14T11:10:41.210 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:41.210 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:41.210 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.210 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.210 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:41.210 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.211 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:41.211 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:41.211 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:41.211 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.211 INFO:tasks.workunit.client.0.smithi050.stderr: -310> 2024-09-14T11:10:40.867+0000 7f6ac7f26800 5 monclient: authenticate success, global_id 6530 2024-09-14T11:10:41.211 INFO:tasks.workunit.client.0.smithi050.stderr: -309> 2024-09-14T11:10:40.867+0000 7f6ac7f26800 10 monclient: _renew_subs 2024-09-14T11:10:41.211 INFO:tasks.workunit.client.0.smithi050.stderr: -308> 2024-09-14T11:10:40.867+0000 7f6ac7f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:10:41.211 INFO:tasks.workunit.client.0.smithi050.stderr: -307> 2024-09-14T11:10:40.867+0000 7f6ac4bdb640 4 set_mon_vals no callback set 2024-09-14T11:10:41.211 INFO:tasks.workunit.client.0.smithi050.stderr: -306> 2024-09-14T11:10:40.867+0000 7f6ac7f26800 10 monclient: _renew_subs 2024-09-14T11:10:41.211 INFO:tasks.workunit.client.0.smithi050.stderr: -305> 2024-09-14T11:10:40.867+0000 7f6ac7f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:10:41.211 INFO:tasks.workunit.client.0.smithi050.stderr: -304> 2024-09-14T11:10:40.869+0000 7f69a97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:10:41.211 INFO:tasks.workunit.client.0.smithi050.stderr: -303> 2024-09-14T11:10:40.869+0000 7f69a97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:10:41.211 INFO:tasks.workunit.client.0.smithi050.stderr: -302> 2024-09-14T11:10:40.869+0000 7f69a97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:10:41.211 INFO:tasks.workunit.client.0.smithi050.stderr: -301> 2024-09-14T11:10:40.869+0000 7f6ac3bd9640 10 monclient: get_auth_request con 0x7f699c077140 auth_method 0 2024-09-14T11:10:41.212 INFO:tasks.workunit.client.0.smithi050.stderr: -300> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 10 monclient: get_monmap_and_config 2024-09-14T11:10:41.212 INFO:tasks.workunit.client.0.smithi050.stderr: -299> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 10 monclient: build_initial_monmap 2024-09-14T11:10:41.212 INFO:tasks.workunit.client.0.smithi050.stderr: -298> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 1 build_initial for_mkfs: 0 2024-09-14T11:10:41.212 INFO:tasks.workunit.client.0.smithi050.stderr: -297> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 10 monclient: monmap: 2024-09-14T11:10:41.212 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:10:41.212 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:10:41.212 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:10:41.212 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:10:41.212 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:10:41.212 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.212 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:10:41.212 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:10:41.212 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:10:41.212 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.212 INFO:tasks.workunit.client.0.smithi050.stderr: -296> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding auth protocol: cephx 2024-09-14T11:10:41.213 INFO:tasks.workunit.client.0.smithi050.stderr: -295> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding auth protocol: cephx 2024-09-14T11:10:41.213 INFO:tasks.workunit.client.0.smithi050.stderr: -294> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding auth protocol: cephx 2024-09-14T11:10:41.213 INFO:tasks.workunit.client.0.smithi050.stderr: -293> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding con mode: secure 2024-09-14T11:10:41.213 INFO:tasks.workunit.client.0.smithi050.stderr: -292> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding con mode: crc 2024-09-14T11:10:41.213 INFO:tasks.workunit.client.0.smithi050.stderr: -291> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding con mode: secure 2024-09-14T11:10:41.213 INFO:tasks.workunit.client.0.smithi050.stderr: -290> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding con mode: crc 2024-09-14T11:10:41.213 INFO:tasks.workunit.client.0.smithi050.stderr: -289> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding con mode: secure 2024-09-14T11:10:41.213 INFO:tasks.workunit.client.0.smithi050.stderr: -288> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding con mode: crc 2024-09-14T11:10:41.213 INFO:tasks.workunit.client.0.smithi050.stderr: -287> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding con mode: crc 2024-09-14T11:10:41.213 INFO:tasks.workunit.client.0.smithi050.stderr: -286> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding con mode: secure 2024-09-14T11:10:41.213 INFO:tasks.workunit.client.0.smithi050.stderr: -285> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding con mode: crc 2024-09-14T11:10:41.213 INFO:tasks.workunit.client.0.smithi050.stderr: -284> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding con mode: secure 2024-09-14T11:10:41.213 INFO:tasks.workunit.client.0.smithi050.stderr: -283> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding con mode: crc 2024-09-14T11:10:41.213 INFO:tasks.workunit.client.0.smithi050.stderr: -282> 2024-09-14T11:10:40.869+0000 7f6ac7f26800 5 AuthRegistry(0x56294b978ec0) adding con mode: secure 2024-09-14T11:10:41.214 INFO:tasks.workunit.client.0.smithi050.stderr: -281> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.214 INFO:tasks.workunit.client.0.smithi050.stderr: -280> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 10 monclient: init 2024-09-14T11:10:41.214 INFO:tasks.workunit.client.0.smithi050.stderr: -279> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding auth protocol: cephx 2024-09-14T11:10:41.214 INFO:tasks.workunit.client.0.smithi050.stderr: -278> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding auth protocol: cephx 2024-09-14T11:10:41.214 INFO:tasks.workunit.client.0.smithi050.stderr: -277> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding auth protocol: cephx 2024-09-14T11:10:41.214 INFO:tasks.workunit.client.0.smithi050.stderr: -276> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding con mode: secure 2024-09-14T11:10:41.214 INFO:tasks.workunit.client.0.smithi050.stderr: -275> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding con mode: crc 2024-09-14T11:10:41.214 INFO:tasks.workunit.client.0.smithi050.stderr: -274> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding con mode: secure 2024-09-14T11:10:41.214 INFO:tasks.workunit.client.0.smithi050.stderr: -273> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding con mode: crc 2024-09-14T11:10:41.214 INFO:tasks.workunit.client.0.smithi050.stderr: -272> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding con mode: secure 2024-09-14T11:10:41.214 INFO:tasks.workunit.client.0.smithi050.stderr: -271> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding con mode: crc 2024-09-14T11:10:41.214 INFO:tasks.workunit.client.0.smithi050.stderr: -270> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding con mode: crc 2024-09-14T11:10:41.214 INFO:tasks.workunit.client.0.smithi050.stderr: -269> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding con mode: secure 2024-09-14T11:10:41.214 INFO:tasks.workunit.client.0.smithi050.stderr: -268> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding con mode: crc 2024-09-14T11:10:41.214 INFO:tasks.workunit.client.0.smithi050.stderr: -267> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding con mode: secure 2024-09-14T11:10:41.214 INFO:tasks.workunit.client.0.smithi050.stderr: -266> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding con mode: crc 2024-09-14T11:10:41.215 INFO:tasks.workunit.client.0.smithi050.stderr: -265> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdead0) adding con mode: secure 2024-09-14T11:10:41.215 INFO:tasks.workunit.client.0.smithi050.stderr: -264> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.215 INFO:tasks.workunit.client.0.smithi050.stderr: -263> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.215 INFO:tasks.workunit.client.0.smithi050.stderr: -262> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command rotate-key cmddesc rotate-key hook 0x7ffd8dfdec18 EEXIST 2024-09-14T11:10:41.215 INFO:tasks.workunit.client.0.smithi050.stderr: -261> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 10 monclient: _reopen_session rank -1 2024-09-14T11:10:41.215 INFO:tasks.workunit.client.0.smithi050.stderr: -260> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:10:41.215 INFO:tasks.workunit.client.0.smithi050.stderr: -259> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 10 monclient(hunting): picked mon.noname-a con 0x56294b97d0c0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:10:41.215 INFO:tasks.workunit.client.0.smithi050.stderr: -258> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 10 monclient(hunting): picked mon.noname-c con 0x56294b9a7990 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:10:41.215 INFO:tasks.workunit.client.0.smithi050.stderr: -257> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 10 monclient(hunting): picked mon.noname-b con 0x56294b9a8e10 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:10:41.215 INFO:tasks.workunit.client.0.smithi050.stderr: -256> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:41.215 INFO:tasks.workunit.client.0.smithi050.stderr: -255> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:41.215 INFO:tasks.workunit.client.0.smithi050.stderr: -254> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:41.215 INFO:tasks.workunit.client.0.smithi050.stderr: -253> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 10 monclient(hunting): _renew_subs 2024-09-14T11:10:41.215 INFO:tasks.workunit.client.0.smithi050.stderr: -252> 2024-09-14T11:10:40.870+0000 7f6ac7f26800 10 monclient(hunting): authenticate will time out at 2293.507776s 2024-09-14T11:10:41.216 INFO:tasks.workunit.client.0.smithi050.stderr: -251> 2024-09-14T11:10:40.870+0000 7f6ac3bd9640 10 monclient(hunting): get_auth_request con 0x56294b97d0c0 auth_method 0 2024-09-14T11:10:41.216 INFO:tasks.workunit.client.0.smithi050.stderr: -250> 2024-09-14T11:10:40.870+0000 7f6ac3bd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:41.216 INFO:tasks.workunit.client.0.smithi050.stderr: -249> 2024-09-14T11:10:40.870+0000 7f6ac3bd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:41.216 INFO:tasks.workunit.client.0.smithi050.stderr: -248> 2024-09-14T11:10:40.870+0000 7f6ac3bd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:41.216 INFO:tasks.workunit.client.0.smithi050.stderr: -247> 2024-09-14T11:10:40.870+0000 7f6ac33d8640 10 monclient(hunting): get_auth_request con 0x56294b9a7990 auth_method 0 2024-09-14T11:10:41.216 INFO:tasks.workunit.client.0.smithi050.stderr: -246> 2024-09-14T11:10:40.870+0000 7f6ac33d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:41.216 INFO:tasks.workunit.client.0.smithi050.stderr: -245> 2024-09-14T11:10:40.870+0000 7f6ac33d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:41.216 INFO:tasks.workunit.client.0.smithi050.stderr: -244> 2024-09-14T11:10:40.870+0000 7f6ac33d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:41.216 INFO:tasks.workunit.client.0.smithi050.stderr: -243> 2024-09-14T11:10:40.870+0000 7f6ac3bd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:41.216 INFO:tasks.workunit.client.0.smithi050.stderr: -242> 2024-09-14T11:10:40.870+0000 7f6ac3bd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:41.216 INFO:tasks.workunit.client.0.smithi050.stderr: -241> 2024-09-14T11:10:40.870+0000 7f6ac3bd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:41.216 INFO:tasks.workunit.client.0.smithi050.stderr: -240> 2024-09-14T11:10:40.870+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:41.216 INFO:tasks.workunit.client.0.smithi050.stderr: -239> 2024-09-14T11:10:40.870+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:41.216 INFO:tasks.workunit.client.0.smithi050.stderr: -238> 2024-09-14T11:10:40.870+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:41.216 INFO:tasks.workunit.client.0.smithi050.stderr: -237> 2024-09-14T11:10:40.871+0000 7f6ac3bd9640 10 monclient(hunting): handle_auth_done global_id 6954 payload 274 2024-09-14T11:10:41.216 INFO:tasks.workunit.client.0.smithi050.stderr: -236> 2024-09-14T11:10:40.871+0000 7f6ac3bd9640 10 monclient: _finish_hunting 0 2024-09-14T11:10:41.217 INFO:tasks.workunit.client.0.smithi050.stderr: -235> 2024-09-14T11:10:40.871+0000 7f6ac3bd9640 1 monclient: found mon.noname-a 2024-09-14T11:10:41.217 INFO:tasks.workunit.client.0.smithi050.stderr: -234> 2024-09-14T11:10:40.871+0000 7f6ac3bd9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:10:41.217 INFO:tasks.workunit.client.0.smithi050.stderr: -233> 2024-09-14T11:10:40.871+0000 7f69a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:41.217 INFO:tasks.workunit.client.0.smithi050.stderr: -232> 2024-09-14T11:10:40.871+0000 7f69a2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:10:41.217 INFO:tasks.workunit.client.0.smithi050.stderr: -231> 2024-09-14T11:10:40.871+0000 7f69a2ffd640 10 monclient: dump: 2024-09-14T11:10:41.217 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:41.217 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:41.217 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.217 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.217 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:41.217 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.217 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:41.217 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:41.218 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:41.218 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.218 INFO:tasks.workunit.client.0.smithi050.stderr: -230> 2024-09-14T11:10:40.871+0000 7f69a2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:10:41.218 INFO:tasks.workunit.client.0.smithi050.stderr: -229> 2024-09-14T11:10:40.871+0000 7f69a2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:10:41.218 INFO:tasks.workunit.client.0.smithi050.stderr: -228> 2024-09-14T11:10:40.871+0000 7f69a2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:10:41.218 INFO:tasks.workunit.client.0.smithi050.stderr: -227> 2024-09-14T11:10:40.871+0000 7f6ac7f26800 5 monclient: authenticate success, global_id 6954 2024-09-14T11:10:41.218 INFO:tasks.workunit.client.0.smithi050.stderr: -226> 2024-09-14T11:10:40.871+0000 7f6ac7f26800 10 monclient: get_monmap_and_config success 2024-09-14T11:10:41.218 INFO:tasks.workunit.client.0.smithi050.stderr: -225> 2024-09-14T11:10:40.871+0000 7f6ac7f26800 4 set_mon_vals no callback set 2024-09-14T11:10:41.218 INFO:tasks.workunit.client.0.smithi050.stderr: -224> 2024-09-14T11:10:40.871+0000 7f69a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:41.218 INFO:tasks.workunit.client.0.smithi050.stderr: -223> 2024-09-14T11:10:40.871+0000 7f69a2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:10:41.218 INFO:tasks.workunit.client.0.smithi050.stderr: -222> 2024-09-14T11:10:40.871+0000 7f69a2ffd640 10 monclient: dump: 2024-09-14T11:10:41.218 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:41.218 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:41.218 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.219 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.219 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:41.219 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.219 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:41.219 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:41.219 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:41.219 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.219 INFO:tasks.workunit.client.0.smithi050.stderr: -221> 2024-09-14T11:10:40.871+0000 7f6ac7f26800 10 monclient: shutdown 2024-09-14T11:10:41.219 INFO:tasks.workunit.client.0.smithi050.stderr: -220> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 10 monclient: build_initial_monmap 2024-09-14T11:10:41.219 INFO:tasks.workunit.client.0.smithi050.stderr: -219> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 1 build_initial for_mkfs: 0 2024-09-14T11:10:41.219 INFO:tasks.workunit.client.0.smithi050.stderr: -218> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 10 monclient: monmap: 2024-09-14T11:10:41.219 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:10:41.219 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:10:41.220 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:10:41.220 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:10:41.220 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:10:41.220 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.220 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:10:41.220 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:10:41.220 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:10:41.220 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.220 INFO:tasks.workunit.client.0.smithi050.stderr: -217> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding auth protocol: cephx 2024-09-14T11:10:41.220 INFO:tasks.workunit.client.0.smithi050.stderr: -216> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding auth protocol: cephx 2024-09-14T11:10:41.220 INFO:tasks.workunit.client.0.smithi050.stderr: -215> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding auth protocol: cephx 2024-09-14T11:10:41.220 INFO:tasks.workunit.client.0.smithi050.stderr: -214> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding con mode: secure 2024-09-14T11:10:41.220 INFO:tasks.workunit.client.0.smithi050.stderr: -213> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding con mode: crc 2024-09-14T11:10:41.220 INFO:tasks.workunit.client.0.smithi050.stderr: -212> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding con mode: secure 2024-09-14T11:10:41.221 INFO:tasks.workunit.client.0.smithi050.stderr: -211> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding con mode: crc 2024-09-14T11:10:41.221 INFO:tasks.workunit.client.0.smithi050.stderr: -210> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding con mode: secure 2024-09-14T11:10:41.221 INFO:tasks.workunit.client.0.smithi050.stderr: -209> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding con mode: crc 2024-09-14T11:10:41.221 INFO:tasks.workunit.client.0.smithi050.stderr: -208> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding con mode: crc 2024-09-14T11:10:41.221 INFO:tasks.workunit.client.0.smithi050.stderr: -207> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding con mode: secure 2024-09-14T11:10:41.221 INFO:tasks.workunit.client.0.smithi050.stderr: -206> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding con mode: crc 2024-09-14T11:10:41.221 INFO:tasks.workunit.client.0.smithi050.stderr: -205> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding con mode: secure 2024-09-14T11:10:41.221 INFO:tasks.workunit.client.0.smithi050.stderr: -204> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding con mode: crc 2024-09-14T11:10:41.221 INFO:tasks.workunit.client.0.smithi050.stderr: -203> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b99fb70) adding con mode: secure 2024-09-14T11:10:41.221 INFO:tasks.workunit.client.0.smithi050.stderr: -202> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.221 INFO:tasks.workunit.client.0.smithi050.stderr: -201> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 1 librados: starting msgr at 2024-09-14T11:10:41.221 INFO:tasks.workunit.client.0.smithi050.stderr: -200> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 1 librados: starting objecter 2024-09-14T11:10:41.221 INFO:tasks.workunit.client.0.smithi050.stderr: -199> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command objecter_requests cmddesc objecter_requests hook 0x56294b9a77c0 EEXIST 2024-09-14T11:10:41.222 INFO:tasks.workunit.client.0.smithi050.stderr: -198> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 1 librados: setting wanted keys 2024-09-14T11:10:41.222 INFO:tasks.workunit.client.0.smithi050.stderr: -197> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 1 librados: calling monclient init 2024-09-14T11:10:41.222 INFO:tasks.workunit.client.0.smithi050.stderr: -196> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 10 monclient: init 2024-09-14T11:10:41.222 INFO:tasks.workunit.client.0.smithi050.stderr: -195> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding auth protocol: cephx 2024-09-14T11:10:41.222 INFO:tasks.workunit.client.0.smithi050.stderr: -194> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding auth protocol: cephx 2024-09-14T11:10:41.222 INFO:tasks.workunit.client.0.smithi050.stderr: -193> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding auth protocol: cephx 2024-09-14T11:10:41.222 INFO:tasks.workunit.client.0.smithi050.stderr: -192> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding con mode: secure 2024-09-14T11:10:41.222 INFO:tasks.workunit.client.0.smithi050.stderr: -191> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding con mode: crc 2024-09-14T11:10:41.222 INFO:tasks.workunit.client.0.smithi050.stderr: -190> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding con mode: secure 2024-09-14T11:10:41.222 INFO:tasks.workunit.client.0.smithi050.stderr: -189> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding con mode: crc 2024-09-14T11:10:41.222 INFO:tasks.workunit.client.0.smithi050.stderr: -188> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding con mode: secure 2024-09-14T11:10:41.222 INFO:tasks.workunit.client.0.smithi050.stderr: -187> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding con mode: crc 2024-09-14T11:10:41.222 INFO:tasks.workunit.client.0.smithi050.stderr: -186> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding con mode: crc 2024-09-14T11:10:41.223 INFO:tasks.workunit.client.0.smithi050.stderr: -185> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding con mode: secure 2024-09-14T11:10:41.223 INFO:tasks.workunit.client.0.smithi050.stderr: -184> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding con mode: crc 2024-09-14T11:10:41.223 INFO:tasks.workunit.client.0.smithi050.stderr: -183> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding con mode: secure 2024-09-14T11:10:41.223 INFO:tasks.workunit.client.0.smithi050.stderr: -182> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding con mode: crc 2024-09-14T11:10:41.223 INFO:tasks.workunit.client.0.smithi050.stderr: -181> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 AuthRegistry(0x56294b96d830) adding con mode: secure 2024-09-14T11:10:41.223 INFO:tasks.workunit.client.0.smithi050.stderr: -180> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.223 INFO:tasks.workunit.client.0.smithi050.stderr: -179> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.223 INFO:tasks.workunit.client.0.smithi050.stderr: -178> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command rotate-key cmddesc rotate-key hook 0x56294b96d978 EEXIST 2024-09-14T11:10:41.223 INFO:tasks.workunit.client.0.smithi050.stderr: -177> 2024-09-14T11:10:40.872+0000 7f6ac7f26800 10 monclient: _reopen_session rank -1 2024-09-14T11:10:41.223 INFO:tasks.workunit.client.0.smithi050.stderr: -176> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:10:41.223 INFO:tasks.workunit.client.0.smithi050.stderr: -175> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient(hunting): picked mon.noname-b con 0x56294b97d0c0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:10:41.223 INFO:tasks.workunit.client.0.smithi050.stderr: -174> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient(hunting): picked mon.noname-c con 0x56294b9a7990 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:10:41.223 INFO:tasks.workunit.client.0.smithi050.stderr: -173> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient(hunting): picked mon.noname-a con 0x56294b9a8e10 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:10:41.223 INFO:tasks.workunit.client.0.smithi050.stderr: -172> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:41.224 INFO:tasks.workunit.client.0.smithi050.stderr: -171> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:41.224 INFO:tasks.workunit.client.0.smithi050.stderr: -170> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:10:41.224 INFO:tasks.workunit.client.0.smithi050.stderr: -169> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient(hunting): _renew_subs 2024-09-14T11:10:41.224 INFO:tasks.workunit.client.0.smithi050.stderr: -168> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient(hunting): authenticate will time out at 2293.510057s 2024-09-14T11:10:41.224 INFO:tasks.workunit.client.0.smithi050.stderr: -167> 2024-09-14T11:10:40.873+0000 7f6ac33d8640 10 monclient(hunting): get_auth_request con 0x56294b9a7990 auth_method 0 2024-09-14T11:10:41.224 INFO:tasks.workunit.client.0.smithi050.stderr: -166> 2024-09-14T11:10:40.873+0000 7f6ac33d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:41.224 INFO:tasks.workunit.client.0.smithi050.stderr: -165> 2024-09-14T11:10:40.873+0000 7f6ac33d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:41.224 INFO:tasks.workunit.client.0.smithi050.stderr: -164> 2024-09-14T11:10:40.873+0000 7f6ac33d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:41.224 INFO:tasks.workunit.client.0.smithi050.stderr: -163> 2024-09-14T11:10:40.873+0000 7f6ac43da640 10 monclient(hunting): get_auth_request con 0x56294b9a8e10 auth_method 0 2024-09-14T11:10:41.224 INFO:tasks.workunit.client.0.smithi050.stderr: -162> 2024-09-14T11:10:40.873+0000 7f6ac43da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:41.224 INFO:tasks.workunit.client.0.smithi050.stderr: -161> 2024-09-14T11:10:40.873+0000 7f6ac43da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:41.224 INFO:tasks.workunit.client.0.smithi050.stderr: -160> 2024-09-14T11:10:40.873+0000 7f6ac43da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:41.224 INFO:tasks.workunit.client.0.smithi050.stderr: -159> 2024-09-14T11:10:40.873+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:41.225 INFO:tasks.workunit.client.0.smithi050.stderr: -158> 2024-09-14T11:10:40.873+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:41.225 INFO:tasks.workunit.client.0.smithi050.stderr: -157> 2024-09-14T11:10:40.873+0000 7f6ac33d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:41.225 INFO:tasks.workunit.client.0.smithi050.stderr: -156> 2024-09-14T11:10:40.873+0000 7f6ac43da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:41.225 INFO:tasks.workunit.client.0.smithi050.stderr: -155> 2024-09-14T11:10:40.873+0000 7f6ac43da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:41.225 INFO:tasks.workunit.client.0.smithi050.stderr: -154> 2024-09-14T11:10:40.873+0000 7f6ac43da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:41.225 INFO:tasks.workunit.client.0.smithi050.stderr: -153> 2024-09-14T11:10:40.873+0000 7f6ac3bd9640 10 monclient(hunting): get_auth_request con 0x56294b97d0c0 auth_method 0 2024-09-14T11:10:41.225 INFO:tasks.workunit.client.0.smithi050.stderr: -152> 2024-09-14T11:10:40.873+0000 7f6ac3bd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:10:41.225 INFO:tasks.workunit.client.0.smithi050.stderr: -151> 2024-09-14T11:10:40.873+0000 7f6ac3bd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:10:41.225 INFO:tasks.workunit.client.0.smithi050.stderr: -150> 2024-09-14T11:10:40.873+0000 7f6ac3bd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:10:41.225 INFO:tasks.workunit.client.0.smithi050.stderr: -149> 2024-09-14T11:10:40.873+0000 7f6ac3bd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:10:41.225 INFO:tasks.workunit.client.0.smithi050.stderr: -148> 2024-09-14T11:10:40.873+0000 7f6ac3bd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:10:41.225 INFO:tasks.workunit.client.0.smithi050.stderr: -147> 2024-09-14T11:10:40.873+0000 7f6ac3bd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:10:41.225 INFO:tasks.workunit.client.0.smithi050.stderr: -146> 2024-09-14T11:10:40.873+0000 7f6ac43da640 10 monclient(hunting): handle_auth_done global_id 6957 payload 824 2024-09-14T11:10:41.225 INFO:tasks.workunit.client.0.smithi050.stderr: -145> 2024-09-14T11:10:40.873+0000 7f6ac43da640 10 monclient: _finish_hunting 0 2024-09-14T11:10:41.226 INFO:tasks.workunit.client.0.smithi050.stderr: -144> 2024-09-14T11:10:40.873+0000 7f6ac43da640 1 monclient: found mon.noname-a 2024-09-14T11:10:41.226 INFO:tasks.workunit.client.0.smithi050.stderr: -143> 2024-09-14T11:10:40.873+0000 7f6ac43da640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:10:41.226 INFO:tasks.workunit.client.0.smithi050.stderr: -142> 2024-09-14T11:10:40.873+0000 7f69a17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:41.226 INFO:tasks.workunit.client.0.smithi050.stderr: -141> 2024-09-14T11:10:40.873+0000 7f69a17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:10:41.226 INFO:tasks.workunit.client.0.smithi050.stderr: -140> 2024-09-14T11:10:40.873+0000 7f69a17fa640 10 monclient: dump: 2024-09-14T11:10:41.226 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:41.226 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:41.226 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.226 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.226 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:41.226 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.226 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:41.226 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:41.227 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:41.227 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.227 INFO:tasks.workunit.client.0.smithi050.stderr: -139> 2024-09-14T11:10:40.873+0000 7f69a17fa640 10 monclient: _finish_auth 0 2024-09-14T11:10:41.227 INFO:tasks.workunit.client.0.smithi050.stderr: -138> 2024-09-14T11:10:40.873+0000 7f69a17fa640 10 monclient: _check_auth_tickets 2024-09-14T11:10:41.227 INFO:tasks.workunit.client.0.smithi050.stderr: -137> 2024-09-14T11:10:40.873+0000 7f69a17fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:10:41.227 INFO:tasks.workunit.client.0.smithi050.stderr: -136> 2024-09-14T11:10:40.873+0000 7f69a17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:10:41.227 INFO:tasks.workunit.client.0.smithi050.stderr: -135> 2024-09-14T11:10:40.873+0000 7f69a17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:10:41.227 INFO:tasks.workunit.client.0.smithi050.stderr: -134> 2024-09-14T11:10:40.873+0000 7f69a17fa640 10 monclient: dump: 2024-09-14T11:10:41.227 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:10:41.227 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:10:41.227 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.227 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:10:41.227 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:10:41.227 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:10:41.228 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:10:41.228 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:10:41.228 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:10:41.228 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.228 INFO:tasks.workunit.client.0.smithi050.stderr: -133> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 5 monclient: authenticate success, global_id 6957 2024-09-14T11:10:41.228 INFO:tasks.workunit.client.0.smithi050.stderr: -132> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient: _renew_subs 2024-09-14T11:10:41.228 INFO:tasks.workunit.client.0.smithi050.stderr: -131> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:10:41.228 INFO:tasks.workunit.client.0.smithi050.stderr: -130> 2024-09-14T11:10:40.873+0000 7f69a2ffd640 4 set_mon_vals no callback set 2024-09-14T11:10:41.228 INFO:tasks.workunit.client.0.smithi050.stderr: -129> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient: _renew_subs 2024-09-14T11:10:41.228 INFO:tasks.workunit.client.0.smithi050.stderr: -128> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:10:41.228 INFO:tasks.workunit.client.0.smithi050.stderr: -127> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 1 librados: init done 2024-09-14T11:10:41.228 INFO:tasks.workunit.client.0.smithi050.stderr: -126> 2024-09-14T11:10:40.873+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command cr dump hook 0x56294b99b778 2024-09-14T11:10:41.228 INFO:tasks.workunit.client.0.smithi050.stderr: -125> 2024-09-14T11:10:40.875+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.229 INFO:tasks.workunit.client.0.smithi050.stderr: -124> 2024-09-14T11:10:40.876+0000 7f69a17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:10:41.229 INFO:tasks.workunit.client.0.smithi050.stderr: -123> 2024-09-14T11:10:40.876+0000 7f69a17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:10:41.229 INFO:tasks.workunit.client.0.smithi050.stderr: -122> 2024-09-14T11:10:40.876+0000 7f69a17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:10:41.229 INFO:tasks.workunit.client.0.smithi050.stderr: -121> 2024-09-14T11:10:40.876+0000 7f6ac3bd9640 10 monclient: get_auth_request con 0x7f698c077230 auth_method 0 2024-09-14T11:10:41.229 INFO:tasks.workunit.client.0.smithi050.stderr: -120> 2024-09-14T11:10:40.876+0000 7f6ac33d8640 10 monclient: get_auth_request con 0x56294b9c7840 auth_method 0 2024-09-14T11:10:41.229 INFO:tasks.workunit.client.0.smithi050.stderr: -119> 2024-09-14T11:10:40.876+0000 7f6ac7f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.229 INFO:tasks.workunit.client.0.smithi050.stderr: -118> 2024-09-14T11:10:40.876+0000 7f6ac7f26800 20 realm 2024-09-14T11:10:41.229 INFO:tasks.workunit.client.0.smithi050.stderr: -117> 2024-09-14T11:10:40.876+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.229 INFO:tasks.workunit.client.0.smithi050.stderr: -116> 2024-09-14T11:10:40.877+0000 7f6ac7f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.229 INFO:tasks.workunit.client.0.smithi050.stderr: -115> 2024-09-14T11:10:40.877+0000 7f6ac7f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:41.229 INFO:tasks.workunit.client.0.smithi050.stderr: -114> 2024-09-14T11:10:40.877+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.229 INFO:tasks.workunit.client.0.smithi050.stderr: -113> 2024-09-14T11:10:40.877+0000 7f6ac7f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.229 INFO:tasks.workunit.client.0.smithi050.stderr: -112> 2024-09-14T11:10:40.877+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.229 INFO:tasks.workunit.client.0.smithi050.stderr: -111> 2024-09-14T11:10:40.877+0000 7f6ac3bd9640 10 monclient: get_auth_request con 0x56294b9cbad0 auth_method 0 2024-09-14T11:10:41.230 INFO:tasks.workunit.client.0.smithi050.stderr: -110> 2024-09-14T11:10:40.878+0000 7f6ac7f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:41.230 INFO:tasks.workunit.client.0.smithi050.stderr: -109> 2024-09-14T11:10:40.878+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.230 INFO:tasks.workunit.client.0.smithi050.stderr: -108> 2024-09-14T11:10:40.878+0000 7f6ac33d8640 10 monclient: get_auth_request con 0x56294b9cf330 auth_method 0 2024-09-14T11:10:41.230 INFO:tasks.workunit.client.0.smithi050.stderr: -107> 2024-09-14T11:10:40.878+0000 7f6ac7f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:41.230 INFO:tasks.workunit.client.0.smithi050.stderr: -106> 2024-09-14T11:10:40.878+0000 7f6ac7f26800 20 searching for the correct realm 2024-09-14T11:10:41.230 INFO:tasks.workunit.client.0.smithi050.stderr: -105> 2024-09-14T11:10:40.879+0000 7f6ac43da640 10 monclient: get_auth_request con 0x56294b9d4060 auth_method 0 2024-09-14T11:10:41.230 INFO:tasks.workunit.client.0.smithi050.stderr: -104> 2024-09-14T11:10:40.879+0000 7f6ac3bd9640 10 monclient: get_auth_request con 0x7f6abc025070 auth_method 0 2024-09-14T11:10:41.230 INFO:tasks.workunit.client.0.smithi050.stderr: -103> 2024-09-14T11:10:40.881+0000 7f6ac33d8640 10 monclient: get_auth_request con 0x7f6abc06c0b0 auth_method 0 2024-09-14T11:10:41.230 INFO:tasks.workunit.client.0.smithi050.stderr: -102> 2024-09-14T11:10:40.881+0000 7f6ac33d8640 0 -- 172.21.15.50:0/3641330477 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f6abc06c0b0 msgr2=0x7f6abc070910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:41.230 INFO:tasks.workunit.client.0.smithi050.stderr: -101> 2024-09-14T11:10:41.082+0000 7f6ac33d8640 10 monclient: get_auth_request con 0x7f6abc06c0b0 auth_method 0 2024-09-14T11:10:41.230 INFO:tasks.workunit.client.0.smithi050.stderr: -100> 2024-09-14T11:10:41.084+0000 7f6ac43da640 10 monclient: get_auth_request con 0x7f6ab406b020 auth_method 0 2024-09-14T11:10:41.230 INFO:tasks.workunit.client.0.smithi050.stderr: -99> 2024-09-14T11:10:41.085+0000 7f6ac3bd9640 10 monclient: get_auth_request con 0x7f6abc067d50 auth_method 0 2024-09-14T11:10:41.230 INFO:tasks.workunit.client.0.smithi050.stderr: -98> 2024-09-14T11:10:41.086+0000 7f6ac33d8640 0 -- 172.21.15.50:0/3641330477 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x56294b9c7840 msgr2=0x56294b9c9cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:41.230 INFO:tasks.workunit.client.0.smithi050.stderr: -97> 2024-09-14T11:10:41.086+0000 7f69a17fa640 1 client.6957.objecter ms_handle_reset 0x56294b9c7840 session 0x56294b9c71c0 osd.6 2024-09-14T11:10:41.231 INFO:tasks.workunit.client.0.smithi050.stderr: -96> 2024-09-14T11:10:41.086+0000 7f69a17fa640 10 monclient: _renew_subs 2024-09-14T11:10:41.231 INFO:tasks.workunit.client.0.smithi050.stderr: -95> 2024-09-14T11:10:41.086+0000 7f69a17fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:10:41.231 INFO:tasks.workunit.client.0.smithi050.stderr: -94> 2024-09-14T11:10:41.086+0000 7f6ac33d8640 10 monclient: get_auth_request con 0x7f698c087460 auth_method 0 2024-09-14T11:10:41.231 INFO:tasks.workunit.client.0.smithi050.stderr: -93> 2024-09-14T11:10:41.089+0000 7f6ac7f26800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:10:41.231 INFO:tasks.workunit.client.0.smithi050.stderr: -92> 2024-09-14T11:10:41.089+0000 7f6ac7f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:41.231 INFO:tasks.workunit.client.0.smithi050.stderr: -91> 2024-09-14T11:10:41.089+0000 7f6ac7f26800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:10:41.231 INFO:tasks.workunit.client.0.smithi050.stderr: -90> 2024-09-14T11:10:41.089+0000 7f6ac7f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:41.231 INFO:tasks.workunit.client.0.smithi050.stderr: -89> 2024-09-14T11:10:41.089+0000 7f6ac7f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:41.231 INFO:tasks.workunit.client.0.smithi050.stderr: -88> 2024-09-14T11:10:41.089+0000 7f6ac7f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:41.231 INFO:tasks.workunit.client.0.smithi050.stderr: -87> 2024-09-14T11:10:41.089+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.231 INFO:tasks.workunit.client.0.smithi050.stderr: -86> 2024-09-14T11:10:41.090+0000 7f6ac7f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.231 INFO:tasks.workunit.client.0.smithi050.stderr: -85> 2024-09-14T11:10:41.090+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.231 INFO:tasks.workunit.client.0.smithi050.stderr: -84> 2024-09-14T11:10:41.090+0000 7f6ac7f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:41.232 INFO:tasks.workunit.client.0.smithi050.stderr: -83> 2024-09-14T11:10:41.090+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.232 INFO:tasks.workunit.client.0.smithi050.stderr: -82> 2024-09-14T11:10:41.090+0000 7f6ac7f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:41.232 INFO:tasks.workunit.client.0.smithi050.stderr: -81> 2024-09-14T11:10:41.090+0000 7f6ac7f26800 20 zone default found 2024-09-14T11:10:41.232 INFO:tasks.workunit.client.0.smithi050.stderr: -80> 2024-09-14T11:10:41.090+0000 7f6ac7f26800 4 Realm: () 2024-09-14T11:10:41.232 INFO:tasks.workunit.client.0.smithi050.stderr: -79> 2024-09-14T11:10:41.090+0000 7f6ac7f26800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:10:41.232 INFO:tasks.workunit.client.0.smithi050.stderr: -78> 2024-09-14T11:10:41.090+0000 7f6ac7f26800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:10:41.232 INFO:tasks.workunit.client.0.smithi050.stderr: -77> 2024-09-14T11:10:41.090+0000 7f6ac7f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:41.232 INFO:tasks.workunit.client.0.smithi050.stderr: -76> 2024-09-14T11:10:41.090+0000 7f6ac7f26800 20 zonegroup default 2024-09-14T11:10:41.232 INFO:tasks.workunit.client.0.smithi050.stderr: -75> 2024-09-14T11:10:41.090+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.232 INFO:tasks.workunit.client.0.smithi050.stderr: -74> 2024-09-14T11:10:41.091+0000 7f6ac7f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.232 INFO:tasks.workunit.client.0.smithi050.stderr: -73> 2024-09-14T11:10:41.091+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.232 INFO:tasks.workunit.client.0.smithi050.stderr: -72> 2024-09-14T11:10:41.091+0000 7f6ac7f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.232 INFO:tasks.workunit.client.0.smithi050.stderr: -71> 2024-09-14T11:10:41.091+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.232 INFO:tasks.workunit.client.0.smithi050.stderr: -70> 2024-09-14T11:10:41.091+0000 7f6ac7f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.233 INFO:tasks.workunit.client.0.smithi050.stderr: -69> 2024-09-14T11:10:41.091+0000 7f6ac7f26800 20 started sync module instance, tier type = 2024-09-14T11:10:41.233 INFO:tasks.workunit.client.0.smithi050.stderr: -68> 2024-09-14T11:10:41.091+0000 7f6ac7f26800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:10:41.233 INFO:tasks.workunit.client.0.smithi050.stderr: -67> 2024-09-14T11:10:41.100+0000 7f6ac7f26800 20 add_watcher() i=0 2024-09-14T11:10:41.233 INFO:tasks.workunit.client.0.smithi050.stderr: -66> 2024-09-14T11:10:41.100+0000 7f6ac7f26800 20 add_watcher() i=1 2024-09-14T11:10:41.233 INFO:tasks.workunit.client.0.smithi050.stderr: -65> 2024-09-14T11:10:41.100+0000 7f6ac7f26800 20 add_watcher() i=2 2024-09-14T11:10:41.233 INFO:tasks.workunit.client.0.smithi050.stderr: -64> 2024-09-14T11:10:41.100+0000 7f6ac7f26800 20 add_watcher() i=3 2024-09-14T11:10:41.233 INFO:tasks.workunit.client.0.smithi050.stderr: -63> 2024-09-14T11:10:41.100+0000 7f6ac7f26800 20 add_watcher() i=4 2024-09-14T11:10:41.233 INFO:tasks.workunit.client.0.smithi050.stderr: -62> 2024-09-14T11:10:41.100+0000 7f6ac7f26800 20 add_watcher() i=5 2024-09-14T11:10:41.233 INFO:tasks.workunit.client.0.smithi050.stderr: -61> 2024-09-14T11:10:41.100+0000 7f6ac7f26800 20 add_watcher() i=6 2024-09-14T11:10:41.233 INFO:tasks.workunit.client.0.smithi050.stderr: -60> 2024-09-14T11:10:41.101+0000 7f6ac7f26800 20 add_watcher() i=7 2024-09-14T11:10:41.234 INFO:tasks.workunit.client.0.smithi050.stderr: -59> 2024-09-14T11:10:41.101+0000 7f6ac7f26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:41.234 INFO:tasks.workunit.client.0.smithi050.stderr: -58> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding auth protocol: cephx 2024-09-14T11:10:41.234 INFO:tasks.workunit.client.0.smithi050.stderr: -57> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding auth protocol: cephx 2024-09-14T11:10:41.234 INFO:tasks.workunit.client.0.smithi050.stderr: -56> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding auth protocol: cephx 2024-09-14T11:10:41.234 INFO:tasks.workunit.client.0.smithi050.stderr: -55> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding con mode: secure 2024-09-14T11:10:41.234 INFO:tasks.workunit.client.0.smithi050.stderr: -54> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding con mode: crc 2024-09-14T11:10:41.234 INFO:tasks.workunit.client.0.smithi050.stderr: -53> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding con mode: secure 2024-09-14T11:10:41.234 INFO:tasks.workunit.client.0.smithi050.stderr: -52> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding con mode: crc 2024-09-14T11:10:41.234 INFO:tasks.workunit.client.0.smithi050.stderr: -51> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding con mode: secure 2024-09-14T11:10:41.234 INFO:tasks.workunit.client.0.smithi050.stderr: -50> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding con mode: crc 2024-09-14T11:10:41.234 INFO:tasks.workunit.client.0.smithi050.stderr: -49> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding con mode: crc 2024-09-14T11:10:41.234 INFO:tasks.workunit.client.0.smithi050.stderr: -48> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding con mode: secure 2024-09-14T11:10:41.234 INFO:tasks.workunit.client.0.smithi050.stderr: -47> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding con mode: crc 2024-09-14T11:10:41.235 INFO:tasks.workunit.client.0.smithi050.stderr: -46> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding con mode: secure 2024-09-14T11:10:41.235 INFO:tasks.workunit.client.0.smithi050.stderr: -45> 2024-09-14T11:10:41.103+0000 7f6979fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:41.235 INFO:tasks.workunit.client.0.smithi050.stderr: -44> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding con mode: crc 2024-09-14T11:10:41.235 INFO:tasks.workunit.client.0.smithi050.stderr: -43> 2024-09-14T11:10:41.103+0000 7f6ac7f26800 5 AuthRegistry(0x7ffd8dfdefb0) adding con mode: secure 2024-09-14T11:10:41.235 INFO:tasks.workunit.client.0.smithi050.stderr: -42> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:10:41.235 INFO:tasks.workunit.client.0.smithi050.stderr: -41> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:41.235 INFO:tasks.workunit.client.0.smithi050.stderr: -40> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:41.235 INFO:tasks.workunit.client.0.smithi050.stderr: -39> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command cache list hook 0x56294b9a2bf0 2024-09-14T11:10:41.235 INFO:tasks.workunit.client.0.smithi050.stderr: -38> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command cache inspect hook 0x56294b9a2bf0 2024-09-14T11:10:41.235 INFO:tasks.workunit.client.0.smithi050.stderr: -37> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command cache erase hook 0x56294b9a2bf0 2024-09-14T11:10:41.235 INFO:tasks.workunit.client.0.smithi050.stderr: -36> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command cache zap hook 0x56294b9a2bf0 2024-09-14T11:10:41.235 INFO:tasks.workunit.client.0.smithi050.stderr: -35> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 5 note: GC not initialized 2024-09-14T11:10:41.235 INFO:tasks.workunit.client.0.smithi050.stderr: -34> 2024-09-14T11:10:41.104+0000 7f6978fe1640 20 reqs_thread_entry: start 2024-09-14T11:10:41.235 INFO:tasks.workunit.client.0.smithi050.stderr: -33> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command sync trace show hook 0x7f6ab8004820 2024-09-14T11:10:41.235 INFO:tasks.workunit.client.0.smithi050.stderr: -32> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command sync trace history hook 0x7f6ab8004820 2024-09-14T11:10:41.236 INFO:tasks.workunit.client.0.smithi050.stderr: -31> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command sync trace active hook 0x7f6ab8004820 2024-09-14T11:10:41.236 INFO:tasks.workunit.client.0.smithi050.stderr: -30> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 5 asok(0x56294b6bc270) register_command sync trace active_short hook 0x7f6ab8004820 2024-09-14T11:10:41.236 INFO:tasks.workunit.client.0.smithi050.stderr: -29> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:41.236 INFO:tasks.workunit.client.0.smithi050.stderr: -28> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 20 Filter name: none 2024-09-14T11:10:41.236 INFO:tasks.workunit.client.0.smithi050.stderr: -27> 2024-09-14T11:10:41.104+0000 7f68f27fc640 20 reqs_thread_entry: start 2024-09-14T11:10:41.236 INFO:tasks.workunit.client.0.smithi050.stderr: -26> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:10:41.236 INFO:tasks.workunit.client.0.smithi050.stderr: -25> 2024-09-14T11:10:41.104+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.236 INFO:tasks.workunit.client.0.smithi050.stderr: -24> 2024-09-14T11:10:41.105+0000 7f6ac7f26800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:10:41.236 INFO:tasks.workunit.client.0.smithi050.stderr: -23> 2024-09-14T11:10:41.105+0000 7f6ac7f26800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:10:41.236 INFO:tasks.workunit.client.0.smithi050.stderr: -22> 2024-09-14T11:10:41.105+0000 7f6ac7f26800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:10:41.236 INFO:tasks.workunit.client.0.smithi050.stderr: -21> 2024-09-14T11:10:41.105+0000 7f6ac7f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 : miss 2024-09-14T11:10:41.236 INFO:tasks.workunit.client.0.smithi050.stderr: -20> 2024-09-14T11:10:41.105+0000 7f6ac7f26800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.236 INFO:tasks.workunit.client.0.smithi050.stderr: -19> 2024-09-14T11:10:41.105+0000 7f6ac7f26800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:10:41.236 INFO:tasks.workunit.client.0.smithi050.stderr: -18> 2024-09-14T11:10:41.105+0000 7f6ac7f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 info.flags=0x17 2024-09-14T11:10:41.237 INFO:tasks.workunit.client.0.smithi050.stderr: -17> 2024-09-14T11:10:41.105+0000 7f6ac7f26800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 to cache LRU end 2024-09-14T11:10:41.237 INFO:tasks.workunit.client.0.smithi050.stderr: -16> 2024-09-14T11:10:41.105+0000 7f6ac7f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:10:41.237 INFO:tasks.workunit.client.0.smithi050.stderr: -15> 2024-09-14T11:10:41.105+0000 7f6ac7f26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:41.237 INFO:tasks.workunit.client.0.smithi050.stderr: -14> 2024-09-14T11:10:41.105+0000 7f6ac7f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 2024-09-14T11:10:41.237 INFO:tasks.workunit.client.0.smithi050.stderr: -13> 2024-09-14T11:10:41.110+0000 7f6ac7f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 info.flags=0x17 2024-09-14T11:10:41.237 INFO:tasks.workunit.client.0.smithi050.stderr: -12> 2024-09-14T11:10:41.110+0000 7f6ac7f26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 to cache LRU end 2024-09-14T11:10:41.237 INFO:tasks.workunit.client.0.smithi050.stderr: -11> 2024-09-14T11:10:41.110+0000 7f6ac7f26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:41.237 INFO:tasks.workunit.client.0.smithi050.stderr: -10> 2024-09-14T11:10:41.110+0000 7f6ac7f26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28, ofs0, ns] 2024-09-14T11:10:41.237 INFO:tasks.workunit.client.0.smithi050.stderr: -9> 2024-09-14T11:10:41.111+0000 7f69a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497073 cookie 94735362258224 notifier 6957 bl.length()=1023 2024-09-14T11:10:41.237 INFO:tasks.workunit.client.0.smithi050.stderr: -8> 2024-09-14T11:10:41.111+0000 7f69a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 info.flags=0x17 2024-09-14T11:10:41.237 INFO:tasks.workunit.client.0.smithi050.stderr: -7> 2024-09-14T11:10:41.111+0000 7f69a2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 to cache LRU end 2024-09-14T11:10:41.237 INFO:tasks.workunit.client.0.smithi050.stderr: -6> 2024-09-14T11:10:41.111+0000 7f69a2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:41.237 INFO:tasks.workunit.client.0.smithi050.stderr: -5> 2024-09-14T11:10:41.112+0000 7f6ac7f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28]): orig_sources= new_sources= 2024-09-14T11:10:41.237 INFO:tasks.workunit.client.0.smithi050.stderr: -4> 2024-09-14T11:10:41.112+0000 7f6ac7f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28]): potential sources added=[] removed=[] 2024-09-14T11:10:41.237 INFO:tasks.workunit.client.0.smithi050.stderr: -3> 2024-09-14T11:10:41.112+0000 7f6ac7f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28]): orig_dests= new_dests= 2024-09-14T11:10:41.238 INFO:tasks.workunit.client.0.smithi050.stderr: -2> 2024-09-14T11:10:41.112+0000 7f6ac7f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28]): potential dests added=[] removed=[] 2024-09-14T11:10:41.238 INFO:tasks.workunit.client.0.smithi050.stderr: -1> 2024-09-14T11:10:41.113+0000 7f6ac7f26800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6ac7f26800 time 2024-09-14T11:10:41.113212+0000 2024-09-14T11:10:41.238 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:10:41.238 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.238 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:10:41.238 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6ac958c76a] 2024-09-14T11:10:41.238 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6ac958c928] 2024-09-14T11:10:41.238 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56294a2e90b1] 2024-09-14T11:10:41.238 INFO:tasks.workunit.client.0.smithi050.stderr: 4: radosgw-admin(+0xd8900e) [0x56294a7fd00e] 2024-09-14T11:10:41.238 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56294a2f8efd] 2024-09-14T11:10:41.238 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:10:41.238 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6ac8229590] 2024-09-14T11:10:41.238 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:10:41.238 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:10:41.239 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.239 INFO:tasks.workunit.client.0.smithi050.stderr: 0> 2024-09-14T11:10:41.114+0000 7f6ac7f26800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:10:41.239 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f6ac7f26800 thread_name:radosgw-admin 2024-09-14T11:10:41.239 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.239 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:10:41.239 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6ac823e6f0] 2024-09-14T11:10:41.239 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6ac828b99c] 2024-09-14T11:10:41.239 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:10:41.239 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:10:41.239 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6ac958c7c4] 2024-09-14T11:10:41.239 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6ac958c928] 2024-09-14T11:10:41.239 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56294a2e90b1] 2024-09-14T11:10:41.239 INFO:tasks.workunit.client.0.smithi050.stderr: 8: radosgw-admin(+0xd8900e) [0x56294a7fd00e] 2024-09-14T11:10:41.239 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56294a2f8efd] 2024-09-14T11:10:41.240 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:10:41.240 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6ac8229590] 2024-09-14T11:10:41.240 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:10:41.240 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:10:41.240 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:10:41.240 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.240 INFO:tasks.workunit.client.0.smithi050.stderr:--- logging levels --- 2024-09-14T11:10:41.240 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 none 2024-09-14T11:10:41.240 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 lockdep 2024-09-14T11:10:41.240 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 context 2024-09-14T11:10:41.240 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 crush 2024-09-14T11:10:41.240 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds 2024-09-14T11:10:41.240 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_balancer 2024-09-14T11:10:41.240 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_locker 2024-09-14T11:10:41.240 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log 2024-09-14T11:10:41.241 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log_expire 2024-09-14T11:10:41.241 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_migrator 2024-09-14T11:10:41.241 INFO:tasks.workunit.client.0.smithi050.stderr: 3/ 5 mds_quiesce 2024-09-14T11:10:41.241 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 buffer 2024-09-14T11:10:41.241 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 timer 2024-09-14T11:10:41.241 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 filer 2024-09-14T11:10:41.241 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 striper 2024-09-14T11:10:41.241 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 objecter 2024-09-14T11:10:41.241 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rados 2024-09-14T11:10:41.241 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd 2024-09-14T11:10:41.241 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_mirror 2024-09-14T11:10:41.241 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_replay 2024-09-14T11:10:41.241 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_pwl 2024-09-14T11:10:41.241 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 journaler 2024-09-14T11:10:41.242 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objectcacher 2024-09-14T11:10:41.242 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:10:41.242 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 client 2024-09-14T11:10:41.242 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 osd 2024-09-14T11:10:41.242 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 optracker 2024-09-14T11:10:41.242 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objclass 2024-09-14T11:10:41.242 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 filestore 2024-09-14T11:10:41.242 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 journal 2024-09-14T11:10:41.242 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 ms 2024-09-14T11:10:41.242 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mon 2024-09-14T11:10:41.242 INFO:tasks.workunit.client.0.smithi050.stderr: 0/10 monc 2024-09-14T11:10:41.242 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 paxos 2024-09-14T11:10:41.242 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 tp 2024-09-14T11:10:41.243 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 auth 2024-09-14T11:10:41.243 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 crypto 2024-09-14T11:10:41.243 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 finisher 2024-09-14T11:10:41.243 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 reserver 2024-09-14T11:10:41.243 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 heartbeatmap 2024-09-14T11:10:41.243 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 perfcounter 2024-09-14T11:10:41.243 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw 2024-09-14T11:10:41.243 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_sync 2024-09-14T11:10:41.243 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_datacache 2024-09-14T11:10:41.243 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_access 2024-09-14T11:10:41.243 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:10:41.243 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_flight 2024-09-14T11:10:41.243 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:10:41.243 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw_notification 2024-09-14T11:10:41.243 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 javaclient 2024-09-14T11:10:41.244 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 asok 2024-09-14T11:10:41.244 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 throttle 2024-09-14T11:10:41.244 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 refs 2024-09-14T11:10:41.244 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 compressor 2024-09-14T11:10:41.244 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluestore 2024-09-14T11:10:41.244 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluefs 2024-09-14T11:10:41.244 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 bdev 2024-09-14T11:10:41.244 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 kstore 2024-09-14T11:10:41.244 INFO:tasks.workunit.client.0.smithi050.stderr: 4/ 5 rocksdb 2024-09-14T11:10:41.244 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 fuse 2024-09-14T11:10:41.244 INFO:tasks.workunit.client.0.smithi050.stderr: 2/ 5 mgr 2024-09-14T11:10:41.244 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mgrc 2024-09-14T11:10:41.244 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 dpdk 2024-09-14T11:10:41.245 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 eventtrace 2024-09-14T11:10:41.245 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 prioritycache 2024-09-14T11:10:41.245 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 test 2024-09-14T11:10:41.245 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:10:41.245 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephsqlite 2024-09-14T11:10:41.245 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:10:41.245 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore 2024-09-14T11:10:41.245 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_onode 2024-09-14T11:10:41.245 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_odata 2024-09-14T11:10:41.245 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_omap 2024-09-14T11:10:41.245 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_tm 2024-09-14T11:10:41.245 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_t 2024-09-14T11:10:41.245 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:10:41.245 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_epm 2024-09-14T11:10:41.245 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_lba 2024-09-14T11:10:41.246 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:10:41.246 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cache 2024-09-14T11:10:41.246 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_journal 2024-09-14T11:10:41.246 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_device 2024-09-14T11:10:41.246 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_backref 2024-09-14T11:10:41.246 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 alienstore 2024-09-14T11:10:41.246 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mclock 2024-09-14T11:10:41.246 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cyanstore 2024-09-14T11:10:41.246 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 ceph_exporter 2024-09-14T11:10:41.246 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 memstore 2024-09-14T11:10:41.246 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 trace 2024-09-14T11:10:41.246 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 ceph_dedup 2024-09-14T11:10:41.246 INFO:tasks.workunit.client.0.smithi050.stderr: -2/-2 (syslog threshold) 2024-09-14T11:10:41.246 INFO:tasks.workunit.client.0.smithi050.stderr: 99/99 (stderr threshold) 2024-09-14T11:10:41.246 INFO:tasks.workunit.client.0.smithi050.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:10:41.247 INFO:tasks.workunit.client.0.smithi050.stderr: 7f68f27fc640 / http_manager 2024-09-14T11:10:41.247 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6978fe1640 / http_manager 2024-09-14T11:10:41.247 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6979fe3640 / rgw_dt_lg_renew 2024-09-14T11:10:41.247 INFO:tasks.workunit.client.0.smithi050.stderr: 7f69a17fa640 / ms_dispatch 2024-09-14T11:10:41.247 INFO:tasks.workunit.client.0.smithi050.stderr: 7f69a2ffd640 / io_context_pool 2024-09-14T11:10:41.247 INFO:tasks.workunit.client.0.smithi050.stderr: 7f69a97fa640 / ms_dispatch 2024-09-14T11:10:41.247 INFO:tasks.workunit.client.0.smithi050.stderr: 7f69abfff640 / ms_dispatch 2024-09-14T11:10:41.247 INFO:tasks.workunit.client.0.smithi050.stderr: 7f69b1e0b640 / io_context_pool 2024-09-14T11:10:41.247 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6ac33d8640 / msgr-worker-2 2024-09-14T11:10:41.247 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6ac3bd9640 / msgr-worker-1 2024-09-14T11:10:41.247 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6ac43da640 / msgr-worker-0 2024-09-14T11:10:41.247 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6ac4bdb640 / io_context_pool 2024-09-14T11:10:41.247 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6ac7f26800 / radosgw-admin 2024-09-14T11:10:41.247 INFO:tasks.workunit.client.0.smithi050.stderr: max_recent 500 2024-09-14T11:10:41.247 INFO:tasks.workunit.client.0.smithi050.stderr: max_new 1000 2024-09-14T11:10:41.248 INFO:tasks.workunit.client.0.smithi050.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:10:41.115018Z_5aba4624-59d4-404d-b8de-fd89c7129174/log 2024-09-14T11:10:41.248 INFO:tasks.workunit.client.0.smithi050.stderr:--- end dump of recent events --- 2024-09-14T11:10:41.248 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:10:41.249 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:41.249 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:41.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.193+0000 7f98f9820800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.195+0000 7f98f9820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.195+0000 7f98f9820800 20 realm 2024-09-14T11:10:41.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.195+0000 7f98f9820800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.195+0000 7f98f9820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.195+0000 7f98f9820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:41.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.195+0000 7f98f9820800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.195+0000 7f98f9820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.195+0000 7f98f9820800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.196+0000 7f98f9820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:41.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.196+0000 7f98f9820800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.196+0000 7f98f9820800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:41.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.196+0000 7f98f9820800 20 searching for the correct realm 2024-09-14T11:10:41.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.199+0000 7f98f6b10640 0 -- 172.21.15.50:0/2870688463 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f98f0073400 msgr2=0x7f98f0073880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:41.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.404+0000 7f98f7b12640 0 -- 172.21.15.50:0/2870688463 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5578c2f7a460 msgr2=0x5578c2f7c8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:41.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.408+0000 7f98f9820800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:10:41.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.408+0000 7f98f9820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:41.407 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.408+0000 7f98f9820800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:10:41.407 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.408+0000 7f98f9820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:41.407 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.408+0000 7f98f9820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:41.407 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.408+0000 7f98f9820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:41.407 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.408+0000 7f98f9820800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.407 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.408+0000 7f98f9820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.407 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.408+0000 7f98f9820800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.408 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.409+0000 7f98f9820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:41.408 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.409+0000 7f98f9820800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.408 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.409+0000 7f98f9820800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:41.408 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.409+0000 7f98f9820800 20 zone default found 2024-09-14T11:10:41.408 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.409+0000 7f98f9820800 4 Realm: () 2024-09-14T11:10:41.408 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.409+0000 7f98f9820800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:10:41.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.409+0000 7f98f9820800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:10:41.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.409+0000 7f98f9820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:41.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.409+0000 7f98f9820800 20 zonegroup default 2024-09-14T11:10:41.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.409+0000 7f98f9820800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.409+0000 7f98f9820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.409+0000 7f98f9820800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.410+0000 7f98f9820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.410+0000 7f98f9820800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.410+0000 7f98f9820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.410+0000 7f98f9820800 20 started sync module instance, tier type = 2024-09-14T11:10:41.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.410+0000 7f98f9820800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:10:41.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.418+0000 7f98f9820800 20 add_watcher() i=0 2024-09-14T11:10:41.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.418+0000 7f98f9820800 20 add_watcher() i=1 2024-09-14T11:10:41.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.418+0000 7f98f9820800 20 add_watcher() i=2 2024-09-14T11:10:41.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.418+0000 7f98f9820800 20 add_watcher() i=3 2024-09-14T11:10:41.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.418+0000 7f98f9820800 20 add_watcher() i=4 2024-09-14T11:10:41.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.418+0000 7f98f9820800 20 add_watcher() i=5 2024-09-14T11:10:41.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.418+0000 7f98f9820800 20 add_watcher() i=6 2024-09-14T11:10:41.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.419+0000 7f98f9820800 20 add_watcher() i=7 2024-09-14T11:10:41.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.419+0000 7f98f9820800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:41.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.421+0000 7f97adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:41.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.421+0000 7f98f9820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:41.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.421+0000 7f98f9820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:41.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.421+0000 7f98f9820800 5 note: GC not initialized 2024-09-14T11:10:41.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.421+0000 7f97acfe1640 20 reqs_thread_entry: start 2024-09-14T11:10:41.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.421+0000 7f98f9820800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:41.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.421+0000 7f98f9820800 20 Filter name: none 2024-09-14T11:10:41.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.421+0000 7f97267fc640 20 reqs_thread_entry: start 2024-09-14T11:10:41.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.421+0000 7f98f9820800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.422+0000 7f98f9820800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:10:41.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.422+0000 7f98f9820800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.422+0000 7f98f9820800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:10:41.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.422+0000 7f98f9820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:41.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.422+0000 7f98f9820800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.423+0000 7f98f9820800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:10:41.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.423+0000 7f98f9820800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.423+0000 7f98f9820800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:10:41.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.423+0000 7f98f9820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:41.423 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.425+0000 7f97adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:41.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.427+0000 7f98f9820800 20 remove_watcher() i=0 2024-09-14T11:10:41.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.427+0000 7f98f9820800 2 removed watcher, disabling cache 2024-09-14T11:10:41.426 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.428+0000 7f98f9820800 20 remove_watcher() i=1 2024-09-14T11:10:41.427 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.429+0000 7f98f9820800 20 remove_watcher() i=2 2024-09-14T11:10:41.428 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.430+0000 7f98f9820800 20 remove_watcher() i=3 2024-09-14T11:10:41.429 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.431+0000 7f98f9820800 20 remove_watcher() i=4 2024-09-14T11:10:41.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.432+0000 7f98f9820800 20 remove_watcher() i=5 2024-09-14T11:10:41.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.433+0000 7f98f9820800 20 remove_watcher() i=6 2024-09-14T11:10:41.432 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.434+0000 7f98f9820800 20 remove_watcher() i=7 2024-09-14T11:10:41.443 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.443 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:10:41.443 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: abort-at-trim-reshard-log-entries id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:10:41.443 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:10:41.446 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:41.446 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:41.479 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:10:41.479 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:10:41.537 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:10:41.571 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:41.572 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:41.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.613+0000 7fac5b616800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.615+0000 7fac5b616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.615+0000 7fac5b616800 20 realm 2024-09-14T11:10:41.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.615+0000 7fac5b616800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.615+0000 7fac5b616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.615+0000 7fac5b616800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:41.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.615+0000 7fac5b616800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.616+0000 7fac5b616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.616+0000 7fac5b616800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.615 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.616+0000 7fac5b616800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:41.615 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.616+0000 7fac5b616800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.615 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.617+0000 7fac5b616800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:41.616 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.617+0000 7fac5b616800 20 searching for the correct realm 2024-09-14T11:10:41.617 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.619+0000 7fac56de7640 0 -- 172.21.15.50:0/3497011247 >> [v2:172.21.15.50:6800/2565843969,v1:172.21.15.50:6801/2565843969] conn(0x557c08403500 msgr2=0x557c08405910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:41.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.622+0000 7fac575e8640 0 -- 172.21.15.50:0/3497011247 >> [v2:172.21.15.118:6826/1082138742,v1:172.21.15.118:6827/1082138742] conn(0x7fac4808e020 msgr2=0x7fac4808ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:41.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.829+0000 7fac5b616800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:10:41.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.829+0000 7fac5b616800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:41.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.829+0000 7fac5b616800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:10:41.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.829+0000 7fac5b616800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:41.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.829+0000 7fac5b616800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:41.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.829+0000 7fac5b616800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:41.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.829+0000 7fac5b616800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.829+0000 7fac5b616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.829+0000 7fac5b616800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.830+0000 7fac5b616800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:41.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.830+0000 7fac5b616800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.830+0000 7fac5b616800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:41.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.830+0000 7fac5b616800 20 zone default found 2024-09-14T11:10:41.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.830+0000 7fac5b616800 4 Realm: () 2024-09-14T11:10:41.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.830+0000 7fac5b616800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:10:41.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.830+0000 7fac5b616800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:10:41.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.830+0000 7fac5b616800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:41.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.830+0000 7fac5b616800 20 zonegroup default 2024-09-14T11:10:41.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.830+0000 7fac5b616800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.830+0000 7fac5b616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.830+0000 7fac5b616800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.831 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.831+0000 7fac5b616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.831 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.831+0000 7fac5b616800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.831 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.831+0000 7fac5b616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:41.831 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.831+0000 7fac5b616800 20 started sync module instance, tier type = 2024-09-14T11:10:41.831 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.831+0000 7fac5b616800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:10:41.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.840+0000 7fac5b616800 20 add_watcher() i=0 2024-09-14T11:10:41.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.840+0000 7fac5b616800 20 add_watcher() i=1 2024-09-14T11:10:41.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.840+0000 7fac5b616800 20 add_watcher() i=2 2024-09-14T11:10:41.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.840+0000 7fac5b616800 20 add_watcher() i=3 2024-09-14T11:10:41.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.840+0000 7fac5b616800 20 add_watcher() i=4 2024-09-14T11:10:41.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.840+0000 7fac5b616800 20 add_watcher() i=5 2024-09-14T11:10:41.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.840+0000 7fac5b616800 20 add_watcher() i=6 2024-09-14T11:10:41.839 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.841+0000 7fac5b616800 20 add_watcher() i=7 2024-09-14T11:10:41.839 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.841+0000 7fac5b616800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:41.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.842+0000 7fab0d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:41.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.842+0000 7fac5b616800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:41.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.842+0000 7fac5b616800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:41.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.843+0000 7fac5b616800 5 note: GC not initialized 2024-09-14T11:10:41.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.843+0000 7faa87fff640 20 reqs_thread_entry: start 2024-09-14T11:10:41.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.843+0000 7fac5b616800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:41.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.843+0000 7fac5b616800 20 Filter name: none 2024-09-14T11:10:41.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.843+0000 7faa85ffb640 20 reqs_thread_entry: start 2024-09-14T11:10:41.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.843+0000 7fac5b616800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:10:41.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.843+0000 7fac5b616800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.843+0000 7fac5b616800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:10:41.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.844+0000 7fac5b616800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:10:41.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.844+0000 7fac5b616800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:10:41.844 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.844+0000 7fac5b616800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 : miss 2024-09-14T11:10:41.844 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.844+0000 7fac5b616800 20 rados->read ofs=0 len=0 2024-09-14T11:10:41.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.844+0000 7fac5b616800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:10:41.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.844+0000 7fac5b616800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 info.flags=0x17 2024-09-14T11:10:41.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.844+0000 7fac5b616800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 to cache LRU end 2024-09-14T11:10:41.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.844+0000 7fac5b616800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:10:41.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.844+0000 7fac5b616800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:10:41.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.844+0000 7fac5b616800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 2024-09-14T11:10:41.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.845+0000 7fac5b616800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 to be held by another RGW process; skipping for now 2024-09-14T11:10:41.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.846+0000 7fab0d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:41.847 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.848+0000 7fac5b616800 20 remove_watcher() i=0 2024-09-14T11:10:41.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.848+0000 7fac5b616800 2 removed watcher, disabling cache 2024-09-14T11:10:41.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.849+0000 7fac5b616800 20 remove_watcher() i=1 2024-09-14T11:10:41.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.850+0000 7fac5b616800 20 remove_watcher() i=2 2024-09-14T11:10:41.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.851+0000 7fac5b616800 20 remove_watcher() i=3 2024-09-14T11:10:41.850 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.852+0000 7fac5b616800 20 remove_watcher() i=4 2024-09-14T11:10:41.851 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.853+0000 7fac5b616800 20 remove_watcher() i=5 2024-09-14T11:10:41.852 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.854+0000 7fac5b616800 20 remove_watcher() i=6 2024-09-14T11:10:41.853 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:10:41.855+0000 7fac5b616800 20 remove_watcher() i=7 2024-09-14T11:10:41.864 INFO:tasks.workunit.client.0.smithi050.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:11:11.891 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:11:11.928 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:11.928 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:11.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:11.976+0000 7fb35fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:11.978 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:11.980+0000 7fb35fc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:11.978 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:11.980+0000 7fb35fc0e800 20 realm 2024-09-14T11:11:11.978 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:11.980+0000 7fb35fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:11.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:11.980+0000 7fb35fc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:11.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:11.980+0000 7fb35fc0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:11.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:11.980+0000 7fb35fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:11.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:11.980+0000 7fb35fc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:11.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:11.980+0000 7fb35fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:11.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:11.981+0000 7fb35fc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:11.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:11.981+0000 7fb35fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:11.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:11.982+0000 7fb35fc0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:11.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:11.982+0000 7fb35fc0e800 20 searching for the correct realm 2024-09-14T11:11:11.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:11.985+0000 7fb35ab6a640 0 -- 172.21.15.50:0/113537236 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fb3540853f0 msgr2=0x7fb354085870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:12.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.191+0000 7fb35bb6c640 0 -- 172.21.15.50:0/113537236 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x563458131f80 msgr2=0x563458134370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:12.194 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.196+0000 7fb35fc0e800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:12.194 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.196+0000 7fb35fc0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:12.194 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.196+0000 7fb35fc0e800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:12.194 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.196+0000 7fb35fc0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:12.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.196+0000 7fb35fc0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:12.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.196+0000 7fb35fc0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:12.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.196+0000 7fb35fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:12.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.196+0000 7fb35fc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:12.195 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.196+0000 7fb35fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:12.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.197+0000 7fb35fc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:12.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.197+0000 7fb35fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:12.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.197+0000 7fb35fc0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:12.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.197+0000 7fb35fc0e800 20 zone default found 2024-09-14T11:11:12.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.197+0000 7fb35fc0e800 4 Realm: () 2024-09-14T11:11:12.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.197+0000 7fb35fc0e800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:12.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.197+0000 7fb35fc0e800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:12.196 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.197+0000 7fb35fc0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:12.197 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.197+0000 7fb35fc0e800 20 zonegroup default 2024-09-14T11:11:12.197 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.197+0000 7fb35fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:12.197 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.197+0000 7fb35fc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:12.197 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.197+0000 7fb35fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:12.197 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.198+0000 7fb35fc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:12.197 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.198+0000 7fb35fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:12.197 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.198+0000 7fb35fc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:12.197 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.198+0000 7fb35fc0e800 20 started sync module instance, tier type = 2024-09-14T11:11:12.197 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.198+0000 7fb35fc0e800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:12.206 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.208+0000 7fb35fc0e800 20 add_watcher() i=0 2024-09-14T11:11:12.206 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.208+0000 7fb35fc0e800 20 add_watcher() i=1 2024-09-14T11:11:12.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.208+0000 7fb35fc0e800 20 add_watcher() i=2 2024-09-14T11:11:12.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.208+0000 7fb35fc0e800 20 add_watcher() i=3 2024-09-14T11:11:12.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.208+0000 7fb35fc0e800 20 add_watcher() i=4 2024-09-14T11:11:12.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.208+0000 7fb35fc0e800 20 add_watcher() i=5 2024-09-14T11:11:12.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.208+0000 7fb35fc0e800 20 add_watcher() i=6 2024-09-14T11:11:12.208 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.209+0000 7fb35fc0e800 20 add_watcher() i=7 2024-09-14T11:11:12.208 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.209+0000 7fb35fc0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:12.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.211+0000 7fb211fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:12.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.211+0000 7fb35fc0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:12.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.211+0000 7fb35fc0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:12.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.211+0000 7fb35fc0e800 5 note: GC not initialized 2024-09-14T11:11:12.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.212+0000 7fb210fe1640 20 reqs_thread_entry: start 2024-09-14T11:11:12.213 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.212+0000 7fb35fc0e800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:12.213 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.212+0000 7fb35fc0e800 20 Filter name: none 2024-09-14T11:11:12.213 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.212+0000 7fb18a7fc640 20 reqs_thread_entry: start 2024-09-14T11:11:12.213 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.212+0000 7fb35fc0e800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:11:12.213 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.212+0000 7fb35fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:12.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.213+0000 7fb35fc0e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:11:12.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.213+0000 7fb35fc0e800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:11:12.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.213+0000 7fb35fc0e800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:11:12.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.213+0000 7fb35fc0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 : miss 2024-09-14T11:11:12.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.213+0000 7fb35fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:12.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.213+0000 7fb35fc0e800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:11:12.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.213+0000 7fb35fc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 info.flags=0x17 2024-09-14T11:11:12.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.213+0000 7fb35fc0e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 to cache LRU end 2024-09-14T11:11:12.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.213+0000 7fb35fc0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:11:12.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.213+0000 7fb35fc0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:12.215 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.213+0000 7fb35fc0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 2024-09-14T11:11:12.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.215+0000 7fb35fc0e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:11:12.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.222+0000 7fb35fc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 info.flags=0x17 2024-09-14T11:11:12.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.222+0000 7fb35fc0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 to cache LRU end 2024-09-14T11:11:12.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.222+0000 7fb35fc0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:12.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.222+0000 7fb35fc0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28, ofs0, ns] 2024-09-14T11:11:12.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.222+0000 7fb23e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497074 cookie 94782815942000 notifier 6590 bl.length()=1023 2024-09-14T11:11:12.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.222+0000 7fb23e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 info.flags=0x17 2024-09-14T11:11:12.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.222+0000 7fb23e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 to cache LRU end 2024-09-14T11:11:12.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.222+0000 7fb23e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:12.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.224+0000 7fb35fc0e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28]): orig_sources= new_sources= 2024-09-14T11:11:12.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.224+0000 7fb35fc0e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28]): potential sources added=[] removed=[] 2024-09-14T11:11:12.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.224+0000 7fb35fc0e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28]): orig_dests= new_dests= 2024-09-14T11:11:12.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.224+0000 7fb35fc0e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28]): potential dests added=[] removed=[] 2024-09-14T11:11:12.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2.0 2024-09-14T11:11:12.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2.0 2024-09-14T11:11:12.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2.1 2024-09-14T11:11:12.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2.1 2024-09-14T11:11:12.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2.2 2024-09-14T11:11:12.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2.2 2024-09-14T11:11:12.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2.3 2024-09-14T11:11:12.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2.3 2024-09-14T11:11:12.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2.4 2024-09-14T11:11:12.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2.4 2024-09-14T11:11:12.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2.5 2024-09-14T11:11:12.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2.5 2024-09-14T11:11:12.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2.6 2024-09-14T11:11:12.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2.6 2024-09-14T11:11:12.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2.7 2024-09-14T11:11:12.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2.7 2024-09-14T11:11:12.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2.8 2024-09-14T11:11:12.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2.8 2024-09-14T11:11:12.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2.9 2024-09-14T11:11:12.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2.9 2024-09-14T11:11:12.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2.10 2024-09-14T11:11:12.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2.10 2024-09-14T11:11:12.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2.11 2024-09-14T11:11:12.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2.11 2024-09-14T11:11:12.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.0 2024-09-14T11:11:12.231 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.230+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.1 2024-09-14T11:11:12.231 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.231+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2 2024-09-14T11:11:12.231 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.231+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.3 2024-09-14T11:11:12.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.232+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.4 2024-09-14T11:11:12.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.232+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.5 2024-09-14T11:11:12.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.233+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.6 2024-09-14T11:11:12.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.234+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.7 2024-09-14T11:11:12.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.234+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.8 2024-09-14T11:11:12.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.234+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.9 2024-09-14T11:11:12.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.235+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.10 2024-09-14T11:11:12.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.239+0000 7fb35fc0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:11:12.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.239+0000 7fb35fc0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 2024-09-14T11:11:12.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.240+0000 7fb35fc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 info.flags=0x17 2024-09-14T11:11:12.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.240+0000 7fb35fc0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 to cache LRU end 2024-09-14T11:11:12.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.240+0000 7fb35fc0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:12.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.240+0000 7fb35fc0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28, ofs0, ns] 2024-09-14T11:11:12.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.240+0000 7fb23e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497075 cookie 94782815942000 notifier 6590 bl.length()=1023 2024-09-14T11:11:12.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.240+0000 7fb23e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 info.flags=0x17 2024-09-14T11:11:12.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.240+0000 7fb23e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 to cache LRU end 2024-09-14T11:11:12.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.240+0000 7fb23e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:12.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.242+0000 7fb35fc0e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28]): orig_sources= new_sources= 2024-09-14T11:11:12.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.242+0000 7fb35fc0e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28]): potential sources added=[] removed=[] 2024-09-14T11:11:12.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.242+0000 7fb35fc0e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28]): orig_dests= new_dests= 2024-09-14T11:11:12.241 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.242+0000 7fb35fc0e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28]): potential dests added=[] removed=[] 2024-09-14T11:11:12.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.245+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.0 2024-09-14T11:11:12.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.245+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.1 2024-09-14T11:11:12.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.245+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.2 2024-09-14T11:11:12.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.246+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.3 2024-09-14T11:11:12.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.246+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.4 2024-09-14T11:11:12.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.246+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.5 2024-09-14T11:11:12.245 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.247+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.6 2024-09-14T11:11:12.245 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.247+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.7 2024-09-14T11:11:12.246 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.247+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.8 2024-09-14T11:11:12.246 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.248+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.9 2024-09-14T11:11:12.246 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.248+0000 7fb35fc0e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28.10 2024-09-14T11:11:12.246 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.248+0000 7fb35fc0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:11:12.246 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.248+0000 7fb35fc0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 2024-09-14T11:11:12.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.250+0000 7fb35fc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 info.flags=0x17 2024-09-14T11:11:12.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.250+0000 7fb35fc0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 to cache LRU end 2024-09-14T11:11:12.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.250+0000 7fb35fc0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:12.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.250+0000 7fb35fc0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28, ofs0, ns] 2024-09-14T11:11:12.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.250+0000 7fb23effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497076 cookie 94782815942000 notifier 6590 bl.length()=991 2024-09-14T11:11:12.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.250+0000 7fb23effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 info.flags=0x17 2024-09-14T11:11:12.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.250+0000 7fb23effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 to cache LRU end 2024-09-14T11:11:12.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.250+0000 7fb23effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:12.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.252+0000 7fb35fc0e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28]): orig_sources= new_sources= 2024-09-14T11:11:12.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.252+0000 7fb35fc0e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28]): potential sources added=[] removed=[] 2024-09-14T11:11:12.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.252+0000 7fb35fc0e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28]): orig_dests= new_dests= 2024-09-14T11:11:12.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.252+0000 7fb35fc0e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28]): potential dests added=[] removed=[] 2024-09-14T11:11:12.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.254+0000 7fb35fc0e800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:11:12.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.256+0000 7fb211fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:12.256 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.258+0000 7fb35fc0e800 20 remove_watcher() i=0 2024-09-14T11:11:12.256 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.258+0000 7fb35fc0e800 2 removed watcher, disabling cache 2024-09-14T11:11:12.257 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.259+0000 7fb35fc0e800 20 remove_watcher() i=1 2024-09-14T11:11:12.258 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.260+0000 7fb35fc0e800 20 remove_watcher() i=2 2024-09-14T11:11:12.259 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.261+0000 7fb35fc0e800 20 remove_watcher() i=3 2024-09-14T11:11:12.260 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.262+0000 7fb35fc0e800 20 remove_watcher() i=4 2024-09-14T11:11:12.261 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.263+0000 7fb35fc0e800 20 remove_watcher() i=5 2024-09-14T11:11:12.263 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.264+0000 7fb35fc0e800 20 remove_watcher() i=6 2024-09-14T11:11:12.264 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.266+0000 7fb35fc0e800 20 remove_watcher() i=7 2024-09-14T11:11:12.277 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:11:12.307 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:12.307 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:12.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.535+0000 7fbfa6561640 0 --2- 172.21.15.50:0/745245800 >> [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] conn(0x55aed432a9c0 0x55aed44a6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:11:12.550 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.551+0000 7fbfaa92a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:12.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.554+0000 7fbfaa92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:12.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.554+0000 7fbfaa92a800 20 realm 2024-09-14T11:11:12.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.554+0000 7fbfaa92a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:12.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.554+0000 7fbfaa92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:12.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.554+0000 7fbfaa92a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:12.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.554+0000 7fbfaa92a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:12.553 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.554+0000 7fbfaa92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:12.553 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.554+0000 7fbfaa92a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:12.553 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.555+0000 7fbfaa92a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:12.553 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.555+0000 7fbfaa92a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:12.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.556+0000 7fbfaa92a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:12.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.556+0000 7fbfaa92a800 20 searching for the correct realm 2024-09-14T11:11:12.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.557+0000 7fbfa6561640 0 -- 172.21.15.50:0/1313973634 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x7fbfa0048310 msgr2=0x7fbfa0062ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:12.560 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.562+0000 7fbfa6d62640 0 -- 172.21.15.50:0/1313973634 >> [v2:172.21.15.118:6826/1082138742,v1:172.21.15.118:6827/1082138742] conn(0x7fbf9803e050 msgr2=0x7fbf98078000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:11:12.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.770+0000 7fbfaa92a800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:12.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.770+0000 7fbfaa92a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:12.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.770+0000 7fbfaa92a800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:12.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.770+0000 7fbfaa92a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:12.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.770+0000 7fbfaa92a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:12.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.770+0000 7fbfaa92a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:12.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.770+0000 7fbfaa92a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:12.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.771+0000 7fbfaa92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:12.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.771+0000 7fbfaa92a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:12.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.771+0000 7fbfaa92a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:12.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.771+0000 7fbfaa92a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:12.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.772+0000 7fbfaa92a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:12.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.772+0000 7fbfaa92a800 20 zone default found 2024-09-14T11:11:12.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.772+0000 7fbfaa92a800 4 Realm: () 2024-09-14T11:11:12.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.772+0000 7fbfaa92a800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:12.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.772+0000 7fbfaa92a800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:12.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.772+0000 7fbfaa92a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:12.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.772+0000 7fbfaa92a800 20 zonegroup default 2024-09-14T11:11:12.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.772+0000 7fbfaa92a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:12.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.772+0000 7fbfaa92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:12.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.772+0000 7fbfaa92a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:12.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.773+0000 7fbfaa92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:12.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.773+0000 7fbfaa92a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:12.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.773+0000 7fbfaa92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:12.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.773+0000 7fbfaa92a800 20 started sync module instance, tier type = 2024-09-14T11:11:12.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.773+0000 7fbfaa92a800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:12.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.783+0000 7fbfaa92a800 20 add_watcher() i=0 2024-09-14T11:11:12.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.783+0000 7fbfaa92a800 20 add_watcher() i=1 2024-09-14T11:11:12.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.783+0000 7fbfaa92a800 20 add_watcher() i=2 2024-09-14T11:11:12.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.783+0000 7fbfaa92a800 20 add_watcher() i=3 2024-09-14T11:11:12.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.783+0000 7fbfaa92a800 20 add_watcher() i=4 2024-09-14T11:11:12.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.783+0000 7fbfaa92a800 20 add_watcher() i=5 2024-09-14T11:11:12.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.783+0000 7fbfaa92a800 20 add_watcher() i=6 2024-09-14T11:11:12.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.784+0000 7fbfaa92a800 20 add_watcher() i=7 2024-09-14T11:11:12.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.784+0000 7fbfaa92a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:12.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.786+0000 7fbe5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:12.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.786+0000 7fbfaa92a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:12.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.786+0000 7fbfaa92a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:12.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.786+0000 7fbfaa92a800 5 note: GC not initialized 2024-09-14T11:11:12.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.786+0000 7fbdd77fe640 20 reqs_thread_entry: start 2024-09-14T11:11:12.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.786+0000 7fbfaa92a800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:12.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.786+0000 7fbfaa92a800 20 Filter name: none 2024-09-14T11:11:12.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.787+0000 7fbdd57fa640 20 reqs_thread_entry: start 2024-09-14T11:11:12.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.787+0000 7fbfaa92a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:12.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.787+0000 7fbfaa92a800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:11:12.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.787+0000 7fbfaa92a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:12.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.787+0000 7fbfaa92a800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:11:12.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.787+0000 7fbfaa92a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:12.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.787+0000 7fbfaa92a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:12.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.788+0000 7fbfaa92a800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:11:12.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.788+0000 7fbfaa92a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:12.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.788+0000 7fbfaa92a800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:11:12.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.788+0000 7fbfaa92a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:12.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.790+0000 7fbe5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:12.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.792+0000 7fbfaa92a800 20 remove_watcher() i=0 2024-09-14T11:11:12.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.792+0000 7fbfaa92a800 2 removed watcher, disabling cache 2024-09-14T11:11:12.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.794+0000 7fbfaa92a800 20 remove_watcher() i=1 2024-09-14T11:11:12.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.795+0000 7fbfaa92a800 20 remove_watcher() i=2 2024-09-14T11:11:12.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.796+0000 7fbfaa92a800 20 remove_watcher() i=3 2024-09-14T11:11:12.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.797+0000 7fbfaa92a800 20 remove_watcher() i=4 2024-09-14T11:11:12.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.798+0000 7fbfaa92a800 20 remove_watcher() i=5 2024-09-14T11:11:12.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.800+0000 7fbfaa92a800 20 remove_watcher() i=6 2024-09-14T11:11:12.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:12.801+0000 7fbfaa92a800 20 remove_watcher() i=7 2024-09-14T11:11:12.810 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:12.811 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:11:12.811 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: abort-at-trim-reshard-log-entries id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:11:12.811 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:12.813 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:12.813 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:12.835 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:12.835 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:13.061 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:13.062 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:13.197 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-14T11:11:13.197 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:13.198 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:13.198 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:13.248 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:13.248 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:13.304 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:13.305 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:13.343 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:13.343 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:13.378 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:13.378 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:13.416 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:13.416 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:13.454 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:13.454 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:13.491 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:13.491 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:13.529 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:13.529 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:13.565 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:13.566 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:13.602 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:13.603 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:13.640 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:13.640 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:13.677 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:13.677 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:13.713 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:13.713 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:13.750 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:13.750 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:13.787 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:13.787 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:13.825 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:13.825 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:13.864 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:13.864 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:13.901 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:13.901 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:13.939 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:13.939 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:13.977 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:13.977 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:14.015 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:14.015 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:14.053 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:11:14.082 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:14.082 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:14.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.123+0000 7ffb51414800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.125+0000 7ffb51414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:14.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.125+0000 7ffb51414800 20 realm 2024-09-14T11:11:14.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.125+0000 7ffb51414800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.125+0000 7ffb51414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:14.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.125+0000 7ffb51414800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:14.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.125+0000 7ffb51414800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.126+0000 7ffb51414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:14.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.126+0000 7ffb51414800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.126+0000 7ffb51414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:14.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.126+0000 7ffb51414800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.127+0000 7ffb51414800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:14.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.127+0000 7ffb51414800 20 searching for the correct realm 2024-09-14T11:11:14.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.130+0000 7ffb47fff640 0 -- 172.21.15.50:0/4176288183 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7ffb480b3e20 msgr2=0x7ffb480c08a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:11:14.333 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.335+0000 7ffb4d2cc640 0 -- 172.21.15.50:0/4176288183 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55c368bb8540 msgr2=0x55c368bba950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:14.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.339+0000 7ffb51414800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:14.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.339+0000 7ffb51414800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:14.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.339+0000 7ffb51414800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:14.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.339+0000 7ffb51414800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:14.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.339+0000 7ffb51414800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:14.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.339+0000 7ffb51414800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:14.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.339+0000 7ffb51414800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.339+0000 7ffb51414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:14.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.339+0000 7ffb51414800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.340+0000 7ffb51414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:14.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.340+0000 7ffb51414800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.340+0000 7ffb51414800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:14.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.340+0000 7ffb51414800 20 zone default found 2024-09-14T11:11:14.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.340+0000 7ffb51414800 4 Realm: () 2024-09-14T11:11:14.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.340+0000 7ffb51414800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:14.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.340+0000 7ffb51414800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:14.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.340+0000 7ffb51414800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:14.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.340+0000 7ffb51414800 20 zonegroup default 2024-09-14T11:11:14.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.340+0000 7ffb51414800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.340+0000 7ffb51414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:14.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.340+0000 7ffb51414800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.341+0000 7ffb51414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:14.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.341+0000 7ffb51414800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.341+0000 7ffb51414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:14.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.341+0000 7ffb51414800 20 started sync module instance, tier type = 2024-09-14T11:11:14.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.341+0000 7ffb51414800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:14.348 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.350+0000 7ffb51414800 20 add_watcher() i=0 2024-09-14T11:11:14.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.350+0000 7ffb51414800 20 add_watcher() i=1 2024-09-14T11:11:14.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.350+0000 7ffb51414800 20 add_watcher() i=2 2024-09-14T11:11:14.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.350+0000 7ffb51414800 20 add_watcher() i=3 2024-09-14T11:11:14.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.350+0000 7ffb51414800 20 add_watcher() i=4 2024-09-14T11:11:14.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.350+0000 7ffb51414800 20 add_watcher() i=5 2024-09-14T11:11:14.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.350+0000 7ffb51414800 20 add_watcher() i=6 2024-09-14T11:11:14.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.351+0000 7ffb51414800 20 add_watcher() i=7 2024-09-14T11:11:14.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.351+0000 7ffb51414800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:14.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.353+0000 7ffa02fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:14.352 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.353+0000 7ffb51414800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:14.352 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.353+0000 7ffb51414800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:14.352 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.353+0000 7ffb51414800 5 note: GC not initialized 2024-09-14T11:11:14.352 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.353+0000 7ffa01fe3640 20 reqs_thread_entry: start 2024-09-14T11:11:14.352 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.353+0000 7ffb51414800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:14.352 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.354+0000 7ffb51414800 20 Filter name: none 2024-09-14T11:11:14.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.354+0000 7ff9737fe640 20 reqs_thread_entry: start 2024-09-14T11:11:14.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.354+0000 7ffb51414800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.354+0000 7ffb51414800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:11:14.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.354+0000 7ffb51414800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.354 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.355+0000 7ffb51414800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:11:14.354 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.355+0000 7ffb51414800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:14.354 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.355+0000 7ffb51414800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.354 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.355+0000 7ffb51414800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:11:14.354 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.355+0000 7ffb51414800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.354 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.355+0000 7ffb51414800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:11:14.354 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.355+0000 7ffb51414800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:14.355 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.357+0000 7ffa02fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:14.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.359+0000 7ffb51414800 20 remove_watcher() i=0 2024-09-14T11:11:14.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.359+0000 7ffb51414800 2 removed watcher, disabling cache 2024-09-14T11:11:14.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.360+0000 7ffb51414800 20 remove_watcher() i=1 2024-09-14T11:11:14.359 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.361+0000 7ffb51414800 20 remove_watcher() i=2 2024-09-14T11:11:14.360 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.362+0000 7ffb51414800 20 remove_watcher() i=3 2024-09-14T11:11:14.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.363+0000 7ffb51414800 20 remove_watcher() i=4 2024-09-14T11:11:14.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.364+0000 7ffb51414800 20 remove_watcher() i=5 2024-09-14T11:11:14.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.365+0000 7ffb51414800 20 remove_watcher() i=6 2024-09-14T11:11:14.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.366+0000 7ffb51414800 20 remove_watcher() i=7 2024-09-14T11:11:14.375 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:14.376 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:11:14.376 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-block-writes id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:11:14.376 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:14.377 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-14T11:11:14.411 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:14.411 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:14.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.453+0000 7f28d97af800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.454+0000 7f28d97af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:14.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.454+0000 7f28d97af800 20 realm 2024-09-14T11:11:14.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.454+0000 7f28d97af800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.454+0000 7f28d97af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:14.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.454+0000 7f28d97af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:14.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.454+0000 7f28d97af800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.455+0000 7f28d97af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:14.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.455+0000 7f28d97af800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.455+0000 7f28d97af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:14.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.455+0000 7f28d97af800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.456+0000 7f28d97af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:14.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.456+0000 7f28d97af800 20 searching for the correct realm 2024-09-14T11:11:14.458 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.460+0000 7f28d7299640 0 -- 172.21.15.50:0/2509637682 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x7f28d001d040 msgr2=0x7f28d002c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:14.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.463+0000 7f28d7299640 0 -- 172.21.15.50:0/2509637682 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f28d002ca20 msgr2=0x7f28d0040960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:11:14.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.467+0000 7f28d97af800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:14.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.467+0000 7f28d97af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:14.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.467+0000 7f28d97af800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:14.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.467+0000 7f28d97af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:14.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.467+0000 7f28d97af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:14.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.467+0000 7f28d97af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:14.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.467+0000 7f28d97af800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.467+0000 7f28d97af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:14.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.467+0000 7f28d97af800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.467+0000 7f28d97af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:14.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.467+0000 7f28d97af800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.468+0000 7f28d97af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:14.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.468+0000 7f28d97af800 20 zone default found 2024-09-14T11:11:14.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.468+0000 7f28d97af800 4 Realm: () 2024-09-14T11:11:14.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.468+0000 7f28d97af800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:14.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.468+0000 7f28d97af800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:14.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.468+0000 7f28d97af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:14.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.468+0000 7f28d97af800 20 zonegroup default 2024-09-14T11:11:14.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.468+0000 7f28d97af800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.468+0000 7f28d97af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:14.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.468+0000 7f28d97af800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.468+0000 7f28d97af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:14.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.468+0000 7f28d97af800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.469+0000 7f28d97af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:14.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.469+0000 7f28d97af800 20 started sync module instance, tier type = 2024-09-14T11:11:14.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.469+0000 7f28d97af800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:14.476 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.477+0000 7f28d97af800 20 add_watcher() i=0 2024-09-14T11:11:14.476 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.477+0000 7f28d97af800 20 add_watcher() i=1 2024-09-14T11:11:14.477 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.477+0000 7f28d97af800 20 add_watcher() i=2 2024-09-14T11:11:14.477 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.477+0000 7f28d97af800 20 add_watcher() i=3 2024-09-14T11:11:14.477 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.477+0000 7f28d97af800 20 add_watcher() i=4 2024-09-14T11:11:14.477 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.477+0000 7f28d97af800 20 add_watcher() i=5 2024-09-14T11:11:14.477 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.477+0000 7f28d97af800 20 add_watcher() i=6 2024-09-14T11:11:14.477 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.478+0000 7f28d97af800 20 add_watcher() i=7 2024-09-14T11:11:14.477 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.478+0000 7f28d97af800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:14.477 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.479+0000 7f278dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:14.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.480+0000 7f28d97af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:14.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.480+0000 7f28d97af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:14.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.480+0000 7f28d97af800 5 note: GC not initialized 2024-09-14T11:11:14.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.480+0000 7f278cfe1640 20 reqs_thread_entry: start 2024-09-14T11:11:14.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.480+0000 7f28d97af800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:14.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.480+0000 7f28d97af800 20 Filter name: none 2024-09-14T11:11:14.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.480+0000 7f27067fc640 20 reqs_thread_entry: start 2024-09-14T11:11:14.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.480+0000 7f28d97af800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:11:14.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.480+0000 7f28d97af800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.481+0000 7f28d97af800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:11:14.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.481+0000 7f28d97af800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:11:14.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.481+0000 7f28d97af800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:11:14.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.481+0000 7f28d97af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 : miss 2024-09-14T11:11:14.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.481+0000 7f28d97af800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.481+0000 7f28d97af800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:11:14.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.481+0000 7f28d97af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 info.flags=0x17 2024-09-14T11:11:14.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.481+0000 7f28d97af800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 to cache LRU end 2024-09-14T11:11:14.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.481+0000 7f28d97af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:11:14.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.481+0000 7f28d97af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:14.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.481+0000 7f28d97af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 2024-09-14T11:11:14.484 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.486+0000 7f28d97af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 info.flags=0x17 2024-09-14T11:11:14.484 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.486+0000 7f28d97af800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 to cache LRU end 2024-09-14T11:11:14.484 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.486+0000 7f28d97af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:14.484 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.486+0000 7f28d97af800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29, ofs0, ns] 2024-09-14T11:11:14.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.486+0000 7f27ba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497001 cookie 94785263503200 notifier 7062 bl.length()=999 2024-09-14T11:11:14.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.486+0000 7f27ba7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 info.flags=0x17 2024-09-14T11:11:14.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.486+0000 7f27ba7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 to cache LRU end 2024-09-14T11:11:14.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.486+0000 7f27ba7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:14.486 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.488+0000 7f28d97af800 20 handle_bi_update(): bucket=:error-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29]): orig_sources= new_sources= 2024-09-14T11:11:14.486 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.488+0000 7f28d97af800 20 handle_bi_update(): bucket=:error-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29]): potential sources added=[] removed=[] 2024-09-14T11:11:14.486 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.488+0000 7f28d97af800 20 handle_bi_update(): bucket=:error-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29]): orig_dests= new_dests= 2024-09-14T11:11:14.486 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.488+0000 7f28d97af800 20 handle_bi_update(): bucket=:error-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29]): potential dests added=[] removed=[] 2024-09-14T11:11:14.491 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.0 2024-09-14T11:11:14.491 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.0 2024-09-14T11:11:14.491 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.1 2024-09-14T11:11:14.491 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.1 2024-09-14T11:11:14.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.2 2024-09-14T11:11:14.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.2 2024-09-14T11:11:14.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.3 2024-09-14T11:11:14.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.3 2024-09-14T11:11:14.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.4 2024-09-14T11:11:14.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.4 2024-09-14T11:11:14.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.5 2024-09-14T11:11:14.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.5 2024-09-14T11:11:14.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.6 2024-09-14T11:11:14.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.6 2024-09-14T11:11:14.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.7 2024-09-14T11:11:14.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.7 2024-09-14T11:11:14.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.8 2024-09-14T11:11:14.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.8 2024-09-14T11:11:14.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.9 2024-09-14T11:11:14.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.9 2024-09-14T11:11:14.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.10 2024-09-14T11:11:14.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.10 2024-09-14T11:11:14.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.11 2024-09-14T11:11:14.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.11 2024-09-14T11:11:14.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.0 2024-09-14T11:11:14.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.493+0000 7f28d97af800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1 2024-09-14T11:11:14.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.494+0000 7f28d97af800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.2 2024-09-14T11:11:14.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.494+0000 7f28d97af800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.3 2024-09-14T11:11:14.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.494+0000 7f28d97af800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.4 2024-09-14T11:11:14.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.495+0000 7f28d97af800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.5 2024-09-14T11:11:14.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.495+0000 7f28d97af800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.6 2024-09-14T11:11:14.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.496+0000 7f28d97af800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.7 2024-09-14T11:11:14.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.497+0000 7f28d97af800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.8 2024-09-14T11:11:14.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.497+0000 7f28d97af800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.9 2024-09-14T11:11:14.496 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.498+0000 7f28d97af800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.10 2024-09-14T11:11:14.499 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.501+0000 7f28d97af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:11:14.499 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.501+0000 7f28d97af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 2024-09-14T11:11:14.500 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.502+0000 7f28d97af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 info.flags=0x17 2024-09-14T11:11:14.500 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.502+0000 7f28d97af800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 to cache LRU end 2024-09-14T11:11:14.500 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.502+0000 7f28d97af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:14.501 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.502+0000 7f28d97af800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29, ofs0, ns] 2024-09-14T11:11:14.501 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.502+0000 7f27ba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497002 cookie 94785263503200 notifier 7062 bl.length()=999 2024-09-14T11:11:14.501 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.502+0000 7f27ba7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 info.flags=0x17 2024-09-14T11:11:14.501 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.502+0000 7f27ba7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 to cache LRU end 2024-09-14T11:11:14.501 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.502+0000 7f27ba7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:14.502 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.504+0000 7f28d97af800 20 handle_bi_update(): bucket=:error-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29]): orig_sources= new_sources= 2024-09-14T11:11:14.502 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.504+0000 7f28d97af800 20 handle_bi_update(): bucket=:error-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29]): potential sources added=[] removed=[] 2024-09-14T11:11:14.502 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.504+0000 7f28d97af800 20 handle_bi_update(): bucket=:error-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29]): orig_dests= new_dests= 2024-09-14T11:11:14.502 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.504+0000 7f28d97af800 20 handle_bi_update(): bucket=:error-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29]): potential dests added=[] removed=[] 2024-09-14T11:11:14.502 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.504+0000 7f28d97af800 -1 Injecting error=-5 at location=block_writes 2024-09-14T11:11:14.502 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.504+0000 7f28d97af800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:11:14.507 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.509+0000 7f28d97af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:11:14.507 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.509+0000 7f28d97af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 2024-09-14T11:11:14.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.510+0000 7f28d97af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 info.flags=0x17 2024-09-14T11:11:14.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.510+0000 7f28d97af800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 to cache LRU end 2024-09-14T11:11:14.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.510+0000 7f28d97af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:14.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.510+0000 7f28d97af800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29, ofs0, ns] 2024-09-14T11:11:14.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.510+0000 7f27baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497003 cookie 94785263503200 notifier 7062 bl.length()=967 2024-09-14T11:11:14.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.510+0000 7f27baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 info.flags=0x17 2024-09-14T11:11:14.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.510+0000 7f27baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 to cache LRU end 2024-09-14T11:11:14.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.510+0000 7f27baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:14.510 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.512+0000 7f28d97af800 20 handle_bi_update(): bucket=:error-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29]): orig_sources= new_sources= 2024-09-14T11:11:14.510 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.512+0000 7f28d97af800 20 handle_bi_update(): bucket=:error-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29]): potential sources added=[] removed=[] 2024-09-14T11:11:14.510 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.512+0000 7f28d97af800 20 handle_bi_update(): bucket=:error-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29]): orig_dests= new_dests= 2024-09-14T11:11:14.510 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.512+0000 7f28d97af800 20 handle_bi_update(): bucket=:error-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29]): potential dests added=[] removed=[] 2024-09-14T11:11:14.512 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.514+0000 7f28d97af800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-14T11:11:14.514 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.516+0000 7f278dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:14.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.518+0000 7f28d97af800 20 remove_watcher() i=0 2024-09-14T11:11:14.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.518+0000 7f28d97af800 2 removed watcher, disabling cache 2024-09-14T11:11:14.517 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.519+0000 7f28d97af800 20 remove_watcher() i=1 2024-09-14T11:11:14.518 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.520+0000 7f28d97af800 20 remove_watcher() i=2 2024-09-14T11:11:14.519 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.521+0000 7f28d97af800 20 remove_watcher() i=3 2024-09-14T11:11:14.520 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.522+0000 7f28d97af800 20 remove_watcher() i=4 2024-09-14T11:11:14.521 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.523+0000 7f28d97af800 20 remove_watcher() i=5 2024-09-14T11:11:14.521 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.524+0000 7f28d97af800 20 remove_watcher() i=6 2024-09-14T11:11:14.522 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.524+0000 7f28d97af800 20 remove_watcher() i=7 2024-09-14T11:11:14.535 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:11:14.565 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:14.565 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:14.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.606+0000 7fb783b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.608+0000 7fb783b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:14.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.608+0000 7fb783b0c800 20 realm 2024-09-14T11:11:14.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.608+0000 7fb783b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.608+0000 7fb783b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:14.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.608+0000 7fb783b0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:14.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.608+0000 7fb783b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.608+0000 7fb783b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:14.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.608+0000 7fb783b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.609+0000 7fb783b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:14.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.609+0000 7fb783b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.610+0000 7fb783b0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:14.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.610+0000 7fb783b0c800 20 searching for the correct realm 2024-09-14T11:11:14.610 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.612+0000 7fb7815fd640 0 -- 172.21.15.50:0/3675526747 >> [v2:172.21.15.50:6800/2565843969,v1:172.21.15.50:6801/2565843969] conn(0x56154b0e70a0 msgr2=0x56154b0e9490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:14.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.615+0000 7fb7815fd640 0 -- 172.21.15.50:0/3675526747 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7fb77c0e0720 msgr2=0x7fb77c0a8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:14.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.822+0000 7fb783b0c800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:14.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.822+0000 7fb783b0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:14.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.822+0000 7fb783b0c800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:14.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.822+0000 7fb783b0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:14.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.822+0000 7fb783b0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:14.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.822+0000 7fb783b0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:14.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.822+0000 7fb783b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.822+0000 7fb783b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:14.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.822+0000 7fb783b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.822+0000 7fb783b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:14.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.822+0000 7fb783b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.823+0000 7fb783b0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:14.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.823+0000 7fb783b0c800 20 zone default found 2024-09-14T11:11:14.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.823+0000 7fb783b0c800 4 Realm: () 2024-09-14T11:11:14.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.823+0000 7fb783b0c800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:14.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.823+0000 7fb783b0c800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:14.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.823+0000 7fb783b0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:14.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.823+0000 7fb783b0c800 20 zonegroup default 2024-09-14T11:11:14.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.823+0000 7fb783b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.823+0000 7fb783b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:14.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.824+0000 7fb783b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.824 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.824+0000 7fb783b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:14.824 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.824+0000 7fb783b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.824 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.824+0000 7fb783b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:14.824 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.824+0000 7fb783b0c800 20 started sync module instance, tier type = 2024-09-14T11:11:14.825 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.824+0000 7fb783b0c800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:14.831 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.833+0000 7fb783b0c800 20 add_watcher() i=0 2024-09-14T11:11:14.831 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.833+0000 7fb783b0c800 20 add_watcher() i=1 2024-09-14T11:11:14.831 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.833+0000 7fb783b0c800 20 add_watcher() i=2 2024-09-14T11:11:14.831 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.833+0000 7fb783b0c800 20 add_watcher() i=3 2024-09-14T11:11:14.831 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.833+0000 7fb783b0c800 20 add_watcher() i=4 2024-09-14T11:11:14.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.833+0000 7fb783b0c800 20 add_watcher() i=5 2024-09-14T11:11:14.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.833+0000 7fb783b0c800 20 add_watcher() i=6 2024-09-14T11:11:14.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.834+0000 7fb783b0c800 20 add_watcher() i=7 2024-09-14T11:11:14.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.834+0000 7fb783b0c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:14.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.835+0000 7fb6377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:14.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.836+0000 7fb783b0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:14.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.836+0000 7fb783b0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:14.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.836+0000 7fb783b0c800 5 note: GC not initialized 2024-09-14T11:11:14.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.836+0000 7fb6367e4640 20 reqs_thread_entry: start 2024-09-14T11:11:14.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.836+0000 7fb783b0c800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:14.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.836+0000 7fb783b0c800 20 Filter name: none 2024-09-14T11:11:14.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.836+0000 7fb5a7fff640 20 reqs_thread_entry: start 2024-09-14T11:11:14.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.836+0000 7fb783b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.837+0000 7fb783b0c800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:11:14.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.837+0000 7fb783b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.837+0000 7fb783b0c800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:11:14.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.837+0000 7fb783b0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:14.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.837+0000 7fb783b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.838+0000 7fb783b0c800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:11:14.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.838+0000 7fb783b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:14.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.838+0000 7fb783b0c800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:11:14.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.838+0000 7fb783b0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:14.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.840+0000 7fb6377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:14.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.842+0000 7fb783b0c800 20 remove_watcher() i=0 2024-09-14T11:11:14.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.842+0000 7fb783b0c800 2 removed watcher, disabling cache 2024-09-14T11:11:14.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.843+0000 7fb783b0c800 20 remove_watcher() i=1 2024-09-14T11:11:14.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.844+0000 7fb783b0c800 20 remove_watcher() i=2 2024-09-14T11:11:14.843 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.845+0000 7fb783b0c800 20 remove_watcher() i=3 2024-09-14T11:11:14.844 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.846+0000 7fb783b0c800 20 remove_watcher() i=4 2024-09-14T11:11:14.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.847+0000 7fb783b0c800 20 remove_watcher() i=5 2024-09-14T11:11:14.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.848+0000 7fb783b0c800 20 remove_watcher() i=6 2024-09-14T11:11:14.847 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:14.849+0000 7fb783b0c800 20 remove_watcher() i=7 2024-09-14T11:11:14.858 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:14.858 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:11:14.858 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-block-writes id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:11:14.858 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:14.860 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:14.860 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:14.894 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:14.894 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:14.952 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:11:14.985 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:14.985 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:15.025 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.026+0000 7f67f820e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.026 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.028+0000 7f67f820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:15.026 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.028+0000 7f67f820e800 20 realm 2024-09-14T11:11:15.026 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.028+0000 7f67f820e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.026 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.028+0000 7f67f820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:15.026 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.028+0000 7f67f820e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:15.027 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.028+0000 7f67f820e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.027 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.028+0000 7f67f820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:15.027 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.028+0000 7f67f820e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.027 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.029+0000 7f67f820e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:15.027 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.029+0000 7f67f820e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.028 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.030+0000 7f67f820e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:15.028 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.030+0000 7f67f820e800 20 searching for the correct realm 2024-09-14T11:11:15.030 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.032+0000 7f67ebfff640 0 -- 172.21.15.50:0/3033695591 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f67ec0a61c0 msgr2=0x7f67ec0aa380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:15.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.237+0000 7f67f416c640 0 -- 172.21.15.50:0/3033695591 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55aa11af9e10 msgr2=0x55aa11afc2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:15.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.241+0000 7f67f820e800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:15.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.241+0000 7f67f820e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:15.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.241+0000 7f67f820e800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:15.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.241+0000 7f67f820e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:15.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.241+0000 7f67f820e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:15.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.241+0000 7f67f820e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:15.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.241+0000 7f67f820e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.241+0000 7f67f820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:15.241 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.241+0000 7f67f820e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.241 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.242+0000 7f67f820e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:15.241 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.242+0000 7f67f820e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.242+0000 7f67f820e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:15.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.242+0000 7f67f820e800 20 zone default found 2024-09-14T11:11:15.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.242+0000 7f67f820e800 4 Realm: () 2024-09-14T11:11:15.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.242+0000 7f67f820e800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:15.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.242+0000 7f67f820e800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:15.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.242+0000 7f67f820e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:15.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.242+0000 7f67f820e800 20 zonegroup default 2024-09-14T11:11:15.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.242+0000 7f67f820e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.243+0000 7f67f820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:15.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.243+0000 7f67f820e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.243+0000 7f67f820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:15.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.243+0000 7f67f820e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.243+0000 7f67f820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:15.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.243+0000 7f67f820e800 20 started sync module instance, tier type = 2024-09-14T11:11:15.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.243+0000 7f67f820e800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:15.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.251+0000 7f67f820e800 20 add_watcher() i=0 2024-09-14T11:11:15.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.251+0000 7f67f820e800 20 add_watcher() i=1 2024-09-14T11:11:15.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.251+0000 7f67f820e800 20 add_watcher() i=2 2024-09-14T11:11:15.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.251+0000 7f67f820e800 20 add_watcher() i=3 2024-09-14T11:11:15.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.251+0000 7f67f820e800 20 add_watcher() i=4 2024-09-14T11:11:15.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.251+0000 7f67f820e800 20 add_watcher() i=5 2024-09-14T11:11:15.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.251+0000 7f67f820e800 20 add_watcher() i=6 2024-09-14T11:11:15.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.252+0000 7f67f820e800 20 add_watcher() i=7 2024-09-14T11:11:15.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.252+0000 7f67f820e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:15.253 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.254+0000 7f66a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:15.253 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.254+0000 7f67f820e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:15.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.254+0000 7f67f820e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:15.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.254+0000 7f67f820e800 5 note: GC not initialized 2024-09-14T11:11:15.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.254+0000 7f66a8fe1640 20 reqs_thread_entry: start 2024-09-14T11:11:15.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.255+0000 7f67f820e800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:15.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.255+0000 7f67f820e800 20 Filter name: none 2024-09-14T11:11:15.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.255+0000 7f66227fc640 20 reqs_thread_entry: start 2024-09-14T11:11:15.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.255+0000 7f67f820e800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:11:15.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.255+0000 7f67f820e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.255+0000 7f67f820e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:11:15.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.255+0000 7f67f820e800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:11:15.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.255+0000 7f67f820e800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:11:15.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.255+0000 7f67f820e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 : miss 2024-09-14T11:11:15.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.255+0000 7f67f820e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.255 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.256+0000 7f67f820e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:11:15.255 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.256+0000 7f67f820e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 info.flags=0x17 2024-09-14T11:11:15.255 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.256+0000 7f67f820e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 to cache LRU end 2024-09-14T11:11:15.255 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.256+0000 7f67f820e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:11:15.255 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.256+0000 7f67f820e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:15.255 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.256+0000 7f67f820e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 2024-09-14T11:11:15.259 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.260+0000 7f67f820e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 info.flags=0x17 2024-09-14T11:11:15.259 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.260+0000 7f67f820e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 to cache LRU end 2024-09-14T11:11:15.259 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.261+0000 7f67f820e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:15.259 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.261+0000 7f67f820e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29, ofs0, ns] 2024-09-14T11:11:15.259 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.261+0000 7f66d27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497004 cookie 94188929591952 notifier 6677 bl.length()=999 2024-09-14T11:11:15.259 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.261+0000 7f66d27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 info.flags=0x17 2024-09-14T11:11:15.259 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.261+0000 7f66d27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 to cache LRU end 2024-09-14T11:11:15.260 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.261+0000 7f66d27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:15.260 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.262+0000 7f67f820e800 20 handle_bi_update(): bucket=:error-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29]): orig_sources= new_sources= 2024-09-14T11:11:15.261 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.262+0000 7f67f820e800 20 handle_bi_update(): bucket=:error-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29]): potential sources added=[] removed=[] 2024-09-14T11:11:15.261 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.262+0000 7f67f820e800 20 handle_bi_update(): bucket=:error-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29]): orig_dests= new_dests= 2024-09-14T11:11:15.261 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.262+0000 7f67f820e800 20 handle_bi_update(): bucket=:error-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29]): potential dests added=[] removed=[] 2024-09-14T11:11:15.265 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.0 2024-09-14T11:11:15.265 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.0 2024-09-14T11:11:15.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.1 2024-09-14T11:11:15.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.1 2024-09-14T11:11:15.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.2 2024-09-14T11:11:15.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.2 2024-09-14T11:11:15.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.3 2024-09-14T11:11:15.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.3 2024-09-14T11:11:15.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.4 2024-09-14T11:11:15.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.4 2024-09-14T11:11:15.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.5 2024-09-14T11:11:15.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.5 2024-09-14T11:11:15.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.6 2024-09-14T11:11:15.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.6 2024-09-14T11:11:15.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.7 2024-09-14T11:11:15.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.7 2024-09-14T11:11:15.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.8 2024-09-14T11:11:15.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.8 2024-09-14T11:11:15.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.9 2024-09-14T11:11:15.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.9 2024-09-14T11:11:15.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.10 2024-09-14T11:11:15.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.10 2024-09-14T11:11:15.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.11 2024-09-14T11:11:15.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1.11 2024-09-14T11:11:15.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.0 2024-09-14T11:11:15.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1 2024-09-14T11:11:15.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.267+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.2 2024-09-14T11:11:15.268 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.268+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.3 2024-09-14T11:11:15.268 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.269+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.4 2024-09-14T11:11:15.268 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.269+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.5 2024-09-14T11:11:15.268 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.270+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.6 2024-09-14T11:11:15.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.271+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.7 2024-09-14T11:11:15.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.271+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.8 2024-09-14T11:11:15.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.271+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.9 2024-09-14T11:11:15.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.272+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.10 2024-09-14T11:11:15.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.275+0000 7f67f820e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:11:15.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.275+0000 7f67f820e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 2024-09-14T11:11:15.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.277+0000 7f67f820e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 info.flags=0x17 2024-09-14T11:11:15.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.277+0000 7f67f820e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 to cache LRU end 2024-09-14T11:11:15.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.277+0000 7f67f820e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:15.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.277+0000 7f67f820e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29, ofs0, ns] 2024-09-14T11:11:15.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.277+0000 7f66d27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497005 cookie 94188929591952 notifier 6677 bl.length()=999 2024-09-14T11:11:15.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.277+0000 7f66d27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 info.flags=0x17 2024-09-14T11:11:15.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.277+0000 7f66d27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 to cache LRU end 2024-09-14T11:11:15.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.277+0000 7f66d27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:15.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.279+0000 7f67f820e800 20 handle_bi_update(): bucket=:error-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29]): orig_sources= new_sources= 2024-09-14T11:11:15.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.279+0000 7f67f820e800 20 handle_bi_update(): bucket=:error-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29]): potential sources added=[] removed=[] 2024-09-14T11:11:15.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.279+0000 7f67f820e800 20 handle_bi_update(): bucket=:error-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29]): orig_dests= new_dests= 2024-09-14T11:11:15.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.279+0000 7f67f820e800 20 handle_bi_update(): bucket=:error-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29]): potential dests added=[] removed=[] 2024-09-14T11:11:15.279 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.281+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.0 2024-09-14T11:11:15.279 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.281+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.1 2024-09-14T11:11:15.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.281+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.2 2024-09-14T11:11:15.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.282+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.3 2024-09-14T11:11:15.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.282+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.4 2024-09-14T11:11:15.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.282+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.5 2024-09-14T11:11:15.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.283+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.6 2024-09-14T11:11:15.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.283+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.7 2024-09-14T11:11:15.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.283+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.8 2024-09-14T11:11:15.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.284+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.9 2024-09-14T11:11:15.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.284+0000 7f67f820e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29.10 2024-09-14T11:11:15.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.284+0000 7f67f820e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:11:15.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.284+0000 7f67f820e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 2024-09-14T11:11:15.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.286+0000 7f67f820e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 info.flags=0x17 2024-09-14T11:11:15.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.286+0000 7f67f820e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 to cache LRU end 2024-09-14T11:11:15.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.286+0000 7f67f820e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:15.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.286+0000 7f67f820e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29, ofs0, ns] 2024-09-14T11:11:15.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.286+0000 7f66d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497006 cookie 94188929591952 notifier 6677 bl.length()=967 2024-09-14T11:11:15.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.286+0000 7f66d2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 info.flags=0x17 2024-09-14T11:11:15.285 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.286+0000 7f66d2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 to cache LRU end 2024-09-14T11:11:15.285 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.286+0000 7f66d2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:15.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.288+0000 7f67f820e800 20 handle_bi_update(): bucket=:error-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29]): orig_sources= new_sources= 2024-09-14T11:11:15.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.288+0000 7f67f820e800 20 handle_bi_update(): bucket=:error-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29]): potential sources added=[] removed=[] 2024-09-14T11:11:15.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.288+0000 7f67f820e800 20 handle_bi_update(): bucket=:error-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29]): orig_dests= new_dests= 2024-09-14T11:11:15.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.288+0000 7f67f820e800 20 handle_bi_update(): bucket=:error-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29]): potential dests added=[] removed=[] 2024-09-14T11:11:15.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.290+0000 7f67f820e800 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:11:15.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.292+0000 7f66a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:15.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.294+0000 7f67f820e800 20 remove_watcher() i=0 2024-09-14T11:11:15.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.294+0000 7f67f820e800 2 removed watcher, disabling cache 2024-09-14T11:11:15.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.295+0000 7f67f820e800 20 remove_watcher() i=1 2024-09-14T11:11:15.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.296+0000 7f67f820e800 20 remove_watcher() i=2 2024-09-14T11:11:15.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.297+0000 7f67f820e800 20 remove_watcher() i=3 2024-09-14T11:11:15.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.298+0000 7f67f820e800 20 remove_watcher() i=4 2024-09-14T11:11:15.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.299+0000 7f67f820e800 20 remove_watcher() i=5 2024-09-14T11:11:15.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.300+0000 7f67f820e800 20 remove_watcher() i=6 2024-09-14T11:11:15.299 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.301+0000 7f67f820e800 20 remove_watcher() i=7 2024-09-14T11:11:15.311 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:11:15.340 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:15.341 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:15.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.381+0000 7f3831337800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.381 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.383+0000 7f3831337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:15.381 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.383+0000 7f3831337800 20 realm 2024-09-14T11:11:15.381 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.383+0000 7f3831337800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.381 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.383+0000 7f3831337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:15.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.383+0000 7f3831337800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:15.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.383+0000 7f3831337800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.383+0000 7f3831337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:15.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.383+0000 7f3831337800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.384+0000 7f3831337800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:15.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.384+0000 7f3831337800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.385+0000 7f3831337800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:15.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.385+0000 7f3831337800 20 searching for the correct realm 2024-09-14T11:11:15.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.388+0000 7f382c820640 0 -- 172.21.15.50:0/1530013216 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f3828064410 msgr2=0x7f3828064890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:15.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.391+0000 7f382d021640 0 -- 172.21.15.50:0/1530013216 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f382806c910 msgr2=0x7f38280783e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:15.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.396+0000 7f3831337800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:15.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.396+0000 7f3831337800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:15.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.396+0000 7f3831337800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:15.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.396+0000 7f3831337800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:15.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.396+0000 7f3831337800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:15.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.396+0000 7f3831337800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:15.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.396+0000 7f3831337800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.396+0000 7f3831337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:15.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.396+0000 7f3831337800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.396+0000 7f3831337800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:15.400 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.396+0000 7f3831337800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.400 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.396+0000 7f3831337800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:15.400 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.396+0000 7f3831337800 20 zone default found 2024-09-14T11:11:15.400 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.396+0000 7f3831337800 4 Realm: () 2024-09-14T11:11:15.400 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.396+0000 7f3831337800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:15.400 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.396+0000 7f3831337800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:15.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.397+0000 7f3831337800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:15.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.397+0000 7f3831337800 20 zonegroup default 2024-09-14T11:11:15.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.397+0000 7f3831337800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.397+0000 7f3831337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:15.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.397+0000 7f3831337800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.397+0000 7f3831337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:15.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.397+0000 7f3831337800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.398+0000 7f3831337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:15.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.398+0000 7f3831337800 20 started sync module instance, tier type = 2024-09-14T11:11:15.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.398+0000 7f3831337800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:15.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.405+0000 7f3831337800 20 add_watcher() i=0 2024-09-14T11:11:15.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.405+0000 7f3831337800 20 add_watcher() i=1 2024-09-14T11:11:15.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.405+0000 7f3831337800 20 add_watcher() i=2 2024-09-14T11:11:15.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.405+0000 7f3831337800 20 add_watcher() i=3 2024-09-14T11:11:15.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.405+0000 7f3831337800 20 add_watcher() i=4 2024-09-14T11:11:15.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.405+0000 7f3831337800 20 add_watcher() i=5 2024-09-14T11:11:15.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.406+0000 7f3831337800 20 add_watcher() i=6 2024-09-14T11:11:15.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.406+0000 7f3831337800 20 add_watcher() i=7 2024-09-14T11:11:15.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.406+0000 7f3831337800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:15.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.408+0000 7f36e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:15.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.409+0000 7f3831337800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:15.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.409+0000 7f3831337800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:15.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.409+0000 7f3831337800 5 note: GC not initialized 2024-09-14T11:11:15.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.409+0000 7f36e27e4640 20 reqs_thread_entry: start 2024-09-14T11:11:15.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.409+0000 7f3831337800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:15.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.409+0000 7f3831337800 20 Filter name: none 2024-09-14T11:11:15.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.409+0000 7f3653fff640 20 reqs_thread_entry: start 2024-09-14T11:11:15.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.409+0000 7f3831337800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.410+0000 7f3831337800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:11:15.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.410+0000 7f3831337800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.410+0000 7f3831337800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:11:15.410 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.410+0000 7f3831337800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:15.410 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.410+0000 7f3831337800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.410 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.411+0000 7f3831337800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:11:15.410 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.411+0000 7f3831337800 20 rados->read ofs=0 len=0 2024-09-14T11:11:15.410 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.411+0000 7f3831337800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:11:15.410 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.411+0000 7f3831337800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:15.411 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.413+0000 7f36e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:15.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.415+0000 7f3831337800 20 remove_watcher() i=0 2024-09-14T11:11:15.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.415+0000 7f3831337800 2 removed watcher, disabling cache 2024-09-14T11:11:15.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.416+0000 7f3831337800 20 remove_watcher() i=1 2024-09-14T11:11:15.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.417+0000 7f3831337800 20 remove_watcher() i=2 2024-09-14T11:11:15.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.418+0000 7f3831337800 20 remove_watcher() i=3 2024-09-14T11:11:15.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.418+0000 7f3831337800 20 remove_watcher() i=4 2024-09-14T11:11:15.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.419+0000 7f3831337800 20 remove_watcher() i=5 2024-09-14T11:11:15.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.420+0000 7f3831337800 20 remove_watcher() i=6 2024-09-14T11:11:15.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:15.421+0000 7f3831337800 20 remove_watcher() i=7 2024-09-14T11:11:15.430 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:15.431 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:11:15.431 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-block-writes id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:11:15.431 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:15.433 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:15.433 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:15.454 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:15.454 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:15.678 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:15.678 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:15.812 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard bucket with abort at block_writes 2024-09-14T11:11:15.812 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:15.813 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:15.813 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:15.862 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:15.863 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:15.920 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:15.920 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:15.959 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:15.959 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:15.996 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:15.996 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:16.036 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:16.036 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:16.073 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:16.073 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:16.111 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:16.111 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:16.147 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:16.147 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:16.184 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:16.185 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:16.223 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:16.223 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:16.261 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:16.261 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:16.298 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:16.299 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:16.335 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:16.335 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:16.375 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:16.375 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:16.579 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:16.580 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:16.616 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:16.616 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:16.654 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:16.654 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:16.690 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:16.690 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:16.727 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:16.727 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:16.764 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:16.764 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:16.801 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:16.801 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:16.838 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:11:16.868 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:16.868 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:16.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:16.908+0000 7fdd14540800 20 rados->read ofs=0 len=0 2024-09-14T11:11:16.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:16.910+0000 7fdd14540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:16.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:16.910+0000 7fdd14540800 20 realm 2024-09-14T11:11:16.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:16.910+0000 7fdd14540800 20 rados->read ofs=0 len=0 2024-09-14T11:11:16.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:16.910+0000 7fdd14540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:16.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:16.910+0000 7fdd14540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:16.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:16.910+0000 7fdd14540800 20 rados->read ofs=0 len=0 2024-09-14T11:11:16.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:16.910+0000 7fdd14540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:16.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:16.910+0000 7fdd14540800 20 rados->read ofs=0 len=0 2024-09-14T11:11:16.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:16.911+0000 7fdd14540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:16.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:16.911+0000 7fdd14540800 20 rados->read ofs=0 len=0 2024-09-14T11:11:16.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:16.912+0000 7fdd14540800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:16.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:16.912+0000 7fdd14540800 20 searching for the correct realm 2024-09-14T11:11:16.913 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:16.915+0000 7fdd0fabf640 0 -- 172.21.15.50:0/2896750174 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fdd08055920 msgr2=0x7fdd08084400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:17.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.121+0000 7fdd10ac1640 0 -- 172.21.15.50:0/2896750174 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55cbe48e45c0 msgr2=0x55cbe48e6a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:17.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.125+0000 7fdd14540800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:17.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.125+0000 7fdd14540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:17.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.125+0000 7fdd14540800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:17.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.125+0000 7fdd14540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:17.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.125+0000 7fdd14540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:17.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.125+0000 7fdd14540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:17.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.125+0000 7fdd14540800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.125+0000 7fdd14540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.125+0000 7fdd14540800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.125+0000 7fdd14540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:17.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.125+0000 7fdd14540800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.125+0000 7fdd14540800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:17.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.125+0000 7fdd14540800 20 zone default found 2024-09-14T11:11:17.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.125+0000 7fdd14540800 4 Realm: () 2024-09-14T11:11:17.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.125+0000 7fdd14540800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:17.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.125+0000 7fdd14540800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:17.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.125+0000 7fdd14540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:17.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.125+0000 7fdd14540800 20 zonegroup default 2024-09-14T11:11:17.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.125+0000 7fdd14540800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.126+0000 7fdd14540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.126+0000 7fdd14540800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.126+0000 7fdd14540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.126+0000 7fdd14540800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.126+0000 7fdd14540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.126+0000 7fdd14540800 20 started sync module instance, tier type = 2024-09-14T11:11:17.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.126+0000 7fdd14540800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:17.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.135+0000 7fdd14540800 20 add_watcher() i=0 2024-09-14T11:11:17.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.135+0000 7fdd14540800 20 add_watcher() i=1 2024-09-14T11:11:17.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.135+0000 7fdd14540800 20 add_watcher() i=2 2024-09-14T11:11:17.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.135+0000 7fdd14540800 20 add_watcher() i=3 2024-09-14T11:11:17.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.135+0000 7fdd14540800 20 add_watcher() i=4 2024-09-14T11:11:17.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.135+0000 7fdd14540800 20 add_watcher() i=5 2024-09-14T11:11:17.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.135+0000 7fdd14540800 20 add_watcher() i=6 2024-09-14T11:11:17.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.136+0000 7fdd14540800 20 add_watcher() i=7 2024-09-14T11:11:17.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.136+0000 7fdd14540800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:17.135 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.137+0000 7fdbc6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:17.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.138+0000 7fdd14540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:17.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.138+0000 7fdd14540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:17.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.138+0000 7fdd14540800 5 note: GC not initialized 2024-09-14T11:11:17.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.138+0000 7fdbc5fdb640 20 reqs_thread_entry: start 2024-09-14T11:11:17.140 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.138+0000 7fdd14540800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:17.140 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.138+0000 7fdd14540800 20 Filter name: none 2024-09-14T11:11:17.141 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.138+0000 7fdb377fe640 20 reqs_thread_entry: start 2024-09-14T11:11:17.141 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.138+0000 7fdd14540800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.139+0000 7fdd14540800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:11:17.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.139+0000 7fdd14540800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.140+0000 7fdd14540800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:11:17.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.140+0000 7fdd14540800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:17.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.140+0000 7fdd14540800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.140+0000 7fdd14540800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:11:17.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.140+0000 7fdd14540800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.141+0000 7fdd14540800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:11:17.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.141+0000 7fdd14540800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:17.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.143+0000 7fdbc6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:17.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.145+0000 7fdd14540800 20 remove_watcher() i=0 2024-09-14T11:11:17.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.145+0000 7fdd14540800 2 removed watcher, disabling cache 2024-09-14T11:11:17.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.146+0000 7fdd14540800 20 remove_watcher() i=1 2024-09-14T11:11:17.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.147+0000 7fdd14540800 20 remove_watcher() i=2 2024-09-14T11:11:17.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.148+0000 7fdd14540800 20 remove_watcher() i=3 2024-09-14T11:11:17.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.149+0000 7fdd14540800 20 remove_watcher() i=4 2024-09-14T11:11:17.148 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.150+0000 7fdd14540800 20 remove_watcher() i=5 2024-09-14T11:11:17.148 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.150+0000 7fdd14540800 20 remove_watcher() i=6 2024-09-14T11:11:17.149 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.151+0000 7fdd14540800 20 remove_watcher() i=7 2024-09-14T11:11:17.160 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.161 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:11:17.161 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: abort-at-block-writes id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:11:17.161 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.162 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-14T11:11:17.197 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:17.197 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:17.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.237+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.239+0000 7fd56e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.239+0000 7fd56e72c800 20 realm 2024-09-14T11:11:17.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.239+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.239+0000 7fd56e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.239+0000 7fd56e72c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:17.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.239+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.239+0000 7fd56e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.239+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.240+0000 7fd56e72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:17.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.240+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.241+0000 7fd56e72c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:17.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.241+0000 7fd56e72c800 20 searching for the correct realm 2024-09-14T11:11:17.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.244+0000 7fd569b3d640 0 -- 172.21.15.50:0/3410983899 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fd56402c920 msgr2=0x7fd564017400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:17.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.450+0000 7fd56ab3f640 0 -- 172.21.15.50:0/3410983899 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55655a5999e0 msgr2=0x55655a59bea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:17.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.454+0000 7fd56e72c800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:17.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.454+0000 7fd56e72c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:17.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.454+0000 7fd56e72c800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:17.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.454+0000 7fd56e72c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:17.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.454+0000 7fd56e72c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:17.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.454+0000 7fd56e72c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:17.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.454+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.454+0000 7fd56e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.454+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.454+0000 7fd56e72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:17.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.454+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.455+0000 7fd56e72c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:17.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.455+0000 7fd56e72c800 20 zone default found 2024-09-14T11:11:17.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.455+0000 7fd56e72c800 4 Realm: () 2024-09-14T11:11:17.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.455+0000 7fd56e72c800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:17.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.455+0000 7fd56e72c800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:17.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.455+0000 7fd56e72c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:17.455 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.455+0000 7fd56e72c800 20 zonegroup default 2024-09-14T11:11:17.455 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.455+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.455 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.455+0000 7fd56e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.455 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.455+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.456 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.455+0000 7fd56e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.456 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.455+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.456 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.456+0000 7fd56e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.456 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.456+0000 7fd56e72c800 20 started sync module instance, tier type = 2024-09-14T11:11:17.456 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.456+0000 7fd56e72c800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:17.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.464+0000 7fd56e72c800 20 add_watcher() i=0 2024-09-14T11:11:17.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.464+0000 7fd56e72c800 20 add_watcher() i=1 2024-09-14T11:11:17.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.464+0000 7fd56e72c800 20 add_watcher() i=2 2024-09-14T11:11:17.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.464+0000 7fd56e72c800 20 add_watcher() i=3 2024-09-14T11:11:17.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.464+0000 7fd56e72c800 20 add_watcher() i=4 2024-09-14T11:11:17.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.464+0000 7fd56e72c800 20 add_watcher() i=5 2024-09-14T11:11:17.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.464+0000 7fd56e72c800 20 add_watcher() i=6 2024-09-14T11:11:17.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.465+0000 7fd56e72c800 20 add_watcher() i=7 2024-09-14T11:11:17.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.465+0000 7fd56e72c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:17.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.467+0000 7fd420fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:17.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.467+0000 7fd56e72c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:17.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.467+0000 7fd56e72c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:17.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.467+0000 7fd56e72c800 5 note: GC not initialized 2024-09-14T11:11:17.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.467+0000 7fd39b7fe640 20 reqs_thread_entry: start 2024-09-14T11:11:17.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.467+0000 7fd56e72c800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:17.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.467+0000 7fd56e72c800 20 Filter name: none 2024-09-14T11:11:17.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.467+0000 7fd3997fa640 20 reqs_thread_entry: start 2024-09-14T11:11:17.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.468+0000 7fd56e72c800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:11:17.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.468+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.468+0000 7fd56e72c800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:11:17.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.468+0000 7fd56e72c800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:11:17.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.468+0000 7fd56e72c800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:11:17.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.468+0000 7fd56e72c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 : miss 2024-09-14T11:11:17.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.468+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.468+0000 7fd56e72c800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:11:17.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.468+0000 7fd56e72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 info.flags=0x17 2024-09-14T11:11:17.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.468+0000 7fd56e72c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 to cache LRU end 2024-09-14T11:11:17.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.468+0000 7fd56e72c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:11:17.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.468+0000 7fd56e72c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:17.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.468+0000 7fd56e72c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 2024-09-14T11:11:17.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.473+0000 7fd56e72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 info.flags=0x17 2024-09-14T11:11:17.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.473+0000 7fd56e72c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 to cache LRU end 2024-09-14T11:11:17.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.473+0000 7fd56e72c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:17.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.473+0000 7fd56e72c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30, ofs0, ns] 2024-09-14T11:11:17.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.474+0000 7fd44d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497079 cookie 93893795942352 notifier 7149 bl.length()=999 2024-09-14T11:11:17.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.474+0000 7fd44d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 info.flags=0x17 2024-09-14T11:11:17.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.474+0000 7fd44d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 to cache LRU end 2024-09-14T11:11:17.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.474+0000 7fd44d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:17.473 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.475+0000 7fd56e72c800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): orig_sources= new_sources= 2024-09-14T11:11:17.474 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.475+0000 7fd56e72c800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): potential sources added=[] removed=[] 2024-09-14T11:11:17.474 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.475+0000 7fd56e72c800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): orig_dests= new_dests= 2024-09-14T11:11:17.474 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.475+0000 7fd56e72c800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): potential dests added=[] removed=[] 2024-09-14T11:11:17.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.0 2024-09-14T11:11:17.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.0 2024-09-14T11:11:17.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.1 2024-09-14T11:11:17.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.1 2024-09-14T11:11:17.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.2 2024-09-14T11:11:17.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.2 2024-09-14T11:11:17.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.3 2024-09-14T11:11:17.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.3 2024-09-14T11:11:17.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.4 2024-09-14T11:11:17.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.4 2024-09-14T11:11:17.479 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.5 2024-09-14T11:11:17.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.5 2024-09-14T11:11:17.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.6 2024-09-14T11:11:17.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.6 2024-09-14T11:11:17.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.7 2024-09-14T11:11:17.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.7 2024-09-14T11:11:17.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.8 2024-09-14T11:11:17.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.8 2024-09-14T11:11:17.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.9 2024-09-14T11:11:17.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.9 2024-09-14T11:11:17.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.10 2024-09-14T11:11:17.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.10 2024-09-14T11:11:17.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.11 2024-09-14T11:11:17.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.11 2024-09-14T11:11:17.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.0 2024-09-14T11:11:17.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1 2024-09-14T11:11:17.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.481+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2 2024-09-14T11:11:17.482 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.482+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.3 2024-09-14T11:11:17.482 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.482+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.4 2024-09-14T11:11:17.482 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.483+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.5 2024-09-14T11:11:17.482 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.483+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.6 2024-09-14T11:11:17.482 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.484+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.7 2024-09-14T11:11:17.482 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.484+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.8 2024-09-14T11:11:17.483 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.485+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.9 2024-09-14T11:11:17.483 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.485+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.10 2024-09-14T11:11:17.486 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.488+0000 7fd56e72c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:11:17.486 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.488+0000 7fd56e72c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 2024-09-14T11:11:17.487 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.489+0000 7fd56e72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 info.flags=0x17 2024-09-14T11:11:17.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.489+0000 7fd56e72c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 to cache LRU end 2024-09-14T11:11:17.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.489+0000 7fd56e72c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:17.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.489+0000 7fd56e72c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30, ofs0, ns] 2024-09-14T11:11:17.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.490+0000 7fd44d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497080 cookie 93893795942352 notifier 7149 bl.length()=999 2024-09-14T11:11:17.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.490+0000 7fd44d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 info.flags=0x17 2024-09-14T11:11:17.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.490+0000 7fd44d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 to cache LRU end 2024-09-14T11:11:17.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.490+0000 7fd44d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:17.489 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.491+0000 7fd56e72c800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): orig_sources= new_sources= 2024-09-14T11:11:17.489 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.491+0000 7fd56e72c800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): potential sources added=[] removed=[] 2024-09-14T11:11:17.489 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.491+0000 7fd56e72c800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): orig_dests= new_dests= 2024-09-14T11:11:17.489 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd56e72c800 time 2024-09-14T11:11:17.491933+0000 2024-09-14T11:11:17.489 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:11:17.489 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.491+0000 7fd56e72c800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): potential dests added=[] removed=[] 2024-09-14T11:11:17.490 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:11:17.490 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd56fd8c76a] 2024-09-14T11:11:17.490 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd56fd8c928] 2024-09-14T11:11:17.490 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5565591a80b1] 2024-09-14T11:11:17.490 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x5565591b718e] 2024-09-14T11:11:17.490 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5565591b7fc4] 2024-09-14T11:11:17.490 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:11:17.491 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd56ea29590] 2024-09-14T11:11:17.491 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:11:17.491 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:11:17.491 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.492+0000 7fd56e72c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd56e72c800 time 2024-09-14T11:11:17.491933+0000 2024-09-14T11:11:17.491 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:11:17.491 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.491 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:11:17.491 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd56fd8c76a] 2024-09-14T11:11:17.491 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd56fd8c928] 2024-09-14T11:11:17.491 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5565591a80b1] 2024-09-14T11:11:17.491 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x5565591b718e] 2024-09-14T11:11:17.492 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5565591b7fc4] 2024-09-14T11:11:17.492 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:11:17.492 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd56ea29590] 2024-09-14T11:11:17.492 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:11:17.492 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:11:17.492 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.492 INFO:tasks.workunit.client.0.smithi050.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:11:17.492 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7fd56e72c800 thread_name:radosgw-admin 2024-09-14T11:11:17.513 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:11:17.513 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd56ea3e6f0] 2024-09-14T11:11:17.513 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd56ea8b99c] 2024-09-14T11:11:17.513 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:11:17.513 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:11:17.513 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd56fd8c7c4] 2024-09-14T11:11:17.514 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd56fd8c928] 2024-09-14T11:11:17.514 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5565591a80b1] 2024-09-14T11:11:17.514 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x5565591b718e] 2024-09-14T11:11:17.514 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5565591b7fc4] 2024-09-14T11:11:17.514 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:11:17.514 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd56ea29590] 2024-09-14T11:11:17.514 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:11:17.514 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:11:17.514 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.493+0000 7fd56e72c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:11:17.514 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7fd56e72c800 thread_name:radosgw-admin 2024-09-14T11:11:17.514 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.514 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:11:17.514 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd56ea3e6f0] 2024-09-14T11:11:17.515 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd56ea8b99c] 2024-09-14T11:11:17.515 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:11:17.515 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:11:17.515 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd56fd8c7c4] 2024-09-14T11:11:17.515 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd56fd8c928] 2024-09-14T11:11:17.515 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5565591a80b1] 2024-09-14T11:11:17.515 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x5565591b718e] 2024-09-14T11:11:17.515 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5565591b7fc4] 2024-09-14T11:11:17.515 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:11:17.515 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd56ea29590] 2024-09-14T11:11:17.515 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:11:17.515 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:11:17.515 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:11:17.515 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.516 INFO:tasks.workunit.client.0.smithi050.stderr:--- begin dump of recent events --- 2024-09-14T11:11:17.516 INFO:tasks.workunit.client.0.smithi050.stderr: -499> 2024-09-14T11:11:17.222+0000 7fd56e72c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:11:17.516 INFO:tasks.workunit.client.0.smithi050.stderr: -498> 2024-09-14T11:11:17.222+0000 7fd56e72c800 10 monclient(hunting): picked mon.noname-c con 0x55655a33adf0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:11:17.516 INFO:tasks.workunit.client.0.smithi050.stderr: -497> 2024-09-14T11:11:17.222+0000 7fd56e72c800 10 monclient(hunting): picked mon.noname-b con 0x55655a35d200 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:11:17.516 INFO:tasks.workunit.client.0.smithi050.stderr: -496> 2024-09-14T11:11:17.222+0000 7fd56e72c800 10 monclient(hunting): picked mon.noname-a con 0x55655a3f8990 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:11:17.516 INFO:tasks.workunit.client.0.smithi050.stderr: -495> 2024-09-14T11:11:17.222+0000 7fd56e72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:17.516 INFO:tasks.workunit.client.0.smithi050.stderr: -494> 2024-09-14T11:11:17.222+0000 7fd56e72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:17.516 INFO:tasks.workunit.client.0.smithi050.stderr: -493> 2024-09-14T11:11:17.222+0000 7fd56e72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:17.516 INFO:tasks.workunit.client.0.smithi050.stderr: -492> 2024-09-14T11:11:17.222+0000 7fd56e72c800 10 monclient(hunting): _renew_subs 2024-09-14T11:11:17.516 INFO:tasks.workunit.client.0.smithi050.stderr: -491> 2024-09-14T11:11:17.222+0000 7fd56e72c800 10 monclient(hunting): authenticate will time out at 2329.859308s 2024-09-14T11:11:17.516 INFO:tasks.workunit.client.0.smithi050.stderr: -490> 2024-09-14T11:11:17.222+0000 7fd56a33e640 10 monclient(hunting): get_auth_request con 0x55655a33adf0 auth_method 0 2024-09-14T11:11:17.516 INFO:tasks.workunit.client.0.smithi050.stderr: -489> 2024-09-14T11:11:17.222+0000 7fd56a33e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:17.517 INFO:tasks.workunit.client.0.smithi050.stderr: -488> 2024-09-14T11:11:17.222+0000 7fd56a33e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:17.517 INFO:tasks.workunit.client.0.smithi050.stderr: -487> 2024-09-14T11:11:17.222+0000 7fd56a33e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:17.517 INFO:tasks.workunit.client.0.smithi050.stderr: -486> 2024-09-14T11:11:17.222+0000 7fd56ab3f640 10 monclient(hunting): get_auth_request con 0x55655a3f8990 auth_method 0 2024-09-14T11:11:17.517 INFO:tasks.workunit.client.0.smithi050.stderr: -485> 2024-09-14T11:11:17.222+0000 7fd56ab3f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:17.517 INFO:tasks.workunit.client.0.smithi050.stderr: -484> 2024-09-14T11:11:17.222+0000 7fd56ab3f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:17.517 INFO:tasks.workunit.client.0.smithi050.stderr: -483> 2024-09-14T11:11:17.222+0000 7fd56ab3f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:17.517 INFO:tasks.workunit.client.0.smithi050.stderr: -482> 2024-09-14T11:11:17.222+0000 7fd56a33e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:17.517 INFO:tasks.workunit.client.0.smithi050.stderr: -481> 2024-09-14T11:11:17.222+0000 7fd56a33e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:17.517 INFO:tasks.workunit.client.0.smithi050.stderr: -480> 2024-09-14T11:11:17.222+0000 7fd56a33e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:17.517 INFO:tasks.workunit.client.0.smithi050.stderr: -479> 2024-09-14T11:11:17.222+0000 7fd56ab3f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:17.517 INFO:tasks.workunit.client.0.smithi050.stderr: -478> 2024-09-14T11:11:17.222+0000 7fd56ab3f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:17.517 INFO:tasks.workunit.client.0.smithi050.stderr: -477> 2024-09-14T11:11:17.222+0000 7fd56ab3f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:17.517 INFO:tasks.workunit.client.0.smithi050.stderr: -476> 2024-09-14T11:11:17.222+0000 7fd56a33e640 10 monclient(hunting): handle_auth_done global_id 6722 payload 824 2024-09-14T11:11:17.518 INFO:tasks.workunit.client.0.smithi050.stderr: -475> 2024-09-14T11:11:17.222+0000 7fd56a33e640 10 monclient: _finish_hunting 0 2024-09-14T11:11:17.518 INFO:tasks.workunit.client.0.smithi050.stderr: -474> 2024-09-14T11:11:17.222+0000 7fd56a33e640 1 monclient: found mon.noname-c 2024-09-14T11:11:17.518 INFO:tasks.workunit.client.0.smithi050.stderr: -473> 2024-09-14T11:11:17.222+0000 7fd56a33e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:11:17.518 INFO:tasks.workunit.client.0.smithi050.stderr: -472> 2024-09-14T11:11:17.223+0000 7fd456e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:17.518 INFO:tasks.workunit.client.0.smithi050.stderr: -471> 2024-09-14T11:11:17.223+0000 7fd456e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:11:17.518 INFO:tasks.workunit.client.0.smithi050.stderr: -470> 2024-09-14T11:11:17.223+0000 7fd456e05640 10 monclient: dump: 2024-09-14T11:11:17.518 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:17.518 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:17.518 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.518 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.518 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:17.518 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:17.518 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:17.518 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:17.518 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:17.518 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.519 INFO:tasks.workunit.client.0.smithi050.stderr: -469> 2024-09-14T11:11:17.223+0000 7fd456e05640 10 monclient: _finish_auth 0 2024-09-14T11:11:17.519 INFO:tasks.workunit.client.0.smithi050.stderr: -468> 2024-09-14T11:11:17.223+0000 7fd456e05640 10 monclient: _check_auth_tickets 2024-09-14T11:11:17.519 INFO:tasks.workunit.client.0.smithi050.stderr: -467> 2024-09-14T11:11:17.223+0000 7fd56e72c800 5 monclient: authenticate success, global_id 6722 2024-09-14T11:11:17.519 INFO:tasks.workunit.client.0.smithi050.stderr: -466> 2024-09-14T11:11:17.223+0000 7fd56e72c800 10 monclient: _renew_subs 2024-09-14T11:11:17.519 INFO:tasks.workunit.client.0.smithi050.stderr: -465> 2024-09-14T11:11:17.223+0000 7fd56e72c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:11:17.519 INFO:tasks.workunit.client.0.smithi050.stderr: -464> 2024-09-14T11:11:17.223+0000 7fd456e05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:11:17.519 INFO:tasks.workunit.client.0.smithi050.stderr: -463> 2024-09-14T11:11:17.223+0000 7fd456e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:17.519 INFO:tasks.workunit.client.0.smithi050.stderr: -462> 2024-09-14T11:11:17.223+0000 7fd456e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:11:17.519 INFO:tasks.workunit.client.0.smithi050.stderr: -461> 2024-09-14T11:11:17.223+0000 7fd456e05640 10 monclient: dump: 2024-09-14T11:11:17.519 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:17.519 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:17.519 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.519 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.519 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:17.520 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:17.520 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:17.520 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:17.520 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:17.520 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.520 INFO:tasks.workunit.client.0.smithi050.stderr: -460> 2024-09-14T11:11:17.223+0000 7fd458608640 4 set_mon_vals no callback set 2024-09-14T11:11:17.520 INFO:tasks.workunit.client.0.smithi050.stderr: -459> 2024-09-14T11:11:17.223+0000 7fd56e72c800 10 monclient: _renew_subs 2024-09-14T11:11:17.520 INFO:tasks.workunit.client.0.smithi050.stderr: -458> 2024-09-14T11:11:17.223+0000 7fd56e72c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:11:17.520 INFO:tasks.workunit.client.0.smithi050.stderr: -457> 2024-09-14T11:11:17.223+0000 7fd56e72c800 1 librados: init done 2024-09-14T11:11:17.520 INFO:tasks.workunit.client.0.smithi050.stderr: -456> 2024-09-14T11:11:17.225+0000 7fd456e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:11:17.520 INFO:tasks.workunit.client.0.smithi050.stderr: -455> 2024-09-14T11:11:17.225+0000 7fd456e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:11:17.520 INFO:tasks.workunit.client.0.smithi050.stderr: -454> 2024-09-14T11:11:17.225+0000 7fd456e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:11:17.520 INFO:tasks.workunit.client.0.smithi050.stderr: -453> 2024-09-14T11:11:17.225+0000 7fd569b3d640 10 monclient: get_auth_request con 0x7fd450077260 auth_method 0 2024-09-14T11:11:17.520 INFO:tasks.workunit.client.0.smithi050.stderr: -452> 2024-09-14T11:11:17.225+0000 7fd56ab3f640 10 monclient: get_auth_request con 0x55655a4d6b20 auth_method 0 2024-09-14T11:11:17.521 INFO:tasks.workunit.client.0.smithi050.stderr: -451> 2024-09-14T11:11:17.226+0000 7fd56a33e640 10 monclient: get_auth_request con 0x55655a4fb740 auth_method 0 2024-09-14T11:11:17.521 INFO:tasks.workunit.client.0.smithi050.stderr: -450> 2024-09-14T11:11:17.227+0000 7fd569b3d640 10 monclient: get_auth_request con 0x55655a4ffaa0 auth_method 0 2024-09-14T11:11:17.521 INFO:tasks.workunit.client.0.smithi050.stderr: -449> 2024-09-14T11:11:17.228+0000 7fd56e72c800 10 monclient: build_initial_monmap 2024-09-14T11:11:17.521 INFO:tasks.workunit.client.0.smithi050.stderr: -448> 2024-09-14T11:11:17.228+0000 7fd56e72c800 1 build_initial for_mkfs: 0 2024-09-14T11:11:17.521 INFO:tasks.workunit.client.0.smithi050.stderr: -447> 2024-09-14T11:11:17.228+0000 7fd56e72c800 10 monclient: monmap: 2024-09-14T11:11:17.521 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:11:17.521 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:11:17.521 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:11:17.521 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:11:17.521 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:11:17.521 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:17.521 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:11:17.521 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:11:17.522 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:11:17.522 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.522 INFO:tasks.workunit.client.0.smithi050.stderr: -446> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding auth protocol: cephx 2024-09-14T11:11:17.522 INFO:tasks.workunit.client.0.smithi050.stderr: -445> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding auth protocol: cephx 2024-09-14T11:11:17.522 INFO:tasks.workunit.client.0.smithi050.stderr: -444> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding auth protocol: cephx 2024-09-14T11:11:17.522 INFO:tasks.workunit.client.0.smithi050.stderr: -443> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding con mode: secure 2024-09-14T11:11:17.522 INFO:tasks.workunit.client.0.smithi050.stderr: -442> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding con mode: crc 2024-09-14T11:11:17.522 INFO:tasks.workunit.client.0.smithi050.stderr: -441> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding con mode: secure 2024-09-14T11:11:17.522 INFO:tasks.workunit.client.0.smithi050.stderr: -440> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding con mode: crc 2024-09-14T11:11:17.522 INFO:tasks.workunit.client.0.smithi050.stderr: -439> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding con mode: secure 2024-09-14T11:11:17.522 INFO:tasks.workunit.client.0.smithi050.stderr: -438> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding con mode: crc 2024-09-14T11:11:17.522 INFO:tasks.workunit.client.0.smithi050.stderr: -437> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding con mode: crc 2024-09-14T11:11:17.522 INFO:tasks.workunit.client.0.smithi050.stderr: -436> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding con mode: secure 2024-09-14T11:11:17.523 INFO:tasks.workunit.client.0.smithi050.stderr: -435> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding con mode: crc 2024-09-14T11:11:17.523 INFO:tasks.workunit.client.0.smithi050.stderr: -434> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding con mode: secure 2024-09-14T11:11:17.523 INFO:tasks.workunit.client.0.smithi050.stderr: -433> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding con mode: crc 2024-09-14T11:11:17.523 INFO:tasks.workunit.client.0.smithi050.stderr: -432> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding con mode: secure 2024-09-14T11:11:17.523 INFO:tasks.workunit.client.0.smithi050.stderr: -431> 2024-09-14T11:11:17.228+0000 7fd56e72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:17.523 INFO:tasks.workunit.client.0.smithi050.stderr: -430> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command objecter_requests cmddesc objecter_requests hook 0x55655a507ef0 EEXIST 2024-09-14T11:11:17.523 INFO:tasks.workunit.client.0.smithi050.stderr: -429> 2024-09-14T11:11:17.228+0000 7fd56e72c800 10 monclient: init 2024-09-14T11:11:17.523 INFO:tasks.workunit.client.0.smithi050.stderr: -428> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding auth protocol: cephx 2024-09-14T11:11:17.523 INFO:tasks.workunit.client.0.smithi050.stderr: -427> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding auth protocol: cephx 2024-09-14T11:11:17.523 INFO:tasks.workunit.client.0.smithi050.stderr: -426> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding auth protocol: cephx 2024-09-14T11:11:17.523 INFO:tasks.workunit.client.0.smithi050.stderr: -425> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding con mode: secure 2024-09-14T11:11:17.523 INFO:tasks.workunit.client.0.smithi050.stderr: -424> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding con mode: crc 2024-09-14T11:11:17.523 INFO:tasks.workunit.client.0.smithi050.stderr: -423> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding con mode: secure 2024-09-14T11:11:17.523 INFO:tasks.workunit.client.0.smithi050.stderr: -422> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding con mode: crc 2024-09-14T11:11:17.523 INFO:tasks.workunit.client.0.smithi050.stderr: -421> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding con mode: secure 2024-09-14T11:11:17.524 INFO:tasks.workunit.client.0.smithi050.stderr: -420> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding con mode: crc 2024-09-14T11:11:17.524 INFO:tasks.workunit.client.0.smithi050.stderr: -419> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding con mode: crc 2024-09-14T11:11:17.524 INFO:tasks.workunit.client.0.smithi050.stderr: -418> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding con mode: secure 2024-09-14T11:11:17.524 INFO:tasks.workunit.client.0.smithi050.stderr: -417> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding con mode: crc 2024-09-14T11:11:17.524 INFO:tasks.workunit.client.0.smithi050.stderr: -416> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding con mode: secure 2024-09-14T11:11:17.524 INFO:tasks.workunit.client.0.smithi050.stderr: -415> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding con mode: crc 2024-09-14T11:11:17.524 INFO:tasks.workunit.client.0.smithi050.stderr: -414> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding con mode: secure 2024-09-14T11:11:17.524 INFO:tasks.workunit.client.0.smithi050.stderr: -413> 2024-09-14T11:11:17.229+0000 7fd56e72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:17.524 INFO:tasks.workunit.client.0.smithi050.stderr: -412> 2024-09-14T11:11:17.229+0000 7fd56e72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:17.524 INFO:tasks.workunit.client.0.smithi050.stderr: -411> 2024-09-14T11:11:17.229+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command rotate-key cmddesc rotate-key hook 0x55655a5030f0 EEXIST 2024-09-14T11:11:17.524 INFO:tasks.workunit.client.0.smithi050.stderr: -410> 2024-09-14T11:11:17.229+0000 7fd56e72c800 10 monclient: _reopen_session rank -1 2024-09-14T11:11:17.524 INFO:tasks.workunit.client.0.smithi050.stderr: -409> 2024-09-14T11:11:17.229+0000 7fd56e72c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:11:17.524 INFO:tasks.workunit.client.0.smithi050.stderr: -408> 2024-09-14T11:11:17.229+0000 7fd56e72c800 10 monclient(hunting): picked mon.noname-c con 0x55655a52c210 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:11:17.524 INFO:tasks.workunit.client.0.smithi050.stderr: -407> 2024-09-14T11:11:17.229+0000 7fd56e72c800 10 monclient(hunting): picked mon.noname-a con 0x55655a52c5f0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:11:17.525 INFO:tasks.workunit.client.0.smithi050.stderr: -406> 2024-09-14T11:11:17.229+0000 7fd56e72c800 10 monclient(hunting): picked mon.noname-b con 0x55655a52af20 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:11:17.525 INFO:tasks.workunit.client.0.smithi050.stderr: -405> 2024-09-14T11:11:17.229+0000 7fd56e72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:17.525 INFO:tasks.workunit.client.0.smithi050.stderr: -404> 2024-09-14T11:11:17.229+0000 7fd56e72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:17.525 INFO:tasks.workunit.client.0.smithi050.stderr: -403> 2024-09-14T11:11:17.229+0000 7fd56e72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:17.525 INFO:tasks.workunit.client.0.smithi050.stderr: -402> 2024-09-14T11:11:17.229+0000 7fd56e72c800 10 monclient(hunting): _renew_subs 2024-09-14T11:11:17.525 INFO:tasks.workunit.client.0.smithi050.stderr: -401> 2024-09-14T11:11:17.229+0000 7fd56e72c800 10 monclient(hunting): authenticate will time out at 2329.866503s 2024-09-14T11:11:17.525 INFO:tasks.workunit.client.0.smithi050.stderr: -400> 2024-09-14T11:11:17.229+0000 7fd56a33e640 10 monclient(hunting): get_auth_request con 0x55655a52c210 auth_method 0 2024-09-14T11:11:17.525 INFO:tasks.workunit.client.0.smithi050.stderr: -399> 2024-09-14T11:11:17.229+0000 7fd56a33e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:17.525 INFO:tasks.workunit.client.0.smithi050.stderr: -398> 2024-09-14T11:11:17.229+0000 7fd56a33e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:17.525 INFO:tasks.workunit.client.0.smithi050.stderr: -397> 2024-09-14T11:11:17.229+0000 7fd56a33e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:17.525 INFO:tasks.workunit.client.0.smithi050.stderr: -396> 2024-09-14T11:11:17.229+0000 7fd569b3d640 10 monclient(hunting): get_auth_request con 0x55655a52c5f0 auth_method 0 2024-09-14T11:11:17.525 INFO:tasks.workunit.client.0.smithi050.stderr: -395> 2024-09-14T11:11:17.229+0000 7fd569b3d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:17.525 INFO:tasks.workunit.client.0.smithi050.stderr: -394> 2024-09-14T11:11:17.229+0000 7fd569b3d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:17.526 INFO:tasks.workunit.client.0.smithi050.stderr: -393> 2024-09-14T11:11:17.229+0000 7fd569b3d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:17.526 INFO:tasks.workunit.client.0.smithi050.stderr: -392> 2024-09-14T11:11:17.229+0000 7fd56ab3f640 10 monclient(hunting): get_auth_request con 0x55655a52af20 auth_method 0 2024-09-14T11:11:17.526 INFO:tasks.workunit.client.0.smithi050.stderr: -391> 2024-09-14T11:11:17.229+0000 7fd56ab3f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:17.526 INFO:tasks.workunit.client.0.smithi050.stderr: -390> 2024-09-14T11:11:17.229+0000 7fd56ab3f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:17.526 INFO:tasks.workunit.client.0.smithi050.stderr: -389> 2024-09-14T11:11:17.229+0000 7fd56ab3f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:17.526 INFO:tasks.workunit.client.0.smithi050.stderr: -388> 2024-09-14T11:11:17.229+0000 7fd56a33e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:17.526 INFO:tasks.workunit.client.0.smithi050.stderr: -387> 2024-09-14T11:11:17.229+0000 7fd56a33e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:17.526 INFO:tasks.workunit.client.0.smithi050.stderr: -386> 2024-09-14T11:11:17.229+0000 7fd56a33e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:17.526 INFO:tasks.workunit.client.0.smithi050.stderr: -385> 2024-09-14T11:11:17.229+0000 7fd569b3d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:17.526 INFO:tasks.workunit.client.0.smithi050.stderr: -384> 2024-09-14T11:11:17.229+0000 7fd569b3d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:17.526 INFO:tasks.workunit.client.0.smithi050.stderr: -383> 2024-09-14T11:11:17.229+0000 7fd569b3d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:17.526 INFO:tasks.workunit.client.0.smithi050.stderr: -382> 2024-09-14T11:11:17.229+0000 7fd56ab3f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:17.526 INFO:tasks.workunit.client.0.smithi050.stderr: -381> 2024-09-14T11:11:17.229+0000 7fd56ab3f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:17.527 INFO:tasks.workunit.client.0.smithi050.stderr: -380> 2024-09-14T11:11:17.229+0000 7fd56ab3f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:17.527 INFO:tasks.workunit.client.0.smithi050.stderr: -379> 2024-09-14T11:11:17.229+0000 7fd56a33e640 10 monclient(hunting): handle_auth_done global_id 6725 payload 824 2024-09-14T11:11:17.527 INFO:tasks.workunit.client.0.smithi050.stderr: -378> 2024-09-14T11:11:17.229+0000 7fd56a33e640 10 monclient: _finish_hunting 0 2024-09-14T11:11:17.527 INFO:tasks.workunit.client.0.smithi050.stderr: -377> 2024-09-14T11:11:17.229+0000 7fd56a33e640 1 monclient: found mon.noname-c 2024-09-14T11:11:17.527 INFO:tasks.workunit.client.0.smithi050.stderr: -376> 2024-09-14T11:11:17.229+0000 7fd56a33e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:11:17.527 INFO:tasks.workunit.client.0.smithi050.stderr: -375> 2024-09-14T11:11:17.230+0000 7fd44ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:17.527 INFO:tasks.workunit.client.0.smithi050.stderr: -374> 2024-09-14T11:11:17.230+0000 7fd44ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:11:17.527 INFO:tasks.workunit.client.0.smithi050.stderr: -373> 2024-09-14T11:11:17.230+0000 7fd44ffff640 10 monclient: dump: 2024-09-14T11:11:17.527 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:17.527 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:17.527 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.528 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.528 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:17.528 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:17.528 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:17.528 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:17.528 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:17.529 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.529 INFO:tasks.workunit.client.0.smithi050.stderr: -372> 2024-09-14T11:11:17.230+0000 7fd44ffff640 10 monclient: _finish_auth 0 2024-09-14T11:11:17.529 INFO:tasks.workunit.client.0.smithi050.stderr: -371> 2024-09-14T11:11:17.230+0000 7fd44ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:11:17.529 INFO:tasks.workunit.client.0.smithi050.stderr: -370> 2024-09-14T11:11:17.230+0000 7fd56e72c800 5 monclient: authenticate success, global_id 6725 2024-09-14T11:11:17.529 INFO:tasks.workunit.client.0.smithi050.stderr: -369> 2024-09-14T11:11:17.230+0000 7fd56e72c800 10 monclient: _renew_subs 2024-09-14T11:11:17.529 INFO:tasks.workunit.client.0.smithi050.stderr: -368> 2024-09-14T11:11:17.230+0000 7fd56e72c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:11:17.529 INFO:tasks.workunit.client.0.smithi050.stderr: -367> 2024-09-14T11:11:17.230+0000 7fd44ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:11:17.529 INFO:tasks.workunit.client.0.smithi050.stderr: -366> 2024-09-14T11:11:17.230+0000 7fd44ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:17.529 INFO:tasks.workunit.client.0.smithi050.stderr: -365> 2024-09-14T11:11:17.230+0000 7fd44ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:11:17.529 INFO:tasks.workunit.client.0.smithi050.stderr: -364> 2024-09-14T11:11:17.230+0000 7fd44ffff640 10 monclient: dump: 2024-09-14T11:11:17.529 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:17.530 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:17.530 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.530 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.530 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:17.530 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:17.530 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:17.530 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:17.530 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:17.530 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.530 INFO:tasks.workunit.client.0.smithi050.stderr: -363> 2024-09-14T11:11:17.230+0000 7fd56e72c800 10 monclient: _renew_subs 2024-09-14T11:11:17.530 INFO:tasks.workunit.client.0.smithi050.stderr: -362> 2024-09-14T11:11:17.230+0000 7fd56e72c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:11:17.531 INFO:tasks.workunit.client.0.smithi050.stderr: -361> 2024-09-14T11:11:17.230+0000 7fd56b340640 4 set_mon_vals no callback set 2024-09-14T11:11:17.531 INFO:tasks.workunit.client.0.smithi050.stderr: -360> 2024-09-14T11:11:17.232+0000 7fd44ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:11:17.531 INFO:tasks.workunit.client.0.smithi050.stderr: -359> 2024-09-14T11:11:17.232+0000 7fd44ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:11:17.531 INFO:tasks.workunit.client.0.smithi050.stderr: -358> 2024-09-14T11:11:17.232+0000 7fd44ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:11:17.531 INFO:tasks.workunit.client.0.smithi050.stderr: -357> 2024-09-14T11:11:17.232+0000 7fd569b3d640 10 monclient: get_auth_request con 0x7fd444077140 auth_method 0 2024-09-14T11:11:17.531 INFO:tasks.workunit.client.0.smithi050.stderr: -356> 2024-09-14T11:11:17.232+0000 7fd56e72c800 10 monclient: get_monmap_and_config 2024-09-14T11:11:17.531 INFO:tasks.workunit.client.0.smithi050.stderr: -355> 2024-09-14T11:11:17.232+0000 7fd56e72c800 10 monclient: build_initial_monmap 2024-09-14T11:11:17.531 INFO:tasks.workunit.client.0.smithi050.stderr: -354> 2024-09-14T11:11:17.232+0000 7fd56e72c800 1 build_initial for_mkfs: 0 2024-09-14T11:11:17.531 INFO:tasks.workunit.client.0.smithi050.stderr: -353> 2024-09-14T11:11:17.232+0000 7fd56e72c800 10 monclient: monmap: 2024-09-14T11:11:17.531 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:11:17.531 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:11:17.531 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:11:17.531 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:11:17.532 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:11:17.532 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:17.532 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:11:17.532 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:11:17.532 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:11:17.532 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.532 INFO:tasks.workunit.client.0.smithi050.stderr: -352> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding auth protocol: cephx 2024-09-14T11:11:17.532 INFO:tasks.workunit.client.0.smithi050.stderr: -351> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding auth protocol: cephx 2024-09-14T11:11:17.532 INFO:tasks.workunit.client.0.smithi050.stderr: -350> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding auth protocol: cephx 2024-09-14T11:11:17.532 INFO:tasks.workunit.client.0.smithi050.stderr: -349> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding con mode: secure 2024-09-14T11:11:17.532 INFO:tasks.workunit.client.0.smithi050.stderr: -348> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding con mode: crc 2024-09-14T11:11:17.532 INFO:tasks.workunit.client.0.smithi050.stderr: -347> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding con mode: secure 2024-09-14T11:11:17.532 INFO:tasks.workunit.client.0.smithi050.stderr: -346> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding con mode: crc 2024-09-14T11:11:17.533 INFO:tasks.workunit.client.0.smithi050.stderr: -345> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding con mode: secure 2024-09-14T11:11:17.533 INFO:tasks.workunit.client.0.smithi050.stderr: -344> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding con mode: crc 2024-09-14T11:11:17.533 INFO:tasks.workunit.client.0.smithi050.stderr: -343> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding con mode: crc 2024-09-14T11:11:17.533 INFO:tasks.workunit.client.0.smithi050.stderr: -342> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding con mode: secure 2024-09-14T11:11:17.533 INFO:tasks.workunit.client.0.smithi050.stderr: -341> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding con mode: crc 2024-09-14T11:11:17.533 INFO:tasks.workunit.client.0.smithi050.stderr: -340> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding con mode: secure 2024-09-14T11:11:17.533 INFO:tasks.workunit.client.0.smithi050.stderr: -339> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding con mode: crc 2024-09-14T11:11:17.533 INFO:tasks.workunit.client.0.smithi050.stderr: -338> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding con mode: secure 2024-09-14T11:11:17.533 INFO:tasks.workunit.client.0.smithi050.stderr: -337> 2024-09-14T11:11:17.232+0000 7fd56e72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:17.533 INFO:tasks.workunit.client.0.smithi050.stderr: -336> 2024-09-14T11:11:17.232+0000 7fd56e72c800 10 monclient: init 2024-09-14T11:11:17.533 INFO:tasks.workunit.client.0.smithi050.stderr: -335> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding auth protocol: cephx 2024-09-14T11:11:17.533 INFO:tasks.workunit.client.0.smithi050.stderr: -334> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding auth protocol: cephx 2024-09-14T11:11:17.534 INFO:tasks.workunit.client.0.smithi050.stderr: -333> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding auth protocol: cephx 2024-09-14T11:11:17.534 INFO:tasks.workunit.client.0.smithi050.stderr: -332> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding con mode: secure 2024-09-14T11:11:17.534 INFO:tasks.workunit.client.0.smithi050.stderr: -331> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding con mode: crc 2024-09-14T11:11:17.534 INFO:tasks.workunit.client.0.smithi050.stderr: -330> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding con mode: secure 2024-09-14T11:11:17.534 INFO:tasks.workunit.client.0.smithi050.stderr: -329> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding con mode: crc 2024-09-14T11:11:17.534 INFO:tasks.workunit.client.0.smithi050.stderr: -328> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding con mode: secure 2024-09-14T11:11:17.534 INFO:tasks.workunit.client.0.smithi050.stderr: -327> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding con mode: crc 2024-09-14T11:11:17.534 INFO:tasks.workunit.client.0.smithi050.stderr: -326> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding con mode: crc 2024-09-14T11:11:17.534 INFO:tasks.workunit.client.0.smithi050.stderr: -325> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding con mode: secure 2024-09-14T11:11:17.534 INFO:tasks.workunit.client.0.smithi050.stderr: -324> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding con mode: crc 2024-09-14T11:11:17.535 INFO:tasks.workunit.client.0.smithi050.stderr: -323> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding con mode: secure 2024-09-14T11:11:17.535 INFO:tasks.workunit.client.0.smithi050.stderr: -322> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding con mode: crc 2024-09-14T11:11:17.535 INFO:tasks.workunit.client.0.smithi050.stderr: -321> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding con mode: secure 2024-09-14T11:11:17.535 INFO:tasks.workunit.client.0.smithi050.stderr: -320> 2024-09-14T11:11:17.233+0000 7fd56e72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:17.535 INFO:tasks.workunit.client.0.smithi050.stderr: -319> 2024-09-14T11:11:17.233+0000 7fd56e72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:17.535 INFO:tasks.workunit.client.0.smithi050.stderr: -318> 2024-09-14T11:11:17.233+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command rotate-key cmddesc rotate-key hook 0x7ffc830def88 EEXIST 2024-09-14T11:11:17.535 INFO:tasks.workunit.client.0.smithi050.stderr: -317> 2024-09-14T11:11:17.233+0000 7fd56e72c800 10 monclient: _reopen_session rank -1 2024-09-14T11:11:17.535 INFO:tasks.workunit.client.0.smithi050.stderr: -316> 2024-09-14T11:11:17.233+0000 7fd56e72c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:11:17.535 INFO:tasks.workunit.client.0.smithi050.stderr: -315> 2024-09-14T11:11:17.233+0000 7fd56e72c800 10 monclient(hunting): picked mon.noname-a con 0x55655a5802a0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:11:17.535 INFO:tasks.workunit.client.0.smithi050.stderr: -314> 2024-09-14T11:11:17.233+0000 7fd56e72c800 10 monclient(hunting): picked mon.noname-c con 0x55655a5511f0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:11:17.535 INFO:tasks.workunit.client.0.smithi050.stderr: -313> 2024-09-14T11:11:17.233+0000 7fd56e72c800 10 monclient(hunting): picked mon.noname-b con 0x55655a57bb40 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:11:17.536 INFO:tasks.workunit.client.0.smithi050.stderr: -312> 2024-09-14T11:11:17.233+0000 7fd56e72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:17.536 INFO:tasks.workunit.client.0.smithi050.stderr: -311> 2024-09-14T11:11:17.233+0000 7fd56e72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:17.536 INFO:tasks.workunit.client.0.smithi050.stderr: -310> 2024-09-14T11:11:17.233+0000 7fd56e72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:17.536 INFO:tasks.workunit.client.0.smithi050.stderr: -309> 2024-09-14T11:11:17.233+0000 7fd56e72c800 10 monclient(hunting): _renew_subs 2024-09-14T11:11:17.536 INFO:tasks.workunit.client.0.smithi050.stderr: -308> 2024-09-14T11:11:17.233+0000 7fd56e72c800 10 monclient(hunting): authenticate will time out at 2329.870432s 2024-09-14T11:11:17.536 INFO:tasks.workunit.client.0.smithi050.stderr: -307> 2024-09-14T11:11:17.233+0000 7fd56a33e640 10 monclient(hunting): get_auth_request con 0x55655a5802a0 auth_method 0 2024-09-14T11:11:17.536 INFO:tasks.workunit.client.0.smithi050.stderr: -306> 2024-09-14T11:11:17.233+0000 7fd56a33e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:17.536 INFO:tasks.workunit.client.0.smithi050.stderr: -305> 2024-09-14T11:11:17.233+0000 7fd56a33e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:17.536 INFO:tasks.workunit.client.0.smithi050.stderr: -304> 2024-09-14T11:11:17.233+0000 7fd56a33e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:17.536 INFO:tasks.workunit.client.0.smithi050.stderr: -303> 2024-09-14T11:11:17.233+0000 7fd569b3d640 10 monclient(hunting): get_auth_request con 0x55655a5511f0 auth_method 0 2024-09-14T11:11:17.536 INFO:tasks.workunit.client.0.smithi050.stderr: -302> 2024-09-14T11:11:17.233+0000 7fd569b3d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:17.536 INFO:tasks.workunit.client.0.smithi050.stderr: -301> 2024-09-14T11:11:17.233+0000 7fd569b3d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:17.537 INFO:tasks.workunit.client.0.smithi050.stderr: -300> 2024-09-14T11:11:17.233+0000 7fd569b3d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:17.537 INFO:tasks.workunit.client.0.smithi050.stderr: -299> 2024-09-14T11:11:17.233+0000 7fd56ab3f640 10 monclient(hunting): get_auth_request con 0x55655a57bb40 auth_method 0 2024-09-14T11:11:17.537 INFO:tasks.workunit.client.0.smithi050.stderr: -298> 2024-09-14T11:11:17.233+0000 7fd56ab3f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:17.537 INFO:tasks.workunit.client.0.smithi050.stderr: -297> 2024-09-14T11:11:17.233+0000 7fd56ab3f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:17.537 INFO:tasks.workunit.client.0.smithi050.stderr: -296> 2024-09-14T11:11:17.233+0000 7fd56ab3f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:17.537 INFO:tasks.workunit.client.0.smithi050.stderr: -295> 2024-09-14T11:11:17.233+0000 7fd56a33e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:17.537 INFO:tasks.workunit.client.0.smithi050.stderr: -294> 2024-09-14T11:11:17.233+0000 7fd56a33e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:17.537 INFO:tasks.workunit.client.0.smithi050.stderr: -293> 2024-09-14T11:11:17.233+0000 7fd56a33e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:17.537 INFO:tasks.workunit.client.0.smithi050.stderr: -292> 2024-09-14T11:11:17.233+0000 7fd569b3d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:17.537 INFO:tasks.workunit.client.0.smithi050.stderr: -291> 2024-09-14T11:11:17.233+0000 7fd569b3d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:17.537 INFO:tasks.workunit.client.0.smithi050.stderr: -290> 2024-09-14T11:11:17.233+0000 7fd569b3d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:17.537 INFO:tasks.workunit.client.0.smithi050.stderr: -289> 2024-09-14T11:11:17.233+0000 7fd56ab3f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:17.537 INFO:tasks.workunit.client.0.smithi050.stderr: -288> 2024-09-14T11:11:17.233+0000 7fd56ab3f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:17.537 INFO:tasks.workunit.client.0.smithi050.stderr: -287> 2024-09-14T11:11:17.233+0000 7fd56ab3f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:17.538 INFO:tasks.workunit.client.0.smithi050.stderr: -286> 2024-09-14T11:11:17.233+0000 7fd56a33e640 10 monclient(hunting): handle_auth_done global_id 7146 payload 274 2024-09-14T11:11:17.538 INFO:tasks.workunit.client.0.smithi050.stderr: -285> 2024-09-14T11:11:17.233+0000 7fd56a33e640 10 monclient: _finish_hunting 0 2024-09-14T11:11:17.538 INFO:tasks.workunit.client.0.smithi050.stderr: -284> 2024-09-14T11:11:17.233+0000 7fd56a33e640 1 monclient: found mon.noname-a 2024-09-14T11:11:17.538 INFO:tasks.workunit.client.0.smithi050.stderr: -283> 2024-09-14T11:11:17.233+0000 7fd56a33e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:11:17.538 INFO:tasks.workunit.client.0.smithi050.stderr: -282> 2024-09-14T11:11:17.234+0000 7fd44dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:17.538 INFO:tasks.workunit.client.0.smithi050.stderr: -281> 2024-09-14T11:11:17.234+0000 7fd44dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:11:17.538 INFO:tasks.workunit.client.0.smithi050.stderr: -280> 2024-09-14T11:11:17.234+0000 7fd44dffb640 10 monclient: dump: 2024-09-14T11:11:17.538 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:17.538 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:17.538 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.538 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.539 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:17.539 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:17.539 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:17.539 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:17.539 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:17.539 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.539 INFO:tasks.workunit.client.0.smithi050.stderr: -279> 2024-09-14T11:11:17.234+0000 7fd44dffb640 10 monclient: _finish_auth 0 2024-09-14T11:11:17.539 INFO:tasks.workunit.client.0.smithi050.stderr: -278> 2024-09-14T11:11:17.234+0000 7fd44dffb640 10 monclient: _check_auth_tickets 2024-09-14T11:11:17.539 INFO:tasks.workunit.client.0.smithi050.stderr: -277> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 monclient: authenticate success, global_id 7146 2024-09-14T11:11:17.539 INFO:tasks.workunit.client.0.smithi050.stderr: -276> 2024-09-14T11:11:17.234+0000 7fd44dffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:11:17.539 INFO:tasks.workunit.client.0.smithi050.stderr: -275> 2024-09-14T11:11:17.234+0000 7fd56e72c800 10 monclient: get_monmap_and_config success 2024-09-14T11:11:17.539 INFO:tasks.workunit.client.0.smithi050.stderr: -274> 2024-09-14T11:11:17.234+0000 7fd56e72c800 4 set_mon_vals no callback set 2024-09-14T11:11:17.539 INFO:tasks.workunit.client.0.smithi050.stderr: -273> 2024-09-14T11:11:17.234+0000 7fd44dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:17.539 INFO:tasks.workunit.client.0.smithi050.stderr: -272> 2024-09-14T11:11:17.234+0000 7fd44dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:11:17.539 INFO:tasks.workunit.client.0.smithi050.stderr: -271> 2024-09-14T11:11:17.234+0000 7fd44dffb640 10 monclient: dump: 2024-09-14T11:11:17.540 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:17.540 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:17.540 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.540 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.540 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:17.540 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:17.540 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:17.540 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:17.540 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:17.540 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.540 INFO:tasks.workunit.client.0.smithi050.stderr: -270> 2024-09-14T11:11:17.234+0000 7fd56e72c800 10 monclient: shutdown 2024-09-14T11:11:17.540 INFO:tasks.workunit.client.0.smithi050.stderr: -269> 2024-09-14T11:11:17.234+0000 7fd56e72c800 10 monclient: build_initial_monmap 2024-09-14T11:11:17.540 INFO:tasks.workunit.client.0.smithi050.stderr: -268> 2024-09-14T11:11:17.234+0000 7fd56e72c800 1 build_initial for_mkfs: 0 2024-09-14T11:11:17.540 INFO:tasks.workunit.client.0.smithi050.stderr: -267> 2024-09-14T11:11:17.234+0000 7fd56e72c800 10 monclient: monmap: 2024-09-14T11:11:17.540 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:11:17.541 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:11:17.541 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:11:17.541 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:11:17.541 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:11:17.541 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:17.541 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:11:17.541 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:11:17.541 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:11:17.541 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.541 INFO:tasks.workunit.client.0.smithi050.stderr: -266> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding auth protocol: cephx 2024-09-14T11:11:17.541 INFO:tasks.workunit.client.0.smithi050.stderr: -265> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding auth protocol: cephx 2024-09-14T11:11:17.541 INFO:tasks.workunit.client.0.smithi050.stderr: -264> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding auth protocol: cephx 2024-09-14T11:11:17.541 INFO:tasks.workunit.client.0.smithi050.stderr: -263> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding con mode: secure 2024-09-14T11:11:17.542 INFO:tasks.workunit.client.0.smithi050.stderr: -262> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding con mode: crc 2024-09-14T11:11:17.542 INFO:tasks.workunit.client.0.smithi050.stderr: -261> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding con mode: secure 2024-09-14T11:11:17.542 INFO:tasks.workunit.client.0.smithi050.stderr: -260> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding con mode: crc 2024-09-14T11:11:17.542 INFO:tasks.workunit.client.0.smithi050.stderr: -259> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding con mode: secure 2024-09-14T11:11:17.542 INFO:tasks.workunit.client.0.smithi050.stderr: -258> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding con mode: crc 2024-09-14T11:11:17.542 INFO:tasks.workunit.client.0.smithi050.stderr: -257> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding con mode: crc 2024-09-14T11:11:17.542 INFO:tasks.workunit.client.0.smithi050.stderr: -256> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding con mode: secure 2024-09-14T11:11:17.542 INFO:tasks.workunit.client.0.smithi050.stderr: -255> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding con mode: crc 2024-09-14T11:11:17.542 INFO:tasks.workunit.client.0.smithi050.stderr: -254> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding con mode: secure 2024-09-14T11:11:17.542 INFO:tasks.workunit.client.0.smithi050.stderr: -253> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding con mode: crc 2024-09-14T11:11:17.542 INFO:tasks.workunit.client.0.smithi050.stderr: -252> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding con mode: secure 2024-09-14T11:11:17.542 INFO:tasks.workunit.client.0.smithi050.stderr: -251> 2024-09-14T11:11:17.234+0000 7fd56e72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:17.542 INFO:tasks.workunit.client.0.smithi050.stderr: -250> 2024-09-14T11:11:17.234+0000 7fd56e72c800 1 librados: starting msgr at 2024-09-14T11:11:17.543 INFO:tasks.workunit.client.0.smithi050.stderr: -249> 2024-09-14T11:11:17.234+0000 7fd56e72c800 1 librados: starting objecter 2024-09-14T11:11:17.543 INFO:tasks.workunit.client.0.smithi050.stderr: -248> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command objecter_requests cmddesc objecter_requests hook 0x55655a52a650 EEXIST 2024-09-14T11:11:17.543 INFO:tasks.workunit.client.0.smithi050.stderr: -247> 2024-09-14T11:11:17.235+0000 7fd56e72c800 1 librados: setting wanted keys 2024-09-14T11:11:17.543 INFO:tasks.workunit.client.0.smithi050.stderr: -246> 2024-09-14T11:11:17.235+0000 7fd56e72c800 1 librados: calling monclient init 2024-09-14T11:11:17.543 INFO:tasks.workunit.client.0.smithi050.stderr: -245> 2024-09-14T11:11:17.235+0000 7fd56e72c800 10 monclient: init 2024-09-14T11:11:17.543 INFO:tasks.workunit.client.0.smithi050.stderr: -244> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding auth protocol: cephx 2024-09-14T11:11:17.543 INFO:tasks.workunit.client.0.smithi050.stderr: -243> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding auth protocol: cephx 2024-09-14T11:11:17.543 INFO:tasks.workunit.client.0.smithi050.stderr: -242> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding auth protocol: cephx 2024-09-14T11:11:17.543 INFO:tasks.workunit.client.0.smithi050.stderr: -241> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding con mode: secure 2024-09-14T11:11:17.543 INFO:tasks.workunit.client.0.smithi050.stderr: -240> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding con mode: crc 2024-09-14T11:11:17.543 INFO:tasks.workunit.client.0.smithi050.stderr: -239> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding con mode: secure 2024-09-14T11:11:17.543 INFO:tasks.workunit.client.0.smithi050.stderr: -238> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding con mode: crc 2024-09-14T11:11:17.543 INFO:tasks.workunit.client.0.smithi050.stderr: -237> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding con mode: secure 2024-09-14T11:11:17.543 INFO:tasks.workunit.client.0.smithi050.stderr: -236> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding con mode: crc 2024-09-14T11:11:17.544 INFO:tasks.workunit.client.0.smithi050.stderr: -235> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding con mode: crc 2024-09-14T11:11:17.544 INFO:tasks.workunit.client.0.smithi050.stderr: -234> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding con mode: secure 2024-09-14T11:11:17.544 INFO:tasks.workunit.client.0.smithi050.stderr: -233> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding con mode: crc 2024-09-14T11:11:17.544 INFO:tasks.workunit.client.0.smithi050.stderr: -232> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding con mode: secure 2024-09-14T11:11:17.544 INFO:tasks.workunit.client.0.smithi050.stderr: -231> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding con mode: crc 2024-09-14T11:11:17.544 INFO:tasks.workunit.client.0.smithi050.stderr: -230> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding con mode: secure 2024-09-14T11:11:17.544 INFO:tasks.workunit.client.0.smithi050.stderr: -229> 2024-09-14T11:11:17.235+0000 7fd56e72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:17.544 INFO:tasks.workunit.client.0.smithi050.stderr: -228> 2024-09-14T11:11:17.235+0000 7fd56e72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:17.544 INFO:tasks.workunit.client.0.smithi050.stderr: -227> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command rotate-key cmddesc rotate-key hook 0x55655a540c18 EEXIST 2024-09-14T11:11:17.544 INFO:tasks.workunit.client.0.smithi050.stderr: -226> 2024-09-14T11:11:17.235+0000 7fd56e72c800 10 monclient: _reopen_session rank -1 2024-09-14T11:11:17.544 INFO:tasks.workunit.client.0.smithi050.stderr: -225> 2024-09-14T11:11:17.235+0000 7fd56e72c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:11:17.544 INFO:tasks.workunit.client.0.smithi050.stderr: -224> 2024-09-14T11:11:17.235+0000 7fd56e72c800 10 monclient(hunting): picked mon.noname-a con 0x55655a5511f0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:11:17.544 INFO:tasks.workunit.client.0.smithi050.stderr: -223> 2024-09-14T11:11:17.235+0000 7fd56e72c800 10 monclient(hunting): picked mon.noname-c con 0x55655a57bb40 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:11:17.544 INFO:tasks.workunit.client.0.smithi050.stderr: -222> 2024-09-14T11:11:17.235+0000 7fd56e72c800 10 monclient(hunting): picked mon.noname-b con 0x55655a5802a0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:11:17.545 INFO:tasks.workunit.client.0.smithi050.stderr: -221> 2024-09-14T11:11:17.235+0000 7fd56e72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:17.545 INFO:tasks.workunit.client.0.smithi050.stderr: -220> 2024-09-14T11:11:17.235+0000 7fd56e72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:17.545 INFO:tasks.workunit.client.0.smithi050.stderr: -219> 2024-09-14T11:11:17.235+0000 7fd56e72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:17.545 INFO:tasks.workunit.client.0.smithi050.stderr: -218> 2024-09-14T11:11:17.235+0000 7fd56e72c800 10 monclient(hunting): _renew_subs 2024-09-14T11:11:17.545 INFO:tasks.workunit.client.0.smithi050.stderr: -217> 2024-09-14T11:11:17.235+0000 7fd56e72c800 10 monclient(hunting): authenticate will time out at 2329.872660s 2024-09-14T11:11:17.545 INFO:tasks.workunit.client.0.smithi050.stderr: -216> 2024-09-14T11:11:17.235+0000 7fd56a33e640 10 monclient(hunting): get_auth_request con 0x55655a5511f0 auth_method 0 2024-09-14T11:11:17.545 INFO:tasks.workunit.client.0.smithi050.stderr: -215> 2024-09-14T11:11:17.235+0000 7fd56a33e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:17.545 INFO:tasks.workunit.client.0.smithi050.stderr: -214> 2024-09-14T11:11:17.235+0000 7fd56a33e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:17.545 INFO:tasks.workunit.client.0.smithi050.stderr: -213> 2024-09-14T11:11:17.235+0000 7fd56a33e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:17.545 INFO:tasks.workunit.client.0.smithi050.stderr: -212> 2024-09-14T11:11:17.235+0000 7fd569b3d640 10 monclient(hunting): get_auth_request con 0x55655a57bb40 auth_method 0 2024-09-14T11:11:17.545 INFO:tasks.workunit.client.0.smithi050.stderr: -211> 2024-09-14T11:11:17.235+0000 7fd569b3d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:17.545 INFO:tasks.workunit.client.0.smithi050.stderr: -210> 2024-09-14T11:11:17.235+0000 7fd569b3d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:17.545 INFO:tasks.workunit.client.0.smithi050.stderr: -209> 2024-09-14T11:11:17.235+0000 7fd569b3d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:17.546 INFO:tasks.workunit.client.0.smithi050.stderr: -208> 2024-09-14T11:11:17.235+0000 7fd56a33e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:17.546 INFO:tasks.workunit.client.0.smithi050.stderr: -207> 2024-09-14T11:11:17.235+0000 7fd56a33e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:17.548 INFO:tasks.workunit.client.0.smithi050.stderr: -206> 2024-09-14T11:11:17.235+0000 7fd56a33e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:17.548 INFO:tasks.workunit.client.0.smithi050.stderr: -205> 2024-09-14T11:11:17.235+0000 7fd56ab3f640 10 monclient(hunting): get_auth_request con 0x55655a5802a0 auth_method 0 2024-09-14T11:11:17.548 INFO:tasks.workunit.client.0.smithi050.stderr: -204> 2024-09-14T11:11:17.235+0000 7fd56ab3f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:17.548 INFO:tasks.workunit.client.0.smithi050.stderr: -203> 2024-09-14T11:11:17.235+0000 7fd56ab3f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:17.548 INFO:tasks.workunit.client.0.smithi050.stderr: -202> 2024-09-14T11:11:17.235+0000 7fd56ab3f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:17.548 INFO:tasks.workunit.client.0.smithi050.stderr: -201> 2024-09-14T11:11:17.235+0000 7fd569b3d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:17.548 INFO:tasks.workunit.client.0.smithi050.stderr: -200> 2024-09-14T11:11:17.235+0000 7fd569b3d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:17.548 INFO:tasks.workunit.client.0.smithi050.stderr: -199> 2024-09-14T11:11:17.235+0000 7fd569b3d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:17.549 INFO:tasks.workunit.client.0.smithi050.stderr: -198> 2024-09-14T11:11:17.235+0000 7fd56ab3f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:17.549 INFO:tasks.workunit.client.0.smithi050.stderr: -197> 2024-09-14T11:11:17.235+0000 7fd56ab3f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:17.549 INFO:tasks.workunit.client.0.smithi050.stderr: -196> 2024-09-14T11:11:17.235+0000 7fd56ab3f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:17.549 INFO:tasks.workunit.client.0.smithi050.stderr: -195> 2024-09-14T11:11:17.235+0000 7fd56a33e640 10 monclient(hunting): handle_auth_done global_id 7149 payload 824 2024-09-14T11:11:17.549 INFO:tasks.workunit.client.0.smithi050.stderr: -194> 2024-09-14T11:11:17.235+0000 7fd56a33e640 10 monclient: _finish_hunting 0 2024-09-14T11:11:17.549 INFO:tasks.workunit.client.0.smithi050.stderr: -193> 2024-09-14T11:11:17.235+0000 7fd56a33e640 1 monclient: found mon.noname-a 2024-09-14T11:11:17.549 INFO:tasks.workunit.client.0.smithi050.stderr: -192> 2024-09-14T11:11:17.235+0000 7fd56a33e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:11:17.549 INFO:tasks.workunit.client.0.smithi050.stderr: -191> 2024-09-14T11:11:17.236+0000 7fd43bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:17.549 INFO:tasks.workunit.client.0.smithi050.stderr: -190> 2024-09-14T11:11:17.236+0000 7fd43bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:11:17.549 INFO:tasks.workunit.client.0.smithi050.stderr: -189> 2024-09-14T11:11:17.236+0000 7fd43bfff640 10 monclient: dump: 2024-09-14T11:11:17.549 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:17.549 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:17.549 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.549 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.550 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:17.550 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:17.550 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:17.550 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:17.550 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:17.550 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.550 INFO:tasks.workunit.client.0.smithi050.stderr: -188> 2024-09-14T11:11:17.236+0000 7fd43bfff640 10 monclient: _finish_auth 0 2024-09-14T11:11:17.550 INFO:tasks.workunit.client.0.smithi050.stderr: -187> 2024-09-14T11:11:17.236+0000 7fd43bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:11:17.550 INFO:tasks.workunit.client.0.smithi050.stderr: -186> 2024-09-14T11:11:17.236+0000 7fd43bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:11:17.550 INFO:tasks.workunit.client.0.smithi050.stderr: -185> 2024-09-14T11:11:17.236+0000 7fd43bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:17.550 INFO:tasks.workunit.client.0.smithi050.stderr: -184> 2024-09-14T11:11:17.236+0000 7fd43bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:11:17.550 INFO:tasks.workunit.client.0.smithi050.stderr: -183> 2024-09-14T11:11:17.236+0000 7fd43bfff640 10 monclient: dump: 2024-09-14T11:11:17.550 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:17.551 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:17.551 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.551 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.551 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:17.551 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:17.551 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:17.551 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:17.551 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:17.551 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.551 INFO:tasks.workunit.client.0.smithi050.stderr: -182> 2024-09-14T11:11:17.236+0000 7fd56e72c800 5 monclient: authenticate success, global_id 7149 2024-09-14T11:11:17.551 INFO:tasks.workunit.client.0.smithi050.stderr: -181> 2024-09-14T11:11:17.236+0000 7fd44dffb640 4 set_mon_vals no callback set 2024-09-14T11:11:17.551 INFO:tasks.workunit.client.0.smithi050.stderr: -180> 2024-09-14T11:11:17.236+0000 7fd56e72c800 10 monclient: _renew_subs 2024-09-14T11:11:17.551 INFO:tasks.workunit.client.0.smithi050.stderr: -179> 2024-09-14T11:11:17.236+0000 7fd56e72c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:11:17.551 INFO:tasks.workunit.client.0.smithi050.stderr: -178> 2024-09-14T11:11:17.236+0000 7fd56e72c800 10 monclient: _renew_subs 2024-09-14T11:11:17.552 INFO:tasks.workunit.client.0.smithi050.stderr: -177> 2024-09-14T11:11:17.236+0000 7fd56e72c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:11:17.552 INFO:tasks.workunit.client.0.smithi050.stderr: -176> 2024-09-14T11:11:17.236+0000 7fd56e72c800 1 librados: init done 2024-09-14T11:11:17.552 INFO:tasks.workunit.client.0.smithi050.stderr: -175> 2024-09-14T11:11:17.236+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command cr dump hook 0x55655a54fca8 2024-09-14T11:11:17.552 INFO:tasks.workunit.client.0.smithi050.stderr: -174> 2024-09-14T11:11:17.237+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.552 INFO:tasks.workunit.client.0.smithi050.stderr: -173> 2024-09-14T11:11:17.238+0000 7fd43bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:11:17.552 INFO:tasks.workunit.client.0.smithi050.stderr: -172> 2024-09-14T11:11:17.238+0000 7fd43bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:11:17.552 INFO:tasks.workunit.client.0.smithi050.stderr: -171> 2024-09-14T11:11:17.238+0000 7fd43bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:11:17.552 INFO:tasks.workunit.client.0.smithi050.stderr: -170> 2024-09-14T11:11:17.238+0000 7fd569b3d640 10 monclient: get_auth_request con 0x7fd434077230 auth_method 0 2024-09-14T11:11:17.552 INFO:tasks.workunit.client.0.smithi050.stderr: -169> 2024-09-14T11:11:17.238+0000 7fd56ab3f640 10 monclient: get_auth_request con 0x55655a5999e0 auth_method 0 2024-09-14T11:11:17.552 INFO:tasks.workunit.client.0.smithi050.stderr: -168> 2024-09-14T11:11:17.239+0000 7fd56e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.552 INFO:tasks.workunit.client.0.smithi050.stderr: -167> 2024-09-14T11:11:17.239+0000 7fd56e72c800 20 realm 2024-09-14T11:11:17.552 INFO:tasks.workunit.client.0.smithi050.stderr: -166> 2024-09-14T11:11:17.239+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.552 INFO:tasks.workunit.client.0.smithi050.stderr: -165> 2024-09-14T11:11:17.239+0000 7fd56e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.553 INFO:tasks.workunit.client.0.smithi050.stderr: -164> 2024-09-14T11:11:17.239+0000 7fd56e72c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:17.553 INFO:tasks.workunit.client.0.smithi050.stderr: -163> 2024-09-14T11:11:17.239+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.553 INFO:tasks.workunit.client.0.smithi050.stderr: -162> 2024-09-14T11:11:17.239+0000 7fd56e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.553 INFO:tasks.workunit.client.0.smithi050.stderr: -161> 2024-09-14T11:11:17.239+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.553 INFO:tasks.workunit.client.0.smithi050.stderr: -160> 2024-09-14T11:11:17.240+0000 7fd56a33e640 10 monclient: get_auth_request con 0x55655a59dc30 auth_method 0 2024-09-14T11:11:17.553 INFO:tasks.workunit.client.0.smithi050.stderr: -159> 2024-09-14T11:11:17.240+0000 7fd56e72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:17.553 INFO:tasks.workunit.client.0.smithi050.stderr: -158> 2024-09-14T11:11:17.240+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.553 INFO:tasks.workunit.client.0.smithi050.stderr: -157> 2024-09-14T11:11:17.240+0000 7fd569b3d640 10 monclient: get_auth_request con 0x55655a5a14b0 auth_method 0 2024-09-14T11:11:17.553 INFO:tasks.workunit.client.0.smithi050.stderr: -156> 2024-09-14T11:11:17.241+0000 7fd56e72c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:17.553 INFO:tasks.workunit.client.0.smithi050.stderr: -155> 2024-09-14T11:11:17.241+0000 7fd56e72c800 20 searching for the correct realm 2024-09-14T11:11:17.553 INFO:tasks.workunit.client.0.smithi050.stderr: -154> 2024-09-14T11:11:17.241+0000 7fd56ab3f640 10 monclient: get_auth_request con 0x55655a5a6280 auth_method 0 2024-09-14T11:11:17.553 INFO:tasks.workunit.client.0.smithi050.stderr: -153> 2024-09-14T11:11:17.242+0000 7fd56a33e640 10 monclient: get_auth_request con 0x7fd56403a410 auth_method 0 2024-09-14T11:11:17.553 INFO:tasks.workunit.client.0.smithi050.stderr: -152> 2024-09-14T11:11:17.244+0000 7fd569b3d640 10 monclient: get_auth_request con 0x7fd56402c920 auth_method 0 2024-09-14T11:11:17.553 INFO:tasks.workunit.client.0.smithi050.stderr: -151> 2024-09-14T11:11:17.244+0000 7fd569b3d640 0 -- 172.21.15.50:0/3410983899 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fd56402c920 msgr2=0x7fd564017400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:17.554 INFO:tasks.workunit.client.0.smithi050.stderr: -150> 2024-09-14T11:11:17.446+0000 7fd569b3d640 10 monclient: get_auth_request con 0x7fd56402c920 auth_method 0 2024-09-14T11:11:17.554 INFO:tasks.workunit.client.0.smithi050.stderr: -149> 2024-09-14T11:11:17.448+0000 7fd56ab3f640 10 monclient: get_auth_request con 0x7fd55c06b020 auth_method 0 2024-09-14T11:11:17.554 INFO:tasks.workunit.client.0.smithi050.stderr: -148> 2024-09-14T11:11:17.449+0000 7fd56a33e640 10 monclient: get_auth_request con 0x7fd564048960 auth_method 0 2024-09-14T11:11:17.554 INFO:tasks.workunit.client.0.smithi050.stderr: -147> 2024-09-14T11:11:17.450+0000 7fd56ab3f640 0 -- 172.21.15.50:0/3410983899 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55655a5999e0 msgr2=0x55655a59bea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:17.554 INFO:tasks.workunit.client.0.smithi050.stderr: -146> 2024-09-14T11:11:17.450+0000 7fd43bfff640 1 client.7149.objecter ms_handle_reset 0x55655a5999e0 session 0x55655a599310 osd.6 2024-09-14T11:11:17.554 INFO:tasks.workunit.client.0.smithi050.stderr: -145> 2024-09-14T11:11:17.450+0000 7fd43bfff640 10 monclient: _renew_subs 2024-09-14T11:11:17.554 INFO:tasks.workunit.client.0.smithi050.stderr: -144> 2024-09-14T11:11:17.450+0000 7fd43bfff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:11:17.554 INFO:tasks.workunit.client.0.smithi050.stderr: -143> 2024-09-14T11:11:17.450+0000 7fd56ab3f640 10 monclient: get_auth_request con 0x7fd4340874e0 auth_method 0 2024-09-14T11:11:17.554 INFO:tasks.workunit.client.0.smithi050.stderr: -142> 2024-09-14T11:11:17.454+0000 7fd56e72c800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:17.554 INFO:tasks.workunit.client.0.smithi050.stderr: -141> 2024-09-14T11:11:17.454+0000 7fd56e72c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:17.554 INFO:tasks.workunit.client.0.smithi050.stderr: -140> 2024-09-14T11:11:17.454+0000 7fd56e72c800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:17.554 INFO:tasks.workunit.client.0.smithi050.stderr: -139> 2024-09-14T11:11:17.454+0000 7fd56e72c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:17.554 INFO:tasks.workunit.client.0.smithi050.stderr: -138> 2024-09-14T11:11:17.454+0000 7fd56e72c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:17.555 INFO:tasks.workunit.client.0.smithi050.stderr: -137> 2024-09-14T11:11:17.454+0000 7fd56e72c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:17.555 INFO:tasks.workunit.client.0.smithi050.stderr: -136> 2024-09-14T11:11:17.454+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.555 INFO:tasks.workunit.client.0.smithi050.stderr: -135> 2024-09-14T11:11:17.454+0000 7fd56e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.555 INFO:tasks.workunit.client.0.smithi050.stderr: -134> 2024-09-14T11:11:17.454+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.555 INFO:tasks.workunit.client.0.smithi050.stderr: -133> 2024-09-14T11:11:17.454+0000 7fd56e72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:17.555 INFO:tasks.workunit.client.0.smithi050.stderr: -132> 2024-09-14T11:11:17.454+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.555 INFO:tasks.workunit.client.0.smithi050.stderr: -131> 2024-09-14T11:11:17.455+0000 7fd56e72c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:17.555 INFO:tasks.workunit.client.0.smithi050.stderr: -130> 2024-09-14T11:11:17.455+0000 7fd56e72c800 20 zone default found 2024-09-14T11:11:17.555 INFO:tasks.workunit.client.0.smithi050.stderr: -129> 2024-09-14T11:11:17.455+0000 7fd56e72c800 4 Realm: () 2024-09-14T11:11:17.555 INFO:tasks.workunit.client.0.smithi050.stderr: -128> 2024-09-14T11:11:17.455+0000 7fd56e72c800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:17.555 INFO:tasks.workunit.client.0.smithi050.stderr: -127> 2024-09-14T11:11:17.455+0000 7fd56e72c800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:17.555 INFO:tasks.workunit.client.0.smithi050.stderr: -126> 2024-09-14T11:11:17.455+0000 7fd56e72c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:17.555 INFO:tasks.workunit.client.0.smithi050.stderr: -125> 2024-09-14T11:11:17.455+0000 7fd56e72c800 20 zonegroup default 2024-09-14T11:11:17.555 INFO:tasks.workunit.client.0.smithi050.stderr: -124> 2024-09-14T11:11:17.455+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.555 INFO:tasks.workunit.client.0.smithi050.stderr: -123> 2024-09-14T11:11:17.455+0000 7fd56e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.556 INFO:tasks.workunit.client.0.smithi050.stderr: -122> 2024-09-14T11:11:17.455+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.556 INFO:tasks.workunit.client.0.smithi050.stderr: -121> 2024-09-14T11:11:17.455+0000 7fd56e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.556 INFO:tasks.workunit.client.0.smithi050.stderr: -120> 2024-09-14T11:11:17.455+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.556 INFO:tasks.workunit.client.0.smithi050.stderr: -119> 2024-09-14T11:11:17.456+0000 7fd56e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.556 INFO:tasks.workunit.client.0.smithi050.stderr: -118> 2024-09-14T11:11:17.456+0000 7fd56e72c800 20 started sync module instance, tier type = 2024-09-14T11:11:17.556 INFO:tasks.workunit.client.0.smithi050.stderr: -117> 2024-09-14T11:11:17.456+0000 7fd56e72c800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:17.556 INFO:tasks.workunit.client.0.smithi050.stderr: -116> 2024-09-14T11:11:17.464+0000 7fd56e72c800 20 add_watcher() i=0 2024-09-14T11:11:17.556 INFO:tasks.workunit.client.0.smithi050.stderr: -115> 2024-09-14T11:11:17.464+0000 7fd56e72c800 20 add_watcher() i=1 2024-09-14T11:11:17.556 INFO:tasks.workunit.client.0.smithi050.stderr: -114> 2024-09-14T11:11:17.464+0000 7fd56e72c800 20 add_watcher() i=2 2024-09-14T11:11:17.556 INFO:tasks.workunit.client.0.smithi050.stderr: -113> 2024-09-14T11:11:17.464+0000 7fd56e72c800 20 add_watcher() i=3 2024-09-14T11:11:17.556 INFO:tasks.workunit.client.0.smithi050.stderr: -112> 2024-09-14T11:11:17.464+0000 7fd56e72c800 20 add_watcher() i=4 2024-09-14T11:11:17.556 INFO:tasks.workunit.client.0.smithi050.stderr: -111> 2024-09-14T11:11:17.464+0000 7fd56e72c800 20 add_watcher() i=5 2024-09-14T11:11:17.556 INFO:tasks.workunit.client.0.smithi050.stderr: -110> 2024-09-14T11:11:17.464+0000 7fd56e72c800 20 add_watcher() i=6 2024-09-14T11:11:17.556 INFO:tasks.workunit.client.0.smithi050.stderr: -109> 2024-09-14T11:11:17.465+0000 7fd56e72c800 20 add_watcher() i=7 2024-09-14T11:11:17.556 INFO:tasks.workunit.client.0.smithi050.stderr: -108> 2024-09-14T11:11:17.465+0000 7fd56e72c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:17.557 INFO:tasks.workunit.client.0.smithi050.stderr: -107> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding auth protocol: cephx 2024-09-14T11:11:17.557 INFO:tasks.workunit.client.0.smithi050.stderr: -106> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding auth protocol: cephx 2024-09-14T11:11:17.557 INFO:tasks.workunit.client.0.smithi050.stderr: -105> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding auth protocol: cephx 2024-09-14T11:11:17.557 INFO:tasks.workunit.client.0.smithi050.stderr: -104> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding con mode: secure 2024-09-14T11:11:17.557 INFO:tasks.workunit.client.0.smithi050.stderr: -103> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding con mode: crc 2024-09-14T11:11:17.557 INFO:tasks.workunit.client.0.smithi050.stderr: -102> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding con mode: secure 2024-09-14T11:11:17.557 INFO:tasks.workunit.client.0.smithi050.stderr: -101> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding con mode: crc 2024-09-14T11:11:17.557 INFO:tasks.workunit.client.0.smithi050.stderr: -100> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding con mode: secure 2024-09-14T11:11:17.557 INFO:tasks.workunit.client.0.smithi050.stderr: -99> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding con mode: crc 2024-09-14T11:11:17.557 INFO:tasks.workunit.client.0.smithi050.stderr: -98> 2024-09-14T11:11:17.467+0000 7fd420fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:17.557 INFO:tasks.workunit.client.0.smithi050.stderr: -97> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding con mode: crc 2024-09-14T11:11:17.557 INFO:tasks.workunit.client.0.smithi050.stderr: -96> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding con mode: secure 2024-09-14T11:11:17.557 INFO:tasks.workunit.client.0.smithi050.stderr: -95> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding con mode: crc 2024-09-14T11:11:17.557 INFO:tasks.workunit.client.0.smithi050.stderr: -94> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding con mode: secure 2024-09-14T11:11:17.558 INFO:tasks.workunit.client.0.smithi050.stderr: -93> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding con mode: crc 2024-09-14T11:11:17.558 INFO:tasks.workunit.client.0.smithi050.stderr: -92> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding con mode: secure 2024-09-14T11:11:17.558 INFO:tasks.workunit.client.0.smithi050.stderr: -91> 2024-09-14T11:11:17.467+0000 7fd56e72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:17.558 INFO:tasks.workunit.client.0.smithi050.stderr: -90> 2024-09-14T11:11:17.467+0000 7fd56e72c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:17.558 INFO:tasks.workunit.client.0.smithi050.stderr: -89> 2024-09-14T11:11:17.467+0000 7fd56e72c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:17.558 INFO:tasks.workunit.client.0.smithi050.stderr: -88> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command cache list hook 0x55655a576940 2024-09-14T11:11:17.558 INFO:tasks.workunit.client.0.smithi050.stderr: -87> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command cache inspect hook 0x55655a576940 2024-09-14T11:11:17.558 INFO:tasks.workunit.client.0.smithi050.stderr: -86> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command cache erase hook 0x55655a576940 2024-09-14T11:11:17.558 INFO:tasks.workunit.client.0.smithi050.stderr: -85> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command cache zap hook 0x55655a576940 2024-09-14T11:11:17.558 INFO:tasks.workunit.client.0.smithi050.stderr: -84> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 note: GC not initialized 2024-09-14T11:11:17.558 INFO:tasks.workunit.client.0.smithi050.stderr: -83> 2024-09-14T11:11:17.467+0000 7fd39b7fe640 20 reqs_thread_entry: start 2024-09-14T11:11:17.558 INFO:tasks.workunit.client.0.smithi050.stderr: -82> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command sync trace show hook 0x7fd55c0c2070 2024-09-14T11:11:17.558 INFO:tasks.workunit.client.0.smithi050.stderr: -81> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command sync trace history hook 0x7fd55c0c2070 2024-09-14T11:11:17.558 INFO:tasks.workunit.client.0.smithi050.stderr: -80> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command sync trace active hook 0x7fd55c0c2070 2024-09-14T11:11:17.559 INFO:tasks.workunit.client.0.smithi050.stderr: -79> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command sync trace active_short hook 0x7fd55c0c2070 2024-09-14T11:11:17.559 INFO:tasks.workunit.client.0.smithi050.stderr: -78> 2024-09-14T11:11:17.467+0000 7fd56e72c800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:17.559 INFO:tasks.workunit.client.0.smithi050.stderr: -77> 2024-09-14T11:11:17.467+0000 7fd56e72c800 20 Filter name: none 2024-09-14T11:11:17.559 INFO:tasks.workunit.client.0.smithi050.stderr: -76> 2024-09-14T11:11:17.467+0000 7fd3997fa640 20 reqs_thread_entry: start 2024-09-14T11:11:17.559 INFO:tasks.workunit.client.0.smithi050.stderr: -75> 2024-09-14T11:11:17.468+0000 7fd56e72c800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:11:17.559 INFO:tasks.workunit.client.0.smithi050.stderr: -74> 2024-09-14T11:11:17.468+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.559 INFO:tasks.workunit.client.0.smithi050.stderr: -73> 2024-09-14T11:11:17.468+0000 7fd56e72c800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:11:17.559 INFO:tasks.workunit.client.0.smithi050.stderr: -72> 2024-09-14T11:11:17.468+0000 7fd56e72c800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:11:17.559 INFO:tasks.workunit.client.0.smithi050.stderr: -71> 2024-09-14T11:11:17.468+0000 7fd56e72c800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:11:17.559 INFO:tasks.workunit.client.0.smithi050.stderr: -70> 2024-09-14T11:11:17.468+0000 7fd56e72c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 : miss 2024-09-14T11:11:17.559 INFO:tasks.workunit.client.0.smithi050.stderr: -69> 2024-09-14T11:11:17.468+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.559 INFO:tasks.workunit.client.0.smithi050.stderr: -68> 2024-09-14T11:11:17.468+0000 7fd56e72c800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:11:17.559 INFO:tasks.workunit.client.0.smithi050.stderr: -67> 2024-09-14T11:11:17.468+0000 7fd56e72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 info.flags=0x17 2024-09-14T11:11:17.559 INFO:tasks.workunit.client.0.smithi050.stderr: -66> 2024-09-14T11:11:17.468+0000 7fd56e72c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 to cache LRU end 2024-09-14T11:11:17.560 INFO:tasks.workunit.client.0.smithi050.stderr: -65> 2024-09-14T11:11:17.468+0000 7fd56e72c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:11:17.560 INFO:tasks.workunit.client.0.smithi050.stderr: -64> 2024-09-14T11:11:17.468+0000 7fd56e72c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:17.560 INFO:tasks.workunit.client.0.smithi050.stderr: -63> 2024-09-14T11:11:17.468+0000 7fd56e72c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 2024-09-14T11:11:17.560 INFO:tasks.workunit.client.0.smithi050.stderr: -62> 2024-09-14T11:11:17.473+0000 7fd56e72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 info.flags=0x17 2024-09-14T11:11:17.560 INFO:tasks.workunit.client.0.smithi050.stderr: -61> 2024-09-14T11:11:17.473+0000 7fd56e72c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 to cache LRU end 2024-09-14T11:11:17.560 INFO:tasks.workunit.client.0.smithi050.stderr: -60> 2024-09-14T11:11:17.473+0000 7fd56e72c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:17.560 INFO:tasks.workunit.client.0.smithi050.stderr: -59> 2024-09-14T11:11:17.473+0000 7fd56e72c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30, ofs0, ns] 2024-09-14T11:11:17.560 INFO:tasks.workunit.client.0.smithi050.stderr: -58> 2024-09-14T11:11:17.474+0000 7fd44d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497079 cookie 93893795942352 notifier 7149 bl.length()=999 2024-09-14T11:11:17.560 INFO:tasks.workunit.client.0.smithi050.stderr: -57> 2024-09-14T11:11:17.474+0000 7fd44d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 info.flags=0x17 2024-09-14T11:11:17.560 INFO:tasks.workunit.client.0.smithi050.stderr: -56> 2024-09-14T11:11:17.474+0000 7fd44d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 to cache LRU end 2024-09-14T11:11:17.560 INFO:tasks.workunit.client.0.smithi050.stderr: -55> 2024-09-14T11:11:17.474+0000 7fd44d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:17.560 INFO:tasks.workunit.client.0.smithi050.stderr: -54> 2024-09-14T11:11:17.475+0000 7fd56e72c800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): orig_sources= new_sources= 2024-09-14T11:11:17.560 INFO:tasks.workunit.client.0.smithi050.stderr: -53> 2024-09-14T11:11:17.475+0000 7fd56e72c800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): potential sources added=[] removed=[] 2024-09-14T11:11:17.561 INFO:tasks.workunit.client.0.smithi050.stderr: -52> 2024-09-14T11:11:17.475+0000 7fd56e72c800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): orig_dests= new_dests= 2024-09-14T11:11:17.561 INFO:tasks.workunit.client.0.smithi050.stderr: -51> 2024-09-14T11:11:17.475+0000 7fd56e72c800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): potential dests added=[] removed=[] 2024-09-14T11:11:17.561 INFO:tasks.workunit.client.0.smithi050.stderr: -50> 2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.0 2024-09-14T11:11:17.561 INFO:tasks.workunit.client.0.smithi050.stderr: -49> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.0 2024-09-14T11:11:17.561 INFO:tasks.workunit.client.0.smithi050.stderr: -48> 2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.1 2024-09-14T11:11:17.561 INFO:tasks.workunit.client.0.smithi050.stderr: -47> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.1 2024-09-14T11:11:17.561 INFO:tasks.workunit.client.0.smithi050.stderr: -46> 2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.2 2024-09-14T11:11:17.561 INFO:tasks.workunit.client.0.smithi050.stderr: -45> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.2 2024-09-14T11:11:17.561 INFO:tasks.workunit.client.0.smithi050.stderr: -44> 2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.3 2024-09-14T11:11:17.561 INFO:tasks.workunit.client.0.smithi050.stderr: -43> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.3 2024-09-14T11:11:17.561 INFO:tasks.workunit.client.0.smithi050.stderr: -42> 2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.4 2024-09-14T11:11:17.561 INFO:tasks.workunit.client.0.smithi050.stderr: -41> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.4 2024-09-14T11:11:17.562 INFO:tasks.workunit.client.0.smithi050.stderr: -40> 2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.5 2024-09-14T11:11:17.562 INFO:tasks.workunit.client.0.smithi050.stderr: -39> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.5 2024-09-14T11:11:17.562 INFO:tasks.workunit.client.0.smithi050.stderr: -38> 2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.6 2024-09-14T11:11:17.562 INFO:tasks.workunit.client.0.smithi050.stderr: -37> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.6 2024-09-14T11:11:17.562 INFO:tasks.workunit.client.0.smithi050.stderr: -36> 2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.7 2024-09-14T11:11:17.562 INFO:tasks.workunit.client.0.smithi050.stderr: -35> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.7 2024-09-14T11:11:17.562 INFO:tasks.workunit.client.0.smithi050.stderr: -34> 2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.8 2024-09-14T11:11:17.562 INFO:tasks.workunit.client.0.smithi050.stderr: -33> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.8 2024-09-14T11:11:17.562 INFO:tasks.workunit.client.0.smithi050.stderr: -32> 2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.9 2024-09-14T11:11:17.562 INFO:tasks.workunit.client.0.smithi050.stderr: -31> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.9 2024-09-14T11:11:17.562 INFO:tasks.workunit.client.0.smithi050.stderr: -30> 2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.10 2024-09-14T11:11:17.562 INFO:tasks.workunit.client.0.smithi050.stderr: -29> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.10 2024-09-14T11:11:17.562 INFO:tasks.workunit.client.0.smithi050.stderr: -28> 2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.11 2024-09-14T11:11:17.563 INFO:tasks.workunit.client.0.smithi050.stderr: -27> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.11 2024-09-14T11:11:17.563 INFO:tasks.workunit.client.0.smithi050.stderr: -26> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.0 2024-09-14T11:11:17.563 INFO:tasks.workunit.client.0.smithi050.stderr: -25> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1 2024-09-14T11:11:17.563 INFO:tasks.workunit.client.0.smithi050.stderr: -24> 2024-09-14T11:11:17.481+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2 2024-09-14T11:11:17.563 INFO:tasks.workunit.client.0.smithi050.stderr: -23> 2024-09-14T11:11:17.482+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.3 2024-09-14T11:11:17.563 INFO:tasks.workunit.client.0.smithi050.stderr: -22> 2024-09-14T11:11:17.482+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.4 2024-09-14T11:11:17.563 INFO:tasks.workunit.client.0.smithi050.stderr: -21> 2024-09-14T11:11:17.483+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.5 2024-09-14T11:11:17.563 INFO:tasks.workunit.client.0.smithi050.stderr: -20> 2024-09-14T11:11:17.483+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.6 2024-09-14T11:11:17.563 INFO:tasks.workunit.client.0.smithi050.stderr: -19> 2024-09-14T11:11:17.484+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.7 2024-09-14T11:11:17.563 INFO:tasks.workunit.client.0.smithi050.stderr: -18> 2024-09-14T11:11:17.484+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.8 2024-09-14T11:11:17.563 INFO:tasks.workunit.client.0.smithi050.stderr: -17> 2024-09-14T11:11:17.485+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.9 2024-09-14T11:11:17.563 INFO:tasks.workunit.client.0.smithi050.stderr: -16> 2024-09-14T11:11:17.485+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.10 2024-09-14T11:11:17.563 INFO:tasks.workunit.client.0.smithi050.stderr: -15> 2024-09-14T11:11:17.488+0000 7fd56e72c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:11:17.564 INFO:tasks.workunit.client.0.smithi050.stderr: -14> 2024-09-14T11:11:17.488+0000 7fd56e72c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 2024-09-14T11:11:17.564 INFO:tasks.workunit.client.0.smithi050.stderr: -13> 2024-09-14T11:11:17.489+0000 7fd56e72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 info.flags=0x17 2024-09-14T11:11:17.564 INFO:tasks.workunit.client.0.smithi050.stderr: -12> 2024-09-14T11:11:17.489+0000 7fd56e72c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 to cache LRU end 2024-09-14T11:11:17.564 INFO:tasks.workunit.client.0.smithi050.stderr: -11> 2024-09-14T11:11:17.489+0000 7fd56e72c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:17.564 INFO:tasks.workunit.client.0.smithi050.stderr: -10> 2024-09-14T11:11:17.489+0000 7fd56e72c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30, ofs0, ns] 2024-09-14T11:11:17.564 INFO:tasks.workunit.client.0.smithi050.stderr: -9> 2024-09-14T11:11:17.490+0000 7fd44d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497080 cookie 93893795942352 notifier 7149 bl.length()=999 2024-09-14T11:11:17.564 INFO:tasks.workunit.client.0.smithi050.stderr: -8> 2024-09-14T11:11:17.490+0000 7fd44d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 info.flags=0x17 2024-09-14T11:11:17.564 INFO:tasks.workunit.client.0.smithi050.stderr: -7> 2024-09-14T11:11:17.490+0000 7fd44d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 to cache LRU end 2024-09-14T11:11:17.564 INFO:tasks.workunit.client.0.smithi050.stderr: -6> 2024-09-14T11:11:17.490+0000 7fd44d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:17.564 INFO:tasks.workunit.client.0.smithi050.stderr: -5> 2024-09-14T11:11:17.491+0000 7fd56e72c800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): orig_sources= new_sources= 2024-09-14T11:11:17.564 INFO:tasks.workunit.client.0.smithi050.stderr: -4> 2024-09-14T11:11:17.491+0000 7fd56e72c800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): potential sources added=[] removed=[] 2024-09-14T11:11:17.564 INFO:tasks.workunit.client.0.smithi050.stderr: -3> 2024-09-14T11:11:17.491+0000 7fd56e72c800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): orig_dests= new_dests= 2024-09-14T11:11:17.564 INFO:tasks.workunit.client.0.smithi050.stderr: -2> 2024-09-14T11:11:17.491+0000 7fd56e72c800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): potential dests added=[] removed=[] 2024-09-14T11:11:17.565 INFO:tasks.workunit.client.0.smithi050.stderr: -1> 2024-09-14T11:11:17.492+0000 7fd56e72c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd56e72c800 time 2024-09-14T11:11:17.491933+0000 2024-09-14T11:11:17.565 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:11:17.565 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.565 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:11:17.565 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd56fd8c76a] 2024-09-14T11:11:17.565 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd56fd8c928] 2024-09-14T11:11:17.565 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5565591a80b1] 2024-09-14T11:11:17.565 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x5565591b718e] 2024-09-14T11:11:17.565 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5565591b7fc4] 2024-09-14T11:11:17.565 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:11:17.565 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd56ea29590] 2024-09-14T11:11:17.565 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:11:17.565 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:11:17.566 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.566 INFO:tasks.workunit.client.0.smithi050.stderr: 0> 2024-09-14T11:11:17.493+0000 7fd56e72c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:11:17.566 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7fd56e72c800 thread_name:radosgw-admin 2024-09-14T11:11:17.566 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.566 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:11:17.566 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd56ea3e6f0] 2024-09-14T11:11:17.566 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd56ea8b99c] 2024-09-14T11:11:17.566 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:11:17.566 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:11:17.566 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd56fd8c7c4] 2024-09-14T11:11:17.566 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd56fd8c928] 2024-09-14T11:11:17.566 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5565591a80b1] 2024-09-14T11:11:17.566 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x5565591b718e] 2024-09-14T11:11:17.567 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5565591b7fc4] 2024-09-14T11:11:17.567 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:11:17.567 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd56ea29590] 2024-09-14T11:11:17.567 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:11:17.567 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:11:17.567 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:11:17.567 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.567 INFO:tasks.workunit.client.0.smithi050.stderr:--- logging levels --- 2024-09-14T11:11:17.567 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 none 2024-09-14T11:11:17.567 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 lockdep 2024-09-14T11:11:17.567 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 context 2024-09-14T11:11:17.567 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 crush 2024-09-14T11:11:17.567 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds 2024-09-14T11:11:17.567 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_balancer 2024-09-14T11:11:17.568 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_locker 2024-09-14T11:11:17.568 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log 2024-09-14T11:11:17.568 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log_expire 2024-09-14T11:11:17.568 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_migrator 2024-09-14T11:11:17.568 INFO:tasks.workunit.client.0.smithi050.stderr: 3/ 5 mds_quiesce 2024-09-14T11:11:17.568 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 buffer 2024-09-14T11:11:17.568 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 timer 2024-09-14T11:11:17.568 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 filer 2024-09-14T11:11:17.568 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 striper 2024-09-14T11:11:17.568 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 objecter 2024-09-14T11:11:17.568 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rados 2024-09-14T11:11:17.568 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd 2024-09-14T11:11:17.568 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_mirror 2024-09-14T11:11:17.569 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_replay 2024-09-14T11:11:17.569 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_pwl 2024-09-14T11:11:17.569 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 journaler 2024-09-14T11:11:17.569 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objectcacher 2024-09-14T11:11:17.569 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:11:17.569 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 client 2024-09-14T11:11:17.569 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 osd 2024-09-14T11:11:17.569 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 optracker 2024-09-14T11:11:17.569 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objclass 2024-09-14T11:11:17.569 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 filestore 2024-09-14T11:11:17.569 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 journal 2024-09-14T11:11:17.569 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 ms 2024-09-14T11:11:17.569 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mon 2024-09-14T11:11:17.570 INFO:tasks.workunit.client.0.smithi050.stderr: 0/10 monc 2024-09-14T11:11:17.570 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 paxos 2024-09-14T11:11:17.570 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 tp 2024-09-14T11:11:17.570 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 auth 2024-09-14T11:11:17.570 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 crypto 2024-09-14T11:11:17.570 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 finisher 2024-09-14T11:11:17.570 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 reserver 2024-09-14T11:11:17.570 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 heartbeatmap 2024-09-14T11:11:17.570 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 perfcounter 2024-09-14T11:11:17.570 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw 2024-09-14T11:11:17.570 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_sync 2024-09-14T11:11:17.570 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_datacache 2024-09-14T11:11:17.570 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_access 2024-09-14T11:11:17.571 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:11:17.571 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_flight 2024-09-14T11:11:17.571 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:11:17.571 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw_notification 2024-09-14T11:11:17.571 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 javaclient 2024-09-14T11:11:17.571 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 asok 2024-09-14T11:11:17.571 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 throttle 2024-09-14T11:11:17.571 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 refs 2024-09-14T11:11:17.571 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 compressor 2024-09-14T11:11:17.571 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluestore 2024-09-14T11:11:17.571 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluefs 2024-09-14T11:11:17.571 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 bdev 2024-09-14T11:11:17.571 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 kstore 2024-09-14T11:11:17.571 INFO:tasks.workunit.client.0.smithi050.stderr: 4/ 5 rocksdb 2024-09-14T11:11:17.572 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 fuse 2024-09-14T11:11:17.572 INFO:tasks.workunit.client.0.smithi050.stderr: 2/ 5 mgr 2024-09-14T11:11:17.572 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mgrc 2024-09-14T11:11:17.572 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 dpdk 2024-09-14T11:11:17.572 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 eventtrace 2024-09-14T11:11:17.572 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 prioritycache 2024-09-14T11:11:17.572 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 test 2024-09-14T11:11:17.572 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:11:17.572 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephsqlite 2024-09-14T11:11:17.572 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:11:17.572 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore 2024-09-14T11:11:17.572 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_onode 2024-09-14T11:11:17.572 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_odata 2024-09-14T11:11:17.573 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_omap 2024-09-14T11:11:17.573 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_tm 2024-09-14T11:11:17.573 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_t 2024-09-14T11:11:17.573 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:11:17.573 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_epm 2024-09-14T11:11:17.573 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_lba 2024-09-14T11:11:17.573 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:11:17.573 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cache 2024-09-14T11:11:17.573 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_journal 2024-09-14T11:11:17.573 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_device 2024-09-14T11:11:17.573 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_backref 2024-09-14T11:11:17.573 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 alienstore 2024-09-14T11:11:17.573 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mclock 2024-09-14T11:11:17.573 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cyanstore 2024-09-14T11:11:17.574 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 ceph_exporter 2024-09-14T11:11:17.574 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 memstore 2024-09-14T11:11:17.574 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 trace 2024-09-14T11:11:17.574 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 ceph_dedup 2024-09-14T11:11:17.574 INFO:tasks.workunit.client.0.smithi050.stderr: -2/-2 (syslog threshold) 2024-09-14T11:11:17.574 INFO:tasks.workunit.client.0.smithi050.stderr: 99/99 (stderr threshold) 2024-09-14T11:11:17.574 INFO:tasks.workunit.client.0.smithi050.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:11:17.574 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd3997fa640 / http_manager 2024-09-14T11:11:17.574 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd39b7fe640 / http_manager 2024-09-14T11:11:17.574 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd420fe1640 / rgw_dt_lg_renew 2024-09-14T11:11:17.574 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd43bfff640 / ms_dispatch 2024-09-14T11:11:17.574 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd44d7fa640 / io_context_pool 2024-09-14T11:11:17.575 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd44dffb640 / io_context_pool 2024-09-14T11:11:17.575 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd44ffff640 / ms_dispatch 2024-09-14T11:11:17.575 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd456e05640 / ms_dispatch 2024-09-14T11:11:17.575 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd458608640 / io_context_pool 2024-09-14T11:11:17.575 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd569b3d640 / msgr-worker-2 2024-09-14T11:11:17.575 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd56a33e640 / msgr-worker-1 2024-09-14T11:11:17.575 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd56ab3f640 / msgr-worker-0 2024-09-14T11:11:17.575 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd56b340640 / io_context_pool 2024-09-14T11:11:17.575 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd56e72c800 / radosgw-admin 2024-09-14T11:11:17.575 INFO:tasks.workunit.client.0.smithi050.stderr: max_recent 500 2024-09-14T11:11:17.575 INFO:tasks.workunit.client.0.smithi050.stderr: max_new 1000 2024-09-14T11:11:17.575 INFO:tasks.workunit.client.0.smithi050.stderr: log_file /var/log/ceph/ceph-client.admin.114346.log 2024-09-14T11:11:17.575 INFO:tasks.workunit.client.0.smithi050.stderr:--- end dump of recent events --- 2024-09-14T11:11:17.576 INFO:tasks.workunit.client.0.smithi050.stderr:--- begin dump of recent events --- 2024-09-14T11:11:17.576 INFO:tasks.workunit.client.0.smithi050.stderr: -499> 2024-09-14T11:11:17.222+0000 7fd56e72c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:11:17.576 INFO:tasks.workunit.client.0.smithi050.stderr: -498> 2024-09-14T11:11:17.222+0000 7fd56e72c800 10 monclient(hunting): picked mon.noname-c con 0x55655a33adf0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:11:17.576 INFO:tasks.workunit.client.0.smithi050.stderr: -497> 2024-09-14T11:11:17.222+0000 7fd56e72c800 10 monclient(hunting): picked mon.noname-b con 0x55655a35d200 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:11:17.576 INFO:tasks.workunit.client.0.smithi050.stderr: -496> 2024-09-14T11:11:17.222+0000 7fd56e72c800 10 monclient(hunting): picked mon.noname-a con 0x55655a3f8990 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:11:17.576 INFO:tasks.workunit.client.0.smithi050.stderr: -495> 2024-09-14T11:11:17.222+0000 7fd56e72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:17.576 INFO:tasks.workunit.client.0.smithi050.stderr: -494> 2024-09-14T11:11:17.222+0000 7fd56e72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:17.576 INFO:tasks.workunit.client.0.smithi050.stderr: -493> 2024-09-14T11:11:17.222+0000 7fd56e72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:17.576 INFO:tasks.workunit.client.0.smithi050.stderr: -492> 2024-09-14T11:11:17.222+0000 7fd56e72c800 10 monclient(hunting): _renew_subs 2024-09-14T11:11:17.576 INFO:tasks.workunit.client.0.smithi050.stderr: -491> 2024-09-14T11:11:17.222+0000 7fd56e72c800 10 monclient(hunting): authenticate will time out at 2329.859308s 2024-09-14T11:11:17.576 INFO:tasks.workunit.client.0.smithi050.stderr: -490> 2024-09-14T11:11:17.222+0000 7fd56a33e640 10 monclient(hunting): get_auth_request con 0x55655a33adf0 auth_method 0 2024-09-14T11:11:17.576 INFO:tasks.workunit.client.0.smithi050.stderr: -489> 2024-09-14T11:11:17.222+0000 7fd56a33e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:17.577 INFO:tasks.workunit.client.0.smithi050.stderr: -488> 2024-09-14T11:11:17.222+0000 7fd56a33e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:17.577 INFO:tasks.workunit.client.0.smithi050.stderr: -487> 2024-09-14T11:11:17.222+0000 7fd56a33e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:17.577 INFO:tasks.workunit.client.0.smithi050.stderr: -486> 2024-09-14T11:11:17.222+0000 7fd56ab3f640 10 monclient(hunting): get_auth_request con 0x55655a3f8990 auth_method 0 2024-09-14T11:11:17.577 INFO:tasks.workunit.client.0.smithi050.stderr: -485> 2024-09-14T11:11:17.222+0000 7fd56ab3f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:17.577 INFO:tasks.workunit.client.0.smithi050.stderr: -484> 2024-09-14T11:11:17.222+0000 7fd56ab3f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:17.577 INFO:tasks.workunit.client.0.smithi050.stderr: -483> 2024-09-14T11:11:17.222+0000 7fd56ab3f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:17.577 INFO:tasks.workunit.client.0.smithi050.stderr: -482> 2024-09-14T11:11:17.222+0000 7fd56a33e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:17.577 INFO:tasks.workunit.client.0.smithi050.stderr: -481> 2024-09-14T11:11:17.222+0000 7fd56a33e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:17.577 INFO:tasks.workunit.client.0.smithi050.stderr: -480> 2024-09-14T11:11:17.222+0000 7fd56a33e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:17.577 INFO:tasks.workunit.client.0.smithi050.stderr: -479> 2024-09-14T11:11:17.222+0000 7fd56ab3f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:17.577 INFO:tasks.workunit.client.0.smithi050.stderr: -478> 2024-09-14T11:11:17.222+0000 7fd56ab3f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:17.577 INFO:tasks.workunit.client.0.smithi050.stderr: -477> 2024-09-14T11:11:17.222+0000 7fd56ab3f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:17.577 INFO:tasks.workunit.client.0.smithi050.stderr: -476> 2024-09-14T11:11:17.222+0000 7fd56a33e640 10 monclient(hunting): handle_auth_done global_id 6722 payload 824 2024-09-14T11:11:17.577 INFO:tasks.workunit.client.0.smithi050.stderr: -475> 2024-09-14T11:11:17.222+0000 7fd56a33e640 10 monclient: _finish_hunting 0 2024-09-14T11:11:17.578 INFO:tasks.workunit.client.0.smithi050.stderr: -474> 2024-09-14T11:11:17.222+0000 7fd56a33e640 1 monclient: found mon.noname-c 2024-09-14T11:11:17.578 INFO:tasks.workunit.client.0.smithi050.stderr: -473> 2024-09-14T11:11:17.222+0000 7fd56a33e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:11:17.578 INFO:tasks.workunit.client.0.smithi050.stderr: -472> 2024-09-14T11:11:17.223+0000 7fd456e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:17.578 INFO:tasks.workunit.client.0.smithi050.stderr: -471> 2024-09-14T11:11:17.223+0000 7fd456e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:11:17.578 INFO:tasks.workunit.client.0.smithi050.stderr: -470> 2024-09-14T11:11:17.223+0000 7fd456e05640 10 monclient: dump: 2024-09-14T11:11:17.578 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:17.578 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:17.578 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.578 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.578 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:17.578 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:17.578 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:17.578 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:17.578 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:17.578 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.579 INFO:tasks.workunit.client.0.smithi050.stderr: -469> 2024-09-14T11:11:17.223+0000 7fd456e05640 10 monclient: _finish_auth 0 2024-09-14T11:11:17.579 INFO:tasks.workunit.client.0.smithi050.stderr: -468> 2024-09-14T11:11:17.223+0000 7fd456e05640 10 monclient: _check_auth_tickets 2024-09-14T11:11:17.579 INFO:tasks.workunit.client.0.smithi050.stderr: -467> 2024-09-14T11:11:17.223+0000 7fd56e72c800 5 monclient: authenticate success, global_id 6722 2024-09-14T11:11:17.579 INFO:tasks.workunit.client.0.smithi050.stderr: -466> 2024-09-14T11:11:17.223+0000 7fd56e72c800 10 monclient: _renew_subs 2024-09-14T11:11:17.579 INFO:tasks.workunit.client.0.smithi050.stderr: -465> 2024-09-14T11:11:17.223+0000 7fd56e72c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:11:17.579 INFO:tasks.workunit.client.0.smithi050.stderr: -464> 2024-09-14T11:11:17.223+0000 7fd456e05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:11:17.579 INFO:tasks.workunit.client.0.smithi050.stderr: -463> 2024-09-14T11:11:17.223+0000 7fd456e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:17.579 INFO:tasks.workunit.client.0.smithi050.stderr: -462> 2024-09-14T11:11:17.223+0000 7fd456e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:11:17.579 INFO:tasks.workunit.client.0.smithi050.stderr: -461> 2024-09-14T11:11:17.223+0000 7fd456e05640 10 monclient: dump: 2024-09-14T11:11:17.579 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:17.579 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:17.579 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.579 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.579 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:17.579 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:17.580 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:17.580 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:17.580 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:17.580 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.580 INFO:tasks.workunit.client.0.smithi050.stderr: -460> 2024-09-14T11:11:17.223+0000 7fd458608640 4 set_mon_vals no callback set 2024-09-14T11:11:17.580 INFO:tasks.workunit.client.0.smithi050.stderr: -459> 2024-09-14T11:11:17.223+0000 7fd56e72c800 10 monclient: _renew_subs 2024-09-14T11:11:17.580 INFO:tasks.workunit.client.0.smithi050.stderr: -458> 2024-09-14T11:11:17.223+0000 7fd56e72c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:11:17.580 INFO:tasks.workunit.client.0.smithi050.stderr: -457> 2024-09-14T11:11:17.223+0000 7fd56e72c800 1 librados: init done 2024-09-14T11:11:17.580 INFO:tasks.workunit.client.0.smithi050.stderr: -456> 2024-09-14T11:11:17.225+0000 7fd456e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:11:17.580 INFO:tasks.workunit.client.0.smithi050.stderr: -455> 2024-09-14T11:11:17.225+0000 7fd456e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:11:17.580 INFO:tasks.workunit.client.0.smithi050.stderr: -454> 2024-09-14T11:11:17.225+0000 7fd456e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:11:17.580 INFO:tasks.workunit.client.0.smithi050.stderr: -453> 2024-09-14T11:11:17.225+0000 7fd569b3d640 10 monclient: get_auth_request con 0x7fd450077260 auth_method 0 2024-09-14T11:11:17.580 INFO:tasks.workunit.client.0.smithi050.stderr: -452> 2024-09-14T11:11:17.225+0000 7fd56ab3f640 10 monclient: get_auth_request con 0x55655a4d6b20 auth_method 0 2024-09-14T11:11:17.580 INFO:tasks.workunit.client.0.smithi050.stderr: -451> 2024-09-14T11:11:17.226+0000 7fd56a33e640 10 monclient: get_auth_request con 0x55655a4fb740 auth_method 0 2024-09-14T11:11:17.581 INFO:tasks.workunit.client.0.smithi050.stderr: -450> 2024-09-14T11:11:17.227+0000 7fd569b3d640 10 monclient: get_auth_request con 0x55655a4ffaa0 auth_method 0 2024-09-14T11:11:17.581 INFO:tasks.workunit.client.0.smithi050.stderr: -449> 2024-09-14T11:11:17.228+0000 7fd56e72c800 10 monclient: build_initial_monmap 2024-09-14T11:11:17.581 INFO:tasks.workunit.client.0.smithi050.stderr: -448> 2024-09-14T11:11:17.228+0000 7fd56e72c800 1 build_initial for_mkfs: 0 2024-09-14T11:11:17.581 INFO:tasks.workunit.client.0.smithi050.stderr: -447> 2024-09-14T11:11:17.228+0000 7fd56e72c800 10 monclient: monmap: 2024-09-14T11:11:17.581 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:11:17.581 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:11:17.581 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:11:17.581 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:11:17.581 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:11:17.581 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:17.581 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:11:17.581 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:11:17.581 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:11:17.581 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.582 INFO:tasks.workunit.client.0.smithi050.stderr: -446> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding auth protocol: cephx 2024-09-14T11:11:17.582 INFO:tasks.workunit.client.0.smithi050.stderr: -445> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding auth protocol: cephx 2024-09-14T11:11:17.582 INFO:tasks.workunit.client.0.smithi050.stderr: -444> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding auth protocol: cephx 2024-09-14T11:11:17.582 INFO:tasks.workunit.client.0.smithi050.stderr: -443> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding con mode: secure 2024-09-14T11:11:17.582 INFO:tasks.workunit.client.0.smithi050.stderr: -442> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding con mode: crc 2024-09-14T11:11:17.582 INFO:tasks.workunit.client.0.smithi050.stderr: -441> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding con mode: secure 2024-09-14T11:11:17.582 INFO:tasks.workunit.client.0.smithi050.stderr: -440> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding con mode: crc 2024-09-14T11:11:17.582 INFO:tasks.workunit.client.0.smithi050.stderr: -439> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding con mode: secure 2024-09-14T11:11:17.582 INFO:tasks.workunit.client.0.smithi050.stderr: -438> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding con mode: crc 2024-09-14T11:11:17.582 INFO:tasks.workunit.client.0.smithi050.stderr: -437> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding con mode: crc 2024-09-14T11:11:17.582 INFO:tasks.workunit.client.0.smithi050.stderr: -436> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding con mode: secure 2024-09-14T11:11:17.582 INFO:tasks.workunit.client.0.smithi050.stderr: -435> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding con mode: crc 2024-09-14T11:11:17.583 INFO:tasks.workunit.client.0.smithi050.stderr: -434> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding con mode: secure 2024-09-14T11:11:17.583 INFO:tasks.workunit.client.0.smithi050.stderr: -433> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding con mode: crc 2024-09-14T11:11:17.583 INFO:tasks.workunit.client.0.smithi050.stderr: -432> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a5049e0) adding con mode: secure 2024-09-14T11:11:17.583 INFO:tasks.workunit.client.0.smithi050.stderr: -431> 2024-09-14T11:11:17.228+0000 7fd56e72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:17.583 INFO:tasks.workunit.client.0.smithi050.stderr: -430> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command objecter_requests cmddesc objecter_requests hook 0x55655a507ef0 EEXIST 2024-09-14T11:11:17.583 INFO:tasks.workunit.client.0.smithi050.stderr: -429> 2024-09-14T11:11:17.228+0000 7fd56e72c800 10 monclient: init 2024-09-14T11:11:17.583 INFO:tasks.workunit.client.0.smithi050.stderr: -428> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding auth protocol: cephx 2024-09-14T11:11:17.583 INFO:tasks.workunit.client.0.smithi050.stderr: -427> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding auth protocol: cephx 2024-09-14T11:11:17.583 INFO:tasks.workunit.client.0.smithi050.stderr: -426> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding auth protocol: cephx 2024-09-14T11:11:17.583 INFO:tasks.workunit.client.0.smithi050.stderr: -425> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding con mode: secure 2024-09-14T11:11:17.583 INFO:tasks.workunit.client.0.smithi050.stderr: -424> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding con mode: crc 2024-09-14T11:11:17.583 INFO:tasks.workunit.client.0.smithi050.stderr: -423> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding con mode: secure 2024-09-14T11:11:17.583 INFO:tasks.workunit.client.0.smithi050.stderr: -422> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding con mode: crc 2024-09-14T11:11:17.583 INFO:tasks.workunit.client.0.smithi050.stderr: -421> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding con mode: secure 2024-09-14T11:11:17.584 INFO:tasks.workunit.client.0.smithi050.stderr: -420> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding con mode: crc 2024-09-14T11:11:17.584 INFO:tasks.workunit.client.0.smithi050.stderr: -419> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding con mode: crc 2024-09-14T11:11:17.584 INFO:tasks.workunit.client.0.smithi050.stderr: -418> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding con mode: secure 2024-09-14T11:11:17.584 INFO:tasks.workunit.client.0.smithi050.stderr: -417> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding con mode: crc 2024-09-14T11:11:17.584 INFO:tasks.workunit.client.0.smithi050.stderr: -416> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding con mode: secure 2024-09-14T11:11:17.584 INFO:tasks.workunit.client.0.smithi050.stderr: -415> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding con mode: crc 2024-09-14T11:11:17.584 INFO:tasks.workunit.client.0.smithi050.stderr: -414> 2024-09-14T11:11:17.228+0000 7fd56e72c800 5 AuthRegistry(0x55655a502fa8) adding con mode: secure 2024-09-14T11:11:17.584 INFO:tasks.workunit.client.0.smithi050.stderr: -413> 2024-09-14T11:11:17.229+0000 7fd56e72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:17.584 INFO:tasks.workunit.client.0.smithi050.stderr: -412> 2024-09-14T11:11:17.229+0000 7fd56e72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:17.584 INFO:tasks.workunit.client.0.smithi050.stderr: -411> 2024-09-14T11:11:17.229+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command rotate-key cmddesc rotate-key hook 0x55655a5030f0 EEXIST 2024-09-14T11:11:17.584 INFO:tasks.workunit.client.0.smithi050.stderr: -410> 2024-09-14T11:11:17.229+0000 7fd56e72c800 10 monclient: _reopen_session rank -1 2024-09-14T11:11:17.584 INFO:tasks.workunit.client.0.smithi050.stderr: -409> 2024-09-14T11:11:17.229+0000 7fd56e72c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:11:17.585 INFO:tasks.workunit.client.0.smithi050.stderr: -408> 2024-09-14T11:11:17.229+0000 7fd56e72c800 10 monclient(hunting): picked mon.noname-c con 0x55655a52c210 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:11:17.585 INFO:tasks.workunit.client.0.smithi050.stderr: -407> 2024-09-14T11:11:17.229+0000 7fd56e72c800 10 monclient(hunting): picked mon.noname-a con 0x55655a52c5f0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:11:17.585 INFO:tasks.workunit.client.0.smithi050.stderr: -406> 2024-09-14T11:11:17.229+0000 7fd56e72c800 10 monclient(hunting): picked mon.noname-b con 0x55655a52af20 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:11:17.585 INFO:tasks.workunit.client.0.smithi050.stderr: -405> 2024-09-14T11:11:17.229+0000 7fd56e72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:17.585 INFO:tasks.workunit.client.0.smithi050.stderr: -404> 2024-09-14T11:11:17.229+0000 7fd56e72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:17.585 INFO:tasks.workunit.client.0.smithi050.stderr: -403> 2024-09-14T11:11:17.229+0000 7fd56e72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:17.585 INFO:tasks.workunit.client.0.smithi050.stderr: -402> 2024-09-14T11:11:17.229+0000 7fd56e72c800 10 monclient(hunting): _renew_subs 2024-09-14T11:11:17.585 INFO:tasks.workunit.client.0.smithi050.stderr: -401> 2024-09-14T11:11:17.229+0000 7fd56e72c800 10 monclient(hunting): authenticate will time out at 2329.866503s 2024-09-14T11:11:17.585 INFO:tasks.workunit.client.0.smithi050.stderr: -400> 2024-09-14T11:11:17.229+0000 7fd56a33e640 10 monclient(hunting): get_auth_request con 0x55655a52c210 auth_method 0 2024-09-14T11:11:17.585 INFO:tasks.workunit.client.0.smithi050.stderr: -399> 2024-09-14T11:11:17.229+0000 7fd56a33e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:17.585 INFO:tasks.workunit.client.0.smithi050.stderr: -398> 2024-09-14T11:11:17.229+0000 7fd56a33e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:17.585 INFO:tasks.workunit.client.0.smithi050.stderr: -397> 2024-09-14T11:11:17.229+0000 7fd56a33e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:17.586 INFO:tasks.workunit.client.0.smithi050.stderr: -396> 2024-09-14T11:11:17.229+0000 7fd569b3d640 10 monclient(hunting): get_auth_request con 0x55655a52c5f0 auth_method 0 2024-09-14T11:11:17.586 INFO:tasks.workunit.client.0.smithi050.stderr: -395> 2024-09-14T11:11:17.229+0000 7fd569b3d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:17.586 INFO:tasks.workunit.client.0.smithi050.stderr: -394> 2024-09-14T11:11:17.229+0000 7fd569b3d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:17.586 INFO:tasks.workunit.client.0.smithi050.stderr: -393> 2024-09-14T11:11:17.229+0000 7fd569b3d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:17.586 INFO:tasks.workunit.client.0.smithi050.stderr: -392> 2024-09-14T11:11:17.229+0000 7fd56ab3f640 10 monclient(hunting): get_auth_request con 0x55655a52af20 auth_method 0 2024-09-14T11:11:17.586 INFO:tasks.workunit.client.0.smithi050.stderr: -391> 2024-09-14T11:11:17.229+0000 7fd56ab3f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:17.586 INFO:tasks.workunit.client.0.smithi050.stderr: -390> 2024-09-14T11:11:17.229+0000 7fd56ab3f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:17.586 INFO:tasks.workunit.client.0.smithi050.stderr: -389> 2024-09-14T11:11:17.229+0000 7fd56ab3f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:17.586 INFO:tasks.workunit.client.0.smithi050.stderr: -388> 2024-09-14T11:11:17.229+0000 7fd56a33e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:17.586 INFO:tasks.workunit.client.0.smithi050.stderr: -387> 2024-09-14T11:11:17.229+0000 7fd56a33e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:17.586 INFO:tasks.workunit.client.0.smithi050.stderr: -386> 2024-09-14T11:11:17.229+0000 7fd56a33e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:17.586 INFO:tasks.workunit.client.0.smithi050.stderr: -385> 2024-09-14T11:11:17.229+0000 7fd569b3d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:17.587 INFO:tasks.workunit.client.0.smithi050.stderr: -384> 2024-09-14T11:11:17.229+0000 7fd569b3d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:17.587 INFO:tasks.workunit.client.0.smithi050.stderr: -383> 2024-09-14T11:11:17.229+0000 7fd569b3d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:17.587 INFO:tasks.workunit.client.0.smithi050.stderr: -382> 2024-09-14T11:11:17.229+0000 7fd56ab3f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:17.587 INFO:tasks.workunit.client.0.smithi050.stderr: -381> 2024-09-14T11:11:17.229+0000 7fd56ab3f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:17.587 INFO:tasks.workunit.client.0.smithi050.stderr: -380> 2024-09-14T11:11:17.229+0000 7fd56ab3f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:17.587 INFO:tasks.workunit.client.0.smithi050.stderr: -379> 2024-09-14T11:11:17.229+0000 7fd56a33e640 10 monclient(hunting): handle_auth_done global_id 6725 payload 824 2024-09-14T11:11:17.587 INFO:tasks.workunit.client.0.smithi050.stderr: -378> 2024-09-14T11:11:17.229+0000 7fd56a33e640 10 monclient: _finish_hunting 0 2024-09-14T11:11:17.587 INFO:tasks.workunit.client.0.smithi050.stderr: -377> 2024-09-14T11:11:17.229+0000 7fd56a33e640 1 monclient: found mon.noname-c 2024-09-14T11:11:17.587 INFO:tasks.workunit.client.0.smithi050.stderr: -376> 2024-09-14T11:11:17.229+0000 7fd56a33e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:11:17.587 INFO:tasks.workunit.client.0.smithi050.stderr: -375> 2024-09-14T11:11:17.230+0000 7fd44ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:17.587 INFO:tasks.workunit.client.0.smithi050.stderr: -374> 2024-09-14T11:11:17.230+0000 7fd44ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:11:17.587 INFO:tasks.workunit.client.0.smithi050.stderr: -373> 2024-09-14T11:11:17.230+0000 7fd44ffff640 10 monclient: dump: 2024-09-14T11:11:17.588 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:17.588 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:17.588 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.588 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.588 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:17.588 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:17.588 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:17.588 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:17.588 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:17.588 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.588 INFO:tasks.workunit.client.0.smithi050.stderr: -372> 2024-09-14T11:11:17.230+0000 7fd44ffff640 10 monclient: _finish_auth 0 2024-09-14T11:11:17.588 INFO:tasks.workunit.client.0.smithi050.stderr: -371> 2024-09-14T11:11:17.230+0000 7fd44ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:11:17.589 INFO:tasks.workunit.client.0.smithi050.stderr: -370> 2024-09-14T11:11:17.230+0000 7fd56e72c800 5 monclient: authenticate success, global_id 6725 2024-09-14T11:11:17.589 INFO:tasks.workunit.client.0.smithi050.stderr: -369> 2024-09-14T11:11:17.230+0000 7fd56e72c800 10 monclient: _renew_subs 2024-09-14T11:11:17.589 INFO:tasks.workunit.client.0.smithi050.stderr: -368> 2024-09-14T11:11:17.230+0000 7fd56e72c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:11:17.589 INFO:tasks.workunit.client.0.smithi050.stderr: -367> 2024-09-14T11:11:17.230+0000 7fd44ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:11:17.589 INFO:tasks.workunit.client.0.smithi050.stderr: -366> 2024-09-14T11:11:17.230+0000 7fd44ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:17.589 INFO:tasks.workunit.client.0.smithi050.stderr: -365> 2024-09-14T11:11:17.230+0000 7fd44ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:11:17.589 INFO:tasks.workunit.client.0.smithi050.stderr: -364> 2024-09-14T11:11:17.230+0000 7fd44ffff640 10 monclient: dump: 2024-09-14T11:11:17.589 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:17.589 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:17.589 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.589 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.590 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:17.590 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:17.590 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:17.590 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:17.590 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:17.590 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.590 INFO:tasks.workunit.client.0.smithi050.stderr: -363> 2024-09-14T11:11:17.230+0000 7fd56e72c800 10 monclient: _renew_subs 2024-09-14T11:11:17.590 INFO:tasks.workunit.client.0.smithi050.stderr: -362> 2024-09-14T11:11:17.230+0000 7fd56e72c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:11:17.590 INFO:tasks.workunit.client.0.smithi050.stderr: -361> 2024-09-14T11:11:17.230+0000 7fd56b340640 4 set_mon_vals no callback set 2024-09-14T11:11:17.590 INFO:tasks.workunit.client.0.smithi050.stderr: -360> 2024-09-14T11:11:17.232+0000 7fd44ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:11:17.590 INFO:tasks.workunit.client.0.smithi050.stderr: -359> 2024-09-14T11:11:17.232+0000 7fd44ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:11:17.590 INFO:tasks.workunit.client.0.smithi050.stderr: -358> 2024-09-14T11:11:17.232+0000 7fd44ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:11:17.590 INFO:tasks.workunit.client.0.smithi050.stderr: -357> 2024-09-14T11:11:17.232+0000 7fd569b3d640 10 monclient: get_auth_request con 0x7fd444077140 auth_method 0 2024-09-14T11:11:17.590 INFO:tasks.workunit.client.0.smithi050.stderr: -356> 2024-09-14T11:11:17.232+0000 7fd56e72c800 10 monclient: get_monmap_and_config 2024-09-14T11:11:17.591 INFO:tasks.workunit.client.0.smithi050.stderr: -355> 2024-09-14T11:11:17.232+0000 7fd56e72c800 10 monclient: build_initial_monmap 2024-09-14T11:11:17.591 INFO:tasks.workunit.client.0.smithi050.stderr: -354> 2024-09-14T11:11:17.232+0000 7fd56e72c800 1 build_initial for_mkfs: 0 2024-09-14T11:11:17.591 INFO:tasks.workunit.client.0.smithi050.stderr: -353> 2024-09-14T11:11:17.232+0000 7fd56e72c800 10 monclient: monmap: 2024-09-14T11:11:17.591 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:11:17.591 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:11:17.591 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:11:17.591 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:11:17.591 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:11:17.591 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:17.591 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:11:17.591 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:11:17.591 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:11:17.591 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.592 INFO:tasks.workunit.client.0.smithi050.stderr: -352> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding auth protocol: cephx 2024-09-14T11:11:17.592 INFO:tasks.workunit.client.0.smithi050.stderr: -351> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding auth protocol: cephx 2024-09-14T11:11:17.592 INFO:tasks.workunit.client.0.smithi050.stderr: -350> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding auth protocol: cephx 2024-09-14T11:11:17.592 INFO:tasks.workunit.client.0.smithi050.stderr: -349> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding con mode: secure 2024-09-14T11:11:17.592 INFO:tasks.workunit.client.0.smithi050.stderr: -348> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding con mode: crc 2024-09-14T11:11:17.592 INFO:tasks.workunit.client.0.smithi050.stderr: -347> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding con mode: secure 2024-09-14T11:11:17.592 INFO:tasks.workunit.client.0.smithi050.stderr: -346> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding con mode: crc 2024-09-14T11:11:17.592 INFO:tasks.workunit.client.0.smithi050.stderr: -345> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding con mode: secure 2024-09-14T11:11:17.592 INFO:tasks.workunit.client.0.smithi050.stderr: -344> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding con mode: crc 2024-09-14T11:11:17.592 INFO:tasks.workunit.client.0.smithi050.stderr: -343> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding con mode: crc 2024-09-14T11:11:17.592 INFO:tasks.workunit.client.0.smithi050.stderr: -342> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding con mode: secure 2024-09-14T11:11:17.592 INFO:tasks.workunit.client.0.smithi050.stderr: -341> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding con mode: crc 2024-09-14T11:11:17.592 INFO:tasks.workunit.client.0.smithi050.stderr: -340> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding con mode: secure 2024-09-14T11:11:17.593 INFO:tasks.workunit.client.0.smithi050.stderr: -339> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding con mode: crc 2024-09-14T11:11:17.593 INFO:tasks.workunit.client.0.smithi050.stderr: -338> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x55655a54bc20) adding con mode: secure 2024-09-14T11:11:17.593 INFO:tasks.workunit.client.0.smithi050.stderr: -337> 2024-09-14T11:11:17.232+0000 7fd56e72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:17.593 INFO:tasks.workunit.client.0.smithi050.stderr: -336> 2024-09-14T11:11:17.232+0000 7fd56e72c800 10 monclient: init 2024-09-14T11:11:17.593 INFO:tasks.workunit.client.0.smithi050.stderr: -335> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding auth protocol: cephx 2024-09-14T11:11:17.593 INFO:tasks.workunit.client.0.smithi050.stderr: -334> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding auth protocol: cephx 2024-09-14T11:11:17.593 INFO:tasks.workunit.client.0.smithi050.stderr: -333> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding auth protocol: cephx 2024-09-14T11:11:17.593 INFO:tasks.workunit.client.0.smithi050.stderr: -332> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding con mode: secure 2024-09-14T11:11:17.593 INFO:tasks.workunit.client.0.smithi050.stderr: -331> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding con mode: crc 2024-09-14T11:11:17.593 INFO:tasks.workunit.client.0.smithi050.stderr: -330> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding con mode: secure 2024-09-14T11:11:17.593 INFO:tasks.workunit.client.0.smithi050.stderr: -329> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding con mode: crc 2024-09-14T11:11:17.593 INFO:tasks.workunit.client.0.smithi050.stderr: -328> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding con mode: secure 2024-09-14T11:11:17.593 INFO:tasks.workunit.client.0.smithi050.stderr: -327> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding con mode: crc 2024-09-14T11:11:17.594 INFO:tasks.workunit.client.0.smithi050.stderr: -326> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding con mode: crc 2024-09-14T11:11:17.594 INFO:tasks.workunit.client.0.smithi050.stderr: -325> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding con mode: secure 2024-09-14T11:11:17.594 INFO:tasks.workunit.client.0.smithi050.stderr: -324> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding con mode: crc 2024-09-14T11:11:17.594 INFO:tasks.workunit.client.0.smithi050.stderr: -323> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding con mode: secure 2024-09-14T11:11:17.594 INFO:tasks.workunit.client.0.smithi050.stderr: -322> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding con mode: crc 2024-09-14T11:11:17.594 INFO:tasks.workunit.client.0.smithi050.stderr: -321> 2024-09-14T11:11:17.232+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830dee40) adding con mode: secure 2024-09-14T11:11:17.594 INFO:tasks.workunit.client.0.smithi050.stderr: -320> 2024-09-14T11:11:17.233+0000 7fd56e72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:17.594 INFO:tasks.workunit.client.0.smithi050.stderr: -319> 2024-09-14T11:11:17.233+0000 7fd56e72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:17.594 INFO:tasks.workunit.client.0.smithi050.stderr: -318> 2024-09-14T11:11:17.233+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command rotate-key cmddesc rotate-key hook 0x7ffc830def88 EEXIST 2024-09-14T11:11:17.594 INFO:tasks.workunit.client.0.smithi050.stderr: -317> 2024-09-14T11:11:17.233+0000 7fd56e72c800 10 monclient: _reopen_session rank -1 2024-09-14T11:11:17.594 INFO:tasks.workunit.client.0.smithi050.stderr: -316> 2024-09-14T11:11:17.233+0000 7fd56e72c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:11:17.594 INFO:tasks.workunit.client.0.smithi050.stderr: -315> 2024-09-14T11:11:17.233+0000 7fd56e72c800 10 monclient(hunting): picked mon.noname-a con 0x55655a5802a0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:11:17.594 INFO:tasks.workunit.client.0.smithi050.stderr: -314> 2024-09-14T11:11:17.233+0000 7fd56e72c800 10 monclient(hunting): picked mon.noname-c con 0x55655a5511f0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:11:17.594 INFO:tasks.workunit.client.0.smithi050.stderr: -313> 2024-09-14T11:11:17.233+0000 7fd56e72c800 10 monclient(hunting): picked mon.noname-b con 0x55655a57bb40 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:11:17.595 INFO:tasks.workunit.client.0.smithi050.stderr: -312> 2024-09-14T11:11:17.233+0000 7fd56e72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:17.595 INFO:tasks.workunit.client.0.smithi050.stderr: -311> 2024-09-14T11:11:17.233+0000 7fd56e72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:17.595 INFO:tasks.workunit.client.0.smithi050.stderr: -310> 2024-09-14T11:11:17.233+0000 7fd56e72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:17.595 INFO:tasks.workunit.client.0.smithi050.stderr: -309> 2024-09-14T11:11:17.233+0000 7fd56e72c800 10 monclient(hunting): _renew_subs 2024-09-14T11:11:17.595 INFO:tasks.workunit.client.0.smithi050.stderr: -308> 2024-09-14T11:11:17.233+0000 7fd56e72c800 10 monclient(hunting): authenticate will time out at 2329.870432s 2024-09-14T11:11:17.595 INFO:tasks.workunit.client.0.smithi050.stderr: -307> 2024-09-14T11:11:17.233+0000 7fd56a33e640 10 monclient(hunting): get_auth_request con 0x55655a5802a0 auth_method 0 2024-09-14T11:11:17.595 INFO:tasks.workunit.client.0.smithi050.stderr: -306> 2024-09-14T11:11:17.233+0000 7fd56a33e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:17.595 INFO:tasks.workunit.client.0.smithi050.stderr: -305> 2024-09-14T11:11:17.233+0000 7fd56a33e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:17.595 INFO:tasks.workunit.client.0.smithi050.stderr: -304> 2024-09-14T11:11:17.233+0000 7fd56a33e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:17.595 INFO:tasks.workunit.client.0.smithi050.stderr: -303> 2024-09-14T11:11:17.233+0000 7fd569b3d640 10 monclient(hunting): get_auth_request con 0x55655a5511f0 auth_method 0 2024-09-14T11:11:17.595 INFO:tasks.workunit.client.0.smithi050.stderr: -302> 2024-09-14T11:11:17.233+0000 7fd569b3d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:17.595 INFO:tasks.workunit.client.0.smithi050.stderr: -301> 2024-09-14T11:11:17.233+0000 7fd569b3d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:17.595 INFO:tasks.workunit.client.0.smithi050.stderr: -300> 2024-09-14T11:11:17.233+0000 7fd569b3d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:17.595 INFO:tasks.workunit.client.0.smithi050.stderr: -299> 2024-09-14T11:11:17.233+0000 7fd56ab3f640 10 monclient(hunting): get_auth_request con 0x55655a57bb40 auth_method 0 2024-09-14T11:11:17.596 INFO:tasks.workunit.client.0.smithi050.stderr: -298> 2024-09-14T11:11:17.233+0000 7fd56ab3f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:17.596 INFO:tasks.workunit.client.0.smithi050.stderr: -297> 2024-09-14T11:11:17.233+0000 7fd56ab3f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:17.596 INFO:tasks.workunit.client.0.smithi050.stderr: -296> 2024-09-14T11:11:17.233+0000 7fd56ab3f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:17.596 INFO:tasks.workunit.client.0.smithi050.stderr: -295> 2024-09-14T11:11:17.233+0000 7fd56a33e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:17.596 INFO:tasks.workunit.client.0.smithi050.stderr: -294> 2024-09-14T11:11:17.233+0000 7fd56a33e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:17.596 INFO:tasks.workunit.client.0.smithi050.stderr: -293> 2024-09-14T11:11:17.233+0000 7fd56a33e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:17.596 INFO:tasks.workunit.client.0.smithi050.stderr: -292> 2024-09-14T11:11:17.233+0000 7fd569b3d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:17.596 INFO:tasks.workunit.client.0.smithi050.stderr: -291> 2024-09-14T11:11:17.233+0000 7fd569b3d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:17.596 INFO:tasks.workunit.client.0.smithi050.stderr: -290> 2024-09-14T11:11:17.233+0000 7fd569b3d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:17.596 INFO:tasks.workunit.client.0.smithi050.stderr: -289> 2024-09-14T11:11:17.233+0000 7fd56ab3f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:17.596 INFO:tasks.workunit.client.0.smithi050.stderr: -288> 2024-09-14T11:11:17.233+0000 7fd56ab3f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:17.596 INFO:tasks.workunit.client.0.smithi050.stderr: -287> 2024-09-14T11:11:17.233+0000 7fd56ab3f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:17.596 INFO:tasks.workunit.client.0.smithi050.stderr: -286> 2024-09-14T11:11:17.233+0000 7fd56a33e640 10 monclient(hunting): handle_auth_done global_id 7146 payload 274 2024-09-14T11:11:17.596 INFO:tasks.workunit.client.0.smithi050.stderr: -285> 2024-09-14T11:11:17.233+0000 7fd56a33e640 10 monclient: _finish_hunting 0 2024-09-14T11:11:17.596 INFO:tasks.workunit.client.0.smithi050.stderr: -284> 2024-09-14T11:11:17.233+0000 7fd56a33e640 1 monclient: found mon.noname-a 2024-09-14T11:11:17.597 INFO:tasks.workunit.client.0.smithi050.stderr: -283> 2024-09-14T11:11:17.233+0000 7fd56a33e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:11:17.597 INFO:tasks.workunit.client.0.smithi050.stderr: -282> 2024-09-14T11:11:17.234+0000 7fd44dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:17.597 INFO:tasks.workunit.client.0.smithi050.stderr: -281> 2024-09-14T11:11:17.234+0000 7fd44dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:11:17.597 INFO:tasks.workunit.client.0.smithi050.stderr: -280> 2024-09-14T11:11:17.234+0000 7fd44dffb640 10 monclient: dump: 2024-09-14T11:11:17.597 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:17.597 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:17.597 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.597 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.597 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:17.597 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:17.597 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:17.597 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:17.597 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:17.597 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.598 INFO:tasks.workunit.client.0.smithi050.stderr: -279> 2024-09-14T11:11:17.234+0000 7fd44dffb640 10 monclient: _finish_auth 0 2024-09-14T11:11:17.598 INFO:tasks.workunit.client.0.smithi050.stderr: -278> 2024-09-14T11:11:17.234+0000 7fd44dffb640 10 monclient: _check_auth_tickets 2024-09-14T11:11:17.598 INFO:tasks.workunit.client.0.smithi050.stderr: -277> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 monclient: authenticate success, global_id 7146 2024-09-14T11:11:17.598 INFO:tasks.workunit.client.0.smithi050.stderr: -276> 2024-09-14T11:11:17.234+0000 7fd44dffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:11:17.598 INFO:tasks.workunit.client.0.smithi050.stderr: -275> 2024-09-14T11:11:17.234+0000 7fd56e72c800 10 monclient: get_monmap_and_config success 2024-09-14T11:11:17.598 INFO:tasks.workunit.client.0.smithi050.stderr: -274> 2024-09-14T11:11:17.234+0000 7fd56e72c800 4 set_mon_vals no callback set 2024-09-14T11:11:17.598 INFO:tasks.workunit.client.0.smithi050.stderr: -273> 2024-09-14T11:11:17.234+0000 7fd44dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:17.598 INFO:tasks.workunit.client.0.smithi050.stderr: -272> 2024-09-14T11:11:17.234+0000 7fd44dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:11:17.598 INFO:tasks.workunit.client.0.smithi050.stderr: -271> 2024-09-14T11:11:17.234+0000 7fd44dffb640 10 monclient: dump: 2024-09-14T11:11:17.598 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:17.598 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:17.598 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.598 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.598 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:17.599 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:17.599 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:17.599 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:17.599 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:17.599 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.599 INFO:tasks.workunit.client.0.smithi050.stderr: -270> 2024-09-14T11:11:17.234+0000 7fd56e72c800 10 monclient: shutdown 2024-09-14T11:11:17.599 INFO:tasks.workunit.client.0.smithi050.stderr: -269> 2024-09-14T11:11:17.234+0000 7fd56e72c800 10 monclient: build_initial_monmap 2024-09-14T11:11:17.599 INFO:tasks.workunit.client.0.smithi050.stderr: -268> 2024-09-14T11:11:17.234+0000 7fd56e72c800 1 build_initial for_mkfs: 0 2024-09-14T11:11:17.599 INFO:tasks.workunit.client.0.smithi050.stderr: -267> 2024-09-14T11:11:17.234+0000 7fd56e72c800 10 monclient: monmap: 2024-09-14T11:11:17.599 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:11:17.599 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:11:17.599 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:11:17.599 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:11:17.600 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:11:17.600 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:17.600 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:11:17.600 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:11:17.600 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:11:17.600 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.600 INFO:tasks.workunit.client.0.smithi050.stderr: -266> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding auth protocol: cephx 2024-09-14T11:11:17.600 INFO:tasks.workunit.client.0.smithi050.stderr: -265> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding auth protocol: cephx 2024-09-14T11:11:17.600 INFO:tasks.workunit.client.0.smithi050.stderr: -264> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding auth protocol: cephx 2024-09-14T11:11:17.600 INFO:tasks.workunit.client.0.smithi050.stderr: -263> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding con mode: secure 2024-09-14T11:11:17.600 INFO:tasks.workunit.client.0.smithi050.stderr: -262> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding con mode: crc 2024-09-14T11:11:17.600 INFO:tasks.workunit.client.0.smithi050.stderr: -261> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding con mode: secure 2024-09-14T11:11:17.600 INFO:tasks.workunit.client.0.smithi050.stderr: -260> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding con mode: crc 2024-09-14T11:11:17.601 INFO:tasks.workunit.client.0.smithi050.stderr: -259> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding con mode: secure 2024-09-14T11:11:17.601 INFO:tasks.workunit.client.0.smithi050.stderr: -258> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding con mode: crc 2024-09-14T11:11:17.601 INFO:tasks.workunit.client.0.smithi050.stderr: -257> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding con mode: crc 2024-09-14T11:11:17.601 INFO:tasks.workunit.client.0.smithi050.stderr: -256> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding con mode: secure 2024-09-14T11:11:17.601 INFO:tasks.workunit.client.0.smithi050.stderr: -255> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding con mode: crc 2024-09-14T11:11:17.601 INFO:tasks.workunit.client.0.smithi050.stderr: -254> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding con mode: secure 2024-09-14T11:11:17.601 INFO:tasks.workunit.client.0.smithi050.stderr: -253> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding con mode: crc 2024-09-14T11:11:17.601 INFO:tasks.workunit.client.0.smithi050.stderr: -252> 2024-09-14T11:11:17.234+0000 7fd56e72c800 5 AuthRegistry(0x55655a571e70) adding con mode: secure 2024-09-14T11:11:17.601 INFO:tasks.workunit.client.0.smithi050.stderr: -251> 2024-09-14T11:11:17.234+0000 7fd56e72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:17.601 INFO:tasks.workunit.client.0.smithi050.stderr: -250> 2024-09-14T11:11:17.234+0000 7fd56e72c800 1 librados: starting msgr at 2024-09-14T11:11:17.601 INFO:tasks.workunit.client.0.smithi050.stderr: -249> 2024-09-14T11:11:17.234+0000 7fd56e72c800 1 librados: starting objecter 2024-09-14T11:11:17.601 INFO:tasks.workunit.client.0.smithi050.stderr: -248> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command objecter_requests cmddesc objecter_requests hook 0x55655a52a650 EEXIST 2024-09-14T11:11:17.602 INFO:tasks.workunit.client.0.smithi050.stderr: -247> 2024-09-14T11:11:17.235+0000 7fd56e72c800 1 librados: setting wanted keys 2024-09-14T11:11:17.602 INFO:tasks.workunit.client.0.smithi050.stderr: -246> 2024-09-14T11:11:17.235+0000 7fd56e72c800 1 librados: calling monclient init 2024-09-14T11:11:17.602 INFO:tasks.workunit.client.0.smithi050.stderr: -245> 2024-09-14T11:11:17.235+0000 7fd56e72c800 10 monclient: init 2024-09-14T11:11:17.602 INFO:tasks.workunit.client.0.smithi050.stderr: -244> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding auth protocol: cephx 2024-09-14T11:11:17.602 INFO:tasks.workunit.client.0.smithi050.stderr: -243> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding auth protocol: cephx 2024-09-14T11:11:17.602 INFO:tasks.workunit.client.0.smithi050.stderr: -242> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding auth protocol: cephx 2024-09-14T11:11:17.602 INFO:tasks.workunit.client.0.smithi050.stderr: -241> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding con mode: secure 2024-09-14T11:11:17.602 INFO:tasks.workunit.client.0.smithi050.stderr: -240> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding con mode: crc 2024-09-14T11:11:17.602 INFO:tasks.workunit.client.0.smithi050.stderr: -239> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding con mode: secure 2024-09-14T11:11:17.602 INFO:tasks.workunit.client.0.smithi050.stderr: -238> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding con mode: crc 2024-09-14T11:11:17.602 INFO:tasks.workunit.client.0.smithi050.stderr: -237> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding con mode: secure 2024-09-14T11:11:17.602 INFO:tasks.workunit.client.0.smithi050.stderr: -236> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding con mode: crc 2024-09-14T11:11:17.602 INFO:tasks.workunit.client.0.smithi050.stderr: -235> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding con mode: crc 2024-09-14T11:11:17.602 INFO:tasks.workunit.client.0.smithi050.stderr: -234> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding con mode: secure 2024-09-14T11:11:17.603 INFO:tasks.workunit.client.0.smithi050.stderr: -233> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding con mode: crc 2024-09-14T11:11:17.603 INFO:tasks.workunit.client.0.smithi050.stderr: -232> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding con mode: secure 2024-09-14T11:11:17.603 INFO:tasks.workunit.client.0.smithi050.stderr: -231> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding con mode: crc 2024-09-14T11:11:17.603 INFO:tasks.workunit.client.0.smithi050.stderr: -230> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 AuthRegistry(0x55655a540ad0) adding con mode: secure 2024-09-14T11:11:17.603 INFO:tasks.workunit.client.0.smithi050.stderr: -229> 2024-09-14T11:11:17.235+0000 7fd56e72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:17.603 INFO:tasks.workunit.client.0.smithi050.stderr: -228> 2024-09-14T11:11:17.235+0000 7fd56e72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:17.603 INFO:tasks.workunit.client.0.smithi050.stderr: -227> 2024-09-14T11:11:17.235+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command rotate-key cmddesc rotate-key hook 0x55655a540c18 EEXIST 2024-09-14T11:11:17.603 INFO:tasks.workunit.client.0.smithi050.stderr: -226> 2024-09-14T11:11:17.235+0000 7fd56e72c800 10 monclient: _reopen_session rank -1 2024-09-14T11:11:17.603 INFO:tasks.workunit.client.0.smithi050.stderr: -225> 2024-09-14T11:11:17.235+0000 7fd56e72c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:11:17.603 INFO:tasks.workunit.client.0.smithi050.stderr: -224> 2024-09-14T11:11:17.235+0000 7fd56e72c800 10 monclient(hunting): picked mon.noname-a con 0x55655a5511f0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:11:17.603 INFO:tasks.workunit.client.0.smithi050.stderr: -223> 2024-09-14T11:11:17.235+0000 7fd56e72c800 10 monclient(hunting): picked mon.noname-c con 0x55655a57bb40 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:11:17.603 INFO:tasks.workunit.client.0.smithi050.stderr: -222> 2024-09-14T11:11:17.235+0000 7fd56e72c800 10 monclient(hunting): picked mon.noname-b con 0x55655a5802a0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:11:17.603 INFO:tasks.workunit.client.0.smithi050.stderr: -221> 2024-09-14T11:11:17.235+0000 7fd56e72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:17.603 INFO:tasks.workunit.client.0.smithi050.stderr: -220> 2024-09-14T11:11:17.235+0000 7fd56e72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:17.604 INFO:tasks.workunit.client.0.smithi050.stderr: -219> 2024-09-14T11:11:17.235+0000 7fd56e72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:17.604 INFO:tasks.workunit.client.0.smithi050.stderr: -218> 2024-09-14T11:11:17.235+0000 7fd56e72c800 10 monclient(hunting): _renew_subs 2024-09-14T11:11:17.604 INFO:tasks.workunit.client.0.smithi050.stderr: -217> 2024-09-14T11:11:17.235+0000 7fd56e72c800 10 monclient(hunting): authenticate will time out at 2329.872660s 2024-09-14T11:11:17.604 INFO:tasks.workunit.client.0.smithi050.stderr: -216> 2024-09-14T11:11:17.235+0000 7fd56a33e640 10 monclient(hunting): get_auth_request con 0x55655a5511f0 auth_method 0 2024-09-14T11:11:17.604 INFO:tasks.workunit.client.0.smithi050.stderr: -215> 2024-09-14T11:11:17.235+0000 7fd56a33e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:17.604 INFO:tasks.workunit.client.0.smithi050.stderr: -214> 2024-09-14T11:11:17.235+0000 7fd56a33e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:17.604 INFO:tasks.workunit.client.0.smithi050.stderr: -213> 2024-09-14T11:11:17.235+0000 7fd56a33e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:17.604 INFO:tasks.workunit.client.0.smithi050.stderr: -212> 2024-09-14T11:11:17.235+0000 7fd569b3d640 10 monclient(hunting): get_auth_request con 0x55655a57bb40 auth_method 0 2024-09-14T11:11:17.604 INFO:tasks.workunit.client.0.smithi050.stderr: -211> 2024-09-14T11:11:17.235+0000 7fd569b3d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:17.604 INFO:tasks.workunit.client.0.smithi050.stderr: -210> 2024-09-14T11:11:17.235+0000 7fd569b3d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:17.604 INFO:tasks.workunit.client.0.smithi050.stderr: -209> 2024-09-14T11:11:17.235+0000 7fd569b3d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:17.604 INFO:tasks.workunit.client.0.smithi050.stderr: -208> 2024-09-14T11:11:17.235+0000 7fd56a33e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:17.604 INFO:tasks.workunit.client.0.smithi050.stderr: -207> 2024-09-14T11:11:17.235+0000 7fd56a33e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:17.605 INFO:tasks.workunit.client.0.smithi050.stderr: -206> 2024-09-14T11:11:17.235+0000 7fd56a33e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:17.605 INFO:tasks.workunit.client.0.smithi050.stderr: -205> 2024-09-14T11:11:17.235+0000 7fd56ab3f640 10 monclient(hunting): get_auth_request con 0x55655a5802a0 auth_method 0 2024-09-14T11:11:17.605 INFO:tasks.workunit.client.0.smithi050.stderr: -204> 2024-09-14T11:11:17.235+0000 7fd56ab3f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:17.605 INFO:tasks.workunit.client.0.smithi050.stderr: -203> 2024-09-14T11:11:17.235+0000 7fd56ab3f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:17.605 INFO:tasks.workunit.client.0.smithi050.stderr: -202> 2024-09-14T11:11:17.235+0000 7fd56ab3f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:17.605 INFO:tasks.workunit.client.0.smithi050.stderr: -201> 2024-09-14T11:11:17.235+0000 7fd569b3d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:17.605 INFO:tasks.workunit.client.0.smithi050.stderr: -200> 2024-09-14T11:11:17.235+0000 7fd569b3d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:17.605 INFO:tasks.workunit.client.0.smithi050.stderr: -199> 2024-09-14T11:11:17.235+0000 7fd569b3d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:17.605 INFO:tasks.workunit.client.0.smithi050.stderr: -198> 2024-09-14T11:11:17.235+0000 7fd56ab3f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:17.605 INFO:tasks.workunit.client.0.smithi050.stderr: -197> 2024-09-14T11:11:17.235+0000 7fd56ab3f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:17.605 INFO:tasks.workunit.client.0.smithi050.stderr: -196> 2024-09-14T11:11:17.235+0000 7fd56ab3f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:17.605 INFO:tasks.workunit.client.0.smithi050.stderr: -195> 2024-09-14T11:11:17.235+0000 7fd56a33e640 10 monclient(hunting): handle_auth_done global_id 7149 payload 824 2024-09-14T11:11:17.605 INFO:tasks.workunit.client.0.smithi050.stderr: -194> 2024-09-14T11:11:17.235+0000 7fd56a33e640 10 monclient: _finish_hunting 0 2024-09-14T11:11:17.606 INFO:tasks.workunit.client.0.smithi050.stderr: -193> 2024-09-14T11:11:17.235+0000 7fd56a33e640 1 monclient: found mon.noname-a 2024-09-14T11:11:17.606 INFO:tasks.workunit.client.0.smithi050.stderr: -192> 2024-09-14T11:11:17.235+0000 7fd56a33e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:11:17.606 INFO:tasks.workunit.client.0.smithi050.stderr: -191> 2024-09-14T11:11:17.236+0000 7fd43bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:17.606 INFO:tasks.workunit.client.0.smithi050.stderr: -190> 2024-09-14T11:11:17.236+0000 7fd43bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:11:17.606 INFO:tasks.workunit.client.0.smithi050.stderr: -189> 2024-09-14T11:11:17.236+0000 7fd43bfff640 10 monclient: dump: 2024-09-14T11:11:17.606 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:17.606 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:17.606 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.606 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.606 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:17.606 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:17.606 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:17.606 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:17.606 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:17.607 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.607 INFO:tasks.workunit.client.0.smithi050.stderr: -188> 2024-09-14T11:11:17.236+0000 7fd43bfff640 10 monclient: _finish_auth 0 2024-09-14T11:11:17.607 INFO:tasks.workunit.client.0.smithi050.stderr: -187> 2024-09-14T11:11:17.236+0000 7fd43bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:11:17.607 INFO:tasks.workunit.client.0.smithi050.stderr: -186> 2024-09-14T11:11:17.236+0000 7fd43bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:11:17.607 INFO:tasks.workunit.client.0.smithi050.stderr: -185> 2024-09-14T11:11:17.236+0000 7fd43bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:17.607 INFO:tasks.workunit.client.0.smithi050.stderr: -184> 2024-09-14T11:11:17.236+0000 7fd43bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:11:17.607 INFO:tasks.workunit.client.0.smithi050.stderr: -183> 2024-09-14T11:11:17.236+0000 7fd43bfff640 10 monclient: dump: 2024-09-14T11:11:17.607 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:17.607 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:17.607 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.607 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:17.607 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:17.607 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:17.608 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:17.608 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:17.608 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:17.608 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.608 INFO:tasks.workunit.client.0.smithi050.stderr: -182> 2024-09-14T11:11:17.236+0000 7fd56e72c800 5 monclient: authenticate success, global_id 7149 2024-09-14T11:11:17.608 INFO:tasks.workunit.client.0.smithi050.stderr: -181> 2024-09-14T11:11:17.236+0000 7fd44dffb640 4 set_mon_vals no callback set 2024-09-14T11:11:17.608 INFO:tasks.workunit.client.0.smithi050.stderr: -180> 2024-09-14T11:11:17.236+0000 7fd56e72c800 10 monclient: _renew_subs 2024-09-14T11:11:17.608 INFO:tasks.workunit.client.0.smithi050.stderr: -179> 2024-09-14T11:11:17.236+0000 7fd56e72c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:11:17.608 INFO:tasks.workunit.client.0.smithi050.stderr: -178> 2024-09-14T11:11:17.236+0000 7fd56e72c800 10 monclient: _renew_subs 2024-09-14T11:11:17.608 INFO:tasks.workunit.client.0.smithi050.stderr: -177> 2024-09-14T11:11:17.236+0000 7fd56e72c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:11:17.608 INFO:tasks.workunit.client.0.smithi050.stderr: -176> 2024-09-14T11:11:17.236+0000 7fd56e72c800 1 librados: init done 2024-09-14T11:11:17.608 INFO:tasks.workunit.client.0.smithi050.stderr: -175> 2024-09-14T11:11:17.236+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command cr dump hook 0x55655a54fca8 2024-09-14T11:11:17.608 INFO:tasks.workunit.client.0.smithi050.stderr: -174> 2024-09-14T11:11:17.237+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.609 INFO:tasks.workunit.client.0.smithi050.stderr: -173> 2024-09-14T11:11:17.238+0000 7fd43bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:11:17.609 INFO:tasks.workunit.client.0.smithi050.stderr: -172> 2024-09-14T11:11:17.238+0000 7fd43bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:11:17.609 INFO:tasks.workunit.client.0.smithi050.stderr: -171> 2024-09-14T11:11:17.238+0000 7fd43bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:11:17.609 INFO:tasks.workunit.client.0.smithi050.stderr: -170> 2024-09-14T11:11:17.238+0000 7fd569b3d640 10 monclient: get_auth_request con 0x7fd434077230 auth_method 0 2024-09-14T11:11:17.609 INFO:tasks.workunit.client.0.smithi050.stderr: -169> 2024-09-14T11:11:17.238+0000 7fd56ab3f640 10 monclient: get_auth_request con 0x55655a5999e0 auth_method 0 2024-09-14T11:11:17.609 INFO:tasks.workunit.client.0.smithi050.stderr: -168> 2024-09-14T11:11:17.239+0000 7fd56e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.609 INFO:tasks.workunit.client.0.smithi050.stderr: -167> 2024-09-14T11:11:17.239+0000 7fd56e72c800 20 realm 2024-09-14T11:11:17.609 INFO:tasks.workunit.client.0.smithi050.stderr: -166> 2024-09-14T11:11:17.239+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.609 INFO:tasks.workunit.client.0.smithi050.stderr: -165> 2024-09-14T11:11:17.239+0000 7fd56e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.609 INFO:tasks.workunit.client.0.smithi050.stderr: -164> 2024-09-14T11:11:17.239+0000 7fd56e72c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:17.609 INFO:tasks.workunit.client.0.smithi050.stderr: -163> 2024-09-14T11:11:17.239+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.609 INFO:tasks.workunit.client.0.smithi050.stderr: -162> 2024-09-14T11:11:17.239+0000 7fd56e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.610 INFO:tasks.workunit.client.0.smithi050.stderr: -161> 2024-09-14T11:11:17.239+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.610 INFO:tasks.workunit.client.0.smithi050.stderr: -160> 2024-09-14T11:11:17.240+0000 7fd56a33e640 10 monclient: get_auth_request con 0x55655a59dc30 auth_method 0 2024-09-14T11:11:17.610 INFO:tasks.workunit.client.0.smithi050.stderr: -159> 2024-09-14T11:11:17.240+0000 7fd56e72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:17.610 INFO:tasks.workunit.client.0.smithi050.stderr: -158> 2024-09-14T11:11:17.240+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.610 INFO:tasks.workunit.client.0.smithi050.stderr: -157> 2024-09-14T11:11:17.240+0000 7fd569b3d640 10 monclient: get_auth_request con 0x55655a5a14b0 auth_method 0 2024-09-14T11:11:17.610 INFO:tasks.workunit.client.0.smithi050.stderr: -156> 2024-09-14T11:11:17.241+0000 7fd56e72c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:17.610 INFO:tasks.workunit.client.0.smithi050.stderr: -155> 2024-09-14T11:11:17.241+0000 7fd56e72c800 20 searching for the correct realm 2024-09-14T11:11:17.610 INFO:tasks.workunit.client.0.smithi050.stderr: -154> 2024-09-14T11:11:17.241+0000 7fd56ab3f640 10 monclient: get_auth_request con 0x55655a5a6280 auth_method 0 2024-09-14T11:11:17.610 INFO:tasks.workunit.client.0.smithi050.stderr: -153> 2024-09-14T11:11:17.242+0000 7fd56a33e640 10 monclient: get_auth_request con 0x7fd56403a410 auth_method 0 2024-09-14T11:11:17.610 INFO:tasks.workunit.client.0.smithi050.stderr: -152> 2024-09-14T11:11:17.244+0000 7fd569b3d640 10 monclient: get_auth_request con 0x7fd56402c920 auth_method 0 2024-09-14T11:11:17.610 INFO:tasks.workunit.client.0.smithi050.stderr: -151> 2024-09-14T11:11:17.244+0000 7fd569b3d640 0 -- 172.21.15.50:0/3410983899 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fd56402c920 msgr2=0x7fd564017400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:17.610 INFO:tasks.workunit.client.0.smithi050.stderr: -150> 2024-09-14T11:11:17.446+0000 7fd569b3d640 10 monclient: get_auth_request con 0x7fd56402c920 auth_method 0 2024-09-14T11:11:17.610 INFO:tasks.workunit.client.0.smithi050.stderr: -149> 2024-09-14T11:11:17.448+0000 7fd56ab3f640 10 monclient: get_auth_request con 0x7fd55c06b020 auth_method 0 2024-09-14T11:11:17.611 INFO:tasks.workunit.client.0.smithi050.stderr: -148> 2024-09-14T11:11:17.449+0000 7fd56a33e640 10 monclient: get_auth_request con 0x7fd564048960 auth_method 0 2024-09-14T11:11:17.611 INFO:tasks.workunit.client.0.smithi050.stderr: -147> 2024-09-14T11:11:17.450+0000 7fd56ab3f640 0 -- 172.21.15.50:0/3410983899 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55655a5999e0 msgr2=0x55655a59bea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:17.611 INFO:tasks.workunit.client.0.smithi050.stderr: -146> 2024-09-14T11:11:17.450+0000 7fd43bfff640 1 client.7149.objecter ms_handle_reset 0x55655a5999e0 session 0x55655a599310 osd.6 2024-09-14T11:11:17.611 INFO:tasks.workunit.client.0.smithi050.stderr: -145> 2024-09-14T11:11:17.450+0000 7fd43bfff640 10 monclient: _renew_subs 2024-09-14T11:11:17.611 INFO:tasks.workunit.client.0.smithi050.stderr: -144> 2024-09-14T11:11:17.450+0000 7fd43bfff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:11:17.611 INFO:tasks.workunit.client.0.smithi050.stderr: -143> 2024-09-14T11:11:17.450+0000 7fd56ab3f640 10 monclient: get_auth_request con 0x7fd4340874e0 auth_method 0 2024-09-14T11:11:17.611 INFO:tasks.workunit.client.0.smithi050.stderr: -142> 2024-09-14T11:11:17.454+0000 7fd56e72c800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:17.611 INFO:tasks.workunit.client.0.smithi050.stderr: -141> 2024-09-14T11:11:17.454+0000 7fd56e72c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:17.611 INFO:tasks.workunit.client.0.smithi050.stderr: -140> 2024-09-14T11:11:17.454+0000 7fd56e72c800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:17.611 INFO:tasks.workunit.client.0.smithi050.stderr: -139> 2024-09-14T11:11:17.454+0000 7fd56e72c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:17.611 INFO:tasks.workunit.client.0.smithi050.stderr: -138> 2024-09-14T11:11:17.454+0000 7fd56e72c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:17.611 INFO:tasks.workunit.client.0.smithi050.stderr: -137> 2024-09-14T11:11:17.454+0000 7fd56e72c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:17.612 INFO:tasks.workunit.client.0.smithi050.stderr: -136> 2024-09-14T11:11:17.454+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.612 INFO:tasks.workunit.client.0.smithi050.stderr: -135> 2024-09-14T11:11:17.454+0000 7fd56e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.612 INFO:tasks.workunit.client.0.smithi050.stderr: -134> 2024-09-14T11:11:17.454+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.612 INFO:tasks.workunit.client.0.smithi050.stderr: -133> 2024-09-14T11:11:17.454+0000 7fd56e72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:17.612 INFO:tasks.workunit.client.0.smithi050.stderr: -132> 2024-09-14T11:11:17.454+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.612 INFO:tasks.workunit.client.0.smithi050.stderr: -131> 2024-09-14T11:11:17.455+0000 7fd56e72c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:17.612 INFO:tasks.workunit.client.0.smithi050.stderr: -130> 2024-09-14T11:11:17.455+0000 7fd56e72c800 20 zone default found 2024-09-14T11:11:17.612 INFO:tasks.workunit.client.0.smithi050.stderr: -129> 2024-09-14T11:11:17.455+0000 7fd56e72c800 4 Realm: () 2024-09-14T11:11:17.612 INFO:tasks.workunit.client.0.smithi050.stderr: -128> 2024-09-14T11:11:17.455+0000 7fd56e72c800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:17.612 INFO:tasks.workunit.client.0.smithi050.stderr: -127> 2024-09-14T11:11:17.455+0000 7fd56e72c800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:17.612 INFO:tasks.workunit.client.0.smithi050.stderr: -126> 2024-09-14T11:11:17.455+0000 7fd56e72c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:17.612 INFO:tasks.workunit.client.0.smithi050.stderr: -125> 2024-09-14T11:11:17.455+0000 7fd56e72c800 20 zonegroup default 2024-09-14T11:11:17.612 INFO:tasks.workunit.client.0.smithi050.stderr: -124> 2024-09-14T11:11:17.455+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.613 INFO:tasks.workunit.client.0.smithi050.stderr: -123> 2024-09-14T11:11:17.455+0000 7fd56e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.613 INFO:tasks.workunit.client.0.smithi050.stderr: -122> 2024-09-14T11:11:17.455+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.613 INFO:tasks.workunit.client.0.smithi050.stderr: -121> 2024-09-14T11:11:17.455+0000 7fd56e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.613 INFO:tasks.workunit.client.0.smithi050.stderr: -120> 2024-09-14T11:11:17.455+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.613 INFO:tasks.workunit.client.0.smithi050.stderr: -119> 2024-09-14T11:11:17.456+0000 7fd56e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.613 INFO:tasks.workunit.client.0.smithi050.stderr: -118> 2024-09-14T11:11:17.456+0000 7fd56e72c800 20 started sync module instance, tier type = 2024-09-14T11:11:17.613 INFO:tasks.workunit.client.0.smithi050.stderr: -117> 2024-09-14T11:11:17.456+0000 7fd56e72c800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:17.613 INFO:tasks.workunit.client.0.smithi050.stderr: -116> 2024-09-14T11:11:17.464+0000 7fd56e72c800 20 add_watcher() i=0 2024-09-14T11:11:17.613 INFO:tasks.workunit.client.0.smithi050.stderr: -115> 2024-09-14T11:11:17.464+0000 7fd56e72c800 20 add_watcher() i=1 2024-09-14T11:11:17.613 INFO:tasks.workunit.client.0.smithi050.stderr: -114> 2024-09-14T11:11:17.464+0000 7fd56e72c800 20 add_watcher() i=2 2024-09-14T11:11:17.613 INFO:tasks.workunit.client.0.smithi050.stderr: -113> 2024-09-14T11:11:17.464+0000 7fd56e72c800 20 add_watcher() i=3 2024-09-14T11:11:17.613 INFO:tasks.workunit.client.0.smithi050.stderr: -112> 2024-09-14T11:11:17.464+0000 7fd56e72c800 20 add_watcher() i=4 2024-09-14T11:11:17.613 INFO:tasks.workunit.client.0.smithi050.stderr: -111> 2024-09-14T11:11:17.464+0000 7fd56e72c800 20 add_watcher() i=5 2024-09-14T11:11:17.613 INFO:tasks.workunit.client.0.smithi050.stderr: -110> 2024-09-14T11:11:17.464+0000 7fd56e72c800 20 add_watcher() i=6 2024-09-14T11:11:17.614 INFO:tasks.workunit.client.0.smithi050.stderr: -109> 2024-09-14T11:11:17.465+0000 7fd56e72c800 20 add_watcher() i=7 2024-09-14T11:11:17.614 INFO:tasks.workunit.client.0.smithi050.stderr: -108> 2024-09-14T11:11:17.465+0000 7fd56e72c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:17.614 INFO:tasks.workunit.client.0.smithi050.stderr: -107> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding auth protocol: cephx 2024-09-14T11:11:17.614 INFO:tasks.workunit.client.0.smithi050.stderr: -106> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding auth protocol: cephx 2024-09-14T11:11:17.614 INFO:tasks.workunit.client.0.smithi050.stderr: -105> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding auth protocol: cephx 2024-09-14T11:11:17.614 INFO:tasks.workunit.client.0.smithi050.stderr: -104> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding con mode: secure 2024-09-14T11:11:17.614 INFO:tasks.workunit.client.0.smithi050.stderr: -103> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding con mode: crc 2024-09-14T11:11:17.614 INFO:tasks.workunit.client.0.smithi050.stderr: -102> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding con mode: secure 2024-09-14T11:11:17.614 INFO:tasks.workunit.client.0.smithi050.stderr: -101> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding con mode: crc 2024-09-14T11:11:17.614 INFO:tasks.workunit.client.0.smithi050.stderr: -100> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding con mode: secure 2024-09-14T11:11:17.614 INFO:tasks.workunit.client.0.smithi050.stderr: -99> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding con mode: crc 2024-09-14T11:11:17.615 INFO:tasks.workunit.client.0.smithi050.stderr: -98> 2024-09-14T11:11:17.467+0000 7fd420fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:17.615 INFO:tasks.workunit.client.0.smithi050.stderr: -97> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding con mode: crc 2024-09-14T11:11:17.615 INFO:tasks.workunit.client.0.smithi050.stderr: -96> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding con mode: secure 2024-09-14T11:11:17.615 INFO:tasks.workunit.client.0.smithi050.stderr: -95> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding con mode: crc 2024-09-14T11:11:17.615 INFO:tasks.workunit.client.0.smithi050.stderr: -94> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding con mode: secure 2024-09-14T11:11:17.615 INFO:tasks.workunit.client.0.smithi050.stderr: -93> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding con mode: crc 2024-09-14T11:11:17.615 INFO:tasks.workunit.client.0.smithi050.stderr: -92> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 AuthRegistry(0x7ffc830df320) adding con mode: secure 2024-09-14T11:11:17.615 INFO:tasks.workunit.client.0.smithi050.stderr: -91> 2024-09-14T11:11:17.467+0000 7fd56e72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:17.615 INFO:tasks.workunit.client.0.smithi050.stderr: -90> 2024-09-14T11:11:17.467+0000 7fd56e72c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:17.615 INFO:tasks.workunit.client.0.smithi050.stderr: -89> 2024-09-14T11:11:17.467+0000 7fd56e72c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:17.615 INFO:tasks.workunit.client.0.smithi050.stderr: -88> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command cache list hook 0x55655a576940 2024-09-14T11:11:17.615 INFO:tasks.workunit.client.0.smithi050.stderr: -87> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command cache inspect hook 0x55655a576940 2024-09-14T11:11:17.615 INFO:tasks.workunit.client.0.smithi050.stderr: -86> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command cache erase hook 0x55655a576940 2024-09-14T11:11:17.616 INFO:tasks.workunit.client.0.smithi050.stderr: -85> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command cache zap hook 0x55655a576940 2024-09-14T11:11:17.616 INFO:tasks.workunit.client.0.smithi050.stderr: -84> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 note: GC not initialized 2024-09-14T11:11:17.616 INFO:tasks.workunit.client.0.smithi050.stderr: -83> 2024-09-14T11:11:17.467+0000 7fd39b7fe640 20 reqs_thread_entry: start 2024-09-14T11:11:17.616 INFO:tasks.workunit.client.0.smithi050.stderr: -82> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command sync trace show hook 0x7fd55c0c2070 2024-09-14T11:11:17.616 INFO:tasks.workunit.client.0.smithi050.stderr: -81> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command sync trace history hook 0x7fd55c0c2070 2024-09-14T11:11:17.616 INFO:tasks.workunit.client.0.smithi050.stderr: -80> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command sync trace active hook 0x7fd55c0c2070 2024-09-14T11:11:17.616 INFO:tasks.workunit.client.0.smithi050.stderr: -79> 2024-09-14T11:11:17.467+0000 7fd56e72c800 5 asok(0x55655a28f270) register_command sync trace active_short hook 0x7fd55c0c2070 2024-09-14T11:11:17.616 INFO:tasks.workunit.client.0.smithi050.stderr: -78> 2024-09-14T11:11:17.467+0000 7fd56e72c800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:17.616 INFO:tasks.workunit.client.0.smithi050.stderr: -77> 2024-09-14T11:11:17.467+0000 7fd56e72c800 20 Filter name: none 2024-09-14T11:11:17.616 INFO:tasks.workunit.client.0.smithi050.stderr: -76> 2024-09-14T11:11:17.467+0000 7fd3997fa640 20 reqs_thread_entry: start 2024-09-14T11:11:17.616 INFO:tasks.workunit.client.0.smithi050.stderr: -75> 2024-09-14T11:11:17.468+0000 7fd56e72c800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:11:17.616 INFO:tasks.workunit.client.0.smithi050.stderr: -74> 2024-09-14T11:11:17.468+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.617 INFO:tasks.workunit.client.0.smithi050.stderr: -73> 2024-09-14T11:11:17.468+0000 7fd56e72c800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:11:17.617 INFO:tasks.workunit.client.0.smithi050.stderr: -72> 2024-09-14T11:11:17.468+0000 7fd56e72c800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:11:17.617 INFO:tasks.workunit.client.0.smithi050.stderr: -71> 2024-09-14T11:11:17.468+0000 7fd56e72c800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:11:17.617 INFO:tasks.workunit.client.0.smithi050.stderr: -70> 2024-09-14T11:11:17.468+0000 7fd56e72c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 : miss 2024-09-14T11:11:17.617 INFO:tasks.workunit.client.0.smithi050.stderr: -69> 2024-09-14T11:11:17.468+0000 7fd56e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.617 INFO:tasks.workunit.client.0.smithi050.stderr: -68> 2024-09-14T11:11:17.468+0000 7fd56e72c800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:11:17.617 INFO:tasks.workunit.client.0.smithi050.stderr: -67> 2024-09-14T11:11:17.468+0000 7fd56e72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 info.flags=0x17 2024-09-14T11:11:17.617 INFO:tasks.workunit.client.0.smithi050.stderr: -66> 2024-09-14T11:11:17.468+0000 7fd56e72c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 to cache LRU end 2024-09-14T11:11:17.617 INFO:tasks.workunit.client.0.smithi050.stderr: -65> 2024-09-14T11:11:17.468+0000 7fd56e72c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:11:17.617 INFO:tasks.workunit.client.0.smithi050.stderr: -64> 2024-09-14T11:11:17.468+0000 7fd56e72c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:17.617 INFO:tasks.workunit.client.0.smithi050.stderr: -63> 2024-09-14T11:11:17.468+0000 7fd56e72c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 2024-09-14T11:11:17.617 INFO:tasks.workunit.client.0.smithi050.stderr: -62> 2024-09-14T11:11:17.473+0000 7fd56e72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 info.flags=0x17 2024-09-14T11:11:17.617 INFO:tasks.workunit.client.0.smithi050.stderr: -61> 2024-09-14T11:11:17.473+0000 7fd56e72c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 to cache LRU end 2024-09-14T11:11:17.617 INFO:tasks.workunit.client.0.smithi050.stderr: -60> 2024-09-14T11:11:17.473+0000 7fd56e72c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:17.618 INFO:tasks.workunit.client.0.smithi050.stderr: -59> 2024-09-14T11:11:17.473+0000 7fd56e72c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30, ofs0, ns] 2024-09-14T11:11:17.618 INFO:tasks.workunit.client.0.smithi050.stderr: -58> 2024-09-14T11:11:17.474+0000 7fd44d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497079 cookie 93893795942352 notifier 7149 bl.length()=999 2024-09-14T11:11:17.618 INFO:tasks.workunit.client.0.smithi050.stderr: -57> 2024-09-14T11:11:17.474+0000 7fd44d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 info.flags=0x17 2024-09-14T11:11:17.618 INFO:tasks.workunit.client.0.smithi050.stderr: -56> 2024-09-14T11:11:17.474+0000 7fd44d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 to cache LRU end 2024-09-14T11:11:17.618 INFO:tasks.workunit.client.0.smithi050.stderr: -55> 2024-09-14T11:11:17.474+0000 7fd44d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:17.618 INFO:tasks.workunit.client.0.smithi050.stderr: -54> 2024-09-14T11:11:17.475+0000 7fd56e72c800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): orig_sources= new_sources= 2024-09-14T11:11:17.618 INFO:tasks.workunit.client.0.smithi050.stderr: -53> 2024-09-14T11:11:17.475+0000 7fd56e72c800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): potential sources added=[] removed=[] 2024-09-14T11:11:17.618 INFO:tasks.workunit.client.0.smithi050.stderr: -52> 2024-09-14T11:11:17.475+0000 7fd56e72c800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): orig_dests= new_dests= 2024-09-14T11:11:17.618 INFO:tasks.workunit.client.0.smithi050.stderr: -51> 2024-09-14T11:11:17.475+0000 7fd56e72c800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): potential dests added=[] removed=[] 2024-09-14T11:11:17.618 INFO:tasks.workunit.client.0.smithi050.stderr: -50> 2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.0 2024-09-14T11:11:17.618 INFO:tasks.workunit.client.0.smithi050.stderr: -49> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.0 2024-09-14T11:11:17.618 INFO:tasks.workunit.client.0.smithi050.stderr: -48> 2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.1 2024-09-14T11:11:17.618 INFO:tasks.workunit.client.0.smithi050.stderr: -47> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.1 2024-09-14T11:11:17.618 INFO:tasks.workunit.client.0.smithi050.stderr: -46> 2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.2 2024-09-14T11:11:17.619 INFO:tasks.workunit.client.0.smithi050.stderr: -45> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.2 2024-09-14T11:11:17.619 INFO:tasks.workunit.client.0.smithi050.stderr: -44> 2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.3 2024-09-14T11:11:17.619 INFO:tasks.workunit.client.0.smithi050.stderr: -43> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.3 2024-09-14T11:11:17.619 INFO:tasks.workunit.client.0.smithi050.stderr: -42> 2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.4 2024-09-14T11:11:17.619 INFO:tasks.workunit.client.0.smithi050.stderr: -41> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.4 2024-09-14T11:11:17.619 INFO:tasks.workunit.client.0.smithi050.stderr: -40> 2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.5 2024-09-14T11:11:17.619 INFO:tasks.workunit.client.0.smithi050.stderr: -39> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.5 2024-09-14T11:11:17.619 INFO:tasks.workunit.client.0.smithi050.stderr: -38> 2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.6 2024-09-14T11:11:17.619 INFO:tasks.workunit.client.0.smithi050.stderr: -37> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.6 2024-09-14T11:11:17.619 INFO:tasks.workunit.client.0.smithi050.stderr: -36> 2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.7 2024-09-14T11:11:17.619 INFO:tasks.workunit.client.0.smithi050.stderr: -35> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.7 2024-09-14T11:11:17.619 INFO:tasks.workunit.client.0.smithi050.stderr: -34> 2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.8 2024-09-14T11:11:17.619 INFO:tasks.workunit.client.0.smithi050.stderr: -33> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.8 2024-09-14T11:11:17.620 INFO:tasks.workunit.client.0.smithi050.stderr: -32> 2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.9 2024-09-14T11:11:17.620 INFO:tasks.workunit.client.0.smithi050.stderr: -31> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.9 2024-09-14T11:11:17.620 INFO:tasks.workunit.client.0.smithi050.stderr: -30> 2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.10 2024-09-14T11:11:17.620 INFO:tasks.workunit.client.0.smithi050.stderr: -29> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.10 2024-09-14T11:11:17.620 INFO:tasks.workunit.client.0.smithi050.stderr: -28> 2024-09-14T11:11:17.480+0000 7fd56e72c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.11 2024-09-14T11:11:17.620 INFO:tasks.workunit.client.0.smithi050.stderr: -27> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1.11 2024-09-14T11:11:17.620 INFO:tasks.workunit.client.0.smithi050.stderr: -26> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.0 2024-09-14T11:11:17.620 INFO:tasks.workunit.client.0.smithi050.stderr: -25> 2024-09-14T11:11:17.480+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1 2024-09-14T11:11:17.620 INFO:tasks.workunit.client.0.smithi050.stderr: -24> 2024-09-14T11:11:17.481+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2 2024-09-14T11:11:17.620 INFO:tasks.workunit.client.0.smithi050.stderr: -23> 2024-09-14T11:11:17.482+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.3 2024-09-14T11:11:17.620 INFO:tasks.workunit.client.0.smithi050.stderr: -22> 2024-09-14T11:11:17.482+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.4 2024-09-14T11:11:17.620 INFO:tasks.workunit.client.0.smithi050.stderr: -21> 2024-09-14T11:11:17.483+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.5 2024-09-14T11:11:17.620 INFO:tasks.workunit.client.0.smithi050.stderr: -20> 2024-09-14T11:11:17.483+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.6 2024-09-14T11:11:17.621 INFO:tasks.workunit.client.0.smithi050.stderr: -19> 2024-09-14T11:11:17.484+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.7 2024-09-14T11:11:17.621 INFO:tasks.workunit.client.0.smithi050.stderr: -18> 2024-09-14T11:11:17.484+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.8 2024-09-14T11:11:17.621 INFO:tasks.workunit.client.0.smithi050.stderr: -17> 2024-09-14T11:11:17.485+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.9 2024-09-14T11:11:17.621 INFO:tasks.workunit.client.0.smithi050.stderr: -16> 2024-09-14T11:11:17.485+0000 7fd56e72c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.10 2024-09-14T11:11:17.621 INFO:tasks.workunit.client.0.smithi050.stderr: -15> 2024-09-14T11:11:17.488+0000 7fd56e72c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:11:17.621 INFO:tasks.workunit.client.0.smithi050.stderr: -14> 2024-09-14T11:11:17.488+0000 7fd56e72c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 2024-09-14T11:11:17.621 INFO:tasks.workunit.client.0.smithi050.stderr: -13> 2024-09-14T11:11:17.489+0000 7fd56e72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 info.flags=0x17 2024-09-14T11:11:17.621 INFO:tasks.workunit.client.0.smithi050.stderr: -12> 2024-09-14T11:11:17.489+0000 7fd56e72c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 to cache LRU end 2024-09-14T11:11:17.621 INFO:tasks.workunit.client.0.smithi050.stderr: -11> 2024-09-14T11:11:17.489+0000 7fd56e72c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:17.621 INFO:tasks.workunit.client.0.smithi050.stderr: -10> 2024-09-14T11:11:17.489+0000 7fd56e72c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30, ofs0, ns] 2024-09-14T11:11:17.621 INFO:tasks.workunit.client.0.smithi050.stderr: -9> 2024-09-14T11:11:17.490+0000 7fd44d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497080 cookie 93893795942352 notifier 7149 bl.length()=999 2024-09-14T11:11:17.621 INFO:tasks.workunit.client.0.smithi050.stderr: -8> 2024-09-14T11:11:17.490+0000 7fd44d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 info.flags=0x17 2024-09-14T11:11:17.621 INFO:tasks.workunit.client.0.smithi050.stderr: -7> 2024-09-14T11:11:17.490+0000 7fd44d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 to cache LRU end 2024-09-14T11:11:17.621 INFO:tasks.workunit.client.0.smithi050.stderr: -6> 2024-09-14T11:11:17.490+0000 7fd44d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:17.622 INFO:tasks.workunit.client.0.smithi050.stderr: -5> 2024-09-14T11:11:17.491+0000 7fd56e72c800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): orig_sources= new_sources= 2024-09-14T11:11:17.622 INFO:tasks.workunit.client.0.smithi050.stderr: -4> 2024-09-14T11:11:17.491+0000 7fd56e72c800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): potential sources added=[] removed=[] 2024-09-14T11:11:17.622 INFO:tasks.workunit.client.0.smithi050.stderr: -3> 2024-09-14T11:11:17.491+0000 7fd56e72c800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): orig_dests= new_dests= 2024-09-14T11:11:17.622 INFO:tasks.workunit.client.0.smithi050.stderr: -2> 2024-09-14T11:11:17.491+0000 7fd56e72c800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): potential dests added=[] removed=[] 2024-09-14T11:11:17.622 INFO:tasks.workunit.client.0.smithi050.stderr: -1> 2024-09-14T11:11:17.492+0000 7fd56e72c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd56e72c800 time 2024-09-14T11:11:17.491933+0000 2024-09-14T11:11:17.622 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:11:17.622 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.622 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:11:17.622 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd56fd8c76a] 2024-09-14T11:11:17.622 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd56fd8c928] 2024-09-14T11:11:17.622 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5565591a80b1] 2024-09-14T11:11:17.622 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x5565591b718e] 2024-09-14T11:11:17.623 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5565591b7fc4] 2024-09-14T11:11:17.623 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:11:17.623 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd56ea29590] 2024-09-14T11:11:17.623 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:11:17.623 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:11:17.623 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.623 INFO:tasks.workunit.client.0.smithi050.stderr: 0> 2024-09-14T11:11:17.493+0000 7fd56e72c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:11:17.623 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7fd56e72c800 thread_name:radosgw-admin 2024-09-14T11:11:17.623 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.623 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:11:17.623 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd56ea3e6f0] 2024-09-14T11:11:17.623 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd56ea8b99c] 2024-09-14T11:11:17.623 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:11:17.623 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:11:17.623 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd56fd8c7c4] 2024-09-14T11:11:17.624 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd56fd8c928] 2024-09-14T11:11:17.624 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5565591a80b1] 2024-09-14T11:11:17.624 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x5565591b718e] 2024-09-14T11:11:17.624 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5565591b7fc4] 2024-09-14T11:11:17.624 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:11:17.624 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd56ea29590] 2024-09-14T11:11:17.624 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:11:17.624 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:11:17.624 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:11:17.624 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.624 INFO:tasks.workunit.client.0.smithi050.stderr:--- logging levels --- 2024-09-14T11:11:17.624 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 none 2024-09-14T11:11:17.624 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 lockdep 2024-09-14T11:11:17.624 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 context 2024-09-14T11:11:17.625 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 crush 2024-09-14T11:11:17.625 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds 2024-09-14T11:11:17.625 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_balancer 2024-09-14T11:11:17.625 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_locker 2024-09-14T11:11:17.625 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log 2024-09-14T11:11:17.625 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log_expire 2024-09-14T11:11:17.625 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_migrator 2024-09-14T11:11:17.625 INFO:tasks.workunit.client.0.smithi050.stderr: 3/ 5 mds_quiesce 2024-09-14T11:11:17.625 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 buffer 2024-09-14T11:11:17.625 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 timer 2024-09-14T11:11:17.625 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 filer 2024-09-14T11:11:17.625 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 striper 2024-09-14T11:11:17.625 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 objecter 2024-09-14T11:11:17.625 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rados 2024-09-14T11:11:17.626 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd 2024-09-14T11:11:17.626 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_mirror 2024-09-14T11:11:17.626 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_replay 2024-09-14T11:11:17.626 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_pwl 2024-09-14T11:11:17.626 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 journaler 2024-09-14T11:11:17.626 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objectcacher 2024-09-14T11:11:17.626 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:11:17.626 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 client 2024-09-14T11:11:17.626 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 osd 2024-09-14T11:11:17.626 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 optracker 2024-09-14T11:11:17.626 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objclass 2024-09-14T11:11:17.626 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 filestore 2024-09-14T11:11:17.626 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 journal 2024-09-14T11:11:17.626 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 ms 2024-09-14T11:11:17.626 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mon 2024-09-14T11:11:17.627 INFO:tasks.workunit.client.0.smithi050.stderr: 0/10 monc 2024-09-14T11:11:17.627 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 paxos 2024-09-14T11:11:17.627 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 tp 2024-09-14T11:11:17.627 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 auth 2024-09-14T11:11:17.627 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 crypto 2024-09-14T11:11:17.627 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 finisher 2024-09-14T11:11:17.627 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 reserver 2024-09-14T11:11:17.627 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 heartbeatmap 2024-09-14T11:11:17.627 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 perfcounter 2024-09-14T11:11:17.627 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw 2024-09-14T11:11:17.627 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_sync 2024-09-14T11:11:17.627 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_datacache 2024-09-14T11:11:17.627 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_access 2024-09-14T11:11:17.628 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:11:17.628 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_flight 2024-09-14T11:11:17.628 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:11:17.628 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw_notification 2024-09-14T11:11:17.628 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 javaclient 2024-09-14T11:11:17.628 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 asok 2024-09-14T11:11:17.628 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 throttle 2024-09-14T11:11:17.628 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 refs 2024-09-14T11:11:17.628 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 compressor 2024-09-14T11:11:17.628 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluestore 2024-09-14T11:11:17.628 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluefs 2024-09-14T11:11:17.628 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 bdev 2024-09-14T11:11:17.629 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 kstore 2024-09-14T11:11:17.629 INFO:tasks.workunit.client.0.smithi050.stderr: 4/ 5 rocksdb 2024-09-14T11:11:17.629 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 fuse 2024-09-14T11:11:17.629 INFO:tasks.workunit.client.0.smithi050.stderr: 2/ 5 mgr 2024-09-14T11:11:17.629 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mgrc 2024-09-14T11:11:17.629 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 dpdk 2024-09-14T11:11:17.629 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 eventtrace 2024-09-14T11:11:17.629 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 prioritycache 2024-09-14T11:11:17.629 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 test 2024-09-14T11:11:17.629 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:11:17.630 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephsqlite 2024-09-14T11:11:17.630 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:11:17.630 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore 2024-09-14T11:11:17.630 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_onode 2024-09-14T11:11:17.630 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_odata 2024-09-14T11:11:17.630 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_omap 2024-09-14T11:11:17.630 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_tm 2024-09-14T11:11:17.630 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_t 2024-09-14T11:11:17.630 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:11:17.630 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_epm 2024-09-14T11:11:17.630 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_lba 2024-09-14T11:11:17.630 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:11:17.630 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cache 2024-09-14T11:11:17.630 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_journal 2024-09-14T11:11:17.631 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_device 2024-09-14T11:11:17.631 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_backref 2024-09-14T11:11:17.631 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 alienstore 2024-09-14T11:11:17.631 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mclock 2024-09-14T11:11:17.631 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cyanstore 2024-09-14T11:11:17.631 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 ceph_exporter 2024-09-14T11:11:17.631 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 memstore 2024-09-14T11:11:17.631 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 trace 2024-09-14T11:11:17.631 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 ceph_dedup 2024-09-14T11:11:17.631 INFO:tasks.workunit.client.0.smithi050.stderr: -2/-2 (syslog threshold) 2024-09-14T11:11:17.631 INFO:tasks.workunit.client.0.smithi050.stderr: 99/99 (stderr threshold) 2024-09-14T11:11:17.631 INFO:tasks.workunit.client.0.smithi050.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:11:17.631 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd3997fa640 / http_manager 2024-09-14T11:11:17.632 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd39b7fe640 / http_manager 2024-09-14T11:11:17.632 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd420fe1640 / rgw_dt_lg_renew 2024-09-14T11:11:17.632 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd43bfff640 / ms_dispatch 2024-09-14T11:11:17.632 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd44d7fa640 / io_context_pool 2024-09-14T11:11:17.632 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd44dffb640 / io_context_pool 2024-09-14T11:11:17.632 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd44ffff640 / ms_dispatch 2024-09-14T11:11:17.632 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd456e05640 / ms_dispatch 2024-09-14T11:11:17.632 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd458608640 / io_context_pool 2024-09-14T11:11:17.632 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd569b3d640 / msgr-worker-2 2024-09-14T11:11:17.632 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd56a33e640 / msgr-worker-1 2024-09-14T11:11:17.632 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd56ab3f640 / msgr-worker-0 2024-09-14T11:11:17.632 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd56b340640 / io_context_pool 2024-09-14T11:11:17.632 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd56e72c800 / radosgw-admin 2024-09-14T11:11:17.633 INFO:tasks.workunit.client.0.smithi050.stderr: max_recent 500 2024-09-14T11:11:17.633 INFO:tasks.workunit.client.0.smithi050.stderr: max_new 1000 2024-09-14T11:11:17.633 INFO:tasks.workunit.client.0.smithi050.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:11:17.493618Z_25ddda7f-8a0e-43c1-9292-f8fae30c097c/log 2024-09-14T11:11:17.633 INFO:tasks.workunit.client.0.smithi050.stderr:--- end dump of recent events --- 2024-09-14T11:11:17.633 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:11:17.635 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:17.635 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:17.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.572+0000 7fda3a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.573+0000 7fda3a62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.573+0000 7fda3a62f800 20 realm 2024-09-14T11:11:17.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.573+0000 7fda3a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.574+0000 7fda3a62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.574+0000 7fda3a62f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:17.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.574+0000 7fda3a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.574+0000 7fda3a62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.636 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.574+0000 7fda3a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.636 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.575+0000 7fda3a62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:17.636 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.575+0000 7fda3a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.636 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.575+0000 7fda3a62f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:17.636 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.576+0000 7fda3a62f800 20 searching for the correct realm 2024-09-14T11:11:17.636 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.578+0000 7fda37918640 0 -- 172.21.15.50:0/3923746919 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fda3008b1d0 msgr2=0x7fda3006e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:17.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.783+0000 7fda3891a640 0 -- 172.21.15.50:0/3923746919 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5568abcaed50 msgr2=0x5568abcb1180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:17.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.787+0000 7fda3a62f800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:17.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.787+0000 7fda3a62f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:17.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.787+0000 7fda3a62f800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:17.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.787+0000 7fda3a62f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:17.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.787+0000 7fda3a62f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:17.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.787+0000 7fda3a62f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:17.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.787+0000 7fda3a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.788+0000 7fda3a62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.788+0000 7fda3a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.788+0000 7fda3a62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:17.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.788+0000 7fda3a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.788+0000 7fda3a62f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:17.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.788+0000 7fda3a62f800 20 zone default found 2024-09-14T11:11:17.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.788+0000 7fda3a62f800 4 Realm: () 2024-09-14T11:11:17.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.788+0000 7fda3a62f800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:17.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.788+0000 7fda3a62f800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:17.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.788+0000 7fda3a62f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:17.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.788+0000 7fda3a62f800 20 zonegroup default 2024-09-14T11:11:17.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.788+0000 7fda3a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.788+0000 7fda3a62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.789+0000 7fda3a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.789+0000 7fda3a62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.789+0000 7fda3a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.789+0000 7fda3a62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.789+0000 7fda3a62f800 20 started sync module instance, tier type = 2024-09-14T11:11:17.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.789+0000 7fda3a62f800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:17.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.797+0000 7fda3a62f800 20 add_watcher() i=0 2024-09-14T11:11:17.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.797+0000 7fda3a62f800 20 add_watcher() i=1 2024-09-14T11:11:17.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.797+0000 7fda3a62f800 20 add_watcher() i=2 2024-09-14T11:11:17.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.797+0000 7fda3a62f800 20 add_watcher() i=3 2024-09-14T11:11:17.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.797+0000 7fda3a62f800 20 add_watcher() i=4 2024-09-14T11:11:17.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.797+0000 7fda3a62f800 20 add_watcher() i=5 2024-09-14T11:11:17.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.797+0000 7fda3a62f800 20 add_watcher() i=6 2024-09-14T11:11:17.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.798+0000 7fda3a62f800 20 add_watcher() i=7 2024-09-14T11:11:17.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.798+0000 7fda3a62f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:17.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.800+0000 7fd8ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:17.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.800+0000 7fda3a62f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:17.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.800+0000 7fda3a62f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:17.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.800+0000 7fda3a62f800 5 note: GC not initialized 2024-09-14T11:11:17.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.800+0000 7fd8ed7e2640 20 reqs_thread_entry: start 2024-09-14T11:11:17.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.801+0000 7fda3a62f800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:17.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.801+0000 7fda3a62f800 20 Filter name: none 2024-09-14T11:11:17.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.801+0000 7fda3a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.801+0000 7fd85effd640 20 reqs_thread_entry: start 2024-09-14T11:11:17.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.801+0000 7fda3a62f800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:11:17.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.801+0000 7fda3a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.802+0000 7fda3a62f800 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:11:17.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.802+0000 7fda3a62f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:17.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.802+0000 7fda3a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.802+0000 7fda3a62f800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:11:17.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.802+0000 7fda3a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.802+0000 7fda3a62f800 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:11:17.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.802+0000 7fda3a62f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:17.802 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.804+0000 7fd8ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:17.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.806+0000 7fda3a62f800 20 remove_watcher() i=0 2024-09-14T11:11:17.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.806+0000 7fda3a62f800 2 removed watcher, disabling cache 2024-09-14T11:11:17.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.807+0000 7fda3a62f800 20 remove_watcher() i=1 2024-09-14T11:11:17.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.808+0000 7fda3a62f800 20 remove_watcher() i=2 2024-09-14T11:11:17.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.809+0000 7fda3a62f800 20 remove_watcher() i=3 2024-09-14T11:11:17.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.810+0000 7fda3a62f800 20 remove_watcher() i=4 2024-09-14T11:11:17.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.811+0000 7fda3a62f800 20 remove_watcher() i=5 2024-09-14T11:11:17.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.811+0000 7fda3a62f800 20 remove_watcher() i=6 2024-09-14T11:11:17.811 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.812+0000 7fda3a62f800 20 remove_watcher() i=7 2024-09-14T11:11:17.822 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.822 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:11:17.822 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: abort-at-block-writes id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:11:17.822 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:17.824 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:17.824 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:17.858 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:17.858 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:17.915 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:11:17.947 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:17.947 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:17.990 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.991+0000 7f79eac14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.990 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.992+0000 7f79eac14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.990 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.992+0000 7f79eac14800 20 realm 2024-09-14T11:11:17.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.992+0000 7f79eac14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.993+0000 7f79eac14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.993+0000 7f79eac14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:17.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.993+0000 7f79eac14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.993+0000 7f79eac14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:17.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.993+0000 7f79eac14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.994+0000 7f79eac14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:17.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.994+0000 7f79eac14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:17.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.994+0000 7f79eac14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:17.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.994+0000 7f79eac14800 20 searching for the correct realm 2024-09-14T11:11:17.996 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:17.998+0000 7f79e5aca640 0 -- 172.21.15.50:0/3242230512 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f79e0034910 msgr2=0x7f79e000e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:18.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.203+0000 7f79e6acc640 0 -- 172.21.15.50:0/3242230512 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55ceadf6ecb0 msgr2=0x55ceadf71170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:18.206 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.208+0000 7f79eac14800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:18.206 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.208+0000 7f79eac14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:18.206 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.208+0000 7f79eac14800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:18.206 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.208+0000 7f79eac14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:18.206 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.208+0000 7f79eac14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:18.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.208+0000 7f79eac14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:18.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.208+0000 7f79eac14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:18.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.208+0000 7f79eac14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:18.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.208+0000 7f79eac14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:18.208 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.208+0000 7f79eac14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:18.208 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.208+0000 7f79eac14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:18.208 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.209+0000 7f79eac14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:18.208 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.209+0000 7f79eac14800 20 zone default found 2024-09-14T11:11:18.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.209+0000 7f79eac14800 4 Realm: () 2024-09-14T11:11:18.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.209+0000 7f79eac14800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:18.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.209+0000 7f79eac14800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:18.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.209+0000 7f79eac14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:18.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.209+0000 7f79eac14800 20 zonegroup default 2024-09-14T11:11:18.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.209+0000 7f79eac14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:18.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.209+0000 7f79eac14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:18.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.209+0000 7f79eac14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:18.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.209+0000 7f79eac14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:18.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.209+0000 7f79eac14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:18.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.210+0000 7f79eac14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:18.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.210+0000 7f79eac14800 20 started sync module instance, tier type = 2024-09-14T11:11:18.209 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.210+0000 7f79eac14800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:18.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.218+0000 7f79eac14800 20 add_watcher() i=0 2024-09-14T11:11:18.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.218+0000 7f79eac14800 20 add_watcher() i=1 2024-09-14T11:11:18.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.218+0000 7f79eac14800 20 add_watcher() i=2 2024-09-14T11:11:18.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.218+0000 7f79eac14800 20 add_watcher() i=3 2024-09-14T11:11:18.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.218+0000 7f79eac14800 20 add_watcher() i=4 2024-09-14T11:11:18.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.218+0000 7f79eac14800 20 add_watcher() i=5 2024-09-14T11:11:18.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.218+0000 7f79eac14800 20 add_watcher() i=6 2024-09-14T11:11:18.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.219+0000 7f79eac14800 20 add_watcher() i=7 2024-09-14T11:11:18.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.219+0000 7f79eac14800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:18.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.221+0000 7f789cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:18.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.221+0000 7f79eac14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:18.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.221+0000 7f79eac14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:18.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.221+0000 7f79eac14800 5 note: GC not initialized 2024-09-14T11:11:18.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.222+0000 7f78177fe640 20 reqs_thread_entry: start 2024-09-14T11:11:18.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.222+0000 7f79eac14800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:18.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.222+0000 7f79eac14800 20 Filter name: none 2024-09-14T11:11:18.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.222+0000 7f78157fa640 20 reqs_thread_entry: start 2024-09-14T11:11:18.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.222+0000 7f79eac14800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:11:18.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.222+0000 7f79eac14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:18.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.222+0000 7f79eac14800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:11:18.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.222+0000 7f79eac14800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:11:18.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.222+0000 7f79eac14800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:11:18.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.222+0000 7f79eac14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 : miss 2024-09-14T11:11:18.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.222+0000 7f79eac14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:18.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.223+0000 7f79eac14800 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:11:18.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.223+0000 7f79eac14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 info.flags=0x17 2024-09-14T11:11:18.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.223+0000 7f79eac14800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 to cache LRU end 2024-09-14T11:11:18.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.223+0000 7f79eac14800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:11:18.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.223+0000 7f79eac14800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:18.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.223+0000 7f79eac14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 2024-09-14T11:11:18.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.224+0000 7f79eac14800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 to be held by another RGW process; skipping for now 2024-09-14T11:11:18.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.225+0000 7f789cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:18.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.227+0000 7f79eac14800 20 remove_watcher() i=0 2024-09-14T11:11:18.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.227+0000 7f79eac14800 2 removed watcher, disabling cache 2024-09-14T11:11:18.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.228+0000 7f79eac14800 20 remove_watcher() i=1 2024-09-14T11:11:18.227 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.229+0000 7f79eac14800 20 remove_watcher() i=2 2024-09-14T11:11:18.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.230+0000 7f79eac14800 20 remove_watcher() i=3 2024-09-14T11:11:18.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.231+0000 7f79eac14800 20 remove_watcher() i=4 2024-09-14T11:11:18.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.232+0000 7f79eac14800 20 remove_watcher() i=5 2024-09-14T11:11:18.231 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.233+0000 7f79eac14800 20 remove_watcher() i=6 2024-09-14T11:11:18.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:18.234+0000 7f79eac14800 20 remove_watcher() i=7 2024-09-14T11:11:18.244 INFO:tasks.workunit.client.0.smithi050.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:11:48.268 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:11:48.306 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:48.306 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:48.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.557+0000 7f4a77f23800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.559+0000 7f4a77f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:48.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.559+0000 7f4a77f23800 20 realm 2024-09-14T11:11:48.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.559+0000 7f4a77f23800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.559+0000 7f4a77f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:48.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.559+0000 7f4a77f23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:48.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.559+0000 7f4a77f23800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.560+0000 7f4a77f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:48.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.560+0000 7f4a77f23800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.560+0000 7f4a77f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:48.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.561+0000 7f4a77f23800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.561+0000 7f4a77f23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:48.560 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.561+0000 7f4a77f23800 20 searching for the correct realm 2024-09-14T11:11:48.560 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.562+0000 7f4a7440d640 0 -- 172.21.15.50:0/2443049904 >> [v2:172.21.15.118:6816/4154782182,v1:172.21.15.118:6817/4154782182] conn(0x55a1f0ada170 msgr2=0x55a1f0adc630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:48.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.567+0000 7f4a7340b640 0 -- 172.21.15.50:0/2443049904 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55a1f0acd960 msgr2=0x55a1f0acfdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:48.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.574+0000 7f4a77f23800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:48.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.574+0000 7f4a77f23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:48.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.574+0000 7f4a77f23800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:48.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.574+0000 7f4a77f23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:48.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.574+0000 7f4a77f23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:48.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.574+0000 7f4a77f23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:48.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.574+0000 7f4a77f23800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.574+0000 7f4a77f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:48.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.574+0000 7f4a77f23800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.575+0000 7f4a77f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:48.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.575+0000 7f4a77f23800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.575+0000 7f4a77f23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:48.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.575+0000 7f4a77f23800 20 zone default found 2024-09-14T11:11:48.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.575+0000 7f4a77f23800 4 Realm: () 2024-09-14T11:11:48.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.575+0000 7f4a77f23800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:48.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.575+0000 7f4a77f23800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:48.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.575+0000 7f4a77f23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:48.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.575+0000 7f4a77f23800 20 zonegroup default 2024-09-14T11:11:48.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.575+0000 7f4a77f23800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.575+0000 7f4a77f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:48.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.575+0000 7f4a77f23800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.576+0000 7f4a77f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:48.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.576+0000 7f4a77f23800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.576+0000 7f4a77f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:48.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.576+0000 7f4a77f23800 20 started sync module instance, tier type = 2024-09-14T11:11:48.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.576+0000 7f4a77f23800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:48.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.586+0000 7f4a77f23800 20 add_watcher() i=0 2024-09-14T11:11:48.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.586+0000 7f4a77f23800 20 add_watcher() i=1 2024-09-14T11:11:48.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.586+0000 7f4a77f23800 20 add_watcher() i=2 2024-09-14T11:11:48.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.586+0000 7f4a77f23800 20 add_watcher() i=3 2024-09-14T11:11:48.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.586+0000 7f4a77f23800 20 add_watcher() i=4 2024-09-14T11:11:48.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.586+0000 7f4a77f23800 20 add_watcher() i=5 2024-09-14T11:11:48.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.586+0000 7f4a77f23800 20 add_watcher() i=6 2024-09-14T11:11:48.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.587+0000 7f4a77f23800 20 add_watcher() i=7 2024-09-14T11:11:48.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.587+0000 7f4a77f23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:48.587 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.589+0000 7f4929fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:48.588 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.590+0000 7f4a77f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:48.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.590+0000 7f4a77f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:48.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.590+0000 7f4a77f23800 5 note: GC not initialized 2024-09-14T11:11:48.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.590+0000 7f4928fe1640 20 reqs_thread_entry: start 2024-09-14T11:11:48.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.590+0000 7f4a77f23800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:48.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.590+0000 7f4a77f23800 20 Filter name: none 2024-09-14T11:11:48.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.590+0000 7f48a27fc640 20 reqs_thread_entry: start 2024-09-14T11:11:48.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.590+0000 7f4a77f23800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:11:48.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.590+0000 7f4a77f23800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.590 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.591+0000 7f4a77f23800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:11:48.590 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.591+0000 7f4a77f23800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:11:48.590 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.591+0000 7f4a77f23800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:11:48.590 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.591+0000 7f4a77f23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 : miss 2024-09-14T11:11:48.590 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.591+0000 7f4a77f23800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.590 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.591+0000 7f4a77f23800 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:11:48.590 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.591+0000 7f4a77f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 info.flags=0x17 2024-09-14T11:11:48.590 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.591+0000 7f4a77f23800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 to cache LRU end 2024-09-14T11:11:48.590 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.591+0000 7f4a77f23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:11:48.590 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.591+0000 7f4a77f23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:48.591 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.592+0000 7f4a77f23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 2024-09-14T11:11:48.591 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.593+0000 7f4a77f23800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:11:48.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.600+0000 7f4a77f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 info.flags=0x17 2024-09-14T11:11:48.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.600+0000 7f4a77f23800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 to cache LRU end 2024-09-14T11:11:48.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.600+0000 7f4a77f23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:48.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.600+0000 7f4a77f23800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30, ofs0, ns] 2024-09-14T11:11:48.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.600+0000 7f49527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497081 cookie 94154015963856 notifier 6782 bl.length()=999 2024-09-14T11:11:48.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.600+0000 7f49527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 info.flags=0x17 2024-09-14T11:11:48.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.600+0000 7f49527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 to cache LRU end 2024-09-14T11:11:48.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.600+0000 7f49527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:48.600 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.602+0000 7f4a77f23800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): orig_sources= new_sources= 2024-09-14T11:11:48.600 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.602+0000 7f4a77f23800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): potential sources added=[] removed=[] 2024-09-14T11:11:48.600 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.602+0000 7f4a77f23800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): orig_dests= new_dests= 2024-09-14T11:11:48.600 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.602+0000 7f4a77f23800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): potential dests added=[] removed=[] 2024-09-14T11:11:48.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2.0 2024-09-14T11:11:48.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2.0 2024-09-14T11:11:48.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2.1 2024-09-14T11:11:48.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2.1 2024-09-14T11:11:48.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2.2 2024-09-14T11:11:48.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2.2 2024-09-14T11:11:48.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2.3 2024-09-14T11:11:48.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2.3 2024-09-14T11:11:48.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2.4 2024-09-14T11:11:48.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2.4 2024-09-14T11:11:48.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2.5 2024-09-14T11:11:48.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2.5 2024-09-14T11:11:48.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2.6 2024-09-14T11:11:48.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2.6 2024-09-14T11:11:48.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2.7 2024-09-14T11:11:48.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2.7 2024-09-14T11:11:48.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2.8 2024-09-14T11:11:48.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2.8 2024-09-14T11:11:48.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2.9 2024-09-14T11:11:48.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2.9 2024-09-14T11:11:48.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2.10 2024-09-14T11:11:48.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2.10 2024-09-14T11:11:48.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2.11 2024-09-14T11:11:48.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2.11 2024-09-14T11:11:48.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.0 2024-09-14T11:11:48.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.608+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1 2024-09-14T11:11:48.609 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.609+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2 2024-09-14T11:11:48.609 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.609+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.3 2024-09-14T11:11:48.609 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.610+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.4 2024-09-14T11:11:48.610 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.611+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.5 2024-09-14T11:11:48.610 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.611+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.6 2024-09-14T11:11:48.610 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.612+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.7 2024-09-14T11:11:48.610 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.612+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.8 2024-09-14T11:11:48.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.613+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.9 2024-09-14T11:11:48.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.614+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.10 2024-09-14T11:11:48.615 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.617+0000 7f4a77f23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:11:48.615 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.617+0000 7f4a77f23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 2024-09-14T11:11:48.617 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.618+0000 7f4a77f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 info.flags=0x17 2024-09-14T11:11:48.617 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.618+0000 7f4a77f23800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 to cache LRU end 2024-09-14T11:11:48.617 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.618+0000 7f4a77f23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:48.617 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.618+0000 7f4a77f23800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30, ofs0, ns] 2024-09-14T11:11:48.617 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.619+0000 7f4952ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497082 cookie 94154015963856 notifier 6782 bl.length()=999 2024-09-14T11:11:48.618 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.619+0000 7f4952ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 info.flags=0x17 2024-09-14T11:11:48.618 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.619+0000 7f4952ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 to cache LRU end 2024-09-14T11:11:48.618 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.619+0000 7f4952ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:48.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.621+0000 7f4a77f23800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): orig_sources= new_sources= 2024-09-14T11:11:48.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.621+0000 7f4a77f23800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): potential sources added=[] removed=[] 2024-09-14T11:11:48.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.621+0000 7f4a77f23800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): orig_dests= new_dests= 2024-09-14T11:11:48.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.621+0000 7f4a77f23800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): potential dests added=[] removed=[] 2024-09-14T11:11:48.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.623+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.0 2024-09-14T11:11:48.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.624+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.1 2024-09-14T11:11:48.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.624+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.2 2024-09-14T11:11:48.623 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.625+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.3 2024-09-14T11:11:48.623 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.625+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.4 2024-09-14T11:11:48.623 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.625+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.5 2024-09-14T11:11:48.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.626+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.6 2024-09-14T11:11:48.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.626+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.7 2024-09-14T11:11:48.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.626+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.8 2024-09-14T11:11:48.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.627+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.9 2024-09-14T11:11:48.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.627+0000 7f4a77f23800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30.10 2024-09-14T11:11:48.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.628+0000 7f4a77f23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:11:48.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.628+0000 7f4a77f23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 2024-09-14T11:11:48.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.629+0000 7f4a77f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 info.flags=0x17 2024-09-14T11:11:48.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.629+0000 7f4a77f23800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 to cache LRU end 2024-09-14T11:11:48.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.629+0000 7f4a77f23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:48.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.629+0000 7f4a77f23800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30, ofs0, ns] 2024-09-14T11:11:48.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.629+0000 7f4952ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497083 cookie 94154015963856 notifier 6782 bl.length()=967 2024-09-14T11:11:48.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.629+0000 7f4952ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 info.flags=0x17 2024-09-14T11:11:48.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.629+0000 7f4952ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 to cache LRU end 2024-09-14T11:11:48.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.629+0000 7f4952ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:48.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.631+0000 7f4a77f23800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): orig_sources= new_sources= 2024-09-14T11:11:48.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.631+0000 7f4a77f23800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): potential sources added=[] removed=[] 2024-09-14T11:11:48.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.631+0000 7f4a77f23800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): orig_dests= new_dests= 2024-09-14T11:11:48.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.631+0000 7f4a77f23800 20 handle_bi_update(): bucket=:abort-at-block-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30]): potential dests added=[] removed=[] 2024-09-14T11:11:48.631 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.633+0000 7f4a77f23800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:11:48.633 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.635+0000 7f4929fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:48.636 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.638+0000 7f4a77f23800 20 remove_watcher() i=0 2024-09-14T11:11:48.636 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.638+0000 7f4a77f23800 2 removed watcher, disabling cache 2024-09-14T11:11:48.637 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.639+0000 7f4a77f23800 20 remove_watcher() i=1 2024-09-14T11:11:48.638 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.640+0000 7f4a77f23800 20 remove_watcher() i=2 2024-09-14T11:11:48.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.641+0000 7f4a77f23800 20 remove_watcher() i=3 2024-09-14T11:11:48.640 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.642+0000 7f4a77f23800 20 remove_watcher() i=4 2024-09-14T11:11:48.641 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.643+0000 7f4a77f23800 20 remove_watcher() i=5 2024-09-14T11:11:48.642 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.644+0000 7f4a77f23800 20 remove_watcher() i=6 2024-09-14T11:11:48.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.645+0000 7f4a77f23800 20 remove_watcher() i=7 2024-09-14T11:11:48.657 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:11:48.686 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:48.686 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:48.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.729+0000 7f8443d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.731+0000 7f8443d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:48.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.731+0000 7f8443d25800 20 realm 2024-09-14T11:11:48.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.731+0000 7f8443d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.731+0000 7f8443d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:48.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.731+0000 7f8443d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:48.730 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.731+0000 7f8443d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.730 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.731+0000 7f8443d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:48.730 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.731+0000 7f8443d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.730 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.732+0000 7f8443d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:48.730 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.732+0000 7f8443d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.731 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.732+0000 7f8443d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:48.731 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.732+0000 7f8443d25800 20 searching for the correct realm 2024-09-14T11:11:48.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.736+0000 7f843f1ad640 0 -- 172.21.15.50:0/641585555 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f843803e350 msgr2=0x7f8438067aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:48.940 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.942+0000 7f843f1ad640 0 -- 172.21.15.50:0/641585555 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x562d0ad35890 msgr2=0x562d0ad37d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:48.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.946+0000 7f8443d25800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:48.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.946+0000 7f8443d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:48.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.946+0000 7f8443d25800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:48.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.946+0000 7f8443d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:48.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.946+0000 7f8443d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:48.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.946+0000 7f8443d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:48.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.946+0000 7f8443d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.946+0000 7f8443d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:48.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.946+0000 7f8443d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.947+0000 7f8443d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:48.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.947+0000 7f8443d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.947 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.947+0000 7f8443d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:48.947 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.947+0000 7f8443d25800 20 zone default found 2024-09-14T11:11:48.947 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.947+0000 7f8443d25800 4 Realm: () 2024-09-14T11:11:48.947 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.947+0000 7f8443d25800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:48.947 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.947+0000 7f8443d25800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:48.947 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.947+0000 7f8443d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:48.947 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.947+0000 7f8443d25800 20 zonegroup default 2024-09-14T11:11:48.947 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.947+0000 7f8443d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.947 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.947+0000 7f8443d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:48.948 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.947+0000 7f8443d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.948 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.948+0000 7f8443d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:48.948 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.948+0000 7f8443d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.948 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.948+0000 7f8443d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:48.948 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.948+0000 7f8443d25800 20 started sync module instance, tier type = 2024-09-14T11:11:48.948 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.948+0000 7f8443d25800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:48.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.957+0000 7f8443d25800 20 add_watcher() i=0 2024-09-14T11:11:48.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.957+0000 7f8443d25800 20 add_watcher() i=1 2024-09-14T11:11:48.956 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.957+0000 7f8443d25800 20 add_watcher() i=2 2024-09-14T11:11:48.956 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.957+0000 7f8443d25800 20 add_watcher() i=3 2024-09-14T11:11:48.956 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.957+0000 7f8443d25800 20 add_watcher() i=4 2024-09-14T11:11:48.956 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.957+0000 7f8443d25800 20 add_watcher() i=5 2024-09-14T11:11:48.956 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.957+0000 7f8443d25800 20 add_watcher() i=6 2024-09-14T11:11:48.956 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.958+0000 7f8443d25800 20 add_watcher() i=7 2024-09-14T11:11:48.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.958+0000 7f8443d25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:48.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.960+0000 7f82f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:48.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.960+0000 7f8443d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:48.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.960+0000 7f8443d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:48.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.960+0000 7f8443d25800 5 note: GC not initialized 2024-09-14T11:11:48.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.960+0000 7f82f4fe1640 20 reqs_thread_entry: start 2024-09-14T11:11:48.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.961+0000 7f8443d25800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:48.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.961+0000 7f8443d25800 20 Filter name: none 2024-09-14T11:11:48.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.961+0000 7f826e7fc640 20 reqs_thread_entry: start 2024-09-14T11:11:48.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.961+0000 7f8443d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.961+0000 7f8443d25800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:11:48.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.962+0000 7f8443d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.962+0000 7f8443d25800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:11:48.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.962+0000 7f8443d25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:48.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.962+0000 7f8443d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.962+0000 7f8443d25800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:11:48.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.962+0000 7f8443d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:48.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.963+0000 7f8443d25800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:11:48.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.963+0000 7f8443d25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:48.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.965+0000 7f82f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:48.965 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.967+0000 7f8443d25800 20 remove_watcher() i=0 2024-09-14T11:11:48.965 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.967+0000 7f8443d25800 2 removed watcher, disabling cache 2024-09-14T11:11:48.966 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.968+0000 7f8443d25800 20 remove_watcher() i=1 2024-09-14T11:11:48.967 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.969+0000 7f8443d25800 20 remove_watcher() i=2 2024-09-14T11:11:48.968 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.970+0000 7f8443d25800 20 remove_watcher() i=3 2024-09-14T11:11:48.969 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.971+0000 7f8443d25800 20 remove_watcher() i=4 2024-09-14T11:11:48.970 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.972+0000 7f8443d25800 20 remove_watcher() i=5 2024-09-14T11:11:48.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.973+0000 7f8443d25800 20 remove_watcher() i=6 2024-09-14T11:11:48.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:48.974+0000 7f8443d25800 20 remove_watcher() i=7 2024-09-14T11:11:48.983 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:48.983 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:11:48.984 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: abort-at-block-writes id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:11:48.984 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:48.986 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:48.986 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:49.008 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:49.009 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:49.230 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:49.230 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:49.369 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-14T11:11:49.369 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:49.370 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:49.370 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:49.418 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:49.418 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:49.476 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:49.476 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:49.514 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:49.515 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:49.551 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:49.551 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:49.588 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:49.588 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:49.625 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:49.626 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:49.663 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:49.663 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:49.701 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:49.701 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:49.739 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:49.739 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:49.776 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:49.776 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:49.813 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:49.813 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:49.850 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:49.850 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:49.890 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:49.890 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:49.926 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:49.927 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:49.962 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:49.962 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:49.999 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:50.000 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:50.037 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:50.037 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:50.074 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:50.074 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:50.112 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:50.112 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:50.149 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:50.149 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:50.188 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:50.188 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:50.225 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:11:50.255 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:50.255 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:50.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.297+0000 7f00b0b39800 20 rados->read ofs=0 len=0 2024-09-14T11:11:50.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.299+0000 7f00b0b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:50.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.299+0000 7f00b0b39800 20 realm 2024-09-14T11:11:50.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.299+0000 7f00b0b39800 20 rados->read ofs=0 len=0 2024-09-14T11:11:50.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.299+0000 7f00b0b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:50.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.299+0000 7f00b0b39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:50.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.299+0000 7f00b0b39800 20 rados->read ofs=0 len=0 2024-09-14T11:11:50.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.299+0000 7f00b0b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:50.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.299+0000 7f00b0b39800 20 rados->read ofs=0 len=0 2024-09-14T11:11:50.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.300+0000 7f00b0b39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:50.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.300+0000 7f00b0b39800 20 rados->read ofs=0 len=0 2024-09-14T11:11:50.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.300+0000 7f00b0b39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:50.299 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.300+0000 7f00b0b39800 20 searching for the correct realm 2024-09-14T11:11:50.299 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.301+0000 7f00ac7c7640 0 -- 172.21.15.50:0/2442536409 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x7f0094003b70 msgr2=0x7f00a4064240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:50.504 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.506+0000 7f00acfc8640 0 -- 172.21.15.50:0/2442536409 >> [v2:172.21.15.118:6826/1082138742,v1:172.21.15.118:6827/1082138742] conn(0x7f009c05d040 msgr2=0x7f009c0d1400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:50.712 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.713+0000 7f00b0b39800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:50.712 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.713+0000 7f00b0b39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:50.712 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.713+0000 7f00b0b39800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:50.712 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.713+0000 7f00b0b39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:50.712 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.713+0000 7f00b0b39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:50.712 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.713+0000 7f00b0b39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:50.713 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.713+0000 7f00b0b39800 20 rados->read ofs=0 len=0 2024-09-14T11:11:50.713 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.714+0000 7f00b0b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:50.713 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.714+0000 7f00b0b39800 20 rados->read ofs=0 len=0 2024-09-14T11:11:50.713 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.714+0000 7f00b0b39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:50.713 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.714+0000 7f00b0b39800 20 rados->read ofs=0 len=0 2024-09-14T11:11:50.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.714+0000 7f00b0b39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:50.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.714+0000 7f00b0b39800 20 zone default found 2024-09-14T11:11:50.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.714+0000 7f00b0b39800 4 Realm: () 2024-09-14T11:11:50.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.714+0000 7f00b0b39800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:50.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.714+0000 7f00b0b39800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:50.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.714+0000 7f00b0b39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:50.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.714+0000 7f00b0b39800 20 zonegroup default 2024-09-14T11:11:50.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.714+0000 7f00b0b39800 20 rados->read ofs=0 len=0 2024-09-14T11:11:50.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.715+0000 7f00b0b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:50.715 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.715+0000 7f00b0b39800 20 rados->read ofs=0 len=0 2024-09-14T11:11:50.715 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.715+0000 7f00b0b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:50.715 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.715+0000 7f00b0b39800 20 rados->read ofs=0 len=0 2024-09-14T11:11:50.715 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.715+0000 7f00b0b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:50.715 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.715+0000 7f00b0b39800 20 started sync module instance, tier type = 2024-09-14T11:11:50.715 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.715+0000 7f00b0b39800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:50.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.725+0000 7f00b0b39800 20 add_watcher() i=0 2024-09-14T11:11:50.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.725+0000 7f00b0b39800 20 add_watcher() i=1 2024-09-14T11:11:50.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.725+0000 7f00b0b39800 20 add_watcher() i=2 2024-09-14T11:11:50.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.725+0000 7f00b0b39800 20 add_watcher() i=3 2024-09-14T11:11:50.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.725+0000 7f00b0b39800 20 add_watcher() i=4 2024-09-14T11:11:50.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.725+0000 7f00b0b39800 20 add_watcher() i=5 2024-09-14T11:11:50.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.725+0000 7f00b0b39800 20 add_watcher() i=6 2024-09-14T11:11:50.724 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.726+0000 7f00b0b39800 20 add_watcher() i=7 2024-09-14T11:11:50.724 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.726+0000 7f00b0b39800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:50.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.728+0000 7eff62fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:50.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.728+0000 7f00b0b39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:50.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.728+0000 7f00b0b39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:50.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.728+0000 7f00b0b39800 5 note: GC not initialized 2024-09-14T11:11:50.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.728+0000 7eff61fdb640 20 reqs_thread_entry: start 2024-09-14T11:11:50.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.728+0000 7f00b0b39800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:50.728 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.728+0000 7f00b0b39800 20 Filter name: none 2024-09-14T11:11:50.728 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.729+0000 7efed37fe640 20 reqs_thread_entry: start 2024-09-14T11:11:50.728 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.729+0000 7f00b0b39800 20 rados->read ofs=0 len=0 2024-09-14T11:11:50.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.729+0000 7f00b0b39800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:11:50.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.729+0000 7f00b0b39800 20 rados->read ofs=0 len=0 2024-09-14T11:11:50.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.730+0000 7f00b0b39800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:11:50.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.730+0000 7f00b0b39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:50.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.730+0000 7f00b0b39800 20 rados->read ofs=0 len=0 2024-09-14T11:11:50.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.730+0000 7f00b0b39800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:11:50.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.730+0000 7f00b0b39800 20 rados->read ofs=0 len=0 2024-09-14T11:11:50.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.730+0000 7f00b0b39800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:11:50.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.730+0000 7f00b0b39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:50.730 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.732+0000 7eff62fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:50.732 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.734+0000 7f00b0b39800 20 remove_watcher() i=0 2024-09-14T11:11:50.733 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.734+0000 7f00b0b39800 2 removed watcher, disabling cache 2024-09-14T11:11:50.733 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.735+0000 7f00b0b39800 20 remove_watcher() i=1 2024-09-14T11:11:50.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.737+0000 7f00b0b39800 20 remove_watcher() i=2 2024-09-14T11:11:50.736 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.738+0000 7f00b0b39800 20 remove_watcher() i=3 2024-09-14T11:11:50.737 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.739+0000 7f00b0b39800 20 remove_watcher() i=4 2024-09-14T11:11:50.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.740+0000 7f00b0b39800 20 remove_watcher() i=5 2024-09-14T11:11:50.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.741+0000 7f00b0b39800 20 remove_watcher() i=6 2024-09-14T11:11:50.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.742+0000 7f00b0b39800 20 remove_watcher() i=7 2024-09-14T11:11:50.752 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:50.752 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:11:50.752 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-commit-target-layout id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:11:50.752 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:50.754 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-14T11:11:50.789 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:50.790 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:50.830 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.832+0000 7f6743175800 20 rados->read ofs=0 len=0 2024-09-14T11:11:50.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.833+0000 7f6743175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:50.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.833+0000 7f6743175800 20 realm 2024-09-14T11:11:50.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.833+0000 7f6743175800 20 rados->read ofs=0 len=0 2024-09-14T11:11:50.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.834+0000 7f6743175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:50.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.834+0000 7f6743175800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:50.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.834+0000 7f6743175800 20 rados->read ofs=0 len=0 2024-09-14T11:11:50.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.834+0000 7f6743175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:50.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.834+0000 7f6743175800 20 rados->read ofs=0 len=0 2024-09-14T11:11:50.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.835+0000 7f6743175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:50.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.835+0000 7f6743175800 20 rados->read ofs=0 len=0 2024-09-14T11:11:50.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.835+0000 7f6743175800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:50.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.835+0000 7f6743175800 20 searching for the correct realm 2024-09-14T11:11:50.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:50.838+0000 7f674045e640 0 -- 172.21.15.50:0/4161367795 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f67380a5ca0 msgr2=0x7f67380bc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:51.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.044+0000 7f6741460640 0 -- 172.21.15.50:0/4161367795 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x556158973190 msgr2=0x556158975620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:51.046 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.048+0000 7f6743175800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:51.046 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.048+0000 7f6743175800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:51.047 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.048+0000 7f6743175800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:51.047 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.048+0000 7f6743175800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:51.047 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.048+0000 7f6743175800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:51.047 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.048+0000 7f6743175800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:51.047 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.048+0000 7f6743175800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.047 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.048+0000 7f6743175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.047 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.048+0000 7f6743175800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.048 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.049+0000 7f6743175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:51.048 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.049+0000 7f6743175800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.048 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.049+0000 7f6743175800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:51.048 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.049+0000 7f6743175800 20 zone default found 2024-09-14T11:11:51.049 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.049+0000 7f6743175800 4 Realm: () 2024-09-14T11:11:51.049 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.049+0000 7f6743175800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:51.049 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.049+0000 7f6743175800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:51.049 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.049+0000 7f6743175800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:51.049 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.049+0000 7f6743175800 20 zonegroup default 2024-09-14T11:11:51.049 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.049+0000 7f6743175800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.049 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.049+0000 7f6743175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.049 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.049+0000 7f6743175800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.049 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.050+0000 7f6743175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.049 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.050+0000 7f6743175800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.049 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.050+0000 7f6743175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.049 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.050+0000 7f6743175800 20 started sync module instance, tier type = 2024-09-14T11:11:51.049 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.050+0000 7f6743175800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:51.057 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.059+0000 7f6743175800 20 add_watcher() i=0 2024-09-14T11:11:51.057 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.059+0000 7f6743175800 20 add_watcher() i=1 2024-09-14T11:11:51.057 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.059+0000 7f6743175800 20 add_watcher() i=2 2024-09-14T11:11:51.057 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.059+0000 7f6743175800 20 add_watcher() i=3 2024-09-14T11:11:51.058 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.059+0000 7f6743175800 20 add_watcher() i=4 2024-09-14T11:11:51.058 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.059+0000 7f6743175800 20 add_watcher() i=5 2024-09-14T11:11:51.058 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.059+0000 7f6743175800 20 add_watcher() i=6 2024-09-14T11:11:51.058 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.060+0000 7f6743175800 20 add_watcher() i=7 2024-09-14T11:11:51.058 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.060+0000 7f6743175800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:51.059 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.061+0000 7f65f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:51.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.062+0000 7f6743175800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:51.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.062+0000 7f6743175800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:51.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.062+0000 7f6743175800 5 note: GC not initialized 2024-09-14T11:11:51.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.062+0000 7f65f5fe3640 20 reqs_thread_entry: start 2024-09-14T11:11:51.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.062+0000 7f6743175800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:51.061 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.062+0000 7f6743175800 20 Filter name: none 2024-09-14T11:11:51.061 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.062+0000 7f65677fe640 20 reqs_thread_entry: start 2024-09-14T11:11:51.061 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.062+0000 7f6743175800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:11:51.061 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.062+0000 7f6743175800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.063+0000 7f6743175800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:11:51.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.063+0000 7f6743175800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:11:51.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.063+0000 7f6743175800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:11:51.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.063+0000 7f6743175800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 : miss 2024-09-14T11:11:51.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.063+0000 7f6743175800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.063+0000 7f6743175800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:11:51.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.063+0000 7f6743175800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 info.flags=0x17 2024-09-14T11:11:51.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.063+0000 7f6743175800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 to cache LRU end 2024-09-14T11:11:51.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.063+0000 7f6743175800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:11:51.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.063+0000 7f6743175800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:51.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.063+0000 7f6743175800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 2024-09-14T11:11:51.066 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.068+0000 7f6743175800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 info.flags=0x17 2024-09-14T11:11:51.067 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.068+0000 7f6743175800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 to cache LRU end 2024-09-14T11:11:51.067 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.068+0000 7f6743175800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:51.067 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.068+0000 7f6743175800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31, ofs0, ns] 2024-09-14T11:11:51.067 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.069+0000 7f66177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497066 cookie 93876586566864 notifier 6833 bl.length()=1015 2024-09-14T11:11:51.067 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.069+0000 7f66177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 info.flags=0x17 2024-09-14T11:11:51.067 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.069+0000 7f66177fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 to cache LRU end 2024-09-14T11:11:51.067 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.069+0000 7f66177fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:51.069 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.071+0000 7f6743175800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31]): orig_sources= new_sources= 2024-09-14T11:11:51.069 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.071+0000 7f6743175800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31]): potential sources added=[] removed=[] 2024-09-14T11:11:51.069 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.071+0000 7f6743175800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31]): orig_dests= new_dests= 2024-09-14T11:11:51.069 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.071+0000 7f6743175800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31]): potential dests added=[] removed=[] 2024-09-14T11:11:51.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1.0 2024-09-14T11:11:51.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1.0 2024-09-14T11:11:51.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1.1 2024-09-14T11:11:51.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1.1 2024-09-14T11:11:51.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1.2 2024-09-14T11:11:51.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1.2 2024-09-14T11:11:51.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1.3 2024-09-14T11:11:51.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1.3 2024-09-14T11:11:51.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1.4 2024-09-14T11:11:51.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1.4 2024-09-14T11:11:51.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1.5 2024-09-14T11:11:51.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1.5 2024-09-14T11:11:51.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1.6 2024-09-14T11:11:51.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1.6 2024-09-14T11:11:51.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1.7 2024-09-14T11:11:51.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1.7 2024-09-14T11:11:51.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1.8 2024-09-14T11:11:51.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1.8 2024-09-14T11:11:51.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1.9 2024-09-14T11:11:51.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1.9 2024-09-14T11:11:51.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1.10 2024-09-14T11:11:51.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1.10 2024-09-14T11:11:51.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1.11 2024-09-14T11:11:51.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1.11 2024-09-14T11:11:51.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.075+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.0 2024-09-14T11:11:51.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.076+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1 2024-09-14T11:11:51.077 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.077+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2 2024-09-14T11:11:51.077 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.077+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.3 2024-09-14T11:11:51.077 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.078+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.4 2024-09-14T11:11:51.077 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.078+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.5 2024-09-14T11:11:51.077 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.079+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.6 2024-09-14T11:11:51.077 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.079+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.7 2024-09-14T11:11:51.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.080+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.8 2024-09-14T11:11:51.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.080+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.9 2024-09-14T11:11:51.079 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.081+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.10 2024-09-14T11:11:51.082 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.084+0000 7f6743175800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:11:51.082 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.084+0000 7f6743175800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 2024-09-14T11:11:51.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.085+0000 7f6743175800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 info.flags=0x17 2024-09-14T11:11:51.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.085+0000 7f6743175800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 to cache LRU end 2024-09-14T11:11:51.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.085+0000 7f6743175800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:51.084 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.085+0000 7f6743175800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31, ofs0, ns] 2024-09-14T11:11:51.084 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.086+0000 7f66177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497067 cookie 93876586566864 notifier 6833 bl.length()=1015 2024-09-14T11:11:51.084 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.086+0000 7f66177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 info.flags=0x17 2024-09-14T11:11:51.084 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.086+0000 7f66177fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 to cache LRU end 2024-09-14T11:11:51.084 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.086+0000 7f66177fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:51.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.087+0000 7f6743175800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31]): orig_sources= new_sources= 2024-09-14T11:11:51.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.087+0000 7f6743175800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31]): potential sources added=[] removed=[] 2024-09-14T11:11:51.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.087+0000 7f6743175800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31]): orig_dests= new_dests= 2024-09-14T11:11:51.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.087+0000 7f6743175800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31]): potential dests added=[] removed=[] 2024-09-14T11:11:51.087 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.089+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.0 2024-09-14T11:11:51.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.090+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1 2024-09-14T11:11:51.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.090+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2 2024-09-14T11:11:51.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.090+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.3 2024-09-14T11:11:51.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.091+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.4 2024-09-14T11:11:51.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.091+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.5 2024-09-14T11:11:51.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.091+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.6 2024-09-14T11:11:51.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.092+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.7 2024-09-14T11:11:51.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.092+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.8 2024-09-14T11:11:51.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.092+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.9 2024-09-14T11:11:51.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.092+0000 7f6743175800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.10 2024-09-14T11:11:51.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.093+0000 7f6743175800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-14T11:11:51.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.093+0000 7f6743175800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-14T11:11:51.095 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.097+0000 7f65f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:51.097 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.099+0000 7f6743175800 20 remove_watcher() i=0 2024-09-14T11:11:51.097 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.099+0000 7f6743175800 2 removed watcher, disabling cache 2024-09-14T11:11:51.098 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.100+0000 7f6743175800 20 remove_watcher() i=1 2024-09-14T11:11:51.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.101+0000 7f6743175800 20 remove_watcher() i=2 2024-09-14T11:11:51.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.102+0000 7f6743175800 20 remove_watcher() i=3 2024-09-14T11:11:51.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.103+0000 7f6743175800 20 remove_watcher() i=4 2024-09-14T11:11:51.102 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.104+0000 7f6743175800 20 remove_watcher() i=5 2024-09-14T11:11:51.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.105+0000 7f6743175800 20 remove_watcher() i=6 2024-09-14T11:11:51.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.106+0000 7f6743175800 20 remove_watcher() i=7 2024-09-14T11:11:51.116 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:11:51.146 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:51.146 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:51.185 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.187+0000 7fcd9090c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.189+0000 7fcd9090c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.189+0000 7fcd9090c800 20 realm 2024-09-14T11:11:51.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.189+0000 7fcd9090c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.189+0000 7fcd9090c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.189+0000 7fcd9090c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:51.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.189+0000 7fcd9090c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.190+0000 7fcd9090c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.190+0000 7fcd9090c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.190+0000 7fcd9090c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:51.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.190+0000 7fcd9090c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.189 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.191+0000 7fcd9090c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:51.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.191+0000 7fcd9090c800 20 searching for the correct realm 2024-09-14T11:11:51.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.194+0000 7fcd85bf5640 0 -- 172.21.15.50:0/1760230721 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fcd88017400 msgr2=0x7fcd88017880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:11:51.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.400+0000 7fcd8ebf7640 0 -- 172.21.15.50:0/1760230721 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55b195967e80 msgr2=0x55b19596a2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:51.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.405+0000 7fcd9090c800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:51.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.405+0000 7fcd9090c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:51.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.405+0000 7fcd9090c800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:51.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.405+0000 7fcd9090c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:51.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.405+0000 7fcd9090c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:51.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.405+0000 7fcd9090c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:51.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.405+0000 7fcd9090c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.405+0000 7fcd9090c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.405+0000 7fcd9090c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.406+0000 7fcd9090c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:51.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.406+0000 7fcd9090c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.406+0000 7fcd9090c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:51.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.406+0000 7fcd9090c800 20 zone default found 2024-09-14T11:11:51.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.406+0000 7fcd9090c800 4 Realm: () 2024-09-14T11:11:51.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.406+0000 7fcd9090c800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:51.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.406+0000 7fcd9090c800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:51.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.406+0000 7fcd9090c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:51.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.406+0000 7fcd9090c800 20 zonegroup default 2024-09-14T11:11:51.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.406+0000 7fcd9090c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.406+0000 7fcd9090c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.406+0000 7fcd9090c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.407+0000 7fcd9090c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.407+0000 7fcd9090c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.407+0000 7fcd9090c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.407+0000 7fcd9090c800 20 started sync module instance, tier type = 2024-09-14T11:11:51.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.407+0000 7fcd9090c800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:51.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.416+0000 7fcd9090c800 20 add_watcher() i=0 2024-09-14T11:11:51.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.416+0000 7fcd9090c800 20 add_watcher() i=1 2024-09-14T11:11:51.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.416+0000 7fcd9090c800 20 add_watcher() i=2 2024-09-14T11:11:51.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.416+0000 7fcd9090c800 20 add_watcher() i=3 2024-09-14T11:11:51.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.416+0000 7fcd9090c800 20 add_watcher() i=4 2024-09-14T11:11:51.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.416+0000 7fcd9090c800 20 add_watcher() i=5 2024-09-14T11:11:51.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.416+0000 7fcd9090c800 20 add_watcher() i=6 2024-09-14T11:11:51.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.417+0000 7fcd9090c800 20 add_watcher() i=7 2024-09-14T11:11:51.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.417+0000 7fcd9090c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:51.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.419+0000 7fcc44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:51.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.419+0000 7fcd9090c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:51.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.419+0000 7fcd9090c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:51.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.419+0000 7fcd9090c800 5 note: GC not initialized 2024-09-14T11:11:51.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.419+0000 7fcbbf7fe640 20 reqs_thread_entry: start 2024-09-14T11:11:51.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.419+0000 7fcd9090c800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:51.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.419+0000 7fcd9090c800 20 Filter name: none 2024-09-14T11:11:51.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.419+0000 7fcbbd7fa640 20 reqs_thread_entry: start 2024-09-14T11:11:51.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.420+0000 7fcd9090c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.420+0000 7fcd9090c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:11:51.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.420+0000 7fcd9090c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.420+0000 7fcd9090c800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:11:51.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.420+0000 7fcd9090c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:51.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.420+0000 7fcd9090c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.421+0000 7fcd9090c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:11:51.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.421+0000 7fcd9090c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.421+0000 7fcd9090c800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:11:51.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.421+0000 7fcd9090c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:51.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.423+0000 7fcc44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:51.423 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.425+0000 7fcd9090c800 20 remove_watcher() i=0 2024-09-14T11:11:51.424 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.425+0000 7fcd9090c800 2 removed watcher, disabling cache 2024-09-14T11:11:51.424 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.426+0000 7fcd9090c800 20 remove_watcher() i=1 2024-09-14T11:11:51.426 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.427+0000 7fcd9090c800 20 remove_watcher() i=2 2024-09-14T11:11:51.427 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.429+0000 7fcd9090c800 20 remove_watcher() i=3 2024-09-14T11:11:51.428 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.430+0000 7fcd9090c800 20 remove_watcher() i=4 2024-09-14T11:11:51.429 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.431+0000 7fcd9090c800 20 remove_watcher() i=5 2024-09-14T11:11:51.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.432+0000 7fcd9090c800 20 remove_watcher() i=6 2024-09-14T11:11:51.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.433+0000 7fcd9090c800 20 remove_watcher() i=7 2024-09-14T11:11:51.443 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:51.443 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:11:51.443 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-commit-target-layout id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:11:51.443 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:51.445 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:51.445 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:51.480 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:51.480 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:51.538 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:11:51.571 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:51.571 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:51.610 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.611+0000 7f1727d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.613+0000 7f1727d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.613+0000 7f1727d2e800 20 realm 2024-09-14T11:11:51.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.613+0000 7f1727d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.613+0000 7f1727d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.613+0000 7f1727d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:51.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.613+0000 7f1727d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.613+0000 7f1727d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.613+0000 7f1727d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.614+0000 7f1727d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:51.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.614+0000 7f1727d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.615+0000 7f1727d2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:51.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.615+0000 7f1727d2e800 20 searching for the correct realm 2024-09-14T11:11:51.616 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.618+0000 7f172316a640 0 -- 172.21.15.50:0/1785992295 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f171c00e070 msgr2=0x7f171c0767b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:51.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.622+0000 7f172396b640 0 -- 172.21.15.50:0/1785992295 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f171c08f040 msgr2=0x7f171c06b0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:51.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.626+0000 7f1727d2e800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:51.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.626+0000 7f1727d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:51.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.626+0000 7f1727d2e800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:51.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.626+0000 7f1727d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:51.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.626+0000 7f1727d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:51.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.626+0000 7f1727d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:51.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.626+0000 7f1727d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.626+0000 7f1727d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.626+0000 7f1727d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.626+0000 7f1727d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:51.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.626+0000 7f1727d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.627+0000 7f1727d2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:51.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.627+0000 7f1727d2e800 20 zone default found 2024-09-14T11:11:51.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.627+0000 7f1727d2e800 4 Realm: () 2024-09-14T11:11:51.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.627+0000 7f1727d2e800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:51.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.627+0000 7f1727d2e800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:51.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.627+0000 7f1727d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:51.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.627+0000 7f1727d2e800 20 zonegroup default 2024-09-14T11:11:51.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.627+0000 7f1727d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.627+0000 7f1727d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.627+0000 7f1727d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.627+0000 7f1727d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.627+0000 7f1727d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.627+0000 7f1727d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.627+0000 7f1727d2e800 20 started sync module instance, tier type = 2024-09-14T11:11:51.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.627+0000 7f1727d2e800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:51.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.636+0000 7f1727d2e800 20 add_watcher() i=0 2024-09-14T11:11:51.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.636+0000 7f1727d2e800 20 add_watcher() i=1 2024-09-14T11:11:51.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.636+0000 7f1727d2e800 20 add_watcher() i=2 2024-09-14T11:11:51.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.636+0000 7f1727d2e800 20 add_watcher() i=3 2024-09-14T11:11:51.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.636+0000 7f1727d2e800 20 add_watcher() i=4 2024-09-14T11:11:51.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.636+0000 7f1727d2e800 20 add_watcher() i=5 2024-09-14T11:11:51.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.636+0000 7f1727d2e800 20 add_watcher() i=6 2024-09-14T11:11:51.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.637+0000 7f1727d2e800 20 add_watcher() i=7 2024-09-14T11:11:51.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.637+0000 7f1727d2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:51.636 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.638+0000 7f15da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:51.637 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.638+0000 7f1727d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:51.637 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.638+0000 7f1727d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:51.637 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.638+0000 7f1727d2e800 5 note: GC not initialized 2024-09-14T11:11:51.637 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.639+0000 7f15d97e2640 20 reqs_thread_entry: start 2024-09-14T11:11:51.637 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.639+0000 7f1727d2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:51.637 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.639+0000 7f1727d2e800 20 Filter name: none 2024-09-14T11:11:51.637 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.639+0000 7f15d27fc640 20 reqs_thread_entry: start 2024-09-14T11:11:51.638 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.639+0000 7f1727d2e800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:11:51.638 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.639+0000 7f1727d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.638 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.639+0000 7f1727d2e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:11:51.638 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.639+0000 7f1727d2e800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:11:51.638 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.639+0000 7f1727d2e800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:11:51.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.639+0000 7f1727d2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 : miss 2024-09-14T11:11:51.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.639+0000 7f1727d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.640+0000 7f1727d2e800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:11:51.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.640+0000 7f1727d2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 info.flags=0x17 2024-09-14T11:11:51.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.640+0000 7f1727d2e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 to cache LRU end 2024-09-14T11:11:51.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.640+0000 7f1727d2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:11:51.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.640+0000 7f1727d2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:51.639 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.640+0000 7f1727d2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 2024-09-14T11:11:51.640 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.641+0000 7f1727d2e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:11:51.644 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.646+0000 7f1727d2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 info.flags=0x17 2024-09-14T11:11:51.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.646+0000 7f1727d2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 to cache LRU end 2024-09-14T11:11:51.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.646+0000 7f1727d2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:51.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.646+0000 7f1727d2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31, ofs0, ns] 2024-09-14T11:11:51.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.647+0000 7f16027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497068 cookie 94662757743296 notifier 7293 bl.length()=1015 2024-09-14T11:11:51.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.647+0000 7f16027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 info.flags=0x17 2024-09-14T11:11:51.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.647+0000 7f16027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 to cache LRU end 2024-09-14T11:11:51.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.647+0000 7f16027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:51.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.648+0000 7f1727d2e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31]): orig_sources= new_sources= 2024-09-14T11:11:51.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.648+0000 7f1727d2e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31]): potential sources added=[] removed=[] 2024-09-14T11:11:51.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.648+0000 7f1727d2e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31]): orig_dests= new_dests= 2024-09-14T11:11:51.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.648+0000 7f1727d2e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31]): potential dests added=[] removed=[] 2024-09-14T11:11:51.652 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2.0 2024-09-14T11:11:51.652 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2.0 2024-09-14T11:11:51.652 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2.1 2024-09-14T11:11:51.652 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2.1 2024-09-14T11:11:51.652 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2.2 2024-09-14T11:11:51.652 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2.2 2024-09-14T11:11:51.652 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2.3 2024-09-14T11:11:51.652 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2.3 2024-09-14T11:11:51.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2.4 2024-09-14T11:11:51.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2.4 2024-09-14T11:11:51.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2.5 2024-09-14T11:11:51.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2.5 2024-09-14T11:11:51.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2.6 2024-09-14T11:11:51.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2.6 2024-09-14T11:11:51.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2.7 2024-09-14T11:11:51.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2.7 2024-09-14T11:11:51.654 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2.8 2024-09-14T11:11:51.654 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2.8 2024-09-14T11:11:51.654 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2.9 2024-09-14T11:11:51.654 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2.9 2024-09-14T11:11:51.654 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2.10 2024-09-14T11:11:51.654 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2.10 2024-09-14T11:11:51.654 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2.11 2024-09-14T11:11:51.654 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2.11 2024-09-14T11:11:51.654 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.653+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.0 2024-09-14T11:11:51.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.654+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1 2024-09-14T11:11:51.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.655+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2 2024-09-14T11:11:51.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.655+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.3 2024-09-14T11:11:51.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.655+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.4 2024-09-14T11:11:51.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.656+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.5 2024-09-14T11:11:51.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.657+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.6 2024-09-14T11:11:51.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.657+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.7 2024-09-14T11:11:51.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.657+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.8 2024-09-14T11:11:51.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.658+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.9 2024-09-14T11:11:51.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.658+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.10 2024-09-14T11:11:51.659 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.661+0000 7f1727d2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:11:51.659 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.661+0000 7f1727d2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 2024-09-14T11:11:51.660 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.662+0000 7f1727d2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 info.flags=0x17 2024-09-14T11:11:51.661 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.662+0000 7f1727d2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 to cache LRU end 2024-09-14T11:11:51.661 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.662+0000 7f1727d2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:51.661 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.662+0000 7f1727d2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31, ofs0, ns] 2024-09-14T11:11:51.661 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.662+0000 7f16027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497069 cookie 94662757743296 notifier 7293 bl.length()=1015 2024-09-14T11:11:51.661 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.662+0000 7f16027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 info.flags=0x17 2024-09-14T11:11:51.661 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.662+0000 7f16027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 to cache LRU end 2024-09-14T11:11:51.661 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.662+0000 7f16027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:51.662 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.664+0000 7f1727d2e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31]): orig_sources= new_sources= 2024-09-14T11:11:51.662 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.664+0000 7f1727d2e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31]): potential sources added=[] removed=[] 2024-09-14T11:11:51.662 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.664+0000 7f1727d2e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31]): orig_dests= new_dests= 2024-09-14T11:11:51.662 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.664+0000 7f1727d2e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31]): potential dests added=[] removed=[] 2024-09-14T11:11:51.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.666+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.0 2024-09-14T11:11:51.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.666+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.1 2024-09-14T11:11:51.665 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.667+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.2 2024-09-14T11:11:51.665 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.667+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.3 2024-09-14T11:11:51.666 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.667+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.4 2024-09-14T11:11:51.666 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.668+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.5 2024-09-14T11:11:51.666 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.668+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.6 2024-09-14T11:11:51.666 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.668+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.7 2024-09-14T11:11:51.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.668+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.8 2024-09-14T11:11:51.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.669+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.9 2024-09-14T11:11:51.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.669+0000 7f1727d2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31.10 2024-09-14T11:11:51.668 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.669+0000 7f1727d2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:11:51.668 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.670+0000 7f1727d2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 2024-09-14T11:11:51.669 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.671+0000 7f1727d2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 info.flags=0x17 2024-09-14T11:11:51.669 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.671+0000 7f1727d2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 to cache LRU end 2024-09-14T11:11:51.669 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.671+0000 7f1727d2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:51.669 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.671+0000 7f1727d2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31, ofs0, ns] 2024-09-14T11:11:51.669 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.671+0000 7f16027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497070 cookie 94662757743296 notifier 7293 bl.length()=983 2024-09-14T11:11:51.669 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.671+0000 7f16027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 info.flags=0x17 2024-09-14T11:11:51.670 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.671+0000 7f16027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 to cache LRU end 2024-09-14T11:11:51.670 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.671+0000 7f16027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:51.671 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.673+0000 7f1727d2e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31]): orig_sources= new_sources= 2024-09-14T11:11:51.671 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.673+0000 7f1727d2e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31]): potential sources added=[] removed=[] 2024-09-14T11:11:51.671 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.673+0000 7f1727d2e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31]): orig_dests= new_dests= 2024-09-14T11:11:51.671 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.673+0000 7f1727d2e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31]): potential dests added=[] removed=[] 2024-09-14T11:11:51.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.675+0000 7f1727d2e800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:11:51.674 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.676+0000 7f15da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:51.677 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.679+0000 7f1727d2e800 20 remove_watcher() i=0 2024-09-14T11:11:51.677 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.679+0000 7f1727d2e800 2 removed watcher, disabling cache 2024-09-14T11:11:51.678 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.680+0000 7f1727d2e800 20 remove_watcher() i=1 2024-09-14T11:11:51.679 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.681+0000 7f1727d2e800 20 remove_watcher() i=2 2024-09-14T11:11:51.680 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.682+0000 7f1727d2e800 20 remove_watcher() i=3 2024-09-14T11:11:51.681 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.683+0000 7f1727d2e800 20 remove_watcher() i=4 2024-09-14T11:11:51.682 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.684+0000 7f1727d2e800 20 remove_watcher() i=5 2024-09-14T11:11:51.683 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.685+0000 7f1727d2e800 20 remove_watcher() i=6 2024-09-14T11:11:51.684 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.686+0000 7f1727d2e800 20 remove_watcher() i=7 2024-09-14T11:11:51.697 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:11:51.726 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:51.727 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:51.766 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.768+0000 7f46e63a7800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.770+0000 7f46e63a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.770+0000 7f46e63a7800 20 realm 2024-09-14T11:11:51.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.770+0000 7f46e63a7800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.770+0000 7f46e63a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.770+0000 7f46e63a7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:51.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.770+0000 7f46e63a7800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.770+0000 7f46e63a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.770+0000 7f46e63a7800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.771+0000 7f46e63a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:51.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.771+0000 7f46e63a7800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.772+0000 7f46e63a7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:51.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.772+0000 7f46e63a7800 20 searching for the correct realm 2024-09-14T11:11:51.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.775+0000 7f46e3690640 0 -- 172.21.15.50:0/2646032542 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f46dc061930 msgr2=0x7f46dc055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:11:51.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.981+0000 7f46e4692640 0 -- 172.21.15.50:0/2646032542 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x56551f3bd1a0 msgr2=0x56551f3bf590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:51.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.985+0000 7f46e63a7800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:51.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.985+0000 7f46e63a7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:51.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.985+0000 7f46e63a7800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:51.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.985+0000 7f46e63a7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:51.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.985+0000 7f46e63a7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:51.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.985+0000 7f46e63a7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:51.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.985+0000 7f46e63a7800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.985 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.986+0000 7f46e63a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.985 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.986+0000 7f46e63a7800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.985 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.986+0000 7f46e63a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:51.985 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.986+0000 7f46e63a7800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.986+0000 7f46e63a7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:51.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.986+0000 7f46e63a7800 20 zone default found 2024-09-14T11:11:51.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.986+0000 7f46e63a7800 4 Realm: () 2024-09-14T11:11:51.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.986+0000 7f46e63a7800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:51.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.986+0000 7f46e63a7800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:51.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.986+0000 7f46e63a7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:51.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.986+0000 7f46e63a7800 20 zonegroup default 2024-09-14T11:11:51.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.986+0000 7f46e63a7800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.987+0000 7f46e63a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.987+0000 7f46e63a7800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.987+0000 7f46e63a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.987+0000 7f46e63a7800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.987+0000 7f46e63a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:51.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.987+0000 7f46e63a7800 20 started sync module instance, tier type = 2024-09-14T11:11:51.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.987+0000 7f46e63a7800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:51.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.996+0000 7f46e63a7800 20 add_watcher() i=0 2024-09-14T11:11:51.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.996+0000 7f46e63a7800 20 add_watcher() i=1 2024-09-14T11:11:51.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.996+0000 7f46e63a7800 20 add_watcher() i=2 2024-09-14T11:11:51.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.996+0000 7f46e63a7800 20 add_watcher() i=3 2024-09-14T11:11:51.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.996+0000 7f46e63a7800 20 add_watcher() i=4 2024-09-14T11:11:51.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.996+0000 7f46e63a7800 20 add_watcher() i=5 2024-09-14T11:11:51.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.996+0000 7f46e63a7800 20 add_watcher() i=6 2024-09-14T11:11:51.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.997+0000 7f46e63a7800 20 add_watcher() i=7 2024-09-14T11:11:51.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.997+0000 7f46e63a7800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:51.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.999+0000 7f4599fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:51.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.999+0000 7f46e63a7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:51.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.999+0000 7f46e63a7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:51.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.999+0000 7f46e63a7800 5 note: GC not initialized 2024-09-14T11:11:51.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:51.999+0000 7f4598fe1640 20 reqs_thread_entry: start 2024-09-14T11:11:51.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:52.000+0000 7f46e63a7800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:51.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:52.000+0000 7f46e63a7800 20 Filter name: none 2024-09-14T11:11:51.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:52.000+0000 7f45127fc640 20 reqs_thread_entry: start 2024-09-14T11:11:51.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:52.000+0000 7f46e63a7800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:52.000+0000 7f46e63a7800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:11:51.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:52.000+0000 7f46e63a7800 20 rados->read ofs=0 len=0 2024-09-14T11:11:51.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:52.001+0000 7f46e63a7800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:11:51.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:52.001+0000 7f46e63a7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:51.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:52.001+0000 7f46e63a7800 20 rados->read ofs=0 len=0 2024-09-14T11:11:52.000 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:52.001+0000 7f46e63a7800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:11:52.000 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:52.001+0000 7f46e63a7800 20 rados->read ofs=0 len=0 2024-09-14T11:11:52.000 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:52.001+0000 7f46e63a7800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:11:52.000 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:52.001+0000 7f46e63a7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:52.002 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:52.004+0000 7f4599fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:52.004 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:52.006+0000 7f46e63a7800 20 remove_watcher() i=0 2024-09-14T11:11:52.004 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:52.006+0000 7f46e63a7800 2 removed watcher, disabling cache 2024-09-14T11:11:52.005 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:52.007+0000 7f46e63a7800 20 remove_watcher() i=1 2024-09-14T11:11:52.006 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:52.008+0000 7f46e63a7800 20 remove_watcher() i=2 2024-09-14T11:11:52.007 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:52.009+0000 7f46e63a7800 20 remove_watcher() i=3 2024-09-14T11:11:52.007 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:52.009+0000 7f46e63a7800 20 remove_watcher() i=4 2024-09-14T11:11:52.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:52.011+0000 7f46e63a7800 20 remove_watcher() i=5 2024-09-14T11:11:52.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:52.011+0000 7f46e63a7800 20 remove_watcher() i=6 2024-09-14T11:11:52.010 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:52.012+0000 7f46e63a7800 20 remove_watcher() i=7 2024-09-14T11:11:52.022 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:52.022 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:11:52.022 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-commit-target-layout id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:11:52.022 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:52.024 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:52.024 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:52.047 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:52.047 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:52.299 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:52.299 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:52.434 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-14T11:11:52.434 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:52.435 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:52.435 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:52.483 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:52.483 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:52.540 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:52.541 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:52.576 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:52.576 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:52.613 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:52.614 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:52.651 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:52.651 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:52.687 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:52.687 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:52.724 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:52.724 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:52.762 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:52.762 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:52.799 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:52.800 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:52.836 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:52.836 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:52.873 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:52.873 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:52.909 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:52.909 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:52.946 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:52.946 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:52.986 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:52.986 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:53.025 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:53.025 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:53.063 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:53.063 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:53.101 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:53.101 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:53.139 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:53.139 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:53.176 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:53.176 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:53.213 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:53.213 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:53.250 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:53.250 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:53.290 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:11:53.319 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:53.320 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:53.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.360+0000 7f5d4a840800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.360 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.362+0000 7f5d4a840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:53.360 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.362+0000 7f5d4a840800 20 realm 2024-09-14T11:11:53.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.362+0000 7f5d4a840800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.362+0000 7f5d4a840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:53.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.362+0000 7f5d4a840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:53.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.362+0000 7f5d4a840800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.362+0000 7f5d4a840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:53.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.362+0000 7f5d4a840800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.363+0000 7f5d4a840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:53.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.363+0000 7f5d4a840800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.364+0000 7f5d4a840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:53.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.364+0000 7f5d4a840800 20 searching for the correct realm 2024-09-14T11:11:53.365 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.367+0000 7f5d47b29640 0 -- 172.21.15.50:0/4152302444 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f5d4006b440 msgr2=0x7f5d4006b8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:53.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.572+0000 7f5d48b2b640 0 -- 172.21.15.50:0/4152302444 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55c984211570 msgr2=0x55c9842139d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:53.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.576+0000 7f5d4a840800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:53.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.576+0000 7f5d4a840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:53.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.576+0000 7f5d4a840800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:53.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.576+0000 7f5d4a840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:53.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.576+0000 7f5d4a840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:53.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.576+0000 7f5d4a840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:53.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.576+0000 7f5d4a840800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.577+0000 7f5d4a840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:53.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.577+0000 7f5d4a840800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.577+0000 7f5d4a840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:53.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.577+0000 7f5d4a840800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.577+0000 7f5d4a840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:53.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.577+0000 7f5d4a840800 20 zone default found 2024-09-14T11:11:53.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.577+0000 7f5d4a840800 4 Realm: () 2024-09-14T11:11:53.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.577+0000 7f5d4a840800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:53.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.577+0000 7f5d4a840800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:53.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.577+0000 7f5d4a840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:53.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.577+0000 7f5d4a840800 20 zonegroup default 2024-09-14T11:11:53.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.577+0000 7f5d4a840800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.577+0000 7f5d4a840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:53.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.577+0000 7f5d4a840800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.578+0000 7f5d4a840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:53.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.578+0000 7f5d4a840800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.578+0000 7f5d4a840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:53.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.578+0000 7f5d4a840800 20 started sync module instance, tier type = 2024-09-14T11:11:53.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.578+0000 7f5d4a840800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:53.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.587+0000 7f5d4a840800 20 add_watcher() i=0 2024-09-14T11:11:53.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.587+0000 7f5d4a840800 20 add_watcher() i=1 2024-09-14T11:11:53.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.587+0000 7f5d4a840800 20 add_watcher() i=2 2024-09-14T11:11:53.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.587+0000 7f5d4a840800 20 add_watcher() i=3 2024-09-14T11:11:53.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.587+0000 7f5d4a840800 20 add_watcher() i=4 2024-09-14T11:11:53.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.587+0000 7f5d4a840800 20 add_watcher() i=5 2024-09-14T11:11:53.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.587+0000 7f5d4a840800 20 add_watcher() i=6 2024-09-14T11:11:53.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.588+0000 7f5d4a840800 20 add_watcher() i=7 2024-09-14T11:11:53.586 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.588+0000 7f5d4a840800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:53.587 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.589+0000 7f5bfefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:53.588 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.590+0000 7f5d4a840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:53.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.590+0000 7f5d4a840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:53.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.590+0000 7f5d4a840800 5 note: GC not initialized 2024-09-14T11:11:53.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.590+0000 7f5bfdfdb640 20 reqs_thread_entry: start 2024-09-14T11:11:53.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.590+0000 7f5d4a840800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:53.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.590+0000 7f5d4a840800 20 Filter name: none 2024-09-14T11:11:53.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.590+0000 7f5b6f7fe640 20 reqs_thread_entry: start 2024-09-14T11:11:53.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.590+0000 7f5d4a840800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.590 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.591+0000 7f5d4a840800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:11:53.590 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.591+0000 7f5d4a840800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.590 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.592+0000 7f5d4a840800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:11:53.590 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.592+0000 7f5d4a840800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:53.590 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.592+0000 7f5d4a840800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.590 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.592+0000 7f5d4a840800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:11:53.590 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.592+0000 7f5d4a840800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.591 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.593+0000 7f5d4a840800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:11:53.591 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.593+0000 7f5d4a840800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:53.592 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.594+0000 7f5bfefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:53.594 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.596+0000 7f5d4a840800 20 remove_watcher() i=0 2024-09-14T11:11:53.594 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.596+0000 7f5d4a840800 2 removed watcher, disabling cache 2024-09-14T11:11:53.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.597+0000 7f5d4a840800 20 remove_watcher() i=1 2024-09-14T11:11:53.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.598+0000 7f5d4a840800 20 remove_watcher() i=2 2024-09-14T11:11:53.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.599+0000 7f5d4a840800 20 remove_watcher() i=3 2024-09-14T11:11:53.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.600+0000 7f5d4a840800 20 remove_watcher() i=4 2024-09-14T11:11:53.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.601+0000 7f5d4a840800 20 remove_watcher() i=5 2024-09-14T11:11:53.600 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.602+0000 7f5d4a840800 20 remove_watcher() i=6 2024-09-14T11:11:53.601 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.603+0000 7f5d4a840800 20 remove_watcher() i=7 2024-09-14T11:11:53.613 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:53.613 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:11:53.613 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-commit-target-layout id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:11:53.613 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:53.615 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-14T11:11:53.652 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:53.652 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:53.691 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.693+0000 7f9f3cb3a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.695+0000 7f9f3cb3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:53.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.695+0000 7f9f3cb3a800 20 realm 2024-09-14T11:11:53.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.695+0000 7f9f3cb3a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.695+0000 7f9f3cb3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:53.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.695+0000 7f9f3cb3a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:53.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.695+0000 7f9f3cb3a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.695+0000 7f9f3cb3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:53.694 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.695+0000 7f9f3cb3a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.694 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.696+0000 7f9f3cb3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:53.694 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.696+0000 7f9f3cb3a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.695 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.696+0000 7f9f3cb3a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:53.695 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.696+0000 7f9f3cb3a800 20 searching for the correct realm 2024-09-14T11:11:53.698 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.700+0000 7f9f380ba640 0 -- 172.21.15.50:0/1460006317 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f9f3002b410 msgr2=0x7f9f3002b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:53.904 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.905+0000 7f9f390bc640 0 -- 172.21.15.50:0/1460006317 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x563cd37e2d00 msgr2=0x563cd37e5190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:53.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.910+0000 7f9f3cb3a800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:53.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.910+0000 7f9f3cb3a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:53.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.910+0000 7f9f3cb3a800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:53.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.910+0000 7f9f3cb3a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:53.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.910+0000 7f9f3cb3a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:53.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.910+0000 7f9f3cb3a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:53.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.910+0000 7f9f3cb3a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.910+0000 7f9f3cb3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:53.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.910+0000 7f9f3cb3a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.910+0000 7f9f3cb3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:53.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.910+0000 7f9f3cb3a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.910+0000 7f9f3cb3a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:53.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.911+0000 7f9f3cb3a800 20 zone default found 2024-09-14T11:11:53.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.911+0000 7f9f3cb3a800 4 Realm: () 2024-09-14T11:11:53.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.911+0000 7f9f3cb3a800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:53.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.911+0000 7f9f3cb3a800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:53.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.911+0000 7f9f3cb3a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:53.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.911+0000 7f9f3cb3a800 20 zonegroup default 2024-09-14T11:11:53.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.911+0000 7f9f3cb3a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.911+0000 7f9f3cb3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:53.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.911+0000 7f9f3cb3a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.911+0000 7f9f3cb3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:53.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.911+0000 7f9f3cb3a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.911+0000 7f9f3cb3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:53.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.911+0000 7f9f3cb3a800 20 started sync module instance, tier type = 2024-09-14T11:11:53.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.911+0000 7f9f3cb3a800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:53.918 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.920+0000 7f9f3cb3a800 20 add_watcher() i=0 2024-09-14T11:11:53.918 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.920+0000 7f9f3cb3a800 20 add_watcher() i=1 2024-09-14T11:11:53.918 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.920+0000 7f9f3cb3a800 20 add_watcher() i=2 2024-09-14T11:11:53.918 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.920+0000 7f9f3cb3a800 20 add_watcher() i=3 2024-09-14T11:11:53.918 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.920+0000 7f9f3cb3a800 20 add_watcher() i=4 2024-09-14T11:11:53.918 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.920+0000 7f9f3cb3a800 20 add_watcher() i=5 2024-09-14T11:11:53.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.920+0000 7f9f3cb3a800 20 add_watcher() i=6 2024-09-14T11:11:53.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.921+0000 7f9f3cb3a800 20 add_watcher() i=7 2024-09-14T11:11:53.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.921+0000 7f9f3cb3a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:53.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.923+0000 7f9deefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:53.922 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.923+0000 7f9f3cb3a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:53.922 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.923+0000 7f9f3cb3a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:53.922 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.923+0000 7f9f3cb3a800 5 note: GC not initialized 2024-09-14T11:11:53.922 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.924+0000 7f9dedfe3640 20 reqs_thread_entry: start 2024-09-14T11:11:53.922 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.924+0000 7f9f3cb3a800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:53.922 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.924+0000 7f9f3cb3a800 20 Filter name: none 2024-09-14T11:11:53.922 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.924+0000 7f9d5f7fe640 20 reqs_thread_entry: start 2024-09-14T11:11:53.922 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.924+0000 7f9f3cb3a800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:11:53.923 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.924+0000 7f9f3cb3a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.923 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.924+0000 7f9f3cb3a800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:11:53.923 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.924+0000 7f9f3cb3a800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:11:53.923 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.924+0000 7f9f3cb3a800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:11:53.923 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.924+0000 7f9f3cb3a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32 : miss 2024-09-14T11:11:53.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.924+0000 7f9f3cb3a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:53.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.925+0000 7f9f3cb3a800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:11:53.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.925+0000 7f9f3cb3a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32 info.flags=0x17 2024-09-14T11:11:53.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.925+0000 7f9f3cb3a800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32 to cache LRU end 2024-09-14T11:11:53.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.925+0000 7f9f3cb3a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:11:53.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.925+0000 7f9f3cb3a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:53.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.925+0000 7f9f3cb3a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32 2024-09-14T11:11:53.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.930+0000 7f9f3cb3a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32 info.flags=0x17 2024-09-14T11:11:53.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.930+0000 7f9f3cb3a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32 to cache LRU end 2024-09-14T11:11:53.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.930+0000 7f9f3cb3a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:53.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.930+0000 7f9f3cb3a800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32, ofs0, ns] 2024-09-14T11:11:53.929 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.930+0000 7f9e0f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497073 cookie 94819246363808 notifier 7353 bl.length()=1015 2024-09-14T11:11:53.929 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.930+0000 7f9e0f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32 info.flags=0x17 2024-09-14T11:11:53.929 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.930+0000 7f9e0f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32 to cache LRU end 2024-09-14T11:11:53.929 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.930+0000 7f9e0f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:53.930 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.932+0000 7f9f3cb3a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32]): orig_sources= new_sources= 2024-09-14T11:11:53.930 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.932+0000 7f9f3cb3a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32]): potential sources added=[] removed=[] 2024-09-14T11:11:53.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.932+0000 7f9f3cb3a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32]): orig_dests= new_dests= 2024-09-14T11:11:53.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.932+0000 7f9f3cb3a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32]): potential dests added=[] removed=[] 2024-09-14T11:11:53.935 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1.0 2024-09-14T11:11:53.935 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1.0 2024-09-14T11:11:53.935 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1.1 2024-09-14T11:11:53.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1.1 2024-09-14T11:11:53.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1.2 2024-09-14T11:11:53.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1.2 2024-09-14T11:11:53.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1.3 2024-09-14T11:11:53.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1.3 2024-09-14T11:11:53.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1.4 2024-09-14T11:11:53.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1.4 2024-09-14T11:11:53.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1.5 2024-09-14T11:11:53.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1.5 2024-09-14T11:11:53.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1.6 2024-09-14T11:11:53.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1.6 2024-09-14T11:11:53.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1.7 2024-09-14T11:11:53.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1.7 2024-09-14T11:11:53.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1.8 2024-09-14T11:11:53.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1.8 2024-09-14T11:11:53.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1.9 2024-09-14T11:11:53.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1.9 2024-09-14T11:11:53.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1.10 2024-09-14T11:11:53.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1.10 2024-09-14T11:11:53.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1.11 2024-09-14T11:11:53.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1.11 2024-09-14T11:11:53.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.0 2024-09-14T11:11:53.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.937+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1 2024-09-14T11:11:53.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.938+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.2 2024-09-14T11:11:53.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.938+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.3 2024-09-14T11:11:53.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.939+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.4 2024-09-14T11:11:53.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.939+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.5 2024-09-14T11:11:53.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.940+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.6 2024-09-14T11:11:53.939 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.940+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.7 2024-09-14T11:11:53.939 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.941+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.8 2024-09-14T11:11:53.939 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.941+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.9 2024-09-14T11:11:53.940 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.942+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.10 2024-09-14T11:11:53.943 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.945+0000 7f9f3cb3a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:11:53.943 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.945+0000 7f9f3cb3a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32 2024-09-14T11:11:53.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.947+0000 7f9f3cb3a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32 info.flags=0x17 2024-09-14T11:11:53.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.947+0000 7f9f3cb3a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32 to cache LRU end 2024-09-14T11:11:53.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.947+0000 7f9f3cb3a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:53.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.947+0000 7f9f3cb3a800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32, ofs0, ns] 2024-09-14T11:11:53.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.947+0000 7f9e0ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497074 cookie 94819246363808 notifier 7353 bl.length()=1015 2024-09-14T11:11:53.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.947+0000 7f9e0ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32 info.flags=0x17 2024-09-14T11:11:53.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.947+0000 7f9e0ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32 to cache LRU end 2024-09-14T11:11:53.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.947+0000 7f9e0ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:53.947 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.949+0000 7f9f3cb3a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32]): orig_sources= new_sources= 2024-09-14T11:11:53.947 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.949+0000 7f9f3cb3a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32]): potential sources added=[] removed=[] 2024-09-14T11:11:53.947 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.949+0000 7f9f3cb3a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32]): orig_dests= new_dests= 2024-09-14T11:11:53.947 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.949+0000 7f9f3cb3a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32]): potential dests added=[] removed=[] 2024-09-14T11:11:53.949 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.951+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.0 2024-09-14T11:11:53.949 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.951+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.1 2024-09-14T11:11:53.950 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.952+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.2 2024-09-14T11:11:53.950 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.952+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.3 2024-09-14T11:11:53.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.952+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.4 2024-09-14T11:11:53.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.953+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.5 2024-09-14T11:11:53.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.953+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.6 2024-09-14T11:11:53.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.953+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.7 2024-09-14T11:11:53.952 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.954+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.8 2024-09-14T11:11:53.952 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.954+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.9 2024-09-14T11:11:53.952 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.954+0000 7f9f3cb3a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32.10 2024-09-14T11:11:53.953 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.955+0000 7f9f3cb3a800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-14T11:11:53.953 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.955+0000 7f9f3cb3a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:11:53.953 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.955+0000 7f9f3cb3a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32 2024-09-14T11:11:53.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.956+0000 7f9f3cb3a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32 info.flags=0x17 2024-09-14T11:11:53.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.956+0000 7f9f3cb3a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32 to cache LRU end 2024-09-14T11:11:53.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.956+0000 7f9f3cb3a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:53.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.956+0000 7f9f3cb3a800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32, ofs0, ns] 2024-09-14T11:11:53.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.956+0000 7f9e0f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497075 cookie 94819246363808 notifier 7353 bl.length()=983 2024-09-14T11:11:53.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.956+0000 7f9e0f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32 info.flags=0x17 2024-09-14T11:11:53.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.956+0000 7f9e0f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32 to cache LRU end 2024-09-14T11:11:53.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.956+0000 7f9e0f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:53.956 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.958+0000 7f9f3cb3a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32]): orig_sources= new_sources= 2024-09-14T11:11:53.956 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.958+0000 7f9f3cb3a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32]): potential sources added=[] removed=[] 2024-09-14T11:11:53.956 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.958+0000 7f9f3cb3a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32]): orig_dests= new_dests= 2024-09-14T11:11:53.956 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.958+0000 7f9f3cb3a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32]): potential dests added=[] removed=[] 2024-09-14T11:11:53.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.960+0000 7f9f3cb3a800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:11:53.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.962+0000 7f9deefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:53.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.964+0000 7f9f3cb3a800 20 remove_watcher() i=0 2024-09-14T11:11:53.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.964+0000 7f9f3cb3a800 2 removed watcher, disabling cache 2024-09-14T11:11:53.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.965+0000 7f9f3cb3a800 20 remove_watcher() i=1 2024-09-14T11:11:53.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.966+0000 7f9f3cb3a800 20 remove_watcher() i=2 2024-09-14T11:11:53.965 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.967+0000 7f9f3cb3a800 20 remove_watcher() i=3 2024-09-14T11:11:53.965 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.967+0000 7f9f3cb3a800 20 remove_watcher() i=4 2024-09-14T11:11:53.966 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.968+0000 7f9f3cb3a800 20 remove_watcher() i=5 2024-09-14T11:11:53.967 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.969+0000 7f9f3cb3a800 20 remove_watcher() i=6 2024-09-14T11:11:53.968 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:53.970+0000 7f9f3cb3a800 20 remove_watcher() i=7 2024-09-14T11:11:53.982 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:11:54.011 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:54.011 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:54.053 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.054+0000 7f6546a11800 20 rados->read ofs=0 len=0 2024-09-14T11:11:54.054 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.056+0000 7f6546a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:54.054 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.056+0000 7f6546a11800 20 realm 2024-09-14T11:11:54.055 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.056+0000 7f6546a11800 20 rados->read ofs=0 len=0 2024-09-14T11:11:54.055 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.056+0000 7f6546a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:54.055 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.056+0000 7f6546a11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:54.055 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.056+0000 7f6546a11800 20 rados->read ofs=0 len=0 2024-09-14T11:11:54.055 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.056+0000 7f6546a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:54.055 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.056+0000 7f6546a11800 20 rados->read ofs=0 len=0 2024-09-14T11:11:54.055 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.057+0000 7f6546a11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:54.055 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.057+0000 7f6546a11800 20 rados->read ofs=0 len=0 2024-09-14T11:11:54.056 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.058+0000 7f6546a11800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:54.056 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.058+0000 7f6546a11800 20 searching for the correct realm 2024-09-14T11:11:54.059 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.061+0000 7f6541947640 0 -- 172.21.15.50:0/504488514 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f653c016c00 msgr2=0x7f653c031920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:54.265 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.266+0000 7f6542949640 0 -- 172.21.15.50:0/504488514 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5644d9ec3010 msgr2=0x5644d9ec5450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:54.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.270+0000 7f6546a11800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:54.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.270+0000 7f6546a11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:54.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.270+0000 7f6546a11800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:54.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.270+0000 7f6546a11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:54.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.270+0000 7f6546a11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:54.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.270+0000 7f6546a11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:54.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.271+0000 7f6546a11800 20 rados->read ofs=0 len=0 2024-09-14T11:11:54.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.271+0000 7f6546a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:54.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.271+0000 7f6546a11800 20 rados->read ofs=0 len=0 2024-09-14T11:11:54.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.271+0000 7f6546a11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:54.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.271+0000 7f6546a11800 20 rados->read ofs=0 len=0 2024-09-14T11:11:54.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.271+0000 7f6546a11800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:54.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.271+0000 7f6546a11800 20 zone default found 2024-09-14T11:11:54.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.271+0000 7f6546a11800 4 Realm: () 2024-09-14T11:11:54.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.271+0000 7f6546a11800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:54.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.271+0000 7f6546a11800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:54.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.271+0000 7f6546a11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:54.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.271+0000 7f6546a11800 20 zonegroup default 2024-09-14T11:11:54.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.271+0000 7f6546a11800 20 rados->read ofs=0 len=0 2024-09-14T11:11:54.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.272+0000 7f6546a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:54.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.272+0000 7f6546a11800 20 rados->read ofs=0 len=0 2024-09-14T11:11:54.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.272+0000 7f6546a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:54.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.272+0000 7f6546a11800 20 rados->read ofs=0 len=0 2024-09-14T11:11:54.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.272+0000 7f6546a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:54.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.272+0000 7f6546a11800 20 started sync module instance, tier type = 2024-09-14T11:11:54.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.272+0000 7f6546a11800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:54.279 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.281+0000 7f6546a11800 20 add_watcher() i=0 2024-09-14T11:11:54.279 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.281+0000 7f6546a11800 20 add_watcher() i=1 2024-09-14T11:11:54.279 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.281+0000 7f6546a11800 20 add_watcher() i=2 2024-09-14T11:11:54.279 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.281+0000 7f6546a11800 20 add_watcher() i=3 2024-09-14T11:11:54.279 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.281+0000 7f6546a11800 20 add_watcher() i=4 2024-09-14T11:11:54.279 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.281+0000 7f6546a11800 20 add_watcher() i=5 2024-09-14T11:11:54.279 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.281+0000 7f6546a11800 20 add_watcher() i=6 2024-09-14T11:11:54.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.282+0000 7f6546a11800 20 add_watcher() i=7 2024-09-14T11:11:54.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.282+0000 7f6546a11800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:54.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.283+0000 7f63f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:54.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.284+0000 7f6546a11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:54.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.284+0000 7f6546a11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:54.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.284+0000 7f6546a11800 5 note: GC not initialized 2024-09-14T11:11:54.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.284+0000 7f63737fe640 20 reqs_thread_entry: start 2024-09-14T11:11:54.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.284+0000 7f6546a11800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:54.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.284+0000 7f6546a11800 20 Filter name: none 2024-09-14T11:11:54.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.284+0000 7f63717fa640 20 reqs_thread_entry: start 2024-09-14T11:11:54.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.284+0000 7f6546a11800 20 rados->read ofs=0 len=0 2024-09-14T11:11:54.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.285+0000 7f6546a11800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:11:54.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.285+0000 7f6546a11800 20 rados->read ofs=0 len=0 2024-09-14T11:11:54.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.285+0000 7f6546a11800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:11:54.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.285+0000 7f6546a11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:54.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.285+0000 7f6546a11800 20 rados->read ofs=0 len=0 2024-09-14T11:11:54.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.285+0000 7f6546a11800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:11:54.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.285+0000 7f6546a11800 20 rados->read ofs=0 len=0 2024-09-14T11:11:54.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.286+0000 7f6546a11800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:11:54.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.286+0000 7f6546a11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:54.285 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.287+0000 7f63f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:54.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.290+0000 7f6546a11800 20 remove_watcher() i=0 2024-09-14T11:11:54.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.290+0000 7f6546a11800 2 removed watcher, disabling cache 2024-09-14T11:11:54.289 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.291+0000 7f6546a11800 20 remove_watcher() i=1 2024-09-14T11:11:54.289 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.291+0000 7f6546a11800 20 remove_watcher() i=2 2024-09-14T11:11:54.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.292+0000 7f6546a11800 20 remove_watcher() i=3 2024-09-14T11:11:54.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.294+0000 7f6546a11800 20 remove_watcher() i=4 2024-09-14T11:11:54.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.295+0000 7f6546a11800 20 remove_watcher() i=5 2024-09-14T11:11:54.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.295+0000 7f6546a11800 20 remove_watcher() i=6 2024-09-14T11:11:54.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:54.296+0000 7f6546a11800 20 remove_watcher() i=7 2024-09-14T11:11:54.306 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:54.306 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:11:54.306 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-commit-target-layout id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:11:54.306 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:54.308 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:54.308 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:54.326 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:54.326 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:54.566 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:54.566 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:54.700 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-14T11:11:54.700 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:54.701 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:54.701 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:54.750 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:54.750 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:54.808 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:54.808 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:54.846 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:54.846 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:54.883 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:54.883 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:54.920 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:54.920 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:54.958 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:54.959 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:54.995 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:54.995 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:55.032 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:55.032 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:55.071 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:55.071 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:55.109 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:55.109 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:55.145 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:55.145 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:55.183 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:55.183 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:55.222 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:55.222 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:55.260 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:55.260 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:55.301 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:55.301 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:55.338 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:55.338 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:55.374 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:55.374 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:55.411 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:55.411 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:55.450 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:55.450 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:55.489 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:55.489 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:55.525 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:55.525 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:11:55.561 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:11:55.590 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:55.591 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:55.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:55.829+0000 7f86efe68640 0 --2- 172.21.15.50:0/828969512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ea008103f0 0x55ea0080a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:11:55.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:55.834+0000 7f86f4122800 20 rados->read ofs=0 len=0 2024-09-14T11:11:55.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:55.836+0000 7f86f4122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:55.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:55.836+0000 7f86f4122800 20 realm 2024-09-14T11:11:55.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:55.836+0000 7f86f4122800 20 rados->read ofs=0 len=0 2024-09-14T11:11:55.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:55.836+0000 7f86f4122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:55.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:55.836+0000 7f86f4122800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:55.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:55.836+0000 7f86f4122800 20 rados->read ofs=0 len=0 2024-09-14T11:11:55.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:55.836+0000 7f86f4122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:55.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:55.836+0000 7f86f4122800 20 rados->read ofs=0 len=0 2024-09-14T11:11:55.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:55.837+0000 7f86f4122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:55.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:55.837+0000 7f86f4122800 20 rados->read ofs=0 len=0 2024-09-14T11:11:55.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:55.838+0000 7f86f4122800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:55.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:55.838+0000 7f86f4122800 20 searching for the correct realm 2024-09-14T11:11:55.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:55.838+0000 7f86f0669640 0 -- 172.21.15.50:0/3015435485 >> [v2:172.21.15.118:6816/4154782182,v1:172.21.15.118:6817/4154782182] conn(0x55ea00835e50 msgr2=0x55ea00838310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:56.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.044+0000 7f86f0669640 0 -- 172.21.15.50:0/3015435485 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55ea00829610 msgr2=0x55ea0082bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:56.050 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.051+0000 7f86f4122800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:56.050 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.051+0000 7f86f4122800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:56.050 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.051+0000 7f86f4122800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:56.050 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.051+0000 7f86f4122800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:56.050 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.051+0000 7f86f4122800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:56.050 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.051+0000 7f86f4122800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:56.050 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.051+0000 7f86f4122800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.050 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.052+0000 7f86f4122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.050 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.052+0000 7f86f4122800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.051 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.052+0000 7f86f4122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:56.051 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.052+0000 7f86f4122800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.052+0000 7f86f4122800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:56.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.052+0000 7f86f4122800 20 zone default found 2024-09-14T11:11:56.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.052+0000 7f86f4122800 4 Realm: () 2024-09-14T11:11:56.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.052+0000 7f86f4122800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:56.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.052+0000 7f86f4122800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:56.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.052+0000 7f86f4122800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:56.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.052+0000 7f86f4122800 20 zonegroup default 2024-09-14T11:11:56.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.052+0000 7f86f4122800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.053+0000 7f86f4122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.053+0000 7f86f4122800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.053+0000 7f86f4122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.053+0000 7f86f4122800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.053+0000 7f86f4122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.053+0000 7f86f4122800 20 started sync module instance, tier type = 2024-09-14T11:11:56.053 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.053+0000 7f86f4122800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:56.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.062+0000 7f86f4122800 20 add_watcher() i=0 2024-09-14T11:11:56.061 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.062+0000 7f86f4122800 20 add_watcher() i=1 2024-09-14T11:11:56.061 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.062+0000 7f86f4122800 20 add_watcher() i=2 2024-09-14T11:11:56.061 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.062+0000 7f86f4122800 20 add_watcher() i=3 2024-09-14T11:11:56.061 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.062+0000 7f86f4122800 20 add_watcher() i=4 2024-09-14T11:11:56.061 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.062+0000 7f86f4122800 20 add_watcher() i=5 2024-09-14T11:11:56.061 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.062+0000 7f86f4122800 20 add_watcher() i=6 2024-09-14T11:11:56.061 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.063+0000 7f86f4122800 20 add_watcher() i=7 2024-09-14T11:11:56.061 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.063+0000 7f86f4122800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:56.063 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.065+0000 7f85a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:56.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.066+0000 7f86f4122800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:56.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.066+0000 7f86f4122800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:56.065 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.066+0000 7f86f4122800 5 note: GC not initialized 2024-09-14T11:11:56.065 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.066+0000 7f85a4fe1640 20 reqs_thread_entry: start 2024-09-14T11:11:56.065 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.066+0000 7f86f4122800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:56.065 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.066+0000 7f86f4122800 20 Filter name: none 2024-09-14T11:11:56.065 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.066+0000 7f851e7fc640 20 reqs_thread_entry: start 2024-09-14T11:11:56.065 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.066+0000 7f86f4122800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.066 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.067+0000 7f86f4122800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:11:56.066 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.067+0000 7f86f4122800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.066 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.067+0000 7f86f4122800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:11:56.066 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.067+0000 7f86f4122800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:56.066 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.067+0000 7f86f4122800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.066 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.068+0000 7f86f4122800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:11:56.066 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.068+0000 7f86f4122800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.067 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.068+0000 7f86f4122800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:11:56.067 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.068+0000 7f86f4122800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:56.068 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.070+0000 7f85a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:56.070 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.072+0000 7f86f4122800 20 remove_watcher() i=0 2024-09-14T11:11:56.070 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.072+0000 7f86f4122800 2 removed watcher, disabling cache 2024-09-14T11:11:56.071 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.073+0000 7f86f4122800 20 remove_watcher() i=1 2024-09-14T11:11:56.072 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.074+0000 7f86f4122800 20 remove_watcher() i=2 2024-09-14T11:11:56.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.075+0000 7f86f4122800 20 remove_watcher() i=3 2024-09-14T11:11:56.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.076+0000 7f86f4122800 20 remove_watcher() i=4 2024-09-14T11:11:56.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.078+0000 7f86f4122800 20 remove_watcher() i=5 2024-09-14T11:11:56.077 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.078+0000 7f86f4122800 20 remove_watcher() i=6 2024-09-14T11:11:56.077 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.079+0000 7f86f4122800 20 remove_watcher() i=7 2024-09-14T11:11:56.089 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.089 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:11:56.090 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: abort-at-commit-target-layout id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:11:56.090 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.091 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-14T11:11:56.127 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:56.127 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:56.166 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.168+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.168 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.169+0000 7fd5ead30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.168 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.169+0000 7fd5ead30800 20 realm 2024-09-14T11:11:56.168 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.169+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.168 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.170+0000 7fd5ead30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.168 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.170+0000 7fd5ead30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:56.168 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.170+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.168 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.170+0000 7fd5ead30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.169 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.170+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.169 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.171+0000 7fd5ead30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:56.169 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.171+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.171+0000 7fd5ead30800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:56.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.172+0000 7fd5ead30800 20 searching for the correct realm 2024-09-14T11:11:56.173 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.174+0000 7fd5e62af640 0 -- 172.21.15.50:0/3132939204 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fd5e003b410 msgr2=0x7fd5e003b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:56.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.380+0000 7fd5e72b1640 0 -- 172.21.15.50:0/3132939204 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55dbe3e46c40 msgr2=0x55dbe3e490e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:56.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.385+0000 7fd5ead30800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:56.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.385+0000 7fd5ead30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:56.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.385+0000 7fd5ead30800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:56.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.385+0000 7fd5ead30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:56.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.385+0000 7fd5ead30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:56.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.385+0000 7fd5ead30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:56.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.385+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.385+0000 7fd5ead30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.385+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.385+0000 7fd5ead30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:56.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.386+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.386+0000 7fd5ead30800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:56.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.386+0000 7fd5ead30800 20 zone default found 2024-09-14T11:11:56.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.386+0000 7fd5ead30800 4 Realm: () 2024-09-14T11:11:56.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.386+0000 7fd5ead30800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:56.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.386+0000 7fd5ead30800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:56.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.386+0000 7fd5ead30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:56.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.386+0000 7fd5ead30800 20 zonegroup default 2024-09-14T11:11:56.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.386+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.386+0000 7fd5ead30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.386+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.386+0000 7fd5ead30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.386+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.387+0000 7fd5ead30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.387+0000 7fd5ead30800 20 started sync module instance, tier type = 2024-09-14T11:11:56.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.387+0000 7fd5ead30800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:56.394 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.395+0000 7fd5ead30800 20 add_watcher() i=0 2024-09-14T11:11:56.394 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.395+0000 7fd5ead30800 20 add_watcher() i=1 2024-09-14T11:11:56.394 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.395+0000 7fd5ead30800 20 add_watcher() i=2 2024-09-14T11:11:56.394 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.395+0000 7fd5ead30800 20 add_watcher() i=3 2024-09-14T11:11:56.394 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.395+0000 7fd5ead30800 20 add_watcher() i=4 2024-09-14T11:11:56.394 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.395+0000 7fd5ead30800 20 add_watcher() i=5 2024-09-14T11:11:56.394 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.396+0000 7fd5ead30800 20 add_watcher() i=6 2024-09-14T11:11:56.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.396+0000 7fd5ead30800 20 add_watcher() i=7 2024-09-14T11:11:56.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.396+0000 7fd5ead30800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:56.396 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.398+0000 7fd49d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:56.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.398+0000 7fd5ead30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:56.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.398+0000 7fd5ead30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:56.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.398+0000 7fd5ead30800 5 note: GC not initialized 2024-09-14T11:11:56.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.399+0000 7fd417fff640 20 reqs_thread_entry: start 2024-09-14T11:11:56.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.399+0000 7fd5ead30800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:56.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.399+0000 7fd5ead30800 20 Filter name: none 2024-09-14T11:11:56.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.399+0000 7fd415ffb640 20 reqs_thread_entry: start 2024-09-14T11:11:56.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.399+0000 7fd5ead30800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:11:56.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.399+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.400+0000 7fd5ead30800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:11:56.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.400+0000 7fd5ead30800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:11:56.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.400+0000 7fd5ead30800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:11:56.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.400+0000 7fd5ead30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 : miss 2024-09-14T11:11:56.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.400+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.400+0000 7fd5ead30800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:11:56.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.400+0000 7fd5ead30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 info.flags=0x17 2024-09-14T11:11:56.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.400+0000 7fd5ead30800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 to cache LRU end 2024-09-14T11:11:56.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.400+0000 7fd5ead30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:11:56.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.400+0000 7fd5ead30800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:56.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.400+0000 7fd5ead30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 2024-09-14T11:11:56.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.405+0000 7fd5ead30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 info.flags=0x17 2024-09-14T11:11:56.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.405+0000 7fd5ead30800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 to cache LRU end 2024-09-14T11:11:56.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.405+0000 7fd5ead30800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:56.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.405+0000 7fd5ead30800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33, ofs0, ns] 2024-09-14T11:11:56.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.406+0000 7fd4ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497091 cookie 94402909670960 notifier 6971 bl.length()=1015 2024-09-14T11:11:56.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.406+0000 7fd4ca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 info.flags=0x17 2024-09-14T11:11:56.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.406+0000 7fd4ca7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 to cache LRU end 2024-09-14T11:11:56.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.406+0000 7fd4ca7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:56.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.407+0000 7fd5ead30800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): orig_sources= new_sources= 2024-09-14T11:11:56.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.407+0000 7fd5ead30800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): potential sources added=[] removed=[] 2024-09-14T11:11:56.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.407+0000 7fd5ead30800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): orig_dests= new_dests= 2024-09-14T11:11:56.406 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.407+0000 7fd5ead30800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): potential dests added=[] removed=[] 2024-09-14T11:11:56.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.0 2024-09-14T11:11:56.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.0 2024-09-14T11:11:56.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.1 2024-09-14T11:11:56.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.1 2024-09-14T11:11:56.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.2 2024-09-14T11:11:56.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.2 2024-09-14T11:11:56.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.3 2024-09-14T11:11:56.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.3 2024-09-14T11:11:56.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.4 2024-09-14T11:11:56.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.4 2024-09-14T11:11:56.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.5 2024-09-14T11:11:56.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.5 2024-09-14T11:11:56.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.6 2024-09-14T11:11:56.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.6 2024-09-14T11:11:56.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.7 2024-09-14T11:11:56.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.7 2024-09-14T11:11:56.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.8 2024-09-14T11:11:56.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.8 2024-09-14T11:11:56.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.9 2024-09-14T11:11:56.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.9 2024-09-14T11:11:56.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.10 2024-09-14T11:11:56.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.10 2024-09-14T11:11:56.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.11 2024-09-14T11:11:56.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.11 2024-09-14T11:11:56.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.0 2024-09-14T11:11:56.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.414+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1 2024-09-14T11:11:56.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.414+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.2 2024-09-14T11:11:56.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.414+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.3 2024-09-14T11:11:56.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.415+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.4 2024-09-14T11:11:56.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.416+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.5 2024-09-14T11:11:56.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.416+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.6 2024-09-14T11:11:56.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.417+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.7 2024-09-14T11:11:56.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.417+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.8 2024-09-14T11:11:56.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.418+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.9 2024-09-14T11:11:56.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.418+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.10 2024-09-14T11:11:56.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.421+0000 7fd5ead30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:11:56.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.422+0000 7fd5ead30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 2024-09-14T11:11:56.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.423+0000 7fd5ead30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 info.flags=0x17 2024-09-14T11:11:56.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.423+0000 7fd5ead30800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 to cache LRU end 2024-09-14T11:11:56.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.423+0000 7fd5ead30800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:56.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.423+0000 7fd5ead30800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33, ofs0, ns] 2024-09-14T11:11:56.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.423+0000 7fd4ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497092 cookie 94402909670960 notifier 6971 bl.length()=1015 2024-09-14T11:11:56.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.423+0000 7fd4ca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 info.flags=0x17 2024-09-14T11:11:56.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.423+0000 7fd4ca7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 to cache LRU end 2024-09-14T11:11:56.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.423+0000 7fd4ca7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:56.423 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.425+0000 7fd5ead30800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): orig_sources= new_sources= 2024-09-14T11:11:56.423 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.425+0000 7fd5ead30800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): potential sources added=[] removed=[] 2024-09-14T11:11:56.423 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.425+0000 7fd5ead30800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): orig_dests= new_dests= 2024-09-14T11:11:56.423 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.425+0000 7fd5ead30800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): potential dests added=[] removed=[] 2024-09-14T11:11:56.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.427+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.0 2024-09-14T11:11:56.426 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.428+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1 2024-09-14T11:11:56.426 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.428+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.2 2024-09-14T11:11:56.426 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.428+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.3 2024-09-14T11:11:56.427 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.429+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.4 2024-09-14T11:11:56.427 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.429+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.5 2024-09-14T11:11:56.427 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.429+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.6 2024-09-14T11:11:56.428 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.430+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.7 2024-09-14T11:11:56.428 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.430+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.8 2024-09-14T11:11:56.429 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.430+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.9 2024-09-14T11:11:56.429 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.431+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.10 2024-09-14T11:11:56.429 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd5ead30800 time 2024-09-14T11:11:56.431919+0000 2024-09-14T11:11:56.429 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:11:56.430 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:11:56.430 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd5ec58c76a] 2024-09-14T11:11:56.430 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd5ec58c928] 2024-09-14T11:11:56.430 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dbe22f20b1] 2024-09-14T11:11:56.430 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55dbe2302217] 2024-09-14T11:11:56.430 INFO:tasks.workunit.client.0.smithi050.stderr: 5: main() 2024-09-14T11:11:56.430 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fd5eb229590] 2024-09-14T11:11:56.430 INFO:tasks.workunit.client.0.smithi050.stderr: 7: __libc_start_main() 2024-09-14T11:11:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 8: _start() 2024-09-14T11:11:56.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.432+0000 7fd5ead30800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd5ead30800 time 2024-09-14T11:11:56.431919+0000 2024-09-14T11:11:56.431 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:11:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:11:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd5ec58c76a] 2024-09-14T11:11:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd5ec58c928] 2024-09-14T11:11:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dbe22f20b1] 2024-09-14T11:11:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55dbe2302217] 2024-09-14T11:11:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 5: main() 2024-09-14T11:11:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fd5eb229590] 2024-09-14T11:11:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 7: __libc_start_main() 2024-09-14T11:11:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 8: _start() 2024-09-14T11:11:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.432 INFO:tasks.workunit.client.0.smithi050.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:11:56.432 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7fd5ead30800 thread_name:radosgw-admin 2024-09-14T11:11:56.448 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:11:56.449 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd5eb23e6f0] 2024-09-14T11:11:56.449 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd5eb28b99c] 2024-09-14T11:11:56.449 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:11:56.449 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:11:56.449 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd5ec58c7c4] 2024-09-14T11:11:56.449 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd5ec58c928] 2024-09-14T11:11:56.449 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dbe22f20b1] 2024-09-14T11:11:56.449 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55dbe2302217] 2024-09-14T11:11:56.449 INFO:tasks.workunit.client.0.smithi050.stderr: 9: main() 2024-09-14T11:11:56.449 INFO:tasks.workunit.client.0.smithi050.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fd5eb229590] 2024-09-14T11:11:56.449 INFO:tasks.workunit.client.0.smithi050.stderr: 11: __libc_start_main() 2024-09-14T11:11:56.449 INFO:tasks.workunit.client.0.smithi050.stderr: 12: _start() 2024-09-14T11:11:56.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.432+0000 7fd5ead30800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:11:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7fd5ead30800 thread_name:radosgw-admin 2024-09-14T11:11:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:11:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd5eb23e6f0] 2024-09-14T11:11:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd5eb28b99c] 2024-09-14T11:11:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:11:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:11:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd5ec58c7c4] 2024-09-14T11:11:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd5ec58c928] 2024-09-14T11:11:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dbe22f20b1] 2024-09-14T11:11:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55dbe2302217] 2024-09-14T11:11:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: 9: main() 2024-09-14T11:11:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fd5eb229590] 2024-09-14T11:11:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: 11: __libc_start_main() 2024-09-14T11:11:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: 12: _start() 2024-09-14T11:11:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:11:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.451 INFO:tasks.workunit.client.0.smithi050.stderr:--- begin dump of recent events --- 2024-09-14T11:11:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: -499> 2024-09-14T11:11:56.152+0000 7fd5e62af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: -498> 2024-09-14T11:11:56.152+0000 7fd5e72b1640 10 monclient(hunting): get_auth_request con 0x55dbe3d62ac0 auth_method 0 2024-09-14T11:11:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: -497> 2024-09-14T11:11:56.152+0000 7fd5e72b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: -496> 2024-09-14T11:11:56.152+0000 7fd5e72b1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: -495> 2024-09-14T11:11:56.152+0000 7fd5e72b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: -494> 2024-09-14T11:11:56.152+0000 7fd5e62af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: -493> 2024-09-14T11:11:56.152+0000 7fd5e62af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -492> 2024-09-14T11:11:56.152+0000 7fd5e62af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -491> 2024-09-14T11:11:56.152+0000 7fd5e72b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -490> 2024-09-14T11:11:56.152+0000 7fd5e72b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -489> 2024-09-14T11:11:56.152+0000 7fd5e72b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -488> 2024-09-14T11:11:56.152+0000 7fd5e6ab0640 10 monclient(hunting): get_auth_request con 0x55dbe3be7df0 auth_method 0 2024-09-14T11:11:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -487> 2024-09-14T11:11:56.152+0000 7fd5e6ab0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -486> 2024-09-14T11:11:56.152+0000 7fd5e6ab0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -485> 2024-09-14T11:11:56.152+0000 7fd5e6ab0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -484> 2024-09-14T11:11:56.153+0000 7fd5e6ab0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -483> 2024-09-14T11:11:56.153+0000 7fd5e6ab0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -482> 2024-09-14T11:11:56.153+0000 7fd5e6ab0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -481> 2024-09-14T11:11:56.153+0000 7fd5e62af640 10 monclient(hunting): handle_auth_done global_id 6962 payload 824 2024-09-14T11:11:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -480> 2024-09-14T11:11:56.153+0000 7fd5e62af640 10 monclient: _finish_hunting 0 2024-09-14T11:11:56.453 INFO:tasks.workunit.client.0.smithi050.stderr: -479> 2024-09-14T11:11:56.153+0000 7fd5e62af640 1 monclient: found mon.noname-c 2024-09-14T11:11:56.453 INFO:tasks.workunit.client.0.smithi050.stderr: -478> 2024-09-14T11:11:56.153+0000 7fd5e62af640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:11:56.453 INFO:tasks.workunit.client.0.smithi050.stderr: -477> 2024-09-14T11:11:56.153+0000 7fd4d3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:56.453 INFO:tasks.workunit.client.0.smithi050.stderr: -476> 2024-09-14T11:11:56.153+0000 7fd4d3606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:11:56.453 INFO:tasks.workunit.client.0.smithi050.stderr: -475> 2024-09-14T11:11:56.153+0000 7fd4d3606640 10 monclient: dump: 2024-09-14T11:11:56.453 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:56.453 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:56.453 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.453 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.453 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:56.453 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:56.453 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:56.453 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:56.454 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:56.454 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.454 INFO:tasks.workunit.client.0.smithi050.stderr: -474> 2024-09-14T11:11:56.153+0000 7fd4d3606640 10 monclient: _finish_auth 0 2024-09-14T11:11:56.454 INFO:tasks.workunit.client.0.smithi050.stderr: -473> 2024-09-14T11:11:56.153+0000 7fd4d3606640 10 monclient: _check_auth_tickets 2024-09-14T11:11:56.454 INFO:tasks.workunit.client.0.smithi050.stderr: -472> 2024-09-14T11:11:56.153+0000 7fd4d3606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:11:56.454 INFO:tasks.workunit.client.0.smithi050.stderr: -471> 2024-09-14T11:11:56.153+0000 7fd4d3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:56.454 INFO:tasks.workunit.client.0.smithi050.stderr: -470> 2024-09-14T11:11:56.153+0000 7fd4d3606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:11:56.454 INFO:tasks.workunit.client.0.smithi050.stderr: -469> 2024-09-14T11:11:56.153+0000 7fd4d3606640 10 monclient: dump: 2024-09-14T11:11:56.454 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:56.454 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:56.454 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.454 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.454 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:56.454 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:56.455 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:56.455 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:56.455 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:56.455 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.455 INFO:tasks.workunit.client.0.smithi050.stderr: -468> 2024-09-14T11:11:56.153+0000 7fd5ead30800 5 monclient: authenticate success, global_id 6962 2024-09-14T11:11:56.455 INFO:tasks.workunit.client.0.smithi050.stderr: -467> 2024-09-14T11:11:56.153+0000 7fd5ead30800 10 monclient: _renew_subs 2024-09-14T11:11:56.455 INFO:tasks.workunit.client.0.smithi050.stderr: -466> 2024-09-14T11:11:56.153+0000 7fd5ead30800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:11:56.455 INFO:tasks.workunit.client.0.smithi050.stderr: -465> 2024-09-14T11:11:56.153+0000 7fd4d4e09640 4 set_mon_vals no callback set 2024-09-14T11:11:56.455 INFO:tasks.workunit.client.0.smithi050.stderr: -464> 2024-09-14T11:11:56.153+0000 7fd5ead30800 10 monclient: _renew_subs 2024-09-14T11:11:56.455 INFO:tasks.workunit.client.0.smithi050.stderr: -463> 2024-09-14T11:11:56.153+0000 7fd5ead30800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:11:56.455 INFO:tasks.workunit.client.0.smithi050.stderr: -462> 2024-09-14T11:11:56.153+0000 7fd5ead30800 1 librados: init done 2024-09-14T11:11:56.455 INFO:tasks.workunit.client.0.smithi050.stderr: -461> 2024-09-14T11:11:56.155+0000 7fd4d3606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:11:56.455 INFO:tasks.workunit.client.0.smithi050.stderr: -460> 2024-09-14T11:11:56.155+0000 7fd4d3606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:11:56.455 INFO:tasks.workunit.client.0.smithi050.stderr: -459> 2024-09-14T11:11:56.155+0000 7fd4d3606640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:11:56.456 INFO:tasks.workunit.client.0.smithi050.stderr: -458> 2024-09-14T11:11:56.155+0000 7fd5e6ab0640 10 monclient: get_auth_request con 0x7fd4cc077230 auth_method 0 2024-09-14T11:11:56.456 INFO:tasks.workunit.client.0.smithi050.stderr: -457> 2024-09-14T11:11:56.156+0000 7fd5e72b1640 10 monclient: get_auth_request con 0x55dbe3d9e110 auth_method 0 2024-09-14T11:11:56.456 INFO:tasks.workunit.client.0.smithi050.stderr: -456> 2024-09-14T11:11:56.156+0000 7fd5e6ab0640 10 monclient: get_auth_request con 0x55dbe3da8f00 auth_method 0 2024-09-14T11:11:56.456 INFO:tasks.workunit.client.0.smithi050.stderr: -455> 2024-09-14T11:11:56.157+0000 7fd5e62af640 10 monclient: get_auth_request con 0x55dbe3dad0f0 auth_method 0 2024-09-14T11:11:56.456 INFO:tasks.workunit.client.0.smithi050.stderr: -454> 2024-09-14T11:11:56.158+0000 7fd5ead30800 10 monclient: build_initial_monmap 2024-09-14T11:11:56.456 INFO:tasks.workunit.client.0.smithi050.stderr: -453> 2024-09-14T11:11:56.158+0000 7fd5ead30800 1 build_initial for_mkfs: 0 2024-09-14T11:11:56.456 INFO:tasks.workunit.client.0.smithi050.stderr: -452> 2024-09-14T11:11:56.158+0000 7fd5ead30800 10 monclient: monmap: 2024-09-14T11:11:56.456 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:11:56.456 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:11:56.456 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:11:56.456 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:11:56.456 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:11:56.456 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:56.457 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:11:56.457 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:11:56.457 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:11:56.457 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.457 INFO:tasks.workunit.client.0.smithi050.stderr: -451> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding auth protocol: cephx 2024-09-14T11:11:56.457 INFO:tasks.workunit.client.0.smithi050.stderr: -450> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding auth protocol: cephx 2024-09-14T11:11:56.457 INFO:tasks.workunit.client.0.smithi050.stderr: -449> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding auth protocol: cephx 2024-09-14T11:11:56.457 INFO:tasks.workunit.client.0.smithi050.stderr: -448> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding con mode: secure 2024-09-14T11:11:56.457 INFO:tasks.workunit.client.0.smithi050.stderr: -447> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding con mode: crc 2024-09-14T11:11:56.457 INFO:tasks.workunit.client.0.smithi050.stderr: -446> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding con mode: secure 2024-09-14T11:11:56.457 INFO:tasks.workunit.client.0.smithi050.stderr: -445> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding con mode: crc 2024-09-14T11:11:56.457 INFO:tasks.workunit.client.0.smithi050.stderr: -444> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding con mode: secure 2024-09-14T11:11:56.458 INFO:tasks.workunit.client.0.smithi050.stderr: -443> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding con mode: crc 2024-09-14T11:11:56.458 INFO:tasks.workunit.client.0.smithi050.stderr: -442> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding con mode: crc 2024-09-14T11:11:56.458 INFO:tasks.workunit.client.0.smithi050.stderr: -441> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding con mode: secure 2024-09-14T11:11:56.458 INFO:tasks.workunit.client.0.smithi050.stderr: -440> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding con mode: crc 2024-09-14T11:11:56.458 INFO:tasks.workunit.client.0.smithi050.stderr: -439> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding con mode: secure 2024-09-14T11:11:56.458 INFO:tasks.workunit.client.0.smithi050.stderr: -438> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding con mode: crc 2024-09-14T11:11:56.458 INFO:tasks.workunit.client.0.smithi050.stderr: -437> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding con mode: secure 2024-09-14T11:11:56.458 INFO:tasks.workunit.client.0.smithi050.stderr: -436> 2024-09-14T11:11:56.158+0000 7fd5ead30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:56.458 INFO:tasks.workunit.client.0.smithi050.stderr: -435> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command objecter_requests cmddesc objecter_requests hook 0x55dbe3db53c0 EEXIST 2024-09-14T11:11:56.458 INFO:tasks.workunit.client.0.smithi050.stderr: -434> 2024-09-14T11:11:56.159+0000 7fd5ead30800 10 monclient: init 2024-09-14T11:11:56.458 INFO:tasks.workunit.client.0.smithi050.stderr: -433> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding auth protocol: cephx 2024-09-14T11:11:56.458 INFO:tasks.workunit.client.0.smithi050.stderr: -432> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding auth protocol: cephx 2024-09-14T11:11:56.458 INFO:tasks.workunit.client.0.smithi050.stderr: -431> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding auth protocol: cephx 2024-09-14T11:11:56.458 INFO:tasks.workunit.client.0.smithi050.stderr: -430> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding con mode: secure 2024-09-14T11:11:56.459 INFO:tasks.workunit.client.0.smithi050.stderr: -429> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding con mode: crc 2024-09-14T11:11:56.459 INFO:tasks.workunit.client.0.smithi050.stderr: -428> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding con mode: secure 2024-09-14T11:11:56.459 INFO:tasks.workunit.client.0.smithi050.stderr: -427> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding con mode: crc 2024-09-14T11:11:56.459 INFO:tasks.workunit.client.0.smithi050.stderr: -426> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding con mode: secure 2024-09-14T11:11:56.459 INFO:tasks.workunit.client.0.smithi050.stderr: -425> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding con mode: crc 2024-09-14T11:11:56.459 INFO:tasks.workunit.client.0.smithi050.stderr: -424> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding con mode: crc 2024-09-14T11:11:56.459 INFO:tasks.workunit.client.0.smithi050.stderr: -423> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding con mode: secure 2024-09-14T11:11:56.459 INFO:tasks.workunit.client.0.smithi050.stderr: -422> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding con mode: crc 2024-09-14T11:11:56.459 INFO:tasks.workunit.client.0.smithi050.stderr: -421> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding con mode: secure 2024-09-14T11:11:56.459 INFO:tasks.workunit.client.0.smithi050.stderr: -420> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding con mode: crc 2024-09-14T11:11:56.459 INFO:tasks.workunit.client.0.smithi050.stderr: -419> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding con mode: secure 2024-09-14T11:11:56.459 INFO:tasks.workunit.client.0.smithi050.stderr: -418> 2024-09-14T11:11:56.159+0000 7fd5ead30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:56.459 INFO:tasks.workunit.client.0.smithi050.stderr: -417> 2024-09-14T11:11:56.159+0000 7fd5ead30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:56.459 INFO:tasks.workunit.client.0.smithi050.stderr: -416> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command rotate-key cmddesc rotate-key hook 0x55dbe3db05d0 EEXIST 2024-09-14T11:11:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -415> 2024-09-14T11:11:56.159+0000 7fd5ead30800 10 monclient: _reopen_session rank -1 2024-09-14T11:11:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -414> 2024-09-14T11:11:56.159+0000 7fd5ead30800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:11:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -413> 2024-09-14T11:11:56.159+0000 7fd5ead30800 10 monclient(hunting): picked mon.noname-a con 0x55dbe3dd96e0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:11:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -412> 2024-09-14T11:11:56.159+0000 7fd5ead30800 10 monclient(hunting): picked mon.noname-c con 0x55dbe3dd9ac0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:11:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -411> 2024-09-14T11:11:56.159+0000 7fd5ead30800 10 monclient(hunting): picked mon.noname-b con 0x55dbe3dd83f0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:11:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -410> 2024-09-14T11:11:56.159+0000 7fd5ead30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -409> 2024-09-14T11:11:56.159+0000 7fd5ead30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -408> 2024-09-14T11:11:56.159+0000 7fd5ead30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -407> 2024-09-14T11:11:56.159+0000 7fd5ead30800 10 monclient(hunting): _renew_subs 2024-09-14T11:11:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -406> 2024-09-14T11:11:56.159+0000 7fd5ead30800 10 monclient(hunting): authenticate will time out at 2368.796760s 2024-09-14T11:11:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -405> 2024-09-14T11:11:56.159+0000 7fd5e62af640 10 monclient(hunting): get_auth_request con 0x55dbe3dd9ac0 auth_method 0 2024-09-14T11:11:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -404> 2024-09-14T11:11:56.159+0000 7fd5e62af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -403> 2024-09-14T11:11:56.159+0000 7fd5e62af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -402> 2024-09-14T11:11:56.159+0000 7fd5e62af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -401> 2024-09-14T11:11:56.159+0000 7fd5e6ab0640 10 monclient(hunting): get_auth_request con 0x55dbe3dd96e0 auth_method 0 2024-09-14T11:11:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -400> 2024-09-14T11:11:56.159+0000 7fd5e6ab0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -399> 2024-09-14T11:11:56.159+0000 7fd5e6ab0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -398> 2024-09-14T11:11:56.159+0000 7fd5e6ab0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -397> 2024-09-14T11:11:56.159+0000 7fd5e62af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -396> 2024-09-14T11:11:56.159+0000 7fd5e62af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -395> 2024-09-14T11:11:56.159+0000 7fd5e62af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -394> 2024-09-14T11:11:56.159+0000 7fd5e72b1640 10 monclient(hunting): get_auth_request con 0x55dbe3dd83f0 auth_method 0 2024-09-14T11:11:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -393> 2024-09-14T11:11:56.159+0000 7fd5e72b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -392> 2024-09-14T11:11:56.159+0000 7fd5e72b1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -391> 2024-09-14T11:11:56.159+0000 7fd5e72b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -390> 2024-09-14T11:11:56.160+0000 7fd5e6ab0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -389> 2024-09-14T11:11:56.160+0000 7fd5e6ab0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -388> 2024-09-14T11:11:56.160+0000 7fd5e6ab0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -387> 2024-09-14T11:11:56.160+0000 7fd5e72b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -386> 2024-09-14T11:11:56.160+0000 7fd5e72b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -385> 2024-09-14T11:11:56.160+0000 7fd5e72b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -384> 2024-09-14T11:11:56.160+0000 7fd5e62af640 10 monclient(hunting): handle_auth_done global_id 6965 payload 824 2024-09-14T11:11:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -383> 2024-09-14T11:11:56.160+0000 7fd5e62af640 10 monclient: _finish_hunting 0 2024-09-14T11:11:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -382> 2024-09-14T11:11:56.160+0000 7fd5e62af640 1 monclient: found mon.noname-c 2024-09-14T11:11:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -381> 2024-09-14T11:11:56.160+0000 7fd5e62af640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:11:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -380> 2024-09-14T11:11:56.160+0000 7fd4d0e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -379> 2024-09-14T11:11:56.160+0000 7fd4d0e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:11:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -378> 2024-09-14T11:11:56.160+0000 7fd4d0e01640 10 monclient: dump: 2024-09-14T11:11:56.463 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:56.463 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:56.463 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.463 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.463 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:56.463 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:56.463 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:56.463 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:56.463 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:56.463 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.463 INFO:tasks.workunit.client.0.smithi050.stderr: -377> 2024-09-14T11:11:56.160+0000 7fd4d0e01640 10 monclient: _finish_auth 0 2024-09-14T11:11:56.463 INFO:tasks.workunit.client.0.smithi050.stderr: -376> 2024-09-14T11:11:56.160+0000 7fd4d0e01640 10 monclient: _check_auth_tickets 2024-09-14T11:11:56.463 INFO:tasks.workunit.client.0.smithi050.stderr: -375> 2024-09-14T11:11:56.160+0000 7fd4d0e01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:11:56.463 INFO:tasks.workunit.client.0.smithi050.stderr: -374> 2024-09-14T11:11:56.160+0000 7fd4d0e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:56.464 INFO:tasks.workunit.client.0.smithi050.stderr: -373> 2024-09-14T11:11:56.160+0000 7fd4d0e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:11:56.464 INFO:tasks.workunit.client.0.smithi050.stderr: -372> 2024-09-14T11:11:56.160+0000 7fd4d0e01640 10 monclient: dump: 2024-09-14T11:11:56.464 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:56.464 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:56.464 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.464 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.464 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:56.464 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:56.464 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:56.464 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:56.464 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:56.464 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.464 INFO:tasks.workunit.client.0.smithi050.stderr: -371> 2024-09-14T11:11:56.160+0000 7fd5ead30800 5 monclient: authenticate success, global_id 6965 2024-09-14T11:11:56.465 INFO:tasks.workunit.client.0.smithi050.stderr: -370> 2024-09-14T11:11:56.160+0000 7fd5ead30800 10 monclient: _renew_subs 2024-09-14T11:11:56.465 INFO:tasks.workunit.client.0.smithi050.stderr: -369> 2024-09-14T11:11:56.160+0000 7fd5ead30800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:11:56.465 INFO:tasks.workunit.client.0.smithi050.stderr: -368> 2024-09-14T11:11:56.160+0000 7fd5e7ab2640 4 set_mon_vals no callback set 2024-09-14T11:11:56.465 INFO:tasks.workunit.client.0.smithi050.stderr: -367> 2024-09-14T11:11:56.160+0000 7fd5ead30800 10 monclient: _renew_subs 2024-09-14T11:11:56.465 INFO:tasks.workunit.client.0.smithi050.stderr: -366> 2024-09-14T11:11:56.160+0000 7fd5ead30800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:11:56.465 INFO:tasks.workunit.client.0.smithi050.stderr: -365> 2024-09-14T11:11:56.162+0000 7fd4d0e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:11:56.465 INFO:tasks.workunit.client.0.smithi050.stderr: -364> 2024-09-14T11:11:56.162+0000 7fd4d0e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:11:56.465 INFO:tasks.workunit.client.0.smithi050.stderr: -363> 2024-09-14T11:11:56.162+0000 7fd4d0e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:11:56.465 INFO:tasks.workunit.client.0.smithi050.stderr: -362> 2024-09-14T11:11:56.162+0000 7fd5ead30800 10 monclient: get_monmap_and_config 2024-09-14T11:11:56.465 INFO:tasks.workunit.client.0.smithi050.stderr: -361> 2024-09-14T11:11:56.162+0000 7fd5ead30800 10 monclient: build_initial_monmap 2024-09-14T11:11:56.465 INFO:tasks.workunit.client.0.smithi050.stderr: -360> 2024-09-14T11:11:56.162+0000 7fd5ead30800 1 build_initial for_mkfs: 0 2024-09-14T11:11:56.465 INFO:tasks.workunit.client.0.smithi050.stderr: -359> 2024-09-14T11:11:56.162+0000 7fd5ead30800 10 monclient: monmap: 2024-09-14T11:11:56.465 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:11:56.466 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:11:56.466 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:11:56.466 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:11:56.466 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:11:56.466 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:56.466 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:11:56.466 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:11:56.466 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:11:56.466 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.466 INFO:tasks.workunit.client.0.smithi050.stderr: -358> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding auth protocol: cephx 2024-09-14T11:11:56.466 INFO:tasks.workunit.client.0.smithi050.stderr: -357> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding auth protocol: cephx 2024-09-14T11:11:56.466 INFO:tasks.workunit.client.0.smithi050.stderr: -356> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding auth protocol: cephx 2024-09-14T11:11:56.466 INFO:tasks.workunit.client.0.smithi050.stderr: -355> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding con mode: secure 2024-09-14T11:11:56.466 INFO:tasks.workunit.client.0.smithi050.stderr: -354> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding con mode: crc 2024-09-14T11:11:56.467 INFO:tasks.workunit.client.0.smithi050.stderr: -353> 2024-09-14T11:11:56.162+0000 7fd5e6ab0640 10 monclient: get_auth_request con 0x7fd4c0077140 auth_method 0 2024-09-14T11:11:56.467 INFO:tasks.workunit.client.0.smithi050.stderr: -352> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding con mode: secure 2024-09-14T11:11:56.467 INFO:tasks.workunit.client.0.smithi050.stderr: -351> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding con mode: crc 2024-09-14T11:11:56.467 INFO:tasks.workunit.client.0.smithi050.stderr: -350> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding con mode: secure 2024-09-14T11:11:56.467 INFO:tasks.workunit.client.0.smithi050.stderr: -349> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding con mode: crc 2024-09-14T11:11:56.467 INFO:tasks.workunit.client.0.smithi050.stderr: -348> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding con mode: crc 2024-09-14T11:11:56.467 INFO:tasks.workunit.client.0.smithi050.stderr: -347> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding con mode: secure 2024-09-14T11:11:56.467 INFO:tasks.workunit.client.0.smithi050.stderr: -346> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding con mode: crc 2024-09-14T11:11:56.467 INFO:tasks.workunit.client.0.smithi050.stderr: -345> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding con mode: secure 2024-09-14T11:11:56.467 INFO:tasks.workunit.client.0.smithi050.stderr: -344> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding con mode: crc 2024-09-14T11:11:56.467 INFO:tasks.workunit.client.0.smithi050.stderr: -343> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding con mode: secure 2024-09-14T11:11:56.467 INFO:tasks.workunit.client.0.smithi050.stderr: -342> 2024-09-14T11:11:56.162+0000 7fd5ead30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:56.467 INFO:tasks.workunit.client.0.smithi050.stderr: -341> 2024-09-14T11:11:56.162+0000 7fd5ead30800 10 monclient: init 2024-09-14T11:11:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -340> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding auth protocol: cephx 2024-09-14T11:11:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -339> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding auth protocol: cephx 2024-09-14T11:11:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -338> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding auth protocol: cephx 2024-09-14T11:11:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -337> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding con mode: secure 2024-09-14T11:11:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -336> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding con mode: crc 2024-09-14T11:11:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -335> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding con mode: secure 2024-09-14T11:11:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -334> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding con mode: crc 2024-09-14T11:11:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -333> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding con mode: secure 2024-09-14T11:11:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -332> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding con mode: crc 2024-09-14T11:11:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -331> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding con mode: crc 2024-09-14T11:11:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -330> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding con mode: secure 2024-09-14T11:11:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -329> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding con mode: crc 2024-09-14T11:11:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -328> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding con mode: secure 2024-09-14T11:11:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -327> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding con mode: crc 2024-09-14T11:11:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -326> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding con mode: secure 2024-09-14T11:11:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -325> 2024-09-14T11:11:56.163+0000 7fd5ead30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -324> 2024-09-14T11:11:56.163+0000 7fd5ead30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -323> 2024-09-14T11:11:56.163+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command rotate-key cmddesc rotate-key hook 0x7fff1da3cbd8 EEXIST 2024-09-14T11:11:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -322> 2024-09-14T11:11:56.163+0000 7fd5ead30800 10 monclient: _reopen_session rank -1 2024-09-14T11:11:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -321> 2024-09-14T11:11:56.163+0000 7fd5ead30800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:11:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -320> 2024-09-14T11:11:56.163+0000 7fd5ead30800 10 monclient(hunting): picked mon.noname-a con 0x55dbe3e2d8d0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:11:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -319> 2024-09-14T11:11:56.163+0000 7fd5ead30800 10 monclient(hunting): picked mon.noname-c con 0x55dbe3dfe820 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:11:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -318> 2024-09-14T11:11:56.163+0000 7fd5ead30800 10 monclient(hunting): picked mon.noname-b con 0x55dbe3e29170 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:11:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -317> 2024-09-14T11:11:56.163+0000 7fd5ead30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -316> 2024-09-14T11:11:56.163+0000 7fd5ead30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -315> 2024-09-14T11:11:56.163+0000 7fd5ead30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -314> 2024-09-14T11:11:56.163+0000 7fd5ead30800 10 monclient(hunting): _renew_subs 2024-09-14T11:11:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -313> 2024-09-14T11:11:56.163+0000 7fd5ead30800 10 monclient(hunting): authenticate will time out at 2368.800496s 2024-09-14T11:11:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -312> 2024-09-14T11:11:56.163+0000 7fd5e62af640 10 monclient(hunting): get_auth_request con 0x55dbe3dfe820 auth_method 0 2024-09-14T11:11:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -311> 2024-09-14T11:11:56.163+0000 7fd5e62af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -310> 2024-09-14T11:11:56.163+0000 7fd5e62af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -309> 2024-09-14T11:11:56.163+0000 7fd5e62af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -308> 2024-09-14T11:11:56.163+0000 7fd5e6ab0640 10 monclient(hunting): get_auth_request con 0x55dbe3e2d8d0 auth_method 0 2024-09-14T11:11:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -307> 2024-09-14T11:11:56.163+0000 7fd5e6ab0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -306> 2024-09-14T11:11:56.163+0000 7fd5e6ab0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -305> 2024-09-14T11:11:56.163+0000 7fd5e6ab0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -304> 2024-09-14T11:11:56.163+0000 7fd5e62af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -303> 2024-09-14T11:11:56.163+0000 7fd5e62af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -302> 2024-09-14T11:11:56.163+0000 7fd5e62af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -301> 2024-09-14T11:11:56.163+0000 7fd5e72b1640 10 monclient(hunting): get_auth_request con 0x55dbe3e29170 auth_method 0 2024-09-14T11:11:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -300> 2024-09-14T11:11:56.163+0000 7fd5e72b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -299> 2024-09-14T11:11:56.163+0000 7fd5e72b1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -298> 2024-09-14T11:11:56.163+0000 7fd5e72b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -297> 2024-09-14T11:11:56.163+0000 7fd5e6ab0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -296> 2024-09-14T11:11:56.163+0000 7fd5e6ab0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -295> 2024-09-14T11:11:56.163+0000 7fd5e6ab0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -294> 2024-09-14T11:11:56.163+0000 7fd5e62af640 10 monclient(hunting): handle_auth_done global_id 6968 payload 274 2024-09-14T11:11:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -293> 2024-09-14T11:11:56.163+0000 7fd5e62af640 10 monclient: _finish_hunting 0 2024-09-14T11:11:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -292> 2024-09-14T11:11:56.163+0000 7fd5e62af640 1 monclient: found mon.noname-c 2024-09-14T11:11:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -291> 2024-09-14T11:11:56.163+0000 7fd5e62af640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:11:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -290> 2024-09-14T11:11:56.164+0000 7fd4ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -289> 2024-09-14T11:11:56.164+0000 7fd4ca7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:11:56.472 INFO:tasks.workunit.client.0.smithi050.stderr: -288> 2024-09-14T11:11:56.164+0000 7fd4ca7fc640 10 monclient: dump: 2024-09-14T11:11:56.472 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:56.472 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:56.472 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.472 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.472 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:56.472 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:56.472 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:56.472 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:56.472 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:56.472 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.472 INFO:tasks.workunit.client.0.smithi050.stderr: -287> 2024-09-14T11:11:56.164+0000 7fd4ca7fc640 10 monclient: _finish_auth 0 2024-09-14T11:11:56.472 INFO:tasks.workunit.client.0.smithi050.stderr: -286> 2024-09-14T11:11:56.164+0000 7fd4ca7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:11:56.472 INFO:tasks.workunit.client.0.smithi050.stderr: -285> 2024-09-14T11:11:56.164+0000 7fd4ca7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:11:56.473 INFO:tasks.workunit.client.0.smithi050.stderr: -284> 2024-09-14T11:11:56.164+0000 7fd4ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:56.473 INFO:tasks.workunit.client.0.smithi050.stderr: -283> 2024-09-14T11:11:56.164+0000 7fd4ca7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:11:56.473 INFO:tasks.workunit.client.0.smithi050.stderr: -282> 2024-09-14T11:11:56.164+0000 7fd4ca7fc640 10 monclient: dump: 2024-09-14T11:11:56.473 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:56.473 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:56.473 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.473 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.473 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:56.473 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:56.473 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:56.473 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:56.473 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:56.474 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.474 INFO:tasks.workunit.client.0.smithi050.stderr: -281> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 monclient: authenticate success, global_id 6968 2024-09-14T11:11:56.474 INFO:tasks.workunit.client.0.smithi050.stderr: -280> 2024-09-14T11:11:56.164+0000 7fd5ead30800 10 monclient: get_monmap_and_config success 2024-09-14T11:11:56.474 INFO:tasks.workunit.client.0.smithi050.stderr: -279> 2024-09-14T11:11:56.164+0000 7fd5ead30800 4 set_mon_vals no callback set 2024-09-14T11:11:56.474 INFO:tasks.workunit.client.0.smithi050.stderr: -278> 2024-09-14T11:11:56.164+0000 7fd5ead30800 10 monclient: shutdown 2024-09-14T11:11:56.474 INFO:tasks.workunit.client.0.smithi050.stderr: -277> 2024-09-14T11:11:56.164+0000 7fd5ead30800 10 monclient: build_initial_monmap 2024-09-14T11:11:56.474 INFO:tasks.workunit.client.0.smithi050.stderr: -276> 2024-09-14T11:11:56.164+0000 7fd5ead30800 1 build_initial for_mkfs: 0 2024-09-14T11:11:56.474 INFO:tasks.workunit.client.0.smithi050.stderr: -275> 2024-09-14T11:11:56.164+0000 7fd5ead30800 10 monclient: monmap: 2024-09-14T11:11:56.474 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:11:56.474 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:11:56.474 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:11:56.474 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:11:56.474 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:11:56.474 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:56.475 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:11:56.475 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:11:56.475 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:11:56.475 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.475 INFO:tasks.workunit.client.0.smithi050.stderr: -274> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding auth protocol: cephx 2024-09-14T11:11:56.475 INFO:tasks.workunit.client.0.smithi050.stderr: -273> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding auth protocol: cephx 2024-09-14T11:11:56.475 INFO:tasks.workunit.client.0.smithi050.stderr: -272> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding auth protocol: cephx 2024-09-14T11:11:56.475 INFO:tasks.workunit.client.0.smithi050.stderr: -271> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding con mode: secure 2024-09-14T11:11:56.475 INFO:tasks.workunit.client.0.smithi050.stderr: -270> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding con mode: crc 2024-09-14T11:11:56.475 INFO:tasks.workunit.client.0.smithi050.stderr: -269> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding con mode: secure 2024-09-14T11:11:56.475 INFO:tasks.workunit.client.0.smithi050.stderr: -268> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding con mode: crc 2024-09-14T11:11:56.475 INFO:tasks.workunit.client.0.smithi050.stderr: -267> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding con mode: secure 2024-09-14T11:11:56.475 INFO:tasks.workunit.client.0.smithi050.stderr: -266> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding con mode: crc 2024-09-14T11:11:56.475 INFO:tasks.workunit.client.0.smithi050.stderr: -265> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding con mode: crc 2024-09-14T11:11:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -264> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding con mode: secure 2024-09-14T11:11:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -263> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding con mode: crc 2024-09-14T11:11:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -262> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding con mode: secure 2024-09-14T11:11:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -261> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding con mode: crc 2024-09-14T11:11:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -260> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding con mode: secure 2024-09-14T11:11:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -259> 2024-09-14T11:11:56.164+0000 7fd5ead30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -258> 2024-09-14T11:11:56.165+0000 7fd5ead30800 1 librados: starting msgr at 2024-09-14T11:11:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -257> 2024-09-14T11:11:56.165+0000 7fd5ead30800 1 librados: starting objecter 2024-09-14T11:11:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -256> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command objecter_requests cmddesc objecter_requests hook 0x55dbe3e280c0 EEXIST 2024-09-14T11:11:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -255> 2024-09-14T11:11:56.165+0000 7fd5ead30800 1 librados: setting wanted keys 2024-09-14T11:11:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -254> 2024-09-14T11:11:56.165+0000 7fd5ead30800 1 librados: calling monclient init 2024-09-14T11:11:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -253> 2024-09-14T11:11:56.165+0000 7fd5ead30800 10 monclient: init 2024-09-14T11:11:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -252> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding auth protocol: cephx 2024-09-14T11:11:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -251> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding auth protocol: cephx 2024-09-14T11:11:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -250> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding auth protocol: cephx 2024-09-14T11:11:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -249> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding con mode: secure 2024-09-14T11:11:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -248> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding con mode: crc 2024-09-14T11:11:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -247> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding con mode: secure 2024-09-14T11:11:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -246> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding con mode: crc 2024-09-14T11:11:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -245> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding con mode: secure 2024-09-14T11:11:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -244> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding con mode: crc 2024-09-14T11:11:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -243> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding con mode: crc 2024-09-14T11:11:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -242> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding con mode: secure 2024-09-14T11:11:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -241> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding con mode: crc 2024-09-14T11:11:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -240> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding con mode: secure 2024-09-14T11:11:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -239> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding con mode: crc 2024-09-14T11:11:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -238> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding con mode: secure 2024-09-14T11:11:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -237> 2024-09-14T11:11:56.165+0000 7fd5ead30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -236> 2024-09-14T11:11:56.165+0000 7fd5ead30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -235> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command rotate-key cmddesc rotate-key hook 0x55dbe3dee0e8 EEXIST 2024-09-14T11:11:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -234> 2024-09-14T11:11:56.165+0000 7fd5ead30800 10 monclient: _reopen_session rank -1 2024-09-14T11:11:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -233> 2024-09-14T11:11:56.165+0000 7fd5ead30800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:11:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -232> 2024-09-14T11:11:56.165+0000 7fd5ead30800 10 monclient(hunting): picked mon.noname-a con 0x55dbe3dfe820 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:11:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -231> 2024-09-14T11:11:56.165+0000 7fd5ead30800 10 monclient(hunting): picked mon.noname-c con 0x55dbe3e29170 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:11:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -230> 2024-09-14T11:11:56.165+0000 7fd5ead30800 10 monclient(hunting): picked mon.noname-b con 0x55dbe3e2d8d0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:11:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -229> 2024-09-14T11:11:56.165+0000 7fd5ead30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -228> 2024-09-14T11:11:56.165+0000 7fd5ead30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -227> 2024-09-14T11:11:56.165+0000 7fd5ead30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -226> 2024-09-14T11:11:56.165+0000 7fd5ead30800 10 monclient(hunting): _renew_subs 2024-09-14T11:11:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -225> 2024-09-14T11:11:56.165+0000 7fd5ead30800 10 monclient(hunting): authenticate will time out at 2368.802719s 2024-09-14T11:11:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -224> 2024-09-14T11:11:56.165+0000 7fd5e6ab0640 10 monclient(hunting): get_auth_request con 0x55dbe3dfe820 auth_method 0 2024-09-14T11:11:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -223> 2024-09-14T11:11:56.165+0000 7fd5e6ab0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -222> 2024-09-14T11:11:56.165+0000 7fd5e6ab0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -221> 2024-09-14T11:11:56.165+0000 7fd5e6ab0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -220> 2024-09-14T11:11:56.165+0000 7fd5e62af640 10 monclient(hunting): get_auth_request con 0x55dbe3e29170 auth_method 0 2024-09-14T11:11:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -219> 2024-09-14T11:11:56.165+0000 7fd5e62af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -218> 2024-09-14T11:11:56.165+0000 7fd5e62af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -217> 2024-09-14T11:11:56.165+0000 7fd5e62af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -216> 2024-09-14T11:11:56.165+0000 7fd5e62af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -215> 2024-09-14T11:11:56.165+0000 7fd5e62af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -214> 2024-09-14T11:11:56.165+0000 7fd5e62af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -213> 2024-09-14T11:11:56.165+0000 7fd5e6ab0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -212> 2024-09-14T11:11:56.165+0000 7fd5e6ab0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -211> 2024-09-14T11:11:56.165+0000 7fd5e6ab0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -210> 2024-09-14T11:11:56.166+0000 7fd5e72b1640 10 monclient(hunting): get_auth_request con 0x55dbe3e2d8d0 auth_method 0 2024-09-14T11:11:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -209> 2024-09-14T11:11:56.166+0000 7fd5e72b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -208> 2024-09-14T11:11:56.166+0000 7fd5e72b1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -207> 2024-09-14T11:11:56.166+0000 7fd5e72b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -206> 2024-09-14T11:11:56.166+0000 7fd5e62af640 10 monclient(hunting): handle_auth_done global_id 6971 payload 824 2024-09-14T11:11:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -205> 2024-09-14T11:11:56.166+0000 7fd5e62af640 10 monclient: _finish_hunting 0 2024-09-14T11:11:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -204> 2024-09-14T11:11:56.166+0000 7fd5e62af640 1 monclient: found mon.noname-c 2024-09-14T11:11:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -203> 2024-09-14T11:11:56.166+0000 7fd5e62af640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:11:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -202> 2024-09-14T11:11:56.166+0000 7fd4c8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -201> 2024-09-14T11:11:56.166+0000 7fd4c8ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:11:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -200> 2024-09-14T11:11:56.166+0000 7fd4c8ff9640 10 monclient: dump: 2024-09-14T11:11:56.480 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:56.480 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:56.481 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.481 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.481 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:56.481 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:56.481 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:56.481 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:56.481 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:56.481 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.481 INFO:tasks.workunit.client.0.smithi050.stderr: -199> 2024-09-14T11:11:56.166+0000 7fd4c8ff9640 10 monclient: _finish_auth 0 2024-09-14T11:11:56.481 INFO:tasks.workunit.client.0.smithi050.stderr: -198> 2024-09-14T11:11:56.166+0000 7fd4c8ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:11:56.481 INFO:tasks.workunit.client.0.smithi050.stderr: -197> 2024-09-14T11:11:56.166+0000 7fd4c8ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:11:56.481 INFO:tasks.workunit.client.0.smithi050.stderr: -196> 2024-09-14T11:11:56.166+0000 7fd4c8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:56.481 INFO:tasks.workunit.client.0.smithi050.stderr: -195> 2024-09-14T11:11:56.166+0000 7fd4c8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:11:56.482 INFO:tasks.workunit.client.0.smithi050.stderr: -194> 2024-09-14T11:11:56.166+0000 7fd4c8ff9640 10 monclient: dump: 2024-09-14T11:11:56.482 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:56.482 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:56.482 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.482 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.482 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:56.482 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:56.482 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:56.482 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:56.482 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:56.482 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.482 INFO:tasks.workunit.client.0.smithi050.stderr: -193> 2024-09-14T11:11:56.166+0000 7fd5ead30800 5 monclient: authenticate success, global_id 6971 2024-09-14T11:11:56.482 INFO:tasks.workunit.client.0.smithi050.stderr: -192> 2024-09-14T11:11:56.166+0000 7fd4ca7fc640 4 set_mon_vals no callback set 2024-09-14T11:11:56.482 INFO:tasks.workunit.client.0.smithi050.stderr: -191> 2024-09-14T11:11:56.166+0000 7fd5ead30800 10 monclient: _renew_subs 2024-09-14T11:11:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -190> 2024-09-14T11:11:56.166+0000 7fd5ead30800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:11:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -189> 2024-09-14T11:11:56.166+0000 7fd5ead30800 10 monclient: _renew_subs 2024-09-14T11:11:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -188> 2024-09-14T11:11:56.166+0000 7fd5ead30800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:11:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -187> 2024-09-14T11:11:56.166+0000 7fd5ead30800 1 librados: init done 2024-09-14T11:11:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -186> 2024-09-14T11:11:56.166+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command cr dump hook 0x55dbe3e22e78 2024-09-14T11:11:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -185> 2024-09-14T11:11:56.168+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -184> 2024-09-14T11:11:56.168+0000 7fd4c8ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:11:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -183> 2024-09-14T11:11:56.168+0000 7fd4c8ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:11:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -182> 2024-09-14T11:11:56.168+0000 7fd4c8ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:11:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -181> 2024-09-14T11:11:56.169+0000 7fd5e6ab0640 10 monclient: get_auth_request con 0x7fd4b0077230 auth_method 0 2024-09-14T11:11:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -180> 2024-09-14T11:11:56.169+0000 7fd5e72b1640 10 monclient: get_auth_request con 0x55dbe3e46c40 auth_method 0 2024-09-14T11:11:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -179> 2024-09-14T11:11:56.169+0000 7fd5ead30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -178> 2024-09-14T11:11:56.169+0000 7fd5ead30800 20 realm 2024-09-14T11:11:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -177> 2024-09-14T11:11:56.169+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -176> 2024-09-14T11:11:56.170+0000 7fd5ead30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -175> 2024-09-14T11:11:56.170+0000 7fd5ead30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -174> 2024-09-14T11:11:56.170+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -173> 2024-09-14T11:11:56.170+0000 7fd5ead30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -172> 2024-09-14T11:11:56.170+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -171> 2024-09-14T11:11:56.170+0000 7fd5e6ab0640 10 monclient: get_auth_request con 0x55dbe3e4afd0 auth_method 0 2024-09-14T11:11:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -170> 2024-09-14T11:11:56.171+0000 7fd5ead30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -169> 2024-09-14T11:11:56.171+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -168> 2024-09-14T11:11:56.171+0000 7fd5e62af640 10 monclient: get_auth_request con 0x55dbe3e4e6f0 auth_method 0 2024-09-14T11:11:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -167> 2024-09-14T11:11:56.171+0000 7fd5ead30800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -166> 2024-09-14T11:11:56.172+0000 7fd5ead30800 20 searching for the correct realm 2024-09-14T11:11:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -165> 2024-09-14T11:11:56.172+0000 7fd5e72b1640 10 monclient: get_auth_request con 0x55dbe3e534b0 auth_method 0 2024-09-14T11:11:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: -164> 2024-09-14T11:11:56.173+0000 7fd5e6ab0640 10 monclient: get_auth_request con 0x7fd5e0018940 auth_method 0 2024-09-14T11:11:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: -163> 2024-09-14T11:11:56.174+0000 7fd5e62af640 10 monclient: get_auth_request con 0x7fd5e003b410 auth_method 0 2024-09-14T11:11:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: -162> 2024-09-14T11:11:56.174+0000 7fd5e62af640 0 -- 172.21.15.50:0/3132939204 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fd5e003b410 msgr2=0x7fd5e003b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: -161> 2024-09-14T11:11:56.376+0000 7fd5e62af640 10 monclient: get_auth_request con 0x7fd5e003b410 auth_method 0 2024-09-14T11:11:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: -160> 2024-09-14T11:11:56.379+0000 7fd5e72b1640 10 monclient: get_auth_request con 0x7fd5d803a030 auth_method 0 2024-09-14T11:11:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: -159> 2024-09-14T11:11:56.379+0000 7fd5e6ab0640 10 monclient: get_auth_request con 0x7fd5e004a970 auth_method 0 2024-09-14T11:11:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: -158> 2024-09-14T11:11:56.380+0000 7fd5e72b1640 0 -- 172.21.15.50:0/3132939204 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55dbe3e46c40 msgr2=0x55dbe3e490e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: -157> 2024-09-14T11:11:56.380+0000 7fd4c8ff9640 1 client.6971.objecter ms_handle_reset 0x55dbe3e46c40 session 0x55dbe3e46530 osd.6 2024-09-14T11:11:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: -156> 2024-09-14T11:11:56.381+0000 7fd4c8ff9640 10 monclient: _renew_subs 2024-09-14T11:11:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: -155> 2024-09-14T11:11:56.381+0000 7fd4c8ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:11:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: -154> 2024-09-14T11:11:56.381+0000 7fd5e72b1640 10 monclient: get_auth_request con 0x7fd4b00874e0 auth_method 0 2024-09-14T11:11:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: -153> 2024-09-14T11:11:56.385+0000 7fd5ead30800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: -152> 2024-09-14T11:11:56.385+0000 7fd5ead30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: -151> 2024-09-14T11:11:56.385+0000 7fd5ead30800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: -150> 2024-09-14T11:11:56.385+0000 7fd5ead30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: -149> 2024-09-14T11:11:56.385+0000 7fd5ead30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: -148> 2024-09-14T11:11:56.385+0000 7fd5ead30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: -147> 2024-09-14T11:11:56.385+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: -146> 2024-09-14T11:11:56.385+0000 7fd5ead30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: -145> 2024-09-14T11:11:56.385+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: -144> 2024-09-14T11:11:56.385+0000 7fd5ead30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: -143> 2024-09-14T11:11:56.386+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: -142> 2024-09-14T11:11:56.386+0000 7fd5ead30800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: -141> 2024-09-14T11:11:56.386+0000 7fd5ead30800 20 zone default found 2024-09-14T11:11:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: -140> 2024-09-14T11:11:56.386+0000 7fd5ead30800 4 Realm: () 2024-09-14T11:11:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: -139> 2024-09-14T11:11:56.386+0000 7fd5ead30800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: -138> 2024-09-14T11:11:56.386+0000 7fd5ead30800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: -137> 2024-09-14T11:11:56.386+0000 7fd5ead30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: -136> 2024-09-14T11:11:56.386+0000 7fd5ead30800 20 zonegroup default 2024-09-14T11:11:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: -135> 2024-09-14T11:11:56.386+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: -134> 2024-09-14T11:11:56.386+0000 7fd5ead30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: -133> 2024-09-14T11:11:56.386+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: -132> 2024-09-14T11:11:56.386+0000 7fd5ead30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: -131> 2024-09-14T11:11:56.386+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: -130> 2024-09-14T11:11:56.387+0000 7fd5ead30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: -129> 2024-09-14T11:11:56.387+0000 7fd5ead30800 20 started sync module instance, tier type = 2024-09-14T11:11:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: -128> 2024-09-14T11:11:56.387+0000 7fd5ead30800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: -127> 2024-09-14T11:11:56.395+0000 7fd5ead30800 20 add_watcher() i=0 2024-09-14T11:11:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: -126> 2024-09-14T11:11:56.395+0000 7fd5ead30800 20 add_watcher() i=1 2024-09-14T11:11:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: -125> 2024-09-14T11:11:56.395+0000 7fd5ead30800 20 add_watcher() i=2 2024-09-14T11:11:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: -124> 2024-09-14T11:11:56.395+0000 7fd5ead30800 20 add_watcher() i=3 2024-09-14T11:11:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: -123> 2024-09-14T11:11:56.395+0000 7fd5ead30800 20 add_watcher() i=4 2024-09-14T11:11:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: -122> 2024-09-14T11:11:56.395+0000 7fd5ead30800 20 add_watcher() i=5 2024-09-14T11:11:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: -121> 2024-09-14T11:11:56.396+0000 7fd5ead30800 20 add_watcher() i=6 2024-09-14T11:11:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: -120> 2024-09-14T11:11:56.396+0000 7fd5ead30800 20 add_watcher() i=7 2024-09-14T11:11:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: -119> 2024-09-14T11:11:56.396+0000 7fd5ead30800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: -118> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding auth protocol: cephx 2024-09-14T11:11:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: -117> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding auth protocol: cephx 2024-09-14T11:11:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: -116> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding auth protocol: cephx 2024-09-14T11:11:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: -115> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding con mode: secure 2024-09-14T11:11:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: -114> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding con mode: crc 2024-09-14T11:11:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: -113> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding con mode: secure 2024-09-14T11:11:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: -112> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding con mode: crc 2024-09-14T11:11:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: -111> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding con mode: secure 2024-09-14T11:11:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: -110> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding con mode: crc 2024-09-14T11:11:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: -109> 2024-09-14T11:11:56.398+0000 7fd49d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: -108> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding con mode: crc 2024-09-14T11:11:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: -107> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding con mode: secure 2024-09-14T11:11:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: -106> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding con mode: crc 2024-09-14T11:11:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: -105> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding con mode: secure 2024-09-14T11:11:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: -104> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding con mode: crc 2024-09-14T11:11:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: -103> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding con mode: secure 2024-09-14T11:11:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: -102> 2024-09-14T11:11:56.398+0000 7fd5ead30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: -101> 2024-09-14T11:11:56.398+0000 7fd5ead30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: -100> 2024-09-14T11:11:56.398+0000 7fd5ead30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: -99> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command cache list hook 0x55dbe3e21bb0 2024-09-14T11:11:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: -98> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command cache inspect hook 0x55dbe3e21bb0 2024-09-14T11:11:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: -97> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command cache erase hook 0x55dbe3e21bb0 2024-09-14T11:11:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: -96> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command cache zap hook 0x55dbe3e21bb0 2024-09-14T11:11:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: -95> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 note: GC not initialized 2024-09-14T11:11:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: -94> 2024-09-14T11:11:56.399+0000 7fd417fff640 20 reqs_thread_entry: start 2024-09-14T11:11:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: -93> 2024-09-14T11:11:56.399+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command sync trace show hook 0x7fd5dc0c9040 2024-09-14T11:11:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: -92> 2024-09-14T11:11:56.399+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command sync trace history hook 0x7fd5dc0c9040 2024-09-14T11:11:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: -91> 2024-09-14T11:11:56.399+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command sync trace active hook 0x7fd5dc0c9040 2024-09-14T11:11:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: -90> 2024-09-14T11:11:56.399+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command sync trace active_short hook 0x7fd5dc0c9040 2024-09-14T11:11:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: -89> 2024-09-14T11:11:56.399+0000 7fd5ead30800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: -88> 2024-09-14T11:11:56.399+0000 7fd5ead30800 20 Filter name: none 2024-09-14T11:11:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: -87> 2024-09-14T11:11:56.399+0000 7fd415ffb640 20 reqs_thread_entry: start 2024-09-14T11:11:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: -86> 2024-09-14T11:11:56.399+0000 7fd5ead30800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:11:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: -85> 2024-09-14T11:11:56.399+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: -84> 2024-09-14T11:11:56.400+0000 7fd5ead30800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:11:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: -83> 2024-09-14T11:11:56.400+0000 7fd5ead30800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:11:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: -82> 2024-09-14T11:11:56.400+0000 7fd5ead30800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:11:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: -81> 2024-09-14T11:11:56.400+0000 7fd5ead30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 : miss 2024-09-14T11:11:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: -80> 2024-09-14T11:11:56.400+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: -79> 2024-09-14T11:11:56.400+0000 7fd5ead30800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:11:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: -78> 2024-09-14T11:11:56.400+0000 7fd5ead30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 info.flags=0x17 2024-09-14T11:11:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: -77> 2024-09-14T11:11:56.400+0000 7fd5ead30800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 to cache LRU end 2024-09-14T11:11:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: -76> 2024-09-14T11:11:56.400+0000 7fd5ead30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:11:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: -75> 2024-09-14T11:11:56.400+0000 7fd5ead30800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: -74> 2024-09-14T11:11:56.400+0000 7fd5ead30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 2024-09-14T11:11:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: -73> 2024-09-14T11:11:56.405+0000 7fd5ead30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 info.flags=0x17 2024-09-14T11:11:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: -72> 2024-09-14T11:11:56.405+0000 7fd5ead30800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 to cache LRU end 2024-09-14T11:11:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: -71> 2024-09-14T11:11:56.405+0000 7fd5ead30800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: -70> 2024-09-14T11:11:56.405+0000 7fd5ead30800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33, ofs0, ns] 2024-09-14T11:11:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: -69> 2024-09-14T11:11:56.406+0000 7fd4ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497091 cookie 94402909670960 notifier 6971 bl.length()=1015 2024-09-14T11:11:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: -68> 2024-09-14T11:11:56.406+0000 7fd4ca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 info.flags=0x17 2024-09-14T11:11:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: -67> 2024-09-14T11:11:56.406+0000 7fd4ca7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 to cache LRU end 2024-09-14T11:11:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: -66> 2024-09-14T11:11:56.406+0000 7fd4ca7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: -65> 2024-09-14T11:11:56.407+0000 7fd5ead30800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): orig_sources= new_sources= 2024-09-14T11:11:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: -64> 2024-09-14T11:11:56.407+0000 7fd5ead30800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): potential sources added=[] removed=[] 2024-09-14T11:11:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: -63> 2024-09-14T11:11:56.407+0000 7fd5ead30800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): orig_dests= new_dests= 2024-09-14T11:11:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: -62> 2024-09-14T11:11:56.407+0000 7fd5ead30800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): potential dests added=[] removed=[] 2024-09-14T11:11:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: -61> 2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.0 2024-09-14T11:11:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: -60> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.0 2024-09-14T11:11:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: -59> 2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.1 2024-09-14T11:11:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: -58> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.1 2024-09-14T11:11:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: -57> 2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.2 2024-09-14T11:11:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: -56> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.2 2024-09-14T11:11:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: -55> 2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.3 2024-09-14T11:11:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: -54> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.3 2024-09-14T11:11:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: -53> 2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.4 2024-09-14T11:11:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: -52> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.4 2024-09-14T11:11:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: -51> 2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.5 2024-09-14T11:11:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: -50> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.5 2024-09-14T11:11:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: -49> 2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.6 2024-09-14T11:11:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: -48> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.6 2024-09-14T11:11:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: -47> 2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.7 2024-09-14T11:11:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: -46> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.7 2024-09-14T11:11:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: -45> 2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.8 2024-09-14T11:11:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: -44> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.8 2024-09-14T11:11:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: -43> 2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.9 2024-09-14T11:11:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: -42> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.9 2024-09-14T11:11:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: -41> 2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.10 2024-09-14T11:11:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: -40> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.10 2024-09-14T11:11:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: -39> 2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.11 2024-09-14T11:11:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: -38> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.11 2024-09-14T11:11:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: -37> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.0 2024-09-14T11:11:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: -36> 2024-09-14T11:11:56.414+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1 2024-09-14T11:11:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: -35> 2024-09-14T11:11:56.414+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.2 2024-09-14T11:11:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: -34> 2024-09-14T11:11:56.414+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.3 2024-09-14T11:11:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: -33> 2024-09-14T11:11:56.415+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.4 2024-09-14T11:11:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: -32> 2024-09-14T11:11:56.416+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.5 2024-09-14T11:11:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: -31> 2024-09-14T11:11:56.416+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.6 2024-09-14T11:11:56.495 INFO:tasks.workunit.client.0.smithi050.stderr: -30> 2024-09-14T11:11:56.417+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.7 2024-09-14T11:11:56.495 INFO:tasks.workunit.client.0.smithi050.stderr: -29> 2024-09-14T11:11:56.417+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.8 2024-09-14T11:11:56.495 INFO:tasks.workunit.client.0.smithi050.stderr: -28> 2024-09-14T11:11:56.418+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.9 2024-09-14T11:11:56.495 INFO:tasks.workunit.client.0.smithi050.stderr: -27> 2024-09-14T11:11:56.418+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.10 2024-09-14T11:11:56.495 INFO:tasks.workunit.client.0.smithi050.stderr: -26> 2024-09-14T11:11:56.421+0000 7fd5ead30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:11:56.495 INFO:tasks.workunit.client.0.smithi050.stderr: -25> 2024-09-14T11:11:56.422+0000 7fd5ead30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 2024-09-14T11:11:56.495 INFO:tasks.workunit.client.0.smithi050.stderr: -24> 2024-09-14T11:11:56.423+0000 7fd5ead30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 info.flags=0x17 2024-09-14T11:11:56.495 INFO:tasks.workunit.client.0.smithi050.stderr: -23> 2024-09-14T11:11:56.423+0000 7fd5ead30800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 to cache LRU end 2024-09-14T11:11:56.495 INFO:tasks.workunit.client.0.smithi050.stderr: -22> 2024-09-14T11:11:56.423+0000 7fd5ead30800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:56.495 INFO:tasks.workunit.client.0.smithi050.stderr: -21> 2024-09-14T11:11:56.423+0000 7fd5ead30800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33, ofs0, ns] 2024-09-14T11:11:56.495 INFO:tasks.workunit.client.0.smithi050.stderr: -20> 2024-09-14T11:11:56.423+0000 7fd4ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497092 cookie 94402909670960 notifier 6971 bl.length()=1015 2024-09-14T11:11:56.495 INFO:tasks.workunit.client.0.smithi050.stderr: -19> 2024-09-14T11:11:56.423+0000 7fd4ca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 info.flags=0x17 2024-09-14T11:11:56.495 INFO:tasks.workunit.client.0.smithi050.stderr: -18> 2024-09-14T11:11:56.423+0000 7fd4ca7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 to cache LRU end 2024-09-14T11:11:56.496 INFO:tasks.workunit.client.0.smithi050.stderr: -17> 2024-09-14T11:11:56.423+0000 7fd4ca7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:56.496 INFO:tasks.workunit.client.0.smithi050.stderr: -16> 2024-09-14T11:11:56.425+0000 7fd5ead30800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): orig_sources= new_sources= 2024-09-14T11:11:56.496 INFO:tasks.workunit.client.0.smithi050.stderr: -15> 2024-09-14T11:11:56.425+0000 7fd5ead30800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): potential sources added=[] removed=[] 2024-09-14T11:11:56.496 INFO:tasks.workunit.client.0.smithi050.stderr: -14> 2024-09-14T11:11:56.425+0000 7fd5ead30800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): orig_dests= new_dests= 2024-09-14T11:11:56.496 INFO:tasks.workunit.client.0.smithi050.stderr: -13> 2024-09-14T11:11:56.425+0000 7fd5ead30800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): potential dests added=[] removed=[] 2024-09-14T11:11:56.496 INFO:tasks.workunit.client.0.smithi050.stderr: -12> 2024-09-14T11:11:56.427+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.0 2024-09-14T11:11:56.496 INFO:tasks.workunit.client.0.smithi050.stderr: -11> 2024-09-14T11:11:56.428+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1 2024-09-14T11:11:56.496 INFO:tasks.workunit.client.0.smithi050.stderr: -10> 2024-09-14T11:11:56.428+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.2 2024-09-14T11:11:56.496 INFO:tasks.workunit.client.0.smithi050.stderr: -9> 2024-09-14T11:11:56.428+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.3 2024-09-14T11:11:56.496 INFO:tasks.workunit.client.0.smithi050.stderr: -8> 2024-09-14T11:11:56.429+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.4 2024-09-14T11:11:56.496 INFO:tasks.workunit.client.0.smithi050.stderr: -7> 2024-09-14T11:11:56.429+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.5 2024-09-14T11:11:56.496 INFO:tasks.workunit.client.0.smithi050.stderr: -6> 2024-09-14T11:11:56.429+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.6 2024-09-14T11:11:56.496 INFO:tasks.workunit.client.0.smithi050.stderr: -5> 2024-09-14T11:11:56.430+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.7 2024-09-14T11:11:56.497 INFO:tasks.workunit.client.0.smithi050.stderr: -4> 2024-09-14T11:11:56.430+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.8 2024-09-14T11:11:56.497 INFO:tasks.workunit.client.0.smithi050.stderr: -3> 2024-09-14T11:11:56.430+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.9 2024-09-14T11:11:56.497 INFO:tasks.workunit.client.0.smithi050.stderr: -2> 2024-09-14T11:11:56.431+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.10 2024-09-14T11:11:56.497 INFO:tasks.workunit.client.0.smithi050.stderr: -1> 2024-09-14T11:11:56.432+0000 7fd5ead30800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd5ead30800 time 2024-09-14T11:11:56.431919+0000 2024-09-14T11:11:56.497 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:11:56.497 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.497 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:11:56.497 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd5ec58c76a] 2024-09-14T11:11:56.497 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd5ec58c928] 2024-09-14T11:11:56.497 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dbe22f20b1] 2024-09-14T11:11:56.497 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55dbe2302217] 2024-09-14T11:11:56.497 INFO:tasks.workunit.client.0.smithi050.stderr: 5: main() 2024-09-14T11:11:56.497 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fd5eb229590] 2024-09-14T11:11:56.498 INFO:tasks.workunit.client.0.smithi050.stderr: 7: __libc_start_main() 2024-09-14T11:11:56.498 INFO:tasks.workunit.client.0.smithi050.stderr: 8: _start() 2024-09-14T11:11:56.498 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.498 INFO:tasks.workunit.client.0.smithi050.stderr: 0> 2024-09-14T11:11:56.432+0000 7fd5ead30800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:11:56.498 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7fd5ead30800 thread_name:radosgw-admin 2024-09-14T11:11:56.498 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.498 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:11:56.498 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd5eb23e6f0] 2024-09-14T11:11:56.498 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd5eb28b99c] 2024-09-14T11:11:56.498 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:11:56.498 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:11:56.498 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd5ec58c7c4] 2024-09-14T11:11:56.498 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd5ec58c928] 2024-09-14T11:11:56.498 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dbe22f20b1] 2024-09-14T11:11:56.499 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55dbe2302217] 2024-09-14T11:11:56.499 INFO:tasks.workunit.client.0.smithi050.stderr: 9: main() 2024-09-14T11:11:56.499 INFO:tasks.workunit.client.0.smithi050.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fd5eb229590] 2024-09-14T11:11:56.499 INFO:tasks.workunit.client.0.smithi050.stderr: 11: __libc_start_main() 2024-09-14T11:11:56.499 INFO:tasks.workunit.client.0.smithi050.stderr: 12: _start() 2024-09-14T11:11:56.499 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:11:56.499 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.499 INFO:tasks.workunit.client.0.smithi050.stderr:--- logging levels --- 2024-09-14T11:11:56.499 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 none 2024-09-14T11:11:56.499 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 lockdep 2024-09-14T11:11:56.499 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 context 2024-09-14T11:11:56.499 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 crush 2024-09-14T11:11:56.499 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds 2024-09-14T11:11:56.500 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_balancer 2024-09-14T11:11:56.500 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_locker 2024-09-14T11:11:56.500 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log 2024-09-14T11:11:56.500 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log_expire 2024-09-14T11:11:56.500 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_migrator 2024-09-14T11:11:56.500 INFO:tasks.workunit.client.0.smithi050.stderr: 3/ 5 mds_quiesce 2024-09-14T11:11:56.500 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 buffer 2024-09-14T11:11:56.500 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 timer 2024-09-14T11:11:56.500 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 filer 2024-09-14T11:11:56.500 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 striper 2024-09-14T11:11:56.500 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 objecter 2024-09-14T11:11:56.500 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rados 2024-09-14T11:11:56.500 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd 2024-09-14T11:11:56.500 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_mirror 2024-09-14T11:11:56.501 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_replay 2024-09-14T11:11:56.501 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_pwl 2024-09-14T11:11:56.501 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 journaler 2024-09-14T11:11:56.501 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objectcacher 2024-09-14T11:11:56.501 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:11:56.501 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 client 2024-09-14T11:11:56.501 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 osd 2024-09-14T11:11:56.501 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 optracker 2024-09-14T11:11:56.501 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objclass 2024-09-14T11:11:56.501 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 filestore 2024-09-14T11:11:56.501 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 journal 2024-09-14T11:11:56.501 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 ms 2024-09-14T11:11:56.502 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mon 2024-09-14T11:11:56.502 INFO:tasks.workunit.client.0.smithi050.stderr: 0/10 monc 2024-09-14T11:11:56.502 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 paxos 2024-09-14T11:11:56.502 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 tp 2024-09-14T11:11:56.502 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 auth 2024-09-14T11:11:56.502 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 crypto 2024-09-14T11:11:56.502 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 finisher 2024-09-14T11:11:56.502 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 reserver 2024-09-14T11:11:56.502 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 heartbeatmap 2024-09-14T11:11:56.502 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 perfcounter 2024-09-14T11:11:56.502 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw 2024-09-14T11:11:56.502 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_sync 2024-09-14T11:11:56.502 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_datacache 2024-09-14T11:11:56.502 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_access 2024-09-14T11:11:56.503 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:11:56.503 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_flight 2024-09-14T11:11:56.503 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:11:56.503 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw_notification 2024-09-14T11:11:56.503 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 javaclient 2024-09-14T11:11:56.503 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 asok 2024-09-14T11:11:56.503 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 throttle 2024-09-14T11:11:56.503 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 refs 2024-09-14T11:11:56.503 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 compressor 2024-09-14T11:11:56.503 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluestore 2024-09-14T11:11:56.503 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluefs 2024-09-14T11:11:56.503 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 bdev 2024-09-14T11:11:56.503 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 kstore 2024-09-14T11:11:56.503 INFO:tasks.workunit.client.0.smithi050.stderr: 4/ 5 rocksdb 2024-09-14T11:11:56.503 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 fuse 2024-09-14T11:11:56.504 INFO:tasks.workunit.client.0.smithi050.stderr: 2/ 5 mgr 2024-09-14T11:11:56.504 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mgrc 2024-09-14T11:11:56.504 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 dpdk 2024-09-14T11:11:56.504 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 eventtrace 2024-09-14T11:11:56.504 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 prioritycache 2024-09-14T11:11:56.504 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 test 2024-09-14T11:11:56.504 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:11:56.504 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephsqlite 2024-09-14T11:11:56.504 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:11:56.504 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore 2024-09-14T11:11:56.504 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_onode 2024-09-14T11:11:56.504 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_odata 2024-09-14T11:11:56.504 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_omap 2024-09-14T11:11:56.505 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_tm 2024-09-14T11:11:56.505 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_t 2024-09-14T11:11:56.505 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:11:56.505 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_epm 2024-09-14T11:11:56.505 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_lba 2024-09-14T11:11:56.505 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:11:56.505 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cache 2024-09-14T11:11:56.505 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_journal 2024-09-14T11:11:56.505 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_device 2024-09-14T11:11:56.505 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_backref 2024-09-14T11:11:56.505 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 alienstore 2024-09-14T11:11:56.505 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mclock 2024-09-14T11:11:56.505 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cyanstore 2024-09-14T11:11:56.506 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 ceph_exporter 2024-09-14T11:11:56.506 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 memstore 2024-09-14T11:11:56.506 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 trace 2024-09-14T11:11:56.506 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 ceph_dedup 2024-09-14T11:11:56.506 INFO:tasks.workunit.client.0.smithi050.stderr: -2/-2 (syslog threshold) 2024-09-14T11:11:56.506 INFO:tasks.workunit.client.0.smithi050.stderr: 99/99 (stderr threshold) 2024-09-14T11:11:56.506 INFO:tasks.workunit.client.0.smithi050.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:11:56.506 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd415ffb640 / http_manager 2024-09-14T11:11:56.506 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd417fff640 / http_manager 2024-09-14T11:11:56.506 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd49d7e2640 / rgw_dt_lg_renew 2024-09-14T11:11:56.506 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd4c8ff9640 / ms_dispatch 2024-09-14T11:11:56.506 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd4ca7fc640 / io_context_pool 2024-09-14T11:11:56.506 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd4d0e01640 / ms_dispatch 2024-09-14T11:11:56.506 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd4d3606640 / ms_dispatch 2024-09-14T11:11:56.507 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd4d4e09640 / io_context_pool 2024-09-14T11:11:56.507 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd5e62af640 / msgr-worker-2 2024-09-14T11:11:56.507 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd5e6ab0640 / msgr-worker-1 2024-09-14T11:11:56.507 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd5e72b1640 / msgr-worker-0 2024-09-14T11:11:56.507 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd5e7ab2640 / io_context_pool 2024-09-14T11:11:56.507 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd5ead30800 / radosgw-admin 2024-09-14T11:11:56.507 INFO:tasks.workunit.client.0.smithi050.stderr: max_recent 500 2024-09-14T11:11:56.507 INFO:tasks.workunit.client.0.smithi050.stderr: max_new 1000 2024-09-14T11:11:56.507 INFO:tasks.workunit.client.0.smithi050.stderr: log_file /var/log/ceph/ceph-client.admin.122592.log 2024-09-14T11:11:56.507 INFO:tasks.workunit.client.0.smithi050.stderr:--- end dump of recent events --- 2024-09-14T11:11:56.507 INFO:tasks.workunit.client.0.smithi050.stderr:--- begin dump of recent events --- 2024-09-14T11:11:56.507 INFO:tasks.workunit.client.0.smithi050.stderr: -499> 2024-09-14T11:11:56.152+0000 7fd5e62af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:56.507 INFO:tasks.workunit.client.0.smithi050.stderr: -498> 2024-09-14T11:11:56.152+0000 7fd5e72b1640 10 monclient(hunting): get_auth_request con 0x55dbe3d62ac0 auth_method 0 2024-09-14T11:11:56.507 INFO:tasks.workunit.client.0.smithi050.stderr: -497> 2024-09-14T11:11:56.152+0000 7fd5e72b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:56.507 INFO:tasks.workunit.client.0.smithi050.stderr: -496> 2024-09-14T11:11:56.152+0000 7fd5e72b1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:56.508 INFO:tasks.workunit.client.0.smithi050.stderr: -495> 2024-09-14T11:11:56.152+0000 7fd5e72b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:56.508 INFO:tasks.workunit.client.0.smithi050.stderr: -494> 2024-09-14T11:11:56.152+0000 7fd5e62af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:56.508 INFO:tasks.workunit.client.0.smithi050.stderr: -493> 2024-09-14T11:11:56.152+0000 7fd5e62af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:56.508 INFO:tasks.workunit.client.0.smithi050.stderr: -492> 2024-09-14T11:11:56.152+0000 7fd5e62af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:56.508 INFO:tasks.workunit.client.0.smithi050.stderr: -491> 2024-09-14T11:11:56.152+0000 7fd5e72b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:56.508 INFO:tasks.workunit.client.0.smithi050.stderr: -490> 2024-09-14T11:11:56.152+0000 7fd5e72b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:56.508 INFO:tasks.workunit.client.0.smithi050.stderr: -489> 2024-09-14T11:11:56.152+0000 7fd5e72b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:56.508 INFO:tasks.workunit.client.0.smithi050.stderr: -488> 2024-09-14T11:11:56.152+0000 7fd5e6ab0640 10 monclient(hunting): get_auth_request con 0x55dbe3be7df0 auth_method 0 2024-09-14T11:11:56.508 INFO:tasks.workunit.client.0.smithi050.stderr: -487> 2024-09-14T11:11:56.152+0000 7fd5e6ab0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:56.508 INFO:tasks.workunit.client.0.smithi050.stderr: -486> 2024-09-14T11:11:56.152+0000 7fd5e6ab0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:56.508 INFO:tasks.workunit.client.0.smithi050.stderr: -485> 2024-09-14T11:11:56.152+0000 7fd5e6ab0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:56.508 INFO:tasks.workunit.client.0.smithi050.stderr: -484> 2024-09-14T11:11:56.153+0000 7fd5e6ab0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:56.508 INFO:tasks.workunit.client.0.smithi050.stderr: -483> 2024-09-14T11:11:56.153+0000 7fd5e6ab0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:56.509 INFO:tasks.workunit.client.0.smithi050.stderr: -482> 2024-09-14T11:11:56.153+0000 7fd5e6ab0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:56.509 INFO:tasks.workunit.client.0.smithi050.stderr: -481> 2024-09-14T11:11:56.153+0000 7fd5e62af640 10 monclient(hunting): handle_auth_done global_id 6962 payload 824 2024-09-14T11:11:56.509 INFO:tasks.workunit.client.0.smithi050.stderr: -480> 2024-09-14T11:11:56.153+0000 7fd5e62af640 10 monclient: _finish_hunting 0 2024-09-14T11:11:56.509 INFO:tasks.workunit.client.0.smithi050.stderr: -479> 2024-09-14T11:11:56.153+0000 7fd5e62af640 1 monclient: found mon.noname-c 2024-09-14T11:11:56.509 INFO:tasks.workunit.client.0.smithi050.stderr: -478> 2024-09-14T11:11:56.153+0000 7fd5e62af640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:11:56.509 INFO:tasks.workunit.client.0.smithi050.stderr: -477> 2024-09-14T11:11:56.153+0000 7fd4d3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:56.509 INFO:tasks.workunit.client.0.smithi050.stderr: -476> 2024-09-14T11:11:56.153+0000 7fd4d3606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:11:56.509 INFO:tasks.workunit.client.0.smithi050.stderr: -475> 2024-09-14T11:11:56.153+0000 7fd4d3606640 10 monclient: dump: 2024-09-14T11:11:56.509 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:56.509 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:56.509 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.509 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.509 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:56.510 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:56.510 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:56.510 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:56.510 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:56.510 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.510 INFO:tasks.workunit.client.0.smithi050.stderr: -474> 2024-09-14T11:11:56.153+0000 7fd4d3606640 10 monclient: _finish_auth 0 2024-09-14T11:11:56.510 INFO:tasks.workunit.client.0.smithi050.stderr: -473> 2024-09-14T11:11:56.153+0000 7fd4d3606640 10 monclient: _check_auth_tickets 2024-09-14T11:11:56.510 INFO:tasks.workunit.client.0.smithi050.stderr: -472> 2024-09-14T11:11:56.153+0000 7fd4d3606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:11:56.510 INFO:tasks.workunit.client.0.smithi050.stderr: -471> 2024-09-14T11:11:56.153+0000 7fd4d3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:56.510 INFO:tasks.workunit.client.0.smithi050.stderr: -470> 2024-09-14T11:11:56.153+0000 7fd4d3606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:11:56.510 INFO:tasks.workunit.client.0.smithi050.stderr: -469> 2024-09-14T11:11:56.153+0000 7fd4d3606640 10 monclient: dump: 2024-09-14T11:11:56.510 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:56.510 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:56.510 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.510 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.511 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:56.511 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:56.511 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:56.511 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:56.511 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:56.511 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.511 INFO:tasks.workunit.client.0.smithi050.stderr: -468> 2024-09-14T11:11:56.153+0000 7fd5ead30800 5 monclient: authenticate success, global_id 6962 2024-09-14T11:11:56.511 INFO:tasks.workunit.client.0.smithi050.stderr: -467> 2024-09-14T11:11:56.153+0000 7fd5ead30800 10 monclient: _renew_subs 2024-09-14T11:11:56.511 INFO:tasks.workunit.client.0.smithi050.stderr: -466> 2024-09-14T11:11:56.153+0000 7fd5ead30800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:11:56.511 INFO:tasks.workunit.client.0.smithi050.stderr: -465> 2024-09-14T11:11:56.153+0000 7fd4d4e09640 4 set_mon_vals no callback set 2024-09-14T11:11:56.511 INFO:tasks.workunit.client.0.smithi050.stderr: -464> 2024-09-14T11:11:56.153+0000 7fd5ead30800 10 monclient: _renew_subs 2024-09-14T11:11:56.511 INFO:tasks.workunit.client.0.smithi050.stderr: -463> 2024-09-14T11:11:56.153+0000 7fd5ead30800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:11:56.511 INFO:tasks.workunit.client.0.smithi050.stderr: -462> 2024-09-14T11:11:56.153+0000 7fd5ead30800 1 librados: init done 2024-09-14T11:11:56.511 INFO:tasks.workunit.client.0.smithi050.stderr: -461> 2024-09-14T11:11:56.155+0000 7fd4d3606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:11:56.512 INFO:tasks.workunit.client.0.smithi050.stderr: -460> 2024-09-14T11:11:56.155+0000 7fd4d3606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:11:56.512 INFO:tasks.workunit.client.0.smithi050.stderr: -459> 2024-09-14T11:11:56.155+0000 7fd4d3606640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:11:56.512 INFO:tasks.workunit.client.0.smithi050.stderr: -458> 2024-09-14T11:11:56.155+0000 7fd5e6ab0640 10 monclient: get_auth_request con 0x7fd4cc077230 auth_method 0 2024-09-14T11:11:56.512 INFO:tasks.workunit.client.0.smithi050.stderr: -457> 2024-09-14T11:11:56.156+0000 7fd5e72b1640 10 monclient: get_auth_request con 0x55dbe3d9e110 auth_method 0 2024-09-14T11:11:56.512 INFO:tasks.workunit.client.0.smithi050.stderr: -456> 2024-09-14T11:11:56.156+0000 7fd5e6ab0640 10 monclient: get_auth_request con 0x55dbe3da8f00 auth_method 0 2024-09-14T11:11:56.512 INFO:tasks.workunit.client.0.smithi050.stderr: -455> 2024-09-14T11:11:56.157+0000 7fd5e62af640 10 monclient: get_auth_request con 0x55dbe3dad0f0 auth_method 0 2024-09-14T11:11:56.512 INFO:tasks.workunit.client.0.smithi050.stderr: -454> 2024-09-14T11:11:56.158+0000 7fd5ead30800 10 monclient: build_initial_monmap 2024-09-14T11:11:56.512 INFO:tasks.workunit.client.0.smithi050.stderr: -453> 2024-09-14T11:11:56.158+0000 7fd5ead30800 1 build_initial for_mkfs: 0 2024-09-14T11:11:56.512 INFO:tasks.workunit.client.0.smithi050.stderr: -452> 2024-09-14T11:11:56.158+0000 7fd5ead30800 10 monclient: monmap: 2024-09-14T11:11:56.512 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:11:56.512 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:11:56.512 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:11:56.513 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:11:56.513 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:11:56.513 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:56.513 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:11:56.513 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:11:56.513 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:11:56.513 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.513 INFO:tasks.workunit.client.0.smithi050.stderr: -451> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding auth protocol: cephx 2024-09-14T11:11:56.513 INFO:tasks.workunit.client.0.smithi050.stderr: -450> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding auth protocol: cephx 2024-09-14T11:11:56.513 INFO:tasks.workunit.client.0.smithi050.stderr: -449> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding auth protocol: cephx 2024-09-14T11:11:56.513 INFO:tasks.workunit.client.0.smithi050.stderr: -448> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding con mode: secure 2024-09-14T11:11:56.513 INFO:tasks.workunit.client.0.smithi050.stderr: -447> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding con mode: crc 2024-09-14T11:11:56.513 INFO:tasks.workunit.client.0.smithi050.stderr: -446> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding con mode: secure 2024-09-14T11:11:56.514 INFO:tasks.workunit.client.0.smithi050.stderr: -445> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding con mode: crc 2024-09-14T11:11:56.514 INFO:tasks.workunit.client.0.smithi050.stderr: -444> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding con mode: secure 2024-09-14T11:11:56.514 INFO:tasks.workunit.client.0.smithi050.stderr: -443> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding con mode: crc 2024-09-14T11:11:56.514 INFO:tasks.workunit.client.0.smithi050.stderr: -442> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding con mode: crc 2024-09-14T11:11:56.514 INFO:tasks.workunit.client.0.smithi050.stderr: -441> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding con mode: secure 2024-09-14T11:11:56.514 INFO:tasks.workunit.client.0.smithi050.stderr: -440> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding con mode: crc 2024-09-14T11:11:56.514 INFO:tasks.workunit.client.0.smithi050.stderr: -439> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding con mode: secure 2024-09-14T11:11:56.514 INFO:tasks.workunit.client.0.smithi050.stderr: -438> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding con mode: crc 2024-09-14T11:11:56.514 INFO:tasks.workunit.client.0.smithi050.stderr: -437> 2024-09-14T11:11:56.158+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db1f80) adding con mode: secure 2024-09-14T11:11:56.514 INFO:tasks.workunit.client.0.smithi050.stderr: -436> 2024-09-14T11:11:56.158+0000 7fd5ead30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:56.514 INFO:tasks.workunit.client.0.smithi050.stderr: -435> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command objecter_requests cmddesc objecter_requests hook 0x55dbe3db53c0 EEXIST 2024-09-14T11:11:56.514 INFO:tasks.workunit.client.0.smithi050.stderr: -434> 2024-09-14T11:11:56.159+0000 7fd5ead30800 10 monclient: init 2024-09-14T11:11:56.514 INFO:tasks.workunit.client.0.smithi050.stderr: -433> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding auth protocol: cephx 2024-09-14T11:11:56.515 INFO:tasks.workunit.client.0.smithi050.stderr: -432> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding auth protocol: cephx 2024-09-14T11:11:56.515 INFO:tasks.workunit.client.0.smithi050.stderr: -431> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding auth protocol: cephx 2024-09-14T11:11:56.515 INFO:tasks.workunit.client.0.smithi050.stderr: -430> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding con mode: secure 2024-09-14T11:11:56.515 INFO:tasks.workunit.client.0.smithi050.stderr: -429> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding con mode: crc 2024-09-14T11:11:56.515 INFO:tasks.workunit.client.0.smithi050.stderr: -428> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding con mode: secure 2024-09-14T11:11:56.515 INFO:tasks.workunit.client.0.smithi050.stderr: -427> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding con mode: crc 2024-09-14T11:11:56.515 INFO:tasks.workunit.client.0.smithi050.stderr: -426> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding con mode: secure 2024-09-14T11:11:56.515 INFO:tasks.workunit.client.0.smithi050.stderr: -425> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding con mode: crc 2024-09-14T11:11:56.515 INFO:tasks.workunit.client.0.smithi050.stderr: -424> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding con mode: crc 2024-09-14T11:11:56.515 INFO:tasks.workunit.client.0.smithi050.stderr: -423> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding con mode: secure 2024-09-14T11:11:56.515 INFO:tasks.workunit.client.0.smithi050.stderr: -422> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding con mode: crc 2024-09-14T11:11:56.515 INFO:tasks.workunit.client.0.smithi050.stderr: -421> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding con mode: secure 2024-09-14T11:11:56.515 INFO:tasks.workunit.client.0.smithi050.stderr: -420> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding con mode: crc 2024-09-14T11:11:56.515 INFO:tasks.workunit.client.0.smithi050.stderr: -419> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3db0488) adding con mode: secure 2024-09-14T11:11:56.516 INFO:tasks.workunit.client.0.smithi050.stderr: -418> 2024-09-14T11:11:56.159+0000 7fd5ead30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:56.516 INFO:tasks.workunit.client.0.smithi050.stderr: -417> 2024-09-14T11:11:56.159+0000 7fd5ead30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:56.516 INFO:tasks.workunit.client.0.smithi050.stderr: -416> 2024-09-14T11:11:56.159+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command rotate-key cmddesc rotate-key hook 0x55dbe3db05d0 EEXIST 2024-09-14T11:11:56.516 INFO:tasks.workunit.client.0.smithi050.stderr: -415> 2024-09-14T11:11:56.159+0000 7fd5ead30800 10 monclient: _reopen_session rank -1 2024-09-14T11:11:56.516 INFO:tasks.workunit.client.0.smithi050.stderr: -414> 2024-09-14T11:11:56.159+0000 7fd5ead30800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:11:56.516 INFO:tasks.workunit.client.0.smithi050.stderr: -413> 2024-09-14T11:11:56.159+0000 7fd5ead30800 10 monclient(hunting): picked mon.noname-a con 0x55dbe3dd96e0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:11:56.516 INFO:tasks.workunit.client.0.smithi050.stderr: -412> 2024-09-14T11:11:56.159+0000 7fd5ead30800 10 monclient(hunting): picked mon.noname-c con 0x55dbe3dd9ac0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:11:56.516 INFO:tasks.workunit.client.0.smithi050.stderr: -411> 2024-09-14T11:11:56.159+0000 7fd5ead30800 10 monclient(hunting): picked mon.noname-b con 0x55dbe3dd83f0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:11:56.516 INFO:tasks.workunit.client.0.smithi050.stderr: -410> 2024-09-14T11:11:56.159+0000 7fd5ead30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:56.516 INFO:tasks.workunit.client.0.smithi050.stderr: -409> 2024-09-14T11:11:56.159+0000 7fd5ead30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:56.516 INFO:tasks.workunit.client.0.smithi050.stderr: -408> 2024-09-14T11:11:56.159+0000 7fd5ead30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:56.516 INFO:tasks.workunit.client.0.smithi050.stderr: -407> 2024-09-14T11:11:56.159+0000 7fd5ead30800 10 monclient(hunting): _renew_subs 2024-09-14T11:11:56.516 INFO:tasks.workunit.client.0.smithi050.stderr: -406> 2024-09-14T11:11:56.159+0000 7fd5ead30800 10 monclient(hunting): authenticate will time out at 2368.796760s 2024-09-14T11:11:56.517 INFO:tasks.workunit.client.0.smithi050.stderr: -405> 2024-09-14T11:11:56.159+0000 7fd5e62af640 10 monclient(hunting): get_auth_request con 0x55dbe3dd9ac0 auth_method 0 2024-09-14T11:11:56.517 INFO:tasks.workunit.client.0.smithi050.stderr: -404> 2024-09-14T11:11:56.159+0000 7fd5e62af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:56.517 INFO:tasks.workunit.client.0.smithi050.stderr: -403> 2024-09-14T11:11:56.159+0000 7fd5e62af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:56.517 INFO:tasks.workunit.client.0.smithi050.stderr: -402> 2024-09-14T11:11:56.159+0000 7fd5e62af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:56.517 INFO:tasks.workunit.client.0.smithi050.stderr: -401> 2024-09-14T11:11:56.159+0000 7fd5e6ab0640 10 monclient(hunting): get_auth_request con 0x55dbe3dd96e0 auth_method 0 2024-09-14T11:11:56.517 INFO:tasks.workunit.client.0.smithi050.stderr: -400> 2024-09-14T11:11:56.159+0000 7fd5e6ab0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:56.517 INFO:tasks.workunit.client.0.smithi050.stderr: -399> 2024-09-14T11:11:56.159+0000 7fd5e6ab0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:56.517 INFO:tasks.workunit.client.0.smithi050.stderr: -398> 2024-09-14T11:11:56.159+0000 7fd5e6ab0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:56.517 INFO:tasks.workunit.client.0.smithi050.stderr: -397> 2024-09-14T11:11:56.159+0000 7fd5e62af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:56.517 INFO:tasks.workunit.client.0.smithi050.stderr: -396> 2024-09-14T11:11:56.159+0000 7fd5e62af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:56.517 INFO:tasks.workunit.client.0.smithi050.stderr: -395> 2024-09-14T11:11:56.159+0000 7fd5e62af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:56.517 INFO:tasks.workunit.client.0.smithi050.stderr: -394> 2024-09-14T11:11:56.159+0000 7fd5e72b1640 10 monclient(hunting): get_auth_request con 0x55dbe3dd83f0 auth_method 0 2024-09-14T11:11:56.517 INFO:tasks.workunit.client.0.smithi050.stderr: -393> 2024-09-14T11:11:56.159+0000 7fd5e72b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:56.517 INFO:tasks.workunit.client.0.smithi050.stderr: -392> 2024-09-14T11:11:56.159+0000 7fd5e72b1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:56.518 INFO:tasks.workunit.client.0.smithi050.stderr: -391> 2024-09-14T11:11:56.159+0000 7fd5e72b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:56.518 INFO:tasks.workunit.client.0.smithi050.stderr: -390> 2024-09-14T11:11:56.160+0000 7fd5e6ab0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:56.518 INFO:tasks.workunit.client.0.smithi050.stderr: -389> 2024-09-14T11:11:56.160+0000 7fd5e6ab0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:56.518 INFO:tasks.workunit.client.0.smithi050.stderr: -388> 2024-09-14T11:11:56.160+0000 7fd5e6ab0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:56.518 INFO:tasks.workunit.client.0.smithi050.stderr: -387> 2024-09-14T11:11:56.160+0000 7fd5e72b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:56.518 INFO:tasks.workunit.client.0.smithi050.stderr: -386> 2024-09-14T11:11:56.160+0000 7fd5e72b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:56.518 INFO:tasks.workunit.client.0.smithi050.stderr: -385> 2024-09-14T11:11:56.160+0000 7fd5e72b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:56.518 INFO:tasks.workunit.client.0.smithi050.stderr: -384> 2024-09-14T11:11:56.160+0000 7fd5e62af640 10 monclient(hunting): handle_auth_done global_id 6965 payload 824 2024-09-14T11:11:56.518 INFO:tasks.workunit.client.0.smithi050.stderr: -383> 2024-09-14T11:11:56.160+0000 7fd5e62af640 10 monclient: _finish_hunting 0 2024-09-14T11:11:56.518 INFO:tasks.workunit.client.0.smithi050.stderr: -382> 2024-09-14T11:11:56.160+0000 7fd5e62af640 1 monclient: found mon.noname-c 2024-09-14T11:11:56.518 INFO:tasks.workunit.client.0.smithi050.stderr: -381> 2024-09-14T11:11:56.160+0000 7fd5e62af640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:11:56.518 INFO:tasks.workunit.client.0.smithi050.stderr: -380> 2024-09-14T11:11:56.160+0000 7fd4d0e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:56.518 INFO:tasks.workunit.client.0.smithi050.stderr: -379> 2024-09-14T11:11:56.160+0000 7fd4d0e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:11:56.519 INFO:tasks.workunit.client.0.smithi050.stderr: -378> 2024-09-14T11:11:56.160+0000 7fd4d0e01640 10 monclient: dump: 2024-09-14T11:11:56.519 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:56.519 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:56.519 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.519 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.519 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:56.519 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:56.519 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:56.519 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:56.519 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:56.519 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.519 INFO:tasks.workunit.client.0.smithi050.stderr: -377> 2024-09-14T11:11:56.160+0000 7fd4d0e01640 10 monclient: _finish_auth 0 2024-09-14T11:11:56.519 INFO:tasks.workunit.client.0.smithi050.stderr: -376> 2024-09-14T11:11:56.160+0000 7fd4d0e01640 10 monclient: _check_auth_tickets 2024-09-14T11:11:56.520 INFO:tasks.workunit.client.0.smithi050.stderr: -375> 2024-09-14T11:11:56.160+0000 7fd4d0e01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:11:56.520 INFO:tasks.workunit.client.0.smithi050.stderr: -374> 2024-09-14T11:11:56.160+0000 7fd4d0e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:56.520 INFO:tasks.workunit.client.0.smithi050.stderr: -373> 2024-09-14T11:11:56.160+0000 7fd4d0e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:11:56.520 INFO:tasks.workunit.client.0.smithi050.stderr: -372> 2024-09-14T11:11:56.160+0000 7fd4d0e01640 10 monclient: dump: 2024-09-14T11:11:56.520 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:56.520 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:56.520 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.520 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.520 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:56.520 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:56.520 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:56.520 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:56.520 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:56.520 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.521 INFO:tasks.workunit.client.0.smithi050.stderr: -371> 2024-09-14T11:11:56.160+0000 7fd5ead30800 5 monclient: authenticate success, global_id 6965 2024-09-14T11:11:56.521 INFO:tasks.workunit.client.0.smithi050.stderr: -370> 2024-09-14T11:11:56.160+0000 7fd5ead30800 10 monclient: _renew_subs 2024-09-14T11:11:56.521 INFO:tasks.workunit.client.0.smithi050.stderr: -369> 2024-09-14T11:11:56.160+0000 7fd5ead30800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:11:56.521 INFO:tasks.workunit.client.0.smithi050.stderr: -368> 2024-09-14T11:11:56.160+0000 7fd5e7ab2640 4 set_mon_vals no callback set 2024-09-14T11:11:56.521 INFO:tasks.workunit.client.0.smithi050.stderr: -367> 2024-09-14T11:11:56.160+0000 7fd5ead30800 10 monclient: _renew_subs 2024-09-14T11:11:56.521 INFO:tasks.workunit.client.0.smithi050.stderr: -366> 2024-09-14T11:11:56.160+0000 7fd5ead30800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:11:56.521 INFO:tasks.workunit.client.0.smithi050.stderr: -365> 2024-09-14T11:11:56.162+0000 7fd4d0e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:11:56.521 INFO:tasks.workunit.client.0.smithi050.stderr: -364> 2024-09-14T11:11:56.162+0000 7fd4d0e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:11:56.521 INFO:tasks.workunit.client.0.smithi050.stderr: -363> 2024-09-14T11:11:56.162+0000 7fd4d0e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:11:56.521 INFO:tasks.workunit.client.0.smithi050.stderr: -362> 2024-09-14T11:11:56.162+0000 7fd5ead30800 10 monclient: get_monmap_and_config 2024-09-14T11:11:56.521 INFO:tasks.workunit.client.0.smithi050.stderr: -361> 2024-09-14T11:11:56.162+0000 7fd5ead30800 10 monclient: build_initial_monmap 2024-09-14T11:11:56.521 INFO:tasks.workunit.client.0.smithi050.stderr: -360> 2024-09-14T11:11:56.162+0000 7fd5ead30800 1 build_initial for_mkfs: 0 2024-09-14T11:11:56.521 INFO:tasks.workunit.client.0.smithi050.stderr: -359> 2024-09-14T11:11:56.162+0000 7fd5ead30800 10 monclient: monmap: 2024-09-14T11:11:56.522 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:11:56.522 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:11:56.522 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:11:56.522 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:11:56.522 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:11:56.522 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:56.522 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:11:56.522 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:11:56.522 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:11:56.522 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.522 INFO:tasks.workunit.client.0.smithi050.stderr: -358> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding auth protocol: cephx 2024-09-14T11:11:56.522 INFO:tasks.workunit.client.0.smithi050.stderr: -357> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding auth protocol: cephx 2024-09-14T11:11:56.522 INFO:tasks.workunit.client.0.smithi050.stderr: -356> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding auth protocol: cephx 2024-09-14T11:11:56.522 INFO:tasks.workunit.client.0.smithi050.stderr: -355> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding con mode: secure 2024-09-14T11:11:56.523 INFO:tasks.workunit.client.0.smithi050.stderr: -354> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding con mode: crc 2024-09-14T11:11:56.523 INFO:tasks.workunit.client.0.smithi050.stderr: -353> 2024-09-14T11:11:56.162+0000 7fd5e6ab0640 10 monclient: get_auth_request con 0x7fd4c0077140 auth_method 0 2024-09-14T11:11:56.523 INFO:tasks.workunit.client.0.smithi050.stderr: -352> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding con mode: secure 2024-09-14T11:11:56.523 INFO:tasks.workunit.client.0.smithi050.stderr: -351> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding con mode: crc 2024-09-14T11:11:56.523 INFO:tasks.workunit.client.0.smithi050.stderr: -350> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding con mode: secure 2024-09-14T11:11:56.523 INFO:tasks.workunit.client.0.smithi050.stderr: -349> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding con mode: crc 2024-09-14T11:11:56.523 INFO:tasks.workunit.client.0.smithi050.stderr: -348> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding con mode: crc 2024-09-14T11:11:56.523 INFO:tasks.workunit.client.0.smithi050.stderr: -347> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding con mode: secure 2024-09-14T11:11:56.523 INFO:tasks.workunit.client.0.smithi050.stderr: -346> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding con mode: crc 2024-09-14T11:11:56.523 INFO:tasks.workunit.client.0.smithi050.stderr: -345> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding con mode: secure 2024-09-14T11:11:56.523 INFO:tasks.workunit.client.0.smithi050.stderr: -344> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding con mode: crc 2024-09-14T11:11:56.523 INFO:tasks.workunit.client.0.smithi050.stderr: -343> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3df9250) adding con mode: secure 2024-09-14T11:11:56.523 INFO:tasks.workunit.client.0.smithi050.stderr: -342> 2024-09-14T11:11:56.162+0000 7fd5ead30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:56.523 INFO:tasks.workunit.client.0.smithi050.stderr: -341> 2024-09-14T11:11:56.162+0000 7fd5ead30800 10 monclient: init 2024-09-14T11:11:56.524 INFO:tasks.workunit.client.0.smithi050.stderr: -340> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding auth protocol: cephx 2024-09-14T11:11:56.524 INFO:tasks.workunit.client.0.smithi050.stderr: -339> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding auth protocol: cephx 2024-09-14T11:11:56.524 INFO:tasks.workunit.client.0.smithi050.stderr: -338> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding auth protocol: cephx 2024-09-14T11:11:56.524 INFO:tasks.workunit.client.0.smithi050.stderr: -337> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding con mode: secure 2024-09-14T11:11:56.524 INFO:tasks.workunit.client.0.smithi050.stderr: -336> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding con mode: crc 2024-09-14T11:11:56.524 INFO:tasks.workunit.client.0.smithi050.stderr: -335> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding con mode: secure 2024-09-14T11:11:56.524 INFO:tasks.workunit.client.0.smithi050.stderr: -334> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding con mode: crc 2024-09-14T11:11:56.524 INFO:tasks.workunit.client.0.smithi050.stderr: -333> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding con mode: secure 2024-09-14T11:11:56.524 INFO:tasks.workunit.client.0.smithi050.stderr: -332> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding con mode: crc 2024-09-14T11:11:56.524 INFO:tasks.workunit.client.0.smithi050.stderr: -331> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding con mode: crc 2024-09-14T11:11:56.524 INFO:tasks.workunit.client.0.smithi050.stderr: -330> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding con mode: secure 2024-09-14T11:11:56.524 INFO:tasks.workunit.client.0.smithi050.stderr: -329> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding con mode: crc 2024-09-14T11:11:56.524 INFO:tasks.workunit.client.0.smithi050.stderr: -328> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding con mode: secure 2024-09-14T11:11:56.524 INFO:tasks.workunit.client.0.smithi050.stderr: -327> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding con mode: crc 2024-09-14T11:11:56.525 INFO:tasks.workunit.client.0.smithi050.stderr: -326> 2024-09-14T11:11:56.162+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3ca90) adding con mode: secure 2024-09-14T11:11:56.525 INFO:tasks.workunit.client.0.smithi050.stderr: -325> 2024-09-14T11:11:56.163+0000 7fd5ead30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:56.525 INFO:tasks.workunit.client.0.smithi050.stderr: -324> 2024-09-14T11:11:56.163+0000 7fd5ead30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:56.525 INFO:tasks.workunit.client.0.smithi050.stderr: -323> 2024-09-14T11:11:56.163+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command rotate-key cmddesc rotate-key hook 0x7fff1da3cbd8 EEXIST 2024-09-14T11:11:56.525 INFO:tasks.workunit.client.0.smithi050.stderr: -322> 2024-09-14T11:11:56.163+0000 7fd5ead30800 10 monclient: _reopen_session rank -1 2024-09-14T11:11:56.525 INFO:tasks.workunit.client.0.smithi050.stderr: -321> 2024-09-14T11:11:56.163+0000 7fd5ead30800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:11:56.525 INFO:tasks.workunit.client.0.smithi050.stderr: -320> 2024-09-14T11:11:56.163+0000 7fd5ead30800 10 monclient(hunting): picked mon.noname-a con 0x55dbe3e2d8d0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:11:56.525 INFO:tasks.workunit.client.0.smithi050.stderr: -319> 2024-09-14T11:11:56.163+0000 7fd5ead30800 10 monclient(hunting): picked mon.noname-c con 0x55dbe3dfe820 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:11:56.525 INFO:tasks.workunit.client.0.smithi050.stderr: -318> 2024-09-14T11:11:56.163+0000 7fd5ead30800 10 monclient(hunting): picked mon.noname-b con 0x55dbe3e29170 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:11:56.525 INFO:tasks.workunit.client.0.smithi050.stderr: -317> 2024-09-14T11:11:56.163+0000 7fd5ead30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:56.525 INFO:tasks.workunit.client.0.smithi050.stderr: -316> 2024-09-14T11:11:56.163+0000 7fd5ead30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:56.525 INFO:tasks.workunit.client.0.smithi050.stderr: -315> 2024-09-14T11:11:56.163+0000 7fd5ead30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:56.525 INFO:tasks.workunit.client.0.smithi050.stderr: -314> 2024-09-14T11:11:56.163+0000 7fd5ead30800 10 monclient(hunting): _renew_subs 2024-09-14T11:11:56.526 INFO:tasks.workunit.client.0.smithi050.stderr: -313> 2024-09-14T11:11:56.163+0000 7fd5ead30800 10 monclient(hunting): authenticate will time out at 2368.800496s 2024-09-14T11:11:56.526 INFO:tasks.workunit.client.0.smithi050.stderr: -312> 2024-09-14T11:11:56.163+0000 7fd5e62af640 10 monclient(hunting): get_auth_request con 0x55dbe3dfe820 auth_method 0 2024-09-14T11:11:56.526 INFO:tasks.workunit.client.0.smithi050.stderr: -311> 2024-09-14T11:11:56.163+0000 7fd5e62af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:56.526 INFO:tasks.workunit.client.0.smithi050.stderr: -310> 2024-09-14T11:11:56.163+0000 7fd5e62af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:56.526 INFO:tasks.workunit.client.0.smithi050.stderr: -309> 2024-09-14T11:11:56.163+0000 7fd5e62af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:56.526 INFO:tasks.workunit.client.0.smithi050.stderr: -308> 2024-09-14T11:11:56.163+0000 7fd5e6ab0640 10 monclient(hunting): get_auth_request con 0x55dbe3e2d8d0 auth_method 0 2024-09-14T11:11:56.526 INFO:tasks.workunit.client.0.smithi050.stderr: -307> 2024-09-14T11:11:56.163+0000 7fd5e6ab0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:56.526 INFO:tasks.workunit.client.0.smithi050.stderr: -306> 2024-09-14T11:11:56.163+0000 7fd5e6ab0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:56.526 INFO:tasks.workunit.client.0.smithi050.stderr: -305> 2024-09-14T11:11:56.163+0000 7fd5e6ab0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:56.526 INFO:tasks.workunit.client.0.smithi050.stderr: -304> 2024-09-14T11:11:56.163+0000 7fd5e62af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:56.526 INFO:tasks.workunit.client.0.smithi050.stderr: -303> 2024-09-14T11:11:56.163+0000 7fd5e62af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:56.526 INFO:tasks.workunit.client.0.smithi050.stderr: -302> 2024-09-14T11:11:56.163+0000 7fd5e62af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:56.526 INFO:tasks.workunit.client.0.smithi050.stderr: -301> 2024-09-14T11:11:56.163+0000 7fd5e72b1640 10 monclient(hunting): get_auth_request con 0x55dbe3e29170 auth_method 0 2024-09-14T11:11:56.526 INFO:tasks.workunit.client.0.smithi050.stderr: -300> 2024-09-14T11:11:56.163+0000 7fd5e72b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:56.527 INFO:tasks.workunit.client.0.smithi050.stderr: -299> 2024-09-14T11:11:56.163+0000 7fd5e72b1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:56.527 INFO:tasks.workunit.client.0.smithi050.stderr: -298> 2024-09-14T11:11:56.163+0000 7fd5e72b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:56.527 INFO:tasks.workunit.client.0.smithi050.stderr: -297> 2024-09-14T11:11:56.163+0000 7fd5e6ab0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:56.527 INFO:tasks.workunit.client.0.smithi050.stderr: -296> 2024-09-14T11:11:56.163+0000 7fd5e6ab0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:56.527 INFO:tasks.workunit.client.0.smithi050.stderr: -295> 2024-09-14T11:11:56.163+0000 7fd5e6ab0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:56.527 INFO:tasks.workunit.client.0.smithi050.stderr: -294> 2024-09-14T11:11:56.163+0000 7fd5e62af640 10 monclient(hunting): handle_auth_done global_id 6968 payload 274 2024-09-14T11:11:56.527 INFO:tasks.workunit.client.0.smithi050.stderr: -293> 2024-09-14T11:11:56.163+0000 7fd5e62af640 10 monclient: _finish_hunting 0 2024-09-14T11:11:56.527 INFO:tasks.workunit.client.0.smithi050.stderr: -292> 2024-09-14T11:11:56.163+0000 7fd5e62af640 1 monclient: found mon.noname-c 2024-09-14T11:11:56.527 INFO:tasks.workunit.client.0.smithi050.stderr: -291> 2024-09-14T11:11:56.163+0000 7fd5e62af640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:11:56.527 INFO:tasks.workunit.client.0.smithi050.stderr: -290> 2024-09-14T11:11:56.164+0000 7fd4ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:56.527 INFO:tasks.workunit.client.0.smithi050.stderr: -289> 2024-09-14T11:11:56.164+0000 7fd4ca7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:11:56.527 INFO:tasks.workunit.client.0.smithi050.stderr: -288> 2024-09-14T11:11:56.164+0000 7fd4ca7fc640 10 monclient: dump: 2024-09-14T11:11:56.527 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:56.528 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:56.528 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.528 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.528 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:56.528 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:56.528 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:56.528 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:56.528 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:56.528 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.528 INFO:tasks.workunit.client.0.smithi050.stderr: -287> 2024-09-14T11:11:56.164+0000 7fd4ca7fc640 10 monclient: _finish_auth 0 2024-09-14T11:11:56.528 INFO:tasks.workunit.client.0.smithi050.stderr: -286> 2024-09-14T11:11:56.164+0000 7fd4ca7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:11:56.528 INFO:tasks.workunit.client.0.smithi050.stderr: -285> 2024-09-14T11:11:56.164+0000 7fd4ca7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:11:56.528 INFO:tasks.workunit.client.0.smithi050.stderr: -284> 2024-09-14T11:11:56.164+0000 7fd4ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:56.528 INFO:tasks.workunit.client.0.smithi050.stderr: -283> 2024-09-14T11:11:56.164+0000 7fd4ca7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:11:56.529 INFO:tasks.workunit.client.0.smithi050.stderr: -282> 2024-09-14T11:11:56.164+0000 7fd4ca7fc640 10 monclient: dump: 2024-09-14T11:11:56.529 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:56.529 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:56.529 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.529 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.529 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:56.529 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:56.529 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:56.529 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:56.529 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:56.529 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.529 INFO:tasks.workunit.client.0.smithi050.stderr: -281> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 monclient: authenticate success, global_id 6968 2024-09-14T11:11:56.529 INFO:tasks.workunit.client.0.smithi050.stderr: -280> 2024-09-14T11:11:56.164+0000 7fd5ead30800 10 monclient: get_monmap_and_config success 2024-09-14T11:11:56.530 INFO:tasks.workunit.client.0.smithi050.stderr: -279> 2024-09-14T11:11:56.164+0000 7fd5ead30800 4 set_mon_vals no callback set 2024-09-14T11:11:56.530 INFO:tasks.workunit.client.0.smithi050.stderr: -278> 2024-09-14T11:11:56.164+0000 7fd5ead30800 10 monclient: shutdown 2024-09-14T11:11:56.530 INFO:tasks.workunit.client.0.smithi050.stderr: -277> 2024-09-14T11:11:56.164+0000 7fd5ead30800 10 monclient: build_initial_monmap 2024-09-14T11:11:56.530 INFO:tasks.workunit.client.0.smithi050.stderr: -276> 2024-09-14T11:11:56.164+0000 7fd5ead30800 1 build_initial for_mkfs: 0 2024-09-14T11:11:56.530 INFO:tasks.workunit.client.0.smithi050.stderr: -275> 2024-09-14T11:11:56.164+0000 7fd5ead30800 10 monclient: monmap: 2024-09-14T11:11:56.530 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:11:56.530 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:11:56.530 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:11:56.530 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:11:56.530 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:11:56.530 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:56.530 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:11:56.530 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:11:56.530 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:11:56.531 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.531 INFO:tasks.workunit.client.0.smithi050.stderr: -274> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding auth protocol: cephx 2024-09-14T11:11:56.531 INFO:tasks.workunit.client.0.smithi050.stderr: -273> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding auth protocol: cephx 2024-09-14T11:11:56.531 INFO:tasks.workunit.client.0.smithi050.stderr: -272> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding auth protocol: cephx 2024-09-14T11:11:56.531 INFO:tasks.workunit.client.0.smithi050.stderr: -271> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding con mode: secure 2024-09-14T11:11:56.531 INFO:tasks.workunit.client.0.smithi050.stderr: -270> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding con mode: crc 2024-09-14T11:11:56.531 INFO:tasks.workunit.client.0.smithi050.stderr: -269> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding con mode: secure 2024-09-14T11:11:56.531 INFO:tasks.workunit.client.0.smithi050.stderr: -268> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding con mode: crc 2024-09-14T11:11:56.531 INFO:tasks.workunit.client.0.smithi050.stderr: -267> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding con mode: secure 2024-09-14T11:11:56.531 INFO:tasks.workunit.client.0.smithi050.stderr: -266> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding con mode: crc 2024-09-14T11:11:56.531 INFO:tasks.workunit.client.0.smithi050.stderr: -265> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding con mode: crc 2024-09-14T11:11:56.531 INFO:tasks.workunit.client.0.smithi050.stderr: -264> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding con mode: secure 2024-09-14T11:11:56.531 INFO:tasks.workunit.client.0.smithi050.stderr: -263> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding con mode: crc 2024-09-14T11:11:56.532 INFO:tasks.workunit.client.0.smithi050.stderr: -262> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding con mode: secure 2024-09-14T11:11:56.532 INFO:tasks.workunit.client.0.smithi050.stderr: -261> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding con mode: crc 2024-09-14T11:11:56.532 INFO:tasks.workunit.client.0.smithi050.stderr: -260> 2024-09-14T11:11:56.164+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3e29aa0) adding con mode: secure 2024-09-14T11:11:56.532 INFO:tasks.workunit.client.0.smithi050.stderr: -259> 2024-09-14T11:11:56.164+0000 7fd5ead30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:56.532 INFO:tasks.workunit.client.0.smithi050.stderr: -258> 2024-09-14T11:11:56.165+0000 7fd5ead30800 1 librados: starting msgr at 2024-09-14T11:11:56.532 INFO:tasks.workunit.client.0.smithi050.stderr: -257> 2024-09-14T11:11:56.165+0000 7fd5ead30800 1 librados: starting objecter 2024-09-14T11:11:56.532 INFO:tasks.workunit.client.0.smithi050.stderr: -256> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command objecter_requests cmddesc objecter_requests hook 0x55dbe3e280c0 EEXIST 2024-09-14T11:11:56.532 INFO:tasks.workunit.client.0.smithi050.stderr: -255> 2024-09-14T11:11:56.165+0000 7fd5ead30800 1 librados: setting wanted keys 2024-09-14T11:11:56.532 INFO:tasks.workunit.client.0.smithi050.stderr: -254> 2024-09-14T11:11:56.165+0000 7fd5ead30800 1 librados: calling monclient init 2024-09-14T11:11:56.532 INFO:tasks.workunit.client.0.smithi050.stderr: -253> 2024-09-14T11:11:56.165+0000 7fd5ead30800 10 monclient: init 2024-09-14T11:11:56.532 INFO:tasks.workunit.client.0.smithi050.stderr: -252> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding auth protocol: cephx 2024-09-14T11:11:56.532 INFO:tasks.workunit.client.0.smithi050.stderr: -251> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding auth protocol: cephx 2024-09-14T11:11:56.532 INFO:tasks.workunit.client.0.smithi050.stderr: -250> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding auth protocol: cephx 2024-09-14T11:11:56.532 INFO:tasks.workunit.client.0.smithi050.stderr: -249> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding con mode: secure 2024-09-14T11:11:56.533 INFO:tasks.workunit.client.0.smithi050.stderr: -248> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding con mode: crc 2024-09-14T11:11:56.533 INFO:tasks.workunit.client.0.smithi050.stderr: -247> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding con mode: secure 2024-09-14T11:11:56.533 INFO:tasks.workunit.client.0.smithi050.stderr: -246> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding con mode: crc 2024-09-14T11:11:56.533 INFO:tasks.workunit.client.0.smithi050.stderr: -245> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding con mode: secure 2024-09-14T11:11:56.533 INFO:tasks.workunit.client.0.smithi050.stderr: -244> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding con mode: crc 2024-09-14T11:11:56.533 INFO:tasks.workunit.client.0.smithi050.stderr: -243> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding con mode: crc 2024-09-14T11:11:56.533 INFO:tasks.workunit.client.0.smithi050.stderr: -242> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding con mode: secure 2024-09-14T11:11:56.533 INFO:tasks.workunit.client.0.smithi050.stderr: -241> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding con mode: crc 2024-09-14T11:11:56.533 INFO:tasks.workunit.client.0.smithi050.stderr: -240> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding con mode: secure 2024-09-14T11:11:56.533 INFO:tasks.workunit.client.0.smithi050.stderr: -239> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding con mode: crc 2024-09-14T11:11:56.533 INFO:tasks.workunit.client.0.smithi050.stderr: -238> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 AuthRegistry(0x55dbe3dedfa0) adding con mode: secure 2024-09-14T11:11:56.533 INFO:tasks.workunit.client.0.smithi050.stderr: -237> 2024-09-14T11:11:56.165+0000 7fd5ead30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:56.533 INFO:tasks.workunit.client.0.smithi050.stderr: -236> 2024-09-14T11:11:56.165+0000 7fd5ead30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:56.534 INFO:tasks.workunit.client.0.smithi050.stderr: -235> 2024-09-14T11:11:56.165+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command rotate-key cmddesc rotate-key hook 0x55dbe3dee0e8 EEXIST 2024-09-14T11:11:56.534 INFO:tasks.workunit.client.0.smithi050.stderr: -234> 2024-09-14T11:11:56.165+0000 7fd5ead30800 10 monclient: _reopen_session rank -1 2024-09-14T11:11:56.534 INFO:tasks.workunit.client.0.smithi050.stderr: -233> 2024-09-14T11:11:56.165+0000 7fd5ead30800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:11:56.534 INFO:tasks.workunit.client.0.smithi050.stderr: -232> 2024-09-14T11:11:56.165+0000 7fd5ead30800 10 monclient(hunting): picked mon.noname-a con 0x55dbe3dfe820 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:11:56.534 INFO:tasks.workunit.client.0.smithi050.stderr: -231> 2024-09-14T11:11:56.165+0000 7fd5ead30800 10 monclient(hunting): picked mon.noname-c con 0x55dbe3e29170 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:11:56.534 INFO:tasks.workunit.client.0.smithi050.stderr: -230> 2024-09-14T11:11:56.165+0000 7fd5ead30800 10 monclient(hunting): picked mon.noname-b con 0x55dbe3e2d8d0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:11:56.534 INFO:tasks.workunit.client.0.smithi050.stderr: -229> 2024-09-14T11:11:56.165+0000 7fd5ead30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:56.534 INFO:tasks.workunit.client.0.smithi050.stderr: -228> 2024-09-14T11:11:56.165+0000 7fd5ead30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:56.534 INFO:tasks.workunit.client.0.smithi050.stderr: -227> 2024-09-14T11:11:56.165+0000 7fd5ead30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:11:56.534 INFO:tasks.workunit.client.0.smithi050.stderr: -226> 2024-09-14T11:11:56.165+0000 7fd5ead30800 10 monclient(hunting): _renew_subs 2024-09-14T11:11:56.534 INFO:tasks.workunit.client.0.smithi050.stderr: -225> 2024-09-14T11:11:56.165+0000 7fd5ead30800 10 monclient(hunting): authenticate will time out at 2368.802719s 2024-09-14T11:11:56.534 INFO:tasks.workunit.client.0.smithi050.stderr: -224> 2024-09-14T11:11:56.165+0000 7fd5e6ab0640 10 monclient(hunting): get_auth_request con 0x55dbe3dfe820 auth_method 0 2024-09-14T11:11:56.534 INFO:tasks.workunit.client.0.smithi050.stderr: -223> 2024-09-14T11:11:56.165+0000 7fd5e6ab0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:56.535 INFO:tasks.workunit.client.0.smithi050.stderr: -222> 2024-09-14T11:11:56.165+0000 7fd5e6ab0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:56.535 INFO:tasks.workunit.client.0.smithi050.stderr: -221> 2024-09-14T11:11:56.165+0000 7fd5e6ab0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:56.535 INFO:tasks.workunit.client.0.smithi050.stderr: -220> 2024-09-14T11:11:56.165+0000 7fd5e62af640 10 monclient(hunting): get_auth_request con 0x55dbe3e29170 auth_method 0 2024-09-14T11:11:56.535 INFO:tasks.workunit.client.0.smithi050.stderr: -219> 2024-09-14T11:11:56.165+0000 7fd5e62af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:56.535 INFO:tasks.workunit.client.0.smithi050.stderr: -218> 2024-09-14T11:11:56.165+0000 7fd5e62af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:56.535 INFO:tasks.workunit.client.0.smithi050.stderr: -217> 2024-09-14T11:11:56.165+0000 7fd5e62af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:56.535 INFO:tasks.workunit.client.0.smithi050.stderr: -216> 2024-09-14T11:11:56.165+0000 7fd5e62af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:56.535 INFO:tasks.workunit.client.0.smithi050.stderr: -215> 2024-09-14T11:11:56.165+0000 7fd5e62af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:56.535 INFO:tasks.workunit.client.0.smithi050.stderr: -214> 2024-09-14T11:11:56.165+0000 7fd5e62af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:56.535 INFO:tasks.workunit.client.0.smithi050.stderr: -213> 2024-09-14T11:11:56.165+0000 7fd5e6ab0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:11:56.535 INFO:tasks.workunit.client.0.smithi050.stderr: -212> 2024-09-14T11:11:56.165+0000 7fd5e6ab0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:11:56.535 INFO:tasks.workunit.client.0.smithi050.stderr: -211> 2024-09-14T11:11:56.165+0000 7fd5e6ab0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:11:56.535 INFO:tasks.workunit.client.0.smithi050.stderr: -210> 2024-09-14T11:11:56.166+0000 7fd5e72b1640 10 monclient(hunting): get_auth_request con 0x55dbe3e2d8d0 auth_method 0 2024-09-14T11:11:56.535 INFO:tasks.workunit.client.0.smithi050.stderr: -209> 2024-09-14T11:11:56.166+0000 7fd5e72b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:11:56.536 INFO:tasks.workunit.client.0.smithi050.stderr: -208> 2024-09-14T11:11:56.166+0000 7fd5e72b1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:11:56.536 INFO:tasks.workunit.client.0.smithi050.stderr: -207> 2024-09-14T11:11:56.166+0000 7fd5e72b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:11:56.536 INFO:tasks.workunit.client.0.smithi050.stderr: -206> 2024-09-14T11:11:56.166+0000 7fd5e62af640 10 monclient(hunting): handle_auth_done global_id 6971 payload 824 2024-09-14T11:11:56.536 INFO:tasks.workunit.client.0.smithi050.stderr: -205> 2024-09-14T11:11:56.166+0000 7fd5e62af640 10 monclient: _finish_hunting 0 2024-09-14T11:11:56.536 INFO:tasks.workunit.client.0.smithi050.stderr: -204> 2024-09-14T11:11:56.166+0000 7fd5e62af640 1 monclient: found mon.noname-c 2024-09-14T11:11:56.536 INFO:tasks.workunit.client.0.smithi050.stderr: -203> 2024-09-14T11:11:56.166+0000 7fd5e62af640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:11:56.536 INFO:tasks.workunit.client.0.smithi050.stderr: -202> 2024-09-14T11:11:56.166+0000 7fd4c8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:56.536 INFO:tasks.workunit.client.0.smithi050.stderr: -201> 2024-09-14T11:11:56.166+0000 7fd4c8ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:11:56.536 INFO:tasks.workunit.client.0.smithi050.stderr: -200> 2024-09-14T11:11:56.166+0000 7fd4c8ff9640 10 monclient: dump: 2024-09-14T11:11:56.536 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:56.536 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:56.536 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.536 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.537 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:56.537 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:56.537 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:56.537 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:56.537 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:56.537 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.537 INFO:tasks.workunit.client.0.smithi050.stderr: -199> 2024-09-14T11:11:56.166+0000 7fd4c8ff9640 10 monclient: _finish_auth 0 2024-09-14T11:11:56.537 INFO:tasks.workunit.client.0.smithi050.stderr: -198> 2024-09-14T11:11:56.166+0000 7fd4c8ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:11:56.537 INFO:tasks.workunit.client.0.smithi050.stderr: -197> 2024-09-14T11:11:56.166+0000 7fd4c8ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:11:56.537 INFO:tasks.workunit.client.0.smithi050.stderr: -196> 2024-09-14T11:11:56.166+0000 7fd4c8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:11:56.537 INFO:tasks.workunit.client.0.smithi050.stderr: -195> 2024-09-14T11:11:56.166+0000 7fd4c8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:11:56.537 INFO:tasks.workunit.client.0.smithi050.stderr: -194> 2024-09-14T11:11:56.166+0000 7fd4c8ff9640 10 monclient: dump: 2024-09-14T11:11:56.537 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:11:56.538 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:11:56.538 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.538 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:11:56.538 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:11:56.538 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:11:56.538 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:11:56.538 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:11:56.538 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:11:56.538 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.538 INFO:tasks.workunit.client.0.smithi050.stderr: -193> 2024-09-14T11:11:56.166+0000 7fd5ead30800 5 monclient: authenticate success, global_id 6971 2024-09-14T11:11:56.538 INFO:tasks.workunit.client.0.smithi050.stderr: -192> 2024-09-14T11:11:56.166+0000 7fd4ca7fc640 4 set_mon_vals no callback set 2024-09-14T11:11:56.538 INFO:tasks.workunit.client.0.smithi050.stderr: -191> 2024-09-14T11:11:56.166+0000 7fd5ead30800 10 monclient: _renew_subs 2024-09-14T11:11:56.538 INFO:tasks.workunit.client.0.smithi050.stderr: -190> 2024-09-14T11:11:56.166+0000 7fd5ead30800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:11:56.538 INFO:tasks.workunit.client.0.smithi050.stderr: -189> 2024-09-14T11:11:56.166+0000 7fd5ead30800 10 monclient: _renew_subs 2024-09-14T11:11:56.539 INFO:tasks.workunit.client.0.smithi050.stderr: -188> 2024-09-14T11:11:56.166+0000 7fd5ead30800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:11:56.539 INFO:tasks.workunit.client.0.smithi050.stderr: -187> 2024-09-14T11:11:56.166+0000 7fd5ead30800 1 librados: init done 2024-09-14T11:11:56.539 INFO:tasks.workunit.client.0.smithi050.stderr: -186> 2024-09-14T11:11:56.166+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command cr dump hook 0x55dbe3e22e78 2024-09-14T11:11:56.539 INFO:tasks.workunit.client.0.smithi050.stderr: -185> 2024-09-14T11:11:56.168+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.539 INFO:tasks.workunit.client.0.smithi050.stderr: -184> 2024-09-14T11:11:56.168+0000 7fd4c8ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:11:56.539 INFO:tasks.workunit.client.0.smithi050.stderr: -183> 2024-09-14T11:11:56.168+0000 7fd4c8ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:11:56.539 INFO:tasks.workunit.client.0.smithi050.stderr: -182> 2024-09-14T11:11:56.168+0000 7fd4c8ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:11:56.539 INFO:tasks.workunit.client.0.smithi050.stderr: -181> 2024-09-14T11:11:56.169+0000 7fd5e6ab0640 10 monclient: get_auth_request con 0x7fd4b0077230 auth_method 0 2024-09-14T11:11:56.539 INFO:tasks.workunit.client.0.smithi050.stderr: -180> 2024-09-14T11:11:56.169+0000 7fd5e72b1640 10 monclient: get_auth_request con 0x55dbe3e46c40 auth_method 0 2024-09-14T11:11:56.539 INFO:tasks.workunit.client.0.smithi050.stderr: -179> 2024-09-14T11:11:56.169+0000 7fd5ead30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.539 INFO:tasks.workunit.client.0.smithi050.stderr: -178> 2024-09-14T11:11:56.169+0000 7fd5ead30800 20 realm 2024-09-14T11:11:56.539 INFO:tasks.workunit.client.0.smithi050.stderr: -177> 2024-09-14T11:11:56.169+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.539 INFO:tasks.workunit.client.0.smithi050.stderr: -176> 2024-09-14T11:11:56.170+0000 7fd5ead30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.540 INFO:tasks.workunit.client.0.smithi050.stderr: -175> 2024-09-14T11:11:56.170+0000 7fd5ead30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:56.540 INFO:tasks.workunit.client.0.smithi050.stderr: -174> 2024-09-14T11:11:56.170+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.540 INFO:tasks.workunit.client.0.smithi050.stderr: -173> 2024-09-14T11:11:56.170+0000 7fd5ead30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.540 INFO:tasks.workunit.client.0.smithi050.stderr: -172> 2024-09-14T11:11:56.170+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.540 INFO:tasks.workunit.client.0.smithi050.stderr: -171> 2024-09-14T11:11:56.170+0000 7fd5e6ab0640 10 monclient: get_auth_request con 0x55dbe3e4afd0 auth_method 0 2024-09-14T11:11:56.540 INFO:tasks.workunit.client.0.smithi050.stderr: -170> 2024-09-14T11:11:56.171+0000 7fd5ead30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:56.540 INFO:tasks.workunit.client.0.smithi050.stderr: -169> 2024-09-14T11:11:56.171+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.540 INFO:tasks.workunit.client.0.smithi050.stderr: -168> 2024-09-14T11:11:56.171+0000 7fd5e62af640 10 monclient: get_auth_request con 0x55dbe3e4e6f0 auth_method 0 2024-09-14T11:11:56.540 INFO:tasks.workunit.client.0.smithi050.stderr: -167> 2024-09-14T11:11:56.171+0000 7fd5ead30800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:56.540 INFO:tasks.workunit.client.0.smithi050.stderr: -166> 2024-09-14T11:11:56.172+0000 7fd5ead30800 20 searching for the correct realm 2024-09-14T11:11:56.540 INFO:tasks.workunit.client.0.smithi050.stderr: -165> 2024-09-14T11:11:56.172+0000 7fd5e72b1640 10 monclient: get_auth_request con 0x55dbe3e534b0 auth_method 0 2024-09-14T11:11:56.540 INFO:tasks.workunit.client.0.smithi050.stderr: -164> 2024-09-14T11:11:56.173+0000 7fd5e6ab0640 10 monclient: get_auth_request con 0x7fd5e0018940 auth_method 0 2024-09-14T11:11:56.540 INFO:tasks.workunit.client.0.smithi050.stderr: -163> 2024-09-14T11:11:56.174+0000 7fd5e62af640 10 monclient: get_auth_request con 0x7fd5e003b410 auth_method 0 2024-09-14T11:11:56.540 INFO:tasks.workunit.client.0.smithi050.stderr: -162> 2024-09-14T11:11:56.174+0000 7fd5e62af640 0 -- 172.21.15.50:0/3132939204 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fd5e003b410 msgr2=0x7fd5e003b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:56.541 INFO:tasks.workunit.client.0.smithi050.stderr: -161> 2024-09-14T11:11:56.376+0000 7fd5e62af640 10 monclient: get_auth_request con 0x7fd5e003b410 auth_method 0 2024-09-14T11:11:56.541 INFO:tasks.workunit.client.0.smithi050.stderr: -160> 2024-09-14T11:11:56.379+0000 7fd5e72b1640 10 monclient: get_auth_request con 0x7fd5d803a030 auth_method 0 2024-09-14T11:11:56.541 INFO:tasks.workunit.client.0.smithi050.stderr: -159> 2024-09-14T11:11:56.379+0000 7fd5e6ab0640 10 monclient: get_auth_request con 0x7fd5e004a970 auth_method 0 2024-09-14T11:11:56.541 INFO:tasks.workunit.client.0.smithi050.stderr: -158> 2024-09-14T11:11:56.380+0000 7fd5e72b1640 0 -- 172.21.15.50:0/3132939204 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55dbe3e46c40 msgr2=0x55dbe3e490e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:56.541 INFO:tasks.workunit.client.0.smithi050.stderr: -157> 2024-09-14T11:11:56.380+0000 7fd4c8ff9640 1 client.6971.objecter ms_handle_reset 0x55dbe3e46c40 session 0x55dbe3e46530 osd.6 2024-09-14T11:11:56.541 INFO:tasks.workunit.client.0.smithi050.stderr: -156> 2024-09-14T11:11:56.381+0000 7fd4c8ff9640 10 monclient: _renew_subs 2024-09-14T11:11:56.541 INFO:tasks.workunit.client.0.smithi050.stderr: -155> 2024-09-14T11:11:56.381+0000 7fd4c8ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:11:56.541 INFO:tasks.workunit.client.0.smithi050.stderr: -154> 2024-09-14T11:11:56.381+0000 7fd5e72b1640 10 monclient: get_auth_request con 0x7fd4b00874e0 auth_method 0 2024-09-14T11:11:56.541 INFO:tasks.workunit.client.0.smithi050.stderr: -153> 2024-09-14T11:11:56.385+0000 7fd5ead30800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:56.541 INFO:tasks.workunit.client.0.smithi050.stderr: -152> 2024-09-14T11:11:56.385+0000 7fd5ead30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:56.541 INFO:tasks.workunit.client.0.smithi050.stderr: -151> 2024-09-14T11:11:56.385+0000 7fd5ead30800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:56.541 INFO:tasks.workunit.client.0.smithi050.stderr: -150> 2024-09-14T11:11:56.385+0000 7fd5ead30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:56.541 INFO:tasks.workunit.client.0.smithi050.stderr: -149> 2024-09-14T11:11:56.385+0000 7fd5ead30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:56.541 INFO:tasks.workunit.client.0.smithi050.stderr: -148> 2024-09-14T11:11:56.385+0000 7fd5ead30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:56.542 INFO:tasks.workunit.client.0.smithi050.stderr: -147> 2024-09-14T11:11:56.385+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.542 INFO:tasks.workunit.client.0.smithi050.stderr: -146> 2024-09-14T11:11:56.385+0000 7fd5ead30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.542 INFO:tasks.workunit.client.0.smithi050.stderr: -145> 2024-09-14T11:11:56.385+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.542 INFO:tasks.workunit.client.0.smithi050.stderr: -144> 2024-09-14T11:11:56.385+0000 7fd5ead30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:56.542 INFO:tasks.workunit.client.0.smithi050.stderr: -143> 2024-09-14T11:11:56.386+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.542 INFO:tasks.workunit.client.0.smithi050.stderr: -142> 2024-09-14T11:11:56.386+0000 7fd5ead30800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:56.542 INFO:tasks.workunit.client.0.smithi050.stderr: -141> 2024-09-14T11:11:56.386+0000 7fd5ead30800 20 zone default found 2024-09-14T11:11:56.542 INFO:tasks.workunit.client.0.smithi050.stderr: -140> 2024-09-14T11:11:56.386+0000 7fd5ead30800 4 Realm: () 2024-09-14T11:11:56.542 INFO:tasks.workunit.client.0.smithi050.stderr: -139> 2024-09-14T11:11:56.386+0000 7fd5ead30800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:56.542 INFO:tasks.workunit.client.0.smithi050.stderr: -138> 2024-09-14T11:11:56.386+0000 7fd5ead30800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:56.542 INFO:tasks.workunit.client.0.smithi050.stderr: -137> 2024-09-14T11:11:56.386+0000 7fd5ead30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:56.542 INFO:tasks.workunit.client.0.smithi050.stderr: -136> 2024-09-14T11:11:56.386+0000 7fd5ead30800 20 zonegroup default 2024-09-14T11:11:56.542 INFO:tasks.workunit.client.0.smithi050.stderr: -135> 2024-09-14T11:11:56.386+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.542 INFO:tasks.workunit.client.0.smithi050.stderr: -134> 2024-09-14T11:11:56.386+0000 7fd5ead30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.543 INFO:tasks.workunit.client.0.smithi050.stderr: -133> 2024-09-14T11:11:56.386+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.543 INFO:tasks.workunit.client.0.smithi050.stderr: -132> 2024-09-14T11:11:56.386+0000 7fd5ead30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.543 INFO:tasks.workunit.client.0.smithi050.stderr: -131> 2024-09-14T11:11:56.386+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.543 INFO:tasks.workunit.client.0.smithi050.stderr: -130> 2024-09-14T11:11:56.387+0000 7fd5ead30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.543 INFO:tasks.workunit.client.0.smithi050.stderr: -129> 2024-09-14T11:11:56.387+0000 7fd5ead30800 20 started sync module instance, tier type = 2024-09-14T11:11:56.543 INFO:tasks.workunit.client.0.smithi050.stderr: -128> 2024-09-14T11:11:56.387+0000 7fd5ead30800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:56.543 INFO:tasks.workunit.client.0.smithi050.stderr: -127> 2024-09-14T11:11:56.395+0000 7fd5ead30800 20 add_watcher() i=0 2024-09-14T11:11:56.543 INFO:tasks.workunit.client.0.smithi050.stderr: -126> 2024-09-14T11:11:56.395+0000 7fd5ead30800 20 add_watcher() i=1 2024-09-14T11:11:56.543 INFO:tasks.workunit.client.0.smithi050.stderr: -125> 2024-09-14T11:11:56.395+0000 7fd5ead30800 20 add_watcher() i=2 2024-09-14T11:11:56.543 INFO:tasks.workunit.client.0.smithi050.stderr: -124> 2024-09-14T11:11:56.395+0000 7fd5ead30800 20 add_watcher() i=3 2024-09-14T11:11:56.543 INFO:tasks.workunit.client.0.smithi050.stderr: -123> 2024-09-14T11:11:56.395+0000 7fd5ead30800 20 add_watcher() i=4 2024-09-14T11:11:56.543 INFO:tasks.workunit.client.0.smithi050.stderr: -122> 2024-09-14T11:11:56.395+0000 7fd5ead30800 20 add_watcher() i=5 2024-09-14T11:11:56.543 INFO:tasks.workunit.client.0.smithi050.stderr: -121> 2024-09-14T11:11:56.396+0000 7fd5ead30800 20 add_watcher() i=6 2024-09-14T11:11:56.543 INFO:tasks.workunit.client.0.smithi050.stderr: -120> 2024-09-14T11:11:56.396+0000 7fd5ead30800 20 add_watcher() i=7 2024-09-14T11:11:56.544 INFO:tasks.workunit.client.0.smithi050.stderr: -119> 2024-09-14T11:11:56.396+0000 7fd5ead30800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:56.544 INFO:tasks.workunit.client.0.smithi050.stderr: -118> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding auth protocol: cephx 2024-09-14T11:11:56.544 INFO:tasks.workunit.client.0.smithi050.stderr: -117> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding auth protocol: cephx 2024-09-14T11:11:56.544 INFO:tasks.workunit.client.0.smithi050.stderr: -116> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding auth protocol: cephx 2024-09-14T11:11:56.544 INFO:tasks.workunit.client.0.smithi050.stderr: -115> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding con mode: secure 2024-09-14T11:11:56.544 INFO:tasks.workunit.client.0.smithi050.stderr: -114> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding con mode: crc 2024-09-14T11:11:56.544 INFO:tasks.workunit.client.0.smithi050.stderr: -113> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding con mode: secure 2024-09-14T11:11:56.544 INFO:tasks.workunit.client.0.smithi050.stderr: -112> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding con mode: crc 2024-09-14T11:11:56.544 INFO:tasks.workunit.client.0.smithi050.stderr: -111> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding con mode: secure 2024-09-14T11:11:56.544 INFO:tasks.workunit.client.0.smithi050.stderr: -110> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding con mode: crc 2024-09-14T11:11:56.544 INFO:tasks.workunit.client.0.smithi050.stderr: -109> 2024-09-14T11:11:56.398+0000 7fd49d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:56.544 INFO:tasks.workunit.client.0.smithi050.stderr: -108> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding con mode: crc 2024-09-14T11:11:56.544 INFO:tasks.workunit.client.0.smithi050.stderr: -107> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding con mode: secure 2024-09-14T11:11:56.545 INFO:tasks.workunit.client.0.smithi050.stderr: -106> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding con mode: crc 2024-09-14T11:11:56.545 INFO:tasks.workunit.client.0.smithi050.stderr: -105> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding con mode: secure 2024-09-14T11:11:56.545 INFO:tasks.workunit.client.0.smithi050.stderr: -104> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding con mode: crc 2024-09-14T11:11:56.545 INFO:tasks.workunit.client.0.smithi050.stderr: -103> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 AuthRegistry(0x7fff1da3cf70) adding con mode: secure 2024-09-14T11:11:56.545 INFO:tasks.workunit.client.0.smithi050.stderr: -102> 2024-09-14T11:11:56.398+0000 7fd5ead30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:11:56.545 INFO:tasks.workunit.client.0.smithi050.stderr: -101> 2024-09-14T11:11:56.398+0000 7fd5ead30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:56.545 INFO:tasks.workunit.client.0.smithi050.stderr: -100> 2024-09-14T11:11:56.398+0000 7fd5ead30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:56.545 INFO:tasks.workunit.client.0.smithi050.stderr: -99> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command cache list hook 0x55dbe3e21bb0 2024-09-14T11:11:56.545 INFO:tasks.workunit.client.0.smithi050.stderr: -98> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command cache inspect hook 0x55dbe3e21bb0 2024-09-14T11:11:56.545 INFO:tasks.workunit.client.0.smithi050.stderr: -97> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command cache erase hook 0x55dbe3e21bb0 2024-09-14T11:11:56.545 INFO:tasks.workunit.client.0.smithi050.stderr: -96> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command cache zap hook 0x55dbe3e21bb0 2024-09-14T11:11:56.545 INFO:tasks.workunit.client.0.smithi050.stderr: -95> 2024-09-14T11:11:56.398+0000 7fd5ead30800 5 note: GC not initialized 2024-09-14T11:11:56.545 INFO:tasks.workunit.client.0.smithi050.stderr: -94> 2024-09-14T11:11:56.399+0000 7fd417fff640 20 reqs_thread_entry: start 2024-09-14T11:11:56.546 INFO:tasks.workunit.client.0.smithi050.stderr: -93> 2024-09-14T11:11:56.399+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command sync trace show hook 0x7fd5dc0c9040 2024-09-14T11:11:56.546 INFO:tasks.workunit.client.0.smithi050.stderr: -92> 2024-09-14T11:11:56.399+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command sync trace history hook 0x7fd5dc0c9040 2024-09-14T11:11:56.546 INFO:tasks.workunit.client.0.smithi050.stderr: -91> 2024-09-14T11:11:56.399+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command sync trace active hook 0x7fd5dc0c9040 2024-09-14T11:11:56.546 INFO:tasks.workunit.client.0.smithi050.stderr: -90> 2024-09-14T11:11:56.399+0000 7fd5ead30800 5 asok(0x55dbe3b3c270) register_command sync trace active_short hook 0x7fd5dc0c9040 2024-09-14T11:11:56.546 INFO:tasks.workunit.client.0.smithi050.stderr: -89> 2024-09-14T11:11:56.399+0000 7fd5ead30800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:56.546 INFO:tasks.workunit.client.0.smithi050.stderr: -88> 2024-09-14T11:11:56.399+0000 7fd5ead30800 20 Filter name: none 2024-09-14T11:11:56.546 INFO:tasks.workunit.client.0.smithi050.stderr: -87> 2024-09-14T11:11:56.399+0000 7fd415ffb640 20 reqs_thread_entry: start 2024-09-14T11:11:56.546 INFO:tasks.workunit.client.0.smithi050.stderr: -86> 2024-09-14T11:11:56.399+0000 7fd5ead30800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:11:56.546 INFO:tasks.workunit.client.0.smithi050.stderr: -85> 2024-09-14T11:11:56.399+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.546 INFO:tasks.workunit.client.0.smithi050.stderr: -84> 2024-09-14T11:11:56.400+0000 7fd5ead30800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:11:56.546 INFO:tasks.workunit.client.0.smithi050.stderr: -83> 2024-09-14T11:11:56.400+0000 7fd5ead30800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:11:56.546 INFO:tasks.workunit.client.0.smithi050.stderr: -82> 2024-09-14T11:11:56.400+0000 7fd5ead30800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:11:56.546 INFO:tasks.workunit.client.0.smithi050.stderr: -81> 2024-09-14T11:11:56.400+0000 7fd5ead30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 : miss 2024-09-14T11:11:56.547 INFO:tasks.workunit.client.0.smithi050.stderr: -80> 2024-09-14T11:11:56.400+0000 7fd5ead30800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.547 INFO:tasks.workunit.client.0.smithi050.stderr: -79> 2024-09-14T11:11:56.400+0000 7fd5ead30800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:11:56.547 INFO:tasks.workunit.client.0.smithi050.stderr: -78> 2024-09-14T11:11:56.400+0000 7fd5ead30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 info.flags=0x17 2024-09-14T11:11:56.547 INFO:tasks.workunit.client.0.smithi050.stderr: -77> 2024-09-14T11:11:56.400+0000 7fd5ead30800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 to cache LRU end 2024-09-14T11:11:56.547 INFO:tasks.workunit.client.0.smithi050.stderr: -76> 2024-09-14T11:11:56.400+0000 7fd5ead30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:11:56.547 INFO:tasks.workunit.client.0.smithi050.stderr: -75> 2024-09-14T11:11:56.400+0000 7fd5ead30800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:56.547 INFO:tasks.workunit.client.0.smithi050.stderr: -74> 2024-09-14T11:11:56.400+0000 7fd5ead30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 2024-09-14T11:11:56.547 INFO:tasks.workunit.client.0.smithi050.stderr: -73> 2024-09-14T11:11:56.405+0000 7fd5ead30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 info.flags=0x17 2024-09-14T11:11:56.547 INFO:tasks.workunit.client.0.smithi050.stderr: -72> 2024-09-14T11:11:56.405+0000 7fd5ead30800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 to cache LRU end 2024-09-14T11:11:56.547 INFO:tasks.workunit.client.0.smithi050.stderr: -71> 2024-09-14T11:11:56.405+0000 7fd5ead30800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:56.547 INFO:tasks.workunit.client.0.smithi050.stderr: -70> 2024-09-14T11:11:56.405+0000 7fd5ead30800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33, ofs0, ns] 2024-09-14T11:11:56.547 INFO:tasks.workunit.client.0.smithi050.stderr: -69> 2024-09-14T11:11:56.406+0000 7fd4ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497091 cookie 94402909670960 notifier 6971 bl.length()=1015 2024-09-14T11:11:56.547 INFO:tasks.workunit.client.0.smithi050.stderr: -68> 2024-09-14T11:11:56.406+0000 7fd4ca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 info.flags=0x17 2024-09-14T11:11:56.548 INFO:tasks.workunit.client.0.smithi050.stderr: -67> 2024-09-14T11:11:56.406+0000 7fd4ca7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 to cache LRU end 2024-09-14T11:11:56.548 INFO:tasks.workunit.client.0.smithi050.stderr: -66> 2024-09-14T11:11:56.406+0000 7fd4ca7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:56.548 INFO:tasks.workunit.client.0.smithi050.stderr: -65> 2024-09-14T11:11:56.407+0000 7fd5ead30800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): orig_sources= new_sources= 2024-09-14T11:11:56.548 INFO:tasks.workunit.client.0.smithi050.stderr: -64> 2024-09-14T11:11:56.407+0000 7fd5ead30800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): potential sources added=[] removed=[] 2024-09-14T11:11:56.548 INFO:tasks.workunit.client.0.smithi050.stderr: -63> 2024-09-14T11:11:56.407+0000 7fd5ead30800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): orig_dests= new_dests= 2024-09-14T11:11:56.548 INFO:tasks.workunit.client.0.smithi050.stderr: -62> 2024-09-14T11:11:56.407+0000 7fd5ead30800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): potential dests added=[] removed=[] 2024-09-14T11:11:56.548 INFO:tasks.workunit.client.0.smithi050.stderr: -61> 2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.0 2024-09-14T11:11:56.548 INFO:tasks.workunit.client.0.smithi050.stderr: -60> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.0 2024-09-14T11:11:56.548 INFO:tasks.workunit.client.0.smithi050.stderr: -59> 2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.1 2024-09-14T11:11:56.548 INFO:tasks.workunit.client.0.smithi050.stderr: -58> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.1 2024-09-14T11:11:56.548 INFO:tasks.workunit.client.0.smithi050.stderr: -57> 2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.2 2024-09-14T11:11:56.548 INFO:tasks.workunit.client.0.smithi050.stderr: -56> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.2 2024-09-14T11:11:56.548 INFO:tasks.workunit.client.0.smithi050.stderr: -55> 2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.3 2024-09-14T11:11:56.548 INFO:tasks.workunit.client.0.smithi050.stderr: -54> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.3 2024-09-14T11:11:56.549 INFO:tasks.workunit.client.0.smithi050.stderr: -53> 2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.4 2024-09-14T11:11:56.549 INFO:tasks.workunit.client.0.smithi050.stderr: -52> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.4 2024-09-14T11:11:56.549 INFO:tasks.workunit.client.0.smithi050.stderr: -51> 2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.5 2024-09-14T11:11:56.549 INFO:tasks.workunit.client.0.smithi050.stderr: -50> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.5 2024-09-14T11:11:56.549 INFO:tasks.workunit.client.0.smithi050.stderr: -49> 2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.6 2024-09-14T11:11:56.549 INFO:tasks.workunit.client.0.smithi050.stderr: -48> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.6 2024-09-14T11:11:56.549 INFO:tasks.workunit.client.0.smithi050.stderr: -47> 2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.7 2024-09-14T11:11:56.549 INFO:tasks.workunit.client.0.smithi050.stderr: -46> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.7 2024-09-14T11:11:56.549 INFO:tasks.workunit.client.0.smithi050.stderr: -45> 2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.8 2024-09-14T11:11:56.549 INFO:tasks.workunit.client.0.smithi050.stderr: -44> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.8 2024-09-14T11:11:56.549 INFO:tasks.workunit.client.0.smithi050.stderr: -43> 2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.9 2024-09-14T11:11:56.549 INFO:tasks.workunit.client.0.smithi050.stderr: -42> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.9 2024-09-14T11:11:56.549 INFO:tasks.workunit.client.0.smithi050.stderr: -41> 2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.10 2024-09-14T11:11:56.549 INFO:tasks.workunit.client.0.smithi050.stderr: -40> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.10 2024-09-14T11:11:56.550 INFO:tasks.workunit.client.0.smithi050.stderr: -39> 2024-09-14T11:11:56.413+0000 7fd5ead30800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.11 2024-09-14T11:11:56.550 INFO:tasks.workunit.client.0.smithi050.stderr: -38> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.11 2024-09-14T11:11:56.550 INFO:tasks.workunit.client.0.smithi050.stderr: -37> 2024-09-14T11:11:56.413+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.0 2024-09-14T11:11:56.550 INFO:tasks.workunit.client.0.smithi050.stderr: -36> 2024-09-14T11:11:56.414+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1 2024-09-14T11:11:56.550 INFO:tasks.workunit.client.0.smithi050.stderr: -35> 2024-09-14T11:11:56.414+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.2 2024-09-14T11:11:56.550 INFO:tasks.workunit.client.0.smithi050.stderr: -34> 2024-09-14T11:11:56.414+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.3 2024-09-14T11:11:56.550 INFO:tasks.workunit.client.0.smithi050.stderr: -33> 2024-09-14T11:11:56.415+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.4 2024-09-14T11:11:56.550 INFO:tasks.workunit.client.0.smithi050.stderr: -32> 2024-09-14T11:11:56.416+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.5 2024-09-14T11:11:56.550 INFO:tasks.workunit.client.0.smithi050.stderr: -31> 2024-09-14T11:11:56.416+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.6 2024-09-14T11:11:56.550 INFO:tasks.workunit.client.0.smithi050.stderr: -30> 2024-09-14T11:11:56.417+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.7 2024-09-14T11:11:56.550 INFO:tasks.workunit.client.0.smithi050.stderr: -29> 2024-09-14T11:11:56.417+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.8 2024-09-14T11:11:56.550 INFO:tasks.workunit.client.0.smithi050.stderr: -28> 2024-09-14T11:11:56.418+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.9 2024-09-14T11:11:56.550 INFO:tasks.workunit.client.0.smithi050.stderr: -27> 2024-09-14T11:11:56.418+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.10 2024-09-14T11:11:56.551 INFO:tasks.workunit.client.0.smithi050.stderr: -26> 2024-09-14T11:11:56.421+0000 7fd5ead30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:11:56.551 INFO:tasks.workunit.client.0.smithi050.stderr: -25> 2024-09-14T11:11:56.422+0000 7fd5ead30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 2024-09-14T11:11:56.551 INFO:tasks.workunit.client.0.smithi050.stderr: -24> 2024-09-14T11:11:56.423+0000 7fd5ead30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 info.flags=0x17 2024-09-14T11:11:56.551 INFO:tasks.workunit.client.0.smithi050.stderr: -23> 2024-09-14T11:11:56.423+0000 7fd5ead30800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 to cache LRU end 2024-09-14T11:11:56.551 INFO:tasks.workunit.client.0.smithi050.stderr: -22> 2024-09-14T11:11:56.423+0000 7fd5ead30800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:56.551 INFO:tasks.workunit.client.0.smithi050.stderr: -21> 2024-09-14T11:11:56.423+0000 7fd5ead30800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33, ofs0, ns] 2024-09-14T11:11:56.551 INFO:tasks.workunit.client.0.smithi050.stderr: -20> 2024-09-14T11:11:56.423+0000 7fd4ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497092 cookie 94402909670960 notifier 6971 bl.length()=1015 2024-09-14T11:11:56.551 INFO:tasks.workunit.client.0.smithi050.stderr: -19> 2024-09-14T11:11:56.423+0000 7fd4ca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 info.flags=0x17 2024-09-14T11:11:56.551 INFO:tasks.workunit.client.0.smithi050.stderr: -18> 2024-09-14T11:11:56.423+0000 7fd4ca7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 to cache LRU end 2024-09-14T11:11:56.551 INFO:tasks.workunit.client.0.smithi050.stderr: -17> 2024-09-14T11:11:56.423+0000 7fd4ca7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:11:56.551 INFO:tasks.workunit.client.0.smithi050.stderr: -16> 2024-09-14T11:11:56.425+0000 7fd5ead30800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): orig_sources= new_sources= 2024-09-14T11:11:56.551 INFO:tasks.workunit.client.0.smithi050.stderr: -15> 2024-09-14T11:11:56.425+0000 7fd5ead30800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): potential sources added=[] removed=[] 2024-09-14T11:11:56.551 INFO:tasks.workunit.client.0.smithi050.stderr: -14> 2024-09-14T11:11:56.425+0000 7fd5ead30800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): orig_dests= new_dests= 2024-09-14T11:11:56.551 INFO:tasks.workunit.client.0.smithi050.stderr: -13> 2024-09-14T11:11:56.425+0000 7fd5ead30800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): potential dests added=[] removed=[] 2024-09-14T11:11:56.552 INFO:tasks.workunit.client.0.smithi050.stderr: -12> 2024-09-14T11:11:56.427+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.0 2024-09-14T11:11:56.552 INFO:tasks.workunit.client.0.smithi050.stderr: -11> 2024-09-14T11:11:56.428+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1 2024-09-14T11:11:56.552 INFO:tasks.workunit.client.0.smithi050.stderr: -10> 2024-09-14T11:11:56.428+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.2 2024-09-14T11:11:56.552 INFO:tasks.workunit.client.0.smithi050.stderr: -9> 2024-09-14T11:11:56.428+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.3 2024-09-14T11:11:56.552 INFO:tasks.workunit.client.0.smithi050.stderr: -8> 2024-09-14T11:11:56.429+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.4 2024-09-14T11:11:56.552 INFO:tasks.workunit.client.0.smithi050.stderr: -7> 2024-09-14T11:11:56.429+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.5 2024-09-14T11:11:56.552 INFO:tasks.workunit.client.0.smithi050.stderr: -6> 2024-09-14T11:11:56.429+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.6 2024-09-14T11:11:56.552 INFO:tasks.workunit.client.0.smithi050.stderr: -5> 2024-09-14T11:11:56.430+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.7 2024-09-14T11:11:56.552 INFO:tasks.workunit.client.0.smithi050.stderr: -4> 2024-09-14T11:11:56.430+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.8 2024-09-14T11:11:56.552 INFO:tasks.workunit.client.0.smithi050.stderr: -3> 2024-09-14T11:11:56.430+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.9 2024-09-14T11:11:56.552 INFO:tasks.workunit.client.0.smithi050.stderr: -2> 2024-09-14T11:11:56.431+0000 7fd5ead30800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.10 2024-09-14T11:11:56.552 INFO:tasks.workunit.client.0.smithi050.stderr: -1> 2024-09-14T11:11:56.432+0000 7fd5ead30800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd5ead30800 time 2024-09-14T11:11:56.431919+0000 2024-09-14T11:11:56.552 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:11:56.552 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.553 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:11:56.553 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd5ec58c76a] 2024-09-14T11:11:56.553 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd5ec58c928] 2024-09-14T11:11:56.553 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dbe22f20b1] 2024-09-14T11:11:56.553 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55dbe2302217] 2024-09-14T11:11:56.553 INFO:tasks.workunit.client.0.smithi050.stderr: 5: main() 2024-09-14T11:11:56.553 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fd5eb229590] 2024-09-14T11:11:56.553 INFO:tasks.workunit.client.0.smithi050.stderr: 7: __libc_start_main() 2024-09-14T11:11:56.553 INFO:tasks.workunit.client.0.smithi050.stderr: 8: _start() 2024-09-14T11:11:56.553 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.553 INFO:tasks.workunit.client.0.smithi050.stderr: 0> 2024-09-14T11:11:56.432+0000 7fd5ead30800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:11:56.553 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7fd5ead30800 thread_name:radosgw-admin 2024-09-14T11:11:56.553 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.554 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:11:56.554 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd5eb23e6f0] 2024-09-14T11:11:56.554 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd5eb28b99c] 2024-09-14T11:11:56.554 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:11:56.554 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:11:56.554 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd5ec58c7c4] 2024-09-14T11:11:56.554 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd5ec58c928] 2024-09-14T11:11:56.554 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dbe22f20b1] 2024-09-14T11:11:56.554 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55dbe2302217] 2024-09-14T11:11:56.554 INFO:tasks.workunit.client.0.smithi050.stderr: 9: main() 2024-09-14T11:11:56.554 INFO:tasks.workunit.client.0.smithi050.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fd5eb229590] 2024-09-14T11:11:56.554 INFO:tasks.workunit.client.0.smithi050.stderr: 11: __libc_start_main() 2024-09-14T11:11:56.554 INFO:tasks.workunit.client.0.smithi050.stderr: 12: _start() 2024-09-14T11:11:56.554 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:11:56.555 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.555 INFO:tasks.workunit.client.0.smithi050.stderr:--- logging levels --- 2024-09-14T11:11:56.555 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 none 2024-09-14T11:11:56.555 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 lockdep 2024-09-14T11:11:56.555 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 context 2024-09-14T11:11:56.555 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 crush 2024-09-14T11:11:56.555 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds 2024-09-14T11:11:56.555 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_balancer 2024-09-14T11:11:56.555 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_locker 2024-09-14T11:11:56.555 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log 2024-09-14T11:11:56.555 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log_expire 2024-09-14T11:11:56.555 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_migrator 2024-09-14T11:11:56.555 INFO:tasks.workunit.client.0.smithi050.stderr: 3/ 5 mds_quiesce 2024-09-14T11:11:56.555 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 buffer 2024-09-14T11:11:56.556 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 timer 2024-09-14T11:11:56.556 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 filer 2024-09-14T11:11:56.556 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 striper 2024-09-14T11:11:56.556 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 objecter 2024-09-14T11:11:56.556 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rados 2024-09-14T11:11:56.556 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd 2024-09-14T11:11:56.556 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_mirror 2024-09-14T11:11:56.556 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_replay 2024-09-14T11:11:56.556 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_pwl 2024-09-14T11:11:56.556 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 journaler 2024-09-14T11:11:56.556 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objectcacher 2024-09-14T11:11:56.556 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:11:56.556 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 client 2024-09-14T11:11:56.556 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 osd 2024-09-14T11:11:56.557 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 optracker 2024-09-14T11:11:56.557 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objclass 2024-09-14T11:11:56.557 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 filestore 2024-09-14T11:11:56.557 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 journal 2024-09-14T11:11:56.557 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 ms 2024-09-14T11:11:56.557 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mon 2024-09-14T11:11:56.557 INFO:tasks.workunit.client.0.smithi050.stderr: 0/10 monc 2024-09-14T11:11:56.557 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 paxos 2024-09-14T11:11:56.557 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 tp 2024-09-14T11:11:56.557 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 auth 2024-09-14T11:11:56.557 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 crypto 2024-09-14T11:11:56.557 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 finisher 2024-09-14T11:11:56.557 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 reserver 2024-09-14T11:11:56.557 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 heartbeatmap 2024-09-14T11:11:56.558 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 perfcounter 2024-09-14T11:11:56.558 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw 2024-09-14T11:11:56.558 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_sync 2024-09-14T11:11:56.558 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_datacache 2024-09-14T11:11:56.558 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_access 2024-09-14T11:11:56.558 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:11:56.558 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_flight 2024-09-14T11:11:56.558 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:11:56.558 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw_notification 2024-09-14T11:11:56.558 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 javaclient 2024-09-14T11:11:56.558 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 asok 2024-09-14T11:11:56.558 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 throttle 2024-09-14T11:11:56.558 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 refs 2024-09-14T11:11:56.559 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 compressor 2024-09-14T11:11:56.559 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluestore 2024-09-14T11:11:56.559 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluefs 2024-09-14T11:11:56.559 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 bdev 2024-09-14T11:11:56.559 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 kstore 2024-09-14T11:11:56.559 INFO:tasks.workunit.client.0.smithi050.stderr: 4/ 5 rocksdb 2024-09-14T11:11:56.559 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 fuse 2024-09-14T11:11:56.559 INFO:tasks.workunit.client.0.smithi050.stderr: 2/ 5 mgr 2024-09-14T11:11:56.559 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mgrc 2024-09-14T11:11:56.559 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 dpdk 2024-09-14T11:11:56.559 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 eventtrace 2024-09-14T11:11:56.559 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 prioritycache 2024-09-14T11:11:56.559 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 test 2024-09-14T11:11:56.559 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:11:56.559 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephsqlite 2024-09-14T11:11:56.560 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:11:56.560 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore 2024-09-14T11:11:56.560 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_onode 2024-09-14T11:11:56.560 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_odata 2024-09-14T11:11:56.560 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_omap 2024-09-14T11:11:56.560 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_tm 2024-09-14T11:11:56.560 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_t 2024-09-14T11:11:56.560 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:11:56.560 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_epm 2024-09-14T11:11:56.560 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_lba 2024-09-14T11:11:56.560 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:11:56.560 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cache 2024-09-14T11:11:56.560 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_journal 2024-09-14T11:11:56.561 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_device 2024-09-14T11:11:56.561 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_backref 2024-09-14T11:11:56.561 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 alienstore 2024-09-14T11:11:56.561 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mclock 2024-09-14T11:11:56.561 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cyanstore 2024-09-14T11:11:56.561 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 ceph_exporter 2024-09-14T11:11:56.561 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 memstore 2024-09-14T11:11:56.561 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 trace 2024-09-14T11:11:56.561 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 ceph_dedup 2024-09-14T11:11:56.561 INFO:tasks.workunit.client.0.smithi050.stderr: -2/-2 (syslog threshold) 2024-09-14T11:11:56.561 INFO:tasks.workunit.client.0.smithi050.stderr: 99/99 (stderr threshold) 2024-09-14T11:11:56.561 INFO:tasks.workunit.client.0.smithi050.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:11:56.561 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd415ffb640 / http_manager 2024-09-14T11:11:56.561 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd417fff640 / http_manager 2024-09-14T11:11:56.561 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd49d7e2640 / rgw_dt_lg_renew 2024-09-14T11:11:56.562 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd4c8ff9640 / ms_dispatch 2024-09-14T11:11:56.562 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd4ca7fc640 / io_context_pool 2024-09-14T11:11:56.562 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd4d0e01640 / ms_dispatch 2024-09-14T11:11:56.562 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd4d3606640 / ms_dispatch 2024-09-14T11:11:56.562 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd4d4e09640 / io_context_pool 2024-09-14T11:11:56.562 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd5e62af640 / msgr-worker-2 2024-09-14T11:11:56.562 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd5e6ab0640 / msgr-worker-1 2024-09-14T11:11:56.562 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd5e72b1640 / msgr-worker-0 2024-09-14T11:11:56.562 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd5e7ab2640 / io_context_pool 2024-09-14T11:11:56.562 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd5ead30800 / radosgw-admin 2024-09-14T11:11:56.562 INFO:tasks.workunit.client.0.smithi050.stderr: max_recent 500 2024-09-14T11:11:56.562 INFO:tasks.workunit.client.0.smithi050.stderr: max_new 1000 2024-09-14T11:11:56.562 INFO:tasks.workunit.client.0.smithi050.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:11:56.433320Z_e9b4edeb-0014-40b4-b7ab-d9f7c4a5ac72/log 2024-09-14T11:11:56.562 INFO:tasks.workunit.client.0.smithi050.stderr:--- end dump of recent events --- 2024-09-14T11:11:56.563 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:11:56.564 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:56.564 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:56.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.511+0000 7f1f40328800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.513+0000 7f1f40328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.513+0000 7f1f40328800 20 realm 2024-09-14T11:11:56.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.513+0000 7f1f40328800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.513+0000 7f1f40328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.513+0000 7f1f40328800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:56.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.513+0000 7f1f40328800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.513+0000 7f1f40328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.513+0000 7f1f40328800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.514+0000 7f1f40328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:56.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.514+0000 7f1f40328800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.515+0000 7f1f40328800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:56.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.515+0000 7f1f40328800 20 searching for the correct realm 2024-09-14T11:11:56.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.517+0000 7f1f3b86e640 0 -- 172.21.15.50:0/48146916 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f1f34010b50 msgr2=0x7f1f34034900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:56.720 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.722+0000 7f1f3c870640 0 -- 172.21.15.50:0/48146916 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55d2a3410db0 msgr2=0x55d2a3413270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:56.724 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.726+0000 7f1f40328800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:11:56.724 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.726+0000 7f1f40328800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:56.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.726+0000 7f1f40328800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:11:56.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.726+0000 7f1f40328800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:56.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.726+0000 7f1f40328800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:56.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.726+0000 7f1f40328800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:56.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.726+0000 7f1f40328800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.726+0000 7f1f40328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.726+0000 7f1f40328800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.727+0000 7f1f40328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:56.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.727+0000 7f1f40328800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.727+0000 7f1f40328800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:56.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.727+0000 7f1f40328800 20 zone default found 2024-09-14T11:11:56.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.727+0000 7f1f40328800 4 Realm: () 2024-09-14T11:11:56.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.727+0000 7f1f40328800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:11:56.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.727+0000 7f1f40328800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:11:56.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.727+0000 7f1f40328800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:56.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.727+0000 7f1f40328800 20 zonegroup default 2024-09-14T11:11:56.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.727+0000 7f1f40328800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.727+0000 7f1f40328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.726 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.727+0000 7f1f40328800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.728+0000 7f1f40328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.728+0000 7f1f40328800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.728+0000 7f1f40328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:56.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.728+0000 7f1f40328800 20 started sync module instance, tier type = 2024-09-14T11:11:56.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.728+0000 7f1f40328800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:11:56.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.737+0000 7f1f40328800 20 add_watcher() i=0 2024-09-14T11:11:56.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.737+0000 7f1f40328800 20 add_watcher() i=1 2024-09-14T11:11:56.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.737+0000 7f1f40328800 20 add_watcher() i=2 2024-09-14T11:11:56.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.737+0000 7f1f40328800 20 add_watcher() i=3 2024-09-14T11:11:56.736 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.737+0000 7f1f40328800 20 add_watcher() i=4 2024-09-14T11:11:56.736 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.737+0000 7f1f40328800 20 add_watcher() i=5 2024-09-14T11:11:56.736 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.737+0000 7f1f40328800 20 add_watcher() i=6 2024-09-14T11:11:56.736 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.738+0000 7f1f40328800 20 add_watcher() i=7 2024-09-14T11:11:56.736 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.738+0000 7f1f40328800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:56.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.740+0000 7f1df2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:56.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.740+0000 7f1f40328800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:56.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.740+0000 7f1f40328800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:56.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.740+0000 7f1f40328800 5 note: GC not initialized 2024-09-14T11:11:56.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.740+0000 7f1df1fdb640 20 reqs_thread_entry: start 2024-09-14T11:11:56.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.741+0000 7f1f40328800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:56.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.741+0000 7f1f40328800 20 Filter name: none 2024-09-14T11:11:56.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.741+0000 7f1d637fe640 20 reqs_thread_entry: start 2024-09-14T11:11:56.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.741+0000 7f1f40328800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.742+0000 7f1f40328800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:11:56.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.742+0000 7f1f40328800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.742+0000 7f1f40328800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:11:56.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.742+0000 7f1f40328800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:56.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.742+0000 7f1f40328800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.742+0000 7f1f40328800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:11:56.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.742+0000 7f1f40328800 20 rados->read ofs=0 len=0 2024-09-14T11:11:56.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.743+0000 7f1f40328800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:11:56.742 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.743+0000 7f1f40328800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:11:56.742 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.744+0000 7f1df2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:56.745 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.747+0000 7f1f40328800 20 remove_watcher() i=0 2024-09-14T11:11:56.745 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.747+0000 7f1f40328800 2 removed watcher, disabling cache 2024-09-14T11:11:56.745 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.747+0000 7f1f40328800 20 remove_watcher() i=1 2024-09-14T11:11:56.747 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.748+0000 7f1f40328800 20 remove_watcher() i=2 2024-09-14T11:11:56.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.749+0000 7f1f40328800 20 remove_watcher() i=3 2024-09-14T11:11:56.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.750+0000 7f1f40328800 20 remove_watcher() i=4 2024-09-14T11:11:56.750 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.751+0000 7f1f40328800 20 remove_watcher() i=5 2024-09-14T11:11:56.751 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.753+0000 7f1f40328800 20 remove_watcher() i=6 2024-09-14T11:11:56.752 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:11:56.754+0000 7f1f40328800 20 remove_watcher() i=7 2024-09-14T11:11:56.763 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.763 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:11:56.763 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: abort-at-commit-target-layout id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:11:56.763 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:11:56.765 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:56.765 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:26.924 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:26.925 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:26.983 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:12:27.016 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:27.017 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:27.057 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.058+0000 7fe3c4698800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.060+0000 7fe3c4698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.060+0000 7fe3c4698800 20 realm 2024-09-14T11:12:27.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.060+0000 7fe3c4698800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.060+0000 7fe3c4698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.060+0000 7fe3c4698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:27.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.060+0000 7fe3c4698800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.061+0000 7fe3c4698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.060 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.061+0000 7fe3c4698800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.061 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.061+0000 7fe3c4698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:27.061 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.061+0000 7fe3c4698800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.061 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.062+0000 7fe3c4698800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:27.061 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.062+0000 7fe3c4698800 20 searching for the correct realm 2024-09-14T11:12:27.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.065+0000 7fe3c1981640 0 -- 172.21.15.50:0/488060689 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fe3bc06cbe0 msgr2=0x7fe3bc0849f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:27.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.270+0000 7fe3c2983640 0 -- 172.21.15.50:0/488060689 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x560d90eb2cf0 msgr2=0x560d90eb5160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:27.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.274+0000 7fe3c4698800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:12:27.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.274+0000 7fe3c4698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:27.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.274+0000 7fe3c4698800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:12:27.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.274+0000 7fe3c4698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:27.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.274+0000 7fe3c4698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:27.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.274+0000 7fe3c4698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:27.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.274+0000 7fe3c4698800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.274+0000 7fe3c4698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.274+0000 7fe3c4698800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.274+0000 7fe3c4698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:27.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.274+0000 7fe3c4698800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.274+0000 7fe3c4698800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:27.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.274+0000 7fe3c4698800 20 zone default found 2024-09-14T11:12:27.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.274+0000 7fe3c4698800 4 Realm: () 2024-09-14T11:12:27.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.274+0000 7fe3c4698800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:12:27.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.274+0000 7fe3c4698800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:12:27.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.274+0000 7fe3c4698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:27.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.274+0000 7fe3c4698800 20 zonegroup default 2024-09-14T11:12:27.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.274+0000 7fe3c4698800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.275+0000 7fe3c4698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.275+0000 7fe3c4698800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.276 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.275+0000 7fe3c4698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.276 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.275+0000 7fe3c4698800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.276 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.275+0000 7fe3c4698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.276 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.275+0000 7fe3c4698800 20 started sync module instance, tier type = 2024-09-14T11:12:27.276 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.275+0000 7fe3c4698800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:12:27.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.285+0000 7fe3c4698800 20 add_watcher() i=0 2024-09-14T11:12:27.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.285+0000 7fe3c4698800 20 add_watcher() i=1 2024-09-14T11:12:27.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.285+0000 7fe3c4698800 20 add_watcher() i=2 2024-09-14T11:12:27.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.285+0000 7fe3c4698800 20 add_watcher() i=3 2024-09-14T11:12:27.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.285+0000 7fe3c4698800 20 add_watcher() i=4 2024-09-14T11:12:27.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.285+0000 7fe3c4698800 20 add_watcher() i=5 2024-09-14T11:12:27.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.285+0000 7fe3c4698800 20 add_watcher() i=6 2024-09-14T11:12:27.285 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.285+0000 7fe3c4698800 20 add_watcher() i=7 2024-09-14T11:12:27.285 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.285+0000 7fe3c4698800 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:27.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.288+0000 7fe278fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:27.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.288+0000 7fe3c4698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:27.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.288+0000 7fe3c4698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:27.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.288+0000 7fe3c4698800 5 note: GC not initialized 2024-09-14T11:12:27.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.288+0000 7fe1f37fe640 20 reqs_thread_entry: start 2024-09-14T11:12:27.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.288+0000 7fe3c4698800 20 init_complete bucket index max shards: 11 2024-09-14T11:12:27.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.288+0000 7fe3c4698800 20 Filter name: none 2024-09-14T11:12:27.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.288+0000 7fe1f17fa640 20 reqs_thread_entry: start 2024-09-14T11:12:27.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.288+0000 7fe3c4698800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:12:27.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.288+0000 7fe3c4698800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.289 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.289+0000 7fe3c4698800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:12:27.289 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.289+0000 7fe3c4698800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:12:27.289 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.289+0000 7fe3c4698800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:12:27.289 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.289+0000 7fe3c4698800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 : miss 2024-09-14T11:12:27.289 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.289+0000 7fe3c4698800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.289 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.289+0000 7fe3c4698800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:12:27.289 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.289+0000 7fe3c4698800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 info.flags=0x17 2024-09-14T11:12:27.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.289+0000 7fe3c4698800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 to cache LRU end 2024-09-14T11:12:27.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.289+0000 7fe3c4698800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:27.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.289+0000 7fe3c4698800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:27.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.289+0000 7fe3c4698800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 2024-09-14T11:12:27.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.294+0000 7fe3c4698800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 info.flags=0x17 2024-09-14T11:12:27.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.294+0000 7fe3c4698800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 to cache LRU end 2024-09-14T11:12:27.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.294+0000 7fe3c4698800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:27.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.294+0000 7fe3c4698800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33, ofs0, ns] 2024-09-14T11:12:27.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.295+0000 7fe2a57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497094 cookie 94616265903056 notifier 7004 bl.length()=1015 2024-09-14T11:12:27.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.295+0000 7fe2a57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 info.flags=0x17 2024-09-14T11:12:27.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.295+0000 7fe2a57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 to cache LRU end 2024-09-14T11:12:27.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.295+0000 7fe2a57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:27.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.297+0000 7fe3c4698800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): orig_sources= new_sources= 2024-09-14T11:12:27.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.297+0000 7fe3c4698800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): potential sources added=[] removed=[] 2024-09-14T11:12:27.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.297+0000 7fe3c4698800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): orig_dests= new_dests= 2024-09-14T11:12:27.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.297+0000 7fe3c4698800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): potential dests added=[] removed=[] 2024-09-14T11:12:27.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.0 2024-09-14T11:12:27.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.0 2024-09-14T11:12:27.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.1 2024-09-14T11:12:27.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.1 2024-09-14T11:12:27.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.2 2024-09-14T11:12:27.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.2 2024-09-14T11:12:27.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.3 2024-09-14T11:12:27.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.3 2024-09-14T11:12:27.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.4 2024-09-14T11:12:27.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.4 2024-09-14T11:12:27.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.5 2024-09-14T11:12:27.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.5 2024-09-14T11:12:27.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.6 2024-09-14T11:12:27.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.6 2024-09-14T11:12:27.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.7 2024-09-14T11:12:27.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.7 2024-09-14T11:12:27.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.8 2024-09-14T11:12:27.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.8 2024-09-14T11:12:27.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.9 2024-09-14T11:12:27.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.9 2024-09-14T11:12:27.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.10 2024-09-14T11:12:27.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.10 2024-09-14T11:12:27.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.11 2024-09-14T11:12:27.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1.11 2024-09-14T11:12:27.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.0 2024-09-14T11:12:27.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.301+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1 2024-09-14T11:12:27.303 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.302+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.2 2024-09-14T11:12:27.303 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.303+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.3 2024-09-14T11:12:27.303 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.303+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.4 2024-09-14T11:12:27.303 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.305+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.5 2024-09-14T11:12:27.304 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.305+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.6 2024-09-14T11:12:27.304 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.305+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.7 2024-09-14T11:12:27.304 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.305+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.8 2024-09-14T11:12:27.305 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.306+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.9 2024-09-14T11:12:27.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.308+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.10 2024-09-14T11:12:27.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.310+0000 7fe3c4698800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:12:27.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.310+0000 7fe3c4698800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 2024-09-14T11:12:27.310 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.311+0000 7fe3c4698800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 info.flags=0x17 2024-09-14T11:12:27.310 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.311+0000 7fe3c4698800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 to cache LRU end 2024-09-14T11:12:27.310 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.311+0000 7fe3c4698800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:27.310 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.311+0000 7fe3c4698800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33, ofs0, ns] 2024-09-14T11:12:27.311 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.311+0000 7fe2a5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497095 cookie 94616265903056 notifier 7004 bl.length()=1015 2024-09-14T11:12:27.311 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.311+0000 7fe2a5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 info.flags=0x17 2024-09-14T11:12:27.311 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.311+0000 7fe2a5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 to cache LRU end 2024-09-14T11:12:27.311 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.311+0000 7fe2a5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:27.312 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.313+0000 7fe3c4698800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): orig_sources= new_sources= 2024-09-14T11:12:27.312 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.313+0000 7fe3c4698800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): potential sources added=[] removed=[] 2024-09-14T11:12:27.312 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.313+0000 7fe3c4698800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): orig_dests= new_dests= 2024-09-14T11:12:27.312 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.313+0000 7fe3c4698800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): potential dests added=[] removed=[] 2024-09-14T11:12:27.315 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.315+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.0 2024-09-14T11:12:27.315 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.316+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.1 2024-09-14T11:12:27.315 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.316+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.2 2024-09-14T11:12:27.315 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.316+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.3 2024-09-14T11:12:27.316 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.317+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.4 2024-09-14T11:12:27.316 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.317+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.5 2024-09-14T11:12:27.316 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.317+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.6 2024-09-14T11:12:27.317 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.318+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.7 2024-09-14T11:12:27.317 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.318+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.8 2024-09-14T11:12:27.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.318+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.9 2024-09-14T11:12:27.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.319+0000 7fe3c4698800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33.10 2024-09-14T11:12:27.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.319+0000 7fe3c4698800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:12:27.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.319+0000 7fe3c4698800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 2024-09-14T11:12:27.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.322+0000 7fe3c4698800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 info.flags=0x17 2024-09-14T11:12:27.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.322+0000 7fe3c4698800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 to cache LRU end 2024-09-14T11:12:27.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.322+0000 7fe3c4698800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:27.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.322+0000 7fe3c4698800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33, ofs0, ns] 2024-09-14T11:12:27.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.322+0000 7fe2a57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497096 cookie 94616265903056 notifier 7004 bl.length()=983 2024-09-14T11:12:27.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.322+0000 7fe2a57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 info.flags=0x17 2024-09-14T11:12:27.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.322+0000 7fe2a57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 to cache LRU end 2024-09-14T11:12:27.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.322+0000 7fe2a57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:27.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.322+0000 7fe3c4698800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): orig_sources= new_sources= 2024-09-14T11:12:27.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.322+0000 7fe3c4698800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): potential sources added=[] removed=[] 2024-09-14T11:12:27.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.322+0000 7fe3c4698800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): orig_dests= new_dests= 2024-09-14T11:12:27.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.322+0000 7fe3c4698800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33]): potential dests added=[] removed=[] 2024-09-14T11:12:27.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.325+0000 7fe3c4698800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:12:27.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.327+0000 7fe278fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:27.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.329+0000 7fe3c4698800 20 remove_watcher() i=0 2024-09-14T11:12:27.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.329+0000 7fe3c4698800 2 removed watcher, disabling cache 2024-09-14T11:12:27.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.330+0000 7fe3c4698800 20 remove_watcher() i=1 2024-09-14T11:12:27.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.331+0000 7fe3c4698800 20 remove_watcher() i=2 2024-09-14T11:12:27.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.332+0000 7fe3c4698800 20 remove_watcher() i=3 2024-09-14T11:12:27.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.332+0000 7fe3c4698800 20 remove_watcher() i=4 2024-09-14T11:12:27.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.333+0000 7fe3c4698800 20 remove_watcher() i=5 2024-09-14T11:12:27.333 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.334+0000 7fe3c4698800 20 remove_watcher() i=6 2024-09-14T11:12:27.334 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.335+0000 7fe3c4698800 20 remove_watcher() i=7 2024-09-14T11:12:27.348 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:12:27.377 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:27.377 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:27.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.417+0000 7f823bab7800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.419+0000 7f823bab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.419+0000 7f823bab7800 20 realm 2024-09-14T11:12:27.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.419+0000 7f823bab7800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.419+0000 7f823bab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.419+0000 7f823bab7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:27.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.419+0000 7f823bab7800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.419+0000 7f823bab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.419+0000 7f823bab7800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.420+0000 7f823bab7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:27.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.420+0000 7f823bab7800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.421+0000 7f823bab7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:27.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.421+0000 7f823bab7800 20 searching for the correct realm 2024-09-14T11:12:27.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.422+0000 7f82395a1640 0 -- 172.21.15.50:0/3441597603 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x7f8234031040 msgr2=0x7f82340079d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:27.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.627+0000 7f8239da2640 0 -- 172.21.15.50:0/3441597603 >> [v2:172.21.15.118:6826/1082138742,v1:172.21.15.118:6827/1082138742] conn(0x7f822c06a2e0 msgr2=0x7f822c082b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:27.834 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.836+0000 7f823bab7800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:12:27.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.836+0000 7f823bab7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:27.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.836+0000 7f823bab7800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:12:27.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.836+0000 7f823bab7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:27.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.836+0000 7f823bab7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:27.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.836+0000 7f823bab7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:27.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.836+0000 7f823bab7800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.836+0000 7f823bab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.836+0000 7f823bab7800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.837+0000 7f823bab7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:27.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.837+0000 7f823bab7800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.837+0000 7f823bab7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:27.836 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.837+0000 7f823bab7800 20 zone default found 2024-09-14T11:12:27.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.837+0000 7f823bab7800 4 Realm: () 2024-09-14T11:12:27.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.837+0000 7f823bab7800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:12:27.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.837+0000 7f823bab7800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:12:27.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.837+0000 7f823bab7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:27.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.837+0000 7f823bab7800 20 zonegroup default 2024-09-14T11:12:27.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.837+0000 7f823bab7800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.837+0000 7f823bab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.837+0000 7f823bab7800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.838+0000 7f823bab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.838+0000 7f823bab7800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.838+0000 7f823bab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.838+0000 7f823bab7800 20 started sync module instance, tier type = 2024-09-14T11:12:27.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.838+0000 7f823bab7800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:12:27.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.847+0000 7f823bab7800 20 add_watcher() i=0 2024-09-14T11:12:27.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.847+0000 7f823bab7800 20 add_watcher() i=1 2024-09-14T11:12:27.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.847+0000 7f823bab7800 20 add_watcher() i=2 2024-09-14T11:12:27.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.847+0000 7f823bab7800 20 add_watcher() i=3 2024-09-14T11:12:27.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.847+0000 7f823bab7800 20 add_watcher() i=4 2024-09-14T11:12:27.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.847+0000 7f823bab7800 20 add_watcher() i=5 2024-09-14T11:12:27.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.847+0000 7f823bab7800 20 add_watcher() i=6 2024-09-14T11:12:27.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.848+0000 7f823bab7800 20 add_watcher() i=7 2024-09-14T11:12:27.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.848+0000 7f823bab7800 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:27.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.850+0000 7f80ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:27.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.850+0000 7f823bab7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:27.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.850+0000 7f823bab7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:27.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.850+0000 7f823bab7800 5 note: GC not initialized 2024-09-14T11:12:27.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.850+0000 7f80ee7e4640 20 reqs_thread_entry: start 2024-09-14T11:12:27.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.850+0000 7f823bab7800 20 init_complete bucket index max shards: 11 2024-09-14T11:12:27.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.851+0000 7f823bab7800 20 Filter name: none 2024-09-14T11:12:27.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.851+0000 7f805ffff640 20 reqs_thread_entry: start 2024-09-14T11:12:27.850 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.851+0000 7f823bab7800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.850 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.851+0000 7f823bab7800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:12:27.850 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.851+0000 7f823bab7800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.850 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.852+0000 7f823bab7800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:12:27.850 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.852+0000 7f823bab7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:27.850 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.852+0000 7f823bab7800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.850 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.852+0000 7f823bab7800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:12:27.850 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.852+0000 7f823bab7800 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.851 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.852+0000 7f823bab7800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:12:27.851 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.852+0000 7f823bab7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:27.853 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.855+0000 7f80ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:27.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.857+0000 7f823bab7800 20 remove_watcher() i=0 2024-09-14T11:12:27.855 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.857+0000 7f823bab7800 2 removed watcher, disabling cache 2024-09-14T11:12:27.856 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.858+0000 7f823bab7800 20 remove_watcher() i=1 2024-09-14T11:12:27.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.859+0000 7f823bab7800 20 remove_watcher() i=2 2024-09-14T11:12:27.858 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.860+0000 7f823bab7800 20 remove_watcher() i=3 2024-09-14T11:12:27.859 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.861+0000 7f823bab7800 20 remove_watcher() i=4 2024-09-14T11:12:27.860 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.862+0000 7f823bab7800 20 remove_watcher() i=5 2024-09-14T11:12:27.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.863+0000 7f823bab7800 20 remove_watcher() i=6 2024-09-14T11:12:27.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:27.864+0000 7f823bab7800 20 remove_watcher() i=7 2024-09-14T11:12:27.873 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:27.873 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:12:27.873 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: abort-at-commit-target-layout id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:12:27.873 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:27.876 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:27.876 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:27.897 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:27.897 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:28.125 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:28.125 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:28.263 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-14T11:12:28.263 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:28.264 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:28.264 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:28.314 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:28.314 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:28.371 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:28.372 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:28.411 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:28.411 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:28.447 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:28.448 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:28.485 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:28.485 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:28.523 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:28.523 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:28.561 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:28.561 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:28.599 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:28.599 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:28.635 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:28.635 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:28.708 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:28.708 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:28.743 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:28.744 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:28.780 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:28.780 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:28.817 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:28.817 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:28.854 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:28.854 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:28.891 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:28.891 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:28.927 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:28.927 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:28.965 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:28.965 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:29.001 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:29.001 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:29.039 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:29.040 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:29.077 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:29.078 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:29.115 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:29.115 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:29.151 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:12:29.179 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:29.180 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:29.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.221+0000 7f3180f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.223+0000 7f3180f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.223+0000 7f3180f2c800 20 realm 2024-09-14T11:12:29.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.223+0000 7f3180f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.223+0000 7f3180f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.223+0000 7f3180f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:29.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.223+0000 7f3180f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.224+0000 7f3180f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.224+0000 7f3180f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.224+0000 7f3180f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:29.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.224+0000 7f3180f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.225+0000 7f3180f2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:29.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.225+0000 7f3180f2c800 20 searching for the correct realm 2024-09-14T11:12:29.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.228+0000 7f317c4ac640 0 -- 172.21.15.50:0/1962260587 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f3174066f50 msgr2=0x7f317406ea10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:29.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.232+0000 7f317c4ac640 0 -- 172.21.15.50:0/1962260587 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55b8b8b6a5b0 msgr2=0x55b8b8b6c9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:29.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.235+0000 7f3180f2c800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:12:29.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.235+0000 7f3180f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:29.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.235+0000 7f3180f2c800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:12:29.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.235+0000 7f3180f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:29.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.235+0000 7f3180f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:29.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.235+0000 7f3180f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:29.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.235+0000 7f3180f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.235+0000 7f3180f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.235+0000 7f3180f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.236+0000 7f3180f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:29.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.236+0000 7f3180f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.236+0000 7f3180f2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:29.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.236+0000 7f3180f2c800 20 zone default found 2024-09-14T11:12:29.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.236+0000 7f3180f2c800 4 Realm: () 2024-09-14T11:12:29.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.236+0000 7f3180f2c800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:12:29.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.236+0000 7f3180f2c800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:12:29.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.236+0000 7f3180f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:29.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.236+0000 7f3180f2c800 20 zonegroup default 2024-09-14T11:12:29.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.236+0000 7f3180f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.236+0000 7f3180f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.236+0000 7f3180f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.237+0000 7f3180f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.237+0000 7f3180f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.237+0000 7f3180f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.237+0000 7f3180f2c800 20 started sync module instance, tier type = 2024-09-14T11:12:29.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.237+0000 7f3180f2c800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:12:29.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.246+0000 7f3180f2c800 20 add_watcher() i=0 2024-09-14T11:12:29.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.246+0000 7f3180f2c800 20 add_watcher() i=1 2024-09-14T11:12:29.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.246+0000 7f3180f2c800 20 add_watcher() i=2 2024-09-14T11:12:29.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.246+0000 7f3180f2c800 20 add_watcher() i=3 2024-09-14T11:12:29.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.246+0000 7f3180f2c800 20 add_watcher() i=4 2024-09-14T11:12:29.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.246+0000 7f3180f2c800 20 add_watcher() i=5 2024-09-14T11:12:29.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.246+0000 7f3180f2c800 20 add_watcher() i=6 2024-09-14T11:12:29.245 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.246+0000 7f3180f2c800 20 add_watcher() i=7 2024-09-14T11:12:29.245 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.246+0000 7f3180f2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:29.247 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.248+0000 7f30337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:29.247 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.249+0000 7f3180f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:29.247 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.249+0000 7f3180f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:29.247 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.249+0000 7f3180f2c800 5 note: GC not initialized 2024-09-14T11:12:29.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.249+0000 7f30327e4640 20 reqs_thread_entry: start 2024-09-14T11:12:29.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.249+0000 7f3180f2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:12:29.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.249+0000 7f3180f2c800 20 Filter name: none 2024-09-14T11:12:29.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.249+0000 7f302bfff640 20 reqs_thread_entry: start 2024-09-14T11:12:29.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.249+0000 7f3180f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.250+0000 7f3180f2c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:12:29.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.250+0000 7f3180f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.250+0000 7f3180f2c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:12:29.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.250+0000 7f3180f2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:29.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.250+0000 7f3180f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.250+0000 7f3180f2c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:12:29.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.250+0000 7f3180f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.251+0000 7f3180f2c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:12:29.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.251+0000 7f3180f2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:29.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.252+0000 7f30337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:29.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.254+0000 7f3180f2c800 20 remove_watcher() i=0 2024-09-14T11:12:29.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.254+0000 7f3180f2c800 2 removed watcher, disabling cache 2024-09-14T11:12:29.253 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.255+0000 7f3180f2c800 20 remove_watcher() i=1 2024-09-14T11:12:29.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.256+0000 7f3180f2c800 20 remove_watcher() i=2 2024-09-14T11:12:29.255 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.257+0000 7f3180f2c800 20 remove_watcher() i=3 2024-09-14T11:12:29.256 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.258+0000 7f3180f2c800 20 remove_watcher() i=4 2024-09-14T11:12:29.257 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.259+0000 7f3180f2c800 20 remove_watcher() i=5 2024-09-14T11:12:29.258 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.260+0000 7f3180f2c800 20 remove_watcher() i=6 2024-09-14T11:12:29.259 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.261+0000 7f3180f2c800 20 remove_watcher() i=7 2024-09-14T11:12:29.270 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:29.271 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:12:29.271 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-do-reshard id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:12:29.271 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:29.272 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-14T11:12:29.307 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:29.307 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:29.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.348+0000 7f79f0abb800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.348 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.350+0000 7f79f0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.350+0000 7f79f0abb800 20 realm 2024-09-14T11:12:29.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.350+0000 7f79f0abb800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.350+0000 7f79f0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.350+0000 7f79f0abb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:29.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.350+0000 7f79f0abb800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.350+0000 7f79f0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.350+0000 7f79f0abb800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.350 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.351+0000 7f79f0abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:29.350 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.351+0000 7f79f0abb800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.350 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.352+0000 7f79f0abb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:29.350 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.352+0000 7f79f0abb800 20 searching for the correct realm 2024-09-14T11:12:29.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.355+0000 7f79edda4640 0 -- 172.21.15.50:0/2461842480 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f79e807b970 msgr2=0x7f79e80723f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:12:29.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.561+0000 7f79eeda6640 0 -- 172.21.15.50:0/2461842480 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5638955b94e0 msgr2=0x5638955bb9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:29.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.564+0000 7f79f0abb800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:12:29.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.564+0000 7f79f0abb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:29.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.564+0000 7f79f0abb800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:12:29.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.564+0000 7f79f0abb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:29.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.564+0000 7f79f0abb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:29.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.564+0000 7f79f0abb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:29.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.564+0000 7f79f0abb800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.565+0000 7f79f0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.565+0000 7f79f0abb800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.565+0000 7f79f0abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:29.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.565+0000 7f79f0abb800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.565+0000 7f79f0abb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:29.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.565+0000 7f79f0abb800 20 zone default found 2024-09-14T11:12:29.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.565+0000 7f79f0abb800 4 Realm: () 2024-09-14T11:12:29.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.565+0000 7f79f0abb800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:12:29.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.565+0000 7f79f0abb800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:12:29.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.565+0000 7f79f0abb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:29.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.565+0000 7f79f0abb800 20 zonegroup default 2024-09-14T11:12:29.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.565+0000 7f79f0abb800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.565+0000 7f79f0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.566+0000 7f79f0abb800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.566+0000 7f79f0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.566+0000 7f79f0abb800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.566+0000 7f79f0abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.566+0000 7f79f0abb800 20 started sync module instance, tier type = 2024-09-14T11:12:29.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.566+0000 7f79f0abb800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:12:29.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.575+0000 7f79f0abb800 20 add_watcher() i=0 2024-09-14T11:12:29.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.575+0000 7f79f0abb800 20 add_watcher() i=1 2024-09-14T11:12:29.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.575+0000 7f79f0abb800 20 add_watcher() i=2 2024-09-14T11:12:29.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.575+0000 7f79f0abb800 20 add_watcher() i=3 2024-09-14T11:12:29.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.575+0000 7f79f0abb800 20 add_watcher() i=4 2024-09-14T11:12:29.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.575+0000 7f79f0abb800 20 add_watcher() i=5 2024-09-14T11:12:29.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.575+0000 7f79f0abb800 20 add_watcher() i=6 2024-09-14T11:12:29.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.576+0000 7f79f0abb800 20 add_watcher() i=7 2024-09-14T11:12:29.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.576+0000 7f79f0abb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:29.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.577+0000 7f78a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:29.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.578+0000 7f79f0abb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:29.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.578+0000 7f79f0abb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:29.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.578+0000 7f79f0abb800 5 note: GC not initialized 2024-09-14T11:12:29.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.578+0000 7f781f7fe640 20 reqs_thread_entry: start 2024-09-14T11:12:29.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.578+0000 7f79f0abb800 20 init_complete bucket index max shards: 11 2024-09-14T11:12:29.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.578+0000 7f79f0abb800 20 Filter name: none 2024-09-14T11:12:29.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.578+0000 7f781d7fa640 20 reqs_thread_entry: start 2024-09-14T11:12:29.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.578+0000 7f79f0abb800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:12:29.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.578+0000 7f79f0abb800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.579+0000 7f79f0abb800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:12:29.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.579+0000 7f79f0abb800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:12:29.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.579+0000 7f79f0abb800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:12:29.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.579+0000 7f79f0abb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 : miss 2024-09-14T11:12:29.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.579+0000 7f79f0abb800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.579+0000 7f79f0abb800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:12:29.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.579+0000 7f79f0abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 info.flags=0x17 2024-09-14T11:12:29.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.579+0000 7f79f0abb800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 to cache LRU end 2024-09-14T11:12:29.579 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.579+0000 7f79f0abb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:29.579 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.579+0000 7f79f0abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:29.579 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.579+0000 7f79f0abb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 2024-09-14T11:12:29.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.585+0000 7f79f0abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 info.flags=0x17 2024-09-14T11:12:29.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.585+0000 7f79f0abb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 to cache LRU end 2024-09-14T11:12:29.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.585+0000 7f79f0abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:29.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.585+0000 7f79f0abb800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34, ofs0, ns] 2024-09-14T11:12:29.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.585+0000 7f78d1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497100 cookie 94801023973600 notifier 7503 bl.length()=995 2024-09-14T11:12:29.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.585+0000 7f78d1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 info.flags=0x17 2024-09-14T11:12:29.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.585+0000 7f78d1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 to cache LRU end 2024-09-14T11:12:29.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.585+0000 7f78d1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:29.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.587+0000 7f79f0abb800 20 handle_bi_update(): bucket=:error-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34]): orig_sources= new_sources= 2024-09-14T11:12:29.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.587+0000 7f79f0abb800 20 handle_bi_update(): bucket=:error-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34]): potential sources added=[] removed=[] 2024-09-14T11:12:29.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.587+0000 7f79f0abb800 20 handle_bi_update(): bucket=:error-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34]): orig_dests= new_dests= 2024-09-14T11:12:29.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.587+0000 7f79f0abb800 20 handle_bi_update(): bucket=:error-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34]): potential dests added=[] removed=[] 2024-09-14T11:12:29.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.591+0000 7f79f0abb800 -1 Injecting error=-5 at location=do_reshard 2024-09-14T11:12:29.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.597+0000 7f79f0abb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:12:29.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.597+0000 7f79f0abb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 2024-09-14T11:12:29.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.599+0000 7f79f0abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 info.flags=0x17 2024-09-14T11:12:29.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.599+0000 7f79f0abb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 to cache LRU end 2024-09-14T11:12:29.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.599+0000 7f79f0abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:29.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.599+0000 7f79f0abb800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34, ofs0, ns] 2024-09-14T11:12:29.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.599+0000 7f78d1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497101 cookie 94801023973600 notifier 7503 bl.length()=963 2024-09-14T11:12:29.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.599+0000 7f78d1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 info.flags=0x17 2024-09-14T11:12:29.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.599+0000 7f78d1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 to cache LRU end 2024-09-14T11:12:29.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.599+0000 7f78d1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:29.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.600+0000 7f79f0abb800 20 handle_bi_update(): bucket=:error-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34]): orig_sources= new_sources= 2024-09-14T11:12:29.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.600+0000 7f79f0abb800 20 handle_bi_update(): bucket=:error-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34]): potential sources added=[] removed=[] 2024-09-14T11:12:29.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.600+0000 7f79f0abb800 20 handle_bi_update(): bucket=:error-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34]): orig_dests= new_dests= 2024-09-14T11:12:29.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.600+0000 7f79f0abb800 20 handle_bi_update(): bucket=:error-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34]): potential dests added=[] removed=[] 2024-09-14T11:12:29.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.600+0000 7f79f0abb800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-14T11:12:29.600 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.602+0000 7f78a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:29.603 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.605+0000 7f79f0abb800 20 remove_watcher() i=0 2024-09-14T11:12:29.603 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.605+0000 7f79f0abb800 2 removed watcher, disabling cache 2024-09-14T11:12:29.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.606+0000 7f79f0abb800 20 remove_watcher() i=1 2024-09-14T11:12:29.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.607+0000 7f79f0abb800 20 remove_watcher() i=2 2024-09-14T11:12:29.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.608+0000 7f79f0abb800 20 remove_watcher() i=3 2024-09-14T11:12:29.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.609+0000 7f79f0abb800 20 remove_watcher() i=4 2024-09-14T11:12:29.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.610+0000 7f79f0abb800 20 remove_watcher() i=5 2024-09-14T11:12:29.609 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.611+0000 7f79f0abb800 20 remove_watcher() i=6 2024-09-14T11:12:29.610 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.612+0000 7f79f0abb800 20 remove_watcher() i=7 2024-09-14T11:12:29.623 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:12:29.652 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:29.652 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:29.691 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.693+0000 7f24f07ad800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.694+0000 7f24f07ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.694+0000 7f24f07ad800 20 realm 2024-09-14T11:12:29.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.694+0000 7f24f07ad800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.695+0000 7f24f07ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.695+0000 7f24f07ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:29.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.695+0000 7f24f07ad800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.695+0000 7f24f07ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.695+0000 7f24f07ad800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.694 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.696+0000 7f24f07ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:29.694 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.696+0000 7f24f07ad800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.694 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.696+0000 7f24f07ad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:29.694 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.696+0000 7f24f07ad800 20 searching for the correct realm 2024-09-14T11:12:29.697 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.699+0000 7f24eda96640 0 -- 172.21.15.50:0/2047759800 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f24e807f400 msgr2=0x7f24e807f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:12:29.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.905+0000 7f24ee297640 0 -- 172.21.15.50:0/2047759800 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f24e808c390 msgr2=0x7f24e808c810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:12:29.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.909+0000 7f24f07ad800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:12:29.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.909+0000 7f24f07ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:29.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.909+0000 7f24f07ad800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:12:29.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.909+0000 7f24f07ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:29.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.909+0000 7f24f07ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:29.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.909+0000 7f24f07ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:29.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.909+0000 7f24f07ad800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.910+0000 7f24f07ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.910+0000 7f24f07ad800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.910+0000 7f24f07ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:29.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.910+0000 7f24f07ad800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.910+0000 7f24f07ad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:29.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.910+0000 7f24f07ad800 20 zone default found 2024-09-14T11:12:29.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.910+0000 7f24f07ad800 4 Realm: () 2024-09-14T11:12:29.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.910+0000 7f24f07ad800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:12:29.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.910+0000 7f24f07ad800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:12:29.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.910+0000 7f24f07ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:29.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.910+0000 7f24f07ad800 20 zonegroup default 2024-09-14T11:12:29.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.910+0000 7f24f07ad800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.910+0000 7f24f07ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.910+0000 7f24f07ad800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.911+0000 7f24f07ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.911+0000 7f24f07ad800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.911+0000 7f24f07ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.911+0000 7f24f07ad800 20 started sync module instance, tier type = 2024-09-14T11:12:29.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.911+0000 7f24f07ad800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:12:29.918 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.920+0000 7f24f07ad800 20 add_watcher() i=0 2024-09-14T11:12:29.918 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.920+0000 7f24f07ad800 20 add_watcher() i=1 2024-09-14T11:12:29.918 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.920+0000 7f24f07ad800 20 add_watcher() i=2 2024-09-14T11:12:29.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.920+0000 7f24f07ad800 20 add_watcher() i=3 2024-09-14T11:12:29.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.920+0000 7f24f07ad800 20 add_watcher() i=4 2024-09-14T11:12:29.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.920+0000 7f24f07ad800 20 add_watcher() i=5 2024-09-14T11:12:29.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.921+0000 7f24f07ad800 20 add_watcher() i=6 2024-09-14T11:12:29.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.922+0000 7f24f07ad800 20 add_watcher() i=7 2024-09-14T11:12:29.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.922+0000 7f24f07ad800 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:29.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.923+0000 7f23a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:29.922 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.924+0000 7f24f07ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:29.922 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.924+0000 7f24f07ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:29.923 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.924+0000 7f24f07ad800 5 note: GC not initialized 2024-09-14T11:12:29.923 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.924+0000 7f231f7fe640 20 reqs_thread_entry: start 2024-09-14T11:12:29.923 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.924+0000 7f24f07ad800 20 init_complete bucket index max shards: 11 2024-09-14T11:12:29.923 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.924+0000 7f24f07ad800 20 Filter name: none 2024-09-14T11:12:29.923 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.924+0000 7f231d7fa640 20 reqs_thread_entry: start 2024-09-14T11:12:29.923 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.924+0000 7f24f07ad800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.925+0000 7f24f07ad800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:12:29.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.925+0000 7f24f07ad800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.925+0000 7f24f07ad800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:12:29.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.925+0000 7f24f07ad800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:29.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.925+0000 7f24f07ad800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.926+0000 7f24f07ad800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:12:29.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.926+0000 7f24f07ad800 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.926+0000 7f24f07ad800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:12:29.925 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.926+0000 7f24f07ad800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:29.926 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.928+0000 7f23a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:29.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.930+0000 7f24f07ad800 20 remove_watcher() i=0 2024-09-14T11:12:29.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.930+0000 7f24f07ad800 2 removed watcher, disabling cache 2024-09-14T11:12:29.929 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.931+0000 7f24f07ad800 20 remove_watcher() i=1 2024-09-14T11:12:29.930 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.932+0000 7f24f07ad800 20 remove_watcher() i=2 2024-09-14T11:12:29.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.933+0000 7f24f07ad800 20 remove_watcher() i=3 2024-09-14T11:12:29.933 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.934+0000 7f24f07ad800 20 remove_watcher() i=4 2024-09-14T11:12:29.933 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.934+0000 7f24f07ad800 20 remove_watcher() i=5 2024-09-14T11:12:29.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.935+0000 7f24f07ad800 20 remove_watcher() i=6 2024-09-14T11:12:29.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:29.936+0000 7f24f07ad800 20 remove_watcher() i=7 2024-09-14T11:12:29.946 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:29.946 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:12:29.946 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-do-reshard id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:12:29.946 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:29.948 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:29.948 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:29.981 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:29.981 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:30.038 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:12:30.071 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:30.071 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:30.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.115+0000 7f5d34b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.115 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.116+0000 7f5d34b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:30.115 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.116+0000 7f5d34b2c800 20 realm 2024-09-14T11:12:30.115 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.116+0000 7f5d34b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.115 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.116+0000 7f5d34b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:30.115 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.116+0000 7f5d34b2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:30.115 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.116+0000 7f5d34b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.115 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.117+0000 7f5d34b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:30.115 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.117+0000 7f5d34b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.117+0000 7f5d34b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:30.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.117+0000 7f5d34b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.118+0000 7f5d34b2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:30.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.118+0000 7f5d34b2c800 20 searching for the correct realm 2024-09-14T11:12:30.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.121+0000 7f5d2ff60640 0 -- 172.21.15.50:0/1483484822 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f5d28070d50 msgr2=0x7f5d28070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:30.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.327+0000 7f5d2ff60640 0 -- 172.21.15.50:0/1483484822 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x561bc6e30e50 msgr2=0x561bc6e332a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:30.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.331+0000 7f5d34b2c800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:12:30.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.331+0000 7f5d34b2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:30.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.331+0000 7f5d34b2c800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:12:30.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.331+0000 7f5d34b2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:30.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.331+0000 7f5d34b2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:30.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.331+0000 7f5d34b2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:30.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.331+0000 7f5d34b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.331+0000 7f5d34b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:30.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.331+0000 7f5d34b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.331+0000 7f5d34b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:30.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.331+0000 7f5d34b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.332+0000 7f5d34b2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:30.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.332+0000 7f5d34b2c800 20 zone default found 2024-09-14T11:12:30.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.332+0000 7f5d34b2c800 4 Realm: () 2024-09-14T11:12:30.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.332+0000 7f5d34b2c800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:12:30.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.332+0000 7f5d34b2c800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:12:30.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.332+0000 7f5d34b2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:30.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.332+0000 7f5d34b2c800 20 zonegroup default 2024-09-14T11:12:30.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.332+0000 7f5d34b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.332+0000 7f5d34b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:30.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.332+0000 7f5d34b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.332+0000 7f5d34b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:30.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.332+0000 7f5d34b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.333 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.333+0000 7f5d34b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:30.333 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.333+0000 7f5d34b2c800 20 started sync module instance, tier type = 2024-09-14T11:12:30.333 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.333+0000 7f5d34b2c800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:12:30.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.341+0000 7f5d34b2c800 20 add_watcher() i=0 2024-09-14T11:12:30.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.341+0000 7f5d34b2c800 20 add_watcher() i=1 2024-09-14T11:12:30.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.341+0000 7f5d34b2c800 20 add_watcher() i=2 2024-09-14T11:12:30.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.341+0000 7f5d34b2c800 20 add_watcher() i=3 2024-09-14T11:12:30.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.341+0000 7f5d34b2c800 20 add_watcher() i=4 2024-09-14T11:12:30.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.341+0000 7f5d34b2c800 20 add_watcher() i=5 2024-09-14T11:12:30.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.341+0000 7f5d34b2c800 20 add_watcher() i=6 2024-09-14T11:12:30.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.342+0000 7f5d34b2c800 20 add_watcher() i=7 2024-09-14T11:12:30.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.342+0000 7f5d34b2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:30.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.343+0000 7f5be67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:30.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.344+0000 7f5d34b2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:30.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.344+0000 7f5d34b2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:30.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.344+0000 7f5d34b2c800 5 note: GC not initialized 2024-09-14T11:12:30.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.344+0000 7f5be57e2640 20 reqs_thread_entry: start 2024-09-14T11:12:30.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.344+0000 7f5d34b2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:12:30.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.344+0000 7f5d34b2c800 20 Filter name: none 2024-09-14T11:12:30.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.344+0000 7f5b56ffd640 20 reqs_thread_entry: start 2024-09-14T11:12:30.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.344+0000 7f5d34b2c800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:12:30.343 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.344+0000 7f5d34b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.345+0000 7f5d34b2c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:12:30.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.345+0000 7f5d34b2c800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:12:30.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.345+0000 7f5d34b2c800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:12:30.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.345+0000 7f5d34b2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 : miss 2024-09-14T11:12:30.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.345+0000 7f5d34b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.345+0000 7f5d34b2c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:12:30.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.345+0000 7f5d34b2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 info.flags=0x17 2024-09-14T11:12:30.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.345+0000 7f5d34b2c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 to cache LRU end 2024-09-14T11:12:30.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.345+0000 7f5d34b2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:30.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.345+0000 7f5d34b2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:30.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.345+0000 7f5d34b2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 2024-09-14T11:12:30.348 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.350+0000 7f5d34b2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 info.flags=0x17 2024-09-14T11:12:30.348 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.350+0000 7f5d34b2c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 to cache LRU end 2024-09-14T11:12:30.348 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.350+0000 7f5d34b2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:30.348 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.350+0000 7f5d34b2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34, ofs0, ns] 2024-09-14T11:12:30.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.350+0000 7f5c0effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497102 cookie 94677300880640 notifier 7542 bl.length()=995 2024-09-14T11:12:30.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.350+0000 7f5c0effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 info.flags=0x17 2024-09-14T11:12:30.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.350+0000 7f5c0effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 to cache LRU end 2024-09-14T11:12:30.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.350+0000 7f5c0effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:30.350 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.352+0000 7f5d34b2c800 20 handle_bi_update(): bucket=:error-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34]): orig_sources= new_sources= 2024-09-14T11:12:30.350 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.352+0000 7f5d34b2c800 20 handle_bi_update(): bucket=:error-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34]): potential sources added=[] removed=[] 2024-09-14T11:12:30.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.352+0000 7f5d34b2c800 20 handle_bi_update(): bucket=:error-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34]): orig_dests= new_dests= 2024-09-14T11:12:30.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.352+0000 7f5d34b2c800 20 handle_bi_update(): bucket=:error-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34]): potential dests added=[] removed=[] 2024-09-14T11:12:30.355 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.356+0000 7f5d34b2c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1.0 2024-09-14T11:12:30.355 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.356+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1.0 2024-09-14T11:12:30.355 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.356+0000 7f5d34b2c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1.1 2024-09-14T11:12:30.355 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.356+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1.1 2024-09-14T11:12:30.355 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.356+0000 7f5d34b2c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1.2 2024-09-14T11:12:30.355 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.356+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1.2 2024-09-14T11:12:30.355 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.356+0000 7f5d34b2c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1.3 2024-09-14T11:12:30.355 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.356+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1.3 2024-09-14T11:12:30.355 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.356+0000 7f5d34b2c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1.4 2024-09-14T11:12:30.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.356+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1.4 2024-09-14T11:12:30.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.356+0000 7f5d34b2c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1.5 2024-09-14T11:12:30.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.356+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1.5 2024-09-14T11:12:30.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.356+0000 7f5d34b2c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1.6 2024-09-14T11:12:30.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.356+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1.6 2024-09-14T11:12:30.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.356+0000 7f5d34b2c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1.7 2024-09-14T11:12:30.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.356+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1.7 2024-09-14T11:12:30.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.356+0000 7f5d34b2c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1.8 2024-09-14T11:12:30.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.356+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1.8 2024-09-14T11:12:30.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.356+0000 7f5d34b2c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1.9 2024-09-14T11:12:30.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.356+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1.9 2024-09-14T11:12:30.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.356+0000 7f5d34b2c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1.10 2024-09-14T11:12:30.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.356+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1.10 2024-09-14T11:12:30.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.356+0000 7f5d34b2c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1.11 2024-09-14T11:12:30.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.356+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1.11 2024-09-14T11:12:30.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.357+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.0 2024-09-14T11:12:30.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.357+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1 2024-09-14T11:12:30.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.357+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.2 2024-09-14T11:12:30.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.358+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.3 2024-09-14T11:12:30.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.358+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.4 2024-09-14T11:12:30.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.359+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.5 2024-09-14T11:12:30.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.359+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.6 2024-09-14T11:12:30.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.360+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.7 2024-09-14T11:12:30.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.360+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.8 2024-09-14T11:12:30.359 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.361+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.9 2024-09-14T11:12:30.360 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.362+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.10 2024-09-14T11:12:30.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.365+0000 7f5d34b2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:12:30.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.365+0000 7f5d34b2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 2024-09-14T11:12:30.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.366+0000 7f5d34b2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 info.flags=0x17 2024-09-14T11:12:30.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.366+0000 7f5d34b2c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 to cache LRU end 2024-09-14T11:12:30.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.366+0000 7f5d34b2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:30.365 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.366+0000 7f5d34b2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34, ofs0, ns] 2024-09-14T11:12:30.365 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.366+0000 7f5c0f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497103 cookie 94677300880640 notifier 7542 bl.length()=995 2024-09-14T11:12:30.365 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.366+0000 7f5c0f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 info.flags=0x17 2024-09-14T11:12:30.365 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.366+0000 7f5c0f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 to cache LRU end 2024-09-14T11:12:30.365 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.366+0000 7f5c0f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:30.366 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.368+0000 7f5d34b2c800 20 handle_bi_update(): bucket=:error-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34]): orig_sources= new_sources= 2024-09-14T11:12:30.366 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.368+0000 7f5d34b2c800 20 handle_bi_update(): bucket=:error-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34]): potential sources added=[] removed=[] 2024-09-14T11:12:30.366 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.368+0000 7f5d34b2c800 20 handle_bi_update(): bucket=:error-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34]): orig_dests= new_dests= 2024-09-14T11:12:30.366 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.368+0000 7f5d34b2c800 20 handle_bi_update(): bucket=:error-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34]): potential dests added=[] removed=[] 2024-09-14T11:12:30.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.370+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.0 2024-09-14T11:12:30.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.370+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.1 2024-09-14T11:12:30.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.371+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.2 2024-09-14T11:12:30.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.371+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.3 2024-09-14T11:12:30.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.371+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.4 2024-09-14T11:12:30.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.372+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.5 2024-09-14T11:12:30.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.372+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.6 2024-09-14T11:12:30.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.372+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.7 2024-09-14T11:12:30.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.373+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.8 2024-09-14T11:12:30.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.373+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.9 2024-09-14T11:12:30.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.374+0000 7f5d34b2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34.10 2024-09-14T11:12:30.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.374+0000 7f5d34b2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:12:30.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.374+0000 7f5d34b2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 2024-09-14T11:12:30.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.375+0000 7f5d34b2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 info.flags=0x17 2024-09-14T11:12:30.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.375+0000 7f5d34b2c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 to cache LRU end 2024-09-14T11:12:30.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.375+0000 7f5d34b2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:30.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.375+0000 7f5d34b2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34, ofs0, ns] 2024-09-14T11:12:30.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.376+0000 7f5c0effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497104 cookie 94677300880640 notifier 7542 bl.length()=963 2024-09-14T11:12:30.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.376+0000 7f5c0effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 info.flags=0x17 2024-09-14T11:12:30.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.376+0000 7f5c0effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 to cache LRU end 2024-09-14T11:12:30.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.376+0000 7f5c0effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:30.375 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.377+0000 7f5d34b2c800 20 handle_bi_update(): bucket=:error-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34]): orig_sources= new_sources= 2024-09-14T11:12:30.375 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.377+0000 7f5d34b2c800 20 handle_bi_update(): bucket=:error-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34]): potential sources added=[] removed=[] 2024-09-14T11:12:30.375 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.377+0000 7f5d34b2c800 20 handle_bi_update(): bucket=:error-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34]): orig_dests= new_dests= 2024-09-14T11:12:30.375 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.377+0000 7f5d34b2c800 20 handle_bi_update(): bucket=:error-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34]): potential dests added=[] removed=[] 2024-09-14T11:12:30.378 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.379+0000 7f5d34b2c800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-14T11:12:30.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.381+0000 7f5be67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:30.381 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.383+0000 7f5d34b2c800 20 remove_watcher() i=0 2024-09-14T11:12:30.381 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.383+0000 7f5d34b2c800 2 removed watcher, disabling cache 2024-09-14T11:12:30.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.385+0000 7f5d34b2c800 20 remove_watcher() i=1 2024-09-14T11:12:30.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.386+0000 7f5d34b2c800 20 remove_watcher() i=2 2024-09-14T11:12:30.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.387+0000 7f5d34b2c800 20 remove_watcher() i=3 2024-09-14T11:12:30.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.388+0000 7f5d34b2c800 20 remove_watcher() i=4 2024-09-14T11:12:30.387 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.389+0000 7f5d34b2c800 20 remove_watcher() i=5 2024-09-14T11:12:30.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.390+0000 7f5d34b2c800 20 remove_watcher() i=6 2024-09-14T11:12:30.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.391+0000 7f5d34b2c800 20 remove_watcher() i=7 2024-09-14T11:12:30.403 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:12:30.432 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:30.432 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:30.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.473+0000 7f2a4bd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.473 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.475+0000 7f2a4bd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:30.473 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.475+0000 7f2a4bd3e800 20 realm 2024-09-14T11:12:30.473 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.475+0000 7f2a4bd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.474 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.475+0000 7f2a4bd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:30.474 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.475+0000 7f2a4bd3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:30.474 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.475+0000 7f2a4bd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.474 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.475+0000 7f2a4bd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:30.474 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.475+0000 7f2a4bd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.474 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.476+0000 7f2a4bd3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:30.474 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.476+0000 7f2a4bd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.476+0000 7f2a4bd3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:30.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.476+0000 7f2a4bd3e800 20 searching for the correct realm 2024-09-14T11:12:30.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.479+0000 7f2a472ec640 0 -- 172.21.15.50:0/1791199247 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f2a40019940 msgr2=0x7f2a40029420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:30.684 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.685+0000 7f2a482ee640 0 -- 172.21.15.50:0/1791199247 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55729703ecc0 msgr2=0x557297041130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:30.688 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.689+0000 7f2a4bd3e800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:12:30.688 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.689+0000 7f2a4bd3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:30.688 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.689+0000 7f2a4bd3e800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:12:30.688 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.689+0000 7f2a4bd3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:30.688 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.689+0000 7f2a4bd3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:30.688 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.689+0000 7f2a4bd3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:30.688 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.689+0000 7f2a4bd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.689 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.690+0000 7f2a4bd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:30.689 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.690+0000 7f2a4bd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.689 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.690+0000 7f2a4bd3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:30.689 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.690+0000 7f2a4bd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.691 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.690+0000 7f2a4bd3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:30.692 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.690+0000 7f2a4bd3e800 20 zone default found 2024-09-14T11:12:30.692 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.690+0000 7f2a4bd3e800 4 Realm: () 2024-09-14T11:12:30.692 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.690+0000 7f2a4bd3e800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:12:30.692 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.690+0000 7f2a4bd3e800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:12:30.692 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.690+0000 7f2a4bd3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:30.692 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.690+0000 7f2a4bd3e800 20 zonegroup default 2024-09-14T11:12:30.692 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.690+0000 7f2a4bd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.691+0000 7f2a4bd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:30.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.691+0000 7f2a4bd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.691+0000 7f2a4bd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:30.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.691+0000 7f2a4bd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.691+0000 7f2a4bd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:30.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.691+0000 7f2a4bd3e800 20 started sync module instance, tier type = 2024-09-14T11:12:30.693 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.691+0000 7f2a4bd3e800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:12:30.699 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.700+0000 7f2a4bd3e800 20 add_watcher() i=0 2024-09-14T11:12:30.699 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.700+0000 7f2a4bd3e800 20 add_watcher() i=1 2024-09-14T11:12:30.699 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.700+0000 7f2a4bd3e800 20 add_watcher() i=2 2024-09-14T11:12:30.699 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.700+0000 7f2a4bd3e800 20 add_watcher() i=3 2024-09-14T11:12:30.699 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.700+0000 7f2a4bd3e800 20 add_watcher() i=4 2024-09-14T11:12:30.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.700+0000 7f2a4bd3e800 20 add_watcher() i=5 2024-09-14T11:12:30.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.700+0000 7f2a4bd3e800 20 add_watcher() i=6 2024-09-14T11:12:30.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.701+0000 7f2a4bd3e800 20 add_watcher() i=7 2024-09-14T11:12:30.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.701+0000 7f2a4bd3e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:30.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.703+0000 7f28fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:30.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.703+0000 7f2a4bd3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:30.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.703+0000 7f2a4bd3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:30.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.703+0000 7f2a4bd3e800 5 note: GC not initialized 2024-09-14T11:12:30.705 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.704+0000 7f28fcfe1640 20 reqs_thread_entry: start 2024-09-14T11:12:30.705 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.704+0000 7f2a4bd3e800 20 init_complete bucket index max shards: 11 2024-09-14T11:12:30.705 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.704+0000 7f2a4bd3e800 20 Filter name: none 2024-09-14T11:12:30.705 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.704+0000 7f28767fc640 20 reqs_thread_entry: start 2024-09-14T11:12:30.705 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.704+0000 7f2a4bd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.706 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.704+0000 7f2a4bd3e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:12:30.706 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.704+0000 7f2a4bd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.706 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.705+0000 7f2a4bd3e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:12:30.706 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.705+0000 7f2a4bd3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:30.706 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.705+0000 7f2a4bd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.706 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.705+0000 7f2a4bd3e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:12:30.707 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.705+0000 7f2a4bd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.707 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.706+0000 7f2a4bd3e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:12:30.707 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.706+0000 7f2a4bd3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:30.707 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.708+0000 7f28fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:30.709 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.710+0000 7f2a4bd3e800 20 remove_watcher() i=0 2024-09-14T11:12:30.709 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.711+0000 7f2a4bd3e800 2 removed watcher, disabling cache 2024-09-14T11:12:30.710 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.712+0000 7f2a4bd3e800 20 remove_watcher() i=1 2024-09-14T11:12:30.710 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.712+0000 7f2a4bd3e800 20 remove_watcher() i=2 2024-09-14T11:12:30.713 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.714+0000 7f2a4bd3e800 20 remove_watcher() i=3 2024-09-14T11:12:30.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.716+0000 7f2a4bd3e800 20 remove_watcher() i=4 2024-09-14T11:12:30.715 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.717+0000 7f2a4bd3e800 20 remove_watcher() i=5 2024-09-14T11:12:30.716 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.718+0000 7f2a4bd3e800 20 remove_watcher() i=6 2024-09-14T11:12:30.717 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:30.719+0000 7f2a4bd3e800 20 remove_watcher() i=7 2024-09-14T11:12:30.729 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:30.729 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:12:30.729 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-do-reshard id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:12:30.729 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:30.731 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:30.731 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:30.752 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:30.752 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:30.975 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:30.975 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:31.110 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-14T11:12:31.110 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:31.111 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:31.111 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:31.161 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:31.161 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:31.219 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:31.219 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:31.258 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:31.258 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:31.294 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:31.294 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:31.332 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:31.332 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:31.372 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:31.372 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:31.415 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:31.415 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:31.451 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:31.451 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:31.489 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:31.489 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:31.527 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:31.528 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:31.564 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:31.564 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:31.600 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:31.601 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:31.637 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:31.638 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:31.675 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:31.676 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:31.714 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:31.714 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:31.751 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:31.751 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:31.787 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:31.788 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:31.825 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:31.826 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:31.861 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:31.861 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:31.898 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:31.898 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:31.934 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:31.934 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:31.972 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:12:32.001 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:32.001 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:32.039 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.041+0000 7f5705e87800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.041 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.043+0000 7f5705e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.041 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.043+0000 7f5705e87800 20 realm 2024-09-14T11:12:32.041 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.043+0000 7f5705e87800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.043+0000 7f5705e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.043+0000 7f5705e87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:32.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.043+0000 7f5705e87800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.043+0000 7f5705e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.043+0000 7f5705e87800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.044+0000 7f5705e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:32.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.044+0000 7f5705e87800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.043 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.045+0000 7f5705e87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:32.043 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.045+0000 7f5705e87800 20 searching for the correct realm 2024-09-14T11:12:32.045 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.047+0000 7f5703170640 0 -- 172.21.15.50:0/3905829790 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f56fc017020 msgr2=0x7f56fc041910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:32.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.252+0000 7f5704172640 0 -- 172.21.15.50:0/3905829790 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55a0d47e67e0 msgr2=0x55a0d47e8c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:32.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.256+0000 7f5705e87800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:12:32.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.256+0000 7f5705e87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:32.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.256+0000 7f5705e87800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:12:32.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.256+0000 7f5705e87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:32.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.256+0000 7f5705e87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:32.255 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.256+0000 7f5705e87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:32.255 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.256+0000 7f5705e87800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.255 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.256+0000 7f5705e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.255 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.256+0000 7f5705e87800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.256 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.257+0000 7f5705e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:32.256 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.257+0000 7f5705e87800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.256 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.257+0000 7f5705e87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:32.256 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.257+0000 7f5705e87800 20 zone default found 2024-09-14T11:12:32.256 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.257+0000 7f5705e87800 4 Realm: () 2024-09-14T11:12:32.256 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.257+0000 7f5705e87800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:12:32.256 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.257+0000 7f5705e87800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:12:32.256 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.257+0000 7f5705e87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:32.256 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.257+0000 7f5705e87800 20 zonegroup default 2024-09-14T11:12:32.256 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.257+0000 7f5705e87800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.257 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.257+0000 7f5705e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.257 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.257+0000 7f5705e87800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.257 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.257+0000 7f5705e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.257 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.257+0000 7f5705e87800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.257 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.258+0000 7f5705e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.257 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.258+0000 7f5705e87800 20 started sync module instance, tier type = 2024-09-14T11:12:32.257 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.258+0000 7f5705e87800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:12:32.264 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.266+0000 7f5705e87800 20 add_watcher() i=0 2024-09-14T11:12:32.264 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.266+0000 7f5705e87800 20 add_watcher() i=1 2024-09-14T11:12:32.264 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.266+0000 7f5705e87800 20 add_watcher() i=2 2024-09-14T11:12:32.264 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.266+0000 7f5705e87800 20 add_watcher() i=3 2024-09-14T11:12:32.264 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.266+0000 7f5705e87800 20 add_watcher() i=4 2024-09-14T11:12:32.264 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.266+0000 7f5705e87800 20 add_watcher() i=5 2024-09-14T11:12:32.265 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.266+0000 7f5705e87800 20 add_watcher() i=6 2024-09-14T11:12:32.265 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.267+0000 7f5705e87800 20 add_watcher() i=7 2024-09-14T11:12:32.265 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.267+0000 7f5705e87800 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:32.268 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.270+0000 7f55b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:32.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.270+0000 7f5705e87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:32.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.270+0000 7f5705e87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:32.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.271+0000 7f5705e87800 5 note: GC not initialized 2024-09-14T11:12:32.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.271+0000 7f55b8fe1640 20 reqs_thread_entry: start 2024-09-14T11:12:32.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.271+0000 7f5705e87800 20 init_complete bucket index max shards: 11 2024-09-14T11:12:32.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.271+0000 7f5705e87800 20 Filter name: none 2024-09-14T11:12:32.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.271+0000 7f55327fc640 20 reqs_thread_entry: start 2024-09-14T11:12:32.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.271+0000 7f5705e87800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.271+0000 7f5705e87800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:12:32.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.271+0000 7f5705e87800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.272+0000 7f5705e87800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:12:32.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.272+0000 7f5705e87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:32.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.272+0000 7f5705e87800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.272+0000 7f5705e87800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:12:32.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.272+0000 7f5705e87800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.273+0000 7f5705e87800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:12:32.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.273+0000 7f5705e87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:32.273 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.275+0000 7f55b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:32.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.277+0000 7f5705e87800 20 remove_watcher() i=0 2024-09-14T11:12:32.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.277+0000 7f5705e87800 2 removed watcher, disabling cache 2024-09-14T11:12:32.276 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.278+0000 7f5705e87800 20 remove_watcher() i=1 2024-09-14T11:12:32.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.279+0000 7f5705e87800 20 remove_watcher() i=2 2024-09-14T11:12:32.278 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.280+0000 7f5705e87800 20 remove_watcher() i=3 2024-09-14T11:12:32.279 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.281+0000 7f5705e87800 20 remove_watcher() i=4 2024-09-14T11:12:32.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.282+0000 7f5705e87800 20 remove_watcher() i=5 2024-09-14T11:12:32.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.283+0000 7f5705e87800 20 remove_watcher() i=6 2024-09-14T11:12:32.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.284+0000 7f5705e87800 20 remove_watcher() i=7 2024-09-14T11:12:32.293 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.293 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:12:32.293 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: abort-at-do-reshard id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:12:32.294 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.295 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:12:32.330 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:32.330 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:32.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.372+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.373+0000 7fed52d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.373+0000 7fed52d40800 20 realm 2024-09-14T11:12:32.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.373+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.373+0000 7fed52d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.373+0000 7fed52d40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:32.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.373+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.373+0000 7fed52d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.373+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.374+0000 7fed52d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:32.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.374+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.375+0000 7fed52d40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:32.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.375+0000 7fed52d40800 20 searching for the correct realm 2024-09-14T11:12:32.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.376+0000 7fed4ea86640 0 -- 172.21.15.50:0/3993628404 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x561350b3d4f0 msgr2=0x7fed4800a3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:32.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.582+0000 7fed4f287640 0 -- 172.21.15.50:0/3993628404 >> [v2:172.21.15.118:6826/1082138742,v1:172.21.15.118:6827/1082138742] conn(0x7fed400a2040 msgr2=0x7fed40071890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:32.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.790+0000 7fed52d40800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:12:32.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.791+0000 7fed52d40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:32.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.791+0000 7fed52d40800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:12:32.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.791+0000 7fed52d40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:32.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.791+0000 7fed52d40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:32.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.791+0000 7fed52d40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:32.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.791+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.791+0000 7fed52d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.791+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.791+0000 7fed52d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:32.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.791+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.792+0000 7fed52d40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:32.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.792+0000 7fed52d40800 20 zone default found 2024-09-14T11:12:32.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.792+0000 7fed52d40800 4 Realm: () 2024-09-14T11:12:32.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.792+0000 7fed52d40800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:12:32.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.792+0000 7fed52d40800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:12:32.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.792+0000 7fed52d40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:32.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.792+0000 7fed52d40800 20 zonegroup default 2024-09-14T11:12:32.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.792+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.792+0000 7fed52d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.792+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.792+0000 7fed52d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.792+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.793+0000 7fed52d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.793+0000 7fed52d40800 20 started sync module instance, tier type = 2024-09-14T11:12:32.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.793+0000 7fed52d40800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:12:32.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.802+0000 7fed52d40800 20 add_watcher() i=0 2024-09-14T11:12:32.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.802+0000 7fed52d40800 20 add_watcher() i=1 2024-09-14T11:12:32.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.802+0000 7fed52d40800 20 add_watcher() i=2 2024-09-14T11:12:32.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.802+0000 7fed52d40800 20 add_watcher() i=3 2024-09-14T11:12:32.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.802+0000 7fed52d40800 20 add_watcher() i=4 2024-09-14T11:12:32.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.802+0000 7fed52d40800 20 add_watcher() i=5 2024-09-14T11:12:32.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.802+0000 7fed52d40800 20 add_watcher() i=6 2024-09-14T11:12:32.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.803+0000 7fed52d40800 20 add_watcher() i=7 2024-09-14T11:12:32.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.803+0000 7fed52d40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:32.803 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.804+0000 7fec057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:32.803 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.805+0000 7fed52d40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:32.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.805+0000 7fed52d40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:32.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.805+0000 7fed52d40800 5 note: GC not initialized 2024-09-14T11:12:32.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.805+0000 7feb7ffff640 20 reqs_thread_entry: start 2024-09-14T11:12:32.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.805+0000 7fed52d40800 20 init_complete bucket index max shards: 11 2024-09-14T11:12:32.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.805+0000 7fed52d40800 20 Filter name: none 2024-09-14T11:12:32.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.805+0000 7feb7dffb640 20 reqs_thread_entry: start 2024-09-14T11:12:32.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.805+0000 7fed52d40800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:12:32.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.805+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.806+0000 7fed52d40800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:12:32.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.806+0000 7fed52d40800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:12:32.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.806+0000 7fed52d40800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:12:32.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.806+0000 7fed52d40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 : miss 2024-09-14T11:12:32.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.806+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.806+0000 7fed52d40800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:12:32.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.806+0000 7fed52d40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 info.flags=0x17 2024-09-14T11:12:32.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.806+0000 7fed52d40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 to cache LRU end 2024-09-14T11:12:32.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.806+0000 7fed52d40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:32.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.806+0000 7fed52d40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:32.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.806+0000 7fed52d40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 2024-09-14T11:12:32.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.812+0000 7fed52d40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 info.flags=0x17 2024-09-14T11:12:32.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.812+0000 7fed52d40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 to cache LRU end 2024-09-14T11:12:32.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.812+0000 7fed52d40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:32.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.812+0000 7fed52d40800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35, ofs0, ns] 2024-09-14T11:12:32.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.812+0000 7fec31ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496985 cookie 94640960754832 notifier 7596 bl.length()=995 2024-09-14T11:12:32.811 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.812+0000 7fec31ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 info.flags=0x17 2024-09-14T11:12:32.811 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.812+0000 7fec31ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 to cache LRU end 2024-09-14T11:12:32.811 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.812+0000 7fec31ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:32.812 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.814+0000 7fed52d40800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35]): orig_sources= new_sources= 2024-09-14T11:12:32.812 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.814+0000 7fed52d40800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35]): potential sources added=[] removed=[] 2024-09-14T11:12:32.813 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.814+0000 7fed52d40800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35]): orig_dests= new_dests= 2024-09-14T11:12:32.813 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.814+0000 7fed52d40800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35]): potential dests added=[] removed=[] 2024-09-14T11:12:32.817 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fed52d40800 time 2024-09-14T11:12:32.820116+0000 2024-09-14T11:12:32.817 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:12:32.818 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:12:32.818 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fed5458c76a] 2024-09-14T11:12:32.818 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fed5458c928] 2024-09-14T11:12:32.818 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56134ef050b1] 2024-09-14T11:12:32.819 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56134ef14f6a] 2024-09-14T11:12:32.819 INFO:tasks.workunit.client.0.smithi050.stderr: 5: main() 2024-09-14T11:12:32.819 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fed53229590] 2024-09-14T11:12:32.819 INFO:tasks.workunit.client.0.smithi050.stderr: 7: __libc_start_main() 2024-09-14T11:12:32.819 INFO:tasks.workunit.client.0.smithi050.stderr: 8: _start() 2024-09-14T11:12:32.819 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.820+0000 7fed52d40800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fed52d40800 time 2024-09-14T11:12:32.820116+0000 2024-09-14T11:12:32.819 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:12:32.819 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.819 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:12:32.819 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fed5458c76a] 2024-09-14T11:12:32.819 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fed5458c928] 2024-09-14T11:12:32.820 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56134ef050b1] 2024-09-14T11:12:32.820 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56134ef14f6a] 2024-09-14T11:12:32.820 INFO:tasks.workunit.client.0.smithi050.stderr: 5: main() 2024-09-14T11:12:32.820 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fed53229590] 2024-09-14T11:12:32.820 INFO:tasks.workunit.client.0.smithi050.stderr: 7: __libc_start_main() 2024-09-14T11:12:32.820 INFO:tasks.workunit.client.0.smithi050.stderr: 8: _start() 2024-09-14T11:12:32.820 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.820 INFO:tasks.workunit.client.0.smithi050.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:12:32.820 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7fed52d40800 thread_name:radosgw-admin 2024-09-14T11:12:32.837 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:12:32.837 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fed5323e6f0] 2024-09-14T11:12:32.838 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fed5328b99c] 2024-09-14T11:12:32.838 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:12:32.838 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:12:32.838 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fed5458c7c4] 2024-09-14T11:12:32.838 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fed5458c928] 2024-09-14T11:12:32.838 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56134ef050b1] 2024-09-14T11:12:32.838 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56134ef14f6a] 2024-09-14T11:12:32.838 INFO:tasks.workunit.client.0.smithi050.stderr: 9: main() 2024-09-14T11:12:32.838 INFO:tasks.workunit.client.0.smithi050.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fed53229590] 2024-09-14T11:12:32.838 INFO:tasks.workunit.client.0.smithi050.stderr: 11: __libc_start_main() 2024-09-14T11:12:32.838 INFO:tasks.workunit.client.0.smithi050.stderr: 12: _start() 2024-09-14T11:12:32.838 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.821+0000 7fed52d40800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:12:32.838 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7fed52d40800 thread_name:radosgw-admin 2024-09-14T11:12:32.839 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.839 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:12:32.839 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fed5323e6f0] 2024-09-14T11:12:32.839 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fed5328b99c] 2024-09-14T11:12:32.839 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:12:32.839 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:12:32.839 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fed5458c7c4] 2024-09-14T11:12:32.839 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fed5458c928] 2024-09-14T11:12:32.839 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56134ef050b1] 2024-09-14T11:12:32.839 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56134ef14f6a] 2024-09-14T11:12:32.839 INFO:tasks.workunit.client.0.smithi050.stderr: 9: main() 2024-09-14T11:12:32.839 INFO:tasks.workunit.client.0.smithi050.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fed53229590] 2024-09-14T11:12:32.840 INFO:tasks.workunit.client.0.smithi050.stderr: 11: __libc_start_main() 2024-09-14T11:12:32.840 INFO:tasks.workunit.client.0.smithi050.stderr: 12: _start() 2024-09-14T11:12:32.840 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:12:32.840 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.840 INFO:tasks.workunit.client.0.smithi050.stderr:--- begin dump of recent events --- 2024-09-14T11:12:32.840 INFO:tasks.workunit.client.0.smithi050.stderr: -499> 2024-09-14T11:12:32.354+0000 7fed4ea86640 1 monclient: found mon.noname-a 2024-09-14T11:12:32.840 INFO:tasks.workunit.client.0.smithi050.stderr: -498> 2024-09-14T11:12:32.354+0000 7fed4ea86640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:12:32.840 INFO:tasks.workunit.client.0.smithi050.stderr: -497> 2024-09-14T11:12:32.354+0000 7fec3ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:12:32.840 INFO:tasks.workunit.client.0.smithi050.stderr: -496> 2024-09-14T11:12:32.354+0000 7fec3ce09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:12:32.840 INFO:tasks.workunit.client.0.smithi050.stderr: -495> 2024-09-14T11:12:32.354+0000 7fec3ce09640 10 monclient: dump: 2024-09-14T11:12:32.840 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:12:32.840 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:12:32.840 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.840 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.841 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:12:32.841 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.841 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:12:32.841 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:12:32.841 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:12:32.841 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.841 INFO:tasks.workunit.client.0.smithi050.stderr: -494> 2024-09-14T11:12:32.354+0000 7fec3ce09640 10 monclient: _finish_auth 0 2024-09-14T11:12:32.841 INFO:tasks.workunit.client.0.smithi050.stderr: -493> 2024-09-14T11:12:32.354+0000 7fec3ce09640 10 monclient: _check_auth_tickets 2024-09-14T11:12:32.841 INFO:tasks.workunit.client.0.smithi050.stderr: -492> 2024-09-14T11:12:32.354+0000 7fec3ce09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:12:32.841 INFO:tasks.workunit.client.0.smithi050.stderr: -491> 2024-09-14T11:12:32.354+0000 7fec3ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:12:32.841 INFO:tasks.workunit.client.0.smithi050.stderr: -490> 2024-09-14T11:12:32.354+0000 7fec3ce09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:12:32.841 INFO:tasks.workunit.client.0.smithi050.stderr: -489> 2024-09-14T11:12:32.354+0000 7fec3ce09640 10 monclient: dump: 2024-09-14T11:12:32.841 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:12:32.842 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:12:32.842 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.842 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.842 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:12:32.842 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.842 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:12:32.842 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:12:32.842 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:12:32.842 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.842 INFO:tasks.workunit.client.0.smithi050.stderr: -488> 2024-09-14T11:12:32.354+0000 7fed52d40800 5 monclient: authenticate success, global_id 7584 2024-09-14T11:12:32.842 INFO:tasks.workunit.client.0.smithi050.stderr: -487> 2024-09-14T11:12:32.354+0000 7fed52d40800 10 monclient: get_monmap_and_config success 2024-09-14T11:12:32.842 INFO:tasks.workunit.client.0.smithi050.stderr: -486> 2024-09-14T11:12:32.354+0000 7fed52d40800 4 set_mon_vals no callback set 2024-09-14T11:12:32.842 INFO:tasks.workunit.client.0.smithi050.stderr: -485> 2024-09-14T11:12:32.354+0000 7fed52d40800 10 monclient: shutdown 2024-09-14T11:12:32.842 INFO:tasks.workunit.client.0.smithi050.stderr: -484> 2024-09-14T11:12:32.354+0000 7fed52d40800 5 asok(0x561350a71270) unregister_commands rotate-key 2024-09-14T11:12:32.842 INFO:tasks.workunit.client.0.smithi050.stderr: -483> 2024-09-14T11:12:32.355+0000 7fed52d40800 10 monclient: build_initial_monmap 2024-09-14T11:12:32.843 INFO:tasks.workunit.client.0.smithi050.stderr: -482> 2024-09-14T11:12:32.355+0000 7fed52d40800 1 build_initial for_mkfs: 0 2024-09-14T11:12:32.843 INFO:tasks.workunit.client.0.smithi050.stderr: -481> 2024-09-14T11:12:32.355+0000 7fed52d40800 10 monclient: monmap: 2024-09-14T11:12:32.843 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:12:32.843 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:12:32.843 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:12:32.843 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:12:32.843 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:12:32.843 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.843 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:12:32.843 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:12:32.843 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:12:32.843 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.843 INFO:tasks.workunit.client.0.smithi050.stderr: -480> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding auth protocol: cephx 2024-09-14T11:12:32.843 INFO:tasks.workunit.client.0.smithi050.stderr: -479> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding auth protocol: cephx 2024-09-14T11:12:32.843 INFO:tasks.workunit.client.0.smithi050.stderr: -478> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding auth protocol: cephx 2024-09-14T11:12:32.844 INFO:tasks.workunit.client.0.smithi050.stderr: -477> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding con mode: secure 2024-09-14T11:12:32.844 INFO:tasks.workunit.client.0.smithi050.stderr: -476> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding con mode: crc 2024-09-14T11:12:32.844 INFO:tasks.workunit.client.0.smithi050.stderr: -475> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding con mode: secure 2024-09-14T11:12:32.844 INFO:tasks.workunit.client.0.smithi050.stderr: -474> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding con mode: crc 2024-09-14T11:12:32.844 INFO:tasks.workunit.client.0.smithi050.stderr: -473> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding con mode: secure 2024-09-14T11:12:32.844 INFO:tasks.workunit.client.0.smithi050.stderr: -472> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding con mode: crc 2024-09-14T11:12:32.844 INFO:tasks.workunit.client.0.smithi050.stderr: -471> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding con mode: crc 2024-09-14T11:12:32.844 INFO:tasks.workunit.client.0.smithi050.stderr: -470> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding con mode: secure 2024-09-14T11:12:32.844 INFO:tasks.workunit.client.0.smithi050.stderr: -469> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding con mode: crc 2024-09-14T11:12:32.844 INFO:tasks.workunit.client.0.smithi050.stderr: -468> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding con mode: secure 2024-09-14T11:12:32.844 INFO:tasks.workunit.client.0.smithi050.stderr: -467> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding con mode: crc 2024-09-14T11:12:32.844 INFO:tasks.workunit.client.0.smithi050.stderr: -466> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding con mode: secure 2024-09-14T11:12:32.844 INFO:tasks.workunit.client.0.smithi050.stderr: -465> 2024-09-14T11:12:32.355+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.845 INFO:tasks.workunit.client.0.smithi050.stderr: -464> 2024-09-14T11:12:32.355+0000 7fed52d40800 1 librados: starting msgr at 2024-09-14T11:12:32.845 INFO:tasks.workunit.client.0.smithi050.stderr: -463> 2024-09-14T11:12:32.355+0000 7fed52d40800 1 librados: starting objecter 2024-09-14T11:12:32.845 INFO:tasks.workunit.client.0.smithi050.stderr: -462> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 asok(0x561350a71270) register_command objecter_requests hook 0x561350cba380 2024-09-14T11:12:32.845 INFO:tasks.workunit.client.0.smithi050.stderr: -461> 2024-09-14T11:12:32.355+0000 7fed52d40800 1 librados: setting wanted keys 2024-09-14T11:12:32.845 INFO:tasks.workunit.client.0.smithi050.stderr: -460> 2024-09-14T11:12:32.355+0000 7fed52d40800 1 librados: calling monclient init 2024-09-14T11:12:32.845 INFO:tasks.workunit.client.0.smithi050.stderr: -459> 2024-09-14T11:12:32.355+0000 7fed52d40800 10 monclient: init 2024-09-14T11:12:32.845 INFO:tasks.workunit.client.0.smithi050.stderr: -458> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding auth protocol: cephx 2024-09-14T11:12:32.845 INFO:tasks.workunit.client.0.smithi050.stderr: -457> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding auth protocol: cephx 2024-09-14T11:12:32.845 INFO:tasks.workunit.client.0.smithi050.stderr: -456> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding auth protocol: cephx 2024-09-14T11:12:32.845 INFO:tasks.workunit.client.0.smithi050.stderr: -455> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding con mode: secure 2024-09-14T11:12:32.845 INFO:tasks.workunit.client.0.smithi050.stderr: -454> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding con mode: crc 2024-09-14T11:12:32.845 INFO:tasks.workunit.client.0.smithi050.stderr: -453> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding con mode: secure 2024-09-14T11:12:32.845 INFO:tasks.workunit.client.0.smithi050.stderr: -452> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding con mode: crc 2024-09-14T11:12:32.845 INFO:tasks.workunit.client.0.smithi050.stderr: -451> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding con mode: secure 2024-09-14T11:12:32.845 INFO:tasks.workunit.client.0.smithi050.stderr: -450> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding con mode: crc 2024-09-14T11:12:32.846 INFO:tasks.workunit.client.0.smithi050.stderr: -449> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding con mode: crc 2024-09-14T11:12:32.846 INFO:tasks.workunit.client.0.smithi050.stderr: -448> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding con mode: secure 2024-09-14T11:12:32.846 INFO:tasks.workunit.client.0.smithi050.stderr: -447> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding con mode: crc 2024-09-14T11:12:32.846 INFO:tasks.workunit.client.0.smithi050.stderr: -446> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding con mode: secure 2024-09-14T11:12:32.846 INFO:tasks.workunit.client.0.smithi050.stderr: -445> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding con mode: crc 2024-09-14T11:12:32.846 INFO:tasks.workunit.client.0.smithi050.stderr: -444> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding con mode: secure 2024-09-14T11:12:32.846 INFO:tasks.workunit.client.0.smithi050.stderr: -443> 2024-09-14T11:12:32.355+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.846 INFO:tasks.workunit.client.0.smithi050.stderr: -442> 2024-09-14T11:12:32.356+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.846 INFO:tasks.workunit.client.0.smithi050.stderr: -441> 2024-09-14T11:12:32.356+0000 7fed52d40800 5 asok(0x561350a71270) register_command rotate-key hook 0x561350c90838 2024-09-14T11:12:32.846 INFO:tasks.workunit.client.0.smithi050.stderr: -440> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient: _reopen_session rank -1 2024-09-14T11:12:32.846 INFO:tasks.workunit.client.0.smithi050.stderr: -439> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:12:32.846 INFO:tasks.workunit.client.0.smithi050.stderr: -438> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient(hunting): picked mon.noname-b con 0x561350c93ca0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:12:32.846 INFO:tasks.workunit.client.0.smithi050.stderr: -437> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient(hunting): picked mon.noname-a con 0x561350cc26c0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:12:32.846 INFO:tasks.workunit.client.0.smithi050.stderr: -436> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient(hunting): picked mon.noname-c con 0x7fed3c003b70 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:12:32.846 INFO:tasks.workunit.client.0.smithi050.stderr: -435> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:12:32.847 INFO:tasks.workunit.client.0.smithi050.stderr: -434> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:12:32.847 INFO:tasks.workunit.client.0.smithi050.stderr: -433> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:12:32.847 INFO:tasks.workunit.client.0.smithi050.stderr: -432> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient(hunting): _renew_subs 2024-09-14T11:12:32.847 INFO:tasks.workunit.client.0.smithi050.stderr: -431> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient(hunting): authenticate will time out at 2404.993165s 2024-09-14T11:12:32.847 INFO:tasks.workunit.client.0.smithi050.stderr: -430> 2024-09-14T11:12:32.356+0000 7fed4f287640 10 monclient(hunting): get_auth_request con 0x7fed3c003b70 auth_method 0 2024-09-14T11:12:32.847 INFO:tasks.workunit.client.0.smithi050.stderr: -429> 2024-09-14T11:12:32.356+0000 7fed4f287640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:12:32.847 INFO:tasks.workunit.client.0.smithi050.stderr: -428> 2024-09-14T11:12:32.356+0000 7fed4f287640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:12:32.847 INFO:tasks.workunit.client.0.smithi050.stderr: -427> 2024-09-14T11:12:32.356+0000 7fed4f287640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:12:32.847 INFO:tasks.workunit.client.0.smithi050.stderr: -426> 2024-09-14T11:12:32.356+0000 7fed47fff640 10 monclient(hunting): get_auth_request con 0x561350cc26c0 auth_method 0 2024-09-14T11:12:32.847 INFO:tasks.workunit.client.0.smithi050.stderr: -425> 2024-09-14T11:12:32.356+0000 7fed47fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:12:32.847 INFO:tasks.workunit.client.0.smithi050.stderr: -424> 2024-09-14T11:12:32.356+0000 7fed47fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:12:32.847 INFO:tasks.workunit.client.0.smithi050.stderr: -423> 2024-09-14T11:12:32.356+0000 7fed47fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:12:32.847 INFO:tasks.workunit.client.0.smithi050.stderr: -422> 2024-09-14T11:12:32.356+0000 7fed4f287640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:12:32.847 INFO:tasks.workunit.client.0.smithi050.stderr: -421> 2024-09-14T11:12:32.356+0000 7fed4f287640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:12:32.848 INFO:tasks.workunit.client.0.smithi050.stderr: -420> 2024-09-14T11:12:32.356+0000 7fed4f287640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:12:32.848 INFO:tasks.workunit.client.0.smithi050.stderr: -419> 2024-09-14T11:12:32.356+0000 7fed47fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:12:32.848 INFO:tasks.workunit.client.0.smithi050.stderr: -418> 2024-09-14T11:12:32.356+0000 7fed47fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:12:32.848 INFO:tasks.workunit.client.0.smithi050.stderr: -417> 2024-09-14T11:12:32.356+0000 7fed47fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:12:32.848 INFO:tasks.workunit.client.0.smithi050.stderr: -416> 2024-09-14T11:12:32.356+0000 7fed4ea86640 10 monclient(hunting): get_auth_request con 0x561350c93ca0 auth_method 0 2024-09-14T11:12:32.848 INFO:tasks.workunit.client.0.smithi050.stderr: -415> 2024-09-14T11:12:32.356+0000 7fed4ea86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:12:32.848 INFO:tasks.workunit.client.0.smithi050.stderr: -414> 2024-09-14T11:12:32.356+0000 7fed4ea86640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:12:32.848 INFO:tasks.workunit.client.0.smithi050.stderr: -413> 2024-09-14T11:12:32.356+0000 7fed4ea86640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:12:32.848 INFO:tasks.workunit.client.0.smithi050.stderr: -412> 2024-09-14T11:12:32.356+0000 7fed4f287640 10 monclient(hunting): handle_auth_done global_id 7121 payload 824 2024-09-14T11:12:32.848 INFO:tasks.workunit.client.0.smithi050.stderr: -411> 2024-09-14T11:12:32.356+0000 7fed4f287640 10 monclient: _finish_hunting 0 2024-09-14T11:12:32.848 INFO:tasks.workunit.client.0.smithi050.stderr: -410> 2024-09-14T11:12:32.356+0000 7fed4f287640 1 monclient: found mon.noname-c 2024-09-14T11:12:32.848 INFO:tasks.workunit.client.0.smithi050.stderr: -409> 2024-09-14T11:12:32.356+0000 7fed4f287640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:12:32.848 INFO:tasks.workunit.client.0.smithi050.stderr: -408> 2024-09-14T11:12:32.356+0000 7fec3b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:12:32.848 INFO:tasks.workunit.client.0.smithi050.stderr: -407> 2024-09-14T11:12:32.356+0000 7fec3b606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:12:32.849 INFO:tasks.workunit.client.0.smithi050.stderr: -406> 2024-09-14T11:12:32.356+0000 7fec3b606640 10 monclient: dump: 2024-09-14T11:12:32.849 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:12:32.849 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:12:32.849 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.849 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.849 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:12:32.849 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.849 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:12:32.849 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:12:32.849 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:12:32.849 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.849 INFO:tasks.workunit.client.0.smithi050.stderr: -405> 2024-09-14T11:12:32.356+0000 7fec3b606640 10 monclient: _finish_auth 0 2024-09-14T11:12:32.850 INFO:tasks.workunit.client.0.smithi050.stderr: -404> 2024-09-14T11:12:32.356+0000 7fec3b606640 10 monclient: _check_auth_tickets 2024-09-14T11:12:32.850 INFO:tasks.workunit.client.0.smithi050.stderr: -403> 2024-09-14T11:12:32.356+0000 7fec3b606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:12:32.850 INFO:tasks.workunit.client.0.smithi050.stderr: -402> 2024-09-14T11:12:32.356+0000 7fec3b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:12:32.850 INFO:tasks.workunit.client.0.smithi050.stderr: -401> 2024-09-14T11:12:32.356+0000 7fec3b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:12:32.850 INFO:tasks.workunit.client.0.smithi050.stderr: -400> 2024-09-14T11:12:32.356+0000 7fec3b606640 10 monclient: dump: 2024-09-14T11:12:32.850 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:12:32.850 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:12:32.850 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.850 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.850 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:12:32.850 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.850 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:12:32.850 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:12:32.850 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:12:32.850 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.850 INFO:tasks.workunit.client.0.smithi050.stderr: -399> 2024-09-14T11:12:32.356+0000 7fed52d40800 5 monclient: authenticate success, global_id 7121 2024-09-14T11:12:32.851 INFO:tasks.workunit.client.0.smithi050.stderr: -398> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient: _renew_subs 2024-09-14T11:12:32.851 INFO:tasks.workunit.client.0.smithi050.stderr: -397> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:12:32.851 INFO:tasks.workunit.client.0.smithi050.stderr: -396> 2024-09-14T11:12:32.356+0000 7fec3ce09640 4 set_mon_vals no callback set 2024-09-14T11:12:32.851 INFO:tasks.workunit.client.0.smithi050.stderr: -395> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient: _renew_subs 2024-09-14T11:12:32.851 INFO:tasks.workunit.client.0.smithi050.stderr: -394> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:12:32.851 INFO:tasks.workunit.client.0.smithi050.stderr: -393> 2024-09-14T11:12:32.357+0000 7fed52d40800 1 librados: init done 2024-09-14T11:12:32.851 INFO:tasks.workunit.client.0.smithi050.stderr: -392> 2024-09-14T11:12:32.358+0000 7fec3b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:12:32.851 INFO:tasks.workunit.client.0.smithi050.stderr: -391> 2024-09-14T11:12:32.358+0000 7fec3b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:12:32.851 INFO:tasks.workunit.client.0.smithi050.stderr: -390> 2024-09-14T11:12:32.359+0000 7fec3b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:12:32.851 INFO:tasks.workunit.client.0.smithi050.stderr: -389> 2024-09-14T11:12:32.359+0000 7fed4ea86640 10 monclient: get_auth_request con 0x7fec34077230 auth_method 0 2024-09-14T11:12:32.851 INFO:tasks.workunit.client.0.smithi050.stderr: -388> 2024-09-14T11:12:32.359+0000 7fed47fff640 10 monclient: get_auth_request con 0x561350cdab30 auth_method 0 2024-09-14T11:12:32.851 INFO:tasks.workunit.client.0.smithi050.stderr: -387> 2024-09-14T11:12:32.360+0000 7fed4ea86640 10 monclient: get_auth_request con 0x561350cddd10 auth_method 0 2024-09-14T11:12:32.851 INFO:tasks.workunit.client.0.smithi050.stderr: -386> 2024-09-14T11:12:32.361+0000 7fed47fff640 10 monclient: get_auth_request con 0x561350ce1f00 auth_method 0 2024-09-14T11:12:32.851 INFO:tasks.workunit.client.0.smithi050.stderr: -385> 2024-09-14T11:12:32.362+0000 7fed52d40800 10 monclient: build_initial_monmap 2024-09-14T11:12:32.852 INFO:tasks.workunit.client.0.smithi050.stderr: -384> 2024-09-14T11:12:32.362+0000 7fed52d40800 1 build_initial for_mkfs: 0 2024-09-14T11:12:32.852 INFO:tasks.workunit.client.0.smithi050.stderr: -383> 2024-09-14T11:12:32.362+0000 7fed52d40800 10 monclient: monmap: 2024-09-14T11:12:32.852 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:12:32.852 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:12:32.852 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:12:32.852 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:12:32.852 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:12:32.852 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.852 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:12:32.852 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:12:32.852 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:12:32.852 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.852 INFO:tasks.workunit.client.0.smithi050.stderr: -382> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding auth protocol: cephx 2024-09-14T11:12:32.852 INFO:tasks.workunit.client.0.smithi050.stderr: -381> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding auth protocol: cephx 2024-09-14T11:12:32.853 INFO:tasks.workunit.client.0.smithi050.stderr: -380> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding auth protocol: cephx 2024-09-14T11:12:32.853 INFO:tasks.workunit.client.0.smithi050.stderr: -379> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding con mode: secure 2024-09-14T11:12:32.853 INFO:tasks.workunit.client.0.smithi050.stderr: -378> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding con mode: crc 2024-09-14T11:12:32.853 INFO:tasks.workunit.client.0.smithi050.stderr: -377> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding con mode: secure 2024-09-14T11:12:32.853 INFO:tasks.workunit.client.0.smithi050.stderr: -376> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding con mode: crc 2024-09-14T11:12:32.853 INFO:tasks.workunit.client.0.smithi050.stderr: -375> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding con mode: secure 2024-09-14T11:12:32.853 INFO:tasks.workunit.client.0.smithi050.stderr: -374> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding con mode: crc 2024-09-14T11:12:32.853 INFO:tasks.workunit.client.0.smithi050.stderr: -373> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding con mode: crc 2024-09-14T11:12:32.853 INFO:tasks.workunit.client.0.smithi050.stderr: -372> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding con mode: secure 2024-09-14T11:12:32.853 INFO:tasks.workunit.client.0.smithi050.stderr: -371> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding con mode: crc 2024-09-14T11:12:32.853 INFO:tasks.workunit.client.0.smithi050.stderr: -370> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding con mode: secure 2024-09-14T11:12:32.853 INFO:tasks.workunit.client.0.smithi050.stderr: -369> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding con mode: crc 2024-09-14T11:12:32.853 INFO:tasks.workunit.client.0.smithi050.stderr: -368> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding con mode: secure 2024-09-14T11:12:32.853 INFO:tasks.workunit.client.0.smithi050.stderr: -367> 2024-09-14T11:12:32.362+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.854 INFO:tasks.workunit.client.0.smithi050.stderr: -366> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 asok(0x561350a71270) register_command objecter_requests cmddesc objecter_requests hook 0x561350cea260 EEXIST 2024-09-14T11:12:32.854 INFO:tasks.workunit.client.0.smithi050.stderr: -365> 2024-09-14T11:12:32.362+0000 7fed52d40800 10 monclient: init 2024-09-14T11:12:32.854 INFO:tasks.workunit.client.0.smithi050.stderr: -364> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding auth protocol: cephx 2024-09-14T11:12:32.854 INFO:tasks.workunit.client.0.smithi050.stderr: -363> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding auth protocol: cephx 2024-09-14T11:12:32.854 INFO:tasks.workunit.client.0.smithi050.stderr: -362> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding auth protocol: cephx 2024-09-14T11:12:32.854 INFO:tasks.workunit.client.0.smithi050.stderr: -361> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding con mode: secure 2024-09-14T11:12:32.854 INFO:tasks.workunit.client.0.smithi050.stderr: -360> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding con mode: crc 2024-09-14T11:12:32.854 INFO:tasks.workunit.client.0.smithi050.stderr: -359> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding con mode: secure 2024-09-14T11:12:32.854 INFO:tasks.workunit.client.0.smithi050.stderr: -358> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding con mode: crc 2024-09-14T11:12:32.854 INFO:tasks.workunit.client.0.smithi050.stderr: -357> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding con mode: secure 2024-09-14T11:12:32.854 INFO:tasks.workunit.client.0.smithi050.stderr: -356> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding con mode: crc 2024-09-14T11:12:32.854 INFO:tasks.workunit.client.0.smithi050.stderr: -355> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding con mode: crc 2024-09-14T11:12:32.854 INFO:tasks.workunit.client.0.smithi050.stderr: -354> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding con mode: secure 2024-09-14T11:12:32.855 INFO:tasks.workunit.client.0.smithi050.stderr: -353> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding con mode: crc 2024-09-14T11:12:32.855 INFO:tasks.workunit.client.0.smithi050.stderr: -352> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding con mode: secure 2024-09-14T11:12:32.855 INFO:tasks.workunit.client.0.smithi050.stderr: -351> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding con mode: crc 2024-09-14T11:12:32.855 INFO:tasks.workunit.client.0.smithi050.stderr: -350> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding con mode: secure 2024-09-14T11:12:32.855 INFO:tasks.workunit.client.0.smithi050.stderr: -349> 2024-09-14T11:12:32.363+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.855 INFO:tasks.workunit.client.0.smithi050.stderr: -348> 2024-09-14T11:12:32.363+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.855 INFO:tasks.workunit.client.0.smithi050.stderr: -347> 2024-09-14T11:12:32.363+0000 7fed52d40800 5 asok(0x561350a71270) register_command rotate-key cmddesc rotate-key hook 0x561350ce54c0 EEXIST 2024-09-14T11:12:32.855 INFO:tasks.workunit.client.0.smithi050.stderr: -346> 2024-09-14T11:12:32.363+0000 7fed52d40800 10 monclient: _reopen_session rank -1 2024-09-14T11:12:32.855 INFO:tasks.workunit.client.0.smithi050.stderr: -345> 2024-09-14T11:12:32.363+0000 7fed52d40800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:12:32.855 INFO:tasks.workunit.client.0.smithi050.stderr: -344> 2024-09-14T11:12:32.363+0000 7fed52d40800 10 monclient(hunting): picked mon.noname-a con 0x561350d0e580 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:12:32.855 INFO:tasks.workunit.client.0.smithi050.stderr: -343> 2024-09-14T11:12:32.363+0000 7fed52d40800 10 monclient(hunting): picked mon.noname-c con 0x561350d0e960 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:12:32.855 INFO:tasks.workunit.client.0.smithi050.stderr: -342> 2024-09-14T11:12:32.363+0000 7fed52d40800 10 monclient(hunting): picked mon.noname-b con 0x561350d0d290 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:12:32.855 INFO:tasks.workunit.client.0.smithi050.stderr: -341> 2024-09-14T11:12:32.363+0000 7fed52d40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:12:32.855 INFO:tasks.workunit.client.0.smithi050.stderr: -340> 2024-09-14T11:12:32.363+0000 7fed52d40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:12:32.856 INFO:tasks.workunit.client.0.smithi050.stderr: -339> 2024-09-14T11:12:32.363+0000 7fed52d40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:12:32.856 INFO:tasks.workunit.client.0.smithi050.stderr: -338> 2024-09-14T11:12:32.363+0000 7fed52d40800 10 monclient(hunting): _renew_subs 2024-09-14T11:12:32.856 INFO:tasks.workunit.client.0.smithi050.stderr: -337> 2024-09-14T11:12:32.363+0000 7fed52d40800 10 monclient(hunting): authenticate will time out at 2405.000391s 2024-09-14T11:12:32.856 INFO:tasks.workunit.client.0.smithi050.stderr: -336> 2024-09-14T11:12:32.363+0000 7fed4ea86640 10 monclient(hunting): get_auth_request con 0x561350d0e580 auth_method 0 2024-09-14T11:12:32.856 INFO:tasks.workunit.client.0.smithi050.stderr: -335> 2024-09-14T11:12:32.363+0000 7fed4ea86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:12:32.856 INFO:tasks.workunit.client.0.smithi050.stderr: -334> 2024-09-14T11:12:32.363+0000 7fed4ea86640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:12:32.856 INFO:tasks.workunit.client.0.smithi050.stderr: -333> 2024-09-14T11:12:32.363+0000 7fed4ea86640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:12:32.856 INFO:tasks.workunit.client.0.smithi050.stderr: -332> 2024-09-14T11:12:32.363+0000 7fed47fff640 10 monclient(hunting): get_auth_request con 0x561350d0e960 auth_method 0 2024-09-14T11:12:32.856 INFO:tasks.workunit.client.0.smithi050.stderr: -331> 2024-09-14T11:12:32.363+0000 7fed47fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:12:32.856 INFO:tasks.workunit.client.0.smithi050.stderr: -330> 2024-09-14T11:12:32.363+0000 7fed47fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:12:32.856 INFO:tasks.workunit.client.0.smithi050.stderr: -329> 2024-09-14T11:12:32.363+0000 7fed47fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:12:32.856 INFO:tasks.workunit.client.0.smithi050.stderr: -328> 2024-09-14T11:12:32.363+0000 7fed4f287640 10 monclient(hunting): get_auth_request con 0x561350d0d290 auth_method 0 2024-09-14T11:12:32.856 INFO:tasks.workunit.client.0.smithi050.stderr: -327> 2024-09-14T11:12:32.363+0000 7fed4f287640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:12:32.856 INFO:tasks.workunit.client.0.smithi050.stderr: -326> 2024-09-14T11:12:32.363+0000 7fed4f287640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:12:32.857 INFO:tasks.workunit.client.0.smithi050.stderr: -325> 2024-09-14T11:12:32.363+0000 7fed4f287640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:12:32.857 INFO:tasks.workunit.client.0.smithi050.stderr: -324> 2024-09-14T11:12:32.363+0000 7fed4ea86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:12:32.857 INFO:tasks.workunit.client.0.smithi050.stderr: -323> 2024-09-14T11:12:32.363+0000 7fed4ea86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:12:32.857 INFO:tasks.workunit.client.0.smithi050.stderr: -322> 2024-09-14T11:12:32.363+0000 7fed4ea86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:12:32.857 INFO:tasks.workunit.client.0.smithi050.stderr: -321> 2024-09-14T11:12:32.363+0000 7fed47fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:12:32.857 INFO:tasks.workunit.client.0.smithi050.stderr: -320> 2024-09-14T11:12:32.363+0000 7fed47fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:12:32.857 INFO:tasks.workunit.client.0.smithi050.stderr: -319> 2024-09-14T11:12:32.363+0000 7fed47fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:12:32.857 INFO:tasks.workunit.client.0.smithi050.stderr: -318> 2024-09-14T11:12:32.363+0000 7fed4f287640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:12:32.857 INFO:tasks.workunit.client.0.smithi050.stderr: -317> 2024-09-14T11:12:32.363+0000 7fed4f287640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:12:32.857 INFO:tasks.workunit.client.0.smithi050.stderr: -316> 2024-09-14T11:12:32.363+0000 7fed4f287640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:12:32.857 INFO:tasks.workunit.client.0.smithi050.stderr: -315> 2024-09-14T11:12:32.363+0000 7fed4ea86640 10 monclient(hunting): handle_auth_done global_id 7590 payload 824 2024-09-14T11:12:32.857 INFO:tasks.workunit.client.0.smithi050.stderr: -314> 2024-09-14T11:12:32.363+0000 7fed4ea86640 10 monclient: _finish_hunting 0 2024-09-14T11:12:32.857 INFO:tasks.workunit.client.0.smithi050.stderr: -313> 2024-09-14T11:12:32.363+0000 7fed4ea86640 1 monclient: found mon.noname-a 2024-09-14T11:12:32.857 INFO:tasks.workunit.client.0.smithi050.stderr: -312> 2024-09-14T11:12:32.363+0000 7fed4ea86640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:12:32.858 INFO:tasks.workunit.client.0.smithi050.stderr: -311> 2024-09-14T11:12:32.364+0000 7fec38e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:12:32.858 INFO:tasks.workunit.client.0.smithi050.stderr: -310> 2024-09-14T11:12:32.364+0000 7fec38e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:12:32.858 INFO:tasks.workunit.client.0.smithi050.stderr: -309> 2024-09-14T11:12:32.364+0000 7fec38e01640 10 monclient: dump: 2024-09-14T11:12:32.858 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:12:32.858 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:12:32.858 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.858 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.858 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:12:32.858 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.858 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:12:32.858 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:12:32.858 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:12:32.859 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.859 INFO:tasks.workunit.client.0.smithi050.stderr: -308> 2024-09-14T11:12:32.364+0000 7fec38e01640 10 monclient: _finish_auth 0 2024-09-14T11:12:32.859 INFO:tasks.workunit.client.0.smithi050.stderr: -307> 2024-09-14T11:12:32.364+0000 7fec38e01640 10 monclient: _check_auth_tickets 2024-09-14T11:12:32.859 INFO:tasks.workunit.client.0.smithi050.stderr: -306> 2024-09-14T11:12:32.364+0000 7fec38e01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:12:32.859 INFO:tasks.workunit.client.0.smithi050.stderr: -305> 2024-09-14T11:12:32.364+0000 7fec38e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:12:32.859 INFO:tasks.workunit.client.0.smithi050.stderr: -304> 2024-09-14T11:12:32.364+0000 7fec38e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:12:32.859 INFO:tasks.workunit.client.0.smithi050.stderr: -303> 2024-09-14T11:12:32.364+0000 7fec38e01640 10 monclient: dump: 2024-09-14T11:12:32.859 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:12:32.859 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:12:32.859 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.859 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.859 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:12:32.859 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.859 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:12:32.860 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:12:32.860 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:12:32.860 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.860 INFO:tasks.workunit.client.0.smithi050.stderr: -302> 2024-09-14T11:12:32.364+0000 7fed52d40800 5 monclient: authenticate success, global_id 7590 2024-09-14T11:12:32.860 INFO:tasks.workunit.client.0.smithi050.stderr: -301> 2024-09-14T11:12:32.364+0000 7fed52d40800 10 monclient: _renew_subs 2024-09-14T11:12:32.860 INFO:tasks.workunit.client.0.smithi050.stderr: -300> 2024-09-14T11:12:32.364+0000 7fed52d40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:12:32.860 INFO:tasks.workunit.client.0.smithi050.stderr: -299> 2024-09-14T11:12:32.364+0000 7fed4fa88640 4 set_mon_vals no callback set 2024-09-14T11:12:32.860 INFO:tasks.workunit.client.0.smithi050.stderr: -298> 2024-09-14T11:12:32.364+0000 7fed52d40800 10 monclient: _renew_subs 2024-09-14T11:12:32.860 INFO:tasks.workunit.client.0.smithi050.stderr: -297> 2024-09-14T11:12:32.364+0000 7fed52d40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:12:32.860 INFO:tasks.workunit.client.0.smithi050.stderr: -296> 2024-09-14T11:12:32.366+0000 7fec38e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:12:32.860 INFO:tasks.workunit.client.0.smithi050.stderr: -295> 2024-09-14T11:12:32.366+0000 7fec38e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:12:32.860 INFO:tasks.workunit.client.0.smithi050.stderr: -294> 2024-09-14T11:12:32.366+0000 7fec38e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:12:32.861 INFO:tasks.workunit.client.0.smithi050.stderr: -293> 2024-09-14T11:12:32.366+0000 7fed47fff640 10 monclient: get_auth_request con 0x7fec28077140 auth_method 0 2024-09-14T11:12:32.861 INFO:tasks.workunit.client.0.smithi050.stderr: -292> 2024-09-14T11:12:32.366+0000 7fed52d40800 10 monclient: get_monmap_and_config 2024-09-14T11:12:32.861 INFO:tasks.workunit.client.0.smithi050.stderr: -291> 2024-09-14T11:12:32.366+0000 7fed52d40800 10 monclient: build_initial_monmap 2024-09-14T11:12:32.861 INFO:tasks.workunit.client.0.smithi050.stderr: -290> 2024-09-14T11:12:32.366+0000 7fed52d40800 1 build_initial for_mkfs: 0 2024-09-14T11:12:32.861 INFO:tasks.workunit.client.0.smithi050.stderr: -289> 2024-09-14T11:12:32.366+0000 7fed52d40800 10 monclient: monmap: 2024-09-14T11:12:32.861 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:12:32.861 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:12:32.861 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:12:32.861 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:12:32.861 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:12:32.861 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.861 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:12:32.861 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:12:32.862 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:12:32.862 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.862 INFO:tasks.workunit.client.0.smithi050.stderr: -288> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding auth protocol: cephx 2024-09-14T11:12:32.862 INFO:tasks.workunit.client.0.smithi050.stderr: -287> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding auth protocol: cephx 2024-09-14T11:12:32.862 INFO:tasks.workunit.client.0.smithi050.stderr: -286> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding auth protocol: cephx 2024-09-14T11:12:32.862 INFO:tasks.workunit.client.0.smithi050.stderr: -285> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding con mode: secure 2024-09-14T11:12:32.862 INFO:tasks.workunit.client.0.smithi050.stderr: -284> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding con mode: crc 2024-09-14T11:12:32.862 INFO:tasks.workunit.client.0.smithi050.stderr: -283> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding con mode: secure 2024-09-14T11:12:32.862 INFO:tasks.workunit.client.0.smithi050.stderr: -282> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding con mode: crc 2024-09-14T11:12:32.862 INFO:tasks.workunit.client.0.smithi050.stderr: -281> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding con mode: secure 2024-09-14T11:12:32.862 INFO:tasks.workunit.client.0.smithi050.stderr: -280> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding con mode: crc 2024-09-14T11:12:32.862 INFO:tasks.workunit.client.0.smithi050.stderr: -279> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding con mode: crc 2024-09-14T11:12:32.862 INFO:tasks.workunit.client.0.smithi050.stderr: -278> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding con mode: secure 2024-09-14T11:12:32.862 INFO:tasks.workunit.client.0.smithi050.stderr: -277> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding con mode: crc 2024-09-14T11:12:32.863 INFO:tasks.workunit.client.0.smithi050.stderr: -276> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding con mode: secure 2024-09-14T11:12:32.863 INFO:tasks.workunit.client.0.smithi050.stderr: -275> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding con mode: crc 2024-09-14T11:12:32.863 INFO:tasks.workunit.client.0.smithi050.stderr: -274> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding con mode: secure 2024-09-14T11:12:32.863 INFO:tasks.workunit.client.0.smithi050.stderr: -273> 2024-09-14T11:12:32.366+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.863 INFO:tasks.workunit.client.0.smithi050.stderr: -272> 2024-09-14T11:12:32.367+0000 7fed52d40800 10 monclient: init 2024-09-14T11:12:32.863 INFO:tasks.workunit.client.0.smithi050.stderr: -271> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding auth protocol: cephx 2024-09-14T11:12:32.863 INFO:tasks.workunit.client.0.smithi050.stderr: -270> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding auth protocol: cephx 2024-09-14T11:12:32.863 INFO:tasks.workunit.client.0.smithi050.stderr: -269> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding auth protocol: cephx 2024-09-14T11:12:32.863 INFO:tasks.workunit.client.0.smithi050.stderr: -268> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding con mode: secure 2024-09-14T11:12:32.863 INFO:tasks.workunit.client.0.smithi050.stderr: -267> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding con mode: crc 2024-09-14T11:12:32.863 INFO:tasks.workunit.client.0.smithi050.stderr: -266> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding con mode: secure 2024-09-14T11:12:32.863 INFO:tasks.workunit.client.0.smithi050.stderr: -265> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding con mode: crc 2024-09-14T11:12:32.863 INFO:tasks.workunit.client.0.smithi050.stderr: -264> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding con mode: secure 2024-09-14T11:12:32.863 INFO:tasks.workunit.client.0.smithi050.stderr: -263> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding con mode: crc 2024-09-14T11:12:32.863 INFO:tasks.workunit.client.0.smithi050.stderr: -262> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding con mode: crc 2024-09-14T11:12:32.864 INFO:tasks.workunit.client.0.smithi050.stderr: -261> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding con mode: secure 2024-09-14T11:12:32.864 INFO:tasks.workunit.client.0.smithi050.stderr: -260> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding con mode: crc 2024-09-14T11:12:32.864 INFO:tasks.workunit.client.0.smithi050.stderr: -259> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding con mode: secure 2024-09-14T11:12:32.864 INFO:tasks.workunit.client.0.smithi050.stderr: -258> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding con mode: crc 2024-09-14T11:12:32.864 INFO:tasks.workunit.client.0.smithi050.stderr: -257> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding con mode: secure 2024-09-14T11:12:32.864 INFO:tasks.workunit.client.0.smithi050.stderr: -256> 2024-09-14T11:12:32.367+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.864 INFO:tasks.workunit.client.0.smithi050.stderr: -255> 2024-09-14T11:12:32.367+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.864 INFO:tasks.workunit.client.0.smithi050.stderr: -254> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 asok(0x561350a71270) register_command rotate-key cmddesc rotate-key hook 0x7fff2c4d4bb8 EEXIST 2024-09-14T11:12:32.864 INFO:tasks.workunit.client.0.smithi050.stderr: -253> 2024-09-14T11:12:32.367+0000 7fed52d40800 10 monclient: _reopen_session rank -1 2024-09-14T11:12:32.864 INFO:tasks.workunit.client.0.smithi050.stderr: -252> 2024-09-14T11:12:32.367+0000 7fed52d40800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:12:32.864 INFO:tasks.workunit.client.0.smithi050.stderr: -251> 2024-09-14T11:12:32.367+0000 7fed52d40800 10 monclient(hunting): picked mon.noname-a con 0x561350d628f0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:12:32.864 INFO:tasks.workunit.client.0.smithi050.stderr: -250> 2024-09-14T11:12:32.367+0000 7fed52d40800 10 monclient(hunting): picked mon.noname-b con 0x561350d53240 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:12:32.864 INFO:tasks.workunit.client.0.smithi050.stderr: -249> 2024-09-14T11:12:32.367+0000 7fed52d40800 10 monclient(hunting): picked mon.noname-c con 0x561350d5dd20 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:12:32.864 INFO:tasks.workunit.client.0.smithi050.stderr: -248> 2024-09-14T11:12:32.367+0000 7fed52d40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:12:32.865 INFO:tasks.workunit.client.0.smithi050.stderr: -247> 2024-09-14T11:12:32.367+0000 7fed52d40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:12:32.865 INFO:tasks.workunit.client.0.smithi050.stderr: -246> 2024-09-14T11:12:32.367+0000 7fed52d40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:12:32.865 INFO:tasks.workunit.client.0.smithi050.stderr: -245> 2024-09-14T11:12:32.367+0000 7fed52d40800 10 monclient(hunting): _renew_subs 2024-09-14T11:12:32.865 INFO:tasks.workunit.client.0.smithi050.stderr: -244> 2024-09-14T11:12:32.367+0000 7fed52d40800 10 monclient(hunting): authenticate will time out at 2405.004572s 2024-09-14T11:12:32.865 INFO:tasks.workunit.client.0.smithi050.stderr: -243> 2024-09-14T11:12:32.367+0000 7fed4ea86640 10 monclient(hunting): get_auth_request con 0x561350d628f0 auth_method 0 2024-09-14T11:12:32.865 INFO:tasks.workunit.client.0.smithi050.stderr: -242> 2024-09-14T11:12:32.367+0000 7fed4ea86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:12:32.865 INFO:tasks.workunit.client.0.smithi050.stderr: -241> 2024-09-14T11:12:32.367+0000 7fed4ea86640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:12:32.865 INFO:tasks.workunit.client.0.smithi050.stderr: -240> 2024-09-14T11:12:32.367+0000 7fed4ea86640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:12:32.865 INFO:tasks.workunit.client.0.smithi050.stderr: -239> 2024-09-14T11:12:32.367+0000 7fed4f287640 10 monclient(hunting): get_auth_request con 0x561350d5dd20 auth_method 0 2024-09-14T11:12:32.865 INFO:tasks.workunit.client.0.smithi050.stderr: -238> 2024-09-14T11:12:32.367+0000 7fed4f287640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:12:32.865 INFO:tasks.workunit.client.0.smithi050.stderr: -237> 2024-09-14T11:12:32.367+0000 7fed4f287640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:12:32.865 INFO:tasks.workunit.client.0.smithi050.stderr: -236> 2024-09-14T11:12:32.367+0000 7fed4f287640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:12:32.865 INFO:tasks.workunit.client.0.smithi050.stderr: -235> 2024-09-14T11:12:32.367+0000 7fed4ea86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:12:32.866 INFO:tasks.workunit.client.0.smithi050.stderr: -234> 2024-09-14T11:12:32.367+0000 7fed4ea86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:12:32.866 INFO:tasks.workunit.client.0.smithi050.stderr: -233> 2024-09-14T11:12:32.367+0000 7fed4ea86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:12:32.866 INFO:tasks.workunit.client.0.smithi050.stderr: -232> 2024-09-14T11:12:32.367+0000 7fed4f287640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:12:32.866 INFO:tasks.workunit.client.0.smithi050.stderr: -231> 2024-09-14T11:12:32.367+0000 7fed4f287640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:12:32.866 INFO:tasks.workunit.client.0.smithi050.stderr: -230> 2024-09-14T11:12:32.367+0000 7fed4f287640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:12:32.866 INFO:tasks.workunit.client.0.smithi050.stderr: -229> 2024-09-14T11:12:32.367+0000 7fed4ea86640 10 monclient(hunting): handle_auth_done global_id 7593 payload 274 2024-09-14T11:12:32.866 INFO:tasks.workunit.client.0.smithi050.stderr: -228> 2024-09-14T11:12:32.367+0000 7fed4ea86640 10 monclient: _finish_hunting 0 2024-09-14T11:12:32.866 INFO:tasks.workunit.client.0.smithi050.stderr: -227> 2024-09-14T11:12:32.367+0000 7fed4ea86640 1 monclient: found mon.noname-a 2024-09-14T11:12:32.866 INFO:tasks.workunit.client.0.smithi050.stderr: -226> 2024-09-14T11:12:32.367+0000 7fed4ea86640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:12:32.866 INFO:tasks.workunit.client.0.smithi050.stderr: -225> 2024-09-14T11:12:32.367+0000 7fed47fff640 10 monclient: get_auth_request con 0x561350d53240 auth_method 0 2024-09-14T11:12:32.866 INFO:tasks.workunit.client.0.smithi050.stderr: -224> 2024-09-14T11:12:32.368+0000 7fec327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:12:32.866 INFO:tasks.workunit.client.0.smithi050.stderr: -223> 2024-09-14T11:12:32.368+0000 7fec327fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:12:32.866 INFO:tasks.workunit.client.0.smithi050.stderr: -222> 2024-09-14T11:12:32.368+0000 7fec327fc640 10 monclient: dump: 2024-09-14T11:12:32.866 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:12:32.866 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:12:32.867 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.867 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.867 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:12:32.867 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.867 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:12:32.867 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:12:32.867 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:12:32.867 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.867 INFO:tasks.workunit.client.0.smithi050.stderr: -221> 2024-09-14T11:12:32.368+0000 7fec327fc640 10 monclient: _finish_auth 0 2024-09-14T11:12:32.867 INFO:tasks.workunit.client.0.smithi050.stderr: -220> 2024-09-14T11:12:32.368+0000 7fec327fc640 10 monclient: _check_auth_tickets 2024-09-14T11:12:32.867 INFO:tasks.workunit.client.0.smithi050.stderr: -219> 2024-09-14T11:12:32.368+0000 7fec327fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:12:32.867 INFO:tasks.workunit.client.0.smithi050.stderr: -218> 2024-09-14T11:12:32.368+0000 7fec327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:12:32.867 INFO:tasks.workunit.client.0.smithi050.stderr: -217> 2024-09-14T11:12:32.368+0000 7fec327fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:12:32.867 INFO:tasks.workunit.client.0.smithi050.stderr: -216> 2024-09-14T11:12:32.368+0000 7fec327fc640 10 monclient: dump: 2024-09-14T11:12:32.868 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:12:32.868 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:12:32.868 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.868 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.868 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:12:32.868 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.868 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:12:32.868 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:12:32.868 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:12:32.868 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.868 INFO:tasks.workunit.client.0.smithi050.stderr: -215> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 monclient: authenticate success, global_id 7593 2024-09-14T11:12:32.868 INFO:tasks.workunit.client.0.smithi050.stderr: -214> 2024-09-14T11:12:32.368+0000 7fed52d40800 10 monclient: get_monmap_and_config success 2024-09-14T11:12:32.868 INFO:tasks.workunit.client.0.smithi050.stderr: -213> 2024-09-14T11:12:32.368+0000 7fed52d40800 4 set_mon_vals no callback set 2024-09-14T11:12:32.868 INFO:tasks.workunit.client.0.smithi050.stderr: -212> 2024-09-14T11:12:32.368+0000 7fed52d40800 10 monclient: shutdown 2024-09-14T11:12:32.869 INFO:tasks.workunit.client.0.smithi050.stderr: -211> 2024-09-14T11:12:32.368+0000 7fed52d40800 10 monclient: build_initial_monmap 2024-09-14T11:12:32.869 INFO:tasks.workunit.client.0.smithi050.stderr: -210> 2024-09-14T11:12:32.368+0000 7fed52d40800 1 build_initial for_mkfs: 0 2024-09-14T11:12:32.869 INFO:tasks.workunit.client.0.smithi050.stderr: -209> 2024-09-14T11:12:32.368+0000 7fed52d40800 10 monclient: monmap: 2024-09-14T11:12:32.869 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:12:32.869 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:12:32.869 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:12:32.869 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:12:32.869 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:12:32.869 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.869 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:12:32.869 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:12:32.869 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:12:32.869 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.869 INFO:tasks.workunit.client.0.smithi050.stderr: -208> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding auth protocol: cephx 2024-09-14T11:12:32.870 INFO:tasks.workunit.client.0.smithi050.stderr: -207> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding auth protocol: cephx 2024-09-14T11:12:32.870 INFO:tasks.workunit.client.0.smithi050.stderr: -206> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding auth protocol: cephx 2024-09-14T11:12:32.870 INFO:tasks.workunit.client.0.smithi050.stderr: -205> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding con mode: secure 2024-09-14T11:12:32.870 INFO:tasks.workunit.client.0.smithi050.stderr: -204> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding con mode: crc 2024-09-14T11:12:32.870 INFO:tasks.workunit.client.0.smithi050.stderr: -203> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding con mode: secure 2024-09-14T11:12:32.870 INFO:tasks.workunit.client.0.smithi050.stderr: -202> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding con mode: crc 2024-09-14T11:12:32.870 INFO:tasks.workunit.client.0.smithi050.stderr: -201> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding con mode: secure 2024-09-14T11:12:32.870 INFO:tasks.workunit.client.0.smithi050.stderr: -200> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding con mode: crc 2024-09-14T11:12:32.870 INFO:tasks.workunit.client.0.smithi050.stderr: -199> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding con mode: crc 2024-09-14T11:12:32.870 INFO:tasks.workunit.client.0.smithi050.stderr: -198> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding con mode: secure 2024-09-14T11:12:32.870 INFO:tasks.workunit.client.0.smithi050.stderr: -197> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding con mode: crc 2024-09-14T11:12:32.870 INFO:tasks.workunit.client.0.smithi050.stderr: -196> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding con mode: secure 2024-09-14T11:12:32.870 INFO:tasks.workunit.client.0.smithi050.stderr: -195> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding con mode: crc 2024-09-14T11:12:32.871 INFO:tasks.workunit.client.0.smithi050.stderr: -194> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding con mode: secure 2024-09-14T11:12:32.871 INFO:tasks.workunit.client.0.smithi050.stderr: -193> 2024-09-14T11:12:32.369+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.871 INFO:tasks.workunit.client.0.smithi050.stderr: -192> 2024-09-14T11:12:32.369+0000 7fed52d40800 1 librados: starting msgr at 2024-09-14T11:12:32.871 INFO:tasks.workunit.client.0.smithi050.stderr: -191> 2024-09-14T11:12:32.369+0000 7fed52d40800 1 librados: starting objecter 2024-09-14T11:12:32.871 INFO:tasks.workunit.client.0.smithi050.stderr: -190> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 asok(0x561350a71270) register_command objecter_requests cmddesc objecter_requests hook 0x561350d30b20 EEXIST 2024-09-14T11:12:32.871 INFO:tasks.workunit.client.0.smithi050.stderr: -189> 2024-09-14T11:12:32.369+0000 7fed52d40800 1 librados: setting wanted keys 2024-09-14T11:12:32.871 INFO:tasks.workunit.client.0.smithi050.stderr: -188> 2024-09-14T11:12:32.369+0000 7fed52d40800 1 librados: calling monclient init 2024-09-14T11:12:32.871 INFO:tasks.workunit.client.0.smithi050.stderr: -187> 2024-09-14T11:12:32.369+0000 7fed52d40800 10 monclient: init 2024-09-14T11:12:32.871 INFO:tasks.workunit.client.0.smithi050.stderr: -186> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding auth protocol: cephx 2024-09-14T11:12:32.871 INFO:tasks.workunit.client.0.smithi050.stderr: -185> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding auth protocol: cephx 2024-09-14T11:12:32.871 INFO:tasks.workunit.client.0.smithi050.stderr: -184> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding auth protocol: cephx 2024-09-14T11:12:32.871 INFO:tasks.workunit.client.0.smithi050.stderr: -183> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding con mode: secure 2024-09-14T11:12:32.872 INFO:tasks.workunit.client.0.smithi050.stderr: -182> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding con mode: crc 2024-09-14T11:12:32.872 INFO:tasks.workunit.client.0.smithi050.stderr: -181> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding con mode: secure 2024-09-14T11:12:32.872 INFO:tasks.workunit.client.0.smithi050.stderr: -180> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding con mode: crc 2024-09-14T11:12:32.872 INFO:tasks.workunit.client.0.smithi050.stderr: -179> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding con mode: secure 2024-09-14T11:12:32.872 INFO:tasks.workunit.client.0.smithi050.stderr: -178> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding con mode: crc 2024-09-14T11:12:32.872 INFO:tasks.workunit.client.0.smithi050.stderr: -177> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding con mode: crc 2024-09-14T11:12:32.872 INFO:tasks.workunit.client.0.smithi050.stderr: -176> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding con mode: secure 2024-09-14T11:12:32.872 INFO:tasks.workunit.client.0.smithi050.stderr: -175> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding con mode: crc 2024-09-14T11:12:32.872 INFO:tasks.workunit.client.0.smithi050.stderr: -174> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding con mode: secure 2024-09-14T11:12:32.873 INFO:tasks.workunit.client.0.smithi050.stderr: -173> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding con mode: crc 2024-09-14T11:12:32.873 INFO:tasks.workunit.client.0.smithi050.stderr: -172> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding con mode: secure 2024-09-14T11:12:32.873 INFO:tasks.workunit.client.0.smithi050.stderr: -171> 2024-09-14T11:12:32.369+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.873 INFO:tasks.workunit.client.0.smithi050.stderr: -170> 2024-09-14T11:12:32.369+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.873 INFO:tasks.workunit.client.0.smithi050.stderr: -169> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 asok(0x561350a71270) register_command rotate-key cmddesc rotate-key hook 0x561350d22f88 EEXIST 2024-09-14T11:12:32.873 INFO:tasks.workunit.client.0.smithi050.stderr: -168> 2024-09-14T11:12:32.369+0000 7fed52d40800 10 monclient: _reopen_session rank -1 2024-09-14T11:12:32.873 INFO:tasks.workunit.client.0.smithi050.stderr: -167> 2024-09-14T11:12:32.369+0000 7fed52d40800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:12:32.873 INFO:tasks.workunit.client.0.smithi050.stderr: -166> 2024-09-14T11:12:32.369+0000 7fed52d40800 10 monclient(hunting): picked mon.noname-b con 0x561350d53240 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:12:32.873 INFO:tasks.workunit.client.0.smithi050.stderr: -165> 2024-09-14T11:12:32.369+0000 7fed52d40800 10 monclient(hunting): picked mon.noname-c con 0x561350d5dd20 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:12:32.873 INFO:tasks.workunit.client.0.smithi050.stderr: -164> 2024-09-14T11:12:32.369+0000 7fed52d40800 10 monclient(hunting): picked mon.noname-a con 0x561350d628f0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:12:32.873 INFO:tasks.workunit.client.0.smithi050.stderr: -163> 2024-09-14T11:12:32.369+0000 7fed52d40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:12:32.874 INFO:tasks.workunit.client.0.smithi050.stderr: -162> 2024-09-14T11:12:32.369+0000 7fed52d40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:12:32.874 INFO:tasks.workunit.client.0.smithi050.stderr: -161> 2024-09-14T11:12:32.369+0000 7fed52d40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:12:32.874 INFO:tasks.workunit.client.0.smithi050.stderr: -160> 2024-09-14T11:12:32.369+0000 7fed52d40800 10 monclient(hunting): _renew_subs 2024-09-14T11:12:32.874 INFO:tasks.workunit.client.0.smithi050.stderr: -159> 2024-09-14T11:12:32.369+0000 7fed52d40800 10 monclient(hunting): authenticate will time out at 2405.006877s 2024-09-14T11:12:32.874 INFO:tasks.workunit.client.0.smithi050.stderr: -158> 2024-09-14T11:12:32.369+0000 7fed4f287640 10 monclient(hunting): get_auth_request con 0x561350d628f0 auth_method 0 2024-09-14T11:12:32.874 INFO:tasks.workunit.client.0.smithi050.stderr: -157> 2024-09-14T11:12:32.369+0000 7fed4f287640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:12:32.874 INFO:tasks.workunit.client.0.smithi050.stderr: -156> 2024-09-14T11:12:32.369+0000 7fed4f287640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:12:32.874 INFO:tasks.workunit.client.0.smithi050.stderr: -155> 2024-09-14T11:12:32.369+0000 7fed4f287640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:12:32.874 INFO:tasks.workunit.client.0.smithi050.stderr: -154> 2024-09-14T11:12:32.370+0000 7fed47fff640 10 monclient(hunting): get_auth_request con 0x561350d5dd20 auth_method 0 2024-09-14T11:12:32.874 INFO:tasks.workunit.client.0.smithi050.stderr: -153> 2024-09-14T11:12:32.370+0000 7fed47fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:12:32.874 INFO:tasks.workunit.client.0.smithi050.stderr: -152> 2024-09-14T11:12:32.370+0000 7fed47fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:12:32.874 INFO:tasks.workunit.client.0.smithi050.stderr: -151> 2024-09-14T11:12:32.370+0000 7fed47fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:12:32.874 INFO:tasks.workunit.client.0.smithi050.stderr: -150> 2024-09-14T11:12:32.370+0000 7fed4f287640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:12:32.874 INFO:tasks.workunit.client.0.smithi050.stderr: -149> 2024-09-14T11:12:32.370+0000 7fed4f287640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:12:32.875 INFO:tasks.workunit.client.0.smithi050.stderr: -148> 2024-09-14T11:12:32.370+0000 7fed4f287640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:12:32.875 INFO:tasks.workunit.client.0.smithi050.stderr: -147> 2024-09-14T11:12:32.370+0000 7fed47fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:12:32.875 INFO:tasks.workunit.client.0.smithi050.stderr: -146> 2024-09-14T11:12:32.370+0000 7fed47fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:12:32.875 INFO:tasks.workunit.client.0.smithi050.stderr: -145> 2024-09-14T11:12:32.370+0000 7fed47fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:12:32.875 INFO:tasks.workunit.client.0.smithi050.stderr: -144> 2024-09-14T11:12:32.370+0000 7fed4f287640 10 monclient(hunting): handle_auth_done global_id 7596 payload 824 2024-09-14T11:12:32.875 INFO:tasks.workunit.client.0.smithi050.stderr: -143> 2024-09-14T11:12:32.370+0000 7fed4f287640 10 monclient: _finish_hunting 0 2024-09-14T11:12:32.875 INFO:tasks.workunit.client.0.smithi050.stderr: -142> 2024-09-14T11:12:32.370+0000 7fed4f287640 1 monclient: found mon.noname-a 2024-09-14T11:12:32.875 INFO:tasks.workunit.client.0.smithi050.stderr: -141> 2024-09-14T11:12:32.370+0000 7fed4f287640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:12:32.875 INFO:tasks.workunit.client.0.smithi050.stderr: -140> 2024-09-14T11:12:32.370+0000 7fed4ea86640 10 monclient: get_auth_request con 0x561350d53240 auth_method 0 2024-09-14T11:12:32.875 INFO:tasks.workunit.client.0.smithi050.stderr: -139> 2024-09-14T11:12:32.370+0000 7fec30ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:12:32.875 INFO:tasks.workunit.client.0.smithi050.stderr: -138> 2024-09-14T11:12:32.370+0000 7fec30ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:12:32.875 INFO:tasks.workunit.client.0.smithi050.stderr: -137> 2024-09-14T11:12:32.370+0000 7fec30ff9640 10 monclient: dump: 2024-09-14T11:12:32.875 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:12:32.875 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:12:32.876 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.876 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.876 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:12:32.876 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.876 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:12:32.876 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:12:32.876 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:12:32.876 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.876 INFO:tasks.workunit.client.0.smithi050.stderr: -136> 2024-09-14T11:12:32.370+0000 7fec30ff9640 10 monclient: _finish_auth 0 2024-09-14T11:12:32.876 INFO:tasks.workunit.client.0.smithi050.stderr: -135> 2024-09-14T11:12:32.370+0000 7fec30ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:12:32.876 INFO:tasks.workunit.client.0.smithi050.stderr: -134> 2024-09-14T11:12:32.370+0000 7fec30ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:12:32.876 INFO:tasks.workunit.client.0.smithi050.stderr: -133> 2024-09-14T11:12:32.370+0000 7fec30ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:12:32.876 INFO:tasks.workunit.client.0.smithi050.stderr: -132> 2024-09-14T11:12:32.370+0000 7fec30ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:12:32.877 INFO:tasks.workunit.client.0.smithi050.stderr: -131> 2024-09-14T11:12:32.370+0000 7fec30ff9640 10 monclient: dump: 2024-09-14T11:12:32.877 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:12:32.877 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:12:32.877 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.877 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.877 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:12:32.877 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.877 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:12:32.877 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:12:32.877 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:12:32.877 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.877 INFO:tasks.workunit.client.0.smithi050.stderr: -130> 2024-09-14T11:12:32.370+0000 7fed52d40800 5 monclient: authenticate success, global_id 7596 2024-09-14T11:12:32.877 INFO:tasks.workunit.client.0.smithi050.stderr: -129> 2024-09-14T11:12:32.370+0000 7fed52d40800 10 monclient: _renew_subs 2024-09-14T11:12:32.877 INFO:tasks.workunit.client.0.smithi050.stderr: -128> 2024-09-14T11:12:32.370+0000 7fed52d40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:12:32.878 INFO:tasks.workunit.client.0.smithi050.stderr: -127> 2024-09-14T11:12:32.370+0000 7fec327fc640 4 set_mon_vals no callback set 2024-09-14T11:12:32.878 INFO:tasks.workunit.client.0.smithi050.stderr: -126> 2024-09-14T11:12:32.370+0000 7fed52d40800 10 monclient: _renew_subs 2024-09-14T11:12:32.878 INFO:tasks.workunit.client.0.smithi050.stderr: -125> 2024-09-14T11:12:32.370+0000 7fed52d40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:12:32.878 INFO:tasks.workunit.client.0.smithi050.stderr: -124> 2024-09-14T11:12:32.370+0000 7fed52d40800 1 librados: init done 2024-09-14T11:12:32.878 INFO:tasks.workunit.client.0.smithi050.stderr: -123> 2024-09-14T11:12:32.370+0000 7fed52d40800 5 asok(0x561350a71270) register_command cr dump hook 0x561350d5ca28 2024-09-14T11:12:32.878 INFO:tasks.workunit.client.0.smithi050.stderr: -122> 2024-09-14T11:12:32.372+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.878 INFO:tasks.workunit.client.0.smithi050.stderr: -121> 2024-09-14T11:12:32.372+0000 7fec30ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:12:32.878 INFO:tasks.workunit.client.0.smithi050.stderr: -120> 2024-09-14T11:12:32.372+0000 7fec30ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:12:32.878 INFO:tasks.workunit.client.0.smithi050.stderr: -119> 2024-09-14T11:12:32.372+0000 7fec30ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:12:32.878 INFO:tasks.workunit.client.0.smithi050.stderr: -118> 2024-09-14T11:12:32.372+0000 7fed4ea86640 10 monclient: get_auth_request con 0x7fec18077260 auth_method 0 2024-09-14T11:12:32.878 INFO:tasks.workunit.client.0.smithi050.stderr: -117> 2024-09-14T11:12:32.372+0000 7fed47fff640 10 monclient: get_auth_request con 0x561350d7c8e0 auth_method 0 2024-09-14T11:12:32.878 INFO:tasks.workunit.client.0.smithi050.stderr: -116> 2024-09-14T11:12:32.373+0000 7fed52d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.878 INFO:tasks.workunit.client.0.smithi050.stderr: -115> 2024-09-14T11:12:32.373+0000 7fed52d40800 20 realm 2024-09-14T11:12:32.878 INFO:tasks.workunit.client.0.smithi050.stderr: -114> 2024-09-14T11:12:32.373+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.878 INFO:tasks.workunit.client.0.smithi050.stderr: -113> 2024-09-14T11:12:32.373+0000 7fed52d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.879 INFO:tasks.workunit.client.0.smithi050.stderr: -112> 2024-09-14T11:12:32.373+0000 7fed52d40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:32.879 INFO:tasks.workunit.client.0.smithi050.stderr: -111> 2024-09-14T11:12:32.373+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.879 INFO:tasks.workunit.client.0.smithi050.stderr: -110> 2024-09-14T11:12:32.373+0000 7fed52d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.879 INFO:tasks.workunit.client.0.smithi050.stderr: -109> 2024-09-14T11:12:32.373+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.879 INFO:tasks.workunit.client.0.smithi050.stderr: -108> 2024-09-14T11:12:32.374+0000 7fed4ea86640 10 monclient: get_auth_request con 0x561350d80b10 auth_method 0 2024-09-14T11:12:32.879 INFO:tasks.workunit.client.0.smithi050.stderr: -107> 2024-09-14T11:12:32.374+0000 7fed52d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:32.879 INFO:tasks.workunit.client.0.smithi050.stderr: -106> 2024-09-14T11:12:32.374+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.879 INFO:tasks.workunit.client.0.smithi050.stderr: -105> 2024-09-14T11:12:32.374+0000 7fed47fff640 10 monclient: get_auth_request con 0x561350d84350 auth_method 0 2024-09-14T11:12:32.879 INFO:tasks.workunit.client.0.smithi050.stderr: -104> 2024-09-14T11:12:32.375+0000 7fed52d40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:32.879 INFO:tasks.workunit.client.0.smithi050.stderr: -103> 2024-09-14T11:12:32.375+0000 7fed52d40800 20 searching for the correct realm 2024-09-14T11:12:32.879 INFO:tasks.workunit.client.0.smithi050.stderr: -102> 2024-09-14T11:12:32.375+0000 7fed4f287640 10 monclient: get_auth_request con 0x561350d88e20 auth_method 0 2024-09-14T11:12:32.879 INFO:tasks.workunit.client.0.smithi050.stderr: -101> 2024-09-14T11:12:32.376+0000 7fed4ea86640 10 monclient: get_auth_request con 0x561350b3d4f0 auth_method 0 2024-09-14T11:12:32.879 INFO:tasks.workunit.client.0.smithi050.stderr: -100> 2024-09-14T11:12:32.376+0000 7fed4ea86640 0 -- 172.21.15.50:0/3993628404 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x561350b3d4f0 msgr2=0x7fed4800a3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:32.879 INFO:tasks.workunit.client.0.smithi050.stderr: -99> 2024-09-14T11:12:32.578+0000 7fed4ea86640 10 monclient: get_auth_request con 0x561350b3d4f0 auth_method 0 2024-09-14T11:12:32.880 INFO:tasks.workunit.client.0.smithi050.stderr: -98> 2024-09-14T11:12:32.580+0000 7fed47fff640 10 monclient: get_auth_request con 0x561350b45f60 auth_method 0 2024-09-14T11:12:32.880 INFO:tasks.workunit.client.0.smithi050.stderr: -97> 2024-09-14T11:12:32.582+0000 7fed4f287640 10 monclient: get_auth_request con 0x7fed400a2040 auth_method 0 2024-09-14T11:12:32.880 INFO:tasks.workunit.client.0.smithi050.stderr: -96> 2024-09-14T11:12:32.582+0000 7fed4f287640 0 -- 172.21.15.50:0/3993628404 >> [v2:172.21.15.118:6826/1082138742,v1:172.21.15.118:6827/1082138742] conn(0x7fed400a2040 msgr2=0x7fed40071890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:32.880 INFO:tasks.workunit.client.0.smithi050.stderr: -95> 2024-09-14T11:12:32.784+0000 7fed4f287640 10 monclient: get_auth_request con 0x7fed400a2040 auth_method 0 2024-09-14T11:12:32.880 INFO:tasks.workunit.client.0.smithi050.stderr: -94> 2024-09-14T11:12:32.785+0000 7fed4ea86640 10 monclient: get_auth_request con 0x561350b49b00 auth_method 0 2024-09-14T11:12:32.880 INFO:tasks.workunit.client.0.smithi050.stderr: -93> 2024-09-14T11:12:32.790+0000 7fed52d40800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:12:32.880 INFO:tasks.workunit.client.0.smithi050.stderr: -92> 2024-09-14T11:12:32.791+0000 7fed52d40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:32.880 INFO:tasks.workunit.client.0.smithi050.stderr: -91> 2024-09-14T11:12:32.791+0000 7fed52d40800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:12:32.880 INFO:tasks.workunit.client.0.smithi050.stderr: -90> 2024-09-14T11:12:32.791+0000 7fed52d40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:32.880 INFO:tasks.workunit.client.0.smithi050.stderr: -89> 2024-09-14T11:12:32.791+0000 7fed52d40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:32.880 INFO:tasks.workunit.client.0.smithi050.stderr: -88> 2024-09-14T11:12:32.791+0000 7fed52d40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:32.880 INFO:tasks.workunit.client.0.smithi050.stderr: -87> 2024-09-14T11:12:32.791+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.880 INFO:tasks.workunit.client.0.smithi050.stderr: -86> 2024-09-14T11:12:32.791+0000 7fed52d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.880 INFO:tasks.workunit.client.0.smithi050.stderr: -85> 2024-09-14T11:12:32.791+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.881 INFO:tasks.workunit.client.0.smithi050.stderr: -84> 2024-09-14T11:12:32.791+0000 7fed52d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:32.881 INFO:tasks.workunit.client.0.smithi050.stderr: -83> 2024-09-14T11:12:32.791+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.881 INFO:tasks.workunit.client.0.smithi050.stderr: -82> 2024-09-14T11:12:32.792+0000 7fed52d40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:32.881 INFO:tasks.workunit.client.0.smithi050.stderr: -81> 2024-09-14T11:12:32.792+0000 7fed52d40800 20 zone default found 2024-09-14T11:12:32.881 INFO:tasks.workunit.client.0.smithi050.stderr: -80> 2024-09-14T11:12:32.792+0000 7fed52d40800 4 Realm: () 2024-09-14T11:12:32.881 INFO:tasks.workunit.client.0.smithi050.stderr: -79> 2024-09-14T11:12:32.792+0000 7fed52d40800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:12:32.881 INFO:tasks.workunit.client.0.smithi050.stderr: -78> 2024-09-14T11:12:32.792+0000 7fed52d40800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:12:32.881 INFO:tasks.workunit.client.0.smithi050.stderr: -77> 2024-09-14T11:12:32.792+0000 7fed52d40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:32.881 INFO:tasks.workunit.client.0.smithi050.stderr: -76> 2024-09-14T11:12:32.792+0000 7fed52d40800 20 zonegroup default 2024-09-14T11:12:32.881 INFO:tasks.workunit.client.0.smithi050.stderr: -75> 2024-09-14T11:12:32.792+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.881 INFO:tasks.workunit.client.0.smithi050.stderr: -74> 2024-09-14T11:12:32.792+0000 7fed52d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.881 INFO:tasks.workunit.client.0.smithi050.stderr: -73> 2024-09-14T11:12:32.792+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.881 INFO:tasks.workunit.client.0.smithi050.stderr: -72> 2024-09-14T11:12:32.792+0000 7fed52d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.881 INFO:tasks.workunit.client.0.smithi050.stderr: -71> 2024-09-14T11:12:32.792+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.881 INFO:tasks.workunit.client.0.smithi050.stderr: -70> 2024-09-14T11:12:32.793+0000 7fed52d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.881 INFO:tasks.workunit.client.0.smithi050.stderr: -69> 2024-09-14T11:12:32.793+0000 7fed52d40800 20 started sync module instance, tier type = 2024-09-14T11:12:32.882 INFO:tasks.workunit.client.0.smithi050.stderr: -68> 2024-09-14T11:12:32.793+0000 7fed52d40800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:12:32.882 INFO:tasks.workunit.client.0.smithi050.stderr: -67> 2024-09-14T11:12:32.802+0000 7fed52d40800 20 add_watcher() i=0 2024-09-14T11:12:32.882 INFO:tasks.workunit.client.0.smithi050.stderr: -66> 2024-09-14T11:12:32.802+0000 7fed52d40800 20 add_watcher() i=1 2024-09-14T11:12:32.882 INFO:tasks.workunit.client.0.smithi050.stderr: -65> 2024-09-14T11:12:32.802+0000 7fed52d40800 20 add_watcher() i=2 2024-09-14T11:12:32.882 INFO:tasks.workunit.client.0.smithi050.stderr: -64> 2024-09-14T11:12:32.802+0000 7fed52d40800 20 add_watcher() i=3 2024-09-14T11:12:32.882 INFO:tasks.workunit.client.0.smithi050.stderr: -63> 2024-09-14T11:12:32.802+0000 7fed52d40800 20 add_watcher() i=4 2024-09-14T11:12:32.882 INFO:tasks.workunit.client.0.smithi050.stderr: -62> 2024-09-14T11:12:32.802+0000 7fed52d40800 20 add_watcher() i=5 2024-09-14T11:12:32.882 INFO:tasks.workunit.client.0.smithi050.stderr: -61> 2024-09-14T11:12:32.802+0000 7fed52d40800 20 add_watcher() i=6 2024-09-14T11:12:32.882 INFO:tasks.workunit.client.0.smithi050.stderr: -60> 2024-09-14T11:12:32.803+0000 7fed52d40800 20 add_watcher() i=7 2024-09-14T11:12:32.882 INFO:tasks.workunit.client.0.smithi050.stderr: -59> 2024-09-14T11:12:32.803+0000 7fed52d40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:32.882 INFO:tasks.workunit.client.0.smithi050.stderr: -58> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding auth protocol: cephx 2024-09-14T11:12:32.882 INFO:tasks.workunit.client.0.smithi050.stderr: -57> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding auth protocol: cephx 2024-09-14T11:12:32.882 INFO:tasks.workunit.client.0.smithi050.stderr: -56> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding auth protocol: cephx 2024-09-14T11:12:32.882 INFO:tasks.workunit.client.0.smithi050.stderr: -55> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding con mode: secure 2024-09-14T11:12:32.882 INFO:tasks.workunit.client.0.smithi050.stderr: -54> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding con mode: crc 2024-09-14T11:12:32.883 INFO:tasks.workunit.client.0.smithi050.stderr: -53> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding con mode: secure 2024-09-14T11:12:32.883 INFO:tasks.workunit.client.0.smithi050.stderr: -52> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding con mode: crc 2024-09-14T11:12:32.883 INFO:tasks.workunit.client.0.smithi050.stderr: -51> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding con mode: secure 2024-09-14T11:12:32.883 INFO:tasks.workunit.client.0.smithi050.stderr: -50> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding con mode: crc 2024-09-14T11:12:32.883 INFO:tasks.workunit.client.0.smithi050.stderr: -49> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding con mode: crc 2024-09-14T11:12:32.883 INFO:tasks.workunit.client.0.smithi050.stderr: -48> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding con mode: secure 2024-09-14T11:12:32.883 INFO:tasks.workunit.client.0.smithi050.stderr: -47> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding con mode: crc 2024-09-14T11:12:32.883 INFO:tasks.workunit.client.0.smithi050.stderr: -46> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding con mode: secure 2024-09-14T11:12:32.883 INFO:tasks.workunit.client.0.smithi050.stderr: -45> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding con mode: crc 2024-09-14T11:12:32.883 INFO:tasks.workunit.client.0.smithi050.stderr: -44> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding con mode: secure 2024-09-14T11:12:32.883 INFO:tasks.workunit.client.0.smithi050.stderr: -43> 2024-09-14T11:12:32.804+0000 7fec057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:32.883 INFO:tasks.workunit.client.0.smithi050.stderr: -42> 2024-09-14T11:12:32.805+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.883 INFO:tasks.workunit.client.0.smithi050.stderr: -41> 2024-09-14T11:12:32.805+0000 7fed52d40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:32.883 INFO:tasks.workunit.client.0.smithi050.stderr: -40> 2024-09-14T11:12:32.805+0000 7fed52d40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:32.883 INFO:tasks.workunit.client.0.smithi050.stderr: -39> 2024-09-14T11:12:32.805+0000 7fed52d40800 5 asok(0x561350a71270) register_command cache list hook 0x561350d57210 2024-09-14T11:12:32.883 INFO:tasks.workunit.client.0.smithi050.stderr: -38> 2024-09-14T11:12:32.805+0000 7fed52d40800 5 asok(0x561350a71270) register_command cache inspect hook 0x561350d57210 2024-09-14T11:12:32.884 INFO:tasks.workunit.client.0.smithi050.stderr: -37> 2024-09-14T11:12:32.805+0000 7fed52d40800 5 asok(0x561350a71270) register_command cache erase hook 0x561350d57210 2024-09-14T11:12:32.884 INFO:tasks.workunit.client.0.smithi050.stderr: -36> 2024-09-14T11:12:32.805+0000 7fed52d40800 5 asok(0x561350a71270) register_command cache zap hook 0x561350d57210 2024-09-14T11:12:32.884 INFO:tasks.workunit.client.0.smithi050.stderr: -35> 2024-09-14T11:12:32.805+0000 7fed52d40800 5 note: GC not initialized 2024-09-14T11:12:32.884 INFO:tasks.workunit.client.0.smithi050.stderr: -34> 2024-09-14T11:12:32.805+0000 7feb7ffff640 20 reqs_thread_entry: start 2024-09-14T11:12:32.884 INFO:tasks.workunit.client.0.smithi050.stderr: -33> 2024-09-14T11:12:32.805+0000 7fed52d40800 5 asok(0x561350a71270) register_command sync trace show hook 0x7fed4806d020 2024-09-14T11:12:32.884 INFO:tasks.workunit.client.0.smithi050.stderr: -32> 2024-09-14T11:12:32.805+0000 7fed52d40800 5 asok(0x561350a71270) register_command sync trace history hook 0x7fed4806d020 2024-09-14T11:12:32.884 INFO:tasks.workunit.client.0.smithi050.stderr: -31> 2024-09-14T11:12:32.805+0000 7fed52d40800 5 asok(0x561350a71270) register_command sync trace active hook 0x7fed4806d020 2024-09-14T11:12:32.884 INFO:tasks.workunit.client.0.smithi050.stderr: -30> 2024-09-14T11:12:32.805+0000 7fed52d40800 5 asok(0x561350a71270) register_command sync trace active_short hook 0x7fed4806d020 2024-09-14T11:12:32.884 INFO:tasks.workunit.client.0.smithi050.stderr: -29> 2024-09-14T11:12:32.805+0000 7fed52d40800 20 init_complete bucket index max shards: 11 2024-09-14T11:12:32.884 INFO:tasks.workunit.client.0.smithi050.stderr: -28> 2024-09-14T11:12:32.805+0000 7fed52d40800 20 Filter name: none 2024-09-14T11:12:32.884 INFO:tasks.workunit.client.0.smithi050.stderr: -27> 2024-09-14T11:12:32.805+0000 7feb7dffb640 20 reqs_thread_entry: start 2024-09-14T11:12:32.884 INFO:tasks.workunit.client.0.smithi050.stderr: -26> 2024-09-14T11:12:32.805+0000 7fed52d40800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:12:32.884 INFO:tasks.workunit.client.0.smithi050.stderr: -25> 2024-09-14T11:12:32.805+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.884 INFO:tasks.workunit.client.0.smithi050.stderr: -24> 2024-09-14T11:12:32.806+0000 7fed52d40800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:12:32.885 INFO:tasks.workunit.client.0.smithi050.stderr: -23> 2024-09-14T11:12:32.806+0000 7fed52d40800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:12:32.885 INFO:tasks.workunit.client.0.smithi050.stderr: -22> 2024-09-14T11:12:32.806+0000 7fed52d40800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:12:32.885 INFO:tasks.workunit.client.0.smithi050.stderr: -21> 2024-09-14T11:12:32.806+0000 7fed52d40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 : miss 2024-09-14T11:12:32.885 INFO:tasks.workunit.client.0.smithi050.stderr: -20> 2024-09-14T11:12:32.806+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.885 INFO:tasks.workunit.client.0.smithi050.stderr: -19> 2024-09-14T11:12:32.806+0000 7fed52d40800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:12:32.885 INFO:tasks.workunit.client.0.smithi050.stderr: -18> 2024-09-14T11:12:32.806+0000 7fed52d40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 info.flags=0x17 2024-09-14T11:12:32.885 INFO:tasks.workunit.client.0.smithi050.stderr: -17> 2024-09-14T11:12:32.806+0000 7fed52d40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 to cache LRU end 2024-09-14T11:12:32.885 INFO:tasks.workunit.client.0.smithi050.stderr: -16> 2024-09-14T11:12:32.806+0000 7fed52d40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:32.885 INFO:tasks.workunit.client.0.smithi050.stderr: -15> 2024-09-14T11:12:32.806+0000 7fed52d40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:32.885 INFO:tasks.workunit.client.0.smithi050.stderr: -14> 2024-09-14T11:12:32.806+0000 7fed52d40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 2024-09-14T11:12:32.885 INFO:tasks.workunit.client.0.smithi050.stderr: -13> 2024-09-14T11:12:32.812+0000 7fed52d40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 info.flags=0x17 2024-09-14T11:12:32.885 INFO:tasks.workunit.client.0.smithi050.stderr: -12> 2024-09-14T11:12:32.812+0000 7fed52d40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 to cache LRU end 2024-09-14T11:12:32.886 INFO:tasks.workunit.client.0.smithi050.stderr: -11> 2024-09-14T11:12:32.812+0000 7fed52d40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:32.886 INFO:tasks.workunit.client.0.smithi050.stderr: -10> 2024-09-14T11:12:32.812+0000 7fed52d40800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35, ofs0, ns] 2024-09-14T11:12:32.886 INFO:tasks.workunit.client.0.smithi050.stderr: -9> 2024-09-14T11:12:32.812+0000 7fec31ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496985 cookie 94640960754832 notifier 7596 bl.length()=995 2024-09-14T11:12:32.886 INFO:tasks.workunit.client.0.smithi050.stderr: -8> 2024-09-14T11:12:32.812+0000 7fec31ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 info.flags=0x17 2024-09-14T11:12:32.886 INFO:tasks.workunit.client.0.smithi050.stderr: -7> 2024-09-14T11:12:32.812+0000 7fec31ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 to cache LRU end 2024-09-14T11:12:32.886 INFO:tasks.workunit.client.0.smithi050.stderr: -6> 2024-09-14T11:12:32.812+0000 7fec31ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:32.886 INFO:tasks.workunit.client.0.smithi050.stderr: -5> 2024-09-14T11:12:32.814+0000 7fed52d40800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35]): orig_sources= new_sources= 2024-09-14T11:12:32.886 INFO:tasks.workunit.client.0.smithi050.stderr: -4> 2024-09-14T11:12:32.814+0000 7fed52d40800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35]): potential sources added=[] removed=[] 2024-09-14T11:12:32.886 INFO:tasks.workunit.client.0.smithi050.stderr: -3> 2024-09-14T11:12:32.814+0000 7fed52d40800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35]): orig_dests= new_dests= 2024-09-14T11:12:32.886 INFO:tasks.workunit.client.0.smithi050.stderr: -2> 2024-09-14T11:12:32.814+0000 7fed52d40800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35]): potential dests added=[] removed=[] 2024-09-14T11:12:32.886 INFO:tasks.workunit.client.0.smithi050.stderr: -1> 2024-09-14T11:12:32.820+0000 7fed52d40800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fed52d40800 time 2024-09-14T11:12:32.820116+0000 2024-09-14T11:12:32.886 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:12:32.886 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.886 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:12:32.886 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fed5458c76a] 2024-09-14T11:12:32.887 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fed5458c928] 2024-09-14T11:12:32.887 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56134ef050b1] 2024-09-14T11:12:32.887 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56134ef14f6a] 2024-09-14T11:12:32.887 INFO:tasks.workunit.client.0.smithi050.stderr: 5: main() 2024-09-14T11:12:32.887 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fed53229590] 2024-09-14T11:12:32.887 INFO:tasks.workunit.client.0.smithi050.stderr: 7: __libc_start_main() 2024-09-14T11:12:32.887 INFO:tasks.workunit.client.0.smithi050.stderr: 8: _start() 2024-09-14T11:12:32.887 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.887 INFO:tasks.workunit.client.0.smithi050.stderr: 0> 2024-09-14T11:12:32.821+0000 7fed52d40800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:12:32.887 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7fed52d40800 thread_name:radosgw-admin 2024-09-14T11:12:32.887 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.887 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:12:32.887 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fed5323e6f0] 2024-09-14T11:12:32.887 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fed5328b99c] 2024-09-14T11:12:32.887 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:12:32.888 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:12:32.888 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fed5458c7c4] 2024-09-14T11:12:32.888 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fed5458c928] 2024-09-14T11:12:32.888 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56134ef050b1] 2024-09-14T11:12:32.888 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56134ef14f6a] 2024-09-14T11:12:32.888 INFO:tasks.workunit.client.0.smithi050.stderr: 9: main() 2024-09-14T11:12:32.888 INFO:tasks.workunit.client.0.smithi050.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fed53229590] 2024-09-14T11:12:32.888 INFO:tasks.workunit.client.0.smithi050.stderr: 11: __libc_start_main() 2024-09-14T11:12:32.888 INFO:tasks.workunit.client.0.smithi050.stderr: 12: _start() 2024-09-14T11:12:32.888 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:12:32.888 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.888 INFO:tasks.workunit.client.0.smithi050.stderr:--- logging levels --- 2024-09-14T11:12:32.888 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 none 2024-09-14T11:12:32.888 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 lockdep 2024-09-14T11:12:32.888 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 context 2024-09-14T11:12:32.889 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 crush 2024-09-14T11:12:32.889 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds 2024-09-14T11:12:32.889 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_balancer 2024-09-14T11:12:32.889 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_locker 2024-09-14T11:12:32.889 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log 2024-09-14T11:12:32.889 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log_expire 2024-09-14T11:12:32.889 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_migrator 2024-09-14T11:12:32.889 INFO:tasks.workunit.client.0.smithi050.stderr: 3/ 5 mds_quiesce 2024-09-14T11:12:32.889 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 buffer 2024-09-14T11:12:32.889 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 timer 2024-09-14T11:12:32.889 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 filer 2024-09-14T11:12:32.889 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 striper 2024-09-14T11:12:32.889 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 objecter 2024-09-14T11:12:32.889 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rados 2024-09-14T11:12:32.889 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd 2024-09-14T11:12:32.890 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_mirror 2024-09-14T11:12:32.890 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_replay 2024-09-14T11:12:32.890 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_pwl 2024-09-14T11:12:32.890 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 journaler 2024-09-14T11:12:32.890 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objectcacher 2024-09-14T11:12:32.890 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:12:32.890 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 client 2024-09-14T11:12:32.890 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 osd 2024-09-14T11:12:32.890 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 optracker 2024-09-14T11:12:32.890 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objclass 2024-09-14T11:12:32.890 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 filestore 2024-09-14T11:12:32.890 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 journal 2024-09-14T11:12:32.890 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 ms 2024-09-14T11:12:32.890 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mon 2024-09-14T11:12:32.891 INFO:tasks.workunit.client.0.smithi050.stderr: 0/10 monc 2024-09-14T11:12:32.891 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 paxos 2024-09-14T11:12:32.891 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 tp 2024-09-14T11:12:32.891 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 auth 2024-09-14T11:12:32.891 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 crypto 2024-09-14T11:12:32.891 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 finisher 2024-09-14T11:12:32.891 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 reserver 2024-09-14T11:12:32.891 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 heartbeatmap 2024-09-14T11:12:32.891 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 perfcounter 2024-09-14T11:12:32.891 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw 2024-09-14T11:12:32.891 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_sync 2024-09-14T11:12:32.891 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_datacache 2024-09-14T11:12:32.891 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_access 2024-09-14T11:12:32.891 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:12:32.892 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_flight 2024-09-14T11:12:32.892 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:12:32.892 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw_notification 2024-09-14T11:12:32.892 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 javaclient 2024-09-14T11:12:32.892 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 asok 2024-09-14T11:12:32.892 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 throttle 2024-09-14T11:12:32.892 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 refs 2024-09-14T11:12:32.892 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 compressor 2024-09-14T11:12:32.892 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluestore 2024-09-14T11:12:32.892 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluefs 2024-09-14T11:12:32.892 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 bdev 2024-09-14T11:12:32.892 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 kstore 2024-09-14T11:12:32.892 INFO:tasks.workunit.client.0.smithi050.stderr: 4/ 5 rocksdb 2024-09-14T11:12:32.892 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 fuse 2024-09-14T11:12:32.893 INFO:tasks.workunit.client.0.smithi050.stderr: 2/ 5 mgr 2024-09-14T11:12:32.893 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mgrc 2024-09-14T11:12:32.893 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 dpdk 2024-09-14T11:12:32.893 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 eventtrace 2024-09-14T11:12:32.893 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 prioritycache 2024-09-14T11:12:32.893 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 test 2024-09-14T11:12:32.893 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:12:32.893 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephsqlite 2024-09-14T11:12:32.893 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:12:32.893 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore 2024-09-14T11:12:32.893 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_onode 2024-09-14T11:12:32.893 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_odata 2024-09-14T11:12:32.893 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_omap 2024-09-14T11:12:32.893 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_tm 2024-09-14T11:12:32.893 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_t 2024-09-14T11:12:32.894 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:12:32.894 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_epm 2024-09-14T11:12:32.894 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_lba 2024-09-14T11:12:32.894 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:12:32.894 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cache 2024-09-14T11:12:32.894 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_journal 2024-09-14T11:12:32.894 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_device 2024-09-14T11:12:32.894 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_backref 2024-09-14T11:12:32.894 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 alienstore 2024-09-14T11:12:32.894 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mclock 2024-09-14T11:12:32.894 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cyanstore 2024-09-14T11:12:32.894 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 ceph_exporter 2024-09-14T11:12:32.894 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 memstore 2024-09-14T11:12:32.894 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 trace 2024-09-14T11:12:32.894 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 ceph_dedup 2024-09-14T11:12:32.895 INFO:tasks.workunit.client.0.smithi050.stderr: -2/-2 (syslog threshold) 2024-09-14T11:12:32.895 INFO:tasks.workunit.client.0.smithi050.stderr: 99/99 (stderr threshold) 2024-09-14T11:12:32.895 INFO:tasks.workunit.client.0.smithi050.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:12:32.895 INFO:tasks.workunit.client.0.smithi050.stderr: 7feb7dffb640 / http_manager 2024-09-14T11:12:32.895 INFO:tasks.workunit.client.0.smithi050.stderr: 7feb7ffff640 / http_manager 2024-09-14T11:12:32.895 INFO:tasks.workunit.client.0.smithi050.stderr: 7fec057e2640 / rgw_dt_lg_renew 2024-09-14T11:12:32.895 INFO:tasks.workunit.client.0.smithi050.stderr: 7fec30ff9640 / ms_dispatch 2024-09-14T11:12:32.895 INFO:tasks.workunit.client.0.smithi050.stderr: 7fec31ffb640 / io_context_pool 2024-09-14T11:12:32.895 INFO:tasks.workunit.client.0.smithi050.stderr: 7fec327fc640 / io_context_pool 2024-09-14T11:12:32.895 INFO:tasks.workunit.client.0.smithi050.stderr: 7fec38e01640 / ms_dispatch 2024-09-14T11:12:32.895 INFO:tasks.workunit.client.0.smithi050.stderr: 7fec3b606640 / ms_dispatch 2024-09-14T11:12:32.895 INFO:tasks.workunit.client.0.smithi050.stderr: 7fec3ce09640 / io_context_pool 2024-09-14T11:12:32.895 INFO:tasks.workunit.client.0.smithi050.stderr: 7fed47fff640 / msgr-worker-2 2024-09-14T11:12:32.895 INFO:tasks.workunit.client.0.smithi050.stderr: 7fed4ea86640 / msgr-worker-1 2024-09-14T11:12:32.895 INFO:tasks.workunit.client.0.smithi050.stderr: 7fed4f287640 / msgr-worker-0 2024-09-14T11:12:32.896 INFO:tasks.workunit.client.0.smithi050.stderr: 7fed4fa88640 / io_context_pool 2024-09-14T11:12:32.896 INFO:tasks.workunit.client.0.smithi050.stderr: 7fed52d40800 / radosgw-admin 2024-09-14T11:12:32.896 INFO:tasks.workunit.client.0.smithi050.stderr: max_recent 500 2024-09-14T11:12:32.896 INFO:tasks.workunit.client.0.smithi050.stderr: max_new 1000 2024-09-14T11:12:32.896 INFO:tasks.workunit.client.0.smithi050.stderr: log_file /var/log/ceph/ceph-client.admin.128482.log 2024-09-14T11:12:32.896 INFO:tasks.workunit.client.0.smithi050.stderr:--- end dump of recent events --- 2024-09-14T11:12:32.896 INFO:tasks.workunit.client.0.smithi050.stderr:--- begin dump of recent events --- 2024-09-14T11:12:32.896 INFO:tasks.workunit.client.0.smithi050.stderr: -499> 2024-09-14T11:12:32.354+0000 7fed4ea86640 1 monclient: found mon.noname-a 2024-09-14T11:12:32.896 INFO:tasks.workunit.client.0.smithi050.stderr: -498> 2024-09-14T11:12:32.354+0000 7fed4ea86640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:12:32.896 INFO:tasks.workunit.client.0.smithi050.stderr: -497> 2024-09-14T11:12:32.354+0000 7fec3ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:12:32.896 INFO:tasks.workunit.client.0.smithi050.stderr: -496> 2024-09-14T11:12:32.354+0000 7fec3ce09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:12:32.896 INFO:tasks.workunit.client.0.smithi050.stderr: -495> 2024-09-14T11:12:32.354+0000 7fec3ce09640 10 monclient: dump: 2024-09-14T11:12:32.896 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:12:32.897 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:12:32.897 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.897 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.897 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:12:32.897 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.897 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:12:32.897 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:12:32.897 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:12:32.897 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.897 INFO:tasks.workunit.client.0.smithi050.stderr: -494> 2024-09-14T11:12:32.354+0000 7fec3ce09640 10 monclient: _finish_auth 0 2024-09-14T11:12:32.897 INFO:tasks.workunit.client.0.smithi050.stderr: -493> 2024-09-14T11:12:32.354+0000 7fec3ce09640 10 monclient: _check_auth_tickets 2024-09-14T11:12:32.897 INFO:tasks.workunit.client.0.smithi050.stderr: -492> 2024-09-14T11:12:32.354+0000 7fec3ce09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:12:32.897 INFO:tasks.workunit.client.0.smithi050.stderr: -491> 2024-09-14T11:12:32.354+0000 7fec3ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:12:32.898 INFO:tasks.workunit.client.0.smithi050.stderr: -490> 2024-09-14T11:12:32.354+0000 7fec3ce09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:12:32.898 INFO:tasks.workunit.client.0.smithi050.stderr: -489> 2024-09-14T11:12:32.354+0000 7fec3ce09640 10 monclient: dump: 2024-09-14T11:12:32.898 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:12:32.898 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:12:32.898 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.898 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.898 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:12:32.898 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.898 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:12:32.898 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:12:32.898 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:12:32.898 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.898 INFO:tasks.workunit.client.0.smithi050.stderr: -488> 2024-09-14T11:12:32.354+0000 7fed52d40800 5 monclient: authenticate success, global_id 7584 2024-09-14T11:12:32.898 INFO:tasks.workunit.client.0.smithi050.stderr: -487> 2024-09-14T11:12:32.354+0000 7fed52d40800 10 monclient: get_monmap_and_config success 2024-09-14T11:12:32.898 INFO:tasks.workunit.client.0.smithi050.stderr: -486> 2024-09-14T11:12:32.354+0000 7fed52d40800 4 set_mon_vals no callback set 2024-09-14T11:12:32.899 INFO:tasks.workunit.client.0.smithi050.stderr: -485> 2024-09-14T11:12:32.354+0000 7fed52d40800 10 monclient: shutdown 2024-09-14T11:12:32.899 INFO:tasks.workunit.client.0.smithi050.stderr: -484> 2024-09-14T11:12:32.354+0000 7fed52d40800 5 asok(0x561350a71270) unregister_commands rotate-key 2024-09-14T11:12:32.899 INFO:tasks.workunit.client.0.smithi050.stderr: -483> 2024-09-14T11:12:32.355+0000 7fed52d40800 10 monclient: build_initial_monmap 2024-09-14T11:12:32.899 INFO:tasks.workunit.client.0.smithi050.stderr: -482> 2024-09-14T11:12:32.355+0000 7fed52d40800 1 build_initial for_mkfs: 0 2024-09-14T11:12:32.899 INFO:tasks.workunit.client.0.smithi050.stderr: -481> 2024-09-14T11:12:32.355+0000 7fed52d40800 10 monclient: monmap: 2024-09-14T11:12:32.899 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:12:32.899 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:12:32.899 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:12:32.899 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:12:32.899 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:12:32.899 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.899 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:12:32.899 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:12:32.899 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:12:32.900 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.900 INFO:tasks.workunit.client.0.smithi050.stderr: -480> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding auth protocol: cephx 2024-09-14T11:12:32.900 INFO:tasks.workunit.client.0.smithi050.stderr: -479> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding auth protocol: cephx 2024-09-14T11:12:32.900 INFO:tasks.workunit.client.0.smithi050.stderr: -478> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding auth protocol: cephx 2024-09-14T11:12:32.900 INFO:tasks.workunit.client.0.smithi050.stderr: -477> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding con mode: secure 2024-09-14T11:12:32.900 INFO:tasks.workunit.client.0.smithi050.stderr: -476> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding con mode: crc 2024-09-14T11:12:32.900 INFO:tasks.workunit.client.0.smithi050.stderr: -475> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding con mode: secure 2024-09-14T11:12:32.900 INFO:tasks.workunit.client.0.smithi050.stderr: -474> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding con mode: crc 2024-09-14T11:12:32.900 INFO:tasks.workunit.client.0.smithi050.stderr: -473> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding con mode: secure 2024-09-14T11:12:32.900 INFO:tasks.workunit.client.0.smithi050.stderr: -472> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding con mode: crc 2024-09-14T11:12:32.900 INFO:tasks.workunit.client.0.smithi050.stderr: -471> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding con mode: crc 2024-09-14T11:12:32.900 INFO:tasks.workunit.client.0.smithi050.stderr: -470> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding con mode: secure 2024-09-14T11:12:32.900 INFO:tasks.workunit.client.0.smithi050.stderr: -469> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding con mode: crc 2024-09-14T11:12:32.900 INFO:tasks.workunit.client.0.smithi050.stderr: -468> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding con mode: secure 2024-09-14T11:12:32.901 INFO:tasks.workunit.client.0.smithi050.stderr: -467> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding con mode: crc 2024-09-14T11:12:32.901 INFO:tasks.workunit.client.0.smithi050.stderr: -466> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c962f0) adding con mode: secure 2024-09-14T11:12:32.901 INFO:tasks.workunit.client.0.smithi050.stderr: -465> 2024-09-14T11:12:32.355+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.901 INFO:tasks.workunit.client.0.smithi050.stderr: -464> 2024-09-14T11:12:32.355+0000 7fed52d40800 1 librados: starting msgr at 2024-09-14T11:12:32.901 INFO:tasks.workunit.client.0.smithi050.stderr: -463> 2024-09-14T11:12:32.355+0000 7fed52d40800 1 librados: starting objecter 2024-09-14T11:12:32.901 INFO:tasks.workunit.client.0.smithi050.stderr: -462> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 asok(0x561350a71270) register_command objecter_requests hook 0x561350cba380 2024-09-14T11:12:32.901 INFO:tasks.workunit.client.0.smithi050.stderr: -461> 2024-09-14T11:12:32.355+0000 7fed52d40800 1 librados: setting wanted keys 2024-09-14T11:12:32.901 INFO:tasks.workunit.client.0.smithi050.stderr: -460> 2024-09-14T11:12:32.355+0000 7fed52d40800 1 librados: calling monclient init 2024-09-14T11:12:32.901 INFO:tasks.workunit.client.0.smithi050.stderr: -459> 2024-09-14T11:12:32.355+0000 7fed52d40800 10 monclient: init 2024-09-14T11:12:32.901 INFO:tasks.workunit.client.0.smithi050.stderr: -458> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding auth protocol: cephx 2024-09-14T11:12:32.901 INFO:tasks.workunit.client.0.smithi050.stderr: -457> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding auth protocol: cephx 2024-09-14T11:12:32.901 INFO:tasks.workunit.client.0.smithi050.stderr: -456> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding auth protocol: cephx 2024-09-14T11:12:32.901 INFO:tasks.workunit.client.0.smithi050.stderr: -455> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding con mode: secure 2024-09-14T11:12:32.901 INFO:tasks.workunit.client.0.smithi050.stderr: -454> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding con mode: crc 2024-09-14T11:12:32.902 INFO:tasks.workunit.client.0.smithi050.stderr: -453> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding con mode: secure 2024-09-14T11:12:32.902 INFO:tasks.workunit.client.0.smithi050.stderr: -452> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding con mode: crc 2024-09-14T11:12:32.902 INFO:tasks.workunit.client.0.smithi050.stderr: -451> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding con mode: secure 2024-09-14T11:12:32.902 INFO:tasks.workunit.client.0.smithi050.stderr: -450> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding con mode: crc 2024-09-14T11:12:32.902 INFO:tasks.workunit.client.0.smithi050.stderr: -449> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding con mode: crc 2024-09-14T11:12:32.902 INFO:tasks.workunit.client.0.smithi050.stderr: -448> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding con mode: secure 2024-09-14T11:12:32.902 INFO:tasks.workunit.client.0.smithi050.stderr: -447> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding con mode: crc 2024-09-14T11:12:32.902 INFO:tasks.workunit.client.0.smithi050.stderr: -446> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding con mode: secure 2024-09-14T11:12:32.902 INFO:tasks.workunit.client.0.smithi050.stderr: -445> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding con mode: crc 2024-09-14T11:12:32.902 INFO:tasks.workunit.client.0.smithi050.stderr: -444> 2024-09-14T11:12:32.355+0000 7fed52d40800 5 AuthRegistry(0x561350c906f0) adding con mode: secure 2024-09-14T11:12:32.902 INFO:tasks.workunit.client.0.smithi050.stderr: -443> 2024-09-14T11:12:32.355+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.902 INFO:tasks.workunit.client.0.smithi050.stderr: -442> 2024-09-14T11:12:32.356+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.902 INFO:tasks.workunit.client.0.smithi050.stderr: -441> 2024-09-14T11:12:32.356+0000 7fed52d40800 5 asok(0x561350a71270) register_command rotate-key hook 0x561350c90838 2024-09-14T11:12:32.902 INFO:tasks.workunit.client.0.smithi050.stderr: -440> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient: _reopen_session rank -1 2024-09-14T11:12:32.902 INFO:tasks.workunit.client.0.smithi050.stderr: -439> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:12:32.903 INFO:tasks.workunit.client.0.smithi050.stderr: -438> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient(hunting): picked mon.noname-b con 0x561350c93ca0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:12:32.903 INFO:tasks.workunit.client.0.smithi050.stderr: -437> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient(hunting): picked mon.noname-a con 0x561350cc26c0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:12:32.903 INFO:tasks.workunit.client.0.smithi050.stderr: -436> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient(hunting): picked mon.noname-c con 0x7fed3c003b70 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:12:32.903 INFO:tasks.workunit.client.0.smithi050.stderr: -435> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:12:32.903 INFO:tasks.workunit.client.0.smithi050.stderr: -434> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:12:32.903 INFO:tasks.workunit.client.0.smithi050.stderr: -433> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:12:32.903 INFO:tasks.workunit.client.0.smithi050.stderr: -432> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient(hunting): _renew_subs 2024-09-14T11:12:32.903 INFO:tasks.workunit.client.0.smithi050.stderr: -431> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient(hunting): authenticate will time out at 2404.993165s 2024-09-14T11:12:32.903 INFO:tasks.workunit.client.0.smithi050.stderr: -430> 2024-09-14T11:12:32.356+0000 7fed4f287640 10 monclient(hunting): get_auth_request con 0x7fed3c003b70 auth_method 0 2024-09-14T11:12:32.903 INFO:tasks.workunit.client.0.smithi050.stderr: -429> 2024-09-14T11:12:32.356+0000 7fed4f287640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:12:32.903 INFO:tasks.workunit.client.0.smithi050.stderr: -428> 2024-09-14T11:12:32.356+0000 7fed4f287640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:12:32.903 INFO:tasks.workunit.client.0.smithi050.stderr: -427> 2024-09-14T11:12:32.356+0000 7fed4f287640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:12:32.903 INFO:tasks.workunit.client.0.smithi050.stderr: -426> 2024-09-14T11:12:32.356+0000 7fed47fff640 10 monclient(hunting): get_auth_request con 0x561350cc26c0 auth_method 0 2024-09-14T11:12:32.903 INFO:tasks.workunit.client.0.smithi050.stderr: -425> 2024-09-14T11:12:32.356+0000 7fed47fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:12:32.903 INFO:tasks.workunit.client.0.smithi050.stderr: -424> 2024-09-14T11:12:32.356+0000 7fed47fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:12:32.904 INFO:tasks.workunit.client.0.smithi050.stderr: -423> 2024-09-14T11:12:32.356+0000 7fed47fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:12:32.904 INFO:tasks.workunit.client.0.smithi050.stderr: -422> 2024-09-14T11:12:32.356+0000 7fed4f287640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:12:32.904 INFO:tasks.workunit.client.0.smithi050.stderr: -421> 2024-09-14T11:12:32.356+0000 7fed4f287640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:12:32.904 INFO:tasks.workunit.client.0.smithi050.stderr: -420> 2024-09-14T11:12:32.356+0000 7fed4f287640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:12:32.904 INFO:tasks.workunit.client.0.smithi050.stderr: -419> 2024-09-14T11:12:32.356+0000 7fed47fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:12:32.904 INFO:tasks.workunit.client.0.smithi050.stderr: -418> 2024-09-14T11:12:32.356+0000 7fed47fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:12:32.904 INFO:tasks.workunit.client.0.smithi050.stderr: -417> 2024-09-14T11:12:32.356+0000 7fed47fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:12:32.904 INFO:tasks.workunit.client.0.smithi050.stderr: -416> 2024-09-14T11:12:32.356+0000 7fed4ea86640 10 monclient(hunting): get_auth_request con 0x561350c93ca0 auth_method 0 2024-09-14T11:12:32.904 INFO:tasks.workunit.client.0.smithi050.stderr: -415> 2024-09-14T11:12:32.356+0000 7fed4ea86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:12:32.904 INFO:tasks.workunit.client.0.smithi050.stderr: -414> 2024-09-14T11:12:32.356+0000 7fed4ea86640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:12:32.904 INFO:tasks.workunit.client.0.smithi050.stderr: -413> 2024-09-14T11:12:32.356+0000 7fed4ea86640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:12:32.904 INFO:tasks.workunit.client.0.smithi050.stderr: -412> 2024-09-14T11:12:32.356+0000 7fed4f287640 10 monclient(hunting): handle_auth_done global_id 7121 payload 824 2024-09-14T11:12:32.904 INFO:tasks.workunit.client.0.smithi050.stderr: -411> 2024-09-14T11:12:32.356+0000 7fed4f287640 10 monclient: _finish_hunting 0 2024-09-14T11:12:32.904 INFO:tasks.workunit.client.0.smithi050.stderr: -410> 2024-09-14T11:12:32.356+0000 7fed4f287640 1 monclient: found mon.noname-c 2024-09-14T11:12:32.905 INFO:tasks.workunit.client.0.smithi050.stderr: -409> 2024-09-14T11:12:32.356+0000 7fed4f287640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:12:32.905 INFO:tasks.workunit.client.0.smithi050.stderr: -408> 2024-09-14T11:12:32.356+0000 7fec3b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:12:32.905 INFO:tasks.workunit.client.0.smithi050.stderr: -407> 2024-09-14T11:12:32.356+0000 7fec3b606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:12:32.905 INFO:tasks.workunit.client.0.smithi050.stderr: -406> 2024-09-14T11:12:32.356+0000 7fec3b606640 10 monclient: dump: 2024-09-14T11:12:32.905 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:12:32.905 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:12:32.905 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.905 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.905 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:12:32.905 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.905 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:12:32.905 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:12:32.906 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:12:32.906 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.906 INFO:tasks.workunit.client.0.smithi050.stderr: -405> 2024-09-14T11:12:32.356+0000 7fec3b606640 10 monclient: _finish_auth 0 2024-09-14T11:12:32.906 INFO:tasks.workunit.client.0.smithi050.stderr: -404> 2024-09-14T11:12:32.356+0000 7fec3b606640 10 monclient: _check_auth_tickets 2024-09-14T11:12:32.906 INFO:tasks.workunit.client.0.smithi050.stderr: -403> 2024-09-14T11:12:32.356+0000 7fec3b606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:12:32.906 INFO:tasks.workunit.client.0.smithi050.stderr: -402> 2024-09-14T11:12:32.356+0000 7fec3b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:12:32.906 INFO:tasks.workunit.client.0.smithi050.stderr: -401> 2024-09-14T11:12:32.356+0000 7fec3b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:12:32.906 INFO:tasks.workunit.client.0.smithi050.stderr: -400> 2024-09-14T11:12:32.356+0000 7fec3b606640 10 monclient: dump: 2024-09-14T11:12:32.906 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:12:32.906 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:12:32.906 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.906 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.906 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:12:32.906 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.907 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:12:32.907 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:12:32.907 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:12:32.907 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.907 INFO:tasks.workunit.client.0.smithi050.stderr: -399> 2024-09-14T11:12:32.356+0000 7fed52d40800 5 monclient: authenticate success, global_id 7121 2024-09-14T11:12:32.907 INFO:tasks.workunit.client.0.smithi050.stderr: -398> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient: _renew_subs 2024-09-14T11:12:32.907 INFO:tasks.workunit.client.0.smithi050.stderr: -397> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:12:32.907 INFO:tasks.workunit.client.0.smithi050.stderr: -396> 2024-09-14T11:12:32.356+0000 7fec3ce09640 4 set_mon_vals no callback set 2024-09-14T11:12:32.907 INFO:tasks.workunit.client.0.smithi050.stderr: -395> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient: _renew_subs 2024-09-14T11:12:32.907 INFO:tasks.workunit.client.0.smithi050.stderr: -394> 2024-09-14T11:12:32.356+0000 7fed52d40800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:12:32.907 INFO:tasks.workunit.client.0.smithi050.stderr: -393> 2024-09-14T11:12:32.357+0000 7fed52d40800 1 librados: init done 2024-09-14T11:12:32.908 INFO:tasks.workunit.client.0.smithi050.stderr: -392> 2024-09-14T11:12:32.358+0000 7fec3b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:12:32.908 INFO:tasks.workunit.client.0.smithi050.stderr: -391> 2024-09-14T11:12:32.358+0000 7fec3b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:12:32.908 INFO:tasks.workunit.client.0.smithi050.stderr: -390> 2024-09-14T11:12:32.359+0000 7fec3b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:12:32.908 INFO:tasks.workunit.client.0.smithi050.stderr: -389> 2024-09-14T11:12:32.359+0000 7fed4ea86640 10 monclient: get_auth_request con 0x7fec34077230 auth_method 0 2024-09-14T11:12:32.908 INFO:tasks.workunit.client.0.smithi050.stderr: -388> 2024-09-14T11:12:32.359+0000 7fed47fff640 10 monclient: get_auth_request con 0x561350cdab30 auth_method 0 2024-09-14T11:12:32.908 INFO:tasks.workunit.client.0.smithi050.stderr: -387> 2024-09-14T11:12:32.360+0000 7fed4ea86640 10 monclient: get_auth_request con 0x561350cddd10 auth_method 0 2024-09-14T11:12:32.908 INFO:tasks.workunit.client.0.smithi050.stderr: -386> 2024-09-14T11:12:32.361+0000 7fed47fff640 10 monclient: get_auth_request con 0x561350ce1f00 auth_method 0 2024-09-14T11:12:32.908 INFO:tasks.workunit.client.0.smithi050.stderr: -385> 2024-09-14T11:12:32.362+0000 7fed52d40800 10 monclient: build_initial_monmap 2024-09-14T11:12:32.909 INFO:tasks.workunit.client.0.smithi050.stderr: -384> 2024-09-14T11:12:32.362+0000 7fed52d40800 1 build_initial for_mkfs: 0 2024-09-14T11:12:32.909 INFO:tasks.workunit.client.0.smithi050.stderr: -383> 2024-09-14T11:12:32.362+0000 7fed52d40800 10 monclient: monmap: 2024-09-14T11:12:32.909 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:12:32.909 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:12:32.909 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:12:32.909 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:12:32.909 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:12:32.909 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.909 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:12:32.909 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:12:32.909 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:12:32.909 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.909 INFO:tasks.workunit.client.0.smithi050.stderr: -382> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding auth protocol: cephx 2024-09-14T11:12:32.909 INFO:tasks.workunit.client.0.smithi050.stderr: -381> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding auth protocol: cephx 2024-09-14T11:12:32.909 INFO:tasks.workunit.client.0.smithi050.stderr: -380> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding auth protocol: cephx 2024-09-14T11:12:32.910 INFO:tasks.workunit.client.0.smithi050.stderr: -379> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding con mode: secure 2024-09-14T11:12:32.910 INFO:tasks.workunit.client.0.smithi050.stderr: -378> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding con mode: crc 2024-09-14T11:12:32.910 INFO:tasks.workunit.client.0.smithi050.stderr: -377> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding con mode: secure 2024-09-14T11:12:32.910 INFO:tasks.workunit.client.0.smithi050.stderr: -376> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding con mode: crc 2024-09-14T11:12:32.910 INFO:tasks.workunit.client.0.smithi050.stderr: -375> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding con mode: secure 2024-09-14T11:12:32.910 INFO:tasks.workunit.client.0.smithi050.stderr: -374> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding con mode: crc 2024-09-14T11:12:32.910 INFO:tasks.workunit.client.0.smithi050.stderr: -373> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding con mode: crc 2024-09-14T11:12:32.910 INFO:tasks.workunit.client.0.smithi050.stderr: -372> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding con mode: secure 2024-09-14T11:12:32.910 INFO:tasks.workunit.client.0.smithi050.stderr: -371> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding con mode: crc 2024-09-14T11:12:32.910 INFO:tasks.workunit.client.0.smithi050.stderr: -370> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding con mode: secure 2024-09-14T11:12:32.910 INFO:tasks.workunit.client.0.smithi050.stderr: -369> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding con mode: crc 2024-09-14T11:12:32.910 INFO:tasks.workunit.client.0.smithi050.stderr: -368> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce6d50) adding con mode: secure 2024-09-14T11:12:32.910 INFO:tasks.workunit.client.0.smithi050.stderr: -367> 2024-09-14T11:12:32.362+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.910 INFO:tasks.workunit.client.0.smithi050.stderr: -366> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 asok(0x561350a71270) register_command objecter_requests cmddesc objecter_requests hook 0x561350cea260 EEXIST 2024-09-14T11:12:32.910 INFO:tasks.workunit.client.0.smithi050.stderr: -365> 2024-09-14T11:12:32.362+0000 7fed52d40800 10 monclient: init 2024-09-14T11:12:32.911 INFO:tasks.workunit.client.0.smithi050.stderr: -364> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding auth protocol: cephx 2024-09-14T11:12:32.911 INFO:tasks.workunit.client.0.smithi050.stderr: -363> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding auth protocol: cephx 2024-09-14T11:12:32.911 INFO:tasks.workunit.client.0.smithi050.stderr: -362> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding auth protocol: cephx 2024-09-14T11:12:32.911 INFO:tasks.workunit.client.0.smithi050.stderr: -361> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding con mode: secure 2024-09-14T11:12:32.911 INFO:tasks.workunit.client.0.smithi050.stderr: -360> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding con mode: crc 2024-09-14T11:12:32.911 INFO:tasks.workunit.client.0.smithi050.stderr: -359> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding con mode: secure 2024-09-14T11:12:32.911 INFO:tasks.workunit.client.0.smithi050.stderr: -358> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding con mode: crc 2024-09-14T11:12:32.911 INFO:tasks.workunit.client.0.smithi050.stderr: -357> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding con mode: secure 2024-09-14T11:12:32.911 INFO:tasks.workunit.client.0.smithi050.stderr: -356> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding con mode: crc 2024-09-14T11:12:32.911 INFO:tasks.workunit.client.0.smithi050.stderr: -355> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding con mode: crc 2024-09-14T11:12:32.911 INFO:tasks.workunit.client.0.smithi050.stderr: -354> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding con mode: secure 2024-09-14T11:12:32.911 INFO:tasks.workunit.client.0.smithi050.stderr: -353> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding con mode: crc 2024-09-14T11:12:32.911 INFO:tasks.workunit.client.0.smithi050.stderr: -352> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding con mode: secure 2024-09-14T11:12:32.911 INFO:tasks.workunit.client.0.smithi050.stderr: -351> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding con mode: crc 2024-09-14T11:12:32.912 INFO:tasks.workunit.client.0.smithi050.stderr: -350> 2024-09-14T11:12:32.362+0000 7fed52d40800 5 AuthRegistry(0x561350ce5378) adding con mode: secure 2024-09-14T11:12:32.912 INFO:tasks.workunit.client.0.smithi050.stderr: -349> 2024-09-14T11:12:32.363+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.912 INFO:tasks.workunit.client.0.smithi050.stderr: -348> 2024-09-14T11:12:32.363+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.912 INFO:tasks.workunit.client.0.smithi050.stderr: -347> 2024-09-14T11:12:32.363+0000 7fed52d40800 5 asok(0x561350a71270) register_command rotate-key cmddesc rotate-key hook 0x561350ce54c0 EEXIST 2024-09-14T11:12:32.912 INFO:tasks.workunit.client.0.smithi050.stderr: -346> 2024-09-14T11:12:32.363+0000 7fed52d40800 10 monclient: _reopen_session rank -1 2024-09-14T11:12:32.912 INFO:tasks.workunit.client.0.smithi050.stderr: -345> 2024-09-14T11:12:32.363+0000 7fed52d40800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:12:32.912 INFO:tasks.workunit.client.0.smithi050.stderr: -344> 2024-09-14T11:12:32.363+0000 7fed52d40800 10 monclient(hunting): picked mon.noname-a con 0x561350d0e580 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:12:32.912 INFO:tasks.workunit.client.0.smithi050.stderr: -343> 2024-09-14T11:12:32.363+0000 7fed52d40800 10 monclient(hunting): picked mon.noname-c con 0x561350d0e960 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:12:32.912 INFO:tasks.workunit.client.0.smithi050.stderr: -342> 2024-09-14T11:12:32.363+0000 7fed52d40800 10 monclient(hunting): picked mon.noname-b con 0x561350d0d290 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:12:32.912 INFO:tasks.workunit.client.0.smithi050.stderr: -341> 2024-09-14T11:12:32.363+0000 7fed52d40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:12:32.912 INFO:tasks.workunit.client.0.smithi050.stderr: -340> 2024-09-14T11:12:32.363+0000 7fed52d40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:12:32.912 INFO:tasks.workunit.client.0.smithi050.stderr: -339> 2024-09-14T11:12:32.363+0000 7fed52d40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:12:32.912 INFO:tasks.workunit.client.0.smithi050.stderr: -338> 2024-09-14T11:12:32.363+0000 7fed52d40800 10 monclient(hunting): _renew_subs 2024-09-14T11:12:32.912 INFO:tasks.workunit.client.0.smithi050.stderr: -337> 2024-09-14T11:12:32.363+0000 7fed52d40800 10 monclient(hunting): authenticate will time out at 2405.000391s 2024-09-14T11:12:32.913 INFO:tasks.workunit.client.0.smithi050.stderr: -336> 2024-09-14T11:12:32.363+0000 7fed4ea86640 10 monclient(hunting): get_auth_request con 0x561350d0e580 auth_method 0 2024-09-14T11:12:32.913 INFO:tasks.workunit.client.0.smithi050.stderr: -335> 2024-09-14T11:12:32.363+0000 7fed4ea86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:12:32.913 INFO:tasks.workunit.client.0.smithi050.stderr: -334> 2024-09-14T11:12:32.363+0000 7fed4ea86640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:12:32.913 INFO:tasks.workunit.client.0.smithi050.stderr: -333> 2024-09-14T11:12:32.363+0000 7fed4ea86640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:12:32.913 INFO:tasks.workunit.client.0.smithi050.stderr: -332> 2024-09-14T11:12:32.363+0000 7fed47fff640 10 monclient(hunting): get_auth_request con 0x561350d0e960 auth_method 0 2024-09-14T11:12:32.913 INFO:tasks.workunit.client.0.smithi050.stderr: -331> 2024-09-14T11:12:32.363+0000 7fed47fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:12:32.913 INFO:tasks.workunit.client.0.smithi050.stderr: -330> 2024-09-14T11:12:32.363+0000 7fed47fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:12:32.913 INFO:tasks.workunit.client.0.smithi050.stderr: -329> 2024-09-14T11:12:32.363+0000 7fed47fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:12:32.913 INFO:tasks.workunit.client.0.smithi050.stderr: -328> 2024-09-14T11:12:32.363+0000 7fed4f287640 10 monclient(hunting): get_auth_request con 0x561350d0d290 auth_method 0 2024-09-14T11:12:32.913 INFO:tasks.workunit.client.0.smithi050.stderr: -327> 2024-09-14T11:12:32.363+0000 7fed4f287640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:12:32.913 INFO:tasks.workunit.client.0.smithi050.stderr: -326> 2024-09-14T11:12:32.363+0000 7fed4f287640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:12:32.913 INFO:tasks.workunit.client.0.smithi050.stderr: -325> 2024-09-14T11:12:32.363+0000 7fed4f287640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:12:32.913 INFO:tasks.workunit.client.0.smithi050.stderr: -324> 2024-09-14T11:12:32.363+0000 7fed4ea86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:12:32.913 INFO:tasks.workunit.client.0.smithi050.stderr: -323> 2024-09-14T11:12:32.363+0000 7fed4ea86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:12:32.914 INFO:tasks.workunit.client.0.smithi050.stderr: -322> 2024-09-14T11:12:32.363+0000 7fed4ea86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:12:32.914 INFO:tasks.workunit.client.0.smithi050.stderr: -321> 2024-09-14T11:12:32.363+0000 7fed47fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:12:32.914 INFO:tasks.workunit.client.0.smithi050.stderr: -320> 2024-09-14T11:12:32.363+0000 7fed47fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:12:32.914 INFO:tasks.workunit.client.0.smithi050.stderr: -319> 2024-09-14T11:12:32.363+0000 7fed47fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:12:32.914 INFO:tasks.workunit.client.0.smithi050.stderr: -318> 2024-09-14T11:12:32.363+0000 7fed4f287640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:12:32.914 INFO:tasks.workunit.client.0.smithi050.stderr: -317> 2024-09-14T11:12:32.363+0000 7fed4f287640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:12:32.914 INFO:tasks.workunit.client.0.smithi050.stderr: -316> 2024-09-14T11:12:32.363+0000 7fed4f287640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:12:32.914 INFO:tasks.workunit.client.0.smithi050.stderr: -315> 2024-09-14T11:12:32.363+0000 7fed4ea86640 10 monclient(hunting): handle_auth_done global_id 7590 payload 824 2024-09-14T11:12:32.914 INFO:tasks.workunit.client.0.smithi050.stderr: -314> 2024-09-14T11:12:32.363+0000 7fed4ea86640 10 monclient: _finish_hunting 0 2024-09-14T11:12:32.914 INFO:tasks.workunit.client.0.smithi050.stderr: -313> 2024-09-14T11:12:32.363+0000 7fed4ea86640 1 monclient: found mon.noname-a 2024-09-14T11:12:32.914 INFO:tasks.workunit.client.0.smithi050.stderr: -312> 2024-09-14T11:12:32.363+0000 7fed4ea86640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:12:32.914 INFO:tasks.workunit.client.0.smithi050.stderr: -311> 2024-09-14T11:12:32.364+0000 7fec38e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:12:32.914 INFO:tasks.workunit.client.0.smithi050.stderr: -310> 2024-09-14T11:12:32.364+0000 7fec38e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:12:32.914 INFO:tasks.workunit.client.0.smithi050.stderr: -309> 2024-09-14T11:12:32.364+0000 7fec38e01640 10 monclient: dump: 2024-09-14T11:12:32.914 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:12:32.915 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:12:32.915 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.915 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.915 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:12:32.915 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.915 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:12:32.915 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:12:32.915 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:12:32.915 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.915 INFO:tasks.workunit.client.0.smithi050.stderr: -308> 2024-09-14T11:12:32.364+0000 7fec38e01640 10 monclient: _finish_auth 0 2024-09-14T11:12:32.915 INFO:tasks.workunit.client.0.smithi050.stderr: -307> 2024-09-14T11:12:32.364+0000 7fec38e01640 10 monclient: _check_auth_tickets 2024-09-14T11:12:32.915 INFO:tasks.workunit.client.0.smithi050.stderr: -306> 2024-09-14T11:12:32.364+0000 7fec38e01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:12:32.915 INFO:tasks.workunit.client.0.smithi050.stderr: -305> 2024-09-14T11:12:32.364+0000 7fec38e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:12:32.915 INFO:tasks.workunit.client.0.smithi050.stderr: -304> 2024-09-14T11:12:32.364+0000 7fec38e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:12:32.916 INFO:tasks.workunit.client.0.smithi050.stderr: -303> 2024-09-14T11:12:32.364+0000 7fec38e01640 10 monclient: dump: 2024-09-14T11:12:32.916 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:12:32.916 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:12:32.916 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.916 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.916 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:12:32.916 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.916 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:12:32.916 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:12:32.916 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:12:32.916 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.916 INFO:tasks.workunit.client.0.smithi050.stderr: -302> 2024-09-14T11:12:32.364+0000 7fed52d40800 5 monclient: authenticate success, global_id 7590 2024-09-14T11:12:32.916 INFO:tasks.workunit.client.0.smithi050.stderr: -301> 2024-09-14T11:12:32.364+0000 7fed52d40800 10 monclient: _renew_subs 2024-09-14T11:12:32.916 INFO:tasks.workunit.client.0.smithi050.stderr: -300> 2024-09-14T11:12:32.364+0000 7fed52d40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:12:32.917 INFO:tasks.workunit.client.0.smithi050.stderr: -299> 2024-09-14T11:12:32.364+0000 7fed4fa88640 4 set_mon_vals no callback set 2024-09-14T11:12:32.917 INFO:tasks.workunit.client.0.smithi050.stderr: -298> 2024-09-14T11:12:32.364+0000 7fed52d40800 10 monclient: _renew_subs 2024-09-14T11:12:32.917 INFO:tasks.workunit.client.0.smithi050.stderr: -297> 2024-09-14T11:12:32.364+0000 7fed52d40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:12:32.917 INFO:tasks.workunit.client.0.smithi050.stderr: -296> 2024-09-14T11:12:32.366+0000 7fec38e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:12:32.917 INFO:tasks.workunit.client.0.smithi050.stderr: -295> 2024-09-14T11:12:32.366+0000 7fec38e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:12:32.917 INFO:tasks.workunit.client.0.smithi050.stderr: -294> 2024-09-14T11:12:32.366+0000 7fec38e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:12:32.917 INFO:tasks.workunit.client.0.smithi050.stderr: -293> 2024-09-14T11:12:32.366+0000 7fed47fff640 10 monclient: get_auth_request con 0x7fec28077140 auth_method 0 2024-09-14T11:12:32.917 INFO:tasks.workunit.client.0.smithi050.stderr: -292> 2024-09-14T11:12:32.366+0000 7fed52d40800 10 monclient: get_monmap_and_config 2024-09-14T11:12:32.917 INFO:tasks.workunit.client.0.smithi050.stderr: -291> 2024-09-14T11:12:32.366+0000 7fed52d40800 10 monclient: build_initial_monmap 2024-09-14T11:12:32.917 INFO:tasks.workunit.client.0.smithi050.stderr: -290> 2024-09-14T11:12:32.366+0000 7fed52d40800 1 build_initial for_mkfs: 0 2024-09-14T11:12:32.917 INFO:tasks.workunit.client.0.smithi050.stderr: -289> 2024-09-14T11:12:32.366+0000 7fed52d40800 10 monclient: monmap: 2024-09-14T11:12:32.918 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:12:32.918 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:12:32.918 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:12:32.918 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:12:32.918 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:12:32.918 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.918 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:12:32.918 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:12:32.918 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:12:32.918 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.918 INFO:tasks.workunit.client.0.smithi050.stderr: -288> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding auth protocol: cephx 2024-09-14T11:12:32.918 INFO:tasks.workunit.client.0.smithi050.stderr: -287> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding auth protocol: cephx 2024-09-14T11:12:32.918 INFO:tasks.workunit.client.0.smithi050.stderr: -286> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding auth protocol: cephx 2024-09-14T11:12:32.918 INFO:tasks.workunit.client.0.smithi050.stderr: -285> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding con mode: secure 2024-09-14T11:12:32.919 INFO:tasks.workunit.client.0.smithi050.stderr: -284> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding con mode: crc 2024-09-14T11:12:32.919 INFO:tasks.workunit.client.0.smithi050.stderr: -283> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding con mode: secure 2024-09-14T11:12:32.919 INFO:tasks.workunit.client.0.smithi050.stderr: -282> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding con mode: crc 2024-09-14T11:12:32.919 INFO:tasks.workunit.client.0.smithi050.stderr: -281> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding con mode: secure 2024-09-14T11:12:32.919 INFO:tasks.workunit.client.0.smithi050.stderr: -280> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding con mode: crc 2024-09-14T11:12:32.919 INFO:tasks.workunit.client.0.smithi050.stderr: -279> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding con mode: crc 2024-09-14T11:12:32.919 INFO:tasks.workunit.client.0.smithi050.stderr: -278> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding con mode: secure 2024-09-14T11:12:32.919 INFO:tasks.workunit.client.0.smithi050.stderr: -277> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding con mode: crc 2024-09-14T11:12:32.919 INFO:tasks.workunit.client.0.smithi050.stderr: -276> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding con mode: secure 2024-09-14T11:12:32.919 INFO:tasks.workunit.client.0.smithi050.stderr: -275> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding con mode: crc 2024-09-14T11:12:32.919 INFO:tasks.workunit.client.0.smithi050.stderr: -274> 2024-09-14T11:12:32.366+0000 7fed52d40800 5 AuthRegistry(0x561350d2e310) adding con mode: secure 2024-09-14T11:12:32.920 INFO:tasks.workunit.client.0.smithi050.stderr: -273> 2024-09-14T11:12:32.366+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.920 INFO:tasks.workunit.client.0.smithi050.stderr: -272> 2024-09-14T11:12:32.367+0000 7fed52d40800 10 monclient: init 2024-09-14T11:12:32.920 INFO:tasks.workunit.client.0.smithi050.stderr: -271> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding auth protocol: cephx 2024-09-14T11:12:32.920 INFO:tasks.workunit.client.0.smithi050.stderr: -270> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding auth protocol: cephx 2024-09-14T11:12:32.920 INFO:tasks.workunit.client.0.smithi050.stderr: -269> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding auth protocol: cephx 2024-09-14T11:12:32.920 INFO:tasks.workunit.client.0.smithi050.stderr: -268> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding con mode: secure 2024-09-14T11:12:32.920 INFO:tasks.workunit.client.0.smithi050.stderr: -267> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding con mode: crc 2024-09-14T11:12:32.920 INFO:tasks.workunit.client.0.smithi050.stderr: -266> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding con mode: secure 2024-09-14T11:12:32.920 INFO:tasks.workunit.client.0.smithi050.stderr: -265> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding con mode: crc 2024-09-14T11:12:32.920 INFO:tasks.workunit.client.0.smithi050.stderr: -264> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding con mode: secure 2024-09-14T11:12:32.920 INFO:tasks.workunit.client.0.smithi050.stderr: -263> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding con mode: crc 2024-09-14T11:12:32.920 INFO:tasks.workunit.client.0.smithi050.stderr: -262> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding con mode: crc 2024-09-14T11:12:32.920 INFO:tasks.workunit.client.0.smithi050.stderr: -261> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding con mode: secure 2024-09-14T11:12:32.921 INFO:tasks.workunit.client.0.smithi050.stderr: -260> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding con mode: crc 2024-09-14T11:12:32.921 INFO:tasks.workunit.client.0.smithi050.stderr: -259> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding con mode: secure 2024-09-14T11:12:32.921 INFO:tasks.workunit.client.0.smithi050.stderr: -258> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding con mode: crc 2024-09-14T11:12:32.921 INFO:tasks.workunit.client.0.smithi050.stderr: -257> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4a70) adding con mode: secure 2024-09-14T11:12:32.921 INFO:tasks.workunit.client.0.smithi050.stderr: -256> 2024-09-14T11:12:32.367+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.921 INFO:tasks.workunit.client.0.smithi050.stderr: -255> 2024-09-14T11:12:32.367+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.921 INFO:tasks.workunit.client.0.smithi050.stderr: -254> 2024-09-14T11:12:32.367+0000 7fed52d40800 5 asok(0x561350a71270) register_command rotate-key cmddesc rotate-key hook 0x7fff2c4d4bb8 EEXIST 2024-09-14T11:12:32.921 INFO:tasks.workunit.client.0.smithi050.stderr: -253> 2024-09-14T11:12:32.367+0000 7fed52d40800 10 monclient: _reopen_session rank -1 2024-09-14T11:12:32.921 INFO:tasks.workunit.client.0.smithi050.stderr: -252> 2024-09-14T11:12:32.367+0000 7fed52d40800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:12:32.921 INFO:tasks.workunit.client.0.smithi050.stderr: -251> 2024-09-14T11:12:32.367+0000 7fed52d40800 10 monclient(hunting): picked mon.noname-a con 0x561350d628f0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:12:32.921 INFO:tasks.workunit.client.0.smithi050.stderr: -250> 2024-09-14T11:12:32.367+0000 7fed52d40800 10 monclient(hunting): picked mon.noname-b con 0x561350d53240 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:12:32.922 INFO:tasks.workunit.client.0.smithi050.stderr: -249> 2024-09-14T11:12:32.367+0000 7fed52d40800 10 monclient(hunting): picked mon.noname-c con 0x561350d5dd20 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:12:32.922 INFO:tasks.workunit.client.0.smithi050.stderr: -248> 2024-09-14T11:12:32.367+0000 7fed52d40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:12:32.922 INFO:tasks.workunit.client.0.smithi050.stderr: -247> 2024-09-14T11:12:32.367+0000 7fed52d40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:12:32.922 INFO:tasks.workunit.client.0.smithi050.stderr: -246> 2024-09-14T11:12:32.367+0000 7fed52d40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:12:32.922 INFO:tasks.workunit.client.0.smithi050.stderr: -245> 2024-09-14T11:12:32.367+0000 7fed52d40800 10 monclient(hunting): _renew_subs 2024-09-14T11:12:32.922 INFO:tasks.workunit.client.0.smithi050.stderr: -244> 2024-09-14T11:12:32.367+0000 7fed52d40800 10 monclient(hunting): authenticate will time out at 2405.004572s 2024-09-14T11:12:32.922 INFO:tasks.workunit.client.0.smithi050.stderr: -243> 2024-09-14T11:12:32.367+0000 7fed4ea86640 10 monclient(hunting): get_auth_request con 0x561350d628f0 auth_method 0 2024-09-14T11:12:32.922 INFO:tasks.workunit.client.0.smithi050.stderr: -242> 2024-09-14T11:12:32.367+0000 7fed4ea86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:12:32.922 INFO:tasks.workunit.client.0.smithi050.stderr: -241> 2024-09-14T11:12:32.367+0000 7fed4ea86640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:12:32.922 INFO:tasks.workunit.client.0.smithi050.stderr: -240> 2024-09-14T11:12:32.367+0000 7fed4ea86640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:12:32.922 INFO:tasks.workunit.client.0.smithi050.stderr: -239> 2024-09-14T11:12:32.367+0000 7fed4f287640 10 monclient(hunting): get_auth_request con 0x561350d5dd20 auth_method 0 2024-09-14T11:12:32.922 INFO:tasks.workunit.client.0.smithi050.stderr: -238> 2024-09-14T11:12:32.367+0000 7fed4f287640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:12:32.922 INFO:tasks.workunit.client.0.smithi050.stderr: -237> 2024-09-14T11:12:32.367+0000 7fed4f287640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:12:32.923 INFO:tasks.workunit.client.0.smithi050.stderr: -236> 2024-09-14T11:12:32.367+0000 7fed4f287640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:12:32.923 INFO:tasks.workunit.client.0.smithi050.stderr: -235> 2024-09-14T11:12:32.367+0000 7fed4ea86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:12:32.923 INFO:tasks.workunit.client.0.smithi050.stderr: -234> 2024-09-14T11:12:32.367+0000 7fed4ea86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:12:32.923 INFO:tasks.workunit.client.0.smithi050.stderr: -233> 2024-09-14T11:12:32.367+0000 7fed4ea86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:12:32.923 INFO:tasks.workunit.client.0.smithi050.stderr: -232> 2024-09-14T11:12:32.367+0000 7fed4f287640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:12:32.923 INFO:tasks.workunit.client.0.smithi050.stderr: -231> 2024-09-14T11:12:32.367+0000 7fed4f287640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:12:32.923 INFO:tasks.workunit.client.0.smithi050.stderr: -230> 2024-09-14T11:12:32.367+0000 7fed4f287640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:12:32.923 INFO:tasks.workunit.client.0.smithi050.stderr: -229> 2024-09-14T11:12:32.367+0000 7fed4ea86640 10 monclient(hunting): handle_auth_done global_id 7593 payload 274 2024-09-14T11:12:32.923 INFO:tasks.workunit.client.0.smithi050.stderr: -228> 2024-09-14T11:12:32.367+0000 7fed4ea86640 10 monclient: _finish_hunting 0 2024-09-14T11:12:32.923 INFO:tasks.workunit.client.0.smithi050.stderr: -227> 2024-09-14T11:12:32.367+0000 7fed4ea86640 1 monclient: found mon.noname-a 2024-09-14T11:12:32.923 INFO:tasks.workunit.client.0.smithi050.stderr: -226> 2024-09-14T11:12:32.367+0000 7fed4ea86640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:12:32.923 INFO:tasks.workunit.client.0.smithi050.stderr: -225> 2024-09-14T11:12:32.367+0000 7fed47fff640 10 monclient: get_auth_request con 0x561350d53240 auth_method 0 2024-09-14T11:12:32.923 INFO:tasks.workunit.client.0.smithi050.stderr: -224> 2024-09-14T11:12:32.368+0000 7fec327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:12:32.924 INFO:tasks.workunit.client.0.smithi050.stderr: -223> 2024-09-14T11:12:32.368+0000 7fec327fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:12:32.924 INFO:tasks.workunit.client.0.smithi050.stderr: -222> 2024-09-14T11:12:32.368+0000 7fec327fc640 10 monclient: dump: 2024-09-14T11:12:32.924 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:12:32.924 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:12:32.924 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.924 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.924 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:12:32.924 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.924 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:12:32.924 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:12:32.924 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:12:32.924 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.924 INFO:tasks.workunit.client.0.smithi050.stderr: -221> 2024-09-14T11:12:32.368+0000 7fec327fc640 10 monclient: _finish_auth 0 2024-09-14T11:12:32.924 INFO:tasks.workunit.client.0.smithi050.stderr: -220> 2024-09-14T11:12:32.368+0000 7fec327fc640 10 monclient: _check_auth_tickets 2024-09-14T11:12:32.925 INFO:tasks.workunit.client.0.smithi050.stderr: -219> 2024-09-14T11:12:32.368+0000 7fec327fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:12:32.925 INFO:tasks.workunit.client.0.smithi050.stderr: -218> 2024-09-14T11:12:32.368+0000 7fec327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:12:32.925 INFO:tasks.workunit.client.0.smithi050.stderr: -217> 2024-09-14T11:12:32.368+0000 7fec327fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:12:32.925 INFO:tasks.workunit.client.0.smithi050.stderr: -216> 2024-09-14T11:12:32.368+0000 7fec327fc640 10 monclient: dump: 2024-09-14T11:12:32.925 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:12:32.925 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:12:32.925 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.925 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.925 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:12:32.925 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.925 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:12:32.925 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:12:32.925 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:12:32.926 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.926 INFO:tasks.workunit.client.0.smithi050.stderr: -215> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 monclient: authenticate success, global_id 7593 2024-09-14T11:12:32.926 INFO:tasks.workunit.client.0.smithi050.stderr: -214> 2024-09-14T11:12:32.368+0000 7fed52d40800 10 monclient: get_monmap_and_config success 2024-09-14T11:12:32.926 INFO:tasks.workunit.client.0.smithi050.stderr: -213> 2024-09-14T11:12:32.368+0000 7fed52d40800 4 set_mon_vals no callback set 2024-09-14T11:12:32.926 INFO:tasks.workunit.client.0.smithi050.stderr: -212> 2024-09-14T11:12:32.368+0000 7fed52d40800 10 monclient: shutdown 2024-09-14T11:12:32.926 INFO:tasks.workunit.client.0.smithi050.stderr: -211> 2024-09-14T11:12:32.368+0000 7fed52d40800 10 monclient: build_initial_monmap 2024-09-14T11:12:32.926 INFO:tasks.workunit.client.0.smithi050.stderr: -210> 2024-09-14T11:12:32.368+0000 7fed52d40800 1 build_initial for_mkfs: 0 2024-09-14T11:12:32.926 INFO:tasks.workunit.client.0.smithi050.stderr: -209> 2024-09-14T11:12:32.368+0000 7fed52d40800 10 monclient: monmap: 2024-09-14T11:12:32.926 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:12:32.926 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:12:32.926 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:12:32.926 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:12:32.926 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:12:32.926 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.927 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:12:32.927 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:12:32.927 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:12:32.927 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.927 INFO:tasks.workunit.client.0.smithi050.stderr: -208> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding auth protocol: cephx 2024-09-14T11:12:32.927 INFO:tasks.workunit.client.0.smithi050.stderr: -207> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding auth protocol: cephx 2024-09-14T11:12:32.927 INFO:tasks.workunit.client.0.smithi050.stderr: -206> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding auth protocol: cephx 2024-09-14T11:12:32.927 INFO:tasks.workunit.client.0.smithi050.stderr: -205> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding con mode: secure 2024-09-14T11:12:32.927 INFO:tasks.workunit.client.0.smithi050.stderr: -204> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding con mode: crc 2024-09-14T11:12:32.927 INFO:tasks.workunit.client.0.smithi050.stderr: -203> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding con mode: secure 2024-09-14T11:12:32.927 INFO:tasks.workunit.client.0.smithi050.stderr: -202> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding con mode: crc 2024-09-14T11:12:32.928 INFO:tasks.workunit.client.0.smithi050.stderr: -201> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding con mode: secure 2024-09-14T11:12:32.928 INFO:tasks.workunit.client.0.smithi050.stderr: -200> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding con mode: crc 2024-09-14T11:12:32.928 INFO:tasks.workunit.client.0.smithi050.stderr: -199> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding con mode: crc 2024-09-14T11:12:32.928 INFO:tasks.workunit.client.0.smithi050.stderr: -198> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding con mode: secure 2024-09-14T11:12:32.928 INFO:tasks.workunit.client.0.smithi050.stderr: -197> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding con mode: crc 2024-09-14T11:12:32.928 INFO:tasks.workunit.client.0.smithi050.stderr: -196> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding con mode: secure 2024-09-14T11:12:32.928 INFO:tasks.workunit.client.0.smithi050.stderr: -195> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding con mode: crc 2024-09-14T11:12:32.928 INFO:tasks.workunit.client.0.smithi050.stderr: -194> 2024-09-14T11:12:32.368+0000 7fed52d40800 5 AuthRegistry(0x561350d31e50) adding con mode: secure 2024-09-14T11:12:32.928 INFO:tasks.workunit.client.0.smithi050.stderr: -193> 2024-09-14T11:12:32.369+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.928 INFO:tasks.workunit.client.0.smithi050.stderr: -192> 2024-09-14T11:12:32.369+0000 7fed52d40800 1 librados: starting msgr at 2024-09-14T11:12:32.928 INFO:tasks.workunit.client.0.smithi050.stderr: -191> 2024-09-14T11:12:32.369+0000 7fed52d40800 1 librados: starting objecter 2024-09-14T11:12:32.928 INFO:tasks.workunit.client.0.smithi050.stderr: -190> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 asok(0x561350a71270) register_command objecter_requests cmddesc objecter_requests hook 0x561350d30b20 EEXIST 2024-09-14T11:12:32.929 INFO:tasks.workunit.client.0.smithi050.stderr: -189> 2024-09-14T11:12:32.369+0000 7fed52d40800 1 librados: setting wanted keys 2024-09-14T11:12:32.929 INFO:tasks.workunit.client.0.smithi050.stderr: -188> 2024-09-14T11:12:32.369+0000 7fed52d40800 1 librados: calling monclient init 2024-09-14T11:12:32.929 INFO:tasks.workunit.client.0.smithi050.stderr: -187> 2024-09-14T11:12:32.369+0000 7fed52d40800 10 monclient: init 2024-09-14T11:12:32.929 INFO:tasks.workunit.client.0.smithi050.stderr: -186> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding auth protocol: cephx 2024-09-14T11:12:32.929 INFO:tasks.workunit.client.0.smithi050.stderr: -185> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding auth protocol: cephx 2024-09-14T11:12:32.929 INFO:tasks.workunit.client.0.smithi050.stderr: -184> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding auth protocol: cephx 2024-09-14T11:12:32.929 INFO:tasks.workunit.client.0.smithi050.stderr: -183> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding con mode: secure 2024-09-14T11:12:32.929 INFO:tasks.workunit.client.0.smithi050.stderr: -182> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding con mode: crc 2024-09-14T11:12:32.929 INFO:tasks.workunit.client.0.smithi050.stderr: -181> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding con mode: secure 2024-09-14T11:12:32.929 INFO:tasks.workunit.client.0.smithi050.stderr: -180> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding con mode: crc 2024-09-14T11:12:32.930 INFO:tasks.workunit.client.0.smithi050.stderr: -179> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding con mode: secure 2024-09-14T11:12:32.930 INFO:tasks.workunit.client.0.smithi050.stderr: -178> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding con mode: crc 2024-09-14T11:12:32.930 INFO:tasks.workunit.client.0.smithi050.stderr: -177> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding con mode: crc 2024-09-14T11:12:32.930 INFO:tasks.workunit.client.0.smithi050.stderr: -176> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding con mode: secure 2024-09-14T11:12:32.930 INFO:tasks.workunit.client.0.smithi050.stderr: -175> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding con mode: crc 2024-09-14T11:12:32.930 INFO:tasks.workunit.client.0.smithi050.stderr: -174> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding con mode: secure 2024-09-14T11:12:32.930 INFO:tasks.workunit.client.0.smithi050.stderr: -173> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding con mode: crc 2024-09-14T11:12:32.930 INFO:tasks.workunit.client.0.smithi050.stderr: -172> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 AuthRegistry(0x561350d22e40) adding con mode: secure 2024-09-14T11:12:32.930 INFO:tasks.workunit.client.0.smithi050.stderr: -171> 2024-09-14T11:12:32.369+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.930 INFO:tasks.workunit.client.0.smithi050.stderr: -170> 2024-09-14T11:12:32.369+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.930 INFO:tasks.workunit.client.0.smithi050.stderr: -169> 2024-09-14T11:12:32.369+0000 7fed52d40800 5 asok(0x561350a71270) register_command rotate-key cmddesc rotate-key hook 0x561350d22f88 EEXIST 2024-09-14T11:12:32.930 INFO:tasks.workunit.client.0.smithi050.stderr: -168> 2024-09-14T11:12:32.369+0000 7fed52d40800 10 monclient: _reopen_session rank -1 2024-09-14T11:12:32.931 INFO:tasks.workunit.client.0.smithi050.stderr: -167> 2024-09-14T11:12:32.369+0000 7fed52d40800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:12:32.931 INFO:tasks.workunit.client.0.smithi050.stderr: -166> 2024-09-14T11:12:32.369+0000 7fed52d40800 10 monclient(hunting): picked mon.noname-b con 0x561350d53240 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:12:32.931 INFO:tasks.workunit.client.0.smithi050.stderr: -165> 2024-09-14T11:12:32.369+0000 7fed52d40800 10 monclient(hunting): picked mon.noname-c con 0x561350d5dd20 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:12:32.931 INFO:tasks.workunit.client.0.smithi050.stderr: -164> 2024-09-14T11:12:32.369+0000 7fed52d40800 10 monclient(hunting): picked mon.noname-a con 0x561350d628f0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:12:32.931 INFO:tasks.workunit.client.0.smithi050.stderr: -163> 2024-09-14T11:12:32.369+0000 7fed52d40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:12:32.931 INFO:tasks.workunit.client.0.smithi050.stderr: -162> 2024-09-14T11:12:32.369+0000 7fed52d40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:12:32.931 INFO:tasks.workunit.client.0.smithi050.stderr: -161> 2024-09-14T11:12:32.369+0000 7fed52d40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:12:32.931 INFO:tasks.workunit.client.0.smithi050.stderr: -160> 2024-09-14T11:12:32.369+0000 7fed52d40800 10 monclient(hunting): _renew_subs 2024-09-14T11:12:32.931 INFO:tasks.workunit.client.0.smithi050.stderr: -159> 2024-09-14T11:12:32.369+0000 7fed52d40800 10 monclient(hunting): authenticate will time out at 2405.006877s 2024-09-14T11:12:32.931 INFO:tasks.workunit.client.0.smithi050.stderr: -158> 2024-09-14T11:12:32.369+0000 7fed4f287640 10 monclient(hunting): get_auth_request con 0x561350d628f0 auth_method 0 2024-09-14T11:12:32.931 INFO:tasks.workunit.client.0.smithi050.stderr: -157> 2024-09-14T11:12:32.369+0000 7fed4f287640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:12:32.931 INFO:tasks.workunit.client.0.smithi050.stderr: -156> 2024-09-14T11:12:32.369+0000 7fed4f287640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:12:32.932 INFO:tasks.workunit.client.0.smithi050.stderr: -155> 2024-09-14T11:12:32.369+0000 7fed4f287640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:12:32.932 INFO:tasks.workunit.client.0.smithi050.stderr: -154> 2024-09-14T11:12:32.370+0000 7fed47fff640 10 monclient(hunting): get_auth_request con 0x561350d5dd20 auth_method 0 2024-09-14T11:12:32.932 INFO:tasks.workunit.client.0.smithi050.stderr: -153> 2024-09-14T11:12:32.370+0000 7fed47fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:12:32.932 INFO:tasks.workunit.client.0.smithi050.stderr: -152> 2024-09-14T11:12:32.370+0000 7fed47fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:12:32.932 INFO:tasks.workunit.client.0.smithi050.stderr: -151> 2024-09-14T11:12:32.370+0000 7fed47fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:12:32.932 INFO:tasks.workunit.client.0.smithi050.stderr: -150> 2024-09-14T11:12:32.370+0000 7fed4f287640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:12:32.932 INFO:tasks.workunit.client.0.smithi050.stderr: -149> 2024-09-14T11:12:32.370+0000 7fed4f287640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:12:32.932 INFO:tasks.workunit.client.0.smithi050.stderr: -148> 2024-09-14T11:12:32.370+0000 7fed4f287640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:12:32.932 INFO:tasks.workunit.client.0.smithi050.stderr: -147> 2024-09-14T11:12:32.370+0000 7fed47fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:12:32.932 INFO:tasks.workunit.client.0.smithi050.stderr: -146> 2024-09-14T11:12:32.370+0000 7fed47fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:12:32.932 INFO:tasks.workunit.client.0.smithi050.stderr: -145> 2024-09-14T11:12:32.370+0000 7fed47fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:12:32.932 INFO:tasks.workunit.client.0.smithi050.stderr: -144> 2024-09-14T11:12:32.370+0000 7fed4f287640 10 monclient(hunting): handle_auth_done global_id 7596 payload 824 2024-09-14T11:12:32.932 INFO:tasks.workunit.client.0.smithi050.stderr: -143> 2024-09-14T11:12:32.370+0000 7fed4f287640 10 monclient: _finish_hunting 0 2024-09-14T11:12:32.933 INFO:tasks.workunit.client.0.smithi050.stderr: -142> 2024-09-14T11:12:32.370+0000 7fed4f287640 1 monclient: found mon.noname-a 2024-09-14T11:12:32.933 INFO:tasks.workunit.client.0.smithi050.stderr: -141> 2024-09-14T11:12:32.370+0000 7fed4f287640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:12:32.933 INFO:tasks.workunit.client.0.smithi050.stderr: -140> 2024-09-14T11:12:32.370+0000 7fed4ea86640 10 monclient: get_auth_request con 0x561350d53240 auth_method 0 2024-09-14T11:12:32.933 INFO:tasks.workunit.client.0.smithi050.stderr: -139> 2024-09-14T11:12:32.370+0000 7fec30ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:12:32.933 INFO:tasks.workunit.client.0.smithi050.stderr: -138> 2024-09-14T11:12:32.370+0000 7fec30ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:12:32.933 INFO:tasks.workunit.client.0.smithi050.stderr: -137> 2024-09-14T11:12:32.370+0000 7fec30ff9640 10 monclient: dump: 2024-09-14T11:12:32.933 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:12:32.933 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:12:32.933 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.933 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.934 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:12:32.934 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.934 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:12:32.934 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:12:32.934 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:12:32.934 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.934 INFO:tasks.workunit.client.0.smithi050.stderr: -136> 2024-09-14T11:12:32.370+0000 7fec30ff9640 10 monclient: _finish_auth 0 2024-09-14T11:12:32.934 INFO:tasks.workunit.client.0.smithi050.stderr: -135> 2024-09-14T11:12:32.370+0000 7fec30ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:12:32.934 INFO:tasks.workunit.client.0.smithi050.stderr: -134> 2024-09-14T11:12:32.370+0000 7fec30ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:12:32.934 INFO:tasks.workunit.client.0.smithi050.stderr: -133> 2024-09-14T11:12:32.370+0000 7fec30ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:12:32.934 INFO:tasks.workunit.client.0.smithi050.stderr: -132> 2024-09-14T11:12:32.370+0000 7fec30ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:12:32.934 INFO:tasks.workunit.client.0.smithi050.stderr: -131> 2024-09-14T11:12:32.370+0000 7fec30ff9640 10 monclient: dump: 2024-09-14T11:12:32.934 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:12:32.934 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:12:32.935 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.935 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:12:32.935 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:12:32.935 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:12:32.935 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:12:32.935 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:12:32.935 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:12:32.935 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.935 INFO:tasks.workunit.client.0.smithi050.stderr: -130> 2024-09-14T11:12:32.370+0000 7fed52d40800 5 monclient: authenticate success, global_id 7596 2024-09-14T11:12:32.935 INFO:tasks.workunit.client.0.smithi050.stderr: -129> 2024-09-14T11:12:32.370+0000 7fed52d40800 10 monclient: _renew_subs 2024-09-14T11:12:32.935 INFO:tasks.workunit.client.0.smithi050.stderr: -128> 2024-09-14T11:12:32.370+0000 7fed52d40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:12:32.935 INFO:tasks.workunit.client.0.smithi050.stderr: -127> 2024-09-14T11:12:32.370+0000 7fec327fc640 4 set_mon_vals no callback set 2024-09-14T11:12:32.935 INFO:tasks.workunit.client.0.smithi050.stderr: -126> 2024-09-14T11:12:32.370+0000 7fed52d40800 10 monclient: _renew_subs 2024-09-14T11:12:32.935 INFO:tasks.workunit.client.0.smithi050.stderr: -125> 2024-09-14T11:12:32.370+0000 7fed52d40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:12:32.936 INFO:tasks.workunit.client.0.smithi050.stderr: -124> 2024-09-14T11:12:32.370+0000 7fed52d40800 1 librados: init done 2024-09-14T11:12:32.936 INFO:tasks.workunit.client.0.smithi050.stderr: -123> 2024-09-14T11:12:32.370+0000 7fed52d40800 5 asok(0x561350a71270) register_command cr dump hook 0x561350d5ca28 2024-09-14T11:12:32.936 INFO:tasks.workunit.client.0.smithi050.stderr: -122> 2024-09-14T11:12:32.372+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.936 INFO:tasks.workunit.client.0.smithi050.stderr: -121> 2024-09-14T11:12:32.372+0000 7fec30ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:12:32.936 INFO:tasks.workunit.client.0.smithi050.stderr: -120> 2024-09-14T11:12:32.372+0000 7fec30ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:12:32.936 INFO:tasks.workunit.client.0.smithi050.stderr: -119> 2024-09-14T11:12:32.372+0000 7fec30ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:12:32.936 INFO:tasks.workunit.client.0.smithi050.stderr: -118> 2024-09-14T11:12:32.372+0000 7fed4ea86640 10 monclient: get_auth_request con 0x7fec18077260 auth_method 0 2024-09-14T11:12:32.936 INFO:tasks.workunit.client.0.smithi050.stderr: -117> 2024-09-14T11:12:32.372+0000 7fed47fff640 10 monclient: get_auth_request con 0x561350d7c8e0 auth_method 0 2024-09-14T11:12:32.936 INFO:tasks.workunit.client.0.smithi050.stderr: -116> 2024-09-14T11:12:32.373+0000 7fed52d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.936 INFO:tasks.workunit.client.0.smithi050.stderr: -115> 2024-09-14T11:12:32.373+0000 7fed52d40800 20 realm 2024-09-14T11:12:32.936 INFO:tasks.workunit.client.0.smithi050.stderr: -114> 2024-09-14T11:12:32.373+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.936 INFO:tasks.workunit.client.0.smithi050.stderr: -113> 2024-09-14T11:12:32.373+0000 7fed52d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.936 INFO:tasks.workunit.client.0.smithi050.stderr: -112> 2024-09-14T11:12:32.373+0000 7fed52d40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:32.937 INFO:tasks.workunit.client.0.smithi050.stderr: -111> 2024-09-14T11:12:32.373+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.937 INFO:tasks.workunit.client.0.smithi050.stderr: -110> 2024-09-14T11:12:32.373+0000 7fed52d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.937 INFO:tasks.workunit.client.0.smithi050.stderr: -109> 2024-09-14T11:12:32.373+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.937 INFO:tasks.workunit.client.0.smithi050.stderr: -108> 2024-09-14T11:12:32.374+0000 7fed4ea86640 10 monclient: get_auth_request con 0x561350d80b10 auth_method 0 2024-09-14T11:12:32.937 INFO:tasks.workunit.client.0.smithi050.stderr: -107> 2024-09-14T11:12:32.374+0000 7fed52d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:32.937 INFO:tasks.workunit.client.0.smithi050.stderr: -106> 2024-09-14T11:12:32.374+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.937 INFO:tasks.workunit.client.0.smithi050.stderr: -105> 2024-09-14T11:12:32.374+0000 7fed47fff640 10 monclient: get_auth_request con 0x561350d84350 auth_method 0 2024-09-14T11:12:32.937 INFO:tasks.workunit.client.0.smithi050.stderr: -104> 2024-09-14T11:12:32.375+0000 7fed52d40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:32.937 INFO:tasks.workunit.client.0.smithi050.stderr: -103> 2024-09-14T11:12:32.375+0000 7fed52d40800 20 searching for the correct realm 2024-09-14T11:12:32.937 INFO:tasks.workunit.client.0.smithi050.stderr: -102> 2024-09-14T11:12:32.375+0000 7fed4f287640 10 monclient: get_auth_request con 0x561350d88e20 auth_method 0 2024-09-14T11:12:32.937 INFO:tasks.workunit.client.0.smithi050.stderr: -101> 2024-09-14T11:12:32.376+0000 7fed4ea86640 10 monclient: get_auth_request con 0x561350b3d4f0 auth_method 0 2024-09-14T11:12:32.937 INFO:tasks.workunit.client.0.smithi050.stderr: -100> 2024-09-14T11:12:32.376+0000 7fed4ea86640 0 -- 172.21.15.50:0/3993628404 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x561350b3d4f0 msgr2=0x7fed4800a3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:32.937 INFO:tasks.workunit.client.0.smithi050.stderr: -99> 2024-09-14T11:12:32.578+0000 7fed4ea86640 10 monclient: get_auth_request con 0x561350b3d4f0 auth_method 0 2024-09-14T11:12:32.937 INFO:tasks.workunit.client.0.smithi050.stderr: -98> 2024-09-14T11:12:32.580+0000 7fed47fff640 10 monclient: get_auth_request con 0x561350b45f60 auth_method 0 2024-09-14T11:12:32.938 INFO:tasks.workunit.client.0.smithi050.stderr: -97> 2024-09-14T11:12:32.582+0000 7fed4f287640 10 monclient: get_auth_request con 0x7fed400a2040 auth_method 0 2024-09-14T11:12:32.938 INFO:tasks.workunit.client.0.smithi050.stderr: -96> 2024-09-14T11:12:32.582+0000 7fed4f287640 0 -- 172.21.15.50:0/3993628404 >> [v2:172.21.15.118:6826/1082138742,v1:172.21.15.118:6827/1082138742] conn(0x7fed400a2040 msgr2=0x7fed40071890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:32.938 INFO:tasks.workunit.client.0.smithi050.stderr: -95> 2024-09-14T11:12:32.784+0000 7fed4f287640 10 monclient: get_auth_request con 0x7fed400a2040 auth_method 0 2024-09-14T11:12:32.938 INFO:tasks.workunit.client.0.smithi050.stderr: -94> 2024-09-14T11:12:32.785+0000 7fed4ea86640 10 monclient: get_auth_request con 0x561350b49b00 auth_method 0 2024-09-14T11:12:32.938 INFO:tasks.workunit.client.0.smithi050.stderr: -93> 2024-09-14T11:12:32.790+0000 7fed52d40800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:12:32.938 INFO:tasks.workunit.client.0.smithi050.stderr: -92> 2024-09-14T11:12:32.791+0000 7fed52d40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:32.938 INFO:tasks.workunit.client.0.smithi050.stderr: -91> 2024-09-14T11:12:32.791+0000 7fed52d40800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:12:32.938 INFO:tasks.workunit.client.0.smithi050.stderr: -90> 2024-09-14T11:12:32.791+0000 7fed52d40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:32.938 INFO:tasks.workunit.client.0.smithi050.stderr: -89> 2024-09-14T11:12:32.791+0000 7fed52d40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:32.938 INFO:tasks.workunit.client.0.smithi050.stderr: -88> 2024-09-14T11:12:32.791+0000 7fed52d40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:32.938 INFO:tasks.workunit.client.0.smithi050.stderr: -87> 2024-09-14T11:12:32.791+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.938 INFO:tasks.workunit.client.0.smithi050.stderr: -86> 2024-09-14T11:12:32.791+0000 7fed52d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.939 INFO:tasks.workunit.client.0.smithi050.stderr: -85> 2024-09-14T11:12:32.791+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.939 INFO:tasks.workunit.client.0.smithi050.stderr: -84> 2024-09-14T11:12:32.791+0000 7fed52d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:32.939 INFO:tasks.workunit.client.0.smithi050.stderr: -83> 2024-09-14T11:12:32.791+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.939 INFO:tasks.workunit.client.0.smithi050.stderr: -82> 2024-09-14T11:12:32.792+0000 7fed52d40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:32.939 INFO:tasks.workunit.client.0.smithi050.stderr: -81> 2024-09-14T11:12:32.792+0000 7fed52d40800 20 zone default found 2024-09-14T11:12:32.939 INFO:tasks.workunit.client.0.smithi050.stderr: -80> 2024-09-14T11:12:32.792+0000 7fed52d40800 4 Realm: () 2024-09-14T11:12:32.939 INFO:tasks.workunit.client.0.smithi050.stderr: -79> 2024-09-14T11:12:32.792+0000 7fed52d40800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:12:32.939 INFO:tasks.workunit.client.0.smithi050.stderr: -78> 2024-09-14T11:12:32.792+0000 7fed52d40800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:12:32.939 INFO:tasks.workunit.client.0.smithi050.stderr: -77> 2024-09-14T11:12:32.792+0000 7fed52d40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:32.939 INFO:tasks.workunit.client.0.smithi050.stderr: -76> 2024-09-14T11:12:32.792+0000 7fed52d40800 20 zonegroup default 2024-09-14T11:12:32.939 INFO:tasks.workunit.client.0.smithi050.stderr: -75> 2024-09-14T11:12:32.792+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.939 INFO:tasks.workunit.client.0.smithi050.stderr: -74> 2024-09-14T11:12:32.792+0000 7fed52d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.939 INFO:tasks.workunit.client.0.smithi050.stderr: -73> 2024-09-14T11:12:32.792+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.940 INFO:tasks.workunit.client.0.smithi050.stderr: -72> 2024-09-14T11:12:32.792+0000 7fed52d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.940 INFO:tasks.workunit.client.0.smithi050.stderr: -71> 2024-09-14T11:12:32.792+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.940 INFO:tasks.workunit.client.0.smithi050.stderr: -70> 2024-09-14T11:12:32.793+0000 7fed52d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.940 INFO:tasks.workunit.client.0.smithi050.stderr: -69> 2024-09-14T11:12:32.793+0000 7fed52d40800 20 started sync module instance, tier type = 2024-09-14T11:12:32.940 INFO:tasks.workunit.client.0.smithi050.stderr: -68> 2024-09-14T11:12:32.793+0000 7fed52d40800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:12:32.940 INFO:tasks.workunit.client.0.smithi050.stderr: -67> 2024-09-14T11:12:32.802+0000 7fed52d40800 20 add_watcher() i=0 2024-09-14T11:12:32.940 INFO:tasks.workunit.client.0.smithi050.stderr: -66> 2024-09-14T11:12:32.802+0000 7fed52d40800 20 add_watcher() i=1 2024-09-14T11:12:32.940 INFO:tasks.workunit.client.0.smithi050.stderr: -65> 2024-09-14T11:12:32.802+0000 7fed52d40800 20 add_watcher() i=2 2024-09-14T11:12:32.940 INFO:tasks.workunit.client.0.smithi050.stderr: -64> 2024-09-14T11:12:32.802+0000 7fed52d40800 20 add_watcher() i=3 2024-09-14T11:12:32.940 INFO:tasks.workunit.client.0.smithi050.stderr: -63> 2024-09-14T11:12:32.802+0000 7fed52d40800 20 add_watcher() i=4 2024-09-14T11:12:32.940 INFO:tasks.workunit.client.0.smithi050.stderr: -62> 2024-09-14T11:12:32.802+0000 7fed52d40800 20 add_watcher() i=5 2024-09-14T11:12:32.940 INFO:tasks.workunit.client.0.smithi050.stderr: -61> 2024-09-14T11:12:32.802+0000 7fed52d40800 20 add_watcher() i=6 2024-09-14T11:12:32.940 INFO:tasks.workunit.client.0.smithi050.stderr: -60> 2024-09-14T11:12:32.803+0000 7fed52d40800 20 add_watcher() i=7 2024-09-14T11:12:32.941 INFO:tasks.workunit.client.0.smithi050.stderr: -59> 2024-09-14T11:12:32.803+0000 7fed52d40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:32.941 INFO:tasks.workunit.client.0.smithi050.stderr: -58> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding auth protocol: cephx 2024-09-14T11:12:32.941 INFO:tasks.workunit.client.0.smithi050.stderr: -57> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding auth protocol: cephx 2024-09-14T11:12:32.941 INFO:tasks.workunit.client.0.smithi050.stderr: -56> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding auth protocol: cephx 2024-09-14T11:12:32.941 INFO:tasks.workunit.client.0.smithi050.stderr: -55> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding con mode: secure 2024-09-14T11:12:32.941 INFO:tasks.workunit.client.0.smithi050.stderr: -54> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding con mode: crc 2024-09-14T11:12:32.941 INFO:tasks.workunit.client.0.smithi050.stderr: -53> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding con mode: secure 2024-09-14T11:12:32.941 INFO:tasks.workunit.client.0.smithi050.stderr: -52> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding con mode: crc 2024-09-14T11:12:32.941 INFO:tasks.workunit.client.0.smithi050.stderr: -51> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding con mode: secure 2024-09-14T11:12:32.941 INFO:tasks.workunit.client.0.smithi050.stderr: -50> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding con mode: crc 2024-09-14T11:12:32.941 INFO:tasks.workunit.client.0.smithi050.stderr: -49> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding con mode: crc 2024-09-14T11:12:32.941 INFO:tasks.workunit.client.0.smithi050.stderr: -48> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding con mode: secure 2024-09-14T11:12:32.941 INFO:tasks.workunit.client.0.smithi050.stderr: -47> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding con mode: crc 2024-09-14T11:12:32.941 INFO:tasks.workunit.client.0.smithi050.stderr: -46> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding con mode: secure 2024-09-14T11:12:32.942 INFO:tasks.workunit.client.0.smithi050.stderr: -45> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding con mode: crc 2024-09-14T11:12:32.942 INFO:tasks.workunit.client.0.smithi050.stderr: -44> 2024-09-14T11:12:32.804+0000 7fed52d40800 5 AuthRegistry(0x7fff2c4d4f50) adding con mode: secure 2024-09-14T11:12:32.942 INFO:tasks.workunit.client.0.smithi050.stderr: -43> 2024-09-14T11:12:32.804+0000 7fec057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:32.942 INFO:tasks.workunit.client.0.smithi050.stderr: -42> 2024-09-14T11:12:32.805+0000 7fed52d40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:12:32.942 INFO:tasks.workunit.client.0.smithi050.stderr: -41> 2024-09-14T11:12:32.805+0000 7fed52d40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:32.942 INFO:tasks.workunit.client.0.smithi050.stderr: -40> 2024-09-14T11:12:32.805+0000 7fed52d40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:32.942 INFO:tasks.workunit.client.0.smithi050.stderr: -39> 2024-09-14T11:12:32.805+0000 7fed52d40800 5 asok(0x561350a71270) register_command cache list hook 0x561350d57210 2024-09-14T11:12:32.942 INFO:tasks.workunit.client.0.smithi050.stderr: -38> 2024-09-14T11:12:32.805+0000 7fed52d40800 5 asok(0x561350a71270) register_command cache inspect hook 0x561350d57210 2024-09-14T11:12:32.942 INFO:tasks.workunit.client.0.smithi050.stderr: -37> 2024-09-14T11:12:32.805+0000 7fed52d40800 5 asok(0x561350a71270) register_command cache erase hook 0x561350d57210 2024-09-14T11:12:32.942 INFO:tasks.workunit.client.0.smithi050.stderr: -36> 2024-09-14T11:12:32.805+0000 7fed52d40800 5 asok(0x561350a71270) register_command cache zap hook 0x561350d57210 2024-09-14T11:12:32.942 INFO:tasks.workunit.client.0.smithi050.stderr: -35> 2024-09-14T11:12:32.805+0000 7fed52d40800 5 note: GC not initialized 2024-09-14T11:12:32.942 INFO:tasks.workunit.client.0.smithi050.stderr: -34> 2024-09-14T11:12:32.805+0000 7feb7ffff640 20 reqs_thread_entry: start 2024-09-14T11:12:32.942 INFO:tasks.workunit.client.0.smithi050.stderr: -33> 2024-09-14T11:12:32.805+0000 7fed52d40800 5 asok(0x561350a71270) register_command sync trace show hook 0x7fed4806d020 2024-09-14T11:12:32.942 INFO:tasks.workunit.client.0.smithi050.stderr: -32> 2024-09-14T11:12:32.805+0000 7fed52d40800 5 asok(0x561350a71270) register_command sync trace history hook 0x7fed4806d020 2024-09-14T11:12:32.943 INFO:tasks.workunit.client.0.smithi050.stderr: -31> 2024-09-14T11:12:32.805+0000 7fed52d40800 5 asok(0x561350a71270) register_command sync trace active hook 0x7fed4806d020 2024-09-14T11:12:32.943 INFO:tasks.workunit.client.0.smithi050.stderr: -30> 2024-09-14T11:12:32.805+0000 7fed52d40800 5 asok(0x561350a71270) register_command sync trace active_short hook 0x7fed4806d020 2024-09-14T11:12:32.943 INFO:tasks.workunit.client.0.smithi050.stderr: -29> 2024-09-14T11:12:32.805+0000 7fed52d40800 20 init_complete bucket index max shards: 11 2024-09-14T11:12:32.943 INFO:tasks.workunit.client.0.smithi050.stderr: -28> 2024-09-14T11:12:32.805+0000 7fed52d40800 20 Filter name: none 2024-09-14T11:12:32.943 INFO:tasks.workunit.client.0.smithi050.stderr: -27> 2024-09-14T11:12:32.805+0000 7feb7dffb640 20 reqs_thread_entry: start 2024-09-14T11:12:32.943 INFO:tasks.workunit.client.0.smithi050.stderr: -26> 2024-09-14T11:12:32.805+0000 7fed52d40800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:12:32.943 INFO:tasks.workunit.client.0.smithi050.stderr: -25> 2024-09-14T11:12:32.805+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.943 INFO:tasks.workunit.client.0.smithi050.stderr: -24> 2024-09-14T11:12:32.806+0000 7fed52d40800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:12:32.943 INFO:tasks.workunit.client.0.smithi050.stderr: -23> 2024-09-14T11:12:32.806+0000 7fed52d40800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:12:32.943 INFO:tasks.workunit.client.0.smithi050.stderr: -22> 2024-09-14T11:12:32.806+0000 7fed52d40800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:12:32.943 INFO:tasks.workunit.client.0.smithi050.stderr: -21> 2024-09-14T11:12:32.806+0000 7fed52d40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 : miss 2024-09-14T11:12:32.943 INFO:tasks.workunit.client.0.smithi050.stderr: -20> 2024-09-14T11:12:32.806+0000 7fed52d40800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.943 INFO:tasks.workunit.client.0.smithi050.stderr: -19> 2024-09-14T11:12:32.806+0000 7fed52d40800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:12:32.943 INFO:tasks.workunit.client.0.smithi050.stderr: -18> 2024-09-14T11:12:32.806+0000 7fed52d40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 info.flags=0x17 2024-09-14T11:12:32.944 INFO:tasks.workunit.client.0.smithi050.stderr: -17> 2024-09-14T11:12:32.806+0000 7fed52d40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 to cache LRU end 2024-09-14T11:12:32.944 INFO:tasks.workunit.client.0.smithi050.stderr: -16> 2024-09-14T11:12:32.806+0000 7fed52d40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:32.944 INFO:tasks.workunit.client.0.smithi050.stderr: -15> 2024-09-14T11:12:32.806+0000 7fed52d40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:32.944 INFO:tasks.workunit.client.0.smithi050.stderr: -14> 2024-09-14T11:12:32.806+0000 7fed52d40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 2024-09-14T11:12:32.944 INFO:tasks.workunit.client.0.smithi050.stderr: -13> 2024-09-14T11:12:32.812+0000 7fed52d40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 info.flags=0x17 2024-09-14T11:12:32.944 INFO:tasks.workunit.client.0.smithi050.stderr: -12> 2024-09-14T11:12:32.812+0000 7fed52d40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 to cache LRU end 2024-09-14T11:12:32.944 INFO:tasks.workunit.client.0.smithi050.stderr: -11> 2024-09-14T11:12:32.812+0000 7fed52d40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:32.944 INFO:tasks.workunit.client.0.smithi050.stderr: -10> 2024-09-14T11:12:32.812+0000 7fed52d40800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35, ofs0, ns] 2024-09-14T11:12:32.944 INFO:tasks.workunit.client.0.smithi050.stderr: -9> 2024-09-14T11:12:32.812+0000 7fec31ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496985 cookie 94640960754832 notifier 7596 bl.length()=995 2024-09-14T11:12:32.944 INFO:tasks.workunit.client.0.smithi050.stderr: -8> 2024-09-14T11:12:32.812+0000 7fec31ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 info.flags=0x17 2024-09-14T11:12:32.944 INFO:tasks.workunit.client.0.smithi050.stderr: -7> 2024-09-14T11:12:32.812+0000 7fec31ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 to cache LRU end 2024-09-14T11:12:32.944 INFO:tasks.workunit.client.0.smithi050.stderr: -6> 2024-09-14T11:12:32.812+0000 7fec31ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:32.944 INFO:tasks.workunit.client.0.smithi050.stderr: -5> 2024-09-14T11:12:32.814+0000 7fed52d40800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35]): orig_sources= new_sources= 2024-09-14T11:12:32.945 INFO:tasks.workunit.client.0.smithi050.stderr: -4> 2024-09-14T11:12:32.814+0000 7fed52d40800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35]): potential sources added=[] removed=[] 2024-09-14T11:12:32.945 INFO:tasks.workunit.client.0.smithi050.stderr: -3> 2024-09-14T11:12:32.814+0000 7fed52d40800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35]): orig_dests= new_dests= 2024-09-14T11:12:32.945 INFO:tasks.workunit.client.0.smithi050.stderr: -2> 2024-09-14T11:12:32.814+0000 7fed52d40800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35]): potential dests added=[] removed=[] 2024-09-14T11:12:32.945 INFO:tasks.workunit.client.0.smithi050.stderr: -1> 2024-09-14T11:12:32.820+0000 7fed52d40800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fed52d40800 time 2024-09-14T11:12:32.820116+0000 2024-09-14T11:12:32.945 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:12:32.945 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.945 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:12:32.945 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fed5458c76a] 2024-09-14T11:12:32.945 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fed5458c928] 2024-09-14T11:12:32.945 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56134ef050b1] 2024-09-14T11:12:32.945 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56134ef14f6a] 2024-09-14T11:12:32.945 INFO:tasks.workunit.client.0.smithi050.stderr: 5: main() 2024-09-14T11:12:32.946 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fed53229590] 2024-09-14T11:12:32.946 INFO:tasks.workunit.client.0.smithi050.stderr: 7: __libc_start_main() 2024-09-14T11:12:32.946 INFO:tasks.workunit.client.0.smithi050.stderr: 8: _start() 2024-09-14T11:12:32.946 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.946 INFO:tasks.workunit.client.0.smithi050.stderr: 0> 2024-09-14T11:12:32.821+0000 7fed52d40800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:12:32.946 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7fed52d40800 thread_name:radosgw-admin 2024-09-14T11:12:32.946 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.946 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:12:32.946 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fed5323e6f0] 2024-09-14T11:12:32.946 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fed5328b99c] 2024-09-14T11:12:32.946 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:12:32.946 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:12:32.946 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fed5458c7c4] 2024-09-14T11:12:32.946 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fed5458c928] 2024-09-14T11:12:32.947 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56134ef050b1] 2024-09-14T11:12:32.947 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56134ef14f6a] 2024-09-14T11:12:32.947 INFO:tasks.workunit.client.0.smithi050.stderr: 9: main() 2024-09-14T11:12:32.947 INFO:tasks.workunit.client.0.smithi050.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fed53229590] 2024-09-14T11:12:32.947 INFO:tasks.workunit.client.0.smithi050.stderr: 11: __libc_start_main() 2024-09-14T11:12:32.947 INFO:tasks.workunit.client.0.smithi050.stderr: 12: _start() 2024-09-14T11:12:32.947 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:12:32.947 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:32.947 INFO:tasks.workunit.client.0.smithi050.stderr:--- logging levels --- 2024-09-14T11:12:32.947 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 none 2024-09-14T11:12:32.947 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 lockdep 2024-09-14T11:12:32.947 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 context 2024-09-14T11:12:32.947 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 crush 2024-09-14T11:12:32.947 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds 2024-09-14T11:12:32.947 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_balancer 2024-09-14T11:12:32.948 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_locker 2024-09-14T11:12:32.948 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log 2024-09-14T11:12:32.948 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log_expire 2024-09-14T11:12:32.948 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_migrator 2024-09-14T11:12:32.948 INFO:tasks.workunit.client.0.smithi050.stderr: 3/ 5 mds_quiesce 2024-09-14T11:12:32.948 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 buffer 2024-09-14T11:12:32.948 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 timer 2024-09-14T11:12:32.948 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 filer 2024-09-14T11:12:32.948 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 striper 2024-09-14T11:12:32.948 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 objecter 2024-09-14T11:12:32.948 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rados 2024-09-14T11:12:32.948 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd 2024-09-14T11:12:32.948 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_mirror 2024-09-14T11:12:32.948 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_replay 2024-09-14T11:12:32.949 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_pwl 2024-09-14T11:12:32.949 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 journaler 2024-09-14T11:12:32.949 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objectcacher 2024-09-14T11:12:32.949 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:12:32.949 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 client 2024-09-14T11:12:32.949 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 osd 2024-09-14T11:12:32.949 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 optracker 2024-09-14T11:12:32.949 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objclass 2024-09-14T11:12:32.949 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 filestore 2024-09-14T11:12:32.949 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 journal 2024-09-14T11:12:32.949 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 ms 2024-09-14T11:12:32.949 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mon 2024-09-14T11:12:32.949 INFO:tasks.workunit.client.0.smithi050.stderr: 0/10 monc 2024-09-14T11:12:32.949 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 paxos 2024-09-14T11:12:32.950 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 tp 2024-09-14T11:12:32.950 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 auth 2024-09-14T11:12:32.950 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 crypto 2024-09-14T11:12:32.950 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 finisher 2024-09-14T11:12:32.950 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 reserver 2024-09-14T11:12:32.950 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 heartbeatmap 2024-09-14T11:12:32.950 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 perfcounter 2024-09-14T11:12:32.950 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw 2024-09-14T11:12:32.950 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_sync 2024-09-14T11:12:32.950 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_datacache 2024-09-14T11:12:32.950 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_access 2024-09-14T11:12:32.950 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:12:32.950 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_flight 2024-09-14T11:12:32.950 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:12:32.951 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw_notification 2024-09-14T11:12:32.951 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 javaclient 2024-09-14T11:12:32.951 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 asok 2024-09-14T11:12:32.951 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 throttle 2024-09-14T11:12:32.951 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 refs 2024-09-14T11:12:32.951 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 compressor 2024-09-14T11:12:32.951 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluestore 2024-09-14T11:12:32.951 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluefs 2024-09-14T11:12:32.951 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 bdev 2024-09-14T11:12:32.951 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 kstore 2024-09-14T11:12:32.951 INFO:tasks.workunit.client.0.smithi050.stderr: 4/ 5 rocksdb 2024-09-14T11:12:32.951 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 fuse 2024-09-14T11:12:32.951 INFO:tasks.workunit.client.0.smithi050.stderr: 2/ 5 mgr 2024-09-14T11:12:32.951 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mgrc 2024-09-14T11:12:32.951 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 dpdk 2024-09-14T11:12:32.952 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 eventtrace 2024-09-14T11:12:32.952 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 prioritycache 2024-09-14T11:12:32.952 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 test 2024-09-14T11:12:32.952 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:12:32.952 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephsqlite 2024-09-14T11:12:32.952 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:12:32.952 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore 2024-09-14T11:12:32.952 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_onode 2024-09-14T11:12:32.952 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_odata 2024-09-14T11:12:32.952 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_omap 2024-09-14T11:12:32.952 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_tm 2024-09-14T11:12:32.952 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_t 2024-09-14T11:12:32.952 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:12:32.952 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_epm 2024-09-14T11:12:32.953 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_lba 2024-09-14T11:12:32.953 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:12:32.953 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cache 2024-09-14T11:12:32.953 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_journal 2024-09-14T11:12:32.953 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_device 2024-09-14T11:12:32.953 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_backref 2024-09-14T11:12:32.953 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 alienstore 2024-09-14T11:12:32.953 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mclock 2024-09-14T11:12:32.953 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cyanstore 2024-09-14T11:12:32.953 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 ceph_exporter 2024-09-14T11:12:32.953 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 memstore 2024-09-14T11:12:32.953 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 trace 2024-09-14T11:12:32.953 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 ceph_dedup 2024-09-14T11:12:32.953 INFO:tasks.workunit.client.0.smithi050.stderr: -2/-2 (syslog threshold) 2024-09-14T11:12:32.953 INFO:tasks.workunit.client.0.smithi050.stderr: 99/99 (stderr threshold) 2024-09-14T11:12:32.954 INFO:tasks.workunit.client.0.smithi050.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:12:32.954 INFO:tasks.workunit.client.0.smithi050.stderr: 7feb7dffb640 / http_manager 2024-09-14T11:12:32.954 INFO:tasks.workunit.client.0.smithi050.stderr: 7feb7ffff640 / http_manager 2024-09-14T11:12:32.954 INFO:tasks.workunit.client.0.smithi050.stderr: 7fec057e2640 / rgw_dt_lg_renew 2024-09-14T11:12:32.954 INFO:tasks.workunit.client.0.smithi050.stderr: 7fec30ff9640 / ms_dispatch 2024-09-14T11:12:32.954 INFO:tasks.workunit.client.0.smithi050.stderr: 7fec31ffb640 / io_context_pool 2024-09-14T11:12:32.954 INFO:tasks.workunit.client.0.smithi050.stderr: 7fec327fc640 / io_context_pool 2024-09-14T11:12:32.954 INFO:tasks.workunit.client.0.smithi050.stderr: 7fec38e01640 / ms_dispatch 2024-09-14T11:12:32.954 INFO:tasks.workunit.client.0.smithi050.stderr: 7fec3b606640 / ms_dispatch 2024-09-14T11:12:32.954 INFO:tasks.workunit.client.0.smithi050.stderr: 7fec3ce09640 / io_context_pool 2024-09-14T11:12:32.954 INFO:tasks.workunit.client.0.smithi050.stderr: 7fed47fff640 / msgr-worker-2 2024-09-14T11:12:32.954 INFO:tasks.workunit.client.0.smithi050.stderr: 7fed4ea86640 / msgr-worker-1 2024-09-14T11:12:32.954 INFO:tasks.workunit.client.0.smithi050.stderr: 7fed4f287640 / msgr-worker-0 2024-09-14T11:12:32.954 INFO:tasks.workunit.client.0.smithi050.stderr: 7fed4fa88640 / io_context_pool 2024-09-14T11:12:32.955 INFO:tasks.workunit.client.0.smithi050.stderr: 7fed52d40800 / radosgw-admin 2024-09-14T11:12:32.955 INFO:tasks.workunit.client.0.smithi050.stderr: max_recent 500 2024-09-14T11:12:32.955 INFO:tasks.workunit.client.0.smithi050.stderr: max_new 1000 2024-09-14T11:12:32.955 INFO:tasks.workunit.client.0.smithi050.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:12:32.821560Z_1b068bad-6b10-4545-8ea6-99d1bd28e66e/log 2024-09-14T11:12:32.955 INFO:tasks.workunit.client.0.smithi050.stderr:--- end dump of recent events --- 2024-09-14T11:12:32.955 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:12:32.956 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:32.957 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:32.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.902+0000 7f8a29546800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.904+0000 7f8a29546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.904+0000 7f8a29546800 20 realm 2024-09-14T11:12:32.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.904+0000 7f8a29546800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.904+0000 7f8a29546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.904+0000 7f8a29546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:32.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.904+0000 7f8a29546800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.905+0000 7f8a29546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:32.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.905+0000 7f8a29546800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.905+0000 7f8a29546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:32.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.905+0000 7f8a29546800 20 rados->read ofs=0 len=0 2024-09-14T11:12:32.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.906+0000 7f8a29546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:32.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.906+0000 7f8a29546800 20 searching for the correct realm 2024-09-14T11:12:32.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:32.909+0000 7f8a2682f640 0 -- 172.21.15.50:0/808595790 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f8a200054d0 msgr2=0x7f8a20005950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:33.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.115+0000 7f8a27831640 0 -- 172.21.15.50:0/808595790 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55f78f679c40 msgr2=0x55f78f67c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:33.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.119+0000 7f8a29546800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:12:33.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.119+0000 7f8a29546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:33.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.119+0000 7f8a29546800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:12:33.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.119+0000 7f8a29546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:33.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.119+0000 7f8a29546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:33.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.119+0000 7f8a29546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:33.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.119+0000 7f8a29546800 20 rados->read ofs=0 len=0 2024-09-14T11:12:33.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.119+0000 7f8a29546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:33.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.119+0000 7f8a29546800 20 rados->read ofs=0 len=0 2024-09-14T11:12:33.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.120+0000 7f8a29546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:33.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.120+0000 7f8a29546800 20 rados->read ofs=0 len=0 2024-09-14T11:12:33.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.120+0000 7f8a29546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:33.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.120+0000 7f8a29546800 20 zone default found 2024-09-14T11:12:33.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.120+0000 7f8a29546800 4 Realm: () 2024-09-14T11:12:33.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.120+0000 7f8a29546800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:12:33.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.120+0000 7f8a29546800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:12:33.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.120+0000 7f8a29546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:33.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.120+0000 7f8a29546800 20 zonegroup default 2024-09-14T11:12:33.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.120+0000 7f8a29546800 20 rados->read ofs=0 len=0 2024-09-14T11:12:33.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.120+0000 7f8a29546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:33.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.120+0000 7f8a29546800 20 rados->read ofs=0 len=0 2024-09-14T11:12:33.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.120+0000 7f8a29546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:33.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.120+0000 7f8a29546800 20 rados->read ofs=0 len=0 2024-09-14T11:12:33.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.121+0000 7f8a29546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:33.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.121+0000 7f8a29546800 20 started sync module instance, tier type = 2024-09-14T11:12:33.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.121+0000 7f8a29546800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:12:33.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.129+0000 7f8a29546800 20 add_watcher() i=0 2024-09-14T11:12:33.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.129+0000 7f8a29546800 20 add_watcher() i=1 2024-09-14T11:12:33.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.129+0000 7f8a29546800 20 add_watcher() i=2 2024-09-14T11:12:33.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.129+0000 7f8a29546800 20 add_watcher() i=3 2024-09-14T11:12:33.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.129+0000 7f8a29546800 20 add_watcher() i=4 2024-09-14T11:12:33.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.129+0000 7f8a29546800 20 add_watcher() i=5 2024-09-14T11:12:33.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.129+0000 7f8a29546800 20 add_watcher() i=6 2024-09-14T11:12:33.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.130+0000 7f8a29546800 20 add_watcher() i=7 2024-09-14T11:12:33.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.130+0000 7f8a29546800 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:33.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.132+0000 7f88ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:33.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.132+0000 7f8a29546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:33.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.132+0000 7f8a29546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:33.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.132+0000 7f8a29546800 5 note: GC not initialized 2024-09-14T11:12:33.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.132+0000 7f88dcfe1640 20 reqs_thread_entry: start 2024-09-14T11:12:33.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.133+0000 7f8a29546800 20 init_complete bucket index max shards: 11 2024-09-14T11:12:33.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.133+0000 7f8a29546800 20 Filter name: none 2024-09-14T11:12:33.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.133+0000 7f88567fc640 20 reqs_thread_entry: start 2024-09-14T11:12:33.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.133+0000 7f8a29546800 20 rados->read ofs=0 len=0 2024-09-14T11:12:33.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.133+0000 7f8a29546800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:12:33.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.133+0000 7f8a29546800 20 rados->read ofs=0 len=0 2024-09-14T11:12:33.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.134+0000 7f8a29546800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:12:33.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.134+0000 7f8a29546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:33.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.134+0000 7f8a29546800 20 rados->read ofs=0 len=0 2024-09-14T11:12:33.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.134+0000 7f8a29546800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:12:33.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.134+0000 7f8a29546800 20 rados->read ofs=0 len=0 2024-09-14T11:12:33.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.135+0000 7f8a29546800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:12:33.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.135+0000 7f8a29546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:33.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.136+0000 7f88ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:33.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.139+0000 7f8a29546800 20 remove_watcher() i=0 2024-09-14T11:12:33.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.139+0000 7f8a29546800 2 removed watcher, disabling cache 2024-09-14T11:12:33.138 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.140+0000 7f8a29546800 20 remove_watcher() i=1 2024-09-14T11:12:33.138 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.141+0000 7f8a29546800 20 remove_watcher() i=2 2024-09-14T11:12:33.140 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.141+0000 7f8a29546800 20 remove_watcher() i=3 2024-09-14T11:12:33.140 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.142+0000 7f8a29546800 20 remove_watcher() i=4 2024-09-14T11:12:33.141 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.143+0000 7f8a29546800 20 remove_watcher() i=5 2024-09-14T11:12:33.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.145+0000 7f8a29546800 20 remove_watcher() i=6 2024-09-14T11:12:33.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.146+0000 7f8a29546800 20 remove_watcher() i=7 2024-09-14T11:12:33.155 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:33.156 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:12:33.156 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: abort-at-do-reshard id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:12:33.156 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:12:33.157 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:33.157 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:33.192 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:12:33.192 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:12:33.250 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:12:33.283 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:33.283 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:33.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.324+0000 7fe5b6d31800 20 rados->read ofs=0 len=0 2024-09-14T11:12:33.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.325+0000 7fe5b6d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:33.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.325+0000 7fe5b6d31800 20 realm 2024-09-14T11:12:33.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.325+0000 7fe5b6d31800 20 rados->read ofs=0 len=0 2024-09-14T11:12:33.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.326+0000 7fe5b6d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:33.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.326+0000 7fe5b6d31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:33.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.326+0000 7fe5b6d31800 20 rados->read ofs=0 len=0 2024-09-14T11:12:33.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.326+0000 7fe5b6d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:33.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.326+0000 7fe5b6d31800 20 rados->read ofs=0 len=0 2024-09-14T11:12:33.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.327+0000 7fe5b6d31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:33.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.327+0000 7fe5b6d31800 20 rados->read ofs=0 len=0 2024-09-14T11:12:33.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.327+0000 7fe5b6d31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:33.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.327+0000 7fe5b6d31800 20 searching for the correct realm 2024-09-14T11:12:33.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.331+0000 7fe5b319a640 0 -- 172.21.15.50:0/2968008355 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5607c44d6ec0 msgr2=0x5607c44d9380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:33.333 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.335+0000 7fe5b319a640 0 -- 172.21.15.50:0/2968008355 >> [v2:172.21.15.118:6816/4154782182,v1:172.21.15.118:6817/4154782182] conn(0x5607c44e3750 msgr2=0x5607c44e5c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:33.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.338+0000 7fe5b6d31800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:12:33.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.338+0000 7fe5b6d31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:33.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.338+0000 7fe5b6d31800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:12:33.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.338+0000 7fe5b6d31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:33.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.338+0000 7fe5b6d31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:33.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.338+0000 7fe5b6d31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:33.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.338+0000 7fe5b6d31800 20 rados->read ofs=0 len=0 2024-09-14T11:12:33.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.338+0000 7fe5b6d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:33.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.338+0000 7fe5b6d31800 20 rados->read ofs=0 len=0 2024-09-14T11:12:33.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.339+0000 7fe5b6d31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:33.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.339+0000 7fe5b6d31800 20 rados->read ofs=0 len=0 2024-09-14T11:12:33.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.339+0000 7fe5b6d31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:33.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.339+0000 7fe5b6d31800 20 zone default found 2024-09-14T11:12:33.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.339+0000 7fe5b6d31800 4 Realm: () 2024-09-14T11:12:33.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.339+0000 7fe5b6d31800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:12:33.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.339+0000 7fe5b6d31800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:12:33.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.339+0000 7fe5b6d31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:33.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.339+0000 7fe5b6d31800 20 zonegroup default 2024-09-14T11:12:33.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.339+0000 7fe5b6d31800 20 rados->read ofs=0 len=0 2024-09-14T11:12:33.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.339+0000 7fe5b6d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:33.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.339+0000 7fe5b6d31800 20 rados->read ofs=0 len=0 2024-09-14T11:12:33.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.340+0000 7fe5b6d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:33.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.340+0000 7fe5b6d31800 20 rados->read ofs=0 len=0 2024-09-14T11:12:33.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.340+0000 7fe5b6d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:33.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.340+0000 7fe5b6d31800 20 started sync module instance, tier type = 2024-09-14T11:12:33.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.340+0000 7fe5b6d31800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:12:33.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.349+0000 7fe5b6d31800 20 add_watcher() i=0 2024-09-14T11:12:33.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.349+0000 7fe5b6d31800 20 add_watcher() i=1 2024-09-14T11:12:33.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.349+0000 7fe5b6d31800 20 add_watcher() i=2 2024-09-14T11:12:33.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.349+0000 7fe5b6d31800 20 add_watcher() i=3 2024-09-14T11:12:33.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.349+0000 7fe5b6d31800 20 add_watcher() i=4 2024-09-14T11:12:33.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.349+0000 7fe5b6d31800 20 add_watcher() i=5 2024-09-14T11:12:33.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.349+0000 7fe5b6d31800 20 add_watcher() i=6 2024-09-14T11:12:33.348 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.350+0000 7fe5b6d31800 20 add_watcher() i=7 2024-09-14T11:12:33.348 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.350+0000 7fe5b6d31800 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:33.350 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.352+0000 7fe4697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:33.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.352+0000 7fe5b6d31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:33.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.352+0000 7fe5b6d31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:33.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.352+0000 7fe5b6d31800 5 note: GC not initialized 2024-09-14T11:12:33.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.352+0000 7fe3e3fff640 20 reqs_thread_entry: start 2024-09-14T11:12:33.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.352+0000 7fe5b6d31800 20 init_complete bucket index max shards: 11 2024-09-14T11:12:33.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.352+0000 7fe5b6d31800 20 Filter name: none 2024-09-14T11:12:33.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.352+0000 7fe3e1ffb640 20 reqs_thread_entry: start 2024-09-14T11:12:33.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.353+0000 7fe5b6d31800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:12:33.352 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.353+0000 7fe5b6d31800 20 rados->read ofs=0 len=0 2024-09-14T11:12:33.352 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.353+0000 7fe5b6d31800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:12:33.352 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.353+0000 7fe5b6d31800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:12:33.352 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.353+0000 7fe5b6d31800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:12:33.352 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.353+0000 7fe5b6d31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 : miss 2024-09-14T11:12:33.352 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.353+0000 7fe5b6d31800 20 rados->read ofs=0 len=0 2024-09-14T11:12:33.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.353+0000 7fe5b6d31800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:12:33.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.353+0000 7fe5b6d31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 info.flags=0x17 2024-09-14T11:12:33.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.353+0000 7fe5b6d31800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 to cache LRU end 2024-09-14T11:12:33.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.353+0000 7fe5b6d31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:33.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.353+0000 7fe5b6d31800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:12:33.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.353+0000 7fe5b6d31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 2024-09-14T11:12:33.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.355+0000 7fe5b6d31800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 to be held by another RGW process; skipping for now 2024-09-14T11:12:33.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.355+0000 7fe4697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:33.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.358+0000 7fe5b6d31800 20 remove_watcher() i=0 2024-09-14T11:12:33.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.358+0000 7fe5b6d31800 2 removed watcher, disabling cache 2024-09-14T11:12:33.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.359+0000 7fe5b6d31800 20 remove_watcher() i=1 2024-09-14T11:12:33.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.360+0000 7fe5b6d31800 20 remove_watcher() i=2 2024-09-14T11:12:33.359 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.361+0000 7fe5b6d31800 20 remove_watcher() i=3 2024-09-14T11:12:33.360 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.362+0000 7fe5b6d31800 20 remove_watcher() i=4 2024-09-14T11:12:33.360 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.362+0000 7fe5b6d31800 20 remove_watcher() i=5 2024-09-14T11:12:33.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.363+0000 7fe5b6d31800 20 remove_watcher() i=6 2024-09-14T11:12:33.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:12:33.365+0000 7fe5b6d31800 20 remove_watcher() i=7 2024-09-14T11:12:33.374 INFO:tasks.workunit.client.0.smithi050.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:13:03.397 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:13:03.436 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:03.436 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:03.482 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.483+0000 7fa3ad210800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.485+0000 7fa3ad210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.485+0000 7fa3ad210800 20 realm 2024-09-14T11:13:03.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.485+0000 7fa3ad210800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.485+0000 7fa3ad210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.485+0000 7fa3ad210800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:03.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.485+0000 7fa3ad210800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.486+0000 7fa3ad210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.486+0000 7fa3ad210800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.486 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.486+0000 7fa3ad210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:03.486 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.486+0000 7fa3ad210800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.486 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.487+0000 7fa3ad210800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:03.486 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.487+0000 7fa3ad210800 20 searching for the correct realm 2024-09-14T11:13:03.489 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.490+0000 7fa3a3fff640 0 -- 172.21.15.50:0/2830575083 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fa3a406a040 msgr2=0x7fa3a40b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:03.695 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.696+0000 7fa3a3fff640 0 -- 172.21.15.50:0/2830575083 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x558687b2d590 msgr2=0x558687b2fa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:03.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.701+0000 7fa3ad210800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:03.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.701+0000 7fa3ad210800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:03.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.701+0000 7fa3ad210800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:03.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.701+0000 7fa3ad210800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:03.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.701+0000 7fa3ad210800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:03.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.701+0000 7fa3ad210800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:03.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.701+0000 7fa3ad210800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.702 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.702+0000 7fa3ad210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.702 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.702+0000 7fa3ad210800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.702 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.702+0000 7fa3ad210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:03.702 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.702+0000 7fa3ad210800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.702 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.702+0000 7fa3ad210800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:03.702 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.702+0000 7fa3ad210800 20 zone default found 2024-09-14T11:13:03.702 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.702+0000 7fa3ad210800 4 Realm: () 2024-09-14T11:13:03.702 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.702+0000 7fa3ad210800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:03.702 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.702+0000 7fa3ad210800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:03.703 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.702+0000 7fa3ad210800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:03.703 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.702+0000 7fa3ad210800 20 zonegroup default 2024-09-14T11:13:03.703 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.702+0000 7fa3ad210800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.703 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.703+0000 7fa3ad210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.703 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.703+0000 7fa3ad210800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.703 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.703+0000 7fa3ad210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.703+0000 7fa3ad210800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.704+0000 7fa3ad210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.704+0000 7fa3ad210800 20 started sync module instance, tier type = 2024-09-14T11:13:03.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.704+0000 7fa3ad210800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:03.713 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.714+0000 7fa3ad210800 20 add_watcher() i=0 2024-09-14T11:13:03.713 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.714+0000 7fa3ad210800 20 add_watcher() i=1 2024-09-14T11:13:03.713 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.714+0000 7fa3ad210800 20 add_watcher() i=2 2024-09-14T11:13:03.713 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.714+0000 7fa3ad210800 20 add_watcher() i=3 2024-09-14T11:13:03.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.714+0000 7fa3ad210800 20 add_watcher() i=4 2024-09-14T11:13:03.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.714+0000 7fa3ad210800 20 add_watcher() i=5 2024-09-14T11:13:03.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.714+0000 7fa3ad210800 20 add_watcher() i=6 2024-09-14T11:13:03.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.715+0000 7fa3ad210800 20 add_watcher() i=7 2024-09-14T11:13:03.714 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.715+0000 7fa3ad210800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:03.716 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.717+0000 7fa25efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:03.717 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.717+0000 7fa3ad210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:03.717 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.717+0000 7fa3ad210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:03.717 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.717+0000 7fa3ad210800 5 note: GC not initialized 2024-09-14T11:13:03.717 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.718+0000 7fa25dfe3640 20 reqs_thread_entry: start 2024-09-14T11:13:03.718 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.718+0000 7fa3ad210800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:03.718 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.718+0000 7fa3ad210800 20 Filter name: none 2024-09-14T11:13:03.718 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.718+0000 7fa1cf7fe640 20 reqs_thread_entry: start 2024-09-14T11:13:03.718 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.718+0000 7fa3ad210800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:13:03.718 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.718+0000 7fa3ad210800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.718 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.719+0000 7fa3ad210800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:13:03.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.719+0000 7fa3ad210800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:13:03.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.719+0000 7fa3ad210800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:13:03.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.719+0000 7fa3ad210800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 : miss 2024-09-14T11:13:03.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.719+0000 7fa3ad210800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.719+0000 7fa3ad210800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:13:03.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.719+0000 7fa3ad210800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 info.flags=0x17 2024-09-14T11:13:03.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.719+0000 7fa3ad210800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 to cache LRU end 2024-09-14T11:13:03.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.719+0000 7fa3ad210800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:03.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.719+0000 7fa3ad210800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:03.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.719+0000 7fa3ad210800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 2024-09-14T11:13:03.720 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.721+0000 7fa3ad210800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:13:03.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.728+0000 7fa3ad210800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 info.flags=0x17 2024-09-14T11:13:03.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.728+0000 7fa3ad210800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 to cache LRU end 2024-09-14T11:13:03.727 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.728+0000 7fa3ad210800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:03.728 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.728+0000 7fa3ad210800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35, ofs0, ns] 2024-09-14T11:13:03.728 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.728+0000 7fa27f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496986 cookie 94036290628064 notifier 7178 bl.length()=995 2024-09-14T11:13:03.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.728+0000 7fa27f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 info.flags=0x17 2024-09-14T11:13:03.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.728+0000 7fa27f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 to cache LRU end 2024-09-14T11:13:03.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.728+0000 7fa27f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:03.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.730+0000 7fa3ad210800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35]): orig_sources= new_sources= 2024-09-14T11:13:03.729 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.730+0000 7fa3ad210800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35]): potential sources added=[] removed=[] 2024-09-14T11:13:03.730 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.730+0000 7fa3ad210800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35]): orig_dests= new_dests= 2024-09-14T11:13:03.730 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.730+0000 7fa3ad210800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35]): potential dests added=[] removed=[] 2024-09-14T11:13:03.737 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2.0 2024-09-14T11:13:03.737 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2.0 2024-09-14T11:13:03.737 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2.1 2024-09-14T11:13:03.737 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2.1 2024-09-14T11:13:03.737 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2.2 2024-09-14T11:13:03.737 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2.2 2024-09-14T11:13:03.737 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2.3 2024-09-14T11:13:03.737 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2.3 2024-09-14T11:13:03.737 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2.4 2024-09-14T11:13:03.737 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2.4 2024-09-14T11:13:03.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2.5 2024-09-14T11:13:03.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2.5 2024-09-14T11:13:03.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2.6 2024-09-14T11:13:03.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2.6 2024-09-14T11:13:03.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2.7 2024-09-14T11:13:03.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2.7 2024-09-14T11:13:03.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2.8 2024-09-14T11:13:03.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2.8 2024-09-14T11:13:03.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2.9 2024-09-14T11:13:03.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2.9 2024-09-14T11:13:03.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2.10 2024-09-14T11:13:03.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2.10 2024-09-14T11:13:03.738 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2.11 2024-09-14T11:13:03.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2.11 2024-09-14T11:13:03.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.737+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.0 2024-09-14T11:13:03.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.738+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.1 2024-09-14T11:13:03.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.739+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2 2024-09-14T11:13:03.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.739+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.3 2024-09-14T11:13:03.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.740+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.4 2024-09-14T11:13:03.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.740+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.5 2024-09-14T11:13:03.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.741+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.6 2024-09-14T11:13:03.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.741+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.7 2024-09-14T11:13:03.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.742+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.8 2024-09-14T11:13:03.742 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.743+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.9 2024-09-14T11:13:03.743 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.743+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.10 2024-09-14T11:13:03.746 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.747+0000 7fa3ad210800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:13:03.746 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.747+0000 7fa3ad210800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 2024-09-14T11:13:03.747 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.748+0000 7fa3ad210800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 info.flags=0x17 2024-09-14T11:13:03.747 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.748+0000 7fa3ad210800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 to cache LRU end 2024-09-14T11:13:03.747 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.748+0000 7fa3ad210800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:03.747 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.748+0000 7fa3ad210800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35, ofs0, ns] 2024-09-14T11:13:03.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.748+0000 7fa27f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496987 cookie 94036290628064 notifier 7178 bl.length()=995 2024-09-14T11:13:03.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.748+0000 7fa27f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 info.flags=0x17 2024-09-14T11:13:03.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.748+0000 7fa27f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 to cache LRU end 2024-09-14T11:13:03.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.748+0000 7fa27f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:03.749 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.750+0000 7fa3ad210800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35]): orig_sources= new_sources= 2024-09-14T11:13:03.749 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.750+0000 7fa3ad210800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35]): potential sources added=[] removed=[] 2024-09-14T11:13:03.749 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.750+0000 7fa3ad210800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35]): orig_dests= new_dests= 2024-09-14T11:13:03.749 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.750+0000 7fa3ad210800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35]): potential dests added=[] removed=[] 2024-09-14T11:13:03.752 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.753+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.0 2024-09-14T11:13:03.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.753+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.1 2024-09-14T11:13:03.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.754+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.2 2024-09-14T11:13:03.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.754+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.3 2024-09-14T11:13:03.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.754+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.4 2024-09-14T11:13:03.754 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.755+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.5 2024-09-14T11:13:03.754 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.755+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.6 2024-09-14T11:13:03.754 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.755+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.7 2024-09-14T11:13:03.755 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.756+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.8 2024-09-14T11:13:03.755 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.756+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.9 2024-09-14T11:13:03.755 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.756+0000 7fa3ad210800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35.10 2024-09-14T11:13:03.756 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.757+0000 7fa3ad210800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:13:03.756 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.757+0000 7fa3ad210800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 2024-09-14T11:13:03.757 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.758+0000 7fa3ad210800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 info.flags=0x17 2024-09-14T11:13:03.757 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.758+0000 7fa3ad210800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 to cache LRU end 2024-09-14T11:13:03.757 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.758+0000 7fa3ad210800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:03.757 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.758+0000 7fa3ad210800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35, ofs0, ns] 2024-09-14T11:13:03.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.759+0000 7fa27ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496988 cookie 94036290628064 notifier 7178 bl.length()=963 2024-09-14T11:13:03.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.759+0000 7fa27ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 info.flags=0x17 2024-09-14T11:13:03.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.759+0000 7fa27ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 to cache LRU end 2024-09-14T11:13:03.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.759+0000 7fa27ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:03.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.760+0000 7fa3ad210800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35]): orig_sources= new_sources= 2024-09-14T11:13:03.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.760+0000 7fa3ad210800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35]): potential sources added=[] removed=[] 2024-09-14T11:13:03.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.760+0000 7fa3ad210800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35]): orig_dests= new_dests= 2024-09-14T11:13:03.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.760+0000 7fa3ad210800 20 handle_bi_update(): bucket=:abort-at-do-reshard[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35]): potential dests added=[] removed=[] 2024-09-14T11:13:03.762 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.763+0000 7fa3ad210800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-14T11:13:03.764 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.765+0000 7fa25efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:03.766 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.767+0000 7fa3ad210800 20 remove_watcher() i=0 2024-09-14T11:13:03.766 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.767+0000 7fa3ad210800 2 removed watcher, disabling cache 2024-09-14T11:13:03.767 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.768+0000 7fa3ad210800 20 remove_watcher() i=1 2024-09-14T11:13:03.768 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.769+0000 7fa3ad210800 20 remove_watcher() i=2 2024-09-14T11:13:03.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.770+0000 7fa3ad210800 20 remove_watcher() i=3 2024-09-14T11:13:03.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.771+0000 7fa3ad210800 20 remove_watcher() i=4 2024-09-14T11:13:03.771 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.772+0000 7fa3ad210800 20 remove_watcher() i=5 2024-09-14T11:13:03.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.773+0000 7fa3ad210800 20 remove_watcher() i=6 2024-09-14T11:13:03.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.774+0000 7fa3ad210800 20 remove_watcher() i=7 2024-09-14T11:13:03.787 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:13:03.818 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:03.818 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:03.858 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.858+0000 7fa227f19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.860+0000 7fa227f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.860+0000 7fa227f19800 20 realm 2024-09-14T11:13:03.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.860+0000 7fa227f19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.861+0000 7fa227f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.861+0000 7fa227f19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:03.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.861+0000 7fa227f19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.861+0000 7fa227f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.861+0000 7fa227f19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.861+0000 7fa227f19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:03.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.861+0000 7fa227f19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.862 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.862+0000 7fa227f19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:03.862 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.862+0000 7fa227f19800 20 searching for the correct realm 2024-09-14T11:13:03.864 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:03.865+0000 7fa225209640 0 -- 172.21.15.50:0/1442637228 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fa22009cbd0 msgr2=0x7fa22006f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:04.069 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.070+0000 7fa225209640 0 -- 172.21.15.50:0/1442637228 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55b4c34a90b0 msgr2=0x55b4c34ab4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:04.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.074+0000 7fa227f19800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:04.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.074+0000 7fa227f19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:04.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.074+0000 7fa227f19800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:04.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.074+0000 7fa227f19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:04.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.074+0000 7fa227f19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:04.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.074+0000 7fa227f19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:04.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.074+0000 7fa227f19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.074+0000 7fa227f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.074+0000 7fa227f19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.074+0000 7fa227f19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:04.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.074+0000 7fa227f19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.075+0000 7fa227f19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:04.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.075+0000 7fa227f19800 20 zone default found 2024-09-14T11:13:04.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.075+0000 7fa227f19800 4 Realm: () 2024-09-14T11:13:04.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.075+0000 7fa227f19800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:04.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.075+0000 7fa227f19800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:04.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.075+0000 7fa227f19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:04.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.075+0000 7fa227f19800 20 zonegroup default 2024-09-14T11:13:04.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.075+0000 7fa227f19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.075+0000 7fa227f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.075+0000 7fa227f19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.075+0000 7fa227f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.075+0000 7fa227f19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.076+0000 7fa227f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.076+0000 7fa227f19800 20 started sync module instance, tier type = 2024-09-14T11:13:04.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.076+0000 7fa227f19800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:04.084 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.085+0000 7fa227f19800 20 add_watcher() i=0 2024-09-14T11:13:04.084 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.085+0000 7fa227f19800 20 add_watcher() i=1 2024-09-14T11:13:04.084 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.085+0000 7fa227f19800 20 add_watcher() i=2 2024-09-14T11:13:04.084 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.085+0000 7fa227f19800 20 add_watcher() i=3 2024-09-14T11:13:04.084 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.085+0000 7fa227f19800 20 add_watcher() i=4 2024-09-14T11:13:04.084 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.085+0000 7fa227f19800 20 add_watcher() i=5 2024-09-14T11:13:04.084 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.085+0000 7fa227f19800 20 add_watcher() i=6 2024-09-14T11:13:04.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.086+0000 7fa227f19800 20 add_watcher() i=7 2024-09-14T11:13:04.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.086+0000 7fa227f19800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:04.086 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.087+0000 7fa0d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:04.087 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.088+0000 7fa227f19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:04.087 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.088+0000 7fa227f19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:04.087 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.088+0000 7fa227f19800 5 note: GC not initialized 2024-09-14T11:13:04.087 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.088+0000 7fa0d67fc640 20 reqs_thread_entry: start 2024-09-14T11:13:04.087 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.088+0000 7fa227f19800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:04.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.088+0000 7fa227f19800 20 Filter name: none 2024-09-14T11:13:04.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.088+0000 7fa047fff640 20 reqs_thread_entry: start 2024-09-14T11:13:04.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.088+0000 7fa227f19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.089+0000 7fa227f19800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:13:04.088 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.089+0000 7fa227f19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.089+0000 7fa227f19800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:13:04.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.089+0000 7fa227f19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:04.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.089+0000 7fa227f19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.090+0000 7fa227f19800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:13:04.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.090+0000 7fa227f19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.090+0000 7fa227f19800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:13:04.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.090+0000 7fa227f19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:04.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.092+0000 7fa0d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:04.093 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.094+0000 7fa227f19800 20 remove_watcher() i=0 2024-09-14T11:13:04.093 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.094+0000 7fa227f19800 2 removed watcher, disabling cache 2024-09-14T11:13:04.094 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.095+0000 7fa227f19800 20 remove_watcher() i=1 2024-09-14T11:13:04.095 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.096+0000 7fa227f19800 20 remove_watcher() i=2 2024-09-14T11:13:04.096 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.097+0000 7fa227f19800 20 remove_watcher() i=3 2024-09-14T11:13:04.097 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.098+0000 7fa227f19800 20 remove_watcher() i=4 2024-09-14T11:13:04.098 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.099+0000 7fa227f19800 20 remove_watcher() i=5 2024-09-14T11:13:04.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.100+0000 7fa227f19800 20 remove_watcher() i=6 2024-09-14T11:13:04.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:04.101+0000 7fa227f19800 20 remove_watcher() i=7 2024-09-14T11:13:04.112 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:04.112 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:13:04.112 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: abort-at-do-reshard id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:13:04.112 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:04.114 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:04.114 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:04.136 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:04.136 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:04.362 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:04.363 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:04.500 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-14T11:13:04.500 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:04.501 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:04.501 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:04.550 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:04.550 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:04.607 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:04.607 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:04.644 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:04.644 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:04.679 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:04.680 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:04.717 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:04.717 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:04.755 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:04.755 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:04.792 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:04.792 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:04.828 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:04.829 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:04.867 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:04.867 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:04.903 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:04.903 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:04.941 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:04.941 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:04.978 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:04.979 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:05.015 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:05.015 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:05.052 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:05.052 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:05.089 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:05.090 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:05.126 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:05.127 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:05.163 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:05.164 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:05.202 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:05.203 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:05.240 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:05.240 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:05.277 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:05.277 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:05.315 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:05.315 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:05.357 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:13:05.386 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:05.386 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:05.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.426+0000 7f19bd80d800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.427 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.428+0000 7f19bd80d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:05.428 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.428+0000 7f19bd80d800 20 realm 2024-09-14T11:13:05.428 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.428+0000 7f19bd80d800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.428 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.428+0000 7f19bd80d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:05.428 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.428+0000 7f19bd80d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:05.428 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.428+0000 7f19bd80d800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.428 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.429+0000 7f19bd80d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:05.428 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.429+0000 7f19bd80d800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.428 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.429+0000 7f19bd80d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:05.429 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.429+0000 7f19bd80d800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.429 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.430+0000 7f19bd80d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:05.429 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.430+0000 7f19bd80d800 20 searching for the correct realm 2024-09-14T11:13:05.432 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.433+0000 7f19baaf6640 0 -- 172.21.15.50:0/727804256 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f19b4055410 msgr2=0x7f19b4055890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:05.637 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.638+0000 7f19bb2f7640 0 -- 172.21.15.50:0/727804256 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f19b40703f0 msgr2=0x7f19b4070870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:05.642 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.643+0000 7f19bd80d800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:05.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.643+0000 7f19bd80d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:05.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.643+0000 7f19bd80d800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:05.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.643+0000 7f19bd80d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:05.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.643+0000 7f19bd80d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:05.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.643+0000 7f19bd80d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:05.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.643+0000 7f19bd80d800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.643+0000 7f19bd80d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:05.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.643+0000 7f19bd80d800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.644 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.644+0000 7f19bd80d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:05.644 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.644+0000 7f19bd80d800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.644 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.644+0000 7f19bd80d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:05.644 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.644+0000 7f19bd80d800 20 zone default found 2024-09-14T11:13:05.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.644+0000 7f19bd80d800 4 Realm: () 2024-09-14T11:13:05.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.644+0000 7f19bd80d800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:05.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.644+0000 7f19bd80d800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:05.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.644+0000 7f19bd80d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:05.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.644+0000 7f19bd80d800 20 zonegroup default 2024-09-14T11:13:05.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.644+0000 7f19bd80d800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.644+0000 7f19bd80d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:05.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.644+0000 7f19bd80d800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.645+0000 7f19bd80d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:05.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.645+0000 7f19bd80d800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.645+0000 7f19bd80d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:05.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.645+0000 7f19bd80d800 20 started sync module instance, tier type = 2024-09-14T11:13:05.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.645+0000 7f19bd80d800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:05.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.654+0000 7f19bd80d800 20 add_watcher() i=0 2024-09-14T11:13:05.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.654+0000 7f19bd80d800 20 add_watcher() i=1 2024-09-14T11:13:05.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.654+0000 7f19bd80d800 20 add_watcher() i=2 2024-09-14T11:13:05.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.654+0000 7f19bd80d800 20 add_watcher() i=3 2024-09-14T11:13:05.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.654+0000 7f19bd80d800 20 add_watcher() i=4 2024-09-14T11:13:05.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.654+0000 7f19bd80d800 20 add_watcher() i=5 2024-09-14T11:13:05.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.654+0000 7f19bd80d800 20 add_watcher() i=6 2024-09-14T11:13:05.654 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.655+0000 7f19bd80d800 20 add_watcher() i=7 2024-09-14T11:13:05.654 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.655+0000 7f19bd80d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:05.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.656+0000 7f1871fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:05.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.657+0000 7f19bd80d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:05.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.657+0000 7f19bd80d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:05.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.657+0000 7f19bd80d800 5 note: GC not initialized 2024-09-14T11:13:05.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.657+0000 7f1870fe1640 20 reqs_thread_entry: start 2024-09-14T11:13:05.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.657+0000 7f19bd80d800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:05.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.657+0000 7f19bd80d800 20 Filter name: none 2024-09-14T11:13:05.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.657+0000 7f17ea7fc640 20 reqs_thread_entry: start 2024-09-14T11:13:05.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.657+0000 7f19bd80d800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.658+0000 7f19bd80d800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:13:05.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.658+0000 7f19bd80d800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.659+0000 7f19bd80d800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:13:05.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.659+0000 7f19bd80d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:05.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.659+0000 7f19bd80d800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.659+0000 7f19bd80d800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:13:05.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.659+0000 7f19bd80d800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.659 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.659+0000 7f19bd80d800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:13:05.659 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.659+0000 7f19bd80d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:05.660 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.661+0000 7f1871fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:05.662 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.663+0000 7f19bd80d800 20 remove_watcher() i=0 2024-09-14T11:13:05.662 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.663+0000 7f19bd80d800 2 removed watcher, disabling cache 2024-09-14T11:13:05.663 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.664+0000 7f19bd80d800 20 remove_watcher() i=1 2024-09-14T11:13:05.664 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.665+0000 7f19bd80d800 20 remove_watcher() i=2 2024-09-14T11:13:05.665 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.666+0000 7f19bd80d800 20 remove_watcher() i=3 2024-09-14T11:13:05.666 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.667+0000 7f19bd80d800 20 remove_watcher() i=4 2024-09-14T11:13:05.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.668+0000 7f19bd80d800 20 remove_watcher() i=5 2024-09-14T11:13:05.668 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.669+0000 7f19bd80d800 20 remove_watcher() i=6 2024-09-14T11:13:05.669 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.670+0000 7f19bd80d800 20 remove_watcher() i=7 2024-09-14T11:13:05.680 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:05.680 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:13:05.680 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-logrecord-writes id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:13:05.681 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:05.682 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-14T11:13:05.717 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:05.717 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:05.757 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.758+0000 7f1806324800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.759+0000 7f1806324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:05.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.759+0000 7f1806324800 20 realm 2024-09-14T11:13:05.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.759+0000 7f1806324800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.759+0000 7f1806324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:05.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.759+0000 7f1806324800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:05.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.759+0000 7f1806324800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.760+0000 7f1806324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:05.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.760+0000 7f1806324800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.760+0000 7f1806324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:05.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.760+0000 7f1806324800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.761+0000 7f1806324800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:05.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.761+0000 7f1806324800 20 searching for the correct realm 2024-09-14T11:13:05.763 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.764+0000 7f1801867640 0 -- 172.21.15.50:0/4089754198 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f17fc069910 msgr2=0x7f17fc0763f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:05.968 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.968+0000 7f1802869640 0 -- 172.21.15.50:0/4089754198 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55ee4646ca60 msgr2=0x55ee4646ef20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:05.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.972+0000 7f1806324800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:05.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.972+0000 7f1806324800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:05.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.972+0000 7f1806324800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:05.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.972+0000 7f1806324800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:05.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.972+0000 7f1806324800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:05.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.972+0000 7f1806324800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:05.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.972+0000 7f1806324800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.973+0000 7f1806324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:05.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.973+0000 7f1806324800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.973+0000 7f1806324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:05.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.973+0000 7f1806324800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.973+0000 7f1806324800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:05.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.973+0000 7f1806324800 20 zone default found 2024-09-14T11:13:05.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.973+0000 7f1806324800 4 Realm: () 2024-09-14T11:13:05.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.973+0000 7f1806324800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:05.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.973+0000 7f1806324800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:05.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.973+0000 7f1806324800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:05.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.973+0000 7f1806324800 20 zonegroup default 2024-09-14T11:13:05.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.973+0000 7f1806324800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.973+0000 7f1806324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:05.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.973+0000 7f1806324800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.974+0000 7f1806324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:05.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.974+0000 7f1806324800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.974+0000 7f1806324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:05.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.974+0000 7f1806324800 20 started sync module instance, tier type = 2024-09-14T11:13:05.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.974+0000 7f1806324800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:05.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.982+0000 7f1806324800 20 add_watcher() i=0 2024-09-14T11:13:05.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.982+0000 7f1806324800 20 add_watcher() i=1 2024-09-14T11:13:05.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.982+0000 7f1806324800 20 add_watcher() i=2 2024-09-14T11:13:05.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.982+0000 7f1806324800 20 add_watcher() i=3 2024-09-14T11:13:05.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.982+0000 7f1806324800 20 add_watcher() i=4 2024-09-14T11:13:05.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.982+0000 7f1806324800 20 add_watcher() i=5 2024-09-14T11:13:05.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.982+0000 7f1806324800 20 add_watcher() i=6 2024-09-14T11:13:05.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.983+0000 7f1806324800 20 add_watcher() i=7 2024-09-14T11:13:05.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.983+0000 7f1806324800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:05.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.985+0000 7f16b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:05.985 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.985+0000 7f1806324800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:05.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.985+0000 7f1806324800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:05.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.986+0000 7f1806324800 5 note: GC not initialized 2024-09-14T11:13:05.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.986+0000 7f16337fe640 20 reqs_thread_entry: start 2024-09-14T11:13:05.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.986+0000 7f1806324800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:05.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.986+0000 7f1806324800 20 Filter name: none 2024-09-14T11:13:05.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.986+0000 7f16317fa640 20 reqs_thread_entry: start 2024-09-14T11:13:05.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.986+0000 7f1806324800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:13:05.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.986+0000 7f1806324800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.986+0000 7f1806324800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:13:05.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.986+0000 7f1806324800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:13:05.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.986+0000 7f1806324800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:13:05.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.986+0000 7f1806324800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 : miss 2024-09-14T11:13:05.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.986+0000 7f1806324800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.987+0000 7f1806324800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:13:05.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.987+0000 7f1806324800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 info.flags=0x17 2024-09-14T11:13:05.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.987+0000 7f1806324800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 to cache LRU end 2024-09-14T11:13:05.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.987+0000 7f1806324800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:05.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.987+0000 7f1806324800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:05.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.987+0000 7f1806324800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 2024-09-14T11:13:05.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.992+0000 7f1806324800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 info.flags=0x17 2024-09-14T11:13:05.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.992+0000 7f1806324800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 to cache LRU end 2024-09-14T11:13:05.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.992+0000 7f1806324800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:05.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.992+0000 7f1806324800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36, ofs0, ns] 2024-09-14T11:13:05.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.992+0000 7f16e57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497108 cookie 94481869690592 notifier 7102 bl.length()=1007 2024-09-14T11:13:05.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.992+0000 7f16e57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 info.flags=0x17 2024-09-14T11:13:05.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.992+0000 7f16e57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 to cache LRU end 2024-09-14T11:13:05.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.992+0000 7f16e57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:05.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.994+0000 7f1806324800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36]): orig_sources= new_sources= 2024-09-14T11:13:05.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.994+0000 7f1806324800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36]): potential sources added=[] removed=[] 2024-09-14T11:13:05.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.994+0000 7f1806324800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36]): orig_dests= new_dests= 2024-09-14T11:13:05.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.994+0000 7f1806324800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36]): potential dests added=[] removed=[] 2024-09-14T11:13:05.996 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.996+0000 7f1806324800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-14T11:13:05.996 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:05.996+0000 7f1806324800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:13:06.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.002+0000 7f1806324800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:13:06.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.002+0000 7f1806324800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 2024-09-14T11:13:06.002 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.003+0000 7f1806324800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 info.flags=0x17 2024-09-14T11:13:06.002 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.003+0000 7f1806324800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 to cache LRU end 2024-09-14T11:13:06.003 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.003+0000 7f1806324800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:06.003 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.003+0000 7f1806324800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36, ofs0, ns] 2024-09-14T11:13:06.003 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.004+0000 7f16e5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497109 cookie 94481869690592 notifier 7102 bl.length()=975 2024-09-14T11:13:06.003 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.004+0000 7f16e5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 info.flags=0x17 2024-09-14T11:13:06.003 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.004+0000 7f16e5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 to cache LRU end 2024-09-14T11:13:06.003 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.004+0000 7f16e5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:06.004 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.005+0000 7f1806324800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36]): orig_sources= new_sources= 2024-09-14T11:13:06.004 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.005+0000 7f1806324800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36]): potential sources added=[] removed=[] 2024-09-14T11:13:06.004 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.005+0000 7f1806324800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36]): orig_dests= new_dests= 2024-09-14T11:13:06.005 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.005+0000 7f1806324800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36]): potential dests added=[] removed=[] 2024-09-14T11:13:06.006 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.007+0000 7f16b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:06.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.010+0000 7f1806324800 20 remove_watcher() i=0 2024-09-14T11:13:06.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.010+0000 7f1806324800 2 removed watcher, disabling cache 2024-09-14T11:13:06.010 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.011+0000 7f1806324800 20 remove_watcher() i=1 2024-09-14T11:13:06.011 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.012+0000 7f1806324800 20 remove_watcher() i=2 2024-09-14T11:13:06.012 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.013+0000 7f1806324800 20 remove_watcher() i=3 2024-09-14T11:13:06.013 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.014+0000 7f1806324800 20 remove_watcher() i=4 2024-09-14T11:13:06.014 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.015+0000 7f1806324800 20 remove_watcher() i=5 2024-09-14T11:13:06.014 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.016+0000 7f1806324800 20 remove_watcher() i=6 2024-09-14T11:13:06.015 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.016+0000 7f1806324800 20 remove_watcher() i=7 2024-09-14T11:13:06.028 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:13:06.057 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:06.057 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:06.096 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.097+0000 7f4d50732800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.098 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.099+0000 7f4d50732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:06.098 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.099+0000 7f4d50732800 20 realm 2024-09-14T11:13:06.098 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.099+0000 7f4d50732800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.098 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.099+0000 7f4d50732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:06.098 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.099+0000 7f4d50732800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:06.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.099+0000 7f4d50732800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.099+0000 7f4d50732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:06.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.099+0000 7f4d50732800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.100+0000 7f4d50732800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:06.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.100+0000 7f4d50732800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.100+0000 7f4d50732800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:06.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.101+0000 7f4d50732800 20 searching for the correct realm 2024-09-14T11:13:06.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.104+0000 7f4d4bcaf640 0 -- 172.21.15.50:0/717479968 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f4d44060ba0 msgr2=0x7f4d44055920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:06.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.108+0000 7f4d4c4b0640 0 -- 172.21.15.50:0/717479968 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f4d44079420 msgr2=0x7f4d44079880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:06.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.112+0000 7f4d50732800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:06.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.112+0000 7f4d50732800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:06.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.112+0000 7f4d50732800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:06.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.112+0000 7f4d50732800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:06.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.112+0000 7f4d50732800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:06.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.112+0000 7f4d50732800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:06.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.112+0000 7f4d50732800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.112+0000 7f4d50732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:06.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.112+0000 7f4d50732800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.113+0000 7f4d50732800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:06.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.113+0000 7f4d50732800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.113+0000 7f4d50732800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:06.113 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.113+0000 7f4d50732800 20 zone default found 2024-09-14T11:13:06.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.113+0000 7f4d50732800 4 Realm: () 2024-09-14T11:13:06.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.113+0000 7f4d50732800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:06.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.113+0000 7f4d50732800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:06.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.113+0000 7f4d50732800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:06.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.113+0000 7f4d50732800 20 zonegroup default 2024-09-14T11:13:06.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.113+0000 7f4d50732800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.113+0000 7f4d50732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:06.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.113+0000 7f4d50732800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.113+0000 7f4d50732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:06.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.113+0000 7f4d50732800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.114+0000 7f4d50732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:06.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.114+0000 7f4d50732800 20 started sync module instance, tier type = 2024-09-14T11:13:06.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.114+0000 7f4d50732800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:06.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.121+0000 7f4d50732800 20 add_watcher() i=0 2024-09-14T11:13:06.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.121+0000 7f4d50732800 20 add_watcher() i=1 2024-09-14T11:13:06.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.121+0000 7f4d50732800 20 add_watcher() i=2 2024-09-14T11:13:06.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.121+0000 7f4d50732800 20 add_watcher() i=3 2024-09-14T11:13:06.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.121+0000 7f4d50732800 20 add_watcher() i=4 2024-09-14T11:13:06.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.121+0000 7f4d50732800 20 add_watcher() i=5 2024-09-14T11:13:06.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.121+0000 7f4d50732800 20 add_watcher() i=6 2024-09-14T11:13:06.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.122+0000 7f4d50732800 20 add_watcher() i=7 2024-09-14T11:13:06.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.122+0000 7f4d50732800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:06.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.124+0000 7f4c02fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:06.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.124+0000 7f4d50732800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:06.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.124+0000 7f4d50732800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:06.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.124+0000 7f4d50732800 5 note: GC not initialized 2024-09-14T11:13:06.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.125+0000 7f4c01fdb640 20 reqs_thread_entry: start 2024-09-14T11:13:06.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.125+0000 7f4d50732800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:06.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.125+0000 7f4d50732800 20 Filter name: none 2024-09-14T11:13:06.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.125+0000 7f4b737fe640 20 reqs_thread_entry: start 2024-09-14T11:13:06.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.125+0000 7f4d50732800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.126+0000 7f4d50732800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:13:06.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.126+0000 7f4d50732800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.126+0000 7f4d50732800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:13:06.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.126+0000 7f4d50732800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:06.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.126+0000 7f4d50732800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.127+0000 7f4d50732800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:13:06.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.127+0000 7f4d50732800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.127+0000 7f4d50732800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:13:06.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.127+0000 7f4d50732800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:06.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.129+0000 7f4c02fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:06.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.131+0000 7f4d50732800 20 remove_watcher() i=0 2024-09-14T11:13:06.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.131+0000 7f4d50732800 2 removed watcher, disabling cache 2024-09-14T11:13:06.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.132+0000 7f4d50732800 20 remove_watcher() i=1 2024-09-14T11:13:06.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.133+0000 7f4d50732800 20 remove_watcher() i=2 2024-09-14T11:13:06.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.134+0000 7f4d50732800 20 remove_watcher() i=3 2024-09-14T11:13:06.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.135+0000 7f4d50732800 20 remove_watcher() i=4 2024-09-14T11:13:06.135 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.136+0000 7f4d50732800 20 remove_watcher() i=5 2024-09-14T11:13:06.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.137+0000 7f4d50732800 20 remove_watcher() i=6 2024-09-14T11:13:06.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.138+0000 7f4d50732800 20 remove_watcher() i=7 2024-09-14T11:13:06.148 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:06.148 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:13:06.148 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-logrecord-writes id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:13:06.148 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:06.150 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:06.150 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:06.184 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:06.184 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:06.242 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:13:06.274 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:06.274 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:06.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.315+0000 7fe570319800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.316+0000 7fe570319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:06.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.316+0000 7fe570319800 20 realm 2024-09-14T11:13:06.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.316+0000 7fe570319800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.317+0000 7fe570319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:06.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.317+0000 7fe570319800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:06.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.317+0000 7fe570319800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.318 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.317+0000 7fe570319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:06.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.317+0000 7fe570319800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.317+0000 7fe570319800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:06.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.317+0000 7fe570319800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.318+0000 7fe570319800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:06.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.318+0000 7fe570319800 20 searching for the correct realm 2024-09-14T11:13:06.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.321+0000 7fe56d609640 0 -- 172.21.15.50:0/180348294 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fe56809abb0 msgr2=0x7fe5680b7690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:06.525 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.526+0000 7fe56e60b640 0 -- 172.21.15.50:0/180348294 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x563066abe940 msgr2=0x563066ac0d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:06.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.530+0000 7fe570319800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:06.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.530+0000 7fe570319800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:06.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.530+0000 7fe570319800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:06.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.530+0000 7fe570319800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:06.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.530+0000 7fe570319800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:06.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.530+0000 7fe570319800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:06.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.530+0000 7fe570319800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.532+0000 7fe570319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:06.530 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.532+0000 7fe570319800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.531 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.532+0000 7fe570319800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:06.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.532+0000 7fe570319800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.532+0000 7fe570319800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:06.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.532+0000 7fe570319800 20 zone default found 2024-09-14T11:13:06.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.532+0000 7fe570319800 4 Realm: () 2024-09-14T11:13:06.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.532+0000 7fe570319800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:06.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.532+0000 7fe570319800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:06.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.532+0000 7fe570319800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:06.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.532+0000 7fe570319800 20 zonegroup default 2024-09-14T11:13:06.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.532+0000 7fe570319800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.532+0000 7fe570319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:06.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.532+0000 7fe570319800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.532+0000 7fe570319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:06.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.532+0000 7fe570319800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.532+0000 7fe570319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:06.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.532+0000 7fe570319800 20 started sync module instance, tier type = 2024-09-14T11:13:06.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.532+0000 7fe570319800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:06.540 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.540+0000 7fe570319800 20 add_watcher() i=0 2024-09-14T11:13:06.540 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.540+0000 7fe570319800 20 add_watcher() i=1 2024-09-14T11:13:06.540 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.540+0000 7fe570319800 20 add_watcher() i=2 2024-09-14T11:13:06.540 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.540+0000 7fe570319800 20 add_watcher() i=3 2024-09-14T11:13:06.540 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.540+0000 7fe570319800 20 add_watcher() i=4 2024-09-14T11:13:06.540 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.540+0000 7fe570319800 20 add_watcher() i=5 2024-09-14T11:13:06.540 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.540+0000 7fe570319800 20 add_watcher() i=6 2024-09-14T11:13:06.541 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.541+0000 7fe570319800 20 add_watcher() i=7 2024-09-14T11:13:06.541 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.541+0000 7fe570319800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:06.542 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.543+0000 7fe41f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:06.543 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.544+0000 7fe570319800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:06.543 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.544+0000 7fe570319800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:06.543 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.544+0000 7fe570319800 5 note: GC not initialized 2024-09-14T11:13:06.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.544+0000 7fe41e7fc640 20 reqs_thread_entry: start 2024-09-14T11:13:06.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.544+0000 7fe570319800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:06.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.544+0000 7fe570319800 20 Filter name: none 2024-09-14T11:13:06.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.544+0000 7fe393fff640 20 reqs_thread_entry: start 2024-09-14T11:13:06.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.544+0000 7fe570319800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:13:06.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.544+0000 7fe570319800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.545+0000 7fe570319800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:13:06.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.545+0000 7fe570319800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:13:06.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.545+0000 7fe570319800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:13:06.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.545+0000 7fe570319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 : miss 2024-09-14T11:13:06.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.545+0000 7fe570319800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.545+0000 7fe570319800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:13:06.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.545+0000 7fe570319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 info.flags=0x17 2024-09-14T11:13:06.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.545+0000 7fe570319800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 to cache LRU end 2024-09-14T11:13:06.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.545+0000 7fe570319800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:06.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.545+0000 7fe570319800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:06.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.545+0000 7fe570319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 2024-09-14T11:13:06.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.550+0000 7fe570319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 info.flags=0x17 2024-09-14T11:13:06.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.550+0000 7fe570319800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 to cache LRU end 2024-09-14T11:13:06.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.550+0000 7fe570319800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:06.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.550+0000 7fe570319800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36, ofs0, ns] 2024-09-14T11:13:06.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.550+0000 7fe4517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497110 cookie 94765881036464 notifier 7256 bl.length()=1007 2024-09-14T11:13:06.550 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.550+0000 7fe4517fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 info.flags=0x17 2024-09-14T11:13:06.550 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.550+0000 7fe4517fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 to cache LRU end 2024-09-14T11:13:06.550 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.550+0000 7fe4517fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:06.551 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.553+0000 7fe570319800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36]): orig_sources= new_sources= 2024-09-14T11:13:06.551 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.553+0000 7fe570319800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36]): potential sources added=[] removed=[] 2024-09-14T11:13:06.551 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.553+0000 7fe570319800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36]): orig_dests= new_dests= 2024-09-14T11:13:06.551 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.553+0000 7fe570319800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36]): potential dests added=[] removed=[] 2024-09-14T11:13:06.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1.0 2024-09-14T11:13:06.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1.0 2024-09-14T11:13:06.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1.1 2024-09-14T11:13:06.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1.1 2024-09-14T11:13:06.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1.2 2024-09-14T11:13:06.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1.2 2024-09-14T11:13:06.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1.3 2024-09-14T11:13:06.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1.3 2024-09-14T11:13:06.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1.4 2024-09-14T11:13:06.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1.4 2024-09-14T11:13:06.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1.5 2024-09-14T11:13:06.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1.5 2024-09-14T11:13:06.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1.6 2024-09-14T11:13:06.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1.6 2024-09-14T11:13:06.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1.7 2024-09-14T11:13:06.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1.7 2024-09-14T11:13:06.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1.8 2024-09-14T11:13:06.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1.8 2024-09-14T11:13:06.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1.9 2024-09-14T11:13:06.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1.9 2024-09-14T11:13:06.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1.10 2024-09-14T11:13:06.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1.10 2024-09-14T11:13:06.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1.11 2024-09-14T11:13:06.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1.11 2024-09-14T11:13:06.557 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.556+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.0 2024-09-14T11:13:06.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.557+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1 2024-09-14T11:13:06.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.557+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.2 2024-09-14T11:13:06.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.558+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.3 2024-09-14T11:13:06.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.558+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.4 2024-09-14T11:13:06.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.560+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.5 2024-09-14T11:13:06.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.560+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.6 2024-09-14T11:13:06.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.560+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.7 2024-09-14T11:13:06.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.561+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.8 2024-09-14T11:13:06.560 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.561+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.9 2024-09-14T11:13:06.561 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.561+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.10 2024-09-14T11:13:06.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.564+0000 7fe570319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:13:06.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.564+0000 7fe570319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 2024-09-14T11:13:06.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.567+0000 7fe570319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 info.flags=0x17 2024-09-14T11:13:06.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.567+0000 7fe570319800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 to cache LRU end 2024-09-14T11:13:06.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.567+0000 7fe570319800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:06.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.567+0000 7fe570319800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36, ofs0, ns] 2024-09-14T11:13:06.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.567+0000 7fe450ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497111 cookie 94765881036464 notifier 7256 bl.length()=1007 2024-09-14T11:13:06.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.567+0000 7fe450ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 info.flags=0x17 2024-09-14T11:13:06.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.567+0000 7fe450ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 to cache LRU end 2024-09-14T11:13:06.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.567+0000 7fe450ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:06.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.568+0000 7fe570319800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36]): orig_sources= new_sources= 2024-09-14T11:13:06.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.568+0000 7fe570319800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36]): potential sources added=[] removed=[] 2024-09-14T11:13:06.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.568+0000 7fe570319800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36]): orig_dests= new_dests= 2024-09-14T11:13:06.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.568+0000 7fe570319800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36]): potential dests added=[] removed=[] 2024-09-14T11:13:06.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.570+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.0 2024-09-14T11:13:06.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.570+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.1 2024-09-14T11:13:06.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.571+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.2 2024-09-14T11:13:06.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.571+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.3 2024-09-14T11:13:06.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.571+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.4 2024-09-14T11:13:06.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.571+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.5 2024-09-14T11:13:06.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.572+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.6 2024-09-14T11:13:06.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.572+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.7 2024-09-14T11:13:06.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.572+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.8 2024-09-14T11:13:06.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.573+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.9 2024-09-14T11:13:06.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.573+0000 7fe570319800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36.10 2024-09-14T11:13:06.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.573+0000 7fe570319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:13:06.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.573+0000 7fe570319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 2024-09-14T11:13:06.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.576+0000 7fe570319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 info.flags=0x17 2024-09-14T11:13:06.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.576+0000 7fe570319800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 to cache LRU end 2024-09-14T11:13:06.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.576+0000 7fe570319800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:06.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.576+0000 7fe570319800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36, ofs0, ns] 2024-09-14T11:13:06.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.576+0000 7fe4517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497112 cookie 94765881036464 notifier 7256 bl.length()=975 2024-09-14T11:13:06.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.576+0000 7fe4517fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 info.flags=0x17 2024-09-14T11:13:06.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.576+0000 7fe4517fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 to cache LRU end 2024-09-14T11:13:06.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.576+0000 7fe4517fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:06.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.577+0000 7fe570319800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36]): orig_sources= new_sources= 2024-09-14T11:13:06.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.577+0000 7fe570319800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36]): potential sources added=[] removed=[] 2024-09-14T11:13:06.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.577+0000 7fe570319800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36]): orig_dests= new_dests= 2024-09-14T11:13:06.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.577+0000 7fe570319800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36]): potential dests added=[] removed=[] 2024-09-14T11:13:06.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.579+0000 7fe570319800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:13:06.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.581+0000 7fe41f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:06.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.583+0000 7fe570319800 20 remove_watcher() i=0 2024-09-14T11:13:06.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.583+0000 7fe570319800 2 removed watcher, disabling cache 2024-09-14T11:13:06.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.584+0000 7fe570319800 20 remove_watcher() i=1 2024-09-14T11:13:06.584 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.585+0000 7fe570319800 20 remove_watcher() i=2 2024-09-14T11:13:06.585 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.586+0000 7fe570319800 20 remove_watcher() i=3 2024-09-14T11:13:06.587 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.589+0000 7fe570319800 20 remove_watcher() i=4 2024-09-14T11:13:06.588 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.589+0000 7fe570319800 20 remove_watcher() i=5 2024-09-14T11:13:06.589 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.590+0000 7fe570319800 20 remove_watcher() i=6 2024-09-14T11:13:06.590 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.591+0000 7fe570319800 20 remove_watcher() i=7 2024-09-14T11:13:06.603 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:13:06.632 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:06.632 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:06.672 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.673+0000 7efc0413e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.674 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.675+0000 7efc0413e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:06.674 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.675+0000 7efc0413e800 20 realm 2024-09-14T11:13:06.674 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.675+0000 7efc0413e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.674 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.675+0000 7efc0413e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:06.675 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.675+0000 7efc0413e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:06.675 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.675+0000 7efc0413e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.675 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.675+0000 7efc0413e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:06.675 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.675+0000 7efc0413e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.675 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.676+0000 7efc0413e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:06.675 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.676+0000 7efc0413e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.676 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.677+0000 7efc0413e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:06.676 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.677+0000 7efc0413e800 20 searching for the correct realm 2024-09-14T11:13:06.678 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.679+0000 7efbff6ec640 0 -- 172.21.15.50:0/3083645959 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7efbf8025920 msgr2=0x7efbf8021440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:06.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.883+0000 7efc006ee640 0 -- 172.21.15.50:0/3083645959 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x558de55e2670 msgr2=0x558de55e4b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:06.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.888+0000 7efc0413e800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:06.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.888+0000 7efc0413e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:06.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.888+0000 7efc0413e800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:06.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.888+0000 7efc0413e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:06.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.888+0000 7efc0413e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:06.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.888+0000 7efc0413e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:06.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.888+0000 7efc0413e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.888+0000 7efc0413e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:06.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.888+0000 7efc0413e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.888+0000 7efc0413e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:06.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.888+0000 7efc0413e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.888+0000 7efc0413e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:06.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.888+0000 7efc0413e800 20 zone default found 2024-09-14T11:13:06.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.888+0000 7efc0413e800 4 Realm: () 2024-09-14T11:13:06.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.888+0000 7efc0413e800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:06.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.888+0000 7efc0413e800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:06.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.888+0000 7efc0413e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:06.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.888+0000 7efc0413e800 20 zonegroup default 2024-09-14T11:13:06.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.888+0000 7efc0413e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.889+0000 7efc0413e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:06.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.889+0000 7efc0413e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.889+0000 7efc0413e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:06.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.889+0000 7efc0413e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.889+0000 7efc0413e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:06.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.889+0000 7efc0413e800 20 started sync module instance, tier type = 2024-09-14T11:13:06.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.889+0000 7efc0413e800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:06.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.898+0000 7efc0413e800 20 add_watcher() i=0 2024-09-14T11:13:06.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.898+0000 7efc0413e800 20 add_watcher() i=1 2024-09-14T11:13:06.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.898+0000 7efc0413e800 20 add_watcher() i=2 2024-09-14T11:13:06.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.898+0000 7efc0413e800 20 add_watcher() i=3 2024-09-14T11:13:06.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.898+0000 7efc0413e800 20 add_watcher() i=4 2024-09-14T11:13:06.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.898+0000 7efc0413e800 20 add_watcher() i=5 2024-09-14T11:13:06.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.898+0000 7efc0413e800 20 add_watcher() i=6 2024-09-14T11:13:06.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.899+0000 7efc0413e800 20 add_watcher() i=7 2024-09-14T11:13:06.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.899+0000 7efc0413e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:06.899 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.900+0000 7efab5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:06.900 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.900+0000 7efc0413e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:06.900 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.900+0000 7efc0413e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:06.900 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.900+0000 7efc0413e800 5 note: GC not initialized 2024-09-14T11:13:06.900 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.901+0000 7efab4fe1640 20 reqs_thread_entry: start 2024-09-14T11:13:06.900 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.901+0000 7efc0413e800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:06.900 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.901+0000 7efc0413e800 20 Filter name: none 2024-09-14T11:13:06.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.901+0000 7efa2e7fc640 20 reqs_thread_entry: start 2024-09-14T11:13:06.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.901+0000 7efc0413e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.901+0000 7efc0413e800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:13:06.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.901+0000 7efc0413e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.902+0000 7efc0413e800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:13:06.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.902+0000 7efc0413e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:06.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.902+0000 7efc0413e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.902+0000 7efc0413e800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:13:06.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.902+0000 7efc0413e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:06.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.903+0000 7efc0413e800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:13:06.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.903+0000 7efc0413e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:06.904 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.905+0000 7efab5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:06.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.907+0000 7efc0413e800 20 remove_watcher() i=0 2024-09-14T11:13:06.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.907+0000 7efc0413e800 2 removed watcher, disabling cache 2024-09-14T11:13:06.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.908+0000 7efc0413e800 20 remove_watcher() i=1 2024-09-14T11:13:06.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.909+0000 7efc0413e800 20 remove_watcher() i=2 2024-09-14T11:13:06.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.910+0000 7efc0413e800 20 remove_watcher() i=3 2024-09-14T11:13:06.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.911+0000 7efc0413e800 20 remove_watcher() i=4 2024-09-14T11:13:06.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.912+0000 7efc0413e800 20 remove_watcher() i=5 2024-09-14T11:13:06.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.913+0000 7efc0413e800 20 remove_watcher() i=6 2024-09-14T11:13:06.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:06.913+0000 7efc0413e800 20 remove_watcher() i=7 2024-09-14T11:13:06.924 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:06.924 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:13:06.924 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-logrecord-writes id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:13:06.924 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:06.926 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:06.926 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:06.948 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:06.948 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:07.170 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:07.170 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:07.306 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-14T11:13:07.307 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:07.308 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:07.308 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:07.357 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:07.357 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:07.414 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:07.414 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:07.452 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:07.453 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:07.490 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:07.490 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:07.528 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:07.528 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:07.570 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:07.570 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:07.607 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:07.607 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:07.644 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:07.644 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:07.681 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:07.681 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:07.718 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:07.718 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:07.755 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:07.755 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:07.792 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:07.792 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:07.829 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:07.829 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:07.866 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:07.866 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:07.903 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:07.903 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:07.940 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:07.940 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:07.977 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:07.977 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:08.014 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:08.014 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:08.051 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:08.052 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:08.089 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:08.090 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:08.126 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:08.126 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:08.164 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:13:08.193 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:08.193 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:08.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.235+0000 7fca23375800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.237+0000 7fca23375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.237+0000 7fca23375800 20 realm 2024-09-14T11:13:08.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.237+0000 7fca23375800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.237+0000 7fca23375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.237+0000 7fca23375800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:08.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.237+0000 7fca23375800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.237+0000 7fca23375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.237+0000 7fca23375800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.238+0000 7fca23375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:08.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.238+0000 7fca23375800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.239+0000 7fca23375800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:08.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.239+0000 7fca23375800 20 searching for the correct realm 2024-09-14T11:13:08.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.242+0000 7fca2065e640 0 -- 172.21.15.50:0/2811574035 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fca1806d900 msgr2=0x7fca18064410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:08.446 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.447+0000 7fca21660640 0 -- 172.21.15.50:0/2811574035 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55c12f9d6e70 msgr2=0x55c12f9d92c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:08.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.451+0000 7fca23375800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:08.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.451+0000 7fca23375800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:08.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.451+0000 7fca23375800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:08.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.451+0000 7fca23375800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:08.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.451+0000 7fca23375800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:08.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.451+0000 7fca23375800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:08.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.451+0000 7fca23375800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.451+0000 7fca23375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.451+0000 7fca23375800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.452+0000 7fca23375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:08.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.452+0000 7fca23375800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.452+0000 7fca23375800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:08.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.452+0000 7fca23375800 20 zone default found 2024-09-14T11:13:08.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.452+0000 7fca23375800 4 Realm: () 2024-09-14T11:13:08.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.452+0000 7fca23375800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:08.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.452+0000 7fca23375800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:08.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.452+0000 7fca23375800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:08.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.452+0000 7fca23375800 20 zonegroup default 2024-09-14T11:13:08.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.452+0000 7fca23375800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.452+0000 7fca23375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.452+0000 7fca23375800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.452+0000 7fca23375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.452+0000 7fca23375800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.453+0000 7fca23375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.453+0000 7fca23375800 20 started sync module instance, tier type = 2024-09-14T11:13:08.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.453+0000 7fca23375800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:08.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.461+0000 7fca23375800 20 add_watcher() i=0 2024-09-14T11:13:08.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.461+0000 7fca23375800 20 add_watcher() i=1 2024-09-14T11:13:08.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.461+0000 7fca23375800 20 add_watcher() i=2 2024-09-14T11:13:08.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.461+0000 7fca23375800 20 add_watcher() i=3 2024-09-14T11:13:08.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.461+0000 7fca23375800 20 add_watcher() i=4 2024-09-14T11:13:08.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.461+0000 7fca23375800 20 add_watcher() i=5 2024-09-14T11:13:08.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.461+0000 7fca23375800 20 add_watcher() i=6 2024-09-14T11:13:08.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.462+0000 7fca23375800 20 add_watcher() i=7 2024-09-14T11:13:08.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.462+0000 7fca23375800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:08.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.464+0000 7fc8d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:08.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.464+0000 7fca23375800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:08.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.464+0000 7fca23375800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:08.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.464+0000 7fca23375800 5 note: GC not initialized 2024-09-14T11:13:08.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.465+0000 7fc8d5fe3640 20 reqs_thread_entry: start 2024-09-14T11:13:08.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.465+0000 7fca23375800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:08.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.465+0000 7fca23375800 20 Filter name: none 2024-09-14T11:13:08.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.465+0000 7fc8477fe640 20 reqs_thread_entry: start 2024-09-14T11:13:08.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.465+0000 7fca23375800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.464 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.465+0000 7fca23375800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:13:08.464 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.465+0000 7fca23375800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.464 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.466+0000 7fca23375800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:13:08.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.466+0000 7fca23375800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:08.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.466+0000 7fca23375800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.466+0000 7fca23375800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:13:08.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.466+0000 7fca23375800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.467+0000 7fca23375800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:13:08.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.467+0000 7fca23375800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:08.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.468+0000 7fc8d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:08.469 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.471+0000 7fca23375800 20 remove_watcher() i=0 2024-09-14T11:13:08.469 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.471+0000 7fca23375800 2 removed watcher, disabling cache 2024-09-14T11:13:08.470 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.472+0000 7fca23375800 20 remove_watcher() i=1 2024-09-14T11:13:08.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.473+0000 7fca23375800 20 remove_watcher() i=2 2024-09-14T11:13:08.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.474+0000 7fca23375800 20 remove_watcher() i=3 2024-09-14T11:13:08.473 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.475+0000 7fca23375800 20 remove_watcher() i=4 2024-09-14T11:13:08.474 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.476+0000 7fca23375800 20 remove_watcher() i=5 2024-09-14T11:13:08.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.477+0000 7fca23375800 20 remove_watcher() i=6 2024-09-14T11:13:08.476 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.478+0000 7fca23375800 20 remove_watcher() i=7 2024-09-14T11:13:08.487 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.487 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:13:08.487 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: abort-at-logrecord-writes id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:13:08.487 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.488 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:13:08.523 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:08.523 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:08.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.564+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.566+0000 7f1c44719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.566+0000 7f1c44719800 20 realm 2024-09-14T11:13:08.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.566+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.566+0000 7f1c44719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.566+0000 7f1c44719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:08.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.566+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.566+0000 7f1c44719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.566+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.567+0000 7f1c44719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:08.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.567+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.568+0000 7f1c44719800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:08.568 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.568+0000 7f1c44719800 20 searching for the correct realm 2024-09-14T11:13:08.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.571+0000 7f1c41a09640 0 -- 172.21.15.50:0/1653362030 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f1c3c060b80 msgr2=0x7f1c3c0767f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:08.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.776+0000 7f1c42a0b640 0 -- 172.21.15.50:0/1653362030 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5605b4023390 msgr2=0x5605b4025820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:08.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.780+0000 7f1c44719800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:08.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.780+0000 7f1c44719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:08.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.780+0000 7f1c44719800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:08.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.780+0000 7f1c44719800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:08.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.780+0000 7f1c44719800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:08.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.780+0000 7f1c44719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:08.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.780+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.780+0000 7f1c44719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.780+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.780+0000 7f1c44719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:08.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.780+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.781+0000 7f1c44719800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:08.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.781+0000 7f1c44719800 20 zone default found 2024-09-14T11:13:08.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.781+0000 7f1c44719800 4 Realm: () 2024-09-14T11:13:08.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.781+0000 7f1c44719800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:08.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.781+0000 7f1c44719800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:08.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.781+0000 7f1c44719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:08.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.781+0000 7f1c44719800 20 zonegroup default 2024-09-14T11:13:08.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.781+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.781+0000 7f1c44719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.781+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.781+0000 7f1c44719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.781+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.781+0000 7f1c44719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.781+0000 7f1c44719800 20 started sync module instance, tier type = 2024-09-14T11:13:08.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.782+0000 7f1c44719800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:08.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.790+0000 7f1c44719800 20 add_watcher() i=0 2024-09-14T11:13:08.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.790+0000 7f1c44719800 20 add_watcher() i=1 2024-09-14T11:13:08.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.790+0000 7f1c44719800 20 add_watcher() i=2 2024-09-14T11:13:08.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.790+0000 7f1c44719800 20 add_watcher() i=3 2024-09-14T11:13:08.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.790+0000 7f1c44719800 20 add_watcher() i=4 2024-09-14T11:13:08.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.790+0000 7f1c44719800 20 add_watcher() i=5 2024-09-14T11:13:08.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.790+0000 7f1c44719800 20 add_watcher() i=6 2024-09-14T11:13:08.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.791+0000 7f1c44719800 20 add_watcher() i=7 2024-09-14T11:13:08.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.791+0000 7f1c44719800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:08.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.793+0000 7f1af8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:08.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.793+0000 7f1c44719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:08.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.793+0000 7f1c44719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:08.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.793+0000 7f1c44719800 5 note: GC not initialized 2024-09-14T11:13:08.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.793+0000 7f1a737fe640 20 reqs_thread_entry: start 2024-09-14T11:13:08.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.794+0000 7f1c44719800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:08.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.794+0000 7f1c44719800 20 Filter name: none 2024-09-14T11:13:08.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.794+0000 7f1a717fa640 20 reqs_thread_entry: start 2024-09-14T11:13:08.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.794+0000 7f1c44719800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:13:08.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.794+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.794+0000 7f1c44719800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:13:08.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.794+0000 7f1c44719800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:13:08.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.794+0000 7f1c44719800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:13:08.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.794+0000 7f1c44719800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 : miss 2024-09-14T11:13:08.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.794+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.795+0000 7f1c44719800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:13:08.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.795+0000 7f1c44719800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 info.flags=0x17 2024-09-14T11:13:08.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.795+0000 7f1c44719800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 to cache LRU end 2024-09-14T11:13:08.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.795+0000 7f1c44719800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:08.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.795+0000 7f1c44719800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:08.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.795+0000 7f1c44719800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 2024-09-14T11:13:08.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.800+0000 7f1c44719800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 info.flags=0x17 2024-09-14T11:13:08.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.800+0000 7f1c44719800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 to cache LRU end 2024-09-14T11:13:08.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.800+0000 7f1c44719800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:08.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.800+0000 7f1c44719800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37, ofs0, ns] 2024-09-14T11:13:08.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.800+0000 7f1b257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496985 cookie 94582494940592 notifier 7806 bl.length()=1007 2024-09-14T11:13:08.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.800+0000 7f1b257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 info.flags=0x17 2024-09-14T11:13:08.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.800+0000 7f1b257fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 to cache LRU end 2024-09-14T11:13:08.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.800+0000 7f1b257fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:08.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.803+0000 7f1c44719800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37]): orig_sources= new_sources= 2024-09-14T11:13:08.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.803+0000 7f1c44719800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37]): potential sources added=[] removed=[] 2024-09-14T11:13:08.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.803+0000 7f1c44719800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37]): orig_dests= new_dests= 2024-09-14T11:13:08.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.803+0000 7f1c44719800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37]): potential dests added=[] removed=[] 2024-09-14T11:13:08.803 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1c44719800 time 2024-09-14T11:13:08.805901+0000 2024-09-14T11:13:08.803 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:13:08.804 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:13:08.804 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1c47b8c76a] 2024-09-14T11:13:08.804 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f1c47b8c928] 2024-09-14T11:13:08.804 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5605b307f0b1] 2024-09-14T11:13:08.804 INFO:tasks.workunit.client.0.smithi050.stderr: 4: radosgw-admin(+0xd8907c) [0x5605b359307c] 2024-09-14T11:13:08.804 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5605b308eefd] 2024-09-14T11:13:08.804 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:13:08.805 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1c46829590] 2024-09-14T11:13:08.805 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:13:08.805 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:13:08.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.806+0000 7f1c44719800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1c44719800 time 2024-09-14T11:13:08.805901+0000 2024-09-14T11:13:08.805 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:13:08.805 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.805 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:13:08.805 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1c47b8c76a] 2024-09-14T11:13:08.805 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f1c47b8c928] 2024-09-14T11:13:08.805 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5605b307f0b1] 2024-09-14T11:13:08.805 INFO:tasks.workunit.client.0.smithi050.stderr: 4: radosgw-admin(+0xd8907c) [0x5605b359307c] 2024-09-14T11:13:08.805 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5605b308eefd] 2024-09-14T11:13:08.805 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:13:08.806 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1c46829590] 2024-09-14T11:13:08.806 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:13:08.806 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:13:08.806 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.806 INFO:tasks.workunit.client.0.smithi050.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:13:08.806 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f1c44719800 thread_name:radosgw-admin 2024-09-14T11:13:08.821 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:13:08.821 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1c4683e6f0] 2024-09-14T11:13:08.821 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1c4688b99c] 2024-09-14T11:13:08.821 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:13:08.821 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:13:08.822 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1c47b8c7c4] 2024-09-14T11:13:08.822 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f1c47b8c928] 2024-09-14T11:13:08.822 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5605b307f0b1] 2024-09-14T11:13:08.822 INFO:tasks.workunit.client.0.smithi050.stderr: 8: radosgw-admin(+0xd8907c) [0x5605b359307c] 2024-09-14T11:13:08.822 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5605b308eefd] 2024-09-14T11:13:08.822 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:13:08.822 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1c46829590] 2024-09-14T11:13:08.822 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:13:08.822 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:13:08.822 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.807+0000 7f1c44719800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:13:08.822 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f1c44719800 thread_name:radosgw-admin 2024-09-14T11:13:08.822 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.823 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:13:08.823 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1c4683e6f0] 2024-09-14T11:13:08.823 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1c4688b99c] 2024-09-14T11:13:08.823 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:13:08.823 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:13:08.823 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1c47b8c7c4] 2024-09-14T11:13:08.823 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f1c47b8c928] 2024-09-14T11:13:08.823 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5605b307f0b1] 2024-09-14T11:13:08.823 INFO:tasks.workunit.client.0.smithi050.stderr: 8: radosgw-admin(+0xd8907c) [0x5605b359307c] 2024-09-14T11:13:08.823 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5605b308eefd] 2024-09-14T11:13:08.823 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:13:08.823 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1c46829590] 2024-09-14T11:13:08.824 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:13:08.824 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:13:08.824 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:13:08.824 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.824 INFO:tasks.workunit.client.0.smithi050.stderr:--- begin dump of recent events --- 2024-09-14T11:13:08.824 INFO:tasks.workunit.client.0.smithi050.stderr: -499> 2024-09-14T11:13:08.546+0000 7f1b30608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:08.824 INFO:tasks.workunit.client.0.smithi050.stderr: -498> 2024-09-14T11:13:08.546+0000 7f1b30608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:13:08.824 INFO:tasks.workunit.client.0.smithi050.stderr: -497> 2024-09-14T11:13:08.546+0000 7f1b30608640 10 monclient: dump: 2024-09-14T11:13:08.824 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:08.824 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:08.824 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.824 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.824 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:08.824 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.825 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:08.825 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:08.825 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:08.825 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.825 INFO:tasks.workunit.client.0.smithi050.stderr: -496> 2024-09-14T11:13:08.546+0000 7f1c44719800 5 monclient: authenticate success, global_id 7295 2024-09-14T11:13:08.825 INFO:tasks.workunit.client.0.smithi050.stderr: -495> 2024-09-14T11:13:08.546+0000 7f1c44719800 10 monclient: get_monmap_and_config success 2024-09-14T11:13:08.825 INFO:tasks.workunit.client.0.smithi050.stderr: -494> 2024-09-14T11:13:08.546+0000 7f1c44719800 4 set_mon_vals no callback set 2024-09-14T11:13:08.825 INFO:tasks.workunit.client.0.smithi050.stderr: -493> 2024-09-14T11:13:08.547+0000 7f1c44719800 10 monclient: shutdown 2024-09-14T11:13:08.825 INFO:tasks.workunit.client.0.smithi050.stderr: -492> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 asok(0x5605b3d18270) unregister_commands rotate-key 2024-09-14T11:13:08.825 INFO:tasks.workunit.client.0.smithi050.stderr: -491> 2024-09-14T11:13:08.547+0000 7f1c44719800 10 monclient: build_initial_monmap 2024-09-14T11:13:08.825 INFO:tasks.workunit.client.0.smithi050.stderr: -490> 2024-09-14T11:13:08.547+0000 7f1c44719800 1 build_initial for_mkfs: 0 2024-09-14T11:13:08.825 INFO:tasks.workunit.client.0.smithi050.stderr: -489> 2024-09-14T11:13:08.547+0000 7f1c44719800 10 monclient: monmap: 2024-09-14T11:13:08.825 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:13:08.826 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:13:08.826 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:13:08.826 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:13:08.826 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:13:08.826 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.826 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:13:08.826 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:13:08.826 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:13:08.826 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.826 INFO:tasks.workunit.client.0.smithi050.stderr: -488> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding auth protocol: cephx 2024-09-14T11:13:08.826 INFO:tasks.workunit.client.0.smithi050.stderr: -487> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding auth protocol: cephx 2024-09-14T11:13:08.826 INFO:tasks.workunit.client.0.smithi050.stderr: -486> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding auth protocol: cephx 2024-09-14T11:13:08.826 INFO:tasks.workunit.client.0.smithi050.stderr: -485> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding con mode: secure 2024-09-14T11:13:08.826 INFO:tasks.workunit.client.0.smithi050.stderr: -484> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding con mode: crc 2024-09-14T11:13:08.827 INFO:tasks.workunit.client.0.smithi050.stderr: -483> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding con mode: secure 2024-09-14T11:13:08.827 INFO:tasks.workunit.client.0.smithi050.stderr: -482> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding con mode: crc 2024-09-14T11:13:08.827 INFO:tasks.workunit.client.0.smithi050.stderr: -481> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding con mode: secure 2024-09-14T11:13:08.827 INFO:tasks.workunit.client.0.smithi050.stderr: -480> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding con mode: crc 2024-09-14T11:13:08.827 INFO:tasks.workunit.client.0.smithi050.stderr: -479> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding con mode: crc 2024-09-14T11:13:08.827 INFO:tasks.workunit.client.0.smithi050.stderr: -478> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding con mode: secure 2024-09-14T11:13:08.827 INFO:tasks.workunit.client.0.smithi050.stderr: -477> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding con mode: crc 2024-09-14T11:13:08.827 INFO:tasks.workunit.client.0.smithi050.stderr: -476> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding con mode: secure 2024-09-14T11:13:08.827 INFO:tasks.workunit.client.0.smithi050.stderr: -475> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding con mode: crc 2024-09-14T11:13:08.827 INFO:tasks.workunit.client.0.smithi050.stderr: -474> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding con mode: secure 2024-09-14T11:13:08.827 INFO:tasks.workunit.client.0.smithi050.stderr: -473> 2024-09-14T11:13:08.547+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.827 INFO:tasks.workunit.client.0.smithi050.stderr: -472> 2024-09-14T11:13:08.547+0000 7f1c44719800 1 librados: starting msgr at 2024-09-14T11:13:08.827 INFO:tasks.workunit.client.0.smithi050.stderr: -471> 2024-09-14T11:13:08.547+0000 7f1c44719800 1 librados: starting objecter 2024-09-14T11:13:08.828 INFO:tasks.workunit.client.0.smithi050.stderr: -470> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command objecter_requests hook 0x5605b3f62330 2024-09-14T11:13:08.828 INFO:tasks.workunit.client.0.smithi050.stderr: -469> 2024-09-14T11:13:08.548+0000 7f1c44719800 1 librados: setting wanted keys 2024-09-14T11:13:08.828 INFO:tasks.workunit.client.0.smithi050.stderr: -468> 2024-09-14T11:13:08.548+0000 7f1c44719800 1 librados: calling monclient init 2024-09-14T11:13:08.828 INFO:tasks.workunit.client.0.smithi050.stderr: -467> 2024-09-14T11:13:08.548+0000 7f1c44719800 10 monclient: init 2024-09-14T11:13:08.828 INFO:tasks.workunit.client.0.smithi050.stderr: -466> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding auth protocol: cephx 2024-09-14T11:13:08.828 INFO:tasks.workunit.client.0.smithi050.stderr: -465> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding auth protocol: cephx 2024-09-14T11:13:08.828 INFO:tasks.workunit.client.0.smithi050.stderr: -464> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding auth protocol: cephx 2024-09-14T11:13:08.828 INFO:tasks.workunit.client.0.smithi050.stderr: -463> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding con mode: secure 2024-09-14T11:13:08.828 INFO:tasks.workunit.client.0.smithi050.stderr: -462> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding con mode: crc 2024-09-14T11:13:08.828 INFO:tasks.workunit.client.0.smithi050.stderr: -461> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding con mode: secure 2024-09-14T11:13:08.828 INFO:tasks.workunit.client.0.smithi050.stderr: -460> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding con mode: crc 2024-09-14T11:13:08.828 INFO:tasks.workunit.client.0.smithi050.stderr: -459> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding con mode: secure 2024-09-14T11:13:08.828 INFO:tasks.workunit.client.0.smithi050.stderr: -458> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding con mode: crc 2024-09-14T11:13:08.829 INFO:tasks.workunit.client.0.smithi050.stderr: -457> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding con mode: crc 2024-09-14T11:13:08.829 INFO:tasks.workunit.client.0.smithi050.stderr: -456> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding con mode: secure 2024-09-14T11:13:08.829 INFO:tasks.workunit.client.0.smithi050.stderr: -455> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding con mode: crc 2024-09-14T11:13:08.829 INFO:tasks.workunit.client.0.smithi050.stderr: -454> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding con mode: secure 2024-09-14T11:13:08.829 INFO:tasks.workunit.client.0.smithi050.stderr: -453> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding con mode: crc 2024-09-14T11:13:08.829 INFO:tasks.workunit.client.0.smithi050.stderr: -452> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding con mode: secure 2024-09-14T11:13:08.829 INFO:tasks.workunit.client.0.smithi050.stderr: -451> 2024-09-14T11:13:08.548+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.829 INFO:tasks.workunit.client.0.smithi050.stderr: -450> 2024-09-14T11:13:08.548+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.829 INFO:tasks.workunit.client.0.smithi050.stderr: -449> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command rotate-key hook 0x5605b3f38ac8 2024-09-14T11:13:08.829 INFO:tasks.workunit.client.0.smithi050.stderr: -448> 2024-09-14T11:13:08.548+0000 7f1c44719800 10 monclient: _reopen_session rank -1 2024-09-14T11:13:08.829 INFO:tasks.workunit.client.0.smithi050.stderr: -447> 2024-09-14T11:13:08.548+0000 7f1c44719800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:13:08.829 INFO:tasks.workunit.client.0.smithi050.stderr: -446> 2024-09-14T11:13:08.548+0000 7f1c44719800 10 monclient(hunting): picked mon.noname-a con 0x5605b3db0bd0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:13:08.829 INFO:tasks.workunit.client.0.smithi050.stderr: -445> 2024-09-14T11:13:08.548+0000 7f1c44719800 10 monclient(hunting): picked mon.noname-b con 0x5605b3de6280 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:13:08.830 INFO:tasks.workunit.client.0.smithi050.stderr: -444> 2024-09-14T11:13:08.548+0000 7f1c44719800 10 monclient(hunting): picked mon.noname-c con 0x5605b3ded250 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:13:08.830 INFO:tasks.workunit.client.0.smithi050.stderr: -443> 2024-09-14T11:13:08.548+0000 7f1c44719800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:08.830 INFO:tasks.workunit.client.0.smithi050.stderr: -442> 2024-09-14T11:13:08.548+0000 7f1c44719800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:08.830 INFO:tasks.workunit.client.0.smithi050.stderr: -441> 2024-09-14T11:13:08.548+0000 7f1c44719800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:08.830 INFO:tasks.workunit.client.0.smithi050.stderr: -440> 2024-09-14T11:13:08.548+0000 7f1c44719800 10 monclient(hunting): _renew_subs 2024-09-14T11:13:08.830 INFO:tasks.workunit.client.0.smithi050.stderr: -439> 2024-09-14T11:13:08.548+0000 7f1c44719800 10 monclient(hunting): authenticate will time out at 2441.185575s 2024-09-14T11:13:08.830 INFO:tasks.workunit.client.0.smithi050.stderr: -438> 2024-09-14T11:13:08.548+0000 7f1c4220a640 10 monclient(hunting): get_auth_request con 0x5605b3db0bd0 auth_method 0 2024-09-14T11:13:08.830 INFO:tasks.workunit.client.0.smithi050.stderr: -437> 2024-09-14T11:13:08.548+0000 7f1c4220a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:08.830 INFO:tasks.workunit.client.0.smithi050.stderr: -436> 2024-09-14T11:13:08.548+0000 7f1c4220a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:08.830 INFO:tasks.workunit.client.0.smithi050.stderr: -435> 2024-09-14T11:13:08.548+0000 7f1c4220a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:08.830 INFO:tasks.workunit.client.0.smithi050.stderr: -434> 2024-09-14T11:13:08.548+0000 7f1c42a0b640 10 monclient(hunting): get_auth_request con 0x5605b3ded250 auth_method 0 2024-09-14T11:13:08.830 INFO:tasks.workunit.client.0.smithi050.stderr: -433> 2024-09-14T11:13:08.548+0000 7f1c42a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:08.830 INFO:tasks.workunit.client.0.smithi050.stderr: -432> 2024-09-14T11:13:08.548+0000 7f1c42a0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:08.831 INFO:tasks.workunit.client.0.smithi050.stderr: -431> 2024-09-14T11:13:08.548+0000 7f1c42a0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:08.831 INFO:tasks.workunit.client.0.smithi050.stderr: -430> 2024-09-14T11:13:08.548+0000 7f1c41a09640 10 monclient(hunting): get_auth_request con 0x5605b3de6280 auth_method 0 2024-09-14T11:13:08.831 INFO:tasks.workunit.client.0.smithi050.stderr: -429> 2024-09-14T11:13:08.548+0000 7f1c41a09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:08.831 INFO:tasks.workunit.client.0.smithi050.stderr: -428> 2024-09-14T11:13:08.548+0000 7f1c41a09640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:08.831 INFO:tasks.workunit.client.0.smithi050.stderr: -427> 2024-09-14T11:13:08.548+0000 7f1c41a09640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:08.831 INFO:tasks.workunit.client.0.smithi050.stderr: -426> 2024-09-14T11:13:08.548+0000 7f1c42a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:08.831 INFO:tasks.workunit.client.0.smithi050.stderr: -425> 2024-09-14T11:13:08.548+0000 7f1c42a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:08.831 INFO:tasks.workunit.client.0.smithi050.stderr: -424> 2024-09-14T11:13:08.548+0000 7f1c42a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:08.831 INFO:tasks.workunit.client.0.smithi050.stderr: -423> 2024-09-14T11:13:08.548+0000 7f1c4220a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:08.831 INFO:tasks.workunit.client.0.smithi050.stderr: -422> 2024-09-14T11:13:08.548+0000 7f1c4220a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:08.831 INFO:tasks.workunit.client.0.smithi050.stderr: -421> 2024-09-14T11:13:08.548+0000 7f1c4220a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:08.831 INFO:tasks.workunit.client.0.smithi050.stderr: -420> 2024-09-14T11:13:08.548+0000 7f1c41a09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:08.831 INFO:tasks.workunit.client.0.smithi050.stderr: -419> 2024-09-14T11:13:08.548+0000 7f1c41a09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:08.831 INFO:tasks.workunit.client.0.smithi050.stderr: -418> 2024-09-14T11:13:08.548+0000 7f1c41a09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:08.832 INFO:tasks.workunit.client.0.smithi050.stderr: -417> 2024-09-14T11:13:08.548+0000 7f1c42a0b640 10 monclient(hunting): handle_auth_done global_id 7298 payload 824 2024-09-14T11:13:08.832 INFO:tasks.workunit.client.0.smithi050.stderr: -416> 2024-09-14T11:13:08.548+0000 7f1c42a0b640 10 monclient: _finish_hunting 0 2024-09-14T11:13:08.832 INFO:tasks.workunit.client.0.smithi050.stderr: -415> 2024-09-14T11:13:08.548+0000 7f1c42a0b640 1 monclient: found mon.noname-c 2024-09-14T11:13:08.832 INFO:tasks.workunit.client.0.smithi050.stderr: -414> 2024-09-14T11:13:08.548+0000 7f1c42a0b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:13:08.832 INFO:tasks.workunit.client.0.smithi050.stderr: -413> 2024-09-14T11:13:08.549+0000 7f1b2ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:08.832 INFO:tasks.workunit.client.0.smithi050.stderr: -412> 2024-09-14T11:13:08.549+0000 7f1b2ee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:13:08.832 INFO:tasks.workunit.client.0.smithi050.stderr: -411> 2024-09-14T11:13:08.549+0000 7f1b2ee05640 10 monclient: dump: 2024-09-14T11:13:08.832 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:08.832 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:08.832 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.832 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.832 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:08.833 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.833 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:08.833 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:08.833 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:08.833 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.833 INFO:tasks.workunit.client.0.smithi050.stderr: -410> 2024-09-14T11:13:08.549+0000 7f1b2ee05640 10 monclient: _finish_auth 0 2024-09-14T11:13:08.833 INFO:tasks.workunit.client.0.smithi050.stderr: -409> 2024-09-14T11:13:08.549+0000 7f1b2ee05640 10 monclient: _check_auth_tickets 2024-09-14T11:13:08.833 INFO:tasks.workunit.client.0.smithi050.stderr: -408> 2024-09-14T11:13:08.549+0000 7f1b2ee05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:08.833 INFO:tasks.workunit.client.0.smithi050.stderr: -407> 2024-09-14T11:13:08.549+0000 7f1b2ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:08.833 INFO:tasks.workunit.client.0.smithi050.stderr: -406> 2024-09-14T11:13:08.549+0000 7f1b2ee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:13:08.833 INFO:tasks.workunit.client.0.smithi050.stderr: -405> 2024-09-14T11:13:08.549+0000 7f1b2ee05640 10 monclient: dump: 2024-09-14T11:13:08.833 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:08.834 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:08.834 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.834 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.834 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:08.834 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.834 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:08.834 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:08.834 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:08.834 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.834 INFO:tasks.workunit.client.0.smithi050.stderr: -404> 2024-09-14T11:13:08.549+0000 7f1c44719800 5 monclient: authenticate success, global_id 7298 2024-09-14T11:13:08.834 INFO:tasks.workunit.client.0.smithi050.stderr: -403> 2024-09-14T11:13:08.549+0000 7f1c44719800 10 monclient: _renew_subs 2024-09-14T11:13:08.834 INFO:tasks.workunit.client.0.smithi050.stderr: -402> 2024-09-14T11:13:08.549+0000 7f1b30608640 4 set_mon_vals no callback set 2024-09-14T11:13:08.834 INFO:tasks.workunit.client.0.smithi050.stderr: -401> 2024-09-14T11:13:08.549+0000 7f1c44719800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:13:08.834 INFO:tasks.workunit.client.0.smithi050.stderr: -400> 2024-09-14T11:13:08.549+0000 7f1c44719800 10 monclient: _renew_subs 2024-09-14T11:13:08.835 INFO:tasks.workunit.client.0.smithi050.stderr: -399> 2024-09-14T11:13:08.549+0000 7f1c44719800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:13:08.835 INFO:tasks.workunit.client.0.smithi050.stderr: -398> 2024-09-14T11:13:08.549+0000 7f1c44719800 1 librados: init done 2024-09-14T11:13:08.835 INFO:tasks.workunit.client.0.smithi050.stderr: -397> 2024-09-14T11:13:08.551+0000 7f1b2ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:13:08.835 INFO:tasks.workunit.client.0.smithi050.stderr: -396> 2024-09-14T11:13:08.551+0000 7f1b2ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:13:08.835 INFO:tasks.workunit.client.0.smithi050.stderr: -395> 2024-09-14T11:13:08.551+0000 7f1b2ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:13:08.835 INFO:tasks.workunit.client.0.smithi050.stderr: -394> 2024-09-14T11:13:08.551+0000 7f1c4220a640 10 monclient: get_auth_request con 0x7f1b28077230 auth_method 0 2024-09-14T11:13:08.835 INFO:tasks.workunit.client.0.smithi050.stderr: -393> 2024-09-14T11:13:08.552+0000 7f1c41a09640 10 monclient: get_auth_request con 0x5605b3f61640 auth_method 0 2024-09-14T11:13:08.835 INFO:tasks.workunit.client.0.smithi050.stderr: -392> 2024-09-14T11:13:08.552+0000 7f1c4220a640 10 monclient: get_auth_request con 0x5605b3f84470 auth_method 0 2024-09-14T11:13:08.835 INFO:tasks.workunit.client.0.smithi050.stderr: -391> 2024-09-14T11:13:08.553+0000 7f1c41a09640 10 monclient: get_auth_request con 0x5605b3f888a0 auth_method 0 2024-09-14T11:13:08.835 INFO:tasks.workunit.client.0.smithi050.stderr: -390> 2024-09-14T11:13:08.554+0000 7f1c44719800 10 monclient: build_initial_monmap 2024-09-14T11:13:08.835 INFO:tasks.workunit.client.0.smithi050.stderr: -389> 2024-09-14T11:13:08.554+0000 7f1c44719800 1 build_initial for_mkfs: 0 2024-09-14T11:13:08.835 INFO:tasks.workunit.client.0.smithi050.stderr: -388> 2024-09-14T11:13:08.554+0000 7f1c44719800 10 monclient: monmap: 2024-09-14T11:13:08.835 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:13:08.835 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:13:08.835 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:13:08.836 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:13:08.836 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:13:08.836 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.836 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:13:08.836 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:13:08.836 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:13:08.836 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.836 INFO:tasks.workunit.client.0.smithi050.stderr: -387> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding auth protocol: cephx 2024-09-14T11:13:08.836 INFO:tasks.workunit.client.0.smithi050.stderr: -386> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding auth protocol: cephx 2024-09-14T11:13:08.836 INFO:tasks.workunit.client.0.smithi050.stderr: -385> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding auth protocol: cephx 2024-09-14T11:13:08.836 INFO:tasks.workunit.client.0.smithi050.stderr: -384> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding con mode: secure 2024-09-14T11:13:08.836 INFO:tasks.workunit.client.0.smithi050.stderr: -383> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding con mode: crc 2024-09-14T11:13:08.837 INFO:tasks.workunit.client.0.smithi050.stderr: -382> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding con mode: secure 2024-09-14T11:13:08.837 INFO:tasks.workunit.client.0.smithi050.stderr: -381> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding con mode: crc 2024-09-14T11:13:08.837 INFO:tasks.workunit.client.0.smithi050.stderr: -380> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding con mode: secure 2024-09-14T11:13:08.837 INFO:tasks.workunit.client.0.smithi050.stderr: -379> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding con mode: crc 2024-09-14T11:13:08.837 INFO:tasks.workunit.client.0.smithi050.stderr: -378> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding con mode: crc 2024-09-14T11:13:08.837 INFO:tasks.workunit.client.0.smithi050.stderr: -377> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding con mode: secure 2024-09-14T11:13:08.837 INFO:tasks.workunit.client.0.smithi050.stderr: -376> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding con mode: crc 2024-09-14T11:13:08.837 INFO:tasks.workunit.client.0.smithi050.stderr: -375> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding con mode: secure 2024-09-14T11:13:08.837 INFO:tasks.workunit.client.0.smithi050.stderr: -374> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding con mode: crc 2024-09-14T11:13:08.837 INFO:tasks.workunit.client.0.smithi050.stderr: -373> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding con mode: secure 2024-09-14T11:13:08.837 INFO:tasks.workunit.client.0.smithi050.stderr: -372> 2024-09-14T11:13:08.554+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.837 INFO:tasks.workunit.client.0.smithi050.stderr: -371> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command objecter_requests cmddesc objecter_requests hook 0x5605b3f91130 EEXIST 2024-09-14T11:13:08.837 INFO:tasks.workunit.client.0.smithi050.stderr: -370> 2024-09-14T11:13:08.555+0000 7f1c44719800 10 monclient: init 2024-09-14T11:13:08.837 INFO:tasks.workunit.client.0.smithi050.stderr: -369> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding auth protocol: cephx 2024-09-14T11:13:08.838 INFO:tasks.workunit.client.0.smithi050.stderr: -368> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding auth protocol: cephx 2024-09-14T11:13:08.838 INFO:tasks.workunit.client.0.smithi050.stderr: -367> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding auth protocol: cephx 2024-09-14T11:13:08.838 INFO:tasks.workunit.client.0.smithi050.stderr: -366> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding con mode: secure 2024-09-14T11:13:08.838 INFO:tasks.workunit.client.0.smithi050.stderr: -365> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding con mode: crc 2024-09-14T11:13:08.838 INFO:tasks.workunit.client.0.smithi050.stderr: -364> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding con mode: secure 2024-09-14T11:13:08.838 INFO:tasks.workunit.client.0.smithi050.stderr: -363> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding con mode: crc 2024-09-14T11:13:08.838 INFO:tasks.workunit.client.0.smithi050.stderr: -362> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding con mode: secure 2024-09-14T11:13:08.838 INFO:tasks.workunit.client.0.smithi050.stderr: -361> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding con mode: crc 2024-09-14T11:13:08.838 INFO:tasks.workunit.client.0.smithi050.stderr: -360> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding con mode: crc 2024-09-14T11:13:08.838 INFO:tasks.workunit.client.0.smithi050.stderr: -359> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding con mode: secure 2024-09-14T11:13:08.838 INFO:tasks.workunit.client.0.smithi050.stderr: -358> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding con mode: crc 2024-09-14T11:13:08.838 INFO:tasks.workunit.client.0.smithi050.stderr: -357> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding con mode: secure 2024-09-14T11:13:08.838 INFO:tasks.workunit.client.0.smithi050.stderr: -356> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding con mode: crc 2024-09-14T11:13:08.839 INFO:tasks.workunit.client.0.smithi050.stderr: -355> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding con mode: secure 2024-09-14T11:13:08.839 INFO:tasks.workunit.client.0.smithi050.stderr: -354> 2024-09-14T11:13:08.555+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.839 INFO:tasks.workunit.client.0.smithi050.stderr: -353> 2024-09-14T11:13:08.555+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.839 INFO:tasks.workunit.client.0.smithi050.stderr: -352> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command rotate-key cmddesc rotate-key hook 0x5605b3f8bf80 EEXIST 2024-09-14T11:13:08.839 INFO:tasks.workunit.client.0.smithi050.stderr: -351> 2024-09-14T11:13:08.555+0000 7f1c44719800 10 monclient: _reopen_session rank -1 2024-09-14T11:13:08.839 INFO:tasks.workunit.client.0.smithi050.stderr: -350> 2024-09-14T11:13:08.555+0000 7f1c44719800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:13:08.839 INFO:tasks.workunit.client.0.smithi050.stderr: -349> 2024-09-14T11:13:08.555+0000 7f1c44719800 10 monclient(hunting): picked mon.noname-c con 0x5605b3fb4e20 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:13:08.839 INFO:tasks.workunit.client.0.smithi050.stderr: -348> 2024-09-14T11:13:08.555+0000 7f1c44719800 10 monclient(hunting): picked mon.noname-a con 0x5605b3fb70f0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:13:08.839 INFO:tasks.workunit.client.0.smithi050.stderr: -347> 2024-09-14T11:13:08.555+0000 7f1c44719800 10 monclient(hunting): picked mon.noname-b con 0x5605b3fb35f0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:13:08.839 INFO:tasks.workunit.client.0.smithi050.stderr: -346> 2024-09-14T11:13:08.555+0000 7f1c44719800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:08.839 INFO:tasks.workunit.client.0.smithi050.stderr: -345> 2024-09-14T11:13:08.555+0000 7f1c44719800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:08.839 INFO:tasks.workunit.client.0.smithi050.stderr: -344> 2024-09-14T11:13:08.555+0000 7f1c44719800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:08.839 INFO:tasks.workunit.client.0.smithi050.stderr: -343> 2024-09-14T11:13:08.555+0000 7f1c44719800 10 monclient(hunting): _renew_subs 2024-09-14T11:13:08.839 INFO:tasks.workunit.client.0.smithi050.stderr: -342> 2024-09-14T11:13:08.555+0000 7f1c44719800 10 monclient(hunting): authenticate will time out at 2441.192803s 2024-09-14T11:13:08.840 INFO:tasks.workunit.client.0.smithi050.stderr: -341> 2024-09-14T11:13:08.555+0000 7f1c4220a640 10 monclient(hunting): get_auth_request con 0x5605b3fb4e20 auth_method 0 2024-09-14T11:13:08.840 INFO:tasks.workunit.client.0.smithi050.stderr: -340> 2024-09-14T11:13:08.555+0000 7f1c4220a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:08.840 INFO:tasks.workunit.client.0.smithi050.stderr: -339> 2024-09-14T11:13:08.555+0000 7f1c4220a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:08.840 INFO:tasks.workunit.client.0.smithi050.stderr: -338> 2024-09-14T11:13:08.555+0000 7f1c4220a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:08.840 INFO:tasks.workunit.client.0.smithi050.stderr: -337> 2024-09-14T11:13:08.555+0000 7f1c41a09640 10 monclient(hunting): get_auth_request con 0x5605b3fb70f0 auth_method 0 2024-09-14T11:13:08.840 INFO:tasks.workunit.client.0.smithi050.stderr: -336> 2024-09-14T11:13:08.555+0000 7f1c41a09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:08.840 INFO:tasks.workunit.client.0.smithi050.stderr: -335> 2024-09-14T11:13:08.555+0000 7f1c41a09640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:08.840 INFO:tasks.workunit.client.0.smithi050.stderr: -334> 2024-09-14T11:13:08.555+0000 7f1c41a09640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:08.840 INFO:tasks.workunit.client.0.smithi050.stderr: -333> 2024-09-14T11:13:08.555+0000 7f1c4220a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:08.840 INFO:tasks.workunit.client.0.smithi050.stderr: -332> 2024-09-14T11:13:08.555+0000 7f1c4220a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:08.840 INFO:tasks.workunit.client.0.smithi050.stderr: -331> 2024-09-14T11:13:08.556+0000 7f1c4220a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:08.840 INFO:tasks.workunit.client.0.smithi050.stderr: -330> 2024-09-14T11:13:08.556+0000 7f1c41a09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:08.840 INFO:tasks.workunit.client.0.smithi050.stderr: -329> 2024-09-14T11:13:08.556+0000 7f1c41a09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:08.841 INFO:tasks.workunit.client.0.smithi050.stderr: -328> 2024-09-14T11:13:08.556+0000 7f1c41a09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:08.841 INFO:tasks.workunit.client.0.smithi050.stderr: -327> 2024-09-14T11:13:08.556+0000 7f1c42a0b640 10 monclient(hunting): get_auth_request con 0x5605b3fb35f0 auth_method 0 2024-09-14T11:13:08.841 INFO:tasks.workunit.client.0.smithi050.stderr: -326> 2024-09-14T11:13:08.556+0000 7f1c42a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:08.841 INFO:tasks.workunit.client.0.smithi050.stderr: -325> 2024-09-14T11:13:08.556+0000 7f1c42a0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:08.841 INFO:tasks.workunit.client.0.smithi050.stderr: -324> 2024-09-14T11:13:08.556+0000 7f1c42a0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:08.841 INFO:tasks.workunit.client.0.smithi050.stderr: -323> 2024-09-14T11:13:08.556+0000 7f1c42a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:08.841 INFO:tasks.workunit.client.0.smithi050.stderr: -322> 2024-09-14T11:13:08.556+0000 7f1c42a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:08.841 INFO:tasks.workunit.client.0.smithi050.stderr: -321> 2024-09-14T11:13:08.556+0000 7f1c42a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:08.841 INFO:tasks.workunit.client.0.smithi050.stderr: -320> 2024-09-14T11:13:08.556+0000 7f1c4220a640 10 monclient(hunting): handle_auth_done global_id 7301 payload 824 2024-09-14T11:13:08.841 INFO:tasks.workunit.client.0.smithi050.stderr: -319> 2024-09-14T11:13:08.556+0000 7f1c4220a640 10 monclient: _finish_hunting 0 2024-09-14T11:13:08.841 INFO:tasks.workunit.client.0.smithi050.stderr: -318> 2024-09-14T11:13:08.556+0000 7f1c4220a640 1 monclient: found mon.noname-c 2024-09-14T11:13:08.842 INFO:tasks.workunit.client.0.smithi050.stderr: -317> 2024-09-14T11:13:08.556+0000 7f1c4220a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:13:08.842 INFO:tasks.workunit.client.0.smithi050.stderr: -316> 2024-09-14T11:13:08.556+0000 7f1b27fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:08.842 INFO:tasks.workunit.client.0.smithi050.stderr: -315> 2024-09-14T11:13:08.556+0000 7f1b27fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:13:08.842 INFO:tasks.workunit.client.0.smithi050.stderr: -314> 2024-09-14T11:13:08.556+0000 7f1b27fff640 10 monclient: dump: 2024-09-14T11:13:08.842 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:08.842 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:08.842 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.842 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.842 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:08.842 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.842 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:08.842 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:08.842 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:08.843 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.843 INFO:tasks.workunit.client.0.smithi050.stderr: -313> 2024-09-14T11:13:08.556+0000 7f1b27fff640 10 monclient: _finish_auth 0 2024-09-14T11:13:08.843 INFO:tasks.workunit.client.0.smithi050.stderr: -312> 2024-09-14T11:13:08.556+0000 7f1b27fff640 10 monclient: _check_auth_tickets 2024-09-14T11:13:08.843 INFO:tasks.workunit.client.0.smithi050.stderr: -311> 2024-09-14T11:13:08.556+0000 7f1b27fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:08.843 INFO:tasks.workunit.client.0.smithi050.stderr: -310> 2024-09-14T11:13:08.556+0000 7f1b27fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:08.843 INFO:tasks.workunit.client.0.smithi050.stderr: -309> 2024-09-14T11:13:08.556+0000 7f1b27fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:13:08.843 INFO:tasks.workunit.client.0.smithi050.stderr: -308> 2024-09-14T11:13:08.556+0000 7f1b27fff640 10 monclient: dump: 2024-09-14T11:13:08.843 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:08.843 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:08.843 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.843 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.843 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:08.843 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.843 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:08.843 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:08.844 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:08.844 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.844 INFO:tasks.workunit.client.0.smithi050.stderr: -307> 2024-09-14T11:13:08.556+0000 7f1c44719800 5 monclient: authenticate success, global_id 7301 2024-09-14T11:13:08.844 INFO:tasks.workunit.client.0.smithi050.stderr: -306> 2024-09-14T11:13:08.556+0000 7f1c44719800 10 monclient: _renew_subs 2024-09-14T11:13:08.844 INFO:tasks.workunit.client.0.smithi050.stderr: -305> 2024-09-14T11:13:08.556+0000 7f1c44719800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:13:08.844 INFO:tasks.workunit.client.0.smithi050.stderr: -304> 2024-09-14T11:13:08.556+0000 7f1c4320c640 4 set_mon_vals no callback set 2024-09-14T11:13:08.844 INFO:tasks.workunit.client.0.smithi050.stderr: -303> 2024-09-14T11:13:08.556+0000 7f1c44719800 10 monclient: _renew_subs 2024-09-14T11:13:08.844 INFO:tasks.workunit.client.0.smithi050.stderr: -302> 2024-09-14T11:13:08.556+0000 7f1c44719800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:13:08.844 INFO:tasks.workunit.client.0.smithi050.stderr: -301> 2024-09-14T11:13:08.558+0000 7f1b27fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:13:08.844 INFO:tasks.workunit.client.0.smithi050.stderr: -300> 2024-09-14T11:13:08.558+0000 7f1b27fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:13:08.844 INFO:tasks.workunit.client.0.smithi050.stderr: -299> 2024-09-14T11:13:08.558+0000 7f1b27fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:13:08.844 INFO:tasks.workunit.client.0.smithi050.stderr: -298> 2024-09-14T11:13:08.558+0000 7f1c41a09640 10 monclient: get_auth_request con 0x7f1b1c077140 auth_method 0 2024-09-14T11:13:08.844 INFO:tasks.workunit.client.0.smithi050.stderr: -297> 2024-09-14T11:13:08.558+0000 7f1c44719800 10 monclient: get_monmap_and_config 2024-09-14T11:13:08.845 INFO:tasks.workunit.client.0.smithi050.stderr: -296> 2024-09-14T11:13:08.558+0000 7f1c44719800 10 monclient: build_initial_monmap 2024-09-14T11:13:08.845 INFO:tasks.workunit.client.0.smithi050.stderr: -295> 2024-09-14T11:13:08.558+0000 7f1c44719800 1 build_initial for_mkfs: 0 2024-09-14T11:13:08.845 INFO:tasks.workunit.client.0.smithi050.stderr: -294> 2024-09-14T11:13:08.558+0000 7f1c44719800 10 monclient: monmap: 2024-09-14T11:13:08.845 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:13:08.845 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:13:08.845 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:13:08.845 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:13:08.845 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:13:08.845 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.845 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:13:08.845 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:13:08.845 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:13:08.845 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.846 INFO:tasks.workunit.client.0.smithi050.stderr: -293> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding auth protocol: cephx 2024-09-14T11:13:08.846 INFO:tasks.workunit.client.0.smithi050.stderr: -292> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding auth protocol: cephx 2024-09-14T11:13:08.846 INFO:tasks.workunit.client.0.smithi050.stderr: -291> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding auth protocol: cephx 2024-09-14T11:13:08.846 INFO:tasks.workunit.client.0.smithi050.stderr: -290> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding con mode: secure 2024-09-14T11:13:08.846 INFO:tasks.workunit.client.0.smithi050.stderr: -289> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding con mode: crc 2024-09-14T11:13:08.846 INFO:tasks.workunit.client.0.smithi050.stderr: -288> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding con mode: secure 2024-09-14T11:13:08.846 INFO:tasks.workunit.client.0.smithi050.stderr: -287> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding con mode: crc 2024-09-14T11:13:08.846 INFO:tasks.workunit.client.0.smithi050.stderr: -286> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding con mode: secure 2024-09-14T11:13:08.846 INFO:tasks.workunit.client.0.smithi050.stderr: -285> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding con mode: crc 2024-09-14T11:13:08.846 INFO:tasks.workunit.client.0.smithi050.stderr: -284> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding con mode: crc 2024-09-14T11:13:08.846 INFO:tasks.workunit.client.0.smithi050.stderr: -283> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding con mode: secure 2024-09-14T11:13:08.846 INFO:tasks.workunit.client.0.smithi050.stderr: -282> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding con mode: crc 2024-09-14T11:13:08.846 INFO:tasks.workunit.client.0.smithi050.stderr: -281> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding con mode: secure 2024-09-14T11:13:08.846 INFO:tasks.workunit.client.0.smithi050.stderr: -280> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding con mode: crc 2024-09-14T11:13:08.847 INFO:tasks.workunit.client.0.smithi050.stderr: -279> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding con mode: secure 2024-09-14T11:13:08.847 INFO:tasks.workunit.client.0.smithi050.stderr: -278> 2024-09-14T11:13:08.559+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.847 INFO:tasks.workunit.client.0.smithi050.stderr: -277> 2024-09-14T11:13:08.559+0000 7f1c44719800 10 monclient: init 2024-09-14T11:13:08.847 INFO:tasks.workunit.client.0.smithi050.stderr: -276> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding auth protocol: cephx 2024-09-14T11:13:08.847 INFO:tasks.workunit.client.0.smithi050.stderr: -275> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding auth protocol: cephx 2024-09-14T11:13:08.847 INFO:tasks.workunit.client.0.smithi050.stderr: -274> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding auth protocol: cephx 2024-09-14T11:13:08.847 INFO:tasks.workunit.client.0.smithi050.stderr: -273> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding con mode: secure 2024-09-14T11:13:08.847 INFO:tasks.workunit.client.0.smithi050.stderr: -272> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding con mode: crc 2024-09-14T11:13:08.847 INFO:tasks.workunit.client.0.smithi050.stderr: -271> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding con mode: secure 2024-09-14T11:13:08.847 INFO:tasks.workunit.client.0.smithi050.stderr: -270> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding con mode: crc 2024-09-14T11:13:08.847 INFO:tasks.workunit.client.0.smithi050.stderr: -269> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding con mode: secure 2024-09-14T11:13:08.847 INFO:tasks.workunit.client.0.smithi050.stderr: -268> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding con mode: crc 2024-09-14T11:13:08.847 INFO:tasks.workunit.client.0.smithi050.stderr: -267> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding con mode: crc 2024-09-14T11:13:08.847 INFO:tasks.workunit.client.0.smithi050.stderr: -266> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding con mode: secure 2024-09-14T11:13:08.848 INFO:tasks.workunit.client.0.smithi050.stderr: -265> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding con mode: crc 2024-09-14T11:13:08.848 INFO:tasks.workunit.client.0.smithi050.stderr: -264> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding con mode: secure 2024-09-14T11:13:08.848 INFO:tasks.workunit.client.0.smithi050.stderr: -263> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding con mode: crc 2024-09-14T11:13:08.848 INFO:tasks.workunit.client.0.smithi050.stderr: -262> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding con mode: secure 2024-09-14T11:13:08.848 INFO:tasks.workunit.client.0.smithi050.stderr: -261> 2024-09-14T11:13:08.559+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.848 INFO:tasks.workunit.client.0.smithi050.stderr: -260> 2024-09-14T11:13:08.559+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.848 INFO:tasks.workunit.client.0.smithi050.stderr: -259> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command rotate-key cmddesc rotate-key hook 0x7ffe4e64cc88 EEXIST 2024-09-14T11:13:08.848 INFO:tasks.workunit.client.0.smithi050.stderr: -258> 2024-09-14T11:13:08.559+0000 7f1c44719800 10 monclient: _reopen_session rank -1 2024-09-14T11:13:08.848 INFO:tasks.workunit.client.0.smithi050.stderr: -257> 2024-09-14T11:13:08.559+0000 7f1c44719800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:13:08.848 INFO:tasks.workunit.client.0.smithi050.stderr: -256> 2024-09-14T11:13:08.559+0000 7f1c44719800 10 monclient(hunting): picked mon.noname-b con 0x5605b4009000 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:13:08.848 INFO:tasks.workunit.client.0.smithi050.stderr: -255> 2024-09-14T11:13:08.559+0000 7f1c44719800 10 monclient(hunting): picked mon.noname-c con 0x5605b3fd9f50 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:13:08.848 INFO:tasks.workunit.client.0.smithi050.stderr: -254> 2024-09-14T11:13:08.559+0000 7f1c44719800 10 monclient(hunting): picked mon.noname-a con 0x5605b40048a0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:13:08.848 INFO:tasks.workunit.client.0.smithi050.stderr: -253> 2024-09-14T11:13:08.559+0000 7f1c44719800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:08.849 INFO:tasks.workunit.client.0.smithi050.stderr: -252> 2024-09-14T11:13:08.559+0000 7f1c44719800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:08.849 INFO:tasks.workunit.client.0.smithi050.stderr: -251> 2024-09-14T11:13:08.559+0000 7f1c44719800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:08.849 INFO:tasks.workunit.client.0.smithi050.stderr: -250> 2024-09-14T11:13:08.559+0000 7f1c44719800 10 monclient(hunting): _renew_subs 2024-09-14T11:13:08.849 INFO:tasks.workunit.client.0.smithi050.stderr: -249> 2024-09-14T11:13:08.559+0000 7f1c44719800 10 monclient(hunting): authenticate will time out at 2441.196866s 2024-09-14T11:13:08.849 INFO:tasks.workunit.client.0.smithi050.stderr: -248> 2024-09-14T11:13:08.559+0000 7f1c41a09640 10 monclient(hunting): get_auth_request con 0x5605b3fd9f50 auth_method 0 2024-09-14T11:13:08.849 INFO:tasks.workunit.client.0.smithi050.stderr: -247> 2024-09-14T11:13:08.559+0000 7f1c41a09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:08.849 INFO:tasks.workunit.client.0.smithi050.stderr: -246> 2024-09-14T11:13:08.559+0000 7f1c41a09640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:08.849 INFO:tasks.workunit.client.0.smithi050.stderr: -245> 2024-09-14T11:13:08.559+0000 7f1c41a09640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:08.849 INFO:tasks.workunit.client.0.smithi050.stderr: -244> 2024-09-14T11:13:08.560+0000 7f1c42a0b640 10 monclient(hunting): get_auth_request con 0x5605b40048a0 auth_method 0 2024-09-14T11:13:08.849 INFO:tasks.workunit.client.0.smithi050.stderr: -243> 2024-09-14T11:13:08.560+0000 7f1c42a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:08.849 INFO:tasks.workunit.client.0.smithi050.stderr: -242> 2024-09-14T11:13:08.560+0000 7f1c42a0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:08.849 INFO:tasks.workunit.client.0.smithi050.stderr: -241> 2024-09-14T11:13:08.560+0000 7f1c42a0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:08.849 INFO:tasks.workunit.client.0.smithi050.stderr: -240> 2024-09-14T11:13:08.560+0000 7f1c4220a640 10 monclient(hunting): get_auth_request con 0x5605b4009000 auth_method 0 2024-09-14T11:13:08.850 INFO:tasks.workunit.client.0.smithi050.stderr: -239> 2024-09-14T11:13:08.560+0000 7f1c4220a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:08.850 INFO:tasks.workunit.client.0.smithi050.stderr: -238> 2024-09-14T11:13:08.560+0000 7f1c4220a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:08.850 INFO:tasks.workunit.client.0.smithi050.stderr: -237> 2024-09-14T11:13:08.560+0000 7f1c4220a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:08.850 INFO:tasks.workunit.client.0.smithi050.stderr: -236> 2024-09-14T11:13:08.560+0000 7f1c41a09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:08.850 INFO:tasks.workunit.client.0.smithi050.stderr: -235> 2024-09-14T11:13:08.560+0000 7f1c41a09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:08.850 INFO:tasks.workunit.client.0.smithi050.stderr: -234> 2024-09-14T11:13:08.560+0000 7f1c41a09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:08.850 INFO:tasks.workunit.client.0.smithi050.stderr: -233> 2024-09-14T11:13:08.560+0000 7f1c42a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:08.850 INFO:tasks.workunit.client.0.smithi050.stderr: -232> 2024-09-14T11:13:08.560+0000 7f1c42a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:08.850 INFO:tasks.workunit.client.0.smithi050.stderr: -231> 2024-09-14T11:13:08.560+0000 7f1c42a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:08.850 INFO:tasks.workunit.client.0.smithi050.stderr: -230> 2024-09-14T11:13:08.560+0000 7f1c4220a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:08.850 INFO:tasks.workunit.client.0.smithi050.stderr: -229> 2024-09-14T11:13:08.560+0000 7f1c4220a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:08.850 INFO:tasks.workunit.client.0.smithi050.stderr: -228> 2024-09-14T11:13:08.560+0000 7f1c4220a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:08.850 INFO:tasks.workunit.client.0.smithi050.stderr: -227> 2024-09-14T11:13:08.560+0000 7f1c41a09640 10 monclient(hunting): handle_auth_done global_id 7304 payload 274 2024-09-14T11:13:08.850 INFO:tasks.workunit.client.0.smithi050.stderr: -226> 2024-09-14T11:13:08.560+0000 7f1c41a09640 10 monclient: _finish_hunting 0 2024-09-14T11:13:08.851 INFO:tasks.workunit.client.0.smithi050.stderr: -225> 2024-09-14T11:13:08.560+0000 7f1c41a09640 1 monclient: found mon.noname-c 2024-09-14T11:13:08.851 INFO:tasks.workunit.client.0.smithi050.stderr: -224> 2024-09-14T11:13:08.560+0000 7f1c41a09640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:13:08.851 INFO:tasks.workunit.client.0.smithi050.stderr: -223> 2024-09-14T11:13:08.560+0000 7f1b25ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:08.851 INFO:tasks.workunit.client.0.smithi050.stderr: -222> 2024-09-14T11:13:08.560+0000 7f1b25ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:13:08.851 INFO:tasks.workunit.client.0.smithi050.stderr: -221> 2024-09-14T11:13:08.560+0000 7f1b25ffb640 10 monclient: dump: 2024-09-14T11:13:08.851 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:08.851 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:08.851 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.851 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.851 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:08.851 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.851 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:08.851 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:08.852 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:08.852 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.852 INFO:tasks.workunit.client.0.smithi050.stderr: -220> 2024-09-14T11:13:08.560+0000 7f1b25ffb640 10 monclient: _finish_auth 0 2024-09-14T11:13:08.852 INFO:tasks.workunit.client.0.smithi050.stderr: -219> 2024-09-14T11:13:08.560+0000 7f1b25ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:13:08.852 INFO:tasks.workunit.client.0.smithi050.stderr: -218> 2024-09-14T11:13:08.560+0000 7f1b25ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:08.852 INFO:tasks.workunit.client.0.smithi050.stderr: -217> 2024-09-14T11:13:08.560+0000 7f1b25ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:08.852 INFO:tasks.workunit.client.0.smithi050.stderr: -216> 2024-09-14T11:13:08.560+0000 7f1b25ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:13:08.852 INFO:tasks.workunit.client.0.smithi050.stderr: -215> 2024-09-14T11:13:08.560+0000 7f1b25ffb640 10 monclient: dump: 2024-09-14T11:13:08.852 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:08.852 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:08.852 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.852 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.852 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:08.853 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.853 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:08.853 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:08.853 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:08.853 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.853 INFO:tasks.workunit.client.0.smithi050.stderr: -214> 2024-09-14T11:13:08.560+0000 7f1c44719800 5 monclient: authenticate success, global_id 7304 2024-09-14T11:13:08.853 INFO:tasks.workunit.client.0.smithi050.stderr: -213> 2024-09-14T11:13:08.560+0000 7f1c44719800 10 monclient: get_monmap_and_config success 2024-09-14T11:13:08.853 INFO:tasks.workunit.client.0.smithi050.stderr: -212> 2024-09-14T11:13:08.560+0000 7f1c44719800 4 set_mon_vals no callback set 2024-09-14T11:13:08.853 INFO:tasks.workunit.client.0.smithi050.stderr: -211> 2024-09-14T11:13:08.561+0000 7f1c44719800 10 monclient: shutdown 2024-09-14T11:13:08.853 INFO:tasks.workunit.client.0.smithi050.stderr: -210> 2024-09-14T11:13:08.561+0000 7f1c44719800 10 monclient: build_initial_monmap 2024-09-14T11:13:08.853 INFO:tasks.workunit.client.0.smithi050.stderr: -209> 2024-09-14T11:13:08.561+0000 7f1c44719800 1 build_initial for_mkfs: 0 2024-09-14T11:13:08.853 INFO:tasks.workunit.client.0.smithi050.stderr: -208> 2024-09-14T11:13:08.561+0000 7f1c44719800 10 monclient: monmap: 2024-09-14T11:13:08.853 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:13:08.854 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:13:08.854 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:13:08.854 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:13:08.854 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:13:08.854 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.854 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:13:08.854 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:13:08.854 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:13:08.854 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.854 INFO:tasks.workunit.client.0.smithi050.stderr: -207> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding auth protocol: cephx 2024-09-14T11:13:08.854 INFO:tasks.workunit.client.0.smithi050.stderr: -206> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding auth protocol: cephx 2024-09-14T11:13:08.854 INFO:tasks.workunit.client.0.smithi050.stderr: -205> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding auth protocol: cephx 2024-09-14T11:13:08.854 INFO:tasks.workunit.client.0.smithi050.stderr: -204> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding con mode: secure 2024-09-14T11:13:08.854 INFO:tasks.workunit.client.0.smithi050.stderr: -203> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding con mode: crc 2024-09-14T11:13:08.855 INFO:tasks.workunit.client.0.smithi050.stderr: -202> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding con mode: secure 2024-09-14T11:13:08.855 INFO:tasks.workunit.client.0.smithi050.stderr: -201> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding con mode: crc 2024-09-14T11:13:08.855 INFO:tasks.workunit.client.0.smithi050.stderr: -200> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding con mode: secure 2024-09-14T11:13:08.855 INFO:tasks.workunit.client.0.smithi050.stderr: -199> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding con mode: crc 2024-09-14T11:13:08.855 INFO:tasks.workunit.client.0.smithi050.stderr: -198> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding con mode: crc 2024-09-14T11:13:08.855 INFO:tasks.workunit.client.0.smithi050.stderr: -197> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding con mode: secure 2024-09-14T11:13:08.855 INFO:tasks.workunit.client.0.smithi050.stderr: -196> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding con mode: crc 2024-09-14T11:13:08.855 INFO:tasks.workunit.client.0.smithi050.stderr: -195> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding con mode: secure 2024-09-14T11:13:08.855 INFO:tasks.workunit.client.0.smithi050.stderr: -194> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding con mode: crc 2024-09-14T11:13:08.855 INFO:tasks.workunit.client.0.smithi050.stderr: -193> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding con mode: secure 2024-09-14T11:13:08.855 INFO:tasks.workunit.client.0.smithi050.stderr: -192> 2024-09-14T11:13:08.561+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.855 INFO:tasks.workunit.client.0.smithi050.stderr: -191> 2024-09-14T11:13:08.561+0000 7f1c44719800 1 librados: starting msgr at 2024-09-14T11:13:08.855 INFO:tasks.workunit.client.0.smithi050.stderr: -190> 2024-09-14T11:13:08.561+0000 7f1c44719800 1 librados: starting objecter 2024-09-14T11:13:08.855 INFO:tasks.workunit.client.0.smithi050.stderr: -189> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command objecter_requests cmddesc objecter_requests hook 0x5605b3fd7f10 EEXIST 2024-09-14T11:13:08.855 INFO:tasks.workunit.client.0.smithi050.stderr: -188> 2024-09-14T11:13:08.561+0000 7f1c44719800 1 librados: setting wanted keys 2024-09-14T11:13:08.856 INFO:tasks.workunit.client.0.smithi050.stderr: -187> 2024-09-14T11:13:08.561+0000 7f1c44719800 1 librados: calling monclient init 2024-09-14T11:13:08.856 INFO:tasks.workunit.client.0.smithi050.stderr: -186> 2024-09-14T11:13:08.561+0000 7f1c44719800 10 monclient: init 2024-09-14T11:13:08.856 INFO:tasks.workunit.client.0.smithi050.stderr: -185> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding auth protocol: cephx 2024-09-14T11:13:08.856 INFO:tasks.workunit.client.0.smithi050.stderr: -184> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding auth protocol: cephx 2024-09-14T11:13:08.856 INFO:tasks.workunit.client.0.smithi050.stderr: -183> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding auth protocol: cephx 2024-09-14T11:13:08.856 INFO:tasks.workunit.client.0.smithi050.stderr: -182> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding con mode: secure 2024-09-14T11:13:08.856 INFO:tasks.workunit.client.0.smithi050.stderr: -181> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding con mode: crc 2024-09-14T11:13:08.856 INFO:tasks.workunit.client.0.smithi050.stderr: -180> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding con mode: secure 2024-09-14T11:13:08.856 INFO:tasks.workunit.client.0.smithi050.stderr: -179> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding con mode: crc 2024-09-14T11:13:08.856 INFO:tasks.workunit.client.0.smithi050.stderr: -178> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding con mode: secure 2024-09-14T11:13:08.856 INFO:tasks.workunit.client.0.smithi050.stderr: -177> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding con mode: crc 2024-09-14T11:13:08.856 INFO:tasks.workunit.client.0.smithi050.stderr: -176> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding con mode: crc 2024-09-14T11:13:08.856 INFO:tasks.workunit.client.0.smithi050.stderr: -175> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding con mode: secure 2024-09-14T11:13:08.857 INFO:tasks.workunit.client.0.smithi050.stderr: -174> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding con mode: crc 2024-09-14T11:13:08.857 INFO:tasks.workunit.client.0.smithi050.stderr: -173> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding con mode: secure 2024-09-14T11:13:08.857 INFO:tasks.workunit.client.0.smithi050.stderr: -172> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding con mode: crc 2024-09-14T11:13:08.857 INFO:tasks.workunit.client.0.smithi050.stderr: -171> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding con mode: secure 2024-09-14T11:13:08.857 INFO:tasks.workunit.client.0.smithi050.stderr: -170> 2024-09-14T11:13:08.562+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.857 INFO:tasks.workunit.client.0.smithi050.stderr: -169> 2024-09-14T11:13:08.562+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.857 INFO:tasks.workunit.client.0.smithi050.stderr: -168> 2024-09-14T11:13:08.562+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command rotate-key cmddesc rotate-key hook 0x5605b3fccd18 EEXIST 2024-09-14T11:13:08.857 INFO:tasks.workunit.client.0.smithi050.stderr: -167> 2024-09-14T11:13:08.562+0000 7f1c44719800 10 monclient: _reopen_session rank -1 2024-09-14T11:13:08.857 INFO:tasks.workunit.client.0.smithi050.stderr: -166> 2024-09-14T11:13:08.562+0000 7f1c44719800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:13:08.857 INFO:tasks.workunit.client.0.smithi050.stderr: -165> 2024-09-14T11:13:08.562+0000 7f1c44719800 10 monclient(hunting): picked mon.noname-b con 0x5605b3fd9f50 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:13:08.857 INFO:tasks.workunit.client.0.smithi050.stderr: -164> 2024-09-14T11:13:08.562+0000 7f1c44719800 10 monclient(hunting): picked mon.noname-a con 0x5605b40048a0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:13:08.857 INFO:tasks.workunit.client.0.smithi050.stderr: -163> 2024-09-14T11:13:08.562+0000 7f1c44719800 10 monclient(hunting): picked mon.noname-c con 0x5605b4009000 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:13:08.857 INFO:tasks.workunit.client.0.smithi050.stderr: -162> 2024-09-14T11:13:08.562+0000 7f1c44719800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:08.858 INFO:tasks.workunit.client.0.smithi050.stderr: -161> 2024-09-14T11:13:08.562+0000 7f1c44719800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:08.858 INFO:tasks.workunit.client.0.smithi050.stderr: -160> 2024-09-14T11:13:08.562+0000 7f1c44719800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:08.858 INFO:tasks.workunit.client.0.smithi050.stderr: -159> 2024-09-14T11:13:08.562+0000 7f1c44719800 10 monclient(hunting): _renew_subs 2024-09-14T11:13:08.858 INFO:tasks.workunit.client.0.smithi050.stderr: -158> 2024-09-14T11:13:08.562+0000 7f1c44719800 10 monclient(hunting): authenticate will time out at 2441.199352s 2024-09-14T11:13:08.858 INFO:tasks.workunit.client.0.smithi050.stderr: -157> 2024-09-14T11:13:08.562+0000 7f1c41a09640 10 monclient(hunting): get_auth_request con 0x5605b40048a0 auth_method 0 2024-09-14T11:13:08.858 INFO:tasks.workunit.client.0.smithi050.stderr: -156> 2024-09-14T11:13:08.562+0000 7f1c41a09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:08.858 INFO:tasks.workunit.client.0.smithi050.stderr: -155> 2024-09-14T11:13:08.562+0000 7f1c41a09640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:08.858 INFO:tasks.workunit.client.0.smithi050.stderr: -154> 2024-09-14T11:13:08.562+0000 7f1c41a09640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:08.858 INFO:tasks.workunit.client.0.smithi050.stderr: -153> 2024-09-14T11:13:08.562+0000 7f1c41a09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:08.858 INFO:tasks.workunit.client.0.smithi050.stderr: -152> 2024-09-14T11:13:08.562+0000 7f1c41a09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:08.858 INFO:tasks.workunit.client.0.smithi050.stderr: -151> 2024-09-14T11:13:08.562+0000 7f1c41a09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:08.858 INFO:tasks.workunit.client.0.smithi050.stderr: -150> 2024-09-14T11:13:08.562+0000 7f1c4220a640 10 monclient(hunting): get_auth_request con 0x5605b3fd9f50 auth_method 0 2024-09-14T11:13:08.858 INFO:tasks.workunit.client.0.smithi050.stderr: -149> 2024-09-14T11:13:08.562+0000 7f1c4220a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:08.859 INFO:tasks.workunit.client.0.smithi050.stderr: -148> 2024-09-14T11:13:08.562+0000 7f1c4220a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:08.859 INFO:tasks.workunit.client.0.smithi050.stderr: -147> 2024-09-14T11:13:08.562+0000 7f1c4220a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:08.859 INFO:tasks.workunit.client.0.smithi050.stderr: -146> 2024-09-14T11:13:08.562+0000 7f1c41a09640 10 monclient(hunting): handle_auth_done global_id 7806 payload 824 2024-09-14T11:13:08.859 INFO:tasks.workunit.client.0.smithi050.stderr: -145> 2024-09-14T11:13:08.562+0000 7f1c41a09640 10 monclient: _finish_hunting 0 2024-09-14T11:13:08.859 INFO:tasks.workunit.client.0.smithi050.stderr: -144> 2024-09-14T11:13:08.562+0000 7f1c41a09640 1 monclient: found mon.noname-a 2024-09-14T11:13:08.859 INFO:tasks.workunit.client.0.smithi050.stderr: -143> 2024-09-14T11:13:08.562+0000 7f1c41a09640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:13:08.859 INFO:tasks.workunit.client.0.smithi050.stderr: -142> 2024-09-14T11:13:08.562+0000 7f1b13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:08.859 INFO:tasks.workunit.client.0.smithi050.stderr: -141> 2024-09-14T11:13:08.563+0000 7f1b13fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:13:08.859 INFO:tasks.workunit.client.0.smithi050.stderr: -140> 2024-09-14T11:13:08.563+0000 7f1b13fff640 10 monclient: dump: 2024-09-14T11:13:08.859 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:08.859 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:08.859 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.859 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.860 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:08.860 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.860 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:08.860 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:08.860 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:08.860 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.860 INFO:tasks.workunit.client.0.smithi050.stderr: -139> 2024-09-14T11:13:08.563+0000 7f1b13fff640 10 monclient: _finish_auth 0 2024-09-14T11:13:08.860 INFO:tasks.workunit.client.0.smithi050.stderr: -138> 2024-09-14T11:13:08.563+0000 7f1b13fff640 10 monclient: _check_auth_tickets 2024-09-14T11:13:08.860 INFO:tasks.workunit.client.0.smithi050.stderr: -137> 2024-09-14T11:13:08.563+0000 7f1b13fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:08.860 INFO:tasks.workunit.client.0.smithi050.stderr: -136> 2024-09-14T11:13:08.563+0000 7f1b13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:08.860 INFO:tasks.workunit.client.0.smithi050.stderr: -135> 2024-09-14T11:13:08.563+0000 7f1b13fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:13:08.860 INFO:tasks.workunit.client.0.smithi050.stderr: -134> 2024-09-14T11:13:08.563+0000 7f1b13fff640 10 monclient: dump: 2024-09-14T11:13:08.860 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:08.861 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:08.861 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.861 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.861 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:08.861 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.861 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:08.861 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:08.861 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:08.861 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.861 INFO:tasks.workunit.client.0.smithi050.stderr: -133> 2024-09-14T11:13:08.563+0000 7f1b25ffb640 4 set_mon_vals no callback set 2024-09-14T11:13:08.861 INFO:tasks.workunit.client.0.smithi050.stderr: -132> 2024-09-14T11:13:08.563+0000 7f1c44719800 5 monclient: authenticate success, global_id 7806 2024-09-14T11:13:08.861 INFO:tasks.workunit.client.0.smithi050.stderr: -131> 2024-09-14T11:13:08.563+0000 7f1c44719800 10 monclient: _renew_subs 2024-09-14T11:13:08.861 INFO:tasks.workunit.client.0.smithi050.stderr: -130> 2024-09-14T11:13:08.563+0000 7f1c44719800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:13:08.861 INFO:tasks.workunit.client.0.smithi050.stderr: -129> 2024-09-14T11:13:08.563+0000 7f1c44719800 10 monclient: _renew_subs 2024-09-14T11:13:08.862 INFO:tasks.workunit.client.0.smithi050.stderr: -128> 2024-09-14T11:13:08.563+0000 7f1c44719800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:13:08.862 INFO:tasks.workunit.client.0.smithi050.stderr: -127> 2024-09-14T11:13:08.563+0000 7f1c44719800 1 librados: init done 2024-09-14T11:13:08.862 INFO:tasks.workunit.client.0.smithi050.stderr: -126> 2024-09-14T11:13:08.563+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command cr dump hook 0x5605b3ffc708 2024-09-14T11:13:08.862 INFO:tasks.workunit.client.0.smithi050.stderr: -125> 2024-09-14T11:13:08.564+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.862 INFO:tasks.workunit.client.0.smithi050.stderr: -124> 2024-09-14T11:13:08.565+0000 7f1b13fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:13:08.862 INFO:tasks.workunit.client.0.smithi050.stderr: -123> 2024-09-14T11:13:08.565+0000 7f1b13fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:13:08.862 INFO:tasks.workunit.client.0.smithi050.stderr: -122> 2024-09-14T11:13:08.565+0000 7f1b13fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:13:08.862 INFO:tasks.workunit.client.0.smithi050.stderr: -121> 2024-09-14T11:13:08.565+0000 7f1c4220a640 10 monclient: get_auth_request con 0x7f1b0c077260 auth_method 0 2024-09-14T11:13:08.862 INFO:tasks.workunit.client.0.smithi050.stderr: -120> 2024-09-14T11:13:08.565+0000 7f1c42a0b640 10 monclient: get_auth_request con 0x5605b4023390 auth_method 0 2024-09-14T11:13:08.862 INFO:tasks.workunit.client.0.smithi050.stderr: -119> 2024-09-14T11:13:08.566+0000 7f1c44719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.862 INFO:tasks.workunit.client.0.smithi050.stderr: -118> 2024-09-14T11:13:08.566+0000 7f1c44719800 20 realm 2024-09-14T11:13:08.862 INFO:tasks.workunit.client.0.smithi050.stderr: -117> 2024-09-14T11:13:08.566+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.862 INFO:tasks.workunit.client.0.smithi050.stderr: -116> 2024-09-14T11:13:08.566+0000 7f1c44719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.862 INFO:tasks.workunit.client.0.smithi050.stderr: -115> 2024-09-14T11:13:08.566+0000 7f1c44719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:08.863 INFO:tasks.workunit.client.0.smithi050.stderr: -114> 2024-09-14T11:13:08.566+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.863 INFO:tasks.workunit.client.0.smithi050.stderr: -113> 2024-09-14T11:13:08.566+0000 7f1c44719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.863 INFO:tasks.workunit.client.0.smithi050.stderr: -112> 2024-09-14T11:13:08.566+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.863 INFO:tasks.workunit.client.0.smithi050.stderr: -111> 2024-09-14T11:13:08.567+0000 7f1c4220a640 10 monclient: get_auth_request con 0x5605b4027690 auth_method 0 2024-09-14T11:13:08.863 INFO:tasks.workunit.client.0.smithi050.stderr: -110> 2024-09-14T11:13:08.567+0000 7f1c44719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:08.863 INFO:tasks.workunit.client.0.smithi050.stderr: -109> 2024-09-14T11:13:08.567+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.863 INFO:tasks.workunit.client.0.smithi050.stderr: -108> 2024-09-14T11:13:08.567+0000 7f1c41a09640 10 monclient: get_auth_request con 0x5605b402add0 auth_method 0 2024-09-14T11:13:08.863 INFO:tasks.workunit.client.0.smithi050.stderr: -107> 2024-09-14T11:13:08.568+0000 7f1c44719800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:08.863 INFO:tasks.workunit.client.0.smithi050.stderr: -106> 2024-09-14T11:13:08.568+0000 7f1c44719800 20 searching for the correct realm 2024-09-14T11:13:08.863 INFO:tasks.workunit.client.0.smithi050.stderr: -105> 2024-09-14T11:13:08.568+0000 7f1c42a0b640 10 monclient: get_auth_request con 0x5605b402fb90 auth_method 0 2024-09-14T11:13:08.863 INFO:tasks.workunit.client.0.smithi050.stderr: -104> 2024-09-14T11:13:08.569+0000 7f1c4220a640 10 monclient: get_auth_request con 0x7f1c3c01d060 auth_method 0 2024-09-14T11:13:08.863 INFO:tasks.workunit.client.0.smithi050.stderr: -103> 2024-09-14T11:13:08.570+0000 7f1c41a09640 10 monclient: get_auth_request con 0x7f1c3c060b80 auth_method 0 2024-09-14T11:13:08.863 INFO:tasks.workunit.client.0.smithi050.stderr: -102> 2024-09-14T11:13:08.571+0000 7f1c41a09640 0 -- 172.21.15.50:0/1653362030 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f1c3c060b80 msgr2=0x7f1c3c0767f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:08.863 INFO:tasks.workunit.client.0.smithi050.stderr: -101> 2024-09-14T11:13:08.772+0000 7f1c41a09640 10 monclient: get_auth_request con 0x7f1c3c060b80 auth_method 0 2024-09-14T11:13:08.864 INFO:tasks.workunit.client.0.smithi050.stderr: -100> 2024-09-14T11:13:08.774+0000 7f1c42a0b640 10 monclient: get_auth_request con 0x7f1c3406c070 auth_method 0 2024-09-14T11:13:08.864 INFO:tasks.workunit.client.0.smithi050.stderr: -99> 2024-09-14T11:13:08.775+0000 7f1c4220a640 10 monclient: get_auth_request con 0x7f1c3c069d70 auth_method 0 2024-09-14T11:13:08.864 INFO:tasks.workunit.client.0.smithi050.stderr: -98> 2024-09-14T11:13:08.776+0000 7f1c42a0b640 0 -- 172.21.15.50:0/1653362030 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5605b4023390 msgr2=0x5605b4025820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:08.864 INFO:tasks.workunit.client.0.smithi050.stderr: -97> 2024-09-14T11:13:08.776+0000 7f1b13fff640 1 client.7806.objecter ms_handle_reset 0x5605b4023390 session 0x5605b4022c80 osd.6 2024-09-14T11:13:08.864 INFO:tasks.workunit.client.0.smithi050.stderr: -96> 2024-09-14T11:13:08.776+0000 7f1b13fff640 10 monclient: _renew_subs 2024-09-14T11:13:08.864 INFO:tasks.workunit.client.0.smithi050.stderr: -95> 2024-09-14T11:13:08.776+0000 7f1b13fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:13:08.864 INFO:tasks.workunit.client.0.smithi050.stderr: -94> 2024-09-14T11:13:08.776+0000 7f1c42a0b640 10 monclient: get_auth_request con 0x7f1b0c087490 auth_method 0 2024-09-14T11:13:08.864 INFO:tasks.workunit.client.0.smithi050.stderr: -93> 2024-09-14T11:13:08.780+0000 7f1c44719800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:08.864 INFO:tasks.workunit.client.0.smithi050.stderr: -92> 2024-09-14T11:13:08.780+0000 7f1c44719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:08.864 INFO:tasks.workunit.client.0.smithi050.stderr: -91> 2024-09-14T11:13:08.780+0000 7f1c44719800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:08.864 INFO:tasks.workunit.client.0.smithi050.stderr: -90> 2024-09-14T11:13:08.780+0000 7f1c44719800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:08.864 INFO:tasks.workunit.client.0.smithi050.stderr: -89> 2024-09-14T11:13:08.780+0000 7f1c44719800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:08.864 INFO:tasks.workunit.client.0.smithi050.stderr: -88> 2024-09-14T11:13:08.780+0000 7f1c44719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:08.865 INFO:tasks.workunit.client.0.smithi050.stderr: -87> 2024-09-14T11:13:08.780+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.865 INFO:tasks.workunit.client.0.smithi050.stderr: -86> 2024-09-14T11:13:08.780+0000 7f1c44719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.865 INFO:tasks.workunit.client.0.smithi050.stderr: -85> 2024-09-14T11:13:08.780+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.865 INFO:tasks.workunit.client.0.smithi050.stderr: -84> 2024-09-14T11:13:08.780+0000 7f1c44719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:08.865 INFO:tasks.workunit.client.0.smithi050.stderr: -83> 2024-09-14T11:13:08.780+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.865 INFO:tasks.workunit.client.0.smithi050.stderr: -82> 2024-09-14T11:13:08.781+0000 7f1c44719800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:08.865 INFO:tasks.workunit.client.0.smithi050.stderr: -81> 2024-09-14T11:13:08.781+0000 7f1c44719800 20 zone default found 2024-09-14T11:13:08.865 INFO:tasks.workunit.client.0.smithi050.stderr: -80> 2024-09-14T11:13:08.781+0000 7f1c44719800 4 Realm: () 2024-09-14T11:13:08.865 INFO:tasks.workunit.client.0.smithi050.stderr: -79> 2024-09-14T11:13:08.781+0000 7f1c44719800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:08.865 INFO:tasks.workunit.client.0.smithi050.stderr: -78> 2024-09-14T11:13:08.781+0000 7f1c44719800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:08.865 INFO:tasks.workunit.client.0.smithi050.stderr: -77> 2024-09-14T11:13:08.781+0000 7f1c44719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:08.865 INFO:tasks.workunit.client.0.smithi050.stderr: -76> 2024-09-14T11:13:08.781+0000 7f1c44719800 20 zonegroup default 2024-09-14T11:13:08.865 INFO:tasks.workunit.client.0.smithi050.stderr: -75> 2024-09-14T11:13:08.781+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.866 INFO:tasks.workunit.client.0.smithi050.stderr: -74> 2024-09-14T11:13:08.781+0000 7f1c44719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.866 INFO:tasks.workunit.client.0.smithi050.stderr: -73> 2024-09-14T11:13:08.781+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.866 INFO:tasks.workunit.client.0.smithi050.stderr: -72> 2024-09-14T11:13:08.781+0000 7f1c44719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.866 INFO:tasks.workunit.client.0.smithi050.stderr: -71> 2024-09-14T11:13:08.781+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.866 INFO:tasks.workunit.client.0.smithi050.stderr: -70> 2024-09-14T11:13:08.781+0000 7f1c44719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.866 INFO:tasks.workunit.client.0.smithi050.stderr: -69> 2024-09-14T11:13:08.781+0000 7f1c44719800 20 started sync module instance, tier type = 2024-09-14T11:13:08.866 INFO:tasks.workunit.client.0.smithi050.stderr: -68> 2024-09-14T11:13:08.782+0000 7f1c44719800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:08.866 INFO:tasks.workunit.client.0.smithi050.stderr: -67> 2024-09-14T11:13:08.790+0000 7f1c44719800 20 add_watcher() i=0 2024-09-14T11:13:08.866 INFO:tasks.workunit.client.0.smithi050.stderr: -66> 2024-09-14T11:13:08.790+0000 7f1c44719800 20 add_watcher() i=1 2024-09-14T11:13:08.866 INFO:tasks.workunit.client.0.smithi050.stderr: -65> 2024-09-14T11:13:08.790+0000 7f1c44719800 20 add_watcher() i=2 2024-09-14T11:13:08.866 INFO:tasks.workunit.client.0.smithi050.stderr: -64> 2024-09-14T11:13:08.790+0000 7f1c44719800 20 add_watcher() i=3 2024-09-14T11:13:08.866 INFO:tasks.workunit.client.0.smithi050.stderr: -63> 2024-09-14T11:13:08.790+0000 7f1c44719800 20 add_watcher() i=4 2024-09-14T11:13:08.866 INFO:tasks.workunit.client.0.smithi050.stderr: -62> 2024-09-14T11:13:08.790+0000 7f1c44719800 20 add_watcher() i=5 2024-09-14T11:13:08.867 INFO:tasks.workunit.client.0.smithi050.stderr: -61> 2024-09-14T11:13:08.790+0000 7f1c44719800 20 add_watcher() i=6 2024-09-14T11:13:08.867 INFO:tasks.workunit.client.0.smithi050.stderr: -60> 2024-09-14T11:13:08.791+0000 7f1c44719800 20 add_watcher() i=7 2024-09-14T11:13:08.867 INFO:tasks.workunit.client.0.smithi050.stderr: -59> 2024-09-14T11:13:08.791+0000 7f1c44719800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:08.867 INFO:tasks.workunit.client.0.smithi050.stderr: -58> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding auth protocol: cephx 2024-09-14T11:13:08.867 INFO:tasks.workunit.client.0.smithi050.stderr: -57> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding auth protocol: cephx 2024-09-14T11:13:08.867 INFO:tasks.workunit.client.0.smithi050.stderr: -56> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding auth protocol: cephx 2024-09-14T11:13:08.867 INFO:tasks.workunit.client.0.smithi050.stderr: -55> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding con mode: secure 2024-09-14T11:13:08.867 INFO:tasks.workunit.client.0.smithi050.stderr: -54> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding con mode: crc 2024-09-14T11:13:08.867 INFO:tasks.workunit.client.0.smithi050.stderr: -53> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding con mode: secure 2024-09-14T11:13:08.867 INFO:tasks.workunit.client.0.smithi050.stderr: -52> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding con mode: crc 2024-09-14T11:13:08.867 INFO:tasks.workunit.client.0.smithi050.stderr: -51> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding con mode: secure 2024-09-14T11:13:08.867 INFO:tasks.workunit.client.0.smithi050.stderr: -50> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding con mode: crc 2024-09-14T11:13:08.867 INFO:tasks.workunit.client.0.smithi050.stderr: -49> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding con mode: crc 2024-09-14T11:13:08.867 INFO:tasks.workunit.client.0.smithi050.stderr: -48> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding con mode: secure 2024-09-14T11:13:08.868 INFO:tasks.workunit.client.0.smithi050.stderr: -47> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding con mode: crc 2024-09-14T11:13:08.868 INFO:tasks.workunit.client.0.smithi050.stderr: -46> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding con mode: secure 2024-09-14T11:13:08.868 INFO:tasks.workunit.client.0.smithi050.stderr: -45> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding con mode: crc 2024-09-14T11:13:08.868 INFO:tasks.workunit.client.0.smithi050.stderr: -44> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding con mode: secure 2024-09-14T11:13:08.868 INFO:tasks.workunit.client.0.smithi050.stderr: -43> 2024-09-14T11:13:08.793+0000 7f1af8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:08.868 INFO:tasks.workunit.client.0.smithi050.stderr: -42> 2024-09-14T11:13:08.793+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.868 INFO:tasks.workunit.client.0.smithi050.stderr: -41> 2024-09-14T11:13:08.793+0000 7f1c44719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:08.868 INFO:tasks.workunit.client.0.smithi050.stderr: -40> 2024-09-14T11:13:08.793+0000 7f1c44719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:08.868 INFO:tasks.workunit.client.0.smithi050.stderr: -39> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command cache list hook 0x5605b3ffa210 2024-09-14T11:13:08.868 INFO:tasks.workunit.client.0.smithi050.stderr: -38> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command cache inspect hook 0x5605b3ffa210 2024-09-14T11:13:08.868 INFO:tasks.workunit.client.0.smithi050.stderr: -37> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command cache erase hook 0x5605b3ffa210 2024-09-14T11:13:08.868 INFO:tasks.workunit.client.0.smithi050.stderr: -36> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command cache zap hook 0x5605b3ffa210 2024-09-14T11:13:08.868 INFO:tasks.workunit.client.0.smithi050.stderr: -35> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 note: GC not initialized 2024-09-14T11:13:08.868 INFO:tasks.workunit.client.0.smithi050.stderr: -34> 2024-09-14T11:13:08.793+0000 7f1a737fe640 20 reqs_thread_entry: start 2024-09-14T11:13:08.869 INFO:tasks.workunit.client.0.smithi050.stderr: -33> 2024-09-14T11:13:08.794+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command sync trace show hook 0x7f1c3800d5f0 2024-09-14T11:13:08.869 INFO:tasks.workunit.client.0.smithi050.stderr: -32> 2024-09-14T11:13:08.794+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command sync trace history hook 0x7f1c3800d5f0 2024-09-14T11:13:08.869 INFO:tasks.workunit.client.0.smithi050.stderr: -31> 2024-09-14T11:13:08.794+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command sync trace active hook 0x7f1c3800d5f0 2024-09-14T11:13:08.869 INFO:tasks.workunit.client.0.smithi050.stderr: -30> 2024-09-14T11:13:08.794+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command sync trace active_short hook 0x7f1c3800d5f0 2024-09-14T11:13:08.869 INFO:tasks.workunit.client.0.smithi050.stderr: -29> 2024-09-14T11:13:08.794+0000 7f1c44719800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:08.869 INFO:tasks.workunit.client.0.smithi050.stderr: -28> 2024-09-14T11:13:08.794+0000 7f1c44719800 20 Filter name: none 2024-09-14T11:13:08.869 INFO:tasks.workunit.client.0.smithi050.stderr: -27> 2024-09-14T11:13:08.794+0000 7f1a717fa640 20 reqs_thread_entry: start 2024-09-14T11:13:08.869 INFO:tasks.workunit.client.0.smithi050.stderr: -26> 2024-09-14T11:13:08.794+0000 7f1c44719800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:13:08.869 INFO:tasks.workunit.client.0.smithi050.stderr: -25> 2024-09-14T11:13:08.794+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.869 INFO:tasks.workunit.client.0.smithi050.stderr: -24> 2024-09-14T11:13:08.794+0000 7f1c44719800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:13:08.869 INFO:tasks.workunit.client.0.smithi050.stderr: -23> 2024-09-14T11:13:08.794+0000 7f1c44719800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:13:08.869 INFO:tasks.workunit.client.0.smithi050.stderr: -22> 2024-09-14T11:13:08.794+0000 7f1c44719800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:13:08.869 INFO:tasks.workunit.client.0.smithi050.stderr: -21> 2024-09-14T11:13:08.794+0000 7f1c44719800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 : miss 2024-09-14T11:13:08.870 INFO:tasks.workunit.client.0.smithi050.stderr: -20> 2024-09-14T11:13:08.794+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.870 INFO:tasks.workunit.client.0.smithi050.stderr: -19> 2024-09-14T11:13:08.795+0000 7f1c44719800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:13:08.870 INFO:tasks.workunit.client.0.smithi050.stderr: -18> 2024-09-14T11:13:08.795+0000 7f1c44719800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 info.flags=0x17 2024-09-14T11:13:08.870 INFO:tasks.workunit.client.0.smithi050.stderr: -17> 2024-09-14T11:13:08.795+0000 7f1c44719800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 to cache LRU end 2024-09-14T11:13:08.870 INFO:tasks.workunit.client.0.smithi050.stderr: -16> 2024-09-14T11:13:08.795+0000 7f1c44719800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:08.870 INFO:tasks.workunit.client.0.smithi050.stderr: -15> 2024-09-14T11:13:08.795+0000 7f1c44719800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:08.870 INFO:tasks.workunit.client.0.smithi050.stderr: -14> 2024-09-14T11:13:08.795+0000 7f1c44719800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 2024-09-14T11:13:08.870 INFO:tasks.workunit.client.0.smithi050.stderr: -13> 2024-09-14T11:13:08.800+0000 7f1c44719800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 info.flags=0x17 2024-09-14T11:13:08.870 INFO:tasks.workunit.client.0.smithi050.stderr: -12> 2024-09-14T11:13:08.800+0000 7f1c44719800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 to cache LRU end 2024-09-14T11:13:08.870 INFO:tasks.workunit.client.0.smithi050.stderr: -11> 2024-09-14T11:13:08.800+0000 7f1c44719800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:08.870 INFO:tasks.workunit.client.0.smithi050.stderr: -10> 2024-09-14T11:13:08.800+0000 7f1c44719800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37, ofs0, ns] 2024-09-14T11:13:08.870 INFO:tasks.workunit.client.0.smithi050.stderr: -9> 2024-09-14T11:13:08.800+0000 7f1b257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496985 cookie 94582494940592 notifier 7806 bl.length()=1007 2024-09-14T11:13:08.870 INFO:tasks.workunit.client.0.smithi050.stderr: -8> 2024-09-14T11:13:08.800+0000 7f1b257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 info.flags=0x17 2024-09-14T11:13:08.870 INFO:tasks.workunit.client.0.smithi050.stderr: -7> 2024-09-14T11:13:08.800+0000 7f1b257fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 to cache LRU end 2024-09-14T11:13:08.871 INFO:tasks.workunit.client.0.smithi050.stderr: -6> 2024-09-14T11:13:08.800+0000 7f1b257fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:08.871 INFO:tasks.workunit.client.0.smithi050.stderr: -5> 2024-09-14T11:13:08.803+0000 7f1c44719800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37]): orig_sources= new_sources= 2024-09-14T11:13:08.871 INFO:tasks.workunit.client.0.smithi050.stderr: -4> 2024-09-14T11:13:08.803+0000 7f1c44719800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37]): potential sources added=[] removed=[] 2024-09-14T11:13:08.871 INFO:tasks.workunit.client.0.smithi050.stderr: -3> 2024-09-14T11:13:08.803+0000 7f1c44719800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37]): orig_dests= new_dests= 2024-09-14T11:13:08.871 INFO:tasks.workunit.client.0.smithi050.stderr: -2> 2024-09-14T11:13:08.803+0000 7f1c44719800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37]): potential dests added=[] removed=[] 2024-09-14T11:13:08.871 INFO:tasks.workunit.client.0.smithi050.stderr: -1> 2024-09-14T11:13:08.806+0000 7f1c44719800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1c44719800 time 2024-09-14T11:13:08.805901+0000 2024-09-14T11:13:08.871 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:13:08.871 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.871 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:13:08.871 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1c47b8c76a] 2024-09-14T11:13:08.871 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f1c47b8c928] 2024-09-14T11:13:08.871 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5605b307f0b1] 2024-09-14T11:13:08.871 INFO:tasks.workunit.client.0.smithi050.stderr: 4: radosgw-admin(+0xd8907c) [0x5605b359307c] 2024-09-14T11:13:08.871 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5605b308eefd] 2024-09-14T11:13:08.872 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:13:08.872 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1c46829590] 2024-09-14T11:13:08.872 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:13:08.872 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:13:08.872 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.872 INFO:tasks.workunit.client.0.smithi050.stderr: 0> 2024-09-14T11:13:08.807+0000 7f1c44719800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:13:08.872 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f1c44719800 thread_name:radosgw-admin 2024-09-14T11:13:08.872 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.872 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:13:08.872 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1c4683e6f0] 2024-09-14T11:13:08.872 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1c4688b99c] 2024-09-14T11:13:08.872 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:13:08.872 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:13:08.873 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1c47b8c7c4] 2024-09-14T11:13:08.873 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f1c47b8c928] 2024-09-14T11:13:08.873 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5605b307f0b1] 2024-09-14T11:13:08.873 INFO:tasks.workunit.client.0.smithi050.stderr: 8: radosgw-admin(+0xd8907c) [0x5605b359307c] 2024-09-14T11:13:08.873 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5605b308eefd] 2024-09-14T11:13:08.873 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:13:08.874 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1c46829590] 2024-09-14T11:13:08.874 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:13:08.874 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:13:08.874 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:13:08.874 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.874 INFO:tasks.workunit.client.0.smithi050.stderr:--- logging levels --- 2024-09-14T11:13:08.874 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 none 2024-09-14T11:13:08.874 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 lockdep 2024-09-14T11:13:08.874 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 context 2024-09-14T11:13:08.874 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 crush 2024-09-14T11:13:08.874 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds 2024-09-14T11:13:08.874 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_balancer 2024-09-14T11:13:08.874 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_locker 2024-09-14T11:13:08.874 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log 2024-09-14T11:13:08.875 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log_expire 2024-09-14T11:13:08.875 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_migrator 2024-09-14T11:13:08.875 INFO:tasks.workunit.client.0.smithi050.stderr: 3/ 5 mds_quiesce 2024-09-14T11:13:08.875 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 buffer 2024-09-14T11:13:08.875 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 timer 2024-09-14T11:13:08.875 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 filer 2024-09-14T11:13:08.875 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 striper 2024-09-14T11:13:08.875 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 objecter 2024-09-14T11:13:08.875 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rados 2024-09-14T11:13:08.875 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd 2024-09-14T11:13:08.875 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_mirror 2024-09-14T11:13:08.875 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_replay 2024-09-14T11:13:08.875 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_pwl 2024-09-14T11:13:08.875 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 journaler 2024-09-14T11:13:08.875 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objectcacher 2024-09-14T11:13:08.876 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:13:08.876 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 client 2024-09-14T11:13:08.876 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 osd 2024-09-14T11:13:08.876 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 optracker 2024-09-14T11:13:08.876 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objclass 2024-09-14T11:13:08.876 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 filestore 2024-09-14T11:13:08.876 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 journal 2024-09-14T11:13:08.876 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 ms 2024-09-14T11:13:08.876 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mon 2024-09-14T11:13:08.876 INFO:tasks.workunit.client.0.smithi050.stderr: 0/10 monc 2024-09-14T11:13:08.876 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 paxos 2024-09-14T11:13:08.876 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 tp 2024-09-14T11:13:08.876 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 auth 2024-09-14T11:13:08.877 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 crypto 2024-09-14T11:13:08.877 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 finisher 2024-09-14T11:13:08.877 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 reserver 2024-09-14T11:13:08.877 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 heartbeatmap 2024-09-14T11:13:08.877 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 perfcounter 2024-09-14T11:13:08.877 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw 2024-09-14T11:13:08.877 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_sync 2024-09-14T11:13:08.877 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_datacache 2024-09-14T11:13:08.877 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_access 2024-09-14T11:13:08.877 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:13:08.877 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_flight 2024-09-14T11:13:08.877 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:13:08.877 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw_notification 2024-09-14T11:13:08.877 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 javaclient 2024-09-14T11:13:08.878 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 asok 2024-09-14T11:13:08.878 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 throttle 2024-09-14T11:13:08.878 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 refs 2024-09-14T11:13:08.878 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 compressor 2024-09-14T11:13:08.878 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluestore 2024-09-14T11:13:08.878 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluefs 2024-09-14T11:13:08.878 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 bdev 2024-09-14T11:13:08.878 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 kstore 2024-09-14T11:13:08.878 INFO:tasks.workunit.client.0.smithi050.stderr: 4/ 5 rocksdb 2024-09-14T11:13:08.878 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 fuse 2024-09-14T11:13:08.878 INFO:tasks.workunit.client.0.smithi050.stderr: 2/ 5 mgr 2024-09-14T11:13:08.878 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mgrc 2024-09-14T11:13:08.878 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 dpdk 2024-09-14T11:13:08.878 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 eventtrace 2024-09-14T11:13:08.878 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 prioritycache 2024-09-14T11:13:08.879 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 test 2024-09-14T11:13:08.879 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:13:08.879 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephsqlite 2024-09-14T11:13:08.879 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:13:08.879 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore 2024-09-14T11:13:08.879 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_onode 2024-09-14T11:13:08.879 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_odata 2024-09-14T11:13:08.879 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_omap 2024-09-14T11:13:08.879 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_tm 2024-09-14T11:13:08.879 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_t 2024-09-14T11:13:08.879 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:13:08.879 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_epm 2024-09-14T11:13:08.879 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_lba 2024-09-14T11:13:08.879 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:13:08.880 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cache 2024-09-14T11:13:08.880 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_journal 2024-09-14T11:13:08.880 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_device 2024-09-14T11:13:08.880 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_backref 2024-09-14T11:13:08.880 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 alienstore 2024-09-14T11:13:08.880 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mclock 2024-09-14T11:13:08.880 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cyanstore 2024-09-14T11:13:08.880 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 ceph_exporter 2024-09-14T11:13:08.880 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 memstore 2024-09-14T11:13:08.880 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 trace 2024-09-14T11:13:08.880 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 ceph_dedup 2024-09-14T11:13:08.880 INFO:tasks.workunit.client.0.smithi050.stderr: -2/-2 (syslog threshold) 2024-09-14T11:13:08.880 INFO:tasks.workunit.client.0.smithi050.stderr: 99/99 (stderr threshold) 2024-09-14T11:13:08.880 INFO:tasks.workunit.client.0.smithi050.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:13:08.881 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1a717fa640 / http_manager 2024-09-14T11:13:08.881 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1a737fe640 / http_manager 2024-09-14T11:13:08.881 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1af8fe1640 / rgw_dt_lg_renew 2024-09-14T11:13:08.881 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1b13fff640 / ms_dispatch 2024-09-14T11:13:08.881 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1b257fa640 / io_context_pool 2024-09-14T11:13:08.881 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1b25ffb640 / io_context_pool 2024-09-14T11:13:08.881 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1b27fff640 / ms_dispatch 2024-09-14T11:13:08.881 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1b2ee05640 / ms_dispatch 2024-09-14T11:13:08.881 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1b30608640 / io_context_pool 2024-09-14T11:13:08.881 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1c41a09640 / msgr-worker-2 2024-09-14T11:13:08.881 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1c4220a640 / msgr-worker-1 2024-09-14T11:13:08.881 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1c42a0b640 / msgr-worker-0 2024-09-14T11:13:08.881 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1c4320c640 / io_context_pool 2024-09-14T11:13:08.881 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1c44719800 / radosgw-admin 2024-09-14T11:13:08.882 INFO:tasks.workunit.client.0.smithi050.stderr: max_recent 500 2024-09-14T11:13:08.882 INFO:tasks.workunit.client.0.smithi050.stderr: max_new 1000 2024-09-14T11:13:08.882 INFO:tasks.workunit.client.0.smithi050.stderr: log_file /var/log/ceph/ceph-client.admin.134961.log 2024-09-14T11:13:08.882 INFO:tasks.workunit.client.0.smithi050.stderr:--- end dump of recent events --- 2024-09-14T11:13:08.882 INFO:tasks.workunit.client.0.smithi050.stderr:--- begin dump of recent events --- 2024-09-14T11:13:08.882 INFO:tasks.workunit.client.0.smithi050.stderr: -499> 2024-09-14T11:13:08.546+0000 7f1b30608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:08.882 INFO:tasks.workunit.client.0.smithi050.stderr: -498> 2024-09-14T11:13:08.546+0000 7f1b30608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:13:08.882 INFO:tasks.workunit.client.0.smithi050.stderr: -497> 2024-09-14T11:13:08.546+0000 7f1b30608640 10 monclient: dump: 2024-09-14T11:13:08.882 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:08.882 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:08.882 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.882 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.882 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:08.882 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.883 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:08.883 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:08.883 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:08.883 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.883 INFO:tasks.workunit.client.0.smithi050.stderr: -496> 2024-09-14T11:13:08.546+0000 7f1c44719800 5 monclient: authenticate success, global_id 7295 2024-09-14T11:13:08.883 INFO:tasks.workunit.client.0.smithi050.stderr: -495> 2024-09-14T11:13:08.546+0000 7f1c44719800 10 monclient: get_monmap_and_config success 2024-09-14T11:13:08.883 INFO:tasks.workunit.client.0.smithi050.stderr: -494> 2024-09-14T11:13:08.546+0000 7f1c44719800 4 set_mon_vals no callback set 2024-09-14T11:13:08.883 INFO:tasks.workunit.client.0.smithi050.stderr: -493> 2024-09-14T11:13:08.547+0000 7f1c44719800 10 monclient: shutdown 2024-09-14T11:13:08.883 INFO:tasks.workunit.client.0.smithi050.stderr: -492> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 asok(0x5605b3d18270) unregister_commands rotate-key 2024-09-14T11:13:08.883 INFO:tasks.workunit.client.0.smithi050.stderr: -491> 2024-09-14T11:13:08.547+0000 7f1c44719800 10 monclient: build_initial_monmap 2024-09-14T11:13:08.883 INFO:tasks.workunit.client.0.smithi050.stderr: -490> 2024-09-14T11:13:08.547+0000 7f1c44719800 1 build_initial for_mkfs: 0 2024-09-14T11:13:08.883 INFO:tasks.workunit.client.0.smithi050.stderr: -489> 2024-09-14T11:13:08.547+0000 7f1c44719800 10 monclient: monmap: 2024-09-14T11:13:08.883 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:13:08.883 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:13:08.884 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:13:08.884 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:13:08.884 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:13:08.884 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.884 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:13:08.884 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:13:08.884 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:13:08.884 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.884 INFO:tasks.workunit.client.0.smithi050.stderr: -488> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding auth protocol: cephx 2024-09-14T11:13:08.884 INFO:tasks.workunit.client.0.smithi050.stderr: -487> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding auth protocol: cephx 2024-09-14T11:13:08.884 INFO:tasks.workunit.client.0.smithi050.stderr: -486> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding auth protocol: cephx 2024-09-14T11:13:08.884 INFO:tasks.workunit.client.0.smithi050.stderr: -485> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding con mode: secure 2024-09-14T11:13:08.884 INFO:tasks.workunit.client.0.smithi050.stderr: -484> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding con mode: crc 2024-09-14T11:13:08.885 INFO:tasks.workunit.client.0.smithi050.stderr: -483> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding con mode: secure 2024-09-14T11:13:08.885 INFO:tasks.workunit.client.0.smithi050.stderr: -482> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding con mode: crc 2024-09-14T11:13:08.885 INFO:tasks.workunit.client.0.smithi050.stderr: -481> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding con mode: secure 2024-09-14T11:13:08.885 INFO:tasks.workunit.client.0.smithi050.stderr: -480> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding con mode: crc 2024-09-14T11:13:08.885 INFO:tasks.workunit.client.0.smithi050.stderr: -479> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding con mode: crc 2024-09-14T11:13:08.885 INFO:tasks.workunit.client.0.smithi050.stderr: -478> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding con mode: secure 2024-09-14T11:13:08.885 INFO:tasks.workunit.client.0.smithi050.stderr: -477> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding con mode: crc 2024-09-14T11:13:08.885 INFO:tasks.workunit.client.0.smithi050.stderr: -476> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding con mode: secure 2024-09-14T11:13:08.885 INFO:tasks.workunit.client.0.smithi050.stderr: -475> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding con mode: crc 2024-09-14T11:13:08.885 INFO:tasks.workunit.client.0.smithi050.stderr: -474> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 AuthRegistry(0x5605b3f3e610) adding con mode: secure 2024-09-14T11:13:08.885 INFO:tasks.workunit.client.0.smithi050.stderr: -473> 2024-09-14T11:13:08.547+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.885 INFO:tasks.workunit.client.0.smithi050.stderr: -472> 2024-09-14T11:13:08.547+0000 7f1c44719800 1 librados: starting msgr at 2024-09-14T11:13:08.885 INFO:tasks.workunit.client.0.smithi050.stderr: -471> 2024-09-14T11:13:08.547+0000 7f1c44719800 1 librados: starting objecter 2024-09-14T11:13:08.885 INFO:tasks.workunit.client.0.smithi050.stderr: -470> 2024-09-14T11:13:08.547+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command objecter_requests hook 0x5605b3f62330 2024-09-14T11:13:08.886 INFO:tasks.workunit.client.0.smithi050.stderr: -469> 2024-09-14T11:13:08.548+0000 7f1c44719800 1 librados: setting wanted keys 2024-09-14T11:13:08.886 INFO:tasks.workunit.client.0.smithi050.stderr: -468> 2024-09-14T11:13:08.548+0000 7f1c44719800 1 librados: calling monclient init 2024-09-14T11:13:08.886 INFO:tasks.workunit.client.0.smithi050.stderr: -467> 2024-09-14T11:13:08.548+0000 7f1c44719800 10 monclient: init 2024-09-14T11:13:08.886 INFO:tasks.workunit.client.0.smithi050.stderr: -466> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding auth protocol: cephx 2024-09-14T11:13:08.886 INFO:tasks.workunit.client.0.smithi050.stderr: -465> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding auth protocol: cephx 2024-09-14T11:13:08.886 INFO:tasks.workunit.client.0.smithi050.stderr: -464> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding auth protocol: cephx 2024-09-14T11:13:08.886 INFO:tasks.workunit.client.0.smithi050.stderr: -463> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding con mode: secure 2024-09-14T11:13:08.886 INFO:tasks.workunit.client.0.smithi050.stderr: -462> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding con mode: crc 2024-09-14T11:13:08.886 INFO:tasks.workunit.client.0.smithi050.stderr: -461> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding con mode: secure 2024-09-14T11:13:08.886 INFO:tasks.workunit.client.0.smithi050.stderr: -460> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding con mode: crc 2024-09-14T11:13:08.886 INFO:tasks.workunit.client.0.smithi050.stderr: -459> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding con mode: secure 2024-09-14T11:13:08.886 INFO:tasks.workunit.client.0.smithi050.stderr: -458> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding con mode: crc 2024-09-14T11:13:08.886 INFO:tasks.workunit.client.0.smithi050.stderr: -457> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding con mode: crc 2024-09-14T11:13:08.886 INFO:tasks.workunit.client.0.smithi050.stderr: -456> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding con mode: secure 2024-09-14T11:13:08.886 INFO:tasks.workunit.client.0.smithi050.stderr: -455> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding con mode: crc 2024-09-14T11:13:08.887 INFO:tasks.workunit.client.0.smithi050.stderr: -454> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding con mode: secure 2024-09-14T11:13:08.887 INFO:tasks.workunit.client.0.smithi050.stderr: -453> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding con mode: crc 2024-09-14T11:13:08.887 INFO:tasks.workunit.client.0.smithi050.stderr: -452> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 AuthRegistry(0x5605b3f38980) adding con mode: secure 2024-09-14T11:13:08.887 INFO:tasks.workunit.client.0.smithi050.stderr: -451> 2024-09-14T11:13:08.548+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.887 INFO:tasks.workunit.client.0.smithi050.stderr: -450> 2024-09-14T11:13:08.548+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.887 INFO:tasks.workunit.client.0.smithi050.stderr: -449> 2024-09-14T11:13:08.548+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command rotate-key hook 0x5605b3f38ac8 2024-09-14T11:13:08.887 INFO:tasks.workunit.client.0.smithi050.stderr: -448> 2024-09-14T11:13:08.548+0000 7f1c44719800 10 monclient: _reopen_session rank -1 2024-09-14T11:13:08.887 INFO:tasks.workunit.client.0.smithi050.stderr: -447> 2024-09-14T11:13:08.548+0000 7f1c44719800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:13:08.887 INFO:tasks.workunit.client.0.smithi050.stderr: -446> 2024-09-14T11:13:08.548+0000 7f1c44719800 10 monclient(hunting): picked mon.noname-a con 0x5605b3db0bd0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:13:08.887 INFO:tasks.workunit.client.0.smithi050.stderr: -445> 2024-09-14T11:13:08.548+0000 7f1c44719800 10 monclient(hunting): picked mon.noname-b con 0x5605b3de6280 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:13:08.887 INFO:tasks.workunit.client.0.smithi050.stderr: -444> 2024-09-14T11:13:08.548+0000 7f1c44719800 10 monclient(hunting): picked mon.noname-c con 0x5605b3ded250 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:13:08.887 INFO:tasks.workunit.client.0.smithi050.stderr: -443> 2024-09-14T11:13:08.548+0000 7f1c44719800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:08.887 INFO:tasks.workunit.client.0.smithi050.stderr: -442> 2024-09-14T11:13:08.548+0000 7f1c44719800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:08.888 INFO:tasks.workunit.client.0.smithi050.stderr: -441> 2024-09-14T11:13:08.548+0000 7f1c44719800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:08.888 INFO:tasks.workunit.client.0.smithi050.stderr: -440> 2024-09-14T11:13:08.548+0000 7f1c44719800 10 monclient(hunting): _renew_subs 2024-09-14T11:13:08.888 INFO:tasks.workunit.client.0.smithi050.stderr: -439> 2024-09-14T11:13:08.548+0000 7f1c44719800 10 monclient(hunting): authenticate will time out at 2441.185575s 2024-09-14T11:13:08.888 INFO:tasks.workunit.client.0.smithi050.stderr: -438> 2024-09-14T11:13:08.548+0000 7f1c4220a640 10 monclient(hunting): get_auth_request con 0x5605b3db0bd0 auth_method 0 2024-09-14T11:13:08.888 INFO:tasks.workunit.client.0.smithi050.stderr: -437> 2024-09-14T11:13:08.548+0000 7f1c4220a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:08.888 INFO:tasks.workunit.client.0.smithi050.stderr: -436> 2024-09-14T11:13:08.548+0000 7f1c4220a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:08.888 INFO:tasks.workunit.client.0.smithi050.stderr: -435> 2024-09-14T11:13:08.548+0000 7f1c4220a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:08.888 INFO:tasks.workunit.client.0.smithi050.stderr: -434> 2024-09-14T11:13:08.548+0000 7f1c42a0b640 10 monclient(hunting): get_auth_request con 0x5605b3ded250 auth_method 0 2024-09-14T11:13:08.888 INFO:tasks.workunit.client.0.smithi050.stderr: -433> 2024-09-14T11:13:08.548+0000 7f1c42a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:08.888 INFO:tasks.workunit.client.0.smithi050.stderr: -432> 2024-09-14T11:13:08.548+0000 7f1c42a0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:08.888 INFO:tasks.workunit.client.0.smithi050.stderr: -431> 2024-09-14T11:13:08.548+0000 7f1c42a0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:08.888 INFO:tasks.workunit.client.0.smithi050.stderr: -430> 2024-09-14T11:13:08.548+0000 7f1c41a09640 10 monclient(hunting): get_auth_request con 0x5605b3de6280 auth_method 0 2024-09-14T11:13:08.888 INFO:tasks.workunit.client.0.smithi050.stderr: -429> 2024-09-14T11:13:08.548+0000 7f1c41a09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:08.889 INFO:tasks.workunit.client.0.smithi050.stderr: -428> 2024-09-14T11:13:08.548+0000 7f1c41a09640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:08.889 INFO:tasks.workunit.client.0.smithi050.stderr: -427> 2024-09-14T11:13:08.548+0000 7f1c41a09640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:08.889 INFO:tasks.workunit.client.0.smithi050.stderr: -426> 2024-09-14T11:13:08.548+0000 7f1c42a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:08.889 INFO:tasks.workunit.client.0.smithi050.stderr: -425> 2024-09-14T11:13:08.548+0000 7f1c42a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:08.889 INFO:tasks.workunit.client.0.smithi050.stderr: -424> 2024-09-14T11:13:08.548+0000 7f1c42a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:08.889 INFO:tasks.workunit.client.0.smithi050.stderr: -423> 2024-09-14T11:13:08.548+0000 7f1c4220a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:08.889 INFO:tasks.workunit.client.0.smithi050.stderr: -422> 2024-09-14T11:13:08.548+0000 7f1c4220a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:08.889 INFO:tasks.workunit.client.0.smithi050.stderr: -421> 2024-09-14T11:13:08.548+0000 7f1c4220a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:08.889 INFO:tasks.workunit.client.0.smithi050.stderr: -420> 2024-09-14T11:13:08.548+0000 7f1c41a09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:08.889 INFO:tasks.workunit.client.0.smithi050.stderr: -419> 2024-09-14T11:13:08.548+0000 7f1c41a09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:08.889 INFO:tasks.workunit.client.0.smithi050.stderr: -418> 2024-09-14T11:13:08.548+0000 7f1c41a09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:08.889 INFO:tasks.workunit.client.0.smithi050.stderr: -417> 2024-09-14T11:13:08.548+0000 7f1c42a0b640 10 monclient(hunting): handle_auth_done global_id 7298 payload 824 2024-09-14T11:13:08.889 INFO:tasks.workunit.client.0.smithi050.stderr: -416> 2024-09-14T11:13:08.548+0000 7f1c42a0b640 10 monclient: _finish_hunting 0 2024-09-14T11:13:08.889 INFO:tasks.workunit.client.0.smithi050.stderr: -415> 2024-09-14T11:13:08.548+0000 7f1c42a0b640 1 monclient: found mon.noname-c 2024-09-14T11:13:08.890 INFO:tasks.workunit.client.0.smithi050.stderr: -414> 2024-09-14T11:13:08.548+0000 7f1c42a0b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:13:08.890 INFO:tasks.workunit.client.0.smithi050.stderr: -413> 2024-09-14T11:13:08.549+0000 7f1b2ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:08.890 INFO:tasks.workunit.client.0.smithi050.stderr: -412> 2024-09-14T11:13:08.549+0000 7f1b2ee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:13:08.890 INFO:tasks.workunit.client.0.smithi050.stderr: -411> 2024-09-14T11:13:08.549+0000 7f1b2ee05640 10 monclient: dump: 2024-09-14T11:13:08.890 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:08.890 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:08.890 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.890 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.890 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:08.890 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.890 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:08.890 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:08.890 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:08.890 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.891 INFO:tasks.workunit.client.0.smithi050.stderr: -410> 2024-09-14T11:13:08.549+0000 7f1b2ee05640 10 monclient: _finish_auth 0 2024-09-14T11:13:08.891 INFO:tasks.workunit.client.0.smithi050.stderr: -409> 2024-09-14T11:13:08.549+0000 7f1b2ee05640 10 monclient: _check_auth_tickets 2024-09-14T11:13:08.891 INFO:tasks.workunit.client.0.smithi050.stderr: -408> 2024-09-14T11:13:08.549+0000 7f1b2ee05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:08.891 INFO:tasks.workunit.client.0.smithi050.stderr: -407> 2024-09-14T11:13:08.549+0000 7f1b2ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:08.891 INFO:tasks.workunit.client.0.smithi050.stderr: -406> 2024-09-14T11:13:08.549+0000 7f1b2ee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:13:08.891 INFO:tasks.workunit.client.0.smithi050.stderr: -405> 2024-09-14T11:13:08.549+0000 7f1b2ee05640 10 monclient: dump: 2024-09-14T11:13:08.891 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:08.891 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:08.891 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.891 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.891 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:08.891 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.891 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:08.891 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:08.892 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:08.892 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.892 INFO:tasks.workunit.client.0.smithi050.stderr: -404> 2024-09-14T11:13:08.549+0000 7f1c44719800 5 monclient: authenticate success, global_id 7298 2024-09-14T11:13:08.892 INFO:tasks.workunit.client.0.smithi050.stderr: -403> 2024-09-14T11:13:08.549+0000 7f1c44719800 10 monclient: _renew_subs 2024-09-14T11:13:08.892 INFO:tasks.workunit.client.0.smithi050.stderr: -402> 2024-09-14T11:13:08.549+0000 7f1b30608640 4 set_mon_vals no callback set 2024-09-14T11:13:08.892 INFO:tasks.workunit.client.0.smithi050.stderr: -401> 2024-09-14T11:13:08.549+0000 7f1c44719800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:13:08.892 INFO:tasks.workunit.client.0.smithi050.stderr: -400> 2024-09-14T11:13:08.549+0000 7f1c44719800 10 monclient: _renew_subs 2024-09-14T11:13:08.892 INFO:tasks.workunit.client.0.smithi050.stderr: -399> 2024-09-14T11:13:08.549+0000 7f1c44719800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:13:08.892 INFO:tasks.workunit.client.0.smithi050.stderr: -398> 2024-09-14T11:13:08.549+0000 7f1c44719800 1 librados: init done 2024-09-14T11:13:08.892 INFO:tasks.workunit.client.0.smithi050.stderr: -397> 2024-09-14T11:13:08.551+0000 7f1b2ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:13:08.892 INFO:tasks.workunit.client.0.smithi050.stderr: -396> 2024-09-14T11:13:08.551+0000 7f1b2ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:13:08.892 INFO:tasks.workunit.client.0.smithi050.stderr: -395> 2024-09-14T11:13:08.551+0000 7f1b2ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:13:08.892 INFO:tasks.workunit.client.0.smithi050.stderr: -394> 2024-09-14T11:13:08.551+0000 7f1c4220a640 10 monclient: get_auth_request con 0x7f1b28077230 auth_method 0 2024-09-14T11:13:08.892 INFO:tasks.workunit.client.0.smithi050.stderr: -393> 2024-09-14T11:13:08.552+0000 7f1c41a09640 10 monclient: get_auth_request con 0x5605b3f61640 auth_method 0 2024-09-14T11:13:08.893 INFO:tasks.workunit.client.0.smithi050.stderr: -392> 2024-09-14T11:13:08.552+0000 7f1c4220a640 10 monclient: get_auth_request con 0x5605b3f84470 auth_method 0 2024-09-14T11:13:08.893 INFO:tasks.workunit.client.0.smithi050.stderr: -391> 2024-09-14T11:13:08.553+0000 7f1c41a09640 10 monclient: get_auth_request con 0x5605b3f888a0 auth_method 0 2024-09-14T11:13:08.893 INFO:tasks.workunit.client.0.smithi050.stderr: -390> 2024-09-14T11:13:08.554+0000 7f1c44719800 10 monclient: build_initial_monmap 2024-09-14T11:13:08.893 INFO:tasks.workunit.client.0.smithi050.stderr: -389> 2024-09-14T11:13:08.554+0000 7f1c44719800 1 build_initial for_mkfs: 0 2024-09-14T11:13:08.893 INFO:tasks.workunit.client.0.smithi050.stderr: -388> 2024-09-14T11:13:08.554+0000 7f1c44719800 10 monclient: monmap: 2024-09-14T11:13:08.893 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:13:08.893 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:13:08.893 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:13:08.893 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:13:08.893 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:13:08.893 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.893 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:13:08.893 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:13:08.893 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:13:08.894 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.894 INFO:tasks.workunit.client.0.smithi050.stderr: -387> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding auth protocol: cephx 2024-09-14T11:13:08.894 INFO:tasks.workunit.client.0.smithi050.stderr: -386> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding auth protocol: cephx 2024-09-14T11:13:08.894 INFO:tasks.workunit.client.0.smithi050.stderr: -385> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding auth protocol: cephx 2024-09-14T11:13:08.894 INFO:tasks.workunit.client.0.smithi050.stderr: -384> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding con mode: secure 2024-09-14T11:13:08.894 INFO:tasks.workunit.client.0.smithi050.stderr: -383> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding con mode: crc 2024-09-14T11:13:08.894 INFO:tasks.workunit.client.0.smithi050.stderr: -382> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding con mode: secure 2024-09-14T11:13:08.894 INFO:tasks.workunit.client.0.smithi050.stderr: -381> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding con mode: crc 2024-09-14T11:13:08.894 INFO:tasks.workunit.client.0.smithi050.stderr: -380> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding con mode: secure 2024-09-14T11:13:08.894 INFO:tasks.workunit.client.0.smithi050.stderr: -379> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding con mode: crc 2024-09-14T11:13:08.894 INFO:tasks.workunit.client.0.smithi050.stderr: -378> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding con mode: crc 2024-09-14T11:13:08.894 INFO:tasks.workunit.client.0.smithi050.stderr: -377> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding con mode: secure 2024-09-14T11:13:08.894 INFO:tasks.workunit.client.0.smithi050.stderr: -376> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding con mode: crc 2024-09-14T11:13:08.895 INFO:tasks.workunit.client.0.smithi050.stderr: -375> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding con mode: secure 2024-09-14T11:13:08.895 INFO:tasks.workunit.client.0.smithi050.stderr: -374> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding con mode: crc 2024-09-14T11:13:08.895 INFO:tasks.workunit.client.0.smithi050.stderr: -373> 2024-09-14T11:13:08.554+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8d760) adding con mode: secure 2024-09-14T11:13:08.895 INFO:tasks.workunit.client.0.smithi050.stderr: -372> 2024-09-14T11:13:08.554+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.895 INFO:tasks.workunit.client.0.smithi050.stderr: -371> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command objecter_requests cmddesc objecter_requests hook 0x5605b3f91130 EEXIST 2024-09-14T11:13:08.895 INFO:tasks.workunit.client.0.smithi050.stderr: -370> 2024-09-14T11:13:08.555+0000 7f1c44719800 10 monclient: init 2024-09-14T11:13:08.895 INFO:tasks.workunit.client.0.smithi050.stderr: -369> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding auth protocol: cephx 2024-09-14T11:13:08.895 INFO:tasks.workunit.client.0.smithi050.stderr: -368> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding auth protocol: cephx 2024-09-14T11:13:08.895 INFO:tasks.workunit.client.0.smithi050.stderr: -367> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding auth protocol: cephx 2024-09-14T11:13:08.895 INFO:tasks.workunit.client.0.smithi050.stderr: -366> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding con mode: secure 2024-09-14T11:13:08.895 INFO:tasks.workunit.client.0.smithi050.stderr: -365> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding con mode: crc 2024-09-14T11:13:08.895 INFO:tasks.workunit.client.0.smithi050.stderr: -364> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding con mode: secure 2024-09-14T11:13:08.895 INFO:tasks.workunit.client.0.smithi050.stderr: -363> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding con mode: crc 2024-09-14T11:13:08.895 INFO:tasks.workunit.client.0.smithi050.stderr: -362> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding con mode: secure 2024-09-14T11:13:08.896 INFO:tasks.workunit.client.0.smithi050.stderr: -361> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding con mode: crc 2024-09-14T11:13:08.896 INFO:tasks.workunit.client.0.smithi050.stderr: -360> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding con mode: crc 2024-09-14T11:13:08.896 INFO:tasks.workunit.client.0.smithi050.stderr: -359> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding con mode: secure 2024-09-14T11:13:08.896 INFO:tasks.workunit.client.0.smithi050.stderr: -358> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding con mode: crc 2024-09-14T11:13:08.896 INFO:tasks.workunit.client.0.smithi050.stderr: -357> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding con mode: secure 2024-09-14T11:13:08.896 INFO:tasks.workunit.client.0.smithi050.stderr: -356> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding con mode: crc 2024-09-14T11:13:08.896 INFO:tasks.workunit.client.0.smithi050.stderr: -355> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 AuthRegistry(0x5605b3f8be38) adding con mode: secure 2024-09-14T11:13:08.896 INFO:tasks.workunit.client.0.smithi050.stderr: -354> 2024-09-14T11:13:08.555+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.896 INFO:tasks.workunit.client.0.smithi050.stderr: -353> 2024-09-14T11:13:08.555+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.896 INFO:tasks.workunit.client.0.smithi050.stderr: -352> 2024-09-14T11:13:08.555+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command rotate-key cmddesc rotate-key hook 0x5605b3f8bf80 EEXIST 2024-09-14T11:13:08.896 INFO:tasks.workunit.client.0.smithi050.stderr: -351> 2024-09-14T11:13:08.555+0000 7f1c44719800 10 monclient: _reopen_session rank -1 2024-09-14T11:13:08.896 INFO:tasks.workunit.client.0.smithi050.stderr: -350> 2024-09-14T11:13:08.555+0000 7f1c44719800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:13:08.896 INFO:tasks.workunit.client.0.smithi050.stderr: -349> 2024-09-14T11:13:08.555+0000 7f1c44719800 10 monclient(hunting): picked mon.noname-c con 0x5605b3fb4e20 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:13:08.897 INFO:tasks.workunit.client.0.smithi050.stderr: -348> 2024-09-14T11:13:08.555+0000 7f1c44719800 10 monclient(hunting): picked mon.noname-a con 0x5605b3fb70f0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:13:08.897 INFO:tasks.workunit.client.0.smithi050.stderr: -347> 2024-09-14T11:13:08.555+0000 7f1c44719800 10 monclient(hunting): picked mon.noname-b con 0x5605b3fb35f0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:13:08.897 INFO:tasks.workunit.client.0.smithi050.stderr: -346> 2024-09-14T11:13:08.555+0000 7f1c44719800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:08.897 INFO:tasks.workunit.client.0.smithi050.stderr: -345> 2024-09-14T11:13:08.555+0000 7f1c44719800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:08.897 INFO:tasks.workunit.client.0.smithi050.stderr: -344> 2024-09-14T11:13:08.555+0000 7f1c44719800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:08.897 INFO:tasks.workunit.client.0.smithi050.stderr: -343> 2024-09-14T11:13:08.555+0000 7f1c44719800 10 monclient(hunting): _renew_subs 2024-09-14T11:13:08.897 INFO:tasks.workunit.client.0.smithi050.stderr: -342> 2024-09-14T11:13:08.555+0000 7f1c44719800 10 monclient(hunting): authenticate will time out at 2441.192803s 2024-09-14T11:13:08.897 INFO:tasks.workunit.client.0.smithi050.stderr: -341> 2024-09-14T11:13:08.555+0000 7f1c4220a640 10 monclient(hunting): get_auth_request con 0x5605b3fb4e20 auth_method 0 2024-09-14T11:13:08.897 INFO:tasks.workunit.client.0.smithi050.stderr: -340> 2024-09-14T11:13:08.555+0000 7f1c4220a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:08.897 INFO:tasks.workunit.client.0.smithi050.stderr: -339> 2024-09-14T11:13:08.555+0000 7f1c4220a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:08.897 INFO:tasks.workunit.client.0.smithi050.stderr: -338> 2024-09-14T11:13:08.555+0000 7f1c4220a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:08.897 INFO:tasks.workunit.client.0.smithi050.stderr: -337> 2024-09-14T11:13:08.555+0000 7f1c41a09640 10 monclient(hunting): get_auth_request con 0x5605b3fb70f0 auth_method 0 2024-09-14T11:13:08.897 INFO:tasks.workunit.client.0.smithi050.stderr: -336> 2024-09-14T11:13:08.555+0000 7f1c41a09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:08.897 INFO:tasks.workunit.client.0.smithi050.stderr: -335> 2024-09-14T11:13:08.555+0000 7f1c41a09640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:08.898 INFO:tasks.workunit.client.0.smithi050.stderr: -334> 2024-09-14T11:13:08.555+0000 7f1c41a09640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:08.898 INFO:tasks.workunit.client.0.smithi050.stderr: -333> 2024-09-14T11:13:08.555+0000 7f1c4220a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:08.898 INFO:tasks.workunit.client.0.smithi050.stderr: -332> 2024-09-14T11:13:08.555+0000 7f1c4220a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:08.898 INFO:tasks.workunit.client.0.smithi050.stderr: -331> 2024-09-14T11:13:08.556+0000 7f1c4220a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:08.898 INFO:tasks.workunit.client.0.smithi050.stderr: -330> 2024-09-14T11:13:08.556+0000 7f1c41a09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:08.898 INFO:tasks.workunit.client.0.smithi050.stderr: -329> 2024-09-14T11:13:08.556+0000 7f1c41a09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:08.898 INFO:tasks.workunit.client.0.smithi050.stderr: -328> 2024-09-14T11:13:08.556+0000 7f1c41a09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:08.898 INFO:tasks.workunit.client.0.smithi050.stderr: -327> 2024-09-14T11:13:08.556+0000 7f1c42a0b640 10 monclient(hunting): get_auth_request con 0x5605b3fb35f0 auth_method 0 2024-09-14T11:13:08.898 INFO:tasks.workunit.client.0.smithi050.stderr: -326> 2024-09-14T11:13:08.556+0000 7f1c42a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:08.898 INFO:tasks.workunit.client.0.smithi050.stderr: -325> 2024-09-14T11:13:08.556+0000 7f1c42a0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:08.898 INFO:tasks.workunit.client.0.smithi050.stderr: -324> 2024-09-14T11:13:08.556+0000 7f1c42a0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:08.898 INFO:tasks.workunit.client.0.smithi050.stderr: -323> 2024-09-14T11:13:08.556+0000 7f1c42a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:08.898 INFO:tasks.workunit.client.0.smithi050.stderr: -322> 2024-09-14T11:13:08.556+0000 7f1c42a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:08.898 INFO:tasks.workunit.client.0.smithi050.stderr: -321> 2024-09-14T11:13:08.556+0000 7f1c42a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:08.899 INFO:tasks.workunit.client.0.smithi050.stderr: -320> 2024-09-14T11:13:08.556+0000 7f1c4220a640 10 monclient(hunting): handle_auth_done global_id 7301 payload 824 2024-09-14T11:13:08.899 INFO:tasks.workunit.client.0.smithi050.stderr: -319> 2024-09-14T11:13:08.556+0000 7f1c4220a640 10 monclient: _finish_hunting 0 2024-09-14T11:13:08.899 INFO:tasks.workunit.client.0.smithi050.stderr: -318> 2024-09-14T11:13:08.556+0000 7f1c4220a640 1 monclient: found mon.noname-c 2024-09-14T11:13:08.899 INFO:tasks.workunit.client.0.smithi050.stderr: -317> 2024-09-14T11:13:08.556+0000 7f1c4220a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:13:08.899 INFO:tasks.workunit.client.0.smithi050.stderr: -316> 2024-09-14T11:13:08.556+0000 7f1b27fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:08.899 INFO:tasks.workunit.client.0.smithi050.stderr: -315> 2024-09-14T11:13:08.556+0000 7f1b27fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:13:08.899 INFO:tasks.workunit.client.0.smithi050.stderr: -314> 2024-09-14T11:13:08.556+0000 7f1b27fff640 10 monclient: dump: 2024-09-14T11:13:08.899 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:08.899 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:08.900 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.900 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.900 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:08.900 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.900 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:08.900 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:08.900 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:08.900 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.900 INFO:tasks.workunit.client.0.smithi050.stderr: -313> 2024-09-14T11:13:08.556+0000 7f1b27fff640 10 monclient: _finish_auth 0 2024-09-14T11:13:08.900 INFO:tasks.workunit.client.0.smithi050.stderr: -312> 2024-09-14T11:13:08.556+0000 7f1b27fff640 10 monclient: _check_auth_tickets 2024-09-14T11:13:08.900 INFO:tasks.workunit.client.0.smithi050.stderr: -311> 2024-09-14T11:13:08.556+0000 7f1b27fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:08.900 INFO:tasks.workunit.client.0.smithi050.stderr: -310> 2024-09-14T11:13:08.556+0000 7f1b27fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:08.900 INFO:tasks.workunit.client.0.smithi050.stderr: -309> 2024-09-14T11:13:08.556+0000 7f1b27fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:13:08.901 INFO:tasks.workunit.client.0.smithi050.stderr: -308> 2024-09-14T11:13:08.556+0000 7f1b27fff640 10 monclient: dump: 2024-09-14T11:13:08.901 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:08.901 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:08.901 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.901 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.901 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:08.901 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.901 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:08.901 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:08.901 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:08.901 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.901 INFO:tasks.workunit.client.0.smithi050.stderr: -307> 2024-09-14T11:13:08.556+0000 7f1c44719800 5 monclient: authenticate success, global_id 7301 2024-09-14T11:13:08.901 INFO:tasks.workunit.client.0.smithi050.stderr: -306> 2024-09-14T11:13:08.556+0000 7f1c44719800 10 monclient: _renew_subs 2024-09-14T11:13:08.901 INFO:tasks.workunit.client.0.smithi050.stderr: -305> 2024-09-14T11:13:08.556+0000 7f1c44719800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:13:08.902 INFO:tasks.workunit.client.0.smithi050.stderr: -304> 2024-09-14T11:13:08.556+0000 7f1c4320c640 4 set_mon_vals no callback set 2024-09-14T11:13:08.902 INFO:tasks.workunit.client.0.smithi050.stderr: -303> 2024-09-14T11:13:08.556+0000 7f1c44719800 10 monclient: _renew_subs 2024-09-14T11:13:08.902 INFO:tasks.workunit.client.0.smithi050.stderr: -302> 2024-09-14T11:13:08.556+0000 7f1c44719800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:13:08.902 INFO:tasks.workunit.client.0.smithi050.stderr: -301> 2024-09-14T11:13:08.558+0000 7f1b27fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:13:08.902 INFO:tasks.workunit.client.0.smithi050.stderr: -300> 2024-09-14T11:13:08.558+0000 7f1b27fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:13:08.902 INFO:tasks.workunit.client.0.smithi050.stderr: -299> 2024-09-14T11:13:08.558+0000 7f1b27fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:13:08.902 INFO:tasks.workunit.client.0.smithi050.stderr: -298> 2024-09-14T11:13:08.558+0000 7f1c41a09640 10 monclient: get_auth_request con 0x7f1b1c077140 auth_method 0 2024-09-14T11:13:08.902 INFO:tasks.workunit.client.0.smithi050.stderr: -297> 2024-09-14T11:13:08.558+0000 7f1c44719800 10 monclient: get_monmap_and_config 2024-09-14T11:13:08.902 INFO:tasks.workunit.client.0.smithi050.stderr: -296> 2024-09-14T11:13:08.558+0000 7f1c44719800 10 monclient: build_initial_monmap 2024-09-14T11:13:08.902 INFO:tasks.workunit.client.0.smithi050.stderr: -295> 2024-09-14T11:13:08.558+0000 7f1c44719800 1 build_initial for_mkfs: 0 2024-09-14T11:13:08.902 INFO:tasks.workunit.client.0.smithi050.stderr: -294> 2024-09-14T11:13:08.558+0000 7f1c44719800 10 monclient: monmap: 2024-09-14T11:13:08.902 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:13:08.902 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:13:08.902 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:13:08.903 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:13:08.903 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:13:08.903 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.903 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:13:08.903 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:13:08.903 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:13:08.903 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.903 INFO:tasks.workunit.client.0.smithi050.stderr: -293> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding auth protocol: cephx 2024-09-14T11:13:08.903 INFO:tasks.workunit.client.0.smithi050.stderr: -292> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding auth protocol: cephx 2024-09-14T11:13:08.903 INFO:tasks.workunit.client.0.smithi050.stderr: -291> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding auth protocol: cephx 2024-09-14T11:13:08.903 INFO:tasks.workunit.client.0.smithi050.stderr: -290> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding con mode: secure 2024-09-14T11:13:08.903 INFO:tasks.workunit.client.0.smithi050.stderr: -289> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding con mode: crc 2024-09-14T11:13:08.903 INFO:tasks.workunit.client.0.smithi050.stderr: -288> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding con mode: secure 2024-09-14T11:13:08.904 INFO:tasks.workunit.client.0.smithi050.stderr: -287> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding con mode: crc 2024-09-14T11:13:08.904 INFO:tasks.workunit.client.0.smithi050.stderr: -286> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding con mode: secure 2024-09-14T11:13:08.904 INFO:tasks.workunit.client.0.smithi050.stderr: -285> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding con mode: crc 2024-09-14T11:13:08.904 INFO:tasks.workunit.client.0.smithi050.stderr: -284> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding con mode: crc 2024-09-14T11:13:08.904 INFO:tasks.workunit.client.0.smithi050.stderr: -283> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding con mode: secure 2024-09-14T11:13:08.904 INFO:tasks.workunit.client.0.smithi050.stderr: -282> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding con mode: crc 2024-09-14T11:13:08.904 INFO:tasks.workunit.client.0.smithi050.stderr: -281> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding con mode: secure 2024-09-14T11:13:08.904 INFO:tasks.workunit.client.0.smithi050.stderr: -280> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding con mode: crc 2024-09-14T11:13:08.904 INFO:tasks.workunit.client.0.smithi050.stderr: -279> 2024-09-14T11:13:08.558+0000 7f1c44719800 5 AuthRegistry(0x5605b3fd49b0) adding con mode: secure 2024-09-14T11:13:08.904 INFO:tasks.workunit.client.0.smithi050.stderr: -278> 2024-09-14T11:13:08.559+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.904 INFO:tasks.workunit.client.0.smithi050.stderr: -277> 2024-09-14T11:13:08.559+0000 7f1c44719800 10 monclient: init 2024-09-14T11:13:08.904 INFO:tasks.workunit.client.0.smithi050.stderr: -276> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding auth protocol: cephx 2024-09-14T11:13:08.904 INFO:tasks.workunit.client.0.smithi050.stderr: -275> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding auth protocol: cephx 2024-09-14T11:13:08.904 INFO:tasks.workunit.client.0.smithi050.stderr: -274> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding auth protocol: cephx 2024-09-14T11:13:08.905 INFO:tasks.workunit.client.0.smithi050.stderr: -273> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding con mode: secure 2024-09-14T11:13:08.905 INFO:tasks.workunit.client.0.smithi050.stderr: -272> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding con mode: crc 2024-09-14T11:13:08.905 INFO:tasks.workunit.client.0.smithi050.stderr: -271> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding con mode: secure 2024-09-14T11:13:08.905 INFO:tasks.workunit.client.0.smithi050.stderr: -270> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding con mode: crc 2024-09-14T11:13:08.905 INFO:tasks.workunit.client.0.smithi050.stderr: -269> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding con mode: secure 2024-09-14T11:13:08.905 INFO:tasks.workunit.client.0.smithi050.stderr: -268> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding con mode: crc 2024-09-14T11:13:08.905 INFO:tasks.workunit.client.0.smithi050.stderr: -267> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding con mode: crc 2024-09-14T11:13:08.905 INFO:tasks.workunit.client.0.smithi050.stderr: -266> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding con mode: secure 2024-09-14T11:13:08.905 INFO:tasks.workunit.client.0.smithi050.stderr: -265> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding con mode: crc 2024-09-14T11:13:08.905 INFO:tasks.workunit.client.0.smithi050.stderr: -264> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding con mode: secure 2024-09-14T11:13:08.905 INFO:tasks.workunit.client.0.smithi050.stderr: -263> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding con mode: crc 2024-09-14T11:13:08.905 INFO:tasks.workunit.client.0.smithi050.stderr: -262> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64cb40) adding con mode: secure 2024-09-14T11:13:08.905 INFO:tasks.workunit.client.0.smithi050.stderr: -261> 2024-09-14T11:13:08.559+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.905 INFO:tasks.workunit.client.0.smithi050.stderr: -260> 2024-09-14T11:13:08.559+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.906 INFO:tasks.workunit.client.0.smithi050.stderr: -259> 2024-09-14T11:13:08.559+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command rotate-key cmddesc rotate-key hook 0x7ffe4e64cc88 EEXIST 2024-09-14T11:13:08.906 INFO:tasks.workunit.client.0.smithi050.stderr: -258> 2024-09-14T11:13:08.559+0000 7f1c44719800 10 monclient: _reopen_session rank -1 2024-09-14T11:13:08.906 INFO:tasks.workunit.client.0.smithi050.stderr: -257> 2024-09-14T11:13:08.559+0000 7f1c44719800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:13:08.906 INFO:tasks.workunit.client.0.smithi050.stderr: -256> 2024-09-14T11:13:08.559+0000 7f1c44719800 10 monclient(hunting): picked mon.noname-b con 0x5605b4009000 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:13:08.906 INFO:tasks.workunit.client.0.smithi050.stderr: -255> 2024-09-14T11:13:08.559+0000 7f1c44719800 10 monclient(hunting): picked mon.noname-c con 0x5605b3fd9f50 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:13:08.906 INFO:tasks.workunit.client.0.smithi050.stderr: -254> 2024-09-14T11:13:08.559+0000 7f1c44719800 10 monclient(hunting): picked mon.noname-a con 0x5605b40048a0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:13:08.906 INFO:tasks.workunit.client.0.smithi050.stderr: -253> 2024-09-14T11:13:08.559+0000 7f1c44719800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:08.906 INFO:tasks.workunit.client.0.smithi050.stderr: -252> 2024-09-14T11:13:08.559+0000 7f1c44719800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:08.906 INFO:tasks.workunit.client.0.smithi050.stderr: -251> 2024-09-14T11:13:08.559+0000 7f1c44719800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:08.906 INFO:tasks.workunit.client.0.smithi050.stderr: -250> 2024-09-14T11:13:08.559+0000 7f1c44719800 10 monclient(hunting): _renew_subs 2024-09-14T11:13:08.906 INFO:tasks.workunit.client.0.smithi050.stderr: -249> 2024-09-14T11:13:08.559+0000 7f1c44719800 10 monclient(hunting): authenticate will time out at 2441.196866s 2024-09-14T11:13:08.906 INFO:tasks.workunit.client.0.smithi050.stderr: -248> 2024-09-14T11:13:08.559+0000 7f1c41a09640 10 monclient(hunting): get_auth_request con 0x5605b3fd9f50 auth_method 0 2024-09-14T11:13:08.906 INFO:tasks.workunit.client.0.smithi050.stderr: -247> 2024-09-14T11:13:08.559+0000 7f1c41a09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:08.906 INFO:tasks.workunit.client.0.smithi050.stderr: -246> 2024-09-14T11:13:08.559+0000 7f1c41a09640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:08.907 INFO:tasks.workunit.client.0.smithi050.stderr: -245> 2024-09-14T11:13:08.559+0000 7f1c41a09640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:08.907 INFO:tasks.workunit.client.0.smithi050.stderr: -244> 2024-09-14T11:13:08.560+0000 7f1c42a0b640 10 monclient(hunting): get_auth_request con 0x5605b40048a0 auth_method 0 2024-09-14T11:13:08.907 INFO:tasks.workunit.client.0.smithi050.stderr: -243> 2024-09-14T11:13:08.560+0000 7f1c42a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:08.907 INFO:tasks.workunit.client.0.smithi050.stderr: -242> 2024-09-14T11:13:08.560+0000 7f1c42a0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:08.907 INFO:tasks.workunit.client.0.smithi050.stderr: -241> 2024-09-14T11:13:08.560+0000 7f1c42a0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:08.907 INFO:tasks.workunit.client.0.smithi050.stderr: -240> 2024-09-14T11:13:08.560+0000 7f1c4220a640 10 monclient(hunting): get_auth_request con 0x5605b4009000 auth_method 0 2024-09-14T11:13:08.907 INFO:tasks.workunit.client.0.smithi050.stderr: -239> 2024-09-14T11:13:08.560+0000 7f1c4220a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:08.907 INFO:tasks.workunit.client.0.smithi050.stderr: -238> 2024-09-14T11:13:08.560+0000 7f1c4220a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:08.907 INFO:tasks.workunit.client.0.smithi050.stderr: -237> 2024-09-14T11:13:08.560+0000 7f1c4220a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:08.907 INFO:tasks.workunit.client.0.smithi050.stderr: -236> 2024-09-14T11:13:08.560+0000 7f1c41a09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:08.907 INFO:tasks.workunit.client.0.smithi050.stderr: -235> 2024-09-14T11:13:08.560+0000 7f1c41a09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:08.907 INFO:tasks.workunit.client.0.smithi050.stderr: -234> 2024-09-14T11:13:08.560+0000 7f1c41a09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:08.907 INFO:tasks.workunit.client.0.smithi050.stderr: -233> 2024-09-14T11:13:08.560+0000 7f1c42a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:08.908 INFO:tasks.workunit.client.0.smithi050.stderr: -232> 2024-09-14T11:13:08.560+0000 7f1c42a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:08.908 INFO:tasks.workunit.client.0.smithi050.stderr: -231> 2024-09-14T11:13:08.560+0000 7f1c42a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:08.908 INFO:tasks.workunit.client.0.smithi050.stderr: -230> 2024-09-14T11:13:08.560+0000 7f1c4220a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:08.908 INFO:tasks.workunit.client.0.smithi050.stderr: -229> 2024-09-14T11:13:08.560+0000 7f1c4220a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:08.908 INFO:tasks.workunit.client.0.smithi050.stderr: -228> 2024-09-14T11:13:08.560+0000 7f1c4220a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:08.908 INFO:tasks.workunit.client.0.smithi050.stderr: -227> 2024-09-14T11:13:08.560+0000 7f1c41a09640 10 monclient(hunting): handle_auth_done global_id 7304 payload 274 2024-09-14T11:13:08.908 INFO:tasks.workunit.client.0.smithi050.stderr: -226> 2024-09-14T11:13:08.560+0000 7f1c41a09640 10 monclient: _finish_hunting 0 2024-09-14T11:13:08.908 INFO:tasks.workunit.client.0.smithi050.stderr: -225> 2024-09-14T11:13:08.560+0000 7f1c41a09640 1 monclient: found mon.noname-c 2024-09-14T11:13:08.908 INFO:tasks.workunit.client.0.smithi050.stderr: -224> 2024-09-14T11:13:08.560+0000 7f1c41a09640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:13:08.908 INFO:tasks.workunit.client.0.smithi050.stderr: -223> 2024-09-14T11:13:08.560+0000 7f1b25ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:08.908 INFO:tasks.workunit.client.0.smithi050.stderr: -222> 2024-09-14T11:13:08.560+0000 7f1b25ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:13:08.908 INFO:tasks.workunit.client.0.smithi050.stderr: -221> 2024-09-14T11:13:08.560+0000 7f1b25ffb640 10 monclient: dump: 2024-09-14T11:13:08.908 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:08.909 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:08.909 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.909 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.909 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:08.909 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.909 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:08.909 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:08.909 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:08.909 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.909 INFO:tasks.workunit.client.0.smithi050.stderr: -220> 2024-09-14T11:13:08.560+0000 7f1b25ffb640 10 monclient: _finish_auth 0 2024-09-14T11:13:08.909 INFO:tasks.workunit.client.0.smithi050.stderr: -219> 2024-09-14T11:13:08.560+0000 7f1b25ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:13:08.909 INFO:tasks.workunit.client.0.smithi050.stderr: -218> 2024-09-14T11:13:08.560+0000 7f1b25ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:08.909 INFO:tasks.workunit.client.0.smithi050.stderr: -217> 2024-09-14T11:13:08.560+0000 7f1b25ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:08.909 INFO:tasks.workunit.client.0.smithi050.stderr: -216> 2024-09-14T11:13:08.560+0000 7f1b25ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:13:08.910 INFO:tasks.workunit.client.0.smithi050.stderr: -215> 2024-09-14T11:13:08.560+0000 7f1b25ffb640 10 monclient: dump: 2024-09-14T11:13:08.910 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:08.910 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:08.910 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.910 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.910 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:08.910 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.910 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:08.910 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:08.910 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:08.910 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.910 INFO:tasks.workunit.client.0.smithi050.stderr: -214> 2024-09-14T11:13:08.560+0000 7f1c44719800 5 monclient: authenticate success, global_id 7304 2024-09-14T11:13:08.910 INFO:tasks.workunit.client.0.smithi050.stderr: -213> 2024-09-14T11:13:08.560+0000 7f1c44719800 10 monclient: get_monmap_and_config success 2024-09-14T11:13:08.910 INFO:tasks.workunit.client.0.smithi050.stderr: -212> 2024-09-14T11:13:08.560+0000 7f1c44719800 4 set_mon_vals no callback set 2024-09-14T11:13:08.910 INFO:tasks.workunit.client.0.smithi050.stderr: -211> 2024-09-14T11:13:08.561+0000 7f1c44719800 10 monclient: shutdown 2024-09-14T11:13:08.911 INFO:tasks.workunit.client.0.smithi050.stderr: -210> 2024-09-14T11:13:08.561+0000 7f1c44719800 10 monclient: build_initial_monmap 2024-09-14T11:13:08.911 INFO:tasks.workunit.client.0.smithi050.stderr: -209> 2024-09-14T11:13:08.561+0000 7f1c44719800 1 build_initial for_mkfs: 0 2024-09-14T11:13:08.911 INFO:tasks.workunit.client.0.smithi050.stderr: -208> 2024-09-14T11:13:08.561+0000 7f1c44719800 10 monclient: monmap: 2024-09-14T11:13:08.911 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:13:08.911 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:13:08.911 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:13:08.911 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:13:08.911 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:13:08.911 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.911 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:13:08.911 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:13:08.911 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:13:08.911 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.911 INFO:tasks.workunit.client.0.smithi050.stderr: -207> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding auth protocol: cephx 2024-09-14T11:13:08.912 INFO:tasks.workunit.client.0.smithi050.stderr: -206> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding auth protocol: cephx 2024-09-14T11:13:08.912 INFO:tasks.workunit.client.0.smithi050.stderr: -205> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding auth protocol: cephx 2024-09-14T11:13:08.912 INFO:tasks.workunit.client.0.smithi050.stderr: -204> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding con mode: secure 2024-09-14T11:13:08.912 INFO:tasks.workunit.client.0.smithi050.stderr: -203> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding con mode: crc 2024-09-14T11:13:08.912 INFO:tasks.workunit.client.0.smithi050.stderr: -202> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding con mode: secure 2024-09-14T11:13:08.912 INFO:tasks.workunit.client.0.smithi050.stderr: -201> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding con mode: crc 2024-09-14T11:13:08.912 INFO:tasks.workunit.client.0.smithi050.stderr: -200> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding con mode: secure 2024-09-14T11:13:08.912 INFO:tasks.workunit.client.0.smithi050.stderr: -199> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding con mode: crc 2024-09-14T11:13:08.912 INFO:tasks.workunit.client.0.smithi050.stderr: -198> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding con mode: crc 2024-09-14T11:13:08.912 INFO:tasks.workunit.client.0.smithi050.stderr: -197> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding con mode: secure 2024-09-14T11:13:08.912 INFO:tasks.workunit.client.0.smithi050.stderr: -196> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding con mode: crc 2024-09-14T11:13:08.912 INFO:tasks.workunit.client.0.smithi050.stderr: -195> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding con mode: secure 2024-09-14T11:13:08.912 INFO:tasks.workunit.client.0.smithi050.stderr: -194> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding con mode: crc 2024-09-14T11:13:08.913 INFO:tasks.workunit.client.0.smithi050.stderr: -193> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3ffb4d0) adding con mode: secure 2024-09-14T11:13:08.913 INFO:tasks.workunit.client.0.smithi050.stderr: -192> 2024-09-14T11:13:08.561+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.913 INFO:tasks.workunit.client.0.smithi050.stderr: -191> 2024-09-14T11:13:08.561+0000 7f1c44719800 1 librados: starting msgr at 2024-09-14T11:13:08.913 INFO:tasks.workunit.client.0.smithi050.stderr: -190> 2024-09-14T11:13:08.561+0000 7f1c44719800 1 librados: starting objecter 2024-09-14T11:13:08.913 INFO:tasks.workunit.client.0.smithi050.stderr: -189> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command objecter_requests cmddesc objecter_requests hook 0x5605b3fd7f10 EEXIST 2024-09-14T11:13:08.913 INFO:tasks.workunit.client.0.smithi050.stderr: -188> 2024-09-14T11:13:08.561+0000 7f1c44719800 1 librados: setting wanted keys 2024-09-14T11:13:08.913 INFO:tasks.workunit.client.0.smithi050.stderr: -187> 2024-09-14T11:13:08.561+0000 7f1c44719800 1 librados: calling monclient init 2024-09-14T11:13:08.913 INFO:tasks.workunit.client.0.smithi050.stderr: -186> 2024-09-14T11:13:08.561+0000 7f1c44719800 10 monclient: init 2024-09-14T11:13:08.913 INFO:tasks.workunit.client.0.smithi050.stderr: -185> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding auth protocol: cephx 2024-09-14T11:13:08.913 INFO:tasks.workunit.client.0.smithi050.stderr: -184> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding auth protocol: cephx 2024-09-14T11:13:08.913 INFO:tasks.workunit.client.0.smithi050.stderr: -183> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding auth protocol: cephx 2024-09-14T11:13:08.913 INFO:tasks.workunit.client.0.smithi050.stderr: -182> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding con mode: secure 2024-09-14T11:13:08.913 INFO:tasks.workunit.client.0.smithi050.stderr: -181> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding con mode: crc 2024-09-14T11:13:08.913 INFO:tasks.workunit.client.0.smithi050.stderr: -180> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding con mode: secure 2024-09-14T11:13:08.914 INFO:tasks.workunit.client.0.smithi050.stderr: -179> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding con mode: crc 2024-09-14T11:13:08.914 INFO:tasks.workunit.client.0.smithi050.stderr: -178> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding con mode: secure 2024-09-14T11:13:08.914 INFO:tasks.workunit.client.0.smithi050.stderr: -177> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding con mode: crc 2024-09-14T11:13:08.914 INFO:tasks.workunit.client.0.smithi050.stderr: -176> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding con mode: crc 2024-09-14T11:13:08.914 INFO:tasks.workunit.client.0.smithi050.stderr: -175> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding con mode: secure 2024-09-14T11:13:08.914 INFO:tasks.workunit.client.0.smithi050.stderr: -174> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding con mode: crc 2024-09-14T11:13:08.914 INFO:tasks.workunit.client.0.smithi050.stderr: -173> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding con mode: secure 2024-09-14T11:13:08.914 INFO:tasks.workunit.client.0.smithi050.stderr: -172> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding con mode: crc 2024-09-14T11:13:08.914 INFO:tasks.workunit.client.0.smithi050.stderr: -171> 2024-09-14T11:13:08.561+0000 7f1c44719800 5 AuthRegistry(0x5605b3fccbd0) adding con mode: secure 2024-09-14T11:13:08.914 INFO:tasks.workunit.client.0.smithi050.stderr: -170> 2024-09-14T11:13:08.562+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.914 INFO:tasks.workunit.client.0.smithi050.stderr: -169> 2024-09-14T11:13:08.562+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.914 INFO:tasks.workunit.client.0.smithi050.stderr: -168> 2024-09-14T11:13:08.562+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command rotate-key cmddesc rotate-key hook 0x5605b3fccd18 EEXIST 2024-09-14T11:13:08.914 INFO:tasks.workunit.client.0.smithi050.stderr: -167> 2024-09-14T11:13:08.562+0000 7f1c44719800 10 monclient: _reopen_session rank -1 2024-09-14T11:13:08.914 INFO:tasks.workunit.client.0.smithi050.stderr: -166> 2024-09-14T11:13:08.562+0000 7f1c44719800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:13:08.915 INFO:tasks.workunit.client.0.smithi050.stderr: -165> 2024-09-14T11:13:08.562+0000 7f1c44719800 10 monclient(hunting): picked mon.noname-b con 0x5605b3fd9f50 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:13:08.915 INFO:tasks.workunit.client.0.smithi050.stderr: -164> 2024-09-14T11:13:08.562+0000 7f1c44719800 10 monclient(hunting): picked mon.noname-a con 0x5605b40048a0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:13:08.915 INFO:tasks.workunit.client.0.smithi050.stderr: -163> 2024-09-14T11:13:08.562+0000 7f1c44719800 10 monclient(hunting): picked mon.noname-c con 0x5605b4009000 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:13:08.915 INFO:tasks.workunit.client.0.smithi050.stderr: -162> 2024-09-14T11:13:08.562+0000 7f1c44719800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:08.915 INFO:tasks.workunit.client.0.smithi050.stderr: -161> 2024-09-14T11:13:08.562+0000 7f1c44719800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:08.915 INFO:tasks.workunit.client.0.smithi050.stderr: -160> 2024-09-14T11:13:08.562+0000 7f1c44719800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:08.915 INFO:tasks.workunit.client.0.smithi050.stderr: -159> 2024-09-14T11:13:08.562+0000 7f1c44719800 10 monclient(hunting): _renew_subs 2024-09-14T11:13:08.915 INFO:tasks.workunit.client.0.smithi050.stderr: -158> 2024-09-14T11:13:08.562+0000 7f1c44719800 10 monclient(hunting): authenticate will time out at 2441.199352s 2024-09-14T11:13:08.915 INFO:tasks.workunit.client.0.smithi050.stderr: -157> 2024-09-14T11:13:08.562+0000 7f1c41a09640 10 monclient(hunting): get_auth_request con 0x5605b40048a0 auth_method 0 2024-09-14T11:13:08.915 INFO:tasks.workunit.client.0.smithi050.stderr: -156> 2024-09-14T11:13:08.562+0000 7f1c41a09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:08.915 INFO:tasks.workunit.client.0.smithi050.stderr: -155> 2024-09-14T11:13:08.562+0000 7f1c41a09640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:08.915 INFO:tasks.workunit.client.0.smithi050.stderr: -154> 2024-09-14T11:13:08.562+0000 7f1c41a09640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:08.915 INFO:tasks.workunit.client.0.smithi050.stderr: -153> 2024-09-14T11:13:08.562+0000 7f1c41a09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:08.915 INFO:tasks.workunit.client.0.smithi050.stderr: -152> 2024-09-14T11:13:08.562+0000 7f1c41a09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:08.916 INFO:tasks.workunit.client.0.smithi050.stderr: -151> 2024-09-14T11:13:08.562+0000 7f1c41a09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:08.916 INFO:tasks.workunit.client.0.smithi050.stderr: -150> 2024-09-14T11:13:08.562+0000 7f1c4220a640 10 monclient(hunting): get_auth_request con 0x5605b3fd9f50 auth_method 0 2024-09-14T11:13:08.916 INFO:tasks.workunit.client.0.smithi050.stderr: -149> 2024-09-14T11:13:08.562+0000 7f1c4220a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:08.916 INFO:tasks.workunit.client.0.smithi050.stderr: -148> 2024-09-14T11:13:08.562+0000 7f1c4220a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:08.916 INFO:tasks.workunit.client.0.smithi050.stderr: -147> 2024-09-14T11:13:08.562+0000 7f1c4220a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:08.916 INFO:tasks.workunit.client.0.smithi050.stderr: -146> 2024-09-14T11:13:08.562+0000 7f1c41a09640 10 monclient(hunting): handle_auth_done global_id 7806 payload 824 2024-09-14T11:13:08.916 INFO:tasks.workunit.client.0.smithi050.stderr: -145> 2024-09-14T11:13:08.562+0000 7f1c41a09640 10 monclient: _finish_hunting 0 2024-09-14T11:13:08.916 INFO:tasks.workunit.client.0.smithi050.stderr: -144> 2024-09-14T11:13:08.562+0000 7f1c41a09640 1 monclient: found mon.noname-a 2024-09-14T11:13:08.916 INFO:tasks.workunit.client.0.smithi050.stderr: -143> 2024-09-14T11:13:08.562+0000 7f1c41a09640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:13:08.916 INFO:tasks.workunit.client.0.smithi050.stderr: -142> 2024-09-14T11:13:08.562+0000 7f1b13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:08.916 INFO:tasks.workunit.client.0.smithi050.stderr: -141> 2024-09-14T11:13:08.563+0000 7f1b13fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:13:08.916 INFO:tasks.workunit.client.0.smithi050.stderr: -140> 2024-09-14T11:13:08.563+0000 7f1b13fff640 10 monclient: dump: 2024-09-14T11:13:08.916 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:08.916 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:08.917 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.917 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.917 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:08.917 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.917 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:08.917 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:08.917 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:08.917 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.917 INFO:tasks.workunit.client.0.smithi050.stderr: -139> 2024-09-14T11:13:08.563+0000 7f1b13fff640 10 monclient: _finish_auth 0 2024-09-14T11:13:08.917 INFO:tasks.workunit.client.0.smithi050.stderr: -138> 2024-09-14T11:13:08.563+0000 7f1b13fff640 10 monclient: _check_auth_tickets 2024-09-14T11:13:08.917 INFO:tasks.workunit.client.0.smithi050.stderr: -137> 2024-09-14T11:13:08.563+0000 7f1b13fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:08.917 INFO:tasks.workunit.client.0.smithi050.stderr: -136> 2024-09-14T11:13:08.563+0000 7f1b13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:08.917 INFO:tasks.workunit.client.0.smithi050.stderr: -135> 2024-09-14T11:13:08.563+0000 7f1b13fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:13:08.918 INFO:tasks.workunit.client.0.smithi050.stderr: -134> 2024-09-14T11:13:08.563+0000 7f1b13fff640 10 monclient: dump: 2024-09-14T11:13:08.918 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:08.918 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:08.918 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.918 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:08.918 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:08.918 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:08.918 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:08.918 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:08.918 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:08.918 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.918 INFO:tasks.workunit.client.0.smithi050.stderr: -133> 2024-09-14T11:13:08.563+0000 7f1b25ffb640 4 set_mon_vals no callback set 2024-09-14T11:13:08.918 INFO:tasks.workunit.client.0.smithi050.stderr: -132> 2024-09-14T11:13:08.563+0000 7f1c44719800 5 monclient: authenticate success, global_id 7806 2024-09-14T11:13:08.918 INFO:tasks.workunit.client.0.smithi050.stderr: -131> 2024-09-14T11:13:08.563+0000 7f1c44719800 10 monclient: _renew_subs 2024-09-14T11:13:08.919 INFO:tasks.workunit.client.0.smithi050.stderr: -130> 2024-09-14T11:13:08.563+0000 7f1c44719800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:13:08.919 INFO:tasks.workunit.client.0.smithi050.stderr: -129> 2024-09-14T11:13:08.563+0000 7f1c44719800 10 monclient: _renew_subs 2024-09-14T11:13:08.919 INFO:tasks.workunit.client.0.smithi050.stderr: -128> 2024-09-14T11:13:08.563+0000 7f1c44719800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:13:08.919 INFO:tasks.workunit.client.0.smithi050.stderr: -127> 2024-09-14T11:13:08.563+0000 7f1c44719800 1 librados: init done 2024-09-14T11:13:08.919 INFO:tasks.workunit.client.0.smithi050.stderr: -126> 2024-09-14T11:13:08.563+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command cr dump hook 0x5605b3ffc708 2024-09-14T11:13:08.919 INFO:tasks.workunit.client.0.smithi050.stderr: -125> 2024-09-14T11:13:08.564+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.919 INFO:tasks.workunit.client.0.smithi050.stderr: -124> 2024-09-14T11:13:08.565+0000 7f1b13fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:13:08.919 INFO:tasks.workunit.client.0.smithi050.stderr: -123> 2024-09-14T11:13:08.565+0000 7f1b13fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:13:08.919 INFO:tasks.workunit.client.0.smithi050.stderr: -122> 2024-09-14T11:13:08.565+0000 7f1b13fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:13:08.919 INFO:tasks.workunit.client.0.smithi050.stderr: -121> 2024-09-14T11:13:08.565+0000 7f1c4220a640 10 monclient: get_auth_request con 0x7f1b0c077260 auth_method 0 2024-09-14T11:13:08.919 INFO:tasks.workunit.client.0.smithi050.stderr: -120> 2024-09-14T11:13:08.565+0000 7f1c42a0b640 10 monclient: get_auth_request con 0x5605b4023390 auth_method 0 2024-09-14T11:13:08.919 INFO:tasks.workunit.client.0.smithi050.stderr: -119> 2024-09-14T11:13:08.566+0000 7f1c44719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.919 INFO:tasks.workunit.client.0.smithi050.stderr: -118> 2024-09-14T11:13:08.566+0000 7f1c44719800 20 realm 2024-09-14T11:13:08.919 INFO:tasks.workunit.client.0.smithi050.stderr: -117> 2024-09-14T11:13:08.566+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.919 INFO:tasks.workunit.client.0.smithi050.stderr: -116> 2024-09-14T11:13:08.566+0000 7f1c44719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.920 INFO:tasks.workunit.client.0.smithi050.stderr: -115> 2024-09-14T11:13:08.566+0000 7f1c44719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:08.920 INFO:tasks.workunit.client.0.smithi050.stderr: -114> 2024-09-14T11:13:08.566+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.920 INFO:tasks.workunit.client.0.smithi050.stderr: -113> 2024-09-14T11:13:08.566+0000 7f1c44719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.920 INFO:tasks.workunit.client.0.smithi050.stderr: -112> 2024-09-14T11:13:08.566+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.920 INFO:tasks.workunit.client.0.smithi050.stderr: -111> 2024-09-14T11:13:08.567+0000 7f1c4220a640 10 monclient: get_auth_request con 0x5605b4027690 auth_method 0 2024-09-14T11:13:08.920 INFO:tasks.workunit.client.0.smithi050.stderr: -110> 2024-09-14T11:13:08.567+0000 7f1c44719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:08.920 INFO:tasks.workunit.client.0.smithi050.stderr: -109> 2024-09-14T11:13:08.567+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.920 INFO:tasks.workunit.client.0.smithi050.stderr: -108> 2024-09-14T11:13:08.567+0000 7f1c41a09640 10 monclient: get_auth_request con 0x5605b402add0 auth_method 0 2024-09-14T11:13:08.920 INFO:tasks.workunit.client.0.smithi050.stderr: -107> 2024-09-14T11:13:08.568+0000 7f1c44719800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:08.920 INFO:tasks.workunit.client.0.smithi050.stderr: -106> 2024-09-14T11:13:08.568+0000 7f1c44719800 20 searching for the correct realm 2024-09-14T11:13:08.920 INFO:tasks.workunit.client.0.smithi050.stderr: -105> 2024-09-14T11:13:08.568+0000 7f1c42a0b640 10 monclient: get_auth_request con 0x5605b402fb90 auth_method 0 2024-09-14T11:13:08.920 INFO:tasks.workunit.client.0.smithi050.stderr: -104> 2024-09-14T11:13:08.569+0000 7f1c4220a640 10 monclient: get_auth_request con 0x7f1c3c01d060 auth_method 0 2024-09-14T11:13:08.920 INFO:tasks.workunit.client.0.smithi050.stderr: -103> 2024-09-14T11:13:08.570+0000 7f1c41a09640 10 monclient: get_auth_request con 0x7f1c3c060b80 auth_method 0 2024-09-14T11:13:08.921 INFO:tasks.workunit.client.0.smithi050.stderr: -102> 2024-09-14T11:13:08.571+0000 7f1c41a09640 0 -- 172.21.15.50:0/1653362030 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f1c3c060b80 msgr2=0x7f1c3c0767f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:08.921 INFO:tasks.workunit.client.0.smithi050.stderr: -101> 2024-09-14T11:13:08.772+0000 7f1c41a09640 10 monclient: get_auth_request con 0x7f1c3c060b80 auth_method 0 2024-09-14T11:13:08.921 INFO:tasks.workunit.client.0.smithi050.stderr: -100> 2024-09-14T11:13:08.774+0000 7f1c42a0b640 10 monclient: get_auth_request con 0x7f1c3406c070 auth_method 0 2024-09-14T11:13:08.921 INFO:tasks.workunit.client.0.smithi050.stderr: -99> 2024-09-14T11:13:08.775+0000 7f1c4220a640 10 monclient: get_auth_request con 0x7f1c3c069d70 auth_method 0 2024-09-14T11:13:08.921 INFO:tasks.workunit.client.0.smithi050.stderr: -98> 2024-09-14T11:13:08.776+0000 7f1c42a0b640 0 -- 172.21.15.50:0/1653362030 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5605b4023390 msgr2=0x5605b4025820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:08.921 INFO:tasks.workunit.client.0.smithi050.stderr: -97> 2024-09-14T11:13:08.776+0000 7f1b13fff640 1 client.7806.objecter ms_handle_reset 0x5605b4023390 session 0x5605b4022c80 osd.6 2024-09-14T11:13:08.921 INFO:tasks.workunit.client.0.smithi050.stderr: -96> 2024-09-14T11:13:08.776+0000 7f1b13fff640 10 monclient: _renew_subs 2024-09-14T11:13:08.921 INFO:tasks.workunit.client.0.smithi050.stderr: -95> 2024-09-14T11:13:08.776+0000 7f1b13fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:13:08.921 INFO:tasks.workunit.client.0.smithi050.stderr: -94> 2024-09-14T11:13:08.776+0000 7f1c42a0b640 10 monclient: get_auth_request con 0x7f1b0c087490 auth_method 0 2024-09-14T11:13:08.921 INFO:tasks.workunit.client.0.smithi050.stderr: -93> 2024-09-14T11:13:08.780+0000 7f1c44719800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:08.921 INFO:tasks.workunit.client.0.smithi050.stderr: -92> 2024-09-14T11:13:08.780+0000 7f1c44719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:08.921 INFO:tasks.workunit.client.0.smithi050.stderr: -91> 2024-09-14T11:13:08.780+0000 7f1c44719800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:08.921 INFO:tasks.workunit.client.0.smithi050.stderr: -90> 2024-09-14T11:13:08.780+0000 7f1c44719800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:08.921 INFO:tasks.workunit.client.0.smithi050.stderr: -89> 2024-09-14T11:13:08.780+0000 7f1c44719800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:08.922 INFO:tasks.workunit.client.0.smithi050.stderr: -88> 2024-09-14T11:13:08.780+0000 7f1c44719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:08.922 INFO:tasks.workunit.client.0.smithi050.stderr: -87> 2024-09-14T11:13:08.780+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.922 INFO:tasks.workunit.client.0.smithi050.stderr: -86> 2024-09-14T11:13:08.780+0000 7f1c44719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.922 INFO:tasks.workunit.client.0.smithi050.stderr: -85> 2024-09-14T11:13:08.780+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.922 INFO:tasks.workunit.client.0.smithi050.stderr: -84> 2024-09-14T11:13:08.780+0000 7f1c44719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:08.922 INFO:tasks.workunit.client.0.smithi050.stderr: -83> 2024-09-14T11:13:08.780+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.922 INFO:tasks.workunit.client.0.smithi050.stderr: -82> 2024-09-14T11:13:08.781+0000 7f1c44719800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:08.922 INFO:tasks.workunit.client.0.smithi050.stderr: -81> 2024-09-14T11:13:08.781+0000 7f1c44719800 20 zone default found 2024-09-14T11:13:08.922 INFO:tasks.workunit.client.0.smithi050.stderr: -80> 2024-09-14T11:13:08.781+0000 7f1c44719800 4 Realm: () 2024-09-14T11:13:08.922 INFO:tasks.workunit.client.0.smithi050.stderr: -79> 2024-09-14T11:13:08.781+0000 7f1c44719800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:08.922 INFO:tasks.workunit.client.0.smithi050.stderr: -78> 2024-09-14T11:13:08.781+0000 7f1c44719800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:08.922 INFO:tasks.workunit.client.0.smithi050.stderr: -77> 2024-09-14T11:13:08.781+0000 7f1c44719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:08.922 INFO:tasks.workunit.client.0.smithi050.stderr: -76> 2024-09-14T11:13:08.781+0000 7f1c44719800 20 zonegroup default 2024-09-14T11:13:08.922 INFO:tasks.workunit.client.0.smithi050.stderr: -75> 2024-09-14T11:13:08.781+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.923 INFO:tasks.workunit.client.0.smithi050.stderr: -74> 2024-09-14T11:13:08.781+0000 7f1c44719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.923 INFO:tasks.workunit.client.0.smithi050.stderr: -73> 2024-09-14T11:13:08.781+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.923 INFO:tasks.workunit.client.0.smithi050.stderr: -72> 2024-09-14T11:13:08.781+0000 7f1c44719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.923 INFO:tasks.workunit.client.0.smithi050.stderr: -71> 2024-09-14T11:13:08.781+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.923 INFO:tasks.workunit.client.0.smithi050.stderr: -70> 2024-09-14T11:13:08.781+0000 7f1c44719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.923 INFO:tasks.workunit.client.0.smithi050.stderr: -69> 2024-09-14T11:13:08.781+0000 7f1c44719800 20 started sync module instance, tier type = 2024-09-14T11:13:08.923 INFO:tasks.workunit.client.0.smithi050.stderr: -68> 2024-09-14T11:13:08.782+0000 7f1c44719800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:08.923 INFO:tasks.workunit.client.0.smithi050.stderr: -67> 2024-09-14T11:13:08.790+0000 7f1c44719800 20 add_watcher() i=0 2024-09-14T11:13:08.923 INFO:tasks.workunit.client.0.smithi050.stderr: -66> 2024-09-14T11:13:08.790+0000 7f1c44719800 20 add_watcher() i=1 2024-09-14T11:13:08.923 INFO:tasks.workunit.client.0.smithi050.stderr: -65> 2024-09-14T11:13:08.790+0000 7f1c44719800 20 add_watcher() i=2 2024-09-14T11:13:08.923 INFO:tasks.workunit.client.0.smithi050.stderr: -64> 2024-09-14T11:13:08.790+0000 7f1c44719800 20 add_watcher() i=3 2024-09-14T11:13:08.924 INFO:tasks.workunit.client.0.smithi050.stderr: -63> 2024-09-14T11:13:08.790+0000 7f1c44719800 20 add_watcher() i=4 2024-09-14T11:13:08.924 INFO:tasks.workunit.client.0.smithi050.stderr: -62> 2024-09-14T11:13:08.790+0000 7f1c44719800 20 add_watcher() i=5 2024-09-14T11:13:08.924 INFO:tasks.workunit.client.0.smithi050.stderr: -61> 2024-09-14T11:13:08.790+0000 7f1c44719800 20 add_watcher() i=6 2024-09-14T11:13:08.924 INFO:tasks.workunit.client.0.smithi050.stderr: -60> 2024-09-14T11:13:08.791+0000 7f1c44719800 20 add_watcher() i=7 2024-09-14T11:13:08.924 INFO:tasks.workunit.client.0.smithi050.stderr: -59> 2024-09-14T11:13:08.791+0000 7f1c44719800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:08.924 INFO:tasks.workunit.client.0.smithi050.stderr: -58> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding auth protocol: cephx 2024-09-14T11:13:08.924 INFO:tasks.workunit.client.0.smithi050.stderr: -57> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding auth protocol: cephx 2024-09-14T11:13:08.924 INFO:tasks.workunit.client.0.smithi050.stderr: -56> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding auth protocol: cephx 2024-09-14T11:13:08.924 INFO:tasks.workunit.client.0.smithi050.stderr: -55> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding con mode: secure 2024-09-14T11:13:08.924 INFO:tasks.workunit.client.0.smithi050.stderr: -54> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding con mode: crc 2024-09-14T11:13:08.924 INFO:tasks.workunit.client.0.smithi050.stderr: -53> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding con mode: secure 2024-09-14T11:13:08.924 INFO:tasks.workunit.client.0.smithi050.stderr: -52> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding con mode: crc 2024-09-14T11:13:08.924 INFO:tasks.workunit.client.0.smithi050.stderr: -51> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding con mode: secure 2024-09-14T11:13:08.925 INFO:tasks.workunit.client.0.smithi050.stderr: -50> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding con mode: crc 2024-09-14T11:13:08.925 INFO:tasks.workunit.client.0.smithi050.stderr: -49> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding con mode: crc 2024-09-14T11:13:08.925 INFO:tasks.workunit.client.0.smithi050.stderr: -48> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding con mode: secure 2024-09-14T11:13:08.925 INFO:tasks.workunit.client.0.smithi050.stderr: -47> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding con mode: crc 2024-09-14T11:13:08.925 INFO:tasks.workunit.client.0.smithi050.stderr: -46> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding con mode: secure 2024-09-14T11:13:08.925 INFO:tasks.workunit.client.0.smithi050.stderr: -45> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding con mode: crc 2024-09-14T11:13:08.925 INFO:tasks.workunit.client.0.smithi050.stderr: -44> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 AuthRegistry(0x7ffe4e64d020) adding con mode: secure 2024-09-14T11:13:08.925 INFO:tasks.workunit.client.0.smithi050.stderr: -43> 2024-09-14T11:13:08.793+0000 7f1af8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:08.925 INFO:tasks.workunit.client.0.smithi050.stderr: -42> 2024-09-14T11:13:08.793+0000 7f1c44719800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:08.925 INFO:tasks.workunit.client.0.smithi050.stderr: -41> 2024-09-14T11:13:08.793+0000 7f1c44719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:08.925 INFO:tasks.workunit.client.0.smithi050.stderr: -40> 2024-09-14T11:13:08.793+0000 7f1c44719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:08.925 INFO:tasks.workunit.client.0.smithi050.stderr: -39> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command cache list hook 0x5605b3ffa210 2024-09-14T11:13:08.925 INFO:tasks.workunit.client.0.smithi050.stderr: -38> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command cache inspect hook 0x5605b3ffa210 2024-09-14T11:13:08.925 INFO:tasks.workunit.client.0.smithi050.stderr: -37> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command cache erase hook 0x5605b3ffa210 2024-09-14T11:13:08.926 INFO:tasks.workunit.client.0.smithi050.stderr: -36> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command cache zap hook 0x5605b3ffa210 2024-09-14T11:13:08.926 INFO:tasks.workunit.client.0.smithi050.stderr: -35> 2024-09-14T11:13:08.793+0000 7f1c44719800 5 note: GC not initialized 2024-09-14T11:13:08.926 INFO:tasks.workunit.client.0.smithi050.stderr: -34> 2024-09-14T11:13:08.793+0000 7f1a737fe640 20 reqs_thread_entry: start 2024-09-14T11:13:08.926 INFO:tasks.workunit.client.0.smithi050.stderr: -33> 2024-09-14T11:13:08.794+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command sync trace show hook 0x7f1c3800d5f0 2024-09-14T11:13:08.926 INFO:tasks.workunit.client.0.smithi050.stderr: -32> 2024-09-14T11:13:08.794+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command sync trace history hook 0x7f1c3800d5f0 2024-09-14T11:13:08.926 INFO:tasks.workunit.client.0.smithi050.stderr: -31> 2024-09-14T11:13:08.794+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command sync trace active hook 0x7f1c3800d5f0 2024-09-14T11:13:08.926 INFO:tasks.workunit.client.0.smithi050.stderr: -30> 2024-09-14T11:13:08.794+0000 7f1c44719800 5 asok(0x5605b3d18270) register_command sync trace active_short hook 0x7f1c3800d5f0 2024-09-14T11:13:08.926 INFO:tasks.workunit.client.0.smithi050.stderr: -29> 2024-09-14T11:13:08.794+0000 7f1c44719800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:08.926 INFO:tasks.workunit.client.0.smithi050.stderr: -28> 2024-09-14T11:13:08.794+0000 7f1c44719800 20 Filter name: none 2024-09-14T11:13:08.926 INFO:tasks.workunit.client.0.smithi050.stderr: -27> 2024-09-14T11:13:08.794+0000 7f1a717fa640 20 reqs_thread_entry: start 2024-09-14T11:13:08.926 INFO:tasks.workunit.client.0.smithi050.stderr: -26> 2024-09-14T11:13:08.794+0000 7f1c44719800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:13:08.926 INFO:tasks.workunit.client.0.smithi050.stderr: -25> 2024-09-14T11:13:08.794+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.926 INFO:tasks.workunit.client.0.smithi050.stderr: -24> 2024-09-14T11:13:08.794+0000 7f1c44719800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:13:08.926 INFO:tasks.workunit.client.0.smithi050.stderr: -23> 2024-09-14T11:13:08.794+0000 7f1c44719800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:13:08.927 INFO:tasks.workunit.client.0.smithi050.stderr: -22> 2024-09-14T11:13:08.794+0000 7f1c44719800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:13:08.927 INFO:tasks.workunit.client.0.smithi050.stderr: -21> 2024-09-14T11:13:08.794+0000 7f1c44719800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 : miss 2024-09-14T11:13:08.927 INFO:tasks.workunit.client.0.smithi050.stderr: -20> 2024-09-14T11:13:08.794+0000 7f1c44719800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.927 INFO:tasks.workunit.client.0.smithi050.stderr: -19> 2024-09-14T11:13:08.795+0000 7f1c44719800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:13:08.927 INFO:tasks.workunit.client.0.smithi050.stderr: -18> 2024-09-14T11:13:08.795+0000 7f1c44719800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 info.flags=0x17 2024-09-14T11:13:08.927 INFO:tasks.workunit.client.0.smithi050.stderr: -17> 2024-09-14T11:13:08.795+0000 7f1c44719800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 to cache LRU end 2024-09-14T11:13:08.927 INFO:tasks.workunit.client.0.smithi050.stderr: -16> 2024-09-14T11:13:08.795+0000 7f1c44719800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:08.927 INFO:tasks.workunit.client.0.smithi050.stderr: -15> 2024-09-14T11:13:08.795+0000 7f1c44719800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:08.927 INFO:tasks.workunit.client.0.smithi050.stderr: -14> 2024-09-14T11:13:08.795+0000 7f1c44719800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 2024-09-14T11:13:08.927 INFO:tasks.workunit.client.0.smithi050.stderr: -13> 2024-09-14T11:13:08.800+0000 7f1c44719800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 info.flags=0x17 2024-09-14T11:13:08.927 INFO:tasks.workunit.client.0.smithi050.stderr: -12> 2024-09-14T11:13:08.800+0000 7f1c44719800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 to cache LRU end 2024-09-14T11:13:08.928 INFO:tasks.workunit.client.0.smithi050.stderr: -11> 2024-09-14T11:13:08.800+0000 7f1c44719800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:08.928 INFO:tasks.workunit.client.0.smithi050.stderr: -10> 2024-09-14T11:13:08.800+0000 7f1c44719800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37, ofs0, ns] 2024-09-14T11:13:08.928 INFO:tasks.workunit.client.0.smithi050.stderr: -9> 2024-09-14T11:13:08.800+0000 7f1b257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496985 cookie 94582494940592 notifier 7806 bl.length()=1007 2024-09-14T11:13:08.928 INFO:tasks.workunit.client.0.smithi050.stderr: -8> 2024-09-14T11:13:08.800+0000 7f1b257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 info.flags=0x17 2024-09-14T11:13:08.928 INFO:tasks.workunit.client.0.smithi050.stderr: -7> 2024-09-14T11:13:08.800+0000 7f1b257fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 to cache LRU end 2024-09-14T11:13:08.928 INFO:tasks.workunit.client.0.smithi050.stderr: -6> 2024-09-14T11:13:08.800+0000 7f1b257fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:08.928 INFO:tasks.workunit.client.0.smithi050.stderr: -5> 2024-09-14T11:13:08.803+0000 7f1c44719800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37]): orig_sources= new_sources= 2024-09-14T11:13:08.928 INFO:tasks.workunit.client.0.smithi050.stderr: -4> 2024-09-14T11:13:08.803+0000 7f1c44719800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37]): potential sources added=[] removed=[] 2024-09-14T11:13:08.928 INFO:tasks.workunit.client.0.smithi050.stderr: -3> 2024-09-14T11:13:08.803+0000 7f1c44719800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37]): orig_dests= new_dests= 2024-09-14T11:13:08.928 INFO:tasks.workunit.client.0.smithi050.stderr: -2> 2024-09-14T11:13:08.803+0000 7f1c44719800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37]): potential dests added=[] removed=[] 2024-09-14T11:13:08.928 INFO:tasks.workunit.client.0.smithi050.stderr: -1> 2024-09-14T11:13:08.806+0000 7f1c44719800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1c44719800 time 2024-09-14T11:13:08.805901+0000 2024-09-14T11:13:08.928 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:13:08.928 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.929 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:13:08.929 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1c47b8c76a] 2024-09-14T11:13:08.929 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f1c47b8c928] 2024-09-14T11:13:08.929 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5605b307f0b1] 2024-09-14T11:13:08.929 INFO:tasks.workunit.client.0.smithi050.stderr: 4: radosgw-admin(+0xd8907c) [0x5605b359307c] 2024-09-14T11:13:08.929 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5605b308eefd] 2024-09-14T11:13:08.929 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:13:08.929 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1c46829590] 2024-09-14T11:13:08.929 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:13:08.929 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:13:08.929 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.929 INFO:tasks.workunit.client.0.smithi050.stderr: 0> 2024-09-14T11:13:08.807+0000 7f1c44719800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:13:08.929 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f1c44719800 thread_name:radosgw-admin 2024-09-14T11:13:08.929 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.930 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:13:08.930 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1c4683e6f0] 2024-09-14T11:13:08.930 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1c4688b99c] 2024-09-14T11:13:08.930 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:13:08.930 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:13:08.930 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1c47b8c7c4] 2024-09-14T11:13:08.930 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f1c47b8c928] 2024-09-14T11:13:08.930 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5605b307f0b1] 2024-09-14T11:13:08.930 INFO:tasks.workunit.client.0.smithi050.stderr: 8: radosgw-admin(+0xd8907c) [0x5605b359307c] 2024-09-14T11:13:08.930 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5605b308eefd] 2024-09-14T11:13:08.930 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:13:08.930 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1c46829590] 2024-09-14T11:13:08.930 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:13:08.930 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:13:08.931 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:13:08.931 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:08.931 INFO:tasks.workunit.client.0.smithi050.stderr:--- logging levels --- 2024-09-14T11:13:08.931 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 none 2024-09-14T11:13:08.931 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 lockdep 2024-09-14T11:13:08.931 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 context 2024-09-14T11:13:08.931 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 crush 2024-09-14T11:13:08.931 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds 2024-09-14T11:13:08.931 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_balancer 2024-09-14T11:13:08.931 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_locker 2024-09-14T11:13:08.931 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log 2024-09-14T11:13:08.931 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log_expire 2024-09-14T11:13:08.931 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_migrator 2024-09-14T11:13:08.931 INFO:tasks.workunit.client.0.smithi050.stderr: 3/ 5 mds_quiesce 2024-09-14T11:13:08.932 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 buffer 2024-09-14T11:13:08.932 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 timer 2024-09-14T11:13:08.932 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 filer 2024-09-14T11:13:08.932 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 striper 2024-09-14T11:13:08.932 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 objecter 2024-09-14T11:13:08.932 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rados 2024-09-14T11:13:08.932 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd 2024-09-14T11:13:08.932 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_mirror 2024-09-14T11:13:08.932 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_replay 2024-09-14T11:13:08.932 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_pwl 2024-09-14T11:13:08.932 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 journaler 2024-09-14T11:13:08.932 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objectcacher 2024-09-14T11:13:08.932 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:13:08.932 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 client 2024-09-14T11:13:08.932 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 osd 2024-09-14T11:13:08.933 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 optracker 2024-09-14T11:13:08.933 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objclass 2024-09-14T11:13:08.933 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 filestore 2024-09-14T11:13:08.933 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 journal 2024-09-14T11:13:08.933 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 ms 2024-09-14T11:13:08.933 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mon 2024-09-14T11:13:08.933 INFO:tasks.workunit.client.0.smithi050.stderr: 0/10 monc 2024-09-14T11:13:08.933 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 paxos 2024-09-14T11:13:08.933 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 tp 2024-09-14T11:13:08.933 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 auth 2024-09-14T11:13:08.933 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 crypto 2024-09-14T11:13:08.933 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 finisher 2024-09-14T11:13:08.933 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 reserver 2024-09-14T11:13:08.933 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 heartbeatmap 2024-09-14T11:13:08.934 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 perfcounter 2024-09-14T11:13:08.934 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw 2024-09-14T11:13:08.934 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_sync 2024-09-14T11:13:08.934 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_datacache 2024-09-14T11:13:08.934 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_access 2024-09-14T11:13:08.934 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:13:08.934 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_flight 2024-09-14T11:13:08.934 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:13:08.934 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw_notification 2024-09-14T11:13:08.934 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 javaclient 2024-09-14T11:13:08.934 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 asok 2024-09-14T11:13:08.934 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 throttle 2024-09-14T11:13:08.934 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 refs 2024-09-14T11:13:08.934 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 compressor 2024-09-14T11:13:08.934 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluestore 2024-09-14T11:13:08.935 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluefs 2024-09-14T11:13:08.935 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 bdev 2024-09-14T11:13:08.935 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 kstore 2024-09-14T11:13:08.935 INFO:tasks.workunit.client.0.smithi050.stderr: 4/ 5 rocksdb 2024-09-14T11:13:08.935 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 fuse 2024-09-14T11:13:08.935 INFO:tasks.workunit.client.0.smithi050.stderr: 2/ 5 mgr 2024-09-14T11:13:08.935 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mgrc 2024-09-14T11:13:08.935 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 dpdk 2024-09-14T11:13:08.935 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 eventtrace 2024-09-14T11:13:08.935 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 prioritycache 2024-09-14T11:13:08.935 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 test 2024-09-14T11:13:08.935 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:13:08.935 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephsqlite 2024-09-14T11:13:08.935 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:13:08.936 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore 2024-09-14T11:13:08.936 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_onode 2024-09-14T11:13:08.936 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_odata 2024-09-14T11:13:08.936 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_omap 2024-09-14T11:13:08.936 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_tm 2024-09-14T11:13:08.936 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_t 2024-09-14T11:13:08.936 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:13:08.936 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_epm 2024-09-14T11:13:08.936 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_lba 2024-09-14T11:13:08.936 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:13:08.936 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cache 2024-09-14T11:13:08.936 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_journal 2024-09-14T11:13:08.936 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_device 2024-09-14T11:13:08.936 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_backref 2024-09-14T11:13:08.937 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 alienstore 2024-09-14T11:13:08.937 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mclock 2024-09-14T11:13:08.937 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cyanstore 2024-09-14T11:13:08.937 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 ceph_exporter 2024-09-14T11:13:08.937 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 memstore 2024-09-14T11:13:08.937 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 trace 2024-09-14T11:13:08.937 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 ceph_dedup 2024-09-14T11:13:08.937 INFO:tasks.workunit.client.0.smithi050.stderr: -2/-2 (syslog threshold) 2024-09-14T11:13:08.937 INFO:tasks.workunit.client.0.smithi050.stderr: 99/99 (stderr threshold) 2024-09-14T11:13:08.937 INFO:tasks.workunit.client.0.smithi050.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:13:08.937 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1a717fa640 / http_manager 2024-09-14T11:13:08.937 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1a737fe640 / http_manager 2024-09-14T11:13:08.937 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1af8fe1640 / rgw_dt_lg_renew 2024-09-14T11:13:08.937 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1b13fff640 / ms_dispatch 2024-09-14T11:13:08.937 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1b257fa640 / io_context_pool 2024-09-14T11:13:08.938 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1b25ffb640 / io_context_pool 2024-09-14T11:13:08.938 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1b27fff640 / ms_dispatch 2024-09-14T11:13:08.938 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1b2ee05640 / ms_dispatch 2024-09-14T11:13:08.938 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1b30608640 / io_context_pool 2024-09-14T11:13:08.938 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1c41a09640 / msgr-worker-2 2024-09-14T11:13:08.938 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1c4220a640 / msgr-worker-1 2024-09-14T11:13:08.938 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1c42a0b640 / msgr-worker-0 2024-09-14T11:13:08.938 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1c4320c640 / io_context_pool 2024-09-14T11:13:08.938 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1c44719800 / radosgw-admin 2024-09-14T11:13:08.938 INFO:tasks.workunit.client.0.smithi050.stderr: max_recent 500 2024-09-14T11:13:08.938 INFO:tasks.workunit.client.0.smithi050.stderr: max_new 1000 2024-09-14T11:13:08.938 INFO:tasks.workunit.client.0.smithi050.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:13:08.807623Z_342a32dd-ea65-4805-ae6f-122f9e843e75/log 2024-09-14T11:13:08.938 INFO:tasks.workunit.client.0.smithi050.stderr:--- end dump of recent events --- 2024-09-14T11:13:08.938 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:13:08.940 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:08.940 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:08.940 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.886+0000 7f17b5b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.940 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.888+0000 7f17b5b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.940 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.888+0000 7f17b5b46800 20 realm 2024-09-14T11:13:08.940 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.888+0000 7f17b5b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.940 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.888+0000 7f17b5b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.940 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.888+0000 7f17b5b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:08.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.888+0000 7f17b5b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.888+0000 7f17b5b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.888+0000 7f17b5b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.889+0000 7f17b5b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:08.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.889+0000 7f17b5b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.889+0000 7f17b5b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:08.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.889+0000 7f17b5b46800 20 searching for the correct realm 2024-09-14T11:13:08.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:08.892+0000 7f17b2e2f640 0 -- 172.21.15.50:0/2889263747 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f17ac06ef80 msgr2=0x7f17ac09e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:09.096 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.098+0000 7f17b2e2f640 0 -- 172.21.15.50:0/2889263747 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5618a8971e30 msgr2=0x5618a8974220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:09.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.102+0000 7f17b5b46800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:09.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.102+0000 7f17b5b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:09.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.102+0000 7f17b5b46800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:09.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.102+0000 7f17b5b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:09.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.102+0000 7f17b5b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:09.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.102+0000 7f17b5b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:09.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.102+0000 7f17b5b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.102+0000 7f17b5b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:09.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.102+0000 7f17b5b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.102+0000 7f17b5b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:09.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.102+0000 7f17b5b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.102 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.102+0000 7f17b5b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:09.102 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.103+0000 7f17b5b46800 20 zone default found 2024-09-14T11:13:09.102 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.103+0000 7f17b5b46800 4 Realm: () 2024-09-14T11:13:09.102 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.103+0000 7f17b5b46800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:09.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.103+0000 7f17b5b46800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:09.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.103+0000 7f17b5b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:09.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.103+0000 7f17b5b46800 20 zonegroup default 2024-09-14T11:13:09.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.103+0000 7f17b5b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.103+0000 7f17b5b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:09.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.103+0000 7f17b5b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.103+0000 7f17b5b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:09.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.103+0000 7f17b5b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.104+0000 7f17b5b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:09.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.104+0000 7f17b5b46800 20 started sync module instance, tier type = 2024-09-14T11:13:09.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.104+0000 7f17b5b46800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:09.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.112+0000 7f17b5b46800 20 add_watcher() i=0 2024-09-14T11:13:09.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.112+0000 7f17b5b46800 20 add_watcher() i=1 2024-09-14T11:13:09.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.112+0000 7f17b5b46800 20 add_watcher() i=2 2024-09-14T11:13:09.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.112+0000 7f17b5b46800 20 add_watcher() i=3 2024-09-14T11:13:09.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.112+0000 7f17b5b46800 20 add_watcher() i=4 2024-09-14T11:13:09.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.112+0000 7f17b5b46800 20 add_watcher() i=5 2024-09-14T11:13:09.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.112+0000 7f17b5b46800 20 add_watcher() i=6 2024-09-14T11:13:09.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.113+0000 7f17b5b46800 20 add_watcher() i=7 2024-09-14T11:13:09.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.113+0000 7f17b5b46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:09.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.115+0000 7f1669fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:09.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.116+0000 7f17b5b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:09.115 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.116+0000 7f17b5b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:09.115 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.116+0000 7f17b5b46800 5 note: GC not initialized 2024-09-14T11:13:09.115 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.116+0000 7f1668fe1640 20 reqs_thread_entry: start 2024-09-14T11:13:09.115 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.116+0000 7f17b5b46800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:09.115 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.116+0000 7f17b5b46800 20 Filter name: none 2024-09-14T11:13:09.115 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.116+0000 7f15e27fc640 20 reqs_thread_entry: start 2024-09-14T11:13:09.115 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.116+0000 7f17b5b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.117+0000 7f17b5b46800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:13:09.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.117+0000 7f17b5b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.117+0000 7f17b5b46800 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:13:09.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.117+0000 7f17b5b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:09.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.117+0000 7f17b5b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.117+0000 7f17b5b46800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:13:09.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.117+0000 7f17b5b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.118+0000 7f17b5b46800 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:13:09.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.118+0000 7f17b5b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:09.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.119+0000 7f1669fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:09.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.122+0000 7f17b5b46800 20 remove_watcher() i=0 2024-09-14T11:13:09.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.122+0000 7f17b5b46800 2 removed watcher, disabling cache 2024-09-14T11:13:09.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.123+0000 7f17b5b46800 20 remove_watcher() i=1 2024-09-14T11:13:09.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.123+0000 7f17b5b46800 20 remove_watcher() i=2 2024-09-14T11:13:09.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.124+0000 7f17b5b46800 20 remove_watcher() i=3 2024-09-14T11:13:09.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.125+0000 7f17b5b46800 20 remove_watcher() i=4 2024-09-14T11:13:09.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.127+0000 7f17b5b46800 20 remove_watcher() i=5 2024-09-14T11:13:09.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.128+0000 7f17b5b46800 20 remove_watcher() i=6 2024-09-14T11:13:09.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.129+0000 7f17b5b46800 20 remove_watcher() i=7 2024-09-14T11:13:09.139 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:09.139 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:13:09.139 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: abort-at-logrecord-writes id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:13:09.139 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:09.141 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:09.141 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:09.176 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:09.176 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:09.234 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:13:09.267 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:09.267 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:09.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.308+0000 7fdf85936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.310+0000 7fdf85936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:09.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.310+0000 7fdf85936800 20 realm 2024-09-14T11:13:09.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.310+0000 7fdf85936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.310+0000 7fdf85936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:09.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.310+0000 7fdf85936800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:09.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.310+0000 7fdf85936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.310+0000 7fdf85936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:09.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.310+0000 7fdf85936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.311+0000 7fdf85936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:09.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.311+0000 7fdf85936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.310 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.311+0000 7fdf85936800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:09.310 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.311+0000 7fdf85936800 20 searching for the correct realm 2024-09-14T11:13:09.313 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.314+0000 7fdf80eb6640 0 -- 172.21.15.50:0/2100006482 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fdf7c06c400 msgr2=0x7fdf7c06c860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:09.517 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.519+0000 7fdf81eb8640 0 -- 172.21.15.50:0/2100006482 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x565546987970 msgr2=0x565546989de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:09.522 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.523+0000 7fdf85936800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:09.522 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.523+0000 7fdf85936800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:09.522 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.523+0000 7fdf85936800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:09.522 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.523+0000 7fdf85936800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:09.522 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.523+0000 7fdf85936800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:09.522 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.523+0000 7fdf85936800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:09.522 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.523+0000 7fdf85936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.522 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.524+0000 7fdf85936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:09.522 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.524+0000 7fdf85936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.523 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.524+0000 7fdf85936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:09.523 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.524+0000 7fdf85936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.523 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.524+0000 7fdf85936800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:09.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.524+0000 7fdf85936800 20 zone default found 2024-09-14T11:13:09.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.524+0000 7fdf85936800 4 Realm: () 2024-09-14T11:13:09.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.524+0000 7fdf85936800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:09.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.524+0000 7fdf85936800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:09.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.524+0000 7fdf85936800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:09.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.524+0000 7fdf85936800 20 zonegroup default 2024-09-14T11:13:09.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.524+0000 7fdf85936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.525+0000 7fdf85936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:09.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.525+0000 7fdf85936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.525+0000 7fdf85936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:09.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.525+0000 7fdf85936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.525+0000 7fdf85936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:09.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.525+0000 7fdf85936800 20 started sync module instance, tier type = 2024-09-14T11:13:09.524 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.525+0000 7fdf85936800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:09.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.533+0000 7fdf85936800 20 add_watcher() i=0 2024-09-14T11:13:09.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.533+0000 7fdf85936800 20 add_watcher() i=1 2024-09-14T11:13:09.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.533+0000 7fdf85936800 20 add_watcher() i=2 2024-09-14T11:13:09.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.533+0000 7fdf85936800 20 add_watcher() i=3 2024-09-14T11:13:09.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.533+0000 7fdf85936800 20 add_watcher() i=4 2024-09-14T11:13:09.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.533+0000 7fdf85936800 20 add_watcher() i=5 2024-09-14T11:13:09.532 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.533+0000 7fdf85936800 20 add_watcher() i=6 2024-09-14T11:13:09.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.534+0000 7fdf85936800 20 add_watcher() i=7 2024-09-14T11:13:09.533 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.534+0000 7fdf85936800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:09.534 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.536+0000 7fde37fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:09.535 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.536+0000 7fdf85936800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:09.535 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.536+0000 7fdf85936800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:09.535 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.536+0000 7fdf85936800 5 note: GC not initialized 2024-09-14T11:13:09.535 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.537+0000 7fde36fe5640 20 reqs_thread_entry: start 2024-09-14T11:13:09.535 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.537+0000 7fdf85936800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:09.535 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.537+0000 7fdf85936800 20 Filter name: none 2024-09-14T11:13:09.535 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.537+0000 7fde34fe1640 20 reqs_thread_entry: start 2024-09-14T11:13:09.536 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.537+0000 7fdf85936800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:13:09.536 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.537+0000 7fdf85936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.537+0000 7fdf85936800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:13:09.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.537+0000 7fdf85936800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:13:09.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.537+0000 7fdf85936800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:13:09.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.537+0000 7fdf85936800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 : miss 2024-09-14T11:13:09.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.537+0000 7fdf85936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.538+0000 7fdf85936800 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:13:09.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.538+0000 7fdf85936800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 info.flags=0x17 2024-09-14T11:13:09.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.538+0000 7fdf85936800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 to cache LRU end 2024-09-14T11:13:09.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.538+0000 7fdf85936800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:09.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.538+0000 7fdf85936800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:09.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.538+0000 7fdf85936800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 2024-09-14T11:13:09.538 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.539+0000 7fdf85936800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 to be held by another RGW process; skipping for now 2024-09-14T11:13:09.538 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.540+0000 7fde37fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:09.540 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.542+0000 7fdf85936800 20 remove_watcher() i=0 2024-09-14T11:13:09.540 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.542+0000 7fdf85936800 2 removed watcher, disabling cache 2024-09-14T11:13:09.541 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.543+0000 7fdf85936800 20 remove_watcher() i=1 2024-09-14T11:13:09.542 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.544+0000 7fdf85936800 20 remove_watcher() i=2 2024-09-14T11:13:09.543 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.545+0000 7fdf85936800 20 remove_watcher() i=3 2024-09-14T11:13:09.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.546+0000 7fdf85936800 20 remove_watcher() i=4 2024-09-14T11:13:09.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.547+0000 7fdf85936800 20 remove_watcher() i=5 2024-09-14T11:13:09.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.548+0000 7fdf85936800 20 remove_watcher() i=6 2024-09-14T11:13:09.547 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:09.549+0000 7fdf85936800 20 remove_watcher() i=7 2024-09-14T11:13:09.557 INFO:tasks.workunit.client.0.smithi050.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:13:39.571 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:13:39.608 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:39.608 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:39.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.654+0000 7f326ab36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.655+0000 7f326ab36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.655+0000 7f326ab36800 20 realm 2024-09-14T11:13:39.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.655+0000 7f326ab36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.656+0000 7f326ab36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.656+0000 7f326ab36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:39.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.656+0000 7f326ab36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.656+0000 7f326ab36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.656+0000 7f326ab36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.657+0000 7f326ab36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:39.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.657+0000 7f326ab36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.657+0000 7f326ab36800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:39.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.657+0000 7f326ab36800 20 searching for the correct realm 2024-09-14T11:13:39.660 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.661+0000 7f32660b6640 0 -- 172.21.15.50:0/1127257291 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f326006da50 msgr2=0x7f326006d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:39.867 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.868+0000 7f32670b8640 0 -- 172.21.15.50:0/1127257291 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55ff99594190 msgr2=0x55ff99596620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:39.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.873+0000 7f326ab36800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:39.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.873+0000 7f326ab36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:39.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.873+0000 7f326ab36800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:39.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.873+0000 7f326ab36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:39.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.873+0000 7f326ab36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:39.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.873+0000 7f326ab36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:39.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.873+0000 7f326ab36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.874+0000 7f326ab36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.874+0000 7f326ab36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.874+0000 7f326ab36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:39.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.874+0000 7f326ab36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.875+0000 7f326ab36800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:39.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.875+0000 7f326ab36800 20 zone default found 2024-09-14T11:13:39.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.875+0000 7f326ab36800 4 Realm: () 2024-09-14T11:13:39.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.875+0000 7f326ab36800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:39.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.875+0000 7f326ab36800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:39.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.875+0000 7f326ab36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:39.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.875+0000 7f326ab36800 20 zonegroup default 2024-09-14T11:13:39.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.875+0000 7f326ab36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.875+0000 7f326ab36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.875+0000 7f326ab36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.875+0000 7f326ab36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.875+0000 7f326ab36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.876+0000 7f326ab36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.876+0000 7f326ab36800 20 started sync module instance, tier type = 2024-09-14T11:13:39.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.876+0000 7f326ab36800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:39.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.886+0000 7f326ab36800 20 add_watcher() i=0 2024-09-14T11:13:39.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.886+0000 7f326ab36800 20 add_watcher() i=1 2024-09-14T11:13:39.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.886+0000 7f326ab36800 20 add_watcher() i=2 2024-09-14T11:13:39.886 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.886+0000 7f326ab36800 20 add_watcher() i=3 2024-09-14T11:13:39.886 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.886+0000 7f326ab36800 20 add_watcher() i=4 2024-09-14T11:13:39.886 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.886+0000 7f326ab36800 20 add_watcher() i=5 2024-09-14T11:13:39.886 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.886+0000 7f326ab36800 20 add_watcher() i=6 2024-09-14T11:13:39.886 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.887+0000 7f326ab36800 20 add_watcher() i=7 2024-09-14T11:13:39.886 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.887+0000 7f326ab36800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:39.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.889+0000 7f311d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:39.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.890+0000 7f326ab36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:39.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.890+0000 7f326ab36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:39.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.890+0000 7f326ab36800 5 note: GC not initialized 2024-09-14T11:13:39.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.890+0000 7f3097fff640 20 reqs_thread_entry: start 2024-09-14T11:13:39.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.890+0000 7f326ab36800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:39.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.890+0000 7f326ab36800 20 Filter name: none 2024-09-14T11:13:39.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.890+0000 7f3095ffb640 20 reqs_thread_entry: start 2024-09-14T11:13:39.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.891+0000 7f326ab36800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:13:39.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.891+0000 7f326ab36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.891+0000 7f326ab36800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:13:39.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.891+0000 7f326ab36800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:13:39.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.891+0000 7f326ab36800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:13:39.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.891+0000 7f326ab36800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 : miss 2024-09-14T11:13:39.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.891+0000 7f326ab36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.892+0000 7f326ab36800 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:13:39.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.892+0000 7f326ab36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 info.flags=0x17 2024-09-14T11:13:39.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.892+0000 7f326ab36800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 to cache LRU end 2024-09-14T11:13:39.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.892+0000 7f326ab36800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:39.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.892+0000 7f326ab36800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:39.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.892+0000 7f326ab36800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 2024-09-14T11:13:39.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.893+0000 7f326ab36800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:13:39.899 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.900+0000 7f326ab36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 info.flags=0x17 2024-09-14T11:13:39.900 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.900+0000 7f326ab36800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 to cache LRU end 2024-09-14T11:13:39.900 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.900+0000 7f326ab36800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:39.900 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.900+0000 7f326ab36800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37, ofs0, ns] 2024-09-14T11:13:39.900 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.901+0000 7f3149ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496986 cookie 94556277855952 notifier 7863 bl.length()=1007 2024-09-14T11:13:39.900 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.901+0000 7f3149ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 info.flags=0x17 2024-09-14T11:13:39.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.901+0000 7f3149ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 to cache LRU end 2024-09-14T11:13:39.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.901+0000 7f3149ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:39.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.903+0000 7f326ab36800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37]): orig_sources= new_sources= 2024-09-14T11:13:39.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.903+0000 7f326ab36800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37]): potential sources added=[] removed=[] 2024-09-14T11:13:39.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.903+0000 7f326ab36800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37]): orig_dests= new_dests= 2024-09-14T11:13:39.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.903+0000 7f326ab36800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37]): potential dests added=[] removed=[] 2024-09-14T11:13:39.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2.0 2024-09-14T11:13:39.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2.0 2024-09-14T11:13:39.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2.1 2024-09-14T11:13:39.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2.1 2024-09-14T11:13:39.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2.2 2024-09-14T11:13:39.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2.2 2024-09-14T11:13:39.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2.3 2024-09-14T11:13:39.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2.3 2024-09-14T11:13:39.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2.4 2024-09-14T11:13:39.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2.4 2024-09-14T11:13:39.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2.5 2024-09-14T11:13:39.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2.5 2024-09-14T11:13:39.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2.6 2024-09-14T11:13:39.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2.6 2024-09-14T11:13:39.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2.7 2024-09-14T11:13:39.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2.7 2024-09-14T11:13:39.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2.8 2024-09-14T11:13:39.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2.8 2024-09-14T11:13:39.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2.9 2024-09-14T11:13:39.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2.9 2024-09-14T11:13:39.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2.10 2024-09-14T11:13:39.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2.10 2024-09-14T11:13:39.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2.11 2024-09-14T11:13:39.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2.11 2024-09-14T11:13:39.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.0 2024-09-14T11:13:39.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.910+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.1 2024-09-14T11:13:39.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.911+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2 2024-09-14T11:13:39.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.911+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.3 2024-09-14T11:13:39.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.912+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.4 2024-09-14T11:13:39.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.912+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.5 2024-09-14T11:13:39.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.913+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.6 2024-09-14T11:13:39.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.913+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.7 2024-09-14T11:13:39.913 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.914+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.8 2024-09-14T11:13:39.914 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.915+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.9 2024-09-14T11:13:39.914 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.915+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.10 2024-09-14T11:13:39.918 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.919+0000 7f326ab36800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:13:39.918 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.919+0000 7f326ab36800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 2024-09-14T11:13:39.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.920+0000 7f326ab36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 info.flags=0x17 2024-09-14T11:13:39.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.920+0000 7f326ab36800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 to cache LRU end 2024-09-14T11:13:39.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.920+0000 7f326ab36800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:39.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.920+0000 7f326ab36800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37, ofs0, ns] 2024-09-14T11:13:39.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.920+0000 7f3149ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496987 cookie 94556277855952 notifier 7863 bl.length()=1007 2024-09-14T11:13:39.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.920+0000 7f3149ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 info.flags=0x17 2024-09-14T11:13:39.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.920+0000 7f3149ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 to cache LRU end 2024-09-14T11:13:39.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.920+0000 7f3149ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:39.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.922+0000 7f326ab36800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37]): orig_sources= new_sources= 2024-09-14T11:13:39.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.922+0000 7f326ab36800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37]): potential sources added=[] removed=[] 2024-09-14T11:13:39.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.922+0000 7f326ab36800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37]): orig_dests= new_dests= 2024-09-14T11:13:39.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.922+0000 7f326ab36800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37]): potential dests added=[] removed=[] 2024-09-14T11:13:39.925 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.926+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.0 2024-09-14T11:13:39.925 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.926+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.1 2024-09-14T11:13:39.925 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.926+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.2 2024-09-14T11:13:39.926 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.927+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.3 2024-09-14T11:13:39.926 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.927+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.4 2024-09-14T11:13:39.926 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.927+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.5 2024-09-14T11:13:39.927 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.928+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.6 2024-09-14T11:13:39.927 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.928+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.7 2024-09-14T11:13:39.927 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.928+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.8 2024-09-14T11:13:39.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.929+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.9 2024-09-14T11:13:39.928 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.929+0000 7f326ab36800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37.10 2024-09-14T11:13:39.929 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.930+0000 7f326ab36800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:13:39.929 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.930+0000 7f326ab36800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 2024-09-14T11:13:39.930 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.931+0000 7f326ab36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 info.flags=0x17 2024-09-14T11:13:39.930 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.931+0000 7f326ab36800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 to cache LRU end 2024-09-14T11:13:39.930 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.931+0000 7f326ab36800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:39.930 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.931+0000 7f326ab36800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37, ofs0, ns] 2024-09-14T11:13:39.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.931+0000 7f3149ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496988 cookie 94556277855952 notifier 7863 bl.length()=975 2024-09-14T11:13:39.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.931+0000 7f3149ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 info.flags=0x17 2024-09-14T11:13:39.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.931+0000 7f3149ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 to cache LRU end 2024-09-14T11:13:39.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.931+0000 7f3149ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:39.932 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.933+0000 7f326ab36800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37]): orig_sources= new_sources= 2024-09-14T11:13:39.932 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.933+0000 7f326ab36800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37]): potential sources added=[] removed=[] 2024-09-14T11:13:39.932 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.933+0000 7f326ab36800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37]): orig_dests= new_dests= 2024-09-14T11:13:39.932 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.933+0000 7f326ab36800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37]): potential dests added=[] removed=[] 2024-09-14T11:13:39.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.935+0000 7f326ab36800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:13:39.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.938+0000 7f311d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:39.939 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.940+0000 7f326ab36800 20 remove_watcher() i=0 2024-09-14T11:13:39.939 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.940+0000 7f326ab36800 2 removed watcher, disabling cache 2024-09-14T11:13:39.940 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.941+0000 7f326ab36800 20 remove_watcher() i=1 2024-09-14T11:13:39.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.942+0000 7f326ab36800 20 remove_watcher() i=2 2024-09-14T11:13:39.942 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.943+0000 7f326ab36800 20 remove_watcher() i=3 2024-09-14T11:13:39.943 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.944+0000 7f326ab36800 20 remove_watcher() i=4 2024-09-14T11:13:39.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.945+0000 7f326ab36800 20 remove_watcher() i=5 2024-09-14T11:13:39.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.946+0000 7f326ab36800 20 remove_watcher() i=6 2024-09-14T11:13:39.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:39.947+0000 7f326ab36800 20 remove_watcher() i=7 2024-09-14T11:13:39.960 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:13:39.990 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:39.990 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:40.031 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.032+0000 7f66da00e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.034 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.034+0000 7f66da00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.034 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.034+0000 7f66da00e800 20 realm 2024-09-14T11:13:40.034 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.034+0000 7f66da00e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.034 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.035+0000 7f66da00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.034 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.035+0000 7f66da00e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:40.034 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.035+0000 7f66da00e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.034 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.035+0000 7f66da00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.034 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.035+0000 7f66da00e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.036+0000 7f66da00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:40.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.036+0000 7f66da00e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.036+0000 7f66da00e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:40.035 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.036+0000 7f66da00e800 20 searching for the correct realm 2024-09-14T11:13:40.036 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.037+0000 7f66d581a640 0 -- 172.21.15.50:0/3254400855 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x55efa42b9b90 msgr2=0x7f66d00a9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:40.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.243+0000 7f66d601b640 0 -- 172.21.15.50:0/3254400855 >> [v2:172.21.15.118:6826/1082138742,v1:172.21.15.118:6827/1082138742] conn(0x7f66c801b040 msgr2=0x7f66c806ceb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:40.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.450+0000 7f66da00e800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:40.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.450+0000 7f66da00e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:40.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.450+0000 7f66da00e800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:40.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.450+0000 7f66da00e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:40.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.450+0000 7f66da00e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:40.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.450+0000 7f66da00e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:40.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.450+0000 7f66da00e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.451+0000 7f66da00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.451+0000 7f66da00e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.451+0000 7f66da00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:40.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.451+0000 7f66da00e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.452+0000 7f66da00e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:40.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.452+0000 7f66da00e800 20 zone default found 2024-09-14T11:13:40.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.452+0000 7f66da00e800 4 Realm: () 2024-09-14T11:13:40.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.452+0000 7f66da00e800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:40.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.452+0000 7f66da00e800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:40.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.452+0000 7f66da00e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:40.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.452+0000 7f66da00e800 20 zonegroup default 2024-09-14T11:13:40.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.452+0000 7f66da00e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.452+0000 7f66da00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.452+0000 7f66da00e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.452+0000 7f66da00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.452+0000 7f66da00e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.453+0000 7f66da00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.453+0000 7f66da00e800 20 started sync module instance, tier type = 2024-09-14T11:13:40.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.453+0000 7f66da00e800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:40.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.462+0000 7f66da00e800 20 add_watcher() i=0 2024-09-14T11:13:40.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.462+0000 7f66da00e800 20 add_watcher() i=1 2024-09-14T11:13:40.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.462+0000 7f66da00e800 20 add_watcher() i=2 2024-09-14T11:13:40.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.462+0000 7f66da00e800 20 add_watcher() i=3 2024-09-14T11:13:40.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.462+0000 7f66da00e800 20 add_watcher() i=4 2024-09-14T11:13:40.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.462+0000 7f66da00e800 20 add_watcher() i=5 2024-09-14T11:13:40.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.462+0000 7f66da00e800 20 add_watcher() i=6 2024-09-14T11:13:40.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.463+0000 7f66da00e800 20 add_watcher() i=7 2024-09-14T11:13:40.462 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.463+0000 7f66da00e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:40.464 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.465+0000 7f65877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:40.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.465+0000 7f66da00e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:40.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.465+0000 7f66da00e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:40.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.465+0000 7f66da00e800 5 note: GC not initialized 2024-09-14T11:13:40.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.466+0000 7f65867fc640 20 reqs_thread_entry: start 2024-09-14T11:13:40.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.466+0000 7f66da00e800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:40.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.466+0000 7f66da00e800 20 Filter name: none 2024-09-14T11:13:40.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.466+0000 7f64f7fff640 20 reqs_thread_entry: start 2024-09-14T11:13:40.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.466+0000 7f66da00e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.466+0000 7f66da00e800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:13:40.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.466+0000 7f66da00e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.467+0000 7f66da00e800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:13:40.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.467+0000 7f66da00e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:40.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.467+0000 7f66da00e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.467+0000 7f66da00e800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:13:40.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.467+0000 7f66da00e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.468+0000 7f66da00e800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:13:40.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.468+0000 7f66da00e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:40.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.469+0000 7f65877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:40.470 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.472+0000 7f66da00e800 20 remove_watcher() i=0 2024-09-14T11:13:40.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.472+0000 7f66da00e800 2 removed watcher, disabling cache 2024-09-14T11:13:40.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.473+0000 7f66da00e800 20 remove_watcher() i=1 2024-09-14T11:13:40.473 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.474+0000 7f66da00e800 20 remove_watcher() i=2 2024-09-14T11:13:40.474 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.475+0000 7f66da00e800 20 remove_watcher() i=3 2024-09-14T11:13:40.475 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.476+0000 7f66da00e800 20 remove_watcher() i=4 2024-09-14T11:13:40.476 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.477+0000 7f66da00e800 20 remove_watcher() i=5 2024-09-14T11:13:40.477 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.478+0000 7f66da00e800 20 remove_watcher() i=6 2024-09-14T11:13:40.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:40.479+0000 7f66da00e800 20 remove_watcher() i=7 2024-09-14T11:13:40.489 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:40.489 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:13:40.489 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: abort-at-logrecord-writes id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:13:40.489 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:40.491 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.492 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:40.514 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.514 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:40.736 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.736 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:40.872 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-14T11:13:40.872 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:40.873 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.873 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:40.922 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.922 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:40.980 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.980 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:41.019 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:41.019 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:41.056 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:41.056 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:41.092 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:41.093 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:41.130 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:41.130 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:41.167 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:41.167 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:41.204 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:41.204 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:41.240 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:41.241 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:41.277 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:41.277 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:41.313 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:41.313 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:41.351 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:41.351 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:41.391 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:41.391 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:41.427 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:41.428 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:41.464 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:41.464 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:41.500 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:41.501 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:41.537 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:41.537 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:41.575 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:41.575 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:41.612 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:41.612 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:41.649 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:41.649 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:41.686 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:41.686 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:41.723 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:13:41.753 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:41.753 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:41.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:41.792+0000 7f7872411800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:41.794+0000 7f7872411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:41.794+0000 7f7872411800 20 realm 2024-09-14T11:13:41.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:41.794+0000 7f7872411800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:41.794+0000 7f7872411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:41.794+0000 7f7872411800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:41.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:41.795+0000 7f7872411800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:41.795+0000 7f7872411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:41.795+0000 7f7872411800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:41.795+0000 7f7872411800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:41.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:41.795+0000 7f7872411800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:41.796+0000 7f7872411800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:41.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:41.796+0000 7f7872411800 20 searching for the correct realm 2024-09-14T11:13:41.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:41.799+0000 7f786e323640 0 -- 172.21.15.50:0/934541841 >> [v2:172.21.15.118:6816/4154782182,v1:172.21.15.118:6817/4154782182] conn(0x557750990770 msgr2=0x557750992c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:41.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:41.802+0000 7f786db22640 0 -- 172.21.15.50:0/934541841 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f78680773f0 msgr2=0x7f7868077870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:42.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.009+0000 7f7872411800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:42.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.009+0000 7f7872411800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:42.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.009+0000 7f7872411800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:42.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.009+0000 7f7872411800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:42.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.009+0000 7f7872411800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:42.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.009+0000 7f7872411800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:42.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.009+0000 7f7872411800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.009+0000 7f7872411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.009+0000 7f7872411800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.010 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.009+0000 7f7872411800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:42.010 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.009+0000 7f7872411800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.010 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.010+0000 7f7872411800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:42.011 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.010+0000 7f7872411800 20 zone default found 2024-09-14T11:13:42.011 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.010+0000 7f7872411800 4 Realm: () 2024-09-14T11:13:42.011 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.010+0000 7f7872411800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:42.011 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.010+0000 7f7872411800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:42.011 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.010+0000 7f7872411800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:42.011 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.010+0000 7f7872411800 20 zonegroup default 2024-09-14T11:13:42.011 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.010+0000 7f7872411800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.011 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.010+0000 7f7872411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.011 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.010+0000 7f7872411800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.011 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.010+0000 7f7872411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.011 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.010+0000 7f7872411800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.011 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.011+0000 7f7872411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.011 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.011+0000 7f7872411800 20 started sync module instance, tier type = 2024-09-14T11:13:42.011 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.011+0000 7f7872411800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:42.018 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.019+0000 7f7872411800 20 add_watcher() i=0 2024-09-14T11:13:42.019 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.019+0000 7f7872411800 20 add_watcher() i=1 2024-09-14T11:13:42.019 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.019+0000 7f7872411800 20 add_watcher() i=2 2024-09-14T11:13:42.019 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.019+0000 7f7872411800 20 add_watcher() i=3 2024-09-14T11:13:42.019 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.019+0000 7f7872411800 20 add_watcher() i=4 2024-09-14T11:13:42.019 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.019+0000 7f7872411800 20 add_watcher() i=5 2024-09-14T11:13:42.019 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.019+0000 7f7872411800 20 add_watcher() i=6 2024-09-14T11:13:42.019 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.020+0000 7f7872411800 20 add_watcher() i=7 2024-09-14T11:13:42.019 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.020+0000 7f7872411800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:42.021 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.022+0000 7f771f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:42.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.022+0000 7f7872411800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:42.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.022+0000 7f7872411800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:42.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.022+0000 7f7872411800 5 note: GC not initialized 2024-09-14T11:13:42.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.022+0000 7f771e7fc640 20 reqs_thread_entry: start 2024-09-14T11:13:42.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.023+0000 7f7872411800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:42.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.023+0000 7f7872411800 20 Filter name: none 2024-09-14T11:13:42.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.023+0000 7f768ffff640 20 reqs_thread_entry: start 2024-09-14T11:13:42.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.023+0000 7f7872411800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.023 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.023+0000 7f7872411800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:13:42.023 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.023+0000 7f7872411800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.023 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.024+0000 7f7872411800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:13:42.023 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.024+0000 7f7872411800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:42.023 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.024+0000 7f7872411800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.023 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.024+0000 7f7872411800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:13:42.024 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.024+0000 7f7872411800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.024 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.024+0000 7f7872411800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:13:42.024 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.024+0000 7f7872411800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:42.025 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.026+0000 7f771f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:42.027 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.029+0000 7f7872411800 20 remove_watcher() i=0 2024-09-14T11:13:42.028 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.029+0000 7f7872411800 2 removed watcher, disabling cache 2024-09-14T11:13:42.029 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.030+0000 7f7872411800 20 remove_watcher() i=1 2024-09-14T11:13:42.030 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.031+0000 7f7872411800 20 remove_watcher() i=2 2024-09-14T11:13:42.031 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.032+0000 7f7872411800 20 remove_watcher() i=3 2024-09-14T11:13:42.032 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.033+0000 7f7872411800 20 remove_watcher() i=4 2024-09-14T11:13:42.033 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.034+0000 7f7872411800 20 remove_watcher() i=5 2024-09-14T11:13:42.034 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.034+0000 7f7872411800 20 remove_watcher() i=6 2024-09-14T11:13:42.034 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.035+0000 7f7872411800 20 remove_watcher() i=7 2024-09-14T11:13:42.046 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:42.046 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:13:42.046 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-change-reshard-state id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:13:42.046 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:42.048 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-14T11:13:42.082 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:42.083 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:42.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.124+0000 7fe637f24800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.125+0000 7fe637f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.125+0000 7fe637f24800 20 realm 2024-09-14T11:13:42.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.125+0000 7fe637f24800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.125+0000 7fe637f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.125+0000 7fe637f24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:42.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.125+0000 7fe637f24800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.126+0000 7fe637f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.126+0000 7fe637f24800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.126+0000 7fe637f24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:42.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.126+0000 7fe637f24800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.127+0000 7fe637f24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:42.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.127+0000 7fe637f24800 20 searching for the correct realm 2024-09-14T11:13:42.129 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.130+0000 7fe633301640 0 -- 172.21.15.50:0/3671181726 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fe62c06b920 msgr2=0x7fe62c055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:42.334 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.335+0000 7fe634303640 0 -- 172.21.15.50:0/3671181726 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x56096b7a76b0 msgr2=0x56096b7a9b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:42.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.339+0000 7fe637f24800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:42.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.339+0000 7fe637f24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:42.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.339+0000 7fe637f24800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:42.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.339+0000 7fe637f24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:42.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.339+0000 7fe637f24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:42.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.339+0000 7fe637f24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:42.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.339+0000 7fe637f24800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.339+0000 7fe637f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.339+0000 7fe637f24800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.339+0000 7fe637f24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:42.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.339+0000 7fe637f24800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.340+0000 7fe637f24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:42.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.340+0000 7fe637f24800 20 zone default found 2024-09-14T11:13:42.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.340+0000 7fe637f24800 4 Realm: () 2024-09-14T11:13:42.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.340+0000 7fe637f24800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:42.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.340+0000 7fe637f24800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:42.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.340+0000 7fe637f24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:42.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.340+0000 7fe637f24800 20 zonegroup default 2024-09-14T11:13:42.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.340+0000 7fe637f24800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.340+0000 7fe637f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.340+0000 7fe637f24800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.340+0000 7fe637f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.340+0000 7fe637f24800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.340+0000 7fe637f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.341+0000 7fe637f24800 20 started sync module instance, tier type = 2024-09-14T11:13:42.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.341+0000 7fe637f24800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:42.348 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.349+0000 7fe637f24800 20 add_watcher() i=0 2024-09-14T11:13:42.348 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.349+0000 7fe637f24800 20 add_watcher() i=1 2024-09-14T11:13:42.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.349+0000 7fe637f24800 20 add_watcher() i=2 2024-09-14T11:13:42.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.349+0000 7fe637f24800 20 add_watcher() i=3 2024-09-14T11:13:42.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.349+0000 7fe637f24800 20 add_watcher() i=4 2024-09-14T11:13:42.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.349+0000 7fe637f24800 20 add_watcher() i=5 2024-09-14T11:13:42.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.349+0000 7fe637f24800 20 add_watcher() i=6 2024-09-14T11:13:42.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.350+0000 7fe637f24800 20 add_watcher() i=7 2024-09-14T11:13:42.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.350+0000 7fe637f24800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:42.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.352+0000 7fe4e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:42.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.353+0000 7fe637f24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:42.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.353+0000 7fe637f24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:42.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.353+0000 7fe637f24800 5 note: GC not initialized 2024-09-14T11:13:42.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.353+0000 7fe4e8fe1640 20 reqs_thread_entry: start 2024-09-14T11:13:42.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.353+0000 7fe637f24800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:42.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.353+0000 7fe637f24800 20 Filter name: none 2024-09-14T11:13:42.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.353+0000 7fe4627fc640 20 reqs_thread_entry: start 2024-09-14T11:13:42.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.353+0000 7fe637f24800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:13:42.353 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.353+0000 7fe637f24800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.354 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.353+0000 7fe637f24800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:13:42.354 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.353+0000 7fe637f24800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:13:42.354 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.353+0000 7fe637f24800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:13:42.354 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.353+0000 7fe637f24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 : miss 2024-09-14T11:13:42.354 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.353+0000 7fe637f24800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.354 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.354+0000 7fe637f24800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:13:42.354 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.354+0000 7fe637f24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 info.flags=0x17 2024-09-14T11:13:42.354 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.354+0000 7fe637f24800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 to cache LRU end 2024-09-14T11:13:42.354 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.354+0000 7fe637f24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:42.354 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.354+0000 7fe637f24800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:42.354 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.354+0000 7fe637f24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 2024-09-14T11:13:42.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.359+0000 7fe637f24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 info.flags=0x17 2024-09-14T11:13:42.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.359+0000 7fe637f24800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 to cache LRU end 2024-09-14T11:13:42.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.359+0000 7fe637f24800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:42.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.359+0000 7fe637f24800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38, ofs0, ns] 2024-09-14T11:13:42.360 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.360+0000 7fe512ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497117 cookie 94598457945776 notifier 7409 bl.length()=1015 2024-09-14T11:13:42.360 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.360+0000 7fe512ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 info.flags=0x17 2024-09-14T11:13:42.360 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.360+0000 7fe512ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 to cache LRU end 2024-09-14T11:13:42.360 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.360+0000 7fe512ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:42.360 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.361+0000 7fe637f24800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38]): orig_sources= new_sources= 2024-09-14T11:13:42.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.361+0000 7fe637f24800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38]): potential sources added=[] removed=[] 2024-09-14T11:13:42.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.361+0000 7fe637f24800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38]): orig_dests= new_dests= 2024-09-14T11:13:42.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.361+0000 7fe637f24800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38]): potential dests added=[] removed=[] 2024-09-14T11:13:42.366 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.0 2024-09-14T11:13:42.366 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.0 2024-09-14T11:13:42.366 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.1 2024-09-14T11:13:42.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.1 2024-09-14T11:13:42.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.2 2024-09-14T11:13:42.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.2 2024-09-14T11:13:42.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.3 2024-09-14T11:13:42.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.3 2024-09-14T11:13:42.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.4 2024-09-14T11:13:42.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.4 2024-09-14T11:13:42.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.5 2024-09-14T11:13:42.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.5 2024-09-14T11:13:42.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.6 2024-09-14T11:13:42.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.6 2024-09-14T11:13:42.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.7 2024-09-14T11:13:42.367 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.7 2024-09-14T11:13:42.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.8 2024-09-14T11:13:42.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.8 2024-09-14T11:13:42.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.9 2024-09-14T11:13:42.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.9 2024-09-14T11:13:42.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.10 2024-09-14T11:13:42.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.10 2024-09-14T11:13:42.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.11 2024-09-14T11:13:42.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.11 2024-09-14T11:13:42.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.0 2024-09-14T11:13:42.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.367+0000 7fe637f24800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1 2024-09-14T11:13:42.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.368+0000 7fe637f24800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.2 2024-09-14T11:13:42.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.368+0000 7fe637f24800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.3 2024-09-14T11:13:42.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.369+0000 7fe637f24800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.4 2024-09-14T11:13:42.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.369+0000 7fe637f24800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.5 2024-09-14T11:13:42.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.370+0000 7fe637f24800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.6 2024-09-14T11:13:42.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.370+0000 7fe637f24800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.7 2024-09-14T11:13:42.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.371+0000 7fe637f24800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.8 2024-09-14T11:13:42.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.371+0000 7fe637f24800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.9 2024-09-14T11:13:42.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.372+0000 7fe637f24800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.10 2024-09-14T11:13:42.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.375+0000 7fe637f24800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-14T11:13:42.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.375+0000 7fe637f24800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-14T11:13:42.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.384+0000 7fe637f24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:13:42.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.384+0000 7fe637f24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 2024-09-14T11:13:42.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.385+0000 7fe637f24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 info.flags=0x17 2024-09-14T11:13:42.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.385+0000 7fe637f24800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 to cache LRU end 2024-09-14T11:13:42.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.385+0000 7fe637f24800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:42.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.385+0000 7fe637f24800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38, ofs0, ns] 2024-09-14T11:13:42.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.385+0000 7fe5127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497118 cookie 94598457945776 notifier 7409 bl.length()=983 2024-09-14T11:13:42.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.385+0000 7fe5127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 info.flags=0x17 2024-09-14T11:13:42.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.385+0000 7fe5127fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 to cache LRU end 2024-09-14T11:13:42.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.385+0000 7fe5127fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:42.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.387+0000 7fe637f24800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38]): orig_sources= new_sources= 2024-09-14T11:13:42.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.387+0000 7fe637f24800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38]): potential sources added=[] removed=[] 2024-09-14T11:13:42.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.387+0000 7fe637f24800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38]): orig_dests= new_dests= 2024-09-14T11:13:42.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.387+0000 7fe637f24800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38]): potential dests added=[] removed=[] 2024-09-14T11:13:42.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.387+0000 7fe637f24800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-14T11:13:42.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.389+0000 7fe4e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:42.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.391+0000 7fe637f24800 20 remove_watcher() i=0 2024-09-14T11:13:42.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.391+0000 7fe637f24800 2 removed watcher, disabling cache 2024-09-14T11:13:42.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.392+0000 7fe637f24800 20 remove_watcher() i=1 2024-09-14T11:13:42.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.393+0000 7fe637f24800 20 remove_watcher() i=2 2024-09-14T11:13:42.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.394+0000 7fe637f24800 20 remove_watcher() i=3 2024-09-14T11:13:42.394 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.395+0000 7fe637f24800 20 remove_watcher() i=4 2024-09-14T11:13:42.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.396+0000 7fe637f24800 20 remove_watcher() i=5 2024-09-14T11:13:42.396 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.397+0000 7fe637f24800 20 remove_watcher() i=6 2024-09-14T11:13:42.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.398+0000 7fe637f24800 20 remove_watcher() i=7 2024-09-14T11:13:42.410 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:13:42.439 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:42.439 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:42.478 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.479+0000 7fbcb311f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.481+0000 7fbcb311f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.481+0000 7fbcb311f800 20 realm 2024-09-14T11:13:42.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.481+0000 7fbcb311f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.481+0000 7fbcb311f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.480 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.481+0000 7fbcb311f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:42.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.481+0000 7fbcb311f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.481+0000 7fbcb311f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.481+0000 7fbcb311f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.482+0000 7fbcb311f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:42.481 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.482+0000 7fbcb311f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.482 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.482+0000 7fbcb311f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:42.482 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.482+0000 7fbcb311f800 20 searching for the correct realm 2024-09-14T11:13:42.485 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.486+0000 7fbcae6a8640 0 -- 172.21.15.50:0/2394926994 >> [v2:172.21.15.50:6816/1957449887,v1:172.21.15.50:6817/1957449887] conn(0x55b1e605b1c0 msgr2=0x55b1e605d5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:42.488 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.489+0000 7fbcaeea9640 0 -- 172.21.15.50:0/2394926994 >> [v2:172.21.15.50:6800/2565843969,v1:172.21.15.50:6801/2565843969] conn(0x55b1e6057950 msgr2=0x55b1e6059d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:42.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.493+0000 7fbcb311f800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:42.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.493+0000 7fbcb311f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:42.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.493+0000 7fbcb311f800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:42.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.493+0000 7fbcb311f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:42.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.493+0000 7fbcb311f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:42.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.493+0000 7fbcb311f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:42.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.493+0000 7fbcb311f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.493+0000 7fbcb311f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.493+0000 7fbcb311f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.493+0000 7fbcb311f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:42.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.493+0000 7fbcb311f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.493+0000 7fbcb311f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:42.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.493+0000 7fbcb311f800 20 zone default found 2024-09-14T11:13:42.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.493+0000 7fbcb311f800 4 Realm: () 2024-09-14T11:13:42.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.493+0000 7fbcb311f800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:42.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.493+0000 7fbcb311f800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:42.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.493+0000 7fbcb311f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:42.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.493+0000 7fbcb311f800 20 zonegroup default 2024-09-14T11:13:42.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.493+0000 7fbcb311f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.494+0000 7fbcb311f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.494+0000 7fbcb311f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.494+0000 7fbcb311f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.494+0000 7fbcb311f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.494+0000 7fbcb311f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.494+0000 7fbcb311f800 20 started sync module instance, tier type = 2024-09-14T11:13:42.495 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.494+0000 7fbcb311f800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:42.501 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.502+0000 7fbcb311f800 20 add_watcher() i=0 2024-09-14T11:13:42.501 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.502+0000 7fbcb311f800 20 add_watcher() i=1 2024-09-14T11:13:42.501 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.502+0000 7fbcb311f800 20 add_watcher() i=2 2024-09-14T11:13:42.502 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.502+0000 7fbcb311f800 20 add_watcher() i=3 2024-09-14T11:13:42.502 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.502+0000 7fbcb311f800 20 add_watcher() i=4 2024-09-14T11:13:42.502 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.502+0000 7fbcb311f800 20 add_watcher() i=5 2024-09-14T11:13:42.502 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.502+0000 7fbcb311f800 20 add_watcher() i=6 2024-09-14T11:13:42.502 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.503+0000 7fbcb311f800 20 add_watcher() i=7 2024-09-14T11:13:42.502 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.503+0000 7fbcb311f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:42.504 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.505+0000 7fbb657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:42.505 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.505+0000 7fbcb311f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:42.505 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.505+0000 7fbcb311f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:42.505 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.505+0000 7fbcb311f800 5 note: GC not initialized 2024-09-14T11:13:42.505 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.505+0000 7fbadffff640 20 reqs_thread_entry: start 2024-09-14T11:13:42.505 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.505+0000 7fbcb311f800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:42.505 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.505+0000 7fbcb311f800 20 Filter name: none 2024-09-14T11:13:42.505 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.505+0000 7fbaddffb640 20 reqs_thread_entry: start 2024-09-14T11:13:42.505 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.506+0000 7fbcb311f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.506 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.506+0000 7fbcb311f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:13:42.506 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.506+0000 7fbcb311f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.506 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.506+0000 7fbcb311f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:13:42.506 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.506+0000 7fbcb311f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:42.506 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.506+0000 7fbcb311f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.506 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.507+0000 7fbcb311f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:13:42.507 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.507+0000 7fbcb311f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.507 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.507+0000 7fbcb311f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:13:42.507 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.507+0000 7fbcb311f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:42.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.509+0000 7fbb657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:42.510 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.511+0000 7fbcb311f800 20 remove_watcher() i=0 2024-09-14T11:13:42.510 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.511+0000 7fbcb311f800 2 removed watcher, disabling cache 2024-09-14T11:13:42.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.512+0000 7fbcb311f800 20 remove_watcher() i=1 2024-09-14T11:13:42.512 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.513+0000 7fbcb311f800 20 remove_watcher() i=2 2024-09-14T11:13:42.513 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.514+0000 7fbcb311f800 20 remove_watcher() i=3 2024-09-14T11:13:42.514 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.515+0000 7fbcb311f800 20 remove_watcher() i=4 2024-09-14T11:13:42.515 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.516+0000 7fbcb311f800 20 remove_watcher() i=5 2024-09-14T11:13:42.515 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.516+0000 7fbcb311f800 20 remove_watcher() i=6 2024-09-14T11:13:42.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.517+0000 7fbcb311f800 20 remove_watcher() i=7 2024-09-14T11:13:42.527 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:42.528 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:13:42.528 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-change-reshard-state id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:13:42.528 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:42.529 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:42.529 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:42.568 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:42.568 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:42.626 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:13:42.659 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:42.659 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:42.698 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.699+0000 7f597ed2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.700+0000 7f597ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.700+0000 7f597ed2e800 20 realm 2024-09-14T11:13:42.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.700+0000 7f597ed2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.701+0000 7f597ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.701+0000 7f597ed2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:42.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.701+0000 7f597ed2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.701+0000 7f597ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.700 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.701+0000 7f597ed2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.702+0000 7f597ed2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:42.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.702+0000 7f597ed2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.702+0000 7f597ed2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:42.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.702+0000 7f597ed2e800 20 searching for the correct realm 2024-09-14T11:13:42.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.705+0000 7f597a2dc640 0 -- 172.21.15.50:0/1894485100 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f59740e2240 msgr2=0x7f59740a4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:42.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:42.910+0000 7f597aadd640 0 -- 172.21.15.50:0/1894485100 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f58440874e0 msgr2=0x7f5844089910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:43.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.117+0000 7f597ed2e800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:43.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.117+0000 7f597ed2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:43.116 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.117+0000 7f597ed2e800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:43.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.117+0000 7f597ed2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:43.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.117+0000 7f597ed2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:43.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.117+0000 7f597ed2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:43.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.117+0000 7f597ed2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.117+0000 7f597ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:43.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.117+0000 7f597ed2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.117+0000 7f597ed2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:43.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.117+0000 7f597ed2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.117+0000 7f597ed2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:43.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.117+0000 7f597ed2e800 20 zone default found 2024-09-14T11:13:43.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.117+0000 7f597ed2e800 4 Realm: () 2024-09-14T11:13:43.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.117+0000 7f597ed2e800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:43.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.117+0000 7f597ed2e800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:43.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.117+0000 7f597ed2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:43.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.117+0000 7f597ed2e800 20 zonegroup default 2024-09-14T11:13:43.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.117+0000 7f597ed2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.118+0000 7f597ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:43.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.118+0000 7f597ed2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.118+0000 7f597ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:43.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.118+0000 7f597ed2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.118+0000 7f597ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:43.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.118+0000 7f597ed2e800 20 started sync module instance, tier type = 2024-09-14T11:13:43.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.118+0000 7f597ed2e800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:43.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.127+0000 7f597ed2e800 20 add_watcher() i=0 2024-09-14T11:13:43.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.127+0000 7f597ed2e800 20 add_watcher() i=1 2024-09-14T11:13:43.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.127+0000 7f597ed2e800 20 add_watcher() i=2 2024-09-14T11:13:43.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.127+0000 7f597ed2e800 20 add_watcher() i=3 2024-09-14T11:13:43.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.127+0000 7f597ed2e800 20 add_watcher() i=4 2024-09-14T11:13:43.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.127+0000 7f597ed2e800 20 add_watcher() i=5 2024-09-14T11:13:43.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.127+0000 7f597ed2e800 20 add_watcher() i=6 2024-09-14T11:13:43.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.128+0000 7f597ed2e800 20 add_watcher() i=7 2024-09-14T11:13:43.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.128+0000 7f597ed2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:43.129 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.130+0000 7f58317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:43.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.130+0000 7f597ed2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:43.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.130+0000 7f597ed2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:43.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.130+0000 7f597ed2e800 5 note: GC not initialized 2024-09-14T11:13:43.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.130+0000 7f57abfff640 20 reqs_thread_entry: start 2024-09-14T11:13:43.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.130+0000 7f597ed2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:43.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.131+0000 7f597ed2e800 20 Filter name: none 2024-09-14T11:13:43.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.131+0000 7f57a9ffb640 20 reqs_thread_entry: start 2024-09-14T11:13:43.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.131+0000 7f597ed2e800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:13:43.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.131+0000 7f597ed2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.131+0000 7f597ed2e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:13:43.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.131+0000 7f597ed2e800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:13:43.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.131+0000 7f597ed2e800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:13:43.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.131+0000 7f597ed2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 : miss 2024-09-14T11:13:43.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.131+0000 7f597ed2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.132+0000 7f597ed2e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:13:43.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.132+0000 7f597ed2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 info.flags=0x17 2024-09-14T11:13:43.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.132+0000 7f597ed2e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 to cache LRU end 2024-09-14T11:13:43.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.132+0000 7f597ed2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:43.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.132+0000 7f597ed2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:43.132 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.132+0000 7f597ed2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 2024-09-14T11:13:43.135 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.136+0000 7f597ed2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 info.flags=0x17 2024-09-14T11:13:43.135 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.136+0000 7f597ed2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 to cache LRU end 2024-09-14T11:13:43.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.136+0000 7f597ed2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:43.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.136+0000 7f597ed2e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38, ofs0, ns] 2024-09-14T11:13:43.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.137+0000 7f585e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497119 cookie 94811329173840 notifier 7442 bl.length()=1015 2024-09-14T11:13:43.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.137+0000 7f585e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 info.flags=0x17 2024-09-14T11:13:43.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.137+0000 7f585e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 to cache LRU end 2024-09-14T11:13:43.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.137+0000 7f585e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:43.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.138+0000 7f597ed2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38]): orig_sources= new_sources= 2024-09-14T11:13:43.138 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.138+0000 7f597ed2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38]): potential sources added=[] removed=[] 2024-09-14T11:13:43.138 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.138+0000 7f597ed2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38]): orig_dests= new_dests= 2024-09-14T11:13:43.138 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.138+0000 7f597ed2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38]): potential dests added=[] removed=[] 2024-09-14T11:13:43.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.0 2024-09-14T11:13:43.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.0 2024-09-14T11:13:43.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.1 2024-09-14T11:13:43.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.1 2024-09-14T11:13:43.142 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.2 2024-09-14T11:13:43.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.2 2024-09-14T11:13:43.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.3 2024-09-14T11:13:43.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.3 2024-09-14T11:13:43.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.4 2024-09-14T11:13:43.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.4 2024-09-14T11:13:43.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.5 2024-09-14T11:13:43.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.5 2024-09-14T11:13:43.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.6 2024-09-14T11:13:43.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.6 2024-09-14T11:13:43.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.7 2024-09-14T11:13:43.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.7 2024-09-14T11:13:43.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.8 2024-09-14T11:13:43.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.8 2024-09-14T11:13:43.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.9 2024-09-14T11:13:43.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.9 2024-09-14T11:13:43.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.10 2024-09-14T11:13:43.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.10 2024-09-14T11:13:43.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.11 2024-09-14T11:13:43.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1.11 2024-09-14T11:13:43.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.0 2024-09-14T11:13:43.144 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.143+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1 2024-09-14T11:13:43.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.144+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.2 2024-09-14T11:13:43.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.144+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.3 2024-09-14T11:13:43.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.144+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.4 2024-09-14T11:13:43.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.145+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.5 2024-09-14T11:13:43.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.146+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.6 2024-09-14T11:13:43.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.146+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.7 2024-09-14T11:13:43.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.147+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.8 2024-09-14T11:13:43.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.147+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.9 2024-09-14T11:13:43.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.148+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.10 2024-09-14T11:13:43.151 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.152+0000 7f597ed2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:13:43.151 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.152+0000 7f597ed2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 2024-09-14T11:13:43.152 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.153+0000 7f597ed2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 info.flags=0x17 2024-09-14T11:13:43.152 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.153+0000 7f597ed2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 to cache LRU end 2024-09-14T11:13:43.152 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.153+0000 7f597ed2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:43.152 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.153+0000 7f597ed2e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38, ofs0, ns] 2024-09-14T11:13:43.153 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.153+0000 7f585dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497120 cookie 94811329173840 notifier 7442 bl.length()=1015 2024-09-14T11:13:43.153 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.153+0000 7f585dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 info.flags=0x17 2024-09-14T11:13:43.153 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.153+0000 7f585dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 to cache LRU end 2024-09-14T11:13:43.153 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.153+0000 7f585dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:43.154 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.155+0000 7f597ed2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38]): orig_sources= new_sources= 2024-09-14T11:13:43.154 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.155+0000 7f597ed2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38]): potential sources added=[] removed=[] 2024-09-14T11:13:43.154 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.155+0000 7f597ed2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38]): orig_dests= new_dests= 2024-09-14T11:13:43.154 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.155+0000 7f597ed2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38]): potential dests added=[] removed=[] 2024-09-14T11:13:43.156 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.157+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.0 2024-09-14T11:13:43.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.158+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.1 2024-09-14T11:13:43.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.158+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.2 2024-09-14T11:13:43.157 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.158+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.3 2024-09-14T11:13:43.158 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.158+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.4 2024-09-14T11:13:43.158 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.159+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.5 2024-09-14T11:13:43.158 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.159+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.6 2024-09-14T11:13:43.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.159+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.7 2024-09-14T11:13:43.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.160+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.8 2024-09-14T11:13:43.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.160+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.9 2024-09-14T11:13:43.159 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.160+0000 7f597ed2e800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38.10 2024-09-14T11:13:43.160 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.161+0000 7f597ed2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:13:43.160 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.161+0000 7f597ed2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 2024-09-14T11:13:43.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.162+0000 7f597ed2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 info.flags=0x17 2024-09-14T11:13:43.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.162+0000 7f597ed2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 to cache LRU end 2024-09-14T11:13:43.162 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.162+0000 7f597ed2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:43.162 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.162+0000 7f597ed2e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38, ofs0, ns] 2024-09-14T11:13:43.162 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.162+0000 7f585dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497121 cookie 94811329173840 notifier 7442 bl.length()=983 2024-09-14T11:13:43.162 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.162+0000 7f585dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 info.flags=0x17 2024-09-14T11:13:43.162 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.162+0000 7f585dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 to cache LRU end 2024-09-14T11:13:43.162 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.162+0000 7f585dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:43.163 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.164+0000 7f597ed2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38]): orig_sources= new_sources= 2024-09-14T11:13:43.163 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.164+0000 7f597ed2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38]): potential sources added=[] removed=[] 2024-09-14T11:13:43.163 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.164+0000 7f597ed2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38]): orig_dests= new_dests= 2024-09-14T11:13:43.163 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.164+0000 7f597ed2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38]): potential dests added=[] removed=[] 2024-09-14T11:13:43.165 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.166+0000 7f597ed2e800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:13:43.167 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.168+0000 7f58317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:43.169 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.170+0000 7f597ed2e800 20 remove_watcher() i=0 2024-09-14T11:13:43.169 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.170+0000 7f597ed2e800 2 removed watcher, disabling cache 2024-09-14T11:13:43.170 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.171+0000 7f597ed2e800 20 remove_watcher() i=1 2024-09-14T11:13:43.171 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.172+0000 7f597ed2e800 20 remove_watcher() i=2 2024-09-14T11:13:43.172 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.173+0000 7f597ed2e800 20 remove_watcher() i=3 2024-09-14T11:13:43.173 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.174+0000 7f597ed2e800 20 remove_watcher() i=4 2024-09-14T11:13:43.174 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.175+0000 7f597ed2e800 20 remove_watcher() i=5 2024-09-14T11:13:43.175 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.176+0000 7f597ed2e800 20 remove_watcher() i=6 2024-09-14T11:13:43.176 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.177+0000 7f597ed2e800 20 remove_watcher() i=7 2024-09-14T11:13:43.190 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:13:43.219 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:43.220 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:43.259 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.260+0000 7f0bd93a7800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.262 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.263+0000 7f0bd93a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:43.262 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.263+0000 7f0bd93a7800 20 realm 2024-09-14T11:13:43.262 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.263+0000 7f0bd93a7800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.262 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.263+0000 7f0bd93a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:43.262 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.263+0000 7f0bd93a7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:43.262 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.263+0000 7f0bd93a7800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.262 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.263+0000 7f0bd93a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:43.263 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.263+0000 7f0bd93a7800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.263 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.264+0000 7f0bd93a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:43.263 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.264+0000 7f0bd93a7800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.263 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.264+0000 7f0bd93a7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:43.263 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.264+0000 7f0bd93a7800 20 searching for the correct realm 2024-09-14T11:13:43.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.268+0000 7f0bd6690640 0 -- 172.21.15.50:0/3854127637 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f0bd0020040 msgr2=0x7f0bd0070040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:43.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.271+0000 7f0bd6e91640 0 -- 172.21.15.50:0/3854127637 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f0bd0067a80 msgr2=0x7f0bd0068aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:43.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.275+0000 7f0bd93a7800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:43.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.275+0000 7f0bd93a7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:43.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.275+0000 7f0bd93a7800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:43.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.275+0000 7f0bd93a7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:43.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.275+0000 7f0bd93a7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:43.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.275+0000 7f0bd93a7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:43.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.275+0000 7f0bd93a7800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.276+0000 7f0bd93a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:43.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.276+0000 7f0bd93a7800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.276+0000 7f0bd93a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:43.276 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.276+0000 7f0bd93a7800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.276 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.276+0000 7f0bd93a7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:43.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.276+0000 7f0bd93a7800 20 zone default found 2024-09-14T11:13:43.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.276+0000 7f0bd93a7800 4 Realm: () 2024-09-14T11:13:43.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.276+0000 7f0bd93a7800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:43.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.276+0000 7f0bd93a7800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:43.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.276+0000 7f0bd93a7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:43.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.276+0000 7f0bd93a7800 20 zonegroup default 2024-09-14T11:13:43.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.276+0000 7f0bd93a7800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.276+0000 7f0bd93a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:43.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.276+0000 7f0bd93a7800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.277+0000 7f0bd93a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:43.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.277+0000 7f0bd93a7800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.277+0000 7f0bd93a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:43.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.277+0000 7f0bd93a7800 20 started sync module instance, tier type = 2024-09-14T11:13:43.277 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.277+0000 7f0bd93a7800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:43.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.285+0000 7f0bd93a7800 20 add_watcher() i=0 2024-09-14T11:13:43.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.285+0000 7f0bd93a7800 20 add_watcher() i=1 2024-09-14T11:13:43.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.285+0000 7f0bd93a7800 20 add_watcher() i=2 2024-09-14T11:13:43.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.285+0000 7f0bd93a7800 20 add_watcher() i=3 2024-09-14T11:13:43.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.285+0000 7f0bd93a7800 20 add_watcher() i=4 2024-09-14T11:13:43.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.285+0000 7f0bd93a7800 20 add_watcher() i=5 2024-09-14T11:13:43.284 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.285+0000 7f0bd93a7800 20 add_watcher() i=6 2024-09-14T11:13:43.285 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.286+0000 7f0bd93a7800 20 add_watcher() i=7 2024-09-14T11:13:43.285 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.286+0000 7f0bd93a7800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:43.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.288+0000 7f0a8d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:43.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.288+0000 7f0bd93a7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:43.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.288+0000 7f0bd93a7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:43.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.288+0000 7f0bd93a7800 5 note: GC not initialized 2024-09-14T11:13:43.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.288+0000 7f0a07fff640 20 reqs_thread_entry: start 2024-09-14T11:13:43.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.288+0000 7f0bd93a7800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:43.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.288+0000 7f0bd93a7800 20 Filter name: none 2024-09-14T11:13:43.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.289+0000 7f0a05ffb640 20 reqs_thread_entry: start 2024-09-14T11:13:43.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.289+0000 7f0bd93a7800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.289 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.289+0000 7f0bd93a7800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:13:43.289 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.289+0000 7f0bd93a7800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.289+0000 7f0bd93a7800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:13:43.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.289+0000 7f0bd93a7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:43.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.289+0000 7f0bd93a7800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.290+0000 7f0bd93a7800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:13:43.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.290+0000 7f0bd93a7800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.290+0000 7f0bd93a7800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:13:43.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.290+0000 7f0bd93a7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:43.291 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.292+0000 7f0a8d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:43.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.294+0000 7f0bd93a7800 20 remove_watcher() i=0 2024-09-14T11:13:43.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.294+0000 7f0bd93a7800 2 removed watcher, disabling cache 2024-09-14T11:13:43.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.295+0000 7f0bd93a7800 20 remove_watcher() i=1 2024-09-14T11:13:43.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.296+0000 7f0bd93a7800 20 remove_watcher() i=2 2024-09-14T11:13:43.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.297+0000 7f0bd93a7800 20 remove_watcher() i=3 2024-09-14T11:13:43.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.297+0000 7f0bd93a7800 20 remove_watcher() i=4 2024-09-14T11:13:43.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.299+0000 7f0bd93a7800 20 remove_watcher() i=5 2024-09-14T11:13:43.299 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.299+0000 7f0bd93a7800 20 remove_watcher() i=6 2024-09-14T11:13:43.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:43.300+0000 7f0bd93a7800 20 remove_watcher() i=7 2024-09-14T11:13:43.311 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:43.311 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:13:43.311 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-change-reshard-state id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:13:43.311 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:43.313 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.313 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:43.332 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.332 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:43.558 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.558 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:43.697 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-14T11:13:43.697 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:43.698 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.698 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:43.746 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.747 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:43.804 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.804 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:43.840 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.841 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:43.877 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.877 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:43.914 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.915 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:43.952 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.952 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:43.989 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.989 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:44.027 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:44.027 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:44.064 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:44.065 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:44.102 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:44.102 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:44.139 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:44.140 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:44.176 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:44.176 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:44.213 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:44.213 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:44.251 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:44.251 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:44.288 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:44.288 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:44.326 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:44.326 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:44.363 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:44.363 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:44.402 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:44.402 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:44.438 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:44.438 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:44.475 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:44.475 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:44.512 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:44.513 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:44.550 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:13:44.579 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:44.579 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:44.618 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.619+0000 7eff1cd26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.621+0000 7eff1cd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:44.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.621+0000 7eff1cd26800 20 realm 2024-09-14T11:13:44.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.621+0000 7eff1cd26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.621+0000 7eff1cd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:44.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.621+0000 7eff1cd26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:44.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.621+0000 7eff1cd26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.621+0000 7eff1cd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:44.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.621+0000 7eff1cd26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.622+0000 7eff1cd26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:44.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.622+0000 7eff1cd26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.623+0000 7eff1cd26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:44.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.623+0000 7eff1cd26800 20 searching for the correct realm 2024-09-14T11:13:44.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.626+0000 7eff181d8640 0 -- 172.21.15.50:0/2628075768 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7eff1003c4a0 msgr2=0x7eff10045060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:44.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.629+0000 7eff189d9640 0 -- 172.21.15.50:0/2628075768 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7eff10045690 msgr2=0x7eff1006a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:44.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.633+0000 7eff1cd26800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:44.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.633+0000 7eff1cd26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:44.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.633+0000 7eff1cd26800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:44.633 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.633+0000 7eff1cd26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:44.633 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.633+0000 7eff1cd26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:44.633 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.633+0000 7eff1cd26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:44.633 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.633+0000 7eff1cd26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.633 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.633+0000 7eff1cd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:44.633 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.633+0000 7eff1cd26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.633 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.633+0000 7eff1cd26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:44.633 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.633+0000 7eff1cd26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.634+0000 7eff1cd26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:44.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.634+0000 7eff1cd26800 20 zone default found 2024-09-14T11:13:44.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.634+0000 7eff1cd26800 4 Realm: () 2024-09-14T11:13:44.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.634+0000 7eff1cd26800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:44.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.634+0000 7eff1cd26800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:44.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.634+0000 7eff1cd26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:44.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.634+0000 7eff1cd26800 20 zonegroup default 2024-09-14T11:13:44.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.634+0000 7eff1cd26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.634+0000 7eff1cd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:44.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.634+0000 7eff1cd26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.634+0000 7eff1cd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:44.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.634+0000 7eff1cd26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.635+0000 7eff1cd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:44.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.635+0000 7eff1cd26800 20 started sync module instance, tier type = 2024-09-14T11:13:44.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.635+0000 7eff1cd26800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:44.642 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.643+0000 7eff1cd26800 20 add_watcher() i=0 2024-09-14T11:13:44.642 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.643+0000 7eff1cd26800 20 add_watcher() i=1 2024-09-14T11:13:44.642 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.643+0000 7eff1cd26800 20 add_watcher() i=2 2024-09-14T11:13:44.642 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.643+0000 7eff1cd26800 20 add_watcher() i=3 2024-09-14T11:13:44.642 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.643+0000 7eff1cd26800 20 add_watcher() i=4 2024-09-14T11:13:44.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.643+0000 7eff1cd26800 20 add_watcher() i=5 2024-09-14T11:13:44.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.643+0000 7eff1cd26800 20 add_watcher() i=6 2024-09-14T11:13:44.643 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.644+0000 7eff1cd26800 20 add_watcher() i=7 2024-09-14T11:13:44.644 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.644+0000 7eff1cd26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:44.644 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.645+0000 7efdcf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:44.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.646+0000 7eff1cd26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:44.645 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.646+0000 7eff1cd26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:44.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.646+0000 7eff1cd26800 5 note: GC not initialized 2024-09-14T11:13:44.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.646+0000 7efdce7e4640 20 reqs_thread_entry: start 2024-09-14T11:13:44.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.646+0000 7eff1cd26800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:44.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.646+0000 7eff1cd26800 20 Filter name: none 2024-09-14T11:13:44.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.646+0000 7efdc77fe640 20 reqs_thread_entry: start 2024-09-14T11:13:44.646 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.646+0000 7eff1cd26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.647+0000 7eff1cd26800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:13:44.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.647+0000 7eff1cd26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.647+0000 7eff1cd26800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:13:44.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.647+0000 7eff1cd26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:44.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.647+0000 7eff1cd26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.648+0000 7eff1cd26800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:13:44.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.648+0000 7eff1cd26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.648+0000 7eff1cd26800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:13:44.647 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.648+0000 7eff1cd26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:44.649 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.650+0000 7efdcf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:44.650 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.651+0000 7eff1cd26800 20 remove_watcher() i=0 2024-09-14T11:13:44.651 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.651+0000 7eff1cd26800 2 removed watcher, disabling cache 2024-09-14T11:13:44.652 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.652+0000 7eff1cd26800 20 remove_watcher() i=1 2024-09-14T11:13:44.652 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.653+0000 7eff1cd26800 20 remove_watcher() i=2 2024-09-14T11:13:44.653 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.654+0000 7eff1cd26800 20 remove_watcher() i=3 2024-09-14T11:13:44.654 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.655+0000 7eff1cd26800 20 remove_watcher() i=4 2024-09-14T11:13:44.655 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.656+0000 7eff1cd26800 20 remove_watcher() i=5 2024-09-14T11:13:44.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.657+0000 7eff1cd26800 20 remove_watcher() i=6 2024-09-14T11:13:44.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.658+0000 7eff1cd26800 20 remove_watcher() i=7 2024-09-14T11:13:44.668 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:44.668 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:13:44.668 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-change-reshard-state id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:13:44.668 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:44.669 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-14T11:13:44.706 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:44.706 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:44.746 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.747+0000 7fc4c5492800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.748+0000 7fc4c5492800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:44.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.748+0000 7fc4c5492800 20 realm 2024-09-14T11:13:44.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.748+0000 7fc4c5492800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.748+0000 7fc4c5492800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:44.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.748+0000 7fc4c5492800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:44.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.748+0000 7fc4c5492800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.749+0000 7fc4c5492800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:44.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.749+0000 7fc4c5492800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.749 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.749+0000 7fc4c5492800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:44.749 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.749+0000 7fc4c5492800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.749 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.750+0000 7fc4c5492800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:44.749 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.750+0000 7fc4c5492800 20 searching for the correct realm 2024-09-14T11:13:44.752 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.753+0000 7fc4c277b640 0 -- 172.21.15.50:0/2520796081 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fc4bc020c20 msgr2=0x7fc4bc031420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:44.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.958+0000 7fc4c377d640 0 -- 172.21.15.50:0/2520796081 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5570a3967bd0 msgr2=0x5570a3969fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:44.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.962+0000 7fc4c5492800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:44.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.962+0000 7fc4c5492800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:44.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.962+0000 7fc4c5492800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:44.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.962+0000 7fc4c5492800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:44.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.962+0000 7fc4c5492800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:44.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.962+0000 7fc4c5492800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:44.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.962+0000 7fc4c5492800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.962+0000 7fc4c5492800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:44.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.962+0000 7fc4c5492800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.962+0000 7fc4c5492800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:44.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.962+0000 7fc4c5492800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.963+0000 7fc4c5492800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:44.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.963+0000 7fc4c5492800 20 zone default found 2024-09-14T11:13:44.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.963+0000 7fc4c5492800 4 Realm: () 2024-09-14T11:13:44.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.963+0000 7fc4c5492800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:44.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.963+0000 7fc4c5492800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:44.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.963+0000 7fc4c5492800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:44.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.963+0000 7fc4c5492800 20 zonegroup default 2024-09-14T11:13:44.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.963+0000 7fc4c5492800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.963+0000 7fc4c5492800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:44.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.963+0000 7fc4c5492800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.963+0000 7fc4c5492800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:44.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.963+0000 7fc4c5492800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.963+0000 7fc4c5492800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:44.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.963+0000 7fc4c5492800 20 started sync module instance, tier type = 2024-09-14T11:13:44.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.963+0000 7fc4c5492800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:44.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.972+0000 7fc4c5492800 20 add_watcher() i=0 2024-09-14T11:13:44.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.972+0000 7fc4c5492800 20 add_watcher() i=1 2024-09-14T11:13:44.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.972+0000 7fc4c5492800 20 add_watcher() i=2 2024-09-14T11:13:44.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.972+0000 7fc4c5492800 20 add_watcher() i=3 2024-09-14T11:13:44.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.972+0000 7fc4c5492800 20 add_watcher() i=4 2024-09-14T11:13:44.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.972+0000 7fc4c5492800 20 add_watcher() i=5 2024-09-14T11:13:44.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.972+0000 7fc4c5492800 20 add_watcher() i=6 2024-09-14T11:13:44.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.973+0000 7fc4c5492800 20 add_watcher() i=7 2024-09-14T11:13:44.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.973+0000 7fc4c5492800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:44.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.975+0000 7fc3797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:44.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.976+0000 7fc4c5492800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:44.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.976+0000 7fc4c5492800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:44.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.976+0000 7fc4c5492800 5 note: GC not initialized 2024-09-14T11:13:44.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.976+0000 7fc2f3fff640 20 reqs_thread_entry: start 2024-09-14T11:13:44.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.976+0000 7fc4c5492800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:44.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.976+0000 7fc4c5492800 20 Filter name: none 2024-09-14T11:13:44.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.976+0000 7fc2f1ffb640 20 reqs_thread_entry: start 2024-09-14T11:13:44.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.976+0000 7fc4c5492800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:13:44.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.976+0000 7fc4c5492800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.977+0000 7fc4c5492800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:13:44.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.977+0000 7fc4c5492800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:13:44.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.977+0000 7fc4c5492800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:13:44.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.977+0000 7fc4c5492800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39 : miss 2024-09-14T11:13:44.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.977+0000 7fc4c5492800 20 rados->read ofs=0 len=0 2024-09-14T11:13:44.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.977+0000 7fc4c5492800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:13:44.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.977+0000 7fc4c5492800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39 info.flags=0x17 2024-09-14T11:13:44.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.977+0000 7fc4c5492800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39 to cache LRU end 2024-09-14T11:13:44.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.977+0000 7fc4c5492800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:44.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.977+0000 7fc4c5492800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:44.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.977+0000 7fc4c5492800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39 2024-09-14T11:13:44.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.982+0000 7fc4c5492800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39 info.flags=0x17 2024-09-14T11:13:44.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.982+0000 7fc4c5492800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39 to cache LRU end 2024-09-14T11:13:44.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.982+0000 7fc4c5492800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:44.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.982+0000 7fc4c5492800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39, ofs0, ns] 2024-09-14T11:13:44.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.983+0000 7fc3a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497126 cookie 93942269319472 notifier 7490 bl.length()=1015 2024-09-14T11:13:44.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.983+0000 7fc3a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39 info.flags=0x17 2024-09-14T11:13:44.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.983+0000 7fc3a67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39 to cache LRU end 2024-09-14T11:13:44.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.983+0000 7fc3a67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:44.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.984+0000 7fc4c5492800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39]): orig_sources= new_sources= 2024-09-14T11:13:44.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.984+0000 7fc4c5492800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39]): potential sources added=[] removed=[] 2024-09-14T11:13:44.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.984+0000 7fc4c5492800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39]): orig_dests= new_dests= 2024-09-14T11:13:44.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.984+0000 7fc4c5492800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39]): potential dests added=[] removed=[] 2024-09-14T11:13:44.990 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1.0 2024-09-14T11:13:44.990 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1.0 2024-09-14T11:13:44.990 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1.1 2024-09-14T11:13:44.990 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1.1 2024-09-14T11:13:44.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1.2 2024-09-14T11:13:44.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1.2 2024-09-14T11:13:44.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1.3 2024-09-14T11:13:44.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1.3 2024-09-14T11:13:44.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1.4 2024-09-14T11:13:44.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1.4 2024-09-14T11:13:44.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1.5 2024-09-14T11:13:44.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1.5 2024-09-14T11:13:44.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1.6 2024-09-14T11:13:44.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1.6 2024-09-14T11:13:44.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1.7 2024-09-14T11:13:44.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1.7 2024-09-14T11:13:44.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1.8 2024-09-14T11:13:44.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1.8 2024-09-14T11:13:44.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1.9 2024-09-14T11:13:44.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1.9 2024-09-14T11:13:44.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1.10 2024-09-14T11:13:44.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1.10 2024-09-14T11:13:44.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1.11 2024-09-14T11:13:44.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1.11 2024-09-14T11:13:44.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.989+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.0 2024-09-14T11:13:44.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.990+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1 2024-09-14T11:13:44.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.990+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.2 2024-09-14T11:13:44.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.991+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.3 2024-09-14T11:13:44.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.991+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.4 2024-09-14T11:13:44.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.992+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.5 2024-09-14T11:13:44.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.992+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.6 2024-09-14T11:13:44.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.993+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.7 2024-09-14T11:13:44.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.993+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.8 2024-09-14T11:13:44.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.994+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.9 2024-09-14T11:13:44.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.994+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.10 2024-09-14T11:13:44.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.998+0000 7fc4c5492800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-14T11:13:44.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.998+0000 7fc4c5492800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:13:44.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.998+0000 7fc4c5492800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39 2024-09-14T11:13:44.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.999+0000 7fc4c5492800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39 info.flags=0x17 2024-09-14T11:13:44.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.999+0000 7fc4c5492800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39 to cache LRU end 2024-09-14T11:13:44.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.999+0000 7fc4c5492800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:44.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.999+0000 7fc4c5492800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39, ofs0, ns] 2024-09-14T11:13:44.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.999+0000 7fc3a5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497127 cookie 93942269319472 notifier 7490 bl.length()=1015 2024-09-14T11:13:44.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.999+0000 7fc3a5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39 info.flags=0x17 2024-09-14T11:13:44.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.999+0000 7fc3a5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39 to cache LRU end 2024-09-14T11:13:44.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:44.999+0000 7fc3a5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:45.000 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.001+0000 7fc4c5492800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39]): orig_sources= new_sources= 2024-09-14T11:13:45.000 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.001+0000 7fc4c5492800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39]): potential sources added=[] removed=[] 2024-09-14T11:13:45.000 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.001+0000 7fc4c5492800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39]): orig_dests= new_dests= 2024-09-14T11:13:45.000 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.001+0000 7fc4c5492800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39]): potential dests added=[] removed=[] 2024-09-14T11:13:45.002 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.003+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.0 2024-09-14T11:13:45.002 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.003+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.1 2024-09-14T11:13:45.003 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.004+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.2 2024-09-14T11:13:45.003 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.004+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.3 2024-09-14T11:13:45.004 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.004+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.4 2024-09-14T11:13:45.004 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.005+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.5 2024-09-14T11:13:45.004 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.005+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.6 2024-09-14T11:13:45.004 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.005+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.7 2024-09-14T11:13:45.005 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.006+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.8 2024-09-14T11:13:45.005 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.006+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.9 2024-09-14T11:13:45.005 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.006+0000 7fc4c5492800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39.10 2024-09-14T11:13:45.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.006+0000 7fc4c5492800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:13:45.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.007+0000 7fc4c5492800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39 2024-09-14T11:13:45.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.008+0000 7fc4c5492800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39 info.flags=0x17 2024-09-14T11:13:45.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.008+0000 7fc4c5492800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39 to cache LRU end 2024-09-14T11:13:45.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.008+0000 7fc4c5492800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:45.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.008+0000 7fc4c5492800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39, ofs0, ns] 2024-09-14T11:13:45.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.008+0000 7fc3a5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497128 cookie 93942269319472 notifier 7490 bl.length()=983 2024-09-14T11:13:45.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.008+0000 7fc3a5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39 info.flags=0x17 2024-09-14T11:13:45.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.008+0000 7fc3a5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39 to cache LRU end 2024-09-14T11:13:45.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.008+0000 7fc3a5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:45.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.010+0000 7fc4c5492800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39]): orig_sources= new_sources= 2024-09-14T11:13:45.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.010+0000 7fc4c5492800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39]): potential sources added=[] removed=[] 2024-09-14T11:13:45.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.010+0000 7fc4c5492800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39]): orig_dests= new_dests= 2024-09-14T11:13:45.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.010+0000 7fc4c5492800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39]): potential dests added=[] removed=[] 2024-09-14T11:13:45.012 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.013+0000 7fc4c5492800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:13:45.013 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.014+0000 7fc3797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:45.016 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.017+0000 7fc4c5492800 20 remove_watcher() i=0 2024-09-14T11:13:45.016 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.017+0000 7fc4c5492800 2 removed watcher, disabling cache 2024-09-14T11:13:45.017 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.018+0000 7fc4c5492800 20 remove_watcher() i=1 2024-09-14T11:13:45.018 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.019+0000 7fc4c5492800 20 remove_watcher() i=2 2024-09-14T11:13:45.019 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.020+0000 7fc4c5492800 20 remove_watcher() i=3 2024-09-14T11:13:45.020 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.021+0000 7fc4c5492800 20 remove_watcher() i=4 2024-09-14T11:13:45.021 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.022+0000 7fc4c5492800 20 remove_watcher() i=5 2024-09-14T11:13:45.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.023+0000 7fc4c5492800 20 remove_watcher() i=6 2024-09-14T11:13:45.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.024+0000 7fc4c5492800 20 remove_watcher() i=7 2024-09-14T11:13:45.035 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:13:45.064 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:45.064 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:45.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.104+0000 7fd921936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.105+0000 7fd921936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:45.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.105+0000 7fd921936800 20 realm 2024-09-14T11:13:45.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.105+0000 7fd921936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.106+0000 7fd921936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:45.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.106+0000 7fd921936800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:45.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.106+0000 7fd921936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.106+0000 7fd921936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:45.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.106+0000 7fd921936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.107+0000 7fd921936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:45.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.107+0000 7fd921936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.107+0000 7fd921936800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:45.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.107+0000 7fd921936800 20 searching for the correct realm 2024-09-14T11:13:45.109 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.110+0000 7fd91ceb6640 0 -- 172.21.15.50:0/2267789770 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fd91806f880 msgr2=0x7fd918084af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:45.315 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.316+0000 7fd91ceb6640 0 -- 172.21.15.50:0/2267789770 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x557195616270 msgr2=0x557195618660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:45.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.320+0000 7fd921936800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:45.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.320+0000 7fd921936800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:45.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.320+0000 7fd921936800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:45.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.320+0000 7fd921936800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:45.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.320+0000 7fd921936800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:45.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.320+0000 7fd921936800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:45.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.320+0000 7fd921936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.320+0000 7fd921936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:45.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.320+0000 7fd921936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.320+0000 7fd921936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:45.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.320+0000 7fd921936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.321+0000 7fd921936800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:45.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.321+0000 7fd921936800 20 zone default found 2024-09-14T11:13:45.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.321+0000 7fd921936800 4 Realm: () 2024-09-14T11:13:45.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.321+0000 7fd921936800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:45.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.321+0000 7fd921936800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:45.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.321+0000 7fd921936800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:45.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.321+0000 7fd921936800 20 zonegroup default 2024-09-14T11:13:45.321 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.321+0000 7fd921936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.321+0000 7fd921936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:45.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.321+0000 7fd921936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.321+0000 7fd921936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:45.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.321+0000 7fd921936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.322+0000 7fd921936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:45.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.322+0000 7fd921936800 20 started sync module instance, tier type = 2024-09-14T11:13:45.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.322+0000 7fd921936800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:45.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.330+0000 7fd921936800 20 add_watcher() i=0 2024-09-14T11:13:45.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.330+0000 7fd921936800 20 add_watcher() i=1 2024-09-14T11:13:45.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.330+0000 7fd921936800 20 add_watcher() i=2 2024-09-14T11:13:45.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.330+0000 7fd921936800 20 add_watcher() i=3 2024-09-14T11:13:45.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.330+0000 7fd921936800 20 add_watcher() i=4 2024-09-14T11:13:45.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.330+0000 7fd921936800 20 add_watcher() i=5 2024-09-14T11:13:45.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.330+0000 7fd921936800 20 add_watcher() i=6 2024-09-14T11:13:45.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.331+0000 7fd921936800 20 add_watcher() i=7 2024-09-14T11:13:45.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.331+0000 7fd921936800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:45.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.333+0000 7fd7d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:45.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.333+0000 7fd921936800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:45.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.333+0000 7fd921936800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:45.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.333+0000 7fd921936800 5 note: GC not initialized 2024-09-14T11:13:45.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.333+0000 7fd7d27e4640 20 reqs_thread_entry: start 2024-09-14T11:13:45.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.333+0000 7fd921936800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:45.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.333+0000 7fd921936800 20 Filter name: none 2024-09-14T11:13:45.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.334+0000 7fd743fff640 20 reqs_thread_entry: start 2024-09-14T11:13:45.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.334+0000 7fd921936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.334+0000 7fd921936800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:13:45.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.334+0000 7fd921936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.335+0000 7fd921936800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:13:45.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.335+0000 7fd921936800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:45.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.335+0000 7fd921936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.335+0000 7fd921936800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:13:45.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.335+0000 7fd921936800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.335+0000 7fd921936800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:13:45.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.335+0000 7fd921936800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:45.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.338+0000 7fd7d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:45.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.339+0000 7fd921936800 20 remove_watcher() i=0 2024-09-14T11:13:45.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.339+0000 7fd921936800 2 removed watcher, disabling cache 2024-09-14T11:13:45.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.340+0000 7fd921936800 20 remove_watcher() i=1 2024-09-14T11:13:45.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.341+0000 7fd921936800 20 remove_watcher() i=2 2024-09-14T11:13:45.342 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.342+0000 7fd921936800 20 remove_watcher() i=3 2024-09-14T11:13:45.342 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.343+0000 7fd921936800 20 remove_watcher() i=4 2024-09-14T11:13:45.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.344+0000 7fd921936800 20 remove_watcher() i=5 2024-09-14T11:13:45.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.345+0000 7fd921936800 20 remove_watcher() i=6 2024-09-14T11:13:45.346 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:45.346+0000 7fd921936800 20 remove_watcher() i=7 2024-09-14T11:13:45.358 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:45.358 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:13:45.358 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: error-at-change-reshard-state id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:13:45.359 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:45.360 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:45.361 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:45.378 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:45.378 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:45.617 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:45.617 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:45.757 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-14T11:13:45.757 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:45.758 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:45.758 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:45.806 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:45.806 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:45.864 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:45.864 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:45.902 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:45.902 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:45.938 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:45.938 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:45.974 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:45.974 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:46.013 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:46.013 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:46.050 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:46.050 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:46.088 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:46.088 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:46.125 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:46.125 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:46.162 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:46.163 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:46.201 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:46.202 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:46.238 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:46.238 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:46.275 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:46.275 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:46.313 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:46.313 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:46.350 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:46.350 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:46.388 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:46.388 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:46.426 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:46.426 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:46.462 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:46.462 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:46.499 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:46.499 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:46.535 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:46.536 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:46.573 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:46.573 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:46.609 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:13:46.638 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:46.638 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:46.677 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.679+0000 7f9d68287800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.679 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.680+0000 7f9d68287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:46.679 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.680+0000 7f9d68287800 20 realm 2024-09-14T11:13:46.679 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.680+0000 7f9d68287800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.679 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.681+0000 7f9d68287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:46.679 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.681+0000 7f9d68287800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:46.680 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.681+0000 7f9d68287800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.680 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.681+0000 7f9d68287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:46.680 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.681+0000 7f9d68287800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.680 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.681+0000 7f9d68287800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:46.680 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.681+0000 7f9d68287800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.680 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.682+0000 7f9d68287800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:46.681 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.682+0000 7f9d68287800 20 searching for the correct realm 2024-09-14T11:13:46.683 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.685+0000 7f9d65570640 0 -- 172.21.15.50:0/1800123298 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f9d6002a430 msgr2=0x7f9d6002a890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:46.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.890+0000 7f9d65d71640 0 -- 172.21.15.50:0/1800123298 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f9d6003e450 msgr2=0x7f9d6003e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:46.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.895+0000 7f9d68287800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:46.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.895+0000 7f9d68287800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:46.894 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.895+0000 7f9d68287800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:46.894 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.895+0000 7f9d68287800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:46.894 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.895+0000 7f9d68287800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:46.894 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.895+0000 7f9d68287800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:46.894 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.895+0000 7f9d68287800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.894 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.895+0000 7f9d68287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:46.894 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.895+0000 7f9d68287800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.894 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.895+0000 7f9d68287800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:46.894 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.895+0000 7f9d68287800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.895 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.896+0000 7f9d68287800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:46.895 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.896+0000 7f9d68287800 20 zone default found 2024-09-14T11:13:46.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.896+0000 7f9d68287800 4 Realm: () 2024-09-14T11:13:46.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.896+0000 7f9d68287800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:46.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.896+0000 7f9d68287800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:46.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.896+0000 7f9d68287800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:46.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.896+0000 7f9d68287800 20 zonegroup default 2024-09-14T11:13:46.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.896+0000 7f9d68287800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.896+0000 7f9d68287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:46.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.896+0000 7f9d68287800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.896+0000 7f9d68287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:46.896 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.896+0000 7f9d68287800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.897+0000 7f9d68287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:46.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.897+0000 7f9d68287800 20 started sync module instance, tier type = 2024-09-14T11:13:46.897 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.897+0000 7f9d68287800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:46.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.905+0000 7f9d68287800 20 add_watcher() i=0 2024-09-14T11:13:46.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.905+0000 7f9d68287800 20 add_watcher() i=1 2024-09-14T11:13:46.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.905+0000 7f9d68287800 20 add_watcher() i=2 2024-09-14T11:13:46.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.905+0000 7f9d68287800 20 add_watcher() i=3 2024-09-14T11:13:46.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.905+0000 7f9d68287800 20 add_watcher() i=4 2024-09-14T11:13:46.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.905+0000 7f9d68287800 20 add_watcher() i=5 2024-09-14T11:13:46.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.905+0000 7f9d68287800 20 add_watcher() i=6 2024-09-14T11:13:46.904 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.906+0000 7f9d68287800 20 add_watcher() i=7 2024-09-14T11:13:46.904 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.906+0000 7f9d68287800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:46.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.907+0000 7f9c177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:46.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.908+0000 7f9d68287800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:46.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.908+0000 7f9d68287800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:46.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.908+0000 7f9d68287800 5 note: GC not initialized 2024-09-14T11:13:46.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.908+0000 7f9c167fc640 20 reqs_thread_entry: start 2024-09-14T11:13:46.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.908+0000 7f9d68287800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:46.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.908+0000 7f9d68287800 20 Filter name: none 2024-09-14T11:13:46.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.908+0000 7f9b87fff640 20 reqs_thread_entry: start 2024-09-14T11:13:46.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.909+0000 7f9d68287800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.909+0000 7f9d68287800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:13:46.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.909+0000 7f9d68287800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.910+0000 7f9d68287800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:13:46.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.910+0000 7f9d68287800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:46.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.910+0000 7f9d68287800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.910+0000 7f9d68287800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:13:46.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.910+0000 7f9d68287800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.911+0000 7f9d68287800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:13:46.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.911+0000 7f9d68287800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:46.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.912+0000 7f9c177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:46.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.914+0000 7f9d68287800 20 remove_watcher() i=0 2024-09-14T11:13:46.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.914+0000 7f9d68287800 2 removed watcher, disabling cache 2024-09-14T11:13:46.913 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.915+0000 7f9d68287800 20 remove_watcher() i=1 2024-09-14T11:13:46.914 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.916+0000 7f9d68287800 20 remove_watcher() i=2 2024-09-14T11:13:46.915 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.917+0000 7f9d68287800 20 remove_watcher() i=3 2024-09-14T11:13:46.916 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.918+0000 7f9d68287800 20 remove_watcher() i=4 2024-09-14T11:13:46.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.919+0000 7f9d68287800 20 remove_watcher() i=5 2024-09-14T11:13:46.918 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.920+0000 7f9d68287800 20 remove_watcher() i=6 2024-09-14T11:13:46.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:46.921+0000 7f9d68287800 20 remove_watcher() i=7 2024-09-14T11:13:46.931 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:46.931 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:13:46.931 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: abort-at-change-reshard-state id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:13:46.931 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:46.932 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:13:46.967 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:46.967 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:47.006 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.008+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.009+0000 7fd48f321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.009+0000 7fd48f321800 20 realm 2024-09-14T11:13:47.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.009+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.009+0000 7fd48f321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.009+0000 7fd48f321800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:47.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.009+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.010+0000 7fd48f321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.010+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.010+0000 7fd48f321800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:47.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.010+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.011+0000 7fd48f321800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:47.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.011+0000 7fd48f321800 20 searching for the correct realm 2024-09-14T11:13:47.012 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.014+0000 7fd483fff640 0 -- 172.21.15.50:0/3104753957 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fd484084400 msgr2=0x7fd484084860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:47.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.220+0000 7fd48b845640 0 -- 172.21.15.50:0/3104753957 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55b0a6254a00 msgr2=0x55b0a6256e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:47.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.224+0000 7fd48f321800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:47.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.224+0000 7fd48f321800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:47.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.224+0000 7fd48f321800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:47.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.224+0000 7fd48f321800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:47.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.224+0000 7fd48f321800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:47.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.224+0000 7fd48f321800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:47.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.224+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.225+0000 7fd48f321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.225+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.225+0000 7fd48f321800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:47.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.225+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.225+0000 7fd48f321800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:47.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.225+0000 7fd48f321800 20 zone default found 2024-09-14T11:13:47.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.225+0000 7fd48f321800 4 Realm: () 2024-09-14T11:13:47.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.225+0000 7fd48f321800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:47.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.225+0000 7fd48f321800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:47.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.225+0000 7fd48f321800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:47.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.225+0000 7fd48f321800 20 zonegroup default 2024-09-14T11:13:47.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.225+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.225+0000 7fd48f321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.225+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.226+0000 7fd48f321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.226+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.226+0000 7fd48f321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.226+0000 7fd48f321800 20 started sync module instance, tier type = 2024-09-14T11:13:47.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.226+0000 7fd48f321800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:47.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.234+0000 7fd48f321800 20 add_watcher() i=0 2024-09-14T11:13:47.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.234+0000 7fd48f321800 20 add_watcher() i=1 2024-09-14T11:13:47.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.234+0000 7fd48f321800 20 add_watcher() i=2 2024-09-14T11:13:47.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.234+0000 7fd48f321800 20 add_watcher() i=3 2024-09-14T11:13:47.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.234+0000 7fd48f321800 20 add_watcher() i=4 2024-09-14T11:13:47.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.234+0000 7fd48f321800 20 add_watcher() i=5 2024-09-14T11:13:47.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.234+0000 7fd48f321800 20 add_watcher() i=6 2024-09-14T11:13:47.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.235+0000 7fd48f321800 20 add_watcher() i=7 2024-09-14T11:13:47.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.235+0000 7fd48f321800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:47.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.237+0000 7fd341fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:47.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.238+0000 7fd48f321800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:47.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.238+0000 7fd48f321800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:47.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.238+0000 7fd48f321800 5 note: GC not initialized 2024-09-14T11:13:47.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.238+0000 7fd340fe1640 20 reqs_thread_entry: start 2024-09-14T11:13:47.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.238+0000 7fd48f321800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:47.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.238+0000 7fd48f321800 20 Filter name: none 2024-09-14T11:13:47.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.238+0000 7fd2ba7fc640 20 reqs_thread_entry: start 2024-09-14T11:13:47.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.238+0000 7fd48f321800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:13:47.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.238+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.239+0000 7fd48f321800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:13:47.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.239+0000 7fd48f321800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:13:47.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.239+0000 7fd48f321800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:13:47.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.239+0000 7fd48f321800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 : miss 2024-09-14T11:13:47.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.239+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.240+0000 7fd48f321800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:13:47.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.240+0000 7fd48f321800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 info.flags=0x17 2024-09-14T11:13:47.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.240+0000 7fd48f321800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 to cache LRU end 2024-09-14T11:13:47.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.240+0000 7fd48f321800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:47.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.240+0000 7fd48f321800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:47.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.240+0000 7fd48f321800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 2024-09-14T11:13:47.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.245+0000 7fd48f321800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 info.flags=0x17 2024-09-14T11:13:47.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.245+0000 7fd48f321800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 to cache LRU end 2024-09-14T11:13:47.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.245+0000 7fd48f321800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:47.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.245+0000 7fd48f321800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40, ofs0, ns] 2024-09-14T11:13:47.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.245+0000 7fd36e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94217190136384 notifier 8067 bl.length()=1015 2024-09-14T11:13:47.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.245+0000 7fd36e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 info.flags=0x17 2024-09-14T11:13:47.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.245+0000 7fd36e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 to cache LRU end 2024-09-14T11:13:47.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.245+0000 7fd36e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:47.245 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.247+0000 7fd48f321800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40]): orig_sources= new_sources= 2024-09-14T11:13:47.245 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.247+0000 7fd48f321800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40]): potential sources added=[] removed=[] 2024-09-14T11:13:47.245 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.247+0000 7fd48f321800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40]): orig_dests= new_dests= 2024-09-14T11:13:47.245 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.247+0000 7fd48f321800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40]): potential dests added=[] removed=[] 2024-09-14T11:13:47.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.0 2024-09-14T11:13:47.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.0 2024-09-14T11:13:47.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.1 2024-09-14T11:13:47.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.1 2024-09-14T11:13:47.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.2 2024-09-14T11:13:47.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.2 2024-09-14T11:13:47.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.3 2024-09-14T11:13:47.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.3 2024-09-14T11:13:47.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.4 2024-09-14T11:13:47.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.4 2024-09-14T11:13:47.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.5 2024-09-14T11:13:47.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.5 2024-09-14T11:13:47.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.6 2024-09-14T11:13:47.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.6 2024-09-14T11:13:47.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.7 2024-09-14T11:13:47.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.7 2024-09-14T11:13:47.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.8 2024-09-14T11:13:47.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.8 2024-09-14T11:13:47.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.9 2024-09-14T11:13:47.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.9 2024-09-14T11:13:47.251 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.10 2024-09-14T11:13:47.251 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.10 2024-09-14T11:13:47.251 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.11 2024-09-14T11:13:47.251 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.11 2024-09-14T11:13:47.251 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.0 2024-09-14T11:13:47.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1 2024-09-14T11:13:47.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.252+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2 2024-09-14T11:13:47.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.252+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.3 2024-09-14T11:13:47.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.253+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.4 2024-09-14T11:13:47.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.253+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.5 2024-09-14T11:13:47.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.253+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.6 2024-09-14T11:13:47.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.254+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.7 2024-09-14T11:13:47.253 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.254+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.8 2024-09-14T11:13:47.253 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.255+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.9 2024-09-14T11:13:47.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.256+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.10 2024-09-14T11:13:47.257 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd48f321800 time 2024-09-14T11:13:47.260094+0000 2024-09-14T11:13:47.257 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:13:47.258 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:13:47.258 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd490b8c76a] 2024-09-14T11:13:47.258 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd490b8c928] 2024-09-14T11:13:47.259 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b0a537d0b1] 2024-09-14T11:13:47.259 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b0a538c124] 2024-09-14T11:13:47.259 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b0a538cfc4] 2024-09-14T11:13:47.259 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:13:47.259 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd48f829590] 2024-09-14T11:13:47.259 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:13:47.259 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:13:47.259 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.260+0000 7fd48f321800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd48f321800 time 2024-09-14T11:13:47.260094+0000 2024-09-14T11:13:47.259 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:13:47.259 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.260 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:13:47.260 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd490b8c76a] 2024-09-14T11:13:47.260 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd490b8c928] 2024-09-14T11:13:47.260 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b0a537d0b1] 2024-09-14T11:13:47.260 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b0a538c124] 2024-09-14T11:13:47.260 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b0a538cfc4] 2024-09-14T11:13:47.260 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:13:47.260 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd48f829590] 2024-09-14T11:13:47.260 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:13:47.260 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:13:47.260 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.260 INFO:tasks.workunit.client.0.smithi050.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:13:47.260 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7fd48f321800 thread_name:radosgw-admin 2024-09-14T11:13:47.277 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:13:47.277 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd48f83e6f0] 2024-09-14T11:13:47.277 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd48f88b99c] 2024-09-14T11:13:47.277 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:13:47.277 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:13:47.277 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd490b8c7c4] 2024-09-14T11:13:47.277 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd490b8c928] 2024-09-14T11:13:47.278 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b0a537d0b1] 2024-09-14T11:13:47.278 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b0a538c124] 2024-09-14T11:13:47.278 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b0a538cfc4] 2024-09-14T11:13:47.278 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:13:47.278 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd48f829590] 2024-09-14T11:13:47.278 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:13:47.278 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:13:47.278 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.261+0000 7fd48f321800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:13:47.278 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7fd48f321800 thread_name:radosgw-admin 2024-09-14T11:13:47.278 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.278 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:13:47.278 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd48f83e6f0] 2024-09-14T11:13:47.278 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd48f88b99c] 2024-09-14T11:13:47.278 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:13:47.279 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:13:47.279 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd490b8c7c4] 2024-09-14T11:13:47.279 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd490b8c928] 2024-09-14T11:13:47.279 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b0a537d0b1] 2024-09-14T11:13:47.279 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b0a538c124] 2024-09-14T11:13:47.279 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b0a538cfc4] 2024-09-14T11:13:47.279 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:13:47.279 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd48f829590] 2024-09-14T11:13:47.279 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:13:47.279 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:13:47.279 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:13:47.279 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.279 INFO:tasks.workunit.client.0.smithi050.stderr:--- begin dump of recent events --- 2024-09-14T11:13:47.279 INFO:tasks.workunit.client.0.smithi050.stderr: -499> 2024-09-14T11:13:46.991+0000 7fd48f321800 5 AuthRegistry(0x55b0a61698a0) adding con mode: crc 2024-09-14T11:13:47.280 INFO:tasks.workunit.client.0.smithi050.stderr: -498> 2024-09-14T11:13:46.991+0000 7fd48f321800 5 AuthRegistry(0x55b0a61698a0) adding con mode: secure 2024-09-14T11:13:47.280 INFO:tasks.workunit.client.0.smithi050.stderr: -497> 2024-09-14T11:13:46.991+0000 7fd48f321800 5 AuthRegistry(0x55b0a61698a0) adding con mode: crc 2024-09-14T11:13:47.280 INFO:tasks.workunit.client.0.smithi050.stderr: -496> 2024-09-14T11:13:46.991+0000 7fd48f321800 5 AuthRegistry(0x55b0a61698a0) adding con mode: secure 2024-09-14T11:13:47.280 INFO:tasks.workunit.client.0.smithi050.stderr: -495> 2024-09-14T11:13:46.991+0000 7fd48f321800 5 AuthRegistry(0x55b0a61698a0) adding con mode: crc 2024-09-14T11:13:47.280 INFO:tasks.workunit.client.0.smithi050.stderr: -494> 2024-09-14T11:13:46.991+0000 7fd48f321800 5 AuthRegistry(0x55b0a61698a0) adding con mode: secure 2024-09-14T11:13:47.280 INFO:tasks.workunit.client.0.smithi050.stderr: -493> 2024-09-14T11:13:46.992+0000 7fd48f321800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:47.280 INFO:tasks.workunit.client.0.smithi050.stderr: -492> 2024-09-14T11:13:46.992+0000 7fd48f321800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:47.280 INFO:tasks.workunit.client.0.smithi050.stderr: -491> 2024-09-14T11:13:46.992+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command rotate-key hook 0x55b0a61699e8 2024-09-14T11:13:47.280 INFO:tasks.workunit.client.0.smithi050.stderr: -490> 2024-09-14T11:13:46.992+0000 7fd48f321800 10 monclient: _reopen_session rank -1 2024-09-14T11:13:47.280 INFO:tasks.workunit.client.0.smithi050.stderr: -489> 2024-09-14T11:13:46.992+0000 7fd48f321800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:13:47.280 INFO:tasks.workunit.client.0.smithi050.stderr: -488> 2024-09-14T11:13:46.992+0000 7fd48f321800 10 monclient(hunting): picked mon.noname-a con 0x55b0a6016d00 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:13:47.280 INFO:tasks.workunit.client.0.smithi050.stderr: -487> 2024-09-14T11:13:46.992+0000 7fd48f321800 10 monclient(hunting): picked mon.noname-c con 0x55b0a6022c90 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:13:47.280 INFO:tasks.workunit.client.0.smithi050.stderr: -486> 2024-09-14T11:13:46.992+0000 7fd48f321800 10 monclient(hunting): picked mon.noname-b con 0x55b0a6194010 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:13:47.280 INFO:tasks.workunit.client.0.smithi050.stderr: -485> 2024-09-14T11:13:46.992+0000 7fd48f321800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:47.281 INFO:tasks.workunit.client.0.smithi050.stderr: -484> 2024-09-14T11:13:46.992+0000 7fd48f321800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:47.281 INFO:tasks.workunit.client.0.smithi050.stderr: -483> 2024-09-14T11:13:46.992+0000 7fd48f321800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:47.281 INFO:tasks.workunit.client.0.smithi050.stderr: -482> 2024-09-14T11:13:46.992+0000 7fd48f321800 10 monclient(hunting): _renew_subs 2024-09-14T11:13:47.281 INFO:tasks.workunit.client.0.smithi050.stderr: -481> 2024-09-14T11:13:46.992+0000 7fd48f321800 10 monclient(hunting): authenticate will time out at 2479.629502s 2024-09-14T11:13:47.281 INFO:tasks.workunit.client.0.smithi050.stderr: -480> 2024-09-14T11:13:46.992+0000 7fd48b044640 10 monclient(hunting): get_auth_request con 0x55b0a6016d00 auth_method 0 2024-09-14T11:13:47.281 INFO:tasks.workunit.client.0.smithi050.stderr: -479> 2024-09-14T11:13:46.992+0000 7fd48b044640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:47.281 INFO:tasks.workunit.client.0.smithi050.stderr: -478> 2024-09-14T11:13:46.992+0000 7fd48b044640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:47.281 INFO:tasks.workunit.client.0.smithi050.stderr: -477> 2024-09-14T11:13:46.992+0000 7fd48b044640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:47.281 INFO:tasks.workunit.client.0.smithi050.stderr: -476> 2024-09-14T11:13:46.992+0000 7fd483fff640 10 monclient(hunting): get_auth_request con 0x55b0a6022c90 auth_method 0 2024-09-14T11:13:47.281 INFO:tasks.workunit.client.0.smithi050.stderr: -475> 2024-09-14T11:13:46.992+0000 7fd483fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:47.281 INFO:tasks.workunit.client.0.smithi050.stderr: -474> 2024-09-14T11:13:46.992+0000 7fd483fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:47.281 INFO:tasks.workunit.client.0.smithi050.stderr: -473> 2024-09-14T11:13:46.992+0000 7fd483fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:47.281 INFO:tasks.workunit.client.0.smithi050.stderr: -472> 2024-09-14T11:13:46.992+0000 7fd48b044640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:47.282 INFO:tasks.workunit.client.0.smithi050.stderr: -471> 2024-09-14T11:13:46.992+0000 7fd48b044640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:47.282 INFO:tasks.workunit.client.0.smithi050.stderr: -470> 2024-09-14T11:13:46.992+0000 7fd48b044640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:47.282 INFO:tasks.workunit.client.0.smithi050.stderr: -469> 2024-09-14T11:13:46.992+0000 7fd483fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:47.282 INFO:tasks.workunit.client.0.smithi050.stderr: -468> 2024-09-14T11:13:46.992+0000 7fd483fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:47.282 INFO:tasks.workunit.client.0.smithi050.stderr: -467> 2024-09-14T11:13:46.992+0000 7fd483fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:47.282 INFO:tasks.workunit.client.0.smithi050.stderr: -466> 2024-09-14T11:13:46.992+0000 7fd48b845640 10 monclient(hunting): get_auth_request con 0x55b0a6194010 auth_method 0 2024-09-14T11:13:47.282 INFO:tasks.workunit.client.0.smithi050.stderr: -465> 2024-09-14T11:13:46.992+0000 7fd48b845640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:47.282 INFO:tasks.workunit.client.0.smithi050.stderr: -464> 2024-09-14T11:13:46.992+0000 7fd48b845640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:47.282 INFO:tasks.workunit.client.0.smithi050.stderr: -463> 2024-09-14T11:13:46.992+0000 7fd48b845640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:47.282 INFO:tasks.workunit.client.0.smithi050.stderr: -462> 2024-09-14T11:13:46.992+0000 7fd48b845640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:47.282 INFO:tasks.workunit.client.0.smithi050.stderr: -461> 2024-09-14T11:13:46.992+0000 7fd48b845640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:47.282 INFO:tasks.workunit.client.0.smithi050.stderr: -460> 2024-09-14T11:13:46.992+0000 7fd48b845640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:47.282 INFO:tasks.workunit.client.0.smithi050.stderr: -459> 2024-09-14T11:13:46.992+0000 7fd48b044640 10 monclient(hunting): handle_auth_done global_id 8058 payload 824 2024-09-14T11:13:47.282 INFO:tasks.workunit.client.0.smithi050.stderr: -458> 2024-09-14T11:13:46.992+0000 7fd48b044640 10 monclient: _finish_hunting 0 2024-09-14T11:13:47.283 INFO:tasks.workunit.client.0.smithi050.stderr: -457> 2024-09-14T11:13:46.992+0000 7fd48b044640 1 monclient: found mon.noname-a 2024-09-14T11:13:47.283 INFO:tasks.workunit.client.0.smithi050.stderr: -456> 2024-09-14T11:13:46.992+0000 7fd48b044640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:13:47.283 INFO:tasks.workunit.client.0.smithi050.stderr: -455> 2024-09-14T11:13:46.993+0000 7fd377e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:47.283 INFO:tasks.workunit.client.0.smithi050.stderr: -454> 2024-09-14T11:13:46.993+0000 7fd377e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:13:47.283 INFO:tasks.workunit.client.0.smithi050.stderr: -453> 2024-09-14T11:13:46.993+0000 7fd377e07640 10 monclient: dump: 2024-09-14T11:13:47.283 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:47.283 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:47.283 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.283 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.283 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:47.283 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:47.283 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:47.283 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:47.283 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:47.284 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.284 INFO:tasks.workunit.client.0.smithi050.stderr: -452> 2024-09-14T11:13:46.993+0000 7fd377e07640 10 monclient: _finish_auth 0 2024-09-14T11:13:47.284 INFO:tasks.workunit.client.0.smithi050.stderr: -451> 2024-09-14T11:13:46.993+0000 7fd377e07640 10 monclient: _check_auth_tickets 2024-09-14T11:13:47.284 INFO:tasks.workunit.client.0.smithi050.stderr: -450> 2024-09-14T11:13:46.993+0000 7fd377e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:47.284 INFO:tasks.workunit.client.0.smithi050.stderr: -449> 2024-09-14T11:13:46.993+0000 7fd377e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:47.284 INFO:tasks.workunit.client.0.smithi050.stderr: -448> 2024-09-14T11:13:46.993+0000 7fd377e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:13:47.284 INFO:tasks.workunit.client.0.smithi050.stderr: -447> 2024-09-14T11:13:46.993+0000 7fd377e07640 10 monclient: dump: 2024-09-14T11:13:47.284 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:47.284 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:47.284 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.284 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.284 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:47.284 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:47.284 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:47.285 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:47.285 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:47.285 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.285 INFO:tasks.workunit.client.0.smithi050.stderr: -446> 2024-09-14T11:13:46.993+0000 7fd48f321800 5 monclient: authenticate success, global_id 8058 2024-09-14T11:13:47.285 INFO:tasks.workunit.client.0.smithi050.stderr: -445> 2024-09-14T11:13:46.993+0000 7fd48f321800 10 monclient: _renew_subs 2024-09-14T11:13:47.285 INFO:tasks.workunit.client.0.smithi050.stderr: -444> 2024-09-14T11:13:46.993+0000 7fd48f321800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:13:47.285 INFO:tasks.workunit.client.0.smithi050.stderr: -443> 2024-09-14T11:13:46.993+0000 7fd37960a640 4 set_mon_vals no callback set 2024-09-14T11:13:47.285 INFO:tasks.workunit.client.0.smithi050.stderr: -442> 2024-09-14T11:13:46.993+0000 7fd48f321800 10 monclient: _renew_subs 2024-09-14T11:13:47.285 INFO:tasks.workunit.client.0.smithi050.stderr: -441> 2024-09-14T11:13:46.993+0000 7fd48f321800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:13:47.285 INFO:tasks.workunit.client.0.smithi050.stderr: -440> 2024-09-14T11:13:46.993+0000 7fd48f321800 1 librados: init done 2024-09-14T11:13:47.285 INFO:tasks.workunit.client.0.smithi050.stderr: -439> 2024-09-14T11:13:46.995+0000 7fd377e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:13:47.285 INFO:tasks.workunit.client.0.smithi050.stderr: -438> 2024-09-14T11:13:46.995+0000 7fd377e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:13:47.285 INFO:tasks.workunit.client.0.smithi050.stderr: -437> 2024-09-14T11:13:46.995+0000 7fd377e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:13:47.286 INFO:tasks.workunit.client.0.smithi050.stderr: -436> 2024-09-14T11:13:46.995+0000 7fd483fff640 10 monclient: get_auth_request con 0x7fd370077230 auth_method 0 2024-09-14T11:13:47.286 INFO:tasks.workunit.client.0.smithi050.stderr: -435> 2024-09-14T11:13:46.995+0000 7fd48b845640 10 monclient: get_auth_request con 0x55b0a61aae00 auth_method 0 2024-09-14T11:13:47.286 INFO:tasks.workunit.client.0.smithi050.stderr: -434> 2024-09-14T11:13:46.996+0000 7fd48b044640 10 monclient: get_auth_request con 0x55b0a61b5640 auth_method 0 2024-09-14T11:13:47.286 INFO:tasks.workunit.client.0.smithi050.stderr: -433> 2024-09-14T11:13:46.997+0000 7fd483fff640 10 monclient: get_auth_request con 0x55b0a61b9ce0 auth_method 0 2024-09-14T11:13:47.286 INFO:tasks.workunit.client.0.smithi050.stderr: -432> 2024-09-14T11:13:46.998+0000 7fd48f321800 10 monclient: build_initial_monmap 2024-09-14T11:13:47.286 INFO:tasks.workunit.client.0.smithi050.stderr: -431> 2024-09-14T11:13:46.998+0000 7fd48f321800 1 build_initial for_mkfs: 0 2024-09-14T11:13:47.286 INFO:tasks.workunit.client.0.smithi050.stderr: -430> 2024-09-14T11:13:46.998+0000 7fd48f321800 10 monclient: monmap: 2024-09-14T11:13:47.286 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:13:47.286 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:13:47.286 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:13:47.286 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:13:47.286 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:13:47.286 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:47.287 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:13:47.287 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:13:47.287 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:13:47.287 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.287 INFO:tasks.workunit.client.0.smithi050.stderr: -429> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding auth protocol: cephx 2024-09-14T11:13:47.287 INFO:tasks.workunit.client.0.smithi050.stderr: -428> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding auth protocol: cephx 2024-09-14T11:13:47.287 INFO:tasks.workunit.client.0.smithi050.stderr: -427> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding auth protocol: cephx 2024-09-14T11:13:47.287 INFO:tasks.workunit.client.0.smithi050.stderr: -426> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding con mode: secure 2024-09-14T11:13:47.287 INFO:tasks.workunit.client.0.smithi050.stderr: -425> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding con mode: crc 2024-09-14T11:13:47.287 INFO:tasks.workunit.client.0.smithi050.stderr: -424> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding con mode: secure 2024-09-14T11:13:47.287 INFO:tasks.workunit.client.0.smithi050.stderr: -423> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding con mode: crc 2024-09-14T11:13:47.287 INFO:tasks.workunit.client.0.smithi050.stderr: -422> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding con mode: secure 2024-09-14T11:13:47.287 INFO:tasks.workunit.client.0.smithi050.stderr: -421> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding con mode: crc 2024-09-14T11:13:47.287 INFO:tasks.workunit.client.0.smithi050.stderr: -420> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding con mode: crc 2024-09-14T11:13:47.288 INFO:tasks.workunit.client.0.smithi050.stderr: -419> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding con mode: secure 2024-09-14T11:13:47.288 INFO:tasks.workunit.client.0.smithi050.stderr: -418> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding con mode: crc 2024-09-14T11:13:47.288 INFO:tasks.workunit.client.0.smithi050.stderr: -417> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding con mode: secure 2024-09-14T11:13:47.288 INFO:tasks.workunit.client.0.smithi050.stderr: -416> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding con mode: crc 2024-09-14T11:13:47.288 INFO:tasks.workunit.client.0.smithi050.stderr: -415> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding con mode: secure 2024-09-14T11:13:47.288 INFO:tasks.workunit.client.0.smithi050.stderr: -414> 2024-09-14T11:13:46.998+0000 7fd48f321800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:47.288 INFO:tasks.workunit.client.0.smithi050.stderr: -413> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command objecter_requests cmddesc objecter_requests hook 0x55b0a61c1e70 EEXIST 2024-09-14T11:13:47.288 INFO:tasks.workunit.client.0.smithi050.stderr: -412> 2024-09-14T11:13:46.999+0000 7fd48f321800 10 monclient: init 2024-09-14T11:13:47.288 INFO:tasks.workunit.client.0.smithi050.stderr: -411> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding auth protocol: cephx 2024-09-14T11:13:47.288 INFO:tasks.workunit.client.0.smithi050.stderr: -410> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding auth protocol: cephx 2024-09-14T11:13:47.288 INFO:tasks.workunit.client.0.smithi050.stderr: -409> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding auth protocol: cephx 2024-09-14T11:13:47.288 INFO:tasks.workunit.client.0.smithi050.stderr: -408> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding con mode: secure 2024-09-14T11:13:47.288 INFO:tasks.workunit.client.0.smithi050.stderr: -407> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding con mode: crc 2024-09-14T11:13:47.289 INFO:tasks.workunit.client.0.smithi050.stderr: -406> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding con mode: secure 2024-09-14T11:13:47.289 INFO:tasks.workunit.client.0.smithi050.stderr: -405> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding con mode: crc 2024-09-14T11:13:47.289 INFO:tasks.workunit.client.0.smithi050.stderr: -404> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding con mode: secure 2024-09-14T11:13:47.289 INFO:tasks.workunit.client.0.smithi050.stderr: -403> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding con mode: crc 2024-09-14T11:13:47.289 INFO:tasks.workunit.client.0.smithi050.stderr: -402> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding con mode: crc 2024-09-14T11:13:47.289 INFO:tasks.workunit.client.0.smithi050.stderr: -401> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding con mode: secure 2024-09-14T11:13:47.289 INFO:tasks.workunit.client.0.smithi050.stderr: -400> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding con mode: crc 2024-09-14T11:13:47.289 INFO:tasks.workunit.client.0.smithi050.stderr: -399> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding con mode: secure 2024-09-14T11:13:47.289 INFO:tasks.workunit.client.0.smithi050.stderr: -398> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding con mode: crc 2024-09-14T11:13:47.289 INFO:tasks.workunit.client.0.smithi050.stderr: -397> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding con mode: secure 2024-09-14T11:13:47.289 INFO:tasks.workunit.client.0.smithi050.stderr: -396> 2024-09-14T11:13:46.999+0000 7fd48f321800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:47.289 INFO:tasks.workunit.client.0.smithi050.stderr: -395> 2024-09-14T11:13:46.999+0000 7fd48f321800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:47.289 INFO:tasks.workunit.client.0.smithi050.stderr: -394> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command rotate-key cmddesc rotate-key hook 0x55b0a61bd1d0 EEXIST 2024-09-14T11:13:47.289 INFO:tasks.workunit.client.0.smithi050.stderr: -393> 2024-09-14T11:13:46.999+0000 7fd48f321800 10 monclient: _reopen_session rank -1 2024-09-14T11:13:47.290 INFO:tasks.workunit.client.0.smithi050.stderr: -392> 2024-09-14T11:13:46.999+0000 7fd48f321800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:13:47.290 INFO:tasks.workunit.client.0.smithi050.stderr: -391> 2024-09-14T11:13:46.999+0000 7fd48f321800 10 monclient(hunting): picked mon.noname-c con 0x55b0a61e6190 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:13:47.290 INFO:tasks.workunit.client.0.smithi050.stderr: -390> 2024-09-14T11:13:46.999+0000 7fd48f321800 10 monclient(hunting): picked mon.noname-b con 0x55b0a61e6570 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:13:47.290 INFO:tasks.workunit.client.0.smithi050.stderr: -389> 2024-09-14T11:13:46.999+0000 7fd48f321800 10 monclient(hunting): picked mon.noname-a con 0x55b0a61e4ea0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:13:47.290 INFO:tasks.workunit.client.0.smithi050.stderr: -388> 2024-09-14T11:13:46.999+0000 7fd48f321800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:47.290 INFO:tasks.workunit.client.0.smithi050.stderr: -387> 2024-09-14T11:13:46.999+0000 7fd48f321800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:47.290 INFO:tasks.workunit.client.0.smithi050.stderr: -386> 2024-09-14T11:13:46.999+0000 7fd48f321800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:47.290 INFO:tasks.workunit.client.0.smithi050.stderr: -385> 2024-09-14T11:13:46.999+0000 7fd48f321800 10 monclient(hunting): _renew_subs 2024-09-14T11:13:47.290 INFO:tasks.workunit.client.0.smithi050.stderr: -384> 2024-09-14T11:13:46.999+0000 7fd48f321800 10 monclient(hunting): authenticate will time out at 2479.636587s 2024-09-14T11:13:47.290 INFO:tasks.workunit.client.0.smithi050.stderr: -383> 2024-09-14T11:13:46.999+0000 7fd48b044640 10 monclient(hunting): get_auth_request con 0x55b0a61e6190 auth_method 0 2024-09-14T11:13:47.291 INFO:tasks.workunit.client.0.smithi050.stderr: -382> 2024-09-14T11:13:46.999+0000 7fd48b044640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:47.291 INFO:tasks.workunit.client.0.smithi050.stderr: -381> 2024-09-14T11:13:46.999+0000 7fd48b044640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:47.291 INFO:tasks.workunit.client.0.smithi050.stderr: -380> 2024-09-14T11:13:46.999+0000 7fd48b044640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:47.291 INFO:tasks.workunit.client.0.smithi050.stderr: -379> 2024-09-14T11:13:46.999+0000 7fd48b845640 10 monclient(hunting): get_auth_request con 0x55b0a61e4ea0 auth_method 0 2024-09-14T11:13:47.291 INFO:tasks.workunit.client.0.smithi050.stderr: -378> 2024-09-14T11:13:46.999+0000 7fd48b845640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:47.291 INFO:tasks.workunit.client.0.smithi050.stderr: -377> 2024-09-14T11:13:46.999+0000 7fd48b845640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:47.291 INFO:tasks.workunit.client.0.smithi050.stderr: -376> 2024-09-14T11:13:46.999+0000 7fd48b845640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:47.291 INFO:tasks.workunit.client.0.smithi050.stderr: -375> 2024-09-14T11:13:46.999+0000 7fd48b044640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:47.291 INFO:tasks.workunit.client.0.smithi050.stderr: -374> 2024-09-14T11:13:46.999+0000 7fd48b044640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:47.291 INFO:tasks.workunit.client.0.smithi050.stderr: -373> 2024-09-14T11:13:46.999+0000 7fd48b044640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:47.291 INFO:tasks.workunit.client.0.smithi050.stderr: -372> 2024-09-14T11:13:46.999+0000 7fd48b845640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:47.291 INFO:tasks.workunit.client.0.smithi050.stderr: -371> 2024-09-14T11:13:46.999+0000 7fd48b845640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:47.291 INFO:tasks.workunit.client.0.smithi050.stderr: -370> 2024-09-14T11:13:46.999+0000 7fd48b845640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:47.291 INFO:tasks.workunit.client.0.smithi050.stderr: -369> 2024-09-14T11:13:46.999+0000 7fd483fff640 10 monclient(hunting): get_auth_request con 0x55b0a61e6570 auth_method 0 2024-09-14T11:13:47.292 INFO:tasks.workunit.client.0.smithi050.stderr: -368> 2024-09-14T11:13:46.999+0000 7fd483fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:47.292 INFO:tasks.workunit.client.0.smithi050.stderr: -367> 2024-09-14T11:13:46.999+0000 7fd483fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:47.292 INFO:tasks.workunit.client.0.smithi050.stderr: -366> 2024-09-14T11:13:46.999+0000 7fd483fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:47.292 INFO:tasks.workunit.client.0.smithi050.stderr: -365> 2024-09-14T11:13:46.999+0000 7fd48b044640 10 monclient(hunting): handle_auth_done global_id 7529 payload 824 2024-09-14T11:13:47.292 INFO:tasks.workunit.client.0.smithi050.stderr: -364> 2024-09-14T11:13:46.999+0000 7fd48b044640 10 monclient: _finish_hunting 0 2024-09-14T11:13:47.292 INFO:tasks.workunit.client.0.smithi050.stderr: -363> 2024-09-14T11:13:46.999+0000 7fd48b044640 1 monclient: found mon.noname-c 2024-09-14T11:13:47.292 INFO:tasks.workunit.client.0.smithi050.stderr: -362> 2024-09-14T11:13:46.999+0000 7fd48b044640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:13:47.292 INFO:tasks.workunit.client.0.smithi050.stderr: -361> 2024-09-14T11:13:47.000+0000 7fd375602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:47.292 INFO:tasks.workunit.client.0.smithi050.stderr: -360> 2024-09-14T11:13:47.000+0000 7fd375602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:13:47.292 INFO:tasks.workunit.client.0.smithi050.stderr: -359> 2024-09-14T11:13:47.000+0000 7fd375602640 10 monclient: dump: 2024-09-14T11:13:47.292 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:47.292 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:47.292 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.293 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.293 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:47.293 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:47.293 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:47.293 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:47.293 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:47.293 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.293 INFO:tasks.workunit.client.0.smithi050.stderr: -358> 2024-09-14T11:13:47.000+0000 7fd375602640 10 monclient: _finish_auth 0 2024-09-14T11:13:47.293 INFO:tasks.workunit.client.0.smithi050.stderr: -357> 2024-09-14T11:13:47.000+0000 7fd375602640 10 monclient: _check_auth_tickets 2024-09-14T11:13:47.293 INFO:tasks.workunit.client.0.smithi050.stderr: -356> 2024-09-14T11:13:47.000+0000 7fd375602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:47.293 INFO:tasks.workunit.client.0.smithi050.stderr: -355> 2024-09-14T11:13:47.000+0000 7fd375602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:47.293 INFO:tasks.workunit.client.0.smithi050.stderr: -354> 2024-09-14T11:13:47.000+0000 7fd375602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:13:47.293 INFO:tasks.workunit.client.0.smithi050.stderr: -353> 2024-09-14T11:13:47.000+0000 7fd375602640 10 monclient: dump: 2024-09-14T11:13:47.294 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:47.294 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:47.294 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.294 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.294 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:47.294 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:47.294 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:47.294 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:47.294 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:47.294 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.294 INFO:tasks.workunit.client.0.smithi050.stderr: -352> 2024-09-14T11:13:47.000+0000 7fd48f321800 5 monclient: authenticate success, global_id 7529 2024-09-14T11:13:47.294 INFO:tasks.workunit.client.0.smithi050.stderr: -351> 2024-09-14T11:13:47.000+0000 7fd48f321800 10 monclient: _renew_subs 2024-09-14T11:13:47.294 INFO:tasks.workunit.client.0.smithi050.stderr: -350> 2024-09-14T11:13:47.000+0000 7fd48f321800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:13:47.294 INFO:tasks.workunit.client.0.smithi050.stderr: -349> 2024-09-14T11:13:47.000+0000 7fd48c046640 4 set_mon_vals no callback set 2024-09-14T11:13:47.295 INFO:tasks.workunit.client.0.smithi050.stderr: -348> 2024-09-14T11:13:47.000+0000 7fd48f321800 10 monclient: _renew_subs 2024-09-14T11:13:47.295 INFO:tasks.workunit.client.0.smithi050.stderr: -347> 2024-09-14T11:13:47.000+0000 7fd48f321800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:13:47.295 INFO:tasks.workunit.client.0.smithi050.stderr: -346> 2024-09-14T11:13:47.002+0000 7fd375602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:13:47.295 INFO:tasks.workunit.client.0.smithi050.stderr: -345> 2024-09-14T11:13:47.002+0000 7fd375602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:13:47.295 INFO:tasks.workunit.client.0.smithi050.stderr: -344> 2024-09-14T11:13:47.002+0000 7fd375602640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:13:47.295 INFO:tasks.workunit.client.0.smithi050.stderr: -343> 2024-09-14T11:13:47.002+0000 7fd483fff640 10 monclient: get_auth_request con 0x7fd364077140 auth_method 0 2024-09-14T11:13:47.295 INFO:tasks.workunit.client.0.smithi050.stderr: -342> 2024-09-14T11:13:47.002+0000 7fd48f321800 10 monclient: get_monmap_and_config 2024-09-14T11:13:47.295 INFO:tasks.workunit.client.0.smithi050.stderr: -341> 2024-09-14T11:13:47.002+0000 7fd48f321800 10 monclient: build_initial_monmap 2024-09-14T11:13:47.295 INFO:tasks.workunit.client.0.smithi050.stderr: -340> 2024-09-14T11:13:47.002+0000 7fd48f321800 1 build_initial for_mkfs: 0 2024-09-14T11:13:47.295 INFO:tasks.workunit.client.0.smithi050.stderr: -339> 2024-09-14T11:13:47.002+0000 7fd48f321800 10 monclient: monmap: 2024-09-14T11:13:47.295 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:13:47.295 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:13:47.295 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:13:47.295 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:13:47.296 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:13:47.296 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:47.296 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:13:47.296 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:13:47.296 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:13:47.296 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.296 INFO:tasks.workunit.client.0.smithi050.stderr: -338> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding auth protocol: cephx 2024-09-14T11:13:47.296 INFO:tasks.workunit.client.0.smithi050.stderr: -337> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding auth protocol: cephx 2024-09-14T11:13:47.296 INFO:tasks.workunit.client.0.smithi050.stderr: -336> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding auth protocol: cephx 2024-09-14T11:13:47.296 INFO:tasks.workunit.client.0.smithi050.stderr: -335> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding con mode: secure 2024-09-14T11:13:47.296 INFO:tasks.workunit.client.0.smithi050.stderr: -334> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding con mode: crc 2024-09-14T11:13:47.296 INFO:tasks.workunit.client.0.smithi050.stderr: -333> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding con mode: secure 2024-09-14T11:13:47.296 INFO:tasks.workunit.client.0.smithi050.stderr: -332> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding con mode: crc 2024-09-14T11:13:47.296 INFO:tasks.workunit.client.0.smithi050.stderr: -331> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding con mode: secure 2024-09-14T11:13:47.297 INFO:tasks.workunit.client.0.smithi050.stderr: -330> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding con mode: crc 2024-09-14T11:13:47.297 INFO:tasks.workunit.client.0.smithi050.stderr: -329> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding con mode: crc 2024-09-14T11:13:47.297 INFO:tasks.workunit.client.0.smithi050.stderr: -328> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding con mode: secure 2024-09-14T11:13:47.297 INFO:tasks.workunit.client.0.smithi050.stderr: -327> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding con mode: crc 2024-09-14T11:13:47.297 INFO:tasks.workunit.client.0.smithi050.stderr: -326> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding con mode: secure 2024-09-14T11:13:47.297 INFO:tasks.workunit.client.0.smithi050.stderr: -325> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding con mode: crc 2024-09-14T11:13:47.297 INFO:tasks.workunit.client.0.smithi050.stderr: -324> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding con mode: secure 2024-09-14T11:13:47.297 INFO:tasks.workunit.client.0.smithi050.stderr: -323> 2024-09-14T11:13:47.002+0000 7fd48f321800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:47.297 INFO:tasks.workunit.client.0.smithi050.stderr: -322> 2024-09-14T11:13:47.002+0000 7fd48f321800 10 monclient: init 2024-09-14T11:13:47.297 INFO:tasks.workunit.client.0.smithi050.stderr: -321> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding auth protocol: cephx 2024-09-14T11:13:47.297 INFO:tasks.workunit.client.0.smithi050.stderr: -320> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding auth protocol: cephx 2024-09-14T11:13:47.297 INFO:tasks.workunit.client.0.smithi050.stderr: -319> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding auth protocol: cephx 2024-09-14T11:13:47.297 INFO:tasks.workunit.client.0.smithi050.stderr: -318> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding con mode: secure 2024-09-14T11:13:47.297 INFO:tasks.workunit.client.0.smithi050.stderr: -317> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding con mode: crc 2024-09-14T11:13:47.298 INFO:tasks.workunit.client.0.smithi050.stderr: -316> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding con mode: secure 2024-09-14T11:13:47.298 INFO:tasks.workunit.client.0.smithi050.stderr: -315> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding con mode: crc 2024-09-14T11:13:47.298 INFO:tasks.workunit.client.0.smithi050.stderr: -314> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding con mode: secure 2024-09-14T11:13:47.298 INFO:tasks.workunit.client.0.smithi050.stderr: -313> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding con mode: crc 2024-09-14T11:13:47.298 INFO:tasks.workunit.client.0.smithi050.stderr: -312> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding con mode: crc 2024-09-14T11:13:47.298 INFO:tasks.workunit.client.0.smithi050.stderr: -311> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding con mode: secure 2024-09-14T11:13:47.298 INFO:tasks.workunit.client.0.smithi050.stderr: -310> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding con mode: crc 2024-09-14T11:13:47.298 INFO:tasks.workunit.client.0.smithi050.stderr: -309> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding con mode: secure 2024-09-14T11:13:47.298 INFO:tasks.workunit.client.0.smithi050.stderr: -308> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding con mode: crc 2024-09-14T11:13:47.298 INFO:tasks.workunit.client.0.smithi050.stderr: -307> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding con mode: secure 2024-09-14T11:13:47.298 INFO:tasks.workunit.client.0.smithi050.stderr: -306> 2024-09-14T11:13:47.003+0000 7fd48f321800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:47.298 INFO:tasks.workunit.client.0.smithi050.stderr: -305> 2024-09-14T11:13:47.003+0000 7fd48f321800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:47.298 INFO:tasks.workunit.client.0.smithi050.stderr: -304> 2024-09-14T11:13:47.003+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command rotate-key cmddesc rotate-key hook 0x7fff0e6b2868 EEXIST 2024-09-14T11:13:47.299 INFO:tasks.workunit.client.0.smithi050.stderr: -303> 2024-09-14T11:13:47.003+0000 7fd48f321800 10 monclient: _reopen_session rank -1 2024-09-14T11:13:47.299 INFO:tasks.workunit.client.0.smithi050.stderr: -302> 2024-09-14T11:13:47.003+0000 7fd48f321800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:13:47.299 INFO:tasks.workunit.client.0.smithi050.stderr: -301> 2024-09-14T11:13:47.003+0000 7fd48f321800 10 monclient(hunting): picked mon.noname-b con 0x55b0a623a680 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:13:47.299 INFO:tasks.workunit.client.0.smithi050.stderr: -300> 2024-09-14T11:13:47.003+0000 7fd48f321800 10 monclient(hunting): picked mon.noname-c con 0x55b0a620a490 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:13:47.299 INFO:tasks.workunit.client.0.smithi050.stderr: -299> 2024-09-14T11:13:47.003+0000 7fd48f321800 10 monclient(hunting): picked mon.noname-a con 0x55b0a6235a40 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:13:47.299 INFO:tasks.workunit.client.0.smithi050.stderr: -298> 2024-09-14T11:13:47.003+0000 7fd48f321800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:47.299 INFO:tasks.workunit.client.0.smithi050.stderr: -297> 2024-09-14T11:13:47.003+0000 7fd48f321800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:47.299 INFO:tasks.workunit.client.0.smithi050.stderr: -296> 2024-09-14T11:13:47.003+0000 7fd48f321800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:47.299 INFO:tasks.workunit.client.0.smithi050.stderr: -295> 2024-09-14T11:13:47.003+0000 7fd48f321800 10 monclient(hunting): _renew_subs 2024-09-14T11:13:47.299 INFO:tasks.workunit.client.0.smithi050.stderr: -294> 2024-09-14T11:13:47.003+0000 7fd48f321800 10 monclient(hunting): authenticate will time out at 2479.640406s 2024-09-14T11:13:47.299 INFO:tasks.workunit.client.0.smithi050.stderr: -293> 2024-09-14T11:13:47.003+0000 7fd483fff640 10 monclient(hunting): get_auth_request con 0x55b0a620a490 auth_method 0 2024-09-14T11:13:47.299 INFO:tasks.workunit.client.0.smithi050.stderr: -292> 2024-09-14T11:13:47.003+0000 7fd483fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:47.299 INFO:tasks.workunit.client.0.smithi050.stderr: -291> 2024-09-14T11:13:47.003+0000 7fd483fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:47.299 INFO:tasks.workunit.client.0.smithi050.stderr: -290> 2024-09-14T11:13:47.003+0000 7fd483fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:47.299 INFO:tasks.workunit.client.0.smithi050.stderr: -289> 2024-09-14T11:13:47.003+0000 7fd48b845640 10 monclient(hunting): get_auth_request con 0x55b0a6235a40 auth_method 0 2024-09-14T11:13:47.300 INFO:tasks.workunit.client.0.smithi050.stderr: -288> 2024-09-14T11:13:47.003+0000 7fd48b845640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:47.300 INFO:tasks.workunit.client.0.smithi050.stderr: -287> 2024-09-14T11:13:47.003+0000 7fd48b845640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:47.300 INFO:tasks.workunit.client.0.smithi050.stderr: -286> 2024-09-14T11:13:47.003+0000 7fd48b845640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:47.300 INFO:tasks.workunit.client.0.smithi050.stderr: -285> 2024-09-14T11:13:47.003+0000 7fd48b044640 10 monclient(hunting): get_auth_request con 0x55b0a623a680 auth_method 0 2024-09-14T11:13:47.300 INFO:tasks.workunit.client.0.smithi050.stderr: -284> 2024-09-14T11:13:47.003+0000 7fd48b044640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:47.300 INFO:tasks.workunit.client.0.smithi050.stderr: -283> 2024-09-14T11:13:47.003+0000 7fd48b044640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:47.300 INFO:tasks.workunit.client.0.smithi050.stderr: -282> 2024-09-14T11:13:47.003+0000 7fd48b044640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:47.300 INFO:tasks.workunit.client.0.smithi050.stderr: -281> 2024-09-14T11:13:47.003+0000 7fd483fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:47.300 INFO:tasks.workunit.client.0.smithi050.stderr: -280> 2024-09-14T11:13:47.003+0000 7fd483fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:47.300 INFO:tasks.workunit.client.0.smithi050.stderr: -279> 2024-09-14T11:13:47.003+0000 7fd483fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:47.300 INFO:tasks.workunit.client.0.smithi050.stderr: -278> 2024-09-14T11:13:47.003+0000 7fd48b845640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:47.300 INFO:tasks.workunit.client.0.smithi050.stderr: -277> 2024-09-14T11:13:47.003+0000 7fd48b845640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:47.300 INFO:tasks.workunit.client.0.smithi050.stderr: -276> 2024-09-14T11:13:47.003+0000 7fd48b845640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:47.300 INFO:tasks.workunit.client.0.smithi050.stderr: -275> 2024-09-14T11:13:47.003+0000 7fd48b044640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:47.301 INFO:tasks.workunit.client.0.smithi050.stderr: -274> 2024-09-14T11:13:47.003+0000 7fd48b044640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:47.301 INFO:tasks.workunit.client.0.smithi050.stderr: -273> 2024-09-14T11:13:47.003+0000 7fd48b044640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:47.301 INFO:tasks.workunit.client.0.smithi050.stderr: -272> 2024-09-14T11:13:47.003+0000 7fd483fff640 10 monclient(hunting): handle_auth_done global_id 7532 payload 274 2024-09-14T11:13:47.301 INFO:tasks.workunit.client.0.smithi050.stderr: -271> 2024-09-14T11:13:47.003+0000 7fd483fff640 10 monclient: _finish_hunting 0 2024-09-14T11:13:47.301 INFO:tasks.workunit.client.0.smithi050.stderr: -270> 2024-09-14T11:13:47.003+0000 7fd483fff640 1 monclient: found mon.noname-c 2024-09-14T11:13:47.301 INFO:tasks.workunit.client.0.smithi050.stderr: -269> 2024-09-14T11:13:47.003+0000 7fd483fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:13:47.301 INFO:tasks.workunit.client.0.smithi050.stderr: -268> 2024-09-14T11:13:47.004+0000 7fd36effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:47.301 INFO:tasks.workunit.client.0.smithi050.stderr: -267> 2024-09-14T11:13:47.004+0000 7fd36effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:13:47.301 INFO:tasks.workunit.client.0.smithi050.stderr: -266> 2024-09-14T11:13:47.004+0000 7fd36effd640 10 monclient: dump: 2024-09-14T11:13:47.301 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:47.301 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:47.301 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.301 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.301 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:47.302 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:47.302 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:47.302 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:47.302 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:47.302 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.302 INFO:tasks.workunit.client.0.smithi050.stderr: -265> 2024-09-14T11:13:47.004+0000 7fd36effd640 10 monclient: _finish_auth 0 2024-09-14T11:13:47.302 INFO:tasks.workunit.client.0.smithi050.stderr: -264> 2024-09-14T11:13:47.004+0000 7fd36effd640 10 monclient: _check_auth_tickets 2024-09-14T11:13:47.302 INFO:tasks.workunit.client.0.smithi050.stderr: -263> 2024-09-14T11:13:47.004+0000 7fd36effd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:47.302 INFO:tasks.workunit.client.0.smithi050.stderr: -262> 2024-09-14T11:13:47.004+0000 7fd36effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:47.302 INFO:tasks.workunit.client.0.smithi050.stderr: -261> 2024-09-14T11:13:47.004+0000 7fd36effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:13:47.302 INFO:tasks.workunit.client.0.smithi050.stderr: -260> 2024-09-14T11:13:47.004+0000 7fd36effd640 10 monclient: dump: 2024-09-14T11:13:47.302 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:47.302 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:47.302 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.303 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.303 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:47.303 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:47.303 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:47.303 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:47.303 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:47.303 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.303 INFO:tasks.workunit.client.0.smithi050.stderr: -259> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 monclient: authenticate success, global_id 7532 2024-09-14T11:13:47.303 INFO:tasks.workunit.client.0.smithi050.stderr: -258> 2024-09-14T11:13:47.004+0000 7fd48f321800 10 monclient: get_monmap_and_config success 2024-09-14T11:13:47.303 INFO:tasks.workunit.client.0.smithi050.stderr: -257> 2024-09-14T11:13:47.004+0000 7fd48f321800 4 set_mon_vals no callback set 2024-09-14T11:13:47.303 INFO:tasks.workunit.client.0.smithi050.stderr: -256> 2024-09-14T11:13:47.004+0000 7fd48f321800 10 monclient: shutdown 2024-09-14T11:13:47.303 INFO:tasks.workunit.client.0.smithi050.stderr: -255> 2024-09-14T11:13:47.004+0000 7fd48f321800 10 monclient: build_initial_monmap 2024-09-14T11:13:47.303 INFO:tasks.workunit.client.0.smithi050.stderr: -254> 2024-09-14T11:13:47.004+0000 7fd48f321800 1 build_initial for_mkfs: 0 2024-09-14T11:13:47.303 INFO:tasks.workunit.client.0.smithi050.stderr: -253> 2024-09-14T11:13:47.004+0000 7fd48f321800 10 monclient: monmap: 2024-09-14T11:13:47.303 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:13:47.304 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:13:47.304 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:13:47.304 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:13:47.304 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:13:47.304 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:47.304 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:13:47.304 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:13:47.304 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:13:47.304 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.304 INFO:tasks.workunit.client.0.smithi050.stderr: -252> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding auth protocol: cephx 2024-09-14T11:13:47.304 INFO:tasks.workunit.client.0.smithi050.stderr: -251> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding auth protocol: cephx 2024-09-14T11:13:47.304 INFO:tasks.workunit.client.0.smithi050.stderr: -250> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding auth protocol: cephx 2024-09-14T11:13:47.304 INFO:tasks.workunit.client.0.smithi050.stderr: -249> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding con mode: secure 2024-09-14T11:13:47.305 INFO:tasks.workunit.client.0.smithi050.stderr: -248> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding con mode: crc 2024-09-14T11:13:47.305 INFO:tasks.workunit.client.0.smithi050.stderr: -247> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding con mode: secure 2024-09-14T11:13:47.305 INFO:tasks.workunit.client.0.smithi050.stderr: -246> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding con mode: crc 2024-09-14T11:13:47.305 INFO:tasks.workunit.client.0.smithi050.stderr: -245> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding con mode: secure 2024-09-14T11:13:47.305 INFO:tasks.workunit.client.0.smithi050.stderr: -244> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding con mode: crc 2024-09-14T11:13:47.305 INFO:tasks.workunit.client.0.smithi050.stderr: -243> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding con mode: crc 2024-09-14T11:13:47.305 INFO:tasks.workunit.client.0.smithi050.stderr: -242> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding con mode: secure 2024-09-14T11:13:47.305 INFO:tasks.workunit.client.0.smithi050.stderr: -241> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding con mode: crc 2024-09-14T11:13:47.305 INFO:tasks.workunit.client.0.smithi050.stderr: -240> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding con mode: secure 2024-09-14T11:13:47.305 INFO:tasks.workunit.client.0.smithi050.stderr: -239> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding con mode: crc 2024-09-14T11:13:47.305 INFO:tasks.workunit.client.0.smithi050.stderr: -238> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding con mode: secure 2024-09-14T11:13:47.305 INFO:tasks.workunit.client.0.smithi050.stderr: -237> 2024-09-14T11:13:47.005+0000 7fd48f321800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:47.305 INFO:tasks.workunit.client.0.smithi050.stderr: -236> 2024-09-14T11:13:47.005+0000 7fd48f321800 1 librados: starting msgr at 2024-09-14T11:13:47.306 INFO:tasks.workunit.client.0.smithi050.stderr: -235> 2024-09-14T11:13:47.005+0000 7fd48f321800 1 librados: starting objecter 2024-09-14T11:13:47.306 INFO:tasks.workunit.client.0.smithi050.stderr: -234> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command objecter_requests cmddesc objecter_requests hook 0x55b0a620c260 EEXIST 2024-09-14T11:13:47.306 INFO:tasks.workunit.client.0.smithi050.stderr: -233> 2024-09-14T11:13:47.005+0000 7fd48f321800 1 librados: setting wanted keys 2024-09-14T11:13:47.306 INFO:tasks.workunit.client.0.smithi050.stderr: -232> 2024-09-14T11:13:47.005+0000 7fd48f321800 1 librados: calling monclient init 2024-09-14T11:13:47.306 INFO:tasks.workunit.client.0.smithi050.stderr: -231> 2024-09-14T11:13:47.005+0000 7fd48f321800 10 monclient: init 2024-09-14T11:13:47.306 INFO:tasks.workunit.client.0.smithi050.stderr: -230> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding auth protocol: cephx 2024-09-14T11:13:47.306 INFO:tasks.workunit.client.0.smithi050.stderr: -229> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding auth protocol: cephx 2024-09-14T11:13:47.306 INFO:tasks.workunit.client.0.smithi050.stderr: -228> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding auth protocol: cephx 2024-09-14T11:13:47.306 INFO:tasks.workunit.client.0.smithi050.stderr: -227> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding con mode: secure 2024-09-14T11:13:47.306 INFO:tasks.workunit.client.0.smithi050.stderr: -226> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding con mode: crc 2024-09-14T11:13:47.306 INFO:tasks.workunit.client.0.smithi050.stderr: -225> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding con mode: secure 2024-09-14T11:13:47.306 INFO:tasks.workunit.client.0.smithi050.stderr: -224> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding con mode: crc 2024-09-14T11:13:47.306 INFO:tasks.workunit.client.0.smithi050.stderr: -223> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding con mode: secure 2024-09-14T11:13:47.306 INFO:tasks.workunit.client.0.smithi050.stderr: -222> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding con mode: crc 2024-09-14T11:13:47.306 INFO:tasks.workunit.client.0.smithi050.stderr: -221> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding con mode: crc 2024-09-14T11:13:47.307 INFO:tasks.workunit.client.0.smithi050.stderr: -220> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding con mode: secure 2024-09-14T11:13:47.307 INFO:tasks.workunit.client.0.smithi050.stderr: -219> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding con mode: crc 2024-09-14T11:13:47.307 INFO:tasks.workunit.client.0.smithi050.stderr: -218> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding con mode: secure 2024-09-14T11:13:47.307 INFO:tasks.workunit.client.0.smithi050.stderr: -217> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding con mode: crc 2024-09-14T11:13:47.307 INFO:tasks.workunit.client.0.smithi050.stderr: -216> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding con mode: secure 2024-09-14T11:13:47.307 INFO:tasks.workunit.client.0.smithi050.stderr: -215> 2024-09-14T11:13:47.005+0000 7fd48f321800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:47.307 INFO:tasks.workunit.client.0.smithi050.stderr: -214> 2024-09-14T11:13:47.005+0000 7fd48f321800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:47.307 INFO:tasks.workunit.client.0.smithi050.stderr: -213> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command rotate-key cmddesc rotate-key hook 0x55b0a61fab98 EEXIST 2024-09-14T11:13:47.308 INFO:tasks.workunit.client.0.smithi050.stderr: -212> 2024-09-14T11:13:47.005+0000 7fd48f321800 10 monclient: _reopen_session rank -1 2024-09-14T11:13:47.308 INFO:tasks.workunit.client.0.smithi050.stderr: -211> 2024-09-14T11:13:47.005+0000 7fd48f321800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:13:47.308 INFO:tasks.workunit.client.0.smithi050.stderr: -210> 2024-09-14T11:13:47.005+0000 7fd48f321800 10 monclient(hunting): picked mon.noname-c con 0x55b0a620a490 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:13:47.308 INFO:tasks.workunit.client.0.smithi050.stderr: -209> 2024-09-14T11:13:47.005+0000 7fd48f321800 10 monclient(hunting): picked mon.noname-a con 0x55b0a6235a40 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:13:47.308 INFO:tasks.workunit.client.0.smithi050.stderr: -208> 2024-09-14T11:13:47.005+0000 7fd48f321800 10 monclient(hunting): picked mon.noname-b con 0x55b0a623a680 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:13:47.308 INFO:tasks.workunit.client.0.smithi050.stderr: -207> 2024-09-14T11:13:47.005+0000 7fd48f321800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:47.308 INFO:tasks.workunit.client.0.smithi050.stderr: -206> 2024-09-14T11:13:47.005+0000 7fd48f321800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:47.308 INFO:tasks.workunit.client.0.smithi050.stderr: -205> 2024-09-14T11:13:47.005+0000 7fd48f321800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:47.308 INFO:tasks.workunit.client.0.smithi050.stderr: -204> 2024-09-14T11:13:47.005+0000 7fd48f321800 10 monclient(hunting): _renew_subs 2024-09-14T11:13:47.308 INFO:tasks.workunit.client.0.smithi050.stderr: -203> 2024-09-14T11:13:47.005+0000 7fd48f321800 10 monclient(hunting): authenticate will time out at 2479.642760s 2024-09-14T11:13:47.308 INFO:tasks.workunit.client.0.smithi050.stderr: -202> 2024-09-14T11:13:47.005+0000 7fd483fff640 10 monclient(hunting): get_auth_request con 0x55b0a6235a40 auth_method 0 2024-09-14T11:13:47.308 INFO:tasks.workunit.client.0.smithi050.stderr: -201> 2024-09-14T11:13:47.005+0000 7fd483fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:47.308 INFO:tasks.workunit.client.0.smithi050.stderr: -200> 2024-09-14T11:13:47.005+0000 7fd483fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:47.309 INFO:tasks.workunit.client.0.smithi050.stderr: -199> 2024-09-14T11:13:47.005+0000 7fd483fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:47.309 INFO:tasks.workunit.client.0.smithi050.stderr: -198> 2024-09-14T11:13:47.005+0000 7fd48b044640 10 monclient(hunting): get_auth_request con 0x55b0a620a490 auth_method 0 2024-09-14T11:13:47.309 INFO:tasks.workunit.client.0.smithi050.stderr: -197> 2024-09-14T11:13:47.005+0000 7fd48b044640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:47.309 INFO:tasks.workunit.client.0.smithi050.stderr: -196> 2024-09-14T11:13:47.005+0000 7fd48b044640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:47.309 INFO:tasks.workunit.client.0.smithi050.stderr: -195> 2024-09-14T11:13:47.005+0000 7fd48b044640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:47.309 INFO:tasks.workunit.client.0.smithi050.stderr: -194> 2024-09-14T11:13:47.005+0000 7fd483fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:47.309 INFO:tasks.workunit.client.0.smithi050.stderr: -193> 2024-09-14T11:13:47.005+0000 7fd483fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:47.309 INFO:tasks.workunit.client.0.smithi050.stderr: -192> 2024-09-14T11:13:47.005+0000 7fd483fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:47.309 INFO:tasks.workunit.client.0.smithi050.stderr: -191> 2024-09-14T11:13:47.005+0000 7fd48b044640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:47.309 INFO:tasks.workunit.client.0.smithi050.stderr: -190> 2024-09-14T11:13:47.005+0000 7fd48b044640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:47.309 INFO:tasks.workunit.client.0.smithi050.stderr: -189> 2024-09-14T11:13:47.005+0000 7fd48b044640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:47.309 INFO:tasks.workunit.client.0.smithi050.stderr: -188> 2024-09-14T11:13:47.005+0000 7fd48b845640 10 monclient(hunting): get_auth_request con 0x55b0a623a680 auth_method 0 2024-09-14T11:13:47.309 INFO:tasks.workunit.client.0.smithi050.stderr: -187> 2024-09-14T11:13:47.005+0000 7fd48b845640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:47.309 INFO:tasks.workunit.client.0.smithi050.stderr: -186> 2024-09-14T11:13:47.005+0000 7fd48b845640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:47.309 INFO:tasks.workunit.client.0.smithi050.stderr: -185> 2024-09-14T11:13:47.005+0000 7fd48b845640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:47.310 INFO:tasks.workunit.client.0.smithi050.stderr: -184> 2024-09-14T11:13:47.006+0000 7fd48b845640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:47.310 INFO:tasks.workunit.client.0.smithi050.stderr: -183> 2024-09-14T11:13:47.006+0000 7fd48b845640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:47.310 INFO:tasks.workunit.client.0.smithi050.stderr: -182> 2024-09-14T11:13:47.006+0000 7fd48b845640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:47.310 INFO:tasks.workunit.client.0.smithi050.stderr: -181> 2024-09-14T11:13:47.006+0000 7fd483fff640 10 monclient(hunting): handle_auth_done global_id 8067 payload 824 2024-09-14T11:13:47.310 INFO:tasks.workunit.client.0.smithi050.stderr: -180> 2024-09-14T11:13:47.006+0000 7fd483fff640 10 monclient: _finish_hunting 0 2024-09-14T11:13:47.310 INFO:tasks.workunit.client.0.smithi050.stderr: -179> 2024-09-14T11:13:47.006+0000 7fd483fff640 1 monclient: found mon.noname-a 2024-09-14T11:13:47.310 INFO:tasks.workunit.client.0.smithi050.stderr: -178> 2024-09-14T11:13:47.006+0000 7fd483fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:13:47.310 INFO:tasks.workunit.client.0.smithi050.stderr: -177> 2024-09-14T11:13:47.006+0000 7fd36d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:47.310 INFO:tasks.workunit.client.0.smithi050.stderr: -176> 2024-09-14T11:13:47.006+0000 7fd36d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:13:47.310 INFO:tasks.workunit.client.0.smithi050.stderr: -175> 2024-09-14T11:13:47.006+0000 7fd36d7fa640 10 monclient: dump: 2024-09-14T11:13:47.310 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:47.310 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:47.310 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.311 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.311 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:47.311 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:47.311 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:47.311 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:47.311 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:47.311 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.311 INFO:tasks.workunit.client.0.smithi050.stderr: -174> 2024-09-14T11:13:47.006+0000 7fd36d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:13:47.311 INFO:tasks.workunit.client.0.smithi050.stderr: -173> 2024-09-14T11:13:47.006+0000 7fd36d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:13:47.311 INFO:tasks.workunit.client.0.smithi050.stderr: -172> 2024-09-14T11:13:47.006+0000 7fd36d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:47.311 INFO:tasks.workunit.client.0.smithi050.stderr: -171> 2024-09-14T11:13:47.006+0000 7fd36d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:47.311 INFO:tasks.workunit.client.0.smithi050.stderr: -170> 2024-09-14T11:13:47.006+0000 7fd36d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:13:47.311 INFO:tasks.workunit.client.0.smithi050.stderr: -169> 2024-09-14T11:13:47.006+0000 7fd36d7fa640 10 monclient: dump: 2024-09-14T11:13:47.311 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:47.312 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:47.312 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.312 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.312 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:47.312 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:47.312 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:47.312 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:47.312 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:47.312 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.312 INFO:tasks.workunit.client.0.smithi050.stderr: -168> 2024-09-14T11:13:47.006+0000 7fd48f321800 5 monclient: authenticate success, global_id 8067 2024-09-14T11:13:47.312 INFO:tasks.workunit.client.0.smithi050.stderr: -167> 2024-09-14T11:13:47.006+0000 7fd48f321800 10 monclient: _renew_subs 2024-09-14T11:13:47.312 INFO:tasks.workunit.client.0.smithi050.stderr: -166> 2024-09-14T11:13:47.006+0000 7fd36effd640 4 set_mon_vals no callback set 2024-09-14T11:13:47.312 INFO:tasks.workunit.client.0.smithi050.stderr: -165> 2024-09-14T11:13:47.006+0000 7fd48f321800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:13:47.313 INFO:tasks.workunit.client.0.smithi050.stderr: -164> 2024-09-14T11:13:47.006+0000 7fd48f321800 10 monclient: _renew_subs 2024-09-14T11:13:47.313 INFO:tasks.workunit.client.0.smithi050.stderr: -163> 2024-09-14T11:13:47.006+0000 7fd48f321800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:13:47.313 INFO:tasks.workunit.client.0.smithi050.stderr: -162> 2024-09-14T11:13:47.006+0000 7fd48f321800 1 librados: init done 2024-09-14T11:13:47.313 INFO:tasks.workunit.client.0.smithi050.stderr: -161> 2024-09-14T11:13:47.006+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command cr dump hook 0x55b0a622ca88 2024-09-14T11:13:47.313 INFO:tasks.workunit.client.0.smithi050.stderr: -160> 2024-09-14T11:13:47.008+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.313 INFO:tasks.workunit.client.0.smithi050.stderr: -159> 2024-09-14T11:13:47.008+0000 7fd36d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:13:47.313 INFO:tasks.workunit.client.0.smithi050.stderr: -158> 2024-09-14T11:13:47.008+0000 7fd36d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:13:47.313 INFO:tasks.workunit.client.0.smithi050.stderr: -157> 2024-09-14T11:13:47.008+0000 7fd36d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:13:47.313 INFO:tasks.workunit.client.0.smithi050.stderr: -156> 2024-09-14T11:13:47.008+0000 7fd48b044640 10 monclient: get_auth_request con 0x7fd354077230 auth_method 0 2024-09-14T11:13:47.313 INFO:tasks.workunit.client.0.smithi050.stderr: -155> 2024-09-14T11:13:47.009+0000 7fd48b845640 10 monclient: get_auth_request con 0x55b0a6254a00 auth_method 0 2024-09-14T11:13:47.313 INFO:tasks.workunit.client.0.smithi050.stderr: -154> 2024-09-14T11:13:47.009+0000 7fd48f321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.313 INFO:tasks.workunit.client.0.smithi050.stderr: -153> 2024-09-14T11:13:47.009+0000 7fd48f321800 20 realm 2024-09-14T11:13:47.313 INFO:tasks.workunit.client.0.smithi050.stderr: -152> 2024-09-14T11:13:47.009+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.313 INFO:tasks.workunit.client.0.smithi050.stderr: -151> 2024-09-14T11:13:47.009+0000 7fd48f321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.313 INFO:tasks.workunit.client.0.smithi050.stderr: -150> 2024-09-14T11:13:47.009+0000 7fd48f321800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:47.314 INFO:tasks.workunit.client.0.smithi050.stderr: -149> 2024-09-14T11:13:47.009+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.314 INFO:tasks.workunit.client.0.smithi050.stderr: -148> 2024-09-14T11:13:47.010+0000 7fd48f321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.314 INFO:tasks.workunit.client.0.smithi050.stderr: -147> 2024-09-14T11:13:47.010+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.314 INFO:tasks.workunit.client.0.smithi050.stderr: -146> 2024-09-14T11:13:47.010+0000 7fd48b044640 10 monclient: get_auth_request con 0x55b0a6258d70 auth_method 0 2024-09-14T11:13:47.314 INFO:tasks.workunit.client.0.smithi050.stderr: -145> 2024-09-14T11:13:47.010+0000 7fd48f321800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:47.314 INFO:tasks.workunit.client.0.smithi050.stderr: -144> 2024-09-14T11:13:47.010+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.314 INFO:tasks.workunit.client.0.smithi050.stderr: -143> 2024-09-14T11:13:47.011+0000 7fd483fff640 10 monclient: get_auth_request con 0x55b0a625c470 auth_method 0 2024-09-14T11:13:47.314 INFO:tasks.workunit.client.0.smithi050.stderr: -142> 2024-09-14T11:13:47.011+0000 7fd48f321800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:47.314 INFO:tasks.workunit.client.0.smithi050.stderr: -141> 2024-09-14T11:13:47.011+0000 7fd48f321800 20 searching for the correct realm 2024-09-14T11:13:47.314 INFO:tasks.workunit.client.0.smithi050.stderr: -140> 2024-09-14T11:13:47.011+0000 7fd48b845640 10 monclient: get_auth_request con 0x55b0a6261230 auth_method 0 2024-09-14T11:13:47.314 INFO:tasks.workunit.client.0.smithi050.stderr: -139> 2024-09-14T11:13:47.012+0000 7fd48b044640 10 monclient: get_auth_request con 0x7fd48406abd0 auth_method 0 2024-09-14T11:13:47.314 INFO:tasks.workunit.client.0.smithi050.stderr: -138> 2024-09-14T11:13:47.014+0000 7fd483fff640 10 monclient: get_auth_request con 0x7fd484084400 auth_method 0 2024-09-14T11:13:47.314 INFO:tasks.workunit.client.0.smithi050.stderr: -137> 2024-09-14T11:13:47.014+0000 7fd483fff640 0 -- 172.21.15.50:0/3104753957 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fd484084400 msgr2=0x7fd484084860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:47.315 INFO:tasks.workunit.client.0.smithi050.stderr: -136> 2024-09-14T11:13:47.216+0000 7fd483fff640 10 monclient: get_auth_request con 0x7fd484084400 auth_method 0 2024-09-14T11:13:47.315 INFO:tasks.workunit.client.0.smithi050.stderr: -135> 2024-09-14T11:13:47.218+0000 7fd48b845640 10 monclient: get_auth_request con 0x7fd47c0722e0 auth_method 0 2024-09-14T11:13:47.315 INFO:tasks.workunit.client.0.smithi050.stderr: -134> 2024-09-14T11:13:47.219+0000 7fd48b044640 10 monclient: get_auth_request con 0x7fd484068440 auth_method 0 2024-09-14T11:13:47.315 INFO:tasks.workunit.client.0.smithi050.stderr: -133> 2024-09-14T11:13:47.220+0000 7fd48b845640 0 -- 172.21.15.50:0/3104753957 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55b0a6254a00 msgr2=0x55b0a6256e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:47.315 INFO:tasks.workunit.client.0.smithi050.stderr: -132> 2024-09-14T11:13:47.220+0000 7fd36d7fa640 1 client.8067.objecter ms_handle_reset 0x55b0a6254a00 session 0x55b0a6254380 osd.6 2024-09-14T11:13:47.315 INFO:tasks.workunit.client.0.smithi050.stderr: -131> 2024-09-14T11:13:47.220+0000 7fd36d7fa640 10 monclient: _renew_subs 2024-09-14T11:13:47.315 INFO:tasks.workunit.client.0.smithi050.stderr: -130> 2024-09-14T11:13:47.220+0000 7fd36d7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:13:47.315 INFO:tasks.workunit.client.0.smithi050.stderr: -129> 2024-09-14T11:13:47.221+0000 7fd48b845640 10 monclient: get_auth_request con 0x7fd354087540 auth_method 0 2024-09-14T11:13:47.315 INFO:tasks.workunit.client.0.smithi050.stderr: -128> 2024-09-14T11:13:47.224+0000 7fd48f321800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:47.315 INFO:tasks.workunit.client.0.smithi050.stderr: -127> 2024-09-14T11:13:47.224+0000 7fd48f321800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:47.315 INFO:tasks.workunit.client.0.smithi050.stderr: -126> 2024-09-14T11:13:47.224+0000 7fd48f321800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:47.315 INFO:tasks.workunit.client.0.smithi050.stderr: -125> 2024-09-14T11:13:47.224+0000 7fd48f321800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:47.315 INFO:tasks.workunit.client.0.smithi050.stderr: -124> 2024-09-14T11:13:47.224+0000 7fd48f321800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:47.315 INFO:tasks.workunit.client.0.smithi050.stderr: -123> 2024-09-14T11:13:47.224+0000 7fd48f321800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:47.316 INFO:tasks.workunit.client.0.smithi050.stderr: -122> 2024-09-14T11:13:47.224+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.316 INFO:tasks.workunit.client.0.smithi050.stderr: -121> 2024-09-14T11:13:47.225+0000 7fd48f321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.316 INFO:tasks.workunit.client.0.smithi050.stderr: -120> 2024-09-14T11:13:47.225+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.316 INFO:tasks.workunit.client.0.smithi050.stderr: -119> 2024-09-14T11:13:47.225+0000 7fd48f321800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:47.316 INFO:tasks.workunit.client.0.smithi050.stderr: -118> 2024-09-14T11:13:47.225+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.316 INFO:tasks.workunit.client.0.smithi050.stderr: -117> 2024-09-14T11:13:47.225+0000 7fd48f321800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:47.316 INFO:tasks.workunit.client.0.smithi050.stderr: -116> 2024-09-14T11:13:47.225+0000 7fd48f321800 20 zone default found 2024-09-14T11:13:47.316 INFO:tasks.workunit.client.0.smithi050.stderr: -115> 2024-09-14T11:13:47.225+0000 7fd48f321800 4 Realm: () 2024-09-14T11:13:47.316 INFO:tasks.workunit.client.0.smithi050.stderr: -114> 2024-09-14T11:13:47.225+0000 7fd48f321800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:47.316 INFO:tasks.workunit.client.0.smithi050.stderr: -113> 2024-09-14T11:13:47.225+0000 7fd48f321800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:47.316 INFO:tasks.workunit.client.0.smithi050.stderr: -112> 2024-09-14T11:13:47.225+0000 7fd48f321800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:47.316 INFO:tasks.workunit.client.0.smithi050.stderr: -111> 2024-09-14T11:13:47.225+0000 7fd48f321800 20 zonegroup default 2024-09-14T11:13:47.317 INFO:tasks.workunit.client.0.smithi050.stderr: -110> 2024-09-14T11:13:47.225+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.317 INFO:tasks.workunit.client.0.smithi050.stderr: -109> 2024-09-14T11:13:47.225+0000 7fd48f321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.317 INFO:tasks.workunit.client.0.smithi050.stderr: -108> 2024-09-14T11:13:47.225+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.317 INFO:tasks.workunit.client.0.smithi050.stderr: -107> 2024-09-14T11:13:47.226+0000 7fd48f321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.317 INFO:tasks.workunit.client.0.smithi050.stderr: -106> 2024-09-14T11:13:47.226+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.317 INFO:tasks.workunit.client.0.smithi050.stderr: -105> 2024-09-14T11:13:47.226+0000 7fd48f321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.317 INFO:tasks.workunit.client.0.smithi050.stderr: -104> 2024-09-14T11:13:47.226+0000 7fd48f321800 20 started sync module instance, tier type = 2024-09-14T11:13:47.317 INFO:tasks.workunit.client.0.smithi050.stderr: -103> 2024-09-14T11:13:47.226+0000 7fd48f321800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:47.317 INFO:tasks.workunit.client.0.smithi050.stderr: -102> 2024-09-14T11:13:47.234+0000 7fd48f321800 20 add_watcher() i=0 2024-09-14T11:13:47.317 INFO:tasks.workunit.client.0.smithi050.stderr: -101> 2024-09-14T11:13:47.234+0000 7fd48f321800 20 add_watcher() i=1 2024-09-14T11:13:47.317 INFO:tasks.workunit.client.0.smithi050.stderr: -100> 2024-09-14T11:13:47.234+0000 7fd48f321800 20 add_watcher() i=2 2024-09-14T11:13:47.317 INFO:tasks.workunit.client.0.smithi050.stderr: -99> 2024-09-14T11:13:47.234+0000 7fd48f321800 20 add_watcher() i=3 2024-09-14T11:13:47.317 INFO:tasks.workunit.client.0.smithi050.stderr: -98> 2024-09-14T11:13:47.234+0000 7fd48f321800 20 add_watcher() i=4 2024-09-14T11:13:47.318 INFO:tasks.workunit.client.0.smithi050.stderr: -97> 2024-09-14T11:13:47.234+0000 7fd48f321800 20 add_watcher() i=5 2024-09-14T11:13:47.318 INFO:tasks.workunit.client.0.smithi050.stderr: -96> 2024-09-14T11:13:47.234+0000 7fd48f321800 20 add_watcher() i=6 2024-09-14T11:13:47.318 INFO:tasks.workunit.client.0.smithi050.stderr: -95> 2024-09-14T11:13:47.235+0000 7fd48f321800 20 add_watcher() i=7 2024-09-14T11:13:47.318 INFO:tasks.workunit.client.0.smithi050.stderr: -94> 2024-09-14T11:13:47.235+0000 7fd48f321800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:47.318 INFO:tasks.workunit.client.0.smithi050.stderr: -93> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding auth protocol: cephx 2024-09-14T11:13:47.318 INFO:tasks.workunit.client.0.smithi050.stderr: -92> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding auth protocol: cephx 2024-09-14T11:13:47.318 INFO:tasks.workunit.client.0.smithi050.stderr: -91> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding auth protocol: cephx 2024-09-14T11:13:47.318 INFO:tasks.workunit.client.0.smithi050.stderr: -90> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding con mode: secure 2024-09-14T11:13:47.318 INFO:tasks.workunit.client.0.smithi050.stderr: -89> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding con mode: crc 2024-09-14T11:13:47.318 INFO:tasks.workunit.client.0.smithi050.stderr: -88> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding con mode: secure 2024-09-14T11:13:47.318 INFO:tasks.workunit.client.0.smithi050.stderr: -87> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding con mode: crc 2024-09-14T11:13:47.318 INFO:tasks.workunit.client.0.smithi050.stderr: -86> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding con mode: secure 2024-09-14T11:13:47.318 INFO:tasks.workunit.client.0.smithi050.stderr: -85> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding con mode: crc 2024-09-14T11:13:47.318 INFO:tasks.workunit.client.0.smithi050.stderr: -84> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding con mode: crc 2024-09-14T11:13:47.319 INFO:tasks.workunit.client.0.smithi050.stderr: -83> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding con mode: secure 2024-09-14T11:13:47.319 INFO:tasks.workunit.client.0.smithi050.stderr: -82> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding con mode: crc 2024-09-14T11:13:47.319 INFO:tasks.workunit.client.0.smithi050.stderr: -81> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding con mode: secure 2024-09-14T11:13:47.319 INFO:tasks.workunit.client.0.smithi050.stderr: -80> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding con mode: crc 2024-09-14T11:13:47.319 INFO:tasks.workunit.client.0.smithi050.stderr: -79> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding con mode: secure 2024-09-14T11:13:47.319 INFO:tasks.workunit.client.0.smithi050.stderr: -78> 2024-09-14T11:13:47.237+0000 7fd341fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:47.319 INFO:tasks.workunit.client.0.smithi050.stderr: -77> 2024-09-14T11:13:47.238+0000 7fd48f321800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:47.319 INFO:tasks.workunit.client.0.smithi050.stderr: -76> 2024-09-14T11:13:47.238+0000 7fd48f321800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:47.319 INFO:tasks.workunit.client.0.smithi050.stderr: -75> 2024-09-14T11:13:47.238+0000 7fd48f321800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:47.319 INFO:tasks.workunit.client.0.smithi050.stderr: -74> 2024-09-14T11:13:47.238+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command cache list hook 0x55b0a622c0c0 2024-09-14T11:13:47.319 INFO:tasks.workunit.client.0.smithi050.stderr: -73> 2024-09-14T11:13:47.238+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command cache inspect hook 0x55b0a622c0c0 2024-09-14T11:13:47.319 INFO:tasks.workunit.client.0.smithi050.stderr: -72> 2024-09-14T11:13:47.238+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command cache erase hook 0x55b0a622c0c0 2024-09-14T11:13:47.319 INFO:tasks.workunit.client.0.smithi050.stderr: -71> 2024-09-14T11:13:47.238+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command cache zap hook 0x55b0a622c0c0 2024-09-14T11:13:47.319 INFO:tasks.workunit.client.0.smithi050.stderr: -70> 2024-09-14T11:13:47.238+0000 7fd48f321800 5 note: GC not initialized 2024-09-14T11:13:47.319 INFO:tasks.workunit.client.0.smithi050.stderr: -69> 2024-09-14T11:13:47.238+0000 7fd340fe1640 20 reqs_thread_entry: start 2024-09-14T11:13:47.320 INFO:tasks.workunit.client.0.smithi050.stderr: -68> 2024-09-14T11:13:47.238+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command sync trace show hook 0x7fd47401f070 2024-09-14T11:13:47.320 INFO:tasks.workunit.client.0.smithi050.stderr: -67> 2024-09-14T11:13:47.238+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command sync trace history hook 0x7fd47401f070 2024-09-14T11:13:47.320 INFO:tasks.workunit.client.0.smithi050.stderr: -66> 2024-09-14T11:13:47.238+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command sync trace active hook 0x7fd47401f070 2024-09-14T11:13:47.320 INFO:tasks.workunit.client.0.smithi050.stderr: -65> 2024-09-14T11:13:47.238+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command sync trace active_short hook 0x7fd47401f070 2024-09-14T11:13:47.320 INFO:tasks.workunit.client.0.smithi050.stderr: -64> 2024-09-14T11:13:47.238+0000 7fd48f321800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:47.320 INFO:tasks.workunit.client.0.smithi050.stderr: -63> 2024-09-14T11:13:47.238+0000 7fd48f321800 20 Filter name: none 2024-09-14T11:13:47.320 INFO:tasks.workunit.client.0.smithi050.stderr: -62> 2024-09-14T11:13:47.238+0000 7fd2ba7fc640 20 reqs_thread_entry: start 2024-09-14T11:13:47.320 INFO:tasks.workunit.client.0.smithi050.stderr: -61> 2024-09-14T11:13:47.238+0000 7fd48f321800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:13:47.320 INFO:tasks.workunit.client.0.smithi050.stderr: -60> 2024-09-14T11:13:47.238+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.320 INFO:tasks.workunit.client.0.smithi050.stderr: -59> 2024-09-14T11:13:47.239+0000 7fd48f321800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:13:47.320 INFO:tasks.workunit.client.0.smithi050.stderr: -58> 2024-09-14T11:13:47.239+0000 7fd48f321800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:13:47.320 INFO:tasks.workunit.client.0.smithi050.stderr: -57> 2024-09-14T11:13:47.239+0000 7fd48f321800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:13:47.320 INFO:tasks.workunit.client.0.smithi050.stderr: -56> 2024-09-14T11:13:47.239+0000 7fd48f321800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 : miss 2024-09-14T11:13:47.321 INFO:tasks.workunit.client.0.smithi050.stderr: -55> 2024-09-14T11:13:47.239+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.321 INFO:tasks.workunit.client.0.smithi050.stderr: -54> 2024-09-14T11:13:47.240+0000 7fd48f321800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:13:47.321 INFO:tasks.workunit.client.0.smithi050.stderr: -53> 2024-09-14T11:13:47.240+0000 7fd48f321800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 info.flags=0x17 2024-09-14T11:13:47.321 INFO:tasks.workunit.client.0.smithi050.stderr: -52> 2024-09-14T11:13:47.240+0000 7fd48f321800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 to cache LRU end 2024-09-14T11:13:47.321 INFO:tasks.workunit.client.0.smithi050.stderr: -51> 2024-09-14T11:13:47.240+0000 7fd48f321800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:47.321 INFO:tasks.workunit.client.0.smithi050.stderr: -50> 2024-09-14T11:13:47.240+0000 7fd48f321800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:47.321 INFO:tasks.workunit.client.0.smithi050.stderr: -49> 2024-09-14T11:13:47.240+0000 7fd48f321800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 2024-09-14T11:13:47.321 INFO:tasks.workunit.client.0.smithi050.stderr: -48> 2024-09-14T11:13:47.245+0000 7fd48f321800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 info.flags=0x17 2024-09-14T11:13:47.321 INFO:tasks.workunit.client.0.smithi050.stderr: -47> 2024-09-14T11:13:47.245+0000 7fd48f321800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 to cache LRU end 2024-09-14T11:13:47.321 INFO:tasks.workunit.client.0.smithi050.stderr: -46> 2024-09-14T11:13:47.245+0000 7fd48f321800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:47.321 INFO:tasks.workunit.client.0.smithi050.stderr: -45> 2024-09-14T11:13:47.245+0000 7fd48f321800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40, ofs0, ns] 2024-09-14T11:13:47.321 INFO:tasks.workunit.client.0.smithi050.stderr: -44> 2024-09-14T11:13:47.245+0000 7fd36e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94217190136384 notifier 8067 bl.length()=1015 2024-09-14T11:13:47.322 INFO:tasks.workunit.client.0.smithi050.stderr: -43> 2024-09-14T11:13:47.245+0000 7fd36e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 info.flags=0x17 2024-09-14T11:13:47.322 INFO:tasks.workunit.client.0.smithi050.stderr: -42> 2024-09-14T11:13:47.245+0000 7fd36e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 to cache LRU end 2024-09-14T11:13:47.322 INFO:tasks.workunit.client.0.smithi050.stderr: -41> 2024-09-14T11:13:47.245+0000 7fd36e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:47.322 INFO:tasks.workunit.client.0.smithi050.stderr: -40> 2024-09-14T11:13:47.247+0000 7fd48f321800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40]): orig_sources= new_sources= 2024-09-14T11:13:47.322 INFO:tasks.workunit.client.0.smithi050.stderr: -39> 2024-09-14T11:13:47.247+0000 7fd48f321800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40]): potential sources added=[] removed=[] 2024-09-14T11:13:47.322 INFO:tasks.workunit.client.0.smithi050.stderr: -38> 2024-09-14T11:13:47.247+0000 7fd48f321800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40]): orig_dests= new_dests= 2024-09-14T11:13:47.322 INFO:tasks.workunit.client.0.smithi050.stderr: -37> 2024-09-14T11:13:47.247+0000 7fd48f321800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40]): potential dests added=[] removed=[] 2024-09-14T11:13:47.322 INFO:tasks.workunit.client.0.smithi050.stderr: -36> 2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.0 2024-09-14T11:13:47.322 INFO:tasks.workunit.client.0.smithi050.stderr: -35> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.0 2024-09-14T11:13:47.322 INFO:tasks.workunit.client.0.smithi050.stderr: -34> 2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.1 2024-09-14T11:13:47.322 INFO:tasks.workunit.client.0.smithi050.stderr: -33> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.1 2024-09-14T11:13:47.322 INFO:tasks.workunit.client.0.smithi050.stderr: -32> 2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.2 2024-09-14T11:13:47.322 INFO:tasks.workunit.client.0.smithi050.stderr: -31> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.2 2024-09-14T11:13:47.323 INFO:tasks.workunit.client.0.smithi050.stderr: -30> 2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.3 2024-09-14T11:13:47.323 INFO:tasks.workunit.client.0.smithi050.stderr: -29> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.3 2024-09-14T11:13:47.323 INFO:tasks.workunit.client.0.smithi050.stderr: -28> 2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.4 2024-09-14T11:13:47.323 INFO:tasks.workunit.client.0.smithi050.stderr: -27> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.4 2024-09-14T11:13:47.323 INFO:tasks.workunit.client.0.smithi050.stderr: -26> 2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.5 2024-09-14T11:13:47.323 INFO:tasks.workunit.client.0.smithi050.stderr: -25> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.5 2024-09-14T11:13:47.323 INFO:tasks.workunit.client.0.smithi050.stderr: -24> 2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.6 2024-09-14T11:13:47.323 INFO:tasks.workunit.client.0.smithi050.stderr: -23> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.6 2024-09-14T11:13:47.323 INFO:tasks.workunit.client.0.smithi050.stderr: -22> 2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.7 2024-09-14T11:13:47.323 INFO:tasks.workunit.client.0.smithi050.stderr: -21> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.7 2024-09-14T11:13:47.323 INFO:tasks.workunit.client.0.smithi050.stderr: -20> 2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.8 2024-09-14T11:13:47.323 INFO:tasks.workunit.client.0.smithi050.stderr: -19> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.8 2024-09-14T11:13:47.323 INFO:tasks.workunit.client.0.smithi050.stderr: -18> 2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.9 2024-09-14T11:13:47.324 INFO:tasks.workunit.client.0.smithi050.stderr: -17> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.9 2024-09-14T11:13:47.324 INFO:tasks.workunit.client.0.smithi050.stderr: -16> 2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.10 2024-09-14T11:13:47.324 INFO:tasks.workunit.client.0.smithi050.stderr: -15> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.10 2024-09-14T11:13:47.324 INFO:tasks.workunit.client.0.smithi050.stderr: -14> 2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.11 2024-09-14T11:13:47.324 INFO:tasks.workunit.client.0.smithi050.stderr: -13> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.11 2024-09-14T11:13:47.324 INFO:tasks.workunit.client.0.smithi050.stderr: -12> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.0 2024-09-14T11:13:47.324 INFO:tasks.workunit.client.0.smithi050.stderr: -11> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1 2024-09-14T11:13:47.324 INFO:tasks.workunit.client.0.smithi050.stderr: -10> 2024-09-14T11:13:47.252+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2 2024-09-14T11:13:47.324 INFO:tasks.workunit.client.0.smithi050.stderr: -9> 2024-09-14T11:13:47.252+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.3 2024-09-14T11:13:47.324 INFO:tasks.workunit.client.0.smithi050.stderr: -8> 2024-09-14T11:13:47.253+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.4 2024-09-14T11:13:47.324 INFO:tasks.workunit.client.0.smithi050.stderr: -7> 2024-09-14T11:13:47.253+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.5 2024-09-14T11:13:47.324 INFO:tasks.workunit.client.0.smithi050.stderr: -6> 2024-09-14T11:13:47.253+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.6 2024-09-14T11:13:47.324 INFO:tasks.workunit.client.0.smithi050.stderr: -5> 2024-09-14T11:13:47.254+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.7 2024-09-14T11:13:47.325 INFO:tasks.workunit.client.0.smithi050.stderr: -4> 2024-09-14T11:13:47.254+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.8 2024-09-14T11:13:47.325 INFO:tasks.workunit.client.0.smithi050.stderr: -3> 2024-09-14T11:13:47.255+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.9 2024-09-14T11:13:47.325 INFO:tasks.workunit.client.0.smithi050.stderr: -2> 2024-09-14T11:13:47.256+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.10 2024-09-14T11:13:47.325 INFO:tasks.workunit.client.0.smithi050.stderr: -1> 2024-09-14T11:13:47.260+0000 7fd48f321800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd48f321800 time 2024-09-14T11:13:47.260094+0000 2024-09-14T11:13:47.325 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:13:47.325 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.325 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:13:47.325 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd490b8c76a] 2024-09-14T11:13:47.325 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd490b8c928] 2024-09-14T11:13:47.325 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b0a537d0b1] 2024-09-14T11:13:47.325 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b0a538c124] 2024-09-14T11:13:47.325 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b0a538cfc4] 2024-09-14T11:13:47.325 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:13:47.325 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd48f829590] 2024-09-14T11:13:47.326 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:13:47.326 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:13:47.326 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.326 INFO:tasks.workunit.client.0.smithi050.stderr: 0> 2024-09-14T11:13:47.261+0000 7fd48f321800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:13:47.326 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7fd48f321800 thread_name:radosgw-admin 2024-09-14T11:13:47.326 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.326 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:13:47.326 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd48f83e6f0] 2024-09-14T11:13:47.326 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd48f88b99c] 2024-09-14T11:13:47.326 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:13:47.326 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:13:47.326 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd490b8c7c4] 2024-09-14T11:13:47.326 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd490b8c928] 2024-09-14T11:13:47.326 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b0a537d0b1] 2024-09-14T11:13:47.327 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b0a538c124] 2024-09-14T11:13:47.327 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b0a538cfc4] 2024-09-14T11:13:47.327 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:13:47.327 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd48f829590] 2024-09-14T11:13:47.327 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:13:47.327 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:13:47.327 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:13:47.327 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.327 INFO:tasks.workunit.client.0.smithi050.stderr:--- logging levels --- 2024-09-14T11:13:47.327 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 none 2024-09-14T11:13:47.327 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 lockdep 2024-09-14T11:13:47.327 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 context 2024-09-14T11:13:47.327 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 crush 2024-09-14T11:13:47.327 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds 2024-09-14T11:13:47.327 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_balancer 2024-09-14T11:13:47.328 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_locker 2024-09-14T11:13:47.328 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log 2024-09-14T11:13:47.328 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log_expire 2024-09-14T11:13:47.328 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_migrator 2024-09-14T11:13:47.328 INFO:tasks.workunit.client.0.smithi050.stderr: 3/ 5 mds_quiesce 2024-09-14T11:13:47.328 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 buffer 2024-09-14T11:13:47.328 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 timer 2024-09-14T11:13:47.328 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 filer 2024-09-14T11:13:47.328 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 striper 2024-09-14T11:13:47.328 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 objecter 2024-09-14T11:13:47.328 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rados 2024-09-14T11:13:47.328 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd 2024-09-14T11:13:47.328 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_mirror 2024-09-14T11:13:47.328 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_replay 2024-09-14T11:13:47.329 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_pwl 2024-09-14T11:13:47.329 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 journaler 2024-09-14T11:13:47.329 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objectcacher 2024-09-14T11:13:47.329 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:13:47.329 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 client 2024-09-14T11:13:47.329 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 osd 2024-09-14T11:13:47.329 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 optracker 2024-09-14T11:13:47.329 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objclass 2024-09-14T11:13:47.329 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 filestore 2024-09-14T11:13:47.329 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 journal 2024-09-14T11:13:47.329 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 ms 2024-09-14T11:13:47.329 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mon 2024-09-14T11:13:47.329 INFO:tasks.workunit.client.0.smithi050.stderr: 0/10 monc 2024-09-14T11:13:47.329 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 paxos 2024-09-14T11:13:47.330 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 tp 2024-09-14T11:13:47.330 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 auth 2024-09-14T11:13:47.330 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 crypto 2024-09-14T11:13:47.330 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 finisher 2024-09-14T11:13:47.330 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 reserver 2024-09-14T11:13:47.330 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 heartbeatmap 2024-09-14T11:13:47.330 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 perfcounter 2024-09-14T11:13:47.330 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw 2024-09-14T11:13:47.330 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_sync 2024-09-14T11:13:47.330 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_datacache 2024-09-14T11:13:47.330 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_access 2024-09-14T11:13:47.330 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:13:47.330 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_flight 2024-09-14T11:13:47.330 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:13:47.330 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw_notification 2024-09-14T11:13:47.331 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 javaclient 2024-09-14T11:13:47.331 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 asok 2024-09-14T11:13:47.331 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 throttle 2024-09-14T11:13:47.331 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 refs 2024-09-14T11:13:47.331 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 compressor 2024-09-14T11:13:47.331 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluestore 2024-09-14T11:13:47.331 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluefs 2024-09-14T11:13:47.331 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 bdev 2024-09-14T11:13:47.331 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 kstore 2024-09-14T11:13:47.331 INFO:tasks.workunit.client.0.smithi050.stderr: 4/ 5 rocksdb 2024-09-14T11:13:47.331 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 fuse 2024-09-14T11:13:47.331 INFO:tasks.workunit.client.0.smithi050.stderr: 2/ 5 mgr 2024-09-14T11:13:47.331 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mgrc 2024-09-14T11:13:47.331 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 dpdk 2024-09-14T11:13:47.332 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 eventtrace 2024-09-14T11:13:47.332 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 prioritycache 2024-09-14T11:13:47.332 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 test 2024-09-14T11:13:47.332 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:13:47.332 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephsqlite 2024-09-14T11:13:47.332 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:13:47.332 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore 2024-09-14T11:13:47.332 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_onode 2024-09-14T11:13:47.332 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_odata 2024-09-14T11:13:47.332 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_omap 2024-09-14T11:13:47.332 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_tm 2024-09-14T11:13:47.332 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_t 2024-09-14T11:13:47.332 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:13:47.333 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_epm 2024-09-14T11:13:47.333 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_lba 2024-09-14T11:13:47.333 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:13:47.333 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cache 2024-09-14T11:13:47.333 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_journal 2024-09-14T11:13:47.333 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_device 2024-09-14T11:13:47.333 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_backref 2024-09-14T11:13:47.333 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 alienstore 2024-09-14T11:13:47.333 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mclock 2024-09-14T11:13:47.333 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cyanstore 2024-09-14T11:13:47.333 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 ceph_exporter 2024-09-14T11:13:47.333 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 memstore 2024-09-14T11:13:47.333 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 trace 2024-09-14T11:13:47.333 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 ceph_dedup 2024-09-14T11:13:47.334 INFO:tasks.workunit.client.0.smithi050.stderr: -2/-2 (syslog threshold) 2024-09-14T11:13:47.334 INFO:tasks.workunit.client.0.smithi050.stderr: 99/99 (stderr threshold) 2024-09-14T11:13:47.334 INFO:tasks.workunit.client.0.smithi050.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:13:47.334 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd2ba7fc640 / http_manager 2024-09-14T11:13:47.334 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd340fe1640 / http_manager 2024-09-14T11:13:47.334 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd341fe3640 / rgw_dt_lg_renew 2024-09-14T11:13:47.334 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd36d7fa640 / ms_dispatch 2024-09-14T11:13:47.334 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd36e7fc640 / io_context_pool 2024-09-14T11:13:47.334 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd36effd640 / io_context_pool 2024-09-14T11:13:47.334 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd375602640 / ms_dispatch 2024-09-14T11:13:47.334 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd377e07640 / ms_dispatch 2024-09-14T11:13:47.334 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd37960a640 / io_context_pool 2024-09-14T11:13:47.334 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd483fff640 / msgr-worker-2 2024-09-14T11:13:47.334 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd48b044640 / msgr-worker-1 2024-09-14T11:13:47.335 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd48b845640 / msgr-worker-0 2024-09-14T11:13:47.335 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd48c046640 / io_context_pool 2024-09-14T11:13:47.335 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd48f321800 / radosgw-admin 2024-09-14T11:13:47.335 INFO:tasks.workunit.client.0.smithi050.stderr: max_recent 500 2024-09-14T11:13:47.335 INFO:tasks.workunit.client.0.smithi050.stderr: max_new 1000 2024-09-14T11:13:47.335 INFO:tasks.workunit.client.0.smithi050.stderr: log_file /var/log/ceph/ceph-client.admin.143207.log 2024-09-14T11:13:47.335 INFO:tasks.workunit.client.0.smithi050.stderr:--- end dump of recent events --- 2024-09-14T11:13:47.335 INFO:tasks.workunit.client.0.smithi050.stderr:--- begin dump of recent events --- 2024-09-14T11:13:47.335 INFO:tasks.workunit.client.0.smithi050.stderr: -499> 2024-09-14T11:13:46.991+0000 7fd48f321800 5 AuthRegistry(0x55b0a61698a0) adding con mode: crc 2024-09-14T11:13:47.335 INFO:tasks.workunit.client.0.smithi050.stderr: -498> 2024-09-14T11:13:46.991+0000 7fd48f321800 5 AuthRegistry(0x55b0a61698a0) adding con mode: secure 2024-09-14T11:13:47.335 INFO:tasks.workunit.client.0.smithi050.stderr: -497> 2024-09-14T11:13:46.991+0000 7fd48f321800 5 AuthRegistry(0x55b0a61698a0) adding con mode: crc 2024-09-14T11:13:47.335 INFO:tasks.workunit.client.0.smithi050.stderr: -496> 2024-09-14T11:13:46.991+0000 7fd48f321800 5 AuthRegistry(0x55b0a61698a0) adding con mode: secure 2024-09-14T11:13:47.335 INFO:tasks.workunit.client.0.smithi050.stderr: -495> 2024-09-14T11:13:46.991+0000 7fd48f321800 5 AuthRegistry(0x55b0a61698a0) adding con mode: crc 2024-09-14T11:13:47.335 INFO:tasks.workunit.client.0.smithi050.stderr: -494> 2024-09-14T11:13:46.991+0000 7fd48f321800 5 AuthRegistry(0x55b0a61698a0) adding con mode: secure 2024-09-14T11:13:47.336 INFO:tasks.workunit.client.0.smithi050.stderr: -493> 2024-09-14T11:13:46.992+0000 7fd48f321800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:47.336 INFO:tasks.workunit.client.0.smithi050.stderr: -492> 2024-09-14T11:13:46.992+0000 7fd48f321800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:47.336 INFO:tasks.workunit.client.0.smithi050.stderr: -491> 2024-09-14T11:13:46.992+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command rotate-key hook 0x55b0a61699e8 2024-09-14T11:13:47.336 INFO:tasks.workunit.client.0.smithi050.stderr: -490> 2024-09-14T11:13:46.992+0000 7fd48f321800 10 monclient: _reopen_session rank -1 2024-09-14T11:13:47.336 INFO:tasks.workunit.client.0.smithi050.stderr: -489> 2024-09-14T11:13:46.992+0000 7fd48f321800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:13:47.336 INFO:tasks.workunit.client.0.smithi050.stderr: -488> 2024-09-14T11:13:46.992+0000 7fd48f321800 10 monclient(hunting): picked mon.noname-a con 0x55b0a6016d00 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:13:47.336 INFO:tasks.workunit.client.0.smithi050.stderr: -487> 2024-09-14T11:13:46.992+0000 7fd48f321800 10 monclient(hunting): picked mon.noname-c con 0x55b0a6022c90 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:13:47.336 INFO:tasks.workunit.client.0.smithi050.stderr: -486> 2024-09-14T11:13:46.992+0000 7fd48f321800 10 monclient(hunting): picked mon.noname-b con 0x55b0a6194010 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:13:47.336 INFO:tasks.workunit.client.0.smithi050.stderr: -485> 2024-09-14T11:13:46.992+0000 7fd48f321800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:47.336 INFO:tasks.workunit.client.0.smithi050.stderr: -484> 2024-09-14T11:13:46.992+0000 7fd48f321800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:47.336 INFO:tasks.workunit.client.0.smithi050.stderr: -483> 2024-09-14T11:13:46.992+0000 7fd48f321800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:47.336 INFO:tasks.workunit.client.0.smithi050.stderr: -482> 2024-09-14T11:13:46.992+0000 7fd48f321800 10 monclient(hunting): _renew_subs 2024-09-14T11:13:47.336 INFO:tasks.workunit.client.0.smithi050.stderr: -481> 2024-09-14T11:13:46.992+0000 7fd48f321800 10 monclient(hunting): authenticate will time out at 2479.629502s 2024-09-14T11:13:47.337 INFO:tasks.workunit.client.0.smithi050.stderr: -480> 2024-09-14T11:13:46.992+0000 7fd48b044640 10 monclient(hunting): get_auth_request con 0x55b0a6016d00 auth_method 0 2024-09-14T11:13:47.337 INFO:tasks.workunit.client.0.smithi050.stderr: -479> 2024-09-14T11:13:46.992+0000 7fd48b044640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:47.337 INFO:tasks.workunit.client.0.smithi050.stderr: -478> 2024-09-14T11:13:46.992+0000 7fd48b044640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:47.337 INFO:tasks.workunit.client.0.smithi050.stderr: -477> 2024-09-14T11:13:46.992+0000 7fd48b044640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:47.337 INFO:tasks.workunit.client.0.smithi050.stderr: -476> 2024-09-14T11:13:46.992+0000 7fd483fff640 10 monclient(hunting): get_auth_request con 0x55b0a6022c90 auth_method 0 2024-09-14T11:13:47.337 INFO:tasks.workunit.client.0.smithi050.stderr: -475> 2024-09-14T11:13:46.992+0000 7fd483fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:47.337 INFO:tasks.workunit.client.0.smithi050.stderr: -474> 2024-09-14T11:13:46.992+0000 7fd483fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:47.337 INFO:tasks.workunit.client.0.smithi050.stderr: -473> 2024-09-14T11:13:46.992+0000 7fd483fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:47.337 INFO:tasks.workunit.client.0.smithi050.stderr: -472> 2024-09-14T11:13:46.992+0000 7fd48b044640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:47.337 INFO:tasks.workunit.client.0.smithi050.stderr: -471> 2024-09-14T11:13:46.992+0000 7fd48b044640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:47.337 INFO:tasks.workunit.client.0.smithi050.stderr: -470> 2024-09-14T11:13:46.992+0000 7fd48b044640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:47.337 INFO:tasks.workunit.client.0.smithi050.stderr: -469> 2024-09-14T11:13:46.992+0000 7fd483fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:47.337 INFO:tasks.workunit.client.0.smithi050.stderr: -468> 2024-09-14T11:13:46.992+0000 7fd483fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:47.337 INFO:tasks.workunit.client.0.smithi050.stderr: -467> 2024-09-14T11:13:46.992+0000 7fd483fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:47.338 INFO:tasks.workunit.client.0.smithi050.stderr: -466> 2024-09-14T11:13:46.992+0000 7fd48b845640 10 monclient(hunting): get_auth_request con 0x55b0a6194010 auth_method 0 2024-09-14T11:13:47.338 INFO:tasks.workunit.client.0.smithi050.stderr: -465> 2024-09-14T11:13:46.992+0000 7fd48b845640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:47.338 INFO:tasks.workunit.client.0.smithi050.stderr: -464> 2024-09-14T11:13:46.992+0000 7fd48b845640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:47.338 INFO:tasks.workunit.client.0.smithi050.stderr: -463> 2024-09-14T11:13:46.992+0000 7fd48b845640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:47.338 INFO:tasks.workunit.client.0.smithi050.stderr: -462> 2024-09-14T11:13:46.992+0000 7fd48b845640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:47.338 INFO:tasks.workunit.client.0.smithi050.stderr: -461> 2024-09-14T11:13:46.992+0000 7fd48b845640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:47.338 INFO:tasks.workunit.client.0.smithi050.stderr: -460> 2024-09-14T11:13:46.992+0000 7fd48b845640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:47.338 INFO:tasks.workunit.client.0.smithi050.stderr: -459> 2024-09-14T11:13:46.992+0000 7fd48b044640 10 monclient(hunting): handle_auth_done global_id 8058 payload 824 2024-09-14T11:13:47.338 INFO:tasks.workunit.client.0.smithi050.stderr: -458> 2024-09-14T11:13:46.992+0000 7fd48b044640 10 monclient: _finish_hunting 0 2024-09-14T11:13:47.338 INFO:tasks.workunit.client.0.smithi050.stderr: -457> 2024-09-14T11:13:46.992+0000 7fd48b044640 1 monclient: found mon.noname-a 2024-09-14T11:13:47.338 INFO:tasks.workunit.client.0.smithi050.stderr: -456> 2024-09-14T11:13:46.992+0000 7fd48b044640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:13:47.338 INFO:tasks.workunit.client.0.smithi050.stderr: -455> 2024-09-14T11:13:46.993+0000 7fd377e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:47.339 INFO:tasks.workunit.client.0.smithi050.stderr: -454> 2024-09-14T11:13:46.993+0000 7fd377e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:13:47.339 INFO:tasks.workunit.client.0.smithi050.stderr: -453> 2024-09-14T11:13:46.993+0000 7fd377e07640 10 monclient: dump: 2024-09-14T11:13:47.339 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:47.339 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:47.339 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.339 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.339 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:47.339 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:47.339 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:47.339 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:47.339 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:47.339 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.340 INFO:tasks.workunit.client.0.smithi050.stderr: -452> 2024-09-14T11:13:46.993+0000 7fd377e07640 10 monclient: _finish_auth 0 2024-09-14T11:13:47.340 INFO:tasks.workunit.client.0.smithi050.stderr: -451> 2024-09-14T11:13:46.993+0000 7fd377e07640 10 monclient: _check_auth_tickets 2024-09-14T11:13:47.340 INFO:tasks.workunit.client.0.smithi050.stderr: -450> 2024-09-14T11:13:46.993+0000 7fd377e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:47.340 INFO:tasks.workunit.client.0.smithi050.stderr: -449> 2024-09-14T11:13:46.993+0000 7fd377e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:47.340 INFO:tasks.workunit.client.0.smithi050.stderr: -448> 2024-09-14T11:13:46.993+0000 7fd377e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:13:47.340 INFO:tasks.workunit.client.0.smithi050.stderr: -447> 2024-09-14T11:13:46.993+0000 7fd377e07640 10 monclient: dump: 2024-09-14T11:13:47.340 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:47.340 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:47.340 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.340 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.340 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:47.340 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:47.341 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:47.341 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:47.341 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:47.341 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.341 INFO:tasks.workunit.client.0.smithi050.stderr: -446> 2024-09-14T11:13:46.993+0000 7fd48f321800 5 monclient: authenticate success, global_id 8058 2024-09-14T11:13:47.341 INFO:tasks.workunit.client.0.smithi050.stderr: -445> 2024-09-14T11:13:46.993+0000 7fd48f321800 10 monclient: _renew_subs 2024-09-14T11:13:47.341 INFO:tasks.workunit.client.0.smithi050.stderr: -444> 2024-09-14T11:13:46.993+0000 7fd48f321800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:13:47.341 INFO:tasks.workunit.client.0.smithi050.stderr: -443> 2024-09-14T11:13:46.993+0000 7fd37960a640 4 set_mon_vals no callback set 2024-09-14T11:13:47.341 INFO:tasks.workunit.client.0.smithi050.stderr: -442> 2024-09-14T11:13:46.993+0000 7fd48f321800 10 monclient: _renew_subs 2024-09-14T11:13:47.341 INFO:tasks.workunit.client.0.smithi050.stderr: -441> 2024-09-14T11:13:46.993+0000 7fd48f321800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:13:47.341 INFO:tasks.workunit.client.0.smithi050.stderr: -440> 2024-09-14T11:13:46.993+0000 7fd48f321800 1 librados: init done 2024-09-14T11:13:47.341 INFO:tasks.workunit.client.0.smithi050.stderr: -439> 2024-09-14T11:13:46.995+0000 7fd377e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:13:47.341 INFO:tasks.workunit.client.0.smithi050.stderr: -438> 2024-09-14T11:13:46.995+0000 7fd377e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:13:47.342 INFO:tasks.workunit.client.0.smithi050.stderr: -437> 2024-09-14T11:13:46.995+0000 7fd377e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:13:47.342 INFO:tasks.workunit.client.0.smithi050.stderr: -436> 2024-09-14T11:13:46.995+0000 7fd483fff640 10 monclient: get_auth_request con 0x7fd370077230 auth_method 0 2024-09-14T11:13:47.342 INFO:tasks.workunit.client.0.smithi050.stderr: -435> 2024-09-14T11:13:46.995+0000 7fd48b845640 10 monclient: get_auth_request con 0x55b0a61aae00 auth_method 0 2024-09-14T11:13:47.342 INFO:tasks.workunit.client.0.smithi050.stderr: -434> 2024-09-14T11:13:46.996+0000 7fd48b044640 10 monclient: get_auth_request con 0x55b0a61b5640 auth_method 0 2024-09-14T11:13:47.342 INFO:tasks.workunit.client.0.smithi050.stderr: -433> 2024-09-14T11:13:46.997+0000 7fd483fff640 10 monclient: get_auth_request con 0x55b0a61b9ce0 auth_method 0 2024-09-14T11:13:47.342 INFO:tasks.workunit.client.0.smithi050.stderr: -432> 2024-09-14T11:13:46.998+0000 7fd48f321800 10 monclient: build_initial_monmap 2024-09-14T11:13:47.342 INFO:tasks.workunit.client.0.smithi050.stderr: -431> 2024-09-14T11:13:46.998+0000 7fd48f321800 1 build_initial for_mkfs: 0 2024-09-14T11:13:47.342 INFO:tasks.workunit.client.0.smithi050.stderr: -430> 2024-09-14T11:13:46.998+0000 7fd48f321800 10 monclient: monmap: 2024-09-14T11:13:47.342 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:13:47.342 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:13:47.342 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:13:47.342 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:13:47.342 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:13:47.343 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:47.343 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:13:47.343 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:13:47.343 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:13:47.343 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.343 INFO:tasks.workunit.client.0.smithi050.stderr: -429> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding auth protocol: cephx 2024-09-14T11:13:47.343 INFO:tasks.workunit.client.0.smithi050.stderr: -428> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding auth protocol: cephx 2024-09-14T11:13:47.343 INFO:tasks.workunit.client.0.smithi050.stderr: -427> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding auth protocol: cephx 2024-09-14T11:13:47.343 INFO:tasks.workunit.client.0.smithi050.stderr: -426> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding con mode: secure 2024-09-14T11:13:47.343 INFO:tasks.workunit.client.0.smithi050.stderr: -425> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding con mode: crc 2024-09-14T11:13:47.343 INFO:tasks.workunit.client.0.smithi050.stderr: -424> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding con mode: secure 2024-09-14T11:13:47.343 INFO:tasks.workunit.client.0.smithi050.stderr: -423> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding con mode: crc 2024-09-14T11:13:47.343 INFO:tasks.workunit.client.0.smithi050.stderr: -422> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding con mode: secure 2024-09-14T11:13:47.343 INFO:tasks.workunit.client.0.smithi050.stderr: -421> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding con mode: crc 2024-09-14T11:13:47.344 INFO:tasks.workunit.client.0.smithi050.stderr: -420> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding con mode: crc 2024-09-14T11:13:47.344 INFO:tasks.workunit.client.0.smithi050.stderr: -419> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding con mode: secure 2024-09-14T11:13:47.344 INFO:tasks.workunit.client.0.smithi050.stderr: -418> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding con mode: crc 2024-09-14T11:13:47.344 INFO:tasks.workunit.client.0.smithi050.stderr: -417> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding con mode: secure 2024-09-14T11:13:47.344 INFO:tasks.workunit.client.0.smithi050.stderr: -416> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding con mode: crc 2024-09-14T11:13:47.344 INFO:tasks.workunit.client.0.smithi050.stderr: -415> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 AuthRegistry(0x55b0a61be960) adding con mode: secure 2024-09-14T11:13:47.344 INFO:tasks.workunit.client.0.smithi050.stderr: -414> 2024-09-14T11:13:46.998+0000 7fd48f321800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:47.344 INFO:tasks.workunit.client.0.smithi050.stderr: -413> 2024-09-14T11:13:46.998+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command objecter_requests cmddesc objecter_requests hook 0x55b0a61c1e70 EEXIST 2024-09-14T11:13:47.344 INFO:tasks.workunit.client.0.smithi050.stderr: -412> 2024-09-14T11:13:46.999+0000 7fd48f321800 10 monclient: init 2024-09-14T11:13:47.344 INFO:tasks.workunit.client.0.smithi050.stderr: -411> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding auth protocol: cephx 2024-09-14T11:13:47.344 INFO:tasks.workunit.client.0.smithi050.stderr: -410> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding auth protocol: cephx 2024-09-14T11:13:47.344 INFO:tasks.workunit.client.0.smithi050.stderr: -409> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding auth protocol: cephx 2024-09-14T11:13:47.344 INFO:tasks.workunit.client.0.smithi050.stderr: -408> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding con mode: secure 2024-09-14T11:13:47.344 INFO:tasks.workunit.client.0.smithi050.stderr: -407> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding con mode: crc 2024-09-14T11:13:47.345 INFO:tasks.workunit.client.0.smithi050.stderr: -406> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding con mode: secure 2024-09-14T11:13:47.345 INFO:tasks.workunit.client.0.smithi050.stderr: -405> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding con mode: crc 2024-09-14T11:13:47.345 INFO:tasks.workunit.client.0.smithi050.stderr: -404> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding con mode: secure 2024-09-14T11:13:47.345 INFO:tasks.workunit.client.0.smithi050.stderr: -403> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding con mode: crc 2024-09-14T11:13:47.345 INFO:tasks.workunit.client.0.smithi050.stderr: -402> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding con mode: crc 2024-09-14T11:13:47.345 INFO:tasks.workunit.client.0.smithi050.stderr: -401> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding con mode: secure 2024-09-14T11:13:47.345 INFO:tasks.workunit.client.0.smithi050.stderr: -400> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding con mode: crc 2024-09-14T11:13:47.345 INFO:tasks.workunit.client.0.smithi050.stderr: -399> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding con mode: secure 2024-09-14T11:13:47.345 INFO:tasks.workunit.client.0.smithi050.stderr: -398> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding con mode: crc 2024-09-14T11:13:47.345 INFO:tasks.workunit.client.0.smithi050.stderr: -397> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 AuthRegistry(0x55b0a61bd088) adding con mode: secure 2024-09-14T11:13:47.345 INFO:tasks.workunit.client.0.smithi050.stderr: -396> 2024-09-14T11:13:46.999+0000 7fd48f321800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:47.345 INFO:tasks.workunit.client.0.smithi050.stderr: -395> 2024-09-14T11:13:46.999+0000 7fd48f321800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:47.346 INFO:tasks.workunit.client.0.smithi050.stderr: -394> 2024-09-14T11:13:46.999+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command rotate-key cmddesc rotate-key hook 0x55b0a61bd1d0 EEXIST 2024-09-14T11:13:47.346 INFO:tasks.workunit.client.0.smithi050.stderr: -393> 2024-09-14T11:13:46.999+0000 7fd48f321800 10 monclient: _reopen_session rank -1 2024-09-14T11:13:47.346 INFO:tasks.workunit.client.0.smithi050.stderr: -392> 2024-09-14T11:13:46.999+0000 7fd48f321800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:13:47.346 INFO:tasks.workunit.client.0.smithi050.stderr: -391> 2024-09-14T11:13:46.999+0000 7fd48f321800 10 monclient(hunting): picked mon.noname-c con 0x55b0a61e6190 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:13:47.346 INFO:tasks.workunit.client.0.smithi050.stderr: -390> 2024-09-14T11:13:46.999+0000 7fd48f321800 10 monclient(hunting): picked mon.noname-b con 0x55b0a61e6570 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:13:47.346 INFO:tasks.workunit.client.0.smithi050.stderr: -389> 2024-09-14T11:13:46.999+0000 7fd48f321800 10 monclient(hunting): picked mon.noname-a con 0x55b0a61e4ea0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:13:47.346 INFO:tasks.workunit.client.0.smithi050.stderr: -388> 2024-09-14T11:13:46.999+0000 7fd48f321800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:47.346 INFO:tasks.workunit.client.0.smithi050.stderr: -387> 2024-09-14T11:13:46.999+0000 7fd48f321800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:47.346 INFO:tasks.workunit.client.0.smithi050.stderr: -386> 2024-09-14T11:13:46.999+0000 7fd48f321800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:47.346 INFO:tasks.workunit.client.0.smithi050.stderr: -385> 2024-09-14T11:13:46.999+0000 7fd48f321800 10 monclient(hunting): _renew_subs 2024-09-14T11:13:47.346 INFO:tasks.workunit.client.0.smithi050.stderr: -384> 2024-09-14T11:13:46.999+0000 7fd48f321800 10 monclient(hunting): authenticate will time out at 2479.636587s 2024-09-14T11:13:47.346 INFO:tasks.workunit.client.0.smithi050.stderr: -383> 2024-09-14T11:13:46.999+0000 7fd48b044640 10 monclient(hunting): get_auth_request con 0x55b0a61e6190 auth_method 0 2024-09-14T11:13:47.346 INFO:tasks.workunit.client.0.smithi050.stderr: -382> 2024-09-14T11:13:46.999+0000 7fd48b044640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:47.346 INFO:tasks.workunit.client.0.smithi050.stderr: -381> 2024-09-14T11:13:46.999+0000 7fd48b044640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:47.347 INFO:tasks.workunit.client.0.smithi050.stderr: -380> 2024-09-14T11:13:46.999+0000 7fd48b044640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:47.347 INFO:tasks.workunit.client.0.smithi050.stderr: -379> 2024-09-14T11:13:46.999+0000 7fd48b845640 10 monclient(hunting): get_auth_request con 0x55b0a61e4ea0 auth_method 0 2024-09-14T11:13:47.347 INFO:tasks.workunit.client.0.smithi050.stderr: -378> 2024-09-14T11:13:46.999+0000 7fd48b845640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:47.347 INFO:tasks.workunit.client.0.smithi050.stderr: -377> 2024-09-14T11:13:46.999+0000 7fd48b845640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:47.347 INFO:tasks.workunit.client.0.smithi050.stderr: -376> 2024-09-14T11:13:46.999+0000 7fd48b845640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:47.347 INFO:tasks.workunit.client.0.smithi050.stderr: -375> 2024-09-14T11:13:46.999+0000 7fd48b044640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:47.347 INFO:tasks.workunit.client.0.smithi050.stderr: -374> 2024-09-14T11:13:46.999+0000 7fd48b044640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:47.347 INFO:tasks.workunit.client.0.smithi050.stderr: -373> 2024-09-14T11:13:46.999+0000 7fd48b044640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:47.347 INFO:tasks.workunit.client.0.smithi050.stderr: -372> 2024-09-14T11:13:46.999+0000 7fd48b845640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:47.347 INFO:tasks.workunit.client.0.smithi050.stderr: -371> 2024-09-14T11:13:46.999+0000 7fd48b845640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:47.347 INFO:tasks.workunit.client.0.smithi050.stderr: -370> 2024-09-14T11:13:46.999+0000 7fd48b845640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:47.347 INFO:tasks.workunit.client.0.smithi050.stderr: -369> 2024-09-14T11:13:46.999+0000 7fd483fff640 10 monclient(hunting): get_auth_request con 0x55b0a61e6570 auth_method 0 2024-09-14T11:13:47.347 INFO:tasks.workunit.client.0.smithi050.stderr: -368> 2024-09-14T11:13:46.999+0000 7fd483fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:47.347 INFO:tasks.workunit.client.0.smithi050.stderr: -367> 2024-09-14T11:13:46.999+0000 7fd483fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:47.347 INFO:tasks.workunit.client.0.smithi050.stderr: -366> 2024-09-14T11:13:46.999+0000 7fd483fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:47.348 INFO:tasks.workunit.client.0.smithi050.stderr: -365> 2024-09-14T11:13:46.999+0000 7fd48b044640 10 monclient(hunting): handle_auth_done global_id 7529 payload 824 2024-09-14T11:13:47.348 INFO:tasks.workunit.client.0.smithi050.stderr: -364> 2024-09-14T11:13:46.999+0000 7fd48b044640 10 monclient: _finish_hunting 0 2024-09-14T11:13:47.348 INFO:tasks.workunit.client.0.smithi050.stderr: -363> 2024-09-14T11:13:46.999+0000 7fd48b044640 1 monclient: found mon.noname-c 2024-09-14T11:13:47.348 INFO:tasks.workunit.client.0.smithi050.stderr: -362> 2024-09-14T11:13:46.999+0000 7fd48b044640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:13:47.348 INFO:tasks.workunit.client.0.smithi050.stderr: -361> 2024-09-14T11:13:47.000+0000 7fd375602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:47.348 INFO:tasks.workunit.client.0.smithi050.stderr: -360> 2024-09-14T11:13:47.000+0000 7fd375602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:13:47.348 INFO:tasks.workunit.client.0.smithi050.stderr: -359> 2024-09-14T11:13:47.000+0000 7fd375602640 10 monclient: dump: 2024-09-14T11:13:47.348 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:47.348 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:47.348 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.348 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.348 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:47.348 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:47.349 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:47.349 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:47.349 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:47.349 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.349 INFO:tasks.workunit.client.0.smithi050.stderr: -358> 2024-09-14T11:13:47.000+0000 7fd375602640 10 monclient: _finish_auth 0 2024-09-14T11:13:47.349 INFO:tasks.workunit.client.0.smithi050.stderr: -357> 2024-09-14T11:13:47.000+0000 7fd375602640 10 monclient: _check_auth_tickets 2024-09-14T11:13:47.349 INFO:tasks.workunit.client.0.smithi050.stderr: -356> 2024-09-14T11:13:47.000+0000 7fd375602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:47.349 INFO:tasks.workunit.client.0.smithi050.stderr: -355> 2024-09-14T11:13:47.000+0000 7fd375602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:47.349 INFO:tasks.workunit.client.0.smithi050.stderr: -354> 2024-09-14T11:13:47.000+0000 7fd375602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:13:47.349 INFO:tasks.workunit.client.0.smithi050.stderr: -353> 2024-09-14T11:13:47.000+0000 7fd375602640 10 monclient: dump: 2024-09-14T11:13:47.349 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:47.349 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:47.349 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.349 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.350 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:47.350 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:47.350 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:47.350 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:47.350 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:47.350 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.350 INFO:tasks.workunit.client.0.smithi050.stderr: -352> 2024-09-14T11:13:47.000+0000 7fd48f321800 5 monclient: authenticate success, global_id 7529 2024-09-14T11:13:47.350 INFO:tasks.workunit.client.0.smithi050.stderr: -351> 2024-09-14T11:13:47.000+0000 7fd48f321800 10 monclient: _renew_subs 2024-09-14T11:13:47.350 INFO:tasks.workunit.client.0.smithi050.stderr: -350> 2024-09-14T11:13:47.000+0000 7fd48f321800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:13:47.350 INFO:tasks.workunit.client.0.smithi050.stderr: -349> 2024-09-14T11:13:47.000+0000 7fd48c046640 4 set_mon_vals no callback set 2024-09-14T11:13:47.350 INFO:tasks.workunit.client.0.smithi050.stderr: -348> 2024-09-14T11:13:47.000+0000 7fd48f321800 10 monclient: _renew_subs 2024-09-14T11:13:47.350 INFO:tasks.workunit.client.0.smithi050.stderr: -347> 2024-09-14T11:13:47.000+0000 7fd48f321800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:13:47.350 INFO:tasks.workunit.client.0.smithi050.stderr: -346> 2024-09-14T11:13:47.002+0000 7fd375602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:13:47.350 INFO:tasks.workunit.client.0.smithi050.stderr: -345> 2024-09-14T11:13:47.002+0000 7fd375602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:13:47.350 INFO:tasks.workunit.client.0.smithi050.stderr: -344> 2024-09-14T11:13:47.002+0000 7fd375602640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:13:47.351 INFO:tasks.workunit.client.0.smithi050.stderr: -343> 2024-09-14T11:13:47.002+0000 7fd483fff640 10 monclient: get_auth_request con 0x7fd364077140 auth_method 0 2024-09-14T11:13:47.351 INFO:tasks.workunit.client.0.smithi050.stderr: -342> 2024-09-14T11:13:47.002+0000 7fd48f321800 10 monclient: get_monmap_and_config 2024-09-14T11:13:47.351 INFO:tasks.workunit.client.0.smithi050.stderr: -341> 2024-09-14T11:13:47.002+0000 7fd48f321800 10 monclient: build_initial_monmap 2024-09-14T11:13:47.351 INFO:tasks.workunit.client.0.smithi050.stderr: -340> 2024-09-14T11:13:47.002+0000 7fd48f321800 1 build_initial for_mkfs: 0 2024-09-14T11:13:47.351 INFO:tasks.workunit.client.0.smithi050.stderr: -339> 2024-09-14T11:13:47.002+0000 7fd48f321800 10 monclient: monmap: 2024-09-14T11:13:47.351 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:13:47.351 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:13:47.351 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:13:47.351 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:13:47.351 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:13:47.351 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:47.351 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:13:47.351 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:13:47.351 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:13:47.352 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.352 INFO:tasks.workunit.client.0.smithi050.stderr: -338> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding auth protocol: cephx 2024-09-14T11:13:47.352 INFO:tasks.workunit.client.0.smithi050.stderr: -337> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding auth protocol: cephx 2024-09-14T11:13:47.352 INFO:tasks.workunit.client.0.smithi050.stderr: -336> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding auth protocol: cephx 2024-09-14T11:13:47.352 INFO:tasks.workunit.client.0.smithi050.stderr: -335> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding con mode: secure 2024-09-14T11:13:47.352 INFO:tasks.workunit.client.0.smithi050.stderr: -334> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding con mode: crc 2024-09-14T11:13:47.352 INFO:tasks.workunit.client.0.smithi050.stderr: -333> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding con mode: secure 2024-09-14T11:13:47.352 INFO:tasks.workunit.client.0.smithi050.stderr: -332> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding con mode: crc 2024-09-14T11:13:47.352 INFO:tasks.workunit.client.0.smithi050.stderr: -331> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding con mode: secure 2024-09-14T11:13:47.352 INFO:tasks.workunit.client.0.smithi050.stderr: -330> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding con mode: crc 2024-09-14T11:13:47.352 INFO:tasks.workunit.client.0.smithi050.stderr: -329> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding con mode: crc 2024-09-14T11:13:47.352 INFO:tasks.workunit.client.0.smithi050.stderr: -328> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding con mode: secure 2024-09-14T11:13:47.352 INFO:tasks.workunit.client.0.smithi050.stderr: -327> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding con mode: crc 2024-09-14T11:13:47.352 INFO:tasks.workunit.client.0.smithi050.stderr: -326> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding con mode: secure 2024-09-14T11:13:47.353 INFO:tasks.workunit.client.0.smithi050.stderr: -325> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding con mode: crc 2024-09-14T11:13:47.353 INFO:tasks.workunit.client.0.smithi050.stderr: -324> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x55b0a6205fe0) adding con mode: secure 2024-09-14T11:13:47.353 INFO:tasks.workunit.client.0.smithi050.stderr: -323> 2024-09-14T11:13:47.002+0000 7fd48f321800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:47.353 INFO:tasks.workunit.client.0.smithi050.stderr: -322> 2024-09-14T11:13:47.002+0000 7fd48f321800 10 monclient: init 2024-09-14T11:13:47.353 INFO:tasks.workunit.client.0.smithi050.stderr: -321> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding auth protocol: cephx 2024-09-14T11:13:47.353 INFO:tasks.workunit.client.0.smithi050.stderr: -320> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding auth protocol: cephx 2024-09-14T11:13:47.353 INFO:tasks.workunit.client.0.smithi050.stderr: -319> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding auth protocol: cephx 2024-09-14T11:13:47.353 INFO:tasks.workunit.client.0.smithi050.stderr: -318> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding con mode: secure 2024-09-14T11:13:47.353 INFO:tasks.workunit.client.0.smithi050.stderr: -317> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding con mode: crc 2024-09-14T11:13:47.353 INFO:tasks.workunit.client.0.smithi050.stderr: -316> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding con mode: secure 2024-09-14T11:13:47.353 INFO:tasks.workunit.client.0.smithi050.stderr: -315> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding con mode: crc 2024-09-14T11:13:47.353 INFO:tasks.workunit.client.0.smithi050.stderr: -314> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding con mode: secure 2024-09-14T11:13:47.353 INFO:tasks.workunit.client.0.smithi050.stderr: -313> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding con mode: crc 2024-09-14T11:13:47.354 INFO:tasks.workunit.client.0.smithi050.stderr: -312> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding con mode: crc 2024-09-14T11:13:47.354 INFO:tasks.workunit.client.0.smithi050.stderr: -311> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding con mode: secure 2024-09-14T11:13:47.354 INFO:tasks.workunit.client.0.smithi050.stderr: -310> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding con mode: crc 2024-09-14T11:13:47.354 INFO:tasks.workunit.client.0.smithi050.stderr: -309> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding con mode: secure 2024-09-14T11:13:47.354 INFO:tasks.workunit.client.0.smithi050.stderr: -308> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding con mode: crc 2024-09-14T11:13:47.354 INFO:tasks.workunit.client.0.smithi050.stderr: -307> 2024-09-14T11:13:47.002+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2720) adding con mode: secure 2024-09-14T11:13:47.354 INFO:tasks.workunit.client.0.smithi050.stderr: -306> 2024-09-14T11:13:47.003+0000 7fd48f321800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:47.354 INFO:tasks.workunit.client.0.smithi050.stderr: -305> 2024-09-14T11:13:47.003+0000 7fd48f321800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:47.354 INFO:tasks.workunit.client.0.smithi050.stderr: -304> 2024-09-14T11:13:47.003+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command rotate-key cmddesc rotate-key hook 0x7fff0e6b2868 EEXIST 2024-09-14T11:13:47.354 INFO:tasks.workunit.client.0.smithi050.stderr: -303> 2024-09-14T11:13:47.003+0000 7fd48f321800 10 monclient: _reopen_session rank -1 2024-09-14T11:13:47.354 INFO:tasks.workunit.client.0.smithi050.stderr: -302> 2024-09-14T11:13:47.003+0000 7fd48f321800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:13:47.354 INFO:tasks.workunit.client.0.smithi050.stderr: -301> 2024-09-14T11:13:47.003+0000 7fd48f321800 10 monclient(hunting): picked mon.noname-b con 0x55b0a623a680 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:13:47.354 INFO:tasks.workunit.client.0.smithi050.stderr: -300> 2024-09-14T11:13:47.003+0000 7fd48f321800 10 monclient(hunting): picked mon.noname-c con 0x55b0a620a490 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:13:47.354 INFO:tasks.workunit.client.0.smithi050.stderr: -299> 2024-09-14T11:13:47.003+0000 7fd48f321800 10 monclient(hunting): picked mon.noname-a con 0x55b0a6235a40 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:13:47.354 INFO:tasks.workunit.client.0.smithi050.stderr: -298> 2024-09-14T11:13:47.003+0000 7fd48f321800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:47.355 INFO:tasks.workunit.client.0.smithi050.stderr: -297> 2024-09-14T11:13:47.003+0000 7fd48f321800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:47.355 INFO:tasks.workunit.client.0.smithi050.stderr: -296> 2024-09-14T11:13:47.003+0000 7fd48f321800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:47.355 INFO:tasks.workunit.client.0.smithi050.stderr: -295> 2024-09-14T11:13:47.003+0000 7fd48f321800 10 monclient(hunting): _renew_subs 2024-09-14T11:13:47.355 INFO:tasks.workunit.client.0.smithi050.stderr: -294> 2024-09-14T11:13:47.003+0000 7fd48f321800 10 monclient(hunting): authenticate will time out at 2479.640406s 2024-09-14T11:13:47.355 INFO:tasks.workunit.client.0.smithi050.stderr: -293> 2024-09-14T11:13:47.003+0000 7fd483fff640 10 monclient(hunting): get_auth_request con 0x55b0a620a490 auth_method 0 2024-09-14T11:13:47.355 INFO:tasks.workunit.client.0.smithi050.stderr: -292> 2024-09-14T11:13:47.003+0000 7fd483fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:47.355 INFO:tasks.workunit.client.0.smithi050.stderr: -291> 2024-09-14T11:13:47.003+0000 7fd483fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:47.355 INFO:tasks.workunit.client.0.smithi050.stderr: -290> 2024-09-14T11:13:47.003+0000 7fd483fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:47.355 INFO:tasks.workunit.client.0.smithi050.stderr: -289> 2024-09-14T11:13:47.003+0000 7fd48b845640 10 monclient(hunting): get_auth_request con 0x55b0a6235a40 auth_method 0 2024-09-14T11:13:47.355 INFO:tasks.workunit.client.0.smithi050.stderr: -288> 2024-09-14T11:13:47.003+0000 7fd48b845640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:47.355 INFO:tasks.workunit.client.0.smithi050.stderr: -287> 2024-09-14T11:13:47.003+0000 7fd48b845640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:47.355 INFO:tasks.workunit.client.0.smithi050.stderr: -286> 2024-09-14T11:13:47.003+0000 7fd48b845640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:47.355 INFO:tasks.workunit.client.0.smithi050.stderr: -285> 2024-09-14T11:13:47.003+0000 7fd48b044640 10 monclient(hunting): get_auth_request con 0x55b0a623a680 auth_method 0 2024-09-14T11:13:47.355 INFO:tasks.workunit.client.0.smithi050.stderr: -284> 2024-09-14T11:13:47.003+0000 7fd48b044640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:47.355 INFO:tasks.workunit.client.0.smithi050.stderr: -283> 2024-09-14T11:13:47.003+0000 7fd48b044640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:47.356 INFO:tasks.workunit.client.0.smithi050.stderr: -282> 2024-09-14T11:13:47.003+0000 7fd48b044640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:47.356 INFO:tasks.workunit.client.0.smithi050.stderr: -281> 2024-09-14T11:13:47.003+0000 7fd483fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:47.356 INFO:tasks.workunit.client.0.smithi050.stderr: -280> 2024-09-14T11:13:47.003+0000 7fd483fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:47.356 INFO:tasks.workunit.client.0.smithi050.stderr: -279> 2024-09-14T11:13:47.003+0000 7fd483fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:47.356 INFO:tasks.workunit.client.0.smithi050.stderr: -278> 2024-09-14T11:13:47.003+0000 7fd48b845640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:47.356 INFO:tasks.workunit.client.0.smithi050.stderr: -277> 2024-09-14T11:13:47.003+0000 7fd48b845640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:47.356 INFO:tasks.workunit.client.0.smithi050.stderr: -276> 2024-09-14T11:13:47.003+0000 7fd48b845640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:47.356 INFO:tasks.workunit.client.0.smithi050.stderr: -275> 2024-09-14T11:13:47.003+0000 7fd48b044640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:47.356 INFO:tasks.workunit.client.0.smithi050.stderr: -274> 2024-09-14T11:13:47.003+0000 7fd48b044640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:47.356 INFO:tasks.workunit.client.0.smithi050.stderr: -273> 2024-09-14T11:13:47.003+0000 7fd48b044640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:47.356 INFO:tasks.workunit.client.0.smithi050.stderr: -272> 2024-09-14T11:13:47.003+0000 7fd483fff640 10 monclient(hunting): handle_auth_done global_id 7532 payload 274 2024-09-14T11:13:47.356 INFO:tasks.workunit.client.0.smithi050.stderr: -271> 2024-09-14T11:13:47.003+0000 7fd483fff640 10 monclient: _finish_hunting 0 2024-09-14T11:13:47.356 INFO:tasks.workunit.client.0.smithi050.stderr: -270> 2024-09-14T11:13:47.003+0000 7fd483fff640 1 monclient: found mon.noname-c 2024-09-14T11:13:47.356 INFO:tasks.workunit.client.0.smithi050.stderr: -269> 2024-09-14T11:13:47.003+0000 7fd483fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:13:47.357 INFO:tasks.workunit.client.0.smithi050.stderr: -268> 2024-09-14T11:13:47.004+0000 7fd36effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:47.357 INFO:tasks.workunit.client.0.smithi050.stderr: -267> 2024-09-14T11:13:47.004+0000 7fd36effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:13:47.357 INFO:tasks.workunit.client.0.smithi050.stderr: -266> 2024-09-14T11:13:47.004+0000 7fd36effd640 10 monclient: dump: 2024-09-14T11:13:47.357 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:47.357 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:47.357 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.357 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.357 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:47.357 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:47.357 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:47.357 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:47.357 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:47.357 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.357 INFO:tasks.workunit.client.0.smithi050.stderr: -265> 2024-09-14T11:13:47.004+0000 7fd36effd640 10 monclient: _finish_auth 0 2024-09-14T11:13:47.358 INFO:tasks.workunit.client.0.smithi050.stderr: -264> 2024-09-14T11:13:47.004+0000 7fd36effd640 10 monclient: _check_auth_tickets 2024-09-14T11:13:47.358 INFO:tasks.workunit.client.0.smithi050.stderr: -263> 2024-09-14T11:13:47.004+0000 7fd36effd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:47.358 INFO:tasks.workunit.client.0.smithi050.stderr: -262> 2024-09-14T11:13:47.004+0000 7fd36effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:47.358 INFO:tasks.workunit.client.0.smithi050.stderr: -261> 2024-09-14T11:13:47.004+0000 7fd36effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:13:47.358 INFO:tasks.workunit.client.0.smithi050.stderr: -260> 2024-09-14T11:13:47.004+0000 7fd36effd640 10 monclient: dump: 2024-09-14T11:13:47.358 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:47.358 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:47.358 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.358 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.358 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:47.358 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:47.358 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:47.358 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:47.358 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:47.358 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.359 INFO:tasks.workunit.client.0.smithi050.stderr: -259> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 monclient: authenticate success, global_id 7532 2024-09-14T11:13:47.359 INFO:tasks.workunit.client.0.smithi050.stderr: -258> 2024-09-14T11:13:47.004+0000 7fd48f321800 10 monclient: get_monmap_and_config success 2024-09-14T11:13:47.359 INFO:tasks.workunit.client.0.smithi050.stderr: -257> 2024-09-14T11:13:47.004+0000 7fd48f321800 4 set_mon_vals no callback set 2024-09-14T11:13:47.359 INFO:tasks.workunit.client.0.smithi050.stderr: -256> 2024-09-14T11:13:47.004+0000 7fd48f321800 10 monclient: shutdown 2024-09-14T11:13:47.359 INFO:tasks.workunit.client.0.smithi050.stderr: -255> 2024-09-14T11:13:47.004+0000 7fd48f321800 10 monclient: build_initial_monmap 2024-09-14T11:13:47.359 INFO:tasks.workunit.client.0.smithi050.stderr: -254> 2024-09-14T11:13:47.004+0000 7fd48f321800 1 build_initial for_mkfs: 0 2024-09-14T11:13:47.359 INFO:tasks.workunit.client.0.smithi050.stderr: -253> 2024-09-14T11:13:47.004+0000 7fd48f321800 10 monclient: monmap: 2024-09-14T11:13:47.359 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:13:47.359 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:13:47.359 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:13:47.359 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:13:47.359 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:13:47.359 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:47.359 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:13:47.359 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:13:47.360 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:13:47.360 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.360 INFO:tasks.workunit.client.0.smithi050.stderr: -252> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding auth protocol: cephx 2024-09-14T11:13:47.360 INFO:tasks.workunit.client.0.smithi050.stderr: -251> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding auth protocol: cephx 2024-09-14T11:13:47.360 INFO:tasks.workunit.client.0.smithi050.stderr: -250> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding auth protocol: cephx 2024-09-14T11:13:47.360 INFO:tasks.workunit.client.0.smithi050.stderr: -249> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding con mode: secure 2024-09-14T11:13:47.360 INFO:tasks.workunit.client.0.smithi050.stderr: -248> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding con mode: crc 2024-09-14T11:13:47.360 INFO:tasks.workunit.client.0.smithi050.stderr: -247> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding con mode: secure 2024-09-14T11:13:47.360 INFO:tasks.workunit.client.0.smithi050.stderr: -246> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding con mode: crc 2024-09-14T11:13:47.360 INFO:tasks.workunit.client.0.smithi050.stderr: -245> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding con mode: secure 2024-09-14T11:13:47.360 INFO:tasks.workunit.client.0.smithi050.stderr: -244> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding con mode: crc 2024-09-14T11:13:47.360 INFO:tasks.workunit.client.0.smithi050.stderr: -243> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding con mode: crc 2024-09-14T11:13:47.360 INFO:tasks.workunit.client.0.smithi050.stderr: -242> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding con mode: secure 2024-09-14T11:13:47.360 INFO:tasks.workunit.client.0.smithi050.stderr: -241> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding con mode: crc 2024-09-14T11:13:47.361 INFO:tasks.workunit.client.0.smithi050.stderr: -240> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding con mode: secure 2024-09-14T11:13:47.361 INFO:tasks.workunit.client.0.smithi050.stderr: -239> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding con mode: crc 2024-09-14T11:13:47.361 INFO:tasks.workunit.client.0.smithi050.stderr: -238> 2024-09-14T11:13:47.004+0000 7fd48f321800 5 AuthRegistry(0x55b0a620b2d0) adding con mode: secure 2024-09-14T11:13:47.361 INFO:tasks.workunit.client.0.smithi050.stderr: -237> 2024-09-14T11:13:47.005+0000 7fd48f321800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:47.361 INFO:tasks.workunit.client.0.smithi050.stderr: -236> 2024-09-14T11:13:47.005+0000 7fd48f321800 1 librados: starting msgr at 2024-09-14T11:13:47.361 INFO:tasks.workunit.client.0.smithi050.stderr: -235> 2024-09-14T11:13:47.005+0000 7fd48f321800 1 librados: starting objecter 2024-09-14T11:13:47.361 INFO:tasks.workunit.client.0.smithi050.stderr: -234> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command objecter_requests cmddesc objecter_requests hook 0x55b0a620c260 EEXIST 2024-09-14T11:13:47.361 INFO:tasks.workunit.client.0.smithi050.stderr: -233> 2024-09-14T11:13:47.005+0000 7fd48f321800 1 librados: setting wanted keys 2024-09-14T11:13:47.361 INFO:tasks.workunit.client.0.smithi050.stderr: -232> 2024-09-14T11:13:47.005+0000 7fd48f321800 1 librados: calling monclient init 2024-09-14T11:13:47.361 INFO:tasks.workunit.client.0.smithi050.stderr: -231> 2024-09-14T11:13:47.005+0000 7fd48f321800 10 monclient: init 2024-09-14T11:13:47.361 INFO:tasks.workunit.client.0.smithi050.stderr: -230> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding auth protocol: cephx 2024-09-14T11:13:47.361 INFO:tasks.workunit.client.0.smithi050.stderr: -229> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding auth protocol: cephx 2024-09-14T11:13:47.361 INFO:tasks.workunit.client.0.smithi050.stderr: -228> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding auth protocol: cephx 2024-09-14T11:13:47.361 INFO:tasks.workunit.client.0.smithi050.stderr: -227> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding con mode: secure 2024-09-14T11:13:47.361 INFO:tasks.workunit.client.0.smithi050.stderr: -226> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding con mode: crc 2024-09-14T11:13:47.362 INFO:tasks.workunit.client.0.smithi050.stderr: -225> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding con mode: secure 2024-09-14T11:13:47.362 INFO:tasks.workunit.client.0.smithi050.stderr: -224> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding con mode: crc 2024-09-14T11:13:47.362 INFO:tasks.workunit.client.0.smithi050.stderr: -223> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding con mode: secure 2024-09-14T11:13:47.362 INFO:tasks.workunit.client.0.smithi050.stderr: -222> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding con mode: crc 2024-09-14T11:13:47.362 INFO:tasks.workunit.client.0.smithi050.stderr: -221> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding con mode: crc 2024-09-14T11:13:47.362 INFO:tasks.workunit.client.0.smithi050.stderr: -220> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding con mode: secure 2024-09-14T11:13:47.362 INFO:tasks.workunit.client.0.smithi050.stderr: -219> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding con mode: crc 2024-09-14T11:13:47.362 INFO:tasks.workunit.client.0.smithi050.stderr: -218> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding con mode: secure 2024-09-14T11:13:47.362 INFO:tasks.workunit.client.0.smithi050.stderr: -217> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding con mode: crc 2024-09-14T11:13:47.362 INFO:tasks.workunit.client.0.smithi050.stderr: -216> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 AuthRegistry(0x55b0a61faa50) adding con mode: secure 2024-09-14T11:13:47.362 INFO:tasks.workunit.client.0.smithi050.stderr: -215> 2024-09-14T11:13:47.005+0000 7fd48f321800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:47.362 INFO:tasks.workunit.client.0.smithi050.stderr: -214> 2024-09-14T11:13:47.005+0000 7fd48f321800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:47.362 INFO:tasks.workunit.client.0.smithi050.stderr: -213> 2024-09-14T11:13:47.005+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command rotate-key cmddesc rotate-key hook 0x55b0a61fab98 EEXIST 2024-09-14T11:13:47.362 INFO:tasks.workunit.client.0.smithi050.stderr: -212> 2024-09-14T11:13:47.005+0000 7fd48f321800 10 monclient: _reopen_session rank -1 2024-09-14T11:13:47.363 INFO:tasks.workunit.client.0.smithi050.stderr: -211> 2024-09-14T11:13:47.005+0000 7fd48f321800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:13:47.363 INFO:tasks.workunit.client.0.smithi050.stderr: -210> 2024-09-14T11:13:47.005+0000 7fd48f321800 10 monclient(hunting): picked mon.noname-c con 0x55b0a620a490 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:13:47.363 INFO:tasks.workunit.client.0.smithi050.stderr: -209> 2024-09-14T11:13:47.005+0000 7fd48f321800 10 monclient(hunting): picked mon.noname-a con 0x55b0a6235a40 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:13:47.363 INFO:tasks.workunit.client.0.smithi050.stderr: -208> 2024-09-14T11:13:47.005+0000 7fd48f321800 10 monclient(hunting): picked mon.noname-b con 0x55b0a623a680 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:13:47.363 INFO:tasks.workunit.client.0.smithi050.stderr: -207> 2024-09-14T11:13:47.005+0000 7fd48f321800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:47.363 INFO:tasks.workunit.client.0.smithi050.stderr: -206> 2024-09-14T11:13:47.005+0000 7fd48f321800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:47.363 INFO:tasks.workunit.client.0.smithi050.stderr: -205> 2024-09-14T11:13:47.005+0000 7fd48f321800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:47.363 INFO:tasks.workunit.client.0.smithi050.stderr: -204> 2024-09-14T11:13:47.005+0000 7fd48f321800 10 monclient(hunting): _renew_subs 2024-09-14T11:13:47.363 INFO:tasks.workunit.client.0.smithi050.stderr: -203> 2024-09-14T11:13:47.005+0000 7fd48f321800 10 monclient(hunting): authenticate will time out at 2479.642760s 2024-09-14T11:13:47.363 INFO:tasks.workunit.client.0.smithi050.stderr: -202> 2024-09-14T11:13:47.005+0000 7fd483fff640 10 monclient(hunting): get_auth_request con 0x55b0a6235a40 auth_method 0 2024-09-14T11:13:47.363 INFO:tasks.workunit.client.0.smithi050.stderr: -201> 2024-09-14T11:13:47.005+0000 7fd483fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:47.363 INFO:tasks.workunit.client.0.smithi050.stderr: -200> 2024-09-14T11:13:47.005+0000 7fd483fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:47.363 INFO:tasks.workunit.client.0.smithi050.stderr: -199> 2024-09-14T11:13:47.005+0000 7fd483fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:47.363 INFO:tasks.workunit.client.0.smithi050.stderr: -198> 2024-09-14T11:13:47.005+0000 7fd48b044640 10 monclient(hunting): get_auth_request con 0x55b0a620a490 auth_method 0 2024-09-14T11:13:47.363 INFO:tasks.workunit.client.0.smithi050.stderr: -197> 2024-09-14T11:13:47.005+0000 7fd48b044640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:47.364 INFO:tasks.workunit.client.0.smithi050.stderr: -196> 2024-09-14T11:13:47.005+0000 7fd48b044640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:47.364 INFO:tasks.workunit.client.0.smithi050.stderr: -195> 2024-09-14T11:13:47.005+0000 7fd48b044640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:47.364 INFO:tasks.workunit.client.0.smithi050.stderr: -194> 2024-09-14T11:13:47.005+0000 7fd483fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:47.364 INFO:tasks.workunit.client.0.smithi050.stderr: -193> 2024-09-14T11:13:47.005+0000 7fd483fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:47.364 INFO:tasks.workunit.client.0.smithi050.stderr: -192> 2024-09-14T11:13:47.005+0000 7fd483fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:47.364 INFO:tasks.workunit.client.0.smithi050.stderr: -191> 2024-09-14T11:13:47.005+0000 7fd48b044640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:47.364 INFO:tasks.workunit.client.0.smithi050.stderr: -190> 2024-09-14T11:13:47.005+0000 7fd48b044640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:47.364 INFO:tasks.workunit.client.0.smithi050.stderr: -189> 2024-09-14T11:13:47.005+0000 7fd48b044640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:47.364 INFO:tasks.workunit.client.0.smithi050.stderr: -188> 2024-09-14T11:13:47.005+0000 7fd48b845640 10 monclient(hunting): get_auth_request con 0x55b0a623a680 auth_method 0 2024-09-14T11:13:47.364 INFO:tasks.workunit.client.0.smithi050.stderr: -187> 2024-09-14T11:13:47.005+0000 7fd48b845640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:47.364 INFO:tasks.workunit.client.0.smithi050.stderr: -186> 2024-09-14T11:13:47.005+0000 7fd48b845640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:47.364 INFO:tasks.workunit.client.0.smithi050.stderr: -185> 2024-09-14T11:13:47.005+0000 7fd48b845640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:47.364 INFO:tasks.workunit.client.0.smithi050.stderr: -184> 2024-09-14T11:13:47.006+0000 7fd48b845640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:47.364 INFO:tasks.workunit.client.0.smithi050.stderr: -183> 2024-09-14T11:13:47.006+0000 7fd48b845640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:47.365 INFO:tasks.workunit.client.0.smithi050.stderr: -182> 2024-09-14T11:13:47.006+0000 7fd48b845640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:47.365 INFO:tasks.workunit.client.0.smithi050.stderr: -181> 2024-09-14T11:13:47.006+0000 7fd483fff640 10 monclient(hunting): handle_auth_done global_id 8067 payload 824 2024-09-14T11:13:47.365 INFO:tasks.workunit.client.0.smithi050.stderr: -180> 2024-09-14T11:13:47.006+0000 7fd483fff640 10 monclient: _finish_hunting 0 2024-09-14T11:13:47.365 INFO:tasks.workunit.client.0.smithi050.stderr: -179> 2024-09-14T11:13:47.006+0000 7fd483fff640 1 monclient: found mon.noname-a 2024-09-14T11:13:47.365 INFO:tasks.workunit.client.0.smithi050.stderr: -178> 2024-09-14T11:13:47.006+0000 7fd483fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:13:47.365 INFO:tasks.workunit.client.0.smithi050.stderr: -177> 2024-09-14T11:13:47.006+0000 7fd36d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:47.365 INFO:tasks.workunit.client.0.smithi050.stderr: -176> 2024-09-14T11:13:47.006+0000 7fd36d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:13:47.365 INFO:tasks.workunit.client.0.smithi050.stderr: -175> 2024-09-14T11:13:47.006+0000 7fd36d7fa640 10 monclient: dump: 2024-09-14T11:13:47.365 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:47.365 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:47.365 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.365 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.365 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:47.365 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:47.366 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:47.366 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:47.366 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:47.366 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.366 INFO:tasks.workunit.client.0.smithi050.stderr: -174> 2024-09-14T11:13:47.006+0000 7fd36d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:13:47.366 INFO:tasks.workunit.client.0.smithi050.stderr: -173> 2024-09-14T11:13:47.006+0000 7fd36d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:13:47.366 INFO:tasks.workunit.client.0.smithi050.stderr: -172> 2024-09-14T11:13:47.006+0000 7fd36d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:47.366 INFO:tasks.workunit.client.0.smithi050.stderr: -171> 2024-09-14T11:13:47.006+0000 7fd36d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:47.366 INFO:tasks.workunit.client.0.smithi050.stderr: -170> 2024-09-14T11:13:47.006+0000 7fd36d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:13:47.366 INFO:tasks.workunit.client.0.smithi050.stderr: -169> 2024-09-14T11:13:47.006+0000 7fd36d7fa640 10 monclient: dump: 2024-09-14T11:13:47.366 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:13:47.366 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:13:47.366 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.366 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:13:47.366 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:47.367 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:13:47.367 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:13:47.367 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:13:47.367 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:13:47.367 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.367 INFO:tasks.workunit.client.0.smithi050.stderr: -168> 2024-09-14T11:13:47.006+0000 7fd48f321800 5 monclient: authenticate success, global_id 8067 2024-09-14T11:13:47.367 INFO:tasks.workunit.client.0.smithi050.stderr: -167> 2024-09-14T11:13:47.006+0000 7fd48f321800 10 monclient: _renew_subs 2024-09-14T11:13:47.367 INFO:tasks.workunit.client.0.smithi050.stderr: -166> 2024-09-14T11:13:47.006+0000 7fd36effd640 4 set_mon_vals no callback set 2024-09-14T11:13:47.367 INFO:tasks.workunit.client.0.smithi050.stderr: -165> 2024-09-14T11:13:47.006+0000 7fd48f321800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:13:47.367 INFO:tasks.workunit.client.0.smithi050.stderr: -164> 2024-09-14T11:13:47.006+0000 7fd48f321800 10 monclient: _renew_subs 2024-09-14T11:13:47.367 INFO:tasks.workunit.client.0.smithi050.stderr: -163> 2024-09-14T11:13:47.006+0000 7fd48f321800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:13:47.367 INFO:tasks.workunit.client.0.smithi050.stderr: -162> 2024-09-14T11:13:47.006+0000 7fd48f321800 1 librados: init done 2024-09-14T11:13:47.367 INFO:tasks.workunit.client.0.smithi050.stderr: -161> 2024-09-14T11:13:47.006+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command cr dump hook 0x55b0a622ca88 2024-09-14T11:13:47.367 INFO:tasks.workunit.client.0.smithi050.stderr: -160> 2024-09-14T11:13:47.008+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.368 INFO:tasks.workunit.client.0.smithi050.stderr: -159> 2024-09-14T11:13:47.008+0000 7fd36d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:13:47.368 INFO:tasks.workunit.client.0.smithi050.stderr: -158> 2024-09-14T11:13:47.008+0000 7fd36d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:13:47.368 INFO:tasks.workunit.client.0.smithi050.stderr: -157> 2024-09-14T11:13:47.008+0000 7fd36d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:13:47.368 INFO:tasks.workunit.client.0.smithi050.stderr: -156> 2024-09-14T11:13:47.008+0000 7fd48b044640 10 monclient: get_auth_request con 0x7fd354077230 auth_method 0 2024-09-14T11:13:47.368 INFO:tasks.workunit.client.0.smithi050.stderr: -155> 2024-09-14T11:13:47.009+0000 7fd48b845640 10 monclient: get_auth_request con 0x55b0a6254a00 auth_method 0 2024-09-14T11:13:47.368 INFO:tasks.workunit.client.0.smithi050.stderr: -154> 2024-09-14T11:13:47.009+0000 7fd48f321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.368 INFO:tasks.workunit.client.0.smithi050.stderr: -153> 2024-09-14T11:13:47.009+0000 7fd48f321800 20 realm 2024-09-14T11:13:47.368 INFO:tasks.workunit.client.0.smithi050.stderr: -152> 2024-09-14T11:13:47.009+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.368 INFO:tasks.workunit.client.0.smithi050.stderr: -151> 2024-09-14T11:13:47.009+0000 7fd48f321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.368 INFO:tasks.workunit.client.0.smithi050.stderr: -150> 2024-09-14T11:13:47.009+0000 7fd48f321800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:47.368 INFO:tasks.workunit.client.0.smithi050.stderr: -149> 2024-09-14T11:13:47.009+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.368 INFO:tasks.workunit.client.0.smithi050.stderr: -148> 2024-09-14T11:13:47.010+0000 7fd48f321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.368 INFO:tasks.workunit.client.0.smithi050.stderr: -147> 2024-09-14T11:13:47.010+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.368 INFO:tasks.workunit.client.0.smithi050.stderr: -146> 2024-09-14T11:13:47.010+0000 7fd48b044640 10 monclient: get_auth_request con 0x55b0a6258d70 auth_method 0 2024-09-14T11:13:47.369 INFO:tasks.workunit.client.0.smithi050.stderr: -145> 2024-09-14T11:13:47.010+0000 7fd48f321800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:47.369 INFO:tasks.workunit.client.0.smithi050.stderr: -144> 2024-09-14T11:13:47.010+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.369 INFO:tasks.workunit.client.0.smithi050.stderr: -143> 2024-09-14T11:13:47.011+0000 7fd483fff640 10 monclient: get_auth_request con 0x55b0a625c470 auth_method 0 2024-09-14T11:13:47.369 INFO:tasks.workunit.client.0.smithi050.stderr: -142> 2024-09-14T11:13:47.011+0000 7fd48f321800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:47.369 INFO:tasks.workunit.client.0.smithi050.stderr: -141> 2024-09-14T11:13:47.011+0000 7fd48f321800 20 searching for the correct realm 2024-09-14T11:13:47.369 INFO:tasks.workunit.client.0.smithi050.stderr: -140> 2024-09-14T11:13:47.011+0000 7fd48b845640 10 monclient: get_auth_request con 0x55b0a6261230 auth_method 0 2024-09-14T11:13:47.369 INFO:tasks.workunit.client.0.smithi050.stderr: -139> 2024-09-14T11:13:47.012+0000 7fd48b044640 10 monclient: get_auth_request con 0x7fd48406abd0 auth_method 0 2024-09-14T11:13:47.369 INFO:tasks.workunit.client.0.smithi050.stderr: -138> 2024-09-14T11:13:47.014+0000 7fd483fff640 10 monclient: get_auth_request con 0x7fd484084400 auth_method 0 2024-09-14T11:13:47.369 INFO:tasks.workunit.client.0.smithi050.stderr: -137> 2024-09-14T11:13:47.014+0000 7fd483fff640 0 -- 172.21.15.50:0/3104753957 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fd484084400 msgr2=0x7fd484084860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:47.369 INFO:tasks.workunit.client.0.smithi050.stderr: -136> 2024-09-14T11:13:47.216+0000 7fd483fff640 10 monclient: get_auth_request con 0x7fd484084400 auth_method 0 2024-09-14T11:13:47.369 INFO:tasks.workunit.client.0.smithi050.stderr: -135> 2024-09-14T11:13:47.218+0000 7fd48b845640 10 monclient: get_auth_request con 0x7fd47c0722e0 auth_method 0 2024-09-14T11:13:47.369 INFO:tasks.workunit.client.0.smithi050.stderr: -134> 2024-09-14T11:13:47.219+0000 7fd48b044640 10 monclient: get_auth_request con 0x7fd484068440 auth_method 0 2024-09-14T11:13:47.369 INFO:tasks.workunit.client.0.smithi050.stderr: -133> 2024-09-14T11:13:47.220+0000 7fd48b845640 0 -- 172.21.15.50:0/3104753957 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55b0a6254a00 msgr2=0x55b0a6256e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:47.369 INFO:tasks.workunit.client.0.smithi050.stderr: -132> 2024-09-14T11:13:47.220+0000 7fd36d7fa640 1 client.8067.objecter ms_handle_reset 0x55b0a6254a00 session 0x55b0a6254380 osd.6 2024-09-14T11:13:47.370 INFO:tasks.workunit.client.0.smithi050.stderr: -131> 2024-09-14T11:13:47.220+0000 7fd36d7fa640 10 monclient: _renew_subs 2024-09-14T11:13:47.370 INFO:tasks.workunit.client.0.smithi050.stderr: -130> 2024-09-14T11:13:47.220+0000 7fd36d7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:13:47.370 INFO:tasks.workunit.client.0.smithi050.stderr: -129> 2024-09-14T11:13:47.221+0000 7fd48b845640 10 monclient: get_auth_request con 0x7fd354087540 auth_method 0 2024-09-14T11:13:47.370 INFO:tasks.workunit.client.0.smithi050.stderr: -128> 2024-09-14T11:13:47.224+0000 7fd48f321800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:47.370 INFO:tasks.workunit.client.0.smithi050.stderr: -127> 2024-09-14T11:13:47.224+0000 7fd48f321800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:47.370 INFO:tasks.workunit.client.0.smithi050.stderr: -126> 2024-09-14T11:13:47.224+0000 7fd48f321800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:47.370 INFO:tasks.workunit.client.0.smithi050.stderr: -125> 2024-09-14T11:13:47.224+0000 7fd48f321800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:47.370 INFO:tasks.workunit.client.0.smithi050.stderr: -124> 2024-09-14T11:13:47.224+0000 7fd48f321800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:47.370 INFO:tasks.workunit.client.0.smithi050.stderr: -123> 2024-09-14T11:13:47.224+0000 7fd48f321800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:47.370 INFO:tasks.workunit.client.0.smithi050.stderr: -122> 2024-09-14T11:13:47.224+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.370 INFO:tasks.workunit.client.0.smithi050.stderr: -121> 2024-09-14T11:13:47.225+0000 7fd48f321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.370 INFO:tasks.workunit.client.0.smithi050.stderr: -120> 2024-09-14T11:13:47.225+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.370 INFO:tasks.workunit.client.0.smithi050.stderr: -119> 2024-09-14T11:13:47.225+0000 7fd48f321800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:47.370 INFO:tasks.workunit.client.0.smithi050.stderr: -118> 2024-09-14T11:13:47.225+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.371 INFO:tasks.workunit.client.0.smithi050.stderr: -117> 2024-09-14T11:13:47.225+0000 7fd48f321800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:47.371 INFO:tasks.workunit.client.0.smithi050.stderr: -116> 2024-09-14T11:13:47.225+0000 7fd48f321800 20 zone default found 2024-09-14T11:13:47.371 INFO:tasks.workunit.client.0.smithi050.stderr: -115> 2024-09-14T11:13:47.225+0000 7fd48f321800 4 Realm: () 2024-09-14T11:13:47.371 INFO:tasks.workunit.client.0.smithi050.stderr: -114> 2024-09-14T11:13:47.225+0000 7fd48f321800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:47.371 INFO:tasks.workunit.client.0.smithi050.stderr: -113> 2024-09-14T11:13:47.225+0000 7fd48f321800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:47.371 INFO:tasks.workunit.client.0.smithi050.stderr: -112> 2024-09-14T11:13:47.225+0000 7fd48f321800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:47.371 INFO:tasks.workunit.client.0.smithi050.stderr: -111> 2024-09-14T11:13:47.225+0000 7fd48f321800 20 zonegroup default 2024-09-14T11:13:47.371 INFO:tasks.workunit.client.0.smithi050.stderr: -110> 2024-09-14T11:13:47.225+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.371 INFO:tasks.workunit.client.0.smithi050.stderr: -109> 2024-09-14T11:13:47.225+0000 7fd48f321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.371 INFO:tasks.workunit.client.0.smithi050.stderr: -108> 2024-09-14T11:13:47.225+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.371 INFO:tasks.workunit.client.0.smithi050.stderr: -107> 2024-09-14T11:13:47.226+0000 7fd48f321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.371 INFO:tasks.workunit.client.0.smithi050.stderr: -106> 2024-09-14T11:13:47.226+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.371 INFO:tasks.workunit.client.0.smithi050.stderr: -105> 2024-09-14T11:13:47.226+0000 7fd48f321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.372 INFO:tasks.workunit.client.0.smithi050.stderr: -104> 2024-09-14T11:13:47.226+0000 7fd48f321800 20 started sync module instance, tier type = 2024-09-14T11:13:47.372 INFO:tasks.workunit.client.0.smithi050.stderr: -103> 2024-09-14T11:13:47.226+0000 7fd48f321800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:47.372 INFO:tasks.workunit.client.0.smithi050.stderr: -102> 2024-09-14T11:13:47.234+0000 7fd48f321800 20 add_watcher() i=0 2024-09-14T11:13:47.372 INFO:tasks.workunit.client.0.smithi050.stderr: -101> 2024-09-14T11:13:47.234+0000 7fd48f321800 20 add_watcher() i=1 2024-09-14T11:13:47.372 INFO:tasks.workunit.client.0.smithi050.stderr: -100> 2024-09-14T11:13:47.234+0000 7fd48f321800 20 add_watcher() i=2 2024-09-14T11:13:47.372 INFO:tasks.workunit.client.0.smithi050.stderr: -99> 2024-09-14T11:13:47.234+0000 7fd48f321800 20 add_watcher() i=3 2024-09-14T11:13:47.372 INFO:tasks.workunit.client.0.smithi050.stderr: -98> 2024-09-14T11:13:47.234+0000 7fd48f321800 20 add_watcher() i=4 2024-09-14T11:13:47.372 INFO:tasks.workunit.client.0.smithi050.stderr: -97> 2024-09-14T11:13:47.234+0000 7fd48f321800 20 add_watcher() i=5 2024-09-14T11:13:47.372 INFO:tasks.workunit.client.0.smithi050.stderr: -96> 2024-09-14T11:13:47.234+0000 7fd48f321800 20 add_watcher() i=6 2024-09-14T11:13:47.372 INFO:tasks.workunit.client.0.smithi050.stderr: -95> 2024-09-14T11:13:47.235+0000 7fd48f321800 20 add_watcher() i=7 2024-09-14T11:13:47.372 INFO:tasks.workunit.client.0.smithi050.stderr: -94> 2024-09-14T11:13:47.235+0000 7fd48f321800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:47.372 INFO:tasks.workunit.client.0.smithi050.stderr: -93> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding auth protocol: cephx 2024-09-14T11:13:47.372 INFO:tasks.workunit.client.0.smithi050.stderr: -92> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding auth protocol: cephx 2024-09-14T11:13:47.372 INFO:tasks.workunit.client.0.smithi050.stderr: -91> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding auth protocol: cephx 2024-09-14T11:13:47.373 INFO:tasks.workunit.client.0.smithi050.stderr: -90> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding con mode: secure 2024-09-14T11:13:47.373 INFO:tasks.workunit.client.0.smithi050.stderr: -89> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding con mode: crc 2024-09-14T11:13:47.373 INFO:tasks.workunit.client.0.smithi050.stderr: -88> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding con mode: secure 2024-09-14T11:13:47.373 INFO:tasks.workunit.client.0.smithi050.stderr: -87> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding con mode: crc 2024-09-14T11:13:47.373 INFO:tasks.workunit.client.0.smithi050.stderr: -86> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding con mode: secure 2024-09-14T11:13:47.373 INFO:tasks.workunit.client.0.smithi050.stderr: -85> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding con mode: crc 2024-09-14T11:13:47.373 INFO:tasks.workunit.client.0.smithi050.stderr: -84> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding con mode: crc 2024-09-14T11:13:47.373 INFO:tasks.workunit.client.0.smithi050.stderr: -83> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding con mode: secure 2024-09-14T11:13:47.373 INFO:tasks.workunit.client.0.smithi050.stderr: -82> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding con mode: crc 2024-09-14T11:13:47.373 INFO:tasks.workunit.client.0.smithi050.stderr: -81> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding con mode: secure 2024-09-14T11:13:47.373 INFO:tasks.workunit.client.0.smithi050.stderr: -80> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding con mode: crc 2024-09-14T11:13:47.373 INFO:tasks.workunit.client.0.smithi050.stderr: -79> 2024-09-14T11:13:47.237+0000 7fd48f321800 5 AuthRegistry(0x7fff0e6b2c00) adding con mode: secure 2024-09-14T11:13:47.373 INFO:tasks.workunit.client.0.smithi050.stderr: -78> 2024-09-14T11:13:47.237+0000 7fd341fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:47.373 INFO:tasks.workunit.client.0.smithi050.stderr: -77> 2024-09-14T11:13:47.238+0000 7fd48f321800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:47.374 INFO:tasks.workunit.client.0.smithi050.stderr: -76> 2024-09-14T11:13:47.238+0000 7fd48f321800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:47.374 INFO:tasks.workunit.client.0.smithi050.stderr: -75> 2024-09-14T11:13:47.238+0000 7fd48f321800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:47.374 INFO:tasks.workunit.client.0.smithi050.stderr: -74> 2024-09-14T11:13:47.238+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command cache list hook 0x55b0a622c0c0 2024-09-14T11:13:47.374 INFO:tasks.workunit.client.0.smithi050.stderr: -73> 2024-09-14T11:13:47.238+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command cache inspect hook 0x55b0a622c0c0 2024-09-14T11:13:47.374 INFO:tasks.workunit.client.0.smithi050.stderr: -72> 2024-09-14T11:13:47.238+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command cache erase hook 0x55b0a622c0c0 2024-09-14T11:13:47.374 INFO:tasks.workunit.client.0.smithi050.stderr: -71> 2024-09-14T11:13:47.238+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command cache zap hook 0x55b0a622c0c0 2024-09-14T11:13:47.374 INFO:tasks.workunit.client.0.smithi050.stderr: -70> 2024-09-14T11:13:47.238+0000 7fd48f321800 5 note: GC not initialized 2024-09-14T11:13:47.374 INFO:tasks.workunit.client.0.smithi050.stderr: -69> 2024-09-14T11:13:47.238+0000 7fd340fe1640 20 reqs_thread_entry: start 2024-09-14T11:13:47.374 INFO:tasks.workunit.client.0.smithi050.stderr: -68> 2024-09-14T11:13:47.238+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command sync trace show hook 0x7fd47401f070 2024-09-14T11:13:47.374 INFO:tasks.workunit.client.0.smithi050.stderr: -67> 2024-09-14T11:13:47.238+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command sync trace history hook 0x7fd47401f070 2024-09-14T11:13:47.374 INFO:tasks.workunit.client.0.smithi050.stderr: -66> 2024-09-14T11:13:47.238+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command sync trace active hook 0x7fd47401f070 2024-09-14T11:13:47.374 INFO:tasks.workunit.client.0.smithi050.stderr: -65> 2024-09-14T11:13:47.238+0000 7fd48f321800 5 asok(0x55b0a5f49270) register_command sync trace active_short hook 0x7fd47401f070 2024-09-14T11:13:47.374 INFO:tasks.workunit.client.0.smithi050.stderr: -64> 2024-09-14T11:13:47.238+0000 7fd48f321800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:47.374 INFO:tasks.workunit.client.0.smithi050.stderr: -63> 2024-09-14T11:13:47.238+0000 7fd48f321800 20 Filter name: none 2024-09-14T11:13:47.375 INFO:tasks.workunit.client.0.smithi050.stderr: -62> 2024-09-14T11:13:47.238+0000 7fd2ba7fc640 20 reqs_thread_entry: start 2024-09-14T11:13:47.375 INFO:tasks.workunit.client.0.smithi050.stderr: -61> 2024-09-14T11:13:47.238+0000 7fd48f321800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:13:47.375 INFO:tasks.workunit.client.0.smithi050.stderr: -60> 2024-09-14T11:13:47.238+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.375 INFO:tasks.workunit.client.0.smithi050.stderr: -59> 2024-09-14T11:13:47.239+0000 7fd48f321800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:13:47.375 INFO:tasks.workunit.client.0.smithi050.stderr: -58> 2024-09-14T11:13:47.239+0000 7fd48f321800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:13:47.375 INFO:tasks.workunit.client.0.smithi050.stderr: -57> 2024-09-14T11:13:47.239+0000 7fd48f321800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:13:47.375 INFO:tasks.workunit.client.0.smithi050.stderr: -56> 2024-09-14T11:13:47.239+0000 7fd48f321800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 : miss 2024-09-14T11:13:47.375 INFO:tasks.workunit.client.0.smithi050.stderr: -55> 2024-09-14T11:13:47.239+0000 7fd48f321800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.375 INFO:tasks.workunit.client.0.smithi050.stderr: -54> 2024-09-14T11:13:47.240+0000 7fd48f321800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:13:47.375 INFO:tasks.workunit.client.0.smithi050.stderr: -53> 2024-09-14T11:13:47.240+0000 7fd48f321800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 info.flags=0x17 2024-09-14T11:13:47.375 INFO:tasks.workunit.client.0.smithi050.stderr: -52> 2024-09-14T11:13:47.240+0000 7fd48f321800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 to cache LRU end 2024-09-14T11:13:47.375 INFO:tasks.workunit.client.0.smithi050.stderr: -51> 2024-09-14T11:13:47.240+0000 7fd48f321800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:47.375 INFO:tasks.workunit.client.0.smithi050.stderr: -50> 2024-09-14T11:13:47.240+0000 7fd48f321800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:47.375 INFO:tasks.workunit.client.0.smithi050.stderr: -49> 2024-09-14T11:13:47.240+0000 7fd48f321800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 2024-09-14T11:13:47.376 INFO:tasks.workunit.client.0.smithi050.stderr: -48> 2024-09-14T11:13:47.245+0000 7fd48f321800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 info.flags=0x17 2024-09-14T11:13:47.376 INFO:tasks.workunit.client.0.smithi050.stderr: -47> 2024-09-14T11:13:47.245+0000 7fd48f321800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 to cache LRU end 2024-09-14T11:13:47.376 INFO:tasks.workunit.client.0.smithi050.stderr: -46> 2024-09-14T11:13:47.245+0000 7fd48f321800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:47.376 INFO:tasks.workunit.client.0.smithi050.stderr: -45> 2024-09-14T11:13:47.245+0000 7fd48f321800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40, ofs0, ns] 2024-09-14T11:13:47.376 INFO:tasks.workunit.client.0.smithi050.stderr: -44> 2024-09-14T11:13:47.245+0000 7fd36e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94217190136384 notifier 8067 bl.length()=1015 2024-09-14T11:13:47.376 INFO:tasks.workunit.client.0.smithi050.stderr: -43> 2024-09-14T11:13:47.245+0000 7fd36e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 info.flags=0x17 2024-09-14T11:13:47.376 INFO:tasks.workunit.client.0.smithi050.stderr: -42> 2024-09-14T11:13:47.245+0000 7fd36e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 to cache LRU end 2024-09-14T11:13:47.376 INFO:tasks.workunit.client.0.smithi050.stderr: -41> 2024-09-14T11:13:47.245+0000 7fd36e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:47.376 INFO:tasks.workunit.client.0.smithi050.stderr: -40> 2024-09-14T11:13:47.247+0000 7fd48f321800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40]): orig_sources= new_sources= 2024-09-14T11:13:47.376 INFO:tasks.workunit.client.0.smithi050.stderr: -39> 2024-09-14T11:13:47.247+0000 7fd48f321800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40]): potential sources added=[] removed=[] 2024-09-14T11:13:47.376 INFO:tasks.workunit.client.0.smithi050.stderr: -38> 2024-09-14T11:13:47.247+0000 7fd48f321800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40]): orig_dests= new_dests= 2024-09-14T11:13:47.376 INFO:tasks.workunit.client.0.smithi050.stderr: -37> 2024-09-14T11:13:47.247+0000 7fd48f321800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40]): potential dests added=[] removed=[] 2024-09-14T11:13:47.376 INFO:tasks.workunit.client.0.smithi050.stderr: -36> 2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.0 2024-09-14T11:13:47.376 INFO:tasks.workunit.client.0.smithi050.stderr: -35> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.0 2024-09-14T11:13:47.377 INFO:tasks.workunit.client.0.smithi050.stderr: -34> 2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.1 2024-09-14T11:13:47.377 INFO:tasks.workunit.client.0.smithi050.stderr: -33> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.1 2024-09-14T11:13:47.377 INFO:tasks.workunit.client.0.smithi050.stderr: -32> 2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.2 2024-09-14T11:13:47.377 INFO:tasks.workunit.client.0.smithi050.stderr: -31> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.2 2024-09-14T11:13:47.377 INFO:tasks.workunit.client.0.smithi050.stderr: -30> 2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.3 2024-09-14T11:13:47.377 INFO:tasks.workunit.client.0.smithi050.stderr: -29> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.3 2024-09-14T11:13:47.377 INFO:tasks.workunit.client.0.smithi050.stderr: -28> 2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.4 2024-09-14T11:13:47.377 INFO:tasks.workunit.client.0.smithi050.stderr: -27> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.4 2024-09-14T11:13:47.377 INFO:tasks.workunit.client.0.smithi050.stderr: -26> 2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.5 2024-09-14T11:13:47.377 INFO:tasks.workunit.client.0.smithi050.stderr: -25> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.5 2024-09-14T11:13:47.377 INFO:tasks.workunit.client.0.smithi050.stderr: -24> 2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.6 2024-09-14T11:13:47.377 INFO:tasks.workunit.client.0.smithi050.stderr: -23> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.6 2024-09-14T11:13:47.377 INFO:tasks.workunit.client.0.smithi050.stderr: -22> 2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.7 2024-09-14T11:13:47.377 INFO:tasks.workunit.client.0.smithi050.stderr: -21> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.7 2024-09-14T11:13:47.378 INFO:tasks.workunit.client.0.smithi050.stderr: -20> 2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.8 2024-09-14T11:13:47.378 INFO:tasks.workunit.client.0.smithi050.stderr: -19> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.8 2024-09-14T11:13:47.378 INFO:tasks.workunit.client.0.smithi050.stderr: -18> 2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.9 2024-09-14T11:13:47.378 INFO:tasks.workunit.client.0.smithi050.stderr: -17> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.9 2024-09-14T11:13:47.378 INFO:tasks.workunit.client.0.smithi050.stderr: -16> 2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.10 2024-09-14T11:13:47.378 INFO:tasks.workunit.client.0.smithi050.stderr: -15> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.10 2024-09-14T11:13:47.378 INFO:tasks.workunit.client.0.smithi050.stderr: -14> 2024-09-14T11:13:47.251+0000 7fd48f321800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.11 2024-09-14T11:13:47.378 INFO:tasks.workunit.client.0.smithi050.stderr: -13> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1.11 2024-09-14T11:13:47.378 INFO:tasks.workunit.client.0.smithi050.stderr: -12> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.0 2024-09-14T11:13:47.378 INFO:tasks.workunit.client.0.smithi050.stderr: -11> 2024-09-14T11:13:47.251+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1 2024-09-14T11:13:47.378 INFO:tasks.workunit.client.0.smithi050.stderr: -10> 2024-09-14T11:13:47.252+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2 2024-09-14T11:13:47.378 INFO:tasks.workunit.client.0.smithi050.stderr: -9> 2024-09-14T11:13:47.252+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.3 2024-09-14T11:13:47.378 INFO:tasks.workunit.client.0.smithi050.stderr: -8> 2024-09-14T11:13:47.253+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.4 2024-09-14T11:13:47.378 INFO:tasks.workunit.client.0.smithi050.stderr: -7> 2024-09-14T11:13:47.253+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.5 2024-09-14T11:13:47.378 INFO:tasks.workunit.client.0.smithi050.stderr: -6> 2024-09-14T11:13:47.253+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.6 2024-09-14T11:13:47.379 INFO:tasks.workunit.client.0.smithi050.stderr: -5> 2024-09-14T11:13:47.254+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.7 2024-09-14T11:13:47.379 INFO:tasks.workunit.client.0.smithi050.stderr: -4> 2024-09-14T11:13:47.254+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.8 2024-09-14T11:13:47.379 INFO:tasks.workunit.client.0.smithi050.stderr: -3> 2024-09-14T11:13:47.255+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.9 2024-09-14T11:13:47.379 INFO:tasks.workunit.client.0.smithi050.stderr: -2> 2024-09-14T11:13:47.256+0000 7fd48f321800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.10 2024-09-14T11:13:47.379 INFO:tasks.workunit.client.0.smithi050.stderr: -1> 2024-09-14T11:13:47.260+0000 7fd48f321800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd48f321800 time 2024-09-14T11:13:47.260094+0000 2024-09-14T11:13:47.379 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:13:47.379 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.379 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:13:47.379 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd490b8c76a] 2024-09-14T11:13:47.379 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd490b8c928] 2024-09-14T11:13:47.379 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b0a537d0b1] 2024-09-14T11:13:47.379 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b0a538c124] 2024-09-14T11:13:47.379 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b0a538cfc4] 2024-09-14T11:13:47.379 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:13:47.380 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd48f829590] 2024-09-14T11:13:47.380 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:13:47.380 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:13:47.380 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.380 INFO:tasks.workunit.client.0.smithi050.stderr: 0> 2024-09-14T11:13:47.261+0000 7fd48f321800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:13:47.380 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7fd48f321800 thread_name:radosgw-admin 2024-09-14T11:13:47.380 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.380 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:13:47.380 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd48f83e6f0] 2024-09-14T11:13:47.380 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd48f88b99c] 2024-09-14T11:13:47.380 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:13:47.380 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:13:47.380 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd490b8c7c4] 2024-09-14T11:13:47.380 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd490b8c928] 2024-09-14T11:13:47.381 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b0a537d0b1] 2024-09-14T11:13:47.381 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b0a538c124] 2024-09-14T11:13:47.381 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b0a538cfc4] 2024-09-14T11:13:47.381 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:13:47.381 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd48f829590] 2024-09-14T11:13:47.381 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:13:47.381 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:13:47.381 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:13:47.381 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.381 INFO:tasks.workunit.client.0.smithi050.stderr:--- logging levels --- 2024-09-14T11:13:47.381 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 none 2024-09-14T11:13:47.381 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 lockdep 2024-09-14T11:13:47.381 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 context 2024-09-14T11:13:47.382 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 crush 2024-09-14T11:13:47.382 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds 2024-09-14T11:13:47.382 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_balancer 2024-09-14T11:13:47.382 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_locker 2024-09-14T11:13:47.382 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log 2024-09-14T11:13:47.382 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log_expire 2024-09-14T11:13:47.382 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_migrator 2024-09-14T11:13:47.382 INFO:tasks.workunit.client.0.smithi050.stderr: 3/ 5 mds_quiesce 2024-09-14T11:13:47.382 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 buffer 2024-09-14T11:13:47.382 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 timer 2024-09-14T11:13:47.382 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 filer 2024-09-14T11:13:47.382 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 striper 2024-09-14T11:13:47.382 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 objecter 2024-09-14T11:13:47.382 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rados 2024-09-14T11:13:47.383 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd 2024-09-14T11:13:47.383 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_mirror 2024-09-14T11:13:47.383 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_replay 2024-09-14T11:13:47.383 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_pwl 2024-09-14T11:13:47.383 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 journaler 2024-09-14T11:13:47.383 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objectcacher 2024-09-14T11:13:47.383 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:13:47.383 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 client 2024-09-14T11:13:47.383 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 osd 2024-09-14T11:13:47.383 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 optracker 2024-09-14T11:13:47.383 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objclass 2024-09-14T11:13:47.383 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 filestore 2024-09-14T11:13:47.383 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 journal 2024-09-14T11:13:47.383 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 ms 2024-09-14T11:13:47.383 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mon 2024-09-14T11:13:47.384 INFO:tasks.workunit.client.0.smithi050.stderr: 0/10 monc 2024-09-14T11:13:47.384 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 paxos 2024-09-14T11:13:47.384 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 tp 2024-09-14T11:13:47.384 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 auth 2024-09-14T11:13:47.384 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 crypto 2024-09-14T11:13:47.384 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 finisher 2024-09-14T11:13:47.384 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 reserver 2024-09-14T11:13:47.384 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 heartbeatmap 2024-09-14T11:13:47.384 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 perfcounter 2024-09-14T11:13:47.384 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw 2024-09-14T11:13:47.384 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_sync 2024-09-14T11:13:47.384 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_datacache 2024-09-14T11:13:47.384 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_access 2024-09-14T11:13:47.384 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:13:47.385 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_flight 2024-09-14T11:13:47.385 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:13:47.385 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw_notification 2024-09-14T11:13:47.385 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 javaclient 2024-09-14T11:13:47.385 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 asok 2024-09-14T11:13:47.385 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 throttle 2024-09-14T11:13:47.385 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 refs 2024-09-14T11:13:47.385 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 compressor 2024-09-14T11:13:47.385 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluestore 2024-09-14T11:13:47.385 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluefs 2024-09-14T11:13:47.385 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 bdev 2024-09-14T11:13:47.385 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 kstore 2024-09-14T11:13:47.385 INFO:tasks.workunit.client.0.smithi050.stderr: 4/ 5 rocksdb 2024-09-14T11:13:47.385 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 fuse 2024-09-14T11:13:47.386 INFO:tasks.workunit.client.0.smithi050.stderr: 2/ 5 mgr 2024-09-14T11:13:47.386 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mgrc 2024-09-14T11:13:47.386 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 dpdk 2024-09-14T11:13:47.386 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 eventtrace 2024-09-14T11:13:47.386 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 prioritycache 2024-09-14T11:13:47.386 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 test 2024-09-14T11:13:47.386 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:13:47.386 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephsqlite 2024-09-14T11:13:47.386 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:13:47.386 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore 2024-09-14T11:13:47.386 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_onode 2024-09-14T11:13:47.386 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_odata 2024-09-14T11:13:47.386 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_omap 2024-09-14T11:13:47.387 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_tm 2024-09-14T11:13:47.387 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_t 2024-09-14T11:13:47.387 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:13:47.387 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_epm 2024-09-14T11:13:47.387 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_lba 2024-09-14T11:13:47.387 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:13:47.387 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cache 2024-09-14T11:13:47.387 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_journal 2024-09-14T11:13:47.387 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_device 2024-09-14T11:13:47.387 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_backref 2024-09-14T11:13:47.387 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 alienstore 2024-09-14T11:13:47.387 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mclock 2024-09-14T11:13:47.387 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cyanstore 2024-09-14T11:13:47.387 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 ceph_exporter 2024-09-14T11:13:47.388 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 memstore 2024-09-14T11:13:47.388 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 trace 2024-09-14T11:13:47.388 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 ceph_dedup 2024-09-14T11:13:47.388 INFO:tasks.workunit.client.0.smithi050.stderr: -2/-2 (syslog threshold) 2024-09-14T11:13:47.388 INFO:tasks.workunit.client.0.smithi050.stderr: 99/99 (stderr threshold) 2024-09-14T11:13:47.388 INFO:tasks.workunit.client.0.smithi050.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:13:47.388 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd2ba7fc640 / http_manager 2024-09-14T11:13:47.388 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd340fe1640 / http_manager 2024-09-14T11:13:47.388 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd341fe3640 / rgw_dt_lg_renew 2024-09-14T11:13:47.388 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd36d7fa640 / ms_dispatch 2024-09-14T11:13:47.388 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd36e7fc640 / io_context_pool 2024-09-14T11:13:47.388 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd36effd640 / io_context_pool 2024-09-14T11:13:47.388 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd375602640 / ms_dispatch 2024-09-14T11:13:47.388 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd377e07640 / ms_dispatch 2024-09-14T11:13:47.389 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd37960a640 / io_context_pool 2024-09-14T11:13:47.389 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd483fff640 / msgr-worker-2 2024-09-14T11:13:47.389 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd48b044640 / msgr-worker-1 2024-09-14T11:13:47.389 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd48b845640 / msgr-worker-0 2024-09-14T11:13:47.389 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd48c046640 / io_context_pool 2024-09-14T11:13:47.389 INFO:tasks.workunit.client.0.smithi050.stderr: 7fd48f321800 / radosgw-admin 2024-09-14T11:13:47.389 INFO:tasks.workunit.client.0.smithi050.stderr: max_recent 500 2024-09-14T11:13:47.389 INFO:tasks.workunit.client.0.smithi050.stderr: max_new 1000 2024-09-14T11:13:47.389 INFO:tasks.workunit.client.0.smithi050.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:13:47.261756Z_7da53c1f-7d3e-4ad6-9418-e48ea3561a2d/log 2024-09-14T11:13:47.389 INFO:tasks.workunit.client.0.smithi050.stderr:--- end dump of recent events --- 2024-09-14T11:13:47.389 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:13:47.391 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:47.391 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:47.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.339+0000 7f73f8263800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.340+0000 7f73f8263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.340+0000 7f73f8263800 20 realm 2024-09-14T11:13:47.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.340+0000 7f73f8263800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.341+0000 7f73f8263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.341+0000 7f73f8263800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:47.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.341+0000 7f73f8263800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.341+0000 7f73f8263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.341+0000 7f73f8263800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.341+0000 7f73f8263800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:47.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.341+0000 7f73f8263800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.342+0000 7f73f8263800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:47.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.342+0000 7f73f8263800 20 searching for the correct realm 2024-09-14T11:13:47.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.344+0000 7f73f5d54640 0 -- 172.21.15.50:0/2192435825 >> [v2:172.21.15.50:6800/2565843969,v1:172.21.15.50:6801/2565843969] conn(0x563ed3abdca0 msgr2=0x563ed3ac0090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:47.392 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.348+0000 7f73f5d54640 0 -- 172.21.15.50:0/2192435825 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f73f00543c0 msgr2=0x7f73f0054820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:47.553 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.555+0000 7f73f8263800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:47.553 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.555+0000 7f73f8263800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:47.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.555+0000 7f73f8263800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:47.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.555+0000 7f73f8263800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:47.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.555+0000 7f73f8263800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:47.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.555+0000 7f73f8263800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:47.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.555+0000 7f73f8263800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.555+0000 7f73f8263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.555+0000 7f73f8263800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.555+0000 7f73f8263800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:47.554 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.555+0000 7f73f8263800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.556+0000 7f73f8263800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:47.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.556+0000 7f73f8263800 20 zone default found 2024-09-14T11:13:47.555 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.556+0000 7f73f8263800 4 Realm: () 2024-09-14T11:13:47.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.556+0000 7f73f8263800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:47.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.556+0000 7f73f8263800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:47.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.556+0000 7f73f8263800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:47.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.556+0000 7f73f8263800 20 zonegroup default 2024-09-14T11:13:47.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.556+0000 7f73f8263800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.556+0000 7f73f8263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.556+0000 7f73f8263800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.556+0000 7f73f8263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.556+0000 7f73f8263800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.557+0000 7f73f8263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.557+0000 7f73f8263800 20 started sync module instance, tier type = 2024-09-14T11:13:47.556 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.557+0000 7f73f8263800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:47.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.566+0000 7f73f8263800 20 add_watcher() i=0 2024-09-14T11:13:47.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.566+0000 7f73f8263800 20 add_watcher() i=1 2024-09-14T11:13:47.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.566+0000 7f73f8263800 20 add_watcher() i=2 2024-09-14T11:13:47.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.566+0000 7f73f8263800 20 add_watcher() i=3 2024-09-14T11:13:47.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.566+0000 7f73f8263800 20 add_watcher() i=4 2024-09-14T11:13:47.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.566+0000 7f73f8263800 20 add_watcher() i=5 2024-09-14T11:13:47.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.566+0000 7f73f8263800 20 add_watcher() i=6 2024-09-14T11:13:47.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.567+0000 7f73f8263800 20 add_watcher() i=7 2024-09-14T11:13:47.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.567+0000 7f73f8263800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:47.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.568+0000 7f72a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:47.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.569+0000 7f73f8263800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:47.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.569+0000 7f73f8263800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:47.568 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.569+0000 7f73f8263800 5 note: GC not initialized 2024-09-14T11:13:47.568 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.569+0000 7f72a67fc640 20 reqs_thread_entry: start 2024-09-14T11:13:47.568 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.569+0000 7f73f8263800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:47.568 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.569+0000 7f73f8263800 20 Filter name: none 2024-09-14T11:13:47.568 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.569+0000 7f7217fff640 20 reqs_thread_entry: start 2024-09-14T11:13:47.568 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.569+0000 7f73f8263800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.570+0000 7f73f8263800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:13:47.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.570+0000 7f73f8263800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.570+0000 7f73f8263800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:13:47.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.570+0000 7f73f8263800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:47.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.570+0000 7f73f8263800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.571+0000 7f73f8263800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:13:47.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.571+0000 7f73f8263800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.571+0000 7f73f8263800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:13:47.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.571+0000 7f73f8263800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:47.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.573+0000 7f72a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:47.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.575+0000 7f73f8263800 20 remove_watcher() i=0 2024-09-14T11:13:47.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.575+0000 7f73f8263800 2 removed watcher, disabling cache 2024-09-14T11:13:47.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.576+0000 7f73f8263800 20 remove_watcher() i=1 2024-09-14T11:13:47.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.577+0000 7f73f8263800 20 remove_watcher() i=2 2024-09-14T11:13:47.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.578+0000 7f73f8263800 20 remove_watcher() i=3 2024-09-14T11:13:47.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.579+0000 7f73f8263800 20 remove_watcher() i=4 2024-09-14T11:13:47.578 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.580+0000 7f73f8263800 20 remove_watcher() i=5 2024-09-14T11:13:47.579 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.581+0000 7f73f8263800 20 remove_watcher() i=6 2024-09-14T11:13:47.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.582+0000 7f73f8263800 20 remove_watcher() i=7 2024-09-14T11:13:47.591 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.591 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:13:47.592 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: abort-at-change-reshard-state id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:13:47.592 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:13:47.593 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:47.593 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:47.627 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:47.627 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:13:47.685 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:13:47.717 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:47.718 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:47.757 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.759+0000 7f9642131800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.760+0000 7f9642131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.760+0000 7f9642131800 20 realm 2024-09-14T11:13:47.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.760+0000 7f9642131800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.760+0000 7f9642131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.761+0000 7f9642131800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:47.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.761+0000 7f9642131800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.761+0000 7f9642131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.761+0000 7f9642131800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.761+0000 7f9642131800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:47.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.761+0000 7f9642131800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.762+0000 7f9642131800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:47.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.762+0000 7f9642131800 20 searching for the correct realm 2024-09-14T11:13:47.763 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.765+0000 7f963d598640 0 -- 172.21.15.50:0/4020275433 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f9638064bc0 msgr2=0x7f963806ed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:47.969 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.970+0000 7f963e59a640 0 -- 172.21.15.50:0/4020275433 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55922606ce90 msgr2=0x55922606f320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:47.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.974+0000 7f9642131800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:13:47.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.974+0000 7f9642131800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:47.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.974+0000 7f9642131800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:13:47.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.974+0000 7f9642131800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:47.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.974+0000 7f9642131800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:47.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.974+0000 7f9642131800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:47.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.974+0000 7f9642131800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.975+0000 7f9642131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.975+0000 7f9642131800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.975+0000 7f9642131800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:47.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.975+0000 7f9642131800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.975+0000 7f9642131800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:47.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.975+0000 7f9642131800 20 zone default found 2024-09-14T11:13:47.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.975+0000 7f9642131800 4 Realm: () 2024-09-14T11:13:47.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.975+0000 7f9642131800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:13:47.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.975+0000 7f9642131800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:13:47.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.975+0000 7f9642131800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:47.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.975+0000 7f9642131800 20 zonegroup default 2024-09-14T11:13:47.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.975+0000 7f9642131800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.976+0000 7f9642131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.976+0000 7f9642131800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.976+0000 7f9642131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.976+0000 7f9642131800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.976+0000 7f9642131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.976+0000 7f9642131800 20 started sync module instance, tier type = 2024-09-14T11:13:47.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.976+0000 7f9642131800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:13:47.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.985+0000 7f9642131800 20 add_watcher() i=0 2024-09-14T11:13:47.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.985+0000 7f9642131800 20 add_watcher() i=1 2024-09-14T11:13:47.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.985+0000 7f9642131800 20 add_watcher() i=2 2024-09-14T11:13:47.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.985+0000 7f9642131800 20 add_watcher() i=3 2024-09-14T11:13:47.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.985+0000 7f9642131800 20 add_watcher() i=4 2024-09-14T11:13:47.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.985+0000 7f9642131800 20 add_watcher() i=5 2024-09-14T11:13:47.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.985+0000 7f9642131800 20 add_watcher() i=6 2024-09-14T11:13:47.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.986+0000 7f9642131800 20 add_watcher() i=7 2024-09-14T11:13:47.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.986+0000 7f9642131800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:47.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.988+0000 7f94ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:47.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.988+0000 7f9642131800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:47.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.988+0000 7f9642131800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:47.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.988+0000 7f9642131800 5 note: GC not initialized 2024-09-14T11:13:47.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.989+0000 7f94ee7fc640 20 reqs_thread_entry: start 2024-09-14T11:13:47.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.989+0000 7f9642131800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:47.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.989+0000 7f9642131800 20 Filter name: none 2024-09-14T11:13:47.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.989+0000 7f9463fff640 20 reqs_thread_entry: start 2024-09-14T11:13:47.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.989+0000 7f9642131800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:13:47.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.989+0000 7f9642131800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.989+0000 7f9642131800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:13:47.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.990+0000 7f9642131800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:13:47.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.990+0000 7f9642131800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:13:47.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.990+0000 7f9642131800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 : miss 2024-09-14T11:13:47.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.990+0000 7f9642131800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.990+0000 7f9642131800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:13:47.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.990+0000 7f9642131800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 info.flags=0x17 2024-09-14T11:13:47.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.990+0000 7f9642131800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 to cache LRU end 2024-09-14T11:13:47.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.990+0000 7f9642131800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:47.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.990+0000 7f9642131800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:13:47.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.990+0000 7f9642131800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 2024-09-14T11:13:47.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.991+0000 7f9642131800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 to be held by another RGW process; skipping for now 2024-09-14T11:13:47.990 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.992+0000 7f94ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:47.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.995+0000 7f9642131800 20 remove_watcher() i=0 2024-09-14T11:13:47.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.995+0000 7f9642131800 2 removed watcher, disabling cache 2024-09-14T11:13:47.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.996+0000 7f9642131800 20 remove_watcher() i=1 2024-09-14T11:13:47.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.997+0000 7f9642131800 20 remove_watcher() i=2 2024-09-14T11:13:47.996 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.998+0000 7f9642131800 20 remove_watcher() i=3 2024-09-14T11:13:47.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:47.999+0000 7f9642131800 20 remove_watcher() i=4 2024-09-14T11:13:47.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:48.000+0000 7f9642131800 20 remove_watcher() i=5 2024-09-14T11:13:47.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:48.000+0000 7f9642131800 20 remove_watcher() i=6 2024-09-14T11:13:47.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:13:48.001+0000 7f9642131800 20 remove_watcher() i=7 2024-09-14T11:13:48.010 INFO:tasks.workunit.client.0.smithi050.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:14:18.043 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:14:18.081 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:18.081 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:18.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.126+0000 7fe201323800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.127 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.128+0000 7fe201323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:18.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.128+0000 7fe201323800 20 realm 2024-09-14T11:14:18.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.128+0000 7fe201323800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.128+0000 7fe201323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:18.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.128+0000 7fe201323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:18.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.128+0000 7fe201323800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.129+0000 7fe201323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:18.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.129+0000 7fe201323800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.129 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.129+0000 7fe201323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:18.129 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.129+0000 7fe201323800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.129 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.130+0000 7fe201323800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:18.129 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.130+0000 7fe201323800 20 searching for the correct realm 2024-09-14T11:14:18.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.134+0000 7fe1f7fff640 0 -- 172.21.15.50:0/354774528 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fe1f8055920 msgr2=0x7fe1f80763f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:18.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.340+0000 7fe1fd80d640 0 -- 172.21.15.50:0/354774528 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55871c399df0 msgr2=0x55871c39c290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:18.344 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.345+0000 7fe201323800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:14:18.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.345+0000 7fe201323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:18.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.345+0000 7fe201323800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:14:18.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.345+0000 7fe201323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:18.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.345+0000 7fe201323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:18.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.345+0000 7fe201323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:18.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.345+0000 7fe201323800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.345+0000 7fe201323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:18.345 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.345+0000 7fe201323800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.346 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.346+0000 7fe201323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:18.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.346+0000 7fe201323800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.346+0000 7fe201323800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:18.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.346+0000 7fe201323800 20 zone default found 2024-09-14T11:14:18.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.346+0000 7fe201323800 4 Realm: () 2024-09-14T11:14:18.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.346+0000 7fe201323800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:14:18.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.346+0000 7fe201323800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:14:18.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.346+0000 7fe201323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:18.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.346+0000 7fe201323800 20 zonegroup default 2024-09-14T11:14:18.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.346+0000 7fe201323800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.347+0000 7fe201323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:18.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.347+0000 7fe201323800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.347+0000 7fe201323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:18.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.347+0000 7fe201323800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.347 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.347+0000 7fe201323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:18.348 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.348+0000 7fe201323800 20 started sync module instance, tier type = 2024-09-14T11:14:18.348 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.348+0000 7fe201323800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:14:18.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.358+0000 7fe201323800 20 add_watcher() i=0 2024-09-14T11:14:18.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.358+0000 7fe201323800 20 add_watcher() i=1 2024-09-14T11:14:18.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.358+0000 7fe201323800 20 add_watcher() i=2 2024-09-14T11:14:18.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.358+0000 7fe201323800 20 add_watcher() i=3 2024-09-14T11:14:18.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.358+0000 7fe201323800 20 add_watcher() i=4 2024-09-14T11:14:18.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.358+0000 7fe201323800 20 add_watcher() i=5 2024-09-14T11:14:18.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.358+0000 7fe201323800 20 add_watcher() i=6 2024-09-14T11:14:18.359 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.360+0000 7fe201323800 20 add_watcher() i=7 2024-09-14T11:14:18.359 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.360+0000 7fe201323800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:18.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.362+0000 7fe0b3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:18.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.362+0000 7fe201323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:18.361 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.362+0000 7fe201323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:18.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.362+0000 7fe201323800 5 note: GC not initialized 2024-09-14T11:14:18.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.363+0000 7fe0b2fe5640 20 reqs_thread_entry: start 2024-09-14T11:14:18.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.363+0000 7fe201323800 20 init_complete bucket index max shards: 11 2024-09-14T11:14:18.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.363+0000 7fe201323800 20 Filter name: none 2024-09-14T11:14:18.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.363+0000 7fe0b0fe1640 20 reqs_thread_entry: start 2024-09-14T11:14:18.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.363+0000 7fe201323800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:14:18.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.363+0000 7fe201323800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.364+0000 7fe201323800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:14:18.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.364+0000 7fe201323800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:14:18.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.364+0000 7fe201323800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:14:18.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.364+0000 7fe201323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 : miss 2024-09-14T11:14:18.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.364+0000 7fe201323800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.364+0000 7fe201323800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:14:18.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.364+0000 7fe201323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 info.flags=0x17 2024-09-14T11:14:18.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.364+0000 7fe201323800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 to cache LRU end 2024-09-14T11:14:18.364 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.364+0000 7fe201323800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:18.365 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.364+0000 7fe201323800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:14:18.365 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.364+0000 7fe201323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 2024-09-14T11:14:18.365 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.366+0000 7fe201323800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:14:18.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.373+0000 7fe201323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 info.flags=0x17 2024-09-14T11:14:18.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.373+0000 7fe201323800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 to cache LRU end 2024-09-14T11:14:18.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.373+0000 7fe201323800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:14:18.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.373+0000 7fe201323800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40, ofs0, ns] 2024-09-14T11:14:18.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.374+0000 7fe0e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496992 cookie 94038782551952 notifier 7583 bl.length()=1015 2024-09-14T11:14:18.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.374+0000 7fe0e0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 info.flags=0x17 2024-09-14T11:14:18.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.374+0000 7fe0e0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 to cache LRU end 2024-09-14T11:14:18.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.374+0000 7fe0e0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:14:18.375 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.376+0000 7fe201323800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40]): orig_sources= new_sources= 2024-09-14T11:14:18.375 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.376+0000 7fe201323800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40]): potential sources added=[] removed=[] 2024-09-14T11:14:18.375 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.376+0000 7fe201323800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40]): orig_dests= new_dests= 2024-09-14T11:14:18.375 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.376+0000 7fe201323800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40]): potential dests added=[] removed=[] 2024-09-14T11:14:18.381 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2.0 2024-09-14T11:14:18.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2.0 2024-09-14T11:14:18.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2.1 2024-09-14T11:14:18.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2.1 2024-09-14T11:14:18.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2.2 2024-09-14T11:14:18.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2.2 2024-09-14T11:14:18.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2.3 2024-09-14T11:14:18.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2.3 2024-09-14T11:14:18.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2.4 2024-09-14T11:14:18.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2.4 2024-09-14T11:14:18.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2.5 2024-09-14T11:14:18.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2.5 2024-09-14T11:14:18.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2.6 2024-09-14T11:14:18.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2.6 2024-09-14T11:14:18.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2.7 2024-09-14T11:14:18.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2.7 2024-09-14T11:14:18.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2.8 2024-09-14T11:14:18.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2.8 2024-09-14T11:14:18.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2.9 2024-09-14T11:14:18.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2.9 2024-09-14T11:14:18.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2.10 2024-09-14T11:14:18.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2.10 2024-09-14T11:14:18.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2.11 2024-09-14T11:14:18.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2.11 2024-09-14T11:14:18.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.382+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.0 2024-09-14T11:14:18.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.383+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1 2024-09-14T11:14:18.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.383+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2 2024-09-14T11:14:18.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.384+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.3 2024-09-14T11:14:18.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.385+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.4 2024-09-14T11:14:18.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.386+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.5 2024-09-14T11:14:18.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.386+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.6 2024-09-14T11:14:18.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.387+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.7 2024-09-14T11:14:18.387 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.388+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.8 2024-09-14T11:14:18.387 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.388+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.9 2024-09-14T11:14:18.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.389+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.10 2024-09-14T11:14:18.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.392+0000 7fe201323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 : hit (requested=0x17, cached=0x17) 2024-09-14T11:14:18.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.392+0000 7fe201323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 2024-09-14T11:14:18.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.393+0000 7fe201323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 info.flags=0x17 2024-09-14T11:14:18.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.393+0000 7fe201323800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 to cache LRU end 2024-09-14T11:14:18.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.393+0000 7fe201323800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:14:18.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.393+0000 7fe201323800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40, ofs0, ns] 2024-09-14T11:14:18.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.394+0000 7fe0cffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496993 cookie 94038782551952 notifier 7583 bl.length()=1015 2024-09-14T11:14:18.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.394+0000 7fe0cffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 info.flags=0x17 2024-09-14T11:14:18.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.394+0000 7fe0cffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 to cache LRU end 2024-09-14T11:14:18.393 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.394+0000 7fe0cffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:14:18.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.396+0000 7fe201323800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40]): orig_sources= new_sources= 2024-09-14T11:14:18.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.396+0000 7fe201323800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40]): potential sources added=[] removed=[] 2024-09-14T11:14:18.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.396+0000 7fe201323800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40]): orig_dests= new_dests= 2024-09-14T11:14:18.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.396+0000 7fe201323800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40]): potential dests added=[] removed=[] 2024-09-14T11:14:18.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.398+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.0 2024-09-14T11:14:18.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.399+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.1 2024-09-14T11:14:18.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.399+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.2 2024-09-14T11:14:18.398 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.399+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.3 2024-09-14T11:14:18.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.400+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.4 2024-09-14T11:14:18.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.400+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.5 2024-09-14T11:14:18.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.400+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.6 2024-09-14T11:14:18.400 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.401+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.7 2024-09-14T11:14:18.400 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.401+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.8 2024-09-14T11:14:18.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.402+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.9 2024-09-14T11:14:18.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.402+0000 7fe201323800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40.10 2024-09-14T11:14:18.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.402+0000 7fe201323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 : hit (requested=0x17, cached=0x17) 2024-09-14T11:14:18.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.402+0000 7fe201323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 2024-09-14T11:14:18.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.404+0000 7fe201323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 info.flags=0x17 2024-09-14T11:14:18.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.404+0000 7fe201323800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 to cache LRU end 2024-09-14T11:14:18.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.404+0000 7fe201323800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:14:18.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.404+0000 7fe201323800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40, ofs0, ns] 2024-09-14T11:14:18.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.404+0000 7fe0e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496994 cookie 94038782551952 notifier 7583 bl.length()=983 2024-09-14T11:14:18.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.404+0000 7fe0e0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 info.flags=0x17 2024-09-14T11:14:18.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.404+0000 7fe0e0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 to cache LRU end 2024-09-14T11:14:18.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.404+0000 7fe0e0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:14:18.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.406+0000 7fe201323800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40]): orig_sources= new_sources= 2024-09-14T11:14:18.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.406+0000 7fe201323800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40]): potential sources added=[] removed=[] 2024-09-14T11:14:18.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.406+0000 7fe201323800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40]): orig_dests= new_dests= 2024-09-14T11:14:18.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.406+0000 7fe201323800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40]): potential dests added=[] removed=[] 2024-09-14T11:14:18.407 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.408+0000 7fe201323800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:14:18.409 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.410+0000 7fe0b3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:18.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.413+0000 7fe201323800 20 remove_watcher() i=0 2024-09-14T11:14:18.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.413+0000 7fe201323800 2 removed watcher, disabling cache 2024-09-14T11:14:18.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.414+0000 7fe201323800 20 remove_watcher() i=1 2024-09-14T11:14:18.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.415+0000 7fe201323800 20 remove_watcher() i=2 2024-09-14T11:14:18.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.416+0000 7fe201323800 20 remove_watcher() i=3 2024-09-14T11:14:18.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.417+0000 7fe201323800 20 remove_watcher() i=4 2024-09-14T11:14:18.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.418+0000 7fe201323800 20 remove_watcher() i=5 2024-09-14T11:14:18.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.419+0000 7fe201323800 20 remove_watcher() i=6 2024-09-14T11:14:18.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.421+0000 7fe201323800 20 remove_watcher() i=7 2024-09-14T11:14:18.434 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:14:18.465 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:18.465 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:18.506 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.506+0000 7ff944412800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.508+0000 7ff944412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:18.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.508+0000 7ff944412800 20 realm 2024-09-14T11:14:18.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.508+0000 7ff944412800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.509+0000 7ff944412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:18.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.509+0000 7ff944412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:18.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.509+0000 7ff944412800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.509+0000 7ff944412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:18.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.509+0000 7ff944412800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.510+0000 7ff944412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:18.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.510+0000 7ff944412800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.510 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.510+0000 7ff944412800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:18.510 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.510+0000 7ff944412800 20 searching for the correct realm 2024-09-14T11:14:18.513 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.513+0000 7ff93f3df640 0 -- 172.21.15.50:0/3095245879 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7ff93803c900 msgr2=0x7ff93806a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:18.718 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.719+0000 7ff93f3df640 0 -- 172.21.15.50:0/3095245879 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5637f5f46250 msgr2=0x5637f5f486c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:18.722 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.723+0000 7ff944412800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:14:18.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.723+0000 7ff944412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:18.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.723+0000 7ff944412800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:14:18.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.723+0000 7ff944412800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:18.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.723+0000 7ff944412800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:18.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.723+0000 7ff944412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:18.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.723+0000 7ff944412800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.723+0000 7ff944412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:18.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.723+0000 7ff944412800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.723+0000 7ff944412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:18.723 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.723+0000 7ff944412800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.724 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.724+0000 7ff944412800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:18.724 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.724+0000 7ff944412800 20 zone default found 2024-09-14T11:14:18.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.724+0000 7ff944412800 4 Realm: () 2024-09-14T11:14:18.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.724+0000 7ff944412800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:14:18.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.724+0000 7ff944412800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:14:18.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.724+0000 7ff944412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:18.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.724+0000 7ff944412800 20 zonegroup default 2024-09-14T11:14:18.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.724+0000 7ff944412800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.724+0000 7ff944412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:18.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.724+0000 7ff944412800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.724+0000 7ff944412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:18.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.724+0000 7ff944412800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.725+0000 7ff944412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:18.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.725+0000 7ff944412800 20 started sync module instance, tier type = 2024-09-14T11:14:18.725 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.725+0000 7ff944412800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:14:18.736 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.737+0000 7ff944412800 20 add_watcher() i=0 2024-09-14T11:14:18.736 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.737+0000 7ff944412800 20 add_watcher() i=1 2024-09-14T11:14:18.736 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.737+0000 7ff944412800 20 add_watcher() i=2 2024-09-14T11:14:18.736 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.737+0000 7ff944412800 20 add_watcher() i=3 2024-09-14T11:14:18.736 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.737+0000 7ff944412800 20 add_watcher() i=4 2024-09-14T11:14:18.736 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.737+0000 7ff944412800 20 add_watcher() i=5 2024-09-14T11:14:18.736 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.737+0000 7ff944412800 20 add_watcher() i=6 2024-09-14T11:14:18.737 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.738+0000 7ff944412800 20 add_watcher() i=7 2024-09-14T11:14:18.737 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.738+0000 7ff944412800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:18.739 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.740+0000 7ff7f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:18.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.740+0000 7ff944412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:18.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.740+0000 7ff944412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:18.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.740+0000 7ff944412800 5 note: GC not initialized 2024-09-14T11:14:18.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.740+0000 7ff7f4fe1640 20 reqs_thread_entry: start 2024-09-14T11:14:18.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.740+0000 7ff944412800 20 init_complete bucket index max shards: 11 2024-09-14T11:14:18.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.741+0000 7ff944412800 20 Filter name: none 2024-09-14T11:14:18.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.741+0000 7ff76e7fc640 20 reqs_thread_entry: start 2024-09-14T11:14:18.740 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.741+0000 7ff944412800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.741+0000 7ff944412800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:14:18.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.741+0000 7ff944412800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.742+0000 7ff944412800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:14:18.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.742+0000 7ff944412800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:18.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.742+0000 7ff944412800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.741 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.742+0000 7ff944412800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:14:18.742 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.742+0000 7ff944412800 20 rados->read ofs=0 len=0 2024-09-14T11:14:18.742 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.742+0000 7ff944412800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:14:18.742 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.742+0000 7ff944412800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:18.743 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.744+0000 7ff7f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:18.746 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.747+0000 7ff944412800 20 remove_watcher() i=0 2024-09-14T11:14:18.746 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.747+0000 7ff944412800 2 removed watcher, disabling cache 2024-09-14T11:14:18.747 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.748+0000 7ff944412800 20 remove_watcher() i=1 2024-09-14T11:14:18.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.749+0000 7ff944412800 20 remove_watcher() i=2 2024-09-14T11:14:18.749 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.750+0000 7ff944412800 20 remove_watcher() i=3 2024-09-14T11:14:18.750 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.751+0000 7ff944412800 20 remove_watcher() i=4 2024-09-14T11:14:18.751 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.752+0000 7ff944412800 20 remove_watcher() i=5 2024-09-14T11:14:18.752 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.753+0000 7ff944412800 20 remove_watcher() i=6 2024-09-14T11:14:18.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:18.754+0000 7ff944412800 20 remove_watcher() i=7 2024-09-14T11:14:18.765 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:18.765 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:14:18.765 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: abort-at-change-reshard-state id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:14:18.765 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:18.767 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:18.767 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:14:18.786 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:18.787 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:14:19.011 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:19.011 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:14:19.147 INFO:tasks.workunit.client.0.smithi050.stderr: test: logrecord could be stopped after reshard failed 2024-09-14T11:14:19.149 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:14:19.178 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:19.178 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:19.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.219+0000 7f6bd1130800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.221+0000 7f6bd1130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:19.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.221+0000 7f6bd1130800 20 realm 2024-09-14T11:14:19.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.221+0000 7f6bd1130800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.221+0000 7f6bd1130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:19.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.221+0000 7f6bd1130800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:19.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.221+0000 7f6bd1130800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.221+0000 7f6bd1130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:19.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.221+0000 7f6bd1130800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.222+0000 7f6bd1130800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:19.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.222+0000 7f6bd1130800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.223+0000 7f6bd1130800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:19.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.223+0000 7f6bd1130800 20 searching for the correct realm 2024-09-14T11:14:19.224 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.225+0000 7f6bcc5bb640 0 -- 172.21.15.50:0/1705068517 >> [v2:172.21.15.50:6816/1957449887,v1:172.21.15.50:6817/1957449887] conn(0x56099ebeb500 msgr2=0x56099ebed8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:19.227 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.228+0000 7f6bccdbc640 0 -- 172.21.15.50:0/1705068517 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f6bc4056040 msgr2=0x7f6bc40b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:19.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.434+0000 7f6bd1130800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:14:19.436 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.434+0000 7f6bd1130800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:19.436 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.434+0000 7f6bd1130800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:14:19.436 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.434+0000 7f6bd1130800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:19.436 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.434+0000 7f6bd1130800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:19.436 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.434+0000 7f6bd1130800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:19.436 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.434+0000 7f6bd1130800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.436 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.434+0000 7f6bd1130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:19.436 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.434+0000 7f6bd1130800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.436 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.435+0000 7f6bd1130800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:19.436 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.435+0000 7f6bd1130800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.435+0000 7f6bd1130800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:19.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.435+0000 7f6bd1130800 20 zone default found 2024-09-14T11:14:19.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.435+0000 7f6bd1130800 4 Realm: () 2024-09-14T11:14:19.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.435+0000 7f6bd1130800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:14:19.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.435+0000 7f6bd1130800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:14:19.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.435+0000 7f6bd1130800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:19.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.435+0000 7f6bd1130800 20 zonegroup default 2024-09-14T11:14:19.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.435+0000 7f6bd1130800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.435+0000 7f6bd1130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:19.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.435+0000 7f6bd1130800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.436+0000 7f6bd1130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:19.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.436+0000 7f6bd1130800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.436+0000 7f6bd1130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:19.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.436+0000 7f6bd1130800 20 started sync module instance, tier type = 2024-09-14T11:14:19.438 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.436+0000 7f6bd1130800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:14:19.444 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.445+0000 7f6bd1130800 20 add_watcher() i=0 2024-09-14T11:14:19.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.445+0000 7f6bd1130800 20 add_watcher() i=1 2024-09-14T11:14:19.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.445+0000 7f6bd1130800 20 add_watcher() i=2 2024-09-14T11:14:19.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.445+0000 7f6bd1130800 20 add_watcher() i=3 2024-09-14T11:14:19.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.445+0000 7f6bd1130800 20 add_watcher() i=4 2024-09-14T11:14:19.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.445+0000 7f6bd1130800 20 add_watcher() i=5 2024-09-14T11:14:19.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.445+0000 7f6bd1130800 20 add_watcher() i=6 2024-09-14T11:14:19.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.446+0000 7f6bd1130800 20 add_watcher() i=7 2024-09-14T11:14:19.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.446+0000 7f6bd1130800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:19.447 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.448+0000 7f6a837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:19.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.448+0000 7f6bd1130800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:19.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.448+0000 7f6bd1130800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:19.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.448+0000 7f6bd1130800 5 note: GC not initialized 2024-09-14T11:14:19.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.448+0000 7f6a827e4640 20 reqs_thread_entry: start 2024-09-14T11:14:19.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.449+0000 7f6bd1130800 20 init_complete bucket index max shards: 11 2024-09-14T11:14:19.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.449+0000 7f6bd1130800 20 Filter name: none 2024-09-14T11:14:19.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.449+0000 7f6a7bfff640 20 reqs_thread_entry: start 2024-09-14T11:14:19.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.449+0000 7f6bd1130800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.449+0000 7f6bd1130800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:14:19.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.449+0000 7f6bd1130800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.450+0000 7f6bd1130800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:14:19.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.450+0000 7f6bd1130800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:19.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.450+0000 7f6bd1130800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.450+0000 7f6bd1130800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:14:19.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.450+0000 7f6bd1130800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.450+0000 7f6bd1130800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:14:19.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.450+0000 7f6bd1130800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:19.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.452+0000 7f6a837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:19.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.454+0000 7f6bd1130800 20 remove_watcher() i=0 2024-09-14T11:14:19.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.454+0000 7f6bd1130800 2 removed watcher, disabling cache 2024-09-14T11:14:19.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.455+0000 7f6bd1130800 20 remove_watcher() i=1 2024-09-14T11:14:19.455 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.456+0000 7f6bd1130800 20 remove_watcher() i=2 2024-09-14T11:14:19.456 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.457+0000 7f6bd1130800 20 remove_watcher() i=3 2024-09-14T11:14:19.457 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.458+0000 7f6bd1130800 20 remove_watcher() i=4 2024-09-14T11:14:19.458 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.459+0000 7f6bd1130800 20 remove_watcher() i=5 2024-09-14T11:14:19.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.460+0000 7f6bd1130800 20 remove_watcher() i=6 2024-09-14T11:14:19.460 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.461+0000 7f6bd1130800 20 remove_watcher() i=7 2024-09-14T11:14:19.471 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:19.471 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:14:19.471 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: a-bucket id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-14T11:14:19.472 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:19.473 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:14:19.502 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:19.502 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:19.542 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.543+0000 7f75da263800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.544+0000 7f75da263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:19.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.544+0000 7f75da263800 20 realm 2024-09-14T11:14:19.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.544+0000 7f75da263800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.545+0000 7f75da263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:19.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.545+0000 7f75da263800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:19.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.545+0000 7f75da263800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.545+0000 7f75da263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:19.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.545+0000 7f75da263800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.546+0000 7f75da263800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:19.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.546+0000 7f75da263800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.546+0000 7f75da263800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:19.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.546+0000 7f75da263800 20 searching for the correct realm 2024-09-14T11:14:19.548 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.549+0000 7f75d8555640 0 -- 172.21.15.50:0/1987595515 >> [v2:172.21.15.118:6816/4154782182,v1:172.21.15.118:6817/4154782182] conn(0x5561782bef70 msgr2=0x5561782c1430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:19.551 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.552+0000 7f75d7d54640 0 -- 172.21.15.50:0/1987595515 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f75d0095920 msgr2=0x7f75d0078400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:19.757 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.758+0000 7f75da263800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:14:19.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.758+0000 7f75da263800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:19.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.758+0000 7f75da263800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:14:19.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.758+0000 7f75da263800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:19.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.758+0000 7f75da263800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:19.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.758+0000 7f75da263800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:19.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.758+0000 7f75da263800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.758+0000 7f75da263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:19.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.758+0000 7f75da263800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.759+0000 7f75da263800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:19.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.759+0000 7f75da263800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.759+0000 7f75da263800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:19.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.759+0000 7f75da263800 20 zone default found 2024-09-14T11:14:19.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.759+0000 7f75da263800 4 Realm: () 2024-09-14T11:14:19.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.759+0000 7f75da263800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:14:19.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.759+0000 7f75da263800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:14:19.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.759+0000 7f75da263800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:19.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.759+0000 7f75da263800 20 zonegroup default 2024-09-14T11:14:19.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.759+0000 7f75da263800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.759+0000 7f75da263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:19.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.759+0000 7f75da263800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.760+0000 7f75da263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:19.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.760+0000 7f75da263800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.760+0000 7f75da263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:19.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.760+0000 7f75da263800 20 started sync module instance, tier type = 2024-09-14T11:14:19.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.760+0000 7f75da263800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:14:19.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.770+0000 7f75da263800 20 add_watcher() i=0 2024-09-14T11:14:19.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.770+0000 7f75da263800 20 add_watcher() i=1 2024-09-14T11:14:19.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.770+0000 7f75da263800 20 add_watcher() i=2 2024-09-14T11:14:19.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.770+0000 7f75da263800 20 add_watcher() i=3 2024-09-14T11:14:19.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.770+0000 7f75da263800 20 add_watcher() i=4 2024-09-14T11:14:19.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.770+0000 7f75da263800 20 add_watcher() i=5 2024-09-14T11:14:19.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.770+0000 7f75da263800 20 add_watcher() i=6 2024-09-14T11:14:19.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.771+0000 7f75da263800 20 add_watcher() i=7 2024-09-14T11:14:19.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.771+0000 7f75da263800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:19.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.773+0000 7f748dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:19.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.773+0000 7f75da263800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:19.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.773+0000 7f75da263800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:19.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.773+0000 7f75da263800 5 note: GC not initialized 2024-09-14T11:14:19.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.773+0000 7f748cfe1640 20 reqs_thread_entry: start 2024-09-14T11:14:19.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.773+0000 7f75da263800 20 init_complete bucket index max shards: 11 2024-09-14T11:14:19.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.773+0000 7f75da263800 20 Filter name: none 2024-09-14T11:14:19.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.774+0000 7f74067fc640 20 reqs_thread_entry: start 2024-09-14T11:14:19.773 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.774+0000 7f75da263800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.774+0000 7f75da263800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:14:19.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.774+0000 7f75da263800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.774+0000 7f75da263800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:14:19.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.774+0000 7f75da263800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:19.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.774+0000 7f75da263800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.775+0000 7f75da263800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:14:19.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.775+0000 7f75da263800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.775+0000 7f75da263800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:14:19.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.775+0000 7f75da263800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:19.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.777+0000 7f748dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:19.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.779+0000 7f75da263800 20 remove_watcher() i=0 2024-09-14T11:14:19.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.779+0000 7f75da263800 2 removed watcher, disabling cache 2024-09-14T11:14:19.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.780+0000 7f75da263800 20 remove_watcher() i=1 2024-09-14T11:14:19.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.781+0000 7f75da263800 20 remove_watcher() i=2 2024-09-14T11:14:19.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.782+0000 7f75da263800 20 remove_watcher() i=3 2024-09-14T11:14:19.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.783+0000 7f75da263800 20 remove_watcher() i=4 2024-09-14T11:14:19.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.784+0000 7f75da263800 20 remove_watcher() i=5 2024-09-14T11:14:19.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.785+0000 7f75da263800 20 remove_watcher() i=6 2024-09-14T11:14:19.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.786+0000 7f75da263800 20 remove_watcher() i=7 2024-09-14T11:14:19.798 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:14:19.833 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:19.833 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:19.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.874+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.875+0000 7f438c0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:19.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.875+0000 7f438c0b7800 20 realm 2024-09-14T11:14:19.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.875+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.876+0000 7f438c0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:19.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.876+0000 7f438c0b7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:19.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.876+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.876+0000 7f438c0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:19.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.876+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.876+0000 7f438c0b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:19.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.876+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:19.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.877+0000 7f438c0b7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:19.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.877+0000 7f438c0b7800 20 searching for the correct realm 2024-09-14T11:14:19.879 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:19.880+0000 7f43893a0640 0 -- 172.21.15.50:0/109344237 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f438406e3d0 msgr2=0x7f4384069350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:20.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.086+0000 7f438a3a2640 0 -- 172.21.15.50:0/109344237 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5596df950c20 msgr2=0x5596df953090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:20.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.090+0000 7f438c0b7800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:14:20.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.090+0000 7f438c0b7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:20.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.090+0000 7f438c0b7800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:14:20.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.090+0000 7f438c0b7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:20.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.090+0000 7f438c0b7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:20.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.090+0000 7f438c0b7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:20.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.090+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.090+0000 7f438c0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.090+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.091+0000 7f438c0b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:20.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.091+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.091+0000 7f438c0b7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:20.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.091+0000 7f438c0b7800 20 zone default found 2024-09-14T11:14:20.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.091+0000 7f438c0b7800 4 Realm: () 2024-09-14T11:14:20.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.091+0000 7f438c0b7800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:14:20.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.091+0000 7f438c0b7800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:14:20.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.091+0000 7f438c0b7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:20.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.091+0000 7f438c0b7800 20 zonegroup default 2024-09-14T11:14:20.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.091+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.092 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.091+0000 7f438c0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.092 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.091+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.092 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.091+0000 7f438c0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.092 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.091+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.092 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.092+0000 7f438c0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.092 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.092+0000 7f438c0b7800 20 started sync module instance, tier type = 2024-09-14T11:14:20.092 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.092+0000 7f438c0b7800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:14:20.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.101+0000 7f438c0b7800 20 add_watcher() i=0 2024-09-14T11:14:20.100 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.101+0000 7f438c0b7800 20 add_watcher() i=1 2024-09-14T11:14:20.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.101+0000 7f438c0b7800 20 add_watcher() i=2 2024-09-14T11:14:20.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.101+0000 7f438c0b7800 20 add_watcher() i=3 2024-09-14T11:14:20.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.101+0000 7f438c0b7800 20 add_watcher() i=4 2024-09-14T11:14:20.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.101+0000 7f438c0b7800 20 add_watcher() i=5 2024-09-14T11:14:20.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.101+0000 7f438c0b7800 20 add_watcher() i=6 2024-09-14T11:14:20.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.102+0000 7f438c0b7800 20 add_watcher() i=7 2024-09-14T11:14:20.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.102+0000 7f438c0b7800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:20.103 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.104+0000 7f423b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:20.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.104+0000 7f438c0b7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:20.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.104+0000 7f438c0b7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:20.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.104+0000 7f438c0b7800 5 note: GC not initialized 2024-09-14T11:14:20.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.105+0000 7f423a7fc640 20 reqs_thread_entry: start 2024-09-14T11:14:20.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.105+0000 7f438c0b7800 20 init_complete bucket index max shards: 11 2024-09-14T11:14:20.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.105+0000 7f438c0b7800 20 Filter name: none 2024-09-14T11:14:20.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.105+0000 7f41abfff640 20 reqs_thread_entry: start 2024-09-14T11:14:20.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.105+0000 7f438c0b7800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:14:20.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.105+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.105+0000 7f438c0b7800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:14:20.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.105+0000 7f438c0b7800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:14:20.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.105+0000 7f438c0b7800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:14:20.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.105+0000 7f438c0b7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : miss 2024-09-14T11:14:20.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.105+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.106+0000 7f438c0b7800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:14:20.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.106+0000 7f438c0b7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:14:20.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.106+0000 7f438c0b7800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:14:20.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.106+0000 7f438c0b7800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:20.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.106+0000 7f438c0b7800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:14:20.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.106+0000 7f438c0b7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:14:20.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.111+0000 7f438c0b7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:14:20.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.111+0000 7f438c0b7800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:14:20.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.111+0000 7f438c0b7800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:14:20.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.111+0000 7f438c0b7800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18, ofs0, ns] 2024-09-14T11:14:20.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.111+0000 7f426cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497131 cookie 94106484617488 notifier 7652 bl.length()=911 2024-09-14T11:14:20.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.111+0000 7f426cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:14:20.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.111+0000 7f426cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:14:20.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.111+0000 7f426cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:14:20.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.113+0000 7f438c0b7800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_sources= new_sources= 2024-09-14T11:14:20.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.113+0000 7f438c0b7800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential sources added=[] removed=[] 2024-09-14T11:14:20.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.113+0000 7f438c0b7800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_dests= new_dests= 2024-09-14T11:14:20.112 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.113+0000 7f438c0b7800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential dests added=[] removed=[] 2024-09-14T11:14:20.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.0 2024-09-14T11:14:20.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.0 2024-09-14T11:14:20.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.1 2024-09-14T11:14:20.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.1 2024-09-14T11:14:20.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.2 2024-09-14T11:14:20.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.2 2024-09-14T11:14:20.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.3 2024-09-14T11:14:20.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.3 2024-09-14T11:14:20.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.4 2024-09-14T11:14:20.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.4 2024-09-14T11:14:20.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.5 2024-09-14T11:14:20.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.5 2024-09-14T11:14:20.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.6 2024-09-14T11:14:20.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.6 2024-09-14T11:14:20.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.7 2024-09-14T11:14:20.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.7 2024-09-14T11:14:20.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.8 2024-09-14T11:14:20.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.8 2024-09-14T11:14:20.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.9 2024-09-14T11:14:20.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.9 2024-09-14T11:14:20.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.10 2024-09-14T11:14:20.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.10 2024-09-14T11:14:20.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.11 2024-09-14T11:14:20.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.11 2024-09-14T11:14:20.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.12 2024-09-14T11:14:20.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.12 2024-09-14T11:14:20.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.13 2024-09-14T11:14:20.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.13 2024-09-14T11:14:20.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:14:20.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:14:20.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.118+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:14:20.119 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.118+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:14:20.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.118+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:14:20.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.118+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:14:20.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.119+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:14:20.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.119+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:14:20.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.119+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:14:20.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.119+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:14:20.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.120+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:14:20.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.120+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:14:20.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.120+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:14:20.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.120+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:14:20.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.121+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:14:20.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.121+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:14:20.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.121+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:14:20.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.121+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:14:20.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.122+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:14:20.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.122+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:14:20.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.122+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:14:20.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.122+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:14:20.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.123+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:14:20.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.123+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:14:20.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.123+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:14:20.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.123+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:14:20.124 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f438c0b7800 time 2024-09-14T11:14:20.127083+0000 2024-09-14T11:14:20.124 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:14:20.125 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:20.125 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f438f58c76a] 2024-09-14T11:14:20.125 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f438f58c928] 2024-09-14T11:14:20.125 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5596ddbbb0b1] 2024-09-14T11:14:20.125 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5596ddbca124] 2024-09-14T11:14:20.125 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5596ddbcafc4] 2024-09-14T11:14:20.125 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:14:20.125 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f438e229590] 2024-09-14T11:14:20.126 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:14:20.126 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:14:20.126 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.126+0000 7f438c0b7800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f438c0b7800 time 2024-09-14T11:14:20.127083+0000 2024-09-14T11:14:20.126 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:14:20.126 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.126 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:20.126 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f438f58c76a] 2024-09-14T11:14:20.126 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f438f58c928] 2024-09-14T11:14:20.126 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5596ddbbb0b1] 2024-09-14T11:14:20.126 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5596ddbca124] 2024-09-14T11:14:20.126 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5596ddbcafc4] 2024-09-14T11:14:20.126 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:14:20.126 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f438e229590] 2024-09-14T11:14:20.126 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:14:20.127 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:14:20.127 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.127 INFO:tasks.workunit.client.0.smithi050.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:14:20.127 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f438c0b7800 thread_name:radosgw-admin 2024-09-14T11:14:20.142 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:20.142 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f438e23e6f0] 2024-09-14T11:14:20.142 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f438e28b99c] 2024-09-14T11:14:20.142 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:14:20.143 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:14:20.143 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f438f58c7c4] 2024-09-14T11:14:20.143 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f438f58c928] 2024-09-14T11:14:20.143 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5596ddbbb0b1] 2024-09-14T11:14:20.143 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5596ddbca124] 2024-09-14T11:14:20.143 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5596ddbcafc4] 2024-09-14T11:14:20.143 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:14:20.143 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f438e229590] 2024-09-14T11:14:20.143 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:14:20.143 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:14:20.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.127+0000 7f438c0b7800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:14:20.143 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f438c0b7800 thread_name:radosgw-admin 2024-09-14T11:14:20.143 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.144 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:20.144 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f438e23e6f0] 2024-09-14T11:14:20.144 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f438e28b99c] 2024-09-14T11:14:20.144 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:14:20.144 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:14:20.144 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f438f58c7c4] 2024-09-14T11:14:20.144 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f438f58c928] 2024-09-14T11:14:20.144 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5596ddbbb0b1] 2024-09-14T11:14:20.144 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5596ddbca124] 2024-09-14T11:14:20.144 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5596ddbcafc4] 2024-09-14T11:14:20.144 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:14:20.144 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f438e229590] 2024-09-14T11:14:20.145 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:14:20.145 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:14:20.145 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:14:20.145 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.145 INFO:tasks.workunit.client.0.smithi050.stderr:--- begin dump of recent events --- 2024-09-14T11:14:20.145 INFO:tasks.workunit.client.0.smithi050.stderr: -499> 2024-09-14T11:14:19.858+0000 7f438c0b7800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:20.145 INFO:tasks.workunit.client.0.smithi050.stderr: -498> 2024-09-14T11:14:19.858+0000 7f438c0b7800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:20.145 INFO:tasks.workunit.client.0.smithi050.stderr: -497> 2024-09-14T11:14:19.858+0000 7f438c0b7800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:20.145 INFO:tasks.workunit.client.0.smithi050.stderr: -496> 2024-09-14T11:14:19.858+0000 7f438c0b7800 10 monclient(hunting): authenticate will time out at 2512.496297s 2024-09-14T11:14:20.145 INFO:tasks.workunit.client.0.smithi050.stderr: -495> 2024-09-14T11:14:19.858+0000 7f438a3a2640 10 monclient(hunting): get_auth_request con 0x5596df866660 auth_method 0 2024-09-14T11:14:20.145 INFO:tasks.workunit.client.0.smithi050.stderr: -494> 2024-09-14T11:14:19.858+0000 7f438a3a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:20.145 INFO:tasks.workunit.client.0.smithi050.stderr: -493> 2024-09-14T11:14:19.858+0000 7f438a3a2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:20.145 INFO:tasks.workunit.client.0.smithi050.stderr: -492> 2024-09-14T11:14:19.858+0000 7f438a3a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:20.146 INFO:tasks.workunit.client.0.smithi050.stderr: -491> 2024-09-14T11:14:19.858+0000 7f4389ba1640 10 monclient(hunting): get_auth_request con 0x5596df70cd00 auth_method 0 2024-09-14T11:14:20.146 INFO:tasks.workunit.client.0.smithi050.stderr: -490> 2024-09-14T11:14:19.858+0000 7f4389ba1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:20.146 INFO:tasks.workunit.client.0.smithi050.stderr: -489> 2024-09-14T11:14:19.858+0000 7f4389ba1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:20.146 INFO:tasks.workunit.client.0.smithi050.stderr: -488> 2024-09-14T11:14:19.858+0000 7f4389ba1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:20.146 INFO:tasks.workunit.client.0.smithi050.stderr: -487> 2024-09-14T11:14:19.858+0000 7f43893a0640 10 monclient(hunting): get_auth_request con 0x5596df718c90 auth_method 0 2024-09-14T11:14:20.146 INFO:tasks.workunit.client.0.smithi050.stderr: -486> 2024-09-14T11:14:19.858+0000 7f43893a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:20.146 INFO:tasks.workunit.client.0.smithi050.stderr: -485> 2024-09-14T11:14:19.858+0000 7f43893a0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:20.146 INFO:tasks.workunit.client.0.smithi050.stderr: -484> 2024-09-14T11:14:19.858+0000 7f43893a0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:20.146 INFO:tasks.workunit.client.0.smithi050.stderr: -483> 2024-09-14T11:14:19.858+0000 7f438a3a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:20.146 INFO:tasks.workunit.client.0.smithi050.stderr: -482> 2024-09-14T11:14:19.858+0000 7f438a3a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:20.146 INFO:tasks.workunit.client.0.smithi050.stderr: -481> 2024-09-14T11:14:19.858+0000 7f438a3a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:20.146 INFO:tasks.workunit.client.0.smithi050.stderr: -480> 2024-09-14T11:14:19.858+0000 7f4389ba1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:20.146 INFO:tasks.workunit.client.0.smithi050.stderr: -479> 2024-09-14T11:14:19.858+0000 7f4389ba1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:20.147 INFO:tasks.workunit.client.0.smithi050.stderr: -478> 2024-09-14T11:14:19.858+0000 7f4389ba1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:20.147 INFO:tasks.workunit.client.0.smithi050.stderr: -477> 2024-09-14T11:14:19.858+0000 7f43893a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:20.147 INFO:tasks.workunit.client.0.smithi050.stderr: -476> 2024-09-14T11:14:19.858+0000 7f43893a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:20.147 INFO:tasks.workunit.client.0.smithi050.stderr: -475> 2024-09-14T11:14:19.858+0000 7f43893a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:20.147 INFO:tasks.workunit.client.0.smithi050.stderr: -474> 2024-09-14T11:14:19.858+0000 7f4389ba1640 10 monclient(hunting): handle_auth_done global_id 7643 payload 824 2024-09-14T11:14:20.147 INFO:tasks.workunit.client.0.smithi050.stderr: -473> 2024-09-14T11:14:19.858+0000 7f4389ba1640 10 monclient: _finish_hunting 0 2024-09-14T11:14:20.147 INFO:tasks.workunit.client.0.smithi050.stderr: -472> 2024-09-14T11:14:19.858+0000 7f4389ba1640 1 monclient: found mon.noname-c 2024-09-14T11:14:20.147 INFO:tasks.workunit.client.0.smithi050.stderr: -471> 2024-09-14T11:14:19.858+0000 7f4389ba1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:14:20.147 INFO:tasks.workunit.client.0.smithi050.stderr: -470> 2024-09-14T11:14:19.858+0000 7f4276604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:20.147 INFO:tasks.workunit.client.0.smithi050.stderr: -469> 2024-09-14T11:14:19.858+0000 7f4276604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:20.147 INFO:tasks.workunit.client.0.smithi050.stderr: -468> 2024-09-14T11:14:19.858+0000 7f4276604640 10 monclient: dump: 2024-09-14T11:14:20.148 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:20.148 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:20.148 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.148 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.148 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:20.148 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:20.148 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:20.148 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:20.148 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:20.148 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.148 INFO:tasks.workunit.client.0.smithi050.stderr: -467> 2024-09-14T11:14:19.858+0000 7f4276604640 10 monclient: _finish_auth 0 2024-09-14T11:14:20.149 INFO:tasks.workunit.client.0.smithi050.stderr: -466> 2024-09-14T11:14:19.858+0000 7f4276604640 10 monclient: _check_auth_tickets 2024-09-14T11:14:20.149 INFO:tasks.workunit.client.0.smithi050.stderr: -465> 2024-09-14T11:14:19.859+0000 7f438c0b7800 5 monclient: authenticate success, global_id 7643 2024-09-14T11:14:20.149 INFO:tasks.workunit.client.0.smithi050.stderr: -464> 2024-09-14T11:14:19.859+0000 7f438c0b7800 10 monclient: _renew_subs 2024-09-14T11:14:20.149 INFO:tasks.workunit.client.0.smithi050.stderr: -463> 2024-09-14T11:14:19.859+0000 7f438c0b7800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:20.149 INFO:tasks.workunit.client.0.smithi050.stderr: -462> 2024-09-14T11:14:19.859+0000 7f4276604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:20.149 INFO:tasks.workunit.client.0.smithi050.stderr: -461> 2024-09-14T11:14:19.859+0000 7f4276604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:20.149 INFO:tasks.workunit.client.0.smithi050.stderr: -460> 2024-09-14T11:14:19.859+0000 7f4276604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:20.149 INFO:tasks.workunit.client.0.smithi050.stderr: -459> 2024-09-14T11:14:19.859+0000 7f4276604640 10 monclient: dump: 2024-09-14T11:14:20.149 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:20.149 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:20.149 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.149 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.149 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:20.150 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:20.150 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:20.150 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:20.150 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:20.150 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.150 INFO:tasks.workunit.client.0.smithi050.stderr: -458> 2024-09-14T11:14:19.859+0000 7f4277e07640 4 set_mon_vals no callback set 2024-09-14T11:14:20.152 INFO:tasks.workunit.client.0.smithi050.stderr: -457> 2024-09-14T11:14:19.859+0000 7f438c0b7800 10 monclient: _renew_subs 2024-09-14T11:14:20.152 INFO:tasks.workunit.client.0.smithi050.stderr: -456> 2024-09-14T11:14:19.859+0000 7f438c0b7800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:20.152 INFO:tasks.workunit.client.0.smithi050.stderr: -455> 2024-09-14T11:14:19.859+0000 7f438c0b7800 1 librados: init done 2024-09-14T11:14:20.152 INFO:tasks.workunit.client.0.smithi050.stderr: -454> 2024-09-14T11:14:19.861+0000 7f4276604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:14:20.152 INFO:tasks.workunit.client.0.smithi050.stderr: -453> 2024-09-14T11:14:19.861+0000 7f4276604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:14:20.152 INFO:tasks.workunit.client.0.smithi050.stderr: -452> 2024-09-14T11:14:19.861+0000 7f4276604640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:14:20.152 INFO:tasks.workunit.client.0.smithi050.stderr: -451> 2024-09-14T11:14:19.861+0000 7f43893a0640 10 monclient: get_auth_request con 0x7f4270077260 auth_method 0 2024-09-14T11:14:20.152 INFO:tasks.workunit.client.0.smithi050.stderr: -450> 2024-09-14T11:14:19.861+0000 7f438a3a2640 10 monclient: get_auth_request con 0x5596df89ebc0 auth_method 0 2024-09-14T11:14:20.152 INFO:tasks.workunit.client.0.smithi050.stderr: -449> 2024-09-14T11:14:19.862+0000 7f4389ba1640 10 monclient: get_auth_request con 0x5596df8ab810 auth_method 0 2024-09-14T11:14:20.153 INFO:tasks.workunit.client.0.smithi050.stderr: -448> 2024-09-14T11:14:19.863+0000 7f43893a0640 10 monclient: get_auth_request con 0x5596df8afb70 auth_method 0 2024-09-14T11:14:20.153 INFO:tasks.workunit.client.0.smithi050.stderr: -447> 2024-09-14T11:14:19.864+0000 7f438c0b7800 10 monclient: build_initial_monmap 2024-09-14T11:14:20.153 INFO:tasks.workunit.client.0.smithi050.stderr: -446> 2024-09-14T11:14:19.864+0000 7f438c0b7800 1 build_initial for_mkfs: 0 2024-09-14T11:14:20.153 INFO:tasks.workunit.client.0.smithi050.stderr: -445> 2024-09-14T11:14:19.864+0000 7f438c0b7800 10 monclient: monmap: 2024-09-14T11:14:20.153 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:14:20.153 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:20.153 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:14:20.153 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:14:20.153 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:20.153 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:20.153 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:14:20.154 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:14:20.154 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:14:20.154 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.154 INFO:tasks.workunit.client.0.smithi050.stderr: -444> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding auth protocol: cephx 2024-09-14T11:14:20.154 INFO:tasks.workunit.client.0.smithi050.stderr: -443> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding auth protocol: cephx 2024-09-14T11:14:20.154 INFO:tasks.workunit.client.0.smithi050.stderr: -442> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding auth protocol: cephx 2024-09-14T11:14:20.154 INFO:tasks.workunit.client.0.smithi050.stderr: -441> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding con mode: secure 2024-09-14T11:14:20.154 INFO:tasks.workunit.client.0.smithi050.stderr: -440> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding con mode: crc 2024-09-14T11:14:20.154 INFO:tasks.workunit.client.0.smithi050.stderr: -439> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding con mode: secure 2024-09-14T11:14:20.154 INFO:tasks.workunit.client.0.smithi050.stderr: -438> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding con mode: crc 2024-09-14T11:14:20.155 INFO:tasks.workunit.client.0.smithi050.stderr: -437> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding con mode: secure 2024-09-14T11:14:20.155 INFO:tasks.workunit.client.0.smithi050.stderr: -436> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding con mode: crc 2024-09-14T11:14:20.155 INFO:tasks.workunit.client.0.smithi050.stderr: -435> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding con mode: crc 2024-09-14T11:14:20.155 INFO:tasks.workunit.client.0.smithi050.stderr: -434> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding con mode: secure 2024-09-14T11:14:20.155 INFO:tasks.workunit.client.0.smithi050.stderr: -433> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding con mode: crc 2024-09-14T11:14:20.155 INFO:tasks.workunit.client.0.smithi050.stderr: -432> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding con mode: secure 2024-09-14T11:14:20.155 INFO:tasks.workunit.client.0.smithi050.stderr: -431> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding con mode: crc 2024-09-14T11:14:20.155 INFO:tasks.workunit.client.0.smithi050.stderr: -430> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding con mode: secure 2024-09-14T11:14:20.155 INFO:tasks.workunit.client.0.smithi050.stderr: -429> 2024-09-14T11:14:19.864+0000 7f438c0b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:20.155 INFO:tasks.workunit.client.0.smithi050.stderr: -428> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command objecter_requests cmddesc objecter_requests hook 0x5596df8b8020 EEXIST 2024-09-14T11:14:20.155 INFO:tasks.workunit.client.0.smithi050.stderr: -427> 2024-09-14T11:14:19.864+0000 7f438c0b7800 10 monclient: init 2024-09-14T11:14:20.155 INFO:tasks.workunit.client.0.smithi050.stderr: -426> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding auth protocol: cephx 2024-09-14T11:14:20.156 INFO:tasks.workunit.client.0.smithi050.stderr: -425> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding auth protocol: cephx 2024-09-14T11:14:20.156 INFO:tasks.workunit.client.0.smithi050.stderr: -424> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding auth protocol: cephx 2024-09-14T11:14:20.156 INFO:tasks.workunit.client.0.smithi050.stderr: -423> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding con mode: secure 2024-09-14T11:14:20.156 INFO:tasks.workunit.client.0.smithi050.stderr: -422> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding con mode: crc 2024-09-14T11:14:20.156 INFO:tasks.workunit.client.0.smithi050.stderr: -421> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding con mode: secure 2024-09-14T11:14:20.156 INFO:tasks.workunit.client.0.smithi050.stderr: -420> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding con mode: crc 2024-09-14T11:14:20.156 INFO:tasks.workunit.client.0.smithi050.stderr: -419> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding con mode: secure 2024-09-14T11:14:20.156 INFO:tasks.workunit.client.0.smithi050.stderr: -418> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding con mode: crc 2024-09-14T11:14:20.156 INFO:tasks.workunit.client.0.smithi050.stderr: -417> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding con mode: crc 2024-09-14T11:14:20.156 INFO:tasks.workunit.client.0.smithi050.stderr: -416> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding con mode: secure 2024-09-14T11:14:20.156 INFO:tasks.workunit.client.0.smithi050.stderr: -415> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding con mode: crc 2024-09-14T11:14:20.156 INFO:tasks.workunit.client.0.smithi050.stderr: -414> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding con mode: secure 2024-09-14T11:14:20.156 INFO:tasks.workunit.client.0.smithi050.stderr: -413> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding con mode: crc 2024-09-14T11:14:20.157 INFO:tasks.workunit.client.0.smithi050.stderr: -412> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding con mode: secure 2024-09-14T11:14:20.157 INFO:tasks.workunit.client.0.smithi050.stderr: -411> 2024-09-14T11:14:19.865+0000 7f438c0b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:20.157 INFO:tasks.workunit.client.0.smithi050.stderr: -410> 2024-09-14T11:14:19.865+0000 7f438c0b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:20.157 INFO:tasks.workunit.client.0.smithi050.stderr: -409> 2024-09-14T11:14:19.865+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command rotate-key cmddesc rotate-key hook 0x5596df8b31e0 EEXIST 2024-09-14T11:14:20.157 INFO:tasks.workunit.client.0.smithi050.stderr: -408> 2024-09-14T11:14:19.865+0000 7f438c0b7800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:20.157 INFO:tasks.workunit.client.0.smithi050.stderr: -407> 2024-09-14T11:14:19.865+0000 7f438c0b7800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:14:20.157 INFO:tasks.workunit.client.0.smithi050.stderr: -406> 2024-09-14T11:14:19.865+0000 7f438c0b7800 10 monclient(hunting): picked mon.noname-b con 0x5596df8dc340 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:14:20.157 INFO:tasks.workunit.client.0.smithi050.stderr: -405> 2024-09-14T11:14:19.865+0000 7f438c0b7800 10 monclient(hunting): picked mon.noname-a con 0x5596df8de2c0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:14:20.157 INFO:tasks.workunit.client.0.smithi050.stderr: -404> 2024-09-14T11:14:19.865+0000 7f438c0b7800 10 monclient(hunting): picked mon.noname-c con 0x5596df8f3df0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:14:20.157 INFO:tasks.workunit.client.0.smithi050.stderr: -403> 2024-09-14T11:14:19.865+0000 7f438c0b7800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:20.157 INFO:tasks.workunit.client.0.smithi050.stderr: -402> 2024-09-14T11:14:19.865+0000 7f438c0b7800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:20.157 INFO:tasks.workunit.client.0.smithi050.stderr: -401> 2024-09-14T11:14:19.865+0000 7f438c0b7800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:20.158 INFO:tasks.workunit.client.0.smithi050.stderr: -400> 2024-09-14T11:14:19.865+0000 7f438c0b7800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:20.158 INFO:tasks.workunit.client.0.smithi050.stderr: -399> 2024-09-14T11:14:19.865+0000 7f438c0b7800 10 monclient(hunting): authenticate will time out at 2512.503421s 2024-09-14T11:14:20.158 INFO:tasks.workunit.client.0.smithi050.stderr: -398> 2024-09-14T11:14:19.865+0000 7f438a3a2640 10 monclient(hunting): get_auth_request con 0x5596df8f3df0 auth_method 0 2024-09-14T11:14:20.158 INFO:tasks.workunit.client.0.smithi050.stderr: -397> 2024-09-14T11:14:19.865+0000 7f438a3a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:20.158 INFO:tasks.workunit.client.0.smithi050.stderr: -396> 2024-09-14T11:14:19.865+0000 7f438a3a2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:20.158 INFO:tasks.workunit.client.0.smithi050.stderr: -395> 2024-09-14T11:14:19.865+0000 7f438a3a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:20.158 INFO:tasks.workunit.client.0.smithi050.stderr: -394> 2024-09-14T11:14:19.865+0000 7f43893a0640 10 monclient(hunting): get_auth_request con 0x5596df8de2c0 auth_method 0 2024-09-14T11:14:20.158 INFO:tasks.workunit.client.0.smithi050.stderr: -393> 2024-09-14T11:14:19.865+0000 7f43893a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:20.158 INFO:tasks.workunit.client.0.smithi050.stderr: -392> 2024-09-14T11:14:19.865+0000 7f43893a0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:20.158 INFO:tasks.workunit.client.0.smithi050.stderr: -391> 2024-09-14T11:14:19.865+0000 7f43893a0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:20.159 INFO:tasks.workunit.client.0.smithi050.stderr: -390> 2024-09-14T11:14:19.865+0000 7f4389ba1640 10 monclient(hunting): get_auth_request con 0x5596df8dc340 auth_method 0 2024-09-14T11:14:20.159 INFO:tasks.workunit.client.0.smithi050.stderr: -389> 2024-09-14T11:14:19.865+0000 7f4389ba1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:20.159 INFO:tasks.workunit.client.0.smithi050.stderr: -388> 2024-09-14T11:14:19.865+0000 7f4389ba1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:20.159 INFO:tasks.workunit.client.0.smithi050.stderr: -387> 2024-09-14T11:14:19.865+0000 7f4389ba1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:20.159 INFO:tasks.workunit.client.0.smithi050.stderr: -386> 2024-09-14T11:14:19.865+0000 7f438a3a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:20.159 INFO:tasks.workunit.client.0.smithi050.stderr: -385> 2024-09-14T11:14:19.865+0000 7f438a3a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:20.159 INFO:tasks.workunit.client.0.smithi050.stderr: -384> 2024-09-14T11:14:19.865+0000 7f438a3a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:20.159 INFO:tasks.workunit.client.0.smithi050.stderr: -383> 2024-09-14T11:14:19.865+0000 7f43893a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:20.159 INFO:tasks.workunit.client.0.smithi050.stderr: -382> 2024-09-14T11:14:19.865+0000 7f43893a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:20.159 INFO:tasks.workunit.client.0.smithi050.stderr: -381> 2024-09-14T11:14:19.865+0000 7f43893a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:20.159 INFO:tasks.workunit.client.0.smithi050.stderr: -380> 2024-09-14T11:14:19.865+0000 7f4389ba1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:20.159 INFO:tasks.workunit.client.0.smithi050.stderr: -379> 2024-09-14T11:14:19.865+0000 7f4389ba1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:20.159 INFO:tasks.workunit.client.0.smithi050.stderr: -378> 2024-09-14T11:14:19.865+0000 7f4389ba1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:20.159 INFO:tasks.workunit.client.0.smithi050.stderr: -377> 2024-09-14T11:14:19.865+0000 7f438a3a2640 10 monclient(hunting): handle_auth_done global_id 7646 payload 824 2024-09-14T11:14:20.160 INFO:tasks.workunit.client.0.smithi050.stderr: -376> 2024-09-14T11:14:19.865+0000 7f438a3a2640 10 monclient: _finish_hunting 0 2024-09-14T11:14:20.160 INFO:tasks.workunit.client.0.smithi050.stderr: -375> 2024-09-14T11:14:19.865+0000 7f438a3a2640 1 monclient: found mon.noname-c 2024-09-14T11:14:20.160 INFO:tasks.workunit.client.0.smithi050.stderr: -374> 2024-09-14T11:14:19.865+0000 7f438a3a2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:14:20.160 INFO:tasks.workunit.client.0.smithi050.stderr: -373> 2024-09-14T11:14:19.866+0000 7f426f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:20.160 INFO:tasks.workunit.client.0.smithi050.stderr: -372> 2024-09-14T11:14:19.866+0000 7f426f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:20.160 INFO:tasks.workunit.client.0.smithi050.stderr: -371> 2024-09-14T11:14:19.866+0000 7f426f7fe640 10 monclient: dump: 2024-09-14T11:14:20.160 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:20.160 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:20.160 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.160 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.160 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:20.160 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:20.161 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:20.161 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:20.161 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:20.161 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.161 INFO:tasks.workunit.client.0.smithi050.stderr: -370> 2024-09-14T11:14:19.866+0000 7f426f7fe640 10 monclient: _finish_auth 0 2024-09-14T11:14:20.161 INFO:tasks.workunit.client.0.smithi050.stderr: -369> 2024-09-14T11:14:19.866+0000 7f426f7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:14:20.161 INFO:tasks.workunit.client.0.smithi050.stderr: -368> 2024-09-14T11:14:19.866+0000 7f426f7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:20.161 INFO:tasks.workunit.client.0.smithi050.stderr: -367> 2024-09-14T11:14:19.866+0000 7f426f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:20.162 INFO:tasks.workunit.client.0.smithi050.stderr: -366> 2024-09-14T11:14:19.866+0000 7f426f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:20.162 INFO:tasks.workunit.client.0.smithi050.stderr: -365> 2024-09-14T11:14:19.866+0000 7f426f7fe640 10 monclient: dump: 2024-09-14T11:14:20.162 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:20.162 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:20.162 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.162 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.162 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:20.162 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:20.162 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:20.162 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:20.162 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:20.162 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.162 INFO:tasks.workunit.client.0.smithi050.stderr: -364> 2024-09-14T11:14:19.866+0000 7f438c0b7800 5 monclient: authenticate success, global_id 7646 2024-09-14T11:14:20.163 INFO:tasks.workunit.client.0.smithi050.stderr: -363> 2024-09-14T11:14:19.866+0000 7f438c0b7800 10 monclient: _renew_subs 2024-09-14T11:14:20.163 INFO:tasks.workunit.client.0.smithi050.stderr: -362> 2024-09-14T11:14:19.866+0000 7f438c0b7800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:20.163 INFO:tasks.workunit.client.0.smithi050.stderr: -361> 2024-09-14T11:14:19.866+0000 7f438aba3640 4 set_mon_vals no callback set 2024-09-14T11:14:20.163 INFO:tasks.workunit.client.0.smithi050.stderr: -360> 2024-09-14T11:14:19.866+0000 7f438c0b7800 10 monclient: _renew_subs 2024-09-14T11:14:20.163 INFO:tasks.workunit.client.0.smithi050.stderr: -359> 2024-09-14T11:14:19.866+0000 7f438c0b7800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:20.163 INFO:tasks.workunit.client.0.smithi050.stderr: -358> 2024-09-14T11:14:19.868+0000 7f426f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:14:20.163 INFO:tasks.workunit.client.0.smithi050.stderr: -357> 2024-09-14T11:14:19.868+0000 7f426f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:14:20.163 INFO:tasks.workunit.client.0.smithi050.stderr: -356> 2024-09-14T11:14:19.868+0000 7f426f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:14:20.163 INFO:tasks.workunit.client.0.smithi050.stderr: -355> 2024-09-14T11:14:19.868+0000 7f4389ba1640 10 monclient: get_auth_request con 0x7f4264077140 auth_method 0 2024-09-14T11:14:20.163 INFO:tasks.workunit.client.0.smithi050.stderr: -354> 2024-09-14T11:14:19.868+0000 7f438c0b7800 10 monclient: get_monmap_and_config 2024-09-14T11:14:20.163 INFO:tasks.workunit.client.0.smithi050.stderr: -353> 2024-09-14T11:14:19.868+0000 7f438c0b7800 10 monclient: build_initial_monmap 2024-09-14T11:14:20.163 INFO:tasks.workunit.client.0.smithi050.stderr: -352> 2024-09-14T11:14:19.868+0000 7f438c0b7800 1 build_initial for_mkfs: 0 2024-09-14T11:14:20.163 INFO:tasks.workunit.client.0.smithi050.stderr: -351> 2024-09-14T11:14:19.868+0000 7f438c0b7800 10 monclient: monmap: 2024-09-14T11:14:20.163 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:14:20.163 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:20.164 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:14:20.164 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:14:20.164 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:20.164 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:20.164 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:14:20.164 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:14:20.164 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:14:20.164 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.164 INFO:tasks.workunit.client.0.smithi050.stderr: -350> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding auth protocol: cephx 2024-09-14T11:14:20.164 INFO:tasks.workunit.client.0.smithi050.stderr: -349> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding auth protocol: cephx 2024-09-14T11:14:20.164 INFO:tasks.workunit.client.0.smithi050.stderr: -348> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding auth protocol: cephx 2024-09-14T11:14:20.164 INFO:tasks.workunit.client.0.smithi050.stderr: -347> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding con mode: secure 2024-09-14T11:14:20.164 INFO:tasks.workunit.client.0.smithi050.stderr: -346> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding con mode: crc 2024-09-14T11:14:20.165 INFO:tasks.workunit.client.0.smithi050.stderr: -345> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding con mode: secure 2024-09-14T11:14:20.165 INFO:tasks.workunit.client.0.smithi050.stderr: -344> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding con mode: crc 2024-09-14T11:14:20.165 INFO:tasks.workunit.client.0.smithi050.stderr: -343> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding con mode: secure 2024-09-14T11:14:20.165 INFO:tasks.workunit.client.0.smithi050.stderr: -342> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding con mode: crc 2024-09-14T11:14:20.165 INFO:tasks.workunit.client.0.smithi050.stderr: -341> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding con mode: crc 2024-09-14T11:14:20.165 INFO:tasks.workunit.client.0.smithi050.stderr: -340> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding con mode: secure 2024-09-14T11:14:20.165 INFO:tasks.workunit.client.0.smithi050.stderr: -339> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding con mode: crc 2024-09-14T11:14:20.165 INFO:tasks.workunit.client.0.smithi050.stderr: -338> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding con mode: secure 2024-09-14T11:14:20.165 INFO:tasks.workunit.client.0.smithi050.stderr: -337> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding con mode: crc 2024-09-14T11:14:20.165 INFO:tasks.workunit.client.0.smithi050.stderr: -336> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding con mode: secure 2024-09-14T11:14:20.165 INFO:tasks.workunit.client.0.smithi050.stderr: -335> 2024-09-14T11:14:19.868+0000 7f438c0b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:20.165 INFO:tasks.workunit.client.0.smithi050.stderr: -334> 2024-09-14T11:14:19.869+0000 7f438c0b7800 10 monclient: init 2024-09-14T11:14:20.165 INFO:tasks.workunit.client.0.smithi050.stderr: -333> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding auth protocol: cephx 2024-09-14T11:14:20.165 INFO:tasks.workunit.client.0.smithi050.stderr: -332> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding auth protocol: cephx 2024-09-14T11:14:20.166 INFO:tasks.workunit.client.0.smithi050.stderr: -331> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding auth protocol: cephx 2024-09-14T11:14:20.166 INFO:tasks.workunit.client.0.smithi050.stderr: -330> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding con mode: secure 2024-09-14T11:14:20.166 INFO:tasks.workunit.client.0.smithi050.stderr: -329> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding con mode: crc 2024-09-14T11:14:20.166 INFO:tasks.workunit.client.0.smithi050.stderr: -328> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding con mode: secure 2024-09-14T11:14:20.166 INFO:tasks.workunit.client.0.smithi050.stderr: -327> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding con mode: crc 2024-09-14T11:14:20.166 INFO:tasks.workunit.client.0.smithi050.stderr: -326> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding con mode: secure 2024-09-14T11:14:20.166 INFO:tasks.workunit.client.0.smithi050.stderr: -325> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding con mode: crc 2024-09-14T11:14:20.166 INFO:tasks.workunit.client.0.smithi050.stderr: -324> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding con mode: crc 2024-09-14T11:14:20.166 INFO:tasks.workunit.client.0.smithi050.stderr: -323> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding con mode: secure 2024-09-14T11:14:20.166 INFO:tasks.workunit.client.0.smithi050.stderr: -322> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding con mode: crc 2024-09-14T11:14:20.166 INFO:tasks.workunit.client.0.smithi050.stderr: -321> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding con mode: secure 2024-09-14T11:14:20.166 INFO:tasks.workunit.client.0.smithi050.stderr: -320> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding con mode: crc 2024-09-14T11:14:20.166 INFO:tasks.workunit.client.0.smithi050.stderr: -319> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding con mode: secure 2024-09-14T11:14:20.166 INFO:tasks.workunit.client.0.smithi050.stderr: -318> 2024-09-14T11:14:19.869+0000 7f438c0b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:20.167 INFO:tasks.workunit.client.0.smithi050.stderr: -317> 2024-09-14T11:14:19.869+0000 7f438c0b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:20.167 INFO:tasks.workunit.client.0.smithi050.stderr: -316> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command rotate-key cmddesc rotate-key hook 0x7ffd7333fe58 EEXIST 2024-09-14T11:14:20.167 INFO:tasks.workunit.client.0.smithi050.stderr: -315> 2024-09-14T11:14:19.869+0000 7f438c0b7800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:20.167 INFO:tasks.workunit.client.0.smithi050.stderr: -314> 2024-09-14T11:14:19.869+0000 7f438c0b7800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:14:20.167 INFO:tasks.workunit.client.0.smithi050.stderr: -313> 2024-09-14T11:14:19.869+0000 7f438c0b7800 10 monclient(hunting): picked mon.noname-b con 0x5596df930590 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:14:20.167 INFO:tasks.workunit.client.0.smithi050.stderr: -312> 2024-09-14T11:14:19.869+0000 7f438c0b7800 10 monclient(hunting): picked mon.noname-c con 0x5596df9014e0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:14:20.167 INFO:tasks.workunit.client.0.smithi050.stderr: -311> 2024-09-14T11:14:19.869+0000 7f438c0b7800 10 monclient(hunting): picked mon.noname-a con 0x5596df92be30 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:14:20.167 INFO:tasks.workunit.client.0.smithi050.stderr: -310> 2024-09-14T11:14:19.869+0000 7f438c0b7800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:20.167 INFO:tasks.workunit.client.0.smithi050.stderr: -309> 2024-09-14T11:14:19.869+0000 7f438c0b7800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:20.167 INFO:tasks.workunit.client.0.smithi050.stderr: -308> 2024-09-14T11:14:19.869+0000 7f438c0b7800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:20.167 INFO:tasks.workunit.client.0.smithi050.stderr: -307> 2024-09-14T11:14:19.869+0000 7f438c0b7800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:20.168 INFO:tasks.workunit.client.0.smithi050.stderr: -306> 2024-09-14T11:14:19.869+0000 7f438c0b7800 10 monclient(hunting): authenticate will time out at 2512.507543s 2024-09-14T11:14:20.168 INFO:tasks.workunit.client.0.smithi050.stderr: -305> 2024-09-14T11:14:19.869+0000 7f43893a0640 10 monclient(hunting): get_auth_request con 0x5596df9014e0 auth_method 0 2024-09-14T11:14:20.168 INFO:tasks.workunit.client.0.smithi050.stderr: -304> 2024-09-14T11:14:19.869+0000 7f43893a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:20.168 INFO:tasks.workunit.client.0.smithi050.stderr: -303> 2024-09-14T11:14:19.869+0000 7f43893a0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:20.168 INFO:tasks.workunit.client.0.smithi050.stderr: -302> 2024-09-14T11:14:19.869+0000 7f43893a0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:20.168 INFO:tasks.workunit.client.0.smithi050.stderr: -301> 2024-09-14T11:14:19.869+0000 7f438a3a2640 10 monclient(hunting): get_auth_request con 0x5596df92be30 auth_method 0 2024-09-14T11:14:20.168 INFO:tasks.workunit.client.0.smithi050.stderr: -300> 2024-09-14T11:14:19.869+0000 7f438a3a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:20.168 INFO:tasks.workunit.client.0.smithi050.stderr: -299> 2024-09-14T11:14:19.869+0000 7f438a3a2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:20.168 INFO:tasks.workunit.client.0.smithi050.stderr: -298> 2024-09-14T11:14:19.869+0000 7f438a3a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:20.168 INFO:tasks.workunit.client.0.smithi050.stderr: -297> 2024-09-14T11:14:19.869+0000 7f43893a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:20.168 INFO:tasks.workunit.client.0.smithi050.stderr: -296> 2024-09-14T11:14:19.869+0000 7f43893a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:20.168 INFO:tasks.workunit.client.0.smithi050.stderr: -295> 2024-09-14T11:14:19.869+0000 7f43893a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:20.168 INFO:tasks.workunit.client.0.smithi050.stderr: -294> 2024-09-14T11:14:19.869+0000 7f438a3a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:20.168 INFO:tasks.workunit.client.0.smithi050.stderr: -293> 2024-09-14T11:14:19.869+0000 7f438a3a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:20.169 INFO:tasks.workunit.client.0.smithi050.stderr: -292> 2024-09-14T11:14:19.869+0000 7f438a3a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:20.169 INFO:tasks.workunit.client.0.smithi050.stderr: -291> 2024-09-14T11:14:19.869+0000 7f4389ba1640 10 monclient(hunting): get_auth_request con 0x5596df930590 auth_method 0 2024-09-14T11:14:20.169 INFO:tasks.workunit.client.0.smithi050.stderr: -290> 2024-09-14T11:14:19.869+0000 7f4389ba1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:20.169 INFO:tasks.workunit.client.0.smithi050.stderr: -289> 2024-09-14T11:14:19.869+0000 7f4389ba1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:20.169 INFO:tasks.workunit.client.0.smithi050.stderr: -288> 2024-09-14T11:14:19.869+0000 7f4389ba1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:20.169 INFO:tasks.workunit.client.0.smithi050.stderr: -287> 2024-09-14T11:14:19.869+0000 7f43893a0640 10 monclient(hunting): handle_auth_done global_id 7649 payload 274 2024-09-14T11:14:20.169 INFO:tasks.workunit.client.0.smithi050.stderr: -286> 2024-09-14T11:14:19.869+0000 7f43893a0640 10 monclient: _finish_hunting 0 2024-09-14T11:14:20.169 INFO:tasks.workunit.client.0.smithi050.stderr: -285> 2024-09-14T11:14:19.869+0000 7f43893a0640 1 monclient: found mon.noname-c 2024-09-14T11:14:20.169 INFO:tasks.workunit.client.0.smithi050.stderr: -284> 2024-09-14T11:14:19.869+0000 7f43893a0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:14:20.169 INFO:tasks.workunit.client.0.smithi050.stderr: -283> 2024-09-14T11:14:19.870+0000 7f426d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:20.169 INFO:tasks.workunit.client.0.smithi050.stderr: -282> 2024-09-14T11:14:19.870+0000 7f426d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:20.169 INFO:tasks.workunit.client.0.smithi050.stderr: -281> 2024-09-14T11:14:19.870+0000 7f426d7fa640 10 monclient: dump: 2024-09-14T11:14:20.170 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:20.170 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:20.170 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.170 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.170 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:20.170 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:20.170 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:20.170 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:20.170 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:20.170 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.170 INFO:tasks.workunit.client.0.smithi050.stderr: -280> 2024-09-14T11:14:19.870+0000 7f426d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:14:20.170 INFO:tasks.workunit.client.0.smithi050.stderr: -279> 2024-09-14T11:14:19.870+0000 7f426d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:14:20.170 INFO:tasks.workunit.client.0.smithi050.stderr: -278> 2024-09-14T11:14:19.870+0000 7f426d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:20.170 INFO:tasks.workunit.client.0.smithi050.stderr: -277> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 monclient: authenticate success, global_id 7649 2024-09-14T11:14:20.171 INFO:tasks.workunit.client.0.smithi050.stderr: -276> 2024-09-14T11:14:19.870+0000 7f438c0b7800 10 monclient: get_monmap_and_config success 2024-09-14T11:14:20.171 INFO:tasks.workunit.client.0.smithi050.stderr: -275> 2024-09-14T11:14:19.870+0000 7f438c0b7800 4 set_mon_vals no callback set 2024-09-14T11:14:20.171 INFO:tasks.workunit.client.0.smithi050.stderr: -274> 2024-09-14T11:14:19.870+0000 7f426d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:20.171 INFO:tasks.workunit.client.0.smithi050.stderr: -273> 2024-09-14T11:14:19.870+0000 7f426d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:20.171 INFO:tasks.workunit.client.0.smithi050.stderr: -272> 2024-09-14T11:14:19.870+0000 7f426d7fa640 10 monclient: dump: 2024-09-14T11:14:20.171 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:20.171 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:20.171 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.171 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.171 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:20.171 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:20.171 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:20.172 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:20.172 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:20.172 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.172 INFO:tasks.workunit.client.0.smithi050.stderr: -271> 2024-09-14T11:14:19.870+0000 7f438c0b7800 10 monclient: shutdown 2024-09-14T11:14:20.172 INFO:tasks.workunit.client.0.smithi050.stderr: -270> 2024-09-14T11:14:19.870+0000 7f438c0b7800 10 monclient: build_initial_monmap 2024-09-14T11:14:20.172 INFO:tasks.workunit.client.0.smithi050.stderr: -269> 2024-09-14T11:14:19.870+0000 7f438c0b7800 1 build_initial for_mkfs: 0 2024-09-14T11:14:20.172 INFO:tasks.workunit.client.0.smithi050.stderr: -268> 2024-09-14T11:14:19.870+0000 7f438c0b7800 10 monclient: monmap: 2024-09-14T11:14:20.172 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:14:20.172 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:20.172 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:14:20.172 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:14:20.172 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:20.172 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:20.172 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:14:20.173 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:14:20.173 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:14:20.173 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.173 INFO:tasks.workunit.client.0.smithi050.stderr: -267> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding auth protocol: cephx 2024-09-14T11:14:20.173 INFO:tasks.workunit.client.0.smithi050.stderr: -266> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding auth protocol: cephx 2024-09-14T11:14:20.173 INFO:tasks.workunit.client.0.smithi050.stderr: -265> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding auth protocol: cephx 2024-09-14T11:14:20.173 INFO:tasks.workunit.client.0.smithi050.stderr: -264> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding con mode: secure 2024-09-14T11:14:20.173 INFO:tasks.workunit.client.0.smithi050.stderr: -263> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding con mode: crc 2024-09-14T11:14:20.173 INFO:tasks.workunit.client.0.smithi050.stderr: -262> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding con mode: secure 2024-09-14T11:14:20.173 INFO:tasks.workunit.client.0.smithi050.stderr: -261> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding con mode: crc 2024-09-14T11:14:20.173 INFO:tasks.workunit.client.0.smithi050.stderr: -260> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding con mode: secure 2024-09-14T11:14:20.173 INFO:tasks.workunit.client.0.smithi050.stderr: -259> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding con mode: crc 2024-09-14T11:14:20.174 INFO:tasks.workunit.client.0.smithi050.stderr: -258> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding con mode: crc 2024-09-14T11:14:20.174 INFO:tasks.workunit.client.0.smithi050.stderr: -257> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding con mode: secure 2024-09-14T11:14:20.174 INFO:tasks.workunit.client.0.smithi050.stderr: -256> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding con mode: crc 2024-09-14T11:14:20.174 INFO:tasks.workunit.client.0.smithi050.stderr: -255> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding con mode: secure 2024-09-14T11:14:20.174 INFO:tasks.workunit.client.0.smithi050.stderr: -254> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding con mode: crc 2024-09-14T11:14:20.174 INFO:tasks.workunit.client.0.smithi050.stderr: -253> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding con mode: secure 2024-09-14T11:14:20.174 INFO:tasks.workunit.client.0.smithi050.stderr: -252> 2024-09-14T11:14:19.871+0000 7f438c0b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:20.174 INFO:tasks.workunit.client.0.smithi050.stderr: -251> 2024-09-14T11:14:19.871+0000 7f438c0b7800 1 librados: starting msgr at 2024-09-14T11:14:20.174 INFO:tasks.workunit.client.0.smithi050.stderr: -250> 2024-09-14T11:14:19.871+0000 7f438c0b7800 1 librados: starting objecter 2024-09-14T11:14:20.174 INFO:tasks.workunit.client.0.smithi050.stderr: -249> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command objecter_requests cmddesc objecter_requests hook 0x5596df7a6680 EEXIST 2024-09-14T11:14:20.174 INFO:tasks.workunit.client.0.smithi050.stderr: -248> 2024-09-14T11:14:19.871+0000 7f438c0b7800 1 librados: setting wanted keys 2024-09-14T11:14:20.174 INFO:tasks.workunit.client.0.smithi050.stderr: -247> 2024-09-14T11:14:19.871+0000 7f438c0b7800 1 librados: calling monclient init 2024-09-14T11:14:20.174 INFO:tasks.workunit.client.0.smithi050.stderr: -246> 2024-09-14T11:14:19.871+0000 7f438c0b7800 10 monclient: init 2024-09-14T11:14:20.175 INFO:tasks.workunit.client.0.smithi050.stderr: -245> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding auth protocol: cephx 2024-09-14T11:14:20.175 INFO:tasks.workunit.client.0.smithi050.stderr: -244> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding auth protocol: cephx 2024-09-14T11:14:20.175 INFO:tasks.workunit.client.0.smithi050.stderr: -243> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding auth protocol: cephx 2024-09-14T11:14:20.175 INFO:tasks.workunit.client.0.smithi050.stderr: -242> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding con mode: secure 2024-09-14T11:14:20.175 INFO:tasks.workunit.client.0.smithi050.stderr: -241> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding con mode: crc 2024-09-14T11:14:20.175 INFO:tasks.workunit.client.0.smithi050.stderr: -240> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding con mode: secure 2024-09-14T11:14:20.175 INFO:tasks.workunit.client.0.smithi050.stderr: -239> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding con mode: crc 2024-09-14T11:14:20.175 INFO:tasks.workunit.client.0.smithi050.stderr: -238> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding con mode: secure 2024-09-14T11:14:20.175 INFO:tasks.workunit.client.0.smithi050.stderr: -237> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding con mode: crc 2024-09-14T11:14:20.175 INFO:tasks.workunit.client.0.smithi050.stderr: -236> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding con mode: crc 2024-09-14T11:14:20.175 INFO:tasks.workunit.client.0.smithi050.stderr: -235> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding con mode: secure 2024-09-14T11:14:20.175 INFO:tasks.workunit.client.0.smithi050.stderr: -234> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding con mode: crc 2024-09-14T11:14:20.175 INFO:tasks.workunit.client.0.smithi050.stderr: -233> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding con mode: secure 2024-09-14T11:14:20.175 INFO:tasks.workunit.client.0.smithi050.stderr: -232> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding con mode: crc 2024-09-14T11:14:20.176 INFO:tasks.workunit.client.0.smithi050.stderr: -231> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding con mode: secure 2024-09-14T11:14:20.176 INFO:tasks.workunit.client.0.smithi050.stderr: -230> 2024-09-14T11:14:19.871+0000 7f438c0b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:20.176 INFO:tasks.workunit.client.0.smithi050.stderr: -229> 2024-09-14T11:14:19.871+0000 7f438c0b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:20.176 INFO:tasks.workunit.client.0.smithi050.stderr: -228> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command rotate-key cmddesc rotate-key hook 0x5596df8da6b8 EEXIST 2024-09-14T11:14:20.176 INFO:tasks.workunit.client.0.smithi050.stderr: -227> 2024-09-14T11:14:19.871+0000 7f438c0b7800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:20.176 INFO:tasks.workunit.client.0.smithi050.stderr: -226> 2024-09-14T11:14:19.871+0000 7f438c0b7800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:14:20.176 INFO:tasks.workunit.client.0.smithi050.stderr: -225> 2024-09-14T11:14:19.871+0000 7f438c0b7800 10 monclient(hunting): picked mon.noname-a con 0x5596df9014e0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:14:20.176 INFO:tasks.workunit.client.0.smithi050.stderr: -224> 2024-09-14T11:14:19.871+0000 7f438c0b7800 10 monclient(hunting): picked mon.noname-c con 0x5596df92be30 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:14:20.176 INFO:tasks.workunit.client.0.smithi050.stderr: -223> 2024-09-14T11:14:19.871+0000 7f438c0b7800 10 monclient(hunting): picked mon.noname-b con 0x5596df930590 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:14:20.176 INFO:tasks.workunit.client.0.smithi050.stderr: -222> 2024-09-14T11:14:19.871+0000 7f438c0b7800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:20.176 INFO:tasks.workunit.client.0.smithi050.stderr: -221> 2024-09-14T11:14:19.871+0000 7f438c0b7800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:20.176 INFO:tasks.workunit.client.0.smithi050.stderr: -220> 2024-09-14T11:14:19.871+0000 7f438c0b7800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:20.176 INFO:tasks.workunit.client.0.smithi050.stderr: -219> 2024-09-14T11:14:19.871+0000 7f438c0b7800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:20.177 INFO:tasks.workunit.client.0.smithi050.stderr: -218> 2024-09-14T11:14:19.871+0000 7f438c0b7800 10 monclient(hunting): authenticate will time out at 2512.509843s 2024-09-14T11:14:20.177 INFO:tasks.workunit.client.0.smithi050.stderr: -217> 2024-09-14T11:14:19.871+0000 7f4389ba1640 10 monclient(hunting): get_auth_request con 0x5596df9014e0 auth_method 0 2024-09-14T11:14:20.177 INFO:tasks.workunit.client.0.smithi050.stderr: -216> 2024-09-14T11:14:19.871+0000 7f4389ba1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:20.177 INFO:tasks.workunit.client.0.smithi050.stderr: -215> 2024-09-14T11:14:19.871+0000 7f4389ba1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:20.177 INFO:tasks.workunit.client.0.smithi050.stderr: -214> 2024-09-14T11:14:19.871+0000 7f4389ba1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:20.177 INFO:tasks.workunit.client.0.smithi050.stderr: -213> 2024-09-14T11:14:19.871+0000 7f43893a0640 10 monclient(hunting): get_auth_request con 0x5596df92be30 auth_method 0 2024-09-14T11:14:20.177 INFO:tasks.workunit.client.0.smithi050.stderr: -212> 2024-09-14T11:14:19.871+0000 7f43893a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:20.177 INFO:tasks.workunit.client.0.smithi050.stderr: -211> 2024-09-14T11:14:19.871+0000 7f43893a0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:20.177 INFO:tasks.workunit.client.0.smithi050.stderr: -210> 2024-09-14T11:14:19.871+0000 7f43893a0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:20.177 INFO:tasks.workunit.client.0.smithi050.stderr: -209> 2024-09-14T11:14:19.872+0000 7f4389ba1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:20.177 INFO:tasks.workunit.client.0.smithi050.stderr: -208> 2024-09-14T11:14:19.872+0000 7f4389ba1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:20.177 INFO:tasks.workunit.client.0.smithi050.stderr: -207> 2024-09-14T11:14:19.872+0000 7f4389ba1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:20.177 INFO:tasks.workunit.client.0.smithi050.stderr: -206> 2024-09-14T11:14:19.872+0000 7f43893a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:20.177 INFO:tasks.workunit.client.0.smithi050.stderr: -205> 2024-09-14T11:14:19.872+0000 7f43893a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:20.178 INFO:tasks.workunit.client.0.smithi050.stderr: -204> 2024-09-14T11:14:19.872+0000 7f43893a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:20.178 INFO:tasks.workunit.client.0.smithi050.stderr: -203> 2024-09-14T11:14:19.872+0000 7f438a3a2640 10 monclient(hunting): get_auth_request con 0x5596df930590 auth_method 0 2024-09-14T11:14:20.178 INFO:tasks.workunit.client.0.smithi050.stderr: -202> 2024-09-14T11:14:19.872+0000 7f438a3a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:20.178 INFO:tasks.workunit.client.0.smithi050.stderr: -201> 2024-09-14T11:14:19.872+0000 7f438a3a2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:20.178 INFO:tasks.workunit.client.0.smithi050.stderr: -200> 2024-09-14T11:14:19.872+0000 7f438a3a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:20.178 INFO:tasks.workunit.client.0.smithi050.stderr: -199> 2024-09-14T11:14:19.872+0000 7f43893a0640 10 monclient(hunting): handle_auth_done global_id 7652 payload 824 2024-09-14T11:14:20.178 INFO:tasks.workunit.client.0.smithi050.stderr: -198> 2024-09-14T11:14:19.872+0000 7f43893a0640 10 monclient: _finish_hunting 0 2024-09-14T11:14:20.178 INFO:tasks.workunit.client.0.smithi050.stderr: -197> 2024-09-14T11:14:19.872+0000 7f43893a0640 1 monclient: found mon.noname-c 2024-09-14T11:14:20.178 INFO:tasks.workunit.client.0.smithi050.stderr: -196> 2024-09-14T11:14:19.872+0000 7f43893a0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:14:20.178 INFO:tasks.workunit.client.0.smithi050.stderr: -195> 2024-09-14T11:14:19.872+0000 7f425b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:20.178 INFO:tasks.workunit.client.0.smithi050.stderr: -194> 2024-09-14T11:14:19.872+0000 7f425b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:20.178 INFO:tasks.workunit.client.0.smithi050.stderr: -193> 2024-09-14T11:14:19.872+0000 7f425b7fe640 10 monclient: dump: 2024-09-14T11:14:20.178 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:20.178 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:20.178 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.179 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.179 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:20.179 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:20.179 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:20.179 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:20.179 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:20.179 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.179 INFO:tasks.workunit.client.0.smithi050.stderr: -192> 2024-09-14T11:14:19.872+0000 7f425b7fe640 10 monclient: _finish_auth 0 2024-09-14T11:14:20.179 INFO:tasks.workunit.client.0.smithi050.stderr: -191> 2024-09-14T11:14:19.872+0000 7f425b7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:14:20.179 INFO:tasks.workunit.client.0.smithi050.stderr: -190> 2024-09-14T11:14:19.872+0000 7f425b7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:20.179 INFO:tasks.workunit.client.0.smithi050.stderr: -189> 2024-09-14T11:14:19.872+0000 7f425b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:20.179 INFO:tasks.workunit.client.0.smithi050.stderr: -188> 2024-09-14T11:14:19.872+0000 7f425b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:20.179 INFO:tasks.workunit.client.0.smithi050.stderr: -187> 2024-09-14T11:14:19.872+0000 7f425b7fe640 10 monclient: dump: 2024-09-14T11:14:20.179 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:20.180 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:20.180 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.180 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.180 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:20.180 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:20.180 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:20.180 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:20.180 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:20.180 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.180 INFO:tasks.workunit.client.0.smithi050.stderr: -186> 2024-09-14T11:14:19.872+0000 7f438c0b7800 5 monclient: authenticate success, global_id 7652 2024-09-14T11:14:20.180 INFO:tasks.workunit.client.0.smithi050.stderr: -185> 2024-09-14T11:14:19.872+0000 7f426d7fa640 4 set_mon_vals no callback set 2024-09-14T11:14:20.180 INFO:tasks.workunit.client.0.smithi050.stderr: -184> 2024-09-14T11:14:19.872+0000 7f438c0b7800 10 monclient: _renew_subs 2024-09-14T11:14:20.180 INFO:tasks.workunit.client.0.smithi050.stderr: -183> 2024-09-14T11:14:19.872+0000 7f438c0b7800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:20.180 INFO:tasks.workunit.client.0.smithi050.stderr: -182> 2024-09-14T11:14:19.872+0000 7f438c0b7800 10 monclient: _renew_subs 2024-09-14T11:14:20.181 INFO:tasks.workunit.client.0.smithi050.stderr: -181> 2024-09-14T11:14:19.872+0000 7f438c0b7800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:20.181 INFO:tasks.workunit.client.0.smithi050.stderr: -180> 2024-09-14T11:14:19.872+0000 7f438c0b7800 1 librados: init done 2024-09-14T11:14:20.181 INFO:tasks.workunit.client.0.smithi050.stderr: -179> 2024-09-14T11:14:19.872+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command cr dump hook 0x5596df6eb988 2024-09-14T11:14:20.181 INFO:tasks.workunit.client.0.smithi050.stderr: -178> 2024-09-14T11:14:19.874+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.181 INFO:tasks.workunit.client.0.smithi050.stderr: -177> 2024-09-14T11:14:19.874+0000 7f425b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:14:20.181 INFO:tasks.workunit.client.0.smithi050.stderr: -176> 2024-09-14T11:14:19.874+0000 7f425b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:14:20.181 INFO:tasks.workunit.client.0.smithi050.stderr: -175> 2024-09-14T11:14:19.874+0000 7f425b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:14:20.181 INFO:tasks.workunit.client.0.smithi050.stderr: -174> 2024-09-14T11:14:19.875+0000 7f4389ba1640 10 monclient: get_auth_request con 0x7f4254077260 auth_method 0 2024-09-14T11:14:20.181 INFO:tasks.workunit.client.0.smithi050.stderr: -173> 2024-09-14T11:14:19.875+0000 7f438a3a2640 10 monclient: get_auth_request con 0x5596df950c20 auth_method 0 2024-09-14T11:14:20.181 INFO:tasks.workunit.client.0.smithi050.stderr: -172> 2024-09-14T11:14:19.875+0000 7f438c0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.181 INFO:tasks.workunit.client.0.smithi050.stderr: -171> 2024-09-14T11:14:19.875+0000 7f438c0b7800 20 realm 2024-09-14T11:14:20.181 INFO:tasks.workunit.client.0.smithi050.stderr: -170> 2024-09-14T11:14:19.875+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.181 INFO:tasks.workunit.client.0.smithi050.stderr: -169> 2024-09-14T11:14:19.876+0000 7f438c0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.181 INFO:tasks.workunit.client.0.smithi050.stderr: -168> 2024-09-14T11:14:19.876+0000 7f438c0b7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:20.182 INFO:tasks.workunit.client.0.smithi050.stderr: -167> 2024-09-14T11:14:19.876+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.182 INFO:tasks.workunit.client.0.smithi050.stderr: -166> 2024-09-14T11:14:19.876+0000 7f438c0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.182 INFO:tasks.workunit.client.0.smithi050.stderr: -165> 2024-09-14T11:14:19.876+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.182 INFO:tasks.workunit.client.0.smithi050.stderr: -164> 2024-09-14T11:14:19.876+0000 7f4389ba1640 10 monclient: get_auth_request con 0x5596df954e40 auth_method 0 2024-09-14T11:14:20.182 INFO:tasks.workunit.client.0.smithi050.stderr: -163> 2024-09-14T11:14:19.876+0000 7f438c0b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:20.182 INFO:tasks.workunit.client.0.smithi050.stderr: -162> 2024-09-14T11:14:19.876+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.182 INFO:tasks.workunit.client.0.smithi050.stderr: -161> 2024-09-14T11:14:19.877+0000 7f43893a0640 10 monclient: get_auth_request con 0x5596df9586a0 auth_method 0 2024-09-14T11:14:20.182 INFO:tasks.workunit.client.0.smithi050.stderr: -160> 2024-09-14T11:14:19.877+0000 7f438c0b7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:20.182 INFO:tasks.workunit.client.0.smithi050.stderr: -159> 2024-09-14T11:14:19.877+0000 7f438c0b7800 20 searching for the correct realm 2024-09-14T11:14:20.182 INFO:tasks.workunit.client.0.smithi050.stderr: -158> 2024-09-14T11:14:19.877+0000 7f438a3a2640 10 monclient: get_auth_request con 0x5596df95d460 auth_method 0 2024-09-14T11:14:20.182 INFO:tasks.workunit.client.0.smithi050.stderr: -157> 2024-09-14T11:14:19.878+0000 7f4389ba1640 10 monclient: get_auth_request con 0x7f43840651e0 auth_method 0 2024-09-14T11:14:20.182 INFO:tasks.workunit.client.0.smithi050.stderr: -156> 2024-09-14T11:14:19.880+0000 7f43893a0640 0 -- 172.21.15.50:0/109344237 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f438406e3d0 msgr2=0x7f4384069350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:20.182 INFO:tasks.workunit.client.0.smithi050.stderr: -155> 2024-09-14T11:14:20.081+0000 7f43893a0640 10 monclient: get_auth_request con 0x7f438406e3d0 auth_method 0 2024-09-14T11:14:20.182 INFO:tasks.workunit.client.0.smithi050.stderr: -154> 2024-09-14T11:14:20.084+0000 7f438a3a2640 10 monclient: get_auth_request con 0x7f437c017070 auth_method 0 2024-09-14T11:14:20.182 INFO:tasks.workunit.client.0.smithi050.stderr: -153> 2024-09-14T11:14:20.085+0000 7f4389ba1640 10 monclient: get_auth_request con 0x7f438406ab40 auth_method 0 2024-09-14T11:14:20.183 INFO:tasks.workunit.client.0.smithi050.stderr: -152> 2024-09-14T11:14:20.086+0000 7f438a3a2640 0 -- 172.21.15.50:0/109344237 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5596df950c20 msgr2=0x5596df953090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:20.183 INFO:tasks.workunit.client.0.smithi050.stderr: -151> 2024-09-14T11:14:20.086+0000 7f425b7fe640 1 client.7652.objecter ms_handle_reset 0x5596df950c20 session 0x5596df950550 osd.6 2024-09-14T11:14:20.183 INFO:tasks.workunit.client.0.smithi050.stderr: -150> 2024-09-14T11:14:20.086+0000 7f425b7fe640 10 monclient: _renew_subs 2024-09-14T11:14:20.183 INFO:tasks.workunit.client.0.smithi050.stderr: -149> 2024-09-14T11:14:20.086+0000 7f425b7fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:20.183 INFO:tasks.workunit.client.0.smithi050.stderr: -148> 2024-09-14T11:14:20.086+0000 7f438a3a2640 10 monclient: get_auth_request con 0x7f4254087510 auth_method 0 2024-09-14T11:14:20.183 INFO:tasks.workunit.client.0.smithi050.stderr: -147> 2024-09-14T11:14:20.090+0000 7f438c0b7800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:14:20.183 INFO:tasks.workunit.client.0.smithi050.stderr: -146> 2024-09-14T11:14:20.090+0000 7f438c0b7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:20.183 INFO:tasks.workunit.client.0.smithi050.stderr: -145> 2024-09-14T11:14:20.090+0000 7f438c0b7800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:14:20.183 INFO:tasks.workunit.client.0.smithi050.stderr: -144> 2024-09-14T11:14:20.090+0000 7f438c0b7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:20.183 INFO:tasks.workunit.client.0.smithi050.stderr: -143> 2024-09-14T11:14:20.090+0000 7f438c0b7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:20.183 INFO:tasks.workunit.client.0.smithi050.stderr: -142> 2024-09-14T11:14:20.090+0000 7f438c0b7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:20.183 INFO:tasks.workunit.client.0.smithi050.stderr: -141> 2024-09-14T11:14:20.090+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.183 INFO:tasks.workunit.client.0.smithi050.stderr: -140> 2024-09-14T11:14:20.090+0000 7f438c0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.184 INFO:tasks.workunit.client.0.smithi050.stderr: -139> 2024-09-14T11:14:20.090+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.184 INFO:tasks.workunit.client.0.smithi050.stderr: -138> 2024-09-14T11:14:20.091+0000 7f438c0b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:20.184 INFO:tasks.workunit.client.0.smithi050.stderr: -137> 2024-09-14T11:14:20.091+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.184 INFO:tasks.workunit.client.0.smithi050.stderr: -136> 2024-09-14T11:14:20.091+0000 7f438c0b7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:20.184 INFO:tasks.workunit.client.0.smithi050.stderr: -135> 2024-09-14T11:14:20.091+0000 7f438c0b7800 20 zone default found 2024-09-14T11:14:20.184 INFO:tasks.workunit.client.0.smithi050.stderr: -134> 2024-09-14T11:14:20.091+0000 7f438c0b7800 4 Realm: () 2024-09-14T11:14:20.184 INFO:tasks.workunit.client.0.smithi050.stderr: -133> 2024-09-14T11:14:20.091+0000 7f438c0b7800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:14:20.184 INFO:tasks.workunit.client.0.smithi050.stderr: -132> 2024-09-14T11:14:20.091+0000 7f438c0b7800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:14:20.184 INFO:tasks.workunit.client.0.smithi050.stderr: -131> 2024-09-14T11:14:20.091+0000 7f438c0b7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:20.184 INFO:tasks.workunit.client.0.smithi050.stderr: -130> 2024-09-14T11:14:20.091+0000 7f438c0b7800 20 zonegroup default 2024-09-14T11:14:20.184 INFO:tasks.workunit.client.0.smithi050.stderr: -129> 2024-09-14T11:14:20.091+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.184 INFO:tasks.workunit.client.0.smithi050.stderr: -128> 2024-09-14T11:14:20.091+0000 7f438c0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.184 INFO:tasks.workunit.client.0.smithi050.stderr: -127> 2024-09-14T11:14:20.091+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.184 INFO:tasks.workunit.client.0.smithi050.stderr: -126> 2024-09-14T11:14:20.091+0000 7f438c0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.185 INFO:tasks.workunit.client.0.smithi050.stderr: -125> 2024-09-14T11:14:20.091+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.185 INFO:tasks.workunit.client.0.smithi050.stderr: -124> 2024-09-14T11:14:20.092+0000 7f438c0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.185 INFO:tasks.workunit.client.0.smithi050.stderr: -123> 2024-09-14T11:14:20.092+0000 7f438c0b7800 20 started sync module instance, tier type = 2024-09-14T11:14:20.185 INFO:tasks.workunit.client.0.smithi050.stderr: -122> 2024-09-14T11:14:20.092+0000 7f438c0b7800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:14:20.185 INFO:tasks.workunit.client.0.smithi050.stderr: -121> 2024-09-14T11:14:20.101+0000 7f438c0b7800 20 add_watcher() i=0 2024-09-14T11:14:20.185 INFO:tasks.workunit.client.0.smithi050.stderr: -120> 2024-09-14T11:14:20.101+0000 7f438c0b7800 20 add_watcher() i=1 2024-09-14T11:14:20.185 INFO:tasks.workunit.client.0.smithi050.stderr: -119> 2024-09-14T11:14:20.101+0000 7f438c0b7800 20 add_watcher() i=2 2024-09-14T11:14:20.185 INFO:tasks.workunit.client.0.smithi050.stderr: -118> 2024-09-14T11:14:20.101+0000 7f438c0b7800 20 add_watcher() i=3 2024-09-14T11:14:20.185 INFO:tasks.workunit.client.0.smithi050.stderr: -117> 2024-09-14T11:14:20.101+0000 7f438c0b7800 20 add_watcher() i=4 2024-09-14T11:14:20.185 INFO:tasks.workunit.client.0.smithi050.stderr: -116> 2024-09-14T11:14:20.101+0000 7f438c0b7800 20 add_watcher() i=5 2024-09-14T11:14:20.185 INFO:tasks.workunit.client.0.smithi050.stderr: -115> 2024-09-14T11:14:20.101+0000 7f438c0b7800 20 add_watcher() i=6 2024-09-14T11:14:20.185 INFO:tasks.workunit.client.0.smithi050.stderr: -114> 2024-09-14T11:14:20.102+0000 7f438c0b7800 20 add_watcher() i=7 2024-09-14T11:14:20.185 INFO:tasks.workunit.client.0.smithi050.stderr: -113> 2024-09-14T11:14:20.102+0000 7f438c0b7800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:20.186 INFO:tasks.workunit.client.0.smithi050.stderr: -112> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding auth protocol: cephx 2024-09-14T11:14:20.186 INFO:tasks.workunit.client.0.smithi050.stderr: -111> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding auth protocol: cephx 2024-09-14T11:14:20.186 INFO:tasks.workunit.client.0.smithi050.stderr: -110> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding auth protocol: cephx 2024-09-14T11:14:20.186 INFO:tasks.workunit.client.0.smithi050.stderr: -109> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding con mode: secure 2024-09-14T11:14:20.186 INFO:tasks.workunit.client.0.smithi050.stderr: -108> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding con mode: crc 2024-09-14T11:14:20.186 INFO:tasks.workunit.client.0.smithi050.stderr: -107> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding con mode: secure 2024-09-14T11:14:20.186 INFO:tasks.workunit.client.0.smithi050.stderr: -106> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding con mode: crc 2024-09-14T11:14:20.186 INFO:tasks.workunit.client.0.smithi050.stderr: -105> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding con mode: secure 2024-09-14T11:14:20.186 INFO:tasks.workunit.client.0.smithi050.stderr: -104> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding con mode: crc 2024-09-14T11:14:20.186 INFO:tasks.workunit.client.0.smithi050.stderr: -103> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding con mode: crc 2024-09-14T11:14:20.186 INFO:tasks.workunit.client.0.smithi050.stderr: -102> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding con mode: secure 2024-09-14T11:14:20.186 INFO:tasks.workunit.client.0.smithi050.stderr: -101> 2024-09-14T11:14:20.104+0000 7f423b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:20.186 INFO:tasks.workunit.client.0.smithi050.stderr: -100> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding con mode: crc 2024-09-14T11:14:20.186 INFO:tasks.workunit.client.0.smithi050.stderr: -99> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding con mode: secure 2024-09-14T11:14:20.186 INFO:tasks.workunit.client.0.smithi050.stderr: -98> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding con mode: crc 2024-09-14T11:14:20.187 INFO:tasks.workunit.client.0.smithi050.stderr: -97> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding con mode: secure 2024-09-14T11:14:20.187 INFO:tasks.workunit.client.0.smithi050.stderr: -96> 2024-09-14T11:14:20.104+0000 7f438c0b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:20.187 INFO:tasks.workunit.client.0.smithi050.stderr: -95> 2024-09-14T11:14:20.104+0000 7f438c0b7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:20.187 INFO:tasks.workunit.client.0.smithi050.stderr: -94> 2024-09-14T11:14:20.104+0000 7f438c0b7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:20.187 INFO:tasks.workunit.client.0.smithi050.stderr: -93> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command cache list hook 0x5596df9217f0 2024-09-14T11:14:20.187 INFO:tasks.workunit.client.0.smithi050.stderr: -92> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command cache inspect hook 0x5596df9217f0 2024-09-14T11:14:20.187 INFO:tasks.workunit.client.0.smithi050.stderr: -91> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command cache erase hook 0x5596df9217f0 2024-09-14T11:14:20.187 INFO:tasks.workunit.client.0.smithi050.stderr: -90> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command cache zap hook 0x5596df9217f0 2024-09-14T11:14:20.187 INFO:tasks.workunit.client.0.smithi050.stderr: -89> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 note: GC not initialized 2024-09-14T11:14:20.187 INFO:tasks.workunit.client.0.smithi050.stderr: -88> 2024-09-14T11:14:20.105+0000 7f423a7fc640 20 reqs_thread_entry: start 2024-09-14T11:14:20.187 INFO:tasks.workunit.client.0.smithi050.stderr: -87> 2024-09-14T11:14:20.105+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command sync trace show hook 0x7f4380056d50 2024-09-14T11:14:20.187 INFO:tasks.workunit.client.0.smithi050.stderr: -86> 2024-09-14T11:14:20.105+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command sync trace history hook 0x7f4380056d50 2024-09-14T11:14:20.187 INFO:tasks.workunit.client.0.smithi050.stderr: -85> 2024-09-14T11:14:20.105+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command sync trace active hook 0x7f4380056d50 2024-09-14T11:14:20.187 INFO:tasks.workunit.client.0.smithi050.stderr: -84> 2024-09-14T11:14:20.105+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command sync trace active_short hook 0x7f4380056d50 2024-09-14T11:14:20.188 INFO:tasks.workunit.client.0.smithi050.stderr: -83> 2024-09-14T11:14:20.105+0000 7f438c0b7800 20 init_complete bucket index max shards: 11 2024-09-14T11:14:20.188 INFO:tasks.workunit.client.0.smithi050.stderr: -82> 2024-09-14T11:14:20.105+0000 7f438c0b7800 20 Filter name: none 2024-09-14T11:14:20.188 INFO:tasks.workunit.client.0.smithi050.stderr: -81> 2024-09-14T11:14:20.105+0000 7f41abfff640 20 reqs_thread_entry: start 2024-09-14T11:14:20.188 INFO:tasks.workunit.client.0.smithi050.stderr: -80> 2024-09-14T11:14:20.105+0000 7f438c0b7800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:14:20.188 INFO:tasks.workunit.client.0.smithi050.stderr: -79> 2024-09-14T11:14:20.105+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.188 INFO:tasks.workunit.client.0.smithi050.stderr: -78> 2024-09-14T11:14:20.105+0000 7f438c0b7800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:14:20.188 INFO:tasks.workunit.client.0.smithi050.stderr: -77> 2024-09-14T11:14:20.105+0000 7f438c0b7800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:14:20.188 INFO:tasks.workunit.client.0.smithi050.stderr: -76> 2024-09-14T11:14:20.105+0000 7f438c0b7800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:14:20.188 INFO:tasks.workunit.client.0.smithi050.stderr: -75> 2024-09-14T11:14:20.105+0000 7f438c0b7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : miss 2024-09-14T11:14:20.188 INFO:tasks.workunit.client.0.smithi050.stderr: -74> 2024-09-14T11:14:20.105+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.188 INFO:tasks.workunit.client.0.smithi050.stderr: -73> 2024-09-14T11:14:20.106+0000 7f438c0b7800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:14:20.188 INFO:tasks.workunit.client.0.smithi050.stderr: -72> 2024-09-14T11:14:20.106+0000 7f438c0b7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:14:20.188 INFO:tasks.workunit.client.0.smithi050.stderr: -71> 2024-09-14T11:14:20.106+0000 7f438c0b7800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:14:20.188 INFO:tasks.workunit.client.0.smithi050.stderr: -70> 2024-09-14T11:14:20.106+0000 7f438c0b7800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:20.188 INFO:tasks.workunit.client.0.smithi050.stderr: -69> 2024-09-14T11:14:20.106+0000 7f438c0b7800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:14:20.189 INFO:tasks.workunit.client.0.smithi050.stderr: -68> 2024-09-14T11:14:20.106+0000 7f438c0b7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:14:20.189 INFO:tasks.workunit.client.0.smithi050.stderr: -67> 2024-09-14T11:14:20.111+0000 7f438c0b7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:14:20.189 INFO:tasks.workunit.client.0.smithi050.stderr: -66> 2024-09-14T11:14:20.111+0000 7f438c0b7800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:14:20.189 INFO:tasks.workunit.client.0.smithi050.stderr: -65> 2024-09-14T11:14:20.111+0000 7f438c0b7800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:14:20.189 INFO:tasks.workunit.client.0.smithi050.stderr: -64> 2024-09-14T11:14:20.111+0000 7f438c0b7800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18, ofs0, ns] 2024-09-14T11:14:20.189 INFO:tasks.workunit.client.0.smithi050.stderr: -63> 2024-09-14T11:14:20.111+0000 7f426cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497131 cookie 94106484617488 notifier 7652 bl.length()=911 2024-09-14T11:14:20.189 INFO:tasks.workunit.client.0.smithi050.stderr: -62> 2024-09-14T11:14:20.111+0000 7f426cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:14:20.189 INFO:tasks.workunit.client.0.smithi050.stderr: -61> 2024-09-14T11:14:20.111+0000 7f426cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:14:20.189 INFO:tasks.workunit.client.0.smithi050.stderr: -60> 2024-09-14T11:14:20.111+0000 7f426cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:14:20.189 INFO:tasks.workunit.client.0.smithi050.stderr: -59> 2024-09-14T11:14:20.113+0000 7f438c0b7800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_sources= new_sources= 2024-09-14T11:14:20.189 INFO:tasks.workunit.client.0.smithi050.stderr: -58> 2024-09-14T11:14:20.113+0000 7f438c0b7800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential sources added=[] removed=[] 2024-09-14T11:14:20.189 INFO:tasks.workunit.client.0.smithi050.stderr: -57> 2024-09-14T11:14:20.113+0000 7f438c0b7800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_dests= new_dests= 2024-09-14T11:14:20.190 INFO:tasks.workunit.client.0.smithi050.stderr: -56> 2024-09-14T11:14:20.113+0000 7f438c0b7800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential dests added=[] removed=[] 2024-09-14T11:14:20.190 INFO:tasks.workunit.client.0.smithi050.stderr: -55> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.0 2024-09-14T11:14:20.190 INFO:tasks.workunit.client.0.smithi050.stderr: -54> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.0 2024-09-14T11:14:20.190 INFO:tasks.workunit.client.0.smithi050.stderr: -53> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.1 2024-09-14T11:14:20.190 INFO:tasks.workunit.client.0.smithi050.stderr: -52> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.1 2024-09-14T11:14:20.190 INFO:tasks.workunit.client.0.smithi050.stderr: -51> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.2 2024-09-14T11:14:20.190 INFO:tasks.workunit.client.0.smithi050.stderr: -50> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.2 2024-09-14T11:14:20.190 INFO:tasks.workunit.client.0.smithi050.stderr: -49> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.3 2024-09-14T11:14:20.190 INFO:tasks.workunit.client.0.smithi050.stderr: -48> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.3 2024-09-14T11:14:20.190 INFO:tasks.workunit.client.0.smithi050.stderr: -47> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.4 2024-09-14T11:14:20.190 INFO:tasks.workunit.client.0.smithi050.stderr: -46> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.4 2024-09-14T11:14:20.190 INFO:tasks.workunit.client.0.smithi050.stderr: -45> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.5 2024-09-14T11:14:20.190 INFO:tasks.workunit.client.0.smithi050.stderr: -44> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.5 2024-09-14T11:14:20.190 INFO:tasks.workunit.client.0.smithi050.stderr: -43> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.6 2024-09-14T11:14:20.191 INFO:tasks.workunit.client.0.smithi050.stderr: -42> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.6 2024-09-14T11:14:20.191 INFO:tasks.workunit.client.0.smithi050.stderr: -41> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.7 2024-09-14T11:14:20.191 INFO:tasks.workunit.client.0.smithi050.stderr: -40> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.7 2024-09-14T11:14:20.191 INFO:tasks.workunit.client.0.smithi050.stderr: -39> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.8 2024-09-14T11:14:20.191 INFO:tasks.workunit.client.0.smithi050.stderr: -38> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.8 2024-09-14T11:14:20.191 INFO:tasks.workunit.client.0.smithi050.stderr: -37> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.9 2024-09-14T11:14:20.191 INFO:tasks.workunit.client.0.smithi050.stderr: -36> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.9 2024-09-14T11:14:20.191 INFO:tasks.workunit.client.0.smithi050.stderr: -35> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.10 2024-09-14T11:14:20.191 INFO:tasks.workunit.client.0.smithi050.stderr: -34> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.10 2024-09-14T11:14:20.191 INFO:tasks.workunit.client.0.smithi050.stderr: -33> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.11 2024-09-14T11:14:20.191 INFO:tasks.workunit.client.0.smithi050.stderr: -32> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.11 2024-09-14T11:14:20.191 INFO:tasks.workunit.client.0.smithi050.stderr: -31> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.12 2024-09-14T11:14:20.191 INFO:tasks.workunit.client.0.smithi050.stderr: -30> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.12 2024-09-14T11:14:20.192 INFO:tasks.workunit.client.0.smithi050.stderr: -29> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.13 2024-09-14T11:14:20.192 INFO:tasks.workunit.client.0.smithi050.stderr: -28> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.13 2024-09-14T11:14:20.192 INFO:tasks.workunit.client.0.smithi050.stderr: -27> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:14:20.192 INFO:tasks.workunit.client.0.smithi050.stderr: -26> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:14:20.192 INFO:tasks.workunit.client.0.smithi050.stderr: -25> 2024-09-14T11:14:20.118+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:14:20.192 INFO:tasks.workunit.client.0.smithi050.stderr: -24> 2024-09-14T11:14:20.118+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:14:20.192 INFO:tasks.workunit.client.0.smithi050.stderr: -23> 2024-09-14T11:14:20.118+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:14:20.192 INFO:tasks.workunit.client.0.smithi050.stderr: -22> 2024-09-14T11:14:20.118+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:14:20.192 INFO:tasks.workunit.client.0.smithi050.stderr: -21> 2024-09-14T11:14:20.119+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:14:20.192 INFO:tasks.workunit.client.0.smithi050.stderr: -20> 2024-09-14T11:14:20.119+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:14:20.192 INFO:tasks.workunit.client.0.smithi050.stderr: -19> 2024-09-14T11:14:20.119+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:14:20.192 INFO:tasks.workunit.client.0.smithi050.stderr: -18> 2024-09-14T11:14:20.119+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:14:20.192 INFO:tasks.workunit.client.0.smithi050.stderr: -17> 2024-09-14T11:14:20.120+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:14:20.192 INFO:tasks.workunit.client.0.smithi050.stderr: -16> 2024-09-14T11:14:20.120+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:14:20.192 INFO:tasks.workunit.client.0.smithi050.stderr: -15> 2024-09-14T11:14:20.120+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:14:20.193 INFO:tasks.workunit.client.0.smithi050.stderr: -14> 2024-09-14T11:14:20.120+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:14:20.193 INFO:tasks.workunit.client.0.smithi050.stderr: -13> 2024-09-14T11:14:20.121+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:14:20.193 INFO:tasks.workunit.client.0.smithi050.stderr: -12> 2024-09-14T11:14:20.121+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:14:20.193 INFO:tasks.workunit.client.0.smithi050.stderr: -11> 2024-09-14T11:14:20.121+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:14:20.193 INFO:tasks.workunit.client.0.smithi050.stderr: -10> 2024-09-14T11:14:20.121+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:14:20.193 INFO:tasks.workunit.client.0.smithi050.stderr: -9> 2024-09-14T11:14:20.122+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:14:20.193 INFO:tasks.workunit.client.0.smithi050.stderr: -8> 2024-09-14T11:14:20.122+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:14:20.193 INFO:tasks.workunit.client.0.smithi050.stderr: -7> 2024-09-14T11:14:20.122+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:14:20.193 INFO:tasks.workunit.client.0.smithi050.stderr: -6> 2024-09-14T11:14:20.122+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:14:20.193 INFO:tasks.workunit.client.0.smithi050.stderr: -5> 2024-09-14T11:14:20.123+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:14:20.194 INFO:tasks.workunit.client.0.smithi050.stderr: -4> 2024-09-14T11:14:20.123+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:14:20.194 INFO:tasks.workunit.client.0.smithi050.stderr: -3> 2024-09-14T11:14:20.123+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:14:20.194 INFO:tasks.workunit.client.0.smithi050.stderr: -2> 2024-09-14T11:14:20.123+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:14:20.194 INFO:tasks.workunit.client.0.smithi050.stderr: -1> 2024-09-14T11:14:20.126+0000 7f438c0b7800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f438c0b7800 time 2024-09-14T11:14:20.127083+0000 2024-09-14T11:14:20.194 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:14:20.194 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.194 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:20.194 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f438f58c76a] 2024-09-14T11:14:20.194 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f438f58c928] 2024-09-14T11:14:20.194 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5596ddbbb0b1] 2024-09-14T11:14:20.194 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5596ddbca124] 2024-09-14T11:14:20.194 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5596ddbcafc4] 2024-09-14T11:14:20.195 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:14:20.195 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f438e229590] 2024-09-14T11:14:20.195 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:14:20.195 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:14:20.195 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.195 INFO:tasks.workunit.client.0.smithi050.stderr: 0> 2024-09-14T11:14:20.127+0000 7f438c0b7800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:14:20.195 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f438c0b7800 thread_name:radosgw-admin 2024-09-14T11:14:20.195 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.195 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:20.195 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f438e23e6f0] 2024-09-14T11:14:20.195 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f438e28b99c] 2024-09-14T11:14:20.195 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:14:20.196 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:14:20.196 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f438f58c7c4] 2024-09-14T11:14:20.196 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f438f58c928] 2024-09-14T11:14:20.196 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5596ddbbb0b1] 2024-09-14T11:14:20.196 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5596ddbca124] 2024-09-14T11:14:20.196 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5596ddbcafc4] 2024-09-14T11:14:20.196 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:14:20.196 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f438e229590] 2024-09-14T11:14:20.196 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:14:20.196 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:14:20.196 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:14:20.196 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.196 INFO:tasks.workunit.client.0.smithi050.stderr:--- logging levels --- 2024-09-14T11:14:20.197 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 none 2024-09-14T11:14:20.197 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 lockdep 2024-09-14T11:14:20.197 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 context 2024-09-14T11:14:20.197 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 crush 2024-09-14T11:14:20.197 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds 2024-09-14T11:14:20.197 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_balancer 2024-09-14T11:14:20.197 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_locker 2024-09-14T11:14:20.197 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log 2024-09-14T11:14:20.197 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log_expire 2024-09-14T11:14:20.197 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_migrator 2024-09-14T11:14:20.197 INFO:tasks.workunit.client.0.smithi050.stderr: 3/ 5 mds_quiesce 2024-09-14T11:14:20.198 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 buffer 2024-09-14T11:14:20.198 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 timer 2024-09-14T11:14:20.198 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 filer 2024-09-14T11:14:20.198 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 striper 2024-09-14T11:14:20.198 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 objecter 2024-09-14T11:14:20.198 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rados 2024-09-14T11:14:20.198 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd 2024-09-14T11:14:20.198 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_mirror 2024-09-14T11:14:20.198 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_replay 2024-09-14T11:14:20.198 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_pwl 2024-09-14T11:14:20.198 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 journaler 2024-09-14T11:14:20.198 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objectcacher 2024-09-14T11:14:20.198 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:14:20.198 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 client 2024-09-14T11:14:20.198 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 osd 2024-09-14T11:14:20.199 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 optracker 2024-09-14T11:14:20.199 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objclass 2024-09-14T11:14:20.199 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 filestore 2024-09-14T11:14:20.199 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 journal 2024-09-14T11:14:20.199 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 ms 2024-09-14T11:14:20.199 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mon 2024-09-14T11:14:20.199 INFO:tasks.workunit.client.0.smithi050.stderr: 0/10 monc 2024-09-14T11:14:20.199 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 paxos 2024-09-14T11:14:20.199 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 tp 2024-09-14T11:14:20.199 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 auth 2024-09-14T11:14:20.199 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 crypto 2024-09-14T11:14:20.199 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 finisher 2024-09-14T11:14:20.199 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 reserver 2024-09-14T11:14:20.200 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 heartbeatmap 2024-09-14T11:14:20.200 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 perfcounter 2024-09-14T11:14:20.200 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw 2024-09-14T11:14:20.200 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_sync 2024-09-14T11:14:20.200 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_datacache 2024-09-14T11:14:20.200 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_access 2024-09-14T11:14:20.200 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:14:20.200 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_flight 2024-09-14T11:14:20.200 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:14:20.200 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw_notification 2024-09-14T11:14:20.200 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 javaclient 2024-09-14T11:14:20.200 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 asok 2024-09-14T11:14:20.200 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 throttle 2024-09-14T11:14:20.200 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 refs 2024-09-14T11:14:20.200 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 compressor 2024-09-14T11:14:20.201 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluestore 2024-09-14T11:14:20.201 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluefs 2024-09-14T11:14:20.201 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 bdev 2024-09-14T11:14:20.201 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 kstore 2024-09-14T11:14:20.201 INFO:tasks.workunit.client.0.smithi050.stderr: 4/ 5 rocksdb 2024-09-14T11:14:20.201 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 fuse 2024-09-14T11:14:20.201 INFO:tasks.workunit.client.0.smithi050.stderr: 2/ 5 mgr 2024-09-14T11:14:20.201 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mgrc 2024-09-14T11:14:20.201 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 dpdk 2024-09-14T11:14:20.201 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 eventtrace 2024-09-14T11:14:20.201 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 prioritycache 2024-09-14T11:14:20.201 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 test 2024-09-14T11:14:20.201 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:14:20.202 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephsqlite 2024-09-14T11:14:20.202 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:14:20.202 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore 2024-09-14T11:14:20.202 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_onode 2024-09-14T11:14:20.202 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_odata 2024-09-14T11:14:20.202 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_omap 2024-09-14T11:14:20.202 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_tm 2024-09-14T11:14:20.202 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_t 2024-09-14T11:14:20.202 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:14:20.202 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_epm 2024-09-14T11:14:20.202 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_lba 2024-09-14T11:14:20.202 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:14:20.202 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cache 2024-09-14T11:14:20.202 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_journal 2024-09-14T11:14:20.203 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_device 2024-09-14T11:14:20.203 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_backref 2024-09-14T11:14:20.203 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 alienstore 2024-09-14T11:14:20.203 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mclock 2024-09-14T11:14:20.203 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cyanstore 2024-09-14T11:14:20.203 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 ceph_exporter 2024-09-14T11:14:20.203 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 memstore 2024-09-14T11:14:20.203 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 trace 2024-09-14T11:14:20.203 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 ceph_dedup 2024-09-14T11:14:20.203 INFO:tasks.workunit.client.0.smithi050.stderr: -2/-2 (syslog threshold) 2024-09-14T11:14:20.203 INFO:tasks.workunit.client.0.smithi050.stderr: 99/99 (stderr threshold) 2024-09-14T11:14:20.203 INFO:tasks.workunit.client.0.smithi050.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:14:20.204 INFO:tasks.workunit.client.0.smithi050.stderr: 7f41abfff640 / http_manager 2024-09-14T11:14:20.204 INFO:tasks.workunit.client.0.smithi050.stderr: 7f423a7fc640 / http_manager 2024-09-14T11:14:20.204 INFO:tasks.workunit.client.0.smithi050.stderr: 7f423b7fe640 / rgw_dt_lg_renew 2024-09-14T11:14:20.204 INFO:tasks.workunit.client.0.smithi050.stderr: 7f425b7fe640 / ms_dispatch 2024-09-14T11:14:20.204 INFO:tasks.workunit.client.0.smithi050.stderr: 7f426cff9640 / io_context_pool 2024-09-14T11:14:20.204 INFO:tasks.workunit.client.0.smithi050.stderr: 7f426d7fa640 / io_context_pool 2024-09-14T11:14:20.204 INFO:tasks.workunit.client.0.smithi050.stderr: 7f426f7fe640 / ms_dispatch 2024-09-14T11:14:20.204 INFO:tasks.workunit.client.0.smithi050.stderr: 7f4276604640 / ms_dispatch 2024-09-14T11:14:20.204 INFO:tasks.workunit.client.0.smithi050.stderr: 7f4277e07640 / io_context_pool 2024-09-14T11:14:20.204 INFO:tasks.workunit.client.0.smithi050.stderr: 7f43893a0640 / msgr-worker-2 2024-09-14T11:14:20.205 INFO:tasks.workunit.client.0.smithi050.stderr: 7f4389ba1640 / msgr-worker-1 2024-09-14T11:14:20.205 INFO:tasks.workunit.client.0.smithi050.stderr: 7f438a3a2640 / msgr-worker-0 2024-09-14T11:14:20.205 INFO:tasks.workunit.client.0.smithi050.stderr: 7f438aba3640 / io_context_pool 2024-09-14T11:14:20.205 INFO:tasks.workunit.client.0.smithi050.stderr: 7f438c0b7800 / radosgw-admin 2024-09-14T11:14:20.205 INFO:tasks.workunit.client.0.smithi050.stderr: max_recent 500 2024-09-14T11:14:20.205 INFO:tasks.workunit.client.0.smithi050.stderr: max_new 1000 2024-09-14T11:14:20.205 INFO:tasks.workunit.client.0.smithi050.stderr: log_file /var/log/ceph/ceph-client.admin.147331.log 2024-09-14T11:14:20.205 INFO:tasks.workunit.client.0.smithi050.stderr:--- end dump of recent events --- 2024-09-14T11:14:20.205 INFO:tasks.workunit.client.0.smithi050.stderr:--- begin dump of recent events --- 2024-09-14T11:14:20.205 INFO:tasks.workunit.client.0.smithi050.stderr: -499> 2024-09-14T11:14:19.858+0000 7f438c0b7800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:20.206 INFO:tasks.workunit.client.0.smithi050.stderr: -498> 2024-09-14T11:14:19.858+0000 7f438c0b7800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:20.206 INFO:tasks.workunit.client.0.smithi050.stderr: -497> 2024-09-14T11:14:19.858+0000 7f438c0b7800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:20.206 INFO:tasks.workunit.client.0.smithi050.stderr: -496> 2024-09-14T11:14:19.858+0000 7f438c0b7800 10 monclient(hunting): authenticate will time out at 2512.496297s 2024-09-14T11:14:20.206 INFO:tasks.workunit.client.0.smithi050.stderr: -495> 2024-09-14T11:14:19.858+0000 7f438a3a2640 10 monclient(hunting): get_auth_request con 0x5596df866660 auth_method 0 2024-09-14T11:14:20.206 INFO:tasks.workunit.client.0.smithi050.stderr: -494> 2024-09-14T11:14:19.858+0000 7f438a3a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:20.206 INFO:tasks.workunit.client.0.smithi050.stderr: -493> 2024-09-14T11:14:19.858+0000 7f438a3a2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:20.206 INFO:tasks.workunit.client.0.smithi050.stderr: -492> 2024-09-14T11:14:19.858+0000 7f438a3a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:20.206 INFO:tasks.workunit.client.0.smithi050.stderr: -491> 2024-09-14T11:14:19.858+0000 7f4389ba1640 10 monclient(hunting): get_auth_request con 0x5596df70cd00 auth_method 0 2024-09-14T11:14:20.206 INFO:tasks.workunit.client.0.smithi050.stderr: -490> 2024-09-14T11:14:19.858+0000 7f4389ba1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:20.206 INFO:tasks.workunit.client.0.smithi050.stderr: -489> 2024-09-14T11:14:19.858+0000 7f4389ba1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:20.206 INFO:tasks.workunit.client.0.smithi050.stderr: -488> 2024-09-14T11:14:19.858+0000 7f4389ba1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:20.206 INFO:tasks.workunit.client.0.smithi050.stderr: -487> 2024-09-14T11:14:19.858+0000 7f43893a0640 10 monclient(hunting): get_auth_request con 0x5596df718c90 auth_method 0 2024-09-14T11:14:20.206 INFO:tasks.workunit.client.0.smithi050.stderr: -486> 2024-09-14T11:14:19.858+0000 7f43893a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:20.207 INFO:tasks.workunit.client.0.smithi050.stderr: -485> 2024-09-14T11:14:19.858+0000 7f43893a0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:20.207 INFO:tasks.workunit.client.0.smithi050.stderr: -484> 2024-09-14T11:14:19.858+0000 7f43893a0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:20.207 INFO:tasks.workunit.client.0.smithi050.stderr: -483> 2024-09-14T11:14:19.858+0000 7f438a3a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:20.207 INFO:tasks.workunit.client.0.smithi050.stderr: -482> 2024-09-14T11:14:19.858+0000 7f438a3a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:20.207 INFO:tasks.workunit.client.0.smithi050.stderr: -481> 2024-09-14T11:14:19.858+0000 7f438a3a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:20.207 INFO:tasks.workunit.client.0.smithi050.stderr: -480> 2024-09-14T11:14:19.858+0000 7f4389ba1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:20.207 INFO:tasks.workunit.client.0.smithi050.stderr: -479> 2024-09-14T11:14:19.858+0000 7f4389ba1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:20.207 INFO:tasks.workunit.client.0.smithi050.stderr: -478> 2024-09-14T11:14:19.858+0000 7f4389ba1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:20.207 INFO:tasks.workunit.client.0.smithi050.stderr: -477> 2024-09-14T11:14:19.858+0000 7f43893a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:20.207 INFO:tasks.workunit.client.0.smithi050.stderr: -476> 2024-09-14T11:14:19.858+0000 7f43893a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:20.207 INFO:tasks.workunit.client.0.smithi050.stderr: -475> 2024-09-14T11:14:19.858+0000 7f43893a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:20.207 INFO:tasks.workunit.client.0.smithi050.stderr: -474> 2024-09-14T11:14:19.858+0000 7f4389ba1640 10 monclient(hunting): handle_auth_done global_id 7643 payload 824 2024-09-14T11:14:20.207 INFO:tasks.workunit.client.0.smithi050.stderr: -473> 2024-09-14T11:14:19.858+0000 7f4389ba1640 10 monclient: _finish_hunting 0 2024-09-14T11:14:20.207 INFO:tasks.workunit.client.0.smithi050.stderr: -472> 2024-09-14T11:14:19.858+0000 7f4389ba1640 1 monclient: found mon.noname-c 2024-09-14T11:14:20.208 INFO:tasks.workunit.client.0.smithi050.stderr: -471> 2024-09-14T11:14:19.858+0000 7f4389ba1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:14:20.208 INFO:tasks.workunit.client.0.smithi050.stderr: -470> 2024-09-14T11:14:19.858+0000 7f4276604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:20.208 INFO:tasks.workunit.client.0.smithi050.stderr: -469> 2024-09-14T11:14:19.858+0000 7f4276604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:20.208 INFO:tasks.workunit.client.0.smithi050.stderr: -468> 2024-09-14T11:14:19.858+0000 7f4276604640 10 monclient: dump: 2024-09-14T11:14:20.208 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:20.208 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:20.208 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.208 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.208 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:20.208 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:20.208 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:20.208 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:20.208 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:20.208 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.209 INFO:tasks.workunit.client.0.smithi050.stderr: -467> 2024-09-14T11:14:19.858+0000 7f4276604640 10 monclient: _finish_auth 0 2024-09-14T11:14:20.209 INFO:tasks.workunit.client.0.smithi050.stderr: -466> 2024-09-14T11:14:19.858+0000 7f4276604640 10 monclient: _check_auth_tickets 2024-09-14T11:14:20.209 INFO:tasks.workunit.client.0.smithi050.stderr: -465> 2024-09-14T11:14:19.859+0000 7f438c0b7800 5 monclient: authenticate success, global_id 7643 2024-09-14T11:14:20.209 INFO:tasks.workunit.client.0.smithi050.stderr: -464> 2024-09-14T11:14:19.859+0000 7f438c0b7800 10 monclient: _renew_subs 2024-09-14T11:14:20.209 INFO:tasks.workunit.client.0.smithi050.stderr: -463> 2024-09-14T11:14:19.859+0000 7f438c0b7800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:20.209 INFO:tasks.workunit.client.0.smithi050.stderr: -462> 2024-09-14T11:14:19.859+0000 7f4276604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:20.209 INFO:tasks.workunit.client.0.smithi050.stderr: -461> 2024-09-14T11:14:19.859+0000 7f4276604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:20.209 INFO:tasks.workunit.client.0.smithi050.stderr: -460> 2024-09-14T11:14:19.859+0000 7f4276604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:20.209 INFO:tasks.workunit.client.0.smithi050.stderr: -459> 2024-09-14T11:14:19.859+0000 7f4276604640 10 monclient: dump: 2024-09-14T11:14:20.209 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:20.209 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:20.209 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.209 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.209 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:20.210 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:20.210 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:20.210 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:20.210 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:20.210 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.210 INFO:tasks.workunit.client.0.smithi050.stderr: -458> 2024-09-14T11:14:19.859+0000 7f4277e07640 4 set_mon_vals no callback set 2024-09-14T11:14:20.210 INFO:tasks.workunit.client.0.smithi050.stderr: -457> 2024-09-14T11:14:19.859+0000 7f438c0b7800 10 monclient: _renew_subs 2024-09-14T11:14:20.210 INFO:tasks.workunit.client.0.smithi050.stderr: -456> 2024-09-14T11:14:19.859+0000 7f438c0b7800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:20.210 INFO:tasks.workunit.client.0.smithi050.stderr: -455> 2024-09-14T11:14:19.859+0000 7f438c0b7800 1 librados: init done 2024-09-14T11:14:20.210 INFO:tasks.workunit.client.0.smithi050.stderr: -454> 2024-09-14T11:14:19.861+0000 7f4276604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:14:20.210 INFO:tasks.workunit.client.0.smithi050.stderr: -453> 2024-09-14T11:14:19.861+0000 7f4276604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:14:20.210 INFO:tasks.workunit.client.0.smithi050.stderr: -452> 2024-09-14T11:14:19.861+0000 7f4276604640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:14:20.210 INFO:tasks.workunit.client.0.smithi050.stderr: -451> 2024-09-14T11:14:19.861+0000 7f43893a0640 10 monclient: get_auth_request con 0x7f4270077260 auth_method 0 2024-09-14T11:14:20.211 INFO:tasks.workunit.client.0.smithi050.stderr: -450> 2024-09-14T11:14:19.861+0000 7f438a3a2640 10 monclient: get_auth_request con 0x5596df89ebc0 auth_method 0 2024-09-14T11:14:20.211 INFO:tasks.workunit.client.0.smithi050.stderr: -449> 2024-09-14T11:14:19.862+0000 7f4389ba1640 10 monclient: get_auth_request con 0x5596df8ab810 auth_method 0 2024-09-14T11:14:20.211 INFO:tasks.workunit.client.0.smithi050.stderr: -448> 2024-09-14T11:14:19.863+0000 7f43893a0640 10 monclient: get_auth_request con 0x5596df8afb70 auth_method 0 2024-09-14T11:14:20.211 INFO:tasks.workunit.client.0.smithi050.stderr: -447> 2024-09-14T11:14:19.864+0000 7f438c0b7800 10 monclient: build_initial_monmap 2024-09-14T11:14:20.211 INFO:tasks.workunit.client.0.smithi050.stderr: -446> 2024-09-14T11:14:19.864+0000 7f438c0b7800 1 build_initial for_mkfs: 0 2024-09-14T11:14:20.211 INFO:tasks.workunit.client.0.smithi050.stderr: -445> 2024-09-14T11:14:19.864+0000 7f438c0b7800 10 monclient: monmap: 2024-09-14T11:14:20.211 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:14:20.211 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:20.211 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:14:20.211 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:14:20.211 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:20.211 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:20.211 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:14:20.211 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:14:20.212 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:14:20.212 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.212 INFO:tasks.workunit.client.0.smithi050.stderr: -444> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding auth protocol: cephx 2024-09-14T11:14:20.212 INFO:tasks.workunit.client.0.smithi050.stderr: -443> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding auth protocol: cephx 2024-09-14T11:14:20.212 INFO:tasks.workunit.client.0.smithi050.stderr: -442> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding auth protocol: cephx 2024-09-14T11:14:20.212 INFO:tasks.workunit.client.0.smithi050.stderr: -441> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding con mode: secure 2024-09-14T11:14:20.212 INFO:tasks.workunit.client.0.smithi050.stderr: -440> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding con mode: crc 2024-09-14T11:14:20.212 INFO:tasks.workunit.client.0.smithi050.stderr: -439> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding con mode: secure 2024-09-14T11:14:20.212 INFO:tasks.workunit.client.0.smithi050.stderr: -438> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding con mode: crc 2024-09-14T11:14:20.212 INFO:tasks.workunit.client.0.smithi050.stderr: -437> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding con mode: secure 2024-09-14T11:14:20.212 INFO:tasks.workunit.client.0.smithi050.stderr: -436> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding con mode: crc 2024-09-14T11:14:20.212 INFO:tasks.workunit.client.0.smithi050.stderr: -435> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding con mode: crc 2024-09-14T11:14:20.213 INFO:tasks.workunit.client.0.smithi050.stderr: -434> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding con mode: secure 2024-09-14T11:14:20.213 INFO:tasks.workunit.client.0.smithi050.stderr: -433> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding con mode: crc 2024-09-14T11:14:20.213 INFO:tasks.workunit.client.0.smithi050.stderr: -432> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding con mode: secure 2024-09-14T11:14:20.213 INFO:tasks.workunit.client.0.smithi050.stderr: -431> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding con mode: crc 2024-09-14T11:14:20.213 INFO:tasks.workunit.client.0.smithi050.stderr: -430> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b4ad0) adding con mode: secure 2024-09-14T11:14:20.213 INFO:tasks.workunit.client.0.smithi050.stderr: -429> 2024-09-14T11:14:19.864+0000 7f438c0b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:20.213 INFO:tasks.workunit.client.0.smithi050.stderr: -428> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command objecter_requests cmddesc objecter_requests hook 0x5596df8b8020 EEXIST 2024-09-14T11:14:20.213 INFO:tasks.workunit.client.0.smithi050.stderr: -427> 2024-09-14T11:14:19.864+0000 7f438c0b7800 10 monclient: init 2024-09-14T11:14:20.213 INFO:tasks.workunit.client.0.smithi050.stderr: -426> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding auth protocol: cephx 2024-09-14T11:14:20.213 INFO:tasks.workunit.client.0.smithi050.stderr: -425> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding auth protocol: cephx 2024-09-14T11:14:20.213 INFO:tasks.workunit.client.0.smithi050.stderr: -424> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding auth protocol: cephx 2024-09-14T11:14:20.213 INFO:tasks.workunit.client.0.smithi050.stderr: -423> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding con mode: secure 2024-09-14T11:14:20.213 INFO:tasks.workunit.client.0.smithi050.stderr: -422> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding con mode: crc 2024-09-14T11:14:20.214 INFO:tasks.workunit.client.0.smithi050.stderr: -421> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding con mode: secure 2024-09-14T11:14:20.214 INFO:tasks.workunit.client.0.smithi050.stderr: -420> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding con mode: crc 2024-09-14T11:14:20.214 INFO:tasks.workunit.client.0.smithi050.stderr: -419> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding con mode: secure 2024-09-14T11:14:20.214 INFO:tasks.workunit.client.0.smithi050.stderr: -418> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding con mode: crc 2024-09-14T11:14:20.214 INFO:tasks.workunit.client.0.smithi050.stderr: -417> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding con mode: crc 2024-09-14T11:14:20.214 INFO:tasks.workunit.client.0.smithi050.stderr: -416> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding con mode: secure 2024-09-14T11:14:20.214 INFO:tasks.workunit.client.0.smithi050.stderr: -415> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding con mode: crc 2024-09-14T11:14:20.214 INFO:tasks.workunit.client.0.smithi050.stderr: -414> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding con mode: secure 2024-09-14T11:14:20.214 INFO:tasks.workunit.client.0.smithi050.stderr: -413> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding con mode: crc 2024-09-14T11:14:20.214 INFO:tasks.workunit.client.0.smithi050.stderr: -412> 2024-09-14T11:14:19.864+0000 7f438c0b7800 5 AuthRegistry(0x5596df8b3098) adding con mode: secure 2024-09-14T11:14:20.214 INFO:tasks.workunit.client.0.smithi050.stderr: -411> 2024-09-14T11:14:19.865+0000 7f438c0b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:20.214 INFO:tasks.workunit.client.0.smithi050.stderr: -410> 2024-09-14T11:14:19.865+0000 7f438c0b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:20.214 INFO:tasks.workunit.client.0.smithi050.stderr: -409> 2024-09-14T11:14:19.865+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command rotate-key cmddesc rotate-key hook 0x5596df8b31e0 EEXIST 2024-09-14T11:14:20.215 INFO:tasks.workunit.client.0.smithi050.stderr: -408> 2024-09-14T11:14:19.865+0000 7f438c0b7800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:20.215 INFO:tasks.workunit.client.0.smithi050.stderr: -407> 2024-09-14T11:14:19.865+0000 7f438c0b7800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:14:20.215 INFO:tasks.workunit.client.0.smithi050.stderr: -406> 2024-09-14T11:14:19.865+0000 7f438c0b7800 10 monclient(hunting): picked mon.noname-b con 0x5596df8dc340 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:14:20.215 INFO:tasks.workunit.client.0.smithi050.stderr: -405> 2024-09-14T11:14:19.865+0000 7f438c0b7800 10 monclient(hunting): picked mon.noname-a con 0x5596df8de2c0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:14:20.215 INFO:tasks.workunit.client.0.smithi050.stderr: -404> 2024-09-14T11:14:19.865+0000 7f438c0b7800 10 monclient(hunting): picked mon.noname-c con 0x5596df8f3df0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:14:20.215 INFO:tasks.workunit.client.0.smithi050.stderr: -403> 2024-09-14T11:14:19.865+0000 7f438c0b7800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:20.215 INFO:tasks.workunit.client.0.smithi050.stderr: -402> 2024-09-14T11:14:19.865+0000 7f438c0b7800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:20.215 INFO:tasks.workunit.client.0.smithi050.stderr: -401> 2024-09-14T11:14:19.865+0000 7f438c0b7800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:20.215 INFO:tasks.workunit.client.0.smithi050.stderr: -400> 2024-09-14T11:14:19.865+0000 7f438c0b7800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:20.215 INFO:tasks.workunit.client.0.smithi050.stderr: -399> 2024-09-14T11:14:19.865+0000 7f438c0b7800 10 monclient(hunting): authenticate will time out at 2512.503421s 2024-09-14T11:14:20.215 INFO:tasks.workunit.client.0.smithi050.stderr: -398> 2024-09-14T11:14:19.865+0000 7f438a3a2640 10 monclient(hunting): get_auth_request con 0x5596df8f3df0 auth_method 0 2024-09-14T11:14:20.215 INFO:tasks.workunit.client.0.smithi050.stderr: -397> 2024-09-14T11:14:19.865+0000 7f438a3a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:20.215 INFO:tasks.workunit.client.0.smithi050.stderr: -396> 2024-09-14T11:14:19.865+0000 7f438a3a2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:20.215 INFO:tasks.workunit.client.0.smithi050.stderr: -395> 2024-09-14T11:14:19.865+0000 7f438a3a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:20.215 INFO:tasks.workunit.client.0.smithi050.stderr: -394> 2024-09-14T11:14:19.865+0000 7f43893a0640 10 monclient(hunting): get_auth_request con 0x5596df8de2c0 auth_method 0 2024-09-14T11:14:20.216 INFO:tasks.workunit.client.0.smithi050.stderr: -393> 2024-09-14T11:14:19.865+0000 7f43893a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:20.216 INFO:tasks.workunit.client.0.smithi050.stderr: -392> 2024-09-14T11:14:19.865+0000 7f43893a0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:20.216 INFO:tasks.workunit.client.0.smithi050.stderr: -391> 2024-09-14T11:14:19.865+0000 7f43893a0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:20.216 INFO:tasks.workunit.client.0.smithi050.stderr: -390> 2024-09-14T11:14:19.865+0000 7f4389ba1640 10 monclient(hunting): get_auth_request con 0x5596df8dc340 auth_method 0 2024-09-14T11:14:20.216 INFO:tasks.workunit.client.0.smithi050.stderr: -389> 2024-09-14T11:14:19.865+0000 7f4389ba1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:20.216 INFO:tasks.workunit.client.0.smithi050.stderr: -388> 2024-09-14T11:14:19.865+0000 7f4389ba1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:20.216 INFO:tasks.workunit.client.0.smithi050.stderr: -387> 2024-09-14T11:14:19.865+0000 7f4389ba1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:20.216 INFO:tasks.workunit.client.0.smithi050.stderr: -386> 2024-09-14T11:14:19.865+0000 7f438a3a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:20.216 INFO:tasks.workunit.client.0.smithi050.stderr: -385> 2024-09-14T11:14:19.865+0000 7f438a3a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:20.216 INFO:tasks.workunit.client.0.smithi050.stderr: -384> 2024-09-14T11:14:19.865+0000 7f438a3a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:20.216 INFO:tasks.workunit.client.0.smithi050.stderr: -383> 2024-09-14T11:14:19.865+0000 7f43893a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:20.216 INFO:tasks.workunit.client.0.smithi050.stderr: -382> 2024-09-14T11:14:19.865+0000 7f43893a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:20.217 INFO:tasks.workunit.client.0.smithi050.stderr: -381> 2024-09-14T11:14:19.865+0000 7f43893a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:20.217 INFO:tasks.workunit.client.0.smithi050.stderr: -380> 2024-09-14T11:14:19.865+0000 7f4389ba1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:20.217 INFO:tasks.workunit.client.0.smithi050.stderr: -379> 2024-09-14T11:14:19.865+0000 7f4389ba1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:20.217 INFO:tasks.workunit.client.0.smithi050.stderr: -378> 2024-09-14T11:14:19.865+0000 7f4389ba1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:20.217 INFO:tasks.workunit.client.0.smithi050.stderr: -377> 2024-09-14T11:14:19.865+0000 7f438a3a2640 10 monclient(hunting): handle_auth_done global_id 7646 payload 824 2024-09-14T11:14:20.217 INFO:tasks.workunit.client.0.smithi050.stderr: -376> 2024-09-14T11:14:19.865+0000 7f438a3a2640 10 monclient: _finish_hunting 0 2024-09-14T11:14:20.217 INFO:tasks.workunit.client.0.smithi050.stderr: -375> 2024-09-14T11:14:19.865+0000 7f438a3a2640 1 monclient: found mon.noname-c 2024-09-14T11:14:20.217 INFO:tasks.workunit.client.0.smithi050.stderr: -374> 2024-09-14T11:14:19.865+0000 7f438a3a2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:14:20.217 INFO:tasks.workunit.client.0.smithi050.stderr: -373> 2024-09-14T11:14:19.866+0000 7f426f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:20.218 INFO:tasks.workunit.client.0.smithi050.stderr: -372> 2024-09-14T11:14:19.866+0000 7f426f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:20.218 INFO:tasks.workunit.client.0.smithi050.stderr: -371> 2024-09-14T11:14:19.866+0000 7f426f7fe640 10 monclient: dump: 2024-09-14T11:14:20.218 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:20.218 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:20.218 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.218 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.218 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:20.218 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:20.218 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:20.218 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:20.218 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:20.219 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.219 INFO:tasks.workunit.client.0.smithi050.stderr: -370> 2024-09-14T11:14:19.866+0000 7f426f7fe640 10 monclient: _finish_auth 0 2024-09-14T11:14:20.219 INFO:tasks.workunit.client.0.smithi050.stderr: -369> 2024-09-14T11:14:19.866+0000 7f426f7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:14:20.219 INFO:tasks.workunit.client.0.smithi050.stderr: -368> 2024-09-14T11:14:19.866+0000 7f426f7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:20.219 INFO:tasks.workunit.client.0.smithi050.stderr: -367> 2024-09-14T11:14:19.866+0000 7f426f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:20.219 INFO:tasks.workunit.client.0.smithi050.stderr: -366> 2024-09-14T11:14:19.866+0000 7f426f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:20.219 INFO:tasks.workunit.client.0.smithi050.stderr: -365> 2024-09-14T11:14:19.866+0000 7f426f7fe640 10 monclient: dump: 2024-09-14T11:14:20.219 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:20.219 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:20.219 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.219 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.219 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:20.220 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:20.220 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:20.220 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:20.220 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:20.220 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.220 INFO:tasks.workunit.client.0.smithi050.stderr: -364> 2024-09-14T11:14:19.866+0000 7f438c0b7800 5 monclient: authenticate success, global_id 7646 2024-09-14T11:14:20.220 INFO:tasks.workunit.client.0.smithi050.stderr: -363> 2024-09-14T11:14:19.866+0000 7f438c0b7800 10 monclient: _renew_subs 2024-09-14T11:14:20.220 INFO:tasks.workunit.client.0.smithi050.stderr: -362> 2024-09-14T11:14:19.866+0000 7f438c0b7800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:20.220 INFO:tasks.workunit.client.0.smithi050.stderr: -361> 2024-09-14T11:14:19.866+0000 7f438aba3640 4 set_mon_vals no callback set 2024-09-14T11:14:20.220 INFO:tasks.workunit.client.0.smithi050.stderr: -360> 2024-09-14T11:14:19.866+0000 7f438c0b7800 10 monclient: _renew_subs 2024-09-14T11:14:20.220 INFO:tasks.workunit.client.0.smithi050.stderr: -359> 2024-09-14T11:14:19.866+0000 7f438c0b7800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:20.221 INFO:tasks.workunit.client.0.smithi050.stderr: -358> 2024-09-14T11:14:19.868+0000 7f426f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:14:20.221 INFO:tasks.workunit.client.0.smithi050.stderr: -357> 2024-09-14T11:14:19.868+0000 7f426f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:14:20.221 INFO:tasks.workunit.client.0.smithi050.stderr: -356> 2024-09-14T11:14:19.868+0000 7f426f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:14:20.221 INFO:tasks.workunit.client.0.smithi050.stderr: -355> 2024-09-14T11:14:19.868+0000 7f4389ba1640 10 monclient: get_auth_request con 0x7f4264077140 auth_method 0 2024-09-14T11:14:20.221 INFO:tasks.workunit.client.0.smithi050.stderr: -354> 2024-09-14T11:14:19.868+0000 7f438c0b7800 10 monclient: get_monmap_and_config 2024-09-14T11:14:20.221 INFO:tasks.workunit.client.0.smithi050.stderr: -353> 2024-09-14T11:14:19.868+0000 7f438c0b7800 10 monclient: build_initial_monmap 2024-09-14T11:14:20.221 INFO:tasks.workunit.client.0.smithi050.stderr: -352> 2024-09-14T11:14:19.868+0000 7f438c0b7800 1 build_initial for_mkfs: 0 2024-09-14T11:14:20.221 INFO:tasks.workunit.client.0.smithi050.stderr: -351> 2024-09-14T11:14:19.868+0000 7f438c0b7800 10 monclient: monmap: 2024-09-14T11:14:20.221 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:14:20.221 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:20.221 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:14:20.221 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:14:20.221 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:20.222 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:20.222 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:14:20.222 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:14:20.222 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:14:20.222 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.222 INFO:tasks.workunit.client.0.smithi050.stderr: -350> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding auth protocol: cephx 2024-09-14T11:14:20.222 INFO:tasks.workunit.client.0.smithi050.stderr: -349> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding auth protocol: cephx 2024-09-14T11:14:20.222 INFO:tasks.workunit.client.0.smithi050.stderr: -348> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding auth protocol: cephx 2024-09-14T11:14:20.222 INFO:tasks.workunit.client.0.smithi050.stderr: -347> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding con mode: secure 2024-09-14T11:14:20.222 INFO:tasks.workunit.client.0.smithi050.stderr: -346> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding con mode: crc 2024-09-14T11:14:20.222 INFO:tasks.workunit.client.0.smithi050.stderr: -345> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding con mode: secure 2024-09-14T11:14:20.222 INFO:tasks.workunit.client.0.smithi050.stderr: -344> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding con mode: crc 2024-09-14T11:14:20.222 INFO:tasks.workunit.client.0.smithi050.stderr: -343> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding con mode: secure 2024-09-14T11:14:20.222 INFO:tasks.workunit.client.0.smithi050.stderr: -342> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding con mode: crc 2024-09-14T11:14:20.223 INFO:tasks.workunit.client.0.smithi050.stderr: -341> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding con mode: crc 2024-09-14T11:14:20.223 INFO:tasks.workunit.client.0.smithi050.stderr: -340> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding con mode: secure 2024-09-14T11:14:20.223 INFO:tasks.workunit.client.0.smithi050.stderr: -339> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding con mode: crc 2024-09-14T11:14:20.223 INFO:tasks.workunit.client.0.smithi050.stderr: -338> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding con mode: secure 2024-09-14T11:14:20.223 INFO:tasks.workunit.client.0.smithi050.stderr: -337> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding con mode: crc 2024-09-14T11:14:20.223 INFO:tasks.workunit.client.0.smithi050.stderr: -336> 2024-09-14T11:14:19.868+0000 7f438c0b7800 5 AuthRegistry(0x5596df8fbed0) adding con mode: secure 2024-09-14T11:14:20.223 INFO:tasks.workunit.client.0.smithi050.stderr: -335> 2024-09-14T11:14:19.868+0000 7f438c0b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:20.223 INFO:tasks.workunit.client.0.smithi050.stderr: -334> 2024-09-14T11:14:19.869+0000 7f438c0b7800 10 monclient: init 2024-09-14T11:14:20.223 INFO:tasks.workunit.client.0.smithi050.stderr: -333> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding auth protocol: cephx 2024-09-14T11:14:20.223 INFO:tasks.workunit.client.0.smithi050.stderr: -332> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding auth protocol: cephx 2024-09-14T11:14:20.223 INFO:tasks.workunit.client.0.smithi050.stderr: -331> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding auth protocol: cephx 2024-09-14T11:14:20.223 INFO:tasks.workunit.client.0.smithi050.stderr: -330> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding con mode: secure 2024-09-14T11:14:20.223 INFO:tasks.workunit.client.0.smithi050.stderr: -329> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding con mode: crc 2024-09-14T11:14:20.223 INFO:tasks.workunit.client.0.smithi050.stderr: -328> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding con mode: secure 2024-09-14T11:14:20.224 INFO:tasks.workunit.client.0.smithi050.stderr: -327> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding con mode: crc 2024-09-14T11:14:20.224 INFO:tasks.workunit.client.0.smithi050.stderr: -326> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding con mode: secure 2024-09-14T11:14:20.224 INFO:tasks.workunit.client.0.smithi050.stderr: -325> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding con mode: crc 2024-09-14T11:14:20.224 INFO:tasks.workunit.client.0.smithi050.stderr: -324> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding con mode: crc 2024-09-14T11:14:20.224 INFO:tasks.workunit.client.0.smithi050.stderr: -323> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding con mode: secure 2024-09-14T11:14:20.224 INFO:tasks.workunit.client.0.smithi050.stderr: -322> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding con mode: crc 2024-09-14T11:14:20.224 INFO:tasks.workunit.client.0.smithi050.stderr: -321> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding con mode: secure 2024-09-14T11:14:20.224 INFO:tasks.workunit.client.0.smithi050.stderr: -320> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding con mode: crc 2024-09-14T11:14:20.224 INFO:tasks.workunit.client.0.smithi050.stderr: -319> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 AuthRegistry(0x7ffd7333fd10) adding con mode: secure 2024-09-14T11:14:20.224 INFO:tasks.workunit.client.0.smithi050.stderr: -318> 2024-09-14T11:14:19.869+0000 7f438c0b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:20.224 INFO:tasks.workunit.client.0.smithi050.stderr: -317> 2024-09-14T11:14:19.869+0000 7f438c0b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:20.225 INFO:tasks.workunit.client.0.smithi050.stderr: -316> 2024-09-14T11:14:19.869+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command rotate-key cmddesc rotate-key hook 0x7ffd7333fe58 EEXIST 2024-09-14T11:14:20.225 INFO:tasks.workunit.client.0.smithi050.stderr: -315> 2024-09-14T11:14:19.869+0000 7f438c0b7800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:20.225 INFO:tasks.workunit.client.0.smithi050.stderr: -314> 2024-09-14T11:14:19.869+0000 7f438c0b7800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:14:20.225 INFO:tasks.workunit.client.0.smithi050.stderr: -313> 2024-09-14T11:14:19.869+0000 7f438c0b7800 10 monclient(hunting): picked mon.noname-b con 0x5596df930590 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:14:20.225 INFO:tasks.workunit.client.0.smithi050.stderr: -312> 2024-09-14T11:14:19.869+0000 7f438c0b7800 10 monclient(hunting): picked mon.noname-c con 0x5596df9014e0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:14:20.225 INFO:tasks.workunit.client.0.smithi050.stderr: -311> 2024-09-14T11:14:19.869+0000 7f438c0b7800 10 monclient(hunting): picked mon.noname-a con 0x5596df92be30 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:14:20.225 INFO:tasks.workunit.client.0.smithi050.stderr: -310> 2024-09-14T11:14:19.869+0000 7f438c0b7800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:20.225 INFO:tasks.workunit.client.0.smithi050.stderr: -309> 2024-09-14T11:14:19.869+0000 7f438c0b7800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:20.225 INFO:tasks.workunit.client.0.smithi050.stderr: -308> 2024-09-14T11:14:19.869+0000 7f438c0b7800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:20.225 INFO:tasks.workunit.client.0.smithi050.stderr: -307> 2024-09-14T11:14:19.869+0000 7f438c0b7800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:20.225 INFO:tasks.workunit.client.0.smithi050.stderr: -306> 2024-09-14T11:14:19.869+0000 7f438c0b7800 10 monclient(hunting): authenticate will time out at 2512.507543s 2024-09-14T11:14:20.225 INFO:tasks.workunit.client.0.smithi050.stderr: -305> 2024-09-14T11:14:19.869+0000 7f43893a0640 10 monclient(hunting): get_auth_request con 0x5596df9014e0 auth_method 0 2024-09-14T11:14:20.225 INFO:tasks.workunit.client.0.smithi050.stderr: -304> 2024-09-14T11:14:19.869+0000 7f43893a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:20.225 INFO:tasks.workunit.client.0.smithi050.stderr: -303> 2024-09-14T11:14:19.869+0000 7f43893a0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:20.226 INFO:tasks.workunit.client.0.smithi050.stderr: -302> 2024-09-14T11:14:19.869+0000 7f43893a0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:20.226 INFO:tasks.workunit.client.0.smithi050.stderr: -301> 2024-09-14T11:14:19.869+0000 7f438a3a2640 10 monclient(hunting): get_auth_request con 0x5596df92be30 auth_method 0 2024-09-14T11:14:20.226 INFO:tasks.workunit.client.0.smithi050.stderr: -300> 2024-09-14T11:14:19.869+0000 7f438a3a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:20.226 INFO:tasks.workunit.client.0.smithi050.stderr: -299> 2024-09-14T11:14:19.869+0000 7f438a3a2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:20.226 INFO:tasks.workunit.client.0.smithi050.stderr: -298> 2024-09-14T11:14:19.869+0000 7f438a3a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:20.226 INFO:tasks.workunit.client.0.smithi050.stderr: -297> 2024-09-14T11:14:19.869+0000 7f43893a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:20.226 INFO:tasks.workunit.client.0.smithi050.stderr: -296> 2024-09-14T11:14:19.869+0000 7f43893a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:20.226 INFO:tasks.workunit.client.0.smithi050.stderr: -295> 2024-09-14T11:14:19.869+0000 7f43893a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:20.226 INFO:tasks.workunit.client.0.smithi050.stderr: -294> 2024-09-14T11:14:19.869+0000 7f438a3a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:20.226 INFO:tasks.workunit.client.0.smithi050.stderr: -293> 2024-09-14T11:14:19.869+0000 7f438a3a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:20.226 INFO:tasks.workunit.client.0.smithi050.stderr: -292> 2024-09-14T11:14:19.869+0000 7f438a3a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:20.226 INFO:tasks.workunit.client.0.smithi050.stderr: -291> 2024-09-14T11:14:19.869+0000 7f4389ba1640 10 monclient(hunting): get_auth_request con 0x5596df930590 auth_method 0 2024-09-14T11:14:20.226 INFO:tasks.workunit.client.0.smithi050.stderr: -290> 2024-09-14T11:14:19.869+0000 7f4389ba1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:20.227 INFO:tasks.workunit.client.0.smithi050.stderr: -289> 2024-09-14T11:14:19.869+0000 7f4389ba1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:20.227 INFO:tasks.workunit.client.0.smithi050.stderr: -288> 2024-09-14T11:14:19.869+0000 7f4389ba1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:20.227 INFO:tasks.workunit.client.0.smithi050.stderr: -287> 2024-09-14T11:14:19.869+0000 7f43893a0640 10 monclient(hunting): handle_auth_done global_id 7649 payload 274 2024-09-14T11:14:20.227 INFO:tasks.workunit.client.0.smithi050.stderr: -286> 2024-09-14T11:14:19.869+0000 7f43893a0640 10 monclient: _finish_hunting 0 2024-09-14T11:14:20.227 INFO:tasks.workunit.client.0.smithi050.stderr: -285> 2024-09-14T11:14:19.869+0000 7f43893a0640 1 monclient: found mon.noname-c 2024-09-14T11:14:20.227 INFO:tasks.workunit.client.0.smithi050.stderr: -284> 2024-09-14T11:14:19.869+0000 7f43893a0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:14:20.227 INFO:tasks.workunit.client.0.smithi050.stderr: -283> 2024-09-14T11:14:19.870+0000 7f426d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:20.227 INFO:tasks.workunit.client.0.smithi050.stderr: -282> 2024-09-14T11:14:19.870+0000 7f426d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:20.227 INFO:tasks.workunit.client.0.smithi050.stderr: -281> 2024-09-14T11:14:19.870+0000 7f426d7fa640 10 monclient: dump: 2024-09-14T11:14:20.227 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:20.227 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:20.227 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.227 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.227 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:20.227 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:20.228 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:20.228 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:20.228 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:20.228 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.228 INFO:tasks.workunit.client.0.smithi050.stderr: -280> 2024-09-14T11:14:19.870+0000 7f426d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:14:20.228 INFO:tasks.workunit.client.0.smithi050.stderr: -279> 2024-09-14T11:14:19.870+0000 7f426d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:14:20.228 INFO:tasks.workunit.client.0.smithi050.stderr: -278> 2024-09-14T11:14:19.870+0000 7f426d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:20.228 INFO:tasks.workunit.client.0.smithi050.stderr: -277> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 monclient: authenticate success, global_id 7649 2024-09-14T11:14:20.228 INFO:tasks.workunit.client.0.smithi050.stderr: -276> 2024-09-14T11:14:19.870+0000 7f438c0b7800 10 monclient: get_monmap_and_config success 2024-09-14T11:14:20.228 INFO:tasks.workunit.client.0.smithi050.stderr: -275> 2024-09-14T11:14:19.870+0000 7f438c0b7800 4 set_mon_vals no callback set 2024-09-14T11:14:20.228 INFO:tasks.workunit.client.0.smithi050.stderr: -274> 2024-09-14T11:14:19.870+0000 7f426d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:20.229 INFO:tasks.workunit.client.0.smithi050.stderr: -273> 2024-09-14T11:14:19.870+0000 7f426d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:20.229 INFO:tasks.workunit.client.0.smithi050.stderr: -272> 2024-09-14T11:14:19.870+0000 7f426d7fa640 10 monclient: dump: 2024-09-14T11:14:20.229 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:20.229 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:20.229 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.229 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.229 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:20.229 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:20.229 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:20.229 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:20.229 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:20.229 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.229 INFO:tasks.workunit.client.0.smithi050.stderr: -271> 2024-09-14T11:14:19.870+0000 7f438c0b7800 10 monclient: shutdown 2024-09-14T11:14:20.230 INFO:tasks.workunit.client.0.smithi050.stderr: -270> 2024-09-14T11:14:19.870+0000 7f438c0b7800 10 monclient: build_initial_monmap 2024-09-14T11:14:20.230 INFO:tasks.workunit.client.0.smithi050.stderr: -269> 2024-09-14T11:14:19.870+0000 7f438c0b7800 1 build_initial for_mkfs: 0 2024-09-14T11:14:20.230 INFO:tasks.workunit.client.0.smithi050.stderr: -268> 2024-09-14T11:14:19.870+0000 7f438c0b7800 10 monclient: monmap: 2024-09-14T11:14:20.230 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:14:20.230 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:20.230 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:14:20.230 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:14:20.230 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:20.230 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:20.230 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:14:20.230 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:14:20.230 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:14:20.230 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.230 INFO:tasks.workunit.client.0.smithi050.stderr: -267> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding auth protocol: cephx 2024-09-14T11:14:20.231 INFO:tasks.workunit.client.0.smithi050.stderr: -266> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding auth protocol: cephx 2024-09-14T11:14:20.231 INFO:tasks.workunit.client.0.smithi050.stderr: -265> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding auth protocol: cephx 2024-09-14T11:14:20.231 INFO:tasks.workunit.client.0.smithi050.stderr: -264> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding con mode: secure 2024-09-14T11:14:20.231 INFO:tasks.workunit.client.0.smithi050.stderr: -263> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding con mode: crc 2024-09-14T11:14:20.231 INFO:tasks.workunit.client.0.smithi050.stderr: -262> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding con mode: secure 2024-09-14T11:14:20.231 INFO:tasks.workunit.client.0.smithi050.stderr: -261> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding con mode: crc 2024-09-14T11:14:20.231 INFO:tasks.workunit.client.0.smithi050.stderr: -260> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding con mode: secure 2024-09-14T11:14:20.231 INFO:tasks.workunit.client.0.smithi050.stderr: -259> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding con mode: crc 2024-09-14T11:14:20.231 INFO:tasks.workunit.client.0.smithi050.stderr: -258> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding con mode: crc 2024-09-14T11:14:20.231 INFO:tasks.workunit.client.0.smithi050.stderr: -257> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding con mode: secure 2024-09-14T11:14:20.231 INFO:tasks.workunit.client.0.smithi050.stderr: -256> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding con mode: crc 2024-09-14T11:14:20.231 INFO:tasks.workunit.client.0.smithi050.stderr: -255> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding con mode: secure 2024-09-14T11:14:20.231 INFO:tasks.workunit.client.0.smithi050.stderr: -254> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding con mode: crc 2024-09-14T11:14:20.231 INFO:tasks.workunit.client.0.smithi050.stderr: -253> 2024-09-14T11:14:19.870+0000 7f438c0b7800 5 AuthRegistry(0x5596df92c760) adding con mode: secure 2024-09-14T11:14:20.231 INFO:tasks.workunit.client.0.smithi050.stderr: -252> 2024-09-14T11:14:19.871+0000 7f438c0b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:20.232 INFO:tasks.workunit.client.0.smithi050.stderr: -251> 2024-09-14T11:14:19.871+0000 7f438c0b7800 1 librados: starting msgr at 2024-09-14T11:14:20.232 INFO:tasks.workunit.client.0.smithi050.stderr: -250> 2024-09-14T11:14:19.871+0000 7f438c0b7800 1 librados: starting objecter 2024-09-14T11:14:20.232 INFO:tasks.workunit.client.0.smithi050.stderr: -249> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command objecter_requests cmddesc objecter_requests hook 0x5596df7a6680 EEXIST 2024-09-14T11:14:20.232 INFO:tasks.workunit.client.0.smithi050.stderr: -248> 2024-09-14T11:14:19.871+0000 7f438c0b7800 1 librados: setting wanted keys 2024-09-14T11:14:20.232 INFO:tasks.workunit.client.0.smithi050.stderr: -247> 2024-09-14T11:14:19.871+0000 7f438c0b7800 1 librados: calling monclient init 2024-09-14T11:14:20.232 INFO:tasks.workunit.client.0.smithi050.stderr: -246> 2024-09-14T11:14:19.871+0000 7f438c0b7800 10 monclient: init 2024-09-14T11:14:20.232 INFO:tasks.workunit.client.0.smithi050.stderr: -245> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding auth protocol: cephx 2024-09-14T11:14:20.232 INFO:tasks.workunit.client.0.smithi050.stderr: -244> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding auth protocol: cephx 2024-09-14T11:14:20.232 INFO:tasks.workunit.client.0.smithi050.stderr: -243> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding auth protocol: cephx 2024-09-14T11:14:20.232 INFO:tasks.workunit.client.0.smithi050.stderr: -242> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding con mode: secure 2024-09-14T11:14:20.232 INFO:tasks.workunit.client.0.smithi050.stderr: -241> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding con mode: crc 2024-09-14T11:14:20.232 INFO:tasks.workunit.client.0.smithi050.stderr: -240> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding con mode: secure 2024-09-14T11:14:20.232 INFO:tasks.workunit.client.0.smithi050.stderr: -239> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding con mode: crc 2024-09-14T11:14:20.233 INFO:tasks.workunit.client.0.smithi050.stderr: -238> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding con mode: secure 2024-09-14T11:14:20.233 INFO:tasks.workunit.client.0.smithi050.stderr: -237> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding con mode: crc 2024-09-14T11:14:20.233 INFO:tasks.workunit.client.0.smithi050.stderr: -236> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding con mode: crc 2024-09-14T11:14:20.233 INFO:tasks.workunit.client.0.smithi050.stderr: -235> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding con mode: secure 2024-09-14T11:14:20.233 INFO:tasks.workunit.client.0.smithi050.stderr: -234> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding con mode: crc 2024-09-14T11:14:20.233 INFO:tasks.workunit.client.0.smithi050.stderr: -233> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding con mode: secure 2024-09-14T11:14:20.233 INFO:tasks.workunit.client.0.smithi050.stderr: -232> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding con mode: crc 2024-09-14T11:14:20.233 INFO:tasks.workunit.client.0.smithi050.stderr: -231> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 AuthRegistry(0x5596df8da570) adding con mode: secure 2024-09-14T11:14:20.233 INFO:tasks.workunit.client.0.smithi050.stderr: -230> 2024-09-14T11:14:19.871+0000 7f438c0b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:20.233 INFO:tasks.workunit.client.0.smithi050.stderr: -229> 2024-09-14T11:14:19.871+0000 7f438c0b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:20.233 INFO:tasks.workunit.client.0.smithi050.stderr: -228> 2024-09-14T11:14:19.871+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command rotate-key cmddesc rotate-key hook 0x5596df8da6b8 EEXIST 2024-09-14T11:14:20.233 INFO:tasks.workunit.client.0.smithi050.stderr: -227> 2024-09-14T11:14:19.871+0000 7f438c0b7800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:20.233 INFO:tasks.workunit.client.0.smithi050.stderr: -226> 2024-09-14T11:14:19.871+0000 7f438c0b7800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:14:20.234 INFO:tasks.workunit.client.0.smithi050.stderr: -225> 2024-09-14T11:14:19.871+0000 7f438c0b7800 10 monclient(hunting): picked mon.noname-a con 0x5596df9014e0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:14:20.234 INFO:tasks.workunit.client.0.smithi050.stderr: -224> 2024-09-14T11:14:19.871+0000 7f438c0b7800 10 monclient(hunting): picked mon.noname-c con 0x5596df92be30 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:14:20.234 INFO:tasks.workunit.client.0.smithi050.stderr: -223> 2024-09-14T11:14:19.871+0000 7f438c0b7800 10 monclient(hunting): picked mon.noname-b con 0x5596df930590 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:14:20.234 INFO:tasks.workunit.client.0.smithi050.stderr: -222> 2024-09-14T11:14:19.871+0000 7f438c0b7800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:20.234 INFO:tasks.workunit.client.0.smithi050.stderr: -221> 2024-09-14T11:14:19.871+0000 7f438c0b7800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:20.234 INFO:tasks.workunit.client.0.smithi050.stderr: -220> 2024-09-14T11:14:19.871+0000 7f438c0b7800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:20.234 INFO:tasks.workunit.client.0.smithi050.stderr: -219> 2024-09-14T11:14:19.871+0000 7f438c0b7800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:20.234 INFO:tasks.workunit.client.0.smithi050.stderr: -218> 2024-09-14T11:14:19.871+0000 7f438c0b7800 10 monclient(hunting): authenticate will time out at 2512.509843s 2024-09-14T11:14:20.234 INFO:tasks.workunit.client.0.smithi050.stderr: -217> 2024-09-14T11:14:19.871+0000 7f4389ba1640 10 monclient(hunting): get_auth_request con 0x5596df9014e0 auth_method 0 2024-09-14T11:14:20.234 INFO:tasks.workunit.client.0.smithi050.stderr: -216> 2024-09-14T11:14:19.871+0000 7f4389ba1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:20.234 INFO:tasks.workunit.client.0.smithi050.stderr: -215> 2024-09-14T11:14:19.871+0000 7f4389ba1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:20.234 INFO:tasks.workunit.client.0.smithi050.stderr: -214> 2024-09-14T11:14:19.871+0000 7f4389ba1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:20.234 INFO:tasks.workunit.client.0.smithi050.stderr: -213> 2024-09-14T11:14:19.871+0000 7f43893a0640 10 monclient(hunting): get_auth_request con 0x5596df92be30 auth_method 0 2024-09-14T11:14:20.235 INFO:tasks.workunit.client.0.smithi050.stderr: -212> 2024-09-14T11:14:19.871+0000 7f43893a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:20.235 INFO:tasks.workunit.client.0.smithi050.stderr: -211> 2024-09-14T11:14:19.871+0000 7f43893a0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:20.235 INFO:tasks.workunit.client.0.smithi050.stderr: -210> 2024-09-14T11:14:19.871+0000 7f43893a0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:20.235 INFO:tasks.workunit.client.0.smithi050.stderr: -209> 2024-09-14T11:14:19.872+0000 7f4389ba1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:20.235 INFO:tasks.workunit.client.0.smithi050.stderr: -208> 2024-09-14T11:14:19.872+0000 7f4389ba1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:20.235 INFO:tasks.workunit.client.0.smithi050.stderr: -207> 2024-09-14T11:14:19.872+0000 7f4389ba1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:20.235 INFO:tasks.workunit.client.0.smithi050.stderr: -206> 2024-09-14T11:14:19.872+0000 7f43893a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:20.235 INFO:tasks.workunit.client.0.smithi050.stderr: -205> 2024-09-14T11:14:19.872+0000 7f43893a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:20.235 INFO:tasks.workunit.client.0.smithi050.stderr: -204> 2024-09-14T11:14:19.872+0000 7f43893a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:20.235 INFO:tasks.workunit.client.0.smithi050.stderr: -203> 2024-09-14T11:14:19.872+0000 7f438a3a2640 10 monclient(hunting): get_auth_request con 0x5596df930590 auth_method 0 2024-09-14T11:14:20.235 INFO:tasks.workunit.client.0.smithi050.stderr: -202> 2024-09-14T11:14:19.872+0000 7f438a3a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:20.235 INFO:tasks.workunit.client.0.smithi050.stderr: -201> 2024-09-14T11:14:19.872+0000 7f438a3a2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:20.235 INFO:tasks.workunit.client.0.smithi050.stderr: -200> 2024-09-14T11:14:19.872+0000 7f438a3a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:20.236 INFO:tasks.workunit.client.0.smithi050.stderr: -199> 2024-09-14T11:14:19.872+0000 7f43893a0640 10 monclient(hunting): handle_auth_done global_id 7652 payload 824 2024-09-14T11:14:20.236 INFO:tasks.workunit.client.0.smithi050.stderr: -198> 2024-09-14T11:14:19.872+0000 7f43893a0640 10 monclient: _finish_hunting 0 2024-09-14T11:14:20.236 INFO:tasks.workunit.client.0.smithi050.stderr: -197> 2024-09-14T11:14:19.872+0000 7f43893a0640 1 monclient: found mon.noname-c 2024-09-14T11:14:20.236 INFO:tasks.workunit.client.0.smithi050.stderr: -196> 2024-09-14T11:14:19.872+0000 7f43893a0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:14:20.236 INFO:tasks.workunit.client.0.smithi050.stderr: -195> 2024-09-14T11:14:19.872+0000 7f425b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:20.236 INFO:tasks.workunit.client.0.smithi050.stderr: -194> 2024-09-14T11:14:19.872+0000 7f425b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:20.236 INFO:tasks.workunit.client.0.smithi050.stderr: -193> 2024-09-14T11:14:19.872+0000 7f425b7fe640 10 monclient: dump: 2024-09-14T11:14:20.236 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:20.236 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:20.236 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.236 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.236 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:20.237 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:20.237 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:20.237 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:20.237 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:20.237 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.237 INFO:tasks.workunit.client.0.smithi050.stderr: -192> 2024-09-14T11:14:19.872+0000 7f425b7fe640 10 monclient: _finish_auth 0 2024-09-14T11:14:20.237 INFO:tasks.workunit.client.0.smithi050.stderr: -191> 2024-09-14T11:14:19.872+0000 7f425b7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:14:20.237 INFO:tasks.workunit.client.0.smithi050.stderr: -190> 2024-09-14T11:14:19.872+0000 7f425b7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:20.237 INFO:tasks.workunit.client.0.smithi050.stderr: -189> 2024-09-14T11:14:19.872+0000 7f425b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:20.237 INFO:tasks.workunit.client.0.smithi050.stderr: -188> 2024-09-14T11:14:19.872+0000 7f425b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:20.237 INFO:tasks.workunit.client.0.smithi050.stderr: -187> 2024-09-14T11:14:19.872+0000 7f425b7fe640 10 monclient: dump: 2024-09-14T11:14:20.237 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:20.237 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:20.238 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.238 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:20.238 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:20.238 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:20.238 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:20.238 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:20.238 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:20.238 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.238 INFO:tasks.workunit.client.0.smithi050.stderr: -186> 2024-09-14T11:14:19.872+0000 7f438c0b7800 5 monclient: authenticate success, global_id 7652 2024-09-14T11:14:20.238 INFO:tasks.workunit.client.0.smithi050.stderr: -185> 2024-09-14T11:14:19.872+0000 7f426d7fa640 4 set_mon_vals no callback set 2024-09-14T11:14:20.238 INFO:tasks.workunit.client.0.smithi050.stderr: -184> 2024-09-14T11:14:19.872+0000 7f438c0b7800 10 monclient: _renew_subs 2024-09-14T11:14:20.238 INFO:tasks.workunit.client.0.smithi050.stderr: -183> 2024-09-14T11:14:19.872+0000 7f438c0b7800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:20.238 INFO:tasks.workunit.client.0.smithi050.stderr: -182> 2024-09-14T11:14:19.872+0000 7f438c0b7800 10 monclient: _renew_subs 2024-09-14T11:14:20.238 INFO:tasks.workunit.client.0.smithi050.stderr: -181> 2024-09-14T11:14:19.872+0000 7f438c0b7800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:20.239 INFO:tasks.workunit.client.0.smithi050.stderr: -180> 2024-09-14T11:14:19.872+0000 7f438c0b7800 1 librados: init done 2024-09-14T11:14:20.239 INFO:tasks.workunit.client.0.smithi050.stderr: -179> 2024-09-14T11:14:19.872+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command cr dump hook 0x5596df6eb988 2024-09-14T11:14:20.239 INFO:tasks.workunit.client.0.smithi050.stderr: -178> 2024-09-14T11:14:19.874+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.239 INFO:tasks.workunit.client.0.smithi050.stderr: -177> 2024-09-14T11:14:19.874+0000 7f425b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:14:20.239 INFO:tasks.workunit.client.0.smithi050.stderr: -176> 2024-09-14T11:14:19.874+0000 7f425b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:14:20.239 INFO:tasks.workunit.client.0.smithi050.stderr: -175> 2024-09-14T11:14:19.874+0000 7f425b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:14:20.239 INFO:tasks.workunit.client.0.smithi050.stderr: -174> 2024-09-14T11:14:19.875+0000 7f4389ba1640 10 monclient: get_auth_request con 0x7f4254077260 auth_method 0 2024-09-14T11:14:20.239 INFO:tasks.workunit.client.0.smithi050.stderr: -173> 2024-09-14T11:14:19.875+0000 7f438a3a2640 10 monclient: get_auth_request con 0x5596df950c20 auth_method 0 2024-09-14T11:14:20.239 INFO:tasks.workunit.client.0.smithi050.stderr: -172> 2024-09-14T11:14:19.875+0000 7f438c0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.239 INFO:tasks.workunit.client.0.smithi050.stderr: -171> 2024-09-14T11:14:19.875+0000 7f438c0b7800 20 realm 2024-09-14T11:14:20.239 INFO:tasks.workunit.client.0.smithi050.stderr: -170> 2024-09-14T11:14:19.875+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.239 INFO:tasks.workunit.client.0.smithi050.stderr: -169> 2024-09-14T11:14:19.876+0000 7f438c0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.239 INFO:tasks.workunit.client.0.smithi050.stderr: -168> 2024-09-14T11:14:19.876+0000 7f438c0b7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:20.240 INFO:tasks.workunit.client.0.smithi050.stderr: -167> 2024-09-14T11:14:19.876+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.240 INFO:tasks.workunit.client.0.smithi050.stderr: -166> 2024-09-14T11:14:19.876+0000 7f438c0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.240 INFO:tasks.workunit.client.0.smithi050.stderr: -165> 2024-09-14T11:14:19.876+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.240 INFO:tasks.workunit.client.0.smithi050.stderr: -164> 2024-09-14T11:14:19.876+0000 7f4389ba1640 10 monclient: get_auth_request con 0x5596df954e40 auth_method 0 2024-09-14T11:14:20.240 INFO:tasks.workunit.client.0.smithi050.stderr: -163> 2024-09-14T11:14:19.876+0000 7f438c0b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:20.240 INFO:tasks.workunit.client.0.smithi050.stderr: -162> 2024-09-14T11:14:19.876+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.240 INFO:tasks.workunit.client.0.smithi050.stderr: -161> 2024-09-14T11:14:19.877+0000 7f43893a0640 10 monclient: get_auth_request con 0x5596df9586a0 auth_method 0 2024-09-14T11:14:20.240 INFO:tasks.workunit.client.0.smithi050.stderr: -160> 2024-09-14T11:14:19.877+0000 7f438c0b7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:20.240 INFO:tasks.workunit.client.0.smithi050.stderr: -159> 2024-09-14T11:14:19.877+0000 7f438c0b7800 20 searching for the correct realm 2024-09-14T11:14:20.240 INFO:tasks.workunit.client.0.smithi050.stderr: -158> 2024-09-14T11:14:19.877+0000 7f438a3a2640 10 monclient: get_auth_request con 0x5596df95d460 auth_method 0 2024-09-14T11:14:20.241 INFO:tasks.workunit.client.0.smithi050.stderr: -157> 2024-09-14T11:14:19.878+0000 7f4389ba1640 10 monclient: get_auth_request con 0x7f43840651e0 auth_method 0 2024-09-14T11:14:20.241 INFO:tasks.workunit.client.0.smithi050.stderr: -156> 2024-09-14T11:14:19.880+0000 7f43893a0640 0 -- 172.21.15.50:0/109344237 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f438406e3d0 msgr2=0x7f4384069350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:20.241 INFO:tasks.workunit.client.0.smithi050.stderr: -155> 2024-09-14T11:14:20.081+0000 7f43893a0640 10 monclient: get_auth_request con 0x7f438406e3d0 auth_method 0 2024-09-14T11:14:20.241 INFO:tasks.workunit.client.0.smithi050.stderr: -154> 2024-09-14T11:14:20.084+0000 7f438a3a2640 10 monclient: get_auth_request con 0x7f437c017070 auth_method 0 2024-09-14T11:14:20.241 INFO:tasks.workunit.client.0.smithi050.stderr: -153> 2024-09-14T11:14:20.085+0000 7f4389ba1640 10 monclient: get_auth_request con 0x7f438406ab40 auth_method 0 2024-09-14T11:14:20.241 INFO:tasks.workunit.client.0.smithi050.stderr: -152> 2024-09-14T11:14:20.086+0000 7f438a3a2640 0 -- 172.21.15.50:0/109344237 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5596df950c20 msgr2=0x5596df953090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:20.241 INFO:tasks.workunit.client.0.smithi050.stderr: -151> 2024-09-14T11:14:20.086+0000 7f425b7fe640 1 client.7652.objecter ms_handle_reset 0x5596df950c20 session 0x5596df950550 osd.6 2024-09-14T11:14:20.241 INFO:tasks.workunit.client.0.smithi050.stderr: -150> 2024-09-14T11:14:20.086+0000 7f425b7fe640 10 monclient: _renew_subs 2024-09-14T11:14:20.241 INFO:tasks.workunit.client.0.smithi050.stderr: -149> 2024-09-14T11:14:20.086+0000 7f425b7fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:20.241 INFO:tasks.workunit.client.0.smithi050.stderr: -148> 2024-09-14T11:14:20.086+0000 7f438a3a2640 10 monclient: get_auth_request con 0x7f4254087510 auth_method 0 2024-09-14T11:14:20.241 INFO:tasks.workunit.client.0.smithi050.stderr: -147> 2024-09-14T11:14:20.090+0000 7f438c0b7800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:14:20.241 INFO:tasks.workunit.client.0.smithi050.stderr: -146> 2024-09-14T11:14:20.090+0000 7f438c0b7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:20.242 INFO:tasks.workunit.client.0.smithi050.stderr: -145> 2024-09-14T11:14:20.090+0000 7f438c0b7800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:14:20.242 INFO:tasks.workunit.client.0.smithi050.stderr: -144> 2024-09-14T11:14:20.090+0000 7f438c0b7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:20.242 INFO:tasks.workunit.client.0.smithi050.stderr: -143> 2024-09-14T11:14:20.090+0000 7f438c0b7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:20.242 INFO:tasks.workunit.client.0.smithi050.stderr: -142> 2024-09-14T11:14:20.090+0000 7f438c0b7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:20.242 INFO:tasks.workunit.client.0.smithi050.stderr: -141> 2024-09-14T11:14:20.090+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.242 INFO:tasks.workunit.client.0.smithi050.stderr: -140> 2024-09-14T11:14:20.090+0000 7f438c0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.242 INFO:tasks.workunit.client.0.smithi050.stderr: -139> 2024-09-14T11:14:20.090+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.242 INFO:tasks.workunit.client.0.smithi050.stderr: -138> 2024-09-14T11:14:20.091+0000 7f438c0b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:20.242 INFO:tasks.workunit.client.0.smithi050.stderr: -137> 2024-09-14T11:14:20.091+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.242 INFO:tasks.workunit.client.0.smithi050.stderr: -136> 2024-09-14T11:14:20.091+0000 7f438c0b7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:20.242 INFO:tasks.workunit.client.0.smithi050.stderr: -135> 2024-09-14T11:14:20.091+0000 7f438c0b7800 20 zone default found 2024-09-14T11:14:20.242 INFO:tasks.workunit.client.0.smithi050.stderr: -134> 2024-09-14T11:14:20.091+0000 7f438c0b7800 4 Realm: () 2024-09-14T11:14:20.242 INFO:tasks.workunit.client.0.smithi050.stderr: -133> 2024-09-14T11:14:20.091+0000 7f438c0b7800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:14:20.242 INFO:tasks.workunit.client.0.smithi050.stderr: -132> 2024-09-14T11:14:20.091+0000 7f438c0b7800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:14:20.243 INFO:tasks.workunit.client.0.smithi050.stderr: -131> 2024-09-14T11:14:20.091+0000 7f438c0b7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:20.243 INFO:tasks.workunit.client.0.smithi050.stderr: -130> 2024-09-14T11:14:20.091+0000 7f438c0b7800 20 zonegroup default 2024-09-14T11:14:20.243 INFO:tasks.workunit.client.0.smithi050.stderr: -129> 2024-09-14T11:14:20.091+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.243 INFO:tasks.workunit.client.0.smithi050.stderr: -128> 2024-09-14T11:14:20.091+0000 7f438c0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.243 INFO:tasks.workunit.client.0.smithi050.stderr: -127> 2024-09-14T11:14:20.091+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.243 INFO:tasks.workunit.client.0.smithi050.stderr: -126> 2024-09-14T11:14:20.091+0000 7f438c0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.243 INFO:tasks.workunit.client.0.smithi050.stderr: -125> 2024-09-14T11:14:20.091+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.243 INFO:tasks.workunit.client.0.smithi050.stderr: -124> 2024-09-14T11:14:20.092+0000 7f438c0b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.243 INFO:tasks.workunit.client.0.smithi050.stderr: -123> 2024-09-14T11:14:20.092+0000 7f438c0b7800 20 started sync module instance, tier type = 2024-09-14T11:14:20.243 INFO:tasks.workunit.client.0.smithi050.stderr: -122> 2024-09-14T11:14:20.092+0000 7f438c0b7800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:14:20.243 INFO:tasks.workunit.client.0.smithi050.stderr: -121> 2024-09-14T11:14:20.101+0000 7f438c0b7800 20 add_watcher() i=0 2024-09-14T11:14:20.243 INFO:tasks.workunit.client.0.smithi050.stderr: -120> 2024-09-14T11:14:20.101+0000 7f438c0b7800 20 add_watcher() i=1 2024-09-14T11:14:20.243 INFO:tasks.workunit.client.0.smithi050.stderr: -119> 2024-09-14T11:14:20.101+0000 7f438c0b7800 20 add_watcher() i=2 2024-09-14T11:14:20.243 INFO:tasks.workunit.client.0.smithi050.stderr: -118> 2024-09-14T11:14:20.101+0000 7f438c0b7800 20 add_watcher() i=3 2024-09-14T11:14:20.244 INFO:tasks.workunit.client.0.smithi050.stderr: -117> 2024-09-14T11:14:20.101+0000 7f438c0b7800 20 add_watcher() i=4 2024-09-14T11:14:20.244 INFO:tasks.workunit.client.0.smithi050.stderr: -116> 2024-09-14T11:14:20.101+0000 7f438c0b7800 20 add_watcher() i=5 2024-09-14T11:14:20.244 INFO:tasks.workunit.client.0.smithi050.stderr: -115> 2024-09-14T11:14:20.101+0000 7f438c0b7800 20 add_watcher() i=6 2024-09-14T11:14:20.244 INFO:tasks.workunit.client.0.smithi050.stderr: -114> 2024-09-14T11:14:20.102+0000 7f438c0b7800 20 add_watcher() i=7 2024-09-14T11:14:20.244 INFO:tasks.workunit.client.0.smithi050.stderr: -113> 2024-09-14T11:14:20.102+0000 7f438c0b7800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:20.244 INFO:tasks.workunit.client.0.smithi050.stderr: -112> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding auth protocol: cephx 2024-09-14T11:14:20.244 INFO:tasks.workunit.client.0.smithi050.stderr: -111> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding auth protocol: cephx 2024-09-14T11:14:20.244 INFO:tasks.workunit.client.0.smithi050.stderr: -110> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding auth protocol: cephx 2024-09-14T11:14:20.244 INFO:tasks.workunit.client.0.smithi050.stderr: -109> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding con mode: secure 2024-09-14T11:14:20.244 INFO:tasks.workunit.client.0.smithi050.stderr: -108> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding con mode: crc 2024-09-14T11:14:20.244 INFO:tasks.workunit.client.0.smithi050.stderr: -107> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding con mode: secure 2024-09-14T11:14:20.244 INFO:tasks.workunit.client.0.smithi050.stderr: -106> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding con mode: crc 2024-09-14T11:14:20.244 INFO:tasks.workunit.client.0.smithi050.stderr: -105> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding con mode: secure 2024-09-14T11:14:20.245 INFO:tasks.workunit.client.0.smithi050.stderr: -104> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding con mode: crc 2024-09-14T11:14:20.245 INFO:tasks.workunit.client.0.smithi050.stderr: -103> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding con mode: crc 2024-09-14T11:14:20.245 INFO:tasks.workunit.client.0.smithi050.stderr: -102> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding con mode: secure 2024-09-14T11:14:20.245 INFO:tasks.workunit.client.0.smithi050.stderr: -101> 2024-09-14T11:14:20.104+0000 7f423b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:20.245 INFO:tasks.workunit.client.0.smithi050.stderr: -100> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding con mode: crc 2024-09-14T11:14:20.245 INFO:tasks.workunit.client.0.smithi050.stderr: -99> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding con mode: secure 2024-09-14T11:14:20.245 INFO:tasks.workunit.client.0.smithi050.stderr: -98> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding con mode: crc 2024-09-14T11:14:20.245 INFO:tasks.workunit.client.0.smithi050.stderr: -97> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 AuthRegistry(0x7ffd733401f0) adding con mode: secure 2024-09-14T11:14:20.245 INFO:tasks.workunit.client.0.smithi050.stderr: -96> 2024-09-14T11:14:20.104+0000 7f438c0b7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:20.245 INFO:tasks.workunit.client.0.smithi050.stderr: -95> 2024-09-14T11:14:20.104+0000 7f438c0b7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:20.245 INFO:tasks.workunit.client.0.smithi050.stderr: -94> 2024-09-14T11:14:20.104+0000 7f438c0b7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:20.245 INFO:tasks.workunit.client.0.smithi050.stderr: -93> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command cache list hook 0x5596df9217f0 2024-09-14T11:14:20.246 INFO:tasks.workunit.client.0.smithi050.stderr: -92> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command cache inspect hook 0x5596df9217f0 2024-09-14T11:14:20.246 INFO:tasks.workunit.client.0.smithi050.stderr: -91> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command cache erase hook 0x5596df9217f0 2024-09-14T11:14:20.246 INFO:tasks.workunit.client.0.smithi050.stderr: -90> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command cache zap hook 0x5596df9217f0 2024-09-14T11:14:20.246 INFO:tasks.workunit.client.0.smithi050.stderr: -89> 2024-09-14T11:14:20.104+0000 7f438c0b7800 5 note: GC not initialized 2024-09-14T11:14:20.246 INFO:tasks.workunit.client.0.smithi050.stderr: -88> 2024-09-14T11:14:20.105+0000 7f423a7fc640 20 reqs_thread_entry: start 2024-09-14T11:14:20.246 INFO:tasks.workunit.client.0.smithi050.stderr: -87> 2024-09-14T11:14:20.105+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command sync trace show hook 0x7f4380056d50 2024-09-14T11:14:20.246 INFO:tasks.workunit.client.0.smithi050.stderr: -86> 2024-09-14T11:14:20.105+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command sync trace history hook 0x7f4380056d50 2024-09-14T11:14:20.246 INFO:tasks.workunit.client.0.smithi050.stderr: -85> 2024-09-14T11:14:20.105+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command sync trace active hook 0x7f4380056d50 2024-09-14T11:14:20.246 INFO:tasks.workunit.client.0.smithi050.stderr: -84> 2024-09-14T11:14:20.105+0000 7f438c0b7800 5 asok(0x5596df63f270) register_command sync trace active_short hook 0x7f4380056d50 2024-09-14T11:14:20.246 INFO:tasks.workunit.client.0.smithi050.stderr: -83> 2024-09-14T11:14:20.105+0000 7f438c0b7800 20 init_complete bucket index max shards: 11 2024-09-14T11:14:20.246 INFO:tasks.workunit.client.0.smithi050.stderr: -82> 2024-09-14T11:14:20.105+0000 7f438c0b7800 20 Filter name: none 2024-09-14T11:14:20.246 INFO:tasks.workunit.client.0.smithi050.stderr: -81> 2024-09-14T11:14:20.105+0000 7f41abfff640 20 reqs_thread_entry: start 2024-09-14T11:14:20.246 INFO:tasks.workunit.client.0.smithi050.stderr: -80> 2024-09-14T11:14:20.105+0000 7f438c0b7800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:14:20.246 INFO:tasks.workunit.client.0.smithi050.stderr: -79> 2024-09-14T11:14:20.105+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.247 INFO:tasks.workunit.client.0.smithi050.stderr: -78> 2024-09-14T11:14:20.105+0000 7f438c0b7800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:14:20.247 INFO:tasks.workunit.client.0.smithi050.stderr: -77> 2024-09-14T11:14:20.105+0000 7f438c0b7800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:14:20.247 INFO:tasks.workunit.client.0.smithi050.stderr: -76> 2024-09-14T11:14:20.105+0000 7f438c0b7800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:14:20.247 INFO:tasks.workunit.client.0.smithi050.stderr: -75> 2024-09-14T11:14:20.105+0000 7f438c0b7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : miss 2024-09-14T11:14:20.247 INFO:tasks.workunit.client.0.smithi050.stderr: -74> 2024-09-14T11:14:20.105+0000 7f438c0b7800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.247 INFO:tasks.workunit.client.0.smithi050.stderr: -73> 2024-09-14T11:14:20.106+0000 7f438c0b7800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:14:20.247 INFO:tasks.workunit.client.0.smithi050.stderr: -72> 2024-09-14T11:14:20.106+0000 7f438c0b7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:14:20.247 INFO:tasks.workunit.client.0.smithi050.stderr: -71> 2024-09-14T11:14:20.106+0000 7f438c0b7800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:14:20.247 INFO:tasks.workunit.client.0.smithi050.stderr: -70> 2024-09-14T11:14:20.106+0000 7f438c0b7800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:20.247 INFO:tasks.workunit.client.0.smithi050.stderr: -69> 2024-09-14T11:14:20.106+0000 7f438c0b7800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:14:20.247 INFO:tasks.workunit.client.0.smithi050.stderr: -68> 2024-09-14T11:14:20.106+0000 7f438c0b7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:14:20.248 INFO:tasks.workunit.client.0.smithi050.stderr: -67> 2024-09-14T11:14:20.111+0000 7f438c0b7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:14:20.248 INFO:tasks.workunit.client.0.smithi050.stderr: -66> 2024-09-14T11:14:20.111+0000 7f438c0b7800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:14:20.248 INFO:tasks.workunit.client.0.smithi050.stderr: -65> 2024-09-14T11:14:20.111+0000 7f438c0b7800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:14:20.248 INFO:tasks.workunit.client.0.smithi050.stderr: -64> 2024-09-14T11:14:20.111+0000 7f438c0b7800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18, ofs0, ns] 2024-09-14T11:14:20.248 INFO:tasks.workunit.client.0.smithi050.stderr: -63> 2024-09-14T11:14:20.111+0000 7f426cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497131 cookie 94106484617488 notifier 7652 bl.length()=911 2024-09-14T11:14:20.248 INFO:tasks.workunit.client.0.smithi050.stderr: -62> 2024-09-14T11:14:20.111+0000 7f426cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:14:20.248 INFO:tasks.workunit.client.0.smithi050.stderr: -61> 2024-09-14T11:14:20.111+0000 7f426cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:14:20.248 INFO:tasks.workunit.client.0.smithi050.stderr: -60> 2024-09-14T11:14:20.111+0000 7f426cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:14:20.248 INFO:tasks.workunit.client.0.smithi050.stderr: -59> 2024-09-14T11:14:20.113+0000 7f438c0b7800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_sources= new_sources= 2024-09-14T11:14:20.248 INFO:tasks.workunit.client.0.smithi050.stderr: -58> 2024-09-14T11:14:20.113+0000 7f438c0b7800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential sources added=[] removed=[] 2024-09-14T11:14:20.248 INFO:tasks.workunit.client.0.smithi050.stderr: -57> 2024-09-14T11:14:20.113+0000 7f438c0b7800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_dests= new_dests= 2024-09-14T11:14:20.248 INFO:tasks.workunit.client.0.smithi050.stderr: -56> 2024-09-14T11:14:20.113+0000 7f438c0b7800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential dests added=[] removed=[] 2024-09-14T11:14:20.249 INFO:tasks.workunit.client.0.smithi050.stderr: -55> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.0 2024-09-14T11:14:20.249 INFO:tasks.workunit.client.0.smithi050.stderr: -54> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.0 2024-09-14T11:14:20.249 INFO:tasks.workunit.client.0.smithi050.stderr: -53> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.1 2024-09-14T11:14:20.249 INFO:tasks.workunit.client.0.smithi050.stderr: -52> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.1 2024-09-14T11:14:20.249 INFO:tasks.workunit.client.0.smithi050.stderr: -51> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.2 2024-09-14T11:14:20.249 INFO:tasks.workunit.client.0.smithi050.stderr: -50> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.2 2024-09-14T11:14:20.249 INFO:tasks.workunit.client.0.smithi050.stderr: -49> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.3 2024-09-14T11:14:20.249 INFO:tasks.workunit.client.0.smithi050.stderr: -48> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.3 2024-09-14T11:14:20.249 INFO:tasks.workunit.client.0.smithi050.stderr: -47> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.4 2024-09-14T11:14:20.249 INFO:tasks.workunit.client.0.smithi050.stderr: -46> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.4 2024-09-14T11:14:20.250 INFO:tasks.workunit.client.0.smithi050.stderr: -45> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.5 2024-09-14T11:14:20.250 INFO:tasks.workunit.client.0.smithi050.stderr: -44> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.5 2024-09-14T11:14:20.250 INFO:tasks.workunit.client.0.smithi050.stderr: -43> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.6 2024-09-14T11:14:20.250 INFO:tasks.workunit.client.0.smithi050.stderr: -42> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.6 2024-09-14T11:14:20.250 INFO:tasks.workunit.client.0.smithi050.stderr: -41> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.7 2024-09-14T11:14:20.250 INFO:tasks.workunit.client.0.smithi050.stderr: -40> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.7 2024-09-14T11:14:20.250 INFO:tasks.workunit.client.0.smithi050.stderr: -39> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.8 2024-09-14T11:14:20.250 INFO:tasks.workunit.client.0.smithi050.stderr: -38> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.8 2024-09-14T11:14:20.250 INFO:tasks.workunit.client.0.smithi050.stderr: -37> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.9 2024-09-14T11:14:20.250 INFO:tasks.workunit.client.0.smithi050.stderr: -36> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.9 2024-09-14T11:14:20.250 INFO:tasks.workunit.client.0.smithi050.stderr: -35> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.10 2024-09-14T11:14:20.250 INFO:tasks.workunit.client.0.smithi050.stderr: -34> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.10 2024-09-14T11:14:20.250 INFO:tasks.workunit.client.0.smithi050.stderr: -33> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.11 2024-09-14T11:14:20.250 INFO:tasks.workunit.client.0.smithi050.stderr: -32> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.11 2024-09-14T11:14:20.251 INFO:tasks.workunit.client.0.smithi050.stderr: -31> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.12 2024-09-14T11:14:20.251 INFO:tasks.workunit.client.0.smithi050.stderr: -30> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.12 2024-09-14T11:14:20.251 INFO:tasks.workunit.client.0.smithi050.stderr: -29> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.13 2024-09-14T11:14:20.251 INFO:tasks.workunit.client.0.smithi050.stderr: -28> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.13 2024-09-14T11:14:20.251 INFO:tasks.workunit.client.0.smithi050.stderr: -27> 2024-09-14T11:14:20.117+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:14:20.251 INFO:tasks.workunit.client.0.smithi050.stderr: -26> 2024-09-14T11:14:20.117+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:14:20.251 INFO:tasks.workunit.client.0.smithi050.stderr: -25> 2024-09-14T11:14:20.118+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:14:20.251 INFO:tasks.workunit.client.0.smithi050.stderr: -24> 2024-09-14T11:14:20.118+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:14:20.251 INFO:tasks.workunit.client.0.smithi050.stderr: -23> 2024-09-14T11:14:20.118+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:14:20.251 INFO:tasks.workunit.client.0.smithi050.stderr: -22> 2024-09-14T11:14:20.118+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:14:20.251 INFO:tasks.workunit.client.0.smithi050.stderr: -21> 2024-09-14T11:14:20.119+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:14:20.251 INFO:tasks.workunit.client.0.smithi050.stderr: -20> 2024-09-14T11:14:20.119+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:14:20.251 INFO:tasks.workunit.client.0.smithi050.stderr: -19> 2024-09-14T11:14:20.119+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:14:20.251 INFO:tasks.workunit.client.0.smithi050.stderr: -18> 2024-09-14T11:14:20.119+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:14:20.252 INFO:tasks.workunit.client.0.smithi050.stderr: -17> 2024-09-14T11:14:20.120+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:14:20.252 INFO:tasks.workunit.client.0.smithi050.stderr: -16> 2024-09-14T11:14:20.120+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:14:20.252 INFO:tasks.workunit.client.0.smithi050.stderr: -15> 2024-09-14T11:14:20.120+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:14:20.252 INFO:tasks.workunit.client.0.smithi050.stderr: -14> 2024-09-14T11:14:20.120+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:14:20.252 INFO:tasks.workunit.client.0.smithi050.stderr: -13> 2024-09-14T11:14:20.121+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:14:20.252 INFO:tasks.workunit.client.0.smithi050.stderr: -12> 2024-09-14T11:14:20.121+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:14:20.252 INFO:tasks.workunit.client.0.smithi050.stderr: -11> 2024-09-14T11:14:20.121+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:14:20.252 INFO:tasks.workunit.client.0.smithi050.stderr: -10> 2024-09-14T11:14:20.121+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:14:20.252 INFO:tasks.workunit.client.0.smithi050.stderr: -9> 2024-09-14T11:14:20.122+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:14:20.252 INFO:tasks.workunit.client.0.smithi050.stderr: -8> 2024-09-14T11:14:20.122+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:14:20.252 INFO:tasks.workunit.client.0.smithi050.stderr: -7> 2024-09-14T11:14:20.122+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:14:20.252 INFO:tasks.workunit.client.0.smithi050.stderr: -6> 2024-09-14T11:14:20.122+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:14:20.252 INFO:tasks.workunit.client.0.smithi050.stderr: -5> 2024-09-14T11:14:20.123+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:14:20.253 INFO:tasks.workunit.client.0.smithi050.stderr: -4> 2024-09-14T11:14:20.123+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:14:20.253 INFO:tasks.workunit.client.0.smithi050.stderr: -3> 2024-09-14T11:14:20.123+0000 7f438c0b7800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:14:20.253 INFO:tasks.workunit.client.0.smithi050.stderr: -2> 2024-09-14T11:14:20.123+0000 7f438c0b7800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:14:20.253 INFO:tasks.workunit.client.0.smithi050.stderr: -1> 2024-09-14T11:14:20.126+0000 7f438c0b7800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f438c0b7800 time 2024-09-14T11:14:20.127083+0000 2024-09-14T11:14:20.253 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:14:20.253 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.253 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:20.253 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f438f58c76a] 2024-09-14T11:14:20.253 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f438f58c928] 2024-09-14T11:14:20.253 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5596ddbbb0b1] 2024-09-14T11:14:20.253 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5596ddbca124] 2024-09-14T11:14:20.253 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5596ddbcafc4] 2024-09-14T11:14:20.254 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:14:20.254 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f438e229590] 2024-09-14T11:14:20.254 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:14:20.254 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:14:20.254 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.254 INFO:tasks.workunit.client.0.smithi050.stderr: 0> 2024-09-14T11:14:20.127+0000 7f438c0b7800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:14:20.254 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f438c0b7800 thread_name:radosgw-admin 2024-09-14T11:14:20.254 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.254 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:20.254 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f438e23e6f0] 2024-09-14T11:14:20.254 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f438e28b99c] 2024-09-14T11:14:20.254 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:14:20.255 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:14:20.255 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f438f58c7c4] 2024-09-14T11:14:20.255 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f438f58c928] 2024-09-14T11:14:20.255 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5596ddbbb0b1] 2024-09-14T11:14:20.255 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5596ddbca124] 2024-09-14T11:14:20.255 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5596ddbcafc4] 2024-09-14T11:14:20.255 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:14:20.255 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f438e229590] 2024-09-14T11:14:20.255 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:14:20.255 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:14:20.255 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:14:20.256 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:20.256 INFO:tasks.workunit.client.0.smithi050.stderr:--- logging levels --- 2024-09-14T11:14:20.256 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 none 2024-09-14T11:14:20.256 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 lockdep 2024-09-14T11:14:20.256 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 context 2024-09-14T11:14:20.256 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 crush 2024-09-14T11:14:20.256 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds 2024-09-14T11:14:20.256 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_balancer 2024-09-14T11:14:20.256 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_locker 2024-09-14T11:14:20.256 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log 2024-09-14T11:14:20.256 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log_expire 2024-09-14T11:14:20.256 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_migrator 2024-09-14T11:14:20.256 INFO:tasks.workunit.client.0.smithi050.stderr: 3/ 5 mds_quiesce 2024-09-14T11:14:20.257 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 buffer 2024-09-14T11:14:20.257 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 timer 2024-09-14T11:14:20.257 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 filer 2024-09-14T11:14:20.257 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 striper 2024-09-14T11:14:20.257 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 objecter 2024-09-14T11:14:20.257 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rados 2024-09-14T11:14:20.257 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd 2024-09-14T11:14:20.257 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_mirror 2024-09-14T11:14:20.257 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_replay 2024-09-14T11:14:20.257 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_pwl 2024-09-14T11:14:20.257 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 journaler 2024-09-14T11:14:20.257 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objectcacher 2024-09-14T11:14:20.257 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:14:20.258 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 client 2024-09-14T11:14:20.258 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 osd 2024-09-14T11:14:20.258 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 optracker 2024-09-14T11:14:20.258 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objclass 2024-09-14T11:14:20.258 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 filestore 2024-09-14T11:14:20.258 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 journal 2024-09-14T11:14:20.258 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 ms 2024-09-14T11:14:20.258 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mon 2024-09-14T11:14:20.258 INFO:tasks.workunit.client.0.smithi050.stderr: 0/10 monc 2024-09-14T11:14:20.258 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 paxos 2024-09-14T11:14:20.258 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 tp 2024-09-14T11:14:20.258 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 auth 2024-09-14T11:14:20.258 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 crypto 2024-09-14T11:14:20.258 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 finisher 2024-09-14T11:14:20.259 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 reserver 2024-09-14T11:14:20.259 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 heartbeatmap 2024-09-14T11:14:20.259 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 perfcounter 2024-09-14T11:14:20.259 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw 2024-09-14T11:14:20.259 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_sync 2024-09-14T11:14:20.259 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_datacache 2024-09-14T11:14:20.259 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_access 2024-09-14T11:14:20.259 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:14:20.259 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_flight 2024-09-14T11:14:20.259 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:14:20.259 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw_notification 2024-09-14T11:14:20.259 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 javaclient 2024-09-14T11:14:20.259 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 asok 2024-09-14T11:14:20.259 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 throttle 2024-09-14T11:14:20.260 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 refs 2024-09-14T11:14:20.260 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 compressor 2024-09-14T11:14:20.260 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluestore 2024-09-14T11:14:20.260 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluefs 2024-09-14T11:14:20.260 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 bdev 2024-09-14T11:14:20.260 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 kstore 2024-09-14T11:14:20.260 INFO:tasks.workunit.client.0.smithi050.stderr: 4/ 5 rocksdb 2024-09-14T11:14:20.260 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 fuse 2024-09-14T11:14:20.260 INFO:tasks.workunit.client.0.smithi050.stderr: 2/ 5 mgr 2024-09-14T11:14:20.260 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mgrc 2024-09-14T11:14:20.260 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 dpdk 2024-09-14T11:14:20.260 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 eventtrace 2024-09-14T11:14:20.260 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 prioritycache 2024-09-14T11:14:20.260 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 test 2024-09-14T11:14:20.261 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:14:20.261 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephsqlite 2024-09-14T11:14:20.261 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:14:20.261 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore 2024-09-14T11:14:20.261 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_onode 2024-09-14T11:14:20.261 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_odata 2024-09-14T11:14:20.261 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_omap 2024-09-14T11:14:20.261 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_tm 2024-09-14T11:14:20.261 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_t 2024-09-14T11:14:20.261 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:14:20.261 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_epm 2024-09-14T11:14:20.261 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_lba 2024-09-14T11:14:20.262 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:14:20.262 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cache 2024-09-14T11:14:20.262 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_journal 2024-09-14T11:14:20.262 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_device 2024-09-14T11:14:20.262 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_backref 2024-09-14T11:14:20.262 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 alienstore 2024-09-14T11:14:20.262 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mclock 2024-09-14T11:14:20.262 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cyanstore 2024-09-14T11:14:20.262 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 ceph_exporter 2024-09-14T11:14:20.262 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 memstore 2024-09-14T11:14:20.262 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 trace 2024-09-14T11:14:20.262 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 ceph_dedup 2024-09-14T11:14:20.262 INFO:tasks.workunit.client.0.smithi050.stderr: -2/-2 (syslog threshold) 2024-09-14T11:14:20.262 INFO:tasks.workunit.client.0.smithi050.stderr: 99/99 (stderr threshold) 2024-09-14T11:14:20.263 INFO:tasks.workunit.client.0.smithi050.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:14:20.263 INFO:tasks.workunit.client.0.smithi050.stderr: 7f41abfff640 / http_manager 2024-09-14T11:14:20.263 INFO:tasks.workunit.client.0.smithi050.stderr: 7f423a7fc640 / http_manager 2024-09-14T11:14:20.263 INFO:tasks.workunit.client.0.smithi050.stderr: 7f423b7fe640 / rgw_dt_lg_renew 2024-09-14T11:14:20.263 INFO:tasks.workunit.client.0.smithi050.stderr: 7f425b7fe640 / ms_dispatch 2024-09-14T11:14:20.263 INFO:tasks.workunit.client.0.smithi050.stderr: 7f426cff9640 / io_context_pool 2024-09-14T11:14:20.263 INFO:tasks.workunit.client.0.smithi050.stderr: 7f426d7fa640 / io_context_pool 2024-09-14T11:14:20.263 INFO:tasks.workunit.client.0.smithi050.stderr: 7f426f7fe640 / ms_dispatch 2024-09-14T11:14:20.263 INFO:tasks.workunit.client.0.smithi050.stderr: 7f4276604640 / ms_dispatch 2024-09-14T11:14:20.263 INFO:tasks.workunit.client.0.smithi050.stderr: 7f4277e07640 / io_context_pool 2024-09-14T11:14:20.263 INFO:tasks.workunit.client.0.smithi050.stderr: 7f43893a0640 / msgr-worker-2 2024-09-14T11:14:20.263 INFO:tasks.workunit.client.0.smithi050.stderr: 7f4389ba1640 / msgr-worker-1 2024-09-14T11:14:20.263 INFO:tasks.workunit.client.0.smithi050.stderr: 7f438a3a2640 / msgr-worker-0 2024-09-14T11:14:20.263 INFO:tasks.workunit.client.0.smithi050.stderr: 7f438aba3640 / io_context_pool 2024-09-14T11:14:20.264 INFO:tasks.workunit.client.0.smithi050.stderr: 7f438c0b7800 / radosgw-admin 2024-09-14T11:14:20.264 INFO:tasks.workunit.client.0.smithi050.stderr: max_recent 500 2024-09-14T11:14:20.264 INFO:tasks.workunit.client.0.smithi050.stderr: max_new 1000 2024-09-14T11:14:20.264 INFO:tasks.workunit.client.0.smithi050.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:14:20.128738Z_e39a0815-17f4-4c58-88ce-bdf977bc5889/log 2024-09-14T11:14:20.264 INFO:tasks.workunit.client.0.smithi050.stderr:--- end dump of recent events --- 2024-09-14T11:14:20.264 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:14:20.265 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:20.265 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:20.265 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.205+0000 7f3eb1c13800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.207+0000 7f3eb1c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.207+0000 7f3eb1c13800 20 realm 2024-09-14T11:14:20.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.207+0000 7f3eb1c13800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.207+0000 7f3eb1c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.207+0000 7f3eb1c13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:20.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.207+0000 7f3eb1c13800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.207+0000 7f3eb1c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.207+0000 7f3eb1c13800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.208+0000 7f3eb1c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:20.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.208+0000 7f3eb1c13800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.208+0000 7f3eb1c13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:20.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.208+0000 7f3eb1c13800 20 searching for the correct realm 2024-09-14T11:14:20.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.211+0000 7f3eacb47640 0 -- 172.21.15.50:0/1795916783 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f3ea8015b50 msgr2=0x7f3ea8025930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:20.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.416+0000 7f3eadb49640 0 -- 172.21.15.50:0/1795916783 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x56184cfe4720 msgr2=0x56184cfe6bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:20.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.420+0000 7f3eb1c13800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:14:20.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.420+0000 7f3eb1c13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:20.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.420+0000 7f3eb1c13800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:14:20.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.420+0000 7f3eb1c13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:20.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.420+0000 7f3eb1c13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:20.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.420+0000 7f3eb1c13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:20.420 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.420+0000 7f3eb1c13800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.420+0000 7f3eb1c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.420+0000 7f3eb1c13800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.421+0000 7f3eb1c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:20.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.421+0000 7f3eb1c13800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.421+0000 7f3eb1c13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:20.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.421+0000 7f3eb1c13800 20 zone default found 2024-09-14T11:14:20.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.421+0000 7f3eb1c13800 4 Realm: () 2024-09-14T11:14:20.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.421+0000 7f3eb1c13800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:14:20.421 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.421+0000 7f3eb1c13800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:14:20.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.421+0000 7f3eb1c13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:20.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.421+0000 7f3eb1c13800 20 zonegroup default 2024-09-14T11:14:20.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.421+0000 7f3eb1c13800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.421+0000 7f3eb1c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.422+0000 7f3eb1c13800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.422+0000 7f3eb1c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.422+0000 7f3eb1c13800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.422+0000 7f3eb1c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.423 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.422+0000 7f3eb1c13800 20 started sync module instance, tier type = 2024-09-14T11:14:20.423 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.422+0000 7f3eb1c13800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:14:20.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.431+0000 7f3eb1c13800 20 add_watcher() i=0 2024-09-14T11:14:20.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.431+0000 7f3eb1c13800 20 add_watcher() i=1 2024-09-14T11:14:20.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.431+0000 7f3eb1c13800 20 add_watcher() i=2 2024-09-14T11:14:20.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.431+0000 7f3eb1c13800 20 add_watcher() i=3 2024-09-14T11:14:20.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.431+0000 7f3eb1c13800 20 add_watcher() i=4 2024-09-14T11:14:20.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.431+0000 7f3eb1c13800 20 add_watcher() i=5 2024-09-14T11:14:20.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.431+0000 7f3eb1c13800 20 add_watcher() i=6 2024-09-14T11:14:20.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.432+0000 7f3eb1c13800 20 add_watcher() i=7 2024-09-14T11:14:20.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.432+0000 7f3eb1c13800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:20.432 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.433+0000 7f3d637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:20.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.434+0000 7f3eb1c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:20.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.434+0000 7f3eb1c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:20.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.434+0000 7f3eb1c13800 5 note: GC not initialized 2024-09-14T11:14:20.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.434+0000 7f3d627e4640 20 reqs_thread_entry: start 2024-09-14T11:14:20.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.434+0000 7f3eb1c13800 20 init_complete bucket index max shards: 11 2024-09-14T11:14:20.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.434+0000 7f3eb1c13800 20 Filter name: none 2024-09-14T11:14:20.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.434+0000 7f3cd3fff640 20 reqs_thread_entry: start 2024-09-14T11:14:20.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.434+0000 7f3eb1c13800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.435+0000 7f3eb1c13800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:14:20.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.435+0000 7f3eb1c13800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.435+0000 7f3eb1c13800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:14:20.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.435+0000 7f3eb1c13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:20.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.435+0000 7f3eb1c13800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.435+0000 7f3eb1c13800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:14:20.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.435+0000 7f3eb1c13800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.436+0000 7f3eb1c13800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:14:20.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.436+0000 7f3eb1c13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:20.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.437+0000 7f3d637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:20.438 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.439+0000 7f3eb1c13800 20 remove_watcher() i=0 2024-09-14T11:14:20.438 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.439+0000 7f3eb1c13800 2 removed watcher, disabling cache 2024-09-14T11:14:20.440 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.441+0000 7f3eb1c13800 20 remove_watcher() i=1 2024-09-14T11:14:20.441 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.442+0000 7f3eb1c13800 20 remove_watcher() i=2 2024-09-14T11:14:20.442 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.443+0000 7f3eb1c13800 20 remove_watcher() i=3 2024-09-14T11:14:20.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.444+0000 7f3eb1c13800 20 remove_watcher() i=4 2024-09-14T11:14:20.444 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.445+0000 7f3eb1c13800 20 remove_watcher() i=5 2024-09-14T11:14:20.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.446+0000 7f3eb1c13800 20 remove_watcher() i=6 2024-09-14T11:14:20.446 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.446+0000 7f3eb1c13800 20 remove_watcher() i=7 2024-09-14T11:14:20.459 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:20.459 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:14:20.496 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:14:20.525 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:20.525 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:20.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.565+0000 7f2fa5925800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.567+0000 7f2fa5925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.567+0000 7f2fa5925800 20 realm 2024-09-14T11:14:20.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.567+0000 7f2fa5925800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.567+0000 7f2fa5925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.567+0000 7f2fa5925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:20.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.567+0000 7f2fa5925800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.567+0000 7f2fa5925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.567+0000 7f2fa5925800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.568+0000 7f2fa5925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:20.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.568+0000 7f2fa5925800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.568 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.569+0000 7f2fa5925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:20.568 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.569+0000 7f2fa5925800 20 searching for the correct realm 2024-09-14T11:14:20.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.572+0000 7f2fa0dad640 0 -- 172.21.15.50:0/1906586711 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f2f9c06d400 msgr2=0x7f2f9c06d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:20.777 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.777+0000 7f2fa1daf640 0 -- 172.21.15.50:0/1906586711 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x558f2b7bfbe0 msgr2=0x558f2b7c2080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:20.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.782+0000 7f2fa5925800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:14:20.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.782+0000 7f2fa5925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:20.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.782+0000 7f2fa5925800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:14:20.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.782+0000 7f2fa5925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:20.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.782+0000 7f2fa5925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:20.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.782+0000 7f2fa5925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:20.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.782+0000 7f2fa5925800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.782+0000 7f2fa5925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.782+0000 7f2fa5925800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.782+0000 7f2fa5925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:20.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.782+0000 7f2fa5925800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.783+0000 7f2fa5925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:20.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.783+0000 7f2fa5925800 20 zone default found 2024-09-14T11:14:20.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.783+0000 7f2fa5925800 4 Realm: () 2024-09-14T11:14:20.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.783+0000 7f2fa5925800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:14:20.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.783+0000 7f2fa5925800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:14:20.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.783+0000 7f2fa5925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:20.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.783+0000 7f2fa5925800 20 zonegroup default 2024-09-14T11:14:20.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.783+0000 7f2fa5925800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.783+0000 7f2fa5925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.783+0000 7f2fa5925800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.783+0000 7f2fa5925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.783+0000 7f2fa5925800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.783+0000 7f2fa5925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:20.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.783+0000 7f2fa5925800 20 started sync module instance, tier type = 2024-09-14T11:14:20.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.784+0000 7f2fa5925800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:14:20.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.792+0000 7f2fa5925800 20 add_watcher() i=0 2024-09-14T11:14:20.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.792+0000 7f2fa5925800 20 add_watcher() i=1 2024-09-14T11:14:20.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.792+0000 7f2fa5925800 20 add_watcher() i=2 2024-09-14T11:14:20.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.792+0000 7f2fa5925800 20 add_watcher() i=3 2024-09-14T11:14:20.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.792+0000 7f2fa5925800 20 add_watcher() i=4 2024-09-14T11:14:20.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.792+0000 7f2fa5925800 20 add_watcher() i=5 2024-09-14T11:14:20.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.792+0000 7f2fa5925800 20 add_watcher() i=6 2024-09-14T11:14:20.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.792+0000 7f2fa5925800 20 add_watcher() i=7 2024-09-14T11:14:20.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.793+0000 7f2fa5925800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:20.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.794+0000 7f2e57fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:20.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.795+0000 7f2fa5925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:20.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.795+0000 7f2fa5925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:20.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.795+0000 7f2fa5925800 5 note: GC not initialized 2024-09-14T11:14:20.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.795+0000 7f2e56fe5640 20 reqs_thread_entry: start 2024-09-14T11:14:20.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.795+0000 7f2fa5925800 20 init_complete bucket index max shards: 11 2024-09-14T11:14:20.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.795+0000 7f2fa5925800 20 Filter name: none 2024-09-14T11:14:20.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.795+0000 7f2e54fe1640 20 reqs_thread_entry: start 2024-09-14T11:14:20.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.795+0000 7f2fa5925800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:14:20.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.795+0000 7f2fa5925800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.796+0000 7f2fa5925800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:14:20.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.796+0000 7f2fa5925800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:14:20.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.796+0000 7f2fa5925800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:14:20.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.796+0000 7f2fa5925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : miss 2024-09-14T11:14:20.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.796+0000 7f2fa5925800 20 rados->read ofs=0 len=0 2024-09-14T11:14:20.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.796+0000 7f2fa5925800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:14:20.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.796+0000 7f2fa5925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:14:20.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.796+0000 7f2fa5925800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:14:20.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.796+0000 7f2fa5925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:20.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.796+0000 7f2fa5925800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:14:20.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.796+0000 7f2fa5925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:14:20.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.796+0000 7f2fa5925800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:14:20.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.796+0000 7f2fa5925800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:14:20.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.796+0000 7f2fa5925800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:14:20.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.796+0000 7f2fa5925800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:14:20.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.797+0000 7f2fa5925800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:14:20.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.797+0000 7f2fa5925800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:14:20.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.797+0000 7f2fa5925800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:14:20.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.797+0000 7f2fa5925800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:14:20.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.798+0000 7f2fa5925800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:14:20.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.798+0000 7f2fa5925800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:14:20.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.798+0000 7f2fa5925800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:14:20.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.798+0000 7f2fa5925800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:14:20.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.799+0000 7f2fa5925800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:14:20.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.799+0000 7f2fa5925800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:14:20.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.799+0000 7f2fa5925800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:14:20.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.799+0000 7f2fa5925800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:14:20.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.799+0000 7f2fa5925800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:14:20.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.799+0000 7f2fa5925800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:14:20.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.800+0000 7f2fa5925800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:14:20.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.800+0000 7f2fa5925800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:14:20.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.800+0000 7f2fa5925800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:14:20.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.800+0000 7f2fa5925800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:14:20.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.800+0000 7f2fa5925800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:14:20.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.800+0000 7f2fa5925800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:14:20.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.801+0000 7f2fa5925800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:14:20.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.801+0000 7f2fa5925800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:14:20.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.802+0000 7f2e57fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:20.803 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.804+0000 7f2fa5925800 20 remove_watcher() i=0 2024-09-14T11:14:20.803 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.804+0000 7f2fa5925800 2 removed watcher, disabling cache 2024-09-14T11:14:20.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.805+0000 7f2fa5925800 20 remove_watcher() i=1 2024-09-14T11:14:20.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.806+0000 7f2fa5925800 20 remove_watcher() i=2 2024-09-14T11:14:20.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.807+0000 7f2fa5925800 20 remove_watcher() i=3 2024-09-14T11:14:20.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.808+0000 7f2fa5925800 20 remove_watcher() i=4 2024-09-14T11:14:20.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.809+0000 7f2fa5925800 20 remove_watcher() i=5 2024-09-14T11:14:20.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.810+0000 7f2fa5925800 20 remove_watcher() i=6 2024-09-14T11:14:20.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:20.811+0000 7f2fa5925800 20 remove_watcher() i=7 2024-09-14T11:14:50.853 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:14:50.888 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:50.888 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:50.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:50.935+0000 7f357892c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:50.937+0000 7f357892c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:50.937+0000 7f357892c800 20 realm 2024-09-14T11:14:50.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:50.937+0000 7f357892c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:50.937+0000 7f357892c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:50.937+0000 7f357892c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:50.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:50.937+0000 7f357892c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:50.937+0000 7f357892c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:50.937+0000 7f357892c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:50.938+0000 7f357892c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:50.937 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:50.938+0000 7f357892c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:50.939+0000 7f357892c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:50.938 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:50.939+0000 7f357892c800 20 searching for the correct realm 2024-09-14T11:14:50.939 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:50.940+0000 7f35746da640 0 -- 172.21.15.50:0/408124651 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x7f356c01a050 msgr2=0x7f356c01a430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:51.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.146+0000 7f3574edb640 0 -- 172.21.15.50:0/408124651 >> [v2:172.21.15.118:6826/1082138742,v1:172.21.15.118:6827/1082138742] conn(0x7f35640be040 msgr2=0x7f35640ab300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:51.355 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.356+0000 7f357892c800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:14:51.355 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.356+0000 7f357892c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:51.355 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.356+0000 7f357892c800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:14:51.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.356+0000 7f357892c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:51.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.356+0000 7f357892c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:51.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.356+0000 7f357892c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:51.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.356+0000 7f357892c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.356+0000 7f357892c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.356 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.356+0000 7f357892c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.357+0000 7f357892c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:51.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.357+0000 7f357892c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.357+0000 7f357892c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:51.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.357+0000 7f357892c800 20 zone default found 2024-09-14T11:14:51.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.357+0000 7f357892c800 4 Realm: () 2024-09-14T11:14:51.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.357+0000 7f357892c800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:14:51.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.357+0000 7f357892c800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:14:51.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.357+0000 7f357892c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:51.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.357+0000 7f357892c800 20 zonegroup default 2024-09-14T11:14:51.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.357+0000 7f357892c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.357+0000 7f357892c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.358+0000 7f357892c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.358+0000 7f357892c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.358+0000 7f357892c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.358+0000 7f357892c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.358+0000 7f357892c800 20 started sync module instance, tier type = 2024-09-14T11:14:51.358 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.358+0000 7f357892c800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:14:51.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.369+0000 7f357892c800 20 add_watcher() i=0 2024-09-14T11:14:51.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.369+0000 7f357892c800 20 add_watcher() i=1 2024-09-14T11:14:51.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.369+0000 7f357892c800 20 add_watcher() i=2 2024-09-14T11:14:51.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.369+0000 7f357892c800 20 add_watcher() i=3 2024-09-14T11:14:51.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.369+0000 7f357892c800 20 add_watcher() i=4 2024-09-14T11:14:51.368 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.369+0000 7f357892c800 20 add_watcher() i=5 2024-09-14T11:14:51.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.369+0000 7f357892c800 20 add_watcher() i=6 2024-09-14T11:14:51.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.370+0000 7f357892c800 20 add_watcher() i=7 2024-09-14T11:14:51.369 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.370+0000 7f357892c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:51.371 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.372+0000 7f342afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:51.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.373+0000 7f357892c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:51.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.373+0000 7f357892c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:51.372 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.373+0000 7f357892c800 5 note: GC not initialized 2024-09-14T11:14:51.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.373+0000 7f3429fdb640 20 reqs_thread_entry: start 2024-09-14T11:14:51.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.373+0000 7f357892c800 20 init_complete bucket index max shards: 11 2024-09-14T11:14:51.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.373+0000 7f357892c800 20 Filter name: none 2024-09-14T11:14:51.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.374+0000 7f339b7fe640 20 reqs_thread_entry: start 2024-09-14T11:14:51.373 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.374+0000 7f357892c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.374+0000 7f357892c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:14:51.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.374+0000 7f357892c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.375+0000 7f357892c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:14:51.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.375+0000 7f357892c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:51.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.375+0000 7f357892c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.375 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.375+0000 7f357892c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:14:51.375 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.375+0000 7f357892c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.375 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.375+0000 7f357892c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:14:51.375 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.375+0000 7f357892c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:51.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.378+0000 7f342afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:51.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.380+0000 7f357892c800 20 remove_watcher() i=0 2024-09-14T11:14:51.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.380+0000 7f357892c800 2 removed watcher, disabling cache 2024-09-14T11:14:51.380 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.381+0000 7f357892c800 20 remove_watcher() i=1 2024-09-14T11:14:51.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.383+0000 7f357892c800 20 remove_watcher() i=2 2024-09-14T11:14:51.383 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.384+0000 7f357892c800 20 remove_watcher() i=3 2024-09-14T11:14:51.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.385+0000 7f357892c800 20 remove_watcher() i=4 2024-09-14T11:14:51.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.387+0000 7f357892c800 20 remove_watcher() i=5 2024-09-14T11:14:51.387 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.388+0000 7f357892c800 20 remove_watcher() i=6 2024-09-14T11:14:51.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.389+0000 7f357892c800 20 remove_watcher() i=7 2024-09-14T11:14:51.404 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:51.404 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:14:51.501 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:14:51.530 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:51.530 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:51.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.571+0000 7f2a57d46800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.572+0000 7f2a57d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.572+0000 7f2a57d46800 20 realm 2024-09-14T11:14:51.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.572+0000 7f2a57d46800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.573+0000 7f2a57d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.573+0000 7f2a57d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:51.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.573+0000 7f2a57d46800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.573+0000 7f2a57d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.573+0000 7f2a57d46800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.574+0000 7f2a57d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:51.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.574+0000 7f2a57d46800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.574+0000 7f2a57d46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:51.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.574+0000 7f2a57d46800 20 searching for the correct realm 2024-09-14T11:14:51.577 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.578+0000 7f2a5502f640 0 -- 172.21.15.50:0/3033938145 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f2a5006e8d0 msgr2=0x7f2a50087a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:51.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.784+0000 7f2a56031640 0 -- 172.21.15.50:0/3033938145 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55f93b9fdd80 msgr2=0x55f93ba001d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:51.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.789+0000 7f2a57d46800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:14:51.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.789+0000 7f2a57d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:51.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.789+0000 7f2a57d46800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:14:51.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.789+0000 7f2a57d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:51.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.789+0000 7f2a57d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:51.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.789+0000 7f2a57d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:51.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.789+0000 7f2a57d46800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.789+0000 7f2a57d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.789+0000 7f2a57d46800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.790+0000 7f2a57d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:51.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.790+0000 7f2a57d46800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.790+0000 7f2a57d46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:51.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.790+0000 7f2a57d46800 20 zone default found 2024-09-14T11:14:51.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.790+0000 7f2a57d46800 4 Realm: () 2024-09-14T11:14:51.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.790+0000 7f2a57d46800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:14:51.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.790+0000 7f2a57d46800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:14:51.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.790+0000 7f2a57d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:51.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.790+0000 7f2a57d46800 20 zonegroup default 2024-09-14T11:14:51.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.790+0000 7f2a57d46800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.791+0000 7f2a57d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.791+0000 7f2a57d46800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.791+0000 7f2a57d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.791+0000 7f2a57d46800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.791+0000 7f2a57d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.791+0000 7f2a57d46800 20 started sync module instance, tier type = 2024-09-14T11:14:51.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.791+0000 7f2a57d46800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:14:51.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.801+0000 7f2a57d46800 20 add_watcher() i=0 2024-09-14T11:14:51.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.801+0000 7f2a57d46800 20 add_watcher() i=1 2024-09-14T11:14:51.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.801+0000 7f2a57d46800 20 add_watcher() i=2 2024-09-14T11:14:51.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.801+0000 7f2a57d46800 20 add_watcher() i=3 2024-09-14T11:14:51.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.801+0000 7f2a57d46800 20 add_watcher() i=4 2024-09-14T11:14:51.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.801+0000 7f2a57d46800 20 add_watcher() i=5 2024-09-14T11:14:51.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.801+0000 7f2a57d46800 20 add_watcher() i=6 2024-09-14T11:14:51.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.802+0000 7f2a57d46800 20 add_watcher() i=7 2024-09-14T11:14:51.801 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.802+0000 7f2a57d46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:51.803 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.804+0000 7f29077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:51.804 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.805+0000 7f2a57d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:51.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.805+0000 7f2a57d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:51.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.805+0000 7f2a57d46800 5 note: GC not initialized 2024-09-14T11:14:51.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.805+0000 7f29067fc640 20 reqs_thread_entry: start 2024-09-14T11:14:51.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.805+0000 7f2a57d46800 20 init_complete bucket index max shards: 11 2024-09-14T11:14:51.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.805+0000 7f2a57d46800 20 Filter name: none 2024-09-14T11:14:51.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.805+0000 7f2877fff640 20 reqs_thread_entry: start 2024-09-14T11:14:51.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.805+0000 7f2a57d46800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:14:51.805 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.805+0000 7f2a57d46800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.806+0000 7f2a57d46800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:14:51.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.806+0000 7f2a57d46800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:14:51.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.806+0000 7f2a57d46800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:14:51.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.806+0000 7f2a57d46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : miss 2024-09-14T11:14:51.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.806+0000 7f2a57d46800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.806+0000 7f2a57d46800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:14:51.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.806+0000 7f2a57d46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:14:51.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.806+0000 7f2a57d46800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:14:51.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.806+0000 7f2a57d46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:51.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.806+0000 7f2a57d46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:14:51.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.806+0000 7f2a57d46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:14:51.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.806+0000 7f2a57d46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:14:51.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.806+0000 7f2a57d46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:14:51.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.807+0000 7f2a57d46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:14:51.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.807+0000 7f2a57d46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:14:51.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.807+0000 7f2a57d46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:14:51.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.807+0000 7f2a57d46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:14:51.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.808+0000 7f2a57d46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:14:51.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.808+0000 7f2a57d46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:14:51.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.808+0000 7f2a57d46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:14:51.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.808+0000 7f2a57d46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:14:51.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.809+0000 7f2a57d46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:14:51.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.809+0000 7f2a57d46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:14:51.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.809+0000 7f2a57d46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:14:51.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.809+0000 7f2a57d46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:14:51.809 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.809+0000 7f2a57d46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:14:51.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.809+0000 7f2a57d46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:14:51.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.810+0000 7f2a57d46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:14:51.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.810+0000 7f2a57d46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:14:51.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.810+0000 7f2a57d46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:14:51.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.810+0000 7f2a57d46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:14:51.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.810+0000 7f2a57d46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:14:51.811 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.810+0000 7f2a57d46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:14:51.811 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.811+0000 7f2a57d46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:14:51.811 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.811+0000 7f2a57d46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:14:51.811 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.811+0000 7f2a57d46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:14:51.811 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.811+0000 7f2a57d46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:14:51.811 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.812+0000 7f29077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:51.814 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.815+0000 7f2a57d46800 20 remove_watcher() i=0 2024-09-14T11:14:51.814 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.815+0000 7f2a57d46800 2 removed watcher, disabling cache 2024-09-14T11:14:51.815 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.816+0000 7f2a57d46800 20 remove_watcher() i=1 2024-09-14T11:14:51.816 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.817+0000 7f2a57d46800 20 remove_watcher() i=2 2024-09-14T11:14:51.817 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.818+0000 7f2a57d46800 20 remove_watcher() i=3 2024-09-14T11:14:51.818 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.819+0000 7f2a57d46800 20 remove_watcher() i=4 2024-09-14T11:14:51.819 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.820+0000 7f2a57d46800 20 remove_watcher() i=5 2024-09-14T11:14:51.820 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.821+0000 7f2a57d46800 20 remove_watcher() i=6 2024-09-14T11:14:51.821 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.822+0000 7f2a57d46800 20 remove_watcher() i=7 2024-09-14T11:14:51.835 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:14:51.865 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:51.865 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:51.904 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.905+0000 7f568701d800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.907+0000 7f568701d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.907+0000 7f568701d800 20 realm 2024-09-14T11:14:51.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.907+0000 7f568701d800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.907+0000 7f568701d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.907+0000 7f568701d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:51.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.907+0000 7f568701d800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.907+0000 7f568701d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.907+0000 7f568701d800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.908+0000 7f568701d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:51.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.908+0000 7f568701d800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.909+0000 7f568701d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:51.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.909+0000 7f568701d800 20 searching for the correct realm 2024-09-14T11:14:51.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:51.912+0000 7f5681fea640 0 -- 172.21.15.50:0/2845160489 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f567c025040 msgr2=0x7f567c065720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:52.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.118+0000 7f5681fea640 0 -- 172.21.15.50:0/2845160489 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55d9c0938120 msgr2=0x55d9c093a5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:52.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.122+0000 7f568701d800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:14:52.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.122+0000 7f568701d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:52.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.122+0000 7f568701d800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:14:52.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.122+0000 7f568701d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:52.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.122+0000 7f568701d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:52.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.122+0000 7f568701d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:52.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.122+0000 7f568701d800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.123+0000 7f568701d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.123+0000 7f568701d800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.123+0000 7f568701d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:52.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.123+0000 7f568701d800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.123+0000 7f568701d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:52.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.123+0000 7f568701d800 20 zone default found 2024-09-14T11:14:52.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.123+0000 7f568701d800 4 Realm: () 2024-09-14T11:14:52.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.123+0000 7f568701d800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:14:52.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.123+0000 7f568701d800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:14:52.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.123+0000 7f568701d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:52.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.123+0000 7f568701d800 20 zonegroup default 2024-09-14T11:14:52.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.123+0000 7f568701d800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.124+0000 7f568701d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.124+0000 7f568701d800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.124+0000 7f568701d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.124+0000 7f568701d800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.124+0000 7f568701d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.124+0000 7f568701d800 20 started sync module instance, tier type = 2024-09-14T11:14:52.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.124+0000 7f568701d800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:14:52.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.134+0000 7f568701d800 20 add_watcher() i=0 2024-09-14T11:14:52.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.134+0000 7f568701d800 20 add_watcher() i=1 2024-09-14T11:14:52.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.134+0000 7f568701d800 20 add_watcher() i=2 2024-09-14T11:14:52.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.134+0000 7f568701d800 20 add_watcher() i=3 2024-09-14T11:14:52.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.134+0000 7f568701d800 20 add_watcher() i=4 2024-09-14T11:14:52.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.134+0000 7f568701d800 20 add_watcher() i=5 2024-09-14T11:14:52.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.134+0000 7f568701d800 20 add_watcher() i=6 2024-09-14T11:14:52.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.135+0000 7f568701d800 20 add_watcher() i=7 2024-09-14T11:14:52.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.135+0000 7f568701d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:52.135 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.136+0000 7f5538fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:52.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.137+0000 7f568701d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:52.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.137+0000 7f568701d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:52.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.137+0000 7f568701d800 5 note: GC not initialized 2024-09-14T11:14:52.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.137+0000 7f54b37fe640 20 reqs_thread_entry: start 2024-09-14T11:14:52.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.137+0000 7f568701d800 20 init_complete bucket index max shards: 11 2024-09-14T11:14:52.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.137+0000 7f568701d800 20 Filter name: none 2024-09-14T11:14:52.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.137+0000 7f54b17fa640 20 reqs_thread_entry: start 2024-09-14T11:14:52.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.137+0000 7f568701d800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.138 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.138+0000 7f568701d800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:14:52.138 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.138+0000 7f568701d800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.138 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.138+0000 7f568701d800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:14:52.138 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.138+0000 7f568701d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:52.138 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.138+0000 7f568701d800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.138 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.138+0000 7f568701d800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:14:52.138 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.138+0000 7f568701d800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.139 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.139+0000 7f568701d800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:14:52.139 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.139+0000 7f568701d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:52.140 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.141+0000 7f5538fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:52.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.144+0000 7f568701d800 20 remove_watcher() i=0 2024-09-14T11:14:52.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.144+0000 7f568701d800 2 removed watcher, disabling cache 2024-09-14T11:14:52.143 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.145+0000 7f568701d800 20 remove_watcher() i=1 2024-09-14T11:14:52.145 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.146+0000 7f568701d800 20 remove_watcher() i=2 2024-09-14T11:14:52.146 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.147+0000 7f568701d800 20 remove_watcher() i=3 2024-09-14T11:14:52.147 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.148+0000 7f568701d800 20 remove_watcher() i=4 2024-09-14T11:14:52.148 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.149+0000 7f568701d800 20 remove_watcher() i=5 2024-09-14T11:14:52.149 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.150+0000 7f568701d800 20 remove_watcher() i=6 2024-09-14T11:14:52.150 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.151+0000 7f568701d800 20 remove_watcher() i=7 2024-09-14T11:14:52.161 INFO:tasks.workunit.client.0.smithi050.stderr: test: duplicated entries should be purged before reshard 2024-09-14T11:14:52.163 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:14:52.192 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:52.192 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:52.231 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.232+0000 7f9b1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.235+0000 7f9b1512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.235+0000 7f9b1512c800 20 realm 2024-09-14T11:14:52.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.235+0000 7f9b1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.235+0000 7f9b1512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.235+0000 7f9b1512c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:52.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.235+0000 7f9b1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.235+0000 7f9b1512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.235+0000 7f9b1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.236+0000 7f9b1512c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:52.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.236+0000 7f9b1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.236+0000 7f9b1512c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:52.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.236+0000 7f9b1512c800 20 searching for the correct realm 2024-09-14T11:14:52.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.239+0000 7f9b0bfff640 0 -- 172.21.15.50:0/2880904858 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f9b0c0670c0 msgr2=0x7f9b0c087a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:52.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.243+0000 7f9b0bfff640 0 -- 172.21.15.50:0/2880904858 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55af62686bc0 msgr2=0x55af62688fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:52.246 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.247+0000 7f9b1512c800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:14:52.247 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.247+0000 7f9b1512c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:52.247 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.247+0000 7f9b1512c800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:14:52.247 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.247+0000 7f9b1512c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:52.247 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.247+0000 7f9b1512c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:52.247 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.247+0000 7f9b1512c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:52.247 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.247+0000 7f9b1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.247 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.248+0000 7f9b1512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.247 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.248+0000 7f9b1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.248+0000 7f9b1512c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:52.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.248+0000 7f9b1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.248+0000 7f9b1512c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:52.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.248+0000 7f9b1512c800 20 zone default found 2024-09-14T11:14:52.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.248+0000 7f9b1512c800 4 Realm: () 2024-09-14T11:14:52.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.248+0000 7f9b1512c800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:14:52.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.248+0000 7f9b1512c800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:14:52.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.248+0000 7f9b1512c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:52.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.248+0000 7f9b1512c800 20 zonegroup default 2024-09-14T11:14:52.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.248+0000 7f9b1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.248+0000 7f9b1512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.248+0000 7f9b1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.249+0000 7f9b1512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.249+0000 7f9b1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.249+0000 7f9b1512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.249+0000 7f9b1512c800 20 started sync module instance, tier type = 2024-09-14T11:14:52.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.249+0000 7f9b1512c800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:14:52.257 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.258+0000 7f9b1512c800 20 add_watcher() i=0 2024-09-14T11:14:52.257 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.258+0000 7f9b1512c800 20 add_watcher() i=1 2024-09-14T11:14:52.257 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.258+0000 7f9b1512c800 20 add_watcher() i=2 2024-09-14T11:14:52.257 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.258+0000 7f9b1512c800 20 add_watcher() i=3 2024-09-14T11:14:52.257 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.258+0000 7f9b1512c800 20 add_watcher() i=4 2024-09-14T11:14:52.257 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.258+0000 7f9b1512c800 20 add_watcher() i=5 2024-09-14T11:14:52.257 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.258+0000 7f9b1512c800 20 add_watcher() i=6 2024-09-14T11:14:52.258 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.259+0000 7f9b1512c800 20 add_watcher() i=7 2024-09-14T11:14:52.258 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.259+0000 7f9b1512c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:52.260 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.261+0000 7f99c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:52.261 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.261+0000 7f9b1512c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:52.261 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.261+0000 7f9b1512c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:52.261 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.261+0000 7f9b1512c800 5 note: GC not initialized 2024-09-14T11:14:52.261 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.261+0000 7f99c67e4640 20 reqs_thread_entry: start 2024-09-14T11:14:52.261 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.261+0000 7f9b1512c800 20 init_complete bucket index max shards: 11 2024-09-14T11:14:52.261 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.261+0000 7f9b1512c800 20 Filter name: none 2024-09-14T11:14:52.261 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.261+0000 7f99bf7fe640 20 reqs_thread_entry: start 2024-09-14T11:14:52.261 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.261+0000 7f9b1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.262 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.262+0000 7f9b1512c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:14:52.262 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.262+0000 7f9b1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.262 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.262+0000 7f9b1512c800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:14:52.262 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.262+0000 7f9b1512c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:52.263 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.262+0000 7f9b1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.263 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.262+0000 7f9b1512c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:14:52.263 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.262+0000 7f9b1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.263 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.263+0000 7f9b1512c800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:14:52.263 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.263+0000 7f9b1512c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:52.264 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.265+0000 7f99c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:52.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.267+0000 7f9b1512c800 20 remove_watcher() i=0 2024-09-14T11:14:52.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.267+0000 7f9b1512c800 2 removed watcher, disabling cache 2024-09-14T11:14:52.266 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.268+0000 7f9b1512c800 20 remove_watcher() i=1 2024-09-14T11:14:52.268 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.269+0000 7f9b1512c800 20 remove_watcher() i=2 2024-09-14T11:14:52.268 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.270+0000 7f9b1512c800 20 remove_watcher() i=3 2024-09-14T11:14:52.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.271+0000 7f9b1512c800 20 remove_watcher() i=4 2024-09-14T11:14:52.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.272+0000 7f9b1512c800 20 remove_watcher() i=5 2024-09-14T11:14:52.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.272+0000 7f9b1512c800 20 remove_watcher() i=6 2024-09-14T11:14:52.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.273+0000 7f9b1512c800 20 remove_watcher() i=7 2024-09-14T11:14:52.284 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.284 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:14:52.284 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: a-bucket id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-14T11:14:52.284 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.285 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:14:52.320 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:52.320 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:52.359 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.360+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.362+0000 7fcb2e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.362+0000 7fcb2e887800 20 realm 2024-09-14T11:14:52.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.362+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.362+0000 7fcb2e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.362+0000 7fcb2e887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:52.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.362+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.363+0000 7fcb2e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.362 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.363+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.364+0000 7fcb2e887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:52.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.364+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.364+0000 7fcb2e887800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:52.363 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.364+0000 7fcb2e887800 20 searching for the correct realm 2024-09-14T11:14:52.366 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.367+0000 7fcb2bb70640 0 -- 172.21.15.50:0/3522413320 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fcb24061040 msgr2=0x7fcb240df900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:52.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.371+0000 7fcb2cb72640 0 -- 172.21.15.50:0/3522413320 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55cca399c810 msgr2=0x55cca399ec80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:52.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.375+0000 7fcb2e887800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:14:52.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.375+0000 7fcb2e887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:52.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.375+0000 7fcb2e887800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:14:52.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.375+0000 7fcb2e887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:52.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.375+0000 7fcb2e887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:52.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.375+0000 7fcb2e887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:52.374 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.375+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.375 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.375+0000 7fcb2e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.375 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.375+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.376 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.375+0000 7fcb2e887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:52.376 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.375+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.376 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.376+0000 7fcb2e887800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:52.376 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.376+0000 7fcb2e887800 20 zone default found 2024-09-14T11:14:52.376 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.376+0000 7fcb2e887800 4 Realm: () 2024-09-14T11:14:52.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.376+0000 7fcb2e887800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:14:52.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.376+0000 7fcb2e887800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:14:52.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.376+0000 7fcb2e887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:52.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.376+0000 7fcb2e887800 20 zonegroup default 2024-09-14T11:14:52.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.376+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.376+0000 7fcb2e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.376+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.376+0000 7fcb2e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.376+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.376+0000 7fcb2e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.376+0000 7fcb2e887800 20 started sync module instance, tier type = 2024-09-14T11:14:52.377 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.376+0000 7fcb2e887800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:14:52.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.385+0000 7fcb2e887800 20 add_watcher() i=0 2024-09-14T11:14:52.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.385+0000 7fcb2e887800 20 add_watcher() i=1 2024-09-14T11:14:52.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.385+0000 7fcb2e887800 20 add_watcher() i=2 2024-09-14T11:14:52.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.385+0000 7fcb2e887800 20 add_watcher() i=3 2024-09-14T11:14:52.384 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.385+0000 7fcb2e887800 20 add_watcher() i=4 2024-09-14T11:14:52.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.385+0000 7fcb2e887800 20 add_watcher() i=5 2024-09-14T11:14:52.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.385+0000 7fcb2e887800 20 add_watcher() i=6 2024-09-14T11:14:52.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.386+0000 7fcb2e887800 20 add_watcher() i=7 2024-09-14T11:14:52.385 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.386+0000 7fcb2e887800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:52.386 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.387+0000 7fc9e2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:52.387 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.388+0000 7fcb2e887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:52.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.388+0000 7fcb2e887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:52.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.388+0000 7fcb2e887800 5 note: GC not initialized 2024-09-14T11:14:52.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.388+0000 7fc9e1fdb640 20 reqs_thread_entry: start 2024-09-14T11:14:52.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.388+0000 7fcb2e887800 20 init_complete bucket index max shards: 11 2024-09-14T11:14:52.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.388+0000 7fcb2e887800 20 Filter name: none 2024-09-14T11:14:52.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.388+0000 7fc9537fe640 20 reqs_thread_entry: start 2024-09-14T11:14:52.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.388+0000 7fcb2e887800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:14:52.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.388+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.389+0000 7fcb2e887800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:14:52.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.389+0000 7fcb2e887800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:14:52.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.389+0000 7fcb2e887800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:14:52.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.389+0000 7fcb2e887800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : miss 2024-09-14T11:14:52.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.389+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.389+0000 7fcb2e887800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:14:52.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.389+0000 7fcb2e887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:14:52.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.389+0000 7fcb2e887800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:14:52.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.389+0000 7fcb2e887800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:52.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.389+0000 7fcb2e887800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:14:52.389 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.389+0000 7fcb2e887800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:14:52.394 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.395+0000 7fcb2e887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:14:52.394 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.395+0000 7fcb2e887800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:14:52.394 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.395+0000 7fcb2e887800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:14:52.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.395+0000 7fcb2e887800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18, ofs0, ns] 2024-09-14T11:14:52.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.396+0000 7fca037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497133 cookie 94337406520512 notifier 7766 bl.length()=911 2024-09-14T11:14:52.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.396+0000 7fca037fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:14:52.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.396+0000 7fca037fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:14:52.395 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.396+0000 7fca037fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:14:52.396 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.397+0000 7fcb2e887800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_sources= new_sources= 2024-09-14T11:14:52.396 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.397+0000 7fcb2e887800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential sources added=[] removed=[] 2024-09-14T11:14:52.396 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.397+0000 7fcb2e887800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_dests= new_dests= 2024-09-14T11:14:52.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.397+0000 7fcb2e887800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential dests added=[] removed=[] 2024-09-14T11:14:52.401 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcb2e887800 time 2024-09-14T11:14:52.404105+0000 2024-09-14T11:14:52.401 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:14:52.402 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:52.402 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcb31d8c76a] 2024-09-14T11:14:52.402 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fcb31d8c928] 2024-09-14T11:14:52.402 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cca1c8f0b1] 2024-09-14T11:14:52.402 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55cca1c9ef6a] 2024-09-14T11:14:52.402 INFO:tasks.workunit.client.0.smithi050.stderr: 5: main() 2024-09-14T11:14:52.402 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fcb30a29590] 2024-09-14T11:14:52.402 INFO:tasks.workunit.client.0.smithi050.stderr: 7: __libc_start_main() 2024-09-14T11:14:52.403 INFO:tasks.workunit.client.0.smithi050.stderr: 8: _start() 2024-09-14T11:14:52.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.403+0000 7fcb2e887800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcb2e887800 time 2024-09-14T11:14:52.404105+0000 2024-09-14T11:14:52.403 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:14:52.403 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.403 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:52.403 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcb31d8c76a] 2024-09-14T11:14:52.403 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fcb31d8c928] 2024-09-14T11:14:52.403 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cca1c8f0b1] 2024-09-14T11:14:52.403 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55cca1c9ef6a] 2024-09-14T11:14:52.403 INFO:tasks.workunit.client.0.smithi050.stderr: 5: main() 2024-09-14T11:14:52.403 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fcb30a29590] 2024-09-14T11:14:52.403 INFO:tasks.workunit.client.0.smithi050.stderr: 7: __libc_start_main() 2024-09-14T11:14:52.403 INFO:tasks.workunit.client.0.smithi050.stderr: 8: _start() 2024-09-14T11:14:52.403 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.404 INFO:tasks.workunit.client.0.smithi050.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:14:52.404 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7fcb2e887800 thread_name:radosgw-admin 2024-09-14T11:14:52.422 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:52.423 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcb30a3e6f0] 2024-09-14T11:14:52.423 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fcb30a8b99c] 2024-09-14T11:14:52.423 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:14:52.423 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:14:52.423 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcb31d8c7c4] 2024-09-14T11:14:52.423 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fcb31d8c928] 2024-09-14T11:14:52.423 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cca1c8f0b1] 2024-09-14T11:14:52.423 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55cca1c9ef6a] 2024-09-14T11:14:52.423 INFO:tasks.workunit.client.0.smithi050.stderr: 9: main() 2024-09-14T11:14:52.423 INFO:tasks.workunit.client.0.smithi050.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fcb30a29590] 2024-09-14T11:14:52.423 INFO:tasks.workunit.client.0.smithi050.stderr: 11: __libc_start_main() 2024-09-14T11:14:52.423 INFO:tasks.workunit.client.0.smithi050.stderr: 12: _start() 2024-09-14T11:14:52.424 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.404+0000 7fcb2e887800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:14:52.424 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7fcb2e887800 thread_name:radosgw-admin 2024-09-14T11:14:52.424 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.424 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:52.424 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcb30a3e6f0] 2024-09-14T11:14:52.424 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fcb30a8b99c] 2024-09-14T11:14:52.424 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:14:52.424 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:14:52.424 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcb31d8c7c4] 2024-09-14T11:14:52.424 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fcb31d8c928] 2024-09-14T11:14:52.424 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cca1c8f0b1] 2024-09-14T11:14:52.424 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55cca1c9ef6a] 2024-09-14T11:14:52.425 INFO:tasks.workunit.client.0.smithi050.stderr: 9: main() 2024-09-14T11:14:52.425 INFO:tasks.workunit.client.0.smithi050.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fcb30a29590] 2024-09-14T11:14:52.425 INFO:tasks.workunit.client.0.smithi050.stderr: 11: __libc_start_main() 2024-09-14T11:14:52.425 INFO:tasks.workunit.client.0.smithi050.stderr: 12: _start() 2024-09-14T11:14:52.425 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:14:52.425 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.425 INFO:tasks.workunit.client.0.smithi050.stderr:--- begin dump of recent events --- 2024-09-14T11:14:52.425 INFO:tasks.workunit.client.0.smithi050.stderr: -499> 2024-09-14T11:14:52.342+0000 7fca1a60c640 10 monclient: dump: 2024-09-14T11:14:52.425 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:52.425 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:52.425 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.425 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.425 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.425 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.425 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:52.426 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:52.426 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:52.426 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.426 INFO:tasks.workunit.client.0.smithi050.stderr: -498> 2024-09-14T11:14:52.342+0000 7fcb2e887800 5 monclient: authenticate success, global_id 8319 2024-09-14T11:14:52.426 INFO:tasks.workunit.client.0.smithi050.stderr: -497> 2024-09-14T11:14:52.342+0000 7fcb2e887800 10 monclient: get_monmap_and_config success 2024-09-14T11:14:52.426 INFO:tasks.workunit.client.0.smithi050.stderr: -496> 2024-09-14T11:14:52.342+0000 7fcb2e887800 4 set_mon_vals no callback set 2024-09-14T11:14:52.426 INFO:tasks.workunit.client.0.smithi050.stderr: -495> 2024-09-14T11:14:52.343+0000 7fcb2e887800 10 monclient: shutdown 2024-09-14T11:14:52.426 INFO:tasks.workunit.client.0.smithi050.stderr: -494> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 asok(0x55cca368e270) unregister_commands rotate-key 2024-09-14T11:14:52.426 INFO:tasks.workunit.client.0.smithi050.stderr: -493> 2024-09-14T11:14:52.343+0000 7fcb2e887800 10 monclient: build_initial_monmap 2024-09-14T11:14:52.426 INFO:tasks.workunit.client.0.smithi050.stderr: -492> 2024-09-14T11:14:52.343+0000 7fcb2e887800 1 build_initial for_mkfs: 0 2024-09-14T11:14:52.426 INFO:tasks.workunit.client.0.smithi050.stderr: -491> 2024-09-14T11:14:52.343+0000 7fcb2e887800 10 monclient: monmap: 2024-09-14T11:14:52.426 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:14:52.426 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:52.427 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:14:52.427 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:14:52.427 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:52.427 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.427 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:14:52.427 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:14:52.427 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:14:52.427 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.427 INFO:tasks.workunit.client.0.smithi050.stderr: -490> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding auth protocol: cephx 2024-09-14T11:14:52.427 INFO:tasks.workunit.client.0.smithi050.stderr: -489> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding auth protocol: cephx 2024-09-14T11:14:52.427 INFO:tasks.workunit.client.0.smithi050.stderr: -488> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding auth protocol: cephx 2024-09-14T11:14:52.427 INFO:tasks.workunit.client.0.smithi050.stderr: -487> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding con mode: secure 2024-09-14T11:14:52.427 INFO:tasks.workunit.client.0.smithi050.stderr: -486> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding con mode: crc 2024-09-14T11:14:52.427 INFO:tasks.workunit.client.0.smithi050.stderr: -485> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding con mode: secure 2024-09-14T11:14:52.428 INFO:tasks.workunit.client.0.smithi050.stderr: -484> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding con mode: crc 2024-09-14T11:14:52.428 INFO:tasks.workunit.client.0.smithi050.stderr: -483> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding con mode: secure 2024-09-14T11:14:52.428 INFO:tasks.workunit.client.0.smithi050.stderr: -482> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding con mode: crc 2024-09-14T11:14:52.428 INFO:tasks.workunit.client.0.smithi050.stderr: -481> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding con mode: crc 2024-09-14T11:14:52.428 INFO:tasks.workunit.client.0.smithi050.stderr: -480> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding con mode: secure 2024-09-14T11:14:52.428 INFO:tasks.workunit.client.0.smithi050.stderr: -479> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding con mode: crc 2024-09-14T11:14:52.428 INFO:tasks.workunit.client.0.smithi050.stderr: -478> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding con mode: secure 2024-09-14T11:14:52.428 INFO:tasks.workunit.client.0.smithi050.stderr: -477> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding con mode: crc 2024-09-14T11:14:52.428 INFO:tasks.workunit.client.0.smithi050.stderr: -476> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding con mode: secure 2024-09-14T11:14:52.428 INFO:tasks.workunit.client.0.smithi050.stderr: -475> 2024-09-14T11:14:52.343+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.428 INFO:tasks.workunit.client.0.smithi050.stderr: -474> 2024-09-14T11:14:52.343+0000 7fcb2e887800 1 librados: starting msgr at 2024-09-14T11:14:52.428 INFO:tasks.workunit.client.0.smithi050.stderr: -473> 2024-09-14T11:14:52.343+0000 7fcb2e887800 1 librados: starting objecter 2024-09-14T11:14:52.428 INFO:tasks.workunit.client.0.smithi050.stderr: -472> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command objecter_requests hook 0x55cca38b62b0 2024-09-14T11:14:52.428 INFO:tasks.workunit.client.0.smithi050.stderr: -471> 2024-09-14T11:14:52.344+0000 7fcb2e887800 1 librados: setting wanted keys 2024-09-14T11:14:52.429 INFO:tasks.workunit.client.0.smithi050.stderr: -470> 2024-09-14T11:14:52.344+0000 7fcb2e887800 1 librados: calling monclient init 2024-09-14T11:14:52.429 INFO:tasks.workunit.client.0.smithi050.stderr: -469> 2024-09-14T11:14:52.344+0000 7fcb2e887800 10 monclient: init 2024-09-14T11:14:52.429 INFO:tasks.workunit.client.0.smithi050.stderr: -468> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding auth protocol: cephx 2024-09-14T11:14:52.429 INFO:tasks.workunit.client.0.smithi050.stderr: -467> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding auth protocol: cephx 2024-09-14T11:14:52.429 INFO:tasks.workunit.client.0.smithi050.stderr: -466> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding auth protocol: cephx 2024-09-14T11:14:52.429 INFO:tasks.workunit.client.0.smithi050.stderr: -465> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding con mode: secure 2024-09-14T11:14:52.429 INFO:tasks.workunit.client.0.smithi050.stderr: -464> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding con mode: crc 2024-09-14T11:14:52.429 INFO:tasks.workunit.client.0.smithi050.stderr: -463> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding con mode: secure 2024-09-14T11:14:52.429 INFO:tasks.workunit.client.0.smithi050.stderr: -462> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding con mode: crc 2024-09-14T11:14:52.429 INFO:tasks.workunit.client.0.smithi050.stderr: -461> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding con mode: secure 2024-09-14T11:14:52.429 INFO:tasks.workunit.client.0.smithi050.stderr: -460> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding con mode: crc 2024-09-14T11:14:52.429 INFO:tasks.workunit.client.0.smithi050.stderr: -459> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding con mode: crc 2024-09-14T11:14:52.429 INFO:tasks.workunit.client.0.smithi050.stderr: -458> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding con mode: secure 2024-09-14T11:14:52.430 INFO:tasks.workunit.client.0.smithi050.stderr: -457> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding con mode: crc 2024-09-14T11:14:52.430 INFO:tasks.workunit.client.0.smithi050.stderr: -456> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding con mode: secure 2024-09-14T11:14:52.430 INFO:tasks.workunit.client.0.smithi050.stderr: -455> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding con mode: crc 2024-09-14T11:14:52.430 INFO:tasks.workunit.client.0.smithi050.stderr: -454> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding con mode: secure 2024-09-14T11:14:52.430 INFO:tasks.workunit.client.0.smithi050.stderr: -453> 2024-09-14T11:14:52.344+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.430 INFO:tasks.workunit.client.0.smithi050.stderr: -452> 2024-09-14T11:14:52.344+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.430 INFO:tasks.workunit.client.0.smithi050.stderr: -451> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command rotate-key hook 0x55cca38b0f48 2024-09-14T11:14:52.430 INFO:tasks.workunit.client.0.smithi050.stderr: -450> 2024-09-14T11:14:52.344+0000 7fcb2e887800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:52.430 INFO:tasks.workunit.client.0.smithi050.stderr: -449> 2024-09-14T11:14:52.344+0000 7fcb2e887800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:14:52.430 INFO:tasks.workunit.client.0.smithi050.stderr: -448> 2024-09-14T11:14:52.344+0000 7fcb2e887800 10 monclient(hunting): picked mon.noname-b con 0x55cca3726930 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:14:52.430 INFO:tasks.workunit.client.0.smithi050.stderr: -447> 2024-09-14T11:14:52.344+0000 7fcb2e887800 10 monclient(hunting): picked mon.noname-c con 0x55cca37fa7a0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:14:52.430 INFO:tasks.workunit.client.0.smithi050.stderr: -446> 2024-09-14T11:14:52.344+0000 7fcb2e887800 10 monclient(hunting): picked mon.noname-a con 0x55cca38e2d70 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:14:52.430 INFO:tasks.workunit.client.0.smithi050.stderr: -445> 2024-09-14T11:14:52.344+0000 7fcb2e887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.430 INFO:tasks.workunit.client.0.smithi050.stderr: -444> 2024-09-14T11:14:52.344+0000 7fcb2e887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.431 INFO:tasks.workunit.client.0.smithi050.stderr: -443> 2024-09-14T11:14:52.344+0000 7fcb2e887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.431 INFO:tasks.workunit.client.0.smithi050.stderr: -442> 2024-09-14T11:14:52.344+0000 7fcb2e887800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:52.431 INFO:tasks.workunit.client.0.smithi050.stderr: -441> 2024-09-14T11:14:52.344+0000 7fcb2e887800 10 monclient(hunting): authenticate will time out at 2544.982600s 2024-09-14T11:14:52.431 INFO:tasks.workunit.client.0.smithi050.stderr: -440> 2024-09-14T11:14:52.344+0000 7fcb2bb70640 10 monclient(hunting): get_auth_request con 0x55cca37fa7a0 auth_method 0 2024-09-14T11:14:52.431 INFO:tasks.workunit.client.0.smithi050.stderr: -439> 2024-09-14T11:14:52.344+0000 7fcb2bb70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.431 INFO:tasks.workunit.client.0.smithi050.stderr: -438> 2024-09-14T11:14:52.344+0000 7fcb2bb70640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.431 INFO:tasks.workunit.client.0.smithi050.stderr: -437> 2024-09-14T11:14:52.344+0000 7fcb2bb70640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.431 INFO:tasks.workunit.client.0.smithi050.stderr: -436> 2024-09-14T11:14:52.344+0000 7fcb2cb72640 10 monclient(hunting): get_auth_request con 0x55cca38e2d70 auth_method 0 2024-09-14T11:14:52.431 INFO:tasks.workunit.client.0.smithi050.stderr: -435> 2024-09-14T11:14:52.344+0000 7fcb2cb72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.431 INFO:tasks.workunit.client.0.smithi050.stderr: -434> 2024-09-14T11:14:52.344+0000 7fcb2cb72640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.431 INFO:tasks.workunit.client.0.smithi050.stderr: -433> 2024-09-14T11:14:52.344+0000 7fcb2cb72640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.431 INFO:tasks.workunit.client.0.smithi050.stderr: -432> 2024-09-14T11:14:52.344+0000 7fcb2c371640 10 monclient(hunting): get_auth_request con 0x55cca3726930 auth_method 0 2024-09-14T11:14:52.431 INFO:tasks.workunit.client.0.smithi050.stderr: -431> 2024-09-14T11:14:52.344+0000 7fcb2c371640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.431 INFO:tasks.workunit.client.0.smithi050.stderr: -430> 2024-09-14T11:14:52.344+0000 7fcb2c371640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.432 INFO:tasks.workunit.client.0.smithi050.stderr: -429> 2024-09-14T11:14:52.344+0000 7fcb2c371640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.432 INFO:tasks.workunit.client.0.smithi050.stderr: -428> 2024-09-14T11:14:52.344+0000 7fcb2bb70640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.432 INFO:tasks.workunit.client.0.smithi050.stderr: -427> 2024-09-14T11:14:52.344+0000 7fcb2bb70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.432 INFO:tasks.workunit.client.0.smithi050.stderr: -426> 2024-09-14T11:14:52.344+0000 7fcb2bb70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.432 INFO:tasks.workunit.client.0.smithi050.stderr: -425> 2024-09-14T11:14:52.344+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.432 INFO:tasks.workunit.client.0.smithi050.stderr: -424> 2024-09-14T11:14:52.344+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.432 INFO:tasks.workunit.client.0.smithi050.stderr: -423> 2024-09-14T11:14:52.344+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.432 INFO:tasks.workunit.client.0.smithi050.stderr: -422> 2024-09-14T11:14:52.344+0000 7fcb2c371640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.432 INFO:tasks.workunit.client.0.smithi050.stderr: -421> 2024-09-14T11:14:52.344+0000 7fcb2c371640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.432 INFO:tasks.workunit.client.0.smithi050.stderr: -420> 2024-09-14T11:14:52.344+0000 7fcb2c371640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.432 INFO:tasks.workunit.client.0.smithi050.stderr: -419> 2024-09-14T11:14:52.344+0000 7fcb2bb70640 10 monclient(hunting): handle_auth_done global_id 7757 payload 824 2024-09-14T11:14:52.432 INFO:tasks.workunit.client.0.smithi050.stderr: -418> 2024-09-14T11:14:52.345+0000 7fcb2bb70640 10 monclient: _finish_hunting 0 2024-09-14T11:14:52.432 INFO:tasks.workunit.client.0.smithi050.stderr: -417> 2024-09-14T11:14:52.345+0000 7fcb2bb70640 1 monclient: found mon.noname-c 2024-09-14T11:14:52.432 INFO:tasks.workunit.client.0.smithi050.stderr: -416> 2024-09-14T11:14:52.345+0000 7fcb2bb70640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:14:52.433 INFO:tasks.workunit.client.0.smithi050.stderr: -415> 2024-09-14T11:14:52.345+0000 7fca18e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.433 INFO:tasks.workunit.client.0.smithi050.stderr: -414> 2024-09-14T11:14:52.345+0000 7fca18e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:52.433 INFO:tasks.workunit.client.0.smithi050.stderr: -413> 2024-09-14T11:14:52.345+0000 7fca18e09640 10 monclient: dump: 2024-09-14T11:14:52.433 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:52.433 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:52.433 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.433 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.433 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.433 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.433 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:52.433 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:52.433 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:52.433 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.433 INFO:tasks.workunit.client.0.smithi050.stderr: -412> 2024-09-14T11:14:52.345+0000 7fca18e09640 10 monclient: _finish_auth 0 2024-09-14T11:14:52.434 INFO:tasks.workunit.client.0.smithi050.stderr: -411> 2024-09-14T11:14:52.345+0000 7fca18e09640 10 monclient: _check_auth_tickets 2024-09-14T11:14:52.434 INFO:tasks.workunit.client.0.smithi050.stderr: -410> 2024-09-14T11:14:52.345+0000 7fca18e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:52.434 INFO:tasks.workunit.client.0.smithi050.stderr: -409> 2024-09-14T11:14:52.345+0000 7fca18e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.434 INFO:tasks.workunit.client.0.smithi050.stderr: -408> 2024-09-14T11:14:52.345+0000 7fca18e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:52.434 INFO:tasks.workunit.client.0.smithi050.stderr: -407> 2024-09-14T11:14:52.345+0000 7fca18e09640 10 monclient: dump: 2024-09-14T11:14:52.434 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:52.434 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:52.434 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.434 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.434 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.434 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.434 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:52.434 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:52.434 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:52.435 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.435 INFO:tasks.workunit.client.0.smithi050.stderr: -406> 2024-09-14T11:14:52.345+0000 7fcb2e887800 5 monclient: authenticate success, global_id 7757 2024-09-14T11:14:52.435 INFO:tasks.workunit.client.0.smithi050.stderr: -405> 2024-09-14T11:14:52.345+0000 7fcb2e887800 10 monclient: _renew_subs 2024-09-14T11:14:52.435 INFO:tasks.workunit.client.0.smithi050.stderr: -404> 2024-09-14T11:14:52.345+0000 7fcb2e887800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:52.435 INFO:tasks.workunit.client.0.smithi050.stderr: -403> 2024-09-14T11:14:52.345+0000 7fca1a60c640 4 set_mon_vals no callback set 2024-09-14T11:14:52.435 INFO:tasks.workunit.client.0.smithi050.stderr: -402> 2024-09-14T11:14:52.345+0000 7fcb2e887800 10 monclient: _renew_subs 2024-09-14T11:14:52.435 INFO:tasks.workunit.client.0.smithi050.stderr: -401> 2024-09-14T11:14:52.345+0000 7fcb2e887800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:52.435 INFO:tasks.workunit.client.0.smithi050.stderr: -400> 2024-09-14T11:14:52.345+0000 7fcb2e887800 1 librados: init done 2024-09-14T11:14:52.435 INFO:tasks.workunit.client.0.smithi050.stderr: -399> 2024-09-14T11:14:52.347+0000 7fca18e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:14:52.435 INFO:tasks.workunit.client.0.smithi050.stderr: -398> 2024-09-14T11:14:52.347+0000 7fca18e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:14:52.435 INFO:tasks.workunit.client.0.smithi050.stderr: -397> 2024-09-14T11:14:52.347+0000 7fca18e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:14:52.435 INFO:tasks.workunit.client.0.smithi050.stderr: -396> 2024-09-14T11:14:52.347+0000 7fcb2c371640 10 monclient: get_auth_request con 0x7fca14077260 auth_method 0 2024-09-14T11:14:52.435 INFO:tasks.workunit.client.0.smithi050.stderr: -395> 2024-09-14T11:14:52.347+0000 7fcb2cb72640 10 monclient: get_auth_request con 0x55cca38f9d90 auth_method 0 2024-09-14T11:14:52.435 INFO:tasks.workunit.client.0.smithi050.stderr: -394> 2024-09-14T11:14:52.348+0000 7fcb2c371640 10 monclient: get_auth_request con 0x55cca38fcf70 auth_method 0 2024-09-14T11:14:52.435 INFO:tasks.workunit.client.0.smithi050.stderr: -393> 2024-09-14T11:14:52.349+0000 7fcb2bb70640 10 monclient: get_auth_request con 0x55cca3901160 auth_method 0 2024-09-14T11:14:52.435 INFO:tasks.workunit.client.0.smithi050.stderr: -392> 2024-09-14T11:14:52.351+0000 7fcb2e887800 10 monclient: build_initial_monmap 2024-09-14T11:14:52.436 INFO:tasks.workunit.client.0.smithi050.stderr: -391> 2024-09-14T11:14:52.351+0000 7fcb2e887800 1 build_initial for_mkfs: 0 2024-09-14T11:14:52.436 INFO:tasks.workunit.client.0.smithi050.stderr: -390> 2024-09-14T11:14:52.351+0000 7fcb2e887800 10 monclient: monmap: 2024-09-14T11:14:52.436 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:14:52.436 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:52.436 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:14:52.436 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:14:52.436 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:52.436 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.436 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:14:52.436 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:14:52.436 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:14:52.436 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.436 INFO:tasks.workunit.client.0.smithi050.stderr: -389> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding auth protocol: cephx 2024-09-14T11:14:52.436 INFO:tasks.workunit.client.0.smithi050.stderr: -388> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding auth protocol: cephx 2024-09-14T11:14:52.437 INFO:tasks.workunit.client.0.smithi050.stderr: -387> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding auth protocol: cephx 2024-09-14T11:14:52.437 INFO:tasks.workunit.client.0.smithi050.stderr: -386> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding con mode: secure 2024-09-14T11:14:52.437 INFO:tasks.workunit.client.0.smithi050.stderr: -385> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding con mode: crc 2024-09-14T11:14:52.437 INFO:tasks.workunit.client.0.smithi050.stderr: -384> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding con mode: secure 2024-09-14T11:14:52.437 INFO:tasks.workunit.client.0.smithi050.stderr: -383> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding con mode: crc 2024-09-14T11:14:52.437 INFO:tasks.workunit.client.0.smithi050.stderr: -382> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding con mode: secure 2024-09-14T11:14:52.437 INFO:tasks.workunit.client.0.smithi050.stderr: -381> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding con mode: crc 2024-09-14T11:14:52.437 INFO:tasks.workunit.client.0.smithi050.stderr: -380> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding con mode: crc 2024-09-14T11:14:52.437 INFO:tasks.workunit.client.0.smithi050.stderr: -379> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding con mode: secure 2024-09-14T11:14:52.437 INFO:tasks.workunit.client.0.smithi050.stderr: -378> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding con mode: crc 2024-09-14T11:14:52.437 INFO:tasks.workunit.client.0.smithi050.stderr: -377> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding con mode: secure 2024-09-14T11:14:52.437 INFO:tasks.workunit.client.0.smithi050.stderr: -376> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding con mode: crc 2024-09-14T11:14:52.437 INFO:tasks.workunit.client.0.smithi050.stderr: -375> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding con mode: secure 2024-09-14T11:14:52.437 INFO:tasks.workunit.client.0.smithi050.stderr: -374> 2024-09-14T11:14:52.351+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.437 INFO:tasks.workunit.client.0.smithi050.stderr: -373> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command objecter_requests cmddesc objecter_requests hook 0x55cca39094e0 EEXIST 2024-09-14T11:14:52.438 INFO:tasks.workunit.client.0.smithi050.stderr: -372> 2024-09-14T11:14:52.351+0000 7fcb2e887800 10 monclient: init 2024-09-14T11:14:52.438 INFO:tasks.workunit.client.0.smithi050.stderr: -371> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding auth protocol: cephx 2024-09-14T11:14:52.438 INFO:tasks.workunit.client.0.smithi050.stderr: -370> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding auth protocol: cephx 2024-09-14T11:14:52.438 INFO:tasks.workunit.client.0.smithi050.stderr: -369> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding auth protocol: cephx 2024-09-14T11:14:52.438 INFO:tasks.workunit.client.0.smithi050.stderr: -368> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding con mode: secure 2024-09-14T11:14:52.438 INFO:tasks.workunit.client.0.smithi050.stderr: -367> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding con mode: crc 2024-09-14T11:14:52.438 INFO:tasks.workunit.client.0.smithi050.stderr: -366> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding con mode: secure 2024-09-14T11:14:52.438 INFO:tasks.workunit.client.0.smithi050.stderr: -365> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding con mode: crc 2024-09-14T11:14:52.438 INFO:tasks.workunit.client.0.smithi050.stderr: -364> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding con mode: secure 2024-09-14T11:14:52.438 INFO:tasks.workunit.client.0.smithi050.stderr: -363> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding con mode: crc 2024-09-14T11:14:52.438 INFO:tasks.workunit.client.0.smithi050.stderr: -362> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding con mode: crc 2024-09-14T11:14:52.438 INFO:tasks.workunit.client.0.smithi050.stderr: -361> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding con mode: secure 2024-09-14T11:14:52.438 INFO:tasks.workunit.client.0.smithi050.stderr: -360> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding con mode: crc 2024-09-14T11:14:52.438 INFO:tasks.workunit.client.0.smithi050.stderr: -359> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding con mode: secure 2024-09-14T11:14:52.439 INFO:tasks.workunit.client.0.smithi050.stderr: -358> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding con mode: crc 2024-09-14T11:14:52.439 INFO:tasks.workunit.client.0.smithi050.stderr: -357> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding con mode: secure 2024-09-14T11:14:52.439 INFO:tasks.workunit.client.0.smithi050.stderr: -356> 2024-09-14T11:14:52.351+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.439 INFO:tasks.workunit.client.0.smithi050.stderr: -355> 2024-09-14T11:14:52.352+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.439 INFO:tasks.workunit.client.0.smithi050.stderr: -354> 2024-09-14T11:14:52.352+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command rotate-key cmddesc rotate-key hook 0x55cca3904790 EEXIST 2024-09-14T11:14:52.439 INFO:tasks.workunit.client.0.smithi050.stderr: -353> 2024-09-14T11:14:52.352+0000 7fcb2e887800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:52.439 INFO:tasks.workunit.client.0.smithi050.stderr: -352> 2024-09-14T11:14:52.352+0000 7fcb2e887800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:14:52.439 INFO:tasks.workunit.client.0.smithi050.stderr: -351> 2024-09-14T11:14:52.352+0000 7fcb2e887800 10 monclient(hunting): picked mon.noname-b con 0x55cca392d800 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:14:52.439 INFO:tasks.workunit.client.0.smithi050.stderr: -350> 2024-09-14T11:14:52.352+0000 7fcb2e887800 10 monclient(hunting): picked mon.noname-a con 0x55cca392dbe0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:14:52.439 INFO:tasks.workunit.client.0.smithi050.stderr: -349> 2024-09-14T11:14:52.352+0000 7fcb2e887800 10 monclient(hunting): picked mon.noname-c con 0x55cca392c510 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:14:52.439 INFO:tasks.workunit.client.0.smithi050.stderr: -348> 2024-09-14T11:14:52.352+0000 7fcb2e887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.439 INFO:tasks.workunit.client.0.smithi050.stderr: -347> 2024-09-14T11:14:52.352+0000 7fcb2e887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.439 INFO:tasks.workunit.client.0.smithi050.stderr: -346> 2024-09-14T11:14:52.352+0000 7fcb2e887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.440 INFO:tasks.workunit.client.0.smithi050.stderr: -345> 2024-09-14T11:14:52.352+0000 7fcb2e887800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:52.440 INFO:tasks.workunit.client.0.smithi050.stderr: -344> 2024-09-14T11:14:52.352+0000 7fcb2e887800 10 monclient(hunting): authenticate will time out at 2544.990210s 2024-09-14T11:14:52.440 INFO:tasks.workunit.client.0.smithi050.stderr: -343> 2024-09-14T11:14:52.352+0000 7fcb2cb72640 10 monclient(hunting): get_auth_request con 0x55cca392c510 auth_method 0 2024-09-14T11:14:52.440 INFO:tasks.workunit.client.0.smithi050.stderr: -342> 2024-09-14T11:14:52.352+0000 7fcb2cb72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.440 INFO:tasks.workunit.client.0.smithi050.stderr: -341> 2024-09-14T11:14:52.352+0000 7fcb2cb72640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.440 INFO:tasks.workunit.client.0.smithi050.stderr: -340> 2024-09-14T11:14:52.352+0000 7fcb2cb72640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.440 INFO:tasks.workunit.client.0.smithi050.stderr: -339> 2024-09-14T11:14:52.352+0000 7fcb2bb70640 10 monclient(hunting): get_auth_request con 0x55cca392dbe0 auth_method 0 2024-09-14T11:14:52.440 INFO:tasks.workunit.client.0.smithi050.stderr: -338> 2024-09-14T11:14:52.352+0000 7fcb2bb70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.440 INFO:tasks.workunit.client.0.smithi050.stderr: -337> 2024-09-14T11:14:52.352+0000 7fcb2bb70640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.440 INFO:tasks.workunit.client.0.smithi050.stderr: -336> 2024-09-14T11:14:52.352+0000 7fcb2bb70640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.440 INFO:tasks.workunit.client.0.smithi050.stderr: -335> 2024-09-14T11:14:52.352+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.440 INFO:tasks.workunit.client.0.smithi050.stderr: -334> 2024-09-14T11:14:52.352+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.440 INFO:tasks.workunit.client.0.smithi050.stderr: -333> 2024-09-14T11:14:52.352+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.441 INFO:tasks.workunit.client.0.smithi050.stderr: -332> 2024-09-14T11:14:52.352+0000 7fcb2c371640 10 monclient(hunting): get_auth_request con 0x55cca392d800 auth_method 0 2024-09-14T11:14:52.441 INFO:tasks.workunit.client.0.smithi050.stderr: -331> 2024-09-14T11:14:52.352+0000 7fcb2c371640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.441 INFO:tasks.workunit.client.0.smithi050.stderr: -330> 2024-09-14T11:14:52.352+0000 7fcb2c371640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.441 INFO:tasks.workunit.client.0.smithi050.stderr: -329> 2024-09-14T11:14:52.352+0000 7fcb2c371640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.441 INFO:tasks.workunit.client.0.smithi050.stderr: -328> 2024-09-14T11:14:52.352+0000 7fcb2bb70640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.441 INFO:tasks.workunit.client.0.smithi050.stderr: -327> 2024-09-14T11:14:52.352+0000 7fcb2bb70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.441 INFO:tasks.workunit.client.0.smithi050.stderr: -326> 2024-09-14T11:14:52.352+0000 7fcb2bb70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.441 INFO:tasks.workunit.client.0.smithi050.stderr: -325> 2024-09-14T11:14:52.352+0000 7fcb2c371640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.441 INFO:tasks.workunit.client.0.smithi050.stderr: -324> 2024-09-14T11:14:52.352+0000 7fcb2c371640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.441 INFO:tasks.workunit.client.0.smithi050.stderr: -323> 2024-09-14T11:14:52.352+0000 7fcb2c371640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.441 INFO:tasks.workunit.client.0.smithi050.stderr: -322> 2024-09-14T11:14:52.352+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_done global_id 7760 payload 824 2024-09-14T11:14:52.441 INFO:tasks.workunit.client.0.smithi050.stderr: -321> 2024-09-14T11:14:52.352+0000 7fcb2cb72640 10 monclient: _finish_hunting 0 2024-09-14T11:14:52.441 INFO:tasks.workunit.client.0.smithi050.stderr: -320> 2024-09-14T11:14:52.352+0000 7fcb2cb72640 1 monclient: found mon.noname-c 2024-09-14T11:14:52.441 INFO:tasks.workunit.client.0.smithi050.stderr: -319> 2024-09-14T11:14:52.352+0000 7fcb2cb72640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:14:52.442 INFO:tasks.workunit.client.0.smithi050.stderr: -318> 2024-09-14T11:14:52.352+0000 7fca11ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.442 INFO:tasks.workunit.client.0.smithi050.stderr: -317> 2024-09-14T11:14:52.352+0000 7fca11ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:52.442 INFO:tasks.workunit.client.0.smithi050.stderr: -316> 2024-09-14T11:14:52.352+0000 7fca11ffb640 10 monclient: dump: 2024-09-14T11:14:52.442 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:52.442 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:52.442 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.442 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.442 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.442 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.442 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:52.442 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:52.442 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:52.442 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.443 INFO:tasks.workunit.client.0.smithi050.stderr: -315> 2024-09-14T11:14:52.352+0000 7fca11ffb640 10 monclient: _finish_auth 0 2024-09-14T11:14:52.443 INFO:tasks.workunit.client.0.smithi050.stderr: -314> 2024-09-14T11:14:52.352+0000 7fca11ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:14:52.443 INFO:tasks.workunit.client.0.smithi050.stderr: -313> 2024-09-14T11:14:52.352+0000 7fca11ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:52.443 INFO:tasks.workunit.client.0.smithi050.stderr: -312> 2024-09-14T11:14:52.352+0000 7fca11ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.443 INFO:tasks.workunit.client.0.smithi050.stderr: -311> 2024-09-14T11:14:52.352+0000 7fca11ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:52.443 INFO:tasks.workunit.client.0.smithi050.stderr: -310> 2024-09-14T11:14:52.352+0000 7fca11ffb640 10 monclient: dump: 2024-09-14T11:14:52.443 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:52.443 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:52.443 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.443 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.443 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.443 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.443 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:52.443 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:52.444 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:52.444 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.444 INFO:tasks.workunit.client.0.smithi050.stderr: -309> 2024-09-14T11:14:52.352+0000 7fcb2e887800 5 monclient: authenticate success, global_id 7760 2024-09-14T11:14:52.444 INFO:tasks.workunit.client.0.smithi050.stderr: -308> 2024-09-14T11:14:52.353+0000 7fcb2e887800 10 monclient: _renew_subs 2024-09-14T11:14:52.444 INFO:tasks.workunit.client.0.smithi050.stderr: -307> 2024-09-14T11:14:52.352+0000 7fcb2d373640 4 set_mon_vals no callback set 2024-09-14T11:14:52.444 INFO:tasks.workunit.client.0.smithi050.stderr: -306> 2024-09-14T11:14:52.353+0000 7fcb2e887800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:52.444 INFO:tasks.workunit.client.0.smithi050.stderr: -305> 2024-09-14T11:14:52.353+0000 7fcb2e887800 10 monclient: _renew_subs 2024-09-14T11:14:52.444 INFO:tasks.workunit.client.0.smithi050.stderr: -304> 2024-09-14T11:14:52.353+0000 7fcb2e887800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:52.444 INFO:tasks.workunit.client.0.smithi050.stderr: -303> 2024-09-14T11:14:52.354+0000 7fca11ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:14:52.444 INFO:tasks.workunit.client.0.smithi050.stderr: -302> 2024-09-14T11:14:52.354+0000 7fca11ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:14:52.444 INFO:tasks.workunit.client.0.smithi050.stderr: -301> 2024-09-14T11:14:52.354+0000 7fca11ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:14:52.444 INFO:tasks.workunit.client.0.smithi050.stderr: -300> 2024-09-14T11:14:52.355+0000 7fcb2c371640 10 monclient: get_auth_request con 0x7fca04077140 auth_method 0 2024-09-14T11:14:52.444 INFO:tasks.workunit.client.0.smithi050.stderr: -299> 2024-09-14T11:14:52.355+0000 7fcb2e887800 10 monclient: get_monmap_and_config 2024-09-14T11:14:52.444 INFO:tasks.workunit.client.0.smithi050.stderr: -298> 2024-09-14T11:14:52.355+0000 7fcb2e887800 10 monclient: build_initial_monmap 2024-09-14T11:14:52.445 INFO:tasks.workunit.client.0.smithi050.stderr: -297> 2024-09-14T11:14:52.355+0000 7fcb2e887800 1 build_initial for_mkfs: 0 2024-09-14T11:14:52.445 INFO:tasks.workunit.client.0.smithi050.stderr: -296> 2024-09-14T11:14:52.355+0000 7fcb2e887800 10 monclient: monmap: 2024-09-14T11:14:52.445 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:14:52.445 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:52.445 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:14:52.445 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:14:52.445 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:52.445 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.448 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:14:52.448 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:14:52.448 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:14:52.448 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.448 INFO:tasks.workunit.client.0.smithi050.stderr: -295> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding auth protocol: cephx 2024-09-14T11:14:52.448 INFO:tasks.workunit.client.0.smithi050.stderr: -294> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding auth protocol: cephx 2024-09-14T11:14:52.448 INFO:tasks.workunit.client.0.smithi050.stderr: -293> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding auth protocol: cephx 2024-09-14T11:14:52.448 INFO:tasks.workunit.client.0.smithi050.stderr: -292> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding con mode: secure 2024-09-14T11:14:52.448 INFO:tasks.workunit.client.0.smithi050.stderr: -291> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding con mode: crc 2024-09-14T11:14:52.448 INFO:tasks.workunit.client.0.smithi050.stderr: -290> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding con mode: secure 2024-09-14T11:14:52.448 INFO:tasks.workunit.client.0.smithi050.stderr: -289> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding con mode: crc 2024-09-14T11:14:52.449 INFO:tasks.workunit.client.0.smithi050.stderr: -288> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding con mode: secure 2024-09-14T11:14:52.449 INFO:tasks.workunit.client.0.smithi050.stderr: -287> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding con mode: crc 2024-09-14T11:14:52.449 INFO:tasks.workunit.client.0.smithi050.stderr: -286> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding con mode: crc 2024-09-14T11:14:52.449 INFO:tasks.workunit.client.0.smithi050.stderr: -285> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding con mode: secure 2024-09-14T11:14:52.449 INFO:tasks.workunit.client.0.smithi050.stderr: -284> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding con mode: crc 2024-09-14T11:14:52.449 INFO:tasks.workunit.client.0.smithi050.stderr: -283> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding con mode: secure 2024-09-14T11:14:52.449 INFO:tasks.workunit.client.0.smithi050.stderr: -282> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding con mode: crc 2024-09-14T11:14:52.449 INFO:tasks.workunit.client.0.smithi050.stderr: -281> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding con mode: secure 2024-09-14T11:14:52.449 INFO:tasks.workunit.client.0.smithi050.stderr: -280> 2024-09-14T11:14:52.355+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.449 INFO:tasks.workunit.client.0.smithi050.stderr: -279> 2024-09-14T11:14:52.355+0000 7fcb2e887800 10 monclient: init 2024-09-14T11:14:52.449 INFO:tasks.workunit.client.0.smithi050.stderr: -278> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding auth protocol: cephx 2024-09-14T11:14:52.449 INFO:tasks.workunit.client.0.smithi050.stderr: -277> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding auth protocol: cephx 2024-09-14T11:14:52.449 INFO:tasks.workunit.client.0.smithi050.stderr: -276> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding auth protocol: cephx 2024-09-14T11:14:52.450 INFO:tasks.workunit.client.0.smithi050.stderr: -275> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding con mode: secure 2024-09-14T11:14:52.450 INFO:tasks.workunit.client.0.smithi050.stderr: -274> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding con mode: crc 2024-09-14T11:14:52.450 INFO:tasks.workunit.client.0.smithi050.stderr: -273> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding con mode: secure 2024-09-14T11:14:52.450 INFO:tasks.workunit.client.0.smithi050.stderr: -272> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding con mode: crc 2024-09-14T11:14:52.450 INFO:tasks.workunit.client.0.smithi050.stderr: -271> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding con mode: secure 2024-09-14T11:14:52.450 INFO:tasks.workunit.client.0.smithi050.stderr: -270> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding con mode: crc 2024-09-14T11:14:52.450 INFO:tasks.workunit.client.0.smithi050.stderr: -269> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding con mode: crc 2024-09-14T11:14:52.450 INFO:tasks.workunit.client.0.smithi050.stderr: -268> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding con mode: secure 2024-09-14T11:14:52.450 INFO:tasks.workunit.client.0.smithi050.stderr: -267> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding con mode: crc 2024-09-14T11:14:52.450 INFO:tasks.workunit.client.0.smithi050.stderr: -266> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding con mode: secure 2024-09-14T11:14:52.450 INFO:tasks.workunit.client.0.smithi050.stderr: -265> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding con mode: crc 2024-09-14T11:14:52.450 INFO:tasks.workunit.client.0.smithi050.stderr: -264> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding con mode: secure 2024-09-14T11:14:52.450 INFO:tasks.workunit.client.0.smithi050.stderr: -263> 2024-09-14T11:14:52.355+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.450 INFO:tasks.workunit.client.0.smithi050.stderr: -262> 2024-09-14T11:14:52.356+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.450 INFO:tasks.workunit.client.0.smithi050.stderr: -261> 2024-09-14T11:14:52.356+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command rotate-key cmddesc rotate-key hook 0x7ffeb9d293c8 EEXIST 2024-09-14T11:14:52.451 INFO:tasks.workunit.client.0.smithi050.stderr: -260> 2024-09-14T11:14:52.356+0000 7fcb2e887800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:52.451 INFO:tasks.workunit.client.0.smithi050.stderr: -259> 2024-09-14T11:14:52.356+0000 7fcb2e887800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:14:52.451 INFO:tasks.workunit.client.0.smithi050.stderr: -258> 2024-09-14T11:14:52.356+0000 7fcb2e887800 10 monclient(hunting): picked mon.noname-a con 0x55cca3981ce0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:14:52.451 INFO:tasks.workunit.client.0.smithi050.stderr: -257> 2024-09-14T11:14:52.356+0000 7fcb2e887800 10 monclient(hunting): picked mon.noname-b con 0x55cca3952cf0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:14:52.451 INFO:tasks.workunit.client.0.smithi050.stderr: -256> 2024-09-14T11:14:52.356+0000 7fcb2e887800 10 monclient(hunting): picked mon.noname-c con 0x55cca397d1c0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:14:52.451 INFO:tasks.workunit.client.0.smithi050.stderr: -255> 2024-09-14T11:14:52.356+0000 7fcb2e887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.451 INFO:tasks.workunit.client.0.smithi050.stderr: -254> 2024-09-14T11:14:52.356+0000 7fcb2e887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.451 INFO:tasks.workunit.client.0.smithi050.stderr: -253> 2024-09-14T11:14:52.356+0000 7fcb2e887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.451 INFO:tasks.workunit.client.0.smithi050.stderr: -252> 2024-09-14T11:14:52.356+0000 7fcb2e887800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:52.451 INFO:tasks.workunit.client.0.smithi050.stderr: -251> 2024-09-14T11:14:52.356+0000 7fcb2e887800 10 monclient(hunting): authenticate will time out at 2544.994282s 2024-09-14T11:14:52.451 INFO:tasks.workunit.client.0.smithi050.stderr: -250> 2024-09-14T11:14:52.356+0000 7fcb2cb72640 10 monclient(hunting): get_auth_request con 0x55cca397d1c0 auth_method 0 2024-09-14T11:14:52.451 INFO:tasks.workunit.client.0.smithi050.stderr: -249> 2024-09-14T11:14:52.356+0000 7fcb2cb72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.451 INFO:tasks.workunit.client.0.smithi050.stderr: -248> 2024-09-14T11:14:52.356+0000 7fcb2cb72640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.451 INFO:tasks.workunit.client.0.smithi050.stderr: -247> 2024-09-14T11:14:52.356+0000 7fcb2cb72640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.452 INFO:tasks.workunit.client.0.smithi050.stderr: -246> 2024-09-14T11:14:52.356+0000 7fcb2c371640 10 monclient(hunting): get_auth_request con 0x55cca3981ce0 auth_method 0 2024-09-14T11:14:52.452 INFO:tasks.workunit.client.0.smithi050.stderr: -245> 2024-09-14T11:14:52.356+0000 7fcb2c371640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.452 INFO:tasks.workunit.client.0.smithi050.stderr: -244> 2024-09-14T11:14:52.356+0000 7fcb2c371640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.452 INFO:tasks.workunit.client.0.smithi050.stderr: -243> 2024-09-14T11:14:52.356+0000 7fcb2c371640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.452 INFO:tasks.workunit.client.0.smithi050.stderr: -242> 2024-09-14T11:14:52.356+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.452 INFO:tasks.workunit.client.0.smithi050.stderr: -241> 2024-09-14T11:14:52.356+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.452 INFO:tasks.workunit.client.0.smithi050.stderr: -240> 2024-09-14T11:14:52.356+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.452 INFO:tasks.workunit.client.0.smithi050.stderr: -239> 2024-09-14T11:14:52.356+0000 7fcb2c371640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.452 INFO:tasks.workunit.client.0.smithi050.stderr: -238> 2024-09-14T11:14:52.356+0000 7fcb2c371640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.452 INFO:tasks.workunit.client.0.smithi050.stderr: -237> 2024-09-14T11:14:52.356+0000 7fcb2c371640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.452 INFO:tasks.workunit.client.0.smithi050.stderr: -236> 2024-09-14T11:14:52.356+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_done global_id 7763 payload 274 2024-09-14T11:14:52.453 INFO:tasks.workunit.client.0.smithi050.stderr: -235> 2024-09-14T11:14:52.356+0000 7fcb2cb72640 10 monclient: _finish_hunting 0 2024-09-14T11:14:52.453 INFO:tasks.workunit.client.0.smithi050.stderr: -234> 2024-09-14T11:14:52.356+0000 7fcb2cb72640 1 monclient: found mon.noname-c 2024-09-14T11:14:52.453 INFO:tasks.workunit.client.0.smithi050.stderr: -233> 2024-09-14T11:14:52.356+0000 7fcb2cb72640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:14:52.453 INFO:tasks.workunit.client.0.smithi050.stderr: -232> 2024-09-14T11:14:52.356+0000 7fcb2bb70640 10 monclient: get_auth_request con 0x55cca3952cf0 auth_method 0 2024-09-14T11:14:52.453 INFO:tasks.workunit.client.0.smithi050.stderr: -231> 2024-09-14T11:14:52.356+0000 7fca037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.453 INFO:tasks.workunit.client.0.smithi050.stderr: -230> 2024-09-14T11:14:52.356+0000 7fca037fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:52.453 INFO:tasks.workunit.client.0.smithi050.stderr: -229> 2024-09-14T11:14:52.356+0000 7fca037fe640 10 monclient: dump: 2024-09-14T11:14:52.453 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:52.453 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:52.453 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.453 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.453 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.453 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.453 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:52.454 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:52.454 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:52.454 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.454 INFO:tasks.workunit.client.0.smithi050.stderr: -228> 2024-09-14T11:14:52.356+0000 7fca037fe640 10 monclient: _finish_auth 0 2024-09-14T11:14:52.454 INFO:tasks.workunit.client.0.smithi050.stderr: -227> 2024-09-14T11:14:52.356+0000 7fca037fe640 10 monclient: _check_auth_tickets 2024-09-14T11:14:52.454 INFO:tasks.workunit.client.0.smithi050.stderr: -226> 2024-09-14T11:14:52.356+0000 7fca037fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:52.454 INFO:tasks.workunit.client.0.smithi050.stderr: -225> 2024-09-14T11:14:52.356+0000 7fca037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.454 INFO:tasks.workunit.client.0.smithi050.stderr: -224> 2024-09-14T11:14:52.356+0000 7fca037fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:52.454 INFO:tasks.workunit.client.0.smithi050.stderr: -223> 2024-09-14T11:14:52.356+0000 7fca037fe640 10 monclient: dump: 2024-09-14T11:14:52.454 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:52.454 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:52.454 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.454 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.454 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.454 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.455 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:52.455 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:52.455 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:52.455 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.455 INFO:tasks.workunit.client.0.smithi050.stderr: -222> 2024-09-14T11:14:52.356+0000 7fcb2e887800 5 monclient: authenticate success, global_id 7763 2024-09-14T11:14:52.455 INFO:tasks.workunit.client.0.smithi050.stderr: -221> 2024-09-14T11:14:52.356+0000 7fcb2e887800 10 monclient: get_monmap_and_config success 2024-09-14T11:14:52.455 INFO:tasks.workunit.client.0.smithi050.stderr: -220> 2024-09-14T11:14:52.356+0000 7fcb2e887800 4 set_mon_vals no callback set 2024-09-14T11:14:52.455 INFO:tasks.workunit.client.0.smithi050.stderr: -219> 2024-09-14T11:14:52.357+0000 7fcb2e887800 10 monclient: shutdown 2024-09-14T11:14:52.455 INFO:tasks.workunit.client.0.smithi050.stderr: -218> 2024-09-14T11:14:52.357+0000 7fcb2e887800 10 monclient: build_initial_monmap 2024-09-14T11:14:52.455 INFO:tasks.workunit.client.0.smithi050.stderr: -217> 2024-09-14T11:14:52.357+0000 7fcb2e887800 1 build_initial for_mkfs: 0 2024-09-14T11:14:52.455 INFO:tasks.workunit.client.0.smithi050.stderr: -216> 2024-09-14T11:14:52.357+0000 7fcb2e887800 10 monclient: monmap: 2024-09-14T11:14:52.455 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:14:52.455 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:52.455 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:14:52.455 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:14:52.456 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:52.456 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.456 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:14:52.456 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:14:52.456 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:14:52.456 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.456 INFO:tasks.workunit.client.0.smithi050.stderr: -215> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding auth protocol: cephx 2024-09-14T11:14:52.456 INFO:tasks.workunit.client.0.smithi050.stderr: -214> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding auth protocol: cephx 2024-09-14T11:14:52.456 INFO:tasks.workunit.client.0.smithi050.stderr: -213> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding auth protocol: cephx 2024-09-14T11:14:52.456 INFO:tasks.workunit.client.0.smithi050.stderr: -212> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding con mode: secure 2024-09-14T11:14:52.456 INFO:tasks.workunit.client.0.smithi050.stderr: -211> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding con mode: crc 2024-09-14T11:14:52.456 INFO:tasks.workunit.client.0.smithi050.stderr: -210> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding con mode: secure 2024-09-14T11:14:52.456 INFO:tasks.workunit.client.0.smithi050.stderr: -209> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding con mode: crc 2024-09-14T11:14:52.456 INFO:tasks.workunit.client.0.smithi050.stderr: -208> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding con mode: secure 2024-09-14T11:14:52.456 INFO:tasks.workunit.client.0.smithi050.stderr: -207> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding con mode: crc 2024-09-14T11:14:52.457 INFO:tasks.workunit.client.0.smithi050.stderr: -206> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding con mode: crc 2024-09-14T11:14:52.457 INFO:tasks.workunit.client.0.smithi050.stderr: -205> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding con mode: secure 2024-09-14T11:14:52.457 INFO:tasks.workunit.client.0.smithi050.stderr: -204> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding con mode: crc 2024-09-14T11:14:52.457 INFO:tasks.workunit.client.0.smithi050.stderr: -203> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding con mode: secure 2024-09-14T11:14:52.457 INFO:tasks.workunit.client.0.smithi050.stderr: -202> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding con mode: crc 2024-09-14T11:14:52.457 INFO:tasks.workunit.client.0.smithi050.stderr: -201> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding con mode: secure 2024-09-14T11:14:52.457 INFO:tasks.workunit.client.0.smithi050.stderr: -200> 2024-09-14T11:14:52.357+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.457 INFO:tasks.workunit.client.0.smithi050.stderr: -199> 2024-09-14T11:14:52.357+0000 7fcb2e887800 1 librados: starting msgr at 2024-09-14T11:14:52.457 INFO:tasks.workunit.client.0.smithi050.stderr: -198> 2024-09-14T11:14:52.357+0000 7fcb2e887800 1 librados: starting objecter 2024-09-14T11:14:52.457 INFO:tasks.workunit.client.0.smithi050.stderr: -197> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command objecter_requests cmddesc objecter_requests hook 0x55cca392f5e0 EEXIST 2024-09-14T11:14:52.457 INFO:tasks.workunit.client.0.smithi050.stderr: -196> 2024-09-14T11:14:52.358+0000 7fcb2e887800 1 librados: setting wanted keys 2024-09-14T11:14:52.457 INFO:tasks.workunit.client.0.smithi050.stderr: -195> 2024-09-14T11:14:52.358+0000 7fcb2e887800 1 librados: calling monclient init 2024-09-14T11:14:52.457 INFO:tasks.workunit.client.0.smithi050.stderr: -194> 2024-09-14T11:14:52.358+0000 7fcb2e887800 10 monclient: init 2024-09-14T11:14:52.457 INFO:tasks.workunit.client.0.smithi050.stderr: -193> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding auth protocol: cephx 2024-09-14T11:14:52.457 INFO:tasks.workunit.client.0.smithi050.stderr: -192> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding auth protocol: cephx 2024-09-14T11:14:52.458 INFO:tasks.workunit.client.0.smithi050.stderr: -191> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding auth protocol: cephx 2024-09-14T11:14:52.458 INFO:tasks.workunit.client.0.smithi050.stderr: -190> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding con mode: secure 2024-09-14T11:14:52.458 INFO:tasks.workunit.client.0.smithi050.stderr: -189> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding con mode: crc 2024-09-14T11:14:52.458 INFO:tasks.workunit.client.0.smithi050.stderr: -188> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding con mode: secure 2024-09-14T11:14:52.458 INFO:tasks.workunit.client.0.smithi050.stderr: -187> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding con mode: crc 2024-09-14T11:14:52.458 INFO:tasks.workunit.client.0.smithi050.stderr: -186> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding con mode: secure 2024-09-14T11:14:52.458 INFO:tasks.workunit.client.0.smithi050.stderr: -185> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding con mode: crc 2024-09-14T11:14:52.458 INFO:tasks.workunit.client.0.smithi050.stderr: -184> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding con mode: crc 2024-09-14T11:14:52.458 INFO:tasks.workunit.client.0.smithi050.stderr: -183> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding con mode: secure 2024-09-14T11:14:52.458 INFO:tasks.workunit.client.0.smithi050.stderr: -182> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding con mode: crc 2024-09-14T11:14:52.458 INFO:tasks.workunit.client.0.smithi050.stderr: -181> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding con mode: secure 2024-09-14T11:14:52.458 INFO:tasks.workunit.client.0.smithi050.stderr: -180> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding con mode: crc 2024-09-14T11:14:52.458 INFO:tasks.workunit.client.0.smithi050.stderr: -179> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding con mode: secure 2024-09-14T11:14:52.458 INFO:tasks.workunit.client.0.smithi050.stderr: -178> 2024-09-14T11:14:52.358+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.458 INFO:tasks.workunit.client.0.smithi050.stderr: -177> 2024-09-14T11:14:52.358+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.459 INFO:tasks.workunit.client.0.smithi050.stderr: -176> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command rotate-key cmddesc rotate-key hook 0x55cca3942208 EEXIST 2024-09-14T11:14:52.459 INFO:tasks.workunit.client.0.smithi050.stderr: -175> 2024-09-14T11:14:52.358+0000 7fcb2e887800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:52.459 INFO:tasks.workunit.client.0.smithi050.stderr: -174> 2024-09-14T11:14:52.358+0000 7fcb2e887800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:14:52.459 INFO:tasks.workunit.client.0.smithi050.stderr: -173> 2024-09-14T11:14:52.358+0000 7fcb2e887800 10 monclient(hunting): picked mon.noname-c con 0x55cca3952cf0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:14:52.459 INFO:tasks.workunit.client.0.smithi050.stderr: -172> 2024-09-14T11:14:52.358+0000 7fcb2e887800 10 monclient(hunting): picked mon.noname-b con 0x55cca397d1c0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:14:52.459 INFO:tasks.workunit.client.0.smithi050.stderr: -171> 2024-09-14T11:14:52.358+0000 7fcb2e887800 10 monclient(hunting): picked mon.noname-a con 0x55cca3981ce0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:14:52.459 INFO:tasks.workunit.client.0.smithi050.stderr: -170> 2024-09-14T11:14:52.358+0000 7fcb2e887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.459 INFO:tasks.workunit.client.0.smithi050.stderr: -169> 2024-09-14T11:14:52.358+0000 7fcb2e887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.459 INFO:tasks.workunit.client.0.smithi050.stderr: -168> 2024-09-14T11:14:52.358+0000 7fcb2e887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.459 INFO:tasks.workunit.client.0.smithi050.stderr: -167> 2024-09-14T11:14:52.358+0000 7fcb2e887800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:52.459 INFO:tasks.workunit.client.0.smithi050.stderr: -166> 2024-09-14T11:14:52.358+0000 7fcb2e887800 10 monclient(hunting): authenticate will time out at 2544.996613s 2024-09-14T11:14:52.459 INFO:tasks.workunit.client.0.smithi050.stderr: -165> 2024-09-14T11:14:52.358+0000 7fcb2c371640 10 monclient(hunting): get_auth_request con 0x55cca3952cf0 auth_method 0 2024-09-14T11:14:52.459 INFO:tasks.workunit.client.0.smithi050.stderr: -164> 2024-09-14T11:14:52.358+0000 7fcb2c371640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.459 INFO:tasks.workunit.client.0.smithi050.stderr: -163> 2024-09-14T11:14:52.358+0000 7fcb2c371640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.459 INFO:tasks.workunit.client.0.smithi050.stderr: -162> 2024-09-14T11:14:52.358+0000 7fcb2c371640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.460 INFO:tasks.workunit.client.0.smithi050.stderr: -161> 2024-09-14T11:14:52.358+0000 7fcb2cb72640 10 monclient(hunting): get_auth_request con 0x55cca3981ce0 auth_method 0 2024-09-14T11:14:52.460 INFO:tasks.workunit.client.0.smithi050.stderr: -160> 2024-09-14T11:14:52.358+0000 7fcb2cb72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.460 INFO:tasks.workunit.client.0.smithi050.stderr: -159> 2024-09-14T11:14:52.358+0000 7fcb2cb72640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.460 INFO:tasks.workunit.client.0.smithi050.stderr: -158> 2024-09-14T11:14:52.358+0000 7fcb2cb72640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.460 INFO:tasks.workunit.client.0.smithi050.stderr: -157> 2024-09-14T11:14:52.358+0000 7fcb2c371640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.460 INFO:tasks.workunit.client.0.smithi050.stderr: -156> 2024-09-14T11:14:52.358+0000 7fcb2c371640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.460 INFO:tasks.workunit.client.0.smithi050.stderr: -155> 2024-09-14T11:14:52.358+0000 7fcb2c371640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.460 INFO:tasks.workunit.client.0.smithi050.stderr: -154> 2024-09-14T11:14:52.358+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.460 INFO:tasks.workunit.client.0.smithi050.stderr: -153> 2024-09-14T11:14:52.358+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.460 INFO:tasks.workunit.client.0.smithi050.stderr: -152> 2024-09-14T11:14:52.358+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.460 INFO:tasks.workunit.client.0.smithi050.stderr: -151> 2024-09-14T11:14:52.358+0000 7fcb2bb70640 10 monclient(hunting): get_auth_request con 0x55cca397d1c0 auth_method 0 2024-09-14T11:14:52.460 INFO:tasks.workunit.client.0.smithi050.stderr: -150> 2024-09-14T11:14:52.358+0000 7fcb2bb70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.460 INFO:tasks.workunit.client.0.smithi050.stderr: -149> 2024-09-14T11:14:52.358+0000 7fcb2bb70640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.460 INFO:tasks.workunit.client.0.smithi050.stderr: -148> 2024-09-14T11:14:52.358+0000 7fcb2bb70640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.461 INFO:tasks.workunit.client.0.smithi050.stderr: -147> 2024-09-14T11:14:52.358+0000 7fcb2c371640 10 monclient(hunting): handle_auth_done global_id 7766 payload 824 2024-09-14T11:14:52.461 INFO:tasks.workunit.client.0.smithi050.stderr: -146> 2024-09-14T11:14:52.358+0000 7fcb2c371640 10 monclient: _finish_hunting 0 2024-09-14T11:14:52.461 INFO:tasks.workunit.client.0.smithi050.stderr: -145> 2024-09-14T11:14:52.358+0000 7fcb2c371640 1 monclient: found mon.noname-c 2024-09-14T11:14:52.461 INFO:tasks.workunit.client.0.smithi050.stderr: -144> 2024-09-14T11:14:52.358+0000 7fcb2c371640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:14:52.461 INFO:tasks.workunit.client.0.smithi050.stderr: -143> 2024-09-14T11:14:52.359+0000 7fca01ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.461 INFO:tasks.workunit.client.0.smithi050.stderr: -142> 2024-09-14T11:14:52.359+0000 7fca01ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:52.461 INFO:tasks.workunit.client.0.smithi050.stderr: -141> 2024-09-14T11:14:52.359+0000 7fca01ffb640 10 monclient: dump: 2024-09-14T11:14:52.461 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:52.461 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:52.461 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.461 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.461 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.461 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.462 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:52.462 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:52.462 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:52.462 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.462 INFO:tasks.workunit.client.0.smithi050.stderr: -140> 2024-09-14T11:14:52.359+0000 7fca01ffb640 10 monclient: _finish_auth 0 2024-09-14T11:14:52.462 INFO:tasks.workunit.client.0.smithi050.stderr: -139> 2024-09-14T11:14:52.359+0000 7fca01ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:14:52.462 INFO:tasks.workunit.client.0.smithi050.stderr: -138> 2024-09-14T11:14:52.359+0000 7fca01ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:52.462 INFO:tasks.workunit.client.0.smithi050.stderr: -137> 2024-09-14T11:14:52.359+0000 7fca01ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.462 INFO:tasks.workunit.client.0.smithi050.stderr: -136> 2024-09-14T11:14:52.359+0000 7fca01ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:52.462 INFO:tasks.workunit.client.0.smithi050.stderr: -135> 2024-09-14T11:14:52.359+0000 7fca01ffb640 10 monclient: dump: 2024-09-14T11:14:52.462 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:52.462 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:52.462 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.462 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.462 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.463 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.463 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:52.463 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:52.463 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:52.463 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.463 INFO:tasks.workunit.client.0.smithi050.stderr: -134> 2024-09-14T11:14:52.359+0000 7fca037fe640 4 set_mon_vals no callback set 2024-09-14T11:14:52.463 INFO:tasks.workunit.client.0.smithi050.stderr: -133> 2024-09-14T11:14:52.359+0000 7fcb2e887800 5 monclient: authenticate success, global_id 7766 2024-09-14T11:14:52.463 INFO:tasks.workunit.client.0.smithi050.stderr: -132> 2024-09-14T11:14:52.359+0000 7fcb2e887800 10 monclient: _renew_subs 2024-09-14T11:14:52.463 INFO:tasks.workunit.client.0.smithi050.stderr: -131> 2024-09-14T11:14:52.359+0000 7fcb2e887800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:52.463 INFO:tasks.workunit.client.0.smithi050.stderr: -130> 2024-09-14T11:14:52.359+0000 7fcb2e887800 10 monclient: _renew_subs 2024-09-14T11:14:52.463 INFO:tasks.workunit.client.0.smithi050.stderr: -129> 2024-09-14T11:14:52.359+0000 7fcb2e887800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:52.463 INFO:tasks.workunit.client.0.smithi050.stderr: -128> 2024-09-14T11:14:52.359+0000 7fcb2e887800 1 librados: init done 2024-09-14T11:14:52.463 INFO:tasks.workunit.client.0.smithi050.stderr: -127> 2024-09-14T11:14:52.359+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command cr dump hook 0x55cca39790f8 2024-09-14T11:14:52.463 INFO:tasks.workunit.client.0.smithi050.stderr: -126> 2024-09-14T11:14:52.360+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.464 INFO:tasks.workunit.client.0.smithi050.stderr: -125> 2024-09-14T11:14:52.361+0000 7fca01ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:14:52.464 INFO:tasks.workunit.client.0.smithi050.stderr: -124> 2024-09-14T11:14:52.361+0000 7fca01ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:14:52.464 INFO:tasks.workunit.client.0.smithi050.stderr: -123> 2024-09-14T11:14:52.361+0000 7fca01ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:14:52.464 INFO:tasks.workunit.client.0.smithi050.stderr: -122> 2024-09-14T11:14:52.362+0000 7fcb2bb70640 10 monclient: get_auth_request con 0x7fc9f4077260 auth_method 0 2024-09-14T11:14:52.464 INFO:tasks.workunit.client.0.smithi050.stderr: -121> 2024-09-14T11:14:52.362+0000 7fcb2cb72640 10 monclient: get_auth_request con 0x55cca399c810 auth_method 0 2024-09-14T11:14:52.464 INFO:tasks.workunit.client.0.smithi050.stderr: -120> 2024-09-14T11:14:52.362+0000 7fcb2e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.464 INFO:tasks.workunit.client.0.smithi050.stderr: -119> 2024-09-14T11:14:52.362+0000 7fcb2e887800 20 realm 2024-09-14T11:14:52.464 INFO:tasks.workunit.client.0.smithi050.stderr: -118> 2024-09-14T11:14:52.362+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.464 INFO:tasks.workunit.client.0.smithi050.stderr: -117> 2024-09-14T11:14:52.362+0000 7fcb2e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.464 INFO:tasks.workunit.client.0.smithi050.stderr: -116> 2024-09-14T11:14:52.362+0000 7fcb2e887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:52.464 INFO:tasks.workunit.client.0.smithi050.stderr: -115> 2024-09-14T11:14:52.362+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.464 INFO:tasks.workunit.client.0.smithi050.stderr: -114> 2024-09-14T11:14:52.363+0000 7fcb2e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.464 INFO:tasks.workunit.client.0.smithi050.stderr: -113> 2024-09-14T11:14:52.363+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.464 INFO:tasks.workunit.client.0.smithi050.stderr: -112> 2024-09-14T11:14:52.363+0000 7fcb2c371640 10 monclient: get_auth_request con 0x55cca39a0a30 auth_method 0 2024-09-14T11:14:52.465 INFO:tasks.workunit.client.0.smithi050.stderr: -111> 2024-09-14T11:14:52.364+0000 7fcb2e887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:52.465 INFO:tasks.workunit.client.0.smithi050.stderr: -110> 2024-09-14T11:14:52.364+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.465 INFO:tasks.workunit.client.0.smithi050.stderr: -109> 2024-09-14T11:14:52.364+0000 7fcb2bb70640 10 monclient: get_auth_request con 0x55cca39a4290 auth_method 0 2024-09-14T11:14:52.465 INFO:tasks.workunit.client.0.smithi050.stderr: -108> 2024-09-14T11:14:52.364+0000 7fcb2e887800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:52.465 INFO:tasks.workunit.client.0.smithi050.stderr: -107> 2024-09-14T11:14:52.364+0000 7fcb2e887800 20 searching for the correct realm 2024-09-14T11:14:52.465 INFO:tasks.workunit.client.0.smithi050.stderr: -106> 2024-09-14T11:14:52.365+0000 7fcb2cb72640 10 monclient: get_auth_request con 0x55cca39a9050 auth_method 0 2024-09-14T11:14:52.465 INFO:tasks.workunit.client.0.smithi050.stderr: -105> 2024-09-14T11:14:52.365+0000 7fcb2c371640 10 monclient: get_auth_request con 0x7fcb240c5040 auth_method 0 2024-09-14T11:14:52.465 INFO:tasks.workunit.client.0.smithi050.stderr: -104> 2024-09-14T11:14:52.367+0000 7fcb2bb70640 10 monclient: get_auth_request con 0x7fcb24061040 auth_method 0 2024-09-14T11:14:52.465 INFO:tasks.workunit.client.0.smithi050.stderr: -103> 2024-09-14T11:14:52.367+0000 7fcb2bb70640 0 -- 172.21.15.50:0/3522413320 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fcb24061040 msgr2=0x7fcb240df900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:52.465 INFO:tasks.workunit.client.0.smithi050.stderr: -102> 2024-09-14T11:14:52.367+0000 7fca01ffb640 1 client.7766.objecter ms_handle_reset 0x7fcb24061040 session 0x7fcb240df520 osd.5 2024-09-14T11:14:52.465 INFO:tasks.workunit.client.0.smithi050.stderr: -101> 2024-09-14T11:14:52.367+0000 7fca01ffb640 10 monclient: _renew_subs 2024-09-14T11:14:52.465 INFO:tasks.workunit.client.0.smithi050.stderr: -100> 2024-09-14T11:14:52.367+0000 7fca01ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:52.465 INFO:tasks.workunit.client.0.smithi050.stderr: -99> 2024-09-14T11:14:52.368+0000 7fcb2bb70640 10 monclient: get_auth_request con 0x7fc9f4087510 auth_method 0 2024-09-14T11:14:52.465 INFO:tasks.workunit.client.0.smithi050.stderr: -98> 2024-09-14T11:14:52.369+0000 7fcb2cb72640 10 monclient: get_auth_request con 0x7fcb1c06d0f0 auth_method 0 2024-09-14T11:14:52.466 INFO:tasks.workunit.client.0.smithi050.stderr: -97> 2024-09-14T11:14:52.370+0000 7fcb2c371640 10 monclient: get_auth_request con 0x7fcb240ad0d0 auth_method 0 2024-09-14T11:14:52.466 INFO:tasks.workunit.client.0.smithi050.stderr: -96> 2024-09-14T11:14:52.371+0000 7fcb2cb72640 0 -- 172.21.15.50:0/3522413320 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55cca399c810 msgr2=0x55cca399ec80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:52.466 INFO:tasks.workunit.client.0.smithi050.stderr: -95> 2024-09-14T11:14:52.371+0000 7fca01ffb640 1 client.7766.objecter ms_handle_reset 0x55cca399c810 session 0x55cca399c140 osd.6 2024-09-14T11:14:52.466 INFO:tasks.workunit.client.0.smithi050.stderr: -94> 2024-09-14T11:14:52.371+0000 7fcb2cb72640 10 monclient: get_auth_request con 0x7fcb24061040 auth_method 0 2024-09-14T11:14:52.466 INFO:tasks.workunit.client.0.smithi050.stderr: -93> 2024-09-14T11:14:52.375+0000 7fcb2e887800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:14:52.466 INFO:tasks.workunit.client.0.smithi050.stderr: -92> 2024-09-14T11:14:52.375+0000 7fcb2e887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:52.466 INFO:tasks.workunit.client.0.smithi050.stderr: -91> 2024-09-14T11:14:52.375+0000 7fcb2e887800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:14:52.466 INFO:tasks.workunit.client.0.smithi050.stderr: -90> 2024-09-14T11:14:52.375+0000 7fcb2e887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:52.466 INFO:tasks.workunit.client.0.smithi050.stderr: -89> 2024-09-14T11:14:52.375+0000 7fcb2e887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:52.466 INFO:tasks.workunit.client.0.smithi050.stderr: -88> 2024-09-14T11:14:52.375+0000 7fcb2e887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:52.466 INFO:tasks.workunit.client.0.smithi050.stderr: -87> 2024-09-14T11:14:52.375+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.466 INFO:tasks.workunit.client.0.smithi050.stderr: -86> 2024-09-14T11:14:52.375+0000 7fcb2e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.466 INFO:tasks.workunit.client.0.smithi050.stderr: -85> 2024-09-14T11:14:52.375+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.466 INFO:tasks.workunit.client.0.smithi050.stderr: -84> 2024-09-14T11:14:52.375+0000 7fcb2e887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:52.466 INFO:tasks.workunit.client.0.smithi050.stderr: -83> 2024-09-14T11:14:52.375+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.467 INFO:tasks.workunit.client.0.smithi050.stderr: -82> 2024-09-14T11:14:52.376+0000 7fcb2e887800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:52.467 INFO:tasks.workunit.client.0.smithi050.stderr: -81> 2024-09-14T11:14:52.376+0000 7fcb2e887800 20 zone default found 2024-09-14T11:14:52.467 INFO:tasks.workunit.client.0.smithi050.stderr: -80> 2024-09-14T11:14:52.376+0000 7fcb2e887800 4 Realm: () 2024-09-14T11:14:52.467 INFO:tasks.workunit.client.0.smithi050.stderr: -79> 2024-09-14T11:14:52.376+0000 7fcb2e887800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:14:52.467 INFO:tasks.workunit.client.0.smithi050.stderr: -78> 2024-09-14T11:14:52.376+0000 7fcb2e887800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:14:52.467 INFO:tasks.workunit.client.0.smithi050.stderr: -77> 2024-09-14T11:14:52.376+0000 7fcb2e887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:52.467 INFO:tasks.workunit.client.0.smithi050.stderr: -76> 2024-09-14T11:14:52.376+0000 7fcb2e887800 20 zonegroup default 2024-09-14T11:14:52.467 INFO:tasks.workunit.client.0.smithi050.stderr: -75> 2024-09-14T11:14:52.376+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.467 INFO:tasks.workunit.client.0.smithi050.stderr: -74> 2024-09-14T11:14:52.376+0000 7fcb2e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.467 INFO:tasks.workunit.client.0.smithi050.stderr: -73> 2024-09-14T11:14:52.376+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.467 INFO:tasks.workunit.client.0.smithi050.stderr: -72> 2024-09-14T11:14:52.376+0000 7fcb2e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.467 INFO:tasks.workunit.client.0.smithi050.stderr: -71> 2024-09-14T11:14:52.376+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.467 INFO:tasks.workunit.client.0.smithi050.stderr: -70> 2024-09-14T11:14:52.376+0000 7fcb2e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.467 INFO:tasks.workunit.client.0.smithi050.stderr: -69> 2024-09-14T11:14:52.376+0000 7fcb2e887800 20 started sync module instance, tier type = 2024-09-14T11:14:52.467 INFO:tasks.workunit.client.0.smithi050.stderr: -68> 2024-09-14T11:14:52.376+0000 7fcb2e887800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:14:52.468 INFO:tasks.workunit.client.0.smithi050.stderr: -67> 2024-09-14T11:14:52.385+0000 7fcb2e887800 20 add_watcher() i=0 2024-09-14T11:14:52.468 INFO:tasks.workunit.client.0.smithi050.stderr: -66> 2024-09-14T11:14:52.385+0000 7fcb2e887800 20 add_watcher() i=1 2024-09-14T11:14:52.468 INFO:tasks.workunit.client.0.smithi050.stderr: -65> 2024-09-14T11:14:52.385+0000 7fcb2e887800 20 add_watcher() i=2 2024-09-14T11:14:52.468 INFO:tasks.workunit.client.0.smithi050.stderr: -64> 2024-09-14T11:14:52.385+0000 7fcb2e887800 20 add_watcher() i=3 2024-09-14T11:14:52.468 INFO:tasks.workunit.client.0.smithi050.stderr: -63> 2024-09-14T11:14:52.385+0000 7fcb2e887800 20 add_watcher() i=4 2024-09-14T11:14:52.468 INFO:tasks.workunit.client.0.smithi050.stderr: -62> 2024-09-14T11:14:52.385+0000 7fcb2e887800 20 add_watcher() i=5 2024-09-14T11:14:52.468 INFO:tasks.workunit.client.0.smithi050.stderr: -61> 2024-09-14T11:14:52.385+0000 7fcb2e887800 20 add_watcher() i=6 2024-09-14T11:14:52.468 INFO:tasks.workunit.client.0.smithi050.stderr: -60> 2024-09-14T11:14:52.386+0000 7fcb2e887800 20 add_watcher() i=7 2024-09-14T11:14:52.468 INFO:tasks.workunit.client.0.smithi050.stderr: -59> 2024-09-14T11:14:52.386+0000 7fcb2e887800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:52.468 INFO:tasks.workunit.client.0.smithi050.stderr: -58> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding auth protocol: cephx 2024-09-14T11:14:52.468 INFO:tasks.workunit.client.0.smithi050.stderr: -57> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding auth protocol: cephx 2024-09-14T11:14:52.468 INFO:tasks.workunit.client.0.smithi050.stderr: -56> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding auth protocol: cephx 2024-09-14T11:14:52.468 INFO:tasks.workunit.client.0.smithi050.stderr: -55> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding con mode: secure 2024-09-14T11:14:52.468 INFO:tasks.workunit.client.0.smithi050.stderr: -54> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding con mode: crc 2024-09-14T11:14:52.469 INFO:tasks.workunit.client.0.smithi050.stderr: -53> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding con mode: secure 2024-09-14T11:14:52.469 INFO:tasks.workunit.client.0.smithi050.stderr: -52> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding con mode: crc 2024-09-14T11:14:52.469 INFO:tasks.workunit.client.0.smithi050.stderr: -51> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding con mode: secure 2024-09-14T11:14:52.469 INFO:tasks.workunit.client.0.smithi050.stderr: -50> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding con mode: crc 2024-09-14T11:14:52.469 INFO:tasks.workunit.client.0.smithi050.stderr: -49> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding con mode: crc 2024-09-14T11:14:52.469 INFO:tasks.workunit.client.0.smithi050.stderr: -48> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding con mode: secure 2024-09-14T11:14:52.469 INFO:tasks.workunit.client.0.smithi050.stderr: -47> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding con mode: crc 2024-09-14T11:14:52.469 INFO:tasks.workunit.client.0.smithi050.stderr: -46> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding con mode: secure 2024-09-14T11:14:52.469 INFO:tasks.workunit.client.0.smithi050.stderr: -45> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding con mode: crc 2024-09-14T11:14:52.469 INFO:tasks.workunit.client.0.smithi050.stderr: -44> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding con mode: secure 2024-09-14T11:14:52.469 INFO:tasks.workunit.client.0.smithi050.stderr: -43> 2024-09-14T11:14:52.387+0000 7fc9e2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:52.469 INFO:tasks.workunit.client.0.smithi050.stderr: -42> 2024-09-14T11:14:52.388+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.469 INFO:tasks.workunit.client.0.smithi050.stderr: -41> 2024-09-14T11:14:52.388+0000 7fcb2e887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:52.469 INFO:tasks.workunit.client.0.smithi050.stderr: -40> 2024-09-14T11:14:52.388+0000 7fcb2e887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:52.469 INFO:tasks.workunit.client.0.smithi050.stderr: -39> 2024-09-14T11:14:52.388+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command cache list hook 0x55cca397b460 2024-09-14T11:14:52.470 INFO:tasks.workunit.client.0.smithi050.stderr: -38> 2024-09-14T11:14:52.388+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command cache inspect hook 0x55cca397b460 2024-09-14T11:14:52.470 INFO:tasks.workunit.client.0.smithi050.stderr: -37> 2024-09-14T11:14:52.388+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command cache erase hook 0x55cca397b460 2024-09-14T11:14:52.470 INFO:tasks.workunit.client.0.smithi050.stderr: -36> 2024-09-14T11:14:52.388+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command cache zap hook 0x55cca397b460 2024-09-14T11:14:52.470 INFO:tasks.workunit.client.0.smithi050.stderr: -35> 2024-09-14T11:14:52.388+0000 7fcb2e887800 5 note: GC not initialized 2024-09-14T11:14:52.470 INFO:tasks.workunit.client.0.smithi050.stderr: -34> 2024-09-14T11:14:52.388+0000 7fc9e1fdb640 20 reqs_thread_entry: start 2024-09-14T11:14:52.470 INFO:tasks.workunit.client.0.smithi050.stderr: -33> 2024-09-14T11:14:52.388+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command sync trace show hook 0x7fcb2001c070 2024-09-14T11:14:52.470 INFO:tasks.workunit.client.0.smithi050.stderr: -32> 2024-09-14T11:14:52.388+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command sync trace history hook 0x7fcb2001c070 2024-09-14T11:14:52.470 INFO:tasks.workunit.client.0.smithi050.stderr: -31> 2024-09-14T11:14:52.388+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command sync trace active hook 0x7fcb2001c070 2024-09-14T11:14:52.470 INFO:tasks.workunit.client.0.smithi050.stderr: -30> 2024-09-14T11:14:52.388+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command sync trace active_short hook 0x7fcb2001c070 2024-09-14T11:14:52.470 INFO:tasks.workunit.client.0.smithi050.stderr: -29> 2024-09-14T11:14:52.388+0000 7fcb2e887800 20 init_complete bucket index max shards: 11 2024-09-14T11:14:52.470 INFO:tasks.workunit.client.0.smithi050.stderr: -28> 2024-09-14T11:14:52.388+0000 7fcb2e887800 20 Filter name: none 2024-09-14T11:14:52.470 INFO:tasks.workunit.client.0.smithi050.stderr: -27> 2024-09-14T11:14:52.388+0000 7fc9537fe640 20 reqs_thread_entry: start 2024-09-14T11:14:52.470 INFO:tasks.workunit.client.0.smithi050.stderr: -26> 2024-09-14T11:14:52.388+0000 7fcb2e887800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:14:52.470 INFO:tasks.workunit.client.0.smithi050.stderr: -25> 2024-09-14T11:14:52.388+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.471 INFO:tasks.workunit.client.0.smithi050.stderr: -24> 2024-09-14T11:14:52.389+0000 7fcb2e887800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:14:52.471 INFO:tasks.workunit.client.0.smithi050.stderr: -23> 2024-09-14T11:14:52.389+0000 7fcb2e887800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:14:52.471 INFO:tasks.workunit.client.0.smithi050.stderr: -22> 2024-09-14T11:14:52.389+0000 7fcb2e887800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:14:52.471 INFO:tasks.workunit.client.0.smithi050.stderr: -21> 2024-09-14T11:14:52.389+0000 7fcb2e887800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : miss 2024-09-14T11:14:52.471 INFO:tasks.workunit.client.0.smithi050.stderr: -20> 2024-09-14T11:14:52.389+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.471 INFO:tasks.workunit.client.0.smithi050.stderr: -19> 2024-09-14T11:14:52.389+0000 7fcb2e887800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:14:52.471 INFO:tasks.workunit.client.0.smithi050.stderr: -18> 2024-09-14T11:14:52.389+0000 7fcb2e887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:14:52.471 INFO:tasks.workunit.client.0.smithi050.stderr: -17> 2024-09-14T11:14:52.389+0000 7fcb2e887800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:14:52.471 INFO:tasks.workunit.client.0.smithi050.stderr: -16> 2024-09-14T11:14:52.389+0000 7fcb2e887800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:52.471 INFO:tasks.workunit.client.0.smithi050.stderr: -15> 2024-09-14T11:14:52.389+0000 7fcb2e887800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:14:52.471 INFO:tasks.workunit.client.0.smithi050.stderr: -14> 2024-09-14T11:14:52.389+0000 7fcb2e887800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:14:52.471 INFO:tasks.workunit.client.0.smithi050.stderr: -13> 2024-09-14T11:14:52.395+0000 7fcb2e887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:14:52.471 INFO:tasks.workunit.client.0.smithi050.stderr: -12> 2024-09-14T11:14:52.395+0000 7fcb2e887800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:14:52.472 INFO:tasks.workunit.client.0.smithi050.stderr: -11> 2024-09-14T11:14:52.395+0000 7fcb2e887800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:14:52.472 INFO:tasks.workunit.client.0.smithi050.stderr: -10> 2024-09-14T11:14:52.395+0000 7fcb2e887800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18, ofs0, ns] 2024-09-14T11:14:52.472 INFO:tasks.workunit.client.0.smithi050.stderr: -9> 2024-09-14T11:14:52.396+0000 7fca037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497133 cookie 94337406520512 notifier 7766 bl.length()=911 2024-09-14T11:14:52.472 INFO:tasks.workunit.client.0.smithi050.stderr: -8> 2024-09-14T11:14:52.396+0000 7fca037fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:14:52.472 INFO:tasks.workunit.client.0.smithi050.stderr: -7> 2024-09-14T11:14:52.396+0000 7fca037fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:14:52.472 INFO:tasks.workunit.client.0.smithi050.stderr: -6> 2024-09-14T11:14:52.396+0000 7fca037fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:14:52.472 INFO:tasks.workunit.client.0.smithi050.stderr: -5> 2024-09-14T11:14:52.397+0000 7fcb2e887800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_sources= new_sources= 2024-09-14T11:14:52.472 INFO:tasks.workunit.client.0.smithi050.stderr: -4> 2024-09-14T11:14:52.397+0000 7fcb2e887800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential sources added=[] removed=[] 2024-09-14T11:14:52.472 INFO:tasks.workunit.client.0.smithi050.stderr: -3> 2024-09-14T11:14:52.397+0000 7fcb2e887800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_dests= new_dests= 2024-09-14T11:14:52.472 INFO:tasks.workunit.client.0.smithi050.stderr: -2> 2024-09-14T11:14:52.397+0000 7fcb2e887800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential dests added=[] removed=[] 2024-09-14T11:14:52.472 INFO:tasks.workunit.client.0.smithi050.stderr: -1> 2024-09-14T11:14:52.403+0000 7fcb2e887800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcb2e887800 time 2024-09-14T11:14:52.404105+0000 2024-09-14T11:14:52.472 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:14:52.472 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.473 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:52.473 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcb31d8c76a] 2024-09-14T11:14:52.473 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fcb31d8c928] 2024-09-14T11:14:52.473 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cca1c8f0b1] 2024-09-14T11:14:52.473 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55cca1c9ef6a] 2024-09-14T11:14:52.473 INFO:tasks.workunit.client.0.smithi050.stderr: 5: main() 2024-09-14T11:14:52.473 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fcb30a29590] 2024-09-14T11:14:52.473 INFO:tasks.workunit.client.0.smithi050.stderr: 7: __libc_start_main() 2024-09-14T11:14:52.473 INFO:tasks.workunit.client.0.smithi050.stderr: 8: _start() 2024-09-14T11:14:52.473 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.473 INFO:tasks.workunit.client.0.smithi050.stderr: 0> 2024-09-14T11:14:52.404+0000 7fcb2e887800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:14:52.473 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7fcb2e887800 thread_name:radosgw-admin 2024-09-14T11:14:52.473 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.473 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:52.473 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcb30a3e6f0] 2024-09-14T11:14:52.474 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fcb30a8b99c] 2024-09-14T11:14:52.474 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:14:52.474 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:14:52.474 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcb31d8c7c4] 2024-09-14T11:14:52.474 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fcb31d8c928] 2024-09-14T11:14:52.474 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cca1c8f0b1] 2024-09-14T11:14:52.474 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55cca1c9ef6a] 2024-09-14T11:14:52.474 INFO:tasks.workunit.client.0.smithi050.stderr: 9: main() 2024-09-14T11:14:52.474 INFO:tasks.workunit.client.0.smithi050.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fcb30a29590] 2024-09-14T11:14:52.474 INFO:tasks.workunit.client.0.smithi050.stderr: 11: __libc_start_main() 2024-09-14T11:14:52.474 INFO:tasks.workunit.client.0.smithi050.stderr: 12: _start() 2024-09-14T11:14:52.474 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:14:52.474 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.474 INFO:tasks.workunit.client.0.smithi050.stderr:--- logging levels --- 2024-09-14T11:14:52.474 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 none 2024-09-14T11:14:52.475 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 lockdep 2024-09-14T11:14:52.475 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 context 2024-09-14T11:14:52.475 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 crush 2024-09-14T11:14:52.475 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds 2024-09-14T11:14:52.475 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_balancer 2024-09-14T11:14:52.475 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_locker 2024-09-14T11:14:52.475 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log 2024-09-14T11:14:52.475 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log_expire 2024-09-14T11:14:52.475 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_migrator 2024-09-14T11:14:52.475 INFO:tasks.workunit.client.0.smithi050.stderr: 3/ 5 mds_quiesce 2024-09-14T11:14:52.475 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 buffer 2024-09-14T11:14:52.475 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 timer 2024-09-14T11:14:52.475 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 filer 2024-09-14T11:14:52.475 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 striper 2024-09-14T11:14:52.475 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 objecter 2024-09-14T11:14:52.476 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rados 2024-09-14T11:14:52.476 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd 2024-09-14T11:14:52.476 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_mirror 2024-09-14T11:14:52.476 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_replay 2024-09-14T11:14:52.476 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_pwl 2024-09-14T11:14:52.476 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 journaler 2024-09-14T11:14:52.476 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objectcacher 2024-09-14T11:14:52.476 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:14:52.476 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 client 2024-09-14T11:14:52.476 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 osd 2024-09-14T11:14:52.476 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 optracker 2024-09-14T11:14:52.476 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objclass 2024-09-14T11:14:52.476 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 filestore 2024-09-14T11:14:52.476 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 journal 2024-09-14T11:14:52.476 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 ms 2024-09-14T11:14:52.477 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mon 2024-09-14T11:14:52.477 INFO:tasks.workunit.client.0.smithi050.stderr: 0/10 monc 2024-09-14T11:14:52.477 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 paxos 2024-09-14T11:14:52.477 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 tp 2024-09-14T11:14:52.477 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 auth 2024-09-14T11:14:52.477 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 crypto 2024-09-14T11:14:52.477 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 finisher 2024-09-14T11:14:52.477 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 reserver 2024-09-14T11:14:52.477 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 heartbeatmap 2024-09-14T11:14:52.477 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 perfcounter 2024-09-14T11:14:52.477 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw 2024-09-14T11:14:52.477 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_sync 2024-09-14T11:14:52.477 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_datacache 2024-09-14T11:14:52.477 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_access 2024-09-14T11:14:52.477 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:14:52.477 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_flight 2024-09-14T11:14:52.478 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:14:52.478 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw_notification 2024-09-14T11:14:52.478 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 javaclient 2024-09-14T11:14:52.478 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 asok 2024-09-14T11:14:52.478 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 throttle 2024-09-14T11:14:52.478 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 refs 2024-09-14T11:14:52.478 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 compressor 2024-09-14T11:14:52.478 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluestore 2024-09-14T11:14:52.478 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluefs 2024-09-14T11:14:52.478 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 bdev 2024-09-14T11:14:52.478 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 kstore 2024-09-14T11:14:52.478 INFO:tasks.workunit.client.0.smithi050.stderr: 4/ 5 rocksdb 2024-09-14T11:14:52.478 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 fuse 2024-09-14T11:14:52.478 INFO:tasks.workunit.client.0.smithi050.stderr: 2/ 5 mgr 2024-09-14T11:14:52.478 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mgrc 2024-09-14T11:14:52.479 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 dpdk 2024-09-14T11:14:52.479 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 eventtrace 2024-09-14T11:14:52.479 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 prioritycache 2024-09-14T11:14:52.479 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 test 2024-09-14T11:14:52.479 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:14:52.479 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephsqlite 2024-09-14T11:14:52.479 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:14:52.479 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore 2024-09-14T11:14:52.479 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_onode 2024-09-14T11:14:52.479 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_odata 2024-09-14T11:14:52.479 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_omap 2024-09-14T11:14:52.479 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_tm 2024-09-14T11:14:52.479 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_t 2024-09-14T11:14:52.479 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:14:52.479 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_epm 2024-09-14T11:14:52.480 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_lba 2024-09-14T11:14:52.480 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:14:52.480 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cache 2024-09-14T11:14:52.480 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_journal 2024-09-14T11:14:52.480 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_device 2024-09-14T11:14:52.480 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_backref 2024-09-14T11:14:52.480 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 alienstore 2024-09-14T11:14:52.480 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mclock 2024-09-14T11:14:52.480 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cyanstore 2024-09-14T11:14:52.480 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 ceph_exporter 2024-09-14T11:14:52.480 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 memstore 2024-09-14T11:14:52.480 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 trace 2024-09-14T11:14:52.480 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 ceph_dedup 2024-09-14T11:14:52.481 INFO:tasks.workunit.client.0.smithi050.stderr: -2/-2 (syslog threshold) 2024-09-14T11:14:52.481 INFO:tasks.workunit.client.0.smithi050.stderr: 99/99 (stderr threshold) 2024-09-14T11:14:52.481 INFO:tasks.workunit.client.0.smithi050.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:14:52.481 INFO:tasks.workunit.client.0.smithi050.stderr: 7fc9537fe640 / http_manager 2024-09-14T11:14:52.481 INFO:tasks.workunit.client.0.smithi050.stderr: 7fc9e1fdb640 / http_manager 2024-09-14T11:14:52.481 INFO:tasks.workunit.client.0.smithi050.stderr: 7fc9e2fdd640 / rgw_dt_lg_renew 2024-09-14T11:14:52.481 INFO:tasks.workunit.client.0.smithi050.stderr: 7fca01ffb640 / ms_dispatch 2024-09-14T11:14:52.481 INFO:tasks.workunit.client.0.smithi050.stderr: 7fca037fe640 / io_context_pool 2024-09-14T11:14:52.481 INFO:tasks.workunit.client.0.smithi050.stderr: 7fca11ffb640 / ms_dispatch 2024-09-14T11:14:52.481 INFO:tasks.workunit.client.0.smithi050.stderr: 7fca18e09640 / ms_dispatch 2024-09-14T11:14:52.481 INFO:tasks.workunit.client.0.smithi050.stderr: 7fca1a60c640 / io_context_pool 2024-09-14T11:14:52.481 INFO:tasks.workunit.client.0.smithi050.stderr: 7fcb2bb70640 / msgr-worker-2 2024-09-14T11:14:52.481 INFO:tasks.workunit.client.0.smithi050.stderr: 7fcb2c371640 / msgr-worker-1 2024-09-14T11:14:52.481 INFO:tasks.workunit.client.0.smithi050.stderr: 7fcb2cb72640 / msgr-worker-0 2024-09-14T11:14:52.481 INFO:tasks.workunit.client.0.smithi050.stderr: 7fcb2d373640 / io_context_pool 2024-09-14T11:14:52.482 INFO:tasks.workunit.client.0.smithi050.stderr: 7fcb2e887800 / radosgw-admin 2024-09-14T11:14:52.482 INFO:tasks.workunit.client.0.smithi050.stderr: max_recent 500 2024-09-14T11:14:52.482 INFO:tasks.workunit.client.0.smithi050.stderr: max_new 1000 2024-09-14T11:14:52.482 INFO:tasks.workunit.client.0.smithi050.stderr: log_file /var/log/ceph/ceph-client.admin.151454.log 2024-09-14T11:14:52.482 INFO:tasks.workunit.client.0.smithi050.stderr:--- end dump of recent events --- 2024-09-14T11:14:52.482 INFO:tasks.workunit.client.0.smithi050.stderr:--- begin dump of recent events --- 2024-09-14T11:14:52.482 INFO:tasks.workunit.client.0.smithi050.stderr: -499> 2024-09-14T11:14:52.342+0000 7fca1a60c640 10 monclient: dump: 2024-09-14T11:14:52.482 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:52.482 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:52.482 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.482 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.482 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.482 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.482 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:52.483 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:52.483 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:52.483 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.483 INFO:tasks.workunit.client.0.smithi050.stderr: -498> 2024-09-14T11:14:52.342+0000 7fcb2e887800 5 monclient: authenticate success, global_id 8319 2024-09-14T11:14:52.483 INFO:tasks.workunit.client.0.smithi050.stderr: -497> 2024-09-14T11:14:52.342+0000 7fcb2e887800 10 monclient: get_monmap_and_config success 2024-09-14T11:14:52.483 INFO:tasks.workunit.client.0.smithi050.stderr: -496> 2024-09-14T11:14:52.342+0000 7fcb2e887800 4 set_mon_vals no callback set 2024-09-14T11:14:52.483 INFO:tasks.workunit.client.0.smithi050.stderr: -495> 2024-09-14T11:14:52.343+0000 7fcb2e887800 10 monclient: shutdown 2024-09-14T11:14:52.483 INFO:tasks.workunit.client.0.smithi050.stderr: -494> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 asok(0x55cca368e270) unregister_commands rotate-key 2024-09-14T11:14:52.483 INFO:tasks.workunit.client.0.smithi050.stderr: -493> 2024-09-14T11:14:52.343+0000 7fcb2e887800 10 monclient: build_initial_monmap 2024-09-14T11:14:52.483 INFO:tasks.workunit.client.0.smithi050.stderr: -492> 2024-09-14T11:14:52.343+0000 7fcb2e887800 1 build_initial for_mkfs: 0 2024-09-14T11:14:52.483 INFO:tasks.workunit.client.0.smithi050.stderr: -491> 2024-09-14T11:14:52.343+0000 7fcb2e887800 10 monclient: monmap: 2024-09-14T11:14:52.483 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:14:52.484 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:52.484 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:14:52.484 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:14:52.484 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:52.484 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.484 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:14:52.484 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:14:52.484 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:14:52.484 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.484 INFO:tasks.workunit.client.0.smithi050.stderr: -490> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding auth protocol: cephx 2024-09-14T11:14:52.484 INFO:tasks.workunit.client.0.smithi050.stderr: -489> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding auth protocol: cephx 2024-09-14T11:14:52.484 INFO:tasks.workunit.client.0.smithi050.stderr: -488> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding auth protocol: cephx 2024-09-14T11:14:52.484 INFO:tasks.workunit.client.0.smithi050.stderr: -487> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding con mode: secure 2024-09-14T11:14:52.484 INFO:tasks.workunit.client.0.smithi050.stderr: -486> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding con mode: crc 2024-09-14T11:14:52.485 INFO:tasks.workunit.client.0.smithi050.stderr: -485> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding con mode: secure 2024-09-14T11:14:52.485 INFO:tasks.workunit.client.0.smithi050.stderr: -484> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding con mode: crc 2024-09-14T11:14:52.485 INFO:tasks.workunit.client.0.smithi050.stderr: -483> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding con mode: secure 2024-09-14T11:14:52.485 INFO:tasks.workunit.client.0.smithi050.stderr: -482> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding con mode: crc 2024-09-14T11:14:52.485 INFO:tasks.workunit.client.0.smithi050.stderr: -481> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding con mode: crc 2024-09-14T11:14:52.485 INFO:tasks.workunit.client.0.smithi050.stderr: -480> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding con mode: secure 2024-09-14T11:14:52.485 INFO:tasks.workunit.client.0.smithi050.stderr: -479> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding con mode: crc 2024-09-14T11:14:52.485 INFO:tasks.workunit.client.0.smithi050.stderr: -478> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding con mode: secure 2024-09-14T11:14:52.485 INFO:tasks.workunit.client.0.smithi050.stderr: -477> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding con mode: crc 2024-09-14T11:14:52.485 INFO:tasks.workunit.client.0.smithi050.stderr: -476> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b6a50) adding con mode: secure 2024-09-14T11:14:52.485 INFO:tasks.workunit.client.0.smithi050.stderr: -475> 2024-09-14T11:14:52.343+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.485 INFO:tasks.workunit.client.0.smithi050.stderr: -474> 2024-09-14T11:14:52.343+0000 7fcb2e887800 1 librados: starting msgr at 2024-09-14T11:14:52.485 INFO:tasks.workunit.client.0.smithi050.stderr: -473> 2024-09-14T11:14:52.343+0000 7fcb2e887800 1 librados: starting objecter 2024-09-14T11:14:52.485 INFO:tasks.workunit.client.0.smithi050.stderr: -472> 2024-09-14T11:14:52.343+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command objecter_requests hook 0x55cca38b62b0 2024-09-14T11:14:52.486 INFO:tasks.workunit.client.0.smithi050.stderr: -471> 2024-09-14T11:14:52.344+0000 7fcb2e887800 1 librados: setting wanted keys 2024-09-14T11:14:52.486 INFO:tasks.workunit.client.0.smithi050.stderr: -470> 2024-09-14T11:14:52.344+0000 7fcb2e887800 1 librados: calling monclient init 2024-09-14T11:14:52.486 INFO:tasks.workunit.client.0.smithi050.stderr: -469> 2024-09-14T11:14:52.344+0000 7fcb2e887800 10 monclient: init 2024-09-14T11:14:52.486 INFO:tasks.workunit.client.0.smithi050.stderr: -468> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding auth protocol: cephx 2024-09-14T11:14:52.486 INFO:tasks.workunit.client.0.smithi050.stderr: -467> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding auth protocol: cephx 2024-09-14T11:14:52.486 INFO:tasks.workunit.client.0.smithi050.stderr: -466> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding auth protocol: cephx 2024-09-14T11:14:52.486 INFO:tasks.workunit.client.0.smithi050.stderr: -465> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding con mode: secure 2024-09-14T11:14:52.486 INFO:tasks.workunit.client.0.smithi050.stderr: -464> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding con mode: crc 2024-09-14T11:14:52.486 INFO:tasks.workunit.client.0.smithi050.stderr: -463> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding con mode: secure 2024-09-14T11:14:52.486 INFO:tasks.workunit.client.0.smithi050.stderr: -462> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding con mode: crc 2024-09-14T11:14:52.486 INFO:tasks.workunit.client.0.smithi050.stderr: -461> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding con mode: secure 2024-09-14T11:14:52.486 INFO:tasks.workunit.client.0.smithi050.stderr: -460> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding con mode: crc 2024-09-14T11:14:52.486 INFO:tasks.workunit.client.0.smithi050.stderr: -459> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding con mode: crc 2024-09-14T11:14:52.486 INFO:tasks.workunit.client.0.smithi050.stderr: -458> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding con mode: secure 2024-09-14T11:14:52.486 INFO:tasks.workunit.client.0.smithi050.stderr: -457> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding con mode: crc 2024-09-14T11:14:52.487 INFO:tasks.workunit.client.0.smithi050.stderr: -456> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding con mode: secure 2024-09-14T11:14:52.487 INFO:tasks.workunit.client.0.smithi050.stderr: -455> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding con mode: crc 2024-09-14T11:14:52.487 INFO:tasks.workunit.client.0.smithi050.stderr: -454> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 AuthRegistry(0x55cca38b0e00) adding con mode: secure 2024-09-14T11:14:52.487 INFO:tasks.workunit.client.0.smithi050.stderr: -453> 2024-09-14T11:14:52.344+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.487 INFO:tasks.workunit.client.0.smithi050.stderr: -452> 2024-09-14T11:14:52.344+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.487 INFO:tasks.workunit.client.0.smithi050.stderr: -451> 2024-09-14T11:14:52.344+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command rotate-key hook 0x55cca38b0f48 2024-09-14T11:14:52.487 INFO:tasks.workunit.client.0.smithi050.stderr: -450> 2024-09-14T11:14:52.344+0000 7fcb2e887800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:52.487 INFO:tasks.workunit.client.0.smithi050.stderr: -449> 2024-09-14T11:14:52.344+0000 7fcb2e887800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:14:52.487 INFO:tasks.workunit.client.0.smithi050.stderr: -448> 2024-09-14T11:14:52.344+0000 7fcb2e887800 10 monclient(hunting): picked mon.noname-b con 0x55cca3726930 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:14:52.487 INFO:tasks.workunit.client.0.smithi050.stderr: -447> 2024-09-14T11:14:52.344+0000 7fcb2e887800 10 monclient(hunting): picked mon.noname-c con 0x55cca37fa7a0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:14:52.487 INFO:tasks.workunit.client.0.smithi050.stderr: -446> 2024-09-14T11:14:52.344+0000 7fcb2e887800 10 monclient(hunting): picked mon.noname-a con 0x55cca38e2d70 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:14:52.487 INFO:tasks.workunit.client.0.smithi050.stderr: -445> 2024-09-14T11:14:52.344+0000 7fcb2e887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.487 INFO:tasks.workunit.client.0.smithi050.stderr: -444> 2024-09-14T11:14:52.344+0000 7fcb2e887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.487 INFO:tasks.workunit.client.0.smithi050.stderr: -443> 2024-09-14T11:14:52.344+0000 7fcb2e887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.487 INFO:tasks.workunit.client.0.smithi050.stderr: -442> 2024-09-14T11:14:52.344+0000 7fcb2e887800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:52.488 INFO:tasks.workunit.client.0.smithi050.stderr: -441> 2024-09-14T11:14:52.344+0000 7fcb2e887800 10 monclient(hunting): authenticate will time out at 2544.982600s 2024-09-14T11:14:52.488 INFO:tasks.workunit.client.0.smithi050.stderr: -440> 2024-09-14T11:14:52.344+0000 7fcb2bb70640 10 monclient(hunting): get_auth_request con 0x55cca37fa7a0 auth_method 0 2024-09-14T11:14:52.488 INFO:tasks.workunit.client.0.smithi050.stderr: -439> 2024-09-14T11:14:52.344+0000 7fcb2bb70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.488 INFO:tasks.workunit.client.0.smithi050.stderr: -438> 2024-09-14T11:14:52.344+0000 7fcb2bb70640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.488 INFO:tasks.workunit.client.0.smithi050.stderr: -437> 2024-09-14T11:14:52.344+0000 7fcb2bb70640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.488 INFO:tasks.workunit.client.0.smithi050.stderr: -436> 2024-09-14T11:14:52.344+0000 7fcb2cb72640 10 monclient(hunting): get_auth_request con 0x55cca38e2d70 auth_method 0 2024-09-14T11:14:52.488 INFO:tasks.workunit.client.0.smithi050.stderr: -435> 2024-09-14T11:14:52.344+0000 7fcb2cb72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.488 INFO:tasks.workunit.client.0.smithi050.stderr: -434> 2024-09-14T11:14:52.344+0000 7fcb2cb72640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.488 INFO:tasks.workunit.client.0.smithi050.stderr: -433> 2024-09-14T11:14:52.344+0000 7fcb2cb72640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.488 INFO:tasks.workunit.client.0.smithi050.stderr: -432> 2024-09-14T11:14:52.344+0000 7fcb2c371640 10 monclient(hunting): get_auth_request con 0x55cca3726930 auth_method 0 2024-09-14T11:14:52.488 INFO:tasks.workunit.client.0.smithi050.stderr: -431> 2024-09-14T11:14:52.344+0000 7fcb2c371640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.488 INFO:tasks.workunit.client.0.smithi050.stderr: -430> 2024-09-14T11:14:52.344+0000 7fcb2c371640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.488 INFO:tasks.workunit.client.0.smithi050.stderr: -429> 2024-09-14T11:14:52.344+0000 7fcb2c371640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.488 INFO:tasks.workunit.client.0.smithi050.stderr: -428> 2024-09-14T11:14:52.344+0000 7fcb2bb70640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.488 INFO:tasks.workunit.client.0.smithi050.stderr: -427> 2024-09-14T11:14:52.344+0000 7fcb2bb70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.489 INFO:tasks.workunit.client.0.smithi050.stderr: -426> 2024-09-14T11:14:52.344+0000 7fcb2bb70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.489 INFO:tasks.workunit.client.0.smithi050.stderr: -425> 2024-09-14T11:14:52.344+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.489 INFO:tasks.workunit.client.0.smithi050.stderr: -424> 2024-09-14T11:14:52.344+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.489 INFO:tasks.workunit.client.0.smithi050.stderr: -423> 2024-09-14T11:14:52.344+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.489 INFO:tasks.workunit.client.0.smithi050.stderr: -422> 2024-09-14T11:14:52.344+0000 7fcb2c371640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.489 INFO:tasks.workunit.client.0.smithi050.stderr: -421> 2024-09-14T11:14:52.344+0000 7fcb2c371640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.489 INFO:tasks.workunit.client.0.smithi050.stderr: -420> 2024-09-14T11:14:52.344+0000 7fcb2c371640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.489 INFO:tasks.workunit.client.0.smithi050.stderr: -419> 2024-09-14T11:14:52.344+0000 7fcb2bb70640 10 monclient(hunting): handle_auth_done global_id 7757 payload 824 2024-09-14T11:14:52.489 INFO:tasks.workunit.client.0.smithi050.stderr: -418> 2024-09-14T11:14:52.345+0000 7fcb2bb70640 10 monclient: _finish_hunting 0 2024-09-14T11:14:52.489 INFO:tasks.workunit.client.0.smithi050.stderr: -417> 2024-09-14T11:14:52.345+0000 7fcb2bb70640 1 monclient: found mon.noname-c 2024-09-14T11:14:52.489 INFO:tasks.workunit.client.0.smithi050.stderr: -416> 2024-09-14T11:14:52.345+0000 7fcb2bb70640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:14:52.489 INFO:tasks.workunit.client.0.smithi050.stderr: -415> 2024-09-14T11:14:52.345+0000 7fca18e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.489 INFO:tasks.workunit.client.0.smithi050.stderr: -414> 2024-09-14T11:14:52.345+0000 7fca18e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:52.489 INFO:tasks.workunit.client.0.smithi050.stderr: -413> 2024-09-14T11:14:52.345+0000 7fca18e09640 10 monclient: dump: 2024-09-14T11:14:52.489 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:52.490 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:52.490 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.490 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.490 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.490 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.490 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:52.490 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:52.490 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:52.490 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.490 INFO:tasks.workunit.client.0.smithi050.stderr: -412> 2024-09-14T11:14:52.345+0000 7fca18e09640 10 monclient: _finish_auth 0 2024-09-14T11:14:52.490 INFO:tasks.workunit.client.0.smithi050.stderr: -411> 2024-09-14T11:14:52.345+0000 7fca18e09640 10 monclient: _check_auth_tickets 2024-09-14T11:14:52.490 INFO:tasks.workunit.client.0.smithi050.stderr: -410> 2024-09-14T11:14:52.345+0000 7fca18e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:52.490 INFO:tasks.workunit.client.0.smithi050.stderr: -409> 2024-09-14T11:14:52.345+0000 7fca18e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.490 INFO:tasks.workunit.client.0.smithi050.stderr: -408> 2024-09-14T11:14:52.345+0000 7fca18e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:52.491 INFO:tasks.workunit.client.0.smithi050.stderr: -407> 2024-09-14T11:14:52.345+0000 7fca18e09640 10 monclient: dump: 2024-09-14T11:14:52.491 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:52.491 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:52.491 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.491 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.491 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.491 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.491 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:52.491 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:52.491 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:52.491 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.491 INFO:tasks.workunit.client.0.smithi050.stderr: -406> 2024-09-14T11:14:52.345+0000 7fcb2e887800 5 monclient: authenticate success, global_id 7757 2024-09-14T11:14:52.491 INFO:tasks.workunit.client.0.smithi050.stderr: -405> 2024-09-14T11:14:52.345+0000 7fcb2e887800 10 monclient: _renew_subs 2024-09-14T11:14:52.491 INFO:tasks.workunit.client.0.smithi050.stderr: -404> 2024-09-14T11:14:52.345+0000 7fcb2e887800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:52.492 INFO:tasks.workunit.client.0.smithi050.stderr: -403> 2024-09-14T11:14:52.345+0000 7fca1a60c640 4 set_mon_vals no callback set 2024-09-14T11:14:52.492 INFO:tasks.workunit.client.0.smithi050.stderr: -402> 2024-09-14T11:14:52.345+0000 7fcb2e887800 10 monclient: _renew_subs 2024-09-14T11:14:52.492 INFO:tasks.workunit.client.0.smithi050.stderr: -401> 2024-09-14T11:14:52.345+0000 7fcb2e887800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:52.492 INFO:tasks.workunit.client.0.smithi050.stderr: -400> 2024-09-14T11:14:52.345+0000 7fcb2e887800 1 librados: init done 2024-09-14T11:14:52.492 INFO:tasks.workunit.client.0.smithi050.stderr: -399> 2024-09-14T11:14:52.347+0000 7fca18e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:14:52.492 INFO:tasks.workunit.client.0.smithi050.stderr: -398> 2024-09-14T11:14:52.347+0000 7fca18e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:14:52.492 INFO:tasks.workunit.client.0.smithi050.stderr: -397> 2024-09-14T11:14:52.347+0000 7fca18e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:14:52.492 INFO:tasks.workunit.client.0.smithi050.stderr: -396> 2024-09-14T11:14:52.347+0000 7fcb2c371640 10 monclient: get_auth_request con 0x7fca14077260 auth_method 0 2024-09-14T11:14:52.492 INFO:tasks.workunit.client.0.smithi050.stderr: -395> 2024-09-14T11:14:52.347+0000 7fcb2cb72640 10 monclient: get_auth_request con 0x55cca38f9d90 auth_method 0 2024-09-14T11:14:52.492 INFO:tasks.workunit.client.0.smithi050.stderr: -394> 2024-09-14T11:14:52.348+0000 7fcb2c371640 10 monclient: get_auth_request con 0x55cca38fcf70 auth_method 0 2024-09-14T11:14:52.492 INFO:tasks.workunit.client.0.smithi050.stderr: -393> 2024-09-14T11:14:52.349+0000 7fcb2bb70640 10 monclient: get_auth_request con 0x55cca3901160 auth_method 0 2024-09-14T11:14:52.492 INFO:tasks.workunit.client.0.smithi050.stderr: -392> 2024-09-14T11:14:52.351+0000 7fcb2e887800 10 monclient: build_initial_monmap 2024-09-14T11:14:52.492 INFO:tasks.workunit.client.0.smithi050.stderr: -391> 2024-09-14T11:14:52.351+0000 7fcb2e887800 1 build_initial for_mkfs: 0 2024-09-14T11:14:52.492 INFO:tasks.workunit.client.0.smithi050.stderr: -390> 2024-09-14T11:14:52.351+0000 7fcb2e887800 10 monclient: monmap: 2024-09-14T11:14:52.493 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:14:52.493 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:52.493 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:14:52.493 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:14:52.493 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:52.493 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.493 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:14:52.493 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:14:52.493 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:14:52.493 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.493 INFO:tasks.workunit.client.0.smithi050.stderr: -389> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding auth protocol: cephx 2024-09-14T11:14:52.493 INFO:tasks.workunit.client.0.smithi050.stderr: -388> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding auth protocol: cephx 2024-09-14T11:14:52.493 INFO:tasks.workunit.client.0.smithi050.stderr: -387> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding auth protocol: cephx 2024-09-14T11:14:52.493 INFO:tasks.workunit.client.0.smithi050.stderr: -386> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding con mode: secure 2024-09-14T11:14:52.494 INFO:tasks.workunit.client.0.smithi050.stderr: -385> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding con mode: crc 2024-09-14T11:14:52.494 INFO:tasks.workunit.client.0.smithi050.stderr: -384> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding con mode: secure 2024-09-14T11:14:52.494 INFO:tasks.workunit.client.0.smithi050.stderr: -383> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding con mode: crc 2024-09-14T11:14:52.494 INFO:tasks.workunit.client.0.smithi050.stderr: -382> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding con mode: secure 2024-09-14T11:14:52.494 INFO:tasks.workunit.client.0.smithi050.stderr: -381> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding con mode: crc 2024-09-14T11:14:52.494 INFO:tasks.workunit.client.0.smithi050.stderr: -380> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding con mode: crc 2024-09-14T11:14:52.494 INFO:tasks.workunit.client.0.smithi050.stderr: -379> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding con mode: secure 2024-09-14T11:14:52.494 INFO:tasks.workunit.client.0.smithi050.stderr: -378> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding con mode: crc 2024-09-14T11:14:52.494 INFO:tasks.workunit.client.0.smithi050.stderr: -377> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding con mode: secure 2024-09-14T11:14:52.494 INFO:tasks.workunit.client.0.smithi050.stderr: -376> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding con mode: crc 2024-09-14T11:14:52.494 INFO:tasks.workunit.client.0.smithi050.stderr: -375> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3905fe0) adding con mode: secure 2024-09-14T11:14:52.494 INFO:tasks.workunit.client.0.smithi050.stderr: -374> 2024-09-14T11:14:52.351+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.494 INFO:tasks.workunit.client.0.smithi050.stderr: -373> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command objecter_requests cmddesc objecter_requests hook 0x55cca39094e0 EEXIST 2024-09-14T11:14:52.494 INFO:tasks.workunit.client.0.smithi050.stderr: -372> 2024-09-14T11:14:52.351+0000 7fcb2e887800 10 monclient: init 2024-09-14T11:14:52.495 INFO:tasks.workunit.client.0.smithi050.stderr: -371> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding auth protocol: cephx 2024-09-14T11:14:52.495 INFO:tasks.workunit.client.0.smithi050.stderr: -370> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding auth protocol: cephx 2024-09-14T11:14:52.495 INFO:tasks.workunit.client.0.smithi050.stderr: -369> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding auth protocol: cephx 2024-09-14T11:14:52.495 INFO:tasks.workunit.client.0.smithi050.stderr: -368> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding con mode: secure 2024-09-14T11:14:52.495 INFO:tasks.workunit.client.0.smithi050.stderr: -367> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding con mode: crc 2024-09-14T11:14:52.495 INFO:tasks.workunit.client.0.smithi050.stderr: -366> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding con mode: secure 2024-09-14T11:14:52.495 INFO:tasks.workunit.client.0.smithi050.stderr: -365> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding con mode: crc 2024-09-14T11:14:52.495 INFO:tasks.workunit.client.0.smithi050.stderr: -364> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding con mode: secure 2024-09-14T11:14:52.495 INFO:tasks.workunit.client.0.smithi050.stderr: -363> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding con mode: crc 2024-09-14T11:14:52.495 INFO:tasks.workunit.client.0.smithi050.stderr: -362> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding con mode: crc 2024-09-14T11:14:52.495 INFO:tasks.workunit.client.0.smithi050.stderr: -361> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding con mode: secure 2024-09-14T11:14:52.495 INFO:tasks.workunit.client.0.smithi050.stderr: -360> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding con mode: crc 2024-09-14T11:14:52.495 INFO:tasks.workunit.client.0.smithi050.stderr: -359> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding con mode: secure 2024-09-14T11:14:52.495 INFO:tasks.workunit.client.0.smithi050.stderr: -358> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding con mode: crc 2024-09-14T11:14:52.495 INFO:tasks.workunit.client.0.smithi050.stderr: -357> 2024-09-14T11:14:52.351+0000 7fcb2e887800 5 AuthRegistry(0x55cca3904648) adding con mode: secure 2024-09-14T11:14:52.496 INFO:tasks.workunit.client.0.smithi050.stderr: -356> 2024-09-14T11:14:52.351+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.496 INFO:tasks.workunit.client.0.smithi050.stderr: -355> 2024-09-14T11:14:52.352+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.496 INFO:tasks.workunit.client.0.smithi050.stderr: -354> 2024-09-14T11:14:52.352+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command rotate-key cmddesc rotate-key hook 0x55cca3904790 EEXIST 2024-09-14T11:14:52.496 INFO:tasks.workunit.client.0.smithi050.stderr: -353> 2024-09-14T11:14:52.352+0000 7fcb2e887800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:52.496 INFO:tasks.workunit.client.0.smithi050.stderr: -352> 2024-09-14T11:14:52.352+0000 7fcb2e887800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:14:52.496 INFO:tasks.workunit.client.0.smithi050.stderr: -351> 2024-09-14T11:14:52.352+0000 7fcb2e887800 10 monclient(hunting): picked mon.noname-b con 0x55cca392d800 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:14:52.496 INFO:tasks.workunit.client.0.smithi050.stderr: -350> 2024-09-14T11:14:52.352+0000 7fcb2e887800 10 monclient(hunting): picked mon.noname-a con 0x55cca392dbe0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:14:52.496 INFO:tasks.workunit.client.0.smithi050.stderr: -349> 2024-09-14T11:14:52.352+0000 7fcb2e887800 10 monclient(hunting): picked mon.noname-c con 0x55cca392c510 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:14:52.496 INFO:tasks.workunit.client.0.smithi050.stderr: -348> 2024-09-14T11:14:52.352+0000 7fcb2e887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.496 INFO:tasks.workunit.client.0.smithi050.stderr: -347> 2024-09-14T11:14:52.352+0000 7fcb2e887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.496 INFO:tasks.workunit.client.0.smithi050.stderr: -346> 2024-09-14T11:14:52.352+0000 7fcb2e887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.496 INFO:tasks.workunit.client.0.smithi050.stderr: -345> 2024-09-14T11:14:52.352+0000 7fcb2e887800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:52.496 INFO:tasks.workunit.client.0.smithi050.stderr: -344> 2024-09-14T11:14:52.352+0000 7fcb2e887800 10 monclient(hunting): authenticate will time out at 2544.990210s 2024-09-14T11:14:52.496 INFO:tasks.workunit.client.0.smithi050.stderr: -343> 2024-09-14T11:14:52.352+0000 7fcb2cb72640 10 monclient(hunting): get_auth_request con 0x55cca392c510 auth_method 0 2024-09-14T11:14:52.496 INFO:tasks.workunit.client.0.smithi050.stderr: -342> 2024-09-14T11:14:52.352+0000 7fcb2cb72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.497 INFO:tasks.workunit.client.0.smithi050.stderr: -341> 2024-09-14T11:14:52.352+0000 7fcb2cb72640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.497 INFO:tasks.workunit.client.0.smithi050.stderr: -340> 2024-09-14T11:14:52.352+0000 7fcb2cb72640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.497 INFO:tasks.workunit.client.0.smithi050.stderr: -339> 2024-09-14T11:14:52.352+0000 7fcb2bb70640 10 monclient(hunting): get_auth_request con 0x55cca392dbe0 auth_method 0 2024-09-14T11:14:52.497 INFO:tasks.workunit.client.0.smithi050.stderr: -338> 2024-09-14T11:14:52.352+0000 7fcb2bb70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.497 INFO:tasks.workunit.client.0.smithi050.stderr: -337> 2024-09-14T11:14:52.352+0000 7fcb2bb70640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.497 INFO:tasks.workunit.client.0.smithi050.stderr: -336> 2024-09-14T11:14:52.352+0000 7fcb2bb70640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.497 INFO:tasks.workunit.client.0.smithi050.stderr: -335> 2024-09-14T11:14:52.352+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.497 INFO:tasks.workunit.client.0.smithi050.stderr: -334> 2024-09-14T11:14:52.352+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.497 INFO:tasks.workunit.client.0.smithi050.stderr: -333> 2024-09-14T11:14:52.352+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.497 INFO:tasks.workunit.client.0.smithi050.stderr: -332> 2024-09-14T11:14:52.352+0000 7fcb2c371640 10 monclient(hunting): get_auth_request con 0x55cca392d800 auth_method 0 2024-09-14T11:14:52.497 INFO:tasks.workunit.client.0.smithi050.stderr: -331> 2024-09-14T11:14:52.352+0000 7fcb2c371640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.497 INFO:tasks.workunit.client.0.smithi050.stderr: -330> 2024-09-14T11:14:52.352+0000 7fcb2c371640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.497 INFO:tasks.workunit.client.0.smithi050.stderr: -329> 2024-09-14T11:14:52.352+0000 7fcb2c371640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.497 INFO:tasks.workunit.client.0.smithi050.stderr: -328> 2024-09-14T11:14:52.352+0000 7fcb2bb70640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.498 INFO:tasks.workunit.client.0.smithi050.stderr: -327> 2024-09-14T11:14:52.352+0000 7fcb2bb70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.498 INFO:tasks.workunit.client.0.smithi050.stderr: -326> 2024-09-14T11:14:52.352+0000 7fcb2bb70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.498 INFO:tasks.workunit.client.0.smithi050.stderr: -325> 2024-09-14T11:14:52.352+0000 7fcb2c371640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.498 INFO:tasks.workunit.client.0.smithi050.stderr: -324> 2024-09-14T11:14:52.352+0000 7fcb2c371640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.498 INFO:tasks.workunit.client.0.smithi050.stderr: -323> 2024-09-14T11:14:52.352+0000 7fcb2c371640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.498 INFO:tasks.workunit.client.0.smithi050.stderr: -322> 2024-09-14T11:14:52.352+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_done global_id 7760 payload 824 2024-09-14T11:14:52.498 INFO:tasks.workunit.client.0.smithi050.stderr: -321> 2024-09-14T11:14:52.352+0000 7fcb2cb72640 10 monclient: _finish_hunting 0 2024-09-14T11:14:52.498 INFO:tasks.workunit.client.0.smithi050.stderr: -320> 2024-09-14T11:14:52.352+0000 7fcb2cb72640 1 monclient: found mon.noname-c 2024-09-14T11:14:52.498 INFO:tasks.workunit.client.0.smithi050.stderr: -319> 2024-09-14T11:14:52.352+0000 7fcb2cb72640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:14:52.498 INFO:tasks.workunit.client.0.smithi050.stderr: -318> 2024-09-14T11:14:52.352+0000 7fca11ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.498 INFO:tasks.workunit.client.0.smithi050.stderr: -317> 2024-09-14T11:14:52.352+0000 7fca11ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:52.498 INFO:tasks.workunit.client.0.smithi050.stderr: -316> 2024-09-14T11:14:52.352+0000 7fca11ffb640 10 monclient: dump: 2024-09-14T11:14:52.498 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:52.498 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:52.498 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.498 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.499 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.499 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.499 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:52.499 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:52.499 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:52.499 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.499 INFO:tasks.workunit.client.0.smithi050.stderr: -315> 2024-09-14T11:14:52.352+0000 7fca11ffb640 10 monclient: _finish_auth 0 2024-09-14T11:14:52.499 INFO:tasks.workunit.client.0.smithi050.stderr: -314> 2024-09-14T11:14:52.352+0000 7fca11ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:14:52.499 INFO:tasks.workunit.client.0.smithi050.stderr: -313> 2024-09-14T11:14:52.352+0000 7fca11ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:52.499 INFO:tasks.workunit.client.0.smithi050.stderr: -312> 2024-09-14T11:14:52.352+0000 7fca11ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.499 INFO:tasks.workunit.client.0.smithi050.stderr: -311> 2024-09-14T11:14:52.352+0000 7fca11ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:52.499 INFO:tasks.workunit.client.0.smithi050.stderr: -310> 2024-09-14T11:14:52.352+0000 7fca11ffb640 10 monclient: dump: 2024-09-14T11:14:52.499 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:52.499 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:52.499 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.499 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.500 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.500 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.500 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:52.500 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:52.500 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:52.500 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.500 INFO:tasks.workunit.client.0.smithi050.stderr: -309> 2024-09-14T11:14:52.352+0000 7fcb2e887800 5 monclient: authenticate success, global_id 7760 2024-09-14T11:14:52.500 INFO:tasks.workunit.client.0.smithi050.stderr: -308> 2024-09-14T11:14:52.353+0000 7fcb2e887800 10 monclient: _renew_subs 2024-09-14T11:14:52.500 INFO:tasks.workunit.client.0.smithi050.stderr: -307> 2024-09-14T11:14:52.352+0000 7fcb2d373640 4 set_mon_vals no callback set 2024-09-14T11:14:52.500 INFO:tasks.workunit.client.0.smithi050.stderr: -306> 2024-09-14T11:14:52.353+0000 7fcb2e887800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:52.500 INFO:tasks.workunit.client.0.smithi050.stderr: -305> 2024-09-14T11:14:52.353+0000 7fcb2e887800 10 monclient: _renew_subs 2024-09-14T11:14:52.500 INFO:tasks.workunit.client.0.smithi050.stderr: -304> 2024-09-14T11:14:52.353+0000 7fcb2e887800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:52.500 INFO:tasks.workunit.client.0.smithi050.stderr: -303> 2024-09-14T11:14:52.354+0000 7fca11ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:14:52.500 INFO:tasks.workunit.client.0.smithi050.stderr: -302> 2024-09-14T11:14:52.354+0000 7fca11ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:14:52.500 INFO:tasks.workunit.client.0.smithi050.stderr: -301> 2024-09-14T11:14:52.354+0000 7fca11ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:14:52.501 INFO:tasks.workunit.client.0.smithi050.stderr: -300> 2024-09-14T11:14:52.355+0000 7fcb2c371640 10 monclient: get_auth_request con 0x7fca04077140 auth_method 0 2024-09-14T11:14:52.501 INFO:tasks.workunit.client.0.smithi050.stderr: -299> 2024-09-14T11:14:52.355+0000 7fcb2e887800 10 monclient: get_monmap_and_config 2024-09-14T11:14:52.501 INFO:tasks.workunit.client.0.smithi050.stderr: -298> 2024-09-14T11:14:52.355+0000 7fcb2e887800 10 monclient: build_initial_monmap 2024-09-14T11:14:52.501 INFO:tasks.workunit.client.0.smithi050.stderr: -297> 2024-09-14T11:14:52.355+0000 7fcb2e887800 1 build_initial for_mkfs: 0 2024-09-14T11:14:52.501 INFO:tasks.workunit.client.0.smithi050.stderr: -296> 2024-09-14T11:14:52.355+0000 7fcb2e887800 10 monclient: monmap: 2024-09-14T11:14:52.501 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:14:52.501 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:52.501 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:14:52.501 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:14:52.501 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:52.501 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.501 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:14:52.501 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:14:52.501 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:14:52.502 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.502 INFO:tasks.workunit.client.0.smithi050.stderr: -295> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding auth protocol: cephx 2024-09-14T11:14:52.502 INFO:tasks.workunit.client.0.smithi050.stderr: -294> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding auth protocol: cephx 2024-09-14T11:14:52.502 INFO:tasks.workunit.client.0.smithi050.stderr: -293> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding auth protocol: cephx 2024-09-14T11:14:52.502 INFO:tasks.workunit.client.0.smithi050.stderr: -292> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding con mode: secure 2024-09-14T11:14:52.502 INFO:tasks.workunit.client.0.smithi050.stderr: -291> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding con mode: crc 2024-09-14T11:14:52.502 INFO:tasks.workunit.client.0.smithi050.stderr: -290> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding con mode: secure 2024-09-14T11:14:52.502 INFO:tasks.workunit.client.0.smithi050.stderr: -289> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding con mode: crc 2024-09-14T11:14:52.502 INFO:tasks.workunit.client.0.smithi050.stderr: -288> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding con mode: secure 2024-09-14T11:14:52.502 INFO:tasks.workunit.client.0.smithi050.stderr: -287> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding con mode: crc 2024-09-14T11:14:52.502 INFO:tasks.workunit.client.0.smithi050.stderr: -286> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding con mode: crc 2024-09-14T11:14:52.502 INFO:tasks.workunit.client.0.smithi050.stderr: -285> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding con mode: secure 2024-09-14T11:14:52.502 INFO:tasks.workunit.client.0.smithi050.stderr: -284> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding con mode: crc 2024-09-14T11:14:52.502 INFO:tasks.workunit.client.0.smithi050.stderr: -283> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding con mode: secure 2024-09-14T11:14:52.502 INFO:tasks.workunit.client.0.smithi050.stderr: -282> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding con mode: crc 2024-09-14T11:14:52.503 INFO:tasks.workunit.client.0.smithi050.stderr: -281> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x55cca394d680) adding con mode: secure 2024-09-14T11:14:52.503 INFO:tasks.workunit.client.0.smithi050.stderr: -280> 2024-09-14T11:14:52.355+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.503 INFO:tasks.workunit.client.0.smithi050.stderr: -279> 2024-09-14T11:14:52.355+0000 7fcb2e887800 10 monclient: init 2024-09-14T11:14:52.503 INFO:tasks.workunit.client.0.smithi050.stderr: -278> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding auth protocol: cephx 2024-09-14T11:14:52.503 INFO:tasks.workunit.client.0.smithi050.stderr: -277> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding auth protocol: cephx 2024-09-14T11:14:52.503 INFO:tasks.workunit.client.0.smithi050.stderr: -276> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding auth protocol: cephx 2024-09-14T11:14:52.503 INFO:tasks.workunit.client.0.smithi050.stderr: -275> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding con mode: secure 2024-09-14T11:14:52.503 INFO:tasks.workunit.client.0.smithi050.stderr: -274> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding con mode: crc 2024-09-14T11:14:52.503 INFO:tasks.workunit.client.0.smithi050.stderr: -273> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding con mode: secure 2024-09-14T11:14:52.503 INFO:tasks.workunit.client.0.smithi050.stderr: -272> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding con mode: crc 2024-09-14T11:14:52.503 INFO:tasks.workunit.client.0.smithi050.stderr: -271> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding con mode: secure 2024-09-14T11:14:52.503 INFO:tasks.workunit.client.0.smithi050.stderr: -270> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding con mode: crc 2024-09-14T11:14:52.503 INFO:tasks.workunit.client.0.smithi050.stderr: -269> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding con mode: crc 2024-09-14T11:14:52.503 INFO:tasks.workunit.client.0.smithi050.stderr: -268> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding con mode: secure 2024-09-14T11:14:52.503 INFO:tasks.workunit.client.0.smithi050.stderr: -267> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding con mode: crc 2024-09-14T11:14:52.504 INFO:tasks.workunit.client.0.smithi050.stderr: -266> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding con mode: secure 2024-09-14T11:14:52.504 INFO:tasks.workunit.client.0.smithi050.stderr: -265> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding con mode: crc 2024-09-14T11:14:52.504 INFO:tasks.workunit.client.0.smithi050.stderr: -264> 2024-09-14T11:14:52.355+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29280) adding con mode: secure 2024-09-14T11:14:52.504 INFO:tasks.workunit.client.0.smithi050.stderr: -263> 2024-09-14T11:14:52.355+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.504 INFO:tasks.workunit.client.0.smithi050.stderr: -262> 2024-09-14T11:14:52.356+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.504 INFO:tasks.workunit.client.0.smithi050.stderr: -261> 2024-09-14T11:14:52.356+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command rotate-key cmddesc rotate-key hook 0x7ffeb9d293c8 EEXIST 2024-09-14T11:14:52.504 INFO:tasks.workunit.client.0.smithi050.stderr: -260> 2024-09-14T11:14:52.356+0000 7fcb2e887800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:52.504 INFO:tasks.workunit.client.0.smithi050.stderr: -259> 2024-09-14T11:14:52.356+0000 7fcb2e887800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:14:52.504 INFO:tasks.workunit.client.0.smithi050.stderr: -258> 2024-09-14T11:14:52.356+0000 7fcb2e887800 10 monclient(hunting): picked mon.noname-a con 0x55cca3981ce0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:14:52.504 INFO:tasks.workunit.client.0.smithi050.stderr: -257> 2024-09-14T11:14:52.356+0000 7fcb2e887800 10 monclient(hunting): picked mon.noname-b con 0x55cca3952cf0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:14:52.504 INFO:tasks.workunit.client.0.smithi050.stderr: -256> 2024-09-14T11:14:52.356+0000 7fcb2e887800 10 monclient(hunting): picked mon.noname-c con 0x55cca397d1c0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:14:52.504 INFO:tasks.workunit.client.0.smithi050.stderr: -255> 2024-09-14T11:14:52.356+0000 7fcb2e887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.504 INFO:tasks.workunit.client.0.smithi050.stderr: -254> 2024-09-14T11:14:52.356+0000 7fcb2e887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.504 INFO:tasks.workunit.client.0.smithi050.stderr: -253> 2024-09-14T11:14:52.356+0000 7fcb2e887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.504 INFO:tasks.workunit.client.0.smithi050.stderr: -252> 2024-09-14T11:14:52.356+0000 7fcb2e887800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:52.504 INFO:tasks.workunit.client.0.smithi050.stderr: -251> 2024-09-14T11:14:52.356+0000 7fcb2e887800 10 monclient(hunting): authenticate will time out at 2544.994282s 2024-09-14T11:14:52.505 INFO:tasks.workunit.client.0.smithi050.stderr: -250> 2024-09-14T11:14:52.356+0000 7fcb2cb72640 10 monclient(hunting): get_auth_request con 0x55cca397d1c0 auth_method 0 2024-09-14T11:14:52.505 INFO:tasks.workunit.client.0.smithi050.stderr: -249> 2024-09-14T11:14:52.356+0000 7fcb2cb72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.505 INFO:tasks.workunit.client.0.smithi050.stderr: -248> 2024-09-14T11:14:52.356+0000 7fcb2cb72640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.505 INFO:tasks.workunit.client.0.smithi050.stderr: -247> 2024-09-14T11:14:52.356+0000 7fcb2cb72640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.505 INFO:tasks.workunit.client.0.smithi050.stderr: -246> 2024-09-14T11:14:52.356+0000 7fcb2c371640 10 monclient(hunting): get_auth_request con 0x55cca3981ce0 auth_method 0 2024-09-14T11:14:52.505 INFO:tasks.workunit.client.0.smithi050.stderr: -245> 2024-09-14T11:14:52.356+0000 7fcb2c371640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.505 INFO:tasks.workunit.client.0.smithi050.stderr: -244> 2024-09-14T11:14:52.356+0000 7fcb2c371640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.505 INFO:tasks.workunit.client.0.smithi050.stderr: -243> 2024-09-14T11:14:52.356+0000 7fcb2c371640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.505 INFO:tasks.workunit.client.0.smithi050.stderr: -242> 2024-09-14T11:14:52.356+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.505 INFO:tasks.workunit.client.0.smithi050.stderr: -241> 2024-09-14T11:14:52.356+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.505 INFO:tasks.workunit.client.0.smithi050.stderr: -240> 2024-09-14T11:14:52.356+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.505 INFO:tasks.workunit.client.0.smithi050.stderr: -239> 2024-09-14T11:14:52.356+0000 7fcb2c371640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.505 INFO:tasks.workunit.client.0.smithi050.stderr: -238> 2024-09-14T11:14:52.356+0000 7fcb2c371640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.505 INFO:tasks.workunit.client.0.smithi050.stderr: -237> 2024-09-14T11:14:52.356+0000 7fcb2c371640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.505 INFO:tasks.workunit.client.0.smithi050.stderr: -236> 2024-09-14T11:14:52.356+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_done global_id 7763 payload 274 2024-09-14T11:14:52.506 INFO:tasks.workunit.client.0.smithi050.stderr: -235> 2024-09-14T11:14:52.356+0000 7fcb2cb72640 10 monclient: _finish_hunting 0 2024-09-14T11:14:52.506 INFO:tasks.workunit.client.0.smithi050.stderr: -234> 2024-09-14T11:14:52.356+0000 7fcb2cb72640 1 monclient: found mon.noname-c 2024-09-14T11:14:52.506 INFO:tasks.workunit.client.0.smithi050.stderr: -233> 2024-09-14T11:14:52.356+0000 7fcb2cb72640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:14:52.506 INFO:tasks.workunit.client.0.smithi050.stderr: -232> 2024-09-14T11:14:52.356+0000 7fcb2bb70640 10 monclient: get_auth_request con 0x55cca3952cf0 auth_method 0 2024-09-14T11:14:52.506 INFO:tasks.workunit.client.0.smithi050.stderr: -231> 2024-09-14T11:14:52.356+0000 7fca037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.506 INFO:tasks.workunit.client.0.smithi050.stderr: -230> 2024-09-14T11:14:52.356+0000 7fca037fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:52.506 INFO:tasks.workunit.client.0.smithi050.stderr: -229> 2024-09-14T11:14:52.356+0000 7fca037fe640 10 monclient: dump: 2024-09-14T11:14:52.506 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:52.506 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:52.506 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.506 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.506 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.506 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.506 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:52.506 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:52.507 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:52.507 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.507 INFO:tasks.workunit.client.0.smithi050.stderr: -228> 2024-09-14T11:14:52.356+0000 7fca037fe640 10 monclient: _finish_auth 0 2024-09-14T11:14:52.507 INFO:tasks.workunit.client.0.smithi050.stderr: -227> 2024-09-14T11:14:52.356+0000 7fca037fe640 10 monclient: _check_auth_tickets 2024-09-14T11:14:52.507 INFO:tasks.workunit.client.0.smithi050.stderr: -226> 2024-09-14T11:14:52.356+0000 7fca037fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:52.507 INFO:tasks.workunit.client.0.smithi050.stderr: -225> 2024-09-14T11:14:52.356+0000 7fca037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.507 INFO:tasks.workunit.client.0.smithi050.stderr: -224> 2024-09-14T11:14:52.356+0000 7fca037fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:52.507 INFO:tasks.workunit.client.0.smithi050.stderr: -223> 2024-09-14T11:14:52.356+0000 7fca037fe640 10 monclient: dump: 2024-09-14T11:14:52.507 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:52.507 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:52.507 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.507 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.507 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.507 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.507 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:52.508 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:52.508 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:52.508 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.508 INFO:tasks.workunit.client.0.smithi050.stderr: -222> 2024-09-14T11:14:52.356+0000 7fcb2e887800 5 monclient: authenticate success, global_id 7763 2024-09-14T11:14:52.508 INFO:tasks.workunit.client.0.smithi050.stderr: -221> 2024-09-14T11:14:52.356+0000 7fcb2e887800 10 monclient: get_monmap_and_config success 2024-09-14T11:14:52.508 INFO:tasks.workunit.client.0.smithi050.stderr: -220> 2024-09-14T11:14:52.356+0000 7fcb2e887800 4 set_mon_vals no callback set 2024-09-14T11:14:52.508 INFO:tasks.workunit.client.0.smithi050.stderr: -219> 2024-09-14T11:14:52.357+0000 7fcb2e887800 10 monclient: shutdown 2024-09-14T11:14:52.508 INFO:tasks.workunit.client.0.smithi050.stderr: -218> 2024-09-14T11:14:52.357+0000 7fcb2e887800 10 monclient: build_initial_monmap 2024-09-14T11:14:52.508 INFO:tasks.workunit.client.0.smithi050.stderr: -217> 2024-09-14T11:14:52.357+0000 7fcb2e887800 1 build_initial for_mkfs: 0 2024-09-14T11:14:52.508 INFO:tasks.workunit.client.0.smithi050.stderr: -216> 2024-09-14T11:14:52.357+0000 7fcb2e887800 10 monclient: monmap: 2024-09-14T11:14:52.508 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:14:52.508 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:52.508 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:14:52.508 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:14:52.508 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:52.508 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.509 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:14:52.509 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:14:52.509 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:14:52.509 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.509 INFO:tasks.workunit.client.0.smithi050.stderr: -215> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding auth protocol: cephx 2024-09-14T11:14:52.509 INFO:tasks.workunit.client.0.smithi050.stderr: -214> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding auth protocol: cephx 2024-09-14T11:14:52.509 INFO:tasks.workunit.client.0.smithi050.stderr: -213> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding auth protocol: cephx 2024-09-14T11:14:52.509 INFO:tasks.workunit.client.0.smithi050.stderr: -212> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding con mode: secure 2024-09-14T11:14:52.509 INFO:tasks.workunit.client.0.smithi050.stderr: -211> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding con mode: crc 2024-09-14T11:14:52.509 INFO:tasks.workunit.client.0.smithi050.stderr: -210> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding con mode: secure 2024-09-14T11:14:52.509 INFO:tasks.workunit.client.0.smithi050.stderr: -209> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding con mode: crc 2024-09-14T11:14:52.509 INFO:tasks.workunit.client.0.smithi050.stderr: -208> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding con mode: secure 2024-09-14T11:14:52.509 INFO:tasks.workunit.client.0.smithi050.stderr: -207> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding con mode: crc 2024-09-14T11:14:52.509 INFO:tasks.workunit.client.0.smithi050.stderr: -206> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding con mode: crc 2024-09-14T11:14:52.510 INFO:tasks.workunit.client.0.smithi050.stderr: -205> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding con mode: secure 2024-09-14T11:14:52.510 INFO:tasks.workunit.client.0.smithi050.stderr: -204> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding con mode: crc 2024-09-14T11:14:52.510 INFO:tasks.workunit.client.0.smithi050.stderr: -203> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding con mode: secure 2024-09-14T11:14:52.510 INFO:tasks.workunit.client.0.smithi050.stderr: -202> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding con mode: crc 2024-09-14T11:14:52.510 INFO:tasks.workunit.client.0.smithi050.stderr: -201> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 AuthRegistry(0x55cca397dda0) adding con mode: secure 2024-09-14T11:14:52.510 INFO:tasks.workunit.client.0.smithi050.stderr: -200> 2024-09-14T11:14:52.357+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.510 INFO:tasks.workunit.client.0.smithi050.stderr: -199> 2024-09-14T11:14:52.357+0000 7fcb2e887800 1 librados: starting msgr at 2024-09-14T11:14:52.510 INFO:tasks.workunit.client.0.smithi050.stderr: -198> 2024-09-14T11:14:52.357+0000 7fcb2e887800 1 librados: starting objecter 2024-09-14T11:14:52.510 INFO:tasks.workunit.client.0.smithi050.stderr: -197> 2024-09-14T11:14:52.357+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command objecter_requests cmddesc objecter_requests hook 0x55cca392f5e0 EEXIST 2024-09-14T11:14:52.510 INFO:tasks.workunit.client.0.smithi050.stderr: -196> 2024-09-14T11:14:52.358+0000 7fcb2e887800 1 librados: setting wanted keys 2024-09-14T11:14:52.510 INFO:tasks.workunit.client.0.smithi050.stderr: -195> 2024-09-14T11:14:52.358+0000 7fcb2e887800 1 librados: calling monclient init 2024-09-14T11:14:52.510 INFO:tasks.workunit.client.0.smithi050.stderr: -194> 2024-09-14T11:14:52.358+0000 7fcb2e887800 10 monclient: init 2024-09-14T11:14:52.510 INFO:tasks.workunit.client.0.smithi050.stderr: -193> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding auth protocol: cephx 2024-09-14T11:14:52.510 INFO:tasks.workunit.client.0.smithi050.stderr: -192> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding auth protocol: cephx 2024-09-14T11:14:52.510 INFO:tasks.workunit.client.0.smithi050.stderr: -191> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding auth protocol: cephx 2024-09-14T11:14:52.511 INFO:tasks.workunit.client.0.smithi050.stderr: -190> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding con mode: secure 2024-09-14T11:14:52.511 INFO:tasks.workunit.client.0.smithi050.stderr: -189> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding con mode: crc 2024-09-14T11:14:52.511 INFO:tasks.workunit.client.0.smithi050.stderr: -188> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding con mode: secure 2024-09-14T11:14:52.511 INFO:tasks.workunit.client.0.smithi050.stderr: -187> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding con mode: crc 2024-09-14T11:14:52.511 INFO:tasks.workunit.client.0.smithi050.stderr: -186> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding con mode: secure 2024-09-14T11:14:52.511 INFO:tasks.workunit.client.0.smithi050.stderr: -185> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding con mode: crc 2024-09-14T11:14:52.511 INFO:tasks.workunit.client.0.smithi050.stderr: -184> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding con mode: crc 2024-09-14T11:14:52.511 INFO:tasks.workunit.client.0.smithi050.stderr: -183> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding con mode: secure 2024-09-14T11:14:52.511 INFO:tasks.workunit.client.0.smithi050.stderr: -182> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding con mode: crc 2024-09-14T11:14:52.511 INFO:tasks.workunit.client.0.smithi050.stderr: -181> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding con mode: secure 2024-09-14T11:14:52.511 INFO:tasks.workunit.client.0.smithi050.stderr: -180> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding con mode: crc 2024-09-14T11:14:52.511 INFO:tasks.workunit.client.0.smithi050.stderr: -179> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 AuthRegistry(0x55cca39420c0) adding con mode: secure 2024-09-14T11:14:52.511 INFO:tasks.workunit.client.0.smithi050.stderr: -178> 2024-09-14T11:14:52.358+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.511 INFO:tasks.workunit.client.0.smithi050.stderr: -177> 2024-09-14T11:14:52.358+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.511 INFO:tasks.workunit.client.0.smithi050.stderr: -176> 2024-09-14T11:14:52.358+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command rotate-key cmddesc rotate-key hook 0x55cca3942208 EEXIST 2024-09-14T11:14:52.512 INFO:tasks.workunit.client.0.smithi050.stderr: -175> 2024-09-14T11:14:52.358+0000 7fcb2e887800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:52.512 INFO:tasks.workunit.client.0.smithi050.stderr: -174> 2024-09-14T11:14:52.358+0000 7fcb2e887800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:14:52.512 INFO:tasks.workunit.client.0.smithi050.stderr: -173> 2024-09-14T11:14:52.358+0000 7fcb2e887800 10 monclient(hunting): picked mon.noname-c con 0x55cca3952cf0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:14:52.512 INFO:tasks.workunit.client.0.smithi050.stderr: -172> 2024-09-14T11:14:52.358+0000 7fcb2e887800 10 monclient(hunting): picked mon.noname-b con 0x55cca397d1c0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:14:52.512 INFO:tasks.workunit.client.0.smithi050.stderr: -171> 2024-09-14T11:14:52.358+0000 7fcb2e887800 10 monclient(hunting): picked mon.noname-a con 0x55cca3981ce0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:14:52.512 INFO:tasks.workunit.client.0.smithi050.stderr: -170> 2024-09-14T11:14:52.358+0000 7fcb2e887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.512 INFO:tasks.workunit.client.0.smithi050.stderr: -169> 2024-09-14T11:14:52.358+0000 7fcb2e887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.512 INFO:tasks.workunit.client.0.smithi050.stderr: -168> 2024-09-14T11:14:52.358+0000 7fcb2e887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.512 INFO:tasks.workunit.client.0.smithi050.stderr: -167> 2024-09-14T11:14:52.358+0000 7fcb2e887800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:52.512 INFO:tasks.workunit.client.0.smithi050.stderr: -166> 2024-09-14T11:14:52.358+0000 7fcb2e887800 10 monclient(hunting): authenticate will time out at 2544.996613s 2024-09-14T11:14:52.512 INFO:tasks.workunit.client.0.smithi050.stderr: -165> 2024-09-14T11:14:52.358+0000 7fcb2c371640 10 monclient(hunting): get_auth_request con 0x55cca3952cf0 auth_method 0 2024-09-14T11:14:52.512 INFO:tasks.workunit.client.0.smithi050.stderr: -164> 2024-09-14T11:14:52.358+0000 7fcb2c371640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.512 INFO:tasks.workunit.client.0.smithi050.stderr: -163> 2024-09-14T11:14:52.358+0000 7fcb2c371640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.512 INFO:tasks.workunit.client.0.smithi050.stderr: -162> 2024-09-14T11:14:52.358+0000 7fcb2c371640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.512 INFO:tasks.workunit.client.0.smithi050.stderr: -161> 2024-09-14T11:14:52.358+0000 7fcb2cb72640 10 monclient(hunting): get_auth_request con 0x55cca3981ce0 auth_method 0 2024-09-14T11:14:52.513 INFO:tasks.workunit.client.0.smithi050.stderr: -160> 2024-09-14T11:14:52.358+0000 7fcb2cb72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.513 INFO:tasks.workunit.client.0.smithi050.stderr: -159> 2024-09-14T11:14:52.358+0000 7fcb2cb72640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.513 INFO:tasks.workunit.client.0.smithi050.stderr: -158> 2024-09-14T11:14:52.358+0000 7fcb2cb72640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.513 INFO:tasks.workunit.client.0.smithi050.stderr: -157> 2024-09-14T11:14:52.358+0000 7fcb2c371640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.513 INFO:tasks.workunit.client.0.smithi050.stderr: -156> 2024-09-14T11:14:52.358+0000 7fcb2c371640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.513 INFO:tasks.workunit.client.0.smithi050.stderr: -155> 2024-09-14T11:14:52.358+0000 7fcb2c371640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.513 INFO:tasks.workunit.client.0.smithi050.stderr: -154> 2024-09-14T11:14:52.358+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.513 INFO:tasks.workunit.client.0.smithi050.stderr: -153> 2024-09-14T11:14:52.358+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.513 INFO:tasks.workunit.client.0.smithi050.stderr: -152> 2024-09-14T11:14:52.358+0000 7fcb2cb72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.513 INFO:tasks.workunit.client.0.smithi050.stderr: -151> 2024-09-14T11:14:52.358+0000 7fcb2bb70640 10 monclient(hunting): get_auth_request con 0x55cca397d1c0 auth_method 0 2024-09-14T11:14:52.513 INFO:tasks.workunit.client.0.smithi050.stderr: -150> 2024-09-14T11:14:52.358+0000 7fcb2bb70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.513 INFO:tasks.workunit.client.0.smithi050.stderr: -149> 2024-09-14T11:14:52.358+0000 7fcb2bb70640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.513 INFO:tasks.workunit.client.0.smithi050.stderr: -148> 2024-09-14T11:14:52.358+0000 7fcb2bb70640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.513 INFO:tasks.workunit.client.0.smithi050.stderr: -147> 2024-09-14T11:14:52.358+0000 7fcb2c371640 10 monclient(hunting): handle_auth_done global_id 7766 payload 824 2024-09-14T11:14:52.513 INFO:tasks.workunit.client.0.smithi050.stderr: -146> 2024-09-14T11:14:52.358+0000 7fcb2c371640 10 monclient: _finish_hunting 0 2024-09-14T11:14:52.514 INFO:tasks.workunit.client.0.smithi050.stderr: -145> 2024-09-14T11:14:52.358+0000 7fcb2c371640 1 monclient: found mon.noname-c 2024-09-14T11:14:52.514 INFO:tasks.workunit.client.0.smithi050.stderr: -144> 2024-09-14T11:14:52.358+0000 7fcb2c371640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:14:52.514 INFO:tasks.workunit.client.0.smithi050.stderr: -143> 2024-09-14T11:14:52.359+0000 7fca01ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.514 INFO:tasks.workunit.client.0.smithi050.stderr: -142> 2024-09-14T11:14:52.359+0000 7fca01ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:52.514 INFO:tasks.workunit.client.0.smithi050.stderr: -141> 2024-09-14T11:14:52.359+0000 7fca01ffb640 10 monclient: dump: 2024-09-14T11:14:52.514 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:52.514 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:52.514 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.514 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.514 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.514 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.514 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:52.514 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:52.514 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:52.514 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.514 INFO:tasks.workunit.client.0.smithi050.stderr: -140> 2024-09-14T11:14:52.359+0000 7fca01ffb640 10 monclient: _finish_auth 0 2024-09-14T11:14:52.515 INFO:tasks.workunit.client.0.smithi050.stderr: -139> 2024-09-14T11:14:52.359+0000 7fca01ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:14:52.515 INFO:tasks.workunit.client.0.smithi050.stderr: -138> 2024-09-14T11:14:52.359+0000 7fca01ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:52.515 INFO:tasks.workunit.client.0.smithi050.stderr: -137> 2024-09-14T11:14:52.359+0000 7fca01ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.515 INFO:tasks.workunit.client.0.smithi050.stderr: -136> 2024-09-14T11:14:52.359+0000 7fca01ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:52.515 INFO:tasks.workunit.client.0.smithi050.stderr: -135> 2024-09-14T11:14:52.359+0000 7fca01ffb640 10 monclient: dump: 2024-09-14T11:14:52.515 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:14:52.515 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:14:52.515 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.515 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:14:52.515 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.515 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:14:52.515 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:14:52.515 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:14:52.515 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:14:52.515 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.516 INFO:tasks.workunit.client.0.smithi050.stderr: -134> 2024-09-14T11:14:52.359+0000 7fca037fe640 4 set_mon_vals no callback set 2024-09-14T11:14:52.516 INFO:tasks.workunit.client.0.smithi050.stderr: -133> 2024-09-14T11:14:52.359+0000 7fcb2e887800 5 monclient: authenticate success, global_id 7766 2024-09-14T11:14:52.516 INFO:tasks.workunit.client.0.smithi050.stderr: -132> 2024-09-14T11:14:52.359+0000 7fcb2e887800 10 monclient: _renew_subs 2024-09-14T11:14:52.516 INFO:tasks.workunit.client.0.smithi050.stderr: -131> 2024-09-14T11:14:52.359+0000 7fcb2e887800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:52.516 INFO:tasks.workunit.client.0.smithi050.stderr: -130> 2024-09-14T11:14:52.359+0000 7fcb2e887800 10 monclient: _renew_subs 2024-09-14T11:14:52.516 INFO:tasks.workunit.client.0.smithi050.stderr: -129> 2024-09-14T11:14:52.359+0000 7fcb2e887800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:52.516 INFO:tasks.workunit.client.0.smithi050.stderr: -128> 2024-09-14T11:14:52.359+0000 7fcb2e887800 1 librados: init done 2024-09-14T11:14:52.516 INFO:tasks.workunit.client.0.smithi050.stderr: -127> 2024-09-14T11:14:52.359+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command cr dump hook 0x55cca39790f8 2024-09-14T11:14:52.516 INFO:tasks.workunit.client.0.smithi050.stderr: -126> 2024-09-14T11:14:52.360+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.516 INFO:tasks.workunit.client.0.smithi050.stderr: -125> 2024-09-14T11:14:52.361+0000 7fca01ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:14:52.516 INFO:tasks.workunit.client.0.smithi050.stderr: -124> 2024-09-14T11:14:52.361+0000 7fca01ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:14:52.516 INFO:tasks.workunit.client.0.smithi050.stderr: -123> 2024-09-14T11:14:52.361+0000 7fca01ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:14:52.516 INFO:tasks.workunit.client.0.smithi050.stderr: -122> 2024-09-14T11:14:52.362+0000 7fcb2bb70640 10 monclient: get_auth_request con 0x7fc9f4077260 auth_method 0 2024-09-14T11:14:52.516 INFO:tasks.workunit.client.0.smithi050.stderr: -121> 2024-09-14T11:14:52.362+0000 7fcb2cb72640 10 monclient: get_auth_request con 0x55cca399c810 auth_method 0 2024-09-14T11:14:52.517 INFO:tasks.workunit.client.0.smithi050.stderr: -120> 2024-09-14T11:14:52.362+0000 7fcb2e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.517 INFO:tasks.workunit.client.0.smithi050.stderr: -119> 2024-09-14T11:14:52.362+0000 7fcb2e887800 20 realm 2024-09-14T11:14:52.517 INFO:tasks.workunit.client.0.smithi050.stderr: -118> 2024-09-14T11:14:52.362+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.517 INFO:tasks.workunit.client.0.smithi050.stderr: -117> 2024-09-14T11:14:52.362+0000 7fcb2e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.517 INFO:tasks.workunit.client.0.smithi050.stderr: -116> 2024-09-14T11:14:52.362+0000 7fcb2e887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:52.517 INFO:tasks.workunit.client.0.smithi050.stderr: -115> 2024-09-14T11:14:52.362+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.517 INFO:tasks.workunit.client.0.smithi050.stderr: -114> 2024-09-14T11:14:52.363+0000 7fcb2e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.517 INFO:tasks.workunit.client.0.smithi050.stderr: -113> 2024-09-14T11:14:52.363+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.517 INFO:tasks.workunit.client.0.smithi050.stderr: -112> 2024-09-14T11:14:52.363+0000 7fcb2c371640 10 monclient: get_auth_request con 0x55cca39a0a30 auth_method 0 2024-09-14T11:14:52.517 INFO:tasks.workunit.client.0.smithi050.stderr: -111> 2024-09-14T11:14:52.364+0000 7fcb2e887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:52.517 INFO:tasks.workunit.client.0.smithi050.stderr: -110> 2024-09-14T11:14:52.364+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.517 INFO:tasks.workunit.client.0.smithi050.stderr: -109> 2024-09-14T11:14:52.364+0000 7fcb2bb70640 10 monclient: get_auth_request con 0x55cca39a4290 auth_method 0 2024-09-14T11:14:52.517 INFO:tasks.workunit.client.0.smithi050.stderr: -108> 2024-09-14T11:14:52.364+0000 7fcb2e887800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:52.517 INFO:tasks.workunit.client.0.smithi050.stderr: -107> 2024-09-14T11:14:52.364+0000 7fcb2e887800 20 searching for the correct realm 2024-09-14T11:14:52.518 INFO:tasks.workunit.client.0.smithi050.stderr: -106> 2024-09-14T11:14:52.365+0000 7fcb2cb72640 10 monclient: get_auth_request con 0x55cca39a9050 auth_method 0 2024-09-14T11:14:52.518 INFO:tasks.workunit.client.0.smithi050.stderr: -105> 2024-09-14T11:14:52.365+0000 7fcb2c371640 10 monclient: get_auth_request con 0x7fcb240c5040 auth_method 0 2024-09-14T11:14:52.518 INFO:tasks.workunit.client.0.smithi050.stderr: -104> 2024-09-14T11:14:52.367+0000 7fcb2bb70640 10 monclient: get_auth_request con 0x7fcb24061040 auth_method 0 2024-09-14T11:14:52.518 INFO:tasks.workunit.client.0.smithi050.stderr: -103> 2024-09-14T11:14:52.367+0000 7fcb2bb70640 0 -- 172.21.15.50:0/3522413320 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fcb24061040 msgr2=0x7fcb240df900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:52.518 INFO:tasks.workunit.client.0.smithi050.stderr: -102> 2024-09-14T11:14:52.367+0000 7fca01ffb640 1 client.7766.objecter ms_handle_reset 0x7fcb24061040 session 0x7fcb240df520 osd.5 2024-09-14T11:14:52.518 INFO:tasks.workunit.client.0.smithi050.stderr: -101> 2024-09-14T11:14:52.367+0000 7fca01ffb640 10 monclient: _renew_subs 2024-09-14T11:14:52.518 INFO:tasks.workunit.client.0.smithi050.stderr: -100> 2024-09-14T11:14:52.367+0000 7fca01ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:14:52.518 INFO:tasks.workunit.client.0.smithi050.stderr: -99> 2024-09-14T11:14:52.368+0000 7fcb2bb70640 10 monclient: get_auth_request con 0x7fc9f4087510 auth_method 0 2024-09-14T11:14:52.518 INFO:tasks.workunit.client.0.smithi050.stderr: -98> 2024-09-14T11:14:52.369+0000 7fcb2cb72640 10 monclient: get_auth_request con 0x7fcb1c06d0f0 auth_method 0 2024-09-14T11:14:52.518 INFO:tasks.workunit.client.0.smithi050.stderr: -97> 2024-09-14T11:14:52.370+0000 7fcb2c371640 10 monclient: get_auth_request con 0x7fcb240ad0d0 auth_method 0 2024-09-14T11:14:52.518 INFO:tasks.workunit.client.0.smithi050.stderr: -96> 2024-09-14T11:14:52.371+0000 7fcb2cb72640 0 -- 172.21.15.50:0/3522413320 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55cca399c810 msgr2=0x55cca399ec80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:52.518 INFO:tasks.workunit.client.0.smithi050.stderr: -95> 2024-09-14T11:14:52.371+0000 7fca01ffb640 1 client.7766.objecter ms_handle_reset 0x55cca399c810 session 0x55cca399c140 osd.6 2024-09-14T11:14:52.518 INFO:tasks.workunit.client.0.smithi050.stderr: -94> 2024-09-14T11:14:52.371+0000 7fcb2cb72640 10 monclient: get_auth_request con 0x7fcb24061040 auth_method 0 2024-09-14T11:14:52.518 INFO:tasks.workunit.client.0.smithi050.stderr: -93> 2024-09-14T11:14:52.375+0000 7fcb2e887800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:14:52.518 INFO:tasks.workunit.client.0.smithi050.stderr: -92> 2024-09-14T11:14:52.375+0000 7fcb2e887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:52.519 INFO:tasks.workunit.client.0.smithi050.stderr: -91> 2024-09-14T11:14:52.375+0000 7fcb2e887800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:14:52.519 INFO:tasks.workunit.client.0.smithi050.stderr: -90> 2024-09-14T11:14:52.375+0000 7fcb2e887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:52.519 INFO:tasks.workunit.client.0.smithi050.stderr: -89> 2024-09-14T11:14:52.375+0000 7fcb2e887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:52.519 INFO:tasks.workunit.client.0.smithi050.stderr: -88> 2024-09-14T11:14:52.375+0000 7fcb2e887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:52.519 INFO:tasks.workunit.client.0.smithi050.stderr: -87> 2024-09-14T11:14:52.375+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.519 INFO:tasks.workunit.client.0.smithi050.stderr: -86> 2024-09-14T11:14:52.375+0000 7fcb2e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.519 INFO:tasks.workunit.client.0.smithi050.stderr: -85> 2024-09-14T11:14:52.375+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.519 INFO:tasks.workunit.client.0.smithi050.stderr: -84> 2024-09-14T11:14:52.375+0000 7fcb2e887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:52.519 INFO:tasks.workunit.client.0.smithi050.stderr: -83> 2024-09-14T11:14:52.375+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.519 INFO:tasks.workunit.client.0.smithi050.stderr: -82> 2024-09-14T11:14:52.376+0000 7fcb2e887800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:52.519 INFO:tasks.workunit.client.0.smithi050.stderr: -81> 2024-09-14T11:14:52.376+0000 7fcb2e887800 20 zone default found 2024-09-14T11:14:52.519 INFO:tasks.workunit.client.0.smithi050.stderr: -80> 2024-09-14T11:14:52.376+0000 7fcb2e887800 4 Realm: () 2024-09-14T11:14:52.519 INFO:tasks.workunit.client.0.smithi050.stderr: -79> 2024-09-14T11:14:52.376+0000 7fcb2e887800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:14:52.519 INFO:tasks.workunit.client.0.smithi050.stderr: -78> 2024-09-14T11:14:52.376+0000 7fcb2e887800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:14:52.520 INFO:tasks.workunit.client.0.smithi050.stderr: -77> 2024-09-14T11:14:52.376+0000 7fcb2e887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:52.520 INFO:tasks.workunit.client.0.smithi050.stderr: -76> 2024-09-14T11:14:52.376+0000 7fcb2e887800 20 zonegroup default 2024-09-14T11:14:52.520 INFO:tasks.workunit.client.0.smithi050.stderr: -75> 2024-09-14T11:14:52.376+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.520 INFO:tasks.workunit.client.0.smithi050.stderr: -74> 2024-09-14T11:14:52.376+0000 7fcb2e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.520 INFO:tasks.workunit.client.0.smithi050.stderr: -73> 2024-09-14T11:14:52.376+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.520 INFO:tasks.workunit.client.0.smithi050.stderr: -72> 2024-09-14T11:14:52.376+0000 7fcb2e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.520 INFO:tasks.workunit.client.0.smithi050.stderr: -71> 2024-09-14T11:14:52.376+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.520 INFO:tasks.workunit.client.0.smithi050.stderr: -70> 2024-09-14T11:14:52.376+0000 7fcb2e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.520 INFO:tasks.workunit.client.0.smithi050.stderr: -69> 2024-09-14T11:14:52.376+0000 7fcb2e887800 20 started sync module instance, tier type = 2024-09-14T11:14:52.520 INFO:tasks.workunit.client.0.smithi050.stderr: -68> 2024-09-14T11:14:52.376+0000 7fcb2e887800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:14:52.520 INFO:tasks.workunit.client.0.smithi050.stderr: -67> 2024-09-14T11:14:52.385+0000 7fcb2e887800 20 add_watcher() i=0 2024-09-14T11:14:52.520 INFO:tasks.workunit.client.0.smithi050.stderr: -66> 2024-09-14T11:14:52.385+0000 7fcb2e887800 20 add_watcher() i=1 2024-09-14T11:14:52.520 INFO:tasks.workunit.client.0.smithi050.stderr: -65> 2024-09-14T11:14:52.385+0000 7fcb2e887800 20 add_watcher() i=2 2024-09-14T11:14:52.520 INFO:tasks.workunit.client.0.smithi050.stderr: -64> 2024-09-14T11:14:52.385+0000 7fcb2e887800 20 add_watcher() i=3 2024-09-14T11:14:52.521 INFO:tasks.workunit.client.0.smithi050.stderr: -63> 2024-09-14T11:14:52.385+0000 7fcb2e887800 20 add_watcher() i=4 2024-09-14T11:14:52.521 INFO:tasks.workunit.client.0.smithi050.stderr: -62> 2024-09-14T11:14:52.385+0000 7fcb2e887800 20 add_watcher() i=5 2024-09-14T11:14:52.521 INFO:tasks.workunit.client.0.smithi050.stderr: -61> 2024-09-14T11:14:52.385+0000 7fcb2e887800 20 add_watcher() i=6 2024-09-14T11:14:52.521 INFO:tasks.workunit.client.0.smithi050.stderr: -60> 2024-09-14T11:14:52.386+0000 7fcb2e887800 20 add_watcher() i=7 2024-09-14T11:14:52.521 INFO:tasks.workunit.client.0.smithi050.stderr: -59> 2024-09-14T11:14:52.386+0000 7fcb2e887800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:52.521 INFO:tasks.workunit.client.0.smithi050.stderr: -58> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding auth protocol: cephx 2024-09-14T11:14:52.521 INFO:tasks.workunit.client.0.smithi050.stderr: -57> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding auth protocol: cephx 2024-09-14T11:14:52.521 INFO:tasks.workunit.client.0.smithi050.stderr: -56> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding auth protocol: cephx 2024-09-14T11:14:52.521 INFO:tasks.workunit.client.0.smithi050.stderr: -55> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding con mode: secure 2024-09-14T11:14:52.521 INFO:tasks.workunit.client.0.smithi050.stderr: -54> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding con mode: crc 2024-09-14T11:14:52.521 INFO:tasks.workunit.client.0.smithi050.stderr: -53> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding con mode: secure 2024-09-14T11:14:52.521 INFO:tasks.workunit.client.0.smithi050.stderr: -52> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding con mode: crc 2024-09-14T11:14:52.521 INFO:tasks.workunit.client.0.smithi050.stderr: -51> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding con mode: secure 2024-09-14T11:14:52.521 INFO:tasks.workunit.client.0.smithi050.stderr: -50> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding con mode: crc 2024-09-14T11:14:52.522 INFO:tasks.workunit.client.0.smithi050.stderr: -49> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding con mode: crc 2024-09-14T11:14:52.522 INFO:tasks.workunit.client.0.smithi050.stderr: -48> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding con mode: secure 2024-09-14T11:14:52.522 INFO:tasks.workunit.client.0.smithi050.stderr: -47> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding con mode: crc 2024-09-14T11:14:52.522 INFO:tasks.workunit.client.0.smithi050.stderr: -46> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding con mode: secure 2024-09-14T11:14:52.522 INFO:tasks.workunit.client.0.smithi050.stderr: -45> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding con mode: crc 2024-09-14T11:14:52.522 INFO:tasks.workunit.client.0.smithi050.stderr: -44> 2024-09-14T11:14:52.387+0000 7fcb2e887800 5 AuthRegistry(0x7ffeb9d29760) adding con mode: secure 2024-09-14T11:14:52.522 INFO:tasks.workunit.client.0.smithi050.stderr: -43> 2024-09-14T11:14:52.387+0000 7fc9e2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:52.522 INFO:tasks.workunit.client.0.smithi050.stderr: -42> 2024-09-14T11:14:52.388+0000 7fcb2e887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.522 INFO:tasks.workunit.client.0.smithi050.stderr: -41> 2024-09-14T11:14:52.388+0000 7fcb2e887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:52.522 INFO:tasks.workunit.client.0.smithi050.stderr: -40> 2024-09-14T11:14:52.388+0000 7fcb2e887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:52.522 INFO:tasks.workunit.client.0.smithi050.stderr: -39> 2024-09-14T11:14:52.388+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command cache list hook 0x55cca397b460 2024-09-14T11:14:52.522 INFO:tasks.workunit.client.0.smithi050.stderr: -38> 2024-09-14T11:14:52.388+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command cache inspect hook 0x55cca397b460 2024-09-14T11:14:52.522 INFO:tasks.workunit.client.0.smithi050.stderr: -37> 2024-09-14T11:14:52.388+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command cache erase hook 0x55cca397b460 2024-09-14T11:14:52.522 INFO:tasks.workunit.client.0.smithi050.stderr: -36> 2024-09-14T11:14:52.388+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command cache zap hook 0x55cca397b460 2024-09-14T11:14:52.523 INFO:tasks.workunit.client.0.smithi050.stderr: -35> 2024-09-14T11:14:52.388+0000 7fcb2e887800 5 note: GC not initialized 2024-09-14T11:14:52.523 INFO:tasks.workunit.client.0.smithi050.stderr: -34> 2024-09-14T11:14:52.388+0000 7fc9e1fdb640 20 reqs_thread_entry: start 2024-09-14T11:14:52.523 INFO:tasks.workunit.client.0.smithi050.stderr: -33> 2024-09-14T11:14:52.388+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command sync trace show hook 0x7fcb2001c070 2024-09-14T11:14:52.523 INFO:tasks.workunit.client.0.smithi050.stderr: -32> 2024-09-14T11:14:52.388+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command sync trace history hook 0x7fcb2001c070 2024-09-14T11:14:52.523 INFO:tasks.workunit.client.0.smithi050.stderr: -31> 2024-09-14T11:14:52.388+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command sync trace active hook 0x7fcb2001c070 2024-09-14T11:14:52.523 INFO:tasks.workunit.client.0.smithi050.stderr: -30> 2024-09-14T11:14:52.388+0000 7fcb2e887800 5 asok(0x55cca368e270) register_command sync trace active_short hook 0x7fcb2001c070 2024-09-14T11:14:52.523 INFO:tasks.workunit.client.0.smithi050.stderr: -29> 2024-09-14T11:14:52.388+0000 7fcb2e887800 20 init_complete bucket index max shards: 11 2024-09-14T11:14:52.523 INFO:tasks.workunit.client.0.smithi050.stderr: -28> 2024-09-14T11:14:52.388+0000 7fcb2e887800 20 Filter name: none 2024-09-14T11:14:52.523 INFO:tasks.workunit.client.0.smithi050.stderr: -27> 2024-09-14T11:14:52.388+0000 7fc9537fe640 20 reqs_thread_entry: start 2024-09-14T11:14:52.523 INFO:tasks.workunit.client.0.smithi050.stderr: -26> 2024-09-14T11:14:52.388+0000 7fcb2e887800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:14:52.523 INFO:tasks.workunit.client.0.smithi050.stderr: -25> 2024-09-14T11:14:52.388+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.523 INFO:tasks.workunit.client.0.smithi050.stderr: -24> 2024-09-14T11:14:52.389+0000 7fcb2e887800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:14:52.523 INFO:tasks.workunit.client.0.smithi050.stderr: -23> 2024-09-14T11:14:52.389+0000 7fcb2e887800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:14:52.524 INFO:tasks.workunit.client.0.smithi050.stderr: -22> 2024-09-14T11:14:52.389+0000 7fcb2e887800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:14:52.524 INFO:tasks.workunit.client.0.smithi050.stderr: -21> 2024-09-14T11:14:52.389+0000 7fcb2e887800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : miss 2024-09-14T11:14:52.524 INFO:tasks.workunit.client.0.smithi050.stderr: -20> 2024-09-14T11:14:52.389+0000 7fcb2e887800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.524 INFO:tasks.workunit.client.0.smithi050.stderr: -19> 2024-09-14T11:14:52.389+0000 7fcb2e887800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:14:52.524 INFO:tasks.workunit.client.0.smithi050.stderr: -18> 2024-09-14T11:14:52.389+0000 7fcb2e887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:14:52.524 INFO:tasks.workunit.client.0.smithi050.stderr: -17> 2024-09-14T11:14:52.389+0000 7fcb2e887800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:14:52.524 INFO:tasks.workunit.client.0.smithi050.stderr: -16> 2024-09-14T11:14:52.389+0000 7fcb2e887800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:52.524 INFO:tasks.workunit.client.0.smithi050.stderr: -15> 2024-09-14T11:14:52.389+0000 7fcb2e887800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:14:52.524 INFO:tasks.workunit.client.0.smithi050.stderr: -14> 2024-09-14T11:14:52.389+0000 7fcb2e887800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:14:52.524 INFO:tasks.workunit.client.0.smithi050.stderr: -13> 2024-09-14T11:14:52.395+0000 7fcb2e887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:14:52.524 INFO:tasks.workunit.client.0.smithi050.stderr: -12> 2024-09-14T11:14:52.395+0000 7fcb2e887800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:14:52.524 INFO:tasks.workunit.client.0.smithi050.stderr: -11> 2024-09-14T11:14:52.395+0000 7fcb2e887800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:14:52.524 INFO:tasks.workunit.client.0.smithi050.stderr: -10> 2024-09-14T11:14:52.395+0000 7fcb2e887800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18, ofs0, ns] 2024-09-14T11:14:52.525 INFO:tasks.workunit.client.0.smithi050.stderr: -9> 2024-09-14T11:14:52.396+0000 7fca037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497133 cookie 94337406520512 notifier 7766 bl.length()=911 2024-09-14T11:14:52.525 INFO:tasks.workunit.client.0.smithi050.stderr: -8> 2024-09-14T11:14:52.396+0000 7fca037fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:14:52.525 INFO:tasks.workunit.client.0.smithi050.stderr: -7> 2024-09-14T11:14:52.396+0000 7fca037fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:14:52.525 INFO:tasks.workunit.client.0.smithi050.stderr: -6> 2024-09-14T11:14:52.396+0000 7fca037fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:14:52.525 INFO:tasks.workunit.client.0.smithi050.stderr: -5> 2024-09-14T11:14:52.397+0000 7fcb2e887800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_sources= new_sources= 2024-09-14T11:14:52.525 INFO:tasks.workunit.client.0.smithi050.stderr: -4> 2024-09-14T11:14:52.397+0000 7fcb2e887800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential sources added=[] removed=[] 2024-09-14T11:14:52.525 INFO:tasks.workunit.client.0.smithi050.stderr: -3> 2024-09-14T11:14:52.397+0000 7fcb2e887800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_dests= new_dests= 2024-09-14T11:14:52.525 INFO:tasks.workunit.client.0.smithi050.stderr: -2> 2024-09-14T11:14:52.397+0000 7fcb2e887800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential dests added=[] removed=[] 2024-09-14T11:14:52.525 INFO:tasks.workunit.client.0.smithi050.stderr: -1> 2024-09-14T11:14:52.403+0000 7fcb2e887800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcb2e887800 time 2024-09-14T11:14:52.404105+0000 2024-09-14T11:14:52.525 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:14:52.525 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.525 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:52.525 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcb31d8c76a] 2024-09-14T11:14:52.526 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fcb31d8c928] 2024-09-14T11:14:52.526 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cca1c8f0b1] 2024-09-14T11:14:52.526 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55cca1c9ef6a] 2024-09-14T11:14:52.526 INFO:tasks.workunit.client.0.smithi050.stderr: 5: main() 2024-09-14T11:14:52.526 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fcb30a29590] 2024-09-14T11:14:52.526 INFO:tasks.workunit.client.0.smithi050.stderr: 7: __libc_start_main() 2024-09-14T11:14:52.526 INFO:tasks.workunit.client.0.smithi050.stderr: 8: _start() 2024-09-14T11:14:52.526 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.526 INFO:tasks.workunit.client.0.smithi050.stderr: 0> 2024-09-14T11:14:52.404+0000 7fcb2e887800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:14:52.526 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7fcb2e887800 thread_name:radosgw-admin 2024-09-14T11:14:52.526 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.526 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:52.526 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcb30a3e6f0] 2024-09-14T11:14:52.526 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fcb30a8b99c] 2024-09-14T11:14:52.527 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:14:52.527 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:14:52.527 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcb31d8c7c4] 2024-09-14T11:14:52.527 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fcb31d8c928] 2024-09-14T11:14:52.527 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cca1c8f0b1] 2024-09-14T11:14:52.527 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55cca1c9ef6a] 2024-09-14T11:14:52.527 INFO:tasks.workunit.client.0.smithi050.stderr: 9: main() 2024-09-14T11:14:52.527 INFO:tasks.workunit.client.0.smithi050.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fcb30a29590] 2024-09-14T11:14:52.527 INFO:tasks.workunit.client.0.smithi050.stderr: 11: __libc_start_main() 2024-09-14T11:14:52.527 INFO:tasks.workunit.client.0.smithi050.stderr: 12: _start() 2024-09-14T11:14:52.527 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:14:52.527 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:14:52.527 INFO:tasks.workunit.client.0.smithi050.stderr:--- logging levels --- 2024-09-14T11:14:52.527 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 none 2024-09-14T11:14:52.528 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 lockdep 2024-09-14T11:14:52.528 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 context 2024-09-14T11:14:52.528 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 crush 2024-09-14T11:14:52.528 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds 2024-09-14T11:14:52.528 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_balancer 2024-09-14T11:14:52.528 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_locker 2024-09-14T11:14:52.528 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log 2024-09-14T11:14:52.528 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log_expire 2024-09-14T11:14:52.528 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_migrator 2024-09-14T11:14:52.528 INFO:tasks.workunit.client.0.smithi050.stderr: 3/ 5 mds_quiesce 2024-09-14T11:14:52.528 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 buffer 2024-09-14T11:14:52.528 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 timer 2024-09-14T11:14:52.528 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 filer 2024-09-14T11:14:52.528 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 striper 2024-09-14T11:14:52.529 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 objecter 2024-09-14T11:14:52.529 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rados 2024-09-14T11:14:52.529 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd 2024-09-14T11:14:52.529 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_mirror 2024-09-14T11:14:52.529 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_replay 2024-09-14T11:14:52.529 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_pwl 2024-09-14T11:14:52.529 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 journaler 2024-09-14T11:14:52.529 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objectcacher 2024-09-14T11:14:52.529 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:14:52.529 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 client 2024-09-14T11:14:52.529 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 osd 2024-09-14T11:14:52.529 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 optracker 2024-09-14T11:14:52.529 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objclass 2024-09-14T11:14:52.529 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 filestore 2024-09-14T11:14:52.530 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 journal 2024-09-14T11:14:52.530 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 ms 2024-09-14T11:14:52.530 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mon 2024-09-14T11:14:52.530 INFO:tasks.workunit.client.0.smithi050.stderr: 0/10 monc 2024-09-14T11:14:52.530 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 paxos 2024-09-14T11:14:52.530 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 tp 2024-09-14T11:14:52.530 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 auth 2024-09-14T11:14:52.530 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 crypto 2024-09-14T11:14:52.530 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 finisher 2024-09-14T11:14:52.530 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 reserver 2024-09-14T11:14:52.530 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 heartbeatmap 2024-09-14T11:14:52.530 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 perfcounter 2024-09-14T11:14:52.530 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw 2024-09-14T11:14:52.530 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_sync 2024-09-14T11:14:52.531 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_datacache 2024-09-14T11:14:52.531 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_access 2024-09-14T11:14:52.531 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:14:52.531 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_flight 2024-09-14T11:14:52.531 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:14:52.531 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw_notification 2024-09-14T11:14:52.531 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 javaclient 2024-09-14T11:14:52.531 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 asok 2024-09-14T11:14:52.531 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 throttle 2024-09-14T11:14:52.531 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 refs 2024-09-14T11:14:52.531 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 compressor 2024-09-14T11:14:52.531 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluestore 2024-09-14T11:14:52.531 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluefs 2024-09-14T11:14:52.531 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 bdev 2024-09-14T11:14:52.531 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 kstore 2024-09-14T11:14:52.532 INFO:tasks.workunit.client.0.smithi050.stderr: 4/ 5 rocksdb 2024-09-14T11:14:52.532 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 fuse 2024-09-14T11:14:52.532 INFO:tasks.workunit.client.0.smithi050.stderr: 2/ 5 mgr 2024-09-14T11:14:52.532 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mgrc 2024-09-14T11:14:52.532 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 dpdk 2024-09-14T11:14:52.532 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 eventtrace 2024-09-14T11:14:52.532 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 prioritycache 2024-09-14T11:14:52.532 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 test 2024-09-14T11:14:52.532 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:14:52.532 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephsqlite 2024-09-14T11:14:52.532 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:14:52.532 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore 2024-09-14T11:14:52.532 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_onode 2024-09-14T11:14:52.532 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_odata 2024-09-14T11:14:52.533 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_omap 2024-09-14T11:14:52.533 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_tm 2024-09-14T11:14:52.533 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_t 2024-09-14T11:14:52.533 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:14:52.533 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_epm 2024-09-14T11:14:52.533 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_lba 2024-09-14T11:14:52.533 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:14:52.533 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cache 2024-09-14T11:14:52.533 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_journal 2024-09-14T11:14:52.533 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_device 2024-09-14T11:14:52.533 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_backref 2024-09-14T11:14:52.533 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 alienstore 2024-09-14T11:14:52.533 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mclock 2024-09-14T11:14:52.534 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cyanstore 2024-09-14T11:14:52.534 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 ceph_exporter 2024-09-14T11:14:52.534 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 memstore 2024-09-14T11:14:52.534 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 trace 2024-09-14T11:14:52.534 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 ceph_dedup 2024-09-14T11:14:52.534 INFO:tasks.workunit.client.0.smithi050.stderr: -2/-2 (syslog threshold) 2024-09-14T11:14:52.534 INFO:tasks.workunit.client.0.smithi050.stderr: 99/99 (stderr threshold) 2024-09-14T11:14:52.534 INFO:tasks.workunit.client.0.smithi050.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:14:52.534 INFO:tasks.workunit.client.0.smithi050.stderr: 7fc9537fe640 / http_manager 2024-09-14T11:14:52.534 INFO:tasks.workunit.client.0.smithi050.stderr: 7fc9e1fdb640 / http_manager 2024-09-14T11:14:52.534 INFO:tasks.workunit.client.0.smithi050.stderr: 7fc9e2fdd640 / rgw_dt_lg_renew 2024-09-14T11:14:52.534 INFO:tasks.workunit.client.0.smithi050.stderr: 7fca01ffb640 / ms_dispatch 2024-09-14T11:14:52.534 INFO:tasks.workunit.client.0.smithi050.stderr: 7fca037fe640 / io_context_pool 2024-09-14T11:14:52.534 INFO:tasks.workunit.client.0.smithi050.stderr: 7fca11ffb640 / ms_dispatch 2024-09-14T11:14:52.534 INFO:tasks.workunit.client.0.smithi050.stderr: 7fca18e09640 / ms_dispatch 2024-09-14T11:14:52.535 INFO:tasks.workunit.client.0.smithi050.stderr: 7fca1a60c640 / io_context_pool 2024-09-14T11:14:52.535 INFO:tasks.workunit.client.0.smithi050.stderr: 7fcb2bb70640 / msgr-worker-2 2024-09-14T11:14:52.535 INFO:tasks.workunit.client.0.smithi050.stderr: 7fcb2c371640 / msgr-worker-1 2024-09-14T11:14:52.535 INFO:tasks.workunit.client.0.smithi050.stderr: 7fcb2cb72640 / msgr-worker-0 2024-09-14T11:14:52.535 INFO:tasks.workunit.client.0.smithi050.stderr: 7fcb2d373640 / io_context_pool 2024-09-14T11:14:52.535 INFO:tasks.workunit.client.0.smithi050.stderr: 7fcb2e887800 / radosgw-admin 2024-09-14T11:14:52.535 INFO:tasks.workunit.client.0.smithi050.stderr: max_recent 500 2024-09-14T11:14:52.535 INFO:tasks.workunit.client.0.smithi050.stderr: max_new 1000 2024-09-14T11:14:52.535 INFO:tasks.workunit.client.0.smithi050.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:14:52.405522Z_791f71a3-1f78-4b0c-9af5-d10340af1273/log 2024-09-14T11:14:52.535 INFO:tasks.workunit.client.0.smithi050.stderr:--- end dump of recent events --- 2024-09-14T11:14:52.535 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:14:52.536 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:52.536 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:52.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.481+0000 7f6889b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.483+0000 7f6889b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.483+0000 7f6889b2a800 20 realm 2024-09-14T11:14:52.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.483+0000 7f6889b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.483+0000 7f6889b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.483+0000 7f6889b2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:52.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.483+0000 7f6889b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.484+0000 7f6889b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.484+0000 7f6889b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.484+0000 7f6889b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:52.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.484+0000 7f6889b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.485+0000 7f6889b2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:52.537 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.485+0000 7f6889b2a800 20 searching for the correct realm 2024-09-14T11:14:52.538 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:52.488+0000 7f688504e640 0 -- 172.21.15.50:0/264767733 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f6880086040 msgr2=0x7f6880086420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:53.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:53.295+0000 7f688584f640 0 -- 172.21.15.50:0/264767733 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f6880062920 msgr2=0x7f68800853b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:54.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.104+0000 7f6889b2a800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:14:54.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.104+0000 7f6889b2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:54.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.104+0000 7f6889b2a800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:14:54.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.104+0000 7f6889b2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:54.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.104+0000 7f6889b2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:54.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.104+0000 7f6889b2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:54.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.104+0000 7f6889b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:54.104 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.104+0000 7f6889b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:54.105 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.105+0000 7f6889b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:54.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.105+0000 7f6889b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:54.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.105+0000 7f6889b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:54.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.105+0000 7f6889b2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:54.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.105+0000 7f6889b2a800 20 zone default found 2024-09-14T11:14:54.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.105+0000 7f6889b2a800 4 Realm: () 2024-09-14T11:14:54.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.105+0000 7f6889b2a800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:14:54.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.105+0000 7f6889b2a800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:14:54.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.105+0000 7f6889b2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:54.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.105+0000 7f6889b2a800 20 zonegroup default 2024-09-14T11:14:54.106 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.105+0000 7f6889b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:54.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.106+0000 7f6889b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:54.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.106+0000 7f6889b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:54.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.106+0000 7f6889b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:54.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.106+0000 7f6889b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:54.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.107+0000 7f6889b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:54.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.107+0000 7f6889b2a800 20 started sync module instance, tier type = 2024-09-14T11:14:54.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.107+0000 7f6889b2a800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:14:54.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.117+0000 7f6889b2a800 20 add_watcher() i=0 2024-09-14T11:14:54.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.117+0000 7f6889b2a800 20 add_watcher() i=1 2024-09-14T11:14:54.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.117+0000 7f6889b2a800 20 add_watcher() i=2 2024-09-14T11:14:54.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.117+0000 7f6889b2a800 20 add_watcher() i=3 2024-09-14T11:14:54.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.117+0000 7f6889b2a800 20 add_watcher() i=4 2024-09-14T11:14:54.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.117+0000 7f6889b2a800 20 add_watcher() i=5 2024-09-14T11:14:54.117 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.117+0000 7f6889b2a800 20 add_watcher() i=6 2024-09-14T11:14:54.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.119+0000 7f6889b2a800 20 add_watcher() i=7 2024-09-14T11:14:54.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.119+0000 7f6889b2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:54.120 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.121+0000 7f67377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:54.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.121+0000 7f6889b2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:54.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.121+0000 7f6889b2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:54.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.121+0000 7f6889b2a800 5 note: GC not initialized 2024-09-14T11:14:54.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.122+0000 7f67367fc640 20 reqs_thread_entry: start 2024-09-14T11:14:54.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.122+0000 7f6889b2a800 20 init_complete bucket index max shards: 11 2024-09-14T11:14:54.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.122+0000 7f6889b2a800 20 Filter name: none 2024-09-14T11:14:54.121 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.122+0000 7f66a7fff640 20 reqs_thread_entry: start 2024-09-14T11:14:54.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.122+0000 7f6889b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:54.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.122+0000 7f6889b2a800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:14:54.122 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.122+0000 7f6889b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:54.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.123+0000 7f6889b2a800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:14:54.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.123+0000 7f6889b2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:54.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.123+0000 7f6889b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:54.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.123+0000 7f6889b2a800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:14:54.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.123+0000 7f6889b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:54.123 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.124+0000 7f6889b2a800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:14:54.124 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.124+0000 7f6889b2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:54.125 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.126+0000 7f67377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:54.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.129+0000 7f6889b2a800 20 remove_watcher() i=0 2024-09-14T11:14:54.128 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.129+0000 7f6889b2a800 2 removed watcher, disabling cache 2024-09-14T11:14:54.129 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.130+0000 7f6889b2a800 20 remove_watcher() i=1 2024-09-14T11:14:54.130 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.131+0000 7f6889b2a800 20 remove_watcher() i=2 2024-09-14T11:14:54.131 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.132+0000 7f6889b2a800 20 remove_watcher() i=3 2024-09-14T11:14:54.133 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.134+0000 7f6889b2a800 20 remove_watcher() i=4 2024-09-14T11:14:54.134 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.135+0000 7f6889b2a800 20 remove_watcher() i=5 2024-09-14T11:14:54.136 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.137+0000 7f6889b2a800 20 remove_watcher() i=6 2024-09-14T11:14:54.137 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.138+0000 7f6889b2a800 20 remove_watcher() i=7 2024-09-14T11:14:54.153 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:54.153 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:14:54.194 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:14:54.224 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:54.224 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:54.458 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.459+0000 7f8a9a355640 0 --2- 172.21.15.50:0/3474445657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eca3b8aa80 0x55eca3b8e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:14:54.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.469+0000 7f8a9c063800 20 rados->read ofs=0 len=0 2024-09-14T11:14:54.470 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.471+0000 7f8a9c063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:54.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.471+0000 7f8a9c063800 20 realm 2024-09-14T11:14:54.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.471+0000 7f8a9c063800 20 rados->read ofs=0 len=0 2024-09-14T11:14:54.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.471+0000 7f8a9c063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:54.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.471+0000 7f8a9c063800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:54.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.471+0000 7f8a9c063800 20 rados->read ofs=0 len=0 2024-09-14T11:14:54.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.472+0000 7f8a9c063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:54.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.472+0000 7f8a9c063800 20 rados->read ofs=0 len=0 2024-09-14T11:14:54.471 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.472+0000 7f8a9c063800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:54.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.472+0000 7f8a9c063800 20 rados->read ofs=0 len=0 2024-09-14T11:14:54.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.473+0000 7f8a9c063800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:54.472 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.473+0000 7f8a9c063800 20 searching for the correct realm 2024-09-14T11:14:54.473 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.474+0000 7f8a99b54640 0 -- 172.21.15.50:0/3413073590 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x7f8a94068580 msgr2=0x7f8a94066ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:54.680 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.681+0000 7f8a9a355640 0 -- 172.21.15.50:0/3413073590 >> [v2:172.21.15.118:6826/1082138742,v1:172.21.15.118:6827/1082138742] conn(0x7f8a8c08fbe0 msgr2=0x7f8a8c070960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:54.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.890+0000 7f8a9c063800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:14:54.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.890+0000 7f8a9c063800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:54.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.890+0000 7f8a9c063800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:14:54.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.890+0000 7f8a9c063800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:54.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.890+0000 7f8a9c063800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:54.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.890+0000 7f8a9c063800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:54.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.890+0000 7f8a9c063800 20 rados->read ofs=0 len=0 2024-09-14T11:14:54.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.891+0000 7f8a9c063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:54.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.891+0000 7f8a9c063800 20 rados->read ofs=0 len=0 2024-09-14T11:14:54.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.891+0000 7f8a9c063800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:54.891 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.891+0000 7f8a9c063800 20 rados->read ofs=0 len=0 2024-09-14T11:14:54.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.892+0000 7f8a9c063800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:54.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.892+0000 7f8a9c063800 20 zone default found 2024-09-14T11:14:54.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.892+0000 7f8a9c063800 4 Realm: () 2024-09-14T11:14:54.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.892+0000 7f8a9c063800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:14:54.892 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.892+0000 7f8a9c063800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:14:54.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.892+0000 7f8a9c063800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:54.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.892+0000 7f8a9c063800 20 zonegroup default 2024-09-14T11:14:54.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.892+0000 7f8a9c063800 20 rados->read ofs=0 len=0 2024-09-14T11:14:54.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.892+0000 7f8a9c063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:54.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.892+0000 7f8a9c063800 20 rados->read ofs=0 len=0 2024-09-14T11:14:54.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.892+0000 7f8a9c063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:54.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.892+0000 7f8a9c063800 20 rados->read ofs=0 len=0 2024-09-14T11:14:54.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.893+0000 7f8a9c063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:54.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.893+0000 7f8a9c063800 20 started sync module instance, tier type = 2024-09-14T11:14:54.893 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.893+0000 7f8a9c063800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:14:54.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.903+0000 7f8a9c063800 20 add_watcher() i=0 2024-09-14T11:14:54.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.903+0000 7f8a9c063800 20 add_watcher() i=1 2024-09-14T11:14:54.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.903+0000 7f8a9c063800 20 add_watcher() i=2 2024-09-14T11:14:54.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.903+0000 7f8a9c063800 20 add_watcher() i=3 2024-09-14T11:14:54.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.903+0000 7f8a9c063800 20 add_watcher() i=4 2024-09-14T11:14:54.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.903+0000 7f8a9c063800 20 add_watcher() i=5 2024-09-14T11:14:54.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.904+0000 7f8a9c063800 20 add_watcher() i=6 2024-09-14T11:14:54.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.905+0000 7f8a9c063800 20 add_watcher() i=7 2024-09-14T11:14:54.904 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.905+0000 7f8a9c063800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:54.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.906+0000 7f894bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:54.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.907+0000 7f8a9c063800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:54.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.907+0000 7f8a9c063800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:54.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.907+0000 7f8a9c063800 5 note: GC not initialized 2024-09-14T11:14:54.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.907+0000 7f894affd640 20 reqs_thread_entry: start 2024-09-14T11:14:54.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.907+0000 7f8a9c063800 20 init_complete bucket index max shards: 11 2024-09-14T11:14:54.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.907+0000 7f8a9c063800 20 Filter name: none 2024-09-14T11:14:54.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.908+0000 7f8948ff9640 20 reqs_thread_entry: start 2024-09-14T11:14:54.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.908+0000 7f8a9c063800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:14:54.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.908+0000 7f8a9c063800 20 rados->read ofs=0 len=0 2024-09-14T11:14:54.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.908+0000 7f8a9c063800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:14:54.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.908+0000 7f8a9c063800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:14:54.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.908+0000 7f8a9c063800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:14:54.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.908+0000 7f8a9c063800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : miss 2024-09-14T11:14:54.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.908+0000 7f8a9c063800 20 rados->read ofs=0 len=0 2024-09-14T11:14:54.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.909+0000 7f8a9c063800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:14:54.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.909+0000 7f8a9c063800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:14:54.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.909+0000 7f8a9c063800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:14:54.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.909+0000 7f8a9c063800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:54.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.909+0000 7f8a9c063800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:14:54.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.909+0000 7f8a9c063800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:14:54.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.909+0000 7f8a9c063800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:14:54.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.909+0000 7f8a9c063800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:14:54.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.909+0000 7f8a9c063800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:14:54.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.909+0000 7f8a9c063800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:14:54.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.909+0000 7f8a9c063800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:14:54.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.910+0000 7f8a9c063800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:14:54.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.910+0000 7f8a9c063800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:14:54.910 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.910+0000 7f8a9c063800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:14:54.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.910+0000 7f8a9c063800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:14:54.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.910+0000 7f8a9c063800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:14:54.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.911+0000 7f8a9c063800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:14:54.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.911+0000 7f8a9c063800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:14:54.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.911+0000 7f8a9c063800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:14:54.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.911+0000 7f8a9c063800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:14:54.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.912+0000 7f8a9c063800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:14:54.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.912+0000 7f8a9c063800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:14:54.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.912+0000 7f8a9c063800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:14:54.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.912+0000 7f8a9c063800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:14:54.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.913+0000 7f8a9c063800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:14:54.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.913+0000 7f8a9c063800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:14:54.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.913+0000 7f8a9c063800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:14:54.913 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.913+0000 7f8a9c063800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:14:54.913 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.913+0000 7f8a9c063800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:14:54.913 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.913+0000 7f8a9c063800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:14:54.913 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.914+0000 7f8a9c063800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:14:54.913 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.914+0000 7f8a9c063800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:14:54.915 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.916+0000 7f894bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:54.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.918+0000 7f8a9c063800 20 remove_watcher() i=0 2024-09-14T11:14:54.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.918+0000 7f8a9c063800 2 removed watcher, disabling cache 2024-09-14T11:14:54.918 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.919+0000 7f8a9c063800 20 remove_watcher() i=1 2024-09-14T11:14:54.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.920+0000 7f8a9c063800 20 remove_watcher() i=2 2024-09-14T11:14:54.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.921+0000 7f8a9c063800 20 remove_watcher() i=3 2024-09-14T11:14:54.922 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.923+0000 7f8a9c063800 20 remove_watcher() i=4 2024-09-14T11:14:54.923 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.924+0000 7f8a9c063800 20 remove_watcher() i=5 2024-09-14T11:14:54.924 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.925+0000 7f8a9c063800 20 remove_watcher() i=6 2024-09-14T11:14:54.925 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:14:54.926+0000 7f8a9c063800 20 remove_watcher() i=7 2024-09-14T11:15:24.962 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:15:25.004 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:25.004 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:25.050 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.051+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.053+0000 7f60473a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.053+0000 7f60473a2800 20 realm 2024-09-14T11:15:25.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.053+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.053 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.054+0000 7f60473a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.053 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.054+0000 7f60473a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:25.053 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.054+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.053 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.054+0000 7f60473a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.053 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.054+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.054 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.055+0000 7f60473a2800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:25.054 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.055+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.054 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.055+0000 7f60473a2800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:25.054 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.055+0000 7f60473a2800 20 searching for the correct realm 2024-09-14T11:15:25.057 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.058+0000 7f6044e8c640 0 -- 172.21.15.50:0/3504865384 >> [v2:172.21.15.50:6800/2565843969,v1:172.21.15.50:6801/2565843969] conn(0x55e9af6dc6b0 msgr2=0x55e9af6dcb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:25.061 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.062+0000 7f6044e8c640 0 -- 172.21.15.50:0/3504865384 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f6040090400 msgr2=0x7f6040090880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:25.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.270+0000 7f60473a2800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:15:25.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.270+0000 7f60473a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:25.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.270+0000 7f60473a2800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:15:25.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.270+0000 7f60473a2800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:25.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.270+0000 7f60473a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:25.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.270+0000 7f60473a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:25.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.270+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.270+0000 7f60473a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.270+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.271+0000 7f60473a2800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:25.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.271+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.271+0000 7f60473a2800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:25.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.271+0000 7f60473a2800 20 zone default found 2024-09-14T11:15:25.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.271+0000 7f60473a2800 4 Realm: () 2024-09-14T11:15:25.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.271+0000 7f60473a2800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:15:25.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.271+0000 7f60473a2800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:15:25.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.271+0000 7f60473a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:25.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.271+0000 7f60473a2800 20 zonegroup default 2024-09-14T11:15:25.271 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.271+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.271+0000 7f60473a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.272+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.272+0000 7f60473a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.272+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.272+0000 7f60473a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.272+0000 7f60473a2800 20 started sync module instance, tier type = 2024-09-14T11:15:25.272 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.272+0000 7f60473a2800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:15:25.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.282+0000 7f60473a2800 20 add_watcher() i=0 2024-09-14T11:15:25.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.282+0000 7f60473a2800 20 add_watcher() i=1 2024-09-14T11:15:25.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.282+0000 7f60473a2800 20 add_watcher() i=2 2024-09-14T11:15:25.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.282+0000 7f60473a2800 20 add_watcher() i=3 2024-09-14T11:15:25.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.282+0000 7f60473a2800 20 add_watcher() i=4 2024-09-14T11:15:25.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.282+0000 7f60473a2800 20 add_watcher() i=5 2024-09-14T11:15:25.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.282+0000 7f60473a2800 20 add_watcher() i=6 2024-09-14T11:15:25.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.284+0000 7f60473a2800 20 add_watcher() i=7 2024-09-14T11:15:25.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.284+0000 7f60473a2800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:25.285 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.286+0000 7f5efafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:25.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.286+0000 7f60473a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:25.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.286+0000 7f60473a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:25.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.286+0000 7f60473a2800 5 note: GC not initialized 2024-09-14T11:15:25.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.286+0000 7f5ef9fe3640 20 reqs_thread_entry: start 2024-09-14T11:15:25.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.286+0000 7f60473a2800 20 init_complete bucket index max shards: 11 2024-09-14T11:15:25.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.287+0000 7f60473a2800 20 Filter name: none 2024-09-14T11:15:25.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.287+0000 7f5e6b7fe640 20 reqs_thread_entry: start 2024-09-14T11:15:25.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.287+0000 7f60473a2800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:15:25.286 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.287+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.287+0000 7f60473a2800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:15:25.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.287+0000 7f60473a2800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:15:25.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.287+0000 7f60473a2800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:15:25.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.287+0000 7f60473a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : miss 2024-09-14T11:15:25.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.287+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.288+0000 7f60473a2800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:15:25.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.288+0000 7f60473a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:15:25.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.288+0000 7f60473a2800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:15:25.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.288+0000 7f60473a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:25.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.288+0000 7f60473a2800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:25.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.288+0000 7f60473a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:15:25.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.289+0000 7f60473a2800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:15:25.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.297+0000 7f60473a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:15:25.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.297+0000 7f60473a2800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:15:25.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.297+0000 7f60473a2800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:25.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.297+0000 7f60473a2800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18, ofs0, ns] 2024-09-14T11:15:25.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.298+0000 7f5f1bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497134 cookie 94462159002096 notifier 8385 bl.length()=911 2024-09-14T11:15:25.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.298+0000 7f5f1bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:15:25.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.298+0000 7f5f1bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:15:25.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.298+0000 7f5f1bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:25.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.299+0000 7f60473a2800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_sources= new_sources= 2024-09-14T11:15:25.298 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.299+0000 7f60473a2800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential sources added=[] removed=[] 2024-09-14T11:15:25.299 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.299+0000 7f60473a2800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_dests= new_dests= 2024-09-14T11:15:25.299 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.299+0000 7f60473a2800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential dests added=[] removed=[] 2024-09-14T11:15:25.302 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f60473a2800 time 2024-09-14T11:15:25.304878+0000 2024-09-14T11:15:25.302 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:15:25.303 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:25.303 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f604a98c76a] 2024-09-14T11:15:25.303 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f604a98c928] 2024-09-14T11:15:25.303 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e9ad2a40b1] 2024-09-14T11:15:25.303 INFO:tasks.workunit.client.0.smithi050.stderr: 4: radosgw-admin(+0xd8907c) [0x55e9ad7b807c] 2024-09-14T11:15:25.303 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e9ad2b3efd] 2024-09-14T11:15:25.303 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:15:25.303 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6049629590] 2024-09-14T11:15:25.304 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:15:25.304 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:15:25.304 INFO:tasks.workunit.client.0.smithi050.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:15:25.304 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f60473a2800 thread_name:radosgw-admin 2024-09-14T11:15:25.304 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.304+0000 7f60473a2800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f60473a2800 time 2024-09-14T11:15:25.304878+0000 2024-09-14T11:15:25.304 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:15:25.304 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.304 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:25.304 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f604a98c76a] 2024-09-14T11:15:25.304 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f604a98c928] 2024-09-14T11:15:25.304 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e9ad2a40b1] 2024-09-14T11:15:25.304 INFO:tasks.workunit.client.0.smithi050.stderr: 4: radosgw-admin(+0xd8907c) [0x55e9ad7b807c] 2024-09-14T11:15:25.304 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e9ad2b3efd] 2024-09-14T11:15:25.305 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:15:25.305 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6049629590] 2024-09-14T11:15:25.305 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:15:25.305 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:15:25.305 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.320 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:25.321 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f604963e6f0] 2024-09-14T11:15:25.321 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f604968b99c] 2024-09-14T11:15:25.321 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:15:25.321 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:15:25.321 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f604a98c7c4] 2024-09-14T11:15:25.321 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f604a98c928] 2024-09-14T11:15:25.321 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e9ad2a40b1] 2024-09-14T11:15:25.321 INFO:tasks.workunit.client.0.smithi050.stderr: 8: radosgw-admin(+0xd8907c) [0x55e9ad7b807c] 2024-09-14T11:15:25.321 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e9ad2b3efd] 2024-09-14T11:15:25.321 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:15:25.321 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6049629590] 2024-09-14T11:15:25.321 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:15:25.322 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:15:25.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.305+0000 7f60473a2800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:15:25.322 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f60473a2800 thread_name:radosgw-admin 2024-09-14T11:15:25.322 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.322 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:25.322 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f604963e6f0] 2024-09-14T11:15:25.322 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f604968b99c] 2024-09-14T11:15:25.322 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:15:25.322 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:15:25.322 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f604a98c7c4] 2024-09-14T11:15:25.322 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f604a98c928] 2024-09-14T11:15:25.322 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e9ad2a40b1] 2024-09-14T11:15:25.322 INFO:tasks.workunit.client.0.smithi050.stderr: 8: radosgw-admin(+0xd8907c) [0x55e9ad7b807c] 2024-09-14T11:15:25.322 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e9ad2b3efd] 2024-09-14T11:15:25.323 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:15:25.323 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6049629590] 2024-09-14T11:15:25.323 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:15:25.323 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:15:25.323 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:15:25.323 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.323 INFO:tasks.workunit.client.0.smithi050.stderr:--- begin dump of recent events --- 2024-09-14T11:15:25.323 INFO:tasks.workunit.client.0.smithi050.stderr: -499> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding auth protocol: cephx 2024-09-14T11:15:25.323 INFO:tasks.workunit.client.0.smithi050.stderr: -498> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding auth protocol: cephx 2024-09-14T11:15:25.323 INFO:tasks.workunit.client.0.smithi050.stderr: -497> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding auth protocol: cephx 2024-09-14T11:15:25.323 INFO:tasks.workunit.client.0.smithi050.stderr: -496> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding con mode: secure 2024-09-14T11:15:25.323 INFO:tasks.workunit.client.0.smithi050.stderr: -495> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding con mode: crc 2024-09-14T11:15:25.323 INFO:tasks.workunit.client.0.smithi050.stderr: -494> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding con mode: secure 2024-09-14T11:15:25.323 INFO:tasks.workunit.client.0.smithi050.stderr: -493> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding con mode: crc 2024-09-14T11:15:25.323 INFO:tasks.workunit.client.0.smithi050.stderr: -492> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding con mode: secure 2024-09-14T11:15:25.324 INFO:tasks.workunit.client.0.smithi050.stderr: -491> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding con mode: crc 2024-09-14T11:15:25.324 INFO:tasks.workunit.client.0.smithi050.stderr: -490> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding con mode: crc 2024-09-14T11:15:25.324 INFO:tasks.workunit.client.0.smithi050.stderr: -489> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding con mode: secure 2024-09-14T11:15:25.324 INFO:tasks.workunit.client.0.smithi050.stderr: -488> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding con mode: crc 2024-09-14T11:15:25.324 INFO:tasks.workunit.client.0.smithi050.stderr: -487> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding con mode: secure 2024-09-14T11:15:25.324 INFO:tasks.workunit.client.0.smithi050.stderr: -486> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding con mode: crc 2024-09-14T11:15:25.324 INFO:tasks.workunit.client.0.smithi050.stderr: -485> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding con mode: secure 2024-09-14T11:15:25.324 INFO:tasks.workunit.client.0.smithi050.stderr: -484> 2024-09-14T11:15:25.031+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.324 INFO:tasks.workunit.client.0.smithi050.stderr: -483> 2024-09-14T11:15:25.031+0000 7f60473a2800 1 librados: starting msgr at 2024-09-14T11:15:25.324 INFO:tasks.workunit.client.0.smithi050.stderr: -482> 2024-09-14T11:15:25.031+0000 7f60473a2800 1 librados: starting objecter 2024-09-14T11:15:25.324 INFO:tasks.workunit.client.0.smithi050.stderr: -481> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command objecter_requests hook 0x55e9af5f47b0 2024-09-14T11:15:25.324 INFO:tasks.workunit.client.0.smithi050.stderr: -480> 2024-09-14T11:15:25.031+0000 7f60473a2800 1 librados: setting wanted keys 2024-09-14T11:15:25.324 INFO:tasks.workunit.client.0.smithi050.stderr: -479> 2024-09-14T11:15:25.031+0000 7f60473a2800 1 librados: calling monclient init 2024-09-14T11:15:25.324 INFO:tasks.workunit.client.0.smithi050.stderr: -478> 2024-09-14T11:15:25.031+0000 7f60473a2800 10 monclient: init 2024-09-14T11:15:25.325 INFO:tasks.workunit.client.0.smithi050.stderr: -477> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding auth protocol: cephx 2024-09-14T11:15:25.325 INFO:tasks.workunit.client.0.smithi050.stderr: -476> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding auth protocol: cephx 2024-09-14T11:15:25.325 INFO:tasks.workunit.client.0.smithi050.stderr: -475> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding auth protocol: cephx 2024-09-14T11:15:25.325 INFO:tasks.workunit.client.0.smithi050.stderr: -474> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding con mode: secure 2024-09-14T11:15:25.325 INFO:tasks.workunit.client.0.smithi050.stderr: -473> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding con mode: crc 2024-09-14T11:15:25.325 INFO:tasks.workunit.client.0.smithi050.stderr: -472> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding con mode: secure 2024-09-14T11:15:25.325 INFO:tasks.workunit.client.0.smithi050.stderr: -471> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding con mode: crc 2024-09-14T11:15:25.325 INFO:tasks.workunit.client.0.smithi050.stderr: -470> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding con mode: secure 2024-09-14T11:15:25.325 INFO:tasks.workunit.client.0.smithi050.stderr: -469> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding con mode: crc 2024-09-14T11:15:25.325 INFO:tasks.workunit.client.0.smithi050.stderr: -468> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding con mode: crc 2024-09-14T11:15:25.325 INFO:tasks.workunit.client.0.smithi050.stderr: -467> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding con mode: secure 2024-09-14T11:15:25.325 INFO:tasks.workunit.client.0.smithi050.stderr: -466> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding con mode: crc 2024-09-14T11:15:25.325 INFO:tasks.workunit.client.0.smithi050.stderr: -465> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding con mode: secure 2024-09-14T11:15:25.325 INFO:tasks.workunit.client.0.smithi050.stderr: -464> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding con mode: crc 2024-09-14T11:15:25.325 INFO:tasks.workunit.client.0.smithi050.stderr: -463> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding con mode: secure 2024-09-14T11:15:25.326 INFO:tasks.workunit.client.0.smithi050.stderr: -462> 2024-09-14T11:15:25.032+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.326 INFO:tasks.workunit.client.0.smithi050.stderr: -461> 2024-09-14T11:15:25.032+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.326 INFO:tasks.workunit.client.0.smithi050.stderr: -460> 2024-09-14T11:15:25.032+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command rotate-key hook 0x55e9af5f0b18 2024-09-14T11:15:25.326 INFO:tasks.workunit.client.0.smithi050.stderr: -459> 2024-09-14T11:15:25.032+0000 7f60473a2800 10 monclient: _reopen_session rank -1 2024-09-14T11:15:25.326 INFO:tasks.workunit.client.0.smithi050.stderr: -458> 2024-09-14T11:15:25.032+0000 7f60473a2800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:15:25.326 INFO:tasks.workunit.client.0.smithi050.stderr: -457> 2024-09-14T11:15:25.032+0000 7f60473a2800 10 monclient(hunting): picked mon.noname-a con 0x55e9af47bdf0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:15:25.326 INFO:tasks.workunit.client.0.smithi050.stderr: -456> 2024-09-14T11:15:25.032+0000 7f60473a2800 10 monclient(hunting): picked mon.noname-b con 0x55e9af49deb0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:15:25.326 INFO:tasks.workunit.client.0.smithi050.stderr: -455> 2024-09-14T11:15:25.032+0000 7f60473a2800 10 monclient(hunting): picked mon.noname-c con 0x55e9af53a030 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:15:25.326 INFO:tasks.workunit.client.0.smithi050.stderr: -454> 2024-09-14T11:15:25.032+0000 7f60473a2800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:25.326 INFO:tasks.workunit.client.0.smithi050.stderr: -453> 2024-09-14T11:15:25.032+0000 7f60473a2800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:25.326 INFO:tasks.workunit.client.0.smithi050.stderr: -452> 2024-09-14T11:15:25.032+0000 7f60473a2800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:25.326 INFO:tasks.workunit.client.0.smithi050.stderr: -451> 2024-09-14T11:15:25.032+0000 7f60473a2800 10 monclient(hunting): _renew_subs 2024-09-14T11:15:25.326 INFO:tasks.workunit.client.0.smithi050.stderr: -450> 2024-09-14T11:15:25.032+0000 7f60473a2800 10 monclient(hunting): authenticate will time out at 2577.670497s 2024-09-14T11:15:25.326 INFO:tasks.workunit.client.0.smithi050.stderr: -449> 2024-09-14T11:15:25.032+0000 7f6044e8c640 10 monclient(hunting): get_auth_request con 0x55e9af47bdf0 auth_method 0 2024-09-14T11:15:25.327 INFO:tasks.workunit.client.0.smithi050.stderr: -448> 2024-09-14T11:15:25.032+0000 7f6044e8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:25.327 INFO:tasks.workunit.client.0.smithi050.stderr: -447> 2024-09-14T11:15:25.032+0000 7f6044e8c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:25.327 INFO:tasks.workunit.client.0.smithi050.stderr: -446> 2024-09-14T11:15:25.032+0000 7f6044e8c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:25.327 INFO:tasks.workunit.client.0.smithi050.stderr: -445> 2024-09-14T11:15:25.032+0000 7f604568d640 10 monclient(hunting): get_auth_request con 0x55e9af53a030 auth_method 0 2024-09-14T11:15:25.327 INFO:tasks.workunit.client.0.smithi050.stderr: -444> 2024-09-14T11:15:25.032+0000 7f604568d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:25.327 INFO:tasks.workunit.client.0.smithi050.stderr: -443> 2024-09-14T11:15:25.032+0000 7f604568d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:25.327 INFO:tasks.workunit.client.0.smithi050.stderr: -442> 2024-09-14T11:15:25.032+0000 7f604568d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:25.327 INFO:tasks.workunit.client.0.smithi050.stderr: -441> 2024-09-14T11:15:25.032+0000 7f6044e8c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:25.327 INFO:tasks.workunit.client.0.smithi050.stderr: -440> 2024-09-14T11:15:25.032+0000 7f6044e8c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:25.328 INFO:tasks.workunit.client.0.smithi050.stderr: -439> 2024-09-14T11:15:25.032+0000 7f6044e8c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:25.328 INFO:tasks.workunit.client.0.smithi050.stderr: -438> 2024-09-14T11:15:25.032+0000 7f604568d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:25.328 INFO:tasks.workunit.client.0.smithi050.stderr: -437> 2024-09-14T11:15:25.032+0000 7f604568d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:25.328 INFO:tasks.workunit.client.0.smithi050.stderr: -436> 2024-09-14T11:15:25.032+0000 7f604568d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:25.328 INFO:tasks.workunit.client.0.smithi050.stderr: -435> 2024-09-14T11:15:25.032+0000 7f603ffff640 10 monclient(hunting): get_auth_request con 0x55e9af49deb0 auth_method 0 2024-09-14T11:15:25.328 INFO:tasks.workunit.client.0.smithi050.stderr: -434> 2024-09-14T11:15:25.032+0000 7f603ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:25.328 INFO:tasks.workunit.client.0.smithi050.stderr: -433> 2024-09-14T11:15:25.032+0000 7f603ffff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:25.328 INFO:tasks.workunit.client.0.smithi050.stderr: -432> 2024-09-14T11:15:25.032+0000 7f603ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:25.328 INFO:tasks.workunit.client.0.smithi050.stderr: -431> 2024-09-14T11:15:25.032+0000 7f6044e8c640 10 monclient(hunting): handle_auth_done global_id 8376 payload 824 2024-09-14T11:15:25.328 INFO:tasks.workunit.client.0.smithi050.stderr: -430> 2024-09-14T11:15:25.032+0000 7f6044e8c640 10 monclient: _finish_hunting 0 2024-09-14T11:15:25.328 INFO:tasks.workunit.client.0.smithi050.stderr: -429> 2024-09-14T11:15:25.032+0000 7f6044e8c640 1 monclient: found mon.noname-a 2024-09-14T11:15:25.328 INFO:tasks.workunit.client.0.smithi050.stderr: -428> 2024-09-14T11:15:25.032+0000 7f6044e8c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:15:25.328 INFO:tasks.workunit.client.0.smithi050.stderr: -427> 2024-09-14T11:15:25.033+0000 7f5f31602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:25.328 INFO:tasks.workunit.client.0.smithi050.stderr: -426> 2024-09-14T11:15:25.033+0000 7f5f31602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:25.329 INFO:tasks.workunit.client.0.smithi050.stderr: -425> 2024-09-14T11:15:25.033+0000 7f5f31602640 10 monclient: dump: 2024-09-14T11:15:25.329 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:25.329 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:25.329 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.329 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.329 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:25.329 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:25.329 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:25.329 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:25.329 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:25.329 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.329 INFO:tasks.workunit.client.0.smithi050.stderr: -424> 2024-09-14T11:15:25.033+0000 7f5f31602640 10 monclient: _finish_auth 0 2024-09-14T11:15:25.329 INFO:tasks.workunit.client.0.smithi050.stderr: -423> 2024-09-14T11:15:25.033+0000 7f5f31602640 10 monclient: _check_auth_tickets 2024-09-14T11:15:25.329 INFO:tasks.workunit.client.0.smithi050.stderr: -422> 2024-09-14T11:15:25.033+0000 7f5f31602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:25.330 INFO:tasks.workunit.client.0.smithi050.stderr: -421> 2024-09-14T11:15:25.033+0000 7f5f31602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:25.330 INFO:tasks.workunit.client.0.smithi050.stderr: -420> 2024-09-14T11:15:25.033+0000 7f5f31602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:25.330 INFO:tasks.workunit.client.0.smithi050.stderr: -419> 2024-09-14T11:15:25.033+0000 7f5f31602640 10 monclient: dump: 2024-09-14T11:15:25.330 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:25.330 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:25.330 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.330 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.330 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:25.330 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:25.330 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:25.330 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:25.330 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:25.330 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.330 INFO:tasks.workunit.client.0.smithi050.stderr: -418> 2024-09-14T11:15:25.033+0000 7f60473a2800 5 monclient: authenticate success, global_id 8376 2024-09-14T11:15:25.330 INFO:tasks.workunit.client.0.smithi050.stderr: -417> 2024-09-14T11:15:25.033+0000 7f60473a2800 10 monclient: _renew_subs 2024-09-14T11:15:25.330 INFO:tasks.workunit.client.0.smithi050.stderr: -416> 2024-09-14T11:15:25.033+0000 7f60473a2800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:15:25.331 INFO:tasks.workunit.client.0.smithi050.stderr: -415> 2024-09-14T11:15:25.033+0000 7f5f32e05640 4 set_mon_vals no callback set 2024-09-14T11:15:25.331 INFO:tasks.workunit.client.0.smithi050.stderr: -414> 2024-09-14T11:15:25.033+0000 7f60473a2800 10 monclient: _renew_subs 2024-09-14T11:15:25.331 INFO:tasks.workunit.client.0.smithi050.stderr: -413> 2024-09-14T11:15:25.033+0000 7f60473a2800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:15:25.331 INFO:tasks.workunit.client.0.smithi050.stderr: -412> 2024-09-14T11:15:25.033+0000 7f60473a2800 1 librados: init done 2024-09-14T11:15:25.331 INFO:tasks.workunit.client.0.smithi050.stderr: -411> 2024-09-14T11:15:25.036+0000 7f5f31602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:15:25.331 INFO:tasks.workunit.client.0.smithi050.stderr: -410> 2024-09-14T11:15:25.036+0000 7f5f31602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:15:25.331 INFO:tasks.workunit.client.0.smithi050.stderr: -409> 2024-09-14T11:15:25.036+0000 7f5f31602640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:15:25.331 INFO:tasks.workunit.client.0.smithi050.stderr: -408> 2024-09-14T11:15:25.036+0000 7f603ffff640 10 monclient: get_auth_request con 0x7f5f2c077230 auth_method 0 2024-09-14T11:15:25.331 INFO:tasks.workunit.client.0.smithi050.stderr: -407> 2024-09-14T11:15:25.036+0000 7f604568d640 10 monclient: get_auth_request con 0x55e9af6192c0 auth_method 0 2024-09-14T11:15:25.331 INFO:tasks.workunit.client.0.smithi050.stderr: -406> 2024-09-14T11:15:25.037+0000 7f6044e8c640 10 monclient: get_auth_request con 0x55e9af63bdc0 auth_method 0 2024-09-14T11:15:25.331 INFO:tasks.workunit.client.0.smithi050.stderr: -405> 2024-09-14T11:15:25.038+0000 7f603ffff640 10 monclient: get_auth_request con 0x55e9af640540 auth_method 0 2024-09-14T11:15:25.331 INFO:tasks.workunit.client.0.smithi050.stderr: -404> 2024-09-14T11:15:25.040+0000 7f60473a2800 10 monclient: build_initial_monmap 2024-09-14T11:15:25.331 INFO:tasks.workunit.client.0.smithi050.stderr: -403> 2024-09-14T11:15:25.040+0000 7f60473a2800 1 build_initial for_mkfs: 0 2024-09-14T11:15:25.331 INFO:tasks.workunit.client.0.smithi050.stderr: -402> 2024-09-14T11:15:25.040+0000 7f60473a2800 10 monclient: monmap: 2024-09-14T11:15:25.331 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:15:25.332 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:25.332 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:15:25.332 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:15:25.332 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:25.332 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:25.332 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:15:25.332 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:15:25.332 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:15:25.332 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.332 INFO:tasks.workunit.client.0.smithi050.stderr: -401> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding auth protocol: cephx 2024-09-14T11:15:25.332 INFO:tasks.workunit.client.0.smithi050.stderr: -400> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding auth protocol: cephx 2024-09-14T11:15:25.332 INFO:tasks.workunit.client.0.smithi050.stderr: -399> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding auth protocol: cephx 2024-09-14T11:15:25.332 INFO:tasks.workunit.client.0.smithi050.stderr: -398> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding con mode: secure 2024-09-14T11:15:25.332 INFO:tasks.workunit.client.0.smithi050.stderr: -397> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding con mode: crc 2024-09-14T11:15:25.333 INFO:tasks.workunit.client.0.smithi050.stderr: -396> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding con mode: secure 2024-09-14T11:15:25.333 INFO:tasks.workunit.client.0.smithi050.stderr: -395> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding con mode: crc 2024-09-14T11:15:25.333 INFO:tasks.workunit.client.0.smithi050.stderr: -394> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding con mode: secure 2024-09-14T11:15:25.333 INFO:tasks.workunit.client.0.smithi050.stderr: -393> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding con mode: crc 2024-09-14T11:15:25.333 INFO:tasks.workunit.client.0.smithi050.stderr: -392> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding con mode: crc 2024-09-14T11:15:25.333 INFO:tasks.workunit.client.0.smithi050.stderr: -391> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding con mode: secure 2024-09-14T11:15:25.333 INFO:tasks.workunit.client.0.smithi050.stderr: -390> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding con mode: crc 2024-09-14T11:15:25.333 INFO:tasks.workunit.client.0.smithi050.stderr: -389> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding con mode: secure 2024-09-14T11:15:25.333 INFO:tasks.workunit.client.0.smithi050.stderr: -388> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding con mode: crc 2024-09-14T11:15:25.333 INFO:tasks.workunit.client.0.smithi050.stderr: -387> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding con mode: secure 2024-09-14T11:15:25.333 INFO:tasks.workunit.client.0.smithi050.stderr: -386> 2024-09-14T11:15:25.040+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.333 INFO:tasks.workunit.client.0.smithi050.stderr: -385> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command objecter_requests cmddesc objecter_requests hook 0x55e9af6487c0 EEXIST 2024-09-14T11:15:25.333 INFO:tasks.workunit.client.0.smithi050.stderr: -384> 2024-09-14T11:15:25.040+0000 7f60473a2800 10 monclient: init 2024-09-14T11:15:25.333 INFO:tasks.workunit.client.0.smithi050.stderr: -383> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding auth protocol: cephx 2024-09-14T11:15:25.333 INFO:tasks.workunit.client.0.smithi050.stderr: -382> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding auth protocol: cephx 2024-09-14T11:15:25.334 INFO:tasks.workunit.client.0.smithi050.stderr: -381> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding auth protocol: cephx 2024-09-14T11:15:25.334 INFO:tasks.workunit.client.0.smithi050.stderr: -380> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding con mode: secure 2024-09-14T11:15:25.334 INFO:tasks.workunit.client.0.smithi050.stderr: -379> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding con mode: crc 2024-09-14T11:15:25.334 INFO:tasks.workunit.client.0.smithi050.stderr: -378> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding con mode: secure 2024-09-14T11:15:25.334 INFO:tasks.workunit.client.0.smithi050.stderr: -377> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding con mode: crc 2024-09-14T11:15:25.334 INFO:tasks.workunit.client.0.smithi050.stderr: -376> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding con mode: secure 2024-09-14T11:15:25.334 INFO:tasks.workunit.client.0.smithi050.stderr: -375> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding con mode: crc 2024-09-14T11:15:25.334 INFO:tasks.workunit.client.0.smithi050.stderr: -374> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding con mode: crc 2024-09-14T11:15:25.334 INFO:tasks.workunit.client.0.smithi050.stderr: -373> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding con mode: secure 2024-09-14T11:15:25.334 INFO:tasks.workunit.client.0.smithi050.stderr: -372> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding con mode: crc 2024-09-14T11:15:25.334 INFO:tasks.workunit.client.0.smithi050.stderr: -371> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding con mode: secure 2024-09-14T11:15:25.334 INFO:tasks.workunit.client.0.smithi050.stderr: -370> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding con mode: crc 2024-09-14T11:15:25.334 INFO:tasks.workunit.client.0.smithi050.stderr: -369> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding con mode: secure 2024-09-14T11:15:25.335 INFO:tasks.workunit.client.0.smithi050.stderr: -368> 2024-09-14T11:15:25.041+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.335 INFO:tasks.workunit.client.0.smithi050.stderr: -367> 2024-09-14T11:15:25.041+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.335 INFO:tasks.workunit.client.0.smithi050.stderr: -366> 2024-09-14T11:15:25.041+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command rotate-key cmddesc rotate-key hook 0x55e9af643a90 EEXIST 2024-09-14T11:15:25.335 INFO:tasks.workunit.client.0.smithi050.stderr: -365> 2024-09-14T11:15:25.041+0000 7f60473a2800 10 monclient: _reopen_session rank -1 2024-09-14T11:15:25.335 INFO:tasks.workunit.client.0.smithi050.stderr: -364> 2024-09-14T11:15:25.041+0000 7f60473a2800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:15:25.335 INFO:tasks.workunit.client.0.smithi050.stderr: -363> 2024-09-14T11:15:25.041+0000 7f60473a2800 10 monclient(hunting): picked mon.noname-b con 0x55e9af66cae0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:15:25.335 INFO:tasks.workunit.client.0.smithi050.stderr: -362> 2024-09-14T11:15:25.041+0000 7f60473a2800 10 monclient(hunting): picked mon.noname-a con 0x55e9af66cec0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:15:25.335 INFO:tasks.workunit.client.0.smithi050.stderr: -361> 2024-09-14T11:15:25.041+0000 7f60473a2800 10 monclient(hunting): picked mon.noname-c con 0x55e9af66b7f0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:15:25.335 INFO:tasks.workunit.client.0.smithi050.stderr: -360> 2024-09-14T11:15:25.041+0000 7f60473a2800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:25.335 INFO:tasks.workunit.client.0.smithi050.stderr: -359> 2024-09-14T11:15:25.041+0000 7f60473a2800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:25.335 INFO:tasks.workunit.client.0.smithi050.stderr: -358> 2024-09-14T11:15:25.041+0000 7f60473a2800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:25.335 INFO:tasks.workunit.client.0.smithi050.stderr: -357> 2024-09-14T11:15:25.041+0000 7f60473a2800 10 monclient(hunting): _renew_subs 2024-09-14T11:15:25.335 INFO:tasks.workunit.client.0.smithi050.stderr: -356> 2024-09-14T11:15:25.041+0000 7f60473a2800 10 monclient(hunting): authenticate will time out at 2577.679482s 2024-09-14T11:15:25.335 INFO:tasks.workunit.client.0.smithi050.stderr: -355> 2024-09-14T11:15:25.041+0000 7f603ffff640 10 monclient(hunting): get_auth_request con 0x55e9af66cec0 auth_method 0 2024-09-14T11:15:25.335 INFO:tasks.workunit.client.0.smithi050.stderr: -354> 2024-09-14T11:15:25.041+0000 7f603ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:25.336 INFO:tasks.workunit.client.0.smithi050.stderr: -353> 2024-09-14T11:15:25.041+0000 7f603ffff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:25.336 INFO:tasks.workunit.client.0.smithi050.stderr: -352> 2024-09-14T11:15:25.041+0000 7f603ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:25.336 INFO:tasks.workunit.client.0.smithi050.stderr: -351> 2024-09-14T11:15:25.041+0000 7f604568d640 10 monclient(hunting): get_auth_request con 0x55e9af66b7f0 auth_method 0 2024-09-14T11:15:25.336 INFO:tasks.workunit.client.0.smithi050.stderr: -350> 2024-09-14T11:15:25.041+0000 7f604568d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:25.336 INFO:tasks.workunit.client.0.smithi050.stderr: -349> 2024-09-14T11:15:25.041+0000 7f604568d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:25.336 INFO:tasks.workunit.client.0.smithi050.stderr: -348> 2024-09-14T11:15:25.041+0000 7f604568d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:25.336 INFO:tasks.workunit.client.0.smithi050.stderr: -347> 2024-09-14T11:15:25.041+0000 7f6044e8c640 10 monclient(hunting): get_auth_request con 0x55e9af66cae0 auth_method 0 2024-09-14T11:15:25.336 INFO:tasks.workunit.client.0.smithi050.stderr: -346> 2024-09-14T11:15:25.041+0000 7f6044e8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:25.336 INFO:tasks.workunit.client.0.smithi050.stderr: -345> 2024-09-14T11:15:25.041+0000 7f6044e8c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:25.336 INFO:tasks.workunit.client.0.smithi050.stderr: -344> 2024-09-14T11:15:25.041+0000 7f6044e8c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:25.336 INFO:tasks.workunit.client.0.smithi050.stderr: -343> 2024-09-14T11:15:25.041+0000 7f603ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:25.336 INFO:tasks.workunit.client.0.smithi050.stderr: -342> 2024-09-14T11:15:25.041+0000 7f603ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:25.336 INFO:tasks.workunit.client.0.smithi050.stderr: -341> 2024-09-14T11:15:25.041+0000 7f603ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:25.337 INFO:tasks.workunit.client.0.smithi050.stderr: -340> 2024-09-14T11:15:25.041+0000 7f604568d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:25.337 INFO:tasks.workunit.client.0.smithi050.stderr: -339> 2024-09-14T11:15:25.041+0000 7f604568d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:25.337 INFO:tasks.workunit.client.0.smithi050.stderr: -338> 2024-09-14T11:15:25.041+0000 7f604568d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:25.337 INFO:tasks.workunit.client.0.smithi050.stderr: -337> 2024-09-14T11:15:25.041+0000 7f6044e8c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:25.337 INFO:tasks.workunit.client.0.smithi050.stderr: -336> 2024-09-14T11:15:25.041+0000 7f6044e8c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:25.337 INFO:tasks.workunit.client.0.smithi050.stderr: -335> 2024-09-14T11:15:25.041+0000 7f6044e8c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:25.337 INFO:tasks.workunit.client.0.smithi050.stderr: -334> 2024-09-14T11:15:25.041+0000 7f603ffff640 10 monclient(hunting): handle_auth_done global_id 8379 payload 824 2024-09-14T11:15:25.337 INFO:tasks.workunit.client.0.smithi050.stderr: -333> 2024-09-14T11:15:25.041+0000 7f603ffff640 10 monclient: _finish_hunting 0 2024-09-14T11:15:25.337 INFO:tasks.workunit.client.0.smithi050.stderr: -332> 2024-09-14T11:15:25.041+0000 7f603ffff640 1 monclient: found mon.noname-a 2024-09-14T11:15:25.337 INFO:tasks.workunit.client.0.smithi050.stderr: -331> 2024-09-14T11:15:25.041+0000 7f603ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:15:25.337 INFO:tasks.workunit.client.0.smithi050.stderr: -330> 2024-09-14T11:15:25.042+0000 7f5f2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:25.337 INFO:tasks.workunit.client.0.smithi050.stderr: -329> 2024-09-14T11:15:25.042+0000 7f5f2a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:25.337 INFO:tasks.workunit.client.0.smithi050.stderr: -328> 2024-09-14T11:15:25.042+0000 7f5f2a7fc640 10 monclient: dump: 2024-09-14T11:15:25.337 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:25.338 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:25.338 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.338 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.338 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:25.338 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:25.338 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:25.338 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:25.338 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:25.338 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.338 INFO:tasks.workunit.client.0.smithi050.stderr: -327> 2024-09-14T11:15:25.042+0000 7f5f2a7fc640 10 monclient: _finish_auth 0 2024-09-14T11:15:25.338 INFO:tasks.workunit.client.0.smithi050.stderr: -326> 2024-09-14T11:15:25.042+0000 7f5f2a7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:15:25.338 INFO:tasks.workunit.client.0.smithi050.stderr: -325> 2024-09-14T11:15:25.042+0000 7f60473a2800 5 monclient: authenticate success, global_id 8379 2024-09-14T11:15:25.338 INFO:tasks.workunit.client.0.smithi050.stderr: -324> 2024-09-14T11:15:25.042+0000 7f60473a2800 10 monclient: _renew_subs 2024-09-14T11:15:25.338 INFO:tasks.workunit.client.0.smithi050.stderr: -323> 2024-09-14T11:15:25.042+0000 7f60473a2800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:15:25.338 INFO:tasks.workunit.client.0.smithi050.stderr: -322> 2024-09-14T11:15:25.042+0000 7f5f2a7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:25.338 INFO:tasks.workunit.client.0.smithi050.stderr: -321> 2024-09-14T11:15:25.042+0000 7f5f2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:25.339 INFO:tasks.workunit.client.0.smithi050.stderr: -320> 2024-09-14T11:15:25.042+0000 7f5f2a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:25.339 INFO:tasks.workunit.client.0.smithi050.stderr: -319> 2024-09-14T11:15:25.042+0000 7f5f2a7fc640 10 monclient: dump: 2024-09-14T11:15:25.339 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:25.339 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:25.339 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.339 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.339 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:25.339 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:25.339 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:25.339 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:25.339 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:25.339 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.339 INFO:tasks.workunit.client.0.smithi050.stderr: -318> 2024-09-14T11:15:25.042+0000 7f6045e8e640 4 set_mon_vals no callback set 2024-09-14T11:15:25.339 INFO:tasks.workunit.client.0.smithi050.stderr: -317> 2024-09-14T11:15:25.042+0000 7f60473a2800 10 monclient: _renew_subs 2024-09-14T11:15:25.340 INFO:tasks.workunit.client.0.smithi050.stderr: -316> 2024-09-14T11:15:25.042+0000 7f60473a2800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:15:25.340 INFO:tasks.workunit.client.0.smithi050.stderr: -315> 2024-09-14T11:15:25.044+0000 7f5f2a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:15:25.340 INFO:tasks.workunit.client.0.smithi050.stderr: -314> 2024-09-14T11:15:25.044+0000 7f5f2a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:15:25.340 INFO:tasks.workunit.client.0.smithi050.stderr: -313> 2024-09-14T11:15:25.044+0000 7f5f2a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:15:25.340 INFO:tasks.workunit.client.0.smithi050.stderr: -312> 2024-09-14T11:15:25.044+0000 7f6044e8c640 10 monclient: get_auth_request con 0x7f5f1c077140 auth_method 0 2024-09-14T11:15:25.340 INFO:tasks.workunit.client.0.smithi050.stderr: -311> 2024-09-14T11:15:25.044+0000 7f60473a2800 10 monclient: get_monmap_and_config 2024-09-14T11:15:25.340 INFO:tasks.workunit.client.0.smithi050.stderr: -310> 2024-09-14T11:15:25.044+0000 7f60473a2800 10 monclient: build_initial_monmap 2024-09-14T11:15:25.340 INFO:tasks.workunit.client.0.smithi050.stderr: -309> 2024-09-14T11:15:25.044+0000 7f60473a2800 1 build_initial for_mkfs: 0 2024-09-14T11:15:25.340 INFO:tasks.workunit.client.0.smithi050.stderr: -308> 2024-09-14T11:15:25.044+0000 7f60473a2800 10 monclient: monmap: 2024-09-14T11:15:25.340 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:15:25.340 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:25.340 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:15:25.340 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:15:25.341 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:25.341 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:25.341 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:15:25.341 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:15:25.341 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:15:25.341 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.341 INFO:tasks.workunit.client.0.smithi050.stderr: -307> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding auth protocol: cephx 2024-09-14T11:15:25.341 INFO:tasks.workunit.client.0.smithi050.stderr: -306> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding auth protocol: cephx 2024-09-14T11:15:25.341 INFO:tasks.workunit.client.0.smithi050.stderr: -305> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding auth protocol: cephx 2024-09-14T11:15:25.341 INFO:tasks.workunit.client.0.smithi050.stderr: -304> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding con mode: secure 2024-09-14T11:15:25.341 INFO:tasks.workunit.client.0.smithi050.stderr: -303> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding con mode: crc 2024-09-14T11:15:25.341 INFO:tasks.workunit.client.0.smithi050.stderr: -302> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding con mode: secure 2024-09-14T11:15:25.341 INFO:tasks.workunit.client.0.smithi050.stderr: -301> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding con mode: crc 2024-09-14T11:15:25.341 INFO:tasks.workunit.client.0.smithi050.stderr: -300> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding con mode: secure 2024-09-14T11:15:25.342 INFO:tasks.workunit.client.0.smithi050.stderr: -299> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding con mode: crc 2024-09-14T11:15:25.342 INFO:tasks.workunit.client.0.smithi050.stderr: -298> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding con mode: crc 2024-09-14T11:15:25.342 INFO:tasks.workunit.client.0.smithi050.stderr: -297> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding con mode: secure 2024-09-14T11:15:25.342 INFO:tasks.workunit.client.0.smithi050.stderr: -296> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding con mode: crc 2024-09-14T11:15:25.342 INFO:tasks.workunit.client.0.smithi050.stderr: -295> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding con mode: secure 2024-09-14T11:15:25.342 INFO:tasks.workunit.client.0.smithi050.stderr: -294> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding con mode: crc 2024-09-14T11:15:25.342 INFO:tasks.workunit.client.0.smithi050.stderr: -293> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding con mode: secure 2024-09-14T11:15:25.342 INFO:tasks.workunit.client.0.smithi050.stderr: -292> 2024-09-14T11:15:25.045+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.342 INFO:tasks.workunit.client.0.smithi050.stderr: -291> 2024-09-14T11:15:25.045+0000 7f60473a2800 10 monclient: init 2024-09-14T11:15:25.342 INFO:tasks.workunit.client.0.smithi050.stderr: -290> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding auth protocol: cephx 2024-09-14T11:15:25.342 INFO:tasks.workunit.client.0.smithi050.stderr: -289> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding auth protocol: cephx 2024-09-14T11:15:25.342 INFO:tasks.workunit.client.0.smithi050.stderr: -288> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding auth protocol: cephx 2024-09-14T11:15:25.342 INFO:tasks.workunit.client.0.smithi050.stderr: -287> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding con mode: secure 2024-09-14T11:15:25.342 INFO:tasks.workunit.client.0.smithi050.stderr: -286> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding con mode: crc 2024-09-14T11:15:25.343 INFO:tasks.workunit.client.0.smithi050.stderr: -285> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding con mode: secure 2024-09-14T11:15:25.343 INFO:tasks.workunit.client.0.smithi050.stderr: -284> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding con mode: crc 2024-09-14T11:15:25.343 INFO:tasks.workunit.client.0.smithi050.stderr: -283> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding con mode: secure 2024-09-14T11:15:25.343 INFO:tasks.workunit.client.0.smithi050.stderr: -282> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding con mode: crc 2024-09-14T11:15:25.343 INFO:tasks.workunit.client.0.smithi050.stderr: -281> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding con mode: crc 2024-09-14T11:15:25.343 INFO:tasks.workunit.client.0.smithi050.stderr: -280> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding con mode: secure 2024-09-14T11:15:25.343 INFO:tasks.workunit.client.0.smithi050.stderr: -279> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding con mode: crc 2024-09-14T11:15:25.343 INFO:tasks.workunit.client.0.smithi050.stderr: -278> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding con mode: secure 2024-09-14T11:15:25.343 INFO:tasks.workunit.client.0.smithi050.stderr: -277> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding con mode: crc 2024-09-14T11:15:25.343 INFO:tasks.workunit.client.0.smithi050.stderr: -276> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding con mode: secure 2024-09-14T11:15:25.343 INFO:tasks.workunit.client.0.smithi050.stderr: -275> 2024-09-14T11:15:25.045+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.343 INFO:tasks.workunit.client.0.smithi050.stderr: -274> 2024-09-14T11:15:25.045+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.343 INFO:tasks.workunit.client.0.smithi050.stderr: -273> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command rotate-key cmddesc rotate-key hook 0x7ffd01ccab68 EEXIST 2024-09-14T11:15:25.343 INFO:tasks.workunit.client.0.smithi050.stderr: -272> 2024-09-14T11:15:25.045+0000 7f60473a2800 10 monclient: _reopen_session rank -1 2024-09-14T11:15:25.344 INFO:tasks.workunit.client.0.smithi050.stderr: -271> 2024-09-14T11:15:25.045+0000 7f60473a2800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:15:25.344 INFO:tasks.workunit.client.0.smithi050.stderr: -270> 2024-09-14T11:15:25.045+0000 7f60473a2800 10 monclient(hunting): picked mon.noname-c con 0x55e9af6c1070 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:15:25.344 INFO:tasks.workunit.client.0.smithi050.stderr: -269> 2024-09-14T11:15:25.045+0000 7f60473a2800 10 monclient(hunting): picked mon.noname-a con 0x55e9af691fc0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:15:25.344 INFO:tasks.workunit.client.0.smithi050.stderr: -268> 2024-09-14T11:15:25.045+0000 7f60473a2800 10 monclient(hunting): picked mon.noname-b con 0x55e9af6bc910 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:15:25.344 INFO:tasks.workunit.client.0.smithi050.stderr: -267> 2024-09-14T11:15:25.045+0000 7f60473a2800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:25.344 INFO:tasks.workunit.client.0.smithi050.stderr: -266> 2024-09-14T11:15:25.045+0000 7f60473a2800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:25.344 INFO:tasks.workunit.client.0.smithi050.stderr: -265> 2024-09-14T11:15:25.045+0000 7f60473a2800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:25.344 INFO:tasks.workunit.client.0.smithi050.stderr: -264> 2024-09-14T11:15:25.045+0000 7f60473a2800 10 monclient(hunting): _renew_subs 2024-09-14T11:15:25.344 INFO:tasks.workunit.client.0.smithi050.stderr: -263> 2024-09-14T11:15:25.045+0000 7f60473a2800 10 monclient(hunting): authenticate will time out at 2577.683872s 2024-09-14T11:15:25.344 INFO:tasks.workunit.client.0.smithi050.stderr: -262> 2024-09-14T11:15:25.046+0000 7f6044e8c640 10 monclient(hunting): get_auth_request con 0x55e9af6c1070 auth_method 0 2024-09-14T11:15:25.344 INFO:tasks.workunit.client.0.smithi050.stderr: -261> 2024-09-14T11:15:25.046+0000 7f6044e8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:25.344 INFO:tasks.workunit.client.0.smithi050.stderr: -260> 2024-09-14T11:15:25.046+0000 7f6044e8c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:25.344 INFO:tasks.workunit.client.0.smithi050.stderr: -259> 2024-09-14T11:15:25.046+0000 7f6044e8c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:25.344 INFO:tasks.workunit.client.0.smithi050.stderr: -258> 2024-09-14T11:15:25.046+0000 7f603ffff640 10 monclient(hunting): get_auth_request con 0x55e9af691fc0 auth_method 0 2024-09-14T11:15:25.345 INFO:tasks.workunit.client.0.smithi050.stderr: -257> 2024-09-14T11:15:25.046+0000 7f603ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:25.345 INFO:tasks.workunit.client.0.smithi050.stderr: -256> 2024-09-14T11:15:25.046+0000 7f603ffff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:25.345 INFO:tasks.workunit.client.0.smithi050.stderr: -255> 2024-09-14T11:15:25.046+0000 7f603ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:25.345 INFO:tasks.workunit.client.0.smithi050.stderr: -254> 2024-09-14T11:15:25.046+0000 7f6044e8c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:25.345 INFO:tasks.workunit.client.0.smithi050.stderr: -253> 2024-09-14T11:15:25.046+0000 7f6044e8c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:25.345 INFO:tasks.workunit.client.0.smithi050.stderr: -252> 2024-09-14T11:15:25.046+0000 7f6044e8c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:25.345 INFO:tasks.workunit.client.0.smithi050.stderr: -251> 2024-09-14T11:15:25.046+0000 7f604568d640 10 monclient(hunting): get_auth_request con 0x55e9af6bc910 auth_method 0 2024-09-14T11:15:25.345 INFO:tasks.workunit.client.0.smithi050.stderr: -250> 2024-09-14T11:15:25.046+0000 7f604568d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:25.345 INFO:tasks.workunit.client.0.smithi050.stderr: -249> 2024-09-14T11:15:25.046+0000 7f604568d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:25.345 INFO:tasks.workunit.client.0.smithi050.stderr: -248> 2024-09-14T11:15:25.046+0000 7f604568d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:25.345 INFO:tasks.workunit.client.0.smithi050.stderr: -247> 2024-09-14T11:15:25.046+0000 7f603ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:25.345 INFO:tasks.workunit.client.0.smithi050.stderr: -246> 2024-09-14T11:15:25.046+0000 7f603ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:25.345 INFO:tasks.workunit.client.0.smithi050.stderr: -245> 2024-09-14T11:15:25.046+0000 7f603ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:25.345 INFO:tasks.workunit.client.0.smithi050.stderr: -244> 2024-09-14T11:15:25.046+0000 7f604568d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:25.345 INFO:tasks.workunit.client.0.smithi050.stderr: -243> 2024-09-14T11:15:25.046+0000 7f604568d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:25.346 INFO:tasks.workunit.client.0.smithi050.stderr: -242> 2024-09-14T11:15:25.046+0000 7f604568d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:25.346 INFO:tasks.workunit.client.0.smithi050.stderr: -241> 2024-09-14T11:15:25.046+0000 7f603ffff640 10 monclient(hunting): handle_auth_done global_id 8382 payload 274 2024-09-14T11:15:25.346 INFO:tasks.workunit.client.0.smithi050.stderr: -240> 2024-09-14T11:15:25.046+0000 7f603ffff640 10 monclient: _finish_hunting 0 2024-09-14T11:15:25.346 INFO:tasks.workunit.client.0.smithi050.stderr: -239> 2024-09-14T11:15:25.046+0000 7f603ffff640 1 monclient: found mon.noname-a 2024-09-14T11:15:25.346 INFO:tasks.workunit.client.0.smithi050.stderr: -238> 2024-09-14T11:15:25.046+0000 7f603ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:15:25.346 INFO:tasks.workunit.client.0.smithi050.stderr: -237> 2024-09-14T11:15:25.046+0000 7f5f1bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:25.346 INFO:tasks.workunit.client.0.smithi050.stderr: -236> 2024-09-14T11:15:25.046+0000 7f5f1bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:25.346 INFO:tasks.workunit.client.0.smithi050.stderr: -235> 2024-09-14T11:15:25.046+0000 7f5f1bfff640 10 monclient: dump: 2024-09-14T11:15:25.346 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:25.346 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:25.346 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.346 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.346 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:25.346 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:25.347 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:25.347 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:25.347 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:25.347 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.347 INFO:tasks.workunit.client.0.smithi050.stderr: -234> 2024-09-14T11:15:25.046+0000 7f5f1bfff640 10 monclient: _finish_auth 0 2024-09-14T11:15:25.347 INFO:tasks.workunit.client.0.smithi050.stderr: -233> 2024-09-14T11:15:25.046+0000 7f5f1bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:15:25.347 INFO:tasks.workunit.client.0.smithi050.stderr: -232> 2024-09-14T11:15:25.046+0000 7f5f1bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:25.347 INFO:tasks.workunit.client.0.smithi050.stderr: -231> 2024-09-14T11:15:25.046+0000 7f60473a2800 5 monclient: authenticate success, global_id 8382 2024-09-14T11:15:25.347 INFO:tasks.workunit.client.0.smithi050.stderr: -230> 2024-09-14T11:15:25.046+0000 7f60473a2800 10 monclient: get_monmap_and_config success 2024-09-14T11:15:25.347 INFO:tasks.workunit.client.0.smithi050.stderr: -229> 2024-09-14T11:15:25.046+0000 7f60473a2800 4 set_mon_vals no callback set 2024-09-14T11:15:25.347 INFO:tasks.workunit.client.0.smithi050.stderr: -228> 2024-09-14T11:15:25.046+0000 7f5f1bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:25.347 INFO:tasks.workunit.client.0.smithi050.stderr: -227> 2024-09-14T11:15:25.046+0000 7f5f1bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:25.347 INFO:tasks.workunit.client.0.smithi050.stderr: -226> 2024-09-14T11:15:25.046+0000 7f5f1bfff640 10 monclient: dump: 2024-09-14T11:15:25.347 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:25.348 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:25.348 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.348 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.348 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:25.348 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:25.348 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:25.348 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:25.348 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:25.348 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.348 INFO:tasks.workunit.client.0.smithi050.stderr: -225> 2024-09-14T11:15:25.047+0000 7f60473a2800 10 monclient: shutdown 2024-09-14T11:15:25.348 INFO:tasks.workunit.client.0.smithi050.stderr: -224> 2024-09-14T11:15:25.047+0000 7f60473a2800 10 monclient: build_initial_monmap 2024-09-14T11:15:25.348 INFO:tasks.workunit.client.0.smithi050.stderr: -223> 2024-09-14T11:15:25.047+0000 7f60473a2800 1 build_initial for_mkfs: 0 2024-09-14T11:15:25.348 INFO:tasks.workunit.client.0.smithi050.stderr: -222> 2024-09-14T11:15:25.047+0000 7f60473a2800 10 monclient: monmap: 2024-09-14T11:15:25.348 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:15:25.349 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:25.349 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:15:25.349 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:15:25.349 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:25.349 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:25.349 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:15:25.349 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:15:25.349 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:15:25.349 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.349 INFO:tasks.workunit.client.0.smithi050.stderr: -221> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding auth protocol: cephx 2024-09-14T11:15:25.349 INFO:tasks.workunit.client.0.smithi050.stderr: -220> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding auth protocol: cephx 2024-09-14T11:15:25.349 INFO:tasks.workunit.client.0.smithi050.stderr: -219> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding auth protocol: cephx 2024-09-14T11:15:25.350 INFO:tasks.workunit.client.0.smithi050.stderr: -218> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding con mode: secure 2024-09-14T11:15:25.350 INFO:tasks.workunit.client.0.smithi050.stderr: -217> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding con mode: crc 2024-09-14T11:15:25.350 INFO:tasks.workunit.client.0.smithi050.stderr: -216> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding con mode: secure 2024-09-14T11:15:25.350 INFO:tasks.workunit.client.0.smithi050.stderr: -215> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding con mode: crc 2024-09-14T11:15:25.350 INFO:tasks.workunit.client.0.smithi050.stderr: -214> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding con mode: secure 2024-09-14T11:15:25.350 INFO:tasks.workunit.client.0.smithi050.stderr: -213> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding con mode: crc 2024-09-14T11:15:25.350 INFO:tasks.workunit.client.0.smithi050.stderr: -212> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding con mode: crc 2024-09-14T11:15:25.350 INFO:tasks.workunit.client.0.smithi050.stderr: -211> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding con mode: secure 2024-09-14T11:15:25.350 INFO:tasks.workunit.client.0.smithi050.stderr: -210> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding con mode: crc 2024-09-14T11:15:25.350 INFO:tasks.workunit.client.0.smithi050.stderr: -209> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding con mode: secure 2024-09-14T11:15:25.350 INFO:tasks.workunit.client.0.smithi050.stderr: -208> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding con mode: crc 2024-09-14T11:15:25.350 INFO:tasks.workunit.client.0.smithi050.stderr: -207> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding con mode: secure 2024-09-14T11:15:25.350 INFO:tasks.workunit.client.0.smithi050.stderr: -206> 2024-09-14T11:15:25.047+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.350 INFO:tasks.workunit.client.0.smithi050.stderr: -205> 2024-09-14T11:15:25.047+0000 7f60473a2800 1 librados: starting msgr at 2024-09-14T11:15:25.350 INFO:tasks.workunit.client.0.smithi050.stderr: -204> 2024-09-14T11:15:25.047+0000 7f60473a2800 1 librados: starting objecter 2024-09-14T11:15:25.351 INFO:tasks.workunit.client.0.smithi050.stderr: -203> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command objecter_requests cmddesc objecter_requests hook 0x55e9af690d50 EEXIST 2024-09-14T11:15:25.351 INFO:tasks.workunit.client.0.smithi050.stderr: -202> 2024-09-14T11:15:25.047+0000 7f60473a2800 1 librados: setting wanted keys 2024-09-14T11:15:25.351 INFO:tasks.workunit.client.0.smithi050.stderr: -201> 2024-09-14T11:15:25.047+0000 7f60473a2800 1 librados: calling monclient init 2024-09-14T11:15:25.351 INFO:tasks.workunit.client.0.smithi050.stderr: -200> 2024-09-14T11:15:25.047+0000 7f60473a2800 10 monclient: init 2024-09-14T11:15:25.351 INFO:tasks.workunit.client.0.smithi050.stderr: -199> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding auth protocol: cephx 2024-09-14T11:15:25.351 INFO:tasks.workunit.client.0.smithi050.stderr: -198> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding auth protocol: cephx 2024-09-14T11:15:25.351 INFO:tasks.workunit.client.0.smithi050.stderr: -197> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding auth protocol: cephx 2024-09-14T11:15:25.351 INFO:tasks.workunit.client.0.smithi050.stderr: -196> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding con mode: secure 2024-09-14T11:15:25.351 INFO:tasks.workunit.client.0.smithi050.stderr: -195> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding con mode: crc 2024-09-14T11:15:25.351 INFO:tasks.workunit.client.0.smithi050.stderr: -194> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding con mode: secure 2024-09-14T11:15:25.351 INFO:tasks.workunit.client.0.smithi050.stderr: -193> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding con mode: crc 2024-09-14T11:15:25.351 INFO:tasks.workunit.client.0.smithi050.stderr: -192> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding con mode: secure 2024-09-14T11:15:25.351 INFO:tasks.workunit.client.0.smithi050.stderr: -191> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding con mode: crc 2024-09-14T11:15:25.351 INFO:tasks.workunit.client.0.smithi050.stderr: -190> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding con mode: crc 2024-09-14T11:15:25.351 INFO:tasks.workunit.client.0.smithi050.stderr: -189> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding con mode: secure 2024-09-14T11:15:25.352 INFO:tasks.workunit.client.0.smithi050.stderr: -188> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding con mode: crc 2024-09-14T11:15:25.352 INFO:tasks.workunit.client.0.smithi050.stderr: -187> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding con mode: secure 2024-09-14T11:15:25.352 INFO:tasks.workunit.client.0.smithi050.stderr: -186> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding con mode: crc 2024-09-14T11:15:25.352 INFO:tasks.workunit.client.0.smithi050.stderr: -185> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding con mode: secure 2024-09-14T11:15:25.352 INFO:tasks.workunit.client.0.smithi050.stderr: -184> 2024-09-14T11:15:25.047+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.352 INFO:tasks.workunit.client.0.smithi050.stderr: -183> 2024-09-14T11:15:25.048+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.352 INFO:tasks.workunit.client.0.smithi050.stderr: -182> 2024-09-14T11:15:25.048+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command rotate-key cmddesc rotate-key hook 0x55e9af6814e8 EEXIST 2024-09-14T11:15:25.352 INFO:tasks.workunit.client.0.smithi050.stderr: -181> 2024-09-14T11:15:25.048+0000 7f60473a2800 10 monclient: _reopen_session rank -1 2024-09-14T11:15:25.352 INFO:tasks.workunit.client.0.smithi050.stderr: -180> 2024-09-14T11:15:25.048+0000 7f60473a2800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:15:25.352 INFO:tasks.workunit.client.0.smithi050.stderr: -179> 2024-09-14T11:15:25.048+0000 7f60473a2800 10 monclient(hunting): picked mon.noname-c con 0x55e9af691fc0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:15:25.352 INFO:tasks.workunit.client.0.smithi050.stderr: -178> 2024-09-14T11:15:25.048+0000 7f60473a2800 10 monclient(hunting): picked mon.noname-a con 0x55e9af6bc910 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:15:25.352 INFO:tasks.workunit.client.0.smithi050.stderr: -177> 2024-09-14T11:15:25.048+0000 7f60473a2800 10 monclient(hunting): picked mon.noname-b con 0x55e9af6c1070 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:15:25.352 INFO:tasks.workunit.client.0.smithi050.stderr: -176> 2024-09-14T11:15:25.048+0000 7f60473a2800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:25.352 INFO:tasks.workunit.client.0.smithi050.stderr: -175> 2024-09-14T11:15:25.048+0000 7f60473a2800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:25.352 INFO:tasks.workunit.client.0.smithi050.stderr: -174> 2024-09-14T11:15:25.048+0000 7f60473a2800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:25.353 INFO:tasks.workunit.client.0.smithi050.stderr: -173> 2024-09-14T11:15:25.048+0000 7f60473a2800 10 monclient(hunting): _renew_subs 2024-09-14T11:15:25.353 INFO:tasks.workunit.client.0.smithi050.stderr: -172> 2024-09-14T11:15:25.048+0000 7f60473a2800 10 monclient(hunting): authenticate will time out at 2577.686294s 2024-09-14T11:15:25.353 INFO:tasks.workunit.client.0.smithi050.stderr: -171> 2024-09-14T11:15:25.048+0000 7f603ffff640 10 monclient(hunting): get_auth_request con 0x55e9af6bc910 auth_method 0 2024-09-14T11:15:25.353 INFO:tasks.workunit.client.0.smithi050.stderr: -170> 2024-09-14T11:15:25.048+0000 7f603ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:25.353 INFO:tasks.workunit.client.0.smithi050.stderr: -169> 2024-09-14T11:15:25.048+0000 7f603ffff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:25.353 INFO:tasks.workunit.client.0.smithi050.stderr: -168> 2024-09-14T11:15:25.048+0000 7f603ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:25.353 INFO:tasks.workunit.client.0.smithi050.stderr: -167> 2024-09-14T11:15:25.048+0000 7f6044e8c640 10 monclient(hunting): get_auth_request con 0x55e9af691fc0 auth_method 0 2024-09-14T11:15:25.353 INFO:tasks.workunit.client.0.smithi050.stderr: -166> 2024-09-14T11:15:25.048+0000 7f6044e8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:25.353 INFO:tasks.workunit.client.0.smithi050.stderr: -165> 2024-09-14T11:15:25.048+0000 7f6044e8c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:25.353 INFO:tasks.workunit.client.0.smithi050.stderr: -164> 2024-09-14T11:15:25.048+0000 7f6044e8c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:25.353 INFO:tasks.workunit.client.0.smithi050.stderr: -163> 2024-09-14T11:15:25.048+0000 7f603ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:25.353 INFO:tasks.workunit.client.0.smithi050.stderr: -162> 2024-09-14T11:15:25.048+0000 7f603ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:25.353 INFO:tasks.workunit.client.0.smithi050.stderr: -161> 2024-09-14T11:15:25.048+0000 7f603ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:25.354 INFO:tasks.workunit.client.0.smithi050.stderr: -160> 2024-09-14T11:15:25.048+0000 7f6044e8c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:25.354 INFO:tasks.workunit.client.0.smithi050.stderr: -159> 2024-09-14T11:15:25.048+0000 7f6044e8c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:25.354 INFO:tasks.workunit.client.0.smithi050.stderr: -158> 2024-09-14T11:15:25.048+0000 7f6044e8c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:25.354 INFO:tasks.workunit.client.0.smithi050.stderr: -157> 2024-09-14T11:15:25.048+0000 7f604568d640 10 monclient(hunting): get_auth_request con 0x55e9af6c1070 auth_method 0 2024-09-14T11:15:25.354 INFO:tasks.workunit.client.0.smithi050.stderr: -156> 2024-09-14T11:15:25.048+0000 7f604568d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:25.354 INFO:tasks.workunit.client.0.smithi050.stderr: -155> 2024-09-14T11:15:25.048+0000 7f604568d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:25.354 INFO:tasks.workunit.client.0.smithi050.stderr: -154> 2024-09-14T11:15:25.048+0000 7f604568d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:25.354 INFO:tasks.workunit.client.0.smithi050.stderr: -153> 2024-09-14T11:15:25.048+0000 7f604568d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:25.354 INFO:tasks.workunit.client.0.smithi050.stderr: -152> 2024-09-14T11:15:25.048+0000 7f604568d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:25.354 INFO:tasks.workunit.client.0.smithi050.stderr: -151> 2024-09-14T11:15:25.048+0000 7f604568d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:25.354 INFO:tasks.workunit.client.0.smithi050.stderr: -150> 2024-09-14T11:15:25.048+0000 7f603ffff640 10 monclient(hunting): handle_auth_done global_id 8385 payload 824 2024-09-14T11:15:25.354 INFO:tasks.workunit.client.0.smithi050.stderr: -149> 2024-09-14T11:15:25.048+0000 7f603ffff640 10 monclient: _finish_hunting 0 2024-09-14T11:15:25.354 INFO:tasks.workunit.client.0.smithi050.stderr: -148> 2024-09-14T11:15:25.048+0000 7f603ffff640 1 monclient: found mon.noname-a 2024-09-14T11:15:25.354 INFO:tasks.workunit.client.0.smithi050.stderr: -147> 2024-09-14T11:15:25.048+0000 7f603ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:15:25.354 INFO:tasks.workunit.client.0.smithi050.stderr: -146> 2024-09-14T11:15:25.049+0000 7f5f1a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:25.354 INFO:tasks.workunit.client.0.smithi050.stderr: -145> 2024-09-14T11:15:25.049+0000 7f5f1a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:25.355 INFO:tasks.workunit.client.0.smithi050.stderr: -144> 2024-09-14T11:15:25.049+0000 7f5f1a7fc640 10 monclient: dump: 2024-09-14T11:15:25.355 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:25.355 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:25.355 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.355 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.355 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:25.355 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:25.355 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:25.355 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:25.355 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:25.355 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.355 INFO:tasks.workunit.client.0.smithi050.stderr: -143> 2024-09-14T11:15:25.049+0000 7f5f1a7fc640 10 monclient: _finish_auth 0 2024-09-14T11:15:25.355 INFO:tasks.workunit.client.0.smithi050.stderr: -142> 2024-09-14T11:15:25.049+0000 7f5f1a7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:15:25.355 INFO:tasks.workunit.client.0.smithi050.stderr: -141> 2024-09-14T11:15:25.049+0000 7f5f1a7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:25.356 INFO:tasks.workunit.client.0.smithi050.stderr: -140> 2024-09-14T11:15:25.049+0000 7f5f1a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:25.356 INFO:tasks.workunit.client.0.smithi050.stderr: -139> 2024-09-14T11:15:25.049+0000 7f5f1a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:25.356 INFO:tasks.workunit.client.0.smithi050.stderr: -138> 2024-09-14T11:15:25.049+0000 7f5f1a7fc640 10 monclient: dump: 2024-09-14T11:15:25.356 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:25.356 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:25.356 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.356 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.356 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:25.356 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:25.356 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:25.356 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:25.356 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:25.356 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.356 INFO:tasks.workunit.client.0.smithi050.stderr: -137> 2024-09-14T11:15:25.049+0000 7f60473a2800 5 monclient: authenticate success, global_id 8385 2024-09-14T11:15:25.356 INFO:tasks.workunit.client.0.smithi050.stderr: -136> 2024-09-14T11:15:25.049+0000 7f60473a2800 10 monclient: _renew_subs 2024-09-14T11:15:25.357 INFO:tasks.workunit.client.0.smithi050.stderr: -135> 2024-09-14T11:15:25.049+0000 7f5f1bfff640 4 set_mon_vals no callback set 2024-09-14T11:15:25.357 INFO:tasks.workunit.client.0.smithi050.stderr: -134> 2024-09-14T11:15:25.049+0000 7f60473a2800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:15:25.357 INFO:tasks.workunit.client.0.smithi050.stderr: -133> 2024-09-14T11:15:25.049+0000 7f60473a2800 10 monclient: _renew_subs 2024-09-14T11:15:25.357 INFO:tasks.workunit.client.0.smithi050.stderr: -132> 2024-09-14T11:15:25.049+0000 7f60473a2800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:15:25.357 INFO:tasks.workunit.client.0.smithi050.stderr: -131> 2024-09-14T11:15:25.049+0000 7f60473a2800 1 librados: init done 2024-09-14T11:15:25.357 INFO:tasks.workunit.client.0.smithi050.stderr: -130> 2024-09-14T11:15:25.049+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command cr dump hook 0x55e9af6b30c8 2024-09-14T11:15:25.357 INFO:tasks.workunit.client.0.smithi050.stderr: -129> 2024-09-14T11:15:25.051+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.357 INFO:tasks.workunit.client.0.smithi050.stderr: -128> 2024-09-14T11:15:25.051+0000 7f5f1a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:15:25.357 INFO:tasks.workunit.client.0.smithi050.stderr: -127> 2024-09-14T11:15:25.051+0000 7f5f1a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:15:25.357 INFO:tasks.workunit.client.0.smithi050.stderr: -126> 2024-09-14T11:15:25.051+0000 7f5f1a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:15:25.357 INFO:tasks.workunit.client.0.smithi050.stderr: -125> 2024-09-14T11:15:25.052+0000 7f6044e8c640 10 monclient: get_auth_request con 0x7f5f10077260 auth_method 0 2024-09-14T11:15:25.357 INFO:tasks.workunit.client.0.smithi050.stderr: -124> 2024-09-14T11:15:25.052+0000 7f604568d640 10 monclient: get_auth_request con 0x55e9af6db060 auth_method 0 2024-09-14T11:15:25.357 INFO:tasks.workunit.client.0.smithi050.stderr: -123> 2024-09-14T11:15:25.052+0000 7f5f1a7fc640 1 client.8385.objecter ms_handle_reset 0x55e9af6db060 session 0x55e9af6da950 osd.6 2024-09-14T11:15:25.357 INFO:tasks.workunit.client.0.smithi050.stderr: -122> 2024-09-14T11:15:25.052+0000 7f5f1a7fc640 10 monclient: _renew_subs 2024-09-14T11:15:25.357 INFO:tasks.workunit.client.0.smithi050.stderr: -121> 2024-09-14T11:15:25.052+0000 7f5f1a7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:15:25.358 INFO:tasks.workunit.client.0.smithi050.stderr: -120> 2024-09-14T11:15:25.053+0000 7f604568d640 10 monclient: get_auth_request con 0x7f5f10087510 auth_method 0 2024-09-14T11:15:25.358 INFO:tasks.workunit.client.0.smithi050.stderr: -119> 2024-09-14T11:15:25.053+0000 7f60473a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.358 INFO:tasks.workunit.client.0.smithi050.stderr: -118> 2024-09-14T11:15:25.053+0000 7f60473a2800 20 realm 2024-09-14T11:15:25.358 INFO:tasks.workunit.client.0.smithi050.stderr: -117> 2024-09-14T11:15:25.053+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.358 INFO:tasks.workunit.client.0.smithi050.stderr: -116> 2024-09-14T11:15:25.054+0000 7f60473a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.358 INFO:tasks.workunit.client.0.smithi050.stderr: -115> 2024-09-14T11:15:25.054+0000 7f60473a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:25.358 INFO:tasks.workunit.client.0.smithi050.stderr: -114> 2024-09-14T11:15:25.054+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.358 INFO:tasks.workunit.client.0.smithi050.stderr: -113> 2024-09-14T11:15:25.054+0000 7f60473a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.358 INFO:tasks.workunit.client.0.smithi050.stderr: -112> 2024-09-14T11:15:25.054+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.358 INFO:tasks.workunit.client.0.smithi050.stderr: -111> 2024-09-14T11:15:25.054+0000 7f6044e8c640 10 monclient: get_auth_request con 0x55e9af6dc6b0 auth_method 0 2024-09-14T11:15:25.358 INFO:tasks.workunit.client.0.smithi050.stderr: -110> 2024-09-14T11:15:25.055+0000 7f60473a2800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:25.358 INFO:tasks.workunit.client.0.smithi050.stderr: -109> 2024-09-14T11:15:25.055+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.358 INFO:tasks.workunit.client.0.smithi050.stderr: -108> 2024-09-14T11:15:25.055+0000 7f603ffff640 10 monclient: get_auth_request con 0x55e9af6e04c0 auth_method 0 2024-09-14T11:15:25.358 INFO:tasks.workunit.client.0.smithi050.stderr: -107> 2024-09-14T11:15:25.055+0000 7f60473a2800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:25.359 INFO:tasks.workunit.client.0.smithi050.stderr: -106> 2024-09-14T11:15:25.055+0000 7f60473a2800 20 searching for the correct realm 2024-09-14T11:15:25.359 INFO:tasks.workunit.client.0.smithi050.stderr: -105> 2024-09-14T11:15:25.056+0000 7f604568d640 10 monclient: get_auth_request con 0x55e9af6e51e0 auth_method 0 2024-09-14T11:15:25.359 INFO:tasks.workunit.client.0.smithi050.stderr: -104> 2024-09-14T11:15:25.057+0000 7f6044e8c640 10 monclient: get_auth_request con 0x7f604006b430 auth_method 0 2024-09-14T11:15:25.359 INFO:tasks.workunit.client.0.smithi050.stderr: -103> 2024-09-14T11:15:25.058+0000 7f6044e8c640 0 -- 172.21.15.50:0/3504865384 >> [v2:172.21.15.50:6800/2565843969,v1:172.21.15.50:6801/2565843969] conn(0x55e9af6dc6b0 msgr2=0x55e9af6dcb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:25.359 INFO:tasks.workunit.client.0.smithi050.stderr: -102> 2024-09-14T11:15:25.058+0000 7f5f1a7fc640 1 client.8385.objecter ms_handle_reset 0x55e9af6dc6b0 session 0x55e9af6da750 osd.1 2024-09-14T11:15:25.359 INFO:tasks.workunit.client.0.smithi050.stderr: -101> 2024-09-14T11:15:25.058+0000 7f6044e8c640 10 monclient: get_auth_request con 0x55e9af6db060 auth_method 0 2024-09-14T11:15:25.359 INFO:tasks.workunit.client.0.smithi050.stderr: -100> 2024-09-14T11:15:25.059+0000 7f603ffff640 10 monclient: get_auth_request con 0x7f6040055920 auth_method 0 2024-09-14T11:15:25.359 INFO:tasks.workunit.client.0.smithi050.stderr: -99> 2024-09-14T11:15:25.061+0000 7f604568d640 10 monclient: get_auth_request con 0x7f60380682b0 auth_method 0 2024-09-14T11:15:25.359 INFO:tasks.workunit.client.0.smithi050.stderr: -98> 2024-09-14T11:15:25.062+0000 7f6044e8c640 0 -- 172.21.15.50:0/3504865384 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f6040090400 msgr2=0x7f6040090880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:25.359 INFO:tasks.workunit.client.0.smithi050.stderr: -97> 2024-09-14T11:15:25.263+0000 7f6044e8c640 10 monclient: get_auth_request con 0x7f6040090400 auth_method 0 2024-09-14T11:15:25.359 INFO:tasks.workunit.client.0.smithi050.stderr: -96> 2024-09-14T11:15:25.270+0000 7f60473a2800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:15:25.359 INFO:tasks.workunit.client.0.smithi050.stderr: -95> 2024-09-14T11:15:25.270+0000 7f60473a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:25.359 INFO:tasks.workunit.client.0.smithi050.stderr: -94> 2024-09-14T11:15:25.270+0000 7f60473a2800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:15:25.359 INFO:tasks.workunit.client.0.smithi050.stderr: -93> 2024-09-14T11:15:25.270+0000 7f60473a2800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:25.360 INFO:tasks.workunit.client.0.smithi050.stderr: -92> 2024-09-14T11:15:25.270+0000 7f60473a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:25.360 INFO:tasks.workunit.client.0.smithi050.stderr: -91> 2024-09-14T11:15:25.270+0000 7f60473a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:25.360 INFO:tasks.workunit.client.0.smithi050.stderr: -90> 2024-09-14T11:15:25.270+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.360 INFO:tasks.workunit.client.0.smithi050.stderr: -89> 2024-09-14T11:15:25.270+0000 7f60473a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.360 INFO:tasks.workunit.client.0.smithi050.stderr: -88> 2024-09-14T11:15:25.270+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.360 INFO:tasks.workunit.client.0.smithi050.stderr: -87> 2024-09-14T11:15:25.271+0000 7f60473a2800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:25.360 INFO:tasks.workunit.client.0.smithi050.stderr: -86> 2024-09-14T11:15:25.271+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.360 INFO:tasks.workunit.client.0.smithi050.stderr: -85> 2024-09-14T11:15:25.271+0000 7f60473a2800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:25.360 INFO:tasks.workunit.client.0.smithi050.stderr: -84> 2024-09-14T11:15:25.271+0000 7f60473a2800 20 zone default found 2024-09-14T11:15:25.360 INFO:tasks.workunit.client.0.smithi050.stderr: -83> 2024-09-14T11:15:25.271+0000 7f60473a2800 4 Realm: () 2024-09-14T11:15:25.360 INFO:tasks.workunit.client.0.smithi050.stderr: -82> 2024-09-14T11:15:25.271+0000 7f60473a2800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:15:25.360 INFO:tasks.workunit.client.0.smithi050.stderr: -81> 2024-09-14T11:15:25.271+0000 7f60473a2800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:15:25.360 INFO:tasks.workunit.client.0.smithi050.stderr: -80> 2024-09-14T11:15:25.271+0000 7f60473a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:25.360 INFO:tasks.workunit.client.0.smithi050.stderr: -79> 2024-09-14T11:15:25.271+0000 7f60473a2800 20 zonegroup default 2024-09-14T11:15:25.361 INFO:tasks.workunit.client.0.smithi050.stderr: -78> 2024-09-14T11:15:25.271+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.361 INFO:tasks.workunit.client.0.smithi050.stderr: -77> 2024-09-14T11:15:25.271+0000 7f60473a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.361 INFO:tasks.workunit.client.0.smithi050.stderr: -76> 2024-09-14T11:15:25.272+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.361 INFO:tasks.workunit.client.0.smithi050.stderr: -75> 2024-09-14T11:15:25.272+0000 7f60473a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.361 INFO:tasks.workunit.client.0.smithi050.stderr: -74> 2024-09-14T11:15:25.272+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.361 INFO:tasks.workunit.client.0.smithi050.stderr: -73> 2024-09-14T11:15:25.272+0000 7f60473a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.361 INFO:tasks.workunit.client.0.smithi050.stderr: -72> 2024-09-14T11:15:25.272+0000 7f60473a2800 20 started sync module instance, tier type = 2024-09-14T11:15:25.361 INFO:tasks.workunit.client.0.smithi050.stderr: -71> 2024-09-14T11:15:25.272+0000 7f60473a2800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:15:25.361 INFO:tasks.workunit.client.0.smithi050.stderr: -70> 2024-09-14T11:15:25.282+0000 7f60473a2800 20 add_watcher() i=0 2024-09-14T11:15:25.361 INFO:tasks.workunit.client.0.smithi050.stderr: -69> 2024-09-14T11:15:25.282+0000 7f60473a2800 20 add_watcher() i=1 2024-09-14T11:15:25.361 INFO:tasks.workunit.client.0.smithi050.stderr: -68> 2024-09-14T11:15:25.282+0000 7f60473a2800 20 add_watcher() i=2 2024-09-14T11:15:25.361 INFO:tasks.workunit.client.0.smithi050.stderr: -67> 2024-09-14T11:15:25.282+0000 7f60473a2800 20 add_watcher() i=3 2024-09-14T11:15:25.361 INFO:tasks.workunit.client.0.smithi050.stderr: -66> 2024-09-14T11:15:25.282+0000 7f60473a2800 20 add_watcher() i=4 2024-09-14T11:15:25.362 INFO:tasks.workunit.client.0.smithi050.stderr: -65> 2024-09-14T11:15:25.282+0000 7f60473a2800 20 add_watcher() i=5 2024-09-14T11:15:25.362 INFO:tasks.workunit.client.0.smithi050.stderr: -64> 2024-09-14T11:15:25.282+0000 7f60473a2800 20 add_watcher() i=6 2024-09-14T11:15:25.362 INFO:tasks.workunit.client.0.smithi050.stderr: -63> 2024-09-14T11:15:25.284+0000 7f60473a2800 20 add_watcher() i=7 2024-09-14T11:15:25.362 INFO:tasks.workunit.client.0.smithi050.stderr: -62> 2024-09-14T11:15:25.284+0000 7f60473a2800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:25.362 INFO:tasks.workunit.client.0.smithi050.stderr: -61> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding auth protocol: cephx 2024-09-14T11:15:25.362 INFO:tasks.workunit.client.0.smithi050.stderr: -60> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding auth protocol: cephx 2024-09-14T11:15:25.362 INFO:tasks.workunit.client.0.smithi050.stderr: -59> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding auth protocol: cephx 2024-09-14T11:15:25.362 INFO:tasks.workunit.client.0.smithi050.stderr: -58> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding con mode: secure 2024-09-14T11:15:25.362 INFO:tasks.workunit.client.0.smithi050.stderr: -57> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding con mode: crc 2024-09-14T11:15:25.362 INFO:tasks.workunit.client.0.smithi050.stderr: -56> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding con mode: secure 2024-09-14T11:15:25.362 INFO:tasks.workunit.client.0.smithi050.stderr: -55> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding con mode: crc 2024-09-14T11:15:25.362 INFO:tasks.workunit.client.0.smithi050.stderr: -54> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding con mode: secure 2024-09-14T11:15:25.362 INFO:tasks.workunit.client.0.smithi050.stderr: -53> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding con mode: crc 2024-09-14T11:15:25.362 INFO:tasks.workunit.client.0.smithi050.stderr: -52> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding con mode: crc 2024-09-14T11:15:25.363 INFO:tasks.workunit.client.0.smithi050.stderr: -51> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding con mode: secure 2024-09-14T11:15:25.363 INFO:tasks.workunit.client.0.smithi050.stderr: -50> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding con mode: crc 2024-09-14T11:15:25.363 INFO:tasks.workunit.client.0.smithi050.stderr: -49> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding con mode: secure 2024-09-14T11:15:25.363 INFO:tasks.workunit.client.0.smithi050.stderr: -48> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding con mode: crc 2024-09-14T11:15:25.363 INFO:tasks.workunit.client.0.smithi050.stderr: -47> 2024-09-14T11:15:25.286+0000 7f5efafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:25.363 INFO:tasks.workunit.client.0.smithi050.stderr: -46> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding con mode: secure 2024-09-14T11:15:25.363 INFO:tasks.workunit.client.0.smithi050.stderr: -45> 2024-09-14T11:15:25.286+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.363 INFO:tasks.workunit.client.0.smithi050.stderr: -44> 2024-09-14T11:15:25.286+0000 7f60473a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:25.363 INFO:tasks.workunit.client.0.smithi050.stderr: -43> 2024-09-14T11:15:25.286+0000 7f60473a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:25.363 INFO:tasks.workunit.client.0.smithi050.stderr: -42> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command cache list hook 0x55e9af6b8af0 2024-09-14T11:15:25.363 INFO:tasks.workunit.client.0.smithi050.stderr: -41> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command cache inspect hook 0x55e9af6b8af0 2024-09-14T11:15:25.363 INFO:tasks.workunit.client.0.smithi050.stderr: -40> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command cache erase hook 0x55e9af6b8af0 2024-09-14T11:15:25.363 INFO:tasks.workunit.client.0.smithi050.stderr: -39> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command cache zap hook 0x55e9af6b8af0 2024-09-14T11:15:25.363 INFO:tasks.workunit.client.0.smithi050.stderr: -38> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 note: GC not initialized 2024-09-14T11:15:25.363 INFO:tasks.workunit.client.0.smithi050.stderr: -37> 2024-09-14T11:15:25.286+0000 7f5ef9fe3640 20 reqs_thread_entry: start 2024-09-14T11:15:25.364 INFO:tasks.workunit.client.0.smithi050.stderr: -36> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command sync trace show hook 0x7f6038065040 2024-09-14T11:15:25.364 INFO:tasks.workunit.client.0.smithi050.stderr: -35> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command sync trace history hook 0x7f6038065040 2024-09-14T11:15:25.364 INFO:tasks.workunit.client.0.smithi050.stderr: -34> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command sync trace active hook 0x7f6038065040 2024-09-14T11:15:25.364 INFO:tasks.workunit.client.0.smithi050.stderr: -33> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command sync trace active_short hook 0x7f6038065040 2024-09-14T11:15:25.364 INFO:tasks.workunit.client.0.smithi050.stderr: -32> 2024-09-14T11:15:25.286+0000 7f60473a2800 20 init_complete bucket index max shards: 11 2024-09-14T11:15:25.364 INFO:tasks.workunit.client.0.smithi050.stderr: -31> 2024-09-14T11:15:25.287+0000 7f60473a2800 20 Filter name: none 2024-09-14T11:15:25.364 INFO:tasks.workunit.client.0.smithi050.stderr: -30> 2024-09-14T11:15:25.287+0000 7f5e6b7fe640 20 reqs_thread_entry: start 2024-09-14T11:15:25.364 INFO:tasks.workunit.client.0.smithi050.stderr: -29> 2024-09-14T11:15:25.287+0000 7f60473a2800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:15:25.364 INFO:tasks.workunit.client.0.smithi050.stderr: -28> 2024-09-14T11:15:25.287+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.364 INFO:tasks.workunit.client.0.smithi050.stderr: -27> 2024-09-14T11:15:25.287+0000 7f60473a2800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:15:25.364 INFO:tasks.workunit.client.0.smithi050.stderr: -26> 2024-09-14T11:15:25.287+0000 7f60473a2800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:15:25.364 INFO:tasks.workunit.client.0.smithi050.stderr: -25> 2024-09-14T11:15:25.287+0000 7f60473a2800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:15:25.364 INFO:tasks.workunit.client.0.smithi050.stderr: -24> 2024-09-14T11:15:25.287+0000 7f60473a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : miss 2024-09-14T11:15:25.364 INFO:tasks.workunit.client.0.smithi050.stderr: -23> 2024-09-14T11:15:25.287+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.365 INFO:tasks.workunit.client.0.smithi050.stderr: -22> 2024-09-14T11:15:25.288+0000 7f60473a2800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:15:25.365 INFO:tasks.workunit.client.0.smithi050.stderr: -21> 2024-09-14T11:15:25.288+0000 7f60473a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:15:25.365 INFO:tasks.workunit.client.0.smithi050.stderr: -20> 2024-09-14T11:15:25.288+0000 7f60473a2800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:15:25.365 INFO:tasks.workunit.client.0.smithi050.stderr: -19> 2024-09-14T11:15:25.288+0000 7f60473a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:25.365 INFO:tasks.workunit.client.0.smithi050.stderr: -18> 2024-09-14T11:15:25.288+0000 7f60473a2800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:25.365 INFO:tasks.workunit.client.0.smithi050.stderr: -17> 2024-09-14T11:15:25.288+0000 7f60473a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:15:25.365 INFO:tasks.workunit.client.0.smithi050.stderr: -16> 2024-09-14T11:15:25.289+0000 7f60473a2800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:15:25.365 INFO:tasks.workunit.client.0.smithi050.stderr: -15> 2024-09-14T11:15:25.293+0000 7f5f1a7fc640 1 client.8385.objecter ms_handle_reset 0x7f6040090400 session 0x7f6040055d80 osd.3 2024-09-14T11:15:25.365 INFO:tasks.workunit.client.0.smithi050.stderr: -14> 2024-09-14T11:15:25.294+0000 7f6044e8c640 10 monclient: get_auth_request con 0x55e9af6dc6b0 auth_method 0 2024-09-14T11:15:25.365 INFO:tasks.workunit.client.0.smithi050.stderr: -13> 2024-09-14T11:15:25.297+0000 7f60473a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:15:25.365 INFO:tasks.workunit.client.0.smithi050.stderr: -12> 2024-09-14T11:15:25.297+0000 7f60473a2800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:15:25.365 INFO:tasks.workunit.client.0.smithi050.stderr: -11> 2024-09-14T11:15:25.297+0000 7f60473a2800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:25.365 INFO:tasks.workunit.client.0.smithi050.stderr: -10> 2024-09-14T11:15:25.297+0000 7f60473a2800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18, ofs0, ns] 2024-09-14T11:15:25.365 INFO:tasks.workunit.client.0.smithi050.stderr: -9> 2024-09-14T11:15:25.298+0000 7f5f1bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497134 cookie 94462159002096 notifier 8385 bl.length()=911 2024-09-14T11:15:25.366 INFO:tasks.workunit.client.0.smithi050.stderr: -8> 2024-09-14T11:15:25.298+0000 7f5f1bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:15:25.366 INFO:tasks.workunit.client.0.smithi050.stderr: -7> 2024-09-14T11:15:25.298+0000 7f5f1bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:15:25.366 INFO:tasks.workunit.client.0.smithi050.stderr: -6> 2024-09-14T11:15:25.298+0000 7f5f1bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:25.366 INFO:tasks.workunit.client.0.smithi050.stderr: -5> 2024-09-14T11:15:25.299+0000 7f60473a2800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_sources= new_sources= 2024-09-14T11:15:25.366 INFO:tasks.workunit.client.0.smithi050.stderr: -4> 2024-09-14T11:15:25.299+0000 7f60473a2800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential sources added=[] removed=[] 2024-09-14T11:15:25.366 INFO:tasks.workunit.client.0.smithi050.stderr: -3> 2024-09-14T11:15:25.299+0000 7f60473a2800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_dests= new_dests= 2024-09-14T11:15:25.366 INFO:tasks.workunit.client.0.smithi050.stderr: -2> 2024-09-14T11:15:25.299+0000 7f60473a2800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential dests added=[] removed=[] 2024-09-14T11:15:25.366 INFO:tasks.workunit.client.0.smithi050.stderr: -1> 2024-09-14T11:15:25.304+0000 7f60473a2800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f60473a2800 time 2024-09-14T11:15:25.304878+0000 2024-09-14T11:15:25.366 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:15:25.366 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.366 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:25.366 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f604a98c76a] 2024-09-14T11:15:25.366 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f604a98c928] 2024-09-14T11:15:25.366 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e9ad2a40b1] 2024-09-14T11:15:25.367 INFO:tasks.workunit.client.0.smithi050.stderr: 4: radosgw-admin(+0xd8907c) [0x55e9ad7b807c] 2024-09-14T11:15:25.367 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e9ad2b3efd] 2024-09-14T11:15:25.367 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:15:25.367 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6049629590] 2024-09-14T11:15:25.367 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:15:25.367 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:15:25.367 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.367 INFO:tasks.workunit.client.0.smithi050.stderr: 0> 2024-09-14T11:15:25.305+0000 7f60473a2800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:15:25.367 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f60473a2800 thread_name:radosgw-admin 2024-09-14T11:15:25.367 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.367 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:25.367 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f604963e6f0] 2024-09-14T11:15:25.367 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f604968b99c] 2024-09-14T11:15:25.367 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:15:25.367 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:15:25.368 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f604a98c7c4] 2024-09-14T11:15:25.368 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f604a98c928] 2024-09-14T11:15:25.368 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e9ad2a40b1] 2024-09-14T11:15:25.368 INFO:tasks.workunit.client.0.smithi050.stderr: 8: radosgw-admin(+0xd8907c) [0x55e9ad7b807c] 2024-09-14T11:15:25.368 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e9ad2b3efd] 2024-09-14T11:15:25.368 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:15:25.368 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6049629590] 2024-09-14T11:15:25.368 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:15:25.368 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:15:25.368 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:15:25.368 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.368 INFO:tasks.workunit.client.0.smithi050.stderr:--- logging levels --- 2024-09-14T11:15:25.368 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 none 2024-09-14T11:15:25.368 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 lockdep 2024-09-14T11:15:25.369 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 context 2024-09-14T11:15:25.369 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 crush 2024-09-14T11:15:25.369 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds 2024-09-14T11:15:25.369 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_balancer 2024-09-14T11:15:25.369 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_locker 2024-09-14T11:15:25.369 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log 2024-09-14T11:15:25.369 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log_expire 2024-09-14T11:15:25.369 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_migrator 2024-09-14T11:15:25.369 INFO:tasks.workunit.client.0.smithi050.stderr: 3/ 5 mds_quiesce 2024-09-14T11:15:25.369 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 buffer 2024-09-14T11:15:25.369 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 timer 2024-09-14T11:15:25.369 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 filer 2024-09-14T11:15:25.369 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 striper 2024-09-14T11:15:25.369 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 objecter 2024-09-14T11:15:25.369 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rados 2024-09-14T11:15:25.370 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd 2024-09-14T11:15:25.370 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_mirror 2024-09-14T11:15:25.370 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_replay 2024-09-14T11:15:25.370 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_pwl 2024-09-14T11:15:25.370 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 journaler 2024-09-14T11:15:25.370 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objectcacher 2024-09-14T11:15:25.370 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:15:25.370 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 client 2024-09-14T11:15:25.370 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 osd 2024-09-14T11:15:25.370 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 optracker 2024-09-14T11:15:25.370 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objclass 2024-09-14T11:15:25.370 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 filestore 2024-09-14T11:15:25.370 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 journal 2024-09-14T11:15:25.370 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 ms 2024-09-14T11:15:25.370 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mon 2024-09-14T11:15:25.371 INFO:tasks.workunit.client.0.smithi050.stderr: 0/10 monc 2024-09-14T11:15:25.371 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 paxos 2024-09-14T11:15:25.371 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 tp 2024-09-14T11:15:25.371 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 auth 2024-09-14T11:15:25.371 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 crypto 2024-09-14T11:15:25.371 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 finisher 2024-09-14T11:15:25.371 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 reserver 2024-09-14T11:15:25.371 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 heartbeatmap 2024-09-14T11:15:25.371 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 perfcounter 2024-09-14T11:15:25.371 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw 2024-09-14T11:15:25.371 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_sync 2024-09-14T11:15:25.371 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_datacache 2024-09-14T11:15:25.371 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_access 2024-09-14T11:15:25.371 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:15:25.371 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_flight 2024-09-14T11:15:25.371 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:15:25.372 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw_notification 2024-09-14T11:15:25.372 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 javaclient 2024-09-14T11:15:25.372 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 asok 2024-09-14T11:15:25.372 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 throttle 2024-09-14T11:15:25.372 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 refs 2024-09-14T11:15:25.372 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 compressor 2024-09-14T11:15:25.372 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluestore 2024-09-14T11:15:25.372 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluefs 2024-09-14T11:15:25.372 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 bdev 2024-09-14T11:15:25.372 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 kstore 2024-09-14T11:15:25.372 INFO:tasks.workunit.client.0.smithi050.stderr: 4/ 5 rocksdb 2024-09-14T11:15:25.372 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 fuse 2024-09-14T11:15:25.372 INFO:tasks.workunit.client.0.smithi050.stderr: 2/ 5 mgr 2024-09-14T11:15:25.372 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mgrc 2024-09-14T11:15:25.372 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 dpdk 2024-09-14T11:15:25.372 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 eventtrace 2024-09-14T11:15:25.373 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 prioritycache 2024-09-14T11:15:25.373 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 test 2024-09-14T11:15:25.373 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:15:25.373 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephsqlite 2024-09-14T11:15:25.373 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:15:25.373 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore 2024-09-14T11:15:25.373 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_onode 2024-09-14T11:15:25.373 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_odata 2024-09-14T11:15:25.373 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_omap 2024-09-14T11:15:25.373 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_tm 2024-09-14T11:15:25.373 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_t 2024-09-14T11:15:25.373 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:15:25.373 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_epm 2024-09-14T11:15:25.373 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_lba 2024-09-14T11:15:25.374 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:15:25.374 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cache 2024-09-14T11:15:25.374 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_journal 2024-09-14T11:15:25.374 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_device 2024-09-14T11:15:25.374 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_backref 2024-09-14T11:15:25.374 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 alienstore 2024-09-14T11:15:25.374 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mclock 2024-09-14T11:15:25.374 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cyanstore 2024-09-14T11:15:25.374 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 ceph_exporter 2024-09-14T11:15:25.374 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 memstore 2024-09-14T11:15:25.374 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 trace 2024-09-14T11:15:25.374 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 ceph_dedup 2024-09-14T11:15:25.374 INFO:tasks.workunit.client.0.smithi050.stderr: -2/-2 (syslog threshold) 2024-09-14T11:15:25.374 INFO:tasks.workunit.client.0.smithi050.stderr: 99/99 (stderr threshold) 2024-09-14T11:15:25.374 INFO:tasks.workunit.client.0.smithi050.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:15:25.374 INFO:tasks.workunit.client.0.smithi050.stderr: 7f5e6b7fe640 / http_manager 2024-09-14T11:15:25.375 INFO:tasks.workunit.client.0.smithi050.stderr: 7f5ef9fe3640 / http_manager 2024-09-14T11:15:25.375 INFO:tasks.workunit.client.0.smithi050.stderr: 7f5efafe5640 / rgw_dt_lg_renew 2024-09-14T11:15:25.375 INFO:tasks.workunit.client.0.smithi050.stderr: 7f5f1a7fc640 / ms_dispatch 2024-09-14T11:15:25.375 INFO:tasks.workunit.client.0.smithi050.stderr: 7f5f1bfff640 / io_context_pool 2024-09-14T11:15:25.375 INFO:tasks.workunit.client.0.smithi050.stderr: 7f5f2a7fc640 / ms_dispatch 2024-09-14T11:15:25.375 INFO:tasks.workunit.client.0.smithi050.stderr: 7f5f31602640 / ms_dispatch 2024-09-14T11:15:25.375 INFO:tasks.workunit.client.0.smithi050.stderr: 7f5f32e05640 / io_context_pool 2024-09-14T11:15:25.375 INFO:tasks.workunit.client.0.smithi050.stderr: 7f603ffff640 / msgr-worker-2 2024-09-14T11:15:25.375 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6044e8c640 / msgr-worker-1 2024-09-14T11:15:25.375 INFO:tasks.workunit.client.0.smithi050.stderr: 7f604568d640 / msgr-worker-0 2024-09-14T11:15:25.375 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6045e8e640 / io_context_pool 2024-09-14T11:15:25.375 INFO:tasks.workunit.client.0.smithi050.stderr: 7f60473a2800 / radosgw-admin 2024-09-14T11:15:25.375 INFO:tasks.workunit.client.0.smithi050.stderr: max_recent 500 2024-09-14T11:15:25.375 INFO:tasks.workunit.client.0.smithi050.stderr: max_new 1000 2024-09-14T11:15:25.375 INFO:tasks.workunit.client.0.smithi050.stderr: log_file /var/log/ceph/ceph-client.admin.153222.log 2024-09-14T11:15:25.375 INFO:tasks.workunit.client.0.smithi050.stderr:--- end dump of recent events --- 2024-09-14T11:15:25.376 INFO:tasks.workunit.client.0.smithi050.stderr:--- begin dump of recent events --- 2024-09-14T11:15:25.376 INFO:tasks.workunit.client.0.smithi050.stderr: -499> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding auth protocol: cephx 2024-09-14T11:15:25.376 INFO:tasks.workunit.client.0.smithi050.stderr: -498> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding auth protocol: cephx 2024-09-14T11:15:25.376 INFO:tasks.workunit.client.0.smithi050.stderr: -497> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding auth protocol: cephx 2024-09-14T11:15:25.376 INFO:tasks.workunit.client.0.smithi050.stderr: -496> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding con mode: secure 2024-09-14T11:15:25.376 INFO:tasks.workunit.client.0.smithi050.stderr: -495> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding con mode: crc 2024-09-14T11:15:25.376 INFO:tasks.workunit.client.0.smithi050.stderr: -494> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding con mode: secure 2024-09-14T11:15:25.376 INFO:tasks.workunit.client.0.smithi050.stderr: -493> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding con mode: crc 2024-09-14T11:15:25.376 INFO:tasks.workunit.client.0.smithi050.stderr: -492> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding con mode: secure 2024-09-14T11:15:25.376 INFO:tasks.workunit.client.0.smithi050.stderr: -491> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding con mode: crc 2024-09-14T11:15:25.376 INFO:tasks.workunit.client.0.smithi050.stderr: -490> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding con mode: crc 2024-09-14T11:15:25.376 INFO:tasks.workunit.client.0.smithi050.stderr: -489> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding con mode: secure 2024-09-14T11:15:25.376 INFO:tasks.workunit.client.0.smithi050.stderr: -488> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding con mode: crc 2024-09-14T11:15:25.376 INFO:tasks.workunit.client.0.smithi050.stderr: -487> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding con mode: secure 2024-09-14T11:15:25.376 INFO:tasks.workunit.client.0.smithi050.stderr: -486> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding con mode: crc 2024-09-14T11:15:25.377 INFO:tasks.workunit.client.0.smithi050.stderr: -485> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f64a0) adding con mode: secure 2024-09-14T11:15:25.377 INFO:tasks.workunit.client.0.smithi050.stderr: -484> 2024-09-14T11:15:25.031+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.377 INFO:tasks.workunit.client.0.smithi050.stderr: -483> 2024-09-14T11:15:25.031+0000 7f60473a2800 1 librados: starting msgr at 2024-09-14T11:15:25.377 INFO:tasks.workunit.client.0.smithi050.stderr: -482> 2024-09-14T11:15:25.031+0000 7f60473a2800 1 librados: starting objecter 2024-09-14T11:15:25.377 INFO:tasks.workunit.client.0.smithi050.stderr: -481> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command objecter_requests hook 0x55e9af5f47b0 2024-09-14T11:15:25.377 INFO:tasks.workunit.client.0.smithi050.stderr: -480> 2024-09-14T11:15:25.031+0000 7f60473a2800 1 librados: setting wanted keys 2024-09-14T11:15:25.377 INFO:tasks.workunit.client.0.smithi050.stderr: -479> 2024-09-14T11:15:25.031+0000 7f60473a2800 1 librados: calling monclient init 2024-09-14T11:15:25.377 INFO:tasks.workunit.client.0.smithi050.stderr: -478> 2024-09-14T11:15:25.031+0000 7f60473a2800 10 monclient: init 2024-09-14T11:15:25.377 INFO:tasks.workunit.client.0.smithi050.stderr: -477> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding auth protocol: cephx 2024-09-14T11:15:25.377 INFO:tasks.workunit.client.0.smithi050.stderr: -476> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding auth protocol: cephx 2024-09-14T11:15:25.377 INFO:tasks.workunit.client.0.smithi050.stderr: -475> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding auth protocol: cephx 2024-09-14T11:15:25.377 INFO:tasks.workunit.client.0.smithi050.stderr: -474> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding con mode: secure 2024-09-14T11:15:25.377 INFO:tasks.workunit.client.0.smithi050.stderr: -473> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding con mode: crc 2024-09-14T11:15:25.377 INFO:tasks.workunit.client.0.smithi050.stderr: -472> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding con mode: secure 2024-09-14T11:15:25.378 INFO:tasks.workunit.client.0.smithi050.stderr: -471> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding con mode: crc 2024-09-14T11:15:25.378 INFO:tasks.workunit.client.0.smithi050.stderr: -470> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding con mode: secure 2024-09-14T11:15:25.378 INFO:tasks.workunit.client.0.smithi050.stderr: -469> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding con mode: crc 2024-09-14T11:15:25.378 INFO:tasks.workunit.client.0.smithi050.stderr: -468> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding con mode: crc 2024-09-14T11:15:25.378 INFO:tasks.workunit.client.0.smithi050.stderr: -467> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding con mode: secure 2024-09-14T11:15:25.378 INFO:tasks.workunit.client.0.smithi050.stderr: -466> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding con mode: crc 2024-09-14T11:15:25.378 INFO:tasks.workunit.client.0.smithi050.stderr: -465> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding con mode: secure 2024-09-14T11:15:25.378 INFO:tasks.workunit.client.0.smithi050.stderr: -464> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding con mode: crc 2024-09-14T11:15:25.378 INFO:tasks.workunit.client.0.smithi050.stderr: -463> 2024-09-14T11:15:25.031+0000 7f60473a2800 5 AuthRegistry(0x55e9af5f09d0) adding con mode: secure 2024-09-14T11:15:25.378 INFO:tasks.workunit.client.0.smithi050.stderr: -462> 2024-09-14T11:15:25.032+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.378 INFO:tasks.workunit.client.0.smithi050.stderr: -461> 2024-09-14T11:15:25.032+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.378 INFO:tasks.workunit.client.0.smithi050.stderr: -460> 2024-09-14T11:15:25.032+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command rotate-key hook 0x55e9af5f0b18 2024-09-14T11:15:25.378 INFO:tasks.workunit.client.0.smithi050.stderr: -459> 2024-09-14T11:15:25.032+0000 7f60473a2800 10 monclient: _reopen_session rank -1 2024-09-14T11:15:25.378 INFO:tasks.workunit.client.0.smithi050.stderr: -458> 2024-09-14T11:15:25.032+0000 7f60473a2800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:15:25.378 INFO:tasks.workunit.client.0.smithi050.stderr: -457> 2024-09-14T11:15:25.032+0000 7f60473a2800 10 monclient(hunting): picked mon.noname-a con 0x55e9af47bdf0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:15:25.379 INFO:tasks.workunit.client.0.smithi050.stderr: -456> 2024-09-14T11:15:25.032+0000 7f60473a2800 10 monclient(hunting): picked mon.noname-b con 0x55e9af49deb0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:15:25.379 INFO:tasks.workunit.client.0.smithi050.stderr: -455> 2024-09-14T11:15:25.032+0000 7f60473a2800 10 monclient(hunting): picked mon.noname-c con 0x55e9af53a030 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:15:25.379 INFO:tasks.workunit.client.0.smithi050.stderr: -454> 2024-09-14T11:15:25.032+0000 7f60473a2800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:25.379 INFO:tasks.workunit.client.0.smithi050.stderr: -453> 2024-09-14T11:15:25.032+0000 7f60473a2800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:25.379 INFO:tasks.workunit.client.0.smithi050.stderr: -452> 2024-09-14T11:15:25.032+0000 7f60473a2800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:25.379 INFO:tasks.workunit.client.0.smithi050.stderr: -451> 2024-09-14T11:15:25.032+0000 7f60473a2800 10 monclient(hunting): _renew_subs 2024-09-14T11:15:25.379 INFO:tasks.workunit.client.0.smithi050.stderr: -450> 2024-09-14T11:15:25.032+0000 7f60473a2800 10 monclient(hunting): authenticate will time out at 2577.670497s 2024-09-14T11:15:25.379 INFO:tasks.workunit.client.0.smithi050.stderr: -449> 2024-09-14T11:15:25.032+0000 7f6044e8c640 10 monclient(hunting): get_auth_request con 0x55e9af47bdf0 auth_method 0 2024-09-14T11:15:25.379 INFO:tasks.workunit.client.0.smithi050.stderr: -448> 2024-09-14T11:15:25.032+0000 7f6044e8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:25.379 INFO:tasks.workunit.client.0.smithi050.stderr: -447> 2024-09-14T11:15:25.032+0000 7f6044e8c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:25.379 INFO:tasks.workunit.client.0.smithi050.stderr: -446> 2024-09-14T11:15:25.032+0000 7f6044e8c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:25.379 INFO:tasks.workunit.client.0.smithi050.stderr: -445> 2024-09-14T11:15:25.032+0000 7f604568d640 10 monclient(hunting): get_auth_request con 0x55e9af53a030 auth_method 0 2024-09-14T11:15:25.379 INFO:tasks.workunit.client.0.smithi050.stderr: -444> 2024-09-14T11:15:25.032+0000 7f604568d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:25.379 INFO:tasks.workunit.client.0.smithi050.stderr: -443> 2024-09-14T11:15:25.032+0000 7f604568d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:25.380 INFO:tasks.workunit.client.0.smithi050.stderr: -442> 2024-09-14T11:15:25.032+0000 7f604568d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:25.380 INFO:tasks.workunit.client.0.smithi050.stderr: -441> 2024-09-14T11:15:25.032+0000 7f6044e8c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:25.380 INFO:tasks.workunit.client.0.smithi050.stderr: -440> 2024-09-14T11:15:25.032+0000 7f6044e8c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:25.380 INFO:tasks.workunit.client.0.smithi050.stderr: -439> 2024-09-14T11:15:25.032+0000 7f6044e8c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:25.380 INFO:tasks.workunit.client.0.smithi050.stderr: -438> 2024-09-14T11:15:25.032+0000 7f604568d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:25.380 INFO:tasks.workunit.client.0.smithi050.stderr: -437> 2024-09-14T11:15:25.032+0000 7f604568d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:25.380 INFO:tasks.workunit.client.0.smithi050.stderr: -436> 2024-09-14T11:15:25.032+0000 7f604568d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:25.380 INFO:tasks.workunit.client.0.smithi050.stderr: -435> 2024-09-14T11:15:25.032+0000 7f603ffff640 10 monclient(hunting): get_auth_request con 0x55e9af49deb0 auth_method 0 2024-09-14T11:15:25.380 INFO:tasks.workunit.client.0.smithi050.stderr: -434> 2024-09-14T11:15:25.032+0000 7f603ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:25.380 INFO:tasks.workunit.client.0.smithi050.stderr: -433> 2024-09-14T11:15:25.032+0000 7f603ffff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:25.380 INFO:tasks.workunit.client.0.smithi050.stderr: -432> 2024-09-14T11:15:25.032+0000 7f603ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:25.380 INFO:tasks.workunit.client.0.smithi050.stderr: -431> 2024-09-14T11:15:25.032+0000 7f6044e8c640 10 monclient(hunting): handle_auth_done global_id 8376 payload 824 2024-09-14T11:15:25.380 INFO:tasks.workunit.client.0.smithi050.stderr: -430> 2024-09-14T11:15:25.032+0000 7f6044e8c640 10 monclient: _finish_hunting 0 2024-09-14T11:15:25.380 INFO:tasks.workunit.client.0.smithi050.stderr: -429> 2024-09-14T11:15:25.032+0000 7f6044e8c640 1 monclient: found mon.noname-a 2024-09-14T11:15:25.381 INFO:tasks.workunit.client.0.smithi050.stderr: -428> 2024-09-14T11:15:25.032+0000 7f6044e8c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:15:25.381 INFO:tasks.workunit.client.0.smithi050.stderr: -427> 2024-09-14T11:15:25.033+0000 7f5f31602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:25.381 INFO:tasks.workunit.client.0.smithi050.stderr: -426> 2024-09-14T11:15:25.033+0000 7f5f31602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:25.381 INFO:tasks.workunit.client.0.smithi050.stderr: -425> 2024-09-14T11:15:25.033+0000 7f5f31602640 10 monclient: dump: 2024-09-14T11:15:25.381 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:25.381 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:25.381 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.381 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.381 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:25.381 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:25.381 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:25.381 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:25.381 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:25.381 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.382 INFO:tasks.workunit.client.0.smithi050.stderr: -424> 2024-09-14T11:15:25.033+0000 7f5f31602640 10 monclient: _finish_auth 0 2024-09-14T11:15:25.382 INFO:tasks.workunit.client.0.smithi050.stderr: -423> 2024-09-14T11:15:25.033+0000 7f5f31602640 10 monclient: _check_auth_tickets 2024-09-14T11:15:25.382 INFO:tasks.workunit.client.0.smithi050.stderr: -422> 2024-09-14T11:15:25.033+0000 7f5f31602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:25.382 INFO:tasks.workunit.client.0.smithi050.stderr: -421> 2024-09-14T11:15:25.033+0000 7f5f31602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:25.382 INFO:tasks.workunit.client.0.smithi050.stderr: -420> 2024-09-14T11:15:25.033+0000 7f5f31602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:25.382 INFO:tasks.workunit.client.0.smithi050.stderr: -419> 2024-09-14T11:15:25.033+0000 7f5f31602640 10 monclient: dump: 2024-09-14T11:15:25.382 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:25.382 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:25.382 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.382 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.382 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:25.382 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:25.382 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:25.382 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:25.382 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:25.382 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.383 INFO:tasks.workunit.client.0.smithi050.stderr: -418> 2024-09-14T11:15:25.033+0000 7f60473a2800 5 monclient: authenticate success, global_id 8376 2024-09-14T11:15:25.383 INFO:tasks.workunit.client.0.smithi050.stderr: -417> 2024-09-14T11:15:25.033+0000 7f60473a2800 10 monclient: _renew_subs 2024-09-14T11:15:25.383 INFO:tasks.workunit.client.0.smithi050.stderr: -416> 2024-09-14T11:15:25.033+0000 7f60473a2800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:15:25.383 INFO:tasks.workunit.client.0.smithi050.stderr: -415> 2024-09-14T11:15:25.033+0000 7f5f32e05640 4 set_mon_vals no callback set 2024-09-14T11:15:25.383 INFO:tasks.workunit.client.0.smithi050.stderr: -414> 2024-09-14T11:15:25.033+0000 7f60473a2800 10 monclient: _renew_subs 2024-09-14T11:15:25.383 INFO:tasks.workunit.client.0.smithi050.stderr: -413> 2024-09-14T11:15:25.033+0000 7f60473a2800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:15:25.383 INFO:tasks.workunit.client.0.smithi050.stderr: -412> 2024-09-14T11:15:25.033+0000 7f60473a2800 1 librados: init done 2024-09-14T11:15:25.383 INFO:tasks.workunit.client.0.smithi050.stderr: -411> 2024-09-14T11:15:25.036+0000 7f5f31602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:15:25.383 INFO:tasks.workunit.client.0.smithi050.stderr: -410> 2024-09-14T11:15:25.036+0000 7f5f31602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:15:25.383 INFO:tasks.workunit.client.0.smithi050.stderr: -409> 2024-09-14T11:15:25.036+0000 7f5f31602640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:15:25.383 INFO:tasks.workunit.client.0.smithi050.stderr: -408> 2024-09-14T11:15:25.036+0000 7f603ffff640 10 monclient: get_auth_request con 0x7f5f2c077230 auth_method 0 2024-09-14T11:15:25.383 INFO:tasks.workunit.client.0.smithi050.stderr: -407> 2024-09-14T11:15:25.036+0000 7f604568d640 10 monclient: get_auth_request con 0x55e9af6192c0 auth_method 0 2024-09-14T11:15:25.383 INFO:tasks.workunit.client.0.smithi050.stderr: -406> 2024-09-14T11:15:25.037+0000 7f6044e8c640 10 monclient: get_auth_request con 0x55e9af63bdc0 auth_method 0 2024-09-14T11:15:25.383 INFO:tasks.workunit.client.0.smithi050.stderr: -405> 2024-09-14T11:15:25.038+0000 7f603ffff640 10 monclient: get_auth_request con 0x55e9af640540 auth_method 0 2024-09-14T11:15:25.383 INFO:tasks.workunit.client.0.smithi050.stderr: -404> 2024-09-14T11:15:25.040+0000 7f60473a2800 10 monclient: build_initial_monmap 2024-09-14T11:15:25.384 INFO:tasks.workunit.client.0.smithi050.stderr: -403> 2024-09-14T11:15:25.040+0000 7f60473a2800 1 build_initial for_mkfs: 0 2024-09-14T11:15:25.384 INFO:tasks.workunit.client.0.smithi050.stderr: -402> 2024-09-14T11:15:25.040+0000 7f60473a2800 10 monclient: monmap: 2024-09-14T11:15:25.384 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:15:25.384 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:25.384 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:15:25.384 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:15:25.384 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:25.384 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:25.384 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:15:25.384 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:15:25.384 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:15:25.384 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.384 INFO:tasks.workunit.client.0.smithi050.stderr: -401> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding auth protocol: cephx 2024-09-14T11:15:25.384 INFO:tasks.workunit.client.0.smithi050.stderr: -400> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding auth protocol: cephx 2024-09-14T11:15:25.385 INFO:tasks.workunit.client.0.smithi050.stderr: -399> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding auth protocol: cephx 2024-09-14T11:15:25.385 INFO:tasks.workunit.client.0.smithi050.stderr: -398> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding con mode: secure 2024-09-14T11:15:25.385 INFO:tasks.workunit.client.0.smithi050.stderr: -397> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding con mode: crc 2024-09-14T11:15:25.385 INFO:tasks.workunit.client.0.smithi050.stderr: -396> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding con mode: secure 2024-09-14T11:15:25.385 INFO:tasks.workunit.client.0.smithi050.stderr: -395> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding con mode: crc 2024-09-14T11:15:25.385 INFO:tasks.workunit.client.0.smithi050.stderr: -394> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding con mode: secure 2024-09-14T11:15:25.385 INFO:tasks.workunit.client.0.smithi050.stderr: -393> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding con mode: crc 2024-09-14T11:15:25.385 INFO:tasks.workunit.client.0.smithi050.stderr: -392> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding con mode: crc 2024-09-14T11:15:25.385 INFO:tasks.workunit.client.0.smithi050.stderr: -391> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding con mode: secure 2024-09-14T11:15:25.385 INFO:tasks.workunit.client.0.smithi050.stderr: -390> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding con mode: crc 2024-09-14T11:15:25.385 INFO:tasks.workunit.client.0.smithi050.stderr: -389> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding con mode: secure 2024-09-14T11:15:25.385 INFO:tasks.workunit.client.0.smithi050.stderr: -388> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding con mode: crc 2024-09-14T11:15:25.385 INFO:tasks.workunit.client.0.smithi050.stderr: -387> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af645270) adding con mode: secure 2024-09-14T11:15:25.385 INFO:tasks.workunit.client.0.smithi050.stderr: -386> 2024-09-14T11:15:25.040+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.386 INFO:tasks.workunit.client.0.smithi050.stderr: -385> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command objecter_requests cmddesc objecter_requests hook 0x55e9af6487c0 EEXIST 2024-09-14T11:15:25.386 INFO:tasks.workunit.client.0.smithi050.stderr: -384> 2024-09-14T11:15:25.040+0000 7f60473a2800 10 monclient: init 2024-09-14T11:15:25.386 INFO:tasks.workunit.client.0.smithi050.stderr: -383> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding auth protocol: cephx 2024-09-14T11:15:25.386 INFO:tasks.workunit.client.0.smithi050.stderr: -382> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding auth protocol: cephx 2024-09-14T11:15:25.386 INFO:tasks.workunit.client.0.smithi050.stderr: -381> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding auth protocol: cephx 2024-09-14T11:15:25.386 INFO:tasks.workunit.client.0.smithi050.stderr: -380> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding con mode: secure 2024-09-14T11:15:25.386 INFO:tasks.workunit.client.0.smithi050.stderr: -379> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding con mode: crc 2024-09-14T11:15:25.386 INFO:tasks.workunit.client.0.smithi050.stderr: -378> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding con mode: secure 2024-09-14T11:15:25.386 INFO:tasks.workunit.client.0.smithi050.stderr: -377> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding con mode: crc 2024-09-14T11:15:25.386 INFO:tasks.workunit.client.0.smithi050.stderr: -376> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding con mode: secure 2024-09-14T11:15:25.386 INFO:tasks.workunit.client.0.smithi050.stderr: -375> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding con mode: crc 2024-09-14T11:15:25.386 INFO:tasks.workunit.client.0.smithi050.stderr: -374> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding con mode: crc 2024-09-14T11:15:25.386 INFO:tasks.workunit.client.0.smithi050.stderr: -373> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding con mode: secure 2024-09-14T11:15:25.386 INFO:tasks.workunit.client.0.smithi050.stderr: -372> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding con mode: crc 2024-09-14T11:15:25.386 INFO:tasks.workunit.client.0.smithi050.stderr: -371> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding con mode: secure 2024-09-14T11:15:25.387 INFO:tasks.workunit.client.0.smithi050.stderr: -370> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding con mode: crc 2024-09-14T11:15:25.387 INFO:tasks.workunit.client.0.smithi050.stderr: -369> 2024-09-14T11:15:25.040+0000 7f60473a2800 5 AuthRegistry(0x55e9af643948) adding con mode: secure 2024-09-14T11:15:25.387 INFO:tasks.workunit.client.0.smithi050.stderr: -368> 2024-09-14T11:15:25.041+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.387 INFO:tasks.workunit.client.0.smithi050.stderr: -367> 2024-09-14T11:15:25.041+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.387 INFO:tasks.workunit.client.0.smithi050.stderr: -366> 2024-09-14T11:15:25.041+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command rotate-key cmddesc rotate-key hook 0x55e9af643a90 EEXIST 2024-09-14T11:15:25.387 INFO:tasks.workunit.client.0.smithi050.stderr: -365> 2024-09-14T11:15:25.041+0000 7f60473a2800 10 monclient: _reopen_session rank -1 2024-09-14T11:15:25.387 INFO:tasks.workunit.client.0.smithi050.stderr: -364> 2024-09-14T11:15:25.041+0000 7f60473a2800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:15:25.387 INFO:tasks.workunit.client.0.smithi050.stderr: -363> 2024-09-14T11:15:25.041+0000 7f60473a2800 10 monclient(hunting): picked mon.noname-b con 0x55e9af66cae0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:15:25.387 INFO:tasks.workunit.client.0.smithi050.stderr: -362> 2024-09-14T11:15:25.041+0000 7f60473a2800 10 monclient(hunting): picked mon.noname-a con 0x55e9af66cec0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:15:25.387 INFO:tasks.workunit.client.0.smithi050.stderr: -361> 2024-09-14T11:15:25.041+0000 7f60473a2800 10 monclient(hunting): picked mon.noname-c con 0x55e9af66b7f0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:15:25.387 INFO:tasks.workunit.client.0.smithi050.stderr: -360> 2024-09-14T11:15:25.041+0000 7f60473a2800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:25.387 INFO:tasks.workunit.client.0.smithi050.stderr: -359> 2024-09-14T11:15:25.041+0000 7f60473a2800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:25.388 INFO:tasks.workunit.client.0.smithi050.stderr: -358> 2024-09-14T11:15:25.041+0000 7f60473a2800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:25.388 INFO:tasks.workunit.client.0.smithi050.stderr: -357> 2024-09-14T11:15:25.041+0000 7f60473a2800 10 monclient(hunting): _renew_subs 2024-09-14T11:15:25.388 INFO:tasks.workunit.client.0.smithi050.stderr: -356> 2024-09-14T11:15:25.041+0000 7f60473a2800 10 monclient(hunting): authenticate will time out at 2577.679482s 2024-09-14T11:15:25.388 INFO:tasks.workunit.client.0.smithi050.stderr: -355> 2024-09-14T11:15:25.041+0000 7f603ffff640 10 monclient(hunting): get_auth_request con 0x55e9af66cec0 auth_method 0 2024-09-14T11:15:25.388 INFO:tasks.workunit.client.0.smithi050.stderr: -354> 2024-09-14T11:15:25.041+0000 7f603ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:25.388 INFO:tasks.workunit.client.0.smithi050.stderr: -353> 2024-09-14T11:15:25.041+0000 7f603ffff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:25.388 INFO:tasks.workunit.client.0.smithi050.stderr: -352> 2024-09-14T11:15:25.041+0000 7f603ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:25.388 INFO:tasks.workunit.client.0.smithi050.stderr: -351> 2024-09-14T11:15:25.041+0000 7f604568d640 10 monclient(hunting): get_auth_request con 0x55e9af66b7f0 auth_method 0 2024-09-14T11:15:25.388 INFO:tasks.workunit.client.0.smithi050.stderr: -350> 2024-09-14T11:15:25.041+0000 7f604568d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:25.388 INFO:tasks.workunit.client.0.smithi050.stderr: -349> 2024-09-14T11:15:25.041+0000 7f604568d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:25.388 INFO:tasks.workunit.client.0.smithi050.stderr: -348> 2024-09-14T11:15:25.041+0000 7f604568d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:25.388 INFO:tasks.workunit.client.0.smithi050.stderr: -347> 2024-09-14T11:15:25.041+0000 7f6044e8c640 10 monclient(hunting): get_auth_request con 0x55e9af66cae0 auth_method 0 2024-09-14T11:15:25.388 INFO:tasks.workunit.client.0.smithi050.stderr: -346> 2024-09-14T11:15:25.041+0000 7f6044e8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:25.388 INFO:tasks.workunit.client.0.smithi050.stderr: -345> 2024-09-14T11:15:25.041+0000 7f6044e8c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:25.389 INFO:tasks.workunit.client.0.smithi050.stderr: -344> 2024-09-14T11:15:25.041+0000 7f6044e8c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:25.389 INFO:tasks.workunit.client.0.smithi050.stderr: -343> 2024-09-14T11:15:25.041+0000 7f603ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:25.389 INFO:tasks.workunit.client.0.smithi050.stderr: -342> 2024-09-14T11:15:25.041+0000 7f603ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:25.389 INFO:tasks.workunit.client.0.smithi050.stderr: -341> 2024-09-14T11:15:25.041+0000 7f603ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:25.389 INFO:tasks.workunit.client.0.smithi050.stderr: -340> 2024-09-14T11:15:25.041+0000 7f604568d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:25.389 INFO:tasks.workunit.client.0.smithi050.stderr: -339> 2024-09-14T11:15:25.041+0000 7f604568d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:25.389 INFO:tasks.workunit.client.0.smithi050.stderr: -338> 2024-09-14T11:15:25.041+0000 7f604568d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:25.389 INFO:tasks.workunit.client.0.smithi050.stderr: -337> 2024-09-14T11:15:25.041+0000 7f6044e8c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:25.389 INFO:tasks.workunit.client.0.smithi050.stderr: -336> 2024-09-14T11:15:25.041+0000 7f6044e8c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:25.389 INFO:tasks.workunit.client.0.smithi050.stderr: -335> 2024-09-14T11:15:25.041+0000 7f6044e8c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:25.389 INFO:tasks.workunit.client.0.smithi050.stderr: -334> 2024-09-14T11:15:25.041+0000 7f603ffff640 10 monclient(hunting): handle_auth_done global_id 8379 payload 824 2024-09-14T11:15:25.390 INFO:tasks.workunit.client.0.smithi050.stderr: -333> 2024-09-14T11:15:25.041+0000 7f603ffff640 10 monclient: _finish_hunting 0 2024-09-14T11:15:25.390 INFO:tasks.workunit.client.0.smithi050.stderr: -332> 2024-09-14T11:15:25.041+0000 7f603ffff640 1 monclient: found mon.noname-a 2024-09-14T11:15:25.390 INFO:tasks.workunit.client.0.smithi050.stderr: -331> 2024-09-14T11:15:25.041+0000 7f603ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:15:25.390 INFO:tasks.workunit.client.0.smithi050.stderr: -330> 2024-09-14T11:15:25.042+0000 7f5f2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:25.390 INFO:tasks.workunit.client.0.smithi050.stderr: -329> 2024-09-14T11:15:25.042+0000 7f5f2a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:25.390 INFO:tasks.workunit.client.0.smithi050.stderr: -328> 2024-09-14T11:15:25.042+0000 7f5f2a7fc640 10 monclient: dump: 2024-09-14T11:15:25.390 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:25.390 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:25.390 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.390 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.390 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:25.390 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:25.390 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:25.390 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:25.391 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:25.391 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.391 INFO:tasks.workunit.client.0.smithi050.stderr: -327> 2024-09-14T11:15:25.042+0000 7f5f2a7fc640 10 monclient: _finish_auth 0 2024-09-14T11:15:25.391 INFO:tasks.workunit.client.0.smithi050.stderr: -326> 2024-09-14T11:15:25.042+0000 7f5f2a7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:15:25.391 INFO:tasks.workunit.client.0.smithi050.stderr: -325> 2024-09-14T11:15:25.042+0000 7f60473a2800 5 monclient: authenticate success, global_id 8379 2024-09-14T11:15:25.391 INFO:tasks.workunit.client.0.smithi050.stderr: -324> 2024-09-14T11:15:25.042+0000 7f60473a2800 10 monclient: _renew_subs 2024-09-14T11:15:25.391 INFO:tasks.workunit.client.0.smithi050.stderr: -323> 2024-09-14T11:15:25.042+0000 7f60473a2800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:15:25.391 INFO:tasks.workunit.client.0.smithi050.stderr: -322> 2024-09-14T11:15:25.042+0000 7f5f2a7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:25.391 INFO:tasks.workunit.client.0.smithi050.stderr: -321> 2024-09-14T11:15:25.042+0000 7f5f2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:25.391 INFO:tasks.workunit.client.0.smithi050.stderr: -320> 2024-09-14T11:15:25.042+0000 7f5f2a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:25.391 INFO:tasks.workunit.client.0.smithi050.stderr: -319> 2024-09-14T11:15:25.042+0000 7f5f2a7fc640 10 monclient: dump: 2024-09-14T11:15:25.391 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:25.391 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:25.391 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.392 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.392 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:25.392 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:25.392 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:25.392 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:25.392 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:25.392 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.392 INFO:tasks.workunit.client.0.smithi050.stderr: -318> 2024-09-14T11:15:25.042+0000 7f6045e8e640 4 set_mon_vals no callback set 2024-09-14T11:15:25.392 INFO:tasks.workunit.client.0.smithi050.stderr: -317> 2024-09-14T11:15:25.042+0000 7f60473a2800 10 monclient: _renew_subs 2024-09-14T11:15:25.392 INFO:tasks.workunit.client.0.smithi050.stderr: -316> 2024-09-14T11:15:25.042+0000 7f60473a2800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:15:25.392 INFO:tasks.workunit.client.0.smithi050.stderr: -315> 2024-09-14T11:15:25.044+0000 7f5f2a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:15:25.392 INFO:tasks.workunit.client.0.smithi050.stderr: -314> 2024-09-14T11:15:25.044+0000 7f5f2a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:15:25.392 INFO:tasks.workunit.client.0.smithi050.stderr: -313> 2024-09-14T11:15:25.044+0000 7f5f2a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:15:25.392 INFO:tasks.workunit.client.0.smithi050.stderr: -312> 2024-09-14T11:15:25.044+0000 7f6044e8c640 10 monclient: get_auth_request con 0x7f5f1c077140 auth_method 0 2024-09-14T11:15:25.392 INFO:tasks.workunit.client.0.smithi050.stderr: -311> 2024-09-14T11:15:25.044+0000 7f60473a2800 10 monclient: get_monmap_and_config 2024-09-14T11:15:25.392 INFO:tasks.workunit.client.0.smithi050.stderr: -310> 2024-09-14T11:15:25.044+0000 7f60473a2800 10 monclient: build_initial_monmap 2024-09-14T11:15:25.393 INFO:tasks.workunit.client.0.smithi050.stderr: -309> 2024-09-14T11:15:25.044+0000 7f60473a2800 1 build_initial for_mkfs: 0 2024-09-14T11:15:25.393 INFO:tasks.workunit.client.0.smithi050.stderr: -308> 2024-09-14T11:15:25.044+0000 7f60473a2800 10 monclient: monmap: 2024-09-14T11:15:25.393 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:15:25.393 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:25.393 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:15:25.393 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:15:25.393 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:25.393 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:25.393 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:15:25.393 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:15:25.393 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:15:25.393 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.393 INFO:tasks.workunit.client.0.smithi050.stderr: -307> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding auth protocol: cephx 2024-09-14T11:15:25.393 INFO:tasks.workunit.client.0.smithi050.stderr: -306> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding auth protocol: cephx 2024-09-14T11:15:25.394 INFO:tasks.workunit.client.0.smithi050.stderr: -305> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding auth protocol: cephx 2024-09-14T11:15:25.394 INFO:tasks.workunit.client.0.smithi050.stderr: -304> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding con mode: secure 2024-09-14T11:15:25.394 INFO:tasks.workunit.client.0.smithi050.stderr: -303> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding con mode: crc 2024-09-14T11:15:25.394 INFO:tasks.workunit.client.0.smithi050.stderr: -302> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding con mode: secure 2024-09-14T11:15:25.394 INFO:tasks.workunit.client.0.smithi050.stderr: -301> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding con mode: crc 2024-09-14T11:15:25.394 INFO:tasks.workunit.client.0.smithi050.stderr: -300> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding con mode: secure 2024-09-14T11:15:25.394 INFO:tasks.workunit.client.0.smithi050.stderr: -299> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding con mode: crc 2024-09-14T11:15:25.394 INFO:tasks.workunit.client.0.smithi050.stderr: -298> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding con mode: crc 2024-09-14T11:15:25.394 INFO:tasks.workunit.client.0.smithi050.stderr: -297> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding con mode: secure 2024-09-14T11:15:25.394 INFO:tasks.workunit.client.0.smithi050.stderr: -296> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding con mode: crc 2024-09-14T11:15:25.394 INFO:tasks.workunit.client.0.smithi050.stderr: -295> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding con mode: secure 2024-09-14T11:15:25.394 INFO:tasks.workunit.client.0.smithi050.stderr: -294> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding con mode: crc 2024-09-14T11:15:25.394 INFO:tasks.workunit.client.0.smithi050.stderr: -293> 2024-09-14T11:15:25.044+0000 7f60473a2800 5 AuthRegistry(0x55e9af68c9b0) adding con mode: secure 2024-09-14T11:15:25.394 INFO:tasks.workunit.client.0.smithi050.stderr: -292> 2024-09-14T11:15:25.045+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.394 INFO:tasks.workunit.client.0.smithi050.stderr: -291> 2024-09-14T11:15:25.045+0000 7f60473a2800 10 monclient: init 2024-09-14T11:15:25.395 INFO:tasks.workunit.client.0.smithi050.stderr: -290> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding auth protocol: cephx 2024-09-14T11:15:25.395 INFO:tasks.workunit.client.0.smithi050.stderr: -289> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding auth protocol: cephx 2024-09-14T11:15:25.395 INFO:tasks.workunit.client.0.smithi050.stderr: -288> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding auth protocol: cephx 2024-09-14T11:15:25.395 INFO:tasks.workunit.client.0.smithi050.stderr: -287> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding con mode: secure 2024-09-14T11:15:25.395 INFO:tasks.workunit.client.0.smithi050.stderr: -286> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding con mode: crc 2024-09-14T11:15:25.395 INFO:tasks.workunit.client.0.smithi050.stderr: -285> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding con mode: secure 2024-09-14T11:15:25.395 INFO:tasks.workunit.client.0.smithi050.stderr: -284> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding con mode: crc 2024-09-14T11:15:25.395 INFO:tasks.workunit.client.0.smithi050.stderr: -283> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding con mode: secure 2024-09-14T11:15:25.395 INFO:tasks.workunit.client.0.smithi050.stderr: -282> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding con mode: crc 2024-09-14T11:15:25.395 INFO:tasks.workunit.client.0.smithi050.stderr: -281> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding con mode: crc 2024-09-14T11:15:25.395 INFO:tasks.workunit.client.0.smithi050.stderr: -280> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding con mode: secure 2024-09-14T11:15:25.395 INFO:tasks.workunit.client.0.smithi050.stderr: -279> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding con mode: crc 2024-09-14T11:15:25.395 INFO:tasks.workunit.client.0.smithi050.stderr: -278> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding con mode: secure 2024-09-14T11:15:25.396 INFO:tasks.workunit.client.0.smithi050.stderr: -277> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding con mode: crc 2024-09-14T11:15:25.396 INFO:tasks.workunit.client.0.smithi050.stderr: -276> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaa20) adding con mode: secure 2024-09-14T11:15:25.396 INFO:tasks.workunit.client.0.smithi050.stderr: -275> 2024-09-14T11:15:25.045+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.396 INFO:tasks.workunit.client.0.smithi050.stderr: -274> 2024-09-14T11:15:25.045+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.396 INFO:tasks.workunit.client.0.smithi050.stderr: -273> 2024-09-14T11:15:25.045+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command rotate-key cmddesc rotate-key hook 0x7ffd01ccab68 EEXIST 2024-09-14T11:15:25.396 INFO:tasks.workunit.client.0.smithi050.stderr: -272> 2024-09-14T11:15:25.045+0000 7f60473a2800 10 monclient: _reopen_session rank -1 2024-09-14T11:15:25.396 INFO:tasks.workunit.client.0.smithi050.stderr: -271> 2024-09-14T11:15:25.045+0000 7f60473a2800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:15:25.396 INFO:tasks.workunit.client.0.smithi050.stderr: -270> 2024-09-14T11:15:25.045+0000 7f60473a2800 10 monclient(hunting): picked mon.noname-c con 0x55e9af6c1070 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:15:25.396 INFO:tasks.workunit.client.0.smithi050.stderr: -269> 2024-09-14T11:15:25.045+0000 7f60473a2800 10 monclient(hunting): picked mon.noname-a con 0x55e9af691fc0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:15:25.396 INFO:tasks.workunit.client.0.smithi050.stderr: -268> 2024-09-14T11:15:25.045+0000 7f60473a2800 10 monclient(hunting): picked mon.noname-b con 0x55e9af6bc910 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:15:25.396 INFO:tasks.workunit.client.0.smithi050.stderr: -267> 2024-09-14T11:15:25.045+0000 7f60473a2800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:25.396 INFO:tasks.workunit.client.0.smithi050.stderr: -266> 2024-09-14T11:15:25.045+0000 7f60473a2800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:25.396 INFO:tasks.workunit.client.0.smithi050.stderr: -265> 2024-09-14T11:15:25.045+0000 7f60473a2800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:25.396 INFO:tasks.workunit.client.0.smithi050.stderr: -264> 2024-09-14T11:15:25.045+0000 7f60473a2800 10 monclient(hunting): _renew_subs 2024-09-14T11:15:25.397 INFO:tasks.workunit.client.0.smithi050.stderr: -263> 2024-09-14T11:15:25.045+0000 7f60473a2800 10 monclient(hunting): authenticate will time out at 2577.683872s 2024-09-14T11:15:25.397 INFO:tasks.workunit.client.0.smithi050.stderr: -262> 2024-09-14T11:15:25.046+0000 7f6044e8c640 10 monclient(hunting): get_auth_request con 0x55e9af6c1070 auth_method 0 2024-09-14T11:15:25.397 INFO:tasks.workunit.client.0.smithi050.stderr: -261> 2024-09-14T11:15:25.046+0000 7f6044e8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:25.397 INFO:tasks.workunit.client.0.smithi050.stderr: -260> 2024-09-14T11:15:25.046+0000 7f6044e8c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:25.397 INFO:tasks.workunit.client.0.smithi050.stderr: -259> 2024-09-14T11:15:25.046+0000 7f6044e8c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:25.397 INFO:tasks.workunit.client.0.smithi050.stderr: -258> 2024-09-14T11:15:25.046+0000 7f603ffff640 10 monclient(hunting): get_auth_request con 0x55e9af691fc0 auth_method 0 2024-09-14T11:15:25.397 INFO:tasks.workunit.client.0.smithi050.stderr: -257> 2024-09-14T11:15:25.046+0000 7f603ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:25.397 INFO:tasks.workunit.client.0.smithi050.stderr: -256> 2024-09-14T11:15:25.046+0000 7f603ffff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:25.397 INFO:tasks.workunit.client.0.smithi050.stderr: -255> 2024-09-14T11:15:25.046+0000 7f603ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:25.397 INFO:tasks.workunit.client.0.smithi050.stderr: -254> 2024-09-14T11:15:25.046+0000 7f6044e8c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:25.397 INFO:tasks.workunit.client.0.smithi050.stderr: -253> 2024-09-14T11:15:25.046+0000 7f6044e8c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:25.397 INFO:tasks.workunit.client.0.smithi050.stderr: -252> 2024-09-14T11:15:25.046+0000 7f6044e8c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:25.397 INFO:tasks.workunit.client.0.smithi050.stderr: -251> 2024-09-14T11:15:25.046+0000 7f604568d640 10 monclient(hunting): get_auth_request con 0x55e9af6bc910 auth_method 0 2024-09-14T11:15:25.397 INFO:tasks.workunit.client.0.smithi050.stderr: -250> 2024-09-14T11:15:25.046+0000 7f604568d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:25.397 INFO:tasks.workunit.client.0.smithi050.stderr: -249> 2024-09-14T11:15:25.046+0000 7f604568d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:25.398 INFO:tasks.workunit.client.0.smithi050.stderr: -248> 2024-09-14T11:15:25.046+0000 7f604568d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:25.398 INFO:tasks.workunit.client.0.smithi050.stderr: -247> 2024-09-14T11:15:25.046+0000 7f603ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:25.398 INFO:tasks.workunit.client.0.smithi050.stderr: -246> 2024-09-14T11:15:25.046+0000 7f603ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:25.398 INFO:tasks.workunit.client.0.smithi050.stderr: -245> 2024-09-14T11:15:25.046+0000 7f603ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:25.398 INFO:tasks.workunit.client.0.smithi050.stderr: -244> 2024-09-14T11:15:25.046+0000 7f604568d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:25.398 INFO:tasks.workunit.client.0.smithi050.stderr: -243> 2024-09-14T11:15:25.046+0000 7f604568d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:25.398 INFO:tasks.workunit.client.0.smithi050.stderr: -242> 2024-09-14T11:15:25.046+0000 7f604568d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:25.398 INFO:tasks.workunit.client.0.smithi050.stderr: -241> 2024-09-14T11:15:25.046+0000 7f603ffff640 10 monclient(hunting): handle_auth_done global_id 8382 payload 274 2024-09-14T11:15:25.398 INFO:tasks.workunit.client.0.smithi050.stderr: -240> 2024-09-14T11:15:25.046+0000 7f603ffff640 10 monclient: _finish_hunting 0 2024-09-14T11:15:25.398 INFO:tasks.workunit.client.0.smithi050.stderr: -239> 2024-09-14T11:15:25.046+0000 7f603ffff640 1 monclient: found mon.noname-a 2024-09-14T11:15:25.398 INFO:tasks.workunit.client.0.smithi050.stderr: -238> 2024-09-14T11:15:25.046+0000 7f603ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:15:25.398 INFO:tasks.workunit.client.0.smithi050.stderr: -237> 2024-09-14T11:15:25.046+0000 7f5f1bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:25.398 INFO:tasks.workunit.client.0.smithi050.stderr: -236> 2024-09-14T11:15:25.046+0000 7f5f1bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:25.398 INFO:tasks.workunit.client.0.smithi050.stderr: -235> 2024-09-14T11:15:25.046+0000 7f5f1bfff640 10 monclient: dump: 2024-09-14T11:15:25.399 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:25.399 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:25.399 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.399 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.399 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:25.399 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:25.399 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:25.399 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:25.399 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:25.399 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.399 INFO:tasks.workunit.client.0.smithi050.stderr: -234> 2024-09-14T11:15:25.046+0000 7f5f1bfff640 10 monclient: _finish_auth 0 2024-09-14T11:15:25.399 INFO:tasks.workunit.client.0.smithi050.stderr: -233> 2024-09-14T11:15:25.046+0000 7f5f1bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:15:25.399 INFO:tasks.workunit.client.0.smithi050.stderr: -232> 2024-09-14T11:15:25.046+0000 7f5f1bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:25.399 INFO:tasks.workunit.client.0.smithi050.stderr: -231> 2024-09-14T11:15:25.046+0000 7f60473a2800 5 monclient: authenticate success, global_id 8382 2024-09-14T11:15:25.399 INFO:tasks.workunit.client.0.smithi050.stderr: -230> 2024-09-14T11:15:25.046+0000 7f60473a2800 10 monclient: get_monmap_and_config success 2024-09-14T11:15:25.399 INFO:tasks.workunit.client.0.smithi050.stderr: -229> 2024-09-14T11:15:25.046+0000 7f60473a2800 4 set_mon_vals no callback set 2024-09-14T11:15:25.399 INFO:tasks.workunit.client.0.smithi050.stderr: -228> 2024-09-14T11:15:25.046+0000 7f5f1bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:25.400 INFO:tasks.workunit.client.0.smithi050.stderr: -227> 2024-09-14T11:15:25.046+0000 7f5f1bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:25.400 INFO:tasks.workunit.client.0.smithi050.stderr: -226> 2024-09-14T11:15:25.046+0000 7f5f1bfff640 10 monclient: dump: 2024-09-14T11:15:25.400 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:25.400 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:25.400 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.400 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.400 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:25.400 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:25.400 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:25.400 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:25.400 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:25.400 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.400 INFO:tasks.workunit.client.0.smithi050.stderr: -225> 2024-09-14T11:15:25.047+0000 7f60473a2800 10 monclient: shutdown 2024-09-14T11:15:25.400 INFO:tasks.workunit.client.0.smithi050.stderr: -224> 2024-09-14T11:15:25.047+0000 7f60473a2800 10 monclient: build_initial_monmap 2024-09-14T11:15:25.401 INFO:tasks.workunit.client.0.smithi050.stderr: -223> 2024-09-14T11:15:25.047+0000 7f60473a2800 1 build_initial for_mkfs: 0 2024-09-14T11:15:25.401 INFO:tasks.workunit.client.0.smithi050.stderr: -222> 2024-09-14T11:15:25.047+0000 7f60473a2800 10 monclient: monmap: 2024-09-14T11:15:25.401 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:15:25.401 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:25.401 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:15:25.401 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:15:25.401 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:25.401 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:25.401 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:15:25.401 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:15:25.401 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:15:25.401 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.401 INFO:tasks.workunit.client.0.smithi050.stderr: -221> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding auth protocol: cephx 2024-09-14T11:15:25.401 INFO:tasks.workunit.client.0.smithi050.stderr: -220> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding auth protocol: cephx 2024-09-14T11:15:25.401 INFO:tasks.workunit.client.0.smithi050.stderr: -219> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding auth protocol: cephx 2024-09-14T11:15:25.402 INFO:tasks.workunit.client.0.smithi050.stderr: -218> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding con mode: secure 2024-09-14T11:15:25.402 INFO:tasks.workunit.client.0.smithi050.stderr: -217> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding con mode: crc 2024-09-14T11:15:25.402 INFO:tasks.workunit.client.0.smithi050.stderr: -216> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding con mode: secure 2024-09-14T11:15:25.402 INFO:tasks.workunit.client.0.smithi050.stderr: -215> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding con mode: crc 2024-09-14T11:15:25.402 INFO:tasks.workunit.client.0.smithi050.stderr: -214> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding con mode: secure 2024-09-14T11:15:25.402 INFO:tasks.workunit.client.0.smithi050.stderr: -213> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding con mode: crc 2024-09-14T11:15:25.402 INFO:tasks.workunit.client.0.smithi050.stderr: -212> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding con mode: crc 2024-09-14T11:15:25.402 INFO:tasks.workunit.client.0.smithi050.stderr: -211> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding con mode: secure 2024-09-14T11:15:25.402 INFO:tasks.workunit.client.0.smithi050.stderr: -210> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding con mode: crc 2024-09-14T11:15:25.402 INFO:tasks.workunit.client.0.smithi050.stderr: -209> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding con mode: secure 2024-09-14T11:15:25.402 INFO:tasks.workunit.client.0.smithi050.stderr: -208> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding con mode: crc 2024-09-14T11:15:25.402 INFO:tasks.workunit.client.0.smithi050.stderr: -207> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6b3540) adding con mode: secure 2024-09-14T11:15:25.402 INFO:tasks.workunit.client.0.smithi050.stderr: -206> 2024-09-14T11:15:25.047+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.402 INFO:tasks.workunit.client.0.smithi050.stderr: -205> 2024-09-14T11:15:25.047+0000 7f60473a2800 1 librados: starting msgr at 2024-09-14T11:15:25.403 INFO:tasks.workunit.client.0.smithi050.stderr: -204> 2024-09-14T11:15:25.047+0000 7f60473a2800 1 librados: starting objecter 2024-09-14T11:15:25.403 INFO:tasks.workunit.client.0.smithi050.stderr: -203> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command objecter_requests cmddesc objecter_requests hook 0x55e9af690d50 EEXIST 2024-09-14T11:15:25.403 INFO:tasks.workunit.client.0.smithi050.stderr: -202> 2024-09-14T11:15:25.047+0000 7f60473a2800 1 librados: setting wanted keys 2024-09-14T11:15:25.403 INFO:tasks.workunit.client.0.smithi050.stderr: -201> 2024-09-14T11:15:25.047+0000 7f60473a2800 1 librados: calling monclient init 2024-09-14T11:15:25.403 INFO:tasks.workunit.client.0.smithi050.stderr: -200> 2024-09-14T11:15:25.047+0000 7f60473a2800 10 monclient: init 2024-09-14T11:15:25.403 INFO:tasks.workunit.client.0.smithi050.stderr: -199> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding auth protocol: cephx 2024-09-14T11:15:25.403 INFO:tasks.workunit.client.0.smithi050.stderr: -198> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding auth protocol: cephx 2024-09-14T11:15:25.403 INFO:tasks.workunit.client.0.smithi050.stderr: -197> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding auth protocol: cephx 2024-09-14T11:15:25.403 INFO:tasks.workunit.client.0.smithi050.stderr: -196> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding con mode: secure 2024-09-14T11:15:25.403 INFO:tasks.workunit.client.0.smithi050.stderr: -195> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding con mode: crc 2024-09-14T11:15:25.403 INFO:tasks.workunit.client.0.smithi050.stderr: -194> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding con mode: secure 2024-09-14T11:15:25.403 INFO:tasks.workunit.client.0.smithi050.stderr: -193> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding con mode: crc 2024-09-14T11:15:25.403 INFO:tasks.workunit.client.0.smithi050.stderr: -192> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding con mode: secure 2024-09-14T11:15:25.403 INFO:tasks.workunit.client.0.smithi050.stderr: -191> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding con mode: crc 2024-09-14T11:15:25.403 INFO:tasks.workunit.client.0.smithi050.stderr: -190> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding con mode: crc 2024-09-14T11:15:25.404 INFO:tasks.workunit.client.0.smithi050.stderr: -189> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding con mode: secure 2024-09-14T11:15:25.404 INFO:tasks.workunit.client.0.smithi050.stderr: -188> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding con mode: crc 2024-09-14T11:15:25.404 INFO:tasks.workunit.client.0.smithi050.stderr: -187> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding con mode: secure 2024-09-14T11:15:25.404 INFO:tasks.workunit.client.0.smithi050.stderr: -186> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding con mode: crc 2024-09-14T11:15:25.404 INFO:tasks.workunit.client.0.smithi050.stderr: -185> 2024-09-14T11:15:25.047+0000 7f60473a2800 5 AuthRegistry(0x55e9af6813a0) adding con mode: secure 2024-09-14T11:15:25.404 INFO:tasks.workunit.client.0.smithi050.stderr: -184> 2024-09-14T11:15:25.047+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.404 INFO:tasks.workunit.client.0.smithi050.stderr: -183> 2024-09-14T11:15:25.048+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.404 INFO:tasks.workunit.client.0.smithi050.stderr: -182> 2024-09-14T11:15:25.048+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command rotate-key cmddesc rotate-key hook 0x55e9af6814e8 EEXIST 2024-09-14T11:15:25.404 INFO:tasks.workunit.client.0.smithi050.stderr: -181> 2024-09-14T11:15:25.048+0000 7f60473a2800 10 monclient: _reopen_session rank -1 2024-09-14T11:15:25.404 INFO:tasks.workunit.client.0.smithi050.stderr: -180> 2024-09-14T11:15:25.048+0000 7f60473a2800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:15:25.404 INFO:tasks.workunit.client.0.smithi050.stderr: -179> 2024-09-14T11:15:25.048+0000 7f60473a2800 10 monclient(hunting): picked mon.noname-c con 0x55e9af691fc0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:15:25.404 INFO:tasks.workunit.client.0.smithi050.stderr: -178> 2024-09-14T11:15:25.048+0000 7f60473a2800 10 monclient(hunting): picked mon.noname-a con 0x55e9af6bc910 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:15:25.404 INFO:tasks.workunit.client.0.smithi050.stderr: -177> 2024-09-14T11:15:25.048+0000 7f60473a2800 10 monclient(hunting): picked mon.noname-b con 0x55e9af6c1070 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:15:25.404 INFO:tasks.workunit.client.0.smithi050.stderr: -176> 2024-09-14T11:15:25.048+0000 7f60473a2800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:25.404 INFO:tasks.workunit.client.0.smithi050.stderr: -175> 2024-09-14T11:15:25.048+0000 7f60473a2800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:25.405 INFO:tasks.workunit.client.0.smithi050.stderr: -174> 2024-09-14T11:15:25.048+0000 7f60473a2800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:25.405 INFO:tasks.workunit.client.0.smithi050.stderr: -173> 2024-09-14T11:15:25.048+0000 7f60473a2800 10 monclient(hunting): _renew_subs 2024-09-14T11:15:25.405 INFO:tasks.workunit.client.0.smithi050.stderr: -172> 2024-09-14T11:15:25.048+0000 7f60473a2800 10 monclient(hunting): authenticate will time out at 2577.686294s 2024-09-14T11:15:25.405 INFO:tasks.workunit.client.0.smithi050.stderr: -171> 2024-09-14T11:15:25.048+0000 7f603ffff640 10 monclient(hunting): get_auth_request con 0x55e9af6bc910 auth_method 0 2024-09-14T11:15:25.405 INFO:tasks.workunit.client.0.smithi050.stderr: -170> 2024-09-14T11:15:25.048+0000 7f603ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:25.405 INFO:tasks.workunit.client.0.smithi050.stderr: -169> 2024-09-14T11:15:25.048+0000 7f603ffff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:25.405 INFO:tasks.workunit.client.0.smithi050.stderr: -168> 2024-09-14T11:15:25.048+0000 7f603ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:25.405 INFO:tasks.workunit.client.0.smithi050.stderr: -167> 2024-09-14T11:15:25.048+0000 7f6044e8c640 10 monclient(hunting): get_auth_request con 0x55e9af691fc0 auth_method 0 2024-09-14T11:15:25.405 INFO:tasks.workunit.client.0.smithi050.stderr: -166> 2024-09-14T11:15:25.048+0000 7f6044e8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:25.405 INFO:tasks.workunit.client.0.smithi050.stderr: -165> 2024-09-14T11:15:25.048+0000 7f6044e8c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:25.405 INFO:tasks.workunit.client.0.smithi050.stderr: -164> 2024-09-14T11:15:25.048+0000 7f6044e8c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:25.405 INFO:tasks.workunit.client.0.smithi050.stderr: -163> 2024-09-14T11:15:25.048+0000 7f603ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:25.405 INFO:tasks.workunit.client.0.smithi050.stderr: -162> 2024-09-14T11:15:25.048+0000 7f603ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:25.405 INFO:tasks.workunit.client.0.smithi050.stderr: -161> 2024-09-14T11:15:25.048+0000 7f603ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:25.406 INFO:tasks.workunit.client.0.smithi050.stderr: -160> 2024-09-14T11:15:25.048+0000 7f6044e8c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:25.406 INFO:tasks.workunit.client.0.smithi050.stderr: -159> 2024-09-14T11:15:25.048+0000 7f6044e8c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:25.406 INFO:tasks.workunit.client.0.smithi050.stderr: -158> 2024-09-14T11:15:25.048+0000 7f6044e8c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:25.406 INFO:tasks.workunit.client.0.smithi050.stderr: -157> 2024-09-14T11:15:25.048+0000 7f604568d640 10 monclient(hunting): get_auth_request con 0x55e9af6c1070 auth_method 0 2024-09-14T11:15:25.406 INFO:tasks.workunit.client.0.smithi050.stderr: -156> 2024-09-14T11:15:25.048+0000 7f604568d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:25.406 INFO:tasks.workunit.client.0.smithi050.stderr: -155> 2024-09-14T11:15:25.048+0000 7f604568d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:25.406 INFO:tasks.workunit.client.0.smithi050.stderr: -154> 2024-09-14T11:15:25.048+0000 7f604568d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:25.406 INFO:tasks.workunit.client.0.smithi050.stderr: -153> 2024-09-14T11:15:25.048+0000 7f604568d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:25.406 INFO:tasks.workunit.client.0.smithi050.stderr: -152> 2024-09-14T11:15:25.048+0000 7f604568d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:25.406 INFO:tasks.workunit.client.0.smithi050.stderr: -151> 2024-09-14T11:15:25.048+0000 7f604568d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:25.406 INFO:tasks.workunit.client.0.smithi050.stderr: -150> 2024-09-14T11:15:25.048+0000 7f603ffff640 10 monclient(hunting): handle_auth_done global_id 8385 payload 824 2024-09-14T11:15:25.406 INFO:tasks.workunit.client.0.smithi050.stderr: -149> 2024-09-14T11:15:25.048+0000 7f603ffff640 10 monclient: _finish_hunting 0 2024-09-14T11:15:25.406 INFO:tasks.workunit.client.0.smithi050.stderr: -148> 2024-09-14T11:15:25.048+0000 7f603ffff640 1 monclient: found mon.noname-a 2024-09-14T11:15:25.406 INFO:tasks.workunit.client.0.smithi050.stderr: -147> 2024-09-14T11:15:25.048+0000 7f603ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:15:25.406 INFO:tasks.workunit.client.0.smithi050.stderr: -146> 2024-09-14T11:15:25.049+0000 7f5f1a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:25.407 INFO:tasks.workunit.client.0.smithi050.stderr: -145> 2024-09-14T11:15:25.049+0000 7f5f1a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:25.407 INFO:tasks.workunit.client.0.smithi050.stderr: -144> 2024-09-14T11:15:25.049+0000 7f5f1a7fc640 10 monclient: dump: 2024-09-14T11:15:25.407 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:25.407 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:25.407 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.407 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.407 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:25.407 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:25.407 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:25.407 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:25.407 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:25.407 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.407 INFO:tasks.workunit.client.0.smithi050.stderr: -143> 2024-09-14T11:15:25.049+0000 7f5f1a7fc640 10 monclient: _finish_auth 0 2024-09-14T11:15:25.407 INFO:tasks.workunit.client.0.smithi050.stderr: -142> 2024-09-14T11:15:25.049+0000 7f5f1a7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:15:25.407 INFO:tasks.workunit.client.0.smithi050.stderr: -141> 2024-09-14T11:15:25.049+0000 7f5f1a7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:25.408 INFO:tasks.workunit.client.0.smithi050.stderr: -140> 2024-09-14T11:15:25.049+0000 7f5f1a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:25.408 INFO:tasks.workunit.client.0.smithi050.stderr: -139> 2024-09-14T11:15:25.049+0000 7f5f1a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:25.408 INFO:tasks.workunit.client.0.smithi050.stderr: -138> 2024-09-14T11:15:25.049+0000 7f5f1a7fc640 10 monclient: dump: 2024-09-14T11:15:25.408 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:25.408 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:25.408 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.408 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:25.408 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:25.408 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:25.408 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:25.408 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:25.408 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:25.408 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.409 INFO:tasks.workunit.client.0.smithi050.stderr: -137> 2024-09-14T11:15:25.049+0000 7f60473a2800 5 monclient: authenticate success, global_id 8385 2024-09-14T11:15:25.409 INFO:tasks.workunit.client.0.smithi050.stderr: -136> 2024-09-14T11:15:25.049+0000 7f60473a2800 10 monclient: _renew_subs 2024-09-14T11:15:25.409 INFO:tasks.workunit.client.0.smithi050.stderr: -135> 2024-09-14T11:15:25.049+0000 7f5f1bfff640 4 set_mon_vals no callback set 2024-09-14T11:15:25.409 INFO:tasks.workunit.client.0.smithi050.stderr: -134> 2024-09-14T11:15:25.049+0000 7f60473a2800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:15:25.409 INFO:tasks.workunit.client.0.smithi050.stderr: -133> 2024-09-14T11:15:25.049+0000 7f60473a2800 10 monclient: _renew_subs 2024-09-14T11:15:25.409 INFO:tasks.workunit.client.0.smithi050.stderr: -132> 2024-09-14T11:15:25.049+0000 7f60473a2800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:15:25.409 INFO:tasks.workunit.client.0.smithi050.stderr: -131> 2024-09-14T11:15:25.049+0000 7f60473a2800 1 librados: init done 2024-09-14T11:15:25.409 INFO:tasks.workunit.client.0.smithi050.stderr: -130> 2024-09-14T11:15:25.049+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command cr dump hook 0x55e9af6b30c8 2024-09-14T11:15:25.409 INFO:tasks.workunit.client.0.smithi050.stderr: -129> 2024-09-14T11:15:25.051+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.409 INFO:tasks.workunit.client.0.smithi050.stderr: -128> 2024-09-14T11:15:25.051+0000 7f5f1a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:15:25.409 INFO:tasks.workunit.client.0.smithi050.stderr: -127> 2024-09-14T11:15:25.051+0000 7f5f1a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:15:25.409 INFO:tasks.workunit.client.0.smithi050.stderr: -126> 2024-09-14T11:15:25.051+0000 7f5f1a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:15:25.409 INFO:tasks.workunit.client.0.smithi050.stderr: -125> 2024-09-14T11:15:25.052+0000 7f6044e8c640 10 monclient: get_auth_request con 0x7f5f10077260 auth_method 0 2024-09-14T11:15:25.409 INFO:tasks.workunit.client.0.smithi050.stderr: -124> 2024-09-14T11:15:25.052+0000 7f604568d640 10 monclient: get_auth_request con 0x55e9af6db060 auth_method 0 2024-09-14T11:15:25.409 INFO:tasks.workunit.client.0.smithi050.stderr: -123> 2024-09-14T11:15:25.052+0000 7f5f1a7fc640 1 client.8385.objecter ms_handle_reset 0x55e9af6db060 session 0x55e9af6da950 osd.6 2024-09-14T11:15:25.410 INFO:tasks.workunit.client.0.smithi050.stderr: -122> 2024-09-14T11:15:25.052+0000 7f5f1a7fc640 10 monclient: _renew_subs 2024-09-14T11:15:25.410 INFO:tasks.workunit.client.0.smithi050.stderr: -121> 2024-09-14T11:15:25.052+0000 7f5f1a7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:15:25.410 INFO:tasks.workunit.client.0.smithi050.stderr: -120> 2024-09-14T11:15:25.053+0000 7f604568d640 10 monclient: get_auth_request con 0x7f5f10087510 auth_method 0 2024-09-14T11:15:25.410 INFO:tasks.workunit.client.0.smithi050.stderr: -119> 2024-09-14T11:15:25.053+0000 7f60473a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.410 INFO:tasks.workunit.client.0.smithi050.stderr: -118> 2024-09-14T11:15:25.053+0000 7f60473a2800 20 realm 2024-09-14T11:15:25.410 INFO:tasks.workunit.client.0.smithi050.stderr: -117> 2024-09-14T11:15:25.053+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.410 INFO:tasks.workunit.client.0.smithi050.stderr: -116> 2024-09-14T11:15:25.054+0000 7f60473a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.410 INFO:tasks.workunit.client.0.smithi050.stderr: -115> 2024-09-14T11:15:25.054+0000 7f60473a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:25.410 INFO:tasks.workunit.client.0.smithi050.stderr: -114> 2024-09-14T11:15:25.054+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.410 INFO:tasks.workunit.client.0.smithi050.stderr: -113> 2024-09-14T11:15:25.054+0000 7f60473a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.410 INFO:tasks.workunit.client.0.smithi050.stderr: -112> 2024-09-14T11:15:25.054+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.410 INFO:tasks.workunit.client.0.smithi050.stderr: -111> 2024-09-14T11:15:25.054+0000 7f6044e8c640 10 monclient: get_auth_request con 0x55e9af6dc6b0 auth_method 0 2024-09-14T11:15:25.410 INFO:tasks.workunit.client.0.smithi050.stderr: -110> 2024-09-14T11:15:25.055+0000 7f60473a2800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:25.410 INFO:tasks.workunit.client.0.smithi050.stderr: -109> 2024-09-14T11:15:25.055+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.411 INFO:tasks.workunit.client.0.smithi050.stderr: -108> 2024-09-14T11:15:25.055+0000 7f603ffff640 10 monclient: get_auth_request con 0x55e9af6e04c0 auth_method 0 2024-09-14T11:15:25.411 INFO:tasks.workunit.client.0.smithi050.stderr: -107> 2024-09-14T11:15:25.055+0000 7f60473a2800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:25.411 INFO:tasks.workunit.client.0.smithi050.stderr: -106> 2024-09-14T11:15:25.055+0000 7f60473a2800 20 searching for the correct realm 2024-09-14T11:15:25.411 INFO:tasks.workunit.client.0.smithi050.stderr: -105> 2024-09-14T11:15:25.056+0000 7f604568d640 10 monclient: get_auth_request con 0x55e9af6e51e0 auth_method 0 2024-09-14T11:15:25.411 INFO:tasks.workunit.client.0.smithi050.stderr: -104> 2024-09-14T11:15:25.057+0000 7f6044e8c640 10 monclient: get_auth_request con 0x7f604006b430 auth_method 0 2024-09-14T11:15:25.411 INFO:tasks.workunit.client.0.smithi050.stderr: -103> 2024-09-14T11:15:25.058+0000 7f6044e8c640 0 -- 172.21.15.50:0/3504865384 >> [v2:172.21.15.50:6800/2565843969,v1:172.21.15.50:6801/2565843969] conn(0x55e9af6dc6b0 msgr2=0x55e9af6dcb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:25.411 INFO:tasks.workunit.client.0.smithi050.stderr: -102> 2024-09-14T11:15:25.058+0000 7f5f1a7fc640 1 client.8385.objecter ms_handle_reset 0x55e9af6dc6b0 session 0x55e9af6da750 osd.1 2024-09-14T11:15:25.411 INFO:tasks.workunit.client.0.smithi050.stderr: -101> 2024-09-14T11:15:25.058+0000 7f6044e8c640 10 monclient: get_auth_request con 0x55e9af6db060 auth_method 0 2024-09-14T11:15:25.411 INFO:tasks.workunit.client.0.smithi050.stderr: -100> 2024-09-14T11:15:25.059+0000 7f603ffff640 10 monclient: get_auth_request con 0x7f6040055920 auth_method 0 2024-09-14T11:15:25.411 INFO:tasks.workunit.client.0.smithi050.stderr: -99> 2024-09-14T11:15:25.061+0000 7f604568d640 10 monclient: get_auth_request con 0x7f60380682b0 auth_method 0 2024-09-14T11:15:25.411 INFO:tasks.workunit.client.0.smithi050.stderr: -98> 2024-09-14T11:15:25.062+0000 7f6044e8c640 0 -- 172.21.15.50:0/3504865384 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f6040090400 msgr2=0x7f6040090880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:25.411 INFO:tasks.workunit.client.0.smithi050.stderr: -97> 2024-09-14T11:15:25.263+0000 7f6044e8c640 10 monclient: get_auth_request con 0x7f6040090400 auth_method 0 2024-09-14T11:15:25.411 INFO:tasks.workunit.client.0.smithi050.stderr: -96> 2024-09-14T11:15:25.270+0000 7f60473a2800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:15:25.412 INFO:tasks.workunit.client.0.smithi050.stderr: -95> 2024-09-14T11:15:25.270+0000 7f60473a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:25.412 INFO:tasks.workunit.client.0.smithi050.stderr: -94> 2024-09-14T11:15:25.270+0000 7f60473a2800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:15:25.412 INFO:tasks.workunit.client.0.smithi050.stderr: -93> 2024-09-14T11:15:25.270+0000 7f60473a2800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:25.412 INFO:tasks.workunit.client.0.smithi050.stderr: -92> 2024-09-14T11:15:25.270+0000 7f60473a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:25.412 INFO:tasks.workunit.client.0.smithi050.stderr: -91> 2024-09-14T11:15:25.270+0000 7f60473a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:25.412 INFO:tasks.workunit.client.0.smithi050.stderr: -90> 2024-09-14T11:15:25.270+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.412 INFO:tasks.workunit.client.0.smithi050.stderr: -89> 2024-09-14T11:15:25.270+0000 7f60473a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.412 INFO:tasks.workunit.client.0.smithi050.stderr: -88> 2024-09-14T11:15:25.270+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.412 INFO:tasks.workunit.client.0.smithi050.stderr: -87> 2024-09-14T11:15:25.271+0000 7f60473a2800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:25.412 INFO:tasks.workunit.client.0.smithi050.stderr: -86> 2024-09-14T11:15:25.271+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.412 INFO:tasks.workunit.client.0.smithi050.stderr: -85> 2024-09-14T11:15:25.271+0000 7f60473a2800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:25.412 INFO:tasks.workunit.client.0.smithi050.stderr: -84> 2024-09-14T11:15:25.271+0000 7f60473a2800 20 zone default found 2024-09-14T11:15:25.412 INFO:tasks.workunit.client.0.smithi050.stderr: -83> 2024-09-14T11:15:25.271+0000 7f60473a2800 4 Realm: () 2024-09-14T11:15:25.412 INFO:tasks.workunit.client.0.smithi050.stderr: -82> 2024-09-14T11:15:25.271+0000 7f60473a2800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:15:25.413 INFO:tasks.workunit.client.0.smithi050.stderr: -81> 2024-09-14T11:15:25.271+0000 7f60473a2800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:15:25.413 INFO:tasks.workunit.client.0.smithi050.stderr: -80> 2024-09-14T11:15:25.271+0000 7f60473a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:25.413 INFO:tasks.workunit.client.0.smithi050.stderr: -79> 2024-09-14T11:15:25.271+0000 7f60473a2800 20 zonegroup default 2024-09-14T11:15:25.413 INFO:tasks.workunit.client.0.smithi050.stderr: -78> 2024-09-14T11:15:25.271+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.413 INFO:tasks.workunit.client.0.smithi050.stderr: -77> 2024-09-14T11:15:25.271+0000 7f60473a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.413 INFO:tasks.workunit.client.0.smithi050.stderr: -76> 2024-09-14T11:15:25.272+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.413 INFO:tasks.workunit.client.0.smithi050.stderr: -75> 2024-09-14T11:15:25.272+0000 7f60473a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.413 INFO:tasks.workunit.client.0.smithi050.stderr: -74> 2024-09-14T11:15:25.272+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.413 INFO:tasks.workunit.client.0.smithi050.stderr: -73> 2024-09-14T11:15:25.272+0000 7f60473a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.413 INFO:tasks.workunit.client.0.smithi050.stderr: -72> 2024-09-14T11:15:25.272+0000 7f60473a2800 20 started sync module instance, tier type = 2024-09-14T11:15:25.413 INFO:tasks.workunit.client.0.smithi050.stderr: -71> 2024-09-14T11:15:25.272+0000 7f60473a2800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:15:25.413 INFO:tasks.workunit.client.0.smithi050.stderr: -70> 2024-09-14T11:15:25.282+0000 7f60473a2800 20 add_watcher() i=0 2024-09-14T11:15:25.413 INFO:tasks.workunit.client.0.smithi050.stderr: -69> 2024-09-14T11:15:25.282+0000 7f60473a2800 20 add_watcher() i=1 2024-09-14T11:15:25.413 INFO:tasks.workunit.client.0.smithi050.stderr: -68> 2024-09-14T11:15:25.282+0000 7f60473a2800 20 add_watcher() i=2 2024-09-14T11:15:25.414 INFO:tasks.workunit.client.0.smithi050.stderr: -67> 2024-09-14T11:15:25.282+0000 7f60473a2800 20 add_watcher() i=3 2024-09-14T11:15:25.414 INFO:tasks.workunit.client.0.smithi050.stderr: -66> 2024-09-14T11:15:25.282+0000 7f60473a2800 20 add_watcher() i=4 2024-09-14T11:15:25.414 INFO:tasks.workunit.client.0.smithi050.stderr: -65> 2024-09-14T11:15:25.282+0000 7f60473a2800 20 add_watcher() i=5 2024-09-14T11:15:25.414 INFO:tasks.workunit.client.0.smithi050.stderr: -64> 2024-09-14T11:15:25.282+0000 7f60473a2800 20 add_watcher() i=6 2024-09-14T11:15:25.414 INFO:tasks.workunit.client.0.smithi050.stderr: -63> 2024-09-14T11:15:25.284+0000 7f60473a2800 20 add_watcher() i=7 2024-09-14T11:15:25.414 INFO:tasks.workunit.client.0.smithi050.stderr: -62> 2024-09-14T11:15:25.284+0000 7f60473a2800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:25.414 INFO:tasks.workunit.client.0.smithi050.stderr: -61> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding auth protocol: cephx 2024-09-14T11:15:25.414 INFO:tasks.workunit.client.0.smithi050.stderr: -60> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding auth protocol: cephx 2024-09-14T11:15:25.414 INFO:tasks.workunit.client.0.smithi050.stderr: -59> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding auth protocol: cephx 2024-09-14T11:15:25.414 INFO:tasks.workunit.client.0.smithi050.stderr: -58> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding con mode: secure 2024-09-14T11:15:25.414 INFO:tasks.workunit.client.0.smithi050.stderr: -57> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding con mode: crc 2024-09-14T11:15:25.414 INFO:tasks.workunit.client.0.smithi050.stderr: -56> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding con mode: secure 2024-09-14T11:15:25.414 INFO:tasks.workunit.client.0.smithi050.stderr: -55> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding con mode: crc 2024-09-14T11:15:25.414 INFO:tasks.workunit.client.0.smithi050.stderr: -54> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding con mode: secure 2024-09-14T11:15:25.414 INFO:tasks.workunit.client.0.smithi050.stderr: -53> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding con mode: crc 2024-09-14T11:15:25.415 INFO:tasks.workunit.client.0.smithi050.stderr: -52> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding con mode: crc 2024-09-14T11:15:25.415 INFO:tasks.workunit.client.0.smithi050.stderr: -51> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding con mode: secure 2024-09-14T11:15:25.415 INFO:tasks.workunit.client.0.smithi050.stderr: -50> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding con mode: crc 2024-09-14T11:15:25.415 INFO:tasks.workunit.client.0.smithi050.stderr: -49> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding con mode: secure 2024-09-14T11:15:25.415 INFO:tasks.workunit.client.0.smithi050.stderr: -48> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding con mode: crc 2024-09-14T11:15:25.415 INFO:tasks.workunit.client.0.smithi050.stderr: -47> 2024-09-14T11:15:25.286+0000 7f5efafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:25.415 INFO:tasks.workunit.client.0.smithi050.stderr: -46> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 AuthRegistry(0x7ffd01ccaf00) adding con mode: secure 2024-09-14T11:15:25.415 INFO:tasks.workunit.client.0.smithi050.stderr: -45> 2024-09-14T11:15:25.286+0000 7f60473a2800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:25.415 INFO:tasks.workunit.client.0.smithi050.stderr: -44> 2024-09-14T11:15:25.286+0000 7f60473a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:25.415 INFO:tasks.workunit.client.0.smithi050.stderr: -43> 2024-09-14T11:15:25.286+0000 7f60473a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:25.415 INFO:tasks.workunit.client.0.smithi050.stderr: -42> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command cache list hook 0x55e9af6b8af0 2024-09-14T11:15:25.415 INFO:tasks.workunit.client.0.smithi050.stderr: -41> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command cache inspect hook 0x55e9af6b8af0 2024-09-14T11:15:25.415 INFO:tasks.workunit.client.0.smithi050.stderr: -40> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command cache erase hook 0x55e9af6b8af0 2024-09-14T11:15:25.415 INFO:tasks.workunit.client.0.smithi050.stderr: -39> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command cache zap hook 0x55e9af6b8af0 2024-09-14T11:15:25.415 INFO:tasks.workunit.client.0.smithi050.stderr: -38> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 note: GC not initialized 2024-09-14T11:15:25.415 INFO:tasks.workunit.client.0.smithi050.stderr: -37> 2024-09-14T11:15:25.286+0000 7f5ef9fe3640 20 reqs_thread_entry: start 2024-09-14T11:15:25.416 INFO:tasks.workunit.client.0.smithi050.stderr: -36> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command sync trace show hook 0x7f6038065040 2024-09-14T11:15:25.416 INFO:tasks.workunit.client.0.smithi050.stderr: -35> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command sync trace history hook 0x7f6038065040 2024-09-14T11:15:25.416 INFO:tasks.workunit.client.0.smithi050.stderr: -34> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command sync trace active hook 0x7f6038065040 2024-09-14T11:15:25.416 INFO:tasks.workunit.client.0.smithi050.stderr: -33> 2024-09-14T11:15:25.286+0000 7f60473a2800 5 asok(0x55e9af3d0270) register_command sync trace active_short hook 0x7f6038065040 2024-09-14T11:15:25.416 INFO:tasks.workunit.client.0.smithi050.stderr: -32> 2024-09-14T11:15:25.286+0000 7f60473a2800 20 init_complete bucket index max shards: 11 2024-09-14T11:15:25.416 INFO:tasks.workunit.client.0.smithi050.stderr: -31> 2024-09-14T11:15:25.287+0000 7f60473a2800 20 Filter name: none 2024-09-14T11:15:25.416 INFO:tasks.workunit.client.0.smithi050.stderr: -30> 2024-09-14T11:15:25.287+0000 7f5e6b7fe640 20 reqs_thread_entry: start 2024-09-14T11:15:25.416 INFO:tasks.workunit.client.0.smithi050.stderr: -29> 2024-09-14T11:15:25.287+0000 7f60473a2800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:15:25.416 INFO:tasks.workunit.client.0.smithi050.stderr: -28> 2024-09-14T11:15:25.287+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.416 INFO:tasks.workunit.client.0.smithi050.stderr: -27> 2024-09-14T11:15:25.287+0000 7f60473a2800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:15:25.416 INFO:tasks.workunit.client.0.smithi050.stderr: -26> 2024-09-14T11:15:25.287+0000 7f60473a2800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:15:25.416 INFO:tasks.workunit.client.0.smithi050.stderr: -25> 2024-09-14T11:15:25.287+0000 7f60473a2800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:15:25.416 INFO:tasks.workunit.client.0.smithi050.stderr: -24> 2024-09-14T11:15:25.287+0000 7f60473a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : miss 2024-09-14T11:15:25.416 INFO:tasks.workunit.client.0.smithi050.stderr: -23> 2024-09-14T11:15:25.287+0000 7f60473a2800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.417 INFO:tasks.workunit.client.0.smithi050.stderr: -22> 2024-09-14T11:15:25.288+0000 7f60473a2800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:15:25.417 INFO:tasks.workunit.client.0.smithi050.stderr: -21> 2024-09-14T11:15:25.288+0000 7f60473a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:15:25.417 INFO:tasks.workunit.client.0.smithi050.stderr: -20> 2024-09-14T11:15:25.288+0000 7f60473a2800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:15:25.417 INFO:tasks.workunit.client.0.smithi050.stderr: -19> 2024-09-14T11:15:25.288+0000 7f60473a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:25.417 INFO:tasks.workunit.client.0.smithi050.stderr: -18> 2024-09-14T11:15:25.288+0000 7f60473a2800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:25.417 INFO:tasks.workunit.client.0.smithi050.stderr: -17> 2024-09-14T11:15:25.288+0000 7f60473a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:15:25.417 INFO:tasks.workunit.client.0.smithi050.stderr: -16> 2024-09-14T11:15:25.289+0000 7f60473a2800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:15:25.417 INFO:tasks.workunit.client.0.smithi050.stderr: -15> 2024-09-14T11:15:25.293+0000 7f5f1a7fc640 1 client.8385.objecter ms_handle_reset 0x7f6040090400 session 0x7f6040055d80 osd.3 2024-09-14T11:15:25.417 INFO:tasks.workunit.client.0.smithi050.stderr: -14> 2024-09-14T11:15:25.294+0000 7f6044e8c640 10 monclient: get_auth_request con 0x55e9af6dc6b0 auth_method 0 2024-09-14T11:15:25.417 INFO:tasks.workunit.client.0.smithi050.stderr: -13> 2024-09-14T11:15:25.297+0000 7f60473a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:15:25.417 INFO:tasks.workunit.client.0.smithi050.stderr: -12> 2024-09-14T11:15:25.297+0000 7f60473a2800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:15:25.417 INFO:tasks.workunit.client.0.smithi050.stderr: -11> 2024-09-14T11:15:25.297+0000 7f60473a2800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:25.417 INFO:tasks.workunit.client.0.smithi050.stderr: -10> 2024-09-14T11:15:25.297+0000 7f60473a2800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18, ofs0, ns] 2024-09-14T11:15:25.417 INFO:tasks.workunit.client.0.smithi050.stderr: -9> 2024-09-14T11:15:25.298+0000 7f5f1bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497134 cookie 94462159002096 notifier 8385 bl.length()=911 2024-09-14T11:15:25.418 INFO:tasks.workunit.client.0.smithi050.stderr: -8> 2024-09-14T11:15:25.298+0000 7f5f1bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:15:25.418 INFO:tasks.workunit.client.0.smithi050.stderr: -7> 2024-09-14T11:15:25.298+0000 7f5f1bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:15:25.418 INFO:tasks.workunit.client.0.smithi050.stderr: -6> 2024-09-14T11:15:25.298+0000 7f5f1bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:25.418 INFO:tasks.workunit.client.0.smithi050.stderr: -5> 2024-09-14T11:15:25.299+0000 7f60473a2800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_sources= new_sources= 2024-09-14T11:15:25.418 INFO:tasks.workunit.client.0.smithi050.stderr: -4> 2024-09-14T11:15:25.299+0000 7f60473a2800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential sources added=[] removed=[] 2024-09-14T11:15:25.418 INFO:tasks.workunit.client.0.smithi050.stderr: -3> 2024-09-14T11:15:25.299+0000 7f60473a2800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_dests= new_dests= 2024-09-14T11:15:25.418 INFO:tasks.workunit.client.0.smithi050.stderr: -2> 2024-09-14T11:15:25.299+0000 7f60473a2800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential dests added=[] removed=[] 2024-09-14T11:15:25.418 INFO:tasks.workunit.client.0.smithi050.stderr: -1> 2024-09-14T11:15:25.304+0000 7f60473a2800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f60473a2800 time 2024-09-14T11:15:25.304878+0000 2024-09-14T11:15:25.418 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:15:25.418 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.418 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:25.418 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f604a98c76a] 2024-09-14T11:15:25.418 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f604a98c928] 2024-09-14T11:15:25.418 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e9ad2a40b1] 2024-09-14T11:15:25.418 INFO:tasks.workunit.client.0.smithi050.stderr: 4: radosgw-admin(+0xd8907c) [0x55e9ad7b807c] 2024-09-14T11:15:25.419 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e9ad2b3efd] 2024-09-14T11:15:25.419 INFO:tasks.workunit.client.0.smithi050.stderr: 6: main() 2024-09-14T11:15:25.419 INFO:tasks.workunit.client.0.smithi050.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6049629590] 2024-09-14T11:15:25.419 INFO:tasks.workunit.client.0.smithi050.stderr: 8: __libc_start_main() 2024-09-14T11:15:25.419 INFO:tasks.workunit.client.0.smithi050.stderr: 9: _start() 2024-09-14T11:15:25.419 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.419 INFO:tasks.workunit.client.0.smithi050.stderr: 0> 2024-09-14T11:15:25.305+0000 7f60473a2800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:15:25.419 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f60473a2800 thread_name:radosgw-admin 2024-09-14T11:15:25.419 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.419 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:25.419 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f604963e6f0] 2024-09-14T11:15:25.419 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f604968b99c] 2024-09-14T11:15:25.419 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:15:25.419 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:15:25.420 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f604a98c7c4] 2024-09-14T11:15:25.420 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f604a98c928] 2024-09-14T11:15:25.420 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e9ad2a40b1] 2024-09-14T11:15:25.420 INFO:tasks.workunit.client.0.smithi050.stderr: 8: radosgw-admin(+0xd8907c) [0x55e9ad7b807c] 2024-09-14T11:15:25.420 INFO:tasks.workunit.client.0.smithi050.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e9ad2b3efd] 2024-09-14T11:15:25.420 INFO:tasks.workunit.client.0.smithi050.stderr: 10: main() 2024-09-14T11:15:25.420 INFO:tasks.workunit.client.0.smithi050.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6049629590] 2024-09-14T11:15:25.420 INFO:tasks.workunit.client.0.smithi050.stderr: 12: __libc_start_main() 2024-09-14T11:15:25.420 INFO:tasks.workunit.client.0.smithi050.stderr: 13: _start() 2024-09-14T11:15:25.420 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:15:25.420 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:25.420 INFO:tasks.workunit.client.0.smithi050.stderr:--- logging levels --- 2024-09-14T11:15:25.420 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 none 2024-09-14T11:15:25.420 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 lockdep 2024-09-14T11:15:25.420 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 context 2024-09-14T11:15:25.420 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 crush 2024-09-14T11:15:25.421 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds 2024-09-14T11:15:25.421 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_balancer 2024-09-14T11:15:25.421 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_locker 2024-09-14T11:15:25.421 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log 2024-09-14T11:15:25.421 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log_expire 2024-09-14T11:15:25.421 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_migrator 2024-09-14T11:15:25.421 INFO:tasks.workunit.client.0.smithi050.stderr: 3/ 5 mds_quiesce 2024-09-14T11:15:25.421 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 buffer 2024-09-14T11:15:25.421 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 timer 2024-09-14T11:15:25.421 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 filer 2024-09-14T11:15:25.421 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 striper 2024-09-14T11:15:25.421 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 objecter 2024-09-14T11:15:25.421 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rados 2024-09-14T11:15:25.421 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd 2024-09-14T11:15:25.421 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_mirror 2024-09-14T11:15:25.422 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_replay 2024-09-14T11:15:25.422 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_pwl 2024-09-14T11:15:25.422 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 journaler 2024-09-14T11:15:25.422 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objectcacher 2024-09-14T11:15:25.422 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:15:25.422 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 client 2024-09-14T11:15:25.422 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 osd 2024-09-14T11:15:25.422 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 optracker 2024-09-14T11:15:25.422 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objclass 2024-09-14T11:15:25.422 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 filestore 2024-09-14T11:15:25.422 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 journal 2024-09-14T11:15:25.422 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 ms 2024-09-14T11:15:25.422 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mon 2024-09-14T11:15:25.423 INFO:tasks.workunit.client.0.smithi050.stderr: 0/10 monc 2024-09-14T11:15:25.423 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 paxos 2024-09-14T11:15:25.423 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 tp 2024-09-14T11:15:25.423 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 auth 2024-09-14T11:15:25.423 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 crypto 2024-09-14T11:15:25.423 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 finisher 2024-09-14T11:15:25.423 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 reserver 2024-09-14T11:15:25.423 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 heartbeatmap 2024-09-14T11:15:25.423 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 perfcounter 2024-09-14T11:15:25.423 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw 2024-09-14T11:15:25.423 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_sync 2024-09-14T11:15:25.423 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_datacache 2024-09-14T11:15:25.423 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_access 2024-09-14T11:15:25.423 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:15:25.423 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_flight 2024-09-14T11:15:25.423 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:15:25.424 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw_notification 2024-09-14T11:15:25.424 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 javaclient 2024-09-14T11:15:25.424 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 asok 2024-09-14T11:15:25.424 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 throttle 2024-09-14T11:15:25.424 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 refs 2024-09-14T11:15:25.424 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 compressor 2024-09-14T11:15:25.424 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluestore 2024-09-14T11:15:25.424 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluefs 2024-09-14T11:15:25.424 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 bdev 2024-09-14T11:15:25.424 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 kstore 2024-09-14T11:15:25.424 INFO:tasks.workunit.client.0.smithi050.stderr: 4/ 5 rocksdb 2024-09-14T11:15:25.424 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 fuse 2024-09-14T11:15:25.424 INFO:tasks.workunit.client.0.smithi050.stderr: 2/ 5 mgr 2024-09-14T11:15:25.424 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mgrc 2024-09-14T11:15:25.424 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 dpdk 2024-09-14T11:15:25.424 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 eventtrace 2024-09-14T11:15:25.425 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 prioritycache 2024-09-14T11:15:25.425 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 test 2024-09-14T11:15:25.425 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:15:25.425 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephsqlite 2024-09-14T11:15:25.425 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:15:25.425 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore 2024-09-14T11:15:25.425 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_onode 2024-09-14T11:15:25.425 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_odata 2024-09-14T11:15:25.425 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_omap 2024-09-14T11:15:25.425 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_tm 2024-09-14T11:15:25.425 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_t 2024-09-14T11:15:25.425 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:15:25.425 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_epm 2024-09-14T11:15:25.426 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_lba 2024-09-14T11:15:25.426 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:15:25.426 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cache 2024-09-14T11:15:25.426 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_journal 2024-09-14T11:15:25.426 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_device 2024-09-14T11:15:25.426 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_backref 2024-09-14T11:15:25.426 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 alienstore 2024-09-14T11:15:25.426 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mclock 2024-09-14T11:15:25.426 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cyanstore 2024-09-14T11:15:25.426 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 ceph_exporter 2024-09-14T11:15:25.426 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 memstore 2024-09-14T11:15:25.426 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 trace 2024-09-14T11:15:25.426 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 ceph_dedup 2024-09-14T11:15:25.426 INFO:tasks.workunit.client.0.smithi050.stderr: -2/-2 (syslog threshold) 2024-09-14T11:15:25.426 INFO:tasks.workunit.client.0.smithi050.stderr: 99/99 (stderr threshold) 2024-09-14T11:15:25.427 INFO:tasks.workunit.client.0.smithi050.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:15:25.427 INFO:tasks.workunit.client.0.smithi050.stderr: 7f5e6b7fe640 / http_manager 2024-09-14T11:15:25.427 INFO:tasks.workunit.client.0.smithi050.stderr: 7f5ef9fe3640 / http_manager 2024-09-14T11:15:25.427 INFO:tasks.workunit.client.0.smithi050.stderr: 7f5efafe5640 / rgw_dt_lg_renew 2024-09-14T11:15:25.427 INFO:tasks.workunit.client.0.smithi050.stderr: 7f5f1a7fc640 / ms_dispatch 2024-09-14T11:15:25.427 INFO:tasks.workunit.client.0.smithi050.stderr: 7f5f1bfff640 / io_context_pool 2024-09-14T11:15:25.427 INFO:tasks.workunit.client.0.smithi050.stderr: 7f5f2a7fc640 / ms_dispatch 2024-09-14T11:15:25.427 INFO:tasks.workunit.client.0.smithi050.stderr: 7f5f31602640 / ms_dispatch 2024-09-14T11:15:25.427 INFO:tasks.workunit.client.0.smithi050.stderr: 7f5f32e05640 / io_context_pool 2024-09-14T11:15:25.427 INFO:tasks.workunit.client.0.smithi050.stderr: 7f603ffff640 / msgr-worker-2 2024-09-14T11:15:25.428 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6044e8c640 / msgr-worker-1 2024-09-14T11:15:25.428 INFO:tasks.workunit.client.0.smithi050.stderr: 7f604568d640 / msgr-worker-0 2024-09-14T11:15:25.428 INFO:tasks.workunit.client.0.smithi050.stderr: 7f6045e8e640 / io_context_pool 2024-09-14T11:15:25.428 INFO:tasks.workunit.client.0.smithi050.stderr: 7f60473a2800 / radosgw-admin 2024-09-14T11:15:25.428 INFO:tasks.workunit.client.0.smithi050.stderr: max_recent 500 2024-09-14T11:15:25.428 INFO:tasks.workunit.client.0.smithi050.stderr: max_new 1000 2024-09-14T11:15:25.428 INFO:tasks.workunit.client.0.smithi050.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:15:25.306622Z_4cf495b0-4a17-4313-8b9b-6ae925283716/log 2024-09-14T11:15:25.428 INFO:tasks.workunit.client.0.smithi050.stderr:--- end dump of recent events --- 2024-09-14T11:15:25.428 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:15:25.429 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:25.430 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:25.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.389+0000 7f5b21840800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.390+0000 7f5b21840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.390+0000 7f5b21840800 20 realm 2024-09-14T11:15:25.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.390+0000 7f5b21840800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.391+0000 7f5b21840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.391+0000 7f5b21840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:25.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.391+0000 7f5b21840800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.391+0000 7f5b21840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.391+0000 7f5b21840800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.392+0000 7f5b21840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:25.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.392+0000 7f5b21840800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.392+0000 7f5b21840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:25.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.392+0000 7f5b21840800 20 searching for the correct realm 2024-09-14T11:15:25.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.396+0000 7f5b1eb29640 0 -- 172.21.15.50:0/347251522 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f5b18033040 msgr2=0x7f5b18033420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:25.431 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.399+0000 7f5b1f32a640 0 -- 172.21.15.50:0/347251522 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f5b18020430 msgr2=0x7f5b18020890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:25.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.605+0000 7f5b21840800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:15:25.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.605+0000 7f5b21840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:25.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.605+0000 7f5b21840800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:15:25.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.605+0000 7f5b21840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:25.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.605+0000 7f5b21840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:25.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.605+0000 7f5b21840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:25.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.605+0000 7f5b21840800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.605+0000 7f5b21840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.605+0000 7f5b21840800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.606+0000 7f5b21840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:25.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.606+0000 7f5b21840800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.606+0000 7f5b21840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:25.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.606+0000 7f5b21840800 20 zone default found 2024-09-14T11:15:25.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.606+0000 7f5b21840800 4 Realm: () 2024-09-14T11:15:25.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.606+0000 7f5b21840800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:15:25.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.606+0000 7f5b21840800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:15:25.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.606+0000 7f5b21840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:25.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.606+0000 7f5b21840800 20 zonegroup default 2024-09-14T11:15:25.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.606+0000 7f5b21840800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.606+0000 7f5b21840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.606+0000 7f5b21840800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.607+0000 7f5b21840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.607+0000 7f5b21840800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.607+0000 7f5b21840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.607+0000 7f5b21840800 20 started sync module instance, tier type = 2024-09-14T11:15:25.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.607+0000 7f5b21840800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:15:25.615 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.616+0000 7f5b21840800 20 add_watcher() i=0 2024-09-14T11:15:25.616 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.616+0000 7f5b21840800 20 add_watcher() i=1 2024-09-14T11:15:25.616 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.616+0000 7f5b21840800 20 add_watcher() i=2 2024-09-14T11:15:25.616 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.616+0000 7f5b21840800 20 add_watcher() i=3 2024-09-14T11:15:25.616 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.616+0000 7f5b21840800 20 add_watcher() i=4 2024-09-14T11:15:25.616 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.616+0000 7f5b21840800 20 add_watcher() i=5 2024-09-14T11:15:25.616 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.616+0000 7f5b21840800 20 add_watcher() i=6 2024-09-14T11:15:25.616 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.618+0000 7f5b21840800 20 add_watcher() i=7 2024-09-14T11:15:25.616 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.618+0000 7f5b21840800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:25.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.620+0000 7f59d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:25.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.620+0000 7f5b21840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:25.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.620+0000 7f5b21840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:25.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.620+0000 7f5b21840800 5 note: GC not initialized 2024-09-14T11:15:25.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.621+0000 7f59d4fe1640 20 reqs_thread_entry: start 2024-09-14T11:15:25.620 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.621+0000 7f5b21840800 20 init_complete bucket index max shards: 11 2024-09-14T11:15:25.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.621+0000 7f5b21840800 20 Filter name: none 2024-09-14T11:15:25.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.621+0000 7f594e7fc640 20 reqs_thread_entry: start 2024-09-14T11:15:25.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.621+0000 7f5b21840800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:15:25.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.621+0000 7f5b21840800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.621+0000 7f5b21840800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:15:25.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.621+0000 7f5b21840800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:15:25.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.621+0000 7f5b21840800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:15:25.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.621+0000 7f5b21840800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : miss 2024-09-14T11:15:25.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.621+0000 7f5b21840800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.622+0000 7f5b21840800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:15:25.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.622+0000 7f5b21840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:15:25.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.622+0000 7f5b21840800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:15:25.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.622+0000 7f5b21840800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:25.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.622+0000 7f5b21840800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:25.622 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.622+0000 7f5b21840800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:15:25.623 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.622+0000 7f5b21840800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:15:25.623 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.622+0000 7f5b21840800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:15:25.623 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.623+0000 7f5b21840800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:15:25.623 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.623+0000 7f5b21840800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:15:25.623 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.623+0000 7f5b21840800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:15:25.623 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.623+0000 7f5b21840800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:15:25.623 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.623+0000 7f5b21840800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:15:25.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.623+0000 7f5b21840800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:15:25.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.624+0000 7f5b21840800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:15:25.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.624+0000 7f5b21840800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:15:25.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.624+0000 7f5b21840800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:15:25.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.624+0000 7f5b21840800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:15:25.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.624+0000 7f5b21840800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:15:25.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.624+0000 7f5b21840800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:15:25.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.625+0000 7f5b21840800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:15:25.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.625+0000 7f5b21840800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:15:25.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.625+0000 7f5b21840800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:15:25.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.625+0000 7f5b21840800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:15:25.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.626+0000 7f5b21840800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:15:25.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.626+0000 7f5b21840800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:15:25.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.626+0000 7f5b21840800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:15:25.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.626+0000 7f5b21840800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:15:25.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.626+0000 7f5b21840800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:15:25.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.626+0000 7f5b21840800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:15:25.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.627+0000 7f5b21840800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:15:25.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.627+0000 7f5b21840800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:15:25.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.628+0000 7f59d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:25.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.630+0000 7f5b21840800 20 remove_watcher() i=0 2024-09-14T11:15:25.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.630+0000 7f5b21840800 2 removed watcher, disabling cache 2024-09-14T11:15:25.630 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.631+0000 7f5b21840800 20 remove_watcher() i=1 2024-09-14T11:15:25.631 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.632+0000 7f5b21840800 20 remove_watcher() i=2 2024-09-14T11:15:25.632 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.633+0000 7f5b21840800 20 remove_watcher() i=3 2024-09-14T11:15:25.634 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.635+0000 7f5b21840800 20 remove_watcher() i=4 2024-09-14T11:15:25.635 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.636+0000 7f5b21840800 20 remove_watcher() i=5 2024-09-14T11:15:25.636 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.637+0000 7f5b21840800 20 remove_watcher() i=6 2024-09-14T11:15:25.637 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:25.638+0000 7f5b21840800 20 remove_watcher() i=7 2024-09-14T11:15:25.649 INFO:tasks.workunit.client.0.smithi050.stderr: test: duplicated entries can be purged manually 2024-09-14T11:15:55.681 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:15:55.715 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:55.715 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:55.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.763+0000 7fd0f9346800 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.763 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.765+0000 7fd0f9346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:55.763 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.765+0000 7fd0f9346800 20 realm 2024-09-14T11:15:55.763 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.765+0000 7fd0f9346800 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.764 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.765+0000 7fd0f9346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:55.764 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.765+0000 7fd0f9346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:55.764 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.765+0000 7fd0f9346800 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.764 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.765+0000 7fd0f9346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:55.764 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.765+0000 7fd0f9346800 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.764 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.766+0000 7fd0f9346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:55.764 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.766+0000 7fd0f9346800 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.765 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.767+0000 7fd0f9346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:55.765 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.767+0000 7fd0f9346800 20 searching for the correct realm 2024-09-14T11:15:55.769 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.771+0000 7fd0f662f640 0 -- 172.21.15.50:0/1088548828 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fd0f009ea70 msgr2=0x7fd0f00b0040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:55.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.978+0000 7fd0f662f640 0 -- 172.21.15.50:0/1088548828 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55f707293be0 msgr2=0x55f707296080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:55.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.983+0000 7fd0f9346800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:15:55.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.983+0000 7fd0f9346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:55.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.983+0000 7fd0f9346800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:15:55.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.983+0000 7fd0f9346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:55.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.983+0000 7fd0f9346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:55.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.983+0000 7fd0f9346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:55.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.983+0000 7fd0f9346800 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.984+0000 7fd0f9346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:55.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.984+0000 7fd0f9346800 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.984+0000 7fd0f9346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:55.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.984+0000 7fd0f9346800 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.985+0000 7fd0f9346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:55.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.985+0000 7fd0f9346800 20 zone default found 2024-09-14T11:15:55.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.985+0000 7fd0f9346800 4 Realm: () 2024-09-14T11:15:55.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.985+0000 7fd0f9346800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:15:55.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.985+0000 7fd0f9346800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:15:55.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.985+0000 7fd0f9346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:55.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.985+0000 7fd0f9346800 20 zonegroup default 2024-09-14T11:15:55.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.985+0000 7fd0f9346800 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.985+0000 7fd0f9346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:55.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.985+0000 7fd0f9346800 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.985+0000 7fd0f9346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:55.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.985+0000 7fd0f9346800 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.986+0000 7fd0f9346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:55.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.986+0000 7fd0f9346800 20 started sync module instance, tier type = 2024-09-14T11:15:55.984 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.986+0000 7fd0f9346800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:15:55.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.996+0000 7fd0f9346800 20 add_watcher() i=0 2024-09-14T11:15:55.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.996+0000 7fd0f9346800 20 add_watcher() i=1 2024-09-14T11:15:55.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.996+0000 7fd0f9346800 20 add_watcher() i=2 2024-09-14T11:15:55.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.996+0000 7fd0f9346800 20 add_watcher() i=3 2024-09-14T11:15:55.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.996+0000 7fd0f9346800 20 add_watcher() i=4 2024-09-14T11:15:55.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.996+0000 7fd0f9346800 20 add_watcher() i=5 2024-09-14T11:15:55.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.996+0000 7fd0f9346800 20 add_watcher() i=6 2024-09-14T11:15:55.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.997+0000 7fd0f9346800 20 add_watcher() i=7 2024-09-14T11:15:55.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.997+0000 7fd0f9346800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:55.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:55.999+0000 7fcfad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:55.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.000+0000 7fd0f9346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:55.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.000+0000 7fd0f9346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:55.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.000+0000 7fd0f9346800 5 note: GC not initialized 2024-09-14T11:15:55.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.000+0000 7fcf27fff640 20 reqs_thread_entry: start 2024-09-14T11:15:55.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.000+0000 7fd0f9346800 20 init_complete bucket index max shards: 11 2024-09-14T11:15:55.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.000+0000 7fd0f9346800 20 Filter name: none 2024-09-14T11:15:55.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.000+0000 7fcf25ffb640 20 reqs_thread_entry: start 2024-09-14T11:15:55.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.000+0000 7fd0f9346800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.000 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.001+0000 7fd0f9346800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:15:56.000 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.001+0000 7fd0f9346800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.000 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.001+0000 7fd0f9346800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:15:56.000 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.001+0000 7fd0f9346800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:56.000 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.001+0000 7fd0f9346800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.000 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.002+0000 7fd0f9346800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:15:56.000 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.002+0000 7fd0f9346800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.002+0000 7fd0f9346800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:15:56.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.002+0000 7fd0f9346800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:56.002 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.004+0000 7fcfad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:56.005 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.007+0000 7fd0f9346800 20 remove_watcher() i=0 2024-09-14T11:15:56.005 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.007+0000 7fd0f9346800 2 removed watcher, disabling cache 2024-09-14T11:15:56.006 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.008+0000 7fd0f9346800 20 remove_watcher() i=1 2024-09-14T11:15:56.007 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.009+0000 7fd0f9346800 20 remove_watcher() i=2 2024-09-14T11:15:56.008 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.010+0000 7fd0f9346800 20 remove_watcher() i=3 2024-09-14T11:15:56.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.011+0000 7fd0f9346800 20 remove_watcher() i=4 2024-09-14T11:15:56.010 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.012+0000 7fd0f9346800 20 remove_watcher() i=5 2024-09-14T11:15:56.012 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.014+0000 7fd0f9346800 20 remove_watcher() i=6 2024-09-14T11:15:56.013 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.015+0000 7fd0f9346800 20 remove_watcher() i=7 2024-09-14T11:15:56.026 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.026 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:15:56.026 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: a-bucket id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-14T11:15:56.026 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.028 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:15:56.064 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:56.064 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:56.107 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.109+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.111+0000 7f1039725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.111+0000 7f1039725800 20 realm 2024-09-14T11:15:56.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.111+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.111+0000 7f1039725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.111+0000 7f1039725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:56.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.111+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.112+0000 7f1039725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.110 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.112+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.112+0000 7f1039725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:56.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.112+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.113+0000 7f1039725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:56.111 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.113+0000 7f1039725800 20 searching for the correct realm 2024-09-14T11:15:56.114 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.116+0000 7f1034bad640 0 -- 172.21.15.50:0/1467493040 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f103002f040 msgr2=0x7f1030023910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:15:56.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.321+0000 7f1035baf640 0 -- 172.21.15.50:0/1467493040 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55a1aab05620 msgr2=0x55a1aab07ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:56.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.326+0000 7f1039725800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:15:56.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.326+0000 7f1039725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:56.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.326+0000 7f1039725800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:15:56.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.326+0000 7f1039725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:56.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.326+0000 7f1039725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:56.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.326+0000 7f1039725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:56.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.326+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.326+0000 7f1039725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.326+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.326+0000 7f1039725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:56.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.326+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.327+0000 7f1039725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:56.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.327+0000 7f1039725800 20 zone default found 2024-09-14T11:15:56.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.327+0000 7f1039725800 4 Realm: () 2024-09-14T11:15:56.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.327+0000 7f1039725800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:15:56.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.327+0000 7f1039725800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:15:56.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.327+0000 7f1039725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:56.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.327+0000 7f1039725800 20 zonegroup default 2024-09-14T11:15:56.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.327+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.327+0000 7f1039725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.327+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.327+0000 7f1039725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.327+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.328+0000 7f1039725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.328+0000 7f1039725800 20 started sync module instance, tier type = 2024-09-14T11:15:56.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.328+0000 7f1039725800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:15:56.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.337+0000 7f1039725800 20 add_watcher() i=0 2024-09-14T11:15:56.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.337+0000 7f1039725800 20 add_watcher() i=1 2024-09-14T11:15:56.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.337+0000 7f1039725800 20 add_watcher() i=2 2024-09-14T11:15:56.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.337+0000 7f1039725800 20 add_watcher() i=3 2024-09-14T11:15:56.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.337+0000 7f1039725800 20 add_watcher() i=4 2024-09-14T11:15:56.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.337+0000 7f1039725800 20 add_watcher() i=5 2024-09-14T11:15:56.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.337+0000 7f1039725800 20 add_watcher() i=6 2024-09-14T11:15:56.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.338+0000 7f1039725800 20 add_watcher() i=7 2024-09-14T11:15:56.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.338+0000 7f1039725800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:56.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.340+0000 7f0eeb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:56.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.340+0000 7f1039725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:56.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.340+0000 7f1039725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:56.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.340+0000 7f1039725800 5 note: GC not initialized 2024-09-14T11:15:56.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.340+0000 7f0eea7e4640 20 reqs_thread_entry: start 2024-09-14T11:15:56.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.341+0000 7f1039725800 20 init_complete bucket index max shards: 11 2024-09-14T11:15:56.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.341+0000 7f1039725800 20 Filter name: none 2024-09-14T11:15:56.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.341+0000 7f0e5bfff640 20 reqs_thread_entry: start 2024-09-14T11:15:56.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.341+0000 7f1039725800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:15:56.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.341+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.341+0000 7f1039725800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:15:56.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.341+0000 7f1039725800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:15:56.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.341+0000 7f1039725800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:15:56.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.341+0000 7f1039725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : miss 2024-09-14T11:15:56.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.341+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.342+0000 7f1039725800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:15:56.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.342+0000 7f1039725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:15:56.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.342+0000 7f1039725800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:15:56.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.342+0000 7f1039725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:56.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.342+0000 7f1039725800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:56.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.342+0000 7f1039725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:15:56.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.343+0000 7f1039725800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:15:56.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.351+0000 7f1039725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:15:56.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.351+0000 7f1039725800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:15:56.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.351+0000 7f1039725800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:56.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.351+0000 7f1039725800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18, ofs0, ns] 2024-09-14T11:15:56.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.351+0000 7f0f18ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497135 cookie 94152841851104 notifier 7865 bl.length()=911 2024-09-14T11:15:56.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.351+0000 7f0f18ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:15:56.349 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.351+0000 7f0f18ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:15:56.350 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.351+0000 7f0f18ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:56.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.353+0000 7f1039725800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_sources= new_sources= 2024-09-14T11:15:56.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.353+0000 7f1039725800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential sources added=[] removed=[] 2024-09-14T11:15:56.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.353+0000 7f1039725800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_dests= new_dests= 2024-09-14T11:15:56.351 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.353+0000 7f1039725800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential dests added=[] removed=[] 2024-09-14T11:15:56.356 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1039725800 time 2024-09-14T11:15:56.358614+0000 2024-09-14T11:15:56.356 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:15:56.356 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:56.356 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f103ad8c76a] 2024-09-14T11:15:56.357 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f103ad8c928] 2024-09-14T11:15:56.357 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a1a85830b1] 2024-09-14T11:15:56.357 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a1a8592f6a] 2024-09-14T11:15:56.357 INFO:tasks.workunit.client.0.smithi050.stderr: 5: main() 2024-09-14T11:15:56.357 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f1039a29590] 2024-09-14T11:15:56.357 INFO:tasks.workunit.client.0.smithi050.stderr: 7: __libc_start_main() 2024-09-14T11:15:56.357 INFO:tasks.workunit.client.0.smithi050.stderr: 8: _start() 2024-09-14T11:15:56.357 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.358+0000 7f1039725800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1039725800 time 2024-09-14T11:15:56.358614+0000 2024-09-14T11:15:56.357 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:15:56.357 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.357 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:56.357 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f103ad8c76a] 2024-09-14T11:15:56.358 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f103ad8c928] 2024-09-14T11:15:56.358 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a1a85830b1] 2024-09-14T11:15:56.358 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a1a8592f6a] 2024-09-14T11:15:56.358 INFO:tasks.workunit.client.0.smithi050.stderr: 5: main() 2024-09-14T11:15:56.358 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f1039a29590] 2024-09-14T11:15:56.358 INFO:tasks.workunit.client.0.smithi050.stderr: 7: __libc_start_main() 2024-09-14T11:15:56.358 INFO:tasks.workunit.client.0.smithi050.stderr: 8: _start() 2024-09-14T11:15:56.358 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.358 INFO:tasks.workunit.client.0.smithi050.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:15:56.358 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f1039725800 thread_name:radosgw-admin 2024-09-14T11:15:56.379 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:56.379 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1039a3e6f0] 2024-09-14T11:15:56.379 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1039a8b99c] 2024-09-14T11:15:56.379 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:15:56.379 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:15:56.379 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f103ad8c7c4] 2024-09-14T11:15:56.379 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f103ad8c928] 2024-09-14T11:15:56.379 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a1a85830b1] 2024-09-14T11:15:56.379 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a1a8592f6a] 2024-09-14T11:15:56.379 INFO:tasks.workunit.client.0.smithi050.stderr: 9: main() 2024-09-14T11:15:56.380 INFO:tasks.workunit.client.0.smithi050.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f1039a29590] 2024-09-14T11:15:56.380 INFO:tasks.workunit.client.0.smithi050.stderr: 11: __libc_start_main() 2024-09-14T11:15:56.380 INFO:tasks.workunit.client.0.smithi050.stderr: 12: _start() 2024-09-14T11:15:56.380 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.359+0000 7f1039725800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:15:56.380 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f1039725800 thread_name:radosgw-admin 2024-09-14T11:15:56.380 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.380 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:56.380 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1039a3e6f0] 2024-09-14T11:15:56.380 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1039a8b99c] 2024-09-14T11:15:56.380 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:15:56.380 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:15:56.380 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f103ad8c7c4] 2024-09-14T11:15:56.380 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f103ad8c928] 2024-09-14T11:15:56.381 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a1a85830b1] 2024-09-14T11:15:56.381 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a1a8592f6a] 2024-09-14T11:15:56.381 INFO:tasks.workunit.client.0.smithi050.stderr: 9: main() 2024-09-14T11:15:56.381 INFO:tasks.workunit.client.0.smithi050.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f1039a29590] 2024-09-14T11:15:56.381 INFO:tasks.workunit.client.0.smithi050.stderr: 11: __libc_start_main() 2024-09-14T11:15:56.381 INFO:tasks.workunit.client.0.smithi050.stderr: 12: _start() 2024-09-14T11:15:56.381 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:15:56.381 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.381 INFO:tasks.workunit.client.0.smithi050.stderr:--- begin dump of recent events --- 2024-09-14T11:15:56.381 INFO:tasks.workunit.client.0.smithi050.stderr: -499> 2024-09-14T11:15:56.090+0000 7f0f23606640 10 monclient: dump: 2024-09-14T11:15:56.381 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:56.381 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:56.381 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.381 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.382 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:56.382 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.382 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:56.382 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:56.382 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:56.382 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.382 INFO:tasks.workunit.client.0.smithi050.stderr: -498> 2024-09-14T11:15:56.091+0000 7f1039725800 10 monclient: shutdown 2024-09-14T11:15:56.382 INFO:tasks.workunit.client.0.smithi050.stderr: -497> 2024-09-14T11:15:56.091+0000 7f1039725800 5 asok(0x55a1aa7f8270) unregister_commands rotate-key 2024-09-14T11:15:56.382 INFO:tasks.workunit.client.0.smithi050.stderr: -496> 2024-09-14T11:15:56.091+0000 7f1039725800 10 monclient: build_initial_monmap 2024-09-14T11:15:56.382 INFO:tasks.workunit.client.0.smithi050.stderr: -495> 2024-09-14T11:15:56.091+0000 7f1039725800 1 build_initial for_mkfs: 0 2024-09-14T11:15:56.382 INFO:tasks.workunit.client.0.smithi050.stderr: -494> 2024-09-14T11:15:56.091+0000 7f1039725800 10 monclient: monmap: 2024-09-14T11:15:56.382 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:15:56.382 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:56.382 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:15:56.383 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:15:56.383 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:56.383 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.383 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:15:56.383 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:15:56.383 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:15:56.383 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.383 INFO:tasks.workunit.client.0.smithi050.stderr: -493> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding auth protocol: cephx 2024-09-14T11:15:56.383 INFO:tasks.workunit.client.0.smithi050.stderr: -492> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding auth protocol: cephx 2024-09-14T11:15:56.383 INFO:tasks.workunit.client.0.smithi050.stderr: -491> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding auth protocol: cephx 2024-09-14T11:15:56.383 INFO:tasks.workunit.client.0.smithi050.stderr: -490> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding con mode: secure 2024-09-14T11:15:56.383 INFO:tasks.workunit.client.0.smithi050.stderr: -489> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding con mode: crc 2024-09-14T11:15:56.383 INFO:tasks.workunit.client.0.smithi050.stderr: -488> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding con mode: secure 2024-09-14T11:15:56.384 INFO:tasks.workunit.client.0.smithi050.stderr: -487> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding con mode: crc 2024-09-14T11:15:56.384 INFO:tasks.workunit.client.0.smithi050.stderr: -486> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding con mode: secure 2024-09-14T11:15:56.384 INFO:tasks.workunit.client.0.smithi050.stderr: -485> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding con mode: crc 2024-09-14T11:15:56.384 INFO:tasks.workunit.client.0.smithi050.stderr: -484> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding con mode: crc 2024-09-14T11:15:56.384 INFO:tasks.workunit.client.0.smithi050.stderr: -483> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding con mode: secure 2024-09-14T11:15:56.384 INFO:tasks.workunit.client.0.smithi050.stderr: -482> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding con mode: crc 2024-09-14T11:15:56.384 INFO:tasks.workunit.client.0.smithi050.stderr: -481> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding con mode: secure 2024-09-14T11:15:56.384 INFO:tasks.workunit.client.0.smithi050.stderr: -480> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding con mode: crc 2024-09-14T11:15:56.384 INFO:tasks.workunit.client.0.smithi050.stderr: -479> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding con mode: secure 2024-09-14T11:15:56.384 INFO:tasks.workunit.client.0.smithi050.stderr: -478> 2024-09-14T11:15:56.091+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.384 INFO:tasks.workunit.client.0.smithi050.stderr: -477> 2024-09-14T11:15:56.091+0000 7f1039725800 1 librados: starting msgr at 2024-09-14T11:15:56.384 INFO:tasks.workunit.client.0.smithi050.stderr: -476> 2024-09-14T11:15:56.091+0000 7f1039725800 1 librados: starting objecter 2024-09-14T11:15:56.384 INFO:tasks.workunit.client.0.smithi050.stderr: -475> 2024-09-14T11:15:56.091+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command objecter_requests hook 0x55a1aaa45af0 2024-09-14T11:15:56.385 INFO:tasks.workunit.client.0.smithi050.stderr: -474> 2024-09-14T11:15:56.091+0000 7f1039725800 1 librados: setting wanted keys 2024-09-14T11:15:56.385 INFO:tasks.workunit.client.0.smithi050.stderr: -473> 2024-09-14T11:15:56.091+0000 7f1039725800 1 librados: calling monclient init 2024-09-14T11:15:56.385 INFO:tasks.workunit.client.0.smithi050.stderr: -472> 2024-09-14T11:15:56.091+0000 7f1039725800 10 monclient: init 2024-09-14T11:15:56.385 INFO:tasks.workunit.client.0.smithi050.stderr: -471> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding auth protocol: cephx 2024-09-14T11:15:56.385 INFO:tasks.workunit.client.0.smithi050.stderr: -470> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding auth protocol: cephx 2024-09-14T11:15:56.385 INFO:tasks.workunit.client.0.smithi050.stderr: -469> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding auth protocol: cephx 2024-09-14T11:15:56.385 INFO:tasks.workunit.client.0.smithi050.stderr: -468> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding con mode: secure 2024-09-14T11:15:56.385 INFO:tasks.workunit.client.0.smithi050.stderr: -467> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding con mode: crc 2024-09-14T11:15:56.385 INFO:tasks.workunit.client.0.smithi050.stderr: -466> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding con mode: secure 2024-09-14T11:15:56.385 INFO:tasks.workunit.client.0.smithi050.stderr: -465> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding con mode: crc 2024-09-14T11:15:56.385 INFO:tasks.workunit.client.0.smithi050.stderr: -464> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding con mode: secure 2024-09-14T11:15:56.385 INFO:tasks.workunit.client.0.smithi050.stderr: -463> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding con mode: crc 2024-09-14T11:15:56.385 INFO:tasks.workunit.client.0.smithi050.stderr: -462> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding con mode: crc 2024-09-14T11:15:56.385 INFO:tasks.workunit.client.0.smithi050.stderr: -461> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding con mode: secure 2024-09-14T11:15:56.385 INFO:tasks.workunit.client.0.smithi050.stderr: -460> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding con mode: crc 2024-09-14T11:15:56.386 INFO:tasks.workunit.client.0.smithi050.stderr: -459> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding con mode: secure 2024-09-14T11:15:56.386 INFO:tasks.workunit.client.0.smithi050.stderr: -458> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding con mode: crc 2024-09-14T11:15:56.386 INFO:tasks.workunit.client.0.smithi050.stderr: -457> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding con mode: secure 2024-09-14T11:15:56.386 INFO:tasks.workunit.client.0.smithi050.stderr: -456> 2024-09-14T11:15:56.091+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.386 INFO:tasks.workunit.client.0.smithi050.stderr: -455> 2024-09-14T11:15:56.092+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.386 INFO:tasks.workunit.client.0.smithi050.stderr: -454> 2024-09-14T11:15:56.092+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command rotate-key hook 0x55a1aaa1ac68 2024-09-14T11:15:56.386 INFO:tasks.workunit.client.0.smithi050.stderr: -453> 2024-09-14T11:15:56.092+0000 7f1039725800 10 monclient: _reopen_session rank -1 2024-09-14T11:15:56.386 INFO:tasks.workunit.client.0.smithi050.stderr: -452> 2024-09-14T11:15:56.092+0000 7f1039725800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:15:56.386 INFO:tasks.workunit.client.0.smithi050.stderr: -451> 2024-09-14T11:15:56.092+0000 7f1039725800 10 monclient(hunting): picked mon.noname-c con 0x55a1aa8c82d0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:15:56.386 INFO:tasks.workunit.client.0.smithi050.stderr: -450> 2024-09-14T11:15:56.092+0000 7f1039725800 10 monclient(hunting): picked mon.noname-a con 0x55a1aa95e1e0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:15:56.386 INFO:tasks.workunit.client.0.smithi050.stderr: -449> 2024-09-14T11:15:56.092+0000 7f1039725800 10 monclient(hunting): picked mon.noname-b con 0x55a1aa964030 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:15:56.386 INFO:tasks.workunit.client.0.smithi050.stderr: -448> 2024-09-14T11:15:56.092+0000 7f1039725800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:56.387 INFO:tasks.workunit.client.0.smithi050.stderr: -447> 2024-09-14T11:15:56.092+0000 7f1039725800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:56.387 INFO:tasks.workunit.client.0.smithi050.stderr: -446> 2024-09-14T11:15:56.092+0000 7f1039725800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:56.387 INFO:tasks.workunit.client.0.smithi050.stderr: -445> 2024-09-14T11:15:56.092+0000 7f1039725800 10 monclient(hunting): _renew_subs 2024-09-14T11:15:56.387 INFO:tasks.workunit.client.0.smithi050.stderr: -444> 2024-09-14T11:15:56.092+0000 7f1039725800 10 monclient(hunting): authenticate will time out at 2608.729333s 2024-09-14T11:15:56.387 INFO:tasks.workunit.client.0.smithi050.stderr: -443> 2024-09-14T11:15:56.092+0000 7f1034bad640 10 monclient(hunting): get_auth_request con 0x55a1aa95e1e0 auth_method 0 2024-09-14T11:15:56.387 INFO:tasks.workunit.client.0.smithi050.stderr: -442> 2024-09-14T11:15:56.092+0000 7f1034bad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:56.387 INFO:tasks.workunit.client.0.smithi050.stderr: -441> 2024-09-14T11:15:56.092+0000 7f1034bad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:56.387 INFO:tasks.workunit.client.0.smithi050.stderr: -440> 2024-09-14T11:15:56.092+0000 7f1034bad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:56.387 INFO:tasks.workunit.client.0.smithi050.stderr: -439> 2024-09-14T11:15:56.092+0000 7f10353ae640 10 monclient(hunting): get_auth_request con 0x55a1aa8c82d0 auth_method 0 2024-09-14T11:15:56.387 INFO:tasks.workunit.client.0.smithi050.stderr: -438> 2024-09-14T11:15:56.092+0000 7f10353ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:56.387 INFO:tasks.workunit.client.0.smithi050.stderr: -437> 2024-09-14T11:15:56.092+0000 7f10353ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:56.387 INFO:tasks.workunit.client.0.smithi050.stderr: -436> 2024-09-14T11:15:56.092+0000 7f10353ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:56.387 INFO:tasks.workunit.client.0.smithi050.stderr: -435> 2024-09-14T11:15:56.092+0000 7f1034bad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:56.388 INFO:tasks.workunit.client.0.smithi050.stderr: -434> 2024-09-14T11:15:56.092+0000 7f1034bad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:56.388 INFO:tasks.workunit.client.0.smithi050.stderr: -433> 2024-09-14T11:15:56.092+0000 7f1034bad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:56.388 INFO:tasks.workunit.client.0.smithi050.stderr: -432> 2024-09-14T11:15:56.092+0000 7f10353ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:56.388 INFO:tasks.workunit.client.0.smithi050.stderr: -431> 2024-09-14T11:15:56.092+0000 7f10353ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:56.388 INFO:tasks.workunit.client.0.smithi050.stderr: -430> 2024-09-14T11:15:56.092+0000 7f10353ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:56.388 INFO:tasks.workunit.client.0.smithi050.stderr: -429> 2024-09-14T11:15:56.092+0000 7f1034bad640 10 monclient(hunting): handle_auth_done global_id 8430 payload 824 2024-09-14T11:15:56.388 INFO:tasks.workunit.client.0.smithi050.stderr: -428> 2024-09-14T11:15:56.092+0000 7f1034bad640 10 monclient: _finish_hunting 0 2024-09-14T11:15:56.388 INFO:tasks.workunit.client.0.smithi050.stderr: -427> 2024-09-14T11:15:56.092+0000 7f1034bad640 1 monclient: found mon.noname-a 2024-09-14T11:15:56.388 INFO:tasks.workunit.client.0.smithi050.stderr: -426> 2024-09-14T11:15:56.092+0000 7f1034bad640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:15:56.388 INFO:tasks.workunit.client.0.smithi050.stderr: -425> 2024-09-14T11:15:56.092+0000 7f1035baf640 10 monclient: get_auth_request con 0x55a1aa964030 auth_method 0 2024-09-14T11:15:56.388 INFO:tasks.workunit.client.0.smithi050.stderr: -424> 2024-09-14T11:15:56.093+0000 7f0f21e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:56.388 INFO:tasks.workunit.client.0.smithi050.stderr: -423> 2024-09-14T11:15:56.093+0000 7f0f21e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:56.388 INFO:tasks.workunit.client.0.smithi050.stderr: -422> 2024-09-14T11:15:56.093+0000 7f0f21e03640 10 monclient: dump: 2024-09-14T11:15:56.389 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:56.389 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:56.389 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.389 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.389 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:56.389 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.389 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:56.389 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:56.389 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:56.389 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.389 INFO:tasks.workunit.client.0.smithi050.stderr: -421> 2024-09-14T11:15:56.093+0000 7f0f21e03640 10 monclient: _finish_auth 0 2024-09-14T11:15:56.389 INFO:tasks.workunit.client.0.smithi050.stderr: -420> 2024-09-14T11:15:56.093+0000 7f0f21e03640 10 monclient: _check_auth_tickets 2024-09-14T11:15:56.389 INFO:tasks.workunit.client.0.smithi050.stderr: -419> 2024-09-14T11:15:56.093+0000 7f0f21e03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:56.389 INFO:tasks.workunit.client.0.smithi050.stderr: -418> 2024-09-14T11:15:56.093+0000 7f0f21e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:56.390 INFO:tasks.workunit.client.0.smithi050.stderr: -417> 2024-09-14T11:15:56.093+0000 7f0f21e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:56.390 INFO:tasks.workunit.client.0.smithi050.stderr: -416> 2024-09-14T11:15:56.093+0000 7f0f21e03640 10 monclient: dump: 2024-09-14T11:15:56.390 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:56.390 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:56.390 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.390 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.390 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:56.390 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.390 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:56.390 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:56.390 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:56.390 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.391 INFO:tasks.workunit.client.0.smithi050.stderr: -415> 2024-09-14T11:15:56.093+0000 7f1039725800 5 monclient: authenticate success, global_id 8430 2024-09-14T11:15:56.391 INFO:tasks.workunit.client.0.smithi050.stderr: -414> 2024-09-14T11:15:56.093+0000 7f1039725800 10 monclient: _renew_subs 2024-09-14T11:15:56.391 INFO:tasks.workunit.client.0.smithi050.stderr: -413> 2024-09-14T11:15:56.093+0000 7f1039725800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:15:56.391 INFO:tasks.workunit.client.0.smithi050.stderr: -412> 2024-09-14T11:15:56.093+0000 7f0f23606640 4 set_mon_vals no callback set 2024-09-14T11:15:56.391 INFO:tasks.workunit.client.0.smithi050.stderr: -411> 2024-09-14T11:15:56.093+0000 7f1039725800 10 monclient: _renew_subs 2024-09-14T11:15:56.391 INFO:tasks.workunit.client.0.smithi050.stderr: -410> 2024-09-14T11:15:56.093+0000 7f1039725800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:15:56.391 INFO:tasks.workunit.client.0.smithi050.stderr: -409> 2024-09-14T11:15:56.093+0000 7f1039725800 1 librados: init done 2024-09-14T11:15:56.391 INFO:tasks.workunit.client.0.smithi050.stderr: -408> 2024-09-14T11:15:56.095+0000 7f0f21e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:15:56.391 INFO:tasks.workunit.client.0.smithi050.stderr: -407> 2024-09-14T11:15:56.095+0000 7f0f21e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:15:56.391 INFO:tasks.workunit.client.0.smithi050.stderr: -406> 2024-09-14T11:15:56.095+0000 7f0f21e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:15:56.391 INFO:tasks.workunit.client.0.smithi050.stderr: -405> 2024-09-14T11:15:56.096+0000 7f10353ae640 10 monclient: get_auth_request con 0x7f0f1c077230 auth_method 0 2024-09-14T11:15:56.391 INFO:tasks.workunit.client.0.smithi050.stderr: -404> 2024-09-14T11:15:56.096+0000 7f1035baf640 10 monclient: get_auth_request con 0x55a1aaa63560 auth_method 0 2024-09-14T11:15:56.391 INFO:tasks.workunit.client.0.smithi050.stderr: -403> 2024-09-14T11:15:56.097+0000 7f10353ae640 10 monclient: get_auth_request con 0x55a1aaa66740 auth_method 0 2024-09-14T11:15:56.391 INFO:tasks.workunit.client.0.smithi050.stderr: -402> 2024-09-14T11:15:56.097+0000 7f1034bad640 10 monclient: get_auth_request con 0x55a1aaa6a930 auth_method 0 2024-09-14T11:15:56.392 INFO:tasks.workunit.client.0.smithi050.stderr: -401> 2024-09-14T11:15:56.099+0000 7f1039725800 10 monclient: build_initial_monmap 2024-09-14T11:15:56.392 INFO:tasks.workunit.client.0.smithi050.stderr: -400> 2024-09-14T11:15:56.099+0000 7f1039725800 1 build_initial for_mkfs: 0 2024-09-14T11:15:56.392 INFO:tasks.workunit.client.0.smithi050.stderr: -399> 2024-09-14T11:15:56.099+0000 7f1039725800 10 monclient: monmap: 2024-09-14T11:15:56.392 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:15:56.392 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:56.392 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:15:56.392 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:15:56.392 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:56.392 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.392 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:15:56.392 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:15:56.392 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:15:56.393 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.393 INFO:tasks.workunit.client.0.smithi050.stderr: -398> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding auth protocol: cephx 2024-09-14T11:15:56.393 INFO:tasks.workunit.client.0.smithi050.stderr: -397> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding auth protocol: cephx 2024-09-14T11:15:56.393 INFO:tasks.workunit.client.0.smithi050.stderr: -396> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding auth protocol: cephx 2024-09-14T11:15:56.393 INFO:tasks.workunit.client.0.smithi050.stderr: -395> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding con mode: secure 2024-09-14T11:15:56.393 INFO:tasks.workunit.client.0.smithi050.stderr: -394> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding con mode: crc 2024-09-14T11:15:56.393 INFO:tasks.workunit.client.0.smithi050.stderr: -393> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding con mode: secure 2024-09-14T11:15:56.393 INFO:tasks.workunit.client.0.smithi050.stderr: -392> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding con mode: crc 2024-09-14T11:15:56.393 INFO:tasks.workunit.client.0.smithi050.stderr: -391> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding con mode: secure 2024-09-14T11:15:56.393 INFO:tasks.workunit.client.0.smithi050.stderr: -390> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding con mode: crc 2024-09-14T11:15:56.393 INFO:tasks.workunit.client.0.smithi050.stderr: -389> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding con mode: crc 2024-09-14T11:15:56.393 INFO:tasks.workunit.client.0.smithi050.stderr: -388> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding con mode: secure 2024-09-14T11:15:56.393 INFO:tasks.workunit.client.0.smithi050.stderr: -387> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding con mode: crc 2024-09-14T11:15:56.394 INFO:tasks.workunit.client.0.smithi050.stderr: -386> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding con mode: secure 2024-09-14T11:15:56.394 INFO:tasks.workunit.client.0.smithi050.stderr: -385> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding con mode: crc 2024-09-14T11:15:56.394 INFO:tasks.workunit.client.0.smithi050.stderr: -384> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding con mode: secure 2024-09-14T11:15:56.394 INFO:tasks.workunit.client.0.smithi050.stderr: -383> 2024-09-14T11:15:56.099+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.394 INFO:tasks.workunit.client.0.smithi050.stderr: -382> 2024-09-14T11:15:56.099+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command objecter_requests cmddesc objecter_requests hook 0x55a1aaa72c10 EEXIST 2024-09-14T11:15:56.394 INFO:tasks.workunit.client.0.smithi050.stderr: -381> 2024-09-14T11:15:56.099+0000 7f1039725800 10 monclient: init 2024-09-14T11:15:56.394 INFO:tasks.workunit.client.0.smithi050.stderr: -380> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding auth protocol: cephx 2024-09-14T11:15:56.394 INFO:tasks.workunit.client.0.smithi050.stderr: -379> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding auth protocol: cephx 2024-09-14T11:15:56.394 INFO:tasks.workunit.client.0.smithi050.stderr: -378> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding auth protocol: cephx 2024-09-14T11:15:56.394 INFO:tasks.workunit.client.0.smithi050.stderr: -377> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding con mode: secure 2024-09-14T11:15:56.394 INFO:tasks.workunit.client.0.smithi050.stderr: -376> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding con mode: crc 2024-09-14T11:15:56.394 INFO:tasks.workunit.client.0.smithi050.stderr: -375> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding con mode: secure 2024-09-14T11:15:56.394 INFO:tasks.workunit.client.0.smithi050.stderr: -374> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding con mode: crc 2024-09-14T11:15:56.395 INFO:tasks.workunit.client.0.smithi050.stderr: -373> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding con mode: secure 2024-09-14T11:15:56.395 INFO:tasks.workunit.client.0.smithi050.stderr: -372> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding con mode: crc 2024-09-14T11:15:56.395 INFO:tasks.workunit.client.0.smithi050.stderr: -371> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding con mode: crc 2024-09-14T11:15:56.395 INFO:tasks.workunit.client.0.smithi050.stderr: -370> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding con mode: secure 2024-09-14T11:15:56.395 INFO:tasks.workunit.client.0.smithi050.stderr: -369> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding con mode: crc 2024-09-14T11:15:56.395 INFO:tasks.workunit.client.0.smithi050.stderr: -368> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding con mode: secure 2024-09-14T11:15:56.395 INFO:tasks.workunit.client.0.smithi050.stderr: -367> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding con mode: crc 2024-09-14T11:15:56.395 INFO:tasks.workunit.client.0.smithi050.stderr: -366> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding con mode: secure 2024-09-14T11:15:56.395 INFO:tasks.workunit.client.0.smithi050.stderr: -365> 2024-09-14T11:15:56.099+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.395 INFO:tasks.workunit.client.0.smithi050.stderr: -364> 2024-09-14T11:15:56.100+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.395 INFO:tasks.workunit.client.0.smithi050.stderr: -363> 2024-09-14T11:15:56.100+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command rotate-key cmddesc rotate-key hook 0x55a1aaa6de10 EEXIST 2024-09-14T11:15:56.395 INFO:tasks.workunit.client.0.smithi050.stderr: -362> 2024-09-14T11:15:56.100+0000 7f1039725800 10 monclient: _reopen_session rank -1 2024-09-14T11:15:56.395 INFO:tasks.workunit.client.0.smithi050.stderr: -361> 2024-09-14T11:15:56.100+0000 7f1039725800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:15:56.396 INFO:tasks.workunit.client.0.smithi050.stderr: -360> 2024-09-14T11:15:56.100+0000 7f1039725800 10 monclient(hunting): picked mon.noname-a con 0x55a1aaa96f30 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:15:56.396 INFO:tasks.workunit.client.0.smithi050.stderr: -359> 2024-09-14T11:15:56.100+0000 7f1039725800 10 monclient(hunting): picked mon.noname-b con 0x55a1aaa97310 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:15:56.396 INFO:tasks.workunit.client.0.smithi050.stderr: -358> 2024-09-14T11:15:56.100+0000 7f1039725800 10 monclient(hunting): picked mon.noname-c con 0x55a1aaa95c40 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:15:56.396 INFO:tasks.workunit.client.0.smithi050.stderr: -357> 2024-09-14T11:15:56.100+0000 7f1039725800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:56.396 INFO:tasks.workunit.client.0.smithi050.stderr: -356> 2024-09-14T11:15:56.100+0000 7f1039725800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:56.396 INFO:tasks.workunit.client.0.smithi050.stderr: -355> 2024-09-14T11:15:56.100+0000 7f1039725800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:56.396 INFO:tasks.workunit.client.0.smithi050.stderr: -354> 2024-09-14T11:15:56.100+0000 7f1039725800 10 monclient(hunting): _renew_subs 2024-09-14T11:15:56.396 INFO:tasks.workunit.client.0.smithi050.stderr: -353> 2024-09-14T11:15:56.100+0000 7f1039725800 10 monclient(hunting): authenticate will time out at 2608.737295s 2024-09-14T11:15:56.396 INFO:tasks.workunit.client.0.smithi050.stderr: -352> 2024-09-14T11:15:56.100+0000 7f10353ae640 10 monclient(hunting): get_auth_request con 0x55a1aaa96f30 auth_method 0 2024-09-14T11:15:56.396 INFO:tasks.workunit.client.0.smithi050.stderr: -351> 2024-09-14T11:15:56.100+0000 7f10353ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:56.396 INFO:tasks.workunit.client.0.smithi050.stderr: -350> 2024-09-14T11:15:56.100+0000 7f10353ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:56.396 INFO:tasks.workunit.client.0.smithi050.stderr: -349> 2024-09-14T11:15:56.100+0000 7f10353ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:56.396 INFO:tasks.workunit.client.0.smithi050.stderr: -348> 2024-09-14T11:15:56.100+0000 7f1035baf640 10 monclient(hunting): get_auth_request con 0x55a1aaa95c40 auth_method 0 2024-09-14T11:15:56.396 INFO:tasks.workunit.client.0.smithi050.stderr: -347> 2024-09-14T11:15:56.100+0000 7f1035baf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:56.397 INFO:tasks.workunit.client.0.smithi050.stderr: -346> 2024-09-14T11:15:56.100+0000 7f1035baf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:56.397 INFO:tasks.workunit.client.0.smithi050.stderr: -345> 2024-09-14T11:15:56.100+0000 7f1035baf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:56.397 INFO:tasks.workunit.client.0.smithi050.stderr: -344> 2024-09-14T11:15:56.100+0000 7f1034bad640 10 monclient(hunting): get_auth_request con 0x55a1aaa97310 auth_method 0 2024-09-14T11:15:56.397 INFO:tasks.workunit.client.0.smithi050.stderr: -343> 2024-09-14T11:15:56.100+0000 7f1034bad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:56.397 INFO:tasks.workunit.client.0.smithi050.stderr: -342> 2024-09-14T11:15:56.100+0000 7f1034bad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:56.397 INFO:tasks.workunit.client.0.smithi050.stderr: -341> 2024-09-14T11:15:56.100+0000 7f1034bad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:56.397 INFO:tasks.workunit.client.0.smithi050.stderr: -340> 2024-09-14T11:15:56.100+0000 7f10353ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:56.397 INFO:tasks.workunit.client.0.smithi050.stderr: -339> 2024-09-14T11:15:56.100+0000 7f10353ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:56.397 INFO:tasks.workunit.client.0.smithi050.stderr: -338> 2024-09-14T11:15:56.100+0000 7f10353ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:56.397 INFO:tasks.workunit.client.0.smithi050.stderr: -337> 2024-09-14T11:15:56.100+0000 7f1035baf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:56.397 INFO:tasks.workunit.client.0.smithi050.stderr: -336> 2024-09-14T11:15:56.100+0000 7f1035baf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:56.397 INFO:tasks.workunit.client.0.smithi050.stderr: -335> 2024-09-14T11:15:56.100+0000 7f1035baf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:56.397 INFO:tasks.workunit.client.0.smithi050.stderr: -334> 2024-09-14T11:15:56.100+0000 7f1034bad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:56.397 INFO:tasks.workunit.client.0.smithi050.stderr: -333> 2024-09-14T11:15:56.100+0000 7f1034bad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:56.398 INFO:tasks.workunit.client.0.smithi050.stderr: -332> 2024-09-14T11:15:56.100+0000 7f1034bad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:56.398 INFO:tasks.workunit.client.0.smithi050.stderr: -331> 2024-09-14T11:15:56.100+0000 7f10353ae640 10 monclient(hunting): handle_auth_done global_id 8433 payload 824 2024-09-14T11:15:56.398 INFO:tasks.workunit.client.0.smithi050.stderr: -330> 2024-09-14T11:15:56.100+0000 7f10353ae640 10 monclient: _finish_hunting 0 2024-09-14T11:15:56.398 INFO:tasks.workunit.client.0.smithi050.stderr: -329> 2024-09-14T11:15:56.100+0000 7f10353ae640 1 monclient: found mon.noname-a 2024-09-14T11:15:56.398 INFO:tasks.workunit.client.0.smithi050.stderr: -328> 2024-09-14T11:15:56.100+0000 7f10353ae640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:15:56.398 INFO:tasks.workunit.client.0.smithi050.stderr: -327> 2024-09-14T11:15:56.101+0000 7f0f1affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:56.398 INFO:tasks.workunit.client.0.smithi050.stderr: -326> 2024-09-14T11:15:56.101+0000 7f0f1affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:56.398 INFO:tasks.workunit.client.0.smithi050.stderr: -325> 2024-09-14T11:15:56.101+0000 7f0f1affd640 10 monclient: dump: 2024-09-14T11:15:56.398 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:56.398 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:56.398 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.398 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.398 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:56.398 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.399 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:56.399 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:56.399 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:56.399 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.399 INFO:tasks.workunit.client.0.smithi050.stderr: -324> 2024-09-14T11:15:56.101+0000 7f0f1affd640 10 monclient: _finish_auth 0 2024-09-14T11:15:56.399 INFO:tasks.workunit.client.0.smithi050.stderr: -323> 2024-09-14T11:15:56.101+0000 7f0f1affd640 10 monclient: _check_auth_tickets 2024-09-14T11:15:56.399 INFO:tasks.workunit.client.0.smithi050.stderr: -322> 2024-09-14T11:15:56.101+0000 7f0f1affd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:56.399 INFO:tasks.workunit.client.0.smithi050.stderr: -321> 2024-09-14T11:15:56.101+0000 7f0f1affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:56.399 INFO:tasks.workunit.client.0.smithi050.stderr: -320> 2024-09-14T11:15:56.101+0000 7f0f1affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:56.399 INFO:tasks.workunit.client.0.smithi050.stderr: -319> 2024-09-14T11:15:56.101+0000 7f0f1affd640 10 monclient: dump: 2024-09-14T11:15:56.399 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:56.399 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:56.399 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.399 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.400 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:56.400 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.400 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:56.400 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:56.400 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:56.400 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.400 INFO:tasks.workunit.client.0.smithi050.stderr: -318> 2024-09-14T11:15:56.101+0000 7f1039725800 5 monclient: authenticate success, global_id 8433 2024-09-14T11:15:56.400 INFO:tasks.workunit.client.0.smithi050.stderr: -317> 2024-09-14T11:15:56.101+0000 7f1039725800 10 monclient: _renew_subs 2024-09-14T11:15:56.400 INFO:tasks.workunit.client.0.smithi050.stderr: -316> 2024-09-14T11:15:56.101+0000 7f1039725800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:15:56.400 INFO:tasks.workunit.client.0.smithi050.stderr: -315> 2024-09-14T11:15:56.101+0000 7f10363b0640 4 set_mon_vals no callback set 2024-09-14T11:15:56.400 INFO:tasks.workunit.client.0.smithi050.stderr: -314> 2024-09-14T11:15:56.101+0000 7f1039725800 10 monclient: _renew_subs 2024-09-14T11:15:56.400 INFO:tasks.workunit.client.0.smithi050.stderr: -313> 2024-09-14T11:15:56.101+0000 7f1039725800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:15:56.400 INFO:tasks.workunit.client.0.smithi050.stderr: -312> 2024-09-14T11:15:56.103+0000 7f0f1affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:15:56.401 INFO:tasks.workunit.client.0.smithi050.stderr: -311> 2024-09-14T11:15:56.103+0000 7f0f1affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:15:56.401 INFO:tasks.workunit.client.0.smithi050.stderr: -310> 2024-09-14T11:15:56.103+0000 7f0f1affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:15:56.401 INFO:tasks.workunit.client.0.smithi050.stderr: -309> 2024-09-14T11:15:56.103+0000 7f1039725800 10 monclient: get_monmap_and_config 2024-09-14T11:15:56.401 INFO:tasks.workunit.client.0.smithi050.stderr: -308> 2024-09-14T11:15:56.103+0000 7f1039725800 10 monclient: build_initial_monmap 2024-09-14T11:15:56.401 INFO:tasks.workunit.client.0.smithi050.stderr: -307> 2024-09-14T11:15:56.103+0000 7f1039725800 1 build_initial for_mkfs: 0 2024-09-14T11:15:56.401 INFO:tasks.workunit.client.0.smithi050.stderr: -306> 2024-09-14T11:15:56.103+0000 7f1039725800 10 monclient: monmap: 2024-09-14T11:15:56.401 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:15:56.401 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:56.401 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:15:56.401 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:15:56.401 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:56.401 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.401 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:15:56.402 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:15:56.402 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:15:56.402 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.402 INFO:tasks.workunit.client.0.smithi050.stderr: -305> 2024-09-14T11:15:56.103+0000 7f1034bad640 10 monclient: get_auth_request con 0x7f0f10077140 auth_method 0 2024-09-14T11:15:56.402 INFO:tasks.workunit.client.0.smithi050.stderr: -304> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding auth protocol: cephx 2024-09-14T11:15:56.402 INFO:tasks.workunit.client.0.smithi050.stderr: -303> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding auth protocol: cephx 2024-09-14T11:15:56.402 INFO:tasks.workunit.client.0.smithi050.stderr: -302> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding auth protocol: cephx 2024-09-14T11:15:56.402 INFO:tasks.workunit.client.0.smithi050.stderr: -301> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding con mode: secure 2024-09-14T11:15:56.402 INFO:tasks.workunit.client.0.smithi050.stderr: -300> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding con mode: crc 2024-09-14T11:15:56.402 INFO:tasks.workunit.client.0.smithi050.stderr: -299> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding con mode: secure 2024-09-14T11:15:56.402 INFO:tasks.workunit.client.0.smithi050.stderr: -298> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding con mode: crc 2024-09-14T11:15:56.402 INFO:tasks.workunit.client.0.smithi050.stderr: -297> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding con mode: secure 2024-09-14T11:15:56.402 INFO:tasks.workunit.client.0.smithi050.stderr: -296> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding con mode: crc 2024-09-14T11:15:56.402 INFO:tasks.workunit.client.0.smithi050.stderr: -295> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding con mode: crc 2024-09-14T11:15:56.403 INFO:tasks.workunit.client.0.smithi050.stderr: -294> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding con mode: secure 2024-09-14T11:15:56.403 INFO:tasks.workunit.client.0.smithi050.stderr: -293> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding con mode: crc 2024-09-14T11:15:56.403 INFO:tasks.workunit.client.0.smithi050.stderr: -292> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding con mode: secure 2024-09-14T11:15:56.403 INFO:tasks.workunit.client.0.smithi050.stderr: -291> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding con mode: crc 2024-09-14T11:15:56.403 INFO:tasks.workunit.client.0.smithi050.stderr: -290> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding con mode: secure 2024-09-14T11:15:56.403 INFO:tasks.workunit.client.0.smithi050.stderr: -289> 2024-09-14T11:15:56.103+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.403 INFO:tasks.workunit.client.0.smithi050.stderr: -288> 2024-09-14T11:15:56.104+0000 7f1039725800 10 monclient: init 2024-09-14T11:15:56.403 INFO:tasks.workunit.client.0.smithi050.stderr: -287> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding auth protocol: cephx 2024-09-14T11:15:56.403 INFO:tasks.workunit.client.0.smithi050.stderr: -286> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding auth protocol: cephx 2024-09-14T11:15:56.403 INFO:tasks.workunit.client.0.smithi050.stderr: -285> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding auth protocol: cephx 2024-09-14T11:15:56.403 INFO:tasks.workunit.client.0.smithi050.stderr: -284> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding con mode: secure 2024-09-14T11:15:56.403 INFO:tasks.workunit.client.0.smithi050.stderr: -283> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding con mode: crc 2024-09-14T11:15:56.403 INFO:tasks.workunit.client.0.smithi050.stderr: -282> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding con mode: secure 2024-09-14T11:15:56.403 INFO:tasks.workunit.client.0.smithi050.stderr: -281> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding con mode: crc 2024-09-14T11:15:56.403 INFO:tasks.workunit.client.0.smithi050.stderr: -280> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding con mode: secure 2024-09-14T11:15:56.404 INFO:tasks.workunit.client.0.smithi050.stderr: -279> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding con mode: crc 2024-09-14T11:15:56.404 INFO:tasks.workunit.client.0.smithi050.stderr: -278> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding con mode: crc 2024-09-14T11:15:56.404 INFO:tasks.workunit.client.0.smithi050.stderr: -277> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding con mode: secure 2024-09-14T11:15:56.404 INFO:tasks.workunit.client.0.smithi050.stderr: -276> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding con mode: crc 2024-09-14T11:15:56.404 INFO:tasks.workunit.client.0.smithi050.stderr: -275> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding con mode: secure 2024-09-14T11:15:56.404 INFO:tasks.workunit.client.0.smithi050.stderr: -274> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding con mode: crc 2024-09-14T11:15:56.404 INFO:tasks.workunit.client.0.smithi050.stderr: -273> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding con mode: secure 2024-09-14T11:15:56.404 INFO:tasks.workunit.client.0.smithi050.stderr: -272> 2024-09-14T11:15:56.104+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.404 INFO:tasks.workunit.client.0.smithi050.stderr: -271> 2024-09-14T11:15:56.104+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.404 INFO:tasks.workunit.client.0.smithi050.stderr: -270> 2024-09-14T11:15:56.104+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command rotate-key cmddesc rotate-key hook 0x7ffe7d351598 EEXIST 2024-09-14T11:15:56.404 INFO:tasks.workunit.client.0.smithi050.stderr: -269> 2024-09-14T11:15:56.104+0000 7f1039725800 10 monclient: _reopen_session rank -1 2024-09-14T11:15:56.404 INFO:tasks.workunit.client.0.smithi050.stderr: -268> 2024-09-14T11:15:56.104+0000 7f1039725800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:15:56.404 INFO:tasks.workunit.client.0.smithi050.stderr: -267> 2024-09-14T11:15:56.104+0000 7f1039725800 10 monclient(hunting): picked mon.noname-b con 0x55a1aaaeb2a0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:15:56.405 INFO:tasks.workunit.client.0.smithi050.stderr: -266> 2024-09-14T11:15:56.104+0000 7f1039725800 10 monclient(hunting): picked mon.noname-c con 0x55a1aaabc2b0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:15:56.405 INFO:tasks.workunit.client.0.smithi050.stderr: -265> 2024-09-14T11:15:56.104+0000 7f1039725800 10 monclient(hunting): picked mon.noname-a con 0x55a1aaae6780 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:15:56.405 INFO:tasks.workunit.client.0.smithi050.stderr: -264> 2024-09-14T11:15:56.104+0000 7f1039725800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:56.405 INFO:tasks.workunit.client.0.smithi050.stderr: -263> 2024-09-14T11:15:56.104+0000 7f1039725800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:56.405 INFO:tasks.workunit.client.0.smithi050.stderr: -262> 2024-09-14T11:15:56.104+0000 7f1039725800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:56.405 INFO:tasks.workunit.client.0.smithi050.stderr: -261> 2024-09-14T11:15:56.104+0000 7f1039725800 10 monclient(hunting): _renew_subs 2024-09-14T11:15:56.405 INFO:tasks.workunit.client.0.smithi050.stderr: -260> 2024-09-14T11:15:56.104+0000 7f1039725800 10 monclient(hunting): authenticate will time out at 2608.741695s 2024-09-14T11:15:56.405 INFO:tasks.workunit.client.0.smithi050.stderr: -259> 2024-09-14T11:15:56.104+0000 7f1035baf640 10 monclient(hunting): get_auth_request con 0x55a1aaae6780 auth_method 0 2024-09-14T11:15:56.405 INFO:tasks.workunit.client.0.smithi050.stderr: -258> 2024-09-14T11:15:56.104+0000 7f1035baf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:56.405 INFO:tasks.workunit.client.0.smithi050.stderr: -257> 2024-09-14T11:15:56.104+0000 7f1035baf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:56.405 INFO:tasks.workunit.client.0.smithi050.stderr: -256> 2024-09-14T11:15:56.104+0000 7f1035baf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:56.405 INFO:tasks.workunit.client.0.smithi050.stderr: -255> 2024-09-14T11:15:56.104+0000 7f1034bad640 10 monclient(hunting): get_auth_request con 0x55a1aaabc2b0 auth_method 0 2024-09-14T11:15:56.405 INFO:tasks.workunit.client.0.smithi050.stderr: -254> 2024-09-14T11:15:56.104+0000 7f1034bad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:56.405 INFO:tasks.workunit.client.0.smithi050.stderr: -253> 2024-09-14T11:15:56.104+0000 7f1034bad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:56.406 INFO:tasks.workunit.client.0.smithi050.stderr: -252> 2024-09-14T11:15:56.104+0000 7f1034bad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:56.406 INFO:tasks.workunit.client.0.smithi050.stderr: -251> 2024-09-14T11:15:56.104+0000 7f10353ae640 10 monclient(hunting): get_auth_request con 0x55a1aaaeb2a0 auth_method 0 2024-09-14T11:15:56.406 INFO:tasks.workunit.client.0.smithi050.stderr: -250> 2024-09-14T11:15:56.104+0000 7f10353ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:56.406 INFO:tasks.workunit.client.0.smithi050.stderr: -249> 2024-09-14T11:15:56.104+0000 7f10353ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:56.406 INFO:tasks.workunit.client.0.smithi050.stderr: -248> 2024-09-14T11:15:56.104+0000 7f10353ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:56.406 INFO:tasks.workunit.client.0.smithi050.stderr: -247> 2024-09-14T11:15:56.104+0000 7f1035baf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:56.406 INFO:tasks.workunit.client.0.smithi050.stderr: -246> 2024-09-14T11:15:56.104+0000 7f1035baf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:56.406 INFO:tasks.workunit.client.0.smithi050.stderr: -245> 2024-09-14T11:15:56.104+0000 7f1035baf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:56.406 INFO:tasks.workunit.client.0.smithi050.stderr: -244> 2024-09-14T11:15:56.104+0000 7f1034bad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:56.406 INFO:tasks.workunit.client.0.smithi050.stderr: -243> 2024-09-14T11:15:56.104+0000 7f1034bad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:56.406 INFO:tasks.workunit.client.0.smithi050.stderr: -242> 2024-09-14T11:15:56.104+0000 7f1034bad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:56.406 INFO:tasks.workunit.client.0.smithi050.stderr: -241> 2024-09-14T11:15:56.104+0000 7f10353ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:56.406 INFO:tasks.workunit.client.0.smithi050.stderr: -240> 2024-09-14T11:15:56.104+0000 7f10353ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:56.406 INFO:tasks.workunit.client.0.smithi050.stderr: -239> 2024-09-14T11:15:56.104+0000 7f10353ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:56.407 INFO:tasks.workunit.client.0.smithi050.stderr: -238> 2024-09-14T11:15:56.105+0000 7f1035baf640 10 monclient(hunting): handle_auth_done global_id 8436 payload 274 2024-09-14T11:15:56.407 INFO:tasks.workunit.client.0.smithi050.stderr: -237> 2024-09-14T11:15:56.105+0000 7f1035baf640 10 monclient: _finish_hunting 0 2024-09-14T11:15:56.407 INFO:tasks.workunit.client.0.smithi050.stderr: -236> 2024-09-14T11:15:56.105+0000 7f1035baf640 1 monclient: found mon.noname-a 2024-09-14T11:15:56.407 INFO:tasks.workunit.client.0.smithi050.stderr: -235> 2024-09-14T11:15:56.105+0000 7f1035baf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:15:56.407 INFO:tasks.workunit.client.0.smithi050.stderr: -234> 2024-09-14T11:15:56.105+0000 7f0f18ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:56.407 INFO:tasks.workunit.client.0.smithi050.stderr: -233> 2024-09-14T11:15:56.105+0000 7f0f18ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:56.407 INFO:tasks.workunit.client.0.smithi050.stderr: -232> 2024-09-14T11:15:56.105+0000 7f0f18ff9640 10 monclient: dump: 2024-09-14T11:15:56.407 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:56.407 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:56.407 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.407 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.407 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:56.407 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.407 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:56.408 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:56.408 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:56.408 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.408 INFO:tasks.workunit.client.0.smithi050.stderr: -231> 2024-09-14T11:15:56.105+0000 7f0f18ff9640 10 monclient: _finish_auth 0 2024-09-14T11:15:56.408 INFO:tasks.workunit.client.0.smithi050.stderr: -230> 2024-09-14T11:15:56.105+0000 7f0f18ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:15:56.408 INFO:tasks.workunit.client.0.smithi050.stderr: -229> 2024-09-14T11:15:56.105+0000 7f0f18ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:56.408 INFO:tasks.workunit.client.0.smithi050.stderr: -228> 2024-09-14T11:15:56.105+0000 7f0f18ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:56.408 INFO:tasks.workunit.client.0.smithi050.stderr: -227> 2024-09-14T11:15:56.105+0000 7f0f18ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:56.408 INFO:tasks.workunit.client.0.smithi050.stderr: -226> 2024-09-14T11:15:56.105+0000 7f0f18ff9640 10 monclient: dump: 2024-09-14T11:15:56.408 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:56.408 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:56.408 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.408 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.408 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:56.409 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.409 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:56.409 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:56.409 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:56.409 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.409 INFO:tasks.workunit.client.0.smithi050.stderr: -225> 2024-09-14T11:15:56.105+0000 7f1039725800 5 monclient: authenticate success, global_id 8436 2024-09-14T11:15:56.409 INFO:tasks.workunit.client.0.smithi050.stderr: -224> 2024-09-14T11:15:56.105+0000 7f1039725800 10 monclient: get_monmap_and_config success 2024-09-14T11:15:56.409 INFO:tasks.workunit.client.0.smithi050.stderr: -223> 2024-09-14T11:15:56.105+0000 7f1039725800 4 set_mon_vals no callback set 2024-09-14T11:15:56.409 INFO:tasks.workunit.client.0.smithi050.stderr: -222> 2024-09-14T11:15:56.105+0000 7f1039725800 10 monclient: shutdown 2024-09-14T11:15:56.409 INFO:tasks.workunit.client.0.smithi050.stderr: -221> 2024-09-14T11:15:56.106+0000 7f1039725800 10 monclient: build_initial_monmap 2024-09-14T11:15:56.409 INFO:tasks.workunit.client.0.smithi050.stderr: -220> 2024-09-14T11:15:56.106+0000 7f1039725800 1 build_initial for_mkfs: 0 2024-09-14T11:15:56.409 INFO:tasks.workunit.client.0.smithi050.stderr: -219> 2024-09-14T11:15:56.106+0000 7f1039725800 10 monclient: monmap: 2024-09-14T11:15:56.409 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:15:56.409 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:56.410 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:15:56.410 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:15:56.410 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:56.410 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.410 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:15:56.410 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:15:56.410 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:15:56.410 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.410 INFO:tasks.workunit.client.0.smithi050.stderr: -218> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding auth protocol: cephx 2024-09-14T11:15:56.410 INFO:tasks.workunit.client.0.smithi050.stderr: -217> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding auth protocol: cephx 2024-09-14T11:15:56.410 INFO:tasks.workunit.client.0.smithi050.stderr: -216> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding auth protocol: cephx 2024-09-14T11:15:56.410 INFO:tasks.workunit.client.0.smithi050.stderr: -215> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding con mode: secure 2024-09-14T11:15:56.410 INFO:tasks.workunit.client.0.smithi050.stderr: -214> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding con mode: crc 2024-09-14T11:15:56.410 INFO:tasks.workunit.client.0.smithi050.stderr: -213> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding con mode: secure 2024-09-14T11:15:56.411 INFO:tasks.workunit.client.0.smithi050.stderr: -212> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding con mode: crc 2024-09-14T11:15:56.411 INFO:tasks.workunit.client.0.smithi050.stderr: -211> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding con mode: secure 2024-09-14T11:15:56.411 INFO:tasks.workunit.client.0.smithi050.stderr: -210> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding con mode: crc 2024-09-14T11:15:56.411 INFO:tasks.workunit.client.0.smithi050.stderr: -209> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding con mode: crc 2024-09-14T11:15:56.411 INFO:tasks.workunit.client.0.smithi050.stderr: -208> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding con mode: secure 2024-09-14T11:15:56.411 INFO:tasks.workunit.client.0.smithi050.stderr: -207> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding con mode: crc 2024-09-14T11:15:56.411 INFO:tasks.workunit.client.0.smithi050.stderr: -206> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding con mode: secure 2024-09-14T11:15:56.411 INFO:tasks.workunit.client.0.smithi050.stderr: -205> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding con mode: crc 2024-09-14T11:15:56.411 INFO:tasks.workunit.client.0.smithi050.stderr: -204> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding con mode: secure 2024-09-14T11:15:56.411 INFO:tasks.workunit.client.0.smithi050.stderr: -203> 2024-09-14T11:15:56.106+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.411 INFO:tasks.workunit.client.0.smithi050.stderr: -202> 2024-09-14T11:15:56.106+0000 7f1039725800 1 librados: starting msgr at 2024-09-14T11:15:56.411 INFO:tasks.workunit.client.0.smithi050.stderr: -201> 2024-09-14T11:15:56.106+0000 7f1039725800 1 librados: starting objecter 2024-09-14T11:15:56.411 INFO:tasks.workunit.client.0.smithi050.stderr: -200> 2024-09-14T11:15:56.106+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command objecter_requests cmddesc objecter_requests hook 0x55a1aaae6bc0 EEXIST 2024-09-14T11:15:56.411 INFO:tasks.workunit.client.0.smithi050.stderr: -199> 2024-09-14T11:15:56.106+0000 7f1039725800 1 librados: setting wanted keys 2024-09-14T11:15:56.411 INFO:tasks.workunit.client.0.smithi050.stderr: -198> 2024-09-14T11:15:56.106+0000 7f1039725800 1 librados: calling monclient init 2024-09-14T11:15:56.412 INFO:tasks.workunit.client.0.smithi050.stderr: -197> 2024-09-14T11:15:56.106+0000 7f1039725800 10 monclient: init 2024-09-14T11:15:56.412 INFO:tasks.workunit.client.0.smithi050.stderr: -196> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding auth protocol: cephx 2024-09-14T11:15:56.412 INFO:tasks.workunit.client.0.smithi050.stderr: -195> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding auth protocol: cephx 2024-09-14T11:15:56.412 INFO:tasks.workunit.client.0.smithi050.stderr: -194> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding auth protocol: cephx 2024-09-14T11:15:56.412 INFO:tasks.workunit.client.0.smithi050.stderr: -193> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding con mode: secure 2024-09-14T11:15:56.412 INFO:tasks.workunit.client.0.smithi050.stderr: -192> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding con mode: crc 2024-09-14T11:15:56.412 INFO:tasks.workunit.client.0.smithi050.stderr: -191> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding con mode: secure 2024-09-14T11:15:56.412 INFO:tasks.workunit.client.0.smithi050.stderr: -190> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding con mode: crc 2024-09-14T11:15:56.412 INFO:tasks.workunit.client.0.smithi050.stderr: -189> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding con mode: secure 2024-09-14T11:15:56.412 INFO:tasks.workunit.client.0.smithi050.stderr: -188> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding con mode: crc 2024-09-14T11:15:56.412 INFO:tasks.workunit.client.0.smithi050.stderr: -187> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding con mode: crc 2024-09-14T11:15:56.412 INFO:tasks.workunit.client.0.smithi050.stderr: -186> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding con mode: secure 2024-09-14T11:15:56.412 INFO:tasks.workunit.client.0.smithi050.stderr: -185> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding con mode: crc 2024-09-14T11:15:56.412 INFO:tasks.workunit.client.0.smithi050.stderr: -184> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding con mode: secure 2024-09-14T11:15:56.413 INFO:tasks.workunit.client.0.smithi050.stderr: -183> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding con mode: crc 2024-09-14T11:15:56.413 INFO:tasks.workunit.client.0.smithi050.stderr: -182> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding con mode: secure 2024-09-14T11:15:56.413 INFO:tasks.workunit.client.0.smithi050.stderr: -181> 2024-09-14T11:15:56.106+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.413 INFO:tasks.workunit.client.0.smithi050.stderr: -180> 2024-09-14T11:15:56.107+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.413 INFO:tasks.workunit.client.0.smithi050.stderr: -179> 2024-09-14T11:15:56.107+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command rotate-key cmddesc rotate-key hook 0x55a1aaaab938 EEXIST 2024-09-14T11:15:56.413 INFO:tasks.workunit.client.0.smithi050.stderr: -178> 2024-09-14T11:15:56.107+0000 7f1039725800 10 monclient: _reopen_session rank -1 2024-09-14T11:15:56.413 INFO:tasks.workunit.client.0.smithi050.stderr: -177> 2024-09-14T11:15:56.107+0000 7f1039725800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:15:56.413 INFO:tasks.workunit.client.0.smithi050.stderr: -176> 2024-09-14T11:15:56.107+0000 7f1039725800 10 monclient(hunting): picked mon.noname-a con 0x55a1aaabc2b0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:15:56.413 INFO:tasks.workunit.client.0.smithi050.stderr: -175> 2024-09-14T11:15:56.107+0000 7f1039725800 10 monclient(hunting): picked mon.noname-c con 0x55a1aaae6780 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:15:56.413 INFO:tasks.workunit.client.0.smithi050.stderr: -174> 2024-09-14T11:15:56.107+0000 7f1039725800 10 monclient(hunting): picked mon.noname-b con 0x55a1aaaeb2a0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:15:56.413 INFO:tasks.workunit.client.0.smithi050.stderr: -173> 2024-09-14T11:15:56.107+0000 7f1039725800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:56.413 INFO:tasks.workunit.client.0.smithi050.stderr: -172> 2024-09-14T11:15:56.107+0000 7f1039725800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:56.413 INFO:tasks.workunit.client.0.smithi050.stderr: -171> 2024-09-14T11:15:56.107+0000 7f1039725800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:56.413 INFO:tasks.workunit.client.0.smithi050.stderr: -170> 2024-09-14T11:15:56.107+0000 7f1039725800 10 monclient(hunting): _renew_subs 2024-09-14T11:15:56.414 INFO:tasks.workunit.client.0.smithi050.stderr: -169> 2024-09-14T11:15:56.107+0000 7f1039725800 10 monclient(hunting): authenticate will time out at 2608.744144s 2024-09-14T11:15:56.414 INFO:tasks.workunit.client.0.smithi050.stderr: -168> 2024-09-14T11:15:56.107+0000 7f10353ae640 10 monclient(hunting): get_auth_request con 0x55a1aaabc2b0 auth_method 0 2024-09-14T11:15:56.414 INFO:tasks.workunit.client.0.smithi050.stderr: -167> 2024-09-14T11:15:56.107+0000 7f10353ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:56.414 INFO:tasks.workunit.client.0.smithi050.stderr: -166> 2024-09-14T11:15:56.107+0000 7f10353ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:56.414 INFO:tasks.workunit.client.0.smithi050.stderr: -165> 2024-09-14T11:15:56.107+0000 7f10353ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:56.414 INFO:tasks.workunit.client.0.smithi050.stderr: -164> 2024-09-14T11:15:56.107+0000 7f1034bad640 10 monclient(hunting): get_auth_request con 0x55a1aaae6780 auth_method 0 2024-09-14T11:15:56.414 INFO:tasks.workunit.client.0.smithi050.stderr: -163> 2024-09-14T11:15:56.107+0000 7f1034bad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:56.414 INFO:tasks.workunit.client.0.smithi050.stderr: -162> 2024-09-14T11:15:56.107+0000 7f1034bad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:56.414 INFO:tasks.workunit.client.0.smithi050.stderr: -161> 2024-09-14T11:15:56.107+0000 7f1034bad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:56.414 INFO:tasks.workunit.client.0.smithi050.stderr: -160> 2024-09-14T11:15:56.107+0000 7f1034bad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:56.414 INFO:tasks.workunit.client.0.smithi050.stderr: -159> 2024-09-14T11:15:56.107+0000 7f1034bad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:56.414 INFO:tasks.workunit.client.0.smithi050.stderr: -158> 2024-09-14T11:15:56.107+0000 7f1034bad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:56.414 INFO:tasks.workunit.client.0.smithi050.stderr: -157> 2024-09-14T11:15:56.107+0000 7f1035baf640 10 monclient(hunting): get_auth_request con 0x55a1aaaeb2a0 auth_method 0 2024-09-14T11:15:56.415 INFO:tasks.workunit.client.0.smithi050.stderr: -156> 2024-09-14T11:15:56.107+0000 7f1035baf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:56.415 INFO:tasks.workunit.client.0.smithi050.stderr: -155> 2024-09-14T11:15:56.107+0000 7f1035baf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:56.415 INFO:tasks.workunit.client.0.smithi050.stderr: -154> 2024-09-14T11:15:56.107+0000 7f1035baf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:56.415 INFO:tasks.workunit.client.0.smithi050.stderr: -153> 2024-09-14T11:15:56.107+0000 7f10353ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:56.415 INFO:tasks.workunit.client.0.smithi050.stderr: -152> 2024-09-14T11:15:56.107+0000 7f10353ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:56.415 INFO:tasks.workunit.client.0.smithi050.stderr: -151> 2024-09-14T11:15:56.107+0000 7f10353ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:56.415 INFO:tasks.workunit.client.0.smithi050.stderr: -150> 2024-09-14T11:15:56.107+0000 7f1035baf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:56.415 INFO:tasks.workunit.client.0.smithi050.stderr: -149> 2024-09-14T11:15:56.107+0000 7f1035baf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:56.415 INFO:tasks.workunit.client.0.smithi050.stderr: -148> 2024-09-14T11:15:56.107+0000 7f1035baf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:56.415 INFO:tasks.workunit.client.0.smithi050.stderr: -147> 2024-09-14T11:15:56.107+0000 7f1034bad640 10 monclient(hunting): handle_auth_done global_id 7865 payload 824 2024-09-14T11:15:56.415 INFO:tasks.workunit.client.0.smithi050.stderr: -146> 2024-09-14T11:15:56.107+0000 7f1034bad640 10 monclient: _finish_hunting 0 2024-09-14T11:15:56.415 INFO:tasks.workunit.client.0.smithi050.stderr: -145> 2024-09-14T11:15:56.107+0000 7f1034bad640 1 monclient: found mon.noname-c 2024-09-14T11:15:56.415 INFO:tasks.workunit.client.0.smithi050.stderr: -144> 2024-09-14T11:15:56.107+0000 7f1034bad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:15:56.416 INFO:tasks.workunit.client.0.smithi050.stderr: -143> 2024-09-14T11:15:56.107+0000 7f0f06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:56.416 INFO:tasks.workunit.client.0.smithi050.stderr: -142> 2024-09-14T11:15:56.107+0000 7f0f06ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:15:56.416 INFO:tasks.workunit.client.0.smithi050.stderr: -141> 2024-09-14T11:15:56.107+0000 7f0f06ffd640 10 monclient: dump: 2024-09-14T11:15:56.416 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:56.416 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:56.416 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.416 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.416 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:56.416 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.416 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:56.416 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:56.416 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:56.416 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.417 INFO:tasks.workunit.client.0.smithi050.stderr: -140> 2024-09-14T11:15:56.107+0000 7f0f06ffd640 10 monclient: _finish_auth 0 2024-09-14T11:15:56.417 INFO:tasks.workunit.client.0.smithi050.stderr: -139> 2024-09-14T11:15:56.107+0000 7f0f06ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:15:56.417 INFO:tasks.workunit.client.0.smithi050.stderr: -138> 2024-09-14T11:15:56.107+0000 7f0f06ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:56.417 INFO:tasks.workunit.client.0.smithi050.stderr: -137> 2024-09-14T11:15:56.107+0000 7f0f06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:56.417 INFO:tasks.workunit.client.0.smithi050.stderr: -136> 2024-09-14T11:15:56.107+0000 7f0f06ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:15:56.417 INFO:tasks.workunit.client.0.smithi050.stderr: -135> 2024-09-14T11:15:56.107+0000 7f0f06ffd640 10 monclient: dump: 2024-09-14T11:15:56.417 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:56.417 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:56.417 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.417 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.417 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:56.417 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.417 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:56.417 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:56.418 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:56.418 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.418 INFO:tasks.workunit.client.0.smithi050.stderr: -134> 2024-09-14T11:15:56.107+0000 7f0f18ff9640 4 set_mon_vals no callback set 2024-09-14T11:15:56.418 INFO:tasks.workunit.client.0.smithi050.stderr: -133> 2024-09-14T11:15:56.108+0000 7f1039725800 5 monclient: authenticate success, global_id 7865 2024-09-14T11:15:56.418 INFO:tasks.workunit.client.0.smithi050.stderr: -132> 2024-09-14T11:15:56.108+0000 7f1039725800 10 monclient: _renew_subs 2024-09-14T11:15:56.418 INFO:tasks.workunit.client.0.smithi050.stderr: -131> 2024-09-14T11:15:56.108+0000 7f1039725800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:15:56.418 INFO:tasks.workunit.client.0.smithi050.stderr: -130> 2024-09-14T11:15:56.108+0000 7f1039725800 10 monclient: _renew_subs 2024-09-14T11:15:56.418 INFO:tasks.workunit.client.0.smithi050.stderr: -129> 2024-09-14T11:15:56.108+0000 7f1039725800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:15:56.418 INFO:tasks.workunit.client.0.smithi050.stderr: -128> 2024-09-14T11:15:56.108+0000 7f1039725800 1 librados: init done 2024-09-14T11:15:56.418 INFO:tasks.workunit.client.0.smithi050.stderr: -127> 2024-09-14T11:15:56.108+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command cr dump hook 0x55a1aaae4728 2024-09-14T11:15:56.418 INFO:tasks.workunit.client.0.smithi050.stderr: -126> 2024-09-14T11:15:56.109+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.418 INFO:tasks.workunit.client.0.smithi050.stderr: -125> 2024-09-14T11:15:56.110+0000 7f0f06ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:15:56.418 INFO:tasks.workunit.client.0.smithi050.stderr: -124> 2024-09-14T11:15:56.110+0000 7f0f06ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:15:56.418 INFO:tasks.workunit.client.0.smithi050.stderr: -123> 2024-09-14T11:15:56.110+0000 7f0f06ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:15:56.418 INFO:tasks.workunit.client.0.smithi050.stderr: -122> 2024-09-14T11:15:56.110+0000 7f10353ae640 10 monclient: get_auth_request con 0x7f0f00077230 auth_method 0 2024-09-14T11:15:56.419 INFO:tasks.workunit.client.0.smithi050.stderr: -121> 2024-09-14T11:15:56.111+0000 7f1035baf640 10 monclient: get_auth_request con 0x55a1aab05620 auth_method 0 2024-09-14T11:15:56.419 INFO:tasks.workunit.client.0.smithi050.stderr: -120> 2024-09-14T11:15:56.111+0000 7f1039725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.419 INFO:tasks.workunit.client.0.smithi050.stderr: -119> 2024-09-14T11:15:56.111+0000 7f1039725800 20 realm 2024-09-14T11:15:56.419 INFO:tasks.workunit.client.0.smithi050.stderr: -118> 2024-09-14T11:15:56.111+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.419 INFO:tasks.workunit.client.0.smithi050.stderr: -117> 2024-09-14T11:15:56.111+0000 7f1039725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.419 INFO:tasks.workunit.client.0.smithi050.stderr: -116> 2024-09-14T11:15:56.111+0000 7f1039725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:56.419 INFO:tasks.workunit.client.0.smithi050.stderr: -115> 2024-09-14T11:15:56.111+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.419 INFO:tasks.workunit.client.0.smithi050.stderr: -114> 2024-09-14T11:15:56.112+0000 7f1039725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.419 INFO:tasks.workunit.client.0.smithi050.stderr: -113> 2024-09-14T11:15:56.112+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.419 INFO:tasks.workunit.client.0.smithi050.stderr: -112> 2024-09-14T11:15:56.112+0000 7f10353ae640 10 monclient: get_auth_request con 0x55a1aab09830 auth_method 0 2024-09-14T11:15:56.419 INFO:tasks.workunit.client.0.smithi050.stderr: -111> 2024-09-14T11:15:56.112+0000 7f1039725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:56.419 INFO:tasks.workunit.client.0.smithi050.stderr: -110> 2024-09-14T11:15:56.112+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.419 INFO:tasks.workunit.client.0.smithi050.stderr: -109> 2024-09-14T11:15:56.113+0000 7f1034bad640 10 monclient: get_auth_request con 0x55a1aab0d0b0 auth_method 0 2024-09-14T11:15:56.419 INFO:tasks.workunit.client.0.smithi050.stderr: -108> 2024-09-14T11:15:56.113+0000 7f1039725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:56.419 INFO:tasks.workunit.client.0.smithi050.stderr: -107> 2024-09-14T11:15:56.113+0000 7f1039725800 20 searching for the correct realm 2024-09-14T11:15:56.420 INFO:tasks.workunit.client.0.smithi050.stderr: -106> 2024-09-14T11:15:56.114+0000 7f1035baf640 10 monclient: get_auth_request con 0x55a1aab11e70 auth_method 0 2024-09-14T11:15:56.420 INFO:tasks.workunit.client.0.smithi050.stderr: -105> 2024-09-14T11:15:56.114+0000 7f10353ae640 10 monclient: get_auth_request con 0x7f1030004040 auth_method 0 2024-09-14T11:15:56.420 INFO:tasks.workunit.client.0.smithi050.stderr: -104> 2024-09-14T11:15:56.116+0000 7f1034bad640 10 monclient: get_auth_request con 0x7f103002f040 auth_method 0 2024-09-14T11:15:56.420 INFO:tasks.workunit.client.0.smithi050.stderr: -103> 2024-09-14T11:15:56.116+0000 7f1034bad640 0 -- 172.21.15.50:0/1467493040 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f103002f040 msgr2=0x7f1030023910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:15:56.420 INFO:tasks.workunit.client.0.smithi050.stderr: -102> 2024-09-14T11:15:56.317+0000 7f1034bad640 10 monclient: get_auth_request con 0x7f103002f040 auth_method 0 2024-09-14T11:15:56.420 INFO:tasks.workunit.client.0.smithi050.stderr: -101> 2024-09-14T11:15:56.319+0000 7f1035baf640 10 monclient: get_auth_request con 0x7f10280acf80 auth_method 0 2024-09-14T11:15:56.420 INFO:tasks.workunit.client.0.smithi050.stderr: -100> 2024-09-14T11:15:56.320+0000 7f10353ae640 10 monclient: get_auth_request con 0x7f1030041920 auth_method 0 2024-09-14T11:15:56.420 INFO:tasks.workunit.client.0.smithi050.stderr: -99> 2024-09-14T11:15:56.321+0000 7f1035baf640 0 -- 172.21.15.50:0/1467493040 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55a1aab05620 msgr2=0x55a1aab07ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:56.420 INFO:tasks.workunit.client.0.smithi050.stderr: -98> 2024-09-14T11:15:56.321+0000 7f0f06ffd640 1 client.7865.objecter ms_handle_reset 0x55a1aab05620 session 0x55a1aab04f50 osd.6 2024-09-14T11:15:56.420 INFO:tasks.workunit.client.0.smithi050.stderr: -97> 2024-09-14T11:15:56.322+0000 7f0f06ffd640 10 monclient: _renew_subs 2024-09-14T11:15:56.420 INFO:tasks.workunit.client.0.smithi050.stderr: -96> 2024-09-14T11:15:56.322+0000 7f0f06ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:15:56.420 INFO:tasks.workunit.client.0.smithi050.stderr: -95> 2024-09-14T11:15:56.322+0000 7f1035baf640 10 monclient: get_auth_request con 0x7f0f000874e0 auth_method 0 2024-09-14T11:15:56.420 INFO:tasks.workunit.client.0.smithi050.stderr: -94> 2024-09-14T11:15:56.326+0000 7f1039725800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:15:56.421 INFO:tasks.workunit.client.0.smithi050.stderr: -93> 2024-09-14T11:15:56.326+0000 7f1039725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:56.421 INFO:tasks.workunit.client.0.smithi050.stderr: -92> 2024-09-14T11:15:56.326+0000 7f1039725800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:15:56.421 INFO:tasks.workunit.client.0.smithi050.stderr: -91> 2024-09-14T11:15:56.326+0000 7f1039725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:56.421 INFO:tasks.workunit.client.0.smithi050.stderr: -90> 2024-09-14T11:15:56.326+0000 7f1039725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:56.421 INFO:tasks.workunit.client.0.smithi050.stderr: -89> 2024-09-14T11:15:56.326+0000 7f1039725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:56.421 INFO:tasks.workunit.client.0.smithi050.stderr: -88> 2024-09-14T11:15:56.326+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.421 INFO:tasks.workunit.client.0.smithi050.stderr: -87> 2024-09-14T11:15:56.326+0000 7f1039725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.421 INFO:tasks.workunit.client.0.smithi050.stderr: -86> 2024-09-14T11:15:56.326+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.421 INFO:tasks.workunit.client.0.smithi050.stderr: -85> 2024-09-14T11:15:56.326+0000 7f1039725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:56.421 INFO:tasks.workunit.client.0.smithi050.stderr: -84> 2024-09-14T11:15:56.326+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.421 INFO:tasks.workunit.client.0.smithi050.stderr: -83> 2024-09-14T11:15:56.327+0000 7f1039725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:56.421 INFO:tasks.workunit.client.0.smithi050.stderr: -82> 2024-09-14T11:15:56.327+0000 7f1039725800 20 zone default found 2024-09-14T11:15:56.421 INFO:tasks.workunit.client.0.smithi050.stderr: -81> 2024-09-14T11:15:56.327+0000 7f1039725800 4 Realm: () 2024-09-14T11:15:56.421 INFO:tasks.workunit.client.0.smithi050.stderr: -80> 2024-09-14T11:15:56.327+0000 7f1039725800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:15:56.422 INFO:tasks.workunit.client.0.smithi050.stderr: -79> 2024-09-14T11:15:56.327+0000 7f1039725800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:15:56.422 INFO:tasks.workunit.client.0.smithi050.stderr: -78> 2024-09-14T11:15:56.327+0000 7f1039725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:56.422 INFO:tasks.workunit.client.0.smithi050.stderr: -77> 2024-09-14T11:15:56.327+0000 7f1039725800 20 zonegroup default 2024-09-14T11:15:56.422 INFO:tasks.workunit.client.0.smithi050.stderr: -76> 2024-09-14T11:15:56.327+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.422 INFO:tasks.workunit.client.0.smithi050.stderr: -75> 2024-09-14T11:15:56.327+0000 7f1039725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.422 INFO:tasks.workunit.client.0.smithi050.stderr: -74> 2024-09-14T11:15:56.327+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.422 INFO:tasks.workunit.client.0.smithi050.stderr: -73> 2024-09-14T11:15:56.327+0000 7f1039725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.422 INFO:tasks.workunit.client.0.smithi050.stderr: -72> 2024-09-14T11:15:56.327+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.422 INFO:tasks.workunit.client.0.smithi050.stderr: -71> 2024-09-14T11:15:56.328+0000 7f1039725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.422 INFO:tasks.workunit.client.0.smithi050.stderr: -70> 2024-09-14T11:15:56.328+0000 7f1039725800 20 started sync module instance, tier type = 2024-09-14T11:15:56.422 INFO:tasks.workunit.client.0.smithi050.stderr: -69> 2024-09-14T11:15:56.328+0000 7f1039725800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:15:56.422 INFO:tasks.workunit.client.0.smithi050.stderr: -68> 2024-09-14T11:15:56.337+0000 7f1039725800 20 add_watcher() i=0 2024-09-14T11:15:56.422 INFO:tasks.workunit.client.0.smithi050.stderr: -67> 2024-09-14T11:15:56.337+0000 7f1039725800 20 add_watcher() i=1 2024-09-14T11:15:56.423 INFO:tasks.workunit.client.0.smithi050.stderr: -66> 2024-09-14T11:15:56.337+0000 7f1039725800 20 add_watcher() i=2 2024-09-14T11:15:56.423 INFO:tasks.workunit.client.0.smithi050.stderr: -65> 2024-09-14T11:15:56.337+0000 7f1039725800 20 add_watcher() i=3 2024-09-14T11:15:56.423 INFO:tasks.workunit.client.0.smithi050.stderr: -64> 2024-09-14T11:15:56.337+0000 7f1039725800 20 add_watcher() i=4 2024-09-14T11:15:56.423 INFO:tasks.workunit.client.0.smithi050.stderr: -63> 2024-09-14T11:15:56.337+0000 7f1039725800 20 add_watcher() i=5 2024-09-14T11:15:56.423 INFO:tasks.workunit.client.0.smithi050.stderr: -62> 2024-09-14T11:15:56.337+0000 7f1039725800 20 add_watcher() i=6 2024-09-14T11:15:56.423 INFO:tasks.workunit.client.0.smithi050.stderr: -61> 2024-09-14T11:15:56.338+0000 7f1039725800 20 add_watcher() i=7 2024-09-14T11:15:56.423 INFO:tasks.workunit.client.0.smithi050.stderr: -60> 2024-09-14T11:15:56.338+0000 7f1039725800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:56.423 INFO:tasks.workunit.client.0.smithi050.stderr: -59> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding auth protocol: cephx 2024-09-14T11:15:56.423 INFO:tasks.workunit.client.0.smithi050.stderr: -58> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding auth protocol: cephx 2024-09-14T11:15:56.423 INFO:tasks.workunit.client.0.smithi050.stderr: -57> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding auth protocol: cephx 2024-09-14T11:15:56.423 INFO:tasks.workunit.client.0.smithi050.stderr: -56> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding con mode: secure 2024-09-14T11:15:56.423 INFO:tasks.workunit.client.0.smithi050.stderr: -55> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding con mode: crc 2024-09-14T11:15:56.423 INFO:tasks.workunit.client.0.smithi050.stderr: -54> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding con mode: secure 2024-09-14T11:15:56.423 INFO:tasks.workunit.client.0.smithi050.stderr: -53> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding con mode: crc 2024-09-14T11:15:56.424 INFO:tasks.workunit.client.0.smithi050.stderr: -52> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding con mode: secure 2024-09-14T11:15:56.424 INFO:tasks.workunit.client.0.smithi050.stderr: -51> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding con mode: crc 2024-09-14T11:15:56.424 INFO:tasks.workunit.client.0.smithi050.stderr: -50> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding con mode: crc 2024-09-14T11:15:56.424 INFO:tasks.workunit.client.0.smithi050.stderr: -49> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding con mode: secure 2024-09-14T11:15:56.424 INFO:tasks.workunit.client.0.smithi050.stderr: -48> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding con mode: crc 2024-09-14T11:15:56.424 INFO:tasks.workunit.client.0.smithi050.stderr: -47> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding con mode: secure 2024-09-14T11:15:56.424 INFO:tasks.workunit.client.0.smithi050.stderr: -46> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding con mode: crc 2024-09-14T11:15:56.424 INFO:tasks.workunit.client.0.smithi050.stderr: -45> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding con mode: secure 2024-09-14T11:15:56.424 INFO:tasks.workunit.client.0.smithi050.stderr: -44> 2024-09-14T11:15:56.340+0000 7f0eeb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:56.424 INFO:tasks.workunit.client.0.smithi050.stderr: -43> 2024-09-14T11:15:56.340+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.424 INFO:tasks.workunit.client.0.smithi050.stderr: -42> 2024-09-14T11:15:56.340+0000 7f1039725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:56.424 INFO:tasks.workunit.client.0.smithi050.stderr: -41> 2024-09-14T11:15:56.340+0000 7f1039725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:56.424 INFO:tasks.workunit.client.0.smithi050.stderr: -40> 2024-09-14T11:15:56.340+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command cache list hook 0x55a1aaab7c80 2024-09-14T11:15:56.425 INFO:tasks.workunit.client.0.smithi050.stderr: -39> 2024-09-14T11:15:56.340+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command cache inspect hook 0x55a1aaab7c80 2024-09-14T11:15:56.425 INFO:tasks.workunit.client.0.smithi050.stderr: -38> 2024-09-14T11:15:56.340+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command cache erase hook 0x55a1aaab7c80 2024-09-14T11:15:56.425 INFO:tasks.workunit.client.0.smithi050.stderr: -37> 2024-09-14T11:15:56.340+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command cache zap hook 0x55a1aaab7c80 2024-09-14T11:15:56.425 INFO:tasks.workunit.client.0.smithi050.stderr: -36> 2024-09-14T11:15:56.340+0000 7f1039725800 5 note: GC not initialized 2024-09-14T11:15:56.425 INFO:tasks.workunit.client.0.smithi050.stderr: -35> 2024-09-14T11:15:56.340+0000 7f0eea7e4640 20 reqs_thread_entry: start 2024-09-14T11:15:56.425 INFO:tasks.workunit.client.0.smithi050.stderr: -34> 2024-09-14T11:15:56.341+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command sync trace show hook 0x7f1030004ac0 2024-09-14T11:15:56.425 INFO:tasks.workunit.client.0.smithi050.stderr: -33> 2024-09-14T11:15:56.341+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command sync trace history hook 0x7f1030004ac0 2024-09-14T11:15:56.425 INFO:tasks.workunit.client.0.smithi050.stderr: -32> 2024-09-14T11:15:56.341+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command sync trace active hook 0x7f1030004ac0 2024-09-14T11:15:56.425 INFO:tasks.workunit.client.0.smithi050.stderr: -31> 2024-09-14T11:15:56.341+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command sync trace active_short hook 0x7f1030004ac0 2024-09-14T11:15:56.425 INFO:tasks.workunit.client.0.smithi050.stderr: -30> 2024-09-14T11:15:56.341+0000 7f1039725800 20 init_complete bucket index max shards: 11 2024-09-14T11:15:56.425 INFO:tasks.workunit.client.0.smithi050.stderr: -29> 2024-09-14T11:15:56.341+0000 7f1039725800 20 Filter name: none 2024-09-14T11:15:56.425 INFO:tasks.workunit.client.0.smithi050.stderr: -28> 2024-09-14T11:15:56.341+0000 7f0e5bfff640 20 reqs_thread_entry: start 2024-09-14T11:15:56.425 INFO:tasks.workunit.client.0.smithi050.stderr: -27> 2024-09-14T11:15:56.341+0000 7f1039725800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:15:56.426 INFO:tasks.workunit.client.0.smithi050.stderr: -26> 2024-09-14T11:15:56.341+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.426 INFO:tasks.workunit.client.0.smithi050.stderr: -25> 2024-09-14T11:15:56.341+0000 7f1039725800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:15:56.426 INFO:tasks.workunit.client.0.smithi050.stderr: -24> 2024-09-14T11:15:56.341+0000 7f1039725800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:15:56.426 INFO:tasks.workunit.client.0.smithi050.stderr: -23> 2024-09-14T11:15:56.341+0000 7f1039725800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:15:56.426 INFO:tasks.workunit.client.0.smithi050.stderr: -22> 2024-09-14T11:15:56.341+0000 7f1039725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : miss 2024-09-14T11:15:56.426 INFO:tasks.workunit.client.0.smithi050.stderr: -21> 2024-09-14T11:15:56.341+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.426 INFO:tasks.workunit.client.0.smithi050.stderr: -20> 2024-09-14T11:15:56.342+0000 7f1039725800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:15:56.426 INFO:tasks.workunit.client.0.smithi050.stderr: -19> 2024-09-14T11:15:56.342+0000 7f1039725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:15:56.426 INFO:tasks.workunit.client.0.smithi050.stderr: -18> 2024-09-14T11:15:56.342+0000 7f1039725800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:15:56.426 INFO:tasks.workunit.client.0.smithi050.stderr: -17> 2024-09-14T11:15:56.342+0000 7f1039725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:56.426 INFO:tasks.workunit.client.0.smithi050.stderr: -16> 2024-09-14T11:15:56.342+0000 7f1039725800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:56.426 INFO:tasks.workunit.client.0.smithi050.stderr: -15> 2024-09-14T11:15:56.342+0000 7f1039725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:15:56.426 INFO:tasks.workunit.client.0.smithi050.stderr: -14> 2024-09-14T11:15:56.343+0000 7f1039725800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:15:56.427 INFO:tasks.workunit.client.0.smithi050.stderr: -13> 2024-09-14T11:15:56.351+0000 7f1039725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:15:56.427 INFO:tasks.workunit.client.0.smithi050.stderr: -12> 2024-09-14T11:15:56.351+0000 7f1039725800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:15:56.427 INFO:tasks.workunit.client.0.smithi050.stderr: -11> 2024-09-14T11:15:56.351+0000 7f1039725800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:56.427 INFO:tasks.workunit.client.0.smithi050.stderr: -10> 2024-09-14T11:15:56.351+0000 7f1039725800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18, ofs0, ns] 2024-09-14T11:15:56.427 INFO:tasks.workunit.client.0.smithi050.stderr: -9> 2024-09-14T11:15:56.351+0000 7f0f18ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497135 cookie 94152841851104 notifier 7865 bl.length()=911 2024-09-14T11:15:56.427 INFO:tasks.workunit.client.0.smithi050.stderr: -8> 2024-09-14T11:15:56.351+0000 7f0f18ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:15:56.427 INFO:tasks.workunit.client.0.smithi050.stderr: -7> 2024-09-14T11:15:56.351+0000 7f0f18ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:15:56.427 INFO:tasks.workunit.client.0.smithi050.stderr: -6> 2024-09-14T11:15:56.351+0000 7f0f18ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:56.427 INFO:tasks.workunit.client.0.smithi050.stderr: -5> 2024-09-14T11:15:56.353+0000 7f1039725800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_sources= new_sources= 2024-09-14T11:15:56.427 INFO:tasks.workunit.client.0.smithi050.stderr: -4> 2024-09-14T11:15:56.353+0000 7f1039725800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential sources added=[] removed=[] 2024-09-14T11:15:56.427 INFO:tasks.workunit.client.0.smithi050.stderr: -3> 2024-09-14T11:15:56.353+0000 7f1039725800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_dests= new_dests= 2024-09-14T11:15:56.427 INFO:tasks.workunit.client.0.smithi050.stderr: -2> 2024-09-14T11:15:56.353+0000 7f1039725800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential dests added=[] removed=[] 2024-09-14T11:15:56.427 INFO:tasks.workunit.client.0.smithi050.stderr: -1> 2024-09-14T11:15:56.358+0000 7f1039725800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1039725800 time 2024-09-14T11:15:56.358614+0000 2024-09-14T11:15:56.428 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:15:56.428 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.428 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:56.428 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f103ad8c76a] 2024-09-14T11:15:56.428 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f103ad8c928] 2024-09-14T11:15:56.428 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a1a85830b1] 2024-09-14T11:15:56.428 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a1a8592f6a] 2024-09-14T11:15:56.428 INFO:tasks.workunit.client.0.smithi050.stderr: 5: main() 2024-09-14T11:15:56.428 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f1039a29590] 2024-09-14T11:15:56.428 INFO:tasks.workunit.client.0.smithi050.stderr: 7: __libc_start_main() 2024-09-14T11:15:56.428 INFO:tasks.workunit.client.0.smithi050.stderr: 8: _start() 2024-09-14T11:15:56.428 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.428 INFO:tasks.workunit.client.0.smithi050.stderr: 0> 2024-09-14T11:15:56.359+0000 7f1039725800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:15:56.429 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f1039725800 thread_name:radosgw-admin 2024-09-14T11:15:56.429 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.429 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:56.429 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1039a3e6f0] 2024-09-14T11:15:56.429 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1039a8b99c] 2024-09-14T11:15:56.429 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:15:56.429 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:15:56.429 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f103ad8c7c4] 2024-09-14T11:15:56.429 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f103ad8c928] 2024-09-14T11:15:56.429 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a1a85830b1] 2024-09-14T11:15:56.429 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a1a8592f6a] 2024-09-14T11:15:56.429 INFO:tasks.workunit.client.0.smithi050.stderr: 9: main() 2024-09-14T11:15:56.429 INFO:tasks.workunit.client.0.smithi050.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f1039a29590] 2024-09-14T11:15:56.430 INFO:tasks.workunit.client.0.smithi050.stderr: 11: __libc_start_main() 2024-09-14T11:15:56.430 INFO:tasks.workunit.client.0.smithi050.stderr: 12: _start() 2024-09-14T11:15:56.430 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:15:56.430 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.430 INFO:tasks.workunit.client.0.smithi050.stderr:--- logging levels --- 2024-09-14T11:15:56.430 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 none 2024-09-14T11:15:56.430 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 lockdep 2024-09-14T11:15:56.430 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 context 2024-09-14T11:15:56.430 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 crush 2024-09-14T11:15:56.430 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds 2024-09-14T11:15:56.430 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_balancer 2024-09-14T11:15:56.430 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_locker 2024-09-14T11:15:56.430 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log 2024-09-14T11:15:56.430 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log_expire 2024-09-14T11:15:56.430 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_migrator 2024-09-14T11:15:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 3/ 5 mds_quiesce 2024-09-14T11:15:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 buffer 2024-09-14T11:15:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 timer 2024-09-14T11:15:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 filer 2024-09-14T11:15:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 striper 2024-09-14T11:15:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 objecter 2024-09-14T11:15:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rados 2024-09-14T11:15:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd 2024-09-14T11:15:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_mirror 2024-09-14T11:15:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_replay 2024-09-14T11:15:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_pwl 2024-09-14T11:15:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 journaler 2024-09-14T11:15:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objectcacher 2024-09-14T11:15:56.431 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:15:56.432 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 client 2024-09-14T11:15:56.432 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 osd 2024-09-14T11:15:56.432 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 optracker 2024-09-14T11:15:56.432 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objclass 2024-09-14T11:15:56.432 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 filestore 2024-09-14T11:15:56.432 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 journal 2024-09-14T11:15:56.432 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 ms 2024-09-14T11:15:56.432 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mon 2024-09-14T11:15:56.432 INFO:tasks.workunit.client.0.smithi050.stderr: 0/10 monc 2024-09-14T11:15:56.432 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 paxos 2024-09-14T11:15:56.432 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 tp 2024-09-14T11:15:56.432 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 auth 2024-09-14T11:15:56.433 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 crypto 2024-09-14T11:15:56.433 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 finisher 2024-09-14T11:15:56.433 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 reserver 2024-09-14T11:15:56.433 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 heartbeatmap 2024-09-14T11:15:56.433 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 perfcounter 2024-09-14T11:15:56.433 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw 2024-09-14T11:15:56.433 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_sync 2024-09-14T11:15:56.433 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_datacache 2024-09-14T11:15:56.433 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_access 2024-09-14T11:15:56.433 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:15:56.433 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_flight 2024-09-14T11:15:56.433 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:15:56.433 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw_notification 2024-09-14T11:15:56.434 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 javaclient 2024-09-14T11:15:56.434 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 asok 2024-09-14T11:15:56.434 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 throttle 2024-09-14T11:15:56.434 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 refs 2024-09-14T11:15:56.434 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 compressor 2024-09-14T11:15:56.434 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluestore 2024-09-14T11:15:56.434 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluefs 2024-09-14T11:15:56.434 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 bdev 2024-09-14T11:15:56.434 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 kstore 2024-09-14T11:15:56.434 INFO:tasks.workunit.client.0.smithi050.stderr: 4/ 5 rocksdb 2024-09-14T11:15:56.434 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 fuse 2024-09-14T11:15:56.434 INFO:tasks.workunit.client.0.smithi050.stderr: 2/ 5 mgr 2024-09-14T11:15:56.435 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mgrc 2024-09-14T11:15:56.435 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 dpdk 2024-09-14T11:15:56.435 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 eventtrace 2024-09-14T11:15:56.435 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 prioritycache 2024-09-14T11:15:56.435 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 test 2024-09-14T11:15:56.435 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:15:56.435 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephsqlite 2024-09-14T11:15:56.435 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:15:56.435 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore 2024-09-14T11:15:56.435 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_onode 2024-09-14T11:15:56.435 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_odata 2024-09-14T11:15:56.435 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_omap 2024-09-14T11:15:56.435 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_tm 2024-09-14T11:15:56.435 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_t 2024-09-14T11:15:56.436 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:15:56.436 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_epm 2024-09-14T11:15:56.436 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_lba 2024-09-14T11:15:56.436 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:15:56.436 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cache 2024-09-14T11:15:56.436 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_journal 2024-09-14T11:15:56.436 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_device 2024-09-14T11:15:56.436 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_backref 2024-09-14T11:15:56.436 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 alienstore 2024-09-14T11:15:56.436 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mclock 2024-09-14T11:15:56.436 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cyanstore 2024-09-14T11:15:56.436 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 ceph_exporter 2024-09-14T11:15:56.437 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 memstore 2024-09-14T11:15:56.437 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 trace 2024-09-14T11:15:56.437 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 ceph_dedup 2024-09-14T11:15:56.437 INFO:tasks.workunit.client.0.smithi050.stderr: -2/-2 (syslog threshold) 2024-09-14T11:15:56.437 INFO:tasks.workunit.client.0.smithi050.stderr: 99/99 (stderr threshold) 2024-09-14T11:15:56.437 INFO:tasks.workunit.client.0.smithi050.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:15:56.437 INFO:tasks.workunit.client.0.smithi050.stderr: 7f0e5bfff640 / http_manager 2024-09-14T11:15:56.437 INFO:tasks.workunit.client.0.smithi050.stderr: 7f0eea7e4640 / http_manager 2024-09-14T11:15:56.437 INFO:tasks.workunit.client.0.smithi050.stderr: 7f0eeb7e6640 / rgw_dt_lg_renew 2024-09-14T11:15:56.437 INFO:tasks.workunit.client.0.smithi050.stderr: 7f0f06ffd640 / ms_dispatch 2024-09-14T11:15:56.437 INFO:tasks.workunit.client.0.smithi050.stderr: 7f0f18ff9640 / io_context_pool 2024-09-14T11:15:56.437 INFO:tasks.workunit.client.0.smithi050.stderr: 7f0f1affd640 / ms_dispatch 2024-09-14T11:15:56.437 INFO:tasks.workunit.client.0.smithi050.stderr: 7f0f21e03640 / ms_dispatch 2024-09-14T11:15:56.437 INFO:tasks.workunit.client.0.smithi050.stderr: 7f0f23606640 / io_context_pool 2024-09-14T11:15:56.438 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1034bad640 / msgr-worker-2 2024-09-14T11:15:56.438 INFO:tasks.workunit.client.0.smithi050.stderr: 7f10353ae640 / msgr-worker-1 2024-09-14T11:15:56.438 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1035baf640 / msgr-worker-0 2024-09-14T11:15:56.438 INFO:tasks.workunit.client.0.smithi050.stderr: 7f10363b0640 / io_context_pool 2024-09-14T11:15:56.438 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1039725800 / radosgw-admin 2024-09-14T11:15:56.438 INFO:tasks.workunit.client.0.smithi050.stderr: max_recent 500 2024-09-14T11:15:56.438 INFO:tasks.workunit.client.0.smithi050.stderr: max_new 1000 2024-09-14T11:15:56.438 INFO:tasks.workunit.client.0.smithi050.stderr: log_file /var/log/ceph/ceph-client.admin.154989.log 2024-09-14T11:15:56.438 INFO:tasks.workunit.client.0.smithi050.stderr:--- end dump of recent events --- 2024-09-14T11:15:56.438 INFO:tasks.workunit.client.0.smithi050.stderr:--- begin dump of recent events --- 2024-09-14T11:15:56.438 INFO:tasks.workunit.client.0.smithi050.stderr: -499> 2024-09-14T11:15:56.090+0000 7f0f23606640 10 monclient: dump: 2024-09-14T11:15:56.438 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:56.438 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:56.438 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.438 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.439 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:56.439 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.439 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:56.439 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:56.439 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:56.439 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.439 INFO:tasks.workunit.client.0.smithi050.stderr: -498> 2024-09-14T11:15:56.091+0000 7f1039725800 10 monclient: shutdown 2024-09-14T11:15:56.439 INFO:tasks.workunit.client.0.smithi050.stderr: -497> 2024-09-14T11:15:56.091+0000 7f1039725800 5 asok(0x55a1aa7f8270) unregister_commands rotate-key 2024-09-14T11:15:56.439 INFO:tasks.workunit.client.0.smithi050.stderr: -496> 2024-09-14T11:15:56.091+0000 7f1039725800 10 monclient: build_initial_monmap 2024-09-14T11:15:56.439 INFO:tasks.workunit.client.0.smithi050.stderr: -495> 2024-09-14T11:15:56.091+0000 7f1039725800 1 build_initial for_mkfs: 0 2024-09-14T11:15:56.439 INFO:tasks.workunit.client.0.smithi050.stderr: -494> 2024-09-14T11:15:56.091+0000 7f1039725800 10 monclient: monmap: 2024-09-14T11:15:56.439 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:15:56.439 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:56.440 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:15:56.440 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:15:56.440 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:56.440 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.440 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:15:56.440 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:15:56.440 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:15:56.440 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.440 INFO:tasks.workunit.client.0.smithi050.stderr: -493> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding auth protocol: cephx 2024-09-14T11:15:56.440 INFO:tasks.workunit.client.0.smithi050.stderr: -492> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding auth protocol: cephx 2024-09-14T11:15:56.440 INFO:tasks.workunit.client.0.smithi050.stderr: -491> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding auth protocol: cephx 2024-09-14T11:15:56.440 INFO:tasks.workunit.client.0.smithi050.stderr: -490> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding con mode: secure 2024-09-14T11:15:56.441 INFO:tasks.workunit.client.0.smithi050.stderr: -489> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding con mode: crc 2024-09-14T11:15:56.441 INFO:tasks.workunit.client.0.smithi050.stderr: -488> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding con mode: secure 2024-09-14T11:15:56.441 INFO:tasks.workunit.client.0.smithi050.stderr: -487> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding con mode: crc 2024-09-14T11:15:56.441 INFO:tasks.workunit.client.0.smithi050.stderr: -486> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding con mode: secure 2024-09-14T11:15:56.441 INFO:tasks.workunit.client.0.smithi050.stderr: -485> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding con mode: crc 2024-09-14T11:15:56.441 INFO:tasks.workunit.client.0.smithi050.stderr: -484> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding con mode: crc 2024-09-14T11:15:56.441 INFO:tasks.workunit.client.0.smithi050.stderr: -483> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding con mode: secure 2024-09-14T11:15:56.441 INFO:tasks.workunit.client.0.smithi050.stderr: -482> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding con mode: crc 2024-09-14T11:15:56.441 INFO:tasks.workunit.client.0.smithi050.stderr: -481> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding con mode: secure 2024-09-14T11:15:56.441 INFO:tasks.workunit.client.0.smithi050.stderr: -480> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding con mode: crc 2024-09-14T11:15:56.441 INFO:tasks.workunit.client.0.smithi050.stderr: -479> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa20790) adding con mode: secure 2024-09-14T11:15:56.441 INFO:tasks.workunit.client.0.smithi050.stderr: -478> 2024-09-14T11:15:56.091+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.441 INFO:tasks.workunit.client.0.smithi050.stderr: -477> 2024-09-14T11:15:56.091+0000 7f1039725800 1 librados: starting msgr at 2024-09-14T11:15:56.442 INFO:tasks.workunit.client.0.smithi050.stderr: -476> 2024-09-14T11:15:56.091+0000 7f1039725800 1 librados: starting objecter 2024-09-14T11:15:56.442 INFO:tasks.workunit.client.0.smithi050.stderr: -475> 2024-09-14T11:15:56.091+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command objecter_requests hook 0x55a1aaa45af0 2024-09-14T11:15:56.442 INFO:tasks.workunit.client.0.smithi050.stderr: -474> 2024-09-14T11:15:56.091+0000 7f1039725800 1 librados: setting wanted keys 2024-09-14T11:15:56.442 INFO:tasks.workunit.client.0.smithi050.stderr: -473> 2024-09-14T11:15:56.091+0000 7f1039725800 1 librados: calling monclient init 2024-09-14T11:15:56.442 INFO:tasks.workunit.client.0.smithi050.stderr: -472> 2024-09-14T11:15:56.091+0000 7f1039725800 10 monclient: init 2024-09-14T11:15:56.442 INFO:tasks.workunit.client.0.smithi050.stderr: -471> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding auth protocol: cephx 2024-09-14T11:15:56.442 INFO:tasks.workunit.client.0.smithi050.stderr: -470> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding auth protocol: cephx 2024-09-14T11:15:56.442 INFO:tasks.workunit.client.0.smithi050.stderr: -469> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding auth protocol: cephx 2024-09-14T11:15:56.442 INFO:tasks.workunit.client.0.smithi050.stderr: -468> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding con mode: secure 2024-09-14T11:15:56.442 INFO:tasks.workunit.client.0.smithi050.stderr: -467> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding con mode: crc 2024-09-14T11:15:56.442 INFO:tasks.workunit.client.0.smithi050.stderr: -466> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding con mode: secure 2024-09-14T11:15:56.442 INFO:tasks.workunit.client.0.smithi050.stderr: -465> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding con mode: crc 2024-09-14T11:15:56.442 INFO:tasks.workunit.client.0.smithi050.stderr: -464> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding con mode: secure 2024-09-14T11:15:56.442 INFO:tasks.workunit.client.0.smithi050.stderr: -463> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding con mode: crc 2024-09-14T11:15:56.442 INFO:tasks.workunit.client.0.smithi050.stderr: -462> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding con mode: crc 2024-09-14T11:15:56.443 INFO:tasks.workunit.client.0.smithi050.stderr: -461> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding con mode: secure 2024-09-14T11:15:56.443 INFO:tasks.workunit.client.0.smithi050.stderr: -460> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding con mode: crc 2024-09-14T11:15:56.443 INFO:tasks.workunit.client.0.smithi050.stderr: -459> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding con mode: secure 2024-09-14T11:15:56.443 INFO:tasks.workunit.client.0.smithi050.stderr: -458> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding con mode: crc 2024-09-14T11:15:56.443 INFO:tasks.workunit.client.0.smithi050.stderr: -457> 2024-09-14T11:15:56.091+0000 7f1039725800 5 AuthRegistry(0x55a1aaa1ab20) adding con mode: secure 2024-09-14T11:15:56.443 INFO:tasks.workunit.client.0.smithi050.stderr: -456> 2024-09-14T11:15:56.091+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.443 INFO:tasks.workunit.client.0.smithi050.stderr: -455> 2024-09-14T11:15:56.092+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.443 INFO:tasks.workunit.client.0.smithi050.stderr: -454> 2024-09-14T11:15:56.092+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command rotate-key hook 0x55a1aaa1ac68 2024-09-14T11:15:56.443 INFO:tasks.workunit.client.0.smithi050.stderr: -453> 2024-09-14T11:15:56.092+0000 7f1039725800 10 monclient: _reopen_session rank -1 2024-09-14T11:15:56.443 INFO:tasks.workunit.client.0.smithi050.stderr: -452> 2024-09-14T11:15:56.092+0000 7f1039725800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:15:56.443 INFO:tasks.workunit.client.0.smithi050.stderr: -451> 2024-09-14T11:15:56.092+0000 7f1039725800 10 monclient(hunting): picked mon.noname-c con 0x55a1aa8c82d0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:15:56.443 INFO:tasks.workunit.client.0.smithi050.stderr: -450> 2024-09-14T11:15:56.092+0000 7f1039725800 10 monclient(hunting): picked mon.noname-a con 0x55a1aa95e1e0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:15:56.443 INFO:tasks.workunit.client.0.smithi050.stderr: -449> 2024-09-14T11:15:56.092+0000 7f1039725800 10 monclient(hunting): picked mon.noname-b con 0x55a1aa964030 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:15:56.443 INFO:tasks.workunit.client.0.smithi050.stderr: -448> 2024-09-14T11:15:56.092+0000 7f1039725800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:56.443 INFO:tasks.workunit.client.0.smithi050.stderr: -447> 2024-09-14T11:15:56.092+0000 7f1039725800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:56.444 INFO:tasks.workunit.client.0.smithi050.stderr: -446> 2024-09-14T11:15:56.092+0000 7f1039725800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:56.444 INFO:tasks.workunit.client.0.smithi050.stderr: -445> 2024-09-14T11:15:56.092+0000 7f1039725800 10 monclient(hunting): _renew_subs 2024-09-14T11:15:56.444 INFO:tasks.workunit.client.0.smithi050.stderr: -444> 2024-09-14T11:15:56.092+0000 7f1039725800 10 monclient(hunting): authenticate will time out at 2608.729333s 2024-09-14T11:15:56.444 INFO:tasks.workunit.client.0.smithi050.stderr: -443> 2024-09-14T11:15:56.092+0000 7f1034bad640 10 monclient(hunting): get_auth_request con 0x55a1aa95e1e0 auth_method 0 2024-09-14T11:15:56.444 INFO:tasks.workunit.client.0.smithi050.stderr: -442> 2024-09-14T11:15:56.092+0000 7f1034bad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:56.444 INFO:tasks.workunit.client.0.smithi050.stderr: -441> 2024-09-14T11:15:56.092+0000 7f1034bad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:56.444 INFO:tasks.workunit.client.0.smithi050.stderr: -440> 2024-09-14T11:15:56.092+0000 7f1034bad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:56.444 INFO:tasks.workunit.client.0.smithi050.stderr: -439> 2024-09-14T11:15:56.092+0000 7f10353ae640 10 monclient(hunting): get_auth_request con 0x55a1aa8c82d0 auth_method 0 2024-09-14T11:15:56.444 INFO:tasks.workunit.client.0.smithi050.stderr: -438> 2024-09-14T11:15:56.092+0000 7f10353ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:56.444 INFO:tasks.workunit.client.0.smithi050.stderr: -437> 2024-09-14T11:15:56.092+0000 7f10353ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:56.444 INFO:tasks.workunit.client.0.smithi050.stderr: -436> 2024-09-14T11:15:56.092+0000 7f10353ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:56.444 INFO:tasks.workunit.client.0.smithi050.stderr: -435> 2024-09-14T11:15:56.092+0000 7f1034bad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:56.444 INFO:tasks.workunit.client.0.smithi050.stderr: -434> 2024-09-14T11:15:56.092+0000 7f1034bad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:56.445 INFO:tasks.workunit.client.0.smithi050.stderr: -433> 2024-09-14T11:15:56.092+0000 7f1034bad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:56.445 INFO:tasks.workunit.client.0.smithi050.stderr: -432> 2024-09-14T11:15:56.092+0000 7f10353ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:56.445 INFO:tasks.workunit.client.0.smithi050.stderr: -431> 2024-09-14T11:15:56.092+0000 7f10353ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:56.445 INFO:tasks.workunit.client.0.smithi050.stderr: -430> 2024-09-14T11:15:56.092+0000 7f10353ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:56.445 INFO:tasks.workunit.client.0.smithi050.stderr: -429> 2024-09-14T11:15:56.092+0000 7f1034bad640 10 monclient(hunting): handle_auth_done global_id 8430 payload 824 2024-09-14T11:15:56.445 INFO:tasks.workunit.client.0.smithi050.stderr: -428> 2024-09-14T11:15:56.092+0000 7f1034bad640 10 monclient: _finish_hunting 0 2024-09-14T11:15:56.445 INFO:tasks.workunit.client.0.smithi050.stderr: -427> 2024-09-14T11:15:56.092+0000 7f1034bad640 1 monclient: found mon.noname-a 2024-09-14T11:15:56.445 INFO:tasks.workunit.client.0.smithi050.stderr: -426> 2024-09-14T11:15:56.092+0000 7f1034bad640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:15:56.445 INFO:tasks.workunit.client.0.smithi050.stderr: -425> 2024-09-14T11:15:56.092+0000 7f1035baf640 10 monclient: get_auth_request con 0x55a1aa964030 auth_method 0 2024-09-14T11:15:56.445 INFO:tasks.workunit.client.0.smithi050.stderr: -424> 2024-09-14T11:15:56.093+0000 7f0f21e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:56.445 INFO:tasks.workunit.client.0.smithi050.stderr: -423> 2024-09-14T11:15:56.093+0000 7f0f21e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:56.445 INFO:tasks.workunit.client.0.smithi050.stderr: -422> 2024-09-14T11:15:56.093+0000 7f0f21e03640 10 monclient: dump: 2024-09-14T11:15:56.445 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:56.446 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:56.446 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.446 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.446 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:56.446 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.446 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:56.446 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:56.446 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:56.446 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.446 INFO:tasks.workunit.client.0.smithi050.stderr: -421> 2024-09-14T11:15:56.093+0000 7f0f21e03640 10 monclient: _finish_auth 0 2024-09-14T11:15:56.446 INFO:tasks.workunit.client.0.smithi050.stderr: -420> 2024-09-14T11:15:56.093+0000 7f0f21e03640 10 monclient: _check_auth_tickets 2024-09-14T11:15:56.446 INFO:tasks.workunit.client.0.smithi050.stderr: -419> 2024-09-14T11:15:56.093+0000 7f0f21e03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:56.446 INFO:tasks.workunit.client.0.smithi050.stderr: -418> 2024-09-14T11:15:56.093+0000 7f0f21e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:56.447 INFO:tasks.workunit.client.0.smithi050.stderr: -417> 2024-09-14T11:15:56.093+0000 7f0f21e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:56.447 INFO:tasks.workunit.client.0.smithi050.stderr: -416> 2024-09-14T11:15:56.093+0000 7f0f21e03640 10 monclient: dump: 2024-09-14T11:15:56.447 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:56.447 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:56.447 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.447 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.447 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:56.447 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.447 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:56.447 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:56.447 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:56.447 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.447 INFO:tasks.workunit.client.0.smithi050.stderr: -415> 2024-09-14T11:15:56.093+0000 7f1039725800 5 monclient: authenticate success, global_id 8430 2024-09-14T11:15:56.448 INFO:tasks.workunit.client.0.smithi050.stderr: -414> 2024-09-14T11:15:56.093+0000 7f1039725800 10 monclient: _renew_subs 2024-09-14T11:15:56.448 INFO:tasks.workunit.client.0.smithi050.stderr: -413> 2024-09-14T11:15:56.093+0000 7f1039725800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:15:56.448 INFO:tasks.workunit.client.0.smithi050.stderr: -412> 2024-09-14T11:15:56.093+0000 7f0f23606640 4 set_mon_vals no callback set 2024-09-14T11:15:56.448 INFO:tasks.workunit.client.0.smithi050.stderr: -411> 2024-09-14T11:15:56.093+0000 7f1039725800 10 monclient: _renew_subs 2024-09-14T11:15:56.448 INFO:tasks.workunit.client.0.smithi050.stderr: -410> 2024-09-14T11:15:56.093+0000 7f1039725800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:15:56.448 INFO:tasks.workunit.client.0.smithi050.stderr: -409> 2024-09-14T11:15:56.093+0000 7f1039725800 1 librados: init done 2024-09-14T11:15:56.448 INFO:tasks.workunit.client.0.smithi050.stderr: -408> 2024-09-14T11:15:56.095+0000 7f0f21e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:15:56.448 INFO:tasks.workunit.client.0.smithi050.stderr: -407> 2024-09-14T11:15:56.095+0000 7f0f21e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:15:56.448 INFO:tasks.workunit.client.0.smithi050.stderr: -406> 2024-09-14T11:15:56.095+0000 7f0f21e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:15:56.448 INFO:tasks.workunit.client.0.smithi050.stderr: -405> 2024-09-14T11:15:56.096+0000 7f10353ae640 10 monclient: get_auth_request con 0x7f0f1c077230 auth_method 0 2024-09-14T11:15:56.448 INFO:tasks.workunit.client.0.smithi050.stderr: -404> 2024-09-14T11:15:56.096+0000 7f1035baf640 10 monclient: get_auth_request con 0x55a1aaa63560 auth_method 0 2024-09-14T11:15:56.448 INFO:tasks.workunit.client.0.smithi050.stderr: -403> 2024-09-14T11:15:56.097+0000 7f10353ae640 10 monclient: get_auth_request con 0x55a1aaa66740 auth_method 0 2024-09-14T11:15:56.448 INFO:tasks.workunit.client.0.smithi050.stderr: -402> 2024-09-14T11:15:56.097+0000 7f1034bad640 10 monclient: get_auth_request con 0x55a1aaa6a930 auth_method 0 2024-09-14T11:15:56.448 INFO:tasks.workunit.client.0.smithi050.stderr: -401> 2024-09-14T11:15:56.099+0000 7f1039725800 10 monclient: build_initial_monmap 2024-09-14T11:15:56.449 INFO:tasks.workunit.client.0.smithi050.stderr: -400> 2024-09-14T11:15:56.099+0000 7f1039725800 1 build_initial for_mkfs: 0 2024-09-14T11:15:56.449 INFO:tasks.workunit.client.0.smithi050.stderr: -399> 2024-09-14T11:15:56.099+0000 7f1039725800 10 monclient: monmap: 2024-09-14T11:15:56.449 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:15:56.449 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:56.449 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:15:56.449 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:15:56.449 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:56.449 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.449 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:15:56.449 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:15:56.449 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:15:56.449 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.449 INFO:tasks.workunit.client.0.smithi050.stderr: -398> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding auth protocol: cephx 2024-09-14T11:15:56.449 INFO:tasks.workunit.client.0.smithi050.stderr: -397> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding auth protocol: cephx 2024-09-14T11:15:56.449 INFO:tasks.workunit.client.0.smithi050.stderr: -396> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding auth protocol: cephx 2024-09-14T11:15:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: -395> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding con mode: secure 2024-09-14T11:15:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: -394> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding con mode: crc 2024-09-14T11:15:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: -393> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding con mode: secure 2024-09-14T11:15:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: -392> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding con mode: crc 2024-09-14T11:15:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: -391> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding con mode: secure 2024-09-14T11:15:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: -390> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding con mode: crc 2024-09-14T11:15:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: -389> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding con mode: crc 2024-09-14T11:15:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: -388> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding con mode: secure 2024-09-14T11:15:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: -387> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding con mode: crc 2024-09-14T11:15:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: -386> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding con mode: secure 2024-09-14T11:15:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: -385> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding con mode: crc 2024-09-14T11:15:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: -384> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6f6a0) adding con mode: secure 2024-09-14T11:15:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: -383> 2024-09-14T11:15:56.099+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.450 INFO:tasks.workunit.client.0.smithi050.stderr: -382> 2024-09-14T11:15:56.099+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command objecter_requests cmddesc objecter_requests hook 0x55a1aaa72c10 EEXIST 2024-09-14T11:15:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: -381> 2024-09-14T11:15:56.099+0000 7f1039725800 10 monclient: init 2024-09-14T11:15:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: -380> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding auth protocol: cephx 2024-09-14T11:15:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: -379> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding auth protocol: cephx 2024-09-14T11:15:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: -378> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding auth protocol: cephx 2024-09-14T11:15:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: -377> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding con mode: secure 2024-09-14T11:15:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: -376> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding con mode: crc 2024-09-14T11:15:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: -375> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding con mode: secure 2024-09-14T11:15:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: -374> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding con mode: crc 2024-09-14T11:15:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: -373> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding con mode: secure 2024-09-14T11:15:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: -372> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding con mode: crc 2024-09-14T11:15:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: -371> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding con mode: crc 2024-09-14T11:15:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: -370> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding con mode: secure 2024-09-14T11:15:56.451 INFO:tasks.workunit.client.0.smithi050.stderr: -369> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding con mode: crc 2024-09-14T11:15:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -368> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding con mode: secure 2024-09-14T11:15:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -367> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding con mode: crc 2024-09-14T11:15:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -366> 2024-09-14T11:15:56.099+0000 7f1039725800 5 AuthRegistry(0x55a1aaa6dcc8) adding con mode: secure 2024-09-14T11:15:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -365> 2024-09-14T11:15:56.099+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -364> 2024-09-14T11:15:56.100+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -363> 2024-09-14T11:15:56.100+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command rotate-key cmddesc rotate-key hook 0x55a1aaa6de10 EEXIST 2024-09-14T11:15:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -362> 2024-09-14T11:15:56.100+0000 7f1039725800 10 monclient: _reopen_session rank -1 2024-09-14T11:15:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -361> 2024-09-14T11:15:56.100+0000 7f1039725800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:15:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -360> 2024-09-14T11:15:56.100+0000 7f1039725800 10 monclient(hunting): picked mon.noname-a con 0x55a1aaa96f30 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:15:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -359> 2024-09-14T11:15:56.100+0000 7f1039725800 10 monclient(hunting): picked mon.noname-b con 0x55a1aaa97310 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:15:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -358> 2024-09-14T11:15:56.100+0000 7f1039725800 10 monclient(hunting): picked mon.noname-c con 0x55a1aaa95c40 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:15:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -357> 2024-09-14T11:15:56.100+0000 7f1039725800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -356> 2024-09-14T11:15:56.100+0000 7f1039725800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:56.452 INFO:tasks.workunit.client.0.smithi050.stderr: -355> 2024-09-14T11:15:56.100+0000 7f1039725800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:56.453 INFO:tasks.workunit.client.0.smithi050.stderr: -354> 2024-09-14T11:15:56.100+0000 7f1039725800 10 monclient(hunting): _renew_subs 2024-09-14T11:15:56.453 INFO:tasks.workunit.client.0.smithi050.stderr: -353> 2024-09-14T11:15:56.100+0000 7f1039725800 10 monclient(hunting): authenticate will time out at 2608.737295s 2024-09-14T11:15:56.453 INFO:tasks.workunit.client.0.smithi050.stderr: -352> 2024-09-14T11:15:56.100+0000 7f10353ae640 10 monclient(hunting): get_auth_request con 0x55a1aaa96f30 auth_method 0 2024-09-14T11:15:56.453 INFO:tasks.workunit.client.0.smithi050.stderr: -351> 2024-09-14T11:15:56.100+0000 7f10353ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:56.453 INFO:tasks.workunit.client.0.smithi050.stderr: -350> 2024-09-14T11:15:56.100+0000 7f10353ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:56.453 INFO:tasks.workunit.client.0.smithi050.stderr: -349> 2024-09-14T11:15:56.100+0000 7f10353ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:56.453 INFO:tasks.workunit.client.0.smithi050.stderr: -348> 2024-09-14T11:15:56.100+0000 7f1035baf640 10 monclient(hunting): get_auth_request con 0x55a1aaa95c40 auth_method 0 2024-09-14T11:15:56.453 INFO:tasks.workunit.client.0.smithi050.stderr: -347> 2024-09-14T11:15:56.100+0000 7f1035baf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:56.453 INFO:tasks.workunit.client.0.smithi050.stderr: -346> 2024-09-14T11:15:56.100+0000 7f1035baf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:56.453 INFO:tasks.workunit.client.0.smithi050.stderr: -345> 2024-09-14T11:15:56.100+0000 7f1035baf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:56.453 INFO:tasks.workunit.client.0.smithi050.stderr: -344> 2024-09-14T11:15:56.100+0000 7f1034bad640 10 monclient(hunting): get_auth_request con 0x55a1aaa97310 auth_method 0 2024-09-14T11:15:56.453 INFO:tasks.workunit.client.0.smithi050.stderr: -343> 2024-09-14T11:15:56.100+0000 7f1034bad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:56.454 INFO:tasks.workunit.client.0.smithi050.stderr: -342> 2024-09-14T11:15:56.100+0000 7f1034bad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:56.454 INFO:tasks.workunit.client.0.smithi050.stderr: -341> 2024-09-14T11:15:56.100+0000 7f1034bad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:56.454 INFO:tasks.workunit.client.0.smithi050.stderr: -340> 2024-09-14T11:15:56.100+0000 7f10353ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:56.454 INFO:tasks.workunit.client.0.smithi050.stderr: -339> 2024-09-14T11:15:56.100+0000 7f10353ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:56.454 INFO:tasks.workunit.client.0.smithi050.stderr: -338> 2024-09-14T11:15:56.100+0000 7f10353ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:56.454 INFO:tasks.workunit.client.0.smithi050.stderr: -337> 2024-09-14T11:15:56.100+0000 7f1035baf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:56.454 INFO:tasks.workunit.client.0.smithi050.stderr: -336> 2024-09-14T11:15:56.100+0000 7f1035baf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:56.454 INFO:tasks.workunit.client.0.smithi050.stderr: -335> 2024-09-14T11:15:56.100+0000 7f1035baf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:56.454 INFO:tasks.workunit.client.0.smithi050.stderr: -334> 2024-09-14T11:15:56.100+0000 7f1034bad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:56.454 INFO:tasks.workunit.client.0.smithi050.stderr: -333> 2024-09-14T11:15:56.100+0000 7f1034bad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:56.454 INFO:tasks.workunit.client.0.smithi050.stderr: -332> 2024-09-14T11:15:56.100+0000 7f1034bad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:56.454 INFO:tasks.workunit.client.0.smithi050.stderr: -331> 2024-09-14T11:15:56.100+0000 7f10353ae640 10 monclient(hunting): handle_auth_done global_id 8433 payload 824 2024-09-14T11:15:56.454 INFO:tasks.workunit.client.0.smithi050.stderr: -330> 2024-09-14T11:15:56.100+0000 7f10353ae640 10 monclient: _finish_hunting 0 2024-09-14T11:15:56.454 INFO:tasks.workunit.client.0.smithi050.stderr: -329> 2024-09-14T11:15:56.100+0000 7f10353ae640 1 monclient: found mon.noname-a 2024-09-14T11:15:56.455 INFO:tasks.workunit.client.0.smithi050.stderr: -328> 2024-09-14T11:15:56.100+0000 7f10353ae640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:15:56.455 INFO:tasks.workunit.client.0.smithi050.stderr: -327> 2024-09-14T11:15:56.101+0000 7f0f1affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:56.455 INFO:tasks.workunit.client.0.smithi050.stderr: -326> 2024-09-14T11:15:56.101+0000 7f0f1affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:56.455 INFO:tasks.workunit.client.0.smithi050.stderr: -325> 2024-09-14T11:15:56.101+0000 7f0f1affd640 10 monclient: dump: 2024-09-14T11:15:56.455 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:56.455 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:56.455 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.455 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.455 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:56.455 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.455 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:56.455 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:56.455 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:56.455 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.456 INFO:tasks.workunit.client.0.smithi050.stderr: -324> 2024-09-14T11:15:56.101+0000 7f0f1affd640 10 monclient: _finish_auth 0 2024-09-14T11:15:56.456 INFO:tasks.workunit.client.0.smithi050.stderr: -323> 2024-09-14T11:15:56.101+0000 7f0f1affd640 10 monclient: _check_auth_tickets 2024-09-14T11:15:56.456 INFO:tasks.workunit.client.0.smithi050.stderr: -322> 2024-09-14T11:15:56.101+0000 7f0f1affd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:56.456 INFO:tasks.workunit.client.0.smithi050.stderr: -321> 2024-09-14T11:15:56.101+0000 7f0f1affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:56.456 INFO:tasks.workunit.client.0.smithi050.stderr: -320> 2024-09-14T11:15:56.101+0000 7f0f1affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:56.456 INFO:tasks.workunit.client.0.smithi050.stderr: -319> 2024-09-14T11:15:56.101+0000 7f0f1affd640 10 monclient: dump: 2024-09-14T11:15:56.456 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:56.456 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:56.456 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.456 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.456 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:56.456 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.456 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:56.457 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:56.457 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:56.457 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.457 INFO:tasks.workunit.client.0.smithi050.stderr: -318> 2024-09-14T11:15:56.101+0000 7f1039725800 5 monclient: authenticate success, global_id 8433 2024-09-14T11:15:56.457 INFO:tasks.workunit.client.0.smithi050.stderr: -317> 2024-09-14T11:15:56.101+0000 7f1039725800 10 monclient: _renew_subs 2024-09-14T11:15:56.457 INFO:tasks.workunit.client.0.smithi050.stderr: -316> 2024-09-14T11:15:56.101+0000 7f1039725800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:15:56.457 INFO:tasks.workunit.client.0.smithi050.stderr: -315> 2024-09-14T11:15:56.101+0000 7f10363b0640 4 set_mon_vals no callback set 2024-09-14T11:15:56.457 INFO:tasks.workunit.client.0.smithi050.stderr: -314> 2024-09-14T11:15:56.101+0000 7f1039725800 10 monclient: _renew_subs 2024-09-14T11:15:56.457 INFO:tasks.workunit.client.0.smithi050.stderr: -313> 2024-09-14T11:15:56.101+0000 7f1039725800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.50:3300/0 2024-09-14T11:15:56.457 INFO:tasks.workunit.client.0.smithi050.stderr: -312> 2024-09-14T11:15:56.103+0000 7f0f1affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:15:56.457 INFO:tasks.workunit.client.0.smithi050.stderr: -311> 2024-09-14T11:15:56.103+0000 7f0f1affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:15:56.457 INFO:tasks.workunit.client.0.smithi050.stderr: -310> 2024-09-14T11:15:56.103+0000 7f0f1affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:15:56.457 INFO:tasks.workunit.client.0.smithi050.stderr: -309> 2024-09-14T11:15:56.103+0000 7f1039725800 10 monclient: get_monmap_and_config 2024-09-14T11:15:56.457 INFO:tasks.workunit.client.0.smithi050.stderr: -308> 2024-09-14T11:15:56.103+0000 7f1039725800 10 monclient: build_initial_monmap 2024-09-14T11:15:56.457 INFO:tasks.workunit.client.0.smithi050.stderr: -307> 2024-09-14T11:15:56.103+0000 7f1039725800 1 build_initial for_mkfs: 0 2024-09-14T11:15:56.458 INFO:tasks.workunit.client.0.smithi050.stderr: -306> 2024-09-14T11:15:56.103+0000 7f1039725800 10 monclient: monmap: 2024-09-14T11:15:56.458 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:15:56.458 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:56.458 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:15:56.458 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:15:56.458 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:56.458 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.458 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:15:56.458 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:15:56.458 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:15:56.458 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.458 INFO:tasks.workunit.client.0.smithi050.stderr: -305> 2024-09-14T11:15:56.103+0000 7f1034bad640 10 monclient: get_auth_request con 0x7f0f10077140 auth_method 0 2024-09-14T11:15:56.458 INFO:tasks.workunit.client.0.smithi050.stderr: -304> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding auth protocol: cephx 2024-09-14T11:15:56.459 INFO:tasks.workunit.client.0.smithi050.stderr: -303> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding auth protocol: cephx 2024-09-14T11:15:56.459 INFO:tasks.workunit.client.0.smithi050.stderr: -302> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding auth protocol: cephx 2024-09-14T11:15:56.459 INFO:tasks.workunit.client.0.smithi050.stderr: -301> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding con mode: secure 2024-09-14T11:15:56.459 INFO:tasks.workunit.client.0.smithi050.stderr: -300> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding con mode: crc 2024-09-14T11:15:56.459 INFO:tasks.workunit.client.0.smithi050.stderr: -299> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding con mode: secure 2024-09-14T11:15:56.459 INFO:tasks.workunit.client.0.smithi050.stderr: -298> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding con mode: crc 2024-09-14T11:15:56.459 INFO:tasks.workunit.client.0.smithi050.stderr: -297> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding con mode: secure 2024-09-14T11:15:56.459 INFO:tasks.workunit.client.0.smithi050.stderr: -296> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding con mode: crc 2024-09-14T11:15:56.459 INFO:tasks.workunit.client.0.smithi050.stderr: -295> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding con mode: crc 2024-09-14T11:15:56.459 INFO:tasks.workunit.client.0.smithi050.stderr: -294> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding con mode: secure 2024-09-14T11:15:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -293> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding con mode: crc 2024-09-14T11:15:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -292> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding con mode: secure 2024-09-14T11:15:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -291> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding con mode: crc 2024-09-14T11:15:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -290> 2024-09-14T11:15:56.103+0000 7f1039725800 5 AuthRegistry(0x55a1aaab6c40) adding con mode: secure 2024-09-14T11:15:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -289> 2024-09-14T11:15:56.103+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -288> 2024-09-14T11:15:56.104+0000 7f1039725800 10 monclient: init 2024-09-14T11:15:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -287> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding auth protocol: cephx 2024-09-14T11:15:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -286> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding auth protocol: cephx 2024-09-14T11:15:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -285> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding auth protocol: cephx 2024-09-14T11:15:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -284> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding con mode: secure 2024-09-14T11:15:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -283> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding con mode: crc 2024-09-14T11:15:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -282> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding con mode: secure 2024-09-14T11:15:56.460 INFO:tasks.workunit.client.0.smithi050.stderr: -281> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding con mode: crc 2024-09-14T11:15:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -280> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding con mode: secure 2024-09-14T11:15:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -279> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding con mode: crc 2024-09-14T11:15:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -278> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding con mode: crc 2024-09-14T11:15:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -277> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding con mode: secure 2024-09-14T11:15:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -276> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding con mode: crc 2024-09-14T11:15:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -275> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding con mode: secure 2024-09-14T11:15:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -274> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding con mode: crc 2024-09-14T11:15:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -273> 2024-09-14T11:15:56.104+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351450) adding con mode: secure 2024-09-14T11:15:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -272> 2024-09-14T11:15:56.104+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -271> 2024-09-14T11:15:56.104+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -270> 2024-09-14T11:15:56.104+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command rotate-key cmddesc rotate-key hook 0x7ffe7d351598 EEXIST 2024-09-14T11:15:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -269> 2024-09-14T11:15:56.104+0000 7f1039725800 10 monclient: _reopen_session rank -1 2024-09-14T11:15:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -268> 2024-09-14T11:15:56.104+0000 7f1039725800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:15:56.461 INFO:tasks.workunit.client.0.smithi050.stderr: -267> 2024-09-14T11:15:56.104+0000 7f1039725800 10 monclient(hunting): picked mon.noname-b con 0x55a1aaaeb2a0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:15:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -266> 2024-09-14T11:15:56.104+0000 7f1039725800 10 monclient(hunting): picked mon.noname-c con 0x55a1aaabc2b0 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:15:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -265> 2024-09-14T11:15:56.104+0000 7f1039725800 10 monclient(hunting): picked mon.noname-a con 0x55a1aaae6780 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:15:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -264> 2024-09-14T11:15:56.104+0000 7f1039725800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -263> 2024-09-14T11:15:56.104+0000 7f1039725800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -262> 2024-09-14T11:15:56.104+0000 7f1039725800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -261> 2024-09-14T11:15:56.104+0000 7f1039725800 10 monclient(hunting): _renew_subs 2024-09-14T11:15:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -260> 2024-09-14T11:15:56.104+0000 7f1039725800 10 monclient(hunting): authenticate will time out at 2608.741695s 2024-09-14T11:15:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -259> 2024-09-14T11:15:56.104+0000 7f1035baf640 10 monclient(hunting): get_auth_request con 0x55a1aaae6780 auth_method 0 2024-09-14T11:15:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -258> 2024-09-14T11:15:56.104+0000 7f1035baf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -257> 2024-09-14T11:15:56.104+0000 7f1035baf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -256> 2024-09-14T11:15:56.104+0000 7f1035baf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -255> 2024-09-14T11:15:56.104+0000 7f1034bad640 10 monclient(hunting): get_auth_request con 0x55a1aaabc2b0 auth_method 0 2024-09-14T11:15:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -254> 2024-09-14T11:15:56.104+0000 7f1034bad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:56.462 INFO:tasks.workunit.client.0.smithi050.stderr: -253> 2024-09-14T11:15:56.104+0000 7f1034bad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:56.463 INFO:tasks.workunit.client.0.smithi050.stderr: -252> 2024-09-14T11:15:56.104+0000 7f1034bad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:56.463 INFO:tasks.workunit.client.0.smithi050.stderr: -251> 2024-09-14T11:15:56.104+0000 7f10353ae640 10 monclient(hunting): get_auth_request con 0x55a1aaaeb2a0 auth_method 0 2024-09-14T11:15:56.463 INFO:tasks.workunit.client.0.smithi050.stderr: -250> 2024-09-14T11:15:56.104+0000 7f10353ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:56.463 INFO:tasks.workunit.client.0.smithi050.stderr: -249> 2024-09-14T11:15:56.104+0000 7f10353ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:56.463 INFO:tasks.workunit.client.0.smithi050.stderr: -248> 2024-09-14T11:15:56.104+0000 7f10353ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:56.463 INFO:tasks.workunit.client.0.smithi050.stderr: -247> 2024-09-14T11:15:56.104+0000 7f1035baf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:56.463 INFO:tasks.workunit.client.0.smithi050.stderr: -246> 2024-09-14T11:15:56.104+0000 7f1035baf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:56.463 INFO:tasks.workunit.client.0.smithi050.stderr: -245> 2024-09-14T11:15:56.104+0000 7f1035baf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:56.463 INFO:tasks.workunit.client.0.smithi050.stderr: -244> 2024-09-14T11:15:56.104+0000 7f1034bad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:56.463 INFO:tasks.workunit.client.0.smithi050.stderr: -243> 2024-09-14T11:15:56.104+0000 7f1034bad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:56.463 INFO:tasks.workunit.client.0.smithi050.stderr: -242> 2024-09-14T11:15:56.104+0000 7f1034bad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:56.463 INFO:tasks.workunit.client.0.smithi050.stderr: -241> 2024-09-14T11:15:56.104+0000 7f10353ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:56.463 INFO:tasks.workunit.client.0.smithi050.stderr: -240> 2024-09-14T11:15:56.104+0000 7f10353ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:56.463 INFO:tasks.workunit.client.0.smithi050.stderr: -239> 2024-09-14T11:15:56.104+0000 7f10353ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:56.464 INFO:tasks.workunit.client.0.smithi050.stderr: -238> 2024-09-14T11:15:56.105+0000 7f1035baf640 10 monclient(hunting): handle_auth_done global_id 8436 payload 274 2024-09-14T11:15:56.464 INFO:tasks.workunit.client.0.smithi050.stderr: -237> 2024-09-14T11:15:56.105+0000 7f1035baf640 10 monclient: _finish_hunting 0 2024-09-14T11:15:56.464 INFO:tasks.workunit.client.0.smithi050.stderr: -236> 2024-09-14T11:15:56.105+0000 7f1035baf640 1 monclient: found mon.noname-a 2024-09-14T11:15:56.464 INFO:tasks.workunit.client.0.smithi050.stderr: -235> 2024-09-14T11:15:56.105+0000 7f1035baf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.50:3300/0 2024-09-14T11:15:56.464 INFO:tasks.workunit.client.0.smithi050.stderr: -234> 2024-09-14T11:15:56.105+0000 7f0f18ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:56.464 INFO:tasks.workunit.client.0.smithi050.stderr: -233> 2024-09-14T11:15:56.105+0000 7f0f18ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:56.464 INFO:tasks.workunit.client.0.smithi050.stderr: -232> 2024-09-14T11:15:56.105+0000 7f0f18ff9640 10 monclient: dump: 2024-09-14T11:15:56.464 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:56.464 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:56.464 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.464 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.464 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:56.465 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.465 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:56.465 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:56.465 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:56.465 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.465 INFO:tasks.workunit.client.0.smithi050.stderr: -231> 2024-09-14T11:15:56.105+0000 7f0f18ff9640 10 monclient: _finish_auth 0 2024-09-14T11:15:56.465 INFO:tasks.workunit.client.0.smithi050.stderr: -230> 2024-09-14T11:15:56.105+0000 7f0f18ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:15:56.465 INFO:tasks.workunit.client.0.smithi050.stderr: -229> 2024-09-14T11:15:56.105+0000 7f0f18ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:56.465 INFO:tasks.workunit.client.0.smithi050.stderr: -228> 2024-09-14T11:15:56.105+0000 7f0f18ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:56.465 INFO:tasks.workunit.client.0.smithi050.stderr: -227> 2024-09-14T11:15:56.105+0000 7f0f18ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:56.465 INFO:tasks.workunit.client.0.smithi050.stderr: -226> 2024-09-14T11:15:56.105+0000 7f0f18ff9640 10 monclient: dump: 2024-09-14T11:15:56.465 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:56.465 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:56.465 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.466 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.466 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:56.466 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.466 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:56.466 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:56.466 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:56.466 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.466 INFO:tasks.workunit.client.0.smithi050.stderr: -225> 2024-09-14T11:15:56.105+0000 7f1039725800 5 monclient: authenticate success, global_id 8436 2024-09-14T11:15:56.466 INFO:tasks.workunit.client.0.smithi050.stderr: -224> 2024-09-14T11:15:56.105+0000 7f1039725800 10 monclient: get_monmap_and_config success 2024-09-14T11:15:56.466 INFO:tasks.workunit.client.0.smithi050.stderr: -223> 2024-09-14T11:15:56.105+0000 7f1039725800 4 set_mon_vals no callback set 2024-09-14T11:15:56.466 INFO:tasks.workunit.client.0.smithi050.stderr: -222> 2024-09-14T11:15:56.105+0000 7f1039725800 10 monclient: shutdown 2024-09-14T11:15:56.466 INFO:tasks.workunit.client.0.smithi050.stderr: -221> 2024-09-14T11:15:56.106+0000 7f1039725800 10 monclient: build_initial_monmap 2024-09-14T11:15:56.466 INFO:tasks.workunit.client.0.smithi050.stderr: -220> 2024-09-14T11:15:56.106+0000 7f1039725800 1 build_initial for_mkfs: 0 2024-09-14T11:15:56.466 INFO:tasks.workunit.client.0.smithi050.stderr: -219> 2024-09-14T11:15:56.106+0000 7f1039725800 10 monclient: monmap: 2024-09-14T11:15:56.466 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 0 2024-09-14T11:15:56.467 INFO:tasks.workunit.client.0.smithi050.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:56.467 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 0.000000 2024-09-14T11:15:56.467 INFO:tasks.workunit.client.0.smithi050.stderr:created 0.000000 2024-09-14T11:15:56.467 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:56.467 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.467 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.noname-a 2024-09-14T11:15:56.467 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.noname-b 2024-09-14T11:15:56.467 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.noname-c 2024-09-14T11:15:56.467 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.467 INFO:tasks.workunit.client.0.smithi050.stderr: -218> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding auth protocol: cephx 2024-09-14T11:15:56.467 INFO:tasks.workunit.client.0.smithi050.stderr: -217> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding auth protocol: cephx 2024-09-14T11:15:56.467 INFO:tasks.workunit.client.0.smithi050.stderr: -216> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding auth protocol: cephx 2024-09-14T11:15:56.467 INFO:tasks.workunit.client.0.smithi050.stderr: -215> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding con mode: secure 2024-09-14T11:15:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -214> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding con mode: crc 2024-09-14T11:15:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -213> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding con mode: secure 2024-09-14T11:15:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -212> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding con mode: crc 2024-09-14T11:15:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -211> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding con mode: secure 2024-09-14T11:15:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -210> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding con mode: crc 2024-09-14T11:15:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -209> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding con mode: crc 2024-09-14T11:15:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -208> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding con mode: secure 2024-09-14T11:15:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -207> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding con mode: crc 2024-09-14T11:15:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -206> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding con mode: secure 2024-09-14T11:15:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -205> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding con mode: crc 2024-09-14T11:15:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -204> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaadba90) adding con mode: secure 2024-09-14T11:15:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -203> 2024-09-14T11:15:56.106+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -202> 2024-09-14T11:15:56.106+0000 7f1039725800 1 librados: starting msgr at 2024-09-14T11:15:56.468 INFO:tasks.workunit.client.0.smithi050.stderr: -201> 2024-09-14T11:15:56.106+0000 7f1039725800 1 librados: starting objecter 2024-09-14T11:15:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -200> 2024-09-14T11:15:56.106+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command objecter_requests cmddesc objecter_requests hook 0x55a1aaae6bc0 EEXIST 2024-09-14T11:15:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -199> 2024-09-14T11:15:56.106+0000 7f1039725800 1 librados: setting wanted keys 2024-09-14T11:15:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -198> 2024-09-14T11:15:56.106+0000 7f1039725800 1 librados: calling monclient init 2024-09-14T11:15:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -197> 2024-09-14T11:15:56.106+0000 7f1039725800 10 monclient: init 2024-09-14T11:15:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -196> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding auth protocol: cephx 2024-09-14T11:15:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -195> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding auth protocol: cephx 2024-09-14T11:15:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -194> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding auth protocol: cephx 2024-09-14T11:15:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -193> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding con mode: secure 2024-09-14T11:15:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -192> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding con mode: crc 2024-09-14T11:15:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -191> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding con mode: secure 2024-09-14T11:15:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -190> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding con mode: crc 2024-09-14T11:15:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -189> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding con mode: secure 2024-09-14T11:15:56.469 INFO:tasks.workunit.client.0.smithi050.stderr: -188> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding con mode: crc 2024-09-14T11:15:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -187> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding con mode: crc 2024-09-14T11:15:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -186> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding con mode: secure 2024-09-14T11:15:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -185> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding con mode: crc 2024-09-14T11:15:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -184> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding con mode: secure 2024-09-14T11:15:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -183> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding con mode: crc 2024-09-14T11:15:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -182> 2024-09-14T11:15:56.106+0000 7f1039725800 5 AuthRegistry(0x55a1aaaab7f0) adding con mode: secure 2024-09-14T11:15:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -181> 2024-09-14T11:15:56.106+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -180> 2024-09-14T11:15:56.107+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -179> 2024-09-14T11:15:56.107+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command rotate-key cmddesc rotate-key hook 0x55a1aaaab938 EEXIST 2024-09-14T11:15:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -178> 2024-09-14T11:15:56.107+0000 7f1039725800 10 monclient: _reopen_session rank -1 2024-09-14T11:15:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -177> 2024-09-14T11:15:56.107+0000 7f1039725800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:15:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -176> 2024-09-14T11:15:56.107+0000 7f1039725800 10 monclient(hunting): picked mon.noname-a con 0x55a1aaabc2b0 addr [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] 2024-09-14T11:15:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -175> 2024-09-14T11:15:56.107+0000 7f1039725800 10 monclient(hunting): picked mon.noname-c con 0x55a1aaae6780 addr [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] 2024-09-14T11:15:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -174> 2024-09-14T11:15:56.107+0000 7f1039725800 10 monclient(hunting): picked mon.noname-b con 0x55a1aaaeb2a0 addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-14T11:15:56.470 INFO:tasks.workunit.client.0.smithi050.stderr: -173> 2024-09-14T11:15:56.107+0000 7f1039725800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -172> 2024-09-14T11:15:56.107+0000 7f1039725800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -171> 2024-09-14T11:15:56.107+0000 7f1039725800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -170> 2024-09-14T11:15:56.107+0000 7f1039725800 10 monclient(hunting): _renew_subs 2024-09-14T11:15:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -169> 2024-09-14T11:15:56.107+0000 7f1039725800 10 monclient(hunting): authenticate will time out at 2608.744144s 2024-09-14T11:15:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -168> 2024-09-14T11:15:56.107+0000 7f10353ae640 10 monclient(hunting): get_auth_request con 0x55a1aaabc2b0 auth_method 0 2024-09-14T11:15:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -167> 2024-09-14T11:15:56.107+0000 7f10353ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -166> 2024-09-14T11:15:56.107+0000 7f10353ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -165> 2024-09-14T11:15:56.107+0000 7f10353ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -164> 2024-09-14T11:15:56.107+0000 7f1034bad640 10 monclient(hunting): get_auth_request con 0x55a1aaae6780 auth_method 0 2024-09-14T11:15:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -163> 2024-09-14T11:15:56.107+0000 7f1034bad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -162> 2024-09-14T11:15:56.107+0000 7f1034bad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -161> 2024-09-14T11:15:56.107+0000 7f1034bad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -160> 2024-09-14T11:15:56.107+0000 7f1034bad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:56.471 INFO:tasks.workunit.client.0.smithi050.stderr: -159> 2024-09-14T11:15:56.107+0000 7f1034bad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:56.472 INFO:tasks.workunit.client.0.smithi050.stderr: -158> 2024-09-14T11:15:56.107+0000 7f1034bad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:56.472 INFO:tasks.workunit.client.0.smithi050.stderr: -157> 2024-09-14T11:15:56.107+0000 7f1035baf640 10 monclient(hunting): get_auth_request con 0x55a1aaaeb2a0 auth_method 0 2024-09-14T11:15:56.472 INFO:tasks.workunit.client.0.smithi050.stderr: -156> 2024-09-14T11:15:56.107+0000 7f1035baf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:56.472 INFO:tasks.workunit.client.0.smithi050.stderr: -155> 2024-09-14T11:15:56.107+0000 7f1035baf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:56.472 INFO:tasks.workunit.client.0.smithi050.stderr: -154> 2024-09-14T11:15:56.107+0000 7f1035baf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:56.472 INFO:tasks.workunit.client.0.smithi050.stderr: -153> 2024-09-14T11:15:56.107+0000 7f10353ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:56.472 INFO:tasks.workunit.client.0.smithi050.stderr: -152> 2024-09-14T11:15:56.107+0000 7f10353ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:56.472 INFO:tasks.workunit.client.0.smithi050.stderr: -151> 2024-09-14T11:15:56.107+0000 7f10353ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:56.472 INFO:tasks.workunit.client.0.smithi050.stderr: -150> 2024-09-14T11:15:56.107+0000 7f1035baf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:56.472 INFO:tasks.workunit.client.0.smithi050.stderr: -149> 2024-09-14T11:15:56.107+0000 7f1035baf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:56.472 INFO:tasks.workunit.client.0.smithi050.stderr: -148> 2024-09-14T11:15:56.107+0000 7f1035baf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:56.472 INFO:tasks.workunit.client.0.smithi050.stderr: -147> 2024-09-14T11:15:56.107+0000 7f1034bad640 10 monclient(hunting): handle_auth_done global_id 7865 payload 824 2024-09-14T11:15:56.472 INFO:tasks.workunit.client.0.smithi050.stderr: -146> 2024-09-14T11:15:56.107+0000 7f1034bad640 10 monclient: _finish_hunting 0 2024-09-14T11:15:56.473 INFO:tasks.workunit.client.0.smithi050.stderr: -145> 2024-09-14T11:15:56.107+0000 7f1034bad640 1 monclient: found mon.noname-c 2024-09-14T11:15:56.473 INFO:tasks.workunit.client.0.smithi050.stderr: -144> 2024-09-14T11:15:56.107+0000 7f1034bad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.50:3301/0 2024-09-14T11:15:56.473 INFO:tasks.workunit.client.0.smithi050.stderr: -143> 2024-09-14T11:15:56.107+0000 7f0f06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:56.473 INFO:tasks.workunit.client.0.smithi050.stderr: -142> 2024-09-14T11:15:56.107+0000 7f0f06ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:15:56.473 INFO:tasks.workunit.client.0.smithi050.stderr: -141> 2024-09-14T11:15:56.107+0000 7f0f06ffd640 10 monclient: dump: 2024-09-14T11:15:56.473 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:56.473 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:56.473 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.473 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.473 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:56.473 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.473 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:56.473 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:56.473 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:56.474 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.474 INFO:tasks.workunit.client.0.smithi050.stderr: -140> 2024-09-14T11:15:56.107+0000 7f0f06ffd640 10 monclient: _finish_auth 0 2024-09-14T11:15:56.474 INFO:tasks.workunit.client.0.smithi050.stderr: -139> 2024-09-14T11:15:56.107+0000 7f0f06ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:15:56.474 INFO:tasks.workunit.client.0.smithi050.stderr: -138> 2024-09-14T11:15:56.107+0000 7f0f06ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:56.474 INFO:tasks.workunit.client.0.smithi050.stderr: -137> 2024-09-14T11:15:56.107+0000 7f0f06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:56.474 INFO:tasks.workunit.client.0.smithi050.stderr: -136> 2024-09-14T11:15:56.107+0000 7f0f06ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:15:56.474 INFO:tasks.workunit.client.0.smithi050.stderr: -135> 2024-09-14T11:15:56.107+0000 7f0f06ffd640 10 monclient: dump: 2024-09-14T11:15:56.474 INFO:tasks.workunit.client.0.smithi050.stderr:epoch 1 2024-09-14T11:15:56.474 INFO:tasks.workunit.client.0.smithi050.stderr:fsid b6566dc9-5665-4f7c-861a-3125c3883e3a 2024-09-14T11:15:56.474 INFO:tasks.workunit.client.0.smithi050.stderr:last_changed 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.474 INFO:tasks.workunit.client.0.smithi050.stderr:created 2024-09-14T10:45:36.017992+0000 2024-09-14T11:15:56.474 INFO:tasks.workunit.client.0.smithi050.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:56.474 INFO:tasks.workunit.client.0.smithi050.stderr:election_strategy: 1 2024-09-14T11:15:56.475 INFO:tasks.workunit.client.0.smithi050.stderr:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-14T11:15:56.475 INFO:tasks.workunit.client.0.smithi050.stderr:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-09-14T11:15:56.475 INFO:tasks.workunit.client.0.smithi050.stderr:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-14T11:15:56.475 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.475 INFO:tasks.workunit.client.0.smithi050.stderr: -134> 2024-09-14T11:15:56.107+0000 7f0f18ff9640 4 set_mon_vals no callback set 2024-09-14T11:15:56.475 INFO:tasks.workunit.client.0.smithi050.stderr: -133> 2024-09-14T11:15:56.108+0000 7f1039725800 5 monclient: authenticate success, global_id 7865 2024-09-14T11:15:56.475 INFO:tasks.workunit.client.0.smithi050.stderr: -132> 2024-09-14T11:15:56.108+0000 7f1039725800 10 monclient: _renew_subs 2024-09-14T11:15:56.475 INFO:tasks.workunit.client.0.smithi050.stderr: -131> 2024-09-14T11:15:56.108+0000 7f1039725800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:15:56.475 INFO:tasks.workunit.client.0.smithi050.stderr: -130> 2024-09-14T11:15:56.108+0000 7f1039725800 10 monclient: _renew_subs 2024-09-14T11:15:56.475 INFO:tasks.workunit.client.0.smithi050.stderr: -129> 2024-09-14T11:15:56.108+0000 7f1039725800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:15:56.475 INFO:tasks.workunit.client.0.smithi050.stderr: -128> 2024-09-14T11:15:56.108+0000 7f1039725800 1 librados: init done 2024-09-14T11:15:56.475 INFO:tasks.workunit.client.0.smithi050.stderr: -127> 2024-09-14T11:15:56.108+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command cr dump hook 0x55a1aaae4728 2024-09-14T11:15:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -126> 2024-09-14T11:15:56.109+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -125> 2024-09-14T11:15:56.110+0000 7f0f06ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:15:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -124> 2024-09-14T11:15:56.110+0000 7f0f06ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:15:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -123> 2024-09-14T11:15:56.110+0000 7f0f06ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.118:6824/3146386534,v1:172.21.15.118:6825/3146386534] 2024-09-14T11:15:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -122> 2024-09-14T11:15:56.110+0000 7f10353ae640 10 monclient: get_auth_request con 0x7f0f00077230 auth_method 0 2024-09-14T11:15:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -121> 2024-09-14T11:15:56.111+0000 7f1035baf640 10 monclient: get_auth_request con 0x55a1aab05620 auth_method 0 2024-09-14T11:15:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -120> 2024-09-14T11:15:56.111+0000 7f1039725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -119> 2024-09-14T11:15:56.111+0000 7f1039725800 20 realm 2024-09-14T11:15:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -118> 2024-09-14T11:15:56.111+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -117> 2024-09-14T11:15:56.111+0000 7f1039725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -116> 2024-09-14T11:15:56.111+0000 7f1039725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -115> 2024-09-14T11:15:56.111+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -114> 2024-09-14T11:15:56.112+0000 7f1039725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.476 INFO:tasks.workunit.client.0.smithi050.stderr: -113> 2024-09-14T11:15:56.112+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -112> 2024-09-14T11:15:56.112+0000 7f10353ae640 10 monclient: get_auth_request con 0x55a1aab09830 auth_method 0 2024-09-14T11:15:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -111> 2024-09-14T11:15:56.112+0000 7f1039725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -110> 2024-09-14T11:15:56.112+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -109> 2024-09-14T11:15:56.113+0000 7f1034bad640 10 monclient: get_auth_request con 0x55a1aab0d0b0 auth_method 0 2024-09-14T11:15:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -108> 2024-09-14T11:15:56.113+0000 7f1039725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -107> 2024-09-14T11:15:56.113+0000 7f1039725800 20 searching for the correct realm 2024-09-14T11:15:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -106> 2024-09-14T11:15:56.114+0000 7f1035baf640 10 monclient: get_auth_request con 0x55a1aab11e70 auth_method 0 2024-09-14T11:15:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -105> 2024-09-14T11:15:56.114+0000 7f10353ae640 10 monclient: get_auth_request con 0x7f1030004040 auth_method 0 2024-09-14T11:15:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -104> 2024-09-14T11:15:56.116+0000 7f1034bad640 10 monclient: get_auth_request con 0x7f103002f040 auth_method 0 2024-09-14T11:15:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -103> 2024-09-14T11:15:56.116+0000 7f1034bad640 0 -- 172.21.15.50:0/1467493040 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f103002f040 msgr2=0x7f1030023910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:15:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -102> 2024-09-14T11:15:56.317+0000 7f1034bad640 10 monclient: get_auth_request con 0x7f103002f040 auth_method 0 2024-09-14T11:15:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -101> 2024-09-14T11:15:56.319+0000 7f1035baf640 10 monclient: get_auth_request con 0x7f10280acf80 auth_method 0 2024-09-14T11:15:56.477 INFO:tasks.workunit.client.0.smithi050.stderr: -100> 2024-09-14T11:15:56.320+0000 7f10353ae640 10 monclient: get_auth_request con 0x7f1030041920 auth_method 0 2024-09-14T11:15:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -99> 2024-09-14T11:15:56.321+0000 7f1035baf640 0 -- 172.21.15.50:0/1467493040 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55a1aab05620 msgr2=0x55a1aab07ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -98> 2024-09-14T11:15:56.321+0000 7f0f06ffd640 1 client.7865.objecter ms_handle_reset 0x55a1aab05620 session 0x55a1aab04f50 osd.6 2024-09-14T11:15:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -97> 2024-09-14T11:15:56.322+0000 7f0f06ffd640 10 monclient: _renew_subs 2024-09-14T11:15:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -96> 2024-09-14T11:15:56.322+0000 7f0f06ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.50:3301/0 2024-09-14T11:15:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -95> 2024-09-14T11:15:56.322+0000 7f1035baf640 10 monclient: get_auth_request con 0x7f0f000874e0 auth_method 0 2024-09-14T11:15:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -94> 2024-09-14T11:15:56.326+0000 7f1039725800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:15:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -93> 2024-09-14T11:15:56.326+0000 7f1039725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -92> 2024-09-14T11:15:56.326+0000 7f1039725800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:15:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -91> 2024-09-14T11:15:56.326+0000 7f1039725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -90> 2024-09-14T11:15:56.326+0000 7f1039725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -89> 2024-09-14T11:15:56.326+0000 7f1039725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -88> 2024-09-14T11:15:56.326+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -87> 2024-09-14T11:15:56.326+0000 7f1039725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.478 INFO:tasks.workunit.client.0.smithi050.stderr: -86> 2024-09-14T11:15:56.326+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -85> 2024-09-14T11:15:56.326+0000 7f1039725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -84> 2024-09-14T11:15:56.326+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -83> 2024-09-14T11:15:56.327+0000 7f1039725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -82> 2024-09-14T11:15:56.327+0000 7f1039725800 20 zone default found 2024-09-14T11:15:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -81> 2024-09-14T11:15:56.327+0000 7f1039725800 4 Realm: () 2024-09-14T11:15:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -80> 2024-09-14T11:15:56.327+0000 7f1039725800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:15:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -79> 2024-09-14T11:15:56.327+0000 7f1039725800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:15:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -78> 2024-09-14T11:15:56.327+0000 7f1039725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -77> 2024-09-14T11:15:56.327+0000 7f1039725800 20 zonegroup default 2024-09-14T11:15:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -76> 2024-09-14T11:15:56.327+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -75> 2024-09-14T11:15:56.327+0000 7f1039725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -74> 2024-09-14T11:15:56.327+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -73> 2024-09-14T11:15:56.327+0000 7f1039725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -72> 2024-09-14T11:15:56.327+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -71> 2024-09-14T11:15:56.328+0000 7f1039725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.479 INFO:tasks.workunit.client.0.smithi050.stderr: -70> 2024-09-14T11:15:56.328+0000 7f1039725800 20 started sync module instance, tier type = 2024-09-14T11:15:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -69> 2024-09-14T11:15:56.328+0000 7f1039725800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:15:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -68> 2024-09-14T11:15:56.337+0000 7f1039725800 20 add_watcher() i=0 2024-09-14T11:15:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -67> 2024-09-14T11:15:56.337+0000 7f1039725800 20 add_watcher() i=1 2024-09-14T11:15:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -66> 2024-09-14T11:15:56.337+0000 7f1039725800 20 add_watcher() i=2 2024-09-14T11:15:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -65> 2024-09-14T11:15:56.337+0000 7f1039725800 20 add_watcher() i=3 2024-09-14T11:15:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -64> 2024-09-14T11:15:56.337+0000 7f1039725800 20 add_watcher() i=4 2024-09-14T11:15:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -63> 2024-09-14T11:15:56.337+0000 7f1039725800 20 add_watcher() i=5 2024-09-14T11:15:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -62> 2024-09-14T11:15:56.337+0000 7f1039725800 20 add_watcher() i=6 2024-09-14T11:15:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -61> 2024-09-14T11:15:56.338+0000 7f1039725800 20 add_watcher() i=7 2024-09-14T11:15:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -60> 2024-09-14T11:15:56.338+0000 7f1039725800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -59> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding auth protocol: cephx 2024-09-14T11:15:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -58> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding auth protocol: cephx 2024-09-14T11:15:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -57> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding auth protocol: cephx 2024-09-14T11:15:56.480 INFO:tasks.workunit.client.0.smithi050.stderr: -56> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding con mode: secure 2024-09-14T11:15:56.481 INFO:tasks.workunit.client.0.smithi050.stderr: -55> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding con mode: crc 2024-09-14T11:15:56.481 INFO:tasks.workunit.client.0.smithi050.stderr: -54> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding con mode: secure 2024-09-14T11:15:56.481 INFO:tasks.workunit.client.0.smithi050.stderr: -53> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding con mode: crc 2024-09-14T11:15:56.481 INFO:tasks.workunit.client.0.smithi050.stderr: -52> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding con mode: secure 2024-09-14T11:15:56.481 INFO:tasks.workunit.client.0.smithi050.stderr: -51> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding con mode: crc 2024-09-14T11:15:56.481 INFO:tasks.workunit.client.0.smithi050.stderr: -50> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding con mode: crc 2024-09-14T11:15:56.481 INFO:tasks.workunit.client.0.smithi050.stderr: -49> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding con mode: secure 2024-09-14T11:15:56.481 INFO:tasks.workunit.client.0.smithi050.stderr: -48> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding con mode: crc 2024-09-14T11:15:56.481 INFO:tasks.workunit.client.0.smithi050.stderr: -47> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding con mode: secure 2024-09-14T11:15:56.481 INFO:tasks.workunit.client.0.smithi050.stderr: -46> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding con mode: crc 2024-09-14T11:15:56.481 INFO:tasks.workunit.client.0.smithi050.stderr: -45> 2024-09-14T11:15:56.340+0000 7f1039725800 5 AuthRegistry(0x7ffe7d351930) adding con mode: secure 2024-09-14T11:15:56.481 INFO:tasks.workunit.client.0.smithi050.stderr: -44> 2024-09-14T11:15:56.340+0000 7f0eeb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:56.482 INFO:tasks.workunit.client.0.smithi050.stderr: -43> 2024-09-14T11:15:56.340+0000 7f1039725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:56.482 INFO:tasks.workunit.client.0.smithi050.stderr: -42> 2024-09-14T11:15:56.340+0000 7f1039725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:56.482 INFO:tasks.workunit.client.0.smithi050.stderr: -41> 2024-09-14T11:15:56.340+0000 7f1039725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:56.482 INFO:tasks.workunit.client.0.smithi050.stderr: -40> 2024-09-14T11:15:56.340+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command cache list hook 0x55a1aaab7c80 2024-09-14T11:15:56.482 INFO:tasks.workunit.client.0.smithi050.stderr: -39> 2024-09-14T11:15:56.340+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command cache inspect hook 0x55a1aaab7c80 2024-09-14T11:15:56.482 INFO:tasks.workunit.client.0.smithi050.stderr: -38> 2024-09-14T11:15:56.340+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command cache erase hook 0x55a1aaab7c80 2024-09-14T11:15:56.482 INFO:tasks.workunit.client.0.smithi050.stderr: -37> 2024-09-14T11:15:56.340+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command cache zap hook 0x55a1aaab7c80 2024-09-14T11:15:56.482 INFO:tasks.workunit.client.0.smithi050.stderr: -36> 2024-09-14T11:15:56.340+0000 7f1039725800 5 note: GC not initialized 2024-09-14T11:15:56.482 INFO:tasks.workunit.client.0.smithi050.stderr: -35> 2024-09-14T11:15:56.340+0000 7f0eea7e4640 20 reqs_thread_entry: start 2024-09-14T11:15:56.482 INFO:tasks.workunit.client.0.smithi050.stderr: -34> 2024-09-14T11:15:56.341+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command sync trace show hook 0x7f1030004ac0 2024-09-14T11:15:56.482 INFO:tasks.workunit.client.0.smithi050.stderr: -33> 2024-09-14T11:15:56.341+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command sync trace history hook 0x7f1030004ac0 2024-09-14T11:15:56.482 INFO:tasks.workunit.client.0.smithi050.stderr: -32> 2024-09-14T11:15:56.341+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command sync trace active hook 0x7f1030004ac0 2024-09-14T11:15:56.482 INFO:tasks.workunit.client.0.smithi050.stderr: -31> 2024-09-14T11:15:56.341+0000 7f1039725800 5 asok(0x55a1aa7f8270) register_command sync trace active_short hook 0x7f1030004ac0 2024-09-14T11:15:56.482 INFO:tasks.workunit.client.0.smithi050.stderr: -30> 2024-09-14T11:15:56.341+0000 7f1039725800 20 init_complete bucket index max shards: 11 2024-09-14T11:15:56.482 INFO:tasks.workunit.client.0.smithi050.stderr: -29> 2024-09-14T11:15:56.341+0000 7f1039725800 20 Filter name: none 2024-09-14T11:15:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -28> 2024-09-14T11:15:56.341+0000 7f0e5bfff640 20 reqs_thread_entry: start 2024-09-14T11:15:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -27> 2024-09-14T11:15:56.341+0000 7f1039725800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:15:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -26> 2024-09-14T11:15:56.341+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -25> 2024-09-14T11:15:56.341+0000 7f1039725800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:15:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -24> 2024-09-14T11:15:56.341+0000 7f1039725800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:15:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -23> 2024-09-14T11:15:56.341+0000 7f1039725800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:15:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -22> 2024-09-14T11:15:56.341+0000 7f1039725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : miss 2024-09-14T11:15:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -21> 2024-09-14T11:15:56.341+0000 7f1039725800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -20> 2024-09-14T11:15:56.342+0000 7f1039725800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:15:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -19> 2024-09-14T11:15:56.342+0000 7f1039725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:15:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -18> 2024-09-14T11:15:56.342+0000 7f1039725800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:15:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -17> 2024-09-14T11:15:56.342+0000 7f1039725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -16> 2024-09-14T11:15:56.342+0000 7f1039725800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:56.483 INFO:tasks.workunit.client.0.smithi050.stderr: -15> 2024-09-14T11:15:56.342+0000 7f1039725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:15:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -14> 2024-09-14T11:15:56.343+0000 7f1039725800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:15:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -13> 2024-09-14T11:15:56.351+0000 7f1039725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:15:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -12> 2024-09-14T11:15:56.351+0000 7f1039725800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:15:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -11> 2024-09-14T11:15:56.351+0000 7f1039725800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -10> 2024-09-14T11:15:56.351+0000 7f1039725800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18, ofs0, ns] 2024-09-14T11:15:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -9> 2024-09-14T11:15:56.351+0000 7f0f18ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497135 cookie 94152841851104 notifier 7865 bl.length()=911 2024-09-14T11:15:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -8> 2024-09-14T11:15:56.351+0000 7f0f18ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:15:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -7> 2024-09-14T11:15:56.351+0000 7f0f18ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:15:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -6> 2024-09-14T11:15:56.351+0000 7f0f18ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -5> 2024-09-14T11:15:56.353+0000 7f1039725800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_sources= new_sources= 2024-09-14T11:15:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -4> 2024-09-14T11:15:56.353+0000 7f1039725800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential sources added=[] removed=[] 2024-09-14T11:15:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -3> 2024-09-14T11:15:56.353+0000 7f1039725800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_dests= new_dests= 2024-09-14T11:15:56.484 INFO:tasks.workunit.client.0.smithi050.stderr: -2> 2024-09-14T11:15:56.353+0000 7f1039725800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential dests added=[] removed=[] 2024-09-14T11:15:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: -1> 2024-09-14T11:15:56.358+0000 7f1039725800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1039725800 time 2024-09-14T11:15:56.358614+0000 2024-09-14T11:15:56.485 INFO:tasks.workunit.client.0.smithi050.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:15:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f103ad8c76a] 2024-09-14T11:15:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f103ad8c928] 2024-09-14T11:15:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a1a85830b1] 2024-09-14T11:15:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a1a8592f6a] 2024-09-14T11:15:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: 5: main() 2024-09-14T11:15:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f1039a29590] 2024-09-14T11:15:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: 7: __libc_start_main() 2024-09-14T11:15:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: 8: _start() 2024-09-14T11:15:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.485 INFO:tasks.workunit.client.0.smithi050.stderr: 0> 2024-09-14T11:15:56.359+0000 7f1039725800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:15:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: in thread 7f1039725800 thread_name:radosgw-admin 2024-09-14T11:15:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1039a3e6f0] 2024-09-14T11:15:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1039a8b99c] 2024-09-14T11:15:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: 3: raise() 2024-09-14T11:15:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: 4: abort() 2024-09-14T11:15:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f103ad8c7c4] 2024-09-14T11:15:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f103ad8c928] 2024-09-14T11:15:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a1a85830b1] 2024-09-14T11:15:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a1a8592f6a] 2024-09-14T11:15:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: 9: main() 2024-09-14T11:15:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f1039a29590] 2024-09-14T11:15:56.486 INFO:tasks.workunit.client.0.smithi050.stderr: 11: __libc_start_main() 2024-09-14T11:15:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: 12: _start() 2024-09-14T11:15:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:15:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:15:56.487 INFO:tasks.workunit.client.0.smithi050.stderr:--- logging levels --- 2024-09-14T11:15:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 none 2024-09-14T11:15:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 lockdep 2024-09-14T11:15:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 context 2024-09-14T11:15:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 crush 2024-09-14T11:15:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds 2024-09-14T11:15:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_balancer 2024-09-14T11:15:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_locker 2024-09-14T11:15:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log 2024-09-14T11:15:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_log_expire 2024-09-14T11:15:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mds_migrator 2024-09-14T11:15:56.487 INFO:tasks.workunit.client.0.smithi050.stderr: 3/ 5 mds_quiesce 2024-09-14T11:15:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 buffer 2024-09-14T11:15:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 timer 2024-09-14T11:15:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 filer 2024-09-14T11:15:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 striper 2024-09-14T11:15:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 1 objecter 2024-09-14T11:15:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rados 2024-09-14T11:15:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd 2024-09-14T11:15:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_mirror 2024-09-14T11:15:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_replay 2024-09-14T11:15:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 rbd_pwl 2024-09-14T11:15:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 journaler 2024-09-14T11:15:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objectcacher 2024-09-14T11:15:56.488 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:15:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 client 2024-09-14T11:15:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 osd 2024-09-14T11:15:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 optracker 2024-09-14T11:15:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 objclass 2024-09-14T11:15:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 filestore 2024-09-14T11:15:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 journal 2024-09-14T11:15:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 ms 2024-09-14T11:15:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mon 2024-09-14T11:15:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: 0/10 monc 2024-09-14T11:15:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 paxos 2024-09-14T11:15:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 tp 2024-09-14T11:15:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 auth 2024-09-14T11:15:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 crypto 2024-09-14T11:15:56.489 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 finisher 2024-09-14T11:15:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 reserver 2024-09-14T11:15:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 heartbeatmap 2024-09-14T11:15:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 perfcounter 2024-09-14T11:15:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw 2024-09-14T11:15:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_sync 2024-09-14T11:15:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_datacache 2024-09-14T11:15:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_access 2024-09-14T11:15:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:15:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_flight 2024-09-14T11:15:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:15:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: 20/20 rgw_notification 2024-09-14T11:15:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 javaclient 2024-09-14T11:15:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 asok 2024-09-14T11:15:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 1 throttle 2024-09-14T11:15:56.490 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 0 refs 2024-09-14T11:15:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 compressor 2024-09-14T11:15:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluestore 2024-09-14T11:15:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 bluefs 2024-09-14T11:15:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 3 bdev 2024-09-14T11:15:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 kstore 2024-09-14T11:15:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: 4/ 5 rocksdb 2024-09-14T11:15:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 fuse 2024-09-14T11:15:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: 2/ 5 mgr 2024-09-14T11:15:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mgrc 2024-09-14T11:15:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 dpdk 2024-09-14T11:15:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 eventtrace 2024-09-14T11:15:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 prioritycache 2024-09-14T11:15:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 test 2024-09-14T11:15:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:15:56.491 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cephsqlite 2024-09-14T11:15:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:15:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore 2024-09-14T11:15:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_onode 2024-09-14T11:15:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_odata 2024-09-14T11:15:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_omap 2024-09-14T11:15:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_tm 2024-09-14T11:15:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_t 2024-09-14T11:15:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:15:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_epm 2024-09-14T11:15:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_lba 2024-09-14T11:15:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:15:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_cache 2024-09-14T11:15:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_journal 2024-09-14T11:15:56.492 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_device 2024-09-14T11:15:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 seastore_backref 2024-09-14T11:15:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 alienstore 2024-09-14T11:15:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 mclock 2024-09-14T11:15:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 cyanstore 2024-09-14T11:15:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 ceph_exporter 2024-09-14T11:15:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 memstore 2024-09-14T11:15:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: 1/ 5 trace 2024-09-14T11:15:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: 0/ 5 ceph_dedup 2024-09-14T11:15:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: -2/-2 (syslog threshold) 2024-09-14T11:15:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: 99/99 (stderr threshold) 2024-09-14T11:15:56.493 INFO:tasks.workunit.client.0.smithi050.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:15:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: 7f0e5bfff640 / http_manager 2024-09-14T11:15:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: 7f0eea7e4640 / http_manager 2024-09-14T11:15:56.493 INFO:tasks.workunit.client.0.smithi050.stderr: 7f0eeb7e6640 / rgw_dt_lg_renew 2024-09-14T11:15:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: 7f0f06ffd640 / ms_dispatch 2024-09-14T11:15:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: 7f0f18ff9640 / io_context_pool 2024-09-14T11:15:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: 7f0f1affd640 / ms_dispatch 2024-09-14T11:15:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: 7f0f21e03640 / ms_dispatch 2024-09-14T11:15:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: 7f0f23606640 / io_context_pool 2024-09-14T11:15:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1034bad640 / msgr-worker-2 2024-09-14T11:15:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: 7f10353ae640 / msgr-worker-1 2024-09-14T11:15:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1035baf640 / msgr-worker-0 2024-09-14T11:15:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: 7f10363b0640 / io_context_pool 2024-09-14T11:15:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: 7f1039725800 / radosgw-admin 2024-09-14T11:15:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: max_recent 500 2024-09-14T11:15:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: max_new 1000 2024-09-14T11:15:56.494 INFO:tasks.workunit.client.0.smithi050.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:15:56.360025Z_204f8c2e-46de-4d0d-9eaa-b788517ff557/log 2024-09-14T11:15:56.494 INFO:tasks.workunit.client.0.smithi050.stderr:--- end dump of recent events --- 2024-09-14T11:15:56.495 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:15:56.496 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:56.496 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:56.496 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.440+0000 7f4c53728800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.496 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.442+0000 7f4c53728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.496 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.442+0000 7f4c53728800 20 realm 2024-09-14T11:15:56.496 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.442+0000 7f4c53728800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.496 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.442+0000 7f4c53728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.496 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.442+0000 7f4c53728800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:56.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.442+0000 7f4c53728800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.442+0000 7f4c53728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.442+0000 7f4c53728800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.443+0000 7f4c53728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:56.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.443+0000 7f4c53728800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.443+0000 7f4c53728800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:56.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.443+0000 7f4c53728800 20 searching for the correct realm 2024-09-14T11:15:56.497 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.447+0000 7f4c4ec4a640 0 -- 172.21.15.50:0/4014169063 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f4c480b5ac0 msgr2=0x7f4c48056000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:56.651 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.652+0000 7f4c4ec4a640 0 -- 172.21.15.50:0/4014169063 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55cedbf604f0 msgr2=0x55cedbf62990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:56.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.657+0000 7f4c53728800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:15:56.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.657+0000 7f4c53728800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:56.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.657+0000 7f4c53728800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:15:56.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.657+0000 7f4c53728800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:56.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.657+0000 7f4c53728800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:56.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.657+0000 7f4c53728800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:56.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.657+0000 7f4c53728800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.658+0000 7f4c53728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.656 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.658+0000 7f4c53728800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.658+0000 7f4c53728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:56.657 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.658+0000 7f4c53728800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.659+0000 7f4c53728800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:56.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.659+0000 7f4c53728800 20 zone default found 2024-09-14T11:15:56.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.659+0000 7f4c53728800 4 Realm: () 2024-09-14T11:15:56.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.659+0000 7f4c53728800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:15:56.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.659+0000 7f4c53728800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:15:56.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.659+0000 7f4c53728800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:56.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.659+0000 7f4c53728800 20 zonegroup default 2024-09-14T11:15:56.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.659+0000 7f4c53728800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.659+0000 7f4c53728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.659+0000 7f4c53728800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.659+0000 7f4c53728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.659+0000 7f4c53728800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.659+0000 7f4c53728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.658 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.660+0000 7f4c53728800 20 started sync module instance, tier type = 2024-09-14T11:15:56.659 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.660+0000 7f4c53728800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:15:56.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.669+0000 7f4c53728800 20 add_watcher() i=0 2024-09-14T11:15:56.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.669+0000 7f4c53728800 20 add_watcher() i=1 2024-09-14T11:15:56.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.669+0000 7f4c53728800 20 add_watcher() i=2 2024-09-14T11:15:56.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.669+0000 7f4c53728800 20 add_watcher() i=3 2024-09-14T11:15:56.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.669+0000 7f4c53728800 20 add_watcher() i=4 2024-09-14T11:15:56.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.669+0000 7f4c53728800 20 add_watcher() i=5 2024-09-14T11:15:56.667 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.669+0000 7f4c53728800 20 add_watcher() i=6 2024-09-14T11:15:56.668 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.670+0000 7f4c53728800 20 add_watcher() i=7 2024-09-14T11:15:56.668 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.670+0000 7f4c53728800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:56.670 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.672+0000 7f4b05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:56.671 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.672+0000 7f4c53728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:56.671 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.672+0000 7f4c53728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:56.671 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.672+0000 7f4c53728800 5 note: GC not initialized 2024-09-14T11:15:56.671 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.672+0000 7f4b04fe1640 20 reqs_thread_entry: start 2024-09-14T11:15:56.671 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.673+0000 7f4c53728800 20 init_complete bucket index max shards: 11 2024-09-14T11:15:56.671 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.673+0000 7f4c53728800 20 Filter name: none 2024-09-14T11:15:56.671 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.673+0000 7f4a7e7fc640 20 reqs_thread_entry: start 2024-09-14T11:15:56.671 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.673+0000 7f4c53728800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.672 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.673+0000 7f4c53728800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:15:56.672 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.673+0000 7f4c53728800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.672 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.674+0000 7f4c53728800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:15:56.672 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.674+0000 7f4c53728800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:56.672 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.674+0000 7f4c53728800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.674+0000 7f4c53728800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:15:56.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.674+0000 7f4c53728800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.674+0000 7f4c53728800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:15:56.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.674+0000 7f4c53728800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:56.674 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.676+0000 7f4b05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:56.676 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.678+0000 7f4c53728800 20 remove_watcher() i=0 2024-09-14T11:15:56.677 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.679+0000 7f4c53728800 2 removed watcher, disabling cache 2024-09-14T11:15:56.677 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.680+0000 7f4c53728800 20 remove_watcher() i=1 2024-09-14T11:15:56.679 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.681+0000 7f4c53728800 20 remove_watcher() i=2 2024-09-14T11:15:56.680 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.682+0000 7f4c53728800 20 remove_watcher() i=3 2024-09-14T11:15:56.681 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.683+0000 7f4c53728800 20 remove_watcher() i=4 2024-09-14T11:15:56.682 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.684+0000 7f4c53728800 20 remove_watcher() i=5 2024-09-14T11:15:56.683 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.685+0000 7f4c53728800 20 remove_watcher() i=6 2024-09-14T11:15:56.684 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.686+0000 7f4c53728800 20 remove_watcher() i=7 2024-09-14T11:15:56.699 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:56.699 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:15:56.738 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:15:56.768 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:56.768 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:56.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.810+0000 7fb694d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.812+0000 7fb694d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.812+0000 7fb694d26800 20 realm 2024-09-14T11:15:56.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.812+0000 7fb694d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.812+0000 7fb694d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.812+0000 7fb694d26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:56.810 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.812+0000 7fb694d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.811 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.812+0000 7fb694d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:56.811 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.812+0000 7fb694d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.811 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.813+0000 7fb694d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:56.811 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.813+0000 7fb694d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:56.812 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.814+0000 7fb694d26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:56.812 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.814+0000 7fb694d26800 20 searching for the correct realm 2024-09-14T11:15:56.815 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:56.817+0000 7fb6901d8640 0 -- 172.21.15.50:0/4057405866 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fb688068750 msgr2=0x7fb6880820c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:57.020 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.022+0000 7fb6901d8640 0 -- 172.21.15.50:0/4057405866 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55c5eec0d370 msgr2=0x55c5eec0f7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:57.025 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.027+0000 7fb694d26800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:15:57.025 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.027+0000 7fb694d26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:57.025 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.027+0000 7fb694d26800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:15:57.025 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.027+0000 7fb694d26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:57.025 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.027+0000 7fb694d26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:57.025 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.027+0000 7fb694d26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:57.026 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.027+0000 7fb694d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:57.026 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.027+0000 7fb694d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:57.026 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.027+0000 7fb694d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:57.027 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.028+0000 7fb694d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:57.027 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.028+0000 7fb694d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:57.027 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.028+0000 7fb694d26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:57.027 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.028+0000 7fb694d26800 20 zone default found 2024-09-14T11:15:57.027 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.028+0000 7fb694d26800 4 Realm: () 2024-09-14T11:15:57.027 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.028+0000 7fb694d26800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:15:57.027 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.028+0000 7fb694d26800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:15:57.027 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.028+0000 7fb694d26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:57.027 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.028+0000 7fb694d26800 20 zonegroup default 2024-09-14T11:15:57.028 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.028+0000 7fb694d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:57.028 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.028+0000 7fb694d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:57.028 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.028+0000 7fb694d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:57.028 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.029+0000 7fb694d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:57.028 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.029+0000 7fb694d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:57.028 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.029+0000 7fb694d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:57.028 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.029+0000 7fb694d26800 20 started sync module instance, tier type = 2024-09-14T11:15:57.028 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.029+0000 7fb694d26800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:15:57.037 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.039+0000 7fb694d26800 20 add_watcher() i=0 2024-09-14T11:15:57.037 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.039+0000 7fb694d26800 20 add_watcher() i=1 2024-09-14T11:15:57.037 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.039+0000 7fb694d26800 20 add_watcher() i=2 2024-09-14T11:15:57.037 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.039+0000 7fb694d26800 20 add_watcher() i=3 2024-09-14T11:15:57.037 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.039+0000 7fb694d26800 20 add_watcher() i=4 2024-09-14T11:15:57.037 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.039+0000 7fb694d26800 20 add_watcher() i=5 2024-09-14T11:15:57.037 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.039+0000 7fb694d26800 20 add_watcher() i=6 2024-09-14T11:15:57.038 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.040+0000 7fb694d26800 20 add_watcher() i=7 2024-09-14T11:15:57.038 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.040+0000 7fb694d26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:57.039 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.041+0000 7fb546fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:57.040 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.042+0000 7fb694d26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:57.040 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.042+0000 7fb694d26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:57.041 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.042+0000 7fb694d26800 5 note: GC not initialized 2024-09-14T11:15:57.041 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.042+0000 7fb545fe3640 20 reqs_thread_entry: start 2024-09-14T11:15:57.041 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.042+0000 7fb694d26800 20 init_complete bucket index max shards: 11 2024-09-14T11:15:57.041 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.042+0000 7fb694d26800 20 Filter name: none 2024-09-14T11:15:57.041 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.042+0000 7fb4b77fe640 20 reqs_thread_entry: start 2024-09-14T11:15:57.041 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.042+0000 7fb694d26800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:15:57.041 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.042+0000 7fb694d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:57.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.043+0000 7fb694d26800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:15:57.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.043+0000 7fb694d26800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:15:57.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.043+0000 7fb694d26800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:15:57.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.043+0000 7fb694d26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : miss 2024-09-14T11:15:57.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.043+0000 7fb694d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:57.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.043+0000 7fb694d26800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:15:57.042 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.043+0000 7fb694d26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:15:57.043 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.043+0000 7fb694d26800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:15:57.043 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.043+0000 7fb694d26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:57.043 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.043+0000 7fb694d26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:57.043 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.043+0000 7fb694d26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:15:57.043 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.043+0000 7fb694d26800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:15:57.043 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.043+0000 7fb694d26800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:15:57.043 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.044+0000 7fb694d26800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:15:57.043 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.044+0000 7fb694d26800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:15:57.043 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.044+0000 7fb694d26800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:15:57.044 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.044+0000 7fb694d26800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:15:57.044 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.045+0000 7fb694d26800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:15:57.044 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.045+0000 7fb694d26800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:15:57.044 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.045+0000 7fb694d26800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:15:57.044 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.045+0000 7fb694d26800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:15:57.044 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.046+0000 7fb694d26800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:15:57.044 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.046+0000 7fb694d26800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:15:57.045 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.046+0000 7fb694d26800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:15:57.045 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.046+0000 7fb694d26800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:15:57.045 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.047+0000 7fb694d26800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:15:57.045 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.047+0000 7fb694d26800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:15:57.045 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.047+0000 7fb694d26800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:15:57.045 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.047+0000 7fb694d26800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:15:57.045 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.047+0000 7fb694d26800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:15:57.045 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.047+0000 7fb694d26800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:15:57.046 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.048+0000 7fb694d26800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:15:57.046 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.048+0000 7fb694d26800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:15:57.046 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.048+0000 7fb694d26800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:15:57.046 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.048+0000 7fb694d26800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:15:57.046 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.048+0000 7fb694d26800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:15:57.046 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.048+0000 7fb694d26800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:15:57.047 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.049+0000 7fb546fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:57.050 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.052+0000 7fb694d26800 20 remove_watcher() i=0 2024-09-14T11:15:57.050 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.052+0000 7fb694d26800 2 removed watcher, disabling cache 2024-09-14T11:15:57.051 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.053+0000 7fb694d26800 20 remove_watcher() i=1 2024-09-14T11:15:57.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.054+0000 7fb694d26800 20 remove_watcher() i=2 2024-09-14T11:15:57.053 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.055+0000 7fb694d26800 20 remove_watcher() i=3 2024-09-14T11:15:57.054 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.056+0000 7fb694d26800 20 remove_watcher() i=4 2024-09-14T11:15:57.055 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.057+0000 7fb694d26800 20 remove_watcher() i=5 2024-09-14T11:15:57.056 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.058+0000 7fb694d26800 20 remove_watcher() i=6 2024-09-14T11:15:57.057 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:15:57.059+0000 7fb694d26800 20 remove_watcher() i=7 2024-09-14T11:16:27.101 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-14T11:16:27.134 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:27.134 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:27.180 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.182+0000 7fae4b12c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.183 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.184+0000 7fae4b12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:27.183 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.184+0000 7fae4b12c800 20 realm 2024-09-14T11:16:27.183 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.184+0000 7fae4b12c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.183 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.185+0000 7fae4b12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:27.183 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.185+0000 7fae4b12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:27.183 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.185+0000 7fae4b12c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.183 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.185+0000 7fae4b12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:27.183 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.185+0000 7fae4b12c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.184 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.186+0000 7fae4b12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:27.184 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.186+0000 7fae4b12c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.185 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.187+0000 7fae4b12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:27.185 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.187+0000 7fae4b12c800 20 searching for the correct realm 2024-09-14T11:16:27.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.190+0000 7fae466ac640 0 -- 172.21.15.50:0/3046414549 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fae4003dbd0 msgr2=0x7fae40044760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:27.394 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.396+0000 7fae476ae640 0 -- 172.21.15.50:0/3046414549 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55f8ab4de1e0 msgr2=0x55f8ab4e0650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:27.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.400+0000 7fae4b12c800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:16:27.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.400+0000 7fae4b12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:27.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.400+0000 7fae4b12c800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:16:27.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.400+0000 7fae4b12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:27.399 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.400+0000 7fae4b12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:27.400 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.400+0000 7fae4b12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:27.400 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.400+0000 7fae4b12c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.400 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.401+0000 7fae4b12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:27.400 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.401+0000 7fae4b12c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.400 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.401+0000 7fae4b12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:27.400 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.401+0000 7fae4b12c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.401+0000 7fae4b12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:27.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.401+0000 7fae4b12c800 20 zone default found 2024-09-14T11:16:27.401 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.401+0000 7fae4b12c800 4 Realm: () 2024-09-14T11:16:27.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.401+0000 7fae4b12c800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:16:27.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.401+0000 7fae4b12c800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:16:27.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.401+0000 7fae4b12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:27.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.401+0000 7fae4b12c800 20 zonegroup default 2024-09-14T11:16:27.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.401+0000 7fae4b12c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.402+0000 7fae4b12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:27.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.402+0000 7fae4b12c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.402+0000 7fae4b12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:27.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.402+0000 7fae4b12c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.402+0000 7fae4b12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:27.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.402+0000 7fae4b12c800 20 started sync module instance, tier type = 2024-09-14T11:16:27.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.402+0000 7fae4b12c800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:16:27.410 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.412+0000 7fae4b12c800 20 add_watcher() i=0 2024-09-14T11:16:27.410 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.412+0000 7fae4b12c800 20 add_watcher() i=1 2024-09-14T11:16:27.410 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.412+0000 7fae4b12c800 20 add_watcher() i=2 2024-09-14T11:16:27.411 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.412+0000 7fae4b12c800 20 add_watcher() i=3 2024-09-14T11:16:27.411 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.412+0000 7fae4b12c800 20 add_watcher() i=4 2024-09-14T11:16:27.411 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.412+0000 7fae4b12c800 20 add_watcher() i=5 2024-09-14T11:16:27.411 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.412+0000 7fae4b12c800 20 add_watcher() i=6 2024-09-14T11:16:27.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.413+0000 7fae4b12c800 20 add_watcher() i=7 2024-09-14T11:16:27.412 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.413+0000 7fae4b12c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:27.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.415+0000 7facfd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:27.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.416+0000 7fae4b12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:27.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.416+0000 7fae4b12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:27.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.416+0000 7fae4b12c800 5 note: GC not initialized 2024-09-14T11:16:27.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.416+0000 7fac77fff640 20 reqs_thread_entry: start 2024-09-14T11:16:27.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.416+0000 7fae4b12c800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:27.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.416+0000 7fae4b12c800 20 Filter name: none 2024-09-14T11:16:27.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.416+0000 7fac75ffb640 20 reqs_thread_entry: start 2024-09-14T11:16:27.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.416+0000 7fae4b12c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:16:27.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.416+0000 7fae4b12c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.417+0000 7fae4b12c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:16:27.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.417+0000 7fae4b12c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:16:27.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.417+0000 7fae4b12c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:16:27.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.417+0000 7fae4b12c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : miss 2024-09-14T11:16:27.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.417+0000 7fae4b12c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.417+0000 7fae4b12c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:16:27.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.417+0000 7fae4b12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:16:27.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.417+0000 7fae4b12c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:16:27.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.417+0000 7fae4b12c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:27.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.417+0000 7fae4b12c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:27.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.417+0000 7fae4b12c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:16:27.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.422+0000 7facfd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:27.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.424+0000 7fae4b12c800 20 remove_watcher() i=0 2024-09-14T11:16:27.422 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.424+0000 7fae4b12c800 2 removed watcher, disabling cache 2024-09-14T11:16:27.423 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.425+0000 7fae4b12c800 20 remove_watcher() i=1 2024-09-14T11:16:27.424 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.426+0000 7fae4b12c800 20 remove_watcher() i=2 2024-09-14T11:16:27.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.427+0000 7fae4b12c800 20 remove_watcher() i=3 2024-09-14T11:16:27.426 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.428+0000 7fae4b12c800 20 remove_watcher() i=4 2024-09-14T11:16:27.427 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.430+0000 7fae4b12c800 20 remove_watcher() i=5 2024-09-14T11:16:27.428 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.431+0000 7fae4b12c800 20 remove_watcher() i=6 2024-09-14T11:16:27.430 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.432+0000 7fae4b12c800 20 remove_watcher() i=7 2024-09-14T11:16:27.443 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:16:27.474 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:27.474 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:27.514 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.516+0000 7f9255326800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.518+0000 7f9255326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:27.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.518+0000 7f9255326800 20 realm 2024-09-14T11:16:27.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.518+0000 7f9255326800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.517 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.518+0000 7f9255326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:27.517 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.518+0000 7f9255326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:27.517 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.518+0000 7f9255326800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.517 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.518+0000 7f9255326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:27.517 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.518+0000 7f9255326800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.517 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.519+0000 7f9255326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:27.517 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.519+0000 7f9255326800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.518 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.520+0000 7f9255326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:27.518 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.520+0000 7f9255326800 20 searching for the correct realm 2024-09-14T11:16:27.520 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.522+0000 7f925184c640 0 -- 172.21.15.50:0/3265013330 >> [v2:172.21.15.118:6816/4154782182,v1:172.21.15.118:6817/4154782182] conn(0x5637352515e0 msgr2=0x563735253aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:27.523 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.526+0000 7f925104b640 0 -- 172.21.15.50:0/3265013330 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f924c096040 msgr2=0x7f924c097940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:27.731 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.733+0000 7f9255326800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:16:27.732 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.733+0000 7f9255326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:27.732 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.733+0000 7f9255326800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:16:27.732 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.733+0000 7f9255326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:27.732 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.733+0000 7f9255326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:27.732 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.733+0000 7f9255326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:27.732 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.733+0000 7f9255326800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.732 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.734+0000 7f9255326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:27.732 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.734+0000 7f9255326800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.733 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.734+0000 7f9255326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:27.733 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.734+0000 7f9255326800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.733 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.734+0000 7f9255326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:27.733 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.734+0000 7f9255326800 20 zone default found 2024-09-14T11:16:27.733 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.734+0000 7f9255326800 4 Realm: () 2024-09-14T11:16:27.733 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.734+0000 7f9255326800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:16:27.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.734+0000 7f9255326800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:16:27.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.734+0000 7f9255326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:27.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.734+0000 7f9255326800 20 zonegroup default 2024-09-14T11:16:27.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.734+0000 7f9255326800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.735+0000 7f9255326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:27.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.735+0000 7f9255326800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.735+0000 7f9255326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:27.734 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.735+0000 7f9255326800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.736+0000 7f9255326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:27.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.736+0000 7f9255326800 20 started sync module instance, tier type = 2024-09-14T11:16:27.735 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.736+0000 7f9255326800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:16:27.743 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.745+0000 7f9255326800 20 add_watcher() i=0 2024-09-14T11:16:27.743 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.745+0000 7f9255326800 20 add_watcher() i=1 2024-09-14T11:16:27.743 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.745+0000 7f9255326800 20 add_watcher() i=2 2024-09-14T11:16:27.743 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.745+0000 7f9255326800 20 add_watcher() i=3 2024-09-14T11:16:27.743 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.745+0000 7f9255326800 20 add_watcher() i=4 2024-09-14T11:16:27.744 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.745+0000 7f9255326800 20 add_watcher() i=5 2024-09-14T11:16:27.744 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.745+0000 7f9255326800 20 add_watcher() i=6 2024-09-14T11:16:27.744 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.746+0000 7f9255326800 20 add_watcher() i=7 2024-09-14T11:16:27.744 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.746+0000 7f9255326800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:27.746 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.748+0000 7f9107fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:27.747 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.749+0000 7f9255326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:27.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.749+0000 7f9255326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:27.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.749+0000 7f9255326800 5 note: GC not initialized 2024-09-14T11:16:27.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.749+0000 7f9106fe5640 20 reqs_thread_entry: start 2024-09-14T11:16:27.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.749+0000 7f9255326800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:27.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.749+0000 7f9255326800 20 Filter name: none 2024-09-14T11:16:27.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.749+0000 7f9104fe1640 20 reqs_thread_entry: start 2024-09-14T11:16:27.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.749+0000 7f9255326800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:16:27.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.749+0000 7f9255326800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.750+0000 7f9255326800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:16:27.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.750+0000 7f9255326800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:16:27.748 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.750+0000 7f9255326800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:16:27.749 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.750+0000 7f9255326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : miss 2024-09-14T11:16:27.749 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.750+0000 7f9255326800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.750 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.750+0000 7f9255326800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:16:27.750 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.750+0000 7f9255326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:16:27.750 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.750+0000 7f9255326800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:16:27.750 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.750+0000 7f9255326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:27.750 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.750+0000 7f9255326800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:27.750 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.750+0000 7f9255326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:16:27.750 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.750+0000 7f9255326800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:16:27.750 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.750+0000 7f9255326800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:16:27.751 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.751+0000 7f9255326800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:16:27.751 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.751+0000 7f9255326800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:16:27.751 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.751+0000 7f9255326800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:16:27.751 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.751+0000 7f9255326800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:16:27.751 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.752+0000 7f9255326800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:16:27.751 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.752+0000 7f9255326800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:16:27.751 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.752+0000 7f9255326800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:16:27.751 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.752+0000 7f9255326800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:16:27.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.752+0000 7f9255326800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:16:27.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.752+0000 7f9255326800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:16:27.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.753+0000 7f9255326800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:16:27.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.753+0000 7f9255326800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:16:27.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.753+0000 7f9255326800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:16:27.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.753+0000 7f9255326800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:16:27.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.753+0000 7f9255326800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:16:27.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.753+0000 7f9255326800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:16:27.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.754+0000 7f9255326800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:16:27.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.754+0000 7f9255326800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:16:27.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.754+0000 7f9255326800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:16:27.753 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.754+0000 7f9255326800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:16:27.754 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.754+0000 7f9255326800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:16:27.754 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.754+0000 7f9255326800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:16:27.754 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.755+0000 7f9255326800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:16:27.754 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.755+0000 7f9255326800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:16:27.754 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.756+0000 7f9107fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:27.756 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.758+0000 7f9255326800 20 remove_watcher() i=0 2024-09-14T11:16:27.756 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.758+0000 7f9255326800 2 removed watcher, disabling cache 2024-09-14T11:16:27.757 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.759+0000 7f9255326800 20 remove_watcher() i=1 2024-09-14T11:16:27.758 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.760+0000 7f9255326800 20 remove_watcher() i=2 2024-09-14T11:16:27.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.761+0000 7f9255326800 20 remove_watcher() i=3 2024-09-14T11:16:27.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.763+0000 7f9255326800 20 remove_watcher() i=4 2024-09-14T11:16:27.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.764+0000 7f9255326800 20 remove_watcher() i=5 2024-09-14T11:16:27.763 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.765+0000 7f9255326800 20 remove_watcher() i=6 2024-09-14T11:16:27.764 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.766+0000 7f9255326800 20 remove_watcher() i=7 2024-09-14T11:16:27.775 INFO:tasks.workunit.client.0.smithi050.stderr:check reshard logrecord successfully 2024-09-14T11:16:27.775 INFO:tasks.workunit.client.0.smithi050.stderr: test: reshard versioned bucket 2024-09-14T11:16:27.776 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:16:27.806 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:27.806 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:27.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.847+0000 7fb8c412c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.849+0000 7fb8c412c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:27.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.849+0000 7fb8c412c800 20 realm 2024-09-14T11:16:27.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.849+0000 7fb8c412c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.850+0000 7fb8c412c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:27.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.850+0000 7fb8c412c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:27.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.850+0000 7fb8c412c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.850+0000 7fb8c412c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:27.848 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.850+0000 7fb8c412c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.851+0000 7fb8c412c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:27.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.851+0000 7fb8c412c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.851+0000 7fb8c412c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:27.849 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.852+0000 7fb8c412c800 20 searching for the correct realm 2024-09-14T11:16:27.853 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.855+0000 7fb8bfd3e640 0 -- 172.21.15.50:0/1787668303 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x7fb8b8017070 msgr2=0x7fb8b8018970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:27.857 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.859+0000 7fb8bfd3e640 0 -- 172.21.15.50:0/1787668303 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7fb8b8042400 msgr2=0x7fb8b8042880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:27.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.863+0000 7fb8c412c800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:16:27.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.863+0000 7fb8c412c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:27.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.863+0000 7fb8c412c800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:16:27.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.863+0000 7fb8c412c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:27.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.863+0000 7fb8c412c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:27.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.863+0000 7fb8c412c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:27.861 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.863+0000 7fb8c412c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.862 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.863+0000 7fb8c412c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:27.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.863+0000 7fb8c412c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.863+0000 7fb8c412c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:27.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.863+0000 7fb8c412c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.864+0000 7fb8c412c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:27.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.864+0000 7fb8c412c800 20 zone default found 2024-09-14T11:16:27.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.864+0000 7fb8c412c800 4 Realm: () 2024-09-14T11:16:27.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.864+0000 7fb8c412c800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:16:27.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.864+0000 7fb8c412c800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:16:27.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.864+0000 7fb8c412c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:27.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.864+0000 7fb8c412c800 20 zonegroup default 2024-09-14T11:16:27.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.864+0000 7fb8c412c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.863 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.864+0000 7fb8c412c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:27.864 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.864+0000 7fb8c412c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.864 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.864+0000 7fb8c412c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:27.864 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.864+0000 7fb8c412c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.864 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.865+0000 7fb8c412c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:27.864 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.865+0000 7fb8c412c800 20 started sync module instance, tier type = 2024-09-14T11:16:27.864 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.865+0000 7fb8c412c800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:16:27.872 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.874+0000 7fb8c412c800 20 add_watcher() i=0 2024-09-14T11:16:27.872 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.874+0000 7fb8c412c800 20 add_watcher() i=1 2024-09-14T11:16:27.872 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.874+0000 7fb8c412c800 20 add_watcher() i=2 2024-09-14T11:16:27.872 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.874+0000 7fb8c412c800 20 add_watcher() i=3 2024-09-14T11:16:27.872 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.874+0000 7fb8c412c800 20 add_watcher() i=4 2024-09-14T11:16:27.872 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.874+0000 7fb8c412c800 20 add_watcher() i=5 2024-09-14T11:16:27.872 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.874+0000 7fb8c412c800 20 add_watcher() i=6 2024-09-14T11:16:27.872 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.875+0000 7fb8c412c800 20 add_watcher() i=7 2024-09-14T11:16:27.873 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.875+0000 7fb8c412c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:27.874 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.876+0000 7fb775fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:27.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.877+0000 7fb8c412c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:27.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.877+0000 7fb8c412c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:27.875 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.877+0000 7fb8c412c800 5 note: GC not initialized 2024-09-14T11:16:27.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.877+0000 7fb774fe1640 20 reqs_thread_entry: start 2024-09-14T11:16:27.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.877+0000 7fb8c412c800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:27.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.877+0000 7fb8c412c800 20 Filter name: none 2024-09-14T11:16:27.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.877+0000 7fb6ee7fc640 20 reqs_thread_entry: start 2024-09-14T11:16:27.876 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.877+0000 7fb8c412c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.878+0000 7fb8c412c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:27.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.878+0000 7fb8c412c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.878+0000 7fb8c412c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:27.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.878+0000 7fb8c412c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:27.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.878+0000 7fb8c412c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.879+0000 7fb8c412c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:27.877 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.879+0000 7fb8c412c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.879+0000 7fb8c412c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:27.878 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.879+0000 7fb8c412c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:27.879 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.881+0000 7fb775fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:27.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.883+0000 7fb8c412c800 20 remove_watcher() i=0 2024-09-14T11:16:27.881 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.883+0000 7fb8c412c800 2 removed watcher, disabling cache 2024-09-14T11:16:27.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.884+0000 7fb8c412c800 20 remove_watcher() i=1 2024-09-14T11:16:27.883 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.885+0000 7fb8c412c800 20 remove_watcher() i=2 2024-09-14T11:16:27.884 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.886+0000 7fb8c412c800 20 remove_watcher() i=3 2024-09-14T11:16:27.885 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.887+0000 7fb8c412c800 20 remove_watcher() i=4 2024-09-14T11:16:27.886 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.888+0000 7fb8c412c800 20 remove_watcher() i=5 2024-09-14T11:16:27.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.889+0000 7fb8c412c800 20 remove_watcher() i=6 2024-09-14T11:16:27.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.890+0000 7fb8c412c800 20 remove_watcher() i=7 2024-09-14T11:16:27.899 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:16:27.899 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:16:27.899 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: myver id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-14T11:16:27.899 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:16:27.901 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-14T11:16:27.932 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:27.933 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:27.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.974+0000 7f952c8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.976+0000 7f952c8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:27.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.976+0000 7f952c8bb800 20 realm 2024-09-14T11:16:27.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.976+0000 7f952c8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.976+0000 7f952c8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:27.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.976+0000 7f952c8bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:27.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.976+0000 7f952c8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.976+0000 7f952c8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:27.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.976+0000 7f952c8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.977+0000 7f952c8bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:27.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.977+0000 7f952c8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:27.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.978+0000 7f952c8bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:27.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.978+0000 7f952c8bb800 20 searching for the correct realm 2024-09-14T11:16:27.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:27.981+0000 7f9529ba4640 0 -- 172.21.15.50:0/3962843509 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f9524033410 msgr2=0x7f9524033870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:28.185 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.187+0000 7f952aba6640 0 -- 172.21.15.50:0/3962843509 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5588bfde3ef0 msgr2=0x5588bfde6340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:28.190 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.192+0000 7f952c8bb800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:16:28.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.192+0000 7f952c8bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:28.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.192+0000 7f952c8bb800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:16:28.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.192+0000 7f952c8bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:28.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.192+0000 7f952c8bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:28.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.192+0000 7f952c8bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:28.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.192+0000 7f952c8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:28.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.192+0000 7f952c8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:28.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.192+0000 7f952c8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:28.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.193+0000 7f952c8bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:28.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.193+0000 7f952c8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:28.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.193+0000 7f952c8bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:28.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.193+0000 7f952c8bb800 20 zone default found 2024-09-14T11:16:28.192 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.193+0000 7f952c8bb800 4 Realm: () 2024-09-14T11:16:28.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.193+0000 7f952c8bb800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:16:28.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.193+0000 7f952c8bb800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:16:28.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.193+0000 7f952c8bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:28.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.193+0000 7f952c8bb800 20 zonegroup default 2024-09-14T11:16:28.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.193+0000 7f952c8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:28.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.193+0000 7f952c8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:28.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.193+0000 7f952c8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:28.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.194+0000 7f952c8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:28.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.194+0000 7f952c8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:28.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.194+0000 7f952c8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:28.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.194+0000 7f952c8bb800 20 started sync module instance, tier type = 2024-09-14T11:16:28.193 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.194+0000 7f952c8bb800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:16:28.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.203+0000 7f952c8bb800 20 add_watcher() i=0 2024-09-14T11:16:28.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.203+0000 7f952c8bb800 20 add_watcher() i=1 2024-09-14T11:16:28.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.203+0000 7f952c8bb800 20 add_watcher() i=2 2024-09-14T11:16:28.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.203+0000 7f952c8bb800 20 add_watcher() i=3 2024-09-14T11:16:28.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.203+0000 7f952c8bb800 20 add_watcher() i=4 2024-09-14T11:16:28.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.203+0000 7f952c8bb800 20 add_watcher() i=5 2024-09-14T11:16:28.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.203+0000 7f952c8bb800 20 add_watcher() i=6 2024-09-14T11:16:28.202 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.204+0000 7f952c8bb800 20 add_watcher() i=7 2024-09-14T11:16:28.203 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.204+0000 7f952c8bb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:28.204 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.206+0000 7f93e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:28.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.206+0000 7f952c8bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:28.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.206+0000 7f952c8bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:28.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.206+0000 7f952c8bb800 5 note: GC not initialized 2024-09-14T11:16:28.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.207+0000 7f935b7fe640 20 reqs_thread_entry: start 2024-09-14T11:16:28.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.207+0000 7f952c8bb800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:28.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.207+0000 7f952c8bb800 20 Filter name: none 2024-09-14T11:16:28.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.207+0000 7f93597fa640 20 reqs_thread_entry: start 2024-09-14T11:16:28.206 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.207+0000 7f952c8bb800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:16:28.206 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.207+0000 7f952c8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:28.206 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.208+0000 7f952c8bb800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:28.206 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.208+0000 7f952c8bb800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:16:28.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.208+0000 7f952c8bb800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:16:28.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.208+0000 7f952c8bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 : miss 2024-09-14T11:16:28.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.208+0000 7f952c8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:28.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.208+0000 7f952c8bb800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:28.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.208+0000 7f952c8bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 info.flags=0x17 2024-09-14T11:16:28.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.208+0000 7f952c8bb800 10 adding default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 to cache LRU end 2024-09-14T11:16:28.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.208+0000 7f952c8bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:28.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.208+0000 7f952c8bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:28.207 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.208+0000 7f952c8bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 2024-09-14T11:16:28.211 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.213+0000 7f952c8bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 info.flags=0x17 2024-09-14T11:16:28.211 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.213+0000 7f952c8bb800 10 moving default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 to cache LRU end 2024-09-14T11:16:28.211 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.213+0000 7f952c8bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:28.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.213+0000 7f952c8bb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19, ofs0, ns] 2024-09-14T11:16:28.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.214+0000 7f940d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497083 cookie 94045823001216 notifier 8553 bl.length()=905 2024-09-14T11:16:28.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.214+0000 7f940d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 info.flags=0x17 2024-09-14T11:16:28.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.214+0000 7f940d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 to cache LRU end 2024-09-14T11:16:28.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.214+0000 7f940d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:28.213 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.215+0000 7f952c8bb800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): orig_sources= new_sources= 2024-09-14T11:16:28.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.215+0000 7f952c8bb800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): potential sources added=[] removed=[] 2024-09-14T11:16:28.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.215+0000 7f952c8bb800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): orig_dests= new_dests= 2024-09-14T11:16:28.214 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.215+0000 7f952c8bb800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): potential dests added=[] removed=[] 2024-09-14T11:16:28.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.0 2024-09-14T11:16:28.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.0 2024-09-14T11:16:28.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.1 2024-09-14T11:16:28.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.1 2024-09-14T11:16:28.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.2 2024-09-14T11:16:28.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.2 2024-09-14T11:16:28.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.3 2024-09-14T11:16:28.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.3 2024-09-14T11:16:28.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.4 2024-09-14T11:16:28.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.4 2024-09-14T11:16:28.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.5 2024-09-14T11:16:28.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.5 2024-09-14T11:16:28.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.6 2024-09-14T11:16:28.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.6 2024-09-14T11:16:28.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.7 2024-09-14T11:16:28.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.7 2024-09-14T11:16:28.219 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.8 2024-09-14T11:16:28.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.8 2024-09-14T11:16:28.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.9 2024-09-14T11:16:28.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.9 2024-09-14T11:16:28.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.10 2024-09-14T11:16:28.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.10 2024-09-14T11:16:28.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.11 2024-09-14T11:16:28.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.11 2024-09-14T11:16:28.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.0 2024-09-14T11:16:28.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.220+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1 2024-09-14T11:16:28.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.221+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2 2024-09-14T11:16:28.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.221+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3 2024-09-14T11:16:28.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.222+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.4 2024-09-14T11:16:28.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.222+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.5 2024-09-14T11:16:28.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.223+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.6 2024-09-14T11:16:28.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.224+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.7 2024-09-14T11:16:28.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.224+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.8 2024-09-14T11:16:28.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.225+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.9 2024-09-14T11:16:28.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.226+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.10 2024-09-14T11:16:28.224 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.226+0000 7f952c8bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:28.224 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.226+0000 7f952c8bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 2024-09-14T11:16:28.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.227+0000 7f952c8bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 info.flags=0x17 2024-09-14T11:16:28.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.227+0000 7f952c8bb800 10 moving default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 to cache LRU end 2024-09-14T11:16:28.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.227+0000 7f952c8bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:28.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.227+0000 7f952c8bb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19, ofs0, ns] 2024-09-14T11:16:28.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.228+0000 7f940dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497084 cookie 94045823001216 notifier 8553 bl.length()=905 2024-09-14T11:16:28.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.228+0000 7f940dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 info.flags=0x17 2024-09-14T11:16:28.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.228+0000 7f940dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 to cache LRU end 2024-09-14T11:16:28.226 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.228+0000 7f940dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:28.227 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.229+0000 7f952c8bb800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): orig_sources= new_sources= 2024-09-14T11:16:28.227 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.229+0000 7f952c8bb800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): potential sources added=[] removed=[] 2024-09-14T11:16:28.227 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.229+0000 7f952c8bb800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): orig_dests= new_dests= 2024-09-14T11:16:28.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.229+0000 7f952c8bb800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): potential dests added=[] removed=[] 2024-09-14T11:16:28.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.232+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.0 2024-09-14T11:16:28.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.232+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1 2024-09-14T11:16:28.231 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.233+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2 2024-09-14T11:16:28.231 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.233+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3 2024-09-14T11:16:28.231 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.233+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.4 2024-09-14T11:16:28.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.234+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.5 2024-09-14T11:16:28.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.234+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.6 2024-09-14T11:16:28.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.234+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.7 2024-09-14T11:16:28.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.235+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.8 2024-09-14T11:16:28.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.235+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.9 2024-09-14T11:16:28.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.236+0000 7f952c8bb800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.10 2024-09-14T11:16:28.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.236+0000 7f952c8bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:28.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.236+0000 7f952c8bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 2024-09-14T11:16:28.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.237+0000 7f952c8bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 info.flags=0x17 2024-09-14T11:16:28.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.237+0000 7f952c8bb800 10 moving default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 to cache LRU end 2024-09-14T11:16:28.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.237+0000 7f952c8bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:28.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.237+0000 7f952c8bb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19, ofs0, ns] 2024-09-14T11:16:28.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.237+0000 7f940dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497085 cookie 94045823001216 notifier 8553 bl.length()=873 2024-09-14T11:16:28.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.237+0000 7f940dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 info.flags=0x17 2024-09-14T11:16:28.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.237+0000 7f940dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 to cache LRU end 2024-09-14T11:16:28.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.237+0000 7f940dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:28.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.239+0000 7f952c8bb800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): orig_sources= new_sources= 2024-09-14T11:16:28.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.239+0000 7f952c8bb800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): potential sources added=[] removed=[] 2024-09-14T11:16:28.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.239+0000 7f952c8bb800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): orig_dests= new_dests= 2024-09-14T11:16:28.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.239+0000 7f952c8bb800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): potential dests added=[] removed=[] 2024-09-14T11:16:28.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.242+0000 7f952c8bb800 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-14T11:16:28.241 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.244+0000 7f93e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:28.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.246+0000 7f952c8bb800 20 remove_watcher() i=0 2024-09-14T11:16:28.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.246+0000 7f952c8bb800 2 removed watcher, disabling cache 2024-09-14T11:16:28.245 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.247+0000 7f952c8bb800 20 remove_watcher() i=1 2024-09-14T11:16:28.246 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.248+0000 7f952c8bb800 20 remove_watcher() i=2 2024-09-14T11:16:28.247 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.249+0000 7f952c8bb800 20 remove_watcher() i=3 2024-09-14T11:16:28.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.250+0000 7f952c8bb800 20 remove_watcher() i=4 2024-09-14T11:16:28.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.251+0000 7f952c8bb800 20 remove_watcher() i=5 2024-09-14T11:16:28.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.252+0000 7f952c8bb800 20 remove_watcher() i=6 2024-09-14T11:16:28.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.253+0000 7f952c8bb800 20 remove_watcher() i=7 2024-09-14T11:16:28.264 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:16:28.292 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:28.293 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:28.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.334+0000 7f9b4501d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:28.334 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.335+0000 7f9b4501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:28.334 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.335+0000 7f9b4501d800 20 realm 2024-09-14T11:16:28.334 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.335+0000 7f9b4501d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:28.334 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.336+0000 7f9b4501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:28.334 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.336+0000 7f9b4501d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:28.334 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.336+0000 7f9b4501d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:28.334 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.336+0000 7f9b4501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:28.334 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.336+0000 7f9b4501d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:28.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.337+0000 7f9b4501d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:28.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.337+0000 7f9b4501d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:28.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.337+0000 7f9b4501d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:28.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.337+0000 7f9b4501d800 20 searching for the correct realm 2024-09-14T11:16:28.338 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.340+0000 7f9b3ffea640 0 -- 172.21.15.50:0/285802127 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f9b38032920 msgr2=0x7f9b38017400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:28.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.546+0000 7f9b40fec640 0 -- 172.21.15.50:0/285802127 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x559d24690380 msgr2=0x559d24692820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:28.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.550+0000 7f9b4501d800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:16:28.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.550+0000 7f9b4501d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:28.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.550+0000 7f9b4501d800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:16:28.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.550+0000 7f9b4501d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:28.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.550+0000 7f9b4501d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:28.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.550+0000 7f9b4501d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:28.550 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.550+0000 7f9b4501d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:28.550 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.551+0000 7f9b4501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:28.550 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.551+0000 7f9b4501d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:28.550 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.551+0000 7f9b4501d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:28.550 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.551+0000 7f9b4501d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:28.551 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.551+0000 7f9b4501d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:28.551 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.551+0000 7f9b4501d800 20 zone default found 2024-09-14T11:16:28.551 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.551+0000 7f9b4501d800 4 Realm: () 2024-09-14T11:16:28.551 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.551+0000 7f9b4501d800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:16:28.551 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.551+0000 7f9b4501d800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:16:28.551 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.551+0000 7f9b4501d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:28.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.551+0000 7f9b4501d800 20 zonegroup default 2024-09-14T11:16:28.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.551+0000 7f9b4501d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:28.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.552+0000 7f9b4501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:28.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.552+0000 7f9b4501d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:28.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.552+0000 7f9b4501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:28.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.552+0000 7f9b4501d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:28.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.552+0000 7f9b4501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:28.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.552+0000 7f9b4501d800 20 started sync module instance, tier type = 2024-09-14T11:16:28.552 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.552+0000 7f9b4501d800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:16:28.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.561+0000 7f9b4501d800 20 add_watcher() i=0 2024-09-14T11:16:28.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.561+0000 7f9b4501d800 20 add_watcher() i=1 2024-09-14T11:16:28.559 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.561+0000 7f9b4501d800 20 add_watcher() i=2 2024-09-14T11:16:28.560 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.561+0000 7f9b4501d800 20 add_watcher() i=3 2024-09-14T11:16:28.560 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.561+0000 7f9b4501d800 20 add_watcher() i=4 2024-09-14T11:16:28.560 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.561+0000 7f9b4501d800 20 add_watcher() i=5 2024-09-14T11:16:28.560 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.561+0000 7f9b4501d800 20 add_watcher() i=6 2024-09-14T11:16:28.560 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.562+0000 7f9b4501d800 20 add_watcher() i=7 2024-09-14T11:16:28.560 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.562+0000 7f9b4501d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:28.562 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.564+0000 7f99f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:28.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.565+0000 7f9b4501d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:28.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.565+0000 7f9b4501d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:28.563 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.565+0000 7f9b4501d800 5 note: GC not initialized 2024-09-14T11:16:28.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.565+0000 7f99f5fdb640 20 reqs_thread_entry: start 2024-09-14T11:16:28.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.565+0000 7f9b4501d800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:28.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.565+0000 7f9b4501d800 20 Filter name: none 2024-09-14T11:16:28.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.565+0000 7f99677fe640 20 reqs_thread_entry: start 2024-09-14T11:16:28.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.565+0000 7f9b4501d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:28.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.566+0000 7f9b4501d800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:28.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.566+0000 7f9b4501d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:28.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.567+0000 7f9b4501d800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:28.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.567+0000 7f9b4501d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:28.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.567+0000 7f9b4501d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:28.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.567+0000 7f9b4501d800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:28.565 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.567+0000 7f9b4501d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:28.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.567+0000 7f9b4501d800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:28.566 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.567+0000 7f9b4501d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:28.567 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.569+0000 7f99f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:28.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.571+0000 7f9b4501d800 20 remove_watcher() i=0 2024-09-14T11:16:28.569 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.571+0000 7f9b4501d800 2 removed watcher, disabling cache 2024-09-14T11:16:28.570 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.572+0000 7f9b4501d800 20 remove_watcher() i=1 2024-09-14T11:16:28.571 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.573+0000 7f9b4501d800 20 remove_watcher() i=2 2024-09-14T11:16:28.572 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.574+0000 7f9b4501d800 20 remove_watcher() i=3 2024-09-14T11:16:28.573 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.575+0000 7f9b4501d800 20 remove_watcher() i=4 2024-09-14T11:16:28.574 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.576+0000 7f9b4501d800 20 remove_watcher() i=5 2024-09-14T11:16:28.575 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.577+0000 7f9b4501d800 20 remove_watcher() i=6 2024-09-14T11:16:28.576 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:28.578+0000 7f9b4501d800 20 remove_watcher() i=7 2024-09-14T11:16:28.587 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:16:28.587 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:16:28.587 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: myver id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:16:28.587 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:16:28.590 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:28.590 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:28.611 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:28.611 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:28.667 INFO:tasks.workunit.client.0.smithi050.stderr: test: reshard removes olh entries with empty name 2024-09-14T11:16:28.669 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:28.670 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:28.749 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:28.749 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:28.981 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:16:29.010 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:29.010 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:29.049 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.052+0000 7fa556742800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.053+0000 7fa556742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:29.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.053+0000 7fa556742800 20 realm 2024-09-14T11:16:29.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.053+0000 7fa556742800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.054+0000 7fa556742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:29.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.054+0000 7fa556742800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:29.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.054+0000 7fa556742800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.054+0000 7fa556742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:29.052 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.054+0000 7fa556742800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.053 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.055+0000 7fa556742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:29.053 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.055+0000 7fa556742800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.053 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.055+0000 7fa556742800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:29.053 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.055+0000 7fa556742800 20 searching for the correct realm 2024-09-14T11:16:29.056 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.058+0000 7fa551cec640 0 -- 172.21.15.50:0/3491694009 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fa54c0dd940 msgr2=0x7fa54c0607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:29.262 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.264+0000 7fa552cee640 0 -- 172.21.15.50:0/3491694009 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55802e0134e0 msgr2=0x55802e0158d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:29.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.269+0000 7fa556742800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:16:29.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.269+0000 7fa556742800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:29.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.269+0000 7fa556742800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:16:29.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.269+0000 7fa556742800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:29.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.269+0000 7fa556742800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:29.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.269+0000 7fa556742800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:29.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.269+0000 7fa556742800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.267 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.269+0000 7fa556742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:29.268 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.269+0000 7fa556742800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.269+0000 7fa556742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:29.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.269+0000 7fa556742800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.270+0000 7fa556742800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:29.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.270+0000 7fa556742800 20 zone default found 2024-09-14T11:16:29.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.270+0000 7fa556742800 4 Realm: () 2024-09-14T11:16:29.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.270+0000 7fa556742800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:16:29.269 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.270+0000 7fa556742800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:16:29.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.270+0000 7fa556742800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:29.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.270+0000 7fa556742800 20 zonegroup default 2024-09-14T11:16:29.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.270+0000 7fa556742800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.270+0000 7fa556742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:29.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.270+0000 7fa556742800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.270+0000 7fa556742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:29.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.270+0000 7fa556742800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.270+0000 7fa556742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:29.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.270+0000 7fa556742800 20 started sync module instance, tier type = 2024-09-14T11:16:29.270 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.270+0000 7fa556742800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:16:29.278 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.279+0000 7fa556742800 20 add_watcher() i=0 2024-09-14T11:16:29.278 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.279+0000 7fa556742800 20 add_watcher() i=1 2024-09-14T11:16:29.278 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.279+0000 7fa556742800 20 add_watcher() i=2 2024-09-14T11:16:29.278 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.279+0000 7fa556742800 20 add_watcher() i=3 2024-09-14T11:16:29.278 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.279+0000 7fa556742800 20 add_watcher() i=4 2024-09-14T11:16:29.278 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.279+0000 7fa556742800 20 add_watcher() i=5 2024-09-14T11:16:29.278 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.280+0000 7fa556742800 20 add_watcher() i=6 2024-09-14T11:16:29.278 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.280+0000 7fa556742800 20 add_watcher() i=7 2024-09-14T11:16:29.278 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.280+0000 7fa556742800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:29.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.282+0000 7fa408fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:29.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.283+0000 7fa556742800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:29.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.283+0000 7fa556742800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:29.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.283+0000 7fa556742800 5 note: GC not initialized 2024-09-14T11:16:29.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.283+0000 7fa3837fe640 20 reqs_thread_entry: start 2024-09-14T11:16:29.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.283+0000 7fa556742800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:29.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.283+0000 7fa556742800 20 Filter name: none 2024-09-14T11:16:29.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.283+0000 7fa3817fa640 20 reqs_thread_entry: start 2024-09-14T11:16:29.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.283+0000 7fa556742800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.284+0000 7fa556742800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:16:29.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.284+0000 7fa556742800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.284+0000 7fa556742800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:16:29.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.284+0000 7fa556742800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:29.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.284+0000 7fa556742800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.285+0000 7fa556742800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:16:29.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.285+0000 7fa556742800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.285+0000 7fa556742800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:16:29.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.285+0000 7fa556742800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:29.285 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.287+0000 7fa408fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:29.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.289+0000 7fa556742800 20 remove_watcher() i=0 2024-09-14T11:16:29.287 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.289+0000 7fa556742800 2 removed watcher, disabling cache 2024-09-14T11:16:29.288 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.290+0000 7fa556742800 20 remove_watcher() i=1 2024-09-14T11:16:29.289 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.291+0000 7fa556742800 20 remove_watcher() i=2 2024-09-14T11:16:29.290 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.292+0000 7fa556742800 20 remove_watcher() i=3 2024-09-14T11:16:29.291 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.293+0000 7fa556742800 20 remove_watcher() i=4 2024-09-14T11:16:29.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.294+0000 7fa556742800 20 remove_watcher() i=5 2024-09-14T11:16:29.293 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.295+0000 7fa556742800 20 remove_watcher() i=6 2024-09-14T11:16:29.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.296+0000 7fa556742800 20 remove_watcher() i=7 2024-09-14T11:16:29.306 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:16:29.306 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:16:29.306 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: a-bucket id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-14T11:16:29.306 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:16:29.307 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-14T11:16:29.337 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:29.337 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:29.376 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.378+0000 7fdfd5663800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.378 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.380+0000 7fdfd5663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:29.378 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.380+0000 7fdfd5663800 20 realm 2024-09-14T11:16:29.378 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.380+0000 7fdfd5663800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.378 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.380+0000 7fdfd5663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:29.378 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.380+0000 7fdfd5663800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:29.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.380+0000 7fdfd5663800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.380+0000 7fdfd5663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:29.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.380+0000 7fdfd5663800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.381+0000 7fdfd5663800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:29.379 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.381+0000 7fdfd5663800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.380 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.382+0000 7fdfd5663800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:29.380 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.382+0000 7fdfd5663800 20 searching for the correct realm 2024-09-14T11:16:29.382 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.385+0000 7fdfd3955640 0 -- 172.21.15.50:0/1422319802 >> [v2:172.21.15.118:6816/4154782182,v1:172.21.15.118:6817/4154782182] conn(0x5605eda9f0d0 msgr2=0x5605edaa1570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:29.587 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.589+0000 7fdfd3154640 0 -- 172.21.15.50:0/1422319802 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7fdfcc08ab40 msgr2=0x7fdfcc0188a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:29.996 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.998+0000 7fdfd5663800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:16:29.996 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.998+0000 7fdfd5663800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:29.996 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.998+0000 7fdfd5663800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:16:29.996 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.998+0000 7fdfd5663800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:29.996 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.998+0000 7fdfd5663800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:29.996 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.998+0000 7fdfd5663800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:29.996 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.998+0000 7fdfd5663800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.998+0000 7fdfd5663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:29.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.998+0000 7fdfd5663800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.998+0000 7fdfd5663800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:29.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.998+0000 7fdfd5663800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.999+0000 7fdfd5663800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:29.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.999+0000 7fdfd5663800 20 zone default found 2024-09-14T11:16:29.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.999+0000 7fdfd5663800 4 Realm: () 2024-09-14T11:16:29.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.999+0000 7fdfd5663800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:16:29.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.999+0000 7fdfd5663800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:16:29.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.999+0000 7fdfd5663800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:29.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.999+0000 7fdfd5663800 20 zonegroup default 2024-09-14T11:16:29.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.999+0000 7fdfd5663800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.999+0000 7fdfd5663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:29.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:29.999+0000 7fdfd5663800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.000+0000 7fdfd5663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:29.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.000+0000 7fdfd5663800 20 rados->read ofs=0 len=0 2024-09-14T11:16:29.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.000+0000 7fdfd5663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:29.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.000+0000 7fdfd5663800 20 started sync module instance, tier type = 2024-09-14T11:16:29.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.000+0000 7fdfd5663800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:16:30.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.011+0000 7fdfd5663800 20 add_watcher() i=0 2024-09-14T11:16:30.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.011+0000 7fdfd5663800 20 add_watcher() i=1 2024-09-14T11:16:30.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.011+0000 7fdfd5663800 20 add_watcher() i=2 2024-09-14T11:16:30.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.011+0000 7fdfd5663800 20 add_watcher() i=3 2024-09-14T11:16:30.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.011+0000 7fdfd5663800 20 add_watcher() i=4 2024-09-14T11:16:30.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.011+0000 7fdfd5663800 20 add_watcher() i=5 2024-09-14T11:16:30.009 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.011+0000 7fdfd5663800 20 add_watcher() i=6 2024-09-14T11:16:30.010 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.012+0000 7fdfd5663800 20 add_watcher() i=7 2024-09-14T11:16:30.010 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.012+0000 7fdfd5663800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:30.012 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.014+0000 7fde89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:30.013 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.014+0000 7fdfd5663800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:30.013 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.014+0000 7fdfd5663800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:30.013 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.014+0000 7fdfd5663800 5 note: GC not initialized 2024-09-14T11:16:30.013 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.014+0000 7fde88fe1640 20 reqs_thread_entry: start 2024-09-14T11:16:30.013 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.014+0000 7fdfd5663800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:30.013 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.015+0000 7fdfd5663800 20 Filter name: none 2024-09-14T11:16:30.013 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.015+0000 7fde027fc640 20 reqs_thread_entry: start 2024-09-14T11:16:30.013 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.015+0000 7fdfd5663800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.014 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.015+0000 7fdfd5663800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:16:30.014 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.015+0000 7fdfd5663800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.014 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.016+0000 7fdfd5663800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:16:30.014 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.016+0000 7fdfd5663800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:30.015 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.017+0000 7fde89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:30.017 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.019+0000 7fdfd5663800 20 remove_watcher() i=0 2024-09-14T11:16:30.018 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.019+0000 7fdfd5663800 2 removed watcher, disabling cache 2024-09-14T11:16:30.019 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.021+0000 7fdfd5663800 20 remove_watcher() i=1 2024-09-14T11:16:30.020 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.022+0000 7fdfd5663800 20 remove_watcher() i=2 2024-09-14T11:16:30.021 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.023+0000 7fdfd5663800 20 remove_watcher() i=3 2024-09-14T11:16:30.022 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.024+0000 7fdfd5663800 20 remove_watcher() i=4 2024-09-14T11:16:30.024 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.026+0000 7fdfd5663800 20 remove_watcher() i=5 2024-09-14T11:16:30.025 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.027+0000 7fdfd5663800 20 remove_watcher() i=6 2024-09-14T11:16:30.026 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.028+0000 7fdfd5663800 20 remove_watcher() i=7 2024-09-14T11:16:30.041 INFO:tasks.workunit.client.0.smithi050.stderr:rados -p default.rgw.buckets.index setomapval .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-14T11:16:30.069 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:30.069 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:30.087 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:16:30.117 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:30.117 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:30.158 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.160+0000 7fb394928800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.160 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.162+0000 7fb394928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:30.160 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.162+0000 7fb394928800 20 realm 2024-09-14T11:16:30.160 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.162+0000 7fb394928800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.162+0000 7fb394928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:30.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.162+0000 7fb394928800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:30.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.162+0000 7fb394928800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.162+0000 7fb394928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:30.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.162+0000 7fb394928800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.163+0000 7fb394928800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:30.161 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.163+0000 7fb394928800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.162 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.164+0000 7fb394928800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:30.162 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.164+0000 7fb394928800 20 searching for the correct realm 2024-09-14T11:16:30.163 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.165+0000 7fb39066f640 0 -- 172.21.15.50:0/4142721975 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x7fb388077040 msgr2=0x7fb388067450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:30.370 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.372+0000 7fb390e70640 0 -- 172.21.15.50:0/4142721975 >> [v2:172.21.15.118:6826/1082138742,v1:172.21.15.118:6827/1082138742] conn(0x7fb380030070 msgr2=0x7fb38004a430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:30.579 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.581+0000 7fb394928800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:16:30.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.581+0000 7fb394928800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:30.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.581+0000 7fb394928800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:16:30.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.581+0000 7fb394928800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:30.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.581+0000 7fb394928800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:30.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.581+0000 7fb394928800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:30.580 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.581+0000 7fb394928800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.582+0000 7fb394928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:30.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.582+0000 7fb394928800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.582+0000 7fb394928800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:30.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.582+0000 7fb394928800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.583+0000 7fb394928800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:30.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.583+0000 7fb394928800 20 zone default found 2024-09-14T11:16:30.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.583+0000 7fb394928800 4 Realm: () 2024-09-14T11:16:30.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.583+0000 7fb394928800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:16:30.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.583+0000 7fb394928800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:16:30.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.583+0000 7fb394928800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:30.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.583+0000 7fb394928800 20 zonegroup default 2024-09-14T11:16:30.582 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.583+0000 7fb394928800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.583+0000 7fb394928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:30.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.583+0000 7fb394928800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.583+0000 7fb394928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:30.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.583+0000 7fb394928800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.584+0000 7fb394928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:30.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.584+0000 7fb394928800 20 started sync module instance, tier type = 2024-09-14T11:16:30.583 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.584+0000 7fb394928800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:16:30.591 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.593+0000 7fb394928800 20 add_watcher() i=0 2024-09-14T11:16:30.592 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.593+0000 7fb394928800 20 add_watcher() i=1 2024-09-14T11:16:30.592 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.593+0000 7fb394928800 20 add_watcher() i=2 2024-09-14T11:16:30.592 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.593+0000 7fb394928800 20 add_watcher() i=3 2024-09-14T11:16:30.592 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.593+0000 7fb394928800 20 add_watcher() i=4 2024-09-14T11:16:30.592 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.593+0000 7fb394928800 20 add_watcher() i=5 2024-09-14T11:16:30.592 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.593+0000 7fb394928800 20 add_watcher() i=6 2024-09-14T11:16:30.592 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.594+0000 7fb394928800 20 add_watcher() i=7 2024-09-14T11:16:30.592 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.594+0000 7fb394928800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:30.594 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.596+0000 7fb246fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:30.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.596+0000 7fb394928800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:30.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.596+0000 7fb394928800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:30.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.596+0000 7fb394928800 5 note: GC not initialized 2024-09-14T11:16:30.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.597+0000 7fb245fdb640 20 reqs_thread_entry: start 2024-09-14T11:16:30.595 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.597+0000 7fb394928800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:30.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.597+0000 7fb394928800 20 Filter name: none 2024-09-14T11:16:30.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.597+0000 7fb1b77fe640 20 reqs_thread_entry: start 2024-09-14T11:16:30.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.597+0000 7fb394928800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.597+0000 7fb394928800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:16:30.596 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.597+0000 7fb394928800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.598+0000 7fb394928800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:16:30.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.598+0000 7fb394928800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:30.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.598+0000 7fb394928800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:16:30.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.598+0000 7fb394928800 20 INFO: main: starting shard=0 2024-09-14T11:16:30.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.598+0000 7fb394928800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:16:30.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.598+0000 7fb394928800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:16:30.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.599+0000 7fb394928800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:16:30.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.599+0000 7fb394928800 20 INFO: main: starting shard=1 2024-09-14T11:16:30.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.599+0000 7fb394928800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:16:30.597 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.599+0000 7fb394928800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:16:30.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.599+0000 7fb394928800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:30.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.599+0000 7fb394928800 20 INFO: main: starting shard=2 2024-09-14T11:16:30.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.599+0000 7fb394928800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:16:30.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.599+0000 7fb394928800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:16:30.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.600+0000 7fb394928800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:30.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.600+0000 7fb394928800 20 INFO: main: starting shard=3 2024-09-14T11:16:30.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.600+0000 7fb394928800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:16:30.598 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.600+0000 7fb394928800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:16:30.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.600+0000 7fb394928800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:30.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.600+0000 7fb394928800 20 INFO: main: starting shard=4 2024-09-14T11:16:30.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.600+0000 7fb394928800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:16:30.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.600+0000 7fb394928800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:16:30.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.601+0000 7fb394928800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:30.600 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.601+0000 7fb394928800 20 INFO: main: starting shard=5 2024-09-14T11:16:30.600 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.601+0000 7fb394928800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:16:30.600 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.601+0000 7fb394928800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:16:30.600 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.601+0000 7fb394928800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:30.600 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.601+0000 7fb394928800 20 INFO: main: starting shard=6 2024-09-14T11:16:30.600 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.601+0000 7fb394928800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:16:30.600 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.601+0000 7fb394928800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:16:30.600 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.602+0000 7fb394928800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:30.600 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.602+0000 7fb394928800 20 INFO: main: starting shard=7 2024-09-14T11:16:30.601 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.602+0000 7fb394928800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:16:30.601 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.602+0000 7fb394928800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:16:30.601 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.603+0000 7fb394928800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:30.601 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.603+0000 7fb394928800 20 INFO: main: starting shard=8 2024-09-14T11:16:30.601 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.603+0000 7fb394928800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:16:30.601 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.603+0000 7fb394928800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:16:30.602 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.604+0000 7fb394928800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:30.602 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.604+0000 7fb394928800 20 INFO: main: starting shard=9 2024-09-14T11:16:30.602 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.604+0000 7fb394928800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:16:30.602 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.604+0000 7fb394928800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:16:30.602 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.604+0000 7fb394928800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:30.602 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.604+0000 7fb394928800 20 INFO: main: starting shard=10 2024-09-14T11:16:30.603 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.604+0000 7fb394928800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:16:30.603 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.604+0000 7fb394928800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:16:30.603 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.605+0000 7fb394928800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:30.603 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.605+0000 7fb394928800 20 INFO: main: starting shard=11 2024-09-14T11:16:30.603 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.605+0000 7fb394928800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:16:30.603 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.605+0000 7fb394928800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:16:30.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.606+0000 7fb394928800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:30.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.606+0000 7fb394928800 20 INFO: main: starting shard=12 2024-09-14T11:16:30.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.606+0000 7fb394928800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:16:30.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.606+0000 7fb394928800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:16:30.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.606+0000 7fb394928800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:30.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.606+0000 7fb394928800 20 INFO: main: done 2024-09-14T11:16:30.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.607+0000 7fb246fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:30.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.609+0000 7fb394928800 20 remove_watcher() i=0 2024-09-14T11:16:30.607 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.609+0000 7fb394928800 2 removed watcher, disabling cache 2024-09-14T11:16:30.608 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.611+0000 7fb394928800 20 remove_watcher() i=1 2024-09-14T11:16:30.610 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.612+0000 7fb394928800 20 remove_watcher() i=2 2024-09-14T11:16:30.611 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.613+0000 7fb394928800 20 remove_watcher() i=3 2024-09-14T11:16:30.612 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.614+0000 7fb394928800 20 remove_watcher() i=4 2024-09-14T11:16:30.613 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.615+0000 7fb394928800 20 remove_watcher() i=5 2024-09-14T11:16:30.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.616+0000 7fb394928800 20 remove_watcher() i=6 2024-09-14T11:16:30.615 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.617+0000 7fb394928800 20 remove_watcher() i=7 2024-09-14T11:16:30.629 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-14T11:16:30.661 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:30.661 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:30.701 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.703+0000 7f62d5f25800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.703 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.704+0000 7f62d5f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:30.703 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.704+0000 7f62d5f25800 20 realm 2024-09-14T11:16:30.703 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.704+0000 7f62d5f25800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.703 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.705+0000 7f62d5f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:30.703 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.705+0000 7f62d5f25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:30.703 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.705+0000 7f62d5f25800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.703 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.705+0000 7f62d5f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:30.703 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.705+0000 7f62d5f25800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.703 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.705+0000 7f62d5f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:30.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.705+0000 7f62d5f25800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.706+0000 7f62d5f25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:30.704 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.706+0000 7f62d5f25800 20 searching for the correct realm 2024-09-14T11:16:30.707 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.709+0000 7f62d13ad640 0 -- 172.21.15.50:0/2009732084 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f62cc0b3a10 msgr2=0x7f62cc0b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:30.914 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.916+0000 7f62d13ad640 0 -- 172.21.15.50:0/2009732084 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x564562575960 msgr2=0x564562577d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:30.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.920+0000 7f62d5f25800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:16:30.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.920+0000 7f62d5f25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:30.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.920+0000 7f62d5f25800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:16:30.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.920+0000 7f62d5f25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:30.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.920+0000 7f62d5f25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:30.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.920+0000 7f62d5f25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:30.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.920+0000 7f62d5f25800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.921+0000 7f62d5f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:30.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.921+0000 7f62d5f25800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.921+0000 7f62d5f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:30.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.921+0000 7f62d5f25800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.921+0000 7f62d5f25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:30.920 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.921+0000 7f62d5f25800 20 zone default found 2024-09-14T11:16:30.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.921+0000 7f62d5f25800 4 Realm: () 2024-09-14T11:16:30.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.921+0000 7f62d5f25800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:16:30.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.921+0000 7f62d5f25800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:16:30.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.921+0000 7f62d5f25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:30.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.921+0000 7f62d5f25800 20 zonegroup default 2024-09-14T11:16:30.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.921+0000 7f62d5f25800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.922+0000 7f62d5f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:30.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.922+0000 7f62d5f25800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.922+0000 7f62d5f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:30.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.922+0000 7f62d5f25800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.922+0000 7f62d5f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:30.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.922+0000 7f62d5f25800 20 started sync module instance, tier type = 2024-09-14T11:16:30.921 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.922+0000 7f62d5f25800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:16:30.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.933+0000 7f62d5f25800 20 add_watcher() i=0 2024-09-14T11:16:30.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.933+0000 7f62d5f25800 20 add_watcher() i=1 2024-09-14T11:16:30.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.933+0000 7f62d5f25800 20 add_watcher() i=2 2024-09-14T11:16:30.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.933+0000 7f62d5f25800 20 add_watcher() i=3 2024-09-14T11:16:30.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.933+0000 7f62d5f25800 20 add_watcher() i=4 2024-09-14T11:16:30.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.933+0000 7f62d5f25800 20 add_watcher() i=5 2024-09-14T11:16:30.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.933+0000 7f62d5f25800 20 add_watcher() i=6 2024-09-14T11:16:30.932 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.934+0000 7f62d5f25800 20 add_watcher() i=7 2024-09-14T11:16:30.932 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.934+0000 7f62d5f25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:30.933 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.935+0000 7f6183fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:30.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.936+0000 7f62d5f25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:30.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.936+0000 7f62d5f25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:30.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.936+0000 7f62d5f25800 5 note: GC not initialized 2024-09-14T11:16:30.935 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.936+0000 7f6182ffd640 20 reqs_thread_entry: start 2024-09-14T11:16:30.935 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.936+0000 7f62d5f25800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:30.935 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.936+0000 7f62d5f25800 20 Filter name: none 2024-09-14T11:16:30.935 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.936+0000 7f6180ff9640 20 reqs_thread_entry: start 2024-09-14T11:16:30.935 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.936+0000 7f62d5f25800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:16:30.935 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.936+0000 7f62d5f25800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.937+0000 7f62d5f25800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:16:30.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.937+0000 7f62d5f25800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:16:30.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.937+0000 7f62d5f25800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:16:30.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.937+0000 7f62d5f25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : miss 2024-09-14T11:16:30.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.937+0000 7f62d5f25800 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.937+0000 7f62d5f25800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:16:30.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.937+0000 7f62d5f25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:16:30.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.937+0000 7f62d5f25800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:16:30.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.937+0000 7f62d5f25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:30.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.937+0000 7f62d5f25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:30.936 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.937+0000 7f62d5f25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:16:30.939 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.941+0000 7f62d5f25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:16:30.939 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.941+0000 7f62d5f25800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:16:30.939 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.941+0000 7f62d5f25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:30.939 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.941+0000 7f62d5f25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18, ofs0, ns] 2024-09-14T11:16:30.939 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.941+0000 7f61b4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497137 cookie 94856002699744 notifier 8051 bl.length()=911 2024-09-14T11:16:30.940 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.941+0000 7f61b4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:16:30.940 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.941+0000 7f61b4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:16:30.940 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.941+0000 7f61b4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:30.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.943+0000 7f62d5f25800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_sources= new_sources= 2024-09-14T11:16:30.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.943+0000 7f62d5f25800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential sources added=[] removed=[] 2024-09-14T11:16:30.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.943+0000 7f62d5f25800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_dests= new_dests= 2024-09-14T11:16:30.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.943+0000 7f62d5f25800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential dests added=[] removed=[] 2024-09-14T11:16:30.948 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.950+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.0 2024-09-14T11:16:30.948 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.950+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.0 2024-09-14T11:16:30.948 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.950+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:16:30.948 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.950+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:16:30.948 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.950+0000 7f62d5f25800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-14T11:16:30.949 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.950+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:16:30.949 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.950+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:16:30.949 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.951+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:16:30.949 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.951+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:16:30.949 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.951+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:16:30.949 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.951+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:16:30.950 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.952+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:16:30.950 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.952+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:16:30.950 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.952+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:16:30.950 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.952+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:16:30.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.953+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:16:30.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.953+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:16:30.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.953+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:16:30.952 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.953+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:16:30.952 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.954+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:16:30.952 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.954+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:16:30.953 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.954+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:16:30.953 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.954+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:16:30.953 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.955+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:16:30.953 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.955+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:16:30.953 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.955+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:16:30.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.955+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:16:30.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.956+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:16:30.954 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.956+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:16:30.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.957+0000 7f62d5f25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:30.955 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.957+0000 7f62d5f25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:16:30.956 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.958+0000 7f62d5f25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:16:30.956 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.958+0000 7f62d5f25800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:16:30.956 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.958+0000 7f62d5f25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:30.956 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.958+0000 7f62d5f25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18, ofs0, ns] 2024-09-14T11:16:30.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.958+0000 7f61b4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497138 cookie 94856002699744 notifier 8051 bl.length()=911 2024-09-14T11:16:30.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.958+0000 7f61b4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:16:30.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.958+0000 7f61b4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:16:30.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.958+0000 7f61b4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:30.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.960+0000 7f62d5f25800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_sources= new_sources= 2024-09-14T11:16:30.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.960+0000 7f62d5f25800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential sources added=[] removed=[] 2024-09-14T11:16:30.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.960+0000 7f62d5f25800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_dests= new_dests= 2024-09-14T11:16:30.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.960+0000 7f62d5f25800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential dests added=[] removed=[] 2024-09-14T11:16:30.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.962+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:16:30.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.962+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.0 2024-09-14T11:16:30.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.963+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:16:30.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.963+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.1 2024-09-14T11:16:30.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.963+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:16:30.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.963+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.2 2024-09-14T11:16:30.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.963+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:16:30.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.963+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.3 2024-09-14T11:16:30.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.964+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:16:30.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.964+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.4 2024-09-14T11:16:30.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.964+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:16:30.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.964+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.5 2024-09-14T11:16:30.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.964+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:16:30.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.964+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.6 2024-09-14T11:16:30.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.965+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:16:30.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.965+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.7 2024-09-14T11:16:30.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.965+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:16:30.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.965+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.8 2024-09-14T11:16:30.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.965+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:16:30.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.965+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.9 2024-09-14T11:16:30.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.966+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:16:30.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.966+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.10 2024-09-14T11:16:30.965 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.966+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:16:30.965 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.966+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.11 2024-09-14T11:16:30.965 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.966+0000 7f62d5f25800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:16:30.965 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.966+0000 7f62d5f25800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.2.12 2024-09-14T11:16:30.965 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.967+0000 7f62d5f25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:30.965 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.967+0000 7f62d5f25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 2024-09-14T11:16:30.966 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.968+0000 7f62d5f25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:16:30.966 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.968+0000 7f62d5f25800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:16:30.967 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.968+0000 7f62d5f25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:30.967 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.968+0000 7f62d5f25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18, ofs0, ns] 2024-09-14T11:16:30.967 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.968+0000 7f61b4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497139 cookie 94856002699744 notifier 8051 bl.length()=879 2024-09-14T11:16:30.967 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.968+0000 7f61b4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 info.flags=0x17 2024-09-14T11:16:30.967 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.968+0000 7f61b4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18 to cache LRU end 2024-09-14T11:16:30.967 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.968+0000 7f61b4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:30.968 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.970+0000 7f62d5f25800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_sources= new_sources= 2024-09-14T11:16:30.968 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.970+0000 7f62d5f25800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential sources added=[] removed=[] 2024-09-14T11:16:30.968 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.970+0000 7f62d5f25800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): orig_dests= new_dests= 2024-09-14T11:16:30.968 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.970+0000 7f62d5f25800 20 handle_bi_update(): bucket=:a-bucket[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18]): potential dests added=[] removed=[] 2024-09-14T11:16:30.970 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.972+0000 7f62d5f25800 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-14T11:16:30.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.974+0000 7f6183fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:30.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.976+0000 7f62d5f25800 20 remove_watcher() i=0 2024-09-14T11:16:30.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.976+0000 7f62d5f25800 2 removed watcher, disabling cache 2024-09-14T11:16:30.975 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.977+0000 7f62d5f25800 20 remove_watcher() i=1 2024-09-14T11:16:30.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.978+0000 7f62d5f25800 20 remove_watcher() i=2 2024-09-14T11:16:30.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.979+0000 7f62d5f25800 20 remove_watcher() i=3 2024-09-14T11:16:30.978 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.980+0000 7f62d5f25800 20 remove_watcher() i=4 2024-09-14T11:16:30.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.981+0000 7f62d5f25800 20 remove_watcher() i=5 2024-09-14T11:16:30.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.982+0000 7f62d5f25800 20 remove_watcher() i=6 2024-09-14T11:16:30.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:30.984+0000 7f62d5f25800 20 remove_watcher() i=7 2024-09-14T11:16:30.994 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:16:31.023 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:31.023 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:31.062 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.064+0000 7f7fc032a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.066+0000 7f7fc032a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.066+0000 7f7fc032a800 20 realm 2024-09-14T11:16:31.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.066+0000 7f7fc032a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.066+0000 7f7fc032a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.066+0000 7f7fc032a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:31.064 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.066+0000 7f7fc032a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.065 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.066+0000 7f7fc032a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.065 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.066+0000 7f7fc032a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.065 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.067+0000 7f7fc032a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:31.065 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.067+0000 7f7fc032a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.066 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.068+0000 7f7fc032a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:31.066 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.068+0000 7f7fc032a800 20 searching for the correct realm 2024-09-14T11:16:31.069 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.071+0000 7f7fbb8d9640 0 -- 172.21.15.50:0/1701874242 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f7fb40ab130 msgr2=0x7f7fb40af990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:31.275 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.277+0000 7f7fbc8db640 0 -- 172.21.15.50:0/1701874242 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5636b1b47aa0 msgr2=0x5636b1b49f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:31.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.282+0000 7f7fc032a800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:16:31.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.282+0000 7f7fc032a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:31.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.282+0000 7f7fc032a800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:16:31.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.282+0000 7f7fc032a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:31.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.282+0000 7f7fc032a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:31.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.282+0000 7f7fc032a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:31.280 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.282+0000 7f7fc032a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.282+0000 7f7fc032a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.282+0000 7f7fc032a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.282+0000 7f7fc032a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:31.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.282+0000 7f7fc032a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.281 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.283+0000 7f7fc032a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:31.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.283+0000 7f7fc032a800 20 zone default found 2024-09-14T11:16:31.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.283+0000 7f7fc032a800 4 Realm: () 2024-09-14T11:16:31.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.283+0000 7f7fc032a800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:16:31.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.283+0000 7f7fc032a800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:16:31.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.283+0000 7f7fc032a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:31.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.283+0000 7f7fc032a800 20 zonegroup default 2024-09-14T11:16:31.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.283+0000 7f7fc032a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.283+0000 7f7fc032a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.283+0000 7f7fc032a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.283+0000 7f7fc032a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.282 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.283+0000 7f7fc032a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.284+0000 7f7fc032a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.284+0000 7f7fc032a800 20 started sync module instance, tier type = 2024-09-14T11:16:31.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.284+0000 7f7fc032a800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:16:31.291 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.293+0000 7f7fc032a800 20 add_watcher() i=0 2024-09-14T11:16:31.291 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.293+0000 7f7fc032a800 20 add_watcher() i=1 2024-09-14T11:16:31.291 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.293+0000 7f7fc032a800 20 add_watcher() i=2 2024-09-14T11:16:31.291 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.293+0000 7f7fc032a800 20 add_watcher() i=3 2024-09-14T11:16:31.291 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.293+0000 7f7fc032a800 20 add_watcher() i=4 2024-09-14T11:16:31.291 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.293+0000 7f7fc032a800 20 add_watcher() i=5 2024-09-14T11:16:31.291 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.293+0000 7f7fc032a800 20 add_watcher() i=6 2024-09-14T11:16:31.291 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.294+0000 7f7fc032a800 20 add_watcher() i=7 2024-09-14T11:16:31.292 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.294+0000 7f7fc032a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:31.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.295+0000 7f7e727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:31.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.296+0000 7f7fc032a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:31.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.296+0000 7f7fc032a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:31.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.296+0000 7f7fc032a800 5 note: GC not initialized 2024-09-14T11:16:31.294 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.296+0000 7f7e717e2640 20 reqs_thread_entry: start 2024-09-14T11:16:31.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.296+0000 7f7fc032a800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:31.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.296+0000 7f7fc032a800 20 Filter name: none 2024-09-14T11:16:31.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.296+0000 7f7de2ffd640 20 reqs_thread_entry: start 2024-09-14T11:16:31.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.296+0000 7f7fc032a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.297+0000 7f7fc032a800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:16:31.295 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.297+0000 7f7fc032a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.297+0000 7f7fc032a800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:16:31.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.297+0000 7f7fc032a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:31.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.297+0000 7f7fc032a800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-14T11:16:31.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.297+0000 7f7fc032a800 20 INFO: main: starting shard=0 2024-09-14T11:16:31.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.297+0000 7f7fc032a800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.0 2024-09-14T11:16:31.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.297+0000 7f7fc032a800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18.3.0 2024-09-14T11:16:31.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.298+0000 7f7fc032a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:31.296 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.298+0000 7f7fc032a800 20 INFO: main: done 2024-09-14T11:16:31.297 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.299+0000 7f7e727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:31.299 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.301+0000 7f7fc032a800 20 remove_watcher() i=0 2024-09-14T11:16:31.299 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.301+0000 7f7fc032a800 2 removed watcher, disabling cache 2024-09-14T11:16:31.300 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.302+0000 7f7fc032a800 20 remove_watcher() i=1 2024-09-14T11:16:31.301 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.303+0000 7f7fc032a800 20 remove_watcher() i=2 2024-09-14T11:16:31.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.304+0000 7f7fc032a800 20 remove_watcher() i=3 2024-09-14T11:16:31.303 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.305+0000 7f7fc032a800 20 remove_watcher() i=4 2024-09-14T11:16:31.304 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.306+0000 7f7fc032a800 20 remove_watcher() i=5 2024-09-14T11:16:31.305 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.307+0000 7f7fc032a800 20 remove_watcher() i=6 2024-09-14T11:16:31.306 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.308+0000 7f7fc032a800 20 remove_watcher() i=7 2024-09-14T11:16:31.318 INFO:tasks.workunit.client.0.smithi050.stderr: test: PUT succeeds during reshard 2024-09-14T11:16:31.319 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:16:31.348 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:31.349 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:31.388 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.389+0000 7f66f6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.391+0000 7f66f6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.391+0000 7f66f6c40800 20 realm 2024-09-14T11:16:31.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.391+0000 7f66f6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.392+0000 7f66f6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.392+0000 7f66f6c40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:31.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.392+0000 7f66f6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.392+0000 7f66f6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.390 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.392+0000 7f66f6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.393+0000 7f66f6c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:31.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.393+0000 7f66f6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.393+0000 7f66f6c40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:31.391 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.393+0000 7f66f6c40800 20 searching for the correct realm 2024-09-14T11:16:31.394 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.396+0000 7f66f3f29640 0 -- 172.21.15.50:0/670073333 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f66ec0a9930 msgr2=0x7f66ec0aa950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:31.599 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.601+0000 7f66f4f2b640 0 -- 172.21.15.50:0/670073333 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55753703fa20 msgr2=0x557537041e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:31.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.605+0000 7f66f6c40800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:16:31.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.605+0000 7f66f6c40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:31.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.605+0000 7f66f6c40800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:16:31.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.605+0000 7f66f6c40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:31.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.605+0000 7f66f6c40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:31.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.605+0000 7f66f6c40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:31.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.606+0000 7f66f6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.606+0000 7f66f6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.604 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.606+0000 7f66f6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.606+0000 7f66f6c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:31.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.606+0000 7f66f6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.605 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.606+0000 7f66f6c40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:31.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.606+0000 7f66f6c40800 20 zone default found 2024-09-14T11:16:31.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.606+0000 7f66f6c40800 4 Realm: () 2024-09-14T11:16:31.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.606+0000 7f66f6c40800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:16:31.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.606+0000 7f66f6c40800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:16:31.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.606+0000 7f66f6c40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:31.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.606+0000 7f66f6c40800 20 zonegroup default 2024-09-14T11:16:31.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.606+0000 7f66f6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.607+0000 7f66f6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.607+0000 7f66f6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.607+0000 7f66f6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.607+0000 7f66f6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.607+0000 7f66f6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.607+0000 7f66f6c40800 20 started sync module instance, tier type = 2024-09-14T11:16:31.606 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.607+0000 7f66f6c40800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:16:31.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.616+0000 7f66f6c40800 20 add_watcher() i=0 2024-09-14T11:16:31.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.616+0000 7f66f6c40800 20 add_watcher() i=1 2024-09-14T11:16:31.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.616+0000 7f66f6c40800 20 add_watcher() i=2 2024-09-14T11:16:31.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.616+0000 7f66f6c40800 20 add_watcher() i=3 2024-09-14T11:16:31.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.616+0000 7f66f6c40800 20 add_watcher() i=4 2024-09-14T11:16:31.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.616+0000 7f66f6c40800 20 add_watcher() i=5 2024-09-14T11:16:31.614 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.616+0000 7f66f6c40800 20 add_watcher() i=6 2024-09-14T11:16:31.615 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.617+0000 7f66f6c40800 20 add_watcher() i=7 2024-09-14T11:16:31.615 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.617+0000 7f66f6c40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:31.616 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.618+0000 7f65aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:31.617 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.619+0000 7f66f6c40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:31.617 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.619+0000 7f66f6c40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:31.618 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.619+0000 7f66f6c40800 5 note: GC not initialized 2024-09-14T11:16:31.618 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.619+0000 7f65a9fe3640 20 reqs_thread_entry: start 2024-09-14T11:16:31.618 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.619+0000 7f66f6c40800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:31.618 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.619+0000 7f66f6c40800 20 Filter name: none 2024-09-14T11:16:31.618 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.619+0000 7f65a37fe640 20 reqs_thread_entry: start 2024-09-14T11:16:31.618 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.619+0000 7f66f6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.620+0000 7f66f6c40800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:31.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.620+0000 7f66f6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.620+0000 7f66f6c40800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:31.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.620+0000 7f66f6c40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:31.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.620+0000 7f66f6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.621+0000 7f66f6c40800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:31.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.621+0000 7f66f6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.621+0000 7f66f6c40800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:31.619 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.621+0000 7f66f6c40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:31.621 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.623+0000 7f65aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:31.623 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.625+0000 7f66f6c40800 20 remove_watcher() i=0 2024-09-14T11:16:31.623 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.625+0000 7f66f6c40800 2 removed watcher, disabling cache 2024-09-14T11:16:31.624 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.626+0000 7f66f6c40800 20 remove_watcher() i=1 2024-09-14T11:16:31.625 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.627+0000 7f66f6c40800 20 remove_watcher() i=2 2024-09-14T11:16:31.626 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.628+0000 7f66f6c40800 20 remove_watcher() i=3 2024-09-14T11:16:31.627 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.629+0000 7f66f6c40800 20 remove_watcher() i=4 2024-09-14T11:16:31.628 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.630+0000 7f66f6c40800 20 remove_watcher() i=5 2024-09-14T11:16:31.629 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.631+0000 7f66f6c40800 20 remove_watcher() i=6 2024-09-14T11:16:31.630 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.632+0000 7f66f6c40800 20 remove_watcher() i=7 2024-09-14T11:16:31.641 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:16:31.641 INFO:tasks.workunit.client.0.smithi050.stderr:BUCKET_STATS: 2024-09-14T11:16:31.642 INFO:tasks.workunit.client.0.smithi050.stderr:bucket: myver id: c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:16:31.642 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:16:31.643 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-14T11:16:31.677 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:31.678 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:31.717 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.718+0000 7f50b3746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.718 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.720+0000 7f50b3746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.720+0000 7f50b3746800 20 realm 2024-09-14T11:16:31.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.720+0000 7f50b3746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.720+0000 7f50b3746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.720+0000 7f50b3746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:31.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.720+0000 7f50b3746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.721+0000 7f50b3746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.719 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.721+0000 7f50b3746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.720 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.721+0000 7f50b3746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:31.720 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.721+0000 7f50b3746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.720 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.722+0000 7f50b3746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:31.720 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.722+0000 7f50b3746800 20 searching for the correct realm 2024-09-14T11:16:31.722 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.724+0000 7f50b0a36640 0 -- 172.21.15.50:0/2787275531 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f50ac084400 msgr2=0x7f50ac084880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:31.927 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.929+0000 7f50b1a38640 0 -- 172.21.15.50:0/2787275531 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5624c846f3a0 msgr2=0x5624c8471810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:31.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.933+0000 7f50b3746800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:16:31.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.933+0000 7f50b3746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:31.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.933+0000 7f50b3746800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:16:31.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.933+0000 7f50b3746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:31.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.933+0000 7f50b3746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:31.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.933+0000 7f50b3746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:31.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.933+0000 7f50b3746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.931 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.933+0000 7f50b3746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.932 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.933+0000 7f50b3746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.933 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.933+0000 7f50b3746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:31.933 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.933+0000 7f50b3746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.933 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.934+0000 7f50b3746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:31.933 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.934+0000 7f50b3746800 20 zone default found 2024-09-14T11:16:31.933 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.934+0000 7f50b3746800 4 Realm: () 2024-09-14T11:16:31.933 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.934+0000 7f50b3746800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:16:31.933 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.934+0000 7f50b3746800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:16:31.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.934+0000 7f50b3746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:31.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.934+0000 7f50b3746800 20 zonegroup default 2024-09-14T11:16:31.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.934+0000 7f50b3746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.934+0000 7f50b3746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.934+0000 7f50b3746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.934+0000 7f50b3746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.934+0000 7f50b3746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.934+0000 7f50b3746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.934+0000 7f50b3746800 20 started sync module instance, tier type = 2024-09-14T11:16:31.934 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.934+0000 7f50b3746800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:16:31.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.943+0000 7f50b3746800 20 add_watcher() i=0 2024-09-14T11:16:31.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.943+0000 7f50b3746800 20 add_watcher() i=1 2024-09-14T11:16:31.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.943+0000 7f50b3746800 20 add_watcher() i=2 2024-09-14T11:16:31.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.943+0000 7f50b3746800 20 add_watcher() i=3 2024-09-14T11:16:31.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.943+0000 7f50b3746800 20 add_watcher() i=4 2024-09-14T11:16:31.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.943+0000 7f50b3746800 20 add_watcher() i=5 2024-09-14T11:16:31.941 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.943+0000 7f50b3746800 20 add_watcher() i=6 2024-09-14T11:16:31.942 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.944+0000 7f50b3746800 20 add_watcher() i=7 2024-09-14T11:16:31.942 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.944+0000 7f50b3746800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:31.943 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.945+0000 7f4f677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:31.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.946+0000 7f50b3746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:31.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.946+0000 7f50b3746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:31.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.946+0000 7f50b3746800 5 note: GC not initialized 2024-09-14T11:16:31.944 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.946+0000 7f4f667e4640 20 reqs_thread_entry: start 2024-09-14T11:16:31.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.946+0000 7f50b3746800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:31.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.946+0000 7f50b3746800 20 Filter name: none 2024-09-14T11:16:31.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.946+0000 7f4ed7fff640 20 reqs_thread_entry: start 2024-09-14T11:16:31.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.946+0000 7f50b3746800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:16:31.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.946+0000 7f50b3746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.945 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.947+0000 7f50b3746800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:31.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.947+0000 7f50b3746800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:16:31.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.947+0000 7f50b3746800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:16:31.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.947+0000 7f50b3746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 : miss 2024-09-14T11:16:31.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.947+0000 7f50b3746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.947+0000 7f50b3746800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:31.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.947+0000 7f50b3746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 info.flags=0x17 2024-09-14T11:16:31.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.947+0000 7f50b3746800 10 adding default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 to cache LRU end 2024-09-14T11:16:31.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.947+0000 7f50b3746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:31.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.947+0000 7f50b3746800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:31.946 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.947+0000 7f50b3746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 2024-09-14T11:16:31.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.952+0000 7f50b3746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 info.flags=0x17 2024-09-14T11:16:31.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.952+0000 7f50b3746800 10 moving default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 to cache LRU end 2024-09-14T11:16:31.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.952+0000 7f50b3746800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:31.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.952+0000 7f50b3746800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19, ofs0, ns] 2024-09-14T11:16:31.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.952+0000 7f4f94ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497086 cookie 94715978979840 notifier 8718 bl.length()=905 2024-09-14T11:16:31.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.952+0000 7f4f94ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 info.flags=0x17 2024-09-14T11:16:31.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.952+0000 7f4f94ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 to cache LRU end 2024-09-14T11:16:31.951 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.953+0000 7f4f94ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:31.952 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.954+0000 7f50b3746800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): orig_sources= new_sources= 2024-09-14T11:16:31.952 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.954+0000 7f50b3746800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): potential sources added=[] removed=[] 2024-09-14T11:16:31.952 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.954+0000 7f50b3746800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): orig_dests= new_dests= 2024-09-14T11:16:31.953 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.954+0000 7f50b3746800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): potential dests added=[] removed=[] 2024-09-14T11:16:31.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:31.959+0000 7f50b3746800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-14T11:16:32.648 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:32.648 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:32.712 INFO:tasks.workunit.client.0.smithi050.stderr:put object successful 2024-09-14T11:16:36.957 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.0 2024-09-14T11:16:36.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.0 2024-09-14T11:16:36.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.1 2024-09-14T11:16:36.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.1 2024-09-14T11:16:36.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.2 2024-09-14T11:16:36.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.2 2024-09-14T11:16:36.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.3 2024-09-14T11:16:36.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.3 2024-09-14T11:16:36.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.4 2024-09-14T11:16:36.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.4 2024-09-14T11:16:36.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.5 2024-09-14T11:16:36.958 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.5 2024-09-14T11:16:36.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.6 2024-09-14T11:16:36.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.6 2024-09-14T11:16:36.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.7 2024-09-14T11:16:36.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.7 2024-09-14T11:16:36.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.8 2024-09-14T11:16:36.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.8 2024-09-14T11:16:36.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.9 2024-09-14T11:16:36.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.9 2024-09-14T11:16:36.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.10 2024-09-14T11:16:36.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.10 2024-09-14T11:16:36.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.11 2024-09-14T11:16:36.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.11 2024-09-14T11:16:36.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.12 2024-09-14T11:16:36.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.12 2024-09-14T11:16:36.959 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.0 2024-09-14T11:16:36.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.959+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.0 2024-09-14T11:16:36.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.960+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.1 2024-09-14T11:16:36.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.960+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.1 2024-09-14T11:16:36.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.961+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.2 2024-09-14T11:16:36.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.961+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.2 2024-09-14T11:16:36.960 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.962+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.3 2024-09-14T11:16:36.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.962+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.3 2024-09-14T11:16:36.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.963+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.4 2024-09-14T11:16:36.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.963+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.4 2024-09-14T11:16:36.961 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.963+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.5 2024-09-14T11:16:36.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.963+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.5 2024-09-14T11:16:36.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.964+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.6 2024-09-14T11:16:36.962 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.964+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.6 2024-09-14T11:16:36.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.965+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.7 2024-09-14T11:16:36.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.965+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.7 2024-09-14T11:16:36.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.965+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.8 2024-09-14T11:16:36.963 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.965+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.8 2024-09-14T11:16:36.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.966+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.9 2024-09-14T11:16:36.964 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.966+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.9 2024-09-14T11:16:36.965 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.967+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.10 2024-09-14T11:16:36.965 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.967+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.10 2024-09-14T11:16:36.965 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.967+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.11 2024-09-14T11:16:36.965 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.967+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.11 2024-09-14T11:16:36.969 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.971+0000 7f50b3746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:36.969 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.971+0000 7f50b3746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 2024-09-14T11:16:36.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.973+0000 7f50b3746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 info.flags=0x17 2024-09-14T11:16:36.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.973+0000 7f50b3746800 10 moving default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 to cache LRU end 2024-09-14T11:16:36.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.973+0000 7f50b3746800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:36.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.973+0000 7f50b3746800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19, ofs0, ns] 2024-09-14T11:16:36.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.973+0000 7f4f94ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497087 cookie 94715978979840 notifier 8718 bl.length()=905 2024-09-14T11:16:36.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.973+0000 7f4f94ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 info.flags=0x17 2024-09-14T11:16:36.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.973+0000 7f4f94ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 to cache LRU end 2024-09-14T11:16:36.972 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.973+0000 7f4f94ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:36.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.976+0000 7f50b3746800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): orig_sources= new_sources= 2024-09-14T11:16:36.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.976+0000 7f50b3746800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): potential sources added=[] removed=[] 2024-09-14T11:16:36.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.976+0000 7f50b3746800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): orig_dests= new_dests= 2024-09-14T11:16:36.974 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.976+0000 7f50b3746800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): potential dests added=[] removed=[] 2024-09-14T11:16:36.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.979+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.0 2024-09-14T11:16:36.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.979+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.0 2024-09-14T11:16:36.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.979+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.1 2024-09-14T11:16:36.978 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.979+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.1 2024-09-14T11:16:36.978 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.980+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.2 2024-09-14T11:16:36.978 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.980+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.2 2024-09-14T11:16:36.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.980+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.3 2024-09-14T11:16:36.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.980+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.3 2024-09-14T11:16:36.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.981+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.4 2024-09-14T11:16:36.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.981+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.4 2024-09-14T11:16:36.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.981+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.5 2024-09-14T11:16:36.979 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.981+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.5 2024-09-14T11:16:36.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.982+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.6 2024-09-14T11:16:36.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.982+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.6 2024-09-14T11:16:36.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.982+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.7 2024-09-14T11:16:36.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.982+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.7 2024-09-14T11:16:36.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.982+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.8 2024-09-14T11:16:36.980 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.982+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.8 2024-09-14T11:16:36.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.983+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.9 2024-09-14T11:16:36.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.983+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.9 2024-09-14T11:16:36.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.983+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.10 2024-09-14T11:16:36.981 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.983+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.10 2024-09-14T11:16:36.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.984+0000 7f50b3746800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.11 2024-09-14T11:16:36.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.984+0000 7f50b3746800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.1.11 2024-09-14T11:16:36.985 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.987+0000 7f50b3746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:36.985 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.987+0000 7f50b3746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 2024-09-14T11:16:36.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.988+0000 7f50b3746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 info.flags=0x17 2024-09-14T11:16:36.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.988+0000 7f50b3746800 10 moving default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 to cache LRU end 2024-09-14T11:16:36.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.988+0000 7f50b3746800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:36.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.988+0000 7f50b3746800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19, ofs0, ns] 2024-09-14T11:16:36.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.989+0000 7f4f94ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497088 cookie 94715978979840 notifier 8718 bl.length()=873 2024-09-14T11:16:36.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.989+0000 7f4f94ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 info.flags=0x17 2024-09-14T11:16:36.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.989+0000 7f4f94ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 to cache LRU end 2024-09-14T11:16:36.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.989+0000 7f4f94ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:36.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.991+0000 7f4f83fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497089 cookie 94715978979840 notifier 8718 bl.length()=873 2024-09-14T11:16:36.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.991+0000 7f4f83fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 info.flags=0x17 2024-09-14T11:16:36.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.991+0000 7f4f83fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 to cache LRU end 2024-09-14T11:16:36.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.991+0000 7f4f83fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:36.990 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.992+0000 7f50b3746800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): orig_sources= new_sources= 2024-09-14T11:16:36.990 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.992+0000 7f50b3746800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): potential sources added=[] removed=[] 2024-09-14T11:16:36.990 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.992+0000 7f50b3746800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): orig_dests= new_dests= 2024-09-14T11:16:36.990 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.992+0000 7f50b3746800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): potential dests added=[] removed=[] 2024-09-14T11:16:36.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.995+0000 7f50b3746800 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-14T11:16:36.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:36.997+0000 7f4f677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:36.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:37.000+0000 7f50b3746800 20 remove_watcher() i=0 2024-09-14T11:16:36.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:37.000+0000 7f50b3746800 2 removed watcher, disabling cache 2024-09-14T11:16:36.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:37.001+0000 7f50b3746800 20 remove_watcher() i=1 2024-09-14T11:16:37.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:37.003+0000 7f50b3746800 20 remove_watcher() i=2 2024-09-14T11:16:37.002 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:37.004+0000 7f50b3746800 20 remove_watcher() i=3 2024-09-14T11:16:37.004 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:37.006+0000 7f50b3746800 20 remove_watcher() i=4 2024-09-14T11:16:37.005 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:37.007+0000 7f50b3746800 20 remove_watcher() i=5 2024-09-14T11:16:37.006 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:37.008+0000 7f50b3746800 20 remove_watcher() i=6 2024-09-14T11:16:37.007 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:37.009+0000 7f50b3746800 20 remove_watcher() i=7 2024-09-14T11:16:37.717 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-14T11:16:37.718 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T11:16:37.722 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:37.722 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:37.762 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:37.762 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:37.828 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:37.828 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:37.895 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:37.895 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:37.921 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:37.921 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:37.974 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:37.974 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:38.000 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:38.000 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:38.053 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:38.053 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:38.080 INFO:tasks.workunit.client.0.smithi050.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:16:38.501 INFO:tasks.workunit.client.0.smithi050.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:16:39.915 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:39.915 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:40.009 INFO:tasks.workunit.client.0.smithi050.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:16:40.011 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-14T11:16:40.045 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:40.045 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:40.087 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.088+0000 7fc4ec32c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.090+0000 7fc4ec32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:40.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.090+0000 7fc4ec32c800 20 realm 2024-09-14T11:16:40.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.090+0000 7fc4ec32c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.091+0000 7fc4ec32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:40.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.091+0000 7fc4ec32c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:40.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.091+0000 7fc4ec32c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.091+0000 7fc4ec32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:40.090 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.091+0000 7fc4ec32c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.092+0000 7fc4ec32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:40.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.092+0000 7fc4ec32c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.092+0000 7fc4ec32c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:40.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.092+0000 7fc4ec32c800 20 searching for the correct realm 2024-09-14T11:16:40.094 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.096+0000 7fc4e7744640 0 -- 172.21.15.50:0/2650559525 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fc4e007c920 msgr2=0x7fc4e006b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:40.302 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.303+0000 7fc4e8746640 0 -- 172.21.15.50:0/2650559525 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55bb939f89a0 msgr2=0x55bb939fadb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:40.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.308+0000 7fc4ec32c800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:16:40.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.308+0000 7fc4ec32c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:40.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.308+0000 7fc4ec32c800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:16:40.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.308+0000 7fc4ec32c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:40.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.308+0000 7fc4ec32c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:40.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.308+0000 7fc4ec32c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:40.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.308+0000 7fc4ec32c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.308+0000 7fc4ec32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:40.307 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.308+0000 7fc4ec32c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.308 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.308+0000 7fc4ec32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:40.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.308+0000 7fc4ec32c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.309+0000 7fc4ec32c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:40.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.309+0000 7fc4ec32c800 20 zone default found 2024-09-14T11:16:40.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.309+0000 7fc4ec32c800 4 Realm: () 2024-09-14T11:16:40.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.309+0000 7fc4ec32c800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:16:40.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.309+0000 7fc4ec32c800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:16:40.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.309+0000 7fc4ec32c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:40.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.309+0000 7fc4ec32c800 20 zonegroup default 2024-09-14T11:16:40.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.309+0000 7fc4ec32c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.309+0000 7fc4ec32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:40.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.309+0000 7fc4ec32c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.309+0000 7fc4ec32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:40.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.309+0000 7fc4ec32c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.309 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.310+0000 7fc4ec32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:40.310 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.310+0000 7fc4ec32c800 20 started sync module instance, tier type = 2024-09-14T11:16:40.310 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.310+0000 7fc4ec32c800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:16:40.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.320+0000 7fc4ec32c800 20 add_watcher() i=0 2024-09-14T11:16:40.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.320+0000 7fc4ec32c800 20 add_watcher() i=1 2024-09-14T11:16:40.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.320+0000 7fc4ec32c800 20 add_watcher() i=2 2024-09-14T11:16:40.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.320+0000 7fc4ec32c800 20 add_watcher() i=3 2024-09-14T11:16:40.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.320+0000 7fc4ec32c800 20 add_watcher() i=4 2024-09-14T11:16:40.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.320+0000 7fc4ec32c800 20 add_watcher() i=5 2024-09-14T11:16:40.319 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.320+0000 7fc4ec32c800 20 add_watcher() i=6 2024-09-14T11:16:40.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.321+0000 7fc4ec32c800 20 add_watcher() i=7 2024-09-14T11:16:40.320 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.321+0000 7fc4ec32c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:40.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.322+0000 7fc39dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:40.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.323+0000 7fc4ec32c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:40.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.323+0000 7fc4ec32c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:40.322 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.323+0000 7fc4ec32c800 5 note: GC not initialized 2024-09-14T11:16:40.323 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.323+0000 7fc39cfe1640 20 reqs_thread_entry: start 2024-09-14T11:16:40.323 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.323+0000 7fc4ec32c800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:40.323 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.323+0000 7fc4ec32c800 20 Filter name: none 2024-09-14T11:16:40.323 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.323+0000 7fc3167fc640 20 reqs_thread_entry: start 2024-09-14T11:16:40.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.323+0000 7fc4ec32c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.324+0000 7fc4ec32c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:40.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.324+0000 7fc4ec32c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.324+0000 7fc4ec32c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:40.324 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.324+0000 7fc4ec32c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:40.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.324+0000 7fc4ec32c800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:16:40.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.324+0000 7fc4ec32c800 20 INFO: main: starting shard=0 2024-09-14T11:16:40.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.324+0000 7fc4ec32c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.0 2024-09-14T11:16:40.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.324+0000 7fc4ec32c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.0 2024-09-14T11:16:40.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.325+0000 7fc4ec32c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:40.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.325+0000 7fc4ec32c800 20 INFO: main: starting shard=1 2024-09-14T11:16:40.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.325+0000 7fc4ec32c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.1 2024-09-14T11:16:40.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.325+0000 7fc4ec32c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.1 2024-09-14T11:16:40.325 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.326+0000 7fc4ec32c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:40.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.326+0000 7fc4ec32c800 20 INFO: main: starting shard=2 2024-09-14T11:16:40.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.326+0000 7fc4ec32c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.2 2024-09-14T11:16:40.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.326+0000 7fc4ec32c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.2 2024-09-14T11:16:40.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.326+0000 7fc4ec32c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:40.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.326+0000 7fc4ec32c800 20 INFO: main: starting shard=3 2024-09-14T11:16:40.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.326+0000 7fc4ec32c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.3 2024-09-14T11:16:40.326 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.326+0000 7fc4ec32c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.3 2024-09-14T11:16:40.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.327+0000 7fc4ec32c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:40.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.327+0000 7fc4ec32c800 20 INFO: main: starting shard=4 2024-09-14T11:16:40.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.327+0000 7fc4ec32c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.4 2024-09-14T11:16:40.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.327+0000 7fc4ec32c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.4 2024-09-14T11:16:40.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.327+0000 7fc4ec32c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:40.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.327+0000 7fc4ec32c800 20 INFO: main: starting shard=5 2024-09-14T11:16:40.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.327+0000 7fc4ec32c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.5 2024-09-14T11:16:40.327 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.327+0000 7fc4ec32c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.5 2024-09-14T11:16:40.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.328+0000 7fc4ec32c800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:16:40.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.328+0000 7fc4ec32c800 20 INFO: main: starting shard=6 2024-09-14T11:16:40.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.328+0000 7fc4ec32c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.6 2024-09-14T11:16:40.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.328+0000 7fc4ec32c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.6 2024-09-14T11:16:40.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.328+0000 7fc4ec32c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:40.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.328+0000 7fc4ec32c800 20 INFO: main: starting shard=7 2024-09-14T11:16:40.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.328+0000 7fc4ec32c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.7 2024-09-14T11:16:40.328 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.328+0000 7fc4ec32c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.7 2024-09-14T11:16:40.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.329+0000 7fc4ec32c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:40.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.329+0000 7fc4ec32c800 20 INFO: main: starting shard=8 2024-09-14T11:16:40.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.329+0000 7fc4ec32c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.8 2024-09-14T11:16:40.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.329+0000 7fc4ec32c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.8 2024-09-14T11:16:40.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.330+0000 7fc4ec32c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:40.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.330+0000 7fc4ec32c800 20 INFO: main: starting shard=9 2024-09-14T11:16:40.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.330+0000 7fc4ec32c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.9 2024-09-14T11:16:40.329 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.330+0000 7fc4ec32c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.9 2024-09-14T11:16:40.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.330+0000 7fc4ec32c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:40.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.330+0000 7fc4ec32c800 20 INFO: main: starting shard=10 2024-09-14T11:16:40.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.330+0000 7fc4ec32c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.10 2024-09-14T11:16:40.330 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.330+0000 7fc4ec32c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.10 2024-09-14T11:16:40.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.331+0000 7fc4ec32c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:40.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.331+0000 7fc4ec32c800 20 INFO: main: starting shard=11 2024-09-14T11:16:40.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.331+0000 7fc4ec32c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.11 2024-09-14T11:16:40.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.331+0000 7fc4ec32c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.11 2024-09-14T11:16:40.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.331+0000 7fc4ec32c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:40.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.331+0000 7fc4ec32c800 20 INFO: main: starting shard=12 2024-09-14T11:16:40.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.331+0000 7fc4ec32c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.12 2024-09-14T11:16:40.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.331+0000 7fc4ec32c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.12 2024-09-14T11:16:40.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.332+0000 7fc4ec32c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:40.331 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.332+0000 7fc4ec32c800 20 INFO: main: done 2024-09-14T11:16:40.332 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.333+0000 7fc39dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:40.334 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.335+0000 7fc4ec32c800 20 remove_watcher() i=0 2024-09-14T11:16:40.334 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.335+0000 7fc4ec32c800 2 removed watcher, disabling cache 2024-09-14T11:16:40.335 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.336+0000 7fc4ec32c800 20 remove_watcher() i=1 2024-09-14T11:16:40.336 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.337+0000 7fc4ec32c800 20 remove_watcher() i=2 2024-09-14T11:16:40.337 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.338+0000 7fc4ec32c800 20 remove_watcher() i=3 2024-09-14T11:16:40.339 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.339+0000 7fc4ec32c800 20 remove_watcher() i=4 2024-09-14T11:16:40.340 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.341+0000 7fc4ec32c800 20 remove_watcher() i=5 2024-09-14T11:16:40.341 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.342+0000 7fc4ec32c800 20 remove_watcher() i=6 2024-09-14T11:16:40.342 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.343+0000 7fc4ec32c800 20 remove_watcher() i=7 2024-09-14T11:16:40.357 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:40.357 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:40.383 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:40.383 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:40.470 INFO:tasks.workunit.client.0.smithi050.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:16:40.472 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-14T11:16:40.503 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:40.504 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:40.542 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.543+0000 7fa84fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.544 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.545+0000 7fa84fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:40.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.545+0000 7fa84fd46800 20 realm 2024-09-14T11:16:40.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.545+0000 7fa84fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.545+0000 7fa84fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:40.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.545+0000 7fa84fd46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:40.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.545+0000 7fa84fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.546+0000 7fa84fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:40.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.546+0000 7fa84fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.545 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.546+0000 7fa84fd46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:40.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.546+0000 7fa84fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.547+0000 7fa84fd46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:40.546 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.547+0000 7fa84fd46800 20 searching for the correct realm 2024-09-14T11:16:40.549 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.550+0000 7fa84d02f640 0 -- 172.21.15.50:0/789545534 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fa848018070 msgr2=0x7fa848033420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:40.754 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.755+0000 7fa84e031640 0 -- 172.21.15.50:0/789545534 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x556e0e2974d0 msgr2=0x556e0e2998c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:40.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.760+0000 7fa84fd46800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:16:40.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.760+0000 7fa84fd46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:40.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.760+0000 7fa84fd46800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:16:40.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.760+0000 7fa84fd46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:40.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.760+0000 7fa84fd46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:40.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.760+0000 7fa84fd46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:40.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.760+0000 7fa84fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.760+0000 7fa84fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:40.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.760+0000 7fa84fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.760+0000 7fa84fd46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:40.760 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.760+0000 7fa84fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.761+0000 7fa84fd46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:40.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.761+0000 7fa84fd46800 20 zone default found 2024-09-14T11:16:40.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.761+0000 7fa84fd46800 4 Realm: () 2024-09-14T11:16:40.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.761+0000 7fa84fd46800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:16:40.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.761+0000 7fa84fd46800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:16:40.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.761+0000 7fa84fd46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:40.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.761+0000 7fa84fd46800 20 zonegroup default 2024-09-14T11:16:40.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.761+0000 7fa84fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.761 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.761+0000 7fa84fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:40.762 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.761+0000 7fa84fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.762 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.761+0000 7fa84fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:40.762 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.761+0000 7fa84fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.762 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.762+0000 7fa84fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:40.762 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.762+0000 7fa84fd46800 20 started sync module instance, tier type = 2024-09-14T11:16:40.762 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.762+0000 7fa84fd46800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:16:40.771 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.772+0000 7fa84fd46800 20 add_watcher() i=0 2024-09-14T11:16:40.771 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.772+0000 7fa84fd46800 20 add_watcher() i=1 2024-09-14T11:16:40.771 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.772+0000 7fa84fd46800 20 add_watcher() i=2 2024-09-14T11:16:40.771 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.772+0000 7fa84fd46800 20 add_watcher() i=3 2024-09-14T11:16:40.771 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.772+0000 7fa84fd46800 20 add_watcher() i=4 2024-09-14T11:16:40.771 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.772+0000 7fa84fd46800 20 add_watcher() i=5 2024-09-14T11:16:40.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.772+0000 7fa84fd46800 20 add_watcher() i=6 2024-09-14T11:16:40.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.773+0000 7fa84fd46800 20 add_watcher() i=7 2024-09-14T11:16:40.772 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.773+0000 7fa84fd46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:40.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.775+0000 7fa6ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:40.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.775+0000 7fa84fd46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:40.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.775+0000 7fa84fd46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:40.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.775+0000 7fa84fd46800 5 note: GC not initialized 2024-09-14T11:16:40.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.776+0000 7fa6fe7fc640 20 reqs_thread_entry: start 2024-09-14T11:16:40.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.776+0000 7fa84fd46800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:40.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.776+0000 7fa84fd46800 20 Filter name: none 2024-09-14T11:16:40.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.776+0000 7fa66ffff640 20 reqs_thread_entry: start 2024-09-14T11:16:40.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.776+0000 7fa84fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.777+0000 7fa84fd46800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:40.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.777+0000 7fa84fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.777+0000 7fa84fd46800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:40.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.777+0000 7fa84fd46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:40.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.777+0000 7fa84fd46800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:16:40.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.777+0000 7fa84fd46800 20 INFO: main: starting shard=0 2024-09-14T11:16:40.777 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.777+0000 7fa84fd46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.0 2024-09-14T11:16:40.777 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.777+0000 7fa84fd46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.0 2024-09-14T11:16:40.777 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.778+0000 7fa84fd46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:40.777 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.778+0000 7fa84fd46800 20 INFO: main: starting shard=1 2024-09-14T11:16:40.777 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.778+0000 7fa84fd46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.1 2024-09-14T11:16:40.777 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.778+0000 7fa84fd46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.1 2024-09-14T11:16:40.777 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.778+0000 7fa84fd46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:40.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.778+0000 7fa84fd46800 20 INFO: main: starting shard=2 2024-09-14T11:16:40.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.778+0000 7fa84fd46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.2 2024-09-14T11:16:40.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.778+0000 7fa84fd46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.2 2024-09-14T11:16:40.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.779+0000 7fa84fd46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:40.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.779+0000 7fa84fd46800 20 INFO: main: starting shard=3 2024-09-14T11:16:40.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.779+0000 7fa84fd46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.3 2024-09-14T11:16:40.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.779+0000 7fa84fd46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.3 2024-09-14T11:16:40.778 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.779+0000 7fa84fd46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:40.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.779+0000 7fa84fd46800 20 INFO: main: starting shard=4 2024-09-14T11:16:40.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.779+0000 7fa84fd46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.4 2024-09-14T11:16:40.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.779+0000 7fa84fd46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.4 2024-09-14T11:16:40.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.780+0000 7fa84fd46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:40.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.780+0000 7fa84fd46800 20 INFO: main: starting shard=5 2024-09-14T11:16:40.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.780+0000 7fa84fd46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.5 2024-09-14T11:16:40.779 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.780+0000 7fa84fd46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.5 2024-09-14T11:16:40.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.781+0000 7fa84fd46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:40.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.781+0000 7fa84fd46800 20 INFO: main: starting shard=6 2024-09-14T11:16:40.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.781+0000 7fa84fd46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.6 2024-09-14T11:16:40.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.781+0000 7fa84fd46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.6 2024-09-14T11:16:40.780 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.781+0000 7fa84fd46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:40.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.781+0000 7fa84fd46800 20 INFO: main: starting shard=7 2024-09-14T11:16:40.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.781+0000 7fa84fd46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.7 2024-09-14T11:16:40.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.781+0000 7fa84fd46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.7 2024-09-14T11:16:40.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.782+0000 7fa84fd46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:40.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.782+0000 7fa84fd46800 20 INFO: main: starting shard=8 2024-09-14T11:16:40.781 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.782+0000 7fa84fd46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.8 2024-09-14T11:16:40.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.782+0000 7fa84fd46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.8 2024-09-14T11:16:40.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.782+0000 7fa84fd46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:40.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.782+0000 7fa84fd46800 20 INFO: main: starting shard=9 2024-09-14T11:16:40.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.782+0000 7fa84fd46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.9 2024-09-14T11:16:40.782 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.782+0000 7fa84fd46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.9 2024-09-14T11:16:40.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.783+0000 7fa84fd46800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:16:40.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.783+0000 7fa84fd46800 20 INFO: main: starting shard=10 2024-09-14T11:16:40.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.783+0000 7fa84fd46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.10 2024-09-14T11:16:40.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.783+0000 7fa84fd46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.10 2024-09-14T11:16:40.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.784+0000 7fa84fd46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:40.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.784+0000 7fa84fd46800 20 INFO: main: starting shard=11 2024-09-14T11:16:40.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.784+0000 7fa84fd46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.11 2024-09-14T11:16:40.783 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.784+0000 7fa84fd46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.11 2024-09-14T11:16:40.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.784+0000 7fa84fd46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:40.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.784+0000 7fa84fd46800 20 INFO: main: starting shard=12 2024-09-14T11:16:40.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.784+0000 7fa84fd46800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.12 2024-09-14T11:16:40.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.784+0000 7fa84fd46800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.12 2024-09-14T11:16:40.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.784+0000 7fa84fd46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:40.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.784+0000 7fa84fd46800 20 INFO: main: done 2024-09-14T11:16:40.784 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.785+0000 7fa6ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:40.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.788+0000 7fa84fd46800 20 remove_watcher() i=0 2024-09-14T11:16:40.787 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.788+0000 7fa84fd46800 2 removed watcher, disabling cache 2024-09-14T11:16:40.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.789+0000 7fa84fd46800 20 remove_watcher() i=1 2024-09-14T11:16:40.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.790+0000 7fa84fd46800 20 remove_watcher() i=2 2024-09-14T11:16:40.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.791+0000 7fa84fd46800 20 remove_watcher() i=3 2024-09-14T11:16:40.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.792+0000 7fa84fd46800 20 remove_watcher() i=4 2024-09-14T11:16:40.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.793+0000 7fa84fd46800 20 remove_watcher() i=5 2024-09-14T11:16:40.793 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.794+0000 7fa84fd46800 20 remove_watcher() i=6 2024-09-14T11:16:40.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.796+0000 7fa84fd46800 20 remove_watcher() i=7 2024-09-14T11:16:40.808 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:40.808 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:40.832 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:40.833 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:40.919 INFO:tasks.workunit.client.0.smithi050.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:16:40.921 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-14T11:16:40.952 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:40.952 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:40.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.992+0000 7fde1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.995+0000 7fde1512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:40.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.995+0000 7fde1512c800 20 realm 2024-09-14T11:16:40.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.995+0000 7fde1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.995+0000 7fde1512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:40.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.995+0000 7fde1512c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:40.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.995+0000 7fde1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.995+0000 7fde1512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:40.994 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.995+0000 7fde1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.996+0000 7fde1512c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:40.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.996+0000 7fde1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:40.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.996+0000 7fde1512c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:40.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:40.996+0000 7fde1512c800 20 searching for the correct realm 2024-09-14T11:16:40.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.000+0000 7fde1064e640 0 -- 172.21.15.50:0/1022270851 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fde08017910 msgr2=0x7fde0802d410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:41.205 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.206+0000 7fde11650640 0 -- 172.21.15.50:0/1022270851 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55577dcc9670 msgr2=0x55577dccbae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:41.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.211+0000 7fde1512c800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:16:41.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.211+0000 7fde1512c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:41.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.211+0000 7fde1512c800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:16:41.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.211+0000 7fde1512c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:41.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.211+0000 7fde1512c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:41.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.211+0000 7fde1512c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:41.210 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.211+0000 7fde1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:41.211 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.211+0000 7fde1512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:41.211 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.211+0000 7fde1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:41.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.211+0000 7fde1512c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:41.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.211+0000 7fde1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:41.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.212+0000 7fde1512c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:41.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.212+0000 7fde1512c800 20 zone default found 2024-09-14T11:16:41.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.212+0000 7fde1512c800 4 Realm: () 2024-09-14T11:16:41.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.212+0000 7fde1512c800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:16:41.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.212+0000 7fde1512c800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:16:41.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.212+0000 7fde1512c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:41.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.212+0000 7fde1512c800 20 zonegroup default 2024-09-14T11:16:41.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.212+0000 7fde1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:41.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.212+0000 7fde1512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:41.212 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.212+0000 7fde1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:41.213 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.212+0000 7fde1512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:41.213 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.212+0000 7fde1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:41.213 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.213+0000 7fde1512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:41.213 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.213+0000 7fde1512c800 20 started sync module instance, tier type = 2024-09-14T11:16:41.213 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.213+0000 7fde1512c800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:16:41.224 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.225+0000 7fde1512c800 20 add_watcher() i=0 2024-09-14T11:16:41.224 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.225+0000 7fde1512c800 20 add_watcher() i=1 2024-09-14T11:16:41.224 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.225+0000 7fde1512c800 20 add_watcher() i=2 2024-09-14T11:16:41.224 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.225+0000 7fde1512c800 20 add_watcher() i=3 2024-09-14T11:16:41.224 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.225+0000 7fde1512c800 20 add_watcher() i=4 2024-09-14T11:16:41.224 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.225+0000 7fde1512c800 20 add_watcher() i=5 2024-09-14T11:16:41.224 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.225+0000 7fde1512c800 20 add_watcher() i=6 2024-09-14T11:16:41.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.226+0000 7fde1512c800 20 add_watcher() i=7 2024-09-14T11:16:41.225 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.226+0000 7fde1512c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:41.227 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.228+0000 7fdcc6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:41.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.228+0000 7fde1512c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:41.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.228+0000 7fde1512c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:41.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.228+0000 7fde1512c800 5 note: GC not initialized 2024-09-14T11:16:41.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.229+0000 7fdcc5fe3640 20 reqs_thread_entry: start 2024-09-14T11:16:41.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.229+0000 7fde1512c800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:41.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.229+0000 7fde1512c800 20 Filter name: none 2024-09-14T11:16:41.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.229+0000 7fdc377fe640 20 reqs_thread_entry: start 2024-09-14T11:16:41.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.229+0000 7fde1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:41.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.230+0000 7fde1512c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:41.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.230+0000 7fde1512c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:41.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.230+0000 7fde1512c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:41.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.230+0000 7fde1512c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:41.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.230+0000 7fde1512c800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:16:41.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.230+0000 7fde1512c800 20 INFO: main: starting shard=0 2024-09-14T11:16:41.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.230+0000 7fde1512c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.0 2024-09-14T11:16:41.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.230+0000 7fde1512c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.0 2024-09-14T11:16:41.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.231+0000 7fde1512c800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:16:41.231 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.231+0000 7fde1512c800 20 INFO: main: starting shard=1 2024-09-14T11:16:41.231 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.231+0000 7fde1512c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.1 2024-09-14T11:16:41.231 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.231+0000 7fde1512c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.1 2024-09-14T11:16:41.231 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.231+0000 7fde1512c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:41.231 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.231+0000 7fde1512c800 20 INFO: main: starting shard=2 2024-09-14T11:16:41.231 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.231+0000 7fde1512c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.2 2024-09-14T11:16:41.231 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.231+0000 7fde1512c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.2 2024-09-14T11:16:41.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.232+0000 7fde1512c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:41.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.232+0000 7fde1512c800 20 INFO: main: starting shard=3 2024-09-14T11:16:41.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.232+0000 7fde1512c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.3 2024-09-14T11:16:41.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.232+0000 7fde1512c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.3 2024-09-14T11:16:41.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.233+0000 7fde1512c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:41.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.233+0000 7fde1512c800 20 INFO: main: starting shard=4 2024-09-14T11:16:41.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.233+0000 7fde1512c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.4 2024-09-14T11:16:41.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.233+0000 7fde1512c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.4 2024-09-14T11:16:41.232 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.233+0000 7fde1512c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:41.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.233+0000 7fde1512c800 20 INFO: main: starting shard=5 2024-09-14T11:16:41.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.233+0000 7fde1512c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.5 2024-09-14T11:16:41.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.233+0000 7fde1512c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.5 2024-09-14T11:16:41.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.234+0000 7fde1512c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:41.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.234+0000 7fde1512c800 20 INFO: main: starting shard=6 2024-09-14T11:16:41.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.234+0000 7fde1512c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.6 2024-09-14T11:16:41.233 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.234+0000 7fde1512c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.6 2024-09-14T11:16:41.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.235+0000 7fde1512c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:41.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.235+0000 7fde1512c800 20 INFO: main: starting shard=7 2024-09-14T11:16:41.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.235+0000 7fde1512c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.7 2024-09-14T11:16:41.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.235+0000 7fde1512c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.7 2024-09-14T11:16:41.234 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.235+0000 7fde1512c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:41.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.235+0000 7fde1512c800 20 INFO: main: starting shard=8 2024-09-14T11:16:41.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.235+0000 7fde1512c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.8 2024-09-14T11:16:41.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.235+0000 7fde1512c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.8 2024-09-14T11:16:41.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.236+0000 7fde1512c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:41.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.236+0000 7fde1512c800 20 INFO: main: starting shard=9 2024-09-14T11:16:41.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.236+0000 7fde1512c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.9 2024-09-14T11:16:41.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.236+0000 7fde1512c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.9 2024-09-14T11:16:41.235 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.236+0000 7fde1512c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:41.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.236+0000 7fde1512c800 20 INFO: main: starting shard=10 2024-09-14T11:16:41.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.236+0000 7fde1512c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.10 2024-09-14T11:16:41.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.236+0000 7fde1512c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.10 2024-09-14T11:16:41.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.237+0000 7fde1512c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:41.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.237+0000 7fde1512c800 20 INFO: main: starting shard=11 2024-09-14T11:16:41.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.237+0000 7fde1512c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.11 2024-09-14T11:16:41.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.237+0000 7fde1512c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.11 2024-09-14T11:16:41.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.237+0000 7fde1512c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:41.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.237+0000 7fde1512c800 20 INFO: main: starting shard=12 2024-09-14T11:16:41.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.237+0000 7fde1512c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.12 2024-09-14T11:16:41.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.237+0000 7fde1512c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.12 2024-09-14T11:16:41.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.238+0000 7fde1512c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:41.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.238+0000 7fde1512c800 20 INFO: main: done 2024-09-14T11:16:41.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.238+0000 7fdcc6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:41.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.241+0000 7fde1512c800 20 remove_watcher() i=0 2024-09-14T11:16:41.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.241+0000 7fde1512c800 2 removed watcher, disabling cache 2024-09-14T11:16:41.241 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.242+0000 7fde1512c800 20 remove_watcher() i=1 2024-09-14T11:16:41.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.243+0000 7fde1512c800 20 remove_watcher() i=2 2024-09-14T11:16:41.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.244+0000 7fde1512c800 20 remove_watcher() i=3 2024-09-14T11:16:41.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.245+0000 7fde1512c800 20 remove_watcher() i=4 2024-09-14T11:16:41.245 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.246+0000 7fde1512c800 20 remove_watcher() i=5 2024-09-14T11:16:41.246 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.247+0000 7fde1512c800 20 remove_watcher() i=6 2024-09-14T11:16:41.248 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:41.248+0000 7fde1512c800 20 remove_watcher() i=7 2024-09-14T11:16:41.262 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:41.262 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:41.289 INFO:tasks.workunit.client.0.smithi050.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:16:41.702 INFO:tasks.workunit.client.0.smithi050.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:16:42.112 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-14T11:16:42.145 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:42.145 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:42.185 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.185+0000 7f7f8d41d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.186 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.187+0000 7f7f8d41d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:42.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.187+0000 7f7f8d41d800 20 realm 2024-09-14T11:16:42.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.187+0000 7f7f8d41d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.187+0000 7f7f8d41d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:42.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.187+0000 7f7f8d41d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:42.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.187+0000 7f7f8d41d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.188+0000 7f7f8d41d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:42.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.188+0000 7f7f8d41d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.188+0000 7f7f8d41d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:42.187 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.188+0000 7f7f8d41d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.189+0000 7f7f8d41d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:42.188 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.189+0000 7f7f8d41d800 20 searching for the correct realm 2024-09-14T11:16:42.191 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.192+0000 7f7f83fff640 0 -- 172.21.15.50:0/648358927 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f7f84080910 msgr2=0x7f7f840543c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:42.397 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.398+0000 7f7f893ec640 0 -- 172.21.15.50:0/648358927 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55dfe788a360 msgr2=0x55dfe788c7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:42.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.403+0000 7f7f8d41d800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:16:42.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.403+0000 7f7f8d41d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:42.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.403+0000 7f7f8d41d800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:16:42.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.403+0000 7f7f8d41d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:42.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.403+0000 7f7f8d41d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:42.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.403+0000 7f7f8d41d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:42.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.403+0000 7f7f8d41d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.403+0000 7f7f8d41d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:42.402 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.403+0000 7f7f8d41d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.403+0000 7f7f8d41d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:42.403 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.403+0000 7f7f8d41d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.404+0000 7f7f8d41d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:42.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.404+0000 7f7f8d41d800 20 zone default found 2024-09-14T11:16:42.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.404+0000 7f7f8d41d800 4 Realm: () 2024-09-14T11:16:42.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.404+0000 7f7f8d41d800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:16:42.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.404+0000 7f7f8d41d800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:16:42.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.404+0000 7f7f8d41d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:42.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.404+0000 7f7f8d41d800 20 zonegroup default 2024-09-14T11:16:42.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.404+0000 7f7f8d41d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.404+0000 7f7f8d41d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:42.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.404+0000 7f7f8d41d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.404+0000 7f7f8d41d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:42.404 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.404+0000 7f7f8d41d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.405+0000 7f7f8d41d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:42.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.405+0000 7f7f8d41d800 20 started sync module instance, tier type = 2024-09-14T11:16:42.405 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.405+0000 7f7f8d41d800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:16:42.413 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.414+0000 7f7f8d41d800 20 add_watcher() i=0 2024-09-14T11:16:42.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.415+0000 7f7f8d41d800 20 add_watcher() i=1 2024-09-14T11:16:42.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.415+0000 7f7f8d41d800 20 add_watcher() i=2 2024-09-14T11:16:42.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.415+0000 7f7f8d41d800 20 add_watcher() i=3 2024-09-14T11:16:42.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.415+0000 7f7f8d41d800 20 add_watcher() i=4 2024-09-14T11:16:42.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.415+0000 7f7f8d41d800 20 add_watcher() i=5 2024-09-14T11:16:42.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.415+0000 7f7f8d41d800 20 add_watcher() i=6 2024-09-14T11:16:42.414 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.416+0000 7f7f8d41d800 20 add_watcher() i=7 2024-09-14T11:16:42.415 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.416+0000 7f7f8d41d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:42.416 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.418+0000 7f7e3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:42.417 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.418+0000 7f7f8d41d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:42.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.418+0000 7f7f8d41d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:42.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.418+0000 7f7f8d41d800 5 note: GC not initialized 2024-09-14T11:16:42.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.418+0000 7f7e3dfe3640 20 reqs_thread_entry: start 2024-09-14T11:16:42.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.418+0000 7f7f8d41d800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:42.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.418+0000 7f7f8d41d800 20 Filter name: none 2024-09-14T11:16:42.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.418+0000 7f7daf7fe640 20 reqs_thread_entry: start 2024-09-14T11:16:42.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.419+0000 7f7f8d41d800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:16:42.418 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.419+0000 7f7f8d41d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.419+0000 7f7f8d41d800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:42.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.419+0000 7f7f8d41d800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:16:42.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.419+0000 7f7f8d41d800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:16:42.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.419+0000 7f7f8d41d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 : miss 2024-09-14T11:16:42.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.419+0000 7f7f8d41d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.419+0000 7f7f8d41d800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:42.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.419+0000 7f7f8d41d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 info.flags=0x17 2024-09-14T11:16:42.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.419+0000 7f7f8d41d800 10 adding default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 to cache LRU end 2024-09-14T11:16:42.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.419+0000 7f7f8d41d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:42.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.419+0000 7f7f8d41d800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:42.419 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.420+0000 7f7f8d41d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 2024-09-14T11:16:42.424 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.425+0000 7f7f8d41d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 info.flags=0x17 2024-09-14T11:16:42.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.425+0000 7f7f8d41d800 10 moving default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 to cache LRU end 2024-09-14T11:16:42.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.425+0000 7f7f8d41d800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:42.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.425+0000 7f7f8d41d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19, ofs0, ns] 2024-09-14T11:16:42.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.426+0000 7f7e5f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497090 cookie 94420150623840 notifier 8192 bl.length()=905 2024-09-14T11:16:42.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.426+0000 7f7e5f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 info.flags=0x17 2024-09-14T11:16:42.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.426+0000 7f7e5f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 to cache LRU end 2024-09-14T11:16:42.425 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.426+0000 7f7e5f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:42.426 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.428+0000 7f7f8d41d800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): orig_sources= new_sources= 2024-09-14T11:16:42.427 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.428+0000 7f7f8d41d800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): potential sources added=[] removed=[] 2024-09-14T11:16:42.427 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.428+0000 7f7f8d41d800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): orig_dests= new_dests= 2024-09-14T11:16:42.427 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.428+0000 7f7f8d41d800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): potential dests added=[] removed=[] 2024-09-14T11:16:42.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.0 2024-09-14T11:16:42.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.0 2024-09-14T11:16:42.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.1 2024-09-14T11:16:42.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.1 2024-09-14T11:16:42.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.2 2024-09-14T11:16:42.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.2 2024-09-14T11:16:42.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.3 2024-09-14T11:16:42.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.3 2024-09-14T11:16:42.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.4 2024-09-14T11:16:42.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.4 2024-09-14T11:16:42.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.5 2024-09-14T11:16:42.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.5 2024-09-14T11:16:42.433 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.6 2024-09-14T11:16:42.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.6 2024-09-14T11:16:42.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.7 2024-09-14T11:16:42.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.7 2024-09-14T11:16:42.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.8 2024-09-14T11:16:42.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.8 2024-09-14T11:16:42.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.9 2024-09-14T11:16:42.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.9 2024-09-14T11:16:42.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.10 2024-09-14T11:16:42.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.10 2024-09-14T11:16:42.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.11 2024-09-14T11:16:42.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.11 2024-09-14T11:16:42.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.12 2024-09-14T11:16:42.434 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.12 2024-09-14T11:16:42.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.13 2024-09-14T11:16:42.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.13 2024-09-14T11:16:42.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.14 2024-09-14T11:16:42.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.14 2024-09-14T11:16:42.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.15 2024-09-14T11:16:42.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.15 2024-09-14T11:16:42.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.16 2024-09-14T11:16:42.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.16 2024-09-14T11:16:42.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.0 2024-09-14T11:16:42.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.433+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.0 2024-09-14T11:16:42.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.434+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.1 2024-09-14T11:16:42.435 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.434+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.1 2024-09-14T11:16:42.436 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.434+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.2 2024-09-14T11:16:42.436 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.434+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.2 2024-09-14T11:16:42.436 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.435+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.3 2024-09-14T11:16:42.436 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.435+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.3 2024-09-14T11:16:42.436 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.435+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.4 2024-09-14T11:16:42.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.435+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.4 2024-09-14T11:16:42.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.436+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.5 2024-09-14T11:16:42.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.436+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.5 2024-09-14T11:16:42.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.436+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.6 2024-09-14T11:16:42.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.436+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.6 2024-09-14T11:16:42.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.437+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.7 2024-09-14T11:16:42.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.437+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.7 2024-09-14T11:16:42.437 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.438+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.8 2024-09-14T11:16:42.438 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.438+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.8 2024-09-14T11:16:42.438 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.438+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.9 2024-09-14T11:16:42.438 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.438+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.9 2024-09-14T11:16:42.438 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.439+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.10 2024-09-14T11:16:42.438 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.439+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.10 2024-09-14T11:16:42.439 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.440+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.11 2024-09-14T11:16:42.439 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.440+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.11 2024-09-14T11:16:42.439 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.440+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.12 2024-09-14T11:16:42.439 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.440+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.12 2024-09-14T11:16:42.441 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.442+0000 7f7f8d41d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:42.442 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.442+0000 7f7f8d41d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 2024-09-14T11:16:42.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.444+0000 7f7f8d41d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 info.flags=0x17 2024-09-14T11:16:42.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.444+0000 7f7f8d41d800 10 moving default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 to cache LRU end 2024-09-14T11:16:42.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.444+0000 7f7f8d41d800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:42.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.444+0000 7f7f8d41d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19, ofs0, ns] 2024-09-14T11:16:42.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.444+0000 7f7e5ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497091 cookie 94420150623840 notifier 8192 bl.length()=905 2024-09-14T11:16:42.443 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.444+0000 7f7e5ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 info.flags=0x17 2024-09-14T11:16:42.444 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.444+0000 7f7e5ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 to cache LRU end 2024-09-14T11:16:42.444 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.444+0000 7f7e5ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:42.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.446+0000 7f7f8d41d800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): orig_sources= new_sources= 2024-09-14T11:16:42.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.446+0000 7f7f8d41d800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): potential sources added=[] removed=[] 2024-09-14T11:16:42.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.446+0000 7f7f8d41d800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): orig_dests= new_dests= 2024-09-14T11:16:42.445 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.446+0000 7f7f8d41d800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): potential dests added=[] removed=[] 2024-09-14T11:16:42.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.449+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.0 2024-09-14T11:16:42.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.449+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.0 2024-09-14T11:16:42.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.449+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.1 2024-09-14T11:16:42.448 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.449+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.1 2024-09-14T11:16:42.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.450+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.2 2024-09-14T11:16:42.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.450+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.2 2024-09-14T11:16:42.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.450+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.3 2024-09-14T11:16:42.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.450+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.3 2024-09-14T11:16:42.449 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.450+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.4 2024-09-14T11:16:42.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.450+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.4 2024-09-14T11:16:42.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.451+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.5 2024-09-14T11:16:42.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.451+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.5 2024-09-14T11:16:42.450 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.451+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.6 2024-09-14T11:16:42.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.451+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.6 2024-09-14T11:16:42.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.452+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.7 2024-09-14T11:16:42.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.452+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.7 2024-09-14T11:16:42.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.452+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.8 2024-09-14T11:16:42.451 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.452+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.8 2024-09-14T11:16:42.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.452+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.9 2024-09-14T11:16:42.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.452+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.9 2024-09-14T11:16:42.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.453+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.10 2024-09-14T11:16:42.452 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.453+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.10 2024-09-14T11:16:42.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.453+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.11 2024-09-14T11:16:42.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.453+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.11 2024-09-14T11:16:42.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.453+0000 7f7f8d41d800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.12 2024-09-14T11:16:42.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.453+0000 7f7f8d41d800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.2.12 2024-09-14T11:16:42.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.453+0000 7f7f8d41d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:42.453 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.453+0000 7f7f8d41d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 2024-09-14T11:16:42.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.455+0000 7f7f8d41d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 info.flags=0x17 2024-09-14T11:16:42.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.455+0000 7f7f8d41d800 10 moving default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 to cache LRU end 2024-09-14T11:16:42.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.455+0000 7f7f8d41d800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:42.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.455+0000 7f7f8d41d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19, ofs0, ns] 2024-09-14T11:16:42.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.455+0000 7f7e5ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497092 cookie 94420150623840 notifier 8192 bl.length()=873 2024-09-14T11:16:42.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.455+0000 7f7e5ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 info.flags=0x17 2024-09-14T11:16:42.454 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.455+0000 7f7e5ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 to cache LRU end 2024-09-14T11:16:42.455 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.455+0000 7f7e5ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:42.456 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.457+0000 7f7f8d41d800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): orig_sources= new_sources= 2024-09-14T11:16:42.456 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.457+0000 7f7f8d41d800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): potential sources added=[] removed=[] 2024-09-14T11:16:42.456 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.457+0000 7f7f8d41d800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): orig_dests= new_dests= 2024-09-14T11:16:42.456 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.457+0000 7f7f8d41d800 20 handle_bi_update(): bucket=:myver[c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19]): potential dests added=[] removed=[] 2024-09-14T11:16:42.459 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.460+0000 7f7f8d41d800 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-14T11:16:42.461 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.462+0000 7f7e3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:42.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.464+0000 7f7f8d41d800 20 remove_watcher() i=0 2024-09-14T11:16:42.463 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.464+0000 7f7f8d41d800 2 removed watcher, disabling cache 2024-09-14T11:16:42.464 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.465+0000 7f7f8d41d800 20 remove_watcher() i=1 2024-09-14T11:16:42.465 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.466+0000 7f7f8d41d800 20 remove_watcher() i=2 2024-09-14T11:16:42.466 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.467+0000 7f7f8d41d800 20 remove_watcher() i=3 2024-09-14T11:16:42.467 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.468+0000 7f7f8d41d800 20 remove_watcher() i=4 2024-09-14T11:16:42.468 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.469+0000 7f7f8d41d800 20 remove_watcher() i=5 2024-09-14T11:16:42.469 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.470+0000 7f7f8d41d800 20 remove_watcher() i=6 2024-09-14T11:16:42.470 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.471+0000 7f7f8d41d800 20 remove_watcher() i=7 2024-09-14T11:16:42.483 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:16:42.519 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:42.519 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:42.558 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.559+0000 7f20c832c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.560 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.561+0000 7f20c832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:42.560 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.561+0000 7f20c832c800 20 realm 2024-09-14T11:16:42.560 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.561+0000 7f20c832c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.561 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.561+0000 7f20c832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:42.561 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.561+0000 7f20c832c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:42.561 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.561+0000 7f20c832c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.561 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.561+0000 7f20c832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:42.561 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.561+0000 7f20c832c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.561 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.562+0000 7f20c832c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:42.561 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.562+0000 7f20c832c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.562 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.563+0000 7f20c832c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:42.562 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.563+0000 7f20c832c800 20 searching for the correct realm 2024-09-14T11:16:42.564 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.565+0000 7f20c38d9640 0 -- 172.21.15.50:0/2695912352 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f20bc0b2e50 msgr2=0x7f20bc0bf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:42.770 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.770+0000 7f20c48db640 0 -- 172.21.15.50:0/2695912352 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55badd51b870 msgr2=0x55badd51dc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:42.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.774+0000 7f20c832c800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:16:42.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.774+0000 7f20c832c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:42.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.774+0000 7f20c832c800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:16:42.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.774+0000 7f20c832c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:42.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.774+0000 7f20c832c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:42.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.774+0000 7f20c832c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:42.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.775+0000 7f20c832c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.774 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.775+0000 7f20c832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:42.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.775+0000 7f20c832c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.775+0000 7f20c832c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:42.775 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.775+0000 7f20c832c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.775+0000 7f20c832c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:42.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.775+0000 7f20c832c800 20 zone default found 2024-09-14T11:16:42.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.775+0000 7f20c832c800 4 Realm: () 2024-09-14T11:16:42.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.775+0000 7f20c832c800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:16:42.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.775+0000 7f20c832c800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:16:42.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.775+0000 7f20c832c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:42.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.775+0000 7f20c832c800 20 zonegroup default 2024-09-14T11:16:42.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.775+0000 7f20c832c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.776+0000 7f20c832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:42.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.776+0000 7f20c832c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.776+0000 7f20c832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:42.776 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.776+0000 7f20c832c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.777 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.776+0000 7f20c832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:42.777 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.776+0000 7f20c832c800 20 started sync module instance, tier type = 2024-09-14T11:16:42.777 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.776+0000 7f20c832c800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:16:42.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.786+0000 7f20c832c800 20 add_watcher() i=0 2024-09-14T11:16:42.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.786+0000 7f20c832c800 20 add_watcher() i=1 2024-09-14T11:16:42.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.786+0000 7f20c832c800 20 add_watcher() i=2 2024-09-14T11:16:42.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.786+0000 7f20c832c800 20 add_watcher() i=3 2024-09-14T11:16:42.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.786+0000 7f20c832c800 20 add_watcher() i=4 2024-09-14T11:16:42.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.786+0000 7f20c832c800 20 add_watcher() i=5 2024-09-14T11:16:42.785 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.786+0000 7f20c832c800 20 add_watcher() i=6 2024-09-14T11:16:42.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.787+0000 7f20c832c800 20 add_watcher() i=7 2024-09-14T11:16:42.786 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.787+0000 7f20c832c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:42.788 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.789+0000 7f1f7afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:42.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.789+0000 7f20c832c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:42.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.789+0000 7f20c832c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:42.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.789+0000 7f20c832c800 5 note: GC not initialized 2024-09-14T11:16:42.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.790+0000 7f1f79fdb640 20 reqs_thread_entry: start 2024-09-14T11:16:42.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.790+0000 7f20c832c800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:42.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.790+0000 7f20c832c800 20 Filter name: none 2024-09-14T11:16:42.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.790+0000 7f1eeb7fe640 20 reqs_thread_entry: start 2024-09-14T11:16:42.789 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.790+0000 7f20c832c800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:16:42.790 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.790+0000 7f20c832c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.790+0000 7f20c832c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:42.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.790+0000 7f20c832c800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:16:42.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.790+0000 7f20c832c800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:16:42.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.790+0000 7f20c832c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 : miss 2024-09-14T11:16:42.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.790+0000 7f20c832c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:42.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.791+0000 7f20c832c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:42.791 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.791+0000 7f20c832c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 info.flags=0x17 2024-09-14T11:16:42.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.791+0000 7f20c832c800 10 adding default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 to cache LRU end 2024-09-14T11:16:42.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.791+0000 7f20c832c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:42.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.791+0000 7f20c832c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:16:42.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.791+0000 7f20c832c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19 2024-09-14T11:16:42.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.791+0000 7f20c832c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.0 2024-09-14T11:16:42.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.791+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.0 2024-09-14T11:16:42.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.792+0000 7f20c832c800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:16:42.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.792+0000 7f20c832c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.1 2024-09-14T11:16:42.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.792+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.1 2024-09-14T11:16:42.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.792+0000 7f20c832c800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-14T11:16:42.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.792+0000 7f20c832c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.2 2024-09-14T11:16:42.792 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.792+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.2 2024-09-14T11:16:42.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.793+0000 7f20c832c800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:16:42.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.793+0000 7f20c832c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.3 2024-09-14T11:16:42.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.793+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.3 2024-09-14T11:16:42.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.793+0000 7f20c832c800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:16:42.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.793+0000 7f20c832c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.4 2024-09-14T11:16:42.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.793+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.4 2024-09-14T11:16:42.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.793+0000 7f20c832c800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:16:42.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.793+0000 7f20c832c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.5 2024-09-14T11:16:42.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.793+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.5 2024-09-14T11:16:42.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.794+0000 7f20c832c800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-14T11:16:42.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.794+0000 7f20c832c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.6 2024-09-14T11:16:42.794 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.794+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.6 2024-09-14T11:16:42.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.794+0000 7f20c832c800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:16:42.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.794+0000 7f20c832c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.7 2024-09-14T11:16:42.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.794+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.7 2024-09-14T11:16:42.795 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.795+0000 7f20c832c800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:16:42.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.795+0000 7f20c832c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.8 2024-09-14T11:16:42.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.795+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.8 2024-09-14T11:16:42.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.795+0000 7f20c832c800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-14T11:16:42.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.795+0000 7f20c832c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.9 2024-09-14T11:16:42.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.795+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.9 2024-09-14T11:16:42.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.796+0000 7f20c832c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.10 2024-09-14T11:16:42.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.796+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.10 2024-09-14T11:16:42.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.797+0000 7f20c832c800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-14T11:16:42.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.797+0000 7f20c832c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.11 2024-09-14T11:16:42.796 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.797+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.11 2024-09-14T11:16:42.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.797+0000 7f20c832c800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-14T11:16:42.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.797+0000 7f20c832c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.12 2024-09-14T11:16:42.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.797+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.12 2024-09-14T11:16:42.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.798+0000 7f20c832c800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-14T11:16:42.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.798+0000 7f20c832c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.13 2024-09-14T11:16:42.797 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.798+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.13 2024-09-14T11:16:42.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.798+0000 7f20c832c800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-14T11:16:42.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.798+0000 7f20c832c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.14 2024-09-14T11:16:42.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.798+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.14 2024-09-14T11:16:42.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.799+0000 7f20c832c800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-14T11:16:42.798 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.799+0000 7f20c832c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.15 2024-09-14T11:16:42.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.799+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.15 2024-09-14T11:16:42.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.799+0000 7f20c832c800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-14T11:16:42.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.799+0000 7f20c832c800 10 bucket_obj is .dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.16 2024-09-14T11:16:42.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.799+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.16 2024-09-14T11:16:42.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.799+0000 7f20c832c800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-14T11:16:42.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.799+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.9 2024-09-14T11:16:42.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.800+0000 7f20c832c800 20 get_obj_state: octx=0x55badd290300 obj=myver:x state=0x55badd555d68 s->prefetch_data=0 2024-09-14T11:16:42.799 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.800+0000 7f20c832c800 20 get_obj_state: setting s->obj_tag to hbey7piq3o8btoqh4iuyt2k51z5lxix4 2024-09-14T11:16:42.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.800+0000 7f20c832c800 20 get_obj_state_impl: setting s->olh_tag to d9esetur9be34nr9q4j342bg5yogdt0u 2024-09-14T11:16:42.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.800+0000 7f20c832c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=d9esetur9be34nr9q4j342bg5yogdt0u 2024-09-14T11:16:42.800 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.801+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.9 2024-09-14T11:16:42.802 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.803+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.9 2024-09-14T11:16:42.802 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.803+0000 7f20c832c800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-14T11:16:42.802 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.803+0000 7f20c832c800 20 olh_log_entry: epoch=2 op=3 key=x[7GJMTUg50ttU.Wkn88HfwIGIl9xYxWK] 2024-09-14T11:16:42.803 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.803+0000 7f20c832c800 20 get_obj_state: octx=0x55badd290300 obj=myver:_:7GJMTUg50ttU.Wkn88HfwIGIl9xYxWK_x state=0x55badd598048 s->prefetch_data=0 2024-09-14T11:16:42.803 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.804+0000 7f20c832c800 10 manifest: total_size = 22 2024-09-14T11:16:42.803 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.804+0000 7f20c832c800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.223861687870750114 2024-09-14T11:16:42.803 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.804+0000 7f20c832c800 20 get_obj_state: octx=0x55badd290300 obj=myver:_:7GJMTUg50ttU.Wkn88HfwIGIl9xYxWK_x state=0x55badd598048 s->prefetch_data=0 2024-09-14T11:16:42.803 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.804+0000 7f20c832c800 20 prepare_atomic_modification: state is not atomic. state=0x55badd598048 2024-09-14T11:16:42.803 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.804+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.9 2024-09-14T11:16:42.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.807+0000 7f20c832c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:16:42.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.807+0000 7f20c832c800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:16:42.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.807+0000 7f20c832c800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:16:42.806 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.807+0000 7f20c832c800 5 delete_objs_inline: removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19__shadow:7GJMTUg50ttU.Wkn88HfwIGIl9xYxWK_.Ja0DsunadZG_OTxiApjfuPGq-nA-zdw_0 2024-09-14T11:16:42.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.808+0000 7f20c832c800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:16:42.807 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.808+0000 7f1f9affd640 20 handle_completion(): completion ok for obj=x[7GJMTUg50ttU.Wkn88HfwIGIl9xYxWK] 2024-09-14T11:16:42.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.809+0000 7f20c832c800 20 get_obj_state: octx=0x55badd290300 obj=myver:x state=0x55badd555d68 s->prefetch_data=0 2024-09-14T11:16:42.808 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.809+0000 7f20c832c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=d9esetur9be34nr9q4j342bg5yogdt0u 2024-09-14T11:16:42.811 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.812+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.9 2024-09-14T11:16:42.812 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.813+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.9 2024-09-14T11:16:42.812 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.813+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.9 2024-09-14T11:16:42.813 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.814+0000 7f20c832c800 20 get_obj_state: octx=0x55badd290300 obj=myver:y state=0x55badd59d178 s->prefetch_data=0 2024-09-14T11:16:42.813 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.814+0000 7f20c832c800 20 get_obj_state: setting s->obj_tag to j77jvktx3r8708kfcmvvvst1tv1cwlxu 2024-09-14T11:16:42.813 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.814+0000 7f20c832c800 20 get_obj_state_impl: setting s->olh_tag to ixvinwy5z9bc4izk2tbqwbilqhnnjxh3 2024-09-14T11:16:42.813 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.814+0000 7f20c832c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ixvinwy5z9bc4izk2tbqwbilqhnnjxh3 2024-09-14T11:16:42.814 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.815+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.9 2024-09-14T11:16:42.816 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.816+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.9 2024-09-14T11:16:42.816 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.817+0000 7f20c832c800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-14T11:16:42.816 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.817+0000 7f20c832c800 20 olh_log_entry: epoch=2 op=3 key=y[lXbxbLqMFewCISznBQQkqI9HdkfrTLz] 2024-09-14T11:16:42.816 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.817+0000 7f20c832c800 20 get_obj_state: octx=0x55badd290300 obj=myver:_:lXbxbLqMFewCISznBQQkqI9HdkfrTLz_y state=0x55badd555858 s->prefetch_data=0 2024-09-14T11:16:42.817 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.817+0000 7f20c832c800 10 manifest: total_size = 11 2024-09-14T11:16:42.817 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.817+0000 7f20c832c800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13546824706318920191 2024-09-14T11:16:42.817 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.817+0000 7f20c832c800 20 get_obj_state: octx=0x55badd290300 obj=myver:_:lXbxbLqMFewCISznBQQkqI9HdkfrTLz_y state=0x55badd555858 s->prefetch_data=0 2024-09-14T11:16:42.817 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.817+0000 7f20c832c800 20 prepare_atomic_modification: state is not atomic. state=0x55badd555858 2024-09-14T11:16:42.817 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.817+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.9 2024-09-14T11:16:42.819 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.820+0000 7f20c832c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:16:42.819 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.820+0000 7f20c832c800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-14T11:16:42.819 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.820+0000 7f20c832c800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:16:42.819 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.820+0000 7f20c832c800 5 delete_objs_inline: removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19__shadow:lXbxbLqMFewCISznBQQkqI9HdkfrTLz_.D3i5DcRHs96SoyYcilUfBBufIq-piEy_0 2024-09-14T11:16:42.820 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.821+0000 7f1f9b7fe640 20 handle_completion(): completion ok for obj=y[lXbxbLqMFewCISznBQQkqI9HdkfrTLz] 2024-09-14T11:16:42.820 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.821+0000 7f20c832c800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:16:42.821 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.822+0000 7f20c832c800 20 get_obj_state: octx=0x55badd290300 obj=myver:y state=0x55badd59d178 s->prefetch_data=0 2024-09-14T11:16:42.821 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.822+0000 7f20c832c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ixvinwy5z9bc4izk2tbqwbilqhnnjxh3 2024-09-14T11:16:42.823 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.824+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.9 2024-09-14T11:16:42.825 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.826+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.9 2024-09-14T11:16:42.825 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.826+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.9 2024-09-14T11:16:42.825 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.826+0000 7f20c832c800 20 get_obj_state: octx=0x55badd290300 obj=myver:z state=0x55badd59d178 s->prefetch_data=0 2024-09-14T11:16:42.825 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.826+0000 7f20c832c800 20 get_obj_state: setting s->obj_tag to 9gt9i56r52cnvnnpk9cdbiejsswgl7na 2024-09-14T11:16:42.825 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.826+0000 7f20c832c800 20 get_obj_state_impl: setting s->olh_tag to xeydxh4sp9v1px4cxwk8b2vp178g4gra 2024-09-14T11:16:42.826 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.826+0000 7f20c832c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xeydxh4sp9v1px4cxwk8b2vp178g4gra 2024-09-14T11:16:42.827 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.828+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.9 2024-09-14T11:16:42.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.829+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.9 2024-09-14T11:16:42.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.829+0000 7f20c832c800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-14T11:16:42.828 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.829+0000 7f20c832c800 20 olh_log_entry: epoch=2 op=3 key=z[ccI8hH0jnuSaN8oPuIaf9-IhbrQUvz-] 2024-09-14T11:16:42.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.829+0000 7f20c832c800 20 get_obj_state: octx=0x55badd290300 obj=myver:_:ccI8hH0jnuSaN8oPuIaf9-IhbrQUvz-_z state=0x55badd556868 s->prefetch_data=0 2024-09-14T11:16:42.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.829+0000 7f20c832c800 10 manifest: total_size = 11 2024-09-14T11:16:42.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.829+0000 7f20c832c800 20 get_obj_state: setting s->obj_tag to c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17692272942285766214 2024-09-14T11:16:42.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.829+0000 7f20c832c800 20 get_obj_state: octx=0x55badd290300 obj=myver:_:ccI8hH0jnuSaN8oPuIaf9-IhbrQUvz-_z state=0x55badd556868 s->prefetch_data=0 2024-09-14T11:16:42.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.829+0000 7f20c832c800 20 prepare_atomic_modification: state is not atomic. state=0x55badd556868 2024-09-14T11:16:42.829 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.829+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.9 2024-09-14T11:16:42.831 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.832+0000 7f20c832c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:16:42.831 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.832+0000 7f20c832c800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-14T11:16:42.831 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.832+0000 7f20c832c800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:16:42.831 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.832+0000 7f20c832c800 5 delete_objs_inline: removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19__shadow:ccI8hH0jnuSaN8oPuIaf9-IhbrQUvz-_.sxwT9KCUFYb_wii_wdE1KjhVAzNl1JD_0 2024-09-14T11:16:42.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.833+0000 7f20c832c800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:16:42.832 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.833+0000 7f1f9affd640 20 handle_completion(): completion ok for obj=z[ccI8hH0jnuSaN8oPuIaf9-IhbrQUvz-] 2024-09-14T11:16:42.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.834+0000 7f20c832c800 20 get_obj_state: octx=0x55badd290300 obj=myver:z state=0x55badd59d178 s->prefetch_data=0 2024-09-14T11:16:42.833 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.834+0000 7f20c832c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xeydxh4sp9v1px4cxwk8b2vp178g4gra 2024-09-14T11:16:42.835 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.836+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.9 2024-09-14T11:16:42.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.837+0000 7f20c832c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19.3.9 2024-09-14T11:16:42.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.838+0000 7f20c832c800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-14T11:16:42.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.838+0000 7f20c832c800 1 NOTICE: finished all shards (3 entries removed) 2024-09-14T11:16:42.837 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.838+0000 7f1f7afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:42.839 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.841+0000 7f20c832c800 20 remove_watcher() i=0 2024-09-14T11:16:42.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.841+0000 7f20c832c800 2 removed watcher, disabling cache 2024-09-14T11:16:42.840 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.842+0000 7f20c832c800 20 remove_watcher() i=1 2024-09-14T11:16:42.841 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.843+0000 7f20c832c800 20 remove_watcher() i=2 2024-09-14T11:16:42.842 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.844+0000 7f20c832c800 20 remove_watcher() i=3 2024-09-14T11:16:42.844 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.845+0000 7f20c832c800 20 remove_watcher() i=4 2024-09-14T11:16:42.845 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.846+0000 7f20c832c800 20 remove_watcher() i=5 2024-09-14T11:16:42.846 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.847+0000 7f20c832c800 20 remove_watcher() i=6 2024-09-14T11:16:42.847 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:42.848+0000 7f20c832c800 20 remove_watcher() i=7 2024-09-14T11:16:42.860 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:42.860 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:42.900 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:42.900 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:43.005 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:16:43.034 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:43.034 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:43.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.074+0000 7f599fb24800 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.076+0000 7f599fb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.076+0000 7f599fb24800 20 realm 2024-09-14T11:16:43.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.076+0000 7f599fb24800 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.076+0000 7f599fb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.076+0000 7f599fb24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:43.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.076+0000 7f599fb24800 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.077+0000 7f599fb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.077+0000 7f599fb24800 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.077+0000 7f599fb24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:43.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.077+0000 7f599fb24800 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.077 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.078+0000 7f599fb24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:43.077 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.078+0000 7f599fb24800 20 searching for the correct realm 2024-09-14T11:16:43.078 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.079+0000 7f599b702640 0 -- 172.21.15.50:0/369382275 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x559924d559c0 msgr2=0x7f599402f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:43.283 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.284+0000 7f599bf03640 0 -- 172.21.15.50:0/369382275 >> [v2:172.21.15.118:6826/1082138742,v1:172.21.15.118:6827/1082138742] conn(0x7f598c036060 msgr2=0x7f598c067120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:43.491 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.492+0000 7f599fb24800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:16:43.491 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.492+0000 7f599fb24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:43.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.492+0000 7f599fb24800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:16:43.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.492+0000 7f599fb24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:43.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.492+0000 7f599fb24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:43.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.492+0000 7f599fb24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:43.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.492+0000 7f599fb24800 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.492+0000 7f599fb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.492 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.492+0000 7f599fb24800 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.493+0000 7f599fb24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:43.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.493+0000 7f599fb24800 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.493+0000 7f599fb24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:43.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.493+0000 7f599fb24800 20 zone default found 2024-09-14T11:16:43.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.493+0000 7f599fb24800 4 Realm: () 2024-09-14T11:16:43.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.493+0000 7f599fb24800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:16:43.493 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.493+0000 7f599fb24800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:16:43.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.493+0000 7f599fb24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:43.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.493+0000 7f599fb24800 20 zonegroup default 2024-09-14T11:16:43.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.493+0000 7f599fb24800 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.493+0000 7f599fb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.493+0000 7f599fb24800 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.494+0000 7f599fb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.494+0000 7f599fb24800 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.494+0000 7f599fb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.494+0000 7f599fb24800 20 started sync module instance, tier type = 2024-09-14T11:16:43.494 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.494+0000 7f599fb24800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:16:43.504 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.505+0000 7f599fb24800 20 add_watcher() i=0 2024-09-14T11:16:43.504 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.505+0000 7f599fb24800 20 add_watcher() i=1 2024-09-14T11:16:43.504 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.505+0000 7f599fb24800 20 add_watcher() i=2 2024-09-14T11:16:43.504 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.505+0000 7f599fb24800 20 add_watcher() i=3 2024-09-14T11:16:43.504 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.505+0000 7f599fb24800 20 add_watcher() i=4 2024-09-14T11:16:43.505 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.505+0000 7f599fb24800 20 add_watcher() i=5 2024-09-14T11:16:43.505 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.505+0000 7f599fb24800 20 add_watcher() i=6 2024-09-14T11:16:43.506 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.506+0000 7f599fb24800 20 add_watcher() i=7 2024-09-14T11:16:43.506 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.506+0000 7f599fb24800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:43.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.508+0000 7f5851fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:43.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.509+0000 7f599fb24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:43.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.509+0000 7f599fb24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:43.508 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.509+0000 7f599fb24800 5 note: GC not initialized 2024-09-14T11:16:43.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.509+0000 7f5850fe1640 20 reqs_thread_entry: start 2024-09-14T11:16:43.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.509+0000 7f599fb24800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:43.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.509+0000 7f599fb24800 20 Filter name: none 2024-09-14T11:16:43.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.509+0000 7f57ca7fc640 20 reqs_thread_entry: start 2024-09-14T11:16:43.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.509+0000 7f599fb24800 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.510+0000 7f599fb24800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:43.509 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.510+0000 7f599fb24800 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.510 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.511+0000 7f599fb24800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:43.510 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.511+0000 7f599fb24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:43.510 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.511+0000 7f599fb24800 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.511+0000 7f599fb24800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:43.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.511+0000 7f599fb24800 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.512+0000 7f599fb24800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:43.511 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.512+0000 7f599fb24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:43.513 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.514+0000 7f5851fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:43.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.517+0000 7f599fb24800 20 remove_watcher() i=0 2024-09-14T11:16:43.516 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.517+0000 7f599fb24800 2 removed watcher, disabling cache 2024-09-14T11:16:43.517 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.518+0000 7f599fb24800 20 remove_watcher() i=1 2024-09-14T11:16:43.518 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.519+0000 7f599fb24800 20 remove_watcher() i=2 2024-09-14T11:16:43.519 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.520+0000 7f599fb24800 20 remove_watcher() i=3 2024-09-14T11:16:43.520 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.521+0000 7f599fb24800 20 remove_watcher() i=4 2024-09-14T11:16:43.521 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.522+0000 7f599fb24800 20 remove_watcher() i=5 2024-09-14T11:16:43.522 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.523+0000 7f599fb24800 20 remove_watcher() i=6 2024-09-14T11:16:43.523 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T11:16:43.524+0000 7f599fb24800 20 remove_watcher() i=7 2024-09-14T11:16:43.535 INFO:tasks.workunit.client.0.smithi050.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T11:16:43.535 INFO:tasks.workunit.client.0.smithi050.stderr:Deleting bucket a-bucket 2024-09-14T11:16:43.537 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:43.537 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:43.563 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:43.563 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:43.621 INFO:tasks.workunit.client.0.smithi050.stderr:Deleting bucket myver 2024-09-14T11:16:43.622 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:43.622 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:43.696 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:43.696 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T11:16:43.863 INFO:tasks.workunit.client.0.smithi050.stderr:Completed resharding tests 2024-09-14T11:16:43.863 INFO:tasks.workunit.client.0.smithi050.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-14T11:16:43.863 INFO:tasks.workunit.client.0.smithi050.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-14T11:16:43.863 INFO:tasks.workunit.client.0.smithi050.stdout:connected to https://localhost:443 2024-09-14T11:16:43.942 INFO:tasks.workunit.client.0.smithi050.stderr:+ deactivate 2024-09-14T11:16:43.942 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T11:16:43.942 INFO:tasks.workunit.client.0.smithi050.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:16:43.942 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2024-09-14T11:16:43.942 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:16:43.943 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -n '' ']' 2024-09-14T11:16:43.943 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:16:43.943 INFO:tasks.workunit.client.0.smithi050.stderr:+ hash -r 2024-09-14T11:16:43.943 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -n '' ']' 2024-09-14T11:16:43.943 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:16:43.943 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:16:43.943 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset -f deactivate 2024-09-14T11:16:43.943 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo OK. 2024-09-14T11:16:43.944 INFO:tasks.workunit.client.0.smithi050.stdout:OK. 2024-09-14T11:16:43.944 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:16:43.945 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:16:44.024 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-14T11:16:44.024 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:16:44.468 DEBUG:teuthology.parallel:result is None 2024-09-14T11:16:44.469 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:16:44.508 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:16:44.508 DEBUG:teuthology.orchestra.run.smithi050:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:16:44.578 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:16:44.579 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-14T11:16:44.593 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-14T11:16:44.593 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-14T11:16:44.593 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-14T11:16:44.593 DEBUG:teuthology.orchestra.run.smithi050:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-14T11:16:44.648 INFO:teuthology.orchestra.run.smithi050.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-14T11:16:49.119 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-14T11:16:49.119 DEBUG:teuthology.orchestra.run.smithi050:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-14T11:16:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-14T11:16:51.832 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:33:19 ago on Sat 14 Sep 2024 10:43:32 AM UTC. 2024-09-14T11:16:51.980 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-09-14T11:16:51.980 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-09-14T11:16:51.981 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2024-09-14T11:16:51.981 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-09-14T11:16:51.981 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-09-14T11:16:51.981 INFO:teuthology.orchestra.run.smithi050.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-14T11:16:51.981 INFO:teuthology.orchestra.run.smithi050.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-14T11:16:51.981 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2024-09-14T11:16:51.981 INFO:teuthology.orchestra.run.smithi050.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-14T11:16:51.981 INFO:teuthology.orchestra.run.smithi050.stdout:Installing weak dependencies: 2024-09-14T11:16:51.981 INFO:teuthology.orchestra.run.smithi050.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-14T11:16:51.981 INFO:teuthology.orchestra.run.smithi050.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-14T11:16:51.981 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:16:51.981 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-09-14T11:16:51.982 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-09-14T11:16:51.982 INFO:teuthology.orchestra.run.smithi050.stdout:Install 5 Packages 2024-09-14T11:16:51.982 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:16:51.982 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 46 M 2024-09-14T11:16:51.982 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 166 M 2024-09-14T11:16:51.982 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-09-14T11:16:52.253 INFO:teuthology.orchestra.run.smithi050.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 1.7 MB/s | 426 kB 00:00 2024-09-14T11:16:52.929 INFO:teuthology.orchestra.run.smithi050.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 3.8 MB/s | 3.5 MB 00:00 2024-09-14T11:16:52.979 INFO:teuthology.orchestra.run.smithi050.stdout:(3/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 521 kB/s | 26 kB 00:00 2024-09-14T11:16:54.063 INFO:teuthology.orchestra.run.smithi050.stdout:(4/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 4.6 MB/s | 9.3 MB 00:02 2024-09-14T11:16:57.055 INFO:teuthology.orchestra.run.smithi050.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 6.7 MB/s | 32 MB 00:04 2024-09-14T11:16:57.055 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:16:57.055 INFO:teuthology.orchestra.run.smithi050.stdout:Total 9.0 MB/s | 46 MB 00:05 2024-09-14T11:16:57.496 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-09-14T11:16:57.519 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-09-14T11:16:57.519 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-09-14T11:16:58.024 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-09-14T11:16:58.024 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-09-14T11:16:58.564 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-14T11:16:58.721 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-09-14T11:16:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-14T11:16:59.549 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-14T11:16:59.598 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-14T11:16:59.854 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-14T11:16:59.883 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-14T11:17:00.123 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-14T11:17:00.162 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:17:00.171 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:17:00.180 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-14T11:17:00.223 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-14T11:17:03.225 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:17:03.225 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-14T11:17:03.225 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-14T11:17:03.225 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-14T11:17:03.225 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-14T11:17:03.639 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-14T11:17:03.639 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:03.639 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-09-14T11:17:03.639 INFO:teuthology.orchestra.run.smithi050.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-14T11:17:03.639 INFO:teuthology.orchestra.run.smithi050.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:17:03.639 INFO:teuthology.orchestra.run.smithi050.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:17:03.639 INFO:teuthology.orchestra.run.smithi050.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:17:03.640 INFO:teuthology.orchestra.run.smithi050.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-14T11:17:03.640 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:03.640 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-09-14T11:17:04.099 INFO:teuthology.orchestra.run.smithi050.stdout: Gradle will be installed under /opt/gradle 2024-09-14T11:17:04.235 INFO:teuthology.orchestra.run.smithi050.stderr:--2024-09-14 11:17:04-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-14T11:17:04.387 INFO:teuthology.orchestra.run.smithi050.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4965, ... 2024-09-14T11:17:04.396 INFO:teuthology.orchestra.run.smithi050.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-14T11:17:04.495 INFO:teuthology.orchestra.run.smithi050.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-14T11:17:04.495 INFO:teuthology.orchestra.run.smithi050.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-14T11:17:04.496 INFO:teuthology.orchestra.run.smithi050.stderr:--2024-09-14 11:17:04-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-14T11:17:04.496 INFO:teuthology.orchestra.run.smithi050.stderr:Resolving github.com (github.com)... 140.82.112.4 2024-09-14T11:17:04.504 INFO:teuthology.orchestra.run.smithi050.stderr:Connecting to github.com (github.com)|140.82.112.4|:443... connected. 2024-09-14T11:17:04.643 INFO:teuthology.orchestra.run.smithi050.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-14T11:17:04.643 INFO:teuthology.orchestra.run.smithi050.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T111704Z&X-Amz-Expires=300&X-Amz-Signature=4ecdab20539e901c49ca4c3f06e136d591debba2abba0d76a1c21a9bbdd322f7&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-14T11:17:04.643 INFO:teuthology.orchestra.run.smithi050.stderr:--2024-09-14 11:17:04-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T111704Z&X-Amz-Expires=300&X-Amz-Signature=4ecdab20539e901c49ca4c3f06e136d591debba2abba0d76a1c21a9bbdd322f7&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-14T11:17:04.643 INFO:teuthology.orchestra.run.smithi050.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.110.133, 185.199.109.133, 185.199.111.133, ... 2024-09-14T11:17:04.656 INFO:teuthology.orchestra.run.smithi050.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.110.133|:443... connected. 2024-09-14T11:17:04.742 INFO:teuthology.orchestra.run.smithi050.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-14T11:17:04.742 INFO:teuthology.orchestra.run.smithi050.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-14T11:17:04.742 INFO:teuthology.orchestra.run.smithi050.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-14T11:17:04.743 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-14T11:17:04.757 INFO:teuthology.orchestra.run.smithi050.stderr: 0K .......... .......... .......... .......... .......... 0% 3.24M 28s 2024-09-14T11:17:04.770 INFO:teuthology.orchestra.run.smithi050.stderr: 50K .......... .......... .......... .......... .......... 0% 3.70M 26s 2024-09-14T11:17:04.780 INFO:teuthology.orchestra.run.smithi050.stderr: 100K .......... .......... .......... .......... .......... 0% 5.03M 23s 2024-09-14T11:17:04.782 INFO:teuthology.orchestra.run.smithi050.stderr: 150K .......... .......... .......... .......... .......... 0% 22.3M 19s 2024-09-14T11:17:04.784 INFO:teuthology.orchestra.run.smithi050.stderr: 200K .......... .......... .......... .......... .......... 0% 22.4M 16s 2024-09-14T11:17:04.791 INFO:teuthology.orchestra.run.smithi050.stderr: 250K .......... .......... .......... .......... .......... 0% 23.7M 14s 2024-09-14T11:17:04.794 INFO:teuthology.orchestra.run.smithi050.stderr: 300K .......... .......... .......... .......... .......... 0% 6.83M 14s 2024-09-14T11:17:04.795 INFO:teuthology.orchestra.run.smithi050.stderr: 350K .......... .......... .......... .......... .......... 0% 55.1M 12s 2024-09-14T11:17:04.800 INFO:teuthology.orchestra.run.smithi050.stderr: 400K .......... .......... .......... .......... .......... 0% 30.1M 11s 2024-09-14T11:17:04.800 INFO:teuthology.orchestra.run.smithi050.stderr: 450K .......... .......... .......... .......... .......... 0% 111M 10s 2024-09-14T11:17:04.800 INFO:teuthology.orchestra.run.smithi050.stderr: 500K .......... .......... .......... .......... .......... 0% 54.7M 9s 2024-09-14T11:17:04.800 INFO:teuthology.orchestra.run.smithi050.stderr: 550K .......... .......... .......... .......... .......... 0% 40.1M 9s 2024-09-14T11:17:04.805 INFO:teuthology.orchestra.run.smithi050.stderr: 600K .......... .......... .......... .......... .......... 0% 9.17M 9s 2024-09-14T11:17:04.815 INFO:teuthology.orchestra.run.smithi050.stderr: 650K .......... .......... .......... .......... .......... 0% 87.7M 8s 2024-09-14T11:17:04.815 INFO:teuthology.orchestra.run.smithi050.stderr: 700K .......... .......... .......... .......... .......... 0% 34.2M 8s 2024-09-14T11:17:04.815 INFO:teuthology.orchestra.run.smithi050.stderr: 750K .......... .......... .......... .......... .......... 0% 55.4M 7s 2024-09-14T11:17:04.815 INFO:teuthology.orchestra.run.smithi050.stderr: 800K .......... .......... .......... .......... .......... 0% 118M 7s 2024-09-14T11:17:04.815 INFO:teuthology.orchestra.run.smithi050.stderr: 850K .......... .......... .......... .......... .......... 0% 39.5M 7s 2024-09-14T11:17:04.815 INFO:teuthology.orchestra.run.smithi050.stderr: 900K .......... .......... .......... .......... .......... 1% 141M 6s 2024-09-14T11:17:04.815 INFO:teuthology.orchestra.run.smithi050.stderr: 950K .......... .......... .......... .......... .......... 1% 246M 6s 2024-09-14T11:17:04.816 INFO:teuthology.orchestra.run.smithi050.stderr: 1000K .......... .......... .......... .......... .......... 1% 72.7M 6s 2024-09-14T11:17:04.816 INFO:teuthology.orchestra.run.smithi050.stderr: 1050K .......... .......... .......... .......... .......... 1% 79.2M 6s 2024-09-14T11:17:04.816 INFO:teuthology.orchestra.run.smithi050.stderr: 1100K .......... .......... .......... .......... .......... 1% 61.6M 6s 2024-09-14T11:17:04.816 INFO:teuthology.orchestra.run.smithi050.stderr: 1150K .......... .......... .......... .......... .......... 1% 129M 5s 2024-09-14T11:17:04.816 INFO:teuthology.orchestra.run.smithi050.stderr: 1200K .......... .......... .......... .......... .......... 1% 266M 5s 2024-09-14T11:17:06.102 INFO:teuthology.orchestra.run.smithi050.stderr: 1250K .......... .......... .......... .......... .......... 1% 10.6M 5s 2024-09-14T11:17:06.102 INFO:teuthology.orchestra.run.smithi050.stderr: 1300K .......... .......... .......... .......... .......... 1% 77.8M 5s 2024-09-14T11:17:06.102 INFO:teuthology.orchestra.run.smithi050.stderr: 1350K .......... .......... .......... .......... .......... 1% 40.8M 5s 2024-09-14T11:17:06.102 INFO:teuthology.orchestra.run.smithi050.stderr: 1400K .......... .......... .......... .......... .......... 1% 281M 5s 2024-09-14T11:17:06.103 INFO:teuthology.orchestra.run.smithi050.stderr: 1450K .......... .......... .......... .......... .......... 1% 247M 5s 2024-09-14T11:17:06.103 INFO:teuthology.orchestra.run.smithi050.stderr: 1500K .......... .......... .......... .......... .......... 1% 70.1M 5s 2024-09-14T11:17:06.103 INFO:teuthology.orchestra.run.smithi050.stderr: 1550K .......... .......... .......... .......... .......... 1% 262M 4s 2024-09-14T11:17:06.103 INFO:teuthology.orchestra.run.smithi050.stderr: 1600K .......... .......... .......... .......... .......... 1% 131M 4s 2024-09-14T11:17:06.103 INFO:teuthology.orchestra.run.smithi050.stderr: 1650K .......... .......... .......... .......... .......... 1% 283M 4s 2024-09-14T11:17:06.103 INFO:teuthology.orchestra.run.smithi050.stderr: 1700K .......... .......... .......... .......... .......... 1% 128M 4s 2024-09-14T11:17:06.103 INFO:teuthology.orchestra.run.smithi050.stderr: 1750K .......... .......... .......... .......... .......... 1% 79.3M 4s 2024-09-14T11:17:06.103 INFO:teuthology.orchestra.run.smithi050.stderr: 1800K .......... .......... .......... .......... .......... 1% 209M 4s 2024-09-14T11:17:06.103 INFO:teuthology.orchestra.run.smithi050.stderr: 1850K .......... .......... .......... .......... .......... 2% 311M 4s 2024-09-14T11:17:06.103 INFO:teuthology.orchestra.run.smithi050.stderr: 1900K .......... .......... .......... .......... .......... 2% 155M 4s 2024-09-14T11:17:06.103 INFO:teuthology.orchestra.run.smithi050.stderr: 1950K .......... .......... .......... .......... .......... 2% 140M 4s 2024-09-14T11:17:06.103 INFO:teuthology.orchestra.run.smithi050.stderr: 2000K .......... .......... .......... .......... .......... 2% 151M 4s 2024-09-14T11:17:06.103 INFO:teuthology.orchestra.run.smithi050.stderr: 2050K .......... .......... .......... .......... .......... 2% 142M 3s 2024-09-14T11:17:06.104 INFO:teuthology.orchestra.run.smithi050.stderr: 2100K .......... .......... .......... .......... .......... 2% 232M 3s 2024-09-14T11:17:06.104 INFO:teuthology.orchestra.run.smithi050.stderr: 2150K .......... .......... .......... .......... .......... 2% 248M 3s 2024-09-14T11:17:06.104 INFO:teuthology.orchestra.run.smithi050.stderr: 2200K .......... .......... .......... .......... .......... 2% 150M 3s 2024-09-14T11:17:06.104 INFO:teuthology.orchestra.run.smithi050.stderr: 2250K .......... .......... .......... .......... .......... 2% 166M 3s 2024-09-14T11:17:06.104 INFO:teuthology.orchestra.run.smithi050.stderr: 2300K .......... .......... .......... .......... .......... 2% 118M 3s 2024-09-14T11:17:06.104 INFO:teuthology.orchestra.run.smithi050.stderr: 2350K .......... .......... .......... .......... .......... 2% 316M 3s 2024-09-14T11:17:06.104 INFO:teuthology.orchestra.run.smithi050.stderr: 2400K .......... .......... .......... .......... .......... 2% 241M 3s 2024-09-14T11:17:06.104 INFO:teuthology.orchestra.run.smithi050.stderr: 2450K .......... .......... .......... .......... .......... 2% 249M 3s 2024-09-14T11:17:06.104 INFO:teuthology.orchestra.run.smithi050.stderr: 2500K .......... .......... .......... .......... .......... 2% 12.6M 3s 2024-09-14T11:17:06.104 INFO:teuthology.orchestra.run.smithi050.stderr: 2550K .......... .......... .......... .......... .......... 2% 281M 3s 2024-09-14T11:17:06.104 INFO:teuthology.orchestra.run.smithi050.stderr: 2600K .......... .......... .......... .......... .......... 2% 268M 3s 2024-09-14T11:17:06.104 INFO:teuthology.orchestra.run.smithi050.stderr: 2650K .......... .......... .......... .......... .......... 2% 212M 3s 2024-09-14T11:17:06.104 INFO:teuthology.orchestra.run.smithi050.stderr: 2700K .......... .......... .......... .......... .......... 2% 251M 3s 2024-09-14T11:17:06.104 INFO:teuthology.orchestra.run.smithi050.stderr: 2750K .......... .......... .......... .......... .......... 3% 47.0M 3s 2024-09-14T11:17:06.104 INFO:teuthology.orchestra.run.smithi050.stderr: 2800K .......... .......... .......... .......... .......... 3% 259M 3s 2024-09-14T11:17:06.105 INFO:teuthology.orchestra.run.smithi050.stderr: 2850K .......... .......... .......... .......... .......... 3% 291M 3s 2024-09-14T11:17:06.105 INFO:teuthology.orchestra.run.smithi050.stderr: 2900K .......... .......... .......... .......... .......... 3% 260M 3s 2024-09-14T11:17:06.105 INFO:teuthology.orchestra.run.smithi050.stderr: 2950K .......... .......... .......... .......... .......... 3% 311M 3s 2024-09-14T11:17:06.105 INFO:teuthology.orchestra.run.smithi050.stderr: 3000K .......... .......... .......... .......... .......... 3% 310M 3s 2024-09-14T11:17:06.105 INFO:teuthology.orchestra.run.smithi050.stderr: 3050K .......... .......... .......... .......... .......... 3% 209M 3s 2024-09-14T11:17:06.105 INFO:teuthology.orchestra.run.smithi050.stderr: 3100K .......... .......... .......... .......... .......... 3% 229M 3s 2024-09-14T11:17:06.105 INFO:teuthology.orchestra.run.smithi050.stderr: 3150K .......... .......... .......... .......... .......... 3% 221M 3s 2024-09-14T11:17:06.105 INFO:teuthology.orchestra.run.smithi050.stderr: 3200K .......... .......... .......... .......... .......... 3% 276M 2s 2024-09-14T11:17:06.105 INFO:teuthology.orchestra.run.smithi050.stderr: 3250K .......... .......... .......... .......... .......... 3% 275M 2s 2024-09-14T11:17:06.105 INFO:teuthology.orchestra.run.smithi050.stderr: 3300K .......... .......... .......... .......... .......... 3% 247M 2s 2024-09-14T11:17:06.105 INFO:teuthology.orchestra.run.smithi050.stderr: 3350K .......... .......... .......... .......... .......... 3% 264M 2s 2024-09-14T11:17:06.105 INFO:teuthology.orchestra.run.smithi050.stderr: 3400K .......... .......... .......... .......... .......... 3% 259M 2s 2024-09-14T11:17:06.105 INFO:teuthology.orchestra.run.smithi050.stderr: 3450K .......... .......... .......... .......... .......... 3% 252M 2s 2024-09-14T11:17:06.105 INFO:teuthology.orchestra.run.smithi050.stderr: 3500K .......... .......... .......... .......... .......... 3% 257M 2s 2024-09-14T11:17:06.106 INFO:teuthology.orchestra.run.smithi050.stderr: 3550K .......... .......... .......... .......... .......... 3% 189M 2s 2024-09-14T11:17:06.106 INFO:teuthology.orchestra.run.smithi050.stderr: 3600K .......... .......... .......... .......... .......... 3% 282M 2s 2024-09-14T11:17:06.106 INFO:teuthology.orchestra.run.smithi050.stderr: 3650K .......... .......... .......... .......... .......... 3% 253M 2s 2024-09-14T11:17:06.106 INFO:teuthology.orchestra.run.smithi050.stderr: 3700K .......... .......... .......... .......... .......... 4% 278M 2s 2024-09-14T11:17:06.106 INFO:teuthology.orchestra.run.smithi050.stderr: 3750K .......... .......... .......... .......... .......... 4% 292M 2s 2024-09-14T11:17:06.106 INFO:teuthology.orchestra.run.smithi050.stderr: 3800K .......... .......... .......... .......... .......... 4% 312M 2s 2024-09-14T11:17:06.106 INFO:teuthology.orchestra.run.smithi050.stderr: 3850K .......... .......... .......... .......... .......... 4% 324M 2s 2024-09-14T11:17:06.106 INFO:teuthology.orchestra.run.smithi050.stderr: 3900K .......... .......... .......... .......... .......... 4% 262M 2s 2024-09-14T11:17:06.106 INFO:teuthology.orchestra.run.smithi050.stderr: 3950K .......... .......... .......... .......... .......... 4% 300M 2s 2024-09-14T11:17:06.106 INFO:teuthology.orchestra.run.smithi050.stderr: 4000K .......... .......... .......... .......... .......... 4% 333M 2s 2024-09-14T11:17:06.106 INFO:teuthology.orchestra.run.smithi050.stderr: 4050K .......... .......... .......... .......... .......... 4% 316M 2s 2024-09-14T11:17:06.106 INFO:teuthology.orchestra.run.smithi050.stderr: 4100K .......... .......... .......... .......... .......... 4% 273M 2s 2024-09-14T11:17:06.106 INFO:teuthology.orchestra.run.smithi050.stderr: 4150K .......... .......... .......... .......... .......... 4% 324M 2s 2024-09-14T11:17:06.107 INFO:teuthology.orchestra.run.smithi050.stderr: 4200K .......... .......... .......... .......... .......... 4% 302M 2s 2024-09-14T11:17:06.107 INFO:teuthology.orchestra.run.smithi050.stderr: 4250K .......... .......... .......... .......... .......... 4% 306M 2s 2024-09-14T11:17:06.107 INFO:teuthology.orchestra.run.smithi050.stderr: 4300K .......... .......... .......... .......... .......... 4% 231M 2s 2024-09-14T11:17:06.107 INFO:teuthology.orchestra.run.smithi050.stderr: 4350K .......... .......... .......... .......... .......... 4% 311M 2s 2024-09-14T11:17:06.107 INFO:teuthology.orchestra.run.smithi050.stderr: 4400K .......... .......... .......... .......... .......... 4% 301M 2s 2024-09-14T11:17:06.107 INFO:teuthology.orchestra.run.smithi050.stderr: 4450K .......... .......... .......... .......... .......... 4% 298M 2s 2024-09-14T11:17:06.107 INFO:teuthology.orchestra.run.smithi050.stderr: 4500K .......... .......... .......... .......... .......... 4% 235M 2s 2024-09-14T11:17:06.107 INFO:teuthology.orchestra.run.smithi050.stderr: 4550K .......... .......... .......... .......... .......... 4% 252M 2s 2024-09-14T11:17:06.107 INFO:teuthology.orchestra.run.smithi050.stderr: 4600K .......... .......... .......... .......... .......... 5% 253M 2s 2024-09-14T11:17:06.107 INFO:teuthology.orchestra.run.smithi050.stderr: 4650K .......... .......... .......... .......... .......... 5% 260M 2s 2024-09-14T11:17:06.107 INFO:teuthology.orchestra.run.smithi050.stderr: 4700K .......... .......... .......... .......... .......... 5% 236M 2s 2024-09-14T11:17:06.107 INFO:teuthology.orchestra.run.smithi050.stderr: 4750K .......... .......... .......... .......... .......... 5% 312M 2s 2024-09-14T11:17:06.107 INFO:teuthology.orchestra.run.smithi050.stderr: 4800K .......... .......... .......... .......... .......... 5% 326M 2s 2024-09-14T11:17:06.107 INFO:teuthology.orchestra.run.smithi050.stderr: 4850K .......... .......... .......... .......... .......... 5% 274M 2s 2024-09-14T11:17:06.107 INFO:teuthology.orchestra.run.smithi050.stderr: 4900K .......... .......... .......... .......... .......... 5% 245M 2s 2024-09-14T11:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr: 4950K .......... .......... .......... .......... .......... 5% 316M 2s 2024-09-14T11:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr: 5000K .......... .......... .......... .......... .......... 5% 304M 2s 2024-09-14T11:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr: 5050K .......... .......... .......... .......... .......... 5% 18.2M 2s 2024-09-14T11:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr: 5100K .......... .......... .......... .......... .......... 5% 243M 2s 2024-09-14T11:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr: 5150K .......... .......... .......... .......... .......... 5% 273M 2s 2024-09-14T11:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr: 5200K .......... .......... .......... .......... .......... 5% 309M 2s 2024-09-14T11:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr: 5250K .......... .......... .......... .......... .......... 5% 18.7M 2s 2024-09-14T11:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr: 5300K .......... .......... .......... .......... .......... 5% 257M 2s 2024-09-14T11:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr: 5350K .......... .......... .......... .......... .......... 5% 309M 2s 2024-09-14T11:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr: 5400K .......... .......... .......... .......... .......... 5% 283M 2s 2024-09-14T11:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr: 5450K .......... .......... .......... .......... .......... 5% 288M 2s 2024-09-14T11:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr: 5500K .......... .......... .......... .......... .......... 5% 253M 2s 2024-09-14T11:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr: 5550K .......... .......... .......... .......... .......... 6% 309M 2s 2024-09-14T11:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr: 5600K .......... .......... .......... .......... .......... 6% 302M 2s 2024-09-14T11:17:06.109 INFO:teuthology.orchestra.run.smithi050.stderr: 5650K .......... .......... .......... .......... .......... 6% 316M 2s 2024-09-14T11:17:06.109 INFO:teuthology.orchestra.run.smithi050.stderr: 5700K .......... .......... .......... .......... .......... 6% 287M 2s 2024-09-14T11:17:06.109 INFO:teuthology.orchestra.run.smithi050.stderr: 5750K .......... .......... .......... .......... .......... 6% 353M 2s 2024-09-14T11:17:06.109 INFO:teuthology.orchestra.run.smithi050.stderr: 5800K .......... .......... .......... .......... .......... 6% 362M 2s 2024-09-14T11:17:06.109 INFO:teuthology.orchestra.run.smithi050.stderr: 5850K .......... .......... .......... .......... .......... 6% 355M 2s 2024-09-14T11:17:06.109 INFO:teuthology.orchestra.run.smithi050.stderr: 5900K .......... .......... .......... .......... .......... 6% 301M 2s 2024-09-14T11:17:06.109 INFO:teuthology.orchestra.run.smithi050.stderr: 5950K .......... .......... .......... .......... .......... 6% 250M 2s 2024-09-14T11:17:06.109 INFO:teuthology.orchestra.run.smithi050.stderr: 6000K .......... .......... .......... .......... .......... 6% 286M 2s 2024-09-14T11:17:06.109 INFO:teuthology.orchestra.run.smithi050.stderr: 6050K .......... .......... .......... .......... .......... 6% 232M 1s 2024-09-14T11:17:06.109 INFO:teuthology.orchestra.run.smithi050.stderr: 6100K .......... .......... .......... .......... .......... 6% 261M 1s 2024-09-14T11:17:06.109 INFO:teuthology.orchestra.run.smithi050.stderr: 6150K .......... .......... .......... .......... .......... 6% 295M 1s 2024-09-14T11:17:06.109 INFO:teuthology.orchestra.run.smithi050.stderr: 6200K .......... .......... .......... .......... .......... 6% 361M 1s 2024-09-14T11:17:06.109 INFO:teuthology.orchestra.run.smithi050.stderr: 6250K .......... .......... .......... .......... .......... 6% 356M 1s 2024-09-14T11:17:06.109 INFO:teuthology.orchestra.run.smithi050.stderr: 6300K .......... .......... .......... .......... .......... 6% 303M 1s 2024-09-14T11:17:06.110 INFO:teuthology.orchestra.run.smithi050.stderr: 6350K .......... .......... .......... .......... .......... 6% 333M 1s 2024-09-14T11:17:06.110 INFO:teuthology.orchestra.run.smithi050.stderr: 6400K .......... .......... .......... .......... .......... 6% 316M 1s 2024-09-14T11:17:06.110 INFO:teuthology.orchestra.run.smithi050.stderr: 6450K .......... .......... .......... .......... .......... 6% 357M 1s 2024-09-14T11:17:06.110 INFO:teuthology.orchestra.run.smithi050.stderr: 6500K .......... .......... .......... .......... .......... 7% 334M 1s 2024-09-14T11:17:06.110 INFO:teuthology.orchestra.run.smithi050.stderr: 6550K .......... .......... .......... .......... .......... 7% 373M 1s 2024-09-14T11:17:06.110 INFO:teuthology.orchestra.run.smithi050.stderr: 6600K .......... .......... .......... .......... .......... 7% 375M 1s 2024-09-14T11:17:06.110 INFO:teuthology.orchestra.run.smithi050.stderr: 6650K .......... .......... .......... .......... .......... 7% 379M 1s 2024-09-14T11:17:06.110 INFO:teuthology.orchestra.run.smithi050.stderr: 6700K .......... .......... .......... .......... .......... 7% 300M 1s 2024-09-14T11:17:06.110 INFO:teuthology.orchestra.run.smithi050.stderr: 6750K .......... .......... .......... .......... .......... 7% 380M 1s 2024-09-14T11:17:06.110 INFO:teuthology.orchestra.run.smithi050.stderr: 6800K .......... .......... .......... .......... .......... 7% 361M 1s 2024-09-14T11:17:06.110 INFO:teuthology.orchestra.run.smithi050.stderr: 6850K .......... .......... .......... .......... .......... 7% 358M 1s 2024-09-14T11:17:06.110 INFO:teuthology.orchestra.run.smithi050.stderr: 6900K .......... .......... .......... .......... .......... 7% 288M 1s 2024-09-14T11:17:06.110 INFO:teuthology.orchestra.run.smithi050.stderr: 6950K .......... .......... .......... .......... .......... 7% 345M 1s 2024-09-14T11:17:06.110 INFO:teuthology.orchestra.run.smithi050.stderr: 7000K .......... .......... .......... .......... .......... 7% 353M 1s 2024-09-14T11:17:06.111 INFO:teuthology.orchestra.run.smithi050.stderr: 7050K .......... .......... .......... .......... .......... 7% 322M 1s 2024-09-14T11:17:06.111 INFO:teuthology.orchestra.run.smithi050.stderr: 7100K .......... .......... .......... .......... .......... 7% 310M 1s 2024-09-14T11:17:06.111 INFO:teuthology.orchestra.run.smithi050.stderr: 7150K .......... .......... .......... .......... .......... 7% 375M 1s 2024-09-14T11:17:06.111 INFO:teuthology.orchestra.run.smithi050.stderr: 7200K .......... .......... .......... .......... .......... 7% 377M 1s 2024-09-14T11:17:06.111 INFO:teuthology.orchestra.run.smithi050.stderr: 7250K .......... .......... .......... .......... .......... 7% 381M 1s 2024-09-14T11:17:06.111 INFO:teuthology.orchestra.run.smithi050.stderr: 7300K .......... .......... .......... .......... .......... 7% 343M 1s 2024-09-14T11:17:06.111 INFO:teuthology.orchestra.run.smithi050.stderr: 7350K .......... .......... .......... .......... .......... 7% 376M 1s 2024-09-14T11:17:06.111 INFO:teuthology.orchestra.run.smithi050.stderr: 7400K .......... .......... .......... .......... .......... 8% 347M 1s 2024-09-14T11:17:06.111 INFO:teuthology.orchestra.run.smithi050.stderr: 7450K .......... .......... .......... .......... .......... 8% 384M 1s 2024-09-14T11:17:06.111 INFO:teuthology.orchestra.run.smithi050.stderr: 7500K .......... .......... .......... .......... .......... 8% 316M 1s 2024-09-14T11:17:06.111 INFO:teuthology.orchestra.run.smithi050.stderr: 7550K .......... .......... .......... .......... .......... 8% 375M 1s 2024-09-14T11:17:06.111 INFO:teuthology.orchestra.run.smithi050.stderr: 7600K .......... .......... .......... .......... .......... 8% 373M 1s 2024-09-14T11:17:06.111 INFO:teuthology.orchestra.run.smithi050.stderr: 7650K .......... .......... .......... .......... .......... 8% 372M 1s 2024-09-14T11:17:06.111 INFO:teuthology.orchestra.run.smithi050.stderr: 7700K .......... .......... .......... .......... .......... 8% 339M 1s 2024-09-14T11:17:06.112 INFO:teuthology.orchestra.run.smithi050.stderr: 7750K .......... .......... .......... .......... .......... 8% 364M 1s 2024-09-14T11:17:06.112 INFO:teuthology.orchestra.run.smithi050.stderr: 7800K .......... .......... .......... .......... .......... 8% 366M 1s 2024-09-14T11:17:06.112 INFO:teuthology.orchestra.run.smithi050.stderr: 7850K .......... .......... .......... .......... .......... 8% 70.1M 1s 2024-09-14T11:17:06.112 INFO:teuthology.orchestra.run.smithi050.stderr: 7900K .......... .......... .......... .......... .......... 8% 61.3M 1s 2024-09-14T11:17:06.112 INFO:teuthology.orchestra.run.smithi050.stderr: 7950K .......... .......... .......... .......... .......... 8% 303M 1s 2024-09-14T11:17:06.112 INFO:teuthology.orchestra.run.smithi050.stderr: 8000K .......... .......... .......... .......... .......... 8% 355M 1s 2024-09-14T11:17:06.112 INFO:teuthology.orchestra.run.smithi050.stderr: 8050K .......... .......... .......... .......... .......... 8% 339M 1s 2024-09-14T11:17:06.112 INFO:teuthology.orchestra.run.smithi050.stderr: 8100K .......... .......... .......... .......... .......... 8% 341M 1s 2024-09-14T11:17:06.112 INFO:teuthology.orchestra.run.smithi050.stderr: 8150K .......... .......... .......... .......... .......... 8% 363M 1s 2024-09-14T11:17:06.112 INFO:teuthology.orchestra.run.smithi050.stderr: 8200K .......... .......... .......... .......... .......... 8% 71.1M 1s 2024-09-14T11:17:06.112 INFO:teuthology.orchestra.run.smithi050.stderr: 8250K .......... .......... .......... .......... .......... 8% 17.5M 1s 2024-09-14T11:17:06.112 INFO:teuthology.orchestra.run.smithi050.stderr: 8300K .......... .......... .......... .......... .......... 8% 81.0M 1s 2024-09-14T11:17:06.112 INFO:teuthology.orchestra.run.smithi050.stderr: 8350K .......... .......... .......... .......... .......... 9% 134M 1s 2024-09-14T11:17:06.112 INFO:teuthology.orchestra.run.smithi050.stderr: 8400K .......... .......... .......... .......... .......... 9% 328M 1s 2024-09-14T11:17:06.113 INFO:teuthology.orchestra.run.smithi050.stderr: 8450K .......... .......... .......... .......... .......... 9% 305M 1s 2024-09-14T11:17:06.113 INFO:teuthology.orchestra.run.smithi050.stderr: 8500K .......... .......... .......... .......... .......... 9% 320M 1s 2024-09-14T11:17:06.113 INFO:teuthology.orchestra.run.smithi050.stderr: 8550K .......... .......... .......... .......... .......... 9% 353M 1s 2024-09-14T11:17:06.113 INFO:teuthology.orchestra.run.smithi050.stderr: 8600K .......... .......... .......... .......... .......... 9% 355M 1s 2024-09-14T11:17:06.113 INFO:teuthology.orchestra.run.smithi050.stderr: 8650K .......... .......... .......... .......... .......... 9% 364M 1s 2024-09-14T11:17:06.113 INFO:teuthology.orchestra.run.smithi050.stderr: 8700K .......... .......... .......... .......... .......... 9% 294M 1s 2024-09-14T11:17:06.113 INFO:teuthology.orchestra.run.smithi050.stderr: 8750K .......... .......... .......... .......... .......... 9% 358M 1s 2024-09-14T11:17:06.113 INFO:teuthology.orchestra.run.smithi050.stderr: 8800K .......... .......... .......... .......... .......... 9% 325M 1s 2024-09-14T11:17:06.113 INFO:teuthology.orchestra.run.smithi050.stderr: 8850K .......... .......... .......... .......... .......... 9% 373M 1s 2024-09-14T11:17:06.113 INFO:teuthology.orchestra.run.smithi050.stderr: 8900K .......... .......... .......... .......... .......... 9% 290M 1s 2024-09-14T11:17:06.113 INFO:teuthology.orchestra.run.smithi050.stderr: 8950K .......... .......... .......... .......... .......... 9% 325M 1s 2024-09-14T11:17:06.113 INFO:teuthology.orchestra.run.smithi050.stderr: 9000K .......... .......... .......... .......... .......... 9% 362M 1s 2024-09-14T11:17:06.113 INFO:teuthology.orchestra.run.smithi050.stderr: 9050K .......... .......... .......... .......... .......... 9% 359M 1s 2024-09-14T11:17:06.113 INFO:teuthology.orchestra.run.smithi050.stderr: 9100K .......... .......... .......... .......... .......... 9% 291M 1s 2024-09-14T11:17:06.114 INFO:teuthology.orchestra.run.smithi050.stderr: 9150K .......... .......... .......... .......... .......... 9% 334M 1s 2024-09-14T11:17:06.114 INFO:teuthology.orchestra.run.smithi050.stderr: 9200K .......... .......... .......... .......... .......... 9% 368M 1s 2024-09-14T11:17:06.114 INFO:teuthology.orchestra.run.smithi050.stderr: 9250K .......... .......... .......... .......... .......... 10% 379M 1s 2024-09-14T11:17:06.114 INFO:teuthology.orchestra.run.smithi050.stderr: 9300K .......... .......... .......... .......... .......... 10% 345M 1s 2024-09-14T11:17:06.114 INFO:teuthology.orchestra.run.smithi050.stderr: 9350K .......... .......... .......... .......... .......... 10% 377M 1s 2024-09-14T11:17:06.114 INFO:teuthology.orchestra.run.smithi050.stderr: 9400K .......... .......... .......... .......... .......... 10% 358M 1s 2024-09-14T11:17:06.114 INFO:teuthology.orchestra.run.smithi050.stderr: 9450K .......... .......... .......... .......... .......... 10% 376M 1s 2024-09-14T11:17:06.114 INFO:teuthology.orchestra.run.smithi050.stderr: 9500K .......... .......... .......... .......... .......... 10% 279M 1s 2024-09-14T11:17:06.114 INFO:teuthology.orchestra.run.smithi050.stderr: 9550K .......... .......... .......... .......... .......... 10% 369M 1s 2024-09-14T11:17:06.114 INFO:teuthology.orchestra.run.smithi050.stderr: 9600K .......... .......... .......... .......... .......... 10% 379M 1s 2024-09-14T11:17:06.114 INFO:teuthology.orchestra.run.smithi050.stderr: 9650K .......... .......... .......... .......... .......... 10% 304M 1s 2024-09-14T11:17:06.114 INFO:teuthology.orchestra.run.smithi050.stderr: 9700K .......... .......... .......... .......... .......... 10% 268M 1s 2024-09-14T11:17:06.114 INFO:teuthology.orchestra.run.smithi050.stderr: 9750K .......... .......... .......... .......... .......... 10% 367M 1s 2024-09-14T11:17:06.114 INFO:teuthology.orchestra.run.smithi050.stderr: 9800K .......... .......... .......... .......... .......... 10% 352M 1s 2024-09-14T11:17:06.115 INFO:teuthology.orchestra.run.smithi050.stderr: 9850K .......... .......... .......... .......... .......... 10% 358M 1s 2024-09-14T11:17:06.115 INFO:teuthology.orchestra.run.smithi050.stderr: 9900K .......... .......... .......... .......... .......... 10% 311M 1s 2024-09-14T11:17:06.115 INFO:teuthology.orchestra.run.smithi050.stderr: 9950K .......... .......... .......... .......... .......... 10% 313M 1s 2024-09-14T11:17:06.115 INFO:teuthology.orchestra.run.smithi050.stderr: 10000K .......... .......... .......... .......... .......... 10% 345M 1s 2024-09-14T11:17:06.115 INFO:teuthology.orchestra.run.smithi050.stderr: 10050K .......... .......... .......... .......... .......... 10% 358M 1s 2024-09-14T11:17:06.115 INFO:teuthology.orchestra.run.smithi050.stderr: 10100K .......... .......... .......... .......... .......... 10% 341M 1s 2024-09-14T11:17:06.115 INFO:teuthology.orchestra.run.smithi050.stderr: 10150K .......... .......... .......... .......... .......... 10% 349M 1s 2024-09-14T11:17:06.115 INFO:teuthology.orchestra.run.smithi050.stderr: 10200K .......... .......... .......... .......... .......... 11% 304M 1s 2024-09-14T11:17:06.115 INFO:teuthology.orchestra.run.smithi050.stderr: 10250K .......... .......... .......... .......... .......... 11% 421M 1s 2024-09-14T11:17:06.115 INFO:teuthology.orchestra.run.smithi050.stderr: 10300K .......... .......... .......... .......... .......... 11% 299M 1s 2024-09-14T11:17:06.115 INFO:teuthology.orchestra.run.smithi050.stderr: 10350K .......... .......... .......... .......... .......... 11% 330M 1s 2024-09-14T11:17:06.115 INFO:teuthology.orchestra.run.smithi050.stderr: 10400K .......... .......... .......... .......... .......... 11% 230M 1s 2024-09-14T11:17:06.115 INFO:teuthology.orchestra.run.smithi050.stderr: 10450K .......... .......... .......... .......... .......... 11% 305M 1s 2024-09-14T11:17:06.115 INFO:teuthology.orchestra.run.smithi050.stderr: 10500K .......... .......... .......... .......... .......... 11% 246M 1s 2024-09-14T11:17:06.115 INFO:teuthology.orchestra.run.smithi050.stderr: 10550K .......... .......... .......... .......... .......... 11% 305M 1s 2024-09-14T11:17:06.116 INFO:teuthology.orchestra.run.smithi050.stderr: 10600K .......... .......... .......... .......... .......... 11% 374M 1s 2024-09-14T11:17:06.116 INFO:teuthology.orchestra.run.smithi050.stderr: 10650K .......... .......... .......... .......... .......... 11% 372M 1s 2024-09-14T11:17:06.116 INFO:teuthology.orchestra.run.smithi050.stderr: 10700K .......... .......... .......... .......... .......... 11% 321M 1s 2024-09-14T11:17:06.116 INFO:teuthology.orchestra.run.smithi050.stderr: 10750K .......... .......... .......... .......... .......... 11% 385M 1s 2024-09-14T11:17:06.116 INFO:teuthology.orchestra.run.smithi050.stderr: 10800K .......... .......... .......... .......... .......... 11% 347M 1s 2024-09-14T11:17:06.116 INFO:teuthology.orchestra.run.smithi050.stderr: 10850K .......... .......... .......... .......... .......... 11% 368M 1s 2024-09-14T11:17:06.116 INFO:teuthology.orchestra.run.smithi050.stderr: 10900K .......... .......... .......... .......... .......... 11% 348M 1s 2024-09-14T11:17:06.116 INFO:teuthology.orchestra.run.smithi050.stderr: 10950K .......... .......... .......... .......... .......... 11% 374M 1s 2024-09-14T11:17:06.116 INFO:teuthology.orchestra.run.smithi050.stderr: 11000K .......... .......... .......... .......... .......... 11% 345M 1s 2024-09-14T11:17:06.116 INFO:teuthology.orchestra.run.smithi050.stderr: 11050K .......... .......... .......... .......... .......... 11% 375M 1s 2024-09-14T11:17:06.116 INFO:teuthology.orchestra.run.smithi050.stderr: 11100K .......... .......... .......... .......... .......... 12% 327M 1s 2024-09-14T11:17:06.116 INFO:teuthology.orchestra.run.smithi050.stderr: 11150K .......... .......... .......... .......... .......... 12% 150M 1s 2024-09-14T11:17:06.116 INFO:teuthology.orchestra.run.smithi050.stderr: 11200K .......... .......... .......... .......... .......... 12% 315M 1s 2024-09-14T11:17:06.117 INFO:teuthology.orchestra.run.smithi050.stderr: 11250K .......... .......... .......... .......... .......... 12% 372M 1s 2024-09-14T11:17:06.117 INFO:teuthology.orchestra.run.smithi050.stderr: 11300K .......... .......... .......... .......... .......... 12% 30.7M 1s 2024-09-14T11:17:06.117 INFO:teuthology.orchestra.run.smithi050.stderr: 11350K .......... .......... .......... .......... .......... 12% 26.3M 1s 2024-09-14T11:17:06.117 INFO:teuthology.orchestra.run.smithi050.stderr: 11400K .......... .......... .......... .......... .......... 12% 140M 1s 2024-09-14T11:17:06.117 INFO:teuthology.orchestra.run.smithi050.stderr: 11450K .......... .......... .......... .......... .......... 12% 378M 1s 2024-09-14T11:17:06.117 INFO:teuthology.orchestra.run.smithi050.stderr: 11500K .......... .......... .......... .......... .......... 12% 259M 1s 2024-09-14T11:17:06.117 INFO:teuthology.orchestra.run.smithi050.stderr: 11550K .......... .......... .......... .......... .......... 12% 373M 1s 2024-09-14T11:17:06.117 INFO:teuthology.orchestra.run.smithi050.stderr: 11600K .......... .......... .......... .......... .......... 12% 174M 1s 2024-09-14T11:17:06.117 INFO:teuthology.orchestra.run.smithi050.stderr: 11650K .......... .......... .......... .......... .......... 12% 245M 1s 2024-09-14T11:17:06.117 INFO:teuthology.orchestra.run.smithi050.stderr: 11700K .......... .......... .......... .......... .......... 12% 338M 1s 2024-09-14T11:17:06.117 INFO:teuthology.orchestra.run.smithi050.stderr: 11750K .......... .......... .......... .......... .......... 12% 357M 1s 2024-09-14T11:17:06.117 INFO:teuthology.orchestra.run.smithi050.stderr: 11800K .......... .......... .......... .......... .......... 12% 368M 1s 2024-09-14T11:17:06.117 INFO:teuthology.orchestra.run.smithi050.stderr: 11850K .......... .......... .......... .......... .......... 12% 374M 1s 2024-09-14T11:17:06.117 INFO:teuthology.orchestra.run.smithi050.stderr: 11900K .......... .......... .......... .......... .......... 12% 310M 1s 2024-09-14T11:17:06.117 INFO:teuthology.orchestra.run.smithi050.stderr: 11950K .......... .......... .......... .......... .......... 12% 252M 1s 2024-09-14T11:17:06.118 INFO:teuthology.orchestra.run.smithi050.stderr: 12000K .......... .......... .......... .......... .......... 12% 368M 1s 2024-09-14T11:17:06.118 INFO:teuthology.orchestra.run.smithi050.stderr: 12050K .......... .......... .......... .......... .......... 13% 364M 1s 2024-09-14T11:17:06.118 INFO:teuthology.orchestra.run.smithi050.stderr: 12100K .......... .......... .......... .......... .......... 13% 334M 1s 2024-09-14T11:17:06.118 INFO:teuthology.orchestra.run.smithi050.stderr: 12150K .......... .......... .......... .......... .......... 13% 373M 1s 2024-09-14T11:17:06.118 INFO:teuthology.orchestra.run.smithi050.stderr: 12200K .......... .......... .......... .......... .......... 13% 372M 1s 2024-09-14T11:17:06.118 INFO:teuthology.orchestra.run.smithi050.stderr: 12250K .......... .......... .......... .......... .......... 13% 382M 1s 2024-09-14T11:17:06.118 INFO:teuthology.orchestra.run.smithi050.stderr: 12300K .......... .......... .......... .......... .......... 13% 274M 1s 2024-09-14T11:17:06.118 INFO:teuthology.orchestra.run.smithi050.stderr: 12350K .......... .......... .......... .......... .......... 13% 284M 1s 2024-09-14T11:17:06.118 INFO:teuthology.orchestra.run.smithi050.stderr: 12400K .......... .......... .......... .......... .......... 13% 338M 1s 2024-09-14T11:17:06.118 INFO:teuthology.orchestra.run.smithi050.stderr: 12450K .......... .......... .......... .......... .......... 13% 328M 1s 2024-09-14T11:17:06.118 INFO:teuthology.orchestra.run.smithi050.stderr: 12500K .......... .......... .......... .......... .......... 13% 330M 1s 2024-09-14T11:17:06.118 INFO:teuthology.orchestra.run.smithi050.stderr: 12550K .......... .......... .......... .......... .......... 13% 368M 1s 2024-09-14T11:17:06.118 INFO:teuthology.orchestra.run.smithi050.stderr: 12600K .......... .......... .......... .......... .......... 13% 388M 1s 2024-09-14T11:17:06.118 INFO:teuthology.orchestra.run.smithi050.stderr: 12650K .......... .......... .......... .......... .......... 13% 346M 1s 2024-09-14T11:17:06.119 INFO:teuthology.orchestra.run.smithi050.stderr: 12700K .......... .......... .......... .......... .......... 13% 319M 1s 2024-09-14T11:17:06.119 INFO:teuthology.orchestra.run.smithi050.stderr: 12750K .......... .......... .......... .......... .......... 13% 387M 1s 2024-09-14T11:17:06.119 INFO:teuthology.orchestra.run.smithi050.stderr: 12800K .......... .......... .......... .......... .......... 13% 384M 1s 2024-09-14T11:17:06.119 INFO:teuthology.orchestra.run.smithi050.stderr: 12850K .......... .......... .......... .......... .......... 13% 392M 1s 2024-09-14T11:17:06.119 INFO:teuthology.orchestra.run.smithi050.stderr: 12900K .......... .......... .......... .......... .......... 13% 151M 1s 2024-09-14T11:17:06.119 INFO:teuthology.orchestra.run.smithi050.stderr: 12950K .......... .......... .......... .......... .......... 13% 333M 1s 2024-09-14T11:17:06.119 INFO:teuthology.orchestra.run.smithi050.stderr: 13000K .......... .......... .......... .......... .......... 14% 367M 1s 2024-09-14T11:17:06.119 INFO:teuthology.orchestra.run.smithi050.stderr: 13050K .......... .......... .......... .......... .......... 14% 325M 1s 2024-09-14T11:17:06.119 INFO:teuthology.orchestra.run.smithi050.stderr: 13100K .......... .......... .......... .......... .......... 14% 346M 1s 2024-09-14T11:17:06.119 INFO:teuthology.orchestra.run.smithi050.stderr: 13150K .......... .......... .......... .......... .......... 14% 390M 1s 2024-09-14T11:17:06.119 INFO:teuthology.orchestra.run.smithi050.stderr: 13200K .......... .......... .......... .......... .......... 14% 214M 1s 2024-09-14T11:17:06.119 INFO:teuthology.orchestra.run.smithi050.stderr: 13250K .......... .......... .......... .......... .......... 14% 372M 1s 2024-09-14T11:17:06.119 INFO:teuthology.orchestra.run.smithi050.stderr: 13300K .......... .......... .......... .......... .......... 14% 304M 1s 2024-09-14T11:17:06.119 INFO:teuthology.orchestra.run.smithi050.stderr: 13350K .......... .......... .......... .......... .......... 14% 369M 1s 2024-09-14T11:17:06.120 INFO:teuthology.orchestra.run.smithi050.stderr: 13400K .......... .......... .......... .......... .......... 14% 387M 1s 2024-09-14T11:17:06.120 INFO:teuthology.orchestra.run.smithi050.stderr: 13450K .......... .......... .......... .......... .......... 14% 383M 1s 2024-09-14T11:17:06.120 INFO:teuthology.orchestra.run.smithi050.stderr: 13500K .......... .......... .......... .......... .......... 14% 187M 1s 2024-09-14T11:17:06.120 INFO:teuthology.orchestra.run.smithi050.stderr: 13550K .......... .......... .......... .......... .......... 14% 257M 1s 2024-09-14T11:17:06.120 INFO:teuthology.orchestra.run.smithi050.stderr: 13600K .......... .......... .......... .......... .......... 14% 338M 1s 2024-09-14T11:17:06.120 INFO:teuthology.orchestra.run.smithi050.stderr: 13650K .......... .......... .......... .......... .......... 14% 382M 1s 2024-09-14T11:17:06.120 INFO:teuthology.orchestra.run.smithi050.stderr: 13700K .......... .......... .......... .......... .......... 14% 332M 1s 2024-09-14T11:17:06.120 INFO:teuthology.orchestra.run.smithi050.stderr: 13750K .......... .......... .......... .......... .......... 14% 354M 1s 2024-09-14T11:17:06.120 INFO:teuthology.orchestra.run.smithi050.stderr: 13800K .......... .......... .......... .......... .......... 14% 378M 1s 2024-09-14T11:17:06.120 INFO:teuthology.orchestra.run.smithi050.stderr: 13850K .......... .......... .......... .......... .......... 14% 382M 1s 2024-09-14T11:17:06.120 INFO:teuthology.orchestra.run.smithi050.stderr: 13900K .......... .......... .......... .......... .......... 15% 313M 1s 2024-09-14T11:17:06.120 INFO:teuthology.orchestra.run.smithi050.stderr: 13950K .......... .......... .......... .......... .......... 15% 358M 1s 2024-09-14T11:17:06.120 INFO:teuthology.orchestra.run.smithi050.stderr: 14000K .......... .......... .......... .......... .......... 15% 385M 1s 2024-09-14T11:17:06.121 INFO:teuthology.orchestra.run.smithi050.stderr: 14050K .......... .......... .......... .......... .......... 15% 308M 1s 2024-09-14T11:17:06.121 INFO:teuthology.orchestra.run.smithi050.stderr: 14100K .......... .......... .......... .......... .......... 15% 278M 1s 2024-09-14T11:17:06.121 INFO:teuthology.orchestra.run.smithi050.stderr: 14150K .......... .......... .......... .......... .......... 15% 381M 1s 2024-09-14T11:17:06.121 INFO:teuthology.orchestra.run.smithi050.stderr: 14200K .......... .......... .......... .......... .......... 15% 385M 1s 2024-09-14T11:17:06.121 INFO:teuthology.orchestra.run.smithi050.stderr: 14250K .......... .......... .......... .......... .......... 15% 391M 1s 2024-09-14T11:17:06.121 INFO:teuthology.orchestra.run.smithi050.stderr: 14300K .......... .......... .......... .......... .......... 15% 39.2M 1s 2024-09-14T11:17:06.121 INFO:teuthology.orchestra.run.smithi050.stderr: 14350K .......... .......... .......... .......... .......... 15% 378M 1s 2024-09-14T11:17:06.121 INFO:teuthology.orchestra.run.smithi050.stderr: 14400K .......... .......... .......... .......... .......... 15% 25.9M 1s 2024-09-14T11:17:06.121 INFO:teuthology.orchestra.run.smithi050.stderr: 14450K .......... .......... .......... .......... .......... 15% 108M 1s 2024-09-14T11:17:06.121 INFO:teuthology.orchestra.run.smithi050.stderr: 14500K .......... .......... .......... .......... .......... 15% 225M 1s 2024-09-14T11:17:06.121 INFO:teuthology.orchestra.run.smithi050.stderr: 14550K .......... .......... .......... .......... .......... 15% 379M 1s 2024-09-14T11:17:06.121 INFO:teuthology.orchestra.run.smithi050.stderr: 14600K .......... .......... .......... .......... .......... 15% 227M 1s 2024-09-14T11:17:06.121 INFO:teuthology.orchestra.run.smithi050.stderr: 14650K .......... .......... .......... .......... .......... 15% 264M 1s 2024-09-14T11:17:06.121 INFO:teuthology.orchestra.run.smithi050.stderr: 14700K .......... .......... .......... .......... .......... 15% 200M 1s 2024-09-14T11:17:06.121 INFO:teuthology.orchestra.run.smithi050.stderr: 14750K .......... .......... .......... .......... .......... 15% 298M 1s 2024-09-14T11:17:06.122 INFO:teuthology.orchestra.run.smithi050.stderr: 14800K .......... .......... .......... .......... .......... 15% 382M 1s 2024-09-14T11:17:06.122 INFO:teuthology.orchestra.run.smithi050.stderr: 14850K .......... .......... .......... .......... .......... 16% 322M 1s 2024-09-14T11:17:06.122 INFO:teuthology.orchestra.run.smithi050.stderr: 14900K .......... .......... .......... .......... .......... 16% 332M 1s 2024-09-14T11:17:06.122 INFO:teuthology.orchestra.run.smithi050.stderr: 14950K .......... .......... .......... .......... .......... 16% 386M 1s 2024-09-14T11:17:06.122 INFO:teuthology.orchestra.run.smithi050.stderr: 15000K .......... .......... .......... .......... .......... 16% 381M 1s 2024-09-14T11:17:06.122 INFO:teuthology.orchestra.run.smithi050.stderr: 15050K .......... .......... .......... .......... .......... 16% 161M 1s 2024-09-14T11:17:06.122 INFO:teuthology.orchestra.run.smithi050.stderr: 15100K .......... .......... .......... .......... .......... 16% 240M 1s 2024-09-14T11:17:06.122 INFO:teuthology.orchestra.run.smithi050.stderr: 15150K .......... .......... .......... .......... .......... 16% 331M 1s 2024-09-14T11:17:06.122 INFO:teuthology.orchestra.run.smithi050.stderr: 15200K .......... .......... .......... .......... .......... 16% 377M 1s 2024-09-14T11:17:06.122 INFO:teuthology.orchestra.run.smithi050.stderr: 15250K .......... .......... .......... .......... .......... 16% 372M 1s 2024-09-14T11:17:06.122 INFO:teuthology.orchestra.run.smithi050.stderr: 15300K .......... .......... .......... .......... .......... 16% 340M 1s 2024-09-14T11:17:06.122 INFO:teuthology.orchestra.run.smithi050.stderr: 15350K .......... .......... .......... .......... .......... 16% 383M 1s 2024-09-14T11:17:06.122 INFO:teuthology.orchestra.run.smithi050.stderr: 15400K .......... .......... .......... .......... .......... 16% 391M 1s 2024-09-14T11:17:06.122 INFO:teuthology.orchestra.run.smithi050.stderr: 15450K .......... .......... .......... .......... .......... 16% 263M 1s 2024-09-14T11:17:06.123 INFO:teuthology.orchestra.run.smithi050.stderr: 15500K .......... .......... .......... .......... .......... 16% 297M 1s 2024-09-14T11:17:06.123 INFO:teuthology.orchestra.run.smithi050.stderr: 15550K .......... .......... .......... .......... .......... 16% 371M 1s 2024-09-14T11:17:06.123 INFO:teuthology.orchestra.run.smithi050.stderr: 15600K .......... .......... .......... .......... .......... 16% 366M 1s 2024-09-14T11:17:06.123 INFO:teuthology.orchestra.run.smithi050.stderr: 15650K .......... .......... .......... .......... .......... 16% 384M 1s 2024-09-14T11:17:06.123 INFO:teuthology.orchestra.run.smithi050.stderr: 15700K .......... .......... .......... .......... .......... 16% 350M 1s 2024-09-14T11:17:06.123 INFO:teuthology.orchestra.run.smithi050.stderr: 15750K .......... .......... .......... .......... .......... 17% 80.5M 1s 2024-09-14T11:17:06.123 INFO:teuthology.orchestra.run.smithi050.stderr: 15800K .......... .......... .......... .......... .......... 17% 310M 1s 2024-09-14T11:17:06.123 INFO:teuthology.orchestra.run.smithi050.stderr: 15850K .......... .......... .......... .......... .......... 17% 371M 1s 2024-09-14T11:17:06.123 INFO:teuthology.orchestra.run.smithi050.stderr: 15900K .......... .......... .......... .......... .......... 17% 311M 1s 2024-09-14T11:17:06.123 INFO:teuthology.orchestra.run.smithi050.stderr: 15950K .......... .......... .......... .......... .......... 17% 378M 1s 2024-09-14T11:17:06.123 INFO:teuthology.orchestra.run.smithi050.stderr: 16000K .......... .......... .......... .......... .......... 17% 205M 1s 2024-09-14T11:17:06.123 INFO:teuthology.orchestra.run.smithi050.stderr: 16050K .......... .......... .......... .......... .......... 17% 382M 1s 2024-09-14T11:17:06.123 INFO:teuthology.orchestra.run.smithi050.stderr: 16100K .......... .......... .......... .......... .......... 17% 333M 1s 2024-09-14T11:17:06.123 INFO:teuthology.orchestra.run.smithi050.stderr: 16150K .......... .......... .......... .......... .......... 17% 381M 1s 2024-09-14T11:17:06.123 INFO:teuthology.orchestra.run.smithi050.stderr: 16200K .......... .......... .......... .......... .......... 17% 382M 1s 2024-09-14T11:17:06.124 INFO:teuthology.orchestra.run.smithi050.stderr: 16250K .......... .......... .......... .......... .......... 17% 365M 1s 2024-09-14T11:17:06.124 INFO:teuthology.orchestra.run.smithi050.stderr: 16300K .......... .......... .......... .......... .......... 17% 325M 1s 2024-09-14T11:17:06.124 INFO:teuthology.orchestra.run.smithi050.stderr: 16350K .......... .......... .......... .......... .......... 17% 346M 1s 2024-09-14T11:17:06.124 INFO:teuthology.orchestra.run.smithi050.stderr: 16400K .......... .......... .......... .......... .......... 17% 370M 1s 2024-09-14T11:17:06.124 INFO:teuthology.orchestra.run.smithi050.stderr: 16450K .......... .......... .......... .......... .......... 17% 341M 1s 2024-09-14T11:17:06.124 INFO:teuthology.orchestra.run.smithi050.stderr: 16500K .......... .......... .......... .......... .......... 17% 337M 1s 2024-09-14T11:17:06.124 INFO:teuthology.orchestra.run.smithi050.stderr: 16550K .......... .......... .......... .......... .......... 17% 367M 1s 2024-09-14T11:17:06.124 INFO:teuthology.orchestra.run.smithi050.stderr: 16600K .......... .......... .......... .......... .......... 17% 382M 1s 2024-09-14T11:17:06.124 INFO:teuthology.orchestra.run.smithi050.stderr: 16650K .......... .......... .......... .......... .......... 17% 338M 1s 2024-09-14T11:17:06.124 INFO:teuthology.orchestra.run.smithi050.stderr: 16700K .......... .......... .......... .......... .......... 18% 287M 1s 2024-09-14T11:17:06.124 INFO:teuthology.orchestra.run.smithi050.stderr: 16750K .......... .......... .......... .......... .......... 18% 375M 1s 2024-09-14T11:17:06.124 INFO:teuthology.orchestra.run.smithi050.stderr: 16800K .......... .......... .......... .......... .......... 18% 381M 1s 2024-09-14T11:17:06.124 INFO:teuthology.orchestra.run.smithi050.stderr: 16850K .......... .......... .......... .......... .......... 18% 371M 1s 2024-09-14T11:17:06.125 INFO:teuthology.orchestra.run.smithi050.stderr: 16900K .......... .......... .......... .......... .......... 18% 344M 1s 2024-09-14T11:17:06.125 INFO:teuthology.orchestra.run.smithi050.stderr: 16950K .......... .......... .......... .......... .......... 18% 369M 1s 2024-09-14T11:17:06.125 INFO:teuthology.orchestra.run.smithi050.stderr: 17000K .......... .......... .......... .......... .......... 18% 378M 1s 2024-09-14T11:17:06.125 INFO:teuthology.orchestra.run.smithi050.stderr: 17050K .......... .......... .......... .......... .......... 18% 320M 1s 2024-09-14T11:17:06.125 INFO:teuthology.orchestra.run.smithi050.stderr: 17100K .......... .......... .......... .......... .......... 18% 297M 1s 2024-09-14T11:17:06.125 INFO:teuthology.orchestra.run.smithi050.stderr: 17150K .......... .......... .......... .......... .......... 18% 386M 1s 2024-09-14T11:17:06.125 INFO:teuthology.orchestra.run.smithi050.stderr: 17200K .......... .......... .......... .......... .......... 18% 34.5M 1s 2024-09-14T11:17:06.125 INFO:teuthology.orchestra.run.smithi050.stderr: 17250K .......... .......... .......... .......... .......... 18% 272M 1s 2024-09-14T11:17:06.125 INFO:teuthology.orchestra.run.smithi050.stderr: 17300K .......... .......... .......... .......... .......... 18% 321M 1s 2024-09-14T11:17:06.125 INFO:teuthology.orchestra.run.smithi050.stderr: 17350K .......... .......... .......... .......... .......... 18% 370M 1s 2024-09-14T11:17:06.125 INFO:teuthology.orchestra.run.smithi050.stderr: 17400K .......... .......... .......... .......... .......... 18% 143M 1s 2024-09-14T11:17:06.125 INFO:teuthology.orchestra.run.smithi050.stderr: 17450K .......... .......... .......... .......... .......... 18% 323M 1s 2024-09-14T11:17:06.125 INFO:teuthology.orchestra.run.smithi050.stderr: 17500K .......... .......... .......... .......... .......... 18% 331M 1s 2024-09-14T11:17:06.125 INFO:teuthology.orchestra.run.smithi050.stderr: 17550K .......... .......... .......... .......... .......... 18% 29.7M 1s 2024-09-14T11:17:06.126 INFO:teuthology.orchestra.run.smithi050.stderr: 17600K .......... .......... .......... .......... .......... 18% 269M 1s 2024-09-14T11:17:06.126 INFO:teuthology.orchestra.run.smithi050.stderr: 17650K .......... .......... .......... .......... .......... 19% 354M 1s 2024-09-14T11:17:06.126 INFO:teuthology.orchestra.run.smithi050.stderr: 17700K .......... .......... .......... .......... .......... 19% 338M 1s 2024-09-14T11:17:06.126 INFO:teuthology.orchestra.run.smithi050.stderr: 17750K .......... .......... .......... .......... .......... 19% 349M 1s 2024-09-14T11:17:06.126 INFO:teuthology.orchestra.run.smithi050.stderr: 17800K .......... .......... .......... .......... .......... 19% 192M 1s 2024-09-14T11:17:06.126 INFO:teuthology.orchestra.run.smithi050.stderr: 17850K .......... .......... .......... .......... .......... 19% 335M 1s 2024-09-14T11:17:06.126 INFO:teuthology.orchestra.run.smithi050.stderr: 17900K .......... .......... .......... .......... .......... 19% 311M 1s 2024-09-14T11:17:06.126 INFO:teuthology.orchestra.run.smithi050.stderr: 17950K .......... .......... .......... .......... .......... 19% 293M 1s 2024-09-14T11:17:06.126 INFO:teuthology.orchestra.run.smithi050.stderr: 18000K .......... .......... .......... .......... .......... 19% 388M 1s 2024-09-14T11:17:06.126 INFO:teuthology.orchestra.run.smithi050.stderr: 18050K .......... .......... .......... .......... .......... 19% 228M 1s 2024-09-14T11:17:06.126 INFO:teuthology.orchestra.run.smithi050.stderr: 18100K .......... .......... .......... .......... .......... 19% 341M 1s 2024-09-14T11:17:06.126 INFO:teuthology.orchestra.run.smithi050.stderr: 18150K .......... .......... .......... .......... .......... 19% 349M 1s 2024-09-14T11:17:06.126 INFO:teuthology.orchestra.run.smithi050.stderr: 18200K .......... .......... .......... .......... .......... 19% 384M 1s 2024-09-14T11:17:06.126 INFO:teuthology.orchestra.run.smithi050.stderr: 18250K .......... .......... .......... .......... .......... 19% 372M 1s 2024-09-14T11:17:06.127 INFO:teuthology.orchestra.run.smithi050.stderr: 18300K .......... .......... .......... .......... .......... 19% 314M 1s 2024-09-14T11:17:06.127 INFO:teuthology.orchestra.run.smithi050.stderr: 18350K .......... .......... .......... .......... .......... 19% 383M 1s 2024-09-14T11:17:06.127 INFO:teuthology.orchestra.run.smithi050.stderr: 18400K .......... .......... .......... .......... .......... 19% 270M 1s 2024-09-14T11:17:06.127 INFO:teuthology.orchestra.run.smithi050.stderr: 18450K .......... .......... .......... .......... .......... 19% 306M 1s 2024-09-14T11:17:06.127 INFO:teuthology.orchestra.run.smithi050.stderr: 18500K .......... .......... .......... .......... .......... 19% 342M 1s 2024-09-14T11:17:06.127 INFO:teuthology.orchestra.run.smithi050.stderr: 18550K .......... .......... .......... .......... .......... 20% 122M 1s 2024-09-14T11:17:06.127 INFO:teuthology.orchestra.run.smithi050.stderr: 18600K .......... .......... .......... .......... .......... 20% 366M 1s 2024-09-14T11:17:06.127 INFO:teuthology.orchestra.run.smithi050.stderr: 18650K .......... .......... .......... .......... .......... 20% 345M 1s 2024-09-14T11:17:06.127 INFO:teuthology.orchestra.run.smithi050.stderr: 18700K .......... .......... .......... .......... .......... 20% 319M 1s 2024-09-14T11:17:06.127 INFO:teuthology.orchestra.run.smithi050.stderr: 18750K .......... .......... .......... .......... .......... 20% 105M 1s 2024-09-14T11:17:06.127 INFO:teuthology.orchestra.run.smithi050.stderr: 18800K .......... .......... .......... .......... .......... 20% 309M 1s 2024-09-14T11:17:06.127 INFO:teuthology.orchestra.run.smithi050.stderr: 18850K .......... .......... .......... .......... .......... 20% 204M 1s 2024-09-14T11:17:06.127 INFO:teuthology.orchestra.run.smithi050.stderr: 18900K .......... .......... .......... .......... .......... 20% 208M 1s 2024-09-14T11:17:06.127 INFO:teuthology.orchestra.run.smithi050.stderr: 18950K .......... .......... .......... .......... .......... 20% 361M 1s 2024-09-14T11:17:06.128 INFO:teuthology.orchestra.run.smithi050.stderr: 19000K .......... .......... .......... .......... .......... 20% 368M 1s 2024-09-14T11:17:06.128 INFO:teuthology.orchestra.run.smithi050.stderr: 19050K .......... .......... .......... .......... .......... 20% 371M 1s 2024-09-14T11:17:06.128 INFO:teuthology.orchestra.run.smithi050.stderr: 19100K .......... .......... .......... .......... .......... 20% 309M 1s 2024-09-14T11:17:06.128 INFO:teuthology.orchestra.run.smithi050.stderr: 19150K .......... .......... .......... .......... .......... 20% 322M 1s 2024-09-14T11:17:06.128 INFO:teuthology.orchestra.run.smithi050.stderr: 19200K .......... .......... .......... .......... .......... 20% 348M 1s 2024-09-14T11:17:06.128 INFO:teuthology.orchestra.run.smithi050.stderr: 19250K .......... .......... .......... .......... .......... 20% 389M 1s 2024-09-14T11:17:06.128 INFO:teuthology.orchestra.run.smithi050.stderr: 19300K .......... .......... .......... .......... .......... 20% 344M 1s 2024-09-14T11:17:06.128 INFO:teuthology.orchestra.run.smithi050.stderr: 19350K .......... .......... .......... .......... .......... 20% 346M 1s 2024-09-14T11:17:06.128 INFO:teuthology.orchestra.run.smithi050.stderr: 19400K .......... .......... .......... .......... .......... 20% 366M 1s 2024-09-14T11:17:06.128 INFO:teuthology.orchestra.run.smithi050.stderr: 19450K .......... .......... .......... .......... .......... 20% 336M 1s 2024-09-14T11:17:06.128 INFO:teuthology.orchestra.run.smithi050.stderr: 19500K .......... .......... .......... .......... .......... 21% 327M 1s 2024-09-14T11:17:06.128 INFO:teuthology.orchestra.run.smithi050.stderr: 19550K .......... .......... .......... .......... .......... 21% 356M 1s 2024-09-14T11:17:06.128 INFO:teuthology.orchestra.run.smithi050.stderr: 19600K .......... .......... .......... .......... .......... 21% 322M 1s 2024-09-14T11:17:06.129 INFO:teuthology.orchestra.run.smithi050.stderr: 19650K .......... .......... .......... .......... .......... 21% 365M 1s 2024-09-14T11:17:06.129 INFO:teuthology.orchestra.run.smithi050.stderr: 19700K .......... .......... .......... .......... .......... 21% 262M 1s 2024-09-14T11:17:06.129 INFO:teuthology.orchestra.run.smithi050.stderr: 19750K .......... .......... .......... .......... .......... 21% 373M 1s 2024-09-14T11:17:06.129 INFO:teuthology.orchestra.run.smithi050.stderr: 19800K .......... .......... .......... .......... .......... 21% 319M 1s 2024-09-14T11:17:06.129 INFO:teuthology.orchestra.run.smithi050.stderr: 19850K .......... .......... .......... .......... .......... 21% 334M 1s 2024-09-14T11:17:06.129 INFO:teuthology.orchestra.run.smithi050.stderr: 19900K .......... .......... .......... .......... .......... 21% 301M 1s 2024-09-14T11:17:06.129 INFO:teuthology.orchestra.run.smithi050.stderr: 19950K .......... .......... .......... .......... .......... 21% 296M 1s 2024-09-14T11:17:06.129 INFO:teuthology.orchestra.run.smithi050.stderr: 20000K .......... .......... .......... .......... .......... 21% 298M 1s 2024-09-14T11:17:06.129 INFO:teuthology.orchestra.run.smithi050.stderr: 20050K .......... .......... .......... .......... .......... 21% 390M 1s 2024-09-14T11:17:06.129 INFO:teuthology.orchestra.run.smithi050.stderr: 20100K .......... .......... .......... .......... .......... 21% 386M 1s 2024-09-14T11:17:06.129 INFO:teuthology.orchestra.run.smithi050.stderr: 20150K .......... .......... .......... .......... .......... 21% 388M 1s 2024-09-14T11:17:06.129 INFO:teuthology.orchestra.run.smithi050.stderr: 20200K .......... .......... .......... .......... .......... 21% 55.5M 1s 2024-09-14T11:17:06.129 INFO:teuthology.orchestra.run.smithi050.stderr: 20250K .......... .......... .......... .......... .......... 21% 339M 1s 2024-09-14T11:17:06.129 INFO:teuthology.orchestra.run.smithi050.stderr: 20300K .......... .......... .......... .......... .......... 21% 71.0M 1s 2024-09-14T11:17:06.130 INFO:teuthology.orchestra.run.smithi050.stderr: 20350K .......... .......... .......... .......... .......... 21% 293M 1s 2024-09-14T11:17:06.130 INFO:teuthology.orchestra.run.smithi050.stderr: 20400K .......... .......... .......... .......... .......... 22% 325M 1s 2024-09-14T11:17:06.130 INFO:teuthology.orchestra.run.smithi050.stderr: 20450K .......... .......... .......... .......... .......... 22% 319M 1s 2024-09-14T11:17:06.130 INFO:teuthology.orchestra.run.smithi050.stderr: 20500K .......... .......... .......... .......... .......... 22% 74.4M 1s 2024-09-14T11:17:06.130 INFO:teuthology.orchestra.run.smithi050.stderr: 20550K .......... .......... .......... .......... .......... 22% 327M 1s 2024-09-14T11:17:06.130 INFO:teuthology.orchestra.run.smithi050.stderr: 20600K .......... .......... .......... .......... .......... 22% 338M 1s 2024-09-14T11:17:06.130 INFO:teuthology.orchestra.run.smithi050.stderr: 20650K .......... .......... .......... .......... .......... 22% 43.5M 1s 2024-09-14T11:17:06.130 INFO:teuthology.orchestra.run.smithi050.stderr: 20700K .......... .......... .......... .......... .......... 22% 215M 1s 2024-09-14T11:17:06.130 INFO:teuthology.orchestra.run.smithi050.stderr: 20750K .......... .......... .......... .......... .......... 22% 297M 1s 2024-09-14T11:17:06.130 INFO:teuthology.orchestra.run.smithi050.stderr: 20800K .......... .......... .......... .......... .......... 22% 369M 1s 2024-09-14T11:17:06.130 INFO:teuthology.orchestra.run.smithi050.stderr: 20850K .......... .......... .......... .......... .......... 22% 365M 1s 2024-09-14T11:17:06.130 INFO:teuthology.orchestra.run.smithi050.stderr: 20900K .......... .......... .......... .......... .......... 22% 340M 1s 2024-09-14T11:17:06.130 INFO:teuthology.orchestra.run.smithi050.stderr: 20950K .......... .......... .......... .......... .......... 22% 315M 1s 2024-09-14T11:17:06.130 INFO:teuthology.orchestra.run.smithi050.stderr: 21000K .......... .......... .......... .......... .......... 22% 363M 1s 2024-09-14T11:17:06.131 INFO:teuthology.orchestra.run.smithi050.stderr: 21050K .......... .......... .......... .......... .......... 22% 364M 1s 2024-09-14T11:17:06.131 INFO:teuthology.orchestra.run.smithi050.stderr: 21100K .......... .......... .......... .......... .......... 22% 318M 1s 2024-09-14T11:17:06.131 INFO:teuthology.orchestra.run.smithi050.stderr: 21150K .......... .......... .......... .......... .......... 22% 363M 1s 2024-09-14T11:17:06.131 INFO:teuthology.orchestra.run.smithi050.stderr: 21200K .......... .......... .......... .......... .......... 22% 295M 1s 2024-09-14T11:17:06.131 INFO:teuthology.orchestra.run.smithi050.stderr: 21250K .......... .......... .......... .......... .......... 22% 336M 1s 2024-09-14T11:17:06.131 INFO:teuthology.orchestra.run.smithi050.stderr: 21300K .......... .......... .......... .......... .......... 22% 179M 1s 2024-09-14T11:17:06.131 INFO:teuthology.orchestra.run.smithi050.stderr: 21350K .......... .......... .......... .......... .......... 23% 328M 1s 2024-09-14T11:17:06.131 INFO:teuthology.orchestra.run.smithi050.stderr: 21400K .......... .......... .......... .......... .......... 23% 337M 1s 2024-09-14T11:17:06.131 INFO:teuthology.orchestra.run.smithi050.stderr: 21450K .......... .......... .......... .......... .......... 23% 362M 1s 2024-09-14T11:17:06.131 INFO:teuthology.orchestra.run.smithi050.stderr: 21500K .......... .......... .......... .......... .......... 23% 319M 1s 2024-09-14T11:17:06.131 INFO:teuthology.orchestra.run.smithi050.stderr: 21550K .......... .......... .......... .......... .......... 23% 366M 1s 2024-09-14T11:17:06.131 INFO:teuthology.orchestra.run.smithi050.stderr: 21600K .......... .......... .......... .......... .......... 23% 205M 1s 2024-09-14T11:17:06.131 INFO:teuthology.orchestra.run.smithi050.stderr: 21650K .......... .......... .......... .......... .......... 23% 318M 1s 2024-09-14T11:17:06.131 INFO:teuthology.orchestra.run.smithi050.stderr: 21700K .......... .......... .......... .......... .......... 23% 316M 1s 2024-09-14T11:17:06.132 INFO:teuthology.orchestra.run.smithi050.stderr: 21750K .......... .......... .......... .......... .......... 23% 130M 1s 2024-09-14T11:17:06.132 INFO:teuthology.orchestra.run.smithi050.stderr: 21800K .......... .......... .......... .......... .......... 23% 151M 1s 2024-09-14T11:17:06.132 INFO:teuthology.orchestra.run.smithi050.stderr: 21850K .......... .......... .......... .......... .......... 23% 273M 1s 2024-09-14T11:17:06.132 INFO:teuthology.orchestra.run.smithi050.stderr: 21900K .......... .......... .......... .......... .......... 23% 295M 1s 2024-09-14T11:17:06.132 INFO:teuthology.orchestra.run.smithi050.stderr: 21950K .......... .......... .......... .......... .......... 23% 383M 1s 2024-09-14T11:17:06.132 INFO:teuthology.orchestra.run.smithi050.stderr: 22000K .......... .......... .......... .......... .......... 23% 283M 1s 2024-09-14T11:17:06.132 INFO:teuthology.orchestra.run.smithi050.stderr: 22050K .......... .......... .......... .......... .......... 23% 244M 1s 2024-09-14T11:17:06.132 INFO:teuthology.orchestra.run.smithi050.stderr: 22100K .......... .......... .......... .......... .......... 23% 338M 1s 2024-09-14T11:17:06.132 INFO:teuthology.orchestra.run.smithi050.stderr: 22150K .......... .......... .......... .......... .......... 23% 383M 1s 2024-09-14T11:17:06.132 INFO:teuthology.orchestra.run.smithi050.stderr: 22200K .......... .......... .......... .......... .......... 23% 374M 1s 2024-09-14T11:17:06.132 INFO:teuthology.orchestra.run.smithi050.stderr: 22250K .......... .......... .......... .......... .......... 24% 362M 1s 2024-09-14T11:17:06.132 INFO:teuthology.orchestra.run.smithi050.stderr: 22300K .......... .......... .......... .......... .......... 24% 154M 1s 2024-09-14T11:17:06.132 INFO:teuthology.orchestra.run.smithi050.stderr: 22350K .......... .......... .......... .......... .......... 24% 290M 1s 2024-09-14T11:17:06.132 INFO:teuthology.orchestra.run.smithi050.stderr: 22400K .......... .......... .......... .......... .......... 24% 303M 1s 2024-09-14T11:17:06.133 INFO:teuthology.orchestra.run.smithi050.stderr: 22450K .......... .......... .......... .......... .......... 24% 325M 1s 2024-09-14T11:17:06.133 INFO:teuthology.orchestra.run.smithi050.stderr: 22500K .......... .......... .......... .......... .......... 24% 321M 1s 2024-09-14T11:17:06.133 INFO:teuthology.orchestra.run.smithi050.stderr: 22550K .......... .......... .......... .......... .......... 24% 360M 1s 2024-09-14T11:17:06.133 INFO:teuthology.orchestra.run.smithi050.stderr: 22600K .......... .......... .......... .......... .......... 24% 341M 1s 2024-09-14T11:17:06.133 INFO:teuthology.orchestra.run.smithi050.stderr: 22650K .......... .......... .......... .......... .......... 24% 371M 1s 2024-09-14T11:17:06.133 INFO:teuthology.orchestra.run.smithi050.stderr: 22700K .......... .......... .......... .......... .......... 24% 304M 1s 2024-09-14T11:17:06.133 INFO:teuthology.orchestra.run.smithi050.stderr: 22750K .......... .......... .......... .......... .......... 24% 385M 1s 2024-09-14T11:17:06.133 INFO:teuthology.orchestra.run.smithi050.stderr: 22800K .......... .......... .......... .......... .......... 24% 384M 1s 2024-09-14T11:17:06.133 INFO:teuthology.orchestra.run.smithi050.stderr: 22850K .......... .......... .......... .......... .......... 24% 388M 1s 2024-09-14T11:17:06.133 INFO:teuthology.orchestra.run.smithi050.stderr: 22900K .......... .......... .......... .......... .......... 24% 347M 1s 2024-09-14T11:17:06.133 INFO:teuthology.orchestra.run.smithi050.stderr: 22950K .......... .......... .......... .......... .......... 24% 385M 1s 2024-09-14T11:17:06.133 INFO:teuthology.orchestra.run.smithi050.stderr: 23000K .......... .......... .......... .......... .......... 24% 225M 1s 2024-09-14T11:17:06.133 INFO:teuthology.orchestra.run.smithi050.stderr: 23050K .......... .......... .......... .......... .......... 24% 47.4M 1s 2024-09-14T11:17:06.133 INFO:teuthology.orchestra.run.smithi050.stderr: 23100K .......... .......... .......... .......... .......... 24% 184M 1s 2024-09-14T11:17:06.134 INFO:teuthology.orchestra.run.smithi050.stderr: 23150K .......... .......... .......... .......... .......... 24% 376M 1s 2024-09-14T11:17:06.134 INFO:teuthology.orchestra.run.smithi050.stderr: 23200K .......... .......... .......... .......... .......... 25% 375M 1s 2024-09-14T11:17:06.134 INFO:teuthology.orchestra.run.smithi050.stderr: 23250K .......... .......... .......... .......... .......... 25% 379M 1s 2024-09-14T11:17:06.134 INFO:teuthology.orchestra.run.smithi050.stderr: 23300K .......... .......... .......... .......... .......... 25% 144M 1s 2024-09-14T11:17:06.134 INFO:teuthology.orchestra.run.smithi050.stderr: 23350K .......... .......... .......... .......... .......... 25% 165M 1s 2024-09-14T11:17:06.134 INFO:teuthology.orchestra.run.smithi050.stderr: 23400K .......... .......... .......... .......... .......... 25% 383M 1s 2024-09-14T11:17:06.134 INFO:teuthology.orchestra.run.smithi050.stderr: 23450K .......... .......... .......... .......... .......... 25% 365M 1s 2024-09-14T11:17:06.134 INFO:teuthology.orchestra.run.smithi050.stderr: 23500K .......... .......... .......... .......... .......... 25% 315M 1s 2024-09-14T11:17:06.134 INFO:teuthology.orchestra.run.smithi050.stderr: 23550K .......... .......... .......... .......... .......... 25% 135M 1s 2024-09-14T11:17:06.134 INFO:teuthology.orchestra.run.smithi050.stderr: 23600K .......... .......... .......... .......... .......... 25% 221M 1s 2024-09-14T11:17:06.134 INFO:teuthology.orchestra.run.smithi050.stderr: 23650K .......... .......... .......... .......... .......... 25% 39.0M 1s 2024-09-14T11:17:06.134 INFO:teuthology.orchestra.run.smithi050.stderr: 23700K .......... .......... .......... .......... .......... 25% 330M 1s 2024-09-14T11:17:06.134 INFO:teuthology.orchestra.run.smithi050.stderr: 23750K .......... .......... .......... .......... .......... 25% 361M 1s 2024-09-14T11:17:06.134 INFO:teuthology.orchestra.run.smithi050.stderr: 23800K .......... .......... .......... .......... .......... 25% 336M 1s 2024-09-14T11:17:06.134 INFO:teuthology.orchestra.run.smithi050.stderr: 23850K .......... .......... .......... .......... .......... 25% 266M 1s 2024-09-14T11:17:06.135 INFO:teuthology.orchestra.run.smithi050.stderr: 23900K .......... .......... .......... .......... .......... 25% 250M 1s 2024-09-14T11:17:06.135 INFO:teuthology.orchestra.run.smithi050.stderr: 23950K .......... .......... .......... .......... .......... 25% 333M 1s 2024-09-14T11:17:06.135 INFO:teuthology.orchestra.run.smithi050.stderr: 24000K .......... .......... .......... .......... .......... 25% 337M 1s 2024-09-14T11:17:06.135 INFO:teuthology.orchestra.run.smithi050.stderr: 24050K .......... .......... .......... .......... .......... 25% 194M 1s 2024-09-14T11:17:06.135 INFO:teuthology.orchestra.run.smithi050.stderr: 24100K .......... .......... .......... .......... .......... 25% 307M 1s 2024-09-14T11:17:06.135 INFO:teuthology.orchestra.run.smithi050.stderr: 24150K .......... .......... .......... .......... .......... 26% 329M 1s 2024-09-14T11:17:06.135 INFO:teuthology.orchestra.run.smithi050.stderr: 24200K .......... .......... .......... .......... .......... 26% 359M 1s 2024-09-14T11:17:06.135 INFO:teuthology.orchestra.run.smithi050.stderr: 24250K .......... .......... .......... .......... .......... 26% 372M 1s 2024-09-14T11:17:06.135 INFO:teuthology.orchestra.run.smithi050.stderr: 24300K .......... .......... .......... .......... .......... 26% 314M 1s 2024-09-14T11:17:06.135 INFO:teuthology.orchestra.run.smithi050.stderr: 24350K .......... .......... .......... .......... .......... 26% 375M 1s 2024-09-14T11:17:06.135 INFO:teuthology.orchestra.run.smithi050.stderr: 24400K .......... .......... .......... .......... .......... 26% 376M 1s 2024-09-14T11:17:06.135 INFO:teuthology.orchestra.run.smithi050.stderr: 24450K .......... .......... .......... .......... .......... 26% 258M 1s 2024-09-14T11:17:06.135 INFO:teuthology.orchestra.run.smithi050.stderr: 24500K .......... .......... .......... .......... .......... 26% 324M 1s 2024-09-14T11:17:06.135 INFO:teuthology.orchestra.run.smithi050.stderr: 24550K .......... .......... .......... .......... .......... 26% 365M 1s 2024-09-14T11:17:06.135 INFO:teuthology.orchestra.run.smithi050.stderr: 24600K .......... .......... .......... .......... .......... 26% 382M 1s 2024-09-14T11:17:06.136 INFO:teuthology.orchestra.run.smithi050.stderr: 24650K .......... .......... .......... .......... .......... 26% 271M 1s 2024-09-14T11:17:06.136 INFO:teuthology.orchestra.run.smithi050.stderr: 24700K .......... .......... .......... .......... .......... 26% 305M 1s 2024-09-14T11:17:06.136 INFO:teuthology.orchestra.run.smithi050.stderr: 24750K .......... .......... .......... .......... .......... 26% 324M 1s 2024-09-14T11:17:06.136 INFO:teuthology.orchestra.run.smithi050.stderr: 24800K .......... .......... .......... .......... .......... 26% 351M 1s 2024-09-14T11:17:06.136 INFO:teuthology.orchestra.run.smithi050.stderr: 24850K .......... .......... .......... .......... .......... 26% 106M 1s 2024-09-14T11:17:06.136 INFO:teuthology.orchestra.run.smithi050.stderr: 24900K .......... .......... .......... .......... .......... 26% 179M 1s 2024-09-14T11:17:06.136 INFO:teuthology.orchestra.run.smithi050.stderr: 24950K .......... .......... .......... .......... .......... 26% 253M 0s 2024-09-14T11:17:06.136 INFO:teuthology.orchestra.run.smithi050.stderr: 25000K .......... .......... .......... .......... .......... 26% 331M 0s 2024-09-14T11:17:06.136 INFO:teuthology.orchestra.run.smithi050.stderr: 25050K .......... .......... .......... .......... .......... 27% 175M 0s 2024-09-14T11:17:06.136 INFO:teuthology.orchestra.run.smithi050.stderr: 25100K .......... .......... .......... .......... .......... 27% 306M 0s 2024-09-14T11:17:06.136 INFO:teuthology.orchestra.run.smithi050.stderr: 25150K .......... .......... .......... .......... .......... 27% 359M 0s 2024-09-14T11:17:06.136 INFO:teuthology.orchestra.run.smithi050.stderr: 25200K .......... .......... .......... .......... .......... 27% 384M 0s 2024-09-14T11:17:06.136 INFO:teuthology.orchestra.run.smithi050.stderr: 25250K .......... .......... .......... .......... .......... 27% 350M 0s 2024-09-14T11:17:06.136 INFO:teuthology.orchestra.run.smithi050.stderr: 25300K .......... .......... .......... .......... .......... 27% 322M 0s 2024-09-14T11:17:06.136 INFO:teuthology.orchestra.run.smithi050.stderr: 25350K .......... .......... .......... .......... .......... 27% 376M 0s 2024-09-14T11:17:06.137 INFO:teuthology.orchestra.run.smithi050.stderr: 25400K .......... .......... .......... .......... .......... 27% 382M 0s 2024-09-14T11:17:06.137 INFO:teuthology.orchestra.run.smithi050.stderr: 25450K .......... .......... .......... .......... .......... 27% 378M 0s 2024-09-14T11:17:06.137 INFO:teuthology.orchestra.run.smithi050.stderr: 25500K .......... .......... .......... .......... .......... 27% 194M 0s 2024-09-14T11:17:06.137 INFO:teuthology.orchestra.run.smithi050.stderr: 25550K .......... .......... .......... .......... .......... 27% 347M 0s 2024-09-14T11:17:06.137 INFO:teuthology.orchestra.run.smithi050.stderr: 25600K .......... .......... .......... .......... .......... 27% 350M 0s 2024-09-14T11:17:06.137 INFO:teuthology.orchestra.run.smithi050.stderr: 25650K .......... .......... .......... .......... .......... 27% 367M 0s 2024-09-14T11:17:06.137 INFO:teuthology.orchestra.run.smithi050.stderr: 25700K .......... .......... .......... .......... .......... 27% 341M 0s 2024-09-14T11:17:06.137 INFO:teuthology.orchestra.run.smithi050.stderr: 25750K .......... .......... .......... .......... .......... 27% 179M 0s 2024-09-14T11:17:06.137 INFO:teuthology.orchestra.run.smithi050.stderr: 25800K .......... .......... .......... .......... .......... 27% 339M 0s 2024-09-14T11:17:06.137 INFO:teuthology.orchestra.run.smithi050.stderr: 25850K .......... .......... .......... .......... .......... 27% 354M 0s 2024-09-14T11:17:06.137 INFO:teuthology.orchestra.run.smithi050.stderr: 25900K .......... .......... .......... .......... .......... 27% 259M 0s 2024-09-14T11:17:06.137 INFO:teuthology.orchestra.run.smithi050.stderr: 25950K .......... .......... .......... .......... .......... 27% 332M 0s 2024-09-14T11:17:06.137 INFO:teuthology.orchestra.run.smithi050.stderr: 26000K .......... .......... .......... .......... .......... 28% 349M 0s 2024-09-14T11:17:06.137 INFO:teuthology.orchestra.run.smithi050.stderr: 26050K .......... .......... .......... .......... .......... 28% 381M 0s 2024-09-14T11:17:06.137 INFO:teuthology.orchestra.run.smithi050.stderr: 26100K .......... .......... .......... .......... .......... 28% 60.0M 0s 2024-09-14T11:17:06.137 INFO:teuthology.orchestra.run.smithi050.stderr: 26150K .......... .......... .......... .......... .......... 28% 335M 0s 2024-09-14T11:17:06.138 INFO:teuthology.orchestra.run.smithi050.stderr: 26200K .......... .......... .......... .......... .......... 28% 129M 0s 2024-09-14T11:17:06.138 INFO:teuthology.orchestra.run.smithi050.stderr: 26250K .......... .......... .......... .......... .......... 28% 96.4M 0s 2024-09-14T11:17:06.138 INFO:teuthology.orchestra.run.smithi050.stderr: 26300K .......... .......... .......... .......... .......... 28% 296M 0s 2024-09-14T11:17:06.138 INFO:teuthology.orchestra.run.smithi050.stderr: 26350K .......... .......... .......... .......... .......... 28% 372M 0s 2024-09-14T11:17:06.138 INFO:teuthology.orchestra.run.smithi050.stderr: 26400K .......... .......... .......... .......... .......... 28% 372M 0s 2024-09-14T11:17:06.138 INFO:teuthology.orchestra.run.smithi050.stderr: 26450K .......... .......... .......... .......... .......... 28% 380M 0s 2024-09-14T11:17:06.138 INFO:teuthology.orchestra.run.smithi050.stderr: 26500K .......... .......... .......... .......... .......... 28% 304M 0s 2024-09-14T11:17:06.138 INFO:teuthology.orchestra.run.smithi050.stderr: 26550K .......... .......... .......... .......... .......... 28% 188M 0s 2024-09-14T11:17:06.138 INFO:teuthology.orchestra.run.smithi050.stderr: 26600K .......... .......... .......... .......... .......... 28% 367M 0s 2024-09-14T11:17:06.138 INFO:teuthology.orchestra.run.smithi050.stderr: 26650K .......... .......... .......... .......... .......... 28% 372M 0s 2024-09-14T11:17:06.138 INFO:teuthology.orchestra.run.smithi050.stderr: 26700K .......... .......... .......... .......... .......... 28% 39.7M 0s 2024-09-14T11:17:06.138 INFO:teuthology.orchestra.run.smithi050.stderr: 26750K .......... .......... .......... .......... .......... 28% 160M 0s 2024-09-14T11:17:06.138 INFO:teuthology.orchestra.run.smithi050.stderr: 26800K .......... .......... .......... .......... .......... 28% 343M 0s 2024-09-14T11:17:06.138 INFO:teuthology.orchestra.run.smithi050.stderr: 26850K .......... .......... .......... .......... .......... 28% 359M 0s 2024-09-14T11:17:06.138 INFO:teuthology.orchestra.run.smithi050.stderr: 26900K .......... .......... .......... .......... .......... 29% 372M 0s 2024-09-14T11:17:06.138 INFO:teuthology.orchestra.run.smithi050.stderr: 26950K .......... .......... .......... .......... .......... 29% 332M 0s 2024-09-14T11:17:06.139 INFO:teuthology.orchestra.run.smithi050.stderr: 27000K .......... .......... .......... .......... .......... 29% 293M 0s 2024-09-14T11:17:06.139 INFO:teuthology.orchestra.run.smithi050.stderr: 27050K .......... .......... .......... .......... .......... 29% 217M 0s 2024-09-14T11:17:06.139 INFO:teuthology.orchestra.run.smithi050.stderr: 27100K .......... .......... .......... .......... .......... 29% 341M 0s 2024-09-14T11:17:06.139 INFO:teuthology.orchestra.run.smithi050.stderr: 27150K .......... .......... .......... .......... .......... 29% 154M 0s 2024-09-14T11:17:06.139 INFO:teuthology.orchestra.run.smithi050.stderr: 27200K .......... .......... .......... .......... .......... 29% 119M 0s 2024-09-14T11:17:06.139 INFO:teuthology.orchestra.run.smithi050.stderr: 27250K .......... .......... .......... .......... .......... 29% 255M 0s 2024-09-14T11:17:06.139 INFO:teuthology.orchestra.run.smithi050.stderr: 27300K .......... .......... .......... .......... .......... 29% 296M 0s 2024-09-14T11:17:06.139 INFO:teuthology.orchestra.run.smithi050.stderr: 27350K .......... .......... .......... .......... .......... 29% 326M 0s 2024-09-14T11:17:06.139 INFO:teuthology.orchestra.run.smithi050.stderr: 27400K .......... .......... .......... .......... .......... 29% 351M 0s 2024-09-14T11:17:06.139 INFO:teuthology.orchestra.run.smithi050.stderr: 27450K .......... .......... .......... .......... .......... 29% 387M 0s 2024-09-14T11:17:06.139 INFO:teuthology.orchestra.run.smithi050.stderr: 27500K .......... .......... .......... .......... .......... 29% 313M 0s 2024-09-14T11:17:06.139 INFO:teuthology.orchestra.run.smithi050.stderr: 27550K .......... .......... .......... .......... .......... 29% 351M 0s 2024-09-14T11:17:06.139 INFO:teuthology.orchestra.run.smithi050.stderr: 27600K .......... .......... .......... .......... .......... 29% 377M 0s 2024-09-14T11:17:06.139 INFO:teuthology.orchestra.run.smithi050.stderr: 27650K .......... .......... .......... .......... .......... 29% 373M 0s 2024-09-14T11:17:06.139 INFO:teuthology.orchestra.run.smithi050.stderr: 27700K .......... .......... .......... .......... .......... 29% 344M 0s 2024-09-14T11:17:06.140 INFO:teuthology.orchestra.run.smithi050.stderr: 27750K .......... .......... .......... .......... .......... 29% 371M 0s 2024-09-14T11:17:06.140 INFO:teuthology.orchestra.run.smithi050.stderr: 27800K .......... .......... .......... .......... .......... 29% 381M 0s 2024-09-14T11:17:06.140 INFO:teuthology.orchestra.run.smithi050.stderr: 27850K .......... .......... .......... .......... .......... 30% 375M 0s 2024-09-14T11:17:06.140 INFO:teuthology.orchestra.run.smithi050.stderr: 27900K .......... .......... .......... .......... .......... 30% 295M 0s 2024-09-14T11:17:06.140 INFO:teuthology.orchestra.run.smithi050.stderr: 27950K .......... .......... .......... .......... .......... 30% 162M 0s 2024-09-14T11:17:06.140 INFO:teuthology.orchestra.run.smithi050.stderr: 28000K .......... .......... .......... .......... .......... 30% 338M 0s 2024-09-14T11:17:06.140 INFO:teuthology.orchestra.run.smithi050.stderr: 28050K .......... .......... .......... .......... .......... 30% 307M 0s 2024-09-14T11:17:06.140 INFO:teuthology.orchestra.run.smithi050.stderr: 28100K .......... .......... .......... .......... .......... 30% 158M 0s 2024-09-14T11:17:06.140 INFO:teuthology.orchestra.run.smithi050.stderr: 28150K .......... .......... .......... .......... .......... 30% 147M 0s 2024-09-14T11:17:06.140 INFO:teuthology.orchestra.run.smithi050.stderr: 28200K .......... .......... .......... .......... .......... 30% 290M 0s 2024-09-14T11:17:06.140 INFO:teuthology.orchestra.run.smithi050.stderr: 28250K .......... .......... .......... .......... .......... 30% 364M 0s 2024-09-14T11:17:06.140 INFO:teuthology.orchestra.run.smithi050.stderr: 28300K .......... .......... .......... .......... .......... 30% 310M 0s 2024-09-14T11:17:06.140 INFO:teuthology.orchestra.run.smithi050.stderr: 28350K .......... .......... .......... .......... .......... 30% 373M 0s 2024-09-14T11:17:06.140 INFO:teuthology.orchestra.run.smithi050.stderr: 28400K .......... .......... .......... .......... .......... 30% 341M 0s 2024-09-14T11:17:06.140 INFO:teuthology.orchestra.run.smithi050.stderr: 28450K .......... .......... .......... .......... .......... 30% 359M 0s 2024-09-14T11:17:06.141 INFO:teuthology.orchestra.run.smithi050.stderr: 28500K .......... .......... .......... .......... .......... 30% 340M 0s 2024-09-14T11:17:06.141 INFO:teuthology.orchestra.run.smithi050.stderr: 28550K .......... .......... .......... .......... .......... 30% 368M 0s 2024-09-14T11:17:06.141 INFO:teuthology.orchestra.run.smithi050.stderr: 28600K .......... .......... .......... .......... .......... 30% 379M 0s 2024-09-14T11:17:06.141 INFO:teuthology.orchestra.run.smithi050.stderr: 28650K .......... .......... .......... .......... .......... 30% 348M 0s 2024-09-14T11:17:06.141 INFO:teuthology.orchestra.run.smithi050.stderr: 28700K .......... .......... .......... .......... .......... 30% 291M 0s 2024-09-14T11:17:06.141 INFO:teuthology.orchestra.run.smithi050.stderr: 28750K .......... .......... .......... .......... .......... 31% 309M 0s 2024-09-14T11:17:06.141 INFO:teuthology.orchestra.run.smithi050.stderr: 28800K .......... .......... .......... .......... .......... 31% 361M 0s 2024-09-14T11:17:06.141 INFO:teuthology.orchestra.run.smithi050.stderr: 28850K .......... .......... .......... .......... .......... 31% 331M 0s 2024-09-14T11:17:06.141 INFO:teuthology.orchestra.run.smithi050.stderr: 28900K .......... .......... .......... .......... .......... 31% 299M 0s 2024-09-14T11:17:06.141 INFO:teuthology.orchestra.run.smithi050.stderr: 28950K .......... .......... .......... .......... .......... 31% 371M 0s 2024-09-14T11:17:06.141 INFO:teuthology.orchestra.run.smithi050.stderr: 29000K .......... .......... .......... .......... .......... 31% 386M 0s 2024-09-14T11:17:06.141 INFO:teuthology.orchestra.run.smithi050.stderr: 29050K .......... .......... .......... .......... .......... 31% 46.5M 0s 2024-09-14T11:17:06.141 INFO:teuthology.orchestra.run.smithi050.stderr: 29100K .......... .......... .......... .......... .......... 31% 266M 0s 2024-09-14T11:17:06.141 INFO:teuthology.orchestra.run.smithi050.stderr: 29150K .......... .......... .......... .......... .......... 31% 341M 0s 2024-09-14T11:17:06.141 INFO:teuthology.orchestra.run.smithi050.stderr: 29200K .......... .......... .......... .......... .......... 31% 381M 0s 2024-09-14T11:17:06.141 INFO:teuthology.orchestra.run.smithi050.stderr: 29250K .......... .......... .......... .......... .......... 31% 386M 0s 2024-09-14T11:17:06.142 INFO:teuthology.orchestra.run.smithi050.stderr: 29300K .......... .......... .......... .......... .......... 31% 148M 0s 2024-09-14T11:17:06.142 INFO:teuthology.orchestra.run.smithi050.stderr: 29350K .......... .......... .......... .......... .......... 31% 185M 0s 2024-09-14T11:17:06.142 INFO:teuthology.orchestra.run.smithi050.stderr: 29400K .......... .......... .......... .......... .......... 31% 345M 0s 2024-09-14T11:17:06.142 INFO:teuthology.orchestra.run.smithi050.stderr: 29450K .......... .......... .......... .......... .......... 31% 377M 0s 2024-09-14T11:17:06.142 INFO:teuthology.orchestra.run.smithi050.stderr: 29500K .......... .......... .......... .......... .......... 31% 203M 0s 2024-09-14T11:17:06.142 INFO:teuthology.orchestra.run.smithi050.stderr: 29550K .......... .......... .......... .......... .......... 31% 223M 0s 2024-09-14T11:17:06.142 INFO:teuthology.orchestra.run.smithi050.stderr: 29600K .......... .......... .......... .......... .......... 31% 300M 0s 2024-09-14T11:17:06.142 INFO:teuthology.orchestra.run.smithi050.stderr: 29650K .......... .......... .......... .......... .......... 31% 374M 0s 2024-09-14T11:17:06.142 INFO:teuthology.orchestra.run.smithi050.stderr: 29700K .......... .......... .......... .......... .......... 32% 238M 0s 2024-09-14T11:17:06.142 INFO:teuthology.orchestra.run.smithi050.stderr: 29750K .......... .......... .......... .......... .......... 32% 57.9M 0s 2024-09-14T11:17:06.142 INFO:teuthology.orchestra.run.smithi050.stderr: 29800K .......... .......... .......... .......... .......... 32% 126M 0s 2024-09-14T11:17:06.142 INFO:teuthology.orchestra.run.smithi050.stderr: 29850K .......... .......... .......... .......... .......... 32% 286M 0s 2024-09-14T11:17:06.142 INFO:teuthology.orchestra.run.smithi050.stderr: 29900K .......... .......... .......... .......... .......... 32% 129M 0s 2024-09-14T11:17:06.142 INFO:teuthology.orchestra.run.smithi050.stderr: 29950K .......... .......... .......... .......... .......... 32% 337M 0s 2024-09-14T11:17:06.142 INFO:teuthology.orchestra.run.smithi050.stderr: 30000K .......... .......... .......... .......... .......... 32% 367M 0s 2024-09-14T11:17:06.143 INFO:teuthology.orchestra.run.smithi050.stderr: 30050K .......... .......... .......... .......... .......... 32% 377M 0s 2024-09-14T11:17:06.143 INFO:teuthology.orchestra.run.smithi050.stderr: 30100K .......... .......... .......... .......... .......... 32% 283M 0s 2024-09-14T11:17:06.143 INFO:teuthology.orchestra.run.smithi050.stderr: 30150K .......... .......... .......... .......... .......... 32% 379M 0s 2024-09-14T11:17:06.143 INFO:teuthology.orchestra.run.smithi050.stderr: 30200K .......... .......... .......... .......... .......... 32% 223M 0s 2024-09-14T11:17:06.143 INFO:teuthology.orchestra.run.smithi050.stderr: 30250K .......... .......... .......... .......... .......... 32% 89.2M 0s 2024-09-14T11:17:06.143 INFO:teuthology.orchestra.run.smithi050.stderr: 30300K .......... .......... .......... .......... .......... 32% 155M 0s 2024-09-14T11:17:06.143 INFO:teuthology.orchestra.run.smithi050.stderr: 30350K .......... .......... .......... .......... .......... 32% 318M 0s 2024-09-14T11:17:06.143 INFO:teuthology.orchestra.run.smithi050.stderr: 30400K .......... .......... .......... .......... .......... 32% 304M 0s 2024-09-14T11:17:06.143 INFO:teuthology.orchestra.run.smithi050.stderr: 30450K .......... .......... .......... .......... .......... 32% 360M 0s 2024-09-14T11:17:06.143 INFO:teuthology.orchestra.run.smithi050.stderr: 30500K .......... .......... .......... .......... .......... 32% 337M 0s 2024-09-14T11:17:06.143 INFO:teuthology.orchestra.run.smithi050.stderr: 30550K .......... .......... .......... .......... .......... 32% 378M 0s 2024-09-14T11:17:06.143 INFO:teuthology.orchestra.run.smithi050.stderr: 30600K .......... .......... .......... .......... .......... 32% 387M 0s 2024-09-14T11:17:06.143 INFO:teuthology.orchestra.run.smithi050.stderr: 30650K .......... .......... .......... .......... .......... 33% 392M 0s 2024-09-14T11:17:06.143 INFO:teuthology.orchestra.run.smithi050.stderr: 30700K .......... .......... .......... .......... .......... 33% 163M 0s 2024-09-14T11:17:06.144 INFO:teuthology.orchestra.run.smithi050.stderr: 30750K .......... .......... .......... .......... .......... 33% 329M 0s 2024-09-14T11:17:06.144 INFO:teuthology.orchestra.run.smithi050.stderr: 30800K .......... .......... .......... .......... .......... 33% 384M 0s 2024-09-14T11:17:06.144 INFO:teuthology.orchestra.run.smithi050.stderr: 30850K .......... .......... .......... .......... .......... 33% 383M 0s 2024-09-14T11:17:06.144 INFO:teuthology.orchestra.run.smithi050.stderr: 30900K .......... .......... .......... .......... .......... 33% 295M 0s 2024-09-14T11:17:06.144 INFO:teuthology.orchestra.run.smithi050.stderr: 30950K .......... .......... .......... .......... .......... 33% 291M 0s 2024-09-14T11:17:06.144 INFO:teuthology.orchestra.run.smithi050.stderr: 31000K .......... .......... .......... .......... .......... 33% 376M 0s 2024-09-14T11:17:06.144 INFO:teuthology.orchestra.run.smithi050.stderr: 31050K .......... .......... .......... .......... .......... 33% 353M 0s 2024-09-14T11:17:06.144 INFO:teuthology.orchestra.run.smithi050.stderr: 31100K .......... .......... .......... .......... .......... 33% 380M 0s 2024-09-14T11:17:06.144 INFO:teuthology.orchestra.run.smithi050.stderr: 31150K .......... .......... .......... .......... .......... 33% 336M 0s 2024-09-14T11:17:06.144 INFO:teuthology.orchestra.run.smithi050.stderr: 31200K .......... .......... .......... .......... .......... 33% 79.4M 0s 2024-09-14T11:17:06.144 INFO:teuthology.orchestra.run.smithi050.stderr: 31250K .......... .......... .......... .......... .......... 33% 330M 0s 2024-09-14T11:17:06.144 INFO:teuthology.orchestra.run.smithi050.stderr: 31300K .......... .......... .......... .......... .......... 33% 353M 0s 2024-09-14T11:17:06.144 INFO:teuthology.orchestra.run.smithi050.stderr: 31350K .......... .......... .......... .......... .......... 33% 340M 0s 2024-09-14T11:17:06.144 INFO:teuthology.orchestra.run.smithi050.stderr: 31400K .......... .......... .......... .......... .......... 33% 369M 0s 2024-09-14T11:17:06.144 INFO:teuthology.orchestra.run.smithi050.stderr: 31450K .......... .......... .......... .......... .......... 33% 388M 0s 2024-09-14T11:17:06.145 INFO:teuthology.orchestra.run.smithi050.stderr: 31500K .......... .......... .......... .......... .......... 33% 360M 0s 2024-09-14T11:17:06.145 INFO:teuthology.orchestra.run.smithi050.stderr: 31550K .......... .......... .......... .......... .......... 34% 312M 0s 2024-09-14T11:17:06.145 INFO:teuthology.orchestra.run.smithi050.stderr: 31600K .......... .......... .......... .......... .......... 34% 358M 0s 2024-09-14T11:17:06.145 INFO:teuthology.orchestra.run.smithi050.stderr: 31650K .......... .......... .......... .......... .......... 34% 376M 0s 2024-09-14T11:17:06.145 INFO:teuthology.orchestra.run.smithi050.stderr: 31700K .......... .......... .......... .......... .......... 34% 379M 0s 2024-09-14T11:17:06.145 INFO:teuthology.orchestra.run.smithi050.stderr: 31750K .......... .......... .......... .......... .......... 34% 339M 0s 2024-09-14T11:17:06.145 INFO:teuthology.orchestra.run.smithi050.stderr: 31800K .......... .......... .......... .......... .......... 34% 398M 0s 2024-09-14T11:17:06.145 INFO:teuthology.orchestra.run.smithi050.stderr: 31850K .......... .......... .......... .......... .......... 34% 350M 0s 2024-09-14T11:17:06.145 INFO:teuthology.orchestra.run.smithi050.stderr: 31900K .......... .......... .......... .......... .......... 34% 376M 0s 2024-09-14T11:17:06.145 INFO:teuthology.orchestra.run.smithi050.stderr: 31950K .......... .......... .......... .......... .......... 34% 280M 0s 2024-09-14T11:17:06.145 INFO:teuthology.orchestra.run.smithi050.stderr: 32000K .......... .......... .......... .......... .......... 34% 399M 0s 2024-09-14T11:17:06.145 INFO:teuthology.orchestra.run.smithi050.stderr: 32050K .......... .......... .......... .......... .......... 34% 49.3M 0s 2024-09-14T11:17:06.145 INFO:teuthology.orchestra.run.smithi050.stderr: 32100K .......... .......... .......... .......... .......... 34% 205M 0s 2024-09-14T11:17:06.145 INFO:teuthology.orchestra.run.smithi050.stderr: 32150K .......... .......... .......... .......... .......... 34% 342M 0s 2024-09-14T11:17:06.145 INFO:teuthology.orchestra.run.smithi050.stderr: 32200K .......... .......... .......... .......... .......... 34% 397M 0s 2024-09-14T11:17:06.145 INFO:teuthology.orchestra.run.smithi050.stderr: 32250K .......... .......... .......... .......... .......... 34% 68.9M 0s 2024-09-14T11:17:06.146 INFO:teuthology.orchestra.run.smithi050.stderr: 32300K .......... .......... .......... .......... .......... 34% 279M 0s 2024-09-14T11:17:06.146 INFO:teuthology.orchestra.run.smithi050.stderr: 32350K .......... .......... .......... .......... .......... 34% 298M 0s 2024-09-14T11:17:06.146 INFO:teuthology.orchestra.run.smithi050.stderr: 32400K .......... .......... .......... .......... .......... 34% 376M 0s 2024-09-14T11:17:06.146 INFO:teuthology.orchestra.run.smithi050.stderr: 32450K .......... .......... .......... .......... .......... 34% 383M 0s 2024-09-14T11:17:06.146 INFO:teuthology.orchestra.run.smithi050.stderr: 32500K .......... .......... .......... .......... .......... 35% 335M 0s 2024-09-14T11:17:06.146 INFO:teuthology.orchestra.run.smithi050.stderr: 32550K .......... .......... .......... .......... .......... 35% 351M 0s 2024-09-14T11:17:06.146 INFO:teuthology.orchestra.run.smithi050.stderr: 32600K .......... .......... .......... .......... .......... 35% 390M 0s 2024-09-14T11:17:06.146 INFO:teuthology.orchestra.run.smithi050.stderr: 32650K .......... .......... .......... .......... .......... 35% 370M 0s 2024-09-14T11:17:06.146 INFO:teuthology.orchestra.run.smithi050.stderr: 32700K .......... .......... .......... .......... .......... 35% 392M 0s 2024-09-14T11:17:06.146 INFO:teuthology.orchestra.run.smithi050.stderr: 32750K .......... .......... .......... .......... .......... 35% 332M 0s 2024-09-14T11:17:06.146 INFO:teuthology.orchestra.run.smithi050.stderr: 32800K .......... .......... .......... .......... .......... 35% 119M 0s 2024-09-14T11:17:06.146 INFO:teuthology.orchestra.run.smithi050.stderr: 32850K .......... .......... .......... .......... .......... 35% 89.3M 0s 2024-09-14T11:17:06.146 INFO:teuthology.orchestra.run.smithi050.stderr: 32900K .......... .......... .......... .......... .......... 35% 179M 0s 2024-09-14T11:17:06.146 INFO:teuthology.orchestra.run.smithi050.stderr: 32950K .......... .......... .......... .......... .......... 35% 85.2M 0s 2024-09-14T11:17:06.146 INFO:teuthology.orchestra.run.smithi050.stderr: 33000K .......... .......... .......... .......... .......... 35% 314M 0s 2024-09-14T11:17:06.147 INFO:teuthology.orchestra.run.smithi050.stderr: 33050K .......... .......... .......... .......... .......... 35% 381M 0s 2024-09-14T11:17:06.147 INFO:teuthology.orchestra.run.smithi050.stderr: 33100K .......... .......... .......... .......... .......... 35% 373M 0s 2024-09-14T11:17:06.147 INFO:teuthology.orchestra.run.smithi050.stderr: 33150K .......... .......... .......... .......... .......... 35% 308M 0s 2024-09-14T11:17:06.147 INFO:teuthology.orchestra.run.smithi050.stderr: 33200K .......... .......... .......... .......... .......... 35% 376M 0s 2024-09-14T11:17:06.147 INFO:teuthology.orchestra.run.smithi050.stderr: 33250K .......... .......... .......... .......... .......... 35% 389M 0s 2024-09-14T11:17:06.147 INFO:teuthology.orchestra.run.smithi050.stderr: 33300K .......... .......... .......... .......... .......... 35% 141M 0s 2024-09-14T11:17:06.147 INFO:teuthology.orchestra.run.smithi050.stderr: 33350K .......... .......... .......... .......... .......... 35% 103M 0s 2024-09-14T11:17:06.147 INFO:teuthology.orchestra.run.smithi050.stderr: 33400K .......... .......... .......... .......... .......... 36% 363M 0s 2024-09-14T11:17:06.147 INFO:teuthology.orchestra.run.smithi050.stderr: 33450K .......... .......... .......... .......... .......... 36% 179M 0s 2024-09-14T11:17:06.147 INFO:teuthology.orchestra.run.smithi050.stderr: 33500K .......... .......... .......... .......... .......... 36% 379M 0s 2024-09-14T11:17:06.147 INFO:teuthology.orchestra.run.smithi050.stderr: 33550K .......... .......... .......... .......... .......... 36% 270M 0s 2024-09-14T11:17:06.147 INFO:teuthology.orchestra.run.smithi050.stderr: 33600K .......... .......... .......... .......... .......... 36% 307M 0s 2024-09-14T11:17:06.147 INFO:teuthology.orchestra.run.smithi050.stderr: 33650K .......... .......... .......... .......... .......... 36% 389M 0s 2024-09-14T11:17:06.147 INFO:teuthology.orchestra.run.smithi050.stderr: 33700K .......... .......... .......... .......... .......... 36% 197M 0s 2024-09-14T11:17:06.147 INFO:teuthology.orchestra.run.smithi050.stderr: 33750K .......... .......... .......... .......... .......... 36% 249M 0s 2024-09-14T11:17:06.148 INFO:teuthology.orchestra.run.smithi050.stderr: 33800K .......... .......... .......... .......... .......... 36% 366M 0s 2024-09-14T11:17:06.148 INFO:teuthology.orchestra.run.smithi050.stderr: 33850K .......... .......... .......... .......... .......... 36% 343M 0s 2024-09-14T11:17:06.148 INFO:teuthology.orchestra.run.smithi050.stderr: 33900K .......... .......... .......... .......... .......... 36% 278M 0s 2024-09-14T11:17:06.148 INFO:teuthology.orchestra.run.smithi050.stderr: 33950K .......... .......... .......... .......... .......... 36% 327M 0s 2024-09-14T11:17:06.148 INFO:teuthology.orchestra.run.smithi050.stderr: 34000K .......... .......... .......... .......... .......... 36% 379M 0s 2024-09-14T11:17:06.148 INFO:teuthology.orchestra.run.smithi050.stderr: 34050K .......... .......... .......... .......... .......... 36% 377M 0s 2024-09-14T11:17:06.148 INFO:teuthology.orchestra.run.smithi050.stderr: 34100K .......... .......... .......... .......... .......... 36% 402M 0s 2024-09-14T11:17:06.148 INFO:teuthology.orchestra.run.smithi050.stderr: 34150K .......... .......... .......... .......... .......... 36% 326M 0s 2024-09-14T11:17:06.148 INFO:teuthology.orchestra.run.smithi050.stderr: 34200K .......... .......... .......... .......... .......... 36% 108M 0s 2024-09-14T11:17:06.148 INFO:teuthology.orchestra.run.smithi050.stderr: 34250K .......... .......... .......... .......... .......... 36% 299M 0s 2024-09-14T11:17:06.148 INFO:teuthology.orchestra.run.smithi050.stderr: 34300K .......... .......... .......... .......... .......... 36% 297M 0s 2024-09-14T11:17:06.148 INFO:teuthology.orchestra.run.smithi050.stderr: 34350K .......... .......... .......... .......... .......... 37% 330M 0s 2024-09-14T11:17:06.148 INFO:teuthology.orchestra.run.smithi050.stderr: 34400K .......... .......... .......... .......... .......... 37% 390M 0s 2024-09-14T11:17:06.148 INFO:teuthology.orchestra.run.smithi050.stderr: 34450K .......... .......... .......... .......... .......... 37% 375M 0s 2024-09-14T11:17:06.148 INFO:teuthology.orchestra.run.smithi050.stderr: 34500K .......... .......... .......... .......... .......... 37% 356M 0s 2024-09-14T11:17:06.149 INFO:teuthology.orchestra.run.smithi050.stderr: 34550K .......... .......... .......... .......... .......... 37% 198M 0s 2024-09-14T11:17:06.149 INFO:teuthology.orchestra.run.smithi050.stderr: 34600K .......... .......... .......... .......... .......... 37% 372M 0s 2024-09-14T11:17:06.149 INFO:teuthology.orchestra.run.smithi050.stderr: 34650K .......... .......... .......... .......... .......... 37% 383M 0s 2024-09-14T11:17:06.149 INFO:teuthology.orchestra.run.smithi050.stderr: 34700K .......... .......... .......... .......... .......... 37% 384M 0s 2024-09-14T11:17:06.149 INFO:teuthology.orchestra.run.smithi050.stderr: 34750K .......... .......... .......... .......... .......... 37% 353M 0s 2024-09-14T11:17:06.149 INFO:teuthology.orchestra.run.smithi050.stderr: 34800K .......... .......... .......... .......... .......... 37% 344M 0s 2024-09-14T11:17:06.149 INFO:teuthology.orchestra.run.smithi050.stderr: 34850K .......... .......... .......... .......... .......... 37% 377M 0s 2024-09-14T11:17:06.149 INFO:teuthology.orchestra.run.smithi050.stderr: 34900K .......... .......... .......... .......... .......... 37% 375M 0s 2024-09-14T11:17:06.149 INFO:teuthology.orchestra.run.smithi050.stderr: 34950K .......... .......... .......... .......... .......... 37% 329M 0s 2024-09-14T11:17:06.149 INFO:teuthology.orchestra.run.smithi050.stderr: 35000K .......... .......... .......... .......... .......... 37% 60.8M 0s 2024-09-14T11:17:06.149 INFO:teuthology.orchestra.run.smithi050.stderr: 35050K .......... .......... .......... .......... .......... 37% 355M 0s 2024-09-14T11:17:06.149 INFO:teuthology.orchestra.run.smithi050.stderr: 35100K .......... .......... .......... .......... .......... 37% 392M 0s 2024-09-14T11:17:06.149 INFO:teuthology.orchestra.run.smithi050.stderr: 35150K .......... .......... .......... .......... .......... 37% 221M 0s 2024-09-14T11:17:06.149 INFO:teuthology.orchestra.run.smithi050.stderr: 35200K .......... .......... .......... .......... .......... 37% 58.7M 0s 2024-09-14T11:17:06.150 INFO:teuthology.orchestra.run.smithi050.stderr: 35250K .......... .......... .......... .......... .......... 37% 286M 0s 2024-09-14T11:17:06.150 INFO:teuthology.orchestra.run.smithi050.stderr: 35300K .......... .......... .......... .......... .......... 38% 376M 0s 2024-09-14T11:17:06.150 INFO:teuthology.orchestra.run.smithi050.stderr: 35350K .......... .......... .......... .......... .......... 38% 318M 0s 2024-09-14T11:17:06.150 INFO:teuthology.orchestra.run.smithi050.stderr: 35400K .......... .......... .......... .......... .......... 38% 197M 0s 2024-09-14T11:17:06.150 INFO:teuthology.orchestra.run.smithi050.stderr: 35450K .......... .......... .......... .......... .......... 38% 314M 0s 2024-09-14T11:17:06.150 INFO:teuthology.orchestra.run.smithi050.stderr: 35500K .......... .......... .......... .......... .......... 38% 355M 0s 2024-09-14T11:17:06.150 INFO:teuthology.orchestra.run.smithi050.stderr: 35550K .......... .......... .......... .......... .......... 38% 314M 0s 2024-09-14T11:17:06.150 INFO:teuthology.orchestra.run.smithi050.stderr: 35600K .......... .......... .......... .......... .......... 38% 383M 0s 2024-09-14T11:17:06.150 INFO:teuthology.orchestra.run.smithi050.stderr: 35650K .......... .......... .......... .......... .......... 38% 365M 0s 2024-09-14T11:17:06.150 INFO:teuthology.orchestra.run.smithi050.stderr: 35700K .......... .......... .......... .......... .......... 38% 358M 0s 2024-09-14T11:17:06.150 INFO:teuthology.orchestra.run.smithi050.stderr: 35750K .......... .......... .......... .......... .......... 38% 308M 0s 2024-09-14T11:17:06.150 INFO:teuthology.orchestra.run.smithi050.stderr: 35800K .......... .......... .......... .......... .......... 38% 378M 0s 2024-09-14T11:17:06.150 INFO:teuthology.orchestra.run.smithi050.stderr: 35850K .......... .......... .......... .......... .......... 38% 377M 0s 2024-09-14T11:17:06.150 INFO:teuthology.orchestra.run.smithi050.stderr: 35900K .......... .......... .......... .......... .......... 38% 104M 0s 2024-09-14T11:17:06.151 INFO:teuthology.orchestra.run.smithi050.stderr: 35950K .......... .......... .......... .......... .......... 38% 236M 0s 2024-09-14T11:17:06.151 INFO:teuthology.orchestra.run.smithi050.stderr: 36000K .......... .......... .......... .......... .......... 38% 84.4M 0s 2024-09-14T11:17:06.151 INFO:teuthology.orchestra.run.smithi050.stderr: 36050K .......... .......... .......... .......... .......... 38% 103M 0s 2024-09-14T11:17:06.151 INFO:teuthology.orchestra.run.smithi050.stderr: 36100K .......... .......... .......... .......... .......... 38% 354M 0s 2024-09-14T11:17:06.151 INFO:teuthology.orchestra.run.smithi050.stderr: 36150K .......... .......... .......... .......... .......... 38% 259M 0s 2024-09-14T11:17:06.151 INFO:teuthology.orchestra.run.smithi050.stderr: 36200K .......... .......... .......... .......... .......... 39% 368M 0s 2024-09-14T11:17:06.151 INFO:teuthology.orchestra.run.smithi050.stderr: 36250K .......... .......... .......... .......... .......... 39% 374M 0s 2024-09-14T11:17:06.151 INFO:teuthology.orchestra.run.smithi050.stderr: 36300K .......... .......... .......... .......... .......... 39% 304M 0s 2024-09-14T11:17:06.151 INFO:teuthology.orchestra.run.smithi050.stderr: 36350K .......... .......... .......... .......... .......... 39% 304M 0s 2024-09-14T11:17:06.151 INFO:teuthology.orchestra.run.smithi050.stderr: 36400K .......... .......... .......... .......... .......... 39% 393M 0s 2024-09-14T11:17:06.151 INFO:teuthology.orchestra.run.smithi050.stderr: 36450K .......... .......... .......... .......... .......... 39% 194M 0s 2024-09-14T11:17:06.151 INFO:teuthology.orchestra.run.smithi050.stderr: 36500K .......... .......... .......... .......... .......... 39% 215M 0s 2024-09-14T11:17:06.151 INFO:teuthology.orchestra.run.smithi050.stderr: 36550K .......... .......... .......... .......... .......... 39% 72.4M 0s 2024-09-14T11:17:06.151 INFO:teuthology.orchestra.run.smithi050.stderr: 36600K .......... .......... .......... .......... .......... 39% 375M 0s 2024-09-14T11:17:06.151 INFO:teuthology.orchestra.run.smithi050.stderr: 36650K .......... .......... .......... .......... .......... 39% 387M 0s 2024-09-14T11:17:06.152 INFO:teuthology.orchestra.run.smithi050.stderr: 36700K .......... .......... .......... .......... .......... 39% 321M 0s 2024-09-14T11:17:06.152 INFO:teuthology.orchestra.run.smithi050.stderr: 36750K .......... .......... .......... .......... .......... 39% 298M 0s 2024-09-14T11:17:06.152 INFO:teuthology.orchestra.run.smithi050.stderr: 36800K .......... .......... .......... .......... .......... 39% 316M 0s 2024-09-14T11:17:06.152 INFO:teuthology.orchestra.run.smithi050.stderr: 36850K .......... .......... .......... .......... .......... 39% 350M 0s 2024-09-14T11:17:06.152 INFO:teuthology.orchestra.run.smithi050.stderr: 36900K .......... .......... .......... .......... .......... 39% 366M 0s 2024-09-14T11:17:06.152 INFO:teuthology.orchestra.run.smithi050.stderr: 36950K .......... .......... .......... .......... .......... 39% 291M 0s 2024-09-14T11:17:06.152 INFO:teuthology.orchestra.run.smithi050.stderr: 37000K .......... .......... .......... .......... .......... 39% 343M 0s 2024-09-14T11:17:06.152 INFO:teuthology.orchestra.run.smithi050.stderr: 37050K .......... .......... .......... .......... .......... 39% 364M 0s 2024-09-14T11:17:06.152 INFO:teuthology.orchestra.run.smithi050.stderr: 37100K .......... .......... .......... .......... .......... 39% 78.5M 0s 2024-09-14T11:17:06.152 INFO:teuthology.orchestra.run.smithi050.stderr: 37150K .......... .......... .......... .......... .......... 40% 284M 0s 2024-09-14T11:17:06.152 INFO:teuthology.orchestra.run.smithi050.stderr: 37200K .......... .......... .......... .......... .......... 40% 370M 0s 2024-09-14T11:17:06.152 INFO:teuthology.orchestra.run.smithi050.stderr: 37250K .......... .......... .......... .......... .......... 40% 375M 0s 2024-09-14T11:17:06.152 INFO:teuthology.orchestra.run.smithi050.stderr: 37300K .......... .......... .......... .......... .......... 40% 334M 0s 2024-09-14T11:17:06.152 INFO:teuthology.orchestra.run.smithi050.stderr: 37350K .......... .......... .......... .......... .......... 40% 315M 0s 2024-09-14T11:17:06.152 INFO:teuthology.orchestra.run.smithi050.stderr: 37400K .......... .......... .......... .......... .......... 40% 395M 0s 2024-09-14T11:17:06.153 INFO:teuthology.orchestra.run.smithi050.stderr: 37450K .......... .......... .......... .......... .......... 40% 372M 0s 2024-09-14T11:17:06.153 INFO:teuthology.orchestra.run.smithi050.stderr: 37500K .......... .......... .......... .......... .......... 40% 387M 0s 2024-09-14T11:17:06.153 INFO:teuthology.orchestra.run.smithi050.stderr: 37550K .......... .......... .......... .......... .......... 40% 349M 0s 2024-09-14T11:17:06.153 INFO:teuthology.orchestra.run.smithi050.stderr: 37600K .......... .......... .......... .......... .......... 40% 380M 0s 2024-09-14T11:17:06.153 INFO:teuthology.orchestra.run.smithi050.stderr: 37650K .......... .......... .......... .......... .......... 40% 381M 0s 2024-09-14T11:17:06.153 INFO:teuthology.orchestra.run.smithi050.stderr: 37700K .......... .......... .......... .......... .......... 40% 363M 0s 2024-09-14T11:17:06.153 INFO:teuthology.orchestra.run.smithi050.stderr: 37750K .......... .......... .......... .......... .......... 40% 317M 0s 2024-09-14T11:17:06.153 INFO:teuthology.orchestra.run.smithi050.stderr: 37800K .......... .......... .......... .......... .......... 40% 385M 0s 2024-09-14T11:17:06.153 INFO:teuthology.orchestra.run.smithi050.stderr: 37850K .......... .......... .......... .......... .......... 40% 375M 0s 2024-09-14T11:17:06.153 INFO:teuthology.orchestra.run.smithi050.stderr: 37900K .......... .......... .......... .......... .......... 40% 388M 0s 2024-09-14T11:17:06.153 INFO:teuthology.orchestra.run.smithi050.stderr: 37950K .......... .......... .......... .......... .......... 40% 353M 0s 2024-09-14T11:17:06.153 INFO:teuthology.orchestra.run.smithi050.stderr: 38000K .......... .......... .......... .......... .......... 40% 55.0M 0s 2024-09-14T11:17:06.153 INFO:teuthology.orchestra.run.smithi050.stderr: 38050K .......... .......... .......... .......... .......... 41% 352M 0s 2024-09-14T11:17:06.154 INFO:teuthology.orchestra.run.smithi050.stderr: 38100K .......... .......... .......... .......... .......... 41% 351M 0s 2024-09-14T11:17:06.154 INFO:teuthology.orchestra.run.smithi050.stderr: 38150K .......... .......... .......... .......... .......... 41% 290M 0s 2024-09-14T11:17:06.154 INFO:teuthology.orchestra.run.smithi050.stderr: 38200K .......... .......... .......... .......... .......... 41% 392M 0s 2024-09-14T11:17:06.154 INFO:teuthology.orchestra.run.smithi050.stderr: 38250K .......... .......... .......... .......... .......... 41% 93.5M 0s 2024-09-14T11:17:06.154 INFO:teuthology.orchestra.run.smithi050.stderr: 38300K .......... .......... .......... .......... .......... 41% 191M 0s 2024-09-14T11:17:06.154 INFO:teuthology.orchestra.run.smithi050.stderr: 38350K .......... .......... .......... .......... .......... 41% 248M 0s 2024-09-14T11:17:06.154 INFO:teuthology.orchestra.run.smithi050.stderr: 38400K .......... .......... .......... .......... .......... 41% 325M 0s 2024-09-14T11:17:06.154 INFO:teuthology.orchestra.run.smithi050.stderr: 38450K .......... .......... .......... .......... .......... 41% 317M 0s 2024-09-14T11:17:06.154 INFO:teuthology.orchestra.run.smithi050.stderr: 38500K .......... .......... .......... .......... .......... 41% 376M 0s 2024-09-14T11:17:06.154 INFO:teuthology.orchestra.run.smithi050.stderr: 38550K .......... .......... .......... .......... .......... 41% 175M 0s 2024-09-14T11:17:06.154 INFO:teuthology.orchestra.run.smithi050.stderr: 38600K .......... .......... .......... .......... .......... 41% 227M 0s 2024-09-14T11:17:06.154 INFO:teuthology.orchestra.run.smithi050.stderr: 38650K .......... .......... .......... .......... .......... 41% 358M 0s 2024-09-14T11:17:06.154 INFO:teuthology.orchestra.run.smithi050.stderr: 38700K .......... .......... .......... .......... .......... 41% 381M 0s 2024-09-14T11:17:06.154 INFO:teuthology.orchestra.run.smithi050.stderr: 38750K .......... .......... .......... .......... .......... 41% 350M 0s 2024-09-14T11:17:06.155 INFO:teuthology.orchestra.run.smithi050.stderr: 38800K .......... .......... .......... .......... .......... 41% 366M 0s 2024-09-14T11:17:06.155 INFO:teuthology.orchestra.run.smithi050.stderr: 38850K .......... .......... .......... .......... .......... 41% 366M 0s 2024-09-14T11:17:06.155 INFO:teuthology.orchestra.run.smithi050.stderr: 38900K .......... .......... .......... .......... .......... 41% 386M 0s 2024-09-14T11:17:06.155 INFO:teuthology.orchestra.run.smithi050.stderr: 38950K .......... .......... .......... .......... .......... 41% 184M 0s 2024-09-14T11:17:06.155 INFO:teuthology.orchestra.run.smithi050.stderr: 39000K .......... .......... .......... .......... .......... 42% 375M 0s 2024-09-14T11:17:06.155 INFO:teuthology.orchestra.run.smithi050.stderr: 39050K .......... .......... .......... .......... .......... 42% 58.6M 0s 2024-09-14T11:17:06.155 INFO:teuthology.orchestra.run.smithi050.stderr: 39100K .......... .......... .......... .......... .......... 42% 78.4M 0s 2024-09-14T11:17:06.155 INFO:teuthology.orchestra.run.smithi050.stderr: 39150K .......... .......... .......... .......... .......... 42% 327M 0s 2024-09-14T11:17:06.155 INFO:teuthology.orchestra.run.smithi050.stderr: 39200K .......... .......... .......... .......... .......... 42% 328M 0s 2024-09-14T11:17:06.155 INFO:teuthology.orchestra.run.smithi050.stderr: 39250K .......... .......... .......... .......... .......... 42% 381M 0s 2024-09-14T11:17:06.155 INFO:teuthology.orchestra.run.smithi050.stderr: 39300K .......... .......... .......... .......... .......... 42% 402M 0s 2024-09-14T11:17:06.155 INFO:teuthology.orchestra.run.smithi050.stderr: 39350K .......... .......... .......... .......... .......... 42% 321M 0s 2024-09-14T11:17:06.155 INFO:teuthology.orchestra.run.smithi050.stderr: 39400K .......... .......... .......... .......... .......... 42% 385M 0s 2024-09-14T11:17:06.155 INFO:teuthology.orchestra.run.smithi050.stderr: 39450K .......... .......... .......... .......... .......... 42% 326M 0s 2024-09-14T11:17:06.156 INFO:teuthology.orchestra.run.smithi050.stderr: 39500K .......... .......... .......... .......... .......... 42% 379M 0s 2024-09-14T11:17:06.156 INFO:teuthology.orchestra.run.smithi050.stderr: 39550K .......... .......... .......... .......... .......... 42% 305M 0s 2024-09-14T11:17:06.156 INFO:teuthology.orchestra.run.smithi050.stderr: 39600K .......... .......... .......... .......... .......... 42% 56.1M 0s 2024-09-14T11:17:06.156 INFO:teuthology.orchestra.run.smithi050.stderr: 39650K .......... .......... .......... .......... .......... 42% 260M 0s 2024-09-14T11:17:06.156 INFO:teuthology.orchestra.run.smithi050.stderr: 39700K .......... .......... .......... .......... .......... 42% 343M 0s 2024-09-14T11:17:06.156 INFO:teuthology.orchestra.run.smithi050.stderr: 39750K .......... .......... .......... .......... .......... 42% 306M 0s 2024-09-14T11:17:06.156 INFO:teuthology.orchestra.run.smithi050.stderr: 39800K .......... .......... .......... .......... .......... 42% 373M 0s 2024-09-14T11:17:06.156 INFO:teuthology.orchestra.run.smithi050.stderr: 39850K .......... .......... .......... .......... .......... 42% 373M 0s 2024-09-14T11:17:06.156 INFO:teuthology.orchestra.run.smithi050.stderr: 39900K .......... .......... .......... .......... .......... 43% 365M 0s 2024-09-14T11:17:06.156 INFO:teuthology.orchestra.run.smithi050.stderr: 39950K .......... .......... .......... .......... .......... 43% 345M 0s 2024-09-14T11:17:06.156 INFO:teuthology.orchestra.run.smithi050.stderr: 40000K .......... .......... .......... .......... .......... 43% 351M 0s 2024-09-14T11:17:06.156 INFO:teuthology.orchestra.run.smithi050.stderr: 40050K .......... .......... .......... .......... .......... 43% 396M 0s 2024-09-14T11:17:06.156 INFO:teuthology.orchestra.run.smithi050.stderr: 40100K .......... .......... .......... .......... .......... 43% 60.6M 0s 2024-09-14T11:17:06.156 INFO:teuthology.orchestra.run.smithi050.stderr: 40150K .......... .......... .......... .......... .......... 43% 203M 0s 2024-09-14T11:17:06.156 INFO:teuthology.orchestra.run.smithi050.stderr: 40200K .......... .......... .......... .......... .......... 43% 367M 0s 2024-09-14T11:17:06.157 INFO:teuthology.orchestra.run.smithi050.stderr: 40250K .......... .......... .......... .......... .......... 43% 370M 0s 2024-09-14T11:17:06.157 INFO:teuthology.orchestra.run.smithi050.stderr: 40300K .......... .......... .......... .......... .......... 43% 391M 0s 2024-09-14T11:17:06.157 INFO:teuthology.orchestra.run.smithi050.stderr: 40350K .......... .......... .......... .......... .......... 43% 322M 0s 2024-09-14T11:17:06.157 INFO:teuthology.orchestra.run.smithi050.stderr: 40400K .......... .......... .......... .......... .......... 43% 387M 0s 2024-09-14T11:17:06.157 INFO:teuthology.orchestra.run.smithi050.stderr: 40450K .......... .......... .......... .......... .......... 43% 344M 0s 2024-09-14T11:17:06.157 INFO:teuthology.orchestra.run.smithi050.stderr: 40500K .......... .......... .......... .......... .......... 43% 392M 0s 2024-09-14T11:17:06.157 INFO:teuthology.orchestra.run.smithi050.stderr: 40550K .......... .......... .......... .......... .......... 43% 339M 0s 2024-09-14T11:17:06.157 INFO:teuthology.orchestra.run.smithi050.stderr: 40600K .......... .......... .......... .......... .......... 43% 329M 0s 2024-09-14T11:17:06.157 INFO:teuthology.orchestra.run.smithi050.stderr: 40650K .......... .......... .......... .......... .......... 43% 335M 0s 2024-09-14T11:17:06.157 INFO:teuthology.orchestra.run.smithi050.stderr: 40700K .......... .......... .......... .......... .......... 43% 389M 0s 2024-09-14T11:17:06.157 INFO:teuthology.orchestra.run.smithi050.stderr: 40750K .......... .......... .......... .......... .......... 43% 296M 0s 2024-09-14T11:17:06.157 INFO:teuthology.orchestra.run.smithi050.stderr: 40800K .......... .......... .......... .......... .......... 43% 320M 0s 2024-09-14T11:17:06.157 INFO:teuthology.orchestra.run.smithi050.stderr: 40850K .......... .......... .......... .......... .......... 44% 390M 0s 2024-09-14T11:17:06.157 INFO:teuthology.orchestra.run.smithi050.stderr: 40900K .......... .......... .......... .......... .......... 44% 393M 0s 2024-09-14T11:17:06.157 INFO:teuthology.orchestra.run.smithi050.stderr: 40950K .......... .......... .......... .......... .......... 44% 79.5M 0s 2024-09-14T11:17:06.158 INFO:teuthology.orchestra.run.smithi050.stderr: 41000K .......... .......... .......... .......... .......... 44% 258M 0s 2024-09-14T11:17:06.158 INFO:teuthology.orchestra.run.smithi050.stderr: 41050K .......... .......... .......... .......... .......... 44% 367M 0s 2024-09-14T11:17:06.158 INFO:teuthology.orchestra.run.smithi050.stderr: 41100K .......... .......... .......... .......... .......... 44% 317M 0s 2024-09-14T11:17:06.158 INFO:teuthology.orchestra.run.smithi050.stderr: 41150K .......... .......... .......... .......... .......... 44% 380M 0s 2024-09-14T11:17:06.158 INFO:teuthology.orchestra.run.smithi050.stderr: 41200K .......... .......... .......... .......... .......... 44% 382M 0s 2024-09-14T11:17:06.158 INFO:teuthology.orchestra.run.smithi050.stderr: 41250K .......... .......... .......... .......... .......... 44% 101M 0s 2024-09-14T11:17:06.158 INFO:teuthology.orchestra.run.smithi050.stderr: 41300K .......... .......... .......... .......... .......... 44% 225M 0s 2024-09-14T11:17:06.158 INFO:teuthology.orchestra.run.smithi050.stderr: 41350K .......... .......... .......... .......... .......... 44% 382M 0s 2024-09-14T11:17:06.158 INFO:teuthology.orchestra.run.smithi050.stderr: 41400K .......... .......... .......... .......... .......... 44% 130M 0s 2024-09-14T11:17:06.158 INFO:teuthology.orchestra.run.smithi050.stderr: 41450K .......... .......... .......... .......... .......... 44% 345M 0s 2024-09-14T11:17:06.158 INFO:teuthology.orchestra.run.smithi050.stderr: 41500K .......... .......... .......... .......... .......... 44% 372M 0s 2024-09-14T11:17:06.158 INFO:teuthology.orchestra.run.smithi050.stderr: 41550K .......... .......... .......... .......... .......... 44% 379M 0s 2024-09-14T11:17:06.158 INFO:teuthology.orchestra.run.smithi050.stderr: 41600K .......... .......... .......... .......... .......... 44% 348M 0s 2024-09-14T11:17:06.158 INFO:teuthology.orchestra.run.smithi050.stderr: 41650K .......... .......... .......... .......... .......... 44% 373M 0s 2024-09-14T11:17:06.158 INFO:teuthology.orchestra.run.smithi050.stderr: 41700K .......... .......... .......... .......... .......... 44% 295M 0s 2024-09-14T11:17:06.159 INFO:teuthology.orchestra.run.smithi050.stderr: 41750K .......... .......... .......... .......... .......... 44% 226M 0s 2024-09-14T11:17:06.159 INFO:teuthology.orchestra.run.smithi050.stderr: 41800K .......... .......... .......... .......... .......... 45% 341M 0s 2024-09-14T11:17:06.159 INFO:teuthology.orchestra.run.smithi050.stderr: 41850K .......... .......... .......... .......... .......... 45% 366M 0s 2024-09-14T11:17:06.159 INFO:teuthology.orchestra.run.smithi050.stderr: 41900K .......... .......... .......... .......... .......... 45% 308M 0s 2024-09-14T11:17:06.159 INFO:teuthology.orchestra.run.smithi050.stderr: 41950K .......... .......... .......... .......... .......... 45% 377M 0s 2024-09-14T11:17:06.159 INFO:teuthology.orchestra.run.smithi050.stderr: 42000K .......... .......... .......... .......... .......... 45% 380M 0s 2024-09-14T11:17:06.159 INFO:teuthology.orchestra.run.smithi050.stderr: 42050K .......... .......... .......... .......... .......... 45% 390M 0s 2024-09-14T11:17:06.159 INFO:teuthology.orchestra.run.smithi050.stderr: 42100K .......... .......... .......... .......... .......... 45% 78.1M 0s 2024-09-14T11:17:06.159 INFO:teuthology.orchestra.run.smithi050.stderr: 42150K .......... .......... .......... .......... .......... 45% 71.3M 0s 2024-09-14T11:17:06.159 INFO:teuthology.orchestra.run.smithi050.stderr: 42200K .......... .......... .......... .......... .......... 45% 181M 0s 2024-09-14T11:17:06.159 INFO:teuthology.orchestra.run.smithi050.stderr: 42250K .......... .......... .......... .......... .......... 45% 297M 0s 2024-09-14T11:17:06.159 INFO:teuthology.orchestra.run.smithi050.stderr: 42300K .......... .......... .......... .......... .......... 45% 310M 0s 2024-09-14T11:17:06.159 INFO:teuthology.orchestra.run.smithi050.stderr: 42350K .......... .......... .......... .......... .......... 45% 222M 0s 2024-09-14T11:17:06.159 INFO:teuthology.orchestra.run.smithi050.stderr: 42400K .......... .......... .......... .......... .......... 45% 288M 0s 2024-09-14T11:17:06.159 INFO:teuthology.orchestra.run.smithi050.stderr: 42450K .......... .......... .......... .......... .......... 45% 370M 0s 2024-09-14T11:17:06.159 INFO:teuthology.orchestra.run.smithi050.stderr: 42500K .......... .......... .......... .......... .......... 45% 344M 0s 2024-09-14T11:17:06.160 INFO:teuthology.orchestra.run.smithi050.stderr: 42550K .......... .......... .......... .......... .......... 45% 359M 0s 2024-09-14T11:17:06.160 INFO:teuthology.orchestra.run.smithi050.stderr: 42600K .......... .......... .......... .......... .......... 45% 343M 0s 2024-09-14T11:17:06.160 INFO:teuthology.orchestra.run.smithi050.stderr: 42650K .......... .......... .......... .......... .......... 45% 71.4M 0s 2024-09-14T11:17:06.160 INFO:teuthology.orchestra.run.smithi050.stderr: 42700K .......... .......... .......... .......... .......... 46% 195M 0s 2024-09-14T11:17:06.160 INFO:teuthology.orchestra.run.smithi050.stderr: 42750K .......... .......... .......... .......... .......... 46% 282M 0s 2024-09-14T11:17:06.160 INFO:teuthology.orchestra.run.smithi050.stderr: 42800K .......... .......... .......... .......... .......... 46% 219M 0s 2024-09-14T11:17:06.160 INFO:teuthology.orchestra.run.smithi050.stderr: 42850K .......... .......... .......... .......... .......... 46% 280M 0s 2024-09-14T11:17:06.160 INFO:teuthology.orchestra.run.smithi050.stderr: 42900K .......... .......... .......... .......... .......... 46% 337M 0s 2024-09-14T11:17:06.160 INFO:teuthology.orchestra.run.smithi050.stderr: 42950K .......... .......... .......... .......... .......... 46% 372M 0s 2024-09-14T11:17:06.160 INFO:teuthology.orchestra.run.smithi050.stderr: 43000K .......... .......... .......... .......... .......... 46% 384M 0s 2024-09-14T11:17:06.160 INFO:teuthology.orchestra.run.smithi050.stderr: 43050K .......... .......... .......... .......... .......... 46% 387M 0s 2024-09-14T11:17:06.160 INFO:teuthology.orchestra.run.smithi050.stderr: 43100K .......... .......... .......... .......... .......... 46% 72.2M 0s 2024-09-14T11:17:06.160 INFO:teuthology.orchestra.run.smithi050.stderr: 43150K .......... .......... .......... .......... .......... 46% 262M 0s 2024-09-14T11:17:06.160 INFO:teuthology.orchestra.run.smithi050.stderr: 43200K .......... .......... .......... .......... .......... 46% 389M 0s 2024-09-14T11:17:06.160 INFO:teuthology.orchestra.run.smithi050.stderr: 43250K .......... .......... .......... .......... .......... 46% 219M 0s 2024-09-14T11:17:06.161 INFO:teuthology.orchestra.run.smithi050.stderr: 43300K .......... .......... .......... .......... .......... 46% 311M 0s 2024-09-14T11:17:06.161 INFO:teuthology.orchestra.run.smithi050.stderr: 43350K .......... .......... .......... .......... .......... 46% 362M 0s 2024-09-14T11:17:06.161 INFO:teuthology.orchestra.run.smithi050.stderr: 43400K .......... .......... .......... .......... .......... 46% 376M 0s 2024-09-14T11:17:06.161 INFO:teuthology.orchestra.run.smithi050.stderr: 43450K .......... .......... .......... .......... .......... 46% 380M 0s 2024-09-14T11:17:06.161 INFO:teuthology.orchestra.run.smithi050.stderr: 43500K .......... .......... .......... .......... .......... 46% 310M 0s 2024-09-14T11:17:06.161 INFO:teuthology.orchestra.run.smithi050.stderr: 43550K .......... .......... .......... .......... .......... 46% 360M 0s 2024-09-14T11:17:06.161 INFO:teuthology.orchestra.run.smithi050.stderr: 43600K .......... .......... .......... .......... .......... 46% 381M 0s 2024-09-14T11:17:06.161 INFO:teuthology.orchestra.run.smithi050.stderr: 43650K .......... .......... .......... .......... .......... 47% 375M 0s 2024-09-14T11:17:06.161 INFO:teuthology.orchestra.run.smithi050.stderr: 43700K .......... .......... .......... .......... .......... 47% 306M 0s 2024-09-14T11:17:06.161 INFO:teuthology.orchestra.run.smithi050.stderr: 43750K .......... .......... .......... .......... .......... 47% 348M 0s 2024-09-14T11:17:06.161 INFO:teuthology.orchestra.run.smithi050.stderr: 43800K .......... .......... .......... .......... .......... 47% 378M 0s 2024-09-14T11:17:06.161 INFO:teuthology.orchestra.run.smithi050.stderr: 43850K .......... .......... .......... .......... .......... 47% 379M 0s 2024-09-14T11:17:06.161 INFO:teuthology.orchestra.run.smithi050.stderr: 43900K .......... .......... .......... .......... .......... 47% 81.6M 0s 2024-09-14T11:17:06.162 INFO:teuthology.orchestra.run.smithi050.stderr: 43950K .......... .......... .......... .......... .......... 47% 262M 0s 2024-09-14T11:17:06.162 INFO:teuthology.orchestra.run.smithi050.stderr: 44000K .......... .......... .......... .......... .......... 47% 288M 0s 2024-09-14T11:17:06.162 INFO:teuthology.orchestra.run.smithi050.stderr: 44050K .......... .......... .......... .......... .......... 47% 357M 0s 2024-09-14T11:17:06.162 INFO:teuthology.orchestra.run.smithi050.stderr: 44100K .......... .......... .......... .......... .......... 47% 308M 0s 2024-09-14T11:17:06.162 INFO:teuthology.orchestra.run.smithi050.stderr: 44150K .......... .......... .......... .......... .......... 47% 317M 0s 2024-09-14T11:17:06.162 INFO:teuthology.orchestra.run.smithi050.stderr: 44200K .......... .......... .......... .......... .......... 47% 350M 0s 2024-09-14T11:17:06.162 INFO:teuthology.orchestra.run.smithi050.stderr: 44250K .......... .......... .......... .......... .......... 47% 132M 0s 2024-09-14T11:17:06.162 INFO:teuthology.orchestra.run.smithi050.stderr: 44300K .......... .......... .......... .......... .......... 47% 257M 0s 2024-09-14T11:17:06.162 INFO:teuthology.orchestra.run.smithi050.stderr: 44350K .......... .......... .......... .......... .......... 47% 126M 0s 2024-09-14T11:17:06.162 INFO:teuthology.orchestra.run.smithi050.stderr: 44400K .......... .......... .......... .......... .......... 47% 322M 0s 2024-09-14T11:17:06.162 INFO:teuthology.orchestra.run.smithi050.stderr: 44450K .......... .......... .......... .......... .......... 47% 355M 0s 2024-09-14T11:17:06.162 INFO:teuthology.orchestra.run.smithi050.stderr: 44500K .......... .......... .......... .......... .......... 47% 336M 0s 2024-09-14T11:17:06.162 INFO:teuthology.orchestra.run.smithi050.stderr: 44550K .......... .......... .......... .......... .......... 48% 193M 0s 2024-09-14T11:17:06.162 INFO:teuthology.orchestra.run.smithi050.stderr: 44600K .......... .......... .......... .......... .......... 48% 310M 0s 2024-09-14T11:17:06.163 INFO:teuthology.orchestra.run.smithi050.stderr: 44650K .......... .......... .......... .......... .......... 48% 341M 0s 2024-09-14T11:17:06.163 INFO:teuthology.orchestra.run.smithi050.stderr: 44700K .......... .......... .......... .......... .......... 48% 296M 0s 2024-09-14T11:17:06.163 INFO:teuthology.orchestra.run.smithi050.stderr: 44750K .......... .......... .......... .......... .......... 48% 371M 0s 2024-09-14T11:17:06.163 INFO:teuthology.orchestra.run.smithi050.stderr: 44800K .......... .......... .......... .......... .......... 48% 373M 0s 2024-09-14T11:17:06.163 INFO:teuthology.orchestra.run.smithi050.stderr: 44850K .......... .......... .......... .......... .......... 48% 370M 0s 2024-09-14T11:17:06.163 INFO:teuthology.orchestra.run.smithi050.stderr: 44900K .......... .......... .......... .......... .......... 48% 341M 0s 2024-09-14T11:17:06.163 INFO:teuthology.orchestra.run.smithi050.stderr: 44950K .......... .......... .......... .......... .......... 48% 375M 0s 2024-09-14T11:17:06.163 INFO:teuthology.orchestra.run.smithi050.stderr: 45000K .......... .......... .......... .......... .......... 48% 365M 0s 2024-09-14T11:17:06.163 INFO:teuthology.orchestra.run.smithi050.stderr: 45050K .......... .......... .......... .......... .......... 48% 343M 0s 2024-09-14T11:17:06.163 INFO:teuthology.orchestra.run.smithi050.stderr: 45100K .......... .......... .......... .......... .......... 48% 79.6M 0s 2024-09-14T11:17:06.163 INFO:teuthology.orchestra.run.smithi050.stderr: 45150K .......... .......... .......... .......... .......... 48% 372M 0s 2024-09-14T11:17:06.163 INFO:teuthology.orchestra.run.smithi050.stderr: 45200K .......... .......... .......... .......... .......... 48% 97.3M 0s 2024-09-14T11:17:06.163 INFO:teuthology.orchestra.run.smithi050.stderr: 45250K .......... .......... .......... .......... .......... 48% 190M 0s 2024-09-14T11:17:06.163 INFO:teuthology.orchestra.run.smithi050.stderr: 45300K .......... .......... .......... .......... .......... 48% 320M 0s 2024-09-14T11:17:06.163 INFO:teuthology.orchestra.run.smithi050.stderr: 45350K .......... .......... .......... .......... .......... 48% 140M 0s 2024-09-14T11:17:06.164 INFO:teuthology.orchestra.run.smithi050.stderr: 45400K .......... .......... .......... .......... .......... 48% 370M 0s 2024-09-14T11:17:06.164 INFO:teuthology.orchestra.run.smithi050.stderr: 45450K .......... .......... .......... .......... .......... 48% 145M 0s 2024-09-14T11:17:06.164 INFO:teuthology.orchestra.run.smithi050.stderr: 45500K .......... .......... .......... .......... .......... 49% 246M 0s 2024-09-14T11:17:06.164 INFO:teuthology.orchestra.run.smithi050.stderr: 45550K .......... .......... .......... .......... .......... 49% 352M 0s 2024-09-14T11:17:06.164 INFO:teuthology.orchestra.run.smithi050.stderr: 45600K .......... .......... .......... .......... .......... 49% 341M 0s 2024-09-14T11:17:06.164 INFO:teuthology.orchestra.run.smithi050.stderr: 45650K .......... .......... .......... .......... .......... 49% 375M 0s 2024-09-14T11:17:06.164 INFO:teuthology.orchestra.run.smithi050.stderr: 45700K .......... .......... .......... .......... .......... 49% 134M 0s 2024-09-14T11:17:06.164 INFO:teuthology.orchestra.run.smithi050.stderr: 45750K .......... .......... .......... .......... .......... 49% 339M 0s 2024-09-14T11:17:06.164 INFO:teuthology.orchestra.run.smithi050.stderr: 45800K .......... .......... .......... .......... .......... 49% 105M 0s 2024-09-14T11:17:06.164 INFO:teuthology.orchestra.run.smithi050.stderr: 45850K .......... .......... .......... .......... .......... 49% 368M 0s 2024-09-14T11:17:06.164 INFO:teuthology.orchestra.run.smithi050.stderr: 45900K .......... .......... .......... .......... .......... 49% 135M 0s 2024-09-14T11:17:06.164 INFO:teuthology.orchestra.run.smithi050.stderr: 45950K .......... .......... .......... .......... .......... 49% 228M 0s 2024-09-14T11:17:06.164 INFO:teuthology.orchestra.run.smithi050.stderr: 46000K .......... .......... .......... .......... .......... 49% 308M 0s 2024-09-14T11:17:06.164 INFO:teuthology.orchestra.run.smithi050.stderr: 46050K .......... .......... .......... .......... .......... 49% 368M 0s 2024-09-14T11:17:06.165 INFO:teuthology.orchestra.run.smithi050.stderr: 46100K .......... .......... .......... .......... .......... 49% 92.8M 0s 2024-09-14T11:17:06.165 INFO:teuthology.orchestra.run.smithi050.stderr: 46150K .......... .......... .......... .......... .......... 49% 332M 0s 2024-09-14T11:17:06.165 INFO:teuthology.orchestra.run.smithi050.stderr: 46200K .......... .......... .......... .......... .......... 49% 302M 0s 2024-09-14T11:17:06.165 INFO:teuthology.orchestra.run.smithi050.stderr: 46250K .......... .......... .......... .......... .......... 49% 292M 0s 2024-09-14T11:17:06.165 INFO:teuthology.orchestra.run.smithi050.stderr: 46300K .......... .......... .......... .......... .......... 49% 314M 0s 2024-09-14T11:17:06.165 INFO:teuthology.orchestra.run.smithi050.stderr: 46350K .......... .......... .......... .......... .......... 49% 188M 0s 2024-09-14T11:17:06.165 INFO:teuthology.orchestra.run.smithi050.stderr: 46400K .......... .......... .......... .......... .......... 49% 269M 0s 2024-09-14T11:17:06.165 INFO:teuthology.orchestra.run.smithi050.stderr: 46450K .......... .......... .......... .......... .......... 50% 372M 0s 2024-09-14T11:17:06.165 INFO:teuthology.orchestra.run.smithi050.stderr: 46500K .......... .......... .......... .......... .......... 50% 269M 0s 2024-09-14T11:17:06.165 INFO:teuthology.orchestra.run.smithi050.stderr: 46550K .......... .......... .......... .......... .......... 50% 362M 0s 2024-09-14T11:17:06.165 INFO:teuthology.orchestra.run.smithi050.stderr: 46600K .......... .......... .......... .......... .......... 50% 364M 0s 2024-09-14T11:17:06.165 INFO:teuthology.orchestra.run.smithi050.stderr: 46650K .......... .......... .......... .......... .......... 50% 365M 0s 2024-09-14T11:17:06.165 INFO:teuthology.orchestra.run.smithi050.stderr: 46700K .......... .......... .......... .......... .......... 50% 310M 0s 2024-09-14T11:17:06.165 INFO:teuthology.orchestra.run.smithi050.stderr: 46750K .......... .......... .......... .......... .......... 50% 371M 0s 2024-09-14T11:17:06.165 INFO:teuthology.orchestra.run.smithi050.stderr: 46800K .......... .......... .......... .......... .......... 50% 381M 0s 2024-09-14T11:17:06.166 INFO:teuthology.orchestra.run.smithi050.stderr: 46850K .......... .......... .......... .......... .......... 50% 353M 0s 2024-09-14T11:17:06.166 INFO:teuthology.orchestra.run.smithi050.stderr: 46900K .......... .......... .......... .......... .......... 50% 118M 0s 2024-09-14T11:17:06.166 INFO:teuthology.orchestra.run.smithi050.stderr: 46950K .......... .......... .......... .......... .......... 50% 224M 0s 2024-09-14T11:17:06.166 INFO:teuthology.orchestra.run.smithi050.stderr: 47000K .......... .......... .......... .......... .......... 50% 370M 0s 2024-09-14T11:17:06.166 INFO:teuthology.orchestra.run.smithi050.stderr: 47050K .......... .......... .......... .......... .......... 50% 370M 0s 2024-09-14T11:17:06.166 INFO:teuthology.orchestra.run.smithi050.stderr: 47100K .......... .......... .......... .......... .......... 50% 228M 0s 2024-09-14T11:17:06.166 INFO:teuthology.orchestra.run.smithi050.stderr: 47150K .......... .......... .......... .......... .......... 50% 281M 0s 2024-09-14T11:17:06.166 INFO:teuthology.orchestra.run.smithi050.stderr: 47200K .......... .......... .......... .......... .......... 50% 363M 0s 2024-09-14T11:17:06.166 INFO:teuthology.orchestra.run.smithi050.stderr: 47250K .......... .......... .......... .......... .......... 50% 375M 0s 2024-09-14T11:17:06.166 INFO:teuthology.orchestra.run.smithi050.stderr: 47300K .......... .......... .......... .......... .......... 50% 204M 0s 2024-09-14T11:17:06.166 INFO:teuthology.orchestra.run.smithi050.stderr: 47350K .......... .......... .......... .......... .......... 51% 320M 0s 2024-09-14T11:17:06.166 INFO:teuthology.orchestra.run.smithi050.stderr: 47400K .......... .......... .......... .......... .......... 51% 351M 0s 2024-09-14T11:17:06.166 INFO:teuthology.orchestra.run.smithi050.stderr: 47450K .......... .......... .......... .......... .......... 51% 65.5M 0s 2024-09-14T11:17:06.166 INFO:teuthology.orchestra.run.smithi050.stderr: 47500K .......... .......... .......... .......... .......... 51% 266M 0s 2024-09-14T11:17:06.166 INFO:teuthology.orchestra.run.smithi050.stderr: 47550K .......... .......... .......... .......... .......... 51% 311M 0s 2024-09-14T11:17:06.167 INFO:teuthology.orchestra.run.smithi050.stderr: 47600K .......... .......... .......... .......... .......... 51% 375M 0s 2024-09-14T11:17:06.167 INFO:teuthology.orchestra.run.smithi050.stderr: 47650K .......... .......... .......... .......... .......... 51% 364M 0s 2024-09-14T11:17:06.167 INFO:teuthology.orchestra.run.smithi050.stderr: 47700K .......... .......... .......... .......... .......... 51% 278M 0s 2024-09-14T11:17:06.167 INFO:teuthology.orchestra.run.smithi050.stderr: 47750K .......... .......... .......... .......... .......... 51% 364M 0s 2024-09-14T11:17:06.167 INFO:teuthology.orchestra.run.smithi050.stderr: 47800K .......... .......... .......... .......... .......... 51% 364M 0s 2024-09-14T11:17:06.167 INFO:teuthology.orchestra.run.smithi050.stderr: 47850K .......... .......... .......... .......... .......... 51% 322M 0s 2024-09-14T11:17:06.167 INFO:teuthology.orchestra.run.smithi050.stderr: 47900K .......... .......... .......... .......... .......... 51% 308M 0s 2024-09-14T11:17:06.167 INFO:teuthology.orchestra.run.smithi050.stderr: 47950K .......... .......... .......... .......... .......... 51% 370M 0s 2024-09-14T11:17:06.167 INFO:teuthology.orchestra.run.smithi050.stderr: 48000K .......... .......... .......... .......... .......... 51% 384M 0s 2024-09-14T11:17:06.167 INFO:teuthology.orchestra.run.smithi050.stderr: 48050K .......... .......... .......... .......... .......... 51% 138M 0s 2024-09-14T11:17:06.167 INFO:teuthology.orchestra.run.smithi050.stderr: 48100K .......... .......... .......... .......... .......... 51% 248M 0s 2024-09-14T11:17:06.167 INFO:teuthology.orchestra.run.smithi050.stderr: 48150K .......... .......... .......... .......... .......... 51% 382M 0s 2024-09-14T11:17:06.167 INFO:teuthology.orchestra.run.smithi050.stderr: 48200K .......... .......... .......... .......... .......... 51% 115M 0s 2024-09-14T11:17:06.167 INFO:teuthology.orchestra.run.smithi050.stderr: 48250K .......... .......... .......... .......... .......... 51% 232M 0s 2024-09-14T11:17:06.168 INFO:teuthology.orchestra.run.smithi050.stderr: 48300K .......... .......... .......... .......... .......... 52% 310M 0s 2024-09-14T11:17:06.168 INFO:teuthology.orchestra.run.smithi050.stderr: 48350K .......... .......... .......... .......... .......... 52% 350M 0s 2024-09-14T11:17:06.168 INFO:teuthology.orchestra.run.smithi050.stderr: 48400K .......... .......... .......... .......... .......... 52% 80.8M 0s 2024-09-14T11:17:06.168 INFO:teuthology.orchestra.run.smithi050.stderr: 48450K .......... .......... .......... .......... .......... 52% 367M 0s 2024-09-14T11:17:06.168 INFO:teuthology.orchestra.run.smithi050.stderr: 48500K .......... .......... .......... .......... .......... 52% 215M 0s 2024-09-14T11:17:06.168 INFO:teuthology.orchestra.run.smithi050.stderr: 48550K .......... .......... .......... .......... .......... 52% 362M 0s 2024-09-14T11:17:06.168 INFO:teuthology.orchestra.run.smithi050.stderr: 48600K .......... .......... .......... .......... .......... 52% 385M 0s 2024-09-14T11:17:06.168 INFO:teuthology.orchestra.run.smithi050.stderr: 48650K .......... .......... .......... .......... .......... 52% 373M 0s 2024-09-14T11:17:06.168 INFO:teuthology.orchestra.run.smithi050.stderr: 48700K .......... .......... .......... .......... .......... 52% 126M 0s 2024-09-14T11:17:06.168 INFO:teuthology.orchestra.run.smithi050.stderr: 48750K .......... .......... .......... .......... .......... 52% 317M 0s 2024-09-14T11:17:06.168 INFO:teuthology.orchestra.run.smithi050.stderr: 48800K .......... .......... .......... .......... .......... 52% 344M 0s 2024-09-14T11:17:06.168 INFO:teuthology.orchestra.run.smithi050.stderr: 48850K .......... .......... .......... .......... .......... 52% 133M 0s 2024-09-14T11:17:06.168 INFO:teuthology.orchestra.run.smithi050.stderr: 48900K .......... .......... .......... .......... .......... 52% 234M 0s 2024-09-14T11:17:06.168 INFO:teuthology.orchestra.run.smithi050.stderr: 48950K .......... .......... .......... .......... .......... 52% 173M 0s 2024-09-14T11:17:06.168 INFO:teuthology.orchestra.run.smithi050.stderr: 49000K .......... .......... .......... .......... .......... 52% 319M 0s 2024-09-14T11:17:06.169 INFO:teuthology.orchestra.run.smithi050.stderr: 49050K .......... .......... .......... .......... .......... 52% 335M 0s 2024-09-14T11:17:06.169 INFO:teuthology.orchestra.run.smithi050.stderr: 49100K .......... .......... .......... .......... .......... 52% 57.6M 0s 2024-09-14T11:17:06.169 INFO:teuthology.orchestra.run.smithi050.stderr: 49150K .......... .......... .......... .......... .......... 52% 359M 0s 2024-09-14T11:17:06.169 INFO:teuthology.orchestra.run.smithi050.stderr: 49200K .......... .......... .......... .......... .......... 53% 351M 0s 2024-09-14T11:17:06.169 INFO:teuthology.orchestra.run.smithi050.stderr: 49250K .......... .......... .......... .......... .......... 53% 382M 0s 2024-09-14T11:17:06.169 INFO:teuthology.orchestra.run.smithi050.stderr: 49300K .......... .......... .......... .......... .......... 53% 345M 0s 2024-09-14T11:17:06.169 INFO:teuthology.orchestra.run.smithi050.stderr: 49350K .......... .......... .......... .......... .......... 53% 168M 0s 2024-09-14T11:17:06.169 INFO:teuthology.orchestra.run.smithi050.stderr: 49400K .......... .......... .......... .......... .......... 53% 327M 0s 2024-09-14T11:17:06.169 INFO:teuthology.orchestra.run.smithi050.stderr: 49450K .......... .......... .......... .......... .......... 53% 369M 0s 2024-09-14T11:17:06.169 INFO:teuthology.orchestra.run.smithi050.stderr: 49500K .......... .......... .......... .......... .......... 53% 313M 0s 2024-09-14T11:17:06.169 INFO:teuthology.orchestra.run.smithi050.stderr: 49550K .......... .......... .......... .......... .......... 53% 381M 0s 2024-09-14T11:17:06.169 INFO:teuthology.orchestra.run.smithi050.stderr: 49600K .......... .......... .......... .......... .......... 53% 375M 0s 2024-09-14T11:17:06.169 INFO:teuthology.orchestra.run.smithi050.stderr: 49650K .......... .......... .......... .......... .......... 53% 214M 0s 2024-09-14T11:17:06.169 INFO:teuthology.orchestra.run.smithi050.stderr: 49700K .......... .......... .......... .......... .......... 53% 302M 0s 2024-09-14T11:17:06.170 INFO:teuthology.orchestra.run.smithi050.stderr: 49750K .......... .......... .......... .......... .......... 53% 375M 0s 2024-09-14T11:17:06.170 INFO:teuthology.orchestra.run.smithi050.stderr: 49800K .......... .......... .......... .......... .......... 53% 381M 0s 2024-09-14T11:17:06.170 INFO:teuthology.orchestra.run.smithi050.stderr: 49850K .......... .......... .......... .......... .......... 53% 91.2M 0s 2024-09-14T11:17:06.170 INFO:teuthology.orchestra.run.smithi050.stderr: 49900K .......... .......... .......... .......... .......... 53% 231M 0s 2024-09-14T11:17:06.170 INFO:teuthology.orchestra.run.smithi050.stderr: 49950K .......... .......... .......... .......... .......... 53% 361M 0s 2024-09-14T11:17:06.170 INFO:teuthology.orchestra.run.smithi050.stderr: 50000K .......... .......... .......... .......... .......... 53% 336M 0s 2024-09-14T11:17:06.170 INFO:teuthology.orchestra.run.smithi050.stderr: 50050K .......... .......... .......... .......... .......... 53% 352M 0s 2024-09-14T11:17:06.170 INFO:teuthology.orchestra.run.smithi050.stderr: 50100K .......... .......... .......... .......... .......... 53% 306M 0s 2024-09-14T11:17:06.170 INFO:teuthology.orchestra.run.smithi050.stderr: 50150K .......... .......... .......... .......... .......... 54% 356M 0s 2024-09-14T11:17:06.170 INFO:teuthology.orchestra.run.smithi050.stderr: 50200K .......... .......... .......... .......... .......... 54% 354M 0s 2024-09-14T11:17:06.170 INFO:teuthology.orchestra.run.smithi050.stderr: 50250K .......... .......... .......... .......... .......... 54% 286M 0s 2024-09-14T11:17:06.170 INFO:teuthology.orchestra.run.smithi050.stderr: 50300K .......... .......... .......... .......... .......... 54% 310M 0s 2024-09-14T11:17:06.170 INFO:teuthology.orchestra.run.smithi050.stderr: 50350K .......... .......... .......... .......... .......... 54% 364M 0s 2024-09-14T11:17:06.171 INFO:teuthology.orchestra.run.smithi050.stderr: 50400K .......... .......... .......... .......... .......... 54% 327M 0s 2024-09-14T11:17:06.171 INFO:teuthology.orchestra.run.smithi050.stderr: 50450K .......... .......... .......... .......... .......... 54% 386M 0s 2024-09-14T11:17:06.171 INFO:teuthology.orchestra.run.smithi050.stderr: 50500K .......... .......... .......... .......... .......... 54% 79.6M 0s 2024-09-14T11:17:06.171 INFO:teuthology.orchestra.run.smithi050.stderr: 50550K .......... .......... .......... .......... .......... 54% 346M 0s 2024-09-14T11:17:06.171 INFO:teuthology.orchestra.run.smithi050.stderr: 50600K .......... .......... .......... .......... .......... 54% 368M 0s 2024-09-14T11:17:06.171 INFO:teuthology.orchestra.run.smithi050.stderr: 50650K .......... .......... .......... .......... .......... 54% 390M 0s 2024-09-14T11:17:06.171 INFO:teuthology.orchestra.run.smithi050.stderr: 50700K .......... .......... .......... .......... .......... 54% 266M 0s 2024-09-14T11:17:06.171 INFO:teuthology.orchestra.run.smithi050.stderr: 50750K .......... .......... .......... .......... .......... 54% 170M 0s 2024-09-14T11:17:06.171 INFO:teuthology.orchestra.run.smithi050.stderr: 50800K .......... .......... .......... .......... .......... 54% 220M 0s 2024-09-14T11:17:06.171 INFO:teuthology.orchestra.run.smithi050.stderr: 50850K .......... .......... .......... .......... .......... 54% 371M 0s 2024-09-14T11:17:06.171 INFO:teuthology.orchestra.run.smithi050.stderr: 50900K .......... .......... .......... .......... .......... 54% 303M 0s 2024-09-14T11:17:06.171 INFO:teuthology.orchestra.run.smithi050.stderr: 50950K .......... .......... .......... .......... .......... 54% 151M 0s 2024-09-14T11:17:06.171 INFO:teuthology.orchestra.run.smithi050.stderr: 51000K .......... .......... .......... .......... .......... 54% 347M 0s 2024-09-14T11:17:06.172 INFO:teuthology.orchestra.run.smithi050.stderr: 51050K .......... .......... .......... .......... .......... 55% 377M 0s 2024-09-14T11:17:06.172 INFO:teuthology.orchestra.run.smithi050.stderr: 51100K .......... .......... .......... .......... .......... 55% 276M 0s 2024-09-14T11:17:06.172 INFO:teuthology.orchestra.run.smithi050.stderr: 51150K .......... .......... .......... .......... .......... 55% 395M 0s 2024-09-14T11:17:06.172 INFO:teuthology.orchestra.run.smithi050.stderr: 51200K .......... .......... .......... .......... .......... 55% 96.5M 0s 2024-09-14T11:17:06.172 INFO:teuthology.orchestra.run.smithi050.stderr: 51250K .......... .......... .......... .......... .......... 55% 377M 0s 2024-09-14T11:17:06.172 INFO:teuthology.orchestra.run.smithi050.stderr: 51300K .......... .......... .......... .......... .......... 55% 338M 0s 2024-09-14T11:17:06.172 INFO:teuthology.orchestra.run.smithi050.stderr: 51350K .......... .......... .......... .......... .......... 55% 371M 0s 2024-09-14T11:17:06.172 INFO:teuthology.orchestra.run.smithi050.stderr: 51400K .......... .......... .......... .......... .......... 55% 383M 0s 2024-09-14T11:17:06.172 INFO:teuthology.orchestra.run.smithi050.stderr: 51450K .......... .......... .......... .......... .......... 55% 78.4M 0s 2024-09-14T11:17:06.172 INFO:teuthology.orchestra.run.smithi050.stderr: 51500K .......... .......... .......... .......... .......... 55% 326M 0s 2024-09-14T11:17:06.172 INFO:teuthology.orchestra.run.smithi050.stderr: 51550K .......... .......... .......... .......... .......... 55% 375M 0s 2024-09-14T11:17:06.172 INFO:teuthology.orchestra.run.smithi050.stderr: 51600K .......... .......... .......... .......... .......... 55% 336M 0s 2024-09-14T11:17:06.172 INFO:teuthology.orchestra.run.smithi050.stderr: 51650K .......... .......... .......... .......... .......... 55% 375M 0s 2024-09-14T11:17:06.173 INFO:teuthology.orchestra.run.smithi050.stderr: 51700K .......... .......... .......... .......... .......... 55% 331M 0s 2024-09-14T11:17:06.173 INFO:teuthology.orchestra.run.smithi050.stderr: 51750K .......... .......... .......... .......... .......... 55% 186M 0s 2024-09-14T11:17:06.173 INFO:teuthology.orchestra.run.smithi050.stderr: 51800K .......... .......... .......... .......... .......... 55% 276M 0s 2024-09-14T11:17:06.173 INFO:teuthology.orchestra.run.smithi050.stderr: 51850K .......... .......... .......... .......... .......... 55% 283M 0s 2024-09-14T11:17:06.173 INFO:teuthology.orchestra.run.smithi050.stderr: 51900K .......... .......... .......... .......... .......... 55% 114M 0s 2024-09-14T11:17:06.173 INFO:teuthology.orchestra.run.smithi050.stderr: 51950K .......... .......... .......... .......... .......... 55% 166M 0s 2024-09-14T11:17:06.173 INFO:teuthology.orchestra.run.smithi050.stderr: 52000K .......... .......... .......... .......... .......... 56% 350M 0s 2024-09-14T11:17:06.173 INFO:teuthology.orchestra.run.smithi050.stderr: 52050K .......... .......... .......... .......... .......... 56% 344M 0s 2024-09-14T11:17:06.173 INFO:teuthology.orchestra.run.smithi050.stderr: 52100K .......... .......... .......... .......... .......... 56% 306M 0s 2024-09-14T11:17:06.173 INFO:teuthology.orchestra.run.smithi050.stderr: 52150K .......... .......... .......... .......... .......... 56% 61.2M 0s 2024-09-14T11:17:06.173 INFO:teuthology.orchestra.run.smithi050.stderr: 52200K .......... .......... .......... .......... .......... 56% 151M 0s 2024-09-14T11:17:06.173 INFO:teuthology.orchestra.run.smithi050.stderr: 52250K .......... .......... .......... .......... .......... 56% 268M 0s 2024-09-14T11:17:06.173 INFO:teuthology.orchestra.run.smithi050.stderr: 52300K .......... .......... .......... .......... .......... 56% 275M 0s 2024-09-14T11:17:06.173 INFO:teuthology.orchestra.run.smithi050.stderr: 52350K .......... .......... .......... .......... .......... 56% 359M 0s 2024-09-14T11:17:06.173 INFO:teuthology.orchestra.run.smithi050.stderr: 52400K .......... .......... .......... .......... .......... 56% 112M 0s 2024-09-14T11:17:06.174 INFO:teuthology.orchestra.run.smithi050.stderr: 52450K .......... .......... .......... .......... .......... 56% 360M 0s 2024-09-14T11:17:06.174 INFO:teuthology.orchestra.run.smithi050.stderr: 52500K .......... .......... .......... .......... .......... 56% 306M 0s 2024-09-14T11:17:06.174 INFO:teuthology.orchestra.run.smithi050.stderr: 52550K .......... .......... .......... .......... .......... 56% 361M 0s 2024-09-14T11:17:06.174 INFO:teuthology.orchestra.run.smithi050.stderr: 52600K .......... .......... .......... .......... .......... 56% 374M 0s 2024-09-14T11:17:06.174 INFO:teuthology.orchestra.run.smithi050.stderr: 52650K .......... .......... .......... .......... .......... 56% 371M 0s 2024-09-14T11:17:06.174 INFO:teuthology.orchestra.run.smithi050.stderr: 52700K .......... .......... .......... .......... .......... 56% 317M 0s 2024-09-14T11:17:06.174 INFO:teuthology.orchestra.run.smithi050.stderr: 52750K .......... .......... .......... .......... .......... 56% 358M 0s 2024-09-14T11:17:06.174 INFO:teuthology.orchestra.run.smithi050.stderr: 52800K .......... .......... .......... .......... .......... 56% 392M 0s 2024-09-14T11:17:06.174 INFO:teuthology.orchestra.run.smithi050.stderr: 52850K .......... .......... .......... .......... .......... 56% 384M 0s 2024-09-14T11:17:06.174 INFO:teuthology.orchestra.run.smithi050.stderr: 52900K .......... .......... .......... .......... .......... 56% 213M 0s 2024-09-14T11:17:06.174 INFO:teuthology.orchestra.run.smithi050.stderr: 52950K .......... .......... .......... .......... .......... 57% 161M 0s 2024-09-14T11:17:06.174 INFO:teuthology.orchestra.run.smithi050.stderr: 53000K .......... .......... .......... .......... .......... 57% 278M 0s 2024-09-14T11:17:06.174 INFO:teuthology.orchestra.run.smithi050.stderr: 53050K .......... .......... .......... .......... .......... 57% 372M 0s 2024-09-14T11:17:06.174 INFO:teuthology.orchestra.run.smithi050.stderr: 53100K .......... .......... .......... .......... .......... 57% 310M 0s 2024-09-14T11:17:06.175 INFO:teuthology.orchestra.run.smithi050.stderr: 53150K .......... .......... .......... .......... .......... 57% 351M 0s 2024-09-14T11:17:06.175 INFO:teuthology.orchestra.run.smithi050.stderr: 53200K .......... .......... .......... .......... .......... 57% 369M 0s 2024-09-14T11:17:06.175 INFO:teuthology.orchestra.run.smithi050.stderr: 53250K .......... .......... .......... .......... .......... 57% 372M 0s 2024-09-14T11:17:06.175 INFO:teuthology.orchestra.run.smithi050.stderr: 53300K .......... .......... .......... .......... .......... 57% 322M 0s 2024-09-14T11:17:06.175 INFO:teuthology.orchestra.run.smithi050.stderr: 53350K .......... .......... .......... .......... .......... 57% 376M 0s 2024-09-14T11:17:06.175 INFO:teuthology.orchestra.run.smithi050.stderr: 53400K .......... .......... .......... .......... .......... 57% 370M 0s 2024-09-14T11:17:06.175 INFO:teuthology.orchestra.run.smithi050.stderr: 53450K .......... .......... .......... .......... .......... 57% 391M 0s 2024-09-14T11:17:06.175 INFO:teuthology.orchestra.run.smithi050.stderr: 53500K .......... .......... .......... .......... .......... 57% 77.0M 0s 2024-09-14T11:17:06.175 INFO:teuthology.orchestra.run.smithi050.stderr: 53550K .......... .......... .......... .......... .......... 57% 354M 0s 2024-09-14T11:17:06.175 INFO:teuthology.orchestra.run.smithi050.stderr: 53600K .......... .......... .......... .......... .......... 57% 275M 0s 2024-09-14T11:17:06.175 INFO:teuthology.orchestra.run.smithi050.stderr: 53650K .......... .......... .......... .......... .......... 57% 340M 0s 2024-09-14T11:17:06.175 INFO:teuthology.orchestra.run.smithi050.stderr: 53700K .......... .......... .......... .......... .......... 57% 322M 0s 2024-09-14T11:17:06.175 INFO:teuthology.orchestra.run.smithi050.stderr: 53750K .......... .......... .......... .......... .......... 57% 364M 0s 2024-09-14T11:17:06.175 INFO:teuthology.orchestra.run.smithi050.stderr: 53800K .......... .......... .......... .......... .......... 57% 374M 0s 2024-09-14T11:17:06.175 INFO:teuthology.orchestra.run.smithi050.stderr: 53850K .......... .......... .......... .......... .......... 58% 359M 0s 2024-09-14T11:17:06.176 INFO:teuthology.orchestra.run.smithi050.stderr: 53900K .......... .......... .......... .......... .......... 58% 151M 0s 2024-09-14T11:17:06.176 INFO:teuthology.orchestra.run.smithi050.stderr: 53950K .......... .......... .......... .......... .......... 58% 267M 0s 2024-09-14T11:17:06.176 INFO:teuthology.orchestra.run.smithi050.stderr: 54000K .......... .......... .......... .......... .......... 58% 371M 0s 2024-09-14T11:17:06.176 INFO:teuthology.orchestra.run.smithi050.stderr: 54050K .......... .......... .......... .......... .......... 58% 158M 0s 2024-09-14T11:17:06.176 INFO:teuthology.orchestra.run.smithi050.stderr: 54100K .......... .......... .......... .......... .......... 58% 244M 0s 2024-09-14T11:17:06.176 INFO:teuthology.orchestra.run.smithi050.stderr: 54150K .......... .......... .......... .......... .......... 58% 373M 0s 2024-09-14T11:17:06.176 INFO:teuthology.orchestra.run.smithi050.stderr: 54200K .......... .......... .......... .......... .......... 58% 375M 0s 2024-09-14T11:17:06.176 INFO:teuthology.orchestra.run.smithi050.stderr: 54250K .......... .......... .......... .......... .......... 58% 98.6M 0s 2024-09-14T11:17:06.176 INFO:teuthology.orchestra.run.smithi050.stderr: 54300K .......... .......... .......... .......... .......... 58% 276M 0s 2024-09-14T11:17:06.176 INFO:teuthology.orchestra.run.smithi050.stderr: 54350K .......... .......... .......... .......... .......... 58% 317M 0s 2024-09-14T11:17:06.176 INFO:teuthology.orchestra.run.smithi050.stderr: 54400K .......... .......... .......... .......... .......... 58% 377M 0s 2024-09-14T11:17:06.176 INFO:teuthology.orchestra.run.smithi050.stderr: 54450K .......... .......... .......... .......... .......... 58% 95.4M 0s 2024-09-14T11:17:06.176 INFO:teuthology.orchestra.run.smithi050.stderr: 54500K .......... .......... .......... .......... .......... 58% 328M 0s 2024-09-14T11:17:06.176 INFO:teuthology.orchestra.run.smithi050.stderr: 54550K .......... .......... .......... .......... .......... 58% 330M 0s 2024-09-14T11:17:06.176 INFO:teuthology.orchestra.run.smithi050.stderr: 54600K .......... .......... .......... .......... .......... 58% 365M 0s 2024-09-14T11:17:06.177 INFO:teuthology.orchestra.run.smithi050.stderr: 54650K .......... .......... .......... .......... .......... 58% 300M 0s 2024-09-14T11:17:06.177 INFO:teuthology.orchestra.run.smithi050.stderr: 54700K .......... .......... .......... .......... .......... 58% 269M 0s 2024-09-14T11:17:06.177 INFO:teuthology.orchestra.run.smithi050.stderr: 54750K .......... .......... .......... .......... .......... 58% 338M 0s 2024-09-14T11:17:06.177 INFO:teuthology.orchestra.run.smithi050.stderr: 54800K .......... .......... .......... .......... .......... 59% 350M 0s 2024-09-14T11:17:06.177 INFO:teuthology.orchestra.run.smithi050.stderr: 54850K .......... .......... .......... .......... .......... 59% 220M 0s 2024-09-14T11:17:06.177 INFO:teuthology.orchestra.run.smithi050.stderr: 54900K .......... .......... .......... .......... .......... 59% 215M 0s 2024-09-14T11:17:06.177 INFO:teuthology.orchestra.run.smithi050.stderr: 54950K .......... .......... .......... .......... .......... 59% 203M 0s 2024-09-14T11:17:06.177 INFO:teuthology.orchestra.run.smithi050.stderr: 55000K .......... .......... .......... .......... .......... 59% 93.5M 0s 2024-09-14T11:17:06.177 INFO:teuthology.orchestra.run.smithi050.stderr: 55050K .......... .......... .......... .......... .......... 59% 357M 0s 2024-09-14T11:17:06.177 INFO:teuthology.orchestra.run.smithi050.stderr: 55100K .......... .......... .......... .......... .......... 59% 255M 0s 2024-09-14T11:17:06.177 INFO:teuthology.orchestra.run.smithi050.stderr: 55150K .......... .......... .......... .......... .......... 59% 366M 0s 2024-09-14T11:17:06.177 INFO:teuthology.orchestra.run.smithi050.stderr: 55200K .......... .......... .......... .......... .......... 59% 91.5M 0s 2024-09-14T11:17:06.177 INFO:teuthology.orchestra.run.smithi050.stderr: 55250K .......... .......... .......... .......... .......... 59% 70.1M 0s 2024-09-14T11:17:06.177 INFO:teuthology.orchestra.run.smithi050.stderr: 55300K .......... .......... .......... .......... .......... 59% 314M 0s 2024-09-14T11:17:06.177 INFO:teuthology.orchestra.run.smithi050.stderr: 55350K .......... .......... .......... .......... .......... 59% 380M 0s 2024-09-14T11:17:06.178 INFO:teuthology.orchestra.run.smithi050.stderr: 55400K .......... .......... .......... .......... .......... 59% 375M 0s 2024-09-14T11:17:06.178 INFO:teuthology.orchestra.run.smithi050.stderr: 55450K .......... .......... .......... .......... .......... 59% 352M 0s 2024-09-14T11:17:06.178 INFO:teuthology.orchestra.run.smithi050.stderr: 55500K .......... .......... .......... .......... .......... 59% 111M 0s 2024-09-14T11:17:06.178 INFO:teuthology.orchestra.run.smithi050.stderr: 55550K .......... .......... .......... .......... .......... 59% 347M 0s 2024-09-14T11:17:06.178 INFO:teuthology.orchestra.run.smithi050.stderr: 55600K .......... .......... .......... .......... .......... 59% 370M 0s 2024-09-14T11:17:06.178 INFO:teuthology.orchestra.run.smithi050.stderr: 55650K .......... .......... .......... .......... .......... 59% 369M 0s 2024-09-14T11:17:06.178 INFO:teuthology.orchestra.run.smithi050.stderr: 55700K .......... .......... .......... .......... .......... 60% 328M 0s 2024-09-14T11:17:06.178 INFO:teuthology.orchestra.run.smithi050.stderr: 55750K .......... .......... .......... .......... .......... 60% 334M 0s 2024-09-14T11:17:06.178 INFO:teuthology.orchestra.run.smithi050.stderr: 55800K .......... .......... .......... .......... .......... 60% 382M 0s 2024-09-14T11:17:06.178 INFO:teuthology.orchestra.run.smithi050.stderr: 55850K .......... .......... .......... .......... .......... 60% 245M 0s 2024-09-14T11:17:06.178 INFO:teuthology.orchestra.run.smithi050.stderr: 55900K .......... .......... .......... .......... .......... 60% 307M 0s 2024-09-14T11:17:06.178 INFO:teuthology.orchestra.run.smithi050.stderr: 55950K .......... .......... .......... .......... .......... 60% 374M 0s 2024-09-14T11:17:06.178 INFO:teuthology.orchestra.run.smithi050.stderr: 56000K .......... .......... .......... .......... .......... 60% 322M 0s 2024-09-14T11:17:06.178 INFO:teuthology.orchestra.run.smithi050.stderr: 56050K .......... .......... .......... .......... .......... 60% 316M 0s 2024-09-14T11:17:06.178 INFO:teuthology.orchestra.run.smithi050.stderr: 56100K .......... .......... .......... .......... .......... 60% 208M 0s 2024-09-14T11:17:06.178 INFO:teuthology.orchestra.run.smithi050.stderr: 56150K .......... .......... .......... .......... .......... 60% 309M 0s 2024-09-14T11:17:06.179 INFO:teuthology.orchestra.run.smithi050.stderr: 56200K .......... .......... .......... .......... .......... 60% 350M 0s 2024-09-14T11:17:06.179 INFO:teuthology.orchestra.run.smithi050.stderr: 56250K .......... .......... .......... .......... .......... 60% 376M 0s 2024-09-14T11:17:06.179 INFO:teuthology.orchestra.run.smithi050.stderr: 56300K .......... .......... .......... .......... .......... 60% 209M 0s 2024-09-14T11:17:06.179 INFO:teuthology.orchestra.run.smithi050.stderr: 56350K .......... .......... .......... .......... .......... 60% 221M 0s 2024-09-14T11:17:06.179 INFO:teuthology.orchestra.run.smithi050.stderr: 56400K .......... .......... .......... .......... .......... 60% 275M 0s 2024-09-14T11:17:06.179 INFO:teuthology.orchestra.run.smithi050.stderr: 56450K .......... .......... .......... .......... .......... 60% 158M 0s 2024-09-14T11:17:06.179 INFO:teuthology.orchestra.run.smithi050.stderr: 56500K .......... .......... .......... .......... .......... 60% 322M 0s 2024-09-14T11:17:06.179 INFO:teuthology.orchestra.run.smithi050.stderr: 56550K .......... .......... .......... .......... .......... 60% 187M 0s 2024-09-14T11:17:06.179 INFO:teuthology.orchestra.run.smithi050.stderr: 56600K .......... .......... .......... .......... .......... 60% 366M 0s 2024-09-14T11:17:06.179 INFO:teuthology.orchestra.run.smithi050.stderr: 56650K .......... .......... .......... .......... .......... 61% 359M 0s 2024-09-14T11:17:06.179 INFO:teuthology.orchestra.run.smithi050.stderr: 56700K .......... .......... .......... .......... .......... 61% 264M 0s 2024-09-14T11:17:06.179 INFO:teuthology.orchestra.run.smithi050.stderr: 56750K .......... .......... .......... .......... .......... 61% 355M 0s 2024-09-14T11:17:06.179 INFO:teuthology.orchestra.run.smithi050.stderr: 56800K .......... .......... .......... .......... .......... 61% 173M 0s 2024-09-14T11:17:06.179 INFO:teuthology.orchestra.run.smithi050.stderr: 56850K .......... .......... .......... .......... .......... 61% 265M 0s 2024-09-14T11:17:06.179 INFO:teuthology.orchestra.run.smithi050.stderr: 56900K .......... .......... .......... .......... .......... 61% 317M 0s 2024-09-14T11:17:06.179 INFO:teuthology.orchestra.run.smithi050.stderr: 56950K .......... .......... .......... .......... .......... 61% 359M 0s 2024-09-14T11:17:06.180 INFO:teuthology.orchestra.run.smithi050.stderr: 57000K .......... .......... .......... .......... .......... 61% 390M 0s 2024-09-14T11:17:06.180 INFO:teuthology.orchestra.run.smithi050.stderr: 57050K .......... .......... .......... .......... .......... 61% 166M 0s 2024-09-14T11:17:06.180 INFO:teuthology.orchestra.run.smithi050.stderr: 57100K .......... .......... .......... .......... .......... 61% 290M 0s 2024-09-14T11:17:06.180 INFO:teuthology.orchestra.run.smithi050.stderr: 57150K .......... .......... .......... .......... .......... 61% 190M 0s 2024-09-14T11:17:06.180 INFO:teuthology.orchestra.run.smithi050.stderr: 57200K .......... .......... .......... .......... .......... 61% 268M 0s 2024-09-14T11:17:06.180 INFO:teuthology.orchestra.run.smithi050.stderr: 57250K .......... .......... .......... .......... .......... 61% 353M 0s 2024-09-14T11:17:06.180 INFO:teuthology.orchestra.run.smithi050.stderr: 57300K .......... .......... .......... .......... .......... 61% 332M 0s 2024-09-14T11:17:06.180 INFO:teuthology.orchestra.run.smithi050.stderr: 57350K .......... .......... .......... .......... .......... 61% 132M 0s 2024-09-14T11:17:06.180 INFO:teuthology.orchestra.run.smithi050.stderr: 57400K .......... .......... .......... .......... .......... 61% 346M 0s 2024-09-14T11:17:06.180 INFO:teuthology.orchestra.run.smithi050.stderr: 57450K .......... .......... .......... .......... .......... 61% 368M 0s 2024-09-14T11:17:06.180 INFO:teuthology.orchestra.run.smithi050.stderr: 57500K .......... .......... .......... .......... .......... 61% 124M 0s 2024-09-14T11:17:06.180 INFO:teuthology.orchestra.run.smithi050.stderr: 57550K .......... .......... .......... .......... .......... 62% 208M 0s 2024-09-14T11:17:06.180 INFO:teuthology.orchestra.run.smithi050.stderr: 57600K .......... .......... .......... .......... .......... 62% 332M 0s 2024-09-14T11:17:06.180 INFO:teuthology.orchestra.run.smithi050.stderr: 57650K .......... .......... .......... .......... .......... 62% 210M 0s 2024-09-14T11:17:06.180 INFO:teuthology.orchestra.run.smithi050.stderr: 57700K .......... .......... .......... .......... .......... 62% 328M 0s 2024-09-14T11:17:06.181 INFO:teuthology.orchestra.run.smithi050.stderr: 57750K .......... .......... .......... .......... .......... 62% 363M 0s 2024-09-14T11:17:06.181 INFO:teuthology.orchestra.run.smithi050.stderr: 57800K .......... .......... .......... .......... .......... 62% 377M 0s 2024-09-14T11:17:06.181 INFO:teuthology.orchestra.run.smithi050.stderr: 57850K .......... .......... .......... .......... .......... 62% 252M 0s 2024-09-14T11:17:06.181 INFO:teuthology.orchestra.run.smithi050.stderr: 57900K .......... .......... .......... .......... .......... 62% 209M 0s 2024-09-14T11:17:06.181 INFO:teuthology.orchestra.run.smithi050.stderr: 57950K .......... .......... .......... .......... .......... 62% 366M 0s 2024-09-14T11:17:06.181 INFO:teuthology.orchestra.run.smithi050.stderr: 58000K .......... .......... .......... .......... .......... 62% 242M 0s 2024-09-14T11:17:06.181 INFO:teuthology.orchestra.run.smithi050.stderr: 58050K .......... .......... .......... .......... .......... 62% 114M 0s 2024-09-14T11:17:06.181 INFO:teuthology.orchestra.run.smithi050.stderr: 58100K .......... .......... .......... .......... .......... 62% 142M 0s 2024-09-14T11:17:06.181 INFO:teuthology.orchestra.run.smithi050.stderr: 58150K .......... .......... .......... .......... .......... 62% 234M 0s 2024-09-14T11:17:06.181 INFO:teuthology.orchestra.run.smithi050.stderr: 58200K .......... .......... .......... .......... .......... 62% 375M 0s 2024-09-14T11:17:06.181 INFO:teuthology.orchestra.run.smithi050.stderr: 58250K .......... .......... .......... .......... .......... 62% 145M 0s 2024-09-14T11:17:06.181 INFO:teuthology.orchestra.run.smithi050.stderr: 58300K .......... .......... .......... .......... .......... 62% 42.1M 0s 2024-09-14T11:17:06.181 INFO:teuthology.orchestra.run.smithi050.stderr: 58350K .......... .......... .......... .......... .......... 62% 304M 0s 2024-09-14T11:17:06.181 INFO:teuthology.orchestra.run.smithi050.stderr: 58400K .......... .......... .......... .......... .......... 62% 321M 0s 2024-09-14T11:17:06.181 INFO:teuthology.orchestra.run.smithi050.stderr: 58450K .......... .......... .......... .......... .......... 62% 383M 0s 2024-09-14T11:17:06.181 INFO:teuthology.orchestra.run.smithi050.stderr: 58500K .......... .......... .......... .......... .......... 63% 346M 0s 2024-09-14T11:17:06.182 INFO:teuthology.orchestra.run.smithi050.stderr: 58550K .......... .......... .......... .......... .......... 63% 120M 0s 2024-09-14T11:17:06.182 INFO:teuthology.orchestra.run.smithi050.stderr: 58600K .......... .......... .......... .......... .......... 63% 280M 0s 2024-09-14T11:17:06.182 INFO:teuthology.orchestra.run.smithi050.stderr: 58650K .......... .......... .......... .......... .......... 63% 360M 0s 2024-09-14T11:17:06.182 INFO:teuthology.orchestra.run.smithi050.stderr: 58700K .......... .......... .......... .......... .......... 63% 309M 0s 2024-09-14T11:17:06.182 INFO:teuthology.orchestra.run.smithi050.stderr: 58750K .......... .......... .......... .......... .......... 63% 341M 0s 2024-09-14T11:17:06.182 INFO:teuthology.orchestra.run.smithi050.stderr: 58800K .......... .......... .......... .......... .......... 63% 376M 0s 2024-09-14T11:17:06.182 INFO:teuthology.orchestra.run.smithi050.stderr: 58850K .......... .......... .......... .......... .......... 63% 368M 0s 2024-09-14T11:17:06.182 INFO:teuthology.orchestra.run.smithi050.stderr: 58900K .......... .......... .......... .......... .......... 63% 312M 0s 2024-09-14T11:17:06.182 INFO:teuthology.orchestra.run.smithi050.stderr: 58950K .......... .......... .......... .......... .......... 63% 362M 0s 2024-09-14T11:17:06.182 INFO:teuthology.orchestra.run.smithi050.stderr: 59000K .......... .......... .......... .......... .......... 63% 373M 0s 2024-09-14T11:17:06.182 INFO:teuthology.orchestra.run.smithi050.stderr: 59050K .......... .......... .......... .......... .......... 63% 372M 0s 2024-09-14T11:17:06.182 INFO:teuthology.orchestra.run.smithi050.stderr: 59100K .......... .......... .......... .......... .......... 63% 320M 0s 2024-09-14T11:17:06.182 INFO:teuthology.orchestra.run.smithi050.stderr: 59150K .......... .......... .......... .......... .......... 63% 368M 0s 2024-09-14T11:17:06.182 INFO:teuthology.orchestra.run.smithi050.stderr: 59200K .......... .......... .......... .......... .......... 63% 383M 0s 2024-09-14T11:17:06.182 INFO:teuthology.orchestra.run.smithi050.stderr: 59250K .......... .......... .......... .......... .......... 63% 340M 0s 2024-09-14T11:17:06.183 INFO:teuthology.orchestra.run.smithi050.stderr: 59300K .......... .......... .......... .......... .......... 63% 326M 0s 2024-09-14T11:17:06.183 INFO:teuthology.orchestra.run.smithi050.stderr: 59350K .......... .......... .......... .......... .......... 63% 388M 0s 2024-09-14T11:17:06.183 INFO:teuthology.orchestra.run.smithi050.stderr: 59400K .......... .......... .......... .......... .......... 63% 158M 0s 2024-09-14T11:17:06.183 INFO:teuthology.orchestra.run.smithi050.stderr: 59450K .......... .......... .......... .......... .......... 64% 358M 0s 2024-09-14T11:17:06.183 INFO:teuthology.orchestra.run.smithi050.stderr: 59500K .......... .......... .......... .......... .......... 64% 309M 0s 2024-09-14T11:17:06.183 INFO:teuthology.orchestra.run.smithi050.stderr: 59550K .......... .......... .......... .......... .......... 64% 361M 0s 2024-09-14T11:17:06.183 INFO:teuthology.orchestra.run.smithi050.stderr: 59600K .......... .......... .......... .......... .......... 64% 110M 0s 2024-09-14T11:17:06.183 INFO:teuthology.orchestra.run.smithi050.stderr: 59650K .......... .......... .......... .......... .......... 64% 371M 0s 2024-09-14T11:17:06.183 INFO:teuthology.orchestra.run.smithi050.stderr: 59700K .......... .......... .......... .......... .......... 64% 337M 0s 2024-09-14T11:17:06.183 INFO:teuthology.orchestra.run.smithi050.stderr: 59750K .......... .......... .......... .......... .......... 64% 378M 0s 2024-09-14T11:17:06.183 INFO:teuthology.orchestra.run.smithi050.stderr: 59800K .......... .......... .......... .......... .......... 64% 360M 0s 2024-09-14T11:17:06.183 INFO:teuthology.orchestra.run.smithi050.stderr: 59850K .......... .......... .......... .......... .......... 64% 165M 0s 2024-09-14T11:17:06.183 INFO:teuthology.orchestra.run.smithi050.stderr: 59900K .......... .......... .......... .......... .......... 64% 113M 0s 2024-09-14T11:17:06.183 INFO:teuthology.orchestra.run.smithi050.stderr: 59950K .......... .......... .......... .......... .......... 64% 314M 0s 2024-09-14T11:17:06.184 INFO:teuthology.orchestra.run.smithi050.stderr: 60000K .......... .......... .......... .......... .......... 64% 281M 0s 2024-09-14T11:17:06.184 INFO:teuthology.orchestra.run.smithi050.stderr: 60050K .......... .......... .......... .......... .......... 64% 382M 0s 2024-09-14T11:17:06.184 INFO:teuthology.orchestra.run.smithi050.stderr: 60100K .......... .......... .......... .......... .......... 64% 309M 0s 2024-09-14T11:17:06.184 INFO:teuthology.orchestra.run.smithi050.stderr: 60150K .......... .......... .......... .......... .......... 64% 289M 0s 2024-09-14T11:17:06.184 INFO:teuthology.orchestra.run.smithi050.stderr: 60200K .......... .......... .......... .......... .......... 64% 271M 0s 2024-09-14T11:17:06.184 INFO:teuthology.orchestra.run.smithi050.stderr: 60250K .......... .......... .......... .......... .......... 64% 327M 0s 2024-09-14T11:17:06.184 INFO:teuthology.orchestra.run.smithi050.stderr: 60300K .......... .......... .......... .......... .......... 64% 286M 0s 2024-09-14T11:17:06.184 INFO:teuthology.orchestra.run.smithi050.stderr: 60350K .......... .......... .......... .......... .......... 65% 378M 0s 2024-09-14T11:17:06.184 INFO:teuthology.orchestra.run.smithi050.stderr: 60400K .......... .......... .......... .......... .......... 65% 375M 0s 2024-09-14T11:17:06.184 INFO:teuthology.orchestra.run.smithi050.stderr: 60450K .......... .......... .......... .......... .......... 65% 172M 0s 2024-09-14T11:17:06.184 INFO:teuthology.orchestra.run.smithi050.stderr: 60500K .......... .......... .......... .......... .......... 65% 335M 0s 2024-09-14T11:17:06.184 INFO:teuthology.orchestra.run.smithi050.stderr: 60550K .......... .......... .......... .......... .......... 65% 360M 0s 2024-09-14T11:17:06.184 INFO:teuthology.orchestra.run.smithi050.stderr: 60600K .......... .......... .......... .......... .......... 65% 134M 0s 2024-09-14T11:17:06.184 INFO:teuthology.orchestra.run.smithi050.stderr: 60650K .......... .......... .......... .......... .......... 65% 286M 0s 2024-09-14T11:17:06.184 INFO:teuthology.orchestra.run.smithi050.stderr: 60700K .......... .......... .......... .......... .......... 65% 310M 0s 2024-09-14T11:17:06.185 INFO:teuthology.orchestra.run.smithi050.stderr: 60750K .......... .......... .......... .......... .......... 65% 381M 0s 2024-09-14T11:17:06.185 INFO:teuthology.orchestra.run.smithi050.stderr: 60800K .......... .......... .......... .......... .......... 65% 257M 0s 2024-09-14T11:17:06.185 INFO:teuthology.orchestra.run.smithi050.stderr: 60850K .......... .......... .......... .......... .......... 65% 119M 0s 2024-09-14T11:17:06.185 INFO:teuthology.orchestra.run.smithi050.stderr: 60900K .......... .......... .......... .......... .......... 65% 335M 0s 2024-09-14T11:17:06.185 INFO:teuthology.orchestra.run.smithi050.stderr: 60950K .......... .......... .......... .......... .......... 65% 388M 0s 2024-09-14T11:17:06.185 INFO:teuthology.orchestra.run.smithi050.stderr: 61000K .......... .......... .......... .......... .......... 65% 370M 0s 2024-09-14T11:17:06.185 INFO:teuthology.orchestra.run.smithi050.stderr: 61050K .......... .......... .......... .......... .......... 65% 368M 0s 2024-09-14T11:17:06.185 INFO:teuthology.orchestra.run.smithi050.stderr: 61100K .......... .......... .......... .......... .......... 65% 154M 0s 2024-09-14T11:17:06.185 INFO:teuthology.orchestra.run.smithi050.stderr: 61150K .......... .......... .......... .......... .......... 65% 121M 0s 2024-09-14T11:17:06.185 INFO:teuthology.orchestra.run.smithi050.stderr: 61200K .......... .......... .......... .......... .......... 65% 364M 0s 2024-09-14T11:17:06.185 INFO:teuthology.orchestra.run.smithi050.stderr: 61250K .......... .......... .......... .......... .......... 65% 93.4M 0s 2024-09-14T11:17:06.185 INFO:teuthology.orchestra.run.smithi050.stderr: 61300K .......... .......... .......... .......... .......... 66% 335M 0s 2024-09-14T11:17:06.186 INFO:teuthology.orchestra.run.smithi050.stderr: 61350K .......... .......... .......... .......... .......... 66% 44.1M 0s 2024-09-14T11:17:06.186 INFO:teuthology.orchestra.run.smithi050.stderr: 61400K .......... .......... .......... .......... .......... 66% 272M 0s 2024-09-14T11:17:06.186 INFO:teuthology.orchestra.run.smithi050.stderr: 61450K .......... .......... .......... .......... .......... 66% 370M 0s 2024-09-14T11:17:06.186 INFO:teuthology.orchestra.run.smithi050.stderr: 61500K .......... .......... .......... .......... .......... 66% 58.5M 0s 2024-09-14T11:17:06.186 INFO:teuthology.orchestra.run.smithi050.stderr: 61550K .......... .......... .......... .......... .......... 66% 303M 0s 2024-09-14T11:17:06.186 INFO:teuthology.orchestra.run.smithi050.stderr: 61600K .......... .......... .......... .......... .......... 66% 334M 0s 2024-09-14T11:17:06.186 INFO:teuthology.orchestra.run.smithi050.stderr: 61650K .......... .......... .......... .......... .......... 66% 312M 0s 2024-09-14T11:17:06.186 INFO:teuthology.orchestra.run.smithi050.stderr: 61700K .......... .......... .......... .......... .......... 66% 343M 0s 2024-09-14T11:17:06.186 INFO:teuthology.orchestra.run.smithi050.stderr: 61750K .......... .......... .......... .......... .......... 66% 273M 0s 2024-09-14T11:17:06.186 INFO:teuthology.orchestra.run.smithi050.stderr: 61800K .......... .......... .......... .......... .......... 66% 369M 0s 2024-09-14T11:17:06.186 INFO:teuthology.orchestra.run.smithi050.stderr: 61850K .......... .......... .......... .......... .......... 66% 347M 0s 2024-09-14T11:17:06.186 INFO:teuthology.orchestra.run.smithi050.stderr: 61900K .......... .......... .......... .......... .......... 66% 287M 0s 2024-09-14T11:17:06.186 INFO:teuthology.orchestra.run.smithi050.stderr: 61950K .......... .......... .......... .......... .......... 66% 263M 0s 2024-09-14T11:17:06.186 INFO:teuthology.orchestra.run.smithi050.stderr: 62000K .......... .......... .......... .......... .......... 66% 374M 0s 2024-09-14T11:17:06.186 INFO:teuthology.orchestra.run.smithi050.stderr: 62050K .......... .......... .......... .......... .......... 66% 383M 0s 2024-09-14T11:17:06.186 INFO:teuthology.orchestra.run.smithi050.stderr: 62100K .......... .......... .......... .......... .......... 66% 378M 0s 2024-09-14T11:17:06.186 INFO:teuthology.orchestra.run.smithi050.stderr: 62150K .......... .......... .......... .......... .......... 66% 345M 0s 2024-09-14T11:17:06.187 INFO:teuthology.orchestra.run.smithi050.stderr: 62200K .......... .......... .......... .......... .......... 67% 386M 0s 2024-09-14T11:17:06.187 INFO:teuthology.orchestra.run.smithi050.stderr: 62250K .......... .......... .......... .......... .......... 67% 370M 0s 2024-09-14T11:17:06.187 INFO:teuthology.orchestra.run.smithi050.stderr: 62300K .......... .......... .......... .......... .......... 67% 383M 0s 2024-09-14T11:17:06.187 INFO:teuthology.orchestra.run.smithi050.stderr: 62350K .......... .......... .......... .......... .......... 67% 297M 0s 2024-09-14T11:17:06.187 INFO:teuthology.orchestra.run.smithi050.stderr: 62400K .......... .......... .......... .......... .......... 67% 375M 0s 2024-09-14T11:17:06.187 INFO:teuthology.orchestra.run.smithi050.stderr: 62450K .......... .......... .......... .......... .......... 67% 378M 0s 2024-09-14T11:17:06.187 INFO:teuthology.orchestra.run.smithi050.stderr: 62500K .......... .......... .......... .......... .......... 67% 391M 0s 2024-09-14T11:17:06.187 INFO:teuthology.orchestra.run.smithi050.stderr: 62550K .......... .......... .......... .......... .......... 67% 334M 0s 2024-09-14T11:17:06.187 INFO:teuthology.orchestra.run.smithi050.stderr: 62600K .......... .......... .......... .......... .......... 67% 379M 0s 2024-09-14T11:17:06.187 INFO:teuthology.orchestra.run.smithi050.stderr: 62650K .......... .......... .......... .......... .......... 67% 376M 0s 2024-09-14T11:17:06.187 INFO:teuthology.orchestra.run.smithi050.stderr: 62700K .......... .......... .......... .......... .......... 67% 151M 0s 2024-09-14T11:17:06.187 INFO:teuthology.orchestra.run.smithi050.stderr: 62750K .......... .......... .......... .......... .......... 67% 261M 0s 2024-09-14T11:17:06.187 INFO:teuthology.orchestra.run.smithi050.stderr: 62800K .......... .......... .......... .......... .......... 67% 377M 0s 2024-09-14T11:17:06.187 INFO:teuthology.orchestra.run.smithi050.stderr: 62850K .......... .......... .......... .......... .......... 67% 361M 0s 2024-09-14T11:17:06.187 INFO:teuthology.orchestra.run.smithi050.stderr: 62900K .......... .......... .......... .......... .......... 67% 382M 0s 2024-09-14T11:17:06.188 INFO:teuthology.orchestra.run.smithi050.stderr: 62950K .......... .......... .......... .......... .......... 67% 150M 0s 2024-09-14T11:17:06.188 INFO:teuthology.orchestra.run.smithi050.stderr: 63000K .......... .......... .......... .......... .......... 67% 372M 0s 2024-09-14T11:17:06.188 INFO:teuthology.orchestra.run.smithi050.stderr: 63050K .......... .......... .......... .......... .......... 67% 382M 0s 2024-09-14T11:17:06.188 INFO:teuthology.orchestra.run.smithi050.stderr: 63100K .......... .......... .......... .......... .......... 67% 345M 0s 2024-09-14T11:17:06.188 INFO:teuthology.orchestra.run.smithi050.stderr: 63150K .......... .......... .......... .......... .......... 68% 131M 0s 2024-09-14T11:17:06.188 INFO:teuthology.orchestra.run.smithi050.stderr: 63200K .......... .......... .......... .......... .......... 68% 367M 0s 2024-09-14T11:17:06.188 INFO:teuthology.orchestra.run.smithi050.stderr: 63250K .......... .......... .......... .......... .......... 68% 312M 0s 2024-09-14T11:17:06.188 INFO:teuthology.orchestra.run.smithi050.stderr: 63300K .......... .......... .......... .......... .......... 68% 400M 0s 2024-09-14T11:17:06.188 INFO:teuthology.orchestra.run.smithi050.stderr: 63350K .......... .......... .......... .......... .......... 68% 302M 0s 2024-09-14T11:17:06.188 INFO:teuthology.orchestra.run.smithi050.stderr: 63400K .......... .......... .......... .......... .......... 68% 372M 0s 2024-09-14T11:17:06.188 INFO:teuthology.orchestra.run.smithi050.stderr: 63450K .......... .......... .......... .......... .......... 68% 229M 0s 2024-09-14T11:17:06.188 INFO:teuthology.orchestra.run.smithi050.stderr: 63500K .......... .......... .......... .......... .......... 68% 373M 0s 2024-09-14T11:17:06.188 INFO:teuthology.orchestra.run.smithi050.stderr: 63550K .......... .......... .......... .......... .......... 68% 358M 0s 2024-09-14T11:17:06.188 INFO:teuthology.orchestra.run.smithi050.stderr: 63600K .......... .......... .......... .......... .......... 68% 383M 0s 2024-09-14T11:17:06.188 INFO:teuthology.orchestra.run.smithi050.stderr: 63650K .......... .......... .......... .......... .......... 68% 136M 0s 2024-09-14T11:17:06.188 INFO:teuthology.orchestra.run.smithi050.stderr: 63700K .......... .......... .......... .......... .......... 68% 310M 0s 2024-09-14T11:17:06.189 INFO:teuthology.orchestra.run.smithi050.stderr: 63750K .......... .......... .......... .......... .......... 68% 367M 0s 2024-09-14T11:17:06.189 INFO:teuthology.orchestra.run.smithi050.stderr: 63800K .......... .......... .......... .......... .......... 68% 352M 0s 2024-09-14T11:17:06.189 INFO:teuthology.orchestra.run.smithi050.stderr: 63850K .......... .......... .......... .......... .......... 68% 176M 0s 2024-09-14T11:17:06.189 INFO:teuthology.orchestra.run.smithi050.stderr: 63900K .......... .......... .......... .......... .......... 68% 145M 0s 2024-09-14T11:17:06.189 INFO:teuthology.orchestra.run.smithi050.stderr: 63950K .......... .......... .......... .......... .......... 68% 219M 0s 2024-09-14T11:17:06.189 INFO:teuthology.orchestra.run.smithi050.stderr: 64000K .......... .......... .......... .......... .......... 68% 340M 0s 2024-09-14T11:17:06.189 INFO:teuthology.orchestra.run.smithi050.stderr: 64050K .......... .......... .......... .......... .......... 68% 365M 0s 2024-09-14T11:17:06.189 INFO:teuthology.orchestra.run.smithi050.stderr: 64100K .......... .......... .......... .......... .......... 69% 386M 0s 2024-09-14T11:17:06.189 INFO:teuthology.orchestra.run.smithi050.stderr: 64150K .......... .......... .......... .......... .......... 69% 306M 0s 2024-09-14T11:17:06.189 INFO:teuthology.orchestra.run.smithi050.stderr: 64200K .......... .......... .......... .......... .......... 69% 143M 0s 2024-09-14T11:17:06.189 INFO:teuthology.orchestra.run.smithi050.stderr: 64250K .......... .......... .......... .......... .......... 69% 276M 0s 2024-09-14T11:17:06.189 INFO:teuthology.orchestra.run.smithi050.stderr: 64300K .......... .......... .......... .......... .......... 69% 62.6M 0s 2024-09-14T11:17:06.189 INFO:teuthology.orchestra.run.smithi050.stderr: 64350K .......... .......... .......... .......... .......... 69% 48.3M 0s 2024-09-14T11:17:06.189 INFO:teuthology.orchestra.run.smithi050.stderr: 64400K .......... .......... .......... .......... .......... 69% 369M 0s 2024-09-14T11:17:06.190 INFO:teuthology.orchestra.run.smithi050.stderr: 64450K .......... .......... .......... .......... .......... 69% 360M 0s 2024-09-14T11:17:06.190 INFO:teuthology.orchestra.run.smithi050.stderr: 64500K .......... .......... .......... .......... .......... 69% 167M 0s 2024-09-14T11:17:06.190 INFO:teuthology.orchestra.run.smithi050.stderr: 64550K .......... .......... .......... .......... .......... 69% 128M 0s 2024-09-14T11:17:06.190 INFO:teuthology.orchestra.run.smithi050.stderr: 64600K .......... .......... .......... .......... .......... 69% 109M 0s 2024-09-14T11:17:06.190 INFO:teuthology.orchestra.run.smithi050.stderr: 64650K .......... .......... .......... .......... .......... 69% 259M 0s 2024-09-14T11:17:06.190 INFO:teuthology.orchestra.run.smithi050.stderr: 64700K .......... .......... .......... .......... .......... 69% 365M 0s 2024-09-14T11:17:06.190 INFO:teuthology.orchestra.run.smithi050.stderr: 64750K .......... .......... .......... .......... .......... 69% 315M 0s 2024-09-14T11:17:06.190 INFO:teuthology.orchestra.run.smithi050.stderr: 64800K .......... .......... .......... .......... .......... 69% 376M 0s 2024-09-14T11:17:06.190 INFO:teuthology.orchestra.run.smithi050.stderr: 64850K .......... .......... .......... .......... .......... 69% 164M 0s 2024-09-14T11:17:06.190 INFO:teuthology.orchestra.run.smithi050.stderr: 64900K .......... .......... .......... .......... .......... 69% 290M 0s 2024-09-14T11:17:06.190 INFO:teuthology.orchestra.run.smithi050.stderr: 64950K .......... .......... .......... .......... .......... 69% 266M 0s 2024-09-14T11:17:06.190 INFO:teuthology.orchestra.run.smithi050.stderr: 65000K .......... .......... .......... .......... .......... 70% 351M 0s 2024-09-14T11:17:06.190 INFO:teuthology.orchestra.run.smithi050.stderr: 65050K .......... .......... .......... .......... .......... 70% 317M 0s 2024-09-14T11:17:06.190 INFO:teuthology.orchestra.run.smithi050.stderr: 65100K .......... .......... .......... .......... .......... 70% 332M 0s 2024-09-14T11:17:06.190 INFO:teuthology.orchestra.run.smithi050.stderr: 65150K .......... .......... .......... .......... .......... 70% 347M 0s 2024-09-14T11:17:06.190 INFO:teuthology.orchestra.run.smithi050.stderr: 65200K .......... .......... .......... .......... .......... 70% 349M 0s 2024-09-14T11:17:06.191 INFO:teuthology.orchestra.run.smithi050.stderr: 65250K .......... .......... .......... .......... .......... 70% 368M 0s 2024-09-14T11:17:06.191 INFO:teuthology.orchestra.run.smithi050.stderr: 65300K .......... .......... .......... .......... .......... 70% 373M 0s 2024-09-14T11:17:06.191 INFO:teuthology.orchestra.run.smithi050.stderr: 65350K .......... .......... .......... .......... .......... 70% 327M 0s 2024-09-14T11:17:06.191 INFO:teuthology.orchestra.run.smithi050.stderr: 65400K .......... .......... .......... .......... .......... 70% 395M 0s 2024-09-14T11:17:06.191 INFO:teuthology.orchestra.run.smithi050.stderr: 65450K .......... .......... .......... .......... .......... 70% 281M 0s 2024-09-14T11:17:06.191 INFO:teuthology.orchestra.run.smithi050.stderr: 65500K .......... .......... .......... .......... .......... 70% 344M 0s 2024-09-14T11:17:06.191 INFO:teuthology.orchestra.run.smithi050.stderr: 65550K .......... .......... .......... .......... .......... 70% 289M 0s 2024-09-14T11:17:06.191 INFO:teuthology.orchestra.run.smithi050.stderr: 65600K .......... .......... .......... .......... .......... 70% 378M 0s 2024-09-14T11:17:06.191 INFO:teuthology.orchestra.run.smithi050.stderr: 65650K .......... .......... .......... .......... .......... 70% 395M 0s 2024-09-14T11:17:06.191 INFO:teuthology.orchestra.run.smithi050.stderr: 65700K .......... .......... .......... .......... .......... 70% 222M 0s 2024-09-14T11:17:06.191 INFO:teuthology.orchestra.run.smithi050.stderr: 65750K .......... .......... .......... .......... .......... 70% 311M 0s 2024-09-14T11:17:06.191 INFO:teuthology.orchestra.run.smithi050.stderr: 65800K .......... .......... .......... .......... .......... 70% 367M 0s 2024-09-14T11:17:06.191 INFO:teuthology.orchestra.run.smithi050.stderr: 65850K .......... .......... .......... .......... .......... 70% 353M 0s 2024-09-14T11:17:06.191 INFO:teuthology.orchestra.run.smithi050.stderr: 65900K .......... .......... .......... .......... .......... 70% 387M 0s 2024-09-14T11:17:06.192 INFO:teuthology.orchestra.run.smithi050.stderr: 65950K .......... .......... .......... .......... .......... 71% 214M 0s 2024-09-14T11:17:06.192 INFO:teuthology.orchestra.run.smithi050.stderr: 66000K .......... .......... .......... .......... .......... 71% 377M 0s 2024-09-14T11:17:06.192 INFO:teuthology.orchestra.run.smithi050.stderr: 66050K .......... .......... .......... .......... .......... 71% 388M 0s 2024-09-14T11:17:06.192 INFO:teuthology.orchestra.run.smithi050.stderr: 66100K .......... .......... .......... .......... .......... 71% 373M 0s 2024-09-14T11:17:06.192 INFO:teuthology.orchestra.run.smithi050.stderr: 66150K .......... .......... .......... .......... .......... 71% 318M 0s 2024-09-14T11:17:06.192 INFO:teuthology.orchestra.run.smithi050.stderr: 66200K .......... .......... .......... .......... .......... 71% 181M 0s 2024-09-14T11:17:06.192 INFO:teuthology.orchestra.run.smithi050.stderr: 66250K .......... .......... .......... .......... .......... 71% 219M 0s 2024-09-14T11:17:06.192 INFO:teuthology.orchestra.run.smithi050.stderr: 66300K .......... .......... .......... .......... .......... 71% 192M 0s 2024-09-14T11:17:06.192 INFO:teuthology.orchestra.run.smithi050.stderr: 66350K .......... .......... .......... .......... .......... 71% 311M 0s 2024-09-14T11:17:06.192 INFO:teuthology.orchestra.run.smithi050.stderr: 66400K .......... .......... .......... .......... .......... 71% 182M 0s 2024-09-14T11:17:06.192 INFO:teuthology.orchestra.run.smithi050.stderr: 66450K .......... .......... .......... .......... .......... 71% 334M 0s 2024-09-14T11:17:06.192 INFO:teuthology.orchestra.run.smithi050.stderr: 66500K .......... .......... .......... .......... .......... 71% 289M 0s 2024-09-14T11:17:06.192 INFO:teuthology.orchestra.run.smithi050.stderr: 66550K .......... .......... .......... .......... .......... 71% 299M 0s 2024-09-14T11:17:06.192 INFO:teuthology.orchestra.run.smithi050.stderr: 66600K .......... .......... .......... .......... .......... 71% 401M 0s 2024-09-14T11:17:06.192 INFO:teuthology.orchestra.run.smithi050.stderr: 66650K .......... .......... .......... .......... .......... 71% 287M 0s 2024-09-14T11:17:06.192 INFO:teuthology.orchestra.run.smithi050.stderr: 66700K .......... .......... .......... .......... .......... 71% 282M 0s 2024-09-14T11:17:06.193 INFO:teuthology.orchestra.run.smithi050.stderr: 66750K .......... .......... .......... .......... .......... 71% 281M 0s 2024-09-14T11:17:06.193 INFO:teuthology.orchestra.run.smithi050.stderr: 66800K .......... .......... .......... .......... .......... 71% 362M 0s 2024-09-14T11:17:06.193 INFO:teuthology.orchestra.run.smithi050.stderr: 66850K .......... .......... .......... .......... .......... 72% 376M 0s 2024-09-14T11:17:06.193 INFO:teuthology.orchestra.run.smithi050.stderr: 66900K .......... .......... .......... .......... .......... 72% 393M 0s 2024-09-14T11:17:06.193 INFO:teuthology.orchestra.run.smithi050.stderr: 66950K .......... .......... .......... .......... .......... 72% 132M 0s 2024-09-14T11:17:06.193 INFO:teuthology.orchestra.run.smithi050.stderr: 67000K .......... .......... .......... .......... .......... 72% 214M 0s 2024-09-14T11:17:06.193 INFO:teuthology.orchestra.run.smithi050.stderr: 67050K .......... .......... .......... .......... .......... 72% 353M 0s 2024-09-14T11:17:06.193 INFO:teuthology.orchestra.run.smithi050.stderr: 67100K .......... .......... .......... .......... .......... 72% 381M 0s 2024-09-14T11:17:06.193 INFO:teuthology.orchestra.run.smithi050.stderr: 67150K .......... .......... .......... .......... .......... 72% 217M 0s 2024-09-14T11:17:06.193 INFO:teuthology.orchestra.run.smithi050.stderr: 67200K .......... .......... .......... .......... .......... 72% 267M 0s 2024-09-14T11:17:06.193 INFO:teuthology.orchestra.run.smithi050.stderr: 67250K .......... .......... .......... .......... .......... 72% 358M 0s 2024-09-14T11:17:06.193 INFO:teuthology.orchestra.run.smithi050.stderr: 67300K .......... .......... .......... .......... .......... 72% 371M 0s 2024-09-14T11:17:06.193 INFO:teuthology.orchestra.run.smithi050.stderr: 67350K .......... .......... .......... .......... .......... 72% 58.9M 0s 2024-09-14T11:17:06.193 INFO:teuthology.orchestra.run.smithi050.stderr: 67400K .......... .......... .......... .......... .......... 72% 46.5M 0s 2024-09-14T11:17:06.193 INFO:teuthology.orchestra.run.smithi050.stderr: 67450K .......... .......... .......... .......... .......... 72% 175M 0s 2024-09-14T11:17:06.194 INFO:teuthology.orchestra.run.smithi050.stderr: 67500K .......... .......... .......... .......... .......... 72% 371M 0s 2024-09-14T11:17:06.194 INFO:teuthology.orchestra.run.smithi050.stderr: 67550K .......... .......... .......... .......... .......... 72% 332M 0s 2024-09-14T11:17:06.194 INFO:teuthology.orchestra.run.smithi050.stderr: 67600K .......... .......... .......... .......... .......... 72% 162M 0s 2024-09-14T11:17:06.194 INFO:teuthology.orchestra.run.smithi050.stderr: 67650K .......... .......... .......... .......... .......... 72% 116M 0s 2024-09-14T11:17:06.194 INFO:teuthology.orchestra.run.smithi050.stderr: 67700K .......... .......... .......... .......... .......... 72% 318M 0s 2024-09-14T11:17:06.194 INFO:teuthology.orchestra.run.smithi050.stderr: 67750K .......... .......... .......... .......... .......... 72% 199M 0s 2024-09-14T11:17:06.194 INFO:teuthology.orchestra.run.smithi050.stderr: 67800K .......... .......... .......... .......... .......... 73% 131M 0s 2024-09-14T11:17:06.194 INFO:teuthology.orchestra.run.smithi050.stderr: 67850K .......... .......... .......... .......... .......... 73% 341M 0s 2024-09-14T11:17:06.194 INFO:teuthology.orchestra.run.smithi050.stderr: 67900K .......... .......... .......... .......... .......... 73% 252M 0s 2024-09-14T11:17:06.194 INFO:teuthology.orchestra.run.smithi050.stderr: 67950K .......... .......... .......... .......... .......... 73% 257M 0s 2024-09-14T11:17:06.194 INFO:teuthology.orchestra.run.smithi050.stderr: 68000K .......... .......... .......... .......... .......... 73% 347M 0s 2024-09-14T11:17:06.194 INFO:teuthology.orchestra.run.smithi050.stderr: 68050K .......... .......... .......... .......... .......... 73% 381M 0s 2024-09-14T11:17:06.194 INFO:teuthology.orchestra.run.smithi050.stderr: 68100K .......... .......... .......... .......... .......... 73% 218M 0s 2024-09-14T11:17:06.194 INFO:teuthology.orchestra.run.smithi050.stderr: 68150K .......... .......... .......... .......... .......... 73% 187M 0s 2024-09-14T11:17:06.194 INFO:teuthology.orchestra.run.smithi050.stderr: 68200K .......... .......... .......... .......... .......... 73% 368M 0s 2024-09-14T11:17:06.194 INFO:teuthology.orchestra.run.smithi050.stderr: 68250K .......... .......... .......... .......... .......... 73% 378M 0s 2024-09-14T11:17:06.195 INFO:teuthology.orchestra.run.smithi050.stderr: 68300K .......... .......... .......... .......... .......... 73% 350M 0s 2024-09-14T11:17:06.195 INFO:teuthology.orchestra.run.smithi050.stderr: 68350K .......... .......... .......... .......... .......... 73% 317M 0s 2024-09-14T11:17:06.195 INFO:teuthology.orchestra.run.smithi050.stderr: 68400K .......... .......... .......... .......... .......... 73% 355M 0s 2024-09-14T11:17:06.195 INFO:teuthology.orchestra.run.smithi050.stderr: 68450K .......... .......... .......... .......... .......... 73% 374M 0s 2024-09-14T11:17:06.195 INFO:teuthology.orchestra.run.smithi050.stderr: 68500K .......... .......... .......... .......... .......... 73% 388M 0s 2024-09-14T11:17:06.195 INFO:teuthology.orchestra.run.smithi050.stderr: 68550K .......... .......... .......... .......... .......... 73% 187M 0s 2024-09-14T11:17:06.195 INFO:teuthology.orchestra.run.smithi050.stderr: 68600K .......... .......... .......... .......... .......... 73% 363M 0s 2024-09-14T11:17:06.195 INFO:teuthology.orchestra.run.smithi050.stderr: 68650K .......... .......... .......... .......... .......... 73% 383M 0s 2024-09-14T11:17:06.195 INFO:teuthology.orchestra.run.smithi050.stderr: 68700K .......... .......... .......... .......... .......... 74% 342M 0s 2024-09-14T11:17:06.195 INFO:teuthology.orchestra.run.smithi050.stderr: 68750K .......... .......... .......... .......... .......... 74% 284M 0s 2024-09-14T11:17:06.195 INFO:teuthology.orchestra.run.smithi050.stderr: 68800K .......... .......... .......... .......... .......... 74% 222M 0s 2024-09-14T11:17:06.195 INFO:teuthology.orchestra.run.smithi050.stderr: 68850K .......... .......... .......... .......... .......... 74% 367M 0s 2024-09-14T11:17:06.195 INFO:teuthology.orchestra.run.smithi050.stderr: 68900K .......... .......... .......... .......... .......... 74% 380M 0s 2024-09-14T11:17:06.195 INFO:teuthology.orchestra.run.smithi050.stderr: 68950K .......... .......... .......... .......... .......... 74% 349M 0s 2024-09-14T11:17:06.195 INFO:teuthology.orchestra.run.smithi050.stderr: 69000K .......... .......... .......... .......... .......... 74% 387M 0s 2024-09-14T11:17:06.196 INFO:teuthology.orchestra.run.smithi050.stderr: 69050K .......... .......... .......... .......... .......... 74% 347M 0s 2024-09-14T11:17:06.196 INFO:teuthology.orchestra.run.smithi050.stderr: 69100K .......... .......... .......... .......... .......... 74% 379M 0s 2024-09-14T11:17:06.196 INFO:teuthology.orchestra.run.smithi050.stderr: 69150K .......... .......... .......... .......... .......... 74% 324M 0s 2024-09-14T11:17:06.196 INFO:teuthology.orchestra.run.smithi050.stderr: 69200K .......... .......... .......... .......... .......... 74% 179M 0s 2024-09-14T11:17:06.196 INFO:teuthology.orchestra.run.smithi050.stderr: 69250K .......... .......... .......... .......... .......... 74% 368M 0s 2024-09-14T11:17:06.196 INFO:teuthology.orchestra.run.smithi050.stderr: 69300K .......... .......... .......... .......... .......... 74% 374M 0s 2024-09-14T11:17:06.196 INFO:teuthology.orchestra.run.smithi050.stderr: 69350K .......... .......... .......... .......... .......... 74% 338M 0s 2024-09-14T11:17:06.196 INFO:teuthology.orchestra.run.smithi050.stderr: 69400K .......... .......... .......... .......... .......... 74% 118M 0s 2024-09-14T11:17:06.196 INFO:teuthology.orchestra.run.smithi050.stderr: 69450K .......... .......... .......... .......... .......... 74% 345M 0s 2024-09-14T11:17:06.196 INFO:teuthology.orchestra.run.smithi050.stderr: 69500K .......... .......... .......... .......... .......... 74% 328M 0s 2024-09-14T11:17:06.196 INFO:teuthology.orchestra.run.smithi050.stderr: 69550K .......... .......... .......... .......... .......... 74% 302M 0s 2024-09-14T11:17:06.196 INFO:teuthology.orchestra.run.smithi050.stderr: 69600K .......... .......... .......... .......... .......... 74% 387M 0s 2024-09-14T11:17:06.196 INFO:teuthology.orchestra.run.smithi050.stderr: 69650K .......... .......... .......... .......... .......... 75% 219M 0s 2024-09-14T11:17:06.196 INFO:teuthology.orchestra.run.smithi050.stderr: 69700K .......... .......... .......... .......... .......... 75% 377M 0s 2024-09-14T11:17:06.196 INFO:teuthology.orchestra.run.smithi050.stderr: 69750K .......... .......... .......... .......... .......... 75% 342M 0s 2024-09-14T11:17:06.197 INFO:teuthology.orchestra.run.smithi050.stderr: 69800K .......... .......... .......... .......... .......... 75% 387M 0s 2024-09-14T11:17:06.197 INFO:teuthology.orchestra.run.smithi050.stderr: 69850K .......... .......... .......... .......... .......... 75% 264M 0s 2024-09-14T11:17:06.197 INFO:teuthology.orchestra.run.smithi050.stderr: 69900K .......... .......... .......... .......... .......... 75% 373M 0s 2024-09-14T11:17:06.197 INFO:teuthology.orchestra.run.smithi050.stderr: 69950K .......... .......... .......... .......... .......... 75% 305M 0s 2024-09-14T11:17:06.197 INFO:teuthology.orchestra.run.smithi050.stderr: 70000K .......... .......... .......... .......... .......... 75% 155M 0s 2024-09-14T11:17:06.197 INFO:teuthology.orchestra.run.smithi050.stderr: 70050K .......... .......... .......... .......... .......... 75% 322M 0s 2024-09-14T11:17:06.197 INFO:teuthology.orchestra.run.smithi050.stderr: 70100K .......... .......... .......... .......... .......... 75% 382M 0s 2024-09-14T11:17:06.197 INFO:teuthology.orchestra.run.smithi050.stderr: 70150K .......... .......... .......... .......... .......... 75% 185M 0s 2024-09-14T11:17:06.197 INFO:teuthology.orchestra.run.smithi050.stderr: 70200K .......... .......... .......... .......... .......... 75% 343M 0s 2024-09-14T11:17:06.197 INFO:teuthology.orchestra.run.smithi050.stderr: 70250K .......... .......... .......... .......... .......... 75% 383M 0s 2024-09-14T11:17:06.197 INFO:teuthology.orchestra.run.smithi050.stderr: 70300K .......... .......... .......... .......... .......... 75% 383M 0s 2024-09-14T11:17:06.197 INFO:teuthology.orchestra.run.smithi050.stderr: 70350K .......... .......... .......... .......... .......... 75% 284M 0s 2024-09-14T11:17:06.197 INFO:teuthology.orchestra.run.smithi050.stderr: 70400K .......... .......... .......... .......... .......... 75% 56.4M 0s 2024-09-14T11:17:06.197 INFO:teuthology.orchestra.run.smithi050.stderr: 70450K .......... .......... .......... .......... .......... 75% 54.6M 0s 2024-09-14T11:17:06.198 INFO:teuthology.orchestra.run.smithi050.stderr: 70500K .......... .......... .......... .......... .......... 75% 79.7M 0s 2024-09-14T11:17:06.198 INFO:teuthology.orchestra.run.smithi050.stderr: 70550K .......... .......... .......... .......... .......... 75% 262M 0s 2024-09-14T11:17:06.198 INFO:teuthology.orchestra.run.smithi050.stderr: 70600K .......... .......... .......... .......... .......... 76% 355M 0s 2024-09-14T11:17:06.198 INFO:teuthology.orchestra.run.smithi050.stderr: 70650K .......... .......... .......... .......... .......... 76% 365M 0s 2024-09-14T11:17:06.198 INFO:teuthology.orchestra.run.smithi050.stderr: 70700K .......... .......... .......... .......... .......... 76% 292M 0s 2024-09-14T11:17:06.198 INFO:teuthology.orchestra.run.smithi050.stderr: 70750K .......... .......... .......... .......... .......... 76% 134M 0s 2024-09-14T11:17:06.198 INFO:teuthology.orchestra.run.smithi050.stderr: 70800K .......... .......... .......... .......... .......... 76% 267M 0s 2024-09-14T11:17:06.198 INFO:teuthology.orchestra.run.smithi050.stderr: 70850K .......... .......... .......... .......... .......... 76% 160M 0s 2024-09-14T11:17:06.198 INFO:teuthology.orchestra.run.smithi050.stderr: 70900K .......... .......... .......... .......... .......... 76% 148M 0s 2024-09-14T11:17:06.198 INFO:teuthology.orchestra.run.smithi050.stderr: 70950K .......... .......... .......... .......... .......... 76% 211M 0s 2024-09-14T11:17:06.198 INFO:teuthology.orchestra.run.smithi050.stderr: 71000K .......... .......... .......... .......... .......... 76% 339M 0s 2024-09-14T11:17:06.198 INFO:teuthology.orchestra.run.smithi050.stderr: 71050K .......... .......... .......... .......... .......... 76% 358M 0s 2024-09-14T11:17:06.198 INFO:teuthology.orchestra.run.smithi050.stderr: 71100K .......... .......... .......... .......... .......... 76% 375M 0s 2024-09-14T11:17:06.198 INFO:teuthology.orchestra.run.smithi050.stderr: 71150K .......... .......... .......... .......... .......... 76% 309M 0s 2024-09-14T11:17:06.199 INFO:teuthology.orchestra.run.smithi050.stderr: 71200K .......... .......... .......... .......... .......... 76% 383M 0s 2024-09-14T11:17:06.199 INFO:teuthology.orchestra.run.smithi050.stderr: 71250K .......... .......... .......... .......... .......... 76% 332M 0s 2024-09-14T11:17:06.199 INFO:teuthology.orchestra.run.smithi050.stderr: 71300K .......... .......... .......... .......... .......... 76% 102M 0s 2024-09-14T11:17:06.199 INFO:teuthology.orchestra.run.smithi050.stderr: 71350K .......... .......... .......... .......... .......... 76% 301M 0s 2024-09-14T11:17:06.199 INFO:teuthology.orchestra.run.smithi050.stderr: 71400K .......... .......... .......... .......... .......... 76% 324M 0s 2024-09-14T11:17:06.199 INFO:teuthology.orchestra.run.smithi050.stderr: 71450K .......... .......... .......... .......... .......... 76% 366M 0s 2024-09-14T11:17:06.199 INFO:teuthology.orchestra.run.smithi050.stderr: 71500K .......... .......... .......... .......... .......... 77% 314M 0s 2024-09-14T11:17:06.199 INFO:teuthology.orchestra.run.smithi050.stderr: 71550K .......... .......... .......... .......... .......... 77% 293M 0s 2024-09-14T11:17:06.199 INFO:teuthology.orchestra.run.smithi050.stderr: 71600K .......... .......... .......... .......... .......... 77% 353M 0s 2024-09-14T11:17:06.199 INFO:teuthology.orchestra.run.smithi050.stderr: 71650K .......... .......... .......... .......... .......... 77% 364M 0s 2024-09-14T11:17:06.199 INFO:teuthology.orchestra.run.smithi050.stderr: 71700K .......... .......... .......... .......... .......... 77% 369M 0s 2024-09-14T11:17:06.199 INFO:teuthology.orchestra.run.smithi050.stderr: 71750K .......... .......... .......... .......... .......... 77% 380M 0s 2024-09-14T11:17:06.199 INFO:teuthology.orchestra.run.smithi050.stderr: 71800K .......... .......... .......... .......... .......... 77% 370M 0s 2024-09-14T11:17:06.199 INFO:teuthology.orchestra.run.smithi050.stderr: 71850K .......... .......... .......... .......... .......... 77% 373M 0s 2024-09-14T11:17:06.200 INFO:teuthology.orchestra.run.smithi050.stderr: 71900K .......... .......... .......... .......... .......... 77% 313M 0s 2024-09-14T11:17:06.200 INFO:teuthology.orchestra.run.smithi050.stderr: 71950K .......... .......... .......... .......... .......... 77% 321M 0s 2024-09-14T11:17:06.200 INFO:teuthology.orchestra.run.smithi050.stderr: 72000K .......... .......... .......... .......... .......... 77% 374M 0s 2024-09-14T11:17:06.200 INFO:teuthology.orchestra.run.smithi050.stderr: 72050K .......... .......... .......... .......... .......... 77% 369M 0s 2024-09-14T11:17:06.200 INFO:teuthology.orchestra.run.smithi050.stderr: 72100K .......... .......... .......... .......... .......... 77% 334M 0s 2024-09-14T11:17:06.200 INFO:teuthology.orchestra.run.smithi050.stderr: 72150K .......... .......... .......... .......... .......... 77% 384M 0s 2024-09-14T11:17:06.200 INFO:teuthology.orchestra.run.smithi050.stderr: 72200K .......... .......... .......... .......... .......... 77% 149M 0s 2024-09-14T11:17:06.200 INFO:teuthology.orchestra.run.smithi050.stderr: 72250K .......... .......... .......... .......... .......... 77% 332M 0s 2024-09-14T11:17:06.200 INFO:teuthology.orchestra.run.smithi050.stderr: 72300K .......... .......... .......... .......... .......... 77% 312M 0s 2024-09-14T11:17:06.200 INFO:teuthology.orchestra.run.smithi050.stderr: 72350K .......... .......... .......... .......... .......... 77% 149M 0s 2024-09-14T11:17:06.200 INFO:teuthology.orchestra.run.smithi050.stderr: 72400K .......... .......... .......... .......... .......... 77% 329M 0s 2024-09-14T11:17:06.200 INFO:teuthology.orchestra.run.smithi050.stderr: 72450K .......... .......... .......... .......... .......... 78% 242M 0s 2024-09-14T11:17:06.200 INFO:teuthology.orchestra.run.smithi050.stderr: 72500K .......... .......... .......... .......... .......... 78% 165M 0s 2024-09-14T11:17:06.201 INFO:teuthology.orchestra.run.smithi050.stderr: 72550K .......... .......... .......... .......... .......... 78% 282M 0s 2024-09-14T11:17:06.201 INFO:teuthology.orchestra.run.smithi050.stderr: 72600K .......... .......... .......... .......... .......... 78% 376M 0s 2024-09-14T11:17:06.201 INFO:teuthology.orchestra.run.smithi050.stderr: 72650K .......... .......... .......... .......... .......... 78% 369M 0s 2024-09-14T11:17:06.201 INFO:teuthology.orchestra.run.smithi050.stderr: 72700K .......... .......... .......... .......... .......... 78% 315M 0s 2024-09-14T11:17:06.201 INFO:teuthology.orchestra.run.smithi050.stderr: 72750K .......... .......... .......... .......... .......... 78% 270M 0s 2024-09-14T11:17:06.201 INFO:teuthology.orchestra.run.smithi050.stderr: 72800K .......... .......... .......... .......... .......... 78% 327M 0s 2024-09-14T11:17:06.201 INFO:teuthology.orchestra.run.smithi050.stderr: 72850K .......... .......... .......... .......... .......... 78% 356M 0s 2024-09-14T11:17:06.201 INFO:teuthology.orchestra.run.smithi050.stderr: 72900K .......... .......... .......... .......... .......... 78% 313M 0s 2024-09-14T11:17:06.201 INFO:teuthology.orchestra.run.smithi050.stderr: 72950K .......... .......... .......... .......... .......... 78% 335M 0s 2024-09-14T11:17:06.201 INFO:teuthology.orchestra.run.smithi050.stderr: 73000K .......... .......... .......... .......... .......... 78% 309M 0s 2024-09-14T11:17:06.201 INFO:teuthology.orchestra.run.smithi050.stderr: 73050K .......... .......... .......... .......... .......... 78% 377M 0s 2024-09-14T11:17:06.201 INFO:teuthology.orchestra.run.smithi050.stderr: 73100K .......... .......... .......... .......... .......... 78% 302M 0s 2024-09-14T11:17:06.201 INFO:teuthology.orchestra.run.smithi050.stderr: 73150K .......... .......... .......... .......... .......... 78% 298M 0s 2024-09-14T11:17:06.202 INFO:teuthology.orchestra.run.smithi050.stderr: 73200K .......... .......... .......... .......... .......... 78% 373M 0s 2024-09-14T11:17:06.202 INFO:teuthology.orchestra.run.smithi050.stderr: 73250K .......... .......... .......... .......... .......... 78% 206M 0s 2024-09-14T11:17:06.202 INFO:teuthology.orchestra.run.smithi050.stderr: 73300K .......... .......... .......... .......... .......... 78% 303M 0s 2024-09-14T11:17:06.202 INFO:teuthology.orchestra.run.smithi050.stderr: 73350K .......... .......... .......... .......... .......... 79% 378M 0s 2024-09-14T11:17:06.202 INFO:teuthology.orchestra.run.smithi050.stderr: 73400K .......... .......... .......... .......... .......... 79% 364M 0s 2024-09-14T11:17:06.202 INFO:teuthology.orchestra.run.smithi050.stderr: 73450K .......... .......... .......... .......... .......... 79% 105M 0s 2024-09-14T11:17:06.202 INFO:teuthology.orchestra.run.smithi050.stderr: 73500K .......... .......... .......... .......... .......... 79% 43.0M 0s 2024-09-14T11:17:06.202 INFO:teuthology.orchestra.run.smithi050.stderr: 73550K .......... .......... .......... .......... .......... 79% 78.8M 0s 2024-09-14T11:17:06.202 INFO:teuthology.orchestra.run.smithi050.stderr: 73600K .......... .......... .......... .......... .......... 79% 329M 0s 2024-09-14T11:17:06.202 INFO:teuthology.orchestra.run.smithi050.stderr: 73650K .......... .......... .......... .......... .......... 79% 354M 0s 2024-09-14T11:17:06.202 INFO:teuthology.orchestra.run.smithi050.stderr: 73700K .......... .......... .......... .......... .......... 79% 202M 0s 2024-09-14T11:17:06.202 INFO:teuthology.orchestra.run.smithi050.stderr: 73750K .......... .......... .......... .......... .......... 79% 252M 0s 2024-09-14T11:17:06.202 INFO:teuthology.orchestra.run.smithi050.stderr: 73800K .......... .......... .......... .......... .......... 79% 344M 0s 2024-09-14T11:17:06.202 INFO:teuthology.orchestra.run.smithi050.stderr: 73850K .......... .......... .......... .......... .......... 79% 189M 0s 2024-09-14T11:17:06.202 INFO:teuthology.orchestra.run.smithi050.stderr: 73900K .......... .......... .......... .......... .......... 79% 194M 0s 2024-09-14T11:17:06.203 INFO:teuthology.orchestra.run.smithi050.stderr: 73950K .......... .......... .......... .......... .......... 79% 146M 0s 2024-09-14T11:17:06.203 INFO:teuthology.orchestra.run.smithi050.stderr: 74000K .......... .......... .......... .......... .......... 79% 163M 0s 2024-09-14T11:17:06.203 INFO:teuthology.orchestra.run.smithi050.stderr: 74050K .......... .......... .......... .......... .......... 79% 294M 0s 2024-09-14T11:17:06.203 INFO:teuthology.orchestra.run.smithi050.stderr: 74100K .......... .......... .......... .......... .......... 79% 330M 0s 2024-09-14T11:17:06.203 INFO:teuthology.orchestra.run.smithi050.stderr: 74150K .......... .......... .......... .......... .......... 79% 334M 0s 2024-09-14T11:17:06.203 INFO:teuthology.orchestra.run.smithi050.stderr: 74200K .......... .......... .......... .......... .......... 79% 356M 0s 2024-09-14T11:17:06.203 INFO:teuthology.orchestra.run.smithi050.stderr: 74250K .......... .......... .......... .......... .......... 79% 361M 0s 2024-09-14T11:17:06.203 INFO:teuthology.orchestra.run.smithi050.stderr: 74300K .......... .......... .......... .......... .......... 80% 264M 0s 2024-09-14T11:17:06.203 INFO:teuthology.orchestra.run.smithi050.stderr: 74350K .......... .......... .......... .......... .......... 80% 131M 0s 2024-09-14T11:17:06.203 INFO:teuthology.orchestra.run.smithi050.stderr: 74400K .......... .......... .......... .......... .......... 80% 230M 0s 2024-09-14T11:17:06.203 INFO:teuthology.orchestra.run.smithi050.stderr: 74450K .......... .......... .......... .......... .......... 80% 317M 0s 2024-09-14T11:17:06.203 INFO:teuthology.orchestra.run.smithi050.stderr: 74500K .......... .......... .......... .......... .......... 80% 239M 0s 2024-09-14T11:17:06.203 INFO:teuthology.orchestra.run.smithi050.stderr: 74550K .......... .......... .......... .......... .......... 80% 336M 0s 2024-09-14T11:17:06.203 INFO:teuthology.orchestra.run.smithi050.stderr: 74600K .......... .......... .......... .......... .......... 80% 330M 0s 2024-09-14T11:17:06.203 INFO:teuthology.orchestra.run.smithi050.stderr: 74650K .......... .......... .......... .......... .......... 80% 259M 0s 2024-09-14T11:17:06.203 INFO:teuthology.orchestra.run.smithi050.stderr: 74700K .......... .......... .......... .......... .......... 80% 293M 0s 2024-09-14T11:17:06.204 INFO:teuthology.orchestra.run.smithi050.stderr: 74750K .......... .......... .......... .......... .......... 80% 369M 0s 2024-09-14T11:17:06.204 INFO:teuthology.orchestra.run.smithi050.stderr: 74800K .......... .......... .......... .......... .......... 80% 348M 0s 2024-09-14T11:17:06.204 INFO:teuthology.orchestra.run.smithi050.stderr: 74850K .......... .......... .......... .......... .......... 80% 359M 0s 2024-09-14T11:17:06.204 INFO:teuthology.orchestra.run.smithi050.stderr: 74900K .......... .......... .......... .......... .......... 80% 257M 0s 2024-09-14T11:17:06.204 INFO:teuthology.orchestra.run.smithi050.stderr: 74950K .......... .......... .......... .......... .......... 80% 362M 0s 2024-09-14T11:17:06.204 INFO:teuthology.orchestra.run.smithi050.stderr: 75000K .......... .......... .......... .......... .......... 80% 374M 0s 2024-09-14T11:17:06.204 INFO:teuthology.orchestra.run.smithi050.stderr: 75050K .......... .......... .......... .......... .......... 80% 366M 0s 2024-09-14T11:17:06.204 INFO:teuthology.orchestra.run.smithi050.stderr: 75100K .......... .......... .......... .......... .......... 80% 296M 0s 2024-09-14T11:17:06.204 INFO:teuthology.orchestra.run.smithi050.stderr: 75150K .......... .......... .......... .......... .......... 80% 228M 0s 2024-09-14T11:17:06.204 INFO:teuthology.orchestra.run.smithi050.stderr: 75200K .......... .......... .......... .......... .......... 81% 374M 0s 2024-09-14T11:17:06.204 INFO:teuthology.orchestra.run.smithi050.stderr: 75250K .......... .......... .......... .......... .......... 81% 164M 0s 2024-09-14T11:17:06.204 INFO:teuthology.orchestra.run.smithi050.stderr: 75300K .......... .......... .......... .......... .......... 81% 334M 0s 2024-09-14T11:17:06.204 INFO:teuthology.orchestra.run.smithi050.stderr: 75350K .......... .......... .......... .......... .......... 81% 380M 0s 2024-09-14T11:17:06.204 INFO:teuthology.orchestra.run.smithi050.stderr: 75400K .......... .......... .......... .......... .......... 81% 377M 0s 2024-09-14T11:17:06.204 INFO:teuthology.orchestra.run.smithi050.stderr: 75450K .......... .......... .......... .......... .......... 81% 335M 0s 2024-09-14T11:17:06.205 INFO:teuthology.orchestra.run.smithi050.stderr: 75500K .......... .......... .......... .......... .......... 81% 106M 0s 2024-09-14T11:17:06.205 INFO:teuthology.orchestra.run.smithi050.stderr: 75550K .......... .......... .......... .......... .......... 81% 307M 0s 2024-09-14T11:17:06.205 INFO:teuthology.orchestra.run.smithi050.stderr: 75600K .......... .......... .......... .......... .......... 81% 334M 0s 2024-09-14T11:17:06.205 INFO:teuthology.orchestra.run.smithi050.stderr: 75650K .......... .......... .......... .......... .......... 81% 356M 0s 2024-09-14T11:17:06.205 INFO:teuthology.orchestra.run.smithi050.stderr: 75700K .......... .......... .......... .......... .......... 81% 325M 0s 2024-09-14T11:17:06.205 INFO:teuthology.orchestra.run.smithi050.stderr: 75750K .......... .......... .......... .......... .......... 81% 381M 0s 2024-09-14T11:17:06.205 INFO:teuthology.orchestra.run.smithi050.stderr: 75800K .......... .......... .......... .......... .......... 81% 364M 0s 2024-09-14T11:17:06.205 INFO:teuthology.orchestra.run.smithi050.stderr: 75850K .......... .......... .......... .......... .......... 81% 361M 0s 2024-09-14T11:17:06.205 INFO:teuthology.orchestra.run.smithi050.stderr: 75900K .......... .......... .......... .......... .......... 81% 308M 0s 2024-09-14T11:17:06.205 INFO:teuthology.orchestra.run.smithi050.stderr: 75950K .......... .......... .......... .......... .......... 81% 387M 0s 2024-09-14T11:17:06.205 INFO:teuthology.orchestra.run.smithi050.stderr: 76000K .......... .......... .......... .......... .......... 81% 361M 0s 2024-09-14T11:17:06.205 INFO:teuthology.orchestra.run.smithi050.stderr: 76050K .......... .......... .......... .......... .......... 81% 337M 0s 2024-09-14T11:17:06.206 INFO:teuthology.orchestra.run.smithi050.stderr: 76100K .......... .......... .......... .......... .......... 81% 190M 0s 2024-09-14T11:17:06.206 INFO:teuthology.orchestra.run.smithi050.stderr: 76150K .......... .......... .......... .......... .......... 82% 272M 0s 2024-09-14T11:17:06.206 INFO:teuthology.orchestra.run.smithi050.stderr: 76200K .......... .......... .......... .......... .......... 82% 361M 0s 2024-09-14T11:17:06.206 INFO:teuthology.orchestra.run.smithi050.stderr: 76250K .......... .......... .......... .......... .......... 82% 374M 0s 2024-09-14T11:17:06.206 INFO:teuthology.orchestra.run.smithi050.stderr: 76300K .......... .......... .......... .......... .......... 82% 312M 0s 2024-09-14T11:17:06.206 INFO:teuthology.orchestra.run.smithi050.stderr: 76350K .......... .......... .......... .......... .......... 82% 353M 0s 2024-09-14T11:17:06.206 INFO:teuthology.orchestra.run.smithi050.stderr: 76400K .......... .......... .......... .......... .......... 82% 375M 0s 2024-09-14T11:17:06.206 INFO:teuthology.orchestra.run.smithi050.stderr: 76450K .......... .......... .......... .......... .......... 82% 318M 0s 2024-09-14T11:17:06.206 INFO:teuthology.orchestra.run.smithi050.stderr: 76500K .......... .......... .......... .......... .......... 82% 164M 0s 2024-09-14T11:17:06.206 INFO:teuthology.orchestra.run.smithi050.stderr: 76550K .......... .......... .......... .......... .......... 82% 46.7M 0s 2024-09-14T11:17:06.206 INFO:teuthology.orchestra.run.smithi050.stderr: 76600K .......... .......... .......... .......... .......... 82% 338M 0s 2024-09-14T11:17:06.206 INFO:teuthology.orchestra.run.smithi050.stderr: 76650K .......... .......... .......... .......... .......... 82% 47.9M 0s 2024-09-14T11:17:06.206 INFO:teuthology.orchestra.run.smithi050.stderr: 76700K .......... .......... .......... .......... .......... 82% 244M 0s 2024-09-14T11:17:06.206 INFO:teuthology.orchestra.run.smithi050.stderr: 76750K .......... .......... .......... .......... .......... 82% 327M 0s 2024-09-14T11:17:06.206 INFO:teuthology.orchestra.run.smithi050.stderr: 76800K .......... .......... .......... .......... .......... 82% 337M 0s 2024-09-14T11:17:06.207 INFO:teuthology.orchestra.run.smithi050.stderr: 76850K .......... .......... .......... .......... .......... 82% 389M 0s 2024-09-14T11:17:06.207 INFO:teuthology.orchestra.run.smithi050.stderr: 76900K .......... .......... .......... .......... .......... 82% 179M 0s 2024-09-14T11:17:06.207 INFO:teuthology.orchestra.run.smithi050.stderr: 76950K .......... .......... .......... .......... .......... 82% 368M 0s 2024-09-14T11:17:06.207 INFO:teuthology.orchestra.run.smithi050.stderr: 77000K .......... .......... .......... .......... .......... 82% 171M 0s 2024-09-14T11:17:06.207 INFO:teuthology.orchestra.run.smithi050.stderr: 77050K .......... .......... .......... .......... .......... 82% 369M 0s 2024-09-14T11:17:06.207 INFO:teuthology.orchestra.run.smithi050.stderr: 77100K .......... .......... .......... .......... .......... 83% 115M 0s 2024-09-14T11:17:06.207 INFO:teuthology.orchestra.run.smithi050.stderr: 77150K .......... .......... .......... .......... .......... 83% 280M 0s 2024-09-14T11:17:06.207 INFO:teuthology.orchestra.run.smithi050.stderr: 77200K .......... .......... .......... .......... .......... 83% 151M 0s 2024-09-14T11:17:06.207 INFO:teuthology.orchestra.run.smithi050.stderr: 77250K .......... .......... .......... .......... .......... 83% 366M 0s 2024-09-14T11:17:06.207 INFO:teuthology.orchestra.run.smithi050.stderr: 77300K .......... .......... .......... .......... .......... 83% 333M 0s 2024-09-14T11:17:06.207 INFO:teuthology.orchestra.run.smithi050.stderr: 77350K .......... .......... .......... .......... .......... 83% 382M 0s 2024-09-14T11:17:06.207 INFO:teuthology.orchestra.run.smithi050.stderr: 77400K .......... .......... .......... .......... .......... 83% 366M 0s 2024-09-14T11:17:06.207 INFO:teuthology.orchestra.run.smithi050.stderr: 77450K .......... .......... .......... .......... .......... 83% 371M 0s 2024-09-14T11:17:06.207 INFO:teuthology.orchestra.run.smithi050.stderr: 77500K .......... .......... .......... .......... .......... 83% 146M 0s 2024-09-14T11:17:06.208 INFO:teuthology.orchestra.run.smithi050.stderr: 77550K .......... .......... .......... .......... .......... 83% 273M 0s 2024-09-14T11:17:06.208 INFO:teuthology.orchestra.run.smithi050.stderr: 77600K .......... .......... .......... .......... .......... 83% 132M 0s 2024-09-14T11:17:06.208 INFO:teuthology.orchestra.run.smithi050.stderr: 77650K .......... .......... .......... .......... .......... 83% 364M 0s 2024-09-14T11:17:06.208 INFO:teuthology.orchestra.run.smithi050.stderr: 77700K .......... .......... .......... .......... .......... 83% 324M 0s 2024-09-14T11:17:06.208 INFO:teuthology.orchestra.run.smithi050.stderr: 77750K .......... .......... .......... .......... .......... 83% 367M 0s 2024-09-14T11:17:06.208 INFO:teuthology.orchestra.run.smithi050.stderr: 77800K .......... .......... .......... .......... .......... 83% 375M 0s 2024-09-14T11:17:06.208 INFO:teuthology.orchestra.run.smithi050.stderr: 77850K .......... .......... .......... .......... .......... 83% 346M 0s 2024-09-14T11:17:06.208 INFO:teuthology.orchestra.run.smithi050.stderr: 77900K .......... .......... .......... .......... .......... 83% 305M 0s 2024-09-14T11:17:06.208 INFO:teuthology.orchestra.run.smithi050.stderr: 77950K .......... .......... .......... .......... .......... 83% 366M 0s 2024-09-14T11:17:06.208 INFO:teuthology.orchestra.run.smithi050.stderr: 78000K .......... .......... .......... .......... .......... 84% 385M 0s 2024-09-14T11:17:06.208 INFO:teuthology.orchestra.run.smithi050.stderr: 78050K .......... .......... .......... .......... .......... 84% 178M 0s 2024-09-14T11:17:06.208 INFO:teuthology.orchestra.run.smithi050.stderr: 78100K .......... .......... .......... .......... .......... 84% 321M 0s 2024-09-14T11:17:06.208 INFO:teuthology.orchestra.run.smithi050.stderr: 78150K .......... .......... .......... .......... .......... 84% 295M 0s 2024-09-14T11:17:06.209 INFO:teuthology.orchestra.run.smithi050.stderr: 78200K .......... .......... .......... .......... .......... 84% 356M 0s 2024-09-14T11:17:06.209 INFO:teuthology.orchestra.run.smithi050.stderr: 78250K .......... .......... .......... .......... .......... 84% 326M 0s 2024-09-14T11:17:06.209 INFO:teuthology.orchestra.run.smithi050.stderr: 78300K .......... .......... .......... .......... .......... 84% 309M 0s 2024-09-14T11:17:06.209 INFO:teuthology.orchestra.run.smithi050.stderr: 78350K .......... .......... .......... .......... .......... 84% 314M 0s 2024-09-14T11:17:06.209 INFO:teuthology.orchestra.run.smithi050.stderr: 78400K .......... .......... .......... .......... .......... 84% 339M 0s 2024-09-14T11:17:06.209 INFO:teuthology.orchestra.run.smithi050.stderr: 78450K .......... .......... .......... .......... .......... 84% 388M 0s 2024-09-14T11:17:06.209 INFO:teuthology.orchestra.run.smithi050.stderr: 78500K .......... .......... .......... .......... .......... 84% 347M 0s 2024-09-14T11:17:06.209 INFO:teuthology.orchestra.run.smithi050.stderr: 78550K .......... .......... .......... .......... .......... 84% 114M 0s 2024-09-14T11:17:06.209 INFO:teuthology.orchestra.run.smithi050.stderr: 78600K .......... .......... .......... .......... .......... 84% 339M 0s 2024-09-14T11:17:06.209 INFO:teuthology.orchestra.run.smithi050.stderr: 78650K .......... .......... .......... .......... .......... 84% 328M 0s 2024-09-14T11:17:06.209 INFO:teuthology.orchestra.run.smithi050.stderr: 78700K .......... .......... .......... .......... .......... 84% 285M 0s 2024-09-14T11:17:06.209 INFO:teuthology.orchestra.run.smithi050.stderr: 78750K .......... .......... .......... .......... .......... 84% 229M 0s 2024-09-14T11:17:06.209 INFO:teuthology.orchestra.run.smithi050.stderr: 78800K .......... .......... .......... .......... .......... 84% 353M 0s 2024-09-14T11:17:06.209 INFO:teuthology.orchestra.run.smithi050.stderr: 78850K .......... .......... .......... .......... .......... 84% 346M 0s 2024-09-14T11:17:06.209 INFO:teuthology.orchestra.run.smithi050.stderr: 78900K .......... .......... .......... .......... .......... 84% 303M 0s 2024-09-14T11:17:06.210 INFO:teuthology.orchestra.run.smithi050.stderr: 78950K .......... .......... .......... .......... .......... 85% 355M 0s 2024-09-14T11:17:06.210 INFO:teuthology.orchestra.run.smithi050.stderr: 79000K .......... .......... .......... .......... .......... 85% 373M 0s 2024-09-14T11:17:06.210 INFO:teuthology.orchestra.run.smithi050.stderr: 79050K .......... .......... .......... .......... .......... 85% 373M 0s 2024-09-14T11:17:06.210 INFO:teuthology.orchestra.run.smithi050.stderr: 79100K .......... .......... .......... .......... .......... 85% 308M 0s 2024-09-14T11:17:06.210 INFO:teuthology.orchestra.run.smithi050.stderr: 79150K .......... .......... .......... .......... .......... 85% 92.5M 0s 2024-09-14T11:17:06.210 INFO:teuthology.orchestra.run.smithi050.stderr: 79200K .......... .......... .......... .......... .......... 85% 182M 0s 2024-09-14T11:17:06.210 INFO:teuthology.orchestra.run.smithi050.stderr: 79250K .......... .......... .......... .......... .......... 85% 320M 0s 2024-09-14T11:17:06.210 INFO:teuthology.orchestra.run.smithi050.stderr: 79300K .......... .......... .......... .......... .......... 85% 277M 0s 2024-09-14T11:17:06.210 INFO:teuthology.orchestra.run.smithi050.stderr: 79350K .......... .......... .......... .......... .......... 85% 337M 0s 2024-09-14T11:17:06.210 INFO:teuthology.orchestra.run.smithi050.stderr: 79400K .......... .......... .......... .......... .......... 85% 310M 0s 2024-09-14T11:17:06.210 INFO:teuthology.orchestra.run.smithi050.stderr: 79450K .......... .......... .......... .......... .......... 85% 375M 0s 2024-09-14T11:17:06.210 INFO:teuthology.orchestra.run.smithi050.stderr: 79500K .......... .......... .......... .......... .......... 85% 320M 0s 2024-09-14T11:17:06.210 INFO:teuthology.orchestra.run.smithi050.stderr: 79550K .......... .......... .......... .......... .......... 85% 383M 0s 2024-09-14T11:17:06.210 INFO:teuthology.orchestra.run.smithi050.stderr: 79600K .......... .......... .......... .......... .......... 85% 113M 0s 2024-09-14T11:17:06.210 INFO:teuthology.orchestra.run.smithi050.stderr: 79650K .......... .......... .......... .......... .......... 85% 267M 0s 2024-09-14T11:17:06.210 INFO:teuthology.orchestra.run.smithi050.stderr: 79700K .......... .......... .......... .......... .......... 85% 58.6M 0s 2024-09-14T11:17:06.211 INFO:teuthology.orchestra.run.smithi050.stderr: 79750K .......... .......... .......... .......... .......... 85% 105M 0s 2024-09-14T11:17:06.211 INFO:teuthology.orchestra.run.smithi050.stderr: 79800K .......... .......... .......... .......... .......... 85% 225M 0s 2024-09-14T11:17:06.211 INFO:teuthology.orchestra.run.smithi050.stderr: 79850K .......... .......... .......... .......... .......... 86% 358M 0s 2024-09-14T11:17:06.211 INFO:teuthology.orchestra.run.smithi050.stderr: 79900K .......... .......... .......... .......... .......... 86% 181M 0s 2024-09-14T11:17:06.211 INFO:teuthology.orchestra.run.smithi050.stderr: 79950K .......... .......... .......... .......... .......... 86% 379M 0s 2024-09-14T11:17:06.211 INFO:teuthology.orchestra.run.smithi050.stderr: 80000K .......... .......... .......... .......... .......... 86% 158M 0s 2024-09-14T11:17:06.211 INFO:teuthology.orchestra.run.smithi050.stderr: 80050K .......... .......... .......... .......... .......... 86% 291M 0s 2024-09-14T11:17:06.211 INFO:teuthology.orchestra.run.smithi050.stderr: 80100K .......... .......... .......... .......... .......... 86% 340M 0s 2024-09-14T11:17:06.211 INFO:teuthology.orchestra.run.smithi050.stderr: 80150K .......... .......... .......... .......... .......... 86% 148M 0s 2024-09-14T11:17:06.211 INFO:teuthology.orchestra.run.smithi050.stderr: 80200K .......... .......... .......... .......... .......... 86% 294M 0s 2024-09-14T11:17:06.211 INFO:teuthology.orchestra.run.smithi050.stderr: 80250K .......... .......... .......... .......... .......... 86% 81.9M 0s 2024-09-14T11:17:06.211 INFO:teuthology.orchestra.run.smithi050.stderr: 80300K .......... .......... .......... .......... .......... 86% 286M 0s 2024-09-14T11:17:06.211 INFO:teuthology.orchestra.run.smithi050.stderr: 80350K .......... .......... .......... .......... .......... 86% 361M 0s 2024-09-14T11:17:06.211 INFO:teuthology.orchestra.run.smithi050.stderr: 80400K .......... .......... .......... .......... .......... 86% 374M 0s 2024-09-14T11:17:06.211 INFO:teuthology.orchestra.run.smithi050.stderr: 80450K .......... .......... .......... .......... .......... 86% 376M 0s 2024-09-14T11:17:06.212 INFO:teuthology.orchestra.run.smithi050.stderr: 80500K .......... .......... .......... .......... .......... 86% 216M 0s 2024-09-14T11:17:06.212 INFO:teuthology.orchestra.run.smithi050.stderr: 80550K .......... .......... .......... .......... .......... 86% 378M 0s 2024-09-14T11:17:06.212 INFO:teuthology.orchestra.run.smithi050.stderr: 80600K .......... .......... .......... .......... .......... 86% 364M 0s 2024-09-14T11:17:06.212 INFO:teuthology.orchestra.run.smithi050.stderr: 80650K .......... .......... .......... .......... .......... 86% 218M 0s 2024-09-14T11:17:06.212 INFO:teuthology.orchestra.run.smithi050.stderr: 80700K .......... .......... .......... .......... .......... 86% 232M 0s 2024-09-14T11:17:06.212 INFO:teuthology.orchestra.run.smithi050.stderr: 80750K .......... .......... .......... .......... .......... 86% 362M 0s 2024-09-14T11:17:06.212 INFO:teuthology.orchestra.run.smithi050.stderr: 80800K .......... .......... .......... .......... .......... 87% 357M 0s 2024-09-14T11:17:06.212 INFO:teuthology.orchestra.run.smithi050.stderr: 80850K .......... .......... .......... .......... .......... 87% 217M 0s 2024-09-14T11:17:06.212 INFO:teuthology.orchestra.run.smithi050.stderr: 80900K .......... .......... .......... .......... .......... 87% 278M 0s 2024-09-14T11:17:06.212 INFO:teuthology.orchestra.run.smithi050.stderr: 80950K .......... .......... .......... .......... .......... 87% 280M 0s 2024-09-14T11:17:06.212 INFO:teuthology.orchestra.run.smithi050.stderr: 81000K .......... .......... .......... .......... .......... 87% 304M 0s 2024-09-14T11:17:06.212 INFO:teuthology.orchestra.run.smithi050.stderr: 81050K .......... .......... .......... .......... .......... 87% 355M 0s 2024-09-14T11:17:06.212 INFO:teuthology.orchestra.run.smithi050.stderr: 81100K .......... .......... .......... .......... .......... 87% 304M 0s 2024-09-14T11:17:06.212 INFO:teuthology.orchestra.run.smithi050.stderr: 81150K .......... .......... .......... .......... .......... 87% 365M 0s 2024-09-14T11:17:06.213 INFO:teuthology.orchestra.run.smithi050.stderr: 81200K .......... .......... .......... .......... .......... 87% 366M 0s 2024-09-14T11:17:06.213 INFO:teuthology.orchestra.run.smithi050.stderr: 81250K .......... .......... .......... .......... .......... 87% 350M 0s 2024-09-14T11:17:06.213 INFO:teuthology.orchestra.run.smithi050.stderr: 81300K .......... .......... .......... .......... .......... 87% 320M 0s 2024-09-14T11:17:06.213 INFO:teuthology.orchestra.run.smithi050.stderr: 81350K .......... .......... .......... .......... .......... 87% 373M 0s 2024-09-14T11:17:06.213 INFO:teuthology.orchestra.run.smithi050.stderr: 81400K .......... .......... .......... .......... .......... 87% 152M 0s 2024-09-14T11:17:06.213 INFO:teuthology.orchestra.run.smithi050.stderr: 81450K .......... .......... .......... .......... .......... 87% 308M 0s 2024-09-14T11:17:06.213 INFO:teuthology.orchestra.run.smithi050.stderr: 81500K .......... .......... .......... .......... .......... 87% 234M 0s 2024-09-14T11:17:06.213 INFO:teuthology.orchestra.run.smithi050.stderr: 81550K .......... .......... .......... .......... .......... 87% 246M 0s 2024-09-14T11:17:06.213 INFO:teuthology.orchestra.run.smithi050.stderr: 81600K .......... .......... .......... .......... .......... 87% 371M 0s 2024-09-14T11:17:06.213 INFO:teuthology.orchestra.run.smithi050.stderr: 81650K .......... .......... .......... .......... .......... 87% 381M 0s 2024-09-14T11:17:06.213 INFO:teuthology.orchestra.run.smithi050.stderr: 81700K .......... .......... .......... .......... .......... 87% 267M 0s 2024-09-14T11:17:06.213 INFO:teuthology.orchestra.run.smithi050.stderr: 81750K .......... .......... .......... .......... .......... 88% 368M 0s 2024-09-14T11:17:06.213 INFO:teuthology.orchestra.run.smithi050.stderr: 81800K .......... .......... .......... .......... .......... 88% 91.9M 0s 2024-09-14T11:17:06.213 INFO:teuthology.orchestra.run.smithi050.stderr: 81850K .......... .......... .......... .......... .......... 88% 368M 0s 2024-09-14T11:17:06.213 INFO:teuthology.orchestra.run.smithi050.stderr: 81900K .......... .......... .......... .......... .......... 88% 357M 0s 2024-09-14T11:17:06.213 INFO:teuthology.orchestra.run.smithi050.stderr: 81950K .......... .......... .......... .......... .......... 88% 305M 0s 2024-09-14T11:17:06.214 INFO:teuthology.orchestra.run.smithi050.stderr: 82000K .......... .......... .......... .......... .......... 88% 372M 0s 2024-09-14T11:17:06.214 INFO:teuthology.orchestra.run.smithi050.stderr: 82050K .......... .......... .......... .......... .......... 88% 330M 0s 2024-09-14T11:17:06.214 INFO:teuthology.orchestra.run.smithi050.stderr: 82100K .......... .......... .......... .......... .......... 88% 378M 0s 2024-09-14T11:17:06.214 INFO:teuthology.orchestra.run.smithi050.stderr: 82150K .......... .......... .......... .......... .......... 88% 351M 0s 2024-09-14T11:17:06.214 INFO:teuthology.orchestra.run.smithi050.stderr: 82200K .......... .......... .......... .......... .......... 88% 393M 0s 2024-09-14T11:17:06.214 INFO:teuthology.orchestra.run.smithi050.stderr: 82250K .......... .......... .......... .......... .......... 88% 367M 0s 2024-09-14T11:17:06.214 INFO:teuthology.orchestra.run.smithi050.stderr: 82300K .......... .......... .......... .......... .......... 88% 204M 0s 2024-09-14T11:17:06.214 INFO:teuthology.orchestra.run.smithi050.stderr: 82350K .......... .......... .......... .......... .......... 88% 189M 0s 2024-09-14T11:17:06.214 INFO:teuthology.orchestra.run.smithi050.stderr: 82400K .......... .......... .......... .......... .......... 88% 299M 0s 2024-09-14T11:17:06.214 INFO:teuthology.orchestra.run.smithi050.stderr: 82450K .......... .......... .......... .......... .......... 88% 305M 0s 2024-09-14T11:17:06.214 INFO:teuthology.orchestra.run.smithi050.stderr: 82500K .......... .......... .......... .......... .......... 88% 394M 0s 2024-09-14T11:17:06.214 INFO:teuthology.orchestra.run.smithi050.stderr: 82550K .......... .......... .......... .......... .......... 88% 70.3M 0s 2024-09-14T11:17:06.214 INFO:teuthology.orchestra.run.smithi050.stderr: 82600K .......... .......... .......... .......... .......... 88% 286M 0s 2024-09-14T11:17:06.214 INFO:teuthology.orchestra.run.smithi050.stderr: 82650K .......... .......... .......... .......... .......... 89% 321M 0s 2024-09-14T11:17:06.215 INFO:teuthology.orchestra.run.smithi050.stderr: 82700K .......... .......... .......... .......... .......... 89% 395M 0s 2024-09-14T11:17:06.215 INFO:teuthology.orchestra.run.smithi050.stderr: 82750K .......... .......... .......... .......... .......... 89% 82.5M 0s 2024-09-14T11:17:06.215 INFO:teuthology.orchestra.run.smithi050.stderr: 82800K .......... .......... .......... .......... .......... 89% 145M 0s 2024-09-14T11:17:06.215 INFO:teuthology.orchestra.run.smithi050.stderr: 82850K .......... .......... .......... .......... .......... 89% 226M 0s 2024-09-14T11:17:06.215 INFO:teuthology.orchestra.run.smithi050.stderr: 82900K .......... .......... .......... .......... .......... 89% 329M 0s 2024-09-14T11:17:06.215 INFO:teuthology.orchestra.run.smithi050.stderr: 82950K .......... .......... .......... .......... .......... 89% 44.8M 0s 2024-09-14T11:17:06.215 INFO:teuthology.orchestra.run.smithi050.stderr: 83000K .......... .......... .......... .......... .......... 89% 303M 0s 2024-09-14T11:17:06.215 INFO:teuthology.orchestra.run.smithi050.stderr: 83050K .......... .......... .......... .......... .......... 89% 330M 0s 2024-09-14T11:17:06.215 INFO:teuthology.orchestra.run.smithi050.stderr: 83100K .......... .......... .......... .......... .......... 89% 376M 0s 2024-09-14T11:17:06.215 INFO:teuthology.orchestra.run.smithi050.stderr: 83150K .......... .......... .......... .......... .......... 89% 117M 0s 2024-09-14T11:17:06.215 INFO:teuthology.orchestra.run.smithi050.stderr: 83200K .......... .......... .......... .......... .......... 89% 62.1M 0s 2024-09-14T11:17:06.215 INFO:teuthology.orchestra.run.smithi050.stderr: 83250K .......... .......... .......... .......... .......... 89% 57.2M 0s 2024-09-14T11:17:06.215 INFO:teuthology.orchestra.run.smithi050.stderr: 83300K .......... .......... .......... .......... .......... 89% 238M 0s 2024-09-14T11:17:06.215 INFO:teuthology.orchestra.run.smithi050.stderr: 83350K .......... .......... .......... .......... .......... 89% 276M 0s 2024-09-14T11:17:06.215 INFO:teuthology.orchestra.run.smithi050.stderr: 83400K .......... .......... .......... .......... .......... 89% 341M 0s 2024-09-14T11:17:06.215 INFO:teuthology.orchestra.run.smithi050.stderr: 83450K .......... .......... .......... .......... .......... 89% 340M 0s 2024-09-14T11:17:06.216 INFO:teuthology.orchestra.run.smithi050.stderr: 83500K .......... .......... .......... .......... .......... 89% 377M 0s 2024-09-14T11:17:06.216 INFO:teuthology.orchestra.run.smithi050.stderr: 83550K .......... .......... .......... .......... .......... 89% 307M 0s 2024-09-14T11:17:06.216 INFO:teuthology.orchestra.run.smithi050.stderr: 83600K .......... .......... .......... .......... .......... 90% 383M 0s 2024-09-14T11:17:06.216 INFO:teuthology.orchestra.run.smithi050.stderr: 83650K .......... .......... .......... .......... .......... 90% 381M 0s 2024-09-14T11:17:06.216 INFO:teuthology.orchestra.run.smithi050.stderr: 83700K .......... .......... .......... .......... .......... 90% 366M 0s 2024-09-14T11:17:06.216 INFO:teuthology.orchestra.run.smithi050.stderr: 83750K .......... .......... .......... .......... .......... 90% 320M 0s 2024-09-14T11:17:06.216 INFO:teuthology.orchestra.run.smithi050.stderr: 83800K .......... .......... .......... .......... .......... 90% 356M 0s 2024-09-14T11:17:06.216 INFO:teuthology.orchestra.run.smithi050.stderr: 83850K .......... .......... .......... .......... .......... 90% 304M 0s 2024-09-14T11:17:06.216 INFO:teuthology.orchestra.run.smithi050.stderr: 83900K .......... .......... .......... .......... .......... 90% 286M 0s 2024-09-14T11:17:06.216 INFO:teuthology.orchestra.run.smithi050.stderr: 83950K .......... .......... .......... .......... .......... 90% 300M 0s 2024-09-14T11:17:06.216 INFO:teuthology.orchestra.run.smithi050.stderr: 84000K .......... .......... .......... .......... .......... 90% 381M 0s 2024-09-14T11:17:06.216 INFO:teuthology.orchestra.run.smithi050.stderr: 84050K .......... .......... .......... .......... .......... 90% 383M 0s 2024-09-14T11:17:06.216 INFO:teuthology.orchestra.run.smithi050.stderr: 84100K .......... .......... .......... .......... .......... 90% 350M 0s 2024-09-14T11:17:06.216 INFO:teuthology.orchestra.run.smithi050.stderr: 84150K .......... .......... .......... .......... .......... 90% 340M 0s 2024-09-14T11:17:06.216 INFO:teuthology.orchestra.run.smithi050.stderr: 84200K .......... .......... .......... .......... .......... 90% 385M 0s 2024-09-14T11:17:06.217 INFO:teuthology.orchestra.run.smithi050.stderr: 84250K .......... .......... .......... .......... .......... 90% 301M 0s 2024-09-14T11:17:06.217 INFO:teuthology.orchestra.run.smithi050.stderr: 84300K .......... .......... .......... .......... .......... 90% 306M 0s 2024-09-14T11:17:06.217 INFO:teuthology.orchestra.run.smithi050.stderr: 84350K .......... .......... .......... .......... .......... 90% 261M 0s 2024-09-14T11:17:06.217 INFO:teuthology.orchestra.run.smithi050.stderr: 84400K .......... .......... .......... .......... .......... 90% 290M 0s 2024-09-14T11:17:06.217 INFO:teuthology.orchestra.run.smithi050.stderr: 84450K .......... .......... .......... .......... .......... 90% 305M 0s 2024-09-14T11:17:06.217 INFO:teuthology.orchestra.run.smithi050.stderr: 84500K .......... .......... .......... .......... .......... 91% 369M 0s 2024-09-14T11:17:06.217 INFO:teuthology.orchestra.run.smithi050.stderr: 84550K .......... .......... .......... .......... .......... 91% 282M 0s 2024-09-14T11:17:06.217 INFO:teuthology.orchestra.run.smithi050.stderr: 84600K .......... .......... .......... .......... .......... 91% 266M 0s 2024-09-14T11:17:06.217 INFO:teuthology.orchestra.run.smithi050.stderr: 84650K .......... .......... .......... .......... .......... 91% 243M 0s 2024-09-14T11:17:06.217 INFO:teuthology.orchestra.run.smithi050.stderr: 84700K .......... .......... .......... .......... .......... 91% 310M 0s 2024-09-14T11:17:06.217 INFO:teuthology.orchestra.run.smithi050.stderr: 84750K .......... .......... .......... .......... .......... 91% 271M 0s 2024-09-14T11:17:06.217 INFO:teuthology.orchestra.run.smithi050.stderr: 84800K .......... .......... .......... .......... .......... 91% 347M 0s 2024-09-14T11:17:06.217 INFO:teuthology.orchestra.run.smithi050.stderr: 84850K .......... .......... .......... .......... .......... 91% 353M 0s 2024-09-14T11:17:06.217 INFO:teuthology.orchestra.run.smithi050.stderr: 84900K .......... .......... .......... .......... .......... 91% 372M 0s 2024-09-14T11:17:06.217 INFO:teuthology.orchestra.run.smithi050.stderr: 84950K .......... .......... .......... .......... .......... 91% 323M 0s 2024-09-14T11:17:06.217 INFO:teuthology.orchestra.run.smithi050.stderr: 85000K .......... .......... .......... .......... .......... 91% 338M 0s 2024-09-14T11:17:06.218 INFO:teuthology.orchestra.run.smithi050.stderr: 85050K .......... .......... .......... .......... .......... 91% 326M 0s 2024-09-14T11:17:06.218 INFO:teuthology.orchestra.run.smithi050.stderr: 85100K .......... .......... .......... .......... .......... 91% 360M 0s 2024-09-14T11:17:06.218 INFO:teuthology.orchestra.run.smithi050.stderr: 85150K .......... .......... .......... .......... .......... 91% 285M 0s 2024-09-14T11:17:06.218 INFO:teuthology.orchestra.run.smithi050.stderr: 85200K .......... .......... .......... .......... .......... 91% 318M 0s 2024-09-14T11:17:06.218 INFO:teuthology.orchestra.run.smithi050.stderr: 85250K .......... .......... .......... .......... .......... 91% 357M 0s 2024-09-14T11:17:06.218 INFO:teuthology.orchestra.run.smithi050.stderr: 85300K .......... .......... .......... .......... .......... 91% 333M 0s 2024-09-14T11:17:06.218 INFO:teuthology.orchestra.run.smithi050.stderr: 85350K .......... .......... .......... .......... .......... 91% 339M 0s 2024-09-14T11:17:06.218 INFO:teuthology.orchestra.run.smithi050.stderr: 85400K .......... .......... .......... .......... .......... 91% 359M 0s 2024-09-14T11:17:06.218 INFO:teuthology.orchestra.run.smithi050.stderr: 85450K .......... .......... .......... .......... .......... 92% 382M 0s 2024-09-14T11:17:06.218 INFO:teuthology.orchestra.run.smithi050.stderr: 85500K .......... .......... .......... .......... .......... 92% 370M 0s 2024-09-14T11:17:06.218 INFO:teuthology.orchestra.run.smithi050.stderr: 85550K .......... .......... .......... .......... .......... 92% 219M 0s 2024-09-14T11:17:06.218 INFO:teuthology.orchestra.run.smithi050.stderr: 85600K .......... .......... .......... .......... .......... 92% 288M 0s 2024-09-14T11:17:06.218 INFO:teuthology.orchestra.run.smithi050.stderr: 85650K .......... .......... .......... .......... .......... 92% 352M 0s 2024-09-14T11:17:06.218 INFO:teuthology.orchestra.run.smithi050.stderr: 85700K .......... .......... .......... .......... .......... 92% 254M 0s 2024-09-14T11:17:06.218 INFO:teuthology.orchestra.run.smithi050.stderr: 85750K .......... .......... .......... .......... .......... 92% 91.4M 0s 2024-09-14T11:17:06.218 INFO:teuthology.orchestra.run.smithi050.stderr: 85800K .......... .......... .......... .......... .......... 92% 360M 0s 2024-09-14T11:17:06.219 INFO:teuthology.orchestra.run.smithi050.stderr: 85850K .......... .......... .......... .......... .......... 92% 344M 0s 2024-09-14T11:17:06.219 INFO:teuthology.orchestra.run.smithi050.stderr: 85900K .......... .......... .......... .......... .......... 92% 319M 0s 2024-09-14T11:17:06.219 INFO:teuthology.orchestra.run.smithi050.stderr: 85950K .......... .......... .......... .......... .......... 92% 130M 0s 2024-09-14T11:17:06.219 INFO:teuthology.orchestra.run.smithi050.stderr: 86000K .......... .......... .......... .......... .......... 92% 49.2M 0s 2024-09-14T11:17:06.219 INFO:teuthology.orchestra.run.smithi050.stderr: 86050K .......... .......... .......... .......... .......... 92% 37.5M 0s 2024-09-14T11:17:06.219 INFO:teuthology.orchestra.run.smithi050.stderr: 86100K .......... .......... .......... .......... .......... 92% 51.0M 0s 2024-09-14T11:17:06.219 INFO:teuthology.orchestra.run.smithi050.stderr: 86150K .......... .......... .......... .......... .......... 92% 257M 0s 2024-09-14T11:17:06.219 INFO:teuthology.orchestra.run.smithi050.stderr: 86200K .......... .......... .......... .......... .......... 92% 308M 0s 2024-09-14T11:17:06.219 INFO:teuthology.orchestra.run.smithi050.stderr: 86250K .......... .......... .......... .......... .......... 92% 253M 0s 2024-09-14T11:17:06.219 INFO:teuthology.orchestra.run.smithi050.stderr: 86300K .......... .......... .......... .......... .......... 92% 64.0M 0s 2024-09-14T11:17:06.219 INFO:teuthology.orchestra.run.smithi050.stderr: 86350K .......... .......... .......... .......... .......... 93% 184M 0s 2024-09-14T11:17:06.219 INFO:teuthology.orchestra.run.smithi050.stderr: 86400K .......... .......... .......... .......... .......... 93% 333M 0s 2024-09-14T11:17:06.219 INFO:teuthology.orchestra.run.smithi050.stderr: 86450K .......... .......... .......... .......... .......... 93% 216M 0s 2024-09-14T11:17:06.219 INFO:teuthology.orchestra.run.smithi050.stderr: 86500K .......... .......... .......... .......... .......... 93% 301M 0s 2024-09-14T11:17:06.220 INFO:teuthology.orchestra.run.smithi050.stderr: 86550K .......... .......... .......... .......... .......... 93% 284M 0s 2024-09-14T11:17:06.220 INFO:teuthology.orchestra.run.smithi050.stderr: 86600K .......... .......... .......... .......... .......... 93% 286M 0s 2024-09-14T11:17:06.220 INFO:teuthology.orchestra.run.smithi050.stderr: 86650K .......... .......... .......... .......... .......... 93% 314M 0s 2024-09-14T11:17:06.220 INFO:teuthology.orchestra.run.smithi050.stderr: 86700K .......... .......... .......... .......... .......... 93% 316M 0s 2024-09-14T11:17:06.220 INFO:teuthology.orchestra.run.smithi050.stderr: 86750K .......... .......... .......... .......... .......... 93% 256M 0s 2024-09-14T11:17:06.220 INFO:teuthology.orchestra.run.smithi050.stderr: 86800K .......... .......... .......... .......... .......... 93% 308M 0s 2024-09-14T11:17:06.220 INFO:teuthology.orchestra.run.smithi050.stderr: 86850K .......... .......... .......... .......... .......... 93% 242M 0s 2024-09-14T11:17:06.220 INFO:teuthology.orchestra.run.smithi050.stderr: 86900K .......... .......... .......... .......... .......... 93% 299M 0s 2024-09-14T11:17:06.220 INFO:teuthology.orchestra.run.smithi050.stderr: 86950K .......... .......... .......... .......... .......... 93% 275M 0s 2024-09-14T11:17:06.220 INFO:teuthology.orchestra.run.smithi050.stderr: 87000K .......... .......... .......... .......... .......... 93% 308M 0s 2024-09-14T11:17:06.220 INFO:teuthology.orchestra.run.smithi050.stderr: 87050K .......... .......... .......... .......... .......... 93% 316M 0s 2024-09-14T11:17:06.220 INFO:teuthology.orchestra.run.smithi050.stderr: 87100K .......... .......... .......... .......... .......... 93% 316M 0s 2024-09-14T11:17:06.220 INFO:teuthology.orchestra.run.smithi050.stderr: 87150K .......... .......... .......... .......... .......... 93% 270M 0s 2024-09-14T11:17:06.220 INFO:teuthology.orchestra.run.smithi050.stderr: 87200K .......... .......... .......... .......... .......... 93% 308M 0s 2024-09-14T11:17:06.220 INFO:teuthology.orchestra.run.smithi050.stderr: 87250K .......... .......... .......... .......... .......... 93% 290M 0s 2024-09-14T11:17:06.220 INFO:teuthology.orchestra.run.smithi050.stderr: 87300K .......... .......... .......... .......... .......... 94% 307M 0s 2024-09-14T11:17:06.221 INFO:teuthology.orchestra.run.smithi050.stderr: 87350K .......... .......... .......... .......... .......... 94% 297M 0s 2024-09-14T11:17:06.221 INFO:teuthology.orchestra.run.smithi050.stderr: 87400K .......... .......... .......... .......... .......... 94% 278M 0s 2024-09-14T11:17:06.221 INFO:teuthology.orchestra.run.smithi050.stderr: 87450K .......... .......... .......... .......... .......... 94% 318M 0s 2024-09-14T11:17:06.221 INFO:teuthology.orchestra.run.smithi050.stderr: 87500K .......... .......... .......... .......... .......... 94% 285M 0s 2024-09-14T11:17:06.221 INFO:teuthology.orchestra.run.smithi050.stderr: 87550K .......... .......... .......... .......... .......... 94% 254M 0s 2024-09-14T11:17:06.221 INFO:teuthology.orchestra.run.smithi050.stderr: 87600K .......... .......... .......... .......... .......... 94% 306M 0s 2024-09-14T11:17:06.221 INFO:teuthology.orchestra.run.smithi050.stderr: 87650K .......... .......... .......... .......... .......... 94% 324M 0s 2024-09-14T11:17:06.221 INFO:teuthology.orchestra.run.smithi050.stderr: 87700K .......... .......... .......... .......... .......... 94% 312M 0s 2024-09-14T11:17:06.221 INFO:teuthology.orchestra.run.smithi050.stderr: 87750K .......... .......... .......... .......... .......... 94% 291M 0s 2024-09-14T11:17:06.221 INFO:teuthology.orchestra.run.smithi050.stderr: 87800K .......... .......... .......... .......... .......... 94% 300M 0s 2024-09-14T11:17:06.221 INFO:teuthology.orchestra.run.smithi050.stderr: 87850K .......... .......... .......... .......... .......... 94% 321M 0s 2024-09-14T11:17:06.221 INFO:teuthology.orchestra.run.smithi050.stderr: 87900K .......... .......... .......... .......... .......... 94% 331M 0s 2024-09-14T11:17:06.221 INFO:teuthology.orchestra.run.smithi050.stderr: 87950K .......... .......... .......... .......... .......... 94% 279M 0s 2024-09-14T11:17:06.222 INFO:teuthology.orchestra.run.smithi050.stderr: 88000K .......... .......... .......... .......... .......... 94% 300M 0s 2024-09-14T11:17:06.222 INFO:teuthology.orchestra.run.smithi050.stderr: 88050K .......... .......... .......... .......... .......... 94% 333M 0s 2024-09-14T11:17:06.222 INFO:teuthology.orchestra.run.smithi050.stderr: 88100K .......... .......... .......... .......... .......... 94% 296M 0s 2024-09-14T11:17:06.222 INFO:teuthology.orchestra.run.smithi050.stderr: 88150K .......... .......... .......... .......... .......... 94% 282M 0s 2024-09-14T11:17:06.222 INFO:teuthology.orchestra.run.smithi050.stderr: 88200K .......... .......... .......... .......... .......... 94% 317M 0s 2024-09-14T11:17:06.222 INFO:teuthology.orchestra.run.smithi050.stderr: 88250K .......... .......... .......... .......... .......... 95% 290M 0s 2024-09-14T11:17:06.222 INFO:teuthology.orchestra.run.smithi050.stderr: 88300K .......... .......... .......... .......... .......... 95% 282M 0s 2024-09-14T11:17:06.222 INFO:teuthology.orchestra.run.smithi050.stderr: 88350K .......... .......... .......... .......... .......... 95% 221M 0s 2024-09-14T11:17:06.222 INFO:teuthology.orchestra.run.smithi050.stderr: 88400K .......... .......... .......... .......... .......... 95% 244M 0s 2024-09-14T11:17:06.222 INFO:teuthology.orchestra.run.smithi050.stderr: 88450K .......... .......... .......... .......... .......... 95% 257M 0s 2024-09-14T11:17:06.222 INFO:teuthology.orchestra.run.smithi050.stderr: 88500K .......... .......... .......... .......... .......... 95% 337M 0s 2024-09-14T11:17:06.222 INFO:teuthology.orchestra.run.smithi050.stderr: 88550K .......... .......... .......... .......... .......... 95% 189M 0s 2024-09-14T11:17:06.222 INFO:teuthology.orchestra.run.smithi050.stderr: 88600K .......... .......... .......... .......... .......... 95% 329M 0s 2024-09-14T11:17:06.222 INFO:teuthology.orchestra.run.smithi050.stderr: 88650K .......... .......... .......... .......... .......... 95% 301M 0s 2024-09-14T11:17:06.223 INFO:teuthology.orchestra.run.smithi050.stderr: 88700K .......... .......... .......... .......... .......... 95% 336M 0s 2024-09-14T11:17:06.223 INFO:teuthology.orchestra.run.smithi050.stderr: 88750K .......... .......... .......... .......... .......... 95% 257M 0s 2024-09-14T11:17:06.223 INFO:teuthology.orchestra.run.smithi050.stderr: 88800K .......... .......... .......... .......... .......... 95% 296M 0s 2024-09-14T11:17:06.223 INFO:teuthology.orchestra.run.smithi050.stderr: 88850K .......... .......... .......... .......... .......... 95% 293M 0s 2024-09-14T11:17:06.223 INFO:teuthology.orchestra.run.smithi050.stderr: 88900K .......... .......... .......... .......... .......... 95% 304M 0s 2024-09-14T11:17:06.223 INFO:teuthology.orchestra.run.smithi050.stderr: 88950K .......... .......... .......... .......... .......... 95% 268M 0s 2024-09-14T11:17:06.223 INFO:teuthology.orchestra.run.smithi050.stderr: 89000K .......... .......... .......... .......... .......... 95% 348M 0s 2024-09-14T11:17:06.223 INFO:teuthology.orchestra.run.smithi050.stderr: 89050K .......... .......... .......... .......... .......... 95% 338M 0s 2024-09-14T11:17:06.223 INFO:teuthology.orchestra.run.smithi050.stderr: 89100K .......... .......... .......... .......... .......... 95% 86.4M 0s 2024-09-14T11:17:06.223 INFO:teuthology.orchestra.run.smithi050.stderr: 89150K .......... .......... .......... .......... .......... 96% 48.7M 0s 2024-09-14T11:17:06.223 INFO:teuthology.orchestra.run.smithi050.stderr: 89200K .......... .......... .......... .......... .......... 96% 161M 0s 2024-09-14T11:17:06.223 INFO:teuthology.orchestra.run.smithi050.stderr: 89250K .......... .......... .......... .......... .......... 96% 302M 0s 2024-09-14T11:17:06.223 INFO:teuthology.orchestra.run.smithi050.stderr: 89300K .......... .......... .......... .......... .......... 96% 167M 0s 2024-09-14T11:17:06.223 INFO:teuthology.orchestra.run.smithi050.stderr: 89350K .......... .......... .......... .......... .......... 96% 54.7M 0s 2024-09-14T11:17:06.223 INFO:teuthology.orchestra.run.smithi050.stderr: 89400K .......... .......... .......... .......... .......... 96% 215M 0s 2024-09-14T11:17:06.223 INFO:teuthology.orchestra.run.smithi050.stderr: 89450K .......... .......... .......... .......... .......... 96% 285M 0s 2024-09-14T11:17:06.224 INFO:teuthology.orchestra.run.smithi050.stderr: 89500K .......... .......... .......... .......... .......... 96% 219M 0s 2024-09-14T11:17:06.224 INFO:teuthology.orchestra.run.smithi050.stderr: 89550K .......... .......... .......... .......... .......... 96% 256M 0s 2024-09-14T11:17:06.224 INFO:teuthology.orchestra.run.smithi050.stderr: 89600K .......... .......... .......... .......... .......... 96% 321M 0s 2024-09-14T11:17:06.224 INFO:teuthology.orchestra.run.smithi050.stderr: 89650K .......... .......... .......... .......... .......... 96% 312M 0s 2024-09-14T11:17:06.224 INFO:teuthology.orchestra.run.smithi050.stderr: 89700K .......... .......... .......... .......... .......... 96% 315M 0s 2024-09-14T11:17:06.224 INFO:teuthology.orchestra.run.smithi050.stderr: 89750K .......... .......... .......... .......... .......... 96% 258M 0s 2024-09-14T11:17:06.224 INFO:teuthology.orchestra.run.smithi050.stderr: 89800K .......... .......... .......... .......... .......... 96% 334M 0s 2024-09-14T11:17:06.224 INFO:teuthology.orchestra.run.smithi050.stderr: 89850K .......... .......... .......... .......... .......... 96% 323M 0s 2024-09-14T11:17:06.224 INFO:teuthology.orchestra.run.smithi050.stderr: 89900K .......... .......... .......... .......... .......... 96% 315M 0s 2024-09-14T11:17:06.224 INFO:teuthology.orchestra.run.smithi050.stderr: 89950K .......... .......... .......... .......... .......... 96% 247M 0s 2024-09-14T11:17:06.224 INFO:teuthology.orchestra.run.smithi050.stderr: 90000K .......... .......... .......... .......... .......... 96% 311M 0s 2024-09-14T11:17:06.224 INFO:teuthology.orchestra.run.smithi050.stderr: 90050K .......... .......... .......... .......... .......... 96% 303M 0s 2024-09-14T11:17:06.224 INFO:teuthology.orchestra.run.smithi050.stderr: 90100K .......... .......... .......... .......... .......... 97% 314M 0s 2024-09-14T11:17:06.224 INFO:teuthology.orchestra.run.smithi050.stderr: 90150K .......... .......... .......... .......... .......... 97% 222M 0s 2024-09-14T11:17:06.224 INFO:teuthology.orchestra.run.smithi050.stderr: 90200K .......... .......... .......... .......... .......... 97% 271M 0s 2024-09-14T11:17:06.225 INFO:teuthology.orchestra.run.smithi050.stderr: 90250K .......... .......... .......... .......... .......... 97% 272M 0s 2024-09-14T11:17:06.225 INFO:teuthology.orchestra.run.smithi050.stderr: 90300K .......... .......... .......... .......... .......... 97% 294M 0s 2024-09-14T11:17:06.225 INFO:teuthology.orchestra.run.smithi050.stderr: 90350K .......... .......... .......... .......... .......... 97% 211M 0s 2024-09-14T11:17:06.225 INFO:teuthology.orchestra.run.smithi050.stderr: 90400K .......... .......... .......... .......... .......... 97% 256M 0s 2024-09-14T11:17:06.225 INFO:teuthology.orchestra.run.smithi050.stderr: 90450K .......... .......... .......... .......... .......... 97% 291M 0s 2024-09-14T11:17:06.225 INFO:teuthology.orchestra.run.smithi050.stderr: 90500K .......... .......... .......... .......... .......... 97% 292M 0s 2024-09-14T11:17:06.225 INFO:teuthology.orchestra.run.smithi050.stderr: 90550K .......... .......... .......... .......... .......... 97% 277M 0s 2024-09-14T11:17:06.225 INFO:teuthology.orchestra.run.smithi050.stderr: 90600K .......... .......... .......... .......... .......... 97% 282M 0s 2024-09-14T11:17:06.225 INFO:teuthology.orchestra.run.smithi050.stderr: 90650K .......... .......... .......... .......... .......... 97% 302M 0s 2024-09-14T11:17:06.225 INFO:teuthology.orchestra.run.smithi050.stderr: 90700K .......... .......... .......... .......... .......... 97% 306M 0s 2024-09-14T11:17:06.225 INFO:teuthology.orchestra.run.smithi050.stderr: 90750K .......... .......... .......... .......... .......... 97% 263M 0s 2024-09-14T11:17:06.225 INFO:teuthology.orchestra.run.smithi050.stderr: 90800K .......... .......... .......... .......... .......... 97% 314M 0s 2024-09-14T11:17:06.225 INFO:teuthology.orchestra.run.smithi050.stderr: 90850K .......... .......... .......... .......... .......... 97% 327M 0s 2024-09-14T11:17:06.225 INFO:teuthology.orchestra.run.smithi050.stderr: 90900K .......... .......... .......... .......... .......... 97% 329M 0s 2024-09-14T11:17:06.226 INFO:teuthology.orchestra.run.smithi050.stderr: 90950K .......... .......... .......... .......... .......... 97% 265M 0s 2024-09-14T11:17:06.226 INFO:teuthology.orchestra.run.smithi050.stderr: 91000K .......... .......... .......... .......... .......... 98% 326M 0s 2024-09-14T11:17:06.226 INFO:teuthology.orchestra.run.smithi050.stderr: 91050K .......... .......... .......... .......... .......... 98% 317M 0s 2024-09-14T11:17:06.226 INFO:teuthology.orchestra.run.smithi050.stderr: 91100K .......... .......... .......... .......... .......... 98% 322M 0s 2024-09-14T11:17:06.226 INFO:teuthology.orchestra.run.smithi050.stderr: 91150K .......... .......... .......... .......... .......... 98% 255M 0s 2024-09-14T11:17:06.226 INFO:teuthology.orchestra.run.smithi050.stderr: 91200K .......... .......... .......... .......... .......... 98% 325M 0s 2024-09-14T11:17:06.226 INFO:teuthology.orchestra.run.smithi050.stderr: 91250K .......... .......... .......... .......... .......... 98% 302M 0s 2024-09-14T11:17:06.226 INFO:teuthology.orchestra.run.smithi050.stderr: 91300K .......... .......... .......... .......... .......... 98% 301M 0s 2024-09-14T11:17:06.226 INFO:teuthology.orchestra.run.smithi050.stderr: 91350K .......... .......... .......... .......... .......... 98% 288M 0s 2024-09-14T11:17:06.226 INFO:teuthology.orchestra.run.smithi050.stderr: 91400K .......... .......... .......... .......... .......... 98% 318M 0s 2024-09-14T11:17:06.226 INFO:teuthology.orchestra.run.smithi050.stderr: 91450K .......... .......... .......... .......... .......... 98% 303M 0s 2024-09-14T11:17:06.226 INFO:teuthology.orchestra.run.smithi050.stderr: 91500K .......... .......... .......... .......... .......... 98% 275M 0s 2024-09-14T11:17:06.226 INFO:teuthology.orchestra.run.smithi050.stderr: 91550K .......... .......... .......... .......... .......... 98% 254M 0s 2024-09-14T11:17:06.227 INFO:teuthology.orchestra.run.smithi050.stderr: 91600K .......... .......... .......... .......... .......... 98% 334M 0s 2024-09-14T11:17:06.227 INFO:teuthology.orchestra.run.smithi050.stderr: 91650K .......... .......... .......... .......... .......... 98% 329M 0s 2024-09-14T11:17:06.227 INFO:teuthology.orchestra.run.smithi050.stderr: 91700K .......... .......... .......... .......... .......... 98% 118M 0s 2024-09-14T11:17:06.227 INFO:teuthology.orchestra.run.smithi050.stderr: 91750K .......... .......... .......... .......... .......... 98% 269M 0s 2024-09-14T11:17:06.227 INFO:teuthology.orchestra.run.smithi050.stderr: 91800K .......... .......... .......... .......... .......... 98% 317M 0s 2024-09-14T11:17:06.227 INFO:teuthology.orchestra.run.smithi050.stderr: 91850K .......... .......... .......... .......... .......... 98% 304M 0s 2024-09-14T11:17:06.227 INFO:teuthology.orchestra.run.smithi050.stderr: 91900K .......... .......... .......... .......... .......... 98% 312M 0s 2024-09-14T11:17:06.227 INFO:teuthology.orchestra.run.smithi050.stderr: 91950K .......... .......... .......... .......... .......... 99% 284M 0s 2024-09-14T11:17:06.227 INFO:teuthology.orchestra.run.smithi050.stderr: 92000K .......... .......... .......... .......... .......... 99% 112M 0s 2024-09-14T11:17:06.227 INFO:teuthology.orchestra.run.smithi050.stderr: 92050K .......... .......... .......... .......... .......... 99% 232M 0s 2024-09-14T11:17:06.227 INFO:teuthology.orchestra.run.smithi050.stderr: 92100K .......... .......... .......... .......... .......... 99% 325M 0s 2024-09-14T11:17:06.227 INFO:teuthology.orchestra.run.smithi050.stderr: 92150K .......... .......... .......... .......... .......... 99% 321M 0s 2024-09-14T11:17:06.227 INFO:teuthology.orchestra.run.smithi050.stderr: 92200K .......... .......... .......... .......... .......... 99% 88.2M 0s 2024-09-14T11:17:06.227 INFO:teuthology.orchestra.run.smithi050.stderr: 92250K .......... .......... .......... .......... .......... 99% 312M 0s 2024-09-14T11:17:06.227 INFO:teuthology.orchestra.run.smithi050.stderr: 92300K .......... .......... .......... .......... .......... 99% 156M 0s 2024-09-14T11:17:06.228 INFO:teuthology.orchestra.run.smithi050.stderr: 92350K .......... .......... .......... .......... .......... 99% 149M 0s 2024-09-14T11:17:06.228 INFO:teuthology.orchestra.run.smithi050.stderr: 92400K .......... .......... .......... .......... .......... 99% 55.6M 0s 2024-09-14T11:17:06.228 INFO:teuthology.orchestra.run.smithi050.stderr: 92450K .......... .......... .......... .......... .......... 99% 127M 0s 2024-09-14T11:17:06.228 INFO:teuthology.orchestra.run.smithi050.stderr: 92500K .......... .......... .......... .......... .......... 99% 293M 0s 2024-09-14T11:17:06.228 INFO:teuthology.orchestra.run.smithi050.stderr: 92550K .......... .......... .......... .......... .......... 99% 297M 0s 2024-09-14T11:17:06.228 INFO:teuthology.orchestra.run.smithi050.stderr: 92600K .......... .......... .......... .......... .......... 99% 164M 0s 2024-09-14T11:17:06.228 INFO:teuthology.orchestra.run.smithi050.stderr: 92650K .......... .......... .......... .......... .......... 99% 291M 0s 2024-09-14T11:17:06.228 INFO:teuthology.orchestra.run.smithi050.stderr: 92700K .......... .......... .......... .......... .......... 99% 312M 0s 2024-09-14T11:17:06.228 INFO:teuthology.orchestra.run.smithi050.stderr: 92750K .......... .......... .......... .......... .......... 99% 270M 0s 2024-09-14T11:17:06.228 INFO:teuthology.orchestra.run.smithi050.stderr: 92800K .......... .......... .......... .......... .......... 99% 325M 0s 2024-09-14T11:17:06.228 INFO:teuthology.orchestra.run.smithi050.stderr: 92850K .......... .......... .......... .......... .......... 99% 196M 0s 2024-09-14T11:17:06.228 INFO:teuthology.orchestra.run.smithi050.stderr: 92900K 100% 134G=0.5s 2024-09-14T11:17:06.228 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-14T11:17:06.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14 11:17:05 (195 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-14T11:17:06.228 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-14T11:17:06.261 INFO:teuthology.orchestra.run.smithi050.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-14T11:17:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-14T11:17:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-14T11:17:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-14T11:17:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-14T11:17:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-14T11:17:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-14T11:17:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-14T11:17:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-14T11:17:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-14T11:17:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-14T11:17:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-14T11:17:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-14T11:17:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-14T11:17:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-14T11:17:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-14T11:17:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-14T11:17:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-14T11:17:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-14T11:17:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-14T11:17:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-14T11:17:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-14T11:17:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-14T11:17:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-14T11:17:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-14T11:17:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-14T11:17:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-14T11:17:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-14T11:17:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-14T11:17:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-14T11:17:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-14T11:17:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-14T11:17:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-14T11:17:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-14T11:17:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-14T11:17:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-14T11:17:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-14T11:17:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-14T11:17:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-14T11:17:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-14T11:17:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-14T11:17:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-14T11:17:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-14T11:17:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-14T11:17:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-14T11:17:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-14T11:17:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-14T11:17:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-14T11:17:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-14T11:17:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:17:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-14T11:17:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-14T11:17:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-14T11:17:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-14T11:17:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-14T11:17:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-14T11:17:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-14T11:17:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-14T11:17:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-14T11:17:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-14T11:17:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-14T11:17:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-14T11:17:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-14T11:17:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-14T11:17:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-14T11:17:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-14T11:17:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-14T11:17:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-14T11:17:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-14T11:17:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-14T11:17:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-14T11:17:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-14T11:17:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-14T11:17:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-14T11:17:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-14T11:17:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-14T11:17:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-14T11:17:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-14T11:17:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-14T11:17:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-14T11:17:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-14T11:17:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-14T11:17:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-14T11:17:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-14T11:17:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-14T11:17:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-14T11:17:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-14T11:17:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-14T11:17:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-14T11:17:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-14T11:17:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-14T11:17:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-14T11:17:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-14T11:17:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-14T11:17:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-14T11:17:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-14T11:17:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-14T11:17:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-14T11:17:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-14T11:17:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-14T11:17:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-14T11:17:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-14T11:17:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-14T11:17:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-14T11:17:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-14T11:17:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-14T11:17:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-14T11:17:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-14T11:17:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-14T11:17:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-14T11:17:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-14T11:17:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-14T11:17:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-14T11:17:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-14T11:17:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-14T11:17:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-14T11:17:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-14T11:17:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-14T11:17:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-14T11:17:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-14T11:17:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-14T11:17:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-14T11:17:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-14T11:17:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-14T11:17:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-14T11:17:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-14T11:17:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-14T11:17:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-14T11:17:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-14T11:17:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-14T11:17:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-14T11:17:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-14T11:17:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-14T11:17:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-14T11:17:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-14T11:17:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-14T11:17:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-14T11:17:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-14T11:17:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-14T11:17:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-14T11:17:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-14T11:17:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-14T11:17:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-14T11:17:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-14T11:17:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-14T11:17:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-14T11:17:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-14T11:17:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-14T11:17:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-14T11:17:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-14T11:17:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-14T11:17:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-14T11:17:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-14T11:17:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-14T11:17:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-14T11:17:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-14T11:17:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-14T11:17:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-14T11:17:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-14T11:17:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-14T11:17:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-14T11:17:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-14T11:17:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-14T11:17:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-14T11:17:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-14T11:17:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-14T11:17:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-14T11:17:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-14T11:17:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-14T11:17:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-14T11:17:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-14T11:17:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-14T11:17:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-14T11:17:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-14T11:17:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-14T11:17:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-14T11:17:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-14T11:17:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-14T11:17:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-14T11:17:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-14T11:17:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-14T11:17:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-14T11:17:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-14T11:17:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-14T11:17:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-14T11:17:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-14T11:17:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-14T11:17:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-14T11:17:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-14T11:17:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-14T11:17:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-14T11:17:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-14T11:17:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-14T11:17:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-14T11:17:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-14T11:17:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-14T11:17:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-14T11:17:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-14T11:17:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-14T11:17:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-14T11:17:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-14T11:17:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-14T11:17:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-14T11:17:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-14T11:17:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-14T11:17:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-14T11:17:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-14T11:17:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-14T11:17:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-14T11:17:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-14T11:17:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-14T11:17:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-14T11:17:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-14T11:17:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-14T11:17:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-14T11:17:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-14T11:17:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-14T11:17:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-14T11:17:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-14T11:17:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-14T11:17:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-14T11:17:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-14T11:17:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-14T11:17:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-14T11:17:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-14T11:17:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-14T11:17:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-14T11:17:06.277 INFO:teuthology.orchestra.run.smithi050.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-14T11:17:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:06.334 INFO:teuthology.orchestra.run.smithi050.stdout:Welcome to Gradle 6.0.1! 2024-09-14T11:17:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:06.334 INFO:teuthology.orchestra.run.smithi050.stdout:Here are the highlights of this release: 2024-09-14T11:17:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: - Substantial improvements in dependency management, including 2024-09-14T11:17:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-14T11:17:06.334 INFO:teuthology.orchestra.run.smithi050.stdout: - Advanced control of transitive versions 2024-09-14T11:17:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: - Support for optional features and dependencies 2024-09-14T11:17:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: - Rules to tweak published metadata 2024-09-14T11:17:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: - Support for Java 13 2024-09-14T11:17:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: - Faster incremental Java and Groovy compilation 2024-09-14T11:17:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: - New Zinc compiler for Scala 2024-09-14T11:17:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: - VS2019 support 2024-09-14T11:17:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-14T11:17:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:06.335 INFO:teuthology.orchestra.run.smithi050.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-14T11:17:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:06.335 INFO:teuthology.orchestra.run.smithi050.stdout:------------------------------------------------------------ 2024-09-14T11:17:06.335 INFO:teuthology.orchestra.run.smithi050.stdout:Gradle 6.0.1 2024-09-14T11:17:06.335 INFO:teuthology.orchestra.run.smithi050.stdout:------------------------------------------------------------ 2024-09-14T11:17:06.335 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:06.336 INFO:teuthology.orchestra.run.smithi050.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-14T11:17:06.336 INFO:teuthology.orchestra.run.smithi050.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-14T11:17:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:06.336 INFO:teuthology.orchestra.run.smithi050.stdout:Kotlin: 1.3.50 2024-09-14T11:17:06.336 INFO:teuthology.orchestra.run.smithi050.stdout:Groovy: 2.5.8 2024-09-14T11:17:06.336 INFO:teuthology.orchestra.run.smithi050.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-14T11:17:06.336 INFO:teuthology.orchestra.run.smithi050.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-14T11:17:06.336 INFO:teuthology.orchestra.run.smithi050.stdout:OS: Linux 5.14.0-505.el9.x86_64 amd64 2024-09-14T11:17:06.336 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:06.349 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-14T11:17:06.349 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T11:17:06.350 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi050.front.sepia.ceph.com 2024-09-14T11:17:06.350 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T11:17:06.350 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi118.front.sepia.ceph.com 2024-09-14T11:17:06.350 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-14T11:17:06.586 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-14T11:17:06.587 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-14T11:17:06.587 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'ADSFQXUQGLJIOYDCMRXH', 'access_secret': '9iw9a4VwqVFj86e77wf9dtRijk2T63UPpMCXxU6AlD5MTp6gwy/T6Q==', 'region': 'mexico', 'endpoint': 'smithi050.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi050.front.sepia.ceph.com'} 2024-09-14T11:17:06.587 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-14T11:17:06.587 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'ADSFQXUQGLJIOYDCMRXH', '--secret', '9iw9a4VwqVFj86e77wf9dtRijk2T63UPpMCXxU6AlD5MTp6gwy/T6Q==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-14T11:17:06.587 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key ADSFQXUQGLJIOYDCMRXH --secret 9iw9a4VwqVFj86e77wf9dtRijk2T63UPpMCXxU6AlD5MTp6gwy/T6Q== --email tester.client.0_test@test.test --cluster ceph 2024-09-14T11:17:06.654 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:06.654 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:06.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.692+0000 7fcdb3346800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.694+0000 7fcdb3346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:06.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.694+0000 7fcdb3346800 20 realm 2024-09-14T11:17:06.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.694+0000 7fcdb3346800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.694+0000 7fcdb3346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:06.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.694+0000 7fcdb3346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:06.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.694+0000 7fcdb3346800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.694+0000 7fcdb3346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:06.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.694+0000 7fcdb3346800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.695+0000 7fcdb3346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:06.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.695+0000 7fcdb3346800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.696+0000 7fcdb3346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:06.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.696+0000 7fcdb3346800 20 searching for the correct realm 2024-09-14T11:17:06.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.699+0000 7fcdb0636640 0 -- 172.21.15.50:0/2474988275 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fcda8064db0 msgr2=0x7fcda807ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:06.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.905+0000 7fcdb1638640 0 -- 172.21.15.50:0/2474988275 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55b8bb64b490 msgr2=0x55b8bb64d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:06.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.910+0000 7fcdb3346800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:17:06.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.910+0000 7fcdb3346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:06.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.910+0000 7fcdb3346800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:17:06.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.910+0000 7fcdb3346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:06.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.910+0000 7fcdb3346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:06.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.910+0000 7fcdb3346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:06.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.910+0000 7fcdb3346800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.910+0000 7fcdb3346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:06.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.910+0000 7fcdb3346800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.910+0000 7fcdb3346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:06.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.910+0000 7fcdb3346800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.911+0000 7fcdb3346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:06.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.911+0000 7fcdb3346800 20 zone default found 2024-09-14T11:17:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.911+0000 7fcdb3346800 4 Realm: () 2024-09-14T11:17:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.911+0000 7fcdb3346800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:17:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.911+0000 7fcdb3346800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:17:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.911+0000 7fcdb3346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.911+0000 7fcdb3346800 20 zonegroup default 2024-09-14T11:17:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.911+0000 7fcdb3346800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.912+0000 7fcdb3346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:06.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.912+0000 7fcdb3346800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.912+0000 7fcdb3346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:06.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.912+0000 7fcdb3346800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.912+0000 7fcdb3346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:06.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.912+0000 7fcdb3346800 20 started sync module instance, tier type = 2024-09-14T11:17:06.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.912+0000 7fcdb3346800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:17:06.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.922+0000 7fcdb3346800 20 add_watcher() i=0 2024-09-14T11:17:06.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.922+0000 7fcdb3346800 20 add_watcher() i=1 2024-09-14T11:17:06.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.922+0000 7fcdb3346800 20 add_watcher() i=2 2024-09-14T11:17:06.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.922+0000 7fcdb3346800 20 add_watcher() i=3 2024-09-14T11:17:06.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.922+0000 7fcdb3346800 20 add_watcher() i=4 2024-09-14T11:17:06.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.922+0000 7fcdb3346800 20 add_watcher() i=5 2024-09-14T11:17:06.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.922+0000 7fcdb3346800 20 add_watcher() i=6 2024-09-14T11:17:06.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.923+0000 7fcdb3346800 20 add_watcher() i=7 2024-09-14T11:17:06.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.923+0000 7fcdb3346800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:06.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.925+0000 7fcc66fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:06.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.925+0000 7fcdb3346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:06.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.925+0000 7fcdb3346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:06.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.926+0000 7fcdb3346800 5 note: GC not initialized 2024-09-14T11:17:06.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.926+0000 7fcc65fe3640 20 reqs_thread_entry: start 2024-09-14T11:17:06.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.926+0000 7fcdb3346800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:06.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.926+0000 7fcdb3346800 20 Filter name: none 2024-09-14T11:17:06.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.926+0000 7fcbd77fe640 20 reqs_thread_entry: start 2024-09-14T11:17:06.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.926+0000 7fcdb3346800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T11:17:06.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.926+0000 7fcdb3346800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.926+0000 7fcdb3346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:06.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.926+0000 7fcdb3346800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-14T11:17:06.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.926+0000 7fcdb3346800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:17:06.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.927+0000 7fcdb3346800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-14T11:17:06.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.927+0000 7fcdb3346800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.927+0000 7fcdb3346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:06.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.927+0000 7fcdb3346800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-14T11:17:06.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.927+0000 7fcdb3346800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:17:06.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.927+0000 7fcdb3346800 10 cache get: name=default.rgw.meta+users.keys+ADSFQXUQGLJIOYDCMRXH : miss 2024-09-14T11:17:06.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.927+0000 7fcdb3346800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.927+0000 7fcdb3346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:06.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.927+0000 7fcdb3346800 10 cache put: name=default.rgw.meta+users.keys+ADSFQXUQGLJIOYDCMRXH info.flags=0x0 2024-09-14T11:17:06.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.927+0000 7fcdb3346800 10 adding default.rgw.meta+users.keys+ADSFQXUQGLJIOYDCMRXH to cache LRU end 2024-09-14T11:17:06.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.927+0000 7fcdb3346800 10 cache get: name=default.rgw.meta+users.keys+ADSFQXUQGLJIOYDCMRXH : hit (negative entry) 2024-09-14T11:17:06.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.927+0000 7fcdb3346800 10 cache get: name=default.rgw.meta+users.keys+ADSFQXUQGLJIOYDCMRXH : hit (negative entry) 2024-09-14T11:17:06.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.928+0000 7fcdb3346800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:17:06.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.929+0000 7fcdb3346800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:17:06.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.929+0000 7fcdb3346800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T11:17:06.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.929+0000 7fcc87fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497094 cookie 94251906346688 notifier 8243 bl.length()=670 2024-09-14T11:17:06.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.929+0000 7fcc87fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:17:06.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.929+0000 7fcc87fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:17:06.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.932+0000 7fcdb3346800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:17:06.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.932+0000 7fcdb3346800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:17:06.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.932+0000 7fcdb3346800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T11:17:06.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.932+0000 7fcc87fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496997 cookie 94251906338768 notifier 8243 bl.length()=200 2024-09-14T11:17:06.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.932+0000 7fcc87fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:17:06.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.932+0000 7fcc87fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:17:06.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.935+0000 7fcdb3346800 10 cache put: name=default.rgw.meta+users.keys+ADSFQXUQGLJIOYDCMRXH info.flags=0x7 2024-09-14T11:17:06.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.935+0000 7fcdb3346800 10 moving default.rgw.meta+users.keys+ADSFQXUQGLJIOYDCMRXH to cache LRU end 2024-09-14T11:17:06.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.935+0000 7fcdb3346800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:ADSFQXUQGLJIOYDCMRXH, ofs0, ns] 2024-09-14T11:17:06.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.936+0000 7fcc87fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497095 cookie 94251906348256 notifier 8243 bl.length()=189 2024-09-14T11:17:06.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.936+0000 7fcc87fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ADSFQXUQGLJIOYDCMRXH info.flags=0x7 2024-09-14T11:17:06.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.936+0000 7fcc87fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ADSFQXUQGLJIOYDCMRXH to cache LRU end 2024-09-14T11:17:06.935 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-14T11:17:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: "user_id": "tester.client.0", 2024-09-14T11:17:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: "display_name": "Ms. tester.client.0", 2024-09-14T11:17:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: "email": "tester.client.0_test@test.test", 2024-09-14T11:17:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: "suspended": 0, 2024-09-14T11:17:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: "max_buckets": 1000, 2024-09-14T11:17:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: "subusers": [], 2024-09-14T11:17:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: "keys": [ 2024-09-14T11:17:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-14T11:17:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: "user": "tester.client.0", 2024-09-14T11:17:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: "access_key": "ADSFQXUQGLJIOYDCMRXH", 2024-09-14T11:17:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: "secret_key": "9iw9a4VwqVFj86e77wf9dtRijk2T63UPpMCXxU6AlD5MTp6gwy/T6Q==", 2024-09-14T11:17:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: "active": true, 2024-09-14T11:17:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: "create_date": "2024-09-14T11:17:06.928113Z" 2024-09-14T11:17:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-14T11:17:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-14T11:17:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: "swift_keys": [], 2024-09-14T11:17:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": [], 2024-09-14T11:17:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "op_mask": "read, write, delete", 2024-09-14T11:17:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "default_placement": "", 2024-09-14T11:17:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "default_storage_class": "", 2024-09-14T11:17:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "placement_tags": [], 2024-09-14T11:17:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "bucket_quota": { 2024-09-14T11:17:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:17:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:17:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:17:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:17:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:17:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:17:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "user_quota": { 2024-09-14T11:17:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:17:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:17:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:17:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:17:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:17:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:17:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "temp_url_keys": [], 2024-09-14T11:17:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "rgw", 2024-09-14T11:17:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "mfa_ids": [], 2024-09-14T11:17:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "account_id": "", 2024-09-14T11:17:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-09-14T11:17:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "create_date": "2024-09-14T11:17:06.928093Z", 2024-09-14T11:17:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-14T11:17:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "group_ids": [] 2024-09-14T11:17:06.938 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-14T11:17:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:06.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.938+0000 7fcc66fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:06.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.941+0000 7fcdb3346800 20 remove_watcher() i=0 2024-09-14T11:17:06.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.941+0000 7fcdb3346800 2 removed watcher, disabling cache 2024-09-14T11:17:06.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.942+0000 7fcdb3346800 20 remove_watcher() i=1 2024-09-14T11:17:06.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.943+0000 7fcdb3346800 20 remove_watcher() i=2 2024-09-14T11:17:06.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.944+0000 7fcdb3346800 20 remove_watcher() i=3 2024-09-14T11:17:06.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.945+0000 7fcdb3346800 20 remove_watcher() i=4 2024-09-14T11:17:06.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.946+0000 7fcdb3346800 20 remove_watcher() i=5 2024-09-14T11:17:06.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.947+0000 7fcdb3346800 20 remove_watcher() i=6 2024-09-14T11:17:06.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:06.948+0000 7fcdb3346800 20 remove_watcher() i=7 2024-09-14T11:17:06.960 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T11:17:06.960 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-14T11:17:06.993 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-14T11:17:06.993 DEBUG:teuthology.orchestra.run.smithi050:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-14T11:17:07.059 DEBUG:teuthology.orchestra.run.smithi050:> radosgw-admin gc process --include-all 2024-09-14T11:17:07.152 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:07.152 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:07.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.196+0000 7f4534175800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.198+0000 7f4534175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.198+0000 7f4534175800 20 realm 2024-09-14T11:17:07.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.198+0000 7f4534175800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.199+0000 7f4534175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.199+0000 7f4534175800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:07.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.199+0000 7f4534175800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.199+0000 7f4534175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.199+0000 7f4534175800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.200+0000 7f4534175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:07.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.200+0000 7f4534175800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.200+0000 7f4534175800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:07.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.200+0000 7f4534175800 20 searching for the correct realm 2024-09-14T11:17:07.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.203+0000 7f453145e640 0 -- 172.21.15.50:0/2593643398 >> [v2:172.21.15.50:6816/1957449887,v1:172.21.15.50:6817/1957449887] conn(0x55a47e3843c0 msgr2=0x55a47e3867d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:07.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.207+0000 7f4531c5f640 0 -- 172.21.15.50:0/2593643398 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f452c03d400 msgr2=0x7f452c03d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:07.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.415+0000 7f4534175800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:17:07.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.415+0000 7f4534175800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:07.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.415+0000 7f4534175800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:17:07.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.415+0000 7f4534175800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:07.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.415+0000 7f4534175800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:07.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.415+0000 7f4534175800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:07.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.415+0000 7f4534175800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.415+0000 7f4534175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.415+0000 7f4534175800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.416+0000 7f4534175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.416+0000 7f4534175800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.416+0000 7f4534175800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.416+0000 7f4534175800 20 zone default found 2024-09-14T11:17:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.416+0000 7f4534175800 4 Realm: () 2024-09-14T11:17:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.416+0000 7f4534175800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:17:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.416+0000 7f4534175800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:17:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.416+0000 7f4534175800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.416+0000 7f4534175800 20 zonegroup default 2024-09-14T11:17:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.416+0000 7f4534175800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.417+0000 7f4534175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.417+0000 7f4534175800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.417+0000 7f4534175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.417+0000 7f4534175800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.418+0000 7f4534175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.418+0000 7f4534175800 20 started sync module instance, tier type = 2024-09-14T11:17:07.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.418+0000 7f4534175800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:17:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.427+0000 7f4534175800 20 add_watcher() i=0 2024-09-14T11:17:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.427+0000 7f4534175800 20 add_watcher() i=1 2024-09-14T11:17:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.427+0000 7f4534175800 20 add_watcher() i=2 2024-09-14T11:17:07.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.427+0000 7f4534175800 20 add_watcher() i=3 2024-09-14T11:17:07.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.427+0000 7f4534175800 20 add_watcher() i=4 2024-09-14T11:17:07.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.427+0000 7f4534175800 20 add_watcher() i=5 2024-09-14T11:17:07.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.427+0000 7f4534175800 20 add_watcher() i=6 2024-09-14T11:17:07.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.428+0000 7f4534175800 20 add_watcher() i=7 2024-09-14T11:17:07.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.428+0000 7f4534175800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:07.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.430+0000 7f43e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:07.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.431+0000 7f4534175800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:07.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.431+0000 7f4534175800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:07.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.469+0000 7f43e27fc640 20 reqs_thread_entry: start 2024-09-14T11:17:07.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.469+0000 7f4534175800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:07.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.469+0000 7f4534175800 20 Filter name: none 2024-09-14T11:17:07.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.469+0000 7f4353fff640 20 reqs_thread_entry: start 2024-09-14T11:17:07.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.469+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:17:07.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.471+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.472+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.472+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:17:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.472+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11793871626438535463', time=2024-09-14T13:09:18.865729+0000, chain.objs.size()=1 2024-09-14T11:17:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.472+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20__shadow_.t3Vh_9wNKa34NpC0TamCGZJO5w70X7R_0 2024-09-14T11:17:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.472+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17115300428544660763', time=2024-09-14T13:09:57.397527+0000, chain.objs.size()=1 2024-09-14T11:17:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.472+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23__shadow_.DHrDEVtRPV6XCe7_J-o47zHxtO2LuFi_0 2024-09-14T11:17:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.472+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2916876768868145372', time=2024-09-14T13:09:58.506631+0000, chain.objs.size()=1 2024-09-14T11:17:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.472+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23__shadow_.f5m7amK6saDasRMR5YX1AXX7ngF11Sr_0 2024-09-14T11:17:07.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.472+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17369207911220190193', time=2024-09-14T13:11:49.138057+0000, chain.objs.size()=1 2024-09-14T11:17:07.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.472+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30__shadow_.wtC1LTXk4Yrb-L3PXfEJ95UM6jRltkI_0 2024-09-14T11:17:07.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.472+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9256379490337132151', time=2024-09-14T13:11:54.515773+0000, chain.objs.size()=1 2024-09-14T11:17:07.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.472+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32__shadow_.RItiXswe587_AcUg2vtGGGmgENJRjlL_0 2024-09-14T11:17:07.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.472+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6358755378713874789', time=2024-09-14T13:12:30.937752+0000, chain.objs.size()=1 2024-09-14T11:17:07.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.472+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34__shadow_._m2G-CD-gmaBiBVyEeGJ1HHl5zTYQTI_0 2024-09-14T11:17:07.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.472+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5649683914414331488', time=2024-09-14T13:13:04.281500+0000, chain.objs.size()=1 2024-09-14T11:17:07.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.472+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35__shadow_.C26Jcx45w2RuKb3paAs3HiO0G7gfXoK_0 2024-09-14T11:17:07.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.472+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11362655693687671696', time=2024-09-14T13:13:04.282301+0000, chain.objs.size()=1 2024-09-14T11:17:07.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.472+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35__shadow_.JI258BoPCOUGmeyzFliz8dbQzAQJOmR_0 2024-09-14T11:17:07.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.472+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6901788906963707852', time=2024-09-14T13:13:07.166325+0000, chain.objs.size()=1 2024-09-14T11:17:07.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.472+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36__shadow_.vYBk_qBonumKcSFGi7EZtIPmrytuNUj_0 2024-09-14T11:17:07.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.472+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12403832886785383114', time=2024-09-14T13:13:40.678156+0000, chain.objs.size()=1 2024-09-14T11:17:07.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.473+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37__shadow_.yElJSj2TiVK5VD4PWlv0Kmyii7OIZ5D_0 2024-09-14T11:17:07.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.473+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18358694948801086941', time=2024-09-14T13:13:43.447250+0000, chain.objs.size()=1 2024-09-14T11:17:07.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.473+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38__shadow_.tAxNXoZiLBu9t8TTcQuFLZY1V8JwNcZ_0 2024-09-14T11:17:07.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.473+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6506591234067842305', time=2024-09-14T13:13:43.531501+0000, chain.objs.size()=1 2024-09-14T11:17:07.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.473+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38__shadow_.-Ql-XcPk-ToyHaG4WR4MRGfhxSTk4nh_0 2024-09-14T11:17:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.478+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.481+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:17:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.482+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:17:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11828557566274906188', time=2024-09-14T13:07:51.477678+0000, chain.objs.size()=1 2024-09-14T11:17:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16__shadow_.-BOvW_Ta_QdV89j_z4eE6-bjqKH-moL_0 2024-09-14T11:17:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9219263340202957727', time=2024-09-14T13:09:18.915768+0000, chain.objs.size()=1 2024-09-14T11:17:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20__shadow_.shDlIEDmVxhv2w0ZXA3YAVs_cGGIYDC_0 2024-09-14T11:17:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11190265524312633128', time=2024-09-14T13:09:21.088835+0000, chain.objs.size()=1 2024-09-14T11:17:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21__shadow_.t-R5veFohMHQj7sRK6TMcX1AF7GrsjR_0 2024-09-14T11:17:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8928017247821310798', time=2024-09-14T13:11:13.058455+0000, chain.objs.size()=1 2024-09-14T11:17:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28__shadow_.jkIDbjq79t9Jd0K2gcLHjCz8RbmEqMG_0 2024-09-14T11:17:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3444120720578804426', time=2024-09-14T13:11:15.663785+0000, chain.objs.size()=1 2024-09-14T11:17:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29__shadow_.R3y04I664dqWv53jvw2VUL7ofXSY70x_0 2024-09-14T11:17:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2552277481298674613', time=2024-09-14T13:11:54.544669+0000, chain.objs.size()=1 2024-09-14T11:17:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32__shadow_.1OYg0RwfHtpqxhWc02pCkbczKzLwTcO_0 2024-09-14T11:17:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7379792064864362176', time=2024-09-14T13:12:28.120835+0000, chain.objs.size()=1 2024-09-14T11:17:07.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33__shadow_.1MC4Cc-mJS7PSPqx_Xkg4TsgHgKDWzU_0 2024-09-14T11:17:07.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14531390130278834921', time=2024-09-14T13:13:04.271355+0000, chain.objs.size()=1 2024-09-14T11:17:07.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35__shadow_.TJr7VTwL1gZudcG7N_J7APmDGhNNTCY_0 2024-09-14T11:17:07.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3957890421216359028', time=2024-09-14T13:13:07.123037+0000, chain.objs.size()=1 2024-09-14T11:17:07.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36__shadow_.PnI5nsHdux2MMWyFkx1lbnqwxfyDE7__0 2024-09-14T11:17:07.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11543290596194882463', time=2024-09-14T13:13:40.676909+0000, chain.objs.size()=1 2024-09-14T11:17:07.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37__shadow_.IX4rlZqReQawHIs8zeeYHwB_j8wpp_D_0 2024-09-14T11:17:07.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6824981051419429427', time=2024-09-14T13:13:45.498354+0000, chain.objs.size()=1 2024-09-14T11:17:07.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39__shadow_.s9KMDjxKtcWUEJ6FlDnNmq5uQL_D6zA_0 2024-09-14T11:17:07.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1716193406231456911', time=2024-09-14T13:14:18.926534+0000, chain.objs.size()=1 2024-09-14T11:17:07.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.483+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40__shadow_.q0BQH2-LvBdrJGPxrKomPMTjRwx0XKH_0 2024-09-14T11:17:07.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.487+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11236653176938119887', time=2024-09-14T13:14:18.999313+0000, chain.objs.size()=1 2024-09-14T11:17:07.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.487+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40__shadow_.bbLlHhJsi8au6jhYPa6PculKJi_soGL_0 2024-09-14T11:17:07.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.487+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.314536954576117743', time=2024-09-14T13:16:28.936143+0000, chain.objs.size()=1 2024-09-14T11:17:07.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.487+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18__shadow_.Cf9CEWYHYl38wlkWhE1gFGu70cXEBTV_0 2024-09-14T11:17:07.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.488+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14234925983313673853', time=2024-09-14T13:16:28.936657+0000, chain.objs.size()=1 2024-09-14T11:17:07.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.488+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18__shadow_.cdhnssnKi9zMsB2jk6Xi-Ia7F3MWKD4_0 2024-09-14T11:17:07.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.489+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.492+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:17:07.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.493+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.494+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.494+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-14T11:17:07.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.494+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14929112258677367718', time=2024-09-14T13:07:51.411501+0000, chain.objs.size()=4 2024-09-14T11:17:07.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.494+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10__multipart_foo.2~-JPbnwwXKO-qWyGlwjO8n_1PMchWPAX.1 2024-09-14T11:17:07.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.494+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10__multipart_foo.2~-JPbnwwXKO-qWyGlwjO8n_1PMchWPAX.2 2024-09-14T11:17:07.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.494+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10__multipart_foo.2~-JPbnwwXKO-qWyGlwjO8n_1PMchWPAX.3 2024-09-14T11:17:07.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.494+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10__multipart_foo.2~-JPbnwwXKO-qWyGlwjO8n_1PMchWPAX.4 2024-09-14T11:17:07.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.494+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15533069296737314307', time=2024-09-14T13:07:51.441499+0000, chain.objs.size()=1 2024-09-14T11:17:07.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.494+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16__shadow_.-BOvW_Ta_QdV89j_z4eE6-bjqKH-moL_0 2024-09-14T11:17:07.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.494+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6721535853659562274', time=2024-09-14T13:07:51.461248+0000, chain.objs.size()=1 2024-09-14T11:17:07.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.494+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16__shadow_.OtfDSzHopE6vv3iI75qKgxYUFqDfnJT_0 2024-09-14T11:17:07.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.494+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10225109306085646010', time=2024-09-14T13:07:51.465074+0000, chain.objs.size()=1 2024-09-14T11:17:07.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.494+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16__shadow_.Poo_6n4s4wIF7PnpbQytAdeAt9KmqIX_0 2024-09-14T11:17:07.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.494+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2475078482169370415', time=2024-09-14T13:07:51.533522+0000, chain.objs.size()=3 2024-09-14T11:17:07.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.494+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-STANDARD.2~0jG6d4gwrfrm53JSkpLZl1StL3MBE2C.1 2024-09-14T11:17:07.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.495+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-STANDARD.2~0jG6d4gwrfrm53JSkpLZl1StL3MBE2C.2 2024-09-14T11:17:07.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.495+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-STANDARD.2~0jG6d4gwrfrm53JSkpLZl1StL3MBE2C.3 2024-09-14T11:17:07.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.495+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3631406520036894916', time=2024-09-14T13:09:58.532955+0000, chain.objs.size()=1 2024-09-14T11:17:07.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.495+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23__shadow_.iuTr46M4XlHLOOuj5dNu8vqtuhFFwMM_0 2024-09-14T11:17:07.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.495+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11548827419303172175', time=2024-09-14T13:10:34.136944+0000, chain.objs.size()=1 2024-09-14T11:17:07.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.495+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25__shadow_.K-ORgof7ggsossvDHRZnSabjNC_-dCx_0 2024-09-14T11:17:07.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.498+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14326297186195877898', time=2024-09-14T13:10:34.181265+0000, chain.objs.size()=1 2024-09-14T11:17:07.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.498+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25__shadow_.H6EMgAq1eYy1eCXwNIYanZG5SxYzIO2_0 2024-09-14T11:17:07.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.499+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16544950733186012060', time=2024-09-14T13:10:37.127383+0000, chain.objs.size()=1 2024-09-14T11:17:07.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.499+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26__shadow_.CL8fIOkMMfRZqqJ3miuggp74xxZpQnc_0 2024-09-14T11:17:07.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.499+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18105238671003252788', time=2024-09-14T13:11:15.584180+0000, chain.objs.size()=1 2024-09-14T11:17:07.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.499+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29__shadow_.E9Ocq3hfLapVlwNvNrt9wsYVyvhxAnj_0 2024-09-14T11:17:07.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.499+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1537011783853389317', time=2024-09-14T13:11:15.619726+0000, chain.objs.size()=1 2024-09-14T11:17:07.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.499+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29__shadow_.L79BK0qmsQNeoAdIrdinJ_xIPmYLvXU_0 2024-09-14T11:17:07.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.499+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9954266746506740164', time=2024-09-14T13:11:52.242966+0000, chain.objs.size()=1 2024-09-14T11:17:07.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.499+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31__shadow_.0dXfn4gk9XWAshrxJ6n-OonJYbH32CA_0 2024-09-14T11:17:07.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.499+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12564224556661200595', time=2024-09-14T13:11:52.244630+0000, chain.objs.size()=1 2024-09-14T11:17:07.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.499+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31__shadow_.MGbzD08FIlnJUUOg1eVbSjhfnZsv5MB_0 2024-09-14T11:17:07.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.499+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17401996465686220086', time=2024-09-14T13:11:54.491107+0000, chain.objs.size()=1 2024-09-14T11:17:07.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.499+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32__shadow_.OB1g6j79s_xciJimlfl9LmU0Hkrausa_0 2024-09-14T11:17:07.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.499+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8050349268187208645', time=2024-09-14T13:11:54.506360+0000, chain.objs.size()=1 2024-09-14T11:17:07.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.499+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32__shadow_.I0Ie3fWbBVhes3B24mdOwaozIC4TzkT_0 2024-09-14T11:17:07.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.499+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3174994430477051104', time=2024-09-14T13:12:28.044908+0000, chain.objs.size()=1 2024-09-14T11:17:07.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.499+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33__shadow_.gr7V4NFeuiHmH0V6Hckab66bGm7WkMs_0 2024-09-14T11:17:07.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.500+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7865534150820459091', time=2024-09-14T13:12:30.929211+0000, chain.objs.size()=1 2024-09-14T11:17:07.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.500+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34__shadow_.wk1R_4GHbQUA6PTZ0CEpxrffIcFCIjl_0 2024-09-14T11:17:07.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.500+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5798286511182604895', time=2024-09-14T13:12:30.929969+0000, chain.objs.size()=1 2024-09-14T11:17:07.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.500+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34__shadow_.Ma2kA9J-By9Gavp2qEp5hoZj05vSj8I_0 2024-09-14T11:17:07.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.500+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8864827162952944880', time=2024-09-14T13:13:07.096362+0000, chain.objs.size()=1 2024-09-14T11:17:07.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.500+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36__shadow_.X758EL7o8FAKOSEm8fpVCdmpgRw6rJn_0 2024-09-14T11:17:07.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.503+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8458321222973491494', time=2024-09-14T13:13:40.651249+0000, chain.objs.size()=1 2024-09-14T11:17:07.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.503+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37__shadow_.tBSe8z2N392XcjJSBGV68FXqWYmG1rr_0 2024-09-14T11:17:07.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.503+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4516694204943773653', time=2024-09-14T13:13:40.669978+0000, chain.objs.size()=1 2024-09-14T11:17:07.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.503+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37__shadow_.4egCDDii-omhQIEn2Z6C8co9NRUKtPy_0 2024-09-14T11:17:07.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.504+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13454629260550297533', time=2024-09-14T13:14:18.919307+0000, chain.objs.size()=1 2024-09-14T11:17:07.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.504+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40__shadow_.d_9htD5WqOO7uk02vcS7qKGDPhU4KaA_0 2024-09-14T11:17:07.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.504+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16564655821531354011', time=2024-09-14T13:14:18.967633+0000, chain.objs.size()=1 2024-09-14T11:17:07.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.504+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40__shadow_.b0ATjrCTSp9VSWBV7I1yfJxP8Xx5yDC_0 2024-09-14T11:17:07.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.507+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.509+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:17:07.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.511+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.511+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-14T11:17:07.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='_nD_rPoU3FjMOY2uQc0mzwbK3Hw5nkXi', time=2024-09-14T13:07:51.437436+0000, chain.objs.size()=1 2024-09-14T11:17:07.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16__shadow_.-SKQeI0HXeE18Goi_UlTK_JhLeYEQRr_0 2024-09-14T11:17:07.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16801211060307991798', time=2024-09-14T13:09:18.842265+0000, chain.objs.size()=1 2024-09-14T11:17:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20__shadow_.gA3mKhKE-dNbvu9f_RRU4X5l1RkwQl__0 2024-09-14T11:17:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8320757822219547291', time=2024-09-14T13:09:55.110590+0000, chain.objs.size()=1 2024-09-14T11:17:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22__shadow_.6JNhiLzQt9KyKKEkVX6eFlJV0X0BR4d_0 2024-09-14T11:17:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15911216479612941053', time=2024-09-14T13:09:55.136444+0000, chain.objs.size()=1 2024-09-14T11:17:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22__shadow_.kgLjvWj__eYXTqLa0snCH-zTcpOxglY_0 2024-09-14T11:17:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7140163377126700442', time=2024-09-14T13:09:58.487762+0000, chain.objs.size()=1 2024-09-14T11:17:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23__shadow_.xC5T5oB4NhBB8wKK4v-f1US5ty0K6bw_0 2024-09-14T11:17:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14023160536277779474', time=2024-09-14T13:09:58.553683+0000, chain.objs.size()=1 2024-09-14T11:17:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23__shadow_.JOOziR2swLBbB4X2zlwHvNQXC_lt4BJ_0 2024-09-14T11:17:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8378449850657801053', time=2024-09-14T13:10:00.847253+0000, chain.objs.size()=1 2024-09-14T11:17:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24__shadow_.aIH452iRBhB9djgNmb-31m6_-c3CmAt_0 2024-09-14T11:17:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10575116134801050281', time=2024-09-14T13:10:02.838161+0000, chain.objs.size()=1 2024-09-14T11:17:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25__shadow_.3N2Ro2G7jJRYbiJI2GnKFM9_APnb02g_0 2024-09-14T11:17:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14221688648785545267', time=2024-09-14T13:10:39.405250+0000, chain.objs.size()=1 2024-09-14T11:17:07.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27__shadow_.HIEGIR9psQngUG5rmBqBj-MQvMQ8KJR_0 2024-09-14T11:17:07.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3402922096920725864', time=2024-09-14T13:10:39.427630+0000, chain.objs.size()=1 2024-09-14T11:17:07.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27__shadow_.r7FBkQhcQp7Gh1g8DodkUoUCM0L0Fzh_0 2024-09-14T11:17:07.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3607416560544920870', time=2024-09-14T13:11:12.964358+0000, chain.objs.size()=1 2024-09-14T11:17:07.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28__shadow_.Oi15IgqY2fwoHV04ImELXsxeJSP3u6K_0 2024-09-14T11:17:07.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3880748491911593305', time=2024-09-14T13:11:15.613466+0000, chain.objs.size()=1 2024-09-14T11:17:07.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.512+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29__shadow_.VYmMTdxU2udkk9tGVzy_L39_ROkqNPb_0 2024-09-14T11:17:07.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.515+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16160997207305208678', time=2024-09-14T13:11:49.172613+0000, chain.objs.size()=1 2024-09-14T11:17:07.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.515+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30__shadow_.pnBYphuAvFNhvTFnhFrSmU14oCb36qI_0 2024-09-14T11:17:07.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.515+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17684300570193563452', time=2024-09-14T13:11:54.448292+0000, chain.objs.size()=1 2024-09-14T11:17:07.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.515+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32__shadow_.Om1CqKikVvNXFV0Hlm3cJ_-vCLzAWoE_0 2024-09-14T11:17:07.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.515+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5954217554179699049', time=2024-09-14T13:11:54.512390+0000, chain.objs.size()=1 2024-09-14T11:17:07.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.515+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32__shadow_.gdhp-6tC_gpOP73NqGMl0BhwnYcIKuj_0 2024-09-14T11:17:07.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.515+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3882687626838257716', time=2024-09-14T13:12:28.083167+0000, chain.objs.size()=1 2024-09-14T11:17:07.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.515+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33__shadow_.MyZJhe1h7yit29zZ5rIlwlaUVZxlOeo_0 2024-09-14T11:17:07.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.515+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.295301565382372305', time=2024-09-14T13:12:30.885711+0000, chain.objs.size()=1 2024-09-14T11:17:07.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.515+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34__shadow_.6k-18UNaVaX3ynguTalGBG8ye4AsjLW_0 2024-09-14T11:17:07.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.516+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.289020970524638796', time=2024-09-14T13:13:40.724899+0000, chain.objs.size()=1 2024-09-14T11:17:07.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.516+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37__shadow_.--oILatVp2psJlzGSZtDGLhupThah8d_0 2024-09-14T11:17:07.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.516+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6710674427732749216', time=2024-09-14T13:13:43.490002+0000, chain.objs.size()=1 2024-09-14T11:17:07.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.516+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38__shadow_.CpkX7ErfV6Qlb84WIvt-CgnPzliH6pu_0 2024-09-14T11:17:07.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.516+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3208553626218175924', time=2024-09-14T13:14:18.935892+0000, chain.objs.size()=1 2024-09-14T11:17:07.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.516+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40__shadow_.mciH8_iRwue0GvY2wdAYTh5IRxtFyDX_0 2024-09-14T11:17:07.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.520+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.522+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:17:07.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.524+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.524+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.525+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:17:07.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.525+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3232164277003818', time=2024-09-14T13:09:18.860006+0000, chain.objs.size()=1 2024-09-14T11:17:07.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.525+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20__shadow_.8IkC_A3CGv8-_MHR-s9OmBwYTp_u-DM_0 2024-09-14T11:17:07.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.525+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10240555009819765682', time=2024-09-14T13:09:21.066367+0000, chain.objs.size()=1 2024-09-14T11:17:07.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.525+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21__shadow_.G-2RqnBIHwVBMJj7jQpDw1oFJb5kNAM_0 2024-09-14T11:17:07.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.525+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6653096674236100943', time=2024-09-14T13:11:15.639721+0000, chain.objs.size()=1 2024-09-14T11:17:07.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.525+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29__shadow_.YtxZxyQU6r655QwIdEh1X08z58vo4o4_0 2024-09-14T11:17:07.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.525+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.656173232402792645', time=2024-09-14T13:13:43.548703+0000, chain.objs.size()=1 2024-09-14T11:17:07.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.525+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38__shadow_.jqhOnokAFV84lZfKNLCmnXCB9fK3Xzd_0 2024-09-14T11:17:07.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.525+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6483000890050181117', time=2024-09-14T13:13:43.555548+0000, chain.objs.size()=1 2024-09-14T11:17:07.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.525+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38__shadow_.nAiFimmRI_N8IEMVFc2wdv1Z7AHfKWP_0 2024-09-14T11:17:07.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.527+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.529+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:17:07.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.531+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.531+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:17:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3109724667514857384', time=2024-09-14T13:09:18.888504+0000, chain.objs.size()=1 2024-09-14T11:17:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20__shadow_.541wnyXsZEH_34Kar0uaPY6B25A5-Tn_0 2024-09-14T11:17:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1502389029922847211', time=2024-09-14T13:09:21.072836+0000, chain.objs.size()=1 2024-09-14T11:17:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21__shadow_.wrUOPEeL4aTAquXsMJcR6rb8ctslv0m_0 2024-09-14T11:17:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1319168298497506101', time=2024-09-14T13:10:00.795953+0000, chain.objs.size()=1 2024-09-14T11:17:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24__shadow_.oAVc6VGlCguDL2m0Lbif0TJWQWHqlbf_0 2024-09-14T11:17:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3135556261117928735', time=2024-09-14T13:10:00.797481+0000, chain.objs.size()=1 2024-09-14T11:17:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24__shadow_.qudFeBE28LDPbkBk-mlGEZHWdZnsxMX_0 2024-09-14T11:17:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8097735772665963347', time=2024-09-14T13:10:34.092225+0000, chain.objs.size()=1 2024-09-14T11:17:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25__shadow_.c2qE93-GK7Vd0cPuCOB2BBOa7E_N4km_0 2024-09-14T11:17:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6576738430124198475', time=2024-09-14T13:10:34.148907+0000, chain.objs.size()=1 2024-09-14T11:17:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25__shadow_.lvGfBJ99bn5KBfuF4m_eROLYSQFALEz_0 2024-09-14T11:17:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10039549231549202603', time=2024-09-14T13:10:37.115124+0000, chain.objs.size()=1 2024-09-14T11:17:07.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26__shadow_.7aKCY2-u5WnaVLMpy3AOuD8MlzvYGrG_0 2024-09-14T11:17:07.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14192384153957171539', time=2024-09-14T13:10:37.176815+0000, chain.objs.size()=1 2024-09-14T11:17:07.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26__shadow_.oNqJqZbbuvvP8ffO8z1l-P-AyVaiTOc_0 2024-09-14T11:17:07.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15630964855106188244', time=2024-09-14T13:10:39.409673+0000, chain.objs.size()=1 2024-09-14T11:17:07.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27__shadow_.HT8J3NkoeJdsvMm9HkGtoW1c-_02wm3_0 2024-09-14T11:17:07.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2604024794687579943', time=2024-09-14T13:13:40.687568+0000, chain.objs.size()=1 2024-09-14T11:17:07.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37__shadow_.xTb120hWUw1LfdX45p00iWghfWTvyN5_0 2024-09-14T11:17:07.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15533042435801648183', time=2024-09-14T13:14:18.969569+0000, chain.objs.size()=1 2024-09-14T11:17:07.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40__shadow_.AHCDhC5gNVlFQKtnugLB4L38xpGFe8V_0 2024-09-14T11:17:07.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11152858561814597092', time=2024-09-14T13:16:28.947356+0000, chain.objs.size()=1 2024-09-14T11:17:07.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.532+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18__shadow_.nSESZWGcfrGxu0leCC2gKqUoqXbZUmE_0 2024-09-14T11:17:07.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.537+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.539+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:17:07.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.540+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.541+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.541+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:17:07.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.541+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17289625113572889339', time=2024-09-14T13:07:51.297743+0000, chain.objs.size()=1 2024-09-14T11:17:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.541+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5__shadow_.LTl_MPmMQEu0zRNIp50OqyyIT7g2zDR_0 2024-09-14T11:17:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.541+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='_6aeGc8oNey1pZOqOCRV9FWa6UxSUw49', time=2024-09-14T13:07:51.517203+0000, chain.objs.size()=2 2024-09-14T11:17:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.541+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__shadow_.b5_mbvghoZu5NHJRDgqkB3BqMMA_0xz_0 2024-09-14T11:17:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.542+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__shadow_.b5_mbvghoZu5NHJRDgqkB3BqMMA_0xz_1 2024-09-14T11:17:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.542+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17691222531094122194', time=2024-09-14T13:09:21.114552+0000, chain.objs.size()=1 2024-09-14T11:17:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.542+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21__shadow_.78REce_W6ZCoMYwuxkUaN9MRwmyybds_0 2024-09-14T11:17:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.542+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1136619962349052427', time=2024-09-14T13:09:21.115128+0000, chain.objs.size()=1 2024-09-14T11:17:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.542+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21__shadow_.U2rKhJoNzL2hrbgkwwIBmOKdc6yWf0u_0 2024-09-14T11:17:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.542+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2543383202294451704', time=2024-09-14T13:10:39.407670+0000, chain.objs.size()=1 2024-09-14T11:17:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.542+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27__shadow_.SXGYJ9S5OpGD_TdLKzVVqkeq9XTjshr_0 2024-09-14T11:17:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.542+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8969356513431573589', time=2024-09-14T13:10:39.466919+0000, chain.objs.size()=1 2024-09-14T11:17:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.542+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27__shadow_.x2ainNOf4nK_YQOh0kTlDilWHDgBWA8_0 2024-09-14T11:17:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.542+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2776625006786942341', time=2024-09-14T13:11:49.222514+0000, chain.objs.size()=1 2024-09-14T11:17:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.542+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30__shadow_.lSQGuuGQt--9B53pTYrTPzBAXNpwMQV_0 2024-09-14T11:17:07.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.542+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16936729982648050128', time=2024-09-14T13:11:52.232516+0000, chain.objs.size()=1 2024-09-14T11:17:07.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.542+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31__shadow_.-z6fQbu_q9HlONl9g3e3LVOcwFrAX01_0 2024-09-14T11:17:07.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.542+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17764860055341940030', time=2024-09-14T13:12:28.046306+0000, chain.objs.size()=1 2024-09-14T11:17:07.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.542+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33__shadow_.WhFrp8ulV--abS0UzJGlvojVE3AEKZF_0 2024-09-14T11:17:07.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.542+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4102252950139951279', time=2024-09-14T13:12:30.929014+0000, chain.objs.size()=1 2024-09-14T11:17:07.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.542+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34__shadow_.hYrH64tqa5u8iWGq9ubCdb_T4QLrwqF_0 2024-09-14T11:17:07.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.542+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10418638271616074672', time=2024-09-14T13:13:43.461945+0000, chain.objs.size()=1 2024-09-14T11:17:07.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.542+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38__shadow_.MzxFQVhSyue52EapVT3C-hpz279ajQk_0 2024-09-14T11:17:07.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.546+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16171711950361063218', time=2024-09-14T13:13:43.497096+0000, chain.objs.size()=1 2024-09-14T11:17:07.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.546+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38__shadow_.OXBE8PjoEyZ7gaFYuMo12P8E-RQIa3v_0 2024-09-14T11:17:07.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.548+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.550+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:17:07.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.551+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.551+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.552+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:17:07.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.552+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='_A3NaWN4383hYdxC7yer8aOO1SmIVZdE', time=2024-09-14T13:07:51.525158+0000, chain.objs.size()=2 2024-09-14T11:17:07.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.552+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__shadow_.q1ER_zf-LLOQoklZCMQQMZOQc00o5Ox_0 2024-09-14T11:17:07.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.552+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__shadow_.q1ER_zf-LLOQoklZCMQQMZOQc00o5Ox_1 2024-09-14T11:17:07.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.552+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9500340700108960791', time=2024-09-14T13:09:21.115769+0000, chain.objs.size()=1 2024-09-14T11:17:07.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.552+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21__shadow_.4o_9LnkDVxkWkQpjPTA94TdHjROjU78_0 2024-09-14T11:17:07.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.552+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9320329137525772775', time=2024-09-14T13:09:55.111127+0000, chain.objs.size()=1 2024-09-14T11:17:07.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.552+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22__shadow_.mz2psXHW_S1vH4bBAp4trF4mUKCmMkQ_0 2024-09-14T11:17:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.552+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4649315305204905701', time=2024-09-14T13:09:58.519084+0000, chain.objs.size()=1 2024-09-14T11:17:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.552+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23__shadow_.RJ4dcguMMq7zGieZcnVYnasT-uTguqB_0 2024-09-14T11:17:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.552+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1066407162301357560', time=2024-09-14T13:10:00.760270+0000, chain.objs.size()=1 2024-09-14T11:17:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.552+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24__shadow_.N1zq1LUBqxfDIprHzZCbPBBxfZxecoE_0 2024-09-14T11:17:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.552+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8670459559840561146', time=2024-09-14T13:10:39.405324+0000, chain.objs.size()=1 2024-09-14T11:17:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.552+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27__shadow_.tcy37CFOzeNGagIYtIF3TgmpDOMutnz_0 2024-09-14T11:17:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.552+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8400257131491736864', time=2024-09-14T13:10:39.472884+0000, chain.objs.size()=1 2024-09-14T11:17:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.552+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27__shadow_.ICD3UIy-wpo_MQDqp7j7DMTlkA7aOst_0 2024-09-14T11:17:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.552+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12707294004694442567', time=2024-09-14T13:11:54.484315+0000, chain.objs.size()=1 2024-09-14T11:17:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.552+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32__shadow_.i3aWxoqKFopy7eCr6h2cfvDgtiCqLg__0 2024-09-14T11:17:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.552+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6039523410469591487', time=2024-09-14T13:12:26.921137+0000, chain.objs.size()=1 2024-09-14T11:17:07.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.552+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33__shadow_.9WtRFGhfv6dsnWiZ2Qk7KmQvjW_TYn3_0 2024-09-14T11:17:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.552+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4664627107990746305', time=2024-09-14T13:12:28.023714+0000, chain.objs.size()=1 2024-09-14T11:17:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.552+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33__shadow_.VdmV2mUqgYZEzah8CQTTmleUy_9Qqz7_0 2024-09-14T11:17:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.552+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11235609566880410518', time=2024-09-14T13:12:28.049189+0000, chain.objs.size()=1 2024-09-14T11:17:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.552+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33__shadow_.PO-YdFoebSu30FGGrklgyhg1Zs4j0YV_0 2024-09-14T11:17:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.554+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6230733651040750299', time=2024-09-14T13:12:28.111805+0000, chain.objs.size()=1 2024-09-14T11:17:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.554+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33__shadow_.EMNbvoUIcb4d-CbWlEzRmOgBRTnNigi_0 2024-09-14T11:17:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.554+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1492694514939769776', time=2024-09-14T13:13:07.108150+0000, chain.objs.size()=1 2024-09-14T11:17:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.554+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36__shadow_._bKWAHe3X1DFd47fdFv6Bs6dS4zWOaE_0 2024-09-14T11:17:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.555+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17437942676901020156', time=2024-09-14T13:13:07.160554+0000, chain.objs.size()=1 2024-09-14T11:17:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.555+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36__shadow_.QmcZAvPi6Ku0G9NMVIg7aQ7NE5w-lSB_0 2024-09-14T11:17:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.555+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16477901879915914207', time=2024-09-14T13:16:28.951843+0000, chain.objs.size()=1 2024-09-14T11:17:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.555+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18__shadow_.dsSNVJcwoDQGogcZiAX5BYDeDZCl9we_0 2024-09-14T11:17:07.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.556+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11895082921212025360', time=2024-09-14T13:16:28.952639+0000, chain.objs.size()=1 2024-09-14T11:17:07.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.556+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18__shadow_.03P7YyyJZFWR_rp0cZGDlR3rH9gBIB4_0 2024-09-14T11:17:07.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.559+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.562+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:17:07.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.563+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.563+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T11:17:07.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='_tSVAbx7BJSA7fbWXrvVQDNvuq6uL7x0', time=2024-09-14T13:07:51.449206+0000, chain.objs.size()=1 2024-09-14T11:17:07.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16__shadow_.fOaDXsbjghIHoekDGqgcf7ISKop2bmQ_0 2024-09-14T11:17:07.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263614238411205771', time=2024-09-14T13:09:18.845144+0000, chain.objs.size()=1 2024-09-14T11:17:07.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20__shadow_.HcOi-FcnnbAvPD8HhrWRDGcSOc-MwNH_0 2024-09-14T11:17:07.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5810427866706977254', time=2024-09-14T13:09:18.846283+0000, chain.objs.size()=1 2024-09-14T11:17:07.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20__shadow_.KMNisjP40c6Ogh0dbOEwnFKhEjUnPze_0 2024-09-14T11:17:07.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15837225996485635431', time=2024-09-14T13:09:21.122653+0000, chain.objs.size()=1 2024-09-14T11:17:07.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21__shadow_.YTL_gMaiWPqWQt8kgiMOAEvpVWMxfQu_0 2024-09-14T11:17:07.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5223584167415526964', time=2024-09-14T13:09:21.123728+0000, chain.objs.size()=1 2024-09-14T11:17:07.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21__shadow_.lUNLJWWgmZYMQXjlyQrkowI4l3bd7Mz_0 2024-09-14T11:17:07.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7801168272946483942', time=2024-09-14T13:09:58.565615+0000, chain.objs.size()=1 2024-09-14T11:17:07.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23__shadow_.-6uQpVsT8ZAyvoI_HIoV70g_ahLD0Zc_0 2024-09-14T11:17:07.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16657582703806818434', time=2024-09-14T13:09:58.585601+0000, chain.objs.size()=1 2024-09-14T11:17:07.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23__shadow_.axenO7PwZWB1w4QZrvB2qOAhJCGt2b9_0 2024-09-14T11:17:07.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15904271733732575981', time=2024-09-14T13:10:34.167564+0000, chain.objs.size()=1 2024-09-14T11:17:07.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25__shadow_.u9ZcSbtJawQe0pJDre969zHffqIz2lZ_0 2024-09-14T11:17:07.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10479111326026134212', time=2024-09-14T13:11:15.674345+0000, chain.objs.size()=1 2024-09-14T11:17:07.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29__shadow_.9X5dhkFcfsXYGtVXCOfBIWY4HQiQc4L_0 2024-09-14T11:17:07.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9462384570205064977', time=2024-09-14T13:12:28.084958+0000, chain.objs.size()=1 2024-09-14T11:17:07.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33__shadow_.Wdu3diueR6kVNxDIzc-22v3EUTTT6OW_0 2024-09-14T11:17:07.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18272783813065981482', time=2024-09-14T13:13:04.325274+0000, chain.objs.size()=1 2024-09-14T11:17:07.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35__shadow_.HUoztleYpfePBHn_YFfgTOQhhWMV7xo_0 2024-09-14T11:17:07.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18053189124843076791', time=2024-09-14T13:13:40.649825+0000, chain.objs.size()=1 2024-09-14T11:17:07.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.564+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37__shadow_.FdlOLgrKjOUhJxDL23ST0uCVWvpyeAN_0 2024-09-14T11:17:07.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.567+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1868422085432345185', time=2024-09-14T13:13:43.496325+0000, chain.objs.size()=1 2024-09-14T11:17:07.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.567+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38__shadow_.po_8O__pEa_7WpHwnO3PN3sb0hvf-sB_0 2024-09-14T11:17:07.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.567+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10771928566246787672', time=2024-09-14T13:13:43.496974+0000, chain.objs.size()=1 2024-09-14T11:17:07.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.567+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38__shadow_.YC2mIaecYvSWhpWqyj7Rbo99ALVFQus_0 2024-09-14T11:17:07.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.570+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.572+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:17:07.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.574+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.574+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.574+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-14T11:17:07.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.574+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6238541936918323431', time=2024-09-14T13:07:51.301827+0000, chain.objs.size()=1 2024-09-14T11:17:07.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.574+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5__shadow_.LB0LWSGukpkUmDwriRqffE0drmlF-y0_0 2024-09-14T11:17:07.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.574+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3871475956472546270', time=2024-09-14T13:07:51.537040+0000, chain.objs.size()=3 2024-09-14T11:17:07.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.574+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-LUKEWARM.2~CDRUTXG2lzRsIf4XGkea1lvh6F-PK1h.1 2024-09-14T11:17:07.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.574+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-LUKEWARM.2~CDRUTXG2lzRsIf4XGkea1lvh6F-PK1h.2 2024-09-14T11:17:07.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.574+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-LUKEWARM.2~CDRUTXG2lzRsIf4XGkea1lvh6F-PK1h.3 2024-09-14T11:17:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.574+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7567635046200003040', time=2024-09-14T13:09:18.903131+0000, chain.objs.size()=1 2024-09-14T11:17:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.574+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20__shadow_.UYIR3kJomg5uRoTx60GU4mjT19DElzV_0 2024-09-14T11:17:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.574+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8933706756064325163', time=2024-09-14T13:09:58.589487+0000, chain.objs.size()=1 2024-09-14T11:17:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.574+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23__shadow_.4V22VKXLCPMLJBctTsyqBJYIBDP-o-F_0 2024-09-14T11:17:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.574+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5712483441965295302', time=2024-09-14T13:10:37.157940+0000, chain.objs.size()=1 2024-09-14T11:17:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.574+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26__shadow_.qdMxbxZa5rcKtl_NlVK_YHVyUwlsgtE_0 2024-09-14T11:17:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.574+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14309560476056862351', time=2024-09-14T13:10:39.375219+0000, chain.objs.size()=1 2024-09-14T11:17:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.574+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27__shadow_.9ItyuLzh1hubkmQMFUDt1wk3ty5uW4a_0 2024-09-14T11:17:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.574+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17992330265534100830', time=2024-09-14T13:11:49.139350+0000, chain.objs.size()=1 2024-09-14T11:17:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.574+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30__shadow_.IdssdDHqWAbqcwp7g2FVoD0eV5ISOlW_0 2024-09-14T11:17:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.574+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15381969773274680657', time=2024-09-14T13:11:52.288060+0000, chain.objs.size()=1 2024-09-14T11:17:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.574+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31__shadow_.gVuj6WGClYTz8ocEWeO_5JUGWMZGi40_0 2024-09-14T11:17:07.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.575+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1291509177713813202', time=2024-09-14T13:12:30.944520+0000, chain.objs.size()=1 2024-09-14T11:17:07.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.575+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34__shadow_.TBU2aeBfVxdi1g1Ws0-1dvIIXKHiNAs_0 2024-09-14T11:17:07.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.575+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7027615219153573752', time=2024-09-14T13:12:30.945205+0000, chain.objs.size()=1 2024-09-14T11:17:07.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.575+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34__shadow_.mxXY9q1GdjkfkhVPQqLCei9CI003MXY_0 2024-09-14T11:17:07.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.577+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2770255163957882605', time=2024-09-14T13:12:30.971438+0000, chain.objs.size()=1 2024-09-14T11:17:07.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.577+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34__shadow_.mAPahM3VwZpjhWVRPE4-DivhY8CFNWV_0 2024-09-14T11:17:07.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.577+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4266097470029324670', time=2024-09-14T13:13:04.311586+0000, chain.objs.size()=1 2024-09-14T11:17:07.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.577+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35__shadow_.Q7dGW6aieefGMzgSa2bePpBoETCVxQl_0 2024-09-14T11:17:07.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.577+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1743381644590786888', time=2024-09-14T13:13:04.352927+0000, chain.objs.size()=1 2024-09-14T11:17:07.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.577+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35__shadow_.BLbLNwLhaftDqtIKs9n6-t73JC7wY6V_0 2024-09-14T11:17:07.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.577+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13916709784931227228', time=2024-09-14T13:13:07.094007+0000, chain.objs.size()=1 2024-09-14T11:17:07.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.577+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36__shadow_.wzgBvMaYWvaUObxLbNhTThdwipZhYb4_0 2024-09-14T11:17:07.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.577+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4828713049881062762', time=2024-09-14T13:13:07.094962+0000, chain.objs.size()=1 2024-09-14T11:17:07.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.577+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36__shadow_._G0nWXhnXOdxCfGBvxhMVUwAJUoCte1_0 2024-09-14T11:17:07.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.577+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2842493690445507749', time=2024-09-14T13:13:42.565690+0000, chain.objs.size()=1 2024-09-14T11:17:07.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.578+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38__shadow_.BHCVIjnko8uMl_4_PxQ8NcaU-24NpSV_0 2024-09-14T11:17:07.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.578+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12454327389212449627', time=2024-09-14T13:13:43.534428+0000, chain.objs.size()=1 2024-09-14T11:17:07.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.578+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38__shadow_.3I1qmahQEyfCKugu28YL-ZYfeyTTHQD_0 2024-09-14T11:17:07.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.578+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9633028437309115816', time=2024-09-14T13:13:45.570770+0000, chain.objs.size()=1 2024-09-14T11:17:07.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.578+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39__shadow_.j7P1ETaJpUKaWrE8fIn6prXscdptuED_0 2024-09-14T11:17:07.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.578+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16332336420023504970', time=2024-09-14T13:14:18.912874+0000, chain.objs.size()=1 2024-09-14T11:17:07.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.578+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40__shadow_.7ferA-ylcdV36GZ_dObdBPLo4xnHkH-_0 2024-09-14T11:17:07.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.578+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17419575178540400556', time=2024-09-14T13:16:28.947416+0000, chain.objs.size()=1 2024-09-14T11:17:07.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.578+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18__shadow_.StI0lI5iaauN24r7buBQto8Hq7-pv8u_0 2024-09-14T11:17:07.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.582+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.585+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:17:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.586+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.586+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.587+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T11:17:07.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.587+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='_z_wjqiMQVmwmFeJtnemqeZaU3UQLYR8', time=2024-09-14T13:07:51.512826+0000, chain.objs.size()=2 2024-09-14T11:17:07.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.587+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__shadow_.E6bmTGdeciN1MqCzCxK6quWgwEc-IDX_0 2024-09-14T11:17:07.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.587+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__shadow_.E6bmTGdeciN1MqCzCxK6quWgwEc-IDX_1 2024-09-14T11:17:07.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.587+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2410705584116414409', time=2024-09-14T13:07:51.597746+0000, chain.objs.size()=2 2024-09-14T11:17:07.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.587+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14__shadow_.VQdIjRQ5CHXncTMR-Hs6E0SszR4o6i9_0 2024-09-14T11:17:07.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.587+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14__shadow_.VQdIjRQ5CHXncTMR-Hs6E0SszR4o6i9_1 2024-09-14T11:17:07.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.587+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5286863150212645270', time=2024-09-14T13:07:51.670164+0000, chain.objs.size()=1 2024-09-14T11:17:07.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.587+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8__shadow_.EHcUmSBlvL2m_Kl2JNUsI0YPqSJdc9b_0 2024-09-14T11:17:07.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.587+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4002513893629586833', time=2024-09-14T13:09:58.565288+0000, chain.objs.size()=1 2024-09-14T11:17:07.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.587+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23__shadow_.RB5HIPxTXckVpGjj3nd_wC-OGHoNWAi_0 2024-09-14T11:17:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.587+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15451292395729548452', time=2024-09-14T13:10:00.757950+0000, chain.objs.size()=1 2024-09-14T11:17:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.587+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24__shadow_.3DIVjGxjwwYSxpFJCqbJz7H4tKOf2ww_0 2024-09-14T11:17:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.587+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2769266547091773660', time=2024-09-14T13:11:52.258718+0000, chain.objs.size()=1 2024-09-14T11:17:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.587+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31__shadow_.THWTIW6G4aw2EvvU4qXq2OZdPU8SgKE_0 2024-09-14T11:17:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.587+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4201813618082669115', time=2024-09-14T13:11:52.262383+0000, chain.objs.size()=1 2024-09-14T11:17:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.587+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31__shadow_.xvtPg0ZohXD61Z59OshFFw_Af2eeQBw_0 2024-09-14T11:17:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.587+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14589534628472567583', time=2024-09-14T13:13:04.327955+0000, chain.objs.size()=1 2024-09-14T11:17:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.587+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35__shadow_.AFUyEim0b1mTd5iXUyNfXRs3brSkk2b_0 2024-09-14T11:17:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.587+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12557402246224162412', time=2024-09-14T13:14:18.975460+0000, chain.objs.size()=1 2024-09-14T11:17:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.587+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40__shadow_.VSGHSOjNYn7KcSARzHJr44bbqOBQZay_0 2024-09-14T11:17:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.587+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6316503264348502605', time=2024-09-14T13:14:19.007349+0000, chain.objs.size()=1 2024-09-14T11:17:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.587+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40__shadow_.SSCFa0yilTdXhWLnidYumUYiN7yIi0H_0 2024-09-14T11:17:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.592+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.594+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:17:07.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.595+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T11:17:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4417027895011271388', time=2024-09-14T13:09:18.842272+0000, chain.objs.size()=1 2024-09-14T11:17:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20__shadow_.K-m50xh9KSZSpeCHXOWxgh6jwczfPGD_0 2024-09-14T11:17:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10586255982014094336', time=2024-09-14T13:09:55.111282+0000, chain.objs.size()=1 2024-09-14T11:17:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22__shadow_.Js4s_OrJvacNOLgEdBj7jd_c17bt4nw_0 2024-09-14T11:17:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6262583833708770088', time=2024-09-14T13:10:00.761397+0000, chain.objs.size()=1 2024-09-14T11:17:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24__shadow_.BjhHWFzYEzu6YnhBcX1KXG7LsgI2HH6_0 2024-09-14T11:17:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9061793226581106697', time=2024-09-14T13:10:00.786446+0000, chain.objs.size()=1 2024-09-14T11:17:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24__shadow_.3gwz1GX-IqdOh5cxUKwjDdzCgy2gWyD_0 2024-09-14T11:17:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15598520678107819143', time=2024-09-14T13:10:37.154130+0000, chain.objs.size()=1 2024-09-14T11:17:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26__shadow_.A2UDE5kXsQdNdqwvGC0qFeB7Joe3-RU_0 2024-09-14T11:17:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12940191972889386568', time=2024-09-14T13:10:37.194112+0000, chain.objs.size()=1 2024-09-14T11:17:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26__shadow_.soJWp3830nc3Lef0-hOuLsxR_1QN413_0 2024-09-14T11:17:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13339748562747486844', time=2024-09-14T13:10:37.208330+0000, chain.objs.size()=1 2024-09-14T11:17:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26__shadow_.Fvjv1a_8zUGPcG3nERAbAeQnzQ5mZLL_0 2024-09-14T11:17:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7594647599694773540', time=2024-09-14T13:11:13.050476+0000, chain.objs.size()=1 2024-09-14T11:17:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28__shadow_.5lniwv7lnri2Hk3JYxExL8X6txZ_QXj_0 2024-09-14T11:17:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4970712273883498142', time=2024-09-14T13:12:28.049186+0000, chain.objs.size()=1 2024-09-14T11:17:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33__shadow_.Qf46OROxipOVOGZnuVJGmIZv0WGXAqw_0 2024-09-14T11:17:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16759115533085667368', time=2024-09-14T13:12:30.872814+0000, chain.objs.size()=1 2024-09-14T11:17:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34__shadow_.55_hZ8O3dUM_dyWwwmi-6gxK18oD-Vc_0 2024-09-14T11:17:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12647689751657700937', time=2024-09-14T13:13:04.265844+0000, chain.objs.size()=1 2024-09-14T11:17:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35__shadow_.WzukmfUfMHh9W4abY5OakUFSoAPKSx5_0 2024-09-14T11:17:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9582406150015110797', time=2024-09-14T13:13:40.632832+0000, chain.objs.size()=1 2024-09-14T11:17:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.596+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37__shadow_.qOd8ZYowCq5hzk9OqtTwZ5n2YckyX94_0 2024-09-14T11:17:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.598+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14738698538909279742', time=2024-09-14T13:13:40.651787+0000, chain.objs.size()=1 2024-09-14T11:17:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.598+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37__shadow_.Wy5xlNBGQCIrR5vO9m8g9r5AUvmM39P_0 2024-09-14T11:17:07.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.601+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14996104737913057062', time=2024-09-14T13:13:45.555647+0000, chain.objs.size()=1 2024-09-14T11:17:07.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.601+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39__shadow_.eMU7nvVoizcBdMTyJImrVyiDOSGeB8E_0 2024-09-14T11:17:07.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.603+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.605+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:17:07.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.607+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.607+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.608+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-14T11:17:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.608+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11428621068554133429', time=2024-09-14T13:07:51.468819+0000, chain.objs.size()=1 2024-09-14T11:17:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.608+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16__shadow_.OtfDSzHopE6vv3iI75qKgxYUFqDfnJT_0 2024-09-14T11:17:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.608+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='_3B5P5K9msbqMFppKjYKw7ly6ux174-4', time=2024-09-14T13:07:51.500680+0000, chain.objs.size()=1 2024-09-14T11:17:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.608+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__shadow_.OWucWZCnFYIT2GDpk0cpoqDHBTOVtZl_0 2024-09-14T11:17:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.608+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11057791845662632237', time=2024-09-14T13:07:51.529400+0000, chain.objs.size()=3 2024-09-14T11:17:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.608+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-LUKEWARM.2~CDRUTXG2lzRsIf4XGkea1lvh6F-PK1h.1 2024-09-14T11:17:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.608+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-LUKEWARM.2~CDRUTXG2lzRsIf4XGkea1lvh6F-PK1h.2 2024-09-14T11:17:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.608+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-LUKEWARM.2~CDRUTXG2lzRsIf4XGkea1lvh6F-PK1h.3 2024-09-14T11:17:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.608+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8561769324153971103', time=2024-09-14T13:09:18.865661+0000, chain.objs.size()=1 2024-09-14T11:17:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.608+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20__shadow_.Bki3tBwbmLyM7dJqN2yBKtJCQFQ3-7q_0 2024-09-14T11:17:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.608+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7222623995033741949', time=2024-09-14T13:09:18.921056+0000, chain.objs.size()=1 2024-09-14T11:17:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.608+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20__shadow_.vOuNJJUoh7hg3WfHKa8sIZeV8jxUTcQ_0 2024-09-14T11:17:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.608+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2357333577112207446', time=2024-09-14T13:09:21.113131+0000, chain.objs.size()=1 2024-09-14T11:17:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.608+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21__shadow_.6oUzl711UCj-DLjUqZoR2LiQz1322eZ_0 2024-09-14T11:17:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.608+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5965846402278444793', time=2024-09-14T13:09:55.103360+0000, chain.objs.size()=1 2024-09-14T11:17:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.608+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22__shadow_.GuVK8EY02Fu4yMZ37tdz5olTD3VLGLL_0 2024-09-14T11:17:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.608+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13998521232778780494', time=2024-09-14T13:09:55.169717+0000, chain.objs.size()=1 2024-09-14T11:17:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.608+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22__shadow_.Zc-EXBnrBXagb-BeQMVhzOb9i2GOdTq_0 2024-09-14T11:17:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.608+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7700354791894426836', time=2024-09-14T13:09:58.533068+0000, chain.objs.size()=1 2024-09-14T11:17:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.608+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23__shadow_.dASAprQ7zkgLdQlowFAuMOdlFu2nG7E_0 2024-09-14T11:17:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.608+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7055034026046557333', time=2024-09-14T13:10:34.181448+0000, chain.objs.size()=1 2024-09-14T11:17:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.608+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25__shadow_.W4EFXwS0LCTV3Owhx0w-8c5ci8z9_WH_0 2024-09-14T11:17:07.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.611+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5263568804772439690', time=2024-09-14T13:10:39.370490+0000, chain.objs.size()=1 2024-09-14T11:17:07.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.611+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27__shadow_.9A3QgaUYAFRdmFQHvjVoJqppO6IfrC__0 2024-09-14T11:17:07.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.611+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1157897510656194498', time=2024-09-14T13:10:39.384634+0000, chain.objs.size()=1 2024-09-14T11:17:07.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.611+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27__shadow_.lE2RRtS2RrfksKUQa3qajmCI5Ubl724_0 2024-09-14T11:17:07.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.611+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1925897789707450092', time=2024-09-14T13:10:39.478562+0000, chain.objs.size()=1 2024-09-14T11:17:07.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.611+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27__shadow_.g-dO1DiAAsQjym9D8L_vpJDBKmD5hO3_0 2024-09-14T11:17:07.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.611+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8313678187540711577', time=2024-09-14T13:11:15.610871+0000, chain.objs.size()=1 2024-09-14T11:17:07.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.611+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29__shadow_.Hr2mgpMEaYhXi-497kSlsBIHvixPoUi_0 2024-09-14T11:17:07.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.611+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5480874371329819136', time=2024-09-14T13:11:49.146746+0000, chain.objs.size()=1 2024-09-14T11:17:07.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.611+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30__shadow_.tM5Z99GIDmVUuLeubRL5Z2SmT-x_j_9_0 2024-09-14T11:17:07.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.611+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6310692561917406379', time=2024-09-14T13:11:52.290894+0000, chain.objs.size()=1 2024-09-14T11:17:07.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.611+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31__shadow_.GMTSyS7GvZj3VUqjgMwTzwYXgQsZQ90_0 2024-09-14T11:17:07.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.611+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15186661526308824351', time=2024-09-14T13:11:52.295205+0000, chain.objs.size()=1 2024-09-14T11:17:07.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.611+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31__shadow_.GfbDK1D-3K841Xwj_MXdmT2IuMS2ZtG_0 2024-09-14T11:17:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.612+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5411124069864718679', time=2024-09-14T13:11:54.553843+0000, chain.objs.size()=1 2024-09-14T11:17:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.612+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32__shadow_.qHQUWbQ5LiM61ErE3iCaMinm4Q9Aw7t_0 2024-09-14T11:17:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.612+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6960399657570809962', time=2024-09-14T13:12:30.895281+0000, chain.objs.size()=1 2024-09-14T11:17:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.612+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34__shadow_.rfHfayVL0QDYib5vMvu-UGCBVE4Gam0_0 2024-09-14T11:17:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.612+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12922965561779538460', time=2024-09-14T13:12:30.896041+0000, chain.objs.size()=1 2024-09-14T11:17:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.612+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34__shadow_.WY22iEKHzwry5DSm74NfyNymhFVp5d4_0 2024-09-14T11:17:07.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.614+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2636014156859958662', time=2024-09-14T13:13:04.281574+0000, chain.objs.size()=1 2024-09-14T11:17:07.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.614+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35__shadow_.Dm0Ukass4ROsy8Pdh5m-YK0Wq76TXld_0 2024-09-14T11:17:07.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.614+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17176497817677563997', time=2024-09-14T13:13:04.311098+0000, chain.objs.size()=1 2024-09-14T11:17:07.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.614+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35__shadow_.UXarrKNVXU82tJHcxKwAoOCoMltRymf_0 2024-09-14T11:17:07.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.614+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9683915715421552382', time=2024-09-14T13:13:07.145533+0000, chain.objs.size()=1 2024-09-14T11:17:07.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.614+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36__shadow_.YFFu3PtVj6VcPZoZWOovPe0cnFAvKSs_0 2024-09-14T11:17:07.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.614+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4707846370660198793', time=2024-09-14T13:13:40.727873+0000, chain.objs.size()=1 2024-09-14T11:17:07.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.614+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37__shadow_.Ziz8T7x8oByroYbVZnEHQVIvy1A3xZG_0 2024-09-14T11:17:07.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.615+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.824647230689007394', time=2024-09-14T13:13:43.549545+0000, chain.objs.size()=1 2024-09-14T11:17:07.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.615+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38__shadow_.cM13vm0k2wHe0x-ejuUVAXDfSpSVQe9_0 2024-09-14T11:17:07.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.615+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4164302347192629963', time=2024-09-14T13:13:45.575976+0000, chain.objs.size()=1 2024-09-14T11:17:07.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.615+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39__shadow_.5xjA4fULEisdfIiwON4QN0kFZdv6sh0_0 2024-09-14T11:17:07.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.615+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17531453488172193874', time=2024-09-14T13:13:47.624632+0000, chain.objs.size()=1 2024-09-14T11:17:07.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.615+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40__shadow_.oP1Z8ITsGlk4OWisEswW-HHxz2CaCoP_0 2024-09-14T11:17:07.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.619+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.622+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:17:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.623+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.623+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.624+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-14T11:17:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.624+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5204238375223475990', time=2024-09-14T13:09:18.830015+0000, chain.objs.size()=1 2024-09-14T11:17:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.624+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20__shadow_.sQeEiEtLVb98JRIHeuM3zjpVMye0yOp_0 2024-09-14T11:17:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.624+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10115579898089488098', time=2024-09-14T13:10:34.083785+0000, chain.objs.size()=1 2024-09-14T11:17:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.624+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25__shadow_.6emtQk5c0wQJ4M1BYZuVfory2qG-6Nq_0 2024-09-14T11:17:07.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.624+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18262042771719562698', time=2024-09-14T13:11:12.964274+0000, chain.objs.size()=1 2024-09-14T11:17:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.624+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28__shadow_.FBCFytukzYj3drwKK-o4OyQ9XYsmei3_0 2024-09-14T11:17:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.624+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8646166783457193217', time=2024-09-14T13:11:12.999686+0000, chain.objs.size()=1 2024-09-14T11:17:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.624+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28__shadow_.3zOD3qOqmlAkXqNxi-dpgWEtlwthhaS_0 2024-09-14T11:17:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.624+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11715581974106581672', time=2024-09-14T13:11:13.022057+0000, chain.objs.size()=1 2024-09-14T11:17:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.624+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28__shadow_.l3hBfxdV7_Dwy2mk-_wZRbIJ-yelpbd_0 2024-09-14T11:17:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.624+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12003573372783972360', time=2024-09-14T13:11:15.613466+0000, chain.objs.size()=1 2024-09-14T11:17:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.624+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29__shadow_.0LAB7zmCgv0QaI7rVDhe6eXotRQ_l7A_0 2024-09-14T11:17:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.624+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6986014942043252435', time=2024-09-14T13:12:33.189922+0000, chain.objs.size()=1 2024-09-14T11:17:07.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.624+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35__shadow_.viNnfgIzBIESls26iDkxeD9Byw4hdGd_0 2024-09-14T11:17:07.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.626+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.629+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:17:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.630+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.631+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.631+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-14T11:17:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.631+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='_wuZW78pjUvtfocM1OV5T_NaIv9rAsNi', time=2024-09-14T13:07:51.504966+0000, chain.objs.size()=2 2024-09-14T11:17:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.631+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__shadow_.-RXySKjYIKyLzb6BADWU-ZIL9Cu1DcT_0 2024-09-14T11:17:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.631+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__shadow_.-RXySKjYIKyLzb6BADWU-ZIL9Cu1DcT_1 2024-09-14T11:17:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.631+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13981199601498846366', time=2024-09-14T13:07:51.521417+0000, chain.objs.size()=3 2024-09-14T11:17:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.631+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-STANDARD.2~0jG6d4gwrfrm53JSkpLZl1StL3MBE2C.1 2024-09-14T11:17:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.631+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-STANDARD.2~0jG6d4gwrfrm53JSkpLZl1StL3MBE2C.2 2024-09-14T11:17:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.631+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-STANDARD.2~0jG6d4gwrfrm53JSkpLZl1StL3MBE2C.3 2024-09-14T11:17:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.631+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11519600288178634578', time=2024-09-14T13:07:51.567091+0000, chain.objs.size()=3 2024-09-14T11:17:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.631+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15__multipart_foo-FROZEN.2~d2D_LkAdXa_LpmZupJWggS22kj8cnKF.1 2024-09-14T11:17:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.631+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15__multipart_foo-FROZEN.2~d2D_LkAdXa_LpmZupJWggS22kj8cnKF.2 2024-09-14T11:17:07.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.631+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15__multipart_foo-FROZEN.2~d2D_LkAdXa_LpmZupJWggS22kj8cnKF.3 2024-09-14T11:17:07.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.631+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7133817259882645450', time=2024-09-14T13:07:51.605987+0000, chain.objs.size()=2 2024-09-14T11:17:07.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.631+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14__shadow_.IxJdE5SMKY_6udKk7BYCu0TFqT1XMFn_0 2024-09-14T11:17:07.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.631+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14__shadow_.IxJdE5SMKY_6udKk7BYCu0TFqT1XMFn_1 2024-09-14T11:17:07.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.631+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8665419015496991534', time=2024-09-14T13:09:21.091667+0000, chain.objs.size()=1 2024-09-14T11:17:07.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.631+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21__shadow_.Qg2Kky5ePxWkwuxym5OAm8e1hiC4cCG_0 2024-09-14T11:17:07.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.631+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10766107109133439628', time=2024-09-14T13:09:23.791258+0000, chain.objs.size()=1 2024-09-14T11:17:07.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.631+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22__shadow_.wPH30IRnMOVymRc2l3G0u3tqXbT8Jcz_0 2024-09-14T11:17:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.635+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6320549406459742890', time=2024-09-14T13:10:34.104332+0000, chain.objs.size()=1 2024-09-14T11:17:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.635+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25__shadow_.n7MMkGAFMpA2AGsfkSsE32uU_CmysOk_0 2024-09-14T11:17:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.635+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4873059460375846319', time=2024-09-14T13:10:39.407688+0000, chain.objs.size()=1 2024-09-14T11:17:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.635+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27__shadow_.QZlCkTBtQDJTX4tnn43S8yiiIshcA4e_0 2024-09-14T11:17:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.635+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5256133758768615670', time=2024-09-14T13:11:15.673614+0000, chain.objs.size()=1 2024-09-14T11:17:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.635+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29__shadow_.Dy9r74_-INBC-0iRtmsx6TmkBVhKRnT_0 2024-09-14T11:17:07.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.636+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17064113329303979055', time=2024-09-14T13:11:49.145641+0000, chain.objs.size()=1 2024-09-14T11:17:07.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.636+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30__shadow_.OcuaAPtzIe8GXKcsWNjFlmYFrDDma9d_0 2024-09-14T11:17:07.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.638+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18073145195861395370', time=2024-09-14T13:11:49.146476+0000, chain.objs.size()=1 2024-09-14T11:17:07.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.638+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30__shadow_.YSnwxKPpvYte9GtJBWinewlfPmuNsBO_0 2024-09-14T11:17:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.638+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17009907361973786848', time=2024-09-14T13:11:52.265366+0000, chain.objs.size()=1 2024-09-14T11:17:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.638+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31__shadow_.RUXljisf8NwUjp4uyLyW8JE2otINKDv_0 2024-09-14T11:17:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.638+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14718962588834910922', time=2024-09-14T13:11:54.513190+0000, chain.objs.size()=1 2024-09-14T11:17:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.638+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32__shadow_._uO1eApWgZtww8cX-qGMzRjEZnTutff_0 2024-09-14T11:17:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.638+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12763380808756501594', time=2024-09-14T13:12:28.092086+0000, chain.objs.size()=1 2024-09-14T11:17:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.638+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33__shadow_.1fGaREC2e6lbz69uxaRr2C364SladaM_0 2024-09-14T11:17:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.638+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12100442425936245073', time=2024-09-14T13:13:04.292856+0000, chain.objs.size()=1 2024-09-14T11:17:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.638+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35__shadow_.786Yi1k4QvNn_PQzyqS4oqw3zgd6JE6_0 2024-09-14T11:17:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.638+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.717567785699803068', time=2024-09-14T13:13:07.124181+0000, chain.objs.size()=1 2024-09-14T11:17:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.638+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36__shadow_.g04fmHzR98vMNh2jW2A1anH4P79X9z4_0 2024-09-14T11:17:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.638+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12416271834332564013', time=2024-09-14T13:13:40.676908+0000, chain.objs.size()=1 2024-09-14T11:17:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.638+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37__shadow_.8IpTeWTmc5ioGjud5HYB68w6UYykS9B_0 2024-09-14T11:17:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.639+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17079302801874014967', time=2024-09-14T13:13:43.505141+0000, chain.objs.size()=1 2024-09-14T11:17:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.639+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38__shadow_.svsBi1XNvq-4bBVkyr6PxpadF90DgWg_0 2024-09-14T11:17:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.639+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17659259731354846632', time=2024-09-14T13:13:45.604071+0000, chain.objs.size()=1 2024-09-14T11:17:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.639+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39__shadow_.oD5TeD_c0_t5Ldvu_HnuPsXJjptzC3n_0 2024-09-14T11:17:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.640+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15654553118195910475', time=2024-09-14T13:13:45.610101+0000, chain.objs.size()=1 2024-09-14T11:17:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.640+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39__shadow_.ZOTxuljLhO5k7H7fznL38BH1x7Dk3ZM_0 2024-09-14T11:17:07.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.643+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.645+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:17:07.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.646+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T11:17:07.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6070325855584031241', time=2024-09-14T13:09:18.905636+0000, chain.objs.size()=1 2024-09-14T11:17:07.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20__shadow_.hB-0RndxkS4tyeuXfek1OLVJFIGiGx__0 2024-09-14T11:17:07.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8748449874231854914', time=2024-09-14T13:09:21.166859+0000, chain.objs.size()=1 2024-09-14T11:17:07.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21__shadow_.f-dAuZLo8XraCPuSeDSQK8jS7-nfoNT_0 2024-09-14T11:17:07.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15642510642182396048', time=2024-09-14T13:09:55.140694+0000, chain.objs.size()=1 2024-09-14T11:17:07.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22__shadow_.6JIjqurKXj4jhMsk0QJNACuqyvLyaUm_0 2024-09-14T11:17:07.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18288158148917529799', time=2024-09-14T13:09:55.170460+0000, chain.objs.size()=1 2024-09-14T11:17:07.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22__shadow_.J_1W9mORtDpN40gSTVivTB41AJTSauC_0 2024-09-14T11:17:07.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15868188202748792473', time=2024-09-14T13:09:58.560288+0000, chain.objs.size()=1 2024-09-14T11:17:07.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23__shadow_.YvWF87UBq6ncjUsE4Ku_CXlTC9bOpk1_0 2024-09-14T11:17:07.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7334992463053947511', time=2024-09-14T13:10:00.795235+0000, chain.objs.size()=1 2024-09-14T11:17:07.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24__shadow_.G0LN0MbUsHk6YugWGImodsrLikaHkS4_0 2024-09-14T11:17:07.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17701118548192221878', time=2024-09-14T13:10:00.796101+0000, chain.objs.size()=1 2024-09-14T11:17:07.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24__shadow_.75Akfe-Tp185PkE2r9qBQeQw1WmJwTi_0 2024-09-14T11:17:07.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15270653750129031300', time=2024-09-14T13:11:49.193899+0000, chain.objs.size()=1 2024-09-14T11:17:07.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30__shadow_.EmPTOv4NnPZPCq-VjmoT0HNN-gTSZKr_0 2024-09-14T11:17:07.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12767027124938384627', time=2024-09-14T13:11:54.470924+0000, chain.objs.size()=1 2024-09-14T11:17:07.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32__shadow_.B-CkXP6JXCix50Ia4ncUOefD-XPCYin_0 2024-09-14T11:17:07.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.842252411486271089', time=2024-09-14T13:11:54.471774+0000, chain.objs.size()=1 2024-09-14T11:17:07.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32__shadow_.1rrqTkvm9L0z5Z5DWM1d5nJ6bLIgyfT_0 2024-09-14T11:17:07.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6014522156506724816', time=2024-09-14T13:11:54.472573+0000, chain.objs.size()=1 2024-09-14T11:17:07.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32__shadow_.vpjPYIuoYCaakEspeTamKRh1IsJV-rc_0 2024-09-14T11:17:07.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3710118832670522708', time=2024-09-14T13:12:28.053097+0000, chain.objs.size()=1 2024-09-14T11:17:07.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.647+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33__shadow_.AnEwF75F2jkce3XAfu9RwR2ODRZTKBT_0 2024-09-14T11:17:07.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.649+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2704953572891474972', time=2024-09-14T13:12:28.120705+0000, chain.objs.size()=1 2024-09-14T11:17:07.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.649+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33__shadow_.l_NgeMeaUYBPzXN-XciQZHyxXBZGDnE_0 2024-09-14T11:17:07.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.649+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12539796249376726577', time=2024-09-14T13:13:40.733023+0000, chain.objs.size()=1 2024-09-14T11:17:07.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.649+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37__shadow_.CmrHfcbrVxz7TW3_gmUbaLMQiT4Z42Q_0 2024-09-14T11:17:07.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.652+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.655+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:17:07.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.656+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.657+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.657+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T11:17:07.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.657+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13298682246592334418', time=2024-09-14T13:07:51.508837+0000, chain.objs.size()=3 2024-09-14T11:17:07.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.657+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-FROZEN.2~jMGeIzLkKIEiPrsrWc4GgGxUHr6naiZ.1 2024-09-14T11:17:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.657+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-FROZEN.2~jMGeIzLkKIEiPrsrWc4GgGxUHr6naiZ.2 2024-09-14T11:17:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.657+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-FROZEN.2~jMGeIzLkKIEiPrsrWc4GgGxUHr6naiZ.3 2024-09-14T11:17:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.657+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15172937508047999669', time=2024-09-14T13:07:51.602061+0000, chain.objs.size()=1 2024-09-14T11:17:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.657+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14__shadow_.tpGyov9A7z987N8nuqpm_sf39bpvVaR_0 2024-09-14T11:17:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.657+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10888861439105107786', time=2024-09-14T13:07:51.657841+0000, chain.objs.size()=1 2024-09-14T11:17:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.657+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8__shadow_.J0fVIBuXdiUyS-0sKOmNQSbL0l3995f_0 2024-09-14T11:17:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.657+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11569180515910274100', time=2024-09-14T13:09:21.166005+0000, chain.objs.size()=1 2024-09-14T11:17:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.657+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21__shadow_.m2b8Dz0GDRrR0P9jrIcZ3WBd784qaPU_0 2024-09-14T11:17:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.657+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13945008807162436414', time=2024-09-14T13:09:58.519946+0000, chain.objs.size()=1 2024-09-14T11:17:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.657+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23__shadow_.Vs6j2NiO_w3k1zhuItiIS1_25d0UTUs_0 2024-09-14T11:17:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.657+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6692578648309463606', time=2024-09-14T13:10:37.157704+0000, chain.objs.size()=1 2024-09-14T11:17:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.657+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26__shadow_.3QpR7rxGGoBLeGmKKQm-0257eoArbly_0 2024-09-14T11:17:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.657+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2617052997031576771', time=2024-09-14T13:10:37.216265+0000, chain.objs.size()=1 2024-09-14T11:17:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.657+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26__shadow_.G0ASV3Y085BaFwoIvqQjvF3HIX2a8uK_0 2024-09-14T11:17:07.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.657+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8693104011513642630', time=2024-09-14T13:10:37.228101+0000, chain.objs.size()=1 2024-09-14T11:17:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.657+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26__shadow_.KPz_Xk83HIqy3pBpKIKNwOSCxd8Gij9_0 2024-09-14T11:17:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.657+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10234660215565930882', time=2024-09-14T13:10:39.406643+0000, chain.objs.size()=1 2024-09-14T11:17:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.657+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27__shadow_.WbRkPTSh1qwapbvGY5USPtFi1JS19qW_0 2024-09-14T11:17:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.657+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17660238564208874903', time=2024-09-14T13:11:12.965563+0000, chain.objs.size()=1 2024-09-14T11:17:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.657+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28__shadow_.PiY0IRhFrUuTDo_zE_rFDtOkyCgHwT0_0 2024-09-14T11:17:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.659+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12737501085373277607', time=2024-09-14T13:11:12.974472+0000, chain.objs.size()=1 2024-09-14T11:17:07.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.659+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28__shadow_.x7OKCBLZR4AYt-xhj6MG2KSDj1u5nQW_0 2024-09-14T11:17:07.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.660+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2963887505865100975', time=2024-09-14T13:11:15.627473+0000, chain.objs.size()=1 2024-09-14T11:17:07.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.660+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29__shadow_.f5rV_K4T0yTK3e8HxA0jfwkLomxNGBP_0 2024-09-14T11:17:07.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.660+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1661646671381865405', time=2024-09-14T13:11:15.657911+0000, chain.objs.size()=1 2024-09-14T11:17:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.660+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29__shadow_.tpBMNwww018PC2Iw_DLQQwWi6muYX9n_0 2024-09-14T11:17:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.661+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16026266501383969433', time=2024-09-14T13:11:52.231331+0000, chain.objs.size()=1 2024-09-14T11:17:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.661+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31__shadow_.upmAQp_qFASgEftdBzXl2sjg4Vya4Qt_0 2024-09-14T11:17:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.661+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5937709187763867798', time=2024-09-14T13:11:54.560212+0000, chain.objs.size()=1 2024-09-14T11:17:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.661+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32__shadow_.5QxXAqa9LldU4a9t1L-Lf3D2pvz4gy6_0 2024-09-14T11:17:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.661+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7862054323906195789', time=2024-09-14T13:12:30.959359+0000, chain.objs.size()=1 2024-09-14T11:17:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.661+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34__shadow_.TumPqt-KH_5O3MME-ZX--EByMBRQoKi_0 2024-09-14T11:17:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.662+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11255914093469750136', time=2024-09-14T13:13:43.531469+0000, chain.objs.size()=1 2024-09-14T11:17:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.662+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38__shadow_.dfDPYIT91anVEn-CwYINRlYBEzT8nfr_0 2024-09-14T11:17:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.662+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2115404596411680767', time=2024-09-14T13:14:18.975265+0000, chain.objs.size()=1 2024-09-14T11:17:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.662+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40__shadow_.M3aiMlxtW2uOel4qbRQogQ1GG_dVS91_0 2024-09-14T11:17:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.662+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16993508335543520092', time=2024-09-14T13:16:42.981345+0000, chain.objs.size()=1 2024-09-14T11:17:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.662+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19__shadow:PW6jgqcoxo0KNi-fC.d4bEPbHXLxeQp_.va8cFBtEMY8K3XKvAKhpgX4s1zFahtQ_0 2024-09-14T11:17:07.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.665+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.667+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:17:07.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.669+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.669+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-14T11:17:07.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10019866917446147911', time=2024-09-14T13:09:21.088826+0000, chain.objs.size()=1 2024-09-14T11:17:07.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21__shadow_.VAthm1pGA7VkBd50fJDe6HAjUj65KbK_0 2024-09-14T11:17:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14437550388510758840', time=2024-09-14T13:09:21.119931+0000, chain.objs.size()=1 2024-09-14T11:17:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21__shadow_.CiG5VDjjAHXyHFFGQuQ4tjY59ayTcOi_0 2024-09-14T11:17:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11940218085000741252', time=2024-09-14T13:09:21.120404+0000, chain.objs.size()=1 2024-09-14T11:17:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21__shadow_.ki2iZlrGcexMCbYPA5ee4lVfODjQWQf_0 2024-09-14T11:17:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14376299045576474434', time=2024-09-14T13:09:55.117791+0000, chain.objs.size()=1 2024-09-14T11:17:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22__shadow_.gQVqYnJImWJ3gAllNslJ6fpgrpWL-0__0 2024-09-14T11:17:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12645088864466410964', time=2024-09-14T13:09:58.519940+0000, chain.objs.size()=1 2024-09-14T11:17:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23__shadow_.olNGMvcOHfYfbvjxPFBTUrtsC6FPxXB_0 2024-09-14T11:17:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4326839979911240738', time=2024-09-14T13:10:34.080058+0000, chain.objs.size()=1 2024-09-14T11:17:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25__shadow_.FLWIwyGaS41mI_FJ7kXZv1hfaGYDfGk_0 2024-09-14T11:17:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6037139206074009214', time=2024-09-14T13:10:34.167691+0000, chain.objs.size()=1 2024-09-14T11:17:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25__shadow_.9Ileyx2Le5ji7fh6LrSyW22wbeXcVLO_0 2024-09-14T11:17:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17713863392146446262', time=2024-09-14T13:10:41.476769+0000, chain.objs.size()=1 2024-09-14T11:17:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28__shadow_.tYvPdP37-tpUcSU09s_uhzcIpYrPDr__0 2024-09-14T11:17:07.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15935888528198847377', time=2024-09-14T13:11:12.974429+0000, chain.objs.size()=1 2024-09-14T11:17:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28__shadow_.CfPNqS8rz8O-OQcOrYvosXVoOeE5hJr_0 2024-09-14T11:17:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.547217786852741655', time=2024-09-14T13:11:12.996437+0000, chain.objs.size()=1 2024-09-14T11:17:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28__shadow_.ujZQrzPtnF6crv79ea8dVLG7BLpoCxX_0 2024-09-14T11:17:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5592991055659412713', time=2024-09-14T13:11:49.177458+0000, chain.objs.size()=1 2024-09-14T11:17:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30__shadow_.gH7fSvbF8XMSFFuO1qtIFKo3M52HgC6_0 2024-09-14T11:17:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4761761944389100916', time=2024-09-14T13:11:54.563053+0000, chain.objs.size()=1 2024-09-14T11:17:07.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.670+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32__shadow_.3FIqio-9wHHFK71ySS-uz8zlbHcE8F4_0 2024-09-14T11:17:07.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.673+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8285038526640130272', time=2024-09-14T13:12:28.046839+0000, chain.objs.size()=1 2024-09-14T11:17:07.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.673+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33__shadow_.8yVGm3K6xCPFvqFmfCeKotGsfsHrzAA_0 2024-09-14T11:17:07.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.673+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13132036718239423278', time=2024-09-14T13:13:07.124157+0000, chain.objs.size()=1 2024-09-14T11:17:07.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.673+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36__shadow_.69Yw11SOesVOeRU_cvaFKmtV_HOsMFx_0 2024-09-14T11:17:07.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.673+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16056568297570284038', time=2024-09-14T13:13:43.497673+0000, chain.objs.size()=1 2024-09-14T11:17:07.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.673+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38__shadow_.O_qeJ7cHbelzSQxy3u9nlLwPpOGR995_0 2024-09-14T11:17:07.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.673+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8426775835044782801', time=2024-09-14T13:13:43.498325+0000, chain.objs.size()=1 2024-09-14T11:17:07.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.673+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38__shadow_.uA02sKp-hmlS9hdZDV5btHuIq_qm3HY_0 2024-09-14T11:17:07.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.674+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9975198738368472746', time=2024-09-14T13:13:45.555422+0000, chain.objs.size()=1 2024-09-14T11:17:07.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.674+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39__shadow_.5BnbIGdmGVn-aaSngnTkf4EslEVpNxw_0 2024-09-14T11:17:07.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.674+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9245084520576349288', time=2024-09-14T13:16:28.950821+0000, chain.objs.size()=1 2024-09-14T11:17:07.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.674+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18__shadow_.hzSJ4OP3hcTg6KMvyFByeJTLRd9A1Qd_0 2024-09-14T11:17:07.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.676+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.679+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:17:07.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.680+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.680+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.681+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-14T11:17:07.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.681+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6759393883595264595', time=2024-09-14T13:07:51.570793+0000, chain.objs.size()=3 2024-09-14T11:17:07.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.681+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15__multipart_foo-STANDARD.2~ePCjjAHKMAH1sxbj5jX98_k7M0uP2nx.1 2024-09-14T11:17:07.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.681+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15__multipart_foo-STANDARD.2~ePCjjAHKMAH1sxbj5jX98_k7M0uP2nx.2 2024-09-14T11:17:07.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.681+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15__multipart_foo-STANDARD.2~ePCjjAHKMAH1sxbj5jX98_k7M0uP2nx.3 2024-09-14T11:17:07.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.681+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7175522859005200505', time=2024-09-14T13:09:21.113130+0000, chain.objs.size()=1 2024-09-14T11:17:07.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.681+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21__shadow_.oXfN1UTBRtJl0tAWjnr4URNQeMaONt9_0 2024-09-14T11:17:07.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.681+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9820089208784721442', time=2024-09-14T13:09:55.103416+0000, chain.objs.size()=1 2024-09-14T11:17:07.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.681+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22__shadow_.T5Gi4UQn7qALKr8JJCI9ZKSlVdjUlFm_0 2024-09-14T11:17:07.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.681+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6776909150696061633', time=2024-09-14T13:09:58.598243+0000, chain.objs.size()=1 2024-09-14T11:17:07.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.681+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23__shadow_.jxOuF6kgA0nVLmL7NphrGIjcBS8aXGk_0 2024-09-14T11:17:07.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.681+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7032367461561328114', time=2024-09-14T13:10:00.759188+0000, chain.objs.size()=1 2024-09-14T11:17:07.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.681+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24__shadow_.2alvEJ9dUj9vtz_mAcX3-L3--gTb8pJ_0 2024-09-14T11:17:07.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.681+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1983477413676992928', time=2024-09-14T13:10:00.759661+0000, chain.objs.size()=1 2024-09-14T11:17:07.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.681+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24__shadow_.dofDH39Nh6UQ9uRzKL8Xdq9489vVP9__0 2024-09-14T11:17:07.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.681+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14638977343160182897', time=2024-09-14T13:10:37.201168+0000, chain.objs.size()=1 2024-09-14T11:17:07.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.681+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26__shadow_.tGLU5xGEyaCmH6MzXA_opmlbh3uEReu_0 2024-09-14T11:17:07.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.681+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10490395949129734521', time=2024-09-14T13:10:37.233975+0000, chain.objs.size()=1 2024-09-14T11:17:07.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.681+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26__shadow_.fwMdPfHZK90d_v_TEhMEl18JoufzgfX_0 2024-09-14T11:17:07.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.681+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.655239759053315834', time=2024-09-14T13:10:39.424147+0000, chain.objs.size()=1 2024-09-14T11:17:07.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.681+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27__shadow_.bM5E7TaLkcz4XkXIKERIygEhUDdUAGb_0 2024-09-14T11:17:07.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.681+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5850758350421877430', time=2024-09-14T13:11:13.018300+0000, chain.objs.size()=1 2024-09-14T11:17:07.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.681+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28__shadow_.1fd5ZBW6unZZdCUJauntQEOcnv5Lt9-_0 2024-09-14T11:17:07.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.684+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2775102559963192138', time=2024-09-14T13:11:14.891511+0000, chain.objs.size()=1 2024-09-14T11:17:07.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.684+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29__shadow_.BLJBDUaeueXztv-tHtHaSdx4hBAyCqh_0 2024-09-14T11:17:07.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.684+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16088961958915480414', time=2024-09-14T13:11:52.257484+0000, chain.objs.size()=1 2024-09-14T11:17:07.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.684+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31__shadow_.nJVfRsmpzix8R54p4o0weSf8X9bV_G4_0 2024-09-14T11:17:07.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.684+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16030627778449218815', time=2024-09-14T13:12:30.938351+0000, chain.objs.size()=1 2024-09-14T11:17:07.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.684+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34__shadow_.uj6hiGGUMP_qqRCE8X7zU05H9aK2vPj_0 2024-09-14T11:17:07.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.684+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17309401443098292724', time=2024-09-14T13:13:04.360216+0000, chain.objs.size()=1 2024-09-14T11:17:07.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.684+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35__shadow_.ogBB4V_oYHambE4xoNS2ghcucWI3iyN_0 2024-09-14T11:17:07.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.686+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11821915987328508838', time=2024-09-14T13:13:40.655565+0000, chain.objs.size()=1 2024-09-14T11:17:07.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.686+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37__shadow_.CBAIifKjmpmqOfCrz8zV14ve8Ehmvrh_0 2024-09-14T11:17:07.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.686+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12079353552723902676', time=2024-09-14T13:13:45.576061+0000, chain.objs.size()=1 2024-09-14T11:17:07.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.686+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39__shadow_.qCXrGG55nk_9MAMiRiG37X91zAFZS1S_0 2024-09-14T11:17:07.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.686+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9407534350591438705', time=2024-09-14T13:16:28.952217+0000, chain.objs.size()=1 2024-09-14T11:17:07.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.686+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18__shadow_.tMZKmQpIAUYujj2WI3KrQm686qMnEc4_0 2024-09-14T11:17:07.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.686+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11981087204779296500', time=2024-09-14T13:16:28.952964+0000, chain.objs.size()=1 2024-09-14T11:17:07.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.686+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18__shadow_.z3URtER20qvF04FxYfiPtkPSxCFez--_0 2024-09-14T11:17:07.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.688+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.691+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:17:07.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.692+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.692+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.692+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-14T11:17:07.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.692+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='_qOrOlFHDsE3o04wVrXiha8teaTO4bZP', time=2024-09-14T13:07:51.457154+0000, chain.objs.size()=1 2024-09-14T11:17:07.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.692+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16__shadow_.1jvsjW78JxZuuljPUVRNmrlVfIrIi-0_0 2024-09-14T11:17:07.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.692+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3230243080144740178', time=2024-09-14T13:07:51.697641+0000, chain.objs.size()=1 2024-09-14T11:17:07.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.692+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9__shadow_.tOV55VYttJ7iw4p78Gkot8BMmkZ7wCA_0 2024-09-14T11:17:07.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.692+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.540426570074762459', time=2024-09-14T13:09:55.110532+0000, chain.objs.size()=1 2024-09-14T11:17:07.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.692+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22__shadow_.5Pn0yIN8C5_jLRDqoHgvDxZU3K2cfkF_0 2024-09-14T11:17:07.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.692+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2340853536227351265', time=2024-09-14T13:09:58.519890+0000, chain.objs.size()=1 2024-09-14T11:17:07.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.692+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23__shadow_.dubRpC_O6K_BJTjUedmTlW4_J4_zHBy_0 2024-09-14T11:17:07.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.692+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11247677389841771704', time=2024-09-14T13:10:34.115925+0000, chain.objs.size()=1 2024-09-14T11:17:07.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.692+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25__shadow_.MhDCpSuJD-OYQtQD2UNhXustpf8i1KP_0 2024-09-14T11:17:07.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.692+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6387658048289952716', time=2024-09-14T13:10:36.233414+0000, chain.objs.size()=1 2024-09-14T11:17:07.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.692+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26__shadow_.OisTPLkQ09TBj_OlB86Q8reWsVjL_Vb_0 2024-09-14T11:17:07.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.692+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16810199054084499980', time=2024-09-14T13:10:37.126660+0000, chain.objs.size()=1 2024-09-14T11:17:07.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.692+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26__shadow_.wh8YqeKViRDBK-5x-uKKvhkIyHAU8l2_0 2024-09-14T11:17:07.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.692+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6707151208424332596', time=2024-09-14T13:11:15.614240+0000, chain.objs.size()=1 2024-09-14T11:17:07.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.692+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29__shadow_.T-OaC5mGnqncbJVrgJQRqa6JG9hlf_5_0 2024-09-14T11:17:07.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.696+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.698+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:17:07.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.699+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T11:17:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8288854491062816205', time=2024-09-14T13:09:18.820458+0000, chain.objs.size()=1 2024-09-14T11:17:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20__shadow_.6qGeNUaKhJ91BlOACI8NuSlCT0B8oOH_0 2024-09-14T11:17:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17104358082653278212', time=2024-09-14T13:09:21.126794+0000, chain.objs.size()=1 2024-09-14T11:17:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21__shadow_.EXqToZB4ZjG_T9USNuWUJzfZUqEec0S_0 2024-09-14T11:17:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3520192221840220522', time=2024-09-14T13:10:00.837912+0000, chain.objs.size()=1 2024-09-14T11:17:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24__shadow_.XcQXPwW8_Q9WSnnYD-gXdApqwnKN_ob_0 2024-09-14T11:17:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8237097041471772715', time=2024-09-14T13:10:37.213117+0000, chain.objs.size()=1 2024-09-14T11:17:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26__shadow_.S3mEgo0V8wsctaLiyigFG9VII5RB7JZ_0 2024-09-14T11:17:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1338289255982112981', time=2024-09-14T13:10:37.214695+0000, chain.objs.size()=1 2024-09-14T11:17:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26__shadow_.rY3afU5aWCUGpW0bW7aLFRKz4ZrTzBr_0 2024-09-14T11:17:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.748673204473169774', time=2024-09-14T13:10:39.409634+0000, chain.objs.size()=1 2024-09-14T11:17:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27__shadow_.3H7xoY0EPQzuf1sTdejIBW1g3lKggKn_0 2024-09-14T11:17:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1568719039628759691', time=2024-09-14T13:11:13.000757+0000, chain.objs.size()=1 2024-09-14T11:17:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28__shadow_.UzUgkpfJKN83Dlpo-9fbmSHpibb22eI_0 2024-09-14T11:17:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5035863423953154507', time=2024-09-14T13:11:13.001443+0000, chain.objs.size()=1 2024-09-14T11:17:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28__shadow_.mEfZbHsOFKyCACk10KTIu24rUEMk6dp_0 2024-09-14T11:17:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5035884250412547701', time=2024-09-14T13:11:13.017111+0000, chain.objs.size()=1 2024-09-14T11:17:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28__shadow_.hqw6wVA7HOmcTmboZEZtGMq97HRjyew_0 2024-09-14T11:17:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9773220013542623069', time=2024-09-14T13:13:04.291096+0000, chain.objs.size()=1 2024-09-14T11:17:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35__shadow_.PSdEjm_u9iW_ZhIQcs5eoUec-ZuS2sv_0 2024-09-14T11:17:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17850409607835755261', time=2024-09-14T13:13:09.174035+0000, chain.objs.size()=1 2024-09-14T11:17:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37__shadow_.8A_EDMPcgxgn0KSzWMXUwWdeFx8tsDt_0 2024-09-14T11:17:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8091575772843685312', time=2024-09-14T13:13:45.524420+0000, chain.objs.size()=1 2024-09-14T11:17:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.700+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39__shadow_.qJeIxK2Wyaw4hNWX_Tiz5C9Iikurkno_0 2024-09-14T11:17:07.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.703+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14616656633622926134', time=2024-09-14T13:14:18.967796+0000, chain.objs.size()=1 2024-09-14T11:17:07.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.703+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40__shadow_.rfU3C41xpYpMZ46Mk-3a1yn0_4sGMUE_0 2024-09-14T11:17:07.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.706+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.708+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:17:07.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.709+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.710+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.710+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-14T11:17:07.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.710+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18013023058057876007', time=2024-09-14T13:07:51.280596+0000, chain.objs.size()=1 2024-09-14T11:17:07.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.710+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5__shadow_.MEehKmWvm4Yxxmc1INEjYec7imJyuqr_0 2024-09-14T11:17:07.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.710+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1595887430788903042', time=2024-09-14T13:07:51.293479+0000, chain.objs.size()=1 2024-09-14T11:17:07.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.710+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5__shadow_.CAO_TaFw2oOMzh6zBDVpCHWOj5IFAHv_0 2024-09-14T11:17:07.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.710+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5078678217797253551', time=2024-09-14T13:07:51.310902+0000, chain.objs.size()=1 2024-09-14T11:17:07.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.710+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5__shadow_.FEIUJwGvmtehcwA9vlvQduZYi6_vupQ_0 2024-09-14T11:17:07.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.710+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1888587902819908274', time=2024-09-14T13:09:58.528750+0000, chain.objs.size()=1 2024-09-14T11:17:07.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.710+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23__shadow_.pNGNG_T5YglueXjDJ9frEl5NFtJO9j0_0 2024-09-14T11:17:07.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.710+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2626801251066006884', time=2024-09-14T13:10:00.749570+0000, chain.objs.size()=1 2024-09-14T11:17:07.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.710+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24__shadow_.Se8JS5GOelKnhaj7eys8Y0WCVh_JEqp_0 2024-09-14T11:17:07.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.710+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1899830248082090372', time=2024-09-14T13:11:49.191656+0000, chain.objs.size()=1 2024-09-14T11:17:07.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.710+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30__shadow_.lCJ47IxRBq7Nbq2Vq3RZ1iOk2XGS9Ml_0 2024-09-14T11:17:07.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.710+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5123498364744502067', time=2024-09-14T13:11:52.215157+0000, chain.objs.size()=1 2024-09-14T11:17:07.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.710+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31__shadow_.p3ZpJUhgkZSM-utNaep81W-T_lu-PnP_0 2024-09-14T11:17:07.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.710+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4575186153678315350', time=2024-09-14T13:11:52.215951+0000, chain.objs.size()=1 2024-09-14T11:17:07.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.710+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31__shadow_.Oq8SiK-v-pr5F4n2LTcsTxS09kRCAiM_0 2024-09-14T11:17:07.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.711+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.445577634091236787', time=2024-09-14T13:13:04.284006+0000, chain.objs.size()=1 2024-09-14T11:17:07.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.711+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35__shadow_.X1WLa208sS1uHMp9bblq38kjdgnHWbj_0 2024-09-14T11:17:07.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.711+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7287532363734668499', time=2024-09-14T13:13:04.311503+0000, chain.objs.size()=1 2024-09-14T11:17:07.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.711+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35__shadow_.VKNMj_ZkPjGAl3gNzW0OV9mxEzlf0yi_0 2024-09-14T11:17:07.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.711+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11384425275151138286', time=2024-09-14T13:13:07.094041+0000, chain.objs.size()=1 2024-09-14T11:17:07.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.711+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36__shadow_.c5J5HRqI6w9dUPDJ-QXAAdR1_jnBh9C_0 2024-09-14T11:17:07.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.711+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.136519438506177348', time=2024-09-14T13:13:07.160788+0000, chain.objs.size()=1 2024-09-14T11:17:07.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.711+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36__shadow_.iTzQtdZ0OSKiIbKheHuso9tJCVezscC_0 2024-09-14T11:17:07.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.713+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10097344539726759300', time=2024-09-14T13:13:40.672499+0000, chain.objs.size()=1 2024-09-14T11:17:07.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.713+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37__shadow_.XjTsSBQucF2CO7hfWWGAIhSKEd62WVf_0 2024-09-14T11:17:07.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.713+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7487837107662302934', time=2024-09-14T13:13:43.509831+0000, chain.objs.size()=1 2024-09-14T11:17:07.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.713+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38__shadow_.FMbCDO6CrONlBInGaSeMuuuR7RGdh0o_0 2024-09-14T11:17:07.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.714+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14453642066823675883', time=2024-09-14T13:14:18.935038+0000, chain.objs.size()=1 2024-09-14T11:17:07.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.714+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40__shadow_._CG7Dfqtvh9nHseo7S07Bba8NncmDu__0 2024-09-14T11:17:07.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.714+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11404878565539375379', time=2024-09-14T13:14:18.972438+0000, chain.objs.size()=1 2024-09-14T11:17:07.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.714+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40__shadow_.IwCmvM5EIwG5wSvGvZ-XpTR2tzvwu_J_0 2024-09-14T11:17:07.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.714+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4657977748650207736', time=2024-09-14T13:14:18.973059+0000, chain.objs.size()=1 2024-09-14T11:17:07.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.714+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40__shadow_.iLXL9D9okaBDuxPIx5grgk2D1mA0mVq_0 2024-09-14T11:17:07.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.714+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5698850520673703686', time=2024-09-14T13:16:28.947347+0000, chain.objs.size()=1 2024-09-14T11:17:07.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.714+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18__shadow_.fcQEQhmOJHTUPaDpsF-Z6s8Gp3BJ0y7_0 2024-09-14T11:17:07.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.717+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.720+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:17:07.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.721+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.721+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.722+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T11:17:07.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.722+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1642650797208660769', time=2024-09-14T13:07:51.574991+0000, chain.objs.size()=3 2024-09-14T11:17:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.722+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15__multipart_foo-LUKEWARM.2~bbOdMGJV9NtfxLk9dUcc2DgrCbvAUJS.1 2024-09-14T11:17:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.722+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15__multipart_foo-LUKEWARM.2~bbOdMGJV9NtfxLk9dUcc2DgrCbvAUJS.2 2024-09-14T11:17:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.722+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15__multipart_foo-LUKEWARM.2~bbOdMGJV9NtfxLk9dUcc2DgrCbvAUJS.3 2024-09-14T11:17:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.722+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12727175284714484515', time=2024-09-14T13:07:51.661813+0000, chain.objs.size()=1 2024-09-14T11:17:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.722+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8__shadow_.pzoh0wUyZwtkEPhx5pERpzeFULLvCa6_0 2024-09-14T11:17:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.722+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7549797980451308052', time=2024-09-14T13:07:51.701789+0000, chain.objs.size()=1 2024-09-14T11:17:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.722+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9__shadow_.MJA5edrNOT0bVEDaXS3IbheKkEcH1o8_0 2024-09-14T11:17:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.722+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5845456609893193528', time=2024-09-14T13:09:21.048864+0000, chain.objs.size()=1 2024-09-14T11:17:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.722+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21__shadow_.8KY3NNB9fwgnZ3OqwN3br6k6wD7fdVn_0 2024-09-14T11:17:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.722+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17367473381546702616', time=2024-09-14T13:09:21.171726+0000, chain.objs.size()=1 2024-09-14T11:17:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.722+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21__shadow_.bT1sr6eumpuEnhoiId3ORl-r-uzQqw8_0 2024-09-14T11:17:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.722+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6646285485703908847', time=2024-09-14T13:09:55.175059+0000, chain.objs.size()=1 2024-09-14T11:17:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.722+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22__shadow_.6H3IWzpHrcvfKIMdZoBUsYhsggJJov-_0 2024-09-14T11:17:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.722+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5859862227617830398', time=2024-09-14T13:10:34.187065+0000, chain.objs.size()=1 2024-09-14T11:17:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.722+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25__shadow_.uUtHxno6BYYQHpTnc00oCPraIf9QOoj_0 2024-09-14T11:17:07.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.722+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10762383983302837338', time=2024-09-14T13:11:15.608347+0000, chain.objs.size()=1 2024-09-14T11:17:07.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.722+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29__shadow_.h_DNdFBJB7pWobW4R-sppgimXcZ2FTm_0 2024-09-14T11:17:07.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.722+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16134811991245026370', time=2024-09-14T13:11:15.658233+0000, chain.objs.size()=1 2024-09-14T11:17:07.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.722+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29__shadow_.Kfq-sIjFjQuLEwsxeWVYyfX5fsXWnBL_0 2024-09-14T11:17:07.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.722+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12430063314172619237', time=2024-09-14T13:11:49.145507+0000, chain.objs.size()=1 2024-09-14T11:17:07.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.722+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30__shadow_.QWuukMdIbvmOLLo5GF3LlGkJpUS-Vrf_0 2024-09-14T11:17:07.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.724+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13570389087056104609', time=2024-09-14T13:12:28.047370+0000, chain.objs.size()=1 2024-09-14T11:17:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.724+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33__shadow_.0dypRQ0JOeIndOAksuU4NLTWaJDCINo_0 2024-09-14T11:17:07.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.725+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.76655561254653024', time=2024-09-14T13:13:07.074574+0000, chain.objs.size()=1 2024-09-14T11:17:07.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.725+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36__shadow_.KyhSQXVEpPVJQBKahRuPpANqapuHJko_0 2024-09-14T11:17:07.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.725+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1433837587765704852', time=2024-09-14T13:13:07.075226+0000, chain.objs.size()=1 2024-09-14T11:17:07.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.725+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36__shadow_.3KsospBQfPmZ77YgnKwQcAyg24Bdnzu_0 2024-09-14T11:17:07.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.725+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7510056755828241517', time=2024-09-14T13:13:07.117333+0000, chain.objs.size()=1 2024-09-14T11:17:07.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.725+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36__shadow_.mzRiPwB3d0m7wnaZ8D2e81qFmElZMot_0 2024-09-14T11:17:07.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.725+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13418812152767747723', time=2024-09-14T13:13:07.118525+0000, chain.objs.size()=1 2024-09-14T11:17:07.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.725+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36__shadow_.unjNX-VG12wrFnSIO7Cd30oBB9ZYA8u_0 2024-09-14T11:17:07.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.725+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18292845352126547797', time=2024-09-14T13:13:07.119643+0000, chain.objs.size()=1 2024-09-14T11:17:07.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.725+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36__shadow_.GZY8LNZOD_bXPW0GLml5Lr5GD4IipFD_0 2024-09-14T11:17:07.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.725+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18068128701375398905', time=2024-09-14T13:13:40.677149+0000, chain.objs.size()=1 2024-09-14T11:17:07.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.725+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37__shadow_.-iWS4HIi8d5_LWUMss_-MTwRglWzP-R_0 2024-09-14T11:17:07.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.725+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16665895495523347109', time=2024-09-14T13:13:45.555923+0000, chain.objs.size()=1 2024-09-14T11:17:07.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.725+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39__shadow_.ZzvUY5PlXDTb8gK01JJWFfJIdK0xwOD_0 2024-09-14T11:17:07.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.725+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9471692464239053851', time=2024-09-14T13:16:28.972241+0000, chain.objs.size()=1 2024-09-14T11:17:07.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.725+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18__shadow_.zjMnQuRY--R2RhJ8entDaFyiMCZRniI_0 2024-09-14T11:17:07.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.729+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.731+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:17:07.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.733+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.733+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.733+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T11:17:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.733+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='_3OWHmffnJrzTelu15m8GYglLajJYBRo', time=2024-09-14T13:07:51.433209+0000, chain.objs.size()=1 2024-09-14T11:17:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.733+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16__shadow_.ZT6ThVnuJQo7RcL04N_16rT7M7TmkVQ_0 2024-09-14T11:17:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.733+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3853012297336642236', time=2024-09-14T13:07:51.453070+0000, chain.objs.size()=1 2024-09-14T11:17:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.733+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16__shadow_.Poo_6n4s4wIF7PnpbQytAdeAt9KmqIX_0 2024-09-14T11:17:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.733+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17851840558255188140', time=2024-09-14T13:09:55.104224+0000, chain.objs.size()=1 2024-09-14T11:17:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.733+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22__shadow_.TBKatRJ7dbWdZCzcqCzUUVFvXcCQGnx_0 2024-09-14T11:17:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.733+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16349311947245414094', time=2024-09-14T13:09:58.566171+0000, chain.objs.size()=1 2024-09-14T11:17:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.733+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23__shadow_.FH9ej2xIQA-q6I9OLr0JZQnrq_k0p5Z_0 2024-09-14T11:17:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.733+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12676795886164215155', time=2024-09-14T13:10:00.758590+0000, chain.objs.size()=1 2024-09-14T11:17:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.733+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24__shadow_.bndEbWnVHukMOwohHmv4a3c_yvQ383b_0 2024-09-14T11:17:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.734+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5724002636543393607', time=2024-09-14T13:10:00.801265+0000, chain.objs.size()=1 2024-09-14T11:17:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.734+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24__shadow_.FCvlptkKFaKRjW7LVl_z3vBvYgPRo8Z_0 2024-09-14T11:17:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.734+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11140452022196769222', time=2024-09-14T13:10:34.103583+0000, chain.objs.size()=1 2024-09-14T11:17:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.734+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25__shadow_.pHgA--_lli4LOOk6XyaW5btpILKyotM_0 2024-09-14T11:17:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.734+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.533545957147925779', time=2024-09-14T13:10:37.200340+0000, chain.objs.size()=1 2024-09-14T11:17:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.734+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26__shadow_.cjsGS8ir-w6OSJcmnFKNU6QzEMjdKgt_0 2024-09-14T11:17:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.734+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12020481273069099255', time=2024-09-14T13:11:12.991134+0000, chain.objs.size()=1 2024-09-14T11:17:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.734+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28__shadow_.wUSRptLP2hHXzGklAnlrdGvSG8zCnTg_0 2024-09-14T11:17:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.734+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15725577488729833996', time=2024-09-14T13:11:13.018806+0000, chain.objs.size()=1 2024-09-14T11:17:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.734+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28__shadow_._CPjsabTzoRQ7l1-VpUzZkqh8Fnn61W_0 2024-09-14T11:17:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.734+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3996627431677526479', time=2024-09-14T13:11:15.610972+0000, chain.objs.size()=1 2024-09-14T11:17:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.734+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29__shadow_.wfMb5mXGMHkXMmCCDPVOitV7bcKFo1h_0 2024-09-14T11:17:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.734+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11814960652123393217', time=2024-09-14T13:11:49.183211+0000, chain.objs.size()=1 2024-09-14T11:17:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.734+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30__shadow_.easxvZ0P7pbgq0MX1HUC9E1S8TJAJSX_0 2024-09-14T11:17:07.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.736+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17633281300260784147', time=2024-09-14T13:11:54.460064+0000, chain.objs.size()=1 2024-09-14T11:17:07.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.736+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32__shadow_.b_cAlsLW5tml20CI6s2IMiLCZtjpnF6_0 2024-09-14T11:17:07.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.737+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12888864450741566837', time=2024-09-14T13:13:40.679013+0000, chain.objs.size()=1 2024-09-14T11:17:07.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.737+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37__shadow_.qsVFt-gEbo82OWmtWDWBc3QasNERkU5_0 2024-09-14T11:17:07.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.737+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10142279219315650859', time=2024-09-14T13:13:40.695185+0000, chain.objs.size()=1 2024-09-14T11:17:07.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.737+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37__shadow_.U3QAmbOwHOc7Psw1u6Ke0_QBG4vyJsh_0 2024-09-14T11:17:07.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.737+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4692001775159418924', time=2024-09-14T13:13:45.534907+0000, chain.objs.size()=1 2024-09-14T11:17:07.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.737+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39__shadow_._zPpkRInOPQ2kF2omtwKoPS2iUmBMHi_0 2024-09-14T11:17:07.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.737+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4107166862824308840', time=2024-09-14T13:14:18.970978+0000, chain.objs.size()=1 2024-09-14T11:17:07.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.737+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40__shadow_.OFI4tg6o-B6C3NZo_Ql7Yvkgv85naXb_0 2024-09-14T11:17:07.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.740+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.743+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:17:07.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.744+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.744+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-14T11:17:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6402141229435967846', time=2024-09-14T13:07:51.284953+0000, chain.objs.size()=1 2024-09-14T11:17:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5__shadow_.uMOnYhFbG__2EusHneF_lZJUK4cdx44_0 2024-09-14T11:17:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12212026242388383530', time=2024-09-14T13:07:51.315220+0000, chain.objs.size()=1 2024-09-14T11:17:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5__shadow_.BfhK__9xV2N-fHrMF33JKJk0W9IE7Bb_0 2024-09-14T11:17:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2226245566687087476', time=2024-09-14T13:07:51.705747+0000, chain.objs.size()=1 2024-09-14T11:17:07.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9__shadow_.k_crTzDP4SB04zcE5r2YuPzTkenSX4P_0 2024-09-14T11:17:07.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11021987189087692115', time=2024-09-14T13:09:58.553689+0000, chain.objs.size()=1 2024-09-14T11:17:07.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23__shadow_.wbW2GelcT-MIGFrIteujqOzUMonNGje_0 2024-09-14T11:17:07.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15194887146686964850', time=2024-09-14T13:10:00.761361+0000, chain.objs.size()=1 2024-09-14T11:17:07.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24__shadow_.wIc-JhUdPMI8xWezxtWlI3Ll5P-2mlK_0 2024-09-14T11:17:07.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14092066977439823163', time=2024-09-14T13:10:34.115926+0000, chain.objs.size()=1 2024-09-14T11:17:07.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25__shadow_.aWrH8AuAfPhzTAXrVZC9HuvvqFyIbni_0 2024-09-14T11:17:07.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11016261117501981778', time=2024-09-14T13:10:34.148266+0000, chain.objs.size()=1 2024-09-14T11:17:07.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25__shadow_.SmTI3vCHELxWzeF7rNeLaU02r2EyzFR_0 2024-09-14T11:17:07.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.950662071943658970', time=2024-09-14T13:10:37.126580+0000, chain.objs.size()=1 2024-09-14T11:17:07.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26__shadow_.HFYhVsGZu6YOsilU4uB1Ey46xsOkQvY_0 2024-09-14T11:17:07.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9316524685853015375', time=2024-09-14T13:10:39.427643+0000, chain.objs.size()=1 2024-09-14T11:17:07.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27__shadow_.igGK61nhdO6y6pgXEaNFqwT8NZ-17I9_0 2024-09-14T11:17:07.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.864223190119695602', time=2024-09-14T13:11:12.980114+0000, chain.objs.size()=1 2024-09-14T11:17:07.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28__shadow_.US6yLfq8rnuPWQF7GexwPuDtxmFzLG7_0 2024-09-14T11:17:07.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5956988106791795546', time=2024-09-14T13:11:49.138948+0000, chain.objs.size()=1 2024-09-14T11:17:07.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30__shadow_.Bo5aS4cExN0fIebR1W24k47SnLrU6FC_0 2024-09-14T11:17:07.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4559837297919658684', time=2024-09-14T13:11:49.172568+0000, chain.objs.size()=1 2024-09-14T11:17:07.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.745+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30__shadow_.6gUkr44vzYYe5kW0tt5nXwh6IxyJiFi_0 2024-09-14T11:17:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.749+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2307039878862515957', time=2024-09-14T13:12:28.105968+0000, chain.objs.size()=1 2024-09-14T11:17:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.749+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33__shadow_.xI8Stol3QXRq-og0jcBNqz6lFU0uau1_0 2024-09-14T11:17:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.749+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.748699816298783350', time=2024-09-14T13:13:40.695842+0000, chain.objs.size()=1 2024-09-14T11:17:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.749+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37__shadow_.s2j9rvzSjHqdsAi1Q6TbzzPziPTrKnp_0 2024-09-14T11:17:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.749+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13162620678805275265', time=2024-09-14T13:13:45.555738+0000, chain.objs.size()=1 2024-09-14T11:17:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.749+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39__shadow_.lPZ27koeOvEyYGT4uzITSWTpLXzPbFz_0 2024-09-14T11:17:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.749+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4477815266177667432', time=2024-09-14T13:13:45.608514+0000, chain.objs.size()=1 2024-09-14T11:17:07.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.749+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39__shadow_.cqYCDOCkaywveFp0pQXniehhs37JZ2-_0 2024-09-14T11:17:07.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.749+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3312204975431546071', time=2024-09-14T13:14:19.007005+0000, chain.objs.size()=1 2024-09-14T11:17:07.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.749+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40__shadow_.cVPPhaubgkBVck4A0CF0mAwBv3NXdVt_0 2024-09-14T11:17:07.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.749+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5057039554403920006', time=2024-09-14T13:16:42.980063+0000, chain.objs.size()=1 2024-09-14T11:17:07.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.749+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19__shadow:8LZJLEKoEKQoueM.ouISGqDIK0Ua3ns_.Y5WlXEfwMHkYVB5uYSulAkLshand_RS_0 2024-09-14T11:17:07.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.753+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.755+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:17:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.757+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.757+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-14T11:17:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='_4v3amauVK4phzGLeu-BVhd3HWHPdyb0', time=2024-09-14T13:07:51.473128+0000, chain.objs.size()=1 2024-09-14T11:17:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16__shadow_.ltXKLMmzXGHYDRWRmtG1Z__5r4ma17a_0 2024-09-14T11:17:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17145054485412900029', time=2024-09-14T13:07:51.692784+0000, chain.objs.size()=1 2024-09-14T11:17:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9__shadow_.5jfwtGA-DtUS46Iwm0jH7FPLSiS-rf0_0 2024-09-14T11:17:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6004726900129879892', time=2024-09-14T13:09:18.865921+0000, chain.objs.size()=1 2024-09-14T11:17:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20__shadow_.7P-YlXQy_DAjn5yZHyNoFqChBJRLkht_0 2024-09-14T11:17:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14004785650515601554', time=2024-09-14T13:09:18.869808+0000, chain.objs.size()=1 2024-09-14T11:17:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20__shadow_._TMYS0XCn10_jOZH0XgvDXjsrt1B4JY_0 2024-09-14T11:17:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12226349424013147895', time=2024-09-14T13:09:18.898684+0000, chain.objs.size()=1 2024-09-14T11:17:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20__shadow_.jnYd3voNFyVfzr9qbHJMWxYeDkDLgS3_0 2024-09-14T11:17:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14842470498190591728', time=2024-09-14T13:09:55.082167+0000, chain.objs.size()=1 2024-09-14T11:17:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22__shadow_.VuRWk3HsIheWx4EAam2B3QuPSY7M1g9_0 2024-09-14T11:17:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17177378488285885638', time=2024-09-14T13:09:55.119341+0000, chain.objs.size()=1 2024-09-14T11:17:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22__shadow_.zJmXnqq293jU5LHyk2KCXUZr4WG-rKW_0 2024-09-14T11:17:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13171557010163368820', time=2024-09-14T13:10:00.847782+0000, chain.objs.size()=1 2024-09-14T11:17:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24__shadow_.pURtExrsBLvftjs7Cyz2Z_xTKoI7AoX_0 2024-09-14T11:17:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7007762917504661392', time=2024-09-14T13:10:34.146014+0000, chain.objs.size()=1 2024-09-14T11:17:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25__shadow_.N7iWLYVgneqXnRzjHhzXiOrl2VCpxUh_0 2024-09-14T11:17:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.582570742477365051', time=2024-09-14T13:10:34.169508+0000, chain.objs.size()=1 2024-09-14T11:17:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25__shadow_.W_7F0ye6BCPPdW0O5R2Q1oRUFpvnVz7_0 2024-09-14T11:17:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8313812015473958437', time=2024-09-14T13:10:37.209472+0000, chain.objs.size()=1 2024-09-14T11:17:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26__shadow_.XqGr-mBO-I2PTI9qwgaLKiJY2ONRU9f_0 2024-09-14T11:17:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1733797541195999995', time=2024-09-14T13:11:15.606114+0000, chain.objs.size()=1 2024-09-14T11:17:07.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.758+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29__shadow_.US9jajVVVIzDtPgk1iNRrc7l4XzWNJy_0 2024-09-14T11:17:07.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.759+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3769804516776941645', time=2024-09-14T13:11:52.260072+0000, chain.objs.size()=1 2024-09-14T11:17:07.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.759+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31__shadow_.4eqkDX9JfIe8cBf94CN7GkjXLuKevzg_0 2024-09-14T11:17:07.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.761+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7523440822619839040', time=2024-09-14T13:11:54.511111+0000, chain.objs.size()=1 2024-09-14T11:17:07.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.761+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32__shadow_.iSHNHOLFMf9emCXO-2fGZCMs-3uJe5Z_0 2024-09-14T11:17:07.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.761+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17976445479562359872', time=2024-09-14T13:11:54.511586+0000, chain.objs.size()=1 2024-09-14T11:17:07.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.761+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32__shadow_.BwML0S-sJf9xpYn0G6zuzPIOhDJ0GYZ_0 2024-09-14T11:17:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.763+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6495790603878870483', time=2024-09-14T13:12:28.066995+0000, chain.objs.size()=1 2024-09-14T11:17:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.763+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33__shadow_.s4WXKc1l_u2aYWGkJ5IokGFFoEwk2RQ_0 2024-09-14T11:17:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.763+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9928635233373391176', time=2024-09-14T13:12:29.978791+0000, chain.objs.size()=1 2024-09-14T11:17:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.763+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34__shadow_.SgWqjePsO6uD_-CQclb1yo0TM3OTeFZ_0 2024-09-14T11:17:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.763+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9629477805157433457', time=2024-09-14T13:13:06.181184+0000, chain.objs.size()=1 2024-09-14T11:17:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.763+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36__shadow_.n3otfXyqUuT3_T8NN2OMYTDu1gXGCM0_0 2024-09-14T11:17:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.763+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1678494177511769387', time=2024-09-14T13:13:07.073234+0000, chain.objs.size()=1 2024-09-14T11:17:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.763+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36__shadow_.QU4cNpvkMGHCr62HIBNVPwUoSHFjsTw_0 2024-09-14T11:17:07.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.763+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.740727542991601426', time=2024-09-14T13:13:45.563871+0000, chain.objs.size()=1 2024-09-14T11:17:07.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.763+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39__shadow_.dLAiuMZ7aKsVELqVSGZl9PnBvQVXaqX_0 2024-09-14T11:17:07.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.766+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.768+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:17:07.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T11:17:07.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6823454994647417731', time=2024-09-14T13:09:55.141081+0000, chain.objs.size()=1 2024-09-14T11:17:07.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22__shadow_.CulgmmglH_dxtVEuvr4V57dA472vUwF_0 2024-09-14T11:17:07.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1089668814194666668', time=2024-09-14T13:11:13.047277+0000, chain.objs.size()=1 2024-09-14T11:17:07.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28__shadow_.iWw7epaQlPf6DqGV1C7VBTOuduDv4AX_0 2024-09-14T11:17:07.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12110775111481473677', time=2024-09-14T13:11:15.580957+0000, chain.objs.size()=1 2024-09-14T11:17:07.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29__shadow_.CI8O4eAbLEZ1kAgE_46u3CW21U9G3ek_0 2024-09-14T11:17:07.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1876957343163318295', time=2024-09-14T13:11:49.183153+0000, chain.objs.size()=1 2024-09-14T11:17:07.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30__shadow_.4aGrga-VYCpVy_iGKaXV2d2GnO5GlqA_0 2024-09-14T11:17:07.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7686991207962150027', time=2024-09-14T13:11:49.184011+0000, chain.objs.size()=1 2024-09-14T11:17:07.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30__shadow_.ROzqlxMLJPjkeB2BjSfiVRxxOnamZ19_0 2024-09-14T11:17:07.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3730514196381523773', time=2024-09-14T13:11:49.211960+0000, chain.objs.size()=1 2024-09-14T11:17:07.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30__shadow_.T7Y_4cRWveuIMvAkTpZlY_UQVv54WOS_0 2024-09-14T11:17:07.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8986244197147435942', time=2024-09-14T13:11:51.477741+0000, chain.objs.size()=1 2024-09-14T11:17:07.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31__shadow_.elD6eUvyhroOu7VfRZXAxyGD52Z3TVj_0 2024-09-14T11:17:07.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4295610186501638084', time=2024-09-14T13:12:30.895362+0000, chain.objs.size()=1 2024-09-14T11:17:07.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34__shadow_.ZFgph4Ji6_bhZ7N0vOwIBTMI7kDLUj5_0 2024-09-14T11:17:07.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2108215404849734805', time=2024-09-14T13:13:04.311130+0000, chain.objs.size()=1 2024-09-14T11:17:07.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35__shadow_.uzg5LpszVXG12l28BtOCyIaVITvW0qU_0 2024-09-14T11:17:07.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17248782826812511132', time=2024-09-14T13:13:04.311817+0000, chain.objs.size()=1 2024-09-14T11:17:07.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35__shadow_.ReWAW2IJpEq92-RdOqzKNGZZzJaiBpm_0 2024-09-14T11:17:07.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8745807548871807047', time=2024-09-14T13:13:45.516055+0000, chain.objs.size()=1 2024-09-14T11:17:07.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39__shadow_.2m5WpAxDzIN_5_wcnYl8kPn-O7WcydL_0 2024-09-14T11:17:07.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7347652828635351781', time=2024-09-14T13:13:45.613137+0000, chain.objs.size()=1 2024-09-14T11:17:07.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.770+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39__shadow_.6SWnaU36GIl8bLlXYrxfNXg-Zj5qY7G_0 2024-09-14T11:17:07.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.773+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2717564277524870005', time=2024-09-14T13:14:18.917666+0000, chain.objs.size()=1 2024-09-14T11:17:07.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.773+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40__shadow_.Bkj7Yz6cjImURh3KBwacyeR2acZEUe7_0 2024-09-14T11:17:07.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.773+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16996323985665146395', time=2024-09-14T13:16:42.981340+0000, chain.objs.size()=1 2024-09-14T11:17:07.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.773+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19__shadow:RCqFx3ZsWlIoZyGvpAXzPvu0ylONatd_.eALyxsfn9k6nhGiSYn22aRXMDPQAlV5_0 2024-09-14T11:17:07.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.776+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.778+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:17:07.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.779+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.780+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.780+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-14T11:17:07.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.780+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5715470445443067381', time=2024-09-14T13:07:51.665899+0000, chain.objs.size()=1 2024-09-14T11:17:07.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.780+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8__shadow_.2ppZVJWC8u375gUK8tV71iV_7Ys_qHi_0 2024-09-14T11:17:07.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.780+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5139801919747112996', time=2024-09-14T13:09:17.718680+0000, chain.objs.size()=1 2024-09-14T11:17:07.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.780+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20__shadow_.yvKia3pa52St6Pi8MTKVhxBZFbrbw9Z_0 2024-09-14T11:17:07.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.780+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11955797870073144432', time=2024-09-14T13:09:18.865933+0000, chain.objs.size()=1 2024-09-14T11:17:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.780+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20__shadow_.Ul87Nx1WAL_GV33hxECKGCIZk3R2p-h_0 2024-09-14T11:17:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.780+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9036589903563098185', time=2024-09-14T13:09:18.898632+0000, chain.objs.size()=1 2024-09-14T11:17:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.780+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20__shadow_.fm1BAlAbJ0k8_mg6y4kuRk5bqG1Vvj0_0 2024-09-14T11:17:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.780+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17949737911934440785', time=2024-09-14T13:10:34.160382+0000, chain.objs.size()=1 2024-09-14T11:17:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.781+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25__shadow_.7eGu5ovYAFvX-aZobhjlQDV95I3XE2U_0 2024-09-14T11:17:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.781+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9902117953613128772', time=2024-09-14T13:11:15.606210+0000, chain.objs.size()=1 2024-09-14T11:17:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.781+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29__shadow_.AD7Gcw45gTtfHVcWK0WTapLU2APtohn_0 2024-09-14T11:17:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.781+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2516483214330942911', time=2024-09-14T13:11:49.174116+0000, chain.objs.size()=1 2024-09-14T11:17:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.781+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30__shadow_.co7xmaqa6iFbxvhVkQgaJ3lZ6BaHNJG_0 2024-09-14T11:17:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.781+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10257719061811442770', time=2024-09-14T13:13:43.490615+0000, chain.objs.size()=1 2024-09-14T11:17:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.781+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38__shadow_.iVfd8G1mMD44UUQ0p54HBXLIGbwQV4u_0 2024-09-14T11:17:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.781+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14836898224144823892', time=2024-09-14T13:14:18.942002+0000, chain.objs.size()=1 2024-09-14T11:17:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.781+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40__shadow_.j2jkuQwCkgJx4uZv6cIL6ndOLP8jNUi_0 2024-09-14T11:17:07.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.784+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.786+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:17:07.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.787+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.788+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.788+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:17:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.788+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18129315400251047105', time=2024-09-14T13:07:51.289580+0000, chain.objs.size()=1 2024-09-14T11:17:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.788+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5__shadow_.je400QGZU1z2gFko4Usi80sZRTQBNiQ_0 2024-09-14T11:17:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.788+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2903691111790917778', time=2024-09-14T13:07:51.306390+0000, chain.objs.size()=1 2024-09-14T11:17:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.788+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5__shadow_.bg-XwhFx0WSJVKBk1kY1xpw57FpkqPL_0 2024-09-14T11:17:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.788+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13144282124455761199', time=2024-09-14T13:07:51.338215+0000, chain.objs.size()=4 2024-09-14T11:17:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.788+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12__multipart_foo.2~BhCROLGbt7eyFkBa0Yq6jYLoc5xcj8C.1 2024-09-14T11:17:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.788+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12__multipart_foo.2~BhCROLGbt7eyFkBa0Yq6jYLoc5xcj8C.2 2024-09-14T11:17:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.788+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12__multipart_foo.2~BhCROLGbt7eyFkBa0Yq6jYLoc5xcj8C.3 2024-09-14T11:17:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.788+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12__multipart_foo.2~BhCROLGbt7eyFkBa0Yq6jYLoc5xcj8C.4 2024-09-14T11:17:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.788+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='_xWgX2Xz-Cw1aX61uElBXs2oxl9hFrsf', time=2024-09-14T13:07:51.445272+0000, chain.objs.size()=1 2024-09-14T11:17:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.788+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16__shadow_.DOSVPhmytqVNacnUOObuPIyOpUi00qq_0 2024-09-14T11:17:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.788+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12018636127794778101', time=2024-09-14T13:10:34.148907+0000, chain.objs.size()=1 2024-09-14T11:17:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.788+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.25__shadow_.waYG7MeujW4pS7i7vR9Qi0WYeRP8RQp_0 2024-09-14T11:17:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.788+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6695819222198241372', time=2024-09-14T13:10:39.386402+0000, chain.objs.size()=1 2024-09-14T11:17:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.788+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27__shadow_.7Ntj31o-gMMptOi0_tigjl9KLgR872X_0 2024-09-14T11:17:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.788+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7430024692496154445', time=2024-09-14T13:10:39.419382+0000, chain.objs.size()=1 2024-09-14T11:17:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.788+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27__shadow_.JnYY5IZnh8Nvh-T3HjOCCKXCCWEV3Lg_0 2024-09-14T11:17:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.788+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17229149720534836482', time=2024-09-14T13:11:17.854997+0000, chain.objs.size()=1 2024-09-14T11:17:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.788+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30__shadow_.dYJBsNaMc4rIx6xD4V1gbEm4M8CrssY_0 2024-09-14T11:17:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.788+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17408096273218300984', time=2024-09-14T13:11:52.203982+0000, chain.objs.size()=1 2024-09-14T11:17:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.788+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31__shadow_.QSr6el5WzgieYzMexPRM_6eEiJMM5gu_0 2024-09-14T11:17:07.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.791+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14744517122667021672', time=2024-09-14T13:11:54.485120+0000, chain.objs.size()=1 2024-09-14T11:17:07.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.791+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32__shadow_.4mKWvtzVK93fdTXmjDfJqV2bVubYPNB_0 2024-09-14T11:17:07.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.791+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13086512300666080253', time=2024-09-14T13:11:54.513898+0000, chain.objs.size()=1 2024-09-14T11:17:07.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.791+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32__shadow_.AHYPxR0v0YzZ1UaKo4zaeQ9wBEtF_1k_0 2024-09-14T11:17:07.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.791+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7231062898714389855', time=2024-09-14T13:12:28.069890+0000, chain.objs.size()=1 2024-09-14T11:17:07.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.791+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33__shadow_.bkVSoGbx1G4QbTo5envtTFaZ836o-1D_0 2024-09-14T11:17:07.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.791+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1669736666368896689', time=2024-09-14T13:12:30.923199+0000, chain.objs.size()=1 2024-09-14T11:17:07.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.791+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34__shadow_.9qqUghdM-uH3x5J_1BfHuwnkJbtVMzm_0 2024-09-14T11:17:07.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.791+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7568004424867954464', time=2024-09-14T13:13:07.114135+0000, chain.objs.size()=1 2024-09-14T11:17:07.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.791+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.36__shadow_.RPBLZP98aEPbEOc7e1mfnhE7pnV85bA_0 2024-09-14T11:17:07.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.791+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3281119169779799808', time=2024-09-14T13:13:40.686207+0000, chain.objs.size()=1 2024-09-14T11:17:07.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.791+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.37__shadow_.jr1AtGym7ScOWqGkuj0BHMdKjcszDj3_0 2024-09-14T11:17:07.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.792+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8340241559103196720', time=2024-09-14T13:13:45.563136+0000, chain.objs.size()=1 2024-09-14T11:17:07.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.792+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39__shadow_.ZLuI4VWQpD14Kwn3IMQuJj3VOfo1ukU_0 2024-09-14T11:17:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.795+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.797+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:17:07.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.799+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.799+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.800+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T11:17:07.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.800+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17917533110369099847', time=2024-09-14T13:07:51.385637+0000, chain.objs.size()=4 2024-09-14T11:17:07.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.800+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11__multipart_foo.2~1o4VwvX6w_Pqa73xTdZwhNNBG1nMef9.1 2024-09-14T11:17:07.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.800+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11__multipart_foo.2~1o4VwvX6w_Pqa73xTdZwhNNBG1nMef9.2 2024-09-14T11:17:07.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.800+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11__multipart_foo.2~1o4VwvX6w_Pqa73xTdZwhNNBG1nMef9.3 2024-09-14T11:17:07.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.800+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11__multipart_foo.2~1o4VwvX6w_Pqa73xTdZwhNNBG1nMef9.4 2024-09-14T11:17:07.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.800+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='_RJero_JBsD7BaqhBz6HjikCGr2KyWKL', time=2024-09-14T13:07:51.541154+0000, chain.objs.size()=1 2024-09-14T11:17:07.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.800+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__shadow_.yZmV0PlYz67euE4Cch9kuGCdz71c5ZC_0 2024-09-14T11:17:07.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.800+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3790287000286336820', time=2024-09-14T13:07:51.545372+0000, chain.objs.size()=3 2024-09-14T11:17:07.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.800+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-FROZEN.2~jMGeIzLkKIEiPrsrWc4GgGxUHr6naiZ.1 2024-09-14T11:17:07.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.800+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-FROZEN.2~jMGeIzLkKIEiPrsrWc4GgGxUHr6naiZ.2 2024-09-14T11:17:07.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.800+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17__multipart_foo-FROZEN.2~jMGeIzLkKIEiPrsrWc4GgGxUHr6naiZ.3 2024-09-14T11:17:07.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.800+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7930744206827558052', time=2024-09-14T13:09:55.089810+0000, chain.objs.size()=1 2024-09-14T11:17:07.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.800+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22__shadow_.rqWB2cAhpC2ZdVHf9nwoNdE00T9MI8g_0 2024-09-14T11:17:07.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.800+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7468135558397707527', time=2024-09-14T13:09:55.119356+0000, chain.objs.size()=1 2024-09-14T11:17:07.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.800+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22__shadow_.FKaGeIX1qGSty5__bZD0fiUd63fkyCa_0 2024-09-14T11:17:07.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.800+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12437193971314717778', time=2024-09-14T13:10:00.758037+0000, chain.objs.size()=1 2024-09-14T11:17:07.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.800+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24__shadow_.jgo03s2oQb67or8fbL-z2NyXoKkJX0V_0 2024-09-14T11:17:07.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.800+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5782645094994701068', time=2024-09-14T13:10:00.833682+0000, chain.objs.size()=1 2024-09-14T11:17:07.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.800+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24__shadow_.bN0jywPRZytS2lq75tUhQbtNiXfx6u3_0 2024-09-14T11:17:07.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.803+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3930126588310577849', time=2024-09-14T13:11:15.605989+0000, chain.objs.size()=1 2024-09-14T11:17:07.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.803+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.29__shadow_.0_vstVG4ExPYVUwHYyiW3c52PDtNFMd_0 2024-09-14T11:17:07.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.803+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2885062400065180264', time=2024-09-14T13:11:52.214354+0000, chain.objs.size()=1 2024-09-14T11:17:07.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.803+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31__shadow_.zxxhTKspXaUBOtnVRJ4rM8SRmXV0BBJ_0 2024-09-14T11:17:07.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.803+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2325114906988924228', time=2024-09-14T13:12:30.968083+0000, chain.objs.size()=1 2024-09-14T11:17:07.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.803+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34__shadow_.XnUlVfRhJJyuM8ppvaye217APMTWJ6o_0 2024-09-14T11:17:07.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.806+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.808+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:17:07.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.809+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.810+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.810+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:17:07.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.810+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8391506264715265748', time=2024-09-14T13:07:51.360252+0000, chain.objs.size()=4 2024-09-14T11:17:07.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.810+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13__multipart_foo.2~4jm2dL2537ly5YkNb3t0tMattXx8fKg.1 2024-09-14T11:17:07.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.810+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13__multipart_foo.2~4jm2dL2537ly5YkNb3t0tMattXx8fKg.2 2024-09-14T11:17:07.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.810+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13__multipart_foo.2~4jm2dL2537ly5YkNb3t0tMattXx8fKg.3 2024-09-14T11:17:07.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.810+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13__multipart_foo.2~4jm2dL2537ly5YkNb3t0tMattXx8fKg.4 2024-09-14T11:17:07.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.810+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16130463805342538476', time=2024-09-14T13:09:21.153841+0000, chain.objs.size()=1 2024-09-14T11:17:07.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.810+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.21__shadow_.dVGzRTcynfh_TzdaRP4BkI3fUjtDA1q_0 2024-09-14T11:17:07.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.810+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4087270397828563729', time=2024-09-14T13:09:58.567028+0000, chain.objs.size()=1 2024-09-14T11:17:07.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.810+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23__shadow_.XzEz_eDCnIxqBBMtdfqVK6s7Z8as-tw_0 2024-09-14T11:17:07.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.810+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4965987762149110175', time=2024-09-14T13:10:37.173033+0000, chain.objs.size()=1 2024-09-14T11:17:07.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.810+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.26__shadow_.yQWROgrOkfLqkKGGP6tibBuVPgMrFvg_0 2024-09-14T11:17:07.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.810+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15450605575692118215', time=2024-09-14T13:10:39.481885+0000, chain.objs.size()=1 2024-09-14T11:17:07.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.810+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27__shadow_.Bc0gGu47yip3wMQ8Jd0Gy_O70C9pJ3b_0 2024-09-14T11:17:07.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.810+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12076681748625136478', time=2024-09-14T13:11:49.225324+0000, chain.objs.size()=1 2024-09-14T11:17:07.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.810+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.30__shadow_.4Pv27jWQGKnX4i6xDBTKixaE8hMCkui_0 2024-09-14T11:17:07.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.810+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9897917217239261117', time=2024-09-14T13:11:52.217720+0000, chain.objs.size()=1 2024-09-14T11:17:07.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.810+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31__shadow_.TZW4CNFMIq1wpag0fuskGa8C-MJG6B5_0 2024-09-14T11:17:07.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.810+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1332448548674704245', time=2024-09-14T13:11:52.218404+0000, chain.objs.size()=1 2024-09-14T11:17:07.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.810+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31__shadow_.Vsh5UT1wcqiI405fUEZSUpDRnXhoTsZ_0 2024-09-14T11:17:07.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.810+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6381371120453383310', time=2024-09-14T13:11:52.257548+0000, chain.objs.size()=1 2024-09-14T11:17:07.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.810+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.31__shadow_.YA9aPYGCvhymXIzigEUR1wjO90W6T1B_0 2024-09-14T11:17:07.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.813+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7676761971808743339', time=2024-09-14T13:12:28.052073+0000, chain.objs.size()=1 2024-09-14T11:17:07.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.813+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33__shadow_.RH_szy_PW10nKmgdaObNhNguzge6nWX_0 2024-09-14T11:17:07.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.813+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17076277480545660009', time=2024-09-14T13:12:30.895362+0000, chain.objs.size()=1 2024-09-14T11:17:07.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.813+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34__shadow_.SK74rF7URmm-oLLA2lVacmj-Q8t1gAX_0 2024-09-14T11:17:07.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.813+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6163329648440719406', time=2024-09-14T13:13:43.495820+0000, chain.objs.size()=1 2024-09-14T11:17:07.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.813+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38__shadow_.vhmEJmgjA945MSY9tNxtqao67XueC4J_0 2024-09-14T11:17:07.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.813+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2051990580933561468', time=2024-09-14T13:13:43.496689+0000, chain.objs.size()=1 2024-09-14T11:17:07.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.813+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.38__shadow_.G2U1BYjLdkwga-P85KZyy9OpiUs-7t1_0 2024-09-14T11:17:07.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.813+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11671248446467032468', time=2024-09-14T13:13:45.521673+0000, chain.objs.size()=1 2024-09-14T11:17:07.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.813+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39__shadow_.toK2L-Li4vb_y_EU-I_cf-QBMPMTsB4_0 2024-09-14T11:17:07.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.814+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12076588841313038339', time=2024-09-14T13:13:45.575965+0000, chain.objs.size()=1 2024-09-14T11:17:07.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.814+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39__shadow_.TTZBXMnUhBpPTLm16uxdZ-6CIsOfjD3_0 2024-09-14T11:17:07.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.815+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5390036068537560200', time=2024-09-14T13:14:18.971047+0000, chain.objs.size()=1 2024-09-14T11:17:07.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.815+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40__shadow_._hrmACsD2VYp_c4KQUOWpnQxCaMl6aK_0 2024-09-14T11:17:07.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.818+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.820+0000 7f4534175800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:17:07.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.821+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:07.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T11:17:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10310404508625791115', time=2024-09-14T13:09:55.083692+0000, chain.objs.size()=1 2024-09-14T11:17:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.22__shadow_.LmNx6hZ-eeXt9kMAvIgMk-iM7sq9GBa_0 2024-09-14T11:17:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13681238872820870883', time=2024-09-14T13:10:00.801295+0000, chain.objs.size()=1 2024-09-14T11:17:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24__shadow_.kCs7Rjuo4-fmZr3jp11MnxqfX8H6MU1_0 2024-09-14T11:17:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3305338830215261252', time=2024-09-14T13:10:39.424543+0000, chain.objs.size()=1 2024-09-14T11:17:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.27__shadow_.LdvAOwnd_gVfIgsxqjuMZT6J2-HNjjo_0 2024-09-14T11:17:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12930842559081622586', time=2024-09-14T13:11:12.995201+0000, chain.objs.size()=1 2024-09-14T11:17:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.28__shadow_.w1geVdtLkRmR5RJvd9JvBRuDkZy4dJ6_0 2024-09-14T11:17:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13431494729946320566', time=2024-09-14T13:11:54.489127+0000, chain.objs.size()=1 2024-09-14T11:17:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.32__shadow_.LOaFByJWTAX9PuoJXkr2Wy_HbCpNh3a_0 2024-09-14T11:17:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9280679323406988638', time=2024-09-14T13:12:28.066983+0000, chain.objs.size()=1 2024-09-14T11:17:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33__shadow_.s9acig7xbxZt-SndJM36MObwyluZcVg_0 2024-09-14T11:17:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3261306869621825479', time=2024-09-14T13:12:30.899170+0000, chain.objs.size()=1 2024-09-14T11:17:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34__shadow_.QSpA7IOB03c8XMVlWflmpc5cyDI01-Z_0 2024-09-14T11:17:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4785307175864745933', time=2024-09-14T13:12:30.899726+0000, chain.objs.size()=1 2024-09-14T11:17:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.34__shadow_.MIYNAvCcqJcxv1zw22xiCm7Fq8JW5pi_0 2024-09-14T11:17:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16686065212771749652', time=2024-09-14T13:13:04.328686+0000, chain.objs.size()=1 2024-09-14T11:17:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35__shadow_.9pHy1q6ppN-NnMPFsEgGS0176ueXtUp_0 2024-09-14T11:17:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.224691565798357399', time=2024-09-14T13:13:04.356315+0000, chain.objs.size()=1 2024-09-14T11:17:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.35__shadow_.4A1M88M709QSSmLtdzLnfMsuLY1K1JS_0 2024-09-14T11:17:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7117097356082175081', time=2024-09-14T13:13:45.512737+0000, chain.objs.size()=1 2024-09-14T11:17:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39__shadow_.wklpZlBrNyYLzG-AhQnzMCyKgJxWpcH_0 2024-09-14T11:17:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10609615705958107854', time=2024-09-14T13:16:28.977512+0000, chain.objs.size()=1 2024-09-14T11:17:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.822+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18__shadow_.NUPBhsIEN-We1UzKQvQvEI2tDU3qtbz_0 2024-09-14T11:17:07.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.824+0000 7f4534175800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14875218217935491020', time=2024-09-14T13:16:37.814683+0000, chain.objs.size()=1 2024-09-14T11:17:07.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.824+0000 7f4534175800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19__shadow:8jWvjA1qnUurEbDLXFDzF3DD64tkJ9o_.7svtTFf49pMR7zeELa4GmjTtgD2aZoQ_0 2024-09-14T11:17:07.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.828+0000 7f4534175800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:17:07.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.831+0000 7f43e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:07.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.834+0000 7f4534175800 20 remove_watcher() i=0 2024-09-14T11:17:07.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.834+0000 7f4534175800 2 removed watcher, disabling cache 2024-09-14T11:17:07.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.835+0000 7f4534175800 20 remove_watcher() i=1 2024-09-14T11:17:07.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.836+0000 7f4534175800 20 remove_watcher() i=2 2024-09-14T11:17:07.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.837+0000 7f4534175800 20 remove_watcher() i=3 2024-09-14T11:17:07.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.837+0000 7f4534175800 20 remove_watcher() i=4 2024-09-14T11:17:07.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.838+0000 7f4534175800 20 remove_watcher() i=5 2024-09-14T11:17:07.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.839+0000 7f4534175800 20 remove_watcher() i=6 2024-09-14T11:17:07.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.840+0000 7f4534175800 20 remove_watcher() i=7 2024-09-14T11:17:07.850 DEBUG:teuthology.orchestra.run.smithi050:> radosgw-admin gc process --include-all 2024-09-14T11:17:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:07.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.984+0000 7fcea8863800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.985+0000 7fcea8863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.985+0000 7fcea8863800 20 realm 2024-09-14T11:17:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.985+0000 7fcea8863800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.986+0000 7fcea8863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.986+0000 7fcea8863800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.986+0000 7fcea8863800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.986+0000 7fcea8863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.986+0000 7fcea8863800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.987+0000 7fcea8863800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.987+0000 7fcea8863800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.988+0000 7fcea8863800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.988+0000 7fcea8863800 20 searching for the correct realm 2024-09-14T11:17:07.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:07.991+0000 7fce9db53640 0 -- 172.21.15.50:0/1889561615 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fcea0018040 msgr2=0x7fcea0018420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:08.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.196+0000 7fcea6b55640 0 -- 172.21.15.50:0/1889561615 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55b7fd8b0ea0 msgr2=0x55b7fd8b32b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:08.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.200+0000 7fcea8863800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:17:08.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.200+0000 7fcea8863800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:08.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.200+0000 7fcea8863800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:17:08.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.200+0000 7fcea8863800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:08.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.200+0000 7fcea8863800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:08.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.200+0000 7fcea8863800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:08.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.200+0000 7fcea8863800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.201+0000 7fcea8863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.201+0000 7fcea8863800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.201+0000 7fcea8863800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:08.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.201+0000 7fcea8863800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.201+0000 7fcea8863800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.201+0000 7fcea8863800 20 zone default found 2024-09-14T11:17:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.201+0000 7fcea8863800 4 Realm: () 2024-09-14T11:17:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.201+0000 7fcea8863800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:17:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.201+0000 7fcea8863800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:17:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.201+0000 7fcea8863800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.201+0000 7fcea8863800 20 zonegroup default 2024-09-14T11:17:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.201+0000 7fcea8863800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.201+0000 7fcea8863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.202+0000 7fcea8863800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.202+0000 7fcea8863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.202+0000 7fcea8863800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.202+0000 7fcea8863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.202+0000 7fcea8863800 20 started sync module instance, tier type = 2024-09-14T11:17:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.202+0000 7fcea8863800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:17:08.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.210+0000 7fcea8863800 20 add_watcher() i=0 2024-09-14T11:17:08.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.210+0000 7fcea8863800 20 add_watcher() i=1 2024-09-14T11:17:08.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.210+0000 7fcea8863800 20 add_watcher() i=2 2024-09-14T11:17:08.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.210+0000 7fcea8863800 20 add_watcher() i=3 2024-09-14T11:17:08.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.210+0000 7fcea8863800 20 add_watcher() i=4 2024-09-14T11:17:08.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.210+0000 7fcea8863800 20 add_watcher() i=5 2024-09-14T11:17:08.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.210+0000 7fcea8863800 20 add_watcher() i=6 2024-09-14T11:17:08.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.211+0000 7fcea8863800 20 add_watcher() i=7 2024-09-14T11:17:08.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.211+0000 7fcea8863800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:08.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.213+0000 7fcd5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:08.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.214+0000 7fcea8863800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:08.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.214+0000 7fcea8863800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:08.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.247+0000 7fccd77fe640 20 reqs_thread_entry: start 2024-09-14T11:17:08.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.247+0000 7fcea8863800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:08.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.248+0000 7fcea8863800 20 Filter name: none 2024-09-14T11:17:08.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.248+0000 7fccd57fa640 20 reqs_thread_entry: start 2024-09-14T11:17:08.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.248+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:17:08.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.249+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.249+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.250+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.251+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:17:08.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.252+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.252+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.253+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.253+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:17:08.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.255+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.255+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.255+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.256+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:17:08.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.258+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.258+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.258+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.259+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:17:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.260+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.261+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.261+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.262+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:17:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.263+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.264+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.264+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.265+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:17:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.267+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.267+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.267+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.268+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:17:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.269+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.270+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.270+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.271+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:17:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.273+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.273+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.273+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.274+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:17:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.276+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.276+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.277+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.278+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:17:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.279+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.280+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.280+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.281+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:17:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.283+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.283+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.284+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.285+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:17:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.286+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.286+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.287+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.288+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:17:08.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.289+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.290+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.290+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.291+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:17:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.292+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.292+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.293+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.293+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:17:08.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.295+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.295+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.295+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.296+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:17:08.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.297+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.298+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.298+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.299+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:17:08.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.300+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.301+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.301+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.303+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:17:08.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.305+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.305+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.305+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.306+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:17:08.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.307+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.308+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.308+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.309+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:17:08.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.310+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.311+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.311+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.312+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:17:08.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.313+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.314+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.314+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.315+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:17:08.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.316+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.317+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.317+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.318+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:17:08.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.319+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.320+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.320+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.321+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:17:08.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.323+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.323+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.324+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.324+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:17:08.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.326+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.327+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.327+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.328+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:17:08.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.329+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.330+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.330+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.331+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:17:08.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.332+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.333+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.333+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.334+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:17:08.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.335+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.336+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.336+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.337+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:17:08.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.338+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.339+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.339+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.340+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:17:08.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.341+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.341+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.342+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.343+0000 7fcea8863800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:17:08.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.344+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.345+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:17:08.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.345+0000 7fcea8863800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:17:08.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.348+0000 7fcd5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:08.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.351+0000 7fcea8863800 20 remove_watcher() i=0 2024-09-14T11:17:08.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.351+0000 7fcea8863800 2 removed watcher, disabling cache 2024-09-14T11:17:08.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.351+0000 7fcea8863800 20 remove_watcher() i=1 2024-09-14T11:17:08.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.353+0000 7fcea8863800 20 remove_watcher() i=2 2024-09-14T11:17:08.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.354+0000 7fcea8863800 20 remove_watcher() i=3 2024-09-14T11:17:08.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.355+0000 7fcea8863800 20 remove_watcher() i=4 2024-09-14T11:17:08.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.356+0000 7fcea8863800 20 remove_watcher() i=5 2024-09-14T11:17:08.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.357+0000 7fcea8863800 20 remove_watcher() i=6 2024-09-14T11:17:08.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:17:08.358+0000 7fcea8863800 20 remove_watcher() i=7 2024-09-14T11:17:08.368 DEBUG:teuthology.orchestra.run.smithi050:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-14T11:17:08.869 INFO:teuthology.orchestra.run.smithi050.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-14T11:17:12.470 INFO:teuthology.orchestra.run.smithi050.stdout:> Task :clean UP-TO-DATE 2024-09-14T11:17:30.569 INFO:teuthology.orchestra.run.smithi050.stdout:> Task :compileJava 2024-09-14T11:17:30.569 INFO:teuthology.orchestra.run.smithi050.stdout:> Task :processResources 2024-09-14T11:17:30.569 INFO:teuthology.orchestra.run.smithi050.stdout:> Task :classes 2024-09-14T11:17:31.371 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:31.371 INFO:teuthology.orchestra.run.smithi050.stdout:> Task :compileTestJava 2024-09-14T11:17:31.371 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:31.371 INFO:teuthology.orchestra.run.smithi050.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:17:31.371 INFO:teuthology.orchestra.run.smithi050.stdout:> Task :testClasses 2024-09-14T11:17:31.371 INFO:teuthology.orchestra.run.smithi050.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:17:31.371 INFO:teuthology.orchestra.run.smithi050.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:17:37.668 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:37.668 INFO:teuthology.orchestra.run.smithi050.stdout:> Task :test 2024-09-14T11:17:37.669 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:37.669 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-14T11:17:42.968 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:42.969 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-14T11:17:43.368 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:43.368 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-14T11:17:43.468 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:43.469 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-14T11:17:43.868 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:43.868 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-14T11:17:52.968 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:52.968 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-14T11:17:53.368 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:53.368 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:17:53.369 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:53.369 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:17:53.468 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:53.468 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-14T11:17:53.568 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:53.568 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-14T11:17:53.968 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:53.968 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-14T11:17:59.668 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:17:59.668 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-14T11:18:00.368 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:18:00.368 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:18:00.668 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:18:00.668 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-14T11:18:00.668 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14 11:18:00,600 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:18:26.469 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:18:26.469 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:18:27.269 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:18:27.269 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-14T11:18:27.269 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:18:27.269 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-14T11:18:27.668 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:18:27.668 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-14T11:18:27.868 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:18:27.868 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-14T11:18:28.568 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:18:28.569 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-14T11:18:34.068 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:18:34.068 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-14T11:18:34.468 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:18:34.468 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:18:34.568 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:18:34.568 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:18:34.668 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:18:34.668 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-14T11:18:43.268 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:18:43.268 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-14T11:18:47.668 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:18:47.668 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:19:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:19:07.368 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:19:07.968 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:19:07.968 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-14T11:19:14.868 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:19:14.869 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-14T11:19:15.268 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:19:15.268 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:20:45.869 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:20:45.869 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:20:46.268 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:20:46.268 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-14T11:20:54.568 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:20:54.568 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-14T11:20:54.968 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:20:54.968 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-14T11:21:00.268 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:00.268 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-14T11:21:00.668 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:00.668 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-14T11:21:02.668 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:02.668 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-14T11:21:10.868 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:10.869 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-14T11:21:10.968 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:10.968 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-14T11:21:11.368 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:11.368 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-14T11:21:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:11.468 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-14T11:21:11.968 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:11.968 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-14T11:21:11.968 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:11.969 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-14T11:21:12.468 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:12.468 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-14T11:21:12.568 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:12.568 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-14T11:21:12.968 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:12.968 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-14T11:21:13.068 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:13.068 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-14T11:21:13.468 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:13.468 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-14T11:21:13.568 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:13.568 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-14T11:21:14.068 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:14.068 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-14T11:21:14.168 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:14.168 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-14T11:21:14.568 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:14.568 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-14T11:21:26.868 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:26.868 INFO:teuthology.orchestra.run.smithi050.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-14T11:21:27.368 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:27.368 INFO:teuthology.orchestra.run.smithi050.stdout:---------------------------------------------------------------------- 2024-09-14T11:21:27.368 INFO:teuthology.orchestra.run.smithi050.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-14T11:21:27.369 INFO:teuthology.orchestra.run.smithi050.stdout:---------------------------------------------------------------------- 2024-09-14T11:21:27.453 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:27.453 INFO:teuthology.orchestra.run.smithi050.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:21:27.454 INFO:teuthology.orchestra.run.smithi050.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:21:27.454 INFO:teuthology.orchestra.run.smithi050.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:21:27.454 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:27.454 INFO:teuthology.orchestra.run.smithi050.stdout:BUILD SUCCESSFUL in 4m 18s 2024-09-14T11:21:27.454 INFO:teuthology.orchestra.run.smithi050.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-14T11:21:27.772 DEBUG:teuthology.orchestra.run.smithi050:> radosgw-admin gc process --include-all 2024-09-14T11:21:27.826 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:27.827 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:27.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.868+0000 7fc9e1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:21:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.869+0000 7fc9e1c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.869+0000 7fc9e1c40800 20 realm 2024-09-14T11:21:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.869+0000 7fc9e1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:21:27.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.870+0000 7fc9e1c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:27.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.870+0000 7fc9e1c40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:27.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.870+0000 7fc9e1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:21:27.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.870+0000 7fc9e1c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:27.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.870+0000 7fc9e1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:21:27.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.871+0000 7fc9e1c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:27.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.871+0000 7fc9e1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:21:27.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.871+0000 7fc9e1c40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:27.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.871+0000 7fc9e1c40800 20 searching for the correct realm 2024-09-14T11:21:27.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.875+0000 7fc9def29640 0 -- 172.21.15.50:0/3792109725 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fc9d8073030 msgr2=0x7fc9d80ad040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:27.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.879+0000 7fc9dff2b640 0 -- 172.21.15.50:0/3792109725 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x564f96d7cce0 msgr2=0x564f96d7f1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:27.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.883+0000 7fc9e1c40800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:21:27.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.883+0000 7fc9e1c40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:27.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.883+0000 7fc9e1c40800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:21:27.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.883+0000 7fc9e1c40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:27.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.883+0000 7fc9e1c40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:27.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.883+0000 7fc9e1c40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:27.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.883+0000 7fc9e1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:21:27.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.884+0000 7fc9e1c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:27.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.884+0000 7fc9e1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:21:27.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.884+0000 7fc9e1c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:27.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.884+0000 7fc9e1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:21:27.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.884+0000 7fc9e1c40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:27.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.884+0000 7fc9e1c40800 20 zone default found 2024-09-14T11:21:27.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.884+0000 7fc9e1c40800 4 Realm: () 2024-09-14T11:21:27.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.884+0000 7fc9e1c40800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:21:27.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.884+0000 7fc9e1c40800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:21:27.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.884+0000 7fc9e1c40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:27.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.884+0000 7fc9e1c40800 20 zonegroup default 2024-09-14T11:21:27.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.884+0000 7fc9e1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:21:27.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.884+0000 7fc9e1c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:27.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.884+0000 7fc9e1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:21:27.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.885+0000 7fc9e1c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:27.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.885+0000 7fc9e1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:21:27.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.885+0000 7fc9e1c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:27.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.885+0000 7fc9e1c40800 20 started sync module instance, tier type = 2024-09-14T11:21:27.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.885+0000 7fc9e1c40800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:21:27.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.894+0000 7fc9e1c40800 20 add_watcher() i=0 2024-09-14T11:21:27.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.894+0000 7fc9e1c40800 20 add_watcher() i=1 2024-09-14T11:21:27.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.894+0000 7fc9e1c40800 20 add_watcher() i=2 2024-09-14T11:21:27.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.894+0000 7fc9e1c40800 20 add_watcher() i=3 2024-09-14T11:21:27.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.894+0000 7fc9e1c40800 20 add_watcher() i=4 2024-09-14T11:21:27.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.894+0000 7fc9e1c40800 20 add_watcher() i=5 2024-09-14T11:21:27.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.894+0000 7fc9e1c40800 20 add_watcher() i=6 2024-09-14T11:21:27.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.896+0000 7fc9e1c40800 20 add_watcher() i=7 2024-09-14T11:21:27.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.896+0000 7fc9e1c40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:27.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.897+0000 7fc8967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:27.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.898+0000 7fc9e1c40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:27.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.898+0000 7fc9e1c40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:27.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.935+0000 7fc8957e2640 20 reqs_thread_entry: start 2024-09-14T11:21:27.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.935+0000 7fc9e1c40800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:27.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.935+0000 7fc9e1c40800 20 Filter name: none 2024-09-14T11:21:27.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.935+0000 7fc88e7fc640 20 reqs_thread_entry: start 2024-09-14T11:21:27.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.935+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:21:27.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.937+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:27.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.937+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:27.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.937+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:27.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.938+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:21:27.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.940+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:27.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.940+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:27.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.941+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:27.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.941+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17520565663022312087', time=2024-09-14T13:18:26.602660+0000, chain.objs.size()=5 2024-09-14T11:21:27.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.941+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__multipart_key1.2~rYlC2O0n4ThmlDVDRrAglAukAjGKblL.1 2024-09-14T11:21:27.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.941+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__shadow_key1.2~rYlC2O0n4ThmlDVDRrAglAukAjGKblL.1_1 2024-09-14T11:21:27.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.941+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__multipart_key1.2~rYlC2O0n4ThmlDVDRrAglAukAjGKblL.2 2024-09-14T11:21:27.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.941+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__shadow_key1.2~rYlC2O0n4ThmlDVDRrAglAukAjGKblL.2_1 2024-09-14T11:21:27.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.941+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__multipart_key1.2~rYlC2O0n4ThmlDVDRrAglAukAjGKblL.3 2024-09-14T11:21:27.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.944+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:27.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.946+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:21:27.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.947+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:27.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.948+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:27.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.948+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:27.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.948+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5944111769237333519', time=2024-09-14T13:18:26.377472+0000, chain.objs.size()=5 2024-09-14T11:21:27.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.948+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__multipart_key1.2~9_5M9xGPp9qXfDQffCRxJuyIDbkxBgZ.1 2024-09-14T11:21:27.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.948+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__shadow_key1.2~9_5M9xGPp9qXfDQffCRxJuyIDbkxBgZ.1_1 2024-09-14T11:21:27.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.948+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__multipart_key1.2~9_5M9xGPp9qXfDQffCRxJuyIDbkxBgZ.2 2024-09-14T11:21:27.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.948+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__shadow_key1.2~9_5M9xGPp9qXfDQffCRxJuyIDbkxBgZ.2_1 2024-09-14T11:21:27.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.948+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__multipart_key1.2~9_5M9xGPp9qXfDQffCRxJuyIDbkxBgZ.3 2024-09-14T11:21:27.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.951+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:27.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.954+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:21:27.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.955+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:27.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.956+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:27.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.956+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:21:27.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.956+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6229634467966318196', time=2024-09-14T13:18:45.498451+0000, chain.objs.size()=5 2024-09-14T11:21:27.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.956+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.53__multipart_key1.2~XgXIQGClzGoWxTLJXbRV1M8o3jlzpGs.1 2024-09-14T11:21:27.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.956+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.53__multipart_key1.2~XgXIQGClzGoWxTLJXbRV1M8o3jlzpGs.2 2024-09-14T11:21:27.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.956+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.53__multipart_key1.2~XgXIQGClzGoWxTLJXbRV1M8o3jlzpGs.3 2024-09-14T11:21:27.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.956+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.53__multipart_key1.2~XgXIQGClzGoWxTLJXbRV1M8o3jlzpGs.4 2024-09-14T11:21:27.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.956+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.53__multipart_key1.2~XgXIQGClzGoWxTLJXbRV1M8o3jlzpGs.5 2024-09-14T11:21:27.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.956+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6812696036704736374', time=2024-09-14T13:19:07.585309+0000, chain.objs.size()=1 2024-09-14T11:21:27.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.956+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.54__shadow_.V_PhkPcWE4ljAm_e-sIS18vk1IToSsx_0 2024-09-14T11:21:27.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.959+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:27.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.962+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:21:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.963+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.964+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.964+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.964+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12630378761242511424', time=2024-09-14T13:19:07.620729+0000, chain.objs.size()=1 2024-09-14T11:21:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.964+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.54__shadow_.IJtS_zYYVL0Kss7SJarlNvFZ_lLGOdB_0 2024-09-14T11:21:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.965+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.967+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:21:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.968+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:27.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.969+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:27.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.969+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:21:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.969+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2527494366136839582', time=2024-09-14T13:18:13.407146+0000, chain.objs.size()=5 2024-09-14T11:21:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.969+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__multipart_key1.2~u-33o1LjNgNY4UaIec9XMaOYnAmr5-B.1 2024-09-14T11:21:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.969+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__multipart_key1.2~u-33o1LjNgNY4UaIec9XMaOYnAmr5-B.2 2024-09-14T11:21:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.969+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__multipart_key1.2~u-33o1LjNgNY4UaIec9XMaOYnAmr5-B.3 2024-09-14T11:21:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.969+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__multipart_key1.2~u-33o1LjNgNY4UaIec9XMaOYnAmr5-B.4 2024-09-14T11:21:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.969+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__multipart_key1.2~u-33o1LjNgNY4UaIec9XMaOYnAmr5-B.5 2024-09-14T11:21:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.969+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16080922936999201538', time=2024-09-14T13:21:11.073493+0000, chain.objs.size()=1 2024-09-14T11:21:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.969+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.60__shadow_.0sDjaYWEHPdIw8Fl0aGMaSq1ry9ttcH_0 2024-09-14T11:21:27.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.973+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:27.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.975+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:21:27.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.976+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:27.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.977+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:27.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.977+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:27.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.978+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:21:27.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.980+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:27.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.980+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:27.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.980+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:27.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.980+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2676637933301743666', time=2024-09-14T13:21:12.649305+0000, chain.objs.size()=1 2024-09-14T11:21:27.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.980+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.63__shadow_.f3IICSPaj7BdQW87Nj86QtlGd0xbXBe_0 2024-09-14T11:21:27.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.982+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:27.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.984+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:21:27.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.985+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:27.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.986+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:27.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.986+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:27.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.987+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:21:27.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.988+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:27.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.989+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:27.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.989+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:21:27.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.989+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.882867561418736392', time=2024-09-14T13:18:20.104249+0000, chain.objs.size()=5 2024-09-14T11:21:27.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.989+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__multipart_key1.2~7dybmZGO5-ACM8DjNhxxJaDDr3_RmWA.1 2024-09-14T11:21:27.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.989+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__multipart_key1.2~7dybmZGO5-ACM8DjNhxxJaDDr3_RmWA.2 2024-09-14T11:21:27.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.989+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__multipart_key1.2~7dybmZGO5-ACM8DjNhxxJaDDr3_RmWA.3 2024-09-14T11:21:27.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.989+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__multipart_key1.2~7dybmZGO5-ACM8DjNhxxJaDDr3_RmWA.4 2024-09-14T11:21:27.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.989+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__multipart_key1.2~7dybmZGO5-ACM8DjNhxxJaDDr3_RmWA.5 2024-09-14T11:21:27.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.989+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11371341300072876595', time=2024-09-14T13:18:26.922600+0000, chain.objs.size()=4 2024-09-14T11:21:27.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.989+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.47__shadow_.BiiTnvNnwHdAfz9fYArzjIJMU-yndPx_0 2024-09-14T11:21:27.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.989+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.47__shadow_.BiiTnvNnwHdAfz9fYArzjIJMU-yndPx_1 2024-09-14T11:21:27.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.990+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.47__shadow_.BiiTnvNnwHdAfz9fYArzjIJMU-yndPx_2 2024-09-14T11:21:27.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.990+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.47__shadow_.BiiTnvNnwHdAfz9fYArzjIJMU-yndPx_3 2024-09-14T11:21:27.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.990+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18442537272794656778', time=2024-09-14T13:21:00.353770+0000, chain.objs.size()=5 2024-09-14T11:21:27.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.990+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.58__multipart_key1.2~whZY2eSZWRpROlqI-6NTJlVqA_8NRPT.1 2024-09-14T11:21:27.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.991+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.58__multipart_key1.2~whZY2eSZWRpROlqI-6NTJlVqA_8NRPT.2 2024-09-14T11:21:27.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.991+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.58__multipart_key1.2~whZY2eSZWRpROlqI-6NTJlVqA_8NRPT.3 2024-09-14T11:21:27.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.993+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.58__multipart_key1.2~whZY2eSZWRpROlqI-6NTJlVqA_8NRPT.4 2024-09-14T11:21:27.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.993+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.58__multipart_key1.2~whZY2eSZWRpROlqI-6NTJlVqA_8NRPT.5 2024-09-14T11:21:27.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:27.998+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:27.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.000+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:21:28.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.001+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.002+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.002+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:28.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.002+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4746109537293878635', time=2024-09-14T13:21:27.016936+0000, chain.objs.size()=11 2024-09-14T11:21:28.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.002+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.67__multipart_key1.2~yXGPmOadzUcnz8BMvvk8Hf9kbHIs5Tw.1 2024-09-14T11:21:28.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.002+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.67__multipart_key1.2~yXGPmOadzUcnz8BMvvk8Hf9kbHIs5Tw.2 2024-09-14T11:21:28.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.002+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.67__multipart_key1.2~yXGPmOadzUcnz8BMvvk8Hf9kbHIs5Tw.3 2024-09-14T11:21:28.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.002+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.67__multipart_key1.2~yXGPmOadzUcnz8BMvvk8Hf9kbHIs5Tw.4 2024-09-14T11:21:28.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.002+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.67__multipart_key1.2~yXGPmOadzUcnz8BMvvk8Hf9kbHIs5Tw.5 2024-09-14T11:21:28.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.002+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.67__multipart_key1.2~yXGPmOadzUcnz8BMvvk8Hf9kbHIs5Tw.6 2024-09-14T11:21:28.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.002+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.67__multipart_key1.2~yXGPmOadzUcnz8BMvvk8Hf9kbHIs5Tw.7 2024-09-14T11:21:28.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.002+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.67__multipart_key1.2~yXGPmOadzUcnz8BMvvk8Hf9kbHIs5Tw.8 2024-09-14T11:21:28.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.002+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.67__multipart_key1.2~yXGPmOadzUcnz8BMvvk8Hf9kbHIs5Tw.9 2024-09-14T11:21:28.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.002+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.67__multipart_key1.2~yXGPmOadzUcnz8BMvvk8Hf9kbHIs5Tw.10 2024-09-14T11:21:28.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.002+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.67__multipart_key1.2~yXGPmOadzUcnz8BMvvk8Hf9kbHIs5Tw.11 2024-09-14T11:21:28.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.008+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:28.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.010+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:21:28.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.012+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.012+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.012+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:28.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.012+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17252535328301793203', time=2024-09-14T13:20:54.625241+0000, chain.objs.size()=5 2024-09-14T11:21:28.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.012+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.57__multipart_key1.2~-eXV-wz2EHswR4cpx2V4ekqsv7MqFnZ.1 2024-09-14T11:21:28.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.012+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.57__multipart_key1.2~-eXV-wz2EHswR4cpx2V4ekqsv7MqFnZ.2 2024-09-14T11:21:28.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.013+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.57__multipart_key1.2~-eXV-wz2EHswR4cpx2V4ekqsv7MqFnZ.3 2024-09-14T11:21:28.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.013+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.57__multipart_key1.2~-eXV-wz2EHswR4cpx2V4ekqsv7MqFnZ.4 2024-09-14T11:21:28.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.013+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.57__multipart_key1.2~-eXV-wz2EHswR4cpx2V4ekqsv7MqFnZ.5 2024-09-14T11:21:28.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.015+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:28.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.018+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:21:28.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.019+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.020+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.020+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:28.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.020+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6241525012617766973', time=2024-09-14T13:17:53.047867+0000, chain.objs.size()=5 2024-09-14T11:21:28.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.020+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.43__multipart_key1.2~buqHyrfmlwM8RFDKGjbvu3M8ml2OyKu.1 2024-09-14T11:21:28.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.020+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.43__multipart_key1.2~buqHyrfmlwM8RFDKGjbvu3M8ml2OyKu.2 2024-09-14T11:21:28.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.020+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.43__multipart_key1.2~buqHyrfmlwM8RFDKGjbvu3M8ml2OyKu.3 2024-09-14T11:21:28.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.020+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.43__multipart_key1.2~buqHyrfmlwM8RFDKGjbvu3M8ml2OyKu.4 2024-09-14T11:21:28.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.020+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.43__multipart_key1.2~buqHyrfmlwM8RFDKGjbvu3M8ml2OyKu.5 2024-09-14T11:21:28.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.023+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:28.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.026+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:21:28.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.027+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.028+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.028+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:28.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.028+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5692261884055974145', time=2024-09-14T13:20:10.932240+0000, chain.objs.size()=11 2024-09-14T11:21:28.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.028+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~SptQ07FsK39ffstDhxzorOUG0YBiPl2.1 2024-09-14T11:21:28.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.028+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~SptQ07FsK39ffstDhxzorOUG0YBiPl2.2 2024-09-14T11:21:28.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.028+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~SptQ07FsK39ffstDhxzorOUG0YBiPl2.3 2024-09-14T11:21:28.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.028+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~SptQ07FsK39ffstDhxzorOUG0YBiPl2.4 2024-09-14T11:21:28.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.028+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~SptQ07FsK39ffstDhxzorOUG0YBiPl2.5 2024-09-14T11:21:28.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.028+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~SptQ07FsK39ffstDhxzorOUG0YBiPl2.6 2024-09-14T11:21:28.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.028+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~SptQ07FsK39ffstDhxzorOUG0YBiPl2.7 2024-09-14T11:21:28.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.028+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~SptQ07FsK39ffstDhxzorOUG0YBiPl2.8 2024-09-14T11:21:28.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.028+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~SptQ07FsK39ffstDhxzorOUG0YBiPl2.9 2024-09-14T11:21:28.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.028+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~SptQ07FsK39ffstDhxzorOUG0YBiPl2.10 2024-09-14T11:21:28.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.028+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~SptQ07FsK39ffstDhxzorOUG0YBiPl2.11 2024-09-14T11:21:28.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.034+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:28.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.037+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:21:28.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.038+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.038+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.039+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:28.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.039+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2984837255408096220', time=2024-09-14T13:17:59.752514+0000, chain.objs.size()=5 2024-09-14T11:21:28.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.039+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.45__multipart_key1.2~lHlVjb6qRoJgrZYLya8FHvOZIJ3iq9P.1 2024-09-14T11:21:28.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.039+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.45__multipart_key1.2~lHlVjb6qRoJgrZYLya8FHvOZIJ3iq9P.2 2024-09-14T11:21:28.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.039+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.45__multipart_key1.2~lHlVjb6qRoJgrZYLya8FHvOZIJ3iq9P.3 2024-09-14T11:21:28.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.039+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.45__multipart_key1.2~lHlVjb6qRoJgrZYLya8FHvOZIJ3iq9P.4 2024-09-14T11:21:28.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.039+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.45__multipart_key1.2~lHlVjb6qRoJgrZYLya8FHvOZIJ3iq9P.5 2024-09-14T11:21:28.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.041+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:28.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.043+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:21:28.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.045+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.045+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.046+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:21:28.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.046+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14331029197001847741', time=2024-09-14T13:18:16.979830+0000, chain.objs.size()=5 2024-09-14T11:21:28.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.046+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__multipart_key1.2~Eqg8f2m4UGjbtKQRVA6YPuc3O-i6ISY.1 2024-09-14T11:21:28.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.046+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__multipart_key1.2~Eqg8f2m4UGjbtKQRVA6YPuc3O-i6ISY.2 2024-09-14T11:21:28.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.046+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__multipart_key1.2~Eqg8f2m4UGjbtKQRVA6YPuc3O-i6ISY.3 2024-09-14T11:21:28.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.046+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__multipart_key1.2~Eqg8f2m4UGjbtKQRVA6YPuc3O-i6ISY.4 2024-09-14T11:21:28.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.046+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__multipart_key1.2~Eqg8f2m4UGjbtKQRVA6YPuc3O-i6ISY.5 2024-09-14T11:21:28.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.046+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6472753756627999127', time=2024-09-14T13:19:07.548851+0000, chain.objs.size()=5 2024-09-14T11:21:28.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.046+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.54__multipart_file2.mpg.2~d21E3booRgPyTusgNoIeAZOr7xHmjkn.1 2024-09-14T11:21:28.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.046+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.54__multipart_file2.mpg.2~d21E3booRgPyTusgNoIeAZOr7xHmjkn.2 2024-09-14T11:21:28.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.046+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.54__multipart_file2.mpg.2~d21E3booRgPyTusgNoIeAZOr7xHmjkn.3 2024-09-14T11:21:28.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.046+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.54__multipart_file2.mpg.2~d21E3booRgPyTusgNoIeAZOr7xHmjkn.4 2024-09-14T11:21:28.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.046+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.54__multipart_file2.mpg.2~d21E3booRgPyTusgNoIeAZOr7xHmjkn.5 2024-09-14T11:21:28.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.046+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1035756919134023728', time=2024-09-14T13:20:22.052686+0000, chain.objs.size()=10 2024-09-14T11:21:28.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.046+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~nWdJconqJXUGp1lbfAGyGoY1Tz2gnfG.1 2024-09-14T11:21:28.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.046+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~nWdJconqJXUGp1lbfAGyGoY1Tz2gnfG.2 2024-09-14T11:21:28.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.048+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~nWdJconqJXUGp1lbfAGyGoY1Tz2gnfG.3 2024-09-14T11:21:28.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.048+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~nWdJconqJXUGp1lbfAGyGoY1Tz2gnfG.4 2024-09-14T11:21:28.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.050+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~nWdJconqJXUGp1lbfAGyGoY1Tz2gnfG.5 2024-09-14T11:21:28.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.051+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~nWdJconqJXUGp1lbfAGyGoY1Tz2gnfG.6 2024-09-14T11:21:28.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.051+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~nWdJconqJXUGp1lbfAGyGoY1Tz2gnfG.7 2024-09-14T11:21:28.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.052+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~nWdJconqJXUGp1lbfAGyGoY1Tz2gnfG.8 2024-09-14T11:21:28.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.052+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~nWdJconqJXUGp1lbfAGyGoY1Tz2gnfG.9 2024-09-14T11:21:28.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.052+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~nWdJconqJXUGp1lbfAGyGoY1Tz2gnfG.10 2024-09-14T11:21:28.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.056+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:28.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.059+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:21:28.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.060+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.060+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.061+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:28.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.061+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8461126071167839207', time=2024-09-14T13:18:23.006596+0000, chain.objs.size()=5 2024-09-14T11:21:28.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.061+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__multipart_key1.2~SWgZn0_u8DbVf5QUzw1Ckcj8kzcUyXc.1 2024-09-14T11:21:28.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.061+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__shadow_key1.2~SWgZn0_u8DbVf5QUzw1Ckcj8kzcUyXc.1_1 2024-09-14T11:21:28.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.061+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__multipart_key1.2~SWgZn0_u8DbVf5QUzw1Ckcj8kzcUyXc.2 2024-09-14T11:21:28.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.061+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__shadow_key1.2~SWgZn0_u8DbVf5QUzw1Ckcj8kzcUyXc.2_1 2024-09-14T11:21:28.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.061+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48__multipart_key1.2~SWgZn0_u8DbVf5QUzw1Ckcj8kzcUyXc.3 2024-09-14T11:21:28.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.063+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:28.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.065+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:21:28.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.067+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.067+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.068+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-14T11:21:28.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.068+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12724117392246758906', time=2024-09-14T13:20:51.333466+0000, chain.objs.size()=1 2024-09-14T11:21:28.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.068+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.57__shadow_.BOl8j0sNIPgRvj7AiM55RbR716uwsVa_0 2024-09-14T11:21:28.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.068+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe', time=2024-09-14T13:21:07.440097+0000, chain.objs.size()=53 2024-09-14T11:21:28.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.068+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.1 2024-09-14T11:21:28.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.068+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.2 2024-09-14T11:21:28.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.068+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.3 2024-09-14T11:21:28.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.068+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.4 2024-09-14T11:21:28.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.068+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.5 2024-09-14T11:21:28.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.068+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.6 2024-09-14T11:21:28.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.068+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.7 2024-09-14T11:21:28.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.068+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.8 2024-09-14T11:21:28.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.068+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.9 2024-09-14T11:21:28.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.068+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.10 2024-09-14T11:21:28.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.068+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.11 2024-09-14T11:21:28.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.070+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.12 2024-09-14T11:21:28.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.070+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.13 2024-09-14T11:21:28.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.070+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.14 2024-09-14T11:21:28.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.071+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.15 2024-09-14T11:21:28.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.072+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.16 2024-09-14T11:21:28.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.072+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.17 2024-09-14T11:21:28.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.072+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.18 2024-09-14T11:21:28.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.072+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.19 2024-09-14T11:21:28.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.072+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.20 2024-09-14T11:21:28.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.072+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.21 2024-09-14T11:21:28.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.072+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.22 2024-09-14T11:21:28.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.074+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.23 2024-09-14T11:21:28.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.074+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.24 2024-09-14T11:21:28.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.074+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.25 2024-09-14T11:21:28.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.074+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.26 2024-09-14T11:21:28.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.075+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.27 2024-09-14T11:21:28.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.076+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.28 2024-09-14T11:21:28.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.078+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.29 2024-09-14T11:21:28.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.078+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.30 2024-09-14T11:21:28.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.078+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.31 2024-09-14T11:21:28.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.078+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.32 2024-09-14T11:21:28.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.078+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.33 2024-09-14T11:21:28.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.078+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.34 2024-09-14T11:21:28.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.078+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.35 2024-09-14T11:21:28.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.078+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.36 2024-09-14T11:21:28.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.078+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.37 2024-09-14T11:21:28.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.079+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.38 2024-09-14T11:21:28.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.080+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.39 2024-09-14T11:21:28.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.080+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.40 2024-09-14T11:21:28.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.081+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.41 2024-09-14T11:21:28.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.082+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.42 2024-09-14T11:21:28.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.082+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.43 2024-09-14T11:21:28.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.082+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.44 2024-09-14T11:21:28.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.082+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.45 2024-09-14T11:21:28.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.082+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.46 2024-09-14T11:21:28.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.085+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.47 2024-09-14T11:21:28.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.085+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.48 2024-09-14T11:21:28.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.085+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.49 2024-09-14T11:21:28.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.085+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.50 2024-09-14T11:21:28.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.085+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.51 2024-09-14T11:21:28.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.085+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.52 2024-09-14T11:21:28.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.087+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.53 2024-09-14T11:21:28.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.087+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe', time=2024-09-14T13:21:08.235823+0000, chain.objs.size()=9 2024-09-14T11:21:28.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.087+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.54 2024-09-14T11:21:28.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.088+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.55 2024-09-14T11:21:28.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.088+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.56 2024-09-14T11:21:28.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.088+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.57 2024-09-14T11:21:28.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.090+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.58 2024-09-14T11:21:28.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.090+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.59 2024-09-14T11:21:28.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.090+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.60 2024-09-14T11:21:28.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.090+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.61 2024-09-14T11:21:28.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.090+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.62 2024-09-14T11:21:28.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.090+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe', time=2024-09-14T13:21:08.769797+0000, chain.objs.size()=6 2024-09-14T11:21:28.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.090+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.63 2024-09-14T11:21:28.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.090+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.64 2024-09-14T11:21:28.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.090+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.65 2024-09-14T11:21:28.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.092+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.66 2024-09-14T11:21:28.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.092+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.67 2024-09-14T11:21:28.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.092+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.68 2024-09-14T11:21:28.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.092+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe', time=2024-09-14T13:21:09.293472+0000, chain.objs.size()=5 2024-09-14T11:21:28.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.092+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.69 2024-09-14T11:21:28.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.093+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.70 2024-09-14T11:21:28.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.094+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.71 2024-09-14T11:21:28.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.095+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.72 2024-09-14T11:21:28.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.095+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.73 2024-09-14T11:21:28.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.095+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe', time=2024-09-14T13:21:09.733961+0000, chain.objs.size()=5 2024-09-14T11:21:28.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.095+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.74 2024-09-14T11:21:28.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.095+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.75 2024-09-14T11:21:28.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.095+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.76 2024-09-14T11:21:28.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.095+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.77 2024-09-14T11:21:28.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.095+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.78 2024-09-14T11:21:28.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.096+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe', time=2024-09-14T13:21:10.248806+0000, chain.objs.size()=5 2024-09-14T11:21:28.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.096+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.79 2024-09-14T11:21:28.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.096+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.80 2024-09-14T11:21:28.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.098+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.81 2024-09-14T11:21:28.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.098+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.82 2024-09-14T11:21:28.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.098+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.83 2024-09-14T11:21:28.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.098+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe', time=2024-09-14T13:21:10.551924+0000, chain.objs.size()=4 2024-09-14T11:21:28.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.098+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.84 2024-09-14T11:21:28.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.100+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.85 2024-09-14T11:21:28.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.100+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.86 2024-09-14T11:21:28.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.100+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.87 2024-09-14T11:21:28.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.100+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe', time=2024-09-14T13:21:10.660625+0000, chain.objs.size()=5 2024-09-14T11:21:28.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.100+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.88 2024-09-14T11:21:28.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.100+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.89 2024-09-14T11:21:28.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.100+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.90 2024-09-14T11:21:28.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.100+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.91 2024-09-14T11:21:28.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.102+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.59__multipart_key1.2~zPVooijN6DAlLvObcp7TymRpJ_rwgFe.92 2024-09-14T11:21:28.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.104+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:28.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.107+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:21:28.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.108+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.109+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.109+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:28.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.109+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.659421537293201211', time=2024-09-14T13:19:59.315852+0000, chain.objs.size()=11 2024-09-14T11:21:28.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.109+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~qMceKwkPPQR-_-uPE2ugrKlDJK2ZjY_.1 2024-09-14T11:21:28.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.109+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~qMceKwkPPQR-_-uPE2ugrKlDJK2ZjY_.2 2024-09-14T11:21:28.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.109+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~qMceKwkPPQR-_-uPE2ugrKlDJK2ZjY_.3 2024-09-14T11:21:28.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.109+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~qMceKwkPPQR-_-uPE2ugrKlDJK2ZjY_.4 2024-09-14T11:21:28.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.109+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~qMceKwkPPQR-_-uPE2ugrKlDJK2ZjY_.5 2024-09-14T11:21:28.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.109+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~qMceKwkPPQR-_-uPE2ugrKlDJK2ZjY_.6 2024-09-14T11:21:28.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.109+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~qMceKwkPPQR-_-uPE2ugrKlDJK2ZjY_.7 2024-09-14T11:21:28.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.109+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~qMceKwkPPQR-_-uPE2ugrKlDJK2ZjY_.8 2024-09-14T11:21:28.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.109+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~qMceKwkPPQR-_-uPE2ugrKlDJK2ZjY_.9 2024-09-14T11:21:28.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.109+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~qMceKwkPPQR-_-uPE2ugrKlDJK2ZjY_.10 2024-09-14T11:21:28.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.109+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~qMceKwkPPQR-_-uPE2ugrKlDJK2ZjY_.11 2024-09-14T11:21:28.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.114+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:28.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.117+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:21:28.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.118+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.118+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.119+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:21:28.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.119+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='2~n6O-T6dwiB_1iB215sUFiCZtxLo-xtN', time=2024-09-14T13:19:15.096615+0000, chain.objs.size()=3 2024-09-14T11:21:28.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.119+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.55__multipart_key1.2~n6O-T6dwiB_1iB215sUFiCZtxLo-xtN.7 2024-09-14T11:21:28.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.119+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.55__multipart_key1.2~n6O-T6dwiB_1iB215sUFiCZtxLo-xtN.10 2024-09-14T11:21:28.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.119+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.55__multipart_key1.2~n6O-T6dwiB_1iB215sUFiCZtxLo-xtN.13 2024-09-14T11:21:28.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.119+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8733352903096331524', time=2024-09-14T13:21:12.123662+0000, chain.objs.size()=1 2024-09-14T11:21:28.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.119+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.62__shadow_.v7mAbfOx6-8GRHOjtuzFf_TK8lDrtlx_0 2024-09-14T11:21:28.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.121+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:28.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.123+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:21:28.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.125+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.125+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.125+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.126+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:21:28.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.128+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.128+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.128+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:28.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.128+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17953542344279694108', time=2024-09-14T13:19:07.509735+0000, chain.objs.size()=1 2024-09-14T11:21:28.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.128+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.54__shadow_.Dw3ujuVQMsqSsE4c8emMSiYyvXv5fUn_0 2024-09-14T11:21:28.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.130+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:28.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.131+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:21:28.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.133+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.133+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.133+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:21:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.133+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8995140101809518578', time=2024-09-14T13:18:00.068893+0000, chain.objs.size()=5 2024-09-14T11:21:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.133+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.45__multipart_key1.2~lHlVjb6qRoJgrZYLya8FHvOZIJ3iq9P.1 2024-09-14T11:21:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.133+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.45__multipart_key1.2~lHlVjb6qRoJgrZYLya8FHvOZIJ3iq9P.2 2024-09-14T11:21:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.133+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.45__multipart_key1.2~lHlVjb6qRoJgrZYLya8FHvOZIJ3iq9P.3 2024-09-14T11:21:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.133+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.45__multipart_key1.2~lHlVjb6qRoJgrZYLya8FHvOZIJ3iq9P.4 2024-09-14T11:21:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.134+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.45__multipart_key1.2~lHlVjb6qRoJgrZYLya8FHvOZIJ3iq9P.5 2024-09-14T11:21:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.134+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17713768835553983413', time=2024-09-14T13:21:11.595992+0000, chain.objs.size()=1 2024-09-14T11:21:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.134+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.61__shadow_.K8THoVB7E9p3SMBy1mxLjz-iF2dYj-r_0 2024-09-14T11:21:28.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.136+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:28.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.139+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:21:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.140+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.141+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.141+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.142+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:21:28.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.143+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.144+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.144+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:28.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.144+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6235857301504367364', time=2024-09-14T13:18:34.164969+0000, chain.objs.size()=5 2024-09-14T11:21:28.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.144+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.52__multipart_key1.2~sQKhS7e1qZO3neUKzA8gaT5LIXd4ARK.1 2024-09-14T11:21:28.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.144+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.52__multipart_key1.2~sQKhS7e1qZO3neUKzA8gaT5LIXd4ARK.2 2024-09-14T11:21:28.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.144+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.52__multipart_key1.2~sQKhS7e1qZO3neUKzA8gaT5LIXd4ARK.3 2024-09-14T11:21:28.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.144+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.52__multipart_key1.2~sQKhS7e1qZO3neUKzA8gaT5LIXd4ARK.4 2024-09-14T11:21:28.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.144+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.52__multipart_key1.2~sQKhS7e1qZO3neUKzA8gaT5LIXd4ARK.5 2024-09-14T11:21:28.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.147+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:28.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.149+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:21:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.151+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.151+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.151+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.151+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6210458871627685637', time=2024-09-14T13:20:33.455859+0000, chain.objs.size()=11 2024-09-14T11:21:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.152+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~lnyTgSQd4ZOiObcXBTe5As-7H76DL8B.1 2024-09-14T11:21:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.152+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__shadow_key1.2~lnyTgSQd4ZOiObcXBTe5As-7H76DL8B.1_1 2024-09-14T11:21:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.152+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~lnyTgSQd4ZOiObcXBTe5As-7H76DL8B.2 2024-09-14T11:21:28.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.152+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__shadow_key1.2~lnyTgSQd4ZOiObcXBTe5As-7H76DL8B.2_1 2024-09-14T11:21:28.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.152+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~lnyTgSQd4ZOiObcXBTe5As-7H76DL8B.3 2024-09-14T11:21:28.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.152+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__shadow_key1.2~lnyTgSQd4ZOiObcXBTe5As-7H76DL8B.3_1 2024-09-14T11:21:28.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.152+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~lnyTgSQd4ZOiObcXBTe5As-7H76DL8B.4 2024-09-14T11:21:28.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.152+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__shadow_key1.2~lnyTgSQd4ZOiObcXBTe5As-7H76DL8B.4_1 2024-09-14T11:21:28.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.152+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~lnyTgSQd4ZOiObcXBTe5As-7H76DL8B.5 2024-09-14T11:21:28.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.152+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__shadow_key1.2~lnyTgSQd4ZOiObcXBTe5As-7H76DL8B.5_1 2024-09-14T11:21:28.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.152+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~lnyTgSQd4ZOiObcXBTe5As-7H76DL8B.6 2024-09-14T11:21:28.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.156+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:28.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.160+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:21:28.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.161+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.162+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.162+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:21:28.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.162+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6979721767127865252', time=2024-09-14T13:19:07.474791+0000, chain.objs.size()=5 2024-09-14T11:21:28.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.162+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.54__multipart_file.mpg.2~yFfqLQ5UgYyIp_HEEpqXIHnITUDN9uw.1 2024-09-14T11:21:28.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.162+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.54__multipart_file.mpg.2~yFfqLQ5UgYyIp_HEEpqXIHnITUDN9uw.2 2024-09-14T11:21:28.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.162+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.54__multipart_file.mpg.2~yFfqLQ5UgYyIp_HEEpqXIHnITUDN9uw.3 2024-09-14T11:21:28.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.162+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.54__multipart_file.mpg.2~yFfqLQ5UgYyIp_HEEpqXIHnITUDN9uw.4 2024-09-14T11:21:28.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.162+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.54__multipart_file.mpg.2~yFfqLQ5UgYyIp_HEEpqXIHnITUDN9uw.5 2024-09-14T11:21:28.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.162+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2326232848479813286', time=2024-09-14T13:20:45.736116+0000, chain.objs.size()=11 2024-09-14T11:21:28.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.162+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~tl8xM_8SMS7HHgKRwz0x7bVkVgW7HpT.1 2024-09-14T11:21:28.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.162+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__shadow_key1.2~tl8xM_8SMS7HHgKRwz0x7bVkVgW7HpT.1_1 2024-09-14T11:21:28.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.162+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~tl8xM_8SMS7HHgKRwz0x7bVkVgW7HpT.2 2024-09-14T11:21:28.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.162+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__shadow_key1.2~tl8xM_8SMS7HHgKRwz0x7bVkVgW7HpT.2_1 2024-09-14T11:21:28.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.162+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~tl8xM_8SMS7HHgKRwz0x7bVkVgW7HpT.3 2024-09-14T11:21:28.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.162+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__shadow_key1.2~tl8xM_8SMS7HHgKRwz0x7bVkVgW7HpT.3_1 2024-09-14T11:21:28.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.162+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~tl8xM_8SMS7HHgKRwz0x7bVkVgW7HpT.4 2024-09-14T11:21:28.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.166+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__shadow_key1.2~tl8xM_8SMS7HHgKRwz0x7bVkVgW7HpT.4_1 2024-09-14T11:21:28.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.166+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~tl8xM_8SMS7HHgKRwz0x7bVkVgW7HpT.5 2024-09-14T11:21:28.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.167+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__shadow_key1.2~tl8xM_8SMS7HHgKRwz0x7bVkVgW7HpT.5_1 2024-09-14T11:21:28.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.167+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~tl8xM_8SMS7HHgKRwz0x7bVkVgW7HpT.6 2024-09-14T11:21:28.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.167+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18135200827107889113', time=2024-09-14T13:21:13.703948+0000, chain.objs.size()=1 2024-09-14T11:21:28.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.167+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.65__shadow_.Dxzc4W2eX2cW4489ssRoAPnRHgAPKC8_0 2024-09-14T11:21:28.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.171+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:28.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.174+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:21:28.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.175+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.175+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.175+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.176+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:21:28.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.178+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.178+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.179+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.181+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:21:28.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.182+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.182+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.182+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:21:28.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.182+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='2~Kn-u_AJIVarHu5cHiQEqZCwrRNIkghz', time=2024-09-14T13:17:42.889113+0000, chain.objs.size()=5 2024-09-14T11:21:28.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.182+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.41__multipart_key1.2~Kn-u_AJIVarHu5cHiQEqZCwrRNIkghz.1 2024-09-14T11:21:28.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.182+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.41__multipart_key1.2~Kn-u_AJIVarHu5cHiQEqZCwrRNIkghz.2 2024-09-14T11:21:28.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.182+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.41__multipart_key1.2~Kn-u_AJIVarHu5cHiQEqZCwrRNIkghz.3 2024-09-14T11:21:28.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.182+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.41__multipart_key1.2~Kn-u_AJIVarHu5cHiQEqZCwrRNIkghz.4 2024-09-14T11:21:28.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.182+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.41__multipart_key1.2~Kn-u_AJIVarHu5cHiQEqZCwrRNIkghz.5 2024-09-14T11:21:28.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.182+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8513689439023919055', time=2024-09-14T13:21:13.178574+0000, chain.objs.size()=1 2024-09-14T11:21:28.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.182+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.64__shadow_.TbK4aQ6DubCC77WAN6HwQVZj0n7XDDs_0 2024-09-14T11:21:28.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.184+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:28.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.188+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:21:28.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.189+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.190+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.190+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:28.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.190+0000 7fc9e1c40800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18346557909752608306', time=2024-09-14T13:20:45.962033+0000, chain.objs.size()=11 2024-09-14T11:21:28.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.190+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~VYh75vEXEd6bHN5ZdiW-CxdrW-47Y29.1 2024-09-14T11:21:28.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.190+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__shadow_key1.2~VYh75vEXEd6bHN5ZdiW-CxdrW-47Y29.1_1 2024-09-14T11:21:28.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.190+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~VYh75vEXEd6bHN5ZdiW-CxdrW-47Y29.2 2024-09-14T11:21:28.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.190+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__shadow_key1.2~VYh75vEXEd6bHN5ZdiW-CxdrW-47Y29.2_1 2024-09-14T11:21:28.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.190+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~VYh75vEXEd6bHN5ZdiW-CxdrW-47Y29.3 2024-09-14T11:21:28.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.190+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__shadow_key1.2~VYh75vEXEd6bHN5ZdiW-CxdrW-47Y29.3_1 2024-09-14T11:21:28.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.190+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~VYh75vEXEd6bHN5ZdiW-CxdrW-47Y29.4 2024-09-14T11:21:28.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.190+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__shadow_key1.2~VYh75vEXEd6bHN5ZdiW-CxdrW-47Y29.4_1 2024-09-14T11:21:28.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.190+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~VYh75vEXEd6bHN5ZdiW-CxdrW-47Y29.5 2024-09-14T11:21:28.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.190+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__shadow_key1.2~VYh75vEXEd6bHN5ZdiW-CxdrW-47Y29.5_1 2024-09-14T11:21:28.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.190+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.56__multipart_key1.2~VYh75vEXEd6bHN5ZdiW-CxdrW-47Y29.6 2024-09-14T11:21:28.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.196+0000 7fc9e1c40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:28.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.198+0000 7fc9e1c40800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:21:28.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.199+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.200+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.200+0000 7fc9e1c40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.202+0000 7fc8967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:28.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.204+0000 7fc9e1c40800 20 remove_watcher() i=0 2024-09-14T11:21:28.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.204+0000 7fc9e1c40800 2 removed watcher, disabling cache 2024-09-14T11:21:28.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.205+0000 7fc9e1c40800 20 remove_watcher() i=1 2024-09-14T11:21:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.206+0000 7fc9e1c40800 20 remove_watcher() i=2 2024-09-14T11:21:28.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.208+0000 7fc9e1c40800 20 remove_watcher() i=3 2024-09-14T11:21:28.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.208+0000 7fc9e1c40800 20 remove_watcher() i=4 2024-09-14T11:21:28.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.209+0000 7fc9e1c40800 20 remove_watcher() i=5 2024-09-14T11:21:28.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.210+0000 7fc9e1c40800 20 remove_watcher() i=6 2024-09-14T11:21:28.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.211+0000 7fc9e1c40800 20 remove_watcher() i=7 2024-09-14T11:21:28.222 DEBUG:teuthology.orchestra.run.smithi050:> radosgw-admin gc process --include-all 2024-09-14T11:21:28.275 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:28.275 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:28.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.317+0000 7f8b90c63800 20 rados->read ofs=0 len=0 2024-09-14T11:21:28.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.318+0000 7f8b90c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:28.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.318+0000 7f8b90c63800 20 realm 2024-09-14T11:21:28.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.318+0000 7f8b90c63800 20 rados->read ofs=0 len=0 2024-09-14T11:21:28.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.319+0000 7f8b90c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:28.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.319+0000 7f8b90c63800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:28.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.319+0000 7f8b90c63800 20 rados->read ofs=0 len=0 2024-09-14T11:21:28.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.319+0000 7f8b90c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:28.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.319+0000 7f8b90c63800 20 rados->read ofs=0 len=0 2024-09-14T11:21:28.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.320+0000 7f8b90c63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:28.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.320+0000 7f8b90c63800 20 rados->read ofs=0 len=0 2024-09-14T11:21:28.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.320+0000 7f8b90c63800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:28.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.320+0000 7f8b90c63800 20 searching for the correct realm 2024-09-14T11:21:28.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.323+0000 7f8b8ef55640 0 -- 172.21.15.50:0/4134820599 >> [v2:172.21.15.118:6816/4154782182,v1:172.21.15.118:6817/4154782182] conn(0x55ff1995fde0 msgr2=0x55ff199622a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:28.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.325+0000 7f8b8e754640 0 -- 172.21.15.50:0/4134820599 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f8b8806b040 msgr2=0x7f8b88078310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:28.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.531+0000 7f8b90c63800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:21:28.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.531+0000 7f8b90c63800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:28.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.531+0000 7f8b90c63800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:21:28.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.531+0000 7f8b90c63800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:28.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.531+0000 7f8b90c63800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:28.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.531+0000 7f8b90c63800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:28.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.531+0000 7f8b90c63800 20 rados->read ofs=0 len=0 2024-09-14T11:21:28.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.531+0000 7f8b90c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:28.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.531+0000 7f8b90c63800 20 rados->read ofs=0 len=0 2024-09-14T11:21:28.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.531+0000 7f8b90c63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:28.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.531+0000 7f8b90c63800 20 rados->read ofs=0 len=0 2024-09-14T11:21:28.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.532+0000 7f8b90c63800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:28.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.532+0000 7f8b90c63800 20 zone default found 2024-09-14T11:21:28.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.532+0000 7f8b90c63800 4 Realm: () 2024-09-14T11:21:28.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.532+0000 7f8b90c63800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:21:28.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.532+0000 7f8b90c63800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:21:28.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.532+0000 7f8b90c63800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:28.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.532+0000 7f8b90c63800 20 zonegroup default 2024-09-14T11:21:28.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.532+0000 7f8b90c63800 20 rados->read ofs=0 len=0 2024-09-14T11:21:28.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.532+0000 7f8b90c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:28.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.532+0000 7f8b90c63800 20 rados->read ofs=0 len=0 2024-09-14T11:21:28.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.532+0000 7f8b90c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:28.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.532+0000 7f8b90c63800 20 rados->read ofs=0 len=0 2024-09-14T11:21:28.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.533+0000 7f8b90c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:28.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.533+0000 7f8b90c63800 20 started sync module instance, tier type = 2024-09-14T11:21:28.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.533+0000 7f8b90c63800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:21:28.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.542+0000 7f8b90c63800 20 add_watcher() i=0 2024-09-14T11:21:28.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.542+0000 7f8b90c63800 20 add_watcher() i=1 2024-09-14T11:21:28.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.542+0000 7f8b90c63800 20 add_watcher() i=2 2024-09-14T11:21:28.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.542+0000 7f8b90c63800 20 add_watcher() i=3 2024-09-14T11:21:28.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.542+0000 7f8b90c63800 20 add_watcher() i=4 2024-09-14T11:21:28.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.542+0000 7f8b90c63800 20 add_watcher() i=5 2024-09-14T11:21:28.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.542+0000 7f8b90c63800 20 add_watcher() i=6 2024-09-14T11:21:28.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.542+0000 7f8b90c63800 20 add_watcher() i=7 2024-09-14T11:21:28.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.542+0000 7f8b90c63800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:28.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.543+0000 7f8a44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:28.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.544+0000 7f8b90c63800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:28.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.544+0000 7f8b90c63800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:28.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.577+0000 7f89bf7fe640 20 reqs_thread_entry: start 2024-09-14T11:21:28.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.577+0000 7f8b90c63800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:28.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.577+0000 7f8b90c63800 20 Filter name: none 2024-09-14T11:21:28.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.578+0000 7f89bd7fa640 20 reqs_thread_entry: start 2024-09-14T11:21:28.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.578+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:21:28.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.579+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.579+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.580+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.580+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:21:28.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.582+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.582+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.582+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.583+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:21:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.585+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.585+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.586+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.586+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:21:28.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.588+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.588+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.588+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.589+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:21:28.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.591+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.591+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.591+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.592+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:21:28.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.593+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.594+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.594+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.595+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:21:28.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.596+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.597+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.597+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.598+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:21:28.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.599+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.600+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.600+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.601+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:21:28.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.603+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.603+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.604+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.605+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:21:28.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.606+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.606+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.607+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.608+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:21:28.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.609+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.610+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.610+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.611+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:21:28.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.612+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.613+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.613+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.614+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:21:28.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.616+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.617+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.617+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.618+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:21:28.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.619+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.620+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.620+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.621+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:21:28.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.622+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.623+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.623+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.624+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:21:28.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.625+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.626+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.626+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.627+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:21:28.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.628+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.628+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.629+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.630+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:21:28.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.631+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.631+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.632+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.632+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:21:28.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.634+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.634+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.634+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.635+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:21:28.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.637+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.637+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.637+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.638+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:21:28.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.639+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.640+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.640+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.641+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:21:28.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.643+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.643+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.643+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.644+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:21:28.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.645+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.646+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.647+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.648+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:21:28.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.649+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.649+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.649+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.650+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:21:28.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.651+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.652+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.652+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.653+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:21:28.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.654+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.654+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.654+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.655+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:21:28.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.657+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.657+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.657+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.658+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:21:28.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.659+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.660+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.660+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.661+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:21:28.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.663+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.663+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.663+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.664+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:21:28.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.666+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.666+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.666+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.667+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:21:28.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.669+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.669+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.670+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.671+0000 7f8b90c63800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:21:28.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.672+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.672+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:28.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.672+0000 7f8b90c63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:28.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.674+0000 7f8a44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:28.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.676+0000 7f8b90c63800 20 remove_watcher() i=0 2024-09-14T11:21:28.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.676+0000 7f8b90c63800 2 removed watcher, disabling cache 2024-09-14T11:21:28.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.677+0000 7f8b90c63800 20 remove_watcher() i=1 2024-09-14T11:21:28.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.678+0000 7f8b90c63800 20 remove_watcher() i=2 2024-09-14T11:21:28.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.679+0000 7f8b90c63800 20 remove_watcher() i=3 2024-09-14T11:21:28.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.680+0000 7f8b90c63800 20 remove_watcher() i=4 2024-09-14T11:21:28.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.681+0000 7f8b90c63800 20 remove_watcher() i=5 2024-09-14T11:21:28.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.682+0000 7f8b90c63800 20 remove_watcher() i=6 2024-09-14T11:21:28.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.683+0000 7f8b90c63800 20 remove_watcher() i=7 2024-09-14T11:21:28.694 DEBUG:teuthology.orchestra.run.smithi050:> radosgw-admin gc process --include-all 2024-09-14T11:21:28.748 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:28.748 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:28.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.788+0000 7f198ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:21:28.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.790+0000 7f198ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:28.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.790+0000 7f198ca98800 20 realm 2024-09-14T11:21:28.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.790+0000 7f198ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:21:28.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.790+0000 7f198ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:28.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.790+0000 7f198ca98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:28.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.790+0000 7f198ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:21:28.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.790+0000 7f198ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:28.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.790+0000 7f198ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:21:28.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.791+0000 7f198ca98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:28.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.791+0000 7f198ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:21:28.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.792+0000 7f198ca98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:28.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.792+0000 7f198ca98800 20 searching for the correct realm 2024-09-14T11:21:28.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.793+0000 7f198a582640 0 -- 172.21.15.50:0/1700149475 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x5604fcbd8740 msgr2=0x7f198401f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:28.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:28.998+0000 7f198ad83640 0 -- 172.21.15.50:0/1700149475 >> [v2:172.21.15.118:6826/1082138742,v1:172.21.15.118:6827/1082138742] conn(0x7f197c04d070 msgr2=0x7f197c0a5890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:29.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.409+0000 7f198ca98800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:21:29.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.409+0000 7f198ca98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:29.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.409+0000 7f198ca98800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:21:29.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.409+0000 7f198ca98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:29.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.409+0000 7f198ca98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:29.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.409+0000 7f198ca98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:29.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.409+0000 7f198ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:21:29.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.409+0000 7f198ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:29.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.409+0000 7f198ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:21:29.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.409+0000 7f198ca98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:29.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.409+0000 7f198ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:21:29.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.410+0000 7f198ca98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:29.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.410+0000 7f198ca98800 20 zone default found 2024-09-14T11:21:29.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.410+0000 7f198ca98800 4 Realm: () 2024-09-14T11:21:29.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.410+0000 7f198ca98800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:21:29.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.410+0000 7f198ca98800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:21:29.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.410+0000 7f198ca98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:29.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.410+0000 7f198ca98800 20 zonegroup default 2024-09-14T11:21:29.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.410+0000 7f198ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:21:29.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.410+0000 7f198ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:29.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.410+0000 7f198ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:21:29.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.411+0000 7f198ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:29.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.411+0000 7f198ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:21:29.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.411+0000 7f198ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:29.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.411+0000 7f198ca98800 20 started sync module instance, tier type = 2024-09-14T11:21:29.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.411+0000 7f198ca98800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:21:29.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.421+0000 7f198ca98800 20 add_watcher() i=0 2024-09-14T11:21:29.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.421+0000 7f198ca98800 20 add_watcher() i=1 2024-09-14T11:21:29.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.421+0000 7f198ca98800 20 add_watcher() i=2 2024-09-14T11:21:29.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.421+0000 7f198ca98800 20 add_watcher() i=3 2024-09-14T11:21:29.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.421+0000 7f198ca98800 20 add_watcher() i=4 2024-09-14T11:21:29.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.421+0000 7f198ca98800 20 add_watcher() i=5 2024-09-14T11:21:29.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.421+0000 7f198ca98800 20 add_watcher() i=6 2024-09-14T11:21:29.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.422+0000 7f198ca98800 20 add_watcher() i=7 2024-09-14T11:21:29.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.422+0000 7f198ca98800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:29.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.424+0000 7f1840fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:29.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.425+0000 7f198ca98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:29.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.425+0000 7f198ca98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:29.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.468+0000 7f17bb7fe640 20 reqs_thread_entry: start 2024-09-14T11:21:29.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.468+0000 7f198ca98800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:29.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.468+0000 7f198ca98800 20 Filter name: none 2024-09-14T11:21:29.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.468+0000 7f17b97fa640 20 reqs_thread_entry: start 2024-09-14T11:21:29.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.468+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:21:29.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.469+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.470+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.470+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.472+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:21:29.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.473+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.474+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.474+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.475+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:21:29.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.477+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.477+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.477+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.479+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:21:29.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.480+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.481+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.481+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.482+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:21:29.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.484+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.484+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.485+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.486+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:21:29.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.487+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.488+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.488+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.489+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:21:29.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.490+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.491+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.491+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.492+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:21:29.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.494+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.494+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.495+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.496+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:21:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.498+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.498+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.498+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.499+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:21:29.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.501+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.502+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.502+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.504+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:21:29.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.505+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.505+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.505+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.506+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:21:29.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.508+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.508+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.508+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.509+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:21:29.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.511+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.511+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.512+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.513+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:21:29.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.514+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.514+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.515+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.516+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:21:29.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.517+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.518+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.518+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.520+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:21:29.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.521+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.521+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.522+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.522+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:21:29.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.524+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.524+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.525+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.526+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:21:29.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.527+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.528+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.528+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.529+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:21:29.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.530+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.531+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.531+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.532+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:21:29.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.533+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.534+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.534+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.535+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:21:29.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.536+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.537+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.537+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.538+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:21:29.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.539+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.540+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.540+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.541+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:21:29.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.542+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.542+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.543+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.544+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:21:29.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.545+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.545+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.546+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.547+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:21:29.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.548+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.548+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.548+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.549+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:21:29.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.551+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.551+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.551+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.552+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:21:29.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.553+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.555+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.555+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.555+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:21:29.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.557+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.557+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.557+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.558+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:21:29.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.560+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.560+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.561+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.563+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:21:29.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.563+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.564+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.564+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.565+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:21:29.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.567+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.567+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.568+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.569+0000 7f198ca98800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:21:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.570+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.570+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.571+0000 7f198ca98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.573+0000 7f1840fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.574+0000 7f198ca98800 20 remove_watcher() i=0 2024-09-14T11:21:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.574+0000 7f198ca98800 2 removed watcher, disabling cache 2024-09-14T11:21:29.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.575+0000 7f198ca98800 20 remove_watcher() i=1 2024-09-14T11:21:29.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.576+0000 7f198ca98800 20 remove_watcher() i=2 2024-09-14T11:21:29.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.577+0000 7f198ca98800 20 remove_watcher() i=3 2024-09-14T11:21:29.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.578+0000 7f198ca98800 20 remove_watcher() i=4 2024-09-14T11:21:29.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.579+0000 7f198ca98800 20 remove_watcher() i=5 2024-09-14T11:21:29.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.580+0000 7f198ca98800 20 remove_watcher() i=6 2024-09-14T11:21:29.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.581+0000 7f198ca98800 20 remove_watcher() i=7 2024-09-14T11:21:29.593 DEBUG:teuthology.orchestra.run.smithi050:> radosgw-admin gc process --include-all 2024-09-14T11:21:29.646 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:29.646 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:29.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.688+0000 7f7790e13800 20 rados->read ofs=0 len=0 2024-09-14T11:21:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.689+0000 7f7790e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.689+0000 7f7790e13800 20 realm 2024-09-14T11:21:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.689+0000 7f7790e13800 20 rados->read ofs=0 len=0 2024-09-14T11:21:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.689+0000 7f7790e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.689+0000 7f7790e13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.689+0000 7f7790e13800 20 rados->read ofs=0 len=0 2024-09-14T11:21:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.689+0000 7f7790e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.689+0000 7f7790e13800 20 rados->read ofs=0 len=0 2024-09-14T11:21:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.690+0000 7f7790e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:29.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.690+0000 7f7790e13800 20 rados->read ofs=0 len=0 2024-09-14T11:21:29.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.691+0000 7f7790e13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:29.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.691+0000 7f7790e13800 20 searching for the correct realm 2024-09-14T11:21:29.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.693+0000 7f778bd91640 0 -- 172.21.15.50:0/3935322573 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f778402b920 msgr2=0x7f7784039400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:29.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.898+0000 7f778cd93640 0 -- 172.21.15.50:0/3935322573 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5598fd8b37b0 msgr2=0x5598fd8b5c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.902+0000 7f7790e13800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:21:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.902+0000 7f7790e13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.902+0000 7f7790e13800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:21:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.902+0000 7f7790e13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.902+0000 7f7790e13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.902+0000 7f7790e13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.902+0000 7f7790e13800 20 rados->read ofs=0 len=0 2024-09-14T11:21:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.902+0000 7f7790e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.902+0000 7f7790e13800 20 rados->read ofs=0 len=0 2024-09-14T11:21:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.903+0000 7f7790e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.903+0000 7f7790e13800 20 rados->read ofs=0 len=0 2024-09-14T11:21:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.903+0000 7f7790e13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.903+0000 7f7790e13800 20 zone default found 2024-09-14T11:21:29.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.903+0000 7f7790e13800 4 Realm: () 2024-09-14T11:21:29.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.903+0000 7f7790e13800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:21:29.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.903+0000 7f7790e13800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:21:29.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.903+0000 7f7790e13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:29.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.903+0000 7f7790e13800 20 zonegroup default 2024-09-14T11:21:29.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.903+0000 7f7790e13800 20 rados->read ofs=0 len=0 2024-09-14T11:21:29.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.903+0000 7f7790e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:29.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.903+0000 7f7790e13800 20 rados->read ofs=0 len=0 2024-09-14T11:21:29.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.903+0000 7f7790e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:29.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.903+0000 7f7790e13800 20 rados->read ofs=0 len=0 2024-09-14T11:21:29.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.904+0000 7f7790e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:29.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.904+0000 7f7790e13800 20 started sync module instance, tier type = 2024-09-14T11:21:29.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.904+0000 7f7790e13800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:21:29.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.912+0000 7f7790e13800 20 add_watcher() i=0 2024-09-14T11:21:29.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.912+0000 7f7790e13800 20 add_watcher() i=1 2024-09-14T11:21:29.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.912+0000 7f7790e13800 20 add_watcher() i=2 2024-09-14T11:21:29.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.912+0000 7f7790e13800 20 add_watcher() i=3 2024-09-14T11:21:29.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.912+0000 7f7790e13800 20 add_watcher() i=4 2024-09-14T11:21:29.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.912+0000 7f7790e13800 20 add_watcher() i=5 2024-09-14T11:21:29.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.912+0000 7f7790e13800 20 add_watcher() i=6 2024-09-14T11:21:29.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.913+0000 7f7790e13800 20 add_watcher() i=7 2024-09-14T11:21:29.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.913+0000 7f7790e13800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:29.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.914+0000 7f7642fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:29.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.915+0000 7f7790e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:29.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.915+0000 7f7790e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:29.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.951+0000 7f7641fdb640 20 reqs_thread_entry: start 2024-09-14T11:21:29.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.951+0000 7f7790e13800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:29.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.951+0000 7f7790e13800 20 Filter name: none 2024-09-14T11:21:29.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.951+0000 7f75b37fe640 20 reqs_thread_entry: start 2024-09-14T11:21:29.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.951+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:21:29.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.951+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.952+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.952+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.953+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:21:29.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.954+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.955+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.955+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.957+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:21:29.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.957+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.958+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.958+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.960+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:21:29.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.960+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.961+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.961+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.962+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:21:29.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.964+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.965+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.965+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.966+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:21:29.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.967+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.967+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.967+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.969+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:21:29.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.969+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.969+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.969+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.970+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:21:29.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.972+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.972+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.972+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.973+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:21:29.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.975+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.975+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.975+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.978+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:21:29.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.979+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.979+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.980+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.981+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:21:29.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.981+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.982+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.982+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.984+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:21:29.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.985+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.985+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.985+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.987+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:21:29.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.989+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.989+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.989+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.990+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:21:29.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.992+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.992+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.993+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.994+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:21:29.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.995+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.995+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.996+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.996+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:21:29.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.998+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.998+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.999+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:29.999+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:21:29.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.001+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:29.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.001+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:29.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.001+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.002+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:21:30.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.003+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.004+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:30.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.004+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.004+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:21:30.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.006+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.007+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:30.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.007+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.008+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:21:30.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.010+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.010+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:30.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.010+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.011+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:21:30.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.013+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.013+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:30.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.014+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.015+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:21:30.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.017+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.017+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:30.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.018+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.019+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:21:30.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.020+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.021+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:30.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.021+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.022+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:21:30.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.024+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.024+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:30.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.024+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.026+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:21:30.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.027+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.028+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:30.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.028+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.029+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:21:30.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.030+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.031+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:30.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.031+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.032+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:21:30.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.033+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.033+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:30.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.034+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.034+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:21:30.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.036+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.036+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:30.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.037+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.038+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:21:30.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.039+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.039+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:30.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.040+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.041+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:21:30.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.042+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.043+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:30.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.043+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.044+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:21:30.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.045+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.046+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:30.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.046+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.047+0000 7f7790e13800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:21:30.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.048+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.048+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:30.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.049+0000 7f7790e13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:30.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.051+0000 7f7642fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:30.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.053+0000 7f7790e13800 20 remove_watcher() i=0 2024-09-14T11:21:30.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.053+0000 7f7790e13800 2 removed watcher, disabling cache 2024-09-14T11:21:30.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.054+0000 7f7790e13800 20 remove_watcher() i=1 2024-09-14T11:21:30.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.055+0000 7f7790e13800 20 remove_watcher() i=2 2024-09-14T11:21:30.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.056+0000 7f7790e13800 20 remove_watcher() i=3 2024-09-14T11:21:30.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.056+0000 7f7790e13800 20 remove_watcher() i=4 2024-09-14T11:21:30.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.058+0000 7f7790e13800 20 remove_watcher() i=5 2024-09-14T11:21:30.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.059+0000 7f7790e13800 20 remove_watcher() i=6 2024-09-14T11:21:30.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:30.059+0000 7f7790e13800 20 remove_watcher() i=7 2024-09-14T11:21:30.069 DEBUG:teuthology.orchestra.run.smithi050:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-14T11:21:30.571 INFO:teuthology.orchestra.run.smithi050.stdout:> Task :clean 2024-09-14T11:21:31.366 INFO:teuthology.orchestra.run.smithi050.stdout:> Task :compileJava 2024-09-14T11:21:31.366 INFO:teuthology.orchestra.run.smithi050.stdout:> Task :processResources 2024-09-14T11:21:31.466 INFO:teuthology.orchestra.run.smithi050.stdout:> Task :classes 2024-09-14T11:21:31.866 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:31.866 INFO:teuthology.orchestra.run.smithi050.stdout:> Task :compileTestJava 2024-09-14T11:21:31.867 INFO:teuthology.orchestra.run.smithi050.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:21:31.867 INFO:teuthology.orchestra.run.smithi050.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:21:31.867 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:31.867 INFO:teuthology.orchestra.run.smithi050.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:21:31.868 INFO:teuthology.orchestra.run.smithi050.stdout:> Task :testClasses 2024-09-14T11:21:33.867 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:33.867 INFO:teuthology.orchestra.run.smithi050.stdout:> Task :test 2024-09-14T11:21:33.867 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:33.867 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Bucket tests STANDARD_OUT 2024-09-14T11:21:33.867 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14 11:21:33,213 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:21:33.867 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:33.867 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-14T11:21:33.867 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:33.867 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-14T11:21:33.966 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:33.966 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-14T11:21:33.966 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:33.966 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-14T11:21:34.366 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:34.366 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-14T11:21:34.366 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:34.366 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-14T11:21:34.766 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:34.766 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-14T11:21:34.966 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:34.966 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-14T11:21:35.066 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:35.066 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-14T11:21:35.266 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:35.266 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-14T11:21:35.666 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:35.666 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-14T11:21:35.666 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:35.666 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-14T11:21:35.765 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:35.765 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-14T11:21:35.966 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:35.966 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-14T11:21:36.666 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:36.666 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-14T11:21:36.766 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:36.766 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-14T11:21:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:37.066 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-14T11:21:37.166 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:37.166 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-14T11:21:37.242 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:37.242 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------- 2024-09-14T11:21:37.242 INFO:teuthology.orchestra.run.smithi050.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-14T11:21:37.242 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------- 2024-09-14T11:21:37.242 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:37.242 INFO:teuthology.orchestra.run.smithi050.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:21:37.242 INFO:teuthology.orchestra.run.smithi050.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:21:37.242 INFO:teuthology.orchestra.run.smithi050.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:21:37.242 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:37.243 INFO:teuthology.orchestra.run.smithi050.stdout:BUILD SUCCESSFUL in 7s 2024-09-14T11:21:37.243 INFO:teuthology.orchestra.run.smithi050.stdout:5 actionable tasks: 5 executed 2024-09-14T11:21:37.246 DEBUG:teuthology.orchestra.run.smithi050:> radosgw-admin gc process --include-all 2024-09-14T11:21:37.300 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:37.300 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:37.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.343+0000 7f593c60f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:37.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.344+0000 7f593c60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:37.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.344+0000 7f593c60f800 20 realm 2024-09-14T11:21:37.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.344+0000 7f593c60f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:37.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.344+0000 7f593c60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:37.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.344+0000 7f593c60f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:37.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.344+0000 7f593c60f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:37.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.344+0000 7f593c60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:37.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.344+0000 7f593c60f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:37.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.345+0000 7f593c60f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:37.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.345+0000 7f593c60f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:37.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.346+0000 7f593c60f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:37.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.346+0000 7f593c60f800 20 searching for the correct realm 2024-09-14T11:21:37.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.349+0000 7f5937547640 0 -- 172.21.15.50:0/3170265075 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f59300a5a50 msgr2=0x7f59300bfa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:37.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.354+0000 7f5938549640 0 -- 172.21.15.50:0/3170265075 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5634ddef8d70 msgr2=0x5634ddefb200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:37.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.358+0000 7f593c60f800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:21:37.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.358+0000 7f593c60f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:37.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.358+0000 7f593c60f800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:21:37.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.358+0000 7f593c60f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:37.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.358+0000 7f593c60f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:37.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.358+0000 7f593c60f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:37.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.358+0000 7f593c60f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:37.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.358+0000 7f593c60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:37.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.358+0000 7f593c60f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:37.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.358+0000 7f593c60f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:37.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.358+0000 7f593c60f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:37.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.359+0000 7f593c60f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:37.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.359+0000 7f593c60f800 20 zone default found 2024-09-14T11:21:37.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.359+0000 7f593c60f800 4 Realm: () 2024-09-14T11:21:37.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.359+0000 7f593c60f800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:21:37.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.359+0000 7f593c60f800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:21:37.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.359+0000 7f593c60f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:37.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.359+0000 7f593c60f800 20 zonegroup default 2024-09-14T11:21:37.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.359+0000 7f593c60f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:37.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.359+0000 7f593c60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:37.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.359+0000 7f593c60f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:37.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.359+0000 7f593c60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:37.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.359+0000 7f593c60f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:37.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.360+0000 7f593c60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:37.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.360+0000 7f593c60f800 20 started sync module instance, tier type = 2024-09-14T11:21:37.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.360+0000 7f593c60f800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:21:37.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.369+0000 7f593c60f800 20 add_watcher() i=0 2024-09-14T11:21:37.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.369+0000 7f593c60f800 20 add_watcher() i=1 2024-09-14T11:21:37.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.369+0000 7f593c60f800 20 add_watcher() i=2 2024-09-14T11:21:37.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.369+0000 7f593c60f800 20 add_watcher() i=3 2024-09-14T11:21:37.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.369+0000 7f593c60f800 20 add_watcher() i=4 2024-09-14T11:21:37.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.369+0000 7f593c60f800 20 add_watcher() i=5 2024-09-14T11:21:37.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.369+0000 7f593c60f800 20 add_watcher() i=6 2024-09-14T11:21:37.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.370+0000 7f593c60f800 20 add_watcher() i=7 2024-09-14T11:21:37.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.370+0000 7f593c60f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:37.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.371+0000 7f57edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:37.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.372+0000 7f593c60f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:37.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.372+0000 7f593c60f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:37.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.407+0000 7f57ecfe1640 20 reqs_thread_entry: start 2024-09-14T11:21:37.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.407+0000 7f593c60f800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:37.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.407+0000 7f593c60f800 20 Filter name: none 2024-09-14T11:21:37.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.408+0000 7f57667fc640 20 reqs_thread_entry: start 2024-09-14T11:21:37.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.408+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:21:37.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.409+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.410+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.410+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.411+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:21:37.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.412+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.413+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.413+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.414+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:21:37.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.415+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.416+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.416+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.417+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:21:37.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.419+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.419+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.420+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.421+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:21:37.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.422+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.422+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.423+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.424+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:21:37.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.425+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.425+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.426+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.427+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:21:37.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.428+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.428+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.429+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.430+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:21:37.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.431+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.431+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.431+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.433+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:21:37.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.434+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.434+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.435+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.436+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:21:37.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.437+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.437+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.438+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.439+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:21:37.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.440+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.440+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.441+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.442+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:21:37.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.443+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.443+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.444+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.445+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:21:37.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.446+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.446+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.447+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.447+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:21:37.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.449+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.449+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.449+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.450+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:21:37.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.452+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.452+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.453+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.454+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:21:37.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.455+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.456+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.456+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.457+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:21:37.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.458+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.458+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.459+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:37.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.459+0000 7f593c60f800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12382142573858637660', time=2024-09-14T13:21:35.332812+0000, chain.objs.size()=1 2024-09-14T11:21:37.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.459+0000 7f593c60f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.72__shadow_.7HG38RjFuAkPmLbD3il6N2dpo6-4KUb_0 2024-09-14T11:21:37.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.460+0000 7f593c60f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:37.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.462+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:21:37.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.463+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.463+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.464+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.465+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:21:37.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.466+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.466+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.467+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.468+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:21:37.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.469+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.469+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.469+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.471+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:21:37.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.472+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.473+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.473+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.474+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:21:37.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.475+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.475+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.476+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.477+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:21:37.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.478+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.478+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.479+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.479+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:21:37.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.481+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.481+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.481+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.483+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:21:37.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.484+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.484+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.485+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:37.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.485+0000 7f593c60f800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6668680210991795514', time=2024-09-14T13:21:36.323612+0000, chain.objs.size()=1 2024-09-14T11:21:37.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.485+0000 7f593c60f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.73__shadow_.BJrUGwqI7RWlonp_6YJnydxmc-3AZ1k_0 2024-09-14T11:21:37.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.486+0000 7f593c60f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:37.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.488+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:21:37.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.489+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.490+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.490+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.491+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:21:37.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.492+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.493+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.493+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.494+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:21:37.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.495+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.495+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.496+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.496+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:21:37.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.498+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.498+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.498+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.499+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:21:37.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.501+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.501+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.501+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.502+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:21:37.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.503+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.504+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.504+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.505+0000 7f593c60f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:21:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.507+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.507+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.508+0000 7f593c60f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.510+0000 7f57edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:37.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.512+0000 7f593c60f800 20 remove_watcher() i=0 2024-09-14T11:21:37.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.512+0000 7f593c60f800 2 removed watcher, disabling cache 2024-09-14T11:21:37.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.513+0000 7f593c60f800 20 remove_watcher() i=1 2024-09-14T11:21:37.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.514+0000 7f593c60f800 20 remove_watcher() i=2 2024-09-14T11:21:37.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.515+0000 7f593c60f800 20 remove_watcher() i=3 2024-09-14T11:21:37.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.516+0000 7f593c60f800 20 remove_watcher() i=4 2024-09-14T11:21:37.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.517+0000 7f593c60f800 20 remove_watcher() i=5 2024-09-14T11:21:37.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.518+0000 7f593c60f800 20 remove_watcher() i=6 2024-09-14T11:21:37.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.519+0000 7f593c60f800 20 remove_watcher() i=7 2024-09-14T11:21:37.529 DEBUG:teuthology.orchestra.run.smithi050:> radosgw-admin gc process --include-all 2024-09-14T11:21:37.582 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:37.583 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:37.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.625+0000 7fd1b7d32800 20 rados->read ofs=0 len=0 2024-09-14T11:21:37.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.627+0000 7fd1b7d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:37.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.627+0000 7fd1b7d32800 20 realm 2024-09-14T11:21:37.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.627+0000 7fd1b7d32800 20 rados->read ofs=0 len=0 2024-09-14T11:21:37.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.627+0000 7fd1b7d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:37.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.627+0000 7fd1b7d32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:37.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.627+0000 7fd1b7d32800 20 rados->read ofs=0 len=0 2024-09-14T11:21:37.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.628+0000 7fd1b7d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:37.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.628+0000 7fd1b7d32800 20 rados->read ofs=0 len=0 2024-09-14T11:21:37.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.628+0000 7fd1b7d32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:37.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.628+0000 7fd1b7d32800 20 rados->read ofs=0 len=0 2024-09-14T11:21:37.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.629+0000 7fd1b7d32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:37.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.629+0000 7fd1b7d32800 20 searching for the correct realm 2024-09-14T11:21:37.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.630+0000 7fd1b41bd640 0 -- 172.21.15.50:0/973622245 >> [v2:172.21.15.118:6816/4154782182,v1:172.21.15.118:6817/4154782182] conn(0x55e34a2cc7a0 msgr2=0x55e34a2cf690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:37.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.836+0000 7fd1b41bd640 0 -- 172.21.15.50:0/973622245 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55e34a2c2c20 msgr2=0x55e34a2c50e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:37.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.843+0000 7fd1b7d32800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:21:37.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.843+0000 7fd1b7d32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:37.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.843+0000 7fd1b7d32800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:21:37.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.843+0000 7fd1b7d32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:37.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.843+0000 7fd1b7d32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:37.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.843+0000 7fd1b7d32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:37.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.843+0000 7fd1b7d32800 20 rados->read ofs=0 len=0 2024-09-14T11:21:37.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.844+0000 7fd1b7d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:37.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.844+0000 7fd1b7d32800 20 rados->read ofs=0 len=0 2024-09-14T11:21:37.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.844+0000 7fd1b7d32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:37.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.844+0000 7fd1b7d32800 20 rados->read ofs=0 len=0 2024-09-14T11:21:37.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.844+0000 7fd1b7d32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:37.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.844+0000 7fd1b7d32800 20 zone default found 2024-09-14T11:21:37.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.844+0000 7fd1b7d32800 4 Realm: () 2024-09-14T11:21:37.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.844+0000 7fd1b7d32800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:21:37.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.844+0000 7fd1b7d32800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:21:37.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.844+0000 7fd1b7d32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:37.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.844+0000 7fd1b7d32800 20 zonegroup default 2024-09-14T11:21:37.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.844+0000 7fd1b7d32800 20 rados->read ofs=0 len=0 2024-09-14T11:21:37.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.845+0000 7fd1b7d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:37.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.845+0000 7fd1b7d32800 20 rados->read ofs=0 len=0 2024-09-14T11:21:37.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.845+0000 7fd1b7d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:37.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.845+0000 7fd1b7d32800 20 rados->read ofs=0 len=0 2024-09-14T11:21:37.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.845+0000 7fd1b7d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:37.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.845+0000 7fd1b7d32800 20 started sync module instance, tier type = 2024-09-14T11:21:37.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.845+0000 7fd1b7d32800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:21:37.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.854+0000 7fd1b7d32800 20 add_watcher() i=0 2024-09-14T11:21:37.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.854+0000 7fd1b7d32800 20 add_watcher() i=1 2024-09-14T11:21:37.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.854+0000 7fd1b7d32800 20 add_watcher() i=2 2024-09-14T11:21:37.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.854+0000 7fd1b7d32800 20 add_watcher() i=3 2024-09-14T11:21:37.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.854+0000 7fd1b7d32800 20 add_watcher() i=4 2024-09-14T11:21:37.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.854+0000 7fd1b7d32800 20 add_watcher() i=5 2024-09-14T11:21:37.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.854+0000 7fd1b7d32800 20 add_watcher() i=6 2024-09-14T11:21:37.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.855+0000 7fd1b7d32800 20 add_watcher() i=7 2024-09-14T11:21:37.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.855+0000 7fd1b7d32800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:37.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.857+0000 7fd069fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:37.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.857+0000 7fd1b7d32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:37.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.857+0000 7fd1b7d32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:37.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.893+0000 7fd068fe1640 20 reqs_thread_entry: start 2024-09-14T11:21:37.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.893+0000 7fd1b7d32800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:37.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.893+0000 7fd1b7d32800 20 Filter name: none 2024-09-14T11:21:37.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.893+0000 7fcfe27fc640 20 reqs_thread_entry: start 2024-09-14T11:21:37.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.893+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:21:37.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.894+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.895+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.895+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.896+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:21:37.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.898+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.898+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.898+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.899+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:21:37.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.901+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.901+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.901+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.902+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:21:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.904+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.905+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.905+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.906+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:21:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.907+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.908+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.908+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.909+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:21:37.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.910+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.911+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.911+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.912+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:21:37.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.913+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.914+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.914+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.915+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:21:37.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.917+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.917+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.917+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.918+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:21:37.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.920+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.920+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.921+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.922+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:21:37.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.923+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.924+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.924+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.925+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:21:37.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.927+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.927+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.928+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.929+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:21:37.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.930+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.930+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.931+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.932+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:21:37.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.933+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.934+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.934+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.935+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:21:37.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.936+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.937+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.937+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.938+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:21:37.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.939+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.940+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.940+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.941+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:21:37.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.942+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.943+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.943+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.944+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:21:37.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.945+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.946+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.946+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.947+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:21:37.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.949+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.949+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.949+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.950+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:21:37.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.952+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.953+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.953+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.954+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:21:37.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.955+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.955+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.956+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.957+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:21:37.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.958+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.958+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.959+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.959+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:21:37.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.961+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.961+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.962+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.963+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:21:37.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.964+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.965+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.965+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.966+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:21:37.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.967+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.968+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.968+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.969+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:21:37.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.970+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.971+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.971+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.972+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:21:37.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.974+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.974+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.974+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.975+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:21:37.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.976+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.977+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.977+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.978+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:21:37.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.979+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.980+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.980+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.981+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:21:37.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.982+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.983+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.983+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.984+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:21:37.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.985+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.986+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.986+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.987+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:21:37.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.988+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.988+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.989+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.990+0000 7fd1b7d32800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:21:37.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.991+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.991+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:37.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.992+0000 7fd1b7d32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:37.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.993+0000 7fd069fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:37.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.995+0000 7fd1b7d32800 20 remove_watcher() i=0 2024-09-14T11:21:37.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.995+0000 7fd1b7d32800 2 removed watcher, disabling cache 2024-09-14T11:21:37.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.996+0000 7fd1b7d32800 20 remove_watcher() i=1 2024-09-14T11:21:37.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.997+0000 7fd1b7d32800 20 remove_watcher() i=2 2024-09-14T11:21:37.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.998+0000 7fd1b7d32800 20 remove_watcher() i=3 2024-09-14T11:21:37.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:37.999+0000 7fd1b7d32800 20 remove_watcher() i=4 2024-09-14T11:21:37.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.001+0000 7fd1b7d32800 20 remove_watcher() i=5 2024-09-14T11:21:38.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.002+0000 7fd1b7d32800 20 remove_watcher() i=6 2024-09-14T11:21:38.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.003+0000 7fd1b7d32800 20 remove_watcher() i=7 2024-09-14T11:21:38.012 DEBUG:teuthology.orchestra.run.smithi050:> radosgw-admin gc process --include-all 2024-09-14T11:21:38.065 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:38.065 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:38.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.107+0000 7f80a560f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:38.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.109+0000 7f80a560f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:38.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.109+0000 7f80a560f800 20 realm 2024-09-14T11:21:38.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.109+0000 7f80a560f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:38.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.109+0000 7f80a560f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:38.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.109+0000 7f80a560f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:38.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.109+0000 7f80a560f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:38.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.109+0000 7f80a560f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:38.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.109+0000 7f80a560f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:38.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.110+0000 7f80a560f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:38.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.110+0000 7f80a560f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:38.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.111+0000 7f80a560f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:38.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.111+0000 7f80a560f800 20 searching for the correct realm 2024-09-14T11:21:38.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.114+0000 7f80a28ff640 0 -- 172.21.15.50:0/3392676193 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f809c075ba0 msgr2=0x7f809c06c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:38.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.320+0000 7f80a3901640 0 -- 172.21.15.50:0/3392676193 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x562debf5f700 msgr2=0x562debf61b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:38.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.324+0000 7f80a560f800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:21:38.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.324+0000 7f80a560f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:38.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.324+0000 7f80a560f800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:21:38.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.324+0000 7f80a560f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:38.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.324+0000 7f80a560f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:38.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.324+0000 7f80a560f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:38.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.324+0000 7f80a560f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:38.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.324+0000 7f80a560f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:38.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.324+0000 7f80a560f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:38.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.324+0000 7f80a560f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:38.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.324+0000 7f80a560f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:38.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.325+0000 7f80a560f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:38.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.325+0000 7f80a560f800 20 zone default found 2024-09-14T11:21:38.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.325+0000 7f80a560f800 4 Realm: () 2024-09-14T11:21:38.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.325+0000 7f80a560f800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:21:38.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.325+0000 7f80a560f800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:21:38.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.325+0000 7f80a560f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:38.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.325+0000 7f80a560f800 20 zonegroup default 2024-09-14T11:21:38.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.325+0000 7f80a560f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:38.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.325+0000 7f80a560f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:38.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.325+0000 7f80a560f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:38.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.325+0000 7f80a560f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:38.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.325+0000 7f80a560f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:38.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.325+0000 7f80a560f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:38.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.325+0000 7f80a560f800 20 started sync module instance, tier type = 2024-09-14T11:21:38.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.325+0000 7f80a560f800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:21:38.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.334+0000 7f80a560f800 20 add_watcher() i=0 2024-09-14T11:21:38.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.334+0000 7f80a560f800 20 add_watcher() i=1 2024-09-14T11:21:38.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.334+0000 7f80a560f800 20 add_watcher() i=2 2024-09-14T11:21:38.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.334+0000 7f80a560f800 20 add_watcher() i=3 2024-09-14T11:21:38.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.334+0000 7f80a560f800 20 add_watcher() i=4 2024-09-14T11:21:38.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.334+0000 7f80a560f800 20 add_watcher() i=5 2024-09-14T11:21:38.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.334+0000 7f80a560f800 20 add_watcher() i=6 2024-09-14T11:21:38.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.334+0000 7f80a560f800 20 add_watcher() i=7 2024-09-14T11:21:38.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.334+0000 7f80a560f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:38.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.336+0000 7f7f59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:38.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.337+0000 7f80a560f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:38.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.337+0000 7f80a560f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:38.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.371+0000 7f7f58fe1640 20 reqs_thread_entry: start 2024-09-14T11:21:38.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.371+0000 7f80a560f800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:38.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.371+0000 7f80a560f800 20 Filter name: none 2024-09-14T11:21:38.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.371+0000 7f7ed27fc640 20 reqs_thread_entry: start 2024-09-14T11:21:38.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.371+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:21:38.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.373+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.373+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.374+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.375+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:21:38.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.376+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.376+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.376+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.377+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:21:38.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.379+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.379+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.379+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.380+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:21:38.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.381+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.382+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.382+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.383+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:21:38.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.384+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.385+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.385+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.386+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:21:38.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.387+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.388+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.388+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.389+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:21:38.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.390+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.390+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.391+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.392+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:21:38.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.394+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.394+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.395+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.396+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:21:38.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.397+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.398+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.398+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.399+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:21:38.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.401+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.401+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.401+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.402+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:21:38.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.404+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.404+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.404+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.405+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:21:38.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.407+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.407+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.407+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.408+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:21:38.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.410+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.410+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.410+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.411+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:21:38.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.412+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.413+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.413+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.414+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:21:38.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.415+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.416+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.416+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.417+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:21:38.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.418+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.419+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.419+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.420+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:21:38.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.421+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.421+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.422+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.423+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:21:38.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.424+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.425+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.425+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.426+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:21:38.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.427+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.428+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.428+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.429+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:21:38.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.430+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.431+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.431+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.432+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:21:38.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.434+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.434+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.435+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.436+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:21:38.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.437+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.437+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.438+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.439+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:21:38.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.440+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.441+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.441+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.442+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:21:38.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.443+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.444+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.444+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.445+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:21:38.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.446+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.446+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.447+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.448+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:21:38.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.449+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.449+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.450+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.452+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:21:38.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.453+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.453+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.454+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.455+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:21:38.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.456+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.456+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.456+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.457+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:21:38.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.459+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.459+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.459+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.460+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:21:38.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.462+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.462+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.462+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.463+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:21:38.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.464+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.465+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.465+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.466+0000 7f80a560f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:21:38.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.468+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.468+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.469+0000 7f80a560f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.471+0000 7f7f59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:38.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.473+0000 7f80a560f800 20 remove_watcher() i=0 2024-09-14T11:21:38.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.473+0000 7f80a560f800 2 removed watcher, disabling cache 2024-09-14T11:21:38.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.474+0000 7f80a560f800 20 remove_watcher() i=1 2024-09-14T11:21:38.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.475+0000 7f80a560f800 20 remove_watcher() i=2 2024-09-14T11:21:38.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.476+0000 7f80a560f800 20 remove_watcher() i=3 2024-09-14T11:21:38.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.477+0000 7f80a560f800 20 remove_watcher() i=4 2024-09-14T11:21:38.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.478+0000 7f80a560f800 20 remove_watcher() i=5 2024-09-14T11:21:38.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.479+0000 7f80a560f800 20 remove_watcher() i=6 2024-09-14T11:21:38.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.480+0000 7f80a560f800 20 remove_watcher() i=7 2024-09-14T11:21:38.490 DEBUG:teuthology.orchestra.run.smithi050:> radosgw-admin gc process --include-all 2024-09-14T11:21:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:38.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.585+0000 7f837092c800 20 rados->read ofs=0 len=0 2024-09-14T11:21:38.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.586+0000 7f837092c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:38.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.586+0000 7f837092c800 20 realm 2024-09-14T11:21:38.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.586+0000 7f837092c800 20 rados->read ofs=0 len=0 2024-09-14T11:21:38.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.586+0000 7f837092c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:38.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.586+0000 7f837092c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:38.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.586+0000 7f837092c800 20 rados->read ofs=0 len=0 2024-09-14T11:21:38.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.587+0000 7f837092c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:38.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.587+0000 7f837092c800 20 rados->read ofs=0 len=0 2024-09-14T11:21:38.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.587+0000 7f837092c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:38.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.587+0000 7f837092c800 20 rados->read ofs=0 len=0 2024-09-14T11:21:38.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.588+0000 7f837092c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:38.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.588+0000 7f837092c800 20 searching for the correct realm 2024-09-14T11:21:38.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.591+0000 7f836bd44640 0 -- 172.21.15.50:0/2695517778 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f8364089430 msgr2=0x7f83640898b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:38.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.796+0000 7f836cd46640 0 -- 172.21.15.50:0/2695517778 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5581b7f40070 msgr2=0x5581b7f42500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:38.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.800+0000 7f837092c800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:21:38.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.800+0000 7f837092c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:38.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.800+0000 7f837092c800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:21:38.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.800+0000 7f837092c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:38.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.800+0000 7f837092c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:38.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.800+0000 7f837092c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:38.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.800+0000 7f837092c800 20 rados->read ofs=0 len=0 2024-09-14T11:21:38.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.801+0000 7f837092c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:38.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.801+0000 7f837092c800 20 rados->read ofs=0 len=0 2024-09-14T11:21:38.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.801+0000 7f837092c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:38.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.801+0000 7f837092c800 20 rados->read ofs=0 len=0 2024-09-14T11:21:38.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.801+0000 7f837092c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:38.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.801+0000 7f837092c800 20 zone default found 2024-09-14T11:21:38.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.801+0000 7f837092c800 4 Realm: () 2024-09-14T11:21:38.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.801+0000 7f837092c800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:21:38.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.801+0000 7f837092c800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:21:38.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.801+0000 7f837092c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:38.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.801+0000 7f837092c800 20 zonegroup default 2024-09-14T11:21:38.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.801+0000 7f837092c800 20 rados->read ofs=0 len=0 2024-09-14T11:21:38.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.802+0000 7f837092c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:38.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.802+0000 7f837092c800 20 rados->read ofs=0 len=0 2024-09-14T11:21:38.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.802+0000 7f837092c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:38.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.802+0000 7f837092c800 20 rados->read ofs=0 len=0 2024-09-14T11:21:38.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.802+0000 7f837092c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:38.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.802+0000 7f837092c800 20 started sync module instance, tier type = 2024-09-14T11:21:38.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.802+0000 7f837092c800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:21:38.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.811+0000 7f837092c800 20 add_watcher() i=0 2024-09-14T11:21:38.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.811+0000 7f837092c800 20 add_watcher() i=1 2024-09-14T11:21:38.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.811+0000 7f837092c800 20 add_watcher() i=2 2024-09-14T11:21:38.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.811+0000 7f837092c800 20 add_watcher() i=3 2024-09-14T11:21:38.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.811+0000 7f837092c800 20 add_watcher() i=4 2024-09-14T11:21:38.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.811+0000 7f837092c800 20 add_watcher() i=5 2024-09-14T11:21:38.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.811+0000 7f837092c800 20 add_watcher() i=6 2024-09-14T11:21:38.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.812+0000 7f837092c800 20 add_watcher() i=7 2024-09-14T11:21:38.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.812+0000 7f837092c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:38.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.814+0000 7f8222fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:38.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.814+0000 7f837092c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:38.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.815+0000 7f837092c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:38.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.850+0000 7f8221fdb640 20 reqs_thread_entry: start 2024-09-14T11:21:38.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.850+0000 7f837092c800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:38.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.850+0000 7f837092c800 20 Filter name: none 2024-09-14T11:21:38.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.850+0000 7f81937fe640 20 reqs_thread_entry: start 2024-09-14T11:21:38.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.850+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:21:38.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.852+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.852+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.852+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.853+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:21:38.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.854+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.855+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.855+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.856+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:21:38.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.857+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.858+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.858+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.859+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:21:38.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.861+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.861+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.861+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.862+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:21:38.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.864+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.864+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.864+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.865+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:21:38.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.867+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.867+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.867+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.868+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:21:38.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.870+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.870+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.870+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.872+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:21:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.873+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.873+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.874+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.875+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:21:38.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.876+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.877+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.877+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.878+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:21:38.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.879+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.879+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.880+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.880+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:21:38.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.882+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.882+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.882+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.883+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:21:38.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.885+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.885+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.885+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.886+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:21:38.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.887+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.888+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.888+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.889+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:21:38.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.890+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.891+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.891+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.892+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:21:38.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.893+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.894+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.894+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.895+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:21:38.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.897+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.897+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.897+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.898+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:21:38.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.899+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.900+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.900+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.901+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:21:38.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.902+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.903+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.903+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.904+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:21:38.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.905+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.905+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.906+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.907+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:21:38.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.908+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.908+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.908+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.909+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:21:38.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.911+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.911+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.911+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.912+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:21:38.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.914+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.914+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.914+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.915+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:21:38.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.917+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.917+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.917+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.918+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:21:38.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.919+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.920+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.920+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.921+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:21:38.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.922+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.923+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.923+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.924+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:21:38.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.925+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.925+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.925+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.927+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:21:38.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.928+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.928+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.928+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.929+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:21:38.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.931+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.932+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.932+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.933+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:21:38.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.934+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.935+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.935+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.936+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:21:38.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.937+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.937+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.938+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.939+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:21:38.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.940+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.941+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.941+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.942+0000 7f837092c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:21:38.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.943+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.944+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:38.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.944+0000 7f837092c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:38.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.946+0000 7f8222fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:38.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.948+0000 7f837092c800 20 remove_watcher() i=0 2024-09-14T11:21:38.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.948+0000 7f837092c800 2 removed watcher, disabling cache 2024-09-14T11:21:38.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.949+0000 7f837092c800 20 remove_watcher() i=1 2024-09-14T11:21:38.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.950+0000 7f837092c800 20 remove_watcher() i=2 2024-09-14T11:21:38.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.951+0000 7f837092c800 20 remove_watcher() i=3 2024-09-14T11:21:38.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.952+0000 7f837092c800 20 remove_watcher() i=4 2024-09-14T11:21:38.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.952+0000 7f837092c800 20 remove_watcher() i=5 2024-09-14T11:21:38.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.953+0000 7f837092c800 20 remove_watcher() i=6 2024-09-14T11:21:38.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:21:38.954+0000 7f837092c800 20 remove_watcher() i=7 2024-09-14T11:21:38.964 DEBUG:teuthology.orchestra.run.smithi050:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-14T11:21:39.467 INFO:teuthology.orchestra.run.smithi050.stdout:> Task :clean 2024-09-14T11:21:40.263 INFO:teuthology.orchestra.run.smithi050.stdout:> Task :compileJava 2024-09-14T11:21:40.263 INFO:teuthology.orchestra.run.smithi050.stdout:> Task :processResources 2024-09-14T11:21:40.263 INFO:teuthology.orchestra.run.smithi050.stdout:> Task :classes 2024-09-14T11:21:40.862 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:40.863 INFO:teuthology.orchestra.run.smithi050.stdout:> Task :compileTestJava 2024-09-14T11:21:40.863 INFO:teuthology.orchestra.run.smithi050.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:21:40.863 INFO:teuthology.orchestra.run.smithi050.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:21:40.864 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:40.864 INFO:teuthology.orchestra.run.smithi050.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:21:40.864 INFO:teuthology.orchestra.run.smithi050.stdout:> Task :testClasses 2024-09-14T11:21:42.763 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:42.763 INFO:teuthology.orchestra.run.smithi050.stdout:> Task :test 2024-09-14T11:21:42.764 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:42.764 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests STANDARD_OUT 2024-09-14T11:21:42.764 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14 11:21:42,145 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:21:42.764 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:42.764 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-14T11:21:42.764 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:42.764 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-14T11:21:43.262 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:43.262 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-14T11:21:43.362 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:43.362 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-14T11:21:43.762 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:43.762 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-14T11:21:43.862 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:43.862 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-14T11:21:44.162 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:44.162 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-14T11:21:58.362 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:58.363 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-14T11:21:58.662 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:58.663 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-14T11:21:58.762 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:58.762 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-14T11:21:59.162 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:59.162 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-14T11:21:59.362 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:59.362 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-14T11:21:59.762 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:59.763 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-14T11:21:59.763 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:59.763 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-14T11:21:59.862 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:59.863 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-14T11:21:59.962 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:21:59.963 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-14T11:22:00.262 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:00.262 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-14T11:22:05.762 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:05.763 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-14T11:22:06.062 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:06.062 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-14T11:22:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:06.263 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-14T11:22:06.662 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:06.662 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-14T11:22:06.762 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:06.762 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-14T11:22:07.162 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:07.163 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-14T11:22:07.262 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:07.263 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-14T11:22:07.662 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:07.662 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-14T11:22:07.762 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:07.762 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-14T11:22:08.062 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:08.062 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-14T11:22:08.162 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:08.163 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-14T11:22:08.562 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:08.563 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-14T11:22:08.662 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:08.663 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-14T11:22:08.962 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:08.962 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-14T11:22:09.162 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:09.162 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-14T11:22:09.562 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:09.562 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-14T11:22:24.062 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:24.063 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-14T11:22:24.762 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:24.762 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-14T11:22:54.463 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:54.463 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-14T11:22:55.162 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:55.163 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-14T11:22:55.163 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:55.163 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-14T11:22:55.562 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:55.562 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-14T11:22:55.662 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:55.662 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-14T11:22:56.262 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:22:56.262 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-14T11:23:02.063 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:23:02.063 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-14T11:23:02.462 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:23:02.463 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-14T11:23:02.562 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:23:02.563 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-14T11:23:02.662 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:23:02.663 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-14T11:23:10.362 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:23:10.363 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-14T11:23:11.962 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:23:11.963 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests STANDARD_OUT 2024-09-14T11:23:11.963 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14 11:23:11,914 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-14T11:23:12.262 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:23:12.263 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:23:31.662 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:23:31.663 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:23:32.162 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:23:32.163 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-14T11:23:37.162 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:23:37.163 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-14T11:23:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:23:37.562 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-14T11:24:16.662 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:16.663 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-14T11:24:17.062 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:17.062 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-14T11:24:25.962 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:25.962 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-14T11:24:26.362 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:26.362 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-14T11:24:31.362 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:31.362 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-14T11:24:31.762 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:31.762 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-14T11:24:33.562 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:33.563 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-14T11:24:41.162 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:41.163 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-14T11:24:41.163 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:41.163 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-14T11:24:41.262 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:41.262 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-14T11:24:41.362 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:41.363 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-14T11:24:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:41.762 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-14T11:24:41.862 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:41.862 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-14T11:24:42.162 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:42.162 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-14T11:24:42.262 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:42.262 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-14T11:24:42.662 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:42.662 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-14T11:24:42.762 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:42.762 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-14T11:24:43.162 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:43.162 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-14T11:24:43.262 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:43.262 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-14T11:24:43.562 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:43.562 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-14T11:24:43.662 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:43.662 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-14T11:24:44.062 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:44.062 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-14T11:24:44.262 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:44.262 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-14T11:24:44.762 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:44.762 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-14T11:24:44.962 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:44.962 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-14T11:24:45.462 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:45.462 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-14T11:24:45.662 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:45.662 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-14T11:24:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:46.162 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-14T11:24:46.362 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:46.362 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-14T11:24:46.862 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:46.862 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-14T11:24:47.062 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:47.062 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-14T11:24:47.562 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:47.581 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-14T11:24:47.762 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:47.762 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-14T11:24:48.262 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:48.262 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-14T11:24:48.462 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:48.462 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-14T11:24:48.962 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:48.962 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-14T11:24:49.162 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:49.162 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-14T11:24:49.662 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:49.662 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-14T11:24:49.862 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:49.862 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-14T11:24:50.362 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:50.362 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-14T11:24:50.562 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:50.562 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-14T11:24:51.062 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:51.062 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-14T11:24:51.362 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:51.362 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-14T11:24:51.762 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:51.762 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-14T11:24:51.962 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:51.962 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-14T11:24:52.462 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:52.462 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-14T11:24:52.662 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:52.662 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-14T11:24:53.062 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:53.062 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-14T11:24:53.262 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:53.262 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-14T11:24:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:53.762 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-14T11:24:53.962 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:53.962 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-14T11:24:54.462 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:54.462 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-14T11:24:54.662 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:54.662 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-14T11:24:55.162 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:55.162 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-14T11:24:55.362 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:55.362 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-14T11:24:55.862 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:55.862 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-14T11:24:56.062 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:56.062 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-14T11:24:56.562 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:56.562 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-14T11:24:56.762 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:56.762 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-14T11:24:57.162 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:57.162 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-14T11:24:57.362 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:57.362 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-14T11:24:57.862 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:57.862 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-14T11:24:58.062 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:58.062 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-14T11:24:58.462 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:58.462 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-14T11:24:58.662 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:58.662 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-14T11:24:59.062 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:59.062 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-14T11:24:59.162 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:59.162 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-14T11:24:59.562 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:59.562 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-14T11:24:59.662 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:24:59.662 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-14T11:25:00.062 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:00.062 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-14T11:25:00.062 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:00.062 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-14T11:25:00.462 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:00.462 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-14T11:25:00.562 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:00.562 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-14T11:25:00.962 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:00.962 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-14T11:25:01.262 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:01.262 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-14T11:25:01.662 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:01.662 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-14T11:25:01.762 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:01.762 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-14T11:25:01.862 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:01.862 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-14T11:25:01.962 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:01.962 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-14T11:25:02.362 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:02.362 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-14T11:25:02.462 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:02.462 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-14T11:25:02.862 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:02.862 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-14T11:25:03.067 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:03.068 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-14T11:25:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:03.363 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-14T11:25:03.463 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:03.463 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-14T11:25:03.863 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:03.863 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-14T11:25:09.663 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:09.663 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-14T11:25:10.062 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:10.062 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-14T11:25:15.462 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:15.462 INFO:teuthology.orchestra.run.smithi050.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-14T11:25:15.862 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:15.862 INFO:teuthology.orchestra.run.smithi050.stdout:---------------------------------------------------------------------- 2024-09-14T11:25:15.862 INFO:teuthology.orchestra.run.smithi050.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-14T11:25:15.863 INFO:teuthology.orchestra.run.smithi050.stdout:---------------------------------------------------------------------- 2024-09-14T11:25:15.863 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:15.863 INFO:teuthology.orchestra.run.smithi050.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:25:15.863 INFO:teuthology.orchestra.run.smithi050.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:25:15.863 INFO:teuthology.orchestra.run.smithi050.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:25:15.863 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:15.863 INFO:teuthology.orchestra.run.smithi050.stdout:BUILD SUCCESSFUL in 3m 36s 2024-09-14T11:25:15.863 INFO:teuthology.orchestra.run.smithi050.stdout:5 actionable tasks: 5 executed 2024-09-14T11:25:15.879 DEBUG:teuthology.orchestra.run.smithi050:> radosgw-admin gc process --include-all 2024-09-14T11:25:15.932 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:15.932 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:15.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:15.973+0000 7f30c6013800 20 rados->read ofs=0 len=0 2024-09-14T11:25:15.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:15.974+0000 7f30c6013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:15.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:15.974+0000 7f30c6013800 20 realm 2024-09-14T11:25:15.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:15.974+0000 7f30c6013800 20 rados->read ofs=0 len=0 2024-09-14T11:25:15.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:15.975+0000 7f30c6013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:15.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:15.975+0000 7f30c6013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:15.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:15.975+0000 7f30c6013800 20 rados->read ofs=0 len=0 2024-09-14T11:25:15.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:15.975+0000 7f30c6013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:15.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:15.975+0000 7f30c6013800 20 rados->read ofs=0 len=0 2024-09-14T11:25:15.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:15.975+0000 7f30c6013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:15.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:15.975+0000 7f30c6013800 20 rados->read ofs=0 len=0 2024-09-14T11:25:15.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:15.976+0000 7f30c6013800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:15.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:15.976+0000 7f30c6013800 20 searching for the correct realm 2024-09-14T11:25:15.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:15.979+0000 7f30c1f49640 0 -- 172.21.15.50:0/2920021015 >> [v2:172.21.15.118:6816/4154782182,v1:172.21.15.118:6817/4154782182] conn(0x55a839e56520 msgr2=0x55a839e589e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:15.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:15.982+0000 7f30c1748640 0 -- 172.21.15.50:0/2920021015 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f30bc072b60 msgr2=0x7f30bc090920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:16.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.190+0000 7f30c6013800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:25:16.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.190+0000 7f30c6013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:16.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.190+0000 7f30c6013800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:25:16.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.190+0000 7f30c6013800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:16.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.190+0000 7f30c6013800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:16.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.190+0000 7f30c6013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:16.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.190+0000 7f30c6013800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.190+0000 7f30c6013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.190+0000 7f30c6013800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.191+0000 7f30c6013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:16.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.191+0000 7f30c6013800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.191+0000 7f30c6013800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:16.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.191+0000 7f30c6013800 20 zone default found 2024-09-14T11:25:16.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.191+0000 7f30c6013800 4 Realm: () 2024-09-14T11:25:16.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.191+0000 7f30c6013800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:25:16.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.191+0000 7f30c6013800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:25:16.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.191+0000 7f30c6013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:16.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.191+0000 7f30c6013800 20 zonegroup default 2024-09-14T11:25:16.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.191+0000 7f30c6013800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.192+0000 7f30c6013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.192+0000 7f30c6013800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.192+0000 7f30c6013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.192+0000 7f30c6013800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.192+0000 7f30c6013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.192+0000 7f30c6013800 20 started sync module instance, tier type = 2024-09-14T11:25:16.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.192+0000 7f30c6013800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:25:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.202+0000 7f30c6013800 20 add_watcher() i=0 2024-09-14T11:25:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.202+0000 7f30c6013800 20 add_watcher() i=1 2024-09-14T11:25:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.202+0000 7f30c6013800 20 add_watcher() i=2 2024-09-14T11:25:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.202+0000 7f30c6013800 20 add_watcher() i=3 2024-09-14T11:25:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.202+0000 7f30c6013800 20 add_watcher() i=4 2024-09-14T11:25:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.202+0000 7f30c6013800 20 add_watcher() i=5 2024-09-14T11:25:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.202+0000 7f30c6013800 20 add_watcher() i=6 2024-09-14T11:25:16.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.203+0000 7f30c6013800 20 add_watcher() i=7 2024-09-14T11:25:16.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.203+0000 7f30c6013800 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:16.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.204+0000 7f2f777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:16.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.205+0000 7f30c6013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:16.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.205+0000 7f30c6013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:16.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.241+0000 7f2f767e4640 20 reqs_thread_entry: start 2024-09-14T11:25:16.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.241+0000 7f30c6013800 20 init_complete bucket index max shards: 11 2024-09-14T11:25:16.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.241+0000 7f30c6013800 20 Filter name: none 2024-09-14T11:25:16.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.241+0000 7f2ee7fff640 20 reqs_thread_entry: start 2024-09-14T11:25:16.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.241+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:25:16.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.243+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.244+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.244+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:25:16.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.244+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4927675462852549340', time=2024-09-14T13:24:45.130290+0000, chain.objs.size()=1 2024-09-14T11:25:16.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.244+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.114__shadow_.P9elxd_0f9bkccQVVyYInAITgXL08vx_0 2024-09-14T11:25:16.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.244+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10336802975775974035', time=2024-09-14T13:24:52.124491+0000, chain.objs.size()=1 2024-09-14T11:25:16.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.244+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.124__shadow_.3u65oWQU6ZdLXQ47jc_DBUDQQ6ec6Zl_0 2024-09-14T11:25:16.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.244+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5752170427169420416', time=2024-09-14T13:24:52.760232+0000, chain.objs.size()=1 2024-09-14T11:25:16.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.244+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.125__shadow_.ZitcO7h9pVKMl_kYtAHDfm4nv090ATp_0 2024-09-14T11:25:16.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.244+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9138776242999834067', time=2024-09-14T13:24:55.465658+0000, chain.objs.size()=1 2024-09-14T11:25:16.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.244+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.129__shadow_.kEr1LvXEa9Go-d3JcNozNW8_HfSYvQV_0 2024-09-14T11:25:16.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.244+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17381141341455702186', time=2024-09-14T13:24:56.868106+0000, chain.objs.size()=1 2024-09-14T11:25:16.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.244+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.131__shadow_.3-4kJM-A5d9_8XWc8PCuLXWD1UhWDlo_0 2024-09-14T11:25:16.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.246+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.249+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:25:16.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.250+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.251+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.251+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:25:16.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.251+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.165168842616313914', time=2024-09-14T13:24:45.827983+0000, chain.objs.size()=1 2024-09-14T11:25:16.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.251+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.115__shadow_.jWIBdsRePV2FSgs3TOZzTJv-yDZvuj8_0 2024-09-14T11:25:16.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.251+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9730079119607218716', time=2024-09-14T13:24:49.295677+0000, chain.objs.size()=1 2024-09-14T11:25:16.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.251+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.120__shadow_.sU_4U24kTlXyOPsyHeFLo5zl8ckVNya_0 2024-09-14T11:25:16.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.251+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7040723166779409088', time=2024-09-14T13:24:50.698462+0000, chain.objs.size()=1 2024-09-14T11:25:16.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.251+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.122__shadow_.o2JXGobpjIAPwramUqlj4FCA_zh-396_0 2024-09-14T11:25:16.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.251+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17225106627874222651', time=2024-09-14T13:24:52.097208+0000, chain.objs.size()=1 2024-09-14T11:25:16.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.251+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.124__shadow_.yIj6Z-3zoCw-oV7jOKKzpZVJMvZKugV_0 2024-09-14T11:25:16.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.251+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6772424903459855759', time=2024-09-14T13:24:52.705999+0000, chain.objs.size()=1 2024-09-14T11:25:16.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.251+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.125__shadow_.ZAk7J2skmEPiqnalRzgGj7Dq3aQofE8_0 2024-09-14T11:25:16.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.251+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3102143200635130112', time=2024-09-14T13:25:00.210738+0000, chain.objs.size()=1 2024-09-14T11:25:16.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.251+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.137__shadow_.I11C-4oBRVhQuo9GCOOcNrk-uaOeXMQ_0 2024-09-14T11:25:16.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.254+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.256+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:25:16.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.257+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.258+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.259+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:25:16.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.259+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa', time=2024-09-14T13:24:36.888599+0000, chain.objs.size()=40 2024-09-14T11:25:16.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.259+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.1 2024-09-14T11:25:16.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.259+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.2 2024-09-14T11:25:16.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.259+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.3 2024-09-14T11:25:16.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.259+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.4 2024-09-14T11:25:16.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.259+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.5 2024-09-14T11:25:16.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.259+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.6 2024-09-14T11:25:16.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.259+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.7 2024-09-14T11:25:16.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.259+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.8 2024-09-14T11:25:16.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.259+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.9 2024-09-14T11:25:16.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.259+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.10 2024-09-14T11:25:16.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.259+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.11 2024-09-14T11:25:16.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.259+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.12 2024-09-14T11:25:16.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.263+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.13 2024-09-14T11:25:16.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.263+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.14 2024-09-14T11:25:16.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.263+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.15 2024-09-14T11:25:16.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.263+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.16 2024-09-14T11:25:16.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.263+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.17 2024-09-14T11:25:16.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.263+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.18 2024-09-14T11:25:16.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.263+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.19 2024-09-14T11:25:16.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.264+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.20 2024-09-14T11:25:16.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.264+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.21 2024-09-14T11:25:16.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.264+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.22 2024-09-14T11:25:16.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.264+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.23 2024-09-14T11:25:16.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.266+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.24 2024-09-14T11:25:16.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.266+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.25 2024-09-14T11:25:16.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.266+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.26 2024-09-14T11:25:16.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.267+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.27 2024-09-14T11:25:16.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.267+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.28 2024-09-14T11:25:16.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.267+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.29 2024-09-14T11:25:16.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.267+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.30 2024-09-14T11:25:16.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.267+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.31 2024-09-14T11:25:16.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.269+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.32 2024-09-14T11:25:16.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.270+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.33 2024-09-14T11:25:16.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.270+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.34 2024-09-14T11:25:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.270+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.35 2024-09-14T11:25:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.272+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.36 2024-09-14T11:25:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.272+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.37 2024-09-14T11:25:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.272+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.38 2024-09-14T11:25:16.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.273+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.39 2024-09-14T11:25:16.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.273+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.40 2024-09-14T11:25:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.273+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa', time=2024-09-14T13:24:37.473797+0000, chain.objs.size()=10 2024-09-14T11:25:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.273+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.41 2024-09-14T11:25:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.273+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.42 2024-09-14T11:25:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.273+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.43 2024-09-14T11:25:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.273+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.44 2024-09-14T11:25:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.273+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.45 2024-09-14T11:25:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.273+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.46 2024-09-14T11:25:16.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.275+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.47 2024-09-14T11:25:16.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.275+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.48 2024-09-14T11:25:16.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.276+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.49 2024-09-14T11:25:16.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.276+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.50 2024-09-14T11:25:16.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.277+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa', time=2024-09-14T13:24:38.003233+0000, chain.objs.size()=2 2024-09-14T11:25:16.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.277+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.51 2024-09-14T11:25:16.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.278+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.106__multipart_key1.2~7qMZnpDzmsIUn-CHXpNaflrcIRN6Mqa.52 2024-09-14T11:25:16.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.278+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15204794921350044709', time=2024-09-14T13:24:50.077771+0000, chain.objs.size()=1 2024-09-14T11:25:16.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.278+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.121__shadow_._rPzPmsrToZ8PSc-Vllp6tNq7--3Wr3_0 2024-09-14T11:25:16.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.282+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.284+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:25:16.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.286+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.286+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.287+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:25:16.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.287+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4753876410772732921', time=2024-09-14T13:24:47.984994+0000, chain.objs.size()=1 2024-09-14T11:25:16.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.287+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.118__shadow_.4Gb5FT3mMBqhSVEklF-BqMWweIUu0Ea_0 2024-09-14T11:25:16.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.287+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18227518731942360449', time=2024-09-14T13:24:50.048756+0000, chain.objs.size()=1 2024-09-14T11:25:16.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.287+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.121__shadow_.seIttXYhBCX-DcJaI2t5AaThbBKsrcF_0 2024-09-14T11:25:16.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.287+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8994427964889247924', time=2024-09-14T13:24:56.191363+0000, chain.objs.size()=1 2024-09-14T11:25:16.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.287+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.130__shadow_.8Ko5sgv_wsi_dWNil6k-WtJ4C2v4kyu_0 2024-09-14T11:25:16.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.287+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10629214329820991877', time=2024-09-14T13:24:58.786374+0000, chain.objs.size()=1 2024-09-14T11:25:16.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.287+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.134__shadow_.EGbfrM2qZKUvbCzDba7cauLQazovSaa_0 2024-09-14T11:25:16.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.289+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.291+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:25:16.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.292+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.292+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.293+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:25:16.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.293+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8753420876068255027', time=2024-09-14T13:21:43.439613+0000, chain.objs.size()=1 2024-09-14T11:25:16.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.293+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.78__shadow_.aolGbL5RvDJUCt6lL5p3ztR4cvNiwyC_0 2024-09-14T11:25:16.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.293+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11709869887043804465', time=2024-09-14T13:22:42.940874+0000, chain.objs.size()=5 2024-09-14T11:25:16.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.293+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__multipart_key1.2~SBdPjnfjR8it6IRkyl60GcVqH0G8mjP.1 2024-09-14T11:25:16.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.293+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__shadow_key1.2~SBdPjnfjR8it6IRkyl60GcVqH0G8mjP.1_1 2024-09-14T11:25:16.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.293+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__multipart_key1.2~SBdPjnfjR8it6IRkyl60GcVqH0G8mjP.2 2024-09-14T11:25:16.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.293+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__shadow_key1.2~SBdPjnfjR8it6IRkyl60GcVqH0G8mjP.2_1 2024-09-14T11:25:16.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.293+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__multipart_key1.2~SBdPjnfjR8it6IRkyl60GcVqH0G8mjP.3 2024-09-14T11:25:16.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.293+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.361784163585472247', time=2024-09-14T13:24:55.547837+0000, chain.objs.size()=1 2024-09-14T11:25:16.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.293+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.129__shadow_.-a86Fe6ruekUJnbDldH8CqdZihx8tPy_0 2024-09-14T11:25:16.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.296+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.299+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:25:16.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.300+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.301+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.301+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:25:16.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.301+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='2~K3voJYElDAfGTHKdRaGOdaSLLaXDECz', time=2024-09-14T13:21:58.276460+0000, chain.objs.size()=5 2024-09-14T11:25:16.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.301+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.80__multipart_key1.2~K3voJYElDAfGTHKdRaGOdaSLLaXDECz.1 2024-09-14T11:25:16.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.301+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.80__multipart_key1.2~K3voJYElDAfGTHKdRaGOdaSLLaXDECz.2 2024-09-14T11:25:16.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.301+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.80__multipart_key1.2~K3voJYElDAfGTHKdRaGOdaSLLaXDECz.3 2024-09-14T11:25:16.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.301+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.80__multipart_key1.2~K3voJYElDAfGTHKdRaGOdaSLLaXDECz.4 2024-09-14T11:25:16.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.301+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.80__multipart_key1.2~K3voJYElDAfGTHKdRaGOdaSLLaXDECz.5 2024-09-14T11:25:16.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.301+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14756523037485323774', time=2024-09-14T13:24:06.241186+0000, chain.objs.size()=5 2024-09-14T11:25:16.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.301+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__multipart_key1.2~xk1PvR4_updH0puUMJWkfA5sZrDjDKw.1 2024-09-14T11:25:16.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.301+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__multipart_key1.2~xk1PvR4_updH0puUMJWkfA5sZrDjDKw.2 2024-09-14T11:25:16.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.301+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__multipart_key1.2~xk1PvR4_updH0puUMJWkfA5sZrDjDKw.3 2024-09-14T11:25:16.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.301+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__multipart_key1.2~xk1PvR4_updH0puUMJWkfA5sZrDjDKw.4 2024-09-14T11:25:16.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.301+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__multipart_key1.2~xk1PvR4_updH0puUMJWkfA5sZrDjDKw.5 2024-09-14T11:25:16.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.301+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16832058821977007564', time=2024-09-14T13:24:44.431669+0000, chain.objs.size()=1 2024-09-14T11:25:16.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.301+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.113__shadow_.vEjJvqW9P5t5a5rk7l2Zbm2zndf-2KT_0 2024-09-14T11:25:16.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.301+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18298247355156381363', time=2024-09-14T13:24:55.520852+0000, chain.objs.size()=1 2024-09-14T11:25:16.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.301+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.129__shadow_.ndHFcLZF3661vy0tOwSGBYwToU6a8vR_0 2024-09-14T11:25:16.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.304+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4666448145424998887', time=2024-09-14T13:25:01.195010+0000, chain.objs.size()=1 2024-09-14T11:25:16.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.305+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.139__shadow_.SamKuH_514c91CJXal5mXeR1bi1mf1L_0 2024-09-14T11:25:16.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.308+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.310+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:25:16.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.311+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.312+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.312+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:25:16.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.312+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10432536278216100961', time=2024-09-14T13:23:47.503817+0000, chain.objs.size()=5 2024-09-14T11:25:16.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.312+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__multipart_key1.2~K-UsCV1ttBFjDRaSzUiVPoQyOOOhcu4.1 2024-09-14T11:25:16.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.312+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__multipart_key1.2~K-UsCV1ttBFjDRaSzUiVPoQyOOOhcu4.2 2024-09-14T11:25:16.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.312+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__multipart_key1.2~K-UsCV1ttBFjDRaSzUiVPoQyOOOhcu4.3 2024-09-14T11:25:16.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.312+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__multipart_key1.2~K-UsCV1ttBFjDRaSzUiVPoQyOOOhcu4.4 2024-09-14T11:25:16.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.312+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__multipart_key1.2~K-UsCV1ttBFjDRaSzUiVPoQyOOOhcu4.5 2024-09-14T11:25:16.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.312+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15961732076936940579', time=2024-09-14T13:24:11.208166+0000, chain.objs.size()=5 2024-09-14T11:25:16.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.312+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__multipart_key1.2~XKzP7Ydv5oQFSrkE2grspFfexmLzzFg.1 2024-09-14T11:25:16.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.312+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__shadow_key1.2~XKzP7Ydv5oQFSrkE2grspFfexmLzzFg.1_1 2024-09-14T11:25:16.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.312+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__multipart_key1.2~XKzP7Ydv5oQFSrkE2grspFfexmLzzFg.2 2024-09-14T11:25:16.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.312+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__shadow_key1.2~XKzP7Ydv5oQFSrkE2grspFfexmLzzFg.2_1 2024-09-14T11:25:16.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.312+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__multipart_key1.2~XKzP7Ydv5oQFSrkE2grspFfexmLzzFg.3 2024-09-14T11:25:16.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.312+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7698901848922854784', time=2024-09-14T13:24:44.374736+0000, chain.objs.size()=1 2024-09-14T11:25:16.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.312+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.113__shadow_.jmigXBTQ3CIWD99-5wg6JPzcLUmh_xl_0 2024-09-14T11:25:16.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.318+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.320+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:25:16.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.322+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.322+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.322+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:25:16.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.323+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15424604812740861789', time=2024-09-14T13:22:06.873794+0000, chain.objs.size()=1 2024-09-14T11:25:16.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.323+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.86__shadow_.QM7oUW9--Aji9ujz3q6X2rdHr6WritN_0 2024-09-14T11:25:16.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.323+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4060513688947795449', time=2024-09-14T13:23:31.802241+0000, chain.objs.size()=1 2024-09-14T11:25:16.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.323+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.101__shadow_.IS8rUZkchwIPJwJwoN_-1cb4yicZgGm_0 2024-09-14T11:25:16.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.323+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9933322803804986637', time=2024-09-14T13:24:31.420942+0000, chain.objs.size()=5 2024-09-14T11:25:16.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.323+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.105__multipart_key1.2~ZuSGw35jhViLW7p3v7jOjTB6pC9XO8L.1 2024-09-14T11:25:16.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.323+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.105__multipart_key1.2~ZuSGw35jhViLW7p3v7jOjTB6pC9XO8L.2 2024-09-14T11:25:16.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.323+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.105__multipart_key1.2~ZuSGw35jhViLW7p3v7jOjTB6pC9XO8L.3 2024-09-14T11:25:16.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.323+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.105__multipart_key1.2~ZuSGw35jhViLW7p3v7jOjTB6pC9XO8L.4 2024-09-14T11:25:16.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.323+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.105__multipart_key1.2~ZuSGw35jhViLW7p3v7jOjTB6pC9XO8L.5 2024-09-14T11:25:16.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.323+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.127236264349886151', time=2024-09-14T13:24:45.158403+0000, chain.objs.size()=1 2024-09-14T11:25:16.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.323+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.114__shadow_.yjRn-5gURntVcQrDOMCyRJ3xIbt5vti_0 2024-09-14T11:25:16.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.323+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6757115677674541949', time=2024-09-14T13:24:48.655039+0000, chain.objs.size()=1 2024-09-14T11:25:16.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.323+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.119__shadow_.aTBTwT8ClWI31TkojXdy1uo9xaqpEuF_0 2024-09-14T11:25:16.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.327+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.329+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:25:16.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.330+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.331+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.331+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:25:16.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.331+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9307642937513935721', time=2024-09-14T13:22:54.865509+0000, chain.objs.size()=4 2024-09-14T11:25:16.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.331+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.94__shadow_.gyuwHA-tEk2sOj_NMhBoznJ0fUCRfAm_0 2024-09-14T11:25:16.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.331+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.94__shadow_.gyuwHA-tEk2sOj_NMhBoznJ0fUCRfAm_1 2024-09-14T11:25:16.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.331+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.94__shadow_.gyuwHA-tEk2sOj_NMhBoznJ0fUCRfAm_2 2024-09-14T11:25:16.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.331+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.94__shadow_.gyuwHA-tEk2sOj_NMhBoznJ0fUCRfAm_3 2024-09-14T11:25:16.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.331+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15964281074074784713', time=2024-09-14T13:24:48.682881+0000, chain.objs.size()=1 2024-09-14T11:25:16.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.331+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.119__shadow_.u1ipBs1XvtiAMRNvE6wMz4ExGg8vk2Y_0 2024-09-14T11:25:16.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.331+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12109005199590522472', time=2024-09-14T13:24:49.322567+0000, chain.objs.size()=1 2024-09-14T11:25:16.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.331+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.120__shadow_.qI-_N2D2k6qSFTexwo486pNRxf-jQ20_0 2024-09-14T11:25:16.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.335+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.338+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:25:16.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.339+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.339+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.339+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:25:16.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.339+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16549388328122360156', time=2024-09-14T13:24:50.021655+0000, chain.objs.size()=1 2024-09-14T11:25:16.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.339+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.121__shadow_.l-DOlkvEuJ-oz77ddnK-98bTRRgVY_X_0 2024-09-14T11:25:16.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.339+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18222279822981913615', time=2024-09-14T13:24:54.795054+0000, chain.objs.size()=1 2024-09-14T11:25:16.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.340+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.128__shadow_.qZ5wWZseKh4BGH8OGQ7fgwVyAXLALHl_0 2024-09-14T11:25:16.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.340+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13269815158951262248', time=2024-09-14T13:24:54.849234+0000, chain.objs.size()=1 2024-09-14T11:25:16.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.340+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.128__shadow_.2rhsqymRws5xmqG3PYLo93aB8FD6HG8_0 2024-09-14T11:25:16.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.341+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.343+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:25:16.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.345+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.345+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.346+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:25:16.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.346+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11140724649526794831', time=2024-09-14T13:23:31.774321+0000, chain.objs.size()=5 2024-09-14T11:25:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.346+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.101__multipart_file.mpg.2~IIRaVe6DNEp7nyrknzxDHy7vtoh3YF6.1 2024-09-14T11:25:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.346+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.101__multipart_file.mpg.2~IIRaVe6DNEp7nyrknzxDHy7vtoh3YF6.2 2024-09-14T11:25:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.346+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.101__multipart_file.mpg.2~IIRaVe6DNEp7nyrknzxDHy7vtoh3YF6.3 2024-09-14T11:25:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.346+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.101__multipart_file.mpg.2~IIRaVe6DNEp7nyrknzxDHy7vtoh3YF6.4 2024-09-14T11:25:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.346+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.101__multipart_file.mpg.2~IIRaVe6DNEp7nyrknzxDHy7vtoh3YF6.5 2024-09-14T11:25:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.346+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6935453845627138392', time=2024-09-14T13:24:44.459682+0000, chain.objs.size()=1 2024-09-14T11:25:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.346+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.113__shadow_.SS7oRoSxchCAgdg1Dpz8xXfQ-3Wk6om_0 2024-09-14T11:25:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.346+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8462143507490010606', time=2024-09-14T13:24:49.377358+0000, chain.objs.size()=1 2024-09-14T11:25:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.346+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.120__shadow_.U2I0c8HSMeXbkj-qjgvgmbDIpFJXgCp_0 2024-09-14T11:25:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.346+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2914808337234189931', time=2024-09-14T13:24:56.895192+0000, chain.objs.size()=1 2024-09-14T11:25:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.346+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.131__shadow_.JwnO_hcsKuCyoPMR4YJR8xOXbwuiT_l_0 2024-09-14T11:25:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.346+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15551323862344094737', time=2024-09-14T13:25:00.698411+0000, chain.objs.size()=1 2024-09-14T11:25:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.346+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.138__shadow_.lttMjU2LE7K0-KkEeUYCpSj3FOkvShD_0 2024-09-14T11:25:16.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.350+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.353+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:25:16.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.354+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.354+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.355+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:25:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.355+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2740705849782849165', time=2024-09-14T13:22:24.460317+0000, chain.objs.size()=5 2024-09-14T11:25:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.355+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.92__multipart_key1.2~IsIQ8zpOH0-VG17vOwZidW0tOqFCeox.1 2024-09-14T11:25:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.355+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.92__multipart_key1.2~IsIQ8zpOH0-VG17vOwZidW0tOqFCeox.2 2024-09-14T11:25:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.355+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.92__multipart_key1.2~IsIQ8zpOH0-VG17vOwZidW0tOqFCeox.3 2024-09-14T11:25:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.355+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.92__multipart_key1.2~IsIQ8zpOH0-VG17vOwZidW0tOqFCeox.4 2024-09-14T11:25:16.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.355+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.92__multipart_key1.2~IsIQ8zpOH0-VG17vOwZidW0tOqFCeox.5 2024-09-14T11:25:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.355+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.712932672261773038', time=2024-09-14T13:24:45.774543+0000, chain.objs.size()=1 2024-09-14T11:25:16.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.355+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.115__shadow_.BXRmhVxT3dUivmYc-ksYVO-ovAaxdGJ_0 2024-09-14T11:25:16.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.357+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.359+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:25:16.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.360+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.361+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.361+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:25:16.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.361+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5510679364761303109', time=2024-09-14T13:24:54.093504+0000, chain.objs.size()=1 2024-09-14T11:25:16.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.361+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.127__shadow_.gd5YctH3ATaL1nNQAM8Itp4QtViMyzU_0 2024-09-14T11:25:16.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.361+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6650920281311871833', time=2024-09-14T13:24:56.841156+0000, chain.objs.size()=1 2024-09-14T11:25:16.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.361+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.131__shadow_.IMZr2IWJd8p7Ht5kxUMX2u_YYAHIoAC_0 2024-09-14T11:25:16.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.361+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9800731463605165876', time=2024-09-14T13:24:58.142329+0000, chain.objs.size()=1 2024-09-14T11:25:16.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.361+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.133__shadow_.jH08OC1g-irj5jyzK8gMQ2cSwCQYK8z_0 2024-09-14T11:25:16.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.361+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3280763240907202329', time=2024-09-14T13:24:58.758287+0000, chain.objs.size()=1 2024-09-14T11:25:16.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.361+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.134__shadow_.H7PBPPdqJwmIM4CYcXCcUoJUyYutERQ_0 2024-09-14T11:25:16.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.363+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.365+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:25:16.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.366+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.367+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.367+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-14T11:25:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.367+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14481107145908920255', time=2024-09-14T13:22:05.806882+0000, chain.objs.size()=2 2024-09-14T11:25:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.367+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.84__shadow_.SvWji97lKKULh-1Ln7OnspAaEIaGBsq_0 2024-09-14T11:25:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.367+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.84__shadow_.SvWji97lKKULh-1Ln7OnspAaEIaGBsq_1 2024-09-14T11:25:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.367+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13545569651219091183', time=2024-09-14T13:22:37.552140+0000, chain.objs.size()=5 2024-09-14T11:25:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.367+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__multipart_key1.2~PP3FrwbXFT8ZHLYoUqdDW3epH3wSz8b.1 2024-09-14T11:25:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.367+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__multipart_key1.2~PP3FrwbXFT8ZHLYoUqdDW3epH3wSz8b.2 2024-09-14T11:25:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.367+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__multipart_key1.2~PP3FrwbXFT8ZHLYoUqdDW3epH3wSz8b.3 2024-09-14T11:25:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.367+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__multipart_key1.2~PP3FrwbXFT8ZHLYoUqdDW3epH3wSz8b.4 2024-09-14T11:25:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.367+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__multipart_key1.2~PP3FrwbXFT8ZHLYoUqdDW3epH3wSz8b.5 2024-09-14T11:25:16.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.367+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12155455769684281225', time=2024-09-14T13:22:40.048579+0000, chain.objs.size()=5 2024-09-14T11:25:16.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.367+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__multipart_key1.2~NgwWAbk4AQH5RkuY_n3l-9T3qo8_I9W.1 2024-09-14T11:25:16.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.367+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__multipart_key1.2~NgwWAbk4AQH5RkuY_n3l-9T3qo8_I9W.2 2024-09-14T11:25:16.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.367+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__multipart_key1.2~NgwWAbk4AQH5RkuY_n3l-9T3qo8_I9W.3 2024-09-14T11:25:16.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.368+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__multipart_key1.2~NgwWAbk4AQH5RkuY_n3l-9T3qo8_I9W.4 2024-09-14T11:25:16.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.368+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__multipart_key1.2~NgwWAbk4AQH5RkuY_n3l-9T3qo8_I9W.5 2024-09-14T11:25:16.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.371+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13172174300578632276', time=2024-09-14T13:24:26.047431+0000, chain.objs.size()=5 2024-09-14T11:25:16.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.371+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.104__multipart_key1.2~1JaOPpzc_8aU4IAOPTW3eCh6IU_fkOC.1 2024-09-14T11:25:16.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.371+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.104__multipart_key1.2~1JaOPpzc_8aU4IAOPTW3eCh6IU_fkOC.2 2024-09-14T11:25:16.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.372+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.104__multipart_key1.2~1JaOPpzc_8aU4IAOPTW3eCh6IU_fkOC.3 2024-09-14T11:25:16.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.374+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.104__multipart_key1.2~1JaOPpzc_8aU4IAOPTW3eCh6IU_fkOC.4 2024-09-14T11:25:16.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.374+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.104__multipart_key1.2~1JaOPpzc_8aU4IAOPTW3eCh6IU_fkOC.5 2024-09-14T11:25:16.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.374+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9583853419290486023', time=2024-09-14T13:24:45.076480+0000, chain.objs.size()=1 2024-09-14T11:25:16.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.374+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.114__shadow_.dAV75Fo3xsxtmp_oEzLWcGLSci6KnRe_0 2024-09-14T11:25:16.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.374+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5763762306047850959', time=2024-09-14T13:24:47.280774+0000, chain.objs.size()=1 2024-09-14T11:25:16.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.374+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.117__shadow_.Uy2jruNIIzXr5utHT9jWfZ1cZpDMj4x_0 2024-09-14T11:25:16.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.374+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9485976112527978939', time=2024-09-14T13:25:02.565744+0000, chain.objs.size()=1 2024-09-14T11:25:16.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.374+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.141__shadow_.AfJlRZaGFoZMUV2bYEfj0HH3q9E_hlL_0 2024-09-14T11:25:16.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.378+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.380+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:25:16.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.382+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.382+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.383+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:25:16.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.383+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8588636461803050355', time=2024-09-14T13:24:50.725516+0000, chain.objs.size()=1 2024-09-14T11:25:16.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.383+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.122__shadow_.sAcQn7cEOBMIsh9_rDxLV2MsJP3nhQu_0 2024-09-14T11:25:16.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.383+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15113300795541910944', time=2024-09-14T13:24:51.407176+0000, chain.objs.size()=1 2024-09-14T11:25:16.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.383+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.123__shadow_.va4L3iID481U-fFqtjBnQlXJPuGG-Rt_0 2024-09-14T11:25:16.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.383+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7782801871958595825', time=2024-09-14T13:24:51.460796+0000, chain.objs.size()=1 2024-09-14T11:25:16.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.383+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.123__shadow_.40f-2Kdta8TGc1KK9iLNI3A0-Ijt0qu_0 2024-09-14T11:25:16.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.383+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1252702274702902413', time=2024-09-14T13:24:53.450155+0000, chain.objs.size()=1 2024-09-14T11:25:16.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.383+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.126__shadow_.W91rHF53kaqW5jSrUYizi7354B8a414_0 2024-09-14T11:25:16.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.383+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2082303430304690858', time=2024-09-14T13:25:15.588685+0000, chain.objs.size()=1 2024-09-14T11:25:16.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.383+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.145__shadow_.3gvBg-I1Dn8t1VFpdkm5bIZAX6Cz1W2_0 2024-09-14T11:25:16.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.385+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.387+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:25:16.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.388+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.389+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.389+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:25:16.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.389+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4936881198142505357', time=2024-09-14T13:24:46.500014+0000, chain.objs.size()=1 2024-09-14T11:25:16.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.389+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.116__shadow_.mgsGiB3nlhMRJC4yFTPRfxZf_CYlS59_0 2024-09-14T11:25:16.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.389+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4703645634286331138', time=2024-09-14T13:24:54.148056+0000, chain.objs.size()=1 2024-09-14T11:25:16.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.389+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.127__shadow_.2PN1odD6oJsxutAnp7QmnGpR6oAqfbc_0 2024-09-14T11:25:16.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.390+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.392+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:25:16.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.394+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.394+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.394+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:25:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.394+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='2~jppD3yU9RsZ5oAyhm58BUaGlMOnFf-f', time=2024-09-14T13:23:37.403097+0000, chain.objs.size()=5 2024-09-14T11:25:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.394+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.102__multipart_key1.2~jppD3yU9RsZ5oAyhm58BUaGlMOnFf-f.7 2024-09-14T11:25:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.394+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.102__multipart_key1.2~jppD3yU9RsZ5oAyhm58BUaGlMOnFf-f.8 2024-09-14T11:25:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.394+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.102__multipart_key1.2~jppD3yU9RsZ5oAyhm58BUaGlMOnFf-f.9 2024-09-14T11:25:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.394+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.102__multipart_key1.2~jppD3yU9RsZ5oAyhm58BUaGlMOnFf-f.10 2024-09-14T11:25:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.394+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.102__multipart_key1.2~jppD3yU9RsZ5oAyhm58BUaGlMOnFf-f.11 2024-09-14T11:25:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.394+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1789728043732571517', time=2024-09-14T13:24:54.121090+0000, chain.objs.size()=1 2024-09-14T11:25:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.394+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.127__shadow_.wIN5eYH2F1FmKncyLgIbW1j2wWuNz1i_0 2024-09-14T11:25:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.394+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13699165809316023468', time=2024-09-14T13:24:54.822257+0000, chain.objs.size()=1 2024-09-14T11:25:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.394+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.128__shadow_.9487Up_rW8S0XiukyWSKgiCK8_NyZTO_0 2024-09-14T11:25:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.394+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6507967820513307489', time=2024-09-14T13:24:55.493309+0000, chain.objs.size()=1 2024-09-14T11:25:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.394+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.129__shadow_.dlEj2Ot44_1dQL2P4E7wxBZkRlOmrdq_0 2024-09-14T11:25:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.394+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12753564178307647961', time=2024-09-14T13:25:02.043749+0000, chain.objs.size()=1 2024-09-14T11:25:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.394+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.140__shadow_.O3FPb2umlNxY6S6xODNvVPmT0NYXNLm_0 2024-09-14T11:25:16.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.399+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.402+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:25:16.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.403+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.404+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.404+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:25:16.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.404+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2759649909065123817', time=2024-09-14T13:24:47.223111+0000, chain.objs.size()=1 2024-09-14T11:25:16.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.404+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.117__shadow_.J4T5I1gECUx9gV1cWXKPE2CE9OJu09F_0 2024-09-14T11:25:16.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.404+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8615227349288839787', time=2024-09-14T13:24:49.994818+0000, chain.objs.size()=1 2024-09-14T11:25:16.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.404+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.121__shadow_.Y1Rn0q8Eo0E6wF1aC5Gbvd5Fmh_MDwi_0 2024-09-14T11:25:16.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.404+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4455419679742099112', time=2024-09-14T13:24:50.784394+0000, chain.objs.size()=1 2024-09-14T11:25:16.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.404+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.122__shadow_.XSrCU9P3GbcRrkTeWJ5f2VD-BaDlok__0 2024-09-14T11:25:16.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.406+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.408+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:25:16.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.409+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.410+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.410+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:25:16.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.410+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14366031154414913746', time=2024-09-14T13:24:48.627229+0000, chain.objs.size()=1 2024-09-14T11:25:16.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.410+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.119__shadow_.KJ7ZQtegXsr4ncdWh6Zd89BVQl5CU6q_0 2024-09-14T11:25:16.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.410+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11721501559105645904', time=2024-09-14T13:24:53.423805+0000, chain.objs.size()=1 2024-09-14T11:25:16.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.410+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.126__shadow_.ZtM4w8aQgNkd5cNUJQf7pIPPHknmS8Y_0 2024-09-14T11:25:16.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.410+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14089512351703291716', time=2024-09-14T13:24:58.813336+0000, chain.objs.size()=1 2024-09-14T11:25:16.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.410+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.134__shadow_.Ixzu0_Ev3c-SGzRVK9r_WmvYyci1RlT_0 2024-09-14T11:25:16.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.410+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15214340900169289493', time=2024-09-14T13:25:15.556624+0000, chain.objs.size()=5 2024-09-14T11:25:16.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.410+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.145__multipart_key1/data/file.mpg.2~yFcQS_SvE7J4w57bOP6h2r1MTxmkcZ5.1 2024-09-14T11:25:16.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.410+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.145__multipart_key1/data/file.mpg.2~yFcQS_SvE7J4w57bOP6h2r1MTxmkcZ5.2 2024-09-14T11:25:16.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.410+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.145__multipart_key1/data/file.mpg.2~yFcQS_SvE7J4w57bOP6h2r1MTxmkcZ5.3 2024-09-14T11:25:16.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.410+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.145__multipart_key1/data/file.mpg.2~yFcQS_SvE7J4w57bOP6h2r1MTxmkcZ5.4 2024-09-14T11:25:16.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.410+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.145__multipart_key1/data/file.mpg.2~yFcQS_SvE7J4w57bOP6h2r1MTxmkcZ5.5 2024-09-14T11:25:16.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.414+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.417+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:25:16.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.418+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.419+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.419+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:25:16.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.419+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12789123534495826899', time=2024-09-14T13:22:06.337189+0000, chain.objs.size()=1 2024-09-14T11:25:16.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.419+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.85__shadow_.MNFq_0NXz19MFauAM_J3B72KuTh3WUv_0 2024-09-14T11:25:16.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.419+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13355076321461710044', time=2024-09-14T13:24:52.070601+0000, chain.objs.size()=1 2024-09-14T11:25:16.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.419+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.124__shadow_.uBm0Uj7_UwRN7WuWTLB6CKVMRUb9aVO_0 2024-09-14T11:25:16.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.419+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4195926385177929328', time=2024-09-14T13:24:57.535827+0000, chain.objs.size()=1 2024-09-14T11:25:16.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.419+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.132__shadow_.gJ5IhVXqiK3xa0r2AMoeFZtobP6xsny_0 2024-09-14T11:25:16.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.419+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12424373724324587658', time=2024-09-14T13:24:58.114975+0000, chain.objs.size()=1 2024-09-14T11:25:16.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.419+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.133__shadow_.wMk7l8GXUzPZPP_ecOjJ4C1tktcixjk_0 2024-09-14T11:25:16.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.421+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.424+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:25:16.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.425+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.426+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.426+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:25:16.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.426+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7122623987153314855', time=2024-09-14T13:24:16.554108+0000, chain.objs.size()=5 2024-09-14T11:25:16.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.426+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__multipart_key1.2~SdIIOFA6heAs8B1trLuexcYsD-3ltAm.1 2024-09-14T11:25:16.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.426+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__shadow_key1.2~SdIIOFA6heAs8B1trLuexcYsD-3ltAm.1_1 2024-09-14T11:25:16.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.426+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__multipart_key1.2~SdIIOFA6heAs8B1trLuexcYsD-3ltAm.2 2024-09-14T11:25:16.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.426+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__shadow_key1.2~SdIIOFA6heAs8B1trLuexcYsD-3ltAm.2_1 2024-09-14T11:25:16.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.426+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__multipart_key1.2~SdIIOFA6heAs8B1trLuexcYsD-3ltAm.3 2024-09-14T11:25:16.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.426+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2734285111193036523', time=2024-09-14T13:24:44.402341+0000, chain.objs.size()=1 2024-09-14T11:25:16.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.426+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.113__shadow_.qneV5Yz7BKY344bIx69oEbzm_choMwX_0 2024-09-14T11:25:16.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.426+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.623875345282799163', time=2024-09-14T13:24:46.527258+0000, chain.objs.size()=1 2024-09-14T11:25:16.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.426+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.116__shadow_.wDay2XsoCfx7ketd15-HDC763hFE8Mr_0 2024-09-14T11:25:16.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.430+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.432+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:25:16.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.433+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.434+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.434+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:25:16.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.434+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11359348768477397589', time=2024-09-14T13:22:24.174759+0000, chain.objs.size()=5 2024-09-14T11:25:16.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.434+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.92__multipart_key1.2~IsIQ8zpOH0-VG17vOwZidW0tOqFCeox.1 2024-09-14T11:25:16.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.434+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.92__multipart_key1.2~IsIQ8zpOH0-VG17vOwZidW0tOqFCeox.2 2024-09-14T11:25:16.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.434+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.92__multipart_key1.2~IsIQ8zpOH0-VG17vOwZidW0tOqFCeox.3 2024-09-14T11:25:16.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.434+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.92__multipart_key1.2~IsIQ8zpOH0-VG17vOwZidW0tOqFCeox.4 2024-09-14T11:25:16.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.434+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.92__multipart_key1.2~IsIQ8zpOH0-VG17vOwZidW0tOqFCeox.5 2024-09-14T11:25:16.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.434+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5626289123935437739', time=2024-09-14T13:24:45.855189+0000, chain.objs.size()=1 2024-09-14T11:25:16.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.434+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.115__shadow_.Nl_Qv6sC-Jb4cSZ-chj9xhd5F8ZWbrO_0 2024-09-14T11:25:16.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.434+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13010705060072941684', time=2024-09-14T13:24:56.256084+0000, chain.objs.size()=1 2024-09-14T11:25:16.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.434+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.130__shadow_.v1RKh1s4qrodlXS4fVK0gchoea9fiv-_0 2024-09-14T11:25:16.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.438+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.440+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:25:16.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.442+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.442+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.443+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:25:16.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.443+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1619854817903615605', time=2024-09-14T13:22:35.184288+0000, chain.objs.size()=5 2024-09-14T11:25:16.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.443+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__multipart_key1.2~CuDJQv5L5Ms0rpTMr2MKtskYhcwup0U.1 2024-09-14T11:25:16.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.443+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__multipart_key1.2~CuDJQv5L5Ms0rpTMr2MKtskYhcwup0U.2 2024-09-14T11:25:16.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.443+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__multipart_key1.2~CuDJQv5L5Ms0rpTMr2MKtskYhcwup0U.3 2024-09-14T11:25:16.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.443+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__multipart_key1.2~CuDJQv5L5Ms0rpTMr2MKtskYhcwup0U.4 2024-09-14T11:25:16.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.443+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__multipart_key1.2~CuDJQv5L5Ms0rpTMr2MKtskYhcwup0U.5 2024-09-14T11:25:16.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.443+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17304943109750053201', time=2024-09-14T13:23:02.201058+0000, chain.objs.size()=5 2024-09-14T11:25:16.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.443+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.99__multipart_key1.2~t5boTJong0P02fGayQxU6nhd1JJktM9.1 2024-09-14T11:25:16.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.443+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.99__multipart_key1.2~t5boTJong0P02fGayQxU6nhd1JJktM9.2 2024-09-14T11:25:16.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.443+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.99__multipart_key1.2~t5boTJong0P02fGayQxU6nhd1JJktM9.3 2024-09-14T11:25:16.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.443+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.99__multipart_key1.2~t5boTJong0P02fGayQxU6nhd1JJktM9.4 2024-09-14T11:25:16.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.443+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.99__multipart_key1.2~t5boTJong0P02fGayQxU6nhd1JJktM9.5 2024-09-14T11:25:16.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.443+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1576805328029992291', time=2024-09-14T13:24:52.732912+0000, chain.objs.size()=1 2024-09-14T11:25:16.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.443+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.125__shadow_.iTg5KW1WQIut7r6ZBz-Fyr_sCbxnlj3_0 2024-09-14T11:25:16.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.443+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4915263930296168245', time=2024-09-14T13:24:54.767194+0000, chain.objs.size()=1 2024-09-14T11:25:16.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.443+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.128__shadow_.y1VeOjRDTFqG-KC4kyFpblkNe5Ucy48_0 2024-09-14T11:25:16.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.446+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12524371799454607052', time=2024-09-14T13:25:01.105518+0000, chain.objs.size()=1 2024-09-14T11:25:16.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.446+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.139__shadow_.ea_aZfpIM1fCeySEmAspRFyIbUSwax7_0 2024-09-14T11:25:16.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.450+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.452+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:25:16.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.453+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.454+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.454+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:25:16.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.454+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.517740514875405006', time=2024-09-14T13:24:49.349652+0000, chain.objs.size()=1 2024-09-14T11:25:16.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.454+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.120__shadow_.7sd03soyX7rVMs7fyfDxc_Pw96dbBOZ_0 2024-09-14T11:25:16.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.454+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13824190996461864106', time=2024-09-14T13:24:50.752984+0000, chain.objs.size()=1 2024-09-14T11:25:16.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.454+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.122__shadow_.s-HeMT4P8AdKIWjXXu9KUxUrPfWiQVj_0 2024-09-14T11:25:16.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.456+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.458+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:25:16.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.459+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.460+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.460+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:25:16.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.460+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11501354003333584110', time=2024-09-14T13:22:09.060271+0000, chain.objs.size()=1 2024-09-14T11:25:16.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.460+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.91__shadow_.yjZG0we9S0i08rZFJjplfA3VpPNEULy_0 2024-09-14T11:25:16.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.460+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17201682951366735599', time=2024-09-14T13:24:41.451998+0000, chain.objs.size()=1 2024-09-14T11:25:16.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.460+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.107__shadow_.M0oWa7QOtHFxklLBwxtOWm7wGIfCk5S_0 2024-09-14T11:25:16.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.460+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11246422216629417781', time=2024-09-14T13:24:51.434076+0000, chain.objs.size()=1 2024-09-14T11:25:16.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.460+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.123__shadow_.nA-qtyVlYuHRUckQwM0aXhvZ6wlmXIX_0 2024-09-14T11:25:16.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.460+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15573749694176043109', time=2024-09-14T13:24:51.488241+0000, chain.objs.size()=1 2024-09-14T11:25:16.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.460+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.123__shadow_.wFBgk-f3hWu5AQxZei2PdKfzl5MouMS_0 2024-09-14T11:25:16.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.460+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7794416400524320965', time=2024-09-14T13:24:56.163234+0000, chain.objs.size()=1 2024-09-14T11:25:16.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.460+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.130__shadow_.bRSjoqJazRTXVDkqp232lwVDtnPzh2K_0 2024-09-14T11:25:16.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.460+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16701461347900396372', time=2024-09-14T13:24:57.480365+0000, chain.objs.size()=1 2024-09-14T11:25:16.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.460+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.132__shadow_.E6A1Iz-yyowHU5HQiwFLP_BEBn3OTY8_0 2024-09-14T11:25:16.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.463+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.466+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:25:16.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.467+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.468+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.468+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:25:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.468+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11892463078034236756', time=2024-09-14T13:22:54.580682+0000, chain.objs.size()=5 2024-09-14T11:25:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.468+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__multipart_key1.2~pFwMIGqPbL89A1jBJInQaCnnny42Hn3.1 2024-09-14T11:25:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.468+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__shadow_key1.2~pFwMIGqPbL89A1jBJInQaCnnny42Hn3.1_1 2024-09-14T11:25:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.468+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__multipart_key1.2~pFwMIGqPbL89A1jBJInQaCnnny42Hn3.2 2024-09-14T11:25:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.468+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__shadow_key1.2~pFwMIGqPbL89A1jBJInQaCnnny42Hn3.2_1 2024-09-14T11:25:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.468+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__multipart_key1.2~pFwMIGqPbL89A1jBJInQaCnnny42Hn3.3 2024-09-14T11:25:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.468+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14005632315454249940', time=2024-09-14T13:23:11.750135+0000, chain.objs.size()=5 2024-09-14T11:25:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.468+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.100__multipart_key1.2~fXVJ2bgpXM0Y-1bvZePyA2BRQK4zV-s.1 2024-09-14T11:25:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.468+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.100__multipart_key1.2~fXVJ2bgpXM0Y-1bvZePyA2BRQK4zV-s.2 2024-09-14T11:25:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.468+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.100__multipart_key1.2~fXVJ2bgpXM0Y-1bvZePyA2BRQK4zV-s.3 2024-09-14T11:25:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.468+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.100__multipart_key1.2~fXVJ2bgpXM0Y-1bvZePyA2BRQK4zV-s.4 2024-09-14T11:25:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.468+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.100__multipart_key1.2~fXVJ2bgpXM0Y-1bvZePyA2BRQK4zV-s.5 2024-09-14T11:25:16.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.468+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9330865754009035971', time=2024-09-14T13:24:46.580987+0000, chain.objs.size()=1 2024-09-14T11:25:16.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.468+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.116__shadow_.Bqf4Cx3yBFMtAkNYyb1-TJvr7XgSDHu_0 2024-09-14T11:25:16.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.468+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15040654291213192154', time=2024-09-14T13:25:09.727142+0000, chain.objs.size()=5 2024-09-14T11:25:16.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.468+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.144__multipart_key1.2~7Js1n67W_k0R5o6vAHDU9sojx58bcg-.1 2024-09-14T11:25:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.471+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.144__multipart_key1.2~7Js1n67W_k0R5o6vAHDU9sojx58bcg-.2 2024-09-14T11:25:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.471+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.144__multipart_key1.2~7Js1n67W_k0R5o6vAHDU9sojx58bcg-.3 2024-09-14T11:25:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.471+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.144__multipart_key1.2~7Js1n67W_k0R5o6vAHDU9sojx58bcg-.4 2024-09-14T11:25:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.471+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.144__multipart_key1.2~7Js1n67W_k0R5o6vAHDU9sojx58bcg-.5 2024-09-14T11:25:16.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.477+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.479+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:25:16.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.480+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.481+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.481+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:25:16.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.481+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15643842981528527620', time=2024-09-14T13:21:59.439590+0000, chain.objs.size()=1 2024-09-14T11:25:16.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.481+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.82__shadow_.KXql0lswUzh3TVRc3tuXOz3MGo-ZB6E_0 2024-09-14T11:25:16.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.481+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16898084462148698642', time=2024-09-14T13:24:47.195998+0000, chain.objs.size()=1 2024-09-14T11:25:16.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.481+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.117__shadow_.mTzt-Do--84FADEi2oz0LfyzvhMpDuj_0 2024-09-14T11:25:16.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.481+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3450499269374717430', time=2024-09-14T13:24:54.065594+0000, chain.objs.size()=1 2024-09-14T11:25:16.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.481+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.127__shadow_._QCbRdHFxJqFBD6v38I6GUNMnWYzboQ_0 2024-09-14T11:25:16.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.483+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.485+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:25:16.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.486+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.486+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.487+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:25:16.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.487+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17759914935180999473', time=2024-09-14T13:23:31.860861+0000, chain.objs.size()=1 2024-09-14T11:25:16.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.487+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.101__shadow_.1RGmE8L3nKmFFjwdULHm-Lv47kgrZZD_0 2024-09-14T11:25:16.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.487+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3662653278700093076', time=2024-09-14T13:24:16.753157+0000, chain.objs.size()=5 2024-09-14T11:25:16.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.487+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__multipart_key1.2~rZteyOdTaGWEhZrkGggB7aEwcE6iQHa.1 2024-09-14T11:25:16.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.487+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__shadow_key1.2~rZteyOdTaGWEhZrkGggB7aEwcE6iQHa.1_1 2024-09-14T11:25:16.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.487+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__multipart_key1.2~rZteyOdTaGWEhZrkGggB7aEwcE6iQHa.2 2024-09-14T11:25:16.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.487+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__shadow_key1.2~rZteyOdTaGWEhZrkGggB7aEwcE6iQHa.2_1 2024-09-14T11:25:16.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.487+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__multipart_key1.2~rZteyOdTaGWEhZrkGggB7aEwcE6iQHa.3 2024-09-14T11:25:16.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.487+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14028322740817029248', time=2024-09-14T13:24:22.557570+0000, chain.objs.size()=1 2024-09-14T11:25:16.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.487+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.104__shadow_.z6r2BzRJr4wcweMX6iuD2FMBytTaalF_0 2024-09-14T11:25:16.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.490+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.493+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:25:16.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.494+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.494+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.495+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-14T11:25:16.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.495+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6130733621685335481', time=2024-09-14T13:22:54.381228+0000, chain.objs.size()=5 2024-09-14T11:25:16.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.495+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__multipart_key1.2~kvNp2vy80ibnk_L3Gta0YgtKr-plglF.1 2024-09-14T11:25:16.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.495+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__shadow_key1.2~kvNp2vy80ibnk_L3Gta0YgtKr-plglF.1_1 2024-09-14T11:25:16.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.495+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__multipart_key1.2~kvNp2vy80ibnk_L3Gta0YgtKr-plglF.2 2024-09-14T11:25:16.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.495+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__shadow_key1.2~kvNp2vy80ibnk_L3Gta0YgtKr-plglF.2_1 2024-09-14T11:25:16.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.495+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95__multipart_key1.2~kvNp2vy80ibnk_L3Gta0YgtKr-plglF.3 2024-09-14T11:25:16.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.495+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13721010959172947481', time=2024-09-14T13:23:31.832743+0000, chain.objs.size()=5 2024-09-14T11:25:16.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.495+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.101__multipart_file2.mpg.2~eNA-0RCLwylz37Z5ThJMDtQEOYXdnfu.1 2024-09-14T11:25:16.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.495+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.101__multipart_file2.mpg.2~eNA-0RCLwylz37Z5ThJMDtQEOYXdnfu.2 2024-09-14T11:25:16.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.495+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.101__multipart_file2.mpg.2~eNA-0RCLwylz37Z5ThJMDtQEOYXdnfu.3 2024-09-14T11:25:16.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.495+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.101__multipart_file2.mpg.2~eNA-0RCLwylz37Z5ThJMDtQEOYXdnfu.4 2024-09-14T11:25:16.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.495+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.101__multipart_file2.mpg.2~eNA-0RCLwylz37Z5ThJMDtQEOYXdnfu.5 2024-09-14T11:25:16.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.495+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1882234037394218858', time=2024-09-14T13:23:31.888497+0000, chain.objs.size()=1 2024-09-14T11:25:16.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.495+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.101__shadow_.ZC__3jE8Mc5Z6OUBz0aKOaPQ7F_dU-t_0 2024-09-14T11:25:16.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.495+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12920551627387701661', time=2024-09-14T13:24:46.553706+0000, chain.objs.size()=1 2024-09-14T11:25:16.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.495+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.116__shadow_.rBVBqC263-8jP9cx35ogggkFNL-hQUt_0 2024-09-14T11:25:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.499+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4339195851403380526', time=2024-09-14T13:24:47.929443+0000, chain.objs.size()=1 2024-09-14T11:25:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.499+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.118__shadow_.4F1bV0XWW4k4rABDsW9pfPH2fL23qmQ_0 2024-09-14T11:25:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.499+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11715641648849169636', time=2024-09-14T13:24:48.599349+0000, chain.objs.size()=1 2024-09-14T11:25:16.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.499+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.119__shadow_.AO-LC2I2xx8H5j_IxiNXaANGySa-Wej_0 2024-09-14T11:25:16.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.500+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10796836919340057563', time=2024-09-14T13:24:53.396376+0000, chain.objs.size()=1 2024-09-14T11:25:16.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.500+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.126__shadow_.CHE8E-snMgyekdfVADPwGjzcwKRd08r_0 2024-09-14T11:25:16.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.500+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15968485916469535310', time=2024-09-14T13:24:57.508051+0000, chain.objs.size()=1 2024-09-14T11:25:16.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.500+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.132__shadow_.kT_sgai3MjI3HxubkEBmkLPFWB0DlOJ_0 2024-09-14T11:25:16.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.502+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.505+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:25:16.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.506+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.507+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.507+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:25:16.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.507+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.967081770213286304', time=2024-09-14T13:24:47.250624+0000, chain.objs.size()=1 2024-09-14T11:25:16.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.507+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.117__shadow_.QcjaPxUZJjZS_3FU0UE_rsZ2P1gs4FT_0 2024-09-14T11:25:16.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.507+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3850191622063955913', time=2024-09-14T13:24:47.957322+0000, chain.objs.size()=1 2024-09-14T11:25:16.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.507+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.118__shadow_.l7rZEIyG6OYmK1KyBNvkVljrb56sVD7_0 2024-09-14T11:25:16.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.508+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.511+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:25:16.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.512+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.512+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.512+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:25:16.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.512+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3775351729492439777', time=2024-09-14T13:24:53.369027+0000, chain.objs.size()=1 2024-09-14T11:25:16.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.512+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.126__shadow_.jmAMh04fayY8nj_XIF8zO6jbbRgBSjq_0 2024-09-14T11:25:16.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.512+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6572065378943165747', time=2024-09-14T13:24:58.175009+0000, chain.objs.size()=1 2024-09-14T11:25:16.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.512+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.133__shadow_.CUExPHYYKfNWc_KDIsj3bodDOSTpiVH_0 2024-09-14T11:25:16.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.514+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.516+0000 7f30c6013800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:25:16.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.517+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.518+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.518+0000 7f30c6013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:25:16.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.518+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7626088969144023466', time=2024-09-14T13:23:52.379274+0000, chain.objs.size()=5 2024-09-14T11:25:16.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.518+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__multipart_key1.2~KtzEOicbML7wybKeyZvzdWZAStIdRSu.1 2024-09-14T11:25:16.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.518+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__multipart_key1.2~KtzEOicbML7wybKeyZvzdWZAStIdRSu.2 2024-09-14T11:25:16.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.518+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__multipart_key1.2~KtzEOicbML7wybKeyZvzdWZAStIdRSu.3 2024-09-14T11:25:16.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.518+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__multipart_key1.2~KtzEOicbML7wybKeyZvzdWZAStIdRSu.4 2024-09-14T11:25:16.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.518+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103__multipart_key1.2~KtzEOicbML7wybKeyZvzdWZAStIdRSu.5 2024-09-14T11:25:16.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.518+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6734757908721967765', time=2024-09-14T13:24:45.102986+0000, chain.objs.size()=1 2024-09-14T11:25:16.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.518+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.114__shadow_.qKviOYz3niUVtzk7pRFfTe-U806EaO6_0 2024-09-14T11:25:16.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.518+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14362656894327919018', time=2024-09-14T13:24:45.802105+0000, chain.objs.size()=1 2024-09-14T11:25:16.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.518+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.115__shadow_.WHAnn_DSnyydUL2pgnE2LPwk59kX0O2_0 2024-09-14T11:25:16.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.518+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.48950286391224249', time=2024-09-14T13:24:47.901034+0000, chain.objs.size()=1 2024-09-14T11:25:16.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.518+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.118__shadow_.cHmXmqrVpHkQjvbPB4J8x9oIr678XIA_0 2024-09-14T11:25:16.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.518+0000 7f30c6013800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16877548935378114367', time=2024-09-14T13:24:56.225511+0000, chain.objs.size()=1 2024-09-14T11:25:16.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.518+0000 7f30c6013800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.130__shadow_.qd9-0kRYg1wwSdyi12Bh9ehWT1a6KIC_0 2024-09-14T11:25:16.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.522+0000 7f30c6013800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:16.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.526+0000 7f2f777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.528+0000 7f30c6013800 20 remove_watcher() i=0 2024-09-14T11:25:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.528+0000 7f30c6013800 2 removed watcher, disabling cache 2024-09-14T11:25:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.528+0000 7f30c6013800 20 remove_watcher() i=1 2024-09-14T11:25:16.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.530+0000 7f30c6013800 20 remove_watcher() i=2 2024-09-14T11:25:16.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.531+0000 7f30c6013800 20 remove_watcher() i=3 2024-09-14T11:25:16.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.531+0000 7f30c6013800 20 remove_watcher() i=4 2024-09-14T11:25:16.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.532+0000 7f30c6013800 20 remove_watcher() i=5 2024-09-14T11:25:16.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.533+0000 7f30c6013800 20 remove_watcher() i=6 2024-09-14T11:25:16.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.534+0000 7f30c6013800 20 remove_watcher() i=7 2024-09-14T11:25:16.546 DEBUG:teuthology.orchestra.run.smithi050:> radosgw-admin gc process --include-all 2024-09-14T11:25:16.599 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:16.599 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:16.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.639+0000 7fa36a323800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.641+0000 7fa36a323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.641+0000 7fa36a323800 20 realm 2024-09-14T11:25:16.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.641+0000 7fa36a323800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.641+0000 7fa36a323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.641+0000 7fa36a323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:16.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.641+0000 7fa36a323800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.641+0000 7fa36a323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.641+0000 7fa36a323800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.642+0000 7fa36a323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:16.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.642+0000 7fa36a323800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.642+0000 7fa36a323800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:16.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.642+0000 7fa36a323800 20 searching for the correct realm 2024-09-14T11:25:16.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.645+0000 7fa36580b640 0 -- 172.21.15.50:0/1611852913 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fa360066fe0 msgr2=0x7fa36006c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:16.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.850+0000 7fa36580b640 0 -- 172.21.15.50:0/1611852913 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x563d2d3a23e0 msgr2=0x563d2d3a47d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:16.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.854+0000 7fa36a323800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:25:16.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.854+0000 7fa36a323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:16.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.854+0000 7fa36a323800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:25:16.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.854+0000 7fa36a323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:16.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.854+0000 7fa36a323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:16.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.854+0000 7fa36a323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:16.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.854+0000 7fa36a323800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.854+0000 7fa36a323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.854+0000 7fa36a323800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.855+0000 7fa36a323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:16.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.855+0000 7fa36a323800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.855+0000 7fa36a323800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:16.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.855+0000 7fa36a323800 20 zone default found 2024-09-14T11:25:16.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.855+0000 7fa36a323800 4 Realm: () 2024-09-14T11:25:16.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.855+0000 7fa36a323800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:25:16.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.855+0000 7fa36a323800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:25:16.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.855+0000 7fa36a323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:16.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.855+0000 7fa36a323800 20 zonegroup default 2024-09-14T11:25:16.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.855+0000 7fa36a323800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.855+0000 7fa36a323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.856+0000 7fa36a323800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.856+0000 7fa36a323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.856+0000 7fa36a323800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.856+0000 7fa36a323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.856+0000 7fa36a323800 20 started sync module instance, tier type = 2024-09-14T11:25:16.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.856+0000 7fa36a323800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:25:16.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.865+0000 7fa36a323800 20 add_watcher() i=0 2024-09-14T11:25:16.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.865+0000 7fa36a323800 20 add_watcher() i=1 2024-09-14T11:25:16.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.865+0000 7fa36a323800 20 add_watcher() i=2 2024-09-14T11:25:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.865+0000 7fa36a323800 20 add_watcher() i=3 2024-09-14T11:25:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.865+0000 7fa36a323800 20 add_watcher() i=4 2024-09-14T11:25:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.865+0000 7fa36a323800 20 add_watcher() i=5 2024-09-14T11:25:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.865+0000 7fa36a323800 20 add_watcher() i=6 2024-09-14T11:25:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.866+0000 7fa36a323800 20 add_watcher() i=7 2024-09-14T11:25:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.866+0000 7fa36a323800 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:16.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.867+0000 7fa21cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:16.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.868+0000 7fa36a323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:16.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.868+0000 7fa36a323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:16.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.902+0000 7fa1977fe640 20 reqs_thread_entry: start 2024-09-14T11:25:16.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.902+0000 7fa36a323800 20 init_complete bucket index max shards: 11 2024-09-14T11:25:16.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.902+0000 7fa36a323800 20 Filter name: none 2024-09-14T11:25:16.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.902+0000 7fa1957fa640 20 reqs_thread_entry: start 2024-09-14T11:25:16.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.902+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:25:16.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.904+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.904+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.905+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.905+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:25:16.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.907+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.907+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.908+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.909+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:25:16.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.911+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.911+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.911+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.912+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:25:16.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.913+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.914+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.914+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.915+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:25:16.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.916+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.917+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.917+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.918+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:25:16.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.919+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.920+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.920+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.921+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:25:16.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.922+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.923+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.923+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.924+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:25:16.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.925+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.926+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.926+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.927+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:25:16.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.928+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.929+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.929+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.930+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:25:16.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.931+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.932+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.932+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.933+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:25:16.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.934+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.935+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.935+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.936+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:25:16.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.937+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.938+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.938+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.939+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:25:16.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.940+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.940+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.941+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.942+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:25:16.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.943+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.943+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.943+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.944+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:25:16.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.946+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.946+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.947+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.947+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:25:16.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.949+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.949+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.950+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.950+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:25:16.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.952+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.952+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.952+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.953+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:25:16.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.955+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.955+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.955+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.957+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:25:16.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.958+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.958+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.959+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.959+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:25:16.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.961+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.961+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.962+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.963+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:25:16.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.964+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.964+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.965+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.966+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:25:16.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.967+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.967+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.968+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.969+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:25:16.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.970+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.970+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.971+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.972+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:25:16.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.973+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.973+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.974+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.975+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:25:16.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.976+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.977+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.977+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.978+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:25:16.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.979+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.980+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.980+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.981+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:25:16.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.982+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.983+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.983+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.984+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:25:16.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.985+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.986+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.986+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.987+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:25:16.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.988+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.989+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.989+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.990+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:25:16.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.991+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.992+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.992+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.993+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:25:16.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.994+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.995+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.995+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.996+0000 7fa36a323800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:25:16.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.997+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.997+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:16.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.998+0000 7fa36a323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:16.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:16.999+0000 7fa21cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:17.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:17.001+0000 7fa36a323800 20 remove_watcher() i=0 2024-09-14T11:25:17.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:17.001+0000 7fa36a323800 2 removed watcher, disabling cache 2024-09-14T11:25:17.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:17.002+0000 7fa36a323800 20 remove_watcher() i=1 2024-09-14T11:25:17.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:17.003+0000 7fa36a323800 20 remove_watcher() i=2 2024-09-14T11:25:17.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:17.004+0000 7fa36a323800 20 remove_watcher() i=3 2024-09-14T11:25:17.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:17.005+0000 7fa36a323800 20 remove_watcher() i=4 2024-09-14T11:25:17.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:17.006+0000 7fa36a323800 20 remove_watcher() i=5 2024-09-14T11:25:17.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:17.007+0000 7fa36a323800 20 remove_watcher() i=6 2024-09-14T11:25:17.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:17.008+0000 7fa36a323800 20 remove_watcher() i=7 2024-09-14T11:25:17.020 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-14T11:25:17.040 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-14T11:25:17.041 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-14T11:25:17.041 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-14T11:25:17.041 DEBUG:teuthology.orchestra.run.smithi050:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:25:17.070 INFO:teuthology.orchestra.run.smithi050.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-14T11:25:17.867 INFO:tasks.s3tests:Creating rgw users... 2024-09-14T11:25:17.867 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-14T11:25:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:18.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.006+0000 7fc503840800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.008+0000 7fc503840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.008+0000 7fc503840800 20 realm 2024-09-14T11:25:18.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.008+0000 7fc503840800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.008+0000 7fc503840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.008+0000 7fc503840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:18.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.008+0000 7fc503840800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.008+0000 7fc503840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.008+0000 7fc503840800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.009+0000 7fc503840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:18.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.009+0000 7fc503840800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.010+0000 7fc503840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:18.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.010+0000 7fc503840800 20 searching for the correct realm 2024-09-14T11:25:18.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.013+0000 7fc500b29640 0 -- 172.21.15.50:0/3922482392 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fc4fc016400 msgr2=0x7fc4fc016880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:18.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.219+0000 7fc501b2b640 0 -- 172.21.15.50:0/3922482392 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55e4a2f73b10 msgr2=0x55e4a2f75fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.224+0000 7fc503840800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:25:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.224+0000 7fc503840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.224+0000 7fc503840800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:25:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.224+0000 7fc503840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.224+0000 7fc503840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.224+0000 7fc503840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.224+0000 7fc503840800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.224+0000 7fc503840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.224+0000 7fc503840800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.224+0000 7fc503840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.224+0000 7fc503840800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.225+0000 7fc503840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.225+0000 7fc503840800 20 zone default found 2024-09-14T11:25:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.225+0000 7fc503840800 4 Realm: () 2024-09-14T11:25:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.225+0000 7fc503840800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:25:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.225+0000 7fc503840800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:25:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.225+0000 7fc503840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:18.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.225+0000 7fc503840800 20 zonegroup default 2024-09-14T11:25:18.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.225+0000 7fc503840800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.225+0000 7fc503840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.225+0000 7fc503840800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.225+0000 7fc503840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.225+0000 7fc503840800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.226+0000 7fc503840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.226+0000 7fc503840800 20 started sync module instance, tier type = 2024-09-14T11:25:18.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.226+0000 7fc503840800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:25:18.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.235+0000 7fc503840800 20 add_watcher() i=0 2024-09-14T11:25:18.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.235+0000 7fc503840800 20 add_watcher() i=1 2024-09-14T11:25:18.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.235+0000 7fc503840800 20 add_watcher() i=2 2024-09-14T11:25:18.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.235+0000 7fc503840800 20 add_watcher() i=3 2024-09-14T11:25:18.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.235+0000 7fc503840800 20 add_watcher() i=4 2024-09-14T11:25:18.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.235+0000 7fc503840800 20 add_watcher() i=5 2024-09-14T11:25:18.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.235+0000 7fc503840800 20 add_watcher() i=6 2024-09-14T11:25:18.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.236+0000 7fc503840800 20 add_watcher() i=7 2024-09-14T11:25:18.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.236+0000 7fc503840800 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:18.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.237+0000 7fc3b7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:18.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.237+0000 7fc503840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:18.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.237+0000 7fc503840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:18.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.238+0000 7fc503840800 5 note: GC not initialized 2024-09-14T11:25:18.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.238+0000 7fc3b6fe5640 20 reqs_thread_entry: start 2024-09-14T11:25:18.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.238+0000 7fc503840800 20 init_complete bucket index max shards: 11 2024-09-14T11:25:18.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.238+0000 7fc503840800 20 Filter name: none 2024-09-14T11:25:18.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.238+0000 7fc3b4fe1640 20 reqs_thread_entry: start 2024-09-14T11:25:18.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.238+0000 7fc503840800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-14T11:25:18.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.238+0000 7fc503840800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.238+0000 7fc503840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.238+0000 7fc503840800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-14T11:25:18.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.238+0000 7fc503840800 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-14T11:25:18.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.238+0000 7fc503840800 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-14T11:25:18.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.238+0000 7fc503840800 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-14T11:25:18.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.238+0000 7fc503840800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.239+0000 7fc503840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.239+0000 7fc503840800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-14T11:25:18.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.239+0000 7fc503840800 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-14T11:25:18.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.239+0000 7fc503840800 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-14T11:25:18.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.240+0000 7fc503840800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-14T11:25:18.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.240+0000 7fc503840800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-14T11:25:18.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.240+0000 7fc503840800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-14T11:25:18.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.241+0000 7fc3e4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497254 cookie 94440475021840 notifier 8456 bl.length()=384 2024-09-14T11:25:18.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.241+0000 7fc3e4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-14T11:25:18.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.241+0000 7fc3e4ff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-14T11:25:18.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.244+0000 7fc503840800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-14T11:25:18.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.244+0000 7fc503840800 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-14T11:25:18.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.244+0000 7fc503840800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-14T11:25:18.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.244+0000 7fc3e4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497255 cookie 94440475089968 notifier 8456 bl.length()=225 2024-09-14T11:25:18.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.244+0000 7fc3e4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-14T11:25:18.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.244+0000 7fc3e4ff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-14T11:25:18.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.246+0000 7fc503840800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-14T11:25:18.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.246+0000 7fc503840800 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-14T11:25:18.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.246+0000 7fc503840800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-14T11:25:18.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.247+0000 7fc3e4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497030 cookie 94440475087872 notifier 8456 bl.length()=234 2024-09-14T11:25:18.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.247+0000 7fc3e4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-14T11:25:18.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.247+0000 7fc3e4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-14T11:25:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.249+0000 7fc3b7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.252+0000 7fc503840800 20 remove_watcher() i=0 2024-09-14T11:25:18.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.252+0000 7fc503840800 2 removed watcher, disabling cache 2024-09-14T11:25:18.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.253+0000 7fc503840800 20 remove_watcher() i=1 2024-09-14T11:25:18.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.254+0000 7fc503840800 20 remove_watcher() i=2 2024-09-14T11:25:18.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.255+0000 7fc503840800 20 remove_watcher() i=3 2024-09-14T11:25:18.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.256+0000 7fc503840800 20 remove_watcher() i=4 2024-09-14T11:25:18.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.257+0000 7fc503840800 20 remove_watcher() i=5 2024-09-14T11:25:18.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.258+0000 7fc503840800 20 remove_watcher() i=6 2024-09-14T11:25:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.259+0000 7fc503840800 20 remove_watcher() i=7 2024-09-14T11:25:18.267 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-14T11:25:18.267 INFO:teuthology.orchestra.run.smithi050.stdout: "id": "RGW11111111111111111", 2024-09-14T11:25:18.267 INFO:teuthology.orchestra.run.smithi050.stdout: "tenant": "", 2024-09-14T11:25:18.267 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "Mr.RGW11111111111111111", 2024-09-14T11:25:18.267 INFO:teuthology.orchestra.run.smithi050.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-14T11:25:18.268 INFO:teuthology.orchestra.run.smithi050.stdout: "quota": { 2024-09-14T11:25:18.268 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:25:18.268 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:25:18.268 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:25:18.268 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:25:18.268 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:25:18.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:25:18.268 INFO:teuthology.orchestra.run.smithi050.stdout: "bucket_quota": { 2024-09-14T11:25:18.268 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:25:18.268 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:25:18.268 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:25:18.268 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:25:18.268 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:25:18.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:25:18.269 INFO:teuthology.orchestra.run.smithi050.stdout: "max_users": 1000, 2024-09-14T11:25:18.269 INFO:teuthology.orchestra.run.smithi050.stdout: "max_roles": 1000, 2024-09-14T11:25:18.269 INFO:teuthology.orchestra.run.smithi050.stdout: "max_groups": 1000, 2024-09-14T11:25:18.269 INFO:teuthology.orchestra.run.smithi050.stdout: "max_buckets": 1000, 2024-09-14T11:25:18.269 INFO:teuthology.orchestra.run.smithi050.stdout: "max_access_keys": 4 2024-09-14T11:25:18.269 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-14T11:25:18.270 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-14T11:25:18.270 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key FMEATKGIDNCSYFEJEXPI --secret soXlfrgVA2RpOVoWHwj32zcHB2NxfoP5bCB8jSO6FI7zeYfXflI/zA== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-14T11:25:18.340 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:18.340 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:18.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.377+0000 7f482b610800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.379+0000 7f482b610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.379+0000 7f482b610800 20 realm 2024-09-14T11:25:18.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.379+0000 7f482b610800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.379+0000 7f482b610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.379+0000 7f482b610800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:18.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.379+0000 7f482b610800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.379+0000 7f482b610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.379+0000 7f482b610800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.380+0000 7f482b610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:18.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.380+0000 7f482b610800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.381+0000 7f482b610800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:18.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.381+0000 7f482b610800 20 searching for the correct realm 2024-09-14T11:25:18.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.384+0000 7f48265bb640 0 -- 172.21.15.50:0/1417655688 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f482006cb80 msgr2=0x7f4820068130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:18.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.590+0000 7f48275bd640 0 -- 172.21.15.50:0/1417655688 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55d86cba06b0 msgr2=0x55d86cba2b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.594+0000 7f482b610800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:25:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.594+0000 7f482b610800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.594+0000 7f482b610800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:25:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.594+0000 7f482b610800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.594+0000 7f482b610800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.594+0000 7f482b610800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.594+0000 7f482b610800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.594+0000 7f482b610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.594+0000 7f482b610800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.594+0000 7f482b610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.594+0000 7f482b610800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.595+0000 7f482b610800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.595+0000 7f482b610800 20 zone default found 2024-09-14T11:25:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.595+0000 7f482b610800 4 Realm: () 2024-09-14T11:25:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.595+0000 7f482b610800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:25:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.595+0000 7f482b610800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:25:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.595+0000 7f482b610800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.595+0000 7f482b610800 20 zonegroup default 2024-09-14T11:25:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.595+0000 7f482b610800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.595+0000 7f482b610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.595+0000 7f482b610800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.595+0000 7f482b610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.595+0000 7f482b610800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.596+0000 7f482b610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.596+0000 7f482b610800 20 started sync module instance, tier type = 2024-09-14T11:25:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.596+0000 7f482b610800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:25:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.604+0000 7f482b610800 20 add_watcher() i=0 2024-09-14T11:25:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.604+0000 7f482b610800 20 add_watcher() i=1 2024-09-14T11:25:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.604+0000 7f482b610800 20 add_watcher() i=2 2024-09-14T11:25:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.604+0000 7f482b610800 20 add_watcher() i=3 2024-09-14T11:25:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.604+0000 7f482b610800 20 add_watcher() i=4 2024-09-14T11:25:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.604+0000 7f482b610800 20 add_watcher() i=5 2024-09-14T11:25:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.604+0000 7f482b610800 20 add_watcher() i=6 2024-09-14T11:25:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.605+0000 7f482b610800 20 add_watcher() i=7 2024-09-14T11:25:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.605+0000 7f482b610800 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.607+0000 7f46dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.607+0000 7f482b610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.607+0000 7f482b610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.607+0000 7f482b610800 5 note: GC not initialized 2024-09-14T11:25:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.608+0000 7f4657fff640 20 reqs_thread_entry: start 2024-09-14T11:25:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.608+0000 7f482b610800 20 init_complete bucket index max shards: 11 2024-09-14T11:25:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.608+0000 7f482b610800 20 Filter name: none 2024-09-14T11:25:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.608+0000 7f4655ffb640 20 reqs_thread_entry: start 2024-09-14T11:25:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.608+0000 7f482b610800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T11:25:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.608+0000 7f482b610800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.609+0000 7f482b610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.609+0000 7f482b610800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-14T11:25:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.609+0000 7f482b610800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:25:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.609+0000 7f482b610800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-14T11:25:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.609+0000 7f482b610800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.609+0000 7f482b610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.609+0000 7f482b610800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-14T11:25:18.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.609+0000 7f482b610800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:25:18.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.609+0000 7f482b610800 10 cache get: name=default.rgw.meta+users.keys+FMEATKGIDNCSYFEJEXPI : miss 2024-09-14T11:25:18.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.609+0000 7f482b610800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.609+0000 7f482b610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.609+0000 7f482b610800 10 cache put: name=default.rgw.meta+users.keys+FMEATKGIDNCSYFEJEXPI info.flags=0x0 2024-09-14T11:25:18.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.609+0000 7f482b610800 10 adding default.rgw.meta+users.keys+FMEATKGIDNCSYFEJEXPI to cache LRU end 2024-09-14T11:25:18.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.609+0000 7f482b610800 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-14T11:25:18.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.609+0000 7f482b610800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.610+0000 7f482b610800 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:25:18.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.610+0000 7f482b610800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-14T11:25:18.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.610+0000 7f482b610800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-14T11:25:18.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.610+0000 7f482b610800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:25:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.610+0000 7f482b610800 10 cache get: name=default.rgw.meta+users.keys+FMEATKGIDNCSYFEJEXPI : hit (negative entry) 2024-09-14T11:25:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.610+0000 7f482b610800 10 cache get: name=default.rgw.meta+users.keys+FMEATKGIDNCSYFEJEXPI : hit (negative entry) 2024-09-14T11:25:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.611+0000 7f482b610800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:25:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.611+0000 7f482b610800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:25:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.611+0000 7f482b610800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T11:25:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.612+0000 7f470a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497040 cookie 94388025433552 notifier 8474 bl.length()=673 2024-09-14T11:25:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.612+0000 7f470a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:25:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.612+0000 7f470a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:25:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.614+0000 7f482b610800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T11:25:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.614+0000 7f482b610800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:25:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.614+0000 7f482b610800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-14T11:25:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.615+0000 7f470a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497256 cookie 94388025500560 notifier 8474 bl.length()=185 2024-09-14T11:25:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.615+0000 7f470a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T11:25:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.615+0000 7f470a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:25:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.617+0000 7f482b610800 10 cache put: name=default.rgw.meta+users.keys+FMEATKGIDNCSYFEJEXPI info.flags=0x7 2024-09-14T11:25:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.617+0000 7f482b610800 10 moving default.rgw.meta+users.keys+FMEATKGIDNCSYFEJEXPI to cache LRU end 2024-09-14T11:25:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.617+0000 7f482b610800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:FMEATKGIDNCSYFEJEXPI, ofs0, ns] 2024-09-14T11:25:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.617+0000 7f470a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497270 cookie 94388025498944 notifier 8474 bl.length()=186 2024-09-14T11:25:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.617+0000 7f470a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+FMEATKGIDNCSYFEJEXPI info.flags=0x7 2024-09-14T11:25:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.617+0000 7f470a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+FMEATKGIDNCSYFEJEXPI to cache LRU end 2024-09-14T11:25:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.620+0000 7f482b610800 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-14T11:25:18.696 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-14T11:25:18.696 INFO:teuthology.orchestra.run.smithi050.stdout: "user_id": "foo.client.0", 2024-09-14T11:25:18.696 INFO:teuthology.orchestra.run.smithi050.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-14T11:25:18.697 INFO:teuthology.orchestra.run.smithi050.stdout: "email": "foo+test@test.test", 2024-09-14T11:25:18.697 INFO:teuthology.orchestra.run.smithi050.stdout: "suspended": 0, 2024-09-14T11:25:18.697 INFO:teuthology.orchestra.run.smithi050.stdout: "max_buckets": 1000, 2024-09-14T11:25:18.697 INFO:teuthology.orchestra.run.smithi050.stdout: "subusers": [], 2024-09-14T11:25:18.697 INFO:teuthology.orchestra.run.smithi050.stdout: "keys": [ 2024-09-14T11:25:18.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-14T11:25:18.697 INFO:teuthology.orchestra.run.smithi050.stdout: "user": "foo.client.0", 2024-09-14T11:25:18.697 INFO:teuthology.orchestra.run.smithi050.stdout: "access_key": "FMEATKGIDNCSYFEJEXPI", 2024-09-14T11:25:18.697 INFO:teuthology.orchestra.run.smithi050.stdout: "secret_key": "soXlfrgVA2RpOVoWHwj32zcHB2NxfoP5bCB8jSO6FI7zeYfXflI/zA==", 2024-09-14T11:25:18.697 INFO:teuthology.orchestra.run.smithi050.stdout: "active": true, 2024-09-14T11:25:18.697 INFO:teuthology.orchestra.run.smithi050.stdout: "create_date": "2024-09-14T11:25:18.611696Z" 2024-09-14T11:25:18.697 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-14T11:25:18.697 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-14T11:25:18.697 INFO:teuthology.orchestra.run.smithi050.stdout: "swift_keys": [], 2024-09-14T11:25:18.698 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": [], 2024-09-14T11:25:18.698 INFO:teuthology.orchestra.run.smithi050.stdout: "op_mask": "read, write, delete", 2024-09-14T11:25:18.698 INFO:teuthology.orchestra.run.smithi050.stdout: "default_placement": "", 2024-09-14T11:25:18.698 INFO:teuthology.orchestra.run.smithi050.stdout: "default_storage_class": "", 2024-09-14T11:25:18.698 INFO:teuthology.orchestra.run.smithi050.stdout: "placement_tags": [], 2024-09-14T11:25:18.698 INFO:teuthology.orchestra.run.smithi050.stdout: "bucket_quota": { 2024-09-14T11:25:18.698 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:25:18.698 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:25:18.698 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:25:18.698 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:25:18.698 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:25:18.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:25:18.698 INFO:teuthology.orchestra.run.smithi050.stdout: "user_quota": { 2024-09-14T11:25:18.698 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:25:18.698 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:25:18.699 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:25:18.699 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:25:18.699 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:25:18.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:25:18.699 INFO:teuthology.orchestra.run.smithi050.stdout: "temp_url_keys": [], 2024-09-14T11:25:18.699 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "root", 2024-09-14T11:25:18.699 INFO:teuthology.orchestra.run.smithi050.stdout: "mfa_ids": [], 2024-09-14T11:25:18.699 INFO:teuthology.orchestra.run.smithi050.stdout: "account_id": "RGW11111111111111111", 2024-09-14T11:25:18.699 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-09-14T11:25:18.699 INFO:teuthology.orchestra.run.smithi050.stdout: "create_date": "2024-09-14T11:25:18.611683Z", 2024-09-14T11:25:18.699 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-14T11:25:18.699 INFO:teuthology.orchestra.run.smithi050.stdout: "group_ids": [] 2024-09-14T11:25:18.699 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-14T11:25:18.699 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.621+0000 7f46dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.623+0000 7f482b610800 20 remove_watcher() i=0 2024-09-14T11:25:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.623+0000 7f482b610800 2 removed watcher, disabling cache 2024-09-14T11:25:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.624+0000 7f482b610800 20 remove_watcher() i=1 2024-09-14T11:25:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.625+0000 7f482b610800 20 remove_watcher() i=2 2024-09-14T11:25:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.626+0000 7f482b610800 20 remove_watcher() i=3 2024-09-14T11:25:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.627+0000 7f482b610800 20 remove_watcher() i=4 2024-09-14T11:25:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.628+0000 7f482b610800 20 remove_watcher() i=5 2024-09-14T11:25:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.629+0000 7f482b610800 20 remove_watcher() i=6 2024-09-14T11:25:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.630+0000 7f482b610800 20 remove_watcher() i=7 2024-09-14T11:25:18.702 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 4841859745 --totp-seed YYU7GFRKF7S6I5HL3VAYNORSEOIPK54W7YBKA7RHTFQ4GB22CQMPTZ5TVZTPYC2K --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:25:18.770 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:18.770 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:18.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.807+0000 7efcc2d25800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.809+0000 7efcc2d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.809+0000 7efcc2d25800 20 realm 2024-09-14T11:25:18.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.809+0000 7efcc2d25800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.809+0000 7efcc2d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.809+0000 7efcc2d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:18.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.809+0000 7efcc2d25800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.809+0000 7efcc2d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.809+0000 7efcc2d25800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.810+0000 7efcc2d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.810+0000 7efcc2d25800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.811+0000 7efcc2d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.811+0000 7efcc2d25800 20 searching for the correct realm 2024-09-14T11:25:18.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:18.813+0000 7efcbe1b4640 0 -- 172.21.15.50:0/3251510509 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7efcb80a5ad0 msgr2=0x7efcb80ae740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:19.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.019+0000 7efcbf1b6640 0 -- 172.21.15.50:0/3251510509 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5636485f45e0 msgr2=0x5636485f6a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:19.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.023+0000 7efcc2d25800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:25:19.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.023+0000 7efcc2d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:19.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.023+0000 7efcc2d25800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:25:19.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.023+0000 7efcc2d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:19.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.023+0000 7efcc2d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:19.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.023+0000 7efcc2d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:19.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.023+0000 7efcc2d25800 20 rados->read ofs=0 len=0 2024-09-14T11:25:19.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.023+0000 7efcc2d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:19.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.023+0000 7efcc2d25800 20 rados->read ofs=0 len=0 2024-09-14T11:25:19.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.024+0000 7efcc2d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:19.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.024+0000 7efcc2d25800 20 rados->read ofs=0 len=0 2024-09-14T11:25:19.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.024+0000 7efcc2d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:19.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.024+0000 7efcc2d25800 20 zone default found 2024-09-14T11:25:19.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.024+0000 7efcc2d25800 4 Realm: () 2024-09-14T11:25:19.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.024+0000 7efcc2d25800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:25:19.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.024+0000 7efcc2d25800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:25:19.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.024+0000 7efcc2d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:19.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.024+0000 7efcc2d25800 20 zonegroup default 2024-09-14T11:25:19.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.024+0000 7efcc2d25800 20 rados->read ofs=0 len=0 2024-09-14T11:25:19.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.024+0000 7efcc2d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:19.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.024+0000 7efcc2d25800 20 rados->read ofs=0 len=0 2024-09-14T11:25:19.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.024+0000 7efcc2d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:19.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.025+0000 7efcc2d25800 20 rados->read ofs=0 len=0 2024-09-14T11:25:19.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.025+0000 7efcc2d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:19.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.025+0000 7efcc2d25800 20 started sync module instance, tier type = 2024-09-14T11:25:19.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.025+0000 7efcc2d25800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:25:19.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.034+0000 7efcc2d25800 20 add_watcher() i=0 2024-09-14T11:25:19.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.034+0000 7efcc2d25800 20 add_watcher() i=1 2024-09-14T11:25:19.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.034+0000 7efcc2d25800 20 add_watcher() i=2 2024-09-14T11:25:19.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.034+0000 7efcc2d25800 20 add_watcher() i=3 2024-09-14T11:25:19.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.034+0000 7efcc2d25800 20 add_watcher() i=4 2024-09-14T11:25:19.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.034+0000 7efcc2d25800 20 add_watcher() i=5 2024-09-14T11:25:19.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.034+0000 7efcc2d25800 20 add_watcher() i=6 2024-09-14T11:25:19.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.035+0000 7efcc2d25800 20 add_watcher() i=7 2024-09-14T11:25:19.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.035+0000 7efcc2d25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:19.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.036+0000 7efb757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:19.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.036+0000 7efcc2d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:19.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.036+0000 7efcc2d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:19.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.036+0000 7efcc2d25800 5 note: GC not initialized 2024-09-14T11:25:19.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.036+0000 7efaeffff640 20 reqs_thread_entry: start 2024-09-14T11:25:19.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.037+0000 7efcc2d25800 20 init_complete bucket index max shards: 11 2024-09-14T11:25:19.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.037+0000 7efcc2d25800 20 Filter name: none 2024-09-14T11:25:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.037+0000 7efaedffb640 20 reqs_thread_entry: start 2024-09-14T11:25:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.037+0000 7efcc2d25800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T11:25:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.037+0000 7efcc2d25800 20 rados->read ofs=0 len=0 2024-09-14T11:25:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.038+0000 7efcc2d25800 20 rados_obj.operate() r=0 bl.length=488 2024-09-14T11:25:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.038+0000 7efcc2d25800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-14T11:25:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.038+0000 7efcc2d25800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:25:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:19.038+0000 7efcc2d25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:25:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.214+0000 7efcc2d25800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:25:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.214+0000 7efcc2d25800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:25:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.214+0000 7efcc2d25800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T11:25:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.215+0000 7efba1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431633 cookie 94791142432000 notifier 9153 bl.length()=687 2024-09-14T11:25:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.215+0000 7efba1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:25:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.215+0000 7efba1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:25:20.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.218+0000 7efb757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:20.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.221+0000 7efcc2d25800 20 remove_watcher() i=0 2024-09-14T11:25:20.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.221+0000 7efcc2d25800 2 removed watcher, disabling cache 2024-09-14T11:25:20.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.222+0000 7efcc2d25800 20 remove_watcher() i=1 2024-09-14T11:25:20.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.223+0000 7efcc2d25800 20 remove_watcher() i=2 2024-09-14T11:25:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.224+0000 7efcc2d25800 20 remove_watcher() i=3 2024-09-14T11:25:20.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.226+0000 7efcc2d25800 20 remove_watcher() i=4 2024-09-14T11:25:20.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.227+0000 7efcc2d25800 20 remove_watcher() i=5 2024-09-14T11:25:20.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.228+0000 7efcc2d25800 20 remove_watcher() i=6 2024-09-14T11:25:20.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.229+0000 7efcc2d25800 20 remove_watcher() i=7 2024-09-14T11:25:20.242 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-14T11:25:20.242 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key LCRLHBQUQZTEMHFHYEXM --secret 3oZW0jug2aRQzSm5txnA2ZoxGNnjvqkKYxFgLM+6u6hvRkqChzKI2A== --cluster ceph 2024-09-14T11:25:20.311 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:20.312 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:20.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.349+0000 7f1694f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.351+0000 7f1694f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:20.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.351+0000 7f1694f2a800 20 realm 2024-09-14T11:25:20.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.351+0000 7f1694f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.351+0000 7f1694f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:20.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.351+0000 7f1694f2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:20.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.351+0000 7f1694f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.351+0000 7f1694f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:20.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.351+0000 7f1694f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.352+0000 7f1694f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:20.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.352+0000 7f1694f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.353+0000 7f1694f2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:20.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.353+0000 7f1694f2a800 20 searching for the correct realm 2024-09-14T11:25:20.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.356+0000 7f16904ac640 0 -- 172.21.15.50:0/2923992468 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f1688069040 msgr2=0x7f1688055920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:20.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.561+0000 7f16914ae640 0 -- 172.21.15.50:0/2923992468 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55e6ba158e10 msgr2=0x55e6ba15b2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:20.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.566+0000 7f1694f2a800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:25:20.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.566+0000 7f1694f2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:20.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.566+0000 7f1694f2a800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:25:20.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.566+0000 7f1694f2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:20.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.566+0000 7f1694f2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:20.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.566+0000 7f1694f2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:20.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.566+0000 7f1694f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.566+0000 7f1694f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:20.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.566+0000 7f1694f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.566+0000 7f1694f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:20.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.566+0000 7f1694f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.567+0000 7f1694f2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:20.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.567+0000 7f1694f2a800 20 zone default found 2024-09-14T11:25:20.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.567+0000 7f1694f2a800 4 Realm: () 2024-09-14T11:25:20.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.567+0000 7f1694f2a800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:25:20.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.567+0000 7f1694f2a800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:25:20.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.567+0000 7f1694f2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:20.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.567+0000 7f1694f2a800 20 zonegroup default 2024-09-14T11:25:20.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.567+0000 7f1694f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.567+0000 7f1694f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:20.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.567+0000 7f1694f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.567+0000 7f1694f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:20.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.567+0000 7f1694f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.568+0000 7f1694f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:20.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.568+0000 7f1694f2a800 20 started sync module instance, tier type = 2024-09-14T11:25:20.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.568+0000 7f1694f2a800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:25:20.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.577+0000 7f1694f2a800 20 add_watcher() i=0 2024-09-14T11:25:20.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.577+0000 7f1694f2a800 20 add_watcher() i=1 2024-09-14T11:25:20.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.577+0000 7f1694f2a800 20 add_watcher() i=2 2024-09-14T11:25:20.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.577+0000 7f1694f2a800 20 add_watcher() i=3 2024-09-14T11:25:20.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.577+0000 7f1694f2a800 20 add_watcher() i=4 2024-09-14T11:25:20.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.577+0000 7f1694f2a800 20 add_watcher() i=5 2024-09-14T11:25:20.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.577+0000 7f1694f2a800 20 add_watcher() i=6 2024-09-14T11:25:20.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.578+0000 7f1694f2a800 20 add_watcher() i=7 2024-09-14T11:25:20.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.578+0000 7f1694f2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:20.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.580+0000 7f15477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:20.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.580+0000 7f1694f2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:20.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.580+0000 7f1694f2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:20.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.580+0000 7f1694f2a800 5 note: GC not initialized 2024-09-14T11:25:20.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.580+0000 7f15467e4640 20 reqs_thread_entry: start 2024-09-14T11:25:20.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.581+0000 7f1694f2a800 20 init_complete bucket index max shards: 11 2024-09-14T11:25:20.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.581+0000 7f1694f2a800 20 Filter name: none 2024-09-14T11:25:20.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.581+0000 7f153ffff640 20 reqs_thread_entry: start 2024-09-14T11:25:20.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.581+0000 7f1694f2a800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T11:25:20.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.581+0000 7f1694f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.581+0000 7f1694f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:20.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.581+0000 7f1694f2a800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-14T11:25:20.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.581+0000 7f1694f2a800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:25:20.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.581+0000 7f1694f2a800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-14T11:25:20.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.581+0000 7f1694f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.581+0000 7f1694f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:20.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.581+0000 7f1694f2a800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-14T11:25:20.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.581+0000 7f1694f2a800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:25:20.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.581+0000 7f1694f2a800 10 cache get: name=default.rgw.meta+users.keys+LCRLHBQUQZTEMHFHYEXM : miss 2024-09-14T11:25:20.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.581+0000 7f1694f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.582+0000 7f1694f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:20.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.582+0000 7f1694f2a800 10 cache put: name=default.rgw.meta+users.keys+LCRLHBQUQZTEMHFHYEXM info.flags=0x0 2024-09-14T11:25:20.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.582+0000 7f1694f2a800 10 adding default.rgw.meta+users.keys+LCRLHBQUQZTEMHFHYEXM to cache LRU end 2024-09-14T11:25:20.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.582+0000 7f1694f2a800 10 cache get: name=default.rgw.meta+users.keys+LCRLHBQUQZTEMHFHYEXM : hit (negative entry) 2024-09-14T11:25:20.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.582+0000 7f1694f2a800 10 cache get: name=default.rgw.meta+users.keys+LCRLHBQUQZTEMHFHYEXM : hit (negative entry) 2024-09-14T11:25:20.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.583+0000 7f1694f2a800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:25:20.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.583+0000 7f1694f2a800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:25:20.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.583+0000 7f1694f2a800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T11:25:20.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.583+0000 7f1567fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431849 cookie 94449452878912 notifier 9171 bl.length()=645 2024-09-14T11:25:20.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.583+0000 7f1567fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:25:20.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.583+0000 7f1567fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:25:20.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.586+0000 7f1694f2a800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T11:25:20.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.586+0000 7f1694f2a800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:25:20.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.586+0000 7f1694f2a800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-14T11:25:20.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.587+0000 7f1567fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431863 cookie 94449452888896 notifier 9171 bl.length()=185 2024-09-14T11:25:20.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.587+0000 7f1567fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T11:25:20.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.587+0000 7f1567fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:25:20.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.590+0000 7f1694f2a800 10 cache put: name=default.rgw.meta+users.keys+LCRLHBQUQZTEMHFHYEXM info.flags=0x7 2024-09-14T11:25:20.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.590+0000 7f1694f2a800 10 moving default.rgw.meta+users.keys+LCRLHBQUQZTEMHFHYEXM to cache LRU end 2024-09-14T11:25:20.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.590+0000 7f1694f2a800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:LCRLHBQUQZTEMHFHYEXM, ofs0, ns] 2024-09-14T11:25:20.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.590+0000 7f1567fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431850 cookie 94449452878912 notifier 9171 bl.length()=186 2024-09-14T11:25:20.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.590+0000 7f1567fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LCRLHBQUQZTEMHFHYEXM info.flags=0x7 2024-09-14T11:25:20.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.590+0000 7f1567fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LCRLHBQUQZTEMHFHYEXM to cache LRU end 2024-09-14T11:25:20.591 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-14T11:25:20.591 INFO:teuthology.orchestra.run.smithi050.stdout: "user_id": "bar.client.0", 2024-09-14T11:25:20.591 INFO:teuthology.orchestra.run.smithi050.stdout: "display_name": "Mr.bar.client.0", 2024-09-14T11:25:20.591 INFO:teuthology.orchestra.run.smithi050.stdout: "email": "bar+test@test.test", 2024-09-14T11:25:20.591 INFO:teuthology.orchestra.run.smithi050.stdout: "suspended": 0, 2024-09-14T11:25:20.591 INFO:teuthology.orchestra.run.smithi050.stdout: "max_buckets": 1000, 2024-09-14T11:25:20.591 INFO:teuthology.orchestra.run.smithi050.stdout: "subusers": [], 2024-09-14T11:25:20.591 INFO:teuthology.orchestra.run.smithi050.stdout: "keys": [ 2024-09-14T11:25:20.591 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-14T11:25:20.591 INFO:teuthology.orchestra.run.smithi050.stdout: "user": "bar.client.0", 2024-09-14T11:25:20.592 INFO:teuthology.orchestra.run.smithi050.stdout: "access_key": "LCRLHBQUQZTEMHFHYEXM", 2024-09-14T11:25:20.592 INFO:teuthology.orchestra.run.smithi050.stdout: "secret_key": "3oZW0jug2aRQzSm5txnA2ZoxGNnjvqkKYxFgLM+6u6hvRkqChzKI2A==", 2024-09-14T11:25:20.592 INFO:teuthology.orchestra.run.smithi050.stdout: "active": true, 2024-09-14T11:25:20.592 INFO:teuthology.orchestra.run.smithi050.stdout: "create_date": "2024-09-14T11:25:20.583628Z" 2024-09-14T11:25:20.592 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-14T11:25:20.592 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-14T11:25:20.592 INFO:teuthology.orchestra.run.smithi050.stdout: "swift_keys": [], 2024-09-14T11:25:20.592 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": [], 2024-09-14T11:25:20.592 INFO:teuthology.orchestra.run.smithi050.stdout: "op_mask": "read, write, delete", 2024-09-14T11:25:20.592 INFO:teuthology.orchestra.run.smithi050.stdout: "default_placement": "", 2024-09-14T11:25:20.592 INFO:teuthology.orchestra.run.smithi050.stdout: "default_storage_class": "", 2024-09-14T11:25:20.592 INFO:teuthology.orchestra.run.smithi050.stdout: "placement_tags": [], 2024-09-14T11:25:20.592 INFO:teuthology.orchestra.run.smithi050.stdout: "bucket_quota": { 2024-09-14T11:25:20.592 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:25:20.593 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:25:20.593 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:25:20.593 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:25:20.593 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:25:20.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:25:20.593 INFO:teuthology.orchestra.run.smithi050.stdout: "user_quota": { 2024-09-14T11:25:20.593 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:25:20.593 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:25:20.593 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:25:20.593 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:25:20.593 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:25:20.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:25:20.593 INFO:teuthology.orchestra.run.smithi050.stdout: "temp_url_keys": [], 2024-09-14T11:25:20.593 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "rgw", 2024-09-14T11:25:20.594 INFO:teuthology.orchestra.run.smithi050.stdout: "mfa_ids": [], 2024-09-14T11:25:20.594 INFO:teuthology.orchestra.run.smithi050.stdout: "account_id": "", 2024-09-14T11:25:20.594 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-09-14T11:25:20.594 INFO:teuthology.orchestra.run.smithi050.stdout: "create_date": "2024-09-14T11:25:20.583614Z", 2024-09-14T11:25:20.594 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-14T11:25:20.594 INFO:teuthology.orchestra.run.smithi050.stdout: "group_ids": [] 2024-09-14T11:25:20.594 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-14T11:25:20.594 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:20.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.593+0000 7f15477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:20.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.595+0000 7f1694f2a800 20 remove_watcher() i=0 2024-09-14T11:25:20.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.595+0000 7f1694f2a800 2 removed watcher, disabling cache 2024-09-14T11:25:20.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.596+0000 7f1694f2a800 20 remove_watcher() i=1 2024-09-14T11:25:20.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.597+0000 7f1694f2a800 20 remove_watcher() i=2 2024-09-14T11:25:20.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.598+0000 7f1694f2a800 20 remove_watcher() i=3 2024-09-14T11:25:20.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.599+0000 7f1694f2a800 20 remove_watcher() i=4 2024-09-14T11:25:20.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.600+0000 7f1694f2a800 20 remove_watcher() i=5 2024-09-14T11:25:20.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.601+0000 7f1694f2a800 20 remove_watcher() i=6 2024-09-14T11:25:20.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.602+0000 7f1694f2a800 20 remove_watcher() i=7 2024-09-14T11:25:20.613 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 7009262294 --totp-seed UZ4LUWJ4FU4TUN7OHP4WPGFWULTF3UBLCZVPEG46CNNB64T3OWZAYJMOMHSRVJ34 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:25:20.681 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:20.682 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:20.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.718+0000 7f8856c13800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.720+0000 7f8856c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:20.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.720+0000 7f8856c13800 20 realm 2024-09-14T11:25:20.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.720+0000 7f8856c13800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.720+0000 7f8856c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:20.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.720+0000 7f8856c13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:20.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.720+0000 7f8856c13800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.720+0000 7f8856c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:20.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.720+0000 7f8856c13800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.721+0000 7f8856c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:20.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.721+0000 7f8856c13800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.722+0000 7f8856c13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:20.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.722+0000 7f8856c13800 20 searching for the correct realm 2024-09-14T11:25:20.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.725+0000 7f8851b47640 0 -- 172.21.15.50:0/3195607806 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f884c055920 msgr2=0x7f884c0623d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:25:20.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.931+0000 7f8852b49640 0 -- 172.21.15.50:0/3195607806 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55b82b832620 msgr2=0x55b82b834ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:20.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.935+0000 7f8856c13800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:25:20.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.935+0000 7f8856c13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.935+0000 7f8856c13800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:25:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.935+0000 7f8856c13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.935+0000 7f8856c13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.935+0000 7f8856c13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.935+0000 7f8856c13800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.936+0000 7f8856c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.936+0000 7f8856c13800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.936+0000 7f8856c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.936+0000 7f8856c13800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.936+0000 7f8856c13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.936+0000 7f8856c13800 20 zone default found 2024-09-14T11:25:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.936+0000 7f8856c13800 4 Realm: () 2024-09-14T11:25:20.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.936+0000 7f8856c13800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:25:20.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.936+0000 7f8856c13800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:25:20.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.936+0000 7f8856c13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:20.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.936+0000 7f8856c13800 20 zonegroup default 2024-09-14T11:25:20.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.936+0000 7f8856c13800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.937+0000 7f8856c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:20.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.937+0000 7f8856c13800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.937+0000 7f8856c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:20.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.937+0000 7f8856c13800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.938+0000 7f8856c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:20.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.938+0000 7f8856c13800 20 started sync module instance, tier type = 2024-09-14T11:25:20.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.938+0000 7f8856c13800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:25:20.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.947+0000 7f8856c13800 20 add_watcher() i=0 2024-09-14T11:25:20.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.947+0000 7f8856c13800 20 add_watcher() i=1 2024-09-14T11:25:20.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.947+0000 7f8856c13800 20 add_watcher() i=2 2024-09-14T11:25:20.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.947+0000 7f8856c13800 20 add_watcher() i=3 2024-09-14T11:25:20.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.947+0000 7f8856c13800 20 add_watcher() i=4 2024-09-14T11:25:20.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.947+0000 7f8856c13800 20 add_watcher() i=5 2024-09-14T11:25:20.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.947+0000 7f8856c13800 20 add_watcher() i=6 2024-09-14T11:25:20.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.948+0000 7f8856c13800 20 add_watcher() i=7 2024-09-14T11:25:20.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.948+0000 7f8856c13800 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:20.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.950+0000 7f8708fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:20.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.950+0000 7f8856c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:20.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.950+0000 7f8856c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:20.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.950+0000 7f8856c13800 5 note: GC not initialized 2024-09-14T11:25:20.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.950+0000 7f86837fe640 20 reqs_thread_entry: start 2024-09-14T11:25:20.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.950+0000 7f8856c13800 20 init_complete bucket index max shards: 11 2024-09-14T11:25:20.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.950+0000 7f8856c13800 20 Filter name: none 2024-09-14T11:25:20.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.951+0000 7f86817fa640 20 reqs_thread_entry: start 2024-09-14T11:25:20.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.951+0000 7f8856c13800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T11:25:20.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.951+0000 7f8856c13800 20 rados->read ofs=0 len=0 2024-09-14T11:25:20.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.951+0000 7f8856c13800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:25:20.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.951+0000 7f8856c13800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-14T11:25:20.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.951+0000 7f8856c13800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:25:20.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.951+0000 7f8856c13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:25:20.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.954+0000 7f8856c13800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:25:20.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.954+0000 7f8856c13800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:25:20.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.954+0000 7f8856c13800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T11:25:20.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.954+0000 7f8735ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431851 cookie 94249492365664 notifier 8528 bl.length()=659 2024-09-14T11:25:20.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.954+0000 7f8735ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:25:20.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.954+0000 7f8735ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:25:20.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.956+0000 7f8708fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:20.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.959+0000 7f8856c13800 20 remove_watcher() i=0 2024-09-14T11:25:20.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.959+0000 7f8856c13800 2 removed watcher, disabling cache 2024-09-14T11:25:20.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.960+0000 7f8856c13800 20 remove_watcher() i=1 2024-09-14T11:25:20.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.961+0000 7f8856c13800 20 remove_watcher() i=2 2024-09-14T11:25:20.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.962+0000 7f8856c13800 20 remove_watcher() i=3 2024-09-14T11:25:20.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.963+0000 7f8856c13800 20 remove_watcher() i=4 2024-09-14T11:25:20.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.964+0000 7f8856c13800 20 remove_watcher() i=5 2024-09-14T11:25:20.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.966+0000 7f8856c13800 20 remove_watcher() i=6 2024-09-14T11:25:20.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:20.967+0000 7f8856c13800 20 remove_watcher() i=7 2024-09-14T11:25:20.978 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-09-14T11:25:20.978 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr.testx$tenanteduser.client.0' --email 'testx$tenanteduser+test@test.test' --access-key ENALRJHMINTCJCLYSVAU --secret yxaZ35kBXma82vMhssPGC/SAzFwH9eSV2ItpgUPpVm0sT39C5Rpudg== --cluster ceph 2024-09-14T11:25:21.044 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:21.044 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.082+0000 7f7fed52e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.084+0000 7f7fed52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.084+0000 7f7fed52e800 20 realm 2024-09-14T11:25:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.084+0000 7f7fed52e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.084+0000 7f7fed52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:21.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.084+0000 7f7fed52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:21.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.084+0000 7f7fed52e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.084+0000 7f7fed52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:21.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.084+0000 7f7fed52e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.085+0000 7f7fed52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:21.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.085+0000 7f7fed52e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.086+0000 7f7fed52e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:21.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.086+0000 7f7fed52e800 20 searching for the correct realm 2024-09-14T11:25:21.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.089+0000 7f7fe8963640 0 -- 172.21.15.50:0/1488737473 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f7fe4064e00 msgr2=0x7f7fe406da70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:21.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.305+0000 7f7fe9164640 0 -- 172.21.15.50:0/1488737473 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f7fe406e0a0 msgr2=0x7f7fe4063040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:21.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.317+0000 7f7fed52e800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:25:21.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.317+0000 7f7fed52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:21.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.317+0000 7f7fed52e800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:25:21.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.317+0000 7f7fed52e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:21.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.317+0000 7f7fed52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:21.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.317+0000 7f7fed52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:21.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.317+0000 7f7fed52e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.317+0000 7f7fed52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:21.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.317+0000 7f7fed52e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.318+0000 7f7fed52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:21.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.318+0000 7f7fed52e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.318+0000 7f7fed52e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:21.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.318+0000 7f7fed52e800 20 zone default found 2024-09-14T11:25:21.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.318+0000 7f7fed52e800 4 Realm: () 2024-09-14T11:25:21.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.318+0000 7f7fed52e800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:25:21.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.318+0000 7f7fed52e800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:25:21.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.318+0000 7f7fed52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:21.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.318+0000 7f7fed52e800 20 zonegroup default 2024-09-14T11:25:21.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.318+0000 7f7fed52e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.318+0000 7f7fed52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:21.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.318+0000 7f7fed52e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.319+0000 7f7fed52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:21.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.319+0000 7f7fed52e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.319+0000 7f7fed52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:21.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.319+0000 7f7fed52e800 20 started sync module instance, tier type = 2024-09-14T11:25:21.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.319+0000 7f7fed52e800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:25:21.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.329+0000 7f7fed52e800 20 add_watcher() i=0 2024-09-14T11:25:21.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.329+0000 7f7fed52e800 20 add_watcher() i=1 2024-09-14T11:25:21.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.329+0000 7f7fed52e800 20 add_watcher() i=2 2024-09-14T11:25:21.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.329+0000 7f7fed52e800 20 add_watcher() i=3 2024-09-14T11:25:21.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.329+0000 7f7fed52e800 20 add_watcher() i=4 2024-09-14T11:25:21.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.329+0000 7f7fed52e800 20 add_watcher() i=5 2024-09-14T11:25:21.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.329+0000 7f7fed52e800 20 add_watcher() i=6 2024-09-14T11:25:21.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.330+0000 7f7fed52e800 20 add_watcher() i=7 2024-09-14T11:25:21.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.330+0000 7f7fed52e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:21.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.332+0000 7f7e9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:21.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.332+0000 7f7fed52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:21.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.332+0000 7f7fed52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:21.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.332+0000 7f7fed52e800 5 note: GC not initialized 2024-09-14T11:25:21.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.332+0000 7f7e9e7e4640 20 reqs_thread_entry: start 2024-09-14T11:25:21.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.332+0000 7f7fed52e800 20 init_complete bucket index max shards: 11 2024-09-14T11:25:21.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.332+0000 7f7fed52e800 20 Filter name: none 2024-09-14T11:25:21.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.332+0000 7f7e0ffff640 20 reqs_thread_entry: start 2024-09-14T11:25:21.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.333+0000 7f7fed52e800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T11:25:21.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.333+0000 7f7fed52e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.333+0000 7f7fed52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:21.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.333+0000 7f7fed52e800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-14T11:25:21.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.333+0000 7f7fed52e800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:25:21.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.333+0000 7f7fed52e800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-14T11:25:21.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.333+0000 7f7fed52e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.333+0000 7f7fed52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:21.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.333+0000 7f7fed52e800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-14T11:25:21.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.333+0000 7f7fed52e800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:25:21.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.333+0000 7f7fed52e800 10 cache get: name=default.rgw.meta+users.keys+ENALRJHMINTCJCLYSVAU : miss 2024-09-14T11:25:21.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.333+0000 7f7fed52e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.333+0000 7f7fed52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:21.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.333+0000 7f7fed52e800 10 cache put: name=default.rgw.meta+users.keys+ENALRJHMINTCJCLYSVAU info.flags=0x0 2024-09-14T11:25:21.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.333+0000 7f7fed52e800 10 adding default.rgw.meta+users.keys+ENALRJHMINTCJCLYSVAU to cache LRU end 2024-09-14T11:25:21.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.333+0000 7f7fed52e800 10 cache get: name=default.rgw.meta+users.keys+ENALRJHMINTCJCLYSVAU : hit (negative entry) 2024-09-14T11:25:21.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.333+0000 7f7fed52e800 10 cache get: name=default.rgw.meta+users.keys+ENALRJHMINTCJCLYSVAU : hit (negative entry) 2024-09-14T11:25:21.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.335+0000 7f7fed52e800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:25:21.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.335+0000 7f7fed52e800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:25:21.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.335+0000 7f7fed52e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T11:25:21.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.335+0000 7f7eccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399160 cookie 93922522336880 notifier 8546 bl.length()=719 2024-09-14T11:25:21.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.335+0000 7f7eccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:25:21.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.335+0000 7f7eccff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:25:21.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.338+0000 7f7fed52e800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T11:25:21.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.338+0000 7f7fed52e800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:25:21.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.338+0000 7f7fed52e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-14T11:25:21.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.339+0000 7f7eccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399161 cookie 93922522343968 notifier 8546 bl.length()=215 2024-09-14T11:25:21.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.339+0000 7f7eccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T11:25:21.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.339+0000 7f7eccff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:25:21.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.342+0000 7f7fed52e800 10 cache put: name=default.rgw.meta+users.keys+ENALRJHMINTCJCLYSVAU info.flags=0x7 2024-09-14T11:25:21.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.342+0000 7f7fed52e800 10 moving default.rgw.meta+users.keys+ENALRJHMINTCJCLYSVAU to cache LRU end 2024-09-14T11:25:21.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.342+0000 7f7fed52e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:ENALRJHMINTCJCLYSVAU, ofs0, ns] 2024-09-14T11:25:21.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.342+0000 7f7eccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399148 cookie 93922522320448 notifier 8546 bl.length()=201 2024-09-14T11:25:21.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.342+0000 7f7eccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ENALRJHMINTCJCLYSVAU info.flags=0x7 2024-09-14T11:25:21.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.342+0000 7f7eccff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ENALRJHMINTCJCLYSVAU to cache LRU end 2024-09-14T11:25:21.342 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-14T11:25:21.342 INFO:teuthology.orchestra.run.smithi050.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-14T11:25:21.343 INFO:teuthology.orchestra.run.smithi050.stdout: "display_name": "Mr.testx$tenanteduser.client.0", 2024-09-14T11:25:21.343 INFO:teuthology.orchestra.run.smithi050.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-14T11:25:21.343 INFO:teuthology.orchestra.run.smithi050.stdout: "suspended": 0, 2024-09-14T11:25:21.343 INFO:teuthology.orchestra.run.smithi050.stdout: "max_buckets": 1000, 2024-09-14T11:25:21.343 INFO:teuthology.orchestra.run.smithi050.stdout: "subusers": [], 2024-09-14T11:25:21.343 INFO:teuthology.orchestra.run.smithi050.stdout: "keys": [ 2024-09-14T11:25:21.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-14T11:25:21.343 INFO:teuthology.orchestra.run.smithi050.stdout: "user": "testx$tenanteduser.client.0", 2024-09-14T11:25:21.343 INFO:teuthology.orchestra.run.smithi050.stdout: "access_key": "ENALRJHMINTCJCLYSVAU", 2024-09-14T11:25:21.343 INFO:teuthology.orchestra.run.smithi050.stdout: "secret_key": "yxaZ35kBXma82vMhssPGC/SAzFwH9eSV2ItpgUPpVm0sT39C5Rpudg==", 2024-09-14T11:25:21.343 INFO:teuthology.orchestra.run.smithi050.stdout: "active": true, 2024-09-14T11:25:21.343 INFO:teuthology.orchestra.run.smithi050.stdout: "create_date": "2024-09-14T11:25:21.335373Z" 2024-09-14T11:25:21.343 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-14T11:25:21.343 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-14T11:25:21.344 INFO:teuthology.orchestra.run.smithi050.stdout: "swift_keys": [], 2024-09-14T11:25:21.344 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": [], 2024-09-14T11:25:21.344 INFO:teuthology.orchestra.run.smithi050.stdout: "op_mask": "read, write, delete", 2024-09-14T11:25:21.344 INFO:teuthology.orchestra.run.smithi050.stdout: "default_placement": "", 2024-09-14T11:25:21.344 INFO:teuthology.orchestra.run.smithi050.stdout: "default_storage_class": "", 2024-09-14T11:25:21.344 INFO:teuthology.orchestra.run.smithi050.stdout: "placement_tags": [], 2024-09-14T11:25:21.344 INFO:teuthology.orchestra.run.smithi050.stdout: "bucket_quota": { 2024-09-14T11:25:21.344 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:25:21.344 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:25:21.344 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:25:21.344 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:25:21.344 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:25:21.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:25:21.345 INFO:teuthology.orchestra.run.smithi050.stdout: "user_quota": { 2024-09-14T11:25:21.345 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:25:21.345 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:25:21.345 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:25:21.345 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:25:21.345 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:25:21.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:25:21.345 INFO:teuthology.orchestra.run.smithi050.stdout: "temp_url_keys": [], 2024-09-14T11:25:21.345 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "rgw", 2024-09-14T11:25:21.345 INFO:teuthology.orchestra.run.smithi050.stdout: "mfa_ids": [], 2024-09-14T11:25:21.345 INFO:teuthology.orchestra.run.smithi050.stdout: "account_id": "", 2024-09-14T11:25:21.345 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-09-14T11:25:21.345 INFO:teuthology.orchestra.run.smithi050.stdout: "create_date": "2024-09-14T11:25:21.335357Z", 2024-09-14T11:25:21.345 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-14T11:25:21.345 INFO:teuthology.orchestra.run.smithi050.stdout: "group_ids": [] 2024-09-14T11:25:21.346 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-14T11:25:21.346 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:21.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.344+0000 7f7e9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:21.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.347+0000 7f7fed52e800 20 remove_watcher() i=0 2024-09-14T11:25:21.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.347+0000 7f7fed52e800 2 removed watcher, disabling cache 2024-09-14T11:25:21.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.348+0000 7f7fed52e800 20 remove_watcher() i=1 2024-09-14T11:25:21.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.349+0000 7f7fed52e800 20 remove_watcher() i=2 2024-09-14T11:25:21.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.350+0000 7f7fed52e800 20 remove_watcher() i=3 2024-09-14T11:25:21.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.351+0000 7f7fed52e800 20 remove_watcher() i=4 2024-09-14T11:25:21.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.352+0000 7f7fed52e800 20 remove_watcher() i=5 2024-09-14T11:25:21.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.353+0000 7f7fed52e800 20 remove_watcher() i=6 2024-09-14T11:25:21.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.355+0000 7f7fed52e800 20 remove_watcher() i=7 2024-09-14T11:25:21.366 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 3239100537 --totp-seed 25SX3MZRHWF47BC7RJ6V55EUVYRPAIGTCN5D5JR5LGVMZE3RHC57EC7FBFOEIDQI --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:25:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:21.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.472+0000 7f3392f40800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.473+0000 7f3392f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:21.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.473+0000 7f3392f40800 20 realm 2024-09-14T11:25:21.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.473+0000 7f3392f40800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.474+0000 7f3392f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:21.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.474+0000 7f3392f40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:21.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.474+0000 7f3392f40800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.474+0000 7f3392f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:21.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.474+0000 7f3392f40800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.474+0000 7f3392f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:21.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.474+0000 7f3392f40800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.475+0000 7f3392f40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:21.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.475+0000 7f3392f40800 20 searching for the correct realm 2024-09-14T11:25:21.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.476+0000 7f338ecc7640 0 -- 172.21.15.50:0/2337130641 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x55a899123210 msgr2=0x7f3388014970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:21.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.682+0000 7f338f4c8640 0 -- 172.21.15.50:0/2337130641 >> [v2:172.21.15.118:6826/1082138742,v1:172.21.15.118:6827/1082138742] conn(0x7f338001a020 msgr2=0x7f33800a5140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:21.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.890+0000 7f3392f40800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:25:21.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.890+0000 7f3392f40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:21.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.890+0000 7f3392f40800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:25:21.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.890+0000 7f3392f40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:21.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.890+0000 7f3392f40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:21.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.890+0000 7f3392f40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:21.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.890+0000 7f3392f40800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.890+0000 7f3392f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:21.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.890+0000 7f3392f40800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.890+0000 7f3392f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:21.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.890+0000 7f3392f40800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.891+0000 7f3392f40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:21.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.891+0000 7f3392f40800 20 zone default found 2024-09-14T11:25:21.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.891+0000 7f3392f40800 4 Realm: () 2024-09-14T11:25:21.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.891+0000 7f3392f40800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:25:21.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.891+0000 7f3392f40800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:25:21.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.891+0000 7f3392f40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:21.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.891+0000 7f3392f40800 20 zonegroup default 2024-09-14T11:25:21.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.891+0000 7f3392f40800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.891+0000 7f3392f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:21.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.891+0000 7f3392f40800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.892+0000 7f3392f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:21.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.892+0000 7f3392f40800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.892+0000 7f3392f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:21.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.892+0000 7f3392f40800 20 started sync module instance, tier type = 2024-09-14T11:25:21.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.892+0000 7f3392f40800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:25:21.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.903+0000 7f3392f40800 20 add_watcher() i=0 2024-09-14T11:25:21.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.903+0000 7f3392f40800 20 add_watcher() i=1 2024-09-14T11:25:21.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.903+0000 7f3392f40800 20 add_watcher() i=2 2024-09-14T11:25:21.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.903+0000 7f3392f40800 20 add_watcher() i=3 2024-09-14T11:25:21.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.903+0000 7f3392f40800 20 add_watcher() i=4 2024-09-14T11:25:21.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.903+0000 7f3392f40800 20 add_watcher() i=5 2024-09-14T11:25:21.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.903+0000 7f3392f40800 20 add_watcher() i=6 2024-09-14T11:25:21.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.904+0000 7f3392f40800 20 add_watcher() i=7 2024-09-14T11:25:21.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.904+0000 7f3392f40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:21.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.906+0000 7f3245fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:21.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.906+0000 7f3392f40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:21.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.906+0000 7f3392f40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:21.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.906+0000 7f3392f40800 5 note: GC not initialized 2024-09-14T11:25:21.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.906+0000 7f3244fe1640 20 reqs_thread_entry: start 2024-09-14T11:25:21.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.906+0000 7f3392f40800 20 init_complete bucket index max shards: 11 2024-09-14T11:25:21.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.906+0000 7f3392f40800 20 Filter name: none 2024-09-14T11:25:21.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.907+0000 7f323e7fc640 20 reqs_thread_entry: start 2024-09-14T11:25:21.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.907+0000 7f3392f40800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T11:25:21.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.907+0000 7f3392f40800 20 rados->read ofs=0 len=0 2024-09-14T11:25:21.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.907+0000 7f3392f40800 20 rados_obj.operate() r=0 bl.length=519 2024-09-14T11:25:21.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.907+0000 7f3392f40800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-14T11:25:21.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.907+0000 7f3392f40800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:25:21.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.907+0000 7f3392f40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:25:21.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.911+0000 7f3392f40800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:25:21.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.911+0000 7f3392f40800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:25:21.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.911+0000 7f3392f40800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T11:25:21.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.911+0000 7f32727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399162 cookie 94182612406592 notifier 8561 bl.length()=733 2024-09-14T11:25:21.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.911+0000 7f32727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:25:21.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.911+0000 7f32727fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:25:21.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.914+0000 7f3245fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:21.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.916+0000 7f3392f40800 20 remove_watcher() i=0 2024-09-14T11:25:21.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.916+0000 7f3392f40800 2 removed watcher, disabling cache 2024-09-14T11:25:21.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.918+0000 7f3392f40800 20 remove_watcher() i=1 2024-09-14T11:25:21.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.919+0000 7f3392f40800 20 remove_watcher() i=2 2024-09-14T11:25:21.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.920+0000 7f3392f40800 20 remove_watcher() i=3 2024-09-14T11:25:21.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.921+0000 7f3392f40800 20 remove_watcher() i=4 2024-09-14T11:25:21.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.923+0000 7f3392f40800 20 remove_watcher() i=5 2024-09-14T11:25:21.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.924+0000 7f3392f40800 20 remove_watcher() i=6 2024-09-14T11:25:21.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:21.925+0000 7f3392f40800 20 remove_watcher() i=7 2024-09-14T11:25:21.937 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-14T11:25:21.937 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key VELRJRSKOYHODTLIVOKN --secret EQZMTXhx4a3+LJtGriSltlrAeeWNat28p26ucJkLBV9CYNKbFIlplg== --cluster ceph 2024-09-14T11:25:22.006 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:22.006 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:22.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.043+0000 7fdf7d125800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.045+0000 7fdf7d125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:22.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.045+0000 7fdf7d125800 20 realm 2024-09-14T11:25:22.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.045+0000 7fdf7d125800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.045+0000 7fdf7d125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:22.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.045+0000 7fdf7d125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:22.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.045+0000 7fdf7d125800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.045+0000 7fdf7d125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:22.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.045+0000 7fdf7d125800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.046+0000 7fdf7d125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:22.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.046+0000 7fdf7d125800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.047+0000 7fdf7d125800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:22.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.047+0000 7fdf7d125800 20 searching for the correct realm 2024-09-14T11:25:22.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.048+0000 7fdf78dae640 0 -- 172.21.15.50:0/996478176 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x7fdf64003c90 msgr2=0x7fdf700658a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:22.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.253+0000 7fdf795af640 0 -- 172.21.15.50:0/996478176 >> [v2:172.21.15.118:6826/1082138742,v1:172.21.15.118:6827/1082138742] conn(0x7fdf68055410 msgr2=0x7fdf68055890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:22.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.461+0000 7fdf7d125800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:25:22.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.461+0000 7fdf7d125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:22.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.461+0000 7fdf7d125800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:25:22.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.461+0000 7fdf7d125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:22.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.461+0000 7fdf7d125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:22.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.461+0000 7fdf7d125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:22.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.461+0000 7fdf7d125800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.462+0000 7fdf7d125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:22.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.462+0000 7fdf7d125800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.462+0000 7fdf7d125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:22.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.462+0000 7fdf7d125800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.462+0000 7fdf7d125800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:22.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.462+0000 7fdf7d125800 20 zone default found 2024-09-14T11:25:22.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.462+0000 7fdf7d125800 4 Realm: () 2024-09-14T11:25:22.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.462+0000 7fdf7d125800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:25:22.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.462+0000 7fdf7d125800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:25:22.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.462+0000 7fdf7d125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:22.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.462+0000 7fdf7d125800 20 zonegroup default 2024-09-14T11:25:22.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.462+0000 7fdf7d125800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.463+0000 7fdf7d125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:22.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.463+0000 7fdf7d125800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.463+0000 7fdf7d125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:22.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.463+0000 7fdf7d125800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.463+0000 7fdf7d125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:22.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.463+0000 7fdf7d125800 20 started sync module instance, tier type = 2024-09-14T11:25:22.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.463+0000 7fdf7d125800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:25:22.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.473+0000 7fdf7d125800 20 add_watcher() i=0 2024-09-14T11:25:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.473+0000 7fdf7d125800 20 add_watcher() i=1 2024-09-14T11:25:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.473+0000 7fdf7d125800 20 add_watcher() i=2 2024-09-14T11:25:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.473+0000 7fdf7d125800 20 add_watcher() i=3 2024-09-14T11:25:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.473+0000 7fdf7d125800 20 add_watcher() i=4 2024-09-14T11:25:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.473+0000 7fdf7d125800 20 add_watcher() i=5 2024-09-14T11:25:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.473+0000 7fdf7d125800 20 add_watcher() i=6 2024-09-14T11:25:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.474+0000 7fdf7d125800 20 add_watcher() i=7 2024-09-14T11:25:22.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.475+0000 7fdf7d125800 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:22.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.476+0000 7fde2efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:22.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.477+0000 7fdf7d125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:22.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.477+0000 7fdf7d125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.477+0000 7fdf7d125800 5 note: GC not initialized 2024-09-14T11:25:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.477+0000 7fde2dfe3640 20 reqs_thread_entry: start 2024-09-14T11:25:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.477+0000 7fdf7d125800 20 init_complete bucket index max shards: 11 2024-09-14T11:25:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.477+0000 7fdf7d125800 20 Filter name: none 2024-09-14T11:25:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.477+0000 7fdd9f7fe640 20 reqs_thread_entry: start 2024-09-14T11:25:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.477+0000 7fdf7d125800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:25:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.477+0000 7fdf7d125800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.478+0000 7fdf7d125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.478+0000 7fdf7d125800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-14T11:25:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.478+0000 7fdf7d125800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:25:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.478+0000 7fdf7d125800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-14T11:25:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.478+0000 7fdf7d125800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.478+0000 7fdf7d125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.478+0000 7fdf7d125800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-14T11:25:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.478+0000 7fdf7d125800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:25:22.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.478+0000 7fdf7d125800 10 cache get: name=default.rgw.meta+users.keys+VELRJRSKOYHODTLIVOKN : miss 2024-09-14T11:25:22.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.478+0000 7fdf7d125800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.478+0000 7fdf7d125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:22.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.478+0000 7fdf7d125800 10 cache put: name=default.rgw.meta+users.keys+VELRJRSKOYHODTLIVOKN info.flags=0x0 2024-09-14T11:25:22.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.478+0000 7fdf7d125800 10 adding default.rgw.meta+users.keys+VELRJRSKOYHODTLIVOKN to cache LRU end 2024-09-14T11:25:22.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.478+0000 7fdf7d125800 10 cache get: name=default.rgw.meta+users.keys+VELRJRSKOYHODTLIVOKN : hit (negative entry) 2024-09-14T11:25:22.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.478+0000 7fdf7d125800 10 cache get: name=default.rgw.meta+users.keys+VELRJRSKOYHODTLIVOKN : hit (negative entry) 2024-09-14T11:25:22.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.480+0000 7fdf7d125800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:25:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.480+0000 7fdf7d125800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:25:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.480+0000 7fdf7d125800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:25:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.480+0000 7fde4ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399163 cookie 94169572911136 notifier 8576 bl.length()=660 2024-09-14T11:25:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.480+0000 7fde4ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:25:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.480+0000 7fde4ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:25:22.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.483+0000 7fdf7d125800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T11:25:22.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.483+0000 7fdf7d125800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:25:22.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.483+0000 7fdf7d125800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-14T11:25:22.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.483+0000 7fde4ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399149 cookie 94169572886512 notifier 8576 bl.length()=191 2024-09-14T11:25:22.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.483+0000 7fde4ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T11:25:22.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.483+0000 7fde4ffff640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:25:22.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.486+0000 7fdf7d125800 10 cache put: name=default.rgw.meta+users.keys+VELRJRSKOYHODTLIVOKN info.flags=0x7 2024-09-14T11:25:22.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.486+0000 7fdf7d125800 10 moving default.rgw.meta+users.keys+VELRJRSKOYHODTLIVOKN to cache LRU end 2024-09-14T11:25:22.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.486+0000 7fdf7d125800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:VELRJRSKOYHODTLIVOKN, ofs0, ns] 2024-09-14T11:25:22.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.487+0000 7fde4f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399150 cookie 94169572902592 notifier 8576 bl.length()=189 2024-09-14T11:25:22.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.487+0000 7fde4f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+VELRJRSKOYHODTLIVOKN info.flags=0x7 2024-09-14T11:25:22.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.487+0000 7fde4f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+VELRJRSKOYHODTLIVOKN to cache LRU end 2024-09-14T11:25:22.487 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-14T11:25:22.487 INFO:teuthology.orchestra.run.smithi050.stdout: "user_id": "foobar.client.0", 2024-09-14T11:25:22.487 INFO:teuthology.orchestra.run.smithi050.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T11:25:22.487 INFO:teuthology.orchestra.run.smithi050.stdout: "email": "foobar+test@test.test", 2024-09-14T11:25:22.487 INFO:teuthology.orchestra.run.smithi050.stdout: "suspended": 0, 2024-09-14T11:25:22.488 INFO:teuthology.orchestra.run.smithi050.stdout: "max_buckets": 1000, 2024-09-14T11:25:22.488 INFO:teuthology.orchestra.run.smithi050.stdout: "subusers": [], 2024-09-14T11:25:22.488 INFO:teuthology.orchestra.run.smithi050.stdout: "keys": [ 2024-09-14T11:25:22.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-14T11:25:22.488 INFO:teuthology.orchestra.run.smithi050.stdout: "user": "foobar.client.0", 2024-09-14T11:25:22.488 INFO:teuthology.orchestra.run.smithi050.stdout: "access_key": "VELRJRSKOYHODTLIVOKN", 2024-09-14T11:25:22.488 INFO:teuthology.orchestra.run.smithi050.stdout: "secret_key": "EQZMTXhx4a3+LJtGriSltlrAeeWNat28p26ucJkLBV9CYNKbFIlplg==", 2024-09-14T11:25:22.488 INFO:teuthology.orchestra.run.smithi050.stdout: "active": true, 2024-09-14T11:25:22.488 INFO:teuthology.orchestra.run.smithi050.stdout: "create_date": "2024-09-14T11:25:22.480050Z" 2024-09-14T11:25:22.488 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-14T11:25:22.488 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-14T11:25:22.488 INFO:teuthology.orchestra.run.smithi050.stdout: "swift_keys": [], 2024-09-14T11:25:22.488 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": [], 2024-09-14T11:25:22.488 INFO:teuthology.orchestra.run.smithi050.stdout: "op_mask": "read, write, delete", 2024-09-14T11:25:22.489 INFO:teuthology.orchestra.run.smithi050.stdout: "default_placement": "", 2024-09-14T11:25:22.489 INFO:teuthology.orchestra.run.smithi050.stdout: "default_storage_class": "", 2024-09-14T11:25:22.489 INFO:teuthology.orchestra.run.smithi050.stdout: "placement_tags": [], 2024-09-14T11:25:22.489 INFO:teuthology.orchestra.run.smithi050.stdout: "bucket_quota": { 2024-09-14T11:25:22.489 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:25:22.489 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:25:22.489 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:25:22.489 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:25:22.489 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:25:22.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:25:22.489 INFO:teuthology.orchestra.run.smithi050.stdout: "user_quota": { 2024-09-14T11:25:22.489 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:25:22.489 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:25:22.489 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:25:22.490 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:25:22.490 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:25:22.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:25:22.490 INFO:teuthology.orchestra.run.smithi050.stdout: "temp_url_keys": [], 2024-09-14T11:25:22.490 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "rgw", 2024-09-14T11:25:22.490 INFO:teuthology.orchestra.run.smithi050.stdout: "mfa_ids": [], 2024-09-14T11:25:22.490 INFO:teuthology.orchestra.run.smithi050.stdout: "account_id": "", 2024-09-14T11:25:22.490 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-09-14T11:25:22.490 INFO:teuthology.orchestra.run.smithi050.stdout: "create_date": "2024-09-14T11:25:22.480040Z", 2024-09-14T11:25:22.490 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-14T11:25:22.490 INFO:teuthology.orchestra.run.smithi050.stdout: "group_ids": [] 2024-09-14T11:25:22.490 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-14T11:25:22.490 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:22.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.489+0000 7fde2efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:22.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.492+0000 7fdf7d125800 20 remove_watcher() i=0 2024-09-14T11:25:22.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.492+0000 7fdf7d125800 2 removed watcher, disabling cache 2024-09-14T11:25:22.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.493+0000 7fdf7d125800 20 remove_watcher() i=1 2024-09-14T11:25:22.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.494+0000 7fdf7d125800 20 remove_watcher() i=2 2024-09-14T11:25:22.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.495+0000 7fdf7d125800 20 remove_watcher() i=3 2024-09-14T11:25:22.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.496+0000 7fdf7d125800 20 remove_watcher() i=4 2024-09-14T11:25:22.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.497+0000 7fdf7d125800 20 remove_watcher() i=5 2024-09-14T11:25:22.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.498+0000 7fdf7d125800 20 remove_watcher() i=6 2024-09-14T11:25:22.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.500+0000 7fdf7d125800 20 remove_watcher() i=7 2024-09-14T11:25:22.511 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 1714390487 --totp-seed YLWF4IZQ5BC2CE3OMJJXB45UALDBED7XF6N6HBF57GQVZMS4DMZC3VADUQNSLOYE --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:25:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:22.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.617+0000 7feea9820800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.618+0000 7feea9820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:22.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.618+0000 7feea9820800 20 realm 2024-09-14T11:25:22.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.618+0000 7feea9820800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.618+0000 7feea9820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:22.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.618+0000 7feea9820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:22.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.618+0000 7feea9820800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.619+0000 7feea9820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:22.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.619+0000 7feea9820800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.619+0000 7feea9820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:22.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.619+0000 7feea9820800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.620+0000 7feea9820800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:22.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.620+0000 7feea9820800 20 searching for the correct realm 2024-09-14T11:25:22.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.623+0000 7feea6b09640 0 -- 172.21.15.50:0/1829572714 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7feea0040930 msgr2=0x7feea0030410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:22.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.828+0000 7feea7b0b640 0 -- 172.21.15.50:0/1829572714 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55c7b6f69180 msgr2=0x55c7b6f6b640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:22.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.832+0000 7feea9820800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:25:22.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.832+0000 7feea9820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:22.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.832+0000 7feea9820800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:25:22.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.832+0000 7feea9820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:22.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.832+0000 7feea9820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:22.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.832+0000 7feea9820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:22.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.832+0000 7feea9820800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.833+0000 7feea9820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:22.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.833+0000 7feea9820800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.833+0000 7feea9820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:22.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.833+0000 7feea9820800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.833+0000 7feea9820800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:22.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.833+0000 7feea9820800 20 zone default found 2024-09-14T11:25:22.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.833+0000 7feea9820800 4 Realm: () 2024-09-14T11:25:22.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.833+0000 7feea9820800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:25:22.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.833+0000 7feea9820800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:25:22.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.833+0000 7feea9820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:22.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.833+0000 7feea9820800 20 zonegroup default 2024-09-14T11:25:22.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.833+0000 7feea9820800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.833+0000 7feea9820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:22.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.833+0000 7feea9820800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.834+0000 7feea9820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:22.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.834+0000 7feea9820800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.834+0000 7feea9820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:22.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.834+0000 7feea9820800 20 started sync module instance, tier type = 2024-09-14T11:25:22.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.834+0000 7feea9820800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:25:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.844+0000 7feea9820800 20 add_watcher() i=0 2024-09-14T11:25:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.844+0000 7feea9820800 20 add_watcher() i=1 2024-09-14T11:25:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.844+0000 7feea9820800 20 add_watcher() i=2 2024-09-14T11:25:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.844+0000 7feea9820800 20 add_watcher() i=3 2024-09-14T11:25:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.844+0000 7feea9820800 20 add_watcher() i=4 2024-09-14T11:25:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.844+0000 7feea9820800 20 add_watcher() i=5 2024-09-14T11:25:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.844+0000 7feea9820800 20 add_watcher() i=6 2024-09-14T11:25:22.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.845+0000 7feea9820800 20 add_watcher() i=7 2024-09-14T11:25:22.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.845+0000 7feea9820800 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:22.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.847+0000 7fed5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:22.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.847+0000 7feea9820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:22.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.847+0000 7feea9820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:22.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.847+0000 7feea9820800 5 note: GC not initialized 2024-09-14T11:25:22.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.847+0000 7fed5cfe1640 20 reqs_thread_entry: start 2024-09-14T11:25:22.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.847+0000 7feea9820800 20 init_complete bucket index max shards: 11 2024-09-14T11:25:22.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.847+0000 7feea9820800 20 Filter name: none 2024-09-14T11:25:22.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.848+0000 7fecd67fc640 20 reqs_thread_entry: start 2024-09-14T11:25:22.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.848+0000 7feea9820800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:25:22.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.848+0000 7feea9820800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.848+0000 7feea9820800 20 rados_obj.operate() r=0 bl.length=472 2024-09-14T11:25:22.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.848+0000 7feea9820800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T11:25:22.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.848+0000 7feea9820800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:25:22.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.849+0000 7feea9820800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:25:22.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.851+0000 7feea9820800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:25:22.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.851+0000 7feea9820800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:25:22.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.851+0000 7feea9820800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:25:22.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.851+0000 7fed8affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399164 cookie 94316256548096 notifier 9261 bl.length()=674 2024-09-14T11:25:22.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.851+0000 7fed8affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:25:22.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.851+0000 7fed8affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:25:22.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.854+0000 7fed5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:22.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.856+0000 7feea9820800 20 remove_watcher() i=0 2024-09-14T11:25:22.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.856+0000 7feea9820800 2 removed watcher, disabling cache 2024-09-14T11:25:22.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.858+0000 7feea9820800 20 remove_watcher() i=1 2024-09-14T11:25:22.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.859+0000 7feea9820800 20 remove_watcher() i=2 2024-09-14T11:25:22.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.860+0000 7feea9820800 20 remove_watcher() i=3 2024-09-14T11:25:22.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.861+0000 7feea9820800 20 remove_watcher() i=4 2024-09-14T11:25:22.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.862+0000 7feea9820800 20 remove_watcher() i=5 2024-09-14T11:25:22.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.863+0000 7feea9820800 20 remove_watcher() i=6 2024-09-14T11:25:22.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.864+0000 7feea9820800 20 remove_watcher() i=7 2024-09-14T11:25:22.875 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-14T11:25:22.934 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:22.935 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:22.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.972+0000 7f65d5519800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.974+0000 7f65d5519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:22.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.974+0000 7f65d5519800 20 realm 2024-09-14T11:25:22.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.974+0000 7f65d5519800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.974+0000 7f65d5519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:22.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.974+0000 7f65d5519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:22.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.974+0000 7f65d5519800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.974+0000 7f65d5519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:22.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.974+0000 7f65d5519800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.975+0000 7f65d5519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:22.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.975+0000 7f65d5519800 20 rados->read ofs=0 len=0 2024-09-14T11:25:22.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.976+0000 7f65d5519800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:22.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.976+0000 7f65d5519800 20 searching for the correct realm 2024-09-14T11:25:22.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:22.979+0000 7f65d2809640 0 -- 172.21.15.50:0/478486372 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f65cc00e040 msgr2=0x7f65cc06f040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:23.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.186+0000 7f65d380b640 0 -- 172.21.15.50:0/478486372 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55efde75c250 msgr2=0x55efde75e6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:23.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.190+0000 7f65d5519800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:25:23.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.190+0000 7f65d5519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:23.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.190+0000 7f65d5519800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:25:23.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.190+0000 7f65d5519800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:23.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.190+0000 7f65d5519800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:23.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.190+0000 7f65d5519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:23.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.190+0000 7f65d5519800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.190+0000 7f65d5519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:23.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.190+0000 7f65d5519800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.191+0000 7f65d5519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:23.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.191+0000 7f65d5519800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.191+0000 7f65d5519800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:23.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.191+0000 7f65d5519800 20 zone default found 2024-09-14T11:25:23.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.191+0000 7f65d5519800 4 Realm: () 2024-09-14T11:25:23.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.191+0000 7f65d5519800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:25:23.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.191+0000 7f65d5519800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:25:23.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.191+0000 7f65d5519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:23.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.191+0000 7f65d5519800 20 zonegroup default 2024-09-14T11:25:23.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.191+0000 7f65d5519800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.191+0000 7f65d5519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:23.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.191+0000 7f65d5519800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.192+0000 7f65d5519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:23.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.192+0000 7f65d5519800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.192+0000 7f65d5519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:23.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.192+0000 7f65d5519800 20 started sync module instance, tier type = 2024-09-14T11:25:23.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.192+0000 7f65d5519800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:25:23.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.202+0000 7f65d5519800 20 add_watcher() i=0 2024-09-14T11:25:23.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.202+0000 7f65d5519800 20 add_watcher() i=1 2024-09-14T11:25:23.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.202+0000 7f65d5519800 20 add_watcher() i=2 2024-09-14T11:25:23.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.202+0000 7f65d5519800 20 add_watcher() i=3 2024-09-14T11:25:23.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.202+0000 7f65d5519800 20 add_watcher() i=4 2024-09-14T11:25:23.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.202+0000 7f65d5519800 20 add_watcher() i=5 2024-09-14T11:25:23.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.202+0000 7f65d5519800 20 add_watcher() i=6 2024-09-14T11:25:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.204+0000 7f65d5519800 20 add_watcher() i=7 2024-09-14T11:25:23.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.204+0000 7f65d5519800 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.205+0000 7f6489fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.205+0000 7f65d5519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.205+0000 7f65d5519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.206+0000 7f65d5519800 5 note: GC not initialized 2024-09-14T11:25:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.206+0000 7f6488fe1640 20 reqs_thread_entry: start 2024-09-14T11:25:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.206+0000 7f65d5519800 20 init_complete bucket index max shards: 11 2024-09-14T11:25:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.206+0000 7f65d5519800 20 Filter name: none 2024-09-14T11:25:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.206+0000 7f64027fc640 20 reqs_thread_entry: start 2024-09-14T11:25:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.206+0000 7f65d5519800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:25:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.206+0000 7f65d5519800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.207+0000 7f65d5519800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:25:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.207+0000 7f65d5519800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T11:25:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.207+0000 7f65d5519800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:25:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.207+0000 7f65d5519800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:25:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.208+0000 7f65d5519800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:25:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.208+0000 7f65d5519800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:25:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.208+0000 7f65d5519800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:25:23.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.209+0000 7f64b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399165 cookie 94488717889520 notifier 8612 bl.length()=727 2024-09-14T11:25:23.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.209+0000 7f64b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:25:23.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.209+0000 7f64b6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:25:23.210 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-14T11:25:23.210 INFO:teuthology.orchestra.run.smithi050.stdout: "user_id": "foobar.client.0", 2024-09-14T11:25:23.210 INFO:teuthology.orchestra.run.smithi050.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T11:25:23.210 INFO:teuthology.orchestra.run.smithi050.stdout: "email": "foobar+test@test.test", 2024-09-14T11:25:23.210 INFO:teuthology.orchestra.run.smithi050.stdout: "suspended": 0, 2024-09-14T11:25:23.210 INFO:teuthology.orchestra.run.smithi050.stdout: "max_buckets": 1000, 2024-09-14T11:25:23.210 INFO:teuthology.orchestra.run.smithi050.stdout: "subusers": [], 2024-09-14T11:25:23.210 INFO:teuthology.orchestra.run.smithi050.stdout: "keys": [ 2024-09-14T11:25:23.210 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-14T11:25:23.210 INFO:teuthology.orchestra.run.smithi050.stdout: "user": "foobar.client.0", 2024-09-14T11:25:23.210 INFO:teuthology.orchestra.run.smithi050.stdout: "access_key": "VELRJRSKOYHODTLIVOKN", 2024-09-14T11:25:23.210 INFO:teuthology.orchestra.run.smithi050.stdout: "secret_key": "EQZMTXhx4a3+LJtGriSltlrAeeWNat28p26ucJkLBV9CYNKbFIlplg==", 2024-09-14T11:25:23.211 INFO:teuthology.orchestra.run.smithi050.stdout: "active": true, 2024-09-14T11:25:23.211 INFO:teuthology.orchestra.run.smithi050.stdout: "create_date": "2024-09-14T11:25:22.480050Z" 2024-09-14T11:25:23.211 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-14T11:25:23.211 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-14T11:25:23.211 INFO:teuthology.orchestra.run.smithi050.stdout: "swift_keys": [], 2024-09-14T11:25:23.211 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": [ 2024-09-14T11:25:23.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-14T11:25:23.211 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "oidc-provider", 2024-09-14T11:25:23.211 INFO:teuthology.orchestra.run.smithi050.stdout: "perm": "*" 2024-09-14T11:25:23.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:25:23.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-14T11:25:23.211 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "roles", 2024-09-14T11:25:23.211 INFO:teuthology.orchestra.run.smithi050.stdout: "perm": "*" 2024-09-14T11:25:23.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:25:23.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-14T11:25:23.212 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "user-policy", 2024-09-14T11:25:23.212 INFO:teuthology.orchestra.run.smithi050.stdout: "perm": "*" 2024-09-14T11:25:23.212 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-14T11:25:23.212 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-14T11:25:23.212 INFO:teuthology.orchestra.run.smithi050.stdout: "op_mask": "read, write, delete", 2024-09-14T11:25:23.212 INFO:teuthology.orchestra.run.smithi050.stdout: "default_placement": "", 2024-09-14T11:25:23.212 INFO:teuthology.orchestra.run.smithi050.stdout: "default_storage_class": "", 2024-09-14T11:25:23.212 INFO:teuthology.orchestra.run.smithi050.stdout: "placement_tags": [], 2024-09-14T11:25:23.212 INFO:teuthology.orchestra.run.smithi050.stdout: "bucket_quota": { 2024-09-14T11:25:23.212 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:25:23.212 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:25:23.212 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:25:23.213 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:25:23.213 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:25:23.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:25:23.213 INFO:teuthology.orchestra.run.smithi050.stdout: "user_quota": { 2024-09-14T11:25:23.213 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:25:23.213 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:25:23.213 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:25:23.213 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:25:23.213 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:25:23.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:25:23.213 INFO:teuthology.orchestra.run.smithi050.stdout: "temp_url_keys": [], 2024-09-14T11:25:23.213 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "rgw", 2024-09-14T11:25:23.213 INFO:teuthology.orchestra.run.smithi050.stdout: "mfa_ids": [ 2024-09-14T11:25:23.213 INFO:teuthology.orchestra.run.smithi050.stdout: "1714390487" 2024-09-14T11:25:23.213 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-14T11:25:23.214 INFO:teuthology.orchestra.run.smithi050.stdout: "account_id": "", 2024-09-14T11:25:23.214 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-09-14T11:25:23.214 INFO:teuthology.orchestra.run.smithi050.stdout: "create_date": "2024-09-14T11:25:22.480040Z", 2024-09-14T11:25:23.214 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-14T11:25:23.214 INFO:teuthology.orchestra.run.smithi050.stdout: "group_ids": [] 2024-09-14T11:25:23.214 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-14T11:25:23.214 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:23.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.212+0000 7f6489fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:23.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.214+0000 7f65d5519800 20 remove_watcher() i=0 2024-09-14T11:25:23.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.214+0000 7f65d5519800 2 removed watcher, disabling cache 2024-09-14T11:25:23.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.215+0000 7f65d5519800 20 remove_watcher() i=1 2024-09-14T11:25:23.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.216+0000 7f65d5519800 20 remove_watcher() i=2 2024-09-14T11:25:23.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.217+0000 7f65d5519800 20 remove_watcher() i=3 2024-09-14T11:25:23.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.218+0000 7f65d5519800 20 remove_watcher() i=4 2024-09-14T11:25:23.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.219+0000 7f65d5519800 20 remove_watcher() i=5 2024-09-14T11:25:23.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.220+0000 7f65d5519800 20 remove_watcher() i=6 2024-09-14T11:25:23.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.221+0000 7f65d5519800 20 remove_watcher() i=7 2024-09-14T11:25:23.232 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-14T11:25:23.295 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:23.296 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:23.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.332+0000 7fb33a80f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.334+0000 7fb33a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.335+0000 7fb33a80f800 20 realm 2024-09-14T11:25:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.335+0000 7fb33a80f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.335+0000 7fb33a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.335+0000 7fb33a80f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.335+0000 7fb33a80f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.335+0000 7fb33a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:23.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.335+0000 7fb33a80f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.336+0000 7fb33a80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:23.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.336+0000 7fb33a80f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.336+0000 7fb33a80f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:23.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.337+0000 7fb33a80f800 20 searching for the correct realm 2024-09-14T11:25:23.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.340+0000 7fb337aff640 0 -- 172.21.15.50:0/3033933367 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fb330089b00 msgr2=0x7fb330060320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.546+0000 7fb338b01640 0 -- 172.21.15.50:0/3033933367 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55725207d2d0 msgr2=0x55725207f760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.550+0000 7fb33a80f800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:25:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.550+0000 7fb33a80f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.550+0000 7fb33a80f800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:25:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.550+0000 7fb33a80f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.550+0000 7fb33a80f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.550+0000 7fb33a80f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.550+0000 7fb33a80f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.550+0000 7fb33a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.550+0000 7fb33a80f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.551+0000 7fb33a80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.551+0000 7fb33a80f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.551+0000 7fb33a80f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.551+0000 7fb33a80f800 20 zone default found 2024-09-14T11:25:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.551+0000 7fb33a80f800 4 Realm: () 2024-09-14T11:25:23.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.551+0000 7fb33a80f800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:25:23.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.551+0000 7fb33a80f800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:25:23.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.551+0000 7fb33a80f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:23.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.551+0000 7fb33a80f800 20 zonegroup default 2024-09-14T11:25:23.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.551+0000 7fb33a80f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.551+0000 7fb33a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.551+0000 7fb33a80f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.552+0000 7fb33a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.552+0000 7fb33a80f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.552+0000 7fb33a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.552+0000 7fb33a80f800 20 started sync module instance, tier type = 2024-09-14T11:25:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.552+0000 7fb33a80f800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:25:23.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.561+0000 7fb33a80f800 20 add_watcher() i=0 2024-09-14T11:25:23.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.561+0000 7fb33a80f800 20 add_watcher() i=1 2024-09-14T11:25:23.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.561+0000 7fb33a80f800 20 add_watcher() i=2 2024-09-14T11:25:23.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.561+0000 7fb33a80f800 20 add_watcher() i=3 2024-09-14T11:25:23.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.561+0000 7fb33a80f800 20 add_watcher() i=4 2024-09-14T11:25:23.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.561+0000 7fb33a80f800 20 add_watcher() i=5 2024-09-14T11:25:23.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.561+0000 7fb33a80f800 20 add_watcher() i=6 2024-09-14T11:25:23.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.562+0000 7fb33a80f800 20 add_watcher() i=7 2024-09-14T11:25:23.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.562+0000 7fb33a80f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:23.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.564+0000 7fb1eefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:23.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.564+0000 7fb33a80f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:23.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.564+0000 7fb33a80f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:23.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.564+0000 7fb33a80f800 5 note: GC not initialized 2024-09-14T11:25:23.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.565+0000 7fb1edfdb640 20 reqs_thread_entry: start 2024-09-14T11:25:23.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.565+0000 7fb33a80f800 20 init_complete bucket index max shards: 11 2024-09-14T11:25:23.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.565+0000 7fb33a80f800 20 Filter name: none 2024-09-14T11:25:23.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.565+0000 7fb15f7fe640 20 reqs_thread_entry: start 2024-09-14T11:25:23.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.565+0000 7fb33a80f800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-14T11:25:23.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.565+0000 7fb33a80f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.566+0000 7fb33a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:23.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.566+0000 7fb33a80f800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-14T11:25:23.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.566+0000 7fb33a80f800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:25:23.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.566+0000 7fb33a80f800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-14T11:25:23.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.566+0000 7fb33a80f800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-14T11:25:23.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.566+0000 7fb33a80f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.566+0000 7fb33a80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:23.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.566+0000 7fb33a80f800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-14T11:25:23.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.566+0000 7fb33a80f800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:25:23.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.566+0000 7fb33a80f800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-14T11:25:23.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.568+0000 7fb33a80f800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:25:23.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.568+0000 7fb33a80f800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:25:23.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.568+0000 7fb33a80f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-14T11:25:23.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.568+0000 7fb20f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399151 cookie 93949490885264 notifier 8630 bl.length()=384 2024-09-14T11:25:23.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.568+0000 7fb20f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:25:23.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.568+0000 7fb20f7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:25:23.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.571+0000 7fb33a80f800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T11:25:23.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.571+0000 7fb33a80f800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:25:23.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.571+0000 7fb33a80f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-14T11:25:23.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.571+0000 7fb20effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399152 cookie 93949490954848 notifier 8630 bl.length()=225 2024-09-14T11:25:23.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.571+0000 7fb20effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T11:25:23.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.571+0000 7fb20effd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:25:23.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.574+0000 7fb33a80f800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T11:25:23.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.574+0000 7fb33a80f800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:25:23.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.574+0000 7fb33a80f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-14T11:25:23.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.574+0000 7fb20effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398919 cookie 93949490952544 notifier 8630 bl.length()=234 2024-09-14T11:25:23.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.574+0000 7fb20effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T11:25:23.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.574+0000 7fb20effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:25:23.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.576+0000 7fb1eefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:23.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.579+0000 7fb33a80f800 20 remove_watcher() i=0 2024-09-14T11:25:23.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.579+0000 7fb33a80f800 2 removed watcher, disabling cache 2024-09-14T11:25:23.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.580+0000 7fb33a80f800 20 remove_watcher() i=1 2024-09-14T11:25:23.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.581+0000 7fb33a80f800 20 remove_watcher() i=2 2024-09-14T11:25:23.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.582+0000 7fb33a80f800 20 remove_watcher() i=3 2024-09-14T11:25:23.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.583+0000 7fb33a80f800 20 remove_watcher() i=4 2024-09-14T11:25:23.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.584+0000 7fb33a80f800 20 remove_watcher() i=5 2024-09-14T11:25:23.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.585+0000 7fb33a80f800 20 remove_watcher() i=6 2024-09-14T11:25:23.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.586+0000 7fb33a80f800 20 remove_watcher() i=7 2024-09-14T11:25:23.594 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-14T11:25:23.595 INFO:teuthology.orchestra.run.smithi050.stdout: "id": "RGW88888888888888888", 2024-09-14T11:25:23.595 INFO:teuthology.orchestra.run.smithi050.stdout: "tenant": "", 2024-09-14T11:25:23.595 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "Mr.RGW88888888888888888", 2024-09-14T11:25:23.595 INFO:teuthology.orchestra.run.smithi050.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-14T11:25:23.595 INFO:teuthology.orchestra.run.smithi050.stdout: "quota": { 2024-09-14T11:25:23.595 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:25:23.595 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:25:23.595 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:25:23.595 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:25:23.595 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:25:23.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:25:23.595 INFO:teuthology.orchestra.run.smithi050.stdout: "bucket_quota": { 2024-09-14T11:25:23.595 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:25:23.595 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:25:23.596 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:25:23.596 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:25:23.596 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:25:23.596 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:25:23.596 INFO:teuthology.orchestra.run.smithi050.stdout: "max_users": 1000, 2024-09-14T11:25:23.596 INFO:teuthology.orchestra.run.smithi050.stdout: "max_roles": 1000, 2024-09-14T11:25:23.596 INFO:teuthology.orchestra.run.smithi050.stdout: "max_groups": 1000, 2024-09-14T11:25:23.596 INFO:teuthology.orchestra.run.smithi050.stdout: "max_buckets": 1000, 2024-09-14T11:25:23.596 INFO:teuthology.orchestra.run.smithi050.stdout: "max_access_keys": 4 2024-09-14T11:25:23.596 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-14T11:25:23.597 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-14T11:25:23.597 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key NEAZFOUJQPLYEVXWQVEE --secret JPHUaEtC5KqhskrPZnlKI3LjGAZfTJU5Fk2s4623sbo5Hophh4QhiA== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-14T11:25:23.667 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:23.667 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:23.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.704+0000 7efe44e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.706+0000 7efe44e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:23.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.706+0000 7efe44e2f800 20 realm 2024-09-14T11:25:23.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.706+0000 7efe44e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.706+0000 7efe44e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:23.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.706+0000 7efe44e2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:23.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.706+0000 7efe44e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.706+0000 7efe44e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:23.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.706+0000 7efe44e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.707+0000 7efe44e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:23.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.707+0000 7efe44e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.707+0000 7efe44e2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:23.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.707+0000 7efe44e2f800 20 searching for the correct realm 2024-09-14T11:25:23.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.710+0000 7efe4211f640 0 -- 172.21.15.50:0/2967733942 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7efe3c061580 msgr2=0x7efe3c002860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:23.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.915+0000 7efe43121640 0 -- 172.21.15.50:0/2967733942 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55aee484e1f0 msgr2=0x55aee4850680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:23.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.920+0000 7efe44e2f800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:25:23.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.920+0000 7efe44e2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:23.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.920+0000 7efe44e2f800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:25:23.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.920+0000 7efe44e2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:23.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.920+0000 7efe44e2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:23.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.920+0000 7efe44e2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:23.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.920+0000 7efe44e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.920+0000 7efe44e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:23.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.920+0000 7efe44e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.921+0000 7efe44e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:23.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.921+0000 7efe44e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.921+0000 7efe44e2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:23.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.921+0000 7efe44e2f800 20 zone default found 2024-09-14T11:25:23.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.921+0000 7efe44e2f800 4 Realm: () 2024-09-14T11:25:23.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.921+0000 7efe44e2f800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:25:23.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.921+0000 7efe44e2f800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:25:23.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.921+0000 7efe44e2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:23.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.921+0000 7efe44e2f800 20 zonegroup default 2024-09-14T11:25:23.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.921+0000 7efe44e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.921+0000 7efe44e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:23.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.921+0000 7efe44e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.922+0000 7efe44e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:23.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.922+0000 7efe44e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.922+0000 7efe44e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:23.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.922+0000 7efe44e2f800 20 started sync module instance, tier type = 2024-09-14T11:25:23.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.922+0000 7efe44e2f800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:25:23.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.931+0000 7efe44e2f800 20 add_watcher() i=0 2024-09-14T11:25:23.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.931+0000 7efe44e2f800 20 add_watcher() i=1 2024-09-14T11:25:23.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.931+0000 7efe44e2f800 20 add_watcher() i=2 2024-09-14T11:25:23.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.931+0000 7efe44e2f800 20 add_watcher() i=3 2024-09-14T11:25:23.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.931+0000 7efe44e2f800 20 add_watcher() i=4 2024-09-14T11:25:23.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.931+0000 7efe44e2f800 20 add_watcher() i=5 2024-09-14T11:25:23.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.931+0000 7efe44e2f800 20 add_watcher() i=6 2024-09-14T11:25:23.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.933+0000 7efe44e2f800 20 add_watcher() i=7 2024-09-14T11:25:23.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.933+0000 7efe44e2f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:23.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.934+0000 7efcf97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:23.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.934+0000 7efe44e2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:23.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.934+0000 7efe44e2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:23.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.935+0000 7efe44e2f800 5 note: GC not initialized 2024-09-14T11:25:23.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.935+0000 7efc73fff640 20 reqs_thread_entry: start 2024-09-14T11:25:23.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.935+0000 7efe44e2f800 20 init_complete bucket index max shards: 11 2024-09-14T11:25:23.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.935+0000 7efe44e2f800 20 Filter name: none 2024-09-14T11:25:23.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.935+0000 7efc71ffb640 20 reqs_thread_entry: start 2024-09-14T11:25:23.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.935+0000 7efe44e2f800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T11:25:23.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.935+0000 7efe44e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.936+0000 7efe44e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:23.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.936+0000 7efe44e2f800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-14T11:25:23.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.936+0000 7efe44e2f800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:25:23.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.936+0000 7efe44e2f800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-14T11:25:23.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.936+0000 7efe44e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.936+0000 7efe44e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:23.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.936+0000 7efe44e2f800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-14T11:25:23.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.936+0000 7efe44e2f800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:25:23.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.936+0000 7efe44e2f800 10 cache get: name=default.rgw.meta+users.keys+NEAZFOUJQPLYEVXWQVEE : miss 2024-09-14T11:25:23.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.936+0000 7efe44e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.936+0000 7efe44e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:23.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.936+0000 7efe44e2f800 10 cache put: name=default.rgw.meta+users.keys+NEAZFOUJQPLYEVXWQVEE info.flags=0x0 2024-09-14T11:25:23.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.936+0000 7efe44e2f800 10 adding default.rgw.meta+users.keys+NEAZFOUJQPLYEVXWQVEE to cache LRU end 2024-09-14T11:25:23.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.936+0000 7efe44e2f800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-14T11:25:23.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.936+0000 7efe44e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:23.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.936+0000 7efe44e2f800 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:25:23.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.936+0000 7efe44e2f800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:25:23.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.936+0000 7efe44e2f800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:25:23.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.936+0000 7efe44e2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:25:23.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.937+0000 7efe44e2f800 10 cache get: name=default.rgw.meta+users.keys+NEAZFOUJQPLYEVXWQVEE : hit (negative entry) 2024-09-14T11:25:23.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.937+0000 7efe44e2f800 10 cache get: name=default.rgw.meta+users.keys+NEAZFOUJQPLYEVXWQVEE : hit (negative entry) 2024-09-14T11:25:23.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.938+0000 7efe44e2f800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:25:23.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.938+0000 7efe44e2f800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:25:23.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.938+0000 7efe44e2f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T11:25:23.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.939+0000 7efd267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399153 cookie 94209646651360 notifier 8645 bl.length()=681 2024-09-14T11:25:23.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.939+0000 7efd267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:25:23.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.939+0000 7efd267fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:25:23.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.942+0000 7efe44e2f800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T11:25:23.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.942+0000 7efe44e2f800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:25:23.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.942+0000 7efe44e2f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-14T11:25:23.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.942+0000 7efd25ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399166 cookie 94209646662848 notifier 8645 bl.length()=189 2024-09-14T11:25:23.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.942+0000 7efd25ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T11:25:23.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.942+0000 7efd25ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:25:23.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.945+0000 7efe44e2f800 10 cache put: name=default.rgw.meta+users.keys+NEAZFOUJQPLYEVXWQVEE info.flags=0x7 2024-09-14T11:25:23.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.945+0000 7efe44e2f800 10 moving default.rgw.meta+users.keys+NEAZFOUJQPLYEVXWQVEE to cache LRU end 2024-09-14T11:25:23.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.945+0000 7efe44e2f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:NEAZFOUJQPLYEVXWQVEE, ofs0, ns] 2024-09-14T11:25:23.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.945+0000 7efd25ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398920 cookie 94209646657408 notifier 8645 bl.length()=188 2024-09-14T11:25:23.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.945+0000 7efd25ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NEAZFOUJQPLYEVXWQVEE info.flags=0x7 2024-09-14T11:25:23.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.945+0000 7efd25ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NEAZFOUJQPLYEVXWQVEE to cache LRU end 2024-09-14T11:25:23.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.948+0000 7efe44e2f800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-14T11:25:23.947 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-14T11:25:23.947 INFO:teuthology.orchestra.run.smithi050.stdout: "user_id": "root1.client.0", 2024-09-14T11:25:23.947 INFO:teuthology.orchestra.run.smithi050.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-14T11:25:23.947 INFO:teuthology.orchestra.run.smithi050.stdout: "email": "root1+test@test.test", 2024-09-14T11:25:23.947 INFO:teuthology.orchestra.run.smithi050.stdout: "suspended": 0, 2024-09-14T11:25:23.947 INFO:teuthology.orchestra.run.smithi050.stdout: "max_buckets": 1000, 2024-09-14T11:25:23.947 INFO:teuthology.orchestra.run.smithi050.stdout: "subusers": [], 2024-09-14T11:25:23.947 INFO:teuthology.orchestra.run.smithi050.stdout: "keys": [ 2024-09-14T11:25:23.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-14T11:25:23.948 INFO:teuthology.orchestra.run.smithi050.stdout: "user": "root1.client.0", 2024-09-14T11:25:23.948 INFO:teuthology.orchestra.run.smithi050.stdout: "access_key": "NEAZFOUJQPLYEVXWQVEE", 2024-09-14T11:25:23.948 INFO:teuthology.orchestra.run.smithi050.stdout: "secret_key": "JPHUaEtC5KqhskrPZnlKI3LjGAZfTJU5Fk2s4623sbo5Hophh4QhiA==", 2024-09-14T11:25:23.948 INFO:teuthology.orchestra.run.smithi050.stdout: "active": true, 2024-09-14T11:25:23.948 INFO:teuthology.orchestra.run.smithi050.stdout: "create_date": "2024-09-14T11:25:23.938455Z" 2024-09-14T11:25:23.948 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-14T11:25:23.948 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-14T11:25:23.948 INFO:teuthology.orchestra.run.smithi050.stdout: "swift_keys": [], 2024-09-14T11:25:23.948 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": [], 2024-09-14T11:25:23.948 INFO:teuthology.orchestra.run.smithi050.stdout: "op_mask": "read, write, delete", 2024-09-14T11:25:23.948 INFO:teuthology.orchestra.run.smithi050.stdout: "default_placement": "", 2024-09-14T11:25:23.948 INFO:teuthology.orchestra.run.smithi050.stdout: "default_storage_class": "", 2024-09-14T11:25:23.948 INFO:teuthology.orchestra.run.smithi050.stdout: "placement_tags": [], 2024-09-14T11:25:23.949 INFO:teuthology.orchestra.run.smithi050.stdout: "bucket_quota": { 2024-09-14T11:25:23.949 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:25:23.949 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:25:23.949 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:25:23.949 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:25:23.949 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:25:23.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:25:23.949 INFO:teuthology.orchestra.run.smithi050.stdout: "user_quota": { 2024-09-14T11:25:23.949 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:25:23.949 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:25:23.949 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:25:23.949 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:25:23.949 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:25:23.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:25:23.950 INFO:teuthology.orchestra.run.smithi050.stdout: "temp_url_keys": [], 2024-09-14T11:25:23.950 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "root", 2024-09-14T11:25:23.950 INFO:teuthology.orchestra.run.smithi050.stdout: "mfa_ids": [], 2024-09-14T11:25:23.950 INFO:teuthology.orchestra.run.smithi050.stdout: "account_id": "RGW88888888888888888", 2024-09-14T11:25:23.950 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-09-14T11:25:23.950 INFO:teuthology.orchestra.run.smithi050.stdout: "create_date": "2024-09-14T11:25:23.938442Z", 2024-09-14T11:25:23.950 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-14T11:25:23.950 INFO:teuthology.orchestra.run.smithi050.stdout: "group_ids": [] 2024-09-14T11:25:23.950 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-14T11:25:23.950 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:23.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.949+0000 7efcf97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:23.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.951+0000 7efe44e2f800 20 remove_watcher() i=0 2024-09-14T11:25:23.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.951+0000 7efe44e2f800 2 removed watcher, disabling cache 2024-09-14T11:25:23.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.952+0000 7efe44e2f800 20 remove_watcher() i=1 2024-09-14T11:25:23.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.953+0000 7efe44e2f800 20 remove_watcher() i=2 2024-09-14T11:25:23.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.954+0000 7efe44e2f800 20 remove_watcher() i=3 2024-09-14T11:25:23.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.955+0000 7efe44e2f800 20 remove_watcher() i=4 2024-09-14T11:25:23.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.957+0000 7efe44e2f800 20 remove_watcher() i=5 2024-09-14T11:25:23.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.958+0000 7efe44e2f800 20 remove_watcher() i=6 2024-09-14T11:25:23.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:23.959+0000 7efe44e2f800 20 remove_watcher() i=7 2024-09-14T11:25:23.970 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 0064718526 --totp-seed UAMBO7XDP77V7GXN5OHFYGEDUIL6LF2RPU4YCW7FF6GTKFUKTAOPCV43QP6K5KQU --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:25:24.038 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:24.038 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:24.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.075+0000 7fef17b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.077+0000 7fef17b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.077+0000 7fef17b2a800 20 realm 2024-09-14T11:25:24.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.077+0000 7fef17b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.077+0000 7fef17b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.077+0000 7fef17b2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:24.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.077+0000 7fef17b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.077+0000 7fef17b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.077+0000 7fef17b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.078+0000 7fef17b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:24.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.078+0000 7fef17b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.079+0000 7fef17b2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:24.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.079+0000 7fef17b2a800 20 searching for the correct realm 2024-09-14T11:25:24.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.082+0000 7fef1304e640 0 -- 172.21.15.50:0/4004669515 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fef0c02d030 msgr2=0x7fef0c06f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:24.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.288+0000 7fef1304e640 0 -- 172.21.15.50:0/4004669515 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x56217aa5c140 msgr2=0x56217aa5e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.292+0000 7fef17b2a800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:25:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.292+0000 7fef17b2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.292+0000 7fef17b2a800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:25:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.292+0000 7fef17b2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.292+0000 7fef17b2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.292+0000 7fef17b2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.292+0000 7fef17b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.293+0000 7fef17b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.293+0000 7fef17b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.293+0000 7fef17b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:24.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.293+0000 7fef17b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.293+0000 7fef17b2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:24.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.293+0000 7fef17b2a800 20 zone default found 2024-09-14T11:25:24.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.293+0000 7fef17b2a800 4 Realm: () 2024-09-14T11:25:24.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.293+0000 7fef17b2a800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:25:24.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.293+0000 7fef17b2a800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:25:24.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.293+0000 7fef17b2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:24.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.293+0000 7fef17b2a800 20 zonegroup default 2024-09-14T11:25:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.293+0000 7fef17b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.294+0000 7fef17b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.294+0000 7fef17b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.294+0000 7fef17b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.294+0000 7fef17b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.294+0000 7fef17b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.294+0000 7fef17b2a800 20 started sync module instance, tier type = 2024-09-14T11:25:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.294+0000 7fef17b2a800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:25:24.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.306+0000 7fef17b2a800 20 add_watcher() i=0 2024-09-14T11:25:24.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.306+0000 7fef17b2a800 20 add_watcher() i=1 2024-09-14T11:25:24.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.306+0000 7fef17b2a800 20 add_watcher() i=2 2024-09-14T11:25:24.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.306+0000 7fef17b2a800 20 add_watcher() i=3 2024-09-14T11:25:24.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.306+0000 7fef17b2a800 20 add_watcher() i=4 2024-09-14T11:25:24.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.306+0000 7fef17b2a800 20 add_watcher() i=5 2024-09-14T11:25:24.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.306+0000 7fef17b2a800 20 add_watcher() i=6 2024-09-14T11:25:24.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.306+0000 7fef17b2a800 20 add_watcher() i=7 2024-09-14T11:25:24.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.306+0000 7fef17b2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:24.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.308+0000 7fedc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:24.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.308+0000 7fef17b2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:24.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.308+0000 7fef17b2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:24.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.308+0000 7fef17b2a800 5 note: GC not initialized 2024-09-14T11:25:24.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.308+0000 7fedc8fe1640 20 reqs_thread_entry: start 2024-09-14T11:25:24.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.308+0000 7fef17b2a800 20 init_complete bucket index max shards: 11 2024-09-14T11:25:24.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.308+0000 7fef17b2a800 20 Filter name: none 2024-09-14T11:25:24.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.308+0000 7fed427fc640 20 reqs_thread_entry: start 2024-09-14T11:25:24.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.309+0000 7fef17b2a800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T11:25:24.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.309+0000 7fef17b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.309+0000 7fef17b2a800 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T11:25:24.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.309+0000 7fef17b2a800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-14T11:25:24.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.309+0000 7fef17b2a800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:25:24.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.309+0000 7fef17b2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:25:24.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.312+0000 7fef17b2a800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:25:24.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.312+0000 7fef17b2a800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:25:24.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.312+0000 7fef17b2a800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T11:25:24.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.312+0000 7fedf2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399154 cookie 94701791599040 notifier 9327 bl.length()=695 2024-09-14T11:25:24.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.312+0000 7fedf2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:25:24.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.312+0000 7fedf2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:25:24.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.315+0000 7fedc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:24.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.317+0000 7fef17b2a800 20 remove_watcher() i=0 2024-09-14T11:25:24.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.317+0000 7fef17b2a800 2 removed watcher, disabling cache 2024-09-14T11:25:24.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.318+0000 7fef17b2a800 20 remove_watcher() i=1 2024-09-14T11:25:24.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.319+0000 7fef17b2a800 20 remove_watcher() i=2 2024-09-14T11:25:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.320+0000 7fef17b2a800 20 remove_watcher() i=3 2024-09-14T11:25:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.321+0000 7fef17b2a800 20 remove_watcher() i=4 2024-09-14T11:25:24.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.323+0000 7fef17b2a800 20 remove_watcher() i=5 2024-09-14T11:25:24.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.324+0000 7fef17b2a800 20 remove_watcher() i=6 2024-09-14T11:25:24.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.325+0000 7fef17b2a800 20 remove_watcher() i=7 2024-09-14T11:25:24.336 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-14T11:25:24.401 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:24.401 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:24.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.439+0000 7fd67db24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.440+0000 7fd67db24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.440+0000 7fd67db24800 20 realm 2024-09-14T11:25:24.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.440+0000 7fd67db24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.441+0000 7fd67db24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.441+0000 7fd67db24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:24.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.441+0000 7fd67db24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.441+0000 7fd67db24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.441+0000 7fd67db24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.441+0000 7fd67db24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:24.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.441+0000 7fd67db24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.442+0000 7fd67db24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:24.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.442+0000 7fd67db24800 20 searching for the correct realm 2024-09-14T11:25:24.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.443+0000 7fd679868640 0 -- 172.21.15.50:0/1516289359 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x7fd674027040 msgr2=0x7fd674027420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:25:24.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.649+0000 7fd67a069640 0 -- 172.21.15.50:0/1516289359 >> [v2:172.21.15.118:6826/1082138742,v1:172.21.15.118:6827/1082138742] conn(0x7fd66c07a040 msgr2=0x7fd66c002810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:25:24.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.858+0000 7fd67db24800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:25:24.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.858+0000 7fd67db24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:24.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.858+0000 7fd67db24800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:25:24.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.858+0000 7fd67db24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:24.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.858+0000 7fd67db24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:24.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.858+0000 7fd67db24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:24.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.858+0000 7fd67db24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.858+0000 7fd67db24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.858+0000 7fd67db24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.859+0000 7fd67db24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:24.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.859+0000 7fd67db24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.859+0000 7fd67db24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:24.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.859+0000 7fd67db24800 20 zone default found 2024-09-14T11:25:24.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.859+0000 7fd67db24800 4 Realm: () 2024-09-14T11:25:24.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.859+0000 7fd67db24800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:25:24.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.859+0000 7fd67db24800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:25:24.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.859+0000 7fd67db24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:24.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.859+0000 7fd67db24800 20 zonegroup default 2024-09-14T11:25:24.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.859+0000 7fd67db24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.859+0000 7fd67db24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.860+0000 7fd67db24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.860+0000 7fd67db24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.860+0000 7fd67db24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.860+0000 7fd67db24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.860+0000 7fd67db24800 20 started sync module instance, tier type = 2024-09-14T11:25:24.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.860+0000 7fd67db24800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:25:24.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.871+0000 7fd67db24800 20 add_watcher() i=0 2024-09-14T11:25:24.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.871+0000 7fd67db24800 20 add_watcher() i=1 2024-09-14T11:25:24.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.871+0000 7fd67db24800 20 add_watcher() i=2 2024-09-14T11:25:24.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.871+0000 7fd67db24800 20 add_watcher() i=3 2024-09-14T11:25:24.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.871+0000 7fd67db24800 20 add_watcher() i=4 2024-09-14T11:25:24.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.871+0000 7fd67db24800 20 add_watcher() i=5 2024-09-14T11:25:24.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.871+0000 7fd67db24800 20 add_watcher() i=6 2024-09-14T11:25:24.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.872+0000 7fd67db24800 20 add_watcher() i=7 2024-09-14T11:25:24.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.872+0000 7fd67db24800 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.874+0000 7fd52b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.874+0000 7fd67db24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.874+0000 7fd67db24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.874+0000 7fd67db24800 5 note: GC not initialized 2024-09-14T11:25:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.874+0000 7fd52a7fc640 20 reqs_thread_entry: start 2024-09-14T11:25:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.874+0000 7fd67db24800 20 init_complete bucket index max shards: 11 2024-09-14T11:25:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.874+0000 7fd67db24800 20 Filter name: none 2024-09-14T11:25:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.875+0000 7fd49bfff640 20 reqs_thread_entry: start 2024-09-14T11:25:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.875+0000 7fd67db24800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-14T11:25:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.875+0000 7fd67db24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.875+0000 7fd67db24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.875+0000 7fd67db24800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-14T11:25:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.875+0000 7fd67db24800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:25:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.875+0000 7fd67db24800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-14T11:25:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.875+0000 7fd67db24800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-14T11:25:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.875+0000 7fd67db24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.875+0000 7fd67db24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.875+0000 7fd67db24800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-14T11:25:24.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.875+0000 7fd67db24800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:25:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.875+0000 7fd67db24800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-14T11:25:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.877+0000 7fd67db24800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:25:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.877+0000 7fd67db24800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:25:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.877+0000 7fd67db24800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-14T11:25:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.877+0000 7fd55d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399155 cookie 94708119799264 notifier 9345 bl.length()=384 2024-09-14T11:25:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.877+0000 7fd55d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:25:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.877+0000 7fd55d7fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:25:24.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.880+0000 7fd67db24800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T11:25:24.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.880+0000 7fd67db24800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:25:24.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.880+0000 7fd67db24800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-14T11:25:24.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.881+0000 7fd55d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399156 cookie 94708119807856 notifier 9345 bl.length()=225 2024-09-14T11:25:24.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.881+0000 7fd55d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T11:25:24.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.881+0000 7fd55d7fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:25:24.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.884+0000 7fd67db24800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T11:25:24.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.884+0000 7fd67db24800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:25:24.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.884+0000 7fd67db24800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-14T11:25:24.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.884+0000 7fd55d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398921 cookie 94708119805152 notifier 9345 bl.length()=234 2024-09-14T11:25:24.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.884+0000 7fd55d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T11:25:24.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.884+0000 7fd55d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:25:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.887+0000 7fd52b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.889+0000 7fd67db24800 20 remove_watcher() i=0 2024-09-14T11:25:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.889+0000 7fd67db24800 2 removed watcher, disabling cache 2024-09-14T11:25:24.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.890+0000 7fd67db24800 20 remove_watcher() i=1 2024-09-14T11:25:24.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.892+0000 7fd67db24800 20 remove_watcher() i=2 2024-09-14T11:25:24.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.893+0000 7fd67db24800 20 remove_watcher() i=3 2024-09-14T11:25:24.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.894+0000 7fd67db24800 20 remove_watcher() i=4 2024-09-14T11:25:24.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.895+0000 7fd67db24800 20 remove_watcher() i=5 2024-09-14T11:25:24.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.898+0000 7fd67db24800 20 remove_watcher() i=6 2024-09-14T11:25:24.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:24.900+0000 7fd67db24800 20 remove_watcher() i=7 2024-09-14T11:25:24.909 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-14T11:25:24.909 INFO:teuthology.orchestra.run.smithi050.stdout: "id": "RGW99999999999999999", 2024-09-14T11:25:24.909 INFO:teuthology.orchestra.run.smithi050.stdout: "tenant": "", 2024-09-14T11:25:24.909 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "Mr.RGW99999999999999999", 2024-09-14T11:25:24.909 INFO:teuthology.orchestra.run.smithi050.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-14T11:25:24.909 INFO:teuthology.orchestra.run.smithi050.stdout: "quota": { 2024-09-14T11:25:24.909 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:25:24.909 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:25:24.909 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:25:24.909 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:25:24.909 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:25:24.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:25:24.909 INFO:teuthology.orchestra.run.smithi050.stdout: "bucket_quota": { 2024-09-14T11:25:24.910 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:25:24.910 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:25:24.910 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:25:24.910 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:25:24.910 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:25:24.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:25:24.910 INFO:teuthology.orchestra.run.smithi050.stdout: "max_users": 1000, 2024-09-14T11:25:24.910 INFO:teuthology.orchestra.run.smithi050.stdout: "max_roles": 1000, 2024-09-14T11:25:24.910 INFO:teuthology.orchestra.run.smithi050.stdout: "max_groups": 1000, 2024-09-14T11:25:24.910 INFO:teuthology.orchestra.run.smithi050.stdout: "max_buckets": 1000, 2024-09-14T11:25:24.910 INFO:teuthology.orchestra.run.smithi050.stdout: "max_access_keys": 4 2024-09-14T11:25:24.910 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-14T11:25:24.911 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-14T11:25:24.911 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key AIFQPCWDLEQEDSMITFMS --secret TH62m47Ca70pn4NbZSFj+H1js4bQ5yak+jSYF+jMl3RklWkI/Icq7A== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-14T11:25:24.983 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:24.984 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.021+0000 7f2449a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.022+0000 7f2449a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.022+0000 7f2449a0e800 20 realm 2024-09-14T11:25:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.022+0000 7f2449a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.022+0000 7f2449a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.022+0000 7f2449a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.022+0000 7f2449a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.022+0000 7f2449a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.022+0000 7f2449a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.023+0000 7f2449a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.023+0000 7f2449a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.024+0000 7f2449a0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.024+0000 7f2449a0e800 20 searching for the correct realm 2024-09-14T11:25:25.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.028+0000 7f24451bc640 0 -- 172.21.15.50:0/326421746 >> [v2:172.21.15.50:6808/3787956460,v1:172.21.15.50:6809/3787956460] conn(0x7f2440061040 msgr2=0x7f244007b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:25.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.031+0000 7f24451bc640 0 -- 172.21.15.50:0/326421746 >> [v2:172.21.15.50:6824/856974303,v1:172.21.15.50:6825/856974303] conn(0x7f244008b920 msgr2=0x7f244006c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:25.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.036+0000 7f2449a0e800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:25:25.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.036+0000 7f2449a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:25.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.036+0000 7f2449a0e800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:25:25.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.036+0000 7f2449a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:25.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.036+0000 7f2449a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:25.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.036+0000 7f2449a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:25.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.036+0000 7f2449a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.036+0000 7f2449a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:25.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.036+0000 7f2449a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.036+0000 7f2449a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:25.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.036+0000 7f2449a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.037+0000 7f2449a0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:25.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.037+0000 7f2449a0e800 20 zone default found 2024-09-14T11:25:25.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.037+0000 7f2449a0e800 4 Realm: () 2024-09-14T11:25:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.037+0000 7f2449a0e800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:25:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.037+0000 7f2449a0e800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:25:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.037+0000 7f2449a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.037+0000 7f2449a0e800 20 zonegroup default 2024-09-14T11:25:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.037+0000 7f2449a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.037+0000 7f2449a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.037+0000 7f2449a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.037+0000 7f2449a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.037+0000 7f2449a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.038+0000 7f2449a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.038+0000 7f2449a0e800 20 started sync module instance, tier type = 2024-09-14T11:25:25.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.038+0000 7f2449a0e800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:25:25.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.047+0000 7f2449a0e800 20 add_watcher() i=0 2024-09-14T11:25:25.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.047+0000 7f2449a0e800 20 add_watcher() i=1 2024-09-14T11:25:25.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.047+0000 7f2449a0e800 20 add_watcher() i=2 2024-09-14T11:25:25.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.047+0000 7f2449a0e800 20 add_watcher() i=3 2024-09-14T11:25:25.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.047+0000 7f2449a0e800 20 add_watcher() i=4 2024-09-14T11:25:25.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.047+0000 7f2449a0e800 20 add_watcher() i=5 2024-09-14T11:25:25.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.047+0000 7f2449a0e800 20 add_watcher() i=6 2024-09-14T11:25:25.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.049+0000 7f2449a0e800 20 add_watcher() i=7 2024-09-14T11:25:25.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.049+0000 7f2449a0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.049+0000 7f22fbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.049+0000 7f2449a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.049+0000 7f2449a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.049+0000 7f2449a0e800 5 note: GC not initialized 2024-09-14T11:25:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.050+0000 7f22fafe5640 20 reqs_thread_entry: start 2024-09-14T11:25:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.050+0000 7f2449a0e800 20 init_complete bucket index max shards: 11 2024-09-14T11:25:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.050+0000 7f2449a0e800 20 Filter name: none 2024-09-14T11:25:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.050+0000 7f22f8fe1640 20 reqs_thread_entry: start 2024-09-14T11:25:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.050+0000 7f2449a0e800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T11:25:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.050+0000 7f2449a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.051+0000 7f2449a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.051+0000 7f2449a0e800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-14T11:25:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.051+0000 7f2449a0e800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:25:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.051+0000 7f2449a0e800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-14T11:25:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.051+0000 7f2449a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.051+0000 7f2449a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.051+0000 7f2449a0e800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-14T11:25:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.051+0000 7f2449a0e800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:25:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.051+0000 7f2449a0e800 10 cache get: name=default.rgw.meta+users.keys+AIFQPCWDLEQEDSMITFMS : miss 2024-09-14T11:25:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.051+0000 7f2449a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.051+0000 7f2449a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.051+0000 7f2449a0e800 10 cache put: name=default.rgw.meta+users.keys+AIFQPCWDLEQEDSMITFMS info.flags=0x0 2024-09-14T11:25:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.051+0000 7f2449a0e800 10 adding default.rgw.meta+users.keys+AIFQPCWDLEQEDSMITFMS to cache LRU end 2024-09-14T11:25:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.051+0000 7f2449a0e800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-14T11:25:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.051+0000 7f2449a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.052+0000 7f2449a0e800 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:25:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.052+0000 7f2449a0e800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:25:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.052+0000 7f2449a0e800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:25:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.052+0000 7f2449a0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:25:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.052+0000 7f2449a0e800 10 cache get: name=default.rgw.meta+users.keys+AIFQPCWDLEQEDSMITFMS : hit (negative entry) 2024-09-14T11:25:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.052+0000 7f2449a0e800 10 cache get: name=default.rgw.meta+users.keys+AIFQPCWDLEQEDSMITFMS : hit (negative entry) 2024-09-14T11:25:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.053+0000 7f2449a0e800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:25:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.053+0000 7f2449a0e800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:25:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.053+0000 7f2449a0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T11:25:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.054+0000 7f2328ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399157 cookie 94878156177792 notifier 9360 bl.length()=681 2024-09-14T11:25:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.054+0000 7f2328ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:25:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.054+0000 7f2328ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:25:25.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.057+0000 7f2449a0e800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T11:25:25.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.057+0000 7f2449a0e800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:25:25.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.057+0000 7f2449a0e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-14T11:25:25.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.057+0000 7f2328ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399167 cookie 94878156184224 notifier 9360 bl.length()=189 2024-09-14T11:25:25.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.057+0000 7f2328ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T11:25:25.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.057+0000 7f2328ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:25:25.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.060+0000 7f2449a0e800 10 cache put: name=default.rgw.meta+users.keys+AIFQPCWDLEQEDSMITFMS info.flags=0x7 2024-09-14T11:25:25.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.060+0000 7f2449a0e800 10 moving default.rgw.meta+users.keys+AIFQPCWDLEQEDSMITFMS to cache LRU end 2024-09-14T11:25:25.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.060+0000 7f2449a0e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:AIFQPCWDLEQEDSMITFMS, ofs0, ns] 2024-09-14T11:25:25.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.060+0000 7f2328ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398952 cookie 94878156181920 notifier 9360 bl.length()=188 2024-09-14T11:25:25.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.060+0000 7f2328ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+AIFQPCWDLEQEDSMITFMS info.flags=0x7 2024-09-14T11:25:25.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.060+0000 7f2328ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+AIFQPCWDLEQEDSMITFMS to cache LRU end 2024-09-14T11:25:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.062+0000 7f2449a0e800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-14T11:25:25.062 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-14T11:25:25.062 INFO:teuthology.orchestra.run.smithi050.stdout: "user_id": "root2.client.0", 2024-09-14T11:25:25.062 INFO:teuthology.orchestra.run.smithi050.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-14T11:25:25.062 INFO:teuthology.orchestra.run.smithi050.stdout: "email": "root2+test@test.test", 2024-09-14T11:25:25.062 INFO:teuthology.orchestra.run.smithi050.stdout: "suspended": 0, 2024-09-14T11:25:25.062 INFO:teuthology.orchestra.run.smithi050.stdout: "max_buckets": 1000, 2024-09-14T11:25:25.062 INFO:teuthology.orchestra.run.smithi050.stdout: "subusers": [], 2024-09-14T11:25:25.062 INFO:teuthology.orchestra.run.smithi050.stdout: "keys": [ 2024-09-14T11:25:25.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-14T11:25:25.062 INFO:teuthology.orchestra.run.smithi050.stdout: "user": "root2.client.0", 2024-09-14T11:25:25.062 INFO:teuthology.orchestra.run.smithi050.stdout: "access_key": "AIFQPCWDLEQEDSMITFMS", 2024-09-14T11:25:25.062 INFO:teuthology.orchestra.run.smithi050.stdout: "secret_key": "TH62m47Ca70pn4NbZSFj+H1js4bQ5yak+jSYF+jMl3RklWkI/Icq7A==", 2024-09-14T11:25:25.062 INFO:teuthology.orchestra.run.smithi050.stdout: "active": true, 2024-09-14T11:25:25.063 INFO:teuthology.orchestra.run.smithi050.stdout: "create_date": "2024-09-14T11:25:25.053623Z" 2024-09-14T11:25:25.063 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-14T11:25:25.063 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-14T11:25:25.063 INFO:teuthology.orchestra.run.smithi050.stdout: "swift_keys": [], 2024-09-14T11:25:25.063 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": [], 2024-09-14T11:25:25.063 INFO:teuthology.orchestra.run.smithi050.stdout: "op_mask": "read, write, delete", 2024-09-14T11:25:25.063 INFO:teuthology.orchestra.run.smithi050.stdout: "default_placement": "", 2024-09-14T11:25:25.063 INFO:teuthology.orchestra.run.smithi050.stdout: "default_storage_class": "", 2024-09-14T11:25:25.063 INFO:teuthology.orchestra.run.smithi050.stdout: "placement_tags": [], 2024-09-14T11:25:25.063 INFO:teuthology.orchestra.run.smithi050.stdout: "bucket_quota": { 2024-09-14T11:25:25.063 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:25:25.063 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:25:25.063 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:25:25.063 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:25:25.063 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:25:25.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:25:25.064 INFO:teuthology.orchestra.run.smithi050.stdout: "user_quota": { 2024-09-14T11:25:25.064 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": false, 2024-09-14T11:25:25.064 INFO:teuthology.orchestra.run.smithi050.stdout: "check_on_raw": false, 2024-09-14T11:25:25.064 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size": -1, 2024-09-14T11:25:25.064 INFO:teuthology.orchestra.run.smithi050.stdout: "max_size_kb": 0, 2024-09-14T11:25:25.064 INFO:teuthology.orchestra.run.smithi050.stdout: "max_objects": -1 2024-09-14T11:25:25.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-14T11:25:25.064 INFO:teuthology.orchestra.run.smithi050.stdout: "temp_url_keys": [], 2024-09-14T11:25:25.064 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "root", 2024-09-14T11:25:25.064 INFO:teuthology.orchestra.run.smithi050.stdout: "mfa_ids": [], 2024-09-14T11:25:25.064 INFO:teuthology.orchestra.run.smithi050.stdout: "account_id": "RGW99999999999999999", 2024-09-14T11:25:25.064 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-09-14T11:25:25.064 INFO:teuthology.orchestra.run.smithi050.stdout: "create_date": "2024-09-14T11:25:25.053611Z", 2024-09-14T11:25:25.065 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-14T11:25:25.065 INFO:teuthology.orchestra.run.smithi050.stdout: "group_ids": [] 2024-09-14T11:25:25.065 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-14T11:25:25.065 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:25:25.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.063+0000 7f22fbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:25.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.066+0000 7f2449a0e800 20 remove_watcher() i=0 2024-09-14T11:25:25.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.066+0000 7f2449a0e800 2 removed watcher, disabling cache 2024-09-14T11:25:25.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.067+0000 7f2449a0e800 20 remove_watcher() i=1 2024-09-14T11:25:25.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.068+0000 7f2449a0e800 20 remove_watcher() i=2 2024-09-14T11:25:25.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.069+0000 7f2449a0e800 20 remove_watcher() i=3 2024-09-14T11:25:25.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.070+0000 7f2449a0e800 20 remove_watcher() i=4 2024-09-14T11:25:25.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.071+0000 7f2449a0e800 20 remove_watcher() i=5 2024-09-14T11:25:25.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.072+0000 7f2449a0e800 20 remove_watcher() i=6 2024-09-14T11:25:25.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.073+0000 7f2449a0e800 20 remove_watcher() i=7 2024-09-14T11:25:25.084 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 5006695399 --totp-seed E64ZBYKLSNJFIOM53XZB3QKEKCX3YN55VCTYUSKXDMUBQIQ7HRBZNV2AVDEEOMIV --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:25:25.152 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:25.152 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:25.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.189+0000 7fcb35122800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.191+0000 7fcb35122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:25.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.191+0000 7fcb35122800 20 realm 2024-09-14T11:25:25.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.191+0000 7fcb35122800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.191+0000 7fcb35122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:25.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.191+0000 7fcb35122800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:25.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.191+0000 7fcb35122800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.191+0000 7fcb35122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:25.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.191+0000 7fcb35122800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.192+0000 7fcb35122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:25.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.192+0000 7fcb35122800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.192+0000 7fcb35122800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:25.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.192+0000 7fcb35122800 20 searching for the correct realm 2024-09-14T11:25:25.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.196+0000 7fcb305d1640 0 -- 172.21.15.50:0/890753947 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fcb2808b400 msgr2=0x7fcb2808b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:25.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.401+0000 7fcb315d3640 0 -- 172.21.15.50:0/890753947 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55be2b05c510 msgr2=0x55be2b05e940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:25.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.406+0000 7fcb35122800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T11:25:25.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.406+0000 7fcb35122800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:25.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.406+0000 7fcb35122800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T11:25:25.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.406+0000 7fcb35122800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:25.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.406+0000 7fcb35122800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:25.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.406+0000 7fcb35122800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:25.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.406+0000 7fcb35122800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.406+0000 7fcb35122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:25.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.406+0000 7fcb35122800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.407+0000 7fcb35122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:25.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.407+0000 7fcb35122800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.407+0000 7fcb35122800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:25.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.407+0000 7fcb35122800 20 zone default found 2024-09-14T11:25:25.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.407+0000 7fcb35122800 4 Realm: () 2024-09-14T11:25:25.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.407+0000 7fcb35122800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T11:25:25.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.407+0000 7fcb35122800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T11:25:25.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.407+0000 7fcb35122800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:25.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.407+0000 7fcb35122800 20 zonegroup default 2024-09-14T11:25:25.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.407+0000 7fcb35122800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.407+0000 7fcb35122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:25.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.407+0000 7fcb35122800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.408+0000 7fcb35122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:25.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.408+0000 7fcb35122800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.408+0000 7fcb35122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:25.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.408+0000 7fcb35122800 20 started sync module instance, tier type = 2024-09-14T11:25:25.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.408+0000 7fcb35122800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T11:25:25.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.418+0000 7fcb35122800 20 add_watcher() i=0 2024-09-14T11:25:25.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.418+0000 7fcb35122800 20 add_watcher() i=1 2024-09-14T11:25:25.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.418+0000 7fcb35122800 20 add_watcher() i=2 2024-09-14T11:25:25.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.418+0000 7fcb35122800 20 add_watcher() i=3 2024-09-14T11:25:25.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.418+0000 7fcb35122800 20 add_watcher() i=4 2024-09-14T11:25:25.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.418+0000 7fcb35122800 20 add_watcher() i=5 2024-09-14T11:25:25.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.418+0000 7fcb35122800 20 add_watcher() i=6 2024-09-14T11:25:25.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.420+0000 7fcb35122800 20 add_watcher() i=7 2024-09-14T11:25:25.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.420+0000 7fcb35122800 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:25.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.420+0000 7fc9e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:25.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.421+0000 7fcb35122800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:25.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.421+0000 7fcb35122800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:25.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.421+0000 7fcb35122800 5 note: GC not initialized 2024-09-14T11:25:25.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.421+0000 7fc9e67e4640 20 reqs_thread_entry: start 2024-09-14T11:25:25.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.421+0000 7fcb35122800 20 init_complete bucket index max shards: 11 2024-09-14T11:25:25.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.421+0000 7fcb35122800 20 Filter name: none 2024-09-14T11:25:25.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.421+0000 7fc9dffff640 20 reqs_thread_entry: start 2024-09-14T11:25:25.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.421+0000 7fcb35122800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T11:25:25.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.421+0000 7fcb35122800 20 rados->read ofs=0 len=0 2024-09-14T11:25:25.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.422+0000 7fcb35122800 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T11:25:25.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.422+0000 7fcb35122800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-14T11:25:25.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.422+0000 7fcb35122800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:25:25.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.422+0000 7fcb35122800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:25:25.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.426+0000 7fcb35122800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:25:25.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.426+0000 7fcb35122800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:25:25.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.426+0000 7fcb35122800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T11:25:25.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.426+0000 7fca07fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399158 cookie 94275254010512 notifier 9378 bl.length()=695 2024-09-14T11:25:25.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.426+0000 7fca07fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:25:25.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.426+0000 7fca07fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:25:25.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.427+0000 7fc9e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:25.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.430+0000 7fcb35122800 20 remove_watcher() i=0 2024-09-14T11:25:25.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.430+0000 7fcb35122800 2 removed watcher, disabling cache 2024-09-14T11:25:25.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.432+0000 7fcb35122800 20 remove_watcher() i=1 2024-09-14T11:25:25.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.434+0000 7fcb35122800 20 remove_watcher() i=2 2024-09-14T11:25:25.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.435+0000 7fcb35122800 20 remove_watcher() i=3 2024-09-14T11:25:25.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.437+0000 7fcb35122800 20 remove_watcher() i=4 2024-09-14T11:25:25.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.439+0000 7fcb35122800 20 remove_watcher() i=5 2024-09-14T11:25:25.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.441+0000 7fcb35122800 20 remove_watcher() i=6 2024-09-14T11:25:25.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T11:25:25.442+0000 7fcb35122800 20 remove_watcher() i=7 2024-09-14T11:25:25.452 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-14T11:25:25.453 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T11:25:25.453 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-14T11:25:25.482 INFO:tasks.s3tests:Configuring boto... 2024-09-14T11:25:25.483 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T11:25:25.483 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T11:25:25.552 DEBUG:teuthology.orchestra.run.smithi050:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T11:25:25.737 INFO:teuthology.orchestra.run.smithi050.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-14T11:25:25.926 INFO:teuthology.orchestra.run.smithi050.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-14T11:25:26.204 INFO:teuthology.orchestra.run.smithi050.stdout:py installdeps: -rrequirements.txt 2024-09-14T11:27:21.930 INFO:teuthology.orchestra.run.smithi050.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-14T11:27:23.466 INFO:teuthology.orchestra.run.smithi050.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.9,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.3,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=a7991cb37a53db25bda18c6868a700d624be12b0abbabc4dad67565b889a4072,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-14T11:27:23.467 INFO:teuthology.orchestra.run.smithi050.stdout:py run-test-pre: PYTHONHASHSEED='1872678669' 2024-09-14T11:27:23.467 INFO:teuthology.orchestra.run.smithi050.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T11:27:23.607 INFO:teuthology.orchestra.run.smithi050.stdout:============================= test session starts ============================== 2024-09-14T11:27:23.607 INFO:teuthology.orchestra.run.smithi050.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-14T11:27:23.607 INFO:teuthology.orchestra.run.smithi050.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T11:27:23.607 INFO:teuthology.orchestra.run.smithi050.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:27:23.608 INFO:teuthology.orchestra.run.smithi050.stdout:configfile: pytest.ini 2024-09-14T11:27:25.428 INFO:teuthology.orchestra.run.smithi050.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-14T11:27:25.429 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:27:26.153 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-14T11:27:26.569 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-14T11:27:26.959 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-14T11:27:27.345 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-14T11:27:27.745 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-14T11:27:28.049 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-14T11:27:28.493 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-14T11:27:28.797 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-14T11:27:28.925 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-14T11:27:29.050 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-14T11:27:29.449 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-14T11:27:29.848 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-14T11:27:30.245 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-14T11:27:30.645 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-14T11:27:30.773 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-14T11:27:30.902 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-14T11:27:30.983 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-14T11:27:31.063 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-14T11:27:31.144 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-14T11:27:31.227 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-14T11:27:31.309 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-14T11:27:31.390 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-14T11:27:31.470 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T11:27:31.557 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T11:27:31.639 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T11:27:31.720 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T11:27:31.801 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-14T11:27:31.884 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-14T11:27:31.965 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-14T11:27:32.047 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-14T11:27:32.128 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T11:27:32.209 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T11:27:32.290 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T11:27:32.374 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T11:27:32.455 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T11:27:32.538 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T11:27:32.619 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-14T11:27:32.700 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-14T11:27:32.780 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:27:32.861 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-14T11:27:32.942 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-14T11:27:33.022 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:27:33.104 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:27:33.185 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-14T11:27:33.267 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-14T11:27:33.348 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-14T11:27:33.429 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-14T11:27:33.510 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T11:27:33.590 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T11:27:33.672 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T11:27:33.753 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T11:27:33.834 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-14T11:27:33.914 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-14T11:27:34.749 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-14T11:27:43.829 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-14T11:27:51.732 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-14T11:28:08.408 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-14T11:28:29.385 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-14T11:28:35.389 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-14T11:28:42.193 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-14T11:28:43.848 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-14T11:28:44.259 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-14T11:28:45.311 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-14T11:28:46.358 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-14T11:28:47.346 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-14T11:28:47.875 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-14T11:28:48.390 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-14T11:28:48.391 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T11:28:48.392 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T11:28:48.392 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-14T11:28:48.393 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-14T11:28:48.394 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T11:28:48.395 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T11:28:48.396 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-14T11:28:48.397 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:28:48.397 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:28:48.398 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:28:48.399 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:28:48.400 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-14T11:28:48.400 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:28:48.401 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:28:48.402 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:28:48.403 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:28:48.404 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:28:48.404 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:28:48.405 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:28:48.406 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-14T11:28:48.407 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-14T11:28:48.408 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-14T11:28:48.409 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-14T11:28:48.409 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-14T11:28:48.410 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-14T11:28:48.411 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-14T11:28:48.411 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-14T11:28:48.501 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-14T11:28:48.513 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-14T11:28:49.774 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-14T11:28:55.904 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-14T11:28:56.764 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-14T11:28:57.837 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-14T11:28:58.879 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-14T11:28:59.922 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-14T11:29:00.959 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-14T11:29:01.851 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-14T11:29:02.898 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-14T11:29:03.848 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-14T11:29:04.786 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-14T11:29:05.658 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-14T11:29:06.427 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-14T11:29:07.213 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-14T11:29:07.782 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-14T11:29:08.644 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-14T11:29:09.605 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-14T11:29:10.606 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-14T11:29:11.486 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-14T11:29:12.363 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-14T11:29:13.230 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-14T11:29:14.101 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-14T11:29:15.170 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-14T11:29:15.923 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-14T11:29:16.696 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-14T11:29:17.272 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-14T11:29:17.869 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-14T11:29:18.436 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-14T11:29:19.005 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-14T11:29:19.571 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-14T11:29:20.565 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-14T11:29:21.131 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:29:21.712 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-14T11:29:22.442 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-14T11:29:23.150 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-14T11:29:23.717 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:29:24.478 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-14T11:29:25.179 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:29:26.049 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T11:29:26.704 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-14T11:29:27.428 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-14T11:29:28.134 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-14T11:29:29.160 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T11:29:30.199 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T11:29:31.121 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T11:29:32.253 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:29:33.452 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:29:35.503 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:29:37.922 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:29:39.128 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:29:40.298 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:29:41.266 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-14T11:29:42.414 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-14T11:29:43.275 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-14T11:29:44.918 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-14T11:29:46.071 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-14T11:29:47.432 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-14T11:29:49.969 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-14T11:29:53.277 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-14T11:29:55.204 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-14T11:29:56.995 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-14T11:29:58.427 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-14T11:29:59.411 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-14T11:30:01.044 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-14T11:30:02.258 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-14T11:30:03.839 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-14T11:30:04.986 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-14T11:30:06.926 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-14T11:30:08.618 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-14T11:30:10.788 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-14T11:30:12.879 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-14T11:30:14.450 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-14T11:30:15.859 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-14T11:30:17.028 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-14T11:30:19.571 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-14T11:30:21.458 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-14T11:30:23.618 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-14T11:30:25.717 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-14T11:30:27.684 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-14T11:30:29.639 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-14T11:30:31.272 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-14T11:30:32.497 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-14T11:30:33.846 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-14T11:30:36.181 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-14T11:30:39.163 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-14T11:30:40.576 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-14T11:30:42.567 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-14T11:30:44.551 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-14T11:30:46.491 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-14T11:30:48.626 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-14T11:30:50.851 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-14T11:30:53.034 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-14T11:30:55.061 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-14T11:30:56.431 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-14T11:30:57.593 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-14T11:30:58.720 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-14T11:30:59.866 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-14T11:31:01.821 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-14T11:31:03.923 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-14T11:31:05.951 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-14T11:31:07.921 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-14T11:31:09.958 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-14T11:31:11.929 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-14T11:31:13.901 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-14T11:31:15.967 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-14T11:31:17.925 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-14T11:31:19.954 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T11:31:21.917 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-14T11:31:23.966 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-14T11:31:25.424 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-14T11:31:26.896 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-14T11:31:28.289 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T11:31:29.680 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-14T11:31:30.816 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-14T11:31:32.057 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-14T11:31:33.181 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-14T11:31:34.290 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-14T11:31:35.356 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-14T11:31:36.435 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-14T11:31:37.531 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-14T11:31:38.625 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-14T11:31:39.745 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-14T11:31:41.524 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-14T11:31:43.334 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-14T11:31:44.299 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T11:31:45.257 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T11:31:46.334 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-14T11:31:47.425 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-14T11:31:49.266 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T11:31:51.056 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T11:31:52.140 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-14T11:31:53.446 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-14T11:31:54.532 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-14T11:31:55.617 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-14T11:31:56.736 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-14T11:31:57.847 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-14T11:31:58.933 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-14T11:32:00.034 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-14T11:32:01.117 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-14T11:32:02.204 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-14T11:32:03.338 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-14T11:32:04.460 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-14T11:32:05.511 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-14T11:32:06.611 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-14T11:32:07.671 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-14T11:32:08.753 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-14T11:32:09.834 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-14T11:32:59.292 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-14T11:33:00.373 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-14T11:33:01.413 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-14T11:33:02.454 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-14T11:33:03.505 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-14T11:33:04.551 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-14T11:33:05.603 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-14T11:33:06.848 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-14T11:33:07.947 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-14T11:33:08.993 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-14T11:33:10.027 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-14T11:33:11.076 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-14T11:33:12.117 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-14T11:33:13.219 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T11:33:14.309 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T11:33:15.423 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T11:33:16.517 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T11:33:17.604 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-14T11:33:18.702 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-14T11:33:19.794 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:33:20.880 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:33:21.967 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:33:23.113 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:33:24.267 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-14T11:33:25.439 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-14T11:33:26.520 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-14T11:33:27.602 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-14T11:33:28.710 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-14T11:33:29.827 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-14T11:33:30.386 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-14T11:33:31.355 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-14T11:33:33.775 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-14T11:33:36.164 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-14T11:33:37.252 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-14T11:33:38.391 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-14T11:33:39.465 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-14T11:33:40.547 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-14T11:33:41.697 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-14T11:33:42.866 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-14T11:33:43.962 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-14T11:33:45.240 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-14T11:33:46.359 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-14T11:33:47.441 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-14T11:33:48.564 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-14T11:33:49.642 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-14T11:33:50.981 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-14T11:33:52.704 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-14T11:33:53.719 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-14T11:33:54.681 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-14T11:33:55.542 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-14T11:33:56.415 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-14T11:33:56.981 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-14T11:33:57.549 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-14T11:33:58.139 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-14T11:33:59.117 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-14T11:34:03.573 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-14T11:34:04.185 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-14T11:34:05.120 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-14T11:34:05.936 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-14T11:34:06.808 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-14T11:34:07.671 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-14T11:34:10.336 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-14T11:34:11.573 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-14T11:34:12.847 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-14T11:35:03.189 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-14T11:35:53.297 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-14T11:35:54.274 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-14T11:35:55.209 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-14T11:35:56.173 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-14T11:35:57.139 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-14T11:35:58.239 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-14T11:35:59.228 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-14T11:36:00.214 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-14T11:36:01.377 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-14T11:36:02.405 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-14T11:36:03.407 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-14T11:36:04.436 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-14T11:36:05.575 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-14T11:36:06.545 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-14T11:36:07.413 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-14T11:36:08.338 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-14T11:36:09.285 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-14T11:36:11.239 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-14T11:36:12.253 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-14T11:36:13.195 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-14T11:36:14.144 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-14T11:36:15.158 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-14T11:36:16.204 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-14T11:36:17.075 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-14T11:36:17.958 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-14T11:36:18.853 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-14T11:36:19.765 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-14T11:36:20.652 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-14T11:36:21.529 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-14T11:36:22.553 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-14T11:36:23.625 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-14T11:36:24.510 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-14T11:36:25.393 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-14T11:36:26.271 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-14T11:36:27.441 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-14T11:36:28.347 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-14T11:36:29.237 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-14T11:36:30.118 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-14T11:36:30.994 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-14T11:36:31.864 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-14T11:36:32.734 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-14T11:36:33.617 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-14T11:36:35.911 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-14T11:36:36.806 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-14T11:36:37.854 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-14T11:36:38.887 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-14T11:36:39.865 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-14T11:36:40.878 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-14T11:36:41.907 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-14T11:36:43.984 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-14T11:36:44.990 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-14T11:36:46.005 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-14T11:36:47.164 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-14T11:36:48.325 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-14T11:36:49.437 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-14T11:36:50.411 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-14T11:36:51.530 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-14T11:36:52.674 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-14T11:36:53.690 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-14T11:36:54.865 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-14T11:36:55.867 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-14T11:36:56.781 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-14T11:36:57.701 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-14T11:36:58.708 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-14T11:36:59.573 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-14T11:37:00.137 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-14T11:37:01.319 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-14T11:37:02.278 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-14T11:37:03.285 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-14T11:37:06.791 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-14T11:37:07.760 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-14T11:37:08.732 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-14T11:37:09.689 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-14T11:37:10.896 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-14T11:37:11.799 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-14T11:37:12.774 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-14T11:37:13.841 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-14T11:37:14.982 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-14T11:37:15.950 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-14T11:37:16.930 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-14T11:37:17.897 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-14T11:37:18.922 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-14T11:37:19.981 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-14T11:37:20.927 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-14T11:37:21.984 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-14T11:37:23.048 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-14T11:37:24.151 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-14T11:37:24.752 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-14T11:37:25.318 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-14T11:37:25.903 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-14T11:37:26.674 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-14T11:37:27.442 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-14T11:37:28.221 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-14T11:37:28.991 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-14T11:37:30.067 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-14T11:37:30.638 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-14T11:37:31.218 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-14T11:37:32.022 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-14T11:37:32.589 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-14T11:37:33.155 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-14T11:37:33.717 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-14T11:37:34.279 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-14T11:37:35.123 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-14T11:37:35.955 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-14T11:37:36.814 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-14T11:37:37.653 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-14T11:37:38.491 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-14T11:37:39.393 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-14T11:37:40.238 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-14T11:37:41.157 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-14T11:37:41.983 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T11:37:42.811 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T11:37:43.824 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-14T11:37:44.845 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-14T11:37:45.957 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-14T11:37:46.971 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T11:37:47.975 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T11:37:49.095 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-14T11:37:50.185 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-14T11:37:51.284 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-14T11:37:52.392 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-14T11:37:53.262 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-14T11:37:54.373 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-14T11:37:55.481 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-14T11:37:56.601 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-14T11:37:57.716 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-14T11:37:58.872 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-14T11:38:00.434 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-14T11:38:01.842 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-14T11:38:03.244 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-14T11:38:04.727 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-14T11:38:06.135 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-14T11:38:07.132 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-14T11:38:08.136 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-14T11:38:09.189 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-14T11:38:10.225 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-14T11:38:11.407 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-14T11:38:12.525 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-14T11:38:14.012 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-14T11:38:15.538 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-14T11:38:17.038 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-14T11:38:18.533 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-14T11:38:20.024 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-14T11:38:21.525 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-14T11:38:23.057 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-14T11:38:24.585 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-14T11:38:26.075 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-14T11:38:27.479 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-14T11:38:28.883 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-14T11:38:30.282 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-14T11:38:32.200 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-14T11:38:34.183 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-14T11:38:34.780 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-14T11:38:35.348 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-14T11:38:35.912 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-14T11:38:36.864 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-14T11:38:37.821 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-14T11:38:38.591 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-14T11:38:39.379 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-14T11:38:40.653 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-14T11:38:43.347 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-14T11:38:44.607 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-14T11:38:45.703 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-14T11:38:49.615 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-14T11:38:50.732 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-14T11:38:51.848 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-14T11:38:52.915 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-14T11:38:53.981 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-14T11:38:55.494 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-14T11:38:56.688 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-14T11:38:58.085 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-14T11:38:59.352 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-14T11:39:01.307 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-14T11:39:03.117 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-14T11:39:03.984 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-14T11:39:04.873 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-14T11:39:07.690 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-14T11:39:08.885 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-14T11:39:35.802 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-14T11:39:36.807 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-14T11:39:38.014 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-14T11:39:41.628 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-14T11:39:42.775 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-14T11:39:44.633 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-14T11:39:56.018 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-14T11:40:14.869 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-14T11:40:45.903 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-14T11:42:43.724 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-14T11:42:56.289 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-14T11:43:19.752 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-14T11:43:21.235 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-14T11:43:28.316 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-14T11:43:34.427 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-14T11:43:37.463 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-14T11:43:38.479 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-14T11:43:43.581 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-14T11:43:44.776 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-14T11:43:45.788 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-14T11:43:46.860 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-14T11:44:06.063 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-14T11:44:10.127 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-14T11:44:11.201 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-14T11:44:12.183 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-14T11:44:13.285 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-14T11:44:20.427 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-14T11:44:24.523 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-14T11:44:28.599 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-14T11:44:29.700 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-14T11:44:30.810 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-14T11:44:31.905 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-14T11:44:33.003 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-14T11:44:34.125 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-14T11:44:35.231 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-14T11:44:36.266 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-14T11:44:38.125 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-14T11:44:41.895 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-14T11:44:47.950 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-14T11:44:50.358 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-14T11:44:55.235 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-14T11:45:03.651 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-14T11:45:05.625 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-14T11:45:09.730 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-14T11:45:16.681 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-14T11:45:18.841 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-14T11:45:20.019 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-14T11:45:21.584 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-14T11:45:22.589 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-14T11:45:30.045 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-14T11:45:31.063 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-14T11:45:32.086 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-14T11:45:33.091 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-14T11:45:34.107 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-14T11:45:35.568 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-14T11:45:47.642 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-14T11:45:49.261 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-14T11:45:50.578 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-14T11:45:52.136 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-14T11:45:53.811 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-14T11:45:59.291 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-14T11:46:00.861 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-14T11:46:07.195 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-14T11:46:29.677 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-14T11:47:07.290 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-14T11:47:10.114 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-14T11:47:12.893 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-14T11:47:14.303 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-14T11:47:15.766 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-14T11:47:16.942 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-14T11:47:18.576 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-14T11:47:20.121 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-14T11:47:22.850 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-14T11:47:23.769 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-14T11:47:24.800 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-14T11:47:25.783 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-14T11:47:26.660 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-14T11:47:27.560 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-14T11:47:28.548 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-14T11:47:29.433 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-14T11:47:30.310 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-14T11:47:31.334 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-14T11:47:32.201 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-14T11:47:33.068 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-14T11:47:33.978 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-14T11:47:34.864 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-14T11:47:35.766 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-14T11:47:36.796 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-14T11:47:37.808 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-14T11:47:39.257 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-14T11:47:40.292 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-14T11:47:41.324 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-14T11:47:42.339 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-14T11:47:43.354 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-14T11:47:44.252 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-14T11:47:45.138 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-14T11:47:46.007 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-14T11:47:46.880 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-14T11:48:37.968 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-14T11:49:28.655 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-14T11:49:39.100 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-14T11:49:40.116 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-14T11:50:41.620 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-14T11:51:43.327 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-14T11:51:44.360 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-14T11:51:45.361 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-14T11:51:46.221 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-14T11:51:47.099 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-14T11:52:19.391 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-14T11:52:28.695 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-14T11:52:38.041 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-14T11:52:39.071 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-14T11:52:40.103 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-14T11:52:41.109 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-14T11:52:42.545 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-14T11:52:43.556 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-14T11:52:44.591 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-14T11:52:45.678 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-14T11:52:46.774 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-14T11:52:47.935 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-14T11:52:49.131 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-14T11:52:50.203 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-14T11:52:51.225 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-14T11:52:52.883 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-14T11:52:54.560 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-14T11:52:57.108 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-14T11:52:59.598 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-14T11:53:02.119 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-14T11:53:04.569 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-14T11:53:07.017 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-14T11:53:09.490 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-14T11:53:11.942 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-14T11:53:14.562 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-14T11:53:17.100 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-14T11:53:18.117 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-14T11:53:19.150 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-14T11:53:20.239 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-14T11:53:22.840 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-14T11:53:25.472 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-14T11:53:28.147 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-14T11:53:30.266 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-14T11:53:53.908 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-14T11:53:55.350 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-14T11:53:56.831 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T11:53:58.209 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T11:54:00.108 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-14T11:54:01.757 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-14T11:54:02.864 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-14T11:54:04.476 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-14T11:54:05.371 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-14T11:54:06.234 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-14T11:54:07.099 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-14T11:54:08.015 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-14T11:54:09.046 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-14T11:54:09.972 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-14T11:54:11.435 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-14T11:54:12.336 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-14T11:54:13.178 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-14T11:54:14.022 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-14T11:54:14.880 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-14T11:54:15.713 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-14T11:54:16.636 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-14T11:54:17.473 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-14T11:54:18.295 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-14T11:54:19.155 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-14T11:54:20.021 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-14T11:54:21.031 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-14T11:54:21.964 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-14T11:54:22.985 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-14T11:54:23.964 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-14T11:54:24.947 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-14T11:54:26.156 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-14T11:54:27.260 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-14T11:54:28.270 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-14T11:54:29.301 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-14T11:54:30.315 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-14T11:54:31.338 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-14T11:54:32.321 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-14T11:54:33.453 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-14T11:54:34.573 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-14T11:54:35.688 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-14T11:54:36.664 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-14T11:54:37.600 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-14T11:54:38.557 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-14T11:54:39.663 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-14T11:54:40.627 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-14T11:54:41.650 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T11:54:42.811 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T11:54:43.731 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-14T11:54:44.756 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-14T11:54:45.790 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-14T11:54:56.504 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-14T11:54:57.458 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-14T11:55:07.608 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-14T11:55:08.705 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-14T11:55:09.791 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-14T11:55:10.676 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-14T11:55:11.591 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T11:55:12.518 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T11:55:13.523 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T11:55:14.483 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-14T11:55:15.442 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-14T11:55:16.321 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-14T11:55:17.243 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-14T11:55:18.259 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-14T11:55:19.184 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-14T11:55:20.312 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-14T11:55:21.360 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-14T11:55:22.322 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-14T11:55:23.225 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-14T11:55:24.455 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-14T11:55:35.693 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-14T11:55:36.572 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-14T11:55:37.525 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-14T11:55:38.514 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-14T11:55:39.569 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-14T11:55:41.968 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-14T11:55:43.035 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-14T11:55:44.567 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-14T11:55:50.392 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-14T11:55:52.558 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-14T11:56:03.611 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-14T11:56:14.120 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-14T11:56:15.246 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-14T11:56:16.771 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-14T11:56:32.770 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-14T11:56:56.874 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-14T11:57:00.931 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-14T11:57:03.580 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-14T11:57:06.380 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-14T11:57:09.823 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-14T11:57:11.019 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-14T11:57:15.934 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-14T11:57:21.531 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-14T11:57:37.772 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-14T11:57:45.434 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-14T11:57:48.075 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-14T11:57:50.409 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-14T11:57:51.938 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-14T11:57:58.077 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-14T11:58:02.008 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-14T11:58:03.676 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-14T11:58:05.486 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-14T11:58:11.644 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-14T11:58:15.603 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-14T11:58:21.861 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-14T11:58:24.294 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-14T11:58:24.761 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-14T11:58:32.902 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-14T11:58:37.594 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-14T11:58:40.489 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-14T11:58:44.744 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-14T11:58:46.585 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-14T11:59:30.187 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-14T11:59:30.661 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-14T11:59:31.947 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-14T11:59:32.958 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-14T11:59:33.930 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-14T11:59:35.161 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-14T11:59:35.182 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-14T11:59:35.182 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:59:35.182 INFO:teuthology.orchestra.run.smithi050.stdout:=============================== warnings summary =============================== 2024-09-14T11:59:35.182 INFO:teuthology.orchestra.run.smithi050.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-14T11:59:35.182 INFO:teuthology.orchestra.run.smithi050.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-14T11:59:35.182 INFO:teuthology.orchestra.run.smithi050.stdout: import imp 2024-09-14T11:59:35.182 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:59:35.182 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py:120 2024-09-14T11:59:35.182 INFO:teuthology.orchestra.run.smithi050.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T11:59:35.183 INFO:teuthology.orchestra.run.smithi050.stdout: if boto_type is 'S3Connection': 2024-09-14T11:59:35.183 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:59:35.183 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_headers.py:124 2024-09-14T11:59:35.183 INFO:teuthology.orchestra.run.smithi050.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T11:59:35.183 INFO:teuthology.orchestra.run.smithi050.stdout: elif boto_type is 'HTTPRequest': 2024-09-14T11:59:35.183 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:59:35.183 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3.py:359 2024-09-14T11:59:35.183 INFO:teuthology.orchestra.run.smithi050.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-14T11:59:35.183 INFO:teuthology.orchestra.run.smithi050.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-14T11:59:35.183 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:59:35.183 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py:176 2024-09-14T11:59:35.183 INFO:teuthology.orchestra.run.smithi050.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T11:59:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: if k is 'BucketName': 2024-09-14T11:59:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:59:35.184 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py:253 2024-09-14T11:59:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-14T11:59:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: @pytest.mark.timeout(10) 2024-09-14T11:59:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:59:35.184 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-14T11:59:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-14T11:59:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: @pytest.mark.s3website_routing_rules 2024-09-14T11:59:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:59:35.184 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-14T11:59:35.185 INFO:teuthology.orchestra.run.smithi050.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:59:35.185 INFO:teuthology.orchestra.run.smithi050.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:59:35.185 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:59:35.185 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-14T11:59:35.185 INFO:teuthology.orchestra.run.smithi050.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:59:35.185 INFO:teuthology.orchestra.run.smithi050.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T11:59:35.185 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:59:35.185 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-14T11:59:35.185 INFO:teuthology.orchestra.run.smithi050.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:59:35.185 INFO:teuthology.orchestra.run.smithi050.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-14T11:59:35.185 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:59:35.185 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-14T11:59:35.185 INFO:teuthology.orchestra.run.smithi050.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:59:35.186 INFO:teuthology.orchestra.run.smithi050.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:59:35.186 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:59:35.186 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-14T11:59:35.186 INFO:teuthology.orchestra.run.smithi050.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:59:35.186 INFO:teuthology.orchestra.run.smithi050.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T11:59:35.186 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:59:35.186 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-14T11:59:35.186 INFO:teuthology.orchestra.run.smithi050.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:59:35.186 INFO:teuthology.orchestra.run.smithi050.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:59:35.186 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:59:35.186 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-14T11:59:35.186 INFO:teuthology.orchestra.run.smithi050.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:59:35.187 INFO:teuthology.orchestra.run.smithi050.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-14T11:59:35.187 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:59:35.187 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-14T11:59:35.187 INFO:teuthology.orchestra.run.smithi050.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:59:35.187 INFO:teuthology.orchestra.run.smithi050.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:59:35.187 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:59:35.187 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-14T11:59:35.187 INFO:teuthology.orchestra.run.smithi050.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:59:35.187 INFO:teuthology.orchestra.run.smithi050.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T11:59:35.187 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:59:35.187 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-14T11:59:35.187 INFO:teuthology.orchestra.run.smithi050.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:59:35.187 INFO:teuthology.orchestra.run.smithi050.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:59:35.187 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:59:35.188 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-14T11:59:35.188 INFO:teuthology.orchestra.run.smithi050.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:59:35.188 INFO:teuthology.orchestra.run.smithi050.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:59:35.188 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:59:35.188 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-09-14T11:59:35.188 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_iam.py: 82 warnings 2024-09-14T11:59:35.188 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3.py: 497 warnings 2024-09-14T11:59:35.188 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-09-14T11:59:35.188 INFO:teuthology.orchestra.run.smithi050.stdout:s3tests_boto3/functional/test_sns.py: 3 warnings 2024-09-14T11:59:35.188 INFO:teuthology.orchestra.run.smithi050.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi050.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:59:35.188 INFO:teuthology.orchestra.run.smithi050.stdout: warnings.warn( 2024-09-14T11:59:35.188 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T11:59:35.188 INFO:teuthology.orchestra.run.smithi050.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-14T11:59:35.189 INFO:teuthology.orchestra.run.smithi050.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 662 warnings in 1931.57s (0:32:11) = 2024-09-14T11:59:35.317 INFO:teuthology.orchestra.run.smithi050.stdout:___________________________________ summary ____________________________________ 2024-09-14T11:59:35.318 INFO:teuthology.orchestra.run.smithi050.stdout: py: commands succeeded 2024-09-14T11:59:35.318 INFO:teuthology.orchestra.run.smithi050.stdout: congratulations :) 2024-09-14T11:59:35.336 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-14T11:59:35.336 DEBUG:teuthology.orchestra.run.smithi050:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T11:59:35.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:59:35.444 INFO:tasks.s3tests:Cleaning up boto... 2024-09-14T11:59:35.444 DEBUG:teuthology.orchestra.run.smithi050:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T11:59:35.474 INFO:tasks.s3tests:Removing s3-tests... 2024-09-14T11:59:35.475 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:59:35.681 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:59:35.693 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:59:35.693 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:59:35.694 DEBUG:teuthology.orchestra.run.smithi050:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:59:35.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:59:35.723 INFO:teuthology.orchestra.run.smithi050.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:59:35.724 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:59:35.793 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:59:35.793 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:59:35.862 INFO:tasks.workunit:timeout=3h 2024-09-14T11:59:35.863 INFO:tasks.workunit:cleanup=True 2024-09-14T11:59:35.863 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:59:35.933 INFO:tasks.workunit.client.0.smithi050.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T12:00:33.137 INFO:tasks.workunit.client.0.smithi050.stderr:Updating files: 94% (12153/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T12:00:33.277 INFO:tasks.workunit.client.0.smithi050.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T12:00:33.277 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T12:00:33.277 INFO:tasks.workunit.client.0.smithi050.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T12:00:33.277 INFO:tasks.workunit.client.0.smithi050.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T12:00:33.277 INFO:tasks.workunit.client.0.smithi050.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T12:00:33.277 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T12:00:33.278 INFO:tasks.workunit.client.0.smithi050.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T12:00:33.278 INFO:tasks.workunit.client.0.smithi050.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T12:00:33.278 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T12:00:33.278 INFO:tasks.workunit.client.0.smithi050.stderr: git switch -c 2024-09-14T12:00:33.278 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T12:00:33.278 INFO:tasks.workunit.client.0.smithi050.stderr:Or undo this operation with: 2024-09-14T12:00:33.278 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T12:00:33.278 INFO:tasks.workunit.client.0.smithi050.stderr: git switch - 2024-09-14T12:00:33.278 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T12:00:33.278 INFO:tasks.workunit.client.0.smithi050.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T12:00:33.279 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T12:00:33.279 INFO:tasks.workunit.client.0.smithi050.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T12:00:33.280 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T12:00:33.349 INFO:tasks.workunit.client.0.smithi050.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T12:00:33.352 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T12:00:33.352 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T12:00:33.402 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T12:00:33.452 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T12:00:33.493 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T12:00:33.495 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T12:00:33.495 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T12:00:33.534 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T12:00:33.538 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-14T12:00:33.538 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T12:00:33.609 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-14T12:00:33.610 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-14T12:00:33.611 DEBUG:teuthology.orchestra.run.smithi050:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T12:00:33.684 INFO:tasks.workunit.client.0.smithi050.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T12:00:33.685 INFO:tasks.workunit.client.0.smithi050.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T12:00:33.685 INFO:tasks.workunit.client.0.smithi050.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T12:00:36.086 INFO:tasks.workunit.client.0.smithi050.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T12:00:36.086 INFO:tasks.workunit.client.0.smithi050.stderr:++ deactivate nondestructive 2024-09-14T12:00:36.086 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -n '' ']' 2024-09-14T12:00:36.086 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -n '' ']' 2024-09-14T12:00:36.087 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T12:00:36.087 INFO:tasks.workunit.client.0.smithi050.stderr:++ hash -r 2024-09-14T12:00:36.087 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -n '' ']' 2024-09-14T12:00:36.087 INFO:tasks.workunit.client.0.smithi050.stderr:++ unset VIRTUAL_ENV 2024-09-14T12:00:36.087 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T12:00:36.087 INFO:tasks.workunit.client.0.smithi050.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T12:00:36.087 INFO:tasks.workunit.client.0.smithi050.stderr:++ export VIRTUAL_ENV 2024-09-14T12:00:36.087 INFO:tasks.workunit.client.0.smithi050.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T12:00:36.088 INFO:tasks.workunit.client.0.smithi050.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T12:00:36.088 INFO:tasks.workunit.client.0.smithi050.stderr:++ export PATH 2024-09-14T12:00:36.088 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -n '' ']' 2024-09-14T12:00:36.088 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -z '' ']' 2024-09-14T12:00:36.088 INFO:tasks.workunit.client.0.smithi050.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T12:00:36.088 INFO:tasks.workunit.client.0.smithi050.stderr:++ PS1='(rgw) ' 2024-09-14T12:00:36.088 INFO:tasks.workunit.client.0.smithi050.stderr:++ export PS1 2024-09-14T12:00:36.088 INFO:tasks.workunit.client.0.smithi050.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T12:00:36.088 INFO:tasks.workunit.client.0.smithi050.stderr:++ hash -r 2024-09-14T12:00:36.089 INFO:tasks.workunit.client.0.smithi050.stderr:+ pip install pip --upgrade 2024-09-14T12:00:36.325 INFO:tasks.workunit.client.0.smithi050.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T12:00:36.695 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting pip 2024-09-14T12:00:36.701 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T12:00:36.747 INFO:tasks.workunit.client.0.smithi050.stdout:Installing collected packages: pip 2024-09-14T12:00:36.747 INFO:tasks.workunit.client.0.smithi050.stdout: Attempting uninstall: pip 2024-09-14T12:00:36.748 INFO:tasks.workunit.client.0.smithi050.stdout: Found existing installation: pip 21.3.1 2024-09-14T12:00:36.910 INFO:tasks.workunit.client.0.smithi050.stdout: Uninstalling pip-21.3.1: 2024-09-14T12:00:36.915 INFO:tasks.workunit.client.0.smithi050.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T12:00:37.690 INFO:tasks.workunit.client.0.smithi050.stdout:Successfully installed pip-24.2 2024-09-14T12:00:37.739 INFO:tasks.workunit.client.0.smithi050.stderr:+ pip install boto3 2024-09-14T12:00:38.554 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting boto3 2024-09-14T12:00:38.556 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T12:00:39.116 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T12:00:39.118 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T12:00:39.166 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T12:00:39.167 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T12:00:39.222 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T12:00:39.223 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T12:00:39.365 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T12:00:39.366 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T12:00:39.443 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T12:00:39.445 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T12:00:39.595 INFO:tasks.workunit.client.0.smithi050.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T12:00:39.597 INFO:tasks.workunit.client.0.smithi050.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T12:00:39.601 INFO:tasks.workunit.client.0.smithi050.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T12:00:39.602 INFO:tasks.workunit.client.0.smithi050.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T12:00:39.611 INFO:tasks.workunit.client.0.smithi050.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T12:00:39.613 INFO:tasks.workunit.client.0.smithi050.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T12:00:39.614 INFO:tasks.workunit.client.0.smithi050.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T12:00:39.616 INFO:tasks.workunit.client.0.smithi050.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T12:00:39.617 INFO:tasks.workunit.client.0.smithi050.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T12:00:39.694 INFO:tasks.workunit.client.0.smithi050.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T12:00:40.726 INFO:tasks.workunit.client.0.smithi050.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T12:00:40.848 INFO:tasks.workunit.client.0.smithi050.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-14T12:00:40.975 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-14T12:00:41.011 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:00:41.011 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:00:41.051 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.052+0000 7fed7ca98800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.072 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.053+0000 7fed7ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:41.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.053+0000 7fed7ca98800 20 realm 2024-09-14T12:00:41.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.053+0000 7fed7ca98800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.054+0000 7fed7ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:41.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.054+0000 7fed7ca98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:00:41.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.054+0000 7fed7ca98800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.054+0000 7fed7ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:41.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.054+0000 7fed7ca98800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.055+0000 7fed7ca98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:00:41.073 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.055+0000 7fed7ca98800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.055+0000 7fed7ca98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:00:41.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.055+0000 7fed7ca98800 20 searching for the correct realm 2024-09-14T12:00:41.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.059+0000 7fed79d81640 0 -- 172.21.15.50:0/2567665270 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fed74055410 msgr2=0x7fed74055890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T12:00:41.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.063+0000 7fed7ad83640 0 -- 172.21.15.50:0/2567665270 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5639aa592940 msgr2=0x5639aa594dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:00:41.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.067+0000 7fed7ca98800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T12:00:41.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.067+0000 7fed7ca98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:00:41.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.067+0000 7fed7ca98800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T12:00:41.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.067+0000 7fed7ca98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:00:41.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.067+0000 7fed7ca98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:00:41.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.067+0000 7fed7ca98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:00:41.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.067+0000 7fed7ca98800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.074 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.068+0000 7fed7ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:41.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.068+0000 7fed7ca98800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.068+0000 7fed7ca98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:00:41.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.068+0000 7fed7ca98800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.068+0000 7fed7ca98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:00:41.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.068+0000 7fed7ca98800 20 zone default found 2024-09-14T12:00:41.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.068+0000 7fed7ca98800 4 Realm: () 2024-09-14T12:00:41.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.068+0000 7fed7ca98800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T12:00:41.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.068+0000 7fed7ca98800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T12:00:41.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.068+0000 7fed7ca98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:00:41.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.068+0000 7fed7ca98800 20 zonegroup default 2024-09-14T12:00:41.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.068+0000 7fed7ca98800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.075 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.068+0000 7fed7ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:41.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.069+0000 7fed7ca98800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.069+0000 7fed7ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:41.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.069+0000 7fed7ca98800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.069+0000 7fed7ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:41.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.069+0000 7fed7ca98800 20 started sync module instance, tier type = 2024-09-14T12:00:41.076 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.069+0000 7fed7ca98800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T12:00:41.079 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.080+0000 7fed7ca98800 20 add_watcher() i=0 2024-09-14T12:00:41.079 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.080+0000 7fed7ca98800 20 add_watcher() i=1 2024-09-14T12:00:41.079 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.080+0000 7fed7ca98800 20 add_watcher() i=2 2024-09-14T12:00:41.079 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.080+0000 7fed7ca98800 20 add_watcher() i=3 2024-09-14T12:00:41.079 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.080+0000 7fed7ca98800 20 add_watcher() i=4 2024-09-14T12:00:41.079 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.080+0000 7fed7ca98800 20 add_watcher() i=5 2024-09-14T12:00:41.079 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.080+0000 7fed7ca98800 20 add_watcher() i=6 2024-09-14T12:00:41.080 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.081+0000 7fed7ca98800 20 add_watcher() i=7 2024-09-14T12:00:41.080 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.081+0000 7fed7ca98800 2 all 8 watchers are set, enabling cache 2024-09-14T12:00:41.081 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.083+0000 7fec30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:00:41.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.083+0000 7fed7ca98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:00:41.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.083+0000 7fed7ca98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:00:41.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.083+0000 7fed7ca98800 5 note: GC not initialized 2024-09-14T12:00:41.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.084+0000 7febab7fe640 20 reqs_thread_entry: start 2024-09-14T12:00:41.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.084+0000 7fed7ca98800 20 init_complete bucket index max shards: 11 2024-09-14T12:00:41.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.084+0000 7fed7ca98800 20 Filter name: none 2024-09-14T12:00:41.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.084+0000 7feba97fa640 20 reqs_thread_entry: start 2024-09-14T12:00:41.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.084+0000 7fed7ca98800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-14T12:00:41.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.084+0000 7fed7ca98800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.083 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.084+0000 7fed7ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:41.084 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.084+0000 7fed7ca98800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-14T12:00:41.084 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.084+0000 7fed7ca98800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T12:00:41.084 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.084+0000 7fed7ca98800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-14T12:00:41.084 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.084+0000 7fed7ca98800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.085+0000 7fed7ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:41.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.085+0000 7fed7ca98800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-14T12:00:41.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.085+0000 7fed7ca98800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T12:00:41.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.085+0000 7fed7ca98800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T12:00:41.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.085+0000 7fed7ca98800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T12:00:41.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.086+0000 7fed7ca98800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T12:00:41.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.086+0000 7fed7ca98800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T12:00:41.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.086+0000 7fed7ca98800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-14T12:00:41.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.086+0000 7fec5dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576400772 cookie 94805671175728 notifier 9393 bl.length()=613 2024-09-14T12:00:41.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.086+0000 7fec5dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T12:00:41.085 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.086+0000 7fec5dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T12:00:41.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.090+0000 7fed7ca98800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T12:00:41.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.090+0000 7fed7ca98800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T12:00:41.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.090+0000 7fed7ca98800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-14T12:00:41.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.090+0000 7fec5dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576400773 cookie 94805671171840 notifier 9393 bl.length()=191 2024-09-14T12:00:41.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.090+0000 7fec5dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T12:00:41.089 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.090+0000 7fec5dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T12:00:41.091 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.092+0000 7fec30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:00:41.093 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.095+0000 7fed7ca98800 20 remove_watcher() i=0 2024-09-14T12:00:41.093 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.095+0000 7fed7ca98800 2 removed watcher, disabling cache 2024-09-14T12:00:41.094 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.096+0000 7fed7ca98800 20 remove_watcher() i=1 2024-09-14T12:00:41.095 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.097+0000 7fed7ca98800 20 remove_watcher() i=2 2024-09-14T12:00:41.096 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.098+0000 7fed7ca98800 20 remove_watcher() i=3 2024-09-14T12:00:41.097 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.099+0000 7fed7ca98800 20 remove_watcher() i=4 2024-09-14T12:00:41.098 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.100+0000 7fed7ca98800 20 remove_watcher() i=5 2024-09-14T12:00:41.099 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.101+0000 7fed7ca98800 20 remove_watcher() i=6 2024-09-14T12:00:41.101 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.102+0000 7fed7ca98800 20 remove_watcher() i=7 2024-09-14T12:00:41.290 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T12:00:41.290 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T12:00:41.340 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T12:00:41.340 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T12:00:41.400 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T12:00:41.401 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T12:00:41.447 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T12:00:41.448 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T12:00:41.475 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-14T12:00:41.475 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T12:00:41.479 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T12:00:41.480 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T12:00:41.518 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T12:00:41.518 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T12:00:41.556 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T12:00:41.556 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T12:00:41.601 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T12:00:41.630 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:00:41.630 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:00:41.670 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.672+0000 7f11f2b22800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.674+0000 7f11f2b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:41.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.674+0000 7f11f2b22800 20 realm 2024-09-14T12:00:41.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.674+0000 7f11f2b22800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.674+0000 7f11f2b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:41.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.674+0000 7f11f2b22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:00:41.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.674+0000 7f11f2b22800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.674+0000 7f11f2b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:41.673 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.674+0000 7f11f2b22800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.674 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.675+0000 7f11f2b22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:00:41.674 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.675+0000 7f11f2b22800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.674 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.676+0000 7f11f2b22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:00:41.674 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.676+0000 7f11f2b22800 20 searching for the correct realm 2024-09-14T12:00:41.677 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.679+0000 7f11edfd1640 0 -- 172.21.15.50:0/1358198728 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f11e803d910 msgr2=0x7f11e802e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:00:41.882 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.884+0000 7f11eefd3640 0 -- 172.21.15.50:0/1358198728 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x563cd6d684a0 msgr2=0x563cd6d6a910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:00:41.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.888+0000 7f11f2b22800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T12:00:41.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.888+0000 7f11f2b22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:00:41.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.888+0000 7f11f2b22800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T12:00:41.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.888+0000 7f11f2b22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:00:41.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.888+0000 7f11f2b22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:00:41.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.888+0000 7f11f2b22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:00:41.887 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.888+0000 7f11f2b22800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.889+0000 7f11f2b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:41.888 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.889+0000 7f11f2b22800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.889+0000 7f11f2b22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:00:41.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.889+0000 7f11f2b22800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.889+0000 7f11f2b22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:00:41.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.889+0000 7f11f2b22800 20 zone default found 2024-09-14T12:00:41.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.889+0000 7f11f2b22800 4 Realm: () 2024-09-14T12:00:41.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.889+0000 7f11f2b22800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T12:00:41.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.889+0000 7f11f2b22800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T12:00:41.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.889+0000 7f11f2b22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:00:41.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.889+0000 7f11f2b22800 20 zonegroup default 2024-09-14T12:00:41.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.889+0000 7f11f2b22800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.889 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.890+0000 7f11f2b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:41.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.890+0000 7f11f2b22800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.890+0000 7f11f2b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:41.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.890+0000 7f11f2b22800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.890+0000 7f11f2b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:41.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.890+0000 7f11f2b22800 20 started sync module instance, tier type = 2024-09-14T12:00:41.890 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.890+0000 7f11f2b22800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T12:00:41.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.899+0000 7f11f2b22800 20 add_watcher() i=0 2024-09-14T12:00:41.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.899+0000 7f11f2b22800 20 add_watcher() i=1 2024-09-14T12:00:41.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.899+0000 7f11f2b22800 20 add_watcher() i=2 2024-09-14T12:00:41.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.899+0000 7f11f2b22800 20 add_watcher() i=3 2024-09-14T12:00:41.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.899+0000 7f11f2b22800 20 add_watcher() i=4 2024-09-14T12:00:41.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.899+0000 7f11f2b22800 20 add_watcher() i=5 2024-09-14T12:00:41.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.899+0000 7f11f2b22800 20 add_watcher() i=6 2024-09-14T12:00:41.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.900+0000 7f11f2b22800 20 add_watcher() i=7 2024-09-14T12:00:41.898 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.900+0000 7f11f2b22800 2 all 8 watchers are set, enabling cache 2024-09-14T12:00:41.900 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.902+0000 7f10a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:00:41.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.902+0000 7f11f2b22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:00:41.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.902+0000 7f11f2b22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:00:41.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.902+0000 7f11f2b22800 5 note: GC not initialized 2024-09-14T12:00:41.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.903+0000 7f101f7fe640 20 reqs_thread_entry: start 2024-09-14T12:00:41.901 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.903+0000 7f11f2b22800 20 init_complete bucket index max shards: 11 2024-09-14T12:00:41.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.903+0000 7f11f2b22800 20 Filter name: none 2024-09-14T12:00:41.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.903+0000 7f101d7fa640 20 reqs_thread_entry: start 2024-09-14T12:00:41.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.903+0000 7f11f2b22800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.903+0000 7f11f2b22800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T12:00:41.902 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.903+0000 7f11f2b22800 20 rados->read ofs=0 len=0 2024-09-14T12:00:41.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.904+0000 7f11f2b22800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T12:00:41.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.904+0000 7f11f2b22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T12:00:41.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.904+0000 7f11f2b22800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T12:00:41.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.904+0000 7f11f2b22800 20 INFO: main: starting shard=0 2024-09-14T12:00:41.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.904+0000 7f11f2b22800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.0 2024-09-14T12:00:41.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.905+0000 7f11f2b22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:00:41.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.905+0000 7f11f2b22800 20 INFO: main: starting shard=1 2024-09-14T12:00:41.903 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.905+0000 7f11f2b22800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.1 2024-09-14T12:00:41.904 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.905+0000 7f11f2b22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:00:41.904 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.905+0000 7f11f2b22800 20 INFO: main: starting shard=2 2024-09-14T12:00:41.904 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.905+0000 7f11f2b22800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.2 2024-09-14T12:00:41.904 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.906+0000 7f11f2b22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:00:41.904 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.906+0000 7f11f2b22800 20 INFO: main: starting shard=3 2024-09-14T12:00:41.904 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.906+0000 7f11f2b22800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.3 2024-09-14T12:00:41.905 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.906+0000 7f11f2b22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:00:41.905 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.906+0000 7f11f2b22800 20 INFO: main: starting shard=4 2024-09-14T12:00:41.905 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.906+0000 7f11f2b22800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.4 2024-09-14T12:00:41.905 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.907+0000 7f11f2b22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:00:41.905 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.907+0000 7f11f2b22800 20 INFO: main: starting shard=5 2024-09-14T12:00:41.905 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.907+0000 7f11f2b22800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.5 2024-09-14T12:00:41.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.907+0000 7f11f2b22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:00:41.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.907+0000 7f11f2b22800 20 INFO: main: starting shard=6 2024-09-14T12:00:41.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.907+0000 7f11f2b22800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.6 2024-09-14T12:00:41.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.908+0000 7f11f2b22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:00:41.906 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.908+0000 7f11f2b22800 20 INFO: main: starting shard=7 2024-09-14T12:00:41.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.908+0000 7f11f2b22800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.7 2024-09-14T12:00:41.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.908+0000 7f11f2b22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:00:41.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.908+0000 7f11f2b22800 20 INFO: main: starting shard=8 2024-09-14T12:00:41.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.908+0000 7f11f2b22800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.8 2024-09-14T12:00:41.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.909+0000 7f11f2b22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:00:41.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.909+0000 7f11f2b22800 20 INFO: main: starting shard=9 2024-09-14T12:00:41.907 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.909+0000 7f11f2b22800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.9 2024-09-14T12:00:41.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.909+0000 7f11f2b22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:00:41.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.909+0000 7f11f2b22800 20 INFO: main: starting shard=10 2024-09-14T12:00:41.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.909+0000 7f11f2b22800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.10 2024-09-14T12:00:41.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.910+0000 7f11f2b22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:00:41.908 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.910+0000 7f11f2b22800 20 INFO: main: done 2024-09-14T12:00:41.909 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.911+0000 7f10a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:00:41.911 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.913+0000 7f11f2b22800 20 remove_watcher() i=0 2024-09-14T12:00:41.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.913+0000 7f11f2b22800 2 removed watcher, disabling cache 2024-09-14T12:00:41.912 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.914+0000 7f11f2b22800 20 remove_watcher() i=1 2024-09-14T12:00:41.913 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.915+0000 7f11f2b22800 20 remove_watcher() i=2 2024-09-14T12:00:41.915 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.916+0000 7f11f2b22800 20 remove_watcher() i=3 2024-09-14T12:00:41.916 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.917+0000 7f11f2b22800 20 remove_watcher() i=4 2024-09-14T12:00:41.917 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.919+0000 7f11f2b22800 20 remove_watcher() i=5 2024-09-14T12:00:41.918 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.920+0000 7f11f2b22800 20 remove_watcher() i=6 2024-09-14T12:00:41.919 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:41.921+0000 7f11f2b22800 20 remove_watcher() i=7 2024-09-14T12:00:41.933 INFO:tasks.workunit.client.0.smithi050.stderr:rados -p default.rgw.buckets.data ls | grep 336e4d82-331e-4af0-890f-7bad29124afe 2024-09-14T12:00:41.956 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:00:41.957 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:00:42.028 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:42.029+0000 7f72246c1640 0 -- 172.21.15.50:0/2135170374 >> [v2:172.21.15.118:6816/4154782182,v1:172.21.15.118:6817/4154782182] conn(0x7f7214069b80 msgr2=0x7f7214062a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:00:42.042 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-14T12:00:42.042 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T12:00:42.044 INFO:tasks.workunit.client.0.smithi050.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T12:00:43.465 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T12:00:43.465 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T12:00:43.505 INFO:tasks.workunit.client.0.smithi050.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T12:00:43.930 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T12:00:43.959 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:00:43.959 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:00:43.998 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.000+0000 7fd72fd2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:44.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.002+0000 7fd72fd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:44.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.002+0000 7fd72fd2c800 20 realm 2024-09-14T12:00:44.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.002+0000 7fd72fd2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:44.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.002+0000 7fd72fd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:44.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.002+0000 7fd72fd2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:00:44.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.002+0000 7fd72fd2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:44.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.002+0000 7fd72fd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:44.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.002+0000 7fd72fd2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:44.002 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.003+0000 7fd72fd2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:00:44.002 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.003+0000 7fd72fd2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:44.002 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.004+0000 7fd72fd2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:00:44.002 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.004+0000 7fd72fd2c800 20 searching for the correct realm 2024-09-14T12:00:44.006 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.007+0000 7fd723fff640 0 -- 172.21.15.50:0/3242881349 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fd724021900 msgr2=0x7fd72402f3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:00:44.211 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.212+0000 7fd72c250640 0 -- 172.21.15.50:0/3242881349 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x5564f0aa4cf0 msgr2=0x5564f0aa71b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:00:44.216 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.217+0000 7fd72fd2c800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T12:00:44.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.217+0000 7fd72fd2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:00:44.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.217+0000 7fd72fd2c800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T12:00:44.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.217+0000 7fd72fd2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:00:44.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.217+0000 7fd72fd2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:00:44.217 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.217+0000 7fd72fd2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:00:44.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.217+0000 7fd72fd2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:44.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.218+0000 7fd72fd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:44.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.218+0000 7fd72fd2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:44.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.218+0000 7fd72fd2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:00:44.218 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.218+0000 7fd72fd2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:44.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.218+0000 7fd72fd2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:00:44.220 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.218+0000 7fd72fd2c800 20 zone default found 2024-09-14T12:00:44.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.218+0000 7fd72fd2c800 4 Realm: () 2024-09-14T12:00:44.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.218+0000 7fd72fd2c800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T12:00:44.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.218+0000 7fd72fd2c800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T12:00:44.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.218+0000 7fd72fd2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:00:44.221 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.218+0000 7fd72fd2c800 20 zonegroup default 2024-09-14T12:00:44.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.218+0000 7fd72fd2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:44.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.219+0000 7fd72fd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:44.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.219+0000 7fd72fd2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:44.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.219+0000 7fd72fd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:44.222 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.219+0000 7fd72fd2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:44.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.219+0000 7fd72fd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:44.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.219+0000 7fd72fd2c800 20 started sync module instance, tier type = 2024-09-14T12:00:44.223 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.219+0000 7fd72fd2c800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T12:00:44.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.229+0000 7fd72fd2c800 20 add_watcher() i=0 2024-09-14T12:00:44.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.229+0000 7fd72fd2c800 20 add_watcher() i=1 2024-09-14T12:00:44.228 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.229+0000 7fd72fd2c800 20 add_watcher() i=2 2024-09-14T12:00:44.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.229+0000 7fd72fd2c800 20 add_watcher() i=3 2024-09-14T12:00:44.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.229+0000 7fd72fd2c800 20 add_watcher() i=4 2024-09-14T12:00:44.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.229+0000 7fd72fd2c800 20 add_watcher() i=5 2024-09-14T12:00:44.229 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.229+0000 7fd72fd2c800 20 add_watcher() i=6 2024-09-14T12:00:44.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.230+0000 7fd72fd2c800 20 add_watcher() i=7 2024-09-14T12:00:44.230 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.230+0000 7fd72fd2c800 2 all 8 watchers are set, enabling cache 2024-09-14T12:00:44.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.232+0000 7fd5e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:00:44.236 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.232+0000 7fd72fd2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:00:44.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.232+0000 7fd72fd2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:00:44.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.232+0000 7fd72fd2c800 5 note: GC not initialized 2024-09-14T12:00:44.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.232+0000 7fd5e0fe1640 20 reqs_thread_entry: start 2024-09-14T12:00:44.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.233+0000 7fd72fd2c800 20 init_complete bucket index max shards: 11 2024-09-14T12:00:44.237 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.233+0000 7fd72fd2c800 20 Filter name: none 2024-09-14T12:00:44.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.233+0000 7fd55a7fc640 20 reqs_thread_entry: start 2024-09-14T12:00:44.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.233+0000 7fd72fd2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:44.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.233+0000 7fd72fd2c800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T12:00:44.238 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.233+0000 7fd72fd2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:44.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.234+0000 7fd72fd2c800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T12:00:44.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.234+0000 7fd72fd2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T12:00:44.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.234+0000 7fd72fd2c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T12:00:44.239 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.234+0000 7fd72fd2c800 20 INFO: main: starting shard=0 2024-09-14T12:00:44.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.234+0000 7fd72fd2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.0 2024-09-14T12:00:44.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.234+0000 7fd72fd2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:00:44.240 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.234+0000 7fd72fd2c800 20 INFO: main: starting shard=1 2024-09-14T12:00:44.241 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.234+0000 7fd72fd2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.1 2024-09-14T12:00:44.241 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.235+0000 7fd72fd2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:00:44.241 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.235+0000 7fd72fd2c800 20 INFO: main: starting shard=2 2024-09-14T12:00:44.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.235+0000 7fd72fd2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.2 2024-09-14T12:00:44.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.235+0000 7fd72fd2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:00:44.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.235+0000 7fd72fd2c800 20 INFO: main: starting shard=3 2024-09-14T12:00:44.242 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.235+0000 7fd72fd2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.3 2024-09-14T12:00:44.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.236+0000 7fd72fd2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:00:44.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.236+0000 7fd72fd2c800 20 INFO: main: starting shard=4 2024-09-14T12:00:44.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.236+0000 7fd72fd2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.4 2024-09-14T12:00:44.243 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.237+0000 7fd72fd2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:00:44.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.237+0000 7fd72fd2c800 20 INFO: main: starting shard=5 2024-09-14T12:00:44.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.237+0000 7fd72fd2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.5 2024-09-14T12:00:44.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.237+0000 7fd72fd2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:00:44.244 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.237+0000 7fd72fd2c800 20 INFO: main: starting shard=6 2024-09-14T12:00:44.245 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.237+0000 7fd72fd2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.6 2024-09-14T12:00:44.245 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.237+0000 7fd72fd2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:00:44.245 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.237+0000 7fd72fd2c800 20 INFO: main: starting shard=7 2024-09-14T12:00:44.245 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.237+0000 7fd72fd2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.7 2024-09-14T12:00:44.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.238+0000 7fd72fd2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:00:44.249 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.238+0000 7fd72fd2c800 20 INFO: main: starting shard=8 2024-09-14T12:00:44.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.238+0000 7fd72fd2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.8 2024-09-14T12:00:44.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.238+0000 7fd72fd2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:00:44.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.238+0000 7fd72fd2c800 20 INFO: main: starting shard=9 2024-09-14T12:00:44.250 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.238+0000 7fd72fd2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.9 2024-09-14T12:00:44.251 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.239+0000 7fd72fd2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:00:44.251 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.239+0000 7fd72fd2c800 20 INFO: main: starting shard=10 2024-09-14T12:00:44.251 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.239+0000 7fd72fd2c800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.10 2024-09-14T12:00:44.251 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.240+0000 7fd72fd2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:00:44.251 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.240+0000 7fd72fd2c800 20 INFO: main: done 2024-09-14T12:00:44.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.240+0000 7fd5e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:00:44.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.243+0000 7fd72fd2c800 20 remove_watcher() i=0 2024-09-14T12:00:44.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.243+0000 7fd72fd2c800 2 removed watcher, disabling cache 2024-09-14T12:00:44.252 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.244+0000 7fd72fd2c800 20 remove_watcher() i=1 2024-09-14T12:00:44.253 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.245+0000 7fd72fd2c800 20 remove_watcher() i=2 2024-09-14T12:00:44.253 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.246+0000 7fd72fd2c800 20 remove_watcher() i=3 2024-09-14T12:00:44.253 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.247+0000 7fd72fd2c800 20 remove_watcher() i=4 2024-09-14T12:00:44.253 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.248+0000 7fd72fd2c800 20 remove_watcher() i=5 2024-09-14T12:00:44.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.249+0000 7fd72fd2c800 20 remove_watcher() i=6 2024-09-14T12:00:44.254 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.250+0000 7fd72fd2c800 20 remove_watcher() i=7 2024-09-14T12:00:44.262 INFO:tasks.workunit.client.0.smithi050.stderr:rados -p default.rgw.buckets.data ls | grep 9393a1b1-7174-48d3-ba17-ff2dd68a5858 2024-09-14T12:00:44.285 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:00:44.285 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:00:44.360 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:44.362+0000 7f3925699640 0 -- 172.21.15.50:0/1445705563 >> [v2:172.21.15.118:6816/4154782182,v1:172.21.15.118:6817/4154782182] conn(0x7f3920061cd0 msgr2=0x7f39200620d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:00:44.376 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-14T12:00:44.377 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T12:00:44.379 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T12:00:44.379 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T12:00:44.409 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T12:00:44.409 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T12:00:44.448 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T12:00:44.448 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T12:00:44.477 INFO:tasks.workunit.client.0.smithi050.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T12:00:45.892 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T12:00:45.892 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T12:00:45.986 INFO:tasks.workunit.client.0.smithi050.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T12:00:45.987 INFO:tasks.workunit.client.0.smithi050.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T12:00:46.399 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T12:00:46.399 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T12:00:46.474 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T12:00:46.475 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T12:00:46.521 INFO:tasks.workunit.client.0.smithi050.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-14T12:00:46.522 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-14T12:00:46.523 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T12:00:46.523 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T12:00:46.595 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T12:00:46.596 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T12:00:46.659 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T12:00:46.659 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T12:00:46.696 INFO:tasks.workunit.client.0.smithi050.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-14T12:00:48.119 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T12:00:48.120 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T12:00:48.184 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T12:00:48.185 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T12:00:50.255 INFO:tasks.workunit.client.0.smithi050.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-14T12:00:50.681 INFO:tasks.workunit.client.0.smithi050.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-14T12:00:50.712 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:00:50.713 INFO:tasks.workunit.client.0.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:00:50.752 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.755+0000 7f2acbfa2800 20 rados->read ofs=0 len=0 2024-09-14T12:00:50.754 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.757+0000 7f2acbfa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:50.754 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.757+0000 7f2acbfa2800 20 realm 2024-09-14T12:00:50.754 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.757+0000 7f2acbfa2800 20 rados->read ofs=0 len=0 2024-09-14T12:00:50.755 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.757+0000 7f2acbfa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:50.755 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.757+0000 7f2acbfa2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:00:50.755 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.757+0000 7f2acbfa2800 20 rados->read ofs=0 len=0 2024-09-14T12:00:50.755 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.757+0000 7f2acbfa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:50.755 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.757+0000 7f2acbfa2800 20 rados->read ofs=0 len=0 2024-09-14T12:00:50.755 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.758+0000 7f2acbfa2800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:00:50.755 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.758+0000 7f2acbfa2800 20 rados->read ofs=0 len=0 2024-09-14T12:00:50.756 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.759+0000 7f2acbfa2800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:00:50.756 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.759+0000 7f2acbfa2800 20 searching for the correct realm 2024-09-14T12:00:50.759 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.762+0000 7f2ac928b640 0 -- 172.21.15.50:0/1855051098 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f2ac40679c0 msgr2=0x7f2ac4066170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T12:00:50.966 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.969+0000 7f2aca28d640 0 -- 172.21.15.50:0/1855051098 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x558648b9e6b0 msgr2=0x558648ba0b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:00:50.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.973+0000 7f2acbfa2800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T12:00:50.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.973+0000 7f2acbfa2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:00:50.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.973+0000 7f2acbfa2800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T12:00:50.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.973+0000 7f2acbfa2800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:00:50.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.973+0000 7f2acbfa2800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:00:50.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.973+0000 7f2acbfa2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:00:50.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.973+0000 7f2acbfa2800 20 rados->read ofs=0 len=0 2024-09-14T12:00:50.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.973+0000 7f2acbfa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:50.971 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.973+0000 7f2acbfa2800 20 rados->read ofs=0 len=0 2024-09-14T12:00:50.973 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.974+0000 7f2acbfa2800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:00:50.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.974+0000 7f2acbfa2800 20 rados->read ofs=0 len=0 2024-09-14T12:00:50.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.974+0000 7f2acbfa2800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:00:50.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.974+0000 7f2acbfa2800 20 zone default found 2024-09-14T12:00:50.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.974+0000 7f2acbfa2800 4 Realm: () 2024-09-14T12:00:50.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.974+0000 7f2acbfa2800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T12:00:50.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.974+0000 7f2acbfa2800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T12:00:50.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.974+0000 7f2acbfa2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:00:50.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.974+0000 7f2acbfa2800 20 zonegroup default 2024-09-14T12:00:50.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.974+0000 7f2acbfa2800 20 rados->read ofs=0 len=0 2024-09-14T12:00:50.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.974+0000 7f2acbfa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:50.976 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.974+0000 7f2acbfa2800 20 rados->read ofs=0 len=0 2024-09-14T12:00:50.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.975+0000 7f2acbfa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:50.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.975+0000 7f2acbfa2800 20 rados->read ofs=0 len=0 2024-09-14T12:00:50.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.975+0000 7f2acbfa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:50.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.975+0000 7f2acbfa2800 20 started sync module instance, tier type = 2024-09-14T12:00:50.977 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.975+0000 7f2acbfa2800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T12:00:50.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.984+0000 7f2acbfa2800 20 add_watcher() i=0 2024-09-14T12:00:50.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.984+0000 7f2acbfa2800 20 add_watcher() i=1 2024-09-14T12:00:50.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.984+0000 7f2acbfa2800 20 add_watcher() i=2 2024-09-14T12:00:50.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.984+0000 7f2acbfa2800 20 add_watcher() i=3 2024-09-14T12:00:50.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.984+0000 7f2acbfa2800 20 add_watcher() i=4 2024-09-14T12:00:50.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.984+0000 7f2acbfa2800 20 add_watcher() i=5 2024-09-14T12:00:50.982 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.984+0000 7f2acbfa2800 20 add_watcher() i=6 2024-09-14T12:00:50.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.985+0000 7f2acbfa2800 20 add_watcher() i=7 2024-09-14T12:00:50.983 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.985+0000 7f2acbfa2800 2 all 8 watchers are set, enabling cache 2024-09-14T12:00:50.985 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.987+0000 7f297b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:00:50.985 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.988+0000 7f2acbfa2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:00:50.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.988+0000 7f2acbfa2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:00:50.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.988+0000 7f2acbfa2800 5 note: GC not initialized 2024-09-14T12:00:50.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.988+0000 7f297a7fc640 20 reqs_thread_entry: start 2024-09-14T12:00:50.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.988+0000 7f2acbfa2800 20 init_complete bucket index max shards: 11 2024-09-14T12:00:50.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.988+0000 7f2acbfa2800 20 Filter name: none 2024-09-14T12:00:50.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.988+0000 7f28ebfff640 20 reqs_thread_entry: start 2024-09-14T12:00:50.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.988+0000 7f2acbfa2800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-14T12:00:50.986 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.988+0000 7f2acbfa2800 20 rados->read ofs=0 len=0 2024-09-14T12:00:50.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.989+0000 7f2acbfa2800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T12:00:50.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.989+0000 7f2acbfa2800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-14T12:00:50.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.989+0000 7f2acbfa2800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-14T12:00:50.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.989+0000 7f2acbfa2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783 : miss 2024-09-14T12:00:50.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.989+0000 7f2acbfa2800 20 rados->read ofs=0 len=0 2024-09-14T12:00:50.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.989+0000 7f2acbfa2800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T12:00:50.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.989+0000 7f2acbfa2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783 info.flags=0x17 2024-09-14T12:00:50.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.989+0000 7f2acbfa2800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783 to cache LRU end 2024-09-14T12:00:50.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.989+0000 7f2acbfa2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T12:00:50.987 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.989+0000 7f2acbfa2800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T12:00:50.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.989+0000 7f2acbfa2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783 2024-09-14T12:00:50.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.989+0000 7f2acbfa2800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.0 2024-09-14T12:00:50.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.990+0000 7f2acbfa2800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T12:00:50.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.990+0000 7f2acbfa2800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.1 2024-09-14T12:00:50.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.991+0000 7f2acbfa2800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T12:00:50.988 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.991+0000 7f2acbfa2800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.2 2024-09-14T12:00:50.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.991+0000 7f2acbfa2800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T12:00:50.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.991+0000 7f2acbfa2800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.3 2024-09-14T12:00:50.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.992+0000 7f2acbfa2800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T12:00:50.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.992+0000 7f2acbfa2800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.4 2024-09-14T12:00:50.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.992+0000 7f2acbfa2800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T12:00:50.989 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.992+0000 7f2acbfa2800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.5 2024-09-14T12:00:50.990 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.992+0000 7f2acbfa2800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T12:00:50.990 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.993+0000 7f2acbfa2800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.6 2024-09-14T12:00:50.990 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.993+0000 7f2acbfa2800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T12:00:50.990 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.993+0000 7f2acbfa2800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.7 2024-09-14T12:00:50.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.994+0000 7f2acbfa2800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T12:00:50.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.994+0000 7f2acbfa2800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.8 2024-09-14T12:00:50.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.994+0000 7f2acbfa2800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T12:00:50.991 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.994+0000 7f2acbfa2800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.9 2024-09-14T12:00:50.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.995+0000 7f2acbfa2800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T12:00:50.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.995+0000 7f2acbfa2800 20 bucket index object: :.dir.c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783.10 2024-09-14T12:00:50.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.995+0000 7f2acbfa2800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T12:00:50.992 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.995+0000 7f2acbfa2800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T12:00:50.993 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.996+0000 7f297b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:00:50.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.998+0000 7f2acbfa2800 20 remove_watcher() i=0 2024-09-14T12:00:50.995 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.998+0000 7f2acbfa2800 2 removed watcher, disabling cache 2024-09-14T12:00:50.996 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:50.999+0000 7f2acbfa2800 20 remove_watcher() i=1 2024-09-14T12:00:50.997 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:51.000+0000 7f2acbfa2800 20 remove_watcher() i=2 2024-09-14T12:00:50.999 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:51.001+0000 7f2acbfa2800 20 remove_watcher() i=3 2024-09-14T12:00:51.000 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:51.003+0000 7f2acbfa2800 20 remove_watcher() i=4 2024-09-14T12:00:51.001 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:51.004+0000 7f2acbfa2800 20 remove_watcher() i=5 2024-09-14T12:00:51.002 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:51.005+0000 7f2acbfa2800 20 remove_watcher() i=6 2024-09-14T12:00:51.003 INFO:tasks.workunit.client.0.smithi050.stderr:2024-09-14T12:00:51.006+0000 7f2acbfa2800 20 remove_watcher() i=7 2024-09-14T12:00:51.014 INFO:tasks.workunit.client.0.smithi050.stderr:Deleting bucket versioning-bucket 2024-09-14T12:00:51.017 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T12:00:51.017 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T12:00:51.049 INFO:tasks.workunit.client.0.smithi050.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T12:00:51.049 INFO:tasks.workunit.client.0.smithi050.stderr: warnings.warn( 2024-09-14T12:00:51.175 INFO:tasks.workunit.client.0.smithi050.stderr:Completed bucket versioning tests 2024-09-14T12:00:51.175 INFO:tasks.workunit.client.0.smithi050.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-14T12:00:51.175 INFO:tasks.workunit.client.0.smithi050.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-14T12:00:51.176 INFO:tasks.workunit.client.0.smithi050.stdout:connected to https://localhost:443 2024-09-14T12:00:51.240 INFO:tasks.workunit.client.0.smithi050.stderr:+ deactivate 2024-09-14T12:00:51.240 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T12:00:51.240 INFO:tasks.workunit.client.0.smithi050.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T12:00:51.241 INFO:tasks.workunit.client.0.smithi050.stderr:+ export PATH 2024-09-14T12:00:51.241 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T12:00:51.241 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -n '' ']' 2024-09-14T12:00:51.241 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T12:00:51.241 INFO:tasks.workunit.client.0.smithi050.stderr:+ hash -r 2024-09-14T12:00:51.241 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' -n '' ']' 2024-09-14T12:00:51.241 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset VIRTUAL_ENV 2024-09-14T12:00:51.241 INFO:tasks.workunit.client.0.smithi050.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T12:00:51.241 INFO:tasks.workunit.client.0.smithi050.stderr:+ unset -f deactivate 2024-09-14T12:00:51.241 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo OK. 2024-09-14T12:00:51.242 INFO:tasks.workunit.client.0.smithi050.stdout:OK. 2024-09-14T12:00:51.242 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T12:00:51.243 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T12:00:51.324 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-14T12:00:51.324 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T12:00:51.723 DEBUG:teuthology.parallel:result is None 2024-09-14T12:00:51.724 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T12:00:51.764 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T12:00:51.764 DEBUG:teuthology.orchestra.run.smithi050:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T12:00:51.834 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T12:00:51.834 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-14T12:00:51.844 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-14T12:00:51.865 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-14T12:00:51.866 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-14T12:00:51.866 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-14T12:00:51.937 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-14T12:00:51.938 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-14T12:00:51.996 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:00:51.996 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:00:52.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.035+0000 7f8ac8d2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:52.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.037+0000 7f8ac8d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:52.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.037+0000 7f8ac8d2c800 20 realm 2024-09-14T12:00:52.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.037+0000 7f8ac8d2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:52.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.038+0000 7f8ac8d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:52.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.038+0000 7f8ac8d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:00:52.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.038+0000 7f8ac8d2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:52.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.038+0000 7f8ac8d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:52.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.038+0000 7f8ac8d2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:52.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.039+0000 7f8ac8d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:00:52.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.039+0000 7f8ac8d2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:52.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.039+0000 7f8ac8d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:00:52.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.039+0000 7f8ac8d2c800 20 searching for the correct realm 2024-09-14T12:00:52.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.043+0000 7f8ac42ac640 0 -- 172.21.15.50:0/1050238895 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7f8abc06a300 msgr2=0x7f8abc066a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:00:52.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.249+0000 7f8ac52ae640 0 -- 172.21.15.50:0/1050238895 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x55def448ff80 msgr2=0x55def44923f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:00:52.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.254+0000 7f8ac8d2c800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T12:00:52.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.254+0000 7f8ac8d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:00:52.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.254+0000 7f8ac8d2c800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T12:00:52.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.254+0000 7f8ac8d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:00:52.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.254+0000 7f8ac8d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:00:52.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.254+0000 7f8ac8d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:00:52.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.254+0000 7f8ac8d2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:52.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.254+0000 7f8ac8d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:52.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.254+0000 7f8ac8d2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:52.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.254+0000 7f8ac8d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:00:52.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.254+0000 7f8ac8d2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:52.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.255+0000 7f8ac8d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:00:52.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.255+0000 7f8ac8d2c800 20 zone default found 2024-09-14T12:00:52.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.255+0000 7f8ac8d2c800 4 Realm: () 2024-09-14T12:00:52.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.255+0000 7f8ac8d2c800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T12:00:52.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.255+0000 7f8ac8d2c800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T12:00:52.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.255+0000 7f8ac8d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:00:52.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.255+0000 7f8ac8d2c800 20 zonegroup default 2024-09-14T12:00:52.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.255+0000 7f8ac8d2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:52.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.255+0000 7f8ac8d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:52.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.255+0000 7f8ac8d2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:52.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.255+0000 7f8ac8d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:52.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.255+0000 7f8ac8d2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:52.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.256+0000 7f8ac8d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:00:52.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.256+0000 7f8ac8d2c800 20 started sync module instance, tier type = 2024-09-14T12:00:52.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.256+0000 7f8ac8d2c800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T12:00:52.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.266+0000 7f8ac8d2c800 20 add_watcher() i=0 2024-09-14T12:00:52.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.266+0000 7f8ac8d2c800 20 add_watcher() i=1 2024-09-14T12:00:52.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.266+0000 7f8ac8d2c800 20 add_watcher() i=2 2024-09-14T12:00:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.266+0000 7f8ac8d2c800 20 add_watcher() i=3 2024-09-14T12:00:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.266+0000 7f8ac8d2c800 20 add_watcher() i=4 2024-09-14T12:00:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.266+0000 7f8ac8d2c800 20 add_watcher() i=5 2024-09-14T12:00:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.266+0000 7f8ac8d2c800 20 add_watcher() i=6 2024-09-14T12:00:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.267+0000 7f8ac8d2c800 20 add_watcher() i=7 2024-09-14T12:00:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.267+0000 7f8ac8d2c800 2 all 8 watchers are set, enabling cache 2024-09-14T12:00:52.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.269+0000 7f897b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:00:52.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.269+0000 7f8ac8d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:00:52.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.269+0000 7f8ac8d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:00:52.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.307+0000 7f897a7e4640 20 reqs_thread_entry: start 2024-09-14T12:00:52.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.307+0000 7f8ac8d2c800 20 init_complete bucket index max shards: 11 2024-09-14T12:00:52.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.307+0000 7f8ac8d2c800 20 Filter name: none 2024-09-14T12:00:52.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.307+0000 7f89737fe640 20 reqs_thread_entry: start 2024-09-14T12:00:52.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.307+0000 7f8ac8d2c800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T12:00:52.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.307+0000 7f8ac8d2c800 20 rados->read ofs=0 len=0 2024-09-14T12:00:52.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.308+0000 7f8ac8d2c800 20 rados_obj.operate() r=0 bl.length=482 2024-09-14T12:00:52.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.308+0000 7f8ac8d2c800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-14T12:00:52.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.308+0000 7f8ac8d2c800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T12:00:52.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.308+0000 7f8ac8d2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T12:00:52.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.308+0000 7f8ac8d2c800 10 removing key index: ADSFQXUQGLJIOYDCMRXH 2024-09-14T12:00:52.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.309+0000 7f8ac8d2c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:ADSFQXUQGLJIOYDCMRXH, ofs0, ns] 2024-09-14T12:00:52.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.309+0000 7f899bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576400776 cookie 94416069605552 notifier 9519 bl.length()=170 2024-09-14T12:00:52.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.311+0000 7f8ac8d2c800 10 removing email index: tester.client.0_test@test.test 2024-09-14T12:00:52.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.312+0000 7f8ac8d2c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T12:00:52.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.313+0000 7f899bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576400071 cookie 94416069600240 notifier 9519 bl.length()=181 2024-09-14T12:00:52.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.314+0000 7f8ac8d2c800 10 removing user buckets index 2024-09-14T12:00:52.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.315+0000 7f8ac8d2c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-14T12:00:52.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.315+0000 7f899bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576400777 cookie 94416069610816 notifier 9519 bl.length()=172 2024-09-14T12:00:52.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.316+0000 7f8ac8d2c800 10 removing user index: tester.client.0 2024-09-14T12:00:52.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.318+0000 7f8ac8d2c800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-14T12:00:52.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.318+0000 7f8ac8d2c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T12:00:52.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.318+0000 7f899b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576400778 cookie 94416069608672 notifier 9519 bl.length()=164 2024-09-14T12:00:52.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.320+0000 7f897b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:00:52.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.323+0000 7f8ac8d2c800 20 remove_watcher() i=0 2024-09-14T12:00:52.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.323+0000 7f8ac8d2c800 2 removed watcher, disabling cache 2024-09-14T12:00:52.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.324+0000 7f8ac8d2c800 20 remove_watcher() i=1 2024-09-14T12:00:52.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.325+0000 7f8ac8d2c800 20 remove_watcher() i=2 2024-09-14T12:00:52.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.326+0000 7f8ac8d2c800 20 remove_watcher() i=3 2024-09-14T12:00:52.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.327+0000 7f8ac8d2c800 20 remove_watcher() i=4 2024-09-14T12:00:52.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.328+0000 7f8ac8d2c800 20 remove_watcher() i=5 2024-09-14T12:00:52.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.329+0000 7f8ac8d2c800 20 remove_watcher() i=6 2024-09-14T12:00:52.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:00:52.330+0000 7f8ac8d2c800 20 remove_watcher() i=7 2024-09-14T12:00:52.340 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-14T12:00:52.352 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-14T12:00:52.381 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-14T12:00:52.441 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-14T12:00:52.450 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-14T12:00:52.451 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:52.460 INFO:tasks.rgw.client.0.smithi050.stdout:2024-09-14T12:00:52.457+0000 f878640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 45136) UID: 0 2024-09-14T12:00:52.460 INFO:tasks.rgw.client.0.smithi050.stdout:2024-09-14T12:00:52.461+0000 a1c2240 -1 shutting down 2024-09-14T12:01:10.910 INFO:tasks.rgw.client.0.smithi050.stderr:==00:01:14:13.277 45140== could not unlink /tmp/vgdb-pipe-from-vgdb-to-45140-by-root-on-??? 2024-09-14T12:01:10.910 INFO:tasks.rgw.client.0.smithi050.stderr:==00:01:14:13.277 45140== could not unlink /tmp/vgdb-pipe-to-vgdb-from-45140-by-root-on-??? 2024-09-14T12:01:10.910 INFO:tasks.rgw.client.0.smithi050.stderr:==00:01:14:13.277 45140== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-45140-by-root-on-??? 2024-09-14T12:01:16.857 INFO:tasks.rgw.client.0:Stopped 2024-09-14T12:01:16.857 DEBUG:teuthology.orchestra.run.smithi050:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-14T12:01:16.894 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f /etc/ceph/vault-root-token 2024-09-14T12:01:16.979 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-14T12:01:17.063 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-14T12:01:17.064 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-14T12:01:17.064 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-14T12:01:17.164 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:01:17.164 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:01:17.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.203+0000 7fba010bb800 20 rados->read ofs=0 len=0 2024-09-14T12:01:17.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.205+0000 7fba010bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:01:17.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.205+0000 7fba010bb800 20 realm 2024-09-14T12:01:17.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.205+0000 7fba010bb800 20 rados->read ofs=0 len=0 2024-09-14T12:01:17.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.205+0000 7fba010bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:01:17.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.205+0000 7fba010bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:01:17.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.205+0000 7fba010bb800 20 rados->read ofs=0 len=0 2024-09-14T12:01:17.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.205+0000 7fba010bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:01:17.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.205+0000 7fba010bb800 20 rados->read ofs=0 len=0 2024-09-14T12:01:17.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.206+0000 7fba010bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:01:17.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.206+0000 7fba010bb800 20 rados->read ofs=0 len=0 2024-09-14T12:01:17.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.206+0000 7fba010bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:01:17.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.207+0000 7fba010bb800 20 searching for the correct realm 2024-09-14T12:01:17.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.209+0000 7fb9fe3a4640 0 -- 172.21.15.50:0/1397114374 >> [v2:172.21.15.118:6800/287234102,v1:172.21.15.118:6801/287234102] conn(0x7fb9f8069040 msgr2=0x7fb9f80b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:01:17.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.414+0000 7fb9ff3a6640 0 -- 172.21.15.50:0/1397114374 >> [v2:172.21.15.118:6808/2553505309,v1:172.21.15.118:6809/2553505309] conn(0x562b70d58390 msgr2=0x562b70d5a800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:01:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.418+0000 7fba010bb800 20 RGWRados::pool_iterate: got zone_info.c28b75ff-2576-4ab1-a211-5d2fca133105 2024-09-14T12:01:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.418+0000 7fba010bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:01:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.418+0000 7fba010bb800 20 RGWRados::pool_iterate: got zonegroup_info.894bf524-874c-496e-b0b0-8003f73cd6b1 2024-09-14T12:01:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.418+0000 7fba010bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:01:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.418+0000 7fba010bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:01:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.418+0000 7fba010bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:01:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.418+0000 7fba010bb800 20 rados->read ofs=0 len=0 2024-09-14T12:01:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.419+0000 7fba010bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:01:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.419+0000 7fba010bb800 20 rados->read ofs=0 len=0 2024-09-14T12:01:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.419+0000 7fba010bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:01:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.419+0000 7fba010bb800 20 rados->read ofs=0 len=0 2024-09-14T12:01:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.419+0000 7fba010bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:01:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.419+0000 7fba010bb800 20 zone default found 2024-09-14T12:01:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.419+0000 7fba010bb800 4 Realm: () 2024-09-14T12:01:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.419+0000 7fba010bb800 4 ZoneGroup: default (894bf524-874c-496e-b0b0-8003f73cd6b1) 2024-09-14T12:01:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.419+0000 7fba010bb800 4 Zone: default (c28b75ff-2576-4ab1-a211-5d2fca133105) 2024-09-14T12:01:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.419+0000 7fba010bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:01:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.419+0000 7fba010bb800 20 zonegroup default 2024-09-14T12:01:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.419+0000 7fba010bb800 20 rados->read ofs=0 len=0 2024-09-14T12:01:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.420+0000 7fba010bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:01:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.420+0000 7fba010bb800 20 rados->read ofs=0 len=0 2024-09-14T12:01:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.420+0000 7fba010bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:01:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.420+0000 7fba010bb800 20 rados->read ofs=0 len=0 2024-09-14T12:01:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.420+0000 7fba010bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:01:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.420+0000 7fba010bb800 20 started sync module instance, tier type = 2024-09-14T12:01:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.420+0000 7fba010bb800 20 started zone id=c28b75ff-2576-4ab1-a211-5d2fca133105 (name=default) with tier type = 2024-09-14T12:01:17.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.430+0000 7fba010bb800 20 add_watcher() i=0 2024-09-14T12:01:17.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.430+0000 7fba010bb800 20 add_watcher() i=1 2024-09-14T12:01:17.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.430+0000 7fba010bb800 20 add_watcher() i=2 2024-09-14T12:01:17.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.430+0000 7fba010bb800 20 add_watcher() i=3 2024-09-14T12:01:17.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.430+0000 7fba010bb800 20 add_watcher() i=4 2024-09-14T12:01:17.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.430+0000 7fba010bb800 20 add_watcher() i=5 2024-09-14T12:01:17.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.430+0000 7fba010bb800 20 add_watcher() i=6 2024-09-14T12:01:17.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.431+0000 7fba010bb800 20 add_watcher() i=7 2024-09-14T12:01:17.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.431+0000 7fba010bb800 2 all 8 watchers are set, enabling cache 2024-09-14T12:01:17.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.433+0000 7fb8b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:01:17.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.434+0000 7fba010bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:01:17.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.434+0000 7fba010bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:01:17.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.473+0000 7fb82ffff640 20 reqs_thread_entry: start 2024-09-14T12:01:17.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.473+0000 7fba010bb800 20 init_complete bucket index max shards: 11 2024-09-14T12:01:17.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.473+0000 7fba010bb800 20 Filter name: none 2024-09-14T12:01:17.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.474+0000 7fb82dffb640 20 reqs_thread_entry: start 2024-09-14T12:01:17.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.474+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T12:01:17.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.475+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:17.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.475+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:17.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.476+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49707' 2024-09-14T12:01:17.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.476+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='_43FMhX3WM5WTaLf_AIl7ma58G1xkh2z', time=2024-09-14T13:28:29.209751+0000, chain.objs.size()=2 2024-09-14T12:01:17.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.476+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.162__shadow_.B-qp461BbuuzspgnJLInIY9ZHXpGQJx_0 2024-09-14T12:01:17.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.476+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.162__shadow_.B-qp461BbuuzspgnJLInIY9ZHXpGQJx_1 2024-09-14T12:01:17.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.476+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16938840161690811889', time=2024-09-14T13:31:42.802878+0000, chain.objs.size()=1 2024-09-14T12:01:17.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.476+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.239__shadow_.anTdWdODx52yWyZBUtEAB9c8oTQ8U8__0 2024-09-14T12:01:17.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.476+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9971790197731763585', time=2024-09-14T13:31:50.537757+0000, chain.objs.size()=1 2024-09-14T12:01:17.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.476+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.245__shadow_.yHIqHNH9BkUastyCYelpglia011Oe5w_0 2024-09-14T12:01:17.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.476+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9580525641850813286', time=2024-09-14T13:31:58.426680+0000, chain.objs.size()=1 2024-09-14T12:01:17.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.476+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.252__shadow_.RYtPwaQi7kOVKoyqoz653TSUoQh2t0N_0 2024-09-14T12:01:17.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.476+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9315905692469909496', time=2024-09-14T13:32:47.465231+0000, chain.objs.size()=1 2024-09-14T12:01:17.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.476+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.sjj0k7A-vgpn6rICV-kvPb55in8ccIE_0 2024-09-14T12:01:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.476+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9073073335638754800', time=2024-09-14T13:32:47.465985+0000, chain.objs.size()=1 2024-09-14T12:01:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.476+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.m_zoP_69e9v8NZQdWsHycjxBtRs2Vhn_0 2024-09-14T12:01:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.476+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18337532656843240574', time=2024-09-14T13:32:47.830943+0000, chain.objs.size()=1 2024-09-14T12:01:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.476+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.wpQjh8ZXv9NEjHPqn3I37zcW3FcXYgM_0 2024-09-14T12:01:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.476+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13086195069751645834', time=2024-09-14T13:32:49.028996+0000, chain.objs.size()=1 2024-09-14T12:01:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.476+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.adSOmqSmX-xUvM85Fds2iCkdJXcgyRf_0 2024-09-14T12:01:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.476+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11186381295145547231', time=2024-09-14T13:32:49.058765+0000, chain.objs.size()=1 2024-09-14T12:01:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.476+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Cw0oFpqUyMiOrHt9BoNFDrtWweN-9bU_0 2024-09-14T12:01:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.476+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13922623148621479119', time=2024-09-14T13:32:49.212617+0000, chain.objs.size()=1 2024-09-14T12:01:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.476+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.i9PrPu2a7JfCxmWl51ujgz-0WsPWFhN_0 2024-09-14T12:01:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.476+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6526204604816353885', time=2024-09-14T13:32:49.466609+0000, chain.objs.size()=1 2024-09-14T12:01:17.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.476+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Dn5gHATkJJyIxdxAvuOt4bsdTOgZGrD_0 2024-09-14T12:01:17.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.480+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18184273095819844668', time=2024-09-14T13:32:49.796565+0000, chain.objs.size()=1 2024-09-14T12:01:17.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.480+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.1UpGSvJJ3dGGUNwjyLJovmCt8do0s97_0 2024-09-14T12:01:17.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.480+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15828689946326995164', time=2024-09-14T13:32:50.689532+0000, chain.objs.size()=1 2024-09-14T12:01:17.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.480+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.z4jwezI8wIxhFIQ_Va2IMO44chHZ8zn_0 2024-09-14T12:01:17.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.480+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5294276815701959222', time=2024-09-14T13:32:50.835045+0000, chain.objs.size()=1 2024-09-14T12:01:17.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.480+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.XJCdGjLv2GbXjBOE6LpeGJeEVl7BquC_0 2024-09-14T12:01:17.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.480+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14547124838181434780', time=2024-09-14T13:32:50.965770+0000, chain.objs.size()=1 2024-09-14T12:01:17.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.480+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.o1DdugePmBcm3ybELqh34sejkG3GB-o_0 2024-09-14T12:01:17.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.480+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12920257829998210378', time=2024-09-14T13:32:51.258530+0000, chain.objs.size()=1 2024-09-14T12:01:17.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.480+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ejk-Zv8wcH1fXm5TddFfWkGFzoDVv5s_0 2024-09-14T12:01:17.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.480+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17507066771528993107', time=2024-09-14T13:32:51.446729+0000, chain.objs.size()=1 2024-09-14T12:01:17.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.480+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.5NUM9djgzm5ujN1LeyQ3sdS2Fc5OshJ_0 2024-09-14T12:01:17.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.480+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6013547702406103406', time=2024-09-14T13:32:52.199705+0000, chain.objs.size()=1 2024-09-14T12:01:17.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.480+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.x9D-pCwZhzWuOBlV8U0vgDaROIRhl-u_0 2024-09-14T12:01:17.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.483+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13484377952962388399', time=2024-09-14T13:32:52.355641+0000, chain.objs.size()=1 2024-09-14T12:01:17.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.483+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ZRVjseC5yDgpsR9h88B_K04x1_MUzPd_0 2024-09-14T12:01:17.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.483+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18414048405080884227', time=2024-09-14T13:32:52.566248+0000, chain.objs.size()=1 2024-09-14T12:01:17.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.483+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.XvkbsguAv_EcCWECpWdbkZaj97VdGWC_0 2024-09-14T12:01:17.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.483+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5999320221991560145', time=2024-09-14T13:32:53.848080+0000, chain.objs.size()=1 2024-09-14T12:01:17.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.483+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.vBnsy2RBUU3QF6xhrTTLhgE9OYfD1Qf_0 2024-09-14T12:01:17.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.483+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17243946529089525897', time=2024-09-14T13:32:54.136159+0000, chain.objs.size()=1 2024-09-14T12:01:17.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.483+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.8ch_fgQh8a88jGrJIZP9hWu3eWWzTSV_0 2024-09-14T12:01:17.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.485+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13113454551438520892', time=2024-09-14T13:32:54.136912+0000, chain.objs.size()=1 2024-09-14T12:01:17.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.485+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.w-AE9Pp-S_JOFbMM2XDWH0Iszy1012R_0 2024-09-14T12:01:17.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.485+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4082717254482841515', time=2024-09-14T13:32:54.233407+0000, chain.objs.size()=1 2024-09-14T12:01:17.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.485+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.RhIZCWvwnEYDnELi-To1C6tio0acceE_0 2024-09-14T12:01:17.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.485+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6549244033362769747', time=2024-09-14T13:32:54.269442+0000, chain.objs.size()=1 2024-09-14T12:01:17.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.485+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.43B2N0w99QHuNmHqsCeg8e_V8Y_z79T_0 2024-09-14T12:01:17.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.486+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10328029886664815275', time=2024-09-14T13:32:54.523420+0000, chain.objs.size()=1 2024-09-14T12:01:17.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.486+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.1R9Pl4fbO4U99DJwPqMX5JR_4ehS64w_0 2024-09-14T12:01:17.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.486+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6148357417016525780', time=2024-09-14T13:32:54.929442+0000, chain.objs.size()=1 2024-09-14T12:01:17.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.486+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.0XvST82fYywWKUZ7CVH5FW_7mv_A3i9_0 2024-09-14T12:01:17.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.486+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.925481570412964489', time=2024-09-14T13:32:55.120568+0000, chain.objs.size()=1 2024-09-14T12:01:17.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.486+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.MawFAX0TLqNz3MsA33-quUqPhJBKIu1_0 2024-09-14T12:01:17.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.486+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11433610034231839693', time=2024-09-14T13:32:55.121345+0000, chain.objs.size()=1 2024-09-14T12:01:17.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.486+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.8Zc8v37cXKMWtIC2xoR6K_5qf7bizyg_0 2024-09-14T12:01:17.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.486+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10680716493148167733', time=2024-09-14T13:32:55.474601+0000, chain.objs.size()=1 2024-09-14T12:01:17.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.486+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.8B90u7rXV-QpeQd5tdpXrK_A2VsfdVm_0 2024-09-14T12:01:17.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.486+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7289556554711791687', time=2024-09-14T13:32:55.600911+0000, chain.objs.size()=1 2024-09-14T12:01:17.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.486+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.xDAp74I1KBBzaIAqtVugVUR0W8tm3tW_0 2024-09-14T12:01:17.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.486+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2973505533324543909', time=2024-09-14T13:32:55.782045+0000, chain.objs.size()=1 2024-09-14T12:01:17.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.486+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.A9ymhxYfIlAouOZHAJavCuImzI2cIE__0 2024-09-14T12:01:17.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.486+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6171638778668992522', time=2024-09-14T13:32:55.980537+0000, chain.objs.size()=1 2024-09-14T12:01:17.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.486+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.a4J0NpQPQvdzc19WEyf8ZOmXjxTMTjO_0 2024-09-14T12:01:17.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.487+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3997301482677246372', time=2024-09-14T13:32:56.336522+0000, chain.objs.size()=1 2024-09-14T12:01:17.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.487+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.tSKWXJHtOhbPxeitCZm3EwtOB82y4Wn_0 2024-09-14T12:01:17.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.488+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17744154929723080080', time=2024-09-14T13:32:56.345612+0000, chain.objs.size()=1 2024-09-14T12:01:17.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.488+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.PlAPH1XttWJTI5AOo4pU1x8NZQoIaur_0 2024-09-14T12:01:17.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.488+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3192452391528243031', time=2024-09-14T13:32:56.593609+0000, chain.objs.size()=1 2024-09-14T12:01:17.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.488+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.A9zMi7TNwxdy6yl5XqhzCYiB0TQnFHH_0 2024-09-14T12:01:17.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.490+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15928763954925532185', time=2024-09-14T13:32:56.762948+0000, chain.objs.size()=1 2024-09-14T12:01:17.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.490+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ghmr2P5Wzfmc49Kju2kx5-vFpzhRsNI_0 2024-09-14T12:01:17.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.490+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8521347953924899061', time=2024-09-14T13:32:56.843914+0000, chain.objs.size()=1 2024-09-14T12:01:17.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.490+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.AATiagAsFwaO_4LF4Epm0UU_aGa5J2B_0 2024-09-14T12:01:17.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.490+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14124328640522175441', time=2024-09-14T13:32:57.021704+0000, chain.objs.size()=1 2024-09-14T12:01:17.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.490+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.rAXFxBXCaRzvS8irPCkpRp7unJsMoXt_0 2024-09-14T12:01:17.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.492+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7559801488537099004', time=2024-09-14T13:32:57.063575+0000, chain.objs.size()=1 2024-09-14T12:01:17.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.492+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.0tZmptyvk2-i5TTTno-W6H8zqRWl2hL_0 2024-09-14T12:01:17.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.492+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2741927730295663423', time=2024-09-14T13:32:57.259108+0000, chain.objs.size()=1 2024-09-14T12:01:17.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.492+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.kL5vfk9P6d3Le_ONxE45YcPDIuvX33Q_0 2024-09-14T12:01:17.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.492+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.726923171706326843', time=2024-09-14T13:32:57.458982+0000, chain.objs.size()=1 2024-09-14T12:01:17.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.492+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.qnxz7T1-JhcA1jETu5uPPsuDe0Kvyit_0 2024-09-14T12:01:17.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.492+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14146396795416140786', time=2024-09-14T13:33:04.039281+0000, chain.objs.size()=1 2024-09-14T12:01:17.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.492+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.268__shadow_.RCUTX3Lsz1sHTn8ls6Abr65Ym-pJD3q_0 2024-09-14T12:01:17.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.492+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11545636575082401336', time=2024-09-14T13:33:06.131742+0000, chain.objs.size()=1 2024-09-14T12:01:17.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.492+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.270__shadow_.iGYv1Q0BUpJi-RNYiW-lSZgAMwKsabB_0 2024-09-14T12:01:17.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.492+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3459354120270623259', time=2024-09-14T13:33:12.690563+0000, chain.objs.size()=1 2024-09-14T12:01:17.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.492+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.276__shadow_.B6fn6K6ga8Tb9P3Wq7wHD2ndQrWJr72_0 2024-09-14T12:01:17.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.492+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1047096982109335491', time=2024-09-14T13:33:29.276944+0000, chain.objs.size()=1 2024-09-14T12:01:17.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.492+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.291__shadow_.JRcUAjKnW7zfoAU2PVEsuK3C_3bEEoC_0 2024-09-14T12:01:17.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.492+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15528480517769058205', time=2024-09-14T13:34:52.242390+0000, chain.objs.size()=1 2024-09-14T12:01:17.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.492+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.itvUp5eE3J2F9em-tuuNy4blS920yHz_0 2024-09-14T12:01:17.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.494+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17256622517736708936', time=2024-09-14T13:34:52.302965+0000, chain.objs.size()=1 2024-09-14T12:01:17.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.495+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.XGE9cO_M4Xk6m5L8RxEWXvLow-2JIxW_0 2024-09-14T12:01:17.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.495+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2363155594723173723', time=2024-09-14T13:34:52.548085+0000, chain.objs.size()=1 2024-09-14T12:01:17.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.495+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.TWkJxSVBU5zhu3gY2a1BOEvQtsBk8HG_0 2024-09-14T12:01:17.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.495+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14460734829172780786', time=2024-09-14T13:34:53.176067+0000, chain.objs.size()=1 2024-09-14T12:01:17.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.495+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ZcDy1oWY65ofET5i3jF11jgaj2WibUl_0 2024-09-14T12:01:17.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.496+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6991321836573023537', time=2024-09-14T13:34:53.241402+0000, chain.objs.size()=1 2024-09-14T12:01:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.496+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.CxVmXX4tT83zK9x9Q3DcRvtaAbL21FW_0 2024-09-14T12:01:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.496+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16806892813926870380', time=2024-09-14T13:34:53.576445+0000, chain.objs.size()=1 2024-09-14T12:01:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.496+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.QW9NThecJS13aSaOom-ynyZRkTf9w1g_0 2024-09-14T12:01:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.496+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3572870897585640558', time=2024-09-14T13:34:53.755325+0000, chain.objs.size()=1 2024-09-14T12:01:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.496+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.O6vAElXglX0e3xaVefFN8Jg547mWids_0 2024-09-14T12:01:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.496+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5495339350261994638', time=2024-09-14T13:34:53.882731+0000, chain.objs.size()=1 2024-09-14T12:01:17.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.496+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.cYZy-6w8bGv-X9Vk39Ji6-xU8KVikcb_0 2024-09-14T12:01:17.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.496+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8743779621243912445', time=2024-09-14T13:34:53.935711+0000, chain.objs.size()=1 2024-09-14T12:01:17.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.496+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.A_DrhH4l916l8rFhUA5cOGMGH0uj4ll_0 2024-09-14T12:01:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.497+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3782753487091741844', time=2024-09-14T13:34:54.171773+0000, chain.objs.size()=1 2024-09-14T12:01:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.497+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.0fPoCrg8uo0wM7C9xhFBR1U1G9BhBL5_0 2024-09-14T12:01:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.497+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17579878437970051674', time=2024-09-14T13:34:54.870998+0000, chain.objs.size()=1 2024-09-14T12:01:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.497+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.3YDJ8HrKtW967R_U6QTGLKKruL8E2uv_0 2024-09-14T12:01:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.497+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8758418277127723869', time=2024-09-14T13:34:55.725993+0000, chain.objs.size()=1 2024-09-14T12:01:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.497+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.9cIgRQB3wux_0o6FDzNJ_RSjtAdBtg__0 2024-09-14T12:01:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.497+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11716854003049991192', time=2024-09-14T13:34:56.186046+0000, chain.objs.size()=1 2024-09-14T12:01:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.497+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_._XAsLTQtj95EeouD2unCa_IgKLyJYOB_0 2024-09-14T12:01:17.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.500+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2099902084848077886', time=2024-09-14T13:34:56.518635+0000, chain.objs.size()=1 2024-09-14T12:01:17.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.500+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.PduXUtUsznXfJXGz_tL3kvasHZ2fQGl_0 2024-09-14T12:01:17.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.500+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4404225912512494033', time=2024-09-14T13:34:57.087171+0000, chain.objs.size()=1 2024-09-14T12:01:17.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.500+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.CiG-0jtDdAUEn5K5IA5P0aA7D4gJbk1_0 2024-09-14T12:01:17.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.500+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7003017946533457694', time=2024-09-14T13:34:57.772672+0000, chain.objs.size()=1 2024-09-14T12:01:17.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.500+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.H8-b5Zep4WxXGud2-GgfnOZy_JgH0YB_0 2024-09-14T12:01:17.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.500+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5848178583897542712', time=2024-09-14T13:34:59.086350+0000, chain.objs.size()=1 2024-09-14T12:01:17.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.500+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.xEsTI5vHeT41a1FunuICHaERQHo5oty_0 2024-09-14T12:01:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.500+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6734263195485077902', time=2024-09-14T13:34:59.242708+0000, chain.objs.size()=1 2024-09-14T12:01:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.500+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ST-Mjhagu0s8zPmIlVtGzfriExlB7rA_0 2024-09-14T12:01:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.500+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9169886259571687452', time=2024-09-14T13:34:59.469695+0000, chain.objs.size()=1 2024-09-14T12:01:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.500+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.VvMNSLJVRXWALItZMRshMz9kqHubJxp_0 2024-09-14T12:01:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.500+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16603176443404375823', time=2024-09-14T13:34:59.498448+0000, chain.objs.size()=1 2024-09-14T12:01:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.500+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.oGQtNBYNhzCL08WTMzNttOyhT3PgD_w_0 2024-09-14T12:01:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.500+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17119733679087592440', time=2024-09-14T13:34:59.652275+0000, chain.objs.size()=1 2024-09-14T12:01:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.500+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.n4mZ5OBmQkThKDnX7TfzwT2ZqDq92KU_0 2024-09-14T12:01:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.500+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10359394796507953395', time=2024-09-14T13:35:00.578398+0000, chain.objs.size()=1 2024-09-14T12:01:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.500+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.R_13xPwM3ow5oSwr6sb-ea809lxql0A_0 2024-09-14T12:01:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.500+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4055761233937496240', time=2024-09-14T13:35:01.457518+0000, chain.objs.size()=1 2024-09-14T12:01:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.500+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.p_hO-lLHTB2_q7C1ljnEqLaam7s3u_v_0 2024-09-14T12:01:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.503+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14815069206311302815', time=2024-09-14T13:35:01.820072+0000, chain.objs.size()=1 2024-09-14T12:01:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.503+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.kDe2C1WOy36UKFcJr1YwXQVy8BWndbx_0 2024-09-14T12:01:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.504+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.520112214375849460', time=2024-09-14T13:35:01.934862+0000, chain.objs.size()=1 2024-09-14T12:01:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.504+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.gURrgqwYfOuWmKsnyoBzEdDOVZe-wZ3_0 2024-09-14T12:01:17.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.505+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9263168593974665595', time=2024-09-14T13:35:02.081852+0000, chain.objs.size()=1 2024-09-14T12:01:17.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.505+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.6pT2oeQ4wUhKo6rj9QGCRcaeXcq_fQO_0 2024-09-14T12:01:17.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.506+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9673172447117180643', time=2024-09-14T13:35:02.122958+0000, chain.objs.size()=1 2024-09-14T12:01:17.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.506+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.CHLb-reZn28bzEiYDtEjbFoyX95RmCb_0 2024-09-14T12:01:17.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.506+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.551206219184308471', time=2024-09-14T13:35:02.447955+0000, chain.objs.size()=1 2024-09-14T12:01:17.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.506+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.aXzBnbWtBbEzfDhFDiirENaNNScoDLd_0 2024-09-14T12:01:17.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.506+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18320495142020755605', time=2024-09-14T13:35:42.123095+0000, chain.objs.size()=1 2024-09-14T12:01:17.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.507+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.XuzcDVRJGeYQVoHim2qAfJ-jiympqMX_0 2024-09-14T12:01:17.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.507+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3028085730526194061', time=2024-09-14T13:35:42.662060+0000, chain.objs.size()=1 2024-09-14T12:01:17.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.507+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.f6wHRc_F2Gj07MJ_yPEe9SeeeNSUuQA_0 2024-09-14T12:01:17.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.507+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13148610598451591006', time=2024-09-14T13:35:44.184121+0000, chain.objs.size()=1 2024-09-14T12:01:17.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.507+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Q4QAB9-ea82FtjguS_XHulAxtI8p1BE_0 2024-09-14T12:01:17.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.508+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1506891606075402634', time=2024-09-14T13:35:45.618287+0000, chain.objs.size()=1 2024-09-14T12:01:17.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.508+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.6hqPA9F2f6mKWj37B2p2rYKwHkcdow8_0 2024-09-14T12:01:17.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.508+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5650488134006526329', time=2024-09-14T13:35:46.620686+0000, chain.objs.size()=1 2024-09-14T12:01:17.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.508+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.k0oHmhz6CHSpjys4qlj4bfVj3T2OWWo_0 2024-09-14T12:01:17.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.508+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6919129988155244801', time=2024-09-14T13:35:46.661155+0000, chain.objs.size()=1 2024-09-14T12:01:17.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.508+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.SqpZt6MKzk3NpNfuMawKVWrGVjaKAnc_0 2024-09-14T12:01:17.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.508+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5747749980024189525', time=2024-09-14T13:35:46.681631+0000, chain.objs.size()=1 2024-09-14T12:01:17.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.508+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.WT3JDmfLAu67g26KrOvEumz45Jt-zhU_0 2024-09-14T12:01:17.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.508+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17915302458698425239', time=2024-09-14T13:35:46.697868+0000, chain.objs.size()=1 2024-09-14T12:01:17.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.508+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.0gFbdUGJtGtdTAsAaKRDf-BsAhsniJz_0 2024-09-14T12:01:17.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.508+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1445202643351271823', time=2024-09-14T13:35:46.822802+0000, chain.objs.size()=1 2024-09-14T12:01:17.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.508+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.sCLyUFgKeRZF1P6Ui47oEsfTCMVISpv_0 2024-09-14T12:01:17.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.510+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17175223237503633119', time=2024-09-14T13:35:47.118164+0000, chain.objs.size()=1 2024-09-14T12:01:17.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.510+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.U-MD59hyMGa2u4_sz0XoLnebtfLx1K1_0 2024-09-14T12:01:17.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.510+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5160163988611090749', time=2024-09-14T13:35:47.801207+0000, chain.objs.size()=1 2024-09-14T12:01:17.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.510+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.BZqOT7UhXDiPL8SuI4yEyydZLd33t17_0 2024-09-14T12:01:17.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.510+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1495859775987644026', time=2024-09-14T13:35:48.085586+0000, chain.objs.size()=1 2024-09-14T12:01:17.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.510+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.vgvIFz0Z2t9omqysZDrWQjABGKEX51q_0 2024-09-14T12:01:17.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.512+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14736772488702875460', time=2024-09-14T13:35:48.122356+0000, chain.objs.size()=1 2024-09-14T12:01:17.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.512+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.gQfDAlSzs-vte-TbGkm5HJHVUEuVEmp_0 2024-09-14T12:01:17.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.512+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9792838583389731362', time=2024-09-14T13:35:48.768718+0000, chain.objs.size()=1 2024-09-14T12:01:17.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.512+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.8mlu7eHLKgWiWIz5SlVO-zoK39wP-Ca_0 2024-09-14T12:01:17.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.512+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5356574423004512905', time=2024-09-14T13:35:50.923820+0000, chain.objs.size()=1 2024-09-14T12:01:17.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.512+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.nCXD82lj90r90r6YLdYv_hSpABnUfEQ_0 2024-09-14T12:01:17.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.512+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13363191717084099412', time=2024-09-14T13:35:51.044808+0000, chain.objs.size()=1 2024-09-14T12:01:17.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.512+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.jXrXEugfgEMs1gQtzDdjElXM_fifA6K_0 2024-09-14T12:01:17.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.512+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8910360432523155171', time=2024-09-14T13:35:51.502417+0000, chain.objs.size()=1 2024-09-14T12:01:17.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.512+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.tu4m4Qz9hcfcFY0uvORrMrMgHwGdgTx_0 2024-09-14T12:01:17.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.512+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.39370527389853775', time=2024-09-14T13:35:51.539105+0000, chain.objs.size()=1 2024-09-14T12:01:17.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.512+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.f6xH3LurgpMY_pyBEs849hd6hl2nHI2_0 2024-09-14T12:01:17.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.512+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10724356322306352547', time=2024-09-14T13:35:52.161326+0000, chain.objs.size()=1 2024-09-14T12:01:17.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.512+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.hg1wvzXQnkWbz_9bHesd9quLXdsYCB__0 2024-09-14T12:01:17.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.512+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6620982604564899255', time=2024-09-14T13:35:52.225053+0000, chain.objs.size()=1 2024-09-14T12:01:17.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.512+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.lBUUb3qeYqA231kL6AdiMzg6ubMhzA6_0 2024-09-14T12:01:17.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.512+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4960360909379312538', time=2024-09-14T13:35:52.258661+0000, chain.objs.size()=1 2024-09-14T12:01:17.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.512+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.L3UF50KhrQREft0Q2RynituWHivibt6_0 2024-09-14T12:01:17.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.514+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10612111816602295957', time=2024-09-14T13:35:52.259576+0000, chain.objs.size()=1 2024-09-14T12:01:17.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.514+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Ebx0ZrBBhxrbc8ttlhM9Q6HDbUFzqv0_0 2024-09-14T12:01:17.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.514+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.342855937824037564', time=2024-09-14T13:35:52.409971+0000, chain.objs.size()=1 2024-09-14T12:01:17.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.514+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.HcQhXa8-YRzUs7ZgXfN7MI_YnAFVQst_0 2024-09-14T12:01:17.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.516+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11056519230451599048', time=2024-09-14T13:35:52.475336+0000, chain.objs.size()=1 2024-09-14T12:01:17.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.516+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.b5kvqinhEJCqW_mbby2mRxi8lNG71c3_0 2024-09-14T12:01:17.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.516+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14323045945672350081', time=2024-09-14T13:35:52.476327+0000, chain.objs.size()=1 2024-09-14T12:01:17.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.516+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.6Df-J0KqQUuMPTYQK0havr-ukb8Kn_k_0 2024-09-14T12:01:17.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.516+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12974356267685703163', time=2024-09-14T13:35:52.559871+0000, chain.objs.size()=1 2024-09-14T12:01:17.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.516+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.AOX2Mt8k0DJGX5ELiovNiC_RiFxbh_z_0 2024-09-14T12:01:17.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.519+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/49707 2024-09-14T12:01:17.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.522+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-14T12:01:17.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.522+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5617227954080993582', time=2024-09-14T13:35:59.686938+0000, chain.objs.size()=1 2024-09-14T12:01:17.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.522+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.332__shadow_.UMeeeiVoe84nPafzjU2N1GdWd0MGhhN_0 2024-09-14T12:01:17.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.522+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1973698581383629354', time=2024-09-14T13:36:37.329603+0000, chain.objs.size()=1 2024-09-14T12:01:17.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.522+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.370__shadow_.3Gda4PaMjJPoehDSnPco-nFwMco-X-f_0 2024-09-14T12:01:17.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.522+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4495959544751183594', time=2024-09-14T13:38:27.921953+0000, chain.objs.size()=1 2024-09-14T12:01:17.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.522+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.466__shadow_.ywWUX6QmhqO1g-67pORz1XNYG3tOLCI_0 2024-09-14T12:01:17.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.522+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9967975317796806417', time=2024-09-14T13:38:42.793771+0000, chain.objs.size()=1 2024-09-14T12:01:17.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.522+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.484__shadow_.e2TRG1_PImcwHs-o1oaUlL5yyd4MMiX_0 2024-09-14T12:01:17.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.522+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12478140375339575590', time=2024-09-14T13:38:52.394029+0000, chain.objs.size()=1 2024-09-14T12:01:17.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.522+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.490__shadow_.OwwUeZhP_olbeQbyzwm4CIJ_Y_hplOO_0 2024-09-14T12:01:17.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.522+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7496982274849482539', time=2024-09-14T13:38:54.709730+0000, chain.objs.size()=1 2024-09-14T12:01:17.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.522+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.492__shadow_.wdSVv5DT-qtBExPZGKXxiTcMDTNG0kL_0 2024-09-14T12:01:17.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.522+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16047272373703803380', time=2024-09-14T13:39:55.260903+0000, chain.objs.size()=1 2024-09-14T12:01:17.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.522+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.518__shadow_.9qX1DyaJj8ygITO1OBv6Bzk4mar71al_0 2024-09-14T12:01:17.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.522+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6555952655125809304', time=2024-09-14T13:42:27.436252+0000, chain.objs.size()=6 2024-09-14T12:01:17.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.522+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~FPzHus6nF_0_1JvUzAmPvvpA4HOCSYw.1 2024-09-14T12:01:17.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.522+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.byFqk0suh6wZ0mm60JDBUvSQX4OkU_ZF.2 2024-09-14T12:01:17.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.522+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.kkWY_c_tzNG0l6FccX6qbmBKogH86nPe.3 2024-09-14T12:01:17.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.522+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~FPzHus6nF_0_1JvUzAmPvvpA4HOCSYw.4 2024-09-14T12:01:17.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.522+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~FPzHus6nF_0_1JvUzAmPvvpA4HOCSYw.5 2024-09-14T12:01:17.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.525+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~FPzHus6nF_0_1JvUzAmPvvpA4HOCSYw.6 2024-09-14T12:01:17.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.525+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10178008629622218314', time=2024-09-14T13:42:43.207198+0000, chain.objs.size()=6 2024-09-14T12:01:17.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.525+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.5kOHmq38KBt6vQ__J09Wfr_BEe6AA4ze.1 2024-09-14T12:01:17.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.525+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.sOhm6cQIQduEQLNCEJqMycM_BzujDflW.2 2024-09-14T12:01:17.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.526+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.Jl_WhAxHxOK6Fyb-NUC-1TCsYt3cOCJd.3 2024-09-14T12:01:17.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.526+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.aMgRAB6tJ2kp_LAaD4-4qBhFJsWrkcbY.4 2024-09-14T12:01:17.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.527+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.rH0H-7FM9A3ioPs6aXEXvIrN1G4nCpcK.5 2024-09-14T12:01:17.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.527+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.hNZKvuZJH-juFSyMUPZIroj9vyG-dqw1.6 2024-09-14T12:01:17.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.527+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.356572332458254096', time=2024-09-14T13:42:53.396794+0000, chain.objs.size()=3 2024-09-14T12:01:17.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.527+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.524__multipart_mymultipart.2~5sKWGZSIHwRumxHB9roqLg9Cn8zHbDZ.1 2024-09-14T12:01:17.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.527+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.524__multipart_mymultipart.2~5sKWGZSIHwRumxHB9roqLg9Cn8zHbDZ.2 2024-09-14T12:01:17.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.527+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.524__multipart_mymultipart.2~5sKWGZSIHwRumxHB9roqLg9Cn8zHbDZ.3 2024-09-14T12:01:17.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.527+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14982573399835393705', time=2024-09-14T13:45:48.496507+0000, chain.objs.size()=1 2024-09-14T12:01:17.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.527+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.571__shadow:FE.A-JMiVmQfbElj.ZykG3x2ELqNN3F_.RftuS3o4E1RIUMY2qnwoWJoEGhgkfhq_0 2024-09-14T12:01:17.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.529+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14466517169565377435', time=2024-09-14T13:45:52.970144+0000, chain.objs.size()=1 2024-09-14T12:01:17.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.529+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.574__shadow_.hcPWCd0jARYArmVeGYD89IkyFjBkgWA_0 2024-09-14T12:01:17.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.529+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3608217247498853720', time=2024-09-14T13:45:58.269170+0000, chain.objs.size()=1 2024-09-14T12:01:17.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.529+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.575__shadow:vSwf19nl7d3f2h2.Vnrc828-O7ymzHS_.aZEG-eHylLIrTpIKv4XsWyOj9dbjplu_0 2024-09-14T12:01:17.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.529+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9956641362312799792', time=2024-09-14T13:50:40.822560+0000, chain.objs.size()=1 2024-09-14T12:01:17.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.529+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.618__shadow_.g7SDm3ASOxYn3-dZ-CyMf4vpFMlj7fv_0 2024-09-14T12:01:17.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.529+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11692774853569186344', time=2024-09-14T13:53:24.949001+0000, chain.objs.size()=1 2024-09-14T12:01:17.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.529+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.656__shadow_.WZUL_O9UE57du6Fi97N_-bQAL_JmS_5_0 2024-09-14T12:01:17.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.529+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14888457830961617045', time=2024-09-14T13:55:08.180261+0000, chain.objs.size()=1 2024-09-14T12:01:17.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.529+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.719__shadow_.8-gGX6hEuTDCCV9M2OuvO5T6tvrSvGY_0 2024-09-14T12:01:17.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.531+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16555717003367735882', time=2024-09-14T13:57:10.499032+0000, chain.objs.size()=1 2024-09-14T12:01:17.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.531+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.759__shadow_.aKNRs4iEiC8S-2JSKwRPphMs9kR1Vwn_0 2024-09-14T12:01:17.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.531+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14211381823440754883', time=2024-09-14T13:58:15.086375+0000, chain.objs.size()=1 2024-09-14T12:01:17.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.531+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.772__shadow_.ot66ltaWByXDmnvL2rYXVPmOuGteuYX_0 2024-09-14T12:01:17.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.532+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16633227149542691150', time=2024-09-14T13:58:44.213420+0000, chain.objs.size()=1 2024-09-14T12:01:17.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.532+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.778__shadow_.S3QyPwUhFT8redI3HKiCMChAjxakiet_0 2024-09-14T12:01:17.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.532+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4338871596014964344', time=2024-09-14T13:58:46.018207+0000, chain.objs.size()=1 2024-09-14T12:01:17.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.532+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.779__shadow_.AytOF8jv8-Tv6iBYyasIwOrer3b7B6z_0 2024-09-14T12:01:17.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.535+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:17.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.537+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T12:01:17.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.538+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:17.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.539+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:17.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.540+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44315' 2024-09-14T12:01:17.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.540+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15494683271602701529', time=2024-09-14T13:27:27.190772+0000, chain.objs.size()=1 2024-09-14T12:01:17.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.540+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.149__shadow_.KVp_wUa0xpyom6CHqzmq77IXKOm9p48_0 2024-09-14T12:01:17.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.540+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='_sYAjgX-TRloWg-Ih0ILbqNb_r8Bo5vJ', time=2024-09-14T13:28:01.254514+0000, chain.objs.size()=2 2024-09-14T12:01:17.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.540+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.161__shadow_.DuoLoanc7hA1HvT7V35s3kdkTOOzeR9_0 2024-09-14T12:01:17.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.540+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.161__shadow_.DuoLoanc7hA1HvT7V35s3kdkTOOzeR9_1 2024-09-14T12:01:17.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.540+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12238084820346852428', time=2024-09-14T13:29:03.316968+0000, chain.objs.size()=1 2024-09-14T12:01:17.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.540+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.183__shadow_.ZqRt_289VWHLTp09vfXuoURgUBbiTRx_0 2024-09-14T12:01:17.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.540+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1527749747544056999', time=2024-09-14T13:31:48.760637+0000, chain.objs.size()=1 2024-09-14T12:01:17.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.540+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.244__shadow_.xbJr0MItY_UBIl25bIew8t0L9NV5gvJ_0 2024-09-14T12:01:17.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.540+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11883962006362974953', time=2024-09-14T13:31:58.422876+0000, chain.objs.size()=1 2024-09-14T12:01:17.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.540+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.252__shadow_.1aKO-aTTTfbc-V60wUZKRh-qo7qHGKA_0 2024-09-14T12:01:17.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.540+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12752732728409709080', time=2024-09-14T13:32:48.040070+0000, chain.objs.size()=1 2024-09-14T12:01:17.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.540+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.OCVX3ABt6f_HuiH8CiH2dkbdJ15aY8y_0 2024-09-14T12:01:17.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.540+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2652895692282040882', time=2024-09-14T13:32:48.155637+0000, chain.objs.size()=1 2024-09-14T12:01:17.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.540+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.LacdM034sKT0ygm4CjPWXFVQ2OKVlgR_0 2024-09-14T12:01:17.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.540+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17776931698706607103', time=2024-09-14T13:32:48.257012+0000, chain.objs.size()=1 2024-09-14T12:01:17.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.540+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.SYzSVHm2Wk-BfCV61p7AgstCrTP5Fwp_0 2024-09-14T12:01:17.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.540+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1997154255647866106', time=2024-09-14T13:32:48.351239+0000, chain.objs.size()=1 2024-09-14T12:01:17.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.540+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.wW0_nlb9-d-jkYzHaerYeWMOGHAkeoJ_0 2024-09-14T12:01:17.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.540+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9809217401840735388', time=2024-09-14T13:32:49.057336+0000, chain.objs.size()=1 2024-09-14T12:01:17.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.540+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.kJB3zb09Uzod2XpmPHRP4Dij9p_ZWxT_0 2024-09-14T12:01:17.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.540+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5222604471266299781', time=2024-09-14T13:32:49.214024+0000, chain.objs.size()=1 2024-09-14T12:01:17.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.540+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.5sBOaaeQ-IcX9dk4BTCUcCLZwsmKO2W_0 2024-09-14T12:01:17.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.543+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11459306844263962599', time=2024-09-14T13:32:49.443734+0000, chain.objs.size()=1 2024-09-14T12:01:17.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.543+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.fYmHIJ15oW5EhHLkZ7Brgv54FLoY9yq_0 2024-09-14T12:01:17.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.543+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8359936528426420941', time=2024-09-14T13:32:51.169143+0000, chain.objs.size()=1 2024-09-14T12:01:17.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.543+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_._X5Ls8CLuLV6QRrfnAaN5hhObUEHJAa_0 2024-09-14T12:01:17.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.544+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5418292527309790926', time=2024-09-14T13:32:51.223683+0000, chain.objs.size()=1 2024-09-14T12:01:17.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.544+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.uh7ew9xTdBgOJXbAO5GNYXdVrd-assx_0 2024-09-14T12:01:17.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.544+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5512941264711069320', time=2024-09-14T13:32:52.050454+0000, chain.objs.size()=1 2024-09-14T12:01:17.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.544+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.yYa306wbmkBSnQpQZmb4Sj8pM4yIQDq_0 2024-09-14T12:01:17.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.544+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14299235104898159859', time=2024-09-14T13:32:52.311882+0000, chain.objs.size()=1 2024-09-14T12:01:17.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.544+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.mFNbVS9Qkn8QykrYUwI6Mtgq1X6IYJs_0 2024-09-14T12:01:17.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.544+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5024573715568481494', time=2024-09-14T13:32:52.590185+0000, chain.objs.size()=1 2024-09-14T12:01:17.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.544+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ICVap4BPGuS8ToDdwl-JwBz1kfCpcoq_0 2024-09-14T12:01:17.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.544+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5131639135232227277', time=2024-09-14T13:32:52.892737+0000, chain.objs.size()=1 2024-09-14T12:01:17.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.544+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.2sQWy_nevhvriCe9TVYsUuquvwuRxZ8_0 2024-09-14T12:01:17.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.544+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6133377564113207651', time=2024-09-14T13:32:53.515837+0000, chain.objs.size()=1 2024-09-14T12:01:17.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.544+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.HjCa9FetxzsiiIBNUiMSfcY-Yj8AbzA_0 2024-09-14T12:01:17.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.544+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14656477904177877791', time=2024-09-14T13:32:54.362983+0000, chain.objs.size()=1 2024-09-14T12:01:17.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.544+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.pyryoTCeOYtreHWecEFnJRvnafHh4TU_0 2024-09-14T12:01:17.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.544+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9346820705263094604', time=2024-09-14T13:32:54.387904+0000, chain.objs.size()=1 2024-09-14T12:01:17.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.544+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.N3o2TIpf6RPDYp-8PMM8-mDh_ECU_AI_0 2024-09-14T12:01:17.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.544+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7846087834132203187', time=2024-09-14T13:32:54.559706+0000, chain.objs.size()=1 2024-09-14T12:01:17.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.544+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.JQVFbMFfEjl_jc8Ij5TyJU1F0ejR5AN_0 2024-09-14T12:01:17.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.548+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4937352456379430748', time=2024-09-14T13:32:55.463925+0000, chain.objs.size()=1 2024-09-14T12:01:17.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.548+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.7RoQir8QVz1L4CK9_rkO_5vACGVSJBm_0 2024-09-14T12:01:17.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.548+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5018197507548079066', time=2024-09-14T13:32:56.878481+0000, chain.objs.size()=1 2024-09-14T12:01:17.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.548+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.QP6zrZhMAXkCedeG5ewr5Y7a3rFgkAW_0 2024-09-14T12:01:17.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.548+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12385946426378768673', time=2024-09-14T13:32:57.003300+0000, chain.objs.size()=1 2024-09-14T12:01:17.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.548+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.QywNA5JnsOfGytttU9neXJuCJnsBby1_0 2024-09-14T12:01:17.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.548+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18319614690457480170', time=2024-09-14T13:32:57.125043+0000, chain.objs.size()=1 2024-09-14T12:01:17.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.548+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.9eVNqaWDe2-RreC7oHrk-JAMvGk1AHy_0 2024-09-14T12:01:17.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.548+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17620732634767959025', time=2024-09-14T13:32:57.354151+0000, chain.objs.size()=1 2024-09-14T12:01:17.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.548+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.lYCiz52yrFYCBQ6tGZJSbuaBsro09Zy_0 2024-09-14T12:01:17.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.548+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9279954580659075680', time=2024-09-14T13:32:58.578861+0000, chain.objs.size()=1 2024-09-14T12:01:17.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.548+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.U6ZXg8IkgLSpaAqNgUa2yXDsWhetRy0_0 2024-09-14T12:01:17.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.548+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11584859715221148009', time=2024-09-14T13:32:58.741477+0000, chain.objs.size()=1 2024-09-14T12:01:17.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.548+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.vjeO8DsKkJEBnNewb_JHbfoYoCgQvjt_0 2024-09-14T12:01:17.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.548+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13828089800714524514', time=2024-09-14T13:33:33.234290+0000, chain.objs.size()=1 2024-09-14T12:01:17.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.548+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.xycx7nTQHKmeR-EqvSAZtVH_nUFG04z_0 2024-09-14T12:01:17.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.549+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6790826469767661751', time=2024-09-14T13:33:44.543633+0000, chain.objs.size()=1 2024-09-14T12:01:17.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.549+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.302__shadow_.9NLgk8XoMXLtl0mLXkAGzaT4wo8bfzN_0 2024-09-14T12:01:17.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.549+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1827408402365778530', time=2024-09-14T13:34:11.922312+0000, chain.objs.size()=1 2024-09-14T12:01:17.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.549+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.323__shadow_.zzVEJaB1hqC_UXLfbvah7t4kxCxMs96_0 2024-09-14T12:01:17.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.549+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3245804886343350842', time=2024-09-14T13:34:51.492164+0000, chain.objs.size()=1 2024-09-14T12:01:17.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.549+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.eH_YU0ncB-Ccuz2Ru0pWRTDI7AuESbP_0 2024-09-14T12:01:17.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.552+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6244467051731054138', time=2024-09-14T13:34:51.628455+0000, chain.objs.size()=1 2024-09-14T12:01:17.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.552+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.P5aGg71LiRhTANnrn73InOekKfO_vX6_0 2024-09-14T12:01:17.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.552+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1415721080668046886', time=2024-09-14T13:34:51.785415+0000, chain.objs.size()=1 2024-09-14T12:01:17.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.552+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Fy5U8CWBMPKgEsLiuQrALLyW4li6xrQ_0 2024-09-14T12:01:17.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.552+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14962284451214340149', time=2024-09-14T13:34:51.843907+0000, chain.objs.size()=1 2024-09-14T12:01:17.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.552+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.hndODofY-zvxJwNKkRKfgdMl44GXSoT_0 2024-09-14T12:01:17.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.552+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7519995055062777124', time=2024-09-14T13:34:51.926865+0000, chain.objs.size()=1 2024-09-14T12:01:17.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.552+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.25phf9MsQ7kwkvfSovZxRdyl6_smAk3_0 2024-09-14T12:01:17.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.552+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11457471062091616525', time=2024-09-14T13:34:52.067512+0000, chain.objs.size()=1 2024-09-14T12:01:17.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.552+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.CoLtRpZ1JKM0kgvRG5elYOe4KCUuynZ_0 2024-09-14T12:01:17.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.552+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14908552926864261938', time=2024-09-14T13:34:52.411623+0000, chain.objs.size()=1 2024-09-14T12:01:17.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.552+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.zmiyXZIdcWGy0LIfkp5mO7Clj4wqcVU_0 2024-09-14T12:01:17.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.552+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4887270368529410585', time=2024-09-14T13:34:52.412414+0000, chain.objs.size()=1 2024-09-14T12:01:17.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.552+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.T1z2l0cb77G3jlo38Sj9GNzzFrJNWZp_0 2024-09-14T12:01:17.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.553+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11934998872914466140', time=2024-09-14T13:34:53.108455+0000, chain.objs.size()=1 2024-09-14T12:01:17.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.553+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.rvwi49Azh0ltqIc-hsK4e5SyMEbkaEh_0 2024-09-14T12:01:17.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.553+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11745081943016206078', time=2024-09-14T13:34:53.575489+0000, chain.objs.size()=1 2024-09-14T12:01:17.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.553+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.g24SckoybgkFgFBqk6r5QQHCcF_PVdJ_0 2024-09-14T12:01:17.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.553+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4769052543069954797', time=2024-09-14T13:34:53.817078+0000, chain.objs.size()=1 2024-09-14T12:01:17.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.553+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.V0wsF-z13Ovek0KJfn2LaEyqI8BjlXY_0 2024-09-14T12:01:17.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.553+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8557594632665597432', time=2024-09-14T13:34:54.976779+0000, chain.objs.size()=1 2024-09-14T12:01:17.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.553+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.X2yV3WaM6H4uTcmOEjFkUfoxh4iEM_e_0 2024-09-14T12:01:17.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.555+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8429896335740731978', time=2024-09-14T13:34:55.022853+0000, chain.objs.size()=1 2024-09-14T12:01:17.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.555+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.7v0vfN7_wibyge4c_VY3EnReObhrD32_0 2024-09-14T12:01:17.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.556+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15756093377826326789', time=2024-09-14T13:34:55.149000+0000, chain.objs.size()=1 2024-09-14T12:01:17.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.556+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.0Fa4Dwkine6I2epmkfQ5r7DKySOifAB_0 2024-09-14T12:01:17.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.556+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10917962743883103207', time=2024-09-14T13:34:55.262821+0000, chain.objs.size()=1 2024-09-14T12:01:17.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.556+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.P5Ci8LmeztailM0g8vJtOXg-TwXJdg5_0 2024-09-14T12:01:17.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.556+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9491462978333230512', time=2024-09-14T13:34:55.460072+0000, chain.objs.size()=1 2024-09-14T12:01:17.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.556+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.k3SrW97niez1Y02WA86-b2tf89NB8q2_0 2024-09-14T12:01:17.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.556+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4584426422923056060', time=2024-09-14T13:34:55.704055+0000, chain.objs.size()=1 2024-09-14T12:01:17.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.556+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.HX3AB0k2UTE7rQ1e-znToFPbX7E9-nb_0 2024-09-14T12:01:17.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.556+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16683730012189004386', time=2024-09-14T13:34:56.198830+0000, chain.objs.size()=1 2024-09-14T12:01:17.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.556+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.uY077EYWwVHZl38IVRnEuQcTdA_U3RE_0 2024-09-14T12:01:17.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.556+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5980615143002196692', time=2024-09-14T13:34:56.319906+0000, chain.objs.size()=1 2024-09-14T12:01:17.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.556+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.llxnLSgIwZD0zI6TcgaPRsB6wkjHyyW_0 2024-09-14T12:01:17.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.557+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14614072067435078961', time=2024-09-14T13:34:56.930446+0000, chain.objs.size()=1 2024-09-14T12:01:17.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.557+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.46NkgEj8PjJBfzx9BVX1rpPiMVPP1Hn_0 2024-09-14T12:01:17.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.557+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16819698367718901074', time=2024-09-14T13:34:57.014005+0000, chain.objs.size()=1 2024-09-14T12:01:17.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.557+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.-3wlpf6visgLiq6jCfGIsqdfC8vFJlr_0 2024-09-14T12:01:17.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.557+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5748537412605343265', time=2024-09-14T13:34:57.056828+0000, chain.objs.size()=1 2024-09-14T12:01:17.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.557+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.U0liwgLRhs1G4UifyhF-DNfHDkiP5i-_0 2024-09-14T12:01:17.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.557+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4128067007254323432', time=2024-09-14T13:34:57.777951+0000, chain.objs.size()=1 2024-09-14T12:01:17.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.557+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.vUgBKH9rs__EwxXxePiwR4BMn9MGTHi_0 2024-09-14T12:01:17.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.559+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8283477119863161743', time=2024-09-14T13:34:57.796179+0000, chain.objs.size()=1 2024-09-14T12:01:17.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.559+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.G1wUUOk3CqS-qlzT8rrQhVZp9u_o-Ok_0 2024-09-14T12:01:17.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.561+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12190597673259367881', time=2024-09-14T13:34:58.678325+0000, chain.objs.size()=1 2024-09-14T12:01:17.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.561+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.3rg4tyUsUPk5kW-Ahr5Nrgk-Hc6KCjH_0 2024-09-14T12:01:17.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.561+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16819525590569938153', time=2024-09-14T13:34:59.242309+0000, chain.objs.size()=1 2024-09-14T12:01:17.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.561+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.6jj4gntsZiMbVaF5lAiniu-ivnC2K4m_0 2024-09-14T12:01:17.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.561+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15598509657135494347', time=2024-09-14T13:35:00.441036+0000, chain.objs.size()=1 2024-09-14T12:01:17.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.561+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.U0EkQusEM1q35Cgri6cu1LSPkyhi6-N_0 2024-09-14T12:01:17.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.561+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.926992714941830553', time=2024-09-14T13:35:00.896150+0000, chain.objs.size()=1 2024-09-14T12:01:17.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.561+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.iHMpDWSzQ1TKe5IXClxiKItR1R4dBYu_0 2024-09-14T12:01:17.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.561+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15278188538938912164', time=2024-09-14T13:35:00.896955+0000, chain.objs.size()=1 2024-09-14T12:01:17.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.561+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.gZNMHZEmGhAoKWhtqooy7DFMHDRJ6Br_0 2024-09-14T12:01:17.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.561+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10741847627597078205', time=2024-09-14T13:35:01.180658+0000, chain.objs.size()=1 2024-09-14T12:01:17.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.561+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Ock7UD883Ki6LrpPB2Z2eDQ8D4JtzCi_0 2024-09-14T12:01:17.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.561+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4404434189991445497', time=2024-09-14T13:35:01.181400+0000, chain.objs.size()=1 2024-09-14T12:01:17.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.561+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.TFHfx0hWFdbPAV5C9SW3NpI_2HTc6AO_0 2024-09-14T12:01:17.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.561+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15465836561593427876', time=2024-09-14T13:35:01.394921+0000, chain.objs.size()=1 2024-09-14T12:01:17.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.561+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.KDT-D_esIeT-h9GtOGcIdv6_CMjTNol_0 2024-09-14T12:01:17.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.561+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10956009103166049075', time=2024-09-14T13:35:02.164316+0000, chain.objs.size()=1 2024-09-14T12:01:17.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.561+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.2dyPZe0BFqs-HED9qkLrXORVUVHshBU_0 2024-09-14T12:01:17.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.561+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1991245223466027916', time=2024-09-14T13:35:02.173597+0000, chain.objs.size()=1 2024-09-14T12:01:17.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.561+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Xq11V0WjJbFMttALNNeyMAZ-45OtqcT_0 2024-09-14T12:01:17.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.564+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12479104126297939248', time=2024-09-14T13:35:02.394761+0000, chain.objs.size()=1 2024-09-14T12:01:17.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.564+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.g-r3S1Iec7Ia2BnGjjxSvYYzlwNpYSj_0 2024-09-14T12:01:17.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.565+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9620550072391136908', time=2024-09-14T13:35:02.494060+0000, chain.objs.size()=1 2024-09-14T12:01:17.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.565+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.t04aj2nWdSxUxYT20EHCJvGL0tAPtE-_0 2024-09-14T12:01:17.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.566+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7750578505251838702', time=2024-09-14T13:35:02.532944+0000, chain.objs.size()=1 2024-09-14T12:01:17.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.566+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.4i4JX0IjyI_VYuCqQEykNSRNITtGwsm_0 2024-09-14T12:01:17.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.566+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.318035956521925882', time=2024-09-14T13:35:41.781509+0000, chain.objs.size()=1 2024-09-14T12:01:17.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.566+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.1YIkTrHoYhBaY5tsIwFjlxNsKOS_zNe_0 2024-09-14T12:01:17.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.566+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15400919536318158477', time=2024-09-14T13:35:42.210769+0000, chain.objs.size()=1 2024-09-14T12:01:17.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.566+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.eQsv6TT8bkAaByRaYDx6GaLKpgGsc1k_0 2024-09-14T12:01:17.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.566+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8361059237368315659', time=2024-09-14T13:35:42.221789+0000, chain.objs.size()=1 2024-09-14T12:01:17.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.566+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Wg4Wl5QlkAFlaCg0vNkHlfRbFMqVZfU_0 2024-09-14T12:01:17.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.566+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5469214607814568810', time=2024-09-14T13:35:43.725691+0000, chain.objs.size()=1 2024-09-14T12:01:17.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.566+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.IcROpOnuRNUZqQF_DXlpZLgz5ZhFZJc_0 2024-09-14T12:01:17.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.566+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10988227899991842214', time=2024-09-14T13:35:43.971978+0000, chain.objs.size()=1 2024-09-14T12:01:17.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.566+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.wIeOSNRl9ZoPIUyfugDKHuu3362FcDD_0 2024-09-14T12:01:17.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.566+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508700102760339547', time=2024-09-14T13:35:43.994147+0000, chain.objs.size()=1 2024-09-14T12:01:17.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.566+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.0i48gZvmZbd52k5XjihqrljrtZwOZSJ_0 2024-09-14T12:01:17.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.566+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103898150702947978', time=2024-09-14T13:35:44.037264+0000, chain.objs.size()=1 2024-09-14T12:01:17.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.566+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.hURSTxmqt_5xhrSLssG_aMXDohu5a0d_0 2024-09-14T12:01:17.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.566+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7647825577885551500', time=2024-09-14T13:35:44.084538+0000, chain.objs.size()=1 2024-09-14T12:01:17.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.566+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.4sqMq_YOeHXU5uNzxwItm8AC5Wt3Jsp_0 2024-09-14T12:01:17.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.566+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8014279442551332989', time=2024-09-14T13:35:44.222716+0000, chain.objs.size()=1 2024-09-14T12:01:17.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.566+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.wNtggANElDsZPyHKoLweTZEa0oY3dIc_0 2024-09-14T12:01:17.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.569+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13939356543019795234', time=2024-09-14T13:35:44.807294+0000, chain.objs.size()=1 2024-09-14T12:01:17.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.569+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.rFiQmF4jjJcl4VnmQsrUJWwn7x1dg-Z_0 2024-09-14T12:01:17.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.569+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6702312408863336422', time=2024-09-14T13:35:44.850110+0000, chain.objs.size()=1 2024-09-14T12:01:17.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.569+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.qRGdO75fd2YFb_TayUSPMlAkfvaSxKf_0 2024-09-14T12:01:17.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.570+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9363553556343796110', time=2024-09-14T13:35:45.150729+0000, chain.objs.size()=1 2024-09-14T12:01:17.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.570+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.lhlxAv5pO6KpzlQ70FgDt-5eDZtLi6l_0 2024-09-14T12:01:17.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.570+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13577903519709174680', time=2024-09-14T13:35:45.240018+0000, chain.objs.size()=1 2024-09-14T12:01:17.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.570+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.9TZM-b8CEeN5w4G1AAw9TxAQpAb6W3M_0 2024-09-14T12:01:17.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.570+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4738721742742521974', time=2024-09-14T13:35:45.378309+0000, chain.objs.size()=1 2024-09-14T12:01:17.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.570+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.PNvwivhH73sXQbW2elOBX2JR_nItRc3_0 2024-09-14T12:01:17.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.570+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9054897589741100829', time=2024-09-14T13:35:45.441464+0000, chain.objs.size()=1 2024-09-14T12:01:17.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.570+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.fFVDRAluO2gaNDGTgn_Im5JKpb20ZLd_0 2024-09-14T12:01:17.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.573+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3287958329505392229', time=2024-09-14T13:35:45.639981+0000, chain.objs.size()=1 2024-09-14T12:01:17.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.573+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.bh653aYKkllRFUrOMPISM-9AJ70VSa7_0 2024-09-14T12:01:17.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.573+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16254522567891951471', time=2024-09-14T13:35:46.313438+0000, chain.objs.size()=1 2024-09-14T12:01:17.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.573+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.aHaKM2fDHJx7gVCH3brEGPd1WCm6HAn_0 2024-09-14T12:01:17.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.573+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13272987775188188023', time=2024-09-14T13:35:46.339565+0000, chain.objs.size()=1 2024-09-14T12:01:17.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.573+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.D-t-pb0ZgAi2a80dF67gg2_FiM5CH7H_0 2024-09-14T12:01:17.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.573+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17405458021666629264', time=2024-09-14T13:35:46.552371+0000, chain.objs.size()=1 2024-09-14T12:01:17.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.573+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.U8WEfdQ4qNXS1j4-xP0QZIM2h_eUu9C_0 2024-09-14T12:01:17.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.573+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2214996246343434034', time=2024-09-14T13:35:48.533425+0000, chain.objs.size()=1 2024-09-14T12:01:17.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.573+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ilZ0Bx3uNJneWXAtoN5euUjc_ZxFS7K_0 2024-09-14T12:01:17.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.573+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10935474849863233429', time=2024-09-14T13:35:48.632300+0000, chain.objs.size()=1 2024-09-14T12:01:17.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.573+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.jzLKfSGw2n0iSmgfAcRuhgGv9WAPZIt_0 2024-09-14T12:01:17.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.573+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5168794644754704284', time=2024-09-14T13:35:48.765586+0000, chain.objs.size()=1 2024-09-14T12:01:17.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.573+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.I_37ywbcMj9iDymsIqwRJBLpmstl-DW_0 2024-09-14T12:01:17.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.573+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7508241986947828048', time=2024-09-14T13:35:49.261480+0000, chain.objs.size()=1 2024-09-14T12:01:17.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.573+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.RHflxTq2jL4OR17_HbU5ZcGAD5HhVb1_0 2024-09-14T12:01:17.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.574+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18440321707314664495', time=2024-09-14T13:35:49.510931+0000, chain.objs.size()=1 2024-09-14T12:01:17.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.574+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Tom-GV0YjTZv7Y0rQg5ggDrCeMeD9_b_0 2024-09-14T12:01:17.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.575+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12021904790989481107', time=2024-09-14T13:35:50.014930+0000, chain.objs.size()=1 2024-09-14T12:01:17.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.575+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ClkgQSoRe1h5tByvkL8SJyhMCGriASR_0 2024-09-14T12:01:17.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.575+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12051825319945336480', time=2024-09-14T13:35:50.732004+0000, chain.objs.size()=1 2024-09-14T12:01:17.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.575+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.jD8H-gl83X2nKsyQIIkogqiV5-iY_jz_0 2024-09-14T12:01:17.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.575+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12989192173633639896', time=2024-09-14T13:35:50.915571+0000, chain.objs.size()=1 2024-09-14T12:01:17.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.575+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.i6t-akiGdH8AQzjrnACX-B9zQlpu27G_0 2024-09-14T12:01:17.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.578+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15942614329965510934', time=2024-09-14T13:35:50.916489+0000, chain.objs.size()=1 2024-09-14T12:01:17.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.578+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.GhX7krj0TYQSYRBuxtityLlLXH1YLPD_0 2024-09-14T12:01:17.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.578+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.520593649617438424', time=2024-09-14T13:35:51.160131+0000, chain.objs.size()=1 2024-09-14T12:01:17.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.578+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.XXpqONhCXMSlGfL_YvXpXLijjoJR-Ss_0 2024-09-14T12:01:17.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.578+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4025647560938398500', time=2024-09-14T13:35:52.053863+0000, chain.objs.size()=1 2024-09-14T12:01:17.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.578+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ckXRj50t49Y6SqXzlEwJEEbQb7uGzrT_0 2024-09-14T12:01:17.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.578+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1971685261053799252', time=2024-09-14T13:37:53.842008+0000, chain.objs.size()=1 2024-09-14T12:01:17.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.578+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.440__shadow_.EA4a2ly4boh-ZNBJUxdTImqZuhrPusM_0 2024-09-14T12:01:17.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.581+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/44315 2024-09-14T12:01:17.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.583+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T12:01:17.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.583+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2854074105966520178', time=2024-09-14T13:37:57.177534+0000, chain.objs.size()=1 2024-09-14T12:01:17.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.583+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.443__shadow_.wxSkSSjqoGKWEG8Gbcw-raVDdJHtaGb_0 2024-09-14T12:01:17.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.583+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17620113091624737178', time=2024-09-14T13:43:27.805134+0000, chain.objs.size()=4 2024-09-14T12:01:17.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.583+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.528__multipart_mymultipart.2~4MGSsAds61xlUtHgnLB9qmVkhTZfKp7.1 2024-09-14T12:01:17.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.583+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.528__multipart_mymultipart.2~4MGSsAds61xlUtHgnLB9qmVkhTZfKp7.2 2024-09-14T12:01:17.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.583+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.528__multipart_mymultipart.2~4MGSsAds61xlUtHgnLB9qmVkhTZfKp7.3 2024-09-14T12:01:17.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.583+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.528__multipart_mymultipart.2~4MGSsAds61xlUtHgnLB9qmVkhTZfKp7.4 2024-09-14T12:01:17.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.583+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~o9o60vEX4Tt-o83Z7t20zDfGBWN4TWV', time=2024-09-14T13:43:42.866520+0000, chain.objs.size()=2 2024-09-14T12:01:17.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.583+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.532__multipart_mymultipart.2~o9o60vEX4Tt-o83Z7t20zDfGBWN4TWV.1 2024-09-14T12:01:17.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.583+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.532__multipart_mymultipart.2~o9o60vEX4Tt-o83Z7t20zDfGBWN4TWV.2 2024-09-14T12:01:17.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.584+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15920963157382021858', time=2024-09-14T13:45:19.502394+0000, chain.objs.size()=1 2024-09-14T12:01:17.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.584+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.561__shadow_.VGnwBtQmu4ZefLvC5CzO9fAaYP2awUb_0 2024-09-14T12:01:17.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.584+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9264980021344374196', time=2024-09-14T13:45:45.028885+0000, chain.objs.size()=1 2024-09-14T12:01:17.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.584+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:rhfvOCXB9J0yWH6h6MxDUKOPcY.z1mc_.eHhgZ_gfgzmmGHK3ZVebIPzqc0iPcy6_0 2024-09-14T12:01:17.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.584+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17743708339823841494', time=2024-09-14T13:45:48.446874+0000, chain.objs.size()=1 2024-09-14T12:01:17.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.584+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.571__shadow:KhyWUPdQ1RdyhDg8U8maiars1qvja48_.NB2pq_e0-RSY3Q4Hv0W_8LJUdHp5vpa_0 2024-09-14T12:01:17.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.584+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3126216053644606764', time=2024-09-14T13:45:49.762260+0000, chain.objs.size()=1 2024-09-14T12:01:17.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.584+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.572__shadow_.xpSDAaHQou7fOkZwAqcVtRlz0gH8i6S_0 2024-09-14T12:01:17.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.584+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.355955993385708125', time=2024-09-14T13:45:58.529989+0000, chain.objs.size()=1 2024-09-14T12:01:17.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.584+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.575__shadow:213n-UYl6hMDYtpOKkfvcGXayB.o-HM_.B80drolQ1A96cdy3PC-tNSpJvqoq6b4_0 2024-09-14T12:01:17.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.589+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12945351697065613127', time=2024-09-14T13:46:00.122578+0000, chain.objs.size()=1 2024-09-14T12:01:17.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.589+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.576__shadow_.7fjmkdSJrG7vZ1Jy8Yu7Mvvp2WqvqxY_0 2024-09-14T12:01:17.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.589+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16524269584409693049', time=2024-09-14T13:46:09.731831+0000, chain.objs.size()=1 2024-09-14T12:01:17.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.589+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:MS7QbAUKDvilTDx-oHMdauB2x1xZqg6_.OmJmS-MlYRRl78pVgnEPrL1MYuEPgYy_0 2024-09-14T12:01:17.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.589+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1913213578281032516', time=2024-09-14T13:46:11.956038+0000, chain.objs.size()=1 2024-09-14T12:01:17.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.589+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:k3YD1I-TjTENhjIt7OEw4wUMdQOYc52_.YCbSHhDpoRdVaq-q4y5SdUO38Or1R9g_0 2024-09-14T12:01:17.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.589+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17595608520156675771', time=2024-09-14T13:47:42.821573+0000, chain.objs.size()=1 2024-09-14T12:01:17.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.589+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.609__shadow_._8J780ky-HEKqheQIRTQOckBk78bj3B_0 2024-09-14T12:01:17.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.589+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12942711622286040004', time=2024-09-14T13:53:04.047237+0000, chain.objs.size()=1 2024-09-14T12:01:17.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.589+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.646__shadow_.1iu0FL1TJ8c2FdMpdUT5huzlXVqbmcj_0 2024-09-14T12:01:17.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.589+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8772627327693396290', time=2024-09-14T13:53:08.967604+0000, chain.objs.size()=1 2024-09-14T12:01:17.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.589+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.648__shadow_.sb5xrvrugxkXYSK_zS8dGcA58DgJI4P_0 2024-09-14T12:01:17.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.589+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8103533510636808006', time=2024-09-14T13:53:53.139690+0000, chain.objs.size()=6 2024-09-14T12:01:17.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.589+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.662__multipart_baz.2~nZQg8z10J2kJY-jYM2fy-_pMQSg0ah9.1 2024-09-14T12:01:17.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.589+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.662__multipart_baz.2~nZQg8z10J2kJY-jYM2fy-_pMQSg0ah9.2 2024-09-14T12:01:17.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.589+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.662__multipart_baz.2~nZQg8z10J2kJY-jYM2fy-_pMQSg0ah9.3 2024-09-14T12:01:17.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.589+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.662__multipart_baz.2~nZQg8z10J2kJY-jYM2fy-_pMQSg0ah9.4 2024-09-14T12:01:17.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.589+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.662__multipart_baz.2~nZQg8z10J2kJY-jYM2fy-_pMQSg0ah9.5 2024-09-14T12:01:17.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.592+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.662__multipart_baz.2~nZQg8z10J2kJY-jYM2fy-_pMQSg0ah9.6 2024-09-14T12:01:17.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.592+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.452656315279871369', time=2024-09-14T13:57:05.858060+0000, chain.objs.size()=1 2024-09-14T12:01:17.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.592+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.757__shadow_.1pve920D_gUr3X9EiQz7LoNlbOq7HH3_0 2024-09-14T12:01:17.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.592+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15714140378061567516', time=2024-09-14T13:57:21.004776+0000, chain.objs.size()=1 2024-09-14T12:01:17.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.592+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.761__shadow_.Jd4yyr9ZgvAVUZnnDKiPvxsD7_yXWJ3_0 2024-09-14T12:01:17.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.595+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:17.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.598+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T12:01:17.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.599+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.600+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.600+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50451' 2024-09-14T12:01:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.600+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4879440242572213637', time=2024-09-14T13:28:26.045495+0000, chain.objs.size()=3 2024-09-14T12:01:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.600+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.162__multipart_foo-FROZEN.2~210IRH7X8pZ0E_q8G7GcnKt51qA05CA.1 2024-09-14T12:01:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.601+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.162__multipart_foo-FROZEN.2~210IRH7X8pZ0E_q8G7GcnKt51qA05CA.2 2024-09-14T12:01:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.601+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.162__multipart_foo-FROZEN.2~210IRH7X8pZ0E_q8G7GcnKt51qA05CA.3 2024-09-14T12:01:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.601+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15635806783575344439', time=2024-09-14T13:28:35.004817+0000, chain.objs.size()=1 2024-09-14T12:01:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.601+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.163__shadow_.-Bv2MbVYsGOr8vZwftfsLDvKMB9Jp1B_0 2024-09-14T12:01:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.601+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='_FCjhqdIoXg8OaQFRTUkYL6IHWi3gf30', time=2024-09-14T13:28:35.213059+0000, chain.objs.size()=1 2024-09-14T12:01:17.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.601+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.164__shadow_.qC1uXYJ3Yrs0zlA2jxSdaT5C535sQ0q_0 2024-09-14T12:01:17.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.601+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33473669388083642', time=2024-09-14T13:28:47.193236+0000, chain.objs.size()=1 2024-09-14T12:01:17.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.601+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.171__shadow_.B-iJh353Aeab-7MPLzoQGIGgNeNLZPZ_0 2024-09-14T12:01:17.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.601+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11872909124328275586', time=2024-09-14T13:31:37.006387+0000, chain.objs.size()=1 2024-09-14T12:01:17.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.601+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.235__shadow_.G9mSrgiuaf8EtZX4-NwTxEBcBpHWaQk_0 2024-09-14T12:01:17.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.601+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16292785322205561143', time=2024-09-14T13:31:38.107935+0000, chain.objs.size()=1 2024-09-14T12:01:17.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.601+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.236__shadow_.VQFuiD_pJhhh-rhLF7x2wCwdWiOtQ4L_0 2024-09-14T12:01:17.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.601+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2199138372847353266', time=2024-09-14T13:31:39.198326+0000, chain.objs.size()=1 2024-09-14T12:01:17.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.601+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.237__shadow_.VgqodphcSdPQXqMPs8YXgWPliLIrsJS_0 2024-09-14T12:01:17.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.601+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.733599946037648410', time=2024-09-14T13:31:48.747842+0000, chain.objs.size()=1 2024-09-14T12:01:17.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.601+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.244__shadow_.q36ZsOHEJxy3-Aa--XcQksp6859PIvk_0 2024-09-14T12:01:17.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.601+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9206052308260360679', time=2024-09-14T13:31:56.232152+0000, chain.objs.size()=1 2024-09-14T12:01:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.601+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.250__shadow_.onTXjHYT0zgBunlNP8OyDoTqEP_Y0fZ_0 2024-09-14T12:01:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.601+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6910786334709689257', time=2024-09-14T13:32:47.551301+0000, chain.objs.size()=1 2024-09-14T12:01:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.601+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.xQ8DRuPaLpVo68f9PeVVs-pSkNDKxu4_0 2024-09-14T12:01:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.604+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14856235589545080488', time=2024-09-14T13:32:48.156343+0000, chain.objs.size()=1 2024-09-14T12:01:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.604+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.I9i6KWvD4QNg_uBF6HF-JKbpjEI-zN8_0 2024-09-14T12:01:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.604+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15947387742432730970', time=2024-09-14T13:32:48.352858+0000, chain.objs.size()=1 2024-09-14T12:01:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.604+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Zgd3la1k-YMzmO6y8ILjK9TrOtEBxzc_0 2024-09-14T12:01:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.604+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14489070592989240349', time=2024-09-14T13:32:49.015567+0000, chain.objs.size()=1 2024-09-14T12:01:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.604+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.hHt47c_iO9CaYGrWj76Pc2Mqy3OMO1Q_0 2024-09-14T12:01:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.604+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2452090318753768569', time=2024-09-14T13:32:49.043801+0000, chain.objs.size()=1 2024-09-14T12:01:17.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.604+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.A3Kw-VDX6O68lmmB7JL713sPU_waU3p_0 2024-09-14T12:01:17.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.604+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6619781200468904352', time=2024-09-14T13:32:49.315344+0000, chain.objs.size()=1 2024-09-14T12:01:17.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.604+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ptQ0tR2w5rNqcQy9p3L8OLiBnmo7vPu_0 2024-09-14T12:01:17.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.604+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11954127348798158973', time=2024-09-14T13:32:49.821316+0000, chain.objs.size()=1 2024-09-14T12:01:17.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.604+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.KcFuc6mW505Z2S4jHVeptcLnCyB6X1s_0 2024-09-14T12:01:17.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.604+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13502061614163723785', time=2024-09-14T13:32:50.949942+0000, chain.objs.size()=1 2024-09-14T12:01:17.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.604+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Hpm-IXE2VM3MUwXE0sbvhSSaEb7Ou3W_0 2024-09-14T12:01:17.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.604+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6514977270582338257', time=2024-09-14T13:32:51.091264+0000, chain.objs.size()=1 2024-09-14T12:01:17.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.604+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.H-jaTAZT5Uy-kVcNvZrGMZosxF5Cv5B_0 2024-09-14T12:01:17.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.605+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17820506982591176549', time=2024-09-14T13:32:51.366266+0000, chain.objs.size()=1 2024-09-14T12:01:17.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.605+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.4_h9dkwok_eiHJsepes36uq8SQBSgM5_0 2024-09-14T12:01:17.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.605+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5617395961631450390', time=2024-09-14T13:32:51.366888+0000, chain.objs.size()=1 2024-09-14T12:01:17.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.605+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.JioI_pzCMYRbCKFn7d3K0gg15kGXS4F_0 2024-09-14T12:01:17.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.605+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3018011251845432365', time=2024-09-14T13:32:51.395765+0000, chain.objs.size()=1 2024-09-14T12:01:17.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.605+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.J8jsZKDlsQwYIa1SpBk0JTaaL4SyfMa_0 2024-09-14T12:01:17.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.608+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3034973282026994384', time=2024-09-14T13:32:52.304390+0000, chain.objs.size()=1 2024-09-14T12:01:17.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.608+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.wYVnxc2jVmKyS6j-49PYEpBOtz3KOdZ_0 2024-09-14T12:01:17.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.609+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4026524572205948229', time=2024-09-14T13:32:52.305030+0000, chain.objs.size()=1 2024-09-14T12:01:17.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.609+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.aWBg_PtafE9GzND0p4sJX-8_Mg8z-n4_0 2024-09-14T12:01:17.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.609+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9353692373850544539', time=2024-09-14T13:32:52.686932+0000, chain.objs.size()=1 2024-09-14T12:01:17.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.609+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.LzsFyrxWJNL45EpRsHTI13wJb3hl01a_0 2024-09-14T12:01:17.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.609+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11321823321936868184', time=2024-09-14T13:32:53.638054+0000, chain.objs.size()=1 2024-09-14T12:01:17.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.609+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.aTTQtEfY-zHQQ13Se8mEskKF2TqxBlq_0 2024-09-14T12:01:17.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.609+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13549017319314070810', time=2024-09-14T13:32:53.819328+0000, chain.objs.size()=1 2024-09-14T12:01:17.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.609+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.MthCc3LZ7WIiQ58g5dXpLrtrhGre-4B_0 2024-09-14T12:01:17.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.609+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6048971918538275507', time=2024-09-14T13:32:53.859216+0000, chain.objs.size()=1 2024-09-14T12:01:17.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.609+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.DaHLCG3eYudZxg21j40ts94n0Uaar90_0 2024-09-14T12:01:17.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.609+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14865304883393738344', time=2024-09-14T13:32:53.987382+0000, chain.objs.size()=1 2024-09-14T12:01:17.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.609+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.kb3lS1S0laqs7nHUr9eFTMthwMnkTya_0 2024-09-14T12:01:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.609+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12045933978872230104', time=2024-09-14T13:32:54.983304+0000, chain.objs.size()=1 2024-09-14T12:01:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.609+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ADWGVKw6KhXvONpjg5udLgMMZbM-6q8_0 2024-09-14T12:01:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.609+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4114845993729637646', time=2024-09-14T13:32:55.505558+0000, chain.objs.size()=1 2024-09-14T12:01:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.609+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.2THJRkP3v8m2HvcGX2wIRo6c0SPOTUH_0 2024-09-14T12:01:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.609+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18222900867227968915', time=2024-09-14T13:32:56.781913+0000, chain.objs.size()=1 2024-09-14T12:01:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.609+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.7Dz6SvLxm9tNuvdu7FWUJmypY7qaVFr_0 2024-09-14T12:01:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.609+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15330452854471892238', time=2024-09-14T13:32:56.882221+0000, chain.objs.size()=1 2024-09-14T12:01:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.609+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Dl3b__m3nToBn-yRRFbeJDyjcT7WH1D_0 2024-09-14T12:01:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.611+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12797554380754758343', time=2024-09-14T13:32:57.408786+0000, chain.objs.size()=1 2024-09-14T12:01:17.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.611+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.F8qQBLVrW6bFBpfLK2cM3Dic_sLPmfg_0 2024-09-14T12:01:17.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.612+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13302747344690090140', time=2024-09-14T13:32:57.783557+0000, chain.objs.size()=1 2024-09-14T12:01:17.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.612+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.fljtAeOFucubuRJdc_iCT85amyaNLQI_0 2024-09-14T12:01:17.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.613+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8652581794663280902', time=2024-09-14T13:32:57.946745+0000, chain.objs.size()=1 2024-09-14T12:01:17.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.613+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_._x8QJEHLkGmsYxd1unrWNfjQZFvtNk5_0 2024-09-14T12:01:17.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.613+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18288053282175392097', time=2024-09-14T13:32:58.037895+0000, chain.objs.size()=1 2024-09-14T12:01:17.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.613+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.u7TJeW5Muj1f4HZiMe9JfBr0WjG1-2C_0 2024-09-14T12:01:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.613+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14600691460266711221', time=2024-09-14T13:32:58.491704+0000, chain.objs.size()=1 2024-09-14T12:01:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.613+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.VnzE3-CvdcFILCiALXxWG0ALd-s0dBR_0 2024-09-14T12:01:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.614+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7655269039943650827', time=2024-09-14T13:32:58.521608+0000, chain.objs.size()=1 2024-09-14T12:01:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.614+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.nLtMAZzXoxjwN9Ojgo8QKg0GgrkiXvs_0 2024-09-14T12:01:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.614+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12775286918491233715', time=2024-09-14T13:32:58.743707+0000, chain.objs.size()=1 2024-09-14T12:01:17.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.614+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.F2OSpZiNnXZfoOhDLnTWd4UQjPusJlG_0 2024-09-14T12:01:17.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.614+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2290825260443665570', time=2024-09-14T13:32:58.758804+0000, chain.objs.size()=1 2024-09-14T12:01:17.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.614+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.fM6yqs6xbvSEDftx2zVACqjGGi1CJ7O_0 2024-09-14T12:01:17.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.614+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10720196802908679321', time=2024-09-14T13:33:15.997274+0000, chain.objs.size()=1 2024-09-14T12:01:17.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.614+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.279__shadow_.XCy-indKX2lCeeV3cnO7htcCQTPlzoz_0 2024-09-14T12:01:17.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.614+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10893649433100403692', time=2024-09-14T13:33:33.130543+0000, chain.objs.size()=1 2024-09-14T12:01:17.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.614+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.AlGPoC8U4V8MZjCUmLcq9s-lAI00tOg_0 2024-09-14T12:01:17.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.615+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10194415775751681057', time=2024-09-14T13:33:38.960112+0000, chain.objs.size()=1 2024-09-14T12:01:17.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.615+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.297__shadow_.I59e4DffecyOMbOuUCxMDVW4P7CNfSa_0 2024-09-14T12:01:17.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.615+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3129321869732441521', time=2024-09-14T13:33:42.356723+0000, chain.objs.size()=1 2024-09-14T12:01:17.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.615+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.300__shadow_.q5thTwN6AS6mXOZKKm3-hz3WqEmTAZ7_0 2024-09-14T12:01:17.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.615+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14967791009598745732', time=2024-09-14T13:33:45.847181+0000, chain.objs.size()=1 2024-09-14T12:01:17.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.615+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.303__shadow_.OddD9wh0vOCQukG0QRQBQVrS66h02fG_0 2024-09-14T12:01:17.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.615+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1065155081489655957', time=2024-09-14T13:34:51.741134+0000, chain.objs.size()=1 2024-09-14T12:01:17.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.615+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.FfXTRRSlrSovEpWdblEUPgiFdXZDUFK_0 2024-09-14T12:01:17.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.616+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17676377330764224877', time=2024-09-14T13:34:52.009898+0000, chain.objs.size()=1 2024-09-14T12:01:17.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.616+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.i4MMZ378KvPXdccRLWFgUMbksq6gtY4_0 2024-09-14T12:01:17.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.616+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10934287795365265472', time=2024-09-14T13:34:52.574174+0000, chain.objs.size()=1 2024-09-14T12:01:17.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.616+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.U4fqijTXof6Pj0aVOql-AD4G5SHBSlF_0 2024-09-14T12:01:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.618+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4566163722584559666', time=2024-09-14T13:34:53.578649+0000, chain.objs.size()=1 2024-09-14T12:01:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.618+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.aP1XJ5aAPVJnFMPO7dyeolOxiiblvH9_0 2024-09-14T12:01:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.618+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2200808438852242689', time=2024-09-14T13:34:54.018987+0000, chain.objs.size()=1 2024-09-14T12:01:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.618+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.mGyWL2lKoXXzOS_lrdnD8-3FU3WmWkl_0 2024-09-14T12:01:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.618+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8121860296683839632', time=2024-09-14T13:34:54.809600+0000, chain.objs.size()=1 2024-09-14T12:01:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.618+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.BtZ8FKUybf1WPKDbdAGqzy_vYY5BRa9_0 2024-09-14T12:01:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.620+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8065948071523623593', time=2024-09-14T13:34:54.873598+0000, chain.objs.size()=1 2024-09-14T12:01:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.620+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.8tWO-8lyoZ3tNnrz1P08Ct-bneNcn-W_0 2024-09-14T12:01:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.620+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5382711283796995012', time=2024-09-14T13:34:55.366542+0000, chain.objs.size()=1 2024-09-14T12:01:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.620+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.OSKUMpvZQ1tuueZikgq5VDdj8qZhWSI_0 2024-09-14T12:01:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.620+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5161668875323636771', time=2024-09-14T13:34:56.500449+0000, chain.objs.size()=1 2024-09-14T12:01:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.620+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ge7MBaHF0eI3worf3wsFlRGh7Br6tNZ_0 2024-09-14T12:01:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.620+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2752975853469375748', time=2024-09-14T13:34:57.047553+0000, chain.objs.size()=1 2024-09-14T12:01:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.620+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.-AwEtP4nqRXmYlzVyJa1zoctvLQxWGD_0 2024-09-14T12:01:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.620+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.561574521024566886', time=2024-09-14T13:34:57.162934+0000, chain.objs.size()=1 2024-09-14T12:01:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.620+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.7v2kC3e_KCtOE2H4N4ib9Ox6KA1AwSo_0 2024-09-14T12:01:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.620+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6572143878674724709', time=2024-09-14T13:34:57.163587+0000, chain.objs.size()=1 2024-09-14T12:01:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.620+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.JajH5cqy2ojt5CwkaCh7CMxnugbwMoT_0 2024-09-14T12:01:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.620+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8020921951365426488', time=2024-09-14T13:34:57.616071+0000, chain.objs.size()=1 2024-09-14T12:01:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.620+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.vKbhJIFqo0xB85GBGZoBCHyoOy_6sDP_0 2024-09-14T12:01:17.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.620+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5517732069784458203', time=2024-09-14T13:34:58.183245+0000, chain.objs.size()=1 2024-09-14T12:01:17.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.620+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.BI6pTDPwkPlkTWi2kxYg5KqClNaThxV_0 2024-09-14T12:01:17.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.621+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2091435463379099915', time=2024-09-14T13:34:58.360225+0000, chain.objs.size()=1 2024-09-14T12:01:17.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.621+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.67fXQQUqWP2QZO5_x4KP3CKWeIZvxMF_0 2024-09-14T12:01:17.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.622+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2565555843822974570', time=2024-09-14T13:34:58.408273+0000, chain.objs.size()=1 2024-09-14T12:01:17.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.622+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.5VRkZ2rrSTHTK8eOzZUhZxLMFJIkrEN_0 2024-09-14T12:01:17.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.623+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12787519158382294293', time=2024-09-14T13:34:58.571752+0000, chain.objs.size()=1 2024-09-14T12:01:17.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.623+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.svH0ZNK3dWCu5UfDJxnloLfW5vhduRN_0 2024-09-14T12:01:17.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.623+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5236635771071960133', time=2024-09-14T13:34:58.650823+0000, chain.objs.size()=1 2024-09-14T12:01:17.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.623+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.tAK91j8GGIlSAZENQvCstEFJ8m2vFMb_0 2024-09-14T12:01:17.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.623+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16920004748751455413', time=2024-09-14T13:34:59.695361+0000, chain.objs.size()=1 2024-09-14T12:01:17.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.623+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.sRbaz8cRecb5MirL_gyrNpDvVXj6OcA_0 2024-09-14T12:01:17.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.623+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18299790166726927365', time=2024-09-14T13:34:59.771083+0000, chain.objs.size()=1 2024-09-14T12:01:17.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.623+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.bjGr2H6ybpVW_qJFYoyXvlT2_i7M_cG_0 2024-09-14T12:01:17.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.623+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17094775860468888147', time=2024-09-14T13:34:59.809542+0000, chain.objs.size()=1 2024-09-14T12:01:17.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.623+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.h6n7P4aXceiCWM_wYv_fMdlzkr6Gyxg_0 2024-09-14T12:01:17.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.624+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16380449170500489730', time=2024-09-14T13:34:59.841395+0000, chain.objs.size()=1 2024-09-14T12:01:17.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.624+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Hrrei1_gSkisOvczPV35S06N7ou8Gqx_0 2024-09-14T12:01:17.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.624+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10352408213023746171', time=2024-09-14T13:34:59.938957+0000, chain.objs.size()=1 2024-09-14T12:01:17.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.624+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Q0MGVcrbi0aUwGI2jjUrCjFkoC3jH_z_0 2024-09-14T12:01:17.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.625+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6635992739372105137', time=2024-09-14T13:35:00.826857+0000, chain.objs.size()=1 2024-09-14T12:01:17.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.625+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.fTUw-TjwXZrbRP3afg0YsxAjZh9taNR_0 2024-09-14T12:01:17.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.625+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3665274717470718259', time=2024-09-14T13:35:01.921684+0000, chain.objs.size()=1 2024-09-14T12:01:17.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.625+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.lGQRUIkQspnJ8tNWXv8Gvd2N8m8aiZI_0 2024-09-14T12:01:17.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.625+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13786889224978534175', time=2024-09-14T13:35:02.461692+0000, chain.objs.size()=1 2024-09-14T12:01:17.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.625+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.c6WJEdIdOx3KxOUuqls14O2jtTWisTG_0 2024-09-14T12:01:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.625+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14984664287881569361', time=2024-09-14T13:35:02.641201+0000, chain.objs.size()=1 2024-09-14T12:01:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.625+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.1SlVMWURxEunXMSos4M--SGenGErHmO_0 2024-09-14T12:01:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.627+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1471303428283660789', time=2024-09-14T13:35:02.645173+0000, chain.objs.size()=1 2024-09-14T12:01:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.627+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ilECsMclIyuIJtXxD9hC3ilKjUf3oDc_0 2024-09-14T12:01:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.627+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.122961857972978331', time=2024-09-14T13:35:41.659893+0000, chain.objs.size()=1 2024-09-14T12:01:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.627+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.4n42OurtiEKP69WUoPwdHJJf0GfrhQ5_0 2024-09-14T12:01:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.627+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4263744503175331735', time=2024-09-14T13:35:41.660914+0000, chain.objs.size()=1 2024-09-14T12:01:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.627+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.YwNejSOezKtZz4pfMpQluGsbHVC-tDP_0 2024-09-14T12:01:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.627+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2206827807459855566', time=2024-09-14T13:35:41.664137+0000, chain.objs.size()=1 2024-09-14T12:01:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.627+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.dkForSrMqeluhD3gXj5Etj8gccdeNw6_0 2024-09-14T12:01:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.628+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10244605715369468592', time=2024-09-14T13:35:41.762641+0000, chain.objs.size()=1 2024-09-14T12:01:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.628+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.l2wTYA7e0bB2Je8TrzK2dj0Vuzxg99F_0 2024-09-14T12:01:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.628+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5377624211708610702', time=2024-09-14T13:35:42.074145+0000, chain.objs.size()=1 2024-09-14T12:01:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.628+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.2cEmc8VFJHu5gz1UN0UTtvabfRuzLJl_0 2024-09-14T12:01:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.629+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17447141759234572779', time=2024-09-14T13:35:42.206860+0000, chain.objs.size()=1 2024-09-14T12:01:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.629+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.KtAObMXMg8UCTBrndy4o2dP9D1-8GZx_0 2024-09-14T12:01:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.629+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16604334672003763161', time=2024-09-14T13:35:42.243032+0000, chain.objs.size()=1 2024-09-14T12:01:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.629+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.JsapraHD9biKFlV_0vzG7_szVxqHBy-_0 2024-09-14T12:01:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.629+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14947107298854386292', time=2024-09-14T13:35:42.301909+0000, chain.objs.size()=1 2024-09-14T12:01:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.629+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.-cV5OhzS9nZqtKd4BjRnSQ360Xq1mQ1_0 2024-09-14T12:01:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.629+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9073981215077815951', time=2024-09-14T13:35:42.688792+0000, chain.objs.size()=1 2024-09-14T12:01:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.629+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ewqmyOZBLjFa0ulrLZ5C-dGnj-VRiI5_0 2024-09-14T12:01:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.629+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4524540583184398905', time=2024-09-14T13:35:43.261851+0000, chain.objs.size()=1 2024-09-14T12:01:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.629+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.OtXEdtW6KJycCqeadFGumPxiy1XE9vt_0 2024-09-14T12:01:17.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.633+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5623173102925450326', time=2024-09-14T13:35:43.551164+0000, chain.objs.size()=1 2024-09-14T12:01:17.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.633+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.pBuGeXfDNUtSuKucWIM4ZYaPGusn2md_0 2024-09-14T12:01:17.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.633+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15384982819490446267', time=2024-09-14T13:35:43.590382+0000, chain.objs.size()=1 2024-09-14T12:01:17.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.633+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.d2Ky4vCe1PUg_ku_MJAYEEYIowia5ce_0 2024-09-14T12:01:17.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.633+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14725676635184094757', time=2024-09-14T13:35:43.595645+0000, chain.objs.size()=1 2024-09-14T12:01:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.633+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.kAbeNWO7RsOAhKmR8zL5I9HO-ZRbotM_0 2024-09-14T12:01:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.633+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13193685417477560792', time=2024-09-14T13:35:43.997503+0000, chain.objs.size()=1 2024-09-14T12:01:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.633+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.J2QlNFeO6dPKu3N6okdnBb7jEP97ABU_0 2024-09-14T12:01:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.633+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15766123375330188690', time=2024-09-14T13:35:45.290195+0000, chain.objs.size()=1 2024-09-14T12:01:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.633+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.3b3gfoqba9T9-QogFx3qscHTNPpJUMq_0 2024-09-14T12:01:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.633+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5802168197709154440', time=2024-09-14T13:35:46.404956+0000, chain.objs.size()=1 2024-09-14T12:01:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.633+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.aOQocCS8E6uexwgDqvwl7iv3lE-5gFb_0 2024-09-14T12:01:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.633+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14750995796524055348', time=2024-09-14T13:35:46.949538+0000, chain.objs.size()=1 2024-09-14T12:01:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.633+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.IePMSZ_3ulC15Fydi4ooUUuU7DLjYM1_0 2024-09-14T12:01:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.633+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17811610914719076291', time=2024-09-14T13:35:47.197466+0000, chain.objs.size()=1 2024-09-14T12:01:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.633+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.JK3VnPSGDmVALE6IiPKSkxxrdVttsp4_0 2024-09-14T12:01:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.633+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10828248234520467754', time=2024-09-14T13:35:47.325731+0000, chain.objs.size()=1 2024-09-14T12:01:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.633+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.e7oXQwdDuP_N08izAlpxSTqf3bOJnim_0 2024-09-14T12:01:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.633+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9940196385815340195', time=2024-09-14T13:35:47.332689+0000, chain.objs.size()=1 2024-09-14T12:01:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.633+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.y3-MR01T5FVv9-u24hs9HtHNfcdzH3X_0 2024-09-14T12:01:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.633+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1766962090778860199', time=2024-09-14T13:35:47.942552+0000, chain.objs.size()=1 2024-09-14T12:01:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.633+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.5lRuRsbW_vVlBKT9jy_8E0OlufQ5-NW_0 2024-09-14T12:01:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.636+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14805868139687348426', time=2024-09-14T13:35:47.943100+0000, chain.objs.size()=1 2024-09-14T12:01:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.636+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.lEQPYEGYJyc8BLa3g5Qu0dxWoD1rRC8_0 2024-09-14T12:01:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.636+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5719124572084097975', time=2024-09-14T13:35:47.972145+0000, chain.objs.size()=1 2024-09-14T12:01:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.636+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.8RXiAjyRW9zQuAxXfueiIU6h2B1dHui_0 2024-09-14T12:01:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.637+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3532298025494593466', time=2024-09-14T13:35:48.064851+0000, chain.objs.size()=1 2024-09-14T12:01:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.637+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.vPb52WzPIEeGTwaHqTn9UjEAZpsYmM7_0 2024-09-14T12:01:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.637+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12883483100223589772', time=2024-09-14T13:35:48.463547+0000, chain.objs.size()=1 2024-09-14T12:01:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.637+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.63EKu5FArStcvagk61bHHhJY8STBfYY_0 2024-09-14T12:01:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.637+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11130454445507246262', time=2024-09-14T13:35:49.300738+0000, chain.objs.size()=1 2024-09-14T12:01:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.637+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.EhRhury7AaMV2oCzIyiG__ikSo8iykI_0 2024-09-14T12:01:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.637+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7475228421679333721', time=2024-09-14T13:35:50.600535+0000, chain.objs.size()=1 2024-09-14T12:01:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.637+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.eltjGmJaKDAtaZEMKR7CwrQmnMOfPyT_0 2024-09-14T12:01:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.641+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/50451 2024-09-14T12:01:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-14T12:01:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5536346515664669632', time=2024-09-14T13:35:51.988710+0000, chain.objs.size()=1 2024-09-14T12:01:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.pA-rKXpi8Ctz4kZdu-qyWlzn1caMNbq_0 2024-09-14T12:01:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2312744024468617970', time=2024-09-14T13:35:52.111438+0000, chain.objs.size()=1 2024-09-14T12:01:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Z3ZVWxvxgdcHQHoZNebBAaH2gKdtku4_0 2024-09-14T12:01:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1148082965430297534', time=2024-09-14T13:35:52.164037+0000, chain.objs.size()=1 2024-09-14T12:01:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.JIRa7ad7-5aMlBweio7ydOU7UuvyMm1_0 2024-09-14T12:01:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9764878670807571759', time=2024-09-14T13:35:52.196480+0000, chain.objs.size()=1 2024-09-14T12:01:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.eEzpJARegbMIiYbHl1MHk1JHcsIBY5N_0 2024-09-14T12:01:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15990757254971377603', time=2024-09-14T13:35:52.373870+0000, chain.objs.size()=1 2024-09-14T12:01:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.HsyFyCu1WGy6GAfI-6r_ZurvjzbiyZK_0 2024-09-14T12:01:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3523737191033225126', time=2024-09-14T13:35:52.532386+0000, chain.objs.size()=1 2024-09-14T12:01:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.buE1jyfDShICdnt11Q0-etpwCXqFpF6_0 2024-09-14T12:01:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8472687809877411895', time=2024-09-14T13:35:52.583961+0000, chain.objs.size()=1 2024-09-14T12:01:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.FaWjqzF68396cTc6a2B8oXmiWDrYvxT_0 2024-09-14T12:01:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11112248512195707664', time=2024-09-14T13:35:52.616524+0000, chain.objs.size()=1 2024-09-14T12:01:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.eDkewyb9IQwBlGpCQ9xmLAC4-hX6kLB_0 2024-09-14T12:01:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9530768152989281785', time=2024-09-14T13:35:57.460500+0000, chain.objs.size()=1 2024-09-14T12:01:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.330__shadow_.22nnCTT0Y7VHp3apDljz1vHjQ1kIjqA_0 2024-09-14T12:01:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15553714541453542805', time=2024-09-14T13:36:38.340704+0000, chain.objs.size()=1 2024-09-14T12:01:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.371__shadow_.Xcj2WGXGPi0WtGtPnD8gTpJKIXJh2sz_0 2024-09-14T12:01:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10517364719385252451', time=2024-09-14T13:37:00.809399+0000, chain.objs.size()=1 2024-09-14T12:01:17.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.391__shadow_.H34CDEYapka3KrSt9FiI5sNlr8LWNcj_0 2024-09-14T12:01:17.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9174385313823499955', time=2024-09-14T13:38:26.522432+0000, chain.objs.size()=1 2024-09-14T12:01:17.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.643+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.465__shadow_.mMnL_oTgGW_SpBBYape68L3_4PyoebX_0 2024-09-14T12:01:17.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.647+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.586699492488547693', time=2024-09-14T13:38:42.803995+0000, chain.objs.size()=1 2024-09-14T12:01:17.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.647+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.484__shadow_.3uSA4TbhVjAxaU8DCjMKr0vc2gfP_uq_0 2024-09-14T12:01:17.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.647+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6327603670568226862', time=2024-09-14T13:39:35.289698+0000, chain.objs.size()=6 2024-09-14T12:01:17.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.647+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.1 2024-09-14T12:01:17.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.648+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.2 2024-09-14T12:01:17.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.648+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.3 2024-09-14T12:01:17.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.648+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.4 2024-09-14T12:01:17.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.648+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.5 2024-09-14T12:01:17.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.648+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.6 2024-09-14T12:01:17.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.648+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.316209389274006825', time=2024-09-14T13:39:55.266633+0000, chain.objs.size()=1 2024-09-14T12:01:17.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.648+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.518__shadow_.H-5KZ6jEWISWTpTnx5qsVqodCoYrYY__0 2024-09-14T12:01:17.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.649+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.554742536097987938', time=2024-09-14T13:40:33.485695+0000, chain.objs.size()=3 2024-09-14T12:01:17.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.649+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.522__multipart_mymultipart.2~0BjsB220UrxL_M2javYmvUSypPv_m98.1 2024-09-14T12:01:17.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.649+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.522__multipart_mymultipart.2~0BjsB220UrxL_M2javYmvUSypPv_m98.2 2024-09-14T12:01:17.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.649+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.522__multipart_mymultipart.2~0BjsB220UrxL_M2javYmvUSypPv_m98.3 2024-09-14T12:01:17.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.651+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~rwOAgZAIeo-lJgjfx1s2eVn_5nRk7GV', time=2024-09-14T13:41:36.123481+0000, chain.objs.size()=1 2024-09-14T12:01:17.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.651+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~rwOAgZAIeo-lJgjfx1s2eVn_5nRk7GV.3 2024-09-14T12:01:17.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.651+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9521825005464733602', time=2024-09-14T13:45:17.830020+0000, chain.objs.size()=1 2024-09-14T12:01:17.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.651+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.560__shadow_.V3-YuhPDY-HLMXboe-ZFg937p3lRYEv_0 2024-09-14T12:01:17.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.651+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2793719801889010179', time=2024-09-14T13:45:39.871288+0000, chain.objs.size()=1 2024-09-14T12:01:17.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.651+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:dcioJWnUGC8pEYcqVQ5Yo1CJgxd-Po4_.4hsOx3Ca8Loll8aH1_jwS30_Fuvwpev_0 2024-09-14T12:01:17.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.652+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10942595669305756777', time=2024-09-14T13:45:40.711880+0000, chain.objs.size()=1 2024-09-14T12:01:17.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.652+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:M7hWdphQAwaayWdAVR0FEdCuVNFt4z6_.DvHobxv-4Khoed6T7f_v0VoB5oB8erA_0 2024-09-14T12:01:17.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.654+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17279533620246055330', time=2024-09-14T13:45:42.895251+0000, chain.objs.size()=1 2024-09-14T12:01:17.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.654+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:w19lDis8eixlLR80mMhpahfncIW8pbg_.HmOcYTMqsw46KsFMR6DZMvIuf3PBXIr_0 2024-09-14T12:01:17.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.654+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.332375036092527000', time=2024-09-14T13:46:04.571405+0000, chain.objs.size()=1 2024-09-14T12:01:17.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.654+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.577__shadow:Vy1JuKhxWanbY8oYB9Fd5eUuJ3C.vbT_.jIgb3r7W0B7_gp9-CARTwQAS6AKPO9K_0 2024-09-14T12:01:17.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.654+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1133023191150120557', time=2024-09-14T13:46:09.006554+0000, chain.objs.size()=1 2024-09-14T12:01:17.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.654+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:i06KiIbPv9IEV.XwPeUICsklGYd3v0L_.0zxZq6y8lNox252YcmsUbZ4QhwIIB7e_0 2024-09-14T12:01:17.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.654+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13897798470735859920', time=2024-09-14T13:47:09.419346+0000, chain.objs.size()=1 2024-09-14T12:01:17.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.654+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.580__shadow:U6VOnhhbKqYw90wj2MT6MrO-8RWNwzl_.2KOyJKm8TRFzco9w9e3rD37witbrtnV_0 2024-09-14T12:01:17.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.654+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4249908009578281178', time=2024-09-14T13:47:40.802421+0000, chain.objs.size()=1 2024-09-14T12:01:17.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.654+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.607__shadow_.G-N7-nFT3BKWlcLz5WloPn4d9_76tYD_0 2024-09-14T12:01:17.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.654+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16813850629495009216', time=2024-09-14T13:54:00.981856+0000, chain.objs.size()=1 2024-09-14T12:01:17.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.654+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.669__shadow_.8yJ1kWwXS3YbQTgyRVMnQVx_WAu193p_0 2024-09-14T12:01:17.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.654+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16243778513602413934', time=2024-09-14T13:54:29.608592+0000, chain.objs.size()=1 2024-09-14T12:01:17.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.654+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.700__shadow:h8b8RbeKJoSW1gHfXGaZcj0t.3SGaif_.mesVf0xdFy0VGeZb19aKDVMbSw1OUuy_0 2024-09-14T12:01:17.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.658+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:17.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.660+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T12:01:17.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.661+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:17.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.662+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:17.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47247' 2024-09-14T12:01:17.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2384357166611789107', time=2024-09-14T13:28:59.398765+0000, chain.objs.size()=1 2024-09-14T12:01:17.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.179__shadow_.wyU1LRjsU1mcBgRrl5UAhSyJNWVCC_Q_0 2024-09-14T12:01:17.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8818454482700616437', time=2024-09-14T13:29:09.082118+0000, chain.objs.size()=1 2024-09-14T12:01:17.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.189__shadow_.rlYIEFGFBqNlNHq44hqGc3X5Gdjxj_S_0 2024-09-14T12:01:17.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3723203718288976471', time=2024-09-14T13:31:32.671834+0000, chain.objs.size()=1 2024-09-14T12:01:17.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.231__shadow_.eGVboFftUyuQx3BifsHoPGFM7gtNnnF_0 2024-09-14T12:01:17.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7883870237691952660', time=2024-09-14T13:32:09.325298+0000, chain.objs.size()=1 2024-09-14T12:01:17.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.262__shadow_.WhT41swVRqLJAezSVaNWhbcXacEfwny_0 2024-09-14T12:01:17.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5090477214504390938', time=2024-09-14T13:32:47.385980+0000, chain.objs.size()=1 2024-09-14T12:01:17.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.wpMWgoT1eXgkD6SI0jjszNnvEXStrCM_0 2024-09-14T12:01:17.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10288901558671085358', time=2024-09-14T13:32:47.788646+0000, chain.objs.size()=1 2024-09-14T12:01:17.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Yy_KIKWIYYkc2ZR-hvBwXiI3u40SS4M_0 2024-09-14T12:01:17.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17723136814503163580', time=2024-09-14T13:32:47.789478+0000, chain.objs.size()=1 2024-09-14T12:01:17.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.FQKVnJ70FQcMAT1aMu98FZLn2Cgx2pf_0 2024-09-14T12:01:17.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8848296355157379779', time=2024-09-14T13:32:48.455919+0000, chain.objs.size()=1 2024-09-14T12:01:17.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_._L9qaKI8oQvTKCFxpLPFwww-lLn4p4I_0 2024-09-14T12:01:17.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14846063970828827790', time=2024-09-14T13:32:49.130809+0000, chain.objs.size()=1 2024-09-14T12:01:17.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.sVdvtJS15ipC5Qu9U2urpfurXYX2Tok_0 2024-09-14T12:01:17.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18325511741734291073', time=2024-09-14T13:32:50.569284+0000, chain.objs.size()=1 2024-09-14T12:01:17.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_._CS_Do7Et5YwOO-gOR7jFdudAeC7Oqh_0 2024-09-14T12:01:17.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8761524299375602114', time=2024-09-14T13:32:51.144826+0000, chain.objs.size()=1 2024-09-14T12:01:17.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.TMFd6cD4wsY7WnucJRLfD1v3An79hO2_0 2024-09-14T12:01:17.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2202000451928773429', time=2024-09-14T13:32:51.145542+0000, chain.objs.size()=1 2024-09-14T12:01:17.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.663+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.mjEMj_sBinBMP8jzAWiaxIRhOzpKkdX_0 2024-09-14T12:01:17.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.666+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16001365093307164544', time=2024-09-14T13:32:51.309308+0000, chain.objs.size()=1 2024-09-14T12:01:17.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.666+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.JuFQvpNQcrNqFENTlxrpgzLX4ifz_dL_0 2024-09-14T12:01:17.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.666+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8920300578608063552', time=2024-09-14T13:32:51.428202+0000, chain.objs.size()=1 2024-09-14T12:01:17.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.666+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.5h7RV1K5FbH_yXzwDDxiNqO412e_Fd5_0 2024-09-14T12:01:17.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.667+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10613864722437159855', time=2024-09-14T13:32:52.977952+0000, chain.objs.size()=1 2024-09-14T12:01:17.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.667+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.1gZ__Cp2YKK7rxN-I9uiKGWaCczEUX2_0 2024-09-14T12:01:17.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.667+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10940241186316460830', time=2024-09-14T13:32:53.096823+0000, chain.objs.size()=1 2024-09-14T12:01:17.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.667+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.unuzQ2F1A037JqV89I-a3_MZIWYmhvw_0 2024-09-14T12:01:17.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.667+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16416626742676610561', time=2024-09-14T13:32:53.838860+0000, chain.objs.size()=1 2024-09-14T12:01:17.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.667+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.8_Fnc0QBt_vTzHlzEqWb6mtIQTquD16_0 2024-09-14T12:01:17.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.667+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3344861291114664324', time=2024-09-14T13:32:53.980249+0000, chain.objs.size()=1 2024-09-14T12:01:17.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.667+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_._At1VCq2Sx0oZx_PmDXJQTaYlb7H_A0_0 2024-09-14T12:01:17.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.667+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3888681629170519757', time=2024-09-14T13:32:54.958000+0000, chain.objs.size()=1 2024-09-14T12:01:17.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.667+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.8yKWxqd1fXQCRhD9LuzqUN8XExfUiJi_0 2024-09-14T12:01:17.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.667+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16714037722591566553', time=2024-09-14T13:32:55.174021+0000, chain.objs.size()=1 2024-09-14T12:01:17.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.667+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.mmQ-J2cemiDykQ1_Y4FFPpSja4M8Jbg_0 2024-09-14T12:01:17.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.667+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18058924089228179807', time=2024-09-14T13:32:55.421516+0000, chain.objs.size()=1 2024-09-14T12:01:17.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.667+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.W7TbPvMDt0wKzCm4RboU3m1TvRF3lRd_0 2024-09-14T12:01:17.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.667+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2644793542442445618', time=2024-09-14T13:32:55.548705+0000, chain.objs.size()=1 2024-09-14T12:01:17.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.667+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ehiQSwzGRaDYSvLyL6fu4ib57c58zBU_0 2024-09-14T12:01:17.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.668+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17387459438113846434', time=2024-09-14T13:32:55.750102+0000, chain.objs.size()=1 2024-09-14T12:01:17.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.668+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Uu3dkisd6poR4AEhIjyhzVfVN-MXlIn_0 2024-09-14T12:01:17.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.668+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11483911482810649253', time=2024-09-14T13:32:55.860677+0000, chain.objs.size()=1 2024-09-14T12:01:17.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.668+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.XfwxAkmieI0t1HWA0oRrN7jNlUFwf2w_0 2024-09-14T12:01:17.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.669+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3800164615453054747', time=2024-09-14T13:32:56.594004+0000, chain.objs.size()=1 2024-09-14T12:01:17.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.669+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.EkMw_TY3ETcuJNzvHVrYWuOGYLHio6J_0 2024-09-14T12:01:17.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.670+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13981871996775733802', time=2024-09-14T13:32:56.693651+0000, chain.objs.size()=1 2024-09-14T12:01:17.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.670+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.cT3Iiz9AGao3YLnu3jtiZ5ABDDb5ADH_0 2024-09-14T12:01:17.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.671+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16597672184992955403', time=2024-09-14T13:32:56.765642+0000, chain.objs.size()=1 2024-09-14T12:01:17.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.671+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.kRByV-KdvW7Hx8uaXGs1wvJ-tRwlh3U_0 2024-09-14T12:01:17.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.671+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14380119360835078145', time=2024-09-14T13:32:57.122259+0000, chain.objs.size()=1 2024-09-14T12:01:17.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.671+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.pJW5cBXuzjcnIi_bLGbvw-7NlugKvNb_0 2024-09-14T12:01:17.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.671+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.568112427239095208', time=2024-09-14T13:32:57.224071+0000, chain.objs.size()=1 2024-09-14T12:01:17.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.671+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.lqVN4BOjHgt8LkiwlAgdKm-xzdUGAH1_0 2024-09-14T12:01:17.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.671+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14343209705754479196', time=2024-09-14T13:32:58.003675+0000, chain.objs.size()=1 2024-09-14T12:01:17.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.671+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.qf7zgUcvMK4tlpMjDf16FoWfiE23sOM_0 2024-09-14T12:01:17.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.672+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10365324221354076467', time=2024-09-14T13:32:58.162021+0000, chain.objs.size()=1 2024-09-14T12:01:17.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.672+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.notcmI_CINo-pbj8R_Tvl0VeZ_-EI3-_0 2024-09-14T12:01:17.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.672+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7886934214028461618', time=2024-09-14T13:32:58.320423+0000, chain.objs.size()=1 2024-09-14T12:01:17.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.672+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.d70r7lO3_mD1IPVaWUiCTiPFU1L-GI-_0 2024-09-14T12:01:17.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.672+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6576454251389236179', time=2024-09-14T13:32:58.438341+0000, chain.objs.size()=1 2024-09-14T12:01:17.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.672+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.hN_9sMwwjrXKdvsi34P7W5w4AsbsDJS_0 2024-09-14T12:01:17.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.672+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3586639811490935658', time=2024-09-14T13:32:58.470223+0000, chain.objs.size()=1 2024-09-14T12:01:17.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.672+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.uMgKNEMmNBtdIgsFjsDp93Tf8ovyiQU_0 2024-09-14T12:01:17.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.672+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4944927938175395509', time=2024-09-14T13:33:09.518556+0000, chain.objs.size()=1 2024-09-14T12:01:17.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.672+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.273__shadow_.sEUcvbcrsd-YIzVv0ZFo8OUPUGozGDi_0 2024-09-14T12:01:17.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.672+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1947122649090994614', time=2024-09-14T13:33:10.557908+0000, chain.objs.size()=1 2024-09-14T12:01:17.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.672+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.274__shadow_.oR7xH9Cq4AbXR3AdUDNlVkQsd1XhqJv_0 2024-09-14T12:01:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.674+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17345637019261649085', time=2024-09-14T13:33:24.927607+0000, chain.objs.size()=1 2024-09-14T12:01:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.674+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.287__shadow_.DV9RtcMOzf5YGKhBjxflo_dVX9AK4tV_0 2024-09-14T12:01:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.674+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17718712465349609588', time=2024-09-14T13:33:33.151623+0000, chain.objs.size()=1 2024-09-14T12:01:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.674+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.9ywODB0YwFaMR42gMQlv2BpVdprSYrZ_0 2024-09-14T12:01:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.674+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.988799592620834688', time=2024-09-14T13:33:36.747749+0000, chain.objs.size()=1 2024-09-14T12:01:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.674+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.295__shadow_.As53Z20rq7rJD_UKRCnC59p4vjrV8BK_0 2024-09-14T12:01:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.674+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7277950470117864549', time=2024-09-14T13:33:38.949641+0000, chain.objs.size()=1 2024-09-14T12:01:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.674+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.297__shadow_.aav8gE4bjG4uvs9hk2rdOUXNkcamB_w_0 2024-09-14T12:01:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.674+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12317987415171645842', time=2024-09-14T13:33:41.190196+0000, chain.objs.size()=1 2024-09-14T12:01:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.674+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.299__shadow_.pbnrnyu04e4AoGknZsNH6b3r59621pE_0 2024-09-14T12:01:17.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.675+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2372361604893170918', time=2024-09-14T13:33:42.357347+0000, chain.objs.size()=1 2024-09-14T12:01:17.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.675+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.300__shadow_.iAyAYsCAIMj8u2Qx44XbOA9C2X06Xiy_0 2024-09-14T12:01:17.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.676+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15560912909284924436', time=2024-09-14T13:33:44.532234+0000, chain.objs.size()=1 2024-09-14T12:01:17.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.676+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.302__shadow_.LivT0-juZeq1LhiSEwzsXYJ_VT2c80n_0 2024-09-14T12:01:17.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.676+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3614609280450111111', time=2024-09-14T13:33:46.927665+0000, chain.objs.size()=1 2024-09-14T12:01:17.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.676+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.304__shadow_.pPxRulk0S9PBNkMOcms0s0HHT6UE4h8_0 2024-09-14T12:01:17.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.676+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8002865623672962941', time=2024-09-14T13:34:09.096956+0000, chain.objs.size()=1 2024-09-14T12:01:17.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.676+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.320__shadow:5guvLkSOH-ALZuLRkGMnlUy-RZuwc5Q_.NJPITPJR2G6ZC9i9t-5Fk7E0Vm_aYUc_0 2024-09-14T12:01:17.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.676+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.767812800114208241', time=2024-09-14T13:34:51.856267+0000, chain.objs.size()=1 2024-09-14T12:01:17.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.676+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.dviE5BDRbPu_8zIkt8GppdPEqYVK5j2_0 2024-09-14T12:01:17.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.676+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17825160124295509514', time=2024-09-14T13:34:52.340723+0000, chain.objs.size()=1 2024-09-14T12:01:17.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.676+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.dW7EUQsgV1o4V_mQ7GAPeToRaMJYY6d_0 2024-09-14T12:01:17.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.679+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17762428285958841066', time=2024-09-14T13:34:53.157716+0000, chain.objs.size()=1 2024-09-14T12:01:17.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.679+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ZJM5OSXACRwJkgyeZSPq4LYET2zXAPx_0 2024-09-14T12:01:17.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.679+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13874363921433579329', time=2024-09-14T13:34:53.158491+0000, chain.objs.size()=1 2024-09-14T12:01:17.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.679+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ntPS5_Kh1ChKmiXiJfxTfJlSNMTZRck_0 2024-09-14T12:01:17.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.679+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14122749424523950183', time=2024-09-14T13:34:53.354312+0000, chain.objs.size()=1 2024-09-14T12:01:17.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.679+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.xHrK4QUrAWgCYgGMjitZ0JA5T5Cgnbx_0 2024-09-14T12:01:17.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.679+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12250103471990341273', time=2024-09-14T13:34:53.355086+0000, chain.objs.size()=1 2024-09-14T12:01:17.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.679+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.pGgInpIe1HqSj0WqE9L-QAWRcJeXvnW_0 2024-09-14T12:01:17.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.679+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8979455840840076948', time=2024-09-14T13:34:53.501866+0000, chain.objs.size()=1 2024-09-14T12:01:17.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.679+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.0p4Qv7cNCBBylzYYzvaBr_CsJoiQ-Lp_0 2024-09-14T12:01:17.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.679+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8402385783333378525', time=2024-09-14T13:34:54.034164+0000, chain.objs.size()=1 2024-09-14T12:01:17.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.679+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Zk-er7vPT_MhVbSbyeJTajF7hCiZmj__0 2024-09-14T12:01:17.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.679+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8323952035868545693', time=2024-09-14T13:34:54.072443+0000, chain.objs.size()=1 2024-09-14T12:01:17.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.679+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.O7VNiAVvTWXPjYofrB1VlsKo_NbhNnW_0 2024-09-14T12:01:17.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.679+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13258500485873806304', time=2024-09-14T13:34:54.170149+0000, chain.objs.size()=1 2024-09-14T12:01:17.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.679+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.tPukIU5qvbQp8SrEtIAuLX0yx-TKsRg_0 2024-09-14T12:01:17.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.679+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18210457057739762424', time=2024-09-14T13:34:54.892300+0000, chain.objs.size()=1 2024-09-14T12:01:17.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.679+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ZNiG-yji-DkINsho6OGB2jHrmMrOBcu_0 2024-09-14T12:01:17.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.679+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1246854686804042265', time=2024-09-14T13:34:55.021805+0000, chain.objs.size()=1 2024-09-14T12:01:17.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.679+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.nI3E0nI_vFi3ZkyvyQkd2gqYQblf_19_0 2024-09-14T12:01:17.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.681+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17201109575188252346', time=2024-09-14T13:34:55.214717+0000, chain.objs.size()=1 2024-09-14T12:01:17.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.681+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ff0yxGWwyM2QMJKEh6gyzFeL-m7Wq4n_0 2024-09-14T12:01:17.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.682+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.971751836368689362', time=2024-09-14T13:34:55.292258+0000, chain.objs.size()=1 2024-09-14T12:01:17.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.682+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.WfomB5z9ztZOUvEhT3vEWOWuBmbFUgG_0 2024-09-14T12:01:17.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.683+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1914047976697093366', time=2024-09-14T13:34:55.539437+0000, chain.objs.size()=1 2024-09-14T12:01:17.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.683+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.uZa4BN0cjjG4KfTnRFbzlPNmFlwU1ZZ_0 2024-09-14T12:01:17.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.683+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15775534802508533953', time=2024-09-14T13:34:56.364968+0000, chain.objs.size()=1 2024-09-14T12:01:17.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.683+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.-qLI382PBSyf1mrDymZtdaPGezIAgba_0 2024-09-14T12:01:17.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.683+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1336003731379846511', time=2024-09-14T13:34:56.706580+0000, chain.objs.size()=1 2024-09-14T12:01:17.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.683+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.FxsQBNZm3P6sFRejl44BkTLQT9hiqJl_0 2024-09-14T12:01:17.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.683+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13323096958051440493', time=2024-09-14T13:34:56.822349+0000, chain.objs.size()=1 2024-09-14T12:01:17.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.683+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.iEI7369vHqGmyDD-VW3huXeNaFWOopR_0 2024-09-14T12:01:17.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.683+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8104739755198840777', time=2024-09-14T13:34:56.979066+0000, chain.objs.size()=1 2024-09-14T12:01:17.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.683+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.-zT1V_xcuyucb-bkkp5hpBQCCqDpFpc_0 2024-09-14T12:01:17.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.683+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12474944020632642353', time=2024-09-14T13:34:57.641049+0000, chain.objs.size()=1 2024-09-14T12:01:17.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.683+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.lzNd1l67DDUguHuSeJyQYBg2LCH6qm3_0 2024-09-14T12:01:17.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.684+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1358587934927719080', time=2024-09-14T13:34:57.675463+0000, chain.objs.size()=1 2024-09-14T12:01:17.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.684+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.bELPpCBIzAnt875By8VsHrdmlLjdkA8_0 2024-09-14T12:01:17.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.684+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15279370768003362230', time=2024-09-14T13:34:57.931528+0000, chain.objs.size()=1 2024-09-14T12:01:17.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.684+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.JDJ-vp2spZ4gS2HDIH7ouGXmmbkpcDV_0 2024-09-14T12:01:17.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.684+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12251328000371230886', time=2024-09-14T13:34:57.982090+0000, chain.objs.size()=1 2024-09-14T12:01:17.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.684+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.lu-jcdBbJJ-nSu98iU7FEYXMyvDlj7-_0 2024-09-14T12:01:17.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.684+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15827942777231834721', time=2024-09-14T13:34:58.021249+0000, chain.objs.size()=1 2024-09-14T12:01:17.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.684+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.UOlO8TmFnh-q4KbOpAxLepWiZAHVScd_0 2024-09-14T12:01:17.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.687+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1034733710330634665', time=2024-09-14T13:34:59.181609+0000, chain.objs.size()=1 2024-09-14T12:01:17.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.687+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.8NP4k-r1c5u7v-Q2uWgh4z4ytPYA6KK_0 2024-09-14T12:01:17.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.687+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7002147446487264655', time=2024-09-14T13:34:59.766904+0000, chain.objs.size()=1 2024-09-14T12:01:17.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.687+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.6jkZORbN7m-CI40ikwUjuRdhELHN4u0_0 2024-09-14T12:01:17.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.687+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7845362009044045111', time=2024-09-14T13:34:59.917105+0000, chain.objs.size()=1 2024-09-14T12:01:17.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.687+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.9MjEoOHYUOw2hg3MXVkiOLg1lUk9BJQ_0 2024-09-14T12:01:17.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.687+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16885924657447917754', time=2024-09-14T13:35:00.610222+0000, chain.objs.size()=1 2024-09-14T12:01:17.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.687+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.zTIGtPPnTiy5gNRzOimX_bUt674V6SG_0 2024-09-14T12:01:17.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.687+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15159427408749816482', time=2024-09-14T13:35:01.026213+0000, chain.objs.size()=1 2024-09-14T12:01:17.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.687+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.2K6Cl1Nr_onCe4SwI-Iz1DK0c_uySmJ_0 2024-09-14T12:01:17.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.687+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7821087795654592914', time=2024-09-14T13:35:01.026806+0000, chain.objs.size()=1 2024-09-14T12:01:17.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.687+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.IyiJ9HTgkwByshsB2hSnrOyQHftIPN7_0 2024-09-14T12:01:17.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.687+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.803916343654696450', time=2024-09-14T13:35:01.191406+0000, chain.objs.size()=1 2024-09-14T12:01:17.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.687+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.pLs9OxooilwmEgekMcoXrdj_TKg4p9T_0 2024-09-14T12:01:17.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.688+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9366614526179687674', time=2024-09-14T13:35:01.450951+0000, chain.objs.size()=1 2024-09-14T12:01:17.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.688+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.y7orfxdZcbmgbKpWgT9rgKBtECtG9Tm_0 2024-09-14T12:01:17.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.689+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15241921662956453328', time=2024-09-14T13:35:01.520827+0000, chain.objs.size()=1 2024-09-14T12:01:17.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.689+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.C8s7zQtyHlaBA67_WMcduUIrG75iR5e_0 2024-09-14T12:01:17.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.689+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5651277443503075991', time=2024-09-14T13:35:01.804677+0000, chain.objs.size()=1 2024-09-14T12:01:17.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.689+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.8uvO3Kc1fJcyxnUeUw2v82lB5RlTyR4_0 2024-09-14T12:01:17.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.690+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9137629471315363484', time=2024-09-14T13:35:02.325312+0000, chain.objs.size()=1 2024-09-14T12:01:17.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.690+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ekZ9ZJL57aTmIj9dUCyvi8Bu3Qo3WcH_0 2024-09-14T12:01:17.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.690+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13750111858073357285', time=2024-09-14T13:35:02.599465+0000, chain.objs.size()=1 2024-09-14T12:01:17.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.690+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.iiam0sQMrcgXhRc8wmegZ-R3v32uxpQ_0 2024-09-14T12:01:17.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.691+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14114182467538790340', time=2024-09-14T13:35:02.639105+0000, chain.objs.size()=1 2024-09-14T12:01:17.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.691+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.YxikJYovUJEc823zlF-QullkqbbxZ6I_0 2024-09-14T12:01:17.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.691+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5734980021052167306', time=2024-09-14T13:35:41.954032+0000, chain.objs.size()=1 2024-09-14T12:01:17.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.691+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.VqkOqAEmnSlDoWm8HRDqKCYhNU0mIuS_0 2024-09-14T12:01:17.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.691+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10614149749434801086', time=2024-09-14T13:35:41.955024+0000, chain.objs.size()=1 2024-09-14T12:01:17.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.691+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ak3Bvqx5xuhgql-wx8K9-XBbwwG0jrK_0 2024-09-14T12:01:17.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.691+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17291525325053843125', time=2024-09-14T13:35:42.075626+0000, chain.objs.size()=1 2024-09-14T12:01:17.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.691+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.OR-kq_X53HUVAVCxF-NFAJcW365OJyK_0 2024-09-14T12:01:17.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.691+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5379398648383016378', time=2024-09-14T13:35:42.468768+0000, chain.objs.size()=1 2024-09-14T12:01:17.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.691+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.IXO3PmNzKOvXbNnWlowcXC_CNAjtvMq_0 2024-09-14T12:01:17.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.691+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4799502226874965247', time=2024-09-14T13:35:42.678565+0000, chain.objs.size()=1 2024-09-14T12:01:17.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.691+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.omTOl5Z9dRm5LyJqKVK6KOng6VjYt1Y_0 2024-09-14T12:01:17.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.692+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2648886809303643341', time=2024-09-14T13:35:43.377510+0000, chain.objs.size()=1 2024-09-14T12:01:17.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.692+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.w3xDMW2dddKCvkERR3FZ3MxZKQUOf7k_0 2024-09-14T12:01:17.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.693+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8953591734080130371', time=2024-09-14T13:35:43.874563+0000, chain.objs.size()=1 2024-09-14T12:01:17.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.693+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.LJ93Y5Ggl8-TZt5zm-gBQMCk2yk2DSG_0 2024-09-14T12:01:17.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.694+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17588883225200102316', time=2024-09-14T13:35:44.298521+0000, chain.objs.size()=1 2024-09-14T12:01:17.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.694+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.PbOxEZ7Z64Rh60v9TVrHH07C4zQ7Tlz_0 2024-09-14T12:01:17.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.695+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6271710669832066079', time=2024-09-14T13:35:45.158400+0000, chain.objs.size()=1 2024-09-14T12:01:17.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.695+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.GZ8jh3_T-zXJVA5N_A1JUpMnJ_DSyuL_0 2024-09-14T12:01:17.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.695+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11158812762373463231', time=2024-09-14T13:35:45.237104+0000, chain.objs.size()=1 2024-09-14T12:01:17.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.695+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.x-pD2Q6ys4nV_oweH2JWhJTyICgxD9K_0 2024-09-14T12:01:17.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.695+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9926194839628456158', time=2024-09-14T13:35:45.483960+0000, chain.objs.size()=1 2024-09-14T12:01:17.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.695+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.zsvjD1_ATFIar_DZdJvTj-H2Osz-Xcg_0 2024-09-14T12:01:17.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.695+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14785058714266470366', time=2024-09-14T13:35:45.689532+0000, chain.objs.size()=1 2024-09-14T12:01:17.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.695+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.MlJLOOgU0BuNAnwm9xYYEoArqO1tvhQ_0 2024-09-14T12:01:17.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.696+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2701359808193160496', time=2024-09-14T13:35:46.740313+0000, chain.objs.size()=1 2024-09-14T12:01:17.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.696+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.8BtUqEnIxJ4E9lwjq2vGgBMwKhHbjEA_0 2024-09-14T12:01:17.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.696+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7254321191916973665', time=2024-09-14T13:35:47.232459+0000, chain.objs.size()=1 2024-09-14T12:01:17.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.696+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.dzT5G4VKO7_OSvus8-6XdHdmj-foDtY_0 2024-09-14T12:01:17.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.696+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3284532278149989306', time=2024-09-14T13:35:47.751359+0000, chain.objs.size()=1 2024-09-14T12:01:17.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.696+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.fFpgz0ANkry9EvruaNKxZl_VjBQw9iF_0 2024-09-14T12:01:17.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.696+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4793886734382580786', time=2024-09-14T13:35:47.947270+0000, chain.objs.size()=1 2024-09-14T12:01:17.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.696+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.AFpdvMrqT51vxGFbtKklUD-qN9N5ATd_0 2024-09-14T12:01:17.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.696+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10956952734192651770', time=2024-09-14T13:35:48.226207+0000, chain.objs.size()=1 2024-09-14T12:01:17.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.696+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_._-r5lvEai0WkR456fDGUDJDLviieelC_0 2024-09-14T12:01:17.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.696+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10476600030406242946', time=2024-09-14T13:35:49.241956+0000, chain.objs.size()=1 2024-09-14T12:01:17.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.696+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.D7F-rUGLpVgT5NshjWD8zLgDIjQ-zGh_0 2024-09-14T12:01:17.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.702+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/47247 2024-09-14T12:01:17.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-14T12:01:17.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3397913668446430867', time=2024-09-14T13:35:49.381189+0000, chain.objs.size()=1 2024-09-14T12:01:17.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.pD83oJrcSJBL-pulnZ2ZGxvlcRvG-63_0 2024-09-14T12:01:17.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2978196825374424419', time=2024-09-14T13:35:49.406599+0000, chain.objs.size()=1 2024-09-14T12:01:17.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.RxOpFqZcS7dzIwXsTMhJyFvLIiN6l2d_0 2024-09-14T12:01:17.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2628994705881335079', time=2024-09-14T13:35:49.497603+0000, chain.objs.size()=1 2024-09-14T12:01:17.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.3BgMcw1bzDsa1nQkhEeWbwH6zYwVW3f_0 2024-09-14T12:01:17.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13201255519784890788', time=2024-09-14T13:35:50.722804+0000, chain.objs.size()=1 2024-09-14T12:01:17.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.vumOn_my1lrSqsxt-16304m-N962mY__0 2024-09-14T12:01:17.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6949168906663573611', time=2024-09-14T13:35:50.787227+0000, chain.objs.size()=1 2024-09-14T12:01:17.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.FNGTjt_v371YGbt2PRjOY8-Ilx-gccm_0 2024-09-14T12:01:17.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6196649009183752733', time=2024-09-14T13:35:50.886106+0000, chain.objs.size()=1 2024-09-14T12:01:17.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.tQm_DVZB2IDb7271W_-8_MtjmrzWZD4_0 2024-09-14T12:01:17.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17009034222649553878', time=2024-09-14T13:35:51.040279+0000, chain.objs.size()=1 2024-09-14T12:01:17.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Lk3xFAtOggQnNXg2wOGH90v1tIe3ipy_0 2024-09-14T12:01:17.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18376468351898835938', time=2024-09-14T13:35:51.210503+0000, chain.objs.size()=1 2024-09-14T12:01:17.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.uelmeYLOkKHNeQDb_7K4EfhwLATjAB7_0 2024-09-14T12:01:17.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1272610361971082354', time=2024-09-14T13:35:51.963261+0000, chain.objs.size()=1 2024-09-14T12:01:17.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.N85kIAxO5dxGa4VRdvzvvcKKaguedlz_0 2024-09-14T12:01:17.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14004900219664769104', time=2024-09-14T13:35:52.086741+0000, chain.objs.size()=1 2024-09-14T12:01:17.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.BSc5D3P8XgKUidUOjMPj8VG7jb_0Re0_0 2024-09-14T12:01:17.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6326940853143376612', time=2024-09-14T13:35:52.351315+0000, chain.objs.size()=1 2024-09-14T12:01:17.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ajGJtkWtiy_QbZeoRtMZDrqMbJjcWKI_0 2024-09-14T12:01:17.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12268094900071614707', time=2024-09-14T13:35:52.474278+0000, chain.objs.size()=1 2024-09-14T12:01:17.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.704+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.we3eR0rAn2ynKGwZEpL__oTlZ-FIYRI_0 2024-09-14T12:01:17.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.707+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18151526477742677765', time=2024-09-14T13:35:52.691822+0000, chain.objs.size()=1 2024-09-14T12:01:17.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.707+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.-neIRcMvvi8pXnS71aGtLf3koKmzx9B_0 2024-09-14T12:01:17.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.707+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11838037825137771007', time=2024-09-14T13:36:44.467473+0000, chain.objs.size()=1 2024-09-14T12:01:17.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.707+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.376__shadow_.vBPb3yB-Hhw8kIm2Qr1CIe8OZdOrhov_0 2024-09-14T12:01:17.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.707+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3688166438788476328', time=2024-09-14T13:36:50.730379+0000, chain.objs.size()=1 2024-09-14T12:01:17.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.707+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.382__shadow_.JzTAmbjT4qIZI9SZnIx7z6nZ7sqUhK1_0 2024-09-14T12:01:17.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.708+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14647758599215564416', time=2024-09-14T13:38:22.505194+0000, chain.objs.size()=1 2024-09-14T12:01:17.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.708+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.462__shadow_.f8TaT0FK5jcO8AqFqadqYEE9JbvaRdr_0 2024-09-14T12:01:17.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.708+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9034881992157725543', time=2024-09-14T13:38:28.372369+0000, chain.objs.size()=1 2024-09-14T12:01:17.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.708+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.466__shadow_.02k7jw_uQLiRhhqdAYK0X3EXThh1wDC_0 2024-09-14T12:01:17.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.708+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.733702927274371572', time=2024-09-14T13:42:46.645496+0000, chain.objs.size()=1 2024-09-14T12:01:17.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.708+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.524__multipart_mymultipart.2~DINs-jqDgGkXE7mgoLjWGNh0DvR3Rzs.1 2024-09-14T12:01:17.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.708+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4083827628182134201', time=2024-09-14T13:43:18.969770+0000, chain.objs.size()=1 2024-09-14T12:01:17.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.708+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.525__shadow_.gBJpjXEDNn2xvLAtscQqnU0Qarw4e97_0 2024-09-14T12:01:17.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.708+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6363275027495031562', time=2024-09-14T13:46:08.211753+0000, chain.objs.size()=1 2024-09-14T12:01:17.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.708+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:-nTuKbSk.GyrgdGH3uS5tlVaCC0VzH6_.G78ltC2FFRlRyMUnOqkxVD8w8dguDfE_0 2024-09-14T12:01:17.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.709+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17375244440503922993', time=2024-09-14T13:47:21.999851+0000, chain.objs.size()=1 2024-09-14T12:01:17.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.709+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.588__shadow:n.cKER9JmZd6tTfER1f2bFozUdviQ3w_.vzTWEpn-TKu0qFMu8zjICeoyrWt9yrY_0 2024-09-14T12:01:17.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.709+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.502206913947760850', time=2024-09-14T13:47:39.775412+0000, chain.objs.size()=1 2024-09-14T12:01:17.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.709+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.606__shadow_.Z5ZjnzhuMzTkXkmjRwlrs5weWF4nvb-_0 2024-09-14T12:01:17.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.709+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15626037320826457304', time=2024-09-14T13:52:47.406615+0000, chain.objs.size()=1 2024-09-14T12:01:17.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.709+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.635__shadow_.tVzViSLYuvtFaC7_eU8x8R6zOIW6N6h_0 2024-09-14T12:01:17.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.712+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4589980337987451199', time=2024-09-14T13:53:59.325004+0000, chain.objs.size()=1 2024-09-14T12:01:17.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.712+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.667__shadow_.YiXPLiie8J4-mvPB8mrx5XLWjUC_jJG_0 2024-09-14T12:01:17.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.712+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5560940143976533755', time=2024-09-14T13:57:15.424891+0000, chain.objs.size()=1 2024-09-14T12:01:17.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.712+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.760__shadow_.4YmaV-C0tDrywd89q2hvpqfho-eMHeL_0 2024-09-14T12:01:17.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.712+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4264692470005365843', time=2024-09-14T13:57:44.874687+0000, chain.objs.size()=1 2024-09-14T12:01:17.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.712+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.763__shadow_.lYzpBk8VkGWteHnA2jKkMB6EiQncr4m_0 2024-09-14T12:01:17.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.714+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:17.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.717+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T12:01:17.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.718+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:17.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.718+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:17.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.719+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49965' 2024-09-14T12:01:17.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.719+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.394672600445071623', time=2024-09-14T13:28:58.354113+0000, chain.objs.size()=1 2024-09-14T12:01:17.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.719+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.178__shadow_.DZpA7ZyzoBNiXJQtSuYKt0tCGQHBeBa_0 2024-09-14T12:01:17.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.719+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4751811120931940219', time=2024-09-14T13:29:29.538233+0000, chain.objs.size()=1 2024-09-14T12:01:17.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.719+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.198__shadow_.HxIx0zwhEa5WTtMIr5L0RYk1HWCsOCx_0 2024-09-14T12:01:17.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.719+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16470083837943783096', time=2024-09-14T13:32:08.252399+0000, chain.objs.size()=1 2024-09-14T12:01:17.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.719+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.261__shadow_.840q30EmR2ED_s3NJpW5Xzd-6AuTCbH_0 2024-09-14T12:01:17.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.719+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15295236357468570627', time=2024-09-14T13:32:47.487650+0000, chain.objs.size()=1 2024-09-14T12:01:17.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.719+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.KnKLF0PeuwBMD4fklP6lBQJgnH3GriZ_0 2024-09-14T12:01:17.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.719+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18089095852114548003', time=2024-09-14T13:32:48.247287+0000, chain.objs.size()=1 2024-09-14T12:01:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.719+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.zMm7isj-Fm_mS9ixJTRHS0BeTQvXgXr_0 2024-09-14T12:01:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.719+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14904673310528149085', time=2024-09-14T13:32:48.248356+0000, chain.objs.size()=1 2024-09-14T12:01:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.719+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.v_fexe0M8KfClQjra1vDamvPjEy0WUR_0 2024-09-14T12:01:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.719+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17407748348079891836', time=2024-09-14T13:32:48.293418+0000, chain.objs.size()=1 2024-09-14T12:01:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.719+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.p1esEFKkN5hQdSetd1i6vP3LkXmRg3u_0 2024-09-14T12:01:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.719+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2519642964892654763', time=2024-09-14T13:32:48.294137+0000, chain.objs.size()=1 2024-09-14T12:01:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.719+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Hz7GLnd2RQOhDlxY4YhI7gdOPwMtruz_0 2024-09-14T12:01:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.719+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16159777620322878224', time=2024-09-14T13:32:49.592954+0000, chain.objs.size()=1 2024-09-14T12:01:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.719+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Dx816cUKt1KGQzLT_aJDyIVMLPo12FT_0 2024-09-14T12:01:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.719+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2048592408429022585', time=2024-09-14T13:32:49.656585+0000, chain.objs.size()=1 2024-09-14T12:01:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.720+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.P36SimHk10Eu5szqG3Jy25SLUYQUKa0_0 2024-09-14T12:01:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.720+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6484252784029343309', time=2024-09-14T13:32:49.985526+0000, chain.objs.size()=1 2024-09-14T12:01:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.720+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.IKxQE03jndsOQYcsN8ispKjj_GJPO8d_0 2024-09-14T12:01:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.720+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3561563942624812696', time=2024-09-14T13:32:50.568965+0000, chain.objs.size()=1 2024-09-14T12:01:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.720+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.U01IZ0Diusf8A2v0xYQhNIaadawoXpE_0 2024-09-14T12:01:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.722+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15808997876129382493', time=2024-09-14T13:32:50.569654+0000, chain.objs.size()=1 2024-09-14T12:01:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.722+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.jiE-XEY3xQsA3q-rIvI7-t_h_5hY9RT_0 2024-09-14T12:01:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.722+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10449252230615737810', time=2024-09-14T13:32:50.833189+0000, chain.objs.size()=1 2024-09-14T12:01:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.722+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.tHX6QOFZYtDaQ_PA9icQ4iXm3ZhoBaQ_0 2024-09-14T12:01:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.722+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17163703557590432436', time=2024-09-14T13:32:51.032080+0000, chain.objs.size()=1 2024-09-14T12:01:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.722+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.wIPBjki3WzF47YaZDNY0KKkDWE0DBec_0 2024-09-14T12:01:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.722+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13634640541810926206', time=2024-09-14T13:32:51.573350+0000, chain.objs.size()=1 2024-09-14T12:01:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.722+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.6L7Jjq8ugL0FWrT26XGqnKrdJlZn4jb_0 2024-09-14T12:01:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.722+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14185103010720812217', time=2024-09-14T13:32:52.648857+0000, chain.objs.size()=1 2024-09-14T12:01:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.722+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.2svJV_tm0If4MrNZAMOKzVtvo3JtmNw_0 2024-09-14T12:01:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.722+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17844460136072903434', time=2024-09-14T13:32:52.796679+0000, chain.objs.size()=1 2024-09-14T12:01:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.722+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.HCwdxrjTkIlkxfNSOgJtvDtfBxWv0Rb_0 2024-09-14T12:01:17.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.725+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10947768091652161925', time=2024-09-14T13:32:53.101189+0000, chain.objs.size()=1 2024-09-14T12:01:17.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.725+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.IVI_dniye_1l6p5Aye7XKaHkVEqL2MQ_0 2024-09-14T12:01:17.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.726+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11832521094043719563', time=2024-09-14T13:32:53.102337+0000, chain.objs.size()=1 2024-09-14T12:01:17.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.726+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.AIXB-4w2f55yAIdyQdQti0OqSN_8FKg_0 2024-09-14T12:01:17.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.726+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15804466830563321649', time=2024-09-14T13:32:53.545988+0000, chain.objs.size()=1 2024-09-14T12:01:17.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.726+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.GHpxs4HZPZp4pga2_aRih4hOwW3mZzs_0 2024-09-14T12:01:17.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.726+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.440657107105483986', time=2024-09-14T13:32:53.695799+0000, chain.objs.size()=1 2024-09-14T12:01:17.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.726+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.xjwt78VzdTvwOBOxQoQTpk9c0I0qwcG_0 2024-09-14T12:01:17.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.726+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14426867905206709266', time=2024-09-14T13:32:53.819253+0000, chain.objs.size()=1 2024-09-14T12:01:17.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.726+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.FlGLmvBqcu-mlN31SHrWW89FDQFaT3v_0 2024-09-14T12:01:17.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.728+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1144085247306755140', time=2024-09-14T13:32:54.925188+0000, chain.objs.size()=1 2024-09-14T12:01:17.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.728+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.L5LHC02K6EnddS20yl6OppjQ7u9-0x9_0 2024-09-14T12:01:17.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.728+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16034828819768150796', time=2024-09-14T13:32:54.984539+0000, chain.objs.size()=1 2024-09-14T12:01:17.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.728+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.cXAiF5ZzAo9fHG04I8nz_00Nabjlkd-_0 2024-09-14T12:01:17.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.728+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2104109295935828142', time=2024-09-14T13:32:55.291871+0000, chain.objs.size()=1 2024-09-14T12:01:17.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.728+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.1PmeoI7PYqwV0MyCHGzMZeRqZQjw5rf_0 2024-09-14T12:01:17.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.728+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13627674975913669299', time=2024-09-14T13:32:55.589497+0000, chain.objs.size()=1 2024-09-14T12:01:17.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.728+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.GCMyEHc3cGj9vpSWX4byGaF7d-mYV11_0 2024-09-14T12:01:17.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.728+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6432904652319676137', time=2024-09-14T13:32:56.709941+0000, chain.objs.size()=1 2024-09-14T12:01:17.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.728+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.iPQM1yH8hcNpulNdHEJe4AuSpnTRVf9_0 2024-09-14T12:01:17.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.729+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16793470259632154191', time=2024-09-14T13:32:56.724294+0000, chain.objs.size()=1 2024-09-14T12:01:17.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.729+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.uXpZpdNr9_SGJ9VawAtJSuLk_VTfktH_0 2024-09-14T12:01:17.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.731+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11721497339267255759', time=2024-09-14T13:32:56.724884+0000, chain.objs.size()=1 2024-09-14T12:01:17.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.731+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.pTWN7AQKUrHcLiyKMJ7eS9AFNZfqN9X_0 2024-09-14T12:01:17.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.731+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.79348017865275723', time=2024-09-14T13:32:56.991692+0000, chain.objs.size()=1 2024-09-14T12:01:17.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.731+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.lEMfXQfKRl0eZjSa7oXty-QvlOd51ec_0 2024-09-14T12:01:17.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.731+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13378357820554205778', time=2024-09-14T13:32:58.105782+0000, chain.objs.size()=1 2024-09-14T12:01:17.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.731+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.vCL1rud91LX4zx9A-jyOJZzrOm8VpEc_0 2024-09-14T12:01:17.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.731+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.139672617716519826', time=2024-09-14T13:32:58.194738+0000, chain.objs.size()=1 2024-09-14T12:01:17.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.731+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.19edRYFjTT7l9ao2NLz2sglCG2I-_sO_0 2024-09-14T12:01:17.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.731+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11267584800647325756', time=2024-09-14T13:32:58.731447+0000, chain.objs.size()=1 2024-09-14T12:01:17.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.731+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.6_3irDKNqcBNkf_EJb9unTsjdC8A1WT_0 2024-09-14T12:01:17.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.732+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10606764772404038761', time=2024-09-14T13:33:14.918821+0000, chain.objs.size()=1 2024-09-14T12:01:17.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.732+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.278__shadow_.5OLZjoyum3HaYPfmTQuO1PHGkUFEfPy_0 2024-09-14T12:01:17.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.732+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2344747914481578040', time=2024-09-14T13:33:17.086189+0000, chain.objs.size()=1 2024-09-14T12:01:17.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.732+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.280__shadow_.49-c5AXa9sIrQWddqBx847CZW25Wt2w_0 2024-09-14T12:01:17.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.733+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8434977412007851512', time=2024-09-14T13:33:19.267219+0000, chain.objs.size()=1 2024-09-14T12:01:17.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.733+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.282__shadow_.d4v_l3QMirMqj4lUq7ASrgw3W78AgUl_0 2024-09-14T12:01:17.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.733+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16757941670682982190', time=2024-09-14T13:33:26.007913+0000, chain.objs.size()=1 2024-09-14T12:01:17.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.733+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.288__shadow_.VwVCfbIiXM6qIx2p0i5aIqUwK-LMqRo_0 2024-09-14T12:01:17.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.733+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4724608470697070159', time=2024-09-14T13:33:33.161599+0000, chain.objs.size()=1 2024-09-14T12:01:17.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.733+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.4ysrc30-jokQAFiK30LBnjDfF95MET6_0 2024-09-14T12:01:17.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.733+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1349921696849099788', time=2024-09-14T13:33:33.247203+0000, chain.objs.size()=1 2024-09-14T12:01:17.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.733+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.kgzCTSnvletGdt7hp2DncnHjc08NADV_0 2024-09-14T12:01:17.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.734+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13589100389501764050', time=2024-09-14T13:33:35.538584+0000, chain.objs.size()=1 2024-09-14T12:01:17.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.734+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.eNhjkKQi7BkAp3Dg3uIL2edrA2o45Vf_0 2024-09-14T12:01:17.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.734+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8120660196120619700', time=2024-09-14T13:33:40.039504+0000, chain.objs.size()=1 2024-09-14T12:01:17.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.734+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.298__shadow_.ugatDw5tnlS5FBMEbjYaDSc-r1LyEH8_0 2024-09-14T12:01:17.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.734+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7490926757366744313', time=2024-09-14T13:33:41.183717+0000, chain.objs.size()=1 2024-09-14T12:01:17.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.734+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.299__shadow_.-QY1NmorC8nAT-xaQiGEpCsfDYFJU6a_0 2024-09-14T12:01:17.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.735+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5773018720200997323', time=2024-09-14T13:33:42.347297+0000, chain.objs.size()=1 2024-09-14T12:01:17.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.735+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.300__shadow_.ARrJbeUGk5fwJAE58bIAwiCKzm4Ki1-_0 2024-09-14T12:01:17.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.736+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15794289140863288320', time=2024-09-14T13:34:11.929902+0000, chain.objs.size()=1 2024-09-14T12:01:17.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.736+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.323__shadow_._3aqWYgDBMIxk1vKqIK9S9QLODc75X9_0 2024-09-14T12:01:17.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.736+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5121902978067865719', time=2024-09-14T13:34:51.666930+0000, chain.objs.size()=1 2024-09-14T12:01:17.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.736+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Z71E4VnzahxVY7Y8kFjldfNuFePHaut_0 2024-09-14T12:01:17.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.736+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16351569066859171927', time=2024-09-14T13:34:52.226062+0000, chain.objs.size()=1 2024-09-14T12:01:17.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.736+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.qjxb9rjZVlHxqaDsHq3Uf8Ew99E3FNF_0 2024-09-14T12:01:17.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.736+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11663014124417056413', time=2024-09-14T13:34:52.504460+0000, chain.objs.size()=1 2024-09-14T12:01:17.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.736+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.TsR7jOT7UP5sBRkfmqxHooE2c3Bj5z4_0 2024-09-14T12:01:17.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.736+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8970096080375113606', time=2024-09-14T13:34:53.270357+0000, chain.objs.size()=1 2024-09-14T12:01:17.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.736+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.zucZ8L3K7s9KTjxvAJ40Wz-oVnoQUYI_0 2024-09-14T12:01:17.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.739+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7244309209794411981', time=2024-09-14T13:34:53.654257+0000, chain.objs.size()=1 2024-09-14T12:01:17.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.739+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.gfj_yGrlbBMvOQh7xH_GKPGohA4_5kh_0 2024-09-14T12:01:17.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.739+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1726160593642069468', time=2024-09-14T13:34:53.757215+0000, chain.objs.size()=1 2024-09-14T12:01:17.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.739+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.T0IApmRv1EagGA5QUiw9rVySqpC0hn5_0 2024-09-14T12:01:17.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.739+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3222768088484989905', time=2024-09-14T13:34:53.757931+0000, chain.objs.size()=1 2024-09-14T12:01:17.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.739+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ovjdXV8qUCSFc3E4M34aJuh1QKV_9uB_0 2024-09-14T12:01:17.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.739+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16481252796672968019', time=2024-09-14T13:34:54.039934+0000, chain.objs.size()=1 2024-09-14T12:01:17.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.739+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.rVcmyZ2GhT3S-QcGGHFRdNVXSVOwDWQ_0 2024-09-14T12:01:17.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.739+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12064662854314096444', time=2024-09-14T13:34:54.180222+0000, chain.objs.size()=1 2024-09-14T12:01:17.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.739+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.zScZXnEvg8CPR0rRRxKRHkAEtiHrQ73_0 2024-09-14T12:01:17.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.740+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3386233922439448570', time=2024-09-14T13:34:54.758848+0000, chain.objs.size()=1 2024-09-14T12:01:17.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.740+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.J8Z06O63A7nyGmq5oDXof7Du7jMmTUl_0 2024-09-14T12:01:17.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.741+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7869268054955834988', time=2024-09-14T13:34:55.604452+0000, chain.objs.size()=1 2024-09-14T12:01:17.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.741+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.w0VTlvr5-4QzR-QzDZnFSG8rOymekxR_0 2024-09-14T12:01:17.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.741+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2316409949477154152', time=2024-09-14T13:34:56.345321+0000, chain.objs.size()=1 2024-09-14T12:01:17.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.741+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.L-t3vOKmrnF2eO9js8XvjlDpcC0sJ5A_0 2024-09-14T12:01:17.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.741+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7636278783631614433', time=2024-09-14T13:34:56.450468+0000, chain.objs.size()=1 2024-09-14T12:01:17.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.742+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ra0D2GwI-LXGiU4qPpB0Fns-OM16cZV_0 2024-09-14T12:01:17.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.742+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16595359563229972979', time=2024-09-14T13:34:56.776269+0000, chain.objs.size()=1 2024-09-14T12:01:17.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.742+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.qvn18QxT5V9PUPwhqW2nk5PqjEjUt8z_0 2024-09-14T12:01:17.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.742+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11452918481390996191', time=2024-09-14T13:34:56.814357+0000, chain.objs.size()=1 2024-09-14T12:01:17.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.742+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.jRc2bSvVdwYAtfWZQl6XxZHNC01DD2d_0 2024-09-14T12:01:17.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.742+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13142271039673919476', time=2024-09-14T13:34:59.083486+0000, chain.objs.size()=1 2024-09-14T12:01:17.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.742+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.aVxzXvnaipr5vXA7W02T_u29RVSpjn6_0 2024-09-14T12:01:17.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.742+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1064198584787839339', time=2024-09-14T13:34:59.086604+0000, chain.objs.size()=1 2024-09-14T12:01:17.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.742+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Ay5cpm8UspdJwHR1Z-kO5Tn9P3Ujo1y_0 2024-09-14T12:01:17.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.742+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8810257151345943307', time=2024-09-14T13:34:59.177706+0000, chain.objs.size()=1 2024-09-14T12:01:17.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.742+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.FW8swAr6ZFP4ONi0yEiOZ9WQOMgZeTm_0 2024-09-14T12:01:17.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.744+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11496425375976139399', time=2024-09-14T13:34:59.356721+0000, chain.objs.size()=1 2024-09-14T12:01:17.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.744+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.IQQdPtSn0zuOWsj7zq2nNVvJH5JT2M5_0 2024-09-14T12:01:17.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.744+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.906982647172121742', time=2024-09-14T13:34:59.447029+0000, chain.objs.size()=1 2024-09-14T12:01:17.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.744+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.HQL93FVQn1vhNlkO1HwswQDAZ7vSUz6_0 2024-09-14T12:01:17.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.744+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6427894334044982500', time=2024-09-14T13:34:59.609666+0000, chain.objs.size()=1 2024-09-14T12:01:17.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.744+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.-d3mpXMHLGybu1zuFI1-yOIRiijS3ne_0 2024-09-14T12:01:17.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.745+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10913461464820821396', time=2024-09-14T13:35:00.079027+0000, chain.objs.size()=1 2024-09-14T12:01:17.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.745+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.dQeWHPN1V2GMoJr8CNBosFyL5eb0G9__0 2024-09-14T12:01:17.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.745+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9586092922958027897', time=2024-09-14T13:35:00.595966+0000, chain.objs.size()=1 2024-09-14T12:01:17.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.745+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Ud8IXd2djeeqAnV-g3Lr_9J_v1hKtkP_0 2024-09-14T12:01:17.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.745+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13001537692026095771', time=2024-09-14T13:35:00.741016+0000, chain.objs.size()=1 2024-09-14T12:01:17.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.745+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.VSsqu0odyFa0WaJVt0maeDIzSgE_4K1_0 2024-09-14T12:01:17.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.745+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5054686587549927071', time=2024-09-14T13:35:00.791337+0000, chain.objs.size()=1 2024-09-14T12:01:17.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.745+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.6n4hv5zrUNKUoDsib0OKVihlO0WgP-O_0 2024-09-14T12:01:17.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.745+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2334066620892779428', time=2024-09-14T13:35:01.044711+0000, chain.objs.size()=1 2024-09-14T12:01:17.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.745+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.fkZzKnC-_NtWApmw-sshzVVibSlkuuH_0 2024-09-14T12:01:17.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.745+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14727438302820823701', time=2024-09-14T13:35:01.079772+0000, chain.objs.size()=1 2024-09-14T12:01:17.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.745+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.w6r2OcFgKS8ff7lRIeRp1pYU61L24CA_0 2024-09-14T12:01:17.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.745+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6735674161265295163', time=2024-09-14T13:35:01.801424+0000, chain.objs.size()=1 2024-09-14T12:01:17.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.745+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.KHfEHiasQy1MYx_EPdbAHzyXhG7eWtu_0 2024-09-14T12:01:17.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.747+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6641452370576611764', time=2024-09-14T13:35:02.213518+0000, chain.objs.size()=1 2024-09-14T12:01:17.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.747+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.qP5RcWJ0vvd-ze5I4f5RGhOkQAotRrK_0 2024-09-14T12:01:17.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.750+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8536515964375407691', time=2024-09-14T13:35:41.762543+0000, chain.objs.size()=1 2024-09-14T12:01:17.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.750+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.YHA4VELGE8ph1VKW28GqZC7MGJ9toaz_0 2024-09-14T12:01:17.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.750+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10224660669618492521', time=2024-09-14T13:35:41.948647+0000, chain.objs.size()=1 2024-09-14T12:01:17.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.750+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.OI4PZM2eSkCV_mvLgq5XlFO84VNVWOC_0 2024-09-14T12:01:17.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.750+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10613683859948991389', time=2024-09-14T13:35:41.981913+0000, chain.objs.size()=1 2024-09-14T12:01:17.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.750+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.fx666poMinckxLT43Brmcdls9e92tyj_0 2024-09-14T12:01:17.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.750+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12354739972004089223', time=2024-09-14T13:35:42.099343+0000, chain.objs.size()=1 2024-09-14T12:01:17.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.750+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ZpZjadvTWPNNruYsniTj0WvQiZCYP7G_0 2024-09-14T12:01:17.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.750+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5043203786662005757', time=2024-09-14T13:35:42.367595+0000, chain.objs.size()=1 2024-09-14T12:01:17.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.750+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.7k0LuT_U5ptL_tTxz7LmNZW64aA4R4K_0 2024-09-14T12:01:17.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.750+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10158301810391494439', time=2024-09-14T13:35:43.454860+0000, chain.objs.size()=1 2024-09-14T12:01:17.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.750+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.cmLL0jVriX-0Z2H5IlO_srTiRgEb9jv_0 2024-09-14T12:01:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.750+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15047997658275177151', time=2024-09-14T13:35:43.591544+0000, chain.objs.size()=1 2024-09-14T12:01:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.750+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.aWVjb1EmvC7sL4nH3wNHeuKpcrNw4hw_0 2024-09-14T12:01:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.750+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7095319702164505664', time=2024-09-14T13:35:43.741220+0000, chain.objs.size()=1 2024-09-14T12:01:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.750+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.K9MSdEYihcImCZN8_hZ1oBvSAZ6jc1O_0 2024-09-14T12:01:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.750+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12858404912056977570', time=2024-09-14T13:35:44.186870+0000, chain.objs.size()=1 2024-09-14T12:01:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.750+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.sQceCjuDDepJcGq6vQP51JFB7FE-175_0 2024-09-14T12:01:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.750+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6410563734803139838', time=2024-09-14T13:35:44.845050+0000, chain.objs.size()=1 2024-09-14T12:01:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.750+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.vvVi-04QpInmxtl6Iu_umRMJ5X5UI1B_0 2024-09-14T12:01:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.750+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1466193966355536695', time=2024-09-14T13:35:45.290204+0000, chain.objs.size()=1 2024-09-14T12:01:17.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.750+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.B7U1zKqhNoZA0bUIOx5XbklV-AmyxE__0 2024-09-14T12:01:17.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.754+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2576165226211587218', time=2024-09-14T13:35:45.652933+0000, chain.objs.size()=1 2024-09-14T12:01:17.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.754+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.5hFQ9Lc4PFBdoIX-20Psp0DmgW6yqOJ_0 2024-09-14T12:01:17.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.754+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2820211436198862857', time=2024-09-14T13:35:46.439380+0000, chain.objs.size()=1 2024-09-14T12:01:17.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.754+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.aclLGOZn92RhzErj5-aTmSyxnd-aIs-_0 2024-09-14T12:01:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.755+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11811208013194082154', time=2024-09-14T13:35:46.441727+0000, chain.objs.size()=1 2024-09-14T12:01:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.755+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.tu9oanWQj-_lf6cMkAcpGwbLx8PEsWT_0 2024-09-14T12:01:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.755+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7111087432181554498', time=2024-09-14T13:35:46.568982+0000, chain.objs.size()=1 2024-09-14T12:01:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.755+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.yFNmNowOelHlDyuDASz5iZ3Af0I34R2_0 2024-09-14T12:01:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.755+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15899747304615394024', time=2024-09-14T13:35:46.826183+0000, chain.objs.size()=1 2024-09-14T12:01:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.755+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.FvBiNApuJAmaeOET3M5oWFVJOWWll1I_0 2024-09-14T12:01:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.755+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16989551072033528118', time=2024-09-14T13:35:47.147289+0000, chain.objs.size()=1 2024-09-14T12:01:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.755+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.67Hm1UkcM2x5uQLJ005oRfcoCBTvJkz_0 2024-09-14T12:01:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.755+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3220166380948510080', time=2024-09-14T13:35:48.190474+0000, chain.objs.size()=1 2024-09-14T12:01:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.755+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.8A3RbtoLsvnQuV1aQHtFQSBSi4ee43z_0 2024-09-14T12:01:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.755+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10218097167346064892', time=2024-09-14T13:35:48.735864+0000, chain.objs.size()=1 2024-09-14T12:01:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.755+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.5fXYVSiOreTlX1gpXh5uqtz2XYbg-6s_0 2024-09-14T12:01:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.756+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15756126915340901290', time=2024-09-14T13:35:49.729786+0000, chain.objs.size()=1 2024-09-14T12:01:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.756+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.1zUcLrEX6cy855WFWDBn7SXwOeLLPUR_0 2024-09-14T12:01:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.756+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11735682636330400741', time=2024-09-14T13:35:49.823749+0000, chain.objs.size()=1 2024-09-14T12:01:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.756+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.-FBH-o3ED9uGUkeaBluzg0GSIz31EOt_0 2024-09-14T12:01:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.756+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1643024954065103312', time=2024-09-14T13:35:49.857922+0000, chain.objs.size()=1 2024-09-14T12:01:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.756+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Kfq6oNNqNoiuspM4wxvbGaQrP8wIuya_0 2024-09-14T12:01:17.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.760+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4022819386594130301', time=2024-09-14T13:35:49.959561+0000, chain.objs.size()=1 2024-09-14T12:01:17.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.760+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Cdx3xRaslwsFCJBncfnxBCgCuid55yO_0 2024-09-14T12:01:17.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.760+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1130279555308701962', time=2024-09-14T13:35:50.205126+0000, chain.objs.size()=1 2024-09-14T12:01:17.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.760+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.u7fJie4PMcYZ9jzFqbq7aFXZujP11B7_0 2024-09-14T12:01:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.760+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9989198437704984009', time=2024-09-14T13:35:50.264545+0000, chain.objs.size()=1 2024-09-14T12:01:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.760+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.AzBFsYTySVBpGiiwr4bUJfFD3IsqLVe_0 2024-09-14T12:01:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.760+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3095303336529389107', time=2024-09-14T13:35:51.329311+0000, chain.objs.size()=1 2024-09-14T12:01:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.760+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.VSK8JIXd1_ygNeMuClZfAckrHcmvKs3_0 2024-09-14T12:01:17.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.763+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/49965 2024-09-14T12:01:17.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-14T12:01:17.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1661821331888725607', time=2024-09-14T13:35:51.539274+0000, chain.objs.size()=1 2024-09-14T12:01:17.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.p03i8p601mVRa3DcwFKd4utOrCxqzfW_0 2024-09-14T12:01:17.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9369833771093949438', time=2024-09-14T13:35:52.275463+0000, chain.objs.size()=1 2024-09-14T12:01:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.A5XzeUK2eO5aXBqKyuj2W1cUtJ9Om99_0 2024-09-14T12:01:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9929409774509325557', time=2024-09-14T13:35:52.315014+0000, chain.objs.size()=1 2024-09-14T12:01:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.XYP5CtLZ2wxYkMebPaLtKItI-9j32W2_0 2024-09-14T12:01:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13930819305293387652', time=2024-09-14T13:35:52.615412+0000, chain.objs.size()=1 2024-09-14T12:01:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.BOeHhrMjkBzHtAsLRMlsJyxsA0Y4SRM_0 2024-09-14T12:01:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1664081717850672453', time=2024-09-14T13:35:52.767323+0000, chain.objs.size()=1 2024-09-14T12:01:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.6JTdSzqZxRTT8bxxecZusfkYpZBE_0n_0 2024-09-14T12:01:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3435472888726584603', time=2024-09-14T13:37:48.253189+0000, chain.objs.size()=1 2024-09-14T12:01:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.435__shadow_.YwPAgjcS_xWzP-GeLYKF-F1uSYQ4VXZ_0 2024-09-14T12:01:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15219705193091185185', time=2024-09-14T13:37:50.741952+0000, chain.objs.size()=1 2024-09-14T12:01:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.437__shadow_._QMVMF4Q4cmWA0Y5gMLK8vgYzkyd35j_0 2024-09-14T12:01:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4783451902978271625', time=2024-09-14T13:38:16.520551+0000, chain.objs.size()=1 2024-09-14T12:01:17.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.458__shadow_.MWzDFp_3CNm8wgpNXqFVze7-uMyKzN5_0 2024-09-14T12:01:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14837615897321245574', time=2024-09-14T13:38:26.979937+0000, chain.objs.size()=1 2024-09-14T12:01:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.465__shadow_.GQNnD6IG0ILtOMj84XLYWx5P-AOUtrj_0 2024-09-14T12:01:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4517670585352301404', time=2024-09-14T13:38:42.829929+0000, chain.objs.size()=1 2024-09-14T12:01:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.484__shadow_.ONmGsrY8GJDi1XH3skOTIu4cAIkWHMY_0 2024-09-14T12:01:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14911690865263872669', time=2024-09-14T13:38:58.839516+0000, chain.objs.size()=1 2024-09-14T12:01:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.497__shadow_.sDzlz4Pp5A4qZXhC6Ah0hAziaz0Ad2i_0 2024-09-14T12:01:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9878146920042647015', time=2024-09-14T13:45:39.166782+0000, chain.objs.size()=1 2024-09-14T12:01:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.765+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:vAPSHsjDE8l8cz9YVrV7NuIzF6QpFYJ_.VQUWU85XINnshzCq6bl0Lg_haLVMHnb_0 2024-09-14T12:01:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.767+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1552678815426696528', time=2024-09-14T13:46:24.296221+0000, chain.objs.size()=1 2024-09-14T12:01:17.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.767+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:UX0bHoxQZv9tbZxTZND5aCqm7WFwNKx_.P3hlDB7Aw1JiOK3yZGSbkrIAE0cx2wk_0 2024-09-14T12:01:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.768+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4454478168298443528', time=2024-09-14T13:47:12.051525+0000, chain.objs.size()=1 2024-09-14T12:01:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.768+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.581__shadow:s7Wm3hGN2MGsRjpyFzOj3bYNHhCJBiW_.qbAwcssbUDH2BL1BiDG12iyxmcrU1pm_0 2024-09-14T12:01:17.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.768+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9574000259858926860', time=2024-09-14T13:47:21.530686+0000, chain.objs.size()=1 2024-09-14T12:01:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.768+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.588__shadow:HqrKeN3EO9ztgWF2t9u3f0KBGGVfYPf_.Pi0HIJ4pfxrfpoPQ8grc_1YISLfuod__0 2024-09-14T12:01:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.768+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2988589151302250545', time=2024-09-14T13:47:22.056742+0000, chain.objs.size()=1 2024-09-14T12:01:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.768+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.588__shadow:KI3535DD5S26Gw4QYWi6dONsintyYFN_.4pGp6axIce4oa74IFtGc-SsxRTQAGpV_0 2024-09-14T12:01:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.768+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11455939320885905738', time=2024-09-14T13:52:38.567369+0000, chain.objs.size()=1 2024-09-14T12:01:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.768+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.627__shadow_.pFTjVXjQghk97-W6EGQnZxzs6dp83jX_0 2024-09-14T12:01:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.768+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16118102535034259846', time=2024-09-14T13:52:48.572209+0000, chain.objs.size()=1 2024-09-14T12:01:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.768+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.636__shadow_.-jNo5KMM7JJXdhTNgCtc7FH4DjPngch_0 2024-09-14T12:01:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.768+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16247323066180330656', time=2024-09-14T13:54:21.444573+0000, chain.objs.size()=1 2024-09-14T12:01:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.768+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.692__shadow_.ro9H63de-WKY9-aw2xtGvAmg7OhJkI9_0 2024-09-14T12:01:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.769+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2982831060484769172', time=2024-09-14T13:54:33.894505+0000, chain.objs.size()=1 2024-09-14T12:01:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.769+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.704__shadow:9C-R2n1OukRlLz7WHIckkygUSF1oouD_.PWLeuFCvq9kBMb7YZhkGKzWwKrFaQpo_0 2024-09-14T12:01:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.769+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4455495082778004848', time=2024-09-14T13:54:44.075374+0000, chain.objs.size()=1 2024-09-14T12:01:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.769+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.714__shadow:PTsV4TovlF65s5qDm7GSwqNENyVJkB4_.TmaZArFjT_-i8KuQa47sRjKaHXzNIWe_0 2024-09-14T12:01:17.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.769+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~YbhJxQGjgryDuMkHg0abqtVmSTP2vNC', time=2024-09-14T13:55:44.136456+0000, chain.objs.size()=1 2024-09-14T12:01:17.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.769+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.743__multipart_mymultipart2.2~YbhJxQGjgryDuMkHg0abqtVmSTP2vNC.1 2024-09-14T12:01:17.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.773+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:17.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.775+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T12:01:17.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.776+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:17.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.777+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:17.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45688' 2024-09-14T12:01:17.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7072460618558649095', time=2024-09-14T13:31:38.102240+0000, chain.objs.size()=1 2024-09-14T12:01:17.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.236__shadow_.nhmARIZgSzs_p5o_2O_7gi_WULCKqhS_0 2024-09-14T12:01:17.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9644829691039229306', time=2024-09-14T13:31:43.775434+0000, chain.objs.size()=1 2024-09-14T12:01:17.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.240__shadow_.SPSpn_6iNgO_Aza2FKeUUve5o42ITsh_0 2024-09-14T12:01:17.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15378508277424300969', time=2024-09-14T13:31:44.740400+0000, chain.objs.size()=1 2024-09-14T12:01:17.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.241__shadow_.jz_H4jZS9hDBvHHQ4pnwsbJDOzecF0M_0 2024-09-14T12:01:17.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4750529284353978654', time=2024-09-14T13:31:45.827232+0000, chain.objs.size()=1 2024-09-14T12:01:17.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.242__shadow_.k7E2mdCGDu_HZXxDNLlVBaBsgxaig-Q_0 2024-09-14T12:01:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6243389193336120325', time=2024-09-14T13:31:50.536178+0000, chain.objs.size()=1 2024-09-14T12:01:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.245__shadow_.mORKhKCGm_im4stAfbNJRc1cB1AKLHY_0 2024-09-14T12:01:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8935934040454289467', time=2024-09-14T13:32:08.243342+0000, chain.objs.size()=1 2024-09-14T12:01:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.261__shadow_.fqhMDtzbwM8rjIfcGwBis9Yr7BydEfI_0 2024-09-14T12:01:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12337642690096480005', time=2024-09-14T13:32:09.325631+0000, chain.objs.size()=1 2024-09-14T12:01:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.262__shadow_.Y3FLNnnemxbtfa6W15EkiEEcWMuAfbq_0 2024-09-14T12:01:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8356191079328609716', time=2024-09-14T13:32:47.572090+0000, chain.objs.size()=1 2024-09-14T12:01:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.inQXh9xrvu7OxmSRLvGDlh4nBes3Eu8_0 2024-09-14T12:01:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16177789864126025781', time=2024-09-14T13:32:47.887797+0000, chain.objs.size()=1 2024-09-14T12:01:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ajJIM5hO3Ia_0zW3OLSHxmKcojZcTfz_0 2024-09-14T12:01:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10245676667402945557', time=2024-09-14T13:32:48.005700+0000, chain.objs.size()=1 2024-09-14T12:01:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.kt7D-qcDh49XnO_CFZC15YD-qo6-FA7_0 2024-09-14T12:01:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.590191590220382631', time=2024-09-14T13:32:48.043398+0000, chain.objs.size()=1 2024-09-14T12:01:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ZSThjLlFLJCKEwc6mtCnFNUlOl-9wBc_0 2024-09-14T12:01:17.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14655673678143181591', time=2024-09-14T13:32:49.079674+0000, chain.objs.size()=1 2024-09-14T12:01:17.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.778+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Xm4G83tXYLwkYfNhs-PWGTcGzuo542v_0 2024-09-14T12:01:17.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.780+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15468577641909307401', time=2024-09-14T13:32:49.876074+0000, chain.objs.size()=1 2024-09-14T12:01:17.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.780+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.xvFhMFDDDWHZqRXuMcs_gQSRES5XifK_0 2024-09-14T12:01:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.781+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12118240319129176888', time=2024-09-14T13:32:50.744880+0000, chain.objs.size()=1 2024-09-14T12:01:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.781+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.DtIpvob8lqo1QrLl21F5KJnZSClBzxP_0 2024-09-14T12:01:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.781+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8673776962705562246', time=2024-09-14T13:32:50.833162+0000, chain.objs.size()=1 2024-09-14T12:01:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.781+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.TcZKeFJir2MwHS9W5sTTasrrg1d1i2D_0 2024-09-14T12:01:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.781+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1515641169319098779', time=2024-09-14T13:32:51.066202+0000, chain.objs.size()=1 2024-09-14T12:01:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.781+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.mgkQPhUhoD5Ymt3Cns1zikcavaMlWwg_0 2024-09-14T12:01:17.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.782+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17383038542141020866', time=2024-09-14T13:32:52.193230+0000, chain.objs.size()=1 2024-09-14T12:01:17.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.782+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.LU5QCuZ7ylDigNmwe8x5yvPUlrouCLC_0 2024-09-14T12:01:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.783+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9244216874558258286', time=2024-09-14T13:32:52.620922+0000, chain.objs.size()=1 2024-09-14T12:01:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.783+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Tdd_CZ7wpc4tshd_239zY8DeEnF9M0y_0 2024-09-14T12:01:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.783+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13251357978824208109', time=2024-09-14T13:32:52.976703+0000, chain.objs.size()=1 2024-09-14T12:01:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.783+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ughTkl7UHdkMUnIOpVoIUv4p5T8ibQ2_0 2024-09-14T12:01:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.783+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10246823544314938337', time=2024-09-14T13:32:53.949729+0000, chain.objs.size()=1 2024-09-14T12:01:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.783+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.NCuME6lR0Y8WQYznvFOVelbXLTX6rvr_0 2024-09-14T12:01:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.783+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1509978313704223403', time=2024-09-14T13:32:54.048662+0000, chain.objs.size()=1 2024-09-14T12:01:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.783+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.x0Xc7EYD6Kv9R0NwsuOPyvaZOC1FkLN_0 2024-09-14T12:01:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.783+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14730629595869189217', time=2024-09-14T13:32:54.424102+0000, chain.objs.size()=1 2024-09-14T12:01:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.783+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.xSSclfcX3rEUjU9nABsnBEQ29Ft4otc_0 2024-09-14T12:01:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.783+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17191249775685292507', time=2024-09-14T13:32:55.291296+0000, chain.objs.size()=1 2024-09-14T12:01:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.783+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Xd0l8vdymbR7JLm5PPplJuCqNuKlP8O_0 2024-09-14T12:01:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.784+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15425384991065468489', time=2024-09-14T13:32:55.505558+0000, chain.objs.size()=1 2024-09-14T12:01:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.784+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.DiwqriOfOOBKbxF1DvbvHQv5HiYPEJ8_0 2024-09-14T12:01:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.784+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14765333087226779117', time=2024-09-14T13:32:55.618032+0000, chain.objs.size()=1 2024-09-14T12:01:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.784+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.wRqqNJkpAuG4js8Ggb7JBHMgKvBbLE9_0 2024-09-14T12:01:17.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.786+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4789012891909175752', time=2024-09-14T13:32:55.847033+0000, chain.objs.size()=1 2024-09-14T12:01:17.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.786+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.rssXZ2WQSWfJo9AetrEYw77dndJJjeF_0 2024-09-14T12:01:17.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.786+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16608443385835719313', time=2024-09-14T13:32:55.998324+0000, chain.objs.size()=1 2024-09-14T12:01:17.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.786+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Oa9QPNu24VngVeeYiw4xiD2l8mHxddN_0 2024-09-14T12:01:17.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.786+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1946679200984918767', time=2024-09-14T13:32:56.808929+0000, chain.objs.size()=1 2024-09-14T12:01:17.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.786+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.vtgnhAJMJ0oHCmuMvbniL5MMpL_foLz_0 2024-09-14T12:01:17.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.787+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17782997144083956354', time=2024-09-14T13:32:57.220743+0000, chain.objs.size()=1 2024-09-14T12:01:17.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.787+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.mugaL9H-MjQA-2zVpG4UKtm60lSrnV5_0 2024-09-14T12:01:17.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.788+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6410380782797047409', time=2024-09-14T13:32:57.258934+0000, chain.objs.size()=1 2024-09-14T12:01:17.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.788+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.KXBw7wwkrw1QcCT8GtjqxwdUE1ZB7pU_0 2024-09-14T12:01:17.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.788+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18158263470134201905', time=2024-09-14T13:32:57.409730+0000, chain.objs.size()=1 2024-09-14T12:01:17.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.788+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.NkgwXsJngQvlMrTvmXOgKX5F8eAvv8r_0 2024-09-14T12:01:17.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.788+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11382713929892541297', time=2024-09-14T13:32:58.019089+0000, chain.objs.size()=1 2024-09-14T12:01:17.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.788+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Xkq_UARLV5myYBlXYSwxTyKSVnlBqda_0 2024-09-14T12:01:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.789+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9655334457943290865', time=2024-09-14T13:32:58.589739+0000, chain.objs.size()=1 2024-09-14T12:01:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.789+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.uIgmDRI8kGjRB0DY8afRpQx0npbJJWw_0 2024-09-14T12:01:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.789+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5488288496384230030', time=2024-09-14T13:32:58.743707+0000, chain.objs.size()=1 2024-09-14T12:01:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.789+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.2BpZwyaj5u6Uug_wZXCB0LWsrbAgBUf_0 2024-09-14T12:01:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.790+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6355747437106685960', time=2024-09-14T13:33:10.551113+0000, chain.objs.size()=1 2024-09-14T12:01:17.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.790+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.274__shadow_.Tejt3rVopSGngTbcYSO0gXhujT1kRmj_0 2024-09-14T12:01:17.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.790+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17411659208400095386', time=2024-09-14T13:33:26.008790+0000, chain.objs.size()=1 2024-09-14T12:01:17.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.790+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.288__shadow_.3TEH7yCiXQauEH2SLnnXHo3a-wqh9kU_0 2024-09-14T12:01:17.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.791+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1486436685734338520', time=2024-09-14T13:33:33.160490+0000, chain.objs.size()=1 2024-09-14T12:01:17.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.791+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.nE1WRq7lTyWVx4iWG7KlfT-bAQAk7hq_0 2024-09-14T12:01:17.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.791+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4645055394456038825', time=2024-09-14T13:33:35.536791+0000, chain.objs.size()=1 2024-09-14T12:01:17.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.791+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.MZ7xPwkEYERFVGpxRBUAOrD_yEy8sA__0 2024-09-14T12:01:17.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.791+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5598444521390118777', time=2024-09-14T13:33:35.538488+0000, chain.objs.size()=1 2024-09-14T12:01:17.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.791+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.mzOFrepDJdvYIqaWmp1yOlb5g2ZOX6J_0 2024-09-14T12:01:17.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.791+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.710158915579000665', time=2024-09-14T13:33:35.610375+0000, chain.objs.size()=1 2024-09-14T12:01:17.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.791+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.VgnVSjYEqNnb2h7RqCjCO6pDV8nILVs_0 2024-09-14T12:01:17.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.791+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8968374628979384799', time=2024-09-14T13:33:35.636741+0000, chain.objs.size()=1 2024-09-14T12:01:17.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.791+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.vIhK3qEkpv99-t7IKQUyqn2dxWDLKR7_0 2024-09-14T12:01:17.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.791+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14317139389558534200', time=2024-09-14T13:33:35.638921+0000, chain.objs.size()=1 2024-09-14T12:01:17.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.791+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.2JJTSKbLgqEL0E5LuBHDxvBvrSdZb7U_0 2024-09-14T12:01:17.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.791+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15750328921817502724', time=2024-09-14T13:33:49.134587+0000, chain.objs.size()=1 2024-09-14T12:01:17.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.791+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.306__shadow_.t0ffQjmuVb4B45NIOqH-OrsoqspCu1r_0 2024-09-14T12:01:17.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.792+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10193514852066587173', time=2024-09-14T13:33:52.165981+0000, chain.objs.size()=1 2024-09-14T12:01:17.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.792+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.308__shadow:vx3rZCTZpGW402BKB0fFNZZmVloSHmT_.leL2TIphKkkm8_Gh7jST6hYtqQyeV1K_0 2024-09-14T12:01:17.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.792+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2359757179551083651', time=2024-09-14T13:34:51.572771+0000, chain.objs.size()=1 2024-09-14T12:01:17.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.792+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.r6q-3KijugES02tv67Hg4Up9K8208YJ_0 2024-09-14T12:01:17.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.794+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11998921528169913007', time=2024-09-14T13:34:51.573553+0000, chain.objs.size()=1 2024-09-14T12:01:17.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.794+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Wf9wdcr0l1lN9pi69JCAwELdPiEgqfR_0 2024-09-14T12:01:17.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.794+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13126797203683865504', time=2024-09-14T13:34:52.179318+0000, chain.objs.size()=1 2024-09-14T12:01:17.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.794+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.g7bJ8MId0j4W2Dk4ShCJDXSPLUqfvbE_0 2024-09-14T12:01:17.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.794+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17783465964907867590', time=2024-09-14T13:34:53.100308+0000, chain.objs.size()=1 2024-09-14T12:01:17.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.794+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Z03bVEz9z6QnE3ffe2Dv_6a9ea34lM7_0 2024-09-14T12:01:17.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.797+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15526743084674958172', time=2024-09-14T13:34:53.728868+0000, chain.objs.size()=1 2024-09-14T12:01:17.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.797+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.H98DYHqCCZ3fHz_Rj4dOOV45y3AJ-2v_0 2024-09-14T12:01:17.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.797+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9297395082531584717', time=2024-09-14T13:34:54.873611+0000, chain.objs.size()=1 2024-09-14T12:01:17.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.797+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.NlRXYeVGBqh8De3SZV0oTLAGtkQF4rh_0 2024-09-14T12:01:17.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.797+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4828362077439510807', time=2024-09-14T13:34:55.087092+0000, chain.objs.size()=1 2024-09-14T12:01:17.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.797+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.PveE0KAr-vfNJCAp1r8oXYdPFdVo9jx_0 2024-09-14T12:01:17.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.797+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11975341743411979220', time=2024-09-14T13:34:55.506034+0000, chain.objs.size()=1 2024-09-14T12:01:17.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.797+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.GiT-B_HeTkHgLKOwg1Fl9j33V2r87Uz_0 2024-09-14T12:01:17.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.797+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2444240070717327011', time=2024-09-14T13:34:55.746111+0000, chain.objs.size()=1 2024-09-14T12:01:17.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.797+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.IgmLPkiPdymzPaPhQ5Qz-6U-HwE_02V_0 2024-09-14T12:01:17.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.797+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3129507338609081672', time=2024-09-14T13:34:56.360847+0000, chain.objs.size()=1 2024-09-14T12:01:17.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.797+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.CZM39cbhyKpVTy4HljGZBhsvQLFQgwG_0 2024-09-14T12:01:17.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.798+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8010601570997793574', time=2024-09-14T13:34:56.361409+0000, chain.objs.size()=1 2024-09-14T12:01:17.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.798+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.byIVutC2cC0BJnqm4EdaAxc0eSoBm4x_0 2024-09-14T12:01:17.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.798+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12152900089525027355', time=2024-09-14T13:34:56.687743+0000, chain.objs.size()=1 2024-09-14T12:01:17.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.798+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.bFmiRoK17hNmiUwSHOouy3IFtTe2ZOn_0 2024-09-14T12:01:17.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.798+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8151840755934836876', time=2024-09-14T13:34:56.815300+0000, chain.objs.size()=1 2024-09-14T12:01:17.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.798+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ytEoL-bAfNOWO2CmlFSxoYjWikvBmYb_0 2024-09-14T12:01:17.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.798+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17252875801613647247', time=2024-09-14T13:34:56.971573+0000, chain.objs.size()=1 2024-09-14T12:01:17.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.798+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.l901tnYq5dik2HvXhM4J3AK6nl5eaRa_0 2024-09-14T12:01:17.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.798+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11746357053622748847', time=2024-09-14T13:34:57.811880+0000, chain.objs.size()=1 2024-09-14T12:01:17.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.798+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.K3AihlwWeu8g1XszyzKCCISxaJ6w7CM_0 2024-09-14T12:01:17.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.800+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16815346820978204235', time=2024-09-14T13:34:58.253891+0000, chain.objs.size()=1 2024-09-14T12:01:17.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.800+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.WYxyHYfig50Rf2z_oik-vPTJFP9Yz3s_0 2024-09-14T12:01:17.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.801+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7558281629451394666', time=2024-09-14T13:34:58.470715+0000, chain.objs.size()=1 2024-09-14T12:01:17.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.801+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.oNngjQe7-furGLNvvdwdjgT2EPNRRGc_0 2024-09-14T12:01:17.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.801+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15126312391264904723', time=2024-09-14T13:34:59.260715+0000, chain.objs.size()=1 2024-09-14T12:01:17.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.801+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.YrH9LdW41S9fpHJ_2bVbm-f8CnAKvt3_0 2024-09-14T12:01:17.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.801+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4678978104041377926', time=2024-09-14T13:34:59.902769+0000, chain.objs.size()=1 2024-09-14T12:01:17.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.801+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.SYVvFGSOBxP-ccuTYdj4fup_t5stEJY_0 2024-09-14T12:01:17.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.801+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9012462886297195967', time=2024-09-14T13:35:00.476895+0000, chain.objs.size()=1 2024-09-14T12:01:17.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.801+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.pwkv_2wrsyhZi15YWTx6_WjaWUZHNYt_0 2024-09-14T12:01:17.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.801+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17524223330891589678', time=2024-09-14T13:35:01.044737+0000, chain.objs.size()=1 2024-09-14T12:01:17.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.801+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.i4zVuboodyE_eVvJZQLsyrMs1n-ErK1_0 2024-09-14T12:01:17.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.802+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.437754100960447355', time=2024-09-14T13:35:01.151613+0000, chain.objs.size()=1 2024-09-14T12:01:17.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.802+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.dzmwTnxBlU2Y-TXyoLVzF3dvj0aXuYR_0 2024-09-14T12:01:17.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.802+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13359731975741573019', time=2024-09-14T13:35:01.241416+0000, chain.objs.size()=1 2024-09-14T12:01:17.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.802+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.MbGylcp_-rtPAZJwOOE2ok7jKmCPra2_0 2024-09-14T12:01:17.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.802+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17397218202015493529', time=2024-09-14T13:35:01.322923+0000, chain.objs.size()=1 2024-09-14T12:01:17.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.802+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.LQfT3fnSZRwmRzp7OrRftKMJSHHh04H_0 2024-09-14T12:01:17.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.802+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10660042931490949171', time=2024-09-14T13:35:01.499500+0000, chain.objs.size()=1 2024-09-14T12:01:17.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.802+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Ndorzz-GQAGYmACT4pQ1kBPp2AkcqUj_0 2024-09-14T12:01:17.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.802+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4504110593176076862', time=2024-09-14T13:35:01.500040+0000, chain.objs.size()=1 2024-09-14T12:01:17.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.802+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.200SwGGYwfW6RVC2gq6aAe953AINrWn_0 2024-09-14T12:01:17.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.806+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3984487199295891039', time=2024-09-14T13:35:01.801324+0000, chain.objs.size()=1 2024-09-14T12:01:17.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.806+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.gUwZYO506nYaR73xR4yEYTH6P9hAvV7_0 2024-09-14T12:01:17.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.807+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3405411039208401853', time=2024-09-14T13:35:01.802061+0000, chain.objs.size()=1 2024-09-14T12:01:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.807+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.DZIF7v2nJgHYIqiGaZ9LsxM0TVqxRFs_0 2024-09-14T12:01:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.807+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8149021736385016622', time=2024-09-14T13:35:01.802834+0000, chain.objs.size()=1 2024-09-14T12:01:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.807+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.x_rPD1jqIfPoIj2JOWIALgm2PLib0fb_0 2024-09-14T12:01:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.807+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17932208488510657571', time=2024-09-14T13:35:41.662539+0000, chain.objs.size()=1 2024-09-14T12:01:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.807+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.2ZJp0kH1XbC9DmQ2gs5gGL0qYo9_9wR_0 2024-09-14T12:01:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.807+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3449358753359049630', time=2024-09-14T13:35:41.815932+0000, chain.objs.size()=1 2024-09-14T12:01:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.807+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.z2SV4LzzBdk6LspAAiuXgtJr5hkrbQB_0 2024-09-14T12:01:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.807+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5488278697339662991', time=2024-09-14T13:35:42.130976+0000, chain.objs.size()=1 2024-09-14T12:01:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.807+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.euLBjttYvdOqMBVQblyMmcnx4iB4Vio_0 2024-09-14T12:01:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.807+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15531462427375755768', time=2024-09-14T13:35:43.261810+0000, chain.objs.size()=1 2024-09-14T12:01:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.807+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.SAAnbYSWl7xwq889khLWqnpet9kjjL1_0 2024-09-14T12:01:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.807+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1670267397483384268', time=2024-09-14T13:35:43.382906+0000, chain.objs.size()=1 2024-09-14T12:01:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.807+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.jnFuW5w4CGRvTq93u36sgIyFqM5WPo6_0 2024-09-14T12:01:17.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.807+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2093041961223063279', time=2024-09-14T13:35:43.651132+0000, chain.objs.size()=1 2024-09-14T12:01:17.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.807+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.JCirmzcU05qDpdIEa75iflSzupDqyat_0 2024-09-14T12:01:17.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.807+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2316511957896172105', time=2024-09-14T13:35:44.125171+0000, chain.objs.size()=1 2024-09-14T12:01:17.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.807+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.z8O8fO8fnmqm81QCwO8wOwkMJd1Nf7T_0 2024-09-14T12:01:17.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.807+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4368584972782122431', time=2024-09-14T13:35:44.845040+0000, chain.objs.size()=1 2024-09-14T12:01:17.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.807+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.IL-8rIgg0ELGgbwzbV4N8xZEJhU9X8c_0 2024-09-14T12:01:17.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.810+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3517127861101113671', time=2024-09-14T13:35:45.004124+0000, chain.objs.size()=1 2024-09-14T12:01:17.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.810+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Fg-jgoP8Jah_RHV8HPS1AOnn9Kz3M59_0 2024-09-14T12:01:17.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.810+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.849433474759002446', time=2024-09-14T13:35:45.089214+0000, chain.objs.size()=1 2024-09-14T12:01:17.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.810+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.WvEap8CUKqfETI8hga0jrbFfqRiXTIr_0 2024-09-14T12:01:17.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.810+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15717866785272845184', time=2024-09-14T13:35:45.306693+0000, chain.objs.size()=1 2024-09-14T12:01:17.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.810+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.LY1ZAU5J8vlM_qZr9CXx1wa0x98ZgGJ_0 2024-09-14T12:01:17.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.811+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15933686103274127001', time=2024-09-14T13:35:45.851234+0000, chain.objs.size()=1 2024-09-14T12:01:17.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.811+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.zwa6h8w1Z1bBruOyTf4pJZSlsjpdn-j_0 2024-09-14T12:01:17.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.811+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14692622849379616193', time=2024-09-14T13:35:46.594487+0000, chain.objs.size()=1 2024-09-14T12:01:17.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.811+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.xeQgZaRAE84wo5vVncZXN9DtCuINL2h_0 2024-09-14T12:01:17.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.812+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10889417965995036801', time=2024-09-14T13:35:47.783904+0000, chain.objs.size()=1 2024-09-14T12:01:17.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.812+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.nGeHFopwI0svcCBWizRiXGuC1uL4ID8_0 2024-09-14T12:01:17.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.812+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14871520136255188422', time=2024-09-14T13:35:48.332672+0000, chain.objs.size()=1 2024-09-14T12:01:17.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.812+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.hKgx7Xv-4wjdo7yoPeZEuHU6mhsPPo8_0 2024-09-14T12:01:17.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.812+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.854508402732341847', time=2024-09-14T13:35:48.746550+0000, chain.objs.size()=1 2024-09-14T12:01:17.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.812+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.mtiHgN8o1YDQ0Nx0mt-GIabQNSoThOQ_0 2024-09-14T12:01:17.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.812+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8106604535069820516', time=2024-09-14T13:35:48.819760+0000, chain.objs.size()=1 2024-09-14T12:01:17.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.812+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.TUX40bQMH471mjb9guWRqV98uyWm9XK_0 2024-09-14T12:01:17.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.812+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7468306941818859645', time=2024-09-14T13:35:49.233836+0000, chain.objs.size()=1 2024-09-14T12:01:17.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.812+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.lLkpz-fy-ZijU9ViBjgXreneqr11UsX_0 2024-09-14T12:01:17.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.812+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18080919370841773050', time=2024-09-14T13:35:49.363931+0000, chain.objs.size()=1 2024-09-14T12:01:17.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.812+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.4D9jZdKHhFOjrYXm5iBKBAArQ9rFJct_0 2024-09-14T12:01:17.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.814+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17147184146579754600', time=2024-09-14T13:35:49.364538+0000, chain.objs.size()=1 2024-09-14T12:01:17.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.814+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Jioqd987uJM0bwXMgU0Eh_2y4xUeYnH_0 2024-09-14T12:01:17.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.814+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13376135441055276126', time=2024-09-14T13:35:49.659162+0000, chain.objs.size()=1 2024-09-14T12:01:17.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.814+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.t96Gd_GXbnIsgLlWeOXB1zGQERI3fhg_0 2024-09-14T12:01:17.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.815+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11860815709603999193', time=2024-09-14T13:35:49.926453+0000, chain.objs.size()=1 2024-09-14T12:01:17.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.815+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.lDPzbxX8TpBTz-OIjdPJ5WiH9r6Jjaz_0 2024-09-14T12:01:17.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.815+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15895527187049938044', time=2024-09-14T13:35:49.987418+0000, chain.objs.size()=1 2024-09-14T12:01:17.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.815+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.BYxEMzc9hzEBgJ_4XRLUIeWfoDMTO0Z_0 2024-09-14T12:01:17.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.816+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4941184615103032754', time=2024-09-14T13:35:50.027411+0000, chain.objs.size()=1 2024-09-14T12:01:17.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.816+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.rSZtXaz3moGqQjPhJ_TiFADGiibX4Ek_0 2024-09-14T12:01:17.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.816+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11217666852699429742', time=2024-09-14T13:35:50.040166+0000, chain.objs.size()=1 2024-09-14T12:01:17.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.816+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.5TwuVdS82aj5hlle5VXaz4V1sELGQOC_0 2024-09-14T12:01:17.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.816+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9598548008971113091', time=2024-09-14T13:35:50.040909+0000, chain.objs.size()=1 2024-09-14T12:01:17.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.816+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.f8Rw_vEELmGAIomVKu1hfWOfzPsDLnH_0 2024-09-14T12:01:17.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.816+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2059488898743232227', time=2024-09-14T13:35:50.142883+0000, chain.objs.size()=1 2024-09-14T12:01:17.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.816+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.DkcaQ3-y_51KbN6t1EybCNVJ6lUc4AU_0 2024-09-14T12:01:17.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.819+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/45688 2024-09-14T12:01:17.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-14T12:01:17.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10800774808100962571', time=2024-09-14T13:35:50.204636+0000, chain.objs.size()=1 2024-09-14T12:01:17.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.iRHfeD8C51JJWXtPbSla8FIGZs1_AmF_0 2024-09-14T12:01:17.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9403295010749411116', time=2024-09-14T13:35:50.251966+0000, chain.objs.size()=1 2024-09-14T12:01:17.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ITuORFJVyeS2UxXEba1gNIQB4DTbt-l_0 2024-09-14T12:01:17.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11707839859160466829', time=2024-09-14T13:35:50.994127+0000, chain.objs.size()=1 2024-09-14T12:01:17.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.oz0H775JImoQa34rp6DgrYXe7j2PQP7_0 2024-09-14T12:01:17.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2407911524964359374', time=2024-09-14T13:35:51.200627+0000, chain.objs.size()=1 2024-09-14T12:01:17.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_._rgOt9_LYnJI5HsgCSZdYpumi4lwGxw_0 2024-09-14T12:01:17.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.680691386811219277', time=2024-09-14T13:35:51.470310+0000, chain.objs.size()=1 2024-09-14T12:01:17.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.oKBH8MMmLP0AAmtEOIeBWK564lEWhMQ_0 2024-09-14T12:01:17.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5503118294840878431', time=2024-09-14T13:35:51.471483+0000, chain.objs.size()=1 2024-09-14T12:01:17.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.LLIfqUmqYJx9Q3xquqHx3RxsLPH62B5_0 2024-09-14T12:01:17.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14763012747347168611', time=2024-09-14T13:35:51.958660+0000, chain.objs.size()=1 2024-09-14T12:01:17.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ropsYL-2-u3suWF6vEquLzj1zfpkeg0_0 2024-09-14T12:01:17.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14753984876634748672', time=2024-09-14T13:35:52.500001+0000, chain.objs.size()=1 2024-09-14T12:01:17.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.qaZVGT5twaU26sI4LLYfuMO6rhg3yxc_0 2024-09-14T12:01:17.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10299747121012035299', time=2024-09-14T13:35:52.724786+0000, chain.objs.size()=1 2024-09-14T12:01:17.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.kFhoxjPEh5gDsD7cAcRPrv3S2mgZcWf_0 2024-09-14T12:01:17.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9635301057581160209', time=2024-09-14T13:36:11.734989+0000, chain.objs.size()=1 2024-09-14T12:01:17.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.343__shadow_.mp5Lq2Lhi316OH_CP2rW_JjtFF4N9KI_0 2024-09-14T12:01:17.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13615548644302466128', time=2024-09-14T13:37:58.342808+0000, chain.objs.size()=1 2024-09-14T12:01:17.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.444__shadow_.jjHpr3rDqX222oFV8Ajf3ktYg5HFsAm_0 2024-09-14T12:01:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6193776138912556245', time=2024-09-14T13:38:08.653814+0000, chain.objs.size()=1 2024-09-14T12:01:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.822+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.452__shadow_.TXQQRsuA1DJ5W9BDEjQtJqLIaWZQqON_0 2024-09-14T12:01:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.825+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15686140371645950403', time=2024-09-14T13:38:29.324697+0000, chain.objs.size()=1 2024-09-14T12:01:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.825+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.467__shadow_.6GFhiUXm4srwhQafMxbw--BfrqoYOBG_0 2024-09-14T12:01:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.825+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.900963628607082704', time=2024-09-14T13:39:06.623033+0000, chain.objs.size()=1 2024-09-14T12:01:17.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.825+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.504__shadow:-Styd.oxB8SSr1oI0lFwKs5hFqmwg-w_.MvQogDl8WgMpFFuD7AaaxQ0tKLuN8vP_0 2024-09-14T12:01:17.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.825+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4265140000509802843', time=2024-09-14T13:39:34.740685+0000, chain.objs.size()=6 2024-09-14T12:01:17.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.825+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.1 2024-09-14T12:01:17.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.825+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.2 2024-09-14T12:01:17.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.825+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.3 2024-09-14T12:01:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.827+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.4 2024-09-14T12:01:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.827+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.5 2024-09-14T12:01:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.827+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.6 2024-09-14T12:01:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.827+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~h42sVAjWyRH5uVWoZ6cZJqdFJlVVAij', time=2024-09-14T13:41:14.240078+0000, chain.objs.size()=1 2024-09-14T12:01:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.827+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~h42sVAjWyRH5uVWoZ6cZJqdFJlVVAij.2 2024-09-14T12:01:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.827+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5199811028159289610', time=2024-09-14T13:44:49.834127+0000, chain.objs.size()=1 2024-09-14T12:01:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.827+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.554__shadow_.0yY0a5xjLMIAwPimd-FEp5DbPxRDwu5_0 2024-09-14T12:01:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.827+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17559033168619112591', time=2024-09-14T13:45:38.011172+0000, chain.objs.size()=1 2024-09-14T12:01:17.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.827+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:h-yqQfki.K2s45RjTBsPk4GuYGLHLDR_.UYAS_B-qp47_EjqGa4S8jPlI6eU1Q3j_0 2024-09-14T12:01:17.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.827+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12391485412020014556', time=2024-09-14T13:45:48.161874+0000, chain.objs.size()=1 2024-09-14T12:01:17.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.827+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.571__shadow:uv-0cJeWkoGUYjRd-pjw5ORsgxcZfEQ_.N5aQG7JQFsttuLE8jmswei1P8uVEc_n_0 2024-09-14T12:01:17.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.828+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5161258689852077441', time=2024-09-14T13:45:55.998554+0000, chain.objs.size()=1 2024-09-14T12:01:17.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.828+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.575__shadow:ZdAmLbEjRrq.yGMRMjIVU9nIDxqhSxk_.Ui_jeuDjyEmlOIGs1atYSZJjX8_bWuW_0 2024-09-14T12:01:17.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.828+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9120579582595268329', time=2024-09-14T13:46:10.980026+0000, chain.objs.size()=1 2024-09-14T12:01:17.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.828+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:PoPyyqZW-3Ym.IRTx0HvThbOwQpg9ca_.xH73MTKcZ6SJLfkAlq9k77X1tlL9l2J_0 2024-09-14T12:01:17.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.829+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4456797206792762710', time=2024-09-14T13:46:17.681275+0000, chain.objs.size()=1 2024-09-14T12:01:17.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.829+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:2xzazT0uM9Hz12FgMSD2yEU4m9LPHj4_.adkEPJgJUTFvnryXHUJMLvfU3SM_sHB_0 2024-09-14T12:01:17.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.829+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2491505610790565129', time=2024-09-14T13:47:12.382947+0000, chain.objs.size()=1 2024-09-14T12:01:17.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.829+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.581__shadow:VqAkxRUaK0oByVBmxatmd2srWu1m6gv_.maGy89MMbip7Cwj8UlRVtNNVwDQSN-v_0 2024-09-14T12:01:17.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.831+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6051179437334070399', time=2024-09-14T13:47:30.795327+0000, chain.objs.size()=1 2024-09-14T12:01:17.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.831+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.597__shadow_.ppZDmE2gnN0yOZFn7KeIVpG0jot4qDs_0 2024-09-14T12:01:17.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.831+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3187062470335958043', time=2024-09-14T13:52:43.035309+0000, chain.objs.size()=1 2024-09-14T12:01:17.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.831+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.631__shadow_.qsTd4k_-wgcCm6OWHxVY48CsZ-DrBHB_0 2024-09-14T12:01:17.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.831+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6397514555674718106', time=2024-09-14T13:53:56.306744+0000, chain.objs.size()=1 2024-09-14T12:01:17.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.831+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.665__shadow_.rg5LLYgnCdbmLZpZPlwtc135dAFbY_l_0 2024-09-14T12:01:17.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.831+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3486711663270683656', time=2024-09-14T13:58:32.375420+0000, chain.objs.size()=1 2024-09-14T12:01:17.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.831+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.775__shadow_.-t1-EOuNwybt43FgLBtAFySoq5b9w5i_0 2024-09-14T12:01:17.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.834+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:17.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.836+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T12:01:17.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.838+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:17.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.838+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:17.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.839+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49616' 2024-09-14T12:01:17.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.839+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5743305197403825238', time=2024-09-14T13:28:18.831882+0000, chain.objs.size()=3 2024-09-14T12:01:17.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.839+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.162__multipart_foo-LUKEWARM.2~DZ3-RzGp6rAKik9lLnVeqZWdDVH4kwd.1 2024-09-14T12:01:17.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.839+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.162__multipart_foo-LUKEWARM.2~DZ3-RzGp6rAKik9lLnVeqZWdDVH4kwd.2 2024-09-14T12:01:17.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.839+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.162__multipart_foo-LUKEWARM.2~DZ3-RzGp6rAKik9lLnVeqZWdDVH4kwd.3 2024-09-14T12:01:17.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.839+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4011578368487228157', time=2024-09-14T13:29:00.439037+0000, chain.objs.size()=1 2024-09-14T12:01:17.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.840+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.180__shadow_.mfKQhVcqemBaZb3rqYXmZJKACJHnfKh_0 2024-09-14T12:01:17.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.840+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8332809317734964318', time=2024-09-14T13:31:41.016794+0000, chain.objs.size()=1 2024-09-14T12:01:17.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.840+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.238__shadow_.E29axfOfd08bz4kQghh7bjn9nD-zaR0_0 2024-09-14T12:01:17.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.840+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6719392860809878673', time=2024-09-14T13:31:54.022511+0000, chain.objs.size()=1 2024-09-14T12:01:17.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.840+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.248__shadow_.-Mx2dQVwpbTW_3AnolAvF7BaWNsar17_0 2024-09-14T12:01:17.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.840+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7218320410568162412', time=2024-09-14T13:32:00.602937+0000, chain.objs.size()=1 2024-09-14T12:01:17.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.840+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.254__shadow_._b1dOJn__3SL0hIP8bebzUHaATqdwNo_0 2024-09-14T12:01:17.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.840+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7586000568860205880', time=2024-09-14T13:32:02.798777+0000, chain.objs.size()=1 2024-09-14T12:01:17.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.840+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.256__shadow_.FJbErPXiAHzK7FxK_BAFQ5_mAOVif3F_0 2024-09-14T12:01:17.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.840+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8154810566523982237', time=2024-09-14T13:32:47.573241+0000, chain.objs.size()=1 2024-09-14T12:01:17.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.840+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.xYwzJeRP2w_9KdscOk-DdjDZmO7KYyL_0 2024-09-14T12:01:17.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.840+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14598607998277085233', time=2024-09-14T13:32:47.602995+0000, chain.objs.size()=1 2024-09-14T12:01:17.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.840+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.-oiQVG1nGxo7B3ObLmQU70zq96boWM1_0 2024-09-14T12:01:17.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.840+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15752432613261379166', time=2024-09-14T13:32:47.633092+0000, chain.objs.size()=1 2024-09-14T12:01:17.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.840+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.6JUdxJTdX2YqyOXdmnGTgzdutsMlHkF_0 2024-09-14T12:01:17.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.840+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12674385411395608139', time=2024-09-14T13:32:48.042428+0000, chain.objs.size()=1 2024-09-14T12:01:17.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.840+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.kuo0RL26TCkFUASs1d-TgKYEQww0b-__0 2024-09-14T12:01:17.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.844+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5392806178764563379', time=2024-09-14T13:32:48.180733+0000, chain.objs.size()=1 2024-09-14T12:01:17.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.844+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.9ReRHqKYQdCFHkNaX2r5cakIXFkwXco_0 2024-09-14T12:01:17.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.844+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16517379402220837801', time=2024-09-14T13:32:48.352311+0000, chain.objs.size()=1 2024-09-14T12:01:17.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.844+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.xjSbyQfZ-8TyktQXWMA_JOoyLv02pgM_0 2024-09-14T12:01:17.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.844+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13511626070076866181', time=2024-09-14T13:32:48.479687+0000, chain.objs.size()=1 2024-09-14T12:01:17.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.844+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.fs7yOgorMNpMAc7HhD6FuQrY9zqD6qr_0 2024-09-14T12:01:17.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.844+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11280015409450230850', time=2024-09-14T13:32:49.165872+0000, chain.objs.size()=1 2024-09-14T12:01:17.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.844+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.dzgY8sbBA8gj2kxXk54K9K3gBIyKQLs_0 2024-09-14T12:01:17.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.844+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6776060997539582512', time=2024-09-14T13:32:49.400431+0000, chain.objs.size()=1 2024-09-14T12:01:17.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.844+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.xpFysz7zF46KDQFcaixnGfR6mdJ0Es8_0 2024-09-14T12:01:17.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.844+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2171477656470823788', time=2024-09-14T13:32:49.851130+0000, chain.objs.size()=1 2024-09-14T12:01:17.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.844+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.GSi97BJpqAJabH6jbAmFVLcsKxx8ovs_0 2024-09-14T12:01:17.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.844+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.170271522738007434', time=2024-09-14T13:32:49.941660+0000, chain.objs.size()=1 2024-09-14T12:01:17.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.844+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.0zGjTtDz7SihOYAfp6f2rFFQAcrB03Y_0 2024-09-14T12:01:17.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.844+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10889595480529999040', time=2024-09-14T13:32:50.689455+0000, chain.objs.size()=1 2024-09-14T12:01:17.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.844+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.n2ko_onn7RCTFnh3D7hWt5Br_FI1KQF_0 2024-09-14T12:01:17.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.844+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3211086789835180089', time=2024-09-14T13:32:50.691210+0000, chain.objs.size()=1 2024-09-14T12:01:17.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.844+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.jIHQNRp8fk-7MlswP4GbKjlyad5qBzT_0 2024-09-14T12:01:17.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.844+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11346387490837518053', time=2024-09-14T13:32:51.140447+0000, chain.objs.size()=1 2024-09-14T12:01:17.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.844+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.wf9cBgV-DGpM-N6hsqkcxaiQxEB0cVw_0 2024-09-14T12:01:17.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.844+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14810611302463170698', time=2024-09-14T13:32:51.428730+0000, chain.objs.size()=1 2024-09-14T12:01:17.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.844+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.R-H6ihj9BZB8Z6hLfelcmVLEtNckUK__0 2024-09-14T12:01:17.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.847+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9808806767541581381', time=2024-09-14T13:32:51.525843+0000, chain.objs.size()=1 2024-09-14T12:01:17.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.847+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.bK-MSZ-Qyi3IrXEDXoAY1eCzA9eYXmy_0 2024-09-14T12:01:17.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.847+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15283773118162275690', time=2024-09-14T13:32:53.037460+0000, chain.objs.size()=1 2024-09-14T12:01:17.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.847+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_._wefL1Ly2M00382RlYZsEqDWzG7nBiK_0 2024-09-14T12:01:17.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.849+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12586841533213469591', time=2024-09-14T13:32:53.050891+0000, chain.objs.size()=1 2024-09-14T12:01:17.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.849+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ah33IOM_sYUDm2763y-rQdJTxkQHtsg_0 2024-09-14T12:01:17.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.849+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11424902353689478407', time=2024-09-14T13:32:53.106023+0000, chain.objs.size()=1 2024-09-14T12:01:17.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.849+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ctB_6ul1UlzYzFaA_9A0jILrjCWWSwA_0 2024-09-14T12:01:17.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.849+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15307470454947523050', time=2024-09-14T13:32:53.553619+0000, chain.objs.size()=1 2024-09-14T12:01:17.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.849+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.sAes17CrRupmgs1nJViun3_PIsG2mNw_0 2024-09-14T12:01:17.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.849+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14613151603643346424', time=2024-09-14T13:32:53.701517+0000, chain.objs.size()=1 2024-09-14T12:01:17.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.849+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.lVy6jjh2jwi4do8VCuwp_E5tA4w56D2_0 2024-09-14T12:01:17.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.849+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4001513867093587905', time=2024-09-14T13:32:53.848088+0000, chain.objs.size()=1 2024-09-14T12:01:17.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.849+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.aDTbqCBko8jKV73N3LRuUGhAo9OOSTX_0 2024-09-14T12:01:17.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.849+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9097971354959828049', time=2024-09-14T13:32:54.216967+0000, chain.objs.size()=1 2024-09-14T12:01:17.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.849+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.AkWskmjfRbZ7lp9H7hj54wOnwe_4Qjc_0 2024-09-14T12:01:17.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.849+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14151146284728297596', time=2024-09-14T13:32:54.500018+0000, chain.objs.size()=1 2024-09-14T12:01:17.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.849+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.w6wg1Jtc50hqMKbVoWRRW77gkoXjioi_0 2024-09-14T12:01:17.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.849+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12663125508169705507', time=2024-09-14T13:32:54.582439+0000, chain.objs.size()=1 2024-09-14T12:01:17.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.849+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ODRdrIaTURwugELov4ImtdlN7jBzfM0_0 2024-09-14T12:01:17.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.849+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8161639053172323248', time=2024-09-14T13:32:54.989076+0000, chain.objs.size()=1 2024-09-14T12:01:17.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.849+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.fpEhkSkXc-tb57myFKajZOShFOB8_LK_0 2024-09-14T12:01:17.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.851+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2724917488728931554', time=2024-09-14T13:32:55.085477+0000, chain.objs.size()=1 2024-09-14T12:01:17.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.851+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.FkoZ0oiLdoFzVYV-H1O5uOyrbqw7w0r_0 2024-09-14T12:01:17.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.851+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8822827409955823344', time=2024-09-14T13:32:55.816918+0000, chain.objs.size()=1 2024-09-14T12:01:17.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.851+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.uCdxx_vjGTuqrT9NVNvDFLpkn09zxFa_0 2024-09-14T12:01:17.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.852+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.965926084254435318', time=2024-09-14T13:32:55.919370+0000, chain.objs.size()=1 2024-09-14T12:01:17.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.852+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.8NOQmW6vl9KJQYPy2cprsoXlkMD8JEa_0 2024-09-14T12:01:17.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.852+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8877837867463250664', time=2024-09-14T13:32:55.920203+0000, chain.objs.size()=1 2024-09-14T12:01:17.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.852+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.qdtWVQ_i0laIcxp6UqOoGJNFiwVFAAb_0 2024-09-14T12:01:17.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.852+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.582508744139270135', time=2024-09-14T13:32:56.554525+0000, chain.objs.size()=1 2024-09-14T12:01:17.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.852+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.zqKvkj5YDU19WDiYXMC4RNA1LJSyDz5_0 2024-09-14T12:01:17.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.853+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13944608188805412005', time=2024-09-14T13:32:56.918472+0000, chain.objs.size()=1 2024-09-14T12:01:17.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.853+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.L3FFlnHJ13Z2dS7RiuN9ukJU9jjE1td_0 2024-09-14T12:01:17.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.855+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13798986670561144043', time=2024-09-14T13:32:57.090062+0000, chain.objs.size()=1 2024-09-14T12:01:17.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.855+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Rs9LleGG805Ho_A5HCgRUWh18JZ91aA_0 2024-09-14T12:01:17.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.855+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12228346726137082264', time=2024-09-14T13:32:57.766944+0000, chain.objs.size()=1 2024-09-14T12:01:17.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.855+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.LlxwZ00leTVvieGqbsrxM5nVj0RZkUS_0 2024-09-14T12:01:17.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.855+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9098284855665992413', time=2024-09-14T13:32:57.853530+0000, chain.objs.size()=1 2024-09-14T12:01:17.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.855+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.usN9xOiQhiTP-1rq9q2nZRxsAYm0_g4_0 2024-09-14T12:01:17.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.855+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14925355932489762048', time=2024-09-14T13:32:57.919954+0000, chain.objs.size()=1 2024-09-14T12:01:17.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.855+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.AvfZ3y6rz8wtXC4od7sLP1HzkzCsN_Z_0 2024-09-14T12:01:17.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.855+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15715098302851185379', time=2024-09-14T13:32:57.943698+0000, chain.objs.size()=1 2024-09-14T12:01:17.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.855+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.aqY3KwmARo3PXFvjgB_UIx4BeV78ESt_0 2024-09-14T12:01:17.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.855+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16962569253565257760', time=2024-09-14T13:32:58.211683+0000, chain.objs.size()=1 2024-09-14T12:01:17.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.855+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.eVIwrKG6QHOpxX_aKAFUfczJCARgeWC_0 2024-09-14T12:01:17.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.855+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2088217174102522930', time=2024-09-14T13:33:04.032560+0000, chain.objs.size()=1 2024-09-14T12:01:17.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.855+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.268__shadow_.HdrG5NeHG_35FdUpoRqEQOwxzZMdJyn_0 2024-09-14T12:01:17.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.855+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13102674081983785028', time=2024-09-14T13:33:06.131797+0000, chain.objs.size()=1 2024-09-14T12:01:17.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.855+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.270__shadow_.pBtu5agxWN0brKyxwrhd7OlX9txk9Jf_0 2024-09-14T12:01:17.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.855+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10894179715387296594', time=2024-09-14T13:33:20.369451+0000, chain.objs.size()=1 2024-09-14T12:01:17.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.855+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.283__shadow_.7slvDPWSveFhhsTprhy_58lpjM9POXJ_0 2024-09-14T12:01:17.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.856+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2447144644537711138', time=2024-09-14T13:33:23.760072+0000, chain.objs.size()=1 2024-09-14T12:01:17.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.856+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.286__shadow_.ni--77qCHVxRxCLv6FwrMTjgxzaarSX_0 2024-09-14T12:01:17.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.858+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13504530700662211336', time=2024-09-14T13:33:29.278560+0000, chain.objs.size()=1 2024-09-14T12:01:17.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.858+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.291__shadow_.mejFF-2-Ux7mnOtyV41jua42l_RK7U1_0 2024-09-14T12:01:17.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.858+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12492068912953558986', time=2024-09-14T13:33:35.628479+0000, chain.objs.size()=1 2024-09-14T12:01:17.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.858+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.3el-zcsQX2nupsvtAt7fga5Tc3CSz4G_0 2024-09-14T12:01:17.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.859+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16109343202811003004', time=2024-09-14T13:33:36.755235+0000, chain.objs.size()=1 2024-09-14T12:01:17.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.859+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.295__shadow_.1Vds9P8k30n4S6Ebwfx8fcgfBxkct5E_0 2024-09-14T12:01:17.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.859+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5533480949042530603', time=2024-09-14T13:33:43.461319+0000, chain.objs.size()=1 2024-09-14T12:01:17.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.859+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.301__shadow_.T4VGXOSJO9b5TJOtQ0lHcSXNppxU5Hm_0 2024-09-14T12:01:17.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.859+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15862826912032546881', time=2024-09-14T13:33:58.594680+0000, chain.objs.size()=1 2024-09-14T12:01:17.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.859+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.314__shadow_.zDnp88ErSTE1gmc66jlyJCxvcBtNOVC_0 2024-09-14T12:01:17.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.860+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5570825140102308643', time=2024-09-14T13:34:51.806168+0000, chain.objs.size()=1 2024-09-14T12:01:17.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.860+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.eBHwQJSgJIRUZIg0GhZSzYLZ55WjVd3_0 2024-09-14T12:01:17.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.861+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3097449271454693318', time=2024-09-14T13:34:51.847450+0000, chain.objs.size()=1 2024-09-14T12:01:17.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.861+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.7ojl7cgESwQFEJLVRibAMh2r-f5OTS0_0 2024-09-14T12:01:17.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.861+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16464632111688443962', time=2024-09-14T13:34:52.256022+0000, chain.objs.size()=1 2024-09-14T12:01:17.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.861+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ieZr-JnTPxAtyPCTKo-p9da5i_LVoCv_0 2024-09-14T12:01:17.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.861+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15659800649370659298', time=2024-09-14T13:34:52.304483+0000, chain.objs.size()=1 2024-09-14T12:01:17.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.861+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.6GN93SvtMn_pcjp_4HumRJIsLc4Y-UF_0 2024-09-14T12:01:17.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.861+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8058758287251552603', time=2024-09-14T13:34:53.259888+0000, chain.objs.size()=1 2024-09-14T12:01:17.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.861+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.aNXHkfRf4mwyINbgLLocX7l08c_-LUe_0 2024-09-14T12:01:17.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.861+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5710590280728328715', time=2024-09-14T13:34:53.402151+0000, chain.objs.size()=1 2024-09-14T12:01:17.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.861+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.7as-KhBjnZyW_imMv9UVcDPMIckqkkF_0 2024-09-14T12:01:17.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.862+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10283415004253399470', time=2024-09-14T13:34:53.419522+0000, chain.objs.size()=1 2024-09-14T12:01:17.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.862+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.5_PJlVVDkmc7xqI6tK_D4TB7VTKzzxM_0 2024-09-14T12:01:17.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.862+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17237921027220619252', time=2024-09-14T13:34:53.499264+0000, chain.objs.size()=1 2024-09-14T12:01:17.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.862+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.dPXN-6haSnJGLM8a542V0hdummL2Ukk_0 2024-09-14T12:01:17.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.864+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16100002658180109912', time=2024-09-14T13:34:53.816013+0000, chain.objs.size()=1 2024-09-14T12:01:17.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.864+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.F8HOjACf1vKWYXOXFV5w3yPX_9x_9El_0 2024-09-14T12:01:17.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.864+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17245859782340730752', time=2024-09-14T13:34:54.702329+0000, chain.objs.size()=1 2024-09-14T12:01:17.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.864+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.kCT5Na6jIikB12HGHTrt8mzDmevy7_I_0 2024-09-14T12:01:17.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.864+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18429011395810645400', time=2024-09-14T13:34:54.831780+0000, chain.objs.size()=1 2024-09-14T12:01:17.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.864+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Ly851dxlvivq5nSA2Hux3oQu8z9ni4r_0 2024-09-14T12:01:17.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.864+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9607218138320536413', time=2024-09-14T13:34:55.112309+0000, chain.objs.size()=1 2024-09-14T12:01:17.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.864+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Nr72_Kn1JtzKaIk5BzF0FzSsxQoO-TM_0 2024-09-14T12:01:17.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.865+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1666771792883292775', time=2024-09-14T13:34:55.157304+0000, chain.objs.size()=1 2024-09-14T12:01:17.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.865+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.u5_rkhoBUQroSeLBNKiOVEUprSZZoXh_0 2024-09-14T12:01:17.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.865+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13871840015691028047', time=2024-09-14T13:34:56.499415+0000, chain.objs.size()=1 2024-09-14T12:01:17.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.865+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.nPVScEWjKzU2fY6f7p9W3g6K0-QXOXt_0 2024-09-14T12:01:17.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.865+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.898992171651100190', time=2024-09-14T13:34:56.557579+0000, chain.objs.size()=1 2024-09-14T12:01:17.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.865+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Mb6I3XgvyMse720ZultZ2AA0LbK0wv2_0 2024-09-14T12:01:17.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.866+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7899463910649785391', time=2024-09-14T13:34:56.674528+0000, chain.objs.size()=1 2024-09-14T12:01:17.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.866+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.3xiXET3S_JA0zkQdPgrVbpl6hP_cW7S_0 2024-09-14T12:01:17.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.866+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9350722155236329914', time=2024-09-14T13:34:56.818452+0000, chain.objs.size()=1 2024-09-14T12:01:17.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.866+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.5yejJhR1za-DV08Fsu3mmbVI6REYh71_0 2024-09-14T12:01:17.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.866+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10030526647982897950', time=2024-09-14T13:34:58.118412+0000, chain.objs.size()=1 2024-09-14T12:01:17.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.866+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.0T4SM4QaBZgT07jFDrUslSM6tRs7_sB_0 2024-09-14T12:01:17.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.866+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11847571187391854416', time=2024-09-14T13:34:58.119222+0000, chain.objs.size()=1 2024-09-14T12:01:17.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.866+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.yh1uMXi0y57C8GjfDKyCrSGrZWTna_x_0 2024-09-14T12:01:17.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.868+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12896231317901009013', time=2024-09-14T13:34:58.679369+0000, chain.objs.size()=1 2024-09-14T12:01:17.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.868+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.paof9sQTJIlNUQiiurZogYQidGVcYFK_0 2024-09-14T12:01:17.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.868+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1263836598544781352', time=2024-09-14T13:34:58.707939+0000, chain.objs.size()=1 2024-09-14T12:01:17.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.868+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.IhJ7K3LEBxnkQlr7qfulPEVuiLeq-AY_0 2024-09-14T12:01:17.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.868+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12498548372795758460', time=2024-09-14T13:34:59.242639+0000, chain.objs.size()=1 2024-09-14T12:01:17.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.868+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.AIQ4Gx9VAGRihyRz0NHlrL3Goit_yBx_0 2024-09-14T12:01:17.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.869+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5105486290593873491', time=2024-09-14T13:34:59.374357+0000, chain.objs.size()=1 2024-09-14T12:01:17.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.869+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.F8l_fECeUMettRWrTonpvpBZmUg4jO5_0 2024-09-14T12:01:17.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.869+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17758916991720439955', time=2024-09-14T13:34:59.375195+0000, chain.objs.size()=1 2024-09-14T12:01:17.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.869+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Zn-Um6eAnKkuA7A2b4cd07No0yMDgu5_0 2024-09-14T12:01:17.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.869+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14150683236385604024', time=2024-09-14T13:35:00.045333+0000, chain.objs.size()=1 2024-09-14T12:01:17.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.869+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.KEbq5VUsH5EVS2LD_l2WuAlTMycuHi3_0 2024-09-14T12:01:17.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.869+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3921638955697150920', time=2024-09-14T13:35:00.763097+0000, chain.objs.size()=1 2024-09-14T12:01:17.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.869+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.iOQEjnV8Y27lfkx05iXgZxzSG78zk9L_0 2024-09-14T12:01:17.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.869+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9680726026556008451', time=2024-09-14T13:35:01.015854+0000, chain.objs.size()=1 2024-09-14T12:01:17.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.869+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Kqa-nM8pDJdSosXbVro3AHz6u-xBlMp_0 2024-09-14T12:01:17.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.869+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9448242768616078251', time=2024-09-14T13:35:01.323125+0000, chain.objs.size()=1 2024-09-14T12:01:17.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.869+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.R6bJqXjfN30O6Gr2AjnU4ZgGjJEwfV8_0 2024-09-14T12:01:17.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.870+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18300250975226665264', time=2024-09-14T13:35:01.394708+0000, chain.objs.size()=1 2024-09-14T12:01:17.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.870+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.riBCKMflxFaF_CO7AnjNvH-SFOm3Dc__0 2024-09-14T12:01:17.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.870+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2759542362242420771', time=2024-09-14T13:35:01.916172+0000, chain.objs.size()=1 2024-09-14T12:01:17.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.870+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.lEl0uNV2Au9yvLjmINVgYclAkR1jVtb_0 2024-09-14T12:01:17.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.870+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18163899269390886740', time=2024-09-14T13:35:02.081902+0000, chain.objs.size()=1 2024-09-14T12:01:17.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.870+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.589LBGZhXp5jNC0bbloh-YUm_695YeL_0 2024-09-14T12:01:17.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.872+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5761452916273067106', time=2024-09-14T13:35:02.395160+0000, chain.objs.size()=1 2024-09-14T12:01:17.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.872+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.cMBr5VqubgrYXa0vH3C--bU6sTSZ6CP_0 2024-09-14T12:01:17.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.873+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.85527884214244461', time=2024-09-14T13:35:02.610658+0000, chain.objs.size()=1 2024-09-14T12:01:17.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.873+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.UGdz4AQAeWpQr62rJRExAOSSxyFxLs9_0 2024-09-14T12:01:17.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.874+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8389177298326335541', time=2024-09-14T13:35:41.824188+0000, chain.objs.size()=1 2024-09-14T12:01:17.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.874+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.VNTpmbKmDKrnC4geDrhKEaFF8BgAEzb_0 2024-09-14T12:01:17.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.874+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12736028327415008918', time=2024-09-14T13:35:41.825347+0000, chain.objs.size()=1 2024-09-14T12:01:17.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.874+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.nLQ0DlYqGnNQTR-qgitaS1GSYE-X887_0 2024-09-14T12:01:17.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.874+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9798692673919963194', time=2024-09-14T13:35:41.936189+0000, chain.objs.size()=1 2024-09-14T12:01:17.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.874+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.QZ0i78JEzrHGll4PV6Wuqvm1EvMd89K_0 2024-09-14T12:01:17.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.874+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9299686684560133177', time=2024-09-14T13:35:41.937103+0000, chain.objs.size()=1 2024-09-14T12:01:17.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.874+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.CcUUrrSBdRCJyXPI-CkEPYQaWqwmHRq_0 2024-09-14T12:01:17.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.874+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6101323244347109782', time=2024-09-14T13:35:42.050283+0000, chain.objs.size()=1 2024-09-14T12:01:17.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.874+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.jaSw1QcGEXPyuYxuVYPuVtdoFxaoUJn_0 2024-09-14T12:01:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.875+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9336635540113984382', time=2024-09-14T13:35:42.552963+0000, chain.objs.size()=1 2024-09-14T12:01:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.875+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.OMezrk-DRNstpoQSN14tTLBKj9YrGQQ_0 2024-09-14T12:01:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.875+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1414936783437554526', time=2024-09-14T13:35:43.249281+0000, chain.objs.size()=1 2024-09-14T12:01:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.875+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.GlmpG-6Htf8JIVi4cnQa3_UWscz57cE_0 2024-09-14T12:01:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.875+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13837567018716781498', time=2024-09-14T13:35:43.863807+0000, chain.objs.size()=1 2024-09-14T12:01:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.875+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.thNIXbVJYd6Z3L8gKFrn6DLUUHNzADK_0 2024-09-14T12:01:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.875+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5595466687739281008', time=2024-09-14T13:35:43.867091+0000, chain.objs.size()=1 2024-09-14T12:01:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.875+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.9fRJLF8tJ2NQK1wyvuKnm3riCPXhQ_d_0 2024-09-14T12:01:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.875+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15685166185982885618', time=2024-09-14T13:35:44.125780+0000, chain.objs.size()=1 2024-09-14T12:01:17.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.875+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.L2biETkw7em20q0SdhwoI-IzuopLp29_0 2024-09-14T12:01:17.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.877+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10628169933778116710', time=2024-09-14T13:35:44.288567+0000, chain.objs.size()=1 2024-09-14T12:01:17.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.877+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.cfbCsBNtBSFO3tviLpOKuPDbR4eN6VZ_0 2024-09-14T12:01:17.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.878+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13084202157118637397', time=2024-09-14T13:35:44.328734+0000, chain.objs.size()=1 2024-09-14T12:01:17.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.878+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.T1FKFEeQS1bazCiQWPrkknJYC3_gqyg_0 2024-09-14T12:01:17.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.879+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7270820117920830334', time=2024-09-14T13:35:44.955994+0000, chain.objs.size()=1 2024-09-14T12:01:17.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.879+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.mPOzo0UwdMdG6M_lzxe-JVZJhTEvfcz_0 2024-09-14T12:01:17.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.879+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9512343037191508195', time=2024-09-14T13:35:45.490938+0000, chain.objs.size()=1 2024-09-14T12:01:17.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.879+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.4C87vZeOHqjeuPdOHHHVW5tNM8l-BEq_0 2024-09-14T12:01:17.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.881+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/49616 2024-09-14T12:01:17.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=40, truncated=0, next_marker='' 2024-09-14T12:01:17.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5688034750606521408', time=2024-09-14T13:35:45.491508+0000, chain.objs.size()=1 2024-09-14T12:01:17.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Mys_PvMo8ePajDwCWi-cs6WMU4Zhx66_0 2024-09-14T12:01:17.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3362776308982302759', time=2024-09-14T13:35:45.724381+0000, chain.objs.size()=1 2024-09-14T12:01:17.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.0cLkdOShY_PZ9DEeXO-MNUYkpq2ntRO_0 2024-09-14T12:01:17.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10953868423174353355', time=2024-09-14T13:35:45.738003+0000, chain.objs.size()=1 2024-09-14T12:01:17.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.CPjhWYrEqQy9aiZMHM6kcYIg48-eoBi_0 2024-09-14T12:01:17.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10073033842452094280', time=2024-09-14T13:35:45.823427+0000, chain.objs.size()=1 2024-09-14T12:01:17.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.xrMujTAz-zTbkF065Q59eJiW7gCdyif_0 2024-09-14T12:01:17.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5587146334673657320', time=2024-09-14T13:35:46.439433+0000, chain.objs.size()=1 2024-09-14T12:01:17.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.JTp70Ck5mz-GRKC-CXo_sujyqVxusuA_0 2024-09-14T12:01:17.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11519036367444645884', time=2024-09-14T13:35:46.472742+0000, chain.objs.size()=1 2024-09-14T12:01:17.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.LYkuBVe-dRqOXbJx12W8DrdYO6ifXw9_0 2024-09-14T12:01:17.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18282167088660888368', time=2024-09-14T13:35:46.822830+0000, chain.objs.size()=1 2024-09-14T12:01:17.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.DuoGIYSbDTWweFooB8HFzKpiMMkcm48_0 2024-09-14T12:01:17.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10522197121542415944', time=2024-09-14T13:35:46.962079+0000, chain.objs.size()=1 2024-09-14T12:01:17.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.kqQs11HwLdoBdInpxS8J319q82v1JwF_0 2024-09-14T12:01:17.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8965471081664234012', time=2024-09-14T13:35:47.118133+0000, chain.objs.size()=1 2024-09-14T12:01:17.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.KrqHyuvaR4nBmJXiRvfPhfEEdk56oIb_0 2024-09-14T12:01:17.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.337451742196224679', time=2024-09-14T13:35:47.780863+0000, chain.objs.size()=1 2024-09-14T12:01:17.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.usqZrkl7wRRNRRQ7nNxFYrZPwpTg_SU_0 2024-09-14T12:01:17.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15699380055539574571', time=2024-09-14T13:35:48.040873+0000, chain.objs.size()=1 2024-09-14T12:01:17.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.JUNIM1gNF2V2-IONpQFSGKQJYno_6-0_0 2024-09-14T12:01:17.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9065887996692621520', time=2024-09-14T13:35:48.227674+0000, chain.objs.size()=1 2024-09-14T12:01:17.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.883+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.meZKzN9rhrhJPNVGAJs4bs9r4haJLoA_0 2024-09-14T12:01:17.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.885+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6470024270667065349', time=2024-09-14T13:35:48.626280+0000, chain.objs.size()=1 2024-09-14T12:01:17.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.885+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.875E8Jha7LtSsk-NTFFhkhEVX2MwKiQ_0 2024-09-14T12:01:17.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.885+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3134919406973555255', time=2024-09-14T13:35:49.220091+0000, chain.objs.size()=1 2024-09-14T12:01:17.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.885+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.VhiRHTMIblWOHJp-EY_vhFoESurVyyK_0 2024-09-14T12:01:17.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.886+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9806095859607066506', time=2024-09-14T13:35:49.387757+0000, chain.objs.size()=1 2024-09-14T12:01:17.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.886+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.pk3ar18ZbYlmeATEwzk4K80L0qTej_e_0 2024-09-14T12:01:17.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.886+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3012143752322372001', time=2024-09-14T13:35:49.686228+0000, chain.objs.size()=1 2024-09-14T12:01:17.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.886+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.hUg0SfH2OKCwOgEfS0WERbg5Z7rvg9s_0 2024-09-14T12:01:17.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.886+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5923693266208951379', time=2024-09-14T13:35:49.869788+0000, chain.objs.size()=1 2024-09-14T12:01:17.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.886+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.1lRPnp0BFp6ct43m_HZ_3l8ytdRRw6F_0 2024-09-14T12:01:17.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.887+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15074472026681370903', time=2024-09-14T13:35:50.061843+0000, chain.objs.size()=1 2024-09-14T12:01:17.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.887+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.cy6rWojA6Pu2l7eVVOmqTEkGCAvEXiO_0 2024-09-14T12:01:17.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.887+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4312748255885334325', time=2024-09-14T13:35:50.176358+0000, chain.objs.size()=1 2024-09-14T12:01:17.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.887+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_._GQ8zByrWsILcyuV8HhzY-sXcLqGWfa_0 2024-09-14T12:01:17.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.887+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11995709148814582678', time=2024-09-14T13:35:50.598848+0000, chain.objs.size()=1 2024-09-14T12:01:17.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.887+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.3Yij0xabNfOsAmBdEzOYR875hFRSCxu_0 2024-09-14T12:01:17.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.887+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9775866833621119065', time=2024-09-14T13:35:51.432103+0000, chain.objs.size()=1 2024-09-14T12:01:17.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.887+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.wk3CCOcXtMzJtosc5RaPEqSNQmwyMY1_0 2024-09-14T12:01:17.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.887+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9312024766158520313', time=2024-09-14T13:35:52.308980+0000, chain.objs.size()=1 2024-09-14T12:01:17.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.887+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.SfzXGIpJaMc_xi9Y1crygW2ZQUDwVwG_0 2024-09-14T12:01:17.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.888+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15397001808291506233', time=2024-09-14T13:35:52.452253+0000, chain.objs.size()=1 2024-09-14T12:01:17.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.888+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Bia3nr2EvTy4emeQrhY9yncFC_mQlYH_0 2024-09-14T12:01:17.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.889+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.732511478990476777', time=2024-09-14T13:35:52.491567+0000, chain.objs.size()=1 2024-09-14T12:01:17.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.889+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.VvV02KL0h7cv62Rb7Q61szU_L7thdse_0 2024-09-14T12:01:17.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.889+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13614981671970316915', time=2024-09-14T13:35:52.534704+0000, chain.objs.size()=1 2024-09-14T12:01:17.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.889+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.6JEndnD3tc0qHl363eB8pC_8bDu2Xd7_0 2024-09-14T12:01:17.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.890+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16073697852114684134', time=2024-09-14T13:35:52.750586+0000, chain.objs.size()=1 2024-09-14T12:01:17.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.890+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.PAzbstVYa6weHfGHJXq2HRd1rYcEZLD_0 2024-09-14T12:01:17.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.890+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6270823017699771735', time=2024-09-14T13:38:16.522840+0000, chain.objs.size()=1 2024-09-14T12:01:17.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.890+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.458__shadow_.Wj8KYVhicXnDec_XIv9ITCF66UG2lk1_0 2024-09-14T12:01:17.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.890+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4966670534148169701', time=2024-09-14T13:38:25.564754+0000, chain.objs.size()=1 2024-09-14T12:01:17.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.890+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.464__shadow_.Slu5z3IWF2WBgCOGNKK_UZFauS_fui7_0 2024-09-14T12:01:17.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.892+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3291543188519311308', time=2024-09-14T13:38:55.964222+0000, chain.objs.size()=1 2024-09-14T12:01:17.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.892+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.494__shadow_.JdcQNAuC9vMBkR53x1lmi5khbh8FHxD_0 2024-09-14T12:01:17.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.892+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16830679710071009652', time=2024-09-14T13:39:49.643549+0000, chain.objs.size()=1 2024-09-14T12:01:17.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.892+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.519__multipart_mymultipart.2~9dDKh05EKF2GaNL_TgJuLNbCEITItwt.1 2024-09-14T12:01:17.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.892+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4012078300150218810', time=2024-09-14T13:41:57.672715+0000, chain.objs.size()=6 2024-09-14T12:01:17.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.892+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~rwOAgZAIeo-lJgjfx1s2eVn_5nRk7GV.1 2024-09-14T12:01:17.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.892+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~rwOAgZAIeo-lJgjfx1s2eVn_5nRk7GV.2 2024-09-14T12:01:17.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.892+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.JhkA1_cwIlwzNA8kiUWIbaiGAN3FZekN.3 2024-09-14T12:01:17.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.892+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~rwOAgZAIeo-lJgjfx1s2eVn_5nRk7GV.4 2024-09-14T12:01:17.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.893+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~rwOAgZAIeo-lJgjfx1s2eVn_5nRk7GV.5 2024-09-14T12:01:17.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.894+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~rwOAgZAIeo-lJgjfx1s2eVn_5nRk7GV.6 2024-09-14T12:01:17.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.894+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10622893926747361107', time=2024-09-14T13:43:16.194568+0000, chain.objs.size()=3 2024-09-14T12:01:17.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.894+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.526__multipart_mymultipart.2~-1tvTlUlrhErQS7Ao5aHoXYtM6GhpMZ.1 2024-09-14T12:01:17.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.894+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.526__multipart_mymultipart.2~-1tvTlUlrhErQS7Ao5aHoXYtM6GhpMZ.2 2024-09-14T12:01:17.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.894+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.526__multipart_mymultipart.2~-1tvTlUlrhErQS7Ao5aHoXYtM6GhpMZ.3 2024-09-14T12:01:17.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.895+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~1ZJ9cvbkaCRFZefnT1ymPldlpfTlg3O', time=2024-09-14T13:43:36.711444+0000, chain.objs.size()=2 2024-09-14T12:01:17.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.895+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.530__multipart_mymultipart.2~1ZJ9cvbkaCRFZefnT1ymPldlpfTlg3O.1 2024-09-14T12:01:17.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.895+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.530__multipart_mymultipart.2~1ZJ9cvbkaCRFZefnT1ymPldlpfTlg3O.2 2024-09-14T12:01:17.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.896+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1310411790237344954', time=2024-09-14T13:45:54.919941+0000, chain.objs.size()=1 2024-09-14T12:01:17.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.896+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.575__shadow_.skRs-DSTSUrE2ixbFAVkWzNmKGN08lJ_0 2024-09-14T12:01:17.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.896+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7887439505852582959', time=2024-09-14T13:46:20.436213+0000, chain.objs.size()=1 2024-09-14T12:01:17.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.896+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:-rYoBYqkCyF47aQpTF.8wCMn9Ne6zLz_.4acHpuXtQ-j_VV1CH4URRUURZaqkznl_0 2024-09-14T12:01:17.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.896+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2968500957466061594', time=2024-09-14T13:46:23.622087+0000, chain.objs.size()=1 2024-09-14T12:01:17.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.896+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:4nyY1eFKKhMzvH3nr8LbohQTx.D6jTQ_.wghrBPKthOrw2LA4LuXjv_sqTNaRvxs_0 2024-09-14T12:01:17.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.896+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5670139393105530188', time=2024-09-14T13:47:22.030084+0000, chain.objs.size()=1 2024-09-14T12:01:17.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.896+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.588__shadow:.ezqxrz-s-CACd3aqc-d6.pj2yiJVuC_.wyUSbzgHgJlWZZltJCE8N5T7Ic7AGux_0 2024-09-14T12:01:17.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.896+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13316801440213059087', time=2024-09-14T13:52:45.140307+0000, chain.objs.size()=1 2024-09-14T12:01:17.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.896+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.633__shadow_.arVtgd2UkRsbGcQEC4RKSyJsmsHj3cz_0 2024-09-14T12:01:17.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.898+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13950820383626200205', time=2024-09-14T13:52:59.065487+0000, chain.objs.size()=2 2024-09-14T12:01:17.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.898+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.644__shadow_.vs3brvGScui_MUmtt-hvnVi5_GHgppd_0 2024-09-14T12:01:17.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.898+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.644__shadow_.vs3brvGScui_MUmtt-hvnVi5_GHgppd_1 2024-09-14T12:01:17.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.899+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12502633668135274647', time=2024-09-14T13:57:49.881246+0000, chain.objs.size()=1 2024-09-14T12:01:17.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.899+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.765__shadow_.Y5StYYtq_4UN0wnuC9HGtXctv5Vn4_L_0 2024-09-14T12:01:17.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.902+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:17.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.905+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T12:01:17.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.906+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:17.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.906+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:17.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52519' 2024-09-14T12:01:17.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15542975325482525877', time=2024-09-14T13:27:54.590376+0000, chain.objs.size()=1 2024-09-14T12:01:17.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.161__shadow_.447KISapGE2xKGYualPPZo_YwNSK6bB_0 2024-09-14T12:01:17.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4395732556810359859', time=2024-09-14T13:29:38.485401+0000, chain.objs.size()=1 2024-09-14T12:01:17.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.204__shadow_.cwlNYpOvK_kQojcfKK998Roelkz-Z31_0 2024-09-14T12:01:17.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6651118317361162940', time=2024-09-14T13:31:42.812057+0000, chain.objs.size()=1 2024-09-14T12:01:17.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.239__shadow_.VzkX02vmZkVMAhsX4Q1WHSimfydujcX_0 2024-09-14T12:01:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17601410684125954063', time=2024-09-14T13:31:48.761461+0000, chain.objs.size()=1 2024-09-14T12:01:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.244__shadow_.j9f3TpaDDETltLikycBUBu_v0QVAkRU_0 2024-09-14T12:01:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1587798277622049334', time=2024-09-14T13:31:55.112504+0000, chain.objs.size()=1 2024-09-14T12:01:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.249__shadow_.7IouGgDPngDYlGF346tqXpiEU6epAVE_0 2024-09-14T12:01:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10798448663527644412', time=2024-09-14T13:32:47.723243+0000, chain.objs.size()=1 2024-09-14T12:01:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.S_J377iyxx8e5N70bnURrl62bIDnW_8_0 2024-09-14T12:01:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17208775127448216833', time=2024-09-14T13:32:47.883810+0000, chain.objs.size()=1 2024-09-14T12:01:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.aiRMdw_CrLfvoImuTJ6u6FJ22vnawAV_0 2024-09-14T12:01:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7188877148555516730', time=2024-09-14T13:32:48.390781+0000, chain.objs.size()=1 2024-09-14T12:01:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ZiV88BO_qEMgSZSHCxd0wmO-1F3SBNh_0 2024-09-14T12:01:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3090461921312824373', time=2024-09-14T13:32:49.753666+0000, chain.objs.size()=1 2024-09-14T12:01:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.L9tnPhrxtpYnNZzjDiJpjW7_ioPQPoX_0 2024-09-14T12:01:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7881810458337322356', time=2024-09-14T13:32:49.855627+0000, chain.objs.size()=1 2024-09-14T12:01:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.c4ZUu3JoaIqLfjjGTynfXsR-g4YIch5_0 2024-09-14T12:01:17.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13405701555126353385', time=2024-09-14T13:32:49.943612+0000, chain.objs.size()=1 2024-09-14T12:01:17.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.uk7EPqeceMI8qSB4-iIsZaeCkR2AvxN_0 2024-09-14T12:01:17.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1963353631463296861', time=2024-09-14T13:32:50.056636+0000, chain.objs.size()=1 2024-09-14T12:01:17.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.907+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.6dwQUxKF2WsbBT4EYCOeDfjqlVuJ6WP_0 2024-09-14T12:01:17.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.910+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7432580696927976718', time=2024-09-14T13:32:50.574271+0000, chain.objs.size()=1 2024-09-14T12:01:17.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.910+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Rld9IVow1y8Mu6vX_3djEtyv_51JAV-_0 2024-09-14T12:01:17.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.910+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12639112690682909729', time=2024-09-14T13:32:50.870249+0000, chain.objs.size()=1 2024-09-14T12:01:17.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.910+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_._tI69SA_7WhgyzJRyxv9Oze3PO-OE3Q_0 2024-09-14T12:01:17.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.910+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11079693927904065733', time=2024-09-14T13:32:50.951834+0000, chain.objs.size()=1 2024-09-14T12:01:17.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.910+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.NhCy4BpAi48_usflICIfv03fULVlpum_0 2024-09-14T12:01:17.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.910+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14075721949908463898', time=2024-09-14T13:32:52.051276+0000, chain.objs.size()=1 2024-09-14T12:01:17.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.910+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.XdJ4E1EYsa_poOwOypTx671RqvaPYus_0 2024-09-14T12:01:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.911+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10645329707948908228', time=2024-09-14T13:32:52.354165+0000, chain.objs.size()=1 2024-09-14T12:01:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.911+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.cC2AIlDZRNDQ6LaiY_bw-1qcC13sE1J_0 2024-09-14T12:01:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.911+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11898039778078438225', time=2024-09-14T13:32:52.513160+0000, chain.objs.size()=1 2024-09-14T12:01:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.911+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.gRKgtvMepHfnVKrR8qQJ9jYvRIdVF-W_0 2024-09-14T12:01:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.911+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13460157723439323716', time=2024-09-14T13:32:52.958923+0000, chain.objs.size()=1 2024-09-14T12:01:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.911+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.oWL1oSUyjHmKXsAEVK2Jx7U0OovbElK_0 2024-09-14T12:01:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.911+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16910640117755481473', time=2024-09-14T13:32:53.103573+0000, chain.objs.size()=1 2024-09-14T12:01:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.911+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.eDn72yzXiTfWhnnvtZpCejH4Q7WYxrC_0 2024-09-14T12:01:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.911+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11723239610679876401', time=2024-09-14T13:32:53.610602+0000, chain.objs.size()=1 2024-09-14T12:01:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.911+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.2iRbCKHg85liyt3XSZCWkYslQVU7Ug9_0 2024-09-14T12:01:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.911+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11254914281683779702', time=2024-09-14T13:32:53.798106+0000, chain.objs.size()=1 2024-09-14T12:01:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.911+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.GK3UhQwCqd7RNjdHLh9c3ovp2pDQp21_0 2024-09-14T12:01:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.911+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13205516467776459657', time=2024-09-14T13:32:54.388784+0000, chain.objs.size()=1 2024-09-14T12:01:17.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.911+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.EmeHv0DNVn7fwPPgNfSR8FsrjrOmto6_0 2024-09-14T12:01:17.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.914+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6408473177472033944', time=2024-09-14T13:32:54.943070+0000, chain.objs.size()=1 2024-09-14T12:01:17.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.914+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.WDHXtdzO-aU0PTJkvp_MFw9tMVo5np0_0 2024-09-14T12:01:17.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.914+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14157320651328623007', time=2024-09-14T13:32:55.108491+0000, chain.objs.size()=1 2024-09-14T12:01:17.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.914+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.O1BNHerhBgGssulV0iagG3a8nbTlK73_0 2024-09-14T12:01:17.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.915+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13428753888002991324', time=2024-09-14T13:32:55.877228+0000, chain.objs.size()=1 2024-09-14T12:01:17.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.915+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.weFeim3f4NsichgotFwRQ9KP054HawK_0 2024-09-14T12:01:17.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.915+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6976031779376753205', time=2024-09-14T13:32:57.252115+0000, chain.objs.size()=1 2024-09-14T12:01:17.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.915+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.RhMy9k9sKyPHRxyV_RANIjHCmxQEVdY_0 2024-09-14T12:01:17.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.915+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.741605164149279807', time=2024-09-14T13:32:57.889119+0000, chain.objs.size()=1 2024-09-14T12:01:17.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.915+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Qjx9AP4RngHvG6gJmeulFkNxg8QVbzP_0 2024-09-14T12:01:17.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.916+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5854619152506521550', time=2024-09-14T13:32:57.916272+0000, chain.objs.size()=1 2024-09-14T12:01:17.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.916+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.5GOsLKEthJ_8xD5QSQeiobTK4dSm112_0 2024-09-14T12:01:17.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.916+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11686388953879239527', time=2024-09-14T13:32:58.043756+0000, chain.objs.size()=1 2024-09-14T12:01:17.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.916+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.bzvPCozMzgSBBbNLCmHRvArMpyx5aUg_0 2024-09-14T12:01:17.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.916+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3930909446715749893', time=2024-09-14T13:33:00.904035+0000, chain.objs.size()=1 2024-09-14T12:01:17.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.916+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.265__shadow_.MMYHYIp8wLx9fWh7Biq_-YV6bgMgdH1_0 2024-09-14T12:01:17.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.916+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17197473949263624347', time=2024-09-14T13:33:18.200285+0000, chain.objs.size()=1 2024-09-14T12:01:17.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.916+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.281__shadow_.pdoEZ73vLZBQDw9W0bwFz6ZelGCPRRE_0 2024-09-14T12:01:17.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.917+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8855084936952286338', time=2024-09-14T13:33:23.760797+0000, chain.objs.size()=1 2024-09-14T12:01:17.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.917+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.286__shadow_.Fg9az9V1TbF1Cr1C5D04Ttblw6EdxTk_0 2024-09-14T12:01:17.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.917+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3652061102085093058', time=2024-09-14T13:33:33.150053+0000, chain.objs.size()=1 2024-09-14T12:01:17.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.917+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.bQ1MAjxIWgo592zUGu8c-ldaGaZ3YuR_0 2024-09-14T12:01:17.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.917+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16457627847833007189', time=2024-09-14T13:33:35.576136+0000, chain.objs.size()=1 2024-09-14T12:01:17.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.917+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.XpqC5uNuXu6uHg6d6sHP2aI_jY_wwfQ_0 2024-09-14T12:01:17.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.919+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16645475609504673237', time=2024-09-14T13:33:35.645495+0000, chain.objs.size()=1 2024-09-14T12:01:17.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.919+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.RFVuPNqiGH3t4dnZ_BvDN4aFTgGzrQv_0 2024-09-14T12:01:17.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.919+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3379890167445891878', time=2024-09-14T13:33:43.455890+0000, chain.objs.size()=1 2024-09-14T12:01:17.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.919+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.301__shadow_.iTQ98OoHS4k8HKdlj6D9Dqa1HIFlQOF_0 2024-09-14T12:01:17.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.919+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4307827722457080165', time=2024-09-14T13:33:45.855299+0000, chain.objs.size()=1 2024-09-14T12:01:17.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.919+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.303__shadow_.PO6gL4czIVo-DufJuy_NqePO0l5Os4N_0 2024-09-14T12:01:17.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.919+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2678757705229028978', time=2024-09-14T13:34:09.123687+0000, chain.objs.size()=1 2024-09-14T12:01:17.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.919+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.320__shadow:fH6sp9L1vkPWWBPKy3iMHXey.WUeCZw_.qcExGZeth2nxEXmzGIr5p9BWZ16E6UD_0 2024-09-14T12:01:17.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.919+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11670629373626393022', time=2024-09-14T13:34:51.508988+0000, chain.objs.size()=1 2024-09-14T12:01:17.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.919+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.KQhgrqUOUQfFH93lmf0Yh9_-PSGfyPl_0 2024-09-14T12:01:17.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.921+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8925481827181330530', time=2024-09-14T13:34:51.784566+0000, chain.objs.size()=1 2024-09-14T12:01:17.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.921+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.PL1OXz-To7mzg44A0GOIArpArJawyZa_0 2024-09-14T12:01:17.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.921+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11901884048704595151', time=2024-09-14T13:34:51.807757+0000, chain.objs.size()=1 2024-09-14T12:01:17.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.921+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.f1a1iAr9ZwfiTv5bgBLP8eIEalBiXQy_0 2024-09-14T12:01:17.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.923+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4040433853183369574', time=2024-09-14T13:34:52.525098+0000, chain.objs.size()=1 2024-09-14T12:01:17.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.923+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.M-1ZmpF8hd3gWDG_OjXejBTPV-I9qOr_0 2024-09-14T12:01:17.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.923+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6607566975959143991', time=2024-09-14T13:34:53.368025+0000, chain.objs.size()=1 2024-09-14T12:01:17.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.923+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Uh33l1r3ItD9EMkUiirGa44mpmopMZh_0 2024-09-14T12:01:17.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.923+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15290961379856525503', time=2024-09-14T13:34:53.536274+0000, chain.objs.size()=1 2024-09-14T12:01:17.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.923+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.fAqkObIU-cpXVNaTWvCQpPRsFlIwIFR_0 2024-09-14T12:01:17.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.923+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13173450944500498487', time=2024-09-14T13:34:54.181573+0000, chain.objs.size()=1 2024-09-14T12:01:17.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.923+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.rp-iqh3UihR2xgmfYbJrUI2Iie4AWhn_0 2024-09-14T12:01:17.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.923+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4013006505681084412', time=2024-09-14T13:34:54.829994+0000, chain.objs.size()=1 2024-09-14T12:01:17.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.923+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.WSVLTJy_kuyEgDYgA6MagmGhOJqvogO_0 2024-09-14T12:01:17.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.923+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10855302256248985684', time=2024-09-14T13:34:54.869698+0000, chain.objs.size()=1 2024-09-14T12:01:17.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.923+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.S_r02mRmaq6U2-wAthjJ-jgwj3NFrvs_0 2024-09-14T12:01:17.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.923+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7326776399052822862', time=2024-09-14T13:34:55.247155+0000, chain.objs.size()=1 2024-09-14T12:01:17.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.923+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.tmKJl43bl4W9FQTTZ1Hk6lfis1uO7zW_0 2024-09-14T12:01:17.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.923+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3003230629001674017', time=2024-09-14T13:34:55.671327+0000, chain.objs.size()=1 2024-09-14T12:01:17.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.923+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.-EKT6SgHWCG1ZhP3DnEDKetdXLrH6_T_0 2024-09-14T12:01:17.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.923+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6559674247641088152', time=2024-09-14T13:34:56.897931+0000, chain.objs.size()=1 2024-09-14T12:01:17.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.923+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.d6015-Eyj_Nv7BiNJZ0HzfCds3bpzB-_0 2024-09-14T12:01:17.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.923+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8198967498758779892', time=2024-09-14T13:34:56.898804+0000, chain.objs.size()=1 2024-09-14T12:01:17.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.923+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.tOeQPfGPobJKujleSEacF3AGuT9RG8W_0 2024-09-14T12:01:17.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.924+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11091977377090928549', time=2024-09-14T13:34:57.902070+0000, chain.objs.size()=1 2024-09-14T12:01:17.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.924+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.rKgK0PQEHSAhvdHJn5vU6LzAecjBhLW_0 2024-09-14T12:01:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.927+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9006801585472631757', time=2024-09-14T13:34:58.379412+0000, chain.objs.size()=1 2024-09-14T12:01:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.927+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ITnhDY2Xuslvu7oIiVuRT8zqh-KdIiy_0 2024-09-14T12:01:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.927+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5012711434170494650', time=2024-09-14T13:34:58.694261+0000, chain.objs.size()=1 2024-09-14T12:01:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.927+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.21OAUci6respSF0k5FdQRJ-Lo5NhEUK_0 2024-09-14T12:01:17.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.928+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5833243076878579033', time=2024-09-14T13:34:59.243155+0000, chain.objs.size()=1 2024-09-14T12:01:17.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.928+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.nmdgtkNfbEcBOIm3ouzlk6OcBqEYHlY_0 2024-09-14T12:01:17.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.928+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10100507468589141592', time=2024-09-14T13:34:59.519715+0000, chain.objs.size()=1 2024-09-14T12:01:17.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.928+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.QL5rxd65F6OsBs1SLizcwA4TXwYOHdS_0 2024-09-14T12:01:17.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.928+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7175025671847788786', time=2024-09-14T13:35:00.121894+0000, chain.objs.size()=1 2024-09-14T12:01:17.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.928+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.9avxNhQoL5Yx2eDk-5Iz4y0Ki_UEzXO_0 2024-09-14T12:01:17.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.928+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8271551579544330878', time=2024-09-14T13:35:00.781189+0000, chain.objs.size()=1 2024-09-14T12:01:17.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.928+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.EvbOht5NP_LFro24XKj7gJ8YRAIy42Z_0 2024-09-14T12:01:17.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.928+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18114482822928812522', time=2024-09-14T13:35:02.233194+0000, chain.objs.size()=1 2024-09-14T12:01:17.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.928+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.xUDYSywwaYILeZD9zrjJELBeaNK6J7F_0 2024-09-14T12:01:17.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.928+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1752150913298639761', time=2024-09-14T13:35:02.296783+0000, chain.objs.size()=1 2024-09-14T12:01:17.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.928+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.0Xs-Csnv5Ba9YQR2dBTFoR6ZQTNCbAx_0 2024-09-14T12:01:17.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.928+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14726262565650226248', time=2024-09-14T13:35:41.651821+0000, chain.objs.size()=1 2024-09-14T12:01:17.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.928+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.73kgFg4wz_b5eZKuxwfRF8V93YGUezm_0 2024-09-14T12:01:17.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.928+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3501959090435444679', time=2024-09-14T13:35:41.801105+0000, chain.objs.size()=1 2024-09-14T12:01:17.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.928+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.JLcHifVXkkn164yMFvwJkPUklXQDFe9_0 2024-09-14T12:01:17.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.930+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13862830452419969933', time=2024-09-14T13:35:42.506557+0000, chain.objs.size()=1 2024-09-14T12:01:17.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.930+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.LyQ-Q1t_pmbIPnKErEaQULOtqofcbRp_0 2024-09-14T12:01:17.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.931+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9513205692418529619', time=2024-09-14T13:35:43.694457+0000, chain.objs.size()=1 2024-09-14T12:01:17.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.931+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Bdd4vMg2CdyAb96arzFIbAnVMldx1TY_0 2024-09-14T12:01:17.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.931+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15704803649538979405', time=2024-09-14T13:35:44.144790+0000, chain.objs.size()=1 2024-09-14T12:01:17.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.931+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.P2A3XHNHF6rk_B9F9PIEfCVlkCC7v55_0 2024-09-14T12:01:17.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.932+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8135195522872634576', time=2024-09-14T13:35:44.849401+0000, chain.objs.size()=1 2024-09-14T12:01:17.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.932+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.NDaqSM7K6X2pkJg9WxZhI6UCGFDpsB__0 2024-09-14T12:01:17.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.933+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7693359206088320636', time=2024-09-14T13:35:44.959286+0000, chain.objs.size()=1 2024-09-14T12:01:17.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.933+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.QhtYJud5zBwE6b9HSbPK8Y00e9SsUwj_0 2024-09-14T12:01:17.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.933+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16126290260619406707', time=2024-09-14T13:35:45.269357+0000, chain.objs.size()=1 2024-09-14T12:01:17.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.933+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.JN2P5gI6aagb3YnSAW2uKlmHt12LxEL_0 2024-09-14T12:01:17.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.933+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2666481175288625728', time=2024-09-14T13:35:46.522164+0000, chain.objs.size()=1 2024-09-14T12:01:17.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.933+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.c6FIFdRXAO6VyAnTXGzPYGsQ3_yb5JA_0 2024-09-14T12:01:17.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.933+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.590111761186043262', time=2024-09-14T13:35:46.805592+0000, chain.objs.size()=1 2024-09-14T12:01:17.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.933+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.kEoz3OtfZ7ss5GGOmvJIBciB1x50cYA_0 2024-09-14T12:01:17.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.933+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8271685323725043265', time=2024-09-14T13:35:46.842729+0000, chain.objs.size()=1 2024-09-14T12:01:17.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.933+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.7ewJrGp5EorQVYU1hh6lcoAuhC5PWcS_0 2024-09-14T12:01:17.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.933+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7960915252448774946', time=2024-09-14T13:35:47.082511+0000, chain.objs.size()=1 2024-09-14T12:01:17.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.933+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.C6_flIU4Z27ACUg1lZKVgAeug2slcpt_0 2024-09-14T12:01:17.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.933+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14046258368246515124', time=2024-09-14T13:35:47.122610+0000, chain.objs.size()=1 2024-09-14T12:01:17.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.933+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.k8ifKhso-bG2O-EonKEMu1fnYkKWIcD_0 2024-09-14T12:01:17.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.935+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5427351036411173816', time=2024-09-14T13:35:49.377581+0000, chain.objs.size()=1 2024-09-14T12:01:17.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.935+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.yx3isrzj85tyc1oQxUfEWDl9q9HwvON_0 2024-09-14T12:01:17.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.935+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12831831217459814856', time=2024-09-14T13:35:49.770815+0000, chain.objs.size()=1 2024-09-14T12:01:17.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.935+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.1OFCQf0wDqhroxQkzcPjwXkCBEbOW-L_0 2024-09-14T12:01:17.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.935+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4609819097498523747', time=2024-09-14T13:35:50.119133+0000, chain.objs.size()=1 2024-09-14T12:01:17.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.935+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.YCVpG1eiT2EWO2pYL9gKhjn9OvYhU06_0 2024-09-14T12:01:17.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.936+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9940736561636820068', time=2024-09-14T13:35:50.120011+0000, chain.objs.size()=1 2024-09-14T12:01:17.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.936+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.zjkhnaUhSyF6ZEfI0zhd9q6B7q7gj7q_0 2024-09-14T12:01:17.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.937+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14982948497297034662', time=2024-09-14T13:35:50.597725+0000, chain.objs.size()=1 2024-09-14T12:01:17.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.937+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.BJ3d9VtulDCXKjyOn-rs6R4qeXIOKNR_0 2024-09-14T12:01:17.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.937+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17173295306086815203', time=2024-09-14T13:35:50.756879+0000, chain.objs.size()=1 2024-09-14T12:01:17.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.937+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.zGMmSMzRFZ_j7EcTMu5unyekOdifvxP_0 2024-09-14T12:01:17.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.937+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2715541037890464302', time=2024-09-14T13:35:51.070428+0000, chain.objs.size()=1 2024-09-14T12:01:17.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.937+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.YwySY9MMLNBdzwWknyZIsPWNl4mLgsJ_0 2024-09-14T12:01:17.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.937+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2154111030761398404', time=2024-09-14T13:35:51.935259+0000, chain.objs.size()=1 2024-09-14T12:01:17.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.937+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.F3x1ZjIo57ZawMviOQRyI_qaLAw-0CU_0 2024-09-14T12:01:17.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.937+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11581858181755310932', time=2024-09-14T13:35:52.381577+0000, chain.objs.size()=1 2024-09-14T12:01:17.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.937+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.EvIupG5ajPpO8HP6KFuEpmBbg71OD8J_0 2024-09-14T12:01:17.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.939+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9647145785310444231', time=2024-09-14T13:35:52.765750+0000, chain.objs.size()=1 2024-09-14T12:01:17.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.939+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.EopTcEakKoEiartjX7mfwhagZ4Effmd_0 2024-09-14T12:01:17.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.939+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15787903906898481933', time=2024-09-14T13:36:03.906766+0000, chain.objs.size()=1 2024-09-14T12:01:17.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.939+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.336__shadow_.WSihgFjD9s14eeLOHUKlYVXWNTbZxUs_0 2024-09-14T12:01:17.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.939+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14771804264159714564', time=2024-09-14T13:36:46.638471+0000, chain.objs.size()=1 2024-09-14T12:01:17.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.939+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.378__shadow_.CA63_MdEua_Ookmtb0XD6LC8ZRtZAzw_0 2024-09-14T12:01:17.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.939+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5904101961027611180', time=2024-09-14T13:36:48.641896+0000, chain.objs.size()=1 2024-09-14T12:01:17.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.939+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.380__shadow_.5tD7HhiY92Y9XFyqq1j087zgvwWmG8i_0 2024-09-14T12:01:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.941+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8239114777062517379', time=2024-09-14T13:38:53.177712+0000, chain.objs.size()=1 2024-09-14T12:01:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.941+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.491__shadow_.7NbM2NM7yJfGl3XWYDu9tLyOyZfnjOJ_0 2024-09-14T12:01:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.941+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8239114777062517379', time=2024-09-14T13:38:53.458621+0000, chain.objs.size()=1 2024-09-14T12:01:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.941+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.491__shadow_.7NbM2NM7yJfGl3XWYDu9tLyOyZfnjOJ_0 2024-09-14T12:01:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.941+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7856246312293183978', time=2024-09-14T13:39:00.536907+0000, chain.objs.size()=1 2024-09-14T12:01:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.941+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.498__shadow_.7_VLUs8Qo6c7r4g5ffczowRwsRqkXgj_0 2024-09-14T12:01:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.941+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12363023196934380994', time=2024-09-14T13:43:04.252018+0000, chain.objs.size()=2 2024-09-14T12:01:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.941+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.526__multipart_mymultipart.2~XQT8GxeqH0HOWyYiaLpGK4vgBA87vRv.1 2024-09-14T12:01:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.941+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.526__multipart_mymultipart.2~XQT8GxeqH0HOWyYiaLpGK4vgBA87vRv.2 2024-09-14T12:01:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.941+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15661478096334605682', time=2024-09-14T13:45:46.631356+0000, chain.objs.size()=1 2024-09-14T12:01:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.941+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:nh-WWpMaWpW3WeSmTgg6x5az8IImmLe_.yrhUnOAHO71zRle3-7GyXTItiwkrdFf_0 2024-09-14T12:01:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.941+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3398082992414665364', time=2024-09-14T13:45:54.813472+0000, chain.objs.size()=1 2024-09-14T12:01:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.941+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.575__shadow_.QxQUFGE5ezbYMdLjSiLHoIh666N-MUJ_0 2024-09-14T12:01:17.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.943+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11762163492335479812', time=2024-09-14T13:45:57.558825+0000, chain.objs.size()=1 2024-09-14T12:01:17.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.943+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.575__shadow:0nxb9evdeVuMKIXqR.Ixg74qPOK09xd_.TRuUa7yNUR6kBwZ5gO5P6jDMT7oiZrP_0 2024-09-14T12:01:17.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.943+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9123194177281949801', time=2024-09-14T13:46:12.342995+0000, chain.objs.size()=1 2024-09-14T12:01:17.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.943+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:0gdh8RKlkSm006i7DjI.q4J7uh3Gh6O_.-p0jLHDlIGu3bUzfa0srOhmvVa0fqBW_0 2024-09-14T12:01:17.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.943+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1144639424831188573', time=2024-09-14T13:46:15.740303+0000, chain.objs.size()=1 2024-09-14T12:01:17.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.943+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:UkeKEBfVlZ.zUarky.hCbBbn.E0KNRP_.YIZbNSgyoEtjIEuOuOTRLuYC_gMguMZ_0 2024-09-14T12:01:17.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.943+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6858368960376905708', time=2024-09-14T13:47:19.536476+0000, chain.objs.size()=1 2024-09-14T12:01:17.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.943+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.587__shadow:Uq5dKAiJNI4123yMy3ZsV0MH4GVVHtn_.BgHgYswJmJAC-Se2OvXDx14o-tsd1gt_0 2024-09-14T12:01:17.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.945+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17805350736148149453', time=2024-09-14T13:47:19.579139+0000, chain.objs.size()=1 2024-09-14T12:01:17.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.945+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.587__shadow:HU.2Vvl8BvCXPfoYyyA2iERDlpf1Irf_.GP99uEMuJlA8C0igZbu99hPvuoirmJD_0 2024-09-14T12:01:17.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.945+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.370793494926481437', time=2024-09-14T13:53:17.600254+0000, chain.objs.size()=1 2024-09-14T12:01:17.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.945+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.652__shadow_.31pi7Udfs-mXyoTY2TkBEkz7QPD9r4q_0 2024-09-14T12:01:17.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.945+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7097730211293136734', time=2024-09-14T13:53:22.318760+0000, chain.objs.size()=1 2024-09-14T12:01:17.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.945+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.655__shadow_.mwykJdkK8F4UHSaAjgngYFS7nB2sMVL_0 2024-09-14T12:01:17.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.948+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/52519 2024-09-14T12:01:17.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.950+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T12:01:17.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.950+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13588186157756362925', time=2024-09-14T13:53:27.624561+0000, chain.objs.size()=1 2024-09-14T12:01:17.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.950+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.657__shadow_.Wavrr0kap-fZ4aQ9pY-akW5vDlPdb4-_0 2024-09-14T12:01:17.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.950+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5730308022146356548', time=2024-09-14T13:57:00.416689+0000, chain.objs.size()=1 2024-09-14T12:01:17.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.950+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.754__shadow_.XmJOUWZGq_uxPGsnxvNo_alJPGSRcqA_0 2024-09-14T12:01:17.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.950+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13903327114014924155', time=2024-09-14T13:58:37.074131+0000, chain.objs.size()=1 2024-09-14T12:01:17.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.950+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.776__shadow_.L4MeRItplTG-4yzXAoFoULw7nOela_X_0 2024-09-14T12:01:17.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.952+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:17.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.954+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T12:01:17.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.955+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:17.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.955+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:17.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.956+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51669' 2024-09-14T12:01:17.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.956+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16010461108503975885', time=2024-09-14T13:31:42.809962+0000, chain.objs.size()=1 2024-09-14T12:01:17.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.956+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.239__shadow_.5fV3gKHBttl0Vh7_xG0R2KSYBus396F_0 2024-09-14T12:01:17.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.957+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5362450042226802868', time=2024-09-14T13:32:04.988022+0000, chain.objs.size()=1 2024-09-14T12:01:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.957+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.258__shadow_.OfwohqLW-fbFJ-9CoZNeBKsdpSmEpN4_0 2024-09-14T12:01:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.957+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13933727083184447655', time=2024-09-14T13:32:07.144064+0000, chain.objs.size()=1 2024-09-14T12:01:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.957+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.260__shadow_.SX3PG6Etd95NGj0Ttog9pSv5kdwOnPA_0 2024-09-14T12:01:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.957+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11800086202837326040', time=2024-09-14T13:32:47.849844+0000, chain.objs.size()=1 2024-09-14T12:01:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.957+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.k_Y8022T7Yv4kkfX3kiPn_8Yixc9OTm_0 2024-09-14T12:01:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.957+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1110719663763971441', time=2024-09-14T13:32:47.862954+0000, chain.objs.size()=1 2024-09-14T12:01:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.957+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.A0QC5VdvnmKN4Q7ogUGWD4l6NZMIgqA_0 2024-09-14T12:01:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.957+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10525847477172651070', time=2024-09-14T13:32:48.041536+0000, chain.objs.size()=1 2024-09-14T12:01:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.957+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ZkOEyihW3kaI7we_dochBXldoAg5HVA_0 2024-09-14T12:01:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.957+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3063183730602019585', time=2024-09-14T13:32:48.476084+0000, chain.objs.size()=1 2024-09-14T12:01:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.957+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Wg9gyMQXxEkx_nXrIMt2yjfaH3KaWTW_0 2024-09-14T12:01:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.957+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3851752668060848338', time=2024-09-14T13:32:49.216218+0000, chain.objs.size()=1 2024-09-14T12:01:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.957+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.YcCcjStk2Xv8puYAwObZj2tqjzVgYqf_0 2024-09-14T12:01:17.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.957+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4628773527060502743', time=2024-09-14T13:32:49.569712+0000, chain.objs.size()=1 2024-09-14T12:01:17.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.957+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.aDBiDDb780ZhixzXfJiJV5oULGft9a5_0 2024-09-14T12:01:17.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.957+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2163896305556137784', time=2024-09-14T13:32:49.655689+0000, chain.objs.size()=1 2024-09-14T12:01:17.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.957+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.-FUcDTxZkKBAdKF-zaZPf7kNBxtuWen_0 2024-09-14T12:01:17.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.957+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15063823246249447517', time=2024-09-14T13:32:49.741889+0000, chain.objs.size()=1 2024-09-14T12:01:17.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.957+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.zg_yLdqC84ffPAz3ULugh4DJt5BrAkP_0 2024-09-14T12:01:17.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.957+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14764392668860837304', time=2024-09-14T13:32:49.790170+0000, chain.objs.size()=1 2024-09-14T12:01:17.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.957+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.iSK40ULlJljuQ5kVH8T-bhY7D-gQjI9_0 2024-09-14T12:01:17.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.959+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4193503308876647302', time=2024-09-14T13:32:49.820409+0000, chain.objs.size()=1 2024-09-14T12:01:17.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.959+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.pMYtV2GHrMjHke3LCI9HV1p1rUbODhz_0 2024-09-14T12:01:17.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.960+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2140121141206973251', time=2024-09-14T13:32:49.901070+0000, chain.objs.size()=1 2024-09-14T12:01:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.960+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.lSmL0gGCBRTBnPf2cPXHFYFI9x0mzbj_0 2024-09-14T12:01:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.960+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8638400176268411909', time=2024-09-14T13:32:49.904603+0000, chain.objs.size()=1 2024-09-14T12:01:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.960+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Cq_b-nr2-xidcAHHyryMQkuHnEjSSje_0 2024-09-14T12:01:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.960+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2418959081197935301', time=2024-09-14T13:32:50.711059+0000, chain.objs.size()=1 2024-09-14T12:01:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.960+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.pc2n8w37VNJjnTTyNNRiKtvoXNgIwJo_0 2024-09-14T12:01:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.960+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1406740006137998270', time=2024-09-14T13:32:50.865827+0000, chain.objs.size()=1 2024-09-14T12:01:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.960+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.N8USWBY-gdLCEDnsnx8l6TS--9AFANy_0 2024-09-14T12:01:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.960+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7456471209968973240', time=2024-09-14T13:32:51.336264+0000, chain.objs.size()=1 2024-09-14T12:01:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.960+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.mXT_QVfQyxmw6gPZ94CLj5lUn6qgKum_0 2024-09-14T12:01:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.960+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.60246097972184688', time=2024-09-14T13:32:51.393656+0000, chain.objs.size()=1 2024-09-14T12:01:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.960+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.-aDJdsF4lT2N2FrKSUfUSizTd-QJZKO_0 2024-09-14T12:01:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.960+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15187373850061634416', time=2024-09-14T13:32:51.514816+0000, chain.objs.size()=1 2024-09-14T12:01:17.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.960+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.a91dcvOnS99lG3uTCRXrGIJMPoPGP4y_0 2024-09-14T12:01:17.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.961+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3897896703939929065', time=2024-09-14T13:32:51.515445+0000, chain.objs.size()=1 2024-09-14T12:01:17.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.961+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.cSwslVKpbYC5u4QdCtB9jneoKzNOeLi_0 2024-09-14T12:01:17.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.961+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12076967735555480200', time=2024-09-14T13:32:52.483291+0000, chain.objs.size()=1 2024-09-14T12:01:17.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.961+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.NqFvQEHu_AfWZGIK3urCP1CXPRCMUc3_0 2024-09-14T12:01:17.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.961+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3690008197454599907', time=2024-09-14T13:32:52.774546+0000, chain.objs.size()=1 2024-09-14T12:01:17.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.961+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.-dxbg7u48CbHqNqBlGqclKTadbWrqbO_0 2024-09-14T12:01:17.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.963+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3068525120431584032', time=2024-09-14T13:32:52.851263+0000, chain.objs.size()=1 2024-09-14T12:01:17.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.963+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.xoBNCfivF0Mk_Q9a-xTAuBDFZaQaDlX_0 2024-09-14T12:01:17.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.964+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.818692823970097767', time=2024-09-14T13:32:52.914422+0000, chain.objs.size()=1 2024-09-14T12:01:17.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.964+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.sYXm1E2izf8MW_P8g8k0gcnFamD0HSW_0 2024-09-14T12:01:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.965+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9754888088527024220', time=2024-09-14T13:32:52.959935+0000, chain.objs.size()=1 2024-09-14T12:01:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.965+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.q9MHctbzrDpdI6qMoHEdZoLvMPXum7L_0 2024-09-14T12:01:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.965+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10015126939413497438', time=2024-09-14T13:32:52.979132+0000, chain.objs.size()=1 2024-09-14T12:01:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.965+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.RjTZLT1Gm7d98YLSMRKRSvlH7vyBQoR_0 2024-09-14T12:01:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.965+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5134940418958811353', time=2024-09-14T13:32:53.550065+0000, chain.objs.size()=1 2024-09-14T12:01:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.965+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.0zp-OyYmfk2XEz0I_s3553lwO73chNY_0 2024-09-14T12:01:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.965+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1866548610332031249', time=2024-09-14T13:32:53.918647+0000, chain.objs.size()=1 2024-09-14T12:01:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.965+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.S-kdoxaVCLtzNKsR9y1IadcOBo5dLgk_0 2024-09-14T12:01:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.965+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2973615012897654655', time=2024-09-14T13:32:54.350255+0000, chain.objs.size()=1 2024-09-14T12:01:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.965+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.p9-KWekeSJA-bCG4J68AJFUkDct5MPn_0 2024-09-14T12:01:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.965+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14867543470078586787', time=2024-09-14T13:32:55.146672+0000, chain.objs.size()=1 2024-09-14T12:01:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.965+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.iTgGYntAkhIrWPK_m0wowltp38oatlk_0 2024-09-14T12:01:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.965+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1167975773232754380', time=2024-09-14T13:32:55.288051+0000, chain.objs.size()=1 2024-09-14T12:01:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.965+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.YqkkJ4hZC1gFFKyKt3j7t-DoOH_JYcB_0 2024-09-14T12:01:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.965+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15303840534931581866', time=2024-09-14T13:32:55.764739+0000, chain.objs.size()=1 2024-09-14T12:01:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.965+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.T15-6P8MH_gY4kLwMrnQ5KLKH0meS9U_0 2024-09-14T12:01:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.965+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11426396713354787017', time=2024-09-14T13:32:56.335310+0000, chain.objs.size()=1 2024-09-14T12:01:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.965+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.I498pude5ysy6tTuAGkDjHYoy4zOdVV_0 2024-09-14T12:01:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.965+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5576014686617326013', time=2024-09-14T13:32:56.877904+0000, chain.objs.size()=1 2024-09-14T12:01:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.965+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.M7pssmW890wyrnwy10sIEQuq1vx6_FL_0 2024-09-14T12:01:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.967+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15085009053337237428', time=2024-09-14T13:32:57.075384+0000, chain.objs.size()=1 2024-09-14T12:01:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.967+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.HIVZyC6Myy2pEkuY49HQy6iEthYCkyf_0 2024-09-14T12:01:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.969+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.419069328735384276', time=2024-09-14T13:32:57.317511+0000, chain.objs.size()=1 2024-09-14T12:01:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.969+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.yd6Z9w4aQEwJia7FTcZAGqD1FEIlmdS_0 2024-09-14T12:01:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.969+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11433832876058846597', time=2024-09-14T13:32:57.815359+0000, chain.objs.size()=1 2024-09-14T12:01:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.969+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.vM9kzUIYczbgBkprJaakmG6aYFE74F3_0 2024-09-14T12:01:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.970+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2388852104105250015', time=2024-09-14T13:33:02.992741+0000, chain.objs.size()=1 2024-09-14T12:01:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.970+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.267__shadow_.qx6Jj1yoFTB8o9A_iDuIM8FSnTzFoVx_0 2024-09-14T12:01:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.970+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1022960850851510741', time=2024-09-14T13:33:27.082177+0000, chain.objs.size()=1 2024-09-14T12:01:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.970+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.289__shadow_.k6KiQOTnLPidutOboLbsrMVg9_9GPo6_0 2024-09-14T12:01:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.970+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11516424388413499360', time=2024-09-14T13:33:33.262704+0000, chain.objs.size()=1 2024-09-14T12:01:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.970+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.majHPQi-KTBdidrmKOHSavm09lQ3Iv__0 2024-09-14T12:01:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.970+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7295957347317380059', time=2024-09-14T13:33:35.542447+0000, chain.objs.size()=1 2024-09-14T12:01:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.970+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.ny8Qr3A0O7EUVIPNLgjo4uUWL3xKLCQ_0 2024-09-14T12:01:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.970+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18386307780212498619', time=2024-09-14T13:33:35.577132+0000, chain.objs.size()=1 2024-09-14T12:01:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.970+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.4sH6LGEOlYFgUPMxOM1CRCaSqBI1e6n_0 2024-09-14T12:01:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.970+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9736970573116342140', time=2024-09-14T13:33:37.837448+0000, chain.objs.size()=1 2024-09-14T12:01:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.970+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.296__shadow_.gUCVPJoV3Kmg4JuzDe82aiI53BuwA7U_0 2024-09-14T12:01:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.970+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7927900877572593032', time=2024-09-14T13:34:11.925775+0000, chain.objs.size()=1 2024-09-14T12:01:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.970+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.323__shadow_.1lfiVHEC5c0VxwzQ5mcOvn_1dJsqTTB_0 2024-09-14T12:01:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.970+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1748618324445746702', time=2024-09-14T13:34:51.509525+0000, chain.objs.size()=1 2024-09-14T12:01:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.970+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.YbsEbsR4Y-dHWq7Wq8Uh33kqW1IMYWO_0 2024-09-14T12:01:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.970+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16285746187237768556', time=2024-09-14T13:34:51.636122+0000, chain.objs.size()=1 2024-09-14T12:01:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.970+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ZgivypkZnY3Kk4vY4RBmtk03ld33_Wz_0 2024-09-14T12:01:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.974+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7790064518773553458', time=2024-09-14T13:34:51.738738+0000, chain.objs.size()=1 2024-09-14T12:01:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.974+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.QKuH0tZC2xlwbKTjP7BMFfrG8fMSHUX_0 2024-09-14T12:01:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.974+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13559198550242351136', time=2024-09-14T13:34:51.990109+0000, chain.objs.size()=1 2024-09-14T12:01:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.974+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.dBPs3koQwtF-VwfG4qahQFayVvIam-5_0 2024-09-14T12:01:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.974+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4140956167533990322', time=2024-09-14T13:34:53.317614+0000, chain.objs.size()=1 2024-09-14T12:01:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.974+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.8xnYCwMsRBMIS4fVqlGo4uibhXFi47s_0 2024-09-14T12:01:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.974+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2171343744785076067', time=2024-09-14T13:34:53.451819+0000, chain.objs.size()=1 2024-09-14T12:01:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.974+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.58xbdoKJCindXRUXTOC2i2qTRsALJPI_0 2024-09-14T12:01:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.976+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7947749861333322313', time=2024-09-14T13:34:53.658308+0000, chain.objs.size()=1 2024-09-14T12:01:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.976+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.D0SBjhIb48-CnduJZSsf7dFHbUfQDl9_0 2024-09-14T12:01:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.976+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16648294373501939584', time=2024-09-14T13:34:55.569937+0000, chain.objs.size()=1 2024-09-14T12:01:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.976+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.u1JV09vc5AYM826MAASkagRj1GHHEgu_0 2024-09-14T12:01:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.976+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16410193000971555004', time=2024-09-14T13:34:55.705683+0000, chain.objs.size()=1 2024-09-14T12:01:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.976+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.pxiiyW4QKvMMNVQ8JVqST_kNd43FQq6_0 2024-09-14T12:01:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.976+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11507146402618319417', time=2024-09-14T13:34:56.591800+0000, chain.objs.size()=1 2024-09-14T12:01:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.976+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.YyAasKWFXd9Ga1opV2nqw3jbd4ga5nS_0 2024-09-14T12:01:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.976+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13654990393544826842', time=2024-09-14T13:34:56.669559+0000, chain.objs.size()=1 2024-09-14T12:01:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.976+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.7fmpei0PfzMikKXRSTu9bETUORMXpAH_0 2024-09-14T12:01:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.976+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9254729995239082015', time=2024-09-14T13:34:56.930202+0000, chain.objs.size()=1 2024-09-14T12:01:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.976+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.G-xxk2X2ilj2gONbZC1IPrcMjKn8UZT_0 2024-09-14T12:01:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.976+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9283794408106795349', time=2024-09-14T13:34:57.095522+0000, chain.objs.size()=1 2024-09-14T12:01:17.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.976+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.vjJxW1_I1jV_4MBEnXyV4EOuhro6O-n_0 2024-09-14T12:01:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.979+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4162432131998003681', time=2024-09-14T13:34:58.431380+0000, chain.objs.size()=1 2024-09-14T12:01:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.979+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.lsDrrOM38B6Z_2hfcao_QGpRVw4Gl5T_0 2024-09-14T12:01:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.979+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12307916950169230803', time=2024-09-14T13:34:58.717855+0000, chain.objs.size()=1 2024-09-14T12:01:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.979+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Xpll3BefTxxcgZGqJhMRMH7qGLPnpPB_0 2024-09-14T12:01:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.979+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.775986712976441406', time=2024-09-14T13:34:59.119333+0000, chain.objs.size()=1 2024-09-14T12:01:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.979+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.0Ar9kxDmcPcQivIkhGHoZ1tH-jU3758_0 2024-09-14T12:01:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.979+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11569813111561249281', time=2024-09-14T13:34:59.209804+0000, chain.objs.size()=1 2024-09-14T12:01:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.979+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Bc-nm7__CW0vc-5qPslN2c20lBBO5YF_0 2024-09-14T12:01:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.980+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1303975465089261244', time=2024-09-14T13:34:59.616872+0000, chain.objs.size()=1 2024-09-14T12:01:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.980+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.60281Zh3jhsy0FF6EuO0irbFFKCDWlT_0 2024-09-14T12:01:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.980+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18200257631040143829', time=2024-09-14T13:34:59.656518+0000, chain.objs.size()=1 2024-09-14T12:01:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.980+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.cpqcN5iXnDBi8X8Ka2mHukw4rS4_1OZ_0 2024-09-14T12:01:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.980+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.130580678475568279', time=2024-09-14T13:34:59.999821+0000, chain.objs.size()=1 2024-09-14T12:01:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.980+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.M2uC2zIvaRQV8qTLvJtjOS1-2QEWUq9_0 2024-09-14T12:01:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.980+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16054191536411271863', time=2024-09-14T13:35:00.780816+0000, chain.objs.size()=1 2024-09-14T12:01:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.980+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.q9jrcBJVBR5oO-awLaINFtqu3wogG10_0 2024-09-14T12:01:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.980+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11218590647264348076', time=2024-09-14T13:35:00.861437+0000, chain.objs.size()=1 2024-09-14T12:01:17.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.980+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.yb_3LvoWaSyTuEQgLE3gGCueZ7KdXdU_0 2024-09-14T12:01:17.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.980+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2887112251525199543', time=2024-09-14T13:35:01.299912+0000, chain.objs.size()=1 2024-09-14T12:01:17.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.980+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.LJMi2GK09yXA8iEXFYskGXMRzf_6plG_0 2024-09-14T12:01:17.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.980+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2131164926142168563', time=2024-09-14T13:35:01.511259+0000, chain.objs.size()=1 2024-09-14T12:01:17.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.980+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.wP_XVhtTemBl2-6I5hqC25CYfW-YmMX_0 2024-09-14T12:01:17.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.982+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3151905514930179504', time=2024-09-14T13:35:01.961047+0000, chain.objs.size()=1 2024-09-14T12:01:17.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.982+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.bc-95QgQylBCfPFDGAhI8rD6kky8tr5_0 2024-09-14T12:01:17.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.983+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16594277111331570199', time=2024-09-14T13:35:02.215683+0000, chain.objs.size()=1 2024-09-14T12:01:17.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.983+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.lIbuFR-0PvzgpO2Uzh6-GFn6l7ahREm_0 2024-09-14T12:01:17.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.983+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12653074035661313606', time=2024-09-14T13:35:02.623445+0000, chain.objs.size()=1 2024-09-14T12:01:17.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.983+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.tDseknMSFdhFxZOp8rnaG9x3aiPCyV6_0 2024-09-14T12:01:17.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.983+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6802007469531903451', time=2024-09-14T13:35:02.624200+0000, chain.objs.size()=1 2024-09-14T12:01:17.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.983+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.tvgvEHCp6iASqCCZZEui1vUJDbwPCQP_0 2024-09-14T12:01:17.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.984+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10138733309517447841', time=2024-09-14T13:35:41.890993+0000, chain.objs.size()=1 2024-09-14T12:01:17.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.984+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.S2zdNaZ6SKBnrJiD5RDAabMFh_7ogb2_0 2024-09-14T12:01:17.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.984+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18144429308722643306', time=2024-09-14T13:35:43.290104+0000, chain.objs.size()=1 2024-09-14T12:01:17.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.984+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.yxC6weTq_14m8wm6Gb1zZHN-fPau3R-_0 2024-09-14T12:01:17.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.984+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10213446594052273715', time=2024-09-14T13:35:43.452291+0000, chain.objs.size()=1 2024-09-14T12:01:17.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.984+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.lkVHaV7_OLoz88_fnrugQIGyM_q_coG_0 2024-09-14T12:01:17.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.985+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9684663956119438872', time=2024-09-14T13:35:43.453359+0000, chain.objs.size()=1 2024-09-14T12:01:17.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.985+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Ab_eYjlt3RALEJeGoPI17qeytZQpaA2_0 2024-09-14T12:01:17.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.985+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2783614622541772395', time=2024-09-14T13:35:43.588144+0000, chain.objs.size()=1 2024-09-14T12:01:17.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.985+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.H7PDOLm6NUP-5wt9LnPw2JeelL56ikq_0 2024-09-14T12:01:17.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.985+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5164223825332736621', time=2024-09-14T13:35:43.777478+0000, chain.objs.size()=1 2024-09-14T12:01:17.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.985+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.eLmnhJY8IoKVwgOjb_2uew85rBPW7Ma_0 2024-09-14T12:01:17.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.985+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7442727816959061592', time=2024-09-14T13:35:43.840036+0000, chain.objs.size()=1 2024-09-14T12:01:17.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.985+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.YkMmE2SlmkoCctGObvJJ8jMMTf_o4AR_0 2024-09-14T12:01:17.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.985+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6478835673333806082', time=2024-09-14T13:35:44.851407+0000, chain.objs.size()=1 2024-09-14T12:01:17.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.985+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.xzbmwup_t07ULW636H0wg_r-t-M_vW3_0 2024-09-14T12:01:17.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.986+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6500260072016942005', time=2024-09-14T13:35:44.971966+0000, chain.objs.size()=1 2024-09-14T12:01:17.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.986+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.rcJPj8TAcIvYBMKD0hlYW4kLOSh_RTL_0 2024-09-14T12:01:17.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.986+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6278976383277670596', time=2024-09-14T13:35:45.478933+0000, chain.objs.size()=1 2024-09-14T12:01:17.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.986+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.lYuIGnj7SWl4OSasrIdYZMYy7daE_P0_0 2024-09-14T12:01:17.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.986+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13833463705848447834', time=2024-09-14T13:35:45.613702+0000, chain.objs.size()=1 2024-09-14T12:01:17.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.986+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.t12e2XohIaZBXESfbpFCHr4c3Hf9Qle_0 2024-09-14T12:01:17.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.988+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1131123553051787722', time=2024-09-14T13:35:45.850782+0000, chain.objs.size()=1 2024-09-14T12:01:17.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.988+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.M9rKZMFYR5Z_PIMjvGw6n_-EPN4fiDw_0 2024-09-14T12:01:17.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.989+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9469500602869078588', time=2024-09-14T13:35:46.958333+0000, chain.objs.size()=1 2024-09-14T12:01:17.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.989+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.OyExDdF0Zrqsr2LllHJZN5BozpVUuFG_0 2024-09-14T12:01:17.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.989+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1471423127811410556', time=2024-09-14T13:35:47.047243+0000, chain.objs.size()=1 2024-09-14T12:01:17.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.989+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.yMwf_vqyQENDC1XvkFpgIEyc7IC2Eha_0 2024-09-14T12:01:17.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.989+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12806845833525295855', time=2024-09-14T13:35:49.646869+0000, chain.objs.size()=1 2024-09-14T12:01:17.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.989+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.g6DDvWlzeTs1Me5AhXAcKnTYBSApRIi_0 2024-09-14T12:01:17.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.989+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17516139905108460927', time=2024-09-14T13:35:50.124500+0000, chain.objs.size()=1 2024-09-14T12:01:17.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.989+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Tcar3JjPpE7qVt9xJEK0xlMr6vM9OEk_0 2024-09-14T12:01:17.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.989+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8956802842115192524', time=2024-09-14T13:35:50.898176+0000, chain.objs.size()=1 2024-09-14T12:01:17.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.989+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.hMUvq0otq9szYYjl7o4B1ibxQqNB3Gg_0 2024-09-14T12:01:17.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.989+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14004101433248737159', time=2024-09-14T13:35:51.355230+0000, chain.objs.size()=1 2024-09-14T12:01:17.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.989+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.vWg0sSpijCvejMaXOS9pDUSXrYjmW0O_0 2024-09-14T12:01:17.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.989+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1521757439589652375', time=2024-09-14T13:35:51.469181+0000, chain.objs.size()=1 2024-09-14T12:01:17.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.989+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.T11ATC2HMEg5ySLNtvZptT3i6eqQufd_0 2024-09-14T12:01:17.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.990+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5789287496433771917', time=2024-09-14T13:35:51.618077+0000, chain.objs.size()=1 2024-09-14T12:01:17.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.990+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.dBHCWwXu42uJ1FdWa29xmNDJKObOA6N_0 2024-09-14T12:01:17.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.990+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5899172556274985677', time=2024-09-14T13:35:52.120282+0000, chain.objs.size()=1 2024-09-14T12:01:17.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.990+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.el8MLjOYwuWJXUMA-44ZfO5U-LOO0rd_0 2024-09-14T12:01:17.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.991+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16387073333218213250', time=2024-09-14T13:35:52.310790+0000, chain.objs.size()=1 2024-09-14T12:01:17.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.991+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.whVTJ_3XlUI3n8mtPfgymtx5I0hgGOb_0 2024-09-14T12:01:17.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.992+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8541769261588872819', time=2024-09-14T13:35:52.311360+0000, chain.objs.size()=1 2024-09-14T12:01:17.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.992+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.VcQ5eyLo0W8WbpJF4fzyLfg-OSkllhD_0 2024-09-14T12:01:17.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.992+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8158841777064589619', time=2024-09-14T13:35:52.717533+0000, chain.objs.size()=1 2024-09-14T12:01:17.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.992+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.aY0ZYICvL0qGbfWF5Ghdc664CrRcFoN_0 2024-09-14T12:01:17.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.992+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12368336171037934539', time=2024-09-14T13:36:14.640319+0000, chain.objs.size()=1 2024-09-14T12:01:17.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.992+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.346__shadow_.MggU1WuaKOCa7NCBUdS-0bV9yUWDPDK_0 2024-09-14T12:01:17.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.995+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6088518435737753085', time=2024-09-14T13:36:54.334051+0000, chain.objs.size()=1 2024-09-14T12:01:17.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.995+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.385__shadow_.Jmn_mGKvws_tMHV5thvQ6LjY6sVQ-gA_0 2024-09-14T12:01:17.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.995+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15820821427356699482', time=2024-09-14T13:37:45.433892+0000, chain.objs.size()=1 2024-09-14T12:01:17.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.995+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.432__shadow_.-jGDS8XjPd3TCAPYtkEmBvDFAdY5nmk_0 2024-09-14T12:01:17.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.997+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/51669 2024-09-14T12:01:17.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T12:01:17.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17145920325383093252', time=2024-09-14T13:38:25.562688+0000, chain.objs.size()=1 2024-09-14T12:01:17.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.464__shadow_.6KnUhhZmD8_tIku_KvABPDVWKuN9Y5q_0 2024-09-14T12:01:17.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7140938910407844109', time=2024-09-14T13:38:28.363700+0000, chain.objs.size()=1 2024-09-14T12:01:17.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.466__shadow_.Wh47GTUI0IZDGV4Dbzh_2qpguC0fAXU_0 2024-09-14T12:01:17.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8409099090942423334', time=2024-09-14T13:38:29.435858+0000, chain.objs.size()=1 2024-09-14T12:01:17.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.467__shadow_.N8TojpmXOyDrUwRLs45qQwDP0dTxGHF_0 2024-09-14T12:01:17.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6291792839929501171', time=2024-09-14T13:38:42.820600+0000, chain.objs.size()=1 2024-09-14T12:01:17.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.484__shadow_.BC7RSVvMRJQsmcJqJG7NLtGp9OASjzw_0 2024-09-14T12:01:17.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1147333565082166424', time=2024-09-14T13:39:02.606924+0000, chain.objs.size()=1 2024-09-14T12:01:17.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.501__shadow_.nXpZIo1qaRre8n1KDbI99bQpfL10KOF_0 2024-09-14T12:01:17.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17607188847630169627', time=2024-09-14T13:39:55.500151+0000, chain.objs.size()=1 2024-09-14T12:01:17.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.519__multipart_mymultipart.2~Fod7pGfWmcBKasdjqxymU2RcOYASTEF.1 2024-09-14T12:01:17.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8765106010153857095', time=2024-09-14T13:45:44.776510+0000, chain.objs.size()=1 2024-09-14T12:01:17.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:3erL3NWc9htcxZoZR-d2HNhz9nAg7zd_.UrT4NUQyhgq43KEJ1kWiLD5DoNbstln_0 2024-09-14T12:01:17.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1937022954459913792', time=2024-09-14T13:46:12.668024+0000, chain.objs.size()=1 2024-09-14T12:01:17.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:EBA7iu7CrOxgBenknPOPmHnAFsba50U_.w8TWdxuj1DQbyHJpQxEGXoItovzby-y_0 2024-09-14T12:01:17.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7098085455113089706', time=2024-09-14T13:47:18.019974+0000, chain.objs.size()=1 2024-09-14T12:01:17.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.586__shadow:.mF0YOlCxMi3y383Ufh7dJUDn1HTxyb_.81lWFFFvuerHJ-VCxRWBnggIhDwfx1Z_0 2024-09-14T12:01:17.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12058084603008557611', time=2024-09-14T13:47:41.803806+0000, chain.objs.size()=1 2024-09-14T12:01:17.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.608__shadow_.wvDw83ceHrSBnxaDyrdmDcOD4po7Qom_0 2024-09-14T12:01:17.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13981027633957554226', time=2024-09-14T13:51:42.582471+0000, chain.objs.size()=1 2024-09-14T12:01:17.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.619__shadow_.Hmgh6ydER2NtBwpvysRgeQc-xy7ZLdI_0 2024-09-14T12:01:18.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7517417964323990038', time=2024-09-14T13:52:42.025582+0000, chain.objs.size()=1 2024-09-14T12:01:18.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:17.999+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.630__shadow_.jGg6SL7wnNU42RU--4cCxTFnAJYdSyb_0 2024-09-14T12:01:18.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.001+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11688683817960959288', time=2024-09-14T13:52:50.882633+0000, chain.objs.size()=1 2024-09-14T12:01:18.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.001+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.638__shadow_.C82HlCReYxKSGBT20D9YF2dBCa1JgYL_0 2024-09-14T12:01:18.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.003+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17681305799206652872', time=2024-09-14T13:52:53.777838+0000, chain.objs.size()=1 2024-09-14T12:01:18.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.003+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.641__shadow_.6jzdPsDwezjPlyFHUSwf3pa8zOJm3tw_0 2024-09-14T12:01:18.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.003+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18158538436092220831', time=2024-09-14T13:54:32.775097+0000, chain.objs.size()=1 2024-09-14T12:01:18.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.003+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.703__multipart_file1.2~TduzPfZOxKuYH1aBnpzgDzNHhHWpYzb.1 2024-09-14T12:01:18.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.003+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13174339092705414280', time=2024-09-14T13:55:42.496694+0000, chain.objs.size()=1 2024-09-14T12:01:18.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.003+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.742__shadow_.BFryuS0eLj8DOTRc5AIzLpybgHgAHhq_0 2024-09-14T12:01:18.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.003+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4762078069340818846', time=2024-09-14T13:57:57.537211+0000, chain.objs.size()=1 2024-09-14T12:01:18.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.003+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.767__shadow_.r9ICNj5bSjvylWfEOGa2XZcq39l63G4_0 2024-09-14T12:01:18.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.006+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:18.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.008+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T12:01:18.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.009+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:18.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.010+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45582' 2024-09-14T12:01:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='_NQH8fz1fBD4c_l-2PYYrfYPhJZ9lyRx', time=2024-09-14T13:28:35.239484+0000, chain.objs.size()=1 2024-09-14T12:01:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.164__shadow_.Q6O9MXw07dha5vspWOAP8m1E8AKvIq6_0 2024-09-14T12:01:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17663103342698364487', time=2024-09-14T13:31:39.198496+0000, chain.objs.size()=1 2024-09-14T12:01:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.237__shadow_.xTSwbOJQJTKvJw4u4pkPDJjfTHlQ3HO_0 2024-09-14T12:01:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10267559892442901260', time=2024-09-14T13:32:47.948375+0000, chain.objs.size()=1 2024-09-14T12:01:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.rxzINiA03-VfkURMRwfW9OIrt6m6CrC_0 2024-09-14T12:01:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4594655521636433756', time=2024-09-14T13:32:48.038711+0000, chain.objs.size()=1 2024-09-14T12:01:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.A6sIWjNYHMRRvMhZ64Di-ragS7CWSR2_0 2024-09-14T12:01:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5296483061029985485', time=2024-09-14T13:32:48.068578+0000, chain.objs.size()=1 2024-09-14T12:01:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ax3H0S1x091SqHDibwP4EzorREqfm05_0 2024-09-14T12:01:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12743071171116083836', time=2024-09-14T13:32:48.349764+0000, chain.objs.size()=1 2024-09-14T12:01:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.2LBMLEVkLZCUJ_hA-hv3TGAGClpTI-T_0 2024-09-14T12:01:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15029852170658905950', time=2024-09-14T13:32:49.028227+0000, chain.objs.size()=1 2024-09-14T12:01:18.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.MjD2BqHEgR_9zPJNNWjNRlHBWq4885d_0 2024-09-14T12:01:18.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8792532404165941125', time=2024-09-14T13:32:49.060525+0000, chain.objs.size()=1 2024-09-14T12:01:18.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.H5Ab2PH0ttvC5AuGJLWVLczzgd6-rye_0 2024-09-14T12:01:18.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12093935688543291593', time=2024-09-14T13:32:49.700620+0000, chain.objs.size()=1 2024-09-14T12:01:18.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.AD5gGJlBxDa-rGjPX0bgozARrwJoYp1_0 2024-09-14T12:01:18.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2031607715675196863', time=2024-09-14T13:32:49.820803+0000, chain.objs.size()=1 2024-09-14T12:01:18.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.B6gC78zN7HjknCJTAb5dhAuNpO_EuVw_0 2024-09-14T12:01:18.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6709709242244099760', time=2024-09-14T13:32:50.563339+0000, chain.objs.size()=1 2024-09-14T12:01:18.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.YIQZPXW0aT4biHckY3TouV3meYFMvPL_0 2024-09-14T12:01:18.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18105884370701992175', time=2024-09-14T13:32:50.745568+0000, chain.objs.size()=1 2024-09-14T12:01:18.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.011+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.K-2xy0ZVBzQMKo2YYcz7ZFAbb6PBN5O_0 2024-09-14T12:01:18.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.013+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14110067401400494214', time=2024-09-14T13:32:50.838990+0000, chain.objs.size()=1 2024-09-14T12:01:18.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.013+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.JI5HDYrDgZo3_HbBBuJ9sFZnKwDFc_F_0 2024-09-14T12:01:18.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.014+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2103143998777138324', time=2024-09-14T13:32:50.924771+0000, chain.objs.size()=1 2024-09-14T12:01:18.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.014+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.oIFGv0UL3ANnU2Sf5yqzTrQfUihVUtq_0 2024-09-14T12:01:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.015+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11329717194297511984', time=2024-09-14T13:32:50.963685+0000, chain.objs.size()=1 2024-09-14T12:01:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.015+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.6mjNYSbn785U8lF7QG1lgvJQ_FOGryi_0 2024-09-14T12:01:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.015+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9546057711965447021', time=2024-09-14T13:32:51.475477+0000, chain.objs.size()=1 2024-09-14T12:01:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.015+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.8RrD0uGitruNR6JAXrLDgCuuZb166sm_0 2024-09-14T12:01:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.015+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2891065385391837204', time=2024-09-14T13:32:52.343570+0000, chain.objs.size()=1 2024-09-14T12:01:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.015+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.xUqTg1Z0V1W7PX3iYX6DrK41t9EtmNp_0 2024-09-14T12:01:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.015+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6327261393356009104', time=2024-09-14T13:32:52.910687+0000, chain.objs.size()=1 2024-09-14T12:01:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.015+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.vx_upmdByXBBqDl64RCWx6sYUrzNel1_0 2024-09-14T12:01:18.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.015+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7503507551613846768', time=2024-09-14T13:32:53.550222+0000, chain.objs.size()=1 2024-09-14T12:01:18.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.015+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.gjYwVpFFQGqOB673PGKae1FDYYfTDqq_0 2024-09-14T12:01:18.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.015+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.756286132234533496', time=2024-09-14T13:32:54.037604+0000, chain.objs.size()=1 2024-09-14T12:01:18.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.015+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.f5Ax6Dv1U-tCv67zpzltIJfDZn8I3lx_0 2024-09-14T12:01:18.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.015+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3756233776360966644', time=2024-09-14T13:32:54.448848+0000, chain.objs.size()=1 2024-09-14T12:01:18.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.015+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.uMnCQzRdRx3_Z7XAW4BE3H-QIlpRJkK_0 2024-09-14T12:01:18.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.015+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5693811007130334708', time=2024-09-14T13:32:54.578329+0000, chain.objs.size()=1 2024-09-14T12:01:18.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.015+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.XbtDU1iNEM6QYivv3nX8y1nvs42wcJq_0 2024-09-14T12:01:18.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.016+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11314548354911828496', time=2024-09-14T13:32:54.587544+0000, chain.objs.size()=1 2024-09-14T12:01:18.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.016+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.XO2xtZxvZiJlm_XbBncw_09L5wb3BDM_0 2024-09-14T12:01:18.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.016+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7379472085149347917', time=2024-09-14T13:32:55.147890+0000, chain.objs.size()=1 2024-09-14T12:01:18.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.016+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Tu8hSxA_mHc0VDKED78ydo_9a7w5wdd_0 2024-09-14T12:01:18.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.017+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.277660398920000883', time=2024-09-14T13:32:55.512698+0000, chain.objs.size()=1 2024-09-14T12:01:18.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.017+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.noM0jFXAKOkzx0IRRGHVNfY27vjvO97_0 2024-09-14T12:01:18.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.018+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6248619134334658625', time=2024-09-14T13:32:55.606427+0000, chain.objs.size()=1 2024-09-14T12:01:18.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.018+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.tvFjzowL9szDRcwlHL-BVPZSwIaAy2k_0 2024-09-14T12:01:18.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.019+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4320604040177943717', time=2024-09-14T13:32:55.778022+0000, chain.objs.size()=1 2024-09-14T12:01:18.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.019+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.QeN9WK8Uay9Pq4ZjU9f4aNvutrXqDwt_0 2024-09-14T12:01:18.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.020+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9717196990244034948', time=2024-09-14T13:32:55.886807+0000, chain.objs.size()=1 2024-09-14T12:01:18.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.020+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ULc2V6NaOaD8Uxq0gGCSMhN1pkjAqK7_0 2024-09-14T12:01:18.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.020+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16346225432891634095', time=2024-09-14T13:32:57.250162+0000, chain.objs.size()=1 2024-09-14T12:01:18.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.020+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.qnvXaLJHGvHpdcf_TtpH7Jo8YdVQDJT_0 2024-09-14T12:01:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.020+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.720884853554716694', time=2024-09-14T13:32:58.246378+0000, chain.objs.size()=1 2024-09-14T12:01:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.020+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.A-Elrn6USouZOW3jJozGCAfADCwhDZk_0 2024-09-14T12:01:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.020+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1822955111348619457', time=2024-09-14T13:32:58.247501+0000, chain.objs.size()=1 2024-09-14T12:01:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.020+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.1Zu0un_k7RcgcKJNWelBOZG2Xt8GwLa_0 2024-09-14T12:01:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.020+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15992304340067808269', time=2024-09-14T13:32:58.752560+0000, chain.objs.size()=1 2024-09-14T12:01:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.020+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.M6lLVvpAByrbylTR6sSpK4gYI08_Fuo_0 2024-09-14T12:01:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.020+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.60627210582594498', time=2024-09-14T13:33:20.359241+0000, chain.objs.size()=1 2024-09-14T12:01:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.020+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.283__shadow_.abjhvmcb68432Jf5nR_WhJJQCXJYHLL_0 2024-09-14T12:01:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.020+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7766641452156195058', time=2024-09-14T13:33:20.368168+0000, chain.objs.size()=1 2024-09-14T12:01:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.020+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.283__shadow_.AD25JFXKA1oJTHF0ga1O51SG0-_vSbm_0 2024-09-14T12:01:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.020+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6103196090229790989', time=2024-09-14T13:33:27.091195+0000, chain.objs.size()=1 2024-09-14T12:01:18.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.020+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.289__shadow_.GlpkHDfjM4Jhl61bS8RTtSv6yGu6EtI_0 2024-09-14T12:01:18.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.021+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16952634658769003578', time=2024-09-14T13:33:33.147325+0000, chain.objs.size()=1 2024-09-14T12:01:18.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.021+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.1w-DB_YTRvO6pvpxpzIVYIa-Lmtzh1i_0 2024-09-14T12:01:18.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.021+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14189497743695618886', time=2024-09-14T13:33:35.556849+0000, chain.objs.size()=1 2024-09-14T12:01:18.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.021+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.VIImfg5xMtqa0s80A7QyIOklBjtOaJP_0 2024-09-14T12:01:18.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.021+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18194209861739040027', time=2024-09-14T13:34:51.523668+0000, chain.objs.size()=1 2024-09-14T12:01:18.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.021+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.GGK7Eg_PaW2Fu3ofG9rlAWArfmqnfNL_0 2024-09-14T12:01:18.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.024+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12609192597669646315', time=2024-09-14T13:34:51.524445+0000, chain.objs.size()=1 2024-09-14T12:01:18.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.024+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_._i-zV_hOjf7WTlB94lZsPI_2zUkPuOX_0 2024-09-14T12:01:18.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.024+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.490207312780790568', time=2024-09-14T13:34:51.525283+0000, chain.objs.size()=1 2024-09-14T12:01:18.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.024+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.iKFQIBVdptdf5bC0mMepwUXVuAgGHwj_0 2024-09-14T12:01:18.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.024+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7937022186029723001', time=2024-09-14T13:34:51.815312+0000, chain.objs.size()=1 2024-09-14T12:01:18.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.024+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.scER8hEosTBOZLbi-CRNzYHSsUwIFve_0 2024-09-14T12:01:18.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.024+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11490445903631942356', time=2024-09-14T13:34:51.863028+0000, chain.objs.size()=1 2024-09-14T12:01:18.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.024+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.TnJUqAGGAS0d1g2mf5v8h461wbiGm8B_0 2024-09-14T12:01:18.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.024+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6363022902351830744', time=2024-09-14T13:34:51.896721+0000, chain.objs.size()=1 2024-09-14T12:01:18.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.024+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.nJ8wYkLYzzD05hsTMmmdJfIuf1_soaI_0 2024-09-14T12:01:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.024+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17369952649344837840', time=2024-09-14T13:34:52.185355+0000, chain.objs.size()=1 2024-09-14T12:01:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.024+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.hlLZMwFB2lpomhxAyRIQecmJWdtjqkC_0 2024-09-14T12:01:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.025+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1831169560429403450', time=2024-09-14T13:34:52.306414+0000, chain.objs.size()=1 2024-09-14T12:01:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.025+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Wb619mTaHRzYLAOiMEKDKirAN1aJ30I_0 2024-09-14T12:01:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.025+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17514428484687348083', time=2024-09-14T13:34:53.649604+0000, chain.objs.size()=1 2024-09-14T12:01:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.025+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.bY5DQBjwJ_4N4GC3PL0p6GJ1nBK-SS-_0 2024-09-14T12:01:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.025+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7508635754778407387', time=2024-09-14T13:34:53.950705+0000, chain.objs.size()=1 2024-09-14T12:01:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.025+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.8W_vK4_eOfLKAW3Qyjr6EYB-PYlUmRI_0 2024-09-14T12:01:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.025+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13728757500117495957', time=2024-09-14T13:34:54.089741+0000, chain.objs.size()=1 2024-09-14T12:01:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.025+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.oYNUvyeaQ0yFFHTriZ97az2qRwCBDfR_0 2024-09-14T12:01:18.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.026+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10415821311519172039', time=2024-09-14T13:34:54.682719+0000, chain.objs.size()=1 2024-09-14T12:01:18.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.026+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.s8pbCTuvL4XRq-babIWxjxl9W06Jfdx_0 2024-09-14T12:01:18.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.029+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15399454058386442264', time=2024-09-14T13:34:54.700515+0000, chain.objs.size()=1 2024-09-14T12:01:18.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.029+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.vBFIDjK4KwGUELwtJNZtI7ITw7TLNkg_0 2024-09-14T12:01:18.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.029+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2756540446521519866', time=2024-09-14T13:34:54.831810+0000, chain.objs.size()=1 2024-09-14T12:01:18.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.029+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ENviRQ_lo_H33LhZLd0TgjbJhbrmFFO_0 2024-09-14T12:01:18.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.029+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7462315993232241770', time=2024-09-14T13:34:55.306584+0000, chain.objs.size()=1 2024-09-14T12:01:18.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.029+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.zG77hUkhI_tFRrMzMzD8zzHEW5jc2pl_0 2024-09-14T12:01:18.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.029+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11911490769574153040', time=2024-09-14T13:34:56.211211+0000, chain.objs.size()=1 2024-09-14T12:01:18.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.029+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.rJGSbFUf422Xi4p3v04vyjW2DQgsNHR_0 2024-09-14T12:01:18.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.029+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12962033600845567661', time=2024-09-14T13:34:56.211986+0000, chain.objs.size()=1 2024-09-14T12:01:18.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.029+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.zHWlFa_HDM7zoQJAIBxWXRsmwYkGTaz_0 2024-09-14T12:01:18.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.029+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13727657681382929766', time=2024-09-14T13:34:56.328935+0000, chain.objs.size()=1 2024-09-14T12:01:18.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.029+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.7oNy-X0dtS1Wf1bU8_lVml4TDQaUqDc_0 2024-09-14T12:01:18.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.029+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7668482249451690411', time=2024-09-14T13:34:56.610504+0000, chain.objs.size()=1 2024-09-14T12:01:18.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.029+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.WQWiSnv4kQ2V-i82UubkaQ6odAmXsI8_0 2024-09-14T12:01:18.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.029+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5096296811882363490', time=2024-09-14T13:34:57.120063+0000, chain.objs.size()=1 2024-09-14T12:01:18.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.029+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.3PbeQzD2iujikMFFlASJ_6fsMbcQMJe_0 2024-09-14T12:01:18.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.029+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11075668719627224486', time=2024-09-14T13:34:57.779660+0000, chain.objs.size()=1 2024-09-14T12:01:18.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.029+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.P8LflcPt4-vnuKAw98zi0nnsta_EVxt_0 2024-09-14T12:01:18.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.029+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11151354334384706947', time=2024-09-14T13:34:58.007845+0000, chain.objs.size()=1 2024-09-14T12:01:18.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.029+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.544jtM7BTYpzdwNIMFVRKVY7tOXtnp3_0 2024-09-14T12:01:18.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.029+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14356052492909364004', time=2024-09-14T13:34:58.079259+0000, chain.objs.size()=1 2024-09-14T12:01:18.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.029+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_._UJagpF8IhEjoR-wH0ktL3Ovr2-VM8x_0 2024-09-14T12:01:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.032+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10700589909021533989', time=2024-09-14T13:34:58.470110+0000, chain.objs.size()=1 2024-09-14T12:01:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.032+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.d-yygx71CwlX7XrDJ3xxsWzW6Lf9bBp_0 2024-09-14T12:01:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.032+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8798012357167234491', time=2024-09-14T13:34:59.383508+0000, chain.objs.size()=1 2024-09-14T12:01:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.032+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_._F0L53ZXL68_YT4OyhcZ08BLIIzCoAM_0 2024-09-14T12:01:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.032+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6473177561547431383', time=2024-09-14T13:34:59.840762+0000, chain.objs.size()=1 2024-09-14T12:01:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.032+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Q0L2Lj7r3qs-8xppsKyVFK4Hh-aKPmY_0 2024-09-14T12:01:18.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.033+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13738203497758150420', time=2024-09-14T13:35:01.141378+0000, chain.objs.size()=1 2024-09-14T12:01:18.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.033+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.6fodHe7FYxJ8ygObG64CzJCaL4r9pZK_0 2024-09-14T12:01:18.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.033+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13572816471243295353', time=2024-09-14T13:35:02.095657+0000, chain.objs.size()=1 2024-09-14T12:01:18.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.033+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.JDIWd-7sx-lZod9sANpJaDY-MY21Eo9_0 2024-09-14T12:01:18.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.033+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7821352077797858165', time=2024-09-14T13:35:02.282590+0000, chain.objs.size()=1 2024-09-14T12:01:18.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.033+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.SeeQCu19w2q_b6DlyXWs5tgCDHuTTp3_0 2024-09-14T12:01:18.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.033+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1768482336414646077', time=2024-09-14T13:35:02.391270+0000, chain.objs.size()=1 2024-09-14T12:01:18.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.033+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.m-ghTNc92s2QCJqhFjGkk9-TVbsNIsv_0 2024-09-14T12:01:18.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.033+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7670306997766708971', time=2024-09-14T13:35:41.638478+0000, chain.objs.size()=1 2024-09-14T12:01:18.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.033+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.LwI8NLDskuinheMaIr6YUc_0s1kZo4g_0 2024-09-14T12:01:18.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.033+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12929678751276058354', time=2024-09-14T13:35:41.944946+0000, chain.objs.size()=1 2024-09-14T12:01:18.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.033+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.OJkEKLp64IAWYMXfhRNhvxVbK3vhqnA_0 2024-09-14T12:01:18.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.033+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13091591734095370048', time=2024-09-14T13:35:42.258476+0000, chain.objs.size()=1 2024-09-14T12:01:18.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.033+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.IWbqJpRAkxXgpFNVB_sBmbhrfTkPovg_0 2024-09-14T12:01:18.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.033+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2435426673022665441', time=2024-09-14T13:35:42.287583+0000, chain.objs.size()=1 2024-09-14T12:01:18.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.033+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.cY0EGESM9LFDXo6vF6EQs5HNxy9cIZN_0 2024-09-14T12:01:18.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.036+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.955393726264553615', time=2024-09-14T13:35:42.636120+0000, chain.objs.size()=1 2024-09-14T12:01:18.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.036+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.g0EjDeUqNz_47-BPmPImA5QJ4Y9Krd0_0 2024-09-14T12:01:18.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.036+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1411268025875937643', time=2024-09-14T13:35:43.278747+0000, chain.objs.size()=1 2024-09-14T12:01:18.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.036+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.wm5YyrqMNwQWwH9Hfsnwwdst0EeISlG_0 2024-09-14T12:01:18.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.036+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13394202521282507844', time=2024-09-14T13:35:43.597581+0000, chain.objs.size()=1 2024-09-14T12:01:18.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.036+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.T0I16VNvL6VETHgTQENKOVdmvosjLVh_0 2024-09-14T12:01:18.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.036+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15149897237681406231', time=2024-09-14T13:35:43.874365+0000, chain.objs.size()=1 2024-09-14T12:01:18.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.036+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ouGv2LdoBrvsaV65xi2Kvn7HsmgTohN_0 2024-09-14T12:01:18.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.036+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9663679734899172071', time=2024-09-14T13:35:44.838335+0000, chain.objs.size()=1 2024-09-14T12:01:18.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.036+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Hq87vHu-3VwQUeuAxuuxu7NNn9H0O1V_0 2024-09-14T12:01:18.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.036+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.986028168123554273', time=2024-09-14T13:35:44.990248+0000, chain.objs.size()=1 2024-09-14T12:01:18.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.036+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.JjRU-RjH6PXScF9UI3C76I_B0djKGAd_0 2024-09-14T12:01:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.037+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13043850516229274265', time=2024-09-14T13:35:45.675239+0000, chain.objs.size()=1 2024-09-14T12:01:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.037+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.kMCeKlZHiCVLkesYLx2BIt3MvZT4Lgy_0 2024-09-14T12:01:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.037+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14196293953412151307', time=2024-09-14T13:35:46.313954+0000, chain.objs.size()=1 2024-09-14T12:01:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.037+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.VeGx6qMdS3iYbT-KX9cpd6GjSM57ASp_0 2024-09-14T12:01:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.038+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8609046434959649985', time=2024-09-14T13:35:46.431736+0000, chain.objs.size()=1 2024-09-14T12:01:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.038+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.QGKFX8oZ7SZJkS8Rg-VIwR7xlilkzxf_0 2024-09-14T12:01:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.038+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8452418528065506913', time=2024-09-14T13:35:46.605921+0000, chain.objs.size()=1 2024-09-14T12:01:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.038+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.bGT2jOZ77ooZ0fr4XaGu9MLGrjoFmL8_0 2024-09-14T12:01:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.039+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16007981280208222428', time=2024-09-14T13:35:46.924498+0000, chain.objs.size()=1 2024-09-14T12:01:18.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.039+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.LVUPICV4ncW4o8TR7iCYg6Cf56XnX0A_0 2024-09-14T12:01:18.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.041+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5309920793857903478', time=2024-09-14T13:35:48.249376+0000, chain.objs.size()=1 2024-09-14T12:01:18.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.041+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.HvXwlWVb40rFHkUV0HLBp_qXSPWqvGS_0 2024-09-14T12:01:18.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.041+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10884922422906464953', time=2024-09-14T13:35:48.323070+0000, chain.objs.size()=1 2024-09-14T12:01:18.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.041+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.uxDxbjSdyD2geMTyrRM5JegUQS2-S5O_0 2024-09-14T12:01:18.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.041+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9438884919426534885', time=2024-09-14T13:35:48.393536+0000, chain.objs.size()=1 2024-09-14T12:01:18.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.041+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.eBz-UTNbsmOgEgy-1TNaFY0oW6wpAuv_0 2024-09-14T12:01:18.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.042+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11184982331745344981', time=2024-09-14T13:35:48.678795+0000, chain.objs.size()=1 2024-09-14T12:01:18.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.042+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.7FMcBeFN8BH-6kyVUqbUbvT4nBakr9z_0 2024-09-14T12:01:18.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.042+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12730179530473393731', time=2024-09-14T13:35:48.765398+0000, chain.objs.size()=1 2024-09-14T12:01:18.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.042+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.PS6J2p2BKNGFYypRRHeckSWkauSpgjh_0 2024-09-14T12:01:18.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.042+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1104226026123798067', time=2024-09-14T13:35:48.838859+0000, chain.objs.size()=1 2024-09-14T12:01:18.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.042+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.hukQNKyQj-5yW11A_ovjTk7aw4hweOw_0 2024-09-14T12:01:18.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.042+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17912402547101524575', time=2024-09-14T13:35:49.586340+0000, chain.objs.size()=1 2024-09-14T12:01:18.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.042+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.qjY_WDEH0HgPkISP6vmEqBRCtgyQiqU_0 2024-09-14T12:01:18.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.042+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12172140871092410276', time=2024-09-14T13:35:50.249660+0000, chain.objs.size()=1 2024-09-14T12:01:18.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.042+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Y0hknCRgnkIGuD1blJ8hhAfSqcZc6hA_0 2024-09-14T12:01:18.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.042+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11953618784183347260', time=2024-09-14T13:35:50.641235+0000, chain.objs.size()=1 2024-09-14T12:01:18.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.042+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.QN_upG63cldnlWs02a9Z5rhv18w5zJo_0 2024-09-14T12:01:18.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.042+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17043808796272138078', time=2024-09-14T13:35:50.754395+0000, chain.objs.size()=1 2024-09-14T12:01:18.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.042+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.oaiDa-L3QtT5jNv9fZRdesSJ2C5Sw5Y_0 2024-09-14T12:01:18.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.044+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11988066467434442641', time=2024-09-14T13:35:51.354297+0000, chain.objs.size()=1 2024-09-14T12:01:18.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.044+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.b5sFl-kl21JKQ7KoUWpyaGZJU2fOr1t_0 2024-09-14T12:01:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.047+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14833331462117222244', time=2024-09-14T13:35:51.603083+0000, chain.objs.size()=1 2024-09-14T12:01:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.047+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.h-RkwiPOvAXuxjYSsk9WLwK-oo1sQG8_0 2024-09-14T12:01:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.047+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8678975075599869827', time=2024-09-14T13:35:51.639004+0000, chain.objs.size()=1 2024-09-14T12:01:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.047+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.JwHAa7x3ZC2ypQC19IFEaEWmdNbLja5_0 2024-09-14T12:01:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.047+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17699062121085815513', time=2024-09-14T13:35:51.980590+0000, chain.objs.size()=1 2024-09-14T12:01:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.047+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.r-8fK9MCz3BdM79rx41PG_Tsy_JNthY_0 2024-09-14T12:01:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.047+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10919280740073709192', time=2024-09-14T13:35:52.061800+0000, chain.objs.size()=1 2024-09-14T12:01:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.047+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.YVCnh5BTQkbf1DDlXoNid9nx7mxokmo_0 2024-09-14T12:01:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.047+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10642168226501814452', time=2024-09-14T13:35:52.287439+0000, chain.objs.size()=1 2024-09-14T12:01:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.047+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.KCvSsgP3pW_84w_7urCoRUT5ImYh1mM_0 2024-09-14T12:01:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.047+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9164608334823010514', time=2024-09-14T13:35:52.407991+0000, chain.objs.size()=1 2024-09-14T12:01:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.047+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.bblSENVVfeI44dOAS8x9GPBrB1B_ZhR_0 2024-09-14T12:01:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.047+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2558169202479361170', time=2024-09-14T13:35:52.623655+0000, chain.objs.size()=1 2024-09-14T12:01:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.047+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.lKZkBCHPcwcp44U_6S2mV374oWRfDVt_0 2024-09-14T12:01:18.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.051+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/45582 2024-09-14T12:01:18.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.054+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-14T12:01:18.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.054+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4784266825712724218', time=2024-09-14T13:35:54.691462+0000, chain.objs.size()=1 2024-09-14T12:01:18.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.054+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.327__shadow_.XnmG4wjMk_iE27F9uuD80eKe5UAN-_C_0 2024-09-14T12:01:18.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.054+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8685983628013711241', time=2024-09-14T13:37:56.059175+0000, chain.objs.size()=1 2024-09-14T12:01:18.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.054+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.442__shadow_.d6burJNXhza4ORgU12exVzS2c8FNVra_0 2024-09-14T12:01:18.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.054+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1442377172710090757', time=2024-09-14T13:38:26.974033+0000, chain.objs.size()=1 2024-09-14T12:01:18.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.054+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.465__shadow_.lP34_Nom5dLb3B3wC0VXl-J40WAL_LZ_0 2024-09-14T12:01:18.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.054+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4302820696300580977', time=2024-09-14T13:38:40.085238+0000, chain.objs.size()=1 2024-09-14T12:01:18.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.054+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.482__shadow_.WoJZHDjLAWfRYaMM6Kz4DvQd4KSCdSJ_0 2024-09-14T12:01:18.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.054+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15274293220079486975', time=2024-09-14T13:38:40.088981+0000, chain.objs.size()=1 2024-09-14T12:01:18.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.054+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.482__shadow_.5EBVuuEIOYRsCbf79p_VgNSk8_lgB1R_0 2024-09-14T12:01:18.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.054+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7322416659597914634', time=2024-09-14T13:38:42.809374+0000, chain.objs.size()=1 2024-09-14T12:01:18.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.054+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.484__shadow_.CfUKOS-thswnlXXTpejlMyNC3xwjFka_0 2024-09-14T12:01:18.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.054+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3662539815513642015', time=2024-09-14T13:39:37.495483+0000, chain.objs.size()=1 2024-09-14T12:01:18.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.054+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.512__multipart_mymultipart.2~9Qa31leQy8YU5cO_9YEGZees7w_zpJD.1 2024-09-14T12:01:18.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.054+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6886947103979527181', time=2024-09-14T13:39:52.055822+0000, chain.objs.size()=1 2024-09-14T12:01:18.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.054+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.519__multipart_mymultipart.2~_D194YHjEIc0f-Us-ADekEs7UE5WC7W.1 2024-09-14T12:01:18.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.054+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13147735788372005602', time=2024-09-14T13:40:14.340530+0000, chain.objs.size()=6 2024-09-14T12:01:18.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.054+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.520__multipart_mymultipart.2~u9Qy8Mje8-RZP2JxAIZFMrPskOglZNC.1 2024-09-14T12:01:18.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.054+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.520__multipart_mymultipart.2~u9Qy8Mje8-RZP2JxAIZFMrPskOglZNC.2 2024-09-14T12:01:18.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.054+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.520__multipart_mymultipart.2~u9Qy8Mje8-RZP2JxAIZFMrPskOglZNC.3 2024-09-14T12:01:18.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.054+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.520__multipart_mymultipart.2~u9Qy8Mje8-RZP2JxAIZFMrPskOglZNC.4 2024-09-14T12:01:18.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.056+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.520__multipart_mymultipart.2~u9Qy8Mje8-RZP2JxAIZFMrPskOglZNC.5 2024-09-14T12:01:18.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.057+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.520__multipart_mymultipart.2~u9Qy8Mje8-RZP2JxAIZFMrPskOglZNC.6 2024-09-14T12:01:18.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.057+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12141506205893362506', time=2024-09-14T13:44:54.714833+0000, chain.objs.size()=1 2024-09-14T12:01:18.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.057+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.555__shadow_.1gJFx-Sf_8_g0_clhLFdS7RnhTpNdep_0 2024-09-14T12:01:18.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.057+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1510343605678795962', time=2024-09-14T13:45:08.083242+0000, chain.objs.size()=1 2024-09-14T12:01:18.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.057+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.558__shadow_.V5rVevI14aPDFYRlH92gHl_9i7frTvT_0 2024-09-14T12:01:18.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.057+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11356056167095144992', time=2024-09-14T13:47:02.378789+0000, chain.objs.size()=4 2024-09-14T12:01:18.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.057+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.579__multipart_testobj.2~Fx13Kc2B1g7FH-dwRTt__3PCvaT11_6.1 2024-09-14T12:01:18.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.057+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.579__multipart_testobj.2~Fx13Kc2B1g7FH-dwRTt__3PCvaT11_6.2 2024-09-14T12:01:18.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.057+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.579__multipart_testobj.2~Fx13Kc2B1g7FH-dwRTt__3PCvaT11_6.3 2024-09-14T12:01:18.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.060+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.579__multipart_testobj.2~Fx13Kc2B1g7FH-dwRTt__3PCvaT11_6.4 2024-09-14T12:01:18.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.060+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.845813252855123816', time=2024-09-14T13:47:18.050104+0000, chain.objs.size()=1 2024-09-14T12:01:18.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.060+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.586__shadow:HOxNA8EYYqc529klcE4Hi2iSpOwio8x_.aKjJXqhwRe6wAvTKwtcR4xm59drbRMO_0 2024-09-14T12:01:18.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.060+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17537490273008480581', time=2024-09-14T13:48:37.452218+0000, chain.objs.size()=6 2024-09-14T12:01:18.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.060+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.614__multipart_multipart_enc.2~Fuv6dhgI0uDQdgZuw2TobDjxRVzKx4z.1 2024-09-14T12:01:18.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.060+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.614__multipart_multipart_enc.2~Fuv6dhgI0uDQdgZuw2TobDjxRVzKx4z.2 2024-09-14T12:01:18.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.060+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.614__multipart_multipart_enc.2~Fuv6dhgI0uDQdgZuw2TobDjxRVzKx4z.3 2024-09-14T12:01:18.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.061+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.614__multipart_multipart_enc.2~Fuv6dhgI0uDQdgZuw2TobDjxRVzKx4z.4 2024-09-14T12:01:18.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.063+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.614__multipart_multipart_enc.2~Fuv6dhgI0uDQdgZuw2TobDjxRVzKx4z.5 2024-09-14T12:01:18.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.063+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.614__multipart_multipart_enc.2~Fuv6dhgI0uDQdgZuw2TobDjxRVzKx4z.6 2024-09-14T12:01:18.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.063+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15321685705346986476', time=2024-09-14T13:53:18.617477+0000, chain.objs.size()=1 2024-09-14T12:01:18.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.063+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.653__shadow_.DBz0J10RWfA-4IShTm9Cszn8HatfEbe_0 2024-09-14T12:01:18.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.063+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12609754716650754942', time=2024-09-14T13:53:52.891788+0000, chain.objs.size()=6 2024-09-14T12:01:18.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.063+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.661__multipart_bar.2~6GYqhUZ1dTE_HazLZDwyCOEN3ENbSzw.1 2024-09-14T12:01:18.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.063+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.661__multipart_bar.2~6GYqhUZ1dTE_HazLZDwyCOEN3ENbSzw.2 2024-09-14T12:01:18.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.065+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.661__multipart_bar.2~6GYqhUZ1dTE_HazLZDwyCOEN3ENbSzw.3 2024-09-14T12:01:18.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.065+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.661__multipart_bar.2~6GYqhUZ1dTE_HazLZDwyCOEN3ENbSzw.4 2024-09-14T12:01:18.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.065+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.661__multipart_bar.2~6GYqhUZ1dTE_HazLZDwyCOEN3ENbSzw.5 2024-09-14T12:01:18.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.065+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.661__multipart_bar.2~6GYqhUZ1dTE_HazLZDwyCOEN3ENbSzw.6 2024-09-14T12:01:18.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.065+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15969612890347329686', time=2024-09-14T13:54:45.057509+0000, chain.objs.size()=1 2024-09-14T12:01:18.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.065+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.715__shadow:0Ex-6cWt6t7HFINFU3SQE2sYXC9jtQk_.Y0KAh_uVj1W89SvTO4rOvh5j_RhEyJ2_0 2024-09-14T12:01:18.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.065+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9940267818122908334', time=2024-09-14T13:56:15.830417+0000, chain.objs.size()=1 2024-09-14T12:01:18.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.065+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.749__shadow_.Sav7E4S-BkNfpHcytymCVhaC-YMnJX6_0 2024-09-14T12:01:18.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.072+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:18.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.075+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T12:01:18.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.076+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:18.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.076+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:18.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/71091' 2024-09-14T12:01:18.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6421093255944923128', time=2024-09-14T13:28:57.310583+0000, chain.objs.size()=1 2024-09-14T12:01:18.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.177__shadow_.NLm9RGT-FUra72JTuaS6h77P2aJ9tid_0 2024-09-14T12:01:18.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6267088052699188862', time=2024-09-14T13:31:50.542976+0000, chain.objs.size()=1 2024-09-14T12:01:18.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.245__shadow_.fwUdbIwp0dXi8Njs19JpPh36O1Tl_47_0 2024-09-14T12:01:18.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.983739050753046740', time=2024-09-14T13:31:57.318956+0000, chain.objs.size()=1 2024-09-14T12:01:18.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.251__shadow_.51vQea8LRU6yVrCVJexZSQm9OUGYDoo_0 2024-09-14T12:01:18.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15760724404570977954', time=2024-09-14T13:32:01.696739+0000, chain.objs.size()=1 2024-09-14T12:01:18.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.255__shadow_.l8FSwQYa4moycH5dMCmahf481hcZIIA_0 2024-09-14T12:01:18.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15090647023716863440', time=2024-09-14T13:32:03.904612+0000, chain.objs.size()=1 2024-09-14T12:01:18.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.257__shadow_.hM-Le0SpXsn_2hYnU1kLxgwcOMnAOPU_0 2024-09-14T12:01:18.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16431055692993669276', time=2024-09-14T13:32:47.452241+0000, chain.objs.size()=1 2024-09-14T12:01:18.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.wEgsDU-UepMhtF_wOsTCGF9iv9S-PGP_0 2024-09-14T12:01:18.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18169666680360334133', time=2024-09-14T13:32:47.665233+0000, chain.objs.size()=1 2024-09-14T12:01:18.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ybHkPe05YTfuPBnoqRXwfhorMqKSDb0_0 2024-09-14T12:01:18.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6605916190213321602', time=2024-09-14T13:32:47.823761+0000, chain.objs.size()=1 2024-09-14T12:01:18.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.AzBH2j0PCSWyeOdeRvtQPJqYaL1dwOv_0 2024-09-14T12:01:18.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12860188784848390534', time=2024-09-14T13:32:48.042773+0000, chain.objs.size()=1 2024-09-14T12:01:18.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.K490_PqPeMiP1saZl4WcvSyDnwfpDol_0 2024-09-14T12:01:18.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15354558826233355056', time=2024-09-14T13:32:48.062958+0000, chain.objs.size()=1 2024-09-14T12:01:18.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.rq7-SmLFOzqCEFacpATUEsV4KHocFTx_0 2024-09-14T12:01:18.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15569343229406261701', time=2024-09-14T13:32:48.093115+0000, chain.objs.size()=1 2024-09-14T12:01:18.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.oyyL3So5nyfJmvbWrNYJaJUUNnb-wou_0 2024-09-14T12:01:18.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11223034407674496735', time=2024-09-14T13:32:48.425203+0000, chain.objs.size()=1 2024-09-14T12:01:18.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.077+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.nwhEfKCKCXoy5FQh5KGac48qetpQMDF_0 2024-09-14T12:01:18.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.080+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7072540958698096278', time=2024-09-14T13:32:50.050935+0000, chain.objs.size()=1 2024-09-14T12:01:18.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.080+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.UXCUPWIzIB6AcQ_Iffs3sib2sqajKnu_0 2024-09-14T12:01:18.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.080+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14077934654917852785', time=2024-09-14T13:32:50.713812+0000, chain.objs.size()=1 2024-09-14T12:01:18.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.080+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.dTiOs2ljSLvixd7pDZeg_T6GK_kJ1U-_0 2024-09-14T12:01:18.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.080+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12826497298784343202', time=2024-09-14T13:32:50.744214+0000, chain.objs.size()=1 2024-09-14T12:01:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.080+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.GqZADj_ADTPjdVa6Nrx9r9cmL5jy--I_0 2024-09-14T12:01:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.080+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15263947202851429341', time=2024-09-14T13:32:50.866495+0000, chain.objs.size()=1 2024-09-14T12:01:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.080+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.OkjQ2fC67hVpgUrA38dHakUuSOuT6id_0 2024-09-14T12:01:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.081+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8440023926402697270', time=2024-09-14T13:32:50.990321+0000, chain.objs.size()=1 2024-09-14T12:01:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.081+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Nsar5ii5Q6hYek2xSZ_fezd4W-p9zon_0 2024-09-14T12:01:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.081+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9597010606954208196', time=2024-09-14T13:32:50.991073+0000, chain.objs.size()=1 2024-09-14T12:01:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.081+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.uGOnxmG6OhFK1PV-GW62rH4-1NqrQWh_0 2024-09-14T12:01:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.081+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.272414706005639828', time=2024-09-14T13:32:51.451744+0000, chain.objs.size()=1 2024-09-14T12:01:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.081+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.mJOsA4oUHWnFRSt75uPfR6y4MW6sbqI_0 2024-09-14T12:01:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.081+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9356866596417825964', time=2024-09-14T13:32:51.612480+0000, chain.objs.size()=1 2024-09-14T12:01:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.081+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.25PZSTDK8_HTtLA_eGlW8w7MgqGJfA7_0 2024-09-14T12:01:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.081+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11096689826315272015', time=2024-09-14T13:32:52.360197+0000, chain.objs.size()=1 2024-09-14T12:01:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.081+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.QA86MrzAsy0tFimCFBrTBIdsD5iXT-l_0 2024-09-14T12:01:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.081+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6402942595000060650', time=2024-09-14T13:32:52.484149+0000, chain.objs.size()=1 2024-09-14T12:01:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.081+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.OTpfPcaDpKyESHBVKrxhvb_RoIXyF5W_0 2024-09-14T12:01:18.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.081+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.476306029095056195', time=2024-09-14T13:32:52.620264+0000, chain.objs.size()=1 2024-09-14T12:01:18.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.081+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Zq21N6wam-bYDwoO49aOTo4jfY4S7Vc_0 2024-09-14T12:01:18.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.084+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13059675369758389705', time=2024-09-14T13:32:52.686982+0000, chain.objs.size()=1 2024-09-14T12:01:18.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.084+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.q3rhi8nzVZZoK1-CLIxyMSO1WMX4DQK_0 2024-09-14T12:01:18.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.084+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7850440252758083944', time=2024-09-14T13:32:52.851013+0000, chain.objs.size()=1 2024-09-14T12:01:18.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.084+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Vd8sCMyVQH6OAnt4ofZxvXFjixcskJ2_0 2024-09-14T12:01:18.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.084+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16013931187913666214', time=2024-09-14T13:32:53.663927+0000, chain.objs.size()=1 2024-09-14T12:01:18.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.084+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.qDxbMWe7zLjWEUeJre-KoVPz-Yf3Kia_0 2024-09-14T12:01:18.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.085+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8247985528051794026', time=2024-09-14T13:32:53.768379+0000, chain.objs.size()=1 2024-09-14T12:01:18.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.085+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.MsdMl8Cyb7xUIN8g5649nQY7in7lGii_0 2024-09-14T12:01:18.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.085+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17925270232376661465', time=2024-09-14T13:32:54.388873+0000, chain.objs.size()=1 2024-09-14T12:01:18.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.085+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.2gleFB160MyHuuKZhEznO57A6UmoUgw_0 2024-09-14T12:01:18.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.085+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17865740688733179252', time=2024-09-14T13:32:54.424696+0000, chain.objs.size()=1 2024-09-14T12:01:18.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.085+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.720VHbWcqyNVBzLVL2xGe3rwHftPhAq_0 2024-09-14T12:01:18.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.086+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10884348303692824962', time=2024-09-14T13:32:54.561819+0000, chain.objs.size()=1 2024-09-14T12:01:18.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.086+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.irH0Qh7FB9daolVwXr98YnF4m_i28fb_0 2024-09-14T12:01:18.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.086+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17345656318848220196', time=2024-09-14T13:32:54.984530+0000, chain.objs.size()=1 2024-09-14T12:01:18.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.086+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.OSVIjWvU961my1WwBvB3Kw3U8mz6RSE_0 2024-09-14T12:01:18.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.086+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2131700738242727940', time=2024-09-14T13:32:55.193382+0000, chain.objs.size()=1 2024-09-14T12:01:18.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.086+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ZcUPar48m4R1RI5RdzIPYQ_uTDSFhQ2_0 2024-09-14T12:01:18.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.086+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3639378561414027916', time=2024-09-14T13:32:55.232742+0000, chain.objs.size()=1 2024-09-14T12:01:18.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.086+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.nfy2U7h_LobZGfWnutcPIN_ebGcZl6g_0 2024-09-14T12:01:18.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.086+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10362045595904771994', time=2024-09-14T13:32:55.633812+0000, chain.objs.size()=1 2024-09-14T12:01:18.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.086+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.dVuEm5ikWEdCSRzN5teHxPhNVsr1SIM_0 2024-09-14T12:01:18.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.087+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7547432575274708147', time=2024-09-14T13:32:55.682923+0000, chain.objs.size()=1 2024-09-14T12:01:18.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.087+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.LHrGYv8WRYy0iEwTuo4ba60hOql2zNd_0 2024-09-14T12:01:18.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.089+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14369564718232995661', time=2024-09-14T13:32:55.847642+0000, chain.objs.size()=1 2024-09-14T12:01:18.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.089+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.O2ZCaA_ykKWzXG_PWyf0LVXZwKO0YdT_0 2024-09-14T12:01:18.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.089+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8147851589158115134', time=2024-09-14T13:32:55.982329+0000, chain.objs.size()=1 2024-09-14T12:01:18.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.089+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.yhh48xfOWCU7mLcAJjvnXzv_v-h9rfp_0 2024-09-14T12:01:18.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.089+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4771345755723826201', time=2024-09-14T13:32:55.998819+0000, chain.objs.size()=1 2024-09-14T12:01:18.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.089+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.n-eGJq6Oc5rNKKUkoaBbYhmchAmk2k5_0 2024-09-14T12:01:18.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.090+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17970594064817675672', time=2024-09-14T13:32:56.360713+0000, chain.objs.size()=1 2024-09-14T12:01:18.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.090+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.QkiVs4SEv-ooZYNww9NfNsn3s7fc5wp_0 2024-09-14T12:01:18.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.090+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16474627618187530230', time=2024-09-14T13:32:56.634273+0000, chain.objs.size()=1 2024-09-14T12:01:18.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.090+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.gDCAVeFavGiOVK8OMa1FGyVbS3Da_ss_0 2024-09-14T12:01:18.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.090+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3343613443026355584', time=2024-09-14T13:32:56.674295+0000, chain.objs.size()=1 2024-09-14T12:01:18.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.090+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.iIwEm1rdEjW5ZOx5AsaWaIAbzplXfB6_0 2024-09-14T12:01:18.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.090+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2384039656522295798', time=2024-09-14T13:32:56.992879+0000, chain.objs.size()=1 2024-09-14T12:01:18.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.090+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.XcoLDkuHupttxF4IxENGrlvSVzXGi6n_0 2024-09-14T12:01:18.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.091+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11305139305016467898', time=2024-09-14T13:32:57.092612+0000, chain.objs.size()=1 2024-09-14T12:01:18.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.091+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.bGkfCe6v4BRNbj70XiljC9IItRBq4nD_0 2024-09-14T12:01:18.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.091+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16744778042665401470', time=2024-09-14T13:32:57.221331+0000, chain.objs.size()=1 2024-09-14T12:01:18.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.091+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Ha9-NP455Xhr6UmUeokOBJ7NFBzi4mN_0 2024-09-14T12:01:18.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.091+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2870387932463797806', time=2024-09-14T13:32:57.783572+0000, chain.objs.size()=1 2024-09-14T12:01:18.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.091+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.eMdYl3GYbCjmX7SoTIiw2y7a3IrwEEg_0 2024-09-14T12:01:18.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.091+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17447698603954568838', time=2024-09-14T13:32:58.194748+0000, chain.objs.size()=1 2024-09-14T12:01:18.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.091+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.33fy2Sr9T5rS2UHsGxp5-75P8M8Zbfq_0 2024-09-14T12:01:18.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.095+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13513627048721576086', time=2024-09-14T13:33:07.376195+0000, chain.objs.size()=1 2024-09-14T12:01:18.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.095+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.271__shadow_.B7rkfPgzChEzpcaEd0taBYdGIohYivP_0 2024-09-14T12:01:18.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.095+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7788849989154773013', time=2024-09-14T13:33:11.611423+0000, chain.objs.size()=1 2024-09-14T12:01:18.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.095+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.275__shadow_.i0bR24lBG9juI8JJIu-LNBk_8mY9U6v_0 2024-09-14T12:01:18.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.095+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4307019718969087138', time=2024-09-14T13:33:14.912061+0000, chain.objs.size()=1 2024-09-14T12:01:18.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.095+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.278__shadow_.WrgxPztMP7cJTfJ4Et7P0Nwgvr6nym1_0 2024-09-14T12:01:18.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.095+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6059313698747922566', time=2024-09-14T13:33:23.758634+0000, chain.objs.size()=1 2024-09-14T12:01:18.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.095+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.286__shadow_.XrJehjx3Vk8PtRKTNIFgWeYVXoyyUyp_0 2024-09-14T12:01:18.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.095+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12080380182495530174', time=2024-09-14T13:33:33.119064+0000, chain.objs.size()=1 2024-09-14T12:01:18.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.095+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.7AezqpLxTWx9ncV2dq-byD_kEiWemTy_0 2024-09-14T12:01:18.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.095+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.19251924947250344', time=2024-09-14T13:33:33.159809+0000, chain.objs.size()=1 2024-09-14T12:01:18.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.095+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.S5j588JaITQ_L3fA4QSYhQ-mDWVH4m8_0 2024-09-14T12:01:18.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.095+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1226911530853448028', time=2024-09-14T13:33:35.638019+0000, chain.objs.size()=1 2024-09-14T12:01:18.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.095+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.8JQRmfAN04p7PfGprxbz5Y4HDYSh9_L_0 2024-09-14T12:01:18.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.095+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15716183516435170717', time=2024-09-14T13:33:41.191860+0000, chain.objs.size()=1 2024-09-14T12:01:18.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.096+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.299__shadow_.zf_qREJJ99Ds8_vCe_S88xZwsl_4WIc_0 2024-09-14T12:01:18.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.096+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13065024280134523752', time=2024-09-14T13:33:49.135528+0000, chain.objs.size()=1 2024-09-14T12:01:18.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.096+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.306__shadow_.JEUgeH-wuAhKhMYtnr0NHGvv-fm7zrc_0 2024-09-14T12:01:18.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.096+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16424515229106118237', time=2024-09-14T13:34:51.947016+0000, chain.objs.size()=1 2024-09-14T12:01:18.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.096+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.MTisbZln7fmcrI2SIC-xlAfRhC0lUQi_0 2024-09-14T12:01:18.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.096+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5478041313569537621', time=2024-09-14T13:34:52.201753+0000, chain.objs.size()=1 2024-09-14T12:01:18.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.096+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.vfUiiwMuTazjBdVY1kYRFuIhpxxn56q_0 2024-09-14T12:01:18.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.097+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15340401880471190580', time=2024-09-14T13:34:52.428858+0000, chain.objs.size()=1 2024-09-14T12:01:18.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.097+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.hGXpMCPa7DrK1J9itPPTHIm7E6foEJ4_0 2024-09-14T12:01:18.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.100+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1668176157247117514', time=2024-09-14T13:34:53.119364+0000, chain.objs.size()=1 2024-09-14T12:01:18.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.100+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.VHxyXfJgE5zvGrsqiwNOuFYKwt3RAtO_0 2024-09-14T12:01:18.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.100+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1786095271836045555', time=2024-09-14T13:34:53.490944+0000, chain.objs.size()=1 2024-09-14T12:01:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.100+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.kYXKqPmjST9hSEuJoJLdCCBALL-A2tt_0 2024-09-14T12:01:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.100+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4111528781992193669', time=2024-09-14T13:34:53.579148+0000, chain.objs.size()=1 2024-09-14T12:01:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.100+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.mYetQ-OkFeN5YlvnJJ0lLp7FY4WbBw4_0 2024-09-14T12:01:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.100+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7266867239606746580', time=2024-09-14T13:34:54.704520+0000, chain.objs.size()=1 2024-09-14T12:01:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.100+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.JzIXaDnHum-ErShJoRSpJamnkAeERMH_0 2024-09-14T12:01:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.100+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16702551530800429952', time=2024-09-14T13:34:55.117790+0000, chain.objs.size()=1 2024-09-14T12:01:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.100+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ffTVVniUxjRXeRWT2s0oKavAaG0UB7W_0 2024-09-14T12:01:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.100+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4820190988540373337', time=2024-09-14T13:34:55.232259+0000, chain.objs.size()=1 2024-09-14T12:01:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.100+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.19Un3jXdGGdX8OA0riSB7EWqOvPgYdf_0 2024-09-14T12:01:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.100+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3240461793545927166', time=2024-09-14T13:34:55.433465+0000, chain.objs.size()=1 2024-09-14T12:01:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.100+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.O0hK29LaTxqmzNsKgzxZvcX55_2PS4W_0 2024-09-14T12:01:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.100+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15900319639256157572', time=2024-09-14T13:34:55.506751+0000, chain.objs.size()=1 2024-09-14T12:01:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.100+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.a3PFDYkdfOaQvgeMc-72aeqIqdKCzRH_0 2024-09-14T12:01:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.100+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.167235416662377510', time=2024-09-14T13:34:55.567440+0000, chain.objs.size()=1 2024-09-14T12:01:18.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.100+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.alq-dcx2GVrAxIBBC3r5Rl_OByu5_9E_0 2024-09-14T12:01:18.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.100+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12044833449315013970', time=2024-09-14T13:34:55.712822+0000, chain.objs.size()=1 2024-09-14T12:01:18.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.100+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.z-RnvfmXJ0Yg_s6M-4NrIz5rtlzQGBa_0 2024-09-14T12:01:18.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.102+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17126880369468073079', time=2024-09-14T13:34:56.208373+0000, chain.objs.size()=1 2024-09-14T12:01:18.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.102+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.WEhD32R6RxDjiJSVMBnwpVZXvB4uwgZ_0 2024-09-14T12:01:18.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.102+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9733795519466402210', time=2024-09-14T13:34:56.500469+0000, chain.objs.size()=1 2024-09-14T12:01:18.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.102+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.KsO94ZxMIu0M-3Scykk3uzM0EMwN7R-_0 2024-09-14T12:01:18.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.104+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7049393543091401311', time=2024-09-14T13:34:56.672143+0000, chain.objs.size()=1 2024-09-14T12:01:18.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.104+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.WPrEKp6pzSlh0NTeNV6G-KQuU49ga1o_0 2024-09-14T12:01:18.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.104+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3086688642756659527', time=2024-09-14T13:34:56.972275+0000, chain.objs.size()=1 2024-09-14T12:01:18.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.104+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.tskkIpfL12wSATSoaDH6eVxjGNYYmes_0 2024-09-14T12:01:18.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.104+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17573112870937499916', time=2024-09-14T13:34:57.639927+0000, chain.objs.size()=1 2024-09-14T12:01:18.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.104+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.SlAwfbHDK2H7iwaMf5dQRGMChhGD-lU_0 2024-09-14T12:01:18.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.104+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14768218077990515531', time=2024-09-14T13:34:58.162347+0000, chain.objs.size()=1 2024-09-14T12:01:18.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.104+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.T6ZmkSnAPtMUQUTuNIB0Q2d0aeHZE_Z_0 2024-09-14T12:01:18.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.104+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16086634749181920761', time=2024-09-14T13:34:58.705677+0000, chain.objs.size()=1 2024-09-14T12:01:18.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.104+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.SyVM2KRPhcBqn2-gx6d877nZroDOgJj_0 2024-09-14T12:01:18.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.104+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6312011262488160948', time=2024-09-14T13:34:59.086566+0000, chain.objs.size()=1 2024-09-14T12:01:18.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.104+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.IfNbtxwXcuE33pAqCOTVcpmbs5ccPls_0 2024-09-14T12:01:18.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.104+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17201842431192893544', time=2024-09-14T13:34:59.493983+0000, chain.objs.size()=1 2024-09-14T12:01:18.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.104+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.zOLlQfFMvf-KNfA07dnOq2yZ0b3T8xf_0 2024-09-14T12:01:18.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.104+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8218079879126577490', time=2024-09-14T13:34:59.609674+0000, chain.objs.size()=1 2024-09-14T12:01:18.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.104+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.JyRgctCm5zSKXlC4gFnD02ad7Xi1sV9_0 2024-09-14T12:01:18.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.106+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12666781391466123461', time=2024-09-14T13:34:59.753805+0000, chain.objs.size()=1 2024-09-14T12:01:18.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.106+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.L34JxW29AB0KIgUFDE4DdE4goe13OTF_0 2024-09-14T12:01:18.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.106+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10698468197901339618', time=2024-09-14T13:34:59.855706+0000, chain.objs.size()=1 2024-09-14T12:01:18.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.106+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_._2jjtNSA46VWyJ8rqH0TmVGBjokWfWs_0 2024-09-14T12:01:18.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.106+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11759411590764817620', time=2024-09-14T13:35:00.114773+0000, chain.objs.size()=1 2024-09-14T12:01:18.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.106+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.vef-OFZOv1jL3BnVEQdBeshIaGGu-NB_0 2024-09-14T12:01:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.108+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12474733829730787266', time=2024-09-14T13:35:00.457348+0000, chain.objs.size()=1 2024-09-14T12:01:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.108+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Cews2_mlFOThZKE2pflqL6b9cvQbPW4_0 2024-09-14T12:01:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.108+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12296005497453371618', time=2024-09-14T13:35:00.613259+0000, chain.objs.size()=1 2024-09-14T12:01:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.108+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Z5zDxBZ4N7egcbutAlsOkY--jsSsw9S_0 2024-09-14T12:01:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.108+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9716048655179234581', time=2024-09-14T13:35:01.919510+0000, chain.objs.size()=1 2024-09-14T12:01:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.108+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.E64GtzPZ3N5KKPvwrrkiGpecNuGHRzQ_0 2024-09-14T12:01:18.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.108+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3806965581883090563', time=2024-09-14T13:35:02.062224+0000, chain.objs.size()=1 2024-09-14T12:01:18.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.108+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.rDgs5t7fxwctyHq-omrSyJ3D6-ary-p_0 2024-09-14T12:01:18.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.109+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11510769399092783323', time=2024-09-14T13:35:02.461461+0000, chain.objs.size()=1 2024-09-14T12:01:18.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.109+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.MsZJgz-nkouN73ZzfOTIjJosOJZUXuL_0 2024-09-14T12:01:18.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.109+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12753418266389368876', time=2024-09-14T13:35:43.306299+0000, chain.objs.size()=1 2024-09-14T12:01:18.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.109+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.q6yjAihVWmO4QKywmcAnKcPjp1MBm9Z_0 2024-09-14T12:01:18.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.109+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2634379092964952686', time=2024-09-14T13:35:43.383936+0000, chain.objs.size()=1 2024-09-14T12:01:18.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.109+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.fOhveownm-3iQkcwIs0DJ3ThaRKwgXQ_0 2024-09-14T12:01:18.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.109+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15531823256844386993', time=2024-09-14T13:35:43.552388+0000, chain.objs.size()=1 2024-09-14T12:01:18.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.109+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.qIctJBCO05qf3NNuy8sEa-RaJYaE10i_0 2024-09-14T12:01:18.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.110+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17618944632333191748', time=2024-09-14T13:35:43.688282+0000, chain.objs.size()=1 2024-09-14T12:01:18.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.110+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.i9hB293pthwL6bM0t_gjJzoakQ_USlz_0 2024-09-14T12:01:18.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.110+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1098653268890411500', time=2024-09-14T13:35:43.806837+0000, chain.objs.size()=1 2024-09-14T12:01:18.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.110+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.PCiYq6pBBsiRq-dGDjODsV_D9KL9i8p_0 2024-09-14T12:01:18.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.113+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.798813094445399691', time=2024-09-14T13:35:43.847739+0000, chain.objs.size()=1 2024-09-14T12:01:18.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.113+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.QtXBLy8C1WL1hg_vFmJ3BCBT-dqbFn9_0 2024-09-14T12:01:18.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.113+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14221049483930667553', time=2024-09-14T13:35:43.887663+0000, chain.objs.size()=1 2024-09-14T12:01:18.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.113+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.fzYzK-y5-ZyGNeJGRlnhLaAMOPAoLDY_0 2024-09-14T12:01:18.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.113+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4950112347869329303', time=2024-09-14T13:35:44.843882+0000, chain.objs.size()=1 2024-09-14T12:01:18.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.113+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.yY3w4Gku_PCaqgI71jZjz1FAReTmKAN_0 2024-09-14T12:01:18.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.113+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7024870629821954025', time=2024-09-14T13:35:44.934971+0000, chain.objs.size()=1 2024-09-14T12:01:18.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.113+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.k0AQf2iaCRffFRhYljVvfDfW-STYjPF_0 2024-09-14T12:01:18.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.113+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10442725594483586832', time=2024-09-14T13:35:45.163553+0000, chain.objs.size()=1 2024-09-14T12:01:18.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.113+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_._az0Mr4li-AyRcbCPff4yt2O0La4ASH_0 2024-09-14T12:01:18.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.113+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.160357264771059968', time=2024-09-14T13:35:45.803102+0000, chain.objs.size()=1 2024-09-14T12:01:18.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.113+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.IyDwe8Atk_1Q0t3mhntDtdCBf-45NCL_0 2024-09-14T12:01:18.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.113+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12908200480396558473', time=2024-09-14T13:35:46.870836+0000, chain.objs.size()=1 2024-09-14T12:01:18.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.113+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ruj9GVXmAieK_L99xioeFAPpeeOPRB__0 2024-09-14T12:01:18.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.115+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4883433197539751277', time=2024-09-14T13:35:47.068322+0000, chain.objs.size()=1 2024-09-14T12:01:18.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.115+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.HaaXSNzLrwz9A71o6b60kdAWHSlkl5l_0 2024-09-14T12:01:18.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.115+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13242987655570543564', time=2024-09-14T13:35:47.284019+0000, chain.objs.size()=1 2024-09-14T12:01:18.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.115+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.kuVzziUVD2iNHzPrvp2HZOrX6ZWxlmN_0 2024-09-14T12:01:18.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.119+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/71091 2024-09-14T12:01:18.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=41, truncated=0, next_marker='' 2024-09-14T12:01:18.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1493891061389739993', time=2024-09-14T13:35:47.319951+0000, chain.objs.size()=1 2024-09-14T12:01:18.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.0Qt9waH3IoHvLsYkz3f3SsAtFIAQMZC_0 2024-09-14T12:01:18.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.359975369051302218', time=2024-09-14T13:35:48.055819+0000, chain.objs.size()=1 2024-09-14T12:01:18.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.EKm2Z08oJZD3Q_uuLnEztuIayU1fSrZ_0 2024-09-14T12:01:18.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2414871112220355129', time=2024-09-14T13:35:48.099574+0000, chain.objs.size()=1 2024-09-14T12:01:18.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.2LnICwZS6fYaNPkhwu_hK9A-ndpuTPG_0 2024-09-14T12:01:18.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11199018173514480234', time=2024-09-14T13:35:48.407185+0000, chain.objs.size()=1 2024-09-14T12:01:18.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.xf74myfiihuzJTt1LPjbeDl6IPKBH5O_0 2024-09-14T12:01:18.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6896780991742004316', time=2024-09-14T13:35:50.597992+0000, chain.objs.size()=1 2024-09-14T12:01:18.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.lUfx7_dZsywbtwTiR8CoLREEe9pB3VT_0 2024-09-14T12:01:18.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9993927025395231770', time=2024-09-14T13:35:50.757193+0000, chain.objs.size()=1 2024-09-14T12:01:18.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.1pgzS00DC1jE5e-TDOiwkwfHMWaEfAU_0 2024-09-14T12:01:18.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14924643883617009967', time=2024-09-14T13:35:50.757891+0000, chain.objs.size()=1 2024-09-14T12:01:18.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_._CKbB0MQGnlxPBIJg78c5f7fwBBvmmQ_0 2024-09-14T12:01:18.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3349057869927654971', time=2024-09-14T13:35:50.758541+0000, chain.objs.size()=1 2024-09-14T12:01:18.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.yTQkP5vBMsLINsfJxvrvXFHWG0M9Vxt_0 2024-09-14T12:01:18.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15843514607962559989', time=2024-09-14T13:35:50.786365+0000, chain.objs.size()=1 2024-09-14T12:01:18.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.bnTBtqc4yzNjMZK7unnWJxLWvisKp7t_0 2024-09-14T12:01:18.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3565396217313540', time=2024-09-14T13:35:50.859741+0000, chain.objs.size()=1 2024-09-14T12:01:18.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.880hXRRGtgUh2TGxnAqxbWrAF_nvk6x_0 2024-09-14T12:01:18.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.746473603511545093', time=2024-09-14T13:35:51.238381+0000, chain.objs.size()=1 2024-09-14T12:01:18.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.2F8n9pmCBKaw3rCEkhP2z9mI9GmiXq8_0 2024-09-14T12:01:18.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16617143953856580263', time=2024-09-14T13:35:51.988720+0000, chain.objs.size()=1 2024-09-14T12:01:18.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.121+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.83EOJN4HVc6GkcPD0GdSYOaYePekYYe_0 2024-09-14T12:01:18.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.123+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15944415844473145293', time=2024-09-14T13:35:52.164043+0000, chain.objs.size()=1 2024-09-14T12:01:18.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.123+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.MGiEV4JxvoA5NpwCZFNNIKHz358qleX_0 2024-09-14T12:01:18.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.124+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11535884897932249141', time=2024-09-14T13:35:52.553160+0000, chain.objs.size()=1 2024-09-14T12:01:18.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.124+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.mDoP3PMIo4nORMj4LtEWSAwM9cpPyoU_0 2024-09-14T12:01:18.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.125+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3523934200577282893', time=2024-09-14T13:35:52.569376+0000, chain.objs.size()=1 2024-09-14T12:01:18.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.125+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.B6D57mfoUE2r07nIL7Gvpc0eAGeQub3_0 2024-09-14T12:01:18.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.125+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12586044965165405595', time=2024-09-14T13:35:52.673917+0000, chain.objs.size()=1 2024-09-14T12:01:18.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.125+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.WZyISehI7OHDQbRrsBb26qSv7NyE58R_0 2024-09-14T12:01:18.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.125+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9451684370022278153', time=2024-09-14T13:35:52.767499+0000, chain.objs.size()=1 2024-09-14T12:01:18.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.125+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.u0DI2oOT6wtVyvM9OP2Gh3DQAw3vf8I_0 2024-09-14T12:01:18.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.125+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7797393890575086254', time=2024-09-14T13:38:15.024654+0000, chain.objs.size()=1 2024-09-14T12:01:18.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.125+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.457__shadow_.FI4AiFHUM2s-3imZYvfF9PevYm9rN29_0 2024-09-14T12:01:18.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.125+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8379549315054792499', time=2024-09-14T13:38:29.772568+0000, chain.objs.size()=1 2024-09-14T12:01:18.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.125+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.467__shadow_.wLa_g3Tp8m_v6i_pTZr9BK13gDS2WPi_0 2024-09-14T12:01:18.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.125+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9127322603020564040', time=2024-09-14T13:38:42.791135+0000, chain.objs.size()=1 2024-09-14T12:01:18.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.125+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.484__shadow_.D1QuELX0yEWe8qL82TVyB8XnHrpi4XB_0 2024-09-14T12:01:18.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.125+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4812366508361884132', time=2024-09-14T13:38:50.206036+0000, chain.objs.size()=1 2024-09-14T12:01:18.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.125+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.488__shadow_.07jB5aZM9lQJlgo4w6pCkT7eb1RGBqn_0 2024-09-14T12:01:18.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.126+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17076111435810617243', time=2024-09-14T13:39:06.627561+0000, chain.objs.size()=1 2024-09-14T12:01:18.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.126+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.504__shadow:-Styd.oxB8SSr1oI0lFwKs5hFqmwg-w_.MvQogDl8WgMpFFuD7AaaxQ0tKLuN8vP_0 2024-09-14T12:01:18.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.126+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16188204414536040004', time=2024-09-14T13:39:35.296214+0000, chain.objs.size()=6 2024-09-14T12:01:18.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.126+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.1 2024-09-14T12:01:18.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.129+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.2 2024-09-14T12:01:18.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.129+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.3 2024-09-14T12:01:18.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.129+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.4 2024-09-14T12:01:18.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.129+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.5 2024-09-14T12:01:18.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.129+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.6 2024-09-14T12:01:18.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.130+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~FPzHus6nF_0_1JvUzAmPvvpA4HOCSYw', time=2024-09-14T13:41:57.647585+0000, chain.objs.size()=1 2024-09-14T12:01:18.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.130+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~FPzHus6nF_0_1JvUzAmPvvpA4HOCSYw.2 2024-09-14T12:01:18.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.130+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~FPzHus6nF_0_1JvUzAmPvvpA4HOCSYw', time=2024-09-14T13:41:57.651249+0000, chain.objs.size()=1 2024-09-14T12:01:18.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.130+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~FPzHus6nF_0_1JvUzAmPvvpA4HOCSYw.3 2024-09-14T12:01:18.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.130+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12130661365112564773', time=2024-09-14T13:43:32.397052+0000, chain.objs.size()=1 2024-09-14T12:01:18.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.130+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.529__shadow_.HAsYj_1rEGOPlhZ0vw7Ds0es3o8w47w_0 2024-09-14T12:01:18.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.130+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~XxySpJXM2eCsvyrnoYxqtBqhodELiwv', time=2024-09-14T13:43:51.468042+0000, chain.objs.size()=1 2024-09-14T12:01:18.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.130+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.536__multipart_mymultipart.2~XxySpJXM2eCsvyrnoYxqtBqhodELiwv.3 2024-09-14T12:01:18.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.130+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2525635564907120995', time=2024-09-14T13:44:09.608408+0000, chain.objs.size()=1 2024-09-14T12:01:18.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.130+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.537__multipart_mymultipart.2~Pil8WZu_s2PHeP2oCjKna7Oyf9Q7cOV.1 2024-09-14T12:01:18.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.130+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~8sHhHXg6zZFDnpltZbWNsANU1wl5GvW', time=2024-09-14T13:45:20.640383+0000, chain.objs.size()=1 2024-09-14T12:01:18.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.130+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.562__multipart_mymultipart.2~8sHhHXg6zZFDnpltZbWNsANU1wl5GvW.1 2024-09-14T12:01:18.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.131+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13504259400487465681', time=2024-09-14T13:45:39.421335+0000, chain.objs.size()=1 2024-09-14T12:01:18.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.131+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:NeCNpP9mO8Jb7V-QWSiAfNDWe8VhbPY_.WxktNukc8ak3IrB8F1y-wZYAMSlrZX8_0 2024-09-14T12:01:18.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.133+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10103393728525662535', time=2024-09-14T13:45:48.547716+0000, chain.objs.size()=1 2024-09-14T12:01:18.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.133+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.571__shadow:sXPPxMJ-m0UUx6gfWAs-zlMSg-rY8rT_.OI2TuxBYX-NnF59PMSqe7hpid3zEu0r_0 2024-09-14T12:01:18.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.133+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1405086677751639529', time=2024-09-14T13:45:51.199993+0000, chain.objs.size()=1 2024-09-14T12:01:18.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.133+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.573__shadow:L0gK67koEMBPBQH6RBW52VhMz5gJab1_.n4H_CREz4J8i3HjaSRuBN01ZRjW5l5V_0 2024-09-14T12:01:18.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.133+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6014259626723829213', time=2024-09-14T13:46:05.093973+0000, chain.objs.size()=1 2024-09-14T12:01:18.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.133+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.577__shadow:bSIjIR9iM39bV9ikvPWBsX2LOE.Ntmj_.lFMKD20Ww-ySucty-Xg5PPVDhA6Bjk9_0 2024-09-14T12:01:18.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.133+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12678278013666960283', time=2024-09-14T13:47:21.564911+0000, chain.objs.size()=1 2024-09-14T12:01:18.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.133+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.588__shadow:7dce2xXdQFu3GMsUzFUH.V9dtByAGaF_.iuRMZ-y4QO5uR_m7SBGJYLxVoParjdp_0 2024-09-14T12:01:18.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.135+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17316521835188209119', time=2024-09-14T13:49:38.583450+0000, chain.objs.size()=6 2024-09-14T12:01:18.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.135+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.616__multipart_multipart_enc.2~DuXC7e_e-wQttM-QhI2vVcLoeZMU8lG.1 2024-09-14T12:01:18.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.135+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.616__multipart_multipart_enc.2~DuXC7e_e-wQttM-QhI2vVcLoeZMU8lG.2 2024-09-14T12:01:18.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.135+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.616__multipart_multipart_enc.2~DuXC7e_e-wQttM-QhI2vVcLoeZMU8lG.3 2024-09-14T12:01:18.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.137+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.616__multipart_multipart_enc.2~DuXC7e_e-wQttM-QhI2vVcLoeZMU8lG.4 2024-09-14T12:01:18.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.137+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.616__multipart_multipart_enc.2~DuXC7e_e-wQttM-QhI2vVcLoeZMU8lG.5 2024-09-14T12:01:18.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.137+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.616__multipart_multipart_enc.2~DuXC7e_e-wQttM-QhI2vVcLoeZMU8lG.6 2024-09-14T12:01:18.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.137+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14860769892869345339', time=2024-09-14T13:54:25.403224+0000, chain.objs.size()=1 2024-09-14T12:01:18.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.137+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.696__shadow_.zTTlM6vUZbeli-vZS3-IrSTJvhAytWG_0 2024-09-14T12:01:18.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.137+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8522762166725801258', time=2024-09-14T13:54:37.079575+0000, chain.objs.size()=1 2024-09-14T12:01:18.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.137+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.707__shadow_.irgnqMznXk4L2bEKl3ag2y1XkWkXjwG_0 2024-09-14T12:01:18.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.137+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.996296209610146671', time=2024-09-14T13:54:38.044963+0000, chain.objs.size()=1 2024-09-14T12:01:18.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.137+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.708__shadow:y8edN53rePRtkJpn2yM4muTURzJHcjT_.hLpD64oaXQNb0jadLjkwntI8WyOLClg_0 2024-09-14T12:01:18.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.137+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8953547699583341606', time=2024-09-14T13:54:40.107166+0000, chain.objs.size()=1 2024-09-14T12:01:18.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.137+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.710__shadow_.vsveJxyBhl46XnaBGjPh9lOepgQzvIe_0 2024-09-14T12:01:18.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.137+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.317328782475202111', time=2024-09-14T13:55:09.278397+0000, chain.objs.size()=1 2024-09-14T12:01:18.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.137+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.720__shadow_.hjz3KPr_PcUVo-1o7kpOuw0rTNMZugs_0 2024-09-14T12:01:18.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.137+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.313012325891907292', time=2024-09-14T13:57:51.419608+0000, chain.objs.size()=1 2024-09-14T12:01:18.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.137+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.766__shadow_.KJaW80Rm46GNink1jBjJ2VQDNPFmt5h_0 2024-09-14T12:01:18.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.142+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:18.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.145+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T12:01:18.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.146+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:18.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.147+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:18.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.147+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48518' 2024-09-14T12:01:18.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.147+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17598063626427214292', time=2024-09-14T13:27:51.537523+0000, chain.objs.size()=3 2024-09-14T12:01:18.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.147+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.160__multipart_mymultipart-LUKEWARM.2~-pCZfKAYLuBAN49wYzvbC8WSg_2fR3F.1 2024-09-14T12:01:18.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.147+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.160__multipart_mymultipart-LUKEWARM.2~-pCZfKAYLuBAN49wYzvbC8WSg_2fR3F.2 2024-09-14T12:01:18.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.147+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.160__multipart_mymultipart-LUKEWARM.2~-pCZfKAYLuBAN49wYzvbC8WSg_2fR3F.3 2024-09-14T12:01:18.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.147+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15449778397172580351', time=2024-09-14T13:31:46.916260+0000, chain.objs.size()=1 2024-09-14T12:01:18.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.147+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.243__shadow_.2aHvzYSPT7e0Rrs5LLYA5vojbgxWyTv_0 2024-09-14T12:01:18.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.147+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2510269239232262368', time=2024-09-14T13:32:02.798115+0000, chain.objs.size()=1 2024-09-14T12:01:18.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.147+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.256__shadow_.3-uOMx1sR0EE114q5iS-PBU1BkKQMWk_0 2024-09-14T12:01:18.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.147+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4883143688708664635', time=2024-09-14T13:32:03.913526+0000, chain.objs.size()=1 2024-09-14T12:01:18.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.147+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.257__shadow_.KlrDmgN-YxMFrZm3BePbwOWg112OiXv_0 2024-09-14T12:01:18.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.147+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2483277595949419535', time=2024-09-14T13:32:47.465284+0000, chain.objs.size()=1 2024-09-14T12:01:18.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.147+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.tX01p1oo1JqwbNlR7qDGgI9F0Syy_FL_0 2024-09-14T12:01:18.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.147+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.40717297939029507', time=2024-09-14T13:32:47.527806+0000, chain.objs.size()=1 2024-09-14T12:01:18.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.147+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.DwhaHKoR95Y4oUFLdXs3_7XyL5UGeOr_0 2024-09-14T12:01:18.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.147+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5710642286746815822', time=2024-09-14T13:32:47.665359+0000, chain.objs.size()=1 2024-09-14T12:01:18.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.147+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.4ml1PpYcc6T8qcA6bZ1GXh6vNKU8Q0w_0 2024-09-14T12:01:18.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.147+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11932913828217006291', time=2024-09-14T13:32:48.193117+0000, chain.objs.size()=1 2024-09-14T12:01:18.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.147+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Cqy8izsRI2SndJQJvSHGrOzNqXdhgKm_0 2024-09-14T12:01:18.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.147+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13492327011789673393', time=2024-09-14T13:32:49.361602+0000, chain.objs.size()=1 2024-09-14T12:01:18.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.147+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.rQ4U8Omb7A7FF1t5XuAySgvKs-LcFYc_0 2024-09-14T12:01:18.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.147+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6404177386285598344', time=2024-09-14T13:32:49.514403+0000, chain.objs.size()=1 2024-09-14T12:01:18.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.147+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.zP8sarLD45GHbYT3nFZXhu6iRGjRVwF_0 2024-09-14T12:01:18.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.151+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11543491000937173229', time=2024-09-14T13:32:49.653562+0000, chain.objs.size()=1 2024-09-14T12:01:18.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.151+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.LiQ4PIhgcn37Pga6YpuKiBaO2wkQj8K_0 2024-09-14T12:01:18.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.151+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4044725695116455301', time=2024-09-14T13:32:49.975694+0000, chain.objs.size()=1 2024-09-14T12:01:18.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.151+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.VFbJRFr635YHQzndDbdC5N1uyELq4p2_0 2024-09-14T12:01:18.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.152+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9041448943315863884', time=2024-09-14T13:32:50.690467+0000, chain.objs.size()=1 2024-09-14T12:01:18.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.152+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.h0Xkg2hCR3LcP3sYfWDCWvGEnlVZfgP_0 2024-09-14T12:01:18.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.152+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11646060259032216700', time=2024-09-14T13:32:50.915014+0000, chain.objs.size()=1 2024-09-14T12:01:18.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.152+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.6OKpA3C3Jnib7OlUvD4UWErKTSeAOEC_0 2024-09-14T12:01:18.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.152+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4656157170781068902', time=2024-09-14T13:32:51.090311+0000, chain.objs.size()=1 2024-09-14T12:01:18.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.152+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.POwx0rhVBfq43QBrGTVCD6Aoz4m86O-_0 2024-09-14T12:01:18.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.152+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10932943275396564484', time=2024-09-14T13:32:51.221465+0000, chain.objs.size()=1 2024-09-14T12:01:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.152+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.lvO7OiNA8BAr3bE398d4dNmPE_fSU8q_0 2024-09-14T12:01:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.152+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6127022957799861950', time=2024-09-14T13:32:52.199894+0000, chain.objs.size()=1 2024-09-14T12:01:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.152+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.x-a5BLLQwND5uOnRQ661aWy5x7zETyL_0 2024-09-14T12:01:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.152+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1522145095633959282', time=2024-09-14T13:32:52.313740+0000, chain.objs.size()=1 2024-09-14T12:01:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.152+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.wPG6aHJApBfSpNSgTyKJWeFA-DWpQF2_0 2024-09-14T12:01:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.152+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.155766971814984501', time=2024-09-14T13:32:53.786433+0000, chain.objs.size()=1 2024-09-14T12:01:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.152+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.5e6-tpRN_NE8M3UJjzvOSgvWovrGWBk_0 2024-09-14T12:01:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.152+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6716983410398970932', time=2024-09-14T13:32:54.361736+0000, chain.objs.size()=1 2024-09-14T12:01:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.152+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.l8X-7_25mcb6mESIqMsFoXb0bj9R8Eg_0 2024-09-14T12:01:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.152+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2877855098631914153', time=2024-09-14T13:32:54.499179+0000, chain.objs.size()=1 2024-09-14T12:01:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.152+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.RR5q-9u34fbJKfb-8Zj3lCRZAlnGoMU_0 2024-09-14T12:01:18.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.154+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15349125669414433013', time=2024-09-14T13:32:55.188540+0000, chain.objs.size()=1 2024-09-14T12:01:18.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.154+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.oN8ciWg7CZ60Rye-2cLRLurdMI66rnm_0 2024-09-14T12:01:18.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.154+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12020066940774181988', time=2024-09-14T13:32:55.290333+0000, chain.objs.size()=1 2024-09-14T12:01:18.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.154+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.GH6k25Fcam-q9VmE14KClASuwsfM9_M_0 2024-09-14T12:01:18.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.156+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9424134520504135253', time=2024-09-14T13:32:55.510203+0000, chain.objs.size()=1 2024-09-14T12:01:18.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.156+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.vq5hKSQuL0Lo-pXG-5P3hQFgnUECDKa_0 2024-09-14T12:01:18.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.156+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2618899250416148479', time=2024-09-14T13:32:55.816100+0000, chain.objs.size()=1 2024-09-14T12:01:18.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.156+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ldh6hsJJ8aFhuTiYJFmNt5bd99MKf9l_0 2024-09-14T12:01:18.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.156+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4731694369634727274', time=2024-09-14T13:32:56.593617+0000, chain.objs.size()=1 2024-09-14T12:01:18.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.156+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.uBrT-caCYVRkvic93fFFpzgW8Ny67bX_0 2024-09-14T12:01:18.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.156+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7007889972221462684', time=2024-09-14T13:32:57.123821+0000, chain.objs.size()=1 2024-09-14T12:01:18.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.156+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.e3pE_BclEIUZLh59ehZ70-m5AvS5_bg_0 2024-09-14T12:01:18.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.156+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16226410485575192741', time=2024-09-14T13:32:57.380417+0000, chain.objs.size()=1 2024-09-14T12:01:18.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.156+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.H5_qAThjJED1nDmthEYaVcDCgGVAtYE_0 2024-09-14T12:01:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.156+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3163768466348324490', time=2024-09-14T13:32:57.919114+0000, chain.objs.size()=1 2024-09-14T12:01:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.156+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.1gH0VWVbv3NMtYcw33eTqAQ-kQjgvlm_0 2024-09-14T12:01:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.156+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10741849298352430639', time=2024-09-14T13:32:58.104689+0000, chain.objs.size()=1 2024-09-14T12:01:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.156+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.H1fBbufFzIFYxmpI4n4OUv0wMCLwObm_0 2024-09-14T12:01:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.156+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.79307891819311418', time=2024-09-14T13:32:58.369736+0000, chain.objs.size()=1 2024-09-14T12:01:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.156+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.4Vcw7Co4e6NbRhuW_wmQvqKbkuTE67l_0 2024-09-14T12:01:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.156+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8068411860138493593', time=2024-09-14T13:33:07.376616+0000, chain.objs.size()=1 2024-09-14T12:01:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.156+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.271__shadow_.6s64vCOo8ngzwCeTc1wqdyRiDwG0rl7_0 2024-09-14T12:01:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.157+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14062419425856567238', time=2024-09-14T13:33:09.519116+0000, chain.objs.size()=1 2024-09-14T12:01:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.157+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.273__shadow_.SPyf_8UvJVSV8lCHWKgry-P-C3-KXKl_0 2024-09-14T12:01:18.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.157+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7841611764577739143', time=2024-09-14T13:33:13.787678+0000, chain.objs.size()=1 2024-09-14T12:01:18.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.157+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.277__shadow_.sxOQTaFGyEEAMhxrqmU5FD-v4qOqAJm_0 2024-09-14T12:01:18.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.159+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1978874285110709880', time=2024-09-14T13:33:13.797485+0000, chain.objs.size()=1 2024-09-14T12:01:18.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.159+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.277__shadow_.THsSO9MTw8D5JAcWV-yD8fKsvfSnlCd_0 2024-09-14T12:01:18.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.159+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5234304882670141297', time=2024-09-14T13:33:26.008419+0000, chain.objs.size()=1 2024-09-14T12:01:18.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.159+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.288__shadow_.qIQ6twc_Vxm89AyY_DZJSg65Kn6vRUn_0 2024-09-14T12:01:18.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.160+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4270126891702054703', time=2024-09-14T13:33:33.201260+0000, chain.objs.size()=1 2024-09-14T12:01:18.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.160+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.TSXpvdpBSScSyezCkQ90ubAn-nPkd7R_0 2024-09-14T12:01:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.160+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8782297968913937724', time=2024-09-14T13:33:35.500191+0000, chain.objs.size()=1 2024-09-14T12:01:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.160+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.EJC7wNeQpEBPv59S_qPUyEaR4xe3lI5_0 2024-09-14T12:01:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.160+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13689959592985982785', time=2024-09-14T13:33:36.755988+0000, chain.objs.size()=1 2024-09-14T12:01:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.160+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.295__shadow_.tEQQ04XQbFpGQsD5XU3kBCVmJ-RKFDc_0 2024-09-14T12:01:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.160+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7168508177625083035', time=2024-09-14T13:33:37.828218+0000, chain.objs.size()=1 2024-09-14T12:01:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.160+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.296__shadow_.mX_FJJSTPcHbVkvAVPyll75V8L9jlOG_0 2024-09-14T12:01:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.160+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6951025395035304317', time=2024-09-14T13:33:50.475915+0000, chain.objs.size()=1 2024-09-14T12:01:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.160+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.307__shadow_.o9gYaW0U2HjDfIcZ_DwgKZdzDD157y8_0 2024-09-14T12:01:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.160+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13198320337640550052', time=2024-09-14T13:34:09.005577+0000, chain.objs.size()=1 2024-09-14T12:01:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.160+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.320__shadow:yqgz6YuCSJnRFh-QgeV0ZRRUT4w05Xi_.HyIszILbtJNRLk-Ki2dvrPi8MomYHeM_0 2024-09-14T12:01:18.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.161+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5091686233637008985', time=2024-09-14T13:34:10.696450+0000, chain.objs.size()=1 2024-09-14T12:01:18.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.161+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.322__shadow_.XrNvKbxqYdHG64h860T5hja2ghrDYoB_0 2024-09-14T12:01:18.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.161+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14887780809968753847', time=2024-09-14T13:34:52.084038+0000, chain.objs.size()=1 2024-09-14T12:01:18.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.161+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.jQw4JAhSH7IpKq8LutGg5RREzKbiOWO_0 2024-09-14T12:01:18.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.161+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3764327026958667870', time=2024-09-14T13:34:52.179192+0000, chain.objs.size()=1 2024-09-14T12:01:18.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.161+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.vVw49HRAQsNM7LMLNU2b0i9Vv-Q3AhL_0 2024-09-14T12:01:18.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.164+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13138524518973382204', time=2024-09-14T13:34:52.201164+0000, chain.objs.size()=1 2024-09-14T12:01:18.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.164+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.PU3mOP_ERvK7dbmp0khTe3TrYiaA59Q_0 2024-09-14T12:01:18.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.164+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2844917627894471428', time=2024-09-14T13:34:52.303675+0000, chain.objs.size()=1 2024-09-14T12:01:18.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.164+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.rVbbkkpiO440Cu88dlqES2WV08wnd_h_0 2024-09-14T12:01:18.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.164+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9061820061746767385', time=2024-09-14T13:34:52.476679+0000, chain.objs.size()=1 2024-09-14T12:01:18.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.164+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.cIV_88AdeyQDqg16h4jEPFxfaC5TOxX_0 2024-09-14T12:01:18.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.164+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3172848837004318920', time=2024-09-14T13:34:53.176325+0000, chain.objs.size()=1 2024-09-14T12:01:18.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.164+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.KY58waUYRlDV2XyJq-OvRPZ3MiCGqim_0 2024-09-14T12:01:18.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.164+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10080042549485968310', time=2024-09-14T13:34:53.624480+0000, chain.objs.size()=1 2024-09-14T12:01:18.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.164+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.udCXOXmXspQh0vINb3WVnCoagmYjm2K_0 2024-09-14T12:01:18.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.164+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7695979732171270100', time=2024-09-14T13:34:53.697262+0000, chain.objs.size()=1 2024-09-14T12:01:18.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.164+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.lkcqrZ9bA7oPXBBcOYsTINtBD-B8lQd_0 2024-09-14T12:01:18.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.164+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1353869064677021144', time=2024-09-14T13:34:53.882729+0000, chain.objs.size()=1 2024-09-14T12:01:18.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.164+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.48sdyol9o0S70PZmPNgQ1t2shTxTI3f_0 2024-09-14T12:01:18.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.164+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18355704822857656200', time=2024-09-14T13:34:53.935642+0000, chain.objs.size()=1 2024-09-14T12:01:18.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.164+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.rPmIuNJd0gFMeoCg0y8da2E3zH825vF_0 2024-09-14T12:01:18.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.164+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3357480471932364154', time=2024-09-14T13:34:53.967928+0000, chain.objs.size()=1 2024-09-14T12:01:18.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.164+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.jn27p_1ydZ4MZBlp7nW3oxu3XMloGcz_0 2024-09-14T12:01:18.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.166+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8613874786930942314', time=2024-09-14T13:34:54.093232+0000, chain.objs.size()=1 2024-09-14T12:01:18.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.166+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.C-wUZwswHdLMdUh9H9UPfV0YmLjXf4M_0 2024-09-14T12:01:18.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.166+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.527221645623470549', time=2024-09-14T13:34:55.664629+0000, chain.objs.size()=1 2024-09-14T12:01:18.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.166+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.7aJrKTH8u230-nN3m0smRaszDKcHPqG_0 2024-09-14T12:01:18.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.168+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17940205833885628270', time=2024-09-14T13:34:55.740313+0000, chain.objs.size()=1 2024-09-14T12:01:18.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.168+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ZyMknARWOIhKWIG-aobt3nQZr3eI1LH_0 2024-09-14T12:01:18.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.168+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12154467075508172778', time=2024-09-14T13:34:55.740866+0000, chain.objs.size()=1 2024-09-14T12:01:18.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.168+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.0YbrjZGD4tEoNsx7t518dfd-vHFEgET_0 2024-09-14T12:01:18.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.168+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6079683745576100020', time=2024-09-14T13:34:56.292866+0000, chain.objs.size()=1 2024-09-14T12:01:18.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.168+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.XvNnz45mM0nkrfJt_cGnNBAN-RulgvO_0 2024-09-14T12:01:18.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.168+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3737681726106400324', time=2024-09-14T13:34:56.643534+0000, chain.objs.size()=1 2024-09-14T12:01:18.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.168+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.pUNY9NpTyUW4Z4-3voG8Uvdx82R2nZR_0 2024-09-14T12:01:18.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.168+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1374510836885017141', time=2024-09-14T13:34:56.970033+0000, chain.objs.size()=1 2024-09-14T12:01:18.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.168+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.yQrG3BNxx9z3WoEXwxHjMKXgMnR-VgV_0 2024-09-14T12:01:18.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.168+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12769242978183437612', time=2024-09-14T13:34:57.194984+0000, chain.objs.size()=1 2024-09-14T12:01:18.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.168+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.JzAhdnYTkwSiFQABEeRGAdiKs1tnlZd_0 2024-09-14T12:01:18.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.168+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10468665739939573233', time=2024-09-14T13:34:57.623015+0000, chain.objs.size()=1 2024-09-14T12:01:18.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.168+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.GdRXLhMj9-yenicFSzcuLJRfPq0-OKd_0 2024-09-14T12:01:18.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.169+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12726648262333279267', time=2024-09-14T13:34:57.634284+0000, chain.objs.size()=1 2024-09-14T12:01:18.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.169+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.h_zincauyJoTj1zpASipFfxpedAHWL4_0 2024-09-14T12:01:18.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.169+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15790318663782992231', time=2024-09-14T13:34:58.264493+0000, chain.objs.size()=1 2024-09-14T12:01:18.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.169+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.OUqgpzcQtGleJ1o5BA3qICehjtyk5hL_0 2024-09-14T12:01:18.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.169+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1310440751428454112', time=2024-09-14T13:34:58.366228+0000, chain.objs.size()=1 2024-09-14T12:01:18.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.169+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.c0Iqx8Cl4-MooXIAw1GrBPUrfmYO2n4_0 2024-09-14T12:01:18.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.169+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15004893903212606980', time=2024-09-14T13:34:58.630669+0000, chain.objs.size()=1 2024-09-14T12:01:18.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.169+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.LhVGlTDGFlvoU65M9zt0i_Eaog0Pzf__0 2024-09-14T12:01:18.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.170+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11543643381126833556', time=2024-09-14T13:34:59.281569+0000, chain.objs.size()=1 2024-09-14T12:01:18.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.170+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.NEOxdX5cyGBbJv5bAPAh6XEHsZkE9zt_0 2024-09-14T12:01:18.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.171+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10476860558718716353', time=2024-09-14T13:34:59.412825+0000, chain.objs.size()=1 2024-09-14T12:01:18.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.171+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.AOhr4KMsbCwKLPya6Y0PspGAtUMLVGb_0 2024-09-14T12:01:18.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.171+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16987149376246756160', time=2024-09-14T13:34:59.519391+0000, chain.objs.size()=1 2024-09-14T12:01:18.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.171+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.NRcf0AyTJCpRs10t-HUQF3MCrH8tNv3_0 2024-09-14T12:01:18.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.172+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14926268244369758191', time=2024-09-14T13:34:59.565350+0000, chain.objs.size()=1 2024-09-14T12:01:18.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.172+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.FYlSW7IlniYzTp5-x9_gaVzTz6wVEbW_0 2024-09-14T12:01:18.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.172+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13111971794718143035', time=2024-09-14T13:34:59.602924+0000, chain.objs.size()=1 2024-09-14T12:01:18.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.172+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.7xMU6ikVeaDdPjZsNwn8YUbA76tWbV7_0 2024-09-14T12:01:18.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.172+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6997462886851304300', time=2024-09-14T13:34:59.872473+0000, chain.objs.size()=1 2024-09-14T12:01:18.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.172+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.hX2D-0haeJK5PjH3-VEPbjDtY50Ir7W_0 2024-09-14T12:01:18.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.172+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4737304600751001885', time=2024-09-14T13:35:00.097193+0000, chain.objs.size()=1 2024-09-14T12:01:18.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.172+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.p99axDlQt2WClET2VjEPOYxsdM8xvKH_0 2024-09-14T12:01:18.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.173+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2011020039003611936', time=2024-09-14T13:35:00.097826+0000, chain.objs.size()=1 2024-09-14T12:01:18.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.173+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.S9O8LyZ2gv1o8FbJXbYJcocNEe-AI6t_0 2024-09-14T12:01:18.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.176+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12943365697236562897', time=2024-09-14T13:35:00.438824+0000, chain.objs.size()=1 2024-09-14T12:01:18.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.176+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ZbA0wUKOge2hZQCVZGjXZM0hkYeLGNr_0 2024-09-14T12:01:18.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.177+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4197411336643770151', time=2024-09-14T13:35:00.566312+0000, chain.objs.size()=1 2024-09-14T12:01:18.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.177+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.AqVAbeQpG2Da3H9JgXgd-68SiFLRF0t_0 2024-09-14T12:01:18.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.177+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5125211593360996337', time=2024-09-14T13:35:00.753508+0000, chain.objs.size()=1 2024-09-14T12:01:18.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.177+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.tLAq0dRgAsPRAy-h7YEH-BExPGZ0xrQ_0 2024-09-14T12:01:18.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.177+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2136944268624132824', time=2024-09-14T13:35:01.201757+0000, chain.objs.size()=1 2024-09-14T12:01:18.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.177+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.jDe6ZZDvCrHguCG-cXEwZXuYYOJ7ul4_0 2024-09-14T12:01:18.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.177+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13125168964545299162', time=2024-09-14T13:35:01.301491+0000, chain.objs.size()=1 2024-09-14T12:01:18.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.177+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.SfM5SdBsq_kaqJLEMTJ1YehHiRVe70N_0 2024-09-14T12:01:18.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.177+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16372148159971446213', time=2024-09-14T13:35:01.992879+0000, chain.objs.size()=1 2024-09-14T12:01:18.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.177+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.A0VkZkIBCHYTrmNDPWvca3fxGC2jgbm_0 2024-09-14T12:01:18.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.177+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7507997229878681473', time=2024-09-14T13:35:02.396070+0000, chain.objs.size()=1 2024-09-14T12:01:18.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.177+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.RqNjUIVaqdR-qYl1QSsxTWZf53CI8CW_0 2024-09-14T12:01:18.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.177+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2250961875257330130', time=2024-09-14T13:35:02.486169+0000, chain.objs.size()=1 2024-09-14T12:01:18.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.177+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.JLpirBpE9SHYPgqCEFS9R_5FiB9FxbO_0 2024-09-14T12:01:18.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.177+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.725385952226960453', time=2024-09-14T13:35:41.639438+0000, chain.objs.size()=1 2024-09-14T12:01:18.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.177+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.x4qtxSprPqYjzl_FtRMwxOyOj77ujId_0 2024-09-14T12:01:18.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.177+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16096692909006740110', time=2024-09-14T13:35:41.976428+0000, chain.objs.size()=1 2024-09-14T12:01:18.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.177+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Qo6M1VuK6_8HkBG6Kp-dQbe3VcjlpBs_0 2024-09-14T12:01:18.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.177+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.227086441123690629', time=2024-09-14T13:35:42.257906+0000, chain.objs.size()=1 2024-09-14T12:01:18.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.177+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.vzSBCNfXXN_v6OW-NT-dJriJenM8LfV_0 2024-09-14T12:01:18.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.179+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8750522933729269764', time=2024-09-14T13:35:42.283186+0000, chain.objs.size()=1 2024-09-14T12:01:18.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.179+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.rIA7sTR7sZwpcAKWVksyEgCJ4o0kpro_0 2024-09-14T12:01:18.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.179+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5980308467052488768', time=2024-09-14T13:35:43.431309+0000, chain.objs.size()=1 2024-09-14T12:01:18.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.179+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.3Dk6_x9DyGkqsRTzJy1gbeYIQhRLHo0_0 2024-09-14T12:01:18.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.181+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16739519402470809278', time=2024-09-14T13:35:43.731425+0000, chain.objs.size()=1 2024-09-14T12:01:18.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.181+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.UropSsPessQY6ptQg2JzN_Bntmf13Cc_0 2024-09-14T12:01:18.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.181+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15690192810228518884', time=2024-09-14T13:35:44.015031+0000, chain.objs.size()=1 2024-09-14T12:01:18.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.181+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.4smbL9NPNzWucxvc1OSHXMdoUw3k1js_0 2024-09-14T12:01:18.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.181+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18127205496088343328', time=2024-09-14T13:35:44.080409+0000, chain.objs.size()=1 2024-09-14T12:01:18.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.181+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.y6z0BnkGUWGxpyzUEJDizVDkC1C0Hee_0 2024-09-14T12:01:18.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.181+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9637234115081542630', time=2024-09-14T13:35:45.455355+0000, chain.objs.size()=1 2024-09-14T12:01:18.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.181+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.O0A9s-w9iN1gnUJSyKoZGFJIXArZmzX_0 2024-09-14T12:01:18.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.181+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6225636114182641714', time=2024-09-14T13:35:45.455917+0000, chain.objs.size()=1 2024-09-14T12:01:18.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.181+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.hmH5IlP-aoUEyWHxXwwR5lwMEt58yV4_0 2024-09-14T12:01:18.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.181+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16795812579178901152', time=2024-09-14T13:35:45.824283+0000, chain.objs.size()=1 2024-09-14T12:01:18.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.181+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.rlTE6TfebFVxsdoYADLavryNQ2-Gcl7_0 2024-09-14T12:01:18.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.181+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9943076707913091787', time=2024-09-14T13:35:46.295553+0000, chain.objs.size()=1 2024-09-14T12:01:18.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.181+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.HIF7guUBmxNr8xCy6cPVPjWYATdrsJn_0 2024-09-14T12:01:18.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.181+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13052874534325881522', time=2024-09-14T13:35:46.405280+0000, chain.objs.size()=1 2024-09-14T12:01:18.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.181+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.G_ldCVr2SwKdFm_SOirvbu14P4NNLCw_0 2024-09-14T12:01:18.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.181+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6903640118926808731', time=2024-09-14T13:35:46.955885+0000, chain.objs.size()=1 2024-09-14T12:01:18.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.181+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.2Qe8PKW2nyK_NlZ_-yiACzkr6-zbE6o_0 2024-09-14T12:01:18.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.182+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7624602950370474308', time=2024-09-14T13:35:47.165574+0000, chain.objs.size()=1 2024-09-14T12:01:18.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.182+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.t-wtCBUHR7YfI_6sPYEIGiH_asvvnqS_0 2024-09-14T12:01:18.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.183+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18413727628643201905', time=2024-09-14T13:35:47.870935+0000, chain.objs.size()=1 2024-09-14T12:01:18.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.183+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.rSrqswPMLMlTd4MVLGB8l5KDaRKx0b0_0 2024-09-14T12:01:18.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.184+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14234002987618907229', time=2024-09-14T13:35:47.934836+0000, chain.objs.size()=1 2024-09-14T12:01:18.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.184+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.SmsnfxiziD8NnHC55YbLBVRYy75kYlc_0 2024-09-14T12:01:18.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.188+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/48518 2024-09-14T12:01:18.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=45, truncated=0, next_marker='' 2024-09-14T12:01:18.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16749666928379479769', time=2024-09-14T13:35:48.573836+0000, chain.objs.size()=1 2024-09-14T12:01:18.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.CaXygBBAm9K4B71DytQrYWsrjrh8Rrt_0 2024-09-14T12:01:18.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10540255680487850158', time=2024-09-14T13:35:48.817873+0000, chain.objs.size()=1 2024-09-14T12:01:18.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.6PJqYu4t2k1xgVNxSM0xRfMu6KztKgy_0 2024-09-14T12:01:18.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4950201159898063571', time=2024-09-14T13:35:49.685318+0000, chain.objs.size()=1 2024-09-14T12:01:18.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.yxddT6gjWLuBUcXw6pEXFWfhBJifVZG_0 2024-09-14T12:01:18.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6347141404203266523', time=2024-09-14T13:35:49.745190+0000, chain.objs.size()=1 2024-09-14T12:01:18.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.JZl2KXGfk5K5A7VVt8NzbD-utdr-brt_0 2024-09-14T12:01:18.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.414791677485275167', time=2024-09-14T13:35:49.899075+0000, chain.objs.size()=1 2024-09-14T12:01:18.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.MibrLQ1fav1ffBr4fNWVNXjJ1X1XWeF_0 2024-09-14T12:01:18.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15776841852889330997', time=2024-09-14T13:35:49.899775+0000, chain.objs.size()=1 2024-09-14T12:01:18.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.dcgmCwAkOUi4oZcABM_x59QNwg4X9Ek_0 2024-09-14T12:01:18.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13203417481506075738', time=2024-09-14T13:35:50.597138+0000, chain.objs.size()=1 2024-09-14T12:01:18.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.alIIVJ7_J9GMzg9mh4RcSrV2mVFU3Oj_0 2024-09-14T12:01:18.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11626417327939969575', time=2024-09-14T13:35:50.598040+0000, chain.objs.size()=1 2024-09-14T12:01:18.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.3kjyNxeAKT8DAZVqhbnXem4K-kD4wBK_0 2024-09-14T12:01:18.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1772810221995334956', time=2024-09-14T13:35:50.609560+0000, chain.objs.size()=1 2024-09-14T12:01:18.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.z6UrO0z8Qd1w9HJQBJSXKKQt9MsbpSF_0 2024-09-14T12:01:18.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10129027810069553311', time=2024-09-14T13:35:50.946457+0000, chain.objs.size()=1 2024-09-14T12:01:18.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.xmOwVozL4gOVvGfUkX_GEKPvDXwh8aT_0 2024-09-14T12:01:18.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2277721386626206381', time=2024-09-14T13:35:51.018773+0000, chain.objs.size()=1 2024-09-14T12:01:18.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.uVlBG3cOwHHq1hHcnxe-uUaVJUP_abf_0 2024-09-14T12:01:18.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14220687327306756374', time=2024-09-14T13:35:51.232739+0000, chain.objs.size()=1 2024-09-14T12:01:18.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.190+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Bu_ebWWiAdyRe5vYOGEF3cP-LwOv2BK_0 2024-09-14T12:01:18.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.194+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.138798956549659971', time=2024-09-14T13:35:51.233448+0000, chain.objs.size()=1 2024-09-14T12:01:18.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.194+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.6RFSPZBYtpJTTvS5uw8FGnh2Ab3_AzO_0 2024-09-14T12:01:18.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.194+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4442972739198248953', time=2024-09-14T13:35:51.432984+0000, chain.objs.size()=1 2024-09-14T12:01:18.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.194+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.psyH_i-0OLvKoUsAuwVhaOOzpVZV8Yy_0 2024-09-14T12:01:18.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.194+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4175962246000425634', time=2024-09-14T13:35:51.927574+0000, chain.objs.size()=1 2024-09-14T12:01:18.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.194+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.puNiofC9mLt_fxMeSIR2c4Ytja9WWzh_0 2024-09-14T12:01:18.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.194+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8540430138288827026', time=2024-09-14T13:35:52.090341+0000, chain.objs.size()=1 2024-09-14T12:01:18.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.194+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Hfuozo7E0cOYfMNCtrFF5qaJADmYmCQ_0 2024-09-14T12:01:18.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.195+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16745623019668693798', time=2024-09-14T13:35:52.090929+0000, chain.objs.size()=1 2024-09-14T12:01:18.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.195+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.BdWhisn52Es3VVosDZqkOUDRs5dCqYo_0 2024-09-14T12:01:18.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.195+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11439409528858054906', time=2024-09-14T13:35:52.197950+0000, chain.objs.size()=1 2024-09-14T12:01:18.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.195+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.FhXbP1T9icsCPE1aBm_N8_c1iirttQ3_0 2024-09-14T12:01:18.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.195+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6862212234562852442', time=2024-09-14T13:35:52.669567+0000, chain.objs.size()=1 2024-09-14T12:01:18.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.195+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.TdHY-k7q-4rMhkaHxp0VQVO0lyivPn9_0 2024-09-14T12:01:18.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.195+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12260524467049214949', time=2024-09-14T13:35:52.717939+0000, chain.objs.size()=1 2024-09-14T12:01:18.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.195+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.duhcdSUn2fkDBcPc6Ipg8K1p3IG4MI5_0 2024-09-14T12:01:18.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.195+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13393156804526854082', time=2024-09-14T13:35:58.702699+0000, chain.objs.size()=1 2024-09-14T12:01:18.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.195+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.331__shadow_.AqDORZCCRQamdEk8saOXoB1vw5stL0I_0 2024-09-14T12:01:18.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.195+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17795151028125971515', time=2024-09-14T13:37:06.287292+0000, chain.objs.size()=1 2024-09-14T12:01:18.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.195+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.395__shadow:EmtNiPyaeiHw21JnB5IEUKl7pVYApYz_.lRgvGLXuR0jJH2I-tjEQWs32O7RvJb5_0 2024-09-14T12:01:18.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.195+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.422033416235822392', time=2024-09-14T13:37:51.868099+0000, chain.objs.size()=1 2024-09-14T12:01:18.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.195+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.438__shadow_.v0BCrmPwXZzcCz7gyQkxceZukPrOFZ3_0 2024-09-14T12:01:18.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.197+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7191877122936024929', time=2024-09-14T13:38:44.067949+0000, chain.objs.size()=1 2024-09-14T12:01:18.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.197+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.485__shadow_.4mjPplgbfTghYzNV70i9hh-TN90ctR8_0 2024-09-14T12:01:18.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.199+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7562811624889750799', time=2024-09-14T13:42:55.548888+0000, chain.objs.size()=3 2024-09-14T12:01:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.199+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.524__multipart_mymultipart.2~eiNxOeUNR-dowtInrReeK8DrrgqeEp0.1 2024-09-14T12:01:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.199+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.524__multipart_mymultipart.2~eiNxOeUNR-dowtInrReeK8DrrgqeEp0.2 2024-09-14T12:01:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.199+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.524__multipart_mymultipart.2~eiNxOeUNR-dowtInrReeK8DrrgqeEp0.3 2024-09-14T12:01:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.199+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10706703535719029942', time=2024-09-14T13:42:55.769799+0000, chain.objs.size()=2 2024-09-14T12:01:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.199+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.524__multipart_mymultipart.2~1Lfne_1ochjRfeHsSipg5NAUgoifpJv.1 2024-09-14T12:01:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.199+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.524__multipart_mymultipart.2~1Lfne_1ochjRfeHsSipg5NAUgoifpJv.2 2024-09-14T12:01:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.199+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11903814718184473836', time=2024-09-14T13:44:47.420851+0000, chain.objs.size()=1 2024-09-14T12:01:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.199+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.553__shadow_.fVplKkA5WeB5eUnNEvSplaSWeVg1Xmq_0 2024-09-14T12:01:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.199+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2611413693054169446', time=2024-09-14T13:45:09.207201+0000, chain.objs.size()=1 2024-09-14T12:01:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.199+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.558__shadow_.6rE5EGzYmfBKp_ORr79O7SGW4nUNlrm_0 2024-09-14T12:01:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.199+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13228026223926111269', time=2024-09-14T13:45:42.575403+0000, chain.objs.size()=1 2024-09-14T12:01:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.199+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:0opvSzLjYzI0Xe9V40M16DsO5OVlWH4_.IoiCpfe1U2rKmQ0uhY41GPnMF2Qruoi_0 2024-09-14T12:01:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.199+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6413516165671119070', time=2024-09-14T13:45:43.598093+0000, chain.objs.size()=1 2024-09-14T12:01:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.199+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:Ci58xfJD7o.y7QN.VcuNwL69e0uSeZb_.4Ry5y7GJvWS2APKSB08mX8K7GkAGsB8_0 2024-09-14T12:01:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.200+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8453096824673622387', time=2024-09-14T13:45:57.107155+0000, chain.objs.size()=1 2024-09-14T12:01:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.200+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.575__shadow:k1ZwP9MJB93u4EWJhn6ClkyGZDFy9iJ_.Y-pjDljm5t7YkNP4U8yJzB-se_o-KvA_0 2024-09-14T12:01:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.200+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10248940256054078124', time=2024-09-14T13:46:01.817825+0000, chain.objs.size()=1 2024-09-14T12:01:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.200+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.577__shadow:bB0hTG76r-OQeyurZ42P9iLegp0oGMW_.iTZjiHkkJbHwN8HS0GT78nRzjTv7NhI_0 2024-09-14T12:01:18.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.201+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15604108963916981353', time=2024-09-14T13:46:02.608043+0000, chain.objs.size()=1 2024-09-14T12:01:18.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.201+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.577__shadow:jEtOE-vQHjcVe1psLQ7XaaHEXTz.fy0_.hUHmAYOWVCW5bKoforFVEu_RrGUiJwG_0 2024-09-14T12:01:18.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.203+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9022021108016523304', time=2024-09-14T13:46:16.323562+0000, chain.objs.size()=1 2024-09-14T12:01:18.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.203+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:CO9y92Iqx1q7na5A5V8r0C-Puc1THIK_.xLMy8C9RsGWgE4cbxdEatumoSiTkJzx_0 2024-09-14T12:01:18.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.203+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2028618375716931920', time=2024-09-14T13:46:16.841880+0000, chain.objs.size()=1 2024-09-14T12:01:18.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.203+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:WTCGd9aWt9lHCjdRdGyyNGePnkRn5KL_.j8TYwRa2uD-90CX8tWL0pEJb1Ykm8P9_0 2024-09-14T12:01:18.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.203+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14960701464205319423', time=2024-09-14T13:46:18.002044+0000, chain.objs.size()=1 2024-09-14T12:01:18.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.203+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:VR1tIbsAPvJRb0g9nk1HARrlcfnz.Z2_.Qv_CaZh6A7ler1XbZzPdG1T7Am-HZH7_0 2024-09-14T12:01:18.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.203+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7488358114894739329', time=2024-09-14T13:46:22.203082+0000, chain.objs.size()=1 2024-09-14T12:01:18.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.203+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:V02CUs59.TsvKhPfrKQr7kdNHQTso1S_.OdgN53vqm24MTYmVpN-bKXZpMJ1WeIW_0 2024-09-14T12:01:18.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.203+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18130334402101048741', time=2024-09-14T13:46:23.045939+0000, chain.objs.size()=1 2024-09-14T12:01:18.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.203+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:vVP-xwmJkZAlqoeOoLuvYTiXzn4AyC3_.lfTjrxSYRSGGeMOQQ3JRYp6-9PkN_pJ_0 2024-09-14T12:01:18.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.204+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1648601999856894520', time=2024-09-14T13:47:09.396745+0000, chain.objs.size()=1 2024-09-14T12:01:18.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.204+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.580__shadow:QY-0UA1ezXdvkdLD0vIzEpJfYJ2d0qd_.VlbftKh_st2hBR6UMtv1mW_a8gSRW2n_0 2024-09-14T12:01:18.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.204+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17375799419046042201', time=2024-09-14T13:52:46.258303+0000, chain.objs.size()=1 2024-09-14T12:01:18.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.204+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.634__shadow_.MgJ6zkkZI0xTW12ugqVmwpUgXBHTtK6_0 2024-09-14T12:01:18.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.206+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14387702822742726254', time=2024-09-14T13:53:16.576465+0000, chain.objs.size()=1 2024-09-14T12:01:18.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.206+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.651__shadow_.loOq7GlMYKEql1P7OJ37A_zOhu4o-to_0 2024-09-14T12:01:18.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.206+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6448351779846579342', time=2024-09-14T13:54:00.979321+0000, chain.objs.size()=1 2024-09-14T12:01:18.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.206+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.669__shadow_.h4aG7tf5xnLava8PwqIq_HsvzYc25XF_0 2024-09-14T12:01:18.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.207+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18302356131265850652', time=2024-09-14T13:54:26.519875+0000, chain.objs.size()=1 2024-09-14T12:01:18.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.207+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.697__shadow:SdYAkPilD.ZVK3CfMykhNQL68aNRRV5_.7uXDacbLPzVQ-b9eYTh20UdS-D8fRjT_0 2024-09-14T12:01:18.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.207+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13282562960013593607', time=2024-09-14T13:55:49.879270+0000, chain.objs.size()=3 2024-09-14T12:01:18.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.207+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.744__multipart_mymultipart3.2~MOKVkyQO_Oq185oiyk37TI12Tys2IMm.1 2024-09-14T12:01:18.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.208+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.744__multipart_mymultipart3.2~MOKVkyQO_Oq185oiyk37TI12Tys2IMm.2 2024-09-14T12:01:18.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.208+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.744__multipart_mymultipart3.2~MOKVkyQO_Oq185oiyk37TI12Tys2IMm.3 2024-09-14T12:01:18.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.209+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3962366454263315371', time=2024-09-14T13:58:23.780751+0000, chain.objs.size()=1 2024-09-14T12:01:18.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.209+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.774__shadow_.U6FgAPOghpzE7apDRktvQlI3yj695sb_0 2024-09-14T12:01:18.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.211+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:18.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.214+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T12:01:18.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.215+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:18.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.215+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46781' 2024-09-14T12:01:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='_cH5bfkk8X0MNJ_k3by9blcSV-ZJIaHO', time=2024-09-14T13:27:55.710491+0000, chain.objs.size()=1 2024-09-14T12:01:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.161__shadow_.CI-H0mDUNj9L8e3d1CXMGJR62UDNSCi_0 2024-09-14T12:01:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12023707379247325160', time=2024-09-14T13:28:43.697247+0000, chain.objs.size()=1 2024-09-14T12:01:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.167__shadow_.CIaFRPKfpk6laI4mjQlqzJpUdWsAFY0_0 2024-09-14T12:01:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11162930953124918472', time=2024-09-14T13:29:04.263606+0000, chain.objs.size()=1 2024-09-14T12:01:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.184__shadow_.QQP7-5yPRTGAWTHXEIC13V3gWD-hzb1_0 2024-09-14T12:01:18.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3422031578162911912', time=2024-09-14T13:31:35.931029+0000, chain.objs.size()=1 2024-09-14T12:01:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.234__shadow_.xoJR_9tO7QxNosqSgfJAO7Fn68VLNy1_0 2024-09-14T12:01:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11711381149685195444', time=2024-09-14T13:31:46.916726+0000, chain.objs.size()=1 2024-09-14T12:01:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.243__shadow_.bYrzclXrqh3vsWMsXsyK5Rm6OQRuQ1P_0 2024-09-14T12:01:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2616501183905142091', time=2024-09-14T13:31:52.921600+0000, chain.objs.size()=1 2024-09-14T12:01:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.247__shadow_.PuP0vD9gBYc1YPEhKS1vtT8OJPaFA7__0 2024-09-14T12:01:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4337483851157145372', time=2024-09-14T13:31:55.112472+0000, chain.objs.size()=1 2024-09-14T12:01:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.249__shadow_.z85vH3_QQDVSr3O2JyQpj3w1io7jTlT_0 2024-09-14T12:01:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1036032059039579347', time=2024-09-14T13:32:01.699623+0000, chain.objs.size()=1 2024-09-14T12:01:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.255__shadow_.WHAm7jihdkFC-9NREX3erbmAciB22RH_0 2024-09-14T12:01:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8198241169008015361', time=2024-09-14T13:32:03.913708+0000, chain.objs.size()=1 2024-09-14T12:01:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.257__shadow_.zb4Sk_XJL_AfqPGtvfGgVO9QFvYrBwQ_0 2024-09-14T12:01:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5072077269559426961', time=2024-09-14T13:32:47.722679+0000, chain.objs.size()=1 2024-09-14T12:01:18.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.tkX4p28bpNZgu516STQ770tZPXybUao_0 2024-09-14T12:01:18.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9162795249582952197', time=2024-09-14T13:32:48.231721+0000, chain.objs.size()=1 2024-09-14T12:01:18.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.x59q9MFafwirANmAmA9p-pSQOWCETMb_0 2024-09-14T12:01:18.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.717064089468518306', time=2024-09-14T13:32:49.321195+0000, chain.objs.size()=1 2024-09-14T12:01:18.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.216+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.7KiBmgdoqvbPGGnL7ZUO6GmT3GDs4aS_0 2024-09-14T12:01:18.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.220+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2165944374590781073', time=2024-09-14T13:32:49.792441+0000, chain.objs.size()=1 2024-09-14T12:01:18.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.220+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.NMvEJLT7zjybKBq_Ny9hraGHsQ5fgzP_0 2024-09-14T12:01:18.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.221+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17622659108031952548', time=2024-09-14T13:32:49.942937+0000, chain.objs.size()=1 2024-09-14T12:01:18.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.221+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.atoqk2GHjaCY0-k7VuFWoytK_5ifDIE_0 2024-09-14T12:01:18.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.221+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11063285705876859231', time=2024-09-14T13:32:50.078625+0000, chain.objs.size()=1 2024-09-14T12:01:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.221+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.9EGV0nHyC0qVmot8cl-VSn8lsWUYNSe_0 2024-09-14T12:01:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.221+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17084707351839402597', time=2024-09-14T13:32:50.543189+0000, chain.objs.size()=1 2024-09-14T12:01:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.221+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.5lxpkVviR9jjAiY-jpcAwQ6EF_9SDVW_0 2024-09-14T12:01:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.221+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11496520782978764830', time=2024-09-14T13:32:50.776736+0000, chain.objs.size()=1 2024-09-14T12:01:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.221+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Faq8H-xFDDPaE6tjvrPDgWrklsiQfvs_0 2024-09-14T12:01:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.221+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11745164937466213169', time=2024-09-14T13:32:50.927749+0000, chain.objs.size()=1 2024-09-14T12:01:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.221+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.thoZQ9G6osnfboSXMjt7rfrrCz09shg_0 2024-09-14T12:01:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.221+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6846024913022260138', time=2024-09-14T13:32:51.367132+0000, chain.objs.size()=1 2024-09-14T12:01:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.221+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Ls9jCLES9AAmnewv6YWS_yatRBP94cm_0 2024-09-14T12:01:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.221+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2396738191776734884', time=2024-09-14T13:32:51.392685+0000, chain.objs.size()=1 2024-09-14T12:01:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.221+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.VeBEq-jxxQWObRfa9q2gUnMqhkF73o7_0 2024-09-14T12:01:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.221+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8575923456690558955', time=2024-09-14T13:32:51.546379+0000, chain.objs.size()=1 2024-09-14T12:01:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.221+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.zcAXhBuH--AF_m3aE2ApsWecbxZa93h_0 2024-09-14T12:01:18.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.221+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16772611295670826327', time=2024-09-14T13:32:52.050731+0000, chain.objs.size()=1 2024-09-14T12:01:18.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.221+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.3xB33IoVf_SN6S-FTm9QRNQ1erp2BJg_0 2024-09-14T12:01:18.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.221+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8714458625022057865', time=2024-09-14T13:32:52.190288+0000, chain.objs.size()=1 2024-09-14T12:01:18.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.221+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.bbkWo6EQBhD5tApHg-AzKVibvOZ_BM__0 2024-09-14T12:01:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.224+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15178487637069112975', time=2024-09-14T13:32:52.451548+0000, chain.objs.size()=1 2024-09-14T12:01:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.224+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.sHiW-zZqNM19weHXTKGGdJMdiKC_r9C_0 2024-09-14T12:01:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.224+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.453053209871127082', time=2024-09-14T13:32:52.485462+0000, chain.objs.size()=1 2024-09-14T12:01:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.224+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ND7ckCK_-ZDNZ_9sv-heur3GhZmURiR_0 2024-09-14T12:01:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.224+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17373726748246192538', time=2024-09-14T13:32:52.629487+0000, chain.objs.size()=1 2024-09-14T12:01:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.224+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.YH1PswzxlokiE0HUKh9yqCE8TuKHxm8_0 2024-09-14T12:01:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.224+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12229598613673743097', time=2024-09-14T13:32:52.737945+0000, chain.objs.size()=1 2024-09-14T12:01:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.224+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.mc2cCRlZUTbtUtSu0-NfUhnTq6463sl_0 2024-09-14T12:01:18.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.224+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10549738396091233209', time=2024-09-14T13:32:52.996203+0000, chain.objs.size()=1 2024-09-14T12:01:18.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.224+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.PP3Xch6fmCAGmke5KwTm3QXR1nnELkY_0 2024-09-14T12:01:18.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.225+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4328969638930611662', time=2024-09-14T13:32:53.653708+0000, chain.objs.size()=1 2024-09-14T12:01:18.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.225+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.nfTj9ETDTla3l7jHHxKobunfjoPy7ue_0 2024-09-14T12:01:18.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.225+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2999851788296213040', time=2024-09-14T13:32:53.694277+0000, chain.objs.size()=1 2024-09-14T12:01:18.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.225+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.2X6bIQiwJ33oLmiChRaJ2sAvHPnvWIw_0 2024-09-14T12:01:18.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.225+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.397319246576030926', time=2024-09-14T13:32:53.695137+0000, chain.objs.size()=1 2024-09-14T12:01:18.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.225+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.VPOy_zdvdFQo4-RnS2kaamY1s9BK-hD_0 2024-09-14T12:01:18.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.225+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.811349581463139044', time=2024-09-14T13:32:53.695891+0000, chain.objs.size()=1 2024-09-14T12:01:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.225+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.MQ7d9Lv0UYGN9zSvStUnhMNIMjvItAD_0 2024-09-14T12:01:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.225+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7304615824329362209', time=2024-09-14T13:32:54.387866+0000, chain.objs.size()=1 2024-09-14T12:01:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.225+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.9qLy7gZRWzLe004jR5ghNp_vNWRODIt_0 2024-09-14T12:01:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.225+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2238454201253151872', time=2024-09-14T13:32:54.927762+0000, chain.objs.size()=1 2024-09-14T12:01:18.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.225+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.3a3qUG2Jiauy1bl8B1SkD60lS4deQjO_0 2024-09-14T12:01:18.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.228+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.98612829962727714', time=2024-09-14T13:32:55.045745+0000, chain.objs.size()=1 2024-09-14T12:01:18.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.228+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.g3rJNYkU8Qrb-hHAvCitjxhh0g2C2v8_0 2024-09-14T12:01:18.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.228+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16716096108218386054', time=2024-09-14T13:32:55.462847+0000, chain.objs.size()=1 2024-09-14T12:01:18.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.228+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.FSuSBxqj8s9-BHzK8btvym85ZpukayG_0 2024-09-14T12:01:18.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.228+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15208634834697782498', time=2024-09-14T13:32:55.920270+0000, chain.objs.size()=1 2024-09-14T12:01:18.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.228+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.eS4ai28HJiYgtoTvmwQ_I61xBShf7kD_0 2024-09-14T12:01:18.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.228+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10519045140637326240', time=2024-09-14T13:32:58.043773+0000, chain.objs.size()=1 2024-09-14T12:01:18.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.228+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.QD2RQNL1QaAU72tSv-pqIxnlWM2OJsr_0 2024-09-14T12:01:18.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.230+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17441871739435063334', time=2024-09-14T13:32:58.387144+0000, chain.objs.size()=1 2024-09-14T12:01:18.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.230+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.oCCUro8FX2N7WUJ4gNbuEyv8H4slluy_0 2024-09-14T12:01:18.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.230+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1392805446932744662', time=2024-09-14T13:32:58.485288+0000, chain.objs.size()=1 2024-09-14T12:01:18.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.230+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.waVch2L7MaYpWkVTu6kwD4_vrIVQtDt_0 2024-09-14T12:01:18.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.230+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1219403227166670819', time=2024-09-14T13:33:05.086268+0000, chain.objs.size()=1 2024-09-14T12:01:18.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.230+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.269__shadow_.6HY43B47cJnldoShGR2-SGNFRFIkzyL_0 2024-09-14T12:01:18.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.230+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3418229808718220309', time=2024-09-14T13:33:06.125605+0000, chain.objs.size()=1 2024-09-14T12:01:18.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.230+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.270__shadow_.PmLwkdH2c9eanBvodseZLTNwv_lJotN_0 2024-09-14T12:01:18.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.230+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17325693545480987804', time=2024-09-14T13:33:07.377759+0000, chain.objs.size()=1 2024-09-14T12:01:18.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.230+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.271__shadow_.LuRw7WQN1PKrdc3xwCfgx2W6OSN9rl4_0 2024-09-14T12:01:18.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.230+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10654179471416240900', time=2024-09-14T13:33:10.554411+0000, chain.objs.size()=1 2024-09-14T12:01:18.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.230+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.274__shadow_.ymBeokf_xofW0KoLd6Pk_lOP0W-fSjv_0 2024-09-14T12:01:18.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.230+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11245267615158295560', time=2024-09-14T13:33:13.792275+0000, chain.objs.size()=1 2024-09-14T12:01:18.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.230+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.277__shadow_.dEYkQBiVUVvvTNR9O90i5bNVA_PrS4B_0 2024-09-14T12:01:18.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.232+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14218165921254732384', time=2024-09-14T13:33:18.200348+0000, chain.objs.size()=1 2024-09-14T12:01:18.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.232+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.281__shadow_.arTBLpwnMGnFBqJJaYbJDfhU7e7xI8K_0 2024-09-14T12:01:18.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.232+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3795092013222705945', time=2024-09-14T13:33:19.270430+0000, chain.objs.size()=1 2024-09-14T12:01:18.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.232+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.282__shadow_.ZA_sQxIdWI7kGaSN4JwTK6aPCbYObpJ_0 2024-09-14T12:01:18.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.233+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13614975912374101969', time=2024-09-14T13:33:28.188470+0000, chain.objs.size()=1 2024-09-14T12:01:18.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.233+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.290__shadow_.hECPUy4GkL47J7GK3x-DyQ9dm-FO22F_0 2024-09-14T12:01:18.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.233+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10802808443785078053', time=2024-09-14T13:33:35.498681+0000, chain.objs.size()=1 2024-09-14T12:01:18.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.233+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.17hdvDae9puV5CbeMkpi4PSO1wDSSXJ_0 2024-09-14T12:01:18.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.233+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5307833640315015589', time=2024-09-14T13:33:37.827767+0000, chain.objs.size()=1 2024-09-14T12:01:18.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.233+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.296__shadow_.AFrJaiGy__R_-RwGrrkUrBhKHMcnKb4_0 2024-09-14T12:01:18.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.234+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8747534590211215013', time=2024-09-14T13:33:45.855297+0000, chain.objs.size()=1 2024-09-14T12:01:18.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.234+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.303__shadow_.Cq_FVBc-4YL8DkAyTjmIRo2SZlhuRKS_0 2024-09-14T12:01:18.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.234+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15596631287881648024', time=2024-09-14T13:34:04.592811+0000, chain.objs.size()=1 2024-09-14T12:01:18.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.234+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.316__shadow_.fEHAqpTh0Wa8pY9Ut-v_NddN9eUSyFi_0 2024-09-14T12:01:18.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.234+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15205235912715602324', time=2024-09-14T13:34:10.693834+0000, chain.objs.size()=1 2024-09-14T12:01:18.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.234+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.322__shadow_.KpYvifGqMVWUOHXhIpegd55eZ_6b5Vt_0 2024-09-14T12:01:18.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.234+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4060605735112211935', time=2024-09-14T13:34:52.333776+0000, chain.objs.size()=1 2024-09-14T12:01:18.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.234+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.2646fEz3HlRfOgDnP-OhoGl6_buT1dG_0 2024-09-14T12:01:18.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.234+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17775165714593984435', time=2024-09-14T13:34:52.558683+0000, chain.objs.size()=1 2024-09-14T12:01:18.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.234+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.T16cj1d-RncFTco2vAttzulGdiewSii_0 2024-09-14T12:01:18.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.235+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3151757103321373127', time=2024-09-14T13:34:53.126239+0000, chain.objs.size()=1 2024-09-14T12:01:18.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.235+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.UIBVFxtu0R6Xy-iB7aRozILHFAgL6Hg_0 2024-09-14T12:01:18.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.236+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2045267622457480877', time=2024-09-14T13:34:53.341130+0000, chain.objs.size()=1 2024-09-14T12:01:18.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.236+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.P6eWqgH5QhTvpD1IbcMipuyxVU0Guyz_0 2024-09-14T12:01:18.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.236+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5833201748232361048', time=2024-09-14T13:34:53.434841+0000, chain.objs.size()=1 2024-09-14T12:01:18.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.236+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.2HzMo64sZ1h_pLrvsY_Cb4-po93PaFv_0 2024-09-14T12:01:18.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.237+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17992176592549184603', time=2024-09-14T13:34:55.210509+0000, chain.objs.size()=1 2024-09-14T12:01:18.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.237+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.zecRlWdjdboozcE6lvu-YbS43I07EzZ_0 2024-09-14T12:01:18.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.237+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8509574134513072646', time=2024-09-14T13:34:55.373261+0000, chain.objs.size()=1 2024-09-14T12:01:18.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.237+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.bEnprq7-jZ2PbhHOf5uWe46nBwdLeNh_0 2024-09-14T12:01:18.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.237+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1874278626260593890', time=2024-09-14T13:34:55.385834+0000, chain.objs.size()=1 2024-09-14T12:01:18.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.237+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.lNdVS-ltCH6dM0NjXOT6HIDsyiStsVv_0 2024-09-14T12:01:18.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.237+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18035976975283737056', time=2024-09-14T13:34:55.576965+0000, chain.objs.size()=1 2024-09-14T12:01:18.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.237+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.3ZcHWMnFCY1FSyTL6zIQpqZso6c0L7C_0 2024-09-14T12:01:18.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.239+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.438768943102088336', time=2024-09-14T13:34:55.671394+0000, chain.objs.size()=1 2024-09-14T12:01:18.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.239+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.7natoXvjXPjZtHD76g8K1aINsjJ6KcZ_0 2024-09-14T12:01:18.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.239+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9659089210013047680', time=2024-09-14T13:34:56.368768+0000, chain.objs.size()=1 2024-09-14T12:01:18.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.239+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.r8RxBMVEgxL-c6i5dzBFF4YCm6Ot10B_0 2024-09-14T12:01:18.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.239+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11690579697933499373', time=2024-09-14T13:34:56.537209+0000, chain.objs.size()=1 2024-09-14T12:01:18.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.239+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.s0rP0zQviK4ajH3tcK6sa94uWdVZ5MC_0 2024-09-14T12:01:18.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.239+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17508893270056897668', time=2024-09-14T13:34:56.733440+0000, chain.objs.size()=1 2024-09-14T12:01:18.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.239+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.CIm54yKGgtKMPuTAJ90BxTlgnM_P4We_0 2024-09-14T12:01:18.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.239+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8250806005754421867', time=2024-09-14T13:34:57.013971+0000, chain.objs.size()=1 2024-09-14T12:01:18.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.239+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.5MBmAhUtfOyTNfgUaYe9oLp2BZY_cZ6_0 2024-09-14T12:01:18.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.239+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8895465283480204721', time=2024-09-14T13:34:57.077915+0000, chain.objs.size()=1 2024-09-14T12:01:18.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.239+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Ju1pQyCUzOKXe-Z-KRSaeu8KcrG6j2p_0 2024-09-14T12:01:18.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.240+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2981771404303674987', time=2024-09-14T13:34:58.457713+0000, chain.objs.size()=1 2024-09-14T12:01:18.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.240+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.hzzD_1L6P8n512uzqAwtDl5FnAIgFvg_0 2024-09-14T12:01:18.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.241+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.343113006513281188', time=2024-09-14T13:34:58.555966+0000, chain.objs.size()=1 2024-09-14T12:01:18.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.241+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.57r7BkqcSgfVtxS_ZbLVB8_MCb_5Vai_0 2024-09-14T12:01:18.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.241+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4833729604497088717', time=2024-09-14T13:34:58.597292+0000, chain.objs.size()=1 2024-09-14T12:01:18.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.241+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.-NWdtl2wHkFCC92SZ0bR1U6a108nLjb_0 2024-09-14T12:01:18.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.241+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6832703155956323216', time=2024-09-14T13:34:59.057535+0000, chain.objs.size()=1 2024-09-14T12:01:18.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.241+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.sca4aY_ZxRO9xL-iK_WMfy3On4awfxl_0 2024-09-14T12:01:18.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.241+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7982051039956013581', time=2024-09-14T13:34:59.218258+0000, chain.objs.size()=1 2024-09-14T12:01:18.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.241+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Yhvpy8DN7qJzKoMm3sO41DLrbaq8PhO_0 2024-09-14T12:01:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.243+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3434036938926097140', time=2024-09-14T13:34:59.359536+0000, chain.objs.size()=1 2024-09-14T12:01:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.243+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.cOY7mRVSzYDODAg2cbAX24-OMbbzHse_0 2024-09-14T12:01:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.243+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15169522533499933320', time=2024-09-14T13:34:59.412681+0000, chain.objs.size()=1 2024-09-14T12:01:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.243+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.XFJyMMwt9yOcur3nRIPXJske_pTojAu_0 2024-09-14T12:01:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.243+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1159295784708734529', time=2024-09-14T13:34:59.978073+0000, chain.objs.size()=1 2024-09-14T12:01:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.243+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.b9mNcHkwclx79P-S_MKwsO0_hpzz-q4_0 2024-09-14T12:01:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.243+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12832085524463475922', time=2024-09-14T13:35:00.781237+0000, chain.objs.size()=1 2024-09-14T12:01:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.243+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.IgaisP79mehgw6XnIlt7sRCTW7R7GwD_0 2024-09-14T12:01:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.243+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3613663351598006900', time=2024-09-14T13:35:00.931359+0000, chain.objs.size()=1 2024-09-14T12:01:18.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.243+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.9MNUf1yh0lRE7hX0hXDIgTXFGiq54QW_0 2024-09-14T12:01:18.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.243+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16958702661819375546', time=2024-09-14T13:35:01.066366+0000, chain.objs.size()=1 2024-09-14T12:01:18.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.243+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.4XpGozPVJLDLnu9pWLLg9c-tTTAkOWQ_0 2024-09-14T12:01:18.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.244+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16219163771066095915', time=2024-09-14T13:35:01.486001+0000, chain.objs.size()=1 2024-09-14T12:01:18.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.244+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.9dDizyjDxrZa-galJxuIluVyIr1RIke_0 2024-09-14T12:01:18.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.245+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2090153740618645553', time=2024-09-14T13:35:01.486837+0000, chain.objs.size()=1 2024-09-14T12:01:18.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.245+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.uQO8UVoCqwa1cjpjky36XfssfDXwamB_0 2024-09-14T12:01:18.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.245+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12440961773744744280', time=2024-09-14T13:35:01.937677+0000, chain.objs.size()=1 2024-09-14T12:01:18.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.245+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.hQ1t5_feTktQQIFcTKIDXKpugyYT1yJ_0 2024-09-14T12:01:18.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.245+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.121378589641398262', time=2024-09-14T13:35:01.938572+0000, chain.objs.size()=1 2024-09-14T12:01:18.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.245+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ExGvxaLHdv5N9hXxvmVG8y14AaPl_AC_0 2024-09-14T12:01:18.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.245+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11466791364383239639', time=2024-09-14T13:35:02.275529+0000, chain.objs.size()=1 2024-09-14T12:01:18.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.245+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.T3kfHGi9m9PQKCbQKR5N3jemy3Lkhy3_0 2024-09-14T12:01:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.249+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7221334960034245122', time=2024-09-14T13:35:02.562104+0000, chain.objs.size()=1 2024-09-14T12:01:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.249+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.c4QYZKGx11p1EeqqafYFoBb5bx4Sgmz_0 2024-09-14T12:01:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.249+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.655572241515984265', time=2024-09-14T13:35:02.652627+0000, chain.objs.size()=1 2024-09-14T12:01:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.249+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.-MwseqIQTQiWXBT5ClzxNtPDYFeDj5F_0 2024-09-14T12:01:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.249+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17524896550808651066', time=2024-09-14T13:35:41.620331+0000, chain.objs.size()=1 2024-09-14T12:01:18.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.249+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.28kR-xPo9Oaa2BcTaxK-t1ZkrK55xIV_0 2024-09-14T12:01:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.249+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10731358125126253376', time=2024-09-14T13:35:42.082864+0000, chain.objs.size()=1 2024-09-14T12:01:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.249+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.eu-bafC7J0q00BV7bPU24ENJhxebc3f_0 2024-09-14T12:01:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.249+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11930998431760349342', time=2024-09-14T13:35:42.525484+0000, chain.objs.size()=1 2024-09-14T12:01:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.249+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.bLLBJjYGP8d-66JXZ3nJbBMIN2tXUb4_0 2024-09-14T12:01:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.249+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17815087440925126526', time=2024-09-14T13:35:42.552374+0000, chain.objs.size()=1 2024-09-14T12:01:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.249+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.YWvRdUB7wY7Bkr6V-sDCr0k7TpnuV0R_0 2024-09-14T12:01:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.249+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14103068605081210779', time=2024-09-14T13:35:42.648741+0000, chain.objs.size()=1 2024-09-14T12:01:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.249+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.jkm_cwiH90aO23JT-JAuJL4nBkCkFcf_0 2024-09-14T12:01:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.249+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11437223455001783672', time=2024-09-14T13:35:42.679097+0000, chain.objs.size()=1 2024-09-14T12:01:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.249+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Q74ecF-5Nfd8dug75ITa2bUQXHbPQ1l_0 2024-09-14T12:01:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.249+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3101279748685440625', time=2024-09-14T13:35:42.697331+0000, chain.objs.size()=1 2024-09-14T12:01:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.249+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.gDy7cpCgbE1NmQO3vMzT9vwvyVUoRs6_0 2024-09-14T12:01:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.249+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.850302095742282304', time=2024-09-14T13:35:43.423085+0000, chain.objs.size()=1 2024-09-14T12:01:18.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.249+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.U4XrBHCTuL7F97-R6XZK_BukiGo2Ptt_0 2024-09-14T12:01:18.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.249+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14683095066331709678', time=2024-09-14T13:35:43.423850+0000, chain.objs.size()=1 2024-09-14T12:01:18.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.249+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.QyQ2NfJ2gV1XaW3qbunFFyWhbyhdJTm_0 2024-09-14T12:01:18.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.253+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6825962532141516247', time=2024-09-14T13:35:44.315632+0000, chain.objs.size()=1 2024-09-14T12:01:18.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.253+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.rRf6dAZFIJqqyPaCR-ZC2j63YGFUrB8_0 2024-09-14T12:01:18.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.253+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8131981790592018857', time=2024-09-14T13:35:45.299784+0000, chain.objs.size()=1 2024-09-14T12:01:18.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.253+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.7DDu_bWVNqSqUxZRIcd7DucDd5Xp_O5_0 2024-09-14T12:01:18.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.253+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13185468043501159813', time=2024-09-14T13:35:45.851328+0000, chain.objs.size()=1 2024-09-14T12:01:18.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.253+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.eydKaF0GapW-_EDRPE15V4OVwSOtir7_0 2024-09-14T12:01:18.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.253+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13604963786369009934', time=2024-09-14T13:35:46.475206+0000, chain.objs.size()=1 2024-09-14T12:01:18.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.253+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_._qtHwECcYASzTi8M22zepe1wyvqrwo4_0 2024-09-14T12:01:18.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.253+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5610973633891302528', time=2024-09-14T13:35:46.955697+0000, chain.objs.size()=1 2024-09-14T12:01:18.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.253+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.iZ0ZefRw5G6B16TCDcDHjFNu1OC5foS_0 2024-09-14T12:01:18.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.256+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/46781 2024-09-14T12:01:18.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=39, truncated=0, next_marker='' 2024-09-14T12:01:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10817395596165525178', time=2024-09-14T13:35:46.956500+0000, chain.objs.size()=1 2024-09-14T12:01:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.-KiVfTvVsbDqgJyR_Z2EybSrftnbU_G_0 2024-09-14T12:01:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6931694031898813856', time=2024-09-14T13:35:47.059923+0000, chain.objs.size()=1 2024-09-14T12:01:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.mjCUhB7HZe0Fg-HG01aHGJ_j8ZMg076_0 2024-09-14T12:01:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11279671150095094973', time=2024-09-14T13:35:47.320286+0000, chain.objs.size()=1 2024-09-14T12:01:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.hm7sxmOsdCO_H3QzHq-jgDWQIYTYwjI_0 2024-09-14T12:01:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8989022523711172299', time=2024-09-14T13:35:47.932647+0000, chain.objs.size()=1 2024-09-14T12:01:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.lBYxCktFazCJ09KwWPXq-r1UnTGykdx_0 2024-09-14T12:01:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14080171620239859213', time=2024-09-14T13:35:48.047813+0000, chain.objs.size()=1 2024-09-14T12:01:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.SKqd76-SvHFJZoYH5GTZRr8DplYUzOE_0 2024-09-14T12:01:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8745111848920020461', time=2024-09-14T13:35:48.072656+0000, chain.objs.size()=1 2024-09-14T12:01:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.LHM7OO8qUd9OsrxaWqoxXTRECVixLXw_0 2024-09-14T12:01:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4519782173155360333', time=2024-09-14T13:35:48.568425+0000, chain.objs.size()=1 2024-09-14T12:01:18.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.3ZWe2d4V4UuClES6KstPjrJR42mwvuQ_0 2024-09-14T12:01:18.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17422281935356539782', time=2024-09-14T13:35:48.783157+0000, chain.objs.size()=1 2024-09-14T12:01:18.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.5nHH7SMXGjkzmN0gO9WKggVIOevdvfE_0 2024-09-14T12:01:18.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12877747100743268410', time=2024-09-14T13:35:49.525823+0000, chain.objs.size()=1 2024-09-14T12:01:18.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.TE0lptAfapDVbBzL7u5CU-6QS0lDiyW_0 2024-09-14T12:01:18.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11851449775075250282', time=2024-09-14T13:35:50.159076+0000, chain.objs.size()=1 2024-09-14T12:01:18.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.txDX5L1jlh5lK1dDTyetmGAeG6TkYeN_0 2024-09-14T12:01:18.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2910863902891904179', time=2024-09-14T13:35:50.202967+0000, chain.objs.size()=1 2024-09-14T12:01:18.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.qFNfXU_0fawXsE4bmiVSzgwOh8zqOx7_0 2024-09-14T12:01:18.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9566111970999477666', time=2024-09-14T13:35:50.858299+0000, chain.objs.size()=1 2024-09-14T12:01:18.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.259+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.H3PXykLmIQJUPZp_UmYG9r19JxgbHBn_0 2024-09-14T12:01:18.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.262+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12097230570571025276', time=2024-09-14T13:35:51.070345+0000, chain.objs.size()=1 2024-09-14T12:01:18.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.262+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.dteRZEm-gn-OKJfdQGFf0T48pf4W9Ad_0 2024-09-14T12:01:18.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.262+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6490998600500245632', time=2024-09-14T13:35:51.641460+0000, chain.objs.size()=1 2024-09-14T12:01:18.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.262+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.GcPaK5hyDTJCa5WPpSQw7qSF-VtfhvY_0 2024-09-14T12:01:18.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.262+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17725881515504806863', time=2024-09-14T13:35:52.464302+0000, chain.objs.size()=1 2024-09-14T12:01:18.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.262+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ktqHAbUZgp_VtrHa8cQBxoYLkRgFc94_0 2024-09-14T12:01:18.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.262+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9000645412496160968', time=2024-09-14T13:35:57.559605+0000, chain.objs.size()=1 2024-09-14T12:01:18.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.262+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.330__shadow_.qUFzkLnHtC5oX3303R9DKjj-6H5cCQe_0 2024-09-14T12:01:18.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.263+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4392879638965889000', time=2024-09-14T13:38:07.613914+0000, chain.objs.size()=1 2024-09-14T12:01:18.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.263+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.451__shadow_.BulQE59gayyMHm-qBFSpfoxnblslc6P_0 2024-09-14T12:01:18.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.264+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12612756069726553967', time=2024-09-14T13:38:42.810509+0000, chain.objs.size()=1 2024-09-14T12:01:18.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.264+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.484__shadow_.PWCZDtMKKrE8IFkxJ1p70uhKQ696I0Y_0 2024-09-14T12:01:18.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.264+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10434063537588366337', time=2024-09-14T13:38:50.203011+0000, chain.objs.size()=1 2024-09-14T12:01:18.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.264+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.488__shadow_.07jB5aZM9lQJlgo4w6pCkT7eb1RGBqn_0 2024-09-14T12:01:18.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.264+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5484457870975951466', time=2024-09-14T13:38:57.561216+0000, chain.objs.size()=1 2024-09-14T12:01:18.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.264+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.496__shadow_.S5zPTi67oYqAKkVnmKnWu1xeWoOykWx_0 2024-09-14T12:01:18.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.264+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3148693618762467906', time=2024-09-14T13:39:40.852607+0000, chain.objs.size()=1 2024-09-14T12:01:18.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.264+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.513__shadow_.H9mCdPkUTMD-VEUBCL3LtyssG-6bN1I_0 2024-09-14T12:01:18.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.264+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3273274335592017069', time=2024-09-14T13:39:41.108464+0000, chain.objs.size()=1 2024-09-14T12:01:18.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.264+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.514__multipart_mymultipart.2~oZrYEYuvMo1tzFFQ7YzHefcez1DWzJR.1 2024-09-14T12:01:18.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.264+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17105935335836089428', time=2024-09-14T13:39:42.233879+0000, chain.objs.size()=1 2024-09-14T12:01:18.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.264+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.515__shadow_.NCEborWbJdrQ8ZYNXH1a1Wb-A4XzpAo_0 2024-09-14T12:01:18.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.267+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16036519604857427569', time=2024-09-14T13:41:36.142770+0000, chain.objs.size()=6 2024-09-14T12:01:18.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.267+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~h42sVAjWyRH5uVWoZ6cZJqdFJlVVAij.1 2024-09-14T12:01:18.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.267+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.MHW57Imy23HA7I1v_c53b971V6cDiJB0.2 2024-09-14T12:01:18.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.267+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~h42sVAjWyRH5uVWoZ6cZJqdFJlVVAij.3 2024-09-14T12:01:18.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.267+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~h42sVAjWyRH5uVWoZ6cZJqdFJlVVAij.4 2024-09-14T12:01:18.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.268+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~h42sVAjWyRH5uVWoZ6cZJqdFJlVVAij.5 2024-09-14T12:01:18.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.268+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~h42sVAjWyRH5uVWoZ6cZJqdFJlVVAij.6 2024-09-14T12:01:18.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.269+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.483790905699408433', time=2024-09-14T13:43:33.903823+0000, chain.objs.size()=2 2024-09-14T12:01:18.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.269+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.529__multipart_mymultipart.2~X1AHchm1KGHqd_HtSVB0CaRO0mqs4T_.1 2024-09-14T12:01:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.271+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.529__multipart_mymultipart.2~X1AHchm1KGHqd_HtSVB0CaRO0mqs4T_.2 2024-09-14T12:01:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.271+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~BunXaYzftxOvb0lZt6aUWTtE8M19WTQ', time=2024-09-14T13:43:46.399714+0000, chain.objs.size()=1 2024-09-14T12:01:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.271+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.535__multipart_mymultipart.2~BunXaYzftxOvb0lZt6aUWTtE8M19WTQ.1 2024-09-14T12:01:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.271+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12567260662736830519', time=2024-09-14T13:44:10.682345+0000, chain.objs.size()=1 2024-09-14T12:01:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.271+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.538__shadow_.qA1a7V8Lsd8IXgaDErcFO6wkCTn5jjO_0 2024-09-14T12:01:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.271+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7080417481402580291', time=2024-09-14T13:44:40.562915+0000, chain.objs.size()=1 2024-09-14T12:01:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.271+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.552__shadow_.bsm22e89uj6JQn0SrEbGajPhDCsOnUJ_0 2024-09-14T12:01:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.271+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1185437878959837403', time=2024-09-14T13:45:08.417820+0000, chain.objs.size()=1 2024-09-14T12:01:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.271+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.558__shadow_.JqXKg4HVYar00XPLHqUyXSzHya4ES22_0 2024-09-14T12:01:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.272+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9833936807106631268', time=2024-09-14T13:45:21.065630+0000, chain.objs.size()=1 2024-09-14T12:01:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.272+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.562__multipart_mymultipart.jarl4TWQu7zntPK_fODiTkDvCMPgcRe2.1 2024-09-14T12:01:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.272+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6314682649971839264', time=2024-09-14T13:45:41.282001+0000, chain.objs.size()=1 2024-09-14T12:01:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.272+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:zM47EAEOgt0pmp-VlfOind7cOk2f7nu_.X2tEPq54A9ZMDUNfLa86_OpVaKAJRsu_0 2024-09-14T12:01:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.272+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2725783446811649692', time=2024-09-14T13:46:13.566427+0000, chain.objs.size()=1 2024-09-14T12:01:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.272+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:0oullc4U4x-TNw-WYXPTUA39N4AbMxe_.1-kLCOhwX80QnWgRnBnSiiKopLpdTos_0 2024-09-14T12:01:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.272+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16478227138187041940', time=2024-09-14T13:47:12.051328+0000, chain.objs.size()=1 2024-09-14T12:01:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.272+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.581__shadow:ucJQ5gC866YVcJz5iWi8DFmIfLjsX7-_.vszOjRwgAfymXNJl4RRFQCaYIXTsWxI_0 2024-09-14T12:01:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.272+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2454255516758136190', time=2024-09-14T13:52:39.572643+0000, chain.objs.size()=1 2024-09-14T12:01:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.272+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.628__shadow_.jdKGs9TZ4BUtWGktBSHSSfJfQX3Gvwf_0 2024-09-14T12:01:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.272+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10433841166063941834', time=2024-09-14T13:53:56.307224+0000, chain.objs.size()=1 2024-09-14T12:01:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.272+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.665__shadow_.QvuaLHvI361nYHYBkTWDlZs0M_YJTA2_0 2024-09-14T12:01:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.273+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17144177302345297254', time=2024-09-14T13:54:55.988403+0000, chain.objs.size()=1 2024-09-14T12:01:18.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.273+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.716__shadow:YPzqa-s0WqMpWUUsNWV-hbpRRyONiD0_.1zyGykv2hzr9RX9AQEM1oqsa-CRLFGK_0 2024-09-14T12:01:18.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.274+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10952665318257999676', time=2024-09-14T13:55:07.097843+0000, chain.objs.size()=1 2024-09-14T12:01:18.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.274+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.718__shadow:Co4aqJFg9TByYVnwiwGiwOYX6ALSa6A_.MvRmUKM8LkJr7Kf0yYUJ1k5WdHGkFzZ_0 2024-09-14T12:01:18.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.274+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~AeG3zyqEloeZ6TCk3uPo0LeHPeoxbK1', time=2024-09-14T13:55:44.120270+0000, chain.objs.size()=1 2024-09-14T12:01:18.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.274+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.743__multipart_mymultipart.2~AeG3zyqEloeZ6TCk3uPo0LeHPeoxbK1.1 2024-09-14T12:01:18.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.274+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5710585798894883304', time=2024-09-14T13:58:03.151296+0000, chain.objs.size()=1 2024-09-14T12:01:18.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.274+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.769__shadow_.eh4CFgd5ZW4wVTtsSJuw5KocHM1MX-G_0 2024-09-14T12:01:18.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.277+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:18.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.280+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T12:01:18.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.281+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:18.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.282+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.283+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/58887' 2024-09-14T12:01:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.283+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4379040534008287595', time=2024-09-14T13:27:34.589972+0000, chain.objs.size()=1 2024-09-14T12:01:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.283+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.158__shadow:EKKIpGgiif7C2yOCXTK6lZBTCCZEZ66_._iJdLXCkHmlIh7SxQJbAEf0uTwr_0I7_0 2024-09-14T12:01:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.283+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17086689043782544109', time=2024-09-14T13:28:05.509914+0000, chain.objs.size()=2 2024-09-14T12:01:18.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.283+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.161__shadow_.T7OiQus90m2quieSkL9bYp9q3RPqfnc_0 2024-09-14T12:01:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.283+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.161__shadow_.T7OiQus90m2quieSkL9bYp9q3RPqfnc_1 2024-09-14T12:01:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.283+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3306373702093610558', time=2024-09-14T13:28:47.723233+0000, chain.objs.size()=1 2024-09-14T12:01:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.283+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.172__shadow_.Z2k9r18p5Lu26PU5hptm4rucI6eVlWu_0 2024-09-14T12:01:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.283+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11330548536820428215', time=2024-09-14T13:29:10.074011+0000, chain.objs.size()=1 2024-09-14T12:01:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.283+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.190__shadow_.FUnyLt6lNKFu33O4AwR9_SAY_xZi4hR_0 2024-09-14T12:01:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.283+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11850854144349572590', time=2024-09-14T13:31:41.007120+0000, chain.objs.size()=1 2024-09-14T12:01:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.283+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.238__shadow_.fLuYcTp-pcfnC8jf8kP6EZhuB-o_JSI_0 2024-09-14T12:01:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.283+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10286313833510055016', time=2024-09-14T13:31:42.813201+0000, chain.objs.size()=1 2024-09-14T12:01:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.283+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.239__shadow_.wGAleFyDGGvILkVUNd99jJqYsez5nY4_0 2024-09-14T12:01:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.283+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11302703698050042617', time=2024-09-14T13:31:48.753949+0000, chain.objs.size()=1 2024-09-14T12:01:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.283+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.244__shadow_.RTBIBu6e_hSeVngjFL8LxgsFlxTBS6__0 2024-09-14T12:01:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.283+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14517824221738879170', time=2024-09-14T13:31:50.549285+0000, chain.objs.size()=1 2024-09-14T12:01:18.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.283+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.245__shadow_.ktTwQcxvccRw6oBnfkuGblTgG8aTuhv_0 2024-09-14T12:01:18.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.283+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7110855233695073873', time=2024-09-14T13:32:06.040306+0000, chain.objs.size()=1 2024-09-14T12:01:18.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.283+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.259__shadow_.yNvRCq9L2w8Yj6aKW-zME72dV5547Q4_0 2024-09-14T12:01:18.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.283+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13550002414279436835', time=2024-09-14T13:32:47.408426+0000, chain.objs.size()=1 2024-09-14T12:01:18.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.283+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.wAIM4A9DRbQuo9yi52dUEzq1gJGw5FP_0 2024-09-14T12:01:18.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.283+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10101135034794055847', time=2024-09-14T13:32:47.585338+0000, chain.objs.size()=1 2024-09-14T12:01:18.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.283+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.N-bSPgRjgKBpQbTAHlXFoQkocXXAMcw_0 2024-09-14T12:01:18.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.286+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17165098146532195119', time=2024-09-14T13:32:48.461706+0000, chain.objs.size()=1 2024-09-14T12:01:18.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.286+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.PeSssuc6aaRVbRr7Aa1WWj-ULkIn2r-_0 2024-09-14T12:01:18.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.286+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11183346155445121157', time=2024-09-14T13:32:48.477898+0000, chain.objs.size()=1 2024-09-14T12:01:18.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.286+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.dBobNCzP6ZA3NUZRz648WlBlgszENB__0 2024-09-14T12:01:18.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.286+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.284239885038300191', time=2024-09-14T13:32:49.283127+0000, chain.objs.size()=1 2024-09-14T12:01:18.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.286+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.OxmpXgqgJauMxITqoTs0CdvvwlaoGH__0 2024-09-14T12:01:18.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.287+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.313353630286419841', time=2024-09-14T13:32:49.366996+0000, chain.objs.size()=1 2024-09-14T12:01:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.287+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.K5ee39bFOJCs3zWqetrWOe17Q_49kEJ_0 2024-09-14T12:01:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.287+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15368565558633833088', time=2024-09-14T13:32:49.592630+0000, chain.objs.size()=1 2024-09-14T12:01:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.287+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.UxdU1xUNfK_hNRRJbjeP4F0EnSzqvNh_0 2024-09-14T12:01:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.287+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17535383435476423688', time=2024-09-14T13:32:49.662681+0000, chain.objs.size()=1 2024-09-14T12:01:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.287+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ZojPp8AIOZY0XIlxM5ClN6gjFN0CL2E_0 2024-09-14T12:01:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.287+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13237519241089184167', time=2024-09-14T13:32:50.081093+0000, chain.objs.size()=1 2024-09-14T12:01:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.287+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.gvY3dhRwlX10VnMLD8aMioHNN2L0Fd0_0 2024-09-14T12:01:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.287+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2894308796128713383', time=2024-09-14T13:32:50.625585+0000, chain.objs.size()=1 2024-09-14T12:01:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.287+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.4CfbhdjFPCxzFgjAIIzMeXWaCZtaVNP_0 2024-09-14T12:01:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.287+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13206883884394990531', time=2024-09-14T13:32:50.741232+0000, chain.objs.size()=1 2024-09-14T12:01:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.287+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.xQ_N46QrnDOE9SdQfQbLv3IYUcgPyRZ_0 2024-09-14T12:01:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.287+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16817940133935396477', time=2024-09-14T13:32:51.363349+0000, chain.objs.size()=1 2024-09-14T12:01:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.287+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.JdSFyNFGlZzsxdgn5pYGBUAXUuPWu9z_0 2024-09-14T12:01:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.287+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17907162557948366688', time=2024-09-14T13:32:51.417909+0000, chain.objs.size()=1 2024-09-14T12:01:18.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.287+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.CFjAznahnzbFHQCjWSA-MnwB7uENRTn_0 2024-09-14T12:01:18.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.291+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15364362728447023758', time=2024-09-14T13:32:52.190051+0000, chain.objs.size()=1 2024-09-14T12:01:18.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.291+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.rxipikV7SdTUtWvOgqQ5NfLR51OkK5q_0 2024-09-14T12:01:18.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.291+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11316282839487806560', time=2024-09-14T13:32:52.191581+0000, chain.objs.size()=1 2024-09-14T12:01:18.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.291+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.6spevQnXbRBP72Jx5P58zVX81ydYuDr_0 2024-09-14T12:01:18.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.292+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4573557938162270797', time=2024-09-14T13:32:52.450861+0000, chain.objs.size()=1 2024-09-14T12:01:18.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.292+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.vbc7fncT786ki4nFuV0S805dsMUeme-_0 2024-09-14T12:01:18.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.292+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2230978668423287443', time=2024-09-14T13:32:53.924153+0000, chain.objs.size()=1 2024-09-14T12:01:18.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.292+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.8AtDd1lTXtgd6yA5z6i2iEkINWvsyEu_0 2024-09-14T12:01:18.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.292+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18287705232481956675', time=2024-09-14T13:32:54.048082+0000, chain.objs.size()=1 2024-09-14T12:01:18.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.292+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ZkmCYQ-5t2Z077jnW9p5_jGxcI3qrRx_0 2024-09-14T12:01:18.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.292+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2938148688576600130', time=2024-09-14T13:32:54.133529+0000, chain.objs.size()=1 2024-09-14T12:01:18.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.292+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_._f8pFTkLQfW-3bGYJfTPxnu-Bw40Onj_0 2024-09-14T12:01:18.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.292+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6976312599421007009', time=2024-09-14T13:32:54.337009+0000, chain.objs.size()=1 2024-09-14T12:01:18.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.292+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.isruj98dfOOZbpVo-7R-VRPHmND5Z3y_0 2024-09-14T12:01:18.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.292+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5657338838694554078', time=2024-09-14T13:32:54.529212+0000, chain.objs.size()=1 2024-09-14T12:01:18.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.292+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.RZY_yIF8rMfb120KyWlaqBkN2wG10Ig_0 2024-09-14T12:01:18.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.292+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16462286643906032903', time=2024-09-14T13:32:55.319231+0000, chain.objs.size()=1 2024-09-14T12:01:18.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.292+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ndZhzkQHP2vxu2_wLvstChUQtn2N03g_0 2024-09-14T12:01:18.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.292+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14720502466919821320', time=2024-09-14T13:32:55.472664+0000, chain.objs.size()=1 2024-09-14T12:01:18.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.292+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.TMz7_qSbqnguY4ZN3_sFE7LtYtiIiNI_0 2024-09-14T12:01:18.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.292+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6084748651164808464', time=2024-09-14T13:32:55.691460+0000, chain.objs.size()=1 2024-09-14T12:01:18.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.292+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.YsHeZX6Qp8rciO7pXZdf90foYS3lhJA_0 2024-09-14T12:01:18.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.295+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13813897979544986512', time=2024-09-14T13:32:56.896291+0000, chain.objs.size()=1 2024-09-14T12:01:18.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.295+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.1w6Fi5AbaM6c22PNBC8xs2b3EkAv8Zy_0 2024-09-14T12:01:18.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.295+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11953282131274799103', time=2024-09-14T13:32:57.169131+0000, chain.objs.size()=1 2024-09-14T12:01:18.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.295+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.5hAUTh-_-9jkTSHloVktO7R2O7uwAf6_0 2024-09-14T12:01:18.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.295+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9260659600475243139', time=2024-09-14T13:32:57.248348+0000, chain.objs.size()=1 2024-09-14T12:01:18.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.295+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.CuJUsJTn2xrcRNmOATu6dfXgImpfdTv_0 2024-09-14T12:01:18.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.297+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13843704721041856034', time=2024-09-14T13:32:57.411795+0000, chain.objs.size()=1 2024-09-14T12:01:18.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.297+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.73hQQKzmpurKBxuc-c7PqMwFnSARr_B_0 2024-09-14T12:01:18.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.297+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11926349061066811845', time=2024-09-14T13:32:57.780485+0000, chain.objs.size()=1 2024-09-14T12:01:18.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.297+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.B5Q7yT8D6pHRlHZ2ON56jhsJIcWp6_X_0 2024-09-14T12:01:18.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.297+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9971667418688364216', time=2024-09-14T13:32:57.916947+0000, chain.objs.size()=1 2024-09-14T12:01:18.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.297+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.IX0nU_4rNsPnLzJQv6RTMWPVYucBJlX_0 2024-09-14T12:01:18.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.297+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3372487898741481997', time=2024-09-14T13:32:57.918349+0000, chain.objs.size()=1 2024-09-14T12:01:18.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.297+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.wDlp6dFTB3FkNbGcQi227myKrnQ6D8x_0 2024-09-14T12:01:18.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.297+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13003647424388746502', time=2024-09-14T13:32:58.075997+0000, chain.objs.size()=1 2024-09-14T12:01:18.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.297+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.cchDXhInEzGej6-fxxRpr3-raWqL8QC_0 2024-09-14T12:01:18.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.297+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3889916757613628572', time=2024-09-14T13:32:58.154785+0000, chain.objs.size()=1 2024-09-14T12:01:18.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.297+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.QgTC2ps1P8uBKX6Z01RMuBfXN7YzM56_0 2024-09-14T12:01:18.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.297+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14311016030388985251', time=2024-09-14T13:32:58.366155+0000, chain.objs.size()=1 2024-09-14T12:01:18.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.297+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ULRpYlXKb1XYIroGmEu6PDudOcw0h-K_0 2024-09-14T12:01:18.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.297+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4890890884640851276', time=2024-09-14T13:32:58.387592+0000, chain.objs.size()=1 2024-09-14T12:01:18.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.297+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.HmxeqOgDiYrJpyCaLkBhRo-zxU4KWSw_0 2024-09-14T12:01:18.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.299+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6266457726956175696', time=2024-09-14T13:32:58.414062+0000, chain.objs.size()=1 2024-09-14T12:01:18.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.299+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.WVHlPHD82omCD-vdWMwrKiqnlRg_1n7_0 2024-09-14T12:01:18.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.299+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1892777203753880510', time=2024-09-14T13:32:58.483170+0000, chain.objs.size()=1 2024-09-14T12:01:18.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.299+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.WoXabE14BJErgGvbeAjYOJqG_BIdGGq_0 2024-09-14T12:01:18.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.299+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7154452905271849038', time=2024-09-14T13:33:00.903575+0000, chain.objs.size()=1 2024-09-14T12:01:18.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.299+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.265__shadow_.V4zY3eezY3R_DQibus2BVbyj076cdVK_0 2024-09-14T12:01:18.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.299+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12273950081532076663', time=2024-09-14T13:33:01.938464+0000, chain.objs.size()=1 2024-09-14T12:01:18.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.299+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.266__shadow_.ez2Fdz-832lsHo4MAYMvPv_Eswt03w6_0 2024-09-14T12:01:18.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.301+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11272520042306165707', time=2024-09-14T13:33:18.190631+0000, chain.objs.size()=1 2024-09-14T12:01:18.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.301+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.281__shadow_.fFRPO28DyqRFrSGozz6ZZo8_GyJB-m7_0 2024-09-14T12:01:18.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.303+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14479181432860087094', time=2024-09-14T13:33:21.457835+0000, chain.objs.size()=1 2024-09-14T12:01:18.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.303+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.284__shadow_.OxN726UEG6i874QrfcWY4xYzEB4c3dW_0 2024-09-14T12:01:18.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.303+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3728390696393452053', time=2024-09-14T13:33:22.591891+0000, chain.objs.size()=1 2024-09-14T12:01:18.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.303+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.285__shadow_.rcnl0cypPTArbT12v21aqsmU9iEn8aT_0 2024-09-14T12:01:18.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.303+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12400458899430962723', time=2024-09-14T13:33:28.192629+0000, chain.objs.size()=1 2024-09-14T12:01:18.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.303+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.290__shadow_.-9jW1d94H0_myJ-Tyz01zrOARJrX92T_0 2024-09-14T12:01:18.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.303+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3937637529127911342', time=2024-09-14T13:33:33.162791+0000, chain.objs.size()=1 2024-09-14T12:01:18.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.303+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.U4SV29fYJbyWPSh-R83W-944y9MNF9k_0 2024-09-14T12:01:18.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.303+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14195140094976185824', time=2024-09-14T13:33:35.531101+0000, chain.objs.size()=1 2024-09-14T12:01:18.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.303+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.zaChUZh2iSC6Wu5YW4CQpteIx9S2HJj_0 2024-09-14T12:01:18.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.303+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3971576901169265270', time=2024-09-14T13:33:35.533787+0000, chain.objs.size()=1 2024-09-14T12:01:18.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.303+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.GcD0FpT0sZ5nBZcIJY8EeLn70mPvfse_0 2024-09-14T12:01:18.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.303+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6441085003388267396', time=2024-09-14T13:33:38.960753+0000, chain.objs.size()=1 2024-09-14T12:01:18.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.303+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.297__shadow_.L-rJSrHYzoMvRBATwGa9txFCcOa3DMb_0 2024-09-14T12:01:18.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.303+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12271300424605482254', time=2024-09-14T13:33:44.546472+0000, chain.objs.size()=1 2024-09-14T12:01:18.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.303+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.302__shadow_.w4XmQbWvszRBtDwDvZ5Aeo411lsvxUH_0 2024-09-14T12:01:18.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.303+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8201009213339599560', time=2024-09-14T13:33:46.934318+0000, chain.objs.size()=1 2024-09-14T12:01:18.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.303+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.304__shadow_.5L1lxcq6zOvoMq1sXHcvdABaIrUFoMG_0 2024-09-14T12:01:18.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.303+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7721798558884148366', time=2024-09-14T13:34:52.004838+0000, chain.objs.size()=1 2024-09-14T12:01:18.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.303+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ENYa4orMXuDI8g159r7YeeVO_K_snP4_0 2024-09-14T12:01:18.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.304+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16653675004607281700', time=2024-09-14T13:34:52.084868+0000, chain.objs.size()=1 2024-09-14T12:01:18.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.304+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.FMNoJPig349oXcvcE_slMa8uD1NQM3h_0 2024-09-14T12:01:18.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.305+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8841476406970839896', time=2024-09-14T13:34:52.123337+0000, chain.objs.size()=1 2024-09-14T12:01:18.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.305+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.DbpmisuvRSc6osEvIpbNTe2GlaksHaD_0 2024-09-14T12:01:18.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.308+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4169496837253690139', time=2024-09-14T13:34:52.142707+0000, chain.objs.size()=1 2024-09-14T12:01:18.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.308+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.XUcKn6wLvci6JbXiODVV3leJS167l2a_0 2024-09-14T12:01:18.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.309+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8028944349480681885', time=2024-09-14T13:34:52.334737+0000, chain.objs.size()=1 2024-09-14T12:01:18.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.309+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Ivgvcq0J-LsR4RT-GCPREYT8qWqyN97_0 2024-09-14T12:01:18.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.309+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17348458538501996631', time=2024-09-14T13:34:52.456390+0000, chain.objs.size()=1 2024-09-14T12:01:18.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.309+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.JtGugX_iByIA5BRkeSKIS3IADFXOUJz_0 2024-09-14T12:01:18.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.309+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12089709886544136522', time=2024-09-14T13:34:52.458468+0000, chain.objs.size()=1 2024-09-14T12:01:18.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.309+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.s-PdPdAj0aCqdh4uyWBs1uTn5CxfRXB_0 2024-09-14T12:01:18.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.309+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15044292977325965678', time=2024-09-14T13:34:52.585665+0000, chain.objs.size()=1 2024-09-14T12:01:18.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.309+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.P0yp3UKD8cO1mssTEINXqP2CMLh4ZiQ_0 2024-09-14T12:01:18.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.309+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8906418001798775262', time=2024-09-14T13:34:53.149557+0000, chain.objs.size()=1 2024-09-14T12:01:18.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.309+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.zW0rMMxIg8z_FSUtjkbLtpRNlvoG9gD_0 2024-09-14T12:01:18.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.309+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4184024776604146695', time=2024-09-14T13:34:53.609819+0000, chain.objs.size()=1 2024-09-14T12:01:18.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.309+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Ul7SZCcnoLzD2THpqCzyNZ3DOvUVNdl_0 2024-09-14T12:01:18.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.309+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14210923976344141671', time=2024-09-14T13:34:53.616394+0000, chain.objs.size()=1 2024-09-14T12:01:18.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.309+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.H235gOwjbRz-fPzSMqHbOuEt47chgSG_0 2024-09-14T12:01:18.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.309+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4597783409733941253', time=2024-09-14T13:34:54.056032+0000, chain.objs.size()=1 2024-09-14T12:01:18.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.309+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.rgXl8YvO38l0rn6bkoJPJuui9chBfLa_0 2024-09-14T12:01:18.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.309+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6976108473060431194', time=2024-09-14T13:34:54.745328+0000, chain.objs.size()=1 2024-09-14T12:01:18.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.309+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.NAZjwwa_bs24lyUBKdxlS_VDuk5gYOC_0 2024-09-14T12:01:18.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.309+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17486229656237274065', time=2024-09-14T13:34:54.974782+0000, chain.objs.size()=1 2024-09-14T12:01:18.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.309+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.89fJNgJZJp7AsZkNBB-_JyhLybT5sgy_0 2024-09-14T12:01:18.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.310+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14365315390366377975', time=2024-09-14T13:34:55.230872+0000, chain.objs.size()=1 2024-09-14T12:01:18.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.310+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.HAiNki2zs6-KqdCoVTNUHVEH_LZBPkP_0 2024-09-14T12:01:18.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.312+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17895550776035737741', time=2024-09-14T13:34:55.621767+0000, chain.objs.size()=1 2024-09-14T12:01:18.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.312+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.nL3s83-geYGcEWflTpzAVofsKwylxQn_0 2024-09-14T12:01:18.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.312+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17410933050449383901', time=2024-09-14T13:34:56.199369+0000, chain.objs.size()=1 2024-09-14T12:01:18.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.312+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.YkBnWsOO3rgsvaSdhUCjnFaFP7qvLh8_0 2024-09-14T12:01:18.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.312+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14212017374052353392', time=2024-09-14T13:34:56.624304+0000, chain.objs.size()=1 2024-09-14T12:01:18.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.312+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.JscH5Z-fYoKHnW5UwOiPUTlg1s_Crp6_0 2024-09-14T12:01:18.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.312+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11695154107976224452', time=2024-09-14T13:34:56.747123+0000, chain.objs.size()=1 2024-09-14T12:01:18.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.312+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.gmumzs9RdieGauCBX9NyzXoPjH490_P_0 2024-09-14T12:01:18.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.312+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4809985602526997667', time=2024-09-14T13:34:56.812334+0000, chain.objs.size()=1 2024-09-14T12:01:18.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.312+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.0UI0KnFEMuH6QpKihM61G1COWnYzIvy_0 2024-09-14T12:01:18.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.312+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8310440965900140944', time=2024-09-14T13:34:56.970522+0000, chain.objs.size()=1 2024-09-14T12:01:18.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.312+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.MaW5FjTgptHvJJfel_jtyBFkhUsGZeq_0 2024-09-14T12:01:18.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.315+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8153424037151419663', time=2024-09-14T13:34:58.097006+0000, chain.objs.size()=1 2024-09-14T12:01:18.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.315+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.G9LQ7rEMkO9qiVrShS-KKThXKI6se0Q_0 2024-09-14T12:01:18.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.315+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4361112839445458295', time=2024-09-14T13:34:59.111003+0000, chain.objs.size()=1 2024-09-14T12:01:18.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.315+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.q2Tg1l9-A2_36pl2B_uHlYw64SnflI1_0 2024-09-14T12:01:18.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.315+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8256512170010949700', time=2024-09-14T13:34:59.111870+0000, chain.objs.size()=1 2024-09-14T12:01:18.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.315+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.QleJ6DhJbpcaCk6GLtEWEfq9l8XZeP2_0 2024-09-14T12:01:18.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.315+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15108928297786794637', time=2024-09-14T13:34:59.536347+0000, chain.objs.size()=1 2024-09-14T12:01:18.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.315+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.KIdBmCuGxPG5tJ4hhcr8velp1xqo9hF_0 2024-09-14T12:01:18.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.315+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6285712271853961894', time=2024-09-14T13:34:59.925779+0000, chain.objs.size()=1 2024-09-14T12:01:18.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.315+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.pZJjEoU2ZSLlyJOdplT1_ZQpeWsLNb5_0 2024-09-14T12:01:18.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.315+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14628628119713965740', time=2024-09-14T13:35:00.055820+0000, chain.objs.size()=1 2024-09-14T12:01:18.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.315+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.pJmQL0VsZDE1yOaC9l4R7S7I3fwH8mc_0 2024-09-14T12:01:18.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.315+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10054504261494784505', time=2024-09-14T13:35:00.114830+0000, chain.objs.size()=1 2024-09-14T12:01:18.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.315+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Z1KUhZv2lUs9lzoZX9-pKy6h6gxyg63_0 2024-09-14T12:01:18.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.315+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6680564609496947805', time=2024-09-14T13:35:00.693477+0000, chain.objs.size()=1 2024-09-14T12:01:18.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.315+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.EftxzoWwTFNUndePcz31CwQgJEGvqOZ_0 2024-09-14T12:01:18.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.315+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.96016671567418441', time=2024-09-14T13:35:01.054164+0000, chain.objs.size()=1 2024-09-14T12:01:18.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.315+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.i0SQJKavF6cACzCy-auh-EMmy8MYn_z_0 2024-09-14T12:01:18.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.319+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6196609381357893524', time=2024-09-14T13:35:01.358871+0000, chain.objs.size()=1 2024-09-14T12:01:18.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.319+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.TpHWZ-Ahg9Rka-r_KbdvwPQLoMYxMab_0 2024-09-14T12:01:18.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.320+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7736093322635401376', time=2024-09-14T13:35:01.936505+0000, chain.objs.size()=1 2024-09-14T12:01:18.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.320+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.E_L2KutQR6CvbeuQzU3RGUbIjvZrcHM_0 2024-09-14T12:01:18.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.320+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8683398600113266673', time=2024-09-14T13:35:02.122773+0000, chain.objs.size()=1 2024-09-14T12:01:18.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.320+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.G2M8oYjbwadourtNKjXv68OdWi6OSz6_0 2024-09-14T12:01:18.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.320+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16767087089127697990', time=2024-09-14T13:35:02.275299+0000, chain.objs.size()=1 2024-09-14T12:01:18.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.320+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.eye46bZGuGXjmzld_d32knSK94TTBeg_0 2024-09-14T12:01:18.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.320+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7592942525137499311', time=2024-09-14T13:35:41.667392+0000, chain.objs.size()=1 2024-09-14T12:01:18.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.320+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.BxeIwCjnkbt4-37mWjtvSi1CylnzY2t_0 2024-09-14T12:01:18.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.320+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3882199613802781213', time=2024-09-14T13:35:42.557270+0000, chain.objs.size()=1 2024-09-14T12:01:18.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.321+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.7BfkwjF0hujYRC7jxbbZTgW6i_cCkCX_0 2024-09-14T12:01:18.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.321+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10803481502639588660', time=2024-09-14T13:35:43.257703+0000, chain.objs.size()=1 2024-09-14T12:01:18.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.321+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.neI4wHneU3FvfQyy_8LZl6EH4W4TR62_0 2024-09-14T12:01:18.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.321+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10843488291463690887', time=2024-09-14T13:35:43.305118+0000, chain.objs.size()=1 2024-09-14T12:01:18.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.321+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.pV8uAY5_oojq0YEYTeLxzrn5iHf1W-C_0 2024-09-14T12:01:18.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.321+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9393002446955145911', time=2024-09-14T13:35:43.429635+0000, chain.objs.size()=1 2024-09-14T12:01:18.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.321+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.bQ844KBdjw4Syz7UUmWyOpoFephY083_0 2024-09-14T12:01:18.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.321+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5080751088314645343', time=2024-09-14T13:35:43.736192+0000, chain.objs.size()=1 2024-09-14T12:01:18.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.321+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.pYnG96zSu0TAIUycl41IJr2KZxvYxo1_0 2024-09-14T12:01:18.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.321+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16069909727887870893', time=2024-09-14T13:35:44.309428+0000, chain.objs.size()=1 2024-09-14T12:01:18.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.321+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.4GM1r2bcBTrrEDAnvMbpbwN_eR9T7IT_0 2024-09-14T12:01:18.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.323+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2263552835771577087', time=2024-09-14T13:35:45.204910+0000, chain.objs.size()=1 2024-09-14T12:01:18.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.323+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.pMoOzPGvRfdb-Mzjb3GHAqlUJK8C62w_0 2024-09-14T12:01:18.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.326+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/58887 2024-09-14T12:01:18.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=43, truncated=0, next_marker='' 2024-09-14T12:01:18.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5836416365283163403', time=2024-09-14T13:35:45.439738+0000, chain.objs.size()=1 2024-09-14T12:01:18.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.eFiCZxv2U2QXCH_sDNk89xV5rc5fSda_0 2024-09-14T12:01:18.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7280930131291571015', time=2024-09-14T13:35:45.497909+0000, chain.objs.size()=1 2024-09-14T12:01:18.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.DI2dN5zuiqFVR6lIsir1z1poVNyMhgG_0 2024-09-14T12:01:18.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5982770703024531249', time=2024-09-14T13:35:46.275868+0000, chain.objs.size()=1 2024-09-14T12:01:18.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.fWTnjFLghdB4OHsWpmpOLWPnHyQ_8IW_0 2024-09-14T12:01:18.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17398864535992876849', time=2024-09-14T13:35:46.277225+0000, chain.objs.size()=1 2024-09-14T12:01:18.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.3u0O0D-qavrIFrv_vCujEFrl0WzmenW_0 2024-09-14T12:01:18.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14687913791058488014', time=2024-09-14T13:35:46.277846+0000, chain.objs.size()=1 2024-09-14T12:01:18.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.GTvCzXLIuvwx4N2RgW-ZYGnX7hVKMiK_0 2024-09-14T12:01:18.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15221130832741997795', time=2024-09-14T13:35:46.433834+0000, chain.objs.size()=1 2024-09-14T12:01:18.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.FiXPS23K2nyX9CHibdbycgXWuEUJ9HB_0 2024-09-14T12:01:18.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2407818168824666558', time=2024-09-14T13:35:46.768075+0000, chain.objs.size()=1 2024-09-14T12:01:18.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.x1-ox1t9CPJp5SPW-_lUIoR6qNWIg0m_0 2024-09-14T12:01:18.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14006986492732488069', time=2024-09-14T13:35:47.087247+0000, chain.objs.size()=1 2024-09-14T12:01:18.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.HQzckRrxCKjIjLxeIRT5QMOc3pLcUCY_0 2024-09-14T12:01:18.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5739410460517006006', time=2024-09-14T13:35:47.900455+0000, chain.objs.size()=1 2024-09-14T12:01:18.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.CMBsixiZck3Qk2luTHJlTaZ3g54VIAi_0 2024-09-14T12:01:18.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12409891088643704396', time=2024-09-14T13:35:47.942230+0000, chain.objs.size()=1 2024-09-14T12:01:18.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.3rR9mhViL87D0dVwzgOKP6zpsY3Mlw__0 2024-09-14T12:01:18.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15596746595770988212', time=2024-09-14T13:35:48.195444+0000, chain.objs.size()=1 2024-09-14T12:01:18.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.lMHzIDZcz0sHK13cIvItxoSrhJubtS2_0 2024-09-14T12:01:18.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7545783211174185644', time=2024-09-14T13:35:48.255777+0000, chain.objs.size()=1 2024-09-14T12:01:18.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.329+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.jqhjD2xsYW7or8QDmDEp60XIKRm43MA_0 2024-09-14T12:01:18.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.332+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6478257147449236535', time=2024-09-14T13:35:48.443012+0000, chain.objs.size()=1 2024-09-14T12:01:18.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.332+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ndVmaNjM6Qq0dJlZSvYCo_JzjaeO-j0_0 2024-09-14T12:01:18.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.332+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18173982290828433664', time=2024-09-14T13:35:48.624246+0000, chain.objs.size()=1 2024-09-14T12:01:18.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.332+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.aF9vH-EzWGNGNF2Gl5Xv9dYhdetMZuI_0 2024-09-14T12:01:18.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.332+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5781331144694948535', time=2024-09-14T13:35:49.236127+0000, chain.objs.size()=1 2024-09-14T12:01:18.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.332+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.udPJ5d-4uXdGPEAVb-1nstvHawundSR_0 2024-09-14T12:01:18.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.332+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15661550819289946074', time=2024-09-14T13:35:49.378216+0000, chain.objs.size()=1 2024-09-14T12:01:18.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.332+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.bI6vFBJRy_l8jP1Sb7DoGRDV97Z7ru8_0 2024-09-14T12:01:18.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.332+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11393236078665252632', time=2024-09-14T13:35:49.589038+0000, chain.objs.size()=1 2024-09-14T12:01:18.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.332+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.iUYWuOUpyEmge6f-OWg6Q7-Kf-soRxQ_0 2024-09-14T12:01:18.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.332+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13496312461243127798', time=2024-09-14T13:35:49.770609+0000, chain.objs.size()=1 2024-09-14T12:01:18.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.332+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.fH5DMp5tgSSd7VydhAiNv7a-n4UP9Tf_0 2024-09-14T12:01:18.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.332+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12298249450741852108', time=2024-09-14T13:35:50.915134+0000, chain.objs.size()=1 2024-09-14T12:01:18.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.332+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.btSQtHiMTk120XTRnWGsJAiScudvW0i_0 2024-09-14T12:01:18.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.332+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9627983018139517894', time=2024-09-14T13:35:51.923025+0000, chain.objs.size()=1 2024-09-14T12:01:18.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.332+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.zw4gJip-m0KWlrV8zgfou54Mq_u7Yfq_0 2024-09-14T12:01:18.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.332+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4097300549952475052', time=2024-09-14T13:35:52.346169+0000, chain.objs.size()=1 2024-09-14T12:01:18.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.332+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.mn7C-Jw2kN-cE0MuoorHrM0aP8u3tBI_0 2024-09-14T12:01:18.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.332+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15667988980550933905', time=2024-09-14T13:35:52.754974+0000, chain.objs.size()=1 2024-09-14T12:01:18.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.332+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.a4zoI3XjFMA1nx0hluLWrheCmVZ23Ol_0 2024-09-14T12:01:18.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.332+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7490361603967495597', time=2024-09-14T13:35:52.767533+0000, chain.objs.size()=1 2024-09-14T12:01:18.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.332+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.1-m3GwD34rIK9jjNi2pshi3UI8i1oMw_0 2024-09-14T12:01:18.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.336+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15991015614308393480', time=2024-09-14T13:36:39.339344+0000, chain.objs.size()=1 2024-09-14T12:01:18.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.336+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.372__shadow_.q77HszfKRFHgCjWF2bbav7kiy3X4VBi_0 2024-09-14T12:01:18.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.337+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11985121638718083835', time=2024-09-14T13:38:18.014707+0000, chain.objs.size()=1 2024-09-14T12:01:18.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.337+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.459__shadow_.OeX67veY92sq_6Bp7sCgaQhwMetq-o9_0 2024-09-14T12:01:18.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.337+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5897868031354721361', time=2024-09-14T13:38:29.766287+0000, chain.objs.size()=1 2024-09-14T12:01:18.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.337+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.467__shadow_.v-PlcUucxbv8-lQpfEPOVOkTWjNoF0b_0 2024-09-14T12:01:18.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.337+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6351741902081494646', time=2024-09-14T13:38:42.828892+0000, chain.objs.size()=1 2024-09-14T12:01:18.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.337+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.484__shadow_.ynPkAs2fcujYH3akVkRCsNkQoHU7y2M_0 2024-09-14T12:01:18.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.337+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9665554612317281816', time=2024-09-14T13:38:58.839037+0000, chain.objs.size()=1 2024-09-14T12:01:18.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.337+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.497__shadow_.sDzlz4Pp5A4qZXhC6Ah0hAziaz0Ad2i_0 2024-09-14T12:01:18.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.337+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15985091753635927325', time=2024-09-14T13:39:00.794546+0000, chain.objs.size()=1 2024-09-14T12:01:18.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.337+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.499__shadow_.QMkhN9osalIRJ4xCTeCRmU33RkQLei__0 2024-09-14T12:01:18.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.337+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16642729716640278539', time=2024-09-14T13:39:34.750593+0000, chain.objs.size()=6 2024-09-14T12:01:18.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.337+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.1 2024-09-14T12:01:18.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.337+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.2 2024-09-14T12:01:18.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.337+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.3 2024-09-14T12:01:18.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.337+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.4 2024-09-14T12:01:18.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.337+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.5 2024-09-14T12:01:18.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.341+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.6 2024-09-14T12:01:18.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.341+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15760429840523824950', time=2024-09-14T13:45:43.146499+0000, chain.objs.size()=1 2024-09-14T12:01:18.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.341+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:42GZErq57SaG1luiSrPorvfZradLf3w_.pNpBhDRadTY-xM-hIbIHWnwQzt9tEps_0 2024-09-14T12:01:18.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.343+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9061237721901393310', time=2024-09-14T13:45:45.927682+0000, chain.objs.size()=1 2024-09-14T12:01:18.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.343+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:5npZeWx8vNEDE8R3SFMHbTDzg0KcheM_.s3hwJGNcZGmd_Bht3CyQYHxXdSaQNXe_0 2024-09-14T12:01:18.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.343+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10716713284441137312', time=2024-09-14T13:45:48.395187+0000, chain.objs.size()=1 2024-09-14T12:01:18.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.343+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.571__shadow:6WPQhdrvozTjdcMgoIbvJADaxBI5oku_.kE7Pmh_xvGvBNtGeGRNKO0jE6dBKJD-_0 2024-09-14T12:01:18.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.343+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18134912084934464192', time=2024-09-14T13:46:03.982660+0000, chain.objs.size()=1 2024-09-14T12:01:18.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.343+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.577__shadow:BokX52WIucSwqK5Fxt3eEJcqvVZO2bP_.44sBW7rSdKDblG6UUzjME3xbWz9nT8M_0 2024-09-14T12:01:18.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.343+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16460308778808698637', time=2024-09-14T13:47:12.033949+0000, chain.objs.size()=1 2024-09-14T12:01:18.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.343+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.581__shadow:s7Wm3hGN2MGsRjpyFzOj3bYNHhCJBiW_.qbAwcssbUDH2BL1BiDG12iyxmcrU1pm_0 2024-09-14T12:01:18.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.343+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16419275688780555027', time=2024-09-14T13:47:12.380964+0000, chain.objs.size()=1 2024-09-14T12:01:18.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.343+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.581__shadow:VqAkxRUaK0oByVBmxatmd2srWu1m6gv_.maGy89MMbip7Cwj8UlRVtNNVwDQSN-v_0 2024-09-14T12:01:18.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.343+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13209862022990892626', time=2024-09-14T13:47:14.864317+0000, chain.objs.size()=1 2024-09-14T12:01:18.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.343+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.584__shadow:GVdyBPtwwBJXxoQMxVI6zxxrqYWyJoE_.4c1uhB7SdgH6o0hnNn66hLLqGhXQBPh_0 2024-09-14T12:01:18.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.343+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.893607226217347997', time=2024-09-14T13:47:21.914229+0000, chain.objs.size()=1 2024-09-14T12:01:18.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.343+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.588__shadow:0vxjNNWyNkxA69TMAGL6FuhQuFxX8Zm_.x72E_GIBQ3NmPsdS8ecUyGR0J8JlHgK_0 2024-09-14T12:01:18.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.343+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4864524419542418962', time=2024-09-14T13:47:21.958046+0000, chain.objs.size()=1 2024-09-14T12:01:18.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.343+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.588__shadow:lCBUTGSVY.LdF33LYuLkyW682AZbn3W_.IZ349Cb6UR_0r7f5j791GlfNvJMq029_0 2024-09-14T12:01:18.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.343+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14977476966792517962', time=2024-09-14T13:47:30.794597+0000, chain.objs.size()=1 2024-09-14T12:01:18.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.343+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.597__shadow_.LeVqNF4VJqJtuyaWvxThI0k3D7BY32m_0 2024-09-14T12:01:18.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.345+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10645630630744902565', time=2024-09-14T13:53:11.427728+0000, chain.objs.size()=1 2024-09-14T12:01:18.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.345+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.649__shadow_.RuQCIjt6-Px69GjLzKC5aV3biZPKalj_0 2024-09-14T12:01:18.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.345+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16001236348507506741', time=2024-09-14T13:55:39.042342+0000, chain.objs.size()=1 2024-09-14T12:01:18.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.345+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.740__shadow_.2Zm1JOP9fdx213AywnpF-MsDzlc8o9A_0 2024-09-14T12:01:18.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.345+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15665494149816998984', time=2024-09-14T13:58:21.303313+0000, chain.objs.size()=1 2024-09-14T12:01:18.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.345+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.773__shadow_.SvY_NZftvtBQOiS7U4FX-p12UnPMGxU_0 2024-09-14T12:01:18.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.349+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:18.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.351+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T12:01:18.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.352+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:18.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.353+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:18.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.354+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44240' 2024-09-14T12:01:18.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.354+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7886351861298084825', time=2024-09-14T13:27:43.652356+0000, chain.objs.size()=2 2024-09-14T12:01:18.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.354+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.159__shadow_.DrASLGhRYuxz9VIWtkW_ds65vjsSmj1_0 2024-09-14T12:01:18.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.354+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.159__shadow_.DrASLGhRYuxz9VIWtkW_ds65vjsSmj1_1 2024-09-14T12:01:18.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.354+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='_sUd8S-SN97IK1XpIin1YbbzQp9-2C2-', time=2024-09-14T13:28:08.252131+0000, chain.objs.size()=1 2024-09-14T12:01:18.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.354+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.161__shadow_.Ejg5vhFNDR6wPb_qa1FrdcnBLTpO3jl_0 2024-09-14T12:01:18.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.354+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3139905144958063854', time=2024-09-14T13:31:37.005569+0000, chain.objs.size()=1 2024-09-14T12:01:18.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.354+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.235__shadow_.WtIw26dYL-UcAzbpa_wIFMxza1dFNDI_0 2024-09-14T12:01:18.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.354+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16390474608860906718', time=2024-09-14T13:32:07.145114+0000, chain.objs.size()=1 2024-09-14T12:01:18.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.354+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.260__shadow_.rpaMcnrqgjuSNN5iYJ59qA4mf3refLd_0 2024-09-14T12:01:18.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.354+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7050744112568861594', time=2024-09-14T13:32:47.846910+0000, chain.objs.size()=1 2024-09-14T12:01:18.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.354+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.8AmU0fLDRq_Ne4tvQ7rNvpSDesS3LXR_0 2024-09-14T12:01:18.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.354+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4989075745680768367', time=2024-09-14T13:32:48.066251+0000, chain.objs.size()=1 2024-09-14T12:01:18.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.354+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.wQIsgozELWtkYEiFtNPfH0knLxJ6hiJ_0 2024-09-14T12:01:18.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.354+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18236566756946531793', time=2024-09-14T13:32:49.188504+0000, chain.objs.size()=1 2024-09-14T12:01:18.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.354+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.9v9Ddw73yFBEAST05lLTPEzvhvLJLVF_0 2024-09-14T12:01:18.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.354+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.394742623992342594', time=2024-09-14T13:32:49.514403+0000, chain.objs.size()=1 2024-09-14T12:01:18.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.354+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.V4rLM3EkgUxuWHwGmTciH5HZC-LDvrZ_0 2024-09-14T12:01:18.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.354+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1008128086696736747', time=2024-09-14T13:32:49.620040+0000, chain.objs.size()=1 2024-09-14T12:01:18.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.354+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.NgKrXvKwJvtOco5UCNHjiu_jqKbNk1e_0 2024-09-14T12:01:18.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.354+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11009897592619237962', time=2024-09-14T13:32:50.023293+0000, chain.objs.size()=1 2024-09-14T12:01:18.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.354+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.6eVFAcOMSr-QBlLFHWEPitNSC8xhs7s_0 2024-09-14T12:01:18.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.354+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9607852484184397595', time=2024-09-14T13:32:50.069746+0000, chain.objs.size()=1 2024-09-14T12:01:18.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.354+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.HtTe5JJUiGgnPYRFQ7gpTSMWG5uNhZl_0 2024-09-14T12:01:18.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.357+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12731121059097052939', time=2024-09-14T13:32:50.077932+0000, chain.objs.size()=1 2024-09-14T12:01:18.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.357+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.VBLQIcxEZkAHpqYNVTg-eEvqaBvAies_0 2024-09-14T12:01:18.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.357+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17407425458501763762', time=2024-09-14T13:32:50.867658+0000, chain.objs.size()=1 2024-09-14T12:01:18.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.357+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.lQfwKb8ASqw9wBiqQIro1Ypqx3L5fw1_0 2024-09-14T12:01:18.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.357+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12848572753032348294', time=2024-09-14T13:32:51.249789+0000, chain.objs.size()=1 2024-09-14T12:01:18.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.357+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.5uJnL2BUpu4UgjsMhaXTrFrPClqa23N_0 2024-09-14T12:01:18.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.358+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1386636726111126994', time=2024-09-14T13:32:51.298152+0000, chain.objs.size()=1 2024-09-14T12:01:18.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.358+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.oreItoST4IVFWAd48WTF5iMp4kcLujs_0 2024-09-14T12:01:18.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.358+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4630353840431459484', time=2024-09-14T13:32:51.500509+0000, chain.objs.size()=1 2024-09-14T12:01:18.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.358+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.A0lNck0L6RxxwvSPjecxC8YNUwR2TCK_0 2024-09-14T12:01:18.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.358+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14487189861484895726', time=2024-09-14T13:32:51.602771+0000, chain.objs.size()=1 2024-09-14T12:01:18.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.358+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.3tTGpBkCEJwnUI2OHDhqL9NQTAgBLF6_0 2024-09-14T12:01:18.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.358+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3220077414299743196', time=2024-09-14T13:32:52.046481+0000, chain.objs.size()=1 2024-09-14T12:01:18.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.358+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.VHQ9e6VfeP7QOZaarZH5_8GQMidVDFB_0 2024-09-14T12:01:18.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.358+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16858629312503494402', time=2024-09-14T13:32:52.200778+0000, chain.objs.size()=1 2024-09-14T12:01:18.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.358+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.xiUJJfD_4o4O_94QiRCTrorxvyf4D6-_0 2024-09-14T12:01:18.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.358+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12901421064133568512', time=2024-09-14T13:32:52.485041+0000, chain.objs.size()=1 2024-09-14T12:01:18.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.358+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Si-EV5MwPXbXMh828nehPWgbcrI2S9f_0 2024-09-14T12:01:18.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.358+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12287436648520295876', time=2024-09-14T13:32:52.939092+0000, chain.objs.size()=1 2024-09-14T12:01:18.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.358+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ocm-KCMYvO63zhFV37u_ZO-RJXAZLSc_0 2024-09-14T12:01:18.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.358+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2769506972652506534', time=2024-09-14T13:32:53.095783+0000, chain.objs.size()=1 2024-09-14T12:01:18.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.358+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.P6sUX6GBVsTXLvnKwHOBzYe-j7krHFd_0 2024-09-14T12:01:18.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.359+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17433964975629200175', time=2024-09-14T13:32:53.525259+0000, chain.objs.size()=1 2024-09-14T12:01:18.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.359+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.tcnx3OEcv3CVOYlqznpkX7GV_jFA_jj_0 2024-09-14T12:01:18.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.360+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16410259412423080835', time=2024-09-14T13:32:53.701513+0000, chain.objs.size()=1 2024-09-14T12:01:18.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.360+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.1BdCS8GY5yDLn9pdZEojol6cENKQ52o_0 2024-09-14T12:01:18.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.360+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10661099158113819915', time=2024-09-14T13:32:53.931083+0000, chain.objs.size()=1 2024-09-14T12:01:18.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.360+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.x1dV39-aLRqALdYrpcSEgiRrsjWHeag_0 2024-09-14T12:01:18.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.361+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17876281782754886953', time=2024-09-14T13:32:53.982460+0000, chain.objs.size()=1 2024-09-14T12:01:18.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.361+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.v4UgtAH2low5c-yOZosYLz26_6jBOVs_0 2024-09-14T12:01:18.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.361+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6283069613631360618', time=2024-09-14T13:32:54.136581+0000, chain.objs.size()=1 2024-09-14T12:01:18.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.361+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.mtJ7r2Sz0RBFJXlPHiuXyhiaNMvNhrW_0 2024-09-14T12:01:18.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.363+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9508459078609462570', time=2024-09-14T13:32:54.934935+0000, chain.objs.size()=1 2024-09-14T12:01:18.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.363+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.rh_EkFtSFo-8nnR2GHshTkA04dZft9B_0 2024-09-14T12:01:18.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.363+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11176553444006826673', time=2024-09-14T13:32:55.057411+0000, chain.objs.size()=1 2024-09-14T12:01:18.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.363+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.AERdOfrCySu49ckggdk9VC3vvfpYYq8_0 2024-09-14T12:01:18.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.363+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6237004309413887777', time=2024-09-14T13:32:55.236909+0000, chain.objs.size()=1 2024-09-14T12:01:18.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.363+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.USXBzs9sGVB0D7_qL1vrQWIVKc1IwVA_0 2024-09-14T12:01:18.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.363+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6286701655377732560', time=2024-09-14T13:32:55.816151+0000, chain.objs.size()=1 2024-09-14T12:01:18.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.363+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.QMH7qQjCLzXOQvFRNzPnnwNA7-ua4FU_0 2024-09-14T12:01:18.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.363+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11607833035113618719', time=2024-09-14T13:32:55.987489+0000, chain.objs.size()=1 2024-09-14T12:01:18.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.363+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.YbVHrJ9CRLCoyQXa8jzRLBT8eVGRBnE_0 2024-09-14T12:01:18.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.363+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9973071072229539012', time=2024-09-14T13:32:56.554566+0000, chain.objs.size()=1 2024-09-14T12:01:18.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.363+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.GecwMnQMMHwk-PRF_LGI35fdCnwEdxc_0 2024-09-14T12:01:18.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.363+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1938838702600533829', time=2024-09-14T13:32:57.259090+0000, chain.objs.size()=1 2024-09-14T12:01:18.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.363+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.uWQGOlXxpiQi_mBZhG3iZxiUuo9_Ryq_0 2024-09-14T12:01:18.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.364+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13345959982320628317', time=2024-09-14T13:32:57.919268+0000, chain.objs.size()=1 2024-09-14T12:01:18.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.364+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.vTZgv6SrYnPkkJazYs2KJY0yLcUHGzY_0 2024-09-14T12:01:18.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.364+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2359269488640691904', time=2024-09-14T13:32:58.211782+0000, chain.objs.size()=1 2024-09-14T12:01:18.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.364+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.fozNQdUAuJYVFWSj4DRzO3f0p9Q9NuG_0 2024-09-14T12:01:18.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.364+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4222441364965206569', time=2024-09-14T13:32:58.416014+0000, chain.objs.size()=1 2024-09-14T12:01:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.364+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.aAGaT9dhDwOBLH8utp65m9-jcYawRWy_0 2024-09-14T12:01:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.366+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7362792724009929735', time=2024-09-14T13:32:58.555491+0000, chain.objs.size()=1 2024-09-14T12:01:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.366+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.0qp_8NqpdkUBx1aFnnNGQf9tmrAIktY_0 2024-09-14T12:01:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.366+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13475791571835631171', time=2024-09-14T13:32:58.744555+0000, chain.objs.size()=1 2024-09-14T12:01:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.366+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.EoHNvAqLJMceOvN08fpntKradobHQ9s_0 2024-09-14T12:01:18.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.367+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1764507252945878303', time=2024-09-14T13:33:02.988873+0000, chain.objs.size()=1 2024-09-14T12:01:18.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.367+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.267__shadow_.OJrUxLceq3H9z42dBAU6js9TQrB-yU-_0 2024-09-14T12:01:18.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.367+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14545701608026113630', time=2024-09-14T13:33:04.034740+0000, chain.objs.size()=1 2024-09-14T12:01:18.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.367+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.268__shadow_.Twq-sKh_1J47jK4_BKpsZCa1uptF1NX_0 2024-09-14T12:01:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.368+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4162245894316218162', time=2024-09-14T13:33:05.093410+0000, chain.objs.size()=1 2024-09-14T12:01:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.368+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.269__shadow_.KKvpYDcjzPb51cdkvJAV1bZehQ3SOGA_0 2024-09-14T12:01:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.368+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14195851160293713625', time=2024-09-14T13:33:08.495542+0000, chain.objs.size()=1 2024-09-14T12:01:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.368+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.272__shadow_.IoH4zUE4Cmg6_edmue54udhZ1GWlzjI_0 2024-09-14T12:01:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.368+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9016738862496934930', time=2024-09-14T13:33:24.915564+0000, chain.objs.size()=1 2024-09-14T12:01:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.368+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.287__shadow_.tjQPmmJ8WEVfnJw9fzrNTnuciAeCBkH_0 2024-09-14T12:01:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.368+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15705225618345507540', time=2024-09-14T13:33:27.090797+0000, chain.objs.size()=1 2024-09-14T12:01:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.368+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.289__shadow_.W_mkdJPhmiS8vu1_vibquRFiRvDD0yc_0 2024-09-14T12:01:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.368+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15101910427368487656', time=2024-09-14T13:33:33.201221+0000, chain.objs.size()=1 2024-09-14T12:01:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.368+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.YrgaeSu1FV77nEms2JOgNdoG-DZzmzB_0 2024-09-14T12:01:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.368+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17928854000460350420', time=2024-09-14T13:33:33.247725+0000, chain.objs.size()=1 2024-09-14T12:01:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.368+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.dtJQz4O06aRcMjddsH4DQnURDwYGYO8_0 2024-09-14T12:01:18.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.368+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2567445914806772484', time=2024-09-14T13:34:51.661917+0000, chain.objs.size()=1 2024-09-14T12:01:18.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.368+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.PajJZc5rX2XcKOQzJxDRiBKZRZ0wohg_0 2024-09-14T12:01:18.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.368+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17154368287220651912', time=2024-09-14T13:34:51.955640+0000, chain.objs.size()=1 2024-09-14T12:01:18.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.368+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.KhCmp0nvRFf-3PVPMycK3NNEg98HByX_0 2024-09-14T12:01:18.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.370+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8525525531653881564', time=2024-09-14T13:34:53.342142+0000, chain.objs.size()=1 2024-09-14T12:01:18.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.370+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.jCGzyHaWC_lpWwASw8omU6uRYRo26n8_0 2024-09-14T12:01:18.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.371+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16608073238362622521', time=2024-09-14T13:34:53.697293+0000, chain.objs.size()=1 2024-09-14T12:01:18.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.372+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.m6mniNJintbf6toAU_IlTw0a9ye4V5__0 2024-09-14T12:01:18.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.372+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11861477277183602603', time=2024-09-14T13:34:54.125018+0000, chain.objs.size()=1 2024-09-14T12:01:18.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.372+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.YvwIl_DYtXKC0cnFQyTSJMWYwV8wLp6_0 2024-09-14T12:01:18.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.372+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17446884205210226777', time=2024-09-14T13:34:55.112306+0000, chain.objs.size()=1 2024-09-14T12:01:18.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.372+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.D61HPejMBEMaZsDVwz4yBt_d1cQpGaa_0 2024-09-14T12:01:18.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.372+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1971524625872414399', time=2024-09-14T13:34:55.336604+0000, chain.objs.size()=1 2024-09-14T12:01:18.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.372+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.5SBIjzgXjKgaOAcO-tC1xOEeMlCgU8R_0 2024-09-14T12:01:18.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.372+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9797055844779584852', time=2024-09-14T13:34:55.535657+0000, chain.objs.size()=1 2024-09-14T12:01:18.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.372+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.CCHLzbkbeNmahoaipzIdsHziWLdAH6M_0 2024-09-14T12:01:18.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.372+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6801630170882298169', time=2024-09-14T13:34:56.499357+0000, chain.objs.size()=1 2024-09-14T12:01:18.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.372+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.8iWT7t5o-Dva7CHVZgpz0M9xSx08HQU_0 2024-09-14T12:01:18.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.372+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18262694815134657053', time=2024-09-14T13:34:56.612271+0000, chain.objs.size()=1 2024-09-14T12:01:18.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.372+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.aD3w60kce-w6eU7d9TPqzYu2j6tE-yo_0 2024-09-14T12:01:18.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.372+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3626600828490365837', time=2024-09-14T13:34:56.747902+0000, chain.objs.size()=1 2024-09-14T12:01:18.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.372+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.3q7QQIi-PV8faQ6eN7bvXmtZ-fEi4fx_0 2024-09-14T12:01:18.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.372+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1741787673116949067', time=2024-09-14T13:34:57.923860+0000, chain.objs.size()=1 2024-09-14T12:01:18.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.372+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.AI8r-bHHHDLz4o1LY6jsmmUDAtetcr-_0 2024-09-14T12:01:18.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.372+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.684821283587643821', time=2024-09-14T13:34:58.118491+0000, chain.objs.size()=1 2024-09-14T12:01:18.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.372+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.590SbXJk7fqMXyQHL7N1PTBBBMOMpeg_0 2024-09-14T12:01:18.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.375+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8644186654894381489', time=2024-09-14T13:34:58.211213+0000, chain.objs.size()=1 2024-09-14T12:01:18.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.375+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.IzgYH5kw0wc4OmqF6Q0TbkfGpsM0GsA_0 2024-09-14T12:01:18.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.376+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14047414077827871093', time=2024-09-14T13:34:58.413223+0000, chain.objs.size()=1 2024-09-14T12:01:18.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.376+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.DIvIoE7VxVmnUriQdEs_1VZ0tx-4-5e_0 2024-09-14T12:01:18.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.376+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8808712518695013161', time=2024-09-14T13:34:58.551786+0000, chain.objs.size()=1 2024-09-14T12:01:18.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.376+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_._wDhm_ITRKvXC6OpORJo_fVuDgUEPFK_0 2024-09-14T12:01:18.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.376+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17954154375466331361', time=2024-09-14T13:34:58.596874+0000, chain.objs.size()=1 2024-09-14T12:01:18.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.376+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Y0XBwGFKF6hI04y9y5X0MGtDhzT9ip8_0 2024-09-14T12:01:18.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.376+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3560042253868739208', time=2024-09-14T13:34:59.086349+0000, chain.objs.size()=1 2024-09-14T12:01:18.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.376+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_._UbmIaDfZ6a9RK4qLhNV35ceiMfN8cd_0 2024-09-14T12:01:18.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.376+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7682654186914517280', time=2024-09-14T13:34:59.207954+0000, chain.objs.size()=1 2024-09-14T12:01:18.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.376+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.DopwXttPM-q2NLNBQmlAeVHyPaqy1h1_0 2024-09-14T12:01:18.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.377+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9160401763690412058', time=2024-09-14T13:34:59.258849+0000, chain.objs.size()=1 2024-09-14T12:01:18.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.377+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.snCU8Le-7N_VX_l3OyCPcL_7BJH70BS_0 2024-09-14T12:01:18.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.377+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1182409815273403964', time=2024-09-14T13:34:59.281629+0000, chain.objs.size()=1 2024-09-14T12:01:18.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.377+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.sn-gy64_HAPGRE1aFrWFZLrbWs9Caba_0 2024-09-14T12:01:18.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.377+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13096124864884387561', time=2024-09-14T13:34:59.291637+0000, chain.objs.size()=1 2024-09-14T12:01:18.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.377+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.hg-zE3vrMx6Vym6FvSNX08EvATx2F1J_0 2024-09-14T12:01:18.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.377+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.981881671168628039', time=2024-09-14T13:34:59.374457+0000, chain.objs.size()=1 2024-09-14T12:01:18.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.377+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ZI8AbEYRTKJ98nqyevfz-xdaSDKLU9W_0 2024-09-14T12:01:18.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.377+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7412928196573711025', time=2024-09-14T13:34:59.469788+0000, chain.objs.size()=1 2024-09-14T12:01:18.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.377+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.L9rMVq43iYFYnOhUXhPkUEkUY2_6feq_0 2024-09-14T12:01:18.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.379+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.20999749796042444', time=2024-09-14T13:35:00.736158+0000, chain.objs.size()=1 2024-09-14T12:01:18.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.379+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.YQ9auwxXPrQeJJDRU7cHC9B3WtXWYI6_0 2024-09-14T12:01:18.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.379+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6154132713607636589', time=2024-09-14T13:35:01.063383+0000, chain.objs.size()=1 2024-09-14T12:01:18.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.379+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.pjvnsQg_FpTbsH3NKT7o5zJILFo9WM5_0 2024-09-14T12:01:18.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.379+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.620196258244003350', time=2024-09-14T13:35:01.365969+0000, chain.objs.size()=1 2024-09-14T12:01:18.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.379+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.1DqI0gOWVk9qrpjIIcvDeezoQztQFCB_0 2024-09-14T12:01:18.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.380+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8918365794517316919', time=2024-09-14T13:35:01.820121+0000, chain.objs.size()=1 2024-09-14T12:01:18.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.380+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.KRoXhpqFFabVqR1nkXMgfTc8HpuOoOC_0 2024-09-14T12:01:18.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.381+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7162840848766747254', time=2024-09-14T13:35:42.188882+0000, chain.objs.size()=1 2024-09-14T12:01:18.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.381+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.lef2S6eiNPTQmLCnuqa4C0lwEySrbDo_0 2024-09-14T12:01:18.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.381+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.954966322134378937', time=2024-09-14T13:35:42.213863+0000, chain.objs.size()=1 2024-09-14T12:01:18.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.381+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.2vf8APzHeAHD5eXBoCsGW7FLgoztHyq_0 2024-09-14T12:01:18.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.381+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10759047197098764266', time=2024-09-14T13:35:42.655866+0000, chain.objs.size()=1 2024-09-14T12:01:18.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.381+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.NIDQFjttZshrFaQQ9LAVdKoN_asdhwz_0 2024-09-14T12:01:18.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.381+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12151042752890617714', time=2024-09-14T13:35:43.280907+0000, chain.objs.size()=1 2024-09-14T12:01:18.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.381+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.DnITPDXOSe4q6bnmh2HRL3cEYeCTKvT_0 2024-09-14T12:01:18.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.381+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15202509394600294592', time=2024-09-14T13:35:43.281706+0000, chain.objs.size()=1 2024-09-14T12:01:18.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.381+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.29em8G-zhduZ4Lr1p9bD_KxwnJH32H9_0 2024-09-14T12:01:18.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.381+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.443265963670971848', time=2024-09-14T13:35:43.434563+0000, chain.objs.size()=1 2024-09-14T12:01:18.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.381+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.7wNupfof6G3MTnmXxo2n8_TUXN_lq1e_0 2024-09-14T12:01:18.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.381+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1149268342730411698', time=2024-09-14T13:35:44.036774+0000, chain.objs.size()=1 2024-09-14T12:01:18.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.381+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.2TJOugh8LXrddH-R5kST8faaPhdc8YR_0 2024-09-14T12:01:18.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.381+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10881107549414009144', time=2024-09-14T13:35:44.154307+0000, chain.objs.size()=1 2024-09-14T12:01:18.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.381+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Xxx5N_mCLUgezfY52pwiS0pALku4oDf_0 2024-09-14T12:01:18.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.381+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6729333891664973690', time=2024-09-14T13:35:44.184106+0000, chain.objs.size()=1 2024-09-14T12:01:18.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.381+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.NWWlrpiMafz8JkYJNc2fN2jlnz4y8I-_0 2024-09-14T12:01:18.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.383+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6710175438822457430', time=2024-09-14T13:35:44.964552+0000, chain.objs.size()=1 2024-09-14T12:01:18.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.383+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.T7Nl14n7oguQXpSiHbxYQEdirQ5EbjC_0 2024-09-14T12:01:18.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.383+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8561092088411079411', time=2024-09-14T13:35:45.532530+0000, chain.objs.size()=1 2024-09-14T12:01:18.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.383+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ieKrJbSRAuPsVneyZw0z2DjqfyMMMN5_0 2024-09-14T12:01:18.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.384+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15124570830674934024', time=2024-09-14T13:35:45.842465+0000, chain.objs.size()=1 2024-09-14T12:01:18.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.384+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.MHc7xMDbtB6JLZQe-pKj6aLMneffK0V_0 2024-09-14T12:01:18.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.385+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8802094154228512741', time=2024-09-14T13:35:46.316559+0000, chain.objs.size()=1 2024-09-14T12:01:18.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.385+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Ee3_04Bh4UEI2akOvxUN5qu-vb-yR5r_0 2024-09-14T12:01:18.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.385+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10880898554669906378', time=2024-09-14T13:35:46.499832+0000, chain.objs.size()=1 2024-09-14T12:01:18.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.385+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.qI07z3CQwyYI3ln9c1W1-NPfmGBDNof_0 2024-09-14T12:01:18.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.385+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18437238188724033237', time=2024-09-14T13:35:46.594082+0000, chain.objs.size()=1 2024-09-14T12:01:18.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.385+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.tWQ8uuk4czIyLkPNy3z44k9un534hFr_0 2024-09-14T12:01:18.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.385+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5297258918583697555', time=2024-09-14T13:35:46.697801+0000, chain.objs.size()=1 2024-09-14T12:01:18.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.385+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Jm7CZ3xzVRkA52-dT-FiXAahmkVP6cW_0 2024-09-14T12:01:18.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.387+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10969269632846570514', time=2024-09-14T13:35:46.728943+0000, chain.objs.size()=1 2024-09-14T12:01:18.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.387+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.36tKx0p8HANHDcDyli_CqMs33K0JPtz_0 2024-09-14T12:01:18.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.387+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17454696199821082240', time=2024-09-14T13:35:47.118183+0000, chain.objs.size()=1 2024-09-14T12:01:18.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.387+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.hmbhckfeU9JUvkvca7HLOn-q7lVITH__0 2024-09-14T12:01:18.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.387+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8913368112135288734', time=2024-09-14T13:35:48.196252+0000, chain.objs.size()=1 2024-09-14T12:01:18.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.387+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.M0A4xYWHQfWSid--Ck1q_K0-J0B1rjR_0 2024-09-14T12:01:18.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.387+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12022143023952234662', time=2024-09-14T13:35:48.227710+0000, chain.objs.size()=1 2024-09-14T12:01:18.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.387+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.h1fU0kNXJzwIkRxAdMQCvEzaA6tasHw_0 2024-09-14T12:01:18.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.387+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15389378662722987137', time=2024-09-14T13:35:48.360495+0000, chain.objs.size()=1 2024-09-14T12:01:18.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.387+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.PlbwIkTJfIpNHYIeN1lXlmDQQfEY8j__0 2024-09-14T12:01:18.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.387+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10077572339844743840', time=2024-09-14T13:35:48.485172+0000, chain.objs.size()=1 2024-09-14T12:01:18.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.387+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.2mp7_ykd4jovfxTcmLQMpe4IjF0m2Gu_0 2024-09-14T12:01:18.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.389+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15401280818909402091', time=2024-09-14T13:35:48.573832+0000, chain.objs.size()=1 2024-09-14T12:01:18.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.389+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.UNkfP7ahH1udeV2e_AenwhY101pOiTM_0 2024-09-14T12:01:18.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.389+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11125448450150947708', time=2024-09-14T13:35:48.646552+0000, chain.objs.size()=1 2024-09-14T12:01:18.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.389+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Yl5gmoLEgXU5wOURyYyCKWWSZcbZlrt_0 2024-09-14T12:01:18.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.389+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11982272064531801491', time=2024-09-14T13:35:49.602651+0000, chain.objs.size()=1 2024-09-14T12:01:18.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.389+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.7rAYIa82E8kYwHpNz_uUYZ5LlL_T_B1_0 2024-09-14T12:01:18.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.392+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/44240 2024-09-14T12:01:18.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T12:01:18.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7069934494448113058', time=2024-09-14T13:35:50.012544+0000, chain.objs.size()=1 2024-09-14T12:01:18.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.kEsIXqUFlzcANztwLVWEPszrrjjSwPb_0 2024-09-14T12:01:18.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8205930272905447899', time=2024-09-14T13:35:50.226184+0000, chain.objs.size()=1 2024-09-14T12:01:18.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.m9wS6Z1tlGNlqjrOFNLyUPD2xNU16bL_0 2024-09-14T12:01:18.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5531595224599632755', time=2024-09-14T13:35:50.597176+0000, chain.objs.size()=1 2024-09-14T12:01:18.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.axOqOmRU3P_WHwf_zkUQO99BKXuDsyt_0 2024-09-14T12:01:18.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17132201499778363924', time=2024-09-14T13:35:50.724129+0000, chain.objs.size()=1 2024-09-14T12:01:18.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.6mDAI0-swD3Jp1Rqs3BEmGbXZi0EHzL_0 2024-09-14T12:01:18.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12206070450540320', time=2024-09-14T13:35:51.599073+0000, chain.objs.size()=1 2024-09-14T12:01:18.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ES69Jln5Qyk4Ai8pC7s37lP3czY5r-H_0 2024-09-14T12:01:18.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7912502871971051749', time=2024-09-14T13:35:51.965911+0000, chain.objs.size()=1 2024-09-14T12:01:18.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.3JsXRa62_aN4uDwXUrabdP_B0bBZsSh_0 2024-09-14T12:01:18.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1710655910955525410', time=2024-09-14T13:35:52.258658+0000, chain.objs.size()=1 2024-09-14T12:01:18.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.K3Wl2gV4xZkzMqAh6FhYijVUw7_RCbO_0 2024-09-14T12:01:18.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.278026867724838492', time=2024-09-14T13:35:52.259571+0000, chain.objs.size()=1 2024-09-14T12:01:18.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.28xZodS7RCvqYYv74zXF58FdfcytNDW_0 2024-09-14T12:01:18.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2338804840122558894', time=2024-09-14T13:35:55.653686+0000, chain.objs.size()=1 2024-09-14T12:01:18.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.328__shadow_.chOcDbC2J4d940wKWS2GAB4GzDdP_-s_0 2024-09-14T12:01:18.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7163626305647484234', time=2024-09-14T13:36:22.029044+0000, chain.objs.size()=1 2024-09-14T12:01:18.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.354__shadow_.vebaXeJEd7XZku_9TzES_bna8F5iMJm_0 2024-09-14T12:01:18.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17250717443398222431', time=2024-09-14T13:38:15.020133+0000, chain.objs.size()=1 2024-09-14T12:01:18.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.457__shadow_.pyWTqNczqazd6kbjmMfkfOcMYxjrmNP_0 2024-09-14T12:01:18.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5181592134682517157', time=2024-09-14T13:38:49.076707+0000, chain.objs.size()=1 2024-09-14T12:01:18.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.394+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.487__shadow_.__ed6HJURaqphsX3NYKfrN5nK2gTXyO_0 2024-09-14T12:01:18.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.397+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4927827681979675692', time=2024-09-14T13:39:06.628151+0000, chain.objs.size()=1 2024-09-14T12:01:18.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.397+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.504__shadow:-Styd.oxB8SSr1oI0lFwKs5hFqmwg-w_.MvQogDl8WgMpFFuD7AaaxQ0tKLuN8vP_0 2024-09-14T12:01:18.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.397+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13585348564475107868', time=2024-09-14T13:45:52.786222+0000, chain.objs.size()=1 2024-09-14T12:01:18.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.397+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.574__shadow_.vMthsvdlEnFTAi6grA4s_-kwE6T0q-V_0 2024-09-14T12:01:18.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.397+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7944228811000363223', time=2024-09-14T13:47:21.889134+0000, chain.objs.size()=1 2024-09-14T12:01:18.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.397+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.588__shadow:MU6jed2IhzEh4HQHD1HkAQybFQr.YqP_.yPNBtdomw43Nr6cwzPFy26aVaO0WAsO_0 2024-09-14T12:01:18.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.397+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18346347130435645903', time=2024-09-14T13:51:44.846309+0000, chain.objs.size()=1 2024-09-14T12:01:18.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.397+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.621__shadow_.B0UCIlrr3G_60GnJ4FcRXDQ8EylQ2RQ_0 2024-09-14T12:01:18.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.397+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1139935827603712373', time=2024-09-14T13:54:10.923102+0000, chain.objs.size()=1 2024-09-14T12:01:18.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.397+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.680__shadow_.ENTC7EsyRkhVWL6eLoZzcwrCvUBgKro_0 2024-09-14T12:01:18.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.397+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9256090374498628408', time=2024-09-14T13:54:20.345146+0000, chain.objs.size()=1 2024-09-14T12:01:18.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.397+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.691__shadow:rSSKseT6HTEmSsNGy-fL-.WO4vF.LMJ_.scFpxtZM0F3_BdIahGuVhtp3voH3Vji_0 2024-09-14T12:01:18.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.397+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7083785230268184717', time=2024-09-14T13:54:23.291742+0000, chain.objs.size()=1 2024-09-14T12:01:18.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.397+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.694__shadow:CH3eHZmb1rJIVtyJaXGmbYmC4eFkBKR_.GHNgq3XrY1vd8yADqcREVAv6OXJQRjC_0 2024-09-14T12:01:18.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.402+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:18.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.404+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T12:01:18.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.406+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:18.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.406+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:18.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.407+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45284' 2024-09-14T12:01:18.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.407+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='_1O0aoqeLlnbBt_DP31D5X31dejXI22X', time=2024-09-14T13:28:13.473334+0000, chain.objs.size()=1 2024-09-14T12:01:18.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.407+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.162__shadow_.K_I5J7tnyXtbi-H5w0qykkyvf-_yvtt_0 2024-09-14T12:01:18.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.407+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='_2TovMl3C1UQGlyx_ny56ffWFl8ao2ou', time=2024-09-14T13:28:42.040742+0000, chain.objs.size()=2 2024-09-14T12:01:18.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.407+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.166__shadow_.EK68U_qZTgNFtKAajO9WEBSkw53E54-_0 2024-09-14T12:01:18.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.407+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.166__shadow_.EK68U_qZTgNFtKAajO9WEBSkw53E54-_1 2024-09-14T12:01:18.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.407+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6971697693962239709', time=2024-09-14T13:31:54.021659+0000, chain.objs.size()=1 2024-09-14T12:01:18.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.407+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.248__shadow_.V62N6-J1wlQGpDWoX-fNl7x7GsrnZlW_0 2024-09-14T12:01:18.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.407+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1338612725385363365', time=2024-09-14T13:31:57.315118+0000, chain.objs.size()=1 2024-09-14T12:01:18.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.407+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.251__shadow_.WFnU4hn911K3gQmY3nXJEAOknpnATSx_0 2024-09-14T12:01:18.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.407+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9123627469858383411', time=2024-09-14T13:31:58.419610+0000, chain.objs.size()=1 2024-09-14T12:01:18.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.407+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.252__shadow_.po3EqthjvpjUVP0eQIJNU7PtF63Oiep_0 2024-09-14T12:01:18.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.407+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1051555304720055943', time=2024-09-14T13:32:00.604989+0000, chain.objs.size()=1 2024-09-14T12:01:18.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.407+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.254__shadow_._IS7vtr-5M9__Yzuxkny4OaYUKUfkbG_0 2024-09-14T12:01:18.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.407+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15625131337630279346', time=2024-09-14T13:32:47.380437+0000, chain.objs.size()=1 2024-09-14T12:01:18.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.407+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.2eURW-uO3eGBRKprS9vg1RwVzAIam7T_0 2024-09-14T12:01:18.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.407+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9233182108837380427', time=2024-09-14T13:32:47.927753+0000, chain.objs.size()=1 2024-09-14T12:01:18.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.407+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.VEMtJt36OpV8ICDMpAo5GNYgCpmnqrN_0 2024-09-14T12:01:18.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.407+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7967320677212840439', time=2024-09-14T13:32:48.009163+0000, chain.objs.size()=1 2024-09-14T12:01:18.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.407+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.2CneojV5RTFc7kC39KbUCqVGQ4iPhlr_0 2024-09-14T12:01:18.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.407+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16638371413863156562', time=2024-09-14T13:32:48.387587+0000, chain.objs.size()=1 2024-09-14T12:01:18.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.407+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.BaJvlnmX7EKxRrh4z-FGpZn9euXC9-B_0 2024-09-14T12:01:18.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.407+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2901866296903368369', time=2024-09-14T13:32:49.172564+0000, chain.objs.size()=1 2024-09-14T12:01:18.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.407+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.TwHTFXz-ylamlk259gR6lgRhHHpSyKq_0 2024-09-14T12:01:18.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.409+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14710930441067598905', time=2024-09-14T13:32:49.358127+0000, chain.objs.size()=1 2024-09-14T12:01:18.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.409+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Hc0OlcjysR5IogR750GgYXnFKfVHPMW_0 2024-09-14T12:01:18.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.411+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6233228110257090045', time=2024-09-14T13:32:49.450630+0000, chain.objs.size()=1 2024-09-14T12:01:18.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.411+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.zwxU0blvtN1H7oBpLUAuOF9nFcobsWa_0 2024-09-14T12:01:18.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.411+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7404910748446999793', time=2024-09-14T13:32:49.662788+0000, chain.objs.size()=1 2024-09-14T12:01:18.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.411+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.x4L3l12vXTsTWWBA1QzwWK4HOd07geq_0 2024-09-14T12:01:18.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.411+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5251954815229345059', time=2024-09-14T13:32:50.577061+0000, chain.objs.size()=1 2024-09-14T12:01:18.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.411+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.gKUB4NHmFuiHFDF0XIy9bL4-_nZ3TQD_0 2024-09-14T12:01:18.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.411+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18087881880845902144', time=2024-09-14T13:32:51.068008+0000, chain.objs.size()=1 2024-09-14T12:01:18.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.411+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.RaqNJ8h-tVWKJPxw809gGpbjSiZQD05_0 2024-09-14T12:01:18.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.411+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4027695417370496942', time=2024-09-14T13:32:51.090879+0000, chain.objs.size()=1 2024-09-14T12:01:18.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.411+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.4ETYKxHfLm1SKVvxB8BSex9SENbgFu4_0 2024-09-14T12:01:18.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.411+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13414465768618139896', time=2024-09-14T13:32:51.141923+0000, chain.objs.size()=1 2024-09-14T12:01:18.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.411+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.7Y8riKzdkr1SzFIfUe-dV2-Rim8CJvT_0 2024-09-14T12:01:18.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.411+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6797958267232500835', time=2024-09-14T13:32:51.183468+0000, chain.objs.size()=1 2024-09-14T12:01:18.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.411+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.-IuUQIWveOnRfyE8Pu5dnAGCSM6LDbO_0 2024-09-14T12:01:18.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.411+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8053434150440644364', time=2024-09-14T13:32:51.200914+0000, chain.objs.size()=1 2024-09-14T12:01:18.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.411+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.UGiVJeW697LeT6vpKsaXheu6U9dwUsA_0 2024-09-14T12:01:18.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.411+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16759925718434120643', time=2024-09-14T13:32:52.049596+0000, chain.objs.size()=1 2024-09-14T12:01:18.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.411+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.br8j_n5ubOCgdQco_8EQ02_sFcCfCSF_0 2024-09-14T12:01:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.411+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9911442471448141125', time=2024-09-14T13:32:52.356748+0000, chain.objs.size()=1 2024-09-14T12:01:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.411+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.JEHHXAu_PIDJyIxhdESMvF0o62S-jig_0 2024-09-14T12:01:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.412+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15417362854945268358', time=2024-09-14T13:32:52.538649+0000, chain.objs.size()=1 2024-09-14T12:01:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.412+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.JsdIL1JGgQ12pKMMWiK0b_z01cyz_3N_0 2024-09-14T12:01:18.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.414+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15283001905652043459', time=2024-09-14T13:32:52.690468+0000, chain.objs.size()=1 2024-09-14T12:01:18.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.414+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.DFkHs0ntDKR-Lu410URiufFE11vsCn2_0 2024-09-14T12:01:18.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.415+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1640955865296026059', time=2024-09-14T13:32:52.710331+0000, chain.objs.size()=1 2024-09-14T12:01:18.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.415+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.hZ3N4-C6JGPowqbgk6OpAt0GUZCbslA_0 2024-09-14T12:01:18.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.415+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3297238649633581389', time=2024-09-14T13:32:53.498771+0000, chain.objs.size()=1 2024-09-14T12:01:18.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.415+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.b-2jVSRK6z20SrcOfJQizM6NVK-cfCf_0 2024-09-14T12:01:18.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.415+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4489629267470469930', time=2024-09-14T13:32:53.499561+0000, chain.objs.size()=1 2024-09-14T12:01:18.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.415+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.MstoipSNQaW7TwKZ8dCoaXmA9DCSUTu_0 2024-09-14T12:01:18.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.415+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6308539518765619544', time=2024-09-14T13:32:53.804668+0000, chain.objs.size()=1 2024-09-14T12:01:18.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.415+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ZScZGYXMhjnvw5MOz6MYkQ7Tjd6zR_G_0 2024-09-14T12:01:18.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.415+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16131537922791683163', time=2024-09-14T13:32:54.017756+0000, chain.objs.size()=1 2024-09-14T12:01:18.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.415+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.fVWE16v9Ovh4LxiKolglcagO4obufPI_0 2024-09-14T12:01:18.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.415+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9868814218083408279', time=2024-09-14T13:32:55.335534+0000, chain.objs.size()=1 2024-09-14T12:01:18.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.415+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.R6NZjJXvNIFLozFru4smRBUtY7Nqet__0 2024-09-14T12:01:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.417+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7661452490470875622', time=2024-09-14T13:32:55.539809+0000, chain.objs.size()=1 2024-09-14T12:01:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.417+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.sqRrX_2WJBcT2DuMOWK1pHkNmL0CrUR_0 2024-09-14T12:01:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.417+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7142147330387835769', time=2024-09-14T13:32:56.314846+0000, chain.objs.size()=1 2024-09-14T12:01:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.417+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ZFkgYTKbRLiaQGg4CgOScZjS_I6MIFv_0 2024-09-14T12:01:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.417+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10507376437077690075', time=2024-09-14T13:32:56.557073+0000, chain.objs.size()=1 2024-09-14T12:01:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.417+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.PNUqOWw6uMGedi0-YSQUmuOHYno_1BV_0 2024-09-14T12:01:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.417+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6090181021998564709', time=2024-09-14T13:32:56.766945+0000, chain.objs.size()=1 2024-09-14T12:01:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.417+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.RsGzcSxfIRJRkYXV2k7YAWpSTu2_-8A_0 2024-09-14T12:01:18.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.418+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5347796858502410093', time=2024-09-14T13:32:56.953404+0000, chain.objs.size()=1 2024-09-14T12:01:18.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.418+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.zriXykAPgkLshUrxkSLIFRYPq27UDL1_0 2024-09-14T12:01:18.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.418+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12781711758806911587', time=2024-09-14T13:32:57.132932+0000, chain.objs.size()=1 2024-09-14T12:01:18.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.418+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.-N05L0VTFCuTK0YPLftSm86dr0fbB3s_0 2024-09-14T12:01:18.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.419+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5520461512795366115', time=2024-09-14T13:32:57.248340+0000, chain.objs.size()=1 2024-09-14T12:01:18.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.419+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ROkKero1TgznooOsDDJ6LZpPJf4HX3p_0 2024-09-14T12:01:18.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.419+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6386992621652035265', time=2024-09-14T13:32:57.815842+0000, chain.objs.size()=1 2024-09-14T12:01:18.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.419+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.pia_4sL95ZIQ_XjRauowT-eYXQcBaVl_0 2024-09-14T12:01:18.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.419+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6540021674271807057', time=2024-09-14T13:32:58.212298+0000, chain.objs.size()=1 2024-09-14T12:01:18.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.419+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.yGsHSU0NUHWiyN4au-fj6_j81kZyuIX_0 2024-09-14T12:01:18.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.419+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3085372310878904617', time=2024-09-14T13:32:58.367223+0000, chain.objs.size()=1 2024-09-14T12:01:18.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.419+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.8irxub0OCyTRcqQTZgNz5BlUoWgfGOc_0 2024-09-14T12:01:18.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.419+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11505294028857456659', time=2024-09-14T13:32:58.728469+0000, chain.objs.size()=1 2024-09-14T12:01:18.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.419+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.oyigP8pypTS_PnRt2NOq4FzA0Aw6L6I_0 2024-09-14T12:01:18.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.420+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13960188908040512240', time=2024-09-14T13:32:58.762440+0000, chain.objs.size()=1 2024-09-14T12:01:18.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.420+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.XEp6rqArWZc9FNipsImA79zsggMlLD5_0 2024-09-14T12:01:18.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.420+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16837079804738950799', time=2024-09-14T13:33:22.591936+0000, chain.objs.size()=1 2024-09-14T12:01:18.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.420+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.285__shadow_.w23bZrCOMO_sY0LeZJzW5WckvRMaoCO_0 2024-09-14T12:01:18.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.421+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18055622193463966626', time=2024-09-14T13:33:33.122393+0000, chain.objs.size()=1 2024-09-14T12:01:18.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.421+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.8Gs7BtNnxsjEUJLcylW-Ku8cYMJUddQ_0 2024-09-14T12:01:18.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.421+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17242766625768066430', time=2024-09-14T13:33:35.530911+0000, chain.objs.size()=1 2024-09-14T12:01:18.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.421+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.Ubob3i2vNMfoAViU9Do6Vy2181rLCOR_0 2024-09-14T12:01:18.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.423+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12448220570091372878', time=2024-09-14T13:33:40.034744+0000, chain.objs.size()=1 2024-09-14T12:01:18.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.423+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.298__shadow_.ARjJUwbZembThqCdxqPGOJWgAZFOjOC_0 2024-09-14T12:01:18.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.423+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4082292345748176417', time=2024-09-14T13:33:40.036374+0000, chain.objs.size()=1 2024-09-14T12:01:18.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.423+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.298__shadow_.nSgk63BrQLO0fSfvnHHsHS8JvjPshXe_0 2024-09-14T12:01:18.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.423+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10184822264157409571', time=2024-09-14T13:34:52.477407+0000, chain.objs.size()=1 2024-09-14T12:01:18.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.423+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Tx-c5qAKd0dOjZFzkFDHRjXrroXQCWM_0 2024-09-14T12:01:18.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.423+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14236023987410357259', time=2024-09-14T13:34:52.506661+0000, chain.objs.size()=1 2024-09-14T12:01:18.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.423+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.0jYlltK2zNTKBhRS2dTSkubdRG8pP3e_0 2024-09-14T12:01:18.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.423+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11095664250966366940', time=2024-09-14T13:34:53.245438+0000, chain.objs.size()=1 2024-09-14T12:01:18.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.423+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.DjhqRpbSvJCI1w7FbBVR42R3N1mBKeG_0 2024-09-14T12:01:18.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.423+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5020314045339682160', time=2024-09-14T13:34:53.814437+0000, chain.objs.size()=1 2024-09-14T12:01:18.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.423+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.6FyB7ubIvRPqfKGf9gC5N09inn0Ty9g_0 2024-09-14T12:01:18.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.423+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11681458464638885259', time=2024-09-14T13:34:53.909305+0000, chain.objs.size()=1 2024-09-14T12:01:18.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.423+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.7uYaAfjtxRXMCglRY34OQ4lfKhwgs9G_0 2024-09-14T12:01:18.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.423+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8369566182453316417', time=2024-09-14T13:34:53.994335+0000, chain.objs.size()=1 2024-09-14T12:01:18.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.423+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.LGbyD_vgZEgclDZOqhX0EZq5sUjh2rg_0 2024-09-14T12:01:18.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.425+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5153202393442171439', time=2024-09-14T13:34:54.094063+0000, chain.objs.size()=1 2024-09-14T12:01:18.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.425+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.im8U6PNdHiJF50IOJWk9UI3EMB9O20c_0 2024-09-14T12:01:18.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.425+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10058566269339371554', time=2024-09-14T13:34:54.124613+0000, chain.objs.size()=1 2024-09-14T12:01:18.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.425+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.-sd6dC8odKkNY9-RtTIen8bOVOL6L8B_0 2024-09-14T12:01:18.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.425+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9979063023698868438', time=2024-09-14T13:34:54.158006+0000, chain.objs.size()=1 2024-09-14T12:01:18.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.425+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.BHsv_WItcjkFQgYGCqXWjR7e4757Gyo_0 2024-09-14T12:01:18.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.426+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12966012296410080575', time=2024-09-14T13:34:54.867022+0000, chain.objs.size()=1 2024-09-14T12:01:18.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.426+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.XCQgg_UF54lwu5QOnEQ6jTIlQ32-afM_0 2024-09-14T12:01:18.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.427+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8277392254639232819', time=2024-09-14T13:34:55.194067+0000, chain.objs.size()=1 2024-09-14T12:01:18.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.427+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.KdZfAVlxlgvALy79rez--5mUFV8KQ3N_0 2024-09-14T12:01:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.428+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13979708233301668785', time=2024-09-14T13:34:55.739443+0000, chain.objs.size()=1 2024-09-14T12:01:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.428+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.tOY3weivXicN8oZs59chkiNrR8K9Nkn_0 2024-09-14T12:01:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.428+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.24369268202020142', time=2024-09-14T13:34:56.316780+0000, chain.objs.size()=1 2024-09-14T12:01:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.428+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.KOjpdz5FbtldEywJZ47xqAOW5DsPyu3_0 2024-09-14T12:01:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.428+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15347125712979938736', time=2024-09-14T13:34:56.365501+0000, chain.objs.size()=1 2024-09-14T12:01:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.428+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.vlrlMcnq30H9yQuZin66SKKSqgyjMFd_0 2024-09-14T12:01:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.428+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1558086363302716546', time=2024-09-14T13:34:56.369160+0000, chain.objs.size()=1 2024-09-14T12:01:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.428+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.U9o6yuZihWzstFF3ZIt3lhiiqAOqMS5_0 2024-09-14T12:01:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.428+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2061075040430418410', time=2024-09-14T13:34:56.866177+0000, chain.objs.size()=1 2024-09-14T12:01:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.428+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.i74HtJ5pQ9OgZT7PPtWk9lSy71qpdFW_0 2024-09-14T12:01:18.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.428+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13380528827547298764', time=2024-09-14T13:34:56.932536+0000, chain.objs.size()=1 2024-09-14T12:01:18.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.428+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.6Pa38vIWwUv1NzImuyKg3iLNyIoYoSL_0 2024-09-14T12:01:18.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.428+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12081391865663987986', time=2024-09-14T13:34:57.141140+0000, chain.objs.size()=1 2024-09-14T12:01:18.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.428+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.evfy9tebsXKXtkHhaZPXHd6n5mOhO32_0 2024-09-14T12:01:18.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.429+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10136451553778493192', time=2024-09-14T13:34:57.194168+0000, chain.objs.size()=1 2024-09-14T12:01:18.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.429+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Gzwd5WGMbM-dvGfCogpAGFfekXEwALU_0 2024-09-14T12:01:18.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.429+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3547643730870102387', time=2024-09-14T13:34:57.669061+0000, chain.objs.size()=1 2024-09-14T12:01:18.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.429+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ImSbnSyOOsuD0DCs-HJLgHGAQMs5BO6_0 2024-09-14T12:01:18.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.429+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15359809698918808747', time=2024-09-14T13:34:57.774231+0000, chain.objs.size()=1 2024-09-14T12:01:18.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.429+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.JPX-b_BeP5uH9S94fEDbik7mIjXx19o_0 2024-09-14T12:01:18.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.431+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11229548221081442850', time=2024-09-14T13:34:58.080494+0000, chain.objs.size()=1 2024-09-14T12:01:18.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.431+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ATt3-bjJY0Oq-vtRIIZ6qrWjc3BTgjL_0 2024-09-14T12:01:18.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.432+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2223759985237620432', time=2024-09-14T13:34:58.087854+0000, chain.objs.size()=1 2024-09-14T12:01:18.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.432+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.szFpsc9cMPicbsaZyMAtAHzqpYwLKV__0 2024-09-14T12:01:18.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.433+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18196516861345836497', time=2024-09-14T13:34:58.256264+0000, chain.objs.size()=1 2024-09-14T12:01:18.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.433+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.pnbBNMIZCLfJb-O_j2Yw_hSg8eMI9HZ_0 2024-09-14T12:01:18.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.434+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.844969386109565689', time=2024-09-14T13:34:58.318688+0000, chain.objs.size()=1 2024-09-14T12:01:18.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.434+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.cz45NBIZydx31eUwxNnXLto44qcRT_e_0 2024-09-14T12:01:18.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.434+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17876615847925389245', time=2024-09-14T13:34:58.327329+0000, chain.objs.size()=1 2024-09-14T12:01:18.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.434+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.7U2g2RZbLnRYk_ubKsljZk-up4hgSZ0_0 2024-09-14T12:01:18.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.434+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9639023998726706735', time=2024-09-14T13:34:58.409703+0000, chain.objs.size()=1 2024-09-14T12:01:18.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.434+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.AWmjpJuakZnBRWQQRMqQiY2saZUk-KV_0 2024-09-14T12:01:18.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.434+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9051666707521867452', time=2024-09-14T13:34:58.650822+0000, chain.objs.size()=1 2024-09-14T12:01:18.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.434+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.9xoRTKNQXBWGtEgLN8x4UfY-4Kr8fT7_0 2024-09-14T12:01:18.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.434+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17261609116868899188', time=2024-09-14T13:34:59.114992+0000, chain.objs.size()=1 2024-09-14T12:01:18.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.434+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.YtSnyAuD4B85AbAyHJzOqLFpL0_vT5C_0 2024-09-14T12:01:18.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.435+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3859705261673878970', time=2024-09-14T13:34:59.310893+0000, chain.objs.size()=1 2024-09-14T12:01:18.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.435+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.l_vAmW-kLrlw_h3wY1NJfta2xCxb73y_0 2024-09-14T12:01:18.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.435+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7367781442725067098', time=2024-09-14T13:34:59.474806+0000, chain.objs.size()=1 2024-09-14T12:01:18.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.435+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.f-vsvGuNDp1PLL9FBoMj3u0B_6O4DKv_0 2024-09-14T12:01:18.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.435+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5751565564339295277', time=2024-09-14T13:35:00.646315+0000, chain.objs.size()=1 2024-09-14T12:01:18.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.435+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.oEHSnsMEndUrrPJfjarSwQu3BD_JT8w_0 2024-09-14T12:01:18.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.435+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.103725440126515906', time=2024-09-14T13:35:00.753000+0000, chain.objs.size()=1 2024-09-14T12:01:18.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.435+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.2WwkjE4a7p7sFFirQ36oLBe0x1qpcWW_0 2024-09-14T12:01:18.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.437+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4628864950449787859', time=2024-09-14T13:35:01.519206+0000, chain.objs.size()=1 2024-09-14T12:01:18.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.437+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.wUQgO5ONuuhoVJkEtFxwOVFfA_H0A-0_0 2024-09-14T12:01:18.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.437+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6270672623948047239', time=2024-09-14T13:35:01.805786+0000, chain.objs.size()=1 2024-09-14T12:01:18.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.437+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.QVIVAxVB3zpgjlVN6gPg6WWtEoPOsw7_0 2024-09-14T12:01:18.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.438+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7554411998992388263', time=2024-09-14T13:35:02.123144+0000, chain.objs.size()=1 2024-09-14T12:01:18.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.438+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.8e4YqTp80Ba6sem295NT1Cnfv2eTLPR_0 2024-09-14T12:01:18.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.438+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13388566853023350642', time=2024-09-14T13:35:02.249031+0000, chain.objs.size()=1 2024-09-14T12:01:18.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.438+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ApMh0ugBkwnhQyUFKPagJxKrZ4oBoOf_0 2024-09-14T12:01:18.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.438+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2800581104491773483', time=2024-09-14T13:35:41.949752+0000, chain.objs.size()=1 2024-09-14T12:01:18.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.438+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.qADdLBrd9Z2v3Ar4FdK8bcE5BAF8BZf_0 2024-09-14T12:01:18.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.439+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14560695106147310121', time=2024-09-14T13:35:42.076263+0000, chain.objs.size()=1 2024-09-14T12:01:18.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.439+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ou4OKLBkXGfDUucw3g0LAPsUwT7er5s_0 2024-09-14T12:01:18.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.439+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3148186849458034901', time=2024-09-14T13:35:42.587461+0000, chain.objs.size()=1 2024-09-14T12:01:18.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.439+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.cW5hW4FarYUIEyoURLALvauCVljYxpU_0 2024-09-14T12:01:18.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.439+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13737809744960057446', time=2024-09-14T13:35:42.653680+0000, chain.objs.size()=1 2024-09-14T12:01:18.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.439+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.kfwNLN65sI9Ca7EsIq65bC5yISap3pi_0 2024-09-14T12:01:18.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.439+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4474172890659098848', time=2024-09-14T13:35:44.185913+0000, chain.objs.size()=1 2024-09-14T12:01:18.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.439+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.iLmhZBBJiMXssb_XxhKDlnDAWzqPg9H_0 2024-09-14T12:01:18.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.439+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2318899795862520854', time=2024-09-14T13:35:45.591130+0000, chain.objs.size()=1 2024-09-14T12:01:18.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.439+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.T1juNEl7PHaeLO3E3xxrx26rz7HkqzA_0 2024-09-14T12:01:18.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.439+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5773295019756797562', time=2024-09-14T13:35:46.277435+0000, chain.objs.size()=1 2024-09-14T12:01:18.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.439+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.YQpHwn2Lxe_yIixC8bqbz0cBTR7fvBu_0 2024-09-14T12:01:18.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.441+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6405108540334585915', time=2024-09-14T13:35:46.791346+0000, chain.objs.size()=1 2024-09-14T12:01:18.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.441+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.FRP82s_0Z1To9yKR-nkRtYZwwz2EljU_0 2024-09-14T12:01:18.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.442+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1238656893736771740', time=2024-09-14T13:35:46.812391+0000, chain.objs.size()=1 2024-09-14T12:01:18.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.442+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.DZIW61GFo5lVLMZBSGhpK2IV6fs4yUr_0 2024-09-14T12:01:18.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.443+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8716672899854277895', time=2024-09-14T13:35:46.813044+0000, chain.objs.size()=1 2024-09-14T12:01:18.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.443+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.HRJ09hwyvaJlfSgBiqP67IlDeI_9SwH_0 2024-09-14T12:01:18.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.444+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6268056268310977501', time=2024-09-14T13:35:46.872185+0000, chain.objs.size()=1 2024-09-14T12:01:18.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.444+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Bc3j_wpO2r3I7mGSVJ3fBuNb9SrLXXg_0 2024-09-14T12:01:18.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.444+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3089017866845627288', time=2024-09-14T13:35:46.967157+0000, chain.objs.size()=1 2024-09-14T12:01:18.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.444+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Nz2GqOAX8lZhlw8KGEbmWeP7Zrp0OH8_0 2024-09-14T12:01:18.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.444+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7166735007975927823', time=2024-09-14T13:35:47.220112+0000, chain.objs.size()=1 2024-09-14T12:01:18.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.444+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.kGgwErq350MQKBz0MJmg6-y64I1et1Z_0 2024-09-14T12:01:18.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.444+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9680685612744983444', time=2024-09-14T13:35:47.286912+0000, chain.objs.size()=1 2024-09-14T12:01:18.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.444+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.W_pBJKLPDOSVD-59fXuHvfzClg_8JmX_0 2024-09-14T12:01:18.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.444+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7636651048540174689', time=2024-09-14T13:35:47.972830+0000, chain.objs.size()=1 2024-09-14T12:01:18.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.444+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.NKgn_tsgFfaD5MEX3aEf-v5sSCaZwRH_0 2024-09-14T12:01:18.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.445+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14477128173316832098', time=2024-09-14T13:35:48.087419+0000, chain.objs.size()=1 2024-09-14T12:01:18.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.445+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.j7HxmWbSMEsksZbEjb_ig9GrMoixta7_0 2024-09-14T12:01:18.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.450+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/45284 2024-09-14T12:01:18.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=41, truncated=0, next_marker='' 2024-09-14T12:01:18.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8162416182046303494', time=2024-09-14T13:35:48.191580+0000, chain.objs.size()=1 2024-09-14T12:01:18.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.JCIXlFrlcrkv7LxLvst5AqrLrLTsPL0_0 2024-09-14T12:01:18.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15151814966323555138', time=2024-09-14T13:35:48.537553+0000, chain.objs.size()=1 2024-09-14T12:01:18.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.dle5XiFa91s2bG-7q5awOxsJU9q2TEM_0 2024-09-14T12:01:18.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8975489134770576327', time=2024-09-14T13:35:49.234497+0000, chain.objs.size()=1 2024-09-14T12:01:18.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.r-_G1iyVxpwXqKtsvnFCqUOxpFLA-fq_0 2024-09-14T12:01:18.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11697252619649008258', time=2024-09-14T13:35:49.378159+0000, chain.objs.size()=1 2024-09-14T12:01:18.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.KBE6gwdlee0oJ0YRFRkLJtIQQuUPfWh_0 2024-09-14T12:01:18.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14314539288352410025', time=2024-09-14T13:35:49.482508+0000, chain.objs.size()=1 2024-09-14T12:01:18.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.0tzC6ffK21divhX5Dho0vzmT8B3MC5p_0 2024-09-14T12:01:18.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3397008020260340383', time=2024-09-14T13:35:49.512653+0000, chain.objs.size()=1 2024-09-14T12:01:18.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.XZSwoCRBiTsh0M8Hb6uf3AEsfAyeO12_0 2024-09-14T12:01:18.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2940798388453203599', time=2024-09-14T13:35:49.728546+0000, chain.objs.size()=1 2024-09-14T12:01:18.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.qX0YTcIdKhRO_PMTc89j309uduKYccP_0 2024-09-14T12:01:18.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16572606714324025867', time=2024-09-14T13:35:49.906972+0000, chain.objs.size()=1 2024-09-14T12:01:18.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.6_NggHOPeb8rTyKITQyxIndqI-WO1g__0 2024-09-14T12:01:18.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5045277915614663007', time=2024-09-14T13:35:50.151820+0000, chain.objs.size()=1 2024-09-14T12:01:18.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.AEhWk_6AoPjmz6PsJ2xRS6Y3Xn77qkc_0 2024-09-14T12:01:18.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15578862123949793249', time=2024-09-14T13:35:50.780855+0000, chain.objs.size()=1 2024-09-14T12:01:18.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.qKDrObHEl9fyxRvRgU6QZk1ut__F5N3_0 2024-09-14T12:01:18.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4354933016046498617', time=2024-09-14T13:35:51.070160+0000, chain.objs.size()=1 2024-09-14T12:01:18.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.TRedZLs26yPfSSdoIgCMzfkYtrD54lB_0 2024-09-14T12:01:18.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8817568209263612919', time=2024-09-14T13:35:51.236307+0000, chain.objs.size()=1 2024-09-14T12:01:18.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.452+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.4XgjANKa0as3AvumsYnklKgxgAgg5Xd_0 2024-09-14T12:01:18.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.455+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14211694877466808217', time=2024-09-14T13:35:51.602014+0000, chain.objs.size()=1 2024-09-14T12:01:18.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.455+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.E3Ge3laaWIBbMPq_uiupQW34qXXwnmH_0 2024-09-14T12:01:18.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.457+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15256881930655623291', time=2024-09-14T13:35:52.131289+0000, chain.objs.size()=1 2024-09-14T12:01:18.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.457+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.jEA3ao46aOy_eMdB4eeS0ECyaUPsMeE_0 2024-09-14T12:01:18.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.457+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5553515184782337476', time=2024-09-14T13:35:52.387698+0000, chain.objs.size()=1 2024-09-14T12:01:18.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.457+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.C74PQYwndzB4PR57vw23z7JSBPpYOl3_0 2024-09-14T12:01:18.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.457+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10320346037700991228', time=2024-09-14T13:35:52.414849+0000, chain.objs.size()=1 2024-09-14T12:01:18.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.457+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.VGokDta-yrzosF_D4gmUsBMQYr-RGgF_0 2024-09-14T12:01:18.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.457+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5574172691726152604', time=2024-09-14T13:35:52.649568+0000, chain.objs.size()=1 2024-09-14T12:01:18.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.457+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.7UFn4a2aXJsIMjqn707ArKHpPtGvNpy_0 2024-09-14T12:01:18.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.457+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11603870020597396805', time=2024-09-14T13:36:35.386326+0000, chain.objs.size()=1 2024-09-14T12:01:18.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.457+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.368__shadow_.rJZGksTbjKKriCeTFOtc0oW07_t3aw9_0 2024-09-14T12:01:18.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.457+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7559924261137997014', time=2024-09-14T13:36:41.368870+0000, chain.objs.size()=1 2024-09-14T12:01:18.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.457+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.374__shadow_.JvpyANO4y0YSxsVu-p8CjWwjSgiQ80L_0 2024-09-14T12:01:18.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.457+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10888185225572431722', time=2024-09-14T13:37:44.322513+0000, chain.objs.size()=1 2024-09-14T12:01:18.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.457+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.431__shadow_.43YzG-UxjSYyhL1SroUwEw5wb6RK0wj_0 2024-09-14T12:01:18.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.457+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17068722082173931704', time=2024-09-14T13:38:29.770508+0000, chain.objs.size()=1 2024-09-14T12:01:18.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.457+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.467__shadow_.S3yEK3vspUP4sBxToHdKqTjK2csbT5I_0 2024-09-14T12:01:18.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.457+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4669478036634317829', time=2024-09-14T13:40:45.362273+0000, chain.objs.size()=3 2024-09-14T12:01:18.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.457+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.522__multipart_mymultipart.2~572E13ULzhqgRsTf8y0ZlnOwBOtf6YW.1 2024-09-14T12:01:18.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.457+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.522__multipart_mymultipart.2~572E13ULzhqgRsTf8y0ZlnOwBOtf6YW.2 2024-09-14T12:01:18.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.459+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.522__multipart_mymultipart.2~572E13ULzhqgRsTf8y0ZlnOwBOtf6YW.3 2024-09-14T12:01:18.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.459+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~tpaEKw5u5IzcoFP-ea0iCEPzHjcRtmY', time=2024-09-14T13:40:53.222721+0000, chain.objs.size()=1 2024-09-14T12:01:18.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.459+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~tpaEKw5u5IzcoFP-ea0iCEPzHjcRtmY.1 2024-09-14T12:01:18.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.462+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~jRdVjmGRFBdjkNZEZ15R_MMEwYz8DRM', time=2024-09-14T13:43:45.352350+0000, chain.objs.size()=1 2024-09-14T12:01:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.462+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.534__multipart_mymultipart.2~jRdVjmGRFBdjkNZEZ15R_MMEwYz8DRM.1 2024-09-14T12:01:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.462+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9428100807811047539', time=2024-09-14T13:44:37.605539+0000, chain.objs.size()=1 2024-09-14T12:01:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.462+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.551__shadow_.JZkryFXGPiBRhiPt9W-Be31X0ckQUdA_0 2024-09-14T12:01:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.462+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4003712271897460265', time=2024-09-14T13:44:46.185765+0000, chain.objs.size()=1 2024-09-14T12:01:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.462+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.553__shadow_.cPVRP2vbc0_2LxrQj0fyTwnZRUI-9nI_0 2024-09-14T12:01:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.462+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6296564210123773598', time=2024-09-14T13:45:29.524105+0000, chain.objs.size()=1 2024-09-14T12:01:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.462+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.564__shadow_.SgtRJWESGa8t2zmWxwXEqX7JH2wlztC_0 2024-09-14T12:01:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.462+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6167756724919865514', time=2024-09-14T13:45:51.317134+0000, chain.objs.size()=1 2024-09-14T12:01:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.462+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.573__shadow_.yWlp6x6eb2f2tWRsg4xe8npBcbbHLtV_0 2024-09-14T12:01:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.462+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5924515264957396607', time=2024-09-14T13:46:18.922422+0000, chain.objs.size()=1 2024-09-14T12:01:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.462+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:.cemlhfaCT58K11smVHCk3jqHVZKuWY_.oClmYJ_iCLyEt7Na_eAcvSYoGvRf0OT_0 2024-09-14T12:01:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.462+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10284708871128898741', time=2024-09-14T13:46:25.804927+0000, chain.objs.size()=1 2024-09-14T12:01:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.462+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:-sQ2TbGwLEFzSsq4wgYrTd-LLW04hZe_.eB9zm0he6dN9Qb0OYRNHh8BOeNXGF3Q_0 2024-09-14T12:01:18.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.462+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6297712371241037272', time=2024-09-14T13:46:28.030678+0000, chain.objs.size()=1 2024-09-14T12:01:18.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.462+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:SElnmSSYg-R3e-SZQre-2-MHP2-7sZo_.xBemSoBUtqDcq0tVXm-owojeXVuY4hW_0 2024-09-14T12:01:18.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.462+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14670784910829213354', time=2024-09-14T13:47:06.609118+0000, chain.objs.size()=4 2024-09-14T12:01:18.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.462+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.579__multipart_testobj.2~HS6iKgpIgZiY8GfHDItT5bKVh0qcGsD.1 2024-09-14T12:01:18.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.463+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.579__multipart_testobj.2~HS6iKgpIgZiY8GfHDItT5bKVh0qcGsD.2 2024-09-14T12:01:18.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.463+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.579__multipart_testobj.2~HS6iKgpIgZiY8GfHDItT5bKVh0qcGsD.3 2024-09-14T12:01:18.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.465+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.579__multipart_testobj.2~HS6iKgpIgZiY8GfHDItT5bKVh0qcGsD.4 2024-09-14T12:01:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.466+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12174815262929222339', time=2024-09-14T13:47:12.044556+0000, chain.objs.size()=1 2024-09-14T12:01:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.466+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.581__shadow:VqAkxRUaK0oByVBmxatmd2srWu1m6gv_.maGy89MMbip7Cwj8UlRVtNNVwDQSN-v_0 2024-09-14T12:01:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.466+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6730444170874246444', time=2024-09-14T13:47:12.091864+0000, chain.objs.size()=1 2024-09-14T12:01:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.466+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.581__shadow:VqAkxRUaK0oByVBmxatmd2srWu1m6gv_.maGy89MMbip7Cwj8UlRVtNNVwDQSN-v_0 2024-09-14T12:01:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.466+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15858705929530502740', time=2024-09-14T13:47:38.740475+0000, chain.objs.size()=1 2024-09-14T12:01:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.466+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.605__shadow_.9mtHcEAREC9rIdj0QDrMt3Mx4BsGZ4s_0 2024-09-14T12:01:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.466+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11835157734970068339', time=2024-09-14T13:53:59.323725+0000, chain.objs.size()=1 2024-09-14T12:01:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.466+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.667__shadow_.9lc-UY_zGTzpaBIMo5YPGicdn2VyRKE_0 2024-09-14T12:01:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.466+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1470090376145192008', time=2024-09-14T13:54:01.237421+0000, chain.objs.size()=1 2024-09-14T12:01:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.466+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.669__shadow_.h4aG7tf5xnLava8PwqIq_HsvzYc25XF_0 2024-09-14T12:01:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.466+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4980159358159365017', time=2024-09-14T13:54:02.336061+0000, chain.objs.size()=1 2024-09-14T12:01:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.466+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.671__shadow_.sC0LYu6_y1hNqgIsQVUURfgYleKSxRG_0 2024-09-14T12:01:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.466+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16663460900029635191', time=2024-09-14T13:54:42.297668+0000, chain.objs.size()=1 2024-09-14T12:01:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.466+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.712__multipart_file1.2~1iTMSUKCoNrq-Uu_enZ971UdrviOM5D.1 2024-09-14T12:01:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.466+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2090806821276441901', time=2024-09-14T13:55:23.927328+0000, chain.objs.size()=1 2024-09-14T12:01:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.466+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.735__shadow_.4lYmxZNUF5SNi2gjSRgm60HvJTmEei__0 2024-09-14T12:01:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.467+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9579980279815739418', time=2024-09-14T13:56:16.224085+0000, chain.objs.size()=1 2024-09-14T12:01:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.467+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.749__shadow_.KnSNBNxa89xsJIBGkTo9QZGiUle3U96_0 2024-09-14T12:01:18.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.472+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:18.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.474+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T12:01:18.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.476+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:18.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.476+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48094' 2024-09-14T12:01:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18255950164756500709', time=2024-09-14T13:31:57.313702+0000, chain.objs.size()=1 2024-09-14T12:01:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.251__shadow_.qCnMbc_p5mS99iihMZ42jpPWtGywqho_0 2024-09-14T12:01:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15084384772808016263', time=2024-09-14T13:32:07.144117+0000, chain.objs.size()=1 2024-09-14T12:01:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.260__shadow_.vxjga1JuZ_bfWSiCwQOiNzlsLfGK4q2_0 2024-09-14T12:01:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3518970760089977793', time=2024-09-14T13:32:48.195754+0000, chain.objs.size()=1 2024-09-14T12:01:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.f_vkFGjheDiJIbsh4UBV-ui4oZCPUc0_0 2024-09-14T12:01:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5036702271990153973', time=2024-09-14T13:32:48.245347+0000, chain.objs.size()=1 2024-09-14T12:01:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.nElHdbeqlSU-oYcFN1PpAeF9iPy0xQG_0 2024-09-14T12:01:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10517298449668773324', time=2024-09-14T13:32:48.351767+0000, chain.objs.size()=1 2024-09-14T12:01:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Ui5YNg2UyywgRiwEvkuMY7fIvK3gakf_0 2024-09-14T12:01:18.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14772532700608423488', time=2024-09-14T13:32:48.385999+0000, chain.objs.size()=1 2024-09-14T12:01:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.airE1CuFDAUylOwZuwt9gDiIeD__hOu_0 2024-09-14T12:01:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7371070919494160580', time=2024-09-14T13:32:49.019469+0000, chain.objs.size()=1 2024-09-14T12:01:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.RoMlySNvO0Fz1amuc32voiaS8rp39VM_0 2024-09-14T12:01:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13619187729850323910', time=2024-09-14T13:32:49.077202+0000, chain.objs.size()=1 2024-09-14T12:01:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.t-ZiRYjZzUsjVajA7cw_wGZWa3SXBPN_0 2024-09-14T12:01:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6896791340546687323', time=2024-09-14T13:32:50.027341+0000, chain.objs.size()=1 2024-09-14T12:01:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.053vuTSLoWbIBGZQZK83gfwSx2FL4I1_0 2024-09-14T12:01:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16076105631770239441', time=2024-09-14T13:32:50.567339+0000, chain.objs.size()=1 2024-09-14T12:01:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.F2Hm9ibi3NpVLhMM3HoIa_E7iGsc6tp_0 2024-09-14T12:01:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5504724296612253958', time=2024-09-14T13:32:50.865789+0000, chain.objs.size()=1 2024-09-14T12:01:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.g8-pdLLcck-1WjxfMiaqVOtHaR_BKVH_0 2024-09-14T12:01:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9894516371096658249', time=2024-09-14T13:32:52.815155+0000, chain.objs.size()=1 2024-09-14T12:01:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.477+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.NBXvCDSrI0IdU_pyy5KzwWhfQJISPsb_0 2024-09-14T12:01:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.480+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14164752280659226304', time=2024-09-14T13:32:52.879095+0000, chain.objs.size()=1 2024-09-14T12:01:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.480+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.9gJ0HxZ5h9iT0yTAUdRlGHm_mgfRWqa_0 2024-09-14T12:01:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.481+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1186446751050202238', time=2024-09-14T13:32:53.031770+0000, chain.objs.size()=1 2024-09-14T12:01:18.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.481+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.80cjgxlw7DHXCWMegrDVDa-qXXhLl00_0 2024-09-14T12:01:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.481+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10484684291567047914', time=2024-09-14T13:32:53.103139+0000, chain.objs.size()=1 2024-09-14T12:01:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.481+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.YUmJ2BeEElyC8cINFS5EmgNH3iaNL_-_0 2024-09-14T12:01:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.481+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17203243061053430516', time=2024-09-14T13:32:53.117768+0000, chain.objs.size()=1 2024-09-14T12:01:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.481+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.AXXug8HWzN8GQnpR3lSdTA3CLL9u13p_0 2024-09-14T12:01:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.481+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7662992409358311433', time=2024-09-14T13:32:53.550071+0000, chain.objs.size()=1 2024-09-14T12:01:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.481+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.np-g560bb9jcVTOjUkUdadfGGlXz9JZ_0 2024-09-14T12:01:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.481+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12845391488811098288', time=2024-09-14T13:32:53.917462+0000, chain.objs.size()=1 2024-09-14T12:01:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.481+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.G1IPtLLbvCHk3uBHx1x05pY3iKL24G7_0 2024-09-14T12:01:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.481+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15715038271623522217', time=2024-09-14T13:32:53.982449+0000, chain.objs.size()=1 2024-09-14T12:01:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.481+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.UHrUEwgQOMFeZwVEPhFBelx2HPEt1cY_0 2024-09-14T12:01:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.481+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11325010835384453226', time=2024-09-14T13:32:54.248472+0000, chain.objs.size()=1 2024-09-14T12:01:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.481+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.iv3_Y3lNG37PiyRA3nV7U6qI9v2eI1i_0 2024-09-14T12:01:18.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.481+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5210566270926187277', time=2024-09-14T13:32:54.521498+0000, chain.objs.size()=1 2024-09-14T12:01:18.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.481+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.FS3VBEvsEJNym4_pF19g_A4kkNPjfEG_0 2024-09-14T12:01:18.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.481+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14243775602898476174', time=2024-09-14T13:32:55.345563+0000, chain.objs.size()=1 2024-09-14T12:01:18.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.481+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.yxih8DUKJd6f5HMR6JhX5a-UO64WU4k_0 2024-09-14T12:01:18.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.485+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2667873228032353418', time=2024-09-14T13:32:55.376864+0000, chain.objs.size()=1 2024-09-14T12:01:18.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.485+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.2CDeJvTRF10GxFyjkjcK-uspzfMrerr_0 2024-09-14T12:01:18.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.485+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11385902776937907652', time=2024-09-14T13:32:55.689688+0000, chain.objs.size()=1 2024-09-14T12:01:18.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.485+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ZWEQCwBkb1ujoJaMBwtJkgkc9e3Lads_0 2024-09-14T12:01:18.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.485+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15182876211012620440', time=2024-09-14T13:32:55.764763+0000, chain.objs.size()=1 2024-09-14T12:01:18.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.485+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_._f1hmowuDqIwRhMbB-v5e2_gwghaoRM_0 2024-09-14T12:01:18.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.485+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6463617007642612088', time=2024-09-14T13:32:55.881429+0000, chain.objs.size()=1 2024-09-14T12:01:18.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.485+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Li5Yta3pnz4mrr_RyxlUSv9t8HRsPhz_0 2024-09-14T12:01:18.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.485+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6535097268900236138', time=2024-09-14T13:32:56.336522+0000, chain.objs.size()=1 2024-09-14T12:01:18.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.485+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.dqLQXhtpBgeJnu9PPa2hlyff-I9ZB1O_0 2024-09-14T12:01:18.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.485+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5069198126439424066', time=2024-09-14T13:32:56.880102+0000, chain.objs.size()=1 2024-09-14T12:01:18.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.485+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.hMtJhXECpmMXJ_5RypN7iSAMsxXxUAv_0 2024-09-14T12:01:18.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.485+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14827517431060423868', time=2024-09-14T13:32:56.990486+0000, chain.objs.size()=1 2024-09-14T12:01:18.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.485+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.BKndqS6qtcE8wNb3AxcSvI8l4GetygC_0 2024-09-14T12:01:18.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.486+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10870243411194123947', time=2024-09-14T13:32:57.249522+0000, chain.objs.size()=1 2024-09-14T12:01:18.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.486+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.MtK1V45eAbkDwnKFPh-YVyGXJfo05Rh_0 2024-09-14T12:01:18.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.486+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3028090150082126335', time=2024-09-14T13:32:57.283088+0000, chain.objs.size()=1 2024-09-14T12:01:18.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.486+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.tG-XJ8IjGVSgeMeq6C2VngyjkhkPuiu_0 2024-09-14T12:01:18.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.486+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6747197500519267758', time=2024-09-14T13:32:57.467939+0000, chain.objs.size()=1 2024-09-14T12:01:18.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.486+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.FAyBekYYdeCnsL5wkbYCtz8bmD4aSkG_0 2024-09-14T12:01:18.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.486+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8954672491600675734', time=2024-09-14T13:32:58.074519+0000, chain.objs.size()=1 2024-09-14T12:01:18.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.486+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.3xQISaSUFFBAiD__dDCbPFqjGsfzn4z_0 2024-09-14T12:01:18.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.488+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2544233346183833950', time=2024-09-14T13:32:58.195260+0000, chain.objs.size()=1 2024-09-14T12:01:18.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.488+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.AG-O_rfJ8G6vth0l6TJ-jy3f5zKRqMF_0 2024-09-14T12:01:18.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.488+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16845355244980100445', time=2024-09-14T13:32:58.312097+0000, chain.objs.size()=1 2024-09-14T12:01:18.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.488+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_._uncMLx2pXuD6x5vQ_Ro5EmyATkBOrr_0 2024-09-14T12:01:18.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.489+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15452341355210886244', time=2024-09-14T13:33:12.690239+0000, chain.objs.size()=1 2024-09-14T12:01:18.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.489+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.276__shadow_.WE7ThW_FqjKdQb_l8P6CttsNcIDxyHi_0 2024-09-14T12:01:18.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.489+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12169631918395513233', time=2024-09-14T13:33:12.698353+0000, chain.objs.size()=1 2024-09-14T12:01:18.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.489+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.276__shadow_.CM3yLY68MRFPd-IyxaNh1J6_hYrMdpl_0 2024-09-14T12:01:18.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.489+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12396104449269653428', time=2024-09-14T13:33:28.192241+0000, chain.objs.size()=1 2024-09-14T12:01:18.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.489+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.290__shadow_.gt_2TTeAUrWK0hnUMnSYFYFa_ifVa-1_0 2024-09-14T12:01:18.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.489+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17709040902851373817', time=2024-09-14T13:33:33.256434+0000, chain.objs.size()=1 2024-09-14T12:01:18.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.489+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.kDtzit1P0jR-Yn2GLlmBKkm1RpsQUAl_0 2024-09-14T12:01:18.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.490+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13680714848350298023', time=2024-09-14T13:33:42.356399+0000, chain.objs.size()=1 2024-09-14T12:01:18.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.490+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.300__shadow_.KrFcDKsDa71KU_H36tL_kYw3Y0dodNh_0 2024-09-14T12:01:18.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.490+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3665619691943521791', time=2024-09-14T13:34:09.083300+0000, chain.objs.size()=1 2024-09-14T12:01:18.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.490+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.320__shadow:oaxmSqaAlTIDfI.AJu-.GfjMt5-FlSb_.VrL01cisadWB_L4L6s8-KKo9I3Z4tud_0 2024-09-14T12:01:18.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.490+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11503595218559003831', time=2024-09-14T13:34:51.692726+0000, chain.objs.size()=1 2024-09-14T12:01:18.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.490+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.BfRsq5d4_w5wI2ifUWSJR5_sxscampF_0 2024-09-14T12:01:18.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.490+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10221948402316190897', time=2024-09-14T13:34:52.023022+0000, chain.objs.size()=1 2024-09-14T12:01:18.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.490+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.xP3EyY-sMt2s6suc3NAriIdh_jb90Cl_0 2024-09-14T12:01:18.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.490+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1011746015070131573', time=2024-09-14T13:34:52.573897+0000, chain.objs.size()=1 2024-09-14T12:01:18.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.490+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.3vsW-df4lKn5lqRUOOmN_9XZwIVLqg7_0 2024-09-14T12:01:18.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.491+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.286813297108811288', time=2024-09-14T13:34:53.270675+0000, chain.objs.size()=1 2024-09-14T12:01:18.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.491+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.YCwQFjyH9X5jhMdEwvoaz7j0oCFMfkB_0 2024-09-14T12:01:18.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.492+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15535095759769899963', time=2024-09-14T13:34:55.103310+0000, chain.objs.size()=1 2024-09-14T12:01:18.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.492+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.XImvaKPwt205rNTvfJMT-MFOq2_pICT_0 2024-09-14T12:01:18.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.492+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16431886051961378033', time=2024-09-14T13:34:55.233594+0000, chain.objs.size()=1 2024-09-14T12:01:18.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.492+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.8P3nDIuJT775ytM4Z8tucsoDdWNLCTO_0 2024-09-14T12:01:18.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.493+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16233148487291929791', time=2024-09-14T13:34:56.169768+0000, chain.objs.size()=1 2024-09-14T12:01:18.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.493+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.BNd6EHqWL8Tg_Sy3RIP39MyqiQUkw8b_0 2024-09-14T12:01:18.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.493+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2634118719272511895', time=2024-09-14T13:34:56.669540+0000, chain.objs.size()=1 2024-09-14T12:01:18.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.493+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Tious88eZ9LUOQDRNpxE4bj3VjouyiH_0 2024-09-14T12:01:18.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.493+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12314849191154458056', time=2024-09-14T13:34:57.811765+0000, chain.objs.size()=1 2024-09-14T12:01:18.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.493+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.qX7hguzIbl7Jk5b2TJpQFmL0qaMiJeO_0 2024-09-14T12:01:18.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.495+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.357855743154064516', time=2024-09-14T13:34:57.965564+0000, chain.objs.size()=1 2024-09-14T12:01:18.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.495+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Zu0HAd_QdSjXT__WcbzObRl6VpVokLt_0 2024-09-14T12:01:18.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.495+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1097904164897359710', time=2024-09-14T13:34:58.100001+0000, chain.objs.size()=1 2024-09-14T12:01:18.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.495+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.WVca8ANt_XpqVQn_WyO9kVXzveJwipo_0 2024-09-14T12:01:18.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.497+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1459390768672530212', time=2024-09-14T13:34:58.420432+0000, chain.objs.size()=1 2024-09-14T12:01:18.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.497+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.3LvfwxRcnQjfJ-XXBvZCUzjFCqLHs4t_0 2024-09-14T12:01:18.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.497+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17157427955671252152', time=2024-09-14T13:34:59.117920+0000, chain.objs.size()=1 2024-09-14T12:01:18.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.497+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.1XweslGIXd7t44qp-PnD6sUdVAb7x5H_0 2024-09-14T12:01:18.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.497+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9278130538871689351', time=2024-09-14T13:35:00.598862+0000, chain.objs.size()=1 2024-09-14T12:01:18.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.497+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.RzhbqwEac46XtMFHxrnlb_0cO8GEh9m_0 2024-09-14T12:01:18.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.497+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7325239718596086981', time=2024-09-14T13:35:01.288483+0000, chain.objs.size()=1 2024-09-14T12:01:18.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.497+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.0OPfZTz5Os7dPLQ_uryBQh9avQ-dG_S_0 2024-09-14T12:01:18.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.497+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10267809923773160403', time=2024-09-14T13:35:02.015163+0000, chain.objs.size()=1 2024-09-14T12:01:18.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.497+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.A9UDqHN4w3TZ5F1pB-jGM8ABpZNKYY7_0 2024-09-14T12:01:18.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.497+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1252926286917673008', time=2024-09-14T13:35:02.154514+0000, chain.objs.size()=1 2024-09-14T12:01:18.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.497+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.OHkVrdt52h9dkga4YwWOvU9M92PiIQo_0 2024-09-14T12:01:18.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.498+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2525787066769096045', time=2024-09-14T13:35:02.440784+0000, chain.objs.size()=1 2024-09-14T12:01:18.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.498+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.vlqNRJUQ4xOjLvqbajYqjQvKnp8EacM_0 2024-09-14T12:01:18.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.498+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13908372400039510797', time=2024-09-14T13:35:41.978218+0000, chain.objs.size()=1 2024-09-14T12:01:18.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.498+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.hqFoap-X_1DVVSu1s7aLO_NH-MPM3WN_0 2024-09-14T12:01:18.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.498+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16552454600148147', time=2024-09-14T13:35:42.134722+0000, chain.objs.size()=1 2024-09-14T12:01:18.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.498+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.iMkRf_7bGTcco9HWFj2c1RS38AMeGcQ_0 2024-09-14T12:01:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.500+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2132291236442339768', time=2024-09-14T13:35:42.335660+0000, chain.objs.size()=1 2024-09-14T12:01:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.500+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_._ImDtE9BWKnQH13JYJL5gp71XRYxVdH_0 2024-09-14T12:01:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.500+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14983544003467686080', time=2024-09-14T13:35:42.501715+0000, chain.objs.size()=1 2024-09-14T12:01:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.500+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.vy8XzDMKrgZULfU831GQqVK6hoG7utq_0 2024-09-14T12:01:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.500+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1461384834513281910', time=2024-09-14T13:35:43.906263+0000, chain.objs.size()=1 2024-09-14T12:01:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.500+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.sMtS5QyGi3rNXp9bKSQRBMmcI54QwwO_0 2024-09-14T12:01:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.501+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16328564653307642230', time=2024-09-14T13:35:43.991899+0000, chain.objs.size()=1 2024-09-14T12:01:18.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.501+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.N7aOdErmgmmVaBXrxPWwJvooTA3Amif_0 2024-09-14T12:01:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.503+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17894203206616393493', time=2024-09-14T13:35:44.183318+0000, chain.objs.size()=1 2024-09-14T12:01:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.503+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.0n7mHlUwPX2vO31DXTBuHiyXxn5rDmC_0 2024-09-14T12:01:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.503+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10839246172756077116', time=2024-09-14T13:35:44.185416+0000, chain.objs.size()=1 2024-09-14T12:01:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.503+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.JtjyRDjT3uYnUbQ2BJb-Kc7Ui87Rmvo_0 2024-09-14T12:01:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.503+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8322019826630842207', time=2024-09-14T13:35:44.854261+0000, chain.objs.size()=1 2024-09-14T12:01:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.503+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.xrcdJK6tgS7FFOYLxxuUo_o38ZYX_eD_0 2024-09-14T12:01:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.503+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14598981573160921819', time=2024-09-14T13:35:45.329790+0000, chain.objs.size()=1 2024-09-14T12:01:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.503+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.SnFq1GEwSMIL5XCL8Xn-5TXlNqhFjLj_0 2024-09-14T12:01:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.503+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8018744123910894774', time=2024-09-14T13:35:45.585099+0000, chain.objs.size()=1 2024-09-14T12:01:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.503+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.tpjAu4Ktd_9GrUEBObODxty-T1577-q_0 2024-09-14T12:01:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.503+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10819755415693446830', time=2024-09-14T13:35:45.850730+0000, chain.objs.size()=1 2024-09-14T12:01:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.503+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.vZJenrAEmQeiOIuu4x8GIhTy1RH54Br_0 2024-09-14T12:01:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.503+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17712792940480574846', time=2024-09-14T13:35:46.282280+0000, chain.objs.size()=1 2024-09-14T12:01:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.503+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.wMdtROLTtPFXJdc7uDAkNJjvjpYm7iV_0 2024-09-14T12:01:18.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.504+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4235020756894513215', time=2024-09-14T13:35:47.117850+0000, chain.objs.size()=1 2024-09-14T12:01:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.504+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.BXPGESOkAy0Dlcs4r258O2PD45F-gEh_0 2024-09-14T12:01:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.504+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5117887794323139076', time=2024-09-14T13:35:48.072677+0000, chain.objs.size()=1 2024-09-14T12:01:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.504+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.WWsEOwTlYCn_WbnnHEC1Q00taayEO7B_0 2024-09-14T12:01:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.504+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15913719758613641270', time=2024-09-14T13:35:48.084801+0000, chain.objs.size()=1 2024-09-14T12:01:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.504+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.6nwN6ppuywdwSGkxgVaeWkWyZxqTSDy_0 2024-09-14T12:01:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.505+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16373176054620840528', time=2024-09-14T13:35:48.086180+0000, chain.objs.size()=1 2024-09-14T12:01:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.505+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.fmBOvaNoGkTRvtV6iw4SjVPIFMbkqc5_0 2024-09-14T12:01:18.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.507+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8547793416974995433', time=2024-09-14T13:35:49.207015+0000, chain.objs.size()=1 2024-09-14T12:01:18.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.507+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.xMRQaQhMzLccN28PdCVszmbrkq5ziUG_0 2024-09-14T12:01:18.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.507+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14790790517530906566', time=2024-09-14T13:35:49.876218+0000, chain.objs.size()=1 2024-09-14T12:01:18.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.507+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.JafYTbOIi12-LyAypjIWP_4_DqZXM0e_0 2024-09-14T12:01:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.507+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17076380161132319751', time=2024-09-14T13:35:50.202695+0000, chain.objs.size()=1 2024-09-14T12:01:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.507+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ywVvCo0_so2mP4JY65oATIsHOlQP9CH_0 2024-09-14T12:01:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.507+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1576286758210570051', time=2024-09-14T13:35:50.604907+0000, chain.objs.size()=1 2024-09-14T12:01:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.507+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.b1S6bLrr0cWkyegFF9nKdvX27v5j-DG_0 2024-09-14T12:01:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.507+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2298262282147906350', time=2024-09-14T13:35:51.383605+0000, chain.objs.size()=1 2024-09-14T12:01:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.507+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.g5yMfBnfN2c_FvfZwyPMBG9V7l88zDt_0 2024-09-14T12:01:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.507+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2079924504465238865', time=2024-09-14T13:35:52.258359+0000, chain.objs.size()=1 2024-09-14T12:01:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.507+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.u0SWVH4dud45P_nk-kx_qlcV-wY74cz_0 2024-09-14T12:01:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.507+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14651203561459973263', time=2024-09-14T13:35:52.477339+0000, chain.objs.size()=1 2024-09-14T12:01:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.507+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.uUQE4qewPiM34BZ4g4d2ZfKGoc2PMOi_0 2024-09-14T12:01:18.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.510+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16740513806850622252', time=2024-09-14T13:36:00.849810+0000, chain.objs.size()=1 2024-09-14T12:01:18.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.510+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.333__shadow_.w1-kGYeS55cqB4enRz-e8hX-qPD8Kcg_0 2024-09-14T12:01:18.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.510+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1283541779232659588', time=2024-09-14T13:38:42.838372+0000, chain.objs.size()=1 2024-09-14T12:01:18.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.510+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.484__shadow_.8YbGWjemdWBIUmBQdBcPdLF_sYxc5q6_0 2024-09-14T12:01:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.510+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8360889608455016836', time=2024-09-14T13:39:44.109698+0000, chain.objs.size()=1 2024-09-14T12:01:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.510+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.517__multipart_mymultipartcopy.2~4ZzXmmN43e7VOHd0r-bv9xGyytgd2m5.1 2024-09-14T12:01:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.510+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14947010240423912504', time=2024-09-14T13:44:37.162033+0000, chain.objs.size()=1 2024-09-14T12:01:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.510+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.551__shadow_.l1krYnubkk2wDktuRYltK--6PqEJL2D_0 2024-09-14T12:01:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.511+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5716014329997829585', time=2024-09-14T13:44:49.382135+0000, chain.objs.size()=1 2024-09-14T12:01:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.511+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.554__shadow_.j1HAUcoEH8vv7x_SHRX91hj4_HNzp8n_0 2024-09-14T12:01:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.511+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1331363541250762395', time=2024-09-14T13:45:04.535043+0000, chain.objs.size()=1 2024-09-14T12:01:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.511+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.557__shadow_.sekgktw0W-yTXkxYJ_4125r_M0debHD_0 2024-09-14T12:01:18.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.512+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12940589335635741035', time=2024-09-14T13:45:41.736717+0000, chain.objs.size()=1 2024-09-14T12:01:18.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.512+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:rocWRAq0eT5ObHEc5k-3iyzpY57hGuf_.iMVbdcdgIESzM45gGF17EScmlmFDno2_0 2024-09-14T12:01:18.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.512+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8851728103831484511', time=2024-09-14T13:45:46.312486+0000, chain.objs.size()=1 2024-09-14T12:01:18.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.512+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:69PC7xqiyvBNKzKCt9n6DHV5hMIs7J3_.fQis_k-CWaHH_uaO2sl_IGTJYChJ_V1_0 2024-09-14T12:01:18.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.512+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7922216005783073500', time=2024-09-14T13:45:57.947538+0000, chain.objs.size()=1 2024-09-14T12:01:18.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.512+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.575__shadow:IUTLCeIcEv9lwJbLo2.xJtT.alQNJKU_.8z93EeCvo3_vNFSnP4Nj0VHl4iJ87SL_0 2024-09-14T12:01:18.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.512+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15073419257534246295', time=2024-09-14T13:46:00.011846+0000, chain.objs.size()=1 2024-09-14T12:01:18.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.512+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.576__shadow_.7fjmkdSJrG7vZ1Jy8Yu7Mvvp2WqvqxY_0 2024-09-14T12:01:18.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.512+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5427849877143934345', time=2024-09-14T13:46:21.089454+0000, chain.objs.size()=1 2024-09-14T12:01:18.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.512+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:YnYgg.Yz0lMRYrnrzcWBhzEQvxgoR9e_.th3DjdF0V5VHecIgGQcXSwopQ7-f76R_0 2024-09-14T12:01:18.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.512+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11292222068315878486', time=2024-09-14T13:46:22.660737+0000, chain.objs.size()=1 2024-09-14T12:01:18.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.512+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:J4XOsY4jehSPOm.nYSJ3hFuBn07ob2X_.NV3QwpzV5YDZrcKi0-gtcfwu1-yaSKD_0 2024-09-14T12:01:18.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.513+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4123833375468516723', time=2024-09-14T13:46:28.740042+0000, chain.objs.size()=1 2024-09-14T12:01:18.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.513+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:Xwf8cxtYFpFEtoaOVIf3FEjHPmWtRok_.b864D0Rz2mBpCAbtJ0BRF7CdsS7SNxd_0 2024-09-14T12:01:18.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.513+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14426469655542684516', time=2024-09-14T13:46:28.997673+0000, chain.objs.size()=1 2024-09-14T12:01:18.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.513+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:qsaHYU5b4cJWIyDLhU4CJP4lt-aYabn_.FzQOv3hqsvXTuNNkqwoyXoSHK7tnptU_0 2024-09-14T12:01:18.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.514+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12813664877614145025', time=2024-09-14T13:47:09.462356+0000, chain.objs.size()=1 2024-09-14T12:01:18.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.514+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.580__shadow:PY5vU6aNGMIu34wPF5xkZjISrIJhSHo_.hJ_8aRvN4y17GsCgim5guG8jNjnBhCO_0 2024-09-14T12:01:18.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.514+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15168145442391861681', time=2024-09-14T13:47:13.400899+0000, chain.objs.size()=1 2024-09-14T12:01:18.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.514+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.583__shadow:5xnWr7TYRk6Dg9MXbizOze2eqWK1caJ_.ZyjckmV_NJYhZmZmbyGzurW9dP_RW1M_0 2024-09-14T12:01:18.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.514+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1367714335108423112', time=2024-09-14T13:54:24.240146+0000, chain.objs.size()=1 2024-09-14T12:01:18.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.514+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.695__shadow:Be5NaSrVHY99.HviZCNlP16reIRnpyP_.ifTT0jgBY3cp9KMEtvjBL6Tb_-QJ2Yr_0 2024-09-14T12:01:18.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.518+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/48094 2024-09-14T12:01:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.520+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T12:01:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.520+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2027598072481638960', time=2024-09-14T13:58:04.962567+0000, chain.objs.size()=1 2024-09-14T12:01:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.520+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.770__shadow_.4r3rTqXTKGyfszIR4_aZaUiISP9d7HZ_0 2024-09-14T12:01:18.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.521+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:18.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.523+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T12:01:18.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.525+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:18.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.525+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:18.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46624' 2024-09-14T12:01:18.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10641572464778609127', time=2024-09-14T13:27:26.803789+0000, chain.objs.size()=1 2024-09-14T12:01:18.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.148__shadow_.i_uQsbwuUs-sL4MjaCNoM71buAN-QmC_0 2024-09-14T12:01:18.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11396851941143228478', time=2024-09-14T13:31:37.006805+0000, chain.objs.size()=1 2024-09-14T12:01:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.235__shadow_.qrTLAkC-TArDqpxfnABlKfNIN7JPh3r_0 2024-09-14T12:01:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3405465151924833353', time=2024-09-14T13:31:42.812418+0000, chain.objs.size()=1 2024-09-14T12:01:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.239__shadow_.IxzLk6k3J66wgkoLss6VyUj67qoe_C4_0 2024-09-14T12:01:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.777185922326973343', time=2024-09-14T13:31:51.633885+0000, chain.objs.size()=1 2024-09-14T12:01:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.246__shadow_.zfs4IlJEk1omdIpHWWeonhZLGrMXnde_0 2024-09-14T12:01:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6376092463407068705', time=2024-09-14T13:31:51.634508+0000, chain.objs.size()=1 2024-09-14T12:01:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.246__shadow_.6WIbxDX6Jz62S43nJP0ijTH4x6iXzCo_0 2024-09-14T12:01:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16846316470477931375', time=2024-09-14T13:31:54.021605+0000, chain.objs.size()=1 2024-09-14T12:01:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.248__shadow_.A8LXesNMARiryqOAmMjY5lJsJ00KP5T_0 2024-09-14T12:01:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12316809689415628911', time=2024-09-14T13:32:00.611553+0000, chain.objs.size()=1 2024-09-14T12:01:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.254__shadow_.vt4idXB4ob29Tg57IsVPJlf2BWTnFan_0 2024-09-14T12:01:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1228354911005502871', time=2024-09-14T13:32:09.327391+0000, chain.objs.size()=1 2024-09-14T12:01:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.262__shadow_.MxSO1coHAwZQQ44kxfH7tZC96LQg-gU_0 2024-09-14T12:01:18.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6471426813950505944', time=2024-09-14T13:32:47.621957+0000, chain.objs.size()=1 2024-09-14T12:01:18.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.2simuMeBZWli7sogIu1YQaALvhKB_qi_0 2024-09-14T12:01:18.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17402919362595949066', time=2024-09-14T13:32:47.721062+0000, chain.objs.size()=1 2024-09-14T12:01:18.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.q1nzwYC5ryssfecNyzL6CyS4y2niWWj_0 2024-09-14T12:01:18.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7731550085709268851', time=2024-09-14T13:32:47.927320+0000, chain.objs.size()=1 2024-09-14T12:01:18.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.D6J8BXT4c36MJoz6jfWvEwKmsjsDSvK_0 2024-09-14T12:01:18.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10728553704284512616', time=2024-09-14T13:32:48.477083+0000, chain.objs.size()=1 2024-09-14T12:01:18.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.526+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Q4OEPmlDvQE6w1luuHohY18RGNccZtp_0 2024-09-14T12:01:18.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.529+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14526752212205213273', time=2024-09-14T13:32:49.760381+0000, chain.objs.size()=1 2024-09-14T12:01:18.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.529+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.DMISJa1dG1BVmN9huhfBZRlIiC4YcZS_0 2024-09-14T12:01:18.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.529+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17087174518472485166', time=2024-09-14T13:32:51.201004+0000, chain.objs.size()=1 2024-09-14T12:01:18.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.529+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.JkRL-cp7JvYcPJakzSgTLy3dJy3C2O-_0 2024-09-14T12:01:18.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.529+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.198269497618196009', time=2024-09-14T13:32:51.218843+0000, chain.objs.size()=1 2024-09-14T12:01:18.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.529+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.6r2E7vgkB7HQSrqsp29e5rxOTDet0SM_0 2024-09-14T12:01:18.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.530+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15074669502233043777', time=2024-09-14T13:32:51.251192+0000, chain.objs.size()=1 2024-09-14T12:01:18.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.530+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.EPAW8LVKxL3dN6K8SkqcyV3SpXIXH2A_0 2024-09-14T12:01:18.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.530+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2122608786116790481', time=2024-09-14T13:32:51.525533+0000, chain.objs.size()=1 2024-09-14T12:01:18.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.530+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.NwmAQygXUTc0xHwjsts2JQcRfXQkldy_0 2024-09-14T12:01:18.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.530+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3312236399805674820', time=2024-09-14T13:32:51.556767+0000, chain.objs.size()=1 2024-09-14T12:01:18.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.530+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.bi0XfLy6VUyG895DxtwpridxETCTG3d_0 2024-09-14T12:01:18.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.530+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.242850266984932715', time=2024-09-14T13:32:52.047550+0000, chain.objs.size()=1 2024-09-14T12:01:18.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.530+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.6yEWqmWRkTNL7NdqsLAfsqhLb4zn97G_0 2024-09-14T12:01:18.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.530+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1110305891966672407', time=2024-09-14T13:32:52.188552+0000, chain.objs.size()=1 2024-09-14T12:01:18.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.530+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.BprZzdeLsrJwYPKbVIvprCbrmFZQc2X_0 2024-09-14T12:01:18.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.530+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15362197985712752173', time=2024-09-14T13:32:52.190096+0000, chain.objs.size()=1 2024-09-14T12:01:18.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.530+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.sjAZxsTIMLkgjlW1ppaBtHEuHEZFvxt_0 2024-09-14T12:01:18.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.530+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1119643226084388264', time=2024-09-14T13:32:52.454627+0000, chain.objs.size()=1 2024-09-14T12:01:18.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.530+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.uqukp7IdN110DRE5VA9qPlUkuw6ehDX_0 2024-09-14T12:01:18.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.530+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3358492760695949712', time=2024-09-14T13:32:52.541215+0000, chain.objs.size()=1 2024-09-14T12:01:18.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.530+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.LOn6g3rGuwnRmqUd4F797KE7A2mwTgD_0 2024-09-14T12:01:18.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.533+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1027253191004701564', time=2024-09-14T13:32:52.690486+0000, chain.objs.size()=1 2024-09-14T12:01:18.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.533+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.XS_ToP1fdlleyPOB_yI_xJcqG1vcSdm_0 2024-09-14T12:01:18.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.533+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13683261856902722679', time=2024-09-14T13:32:52.995946+0000, chain.objs.size()=1 2024-09-14T12:01:18.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.533+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.VKLIz_pDMv3ffX4toKf9tutoSJZ5Fw8_0 2024-09-14T12:01:18.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.533+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15401630494260680434', time=2024-09-14T13:32:53.848517+0000, chain.objs.size()=1 2024-09-14T12:01:18.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.533+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.lSpM8WL9sXZ4SFV7I-5PZtdeFpdB7ux_0 2024-09-14T12:01:18.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.533+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14097055047609823720', time=2024-09-14T13:32:53.975365+0000, chain.objs.size()=1 2024-09-14T12:01:18.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.533+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.QqbDftmvaS7oj4oc_SANSgmANHZ6VwC_0 2024-09-14T12:01:18.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.533+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5174959899510590810', time=2024-09-14T13:32:54.387128+0000, chain.objs.size()=1 2024-09-14T12:01:18.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.533+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.BUpxorfxnIfYDGm2BuKrg8M7TVpxwIC_0 2024-09-14T12:01:18.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.533+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6364868582353781501', time=2024-09-14T13:32:55.236213+0000, chain.objs.size()=1 2024-09-14T12:01:18.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.533+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.pP7-Jj6h-pVtUyO9zrBq9QxNSAMl_sx_0 2024-09-14T12:01:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.535+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4771106260030789476', time=2024-09-14T13:32:55.424323+0000, chain.objs.size()=1 2024-09-14T12:01:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.535+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.P-OsWNKyEgQol9ECjWbTlXOB_DGjBBs_0 2024-09-14T12:01:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.535+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7078734936272558485', time=2024-09-14T13:32:55.999881+0000, chain.objs.size()=1 2024-09-14T12:01:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.535+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.YrS4ZUkaQdEzyD8NIEkmeADJ_DAAQAr_0 2024-09-14T12:01:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.535+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11049150804206827994', time=2024-09-14T13:32:56.309334+0000, chain.objs.size()=1 2024-09-14T12:01:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.535+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.7VKQUzdM-OLYmKpSgFqsG4xKIhIbeeH_0 2024-09-14T12:01:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.535+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2805580369581635529', time=2024-09-14T13:32:56.360372+0000, chain.objs.size()=1 2024-09-14T12:01:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.535+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.sD9B3PfHukwAQijy5MJWzXqv-WvoE18_0 2024-09-14T12:01:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.535+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5151480138881273210', time=2024-09-14T13:32:56.557912+0000, chain.objs.size()=1 2024-09-14T12:01:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.535+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.CoeOQO9ervfTP-mmGIJQYIX7hu5MezG_0 2024-09-14T12:01:18.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.537+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16300107160575488009', time=2024-09-14T13:32:56.632341+0000, chain.objs.size()=1 2024-09-14T12:01:18.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.537+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.MpmX7lZbIZ1CxyBEwKh1IEkzeribRZp_0 2024-09-14T12:01:18.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.537+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18409033781067782325', time=2024-09-14T13:32:56.651583+0000, chain.objs.size()=1 2024-09-14T12:01:18.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.537+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.xSgpMT_BkEsDaqjgcte8E9VOVw3vjEC_0 2024-09-14T12:01:18.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.537+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12658134508809087058', time=2024-09-14T13:32:56.853513+0000, chain.objs.size()=1 2024-09-14T12:01:18.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.537+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Oa-uekR-kvfJc96rxKJV0G9T6tS7l56_0 2024-09-14T12:01:18.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.538+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4433971722978993779', time=2024-09-14T13:32:57.780403+0000, chain.objs.size()=1 2024-09-14T12:01:18.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.538+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.owhoPaZZFYo77W9m4Yq-cjA3y6bHLio_0 2024-09-14T12:01:18.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.538+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5201201921252772680', time=2024-09-14T13:32:58.040902+0000, chain.objs.size()=1 2024-09-14T12:01:18.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.538+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.77hdwgXLyHV05erqVl_85CwtxR2YzKe_0 2024-09-14T12:01:18.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.538+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11551696666741104452', time=2024-09-14T13:32:58.058011+0000, chain.objs.size()=1 2024-09-14T12:01:18.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.538+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Y3NYJNaED4NFj_qwWBtSEzop-FvxgWY_0 2024-09-14T12:01:18.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.538+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17691559765975276308', time=2024-09-14T13:32:58.212308+0000, chain.objs.size()=1 2024-09-14T12:01:18.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.538+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.LFqi_UzlYIUqUGhdzEjocMNPiyjRo7i_0 2024-09-14T12:01:18.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.539+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.709090420286041932', time=2024-09-14T13:32:58.469361+0000, chain.objs.size()=1 2024-09-14T12:01:18.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.539+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.eWFqREaytcHKwmb_48oTIyA2vIaHUJ3_0 2024-09-14T12:01:18.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.539+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7335773998598857313', time=2024-09-14T13:32:58.556761+0000, chain.objs.size()=1 2024-09-14T12:01:18.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.539+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.aBZ8myToLxmdrj-WDGdAoRMIbeNrxr7_0 2024-09-14T12:01:18.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.539+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4274450007684237469', time=2024-09-14T13:33:17.090738+0000, chain.objs.size()=1 2024-09-14T12:01:18.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.539+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.280__shadow_.8fZ5vYmULj8gTfxV03aI1obVrtoJCTu_0 2024-09-14T12:01:18.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.539+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15260343886071116727', time=2024-09-14T13:33:22.590931+0000, chain.objs.size()=1 2024-09-14T12:01:18.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.539+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.285__shadow_.1R3kgFf7U25mee5_wCd4sbiMvwkCg-i_0 2024-09-14T12:01:18.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.540+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1024452055838653894', time=2024-09-14T13:33:35.505221+0000, chain.objs.size()=1 2024-09-14T12:01:18.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.540+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.kFwg_bz7tlhDBzyQ9NVbTvELBBOhqBR_0 2024-09-14T12:01:18.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.540+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5901979158977186685', time=2024-09-14T13:33:38.960681+0000, chain.objs.size()=1 2024-09-14T12:01:18.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.540+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.297__shadow_.8oemlPXMlt2HD_1lcRo3r9klS_dSnEV_0 2024-09-14T12:01:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.542+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4846278117517364870', time=2024-09-14T13:33:41.191373+0000, chain.objs.size()=1 2024-09-14T12:01:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.542+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.299__shadow_.fUQrOu__QVbh4GFE6d_vVvnfCmLrw4N_0 2024-09-14T12:01:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.542+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7226415778601327102', time=2024-09-14T13:34:51.508713+0000, chain.objs.size()=1 2024-09-14T12:01:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.542+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.rgqDUPWY466q44_OD39sGT4TL4osHuY_0 2024-09-14T12:01:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.542+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6641485527983606084', time=2024-09-14T13:34:51.650298+0000, chain.objs.size()=1 2024-09-14T12:01:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.542+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.MP8KeSEe2lo7G3RuwqCiVSPaEBA330y_0 2024-09-14T12:01:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.543+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13085885700836369848', time=2024-09-14T13:34:51.696941+0000, chain.objs.size()=1 2024-09-14T12:01:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.543+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.dtavB-Vp9JEVFRY5zoWkvXGKDw2V3ud_0 2024-09-14T12:01:18.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.543+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11570884929037408805', time=2024-09-14T13:34:51.699797+0000, chain.objs.size()=1 2024-09-14T12:01:18.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.543+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.E4c2NI06CWfeKt_2vWGTBgOYxZjVRCm_0 2024-09-14T12:01:18.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.543+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8978795456533223141', time=2024-09-14T13:34:51.795876+0000, chain.objs.size()=1 2024-09-14T12:01:18.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.543+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.n82hz2VRHAbpSfl0vHe7rqBFpQ-6XMT_0 2024-09-14T12:01:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.544+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7341398078945570127', time=2024-09-14T13:34:51.935067+0000, chain.objs.size()=1 2024-09-14T12:01:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.544+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.25OPgwBVAONl_BnVoXHJFDF_2Nd-XVr_0 2024-09-14T12:01:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.544+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9172739009911122977', time=2024-09-14T13:34:52.123315+0000, chain.objs.size()=1 2024-09-14T12:01:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.544+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.8UKpcb4rTwtygPyVTRzY329mm3PmYPx_0 2024-09-14T12:01:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.544+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7163558912788268188', time=2024-09-14T13:34:52.387030+0000, chain.objs.size()=1 2024-09-14T12:01:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.544+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.sEaYZDodga-fb-kZeMVf8QcoV-8x4oM_0 2024-09-14T12:01:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.544+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1731933727700224106', time=2024-09-14T13:34:52.388163+0000, chain.objs.size()=1 2024-09-14T12:01:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.544+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.K-dy5Ln-F-IJj4SJsjgGqslFPA1GXgp_0 2024-09-14T12:01:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.544+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.571084456196208518', time=2024-09-14T13:34:52.453895+0000, chain.objs.size()=1 2024-09-14T12:01:18.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.544+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.BPc5ccBNoKjl1a9wXgQAehY1XWPYlO1_0 2024-09-14T12:01:18.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.547+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16039701436018797167', time=2024-09-14T13:34:53.349471+0000, chain.objs.size()=1 2024-09-14T12:01:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.547+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.iQmrRoIvYD_wI0EF5qTVLafqY_v6v7q_0 2024-09-14T12:01:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.547+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16699879488329113471', time=2024-09-14T13:34:53.513655+0000, chain.objs.size()=1 2024-09-14T12:01:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.547+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.iQ7RPgMsMR8Diz6YrfpzKnG2GL4WAbt_0 2024-09-14T12:01:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.547+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11878285501235203503', time=2024-09-14T13:34:53.650466+0000, chain.objs.size()=1 2024-09-14T12:01:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.547+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.AIubrWMH1wntePaRvGSvOi_XNFADAIF_0 2024-09-14T12:01:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.547+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10080199701421618397', time=2024-09-14T13:34:53.812258+0000, chain.objs.size()=1 2024-09-14T12:01:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.547+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.uvJ2VOWUt3xl4yTS6So3ESSK1iDGTog_0 2024-09-14T12:01:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.547+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.95318714592655752', time=2024-09-14T13:34:53.950373+0000, chain.objs.size()=1 2024-09-14T12:01:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.547+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.aIqfI379aBYE8dGDls4QrmnY7uL_gX0_0 2024-09-14T12:01:18.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.549+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18148002373664074509', time=2024-09-14T13:34:54.192997+0000, chain.objs.size()=1 2024-09-14T12:01:18.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.549+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.DtbyC5tfHffexssedtUv8DkA7MMYfg4_0 2024-09-14T12:01:18.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.549+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9096988714587496609', time=2024-09-14T13:34:54.976692+0000, chain.objs.size()=1 2024-09-14T12:01:18.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.549+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.vT9LztNbjbZk0a2ouQmpTkVRaGM8TuY_0 2024-09-14T12:01:18.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.549+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2946843308021206270', time=2024-09-14T13:34:55.290594+0000, chain.objs.size()=1 2024-09-14T12:01:18.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.549+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.OT-WjYb8k-oyyGTjtUVPnecfDAZAzxS_0 2024-09-14T12:01:18.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.549+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.255948922376291114', time=2024-09-14T13:34:55.460484+0000, chain.objs.size()=1 2024-09-14T12:01:18.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.549+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.CGHnmtjZNWxQzo6bGLDxMYVYo7esgmE_0 2024-09-14T12:01:18.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.549+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5651586651355818002', time=2024-09-14T13:34:57.111889+0000, chain.objs.size()=1 2024-09-14T12:01:18.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.549+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.37W0e3GJnfQ2rOi7H75_tYrLGvRbg3l_0 2024-09-14T12:01:18.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.549+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7482215904966213946', time=2024-09-14T13:34:57.667828+0000, chain.objs.size()=1 2024-09-14T12:01:18.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.549+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Pr_201SNb2yKVE6vKi9hrwNNxLnYuYX_0 2024-09-14T12:01:18.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.550+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2475379916070472566', time=2024-09-14T13:34:57.964876+0000, chain.objs.size()=1 2024-09-14T12:01:18.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.550+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.1OOvLYfdobVRHGurLL6kjLq8b1Lu3OY_0 2024-09-14T12:01:18.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.551+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10209334706214648029', time=2024-09-14T13:34:59.652824+0000, chain.objs.size()=1 2024-09-14T12:01:18.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.551+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.KOHYtjhjsMzk46McDiVgvfxPRzs0Lnr_0 2024-09-14T12:01:18.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.551+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6381554008034478955', time=2024-09-14T13:35:00.002550+0000, chain.objs.size()=1 2024-09-14T12:01:18.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.551+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.UA3SQFquyAC8S1StQQrMY6J_E4M6kQ8_0 2024-09-14T12:01:18.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.551+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5450986183730785943', time=2024-09-14T13:35:00.041234+0000, chain.objs.size()=1 2024-09-14T12:01:18.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.551+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.2651bH_OCKf1jFdQKQW_JLhzXX7fNpm_0 2024-09-14T12:01:18.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.551+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13063398285133930795', time=2024-09-14T13:35:00.454512+0000, chain.objs.size()=1 2024-09-14T12:01:18.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.551+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.pLCwNyPxxk81hWukR8RECzJ_zGSrjoQ_0 2024-09-14T12:01:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.553+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.737623614556664856', time=2024-09-14T13:35:00.653999+0000, chain.objs.size()=1 2024-09-14T12:01:18.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.553+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.fApPeO8C8nLmdJD1yU68h6HQW6xMjtV_0 2024-09-14T12:01:18.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.553+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4719195517562409940', time=2024-09-14T13:35:00.894115+0000, chain.objs.size()=1 2024-09-14T12:01:18.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.553+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.3Q-f_WGJmIglTUoz2DWTWUCnLYhIN7x_0 2024-09-14T12:01:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.554+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4882613367766763579', time=2024-09-14T13:35:00.912770+0000, chain.objs.size()=1 2024-09-14T12:01:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.554+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.uOfvDtK6jmWVofQB4V4iN3y0CI2OsXH_0 2024-09-14T12:01:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.554+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16755755495894189665', time=2024-09-14T13:35:01.380253+0000, chain.objs.size()=1 2024-09-14T12:01:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.554+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.mK_7zwgCv5zZSEk1ZPiKQXXwERZ7Xvn_0 2024-09-14T12:01:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.554+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1562613861198029034', time=2024-09-14T13:35:02.356681+0000, chain.objs.size()=1 2024-09-14T12:01:18.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.554+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.nOwNjKbvFlyroFOaMzPQKZGKX6HcbOi_0 2024-09-14T12:01:18.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.554+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12895227067231602228', time=2024-09-14T13:35:02.529609+0000, chain.objs.size()=1 2024-09-14T12:01:18.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.554+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.9c6nsBM3VKXg1lQVCYn6ymn_6ztrTrC_0 2024-09-14T12:01:18.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.554+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16001196490899099061', time=2024-09-14T13:35:02.581161+0000, chain.objs.size()=1 2024-09-14T12:01:18.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.554+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Pjp8CxivHvC-wDkg6ai7rrTWWNQeAFo_0 2024-09-14T12:01:18.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.554+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6057406443465482940', time=2024-09-14T13:35:42.263563+0000, chain.objs.size()=1 2024-09-14T12:01:18.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.554+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.cF8hZZPfWGhSZ22pehPBzrYS3dNBzKh_0 2024-09-14T12:01:18.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.554+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1993311299291986416', time=2024-09-14T13:35:42.386064+0000, chain.objs.size()=1 2024-09-14T12:01:18.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.554+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.-oGhnUEV05T4J5zy_s2qhHgr2dWDgAS_0 2024-09-14T12:01:18.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.554+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16305277237851398481', time=2024-09-14T13:35:42.631540+0000, chain.objs.size()=1 2024-09-14T12:01:18.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.554+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.T5GgXyGv0gek6sIDvGkw1XlJOHp3rhz_0 2024-09-14T12:01:18.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.554+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3937580989735984758', time=2024-09-14T13:35:43.625068+0000, chain.objs.size()=1 2024-09-14T12:01:18.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.554+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.nzul6QmRwAMqd09LUMf2P0Hlzfzdyk7_0 2024-09-14T12:01:18.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.557+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9346487965100388619', time=2024-09-14T13:35:43.845794+0000, chain.objs.size()=1 2024-09-14T12:01:18.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.557+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.VpXlo-IdrReG1cwZrZsFmuqkYXQ7ql7_0 2024-09-14T12:01:18.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.557+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6087018623568777502', time=2024-09-14T13:35:44.220727+0000, chain.objs.size()=1 2024-09-14T12:01:18.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.557+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.0OfRI2L6tu1ZtCZyV_QLV2vRj4nFbLF_0 2024-09-14T12:01:18.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.558+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10713067865914443633', time=2024-09-14T13:35:44.309373+0000, chain.objs.size()=1 2024-09-14T12:01:18.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.558+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.kC7pC9Ubc08LR_CwasWRmTm3wlnF6Mm_0 2024-09-14T12:01:18.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.559+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.370039979967482379', time=2024-09-14T13:35:44.817824+0000, chain.objs.size()=1 2024-09-14T12:01:18.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.559+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.qyEEECZYKc6hqBA7oBwLM9m44Skz_xS_0 2024-09-14T12:01:18.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.559+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3085756689837503440', time=2024-09-14T13:35:45.033007+0000, chain.objs.size()=1 2024-09-14T12:01:18.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.559+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.l4FEWJmbe-SMAOW9lOLRDFw2EmFhv93_0 2024-09-14T12:01:18.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.559+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17229209912825033619', time=2024-09-14T13:35:45.050127+0000, chain.objs.size()=1 2024-09-14T12:01:18.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.559+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.16WgGdEXjMMl5_3gNjcQsI3sRgXzOdF_0 2024-09-14T12:01:18.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.559+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7187521650564500006', time=2024-09-14T13:35:45.253850+0000, chain.objs.size()=1 2024-09-14T12:01:18.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.559+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.T8PZd5JSVbyZ1AnrA8DCMrgWDNX2upj_0 2024-09-14T12:01:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.559+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10418093918906213714', time=2024-09-14T13:35:45.715956+0000, chain.objs.size()=1 2024-09-14T12:01:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.559+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.s85A2CLkazGQz927jMlr6BOkPEgTaVn_0 2024-09-14T12:01:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.559+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1267557804509978660', time=2024-09-14T13:35:46.299664+0000, chain.objs.size()=1 2024-09-14T12:01:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.559+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.x3KEmp4nWMP7-Gha6WrYZVXxq-EfX8f_0 2024-09-14T12:01:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.559+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17469197415675901664', time=2024-09-14T13:35:46.601365+0000, chain.objs.size()=1 2024-09-14T12:01:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.559+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.AvJCq57s5O3qt3818mIYYafHSGtKUmp_0 2024-09-14T12:01:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.559+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.165265001244114701', time=2024-09-14T13:35:46.675623+0000, chain.objs.size()=1 2024-09-14T12:01:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.559+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.m79eS_3fpCCdCttZ6wl_IMEUOukgveX_0 2024-09-14T12:01:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.559+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1207180580160133792', time=2024-09-14T13:35:47.027244+0000, chain.objs.size()=1 2024-09-14T12:01:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.559+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.7FfEtgSMfMm1ChVmUjiOcf6WAcIcNWR_0 2024-09-14T12:01:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.561+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.405239445144711247', time=2024-09-14T13:35:47.251607+0000, chain.objs.size()=1 2024-09-14T12:01:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.561+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.-CpmtfZV4Fd46PL_af5w_NttHoWbKt__0 2024-09-14T12:01:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.562+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9822925367535673895', time=2024-09-14T13:35:47.811530+0000, chain.objs.size()=1 2024-09-14T12:01:18.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.562+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.C6DLyYlUUiz9OE9uxOrL9I06eE7KAoy_0 2024-09-14T12:01:18.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.562+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8609052849543503096', time=2024-09-14T13:35:47.812117+0000, chain.objs.size()=1 2024-09-14T12:01:18.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.562+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.K9ZiWVs50Ugn8Ay2yIQtmtFyyYSvDQT_0 2024-09-14T12:01:18.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.565+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/46624 2024-09-14T12:01:18.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-14T12:01:18.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10535989853375235267', time=2024-09-14T13:35:48.134484+0000, chain.objs.size()=1 2024-09-14T12:01:18.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.pxeGVcbysdhhvYRkT6GJTxfHlcOUH7n_0 2024-09-14T12:01:18.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16911390883913900691', time=2024-09-14T13:35:48.228929+0000, chain.objs.size()=1 2024-09-14T12:01:18.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.u2OooVfKoqao4wolHyemTcryb0Cd8RD_0 2024-09-14T12:01:18.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2439749282194758105', time=2024-09-14T13:35:49.377406+0000, chain.objs.size()=1 2024-09-14T12:01:18.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.vvzQ5IG_A_G0r253mSx6IVf8qTit2Sj_0 2024-09-14T12:01:18.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.656488642236842920', time=2024-09-14T13:35:49.622539+0000, chain.objs.size()=1 2024-09-14T12:01:18.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.G5jNo8I2EF4_XDfNK8-GbAyPose8PPx_0 2024-09-14T12:01:18.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9790803620550335926', time=2024-09-14T13:35:49.770771+0000, chain.objs.size()=1 2024-09-14T12:01:18.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.QXHURw9VMRsdNmad2V5_rWhaAkJZk2q_0 2024-09-14T12:01:18.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6558587182911712328', time=2024-09-14T13:35:50.272885+0000, chain.objs.size()=1 2024-09-14T12:01:18.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.z-JkwJwwSlhhhA0_zPvWTbnq7gSH08y_0 2024-09-14T12:01:18.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3044636909511056320', time=2024-09-14T13:35:51.144804+0000, chain.objs.size()=1 2024-09-14T12:01:18.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.JEsO8yutj8h89zFoHGxYw8YwqxZcZBg_0 2024-09-14T12:01:18.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18154885299448899070', time=2024-09-14T13:35:51.274364+0000, chain.objs.size()=1 2024-09-14T12:01:18.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.T7DxpCoGZgs5_de7HxFEESZcstU6xFj_0 2024-09-14T12:01:18.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10661198546582302014', time=2024-09-14T13:35:51.545143+0000, chain.objs.size()=1 2024-09-14T12:01:18.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.V2vT4H7xP_IPZiAh5nYsVFRwC2dg2md_0 2024-09-14T12:01:18.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5919680693824775584', time=2024-09-14T13:35:51.602019+0000, chain.objs.size()=1 2024-09-14T12:01:18.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.g1j6I5mcQFr-FG1Ui9WRTKlt9jVrLj6_0 2024-09-14T12:01:18.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1440864535668426664', time=2024-09-14T13:35:52.502625+0000, chain.objs.size()=1 2024-09-14T12:01:18.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.F2xkUD84ILv4u5vd-QpJtHplMAtU8ph_0 2024-09-14T12:01:18.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2454444101657933644', time=2024-09-14T13:35:52.611950+0000, chain.objs.size()=1 2024-09-14T12:01:18.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.568+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.oZr88DEBRCy2ZYvcdLFmzgx5tOIbZHq_0 2024-09-14T12:01:18.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.571+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2460544033745040816', time=2024-09-14T13:36:06.006083+0000, chain.objs.size()=1 2024-09-14T12:01:18.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.571+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.338__shadow_.Oau9RiEB1TNptnEK4DTsk1ynecCOaA7_0 2024-09-14T12:01:18.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.571+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6691952435029834741', time=2024-09-14T13:38:13.504743+0000, chain.objs.size()=1 2024-09-14T12:01:18.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.571+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.456__shadow_.AnfxGUckCHRbGkQMUFShodP--558YDk_0 2024-09-14T12:01:18.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.572+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7904051482722770101', time=2024-09-14T13:38:44.066243+0000, chain.objs.size()=1 2024-09-14T12:01:18.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.572+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.485__shadow_.KEUq_xalDf7SZCm827iQEBlfITWZP0A_0 2024-09-14T12:01:18.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.572+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2934224936811177221', time=2024-09-14T13:38:44.840703+0000, chain.objs.size()=1 2024-09-14T12:01:18.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.572+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.486__shadow_.bHTaMXm7Nr5CY7C4wx6MiytPAHzKzLs_0 2024-09-14T12:01:18.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.572+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14565674410220461532', time=2024-09-14T13:38:51.326099+0000, chain.objs.size()=1 2024-09-14T12:01:18.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.572+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.489__shadow_.THjO7g8tNtGx2_rk0jMhtwl50cD7szb_0 2024-09-14T12:01:18.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.572+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4575683373048233864', time=2024-09-14T13:39:02.606757+0000, chain.objs.size()=1 2024-09-14T12:01:18.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.572+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.501__shadow_.nXpZIo1qaRre8n1KDbI99bQpfL10KOF_0 2024-09-14T12:01:18.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.572+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6548603410355084446', time=2024-09-14T13:39:34.740039+0000, chain.objs.size()=6 2024-09-14T12:01:18.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.572+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.1 2024-09-14T12:01:18.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.572+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.2 2024-09-14T12:01:18.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.572+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.3 2024-09-14T12:01:18.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.573+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.4 2024-09-14T12:01:18.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.573+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.5 2024-09-14T12:01:18.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.574+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.6 2024-09-14T12:01:18.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.575+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9076041524865058146', time=2024-09-14T13:39:55.256343+0000, chain.objs.size()=1 2024-09-14T12:01:18.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.575+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.518__shadow_.EVKSsC6bO6wbUnc7-A4ojAinqnTob12_0 2024-09-14T12:01:18.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.575+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3421580637427755548', time=2024-09-14T13:44:41.380012+0000, chain.objs.size()=1 2024-09-14T12:01:18.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.575+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.552__shadow_.nUSlyC9-YxVYOnbX6oiO663DZamSoWq_0 2024-09-14T12:01:18.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.575+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14987236304076786008', time=2024-09-14T13:45:01.873720+0000, chain.objs.size()=2 2024-09-14T12:01:18.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.575+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.556__shadow_.LpKLSwuzwNsEWziMeln7MKz95bDRS5u_0 2024-09-14T12:01:18.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.576+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.556__shadow_.LpKLSwuzwNsEWziMeln7MKz95bDRS5u_1 2024-09-14T12:01:18.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.576+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6943046539639233948', time=2024-09-14T13:45:20.385465+0000, chain.objs.size()=1 2024-09-14T12:01:18.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.576+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.562__multipart_mymultipart.2~7COIbGjK5syGqXYZzO8qZg0sXMAuMEK.1 2024-09-14T12:01:18.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.577+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7218854178248290533', time=2024-09-14T13:45:36.139311+0000, chain.objs.size()=1 2024-09-14T12:01:18.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.577+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:uzT3dbM92ANTHyV8-9eVVtinMNuWNzG_.k7IwEriRywA4kZz1mlhjEm03ahaYm2D_0 2024-09-14T12:01:18.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.577+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1001666829068376901', time=2024-09-14T13:45:36.598355+0000, chain.objs.size()=1 2024-09-14T12:01:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.577+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:DC0M-UnExm1GYnKCzuGp2odmiLgw0b7_.SatStZvKDLsuF70pgX0NzY0MsUrYphs_0 2024-09-14T12:01:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.577+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8074309078920339830', time=2024-09-14T13:45:37.307860+0000, chain.objs.size()=1 2024-09-14T12:01:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.577+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:PdfJxCaR6EMokANHYcTHzflIY9yMQ4x_.Il0D5eaQgOvuKgawlqf0EafeQ_V4U3z_0 2024-09-14T12:01:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.577+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12469947338985808460', time=2024-09-14T13:45:40.323637+0000, chain.objs.size()=1 2024-09-14T12:01:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.577+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:-s84Nhg8PViphIcwCM1DrC47ex.zhql_.rdYPOpuJ9sQ1Vuf-i1eyCBbCBadknVe_0 2024-09-14T12:01:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.577+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14342802329213529196', time=2024-09-14T13:45:45.476734+0000, chain.objs.size()=1 2024-09-14T12:01:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.577+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:UWB-qwP8S8bMXeFKfnINZqX6-0t.1E8_.tHfMl_O9mIF64LTVMKmsveBgNkCTeex_0 2024-09-14T12:01:18.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.580+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7806763265399560871', time=2024-09-14T13:47:09.356335+0000, chain.objs.size()=1 2024-09-14T12:01:18.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.580+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.580__shadow:4XuKmrkydy16PqAvq35MZVXPLICxDKD_.3TJDzYDxSf-sX6vD5Xplf-7jXaKNwHa_0 2024-09-14T12:01:18.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.580+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5600894078519486746', time=2024-09-14T13:47:09.357096+0000, chain.objs.size()=1 2024-09-14T12:01:18.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.580+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.580__shadow:c3h1IqNCN7cFieeB-SHu0TQEm8ICZmZ_.MiHDUoINv6VUiajpk_LkrJwT6uTO6rT_0 2024-09-14T12:01:18.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.580+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2029411649499317820', time=2024-09-14T13:52:40.591400+0000, chain.objs.size()=1 2024-09-14T12:01:18.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.580+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.629__shadow_.o39xO5lZTRITKahlkMgy0oibAD4Tzzy_0 2024-09-14T12:01:18.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.580+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14699967861426948188', time=2024-09-14T13:53:57.707552+0000, chain.objs.size()=1 2024-09-14T12:01:18.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.580+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.666__shadow_.hulK2JKFZW94UJLR1sN2sW1NZVWxesi_0 2024-09-14T12:01:18.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.583+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:18.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.586+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T12:01:18.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.588+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:18.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.588+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.589+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49661' 2024-09-14T12:01:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.589+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9302059887310877925', time=2024-09-14T13:27:43.678530+0000, chain.objs.size()=1 2024-09-14T12:01:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.589+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.159__shadow_.iLG2cfJsLaMpRFKT_OPZ1lcinlFifbh_0 2024-09-14T12:01:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.589+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='_kBg8cX_otoy9_a8tuZ1q3qR2C3TlHqk', time=2024-09-14T13:28:08.225558+0000, chain.objs.size()=2 2024-09-14T12:01:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.589+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.161__shadow_.44pu57cqlK-gd2rR9KxA8pIBE6ne6HP_0 2024-09-14T12:01:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.589+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.161__shadow_.44pu57cqlK-gd2rR9KxA8pIBE6ne6HP_1 2024-09-14T12:01:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.589+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='_FZDJ6s_Bz6BxY97Nvv0DjLyv89Bl-BD', time=2024-09-14T13:28:42.013551+0000, chain.objs.size()=2 2024-09-14T12:01:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.589+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.166__shadow_.KH4KfXG_FQKYZhvJtIiOqmW1UsrR4cc_0 2024-09-14T12:01:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.589+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.166__shadow_.KH4KfXG_FQKYZhvJtIiOqmW1UsrR4cc_1 2024-09-14T12:01:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.589+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13595610051790334516', time=2024-09-14T13:31:32.680894+0000, chain.objs.size()=1 2024-09-14T12:01:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.589+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.231__shadow_.0YZF4yIv7-_3Cejxow56TpzCNwcN8R3_0 2024-09-14T12:01:18.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.589+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4320701802988566089', time=2024-09-14T13:31:50.537804+0000, chain.objs.size()=1 2024-09-14T12:01:18.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.589+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.245__shadow_.LJDZGrtLSMXLjC9d7wX4WRXS9_KOqAO_0 2024-09-14T12:01:18.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.589+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7805723694790203595', time=2024-09-14T13:32:03.908294+0000, chain.objs.size()=1 2024-09-14T12:01:18.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.589+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.257__shadow_.FlzHq2GTI97tw8mVxHfU0rcVtZVlLCd_0 2024-09-14T12:01:18.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.589+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3288785439304915597', time=2024-09-14T13:32:47.576808+0000, chain.objs.size()=1 2024-09-14T12:01:18.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.589+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.mo9it9gPuwLQAJHkPdXDYLUHplD5dgW_0 2024-09-14T12:01:18.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.589+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5186492552474028066', time=2024-09-14T13:32:47.792977+0000, chain.objs.size()=1 2024-09-14T12:01:18.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.589+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.xFX6syIUXjvl5vzPnkSV3jjHxBMEQPO_0 2024-09-14T12:01:18.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.589+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10389905239543280574', time=2024-09-14T13:32:48.386366+0000, chain.objs.size()=1 2024-09-14T12:01:18.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.589+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.EH5ft54pI1Qst0JaYc8ykiHzbqQk23N_0 2024-09-14T12:01:18.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.589+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1311852271263788247', time=2024-09-14T13:32:48.479629+0000, chain.objs.size()=1 2024-09-14T12:01:18.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.589+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ro5Nbf36_-Y0EyXT5fyBcfbjR72jHFU_0 2024-09-14T12:01:18.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.593+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4595359255387431821', time=2024-09-14T13:32:49.316184+0000, chain.objs.size()=1 2024-09-14T12:01:18.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.593+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.rFhX85akjEizmZpC86x5Uj2X9tpJojm_0 2024-09-14T12:01:18.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.594+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2097206153581739039', time=2024-09-14T13:32:50.052516+0000, chain.objs.size()=1 2024-09-14T12:01:18.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.594+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.wvpkyweaZoWNIMUkvTHQRduNdxZ4mC0_0 2024-09-14T12:01:18.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.594+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14963751638556416950', time=2024-09-14T13:32:50.053192+0000, chain.objs.size()=1 2024-09-14T12:01:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.594+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.f5jRLnkYQfmFaDdBuWDXMlIyMoEnMhf_0 2024-09-14T12:01:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.594+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11001300458957712563', time=2024-09-14T13:32:50.091300+0000, chain.objs.size()=1 2024-09-14T12:01:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.594+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.W3kp_eG0AgoHZhS1S6aliDyNwARzkK-_0 2024-09-14T12:01:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.594+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18387147856619757201', time=2024-09-14T13:32:50.914881+0000, chain.objs.size()=1 2024-09-14T12:01:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.594+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.rdj7eop-a6LtuphhmBNZXo-ETR2uCN7_0 2024-09-14T12:01:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.594+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17797291864885200304', time=2024-09-14T13:32:50.915606+0000, chain.objs.size()=1 2024-09-14T12:01:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.594+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.0UlU4nUpWCS-YiHQKwEhzKqJJDUdX10_0 2024-09-14T12:01:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.594+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14645932036262663071', time=2024-09-14T13:32:51.556933+0000, chain.objs.size()=1 2024-09-14T12:01:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.594+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.9LRKyRQbOhlOnMScgq0vFBQDWiQmdk3_0 2024-09-14T12:01:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.594+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7895798988523960760', time=2024-09-14T13:32:52.199775+0000, chain.objs.size()=1 2024-09-14T12:01:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.594+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.DnKgBdcny1Td9fEdDpYJy7P-LPDuJfp_0 2024-09-14T12:01:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.594+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4863921577510220096', time=2024-09-14T13:32:53.557848+0000, chain.objs.size()=1 2024-09-14T12:01:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.594+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.-MuH8CN_xLMjdQPgwnCaeP4ScnlLcYs_0 2024-09-14T12:01:18.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.594+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.195102241542400922', time=2024-09-14T13:32:55.724439+0000, chain.objs.size()=1 2024-09-14T12:01:18.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.594+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.6SbwEiABe33XETKTIKpK4kb1Ucg-w8Y_0 2024-09-14T12:01:18.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.594+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6112305490796909073', time=2024-09-14T13:32:55.766121+0000, chain.objs.size()=1 2024-09-14T12:01:18.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.594+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.e-mOyAtRfh1waapcnv9_0Dd7bS2Qr3P_0 2024-09-14T12:01:18.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.596+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12328874787198915240', time=2024-09-14T13:32:55.919469+0000, chain.objs.size()=1 2024-09-14T12:01:18.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.596+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.z0eMWJWx4qcW4dph---4pme2SQuzERu_0 2024-09-14T12:01:18.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.598+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.64824504513252800', time=2024-09-14T13:32:55.920215+0000, chain.objs.size()=1 2024-09-14T12:01:18.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.598+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.PAfnErI6kX2SHUWLLwT0S3P_T5iVKDK_0 2024-09-14T12:01:18.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.598+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6237580827385533769', time=2024-09-14T13:32:56.336504+0000, chain.objs.size()=1 2024-09-14T12:01:18.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.598+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.9THrC22yQ3ErZoEohMQkm-h33qZrTfB_0 2024-09-14T12:01:18.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.598+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17054764400831317451', time=2024-09-14T13:32:56.678663+0000, chain.objs.size()=1 2024-09-14T12:01:18.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.598+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.9aTo__vbrLB0kAvGZFy6MHulb32STCv_0 2024-09-14T12:01:18.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.598+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16520416966449275312', time=2024-09-14T13:32:57.063538+0000, chain.objs.size()=1 2024-09-14T12:01:18.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.598+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.QhHt5hapCrq0hkWfQOnKppLYWi1P75e_0 2024-09-14T12:01:18.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.598+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12261178093172143165', time=2024-09-14T13:32:57.199645+0000, chain.objs.size()=1 2024-09-14T12:01:18.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.598+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.zSz6p4ij7InEuP3J_sTJRVP3y3U-Hru_0 2024-09-14T12:01:18.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.598+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7375393236606191636', time=2024-09-14T13:32:57.766945+0000, chain.objs.size()=1 2024-09-14T12:01:18.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.598+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.bHnqY8jW0EbU5ERFA7zLXdSEIfagVVe_0 2024-09-14T12:01:18.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.598+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6542050677797445418', time=2024-09-14T13:32:58.086313+0000, chain.objs.size()=1 2024-09-14T12:01:18.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.598+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.o35x8TZh7_M6OM-Tv6Qvhz99wNhsh3f_0 2024-09-14T12:01:18.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.598+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7941884303150654655', time=2024-09-14T13:32:58.285835+0000, chain.objs.size()=1 2024-09-14T12:01:18.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.598+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.bAoWUdMyP8tX9PZHzsCIhujv4Ta2BTQ_0 2024-09-14T12:01:18.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.598+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17647528769609560738', time=2024-09-14T13:32:58.525427+0000, chain.objs.size()=1 2024-09-14T12:01:18.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.598+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.VozXOVVZ8jaMh54bvbx2ZzYLRcwk3zv_0 2024-09-14T12:01:18.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.600+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12348525079922715249', time=2024-09-14T13:33:08.486785+0000, chain.objs.size()=1 2024-09-14T12:01:18.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.600+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.272__shadow_.vhKyVjTWY6ndt27Vrz-TfiybaUXj-OD_0 2024-09-14T12:01:18.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.601+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9326331467864791550', time=2024-09-14T13:33:36.755273+0000, chain.objs.size()=1 2024-09-14T12:01:18.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.601+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.295__shadow_.rkAAgSs3DCUpC7gjczv72L8a007TDVx_0 2024-09-14T12:01:18.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.602+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6701359947314854185', time=2024-09-14T13:34:51.510473+0000, chain.objs.size()=1 2024-09-14T12:01:18.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.602+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.LEC_RSl75t3eSQIsXLxS849fWFEkZAW_0 2024-09-14T12:01:18.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.602+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6664360245392760493', time=2024-09-14T13:34:52.548008+0000, chain.objs.size()=1 2024-09-14T12:01:18.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.602+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.4AyyHgGp91fePjeA6UK8GOgPZr9AfQh_0 2024-09-14T12:01:18.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.602+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11819089507362098056', time=2024-09-14T13:34:53.176139+0000, chain.objs.size()=1 2024-09-14T12:01:18.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.602+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.3P_wrrt89daqv7DgZO7kko--JRp3qP1_0 2024-09-14T12:01:18.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.602+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17694525311628522011', time=2024-09-14T13:34:53.176862+0000, chain.objs.size()=1 2024-09-14T12:01:18.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.602+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Yigcz_WIEvIPjUaeU1-fMxGW_eq87Xq_0 2024-09-14T12:01:18.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.602+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7801191648488914847', time=2024-09-14T13:34:53.342142+0000, chain.objs.size()=1 2024-09-14T12:01:18.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.602+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.0wzm8dtA-YxwUGEwyqo20hITCpFe2y5_0 2024-09-14T12:01:18.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.603+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12620509124039976392', time=2024-09-14T13:34:53.467474+0000, chain.objs.size()=1 2024-09-14T12:01:18.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.603+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.pFCVMpB6zw7gV2VnDxFRji3nxZLqi8b_0 2024-09-14T12:01:18.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.603+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16691252351938759209', time=2024-09-14T13:34:54.156578+0000, chain.objs.size()=1 2024-09-14T12:01:18.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.603+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ntdpOwRtahhZpyzCl2-mCtd-sBpRry0_0 2024-09-14T12:01:18.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.603+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8334855273629161855', time=2024-09-14T13:34:54.683920+0000, chain.objs.size()=1 2024-09-14T12:01:18.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.603+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.S-2sIEx3SzbGFKdcj5RF648WqK9X6t6_0 2024-09-14T12:01:18.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.603+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9760411509084986759', time=2024-09-14T13:34:54.702356+0000, chain.objs.size()=1 2024-09-14T12:01:18.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.603+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.-zNgdMuOGa62DOX7_4_aCMhZLrA9coA_0 2024-09-14T12:01:18.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.604+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17843806870730051322', time=2024-09-14T13:34:55.304740+0000, chain.objs.size()=1 2024-09-14T12:01:18.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.604+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.RgyWV58VB1QaZFlJ1qcqPRMtIO0qv_t_0 2024-09-14T12:01:18.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.604+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18187627092092548082', time=2024-09-14T13:34:55.429779+0000, chain.objs.size()=1 2024-09-14T12:01:18.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.604+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.op1ci4WLJwz91rp6odJzp5cCclEMFX7_0 2024-09-14T12:01:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.606+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9907803104577724000', time=2024-09-14T13:34:55.463563+0000, chain.objs.size()=1 2024-09-14T12:01:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.606+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.OgjIcMTtWCW55Q7iBq8sCPjnNdRpNAl_0 2024-09-14T12:01:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.606+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15362109697674128437', time=2024-09-14T13:34:56.172411+0000, chain.objs.size()=1 2024-09-14T12:01:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.606+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.-1zjmPPs77wW2EL4R7bb7DveMKd_5op_0 2024-09-14T12:01:18.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.606+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3117688170430189256', time=2024-09-14T13:34:56.322347+0000, chain.objs.size()=1 2024-09-14T12:01:18.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.606+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.d_ltEwRV7kr4fZcqwJxNXfe1RciTuuB_0 2024-09-14T12:01:18.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.606+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10984473010482056407', time=2024-09-14T13:34:56.817843+0000, chain.objs.size()=1 2024-09-14T12:01:18.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.606+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.tPHTv4seu7IjmCc2lKa3n7UDs3e6lGW_0 2024-09-14T12:01:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.607+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1354306454684302272', time=2024-09-14T13:34:56.818806+0000, chain.objs.size()=1 2024-09-14T12:01:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.607+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Ow71V6TBpPJZMOZATLcPVk3cAL08VxU_0 2024-09-14T12:01:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.607+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3643251071671141792', time=2024-09-14T13:34:57.832351+0000, chain.objs.size()=1 2024-09-14T12:01:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.607+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.nZtgvneIG1xoNHY5FMnut0UFDzsBMG9_0 2024-09-14T12:01:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.607+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5284707210082730532', time=2024-09-14T13:34:58.058784+0000, chain.objs.size()=1 2024-09-14T12:01:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.607+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_._ZhYPYAi7q1ToJsZyF8gtcd2ZQ1XJks_0 2024-09-14T12:01:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.607+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6083624975847709896', time=2024-09-14T13:34:58.524119+0000, chain.objs.size()=1 2024-09-14T12:01:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.607+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.UZMn3ew381d6cPFUvXgsghoHUyILeWD_0 2024-09-14T12:01:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.607+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6086174857755740666', time=2024-09-14T13:34:59.086396+0000, chain.objs.size()=1 2024-09-14T12:01:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.607+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.E55Qi0Jo35SsNxIar1QOo7C_ivbRKGs_0 2024-09-14T12:01:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.607+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12628570568008485041', time=2024-09-14T13:34:59.915131+0000, chain.objs.size()=1 2024-09-14T12:01:18.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.607+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.bNMghI-zcVQs_CSivDcTfkJdCCflUa2_0 2024-09-14T12:01:18.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.607+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15759581380274797856', time=2024-09-14T13:34:59.915836+0000, chain.objs.size()=1 2024-09-14T12:01:18.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.607+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.vFiI3bKmIjXaqbFwwrj9DYLT0r1EUtm_0 2024-09-14T12:01:18.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.610+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10653182857258444983', time=2024-09-14T13:35:00.486133+0000, chain.objs.size()=1 2024-09-14T12:01:18.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.610+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.pigSDEI6G1eWNXD4XcXsFcCq8cl81bL_0 2024-09-14T12:01:18.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.611+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7774333897564332464', time=2024-09-14T13:35:00.486984+0000, chain.objs.size()=1 2024-09-14T12:01:18.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.611+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.8MPF3UyXaFCiLghI34cyYyEnYLhEf7W_0 2024-09-14T12:01:18.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.611+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.297545331838313384', time=2024-09-14T13:35:00.704780+0000, chain.objs.size()=1 2024-09-14T12:01:18.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.611+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.hPMCTMGXOvG7Inre0ZQSuFs-8IS4VsW_0 2024-09-14T12:01:18.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.611+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16274548089074920070', time=2024-09-14T13:35:01.201746+0000, chain.objs.size()=1 2024-09-14T12:01:18.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.611+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.YdY2BfGO7s7EXd2_6D2XEqOg8l5govc_0 2024-09-14T12:01:18.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.611+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6780661327912775301', time=2024-09-14T13:35:01.202451+0000, chain.objs.size()=1 2024-09-14T12:01:18.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.611+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.PGXOnOdzu3w9kMtR4l7xYG9GiwiNAU-_0 2024-09-14T12:01:18.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.611+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11670806321221235669', time=2024-09-14T13:35:01.203149+0000, chain.objs.size()=1 2024-09-14T12:01:18.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.611+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.qVe4JYR5pVkjpVmlpqokBhXXejUOI5t_0 2024-09-14T12:01:18.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.611+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14506058169836191256', time=2024-09-14T13:35:01.323104+0000, chain.objs.size()=1 2024-09-14T12:01:18.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.611+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.VdkJMiMV6YovtViYSIze-HsTpeCulF1_0 2024-09-14T12:01:18.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.612+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.612072427239834598', time=2024-09-14T13:35:01.421392+0000, chain.objs.size()=1 2024-09-14T12:01:18.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.612+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.c75hL6lqzLDaIkVLP0JJ0l5j_InqnUW_0 2024-09-14T12:01:18.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.612+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1915679299646310216', time=2024-09-14T13:35:01.485036+0000, chain.objs.size()=1 2024-09-14T12:01:18.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.612+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.jGVqQgv2etQQQv2gi_B2250YgYcWkGF_0 2024-09-14T12:01:18.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.612+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14148798246387861102', time=2024-09-14T13:35:01.916095+0000, chain.objs.size()=1 2024-09-14T12:01:18.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.612+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.0U23CpgL7rpBV_RjrZdSWvtSeEcRqum_0 2024-09-14T12:01:18.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.613+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2489699814167027488', time=2024-09-14T13:35:01.970232+0000, chain.objs.size()=1 2024-09-14T12:01:18.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.613+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.BMfsd2mw3aa5tEloBDhmU3M2vsJFbZo_0 2024-09-14T12:01:18.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.614+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7585846814270272439', time=2024-09-14T13:35:01.992912+0000, chain.objs.size()=1 2024-09-14T12:01:18.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.614+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.5lSVbApgc_1bzxIs5gdRH0dkap2EtUi_0 2024-09-14T12:01:18.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.616+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13786649480175444902', time=2024-09-14T13:35:02.041862+0000, chain.objs.size()=1 2024-09-14T12:01:18.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.616+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.RAHi5EodnetViwRzzIjhLRbQtfpv82g_0 2024-09-14T12:01:18.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.616+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3526936425538265836', time=2024-09-14T13:35:02.082049+0000, chain.objs.size()=1 2024-09-14T12:01:18.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.616+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.TBteZ5m4dTL7iD_bFyl7wmzUox1ODBg_0 2024-09-14T12:01:18.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.616+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1599109617778785416', time=2024-09-14T13:35:02.512030+0000, chain.objs.size()=1 2024-09-14T12:01:18.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.616+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.lR6knN88JnwG7FqthIMy1UOjfSGRvyS_0 2024-09-14T12:01:18.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.616+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14245200750771685047', time=2024-09-14T13:35:41.645323+0000, chain.objs.size()=1 2024-09-14T12:01:18.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.616+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.4fuz-m6oTDBQMXtmVapeIkA9pgDivnE_0 2024-09-14T12:01:18.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.616+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8095503033624848423', time=2024-09-14T13:35:42.166906+0000, chain.objs.size()=1 2024-09-14T12:01:18.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.616+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.UDU5xAMgsUU7KKMfvMweFwOlkhvx5QX_0 2024-09-14T12:01:18.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.616+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1924910798499200874', time=2024-09-14T13:35:42.680818+0000, chain.objs.size()=1 2024-09-14T12:01:18.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.616+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.BUzKjH7SgDmCgrbppzbywtJnjinMA94_0 2024-09-14T12:01:18.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.616+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15698650246838076180', time=2024-09-14T13:35:43.769975+0000, chain.objs.size()=1 2024-09-14T12:01:18.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.616+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.n66W_SGSsv2mAlzB02GVXPWhBv9Ic7Z_0 2024-09-14T12:01:18.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.616+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17308681869383953331', time=2024-09-14T13:35:44.036774+0000, chain.objs.size()=1 2024-09-14T12:01:18.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.616+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.7Dk1NaOKLZvG8OQuhOoVm1TNyMN7qYv_0 2024-09-14T12:01:18.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.616+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7864136911863137406', time=2024-09-14T13:35:44.263061+0000, chain.objs.size()=1 2024-09-14T12:01:18.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.616+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.zbtgN3YjcbRrOxvYuDg_PIgw7LduNn2_0 2024-09-14T12:01:18.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.616+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3468034533999732804', time=2024-09-14T13:35:44.310655+0000, chain.objs.size()=1 2024-09-14T12:01:18.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.616+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.hqdf4XcZ78whKQL1RCHj7fEyw7xIzAw_0 2024-09-14T12:01:18.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.617+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11846311231696008468', time=2024-09-14T13:35:45.655267+0000, chain.objs.size()=1 2024-09-14T12:01:18.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.617+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.xiAypUjYv_84jIuiI9itiajy25HJBkL_0 2024-09-14T12:01:18.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.619+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10558578981141646565', time=2024-09-14T13:35:46.580804+0000, chain.objs.size()=1 2024-09-14T12:01:18.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.619+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.GRSybxuqW60ID83UhWRHjntFaxl_jf3_0 2024-09-14T12:01:18.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.619+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3728982783743399101', time=2024-09-14T13:35:47.220398+0000, chain.objs.size()=1 2024-09-14T12:01:18.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.619+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.UizMk7SokWqRB2EfeixxCBoj9hUIH8g_0 2024-09-14T12:01:18.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.619+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3712200308222212865', time=2024-09-14T13:35:48.269196+0000, chain.objs.size()=1 2024-09-14T12:01:18.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.619+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.I9CWLcGenrMbyLwHih08NdBsDRnpT6V_0 2024-09-14T12:01:18.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.619+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11193376578154072752', time=2024-09-14T13:35:48.677045+0000, chain.objs.size()=1 2024-09-14T12:01:18.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.619+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.-ZVprNu5LWvygmxV3jI2UvI682AxN5y_0 2024-09-14T12:01:18.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.619+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.307039130691534368', time=2024-09-14T13:35:48.817873+0000, chain.objs.size()=1 2024-09-14T12:01:18.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.619+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.cc6Osu9Z1KgRnyJtNhfbu0KCOqU3qLw_0 2024-09-14T12:01:18.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.619+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15228058952673855741', time=2024-09-14T13:35:49.776555+0000, chain.objs.size()=1 2024-09-14T12:01:18.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.619+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.lEuMLMRrJYWoAL4YIvj23NF1oNzNY4q_0 2024-09-14T12:01:18.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.619+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15975634969100514249', time=2024-09-14T13:35:50.012592+0000, chain.objs.size()=1 2024-09-14T12:01:18.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.619+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Qsi08LyfuoYrKEgZtoBVxfKZj1Avajm_0 2024-09-14T12:01:18.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.620+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13022564062237736797', time=2024-09-14T13:35:51.141662+0000, chain.objs.size()=1 2024-09-14T12:01:18.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.620+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.txZheMGpc5IMk6kwv_pnax6a8ZlBK76_0 2024-09-14T12:01:18.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.621+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13680989745588302453', time=2024-09-14T13:35:51.632743+0000, chain.objs.size()=1 2024-09-14T12:01:18.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.621+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.-x2RaYvTpsdk2wbRz7bkkwXOO-0CUHN_0 2024-09-14T12:01:18.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.622+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2693083663571862266', time=2024-09-14T13:36:15.673315+0000, chain.objs.size()=1 2024-09-14T12:01:18.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.622+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.347__shadow_.mnrffpj70neb0pRG3lbCj3h0u-2TNRJ_0 2024-09-14T12:01:18.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.622+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15340866773516773279', time=2024-09-14T13:37:21.448539+0000, chain.objs.size()=1 2024-09-14T12:01:18.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.622+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.410__shadow_.gxRXbv-uFCWaS2SnVkx05SQqcNB7rZ3_0 2024-09-14T12:01:18.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.622+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1313201124888403389', time=2024-09-14T13:37:43.302031+0000, chain.objs.size()=1 2024-09-14T12:01:18.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.622+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.430__shadow_.cgQaKXNjltRlHrl1FZPqw3qpGiApdOn_0 2024-09-14T12:01:18.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.623+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7916821366532276465', time=2024-09-14T13:38:19.513532+0000, chain.objs.size()=1 2024-09-14T12:01:18.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.623+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.460__shadow_.SOuitIPsA5yGSG-Fu8MFoCuLyCG3EVd_0 2024-09-14T12:01:18.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.623+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3900981644175860209', time=2024-09-14T13:38:26.974596+0000, chain.objs.size()=1 2024-09-14T12:01:18.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.623+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.465__shadow_.9vnkPcjxmqx8Fe_V_Z7-O8F-ciXMevg_0 2024-09-14T12:01:18.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.623+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2942295868436687224', time=2024-09-14T13:38:42.825820+0000, chain.objs.size()=1 2024-09-14T12:01:18.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.623+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.484__shadow_.NumyZCHWve-YJLIUCa_OZsOluv15jCq_0 2024-09-14T12:01:18.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.623+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14758171280590609811', time=2024-09-14T13:38:44.079244+0000, chain.objs.size()=1 2024-09-14T12:01:18.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.623+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.485__shadow_.zyW2pPZVwlbsi4emQrPXBUKi0cuf2xs_0 2024-09-14T12:01:18.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.623+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1438263034291990327', time=2024-09-14T13:39:00.533427+0000, chain.objs.size()=1 2024-09-14T12:01:18.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.623+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.498__shadow_.7_VLUs8Qo6c7r4g5ffczowRwsRqkXgj_0 2024-09-14T12:01:18.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.623+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9017909744169008150', time=2024-09-14T13:45:32.569083+0000, chain.objs.size()=1 2024-09-14T12:01:18.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.623+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.567__shadow_.JNsEnSjSTHfUFKfqDeYOvnxH9Xqy3yg_0 2024-09-14T12:01:18.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.623+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6873757029493850960', time=2024-09-14T13:46:17.293527+0000, chain.objs.size()=1 2024-09-14T12:01:18.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.623+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:Iod9FW35Jdt8EmEydHF-JZ40UtzaXQZ_.e63pxxqCaYbB_nCr6AmaCJuV1miMN3t_0 2024-09-14T12:01:18.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.624+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8269954397557315822', time=2024-09-14T13:46:18.254090+0000, chain.objs.size()=1 2024-09-14T12:01:18.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.624+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:A26rH.aFdq09NXjml75t1zYD5tLznqL_.8_EZIDDbWMpYHMkl1PA9_D62wFZt8Yu_0 2024-09-14T12:01:18.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.624+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15825723490133557389', time=2024-09-14T13:51:43.829374+0000, chain.objs.size()=1 2024-09-14T12:01:18.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.624+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.620__shadow_.MIlrbFOQ4ZYpE7LL0S6ApskSN_JHFZJ_0 2024-09-14T12:01:18.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.625+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12226530406761324923', time=2024-09-14T13:53:14.043549+0000, chain.objs.size()=2 2024-09-14T12:01:18.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.625+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.650__shadow_.Gj5-l1B9PmkjmiDLrIDCERaQEqyFtV3_0 2024-09-14T12:01:18.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.625+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.650__shadow_.Gj5-l1B9PmkjmiDLrIDCERaQEqyFtV3_1 2024-09-14T12:01:18.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.631+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/49661 2024-09-14T12:01:18.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.633+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T12:01:18.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.633+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18009313141502560120', time=2024-09-14T13:53:56.301208+0000, chain.objs.size()=1 2024-09-14T12:01:18.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.633+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.665__shadow_.SXYaoXDB_C4USZv4pDtt6G7jUjE4jNH_0 2024-09-14T12:01:18.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.633+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6932743042920145714', time=2024-09-14T13:54:22.472438+0000, chain.objs.size()=1 2024-09-14T12:01:18.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.633+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.693__shadow:d07km1M7DbvhtXfIkRHRaZf0weJai-N_.rqlXq-bsF05BJDhdRkmClc5ga9oWf20_0 2024-09-14T12:01:18.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.633+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15041114388890280110', time=2024-09-14T13:54:34.905410+0000, chain.objs.size()=1 2024-09-14T12:01:18.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.633+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.705__shadow:06BwjseWzaBQGuf32RUkixi76NfxjkG_.qqj5Mhy2enYmqr0olWW3lVvvs5JLZQC_0 2024-09-14T12:01:18.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.633+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.949514844989092351', time=2024-09-14T13:56:03.074650+0000, chain.objs.size()=1 2024-09-14T12:01:18.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.633+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.746__shadow_.r2XP63U_WWGbzHSCpAPlPKHOnmvKvEZ_0 2024-09-14T12:01:18.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.636+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:18.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.638+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T12:01:18.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.640+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:18.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.640+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:18.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48236' 2024-09-14T12:01:18.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~WuBuM6cRKpwarTe1-z2BL38FX6o_mLO', time=2024-09-14T13:29:34.827538+0000, chain.objs.size()=1 2024-09-14T12:01:18.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.202__multipart_mymultipart.2~WuBuM6cRKpwarTe1-z2BL38FX6o_mLO.1 2024-09-14T12:01:18.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6238971602366491924', time=2024-09-14T13:31:33.777818+0000, chain.objs.size()=1 2024-09-14T12:01:18.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.232__shadow_.Hoz_yVGqeElTVHx8pXAezNoSnJ8K7vn_0 2024-09-14T12:01:18.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13160327549903904722', time=2024-09-14T13:31:48.759008+0000, chain.objs.size()=1 2024-09-14T12:01:18.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.244__shadow_.3QOriKwt8pYhGQrI0GeMiQWQEJ8qLzI_0 2024-09-14T12:01:18.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7841076064147203322', time=2024-09-14T13:31:55.111453+0000, chain.objs.size()=1 2024-09-14T12:01:18.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.249__shadow_.BnNYS5jnTR--vzMl5oc0kR0bZjMz8_L_0 2024-09-14T12:01:18.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.980040460115119975', time=2024-09-14T13:31:59.524542+0000, chain.objs.size()=1 2024-09-14T12:01:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.253__shadow_.0sypSH14DRxGkoR_xPZ9OxlofPJBIfW_0 2024-09-14T12:01:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.551329163585259527', time=2024-09-14T13:32:01.696524+0000, chain.objs.size()=1 2024-09-14T12:01:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.255__shadow_.jW7eWLAH4HzxS1QR_LEXJf5yc4hDhz5_0 2024-09-14T12:01:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16074008567512744151', time=2024-09-14T13:32:47.570894+0000, chain.objs.size()=1 2024-09-14T12:01:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Cl5qiyu-pSlbd7k0U3kuhgEN1HnexrF_0 2024-09-14T12:01:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11587481907764432195', time=2024-09-14T13:32:47.721038+0000, chain.objs.size()=1 2024-09-14T12:01:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.02qeLW4KzwmjYQZ8KtTEVBPuiUb5P3u_0 2024-09-14T12:01:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12355875739896238634', time=2024-09-14T13:32:47.737269+0000, chain.objs.size()=1 2024-09-14T12:01:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.abExz2m3pSZVkGRK9fUkZIrwVjuL9eP_0 2024-09-14T12:01:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11896254301104203676', time=2024-09-14T13:32:48.038508+0000, chain.objs.size()=1 2024-09-14T12:01:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.sXNE0JaXiKGxVDamcjdblo6P_N2_AZL_0 2024-09-14T12:01:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5671522842962443160', time=2024-09-14T13:32:48.387151+0000, chain.objs.size()=1 2024-09-14T12:01:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.nhlx2mtGvSy5XwS8E7iiizApcCIAB1b_0 2024-09-14T12:01:18.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8778126180846176509', time=2024-09-14T13:32:48.453383+0000, chain.objs.size()=1 2024-09-14T12:01:18.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.641+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.VASCU7zrZwnJhv4iatGPoNHqfvAqpz__0 2024-09-14T12:01:18.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.644+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7984281685184186830', time=2024-09-14T13:32:48.477996+0000, chain.objs.size()=1 2024-09-14T12:01:18.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.644+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.T2BFEFPr285wKtc067un3NnbpJ0sJ6t_0 2024-09-14T12:01:18.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.644+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8009722461622284458', time=2024-09-14T13:32:49.402183+0000, chain.objs.size()=1 2024-09-14T12:01:18.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.644+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.BNNIavx0VumZXHIdUxsTM8TrShYuEHx_0 2024-09-14T12:01:18.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.644+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3074987153307590605', time=2024-09-14T13:32:49.702228+0000, chain.objs.size()=1 2024-09-14T12:01:18.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.644+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.01XqEyhHfCjG07d-5QBW96PC5o9ZwzM_0 2024-09-14T12:01:18.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.644+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14885849479058735638', time=2024-09-14T13:32:50.081101+0000, chain.objs.size()=1 2024-09-14T12:01:18.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.644+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.FlfLAzvbCqOKd4Yg-RvyOdfRhrfuenN_0 2024-09-14T12:01:18.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.644+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15741636222238301566', time=2024-09-14T13:32:50.625305+0000, chain.objs.size()=1 2024-09-14T12:01:18.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.644+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.bkDp1mamwqkgqtdyNGQDtdX1_OFnLEB_0 2024-09-14T12:01:18.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.644+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10909269966993902547', time=2024-09-14T13:32:51.047014+0000, chain.objs.size()=1 2024-09-14T12:01:18.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.644+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Il78tOgoemCcqsNdL0a_1g4Ad68xeoR_0 2024-09-14T12:01:18.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.644+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4027363944233058227', time=2024-09-14T13:32:51.251207+0000, chain.objs.size()=1 2024-09-14T12:01:18.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.644+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.8K3iCTKbV5hfDAyLZozACEzUzFbOxYF_0 2024-09-14T12:01:18.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.645+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3707243020323705610', time=2024-09-14T13:32:51.364792+0000, chain.objs.size()=1 2024-09-14T12:01:18.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.645+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.zC8O27Bvjx71mCYfVZvVMlQhRsSZKgj_0 2024-09-14T12:01:18.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.645+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9173341454655738038', time=2024-09-14T13:32:52.319571+0000, chain.objs.size()=1 2024-09-14T12:01:18.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.645+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.BsvdqkEOKm7ZY1pXiL3OTtKOLykMl0V_0 2024-09-14T12:01:18.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.645+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13698233119804228808', time=2024-09-14T13:32:52.356765+0000, chain.objs.size()=1 2024-09-14T12:01:18.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.645+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.lfEzwn3yLtbe1dT4CGRNw-YP1uRxo0o_0 2024-09-14T12:01:18.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.645+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15233739228812422659', time=2024-09-14T13:32:52.432142+0000, chain.objs.size()=1 2024-09-14T12:01:18.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.645+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ZSgvYhH_hIq91HBO8iAvNb7vsI57YjL_0 2024-09-14T12:01:18.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.647+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1599723704123372996', time=2024-09-14T13:32:52.790016+0000, chain.objs.size()=1 2024-09-14T12:01:18.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.647+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.TWC2RW9_Y14sie8C5UiVAYTJ2Xz0wND_0 2024-09-14T12:01:18.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.648+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7383644813822307546', time=2024-09-14T13:32:52.814737+0000, chain.objs.size()=1 2024-09-14T12:01:18.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.648+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.PkNXndvFLoa9FM5zlvZ1GgAK2pGVk73_0 2024-09-14T12:01:18.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.648+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12575713037687820094', time=2024-09-14T13:32:53.015985+0000, chain.objs.size()=1 2024-09-14T12:01:18.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.648+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.l95RkuJAZhOuHODN3swSWGDBhVOfNLh_0 2024-09-14T12:01:18.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.648+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16091910388990098901', time=2024-09-14T13:32:53.097424+0000, chain.objs.size()=1 2024-09-14T12:01:18.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.648+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.sLtlyHS42eRf6qe6mma4x95R55OIIHG_0 2024-09-14T12:01:18.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.648+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.100638182737579169', time=2024-09-14T13:32:53.767899+0000, chain.objs.size()=1 2024-09-14T12:01:18.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.648+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.RaMx7f6iqEHLf7RE8mTwAZGYE36eSG1_0 2024-09-14T12:01:18.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.648+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12569766490820568447', time=2024-09-14T13:32:54.131849+0000, chain.objs.size()=1 2024-09-14T12:01:18.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.648+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.vsIwUFN1oWAT0KJ9p6Kl7N4SQGBZABc_0 2024-09-14T12:01:18.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.648+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5922092238048625000', time=2024-09-14T13:32:54.155208+0000, chain.objs.size()=1 2024-09-14T12:01:18.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.648+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.szeTzI_q6x3Z-af_HWqSwG9LRExIe2i_0 2024-09-14T12:01:18.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.650+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14392664087812072465', time=2024-09-14T13:32:54.209082+0000, chain.objs.size()=1 2024-09-14T12:01:18.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.650+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Y5VpmZqnxrqmG8iL6sY7Ta1QmkXClnY_0 2024-09-14T12:01:18.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.650+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12628677943031135041', time=2024-09-14T13:32:56.557903+0000, chain.objs.size()=1 2024-09-14T12:01:18.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.650+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.NnV4Q8LKijevaon38Girx3tSRjwq8RF_0 2024-09-14T12:01:18.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.650+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6647375000731301544', time=2024-09-14T13:32:56.765898+0000, chain.objs.size()=1 2024-09-14T12:01:18.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.650+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.IiWMiiLr_t3k3MO7sPc6J5GpH_Lgkx5_0 2024-09-14T12:01:18.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.650+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.782975181966029558', time=2024-09-14T13:32:57.411754+0000, chain.objs.size()=1 2024-09-14T12:01:18.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.650+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.zviExDjRzm1ppgOrcalJXCePhzs802j_0 2024-09-14T12:01:18.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.650+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11735801472562985208', time=2024-09-14T13:33:08.480661+0000, chain.objs.size()=1 2024-09-14T12:01:18.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.650+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.272__shadow_.FcNBvadxQXPcbeXr6-GCegwqLYM8xS__0 2024-09-14T12:01:18.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.650+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2103616021524241789', time=2024-09-14T13:33:17.087540+0000, chain.objs.size()=1 2024-09-14T12:01:18.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.650+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.280__shadow_.NlfqJ7nBMLJzq1Nnu2JTVQPiZJBaXgV_0 2024-09-14T12:01:18.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.653+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9983020044541309223', time=2024-09-14T13:33:22.597755+0000, chain.objs.size()=1 2024-09-14T12:01:18.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.653+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.285__shadow_.WbANA1CWAld3riwoPccbnhXf1cxaZWy_0 2024-09-14T12:01:18.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.653+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2534499435304929424', time=2024-09-14T13:33:33.247545+0000, chain.objs.size()=1 2024-09-14T12:01:18.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.653+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.LydWD1dfXOK-TMrM8awhPq9GHIAWPFT_0 2024-09-14T12:01:18.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.653+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6372570315701378132', time=2024-09-14T13:34:51.666507+0000, chain.objs.size()=1 2024-09-14T12:01:18.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.653+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.i80deh3nDQhEc6hVggGNaRh9q7oNNKy_0 2024-09-14T12:01:18.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.653+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5015591747678261236', time=2024-09-14T13:34:51.813799+0000, chain.objs.size()=1 2024-09-14T12:01:18.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.653+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.u3DhmP8E2yCU6sJU3K0Y8708bBv07nq_0 2024-09-14T12:01:18.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.654+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13130530970379212409', time=2024-09-14T13:34:54.198345+0000, chain.objs.size()=1 2024-09-14T12:01:18.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.654+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.7Xs8Ds67laVfSYz2TAZSKyp61XW8SVO_0 2024-09-14T12:01:18.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.654+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11214471908900277320', time=2024-09-14T13:34:54.974789+0000, chain.objs.size()=1 2024-09-14T12:01:18.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.654+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Xd0YdBuzpvV-A0abck18rduq2mDEzzI_0 2024-09-14T12:01:18.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.654+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15001042956007541677', time=2024-09-14T13:34:55.541397+0000, chain.objs.size()=1 2024-09-14T12:01:18.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.654+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.x-j7Pl6Gwfa672dIrE_IFSmX-GHqFN7_0 2024-09-14T12:01:18.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.656+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17721025168717609226', time=2024-09-14T13:34:56.200646+0000, chain.objs.size()=1 2024-09-14T12:01:18.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.656+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.xnMpGvyNr3U0txSAhLEG8jUE1RNg6f3_0 2024-09-14T12:01:18.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.656+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.33315720729765492', time=2024-09-14T13:34:56.223451+0000, chain.objs.size()=1 2024-09-14T12:01:18.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.656+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.bbta-ap_YsfWeKruJFB_co7oaF3LnfU_0 2024-09-14T12:01:18.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.656+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4366921267673557988', time=2024-09-14T13:34:56.316861+0000, chain.objs.size()=1 2024-09-14T12:01:18.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.657+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.j8XyWj9vNyqoYERxGQeYwKhZm66TEjK_0 2024-09-14T12:01:18.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.657+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4184006872892870034', time=2024-09-14T13:34:56.365805+0000, chain.objs.size()=1 2024-09-14T12:01:18.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.657+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.miDoD0BoljCJVupu7xb-dHLP3R7uGb7_0 2024-09-14T12:01:18.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.657+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3570996088887545309', time=2024-09-14T13:34:56.649459+0000, chain.objs.size()=1 2024-09-14T12:01:18.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.657+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Ab5GVHtHCcIEZofuyBFlBMuprbsOe_2_0 2024-09-14T12:01:18.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.657+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11484131934469668774', time=2024-09-14T13:34:57.209039+0000, chain.objs.size()=1 2024-09-14T12:01:18.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.657+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.NwzdtZoQwrAJwnFj6BUFe6c8Af2FcoD_0 2024-09-14T12:01:18.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.657+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14903386214721561317', time=2024-09-14T13:34:57.644859+0000, chain.objs.size()=1 2024-09-14T12:01:18.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.657+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.eoH_kEFk1vI5KWWmrKKy5Si7K6PHimW_0 2024-09-14T12:01:18.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.657+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5428691598536539925', time=2024-09-14T13:34:57.964812+0000, chain.objs.size()=1 2024-09-14T12:01:18.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.657+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.u8SptllZ4sCA4L5N2RZ0F-Bqe7SPKi2_0 2024-09-14T12:01:18.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.657+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10430639906465957139', time=2024-09-14T13:34:58.030303+0000, chain.objs.size()=1 2024-09-14T12:01:18.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.657+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.g354H-UI5ZBWAQLU6VOLIBYTejXbzaH_0 2024-09-14T12:01:18.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.658+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7530256207367916298', time=2024-09-14T13:34:58.154304+0000, chain.objs.size()=1 2024-09-14T12:01:18.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.658+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.25Kuh0mjq0HRIFcQRiCfXz34k5blSOm_0 2024-09-14T12:01:18.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.658+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5213994184164499757', time=2024-09-14T13:34:58.430787+0000, chain.objs.size()=1 2024-09-14T12:01:18.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.658+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.vyyNmWtViQWSknSlHxzkNOwYs_67HBd_0 2024-09-14T12:01:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.661+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3992170805592163897', time=2024-09-14T13:34:58.632915+0000, chain.objs.size()=1 2024-09-14T12:01:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.661+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.i7SHQpPSgGGJTcMXX-2NmNpe1O0pCL7_0 2024-09-14T12:01:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.661+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.270917846649803926', time=2024-09-14T13:34:58.711689+0000, chain.objs.size()=1 2024-09-14T12:01:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.661+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ApWBLWwReKysSRUV8jyLigFsiDRD-8N_0 2024-09-14T12:01:18.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.661+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2516931837913093682', time=2024-09-14T13:35:02.333839+0000, chain.objs.size()=1 2024-09-14T12:01:18.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.661+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.yl9o4IdLINVTgr0bExvR1hrxLUa3x2x_0 2024-09-14T12:01:18.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.661+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18041787789384856838', time=2024-09-14T13:35:02.393619+0000, chain.objs.size()=1 2024-09-14T12:01:18.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.661+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.gMLzrdgSp8vwU6cUE5DPqgBPOagQTLF_0 2024-09-14T12:01:18.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.661+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17112983215425726631', time=2024-09-14T13:35:02.397254+0000, chain.objs.size()=1 2024-09-14T12:01:18.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.661+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.I7SB57MBXblQQzmDih681RS-XH-ZzHB_0 2024-09-14T12:01:18.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.661+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3816971604691895172', time=2024-09-14T13:35:02.529602+0000, chain.objs.size()=1 2024-09-14T12:01:18.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.661+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.zM19GxAcMtlDKxa7n3NPeKpRuSbt9aN_0 2024-09-14T12:01:18.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.661+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4382664752410509258', time=2024-09-14T13:35:02.625897+0000, chain.objs.size()=1 2024-09-14T12:01:18.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.661+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.KK8X0Ki2NQxLOn4yMGcNS2BEemZ5VAq_0 2024-09-14T12:01:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.662+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14261923809250320873', time=2024-09-14T13:35:41.758154+0000, chain.objs.size()=1 2024-09-14T12:01:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.662+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.MBaw1u6s3-4sUuVXp7XYeTxCm0VB7YX_0 2024-09-14T12:01:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.662+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14988440886473451351', time=2024-09-14T13:35:41.812719+0000, chain.objs.size()=1 2024-09-14T12:01:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.662+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.BYqzpfbNWq8YLvkHbEow0KrbpYrYigb_0 2024-09-14T12:01:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.662+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14954296919916422854', time=2024-09-14T13:35:41.933108+0000, chain.objs.size()=1 2024-09-14T12:01:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.662+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.MHSsRbtejGtz62WfCENwX-nPUToGOqt_0 2024-09-14T12:01:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.662+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12590973865255424643', time=2024-09-14T13:35:41.949752+0000, chain.objs.size()=1 2024-09-14T12:01:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.662+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.PTpGEORBgjQbXnq884VqKUKMrmn6tPv_0 2024-09-14T12:01:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.665+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3363113711368492207', time=2024-09-14T13:35:42.075815+0000, chain.objs.size()=1 2024-09-14T12:01:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.665+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.C63KASonHY9shF0xCAFz1JqaFAJO1SE_0 2024-09-14T12:01:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.665+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3099227779789957882', time=2024-09-14T13:35:42.096097+0000, chain.objs.size()=1 2024-09-14T12:01:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.665+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.5egjZd7QHPnHd0bGxs2WXoLXWm5cHhw_0 2024-09-14T12:01:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.665+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7011997247228115326', time=2024-09-14T13:35:42.096806+0000, chain.objs.size()=1 2024-09-14T12:01:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.665+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.3mfyG9OvRqcw4UI9z4FRW7Khy7v_X9B_0 2024-09-14T12:01:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.665+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3297412792592832418', time=2024-09-14T13:35:42.386061+0000, chain.objs.size()=1 2024-09-14T12:01:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.665+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.vmZdye_Mn5UEvbqNPFDivW40cy4zcsE_0 2024-09-14T12:01:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.665+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1041599861989420843', time=2024-09-14T13:35:42.458533+0000, chain.objs.size()=1 2024-09-14T12:01:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.665+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Cff5Oy-oj3n7gx3-XVfIbsEJuiMOJmn_0 2024-09-14T12:01:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.665+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11098818091606832136', time=2024-09-14T13:35:43.624978+0000, chain.objs.size()=1 2024-09-14T12:01:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.665+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ZKykrBu8cFPxjtPw2RgT7b56b4nPKwO_0 2024-09-14T12:01:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.665+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.135577697279973293', time=2024-09-14T13:35:43.734951+0000, chain.objs.size()=1 2024-09-14T12:01:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.665+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.fAS3ynyJKm1FGaxVgPnCouGpt0mZkwI_0 2024-09-14T12:01:18.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.665+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16210598579326308438', time=2024-09-14T13:35:43.825835+0000, chain.objs.size()=1 2024-09-14T12:01:18.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.665+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.AdsIvlX4X_Nc17KX3uuBB3twtgczFbc_0 2024-09-14T12:01:18.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.666+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11840909817081282218', time=2024-09-14T13:35:44.258270+0000, chain.objs.size()=1 2024-09-14T12:01:18.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.666+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.lMAST0lIs6Of5OG3MYtU_ej78bkiIzI_0 2024-09-14T12:01:18.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.667+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.688641766351282866', time=2024-09-14T13:35:45.337032+0000, chain.objs.size()=1 2024-09-14T12:01:18.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.667+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.zi77SMyhO8Rq3FDgpzw3Ik7KdItRLIZ_0 2024-09-14T12:01:18.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.667+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6829439105592593254', time=2024-09-14T13:35:45.715991+0000, chain.objs.size()=1 2024-09-14T12:01:18.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.667+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.b6bcDyymiJBi4KsG4xc4xWk8bJ_Fz2R_0 2024-09-14T12:01:18.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.668+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16225939658985841597', time=2024-09-14T13:35:45.821722+0000, chain.objs.size()=1 2024-09-14T12:01:18.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.668+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.TKt9eANux4roEV6OocdKzwbbDfPJ3hy_0 2024-09-14T12:01:18.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.668+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10731897633075092366', time=2024-09-14T13:35:46.481347+0000, chain.objs.size()=1 2024-09-14T12:01:18.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.668+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.9uSGrPZmtF3zX1CElGCw6zAME33zUiX_0 2024-09-14T12:01:18.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.668+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10352517286719271300', time=2024-09-14T13:35:46.601383+0000, chain.objs.size()=1 2024-09-14T12:01:18.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.668+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.bN5sz51O2AXtirG8sfXFY1C6mdBP2xp_0 2024-09-14T12:01:18.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.668+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13528342058984010731', time=2024-09-14T13:35:46.872159+0000, chain.objs.size()=1 2024-09-14T12:01:18.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.668+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.5ZbnCTgpNC-V0-QGUlsvtbPVSSwb5lR_0 2024-09-14T12:01:18.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.668+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1973102716580385479', time=2024-09-14T13:35:47.027205+0000, chain.objs.size()=1 2024-09-14T12:01:18.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.668+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.M4NheNfVypGf3BdB5crm1Rimfqqvew4_0 2024-09-14T12:01:18.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.670+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1227228149730253342', time=2024-09-14T13:35:47.263404+0000, chain.objs.size()=1 2024-09-14T12:01:18.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.670+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.QjK13Ja03CkoeRg8m0queA4EqkL1oUR_0 2024-09-14T12:01:18.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.670+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17886420400831678400', time=2024-09-14T13:35:47.332621+0000, chain.objs.size()=1 2024-09-14T12:01:18.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.670+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.92r-xeauYMCZJGNRi2ubWdRZwHWrRuM_0 2024-09-14T12:01:18.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.670+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.829296682987562105', time=2024-09-14T13:35:47.942147+0000, chain.objs.size()=1 2024-09-14T12:01:18.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.670+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.dBJ2yuiRe8kLYPQxYvBpkCcHY1YH0Gz_0 2024-09-14T12:01:18.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.670+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14812731909768132227', time=2024-09-14T13:35:48.362660+0000, chain.objs.size()=1 2024-09-14T12:01:18.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.670+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.BSO22BiuRydBpAQn_cCcD3jeL4WGjlV_0 2024-09-14T12:01:18.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.671+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17134456768246731271', time=2024-09-14T13:35:48.668420+0000, chain.objs.size()=1 2024-09-14T12:01:18.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.671+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.uEN07LAWaRQhxSoqlfC20HV2OAbgatm_0 2024-09-14T12:01:18.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.671+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7027947272116134777', time=2024-09-14T13:35:48.793967+0000, chain.objs.size()=1 2024-09-14T12:01:18.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.671+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.v5AP-usfW8-pfRcKltbU9Qm6FPLF8Kl_0 2024-09-14T12:01:18.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.671+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14005621949469563309', time=2024-09-14T13:35:48.805407+0000, chain.objs.size()=1 2024-09-14T12:01:18.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.671+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.mA1LV4mjcmfFki0yEGNPoVbRTaIKBd9_0 2024-09-14T12:01:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.673+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1831608556767040228', time=2024-09-14T13:35:49.235313+0000, chain.objs.size()=1 2024-09-14T12:01:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.673+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.tLjUGfdkLMSNg8IFCb2KNs7ELaF-3AQ_0 2024-09-14T12:01:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.673+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10374184767421200458', time=2024-09-14T13:35:49.314831+0000, chain.objs.size()=1 2024-09-14T12:01:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.673+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.5mD2RfmPwFszrKhAL5tFjHPlIR0_Uea_0 2024-09-14T12:01:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.673+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8240959228694209020', time=2024-09-14T13:35:50.057983+0000, chain.objs.size()=1 2024-09-14T12:01:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.673+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.mYBEHfdcu4upCrkn7B5GVdEP-ch8Bwe_0 2024-09-14T12:01:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.673+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9367975405806822810', time=2024-09-14T13:35:50.151787+0000, chain.objs.size()=1 2024-09-14T12:01:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.673+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.3rJrkVJdfkZoQDYn9O79PFCRQ6hQjJT_0 2024-09-14T12:01:18.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.673+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11659350398448984103', time=2024-09-14T13:35:50.612527+0000, chain.objs.size()=1 2024-09-14T12:01:18.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.673+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.mul89rQE06UO3Igb-9XvWv-QbmuRyx-_0 2024-09-14T12:01:18.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.674+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2305035172157019644', time=2024-09-14T13:35:50.826916+0000, chain.objs.size()=1 2024-09-14T12:01:18.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.674+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Vmv-raHh7638MSPJ4NsjfN4MD9cFTwR_0 2024-09-14T12:01:18.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.674+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6549246215223229995', time=2024-09-14T13:35:51.384901+0000, chain.objs.size()=1 2024-09-14T12:01:18.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.674+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.xmyXX5XovEEPzYyDFyU0IEewStphO0r_0 2024-09-14T12:01:18.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.674+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5109739288538782160', time=2024-09-14T13:35:51.545923+0000, chain.objs.size()=1 2024-09-14T12:01:18.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.674+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.7p2_6L5VApXXAzpH62b1EYcLGMZ3lI8_0 2024-09-14T12:01:18.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.676+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18082091530276615805', time=2024-09-14T13:35:51.546509+0000, chain.objs.size()=1 2024-09-14T12:01:18.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.676+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.s8Ab4u_5iKzoqmOkuKIDUAK1xC_U3uF_0 2024-09-14T12:01:18.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.676+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.781111797970344269', time=2024-09-14T13:35:52.780534+0000, chain.objs.size()=1 2024-09-14T12:01:18.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.676+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.HEGpAHHUHhFJVohPmZ-lj6mBOowzyfU_0 2024-09-14T12:01:18.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.676+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10176675261623369755', time=2024-09-14T13:36:10.708344+0000, chain.objs.size()=1 2024-09-14T12:01:18.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.676+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.342__shadow_.hiXypcOVajzv0-EZDa6trypnW_TWPUY_0 2024-09-14T12:01:18.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.676+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6886289543635769069', time=2024-09-14T13:36:45.485327+0000, chain.objs.size()=1 2024-09-14T12:01:18.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.676+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.377__shadow_.XPzb7NUSAXX8u3E34nNeXy8Vl3lRFov_0 2024-09-14T12:01:18.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.679+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/48236 2024-09-14T12:01:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.681+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T12:01:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.681+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~viTcC8UkIZvVhJ6mFvsAqoaHf8cntkK', time=2024-09-14T13:42:27.397691+0000, chain.objs.size()=1 2024-09-14T12:01:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.681+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~viTcC8UkIZvVhJ6mFvsAqoaHf8cntkK.1 2024-09-14T12:01:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.681+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~viTcC8UkIZvVhJ6mFvsAqoaHf8cntkK', time=2024-09-14T13:42:27.401704+0000, chain.objs.size()=1 2024-09-14T12:01:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.681+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~viTcC8UkIZvVhJ6mFvsAqoaHf8cntkK.2 2024-09-14T12:01:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.681+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~viTcC8UkIZvVhJ6mFvsAqoaHf8cntkK', time=2024-09-14T13:42:27.405142+0000, chain.objs.size()=1 2024-09-14T12:01:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.681+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~viTcC8UkIZvVhJ6mFvsAqoaHf8cntkK.3 2024-09-14T12:01:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.681+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~viTcC8UkIZvVhJ6mFvsAqoaHf8cntkK', time=2024-09-14T13:42:27.408942+0000, chain.objs.size()=1 2024-09-14T12:01:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.681+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~viTcC8UkIZvVhJ6mFvsAqoaHf8cntkK.4 2024-09-14T12:01:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.681+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~viTcC8UkIZvVhJ6mFvsAqoaHf8cntkK', time=2024-09-14T13:42:27.412777+0000, chain.objs.size()=1 2024-09-14T12:01:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.681+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~viTcC8UkIZvVhJ6mFvsAqoaHf8cntkK.5 2024-09-14T12:01:18.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.681+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~viTcC8UkIZvVhJ6mFvsAqoaHf8cntkK', time=2024-09-14T13:42:27.416947+0000, chain.objs.size()=1 2024-09-14T12:01:18.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.681+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~viTcC8UkIZvVhJ6mFvsAqoaHf8cntkK.6 2024-09-14T12:01:18.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.681+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6767200891710068192', time=2024-09-14T13:42:50.238043+0000, chain.objs.size()=2 2024-09-14T12:01:18.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.681+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.524__multipart_mymultipart.2~jaQlHRRxgwkU0fxWCkoW7tGGgRP_ScM.1 2024-09-14T12:01:18.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.681+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.524__multipart_mymultipart.2~jaQlHRRxgwkU0fxWCkoW7tGGgRP_ScM.2 2024-09-14T12:01:18.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.681+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12303143093169433802', time=2024-09-14T13:45:05.103676+0000, chain.objs.size()=1 2024-09-14T12:01:18.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.681+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.557__shadow_.9YyO4-JGbggxa6temZCai_-5BTxwW9v_0 2024-09-14T12:01:18.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.681+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10827404095042352096', time=2024-09-14T13:45:16.166092+0000, chain.objs.size()=1 2024-09-14T12:01:18.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.681+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.559__shadow_.zZegAVnDLkQc3FCQwQ36vf_nx1Qd2GZ_0 2024-09-14T12:01:18.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.681+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5218665852355240753', time=2024-09-14T13:46:26.464579+0000, chain.objs.size()=1 2024-09-14T12:01:18.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.681+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:WsBbODFwK88kkeu6IO2R14W0LfAMacX_.77BTDEDs1bJjasD3IxLvJhNsRz8DYL8_0 2024-09-14T12:01:18.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.681+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11276585288581452686', time=2024-09-14T13:47:09.293779+0000, chain.objs.size()=1 2024-09-14T12:01:18.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.681+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.580__shadow:2kAwEDQEAO7rbwTfrfLIlvaqIxkLcb6_.93CA-npH2u_qukpS9quNUf37ayPP_74_0 2024-09-14T12:01:18.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.684+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6106523723786933375', time=2024-09-14T13:47:36.269867+0000, chain.objs.size()=1 2024-09-14T12:01:18.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.684+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.603__shadow_.Koq9_xko0zctolLYKZRv5_kmZa22K0M_0 2024-09-14T12:01:18.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.685+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11485980994637315747', time=2024-09-14T13:53:01.599285+0000, chain.objs.size()=1 2024-09-14T12:01:18.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.685+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.645__shadow_.T1Oaq8TusDKNMghbQCwe84GipqZLhao_0 2024-09-14T12:01:18.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.685+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10117486854869364757', time=2024-09-14T13:53:59.608771+0000, chain.objs.size()=1 2024-09-14T12:01:18.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.685+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.667__shadow_.9lc-UY_zGTzpaBIMo5YPGicdn2VyRKE_0 2024-09-14T12:01:18.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.685+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11302751278070096091', time=2024-09-14T13:54:28.621369+0000, chain.objs.size()=1 2024-09-14T12:01:18.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.685+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.699__shadow:0rxM0lqFsvv0Vwn8h4ZqGM5iaFAjmyJ_.WKpHz4seVBbrjoLeq-802xYWfP-u0yX_0 2024-09-14T12:01:18.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.687+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.690+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T12:01:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.691+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44890' 2024-09-14T12:01:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2794526821821795732', time=2024-09-14T13:31:59.529895+0000, chain.objs.size()=1 2024-09-14T12:01:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.253__shadow_.fiZ4lh1cl2yS5S4CI1hZcIj-zR-7YmS_0 2024-09-14T12:01:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14966726235924072048', time=2024-09-14T13:32:00.612030+0000, chain.objs.size()=1 2024-09-14T12:01:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.254__shadow_.rzDYsilpSM54Zw345oiMg93WTLt5MBw_0 2024-09-14T12:01:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11486898398240902759', time=2024-09-14T13:32:09.320599+0000, chain.objs.size()=1 2024-09-14T12:01:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.262__shadow_.3mWrVLQ-32okfavACDBIHccsU5WGWmO_0 2024-09-14T12:01:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9011473378218399027', time=2024-09-14T13:32:47.466160+0000, chain.objs.size()=1 2024-09-14T12:01:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.KjawRrgCcnW6Q9A7z92ef7GZY_f-sne_0 2024-09-14T12:01:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8902601388830952523', time=2024-09-14T13:32:47.544084+0000, chain.objs.size()=1 2024-09-14T12:01:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.RVOFbQhsZgXt0f-fbzeoec5mJrcxVW-_0 2024-09-14T12:01:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7544230918389139647', time=2024-09-14T13:32:47.958306+0000, chain.objs.size()=1 2024-09-14T12:01:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.r7UFjb-F6uqYvrBa9wfaQRUwZpgGfzD_0 2024-09-14T12:01:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16874620442697684726', time=2024-09-14T13:32:48.100375+0000, chain.objs.size()=1 2024-09-14T12:01:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.phfY3A-QSqSJOMyKtO0D40T0PQPCSpG_0 2024-09-14T12:01:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2686291160441128529', time=2024-09-14T13:32:49.212597+0000, chain.objs.size()=1 2024-09-14T12:01:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.3Kipf9FQKChtWMM_79vnOQnYM1loCeO_0 2024-09-14T12:01:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3496746810480631851', time=2024-09-14T13:32:49.362411+0000, chain.objs.size()=1 2024-09-14T12:01:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.IQslIVzhxnqSg12qbHJUiFoqBLSZoL6_0 2024-09-14T12:01:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8751775132653496282', time=2024-09-14T13:32:49.567799+0000, chain.objs.size()=1 2024-09-14T12:01:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ejxLPvD_YU4k7vTI5gbpyVAz8VsdzLO_0 2024-09-14T12:01:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4302913741052708108', time=2024-09-14T13:32:49.735812+0000, chain.objs.size()=1 2024-09-14T12:01:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.FyzQOGx5BzQ7H5yCRK2S3L1X1CEluRb_0 2024-09-14T12:01:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3304694809861859305', time=2024-09-14T13:32:49.796527+0000, chain.objs.size()=1 2024-09-14T12:01:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.692+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.5XZcsiSFP5s97yq04W_fJ_CM4UJdsRV_0 2024-09-14T12:01:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.696+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.215301413907000007', time=2024-09-14T13:32:49.997378+0000, chain.objs.size()=1 2024-09-14T12:01:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.696+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.TlakdSIFrBLel-KLN6JRf5t85oFmJJO_0 2024-09-14T12:01:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.696+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5873742691286672936', time=2024-09-14T13:32:50.552605+0000, chain.objs.size()=1 2024-09-14T12:01:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.696+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.o-4hUFDCOIWhZe12NKaLAa17FwXxVeh_0 2024-09-14T12:01:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.696+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9372818118113661156', time=2024-09-14T13:32:50.553158+0000, chain.objs.size()=1 2024-09-14T12:01:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.696+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.mZIeb81eCJQKMtuZmp3dyX3XGMlHyPj_0 2024-09-14T12:01:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.696+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7697406662469854963', time=2024-09-14T13:32:50.713026+0000, chain.objs.size()=1 2024-09-14T12:01:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.696+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.WBWuYnYGzKIa0exlx74E-YYrmJCJwkX_0 2024-09-14T12:01:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.696+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9278748454209567824', time=2024-09-14T13:32:50.789576+0000, chain.objs.size()=1 2024-09-14T12:01:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.696+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.1DPcJmUaIBj7mC4NL1g6RNFli0lfujX_0 2024-09-14T12:01:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.696+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12981067962521890963', time=2024-09-14T13:32:50.867492+0000, chain.objs.size()=1 2024-09-14T12:01:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.696+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.8ueM30F3JitfkC7wu71FPgvxWTZ7VHZ_0 2024-09-14T12:01:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.696+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4478187732951253464', time=2024-09-14T13:32:51.025448+0000, chain.objs.size()=1 2024-09-14T12:01:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.696+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.qAd7oNOg4kxw2upTb4ogBAct0qaW48d_0 2024-09-14T12:01:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.696+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15177343012885078586', time=2024-09-14T13:32:52.355761+0000, chain.objs.size()=1 2024-09-14T12:01:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.696+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.nBxs0xJccpcFshbF3Wh3pvldQo8xIZQ_0 2024-09-14T12:01:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.697+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14573327807627862039', time=2024-09-14T13:32:52.484692+0000, chain.objs.size()=1 2024-09-14T12:01:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.697+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.swxvQ7mXkUTHB62hqhhhcie6tFIe4Oc_0 2024-09-14T12:01:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.697+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14785840941306526034', time=2024-09-14T13:32:52.556683+0000, chain.objs.size()=1 2024-09-14T12:01:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.697+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.kzWLFcr40CFutyQ0K3SNKswrI3W2Ctb_0 2024-09-14T12:01:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.697+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8558285000373776025', time=2024-09-14T13:32:52.621881+0000, chain.objs.size()=1 2024-09-14T12:01:18.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.697+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ssZBNGV5KEcTckqcIKVrrrZ-H7QNwXJ_0 2024-09-14T12:01:18.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.699+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3209753408951328812', time=2024-09-14T13:32:52.648306+0000, chain.objs.size()=1 2024-09-14T12:01:18.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.699+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.KwQNhyKpwSqBvbRinSkXoMr3AVjM3aM_0 2024-09-14T12:01:18.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.700+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15770212710118056970', time=2024-09-14T13:32:53.645752+0000, chain.objs.size()=1 2024-09-14T12:01:18.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.700+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.WKKzqB_XCcdMBBkTu5_g8PzOsCdGMQ5_0 2024-09-14T12:01:18.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.700+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16640707361776059472', time=2024-09-14T13:32:54.336337+0000, chain.objs.size()=1 2024-09-14T12:01:18.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.700+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.cSfAlx5wb-ZKJa6ba3NWpBERlxCFsCU_0 2024-09-14T12:01:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.702+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18165901145690785999', time=2024-09-14T13:32:55.206591+0000, chain.objs.size()=1 2024-09-14T12:01:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.702+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Ea55nR-SUH8bIdZOAINf3yqG2ea7EN2_0 2024-09-14T12:01:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.702+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3344662357410183863', time=2024-09-14T13:32:55.237236+0000, chain.objs.size()=1 2024-09-14T12:01:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.702+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ZqaJiDKUdJ9Uj-oihg-9nz0ufkvg59P_0 2024-09-14T12:01:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.702+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12905143038903911188', time=2024-09-14T13:32:55.509303+0000, chain.objs.size()=1 2024-09-14T12:01:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.702+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.66aA9Kle7W8sOdV4nTZM-LxUt_sXIZn_0 2024-09-14T12:01:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.702+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1224514237442604720', time=2024-09-14T13:32:55.563220+0000, chain.objs.size()=1 2024-09-14T12:01:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.702+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ShWdz-UHF_uR5JZgNdQff477IhM89vL_0 2024-09-14T12:01:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.702+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7571726923628407672', time=2024-09-14T13:32:55.600942+0000, chain.objs.size()=1 2024-09-14T12:01:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.702+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.LXt7nFrhVTM0sew_WDe2EpWN0gJZHZ4_0 2024-09-14T12:01:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.702+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9274264200530877397', time=2024-09-14T13:32:56.336528+0000, chain.objs.size()=1 2024-09-14T12:01:18.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.702+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.dTbHwvJNg__NRuGWTncgMCK6bTgRoNi_0 2024-09-14T12:01:18.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.702+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17714513324568578512', time=2024-09-14T13:32:56.674749+0000, chain.objs.size()=1 2024-09-14T12:01:18.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.702+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.t2nx68jNf9CxkSPKlEIbCDNvNfB0tiU_0 2024-09-14T12:01:18.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.702+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1972279564624196990', time=2024-09-14T13:32:56.687863+0000, chain.objs.size()=1 2024-09-14T12:01:18.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.702+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.VRgNj-lDk8_i9YHOyTfVjFd-hcVUX68_0 2024-09-14T12:01:18.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.702+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7109788160047415026', time=2024-09-14T13:32:56.762894+0000, chain.objs.size()=1 2024-09-14T12:01:18.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.702+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.37rJJ-2iCp8ILddWoBiIPmnjsVWEdH7_0 2024-09-14T12:01:18.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.703+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11814243782112140957', time=2024-09-14T13:32:57.277205+0000, chain.objs.size()=1 2024-09-14T12:01:18.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.703+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_._-5ckT0f8nqko8cOAd-e8ndcBvgjx_c_0 2024-09-14T12:01:18.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.703+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11445738279265946487', time=2024-09-14T13:33:21.454128+0000, chain.objs.size()=1 2024-09-14T12:01:18.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.703+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.284__shadow_.61cdL-fc1yb3PWWZcAYM_dZhaxObkjz_0 2024-09-14T12:01:18.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.706+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7859543376181377909', time=2024-09-14T13:33:52.169174+0000, chain.objs.size()=1 2024-09-14T12:01:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.706+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.308__shadow:yEqRtKjtMjZ.B7sLJYjefOH9ZF6BVqr_.P18FT5ig85xSM-NSpt-RKMCDZxJumiv_0 2024-09-14T12:01:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.706+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14371115752582776200', time=2024-09-14T13:34:51.698957+0000, chain.objs.size()=1 2024-09-14T12:01:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.706+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.qGZTCtleX8xOE7JfFxfWyojCAjiHVLp_0 2024-09-14T12:01:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.706+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15354074491866154542', time=2024-09-14T13:34:52.178316+0000, chain.objs.size()=1 2024-09-14T12:01:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.706+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.VHkAixmCaW8mxsqbWlUKg8ooTshxboH_0 2024-09-14T12:01:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.706+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11788897330336423642', time=2024-09-14T13:34:52.517877+0000, chain.objs.size()=1 2024-09-14T12:01:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.706+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.aWAIeaqS5hunAC2dfYep0IJAvxL4WWu_0 2024-09-14T12:01:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.706+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13632164759406026201', time=2024-09-14T13:34:53.605327+0000, chain.objs.size()=1 2024-09-14T12:01:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.706+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.xOgYXUaD677CZw9zlYdg6yyPx-p9EAG_0 2024-09-14T12:01:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.706+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16122581596056854919', time=2024-09-14T13:34:53.816685+0000, chain.objs.size()=1 2024-09-14T12:01:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.706+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.-u2awri2rPzEEByFDzGv_5DK7ZjfWa6_0 2024-09-14T12:01:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.706+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13783024819388129921', time=2024-09-14T13:34:54.755714+0000, chain.objs.size()=1 2024-09-14T12:01:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.706+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.eoP8hDgi9qHyieyU753Sh-1vMYiTmDD_0 2024-09-14T12:01:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.706+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7982061749540772692', time=2024-09-14T13:34:54.831013+0000, chain.objs.size()=1 2024-09-14T12:01:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.706+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.jryD9tUgw8AnhxLcHajsuzEz4fMjY9b_0 2024-09-14T12:01:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.706+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16205852599029891830', time=2024-09-14T13:34:55.063454+0000, chain.objs.size()=1 2024-09-14T12:01:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.706+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.h9s1-vfPGJcE1A69jEq_94h6f2moxQq_0 2024-09-14T12:01:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.706+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15444425814570671674', time=2024-09-14T13:34:55.386910+0000, chain.objs.size()=1 2024-09-14T12:01:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.706+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.jr-TtfvWX3Oud3GeigsneWUOv5JLDbb_0 2024-09-14T12:01:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.706+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12535645388700879847', time=2024-09-14T13:34:55.429835+0000, chain.objs.size()=1 2024-09-14T12:01:18.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.706+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.UeL8dQlR1zlB_hptCth8XS1V_WWAlNW_0 2024-09-14T12:01:18.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.710+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7476960294894760937', time=2024-09-14T13:34:55.725957+0000, chain.objs.size()=1 2024-09-14T12:01:18.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.710+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.B56kCASoay2pn6i5NiHfDK9kssQDQAb_0 2024-09-14T12:01:18.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.710+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3623328525282394996', time=2024-09-14T13:34:56.748016+0000, chain.objs.size()=1 2024-09-14T12:01:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.710+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.u6Al6ymiPI6bJqfLNLEnOGQc1DyudY__0 2024-09-14T12:01:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.710+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8638518683933410261', time=2024-09-14T13:34:56.817752+0000, chain.objs.size()=1 2024-09-14T12:01:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.710+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.FOtc1aNRSgA9U_hfYeP_NDk1j5HClSI_0 2024-09-14T12:01:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.710+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8146118779632490410', time=2024-09-14T13:34:57.018251+0000, chain.objs.size()=1 2024-09-14T12:01:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.710+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.9HwTb5Eh4XWPyCp0ZyOU7klHEu6zWpm_0 2024-09-14T12:01:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.710+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10482395068969018184', time=2024-09-14T13:34:57.635090+0000, chain.objs.size()=1 2024-09-14T12:01:18.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.710+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ezd9pXzMx9y-HBGLqv-gl7dujlQhbNh_0 2024-09-14T12:01:18.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.710+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14944740291642448449', time=2024-09-14T13:34:57.669798+0000, chain.objs.size()=1 2024-09-14T12:01:18.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.710+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.esSVdkJY0EeUpCxRtlNPety0j7OoxWE_0 2024-09-14T12:01:18.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.710+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6326015508083114406', time=2024-09-14T13:34:57.883530+0000, chain.objs.size()=1 2024-09-14T12:01:18.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.710+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.YJImfNqHod6UYxAvFCXxWwSH-nUcMpz_0 2024-09-14T12:01:18.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.710+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10837982961449544420', time=2024-09-14T13:34:58.680143+0000, chain.objs.size()=1 2024-09-14T12:01:18.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.710+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.7kFUS4esyQ94eGzqH500OnR-gp2Uymc_0 2024-09-14T12:01:18.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.711+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5169018961914539205', time=2024-09-14T13:34:59.181325+0000, chain.objs.size()=1 2024-09-14T12:01:18.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.711+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.koFnm63mx0zURBsAtxc25e_f73C0TjL_0 2024-09-14T12:01:18.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.711+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10633391471607382421', time=2024-09-14T13:34:59.282423+0000, chain.objs.size()=1 2024-09-14T12:01:18.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.711+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.6kTb6qi3tkqKfSeau-ZLTV4G3CZZXFT_0 2024-09-14T12:01:18.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.712+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3705080672052439120', time=2024-09-14T13:34:59.412009+0000, chain.objs.size()=1 2024-09-14T12:01:18.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.712+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.IWORDxJygcUh6a79_8LXDzOjJauTtlU_0 2024-09-14T12:01:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.713+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2969932038883022106', time=2024-09-14T13:34:59.692215+0000, chain.objs.size()=1 2024-09-14T12:01:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.713+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_._mmXgm5SRWy0-Wm1UITMi3v6vGR9Ut2_0 2024-09-14T12:01:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.713+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16812454726282952491', time=2024-09-14T13:34:59.915096+0000, chain.objs.size()=1 2024-09-14T12:01:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.713+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.whFrrtfXGI2WeLapq6pdVEYG2RcMj5M_0 2024-09-14T12:01:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.713+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8311700079775826122', time=2024-09-14T13:35:00.486247+0000, chain.objs.size()=1 2024-09-14T12:01:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.713+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_._y5jZHlmckupDjVgS344qEmgxHjJcdZ_0 2024-09-14T12:01:18.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.715+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12357687828696086759', time=2024-09-14T13:35:00.635442+0000, chain.objs.size()=1 2024-09-14T12:01:18.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.715+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Bv4A8i-5xLOI9ws7GSEV22UWsSHqPfe_0 2024-09-14T12:01:18.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.715+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10151410374062374639', time=2024-09-14T13:35:01.258507+0000, chain.objs.size()=1 2024-09-14T12:01:18.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.715+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.uolBJf2DGGzJTs7Iw4AjKsw3J1QPcST_0 2024-09-14T12:01:18.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.715+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.540702165250414114', time=2024-09-14T13:35:01.365130+0000, chain.objs.size()=1 2024-09-14T12:01:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.715+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.V5mbySd7-VF0nK3bFS_X4ZMNLmPznMX_0 2024-09-14T12:01:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.715+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4291487183201667670', time=2024-09-14T13:35:01.485045+0000, chain.objs.size()=1 2024-09-14T12:01:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.715+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.sEoVfnPDe4O8IOXdSj8t4EUA5R0e4ia_0 2024-09-14T12:01:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.717+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1567915225914150467', time=2024-09-14T13:35:02.199845+0000, chain.objs.size()=1 2024-09-14T12:01:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.717+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.f-m7H6-eBierxcKt9YWQkilmDAuAN9e_0 2024-09-14T12:01:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.717+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4075343573304461970', time=2024-09-14T13:35:02.642847+0000, chain.objs.size()=1 2024-09-14T12:01:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.717+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.kyKIbHGS-v9HK77N3adqe1n7HpwYYHN_0 2024-09-14T12:01:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.717+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14346862346325213120', time=2024-09-14T13:35:02.643587+0000, chain.objs.size()=1 2024-09-14T12:01:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.717+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.YOExJmNu3WGk3LfR2otT8sUSZDpRZ-y_0 2024-09-14T12:01:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.717+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2730871620567783197', time=2024-09-14T13:35:41.824832+0000, chain.objs.size()=1 2024-09-14T12:01:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.717+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.d-5SEKhrV9MyNvpiyFLkwqcCDP0V8MT_0 2024-09-14T12:01:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.717+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9327913617348618800', time=2024-09-14T13:35:42.327736+0000, chain.objs.size()=1 2024-09-14T12:01:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.717+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.hO94zfW-3VyrX9rD9dLOgzve1p21Szo_0 2024-09-14T12:01:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.717+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6890943065447682215', time=2024-09-14T13:35:42.402783+0000, chain.objs.size()=1 2024-09-14T12:01:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.717+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.0_VCX5xu_MXY5KSdegca4ETaqFiWR7O_0 2024-09-14T12:01:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.717+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.423682144676210807', time=2024-09-14T13:35:43.280951+0000, chain.objs.size()=1 2024-09-14T12:01:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.717+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.-qbcsRA9NkqbeCzdLG8NJ2Y-LKvUCtm_0 2024-09-14T12:01:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.717+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11769228047266134560', time=2024-09-14T13:35:43.451930+0000, chain.objs.size()=1 2024-09-14T12:01:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.717+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.35bBpSYP9tXgbkLfu7f1J0HFZaf0SdB_0 2024-09-14T12:01:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.719+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17701199088049211190', time=2024-09-14T13:35:43.771290+0000, chain.objs.size()=1 2024-09-14T12:01:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.719+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.foG-l6Sdeh7Q8sYb8VmtaWvOm9qPnjj_0 2024-09-14T12:01:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.719+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17544022569951825667', time=2024-09-14T13:35:44.957023+0000, chain.objs.size()=1 2024-09-14T12:01:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.719+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.lMsqkvK9hJYXbU5C31p0o3H7sjuMv8P_0 2024-09-14T12:01:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.719+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.719319613489439560', time=2024-09-14T13:35:44.989149+0000, chain.objs.size()=1 2024-09-14T12:01:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.719+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.uLq9G1p_CgOTglbyxeDWlprpOVHFWE__0 2024-09-14T12:01:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.721+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10468364080550923517', time=2024-09-14T13:35:45.215174+0000, chain.objs.size()=1 2024-09-14T12:01:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.721+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.vZhkxz9cyU5Lt9cYIz-Xt4zxFxI-e4a_0 2024-09-14T12:01:18.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.723+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11149741898701974232', time=2024-09-14T13:35:45.722416+0000, chain.objs.size()=1 2024-09-14T12:01:18.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.723+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.DyWfrog9cL1Jya1UYE7xMh_-HOwYd2I_0 2024-09-14T12:01:18.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.723+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.282812954739715328', time=2024-09-14T13:35:45.852905+0000, chain.objs.size()=1 2024-09-14T12:01:18.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.723+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.kug60GJ4mLGoo6mgduFvmy_svTMMesh_0 2024-09-14T12:01:18.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.723+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14530145995218826224', time=2024-09-14T13:35:46.277764+0000, chain.objs.size()=1 2024-09-14T12:01:18.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.723+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.O-PC6iwtY6JFtixT1NOCqQpVOQjQfcH_0 2024-09-14T12:01:18.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.723+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10336493158033103372', time=2024-09-14T13:35:46.438615+0000, chain.objs.size()=1 2024-09-14T12:01:18.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.723+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.oEHAm6zcfNLzaEKssMw2-axBhB6axSi_0 2024-09-14T12:01:18.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.723+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1894979435403560116', time=2024-09-14T13:35:47.299613+0000, chain.objs.size()=1 2024-09-14T12:01:18.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.723+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.KzRELhmZh6ZMOkksh3Fm8P39puZkizi_0 2024-09-14T12:01:18.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.723+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1671314499376830215', time=2024-09-14T13:35:47.934167+0000, chain.objs.size()=1 2024-09-14T12:01:18.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.723+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.-WuADxkljh-OGucmken7EhndujeddOt_0 2024-09-14T12:01:18.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.723+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13688505380841626204', time=2024-09-14T13:35:47.935644+0000, chain.objs.size()=1 2024-09-14T12:01:18.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.723+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Z-s2b1O5GPogNb_U3hZyhjP83fsSo09_0 2024-09-14T12:01:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.723+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12850199482478096177', time=2024-09-14T13:35:48.335687+0000, chain.objs.size()=1 2024-09-14T12:01:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.723+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.XiQcsg-A276Dg_3DMgYLezoOQgmwYVK_0 2024-09-14T12:01:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.723+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1489908485291891702', time=2024-09-14T13:35:48.626912+0000, chain.objs.size()=1 2024-09-14T12:01:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.723+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.KtsF4cH5Oas_Kh9LscrKCNp27CKoVZu_0 2024-09-14T12:01:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.723+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14732245647942684784', time=2024-09-14T13:35:49.243912+0000, chain.objs.size()=1 2024-09-14T12:01:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.723+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.0XwJqMtLqf7xpYtzV6Z2BD9HwACOY2d_0 2024-09-14T12:01:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.723+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14325886302786671343', time=2024-09-14T13:35:49.644641+0000, chain.objs.size()=1 2024-09-14T12:01:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.723+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.A_PAebJafONIm4nVs1JdfcrQ9q3nIMj_0 2024-09-14T12:01:18.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.726+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3296643998168110265', time=2024-09-14T13:35:49.645235+0000, chain.objs.size()=1 2024-09-14T12:01:18.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.726+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.jXw-QFcGXFGOMWJYkZyQsny2hRP-XkH_0 2024-09-14T12:01:18.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.727+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1373115288010551967', time=2024-09-14T13:35:49.776665+0000, chain.objs.size()=1 2024-09-14T12:01:18.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.727+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.3HfiKckzxE2NeidUixov43tVOljXDiI_0 2024-09-14T12:01:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.727+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15795651502265752832', time=2024-09-14T13:35:50.173867+0000, chain.objs.size()=1 2024-09-14T12:01:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.727+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ofQQNhJS4Hi9c4DbvO1BYUD1t1Cz7Kb_0 2024-09-14T12:01:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.727+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7267685042139306646', time=2024-09-14T13:35:50.883683+0000, chain.objs.size()=1 2024-09-14T12:01:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.727+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.dHP2wjhvB5ZbSMIAxDBxQZlhWcolHoo_0 2024-09-14T12:01:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.727+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16112286313527016216', time=2024-09-14T13:35:50.945803+0000, chain.objs.size()=1 2024-09-14T12:01:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.727+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Lvl-4f3fRSWi58-wubA5Wyxpkjb2GBN_0 2024-09-14T12:01:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.727+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2349108716949227309', time=2024-09-14T13:35:51.311121+0000, chain.objs.size()=1 2024-09-14T12:01:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.727+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.lTdz6FMqmHlee7O4vUBuWFH9j8PbG8B_0 2024-09-14T12:01:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.727+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12996989281771355163', time=2024-09-14T13:35:51.311841+0000, chain.objs.size()=1 2024-09-14T12:01:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.727+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.o_6BDaVs0RhGNHAR2mtHqtzHl5wsLEB_0 2024-09-14T12:01:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.727+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16220441853813282442', time=2024-09-14T13:35:51.539105+0000, chain.objs.size()=1 2024-09-14T12:01:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.727+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.BAvClnr_KQ_IdWsYb9pTRdcNqiclP8F_0 2024-09-14T12:01:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.727+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.618834158836594104', time=2024-09-14T13:35:51.935917+0000, chain.objs.size()=1 2024-09-14T12:01:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.727+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.HfG5MPTrlXUwMMuJw95ksgtt5dZ8D_I_0 2024-09-14T12:01:18.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.727+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17060585258792039108', time=2024-09-14T13:35:52.128239+0000, chain.objs.size()=1 2024-09-14T12:01:18.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.727+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.q37XNckCqk85AG_43PjdKmCpngMKTPC_0 2024-09-14T12:01:18.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.727+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15904626496512427481', time=2024-09-14T13:35:52.451634+0000, chain.objs.size()=1 2024-09-14T12:01:18.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.727+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.6Uv2OWklXc1kreUse6ZgCO8ukXMUVGZ_0 2024-09-14T12:01:18.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.732+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/44890 2024-09-14T12:01:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T12:01:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11259216225459013147', time=2024-09-14T13:35:52.645013+0000, chain.objs.size()=1 2024-09-14T12:01:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Omr8wmg-GJncwG61Zg5FCBUjmuoVbFV_0 2024-09-14T12:01:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.877933681275166837', time=2024-09-14T13:36:01.638114+0000, chain.objs.size()=1 2024-09-14T12:01:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.334__shadow_.6loxkZ_04Ls1l-etQDqqh_AzuErRCs5_0 2024-09-14T12:01:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5628532231108739747', time=2024-09-14T13:36:01.876100+0000, chain.objs.size()=1 2024-09-14T12:01:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.334__shadow_.LYihrYUte2b5eSpU73LJofk2nHGfIsM_0 2024-09-14T12:01:18.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17016207380973117742', time=2024-09-14T13:38:28.370458+0000, chain.objs.size()=1 2024-09-14T12:01:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.466__shadow_.4Ho3VcJd47kLNX8AtYts5VMOwxfsbFi_0 2024-09-14T12:01:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9250458339810237682', time=2024-09-14T13:39:07.144570+0000, chain.objs.size()=1 2024-09-14T12:01:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.504__shadow:-Styd.oxB8SSr1oI0lFwKs5hFqmwg-w_.MvQogDl8WgMpFFuD7AaaxQ0tKLuN8vP_0 2024-09-14T12:01:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15857588477669700160', time=2024-09-14T13:44:53.890661+0000, chain.objs.size()=1 2024-09-14T12:01:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.555__shadow_.RlYcipvoV_loJ-A6TEBxL5TNKZj_ycw_0 2024-09-14T12:01:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14102846469781836106', time=2024-09-14T13:45:30.532334+0000, chain.objs.size()=1 2024-09-14T12:01:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.565__shadow_.1x_8_7yRx8selwisEWgHNoKBRKmUXpm_0 2024-09-14T12:01:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11189676583050866531', time=2024-09-14T13:45:36.987741+0000, chain.objs.size()=1 2024-09-14T12:01:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:HgsI3zMZr3xzdqpsLfLsmHxgd7ivZPX_.G-Z8Qm3jeLj8DFIuZtI0BZVCQLP8wTt_0 2024-09-14T12:01:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7965205623344050368', time=2024-09-14T13:46:27.576361+0000, chain.objs.size()=1 2024-09-14T12:01:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:ICGAYzISHp23DUCJaalonohg7xaHw7m_.Xlzz2ZSeGPfmQy5cXahgUo6xAIt2pU7_0 2024-09-14T12:01:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18163562884919895208', time=2024-09-14T13:47:09.294628+0000, chain.objs.size()=1 2024-09-14T12:01:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.580__shadow:y-QKV.HwokBzOTcwvr95PONyqoRNbBj_.UkRSgHtULqYUFP6KIxY1q4j9gEM6cJW_0 2024-09-14T12:01:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16327754212406635048', time=2024-09-14T13:47:09.523040+0000, chain.objs.size()=1 2024-09-14T12:01:18.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.580__shadow:JLQ4xUY3M9KAfjjJgiV.NIJ7MbDjdS5_.09RoTsQw55EO4QVZLf0X_jlYRRT5KY4_0 2024-09-14T12:01:18.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17926476753966235867', time=2024-09-14T13:47:09.565142+0000, chain.objs.size()=1 2024-09-14T12:01:18.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.735+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.580__shadow:3q3REie7uDnuDTqh0QD8-D0gwkNVrxh_.on2rllacAbgxzAxtZtnTijnqB7QFgm__0 2024-09-14T12:01:18.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.738+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15681194248602298295', time=2024-09-14T13:47:13.384382+0000, chain.objs.size()=1 2024-09-14T12:01:18.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.738+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.583__shadow:2.dG1509N.Yybfpj1m8m5hiYgxJfuFM_._8IiImXqPpnvxuCU3BUmjbSeaj7KoON_0 2024-09-14T12:01:18.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.739+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1948296331103641740', time=2024-09-14T13:52:54.036361+0000, chain.objs.size()=1 2024-09-14T12:01:18.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.739+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.642__shadow_._lV23SXg93t0YUJWgnYN8Z8pYp6VVkp_0 2024-09-14T12:01:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.739+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1897824287236329507', time=2024-09-14T13:53:54.844376+0000, chain.objs.size()=1 2024-09-14T12:01:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.739+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.664__shadow_.HS_y4XjfdQXCvP4mjEVjpUIyiK1Eq8T_0 2024-09-14T12:01:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.739+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7443128744556168039', time=2024-09-14T13:54:26.746788+0000, chain.objs.size()=1 2024-09-14T12:01:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.739+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.697__shadow:VUYPhwOHuXKeL3peyfYMl5pZJrO.W1w_.IXi7KJkB75rfLdtyLR97NMxXAMyvrJj_0 2024-09-14T12:01:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.739+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13450232008557459495', time=2024-09-14T13:54:34.966066+0000, chain.objs.size()=1 2024-09-14T12:01:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.739+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.705__shadow:7SxtJZrZwgRz8.sdyNl9M1VM2.T2Ylv_.L5Ii-Lsx-g3glEUL0MjlE5Jiko60ml__0 2024-09-14T12:01:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.739+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17207079297880392769', time=2024-09-14T13:57:37.181186+0000, chain.objs.size()=1 2024-09-14T12:01:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.739+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.762__shadow_.bD18fCNeXJQciBEitzeMp5akJgPkw7K_0 2024-09-14T12:01:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.739+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17154154411208019477', time=2024-09-14T13:58:39.964319+0000, chain.objs.size()=1 2024-09-14T12:01:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.739+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.777__shadow_.ZolIrMxjMiu2hptlq26fXHUoBPWd10D_0 2024-09-14T12:01:18.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.743+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.745+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T12:01:18.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.747+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:18.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.747+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.748+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45800' 2024-09-14T12:01:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.748+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4057630557919434527', time=2024-09-14T13:27:28.346399+0000, chain.objs.size()=1 2024-09-14T12:01:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.748+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.152__shadow_.q5R6sZfVbrcFJ1WuQV-XzCBb8DjmNAC_0 2024-09-14T12:01:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.748+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5563367403608698225', time=2024-09-14T13:28:12.129229+0000, chain.objs.size()=3 2024-09-14T12:01:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.748+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.162__multipart_foo-STANDARD.2~al0frolsw-WyuQe6SUA2CTglibj5HO5.1 2024-09-14T12:01:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.748+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.162__multipart_foo-STANDARD.2~al0frolsw-WyuQe6SUA2CTglibj5HO5.2 2024-09-14T12:01:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.748+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.162__multipart_foo-STANDARD.2~al0frolsw-WyuQe6SUA2CTglibj5HO5.3 2024-09-14T12:01:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.748+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='_QV0Df3mH7nE4F_Ylou05tXfE5nQSt-A', time=2024-09-14T13:28:29.183814+0000, chain.objs.size()=2 2024-09-14T12:01:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.748+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.162__shadow_.nYiGkOxXKDC2tv1v8SUkpyQVYND9_pU_0 2024-09-14T12:01:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.748+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.162__shadow_.nYiGkOxXKDC2tv1v8SUkpyQVYND9_pU_1 2024-09-14T12:01:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.748+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13130875141686829713', time=2024-09-14T13:31:46.904993+0000, chain.objs.size()=1 2024-09-14T12:01:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.748+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.243__shadow_.5ZsNYMA9n6c5VUWEpN56aCYVuQETG8D_0 2024-09-14T12:01:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.748+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13667493360228012124', time=2024-09-14T13:31:51.623303+0000, chain.objs.size()=1 2024-09-14T12:01:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.748+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.246__shadow_.S1Yv0fCPrrO8i-_WqaO0JlKVkeu3YHm_0 2024-09-14T12:01:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.748+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4864209284588426671', time=2024-09-14T13:31:55.111031+0000, chain.objs.size()=1 2024-09-14T12:01:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.748+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.249__shadow_.kb5G8CZZ2OMC5EXcqMuwUeaSgOOFJ3V_0 2024-09-14T12:01:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.748+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8719245105029517600', time=2024-09-14T13:32:47.585455+0000, chain.objs.size()=1 2024-09-14T12:01:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.748+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.YlFwAKs-dHunODLAChtaiGifqvUo_Sy_0 2024-09-14T12:01:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.748+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2599670524916308700', time=2024-09-14T13:32:47.722259+0000, chain.objs.size()=1 2024-09-14T12:01:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.748+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.fT_zCLtNLvyOjHq8Kl8wctjQfJvXz71_0 2024-09-14T12:01:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.748+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18267187815582692549', time=2024-09-14T13:32:49.424751+0000, chain.objs.size()=1 2024-09-14T12:01:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.748+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.CyP4L6W59FKQgrhCfhEv_Z1Xa1TAOKm_0 2024-09-14T12:01:18.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.752+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5768971126379434004', time=2024-09-14T13:32:49.911025+0000, chain.objs.size()=1 2024-09-14T12:01:18.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.752+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.MTeLNYDDTIxrrXfBhLLPskq-uI8E-EI_0 2024-09-14T12:01:18.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.752+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7063490053895817461', time=2024-09-14T13:32:51.008365+0000, chain.objs.size()=1 2024-09-14T12:01:18.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.752+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.hX4JrtM1t4epOGnraUgT8ISKRYXxqTt_0 2024-09-14T12:01:18.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.752+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12956507706367083266', time=2024-09-14T13:32:51.497148+0000, chain.objs.size()=1 2024-09-14T12:01:18.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.752+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.bYBhmY6GJLKSqSUtNP-NBXCYsBv35lk_0 2024-09-14T12:01:18.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.752+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.645428044233015924', time=2024-09-14T13:32:51.573996+0000, chain.objs.size()=1 2024-09-14T12:01:18.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.752+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.tziWc0WuGuxbRIoD44boBi6jQk1lx2Y_0 2024-09-14T12:01:18.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.752+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4496800493043626094', time=2024-09-14T13:32:52.058484+0000, chain.objs.size()=1 2024-09-14T12:01:18.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.752+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.FGbcNSVB8UlqLr1Xply638opiUuW_zu_0 2024-09-14T12:01:18.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.752+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8317686258763937884', time=2024-09-14T13:32:52.059113+0000, chain.objs.size()=1 2024-09-14T12:01:18.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.752+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ZKSC1MTat9t8vZ_4rJFV01cHwBAv2Pm_0 2024-09-14T12:01:18.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.752+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4067360927570092056', time=2024-09-14T13:32:52.059643+0000, chain.objs.size()=1 2024-09-14T12:01:18.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.752+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.26R8f9fvWWzQK1QbfPosuLXvnNkZpSq_0 2024-09-14T12:01:18.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.752+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14730178590709036069', time=2024-09-14T13:32:52.833223+0000, chain.objs.size()=1 2024-09-14T12:01:18.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.752+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.T9jGPfjkyEawVbPx5mBJcPibWwqWLXU_0 2024-09-14T12:01:18.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.752+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10593383641245560489', time=2024-09-14T13:32:53.099978+0000, chain.objs.size()=1 2024-09-14T12:01:18.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.752+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.H94qUnsMaz25776TpoChaWv1-sGH2ut_0 2024-09-14T12:01:18.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.752+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14960947567757250029', time=2024-09-14T13:32:53.116199+0000, chain.objs.size()=1 2024-09-14T12:01:18.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.752+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.miu_qioD3FQfLbEYcaHHeGmYMSa-WJW_0 2024-09-14T12:01:18.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.752+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7087838066138353809', time=2024-09-14T13:32:53.638054+0000, chain.objs.size()=1 2024-09-14T12:01:18.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.752+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.z3YnrpsoGrwQ538zX7ou7uqBW42BCP6_0 2024-09-14T12:01:18.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.755+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.449522390558607295', time=2024-09-14T13:32:54.016112+0000, chain.objs.size()=1 2024-09-14T12:01:18.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.755+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.XR0U-LHh5zU0kFcDCPVjAqoqLV4PG4I_0 2024-09-14T12:01:18.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.755+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5209553105982400089', time=2024-09-14T13:32:54.089071+0000, chain.objs.size()=1 2024-09-14T12:01:18.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.755+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.__Y5M_SpNWG2ZBUVcNou789bpnknZDX_0 2024-09-14T12:01:18.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.756+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4687512906502255000', time=2024-09-14T13:32:54.094472+0000, chain.objs.size()=1 2024-09-14T12:01:18.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.756+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.a_zok31s-RfF27ih3DAOYAwT-7e6ATb_0 2024-09-14T12:01:18.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.756+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5956145661691537305', time=2024-09-14T13:32:54.235444+0000, chain.objs.size()=1 2024-09-14T12:01:18.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.756+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.yDs5CBhF0xVdy5qYhckIfUD1rUP4aQg_0 2024-09-14T12:01:18.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.757+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15693804540915623158', time=2024-09-14T13:32:55.071854+0000, chain.objs.size()=1 2024-09-14T12:01:18.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.757+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.dkfnZxzHaP7BVLOrrYGFfBkE71z9sOe_0 2024-09-14T12:01:18.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.757+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4343713984049234287', time=2024-09-14T13:32:55.098081+0000, chain.objs.size()=1 2024-09-14T12:01:18.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.757+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.FjQE09WyJal_7SXddVncKtlzf6-BtbC_0 2024-09-14T12:01:18.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.757+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1970714215036413559', time=2024-09-14T13:32:55.741481+0000, chain.objs.size()=1 2024-09-14T12:01:18.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.757+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.v52cZVqmbQphlLJl5OYfHPh4QVoeXk3_0 2024-09-14T12:01:18.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.757+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10456580661812072192', time=2024-09-14T13:32:56.921577+0000, chain.objs.size()=1 2024-09-14T12:01:18.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.757+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.qO0MHLXolJ7n1qxuOuFVKvYhxuJav6Q_0 2024-09-14T12:01:18.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.757+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5922312371877577477', time=2024-09-14T13:32:56.992774+0000, chain.objs.size()=1 2024-09-14T12:01:18.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.757+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.SAGJ1E_rU4BKYZVh-pRS4_S3lKA0kON_0 2024-09-14T12:01:18.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.757+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2016141048041655005', time=2024-09-14T13:32:56.993542+0000, chain.objs.size()=1 2024-09-14T12:01:18.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.757+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.DfMzzDQeqXhqSIO6pnbMr7Dt_vfzrLC_0 2024-09-14T12:01:18.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.757+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11448355092320595908', time=2024-09-14T13:32:57.248603+0000, chain.objs.size()=1 2024-09-14T12:01:18.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.757+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.BtwUOGL6Mvd7fqhT-7xyZvlLV-AZl6L_0 2024-09-14T12:01:18.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.758+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8595767649377760787', time=2024-09-14T13:32:57.783208+0000, chain.objs.size()=1 2024-09-14T12:01:18.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.758+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.MFJb1gh-jIZGky8piSSdQYA_RvfO767_0 2024-09-14T12:01:18.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.758+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.844423912404468265', time=2024-09-14T13:32:57.783818+0000, chain.objs.size()=1 2024-09-14T12:01:18.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.758+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.uaDeS-L1MFal3jSYqpoYIWapM-3rAJP_0 2024-09-14T12:01:18.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.759+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2032253271491405899', time=2024-09-14T13:32:58.213047+0000, chain.objs.size()=1 2024-09-14T12:01:18.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.759+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.6tQV2GcUgXtWMbmpDYyvsx3LF7nbbcm_0 2024-09-14T12:01:18.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.759+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8432627990677123286', time=2024-09-14T13:32:58.286717+0000, chain.objs.size()=1 2024-09-14T12:01:18.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.759+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.EBsqg2HLEH-e_OkPSrf_KjTPfHfPJXz_0 2024-09-14T12:01:18.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.760+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3655748534310666035', time=2024-09-14T13:32:58.292138+0000, chain.objs.size()=1 2024-09-14T12:01:18.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.760+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.LP_TtcG0vwkbICQHOJdRmSHd8NeFFYB_0 2024-09-14T12:01:18.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.760+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14108888722154276151', time=2024-09-14T13:32:58.504869+0000, chain.objs.size()=1 2024-09-14T12:01:18.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.760+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.2ZKEJH1RQ0BfjVunkZhdCxDgnZvXCsh_0 2024-09-14T12:01:18.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.760+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1683129179279775861', time=2024-09-14T13:32:58.730977+0000, chain.objs.size()=1 2024-09-14T12:01:18.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.760+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.i7pM-eNCANv9LAWGl40HejCvIp4vg8K_0 2024-09-14T12:01:18.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.760+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17471402402568662469', time=2024-09-14T13:32:59.822442+0000, chain.objs.size()=1 2024-09-14T12:01:18.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.760+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.264__shadow_.yqGYBRIkHMB8rdL0WMyFKQyiw-Yjjrb_0 2024-09-14T12:01:18.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.761+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11062557623765725052', time=2024-09-14T13:33:01.938939+0000, chain.objs.size()=1 2024-09-14T12:01:18.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.761+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.266__shadow_.aNAr6A5fLp-K1G2yKF1JmxSv8ZuIuzE_0 2024-09-14T12:01:18.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.762+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16632425734586087927', time=2024-09-14T13:33:11.611340+0000, chain.objs.size()=1 2024-09-14T12:01:18.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.762+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.275__shadow_.QyyT0JSPyLHrqSo0NyU-gFE_QD75p8l_0 2024-09-14T12:01:18.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.762+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1231661488320703592', time=2024-09-14T13:33:14.915733+0000, chain.objs.size()=1 2024-09-14T12:01:18.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.762+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.278__shadow_.xlgDOpiAekGOOoRkY8ju6TJZpteXLlZ_0 2024-09-14T12:01:18.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.762+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12784688696950043649', time=2024-09-14T13:33:19.277678+0000, chain.objs.size()=1 2024-09-14T12:01:18.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.762+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.282__shadow_.odqh79bko0qBC6l3QxWZyPdd0SEhBj-_0 2024-09-14T12:01:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.763+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12106626662448635666', time=2024-09-14T13:33:33.159006+0000, chain.objs.size()=1 2024-09-14T12:01:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.763+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.vS8ijBki1MQn9e0kuV7zTV6ERdd7djB_0 2024-09-14T12:01:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.763+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11007363649459569358', time=2024-09-14T13:33:35.537928+0000, chain.objs.size()=1 2024-09-14T12:01:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.763+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.qbiWRW9d7ZX3oldr3NQR1pBdMBYbiRH_0 2024-09-14T12:01:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.763+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11019315412906448612', time=2024-09-14T13:33:35.638859+0000, chain.objs.size()=1 2024-09-14T12:01:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.763+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.vaZyxIupMIyuVal-PZxN_zcvRIwK92l_0 2024-09-14T12:01:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.763+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5476346879877008007', time=2024-09-14T13:33:35.657209+0000, chain.objs.size()=1 2024-09-14T12:01:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.763+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.v5G3OGa4tX0X7_0ndlpdgHfWW84PAVB_0 2024-09-14T12:01:18.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.765+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14815971813636751851', time=2024-09-14T13:34:51.572752+0000, chain.objs.size()=1 2024-09-14T12:01:18.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.765+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.MD6lgoth4kjvyvCPRiTX-GlCUEGjLgV_0 2024-09-14T12:01:18.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.765+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.457202661786676644', time=2024-09-14T13:34:51.845336+0000, chain.objs.size()=1 2024-09-14T12:01:18.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.765+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.IJ4zGP-uh3Z8_GfVwS5Srlx5Q2vm_2N_0 2024-09-14T12:01:18.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.765+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10420593128393555496', time=2024-09-14T13:34:52.546345+0000, chain.objs.size()=1 2024-09-14T12:01:18.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.765+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ylf4IdpMZfurwjhprdNMiYaHoISPO6b_0 2024-09-14T12:01:18.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.765+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17365554525466815884', time=2024-09-14T13:34:53.439188+0000, chain.objs.size()=1 2024-09-14T12:01:18.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.765+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.tXFjJbBy9AKKEBAHl0I-qNK-8MD7Afv_0 2024-09-14T12:01:18.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.765+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1179309623489238808', time=2024-09-14T13:34:53.462871+0000, chain.objs.size()=1 2024-09-14T12:01:18.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.765+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.epuzY8Wwb0PrFprq93wqJFiC9ZfdonA_0 2024-09-14T12:01:18.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.765+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.229128099869498519', time=2024-09-14T13:34:54.121912+0000, chain.objs.size()=1 2024-09-14T12:01:18.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.765+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.EXnm4zFRqzxI7QQg6esG4aBaHY5MUiW_0 2024-09-14T12:01:18.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.765+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11655491372347214614', time=2024-09-14T13:34:54.704512+0000, chain.objs.size()=1 2024-09-14T12:01:18.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.765+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ZW65f6SjsFnhs66k5jLj_8N7aZdkUfI_0 2024-09-14T12:01:18.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.767+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14590064275099326397', time=2024-09-14T13:34:54.996667+0000, chain.objs.size()=1 2024-09-14T12:01:18.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.767+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.L0VghHXVv8VWW4HgEIpR95E1_cB_Scq_0 2024-09-14T12:01:18.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.767+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11673036347969278454', time=2024-09-14T13:34:54.997208+0000, chain.objs.size()=1 2024-09-14T12:01:18.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.767+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.AE8O64vGN-u6iJVzMTdm_b0dmHF8GGN_0 2024-09-14T12:01:18.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.767+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8694527619629026702', time=2024-09-14T13:34:55.104904+0000, chain.objs.size()=1 2024-09-14T12:01:18.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.767+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.GarAEx89exbjb1waiXmEOt5H2sXvfbD_0 2024-09-14T12:01:18.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.767+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8736629982345309837', time=2024-09-14T13:34:55.178317+0000, chain.objs.size()=1 2024-09-14T12:01:18.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.767+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Fz9YBFvaFP4B8Y-k_--32nwRKrV4crm_0 2024-09-14T12:01:18.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.768+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6837599858572050435', time=2024-09-14T13:34:55.370156+0000, chain.objs.size()=1 2024-09-14T12:01:18.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.768+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.-3h4XSGXPC8jro5ftkkdleXvViVk06F_0 2024-09-14T12:01:18.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.769+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11393149530101995826', time=2024-09-14T13:34:55.511794+0000, chain.objs.size()=1 2024-09-14T12:01:18.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.769+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.aXw8UGbGnzVQtD8kQqfpoZvBnb3PhFB_0 2024-09-14T12:01:18.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.770+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4643451087062520715', time=2024-09-14T13:34:56.161766+0000, chain.objs.size()=1 2024-09-14T12:01:18.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.770+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.D4UiAA7nL6kVLZrBfOan3Xb3fPChcsO_0 2024-09-14T12:01:18.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.772+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12553166701015452080', time=2024-09-14T13:34:56.209069+0000, chain.objs.size()=1 2024-09-14T12:01:18.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.772+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.7FJTn_z5xDLlvSMw61q7_5uBRA3gr5q_0 2024-09-14T12:01:18.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.772+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14004190150787451495', time=2024-09-14T13:34:56.543111+0000, chain.objs.size()=1 2024-09-14T12:01:18.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.772+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.xCWBD9_MQnIr3GNFU9Vi4QrKNhmpVrl_0 2024-09-14T12:01:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.772+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1060064006460427255', time=2024-09-14T13:34:56.670141+0000, chain.objs.size()=1 2024-09-14T12:01:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.772+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.IfbI2d4BaJW4k48ZnRSfluQrWAWVUnA_0 2024-09-14T12:01:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.772+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8417069805164276380', time=2024-09-14T13:34:56.671538+0000, chain.objs.size()=1 2024-09-14T12:01:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.772+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.5YqFq5MarHTBkambiNFxsvRuPb_0mZI_0 2024-09-14T12:01:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.772+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7363607934509443030', time=2024-09-14T13:34:57.903019+0000, chain.objs.size()=1 2024-09-14T12:01:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.772+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.w9OjKritA6HbAjUayFKnSBZjEtVHgfk_0 2024-09-14T12:01:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.772+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13174977735717665109', time=2024-09-14T13:34:58.316854+0000, chain.objs.size()=1 2024-09-14T12:01:18.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.772+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ahK5xQBUZhXrFibEKB0rtljVqT6te82_0 2024-09-14T12:01:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.773+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.392356800381418759', time=2024-09-14T13:34:58.448283+0000, chain.objs.size()=1 2024-09-14T12:01:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.773+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.sY0rIe2ezm6ZJQyrgCTpX6o5D_NsEMz_0 2024-09-14T12:01:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.773+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4790667442223292250', time=2024-09-14T13:34:59.722198+0000, chain.objs.size()=1 2024-09-14T12:01:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.773+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.c0ySjoK4FcpeIjlJBpFBEOzUKpjD9vU_0 2024-09-14T12:01:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.773+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6044639722924160651', time=2024-09-14T13:34:59.753843+0000, chain.objs.size()=1 2024-09-14T12:01:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.773+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.W610LmBk5KeXyIwbYSLAUy7rkyCSn-f_0 2024-09-14T12:01:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.773+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13346019663505717640', time=2024-09-14T13:35:00.042895+0000, chain.objs.size()=1 2024-09-14T12:01:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.773+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Vgx8wzDEo1NU34IE-wNosfuCDES4mES_0 2024-09-14T12:01:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.773+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11391668903702084151', time=2024-09-14T13:35:00.457362+0000, chain.objs.size()=1 2024-09-14T12:01:18.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.773+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.18PT7PqsTFF6tXMYfJEcc0M31dNJ6oR_0 2024-09-14T12:01:18.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.776+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4863624694162577852', time=2024-09-14T13:35:00.889776+0000, chain.objs.size()=1 2024-09-14T12:01:18.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.776+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.pl5w6vbhAeV-SfEpJ9-X2jRWuciYgC5_0 2024-09-14T12:01:18.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.777+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17498046045550580299', time=2024-09-14T13:35:00.890363+0000, chain.objs.size()=1 2024-09-14T12:01:18.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.777+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Ew59N_20_o034Q4gfT2LWNe9_9j1vaK_0 2024-09-14T12:01:18.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.777+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8119744164769822155', time=2024-09-14T13:35:01.043838+0000, chain.objs.size()=1 2024-09-14T12:01:18.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.777+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.w2u0edep6IngeCka9i75xDIc-uFmvg5_0 2024-09-14T12:01:18.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.777+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6621117647983402513', time=2024-09-14T13:35:02.272732+0000, chain.objs.size()=1 2024-09-14T12:01:18.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.777+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.VsHW2IFhZeP8RgsQkuf4DJFyGuNnAbw_0 2024-09-14T12:01:18.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.777+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14691749166737768614', time=2024-09-14T13:35:42.206861+0000, chain.objs.size()=1 2024-09-14T12:01:18.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.777+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.78ySrkMMvagjnH3tkk1qNWiRStWVafV_0 2024-09-14T12:01:18.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.777+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8562143429470419580', time=2024-09-14T13:35:42.346017+0000, chain.objs.size()=1 2024-09-14T12:01:18.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.777+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.eD318aWMI6BBq2-hS91kS8dca73zVsc_0 2024-09-14T12:01:18.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.778+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.299269506264616595', time=2024-09-14T13:35:42.550803+0000, chain.objs.size()=1 2024-09-14T12:01:18.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.778+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Myq1btWBEBMB2ilL7zn82WaANpbA2gg_0 2024-09-14T12:01:18.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.778+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1540015754732240549', time=2024-09-14T13:35:42.598965+0000, chain.objs.size()=1 2024-09-14T12:01:18.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.778+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.0mWmhhA8-w3YIWeVwdeuG6YNkCT78_H_0 2024-09-14T12:01:18.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.778+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15859510344545221998', time=2024-09-14T13:35:43.410273+0000, chain.objs.size()=1 2024-09-14T12:01:18.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.778+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.B6qIf6pHQUrfsNBM7N_q1ONamAha0Tj_0 2024-09-14T12:01:18.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.778+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4953992032925456652', time=2024-09-14T13:35:43.640782+0000, chain.objs.size()=1 2024-09-14T12:01:18.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.778+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.0kFzkPv5w9znjcnSp1HZpDbYXFUpDF9_0 2024-09-14T12:01:18.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.778+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18224615603389781191', time=2024-09-14T13:35:43.740635+0000, chain.objs.size()=1 2024-09-14T12:01:18.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.778+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.b4oODWuuCY4MEhHHdbintsnOz5-m0_s_0 2024-09-14T12:01:18.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.778+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10254053446042988626', time=2024-09-14T13:35:43.847691+0000, chain.objs.size()=1 2024-09-14T12:01:18.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.778+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_._jnEVPLmqbE6wp-iyBoFFeJ6WUFqHUe_0 2024-09-14T12:01:18.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.780+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2429778579325903987', time=2024-09-14T13:35:44.295218+0000, chain.objs.size()=1 2024-09-14T12:01:18.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.780+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.tgJR6xz7HBEJxdlUhC-gFC6y6-8pOe2_0 2024-09-14T12:01:18.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.781+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10464825644054296939', time=2024-09-14T13:35:45.289514+0000, chain.objs.size()=1 2024-09-14T12:01:18.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.781+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.xk98StBKeb7Ln7726SYlCiMFm3Sqi9D_0 2024-09-14T12:01:18.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.781+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17041542665746462651', time=2024-09-14T13:35:45.380005+0000, chain.objs.size()=1 2024-09-14T12:01:18.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.781+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.WuQTvWzmZ4t0nCg5KpyudOXvEinV75o_0 2024-09-14T12:01:18.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.781+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5457662288041982980', time=2024-09-14T13:35:45.380661+0000, chain.objs.size()=1 2024-09-14T12:01:18.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.781+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.fboASn_ceeeQS6d87UrTd_1wmHDIctY_0 2024-09-14T12:01:18.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.781+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4769979155155467467', time=2024-09-14T13:35:45.533358+0000, chain.objs.size()=1 2024-09-14T12:01:18.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.781+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.p_mJrm_2njhfeJ_A1n7GOYvmaOu8WyJ_0 2024-09-14T12:01:18.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.781+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14950415645709960285', time=2024-09-14T13:35:46.278108+0000, chain.objs.size()=1 2024-09-14T12:01:18.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.781+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.q_1LCQS8mDZpLVXpIzj6Mszjm234H4a_0 2024-09-14T12:01:18.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.782+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5171992887114552514', time=2024-09-14T13:35:46.812130+0000, chain.objs.size()=1 2024-09-14T12:01:18.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.782+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.SQDv-_7WSg8gmTIl2pR60MAZEoC1tpj_0 2024-09-14T12:01:18.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.782+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2918376589627105961', time=2024-09-14T13:35:47.203496+0000, chain.objs.size()=1 2024-09-14T12:01:18.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.782+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.I56aJRKA7plzmiRbqtS7rzbPUmTYDij_0 2024-09-14T12:01:18.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.782+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.256188100239260795', time=2024-09-14T13:35:47.731264+0000, chain.objs.size()=1 2024-09-14T12:01:18.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.782+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.-Xqt7EEWMdPQxMikUkCm4ZVslixN5GP_0 2024-09-14T12:01:18.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.782+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12352383463921849291', time=2024-09-14T13:35:48.735008+0000, chain.objs.size()=1 2024-09-14T12:01:18.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.782+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.M4qCImEiXIl9Mximb9X2jTJWJ2JG-ih_0 2024-09-14T12:01:18.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.782+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15275245533450421149', time=2024-09-14T13:35:49.233020+0000, chain.objs.size()=1 2024-09-14T12:01:18.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.782+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.bOnupqnWnObiBMUmHBYjlCmS9QF53wG_0 2024-09-14T12:01:18.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.784+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14619093380912091958', time=2024-09-14T13:35:49.300737+0000, chain.objs.size()=1 2024-09-14T12:01:18.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.784+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ZdKkSViiFAFCGpAtuLgN04u4SSTmEyy_0 2024-09-14T12:01:18.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.786+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2028209218898089577', time=2024-09-14T13:35:49.824777+0000, chain.objs.size()=1 2024-09-14T12:01:18.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.786+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.r-iyaH61viAYGzyF4RmytIsEEzYJa_6_0 2024-09-14T12:01:18.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.786+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17330830765999967376', time=2024-09-14T13:35:50.026145+0000, chain.objs.size()=1 2024-09-14T12:01:18.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.786+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ivChtXPNISPUz_dZI3zbiSxAUIiRTHY_0 2024-09-14T12:01:18.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.786+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1436231915478422567', time=2024-09-14T13:35:50.239469+0000, chain.objs.size()=1 2024-09-14T12:01:18.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.786+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.P8ncjB449-NOZUjJLtydEqESXQbw_Ly_0 2024-09-14T12:01:18.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.786+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13426410995073623412', time=2024-09-14T13:35:50.756109+0000, chain.objs.size()=1 2024-09-14T12:01:18.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.786+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.tez-4BfbUCOq_27g9Ulfsl2IyThYOec_0 2024-09-14T12:01:18.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.789+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/45800 2024-09-14T12:01:18.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-14T12:01:18.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1952527214088868609', time=2024-09-14T13:35:50.758031+0000, chain.objs.size()=1 2024-09-14T12:01:18.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.adnLPuXPiXYWP3BVwDS1GHNLgt6ZBnB_0 2024-09-14T12:01:18.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4435610016714681067', time=2024-09-14T13:35:50.994986+0000, chain.objs.size()=1 2024-09-14T12:01:18.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.S_TmInU0M7-YRQzPBuzzv0LlN7PDqyP_0 2024-09-14T12:01:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3568783203488118370', time=2024-09-14T13:35:51.416165+0000, chain.objs.size()=1 2024-09-14T12:01:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.JpTYYwn6kuAklC4-AdSPwWFlPwZn1wI_0 2024-09-14T12:01:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3789415089332362966', time=2024-09-14T13:36:51.004163+0000, chain.objs.size()=1 2024-09-14T12:01:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.382__shadow_.rVQHWwXEQzJ14udUnHxAo3Dvd5Zz92t_0 2024-09-14T12:01:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16572890506508906623', time=2024-09-14T13:37:22.704197+0000, chain.objs.size()=1 2024-09-14T12:01:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.411__shadow_.kxOPVZ-xBU9BUNZAHkJtG2N038C9sGZ_0 2024-09-14T12:01:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9100181047026098183', time=2024-09-14T13:37:47.448273+0000, chain.objs.size()=1 2024-09-14T12:01:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.434__shadow_.W3gbwo7glBJhi_H_j_IBcGVGbDgtPB6_0 2024-09-14T12:01:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14667179313403419654', time=2024-09-14T13:37:59.914243+0000, chain.objs.size()=1 2024-09-14T12:01:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.445__shadow_.ZLAPf9gTJUEodzwKayZkwRScSM-AqqD_0 2024-09-14T12:01:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2231622433224135483', time=2024-09-14T13:38:42.791138+0000, chain.objs.size()=1 2024-09-14T12:01:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.484__shadow_.z0IEEqWjochuRdNjopOPb_OTETZN7o-_0 2024-09-14T12:01:18.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11333092770802267595', time=2024-09-14T13:38:44.074016+0000, chain.objs.size()=1 2024-09-14T12:01:18.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.485__shadow_.WCEk_V3n_qbERoRbJOlCW6yw50d-Ctr_0 2024-09-14T12:01:18.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9279736048865461141', time=2024-09-14T13:45:37.559570+0000, chain.objs.size()=1 2024-09-14T12:01:18.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:VUUcHBvdgoBiMAUo8KlRZ30oA4Sbufy_.4Mr4YY3i42g6En-qAzXTNeLajaZ57Gg_0 2024-09-14T12:01:18.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2453330929765550699', time=2024-09-14T13:45:38.848401+0000, chain.objs.size()=1 2024-09-14T12:01:18.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:ryQPeUGMFNF091hgPH5PAI8j63B7UUj_.YfT9HULlfcEVNd6Wq9IE2BWhTVb7K09_0 2024-09-14T12:01:18.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15615551260798841828', time=2024-09-14T13:46:06.511205+0000, chain.objs.size()=1 2024-09-14T12:01:18.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.791+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.577__shadow:GLLA9-L9rI-zc8aF.jlAF0NeVbgY5kB_.8NKe07Fu8DgrOMhTV0z5IYDQoer20xM_0 2024-09-14T12:01:18.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.794+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5867776677327814844', time=2024-09-14T13:46:10.385785+0000, chain.objs.size()=1 2024-09-14T12:01:18.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.794+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:Jvz3rqfKznWL7O4qtFAjXWjjJQiDOvY_.itbLLnsQ2hzL90nhIkZVQ6rlPX3X160_0 2024-09-14T12:01:18.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.795+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14994084554171779172', time=2024-09-14T13:46:21.675755+0000, chain.objs.size()=1 2024-09-14T12:01:18.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.795+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:CVgoNuOrxcEnV-.VhE4autdpRXt6haK_.6wDuejSBmOesbMTVQlOkY9206Moy4Tf_0 2024-09-14T12:01:18.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.795+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12136918932322940763', time=2024-09-14T13:46:28.419112+0000, chain.objs.size()=1 2024-09-14T12:01:18.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.795+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:X6RNvX7X9TaPhhWAgzycrKi0OeKgn.A_.-NKKab2QCqkrZJNV83aRj_DI7vfiYSL_0 2024-09-14T12:01:18.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.796+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16609097065646142048', time=2024-09-14T13:47:14.886081+0000, chain.objs.size()=1 2024-09-14T12:01:18.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.796+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.584__shadow:nId36T77EsRvVztQljyp16MMyW2dDtN_.aG82I_fUX-VkYEWiWElgDE80i4riAMf_0 2024-09-14T12:01:18.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.796+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16560002879544563175', time=2024-09-14T13:52:44.071505+0000, chain.objs.size()=1 2024-09-14T12:01:18.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.796+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.632__shadow_.uqyOYnZppiJ48H-WtcscPzXKV_J24Tt_0 2024-09-14T12:01:18.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.796+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13567600102447620013', time=2024-09-14T13:53:57.706904+0000, chain.objs.size()=1 2024-09-14T12:01:18.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.796+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.666__shadow_.6lAo-Wg9pwjBuRMgd8d2kY8mYRqzZ-v_0 2024-09-14T12:01:18.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.796+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4718887407082399412', time=2024-09-14T13:54:10.926671+0000, chain.objs.size()=1 2024-09-14T12:01:18.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.796+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.680__shadow_.IwPQVta60rcvfCcZfo9RRWlysxJWc5u_0 2024-09-14T12:01:18.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.796+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3202030511986767866', time=2024-09-14T13:57:47.539882+0000, chain.objs.size()=1 2024-09-14T12:01:18.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.796+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.764__shadow_.HYSQhrfX4geY9H7uU3O-by5FqqzyTAT_0 2024-09-14T12:01:18.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.799+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:18.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.802+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T12:01:18.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.803+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:18.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.803+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:18.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.804+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50533' 2024-09-14T12:01:18.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.804+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7111786645444098998', time=2024-09-14T13:27:51.509853+0000, chain.objs.size()=3 2024-09-14T12:01:18.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.804+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.160__multipart_mymultipart-FROZEN.2~4qMJn-GKBFBV9ANe-OV16uc22nJJg-t.1 2024-09-14T12:01:18.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.804+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.160__multipart_mymultipart-FROZEN.2~4qMJn-GKBFBV9ANe-OV16uc22nJJg-t.2 2024-09-14T12:01:18.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.804+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.160__multipart_mymultipart-FROZEN.2~4qMJn-GKBFBV9ANe-OV16uc22nJJg-t.3 2024-09-14T12:01:18.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.804+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16517104760535387278', time=2024-09-14T13:29:33.021584+0000, chain.objs.size()=1 2024-09-14T12:01:18.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.804+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.201__shadow_.fPIQXkfnzVpiIEngeh3ZkFLfIncwX1A_0 2024-09-14T12:01:18.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.804+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10908685026525479889', time=2024-09-14T13:29:39.643467+0000, chain.objs.size()=1 2024-09-14T12:01:18.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.804+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.205__shadow_.BRGk8w_0oxcHZutwEA7xhpRM7L3IqzU_0 2024-09-14T12:01:18.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.804+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2692022175572881672', time=2024-09-14T13:31:33.784538+0000, chain.objs.size()=1 2024-09-14T12:01:18.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.804+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.232__shadow_.G8DIJP3uJZL2y7pDkbFnw0yXbMr8EYJ_0 2024-09-14T12:01:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.804+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11320745338986908097', time=2024-09-14T13:31:35.925755+0000, chain.objs.size()=1 2024-09-14T12:01:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.804+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.234__shadow_.7It1sBdXwJ7boJG3qJZmNXQBqg6Y6dM_0 2024-09-14T12:01:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.804+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18203404232456598768', time=2024-09-14T13:31:39.192208+0000, chain.objs.size()=1 2024-09-14T12:01:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.804+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.237__shadow_.TK_WcQTpR43id6XObqrYyGGjBK66tzx_0 2024-09-14T12:01:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.804+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6452218691570012247', time=2024-09-14T13:31:41.003021+0000, chain.objs.size()=1 2024-09-14T12:01:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.804+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.238__shadow_.cFzQ89RrCo300qRECUpDteQk6jafz8V_0 2024-09-14T12:01:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.804+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.985313495005248626', time=2024-09-14T13:32:06.043806+0000, chain.objs.size()=1 2024-09-14T12:01:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.804+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.259__shadow_.nEPLebOJ4qOGJzwC5kdSRfXdCmZyYrE_0 2024-09-14T12:01:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.804+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16072594872259451127', time=2024-09-14T13:32:47.380852+0000, chain.objs.size()=1 2024-09-14T12:01:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.804+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.bfhvyqeXLJIBr7btT-xstLJpGsHUxTd_0 2024-09-14T12:01:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.804+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18313318455353947462', time=2024-09-14T13:32:47.730070+0000, chain.objs.size()=1 2024-09-14T12:01:18.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.804+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.f5I6wSExB7DAfV4Ho4BD6fASq-BbX8X_0 2024-09-14T12:01:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.808+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1962167571258021837', time=2024-09-14T13:32:47.736922+0000, chain.objs.size()=1 2024-09-14T12:01:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.808+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.hilxCgCT_GDXK9ozTd4eyEeaXVaO_GJ_0 2024-09-14T12:01:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.808+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15758490742104668240', time=2024-09-14T13:32:47.887505+0000, chain.objs.size()=1 2024-09-14T12:01:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.808+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.usaDQ5quyCmXXGmLkCVJSzWGRPAj4Pm_0 2024-09-14T12:01:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.808+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3920348243499800300', time=2024-09-14T13:32:47.925342+0000, chain.objs.size()=1 2024-09-14T12:01:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.808+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ev9xILw1rZZjZ1tbhI2sbfuv-MZ-SsP_0 2024-09-14T12:01:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.808+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5339846165427280366', time=2024-09-14T13:32:48.471040+0000, chain.objs.size()=1 2024-09-14T12:01:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.808+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.5yuRguCK6PLh1ll3t24Q3KRRXcZI0cv_0 2024-09-14T12:01:18.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.808+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.308201753076865350', time=2024-09-14T13:32:49.003872+0000, chain.objs.size()=1 2024-09-14T12:01:18.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.808+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.8J9agq7NI0k0aZixqCdFJTAiMRir5oE_0 2024-09-14T12:01:18.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.808+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17493098232424071680', time=2024-09-14T13:32:49.028793+0000, chain.objs.size()=1 2024-09-14T12:01:18.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.808+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.5hnYcHisLDuO6uyQ8EtGX4KdgPfwRPc_0 2024-09-14T12:01:18.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.808+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17403696852250005416', time=2024-09-14T13:32:49.356755+0000, chain.objs.size()=1 2024-09-14T12:01:18.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.808+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.o1X_7ablrB7v7WHDtkylDTJRmv9zRpa_0 2024-09-14T12:01:18.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.808+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5681726921148042953', time=2024-09-14T13:32:49.652921+0000, chain.objs.size()=1 2024-09-14T12:01:18.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.808+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.JnpsA6huCzwUB2kVGk8CpvAlhpchsV__0 2024-09-14T12:01:18.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.808+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8325047467259686405', time=2024-09-14T13:32:49.984019+0000, chain.objs.size()=1 2024-09-14T12:01:18.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.808+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.nK3MWy5S3pXlBQwo0357K_jGMg-wD3t_0 2024-09-14T12:01:18.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.808+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11109258592412320411', time=2024-09-14T13:32:50.004692+0000, chain.objs.size()=1 2024-09-14T12:01:18.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.808+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.2xW0stMxfPSAULtiQKvG2f0rAT-7plO_0 2024-09-14T12:01:18.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.808+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14401337876502267699', time=2024-09-14T13:32:50.537420+0000, chain.objs.size()=1 2024-09-14T12:01:18.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.808+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.JjtbKAIB-JSEyR9eLT4ITkdNYrH6tKc_0 2024-09-14T12:01:18.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.811+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.702671084014025099', time=2024-09-14T13:32:50.683653+0000, chain.objs.size()=1 2024-09-14T12:01:18.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.811+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.1jkRkiBjnzg6Zts4JPMsLZUHL070SxG_0 2024-09-14T12:01:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.811+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1322882035456127875', time=2024-09-14T13:32:50.740749+0000, chain.objs.size()=1 2024-09-14T12:01:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.811+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.zGuwy4MeyFY8H2QTLzmlE8QlBeaUBI3_0 2024-09-14T12:01:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.811+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7657151760033414928', time=2024-09-14T13:32:51.597044+0000, chain.objs.size()=1 2024-09-14T12:01:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.811+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.sHrbnlnu3EydNmmovi4IDHTXaPLXSt__0 2024-09-14T12:01:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.811+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15908450838334380567', time=2024-09-14T13:32:52.057252+0000, chain.objs.size()=1 2024-09-14T12:01:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.811+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.YzKHoDOoL6CJ78m9kp0Z-bGX-ABhCWT_0 2024-09-14T12:01:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.811+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16430884099117472764', time=2024-09-14T13:32:52.892699+0000, chain.objs.size()=1 2024-09-14T12:01:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.811+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.hKJJAXdsV5pEP-pU-FbEvDoyZWmkHPw_0 2024-09-14T12:01:18.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.811+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17111500621915383202', time=2024-09-14T13:32:54.947354+0000, chain.objs.size()=1 2024-09-14T12:01:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.811+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.sVu3SHuwTz3R_M8lzYL6k1dc8luqOZa_0 2024-09-14T12:01:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.811+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2180244468438158429', time=2024-09-14T13:32:55.410708+0000, chain.objs.size()=1 2024-09-14T12:01:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.811+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.5MuVils-GAAEodIDr49T0lFmzKFy0Yw_0 2024-09-14T12:01:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.811+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2958955096759341725', time=2024-09-14T13:32:55.672096+0000, chain.objs.size()=1 2024-09-14T12:01:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.811+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.y7L0CGBdMKkyyGjAmZ5b34e26cALWER_0 2024-09-14T12:01:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.812+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.130114825497283089', time=2024-09-14T13:32:55.773699+0000, chain.objs.size()=1 2024-09-14T12:01:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.812+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Pb-OXQgoBFnb58AdHu2kj9L4sZXPqJy_0 2024-09-14T12:01:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.812+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14286080062587390233', time=2024-09-14T13:32:55.966318+0000, chain.objs.size()=1 2024-09-14T12:01:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.812+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.JErJntNit4gQEasHKQvH1f5h9R1oMOq_0 2024-09-14T12:01:18.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.812+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6711554387518420914', time=2024-09-14T13:32:56.349200+0000, chain.objs.size()=1 2024-09-14T12:01:18.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.812+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_._Huhgq9-1ZfI2sOrEqQthFdSK1JuALA_0 2024-09-14T12:01:18.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.815+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16867836082888651959', time=2024-09-14T13:32:56.458937+0000, chain.objs.size()=1 2024-09-14T12:01:18.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.815+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.82Xv2CuApJJJihRjl_dbbT42wQDca_K_0 2024-09-14T12:01:18.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.815+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11508458529690170547', time=2024-09-14T13:32:56.588118+0000, chain.objs.size()=1 2024-09-14T12:01:18.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.815+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.qyD18vKwBv6ySKfsPO6XXe1XwRUR3v5_0 2024-09-14T12:01:18.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.815+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5084799753738934709', time=2024-09-14T13:32:56.813554+0000, chain.objs.size()=1 2024-09-14T12:01:18.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.815+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.omDjklD1iz7E7GlJ3nZ7a4Y2aohOU7b_0 2024-09-14T12:01:18.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.815+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10724576325137777391', time=2024-09-14T13:32:56.956934+0000, chain.objs.size()=1 2024-09-14T12:01:18.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.815+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.TrCnAISzSEnMvlZzI9l9jG9tIXvMWn7_0 2024-09-14T12:01:18.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.815+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13781414078083254623', time=2024-09-14T13:32:57.445831+0000, chain.objs.size()=1 2024-09-14T12:01:18.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.815+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Bpax77AMc4eu18ctJguSFBn8kV5gOpn_0 2024-09-14T12:01:18.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.815+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16855451293155412073', time=2024-09-14T13:32:57.809611+0000, chain.objs.size()=1 2024-09-14T12:01:18.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.815+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ruyt_KdMoVadxrmWBbnTtI6dlr32aky_0 2024-09-14T12:01:18.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.815+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1100103585468946339', time=2024-09-14T13:32:58.150199+0000, chain.objs.size()=1 2024-09-14T12:01:18.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.815+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.zJAZGRJorvd10ZEf2kORq4-SWe-XiQ3_0 2024-09-14T12:01:18.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.815+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9526654227173726202', time=2024-09-14T13:32:58.365964+0000, chain.objs.size()=1 2024-09-14T12:01:18.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.815+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.VPP1y3pS1JZFamy1mnFjR90fL4UJCTA_0 2024-09-14T12:01:18.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.815+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2730989754567702727', time=2024-09-14T13:32:58.527105+0000, chain.objs.size()=1 2024-09-14T12:01:18.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.815+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.8jMX70bwOJA7Xx9uz8CNzD_o8N6kPj9_0 2024-09-14T12:01:18.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.817+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11790681046360303537', time=2024-09-14T13:32:59.821404+0000, chain.objs.size()=1 2024-09-14T12:01:18.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.817+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.264__shadow_.xhXA-zUHsJMxe0DSL9BBLBM8DPxCYzj_0 2024-09-14T12:01:18.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.817+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11482679560585699961', time=2024-09-14T13:33:28.181040+0000, chain.objs.size()=1 2024-09-14T12:01:18.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.817+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.290__shadow_.iefg0xBFQuvXDLYqbTzpnDyKHpNGWfs_0 2024-09-14T12:01:18.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.818+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15901173829036393270', time=2024-09-14T13:33:30.830257+0000, chain.objs.size()=1 2024-09-14T12:01:18.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.818+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.292__shadow_.sP-jBhF3Pc8jWnPHHL8t6RNkUU6uZR0_0 2024-09-14T12:01:18.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.819+0000 7fb9ff3a6640 0 -- 172.21.15.50:0/1397114374 >> [v2:172.21.15.118:6816/4154782182,v1:172.21.15.118:6817/4154782182] conn(0x7fb8c808de00 msgr2=0x7fb8c8092c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:01:18.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.819+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8562517478951839473', time=2024-09-14T13:33:40.033582+0000, chain.objs.size()=1 2024-09-14T12:01:18.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.819+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.298__shadow_.m2iC0Nh1tV0tUuQ2ZzsTQ87qZOc-WtJ_0 2024-09-14T12:01:18.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.819+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2277526387142555816', time=2024-09-14T13:33:48.043360+0000, chain.objs.size()=1 2024-09-14T12:01:18.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.819+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.305__shadow_.JZPlrUOR4Ru2Jb4H6mJgLZfI6Qgpwxv_0 2024-09-14T12:01:18.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.820+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9398599823133708864', time=2024-09-14T13:33:49.138440+0000, chain.objs.size()=1 2024-09-14T12:01:18.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.820+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.306__shadow_.KB8WUMjje8s9WsTUm0F8-raB1NyqqIN_0 2024-09-14T12:01:18.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.820+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11690082658953618911', time=2024-09-14T13:33:50.474866+0000, chain.objs.size()=1 2024-09-14T12:01:18.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.820+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.307__shadow_.B210srKy6dV9rv0s6VTqpx2fQPiwNTF_0 2024-09-14T12:01:18.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.821+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3288519967446399384', time=2024-09-14T13:34:51.934021+0000, chain.objs.size()=1 2024-09-14T12:01:18.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.821+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Neolol-6T3zONzIeaouJesjdTjnzKN6_0 2024-09-14T12:01:18.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.821+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18126224833563912295', time=2024-09-14T13:34:52.093546+0000, chain.objs.size()=1 2024-09-14T12:01:18.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.821+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ZESyPM1W2meuBZolUAP8E10Ptv-N-z1_0 2024-09-14T12:01:18.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.821+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11995620562273395975', time=2024-09-14T13:34:52.269753+0000, chain.objs.size()=1 2024-09-14T12:01:18.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.821+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ImjIaKFa4u93uUwwx3_DemBZSFbc_q9_0 2024-09-14T12:01:18.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.821+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9801953943270606521', time=2024-09-14T13:34:53.672149+0000, chain.objs.size()=1 2024-09-14T12:01:18.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.821+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.2c72HpLhY17psZI50xqGSyQx5toNmAM_0 2024-09-14T12:01:18.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.822+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2962195215378023455', time=2024-09-14T13:34:53.702012+0000, chain.objs.size()=1 2024-09-14T12:01:18.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.822+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Q-ZurlIi374IN_Dfl5E_mzq3pONfgzy_0 2024-09-14T12:01:18.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.822+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15886416122169968885', time=2024-09-14T13:34:53.815645+0000, chain.objs.size()=1 2024-09-14T12:01:18.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.822+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.MBFg_-i9wTHVe65H7nRxGTvy9txFQjX_0 2024-09-14T12:01:18.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.822+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2884206726362131543', time=2024-09-14T13:34:54.871717+0000, chain.objs.size()=1 2024-09-14T12:01:18.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.822+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.F6sl6JRZlDXYnk5q9mCR8wksLU4yZiJ_0 2024-09-14T12:01:18.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.822+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13244441814027372014', time=2024-09-14T13:34:55.629958+0000, chain.objs.size()=1 2024-09-14T12:01:18.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.822+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.20ajGqA7KKodLf2p5oXFtx9cOTS2uwx_0 2024-09-14T12:01:18.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.824+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9677173407966390261', time=2024-09-14T13:34:56.446543+0000, chain.objs.size()=1 2024-09-14T12:01:18.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.824+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.esVyVIfKQSmqVGf0nJlL0dIX4UwKBlB_0 2024-09-14T12:01:18.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.824+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17242579554856088341', time=2024-09-14T13:34:56.491614+0000, chain.objs.size()=1 2024-09-14T12:01:18.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.824+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ibBc9rj0C4nVpEufFXcqdDoIeOiTRHC_0 2024-09-14T12:01:18.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.824+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11103680309660285081', time=2024-09-14T13:34:56.548357+0000, chain.objs.size()=1 2024-09-14T12:01:18.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.824+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.3KY-9JYoYAs4-2FW-rUVmfKPnY-OqOz_0 2024-09-14T12:01:18.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.825+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.967400970385636124', time=2024-09-14T13:34:56.585906+0000, chain.objs.size()=1 2024-09-14T12:01:18.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.825+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.w60oR-AEeix8qYF41otD18tvEzSPUcO_0 2024-09-14T12:01:18.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.825+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2156867856550599325', time=2024-09-14T13:34:56.651947+0000, chain.objs.size()=1 2024-09-14T12:01:18.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.825+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.exeyn2qHiUoOq_UXIKtHbG65u6Y-TBI_0 2024-09-14T12:01:18.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.826+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8690394044184326169', time=2024-09-14T13:34:57.180664+0000, chain.objs.size()=1 2024-09-14T12:01:18.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.826+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.6qhZo_jjP_Afaq597zmpDJ8gL6VKxy8_0 2024-09-14T12:01:18.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.826+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10751906311412008086', time=2024-09-14T13:34:57.772607+0000, chain.objs.size()=1 2024-09-14T12:01:18.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.826+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.dH9Qt1MoVR8kIpQJAU2_cdHKzKSWErO_0 2024-09-14T12:01:18.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.826+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6434793705388276135', time=2024-09-14T13:34:58.096602+0000, chain.objs.size()=1 2024-09-14T12:01:18.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.826+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.7u9yF76D5vXHYCAonVdDE50-hzCjs7O_0 2024-09-14T12:01:18.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.826+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3590510906545251007', time=2024-09-14T13:34:58.117027+0000, chain.objs.size()=1 2024-09-14T12:01:18.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.826+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.TBXOlhjtpejmriAfB9dMdTHhQTC1h9G_0 2024-09-14T12:01:18.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.826+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7943891831671763016', time=2024-09-14T13:34:58.329972+0000, chain.objs.size()=1 2024-09-14T12:01:18.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.826+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.huU3Xx_LDeSHwfPrr2NfOI9mgoSif_l_0 2024-09-14T12:01:18.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.828+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3862819979151091412', time=2024-09-14T13:34:58.457624+0000, chain.objs.size()=1 2024-09-14T12:01:18.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.828+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.tvOJYg-ytcApzMvyQEwD6E70Yj1_Mxg_0 2024-09-14T12:01:18.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.828+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12698592244810847008', time=2024-09-14T13:34:59.448008+0000, chain.objs.size()=1 2024-09-14T12:01:18.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.828+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.KJ5yKtwbzHuWM_gbJXmDrJ-Js2kTrGQ_0 2024-09-14T12:01:18.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.828+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15591191933376435429', time=2024-09-14T13:34:59.558964+0000, chain.objs.size()=1 2024-09-14T12:01:18.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.828+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.iY2ntgRA--QQzByuNWi_vemuOauejc-_0 2024-09-14T12:01:18.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.828+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7463112464642802187', time=2024-09-14T13:34:59.560196+0000, chain.objs.size()=1 2024-09-14T12:01:18.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.828+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.vYmlWVRuNJDRDiOMlbRtHmQWljF0SpZ_0 2024-09-14T12:01:18.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.829+0000 7fb9fe3a4640 0 -- 172.21.15.50:0/1397114374 >> [v2:172.21.15.50:6816/1957449887,v1:172.21.15.50:6817/1957449887] conn(0x562b70d5fed0 msgr2=0x562b70d622c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:01:18.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.829+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4610661729431321399', time=2024-09-14T13:34:59.602498+0000, chain.objs.size()=1 2024-09-14T12:01:18.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.829+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.HdFwEceXuhGS6yCVkxqhkDTDEc_I5wZ_0 2024-09-14T12:01:18.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.829+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15675202333640476570', time=2024-09-14T13:34:59.811910+0000, chain.objs.size()=1 2024-09-14T12:01:18.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.829+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.pgX5oDzp23QseC8hL021rcOi97BmqUZ_0 2024-09-14T12:01:18.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.829+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2135379380748946788', time=2024-09-14T13:34:59.907717+0000, chain.objs.size()=1 2024-09-14T12:01:18.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.829+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.oye3mnM9HRx9rGaw4o9espI9PYbvl_P_0 2024-09-14T12:01:18.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.831+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11211470457039457457', time=2024-09-14T13:35:00.734659+0000, chain.objs.size()=1 2024-09-14T12:01:18.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.831+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.8sZkbs1KP_asoBlO-2_tTsv-5GGIYIp_0 2024-09-14T12:01:18.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.831+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17671233233948794799', time=2024-09-14T13:35:01.319030+0000, chain.objs.size()=1 2024-09-14T12:01:18.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.831+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.OtaDyWMcav5BUf6LxBNTDtP5QfAup5K_0 2024-09-14T12:01:18.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.831+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13956158008887470543', time=2024-09-14T13:35:02.056253+0000, chain.objs.size()=1 2024-09-14T12:01:18.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.831+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Jw2PSmZf6S18KE7rZcBFMYpGarl9HVc_0 2024-09-14T12:01:18.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.831+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7988358708351958061', time=2024-09-14T13:35:02.112799+0000, chain.objs.size()=1 2024-09-14T12:01:18.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.831+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.37H3gswB9d_EhJ-60_gn8o7Z4mLOnbG_0 2024-09-14T12:01:18.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.834+0000 7fb9feba5640 0 -- 172.21.15.50:0/1397114374 >> [v2:172.21.15.50:6800/2565843969,v1:172.21.15.50:6801/2565843969] conn(0x562b70d5c5f0 msgr2=0x562b70d5ea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:01:18.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.835+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15495177536011996715', time=2024-09-14T13:35:42.362055+0000, chain.objs.size()=1 2024-09-14T12:01:18.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.835+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.heQ4log1UYO7bImQUJyc9spcpRQxq7u_0 2024-09-14T12:01:18.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.835+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.407399899320578191', time=2024-09-14T13:35:42.469820+0000, chain.objs.size()=1 2024-09-14T12:01:18.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.835+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.K-fJ10NEI5Kh1ADz90Zytr5CG_GaTdP_0 2024-09-14T12:01:18.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.835+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8246908449199524652', time=2024-09-14T13:35:42.503604+0000, chain.objs.size()=1 2024-09-14T12:01:18.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.835+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.C87g_YGLVvoC6VMBM-kvfnuGwo4-XvH_0 2024-09-14T12:01:18.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.835+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13445576130937549408', time=2024-09-14T13:35:42.551722+0000, chain.objs.size()=1 2024-09-14T12:01:18.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.835+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.C5TMJQd-mVb-5xsQ6gEpXgovum8Zsar_0 2024-09-14T12:01:18.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.835+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12032807448924974959', time=2024-09-14T13:35:44.031891+0000, chain.objs.size()=1 2024-09-14T12:01:18.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.835+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.YO0kz7wqwTZj-LMt9NZ_MZubDo_yKoe_0 2024-09-14T12:01:18.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.835+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8520071305708015138', time=2024-09-14T13:35:44.081446+0000, chain.objs.size()=1 2024-09-14T12:01:18.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.835+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.vtLgfB9H_BhEKL-EsztLVylrIQjpzMl_0 2024-09-14T12:01:18.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.835+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6630188868139966710', time=2024-09-14T13:35:44.182310+0000, chain.objs.size()=1 2024-09-14T12:01:18.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.835+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.WMC3X3Xx_z87WANsNTCvtFgwa572XpQ_0 2024-09-14T12:01:18.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.835+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2750073147974385731', time=2024-09-14T13:35:44.287550+0000, chain.objs.size()=1 2024-09-14T12:01:18.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.835+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.YCsd7IveCg3vROArcyFabl5x63EWkYO_0 2024-09-14T12:01:18.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.835+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6389479727826840745', time=2024-09-14T13:35:44.853581+0000, chain.objs.size()=1 2024-09-14T12:01:18.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.835+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.PbW0N2cEa1jHRdAADgik1eGc-ej4bV0_0 2024-09-14T12:01:18.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.835+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9668119891803560596', time=2024-09-14T13:35:45.294920+0000, chain.objs.size()=1 2024-09-14T12:01:18.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.835+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.BqGYecYucqjiaUTtmM-grHy2SO0nWl0_0 2024-09-14T12:01:18.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.835+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2942468398623081244', time=2024-09-14T13:35:45.334124+0000, chain.objs.size()=1 2024-09-14T12:01:18.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.835+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.NBJlneO7tE57Hl3gMlqiXhTibEYi1aq_0 2024-09-14T12:01:18.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.837+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1938807664776486620', time=2024-09-14T13:35:45.338599+0000, chain.objs.size()=1 2024-09-14T12:01:18.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.837+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.aVxdxNI9N5lSHteCuSQQNe4tlRVn4Ws_0 2024-09-14T12:01:18.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.839+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3206242157662936761', time=2024-09-14T13:35:45.569996+0000, chain.objs.size()=1 2024-09-14T12:01:18.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.839+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.tXX3B1oBIqWCuuaT5gKYlZC-y4X095e_0 2024-09-14T12:01:18.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.840+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1629123973176949618', time=2024-09-14T13:35:46.777113+0000, chain.objs.size()=1 2024-09-14T12:01:18.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.840+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.YHjPTe1ESc5e88dcUsARYUi-4QbP2XG_0 2024-09-14T12:01:18.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.840+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13093724790460457618', time=2024-09-14T13:35:46.921884+0000, chain.objs.size()=1 2024-09-14T12:01:18.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.840+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.EzpfrG_MXeYcDMxYTmXIro5k76EuvEy_0 2024-09-14T12:01:18.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.840+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10573151822579074898', time=2024-09-14T13:35:47.092875+0000, chain.objs.size()=1 2024-09-14T12:01:18.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.840+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.jbfQkciupF_L5Xi6e-q5XIgqgUnqcpc_0 2024-09-14T12:01:18.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.840+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17399458004185598370', time=2024-09-14T13:35:48.322887+0000, chain.objs.size()=1 2024-09-14T12:01:18.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.840+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Q7Mvdmm1Ji0dFWEBH4Bcbu7UUQ9kwAU_0 2024-09-14T12:01:18.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.840+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17935777726606281528', time=2024-09-14T13:35:48.494552+0000, chain.objs.size()=1 2024-09-14T12:01:18.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.840+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.00FDIA1ewyIICyTf9vssmr-gMnuPEil_0 2024-09-14T12:01:18.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.840+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14837556690733756364', time=2024-09-14T13:35:48.631361+0000, chain.objs.size()=1 2024-09-14T12:01:18.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.840+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.uomnIIzZ8tBKk6RPLqKOyyX4lRTeO0X_0 2024-09-14T12:01:18.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.840+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14237273721004046927', time=2024-09-14T13:35:48.695377+0000, chain.objs.size()=1 2024-09-14T12:01:18.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.840+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.csqOJHHQWRICFocNLI4xprPuc7F6aaT_0 2024-09-14T12:01:18.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.840+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.779195946243591284', time=2024-09-14T13:35:48.696118+0000, chain.objs.size()=1 2024-09-14T12:01:18.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.840+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.wk9UzS3C2MRlpv1Qcf6fJ1uJ47xeTfy_0 2024-09-14T12:01:18.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.840+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3941672592284331406', time=2024-09-14T13:35:48.728660+0000, chain.objs.size()=1 2024-09-14T12:01:18.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.840+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.pihfPDnCIbut--JDVqcI_lkA3VM2qJh_0 2024-09-14T12:01:18.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.842+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18070373889476639870', time=2024-09-14T13:35:48.779973+0000, chain.objs.size()=1 2024-09-14T12:01:18.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.842+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.bHdTWWX6gklyWyI6cw9xnGfVx4BeBVZ_0 2024-09-14T12:01:18.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.846+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/50533 2024-09-14T12:01:18.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-14T12:01:18.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11804151530717630233', time=2024-09-14T13:35:49.338737+0000, chain.objs.size()=1 2024-09-14T12:01:18.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Tm9wiboEBZvtFBmL4-7fnMHKG-oyjgh_0 2024-09-14T12:01:18.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5610242021289440423', time=2024-09-14T13:35:49.546980+0000, chain.objs.size()=1 2024-09-14T12:01:18.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.5--kDDTddyjVrARIF6laMEpgEIOoWnW_0 2024-09-14T12:01:18.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7753808713155929837', time=2024-09-14T13:35:50.613023+0000, chain.objs.size()=1 2024-09-14T12:01:18.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.mdj24fZhSAXo42YsABjq51V8YUxicca_0 2024-09-14T12:01:18.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8608659139695419182', time=2024-09-14T13:35:51.082492+0000, chain.objs.size()=1 2024-09-14T12:01:18.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.NPBvcaPTDlWWhvuQ2nYefbXOaUFEv7U_0 2024-09-14T12:01:18.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3841636242253738193', time=2024-09-14T13:35:51.086564+0000, chain.objs.size()=1 2024-09-14T12:01:18.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.xOOYq08buq2C8ap4OLkb3j6D4Ow2s7V_0 2024-09-14T12:01:18.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2635103751960364783', time=2024-09-14T13:36:07.817567+0000, chain.objs.size()=1 2024-09-14T12:01:18.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.340__shadow_.-zskyVh_KUiDNA8ebh2CR0Ige5222VY_0 2024-09-14T12:01:18.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2451502449094728019', time=2024-09-14T13:36:43.450769+0000, chain.objs.size()=1 2024-09-14T12:01:18.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.375__shadow_.7CHCxpYCohRM1z3CauO-m820MnO4fs8_0 2024-09-14T12:01:18.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13422193658521254067', time=2024-09-14T13:37:19.456253+0000, chain.objs.size()=1 2024-09-14T12:01:18.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.408__shadow_.yAgmp4oLbGaI-cIYSttqP4GiTkzaaH-_0 2024-09-14T12:01:18.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2875383093680310975', time=2024-09-14T13:38:20.991434+0000, chain.objs.size()=1 2024-09-14T12:01:18.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.461__shadow_.2vE90cS2CbtnoSioBBtNGvc5sAMaUT9_0 2024-09-14T12:01:18.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13167882162290467229', time=2024-09-14T13:38:24.044209+0000, chain.objs.size()=1 2024-09-14T12:01:18.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.463__shadow_.B75dbEt7D3SxW6cIqqw4R6D9FKYvZlS_0 2024-09-14T12:01:18.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2165494286413321356', time=2024-09-14T13:39:54.433372+0000, chain.objs.size()=1 2024-09-14T12:01:18.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.519__multipart_mymultipart.2~VavtrRVkhiAzorbswgqFcCwWLxI4CQ0.1 2024-09-14T12:01:18.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10881536884147107875', time=2024-09-14T13:45:04.619189+0000, chain.objs.size()=1 2024-09-14T12:01:18.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.848+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.557__shadow_.VdtMAcCkBLGI0njWxhwL-D9KTj5wqBv_0 2024-09-14T12:01:18.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.851+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2117754775810085708', time=2024-09-14T13:45:54.752897+0000, chain.objs.size()=1 2024-09-14T12:01:18.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.851+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.575__shadow_.iv709IxRqFa_AAr8zhExPNi8EWxeWSe_0 2024-09-14T12:01:18.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.851+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4269604331826790789', time=2024-09-14T13:46:12.921551+0000, chain.objs.size()=1 2024-09-14T12:01:18.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.851+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:lZWIJLkPKS0jN-gS4GCYIfEdo710MsG_.PtmY8oHsUeS5ws9iJVo1XAY6lDESegF_0 2024-09-14T12:01:18.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.851+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6020089012408849733', time=2024-09-14T13:47:17.992385+0000, chain.objs.size()=1 2024-09-14T12:01:18.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.851+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.586__shadow:6qOhEI3hHrdLxY4GSMrsm7gu2Jz8o5g_.UhWsOjnSMciM5yLGQwx4doCZvvej5Wj_0 2024-09-14T12:01:18.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.851+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1049223183652960279', time=2024-09-14T13:53:57.702086+0000, chain.objs.size()=1 2024-09-14T12:01:18.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.851+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.666__shadow_.qvNK2XXJh9TKi-UQtBBg5zp98uLHh1m_0 2024-09-14T12:01:18.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.851+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5044186948876964082', time=2024-09-14T13:54:03.692630+0000, chain.objs.size()=1 2024-09-14T12:01:18.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.851+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.672__shadow_.T1D7vVUnvb3beB_l19VLQU_MpPHTb1C_0 2024-09-14T12:01:18.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.851+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4219117745086410840', time=2024-09-14T13:56:14.726262+0000, chain.objs.size()=1 2024-09-14T12:01:18.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.851+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.748__shadow_.DX67xevoOkIaj_HfboW330DyGZTnKZ1_0 2024-09-14T12:01:18.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.855+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:18.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.857+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T12:01:18.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.858+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:18.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.859+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:18.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.860+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49011' 2024-09-14T12:01:18.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.860+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16321885372843292012', time=2024-09-14T13:27:51.565540+0000, chain.objs.size()=3 2024-09-14T12:01:18.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.860+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.160__multipart_mymultipart-STANDARD.2~V_z0CsIGh6TixtuvmgyX9C9q5iu5HlC.1 2024-09-14T12:01:18.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.860+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.160__multipart_mymultipart-STANDARD.2~V_z0CsIGh6TixtuvmgyX9C9q5iu5HlC.2 2024-09-14T12:01:18.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.860+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.160__multipart_mymultipart-STANDARD.2~V_z0CsIGh6TixtuvmgyX9C9q5iu5HlC.3 2024-09-14T12:01:18.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.860+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~89TQ0i_7dOW96axGiqIEI1O8VTTUI2v', time=2024-09-14T13:29:37.344563+0000, chain.objs.size()=1 2024-09-14T12:01:18.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.860+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.203__multipart_mymultipart.2~89TQ0i_7dOW96axGiqIEI1O8VTTUI2v.1 2024-09-14T12:01:18.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.860+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5742314654229809952', time=2024-09-14T13:31:33.774949+0000, chain.objs.size()=1 2024-09-14T12:01:18.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.860+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.232__shadow_.Z9s0adcMkylvQxlJpm7AP0iFLI_wOUK_0 2024-09-14T12:01:18.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.860+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12997168673221713324', time=2024-09-14T13:31:45.827433+0000, chain.objs.size()=1 2024-09-14T12:01:18.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.860+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.242__shadow_.BwOsx0Dfcoc6lPfROBOqVmlQLtGavJq_0 2024-09-14T12:01:18.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.860+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15892868018843837298', time=2024-09-14T13:31:56.220909+0000, chain.objs.size()=1 2024-09-14T12:01:18.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.860+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.250__shadow_.hGiZC5q_3jpoCL-W08yopZlOOap83c8_0 2024-09-14T12:01:18.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.860+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11192780354718270032', time=2024-09-14T13:32:47.454791+0000, chain.objs.size()=1 2024-09-14T12:01:18.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.860+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.uzKV9odCVIWcGf3OgfvkhS4QOkT9I9R_0 2024-09-14T12:01:18.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.860+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4691886813017668475', time=2024-09-14T13:32:47.476339+0000, chain.objs.size()=1 2024-09-14T12:01:18.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.860+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.f6KNoDfBA3iJmXVGKYqLJ8tkWV9YMSh_0 2024-09-14T12:01:18.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.860+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10769121265606939439', time=2024-09-14T13:32:47.722622+0000, chain.objs.size()=1 2024-09-14T12:01:18.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.860+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.3M2QLYzOGhZtoJFKOwNyTmfvVGncnIN_0 2024-09-14T12:01:18.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.860+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14707988427724317176', time=2024-09-14T13:32:48.172075+0000, chain.objs.size()=1 2024-09-14T12:01:18.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.860+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.xwZuFnYnaddWsT_oGqg8oRIadMjKeyE_0 2024-09-14T12:01:18.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.860+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6357113762794986710', time=2024-09-14T13:32:49.057381+0000, chain.objs.size()=1 2024-09-14T12:01:18.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.860+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.BzfSjorFp0pP_jKRY-5GC9rBMEg8auq_0 2024-09-14T12:01:18.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.861+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8078135497375230967', time=2024-09-14T13:32:49.574438+0000, chain.objs.size()=1 2024-09-14T12:01:18.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.861+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.GKqYAEEkXC1wwkZbxXX8lv_96ZsgNx4_0 2024-09-14T12:01:18.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.863+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17063549565337523430', time=2024-09-14T13:32:49.703863+0000, chain.objs.size()=1 2024-09-14T12:01:18.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.863+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.kJBSCx1qLcHdPVleGZGQhBVDzgrhNwz_0 2024-09-14T12:01:18.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.863+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9378782405482155036', time=2024-09-14T13:32:49.907190+0000, chain.objs.size()=1 2024-09-14T12:01:18.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.863+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.GKUshBbYZDZj07DxdEBG7EPP7gMHwxT_0 2024-09-14T12:01:18.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.864+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15876063735455567653', time=2024-09-14T13:32:50.545237+0000, chain.objs.size()=1 2024-09-14T12:01:18.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.864+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ENqIYgpHROkU2XwiCe7ZDm2qN51nXjw_0 2024-09-14T12:01:18.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.864+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17691289674843285692', time=2024-09-14T13:32:51.143170+0000, chain.objs.size()=1 2024-09-14T12:01:18.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.864+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.QCp8aDobX9c2cmiAokDHfQf5Y0WuRRV_0 2024-09-14T12:01:18.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.864+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3509081911348390223', time=2024-09-14T13:32:51.251832+0000, chain.objs.size()=1 2024-09-14T12:01:18.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.864+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Cy3LPdCb_61rP2qfU503qQs21AgOImJ_0 2024-09-14T12:01:18.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.864+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5765006501237889146', time=2024-09-14T13:32:51.392689+0000, chain.objs.size()=1 2024-09-14T12:01:18.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.864+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.5H6r33Lst_SRLxKbophyR2eRzWuTeEa_0 2024-09-14T12:01:18.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.866+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12438464434730297061', time=2024-09-14T13:32:51.527580+0000, chain.objs.size()=1 2024-09-14T12:01:18.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.866+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.fn-Y7uH-hTRaKe83bzUv8PtFKapyJXe_0 2024-09-14T12:01:18.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.866+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9860973487768974417', time=2024-09-14T13:32:52.050813+0000, chain.objs.size()=1 2024-09-14T12:01:18.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.866+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.xD1gVa1SWXa0L2ZQECIt2gEcjUelKP9_0 2024-09-14T12:01:18.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.866+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17114322525558328641', time=2024-09-14T13:32:53.982005+0000, chain.objs.size()=1 2024-09-14T12:01:18.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.866+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.vSnNmRGV90ghmUY9ZDShDK0GYke5dtM_0 2024-09-14T12:01:18.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.866+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8091429470080306975', time=2024-09-14T13:32:54.135598+0000, chain.objs.size()=1 2024-09-14T12:01:18.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.866+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.7WS-__IEiv_pOskJrN-4ihuyLVh4AVy_0 2024-09-14T12:01:18.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.866+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17528912907088625047', time=2024-09-14T13:32:54.212495+0000, chain.objs.size()=1 2024-09-14T12:01:18.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.866+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.oQ9rEnC0yVeAA7BncBn8G9pMjXMH8Oo_0 2024-09-14T12:01:18.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.866+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9789991661366525279', time=2024-09-14T13:32:54.274090+0000, chain.objs.size()=1 2024-09-14T12:01:18.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.866+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.AuE-PxwYJpwBGIQv8tTQASCYU-6zeBQ_0 2024-09-14T12:01:18.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.866+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1985849224847460938', time=2024-09-14T13:32:54.337195+0000, chain.objs.size()=1 2024-09-14T12:01:18.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.866+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.GgLSCS6x3dY1O3Y17HE8PDHgE_4xVD-_0 2024-09-14T12:01:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.868+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6230727960164549849', time=2024-09-14T13:32:55.004240+0000, chain.objs.size()=1 2024-09-14T12:01:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.868+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.lnKlMMw4Ot2bPwdUUbah6QagZI2qVUB_0 2024-09-14T12:01:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.868+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4371548259264874772', time=2024-09-14T13:32:55.246048+0000, chain.objs.size()=1 2024-09-14T12:01:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.868+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.uPmg8vX-b-tD0cYgp1EscqQHYLg0U_N_0 2024-09-14T12:01:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.868+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1787502198167910723', time=2024-09-14T13:32:55.437344+0000, chain.objs.size()=1 2024-09-14T12:01:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.868+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.uReWbOYjrYMWWO_93tZVm-A6IcGrKzt_0 2024-09-14T12:01:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.868+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8729091508424651625', time=2024-09-14T13:32:55.980954+0000, chain.objs.size()=1 2024-09-14T12:01:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.868+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.AxX0Fq-nP3O6XDAxGIVoJzDVxxHzwpv_0 2024-09-14T12:01:18.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.869+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9465653684374846307', time=2024-09-14T13:32:56.630017+0000, chain.objs.size()=1 2024-09-14T12:01:18.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.869+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.nBImsXccg-ysa28dIfkoVbjQwLOgf2F_0 2024-09-14T12:01:18.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.869+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7183550325221524982', time=2024-09-14T13:32:57.076144+0000, chain.objs.size()=1 2024-09-14T12:01:18.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.869+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.1lUJFIWP3pgSqfijKBq_Az9nrsp7flc_0 2024-09-14T12:01:18.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.870+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6969067285082222345', time=2024-09-14T13:32:57.411209+0000, chain.objs.size()=1 2024-09-14T12:01:18.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.870+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.2ZW65n-skjtuYp2ulknnkqt_3zGUcUu_0 2024-09-14T12:01:18.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.870+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2332624262950940213', time=2024-09-14T13:32:57.411932+0000, chain.objs.size()=1 2024-09-14T12:01:18.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.870+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.7zL3X8geiMC7ye35rCIQzTCPBnWFgA9_0 2024-09-14T12:01:18.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.870+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2606406400607597280', time=2024-09-14T13:32:57.772446+0000, chain.objs.size()=1 2024-09-14T12:01:18.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.870+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.x2Br0B4UTNxu5Py-_wGx5Re_14dIdGp_0 2024-09-14T12:01:18.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.870+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9977231358284873959', time=2024-09-14T13:32:57.916258+0000, chain.objs.size()=1 2024-09-14T12:01:18.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.870+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.l1Ri860G8xGDAnnb15gG7FZyg_DSExX_0 2024-09-14T12:01:18.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.871+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4555770541951553246', time=2024-09-14T13:32:57.917068+0000, chain.objs.size()=1 2024-09-14T12:01:18.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.871+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.pLfZgw-dqIPMv_j_-c4E3WS_apJy7Z__0 2024-09-14T12:01:18.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.873+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11924478326177092743', time=2024-09-14T13:32:58.145280+0000, chain.objs.size()=1 2024-09-14T12:01:18.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.873+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.KAPJzpFFX88rTxX1tikNb9oGiahLrF0_0 2024-09-14T12:01:18.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.873+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7233906584454413267', time=2024-09-14T13:33:01.936882+0000, chain.objs.size()=1 2024-09-14T12:01:18.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.873+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.266__shadow_.C5kiUtdgb64ZmkozCGDP1RXoKQIWTmR_0 2024-09-14T12:01:18.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.873+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13287379240884856429', time=2024-09-14T13:33:02.986590+0000, chain.objs.size()=1 2024-09-14T12:01:18.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.873+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.267__shadow_.ra18FSlYIu6iuu3obkH9z-oDom9QsYq_0 2024-09-14T12:01:18.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.873+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18034021502173626221', time=2024-09-14T13:33:13.792305+0000, chain.objs.size()=1 2024-09-14T12:01:18.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.873+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.277__shadow_._iqgMdooPm2M3Z4LnlKB6Z3Wuohe5t7_0 2024-09-14T12:01:18.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.873+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13879183752123074154', time=2024-09-14T13:33:17.087813+0000, chain.objs.size()=1 2024-09-14T12:01:18.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.873+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.280__shadow_.hJ3mlKuhRR2A5WSUwn6f5LaDQ2xXl9A_0 2024-09-14T12:01:18.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.873+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.396307322887505572', time=2024-09-14T13:33:18.193826+0000, chain.objs.size()=1 2024-09-14T12:01:18.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.873+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.281__shadow_.eoXidItTiRBchn3u5LSXEllZxrNLFm5_0 2024-09-14T12:01:18.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.874+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10878957411830318412', time=2024-09-14T13:33:21.458629+0000, chain.objs.size()=1 2024-09-14T12:01:18.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.874+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.284__shadow_.uSJN5T74c4LdUGb6gQ1gDVQDk4y7Gip_0 2024-09-14T12:01:18.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.874+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10210752447358794505', time=2024-09-14T13:33:24.919644+0000, chain.objs.size()=1 2024-09-14T12:01:18.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.874+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.287__shadow_.H-OiUqnLaJynJ0dFJuAtWhul9aOtgHb_0 2024-09-14T12:01:18.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.874+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15981973780548028135', time=2024-09-14T13:33:27.089847+0000, chain.objs.size()=1 2024-09-14T12:01:18.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.874+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.289__shadow_.IQ6k9TMnysvTjA4GxfSCAJ8UXnwGVS1_0 2024-09-14T12:01:18.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.874+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17998206045818924768', time=2024-09-14T13:33:33.172201+0000, chain.objs.size()=1 2024-09-14T12:01:18.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.874+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.eVXRHvtb-Zs4y3aZTqUzHj8EK_jBEfX_0 2024-09-14T12:01:18.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.875+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16334820343602622298', time=2024-09-14T13:33:33.263216+0000, chain.objs.size()=1 2024-09-14T12:01:18.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.875+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.nZrFd4JcZXRE82TkVMx-oOGVk542lJ5_0 2024-09-14T12:01:18.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.875+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13627296483253795343', time=2024-09-14T13:34:51.705880+0000, chain.objs.size()=1 2024-09-14T12:01:18.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.875+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.YreFmwaVLCujW7dbHcZzXk3lmrjoNdu_0 2024-09-14T12:01:18.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.876+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2449692226472756745', time=2024-09-14T13:34:51.889402+0000, chain.objs.size()=1 2024-09-14T12:01:18.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.876+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.NOM4N64MXLSSLNurVsd5aH3_umLoFm1_0 2024-09-14T12:01:18.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.876+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13025385946553178159', time=2024-09-14T13:34:52.023624+0000, chain.objs.size()=1 2024-09-14T12:01:18.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.876+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.iKOwdufSOBKUydCNdw55UmBIUhfICoy_0 2024-09-14T12:01:18.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.877+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14333701761315774301', time=2024-09-14T13:34:52.285742+0000, chain.objs.size()=1 2024-09-14T12:01:18.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.877+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.qekrvtRvDfv6h8hJp8JM9ATQZXYqlas_0 2024-09-14T12:01:18.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.878+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10388777973605424590', time=2024-09-14T13:34:52.411623+0000, chain.objs.size()=1 2024-09-14T12:01:18.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.878+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ZDPy9pIUwbDBYRHr_K7IcXJZ2S7RAvo_0 2024-09-14T12:01:18.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.878+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9740137122664504996', time=2024-09-14T13:34:52.577417+0000, chain.objs.size()=1 2024-09-14T12:01:18.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.878+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.KQr0V_DC35p6GYMe6BmuSgKZ3eLdaRj_0 2024-09-14T12:01:18.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.879+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11176741955891591919', time=2024-09-14T13:34:53.454064+0000, chain.objs.size()=1 2024-09-14T12:01:18.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.879+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.MqAlIJsfNUTqj65EtkmMrMV4BU2BXSd_0 2024-09-14T12:01:18.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.879+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13976260852971749860', time=2024-09-14T13:34:53.769366+0000, chain.objs.size()=1 2024-09-14T12:01:18.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.879+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.RVJ2uRmLnLUtnVrn-UuApy05YrNSB0g_0 2024-09-14T12:01:18.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.879+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10685954107165824602', time=2024-09-14T13:34:53.823041+0000, chain.objs.size()=1 2024-09-14T12:01:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.879+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.awDEcyiipDt6dCX8sQCN28i8fjJe5yU_0 2024-09-14T12:01:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.879+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14040166420566092206', time=2024-09-14T13:34:54.056106+0000, chain.objs.size()=1 2024-09-14T12:01:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.879+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.CyVu3zYZQMB6wMxzLiZbLShcf0YIOTU_0 2024-09-14T12:01:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.879+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.909402257407672626', time=2024-09-14T13:34:54.181570+0000, chain.objs.size()=1 2024-09-14T12:01:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.879+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.xwvn_uHF1AhkeQCZK9M24-TFVxevio__0 2024-09-14T12:01:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.879+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2619892873105813367', time=2024-09-14T13:34:54.975885+0000, chain.objs.size()=1 2024-09-14T12:01:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.879+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.MPAjjwqe34vbdtvJEmCnruS42Ilr0oU_0 2024-09-14T12:01:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.880+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13887828446477148950', time=2024-09-14T13:34:55.072808+0000, chain.objs.size()=1 2024-09-14T12:01:18.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.880+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.2t07lkWQES8q-wifM5HL5b9eUjmdG9J_0 2024-09-14T12:01:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.880+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15741173405825640112', time=2024-09-14T13:34:55.373261+0000, chain.objs.size()=1 2024-09-14T12:01:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.880+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.wYMi5cO7baMQJ7gWlocExYMiiEoThqN_0 2024-09-14T12:01:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.880+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7743673891859939294', time=2024-09-14T13:34:56.319899+0000, chain.objs.size()=1 2024-09-14T12:01:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.880+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.zpmu5K_lG2PlKnvHnLCqimLyrk-J7Ca_0 2024-09-14T12:01:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.881+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.184879445742835975', time=2024-09-14T13:34:56.474554+0000, chain.objs.size()=1 2024-09-14T12:01:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.881+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.-IJkHxjtu_znIUY-28jFNjMVXng9Ahg_0 2024-09-14T12:01:18.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.882+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11254832139791452452', time=2024-09-14T13:34:56.482946+0000, chain.objs.size()=1 2024-09-14T12:01:18.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.882+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Qu40CjRHoGzG0v6iq7beWBLbwZAFLUN_0 2024-09-14T12:01:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.883+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7024252987216633083', time=2024-09-14T13:34:56.864435+0000, chain.objs.size()=1 2024-09-14T12:01:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.883+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.GiVlUTigQbNprkMADhqRQHjiq4lDdH7_0 2024-09-14T12:01:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.883+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4158690608531037346', time=2024-09-14T13:34:56.966798+0000, chain.objs.size()=1 2024-09-14T12:01:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.883+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.UmZaZdGCemtaBiGkB0BOtwbLom23n62_0 2024-09-14T12:01:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.883+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4623294746594456715', time=2024-09-14T13:34:57.665653+0000, chain.objs.size()=1 2024-09-14T12:01:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.883+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.lmjv3uoY9qG9nONQN40yz3G823MjKfe_0 2024-09-14T12:01:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.883+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1867493319403861350', time=2024-09-14T13:34:57.777231+0000, chain.objs.size()=1 2024-09-14T12:01:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.883+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.N3RhYgAaTF0Q6W1c0vJ9CKfzjEPEzqf_0 2024-09-14T12:01:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.883+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11769700782983371615', time=2024-09-14T13:34:57.959414+0000, chain.objs.size()=1 2024-09-14T12:01:18.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.883+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.2Fvz_fJf3rsB5BUtBkPZpakPhHCN3BR_0 2024-09-14T12:01:18.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.883+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11295246161273974328', time=2024-09-14T13:34:58.281251+0000, chain.objs.size()=1 2024-09-14T12:01:18.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.883+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.BtLYRlXLri6iTnKGXTwq0Ig1Tyewh1i_0 2024-09-14T12:01:18.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.886+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13407043607617033876', time=2024-09-14T13:34:58.502504+0000, chain.objs.size()=1 2024-09-14T12:01:18.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.886+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.fSvhp8yTZmCDD9FBCD7xpc6PbOtHhL-_0 2024-09-14T12:01:18.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.886+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3488662094049730847', time=2024-09-14T13:34:58.556014+0000, chain.objs.size()=1 2024-09-14T12:01:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.886+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Eo_-Fx_fqikMw4Mc6FnfdKrJAWWz8hu_0 2024-09-14T12:01:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.886+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4351487136819396339', time=2024-09-14T13:34:58.597339+0000, chain.objs.size()=1 2024-09-14T12:01:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.886+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Sf2VlmFRe08Bt8euvDuq4lipAKtsJDm_0 2024-09-14T12:01:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.886+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16676469781312073184', time=2024-09-14T13:34:59.086963+0000, chain.objs.size()=1 2024-09-14T12:01:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.886+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.D-4wLKzyQGkNimcI5hDMwo6La_e6HZL_0 2024-09-14T12:01:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.886+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7431654396230029733', time=2024-09-14T13:34:59.603701+0000, chain.objs.size()=1 2024-09-14T12:01:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.886+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.izoHR2j8lKbc2Fvoum9nde3B8aCE8Xr_0 2024-09-14T12:01:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.886+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18076566565665810753', time=2024-09-14T13:35:00.094521+0000, chain.objs.size()=1 2024-09-14T12:01:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.886+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.TeWdgZFiLVDl-p_K-XRnbJQ0PRHqnyZ_0 2024-09-14T12:01:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.886+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3303983151834206476', time=2024-09-14T13:35:00.455551+0000, chain.objs.size()=1 2024-09-14T12:01:18.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.886+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.vtK42f8YyEoyaQmBsvZQjIcW1r2-YgR_0 2024-09-14T12:01:18.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.887+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7018581438519907157', time=2024-09-14T13:35:00.994631+0000, chain.objs.size()=1 2024-09-14T12:01:18.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.887+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.5gRZNuK0TjNRRLFso7hgbvzwWtW6D2S_0 2024-09-14T12:01:18.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.887+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10834340753436027976', time=2024-09-14T13:35:01.030936+0000, chain.objs.size()=1 2024-09-14T12:01:18.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.887+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.otBW15qG2D_xV2P3uIiy7Z_j2KjtUgb_0 2024-09-14T12:01:18.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.887+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12162349274056337264', time=2024-09-14T13:35:01.189546+0000, chain.objs.size()=1 2024-09-14T12:01:18.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.887+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.7XQRUVhMv-l1plgJ8XksZ-J854sHaEX_0 2024-09-14T12:01:18.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.887+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11641692006885495974', time=2024-09-14T13:35:01.355218+0000, chain.objs.size()=1 2024-09-14T12:01:18.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.887+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.5yJ2s8SSRx8BqYw1igm7-Xk8GYz0Vnj_0 2024-09-14T12:01:18.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.889+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16128466859703679305', time=2024-09-14T13:35:01.355948+0000, chain.objs.size()=1 2024-09-14T12:01:18.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.889+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.e9C2HqRs5V3O8ErdP5A_LiXI_jsfTPo_0 2024-09-14T12:01:18.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.890+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9215855555486391216', time=2024-09-14T13:35:01.802587+0000, chain.objs.size()=1 2024-09-14T12:01:18.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.890+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.LfdSLAUT3yYJHtV0sKv_VGhmJQQiuyB_0 2024-09-14T12:01:18.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.890+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7863804626970527457', time=2024-09-14T13:35:01.803402+0000, chain.objs.size()=1 2024-09-14T12:01:18.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.890+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.icqOsEqmnyLSIhDub20BbZ3vzNOJgM6_0 2024-09-14T12:01:18.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.891+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15743844426086740965', time=2024-09-14T13:35:01.818170+0000, chain.objs.size()=1 2024-09-14T12:01:18.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.891+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.eh_c50wSqi2eWFgVG8qKM5BXV-wtcix_0 2024-09-14T12:01:18.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.891+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13280562647094024132', time=2024-09-14T13:35:02.089924+0000, chain.objs.size()=1 2024-09-14T12:01:18.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.891+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Nsc2bk45HqzWPyvZl-rKs3o36wJNkFc_0 2024-09-14T12:01:18.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.891+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16386848560788282293', time=2024-09-14T13:35:02.233176+0000, chain.objs.size()=1 2024-09-14T12:01:18.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.891+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.fk9VBeG8KUW9qj3tSBMJ7wnlSdTPPHq_0 2024-09-14T12:01:18.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.891+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12666624224497953397', time=2024-09-14T13:35:02.417010+0000, chain.objs.size()=1 2024-09-14T12:01:18.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.891+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.bety1DXyNrWwRLtzJ7YRIfPuJBHItlb_0 2024-09-14T12:01:18.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.891+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13732006447110539970', time=2024-09-14T13:35:41.651848+0000, chain.objs.size()=1 2024-09-14T12:01:18.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.891+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.RCfnHTAFyLHIEgemqjg40tlZv5MIm-x_0 2024-09-14T12:01:18.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.893+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10574429220273600112', time=2024-09-14T13:35:41.781530+0000, chain.objs.size()=1 2024-09-14T12:01:18.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.893+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.75whSiTk_wyLilhgwVKYgb_BweV7Xtt_0 2024-09-14T12:01:18.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.893+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12281540207133630431', time=2024-09-14T13:35:42.101600+0000, chain.objs.size()=1 2024-09-14T12:01:18.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.893+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.8al93loe_R2EiFHZR4nc8NUjJ3NAeHP_0 2024-09-14T12:01:18.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.893+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3260595903089318516', time=2024-09-14T13:35:42.401817+0000, chain.objs.size()=1 2024-09-14T12:01:18.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.893+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.EzI_8VrG6h3EQT3txPm4lrhLF6uf00g_0 2024-09-14T12:01:18.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.893+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15544203040754070936', time=2024-09-14T13:35:42.517612+0000, chain.objs.size()=1 2024-09-14T12:01:18.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.893+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.JUNgNvPjxAzh0UwTWsTuszwacUWwXki_0 2024-09-14T12:01:18.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.894+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2647466886299036617', time=2024-09-14T13:35:42.586604+0000, chain.objs.size()=1 2024-09-14T12:01:18.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.894+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.qLYvFOAHH5hNyrHhOCTg-vPxErf99R7_0 2024-09-14T12:01:18.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.894+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1330379474938113357', time=2024-09-14T13:35:43.282902+0000, chain.objs.size()=1 2024-09-14T12:01:18.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.894+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.WadFGPDu84vJyqD5Wb-umnaNurmSitr_0 2024-09-14T12:01:18.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.894+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9009872474613098922', time=2024-09-14T13:35:43.565571+0000, chain.objs.size()=1 2024-09-14T12:01:18.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.894+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.kYurLcB6WFQAkVv74vHVowMPjFJsqaG_0 2024-09-14T12:01:18.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.894+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3394937456158435113', time=2024-09-14T13:35:44.994395+0000, chain.objs.size()=1 2024-09-14T12:01:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.894+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.t7V3cpsWJo3Adv3o1jl1LGNveDWAjx6_0 2024-09-14T12:01:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.896+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2713189254309237776', time=2024-09-14T13:35:45.086171+0000, chain.objs.size()=1 2024-09-14T12:01:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.896+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Mj1_oCXp5J-aAJ4UywW3E1Dm9VCi0W-_0 2024-09-14T12:01:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.896+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14316042536522093602', time=2024-09-14T13:35:45.150717+0000, chain.objs.size()=1 2024-09-14T12:01:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.896+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.nNHpA6nSi3x7pm4OUlDec4IxMF0DHqw_0 2024-09-14T12:01:18.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.896+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6108331496110887776', time=2024-09-14T13:35:45.164669+0000, chain.objs.size()=1 2024-09-14T12:01:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.896+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.xUeaSl9pBLukO6kQ690QoN_9-BQ-FQF_0 2024-09-14T12:01:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.896+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10923230352039603933', time=2024-09-14T13:35:45.299755+0000, chain.objs.size()=1 2024-09-14T12:01:18.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.896+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.kRP7wWIMzHjw2lJaIOI6q_D2lkhe0KW_0 2024-09-14T12:01:18.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.900+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/49011 2024-09-14T12:01:18.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=39, truncated=0, next_marker='' 2024-09-14T12:01:18.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14957442000902557069', time=2024-09-14T13:35:45.533053+0000, chain.objs.size()=1 2024-09-14T12:01:18.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.uqMd0SKLk-2B2I0xmFM6wqgmc6kmF2q_0 2024-09-14T12:01:18.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18260558092986296212', time=2024-09-14T13:35:45.798118+0000, chain.objs.size()=1 2024-09-14T12:01:18.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.4lBwMHdADUOjcg3-dFpx6Eghiq4Kvhl_0 2024-09-14T12:01:18.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9871009219099062634', time=2024-09-14T13:35:46.696631+0000, chain.objs.size()=1 2024-09-14T12:01:18.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Wb_MxaSjg3aAUcZBiSRAgVsOHOfRU9X_0 2024-09-14T12:01:18.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16276187149468269079', time=2024-09-14T13:35:46.697290+0000, chain.objs.size()=1 2024-09-14T12:01:18.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.oWpsjMp9ph5i7zzTi1cCSHJNb7eOCkX_0 2024-09-14T12:01:18.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7718916716356076050', time=2024-09-14T13:35:47.240885+0000, chain.objs.size()=1 2024-09-14T12:01:18.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.NxVMz_cAAofdBtQUuUQ9YzME8kF2Uwm_0 2024-09-14T12:01:18.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.609682826175613936', time=2024-09-14T13:35:47.320315+0000, chain.objs.size()=1 2024-09-14T12:01:18.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.zsIM1CDs2ZwP5P-dahBYxhVdv6sGxVl_0 2024-09-14T12:01:18.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5515188067732650941', time=2024-09-14T13:35:47.753778+0000, chain.objs.size()=1 2024-09-14T12:01:18.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.VS-bNy6GhZlbDJz9j5JSmCRBJ5p7O4C_0 2024-09-14T12:01:18.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.858309910181978184', time=2024-09-14T13:35:47.770836+0000, chain.objs.size()=1 2024-09-14T12:01:18.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.LGg2H4oQ0NRkUyFYkL-Ibt5cuiTKfJ__0 2024-09-14T12:01:18.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12965382486067192935', time=2024-09-14T13:35:47.801763+0000, chain.objs.size()=1 2024-09-14T12:01:18.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.85kVRby_Y-OZ_oWs7-DaCcxPu8qNKe5_0 2024-09-14T12:01:18.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1944905337693134042', time=2024-09-14T13:35:48.419725+0000, chain.objs.size()=1 2024-09-14T12:01:18.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.FPQVzAAmaZXsKrW32RkvDtOQIyIWMbk_0 2024-09-14T12:01:18.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10419533534489974448', time=2024-09-14T13:35:48.533404+0000, chain.objs.size()=1 2024-09-14T12:01:18.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.nGU_8-lekPTGNiVEz_34T_mPgF15rSg_0 2024-09-14T12:01:18.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6134971305804497001', time=2024-09-14T13:35:49.620687+0000, chain.objs.size()=1 2024-09-14T12:01:18.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.902+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.5Dro8Vt130W5wVjBCAt7LitndPIQwks_0 2024-09-14T12:01:18.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.905+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10652692804097554936', time=2024-09-14T13:35:49.870285+0000, chain.objs.size()=1 2024-09-14T12:01:18.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.905+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.sVg0ylSNaZOqppQqG_OEr2GiEeuGl7F_0 2024-09-14T12:01:18.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.906+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7701563518966966469', time=2024-09-14T13:35:49.935367+0000, chain.objs.size()=1 2024-09-14T12:01:18.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.906+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Sp1IdR0pF2ic2SSBUZbH8hUiMi4z9Ck_0 2024-09-14T12:01:18.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.906+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15471360312866460177', time=2024-09-14T13:35:50.597705+0000, chain.objs.size()=1 2024-09-14T12:01:18.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.906+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.zRP_b1oDSCZ-r0OkRx2MVzwUpkG8S9I_0 2024-09-14T12:01:18.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.906+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17751254025051020880', time=2024-09-14T13:35:50.612430+0000, chain.objs.size()=1 2024-09-14T12:01:18.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.906+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.7vU7qWQCWf7lzkfclPo9EppGLuwtF2n_0 2024-09-14T12:01:18.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.906+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16914666522190075041', time=2024-09-14T13:35:51.040496+0000, chain.objs.size()=1 2024-09-14T12:01:18.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.906+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.xvVqGwnLOdwjt5t5LTpJHUTiDPlj6aX_0 2024-09-14T12:01:18.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.906+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1808676473178268024', time=2024-09-14T13:35:51.183098+0000, chain.objs.size()=1 2024-09-14T12:01:18.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.906+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.JHvSJkhrtqTo1tIJUApuB7yaSIStKQD_0 2024-09-14T12:01:18.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.906+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.560736220600182935', time=2024-09-14T13:35:51.356549+0000, chain.objs.size()=1 2024-09-14T12:01:18.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.906+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.AkvuECBJ8NaKxpwAjwPi-OSNq2M58fx_0 2024-09-14T12:01:18.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.906+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5872085621954525069', time=2024-09-14T13:35:51.409444+0000, chain.objs.size()=1 2024-09-14T12:01:18.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.906+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.HcLauNoSws2Dt7Z-k8rpfgC1r02ydGM_0 2024-09-14T12:01:18.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.906+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2092073644678753349', time=2024-09-14T13:35:51.603984+0000, chain.objs.size()=1 2024-09-14T12:01:18.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.906+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.hjjtVgXExBUz116n1sIW-eo-CcrXNI4_0 2024-09-14T12:01:18.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.907+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11254982164173115838', time=2024-09-14T13:35:51.604774+0000, chain.objs.size()=1 2024-09-14T12:01:18.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.907+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.7e0YTinEjGQJas0UhJ5GBdtq-j5C9pF_0 2024-09-14T12:01:18.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.907+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16475990166422534153', time=2024-09-14T13:35:51.962084+0000, chain.objs.size()=1 2024-09-14T12:01:18.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.907+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.royV-odO1bwsLWfDGgH05e1_kOD8hij_0 2024-09-14T12:01:18.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.909+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11606633454245491607', time=2024-09-14T13:35:52.107167+0000, chain.objs.size()=1 2024-09-14T12:01:18.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.909+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.mynOOuGU4FahGuyQZ3v8IRfNdMOgbl9_0 2024-09-14T12:01:18.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.910+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5676755676644091651', time=2024-09-14T13:35:52.731767+0000, chain.objs.size()=1 2024-09-14T12:01:18.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.910+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.5AA6fygsS2IQDHKXdnHr06WtfyP0cge_0 2024-09-14T12:01:18.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.910+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6608967294432115278', time=2024-09-14T13:36:02.888464+0000, chain.objs.size()=1 2024-09-14T12:01:18.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.910+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.335__shadow_.pqixyk1PmCrqTPOJTI5hT4NToR77TWB_0 2024-09-14T12:01:18.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.911+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6821451172712108054', time=2024-09-14T13:36:40.351111+0000, chain.objs.size()=1 2024-09-14T12:01:18.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.911+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.373__shadow_.LieW-Yy25MBpD884KqmMNMDBgUZGm60_0 2024-09-14T12:01:18.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.911+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5320194143965632498', time=2024-09-14T13:37:00.812865+0000, chain.objs.size()=1 2024-09-14T12:01:18.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.911+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.391__shadow_.iyLsff_NfL0KvJdvw2ytUFEfQXVdM5q_0 2024-09-14T12:01:18.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.911+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1963758662933752185', time=2024-09-14T13:38:18.011135+0000, chain.objs.size()=1 2024-09-14T12:01:18.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.911+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.459__shadow_.HWTTTP1AlJebI6ga-icrGhF6TDE_XVQ_0 2024-09-14T12:01:18.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.911+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12732237716382671103', time=2024-09-14T13:39:00.794758+0000, chain.objs.size()=1 2024-09-14T12:01:18.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.911+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.499__shadow_.QMkhN9osalIRJ4xCTeCRmU33RkQLei__0 2024-09-14T12:01:18.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.911+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2343840709357642325', time=2024-09-14T13:40:45.059081+0000, chain.objs.size()=1 2024-09-14T12:01:18.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.911+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.521__shadow:.eyJIkJv0lKRMxkfu597.HhsCvbxzEh_.2aTowutorMLEqF94XkzaFx9iwkskGDx_0 2024-09-14T12:01:18.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.911+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~FvXK1qT6-CPMtJPnFfsP8nMcniHdCqk', time=2024-09-14T13:43:20.788580+0000, chain.objs.size()=10 2024-09-14T12:01:18.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.911+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.527__multipart_mymultipart.2~FvXK1qT6-CPMtJPnFfsP8nMcniHdCqk.1 2024-09-14T12:01:18.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.911+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.527__multipart_mymultipart.2~FvXK1qT6-CPMtJPnFfsP8nMcniHdCqk.2 2024-09-14T12:01:18.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.911+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.527__multipart_mymultipart.2~FvXK1qT6-CPMtJPnFfsP8nMcniHdCqk.3 2024-09-14T12:01:18.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.912+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.527__multipart_mymultipart.2~FvXK1qT6-CPMtJPnFfsP8nMcniHdCqk.4 2024-09-14T12:01:18.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.913+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.527__multipart_mymultipart.2~FvXK1qT6-CPMtJPnFfsP8nMcniHdCqk.5 2024-09-14T12:01:18.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.913+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.527__multipart_mymultipart.2~FvXK1qT6-CPMtJPnFfsP8nMcniHdCqk.6 2024-09-14T12:01:18.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.913+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.527__multipart_mymultipart.2~FvXK1qT6-CPMtJPnFfsP8nMcniHdCqk.7 2024-09-14T12:01:18.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.914+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.527__multipart_mymultipart.2~FvXK1qT6-CPMtJPnFfsP8nMcniHdCqk.8 2024-09-14T12:01:18.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.914+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.527__multipart_mymultipart.2~FvXK1qT6-CPMtJPnFfsP8nMcniHdCqk.9 2024-09-14T12:01:18.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.914+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.527__multipart_mymultipart.2~FvXK1qT6-CPMtJPnFfsP8nMcniHdCqk.10 2024-09-14T12:01:18.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.914+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~fxzYZuB8Pwi8VtveTpVxIEcwwtVoITx', time=2024-09-14T13:43:42.829484+0000, chain.objs.size()=1 2024-09-14T12:01:18.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.914+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.532__multipart_mymultipart.2~fxzYZuB8Pwi8VtveTpVxIEcwwtVoITx.1 2024-09-14T12:01:18.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.915+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13824400888861156226', time=2024-09-14T13:45:14.948712+0000, chain.objs.size()=2 2024-09-14T12:01:18.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.915+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.559__shadow_.5GSAmkOF_mKgyhSczvSM2dAQj8ww_YB_0 2024-09-14T12:01:18.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.915+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.559__shadow_.5GSAmkOF_mKgyhSczvSM2dAQj8ww_YB_1 2024-09-14T12:01:18.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.915+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11052997469295990015', time=2024-09-14T13:46:05.548183+0000, chain.objs.size()=1 2024-09-14T12:01:18.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.915+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.577__shadow:u0vWbUaVBKpMUZwwb33WaGQaKv2WNmo_.GzmCRQrdbpsAk8-T1Bq65F0xNl1SKjs_0 2024-09-14T12:01:18.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.915+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9394130610548191249', time=2024-09-14T13:46:06.255966+0000, chain.objs.size()=1 2024-09-14T12:01:18.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.915+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.577__shadow:nhOIfM010WyDA5609zHakL4lXtZ2eQy_.UuYDsVIq8LulEC-DWiggx62k50K1cMy_0 2024-09-14T12:01:18.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.918+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8326728491959387487', time=2024-09-14T13:47:21.581789+0000, chain.objs.size()=1 2024-09-14T12:01:18.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.918+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.588__shadow:F.7u8CdCPDNIIkHvph1ylFIXgAKHED9_.3jz96Cd1sBb-YO9UrkD3KBZ73kJIBjL_0 2024-09-14T12:01:18.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.919+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16003444054135841044', time=2024-09-14T13:53:53.406369+0000, chain.objs.size()=6 2024-09-14T12:01:18.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.919+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.663__multipart_foo.2~j3IRC05fTjG_p1G1KdBD-D4lc7vsD_r.1 2024-09-14T12:01:18.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.919+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.663__multipart_foo.2~j3IRC05fTjG_p1G1KdBD-D4lc7vsD_r.2 2024-09-14T12:01:18.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.919+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.663__multipart_foo.2~j3IRC05fTjG_p1G1KdBD-D4lc7vsD_r.3 2024-09-14T12:01:18.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.919+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.663__multipart_foo.2~j3IRC05fTjG_p1G1KdBD-D4lc7vsD_r.4 2024-09-14T12:01:18.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.919+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.663__multipart_foo.2~j3IRC05fTjG_p1G1KdBD-D4lc7vsD_r.5 2024-09-14T12:01:18.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.919+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.663__multipart_foo.2~j3IRC05fTjG_p1G1KdBD-D4lc7vsD_r.6 2024-09-14T12:01:18.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.919+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18429925752111072799', time=2024-09-14T13:56:13.603182+0000, chain.objs.size()=1 2024-09-14T12:01:18.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.919+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.747__shadow_.Q7Z7vIVVznD6JoJzqJFKZktedolSYH4_0 2024-09-14T12:01:18.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.924+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:18.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.927+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T12:01:18.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.928+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:18.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.929+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:18.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46012' 2024-09-14T12:01:18.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1704595269536706326', time=2024-09-14T13:31:32.675018+0000, chain.objs.size()=1 2024-09-14T12:01:18.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.231__shadow_.vvGtEJ3OU5y0J7pGznB9Oxas8x_1B19_0 2024-09-14T12:01:18.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7417576351781992124', time=2024-09-14T13:31:35.919548+0000, chain.objs.size()=1 2024-09-14T12:01:18.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.234__shadow_.swH-RszGXrRdei43HM4atJ5L3DC0Mw5_0 2024-09-14T12:01:18.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.213245622460727730', time=2024-09-14T13:31:39.198090+0000, chain.objs.size()=1 2024-09-14T12:01:18.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.237__shadow_.xI83p9yUjsnYZF98S3-1Dk9ZoKcoJTi_0 2024-09-14T12:01:18.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4035200547051621423', time=2024-09-14T13:31:45.826238+0000, chain.objs.size()=1 2024-09-14T12:01:18.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.242__shadow_.L588xPxbJKQ3xfN9Xtcnr-oPF3K1S7I_0 2024-09-14T12:01:18.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17277960586901634259', time=2024-09-14T13:31:52.926558+0000, chain.objs.size()=1 2024-09-14T12:01:18.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.247__shadow_.qNRqmwh8gSd5If2L3k7QBB7JPe6Y11F_0 2024-09-14T12:01:18.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17411112680272275539', time=2024-09-14T13:31:52.931508+0000, chain.objs.size()=1 2024-09-14T12:01:18.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.247__shadow_.FXpBZq7j6xjeilpxaYAi41s59KMhzeT_0 2024-09-14T12:01:18.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13342174898954456524', time=2024-09-14T13:31:56.231100+0000, chain.objs.size()=1 2024-09-14T12:01:18.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.250__shadow_.fJRU2L-VlUNTGrvvjbk1yYn6RYyBIC3_0 2024-09-14T12:01:18.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3292327498634806386', time=2024-09-14T13:31:57.314659+0000, chain.objs.size()=1 2024-09-14T12:01:18.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.251__shadow_.iHK6SoLunHGDk7guQ9XYG5h9ZH4J-qM_0 2024-09-14T12:01:18.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4168029630584109261', time=2024-09-14T13:32:01.690934+0000, chain.objs.size()=1 2024-09-14T12:01:18.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.255__shadow_.WZmKfqeYUotF96k2W-tU2T9TYbLjKve_0 2024-09-14T12:01:18.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3183766110827912696', time=2024-09-14T13:32:08.252512+0000, chain.objs.size()=1 2024-09-14T12:01:18.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.261__shadow_.DCveERTsbXLKI1KN0o5rv_KrqjkOXeX_0 2024-09-14T12:01:18.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17017470888634729758', time=2024-09-14T13:32:48.157422+0000, chain.objs.size()=1 2024-09-14T12:01:18.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.1PtmYyUejRxgfkt8FQPme0TZycrPbqG_0 2024-09-14T12:01:18.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4303183059084535644', time=2024-09-14T13:32:49.276071+0000, chain.objs.size()=1 2024-09-14T12:01:18.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.930+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.hbiT1r2h6xGPmO__q50IDjGtMRll7LZ_0 2024-09-14T12:01:18.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.933+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12740762657521468001', time=2024-09-14T13:32:50.833792+0000, chain.objs.size()=1 2024-09-14T12:01:18.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.933+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.GocPo4NwU66bcK4aZMwcayrO_Gy85Cp_0 2024-09-14T12:01:18.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.933+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6503593447990295713', time=2024-09-14T13:32:51.593346+0000, chain.objs.size()=1 2024-09-14T12:01:18.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.933+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.JfZ2r1ItrFccvQexuBfp7rvptGNxSj9_0 2024-09-14T12:01:18.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.933+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2211299755960950303', time=2024-09-14T13:32:52.052835+0000, chain.objs.size()=1 2024-09-14T12:01:18.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.933+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.UeysM-xzus26qVrJuLB-p144Q-rnMCw_0 2024-09-14T12:01:18.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.934+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.281189373529631543', time=2024-09-14T13:32:52.589995+0000, chain.objs.size()=1 2024-09-14T12:01:18.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.934+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.zIi0wIl1xWqJKJ6IBqyrF8uIzZ3Zm2k_0 2024-09-14T12:01:18.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.934+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3287157769253969300', time=2024-09-14T13:32:52.758329+0000, chain.objs.size()=1 2024-09-14T12:01:18.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.934+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.wEW3H1adKNqZMNF5mJK_iZqlMxzlkll_0 2024-09-14T12:01:18.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.934+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5983547133960864270', time=2024-09-14T13:32:52.765216+0000, chain.objs.size()=1 2024-09-14T12:01:18.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.934+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.k1lG2a315RLUcTxWwELnaEWN12dAUbU_0 2024-09-14T12:01:18.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.934+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3805758033788282821', time=2024-09-14T13:32:52.959979+0000, chain.objs.size()=1 2024-09-14T12:01:18.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.934+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.CBt7a2JCLIUv66P-zyc5jrBTF7lDrmF_0 2024-09-14T12:01:18.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.934+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8208339130606230612', time=2024-09-14T13:32:53.501261+0000, chain.objs.size()=1 2024-09-14T12:01:18.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.934+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.rJOAKaSDqaClZZarjuZQw6D1cdN0pjP_0 2024-09-14T12:01:18.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.934+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13527852201245645101', time=2024-09-14T13:32:53.549022+0000, chain.objs.size()=1 2024-09-14T12:01:18.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.934+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.8p9qb2kk-mUqj52oFvt4D-0X-i6rreT_0 2024-09-14T12:01:18.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.934+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11165133833319734884', time=2024-09-14T13:32:53.695170+0000, chain.objs.size()=1 2024-09-14T12:01:18.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.934+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.sA5dlSB32zjg0_lvaYAr4e0QNYN5w1W_0 2024-09-14T12:01:18.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.934+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15660801255731780536', time=2024-09-14T13:32:53.918655+0000, chain.objs.size()=1 2024-09-14T12:01:18.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.934+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.9GUwWSeD6lfqObW6EYAJz1HJseRnXio_0 2024-09-14T12:01:18.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.937+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12098767609660353614', time=2024-09-14T13:32:53.982787+0000, chain.objs.size()=1 2024-09-14T12:01:18.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.937+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.IH-QhI7DUXtHvEEcBMLYYP8UeDkcbxW_0 2024-09-14T12:01:18.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.937+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16916519308271024775', time=2024-09-14T13:32:54.495648+0000, chain.objs.size()=1 2024-09-14T12:01:18.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.937+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.lwSgkicukQCFfyg-PCSa8DW2fa0NzMM_0 2024-09-14T12:01:18.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.937+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7676075001446281392', time=2024-09-14T13:32:54.524076+0000, chain.objs.size()=1 2024-09-14T12:01:18.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.937+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.SidtLt3MOJMa6rhOEsdPE-3wxWCjykn_0 2024-09-14T12:01:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.937+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5468072150458508304', time=2024-09-14T13:32:54.524665+0000, chain.objs.size()=1 2024-09-14T12:01:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.937+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.LwbCujBxAZiJbhfoMvZOOsA3UsafJSF_0 2024-09-14T12:01:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.937+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10270502779818867360', time=2024-09-14T13:32:55.422850+0000, chain.objs.size()=1 2024-09-14T12:01:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.937+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.6Zg4gBu3QtEd8CwTg9Fh6GUNCJRRUdw_0 2024-09-14T12:01:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.937+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6550990966998873852', time=2024-09-14T13:32:56.736930+0000, chain.objs.size()=1 2024-09-14T12:01:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.937+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.GK7eevOAR8mfQ20ZFF_5gfsrz7b1p9F_0 2024-09-14T12:01:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.938+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12846698459734361765', time=2024-09-14T13:32:56.840569+0000, chain.objs.size()=1 2024-09-14T12:01:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.938+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.rPi9W6anf6hxeDzB47Y3mlXL075xOB0_0 2024-09-14T12:01:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.938+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3462928836639902819', time=2024-09-14T13:32:56.920049+0000, chain.objs.size()=1 2024-09-14T12:01:18.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.938+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.opvr4MsmczNGLazWlMSP3eIiaItzNsk_0 2024-09-14T12:01:18.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.939+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4152741499695745270', time=2024-09-14T13:32:57.129526+0000, chain.objs.size()=1 2024-09-14T12:01:18.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.939+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.i9Sxf8e5-p_tttQg8igOwKQQ5yRj5_P_0 2024-09-14T12:01:18.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.939+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16477601242737480119', time=2024-09-14T13:32:57.154671+0000, chain.objs.size()=1 2024-09-14T12:01:18.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.939+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.h9AbQFaHOYjZs-G9Lr-ZDnO_pqA3JV8_0 2024-09-14T12:01:18.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.939+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11152445569559962497', time=2024-09-14T13:32:57.731983+0000, chain.objs.size()=1 2024-09-14T12:01:18.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.939+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.4dTe85kFZceDoKRqLhxIRDlFZRV_Kg0_0 2024-09-14T12:01:18.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.940+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11135211751721051992', time=2024-09-14T13:32:57.770795+0000, chain.objs.size()=1 2024-09-14T12:01:18.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.940+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.I3wzcBuovEyTXRwQqBhqfoAyBlz8cIt_0 2024-09-14T12:01:18.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.941+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3865195325107305060', time=2024-09-14T13:32:57.921077+0000, chain.objs.size()=1 2024-09-14T12:01:18.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.941+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Ad5B3-Zscn-dbIlIA8fwlspFoYZQlc7_0 2024-09-14T12:01:18.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.941+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.687245693486707160', time=2024-09-14T13:32:58.074550+0000, chain.objs.size()=1 2024-09-14T12:01:18.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.941+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.qSacRqoQGavzaFk7iQstrdupggud8uV_0 2024-09-14T12:01:18.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.941+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5482287705803036056', time=2024-09-14T13:32:58.424820+0000, chain.objs.size()=1 2024-09-14T12:01:18.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.941+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.rg4ApVqkafKrlaXvWN595bml6-r4u07_0 2024-09-14T12:01:18.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.941+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7630484400056477360', time=2024-09-14T13:32:59.816884+0000, chain.objs.size()=1 2024-09-14T12:01:18.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.941+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.264__shadow_.UID3EtFQDVP8589dTHgFBdPTJg3ToP3_0 2024-09-14T12:01:18.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.942+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10236238995621564181', time=2024-09-14T13:33:33.134171+0000, chain.objs.size()=1 2024-09-14T12:01:18.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.942+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.XNfPWj0kN-2sEjPHivE_s7DiXMHaWf2_0 2024-09-14T12:01:18.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.943+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15690158892606364202', time=2024-09-14T13:33:33.227129+0000, chain.objs.size()=1 2024-09-14T12:01:18.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.943+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.VlIYBFF9iuJKuYEF2P5IpzBaruWTwkV_0 2024-09-14T12:01:18.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.943+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6827803966535071423', time=2024-09-14T13:33:46.924123+0000, chain.objs.size()=1 2024-09-14T12:01:18.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.943+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.304__shadow_.O8JjAKbfPOODQpu5UNGEttZWrJjtQyF_0 2024-09-14T12:01:18.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.943+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16291025548664231745', time=2024-09-14T13:33:48.046326+0000, chain.objs.size()=1 2024-09-14T12:01:18.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.943+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.305__shadow_.jY6DAQmg4wZHPuWWQAzUwlPasxrrxE9_0 2024-09-14T12:01:18.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.945+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1974464023560127568', time=2024-09-14T13:34:51.841562+0000, chain.objs.size()=1 2024-09-14T12:01:18.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.945+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Uj73GWBS01wHawgExYpeokgmQWDCqdF_0 2024-09-14T12:01:18.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.945+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14231920023849403143', time=2024-09-14T13:34:51.935469+0000, chain.objs.size()=1 2024-09-14T12:01:18.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.945+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.81Vy2xvWcH7o7dUm2YtOcvj1g_oRSps_0 2024-09-14T12:01:18.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.945+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15472139548438384816', time=2024-09-14T13:34:51.992623+0000, chain.objs.size()=1 2024-09-14T12:01:18.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.945+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.qcNHX6p8RMMMPBo6luajsJhGjaT0jxD_0 2024-09-14T12:01:18.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.945+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8569675340629676618', time=2024-09-14T13:34:52.064370+0000, chain.objs.size()=1 2024-09-14T12:01:18.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.945+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.jHdBbUlwB2JYdmcGq6HSyhG6vJ3MdIW_0 2024-09-14T12:01:18.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.947+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4149038004166783853', time=2024-09-14T13:34:53.270615+0000, chain.objs.size()=1 2024-09-14T12:01:18.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.947+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.DQ1MH9zvAPj3GeNcJ7Jy0FyfFWIEUDL_0 2024-09-14T12:01:18.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.947+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10247827333271747727', time=2024-09-14T13:34:53.487101+0000, chain.objs.size()=1 2024-09-14T12:01:18.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.947+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.01BuQ4bTWkR1bk4q7hmqzdFLbeU4Y1M_0 2024-09-14T12:01:18.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.947+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4752806083661887779', time=2024-09-14T13:34:53.788095+0000, chain.objs.size()=1 2024-09-14T12:01:18.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.947+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.QoCaO-sEqa3xy5dKPjOn8F1sChuvwjc_0 2024-09-14T12:01:18.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.947+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7603611047541087126', time=2024-09-14T13:34:53.938552+0000, chain.objs.size()=1 2024-09-14T12:01:18.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.947+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.EKWTujiA4dL7AnpR2BgZNXXVqbcnRfO_0 2024-09-14T12:01:18.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.947+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10586102757856772786', time=2024-09-14T13:34:54.980344+0000, chain.objs.size()=1 2024-09-14T12:01:18.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.947+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.m3TB5avEv11ok5hQu3VY0r-k9A3VJEf_0 2024-09-14T12:01:18.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.947+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7663205568105792566', time=2024-09-14T13:34:56.206551+0000, chain.objs.size()=1 2024-09-14T12:01:18.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.947+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.dCGCX4iHkSYb-4iNliHtufy8ZrzBHPS_0 2024-09-14T12:01:18.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.947+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4639764969107241780', time=2024-09-14T13:34:56.669544+0000, chain.objs.size()=1 2024-09-14T12:01:18.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.947+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Lv4LKhFtbKAa0Dnd-YSQHZvLGVmh792_0 2024-09-14T12:01:18.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.949+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6829548357530639176', time=2024-09-14T13:34:56.977786+0000, chain.objs.size()=1 2024-09-14T12:01:18.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.949+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.AiQOPorDrJXtoFTByNcwfKDC6Qp5Nrs_0 2024-09-14T12:01:18.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.949+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14254066489494904392', time=2024-09-14T13:34:57.027866+0000, chain.objs.size()=1 2024-09-14T12:01:18.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.949+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.qt27NVFttD5ATTo4yFeNWIaXulGVkAd_0 2024-09-14T12:01:18.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.949+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4520904839147245991', time=2024-09-14T13:34:57.170268+0000, chain.objs.size()=1 2024-09-14T12:01:18.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.949+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.4glBN8V96-bEtFbDqytV_SqLApM1UeS_0 2024-09-14T12:01:18.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.949+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8603191717359269071', time=2024-09-14T13:34:57.852552+0000, chain.objs.size()=1 2024-09-14T12:01:18.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.949+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Gcu5fQ_gTCLxgx_HY7OQzJNJOGGg9PP_0 2024-09-14T12:01:18.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.952+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14492348632170921153', time=2024-09-14T13:34:58.061766+0000, chain.objs.size()=1 2024-09-14T12:01:18.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.952+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.2RfiXGCJRPW-hCmeN5ibK4xvRnmnQur_0 2024-09-14T12:01:18.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.952+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8061380821247425622', time=2024-09-14T13:34:58.207410+0000, chain.objs.size()=1 2024-09-14T12:01:18.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.952+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.KG9qffk9Q94i3JiiH3hpBhyOnTAZ2GG_0 2024-09-14T12:01:18.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.952+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7784659831368136836', time=2024-09-14T13:34:58.235938+0000, chain.objs.size()=1 2024-09-14T12:01:18.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.952+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.mW6Eo99L36-V0TPXpLMO7elqfOS0JSU_0 2024-09-14T12:01:18.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.952+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2133440956644932320', time=2024-09-14T13:34:58.552037+0000, chain.objs.size()=1 2024-09-14T12:01:18.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.952+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.qOd0VT5HvlXdbW8mbMXKRwpeIw7nWmt_0 2024-09-14T12:01:18.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.952+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9515456515560959256', time=2024-09-14T13:34:58.704125+0000, chain.objs.size()=1 2024-09-14T12:01:18.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.952+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.wJH9byz5rG9pL-VHV3RSw3_Y1fe_bV0_0 2024-09-14T12:01:18.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.952+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3271393947687744926', time=2024-09-14T13:34:59.967763+0000, chain.objs.size()=1 2024-09-14T12:01:18.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.952+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.WB6S03ZcEbhgPW0uvaHFDJ9hsON4-on_0 2024-09-14T12:01:18.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.952+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18271646718018535311', time=2024-09-14T13:35:00.105758+0000, chain.objs.size()=1 2024-09-14T12:01:18.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.952+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.fVG4I4A7J8-VcIqjJhPlygwvH58IEu4_0 2024-09-14T12:01:18.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.952+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5155316873928340559', time=2024-09-14T13:35:00.472602+0000, chain.objs.size()=1 2024-09-14T12:01:18.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.952+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.sMGJ_jbx9LTMINe9VW4tsKbuZ_c9j-d_0 2024-09-14T12:01:18.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.952+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11685554063685574940', time=2024-09-14T13:35:00.681930+0000, chain.objs.size()=1 2024-09-14T12:01:18.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.952+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.N-L1hf-_ocFzPQgzW3nJFF_IS2ZjSDJ_0 2024-09-14T12:01:18.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.952+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.669073089382215928', time=2024-09-14T13:35:00.915105+0000, chain.objs.size()=1 2024-09-14T12:01:18.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.952+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.BX6U532CuitnZQYe6AQGZ70v7GmH2vD_0 2024-09-14T12:01:18.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.952+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18435678862875003665', time=2024-09-14T13:35:01.801882+0000, chain.objs.size()=1 2024-09-14T12:01:18.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.952+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.7LYyO80pFz3dv6NgCFzH0eNdll7utj-_0 2024-09-14T12:01:18.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.957+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3225825824185182445', time=2024-09-14T13:35:01.828405+0000, chain.objs.size()=1 2024-09-14T12:01:18.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.957+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.2qbc4rk87wObsLTqHuimQ9j5Kaz_ltn_0 2024-09-14T12:01:18.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.957+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13013117708112023942', time=2024-09-14T13:35:02.132163+0000, chain.objs.size()=1 2024-09-14T12:01:18.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.957+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.1-sYWu8YY0g02fWJmqsb4hRHZlqYgVD_0 2024-09-14T12:01:18.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.957+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16541887912204730010', time=2024-09-14T13:35:42.363680+0000, chain.objs.size()=1 2024-09-14T12:01:18.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.957+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.V4Ju6BiyuKu_pAdp5yZyrlDO2Hn6pqg_0 2024-09-14T12:01:18.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.957+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7819438961986682302', time=2024-09-14T13:35:42.423107+0000, chain.objs.size()=1 2024-09-14T12:01:18.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.957+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.gTPlD0dniqIiddRLlM9sOqur7B5nYIq_0 2024-09-14T12:01:18.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.957+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11117849146132474624', time=2024-09-14T13:35:43.291634+0000, chain.objs.size()=1 2024-09-14T12:01:18.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.957+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.iNHyAL62Uj8BQUDMmGHnQeSb9KGS1gJ_0 2024-09-14T12:01:18.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.957+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12105907554741911380', time=2024-09-14T13:35:43.728496+0000, chain.objs.size()=1 2024-09-14T12:01:18.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.957+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.iBXoYXw0ULhAmRIB62gQvghVO9r1xtr_0 2024-09-14T12:01:18.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.957+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6338510814632183837', time=2024-09-14T13:35:43.732524+0000, chain.objs.size()=1 2024-09-14T12:01:18.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.957+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.DigwB9M_b4kjKDQvJBYhdUXT4oqswBh_0 2024-09-14T12:01:18.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.957+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12370302989392938573', time=2024-09-14T13:35:44.031808+0000, chain.objs.size()=1 2024-09-14T12:01:18.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.957+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.xkjBLcR-cSCkwXvu7yV3iMaZ4JCfLV6_0 2024-09-14T12:01:18.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.957+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5258354454627190170', time=2024-09-14T13:35:44.854205+0000, chain.objs.size()=1 2024-09-14T12:01:18.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.957+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.bJU4XBPPFq7U3wYCeyfwSRUxdshqGal_0 2024-09-14T12:01:18.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.957+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14528804086610676084', time=2024-09-14T13:35:44.967538+0000, chain.objs.size()=1 2024-09-14T12:01:18.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.957+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.omE7X1JaVSJJmiSS0oaaAGUMCnqWnKK_0 2024-09-14T12:01:18.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.957+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.767594841703214653', time=2024-09-14T13:35:45.150920+0000, chain.objs.size()=1 2024-09-14T12:01:18.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.957+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.uJKAS3s69ufVXTmEsLY6ovWG1-hV4cd_0 2024-09-14T12:01:18.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.960+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17669849223594263594', time=2024-09-14T13:35:45.564178+0000, chain.objs.size()=1 2024-09-14T12:01:18.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.960+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.vOdSEab5CXUylg3Cf5m64uZVPTifugi_0 2024-09-14T12:01:18.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.960+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7089541070505191346', time=2024-09-14T13:35:45.800793+0000, chain.objs.size()=1 2024-09-14T12:01:18.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.960+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.W6s3LyWrcllnxe29trdR7fnNVryzy41_0 2024-09-14T12:01:18.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.961+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6277530771872645086', time=2024-09-14T13:35:45.823732+0000, chain.objs.size()=1 2024-09-14T12:01:18.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.961+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.v1BRUfuxtPBD8wfKCxsUSPNuudfKLSk_0 2024-09-14T12:01:18.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.961+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16587636777935435589', time=2024-09-14T13:35:46.445780+0000, chain.objs.size()=1 2024-09-14T12:01:18.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.961+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.F7G2rPfCnYe1m_G9FNthsvpjSwBiY7g_0 2024-09-14T12:01:18.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.962+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13581322138565526576', time=2024-09-14T13:35:46.669137+0000, chain.objs.size()=1 2024-09-14T12:01:18.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.962+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.WHAK23gE8MpEppeqJbiop7FtRsEB8wE_0 2024-09-14T12:01:18.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.962+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3204089262688681183', time=2024-09-14T13:35:46.770578+0000, chain.objs.size()=1 2024-09-14T12:01:18.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.962+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.pZEWaqoiwpyBrIPdk3EK7six-UqM4md_0 2024-09-14T12:01:18.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.962+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1420474111208450693', time=2024-09-14T13:35:47.195190+0000, chain.objs.size()=1 2024-09-14T12:01:18.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.962+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.YBCIM2lZZRqVRdYaYmNMMQBVEvQ4zZB_0 2024-09-14T12:01:18.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.962+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8957983973806911107', time=2024-09-14T13:35:47.316551+0000, chain.objs.size()=1 2024-09-14T12:01:18.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.962+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.R7vsgEp2JN6fjCUEiuqD8ZzF4tfuCP6_0 2024-09-14T12:01:18.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.962+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8994530538100901822', time=2024-09-14T13:35:48.281741+0000, chain.objs.size()=1 2024-09-14T12:01:18.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.962+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.HwTI0hgpbaArTqvuCxJBBuV_8qYtnyI_0 2024-09-14T12:01:18.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.963+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4910930287266748067', time=2024-09-14T13:35:48.810746+0000, chain.objs.size()=1 2024-09-14T12:01:18.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.963+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.PNMuEcbSeop1ZlpuCyCOtLkmkjn2FV6_0 2024-09-14T12:01:18.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.963+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10061230026753940361', time=2024-09-14T13:35:49.260426+0000, chain.objs.size()=1 2024-09-14T12:01:18.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.963+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.mOe0QXshVO6c1NCRoaLtbUWUQ4P0v5m_0 2024-09-14T12:01:18.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.967+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15472016659872445538', time=2024-09-14T13:35:49.509638+0000, chain.objs.size()=1 2024-09-14T12:01:18.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.967+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.NJMGZxuTk67nW-6BHNLiyo65i0Yol4P_0 2024-09-14T12:01:18.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.967+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13142405239124727899', time=2024-09-14T13:35:49.531475+0000, chain.objs.size()=1 2024-09-14T12:01:18.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.967+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.0hNLuvINxz6leG4xY4UuQ0I5edAt4px_0 2024-09-14T12:01:18.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.967+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16589880376886341334', time=2024-09-14T13:35:49.818484+0000, chain.objs.size()=1 2024-09-14T12:01:18.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.967+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.6one7NRRYV7Bq8Amr0p7afEGkIxL_24_0 2024-09-14T12:01:18.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.967+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3648993666125354317', time=2024-09-14T13:35:49.956374+0000, chain.objs.size()=1 2024-09-14T12:01:18.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.967+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.L3tcnledua4m06v8Z-ugeZZhewM-zi1_0 2024-09-14T12:01:18.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.967+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3325650188003541863', time=2024-09-14T13:35:50.145187+0000, chain.objs.size()=1 2024-09-14T12:01:18.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.967+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.q8ZeZc_M8A_nhmvRxovAvqop7Xmw_TP_0 2024-09-14T12:01:18.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.967+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5858577081741670760', time=2024-09-14T13:35:50.161483+0000, chain.objs.size()=1 2024-09-14T12:01:18.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.967+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.nJ3QCPBCnLezEvEjKADYAOqlC06o_-4_0 2024-09-14T12:01:18.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.967+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11626229681497886888', time=2024-09-14T13:35:50.761032+0000, chain.objs.size()=1 2024-09-14T12:01:18.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.967+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.sKBPattZJsI_PuyA1KY2MD1TKpLTtXe_0 2024-09-14T12:01:18.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.967+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12934406572308644394', time=2024-09-14T13:35:50.980396+0000, chain.objs.size()=1 2024-09-14T12:01:18.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.967+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.xITdSdDKwgH_oi0Jo2ExziG4s25XV8L_0 2024-09-14T12:01:18.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.967+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15381729727821527964', time=2024-09-14T13:35:51.354519+0000, chain.objs.size()=1 2024-09-14T12:01:18.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.967+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.PFDYgAT-OHH_jKlMg6YC9kI5M2-17Mw_0 2024-09-14T12:01:18.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.971+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/46012 2024-09-14T12:01:18.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.973+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-14T12:01:18.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.973+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16786148876532323361', time=2024-09-14T13:35:51.562726+0000, chain.objs.size()=1 2024-09-14T12:01:18.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.973+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.4BPLNYZtfabaPlcclcik6QGlix_HmOp_0 2024-09-14T12:01:18.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.973+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.565692804118541606', time=2024-09-14T13:35:52.000692+0000, chain.objs.size()=1 2024-09-14T12:01:18.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.973+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.wRd-wgoyJIxmXmC0PPlBXp0UbdbLmGJ_0 2024-09-14T12:01:18.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.973+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4697065980662996496', time=2024-09-14T13:35:52.120297+0000, chain.objs.size()=1 2024-09-14T12:01:18.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.973+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.PP1HFdAUzu3HDErvsI_IYvXIw949NGs_0 2024-09-14T12:01:18.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.973+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16715481963891303049', time=2024-09-14T13:35:52.709740+0000, chain.objs.size()=1 2024-09-14T12:01:18.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.973+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.QvhBF4bDesWo-oWzak-1VmRUw6_X1HM_0 2024-09-14T12:01:18.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.973+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12869581161550217234', time=2024-09-14T13:35:52.710330+0000, chain.objs.size()=1 2024-09-14T12:01:18.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.973+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.lq-qdgesYgcfxVgITlUfKQsu8C71rsa_0 2024-09-14T12:01:18.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.973+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9282007331244706509', time=2024-09-14T13:36:08.758351+0000, chain.objs.size()=1 2024-09-14T12:01:18.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.973+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.341__shadow_.Ez3oOyenjRUgemrPfRyZKn6n4_6m966_0 2024-09-14T12:01:18.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.973+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17805123788300259607', time=2024-09-14T13:38:26.630886+0000, chain.objs.size()=1 2024-09-14T12:01:18.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.973+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.465__shadow_.R5SQP19RX2rDgheJR3eOq64hjDOjpR2_0 2024-09-14T12:01:18.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.973+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14731059952812503576', time=2024-09-14T13:38:28.031019+0000, chain.objs.size()=1 2024-09-14T12:01:18.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.973+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.466__shadow_.u4YcMWvN063VGLwAptlzn5BVX3Ol4Bq_0 2024-09-14T12:01:18.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.973+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14882878553916855170', time=2024-09-14T13:39:06.898933+0000, chain.objs.size()=1 2024-09-14T12:01:18.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.973+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.504__shadow:-Styd.oxB8SSr1oI0lFwKs5hFqmwg-w_.MvQogDl8WgMpFFuD7AaaxQ0tKLuN8vP_0 2024-09-14T12:01:18.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.973+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10646992150327189501', time=2024-09-14T13:39:43.854782+0000, chain.objs.size()=1 2024-09-14T12:01:18.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.973+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.516__shadow_.jB-h23rOIEtcB1zfl5MzzA4fJOljuSz_0 2024-09-14T12:01:18.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.973+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5805095599459353957', time=2024-09-14T13:43:07.750051+0000, chain.objs.size()=2 2024-09-14T12:01:18.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.973+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.526__multipart_mymultipart.2~uA_d0g-bN-Tvq8EpVwdTzbkSf-aKIgJ.1 2024-09-14T12:01:18.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.973+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.526__multipart_mymultipart.2~uA_d0g-bN-Tvq8EpVwdTzbkSf-aKIgJ.2 2024-09-14T12:01:18.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.977+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4739425669768560809', time=2024-09-14T13:43:19.226644+0000, chain.objs.size()=2 2024-09-14T12:01:18.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.977+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.526__multipart_mymultipart.2~LkJvHYZFjTQw0sUH3inIXJi04OFctNI.1 2024-09-14T12:01:18.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.977+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.526__multipart_mymultipart.2~LkJvHYZFjTQw0sUH3inIXJi04OFctNI.2 2024-09-14T12:01:18.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.977+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11960301131278344362', time=2024-09-14T13:44:05.542407+0000, chain.objs.size()=4 2024-09-14T12:01:18.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.977+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.536__multipart_mymultipart.2~XxySpJXM2eCsvyrnoYxqtBqhodELiwv.1 2024-09-14T12:01:18.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.977+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.536__multipart_mymultipart.2~XxySpJXM2eCsvyrnoYxqtBqhodELiwv.2 2024-09-14T12:01:18.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.977+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.536__multipart_mymultipart.lt66R3K_YEDWKeZ2MfdYS--a0BNk17-B.3 2024-09-14T12:01:18.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.977+0000 7fb9feba5640 0 -- 172.21.15.50:0/1397114374 >> [v2:172.21.15.50:6800/2565843969,v1:172.21.15.50:6801/2565843969] conn(0x562b70d5fed0 msgr2=0x7fb8c8095760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:01:18.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.977+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.536__multipart_mymultipart.2~XxySpJXM2eCsvyrnoYxqtBqhodELiwv.4 2024-09-14T12:01:18.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.978+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18157278304301337737', time=2024-09-14T13:46:05.935246+0000, chain.objs.size()=1 2024-09-14T12:01:18.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.978+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.577__shadow:zhwfEu1FKohb.M3nW6nyCAJUjmTSXaV_.WR_GD6XIC_pmUwyIiO90lAK5N1-3n03_0 2024-09-14T12:01:18.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.978+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8586183419280447167', time=2024-09-14T13:47:12.098641+0000, chain.objs.size()=1 2024-09-14T12:01:18.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.978+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.581__shadow:ucJQ5gC866YVcJz5iWi8DFmIfLjsX7-_.vszOjRwgAfymXNJl4RRFQCaYIXTsWxI_0 2024-09-14T12:01:18.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.978+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3856965603003299331', time=2024-09-14T13:53:54.844850+0000, chain.objs.size()=1 2024-09-14T12:01:18.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.978+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.664__shadow_.Hriva32Cbuk-paXqO6KrLF78XcIYSM6_0 2024-09-14T12:01:18.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.978+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12731470977115899277', time=2024-09-14T13:54:30.666956+0000, chain.objs.size()=1 2024-09-14T12:01:18.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.978+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.701__shadow:8LPBCo.qQRmNDOXdR8E5gbYT9toHXMP_.3L2yBQ20gMOHvQdiaTOcPyo7IKywPxl_0 2024-09-14T12:01:18.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.978+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2139376377312320168', time=2024-09-14T13:55:44.012324+0000, chain.objs.size()=1 2024-09-14T12:01:18.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.978+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.743__multipart_mymultipart3.2~W3QoNkI3cnleT_dP5ykcayz3iWAdtXw.1 2024-09-14T12:01:18.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.981+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10196871354472319238', time=2024-09-14T13:56:56.300673+0000, chain.objs.size()=1 2024-09-14T12:01:18.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.981+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.753__shadow_.8lCghBnub_79rk_pOFjDLtYJcR7CEz7_0 2024-09-14T12:01:18.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.981+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5906964317136572974', time=2024-09-14T13:58:01.487543+0000, chain.objs.size()=1 2024-09-14T12:01:18.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.981+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.768__shadow_.3RBr5eyIG9oLlL7p6KXz0GXT8PDc8no_0 2024-09-14T12:01:18.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.983+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:18.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.985+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T12:01:18.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.987+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:18.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.987+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:18.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44011' 2024-09-14T12:01:18.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.246150073231205127', time=2024-09-14T13:29:31.572393+0000, chain.objs.size()=1 2024-09-14T12:01:18.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.200__shadow_.5_LSRQzgd3w93ZUCSToTgKTbMI5tXfl_0 2024-09-14T12:01:18.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17858794982920111689', time=2024-09-14T13:31:35.924684+0000, chain.objs.size()=1 2024-09-14T12:01:18.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.234__shadow_.81-7AnW0_WlIUkXZeTiT3pL3ziysN4h_0 2024-09-14T12:01:18.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7723952117436060727', time=2024-09-14T13:31:54.014292+0000, chain.objs.size()=1 2024-09-14T12:01:18.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.248__shadow_.Zc8WzrqJxBiwlOa1BQQApz5bkbAjCot_0 2024-09-14T12:01:18.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11846620282781217410', time=2024-09-14T13:32:06.039669+0000, chain.objs.size()=1 2024-09-14T12:01:18.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.259__shadow_.GSdUVNErwmXtoVnUkOc_vFpMQhP0NBU_0 2024-09-14T12:01:18.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17363388436249760268', time=2024-09-14T13:32:48.137452+0000, chain.objs.size()=1 2024-09-14T12:01:18.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.HFBr2qtErHA0-V5x5xGnMPdDTRnCd0J_0 2024-09-14T12:01:18.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10742121128959788185', time=2024-09-14T13:32:48.424214+0000, chain.objs.size()=1 2024-09-14T12:01:18.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.QMTu_TC8Xu1nPv5uIjoP8qbf7dLyCbr_0 2024-09-14T12:01:18.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10186691725579376850', time=2024-09-14T13:32:49.019723+0000, chain.objs.size()=1 2024-09-14T12:01:18.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.LTbXIuS62YYsrI37IuFXskNQLt1N0Ak_0 2024-09-14T12:01:18.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14897298506207032621', time=2024-09-14T13:32:49.319679+0000, chain.objs.size()=1 2024-09-14T12:01:18.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.hnRxcvOs6RHnNxVCMAzNlNy6a3qCa9a_0 2024-09-14T12:01:18.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1556281719886922166', time=2024-09-14T13:32:49.320834+0000, chain.objs.size()=1 2024-09-14T12:01:18.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.JaU2lSbpJkNauR1coE6e2uKcuMP4Cv0_0 2024-09-14T12:01:18.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8725159336309952503', time=2024-09-14T13:32:49.425755+0000, chain.objs.size()=1 2024-09-14T12:01:18.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.pR8wnIHiZ6UGPjM7iLKbDHNrH7FzERm_0 2024-09-14T12:01:18.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15779709884842006876', time=2024-09-14T13:32:49.520185+0000, chain.objs.size()=1 2024-09-14T12:01:18.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.GURuwNIzOW8f3rg3M4skr_wyO8OpUCm_0 2024-09-14T12:01:18.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3515565341918927294', time=2024-09-14T13:32:49.789798+0000, chain.objs.size()=1 2024-09-14T12:01:18.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.988+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.4SFR5BT6ZCrj8hL7HnjGwvqXnvm083c_0 2024-09-14T12:01:18.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.991+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9872411238392392697', time=2024-09-14T13:32:49.790467+0000, chain.objs.size()=1 2024-09-14T12:01:18.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.991+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.8dXDrV6UEynGbRN7zCKqCGz-BxwTweo_0 2024-09-14T12:01:18.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.991+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4797455229443048005', time=2024-09-14T13:32:50.567359+0000, chain.objs.size()=1 2024-09-14T12:01:18.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.991+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.TvWwiciqj7KXor6wrwg5Aoyw8Penjrd_0 2024-09-14T12:01:18.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.991+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.464604019950894453', time=2024-09-14T13:32:50.743489+0000, chain.objs.size()=1 2024-09-14T12:01:18.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.991+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.0t9M3vWz9A1U5YfLUQ2NEs6_OEMjAyO_0 2024-09-14T12:01:18.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.992+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17645715018644345185', time=2024-09-14T13:32:51.218103+0000, chain.objs.size()=1 2024-09-14T12:01:18.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.992+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.wQ90NjQaRxofFWbSNSYjAmKwsjPpw06_0 2024-09-14T12:01:18.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.993+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8570793486133108711', time=2024-09-14T13:32:51.605411+0000, chain.objs.size()=1 2024-09-14T12:01:18.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.993+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.9aM9OGWCf_QGfmnN4Ac4TXDFt7ToBKq_0 2024-09-14T12:01:18.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.993+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10014510308280889859', time=2024-09-14T13:32:52.151804+0000, chain.objs.size()=1 2024-09-14T12:01:18.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.993+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.MErwEqKoWI6gCyeamDcfo07U4KfPP_P_0 2024-09-14T12:01:18.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.993+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15234760436145406332', time=2024-09-14T13:32:52.320596+0000, chain.objs.size()=1 2024-09-14T12:01:18.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.993+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.nGWqqNb1EtCpYz-D1emy5iFjKwAkQIi_0 2024-09-14T12:01:18.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.993+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8266742722582134077', time=2024-09-14T13:32:52.796219+0000, chain.objs.size()=1 2024-09-14T12:01:18.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.993+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.4Lm1DVvp80FEEbkfegF1K8JM_ZuSapu_0 2024-09-14T12:01:18.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.995+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11733945725078910787', time=2024-09-14T13:32:52.958334+0000, chain.objs.size()=1 2024-09-14T12:01:18.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.995+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.rnBd9b4llCEbZ1VeDECM8EtqV7V870e_0 2024-09-14T12:01:18.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.995+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3069535482887263249', time=2024-09-14T13:32:53.515426+0000, chain.objs.size()=1 2024-09-14T12:01:18.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.995+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Hcn5yfEYGBZ7NzZxZXE3Sdkdalmdf6__0 2024-09-14T12:01:18.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.995+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12067928811658228670', time=2024-09-14T13:32:53.694014+0000, chain.objs.size()=1 2024-09-14T12:01:18.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.995+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.GqvzfwNjeZVsiDd6lLwlljJoZhl1YcX_0 2024-09-14T12:01:18.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.997+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17885186962471426096', time=2024-09-14T13:32:53.694635+0000, chain.objs.size()=1 2024-09-14T12:01:18.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.997+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.hGXHXmZvKQNQ0rG7UY-lpQxp5zjkIQ4_0 2024-09-14T12:01:18.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.997+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15234868814050767883', time=2024-09-14T13:32:54.169579+0000, chain.objs.size()=1 2024-09-14T12:01:18.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.997+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.wZG7Y1TYrsykusrUpBmOwVH4gcJVE___0 2024-09-14T12:01:18.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.997+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12207385285601637693', time=2024-09-14T13:32:54.207718+0000, chain.objs.size()=1 2024-09-14T12:01:18.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.997+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.vyal6pudzDHjGfY1hv00KQL4EfzMoxI_0 2024-09-14T12:01:18.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.998+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17797426742946151875', time=2024-09-14T13:32:54.282917+0000, chain.objs.size()=1 2024-09-14T12:01:18.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.998+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ut8W912x7ATUhPzJq6wTYTnNxnKonh9_0 2024-09-14T12:01:18.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.998+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10137995357494248480', time=2024-09-14T13:32:54.538008+0000, chain.objs.size()=1 2024-09-14T12:01:18.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.998+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.s88L9RnKE7kiPI0c9AxFEiLgjsiUITI_0 2024-09-14T12:01:18.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.998+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9713376825310462947', time=2024-09-14T13:32:54.564017+0000, chain.objs.size()=1 2024-09-14T12:01:18.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.998+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.wabUVwhxnTbDp1j1rVCtHjsUvvEbvNa_0 2024-09-14T12:01:18.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.998+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7111172831832085755', time=2024-09-14T13:32:54.985771+0000, chain.objs.size()=1 2024-09-14T12:01:18.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.998+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Py94sl4x-YJwE4zAfSjIIuhiKy-b5U3_0 2024-09-14T12:01:18.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.998+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4091150420042262199', time=2024-09-14T13:32:55.146630+0000, chain.objs.size()=1 2024-09-14T12:01:18.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:18.998+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.1iLoWqjk8fsaROurSt-VzbmjONOqflJ_0 2024-09-14T12:01:18.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.000+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18444608148284127733', time=2024-09-14T13:32:55.617194+0000, chain.objs.size()=1 2024-09-14T12:01:18.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.000+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.CnXkjaCquX-CkqrT4m80kOKajXioGvu_0 2024-09-14T12:01:18.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.000+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4515803417460817929', time=2024-09-14T13:32:55.690836+0000, chain.objs.size()=1 2024-09-14T12:01:18.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.000+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.iuSI0tcK5tys2LjiY2ONFlqMqrg1c7i_0 2024-09-14T12:01:18.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.000+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4333556236038407516', time=2024-09-14T13:32:55.691453+0000, chain.objs.size()=1 2024-09-14T12:01:18.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.000+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.o0TtS2gOWNCOdtlcJ1N1qmJj-H_8b_6_0 2024-09-14T12:01:19.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.002+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16813880481898806369', time=2024-09-14T13:32:55.930139+0000, chain.objs.size()=1 2024-09-14T12:01:19.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.002+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.dvnpj3yCJVE-60H21ZmOVALi-YVCKlt_0 2024-09-14T12:01:19.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.002+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15635907973796706605', time=2024-09-14T13:32:56.555082+0000, chain.objs.size()=1 2024-09-14T12:01:19.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.002+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.oDEz14JcOGdv8X54zDYb6hkumFcEBQr_0 2024-09-14T12:01:19.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.002+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2189153556605522032', time=2024-09-14T13:32:56.879284+0000, chain.objs.size()=1 2024-09-14T12:01:19.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.002+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.v9AyEpvXu0efufnxtitakOgPZXfjUnA_0 2024-09-14T12:01:19.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.002+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6899614689457437631', time=2024-09-14T13:32:56.957571+0000, chain.objs.size()=1 2024-09-14T12:01:19.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.002+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.OwBgqCX45KNywRtkxtCD35_kDvVwzNT_0 2024-09-14T12:01:19.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.002+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8872796356744477202', time=2024-09-14T13:32:57.769447+0000, chain.objs.size()=1 2024-09-14T12:01:19.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.002+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.8rUYKccd6gXWiBg8Xpcn8ZJhlpISLWU_0 2024-09-14T12:01:19.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.002+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3915967374787918199', time=2024-09-14T13:32:57.770671+0000, chain.objs.size()=1 2024-09-14T12:01:19.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.002+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.qS1dn5TxeSCI8IuvCtu-eT6YjvJa4e3_0 2024-09-14T12:01:19.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.002+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6672836214931227179', time=2024-09-14T13:33:00.907444+0000, chain.objs.size()=1 2024-09-14T12:01:19.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.002+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.265__shadow_.olGaPTIOBwbJ0-0C9xH02mtB_3ckg8x_0 2024-09-14T12:01:19.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.002+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8526724090311793048', time=2024-09-14T13:33:14.922157+0000, chain.objs.size()=1 2024-09-14T12:01:19.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.002+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.278__shadow_.Zxh3wdQFeIO7ZDpGNoGir6f52AbX8FB_0 2024-09-14T12:01:19.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.004+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3738917193854597519', time=2024-09-14T13:34:51.537791+0000, chain.objs.size()=1 2024-09-14T12:01:19.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.004+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.iMPC46qdcE3G7HQCL1pnZTu7scqYQ-5_0 2024-09-14T12:01:19.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.004+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9728484929088334689', time=2024-09-14T13:34:51.785023+0000, chain.objs.size()=1 2024-09-14T12:01:19.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.004+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.cTjzlCb9VSohaTZ7yLzT146kIWxMBdO_0 2024-09-14T12:01:19.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.004+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10062667280087202795', time=2024-09-14T13:34:52.145376+0000, chain.objs.size()=1 2024-09-14T12:01:19.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.004+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.G_6ujNl2DdghSnTT4Ovp9zrOZw5EuaE_0 2024-09-14T12:01:19.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.004+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15866201404049573727', time=2024-09-14T13:34:53.883061+0000, chain.objs.size()=1 2024-09-14T12:01:19.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.004+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.MJKvK-wyl1rH9wQhFlgPo1Qxhcdj_Ju_0 2024-09-14T12:01:19.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.005+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8743973007954706001', time=2024-09-14T13:34:54.722796+0000, chain.objs.size()=1 2024-09-14T12:01:19.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.005+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.HO8tQvsuLIkz11TmI3dRUOFmZ3mvl47_0 2024-09-14T12:01:19.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.007+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16244992665274425', time=2024-09-14T13:34:55.041180+0000, chain.objs.size()=1 2024-09-14T12:01:19.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.007+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.0fhabJHU2iTb59mfYnvDYjQARDx3vHz_0 2024-09-14T12:01:19.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.007+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15118325512807141946', time=2024-09-14T13:34:55.664331+0000, chain.objs.size()=1 2024-09-14T12:01:19.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.007+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.OGttVckEo8UHBX52sjVCava9VXBtbdx_0 2024-09-14T12:01:19.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.007+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.113842546691252846', time=2024-09-14T13:34:56.504149+0000, chain.objs.size()=1 2024-09-14T12:01:19.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.007+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.49s6UKtW5J3YMOgukajqXI9P9Oxo79Z_0 2024-09-14T12:01:19.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.007+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10409119913947656374', time=2024-09-14T13:34:56.849118+0000, chain.objs.size()=1 2024-09-14T12:01:19.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.007+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.PsrqO_4btcW-3FJ38_Jo2neeFUP-MTO_0 2024-09-14T12:01:19.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.007+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1098508746404925506', time=2024-09-14T13:34:57.220387+0000, chain.objs.size()=1 2024-09-14T12:01:19.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.007+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.qqAqnrBfXdMNwa1E_Wuuzl8ncfAQWtj_0 2024-09-14T12:01:19.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.007+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12704490432115380742', time=2024-09-14T13:34:57.226461+0000, chain.objs.size()=1 2024-09-14T12:01:19.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.007+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.mfouX6W9_76tcgc355V5brvuKemkW-p_0 2024-09-14T12:01:19.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.007+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2156631109658142440', time=2024-09-14T13:34:57.234512+0000, chain.objs.size()=1 2024-09-14T12:01:19.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.007+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.FjjBtP-yLwjKcPGR5CQrHtcpE64kEnL_0 2024-09-14T12:01:19.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.007+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13735150426428924990', time=2024-09-14T13:34:57.235125+0000, chain.objs.size()=1 2024-09-14T12:01:19.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.007+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Yy44LiA-Cc03fIF5Q_hFHPZ_PzewpXJ_0 2024-09-14T12:01:19.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.008+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.641665758731653179', time=2024-09-14T13:34:57.775646+0000, chain.objs.size()=1 2024-09-14T12:01:19.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.008+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.CNtPGJNBFGM1y0eBO0hpVl8BrFDKaJm_0 2024-09-14T12:01:19.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.009+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17045244310130033582', time=2024-09-14T13:34:57.910594+0000, chain.objs.size()=1 2024-09-14T12:01:19.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.009+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.tkkEAuC2SlVPUO-wlVZO91d7Jxr9zVS_0 2024-09-14T12:01:19.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.009+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8847378895718780989', time=2024-09-14T13:34:57.966663+0000, chain.objs.size()=1 2024-09-14T12:01:19.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.009+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Gc8qqfApvJfZMTZoVJiITZkuF_GCeQA_0 2024-09-14T12:01:19.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.011+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1594921422807563281', time=2024-09-14T13:34:57.994754+0000, chain.objs.size()=1 2024-09-14T12:01:19.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.011+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Puv7JxaeCd8qQnhJaFT5n-7Y4-0Gjf7_0 2024-09-14T12:01:19.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.011+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13788033372417451192', time=2024-09-14T13:34:58.289322+0000, chain.objs.size()=1 2024-09-14T12:01:19.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.011+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.tiLjNjmxM_TKRsNmhu3Uzu7Ic4qd5f-_0 2024-09-14T12:01:19.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.011+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14914261803413861910', time=2024-09-14T13:34:58.679775+0000, chain.objs.size()=1 2024-09-14T12:01:19.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.011+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.LUpWWSThKhDupztEt-X791CWRPjw-UB_0 2024-09-14T12:01:19.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.011+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8763534769972331085', time=2024-09-14T13:34:59.125731+0000, chain.objs.size()=1 2024-09-14T12:01:19.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.011+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.vxVL_AMtFrEKAEwHim7A-m9yqafWR2v_0 2024-09-14T12:01:19.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.011+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.104333687417354973', time=2024-09-14T13:34:59.879566+0000, chain.objs.size()=1 2024-09-14T12:01:19.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.011+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.KcIx4zVGU3d-yw3iLEOyaFbQ7lXEtP7_0 2024-09-14T12:01:19.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.011+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.832359755226380350', time=2024-09-14T13:35:00.472554+0000, chain.objs.size()=1 2024-09-14T12:01:19.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.011+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.TRqmN675j9nfu7f0JjAe1JVOWUeS0mD_0 2024-09-14T12:01:19.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.011+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4793385980226916634', time=2024-09-14T13:35:00.598866+0000, chain.objs.size()=1 2024-09-14T12:01:19.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.011+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.fprg6cNJa36TAw-bcAErS02Q-WhdAX9_0 2024-09-14T12:01:19.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.011+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17520511380653361606', time=2024-09-14T13:35:00.781526+0000, chain.objs.size()=1 2024-09-14T12:01:19.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.011+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Ad5lZI0ABZo2XU_ctHLykiyvxJHjFBy_0 2024-09-14T12:01:19.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.012+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16486975075772895164', time=2024-09-14T13:35:00.895474+0000, chain.objs.size()=1 2024-09-14T12:01:19.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.012+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.J2j63cHNl8ZgM7a2kgLn5NUb3VwFJk-_0 2024-09-14T12:01:19.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.012+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9537672530156131363', time=2024-09-14T13:35:01.154106+0000, chain.objs.size()=1 2024-09-14T12:01:19.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.012+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.D8_jstf_bNEKPfosme3dTHS1loYpBCI_0 2024-09-14T12:01:19.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.015+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14902772886444650452', time=2024-09-14T13:35:01.190219+0000, chain.objs.size()=1 2024-09-14T12:01:19.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.015+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.KHiw2GgJyYn6DeuVVxVo1Pex2qIshHV_0 2024-09-14T12:01:19.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.015+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3016427663536301605', time=2024-09-14T13:35:01.490814+0000, chain.objs.size()=1 2024-09-14T12:01:19.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.015+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_._jAvUqaztYLuStyr5e9NFBzQtJ2b1Sl_0 2024-09-14T12:01:19.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.015+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9094244118813375523', time=2024-09-14T13:35:41.802296+0000, chain.objs.size()=1 2024-09-14T12:01:19.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.015+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.jpupFournKz5F9_Os-UyLmQyCeVnSGm_0 2024-09-14T12:01:19.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.015+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11544046486289382539', time=2024-09-14T13:35:41.931277+0000, chain.objs.size()=1 2024-09-14T12:01:19.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.015+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ouRdbUql5-K2UbOukCV6ZdngSrCpNWW_0 2024-09-14T12:01:19.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.015+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5817046368613506666', time=2024-09-14T13:35:41.931939+0000, chain.objs.size()=1 2024-09-14T12:01:19.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.015+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.afBGjY7nOJvY7RyjVwEujBycRkF9K9k_0 2024-09-14T12:01:19.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.015+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13974179459025076917', time=2024-09-14T13:35:43.431603+0000, chain.objs.size()=1 2024-09-14T12:01:19.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.015+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.gNre_VldY0KhXcVu5Og97IkItfp9CgF_0 2024-09-14T12:01:19.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.015+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2216401482592442691', time=2024-09-14T13:35:44.852529+0000, chain.objs.size()=1 2024-09-14T12:01:19.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.015+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.LTe99EkU3ssKhbVftRa3hvmhCaSPkPR_0 2024-09-14T12:01:19.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.015+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.459284996338548001', time=2024-09-14T13:35:45.112315+0000, chain.objs.size()=1 2024-09-14T12:01:19.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.015+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.a_veF59DOAxPMA_mXTwi1vKq2LeKaRK_0 2024-09-14T12:01:19.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.016+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1832926044000022046', time=2024-09-14T13:35:45.146649+0000, chain.objs.size()=1 2024-09-14T12:01:19.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.016+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.oa4F37zLcqdIaMmQwRGD2wdee46cDqw_0 2024-09-14T12:01:19.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.016+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4776901021566023083', time=2024-09-14T13:35:45.200788+0000, chain.objs.size()=1 2024-09-14T12:01:19.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.016+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.zKzTCFi5skybHGXOyqyI5t-E5pTCKeH_0 2024-09-14T12:01:19.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.017+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9577835504540679827', time=2024-09-14T13:35:45.436863+0000, chain.objs.size()=1 2024-09-14T12:01:19.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.017+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.pdT5B4-AqU57I63kW6b7cJWWOKpJJbu_0 2024-09-14T12:01:19.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.018+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17224480109649529460', time=2024-09-14T13:35:46.482486+0000, chain.objs.size()=1 2024-09-14T12:01:19.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.018+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.mOQv8uv5sl7_aHQ38zJEB53i_-OInyL_0 2024-09-14T12:01:19.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.019+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15474960225858554786', time=2024-09-14T13:35:47.193010+0000, chain.objs.size()=1 2024-09-14T12:01:19.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.019+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.0RnYgwVB_O2HBmio_fkqHiZZvD7tulO_0 2024-09-14T12:01:19.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.019+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3289478768416218877', time=2024-09-14T13:35:47.234542+0000, chain.objs.size()=1 2024-09-14T12:01:19.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.019+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.kwAD7DZkPAqficklC8Zb0UBv5GHr0-9_0 2024-09-14T12:01:19.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.019+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14675501723774477316', time=2024-09-14T13:35:48.086077+0000, chain.objs.size()=1 2024-09-14T12:01:19.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.019+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.5Vu783y8qHK72eUE37_-2iMnrJa06ys_0 2024-09-14T12:01:19.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.019+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14409076587660164537', time=2024-09-14T13:35:48.169937+0000, chain.objs.size()=1 2024-09-14T12:01:19.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.019+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.HJdgsro9gky6cwAojtJkbksf643SAM0_0 2024-09-14T12:01:19.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.019+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14888390423069881022', time=2024-09-14T13:35:48.226462+0000, chain.objs.size()=1 2024-09-14T12:01:19.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.019+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.BrM_73fPS2QDzlNXeb8kWA6wFTbdgJy_0 2024-09-14T12:01:19.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.019+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11665802355252882006', time=2024-09-14T13:35:48.341776+0000, chain.objs.size()=1 2024-09-14T12:01:19.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.019+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.J_NwaJFhsNznAs2oePC6jz1FCJVx1C6_0 2024-09-14T12:01:19.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.019+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14852545737086513786', time=2024-09-14T13:35:48.366932+0000, chain.objs.size()=1 2024-09-14T12:01:19.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.019+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.u5icPgCHTxkdTULQyjf3jG1rMXoRGvV_0 2024-09-14T12:01:19.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.020+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3944821266038706684', time=2024-09-14T13:35:48.602766+0000, chain.objs.size()=1 2024-09-14T12:01:19.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.020+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.cR6q2YJ2Vg_BwlodLnHHdtqFMRD6arr_0 2024-09-14T12:01:19.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.021+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5821368385075474302', time=2024-09-14T13:35:48.604330+0000, chain.objs.size()=1 2024-09-14T12:01:19.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.021+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.h0d99U3qzWPFxa1ZxvoZhNdOcmwCVm7_0 2024-09-14T12:01:19.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.021+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6029887958191472911', time=2024-09-14T13:35:49.294039+0000, chain.objs.size()=1 2024-09-14T12:01:19.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.021+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.XaRPEm5usVPvh_kDoh6qfyknuvfT1sG_0 2024-09-14T12:01:19.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.022+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17254725179611361264', time=2024-09-14T13:35:49.663489+0000, chain.objs.size()=1 2024-09-14T12:01:19.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.022+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.lehMmLKz4pvkJSa-jpPV3Dznwmd6arl_0 2024-09-14T12:01:19.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.022+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17141219358843671977', time=2024-09-14T13:35:49.699042+0000, chain.objs.size()=1 2024-09-14T12:01:19.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.022+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.YAVJPWLZWnhS05on6Xv4ZTQqe9CGWZd_0 2024-09-14T12:01:19.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.023+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9349707519254732421', time=2024-09-14T13:35:49.806657+0000, chain.objs.size()=1 2024-09-14T12:01:19.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.023+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.VzgN4kI7TS1E1-WzaLzBZEX5IXyOlKR_0 2024-09-14T12:01:19.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.024+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12217968474927225100', time=2024-09-14T13:35:50.925977+0000, chain.objs.size()=1 2024-09-14T12:01:19.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.024+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.raeuyEFYZj8LefceoQSEwQ_hKQa-mOh_0 2024-09-14T12:01:19.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.024+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8520087469943924869', time=2024-09-14T13:35:50.941196+0000, chain.objs.size()=1 2024-09-14T12:01:19.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.024+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.NYQg4oCnxnVpA9njxh_D4b5dNsDB5XT_0 2024-09-14T12:01:19.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.024+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9538426375830200183', time=2024-09-14T13:35:51.941262+0000, chain.objs.size()=1 2024-09-14T12:01:19.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.024+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.pdb8_sQjV0YqOn1FNuGPcMTXwkmxyfZ_0 2024-09-14T12:01:19.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.025+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14427041111855762787', time=2024-09-14T13:35:52.765860+0000, chain.objs.size()=1 2024-09-14T12:01:19.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.025+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.lMye0F4vyVp-P9cIaPUS0hSVQ7zmYGd_0 2024-09-14T12:01:19.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.025+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18418540587331263936', time=2024-09-14T13:36:05.051010+0000, chain.objs.size()=1 2024-09-14T12:01:19.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.025+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.337__shadow_.0H0o_PYn4ikvtuhvuY4XkRWUDWNHn7V_0 2024-09-14T12:01:19.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.025+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14754098732813782632', time=2024-09-14T13:36:12.660771+0000, chain.objs.size()=1 2024-09-14T12:01:19.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.025+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.344__shadow_.ZYnLQDTvdw8XunA7IixFLHYx61kee21_0 2024-09-14T12:01:19.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.025+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15921583982583030952', time=2024-09-14T13:37:20.401112+0000, chain.objs.size()=1 2024-09-14T12:01:19.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.025+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.409__shadow_.6bgiWvXNtvR-NDzvBrsbHN_HedT-y1s_0 2024-09-14T12:01:19.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.029+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/44011 2024-09-14T12:01:19.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.031+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T12:01:19.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.031+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16365281235212496955', time=2024-09-14T13:38:42.793907+0000, chain.objs.size()=1 2024-09-14T12:01:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.031+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.484__shadow_.2DPTy6sThUFJNQnrxmIYc6gwNDlrH-l_0 2024-09-14T12:01:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.031+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15476981116127464907', time=2024-09-14T13:39:02.349086+0000, chain.objs.size()=1 2024-09-14T12:01:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.031+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.500__shadow_.BvYWg910Du-NAxwKdh3FJhd97z0PYzT_0 2024-09-14T12:01:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.032+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14784062510281260972', time=2024-09-14T13:40:40.403921+0000, chain.objs.size()=3 2024-09-14T12:01:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.032+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.522__multipart_mymultipart.2~2ZMmsXmjzyrhieKZSMM2Ec4auAUTmzF.1 2024-09-14T12:01:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.032+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.522__multipart_mymultipart.2~2ZMmsXmjzyrhieKZSMM2Ec4auAUTmzF.2 2024-09-14T12:01:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.032+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.522__multipart_mymultipart.2~2ZMmsXmjzyrhieKZSMM2Ec4auAUTmzF.3 2024-09-14T12:01:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.032+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~Yl03J8qrURqq-WSgxVx-pDcUujN7Nd0', time=2024-09-14T13:43:42.904130+0000, chain.objs.size()=1 2024-09-14T12:01:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.032+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.532__multipart_mymultipart2.2~Yl03J8qrURqq-WSgxVx-pDcUujN7Nd0.1 2024-09-14T12:01:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.032+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12058686403503053578', time=2024-09-14T13:45:55.344630+0000, chain.objs.size()=1 2024-09-14T12:01:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.032+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.575__shadow:Fla8gjXTtt8euA1TMG3CyTJCHU.B4kF_.lRWYKaC413Er1aME5K4mZNPmxt-xKTn_0 2024-09-14T12:01:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.032+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11705857623899710708', time=2024-09-14T13:46:03.328937+0000, chain.objs.size()=1 2024-09-14T12:01:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.032+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.577__shadow:8XREn9lquoceeYaTrt7-kJ4iBDuHInP_.jp-JWhPCgwOdTBAswQ05m5lkw1Dqxvt_0 2024-09-14T12:01:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.032+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11325858715808358010', time=2024-09-14T13:46:11.502196+0000, chain.objs.size()=1 2024-09-14T12:01:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.032+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:cV8HnMqGHkG0OfFEYsC2SSlxz41EqlO_.hgLG5janyAVmHmNHbJA_8xZ3trv6RGs_0 2024-09-14T12:01:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.032+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4202211730306664873', time=2024-09-14T13:47:12.389941+0000, chain.objs.size()=1 2024-09-14T12:01:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.032+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.581__shadow:ucJQ5gC866YVcJz5iWi8DFmIfLjsX7-_.vszOjRwgAfymXNJl4RRFQCaYIXTsWxI_0 2024-09-14T12:01:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.032+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9616978248704967539', time=2024-09-14T13:52:18.873909+0000, chain.objs.size()=6 2024-09-14T12:01:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.032+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.624__multipart_multipart_enc.2~9aOSh5Qv0ton_oKfEevtO61-mOuL4L6.1 2024-09-14T12:01:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.032+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.624__multipart_multipart_enc.2~9aOSh5Qv0ton_oKfEevtO61-mOuL4L6.2 2024-09-14T12:01:19.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.035+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.624__multipart_multipart_enc.2~9aOSh5Qv0ton_oKfEevtO61-mOuL4L6.3 2024-09-14T12:01:19.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.035+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.624__multipart_multipart_enc.2~9aOSh5Qv0ton_oKfEevtO61-mOuL4L6.4 2024-09-14T12:01:19.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.035+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.624__multipart_multipart_enc.2~9aOSh5Qv0ton_oKfEevtO61-mOuL4L6.5 2024-09-14T12:01:19.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.035+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.624__multipart_multipart_enc.2~9aOSh5Qv0ton_oKfEevtO61-mOuL4L6.6 2024-09-14T12:01:19.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.035+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12627897000196350267', time=2024-09-14T13:53:54.841307+0000, chain.objs.size()=1 2024-09-14T12:01:19.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.035+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.664__shadow_.0QZBXKJ4mkf1kuZekbo2qoOKlsUaaHF_0 2024-09-14T12:01:19.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.035+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15374868912701367491', time=2024-09-14T13:53:59.606284+0000, chain.objs.size()=1 2024-09-14T12:01:19.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.035+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.667__shadow_.bFgJ6VmVPyxqkj6aS8CqGuPz_zEHfHK_0 2024-09-14T12:01:19.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.035+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7480500090759174264', time=2024-09-14T13:54:56.948561+0000, chain.objs.size()=1 2024-09-14T12:01:19.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.035+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.717__shadow:dAYKxrpxJJkQ-3t6bJLK-1Ki3H7nnen_.-yKCbFFL_R4Rwh6N2roBr7ux2QfM1e__0 2024-09-14T12:01:19.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.040+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:19.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.043+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T12:01:19.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.044+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:19.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.044+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.045+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43845' 2024-09-14T12:01:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.045+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11777603550290891741', time=2024-09-14T13:31:37.006424+0000, chain.objs.size()=1 2024-09-14T12:01:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.045+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.235__shadow_.jSUUs59chWgXpjcexc_0PJU0CL3ocoz_0 2024-09-14T12:01:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.045+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16602661464205710999', time=2024-09-14T13:32:47.757305+0000, chain.objs.size()=1 2024-09-14T12:01:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.045+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.BmuU9o2GFrPNexJ9OUc4RvTc0a4Vxyo_0 2024-09-14T12:01:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.046+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18228801105395435264', time=2024-09-14T13:32:48.292977+0000, chain.objs.size()=1 2024-09-14T12:01:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.046+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.IC-DO53qMa3ks8mUTJwScj9GcZYXTwo_0 2024-09-14T12:01:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.046+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4899306268896537926', time=2024-09-14T13:32:49.015581+0000, chain.objs.size()=1 2024-09-14T12:01:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.046+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.gq2wAT4D9Zf1z1OG_0obpJO-I0-tniQ_0 2024-09-14T12:01:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.046+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15836579723404275093', time=2024-09-14T13:32:49.315709+0000, chain.objs.size()=1 2024-09-14T12:01:19.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.046+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.wA7O1Hyj_m6QxbdOxixc6dMq2Kfxexk_0 2024-09-14T12:01:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.046+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14562800665916597479', time=2024-09-14T13:32:49.488200+0000, chain.objs.size()=1 2024-09-14T12:01:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.046+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.pLX6ngdCtjIw4_c1TJWU3f2kZDC7B55_0 2024-09-14T12:01:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.046+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6969190948895808350', time=2024-09-14T13:32:49.985531+0000, chain.objs.size()=1 2024-09-14T12:01:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.046+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.6Io5gWUBtw8BAbDyUXe1MB3jwmRS9dV_0 2024-09-14T12:01:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.046+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5512900316172431516', time=2024-09-14T13:32:52.057016+0000, chain.objs.size()=1 2024-09-14T12:01:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.046+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.6nIM-ALq5svGErQHRA20wWOoAmwrAjS_0 2024-09-14T12:01:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.046+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6406790986679586883', time=2024-09-14T13:32:52.155253+0000, chain.objs.size()=1 2024-09-14T12:01:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.046+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.vgdPE3DvF8WfPCcGsfpQiFLTyySHVLq_0 2024-09-14T12:01:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.046+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6127468411671360899', time=2024-09-14T13:32:52.226317+0000, chain.objs.size()=1 2024-09-14T12:01:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.046+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.-sx7JPzhcdfrf-Wf2vEpPRJr18rxAXp_0 2024-09-14T12:01:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.046+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2855570677557295378', time=2024-09-14T13:32:52.533683+0000, chain.objs.size()=1 2024-09-14T12:01:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.046+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.gLBJjIaqW4LJyhN3-UxiLYW6hYQ439G_0 2024-09-14T12:01:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.046+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14430648075091844595', time=2024-09-14T13:32:52.774548+0000, chain.objs.size()=1 2024-09-14T12:01:19.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.046+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.SWH3AmI8Vefh5JgjuRFdQEGrpmmG2EZ_0 2024-09-14T12:01:19.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.048+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11559726085035340706', time=2024-09-14T13:32:54.561299+0000, chain.objs.size()=1 2024-09-14T12:01:19.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.048+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.KRZ22f0kYa_F7lgN_gtR6jhFMjgd0br_0 2024-09-14T12:01:19.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.048+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12426205464901097992', time=2024-09-14T13:32:54.951606+0000, chain.objs.size()=1 2024-09-14T12:01:19.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.048+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.tbXKhoiFE19-ldLKwDUraSozaoxIQ3E_0 2024-09-14T12:01:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.050+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7019929624271881416', time=2024-09-14T13:32:55.151195+0000, chain.objs.size()=1 2024-09-14T12:01:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.050+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.4YY2QAbLu_-NOmqdOoPR0qVhzEmq1kN_0 2024-09-14T12:01:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.050+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5989600306373107820', time=2024-09-14T13:32:55.337370+0000, chain.objs.size()=1 2024-09-14T12:01:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.050+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.yR60ce1DJ_VeA6VCeMkIF2CfcqfBCWK_0 2024-09-14T12:01:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.050+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16326357402949403963', time=2024-09-14T13:32:55.337862+0000, chain.objs.size()=1 2024-09-14T12:01:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.050+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.6fdTbFmZMrIez7r8ojmt_OrP-P3cIjL_0 2024-09-14T12:01:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.050+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9783871821950201991', time=2024-09-14T13:32:55.949488+0000, chain.objs.size()=1 2024-09-14T12:01:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.050+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.0YCuxpEVanwMsESKwAWarC65fZOtrmQ_0 2024-09-14T12:01:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.050+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6956806270832592020', time=2024-09-14T13:32:55.972719+0000, chain.objs.size()=1 2024-09-14T12:01:19.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.050+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ij6Vjahop7Av3ttkVDFmOtpVH0Jlb-I_0 2024-09-14T12:01:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.050+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14173542126716419823', time=2024-09-14T13:32:57.091176+0000, chain.objs.size()=1 2024-09-14T12:01:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.050+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.qmFTjL7HD0KHGEnUSuibEU1WTZOrGDs_0 2024-09-14T12:01:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.050+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17865555675126635137', time=2024-09-14T13:32:57.139856+0000, chain.objs.size()=1 2024-09-14T12:01:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.050+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ZAIvaHUqTrNICPc2tACkesernQCX0uH_0 2024-09-14T12:01:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.050+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16550349270150114484', time=2024-09-14T13:32:57.364003+0000, chain.objs.size()=1 2024-09-14T12:01:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.050+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.XxHX-1OWDKNclefLeB0yKKnD1j9vZ_H_0 2024-09-14T12:01:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.050+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15418312112423074719', time=2024-09-14T13:32:57.446620+0000, chain.objs.size()=1 2024-09-14T12:01:19.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.050+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.m9I_0VDHEKpp2nIlITHeweIaP_9e0qY_0 2024-09-14T12:01:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.051+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15850953169424625570', time=2024-09-14T13:32:57.459835+0000, chain.objs.size()=1 2024-09-14T12:01:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.051+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.xC1rhONIVi9zYdhec-Gr7puz56lhAzb_0 2024-09-14T12:01:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.051+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1839426392579127851', time=2024-09-14T13:32:58.258360+0000, chain.objs.size()=1 2024-09-14T12:01:19.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.051+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Wu9BQAX6ITd8s1ulQX7qqZFifJs6_gC_0 2024-09-14T12:01:19.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.054+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8618830908736703590', time=2024-09-14T13:33:19.281535+0000, chain.objs.size()=1 2024-09-14T12:01:19.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.054+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.282__shadow_.DZ9rOKCD637oa7LRXVJhbcW4g--6ysi_0 2024-09-14T12:01:19.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.054+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12342415454018563235', time=2024-09-14T13:33:23.754902+0000, chain.objs.size()=1 2024-09-14T12:01:19.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.054+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.286__shadow_.OYtVOL-IysiiRU6A2YPTEuR9T-ziIJx_0 2024-09-14T12:01:19.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.054+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.275174873305545617', time=2024-09-14T13:33:33.247233+0000, chain.objs.size()=1 2024-09-14T12:01:19.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.054+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.u_itL8LpuKRUAhGz54ew2MxvVwEZiek_0 2024-09-14T12:01:19.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.054+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3498665155455410769', time=2024-09-14T13:33:48.034859+0000, chain.objs.size()=1 2024-09-14T12:01:19.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.054+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.305__shadow_.SRqsgXvDR94hniDEr5bxU7B1S6lYDtN_0 2024-09-14T12:01:19.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.054+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12337890208851209138', time=2024-09-14T13:33:50.474441+0000, chain.objs.size()=1 2024-09-14T12:01:19.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.054+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.307__shadow_.SBpMlDGldJU2gYDwEubbxEv4xN3Gubr_0 2024-09-14T12:01:19.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.054+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9714898722374097182', time=2024-09-14T13:34:52.009946+0000, chain.objs.size()=1 2024-09-14T12:01:19.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.054+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.KQ0V8UfFopmu_bTiQOePxPK_onIq9pJ_0 2024-09-14T12:01:19.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.054+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11768510756344776706', time=2024-09-14T13:34:52.341864+0000, chain.objs.size()=1 2024-09-14T12:01:19.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.054+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.S-gQtyaGJnxLgGav1o0ea-mHTteEPPP_0 2024-09-14T12:01:19.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.055+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5036409103818295419', time=2024-09-14T13:34:52.438842+0000, chain.objs.size()=1 2024-09-14T12:01:19.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.055+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.01mqjm2fKEnqfsJW2dyKdMAAXYc5p-p_0 2024-09-14T12:01:19.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.055+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12081638935591122442', time=2024-09-14T13:34:53.578461+0000, chain.objs.size()=1 2024-09-14T12:01:19.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.055+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Z-8dBnsa9lKj3bNSp5GQMiHwb99LGbI_0 2024-09-14T12:01:19.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.055+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13271131342651469095', time=2024-09-14T13:34:53.911445+0000, chain.objs.size()=1 2024-09-14T12:01:19.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.055+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Zci7xXpPokUwAXts561BmNDmxHjKY1b_0 2024-09-14T12:01:19.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.056+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.407141153433480774', time=2024-09-14T13:34:54.156313+0000, chain.objs.size()=1 2024-09-14T12:01:19.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.056+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.JC4CzDmbGzbtXNffQnn1SQGAxsSJ_Rx_0 2024-09-14T12:01:19.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.057+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2424580530856593190', time=2024-09-14T13:34:54.841887+0000, chain.objs.size()=1 2024-09-14T12:01:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.057+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.-XaRT3XGlDiXAcovU-SuK1L4M-5f6ib_0 2024-09-14T12:01:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.058+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5381733599855709096', time=2024-09-14T13:34:54.912921+0000, chain.objs.size()=1 2024-09-14T12:01:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.058+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.nZpPNGdw5XJwOHGqu54xiT1SIByxUFq_0 2024-09-14T12:01:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.058+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15463872324533968348', time=2024-09-14T13:34:55.735887+0000, chain.objs.size()=1 2024-09-14T12:01:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.058+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.n4e-gQZ0s69T5vt6VZEuvDiDnBI_t27_0 2024-09-14T12:01:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.058+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7759699843773975013', time=2024-09-14T13:34:55.745517+0000, chain.objs.size()=1 2024-09-14T12:01:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.058+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.bqaXO4MUpKryXIj3nYnEiK2MmhJY7aE_0 2024-09-14T12:01:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.058+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14059393413033066414', time=2024-09-14T13:34:56.209071+0000, chain.objs.size()=1 2024-09-14T12:01:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.058+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.7Yew9y-fjmOe48o3x9T-uNk4ACGNUl5_0 2024-09-14T12:01:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.058+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.715189834825539931', time=2024-09-14T13:34:56.814757+0000, chain.objs.size()=1 2024-09-14T12:01:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.058+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Jz5GB6B32ncwBXBmEmbMkI_1BUWSwzY_0 2024-09-14T12:01:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.058+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17332888384969125156', time=2024-09-14T13:34:57.141509+0000, chain.objs.size()=1 2024-09-14T12:01:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.058+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.p0qJ-niF92gsj4a3uE9BbEmdUgisUAW_0 2024-09-14T12:01:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.058+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4658070385377265603', time=2024-09-14T13:34:57.788007+0000, chain.objs.size()=1 2024-09-14T12:01:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.058+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.YNHySnUW-IiV03GvgvT0YbQYWE9TGSC_0 2024-09-14T12:01:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.058+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11919708448495618345', time=2024-09-14T13:34:58.128736+0000, chain.objs.size()=1 2024-09-14T12:01:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.058+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.YjGa3juov74ldqJfdIUOFyi-Pz1k05k_0 2024-09-14T12:01:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.058+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1438866288644276169', time=2024-09-14T13:34:58.161852+0000, chain.objs.size()=1 2024-09-14T12:01:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.058+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.qVvDG7_182jIl_VydEwdMOO39DTIUqG_0 2024-09-14T12:01:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.060+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6795519020252807719', time=2024-09-14T13:34:58.571837+0000, chain.objs.size()=1 2024-09-14T12:01:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.060+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.xKjhx20ytVpuIEYlwvyUL-h5u3s9U35_0 2024-09-14T12:01:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.060+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16517671354907439957', time=2024-09-14T13:34:59.082016+0000, chain.objs.size()=1 2024-09-14T12:01:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.060+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ue3gneRprKaL_VGL9QOD3ar37p5L7gI_0 2024-09-14T12:01:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.061+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7645631506737593294', time=2024-09-14T13:34:59.841390+0000, chain.objs.size()=1 2024-09-14T12:01:19.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.061+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.3Ehefmv5lPpumcKE3iwqn0FKgV8Md6F_0 2024-09-14T12:01:19.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.064+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3903194952632876389', time=2024-09-14T13:35:00.126122+0000, chain.objs.size()=1 2024-09-14T12:01:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.064+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.vaO6QgVUifjsK4cUDwhCy84CmuZtTDA_0 2024-09-14T12:01:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.064+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4827955087448642347', time=2024-09-14T13:35:00.476414+0000, chain.objs.size()=1 2024-09-14T12:01:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.064+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.T0-C_Yq1T41-mD-yaLyIFnsSoM0oANG_0 2024-09-14T12:01:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.064+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13163384355736417919', time=2024-09-14T13:35:00.581907+0000, chain.objs.size()=1 2024-09-14T12:01:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.064+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.vTHmVCW3IZOO7n2FAJ6a-fekqdsvVHa_0 2024-09-14T12:01:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.064+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10923265105039434832', time=2024-09-14T13:35:00.595913+0000, chain.objs.size()=1 2024-09-14T12:01:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.064+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.4zRaUX7X3X9MmaWKB1sxO69U9Co23Q7_0 2024-09-14T12:01:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.064+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10616414404627648496', time=2024-09-14T13:35:01.827563+0000, chain.objs.size()=1 2024-09-14T12:01:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.064+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.253gEK9w4e1b6jCqRVdJDwqWFgIyyM-_0 2024-09-14T12:01:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.064+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3755504996312185240', time=2024-09-14T13:35:02.511995+0000, chain.objs.size()=1 2024-09-14T12:01:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.064+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ZzNHgme12kXOT7cjxv9XjYA-aREltqK_0 2024-09-14T12:01:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.064+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4370274694858658163', time=2024-09-14T13:35:02.626250+0000, chain.objs.size()=1 2024-09-14T12:01:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.064+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ouNmLtReHbgheomXWK9AdUSW_eZuWeK_0 2024-09-14T12:01:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.064+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8005023221673227395', time=2024-09-14T13:35:41.660893+0000, chain.objs.size()=1 2024-09-14T12:01:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.064+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.TLnpSc8-BLwcGo2r96wj-MFNAdoJawa_0 2024-09-14T12:01:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.064+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17952527190750487442', time=2024-09-14T13:35:41.661797+0000, chain.objs.size()=1 2024-09-14T12:01:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.064+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.f8d3GQj_z1zkMCWoZqr7Zc2C0Sk5FGL_0 2024-09-14T12:01:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.065+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1429272341107412724', time=2024-09-14T13:35:41.982612+0000, chain.objs.size()=1 2024-09-14T12:01:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.065+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.6iMTuWBHUn0Yw0MXS6Y5LNh-g-OaFg6_0 2024-09-14T12:01:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.065+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11097248404068133645', time=2024-09-14T13:35:42.131557+0000, chain.objs.size()=1 2024-09-14T12:01:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.065+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.thOS0gWiAZhsPO_N6Jvm6uDp-C3TTpi_0 2024-09-14T12:01:19.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.067+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8644510998330316244', time=2024-09-14T13:35:42.388849+0000, chain.objs.size()=1 2024-09-14T12:01:19.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.067+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.iateYddGPMqaqfZMNGpW-Or4a8hPkEf_0 2024-09-14T12:01:19.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.069+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13426005252780518145', time=2024-09-14T13:35:42.462596+0000, chain.objs.size()=1 2024-09-14T12:01:19.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.069+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.n9-u6Je6P-aCOYv_V5p2VZ5uqYPEThf_0 2024-09-14T12:01:19.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.070+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14640124492804750014', time=2024-09-14T13:35:42.466015+0000, chain.objs.size()=1 2024-09-14T12:01:19.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.070+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.4r03AzMjd__7hpMMcdGgZiVMTbUQhTl_0 2024-09-14T12:01:19.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.070+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3415389625551435740', time=2024-09-14T13:35:42.633818+0000, chain.objs.size()=1 2024-09-14T12:01:19.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.070+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_._OJcnNEkjXrw5a2ojun4U9Olucgh3GL_0 2024-09-14T12:01:19.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.070+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15828794246129013274', time=2024-09-14T13:35:42.689049+0000, chain.objs.size()=1 2024-09-14T12:01:19.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.070+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.jvxrhwYukdKS1gtZgAiF3RdxIimn5Rx_0 2024-09-14T12:01:19.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.070+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3312880241916522362', time=2024-09-14T13:35:43.456080+0000, chain.objs.size()=1 2024-09-14T12:01:19.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.070+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.TA3XY4vcJ0CD2bcIPH7KvZkR7UvCbL9_0 2024-09-14T12:01:19.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.070+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5166145400148196851', time=2024-09-14T13:35:43.554321+0000, chain.objs.size()=1 2024-09-14T12:01:19.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.070+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ZCzJr3FjqcrvyvaDffhVS1Mp5hmz1G0_0 2024-09-14T12:01:19.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.070+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13204451225946687219', time=2024-09-14T13:35:43.638177+0000, chain.objs.size()=1 2024-09-14T12:01:19.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.070+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.HFmfz7PKR5RO-g2OGl9WC7GIq3SXMsw_0 2024-09-14T12:01:19.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.070+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14663700689089410032', time=2024-09-14T13:35:43.681075+0000, chain.objs.size()=1 2024-09-14T12:01:19.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.070+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.bTECEdk-cAmNPeo8LwfbCF5r8ggrw-I_0 2024-09-14T12:01:19.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.070+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14322925374259416396', time=2024-09-14T13:35:43.888185+0000, chain.objs.size()=1 2024-09-14T12:01:19.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.070+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.vPZ_BqaZ2wgqJMuacjmarb4rdfnuBFt_0 2024-09-14T12:01:19.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.070+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12157066004179049615', time=2024-09-14T13:35:43.935792+0000, chain.objs.size()=1 2024-09-14T12:01:19.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.070+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ukUy9MEpEuA5naKX4PEsnsYuitdieso_0 2024-09-14T12:01:19.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.070+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8353654206978323220', time=2024-09-14T13:35:45.004987+0000, chain.objs.size()=1 2024-09-14T12:01:19.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.070+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.goIrKLZKuuU6_NELU0oSDcpU9Q26afr_0 2024-09-14T12:01:19.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.072+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11436467384517245544', time=2024-09-14T13:35:45.244325+0000, chain.objs.size()=1 2024-09-14T12:01:19.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.072+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.bGWU1J9lIzc7KtkudFZNGzgHo9I5GkQ_0 2024-09-14T12:01:19.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.072+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10966012851771873957', time=2024-09-14T13:35:45.407894+0000, chain.objs.size()=1 2024-09-14T12:01:19.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.072+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.veWryNL5g-iAkyKsZ44t1-72HN26a5H_0 2024-09-14T12:01:19.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.072+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8470902010778092590', time=2024-09-14T13:35:45.755644+0000, chain.objs.size()=1 2024-09-14T12:01:19.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.072+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.TBGlg3b1vAspEOg1zvDuc0sbin-Hh89_0 2024-09-14T12:01:19.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.073+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4979364843121717283', time=2024-09-14T13:35:45.834410+0000, chain.objs.size()=1 2024-09-14T12:01:19.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.073+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ZdRgxQ5JQkRNxa4r5VcLEiy6RHz3pf2_0 2024-09-14T12:01:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.074+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6334421722511866746', time=2024-09-14T13:35:46.440967+0000, chain.objs.size()=1 2024-09-14T12:01:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.074+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ruhAlevNu3hnx2C0r7f42Uz87ZmzJ8g_0 2024-09-14T12:01:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.074+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5840483514243851740', time=2024-09-14T13:35:46.596419+0000, chain.objs.size()=1 2024-09-14T12:01:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.074+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.R_MFaa0jfesoIW0xAcY31N40v5xB3TE_0 2024-09-14T12:01:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.074+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15475919101990890134', time=2024-09-14T13:35:47.756399+0000, chain.objs.size()=1 2024-09-14T12:01:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.074+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.flBNnqaolixCjpwGo0rzcTRVQeMWdM1_0 2024-09-14T12:01:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.074+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5684229171496026183', time=2024-09-14T13:35:47.914379+0000, chain.objs.size()=1 2024-09-14T12:01:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.074+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.qbsIHx59XV5MAE3YUM8YfThatF8la_v_0 2024-09-14T12:01:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.074+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9169497020819546684', time=2024-09-14T13:35:47.916861+0000, chain.objs.size()=1 2024-09-14T12:01:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.074+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ZMa6-3qYkWb-oy1I6tgcf-Iv4QxxnET_0 2024-09-14T12:01:19.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.074+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5542450734162697798', time=2024-09-14T13:35:48.227191+0000, chain.objs.size()=1 2024-09-14T12:01:19.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.074+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.q6fy8NAwTri2C3J5FDM0thP4sBW9lxn_0 2024-09-14T12:01:19.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.074+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13365009496760147987', time=2024-09-14T13:35:48.463823+0000, chain.objs.size()=1 2024-09-14T12:01:19.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.074+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.m-hT2FDW3criiukNmxGc060PQ7OAuJp_0 2024-09-14T12:01:19.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.075+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2872290819730316030', time=2024-09-14T13:35:49.233040+0000, chain.objs.size()=1 2024-09-14T12:01:19.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.075+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.YgZFfjGi1fMPODes6--ZMpv5mLsLcfd_0 2024-09-14T12:01:19.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.075+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8305549997110640041', time=2024-09-14T13:35:49.404761+0000, chain.objs.size()=1 2024-09-14T12:01:19.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.075+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.emNkUDAKJhosetHMGDoUXtrIgO_7mIn_0 2024-09-14T12:01:19.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.077+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11238291713341358364', time=2024-09-14T13:35:49.511946+0000, chain.objs.size()=1 2024-09-14T12:01:19.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.077+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.qXH1NG8zJRwjSK8LFKQvwZaPuE0YaVj_0 2024-09-14T12:01:19.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.077+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14563514742029760386', time=2024-09-14T13:35:49.512699+0000, chain.objs.size()=1 2024-09-14T12:01:19.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.077+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.7yrEZ7d8GSPMNc547AKUGCOTCopFE4f_0 2024-09-14T12:01:19.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.078+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5940611143781199718', time=2024-09-14T13:35:50.060493+0000, chain.objs.size()=1 2024-09-14T12:01:19.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.078+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.6s6yYItuoFh-dUv54h-fpnYxXdMhcJx_0 2024-09-14T12:01:19.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.078+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.520171128903277062', time=2024-09-14T13:35:50.205187+0000, chain.objs.size()=1 2024-09-14T12:01:19.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.078+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ShO3mgd4f15hUax_wB4EK9Qvz-bhfhi_0 2024-09-14T12:01:19.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.078+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8053715629767537239', time=2024-09-14T13:35:50.250559+0000, chain.objs.size()=1 2024-09-14T12:01:19.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.078+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.SY-pNr5qlv44ozq9Eglc-KrOTrKDWYR_0 2024-09-14T12:01:19.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.078+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18425945456658722400', time=2024-09-14T13:35:51.141173+0000, chain.objs.size()=1 2024-09-14T12:01:19.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.078+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.7Z4d-hscuijL4W9ykW2sRAah1J4GNSs_0 2024-09-14T12:01:19.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.082+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16669071034508406223', time=2024-09-14T13:35:51.201865+0000, chain.objs.size()=1 2024-09-14T12:01:19.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.082+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.8SqiL4z3FmUkKMBYWAY0tuQ12paf3U__0 2024-09-14T12:01:19.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.082+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.960158499337451232', time=2024-09-14T13:35:51.329324+0000, chain.objs.size()=1 2024-09-14T12:01:19.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.082+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_._pLqYK354Zg5bEAnfpV8Jvco5PGrSOh_0 2024-09-14T12:01:19.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.082+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15253070984941496019', time=2024-09-14T13:35:51.336692+0000, chain.objs.size()=1 2024-09-14T12:01:19.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.082+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ZaDctJN-Nz3TKg-TL8nBOicVesIbzBn_0 2024-09-14T12:01:19.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.082+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16923804405055701264', time=2024-09-14T13:35:51.384020+0000, chain.objs.size()=1 2024-09-14T12:01:19.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.082+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Hiz0QJf9_gHS8lDdZuPgb0ZfVWHVXcF_0 2024-09-14T12:01:19.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.082+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13494678793223416272', time=2024-09-14T13:35:51.634745+0000, chain.objs.size()=1 2024-09-14T12:01:19.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.082+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.hEwXHEjtWFq2gMhqH-pGDZMi7T43-I__0 2024-09-14T12:01:19.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.082+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.131346517939667104', time=2024-09-14T13:35:51.959353+0000, chain.objs.size()=1 2024-09-14T12:01:19.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.082+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.uyg5RfBEK7cllzXIyFy9ZiVkJRfKXLY_0 2024-09-14T12:01:19.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.082+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1870876517387741464', time=2024-09-14T13:35:52.233710+0000, chain.objs.size()=1 2024-09-14T12:01:19.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.082+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.5-uqaxU8I0g_TH4rwqy0gbPf_fJNQmq_0 2024-09-14T12:01:19.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.082+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4997277004813770034', time=2024-09-14T13:35:52.351686+0000, chain.objs.size()=1 2024-09-14T12:01:19.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.082+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.RA4G95l2rRHyQBcp0rtSUtOC10Zj1Te_0 2024-09-14T12:01:19.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.082+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6002922703394196542', time=2024-09-14T13:35:52.417855+0000, chain.objs.size()=1 2024-09-14T12:01:19.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.082+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.7ln0dM_XOb0MnhqZzDItVk33LJDQoDe_0 2024-09-14T12:01:19.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.085+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/43845 2024-09-14T12:01:19.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-14T12:01:19.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9223403961596661360', time=2024-09-14T13:36:00.611607+0000, chain.objs.size()=1 2024-09-14T12:01:19.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.333__shadow_.IovyctBYmH0OBxtR2U3k2jonb4UAhc5_0 2024-09-14T12:01:19.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11375292604269111494', time=2024-09-14T13:36:13.602435+0000, chain.objs.size()=1 2024-09-14T12:01:19.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.345__shadow_.VJQ4wMfMSu1Y8vjCT9EXZPUN9aLcPp7_0 2024-09-14T12:01:19.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7568552791256162079', time=2024-09-14T13:36:46.323216+0000, chain.objs.size()=1 2024-09-14T12:01:19.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.378__shadow_.2nDjHauyq5tXqrYl5R2yI1MAQslTf4y_0 2024-09-14T12:01:19.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10633300192100627656', time=2024-09-14T13:38:04.199490+0000, chain.objs.size()=1 2024-09-14T12:01:19.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.448__shadow_.G7GZr5hRVV-4o_nclNeW_MEQVhRdwpP_0 2024-09-14T12:01:19.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7177824796953429254', time=2024-09-14T13:38:13.501737+0000, chain.objs.size()=1 2024-09-14T12:01:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.456__shadow_.bOKPtwa9mIeJM5bvifSpHz-qQQha8HW_0 2024-09-14T12:01:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8075285304708818159', time=2024-09-14T13:38:22.502647+0000, chain.objs.size()=1 2024-09-14T12:01:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.462__shadow_.HpTyCFjkkm5r61Jcvcuy_ZtsUsfyTlq_0 2024-09-14T12:01:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10021257067504474243', time=2024-09-14T13:38:44.075727+0000, chain.objs.size()=1 2024-09-14T12:01:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.485__shadow_.67NXZKpsnxJ7feRLUa-ed2N7UQQt9uw_0 2024-09-14T12:01:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1818243297784410079', time=2024-09-14T13:43:01.857035+0000, chain.objs.size()=1 2024-09-14T12:01:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.526__multipart_mymultipart.2~zwcKekAtNLvDw9e8pwXdwvHU_lkbvic.1 2024-09-14T12:01:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8853536711533115129', time=2024-09-14T13:45:44.069906+0000, chain.objs.size()=1 2024-09-14T12:01:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:mSHRVjlFyL.u0m2icApN7R6BiW-sAGa_.3S_2Souukk7kaBX5Cat53jmYLMmQM3j_0 2024-09-14T12:01:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2887007045478007073', time=2024-09-14T13:45:46.887462+0000, chain.objs.size()=1 2024-09-14T12:01:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:bVCdzPirlfFjL0JxwXnCtO-9Xi0-Ddo_.2gaBrnaSjMn0r725jNZkPAdjUVUrBxn_0 2024-09-14T12:01:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5091254025548304140', time=2024-09-14T13:45:56.589205+0000, chain.objs.size()=1 2024-09-14T12:01:19.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.575__shadow:oZ2qYZOzv.Z7oFAqfTwZt2QMzFg8lJu_.oX-2fl_QH-nkhTKBsY9pwAbMH-2TNaH_0 2024-09-14T12:01:19.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6871753606993625541', time=2024-09-14T13:46:14.368316+0000, chain.objs.size()=1 2024-09-14T12:01:19.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.088+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:QsH7plWU50jwi35K0.kUO.94lHelKE._.Lb0-MkuBKU-Dvn8oAZURHu1Ivkkixb2_0 2024-09-14T12:01:19.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.092+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5618107638986607296', time=2024-09-14T13:46:15.086162+0000, chain.objs.size()=1 2024-09-14T12:01:19.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.092+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:fZe4AsEqzDG.hMmM2KKDfleYPsdyV51_.QQGcHJ7TjXuaTjBtIIUe0QQBDvgxAGX_0 2024-09-14T12:01:19.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.092+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9150848197752066825', time=2024-09-14T13:46:19.714016+0000, chain.objs.size()=1 2024-09-14T12:01:19.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.092+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:29Hx71iZNXF1Uni1kJjgmfsw5TxJo-i_.40Y8cYqg90glJTPW9HjD-vSBuF3RGoF_0 2024-09-14T12:01:19.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.092+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15810739995069487778', time=2024-09-14T13:47:09.501459+0000, chain.objs.size()=1 2024-09-14T12:01:19.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.092+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.580__shadow:yt8Dow2Pzg4gL30PxQP9S1wEAb4zD8w_.G4MfRLUmLn_8Euydb5eBSUHKw_1Pp1v_0 2024-09-14T12:01:19.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.092+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11010733636020645810', time=2024-09-14T13:51:42.797578+0000, chain.objs.size()=1 2024-09-14T12:01:19.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.092+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.619__shadow_.g8laLkg7jeVSUvUHKiisCX2aFMGrony_0 2024-09-14T12:01:19.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.092+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~c2-Jkx7HDm0fjUl-UiRsiPeFFMpVy4t', time=2024-09-14T13:52:28.252651+0000, chain.objs.size()=6 2024-09-14T12:01:19.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.092+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.625__multipart_multipart_enc.2~c2-Jkx7HDm0fjUl-UiRsiPeFFMpVy4t.1 2024-09-14T12:01:19.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.092+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.625__multipart_multipart_enc.2~c2-Jkx7HDm0fjUl-UiRsiPeFFMpVy4t.2 2024-09-14T12:01:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.092+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.625__multipart_multipart_enc.2~c2-Jkx7HDm0fjUl-UiRsiPeFFMpVy4t.3 2024-09-14T12:01:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.092+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.625__multipart_multipart_enc.2~c2-Jkx7HDm0fjUl-UiRsiPeFFMpVy4t.4 2024-09-14T12:01:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.092+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.625__multipart_multipart_enc.2~c2-Jkx7HDm0fjUl-UiRsiPeFFMpVy4t.5 2024-09-14T12:01:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.092+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.625__multipart_multipart_enc.2~c2-Jkx7HDm0fjUl-UiRsiPeFFMpVy4t.6 2024-09-14T12:01:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.092+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~3GABAaozn6qPlvdJeguBx90WLvpC9Gb', time=2024-09-14T13:52:37.604133+0000, chain.objs.size()=6 2024-09-14T12:01:19.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.092+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.626__multipart_multipart_enc.2~3GABAaozn6qPlvdJeguBx90WLvpC9Gb.1 2024-09-14T12:01:19.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.095+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.626__multipart_multipart_enc.2~3GABAaozn6qPlvdJeguBx90WLvpC9Gb.2 2024-09-14T12:01:19.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.095+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.626__multipart_multipart_enc.2~3GABAaozn6qPlvdJeguBx90WLvpC9Gb.3 2024-09-14T12:01:19.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.095+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.626__multipart_multipart_enc.2~3GABAaozn6qPlvdJeguBx90WLvpC9Gb.4 2024-09-14T12:01:19.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.095+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.626__multipart_multipart_enc.2~3GABAaozn6qPlvdJeguBx90WLvpC9Gb.5 2024-09-14T12:01:19.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.097+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.626__multipart_multipart_enc.2~3GABAaozn6qPlvdJeguBx90WLvpC9Gb.6 2024-09-14T12:01:19.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.099+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11856797330378615292', time=2024-09-14T13:52:52.359979+0000, chain.objs.size()=1 2024-09-14T12:01:19.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.099+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.640__shadow_.QcJRRrWXSmWNE54wrZeZOmhJK6VRpRq_0 2024-09-14T12:01:19.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.099+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3522801005390676176', time=2024-09-14T13:53:59.328665+0000, chain.objs.size()=1 2024-09-14T12:01:19.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.099+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.667__shadow_.bFgJ6VmVPyxqkj6aS8CqGuPz_zEHfHK_0 2024-09-14T12:01:19.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.099+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1337298244652998941', time=2024-09-14T13:55:35.127451+0000, chain.objs.size()=10 2024-09-14T12:01:19.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.099+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.736__multipart_foo.2~AJq6dHaBYDeMi2C06QZjOrrlOgk-heV.1 2024-09-14T12:01:19.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.099+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.736__multipart_foo.2~AJq6dHaBYDeMi2C06QZjOrrlOgk-heV.2 2024-09-14T12:01:19.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.101+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.736__multipart_foo.2~AJq6dHaBYDeMi2C06QZjOrrlOgk-heV.3 2024-09-14T12:01:19.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.101+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.736__multipart_foo.2~AJq6dHaBYDeMi2C06QZjOrrlOgk-heV.4 2024-09-14T12:01:19.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.102+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.736__multipart_foo.2~AJq6dHaBYDeMi2C06QZjOrrlOgk-heV.5 2024-09-14T12:01:19.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.102+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.736__multipart_foo.2~AJq6dHaBYDeMi2C06QZjOrrlOgk-heV.6 2024-09-14T12:01:19.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.102+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.736__multipart_foo.2~AJq6dHaBYDeMi2C06QZjOrrlOgk-heV.7 2024-09-14T12:01:19.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.102+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.736__multipart_foo.2~AJq6dHaBYDeMi2C06QZjOrrlOgk-heV.8 2024-09-14T12:01:19.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.102+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.736__multipart_foo.2~AJq6dHaBYDeMi2C06QZjOrrlOgk-heV.9 2024-09-14T12:01:19.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.105+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.736__multipart_foo.2~AJq6dHaBYDeMi2C06QZjOrrlOgk-heV.10 2024-09-14T12:01:19.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.105+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10157948479994445090', time=2024-09-14T13:57:03.061977+0000, chain.objs.size()=1 2024-09-14T12:01:19.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.105+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.756__shadow_._NBw3KsZ61h-S2r9US-JlE992ipCwOK_0 2024-09-14T12:01:19.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.105+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3563245164894572260', time=2024-09-14T13:58:11.077994+0000, chain.objs.size()=1 2024-09-14T12:01:19.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.105+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.771__shadow_.yy5lMY2K4gRnXPF_ojUS7ns4ljnOnYI_0 2024-09-14T12:01:19.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.108+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:19.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.110+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T12:01:19.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.111+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:19.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.112+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:19.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.112+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47320' 2024-09-14T12:01:19.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.112+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='_Vm_E3rPLhYAsUjepFNwVYdy_k-QmTm3', time=2024-09-14T13:28:20.453003+0000, chain.objs.size()=2 2024-09-14T12:01:19.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.112+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.162__shadow_.vykXcq0G4yxTBLdOIjOvXvcQBuDgYY1_0 2024-09-14T12:01:19.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.112+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.162__shadow_.vykXcq0G4yxTBLdOIjOvXvcQBuDgYY1_1 2024-09-14T12:01:19.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.113+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='_7gQv6WNvsSzRzIu9pV9FrnXAjNJ4kmM', time=2024-09-14T13:28:29.236093+0000, chain.objs.size()=1 2024-09-14T12:01:19.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.113+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.162__shadow_.XAZWjb3P7IddDJ5xJogM24C6mAzdJZX_0 2024-09-14T12:01:19.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.113+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10858425308175456219', time=2024-09-14T13:28:41.801527+0000, chain.objs.size()=2 2024-09-14T12:01:19.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.113+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.165__multipart_foo.2~ATyUyQ0O6eeN9rrB-I_ZmoenDp7DGwA.1 2024-09-14T12:01:19.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.113+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.165__multipart_foo.2~ATyUyQ0O6eeN9rrB-I_ZmoenDp7DGwA.2 2024-09-14T12:01:19.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.113+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14107581476350954690', time=2024-09-14T13:28:42.894680+0000, chain.objs.size()=1 2024-09-14T12:01:19.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.113+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.167__shadow_.rcT45KO9nrYWqtrsDjsAWhbJlJ8Hump_0 2024-09-14T12:01:19.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.113+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5448424819137832982', time=2024-09-14T13:31:46.909783+0000, chain.objs.size()=1 2024-09-14T12:01:19.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.113+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.243__shadow_.MUXrjBX5_0IreULpjd9cvU8sfaiz_vt_0 2024-09-14T12:01:19.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.113+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13363385221907434689', time=2024-09-14T13:31:59.523265+0000, chain.objs.size()=1 2024-09-14T12:01:19.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.113+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.253__shadow_.nyx_MKto9IJoROkQzelZAX7r-lt69mv_0 2024-09-14T12:01:19.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.113+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8737106688790884489', time=2024-09-14T13:32:47.381471+0000, chain.objs.size()=1 2024-09-14T12:01:19.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.113+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.F0S_mXWI-mhgmr4hzpczXB-chR_cXO__0 2024-09-14T12:01:19.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.113+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17198980483109001014', time=2024-09-14T13:32:47.393761+0000, chain.objs.size()=1 2024-09-14T12:01:19.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.113+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.k8omTaKWtczNd1b9erWhi6i9k_pE1Pw_0 2024-09-14T12:01:19.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.113+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14002700730373167979', time=2024-09-14T13:32:47.454755+0000, chain.objs.size()=1 2024-09-14T12:01:19.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.113+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.fTj89G6qTgSNs3O21gwOIxvQjpENtl1_0 2024-09-14T12:01:19.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.113+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2972973236682226093', time=2024-09-14T13:32:47.455637+0000, chain.objs.size()=1 2024-09-14T12:01:19.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.113+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.4DvIhEsgSsMgaDglMRRpXJzsCXD4IDz_0 2024-09-14T12:01:19.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.117+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16482778372404878243', time=2024-09-14T13:32:47.722522+0000, chain.objs.size()=1 2024-09-14T12:01:19.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.117+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.MR9aB0mlpK6OA82Xxrxm533UDPOlZZ0_0 2024-09-14T12:01:19.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.117+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13753406241880985872', time=2024-09-14T13:32:47.884558+0000, chain.objs.size()=1 2024-09-14T12:01:19.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.117+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.rZDTDGy_Vlf3pIQe7tquNqrA_Bt2bnv_0 2024-09-14T12:01:19.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.117+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4756692694406976053', time=2024-09-14T13:32:47.885380+0000, chain.objs.size()=1 2024-09-14T12:01:19.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.117+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.gom71NpJC2P-lVxTSAkcBQh9qcqlS4f_0 2024-09-14T12:01:19.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.117+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11944698032941023414', time=2024-09-14T13:32:47.926846+0000, chain.objs.size()=1 2024-09-14T12:01:19.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.117+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.HXDpgSKzvFy7BFo1qF3uSUfWcADzsU9_0 2024-09-14T12:01:19.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.117+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4699679059214358150', time=2024-09-14T13:32:48.429421+0000, chain.objs.size()=1 2024-09-14T12:01:19.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.117+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Zrn2ZQgY5JGSfmY3y-HUXHaV6zPEjry_0 2024-09-14T12:01:19.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.117+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3354081159105084728', time=2024-09-14T13:32:49.479663+0000, chain.objs.size()=1 2024-09-14T12:01:19.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.117+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Vb3TFTeuZqjoBeoxkGXv0BOXclQeXSz_0 2024-09-14T12:01:19.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.117+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10959505824466376128', time=2024-09-14T13:32:49.480497+0000, chain.objs.size()=1 2024-09-14T12:01:19.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.117+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.XgcqNDU_oC9z18LN49KK_AtUkKUKpbM_0 2024-09-14T12:01:19.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.117+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.346448600854602845', time=2024-09-14T13:32:49.942821+0000, chain.objs.size()=1 2024-09-14T12:01:19.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.117+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.xdgIHsbTBT940AuGqlRGqfDXhu759yE_0 2024-09-14T12:01:19.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.117+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14214717162229522633', time=2024-09-14T13:32:50.041940+0000, chain.objs.size()=1 2024-09-14T12:01:19.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.117+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.a4kSWX_K6Q7hRYDFK1UOcCVn8h-QWTq_0 2024-09-14T12:01:19.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.117+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16257083981877414851', time=2024-09-14T13:32:50.574941+0000, chain.objs.size()=1 2024-09-14T12:01:19.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.117+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.DWX-pvFVcWl8sff2zkjlk9m7YPPz0wl_0 2024-09-14T12:01:19.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.117+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14594095062582344538', time=2024-09-14T13:32:50.696266+0000, chain.objs.size()=1 2024-09-14T12:01:19.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.117+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ovhL5t3PzYfgbzbtoyZRwrw3VO9CidC_0 2024-09-14T12:01:19.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.119+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16718383720191092840', time=2024-09-14T13:32:51.088430+0000, chain.objs.size()=1 2024-09-14T12:01:19.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.119+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.iClnP_0sL8RoiwKvUsLb2yEg-jqLtmb_0 2024-09-14T12:01:19.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.120+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16143343091415122472', time=2024-09-14T13:32:51.605166+0000, chain.objs.size()=1 2024-09-14T12:01:19.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.120+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.qIQNeah3Voc5J1h1TsXQ8HCeEmp_WuA_0 2024-09-14T12:01:19.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.121+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.532310008359627112', time=2024-09-14T13:32:52.532423+0000, chain.objs.size()=1 2024-09-14T12:01:19.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.121+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.zckE_TbdCSEtE0ePq0vE1k2H2X0vwmT_0 2024-09-14T12:01:19.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.121+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5974697394116036581', time=2024-09-14T13:32:53.102741+0000, chain.objs.size()=1 2024-09-14T12:01:19.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.121+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.uTCnuI9XqVpAmigCHlws67krCllABJ5_0 2024-09-14T12:01:19.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.121+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15882839872485365883', time=2024-09-14T13:32:54.096323+0000, chain.objs.size()=1 2024-09-14T12:01:19.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.121+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.lYSHF0wNHyJqfIcymKy7zReR879_3uf_0 2024-09-14T12:01:19.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.121+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2025720862878037257', time=2024-09-14T13:32:54.097158+0000, chain.objs.size()=1 2024-09-14T12:01:19.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.121+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.thvqg1__9cIZqw3FkNQMfAV6MgbP-Y5_0 2024-09-14T12:01:19.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.121+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15340296670128980398', time=2024-09-14T13:32:54.558783+0000, chain.objs.size()=1 2024-09-14T12:01:19.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.121+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.6zYThAts4ZnL4lJDwN75rmx0lMWI5i2_0 2024-09-14T12:01:19.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.122+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11875294982299189863', time=2024-09-14T13:32:54.983002+0000, chain.objs.size()=1 2024-09-14T12:01:19.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.122+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_._vU3FdEpEg_DdIl4Mq0ecQOT_lW5f1N_0 2024-09-14T12:01:19.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.124+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14313433235424028775', time=2024-09-14T13:32:55.109200+0000, chain.objs.size()=1 2024-09-14T12:01:19.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.124+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.2prEhGe8SoR1Ld7caYQlLhvdY8sL5lq_0 2024-09-14T12:01:19.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.124+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5412991959316354362', time=2024-09-14T13:32:55.377914+0000, chain.objs.size()=1 2024-09-14T12:01:19.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.124+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.YL0beUBXKdiXEfDt7nwZU7WKHbEr2v4_0 2024-09-14T12:01:19.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.124+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508554938172218106', time=2024-09-14T13:32:55.462748+0000, chain.objs.size()=1 2024-09-14T12:01:19.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.124+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.jVOWWn8TEcPe0N1HSNUcB_SsbKEFacS_0 2024-09-14T12:01:19.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.124+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7264320149449304710', time=2024-09-14T13:32:55.567620+0000, chain.objs.size()=1 2024-09-14T12:01:19.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.124+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.SfO5b-r3NipkLFXnVIGEHVGQXpDDinx_0 2024-09-14T12:01:19.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.124+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17633746030096349224', time=2024-09-14T13:32:56.352317+0000, chain.objs.size()=1 2024-09-14T12:01:19.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.124+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.axBVNjyIzRDU0DezAWflx-8UyNDqh-x_0 2024-09-14T12:01:19.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.124+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13852294267584280984', time=2024-09-14T13:32:56.352884+0000, chain.objs.size()=1 2024-09-14T12:01:19.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.124+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.odmgbrPWUZu5BGI-WGL3v_G6LIYG07X_0 2024-09-14T12:01:19.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.126+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17639112088263600476', time=2024-09-14T13:32:57.124127+0000, chain.objs.size()=1 2024-09-14T12:01:19.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.126+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.lN6INZvyaQUHPjzMAY2UzXUbPXwYCNL_0 2024-09-14T12:01:19.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.126+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17105993414985840813', time=2024-09-14T13:32:57.443638+0000, chain.objs.size()=1 2024-09-14T12:01:19.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.126+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.5ovIwOzO0PQLO-ynVmbr7cd6B98UZde_0 2024-09-14T12:01:19.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.126+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1340830603723343529', time=2024-09-14T13:32:57.471974+0000, chain.objs.size()=1 2024-09-14T12:01:19.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.126+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.7IzKTVNY6Hjm5DCZxKxdAJqbTeG_n8R_0 2024-09-14T12:01:19.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.126+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4570851810563764300', time=2024-09-14T13:32:57.999968+0000, chain.objs.size()=1 2024-09-14T12:01:19.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.126+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.xgnYjsSmjk6wJEmBPJolOiOhWHdvPLT_0 2024-09-14T12:01:19.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.126+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10380155812973603123', time=2024-09-14T13:32:58.081942+0000, chain.objs.size()=1 2024-09-14T12:01:19.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.126+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.UzKcsCsb98Ik68CzpyaSEFgc4I_h2M3_0 2024-09-14T12:01:19.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.126+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1146944654897594965', time=2024-09-14T13:33:09.524523+0000, chain.objs.size()=1 2024-09-14T12:01:19.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.126+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.273__shadow_.N6onbGrH7sqxP4VbARTTC9oYYVNweun_0 2024-09-14T12:01:19.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.126+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5017188912485255862', time=2024-09-14T13:33:35.639360+0000, chain.objs.size()=1 2024-09-14T12:01:19.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.126+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.G4cwRHtMwfS9zOzhKcGaDaoYVvmQppo_0 2024-09-14T12:01:19.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.127+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.131981377056119747', time=2024-09-14T13:33:35.646216+0000, chain.objs.size()=1 2024-09-14T12:01:19.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.127+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.U4LhVwSzVLqdm7JwVuqUCAq5BDqOQC4_0 2024-09-14T12:01:19.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.127+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16438140988483699098', time=2024-09-14T13:33:52.163874+0000, chain.objs.size()=1 2024-09-14T12:01:19.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.127+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.308__shadow:r1He7sBjhRCB5s7ZhBDcrrMo0j99RtL_.oklzQukyAbjkj3ux-byAiFRO2GNM3rQ_0 2024-09-14T12:01:19.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.127+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7014298704136242603', time=2024-09-14T13:34:51.508318+0000, chain.objs.size()=1 2024-09-14T12:01:19.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.127+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.1iRFwgtpmjtN_393VQTMGI5cKAFHA-W_0 2024-09-14T12:01:19.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.127+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.540400862346839596', time=2024-09-14T13:34:52.151741+0000, chain.objs.size()=1 2024-09-14T12:01:19.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.127+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.YlvcRl7tN9MTn5KN6iBEkXsyfVHPOa5_0 2024-09-14T12:01:19.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.129+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5726831528152813108', time=2024-09-14T13:34:52.577344+0000, chain.objs.size()=1 2024-09-14T12:01:19.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.129+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.YSC4GoO6FQnOOXQy-_FSJyYxZeImJm8_0 2024-09-14T12:01:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.130+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5439576301220763050', time=2024-09-14T13:34:53.094104+0000, chain.objs.size()=1 2024-09-14T12:01:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.130+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.0vcCaMK8CImJh-M-1nOv0FpnGeXUq6V_0 2024-09-14T12:01:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.130+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14334785336356914000', time=2024-09-14T13:34:53.158282+0000, chain.objs.size()=1 2024-09-14T12:01:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.130+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.xrLL7yQ96TZieYezUgh6vuWTDPfzH6l_0 2024-09-14T12:01:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.130+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7556060609320251763', time=2024-09-14T13:34:53.293712+0000, chain.objs.size()=1 2024-09-14T12:01:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.130+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.7ILJVHdIPG-Ax5uA1AzD4OuDsocmAdi_0 2024-09-14T12:01:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.130+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7340199887510236106', time=2024-09-14T13:34:53.535441+0000, chain.objs.size()=1 2024-09-14T12:01:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.130+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.XmSyIoZ7wem0qaXTTUjYWfXQuf_y3q2_0 2024-09-14T12:01:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.130+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9568195072209010744', time=2024-09-14T13:34:53.769363+0000, chain.objs.size()=1 2024-09-14T12:01:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.130+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.snfJWEq7Mm0pnfYPf6tZ30bwL5EtqO-_0 2024-09-14T12:01:19.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.131+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2518535926261565586', time=2024-09-14T13:34:53.883171+0000, chain.objs.size()=1 2024-09-14T12:01:19.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.131+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.0KaVLthwEpspZC7CYbPpZ06w7UGiQLD_0 2024-09-14T12:01:19.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.131+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5653266142740195642', time=2024-09-14T13:34:53.935214+0000, chain.objs.size()=1 2024-09-14T12:01:19.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.131+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.aI2lTClmn2E9REWwn_DCe0vIttkTqq8_0 2024-09-14T12:01:19.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.131+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4362828602112503911', time=2024-09-14T13:34:54.016299+0000, chain.objs.size()=1 2024-09-14T12:01:19.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.131+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.avw_3_BCd6zyTKTa7PPPQtHdixChO_m_0 2024-09-14T12:01:19.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.132+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2227878392886621426', time=2024-09-14T13:34:54.975885+0000, chain.objs.size()=1 2024-09-14T12:01:19.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.132+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.xE120KMVIr13mDDVNM5sevA2Mij3bwM_0 2024-09-14T12:01:19.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.132+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5813109276575269721', time=2024-09-14T13:34:54.987036+0000, chain.objs.size()=1 2024-09-14T12:01:19.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.132+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ZBNsQDPmPWM8ySeEj367r_B8JBD0-h9_0 2024-09-14T12:01:19.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.134+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2359068529843284264', time=2024-09-14T13:34:57.226889+0000, chain.objs.size()=1 2024-09-14T12:01:19.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.134+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.mX7LeSgcsC877ZgUE1lrzqq4fI99Efc_0 2024-09-14T12:01:19.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.134+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4704704313354702402', time=2024-09-14T13:34:57.777274+0000, chain.objs.size()=1 2024-09-14T12:01:19.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.134+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.8cLNJkiAGGtgKUOOMl0ILDnqSjQ4mgn_0 2024-09-14T12:01:19.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.134+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12844918600621312264', time=2024-09-14T13:34:58.330767+0000, chain.objs.size()=1 2024-09-14T12:01:19.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.134+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.6IZA7Zrz9IoGlzJ0oTuJypCbWvLcoeO_0 2024-09-14T12:01:19.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.136+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9109731185553703622', time=2024-09-14T13:34:58.432703+0000, chain.objs.size()=1 2024-09-14T12:01:19.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.136+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.iRzGFbKxDDO6knELPuV8ZlrpZTg0PZl_0 2024-09-14T12:01:19.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.136+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17192267740292592150', time=2024-09-14T13:34:58.597975+0000, chain.objs.size()=1 2024-09-14T12:01:19.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.136+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.CT5nTZuNFX9dR_7vEhBpGM8m64SoUeS_0 2024-09-14T12:01:19.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.136+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12680397656744201609', time=2024-09-14T13:34:59.528965+0000, chain.objs.size()=1 2024-09-14T12:01:19.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.136+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.hdTFkXxLBWvnZNHZbClN-3lkOxMY3NP_0 2024-09-14T12:01:19.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.136+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10828396601031781424', time=2024-09-14T13:34:59.764985+0000, chain.objs.size()=1 2024-09-14T12:01:19.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.136+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.OGRERC6i3YHDeNVH11RAN4JNdUM0SMv_0 2024-09-14T12:01:19.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.137+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5310686583929491884', time=2024-09-14T13:35:00.094510+0000, chain.objs.size()=1 2024-09-14T12:01:19.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.137+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.sU38X1RCKAUrJReeQFDAtO5zVCoA52R_0 2024-09-14T12:01:19.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.138+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8242551896635271870', time=2024-09-14T13:35:00.962766+0000, chain.objs.size()=1 2024-09-14T12:01:19.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.138+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.dNH8LhuHrPRF4Zjnb2cV4svmvWKBGIK_0 2024-09-14T12:01:19.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.138+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10062226378916681012', time=2024-09-14T13:35:01.229348+0000, chain.objs.size()=1 2024-09-14T12:01:19.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.138+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.zO9DGqby-WVLpJRs0zDAwASSdeF_sJB_0 2024-09-14T12:01:19.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.138+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293334989694919460', time=2024-09-14T13:35:01.446671+0000, chain.objs.size()=1 2024-09-14T12:01:19.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.138+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.4MV53bP4KmwCQ9h4IaHNulibaReZyX1_0 2024-09-14T12:01:19.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.138+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13904514084760391251', time=2024-09-14T13:35:01.780126+0000, chain.objs.size()=1 2024-09-14T12:01:19.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.138+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.kyzV1DsOHQSzBXSFYvbwl2Ybvefyiy4_0 2024-09-14T12:01:19.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.138+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4123827366762249229', time=2024-09-14T13:35:02.321172+0000, chain.objs.size()=1 2024-09-14T12:01:19.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.138+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.5liR5GK61nIUi4SZEefLDjXG3pHbQPq_0 2024-09-14T12:01:19.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.138+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4824525585059994647', time=2024-09-14T13:35:02.394003+0000, chain.objs.size()=1 2024-09-14T12:01:19.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.138+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.yDH90VxuFQ0mjsYof7iJ72wKQV6kEYZ_0 2024-09-14T12:01:19.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.140+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14034041062073621514', time=2024-09-14T13:35:02.442756+0000, chain.objs.size()=1 2024-09-14T12:01:19.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.140+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.IFDJEyfRCPlqg1656vjtlIGwto1Bs4Y_0 2024-09-14T12:01:19.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.140+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5984195006930078899', time=2024-09-14T13:35:41.659529+0000, chain.objs.size()=1 2024-09-14T12:01:19.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.140+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.VOklPNYHSaxEQatxxE1yTk3Mp543--Z_0 2024-09-14T12:01:19.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.142+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6185436797647927131', time=2024-09-14T13:35:41.765832+0000, chain.objs.size()=1 2024-09-14T12:01:19.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.142+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.v1jJHMDMH9n3UTO45C0wduyCdAzRwG9_0 2024-09-14T12:01:19.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.142+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14868236923744916341', time=2024-09-14T13:35:41.886773+0000, chain.objs.size()=1 2024-09-14T12:01:19.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.142+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.x082B8Hd_dE3KO2v1fpG8ms6W1dC-cr_0 2024-09-14T12:01:19.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.142+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15720522663508251934', time=2024-09-14T13:35:42.231223+0000, chain.objs.size()=1 2024-09-14T12:01:19.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.142+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.5LWKRE8eTdhwXeGXx-UaPpZRU0v9U5d_0 2024-09-14T12:01:19.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.142+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15433867673690351253', time=2024-09-14T13:35:43.695202+0000, chain.objs.size()=1 2024-09-14T12:01:19.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.142+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.l4_CyZzUg10rw1pV-2H4lGR3AWxDLDR_0 2024-09-14T12:01:19.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.142+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17269438476168434415', time=2024-09-14T13:35:43.923277+0000, chain.objs.size()=1 2024-09-14T12:01:19.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.142+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.YCokcyHnPHNDTDdUNRNOQ3QjOk7Ty6H_0 2024-09-14T12:01:19.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.142+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11301696565435044712', time=2024-09-14T13:35:43.965754+0000, chain.objs.size()=1 2024-09-14T12:01:19.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.142+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.pZp2HkGfq9fFx9jvlvJ7G8qmZH0IxJa_0 2024-09-14T12:01:19.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.142+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15437639049561131547', time=2024-09-14T13:35:44.069477+0000, chain.objs.size()=1 2024-09-14T12:01:19.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.142+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.iemxpvOP85pFVobKTzbyLG8_d23y-kr_0 2024-09-14T12:01:19.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.142+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8407054097128411935', time=2024-09-14T13:35:44.813497+0000, chain.objs.size()=1 2024-09-14T12:01:19.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.142+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.kv0r4q5vovIzVzK6ZM9uSWfuT4rV-HJ_0 2024-09-14T12:01:19.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.142+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.966544536467427041', time=2024-09-14T13:35:44.994410+0000, chain.objs.size()=1 2024-09-14T12:01:19.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.142+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.otgxM3NctC-Rx-4N3nqFXMBQ-zd5wVl_0 2024-09-14T12:01:19.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.143+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5241265711181398886', time=2024-09-14T13:35:45.582062+0000, chain.objs.size()=1 2024-09-14T12:01:19.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.143+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.JNB3eOrHJ5p3cpvrT8hxWWm78mj3Z5Y_0 2024-09-14T12:01:19.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.143+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2815787370515351855', time=2024-09-14T13:35:46.955776+0000, chain.objs.size()=1 2024-09-14T12:01:19.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.143+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.XDoWDkofyN3FlslkAZdQ6_2Qr2lp35w_0 2024-09-14T12:01:19.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.147+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5871359466151297231', time=2024-09-14T13:35:47.736072+0000, chain.objs.size()=1 2024-09-14T12:01:19.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.147+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.s2HmcmI-RQTBgjkhGfduwIICAEL7prI_0 2024-09-14T12:01:19.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.147+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10084076362797107922', time=2024-09-14T13:35:47.739550+0000, chain.objs.size()=1 2024-09-14T12:01:19.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.147+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.qFrayrMd8-QEsM94NIyp3gqu7BvqzC1_0 2024-09-14T12:01:19.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.147+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17126608581810724593', time=2024-09-14T13:35:47.770784+0000, chain.objs.size()=1 2024-09-14T12:01:19.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.147+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.98-8pNjR5SxEGYO6IQUGAPcqHrN2OfY_0 2024-09-14T12:01:19.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.147+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17983447668932342241', time=2024-09-14T13:35:47.801787+0000, chain.objs.size()=1 2024-09-14T12:01:19.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.147+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.wR9yiLr6mZDCVM9BcukDWRj5H5MRDVS_0 2024-09-14T12:01:19.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.147+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5708717383305653442', time=2024-09-14T13:35:48.083934+0000, chain.objs.size()=1 2024-09-14T12:01:19.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.147+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.DtSNFdj2OTMtzXD6VD2mq9XmUBCC_1E_0 2024-09-14T12:01:19.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.147+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15244026376610545398', time=2024-09-14T13:35:48.459569+0000, chain.objs.size()=1 2024-09-14T12:01:19.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.147+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.PhFV5UvC5Pnv8JcIguvejI7Agl8xa1x_0 2024-09-14T12:01:19.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.147+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5553583275579200747', time=2024-09-14T13:35:48.733809+0000, chain.objs.size()=1 2024-09-14T12:01:19.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.147+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.vSqH9xT9mcFOwxDsye8hV-rDVQPFw4w_0 2024-09-14T12:01:19.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.148+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7085609989320722348', time=2024-09-14T13:35:49.413508+0000, chain.objs.size()=1 2024-09-14T12:01:19.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.148+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.jZn7j-_IWcjvC23XbC83I7WPAs_upq4_0 2024-09-14T12:01:19.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.148+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6187197120949355691', time=2024-09-14T13:35:49.478950+0000, chain.objs.size()=1 2024-09-14T12:01:19.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.148+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.DOhhUtR8o0HX1J3SpE98XsrhzjxBXKa_0 2024-09-14T12:01:19.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.148+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12964842971675852586', time=2024-09-14T13:35:49.650364+0000, chain.objs.size()=1 2024-09-14T12:01:19.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.148+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.XdcVNlAUAnNnCe8VcwcYUjqGCWiTDM4_0 2024-09-14T12:01:19.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.148+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17040829049198396686', time=2024-09-14T13:35:50.858315+0000, chain.objs.size()=1 2024-09-14T12:01:19.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.148+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.xGL19J8B9bs5XliyGZ8yid7y6c4gUo7_0 2024-09-14T12:01:19.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.151+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4122138389868353882', time=2024-09-14T13:35:51.288042+0000, chain.objs.size()=1 2024-09-14T12:01:19.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.151+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.lMEXzQDJVhCQrbp0-0VaS9yce7D73QQ_0 2024-09-14T12:01:19.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.151+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10730393087815135177', time=2024-09-14T13:35:51.480971+0000, chain.objs.size()=1 2024-09-14T12:01:19.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.151+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.WSzu9QZACbfYwsV8bhDYXmq8T0SVqTB_0 2024-09-14T12:01:19.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.151+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1322999054903312298', time=2024-09-14T13:35:52.076319+0000, chain.objs.size()=1 2024-09-14T12:01:19.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.151+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.GfdUcFsQFhxTy3mvuqwcU6M5YtW5kHH_0 2024-09-14T12:01:19.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.151+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1354553301271389616', time=2024-09-14T13:35:52.235958+0000, chain.objs.size()=1 2024-09-14T12:01:19.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.151+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.V0gHze89HwPIR3faJb2n1R3XRlZPU4X_0 2024-09-14T12:01:19.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.153+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2310243294550955464', time=2024-09-14T13:35:52.344060+0000, chain.objs.size()=1 2024-09-14T12:01:19.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.153+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.xFS8u3cHdVJ9u0nXDtqthVzREoIeipU_0 2024-09-14T12:01:19.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.155+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/47320 2024-09-14T12:01:19.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.158+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T12:01:19.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.158+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3140171072086676103', time=2024-09-14T13:35:52.783534+0000, chain.objs.size()=1 2024-09-14T12:01:19.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.158+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.hK25GvDp_DFPJOaidVZ20IZWGZChKFS_0 2024-09-14T12:01:19.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.158+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13177768479129020712', time=2024-09-14T13:36:53.163898+0000, chain.objs.size()=1 2024-09-14T12:01:19.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.158+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.384__shadow_.gZwnvuXUHTl_3-gPjbRJlPBuOdgfrDx_0 2024-09-14T12:01:19.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.158+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18134157410325220514', time=2024-09-14T13:37:54.952029+0000, chain.objs.size()=1 2024-09-14T12:01:19.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.158+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.441__shadow_.B6I3D8A8ODCRuRBPVnxDj2e0uciig7p_0 2024-09-14T12:01:19.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.158+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5104767438439703112', time=2024-09-14T13:38:12.001164+0000, chain.objs.size()=1 2024-09-14T12:01:19.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.158+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.455__shadow_.qxFhB7ivRpm1uzbvdOjuwKoZ0yKfDLM_0 2024-09-14T12:01:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.158+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.801344449867022430', time=2024-09-14T13:38:20.994238+0000, chain.objs.size()=1 2024-09-14T12:01:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.158+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.461__shadow_.SAwQJZ5-0Qf3khRtxdPoChPHcQjVOfb_0 2024-09-14T12:01:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.158+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2688080945301271796', time=2024-09-14T13:38:24.044294+0000, chain.objs.size()=1 2024-09-14T12:01:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.158+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.463__shadow_.ZU-V7HDiNoedkMWfIuDLcPfM6NTG0Fa_0 2024-09-14T12:01:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.158+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8087232798924796849', time=2024-09-14T13:39:35.040454+0000, chain.objs.size()=6 2024-09-14T12:01:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.158+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.1 2024-09-14T12:01:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.158+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.2 2024-09-14T12:01:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.158+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.3 2024-09-14T12:01:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.158+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.4 2024-09-14T12:01:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.158+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.5 2024-09-14T12:01:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.158+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508__multipart_srcmultipart.2~q2PEgmm1pCEhny-iiDhIa-DuW8-eoBa.6 2024-09-14T12:01:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.161+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6021121021669111996', time=2024-09-14T13:40:45.087695+0000, chain.objs.size()=3 2024-09-14T12:01:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.161+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.521__shadow:BDGrFUPGqRK6Ou.KrYbHjlK5JdlP-h5_.9uoKtNaaBIUCJYTtwYGjGBxjM387Dwn_0 2024-09-14T12:01:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.162+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.521__shadow:BDGrFUPGqRK6Ou.KrYbHjlK5JdlP-h5_.9uoKtNaaBIUCJYTtwYGjGBxjM387Dwn_1 2024-09-14T12:01:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.162+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.521__shadow:BDGrFUPGqRK6Ou.KrYbHjlK5JdlP-h5_.9uoKtNaaBIUCJYTtwYGjGBxjM387Dwn_2 2024-09-14T12:01:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.162+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13064001122871128755', time=2024-09-14T13:42:48.022583+0000, chain.objs.size()=2 2024-09-14T12:01:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.162+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.524__multipart_mymultipart.2~zzQxjSTpYFZWw1tyuFrbd-X6kkGh9N3.1 2024-09-14T12:01:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.162+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.524__multipart_mymultipart.2~zzQxjSTpYFZWw1tyuFrbd-X6kkGh9N3.2 2024-09-14T12:01:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.162+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.133359445276914307', time=2024-09-14T13:45:41.029589+0000, chain.objs.size()=1 2024-09-14T12:01:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.162+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:k.3dKNVQBuXnOGuIK62EPVmfDPvu6fM_.TOIhOeaup6xIusRhgXCAHWC9cfxRsgR_0 2024-09-14T12:01:19.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.162+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7168688318553082487', time=2024-09-14T13:46:27.053944+0000, chain.objs.size()=1 2024-09-14T12:01:19.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.162+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:7jEiHxLVAaK4YSbnFooiRO5qBnB6XzR_.GV5p9h78NI0eN0Iv2ofwJUQ6POpnFJh_0 2024-09-14T12:01:19.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.162+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6264456902931498407', time=2024-09-14T13:54:03.959531+0000, chain.objs.size()=1 2024-09-14T12:01:19.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.162+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.673__shadow_.prer_lu4VZRQwmr0xOf23WfSU4mQAH0_0 2024-09-14T12:01:19.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.162+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15927301953797049379', time=2024-09-14T13:54:39.140551+0000, chain.objs.size()=1 2024-09-14T12:01:19.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.162+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.709__shadow:XAK4emEkV70f5UC1-CWu2PlKqZKE4nO_.IjU8Rxqm1Lq3Skt_sB45VFzHvv6JD5S_0 2024-09-14T12:01:19.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.162+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6855322730984140342', time=2024-09-14T13:54:41.139412+0000, chain.objs.size()=1 2024-09-14T12:01:19.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.162+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.711__shadow:xlBLYGwBHvTesYvKSgHdN2o4v62WL5b_.VsWbmasYp80l1RaTWNyM9N5pZSoMc8n_0 2024-09-14T12:01:19.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.167+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:19.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.169+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T12:01:19.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.171+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:19.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.171+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:19.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.172+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45129' 2024-09-14T12:01:19.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.172+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='_Mh75_aqNh7T74EpQcqENy3W-TEfUTOQ', time=2024-09-14T13:28:27.668395+0000, chain.objs.size()=2 2024-09-14T12:01:19.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.172+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.162__shadow_.Kj8SwqL6JgdcqAH-qYRV5GGebjb455Z_0 2024-09-14T12:01:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.172+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.162__shadow_.Kj8SwqL6JgdcqAH-qYRV5GGebjb455Z_1 2024-09-14T12:01:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.172+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1163589537917240232', time=2024-09-14T13:31:38.101821+0000, chain.objs.size()=1 2024-09-14T12:01:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.172+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.236__shadow_._7Ko2bZOTUCFPn70oFsC4a8ZLC6a3kI_0 2024-09-14T12:01:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.172+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18237814270024753059', time=2024-09-14T13:31:41.014145+0000, chain.objs.size()=1 2024-09-14T12:01:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.172+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.238__shadow_.cPZHIEmt3lboVsLYQPEISBwariXeb63_0 2024-09-14T12:01:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.172+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1152273048054417856', time=2024-09-14T13:31:51.630146+0000, chain.objs.size()=1 2024-09-14T12:01:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.172+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.246__shadow_.8Tl2b6VqzJp8fddZ5uOKtv3sAqfsOvq_0 2024-09-14T12:01:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.172+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4636740558319078894', time=2024-09-14T13:32:02.798005+0000, chain.objs.size()=1 2024-09-14T12:01:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.172+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.256__shadow_.1HGVBw3URUIjJveYBfl67QkEbQEztqt_0 2024-09-14T12:01:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.172+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1393855684176851989', time=2024-09-14T13:32:47.825491+0000, chain.objs.size()=1 2024-09-14T12:01:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.172+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.D4IIaR8smBdh5mYu8Q4z0YK4JOXga29_0 2024-09-14T12:01:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.172+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13912145435928124454', time=2024-09-14T13:32:48.195105+0000, chain.objs.size()=1 2024-09-14T12:01:19.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.172+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ME7HYLDdVbukPE8cGeQ_RNacgB2x1k3_0 2024-09-14T12:01:19.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.172+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13421944194131114516', time=2024-09-14T13:32:49.038727+0000, chain.objs.size()=1 2024-09-14T12:01:19.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.172+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.p_oRuDPcCYM7XRNCv_s1q7wO03jM7he_0 2024-09-14T12:01:19.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.172+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10424607161078022525', time=2024-09-14T13:32:49.151296+0000, chain.objs.size()=1 2024-09-14T12:01:19.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.172+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.z2FfgUrisn8Vi604i1sZ9HXuCubKcyn_0 2024-09-14T12:01:19.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.172+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14901532586820434007', time=2024-09-14T13:32:49.180896+0000, chain.objs.size()=1 2024-09-14T12:01:19.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.172+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.dXfusiznJo5rNIFRjdNAyb_ssktygDK_0 2024-09-14T12:01:19.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.172+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6760872216464692466', time=2024-09-14T13:32:49.418370+0000, chain.objs.size()=1 2024-09-14T12:01:19.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.172+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.PM8la8uYSiut6dG28cGzStM89VDli9S_0 2024-09-14T12:01:19.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.175+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.110119176045615720', time=2024-09-14T13:32:49.518923+0000, chain.objs.size()=1 2024-09-14T12:01:19.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.175+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.WeJOXu_qhUApcFe-Cns6Hy-CjjJWtvS_0 2024-09-14T12:01:19.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.175+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9656802523613052943', time=2024-09-14T13:32:49.606044+0000, chain.objs.size()=1 2024-09-14T12:01:19.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.175+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.D5Q1QL-TX8vXpO1Jw5YMrEl-E7Hoclz_0 2024-09-14T12:01:19.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.176+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4057936922481576766', time=2024-09-14T13:32:49.904521+0000, chain.objs.size()=1 2024-09-14T12:01:19.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.176+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.vyj9fOe6yiEo5QbVJclOctM6497o_OH_0 2024-09-14T12:01:19.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.178+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1020906768815582246', time=2024-09-14T13:32:52.051445+0000, chain.objs.size()=1 2024-09-14T12:01:19.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.178+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.yYtERn3H2fzEiOuoxDbfeQPuLbAi4ni_0 2024-09-14T12:01:19.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.178+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6298059903386863521', time=2024-09-14T13:32:52.052832+0000, chain.objs.size()=1 2024-09-14T12:01:19.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.178+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.DHOOJhy7Fk7JDIiP4TCpSUW9CNh0y0M_0 2024-09-14T12:01:19.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.178+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6714826254783799796', time=2024-09-14T13:32:52.181026+0000, chain.objs.size()=1 2024-09-14T12:01:19.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.178+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ofQMZDL-K8oTHBv6BmmAhNS4lEp-sRE_0 2024-09-14T12:01:19.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.178+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.911469956743956788', time=2024-09-14T13:32:52.359167+0000, chain.objs.size()=1 2024-09-14T12:01:19.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.178+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.a_vRWxBTj4fArCI-j5A_RW_M1PC4ehF_0 2024-09-14T12:01:19.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.178+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17618434010412946061', time=2024-09-14T13:32:52.589994+0000, chain.objs.size()=1 2024-09-14T12:01:19.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.178+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.4GMlfqq3XSqxxxN0DFoyrS7zxG46ZGs_0 2024-09-14T12:01:19.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.178+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11108139841313760572', time=2024-09-14T13:32:53.515275+0000, chain.objs.size()=1 2024-09-14T12:01:19.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.178+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.iAeC12EWjtGqpZGuKJ5f24kXwbFslQm_0 2024-09-14T12:01:19.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.178+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5107518642072718079', time=2024-09-14T13:32:53.805817+0000, chain.objs.size()=1 2024-09-14T12:01:19.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.178+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Hpahplrt3Rylywvx1lGXr8IoXwPTMJg_0 2024-09-14T12:01:19.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.178+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14289842803358849014', time=2024-09-14T13:32:54.019875+0000, chain.objs.size()=1 2024-09-14T12:01:19.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.178+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.yyIhL1WMYBVVRbguhniLHk9C3TofMWT_0 2024-09-14T12:01:19.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.178+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6878779189086059245', time=2024-09-14T13:32:55.454774+0000, chain.objs.size()=1 2024-09-14T12:01:19.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.178+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.97UCr_puLxnq3prMWMVYCruetEDnMif_0 2024-09-14T12:01:19.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.179+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4280298461025796982', time=2024-09-14T13:32:55.663355+0000, chain.objs.size()=1 2024-09-14T12:01:19.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.179+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.yRVGFyLeFBjmqUd8HsABvevjyNmDCFS_0 2024-09-14T12:01:19.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.179+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7947443492476162362', time=2024-09-14T13:32:56.333932+0000, chain.objs.size()=1 2024-09-14T12:01:19.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.179+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.aZCfCcB3gRbApSA8BD4gTTF9lqxKVlt_0 2024-09-14T12:01:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.181+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9136472127486162782', time=2024-09-14T13:32:56.348215+0000, chain.objs.size()=1 2024-09-14T12:01:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.181+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.3OA1eo_isnN2Xp0LOlpQV-eKZ8E2N0R_0 2024-09-14T12:01:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.181+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5369291446090368674', time=2024-09-14T13:32:56.573781+0000, chain.objs.size()=1 2024-09-14T12:01:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.181+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.n-a_h8QxaJWeLTmdN_Uppq8xyh8SHZF_0 2024-09-14T12:01:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.181+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10891327504070457966', time=2024-09-14T13:32:57.407042+0000, chain.objs.size()=1 2024-09-14T12:01:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.181+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.cKNTpJZ4_LLB3oRLK6oY2MuT4ZnqJI2_0 2024-09-14T12:01:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.182+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16778697962647635318', time=2024-09-14T13:32:57.435927+0000, chain.objs.size()=1 2024-09-14T12:01:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.182+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.0J4_KMTLrEoWI82JYc-4bwr61EkVntH_0 2024-09-14T12:01:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.182+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7766169579734123303', time=2024-09-14T13:32:57.955682+0000, chain.objs.size()=1 2024-09-14T12:01:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.182+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.HlFELa4wjkOzNt127DHCjchso5yCsaY_0 2024-09-14T12:01:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.182+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12937236245608211981', time=2024-09-14T13:32:58.038981+0000, chain.objs.size()=1 2024-09-14T12:01:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.182+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.whZmlooUihRaT_xH2812C5SmYE5hOBw_0 2024-09-14T12:01:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.182+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16388734491391223629', time=2024-09-14T13:32:58.340224+0000, chain.objs.size()=1 2024-09-14T12:01:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.182+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.IoUtNTMA8c1rOuDMBCQp6yNG8Yq0paL_0 2024-09-14T12:01:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.182+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.526505308192313827', time=2024-09-14T13:32:58.575419+0000, chain.objs.size()=1 2024-09-14T12:01:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.182+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.5YhL3nxtyhSIE7XtKya8zCs4-OFkFLy_0 2024-09-14T12:01:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.182+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11690419281797143920', time=2024-09-14T13:33:11.605860+0000, chain.objs.size()=1 2024-09-14T12:01:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.182+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.275__shadow_.ejRXeLhXa2-ysDqUvwv4umJthThSrwr_0 2024-09-14T12:01:19.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.184+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13066612017414546514', time=2024-09-14T13:33:15.997671+0000, chain.objs.size()=1 2024-09-14T12:01:19.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.184+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.279__shadow_.C9KdUkqQsyuBgsizuQVf514Zcs1cVwz_0 2024-09-14T12:01:19.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.184+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4316683595563201622', time=2024-09-14T13:33:29.281192+0000, chain.objs.size()=1 2024-09-14T12:01:19.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.184+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.291__shadow_.U6MIljFl0U3ooQgGAEyxh5T4NsYTgC-_0 2024-09-14T12:01:19.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.184+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.624983704626666935', time=2024-09-14T13:33:37.837467+0000, chain.objs.size()=1 2024-09-14T12:01:19.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.184+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.296__shadow_.fm4QPlmaerxwSfiJaxjdTFBMYigr7kp_0 2024-09-14T12:01:19.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.186+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12595467763358649493', time=2024-09-14T13:33:43.449550+0000, chain.objs.size()=1 2024-09-14T12:01:19.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.186+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.301__shadow_.1iCEn3tB3f2JRY9_LU8ZO0MZoavwg8D_0 2024-09-14T12:01:19.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.187+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16372535126668090901', time=2024-09-14T13:33:45.854950+0000, chain.objs.size()=1 2024-09-14T12:01:19.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.187+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.303__shadow_.JLr1JOFeyme8QBrJ37FrB_sjCXF5yuf_0 2024-09-14T12:01:19.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.188+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3155283782253019530', time=2024-09-14T13:33:48.040195+0000, chain.objs.size()=1 2024-09-14T12:01:19.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.188+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.305__shadow_.FoWzJA5GylWzx-Fx9THk8X94ltOk3QJ_0 2024-09-14T12:01:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.188+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15877575206404485767', time=2024-09-14T13:34:51.539256+0000, chain.objs.size()=1 2024-09-14T12:01:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.188+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Wm_T33CRQrdPQ-_CeJzOl2F9eZltI1I_0 2024-09-14T12:01:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.188+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6432446448737987727', time=2024-09-14T13:34:52.223101+0000, chain.objs.size()=1 2024-09-14T12:01:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.188+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.mWNm0wVvSkB0druvjCJ_jprfV8TtoGi_0 2024-09-14T12:01:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.188+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12826792979531731766', time=2024-09-14T13:34:52.302762+0000, chain.objs.size()=1 2024-09-14T12:01:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.188+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.TfXYtMiY1vYaLZ1I4cZpGtweBqxtDox_0 2024-09-14T12:01:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.188+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13222158344295470724', time=2024-09-14T13:34:53.418702+0000, chain.objs.size()=1 2024-09-14T12:01:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.188+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.9p8bVWOgHrQAkwrcCIzDMlg9nt0UVUn_0 2024-09-14T12:01:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.188+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7884341732153927881', time=2024-09-14T13:34:55.138690+0000, chain.objs.size()=1 2024-09-14T12:01:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.188+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.kXSk88uyLWmS_FD8z2WB2_ARcKanSS6_0 2024-09-14T12:01:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.188+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16423051585139772080', time=2024-09-14T13:34:55.338184+0000, chain.objs.size()=1 2024-09-14T12:01:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.188+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.g22B9awBP5fGYG6J8vpv0ySwItxz922_0 2024-09-14T12:01:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.188+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5858923179357194405', time=2024-09-14T13:34:55.414593+0000, chain.objs.size()=1 2024-09-14T12:01:19.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.188+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.8M0atsraSwV2nRnuVf6sUenc2sypv4Q_0 2024-09-14T12:01:19.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.188+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16384244875403902061', time=2024-09-14T13:34:55.498283+0000, chain.objs.size()=1 2024-09-14T12:01:19.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.188+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.7ptFHQrOXd2Bz_ZxOYHWLrX9r9fFBV7_0 2024-09-14T12:01:19.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.190+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2991852136505755819', time=2024-09-14T13:34:55.650485+0000, chain.objs.size()=1 2024-09-14T12:01:19.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.190+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.sYjSt2gEpjNE2PyvF5--Te30XjMGl8n_0 2024-09-14T12:01:19.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.192+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4982805454530208352', time=2024-09-14T13:34:55.651184+0000, chain.objs.size()=1 2024-09-14T12:01:19.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.192+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.eS42MtoOPQichUc-PiK0QWMe4RNpQ9C_0 2024-09-14T12:01:19.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.192+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6713172402407330523', time=2024-09-14T13:34:56.206427+0000, chain.objs.size()=1 2024-09-14T12:01:19.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.192+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Qmgdr48uCU7pWNg_FG7sB84jSl-3xnp_0 2024-09-14T12:01:19.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.192+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1056174410689709311', time=2024-09-14T13:34:56.816490+0000, chain.objs.size()=1 2024-09-14T12:01:19.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.192+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.TztreldFvykIFf0iwMDkaebFataO_JC_0 2024-09-14T12:01:19.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.192+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16170665434735240940', time=2024-09-14T13:34:57.168453+0000, chain.objs.size()=1 2024-09-14T12:01:19.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.192+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.1HlpICt4vglqVBM6vo52LYNHYCYSDOY_0 2024-09-14T12:01:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.193+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8343231272726540485', time=2024-09-14T13:34:57.193601+0000, chain.objs.size()=1 2024-09-14T12:01:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.193+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.9T2LPF7hMkyTPyoHWOITkWNUKTDfAw7_0 2024-09-14T12:01:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.193+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10109055617765334061', time=2024-09-14T13:34:57.638683+0000, chain.objs.size()=1 2024-09-14T12:01:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.193+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.941CPygAiVtKxZxECfb7xYCy0XR2XJ3_0 2024-09-14T12:01:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.193+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.954149528927031781', time=2024-09-14T13:34:58.553404+0000, chain.objs.size()=1 2024-09-14T12:01:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.193+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Lvlw_CcOqY0bR4jokJSydlyRP2nd9WB_0 2024-09-14T12:01:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.193+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15657840219829502939', time=2024-09-14T13:34:59.240464+0000, chain.objs.size()=1 2024-09-14T12:01:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.193+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.xk1QatFE1zYytWsnqDKhaQm7f5OKwlm_0 2024-09-14T12:01:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.193+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1163204048700907208', time=2024-09-14T13:34:59.737107+0000, chain.objs.size()=1 2024-09-14T12:01:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.193+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.G2TKQY_iX7oV26Nq3rvpKrtHfT_IXXm_0 2024-09-14T12:01:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.193+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13218673704832692249', time=2024-09-14T13:34:59.880789+0000, chain.objs.size()=1 2024-09-14T12:01:19.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.193+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Pj9dhf_AR4jPdKbA5RDeiTo1B3AoTaZ_0 2024-09-14T12:01:19.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.193+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3341369463967869658', time=2024-09-14T13:35:00.635146+0000, chain.objs.size()=1 2024-09-14T12:01:19.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.193+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ANynetPTzmIX_SV3qat_M3WvxA2GLQi_0 2024-09-14T12:01:19.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.196+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9185330183027914781', time=2024-09-14T13:35:00.744720+0000, chain.objs.size()=1 2024-09-14T12:01:19.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.196+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.w_xpjgTEsfdDDLIEuM6Dm2AEQmL6aS9_0 2024-09-14T12:01:19.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.196+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12474686696390844822', time=2024-09-14T13:35:00.827668+0000, chain.objs.size()=1 2024-09-14T12:01:19.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.196+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.eKvlQqC1nPyERkgtuW4hDCoDk5soPv__0 2024-09-14T12:01:19.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.196+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2595921105090159878', time=2024-09-14T13:35:01.024604+0000, chain.objs.size()=1 2024-09-14T12:01:19.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.196+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Jlh5L5S365Ma1OJ95ALhd0ItV22E8hV_0 2024-09-14T12:01:19.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.196+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5395266907191287854', time=2024-09-14T13:35:01.061761+0000, chain.objs.size()=1 2024-09-14T12:01:19.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.196+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.NkU7mZdGJgiPema_AaXkzlRYlV3QHP-_0 2024-09-14T12:01:19.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.197+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10311998230989576388', time=2024-09-14T13:35:01.365332+0000, chain.objs.size()=1 2024-09-14T12:01:19.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.197+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.nu-2V6e3RWzXcFBEQpuoNLFJU_66xcg_0 2024-09-14T12:01:19.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.197+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12283066132908097688', time=2024-09-14T13:35:01.457246+0000, chain.objs.size()=1 2024-09-14T12:01:19.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.197+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.FbZG5lbiIC1CzUFoEaObyRCiEMPAkpW_0 2024-09-14T12:01:19.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.198+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7606064912556363813', time=2024-09-14T13:35:41.644272+0000, chain.objs.size()=1 2024-09-14T12:01:19.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.198+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.XoasHPF4EpjmR0raElHQBXmNpTD09lu_0 2024-09-14T12:01:19.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.198+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1713895724629142814', time=2024-09-14T13:35:41.645854+0000, chain.objs.size()=1 2024-09-14T12:01:19.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.198+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.aDjOXb67Q4u6K7VEOvne4JGNGAQZDoU_0 2024-09-14T12:01:19.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.198+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9271872329558677914', time=2024-09-14T13:35:41.930851+0000, chain.objs.size()=1 2024-09-14T12:01:19.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.198+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.9SFO6j5lwRHmiJy8X_RPldZRVDqAA2M_0 2024-09-14T12:01:19.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.198+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12157071989262812126', time=2024-09-14T13:35:43.303158+0000, chain.objs.size()=1 2024-09-14T12:01:19.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.198+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.cNYHc4yU1XHGhGOIYkaZM5gpCD5IOgJ_0 2024-09-14T12:01:19.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.198+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8277902883001979865', time=2024-09-14T13:35:43.407829+0000, chain.objs.size()=1 2024-09-14T12:01:19.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.198+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.o1r44XciwzJ3BHrTecEP1NKrG2HNk0H_0 2024-09-14T12:01:19.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.198+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9880145804874415245', time=2024-09-14T13:35:43.587647+0000, chain.objs.size()=1 2024-09-14T12:01:19.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.198+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.m_ILl8GyYM2VweJDs3foLBLFn7OwCo9_0 2024-09-14T12:01:19.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.199+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6336145093773000535', time=2024-09-14T13:35:45.112598+0000, chain.objs.size()=1 2024-09-14T12:01:19.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.199+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.du0FN9H77hTC8_1gqS1acrDoUuHk8WJ_0 2024-09-14T12:01:19.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.199+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10559382865723770738', time=2024-09-14T13:35:45.410569+0000, chain.objs.size()=1 2024-09-14T12:01:19.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.199+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.vKMyzS6MNoqA5EA8Mle2SWv6QcLBPIF_0 2024-09-14T12:01:19.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.199+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1316413199298669392', time=2024-09-14T13:35:45.587604+0000, chain.objs.size()=1 2024-09-14T12:01:19.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.199+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.sx21NBrC8biUi_WhUkwJ7uNkm0GMJI-_0 2024-09-14T12:01:19.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.201+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5975678002952939483', time=2024-09-14T13:35:45.645876+0000, chain.objs.size()=1 2024-09-14T12:01:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.201+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.QU0-E9FBtDB1BxWIenlhDV7lERlvByU_0 2024-09-14T12:01:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.201+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17270789217445947744', time=2024-09-14T13:35:45.681124+0000, chain.objs.size()=1 2024-09-14T12:01:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.201+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.wMYtxnv9zMA5DSkcDqascsCW_6cey_C_0 2024-09-14T12:01:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.201+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16277456010848510424', time=2024-09-14T13:35:45.685310+0000, chain.objs.size()=1 2024-09-14T12:01:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.201+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.PLxY9NZa8KDpY0UfCFcjwDjFet0zLoj_0 2024-09-14T12:01:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.201+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.821781118601736497', time=2024-09-14T13:35:45.776059+0000, chain.objs.size()=1 2024-09-14T12:01:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.201+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.d1SB2C5BYJmxnigLcpQ1ZEQ7URSlbvc_0 2024-09-14T12:01:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.202+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10830526983758805009', time=2024-09-14T13:35:46.289157+0000, chain.objs.size()=1 2024-09-14T12:01:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.202+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.i6KEZjshxrwUEEJw_0cNaRy1weqJg6o_0 2024-09-14T12:01:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.202+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6347211891610652148', time=2024-09-14T13:35:46.593632+0000, chain.objs.size()=1 2024-09-14T12:01:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.202+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.seW6R6ZINxkwaF92vQ0R-C8jWFf5Zkr_0 2024-09-14T12:01:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.202+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7186540202054903175', time=2024-09-14T13:35:46.983847+0000, chain.objs.size()=1 2024-09-14T12:01:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.202+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.sU4inva_LBXA2OOKMoTBCIwURHoU1LS_0 2024-09-14T12:01:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.203+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11332978083540575130', time=2024-09-14T13:35:47.095202+0000, chain.objs.size()=1 2024-09-14T12:01:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.203+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.goqeKhGdRD2X5vYbbg0EmB9-kE7ihKG_0 2024-09-14T12:01:19.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.203+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5369904325539684862', time=2024-09-14T13:35:47.875175+0000, chain.objs.size()=1 2024-09-14T12:01:19.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.203+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Rfe2WFnJ3dAJqXruTJqk3qm-rgX7k4w_0 2024-09-14T12:01:19.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.203+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11592948782487966791', time=2024-09-14T13:35:47.932189+0000, chain.objs.size()=1 2024-09-14T12:01:19.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.203+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.HedLpUg1wzMIkxKzuwLMz965f-446EZ_0 2024-09-14T12:01:19.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.204+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16377303726586795764', time=2024-09-14T13:35:48.253315+0000, chain.objs.size()=1 2024-09-14T12:01:19.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.204+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.3n3DmRD7HsvIjSOEb5lACoBTzu_9H8z_0 2024-09-14T12:01:19.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.205+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3769751699003300110', time=2024-09-14T13:35:48.570443+0000, chain.objs.size()=1 2024-09-14T12:01:19.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.205+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.HDrNQsfLHoX5j9jv452Vjgqg-Vk8ZPY_0 2024-09-14T12:01:19.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.205+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8972481543205961337', time=2024-09-14T13:35:49.530258+0000, chain.objs.size()=1 2024-09-14T12:01:19.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.205+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Z59Msrys4pHuQ3JHmHF76uXZrjSetTM_0 2024-09-14T12:01:19.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.205+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8812959812878718662', time=2024-09-14T13:35:49.727188+0000, chain.objs.size()=1 2024-09-14T12:01:19.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.205+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.zq0756bWpa7jhbxTZVNKm9dkJpCk33t_0 2024-09-14T12:01:19.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.205+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6110554573547464653', time=2024-09-14T13:35:50.019742+0000, chain.objs.size()=1 2024-09-14T12:01:19.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.205+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.9KLDEH_a8kg2WEZ9MC8xBPj3ioWtz5u_0 2024-09-14T12:01:19.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.205+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4598261778344883333', time=2024-09-14T13:35:50.020698+0000, chain.objs.size()=1 2024-09-14T12:01:19.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.205+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.UKdjpLK11fbHLHCWrdL1BSjCW9gW2t7_0 2024-09-14T12:01:19.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.207+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.942691089284249299', time=2024-09-14T13:35:50.023858+0000, chain.objs.size()=1 2024-09-14T12:01:19.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.207+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.5mHa9l_NxMlZ5Qj9KypffwJ1msAiH0i_0 2024-09-14T12:01:19.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.207+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2896553778069910860', time=2024-09-14T13:35:50.263533+0000, chain.objs.size()=1 2024-09-14T12:01:19.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.207+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.3NS1HybjMBd8POMA-eKumAzvPDdAWAZ_0 2024-09-14T12:01:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.208+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13814482748213389736', time=2024-09-14T13:35:50.940162+0000, chain.objs.size()=1 2024-09-14T12:01:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.208+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.h3TrnGE2dJPu3dwFbHi0qd8fiB5Kjqr_0 2024-09-14T12:01:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.208+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5256187785585012244', time=2024-09-14T13:35:51.042256+0000, chain.objs.size()=1 2024-09-14T12:01:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.208+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.F3nG2v3kC1IrZiVGQM_od2LG7Bt1foJ_0 2024-09-14T12:01:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.208+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1855747911423044931', time=2024-09-14T13:35:51.113353+0000, chain.objs.size()=1 2024-09-14T12:01:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.208+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.xkE2-q_ahG1RxngUmKLX9gGYEWlJ9G1_0 2024-09-14T12:01:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.208+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16354246463049117737', time=2024-09-14T13:35:51.186816+0000, chain.objs.size()=1 2024-09-14T12:01:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.208+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.6vjgCuxdcsl1HG5B3G16zpAVW6Wern6_0 2024-09-14T12:01:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.208+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5561722989496719887', time=2024-09-14T13:35:51.232817+0000, chain.objs.size()=1 2024-09-14T12:01:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.208+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.pKi9NjlclYpS9scZcDbZegBUAs3QBCr_0 2024-09-14T12:01:19.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.208+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15716437580771280594', time=2024-09-14T13:35:51.541992+0000, chain.objs.size()=1 2024-09-14T12:01:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.208+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.r-xT5EfUNjqcoY3OJn6B8w1TJ7LdyYj_0 2024-09-14T12:01:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.210+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7335641433395893623', time=2024-09-14T13:35:52.608454+0000, chain.objs.size()=1 2024-09-14T12:01:19.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.210+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.wsroPrSC1bpQP3Ye3Prmbc4coVCEnRp_0 2024-09-14T12:01:19.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.213+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/45129 2024-09-14T12:01:19.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.215+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T12:01:19.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.215+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6765298105376071259', time=2024-09-14T13:35:52.716239+0000, chain.objs.size()=1 2024-09-14T12:01:19.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.215+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.7dGCnWNtRUJDWz7mLQ9Qhnv65ULVIDx_0 2024-09-14T12:01:19.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.215+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16515110849314668196', time=2024-09-14T13:36:47.784337+0000, chain.objs.size()=1 2024-09-14T12:01:19.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.215+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.379__shadow_.RIGGGufW1HToVIjDyWv5dLfJlGRmlJ0_0 2024-09-14T12:01:19.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.215+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11329392234528947218', time=2024-09-14T13:39:02.349130+0000, chain.objs.size()=1 2024-09-14T12:01:19.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.215+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.500__shadow_.BvYWg910Du-NAxwKdh3FJhd97z0PYzT_0 2024-09-14T12:01:19.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.215+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10013645975856014642', time=2024-09-14T13:41:14.260419+0000, chain.objs.size()=6 2024-09-14T12:01:19.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.215+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.BVH4MfTN_05HWuukn0chgJzb4EaF_Cqa.1 2024-09-14T12:01:19.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.215+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~tpaEKw5u5IzcoFP-ea0iCEPzHjcRtmY.2 2024-09-14T12:01:19.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.215+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~tpaEKw5u5IzcoFP-ea0iCEPzHjcRtmY.3 2024-09-14T12:01:19.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.215+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~tpaEKw5u5IzcoFP-ea0iCEPzHjcRtmY.4 2024-09-14T12:01:19.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.215+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~tpaEKw5u5IzcoFP-ea0iCEPzHjcRtmY.5 2024-09-14T12:01:19.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.215+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.523__multipart_mymultipart.2~tpaEKw5u5IzcoFP-ea0iCEPzHjcRtmY.6 2024-09-14T12:01:19.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.215+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2037080811707543800', time=2024-09-14T13:46:00.217158+0000, chain.objs.size()=1 2024-09-14T12:01:19.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.215+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.576__shadow:1NQCp2p8pG2-JGfsVmNvLSu0YAaBKZU_.Ef-HVdkzCwYZIFJfNOdciPhtZn-87lI_0 2024-09-14T12:01:19.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.215+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7152762012807566421', time=2024-09-14T13:47:19.559533+0000, chain.objs.size()=1 2024-09-14T12:01:19.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.215+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.587__shadow:0-xa..fLAWtX4MwbGdRxYXB0FI4o4dm_.QRpAy_nrc9GWuY4_4uK4kMlESVCbnL5_0 2024-09-14T12:01:19.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.215+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11649023311437436470', time=2024-09-14T13:49:28.140029+0000, chain.objs.size()=6 2024-09-14T12:01:19.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.215+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.615__multipart_multipart_enc.2~tDZwTrlLbwgheCwv2vZNx7dG1IlElaT.1 2024-09-14T12:01:19.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.218+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.615__multipart_multipart_enc.2~tDZwTrlLbwgheCwv2vZNx7dG1IlElaT.2 2024-09-14T12:01:19.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.218+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.615__multipart_multipart_enc.2~tDZwTrlLbwgheCwv2vZNx7dG1IlElaT.3 2024-09-14T12:01:19.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.218+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.615__multipart_multipart_enc.2~tDZwTrlLbwgheCwv2vZNx7dG1IlElaT.4 2024-09-14T12:01:19.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.218+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.615__multipart_multipart_enc.2~tDZwTrlLbwgheCwv2vZNx7dG1IlElaT.5 2024-09-14T12:01:19.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.218+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.615__multipart_multipart_enc.2~tDZwTrlLbwgheCwv2vZNx7dG1IlElaT.6 2024-09-14T12:01:19.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.218+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4602929157977219688', time=2024-09-14T13:54:27.596439+0000, chain.objs.size()=1 2024-09-14T12:01:19.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.218+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.698__shadow:0HfKJ11Y0qifEk1UITOAts1zdct0T9q_.DqrLb7UKOSC7sIqgT0HbEvGF1KzK_Dj_0 2024-09-14T12:01:19.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.218+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15392859967117562103', time=2024-09-14T13:54:36.138720+0000, chain.objs.size()=1 2024-09-14T12:01:19.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.218+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.706__shadow:MN8s8uzUgJcp9Sxvq.y5OjA0N5v3j9D_.In0UG9n8Ek_X6kjPSf1pmu7xGucWxbh_0 2024-09-14T12:01:19.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.218+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16627045717665892175', time=2024-09-14T13:55:09.277946+0000, chain.objs.size()=1 2024-09-14T12:01:19.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.218+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.720__shadow_.hjz3KPr_PcUVo-1o7kpOuw0rTNMZugs_0 2024-09-14T12:01:19.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.218+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9821350646255896766', time=2024-09-14T13:56:32.251296+0000, chain.objs.size()=1 2024-09-14T12:01:19.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.218+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.751__shadow_.PZjE7ISJ1-iqi7A3QwbmUeR94A65ttH_0 2024-09-14T12:01:19.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.220+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13533116515136434119', time=2024-09-14T13:57:09.266990+0000, chain.objs.size()=1 2024-09-14T12:01:19.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.220+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.758__shadow_.nONsDwPg-cvr4BTRiWYJiMOUeoeVwjZ_0 2024-09-14T12:01:19.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.220+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10583468212890866138', time=2024-09-14T14:00:46.646269+0000, chain.objs.size()=1 2024-09-14T12:01:19.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.220+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.783__shadow_.Q5qGVmM7pi81nGgpcmFAFXTyDMjaX3u_0 2024-09-14T12:01:19.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.224+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:19.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.227+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T12:01:19.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.228+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.229+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:19.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.229+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48216' 2024-09-14T12:01:19.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.229+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16041514574946383615', time=2024-09-14T13:27:43.624968+0000, chain.objs.size()=2 2024-09-14T12:01:19.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.229+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.159__shadow_.JcmC8JkTD-0RFG5KSnzXME2MXHJQ3rn_0 2024-09-14T12:01:19.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.229+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.159__shadow_.JcmC8JkTD-0RFG5KSnzXME2MXHJQ3rn_1 2024-09-14T12:01:19.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.229+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='_RRaCdy6zb7MjSMY25dnoPSY4TfJs1EY', time=2024-09-14T13:28:08.198578+0000, chain.objs.size()=2 2024-09-14T12:01:19.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.229+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.161__shadow_.1qt47wNf3Att7Ap38kp5jeeRyFbrlpl_0 2024-09-14T12:01:19.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.229+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.161__shadow_.1qt47wNf3Att7Ap38kp5jeeRyFbrlpl_1 2024-09-14T12:01:19.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.230+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3209517864659125607', time=2024-09-14T13:29:02.375512+0000, chain.objs.size()=1 2024-09-14T12:01:19.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.230+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.182__shadow_.8HOlsFRrmMd26KSySjjOt7WGfFrlh4K_0 2024-09-14T12:01:19.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.230+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10677488860097119745', time=2024-09-14T13:31:38.112373+0000, chain.objs.size()=1 2024-09-14T12:01:19.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.230+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.236__shadow_.KMa0mkGgpemLS34cczBfXpqnyRSDROz_0 2024-09-14T12:01:19.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.230+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11553362021129999993', time=2024-09-14T13:31:41.008052+0000, chain.objs.size()=1 2024-09-14T12:01:19.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.230+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.238__shadow_.PIZBYeNoIUMLpwUihfCyRfHKHI-jLYJ_0 2024-09-14T12:01:19.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.230+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.710785751633760900', time=2024-09-14T13:31:45.820707+0000, chain.objs.size()=1 2024-09-14T12:01:19.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.230+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.242__shadow_.hQVVYYdkjpdI0awDeVKAJLrBeWfAWus_0 2024-09-14T12:01:19.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.230+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15148628436431194376', time=2024-09-14T13:31:59.522521+0000, chain.objs.size()=1 2024-09-14T12:01:19.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.230+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.253__shadow_.gUPqwPFlzVGsCrHwe6CNJ2U-DxzGxkr_0 2024-09-14T12:01:19.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.230+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5626290152588154726', time=2024-09-14T13:32:02.798643+0000, chain.objs.size()=1 2024-09-14T12:01:19.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.230+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.256__shadow_.JjHG3e1MKIP9kjw6aJr-bzPh-ZDqELJ_0 2024-09-14T12:01:19.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.230+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12857479040859121185', time=2024-09-14T13:32:04.993150+0000, chain.objs.size()=1 2024-09-14T12:01:19.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.230+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.258__shadow_.hVAREBkYPyw95NlK3akInEpJ1EA78Ya_0 2024-09-14T12:01:19.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.230+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18233390077638732136', time=2024-09-14T13:32:04.993675+0000, chain.objs.size()=1 2024-09-14T12:01:19.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.230+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.258__shadow_.tRXkqSDOqbLQ8IhzCAb3Q2ofG5t_AC8_0 2024-09-14T12:01:19.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.234+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18182857959593747681', time=2024-09-14T13:32:08.248242+0000, chain.objs.size()=1 2024-09-14T12:01:19.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.234+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.261__shadow_.oEpORx0mX9MGccqv2qfAqgG_GpK2fV8_0 2024-09-14T12:01:19.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.234+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4786732035972894104', time=2024-09-14T13:32:47.409211+0000, chain.objs.size()=1 2024-09-14T12:01:19.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.234+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.3q20HrWLWhluBzDN_ZFy1neeyxu7jTs_0 2024-09-14T12:01:19.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.235+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5715547319516783422', time=2024-09-14T13:32:47.919969+0000, chain.objs.size()=1 2024-09-14T12:01:19.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.235+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_._UBjiFrhkfZa7sTVYk1NzMsDHYgdo1T_0 2024-09-14T12:01:19.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.235+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3171511760272188030', time=2024-09-14T13:32:48.001590+0000, chain.objs.size()=1 2024-09-14T12:01:19.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.235+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.-VK8nc80Foz_9hxngNWKZahByVUmJAB_0 2024-09-14T12:01:19.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.235+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.886903292447797339', time=2024-09-14T13:32:48.162969+0000, chain.objs.size()=1 2024-09-14T12:01:19.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.235+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.oPZscPDeYDyBM-CqLfzEeYxvZXKyNYL_0 2024-09-14T12:01:19.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.235+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15634964688517660037', time=2024-09-14T13:32:49.172799+0000, chain.objs.size()=1 2024-09-14T12:01:19.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.235+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.HQ9p5jbzpQNT1EG7goLtJHUIIhW_HUU_0 2024-09-14T12:01:19.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.235+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4466080239214024009', time=2024-09-14T13:32:49.252853+0000, chain.objs.size()=1 2024-09-14T12:01:19.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.235+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.nmUyivqGO16PLrabhMI_E7Sg2eA3-Oc_0 2024-09-14T12:01:19.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.235+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10445996196871198897', time=2024-09-14T13:32:49.534992+0000, chain.objs.size()=1 2024-09-14T12:01:19.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.235+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.i1FWFDtq4CFr_6XZf01NfK8SA3P61Nc_0 2024-09-14T12:01:19.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.235+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1250757393065025774', time=2024-09-14T13:32:50.995428+0000, chain.objs.size()=1 2024-09-14T12:01:19.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.235+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.A_3jPeniu8SkiF1ufFjY8d6Axp_zjf7_0 2024-09-14T12:01:19.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.235+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6957415104391054756', time=2024-09-14T13:32:51.070338+0000, chain.objs.size()=1 2024-09-14T12:01:19.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.235+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.DWOq2pocf5wVAWl1Pk6UlsMaVyz_nHo_0 2024-09-14T12:01:19.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.235+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14980321150752646470', time=2024-09-14T13:32:51.282096+0000, chain.objs.size()=1 2024-09-14T12:01:19.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.235+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Aa-t9rtBsYphAYCRVQ7q81FNcxAn9Ud_0 2024-09-14T12:01:19.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.237+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13734191954026691612', time=2024-09-14T13:32:51.575544+0000, chain.objs.size()=1 2024-09-14T12:01:19.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.237+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.96mB6BMTZ9BDEhsnzZ04Bgrsp8hnn9s_0 2024-09-14T12:01:19.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.237+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4509577972562217913', time=2024-09-14T13:32:52.049871+0000, chain.objs.size()=1 2024-09-14T12:01:19.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.237+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ivJfEJdPu8pIbCpo_vxdwStAhHtO87c_0 2024-09-14T12:01:19.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.239+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14250125965750926747', time=2024-09-14T13:32:52.203379+0000, chain.objs.size()=1 2024-09-14T12:01:19.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.239+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.IG6ffr5jIsyzfaQV_71A1XTULV5xhsQ_0 2024-09-14T12:01:19.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.239+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17089623347599199568', time=2024-09-14T13:32:52.754511+0000, chain.objs.size()=1 2024-09-14T12:01:19.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.239+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.anKm-rhYM6VaAbWY72RsRsWAqRjPEYn_0 2024-09-14T12:01:19.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.239+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10172339941396095784', time=2024-09-14T13:32:53.011094+0000, chain.objs.size()=1 2024-09-14T12:01:19.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.239+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ftuaUnwwkA0y-LIiAUBK9fLsNrvngrB_0 2024-09-14T12:01:19.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.239+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16325844818213744234', time=2024-09-14T13:32:53.519772+0000, chain.objs.size()=1 2024-09-14T12:01:19.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.239+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.gd8UBw0XA7Dmu5426hRkYBccw98Fl9L_0 2024-09-14T12:01:19.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.239+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6430189404286745749', time=2024-09-14T13:32:53.859362+0000, chain.objs.size()=1 2024-09-14T12:01:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.239+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ikUHcgFZbdB4LPI_FlSZ2KZW6zVpCVQ_0 2024-09-14T12:01:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.239+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3116070335931317699', time=2024-09-14T13:32:54.448925+0000, chain.objs.size()=1 2024-09-14T12:01:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.239+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.6dXy0dJO3XWn1zHATKEjxnpSkSaegd4_0 2024-09-14T12:01:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.239+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8883214590117768320', time=2024-09-14T13:32:55.248947+0000, chain.objs.size()=1 2024-09-14T12:01:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.239+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.WI3hCMKUQ8EBGEYJXPBbPpJHlicKq4l_0 2024-09-14T12:01:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.239+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16089445447167485640', time=2024-09-14T13:32:55.844355+0000, chain.objs.size()=1 2024-09-14T12:01:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.239+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.f3kpKAYJVvh-3E2cuipzlmTtMnt2gdA_0 2024-09-14T12:01:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.239+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15018908340844710376', time=2024-09-14T13:32:55.926317+0000, chain.objs.size()=1 2024-09-14T12:01:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.239+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.UQweesv_zTfiqsjrAdF0F_13OXOpOK6_0 2024-09-14T12:01:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.239+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16013902937545206999', time=2024-09-14T13:32:55.947533+0000, chain.objs.size()=1 2024-09-14T12:01:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.239+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.o05J56gXGEgSnLfAhAVxCpEFD1QqmjR_0 2024-09-14T12:01:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.239+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6555755458749212126', time=2024-09-14T13:32:56.348689+0000, chain.objs.size()=1 2024-09-14T12:01:19.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.239+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.O7KvER0QiUdDw5XqK1jW2pBiStZZ47H_0 2024-09-14T12:01:19.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.244+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9808452591029353550', time=2024-09-14T13:32:56.725526+0000, chain.objs.size()=1 2024-09-14T12:01:19.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.244+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.FpkcuR7cvJhOS1HSBGI3XPntYDSB6z1_0 2024-09-14T12:01:19.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.244+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6862393601713627363', time=2024-09-14T13:32:57.016757+0000, chain.objs.size()=1 2024-09-14T12:01:19.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.244+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.eXeCM8qsrIqlQSmmx4LMPY0BCV9RQBg_0 2024-09-14T12:01:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.244+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5809416351043554776', time=2024-09-14T13:32:57.384039+0000, chain.objs.size()=1 2024-09-14T12:01:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.244+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Ac2cqwckZg7pc1ksGXLhZPkY6QoNsED_0 2024-09-14T12:01:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.244+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10414084350875171666', time=2024-09-14T13:32:58.473600+0000, chain.objs.size()=1 2024-09-14T12:01:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.244+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.D5cZOovbaP1Rtvqj9aiuypxv6ubpTZA_0 2024-09-14T12:01:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.244+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11749266397041639087', time=2024-09-14T13:32:58.557753+0000, chain.objs.size()=1 2024-09-14T12:01:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.244+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.PNTaPq2o5T6VPXFYuuRFptq4GTjeT4a_0 2024-09-14T12:01:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.244+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14421900818263634972', time=2024-09-14T13:33:33.132231+0000, chain.objs.size()=1 2024-09-14T12:01:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.244+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.Z9BbbNjJrgZvZpjCiZJc-E0XmE7ckiG_0 2024-09-14T12:01:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.244+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9900013697376616385', time=2024-09-14T13:33:33.228649+0000, chain.objs.size()=1 2024-09-14T12:01:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.244+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.293__shadow_.SJTvLuuf9JjeIAHbYyQ3KzR2mlKp7JC_0 2024-09-14T12:01:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.244+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.408596082842988657', time=2024-09-14T13:33:43.461142+0000, chain.objs.size()=1 2024-09-14T12:01:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.244+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.301__shadow_.56Emfz7pCBCAZHmui_hsTPW80wWZAxO_0 2024-09-14T12:01:19.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.244+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12376585572836091560', time=2024-09-14T13:33:44.539584+0000, chain.objs.size()=1 2024-09-14T12:01:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.244+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.302__shadow_.s8O9ltykv7CZwiNast7u58A9Xfcyrl2_0 2024-09-14T12:01:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.244+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.814685710532090304', time=2024-09-14T13:33:46.924195+0000, chain.objs.size()=1 2024-09-14T12:01:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.244+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.304__shadow_.Io8vOzRdonzws70X1dIjlVw65g38Wns_0 2024-09-14T12:01:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.244+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1056131267405608541', time=2024-09-14T13:33:49.132685+0000, chain.objs.size()=1 2024-09-14T12:01:19.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.244+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.306__shadow_.APlhxyhsV-KUwP-nirk76CIRm6K2npH_0 2024-09-14T12:01:19.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.246+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14467844715690497911', time=2024-09-14T13:34:09.061328+0000, chain.objs.size()=1 2024-09-14T12:01:19.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.246+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.320__shadow:sMbMnFhe78eTkWtpzLp9GOlk9LZL2uy_.CvulB2biGuxizYs6L7Ok-3gtx-8H2d0_0 2024-09-14T12:01:19.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.246+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15772961152065489379', time=2024-09-14T13:34:10.699970+0000, chain.objs.size()=1 2024-09-14T12:01:19.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.246+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.322__shadow_.bN99OdeMC02Rpg4yfj6WK7G83NYVbW__0 2024-09-14T12:01:19.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.248+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1570686594576419104', time=2024-09-14T13:34:51.975248+0000, chain.objs.size()=1 2024-09-14T12:01:19.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.248+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.8gbBxS7fRaoZ1LJU2VFo3WiAuA4tRy9_0 2024-09-14T12:01:19.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.248+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9837032214259770334', time=2024-09-14T13:34:52.085554+0000, chain.objs.size()=1 2024-09-14T12:01:19.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.248+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.8QtcAlPHpNTspfuF-sVfwjsOrkQKsbR_0 2024-09-14T12:01:19.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.248+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2219304267544949469', time=2024-09-14T13:34:52.305759+0000, chain.objs.size()=1 2024-09-14T12:01:19.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.248+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.adQREhjrYan2ZKokOoCkrLwaCvYgS00_0 2024-09-14T12:01:19.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.248+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13201555688808226122', time=2024-09-14T13:34:52.374253+0000, chain.objs.size()=1 2024-09-14T12:01:19.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.248+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Xroj4cDdN3zITWm4_yjWSLEJK8RZx6w_0 2024-09-14T12:01:19.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.248+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6212476407500888172', time=2024-09-14T13:34:52.551797+0000, chain.objs.size()=1 2024-09-14T12:01:19.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.248+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.es6L8wRBcCiz_G8wBo24Fhg9s6hH9j0_0 2024-09-14T12:01:19.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.248+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11840025418412174169', time=2024-09-14T13:34:53.318755+0000, chain.objs.size()=1 2024-09-14T12:01:19.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.248+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.yJgtTOpsohLG5VP74vY3BE3EJAyvjAB_0 2024-09-14T12:01:19.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.248+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10230867839288220701', time=2024-09-14T13:34:53.319492+0000, chain.objs.size()=1 2024-09-14T12:01:19.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.248+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.MWzWjRzlnrRhz3-Xv39aI7QCY7zsUqD_0 2024-09-14T12:01:19.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.248+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3790018343684648808', time=2024-09-14T13:34:53.535176+0000, chain.objs.size()=1 2024-09-14T12:01:19.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.248+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.F441HlyeoKlVLzvUxMQxaUX7ZLYQA26_0 2024-09-14T12:01:19.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.248+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18360614266593571068', time=2024-09-14T13:34:53.921203+0000, chain.objs.size()=1 2024-09-14T12:01:19.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.248+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.qY8lX1CC-g1jm2xGDrG1K1b0mMwcLfE_0 2024-09-14T12:01:19.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.249+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10020248070859083134', time=2024-09-14T13:34:54.001055+0000, chain.objs.size()=1 2024-09-14T12:01:19.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.249+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.YFnkk5WLeLLG2WPa2OHmc_gQ0vZpN49_0 2024-09-14T12:01:19.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.249+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1383888863988816895', time=2024-09-14T13:34:54.682619+0000, chain.objs.size()=1 2024-09-14T12:01:19.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.249+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.f7UuV1OxRkd1xSH_t2HdEvDzmnbA78D_0 2024-09-14T12:01:19.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.252+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8257725280131913906', time=2024-09-14T13:34:54.700515+0000, chain.objs.size()=1 2024-09-14T12:01:19.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.252+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.lWFii0R5B1GL6t-HAIeaf6AdNhqcrjT_0 2024-09-14T12:01:19.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.253+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8746107236855040909', time=2024-09-14T13:34:55.097008+0000, chain.objs.size()=1 2024-09-14T12:01:19.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.253+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.HQJVBpaYSSmvXA5t2bAcCikDLvVe3Dz_0 2024-09-14T12:01:19.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.253+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2767964839692103680', time=2024-09-14T13:34:55.176960+0000, chain.objs.size()=1 2024-09-14T12:01:19.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.253+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.B99neR35AGi2XRld7-aFQXJOpEG6ckA_0 2024-09-14T12:01:19.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.253+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15022608666662986359', time=2024-09-14T13:34:55.214520+0000, chain.objs.size()=1 2024-09-14T12:01:19.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.253+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.bQscBdmI232ne-UGw_drrGkrPldgw9h_0 2024-09-14T12:01:19.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.253+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12481470334639708575', time=2024-09-14T13:34:55.245316+0000, chain.objs.size()=1 2024-09-14T12:01:19.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.253+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.qas6ekV0WZDEMBtY2Wa_23q1DZEtt7__0 2024-09-14T12:01:19.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.253+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14067258579755154963', time=2024-09-14T13:34:55.499165+0000, chain.objs.size()=1 2024-09-14T12:01:19.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.253+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.O2c4WakOIbziJ3-NKkKOl4-2Swl4q0L_0 2024-09-14T12:01:19.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.254+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12490910746631684785', time=2024-09-14T13:34:55.543405+0000, chain.objs.size()=1 2024-09-14T12:01:19.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.254+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.1SSNt33C1sGg9_0bGPdVSZfbJT63Tqp_0 2024-09-14T12:01:19.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.255+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12143838700625536992', time=2024-09-14T13:34:55.632302+0000, chain.objs.size()=1 2024-09-14T12:01:19.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.255+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.sb_T5yFlhAyR2Lvgt0jlEgjtTWmabo4_0 2024-09-14T12:01:19.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.255+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11633233790733274239', time=2024-09-14T13:34:56.447203+0000, chain.objs.size()=1 2024-09-14T12:01:19.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.255+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.1If7PFhol3kHTCjt0fwYyJ-ueH-6QAI_0 2024-09-14T12:01:19.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.255+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16138065643411562906', time=2024-09-14T13:34:56.448088+0000, chain.objs.size()=1 2024-09-14T12:01:19.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.255+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.yDC63Q6oGmyPK2sybb_Lq78udQ2Hux5_0 2024-09-14T12:01:19.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.255+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13382972163367854392', time=2024-09-14T13:34:56.934895+0000, chain.objs.size()=1 2024-09-14T12:01:19.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.255+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.d8u-7jN0AcW-0notAJGuHAnEn_h-cLX_0 2024-09-14T12:01:19.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.256+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6043679107316458373', time=2024-09-14T13:34:56.967024+0000, chain.objs.size()=1 2024-09-14T12:01:19.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.256+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.JnwtjC8B8-Kn9JMqwbARcWgG7W3PiMW_0 2024-09-14T12:01:19.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.257+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4192463798397319516', time=2024-09-14T13:34:57.120083+0000, chain.objs.size()=1 2024-09-14T12:01:19.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.257+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.nX5WS218l81P9ZknZJEkDALNmjOXxJl_0 2024-09-14T12:01:19.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.257+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2248101170576216693', time=2024-09-14T13:34:57.184512+0000, chain.objs.size()=1 2024-09-14T12:01:19.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.257+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Rw-cxiBLFjhyMHfZ239_OwL24mGaxZv_0 2024-09-14T12:01:19.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.257+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13054446837520148573', time=2024-09-14T13:34:57.671613+0000, chain.objs.size()=1 2024-09-14T12:01:19.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.257+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.dEMNE2wZ-pILPw82HGPJRqCrXTrEQTt_0 2024-09-14T12:01:19.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.257+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14939972159878842340', time=2024-09-14T13:34:57.821117+0000, chain.objs.size()=1 2024-09-14T12:01:19.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.257+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.iBAVFYpb2_yuKZiRmniKQl2cXb74rzN_0 2024-09-14T12:01:19.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.257+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13914170007012827823', time=2024-09-14T13:34:57.961529+0000, chain.objs.size()=1 2024-09-14T12:01:19.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.257+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.7jx0tmZSXuu1bHlKG8Al1fQVxIM0ihq_0 2024-09-14T12:01:19.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.257+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15128912664271081944', time=2024-09-14T13:34:58.261619+0000, chain.objs.size()=1 2024-09-14T12:01:19.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.257+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.odpA8nnveBOWQ5yfmvcIOknUC7-jHNr_0 2024-09-14T12:01:19.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.257+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.779387243436460877', time=2024-09-14T13:34:58.653086+0000, chain.objs.size()=1 2024-09-14T12:01:19.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.257+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.uiuMX8aZY6-uh6sXwvup9G28UMV2pGV_0 2024-09-14T12:01:19.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.259+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2125069420053495024', time=2024-09-14T13:34:58.682065+0000, chain.objs.size()=1 2024-09-14T12:01:19.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.259+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.HFSKdmE-94C1xVlRyvGnsDGth8GfIhd_0 2024-09-14T12:01:19.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.259+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4403261848019081043', time=2024-09-14T13:34:59.383524+0000, chain.objs.size()=1 2024-09-14T12:01:19.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.259+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.U4ZCO3gd__REP_UjksoIJfOIAlWKInc_0 2024-09-14T12:01:19.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.259+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17117555596080506819', time=2024-09-14T13:34:59.605255+0000, chain.objs.size()=1 2024-09-14T12:01:19.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.259+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.H8yICjr8AoBhLev7goHGQTpbhta8Z2q_0 2024-09-14T12:01:19.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.259+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12510694957483733874', time=2024-09-14T13:34:59.721518+0000, chain.objs.size()=1 2024-09-14T12:01:19.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.259+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.V-yiTpbL7vev8ozmM2frp_w3nzr7_bf_0 2024-09-14T12:01:19.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.259+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18398268071383676736', time=2024-09-14T13:35:00.014490+0000, chain.objs.size()=1 2024-09-14T12:01:19.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.259+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.aSNIqKY88viI_f58bRAPBzc6ippr5qF_0 2024-09-14T12:01:19.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.261+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18225989971467278426', time=2024-09-14T13:35:00.070043+0000, chain.objs.size()=1 2024-09-14T12:01:19.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.261+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Nz_h-RVix5ZPfatFFRckh2K2IerUDGA_0 2024-09-14T12:01:19.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.262+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8503700819558785558', time=2024-09-14T13:35:00.433641+0000, chain.objs.size()=1 2024-09-14T12:01:19.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.262+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.QMBS-ky6PZdNvd_t4qU6tTS-rpeS9PR_0 2024-09-14T12:01:19.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.263+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14454688917459568829', time=2024-09-14T13:35:00.477800+0000, chain.objs.size()=1 2024-09-14T12:01:19.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.263+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.4SQ22L4pHe5pRNMtP6HfCNSoNpTi04n_0 2024-09-14T12:01:19.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.263+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.727751716036152815', time=2024-09-14T13:35:00.478624+0000, chain.objs.size()=1 2024-09-14T12:01:19.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.263+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.0eL5vOGYFCkg2sRY_MoXZwkWjCN1jmf_0 2024-09-14T12:01:19.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.263+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10482347879794063962', time=2024-09-14T13:35:00.609975+0000, chain.objs.size()=1 2024-09-14T12:01:19.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.263+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.VcQr-q0Pg_IHSo4izibC0Yfo_GHVkS4_0 2024-09-14T12:01:19.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.263+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4982470901877120035', time=2024-09-14T13:35:00.889787+0000, chain.objs.size()=1 2024-09-14T12:01:19.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.263+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.1jlrcj2XV5uzpFMNgWGvcQxoNEh1jGV_0 2024-09-14T12:01:19.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.263+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9424725725231379312', time=2024-09-14T13:35:00.890425+0000, chain.objs.size()=1 2024-09-14T12:01:19.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.263+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.lf_KDpFFlZvUgFgLwkzXyeWRzO_-Y6p_0 2024-09-14T12:01:19.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.263+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1142678690344967888', time=2024-09-14T13:35:00.932079+0000, chain.objs.size()=1 2024-09-14T12:01:19.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.263+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.IpR5eYZb6AG8_AXfxQJFo2cYssltOg7_0 2024-09-14T12:01:19.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.263+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11630748022451267784', time=2024-09-14T13:35:01.994332+0000, chain.objs.size()=1 2024-09-14T12:01:19.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.263+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.E9rAOp_lAtA4xEXQQ0I7M9CLIT2tFws_0 2024-09-14T12:01:19.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.264+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7840111316748629472', time=2024-09-14T13:35:02.660742+0000, chain.objs.size()=1 2024-09-14T12:01:19.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.264+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.QUq8sbCULPrjbh2rjNqWhb01j04cNYF_0 2024-09-14T12:01:19.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.264+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10953740414967350931', time=2024-09-14T13:35:41.817999+0000, chain.objs.size()=1 2024-09-14T12:01:19.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.264+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ZIeft4rHwmZajb5_9DIFx1Q2ivyAncQ_0 2024-09-14T12:01:19.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.267+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1932062855483313560', time=2024-09-14T13:35:42.345148+0000, chain.objs.size()=1 2024-09-14T12:01:19.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.267+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.j_0pkBEr908dgL5bNHXE9jjWKysAAmh_0 2024-09-14T12:01:19.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.267+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1330430359961347192', time=2024-09-14T13:35:43.242640+0000, chain.objs.size()=1 2024-09-14T12:01:19.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.267+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.vTHWilWPNM9oKo2d8TNWVENlH9jzAeb_0 2024-09-14T12:01:19.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.268+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9431183454516494879', time=2024-09-14T13:35:43.555102+0000, chain.objs.size()=1 2024-09-14T12:01:19.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.268+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.tWKFKQlYJETdrcOW7W_FkrgsB8n0riq_0 2024-09-14T12:01:19.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.268+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18404896447497289042', time=2024-09-14T13:35:43.566181+0000, chain.objs.size()=1 2024-09-14T12:01:19.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.268+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.sn3xXrJywTG70TWXHNbyanjLzMn2B_1_0 2024-09-14T12:01:19.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.268+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7251837199617841841', time=2024-09-14T13:35:44.150814+0000, chain.objs.size()=1 2024-09-14T12:01:19.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.268+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Uf59PuT0p_gFJe3KUTfmqQjkKpzyZX8_0 2024-09-14T12:01:19.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.268+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8297471317303495614', time=2024-09-14T13:35:44.287012+0000, chain.objs.size()=1 2024-09-14T12:01:19.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.268+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.8LIvCPHxozD8rsJvhxkXJ3LFEaFNSwy_0 2024-09-14T12:01:19.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.268+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15580200347447166041', time=2024-09-14T13:35:44.321819+0000, chain.objs.size()=1 2024-09-14T12:01:19.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.268+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.1NKiT0Vqy1q5uH9CSsOmh-mwR6Zy5bv_0 2024-09-14T12:01:19.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.271+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/48216 2024-09-14T12:01:19.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=44, truncated=0, next_marker='' 2024-09-14T12:01:19.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6371686834014963514', time=2024-09-14T13:35:44.990237+0000, chain.objs.size()=1 2024-09-14T12:01:19.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.wCo5_3rCSSL-S04QBy5I13Pa9RwcXUa_0 2024-09-14T12:01:19.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4191558850296359904', time=2024-09-14T13:35:45.112635+0000, chain.objs.size()=1 2024-09-14T12:01:19.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.gopdiKFlxAFiH67y-08OwVinB87KHO2_0 2024-09-14T12:01:19.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16629334553713840365', time=2024-09-14T13:35:45.113765+0000, chain.objs.size()=1 2024-09-14T12:01:19.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.BNDIKa5fFjGE5RkRH00L9TOtoHMZcG8_0 2024-09-14T12:01:19.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9259393921690689946', time=2024-09-14T13:35:45.436143+0000, chain.objs.size()=1 2024-09-14T12:01:19.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.XVc6aCcqUjxoGDv6HDpJyw0BhQ9i4Au_0 2024-09-14T12:01:19.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8425456234671355231', time=2024-09-14T13:35:45.436944+0000, chain.objs.size()=1 2024-09-14T12:01:19.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.F03ZCH3OS79ITYWn0ykYO7KDpUp3Mmu_0 2024-09-14T12:01:19.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13002472818950904586', time=2024-09-14T13:35:45.531054+0000, chain.objs.size()=1 2024-09-14T12:01:19.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.zC28GqI0w-OlQsflT2pA8CSSm5WQiWX_0 2024-09-14T12:01:19.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11782077985597527858', time=2024-09-14T13:35:46.288415+0000, chain.objs.size()=1 2024-09-14T12:01:19.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.L1tEJofEm5FfPbGcmkMM7Dk9FFlbOh4_0 2024-09-14T12:01:19.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5921462715470798062', time=2024-09-14T13:35:46.431663+0000, chain.objs.size()=1 2024-09-14T12:01:19.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.RgXs4-e58aoug6OlEJBUmtKus_8gCqk_0 2024-09-14T12:01:19.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17038324243324874386', time=2024-09-14T13:35:46.813426+0000, chain.objs.size()=1 2024-09-14T12:01:19.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.cRZ7L_ac2Hp48_pOUDEPE6E38MZrbja_0 2024-09-14T12:01:19.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18405435401391011158', time=2024-09-14T13:35:47.017313+0000, chain.objs.size()=1 2024-09-14T12:01:19.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.RthN025WeuWf6PZS4L1v_0zzVT2xguj_0 2024-09-14T12:01:19.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10928544784295965065', time=2024-09-14T13:35:47.119970+0000, chain.objs.size()=1 2024-09-14T12:01:19.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.d3ajYlEw8PJPZweJsEnKM57UCBDWtSC_0 2024-09-14T12:01:19.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18103704436549516068', time=2024-09-14T13:35:47.232547+0000, chain.objs.size()=1 2024-09-14T12:01:19.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.274+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.pWRM7hcOzhuuNQD2IdkIB-mmawbCTEH_0 2024-09-14T12:01:19.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.276+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11335618254957651832', time=2024-09-14T13:35:47.300559+0000, chain.objs.size()=1 2024-09-14T12:01:19.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.276+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.KJIs3cL_Rw_h9GJnfCjpU2ZsVeIBTH7_0 2024-09-14T12:01:19.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.276+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8841109459273401268', time=2024-09-14T13:35:47.780595+0000, chain.objs.size()=1 2024-09-14T12:01:19.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.276+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.RBD1taph4Nb0SbT3KX0tKcoYUTGlyNi_0 2024-09-14T12:01:19.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.277+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16711361823209436484', time=2024-09-14T13:35:47.871249+0000, chain.objs.size()=1 2024-09-14T12:01:19.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.277+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.J_XkjEunwfIpk1oNNoTwVLbjV_rW8g8_0 2024-09-14T12:01:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.278+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13112994129488864533', time=2024-09-14T13:35:48.462898+0000, chain.objs.size()=1 2024-09-14T12:01:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.278+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.w2s6mYVrOssvKu95aEP1aj58An5VT8Q_0 2024-09-14T12:01:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.278+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10387409721609217499', time=2024-09-14T13:35:48.486268+0000, chain.objs.size()=1 2024-09-14T12:01:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.278+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.i4rXMR_kRo5Vv09Ps0JlnVxamTNkPZc_0 2024-09-14T12:01:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.278+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9288557879794401642', time=2024-09-14T13:35:48.831023+0000, chain.objs.size()=1 2024-09-14T12:01:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.278+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.zvJkP4uH1jAsnEsxTxn0i4H0VTSd43S_0 2024-09-14T12:01:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.278+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.819734726764947001', time=2024-09-14T13:35:49.782474+0000, chain.objs.size()=1 2024-09-14T12:01:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.278+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.asTYenm0GXv6jnnKwCotw3uRqkMRsLN_0 2024-09-14T12:01:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.278+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13337976045938486150', time=2024-09-14T13:35:49.805323+0000, chain.objs.size()=1 2024-09-14T12:01:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.278+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.cCbKufnVZeg69uwyb2V578BvUQJFJRF_0 2024-09-14T12:01:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.278+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2802853346803721342', time=2024-09-14T13:35:49.868797+0000, chain.objs.size()=1 2024-09-14T12:01:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.278+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.yx543xc2wNczRhTrcrHgaA3Og67TMLb_0 2024-09-14T12:01:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.278+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.526007412359769424', time=2024-09-14T13:35:49.983166+0000, chain.objs.size()=1 2024-09-14T12:01:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.278+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.piGTRoy7IPm9-rqlZtWZnClSjcksok6_0 2024-09-14T12:01:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.278+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17820024338306832546', time=2024-09-14T13:35:50.725910+0000, chain.objs.size()=1 2024-09-14T12:01:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.278+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.EpSQbH1_A7ZkwPnnWXf2NdeqaBpTTwr_0 2024-09-14T12:01:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.280+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1405119828716132490', time=2024-09-14T13:35:50.861445+0000, chain.objs.size()=1 2024-09-14T12:01:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.280+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.URbMc1nRNo2YwNcubACIJQidfv6ZZrI_0 2024-09-14T12:01:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.280+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.841586104373184714', time=2024-09-14T13:35:51.068338+0000, chain.objs.size()=1 2024-09-14T12:01:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.280+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.KtnefFAeSUnjUe-H1Hh1fvW3h01Ym8l_0 2024-09-14T12:01:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.280+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2882412481143530589', time=2024-09-14T13:35:51.268057+0000, chain.objs.size()=1 2024-09-14T12:01:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.280+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.oCRPMxsJ_8j9oskfH0YWha8vqHZVoi6_0 2024-09-14T12:01:19.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.281+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.787552010094264715', time=2024-09-14T13:35:51.390698+0000, chain.objs.size()=1 2024-09-14T12:01:19.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.281+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Eg1vmaqDiBbgg9toRRHg-MEZ9DbNNCh_0 2024-09-14T12:01:19.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.281+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17002736666833242575', time=2024-09-14T13:35:51.471147+0000, chain.objs.size()=1 2024-09-14T12:01:19.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.281+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.5CPCw_qx4PMEehNSXCnc-a8-SJ44G57_0 2024-09-14T12:01:19.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.282+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4972126299851860928', time=2024-09-14T13:35:51.961696+0000, chain.objs.size()=1 2024-09-14T12:01:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.282+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.es1ePjJPctO5Oc3EbFEHnp7pRkwUJLV_0 2024-09-14T12:01:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.282+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.311904477653147334', time=2024-09-14T13:35:52.200804+0000, chain.objs.size()=1 2024-09-14T12:01:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.282+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.HBM8bIVF8ARJQ2RFhuEh1nX7KoJJa3t_0 2024-09-14T12:01:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.283+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15789033505021829875', time=2024-09-14T13:35:52.566519+0000, chain.objs.size()=1 2024-09-14T12:01:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.283+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.expUnAKh4QT1DQYQpDDwfaUoUkICBnS_0 2024-09-14T12:01:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.283+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16813763234816557122', time=2024-09-14T13:35:56.617366+0000, chain.objs.size()=1 2024-09-14T12:01:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.283+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.329__shadow_.ShpvNZ1HRuBJGavH9ptudRSBB1nG_3j_0 2024-09-14T12:01:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.283+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12224219260331170516', time=2024-09-14T13:38:51.330079+0000, chain.objs.size()=1 2024-09-14T12:01:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.283+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.489__shadow_.THjO7g8tNtGx2_rk0jMhtwl50cD7szb_0 2024-09-14T12:01:19.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.284+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17424069332196179313', time=2024-09-14T13:39:55.253999+0000, chain.objs.size()=1 2024-09-14T12:01:19.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.284+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.518__shadow_.VYwqqL0eZGyoh1fK6g3h3dD-PUb_LbW_0 2024-09-14T12:01:19.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.284+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12633671517244796637', time=2024-09-14T13:45:14.639528+0000, chain.objs.size()=1 2024-09-14T12:01:19.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.284+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.559__shadow_.vMfmCZeYu2lufFeR8wDMqKqzdho_6Gc_0 2024-09-14T12:01:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.285+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8279857802056973826', time=2024-09-14T13:45:18.276250+0000, chain.objs.size()=1 2024-09-14T12:01:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.285+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.560__shadow_.VjHAN_Zxxp-909PU_kR-7ukuuYCnvDE_0 2024-09-14T12:01:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.285+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13858538782286903640', time=2024-09-14T13:45:22.067796+0000, chain.objs.size()=1 2024-09-14T12:01:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.285+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.563__shadow_.VLeciQahmP52oqTzqoSpYNhyl40HLMV_0 2024-09-14T12:01:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.285+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11561636144953371950', time=2024-09-14T13:47:37.286411+0000, chain.objs.size()=1 2024-09-14T12:01:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.285+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.604__shadow_.xfTSXbsKSm-Bnc71-rIHSZOyPnz8KEF_0 2024-09-14T12:01:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.285+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17381453865049143629', time=2024-09-14T13:49:39.606224+0000, chain.objs.size()=1 2024-09-14T12:01:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.285+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.617__shadow_.J-9CAnedIvwmR_F9Etq6HDM-vS-Zkaz_0 2024-09-14T12:01:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.285+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9462243273265242583', time=2024-09-14T13:50:41.081377+0000, chain.objs.size()=1 2024-09-14T12:01:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.285+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.618__shadow_.eI258vXJNVniJkgaeWzsvMkQ9FJyCfR_0 2024-09-14T12:01:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.285+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16097298096109433652', time=2024-09-14T13:53:06.495162+0000, chain.objs.size()=1 2024-09-14T12:01:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.285+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.647__shadow_.feg78I-uhlDZnTu7cH9g6wwh1qhO_yo_0 2024-09-14T12:01:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.286+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13650190779424596559', time=2024-09-14T13:54:31.641124+0000, chain.objs.size()=1 2024-09-14T12:01:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.286+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.702__shadow:gHQMNBnY9pRWgusjs.7BPfJ5Q4waKZI_.BTel_9QIFIOTacujSVdew5cmSp_qIwV_0 2024-09-14T12:01:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.286+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2997809223305230790', time=2024-09-14T13:55:41.443546+0000, chain.objs.size()=1 2024-09-14T12:01:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.286+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.741__shadow_.P2WM5TdaVVxZK-bxHUCkfBZfCMPGp-N_0 2024-09-14T12:01:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.287+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8043075840919993758', time=2024-09-14T13:55:52.033428+0000, chain.objs.size()=1 2024-09-14T12:01:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.287+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.745__shadow_.GdJqyZSQ1YuTIAjbWkwzlnB5qNkssZ-_0 2024-09-14T12:01:19.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.290+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:19.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.292+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T12:01:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.293+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.294+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.295+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44888' 2024-09-14T12:01:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.295+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15642718640486271816', time=2024-09-14T13:27:59.905869+0000, chain.objs.size()=2 2024-09-14T12:01:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.295+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.161__shadow_.YAk4klB0mo-ujJXxqkyx7ZjZ0LfjmCG_0 2024-09-14T12:01:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.295+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.161__shadow_.YAk4klB0mo-ujJXxqkyx7ZjZ0LfjmCG_1 2024-09-14T12:01:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.295+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='_ijjVN3E_zELiu2d8yithyPo2SbZTT_8', time=2024-09-14T13:28:06.875455+0000, chain.objs.size()=2 2024-09-14T12:01:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.295+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.161__shadow_.gouOR2DXkAEI3CBtjp3THbZUynMRlKK_0 2024-09-14T12:01:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.295+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.161__shadow_.gouOR2DXkAEI3CBtjp3THbZUynMRlKK_1 2024-09-14T12:01:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.295+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1876518159993142106', time=2024-09-14T13:31:31.297167+0000, chain.objs.size()=1 2024-09-14T12:01:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.295+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.229__shadow_.7MgkrIKXi38PzhpCz4bdf1VXKI7rUwQ_0 2024-09-14T12:01:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.295+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3362906200547202464', time=2024-09-14T13:31:56.230964+0000, chain.objs.size()=1 2024-09-14T12:01:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.295+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.250__shadow_.I0KvM8NarZ-SCDoT5wjLkD0cDJ_itXo_0 2024-09-14T12:01:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.295+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.508361029618797665', time=2024-09-14T13:31:58.422821+0000, chain.objs.size()=1 2024-09-14T12:01:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.295+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.252__shadow_.v4PtfOWuUC7bluiq9QpjE7tAvLbuLSb_0 2024-09-14T12:01:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.295+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17644532123854754689', time=2024-09-14T13:32:47.583524+0000, chain.objs.size()=1 2024-09-14T12:01:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.295+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.BejR69zoeRn6maSnFilUVg624bZzMWF_0 2024-09-14T12:01:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.295+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17820988636877811719', time=2024-09-14T13:32:47.919630+0000, chain.objs.size()=1 2024-09-14T12:01:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.295+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.b7j3g5pIWAbKnP9hjbDnqJq5dVXUFj5_0 2024-09-14T12:01:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.295+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6670744379837351750', time=2024-09-14T13:32:48.072511+0000, chain.objs.size()=1 2024-09-14T12:01:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.295+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.6h3yIvkL4-UCu493UvxsDI6mZiy4H7y_0 2024-09-14T12:01:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.295+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15250397413449873808', time=2024-09-14T13:32:48.347831+0000, chain.objs.size()=1 2024-09-14T12:01:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.295+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Byo_qjWw-2FDmKU-AfwOLTO00tQmEic_0 2024-09-14T12:01:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.295+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6324715400571298717', time=2024-09-14T13:32:49.125218+0000, chain.objs.size()=1 2024-09-14T12:01:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.295+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.0yvNgYqQ539m9wBvHyiyv4264tJ_JMP_0 2024-09-14T12:01:19.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.299+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5030411558110302734', time=2024-09-14T13:32:49.173129+0000, chain.objs.size()=1 2024-09-14T12:01:19.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.299+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.sekEvwWZnHgXLW87W_93Ook_k24Ihw9_0 2024-09-14T12:01:19.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.299+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14650131973766362210', time=2024-09-14T13:32:49.283127+0000, chain.objs.size()=1 2024-09-14T12:01:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.299+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.LshOPK3LeNciGHcYdsTuGMJOowIaUIt_0 2024-09-14T12:01:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.299+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18078740173281952322', time=2024-09-14T13:32:49.479183+0000, chain.objs.size()=1 2024-09-14T12:01:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.299+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.kgZjZAciARUBZnh23zlmIgpUYrd-fiT_0 2024-09-14T12:01:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.299+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14606370619705042579', time=2024-09-14T13:32:49.619521+0000, chain.objs.size()=1 2024-09-14T12:01:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.299+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.XkZGc3E5vOiaeaNq6QOi2HDG-vx0Y1V_0 2024-09-14T12:01:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.299+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1587203039888954541', time=2024-09-14T13:32:49.702860+0000, chain.objs.size()=1 2024-09-14T12:01:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.299+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.FOtA-yMmGmwnoqhdQUqAH_V8sj12D_a_0 2024-09-14T12:01:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.299+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16160678387240439039', time=2024-09-14T13:32:49.703551+0000, chain.objs.size()=1 2024-09-14T12:01:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.299+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.k4PuLQs4qWM1OszPHlvxwULY6zDjtI7_0 2024-09-14T12:01:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.299+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1986867943227419584', time=2024-09-14T13:32:50.650742+0000, chain.objs.size()=1 2024-09-14T12:01:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.299+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.L1xgB71NUj0FfEKSFs4HSG4czmcV6VZ_0 2024-09-14T12:01:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.299+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10771551447987220442', time=2024-09-14T13:32:51.044954+0000, chain.objs.size()=1 2024-09-14T12:01:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.299+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.cfw4DJUDR0HWFBYYjKI9WGgZ9hcFE-i_0 2024-09-14T12:01:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.299+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14363098160573534617', time=2024-09-14T13:32:51.320034+0000, chain.objs.size()=1 2024-09-14T12:01:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.299+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Uv0G369HHLXuja-9hs5LE94vHzslEQr_0 2024-09-14T12:01:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.299+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15859191730640495847', time=2024-09-14T13:32:51.497585+0000, chain.objs.size()=1 2024-09-14T12:01:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.299+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.EYSjClxjRMjb8LyG3ajZ0jykcGfT5wa_0 2024-09-14T12:01:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.299+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15197605923063139517', time=2024-09-14T13:32:51.585204+0000, chain.objs.size()=1 2024-09-14T12:01:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.299+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.aKLxiBWVbi-Pj-qFg0nNBE_OkBcPZ8Q_0 2024-09-14T12:01:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.303+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10884747120296969304', time=2024-09-14T13:32:52.207084+0000, chain.objs.size()=1 2024-09-14T12:01:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.303+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.cg4zpEutk3yfzzUWcS5HaEjYMhYNneq_0 2024-09-14T12:01:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.303+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6271510967322440250', time=2024-09-14T13:32:52.450882+0000, chain.objs.size()=1 2024-09-14T12:01:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.303+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Ux0vmCSDYxbstUU_pnWoMVRHu0CZXyx_0 2024-09-14T12:01:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.303+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9020695370086784254', time=2024-09-14T13:32:52.828900+0000, chain.objs.size()=1 2024-09-14T12:01:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.303+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.oVXFm2EhCLIXYW3kcUVbOZWhIgK4jGV_0 2024-09-14T12:01:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.303+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17029058609952283293', time=2024-09-14T13:32:53.516265+0000, chain.objs.size()=1 2024-09-14T12:01:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.303+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.oqeck6Qw6Os4I0ehvGAiLiF1jCnOFap_0 2024-09-14T12:01:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.303+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15847344086605596651', time=2024-09-14T13:32:53.797792+0000, chain.objs.size()=1 2024-09-14T12:01:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.303+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.RE0qMdhH2f4Ca-fUOzj-0UuFo9Niela_0 2024-09-14T12:01:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.303+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14819568565508179644', time=2024-09-14T13:32:53.848490+0000, chain.objs.size()=1 2024-09-14T12:01:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.303+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.sLLDUpC6p1EbC3hVUs44weqdmt1JMH5_0 2024-09-14T12:01:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.303+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12480737594600108645', time=2024-09-14T13:32:54.208370+0000, chain.objs.size()=1 2024-09-14T12:01:19.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.303+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.mYLkywPF_wv84um-M2kxHH9gmVrHTfY_0 2024-09-14T12:01:19.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.303+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7892549880468382772', time=2024-09-14T13:32:54.530581+0000, chain.objs.size()=1 2024-09-14T12:01:19.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.303+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Q-FWQspAZrtSP49xjQGStCfIHQ8xWVi_0 2024-09-14T12:01:19.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.303+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8274555468818164896', time=2024-09-14T13:32:54.981147+0000, chain.objs.size()=1 2024-09-14T12:01:19.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.303+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.pDJq7WZRzPfgsghOYQETVSsWbDZbO5w_0 2024-09-14T12:01:19.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.303+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15915220885052894089', time=2024-09-14T13:32:55.120296+0000, chain.objs.size()=1 2024-09-14T12:01:19.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.303+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Sg9ucZeCj8UjfxyiaNBJyJ4Nw9ipKgZ_0 2024-09-14T12:01:19.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.303+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14445170448121126975', time=2024-09-14T13:32:55.288803+0000, chain.objs.size()=1 2024-09-14T12:01:19.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.303+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Njuygfxl47b0wDIGIVMYtyrLHexcnJ4_0 2024-09-14T12:01:19.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.307+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3357918224867221839', time=2024-09-14T13:32:55.335580+0000, chain.objs.size()=1 2024-09-14T12:01:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.307+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.QFzfukBzpdf9xe4rh1DUMA2UO2MTyEf_0 2024-09-14T12:01:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.307+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16059154957571072886', time=2024-09-14T13:32:55.616963+0000, chain.objs.size()=1 2024-09-14T12:01:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.307+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.2HkEXrRM2MA-jnJAI8AtHtRfshUPtQs_0 2024-09-14T12:01:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.307+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.150632742764135958', time=2024-09-14T13:32:55.665648+0000, chain.objs.size()=1 2024-09-14T12:01:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.307+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.8eK1e4J8s0ZFVcO6iF9seMqSdJ-fX8w_0 2024-09-14T12:01:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.307+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15086766198337995548', time=2024-09-14T13:32:56.504363+0000, chain.objs.size()=1 2024-09-14T12:01:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.307+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Dn6GvrwFQBwQEm7nhPK1UjiUB_y7KZW_0 2024-09-14T12:01:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.307+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6500308925504747302', time=2024-09-14T13:32:56.850063+0000, chain.objs.size()=1 2024-09-14T12:01:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.307+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.3vaoF60J6hsFQ5n4gHlxZYZQH2qH_3__0 2024-09-14T12:01:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.307+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3424938417596257148', time=2024-09-14T13:32:57.918342+0000, chain.objs.size()=1 2024-09-14T12:01:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.307+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.ltcMZF0ugItDd6rrwLMduK0X-k5P4N2_0 2024-09-14T12:01:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.307+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.964040658314100437', time=2024-09-14T13:32:58.319383+0000, chain.objs.size()=1 2024-09-14T12:01:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.307+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.j4IzNU7DP0MD01ehdmaeLvcy0CxN-_d_0 2024-09-14T12:01:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.307+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.502849023025742821', time=2024-09-14T13:32:58.387567+0000, chain.objs.size()=1 2024-09-14T12:01:19.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.307+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.G-dSrjIpG_pdUj8NONPKiLF5ZX5xMvG_0 2024-09-14T12:01:19.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.307+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16371777802043288221', time=2024-09-14T13:33:12.694865+0000, chain.objs.size()=1 2024-09-14T12:01:19.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.307+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.276__shadow_.5DrP54dC7LFa7v2mWJssUMtgRLLdBSU_0 2024-09-14T12:01:19.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.307+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12301373078198444047', time=2024-09-14T13:33:15.989712+0000, chain.objs.size()=1 2024-09-14T12:01:19.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.307+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.279__shadow_.M9e38erwG0EDNlBqv2suSIBCcUfyL6O_0 2024-09-14T12:01:19.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.307+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6072532743014692951', time=2024-09-14T13:33:20.367359+0000, chain.objs.size()=1 2024-09-14T12:01:19.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.307+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.283__shadow_.vDQlNu0dJOk1jcPn9HWf2LizzSy6Bsw_0 2024-09-14T12:01:19.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.310+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14739192298655968473', time=2024-09-14T13:33:24.920682+0000, chain.objs.size()=1 2024-09-14T12:01:19.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.310+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.287__shadow_.gmRlOxo1XGuseaGseUmhRQEhYN0r-AA_0 2024-09-14T12:01:19.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.310+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3090927211646007683', time=2024-09-14T13:33:35.573794+0000, chain.objs.size()=1 2024-09-14T12:01:19.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.310+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.GiOjOZCARJarJFN9lt-BPD_lGhP8zvF_0 2024-09-14T12:01:19.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.310+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17000348753704377971', time=2024-09-14T13:34:51.508677+0000, chain.objs.size()=1 2024-09-14T12:01:19.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.310+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.fp929nlWfBftmyglTp7fE4202vStXZ8_0 2024-09-14T12:01:19.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.310+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13864790439576032974', time=2024-09-14T13:34:51.650248+0000, chain.objs.size()=1 2024-09-14T12:01:19.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.310+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.JRxosf2PfN7APOmUgAa6RNSSHXCzBSJ_0 2024-09-14T12:01:19.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.312+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6482017637640220572', time=2024-09-14T13:34:51.703936+0000, chain.objs.size()=1 2024-09-14T12:01:19.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.312+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.X_l3xWnEMok-khRRpQRXxlY4-MPMli9_0 2024-09-14T12:01:19.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.312+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16084836281977446015', time=2024-09-14T13:34:52.008043+0000, chain.objs.size()=1 2024-09-14T12:01:19.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.312+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.NTFt0myqrVmaJWqRgwH1g367GwNNWpB_0 2024-09-14T12:01:19.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.312+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10100349981643420837', time=2024-09-14T13:34:52.177646+0000, chain.objs.size()=1 2024-09-14T12:01:19.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.312+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.IOeJAMkTmH89NLoqMjO_pJbpvAccWkY_0 2024-09-14T12:01:19.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.312+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.314934418254976695', time=2024-09-14T13:34:52.542402+0000, chain.objs.size()=1 2024-09-14T12:01:19.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.312+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Mnwrv1TsAt29r0r_1evvUyV-ZdQHM5j_0 2024-09-14T12:01:19.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.312+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8011117460736650470', time=2024-09-14T13:34:53.149538+0000, chain.objs.size()=1 2024-09-14T12:01:19.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.312+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.06gm83ayOMzdztl6O5AaOvCN6LH-8dL_0 2024-09-14T12:01:19.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.312+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10277899544479616202', time=2024-09-14T13:34:53.697178+0000, chain.objs.size()=1 2024-09-14T12:01:19.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.312+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.x0Tf4Nh6xJ26MOUyZd4xB3pFfLOixix_0 2024-09-14T12:01:19.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.312+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6349142586860536269', time=2024-09-14T13:34:53.950625+0000, chain.objs.size()=1 2024-09-14T12:01:19.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.312+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Rx657m1PXNxUyZGJCfyIDKn321gIa4x_0 2024-09-14T12:01:19.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.314+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17241674106387539986', time=2024-09-14T13:34:54.105456+0000, chain.objs.size()=1 2024-09-14T12:01:19.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.314+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.rgew8cUEFCyKlqCHszYmCxKHsuOEWVB_0 2024-09-14T12:01:19.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.315+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4795429629705627649', time=2024-09-14T13:34:54.758109+0000, chain.objs.size()=1 2024-09-14T12:01:19.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.315+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.wo3y4W9YyoiV0R3BWUk2Bo0GJuzgJaH_0 2024-09-14T12:01:19.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.315+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7960947056930483876', time=2024-09-14T13:34:54.840086+0000, chain.objs.size()=1 2024-09-14T12:01:19.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.315+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.uval9qkCbAQMBSbYkm7HKVPsqlBH87N_0 2024-09-14T12:01:19.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.316+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13806915469869155435', time=2024-09-14T13:34:55.306420+0000, chain.objs.size()=1 2024-09-14T12:01:19.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.316+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.gnHHKN7Bclspnlr2MmLknJMLvqG8vhD_0 2024-09-14T12:01:19.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.317+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12250546134111251322', time=2024-09-14T13:34:55.459718+0000, chain.objs.size()=1 2024-09-14T12:01:19.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.317+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.uu8IHFSSr-kg0Oisa9obyPccfXBSq4l_0 2024-09-14T12:01:19.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.317+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12072039988673204413', time=2024-09-14T13:34:55.518162+0000, chain.objs.size()=1 2024-09-14T12:01:19.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.317+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.GgG7Wx1BDuVYF55mfQYyqeBwaNw1FLQ_0 2024-09-14T12:01:19.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.317+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15398730127393683734', time=2024-09-14T13:34:55.603881+0000, chain.objs.size()=1 2024-09-14T12:01:19.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.317+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.JD6t_AXL_xbCbRBAgfk6te6AkCZAQD8_0 2024-09-14T12:01:19.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.317+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11448578973537838870', time=2024-09-14T13:34:55.701313+0000, chain.objs.size()=1 2024-09-14T12:01:19.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.317+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.xXth_0Dca2V-Gt3eQCuJZ8rFy1pSQDF_0 2024-09-14T12:01:19.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.317+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11950840021684464', time=2024-09-14T13:34:56.369160+0000, chain.objs.size()=1 2024-09-14T12:01:19.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.317+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.P7L5HkTPPyYHkPYnX1Ct3K-5Yto6RJI_0 2024-09-14T12:01:19.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.317+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4692587525235512363', time=2024-09-14T13:34:57.616246+0000, chain.objs.size()=1 2024-09-14T12:01:19.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.317+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.e2R9c-qSb3w4JJmSli05RRCDKYY0vPo_0 2024-09-14T12:01:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.317+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10897322354665398942', time=2024-09-14T13:34:57.643713+0000, chain.objs.size()=1 2024-09-14T12:01:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.317+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.bnd6x_4vU6At5VzqGqI8cLbF7TvLgcr_0 2024-09-14T12:01:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.319+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14818910249244278882', time=2024-09-14T13:34:57.838795+0000, chain.objs.size()=1 2024-09-14T12:01:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.319+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.osZhrYGa6KOWyjViXRPSePhrAZT81mZ_0 2024-09-14T12:01:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.319+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.121828097993735669', time=2024-09-14T13:34:58.500828+0000, chain.objs.size()=1 2024-09-14T12:01:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.319+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.xJQ7rbOfV0dVBWtxMOgjcZmz59dz3Rw_0 2024-09-14T12:01:19.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.319+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12258357024906873943', time=2024-09-14T13:34:59.343050+0000, chain.objs.size()=1 2024-09-14T12:01:19.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.319+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.AaUArAiyITOf0DhHioGpPWLVVDsuEJc_0 2024-09-14T12:01:19.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.319+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15705356435483119294', time=2024-09-14T13:34:59.607887+0000, chain.objs.size()=1 2024-09-14T12:01:19.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.319+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.5V652yTUwMu32KluE9rpu5KstwTC7Tw_0 2024-09-14T12:01:19.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.320+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17573068271648075206', time=2024-09-14T13:34:59.730986+0000, chain.objs.size()=1 2024-09-14T12:01:19.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.320+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.NUgG7TdeOt_ZtoRAjEOACgcqDs-pJ_w_0 2024-09-14T12:01:19.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.320+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3010469397759077937', time=2024-09-14T13:34:59.753822+0000, chain.objs.size()=1 2024-09-14T12:01:19.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.320+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.wOB5nJMApPj34-stnd6Rtm9uqoKH3Bx_0 2024-09-14T12:01:19.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.321+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3763917251659711869', time=2024-09-14T13:35:00.002557+0000, chain.objs.size()=1 2024-09-14T12:01:19.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.321+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.vm5d7amVjnsRipihU9fkDAiUKtt4Sdb_0 2024-09-14T12:01:19.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.322+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16935983434180537408', time=2024-09-14T13:35:00.041175+0000, chain.objs.size()=1 2024-09-14T12:01:19.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.322+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.dRU5FdRmKrw6uuJut7gRODHzvceeVEw_0 2024-09-14T12:01:19.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.322+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14971513072416606981', time=2024-09-14T13:35:00.070252+0000, chain.objs.size()=1 2024-09-14T12:01:19.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.322+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.uOGf8AyeAOe6C4Wh-CKAU48w9BAG_nK_0 2024-09-14T12:01:19.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.322+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8890964223462969116', time=2024-09-14T13:35:01.053246+0000, chain.objs.size()=1 2024-09-14T12:01:19.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.322+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.DOsMtxiJcAvtaLgwjkS6nJ1rLIpUg43_0 2024-09-14T12:01:19.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.322+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7960494458324977796', time=2024-09-14T13:35:01.111510+0000, chain.objs.size()=1 2024-09-14T12:01:19.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.322+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.7-6z581YK-KNCYh6YK4pdKQfXZ3IRvm_0 2024-09-14T12:01:19.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.322+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3554114409582932738', time=2024-09-14T13:35:01.422624+0000, chain.objs.size()=1 2024-09-14T12:01:19.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.322+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.LUbfnK_MlAm8pY5QIT6hARrahfdDNaB_0 2024-09-14T12:01:19.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.322+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17539619770965317530', time=2024-09-14T13:35:01.936458+0000, chain.objs.size()=1 2024-09-14T12:01:19.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.322+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.iy6hGdXnSnDAjCg9XCyxfPE1pXWQI5B_0 2024-09-14T12:01:19.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.324+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1852641947157662111', time=2024-09-14T13:35:02.222062+0000, chain.objs.size()=1 2024-09-14T12:01:19.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.324+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.p7SEjxDwbDP1Rs0Nq7FVwQTqYvmCJKT_0 2024-09-14T12:01:19.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.324+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16876525161782089359', time=2024-09-14T13:35:02.273521+0000, chain.objs.size()=1 2024-09-14T12:01:19.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.324+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.GWOOZeqpY88ijnu2g9Suo5lBhkLBukS_0 2024-09-14T12:01:19.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.326+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13579670068614433293', time=2024-09-14T13:35:02.512417+0000, chain.objs.size()=1 2024-09-14T12:01:19.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.326+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.D06AoutCr4UBWMBiHxLL1CrtTTXsoUs_0 2024-09-14T12:01:19.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.326+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9493610448721341812', time=2024-09-14T13:35:02.602607+0000, chain.objs.size()=1 2024-09-14T12:01:19.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.326+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.DQ9IWCS5LzUkvdxpNn__0dEJ2bA1Yfx_0 2024-09-14T12:01:19.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.326+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7046923470890205833', time=2024-09-14T13:35:42.076523+0000, chain.objs.size()=1 2024-09-14T12:01:19.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.326+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.U1G3NgdJPVCw_SL5VCVuPK675Kgb5cL_0 2024-09-14T12:01:19.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.326+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3935097695374500159', time=2024-09-14T13:35:42.263539+0000, chain.objs.size()=1 2024-09-14T12:01:19.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.326+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.xYgH4SZnE9tSNYHRlu56IZ-9I3RkPJG_0 2024-09-14T12:01:19.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.326+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5738123113452882043', time=2024-09-14T13:35:42.557228+0000, chain.objs.size()=1 2024-09-14T12:01:19.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.326+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.rbgInfnGdoQGBmJymSWsLBYYUYwfldX_0 2024-09-14T12:01:19.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.326+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10123385987074114617', time=2024-09-14T13:35:42.601445+0000, chain.objs.size()=1 2024-09-14T12:01:19.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.326+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.NwCy5HvRBIgXP2ZBRgMdWzwDRtJLY8V_0 2024-09-14T12:01:19.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.326+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3500379736997190429', time=2024-09-14T13:35:43.305453+0000, chain.objs.size()=1 2024-09-14T12:01:19.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.326+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Jl4Gu-d1SUvJNOceOyF5ut2X2s9TczA_0 2024-09-14T12:01:19.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.326+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12824837368981591939', time=2024-09-14T13:35:43.965558+0000, chain.objs.size()=1 2024-09-14T12:01:19.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.326+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Y0mRpv7TuFXuu9YwbYEFyJVjfQTip6G_0 2024-09-14T12:01:19.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.326+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17625248778828393308', time=2024-09-14T13:35:44.220677+0000, chain.objs.size()=1 2024-09-14T12:01:19.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.326+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.lYn3UDh0CPUkd5r_1eAhffWX-mKQ9ca_0 2024-09-14T12:01:19.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.328+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14533887986840891313', time=2024-09-14T13:35:44.257530+0000, chain.objs.size()=1 2024-09-14T12:01:19.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.328+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.MASy7st1fMN5ftvVgb8HXFzjifSY0_-_0 2024-09-14T12:01:19.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.328+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11693120989839718143', time=2024-09-14T13:35:45.165244+0000, chain.objs.size()=1 2024-09-14T12:01:19.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.328+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.WTfcq2mxer125ZQ4gCwS_bz40tkgk_7_0 2024-09-14T12:01:19.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.328+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13180505893661626966', time=2024-09-14T13:35:45.757314+0000, chain.objs.size()=1 2024-09-14T12:01:19.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.328+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ZkNnWaWZPaUJ4c1TZoDfGW5La22G8j8_0 2024-09-14T12:01:19.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.329+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10487411520505005589', time=2024-09-14T13:35:46.341044+0000, chain.objs.size()=1 2024-09-14T12:01:19.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.329+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.bASW29v3rl7_1H0ik2FTkr61EROmGBo_0 2024-09-14T12:01:19.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.330+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17226886136944715119', time=2024-09-14T13:35:46.481939+0000, chain.objs.size()=1 2024-09-14T12:01:19.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.330+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.1MoqodzTBY9Tahzi29hFx3qOU6fbM1w_0 2024-09-14T12:01:19.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.330+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12956628166109993395', time=2024-09-14T13:35:46.570455+0000, chain.objs.size()=1 2024-09-14T12:01:19.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.330+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.HwzG05JhBtqzDBkk7U_wLyZTd1KMgqI_0 2024-09-14T12:01:19.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.330+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7467912364380609525', time=2024-09-14T13:35:46.621409+0000, chain.objs.size()=1 2024-09-14T12:01:19.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.330+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.ZmndpuEA3skAG8eCETRAk1sUi1sdS4V_0 2024-09-14T12:01:19.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.330+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13484202811415443531', time=2024-09-14T13:35:46.905910+0000, chain.objs.size()=1 2024-09-14T12:01:19.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.330+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.tsNpjzpvFc1GEB6iXg7uxHkDq-YdVlt_0 2024-09-14T12:01:19.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.330+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16185549930028444057', time=2024-09-14T13:35:48.034134+0000, chain.objs.size()=1 2024-09-14T12:01:19.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.330+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.X7_Bdf1X0ALv6JU40CyFRstWIcjja8y_0 2024-09-14T12:01:19.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.332+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3423857490423192804', time=2024-09-14T13:35:48.334255+0000, chain.objs.size()=1 2024-09-14T12:01:19.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.332+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.9rqHA1w9N2Yyk2Ke3ko54Ivgt4YyW9L_0 2024-09-14T12:01:19.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.332+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.395838927268667224', time=2024-09-14T13:35:48.378693+0000, chain.objs.size()=1 2024-09-14T12:01:19.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.332+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.0Bi6SPDkvuJ8mDWqzRVAr9UeBhHv_uo_0 2024-09-14T12:01:19.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.335+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/44888 2024-09-14T12:01:19.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-14T12:01:19.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10002795147843937139', time=2024-09-14T13:35:48.464517+0000, chain.objs.size()=1 2024-09-14T12:01:19.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.fLpm5cvcINUJqFLsiZVv9K-ojWG0ynE_0 2024-09-14T12:01:19.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17762763469977062565', time=2024-09-14T13:35:48.767384+0000, chain.objs.size()=1 2024-09-14T12:01:19.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.X1d8NeT679XYcffVo3sH6Voga-_tbM3_0 2024-09-14T12:01:19.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.859716187968706546', time=2024-09-14T13:35:49.378241+0000, chain.objs.size()=1 2024-09-14T12:01:19.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.CpaVOoZwhac-bPUYgYLspgYEKdtr3OJ_0 2024-09-14T12:01:19.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11411766136367679779', time=2024-09-14T13:35:49.525896+0000, chain.objs.size()=1 2024-09-14T12:01:19.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.V7vzYEZspHIFpv6vuF6RbZklhMI4a5q_0 2024-09-14T12:01:19.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10324022416741732614', time=2024-09-14T13:35:49.936958+0000, chain.objs.size()=1 2024-09-14T12:01:19.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.kKoNcsZeeBQcZjVkN3eqf9qBqpqjIGn_0 2024-09-14T12:01:19.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9267214375305829776', time=2024-09-14T13:35:50.611958+0000, chain.objs.size()=1 2024-09-14T12:01:19.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.pn6RKw8Mo8CFA1cOxg93IxDrcqv7tY__0 2024-09-14T12:01:19.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13257230250093291845', time=2024-09-14T13:35:50.708789+0000, chain.objs.size()=1 2024-09-14T12:01:19.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.aFN_Beujt8xfU6myg2pjKm_ymVsqFZ5_0 2024-09-14T12:01:19.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11885864436211896688', time=2024-09-14T13:35:51.195035+0000, chain.objs.size()=1 2024-09-14T12:01:19.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.tx_Ova8jiW9a4XYPnIlVOCRnDX3BKda_0 2024-09-14T12:01:19.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4031300660458715897', time=2024-09-14T13:35:51.502636+0000, chain.objs.size()=1 2024-09-14T12:01:19.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.99oE2FdjdKRBYZG1AtXqKnNGeqmZ0Oc_0 2024-09-14T12:01:19.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11184948115620627332', time=2024-09-14T13:35:52.080874+0000, chain.objs.size()=1 2024-09-14T12:01:19.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.6XMC67-p6KDK3gAXBLlZ2ApO1gbkXQn_0 2024-09-14T12:01:19.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12132041348903746603', time=2024-09-14T13:36:48.918394+0000, chain.objs.size()=1 2024-09-14T12:01:19.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.380__shadow_.f6lagV2XpMzSshhrsUam5HOh_8A6liq_0 2024-09-14T12:01:19.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8010228470711557101', time=2024-09-14T13:36:52.152269+0000, chain.objs.size()=1 2024-09-14T12:01:19.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.337+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.383__shadow_.Qq-zz6dyf96bS3FQzW3-7WVhX3FH1X3_0 2024-09-14T12:01:19.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.340+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8254075704044343219', time=2024-09-14T13:38:19.512641+0000, chain.objs.size()=1 2024-09-14T12:01:19.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.340+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.460__shadow_.lA3kEUntZ3JtOEu-RURQMdKhWitbV6O_0 2024-09-14T12:01:19.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.340+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4755904462955653797', time=2024-09-14T13:38:49.079674+0000, chain.objs.size()=1 2024-09-14T12:01:19.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.340+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.487__shadow_.__ed6HJURaqphsX3NYKfrN5nK2gTXyO_0 2024-09-14T12:01:19.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.342+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.879826580517078158', time=2024-09-14T13:39:06.618907+0000, chain.objs.size()=1 2024-09-14T12:01:19.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.342+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.504__shadow:-Styd.oxB8SSr1oI0lFwKs5hFqmwg-w_.MvQogDl8WgMpFFuD7AaaxQ0tKLuN8vP_0 2024-09-14T12:01:19.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.342+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13866807608226658046', time=2024-09-14T13:40:45.107736+0000, chain.objs.size()=3 2024-09-14T12:01:19.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.342+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.521__shadow:Mg15Yh9zvuPpCVWLTtNa0hn6gFGb.Qi_.OHWO8lXNdKOEjvg2etSLXSGPpoMPhG6_0 2024-09-14T12:01:19.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.342+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.521__shadow:Mg15Yh9zvuPpCVWLTtNa0hn6gFGb.Qi_.OHWO8lXNdKOEjvg2etSLXSGPpoMPhG6_1 2024-09-14T12:01:19.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.342+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.521__shadow:Mg15Yh9zvuPpCVWLTtNa0hn6gFGb.Qi_.OHWO8lXNdKOEjvg2etSLXSGPpoMPhG6_2 2024-09-14T12:01:19.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.342+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15020064026803561362', time=2024-09-14T13:43:12.422450+0000, chain.objs.size()=3 2024-09-14T12:01:19.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.342+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.526__multipart_mymultipart.2~LEpl_z3mJYP83UNuj0vDyzAuou_tbRz.1 2024-09-14T12:01:19.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.342+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.526__multipart_mymultipart.2~LEpl_z3mJYP83UNuj0vDyzAuou_tbRz.2 2024-09-14T12:01:19.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.342+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.526__multipart_mymultipart.2~LEpl_z3mJYP83UNuj0vDyzAuou_tbRz.3 2024-09-14T12:01:19.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.342+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9844540094888958302', time=2024-09-14T13:45:31.563538+0000, chain.objs.size()=1 2024-09-14T12:01:19.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.342+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.566__shadow_.YqSM9FWKF3xZQe9NUbRKjedZlT3rE_C_0 2024-09-14T12:01:19.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.342+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14419211241451119746', time=2024-09-14T13:46:23.366696+0000, chain.objs.size()=1 2024-09-14T12:01:19.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.342+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:7hH3f3gOseAlF9FrhSX5WKUGDA9otqr_.xTufzEhjhWZA1mASMiwg8rLa95NhT7B_0 2024-09-14T12:01:19.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.344+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11889294490508144003', time=2024-09-14T13:46:56.065960+0000, chain.objs.size()=4 2024-09-14T12:01:19.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.344+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.579__multipart_testobj.2~3x2Vd89-24Hol50tcLm9jkI16rjilVr.1 2024-09-14T12:01:19.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.344+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.579__multipart_testobj.2~3x2Vd89-24Hol50tcLm9jkI16rjilVr.2 2024-09-14T12:01:19.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.345+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.579__multipart_testobj.2~3x2Vd89-24Hol50tcLm9jkI16rjilVr.3 2024-09-14T12:01:19.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.346+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.579__multipart_testobj.2~3x2Vd89-24Hol50tcLm9jkI16rjilVr.4 2024-09-14T12:01:19.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.346+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9796873528433626511', time=2024-09-14T13:52:52.101511+0000, chain.objs.size()=1 2024-09-14T12:01:19.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.346+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.639__shadow_.gi_6uSRnD-DFnPx3uGDwaSjFYDnAjSb_0 2024-09-14T12:01:19.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.346+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4754634877867759791', time=2024-09-14T13:52:56.594607+0000, chain.objs.size()=2 2024-09-14T12:01:19.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.346+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.643__shadow_.gwfXWP5rz0iveiFzyK3as1BsRHoeq4Y_0 2024-09-14T12:01:19.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.347+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.643__shadow_.gwfXWP5rz0iveiFzyK3as1BsRHoeq4Y_1 2024-09-14T12:01:19.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.347+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2251031155769444363', time=2024-09-14T13:53:19.709998+0000, chain.objs.size()=1 2024-09-14T12:01:19.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.347+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.654__shadow_.pXWRMz1dIxVTAi-Hy_bqLfPiYop5_e0_0 2024-09-14T12:01:19.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.347+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3092054808298933429', time=2024-09-14T13:54:43.046275+0000, chain.objs.size()=1 2024-09-14T12:01:19.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.347+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.713__shadow:FF5UkO4oKxWVyacGaezL7ZiKYh8d5WK_.d3ASnpUsrelHVTpoZhkMCgc2gvhsJMM_0 2024-09-14T12:01:19.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.347+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6643234263372590256', time=2024-09-14T13:55:08.184032+0000, chain.objs.size()=1 2024-09-14T12:01:19.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.347+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.719__shadow_.8-gGX6hEuTDCCV9M2OuvO5T6tvrSvGY_0 2024-09-14T12:01:19.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.351+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:19.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.354+0000 7fba010bb800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T12:01:19.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.356+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:01:19.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.356+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:01:19.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44996' 2024-09-14T12:01:19.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14109192902708474495', time=2024-09-14T13:31:52.933093+0000, chain.objs.size()=1 2024-09-14T12:01:19.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.247__shadow_.bLfIVQM7wb_cQTzePbxNSdWPdYHzeX2_0 2024-09-14T12:01:19.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12088104537612898707', time=2024-09-14T13:32:47.454766+0000, chain.objs.size()=1 2024-09-14T12:01:19.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.SwR7epdS11Uk6FwzhUBfPNg0QpcMlCn_0 2024-09-14T12:01:19.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9220691367874274073', time=2024-09-14T13:32:47.566211+0000, chain.objs.size()=1 2024-09-14T12:01:19.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.etR8FbL-OPnKNFc6KWFXttKJHgFHvsl_0 2024-09-14T12:01:19.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7713006979794089276', time=2024-09-14T13:32:48.207294+0000, chain.objs.size()=1 2024-09-14T12:01:19.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.m49SSHQOJcu28Vu4nGKwUKzZtSeUrtg_0 2024-09-14T12:01:19.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17253380148537552462', time=2024-09-14T13:32:48.296350+0000, chain.objs.size()=1 2024-09-14T12:01:19.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_._j3ZG5FFXw162ipmKaTM0-PiwN_jU9X_0 2024-09-14T12:01:19.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11204775991599404076', time=2024-09-14T13:32:48.351161+0000, chain.objs.size()=1 2024-09-14T12:01:19.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.Yvn5SUCTn-VhMGs4Rs3UTvb0H1VEpyT_0 2024-09-14T12:01:19.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7225053161646308683', time=2024-09-14T13:32:49.178068+0000, chain.objs.size()=1 2024-09-14T12:01:19.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.wzqh6IukxBPcvxxXUKBcGSojvyntQq9_0 2024-09-14T12:01:19.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8677525418303990865', time=2024-09-14T13:32:49.213409+0000, chain.objs.size()=1 2024-09-14T12:01:19.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.k2dSaZZ4cqHO9d8faieL_cQIVCBlMfT_0 2024-09-14T12:01:19.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18192658382856682523', time=2024-09-14T13:32:49.524064+0000, chain.objs.size()=1 2024-09-14T12:01:19.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.3ySyqF8_fe2tV1nRetpSmHX7Ml0L0l6_0 2024-09-14T12:01:19.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12354573285166411010', time=2024-09-14T13:32:49.855751+0000, chain.objs.size()=1 2024-09-14T12:01:19.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.uKFvkOmwmCw2rpUKRckMamTz3KRxJ-r_0 2024-09-14T12:01:19.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2354636668733145678', time=2024-09-14T13:32:52.324591+0000, chain.objs.size()=1 2024-09-14T12:01:19.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.M5mo-0x54d4-jedLEvOQc-V_eGEOAi9_0 2024-09-14T12:01:19.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2526872935340719548', time=2024-09-14T13:32:52.354199+0000, chain.objs.size()=1 2024-09-14T12:01:19.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.357+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.gxFgMHdlYDR1dImtFASBbuI8-EY_ymH_0 2024-09-14T12:01:19.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.360+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10299531524851540011', time=2024-09-14T13:32:52.859071+0000, chain.objs.size()=1 2024-09-14T12:01:19.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.360+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.dkniOC6_1C8amK0dTH840_Y2MSeDnUe_0 2024-09-14T12:01:19.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.360+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8762756071275519696', time=2024-09-14T13:32:52.958981+0000, chain.objs.size()=1 2024-09-14T12:01:19.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.360+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_._mA9GPHRO8YHW2LZgByuaWqBTNazfh6_0 2024-09-14T12:01:19.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.360+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13374607496630366243', time=2024-09-14T13:32:53.696672+0000, chain.objs.size()=1 2024-09-14T12:01:19.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.360+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.c21n-53CaMeMZJ1fqIb06yvd7-eJrtW_0 2024-09-14T12:01:19.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.360+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4795718558711591981', time=2024-09-14T13:32:54.212560+0000, chain.objs.size()=1 2024-09-14T12:01:19.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.360+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.-QhQ9rLKIzfdWmFhZCsXIvt0QR5_nyG_0 2024-09-14T12:01:19.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.360+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16081903393363589083', time=2024-09-14T13:32:54.305947+0000, chain.objs.size()=1 2024-09-14T12:01:19.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.360+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.6atfhi9HJdGCRRFujS8lReLO9gDbDNK_0 2024-09-14T12:01:19.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.360+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18262618834421112654', time=2024-09-14T13:32:54.337115+0000, chain.objs.size()=1 2024-09-14T12:01:19.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.360+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.RqpYLSnO_tinS112SeBCDp1UhJ-eGcg_0 2024-09-14T12:01:19.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.360+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17559817590404631225', time=2024-09-14T13:32:54.363047+0000, chain.objs.size()=1 2024-09-14T12:01:19.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.360+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.9FFdEYiHZ7ja-z4hWsZ5-puVgnT1uUj_0 2024-09-14T12:01:19.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.360+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4827461727137037874', time=2024-09-14T13:32:54.558824+0000, chain.objs.size()=1 2024-09-14T12:01:19.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.361+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.V5r68DuEqbysYy5Pv1Y8hLvlPf6pgvE_0 2024-09-14T12:01:19.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.361+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.3153509491608627852', time=2024-09-14T13:32:55.107857+0000, chain.objs.size()=1 2024-09-14T12:01:19.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.361+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.bC_KsRZsSk-j8wpyGWsfcwsiCW1zYmH_0 2024-09-14T12:01:19.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.361+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1784131034776586027', time=2024-09-14T13:32:55.293972+0000, chain.objs.size()=1 2024-09-14T12:01:19.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.361+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.xlsUSVjYBEDEsrMi2IbhQY_oeiwqPI1_0 2024-09-14T12:01:19.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.361+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14853239068345300713', time=2024-09-14T13:32:56.848895+0000, chain.objs.size()=1 2024-09-14T12:01:19.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.361+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.llMC2uUysZlU4ZHQzyoo6qzxHyD5ihL_0 2024-09-14T12:01:19.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.363+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14159328836984853180', time=2024-09-14T13:32:57.387078+0000, chain.objs.size()=1 2024-09-14T12:01:19.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.363+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.yNCy3QSKGKISH1DbxzFT_nyE50TFk3h_0 2024-09-14T12:01:19.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.364+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15123127699632931729', time=2024-09-14T13:32:58.145262+0000, chain.objs.size()=1 2024-09-14T12:01:19.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.364+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.CpiII8pHzsExUX3cNhGiKS66hXWYqot_0 2024-09-14T12:01:19.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.364+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9448871842366310512', time=2024-09-14T13:32:58.325962+0000, chain.objs.size()=1 2024-09-14T12:01:19.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.364+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.263__shadow_.qwFHZfi0C6FMAlIObSitbjLmqM3XMqF_0 2024-09-14T12:01:19.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.364+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8322452367582100461', time=2024-09-14T13:33:05.090259+0000, chain.objs.size()=1 2024-09-14T12:01:19.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.364+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.269__shadow_.1ckiPlI98lYaSbvokS1w6Je87UCjdx8_0 2024-09-14T12:01:19.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.365+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5225969239401275443', time=2024-09-14T13:33:15.996574+0000, chain.objs.size()=1 2024-09-14T12:01:19.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.365+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.279__shadow_.Pya4tofM4HGOkLmfthStoX0CPsl62Ab_0 2024-09-14T12:01:19.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.365+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13164893563219858571', time=2024-09-14T13:33:21.453949+0000, chain.objs.size()=1 2024-09-14T12:01:19.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.365+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.284__shadow_.BnwlwOFN9LBcWPZVegzlKCo2m0hLTgG_0 2024-09-14T12:01:19.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.365+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4829957313791115445', time=2024-09-14T13:33:26.006171+0000, chain.objs.size()=1 2024-09-14T12:01:19.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.365+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.288__shadow_.aPcnQFONXygU22dKFiWVMGU03Rbc17D_0 2024-09-14T12:01:19.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.365+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6370105217111231802', time=2024-09-14T13:33:29.284853+0000, chain.objs.size()=1 2024-09-14T12:01:19.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.365+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.291__shadow_.aYAJLZ4D3avimTLWno3VwKizmPbUIlN_0 2024-09-14T12:01:19.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.365+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2930699335924758224', time=2024-09-14T13:33:35.534060+0000, chain.objs.size()=1 2024-09-14T12:01:19.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.365+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.294__shadow_.X01jPqY-JaugDcb_AQCzem4cNaWJx-V_0 2024-09-14T12:01:19.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.365+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15092407370640813789', time=2024-09-14T13:34:51.508363+0000, chain.objs.size()=1 2024-09-14T12:01:19.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.365+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.m0XqK6t7pv3SyfIFNrRCJYhp6vFm6r8_0 2024-09-14T12:01:19.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.365+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8726361238626052502', time=2024-09-14T13:34:51.607442+0000, chain.objs.size()=1 2024-09-14T12:01:19.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.365+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.PAO60ZYY_mtUsLx7iJ74MyvjsRoi2Ya_0 2024-09-14T12:01:19.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.367+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1778853408530472056', time=2024-09-14T13:34:51.680615+0000, chain.objs.size()=1 2024-09-14T12:01:19.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.367+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.l2LBco-PDv1LpVHc539IXUfvWicVxsc_0 2024-09-14T12:01:19.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.370+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2349064557897412270', time=2024-09-14T13:34:52.095979+0000, chain.objs.size()=1 2024-09-14T12:01:19.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.370+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.7maOJmKzETvauGBMHas3DzmJ4vA6gAo_0 2024-09-14T12:01:19.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.370+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14901202683505826435', time=2024-09-14T13:34:52.426898+0000, chain.objs.size()=1 2024-09-14T12:01:19.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.370+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.kSj38jfVCFMtL5ZfWKxlpa5fa6QcGnA_0 2024-09-14T12:01:19.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.370+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4727700834842067324', time=2024-09-14T13:34:53.158209+0000, chain.objs.size()=1 2024-09-14T12:01:19.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.370+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.KXBUWLI_T6DlDvpgovj8qwDts0bqSwh_0 2024-09-14T12:01:19.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.370+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5926202730010956236', time=2024-09-14T13:34:53.158949+0000, chain.objs.size()=1 2024-09-14T12:01:19.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.370+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.oBIkqMRRah6jqtdPWmiTKUr7ch7n3Sh_0 2024-09-14T12:01:19.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.370+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8516640267856560349', time=2024-09-14T13:34:53.415554+0000, chain.objs.size()=1 2024-09-14T12:01:19.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.370+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.17Zy4-H9Y_k7R3f_HqZ_7O7VM6t1UGq_0 2024-09-14T12:01:19.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.370+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7922221634381760813', time=2024-09-14T13:34:53.689951+0000, chain.objs.size()=1 2024-09-14T12:01:19.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.370+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_._qYCfMCOvxIMPmHTxVnR1VQM0xM348y_0 2024-09-14T12:01:19.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.370+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16524019385574398572', time=2024-09-14T13:34:54.056207+0000, chain.objs.size()=1 2024-09-14T12:01:19.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.370+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.oBEJjlFo7TrGVdflETuFGf0YNmJXfcZ_0 2024-09-14T12:01:19.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.370+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2882311963089827018', time=2024-09-14T13:34:54.181591+0000, chain.objs.size()=1 2024-09-14T12:01:19.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.370+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.6xGhIC8atICqU6SDGP9CL8v48XnW-31_0 2024-09-14T12:01:19.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.370+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7768368102650520578', time=2024-09-14T13:34:54.194897+0000, chain.objs.size()=1 2024-09-14T12:01:19.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.370+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Uq8RdbjuSZZ8zR6sRY-lR7FqT0jTPrG_0 2024-09-14T12:01:19.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.370+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5702158487421697498', time=2024-09-14T13:34:54.721293+0000, chain.objs.size()=1 2024-09-14T12:01:19.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.370+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.iDHiiZDzzXXYEyj99NhntB7XWM6mbH3_0 2024-09-14T12:01:19.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.370+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7791075190469314713', time=2024-09-14T13:34:54.744312+0000, chain.objs.size()=1 2024-09-14T12:01:19.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.370+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.mce9DKFlm960HMLZFZ1N4aFQ_xd59dP_0 2024-09-14T12:01:19.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.372+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12699022086354035841', time=2024-09-14T13:34:54.816556+0000, chain.objs.size()=1 2024-09-14T12:01:19.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.372+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.5ioy3wTb3UypTV2viIv6KheOQYhKlqD_0 2024-09-14T12:01:19.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.373+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17769474597873130773', time=2024-09-14T13:34:54.975956+0000, chain.objs.size()=1 2024-09-14T12:01:19.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.373+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.T_iSqEwlZesD-o7GXIdLXrkc0wP_Vaz_0 2024-09-14T12:01:19.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.374+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6856530203916432229', time=2024-09-14T13:34:55.337872+0000, chain.objs.size()=1 2024-09-14T12:01:19.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.374+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.PwNrQ82FJhkMQiHFM6Sk9zenLb2qOaf_0 2024-09-14T12:01:19.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.374+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9466507685175058947', time=2024-09-14T13:34:56.198840+0000, chain.objs.size()=1 2024-09-14T12:01:19.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.374+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.eesQ4Ph0n2pEoUGL23ueNPhAe5qm47V_0 2024-09-14T12:01:19.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.374+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10114796242961631185', time=2024-09-14T13:34:57.238842+0000, chain.objs.size()=1 2024-09-14T12:01:19.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.374+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.dFZ9MDP3IPxmFJ7e9VPF8YIh9GrKjGE_0 2024-09-14T12:01:19.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.374+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.12874529322571799239', time=2024-09-14T13:34:57.920493+0000, chain.objs.size()=1 2024-09-14T12:01:19.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.374+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.uCeEXWY73BIa7thvoPK4r2epNC7firg_0 2024-09-14T12:01:19.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.375+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8445231980076618594', time=2024-09-14T13:34:58.210874+0000, chain.objs.size()=1 2024-09-14T12:01:19.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.375+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.dQaaFpA1EDNRvm1MWR4v1GkY9WUIwht_0 2024-09-14T12:01:19.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.375+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16268090170809781445', time=2024-09-14T13:34:58.252336+0000, chain.objs.size()=1 2024-09-14T12:01:19.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.375+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.--3sLZIZzAoOia0VpvWvukiYdbYrYO4_0 2024-09-14T12:01:19.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.375+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16363057348168249297', time=2024-09-14T13:34:59.087026+0000, chain.objs.size()=1 2024-09-14T12:01:19.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.375+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.btv9WuJCFkcCg_1ygpPmBbvG3-CbkNq_0 2024-09-14T12:01:19.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.375+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17915496899831941218', time=2024-09-14T13:34:59.337795+0000, chain.objs.size()=1 2024-09-14T12:01:19.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.375+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.sV3ro6J6SCAyGZndYdTNCBQx_8aTn0s_0 2024-09-14T12:01:19.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.375+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10343924980638747439', time=2024-09-14T13:34:59.451344+0000, chain.objs.size()=1 2024-09-14T12:01:19.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.375+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ZpzbglP7UUnyLx_KVpm--ly8m5EYve5_0 2024-09-14T12:01:19.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.375+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14799640356160755093', time=2024-09-14T13:34:59.452189+0000, chain.objs.size()=1 2024-09-14T12:01:19.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.375+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.5gr-jOwO93Yopc04RI8pmAkV6En1mac_0 2024-09-14T12:01:19.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.378+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16999558185772562851', time=2024-09-14T13:34:59.673504+0000, chain.objs.size()=1 2024-09-14T12:01:19.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.378+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.UAB7aDD-LMfPocVugBv2LsMYrGT4W5W_0 2024-09-14T12:01:19.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.379+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4918162965712867279', time=2024-09-14T13:34:59.782755+0000, chain.objs.size()=1 2024-09-14T12:01:19.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.379+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.kiBQbLw7Y1jcpszMzoJk_Qktxgav3iy_0 2024-09-14T12:01:19.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.379+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11996038446534062504', time=2024-09-14T13:34:59.967246+0000, chain.objs.size()=1 2024-09-14T12:01:19.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.379+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.ajQ5pjbNbEHaap_Cn0vxapFXQ0Njrw__0 2024-09-14T12:01:19.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.379+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9265513975857041728', time=2024-09-14T13:35:00.633357+0000, chain.objs.size()=1 2024-09-14T12:01:19.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.379+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.nJOQLqXzl3O4_moFDm3lCDCnWg0fKdz_0 2024-09-14T12:01:19.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.379+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5360312055200675210', time=2024-09-14T13:35:00.816872+0000, chain.objs.size()=1 2024-09-14T12:01:19.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.379+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.9cgV3zRyRozz8ZjyT4gixj8_RRXsxun_0 2024-09-14T12:01:19.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.379+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13035840809841696098', time=2024-09-14T13:35:00.896152+0000, chain.objs.size()=1 2024-09-14T12:01:19.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.379+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.Rwa1HcA-Iu399nMILQBxjFu0KZrI7cN_0 2024-09-14T12:01:19.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.379+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17311887722485406993', time=2024-09-14T13:35:01.180687+0000, chain.objs.size()=1 2024-09-14T12:01:19.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.379+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.bsj2JyCnOHO9bEZ3Sgt429Ih0ylp91y_0 2024-09-14T12:01:19.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.379+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9977284064388491938', time=2024-09-14T13:35:01.802716+0000, chain.objs.size()=1 2024-09-14T12:01:19.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.379+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.-rppIczE_OzCgB1s06KQW6YBh7p-fVL_0 2024-09-14T12:01:19.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.379+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5917330991171488015', time=2024-09-14T13:35:01.964212+0000, chain.objs.size()=1 2024-09-14T12:01:19.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.379+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.DobNpDGcgD8a0sjfOtDQ3NDBgWAIKIS_0 2024-09-14T12:01:19.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.379+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17623934360373542021', time=2024-09-14T13:35:02.207670+0000, chain.objs.size()=1 2024-09-14T12:01:19.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.379+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.DKhM91lykTnT2jt152-jNjuu2mlVCwD_0 2024-09-14T12:01:19.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.379+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14061112046908200885', time=2024-09-14T13:35:02.273748+0000, chain.objs.size()=1 2024-09-14T12:01:19.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.379+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.M7x-IbDSFO4Sx9eta6cxgjC1eqNLnhU_0 2024-09-14T12:01:19.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.382+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13102584136074811576', time=2024-09-14T13:35:02.623074+0000, chain.objs.size()=1 2024-09-14T12:01:19.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.382+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.324__shadow_.u4Tku8XjPwLhNRTZPelAA6obt2BlEVB_0 2024-09-14T12:01:19.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.384+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18101549941687406199', time=2024-09-14T13:35:41.774584+0000, chain.objs.size()=1 2024-09-14T12:01:19.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.384+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.FUwMip2x61aefHnwwSPD3hzGjCSpbMb_0 2024-09-14T12:01:19.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.384+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.23332706240814325', time=2024-09-14T13:35:41.801177+0000, chain.objs.size()=1 2024-09-14T12:01:19.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.384+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.x-iVQbKK48C66HlNr0PA9sVArN_pxNt_0 2024-09-14T12:01:19.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.384+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18236545919749619528', time=2024-09-14T13:35:42.334047+0000, chain.objs.size()=1 2024-09-14T12:01:19.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.384+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.YFE4-tJ90UiOlV8GlnWOH3h_b_HN6Hi_0 2024-09-14T12:01:19.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.384+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18250065422952303208', time=2024-09-14T13:35:43.923276+0000, chain.objs.size()=1 2024-09-14T12:01:19.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.384+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.SmpeF5CrF_jA36pB4Uhuu_W9TZ42szA_0 2024-09-14T12:01:19.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.384+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6629834167637628347', time=2024-09-14T13:35:44.037183+0000, chain.objs.size()=1 2024-09-14T12:01:19.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.384+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.JVs8Yoe0oabSRxD1NzP44szlD9ySBmB_0 2024-09-14T12:01:19.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.384+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1746129781593154971', time=2024-09-14T13:35:44.038208+0000, chain.objs.size()=1 2024-09-14T12:01:19.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.384+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.gQQkbLL-czvvCGT9w6lDRK1Ibjnty8-_0 2024-09-14T12:01:19.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.384+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13105273538939790109', time=2024-09-14T13:35:44.287799+0000, chain.objs.size()=1 2024-09-14T12:01:19.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.384+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.VDLEAhzQbxRr4z7wUqHUOyqxBEOgBK8_0 2024-09-14T12:01:19.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.384+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.5192573513542150242', time=2024-09-14T13:35:44.819064+0000, chain.objs.size()=1 2024-09-14T12:01:19.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.384+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.bqIXfgnUvjeJBN-NERuIOnq5LweIBej_0 2024-09-14T12:01:19.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.384+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.14895029693453308203', time=2024-09-14T13:35:44.849354+0000, chain.objs.size()=1 2024-09-14T12:01:19.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.384+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.NNPi7a-0KO94qyHbY3KqHO0LHnosMiu_0 2024-09-14T12:01:19.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.384+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7554098983621343083', time=2024-09-14T13:35:44.959315+0000, chain.objs.size()=1 2024-09-14T12:01:19.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.384+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.r97dbgGQgMP0R1cCH4wSN8rxZ7LwF61_0 2024-09-14T12:01:19.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.385+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.18002003958352802783', time=2024-09-14T13:35:45.086224+0000, chain.objs.size()=1 2024-09-14T12:01:19.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.385+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.0HfJhq9OcdoFglfrX45tXSgbC_dTgjE_0 2024-09-14T12:01:19.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.386+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6766655280564941776', time=2024-09-14T13:35:45.582154+0000, chain.objs.size()=1 2024-09-14T12:01:19.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.386+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.VhXYnxh90WS1cWeGhlIMfa7exNHzWz7_0 2024-09-14T12:01:19.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.387+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.1875489926038693023', time=2024-09-14T13:35:45.739713+0000, chain.objs.size()=1 2024-09-14T12:01:19.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.387+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.OblJdgbHD2xd-85Hwb85UOCrsSgHOO3_0 2024-09-14T12:01:19.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.387+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15493271994434918583', time=2024-09-14T13:35:46.955655+0000, chain.objs.size()=1 2024-09-14T12:01:19.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.387+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.3GgvmGfNXwpxdY-rjVD9DCHUj9bkIaj_0 2024-09-14T12:01:19.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.387+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7348157916446913281', time=2024-09-14T13:35:47.253062+0000, chain.objs.size()=1 2024-09-14T12:01:19.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.387+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.C9KgLdlrOQmrrgq5uSt1y_wirQ5tlFq_0 2024-09-14T12:01:19.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.387+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.820404568663779014', time=2024-09-14T13:35:48.834425+0000, chain.objs.size()=1 2024-09-14T12:01:19.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.387+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.cfrGLEynGjtXUiyk6IgGmtjwxCbzDfA_0 2024-09-14T12:01:19.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.387+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16391459139033636798', time=2024-09-14T13:35:49.289992+0000, chain.objs.size()=1 2024-09-14T12:01:19.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.387+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.dKjRZEBN7qE-IwhiEZz8z-XbgeX0UzJ_0 2024-09-14T12:01:19.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.387+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.306884398988894812', time=2024-09-14T13:35:49.364232+0000, chain.objs.size()=1 2024-09-14T12:01:19.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.387+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.xzFJ8FD0SnO2TgkHjuGW0zh-3hnY7sT_0 2024-09-14T12:01:19.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.387+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13891244299352900576', time=2024-09-14T13:35:49.510859+0000, chain.objs.size()=1 2024-09-14T12:01:19.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.387+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.JEg55gHZ9HvYtdvOU5b4crcQlYt238W_0 2024-09-14T12:01:19.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.388+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15060449778590119946', time=2024-09-14T13:35:49.650345+0000, chain.objs.size()=1 2024-09-14T12:01:19.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.388+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.iRnE33_3N_7xSuc1EJEY12eskSGXyMo_0 2024-09-14T12:01:19.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.390+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.2814200938915621323', time=2024-09-14T13:35:50.263045+0000, chain.objs.size()=1 2024-09-14T12:01:19.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.390+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.fpoJGG_Ny2NYMrTUDEy1JlyPbhs2jxD_0 2024-09-14T12:01:19.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.390+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.16865087385388665643', time=2024-09-14T13:35:50.623178+0000, chain.objs.size()=1 2024-09-14T12:01:19.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.390+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.kE40MKVGRaXyAeFUPY-fCuS9NYOMkDN_0 2024-09-14T12:01:19.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.390+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.6078080660110339667', time=2024-09-14T13:35:51.070420+0000, chain.objs.size()=1 2024-09-14T12:01:19.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.390+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.Kcyhqi_1XhmvKo3f61y7P3aEh1XiYWt_0 2024-09-14T12:01:19.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.393+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.15230844765424171256', time=2024-09-14T13:35:51.071240+0000, chain.objs.size()=1 2024-09-14T12:01:19.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.393+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.gs7OsdPDA2Bunnjsrzu457Upc_RQSOn_0 2024-09-14T12:01:19.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.393+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17902758979419194112', time=2024-09-14T13:35:51.623162+0000, chain.objs.size()=1 2024-09-14T12:01:19.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.393+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.yLHZWNUUuOgZfJNr21eh_ySBHoh2zLw_0 2024-09-14T12:01:19.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.393+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10539309178253124996', time=2024-09-14T13:35:51.962068+0000, chain.objs.size()=1 2024-09-14T12:01:19.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.393+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.EPs7wDeAItMIpLSao6WWHRtdJMq4Gyr_0 2024-09-14T12:01:19.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.393+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10385227998588864043', time=2024-09-14T13:35:52.163780+0000, chain.objs.size()=1 2024-09-14T12:01:19.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.393+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.2ZTTTYrPVt8oidpZ1M3OFOpL6EYNTap_0 2024-09-14T12:01:19.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.393+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.352604808191097688', time=2024-09-14T13:35:52.705073+0000, chain.objs.size()=1 2024-09-14T12:01:19.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.393+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.325__shadow_.k89ZplCyzc6otdZEZAhn3sYFvQldAmv_0 2024-09-14T12:01:19.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.393+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7747800803610734168', time=2024-09-14T13:37:00.812845+0000, chain.objs.size()=1 2024-09-14T12:01:19.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.393+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.391__shadow_.A9L3J6upF1upncg983uBy-jhmSS-lpO_0 2024-09-14T12:01:19.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.393+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11421693459727383297', time=2024-09-14T13:37:46.446226+0000, chain.objs.size()=1 2024-09-14T12:01:19.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.393+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.433__shadow_.ZOyUIGp3JQuWLtbx5rz9i095mmuCn6Y_0 2024-09-14T12:01:19.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.397+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 0/44996 2024-09-14T12:01:19.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T12:01:19.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4218312310008959601', time=2024-09-14T13:37:49.391665+0000, chain.objs.size()=1 2024-09-14T12:01:19.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.436__shadow_.ozm-Dn2K1MqQpRUo0kR7hgpNws9ehti_0 2024-09-14T12:01:19.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7064288788771855340', time=2024-09-14T13:38:54.966499+0000, chain.objs.size()=1 2024-09-14T12:01:19.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.492__shadow_.wdSVv5DT-qtBExPZGKXxiTcMDTNG0kL_0 2024-09-14T12:01:19.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8321844418793824361', time=2024-09-14T13:38:57.564687+0000, chain.objs.size()=1 2024-09-14T12:01:19.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.496__shadow_.S5zPTi67oYqAKkVnmKnWu1xeWoOykWx_0 2024-09-14T12:01:19.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9170279572132170755', time=2024-09-14T13:38:58.530646+0000, chain.objs.size()=1 2024-09-14T12:01:19.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.497__shadow_.sDzlz4Pp5A4qZXhC6Ah0hAziaz0Ad2i_0 2024-09-14T12:01:19.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.9582432929345759707', time=2024-09-14T13:45:03.127298+0000, chain.objs.size()=1 2024-09-14T12:01:19.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.556__shadow_.0N3rHiU3DBbCX5q7oOPTF1FcVJfeAAL_0 2024-09-14T12:01:19.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.8703354636771561198', time=2024-09-14T13:45:38.462429+0000, chain.objs.size()=1 2024-09-14T12:01:19.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:.CRpHdP3JJW1bLvA3ILpnsnSE2mJgrz_.Nk7NWsalw2--lLCMImNZKjpKH0AV8zm_0 2024-09-14T12:01:19.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10661301682439057792', time=2024-09-14T13:45:42.187592+0000, chain.objs.size()=1 2024-09-14T12:01:19.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:Wch2lNTOqPfRCw13rrVEyUt69B.jbtw_.tCDZ92_ky8uV5CZlQwVd9RVLFg39xFi_0 2024-09-14T12:01:19.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.4376929283362799787', time=2024-09-14T13:45:44.457480+0000, chain.objs.size()=1 2024-09-14T12:01:19.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.570__shadow:zgoyD-9wIErna7LE6brdftbe.r10VpE_.m5RDvJaf9nuZKCvodsh5unNiMpq2G6M_0 2024-09-14T12:01:19.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.17198877701589819981', time=2024-09-14T13:46:25.083494+0000, chain.objs.size()=1 2024-09-14T12:01:19.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.578__shadow:dI7zoPt7mTNG-evGA.K8V1jUqxONwsO_.Vbs31pU24DRjEqgJPYW1SzPNJC3D1d-_0 2024-09-14T12:01:19.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.7022211607645900889', time=2024-09-14T13:47:12.382267+0000, chain.objs.size()=1 2024-09-14T12:01:19.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.581__shadow:s7Wm3hGN2MGsRjpyFzOj3bYNHhCJBiW_.qbAwcssbUDH2BL1BiDG12iyxmcrU1pm_0 2024-09-14T12:01:19.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.13177129649284230472', time=2024-09-14T13:52:49.672865+0000, chain.objs.size()=1 2024-09-14T12:01:19.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.637__shadow_.KgFGcGkWbDp6Db1ukeej1laoJ0ywEVb_0 2024-09-14T12:01:19.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.11048254512680211231', time=2024-09-14T13:54:10.931335+0000, chain.objs.size()=1 2024-09-14T12:01:19.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.399+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.680__shadow_.ALhSTudHp0_TKRMLbI6eB74AV9VP4ty_0 2024-09-14T12:01:19.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.401+0000 7fba010bb800 20 garbage collection: RGWGC::process iterating over entry tag='c28b75ff-2576-4ab1-a211-5d2fca133105.4647.10397677026503154518', time=2024-09-14T13:59:29.623482+0000, chain.objs.size()=5 2024-09-14T12:01:19.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.401+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.780__shadow_.SRVxJJAgvkkbe8cYpdxscw95DyVqA-W_0 2024-09-14T12:01:19.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.402+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.780__shadow_.SRVxJJAgvkkbe8cYpdxscw95DyVqA-W_1 2024-09-14T12:01:19.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.402+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.780__shadow_.SRVxJJAgvkkbe8cYpdxscw95DyVqA-W_2 2024-09-14T12:01:19.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.402+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.780__shadow_.SRVxJJAgvkkbe8cYpdxscw95DyVqA-W_3 2024-09-14T12:01:19.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.402+0000 7fba010bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:c28b75ff-2576-4ab1-a211-5d2fca133105.4647.780__shadow_.SRVxJJAgvkkbe8cYpdxscw95DyVqA-W_4 2024-09-14T12:01:19.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.406+0000 7fba010bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:01:19.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.410+0000 7fb8b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:01:19.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.412+0000 7fba010bb800 20 remove_watcher() i=0 2024-09-14T12:01:19.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.412+0000 7fba010bb800 2 removed watcher, disabling cache 2024-09-14T12:01:19.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.413+0000 7fba010bb800 20 remove_watcher() i=1 2024-09-14T12:01:19.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.414+0000 7fba010bb800 20 remove_watcher() i=2 2024-09-14T12:01:19.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.415+0000 7fba010bb800 20 remove_watcher() i=3 2024-09-14T12:01:19.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.416+0000 7fba010bb800 20 remove_watcher() i=4 2024-09-14T12:01:19.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.417+0000 7fba010bb800 20 remove_watcher() i=5 2024-09-14T12:01:19.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.418+0000 7fba010bb800 20 remove_watcher() i=6 2024-09-14T12:01:19.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-14T12:01:19.419+0000 7fba010bb800 20 remove_watcher() i=7 2024-09-14T12:01:19.429 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-14T12:01:19.440 DEBUG:teuthology.orchestra.run.smithi050:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-09-14T12:01:19.498 DEBUG:teuthology.orchestra.run.smithi050:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-14T12:01:19.567 DEBUG:teuthology.orchestra.run.smithi050:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-09-14T12:01:19.637 DEBUG:teuthology.orchestra.run.smithi050:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-14T12:01:19.707 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm /usr/share/pki/ca-trust-source/anchors/root.crt 2024-09-14T12:01:19.786 DEBUG:teuthology.orchestra.run.smithi050:> sudo update-ca-trust 2024-09-14T12:01:20.837 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-14T12:01:20.847 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T12:01:20.848 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:01:21.183 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T12:01:21.195 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-14T12:01:21.198 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":2504,"stamp":"2024-09-14T12:01:21.023965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":124568671,"num_objects":1403,"num_object_clones":0,"num_object_copies":3743,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1403,"num_whiteouts":0,"num_read":308080,"num_read_kb":2528096,"num_write":162942,"num_write_kb":2359352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12957,"ondisk_log_size":12957,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1771768,"kb_used_data":227252,"kb_used_omap":12,"kb_used_meta":1543027,"kb_avail":753202952,"statfs":{"total":773094113280,"available":771279822848,"internally_reserved":0,"allocated":232706048,"data_stored":216739719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1580060209},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-527746617,"num_objects":-3442,"num_object_clones":0,"num_object_copies":-10289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3442,"num_whiteouts":0,"num_read":3881,"num_read_kb":3690,"num_write":3667,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005158"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.599297+0000","last_change":"2024-09-14T11:25:20.213046+0000","last_active":"2024-09-14T11:57:50.599297+0000","last_peered":"2024-09-14T11:57:50.599297+0000","last_clean":"2024-09-14T11:57:50.599297+0000","last_became_active":"2024-09-14T11:25:20.212282+0000","last_became_peered":"2024-09-14T11:25:20.212282+0000","last_unstale":"2024-09-14T11:57:50.599297+0000","last_undegraded":"2024-09-14T11:57:50.599297+0000","last_fullsized":"2024-09-14T11:57:50.599297+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:37.717916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"263'3","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.412622+0000","last_change":"2024-09-14T11:06:45.982990+0000","last_active":"2024-09-14T11:59:15.412622+0000","last_peered":"2024-09-14T11:59:15.412622+0000","last_clean":"2024-09-14T11:59:15.412622+0000","last_became_active":"2024-09-14T11:06:45.982702+0000","last_became_peered":"2024-09-14T11:06:45.982702+0000","last_unstale":"2024-09-14T11:59:15.412622+0000","last_undegraded":"2024-09-14T11:59:15.412622+0000","last_fullsized":"2024-09-14T11:59:15.412622+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:59.949376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.432607+0000","last_change":"2024-09-14T11:06:41.918549+0000","last_active":"2024-09-14T11:56:45.432607+0000","last_peered":"2024-09-14T11:56:45.432607+0000","last_clean":"2024-09-14T11:56:45.432607+0000","last_became_active":"2024-09-14T11:06:41.918259+0000","last_became_peered":"2024-09-14T11:06:41.918259+0000","last_unstale":"2024-09-14T11:56:45.432607+0000","last_undegraded":"2024-09-14T11:56:45.432607+0000","last_fullsized":"2024-09-14T11:56:45.432607+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:55.907181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'53","reported_seq":204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.650174+0000","last_change":"2024-09-14T11:02:34.872954+0000","last_active":"2024-09-14T11:58:50.650174+0000","last_peered":"2024-09-14T11:58:50.650174+0000","last_clean":"2024-09-14T11:58:50.650174+0000","last_became_active":"2024-09-14T11:02:34.872682+0000","last_became_peered":"2024-09-14T11:02:34.872682+0000","last_unstale":"2024-09-14T11:58:50.650174+0000","last_undegraded":"2024-09-14T11:58:50.650174+0000","last_fullsized":"2024-09-14T11:58:50.650174+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:01.174737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":419,"num_read_kb":273,"num_write":133,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:53.517430+0000","last_change":"2024-09-14T11:25:20.206920+0000","last_active":"2024-09-14T11:57:53.517430+0000","last_peered":"2024-09-14T11:57:53.517430+0000","last_clean":"2024-09-14T11:57:53.517430+0000","last_became_active":"2024-09-14T11:25:20.206601+0000","last_became_peered":"2024-09-14T11:25:20.206601+0000","last_unstale":"2024-09-14T11:57:53.517430+0000","last_undegraded":"2024-09-14T11:57:53.517430+0000","last_fullsized":"2024-09-14T11:57:53.517430+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:13.234370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"263'13","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.153862+0000","last_change":"2024-09-14T11:06:45.992917+0000","last_active":"2024-09-14T12:01:18.153862+0000","last_peered":"2024-09-14T12:01:18.153862+0000","last_clean":"2024-09-14T12:01:18.153862+0000","last_became_active":"2024-09-14T11:06:45.992612+0000","last_became_peered":"2024-09-14T11:06:45.992612+0000","last_unstale":"2024-09-14T12:01:18.153862+0000","last_undegraded":"2024-09-14T12:01:18.153862+0000","last_fullsized":"2024-09-14T12:01:18.153862+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:36.001623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13883,"num_write":28,"num_write_kb":14907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"263'3","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.464704+0000","last_change":"2024-09-14T11:06:41.912107+0000","last_active":"2024-09-14T11:59:13.464704+0000","last_peered":"2024-09-14T11:59:13.464704+0000","last_clean":"2024-09-14T11:59:13.464704+0000","last_became_active":"2024-09-14T11:06:41.911807+0000","last_became_peered":"2024-09-14T11:06:41.911807+0000","last_unstale":"2024-09-14T11:59:13.464704+0000","last_undegraded":"2024-09-14T11:59:13.464704+0000","last_fullsized":"2024-09-14T11:59:13.464704+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:55.009953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":621,"num_write":3,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"263'41","reported_seq":172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.650153+0000","last_change":"2024-09-14T11:02:34.879623+0000","last_active":"2024-09-14T11:58:50.650153+0000","last_peered":"2024-09-14T11:58:50.650153+0000","last_clean":"2024-09-14T11:58:50.650153+0000","last_became_active":"2024-09-14T11:02:34.879272+0000","last_became_peered":"2024-09-14T11:02:34.879272+0000","last_unstale":"2024-09-14T11:58:50.650153+0000","last_undegraded":"2024-09-14T11:58:50.650153+0000","last_fullsized":"2024-09-14T11:58:50.650153+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:46.038847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":323,"num_read_kb":209,"num_write":113,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.394943+0000","last_change":"2024-09-14T11:25:20.207542+0000","last_active":"2024-09-14T11:56:45.394943+0000","last_peered":"2024-09-14T11:56:45.394943+0000","last_clean":"2024-09-14T11:56:45.394943+0000","last_became_active":"2024-09-14T11:25:20.207226+0000","last_became_peered":"2024-09-14T11:25:20.207226+0000","last_unstale":"2024-09-14T11:56:45.394943+0000","last_undegraded":"2024-09-14T11:56:45.394943+0000","last_fullsized":"2024-09-14T11:56:45.394943+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:55.365914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.461362+0000","last_change":"2024-09-14T11:06:45.981984+0000","last_active":"2024-09-14T11:58:53.461362+0000","last_peered":"2024-09-14T11:58:53.461362+0000","last_clean":"2024-09-14T11:58:53.461362+0000","last_became_active":"2024-09-14T11:06:45.981705+0000","last_became_peered":"2024-09-14T11:06:45.981705+0000","last_unstale":"2024-09-14T11:58:53.461362+0000","last_undegraded":"2024-09-14T11:58:53.461362+0000","last_fullsized":"2024-09-14T11:58:53.461362+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:53.066712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.450843+0000","last_change":"2024-09-14T11:06:41.918237+0000","last_active":"2024-09-14T11:58:55.450843+0000","last_peered":"2024-09-14T11:58:55.450843+0000","last_clean":"2024-09-14T11:58:55.450843+0000","last_became_active":"2024-09-14T11:06:41.917774+0000","last_became_peered":"2024-09-14T11:06:41.917774+0000","last_unstale":"2024-09-14T11:58:55.450843+0000","last_undegraded":"2024-09-14T11:58:55.450843+0000","last_fullsized":"2024-09-14T11:58:55.450843+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:42.986789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'20","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:38.515232+0000","last_change":"2024-09-14T11:02:34.875159+0000","last_active":"2024-09-14T11:57:38.515232+0000","last_peered":"2024-09-14T11:57:38.515232+0000","last_clean":"2024-09-14T11:57:38.515232+0000","last_became_active":"2024-09-14T11:02:34.874685+0000","last_became_peered":"2024-09-14T11:02:34.874685+0000","last_unstale":"2024-09-14T11:57:38.515232+0000","last_undegraded":"2024-09-14T11:57:38.515232+0000","last_fullsized":"2024-09-14T11:57:38.515232+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:21.593031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":99,"num_write":50,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.442366+0000","last_change":"2024-09-14T11:25:20.211504+0000","last_active":"2024-09-14T11:56:53.442366+0000","last_peered":"2024-09-14T11:56:53.442366+0000","last_clean":"2024-09-14T11:56:53.442366+0000","last_became_active":"2024-09-14T11:25:20.211190+0000","last_became_peered":"2024-09-14T11:25:20.211190+0000","last_unstale":"2024-09-14T11:56:53.442366+0000","last_undegraded":"2024-09-14T11:56:53.442366+0000","last_fullsized":"2024-09-14T11:56:53.442366+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:02.921907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"263'7","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:58.480804+0000","last_change":"2024-09-14T11:06:45.980127+0000","last_active":"2024-09-14T12:00:58.480804+0000","last_peered":"2024-09-14T12:00:58.480804+0000","last_clean":"2024-09-14T12:00:58.480804+0000","last_became_active":"2024-09-14T11:06:45.979801+0000","last_became_peered":"2024-09-14T11:06:45.979801+0000","last_unstale":"2024-09-14T12:00:58.480804+0000","last_undegraded":"2024-09-14T12:00:58.480804+0000","last_fullsized":"2024-09-14T12:00:58.480804+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:14.264168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"263'5","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.481620+0000","last_change":"2024-09-14T11:06:41.905310+0000","last_active":"2024-09-14T12:01:17.481620+0000","last_peered":"2024-09-14T12:01:17.481620+0000","last_clean":"2024-09-14T12:01:17.481620+0000","last_became_active":"2024-09-14T11:06:41.905007+0000","last_became_peered":"2024-09-14T11:06:41.905007+0000","last_unstale":"2024-09-14T12:01:17.481620+0000","last_undegraded":"2024-09-14T12:01:17.481620+0000","last_fullsized":"2024-09-14T12:01:17.481620+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:37.875569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'31","reported_seq":132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:38.515217+0000","last_change":"2024-09-14T11:02:34.873370+0000","last_active":"2024-09-14T11:57:38.515217+0000","last_peered":"2024-09-14T11:57:38.515217+0000","last_clean":"2024-09-14T11:57:38.515217+0000","last_became_active":"2024-09-14T11:02:34.873091+0000","last_became_peered":"2024-09-14T11:02:34.873091+0000","last_unstale":"2024-09-14T11:57:38.515217+0000","last_undegraded":"2024-09-14T11:57:38.515217+0000","last_fullsized":"2024-09-14T11:57:38.515217+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:05.952366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":154,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:25.438215+0000","last_change":"2024-09-14T11:25:20.213420+0000","last_active":"2024-09-14T11:57:25.438215+0000","last_peered":"2024-09-14T11:57:25.438215+0000","last_clean":"2024-09-14T11:57:25.438215+0000","last_became_active":"2024-09-14T11:25:20.213064+0000","last_became_peered":"2024-09-14T11:25:20.213064+0000","last_unstale":"2024-09-14T11:57:25.438215+0000","last_undegraded":"2024-09-14T11:57:25.438215+0000","last_fullsized":"2024-09-14T11:57:25.438215+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:55.006063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"263'7","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:55.612856+0000","last_change":"2024-09-14T11:06:45.982348+0000","last_active":"2024-09-14T11:59:55.612856+0000","last_peered":"2024-09-14T11:59:55.612856+0000","last_clean":"2024-09-14T11:59:55.612856+0000","last_became_active":"2024-09-14T11:06:45.977225+0000","last_became_peered":"2024-09-14T11:06:45.977225+0000","last_unstale":"2024-09-14T11:59:55.612856+0000","last_undegraded":"2024-09-14T11:59:55.612856+0000","last_fullsized":"2024-09-14T11:59:55.612856+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:19.723203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20490,"num_write":7,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.447928+0000","last_change":"2024-09-14T11:06:41.916297+0000","last_active":"2024-09-14T11:57:28.447928+0000","last_peered":"2024-09-14T11:57:28.447928+0000","last_clean":"2024-09-14T11:57:28.447928+0000","last_became_active":"2024-09-14T11:06:41.916037+0000","last_became_peered":"2024-09-14T11:06:41.916037+0000","last_unstale":"2024-09-14T11:57:28.447928+0000","last_undegraded":"2024-09-14T11:57:28.447928+0000","last_fullsized":"2024-09-14T11:57:28.447928+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:36.838054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"263'6","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:38.515163+0000","last_change":"2024-09-14T11:02:34.878852+0000","last_active":"2024-09-14T11:57:38.515163+0000","last_peered":"2024-09-14T11:57:38.515163+0000","last_clean":"2024-09-14T11:57:38.515163+0000","last_became_active":"2024-09-14T11:02:34.878477+0000","last_became_peered":"2024-09-14T11:02:34.878477+0000","last_unstale":"2024-09-14T11:57:38.515163+0000","last_undegraded":"2024-09-14T11:57:38.515163+0000","last_fullsized":"2024-09-14T11:57:38.515163+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:50.190261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.648824+0000","last_change":"2024-09-14T11:25:20.211103+0000","last_active":"2024-09-14T11:58:40.648824+0000","last_peered":"2024-09-14T11:58:40.648824+0000","last_clean":"2024-09-14T11:58:40.648824+0000","last_became_active":"2024-09-14T11:25:20.210841+0000","last_became_peered":"2024-09-14T11:25:20.210841+0000","last_unstale":"2024-09-14T11:58:40.648824+0000","last_undegraded":"2024-09-14T11:58:40.648824+0000","last_fullsized":"2024-09-14T11:58:40.648824+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:22.472173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"260'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:30.523488+0000","last_change":"2024-09-14T11:06:45.992541+0000","last_active":"2024-09-14T11:57:30.523488+0000","last_peered":"2024-09-14T11:57:30.523488+0000","last_clean":"2024-09-14T11:57:30.523488+0000","last_became_active":"2024-09-14T11:06:45.992046+0000","last_became_peered":"2024-09-14T11:06:45.992046+0000","last_unstale":"2024-09-14T11:57:30.523488+0000","last_undegraded":"2024-09-14T11:57:30.523488+0000","last_fullsized":"2024-09-14T11:57:30.523488+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:54.123557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:35.524118+0000","last_change":"2024-09-14T11:06:41.909618+0000","last_active":"2024-09-14T11:57:35.524118+0000","last_peered":"2024-09-14T11:57:35.524118+0000","last_clean":"2024-09-14T11:57:35.524118+0000","last_became_active":"2024-09-14T11:06:41.909310+0000","last_became_peered":"2024-09-14T11:06:41.909310+0000","last_unstale":"2024-09-14T11:57:35.524118+0000","last_undegraded":"2024-09-14T11:57:35.524118+0000","last_fullsized":"2024-09-14T11:57:35.524118+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:36.988586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"263'17","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:35.298310+0000","last_change":"2024-09-14T11:02:34.879155+0000","last_active":"2024-09-14T11:57:35.298310+0000","last_peered":"2024-09-14T11:57:35.298310+0000","last_clean":"2024-09-14T11:57:35.298310+0000","last_became_active":"2024-09-14T11:02:34.878859+0000","last_became_peered":"2024-09-14T11:02:34.878859+0000","last_unstale":"2024-09-14T11:57:35.298310+0000","last_undegraded":"2024-09-14T11:57:35.298310+0000","last_fullsized":"2024-09-14T11:57:35.298310+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:06.717501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":82,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.300187+0000","last_change":"2024-09-14T11:25:20.214123+0000","last_active":"2024-09-14T11:57:50.300187+0000","last_peered":"2024-09-14T11:57:50.300187+0000","last_clean":"2024-09-14T11:57:50.300187+0000","last_became_active":"2024-09-14T11:25:20.213540+0000","last_became_peered":"2024-09-14T11:25:20.213540+0000","last_unstale":"2024-09-14T11:57:50.300187+0000","last_undegraded":"2024-09-14T11:57:50.300187+0000","last_fullsized":"2024-09-14T11:57:50.300187+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:22.650940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"260'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.292797+0000","last_change":"2024-09-14T11:06:45.986594+0000","last_active":"2024-09-14T11:56:45.292797+0000","last_peered":"2024-09-14T11:56:45.292797+0000","last_clean":"2024-09-14T11:56:45.292797+0000","last_became_active":"2024-09-14T11:06:45.984536+0000","last_became_peered":"2024-09-14T11:06:45.984536+0000","last_unstale":"2024-09-14T11:56:45.292797+0000","last_undegraded":"2024-09-14T11:56:45.292797+0000","last_fullsized":"2024-09-14T11:56:45.292797+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:50.142830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.592674+0000","last_change":"2024-09-14T11:06:41.917589+0000","last_active":"2024-09-14T11:56:45.592674+0000","last_peered":"2024-09-14T11:56:45.592674+0000","last_clean":"2024-09-14T11:56:45.592674+0000","last_became_active":"2024-09-14T11:06:41.917297+0000","last_became_peered":"2024-09-14T11:06:41.917297+0000","last_unstale":"2024-09-14T11:56:45.592674+0000","last_undegraded":"2024-09-14T11:56:45.592674+0000","last_fullsized":"2024-09-14T11:56:45.592674+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:24.720580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"260'21","reported_seq":118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.445641+0000","last_change":"2024-09-14T11:02:34.877058+0000","last_active":"2024-09-14T11:58:20.445641+0000","last_peered":"2024-09-14T11:58:20.445641+0000","last_clean":"2024-09-14T11:58:20.445641+0000","last_became_active":"2024-09-14T11:02:34.876726+0000","last_became_peered":"2024-09-14T11:02:34.876726+0000","last_unstale":"2024-09-14T11:58:20.445641+0000","last_undegraded":"2024-09-14T11:58:20.445641+0000","last_fullsized":"2024-09-14T11:58:20.445641+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:13.228297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":116,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.599347+0000","last_change":"2024-09-14T11:25:20.214842+0000","last_active":"2024-09-14T11:57:50.599347+0000","last_peered":"2024-09-14T11:57:50.599347+0000","last_clean":"2024-09-14T11:57:50.599347+0000","last_became_active":"2024-09-14T11:25:20.214475+0000","last_became_peered":"2024-09-14T11:25:20.214475+0000","last_unstale":"2024-09-14T11:57:50.599347+0000","last_undegraded":"2024-09-14T11:57:50.599347+0000","last_fullsized":"2024-09-14T11:57:50.599347+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:56.001599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.432562+0000","last_change":"2024-09-14T11:06:45.990723+0000","last_active":"2024-09-14T11:56:45.432562+0000","last_peered":"2024-09-14T11:56:45.432562+0000","last_clean":"2024-09-14T11:56:45.432562+0000","last_became_active":"2024-09-14T11:06:45.990419+0000","last_became_peered":"2024-09-14T11:06:45.990419+0000","last_unstale":"2024-09-14T11:56:45.432562+0000","last_undegraded":"2024-09-14T11:56:45.432562+0000","last_fullsized":"2024-09-14T11:56:45.432562+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:12.253426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"260'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.507306+0000","last_change":"2024-09-14T11:06:41.911568+0000","last_active":"2024-09-14T11:56:43.507306+0000","last_peered":"2024-09-14T11:56:43.507306+0000","last_clean":"2024-09-14T11:56:43.507306+0000","last_became_active":"2024-09-14T11:06:41.910694+0000","last_became_peered":"2024-09-14T11:06:41.910694+0000","last_unstale":"2024-09-14T11:56:43.507306+0000","last_undegraded":"2024-09-14T11:56:43.507306+0000","last_fullsized":"2024-09-14T11:56:43.507306+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:38.517703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"263'21","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:13.520593+0000","last_change":"2024-09-14T11:02:34.873098+0000","last_active":"2024-09-14T11:58:13.520593+0000","last_peered":"2024-09-14T11:58:13.520593+0000","last_clean":"2024-09-14T11:58:13.520593+0000","last_became_active":"2024-09-14T11:02:34.872803+0000","last_became_peered":"2024-09-14T11:02:34.872803+0000","last_unstale":"2024-09-14T11:58:13.520593+0000","last_undegraded":"2024-09-14T11:58:13.520593+0000","last_fullsized":"2024-09-14T11:58:13.520593+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:22.434265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":102,"num_write":56,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:03.453145+0000","last_change":"2024-09-14T11:25:20.208606+0000","last_active":"2024-09-14T11:58:03.453145+0000","last_peered":"2024-09-14T11:58:03.453145+0000","last_clean":"2024-09-14T11:58:03.453145+0000","last_became_active":"2024-09-14T11:25:20.207780+0000","last_became_peered":"2024-09-14T11:25:20.207780+0000","last_unstale":"2024-09-14T11:58:03.453145+0000","last_undegraded":"2024-09-14T11:58:03.453145+0000","last_fullsized":"2024-09-14T11:58:03.453145+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:39.802914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"263'9","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.358375+0000","last_change":"2024-09-14T11:06:45.992867+0000","last_active":"2024-09-14T12:01:18.358375+0000","last_peered":"2024-09-14T12:01:18.358375+0000","last_clean":"2024-09-14T12:01:18.358375+0000","last_became_active":"2024-09-14T11:06:45.992208+0000","last_became_peered":"2024-09-14T11:06:45.992208+0000","last_unstale":"2024-09-14T12:01:18.358375+0000","last_undegraded":"2024-09-14T12:01:18.358375+0000","last_fullsized":"2024-09-14T12:01:18.358375+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:21.488237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":17408,"num_write":14,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"263'8","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:30.546211+0000","last_change":"2024-09-14T11:06:41.915462+0000","last_active":"2024-09-14T12:00:30.546211+0000","last_peered":"2024-09-14T12:00:30.546211+0000","last_clean":"2024-09-14T12:00:30.546211+0000","last_became_active":"2024-09-14T11:06:41.915173+0000","last_became_peered":"2024-09-14T11:06:41.915173+0000","last_unstale":"2024-09-14T12:00:30.546211+0000","last_undegraded":"2024-09-14T12:00:30.546211+0000","last_fullsized":"2024-09-14T12:00:30.546211+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:30.823550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10242,"num_write":13,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"263'15","reported_seq":94,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:10.644198+0000","last_change":"2024-09-14T11:02:34.867951+0000","last_active":"2024-09-14T11:58:10.644198+0000","last_peered":"2024-09-14T11:58:10.644198+0000","last_clean":"2024-09-14T11:58:10.644198+0000","last_became_active":"2024-09-14T11:02:34.867669+0000","last_became_peered":"2024-09-14T11:02:34.867669+0000","last_unstale":"2024-09-14T11:58:10.644198+0000","last_undegraded":"2024-09-14T11:58:10.644198+0000","last_fullsized":"2024-09-14T11:58:10.644198+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:05.093113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":79,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:03.519056+0000","last_change":"2024-09-14T11:25:20.210078+0000","last_active":"2024-09-14T11:58:03.519056+0000","last_peered":"2024-09-14T11:58:03.519056+0000","last_clean":"2024-09-14T11:58:03.519056+0000","last_became_active":"2024-09-14T11:25:20.209801+0000","last_became_peered":"2024-09-14T11:25:20.209801+0000","last_unstale":"2024-09-14T11:58:03.519056+0000","last_undegraded":"2024-09-14T11:58:03.519056+0000","last_fullsized":"2024-09-14T11:58:03.519056+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:20.540163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:18.455327+0000","last_change":"2024-09-14T11:06:45.990540+0000","last_active":"2024-09-14T11:58:18.455327+0000","last_peered":"2024-09-14T11:58:18.455327+0000","last_clean":"2024-09-14T11:58:18.455327+0000","last_became_active":"2024-09-14T11:06:45.990093+0000","last_became_peered":"2024-09-14T11:06:45.990093+0000","last_unstale":"2024-09-14T11:58:18.455327+0000","last_undegraded":"2024-09-14T11:58:18.455327+0000","last_fullsized":"2024-09-14T11:58:18.455327+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:20.070813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"263'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.604354+0000","last_change":"2024-09-14T11:06:41.913660+0000","last_active":"2024-09-14T12:01:17.604354+0000","last_peered":"2024-09-14T12:01:17.604354+0000","last_clean":"2024-09-14T12:01:17.604354+0000","last_became_active":"2024-09-14T11:06:41.913330+0000","last_became_peered":"2024-09-14T11:06:41.913330+0000","last_unstale":"2024-09-14T12:01:17.604354+0000","last_undegraded":"2024-09-14T12:01:17.604354+0000","last_fullsized":"2024-09-14T12:01:17.604354+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:02.767092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"263'51","reported_seq":192,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:10.644171+0000","last_change":"2024-09-14T11:02:34.879784+0000","last_active":"2024-09-14T11:58:10.644171+0000","last_peered":"2024-09-14T11:58:10.644171+0000","last_clean":"2024-09-14T11:58:10.644171+0000","last_became_active":"2024-09-14T11:02:34.879480+0000","last_became_peered":"2024-09-14T11:02:34.879480+0000","last_unstale":"2024-09-14T11:58:10.644171+0000","last_undegraded":"2024-09-14T11:58:10.644171+0000","last_fullsized":"2024-09-14T11:58:10.644171+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:26.792769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":249,"num_write":134,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:00.301161+0000","last_change":"2024-09-14T11:25:20.208545+0000","last_active":"2024-09-14T11:58:00.301161+0000","last_peered":"2024-09-14T11:58:00.301161+0000","last_clean":"2024-09-14T11:58:00.301161+0000","last_became_active":"2024-09-14T11:25:20.208253+0000","last_became_peered":"2024-09-14T11:25:20.208253+0000","last_unstale":"2024-09-14T11:58:00.301161+0000","last_undegraded":"2024-09-14T11:58:00.301161+0000","last_fullsized":"2024-09-14T11:58:00.301161+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:46.409317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:30.439086+0000","last_change":"2024-09-14T11:06:45.986563+0000","last_active":"2024-09-14T11:57:30.439086+0000","last_peered":"2024-09-14T11:57:30.439086+0000","last_clean":"2024-09-14T11:57:30.439086+0000","last_became_active":"2024-09-14T11:06:45.986268+0000","last_became_peered":"2024-09-14T11:06:45.986268+0000","last_unstale":"2024-09-14T11:57:30.439086+0000","last_undegraded":"2024-09-14T11:57:30.439086+0000","last_fullsized":"2024-09-14T11:57:30.439086+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:57.096459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.287810+0000","last_change":"2024-09-14T11:06:41.919231+0000","last_active":"2024-09-14T12:01:18.287810+0000","last_peered":"2024-09-14T12:01:18.287810+0000","last_clean":"2024-09-14T12:01:18.287810+0000","last_became_active":"2024-09-14T11:06:41.918902+0000","last_became_peered":"2024-09-14T11:06:41.918902+0000","last_unstale":"2024-09-14T12:01:18.287810+0000","last_undegraded":"2024-09-14T12:01:18.287810+0000","last_fullsized":"2024-09-14T12:01:18.287810+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:28.218893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"263'3","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:10.444411+0000","last_change":"2024-09-14T11:02:34.877942+0000","last_active":"2024-09-14T11:58:10.444411+0000","last_peered":"2024-09-14T11:58:10.444411+0000","last_clean":"2024-09-14T11:58:10.444411+0000","last_became_active":"2024-09-14T11:02:34.877623+0000","last_became_peered":"2024-09-14T11:02:34.877623+0000","last_unstale":"2024-09-14T11:58:10.444411+0000","last_undegraded":"2024-09-14T11:58:10.444411+0000","last_fullsized":"2024-09-14T11:58:10.444411+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:37.635532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:00.600265+0000","last_change":"2024-09-14T11:25:20.208685+0000","last_active":"2024-09-14T11:58:00.600265+0000","last_peered":"2024-09-14T11:58:00.600265+0000","last_clean":"2024-09-14T11:58:00.600265+0000","last_became_active":"2024-09-14T11:25:20.208411+0000","last_became_peered":"2024-09-14T11:25:20.208411+0000","last_unstale":"2024-09-14T11:58:00.600265+0000","last_undegraded":"2024-09-14T11:58:00.600265+0000","last_fullsized":"2024-09-14T11:58:00.600265+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:34.443942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:30.597082+0000","last_change":"2024-09-14T11:06:45.978750+0000","last_active":"2024-09-14T11:57:30.597082+0000","last_peered":"2024-09-14T11:57:30.597082+0000","last_clean":"2024-09-14T11:57:30.597082+0000","last_became_active":"2024-09-14T11:06:45.978458+0000","last_became_peered":"2024-09-14T11:06:45.978458+0000","last_unstale":"2024-09-14T11:57:30.597082+0000","last_undegraded":"2024-09-14T11:57:30.597082+0000","last_fullsized":"2024-09-14T11:57:30.597082+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:52.428245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:53.471119+0000","last_change":"2024-09-14T11:06:41.916068+0000","last_active":"2024-09-14T11:59:53.471119+0000","last_peered":"2024-09-14T11:59:53.471119+0000","last_clean":"2024-09-14T11:59:53.471119+0000","last_became_active":"2024-09-14T11:06:41.915795+0000","last_became_peered":"2024-09-14T11:06:41.915795+0000","last_unstale":"2024-09-14T11:59:53.471119+0000","last_undegraded":"2024-09-14T11:59:53.471119+0000","last_fullsized":"2024-09-14T11:59:53.471119+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:10.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"263'20","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.531842+0000","last_change":"2024-09-14T11:02:34.881678+0000","last_active":"2024-09-14T11:58:40.531842+0000","last_peered":"2024-09-14T11:58:40.531842+0000","last_clean":"2024-09-14T11:58:40.531842+0000","last_became_active":"2024-09-14T11:02:34.881333+0000","last_became_peered":"2024-09-14T11:02:34.881333+0000","last_unstale":"2024-09-14T11:58:40.531842+0000","last_undegraded":"2024-09-14T11:58:40.531842+0000","last_fullsized":"2024-09-14T11:58:40.531842+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:25.506302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":49,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.441698+0000","last_change":"2024-09-14T11:25:20.209663+0000","last_active":"2024-09-14T11:56:48.441698+0000","last_peered":"2024-09-14T11:56:48.441698+0000","last_clean":"2024-09-14T11:56:48.441698+0000","last_became_active":"2024-09-14T11:25:20.209369+0000","last_became_peered":"2024-09-14T11:25:20.209369+0000","last_unstale":"2024-09-14T11:56:48.441698+0000","last_undegraded":"2024-09-14T11:56:48.441698+0000","last_fullsized":"2024-09-14T11:56:48.441698+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:58.938617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:08.453886+0000","last_change":"2024-09-14T11:06:45.981996+0000","last_active":"2024-09-14T11:58:08.453886+0000","last_peered":"2024-09-14T11:58:08.453886+0000","last_clean":"2024-09-14T11:58:08.453886+0000","last_became_active":"2024-09-14T11:06:45.980211+0000","last_became_peered":"2024-09-14T11:06:45.980211+0000","last_unstale":"2024-09-14T11:58:08.453886+0000","last_undegraded":"2024-09-14T11:58:08.453886+0000","last_fullsized":"2024-09-14T11:58:08.453886+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:03.580856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.403612+0000","last_change":"2024-09-14T11:06:41.903200+0000","last_active":"2024-09-14T11:58:05.403612+0000","last_peered":"2024-09-14T11:58:05.403612+0000","last_clean":"2024-09-14T11:58:05.403612+0000","last_became_active":"2024-09-14T11:06:41.902894+0000","last_became_peered":"2024-09-14T11:06:41.902894+0000","last_unstale":"2024-09-14T11:58:05.403612+0000","last_undegraded":"2024-09-14T11:58:05.403612+0000","last_fullsized":"2024-09-14T11:58:05.403612+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:39.369082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"260'15","reported_seq":101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:35.531184+0000","last_change":"2024-09-14T11:02:34.873962+0000","last_active":"2024-09-14T11:58:35.531184+0000","last_peered":"2024-09-14T11:58:35.531184+0000","last_clean":"2024-09-14T11:58:35.531184+0000","last_became_active":"2024-09-14T11:02:34.873660+0000","last_became_peered":"2024-09-14T11:02:34.873660+0000","last_unstale":"2024-09-14T11:58:35.531184+0000","last_undegraded":"2024-09-14T11:58:35.531184+0000","last_fullsized":"2024-09-14T11:58:35.531184+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:08.878693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":83,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.508214+0000","last_change":"2024-09-14T11:25:20.210810+0000","last_active":"2024-09-14T11:56:48.508214+0000","last_peered":"2024-09-14T11:56:48.508214+0000","last_clean":"2024-09-14T11:56:48.508214+0000","last_became_active":"2024-09-14T11:25:20.210534+0000","last_became_peered":"2024-09-14T11:25:20.210534+0000","last_unstale":"2024-09-14T11:56:48.508214+0000","last_undegraded":"2024-09-14T11:56:48.508214+0000","last_fullsized":"2024-09-14T11:56:48.508214+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:04.144981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:08.453853+0000","last_change":"2024-09-14T11:06:45.985239+0000","last_active":"2024-09-14T11:58:08.453853+0000","last_peered":"2024-09-14T11:58:08.453853+0000","last_clean":"2024-09-14T11:58:08.453853+0000","last_became_active":"2024-09-14T11:06:45.984993+0000","last_became_peered":"2024-09-14T11:06:45.984993+0000","last_unstale":"2024-09-14T11:58:08.453853+0000","last_undegraded":"2024-09-14T11:58:08.453853+0000","last_fullsized":"2024-09-14T11:58:08.453853+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:26.543636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"263'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:23.475632+0000","last_change":"2024-09-14T11:06:41.910546+0000","last_active":"2024-09-14T12:00:23.475632+0000","last_peered":"2024-09-14T12:00:23.475632+0000","last_clean":"2024-09-14T12:00:23.475632+0000","last_became_active":"2024-09-14T11:06:41.910286+0000","last_became_peered":"2024-09-14T11:06:41.910286+0000","last_unstale":"2024-09-14T12:00:23.475632+0000","last_undegraded":"2024-09-14T12:00:23.475632+0000","last_fullsized":"2024-09-14T12:00:23.475632+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:00.405940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"263'55","reported_seq":203,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:35.447992+0000","last_change":"2024-09-14T11:02:34.873185+0000","last_active":"2024-09-14T11:58:35.447992+0000","last_peered":"2024-09-14T11:58:35.447992+0000","last_clean":"2024-09-14T11:58:35.447992+0000","last_became_active":"2024-09-14T11:02:34.872911+0000","last_became_peered":"2024-09-14T11:02:34.872911+0000","last_unstale":"2024-09-14T11:58:35.447992+0000","last_undegraded":"2024-09-14T11:58:35.447992+0000","last_fullsized":"2024-09-14T11:58:35.447992+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:20.423924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":434,"num_read_kb":298,"num_write":132,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.643221+0000","last_change":"2024-09-14T11:25:20.210573+0000","last_active":"2024-09-14T11:58:05.643221+0000","last_peered":"2024-09-14T11:58:05.643221+0000","last_clean":"2024-09-14T11:58:05.643221+0000","last_became_active":"2024-09-14T11:25:20.209547+0000","last_became_peered":"2024-09-14T11:25:20.209547+0000","last_unstale":"2024-09-14T11:58:05.643221+0000","last_undegraded":"2024-09-14T11:58:05.643221+0000","last_fullsized":"2024-09-14T11:58:05.643221+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:48.503085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:25.464893+0000","last_change":"2024-09-14T11:06:45.984844+0000","last_active":"2024-09-14T12:00:25.464893+0000","last_peered":"2024-09-14T12:00:25.464893+0000","last_clean":"2024-09-14T12:00:25.464893+0000","last_became_active":"2024-09-14T11:06:45.984527+0000","last_became_peered":"2024-09-14T11:06:45.984527+0000","last_unstale":"2024-09-14T12:00:25.464893+0000","last_undegraded":"2024-09-14T12:00:25.464893+0000","last_fullsized":"2024-09-14T12:00:25.464893+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:00.029592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"260'9","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.403653+0000","last_change":"2024-09-14T11:06:41.905789+0000","last_active":"2024-09-14T11:58:05.403653+0000","last_peered":"2024-09-14T11:58:05.403653+0000","last_clean":"2024-09-14T11:58:05.403653+0000","last_became_active":"2024-09-14T11:06:41.905088+0000","last_became_peered":"2024-09-14T11:06:41.905088+0000","last_unstale":"2024-09-14T11:58:05.403653+0000","last_undegraded":"2024-09-14T11:58:05.403653+0000","last_fullsized":"2024-09-14T11:58:05.403653+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:26.152725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17408,"num_write":9,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'36","reported_seq":152,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:35.304813+0000","last_change":"2024-09-14T11:02:34.873841+0000","last_active":"2024-09-14T11:58:35.304813+0000","last_peered":"2024-09-14T11:58:35.304813+0000","last_clean":"2024-09-14T11:58:35.304813+0000","last_became_active":"2024-09-14T11:02:34.873560+0000","last_became_peered":"2024-09-14T11:02:34.873560+0000","last_unstale":"2024-09-14T11:58:35.304813+0000","last_undegraded":"2024-09-14T11:58:35.304813+0000","last_fullsized":"2024-09-14T11:58:35.304813+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:07.656019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":270,"num_read_kb":162,"num_write":93,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.508186+0000","last_change":"2024-09-14T11:25:20.206947+0000","last_active":"2024-09-14T11:56:48.508186+0000","last_peered":"2024-09-14T11:56:48.508186+0000","last_clean":"2024-09-14T11:56:48.508186+0000","last_became_active":"2024-09-14T11:25:20.206692+0000","last_became_peered":"2024-09-14T11:25:20.206692+0000","last_unstale":"2024-09-14T11:56:48.508186+0000","last_undegraded":"2024-09-14T11:56:48.508186+0000","last_fullsized":"2024-09-14T11:56:48.508186+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:46.331575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.527582+0000","last_change":"2024-09-14T11:06:45.985776+0000","last_active":"2024-09-14T11:58:05.527582+0000","last_peered":"2024-09-14T11:58:05.527582+0000","last_clean":"2024-09-14T11:58:05.527582+0000","last_became_active":"2024-09-14T11:06:45.985436+0000","last_became_peered":"2024-09-14T11:06:45.985436+0000","last_unstale":"2024-09-14T11:58:05.527582+0000","last_undegraded":"2024-09-14T11:58:05.527582+0000","last_fullsized":"2024-09-14T11:58:05.527582+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:18.777447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.481613+0000","last_change":"2024-09-14T11:06:41.908095+0000","last_active":"2024-09-14T12:01:17.481613+0000","last_peered":"2024-09-14T12:01:17.481613+0000","last_clean":"2024-09-14T12:01:17.481613+0000","last_became_active":"2024-09-14T11:06:41.907791+0000","last_became_peered":"2024-09-14T11:06:41.907791+0000","last_unstale":"2024-09-14T12:01:17.481613+0000","last_undegraded":"2024-09-14T12:01:17.481613+0000","last_fullsized":"2024-09-14T12:01:17.481613+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:19.380573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5124,"num_write":5,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"263'33","reported_seq":149,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:35.447954+0000","last_change":"2024-09-14T11:02:34.876400+0000","last_active":"2024-09-14T11:58:35.447954+0000","last_peered":"2024-09-14T11:58:35.447954+0000","last_clean":"2024-09-14T11:58:35.447954+0000","last_became_active":"2024-09-14T11:02:34.876080+0000","last_became_peered":"2024-09-14T11:02:34.876080+0000","last_unstale":"2024-09-14T11:58:35.447954+0000","last_undegraded":"2024-09-14T11:58:35.447954+0000","last_fullsized":"2024-09-14T11:58:35.447954+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:45.087546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":186,"num_write":88,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:58.452425+0000","last_change":"2024-09-14T11:25:20.205656+0000","last_active":"2024-09-14T11:57:58.452425+0000","last_peered":"2024-09-14T11:57:58.452425+0000","last_clean":"2024-09-14T11:57:58.452425+0000","last_became_active":"2024-09-14T11:25:20.205335+0000","last_became_peered":"2024-09-14T11:25:20.205335+0000","last_unstale":"2024-09-14T11:57:58.452425+0000","last_undegraded":"2024-09-14T11:57:58.452425+0000","last_fullsized":"2024-09-14T11:57:58.452425+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:12.896781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:30.447384+0000","last_change":"2024-09-14T11:06:45.986506+0000","last_active":"2024-09-14T11:58:30.447384+0000","last_peered":"2024-09-14T11:58:30.447384+0000","last_clean":"2024-09-14T11:58:30.447384+0000","last_became_active":"2024-09-14T11:06:45.986225+0000","last_became_peered":"2024-09-14T11:06:45.986225+0000","last_unstale":"2024-09-14T11:58:30.447384+0000","last_undegraded":"2024-09-14T11:58:30.447384+0000","last_fullsized":"2024-09-14T11:58:30.447384+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:18.018900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"263'3","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:45.320227+0000","last_change":"2024-09-14T11:06:41.903610+0000","last_active":"2024-09-14T12:00:45.320227+0000","last_peered":"2024-09-14T12:00:45.320227+0000","last_clean":"2024-09-14T12:00:45.320227+0000","last_became_active":"2024-09-14T11:06:41.903188+0000","last_became_peered":"2024-09-14T11:06:41.903188+0000","last_unstale":"2024-09-14T12:00:45.320227+0000","last_undegraded":"2024-09-14T12:00:45.320227+0000","last_fullsized":"2024-09-14T12:00:45.320227+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:45.086214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"263'55","reported_seq":202,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.451654+0000","last_change":"2024-09-14T11:02:34.878079+0000","last_active":"2024-09-14T11:59:00.451654+0000","last_peered":"2024-09-14T11:59:00.451654+0000","last_clean":"2024-09-14T11:59:00.451654+0000","last_became_active":"2024-09-14T11:02:34.877631+0000","last_became_peered":"2024-09-14T11:02:34.877631+0000","last_unstale":"2024-09-14T11:59:00.451654+0000","last_undegraded":"2024-09-14T11:59:00.451654+0000","last_fullsized":"2024-09-14T11:59:00.451654+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:50.183737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":260,"num_write":147,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.409942+0000","last_change":"2024-09-14T11:25:20.203431+0000","last_active":"2024-09-14T11:59:05.409942+0000","last_peered":"2024-09-14T11:59:05.409942+0000","last_clean":"2024-09-14T11:59:05.409942+0000","last_became_active":"2024-09-14T11:25:20.200061+0000","last_became_peered":"2024-09-14T11:25:20.200061+0000","last_unstale":"2024-09-14T11:59:05.409942+0000","last_undegraded":"2024-09-14T11:59:05.409942+0000","last_fullsized":"2024-09-14T11:59:05.409942+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:15.179721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:45.467828+0000","last_change":"2024-09-14T11:06:45.991468+0000","last_active":"2024-09-14T12:00:45.467828+0000","last_peered":"2024-09-14T12:00:45.467828+0000","last_clean":"2024-09-14T12:00:45.467828+0000","last_became_active":"2024-09-14T11:06:45.991198+0000","last_became_peered":"2024-09-14T11:06:45.991198+0000","last_unstale":"2024-09-14T12:00:45.467828+0000","last_undegraded":"2024-09-14T12:00:45.467828+0000","last_fullsized":"2024-09-14T12:00:45.467828+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:02.331809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"263'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:43.542221+0000","last_change":"2024-09-14T11:06:41.910787+0000","last_active":"2024-09-14T12:00:43.542221+0000","last_peered":"2024-09-14T12:00:43.542221+0000","last_clean":"2024-09-14T12:00:43.542221+0000","last_became_active":"2024-09-14T11:06:41.910512+0000","last_became_peered":"2024-09-14T11:06:41.910512+0000","last_unstale":"2024-09-14T12:00:43.542221+0000","last_undegraded":"2024-09-14T12:00:43.542221+0000","last_fullsized":"2024-09-14T12:00:43.542221+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:20.996429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"263'44","reported_seq":172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.533064+0000","last_change":"2024-09-14T11:02:34.881693+0000","last_active":"2024-09-14T11:58:50.533064+0000","last_peered":"2024-09-14T11:58:50.533064+0000","last_clean":"2024-09-14T11:58:50.533064+0000","last_became_active":"2024-09-14T11:02:34.881341+0000","last_became_peered":"2024-09-14T11:02:34.881341+0000","last_unstale":"2024-09-14T11:58:50.533064+0000","last_undegraded":"2024-09-14T11:58:50.533064+0000","last_fullsized":"2024-09-14T11:58:50.533064+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:36.323501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":339,"num_read_kb":228,"num_write":117,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.525849+0000","last_change":"2024-09-14T11:25:20.210429+0000","last_active":"2024-09-14T11:57:50.525849+0000","last_peered":"2024-09-14T11:57:50.525849+0000","last_clean":"2024-09-14T11:57:50.525849+0000","last_became_active":"2024-09-14T11:25:20.210117+0000","last_became_peered":"2024-09-14T11:25:20.210117+0000","last_unstale":"2024-09-14T11:57:50.525849+0000","last_undegraded":"2024-09-14T11:57:50.525849+0000","last_fullsized":"2024-09-14T11:57:50.525849+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:07.063593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'6","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.152467+0000","last_change":"2024-09-14T11:06:45.992869+0000","last_active":"2024-09-14T12:01:18.152467+0000","last_peered":"2024-09-14T12:01:18.152467+0000","last_clean":"2024-09-14T12:01:18.152467+0000","last_became_active":"2024-09-14T11:06:45.992574+0000","last_became_peered":"2024-09-14T11:06:45.992574+0000","last_unstale":"2024-09-14T12:01:18.152467+0000","last_undegraded":"2024-09-14T12:01:18.152467+0000","last_fullsized":"2024-09-14T12:01:18.152467+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:58.347483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:30.447415+0000","last_change":"2024-09-14T11:06:41.919642+0000","last_active":"2024-09-14T11:58:30.447415+0000","last_peered":"2024-09-14T11:58:30.447415+0000","last_clean":"2024-09-14T11:58:30.447415+0000","last_became_active":"2024-09-14T11:06:41.919330+0000","last_became_peered":"2024-09-14T11:06:41.919330+0000","last_unstale":"2024-09-14T11:58:30.447415+0000","last_undegraded":"2024-09-14T11:58:30.447415+0000","last_fullsized":"2024-09-14T11:58:30.447415+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:18.967454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"263'112","reported_seq":390,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.408228+0000","last_change":"2024-09-14T11:02:34.873664+0000","last_active":"2024-09-14T11:58:50.408228+0000","last_peered":"2024-09-14T11:58:50.408228+0000","last_clean":"2024-09-14T11:58:50.408228+0000","last_became_active":"2024-09-14T11:02:34.873360+0000","last_became_peered":"2024-09-14T11:02:34.873360+0000","last_unstale":"2024-09-14T11:58:50.408228+0000","last_undegraded":"2024-09-14T11:58:50.408228+0000","last_fullsized":"2024-09-14T11:58:50.408228+0000","mapping_epoch":252,"log_start":"263'100","ondisk_log_start":"263'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:33.431081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1014,"num_read_kb":809,"num_write":225,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.401985+0000","last_change":"2024-09-14T11:25:20.200172+0000","last_active":"2024-09-14T11:57:50.401985+0000","last_peered":"2024-09-14T11:57:50.401985+0000","last_clean":"2024-09-14T11:57:50.401985+0000","last_became_active":"2024-09-14T11:25:20.199875+0000","last_became_peered":"2024-09-14T11:25:20.199875+0000","last_unstale":"2024-09-14T11:57:50.401985+0000","last_undegraded":"2024-09-14T11:57:50.401985+0000","last_fullsized":"2024-09-14T11:57:50.401985+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:26.854076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"260'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:33.457900+0000","last_change":"2024-09-14T11:06:45.980652+0000","last_active":"2024-09-14T11:58:33.457900+0000","last_peered":"2024-09-14T11:58:33.457900+0000","last_clean":"2024-09-14T11:58:33.457900+0000","last_became_active":"2024-09-14T11:06:45.980035+0000","last_became_peered":"2024-09-14T11:06:45.980035+0000","last_unstale":"2024-09-14T11:58:33.457900+0000","last_undegraded":"2024-09-14T11:58:33.457900+0000","last_fullsized":"2024-09-14T11:58:33.457900+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:36.733533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:55.469343+0000","last_change":"2024-09-14T11:06:41.917633+0000","last_active":"2024-09-14T12:00:55.469343+0000","last_peered":"2024-09-14T12:00:55.469343+0000","last_clean":"2024-09-14T12:00:55.469343+0000","last_became_active":"2024-09-14T11:06:41.917341+0000","last_became_peered":"2024-09-14T11:06:41.917341+0000","last_unstale":"2024-09-14T12:00:55.469343+0000","last_undegraded":"2024-09-14T12:00:55.469343+0000","last_fullsized":"2024-09-14T12:00:55.469343+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:27.626042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"260'15","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.526593+0000","last_change":"2024-09-14T11:02:34.876368+0000","last_active":"2024-09-14T11:58:53.526593+0000","last_peered":"2024-09-14T11:58:53.526593+0000","last_clean":"2024-09-14T11:58:53.526593+0000","last_became_active":"2024-09-14T11:02:34.876078+0000","last_became_peered":"2024-09-14T11:02:34.876078+0000","last_unstale":"2024-09-14T11:58:53.526593+0000","last_undegraded":"2024-09-14T11:58:53.526593+0000","last_fullsized":"2024-09-14T11:58:53.526593+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:14.606877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":83,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.442454+0000","last_change":"2024-09-14T11:25:20.210430+0000","last_active":"2024-09-14T11:56:53.442454+0000","last_peered":"2024-09-14T11:56:53.442454+0000","last_clean":"2024-09-14T11:56:53.442454+0000","last_became_active":"2024-09-14T11:25:20.210181+0000","last_became_peered":"2024-09-14T11:25:20.210181+0000","last_unstale":"2024-09-14T11:56:53.442454+0000","last_undegraded":"2024-09-14T11:56:53.442454+0000","last_fullsized":"2024-09-14T11:56:53.442454+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:56.596921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.532365+0000","last_change":"2024-09-14T11:06:45.984990+0000","last_active":"2024-09-14T11:58:45.532365+0000","last_peered":"2024-09-14T11:58:45.532365+0000","last_clean":"2024-09-14T11:58:45.532365+0000","last_became_active":"2024-09-14T11:06:45.984696+0000","last_became_peered":"2024-09-14T11:06:45.984696+0000","last_unstale":"2024-09-14T11:58:45.532365+0000","last_undegraded":"2024-09-14T11:58:45.532365+0000","last_fullsized":"2024-09-14T11:58:45.532365+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:17.939743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"263'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:55.469166+0000","last_change":"2024-09-14T11:06:41.914553+0000","last_active":"2024-09-14T12:00:55.469166+0000","last_peered":"2024-09-14T12:00:55.469166+0000","last_clean":"2024-09-14T12:00:55.469166+0000","last_became_active":"2024-09-14T11:06:41.914209+0000","last_became_peered":"2024-09-14T11:06:41.914209+0000","last_unstale":"2024-09-14T12:00:55.469166+0000","last_undegraded":"2024-09-14T12:00:55.469166+0000","last_fullsized":"2024-09-14T12:00:55.469166+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:46.262011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"263'35","reported_seq":148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.526513+0000","last_change":"2024-09-14T11:02:34.880131+0000","last_active":"2024-09-14T11:58:53.526513+0000","last_peered":"2024-09-14T11:58:53.526513+0000","last_clean":"2024-09-14T11:58:53.526513+0000","last_became_active":"2024-09-14T11:02:34.879834+0000","last_became_peered":"2024-09-14T11:02:34.879834+0000","last_unstale":"2024-09-14T11:58:53.526513+0000","last_undegraded":"2024-09-14T11:58:53.526513+0000","last_fullsized":"2024-09-14T11:58:53.526513+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:06.529921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":172,"num_write":95,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.294128+0000","last_change":"2024-09-14T11:25:20.205157+0000","last_active":"2024-09-14T11:56:55.294128+0000","last_peered":"2024-09-14T11:56:55.294128+0000","last_clean":"2024-09-14T11:56:55.294128+0000","last_became_active":"2024-09-14T11:25:20.204834+0000","last_became_peered":"2024-09-14T11:25:20.204834+0000","last_unstale":"2024-09-14T11:56:55.294128+0000","last_undegraded":"2024-09-14T11:56:55.294128+0000","last_fullsized":"2024-09-14T11:56:55.294128+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:44.546050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.305849+0000","last_change":"2024-09-14T11:06:45.986635+0000","last_active":"2024-09-14T11:58:45.305849+0000","last_peered":"2024-09-14T11:58:45.305849+0000","last_clean":"2024-09-14T11:58:45.305849+0000","last_became_active":"2024-09-14T11:06:45.984865+0000","last_became_peered":"2024-09-14T11:06:45.984865+0000","last_unstale":"2024-09-14T11:58:45.305849+0000","last_undegraded":"2024-09-14T11:58:45.305849+0000","last_fullsized":"2024-09-14T11:58:45.305849+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:51.926620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"260'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:43.459476+0000","last_change":"2024-09-14T11:06:41.909800+0000","last_active":"2024-09-14T11:58:43.459476+0000","last_peered":"2024-09-14T11:58:43.459476+0000","last_clean":"2024-09-14T11:58:43.459476+0000","last_became_active":"2024-09-14T11:06:41.909533+0000","last_became_peered":"2024-09-14T11:06:41.909533+0000","last_unstale":"2024-09-14T11:58:43.459476+0000","last_undegraded":"2024-09-14T11:58:43.459476+0000","last_fullsized":"2024-09-14T11:58:43.459476+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:38.325179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"263'25","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.308510+0000","last_change":"2024-09-14T11:02:34.873554+0000","last_active":"2024-09-14T11:59:10.308510+0000","last_peered":"2024-09-14T11:59:10.308510+0000","last_clean":"2024-09-14T11:59:10.308510+0000","last_became_active":"2024-09-14T11:02:34.873259+0000","last_became_peered":"2024-09-14T11:02:34.873259+0000","last_unstale":"2024-09-14T11:59:10.308510+0000","last_undegraded":"2024-09-14T11:59:10.308510+0000","last_fullsized":"2024-09-14T11:59:10.308510+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:05.178830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":129,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.607073+0000","last_change":"2024-09-14T11:25:20.212620+0000","last_active":"2024-09-14T11:59:05.607073+0000","last_peered":"2024-09-14T11:59:05.607073+0000","last_clean":"2024-09-14T11:59:05.607073+0000","last_became_active":"2024-09-14T11:25:20.212293+0000","last_became_peered":"2024-09-14T11:25:20.212293+0000","last_unstale":"2024-09-14T11:59:05.607073+0000","last_undegraded":"2024-09-14T11:59:05.607073+0000","last_fullsized":"2024-09-14T11:59:05.607073+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:10.346864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:33.523575+0000","last_change":"2024-09-14T11:06:45.986687+0000","last_active":"2024-09-14T11:58:33.523575+0000","last_peered":"2024-09-14T11:58:33.523575+0000","last_clean":"2024-09-14T11:58:33.523575+0000","last_became_active":"2024-09-14T11:06:45.986398+0000","last_became_peered":"2024-09-14T11:06:45.986398+0000","last_unstale":"2024-09-14T11:58:33.523575+0000","last_undegraded":"2024-09-14T11:58:33.523575+0000","last_fullsized":"2024-09-14T11:58:33.523575+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:28.445077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"260'10","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.450778+0000","last_change":"2024-09-14T11:06:41.915770+0000","last_active":"2024-09-14T11:58:55.450778+0000","last_peered":"2024-09-14T11:58:55.450778+0000","last_clean":"2024-09-14T11:58:55.450778+0000","last_became_active":"2024-09-14T11:06:41.915491+0000","last_became_peered":"2024-09-14T11:06:41.915491+0000","last_unstale":"2024-09-14T11:58:55.450778+0000","last_undegraded":"2024-09-14T11:58:55.450778+0000","last_fullsized":"2024-09-14T11:58:55.450778+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:33.737820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":40964,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"260'12","reported_seq":91,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.462030+0000","last_change":"2024-09-14T11:02:34.872228+0000","last_active":"2024-09-14T11:58:58.462030+0000","last_peered":"2024-09-14T11:58:58.462030+0000","last_clean":"2024-09-14T11:58:58.462030+0000","last_became_active":"2024-09-14T11:02:34.871352+0000","last_became_peered":"2024-09-14T11:02:34.871352+0000","last_unstale":"2024-09-14T11:58:58.462030+0000","last_undegraded":"2024-09-14T11:58:58.462030+0000","last_fullsized":"2024-09-14T11:58:58.462030+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:29.511969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.452308+0000","last_change":"2024-09-14T11:25:20.214092+0000","last_active":"2024-09-14T11:59:05.452308+0000","last_peered":"2024-09-14T11:59:05.452308+0000","last_clean":"2024-09-14T11:59:05.452308+0000","last_became_active":"2024-09-14T11:25:20.213785+0000","last_became_peered":"2024-09-14T11:25:20.213785+0000","last_unstale":"2024-09-14T11:59:05.452308+0000","last_undegraded":"2024-09-14T11:59:05.452308+0000","last_fullsized":"2024-09-14T11:59:05.452308+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:56.298725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"260'2","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.605100+0000","last_change":"2024-09-14T11:06:45.981838+0000","last_active":"2024-09-14T11:58:45.605100+0000","last_peered":"2024-09-14T11:58:45.605100+0000","last_clean":"2024-09-14T11:58:45.605100+0000","last_became_active":"2024-09-14T11:06:45.981476+0000","last_became_peered":"2024-09-14T11:06:45.981476+0000","last_unstale":"2024-09-14T11:58:45.605100+0000","last_undegraded":"2024-09-14T11:58:45.605100+0000","last_fullsized":"2024-09-14T11:58:45.605100+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:58.441972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"260'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:30.530578+0000","last_change":"2024-09-14T11:06:41.911683+0000","last_active":"2024-09-14T11:58:30.530578+0000","last_peered":"2024-09-14T11:58:30.530578+0000","last_clean":"2024-09-14T11:58:30.530578+0000","last_became_active":"2024-09-14T11:06:41.911413+0000","last_became_peered":"2024-09-14T11:06:41.911413+0000","last_unstale":"2024-09-14T11:58:30.530578+0000","last_undegraded":"2024-09-14T11:58:30.530578+0000","last_fullsized":"2024-09-14T11:58:30.530578+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:52.497275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"263'38","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.606077+0000","last_change":"2024-09-14T11:02:34.879059+0000","last_active":"2024-09-14T11:58:55.606077+0000","last_peered":"2024-09-14T11:58:55.606077+0000","last_clean":"2024-09-14T11:58:55.606077+0000","last_became_active":"2024-09-14T11:02:34.878752+0000","last_became_peered":"2024-09-14T11:02:34.878752+0000","last_unstale":"2024-09-14T11:58:55.606077+0000","last_undegraded":"2024-09-14T11:58:55.606077+0000","last_fullsized":"2024-09-14T11:58:55.606077+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:34.432738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":231,"num_write":89,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.604290+0000","last_change":"2024-09-14T11:25:20.211271+0000","last_active":"2024-09-14T11:58:40.604290+0000","last_peered":"2024-09-14T11:58:40.604290+0000","last_clean":"2024-09-14T11:58:40.604290+0000","last_became_active":"2024-09-14T11:25:20.210999+0000","last_became_peered":"2024-09-14T11:25:20.210999+0000","last_unstale":"2024-09-14T11:58:40.604290+0000","last_undegraded":"2024-09-14T11:58:40.604290+0000","last_fullsized":"2024-09-14T11:58:40.604290+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:13.729258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.462863+0000","last_change":"2024-09-14T11:06:45.982956+0000","last_active":"2024-09-14T11:59:03.462863+0000","last_peered":"2024-09-14T11:59:03.462863+0000","last_clean":"2024-09-14T11:59:03.462863+0000","last_became_active":"2024-09-14T11:06:45.982181+0000","last_became_peered":"2024-09-14T11:06:45.982181+0000","last_unstale":"2024-09-14T11:59:03.462863+0000","last_undegraded":"2024-09-14T11:59:03.462863+0000","last_fullsized":"2024-09-14T11:59:03.462863+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:18.506633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.533019+0000","last_change":"2024-09-14T11:06:41.914378+0000","last_active":"2024-09-14T11:58:50.533019+0000","last_peered":"2024-09-14T11:58:50.533019+0000","last_clean":"2024-09-14T11:58:50.533019+0000","last_became_active":"2024-09-14T11:06:41.913192+0000","last_became_peered":"2024-09-14T11:06:41.913192+0000","last_unstale":"2024-09-14T11:58:50.533019+0000","last_undegraded":"2024-09-14T11:58:50.533019+0000","last_fullsized":"2024-09-14T11:58:50.533019+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:24.679035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"263'32","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.650978+0000","last_change":"2024-09-14T11:02:34.874602+0000","last_active":"2024-09-14T11:58:55.650978+0000","last_peered":"2024-09-14T11:58:55.650978+0000","last_clean":"2024-09-14T11:58:55.650978+0000","last_became_active":"2024-09-14T11:02:34.874328+0000","last_became_peered":"2024-09-14T11:02:34.874328+0000","last_unstale":"2024-09-14T11:58:55.650978+0000","last_undegraded":"2024-09-14T11:58:55.650978+0000","last_fullsized":"2024-09-14T11:58:55.650978+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:09.428522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":246,"num_read_kb":166,"num_write":81,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.604315+0000","last_change":"2024-09-14T11:25:20.213871+0000","last_active":"2024-09-14T11:58:40.604315+0000","last_peered":"2024-09-14T11:58:40.604315+0000","last_clean":"2024-09-14T11:58:40.604315+0000","last_became_active":"2024-09-14T11:25:20.213577+0000","last_became_peered":"2024-09-14T11:25:20.213577+0000","last_unstale":"2024-09-14T11:58:40.604315+0000","last_undegraded":"2024-09-14T11:58:40.604315+0000","last_fullsized":"2024-09-14T11:58:40.604315+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:03.148226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"263'10","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.842742+0000","last_change":"2024-09-14T11:06:45.991127+0000","last_active":"2024-09-14T12:01:17.842742+0000","last_peered":"2024-09-14T12:01:17.842742+0000","last_clean":"2024-09-14T12:01:17.842742+0000","last_became_active":"2024-09-14T11:06:45.990855+0000","last_became_peered":"2024-09-14T11:06:45.990855+0000","last_unstale":"2024-09-14T12:01:17.842742+0000","last_undegraded":"2024-09-14T12:01:17.842742+0000","last_fullsized":"2024-09-14T12:01:17.842742+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:28.658329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6246,"num_write":20,"num_write_kb":2098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"263'8","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:10.670577+0000","last_change":"2024-09-14T11:06:41.913753+0000","last_active":"2024-09-14T12:01:10.670577+0000","last_peered":"2024-09-14T12:01:10.670577+0000","last_clean":"2024-09-14T12:01:10.670577+0000","last_became_active":"2024-09-14T11:06:41.913454+0000","last_became_peered":"2024-09-14T11:06:41.913454+0000","last_unstale":"2024-09-14T12:01:10.670577+0000","last_undegraded":"2024-09-14T12:01:10.670577+0000","last_fullsized":"2024-09-14T12:01:10.670577+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:38.121049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":18,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'130","reported_seq":444,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.533642+0000","last_change":"2024-09-14T11:02:34.879730+0000","last_active":"2024-09-14T11:58:55.533642+0000","last_peered":"2024-09-14T11:58:55.533642+0000","last_clean":"2024-09-14T11:58:55.533642+0000","last_became_active":"2024-09-14T11:02:34.878813+0000","last_became_peered":"2024-09-14T11:02:34.878813+0000","last_unstale":"2024-09-14T11:58:55.533642+0000","last_undegraded":"2024-09-14T11:58:55.533642+0000","last_fullsized":"2024-09-14T11:58:55.533642+0000","mapping_epoch":252,"log_start":"260'100","ondisk_log_start":"260'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:00.256155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1195,"num_read_kb":1160,"num_write":263,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.447900+0000","last_change":"2024-09-14T11:25:20.212941+0000","last_active":"2024-09-14T11:57:28.447900+0000","last_peered":"2024-09-14T11:57:28.447900+0000","last_clean":"2024-09-14T11:57:28.447900+0000","last_became_active":"2024-09-14T11:25:20.212665+0000","last_became_peered":"2024-09-14T11:25:20.212665+0000","last_unstale":"2024-09-14T11:57:28.447900+0000","last_undegraded":"2024-09-14T11:57:28.447900+0000","last_fullsized":"2024-09-14T11:57:28.447900+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:31.076495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.605166+0000","last_change":"2024-09-14T11:06:45.992405+0000","last_active":"2024-09-14T11:58:45.605166+0000","last_peered":"2024-09-14T11:58:45.605166+0000","last_clean":"2024-09-14T11:58:45.605166+0000","last_became_active":"2024-09-14T11:06:45.992066+0000","last_became_peered":"2024-09-14T11:06:45.992066+0000","last_unstale":"2024-09-14T11:58:45.605166+0000","last_undegraded":"2024-09-14T11:58:45.605166+0000","last_fullsized":"2024-09-14T11:58:45.605166+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:42.417189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"260'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.305944+0000","last_change":"2024-09-14T11:06:41.912718+0000","last_active":"2024-09-14T11:58:45.305944+0000","last_peered":"2024-09-14T11:58:45.305944+0000","last_clean":"2024-09-14T11:58:45.305944+0000","last_became_active":"2024-09-14T11:06:41.912405+0000","last_became_peered":"2024-09-14T11:06:41.912405+0000","last_unstale":"2024-09-14T11:58:45.305944+0000","last_undegraded":"2024-09-14T11:58:45.305944+0000","last_fullsized":"2024-09-14T11:58:45.305944+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:12.800532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"263'36","reported_seq":158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.307994+0000","last_change":"2024-09-14T11:02:34.873402+0000","last_active":"2024-09-14T11:59:05.307994+0000","last_peered":"2024-09-14T11:59:05.307994+0000","last_clean":"2024-09-14T11:59:05.307994+0000","last_became_active":"2024-09-14T11:02:34.873089+0000","last_became_peered":"2024-09-14T11:02:34.873089+0000","last_unstale":"2024-09-14T11:59:05.307994+0000","last_undegraded":"2024-09-14T11:59:05.307994+0000","last_fullsized":"2024-09-14T11:59:05.307994+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:47.372158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":295,"num_read_kb":200,"num_write":86,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.531790+0000","last_change":"2024-09-14T11:25:20.210966+0000","last_active":"2024-09-14T11:58:40.531790+0000","last_peered":"2024-09-14T11:58:40.531790+0000","last_clean":"2024-09-14T11:58:40.531790+0000","last_became_active":"2024-09-14T11:25:20.210331+0000","last_became_peered":"2024-09-14T11:25:20.210331+0000","last_unstale":"2024-09-14T11:58:40.531790+0000","last_undegraded":"2024-09-14T11:58:40.531790+0000","last_fullsized":"2024-09-14T11:58:40.531790+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:27.694386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.532467+0000","last_change":"2024-09-14T11:06:45.986136+0000","last_active":"2024-09-14T11:58:45.532467+0000","last_peered":"2024-09-14T11:58:45.532467+0000","last_clean":"2024-09-14T11:58:45.532467+0000","last_became_active":"2024-09-14T11:06:45.985792+0000","last_became_peered":"2024-09-14T11:06:45.985792+0000","last_unstale":"2024-09-14T11:58:45.532467+0000","last_undegraded":"2024-09-14T11:58:45.532467+0000","last_fullsized":"2024-09-14T11:58:45.532467+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:18.428977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.532481+0000","last_change":"2024-09-14T11:06:41.914556+0000","last_active":"2024-09-14T11:58:45.532481+0000","last_peered":"2024-09-14T11:58:45.532481+0000","last_clean":"2024-09-14T11:58:45.532481+0000","last_became_active":"2024-09-14T11:06:41.913214+0000","last_became_peered":"2024-09-14T11:06:41.913214+0000","last_unstale":"2024-09-14T11:58:45.532481+0000","last_undegraded":"2024-09-14T11:58:45.532481+0000","last_fullsized":"2024-09-14T11:58:45.532481+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:05.435530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"263'55","reported_seq":209,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.450078+0000","last_change":"2024-09-14T11:02:34.873880+0000","last_active":"2024-09-14T11:58:50.450078+0000","last_peered":"2024-09-14T11:58:50.450078+0000","last_clean":"2024-09-14T11:58:50.450078+0000","last_became_active":"2024-09-14T11:02:34.873554+0000","last_became_peered":"2024-09-14T11:02:34.873554+0000","last_unstale":"2024-09-14T11:58:50.450078+0000","last_undegraded":"2024-09-14T11:58:50.450078+0000","last_fullsized":"2024-09-14T11:58:50.450078+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:52.441238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":297,"num_write":136,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.441967+0000","last_change":"2024-09-14T11:25:20.209266+0000","last_active":"2024-09-14T11:57:50.441967+0000","last_peered":"2024-09-14T11:57:50.441967+0000","last_clean":"2024-09-14T11:57:50.441967+0000","last_became_active":"2024-09-14T11:25:20.208985+0000","last_became_peered":"2024-09-14T11:25:20.208985+0000","last_unstale":"2024-09-14T11:57:50.441967+0000","last_undegraded":"2024-09-14T11:57:50.441967+0000","last_fullsized":"2024-09-14T11:57:50.441967+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:35.791238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"260'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.650067+0000","last_change":"2024-09-14T11:06:45.987976+0000","last_active":"2024-09-14T11:58:50.650067+0000","last_peered":"2024-09-14T11:58:50.650067+0000","last_clean":"2024-09-14T11:58:50.650067+0000","last_became_active":"2024-09-14T11:06:45.987665+0000","last_became_peered":"2024-09-14T11:06:45.987665+0000","last_unstale":"2024-09-14T11:58:50.650067+0000","last_undegraded":"2024-09-14T11:58:50.650067+0000","last_fullsized":"2024-09-14T11:58:50.650067+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:33.778940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5649,"num_write":5,"num_write_kb":5649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"260'8","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.307436+0000","last_change":"2024-09-14T11:06:41.906763+0000","last_active":"2024-09-14T11:59:00.307436+0000","last_peered":"2024-09-14T11:59:00.307436+0000","last_clean":"2024-09-14T11:59:00.307436+0000","last_became_active":"2024-09-14T11:06:41.906528+0000","last_became_peered":"2024-09-14T11:06:41.906528+0000","last_unstale":"2024-09-14T11:59:00.307436+0000","last_undegraded":"2024-09-14T11:59:00.307436+0000","last_fullsized":"2024-09-14T11:59:00.307436+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:50.072640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"263'49","reported_seq":191,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.306450+0000","last_change":"2024-09-14T11:02:34.869488+0000","last_active":"2024-09-14T11:58:50.306450+0000","last_peered":"2024-09-14T11:58:50.306450+0000","last_clean":"2024-09-14T11:58:50.306450+0000","last_became_active":"2024-09-14T11:02:34.869154+0000","last_became_peered":"2024-09-14T11:02:34.869154+0000","last_unstale":"2024-09-14T11:58:50.306450+0000","last_undegraded":"2024-09-14T11:58:50.306450+0000","last_fullsized":"2024-09-14T11:58:50.306450+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:51.708190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":272,"num_write":122,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.641217+0000","last_change":"2024-09-14T11:25:20.209267+0000","last_active":"2024-09-14T11:57:50.641217+0000","last_peered":"2024-09-14T11:57:50.641217+0000","last_clean":"2024-09-14T11:57:50.641217+0000","last_became_active":"2024-09-14T11:25:20.208992+0000","last_became_peered":"2024-09-14T11:25:20.208992+0000","last_unstale":"2024-09-14T11:57:50.641217+0000","last_undegraded":"2024-09-14T11:57:50.641217+0000","last_fullsized":"2024-09-14T11:57:50.641217+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:33.801493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"263'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.845194+0000","last_change":"2024-09-14T11:06:45.985807+0000","last_active":"2024-09-14T12:01:17.845194+0000","last_peered":"2024-09-14T12:01:17.845194+0000","last_clean":"2024-09-14T12:01:17.845194+0000","last_became_active":"2024-09-14T11:06:45.985518+0000","last_became_peered":"2024-09-14T11:06:45.985518+0000","last_unstale":"2024-09-14T12:01:17.845194+0000","last_undegraded":"2024-09-14T12:01:17.845194+0000","last_fullsized":"2024-09-14T12:01:17.845194+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:53.847804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:55.549750+0000","last_change":"2024-09-14T11:06:41.915181+0000","last_active":"2024-09-14T12:00:55.549750+0000","last_peered":"2024-09-14T12:00:55.549750+0000","last_clean":"2024-09-14T12:00:55.549750+0000","last_became_active":"2024-09-14T11:06:41.914346+0000","last_became_peered":"2024-09-14T11:06:41.914346+0000","last_unstale":"2024-09-14T12:00:55.549750+0000","last_undegraded":"2024-09-14T12:00:55.549750+0000","last_fullsized":"2024-09-14T12:00:55.549750+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:17.184490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"263'33","reported_seq":145,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.532990+0000","last_change":"2024-09-14T11:02:34.880356+0000","last_active":"2024-09-14T11:58:50.532990+0000","last_peered":"2024-09-14T11:58:50.532990+0000","last_clean":"2024-09-14T11:58:50.532990+0000","last_became_active":"2024-09-14T11:02:34.880066+0000","last_became_peered":"2024-09-14T11:02:34.880066+0000","last_unstale":"2024-09-14T11:58:50.532990+0000","last_undegraded":"2024-09-14T11:58:50.532990+0000","last_fullsized":"2024-09-14T11:58:50.532990+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:20.037542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":165,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:43.459528+0000","last_change":"2024-09-14T11:25:20.211431+0000","last_active":"2024-09-14T11:58:43.459528+0000","last_peered":"2024-09-14T11:58:43.459528+0000","last_clean":"2024-09-14T11:58:43.459528+0000","last_became_active":"2024-09-14T11:25:20.208291+0000","last_became_peered":"2024-09-14T11:25:20.208291+0000","last_unstale":"2024-09-14T11:58:43.459528+0000","last_undegraded":"2024-09-14T11:58:43.459528+0000","last_fullsized":"2024-09-14T11:58:43.459528+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:10.519199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"260'3","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.306441+0000","last_change":"2024-09-14T11:06:45.988585+0000","last_active":"2024-09-14T11:58:50.306441+0000","last_peered":"2024-09-14T11:58:50.306441+0000","last_clean":"2024-09-14T11:58:50.306441+0000","last_became_active":"2024-09-14T11:06:45.988268+0000","last_became_peered":"2024-09-14T11:06:45.988268+0000","last_unstale":"2024-09-14T11:58:50.306441+0000","last_undegraded":"2024-09-14T11:58:50.306441+0000","last_fullsized":"2024-09-14T11:58:50.306441+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:29.911599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.525697+0000","last_change":"2024-09-14T11:06:41.910335+0000","last_active":"2024-09-14T11:58:48.525697+0000","last_peered":"2024-09-14T11:58:48.525697+0000","last_clean":"2024-09-14T11:58:48.525697+0000","last_became_active":"2024-09-14T11:06:41.909915+0000","last_became_peered":"2024-09-14T11:06:41.909915+0000","last_unstale":"2024-09-14T11:58:48.525697+0000","last_undegraded":"2024-09-14T11:58:48.525697+0000","last_fullsized":"2024-09-14T11:58:48.525697+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:47.834488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"263'21","reported_seq":116,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.532964+0000","last_change":"2024-09-14T11:02:34.878110+0000","last_active":"2024-09-14T11:58:50.532964+0000","last_peered":"2024-09-14T11:58:50.532964+0000","last_clean":"2024-09-14T11:58:50.532964+0000","last_became_active":"2024-09-14T11:02:34.877791+0000","last_became_peered":"2024-09-14T11:02:34.877791+0000","last_unstale":"2024-09-14T11:58:50.532964+0000","last_undegraded":"2024-09-14T11:58:50.532964+0000","last_fullsized":"2024-09-14T11:58:50.532964+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:00.836048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":103,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.531860+0000","last_change":"2024-09-14T11:25:20.208774+0000","last_active":"2024-09-14T11:58:40.531860+0000","last_peered":"2024-09-14T11:58:40.531860+0000","last_clean":"2024-09-14T11:58:40.531860+0000","last_became_active":"2024-09-14T11:25:20.208495+0000","last_became_peered":"2024-09-14T11:25:20.208495+0000","last_unstale":"2024-09-14T11:58:40.531860+0000","last_undegraded":"2024-09-14T11:58:40.531860+0000","last_fullsized":"2024-09-14T11:58:40.531860+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:18.019657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"263'3","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:55.321309+0000","last_change":"2024-09-14T11:06:45.987276+0000","last_active":"2024-09-14T12:00:55.321309+0000","last_peered":"2024-09-14T12:00:55.321309+0000","last_clean":"2024-09-14T12:00:55.321309+0000","last_became_active":"2024-09-14T11:06:45.986990+0000","last_became_peered":"2024-09-14T11:06:45.986990+0000","last_unstale":"2024-09-14T12:00:55.321309+0000","last_undegraded":"2024-09-14T12:00:55.321309+0000","last_fullsized":"2024-09-14T12:00:55.321309+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:48.346557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.408167+0000","last_change":"2024-09-14T11:06:41.915671+0000","last_active":"2024-09-14T11:58:50.408167+0000","last_peered":"2024-09-14T11:58:50.408167+0000","last_clean":"2024-09-14T11:58:50.408167+0000","last_became_active":"2024-09-14T11:06:41.915372+0000","last_became_peered":"2024-09-14T11:06:41.915372+0000","last_unstale":"2024-09-14T11:58:50.408167+0000","last_undegraded":"2024-09-14T11:58:50.408167+0000","last_fullsized":"2024-09-14T11:58:50.408167+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:08.016650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"263'13","reported_seq":96,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.306383+0000","last_change":"2024-09-14T11:02:34.879297+0000","last_active":"2024-09-14T11:58:50.306383+0000","last_peered":"2024-09-14T11:58:50.306383+0000","last_clean":"2024-09-14T11:58:50.306383+0000","last_became_active":"2024-09-14T11:02:34.879002+0000","last_became_peered":"2024-09-14T11:02:34.879002+0000","last_unstale":"2024-09-14T11:58:50.306383+0000","last_undegraded":"2024-09-14T11:58:50.306383+0000","last_fullsized":"2024-09-14T11:58:50.306383+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:18.663446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":56,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'347","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.365123+0000","last_change":"2024-09-14T10:46:44.332154+0000","last_active":"2024-09-14T12:01:19.365123+0000","last_peered":"2024-09-14T12:01:19.365123+0000","last_clean":"2024-09-14T12:01:19.365123+0000","last_became_active":"2024-09-14T10:46:44.331827+0000","last_became_peered":"2024-09-14T10:46:44.331827+0000","last_unstale":"2024-09-14T12:01:19.365123+0000","last_undegraded":"2024-09-14T12:01:19.365123+0000","last_fullsized":"2024-09-14T12:01:19.365123+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:51.461537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":808,"num_read_kb":10519,"num_write":1133,"num_write_kb":31597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"263'506","reported_seq":2200,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.709310+0000","last_change":"2024-09-14T10:46:46.341235+0000","last_active":"2024-09-14T11:59:34.709310+0000","last_peered":"2024-09-14T11:59:34.709310+0000","last_clean":"2024-09-14T11:59:34.709310+0000","last_became_active":"2024-09-14T10:46:46.340949+0000","last_became_peered":"2024-09-14T10:46:46.340949+0000","last_unstale":"2024-09-14T11:59:34.709310+0000","last_undegraded":"2024-09-14T11:59:34.709310+0000","last_fullsized":"2024-09-14T11:59:34.709310+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:28.432778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2834,"num_read_kb":2670,"num_write":604,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"263'320","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.423872+0000","last_change":"2024-09-14T10:46:44.333346+0000","last_active":"2024-09-14T12:01:18.423872+0000","last_peered":"2024-09-14T12:01:18.423872+0000","last_clean":"2024-09-14T12:01:18.423872+0000","last_became_active":"2024-09-14T10:46:44.332997+0000","last_became_peered":"2024-09-14T10:46:44.332997+0000","last_unstale":"2024-09-14T12:01:18.423872+0000","last_undegraded":"2024-09-14T12:01:18.423872+0000","last_fullsized":"2024-09-14T12:01:18.423872+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:12.331728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5540160,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":550,"num_read_kb":4891,"num_write":1023,"num_write_kb":34401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"263'664","reported_seq":2310,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.149223+0000","last_change":"2024-09-14T10:46:46.340953+0000","last_active":"2024-09-14T12:00:51.149223+0000","last_peered":"2024-09-14T12:00:51.149223+0000","last_clean":"2024-09-14T12:00:51.149223+0000","last_became_active":"2024-09-14T10:46:46.340612+0000","last_became_peered":"2024-09-14T10:46:46.340612+0000","last_unstale":"2024-09-14T12:00:51.149223+0000","last_undegraded":"2024-09-14T12:00:51.149223+0000","last_fullsized":"2024-09-14T12:00:51.149223+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":600,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:41.266834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3359,"num_read_kb":3045,"num_write":872,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"263'294","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.427907+0000","last_change":"2024-09-14T10:46:44.320649+0000","last_active":"2024-09-14T12:01:18.427907+0000","last_peered":"2024-09-14T12:01:18.427907+0000","last_clean":"2024-09-14T12:01:18.427907+0000","last_became_active":"2024-09-14T10:46:44.320254+0000","last_became_peered":"2024-09-14T10:46:44.320254+0000","last_unstale":"2024-09-14T12:01:18.427907+0000","last_undegraded":"2024-09-14T12:01:18.427907+0000","last_fullsized":"2024-09-14T12:01:18.427907+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:19.897879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6377850,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":557,"num_read_kb":18043,"num_write":1126,"num_write_kb":30368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"263'455","reported_seq":1884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.679270+0000","last_change":"2024-09-14T10:46:46.338061+0000","last_active":"2024-09-14T11:59:34.679270+0000","last_peered":"2024-09-14T11:59:34.679270+0000","last_clean":"2024-09-14T11:59:34.679270+0000","last_became_active":"2024-09-14T10:46:46.337092+0000","last_became_peered":"2024-09-14T10:46:46.337092+0000","last_unstale":"2024-09-14T11:59:34.679270+0000","last_undegraded":"2024-09-14T11:59:34.679270+0000","last_fullsized":"2024-09-14T11:59:34.679270+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:11.129363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2407,"num_read_kb":2236,"num_write":590,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"263'320","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.403504+0000","last_change":"2024-09-14T10:46:44.322511+0000","last_active":"2024-09-14T12:01:19.403504+0000","last_peered":"2024-09-14T12:01:19.403504+0000","last_clean":"2024-09-14T12:01:19.403504+0000","last_became_active":"2024-09-14T10:46:44.321098+0000","last_became_peered":"2024-09-14T10:46:44.321098+0000","last_unstale":"2024-09-14T12:01:19.403504+0000","last_undegraded":"2024-09-14T12:01:19.403504+0000","last_fullsized":"2024-09-14T12:01:19.403504+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:44.225925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":621,"num_read_kb":93491,"num_write":1039,"num_write_kb":33828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"263'561","reported_seq":2220,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:21.444561+0000","last_change":"2024-09-14T10:46:46.338161+0000","last_active":"2024-09-14T11:58:21.444561+0000","last_peered":"2024-09-14T11:58:21.444561+0000","last_clean":"2024-09-14T11:58:21.444561+0000","last_became_active":"2024-09-14T10:46:46.337883+0000","last_became_peered":"2024-09-14T10:46:46.337883+0000","last_unstale":"2024-09-14T11:58:21.444561+0000","last_undegraded":"2024-09-14T11:58:21.444561+0000","last_fullsized":"2024-09-14T11:58:21.444561+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:51.194169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3147,"num_read_kb":2923,"num_write":727,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"263'377","reported_seq":1056,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.349667+0000","last_change":"2024-09-14T10:46:44.325129+0000","last_active":"2024-09-14T12:01:19.349667+0000","last_peered":"2024-09-14T12:01:19.349667+0000","last_clean":"2024-09-14T12:01:19.349667+0000","last_became_active":"2024-09-14T10:46:44.324768+0000","last_became_peered":"2024-09-14T10:46:44.324768+0000","last_unstale":"2024-09-14T12:01:19.349667+0000","last_undegraded":"2024-09-14T12:01:19.349667+0000","last_fullsized":"2024-09-14T12:01:19.349667+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:07.568042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":706,"num_read_kb":82703,"num_write":1285,"num_write_kb":36007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"263'447","reported_seq":2074,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.606129+0000","last_change":"2024-09-14T10:46:46.342723+0000","last_active":"2024-09-14T11:58:55.606129+0000","last_peered":"2024-09-14T11:58:55.606129+0000","last_clean":"2024-09-14T11:58:55.606129+0000","last_became_active":"2024-09-14T10:46:46.338973+0000","last_became_peered":"2024-09-14T10:46:46.338973+0000","last_unstale":"2024-09-14T11:58:55.606129+0000","last_undegraded":"2024-09-14T11:58:55.606129+0000","last_fullsized":"2024-09-14T11:58:55.606129+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:09.155102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2500,"num_read_kb":2382,"num_write":507,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"263'357","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.378797+0000","last_change":"2024-09-14T10:46:44.320180+0000","last_active":"2024-09-14T12:01:19.378797+0000","last_peered":"2024-09-14T12:01:19.378797+0000","last_clean":"2024-09-14T12:01:19.378797+0000","last_became_active":"2024-09-14T10:46:44.319801+0000","last_became_peered":"2024-09-14T10:46:44.319801+0000","last_unstale":"2024-09-14T12:01:19.378797+0000","last_undegraded":"2024-09-14T12:01:19.378797+0000","last_fullsized":"2024-09-14T12:01:19.378797+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:56.539279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":563,"num_read_kb":13023,"num_write":1154,"num_write_kb":36371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"263'579","reported_seq":2155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:01.624820+0000","last_change":"2024-09-14T10:46:46.351079+0000","last_active":"2024-09-14T11:58:01.624820+0000","last_peered":"2024-09-14T11:58:01.624820+0000","last_clean":"2024-09-14T11:58:01.624820+0000","last_became_active":"2024-09-14T10:46:46.350776+0000","last_became_peered":"2024-09-14T10:46:46.350776+0000","last_unstale":"2024-09-14T11:58:01.624820+0000","last_undegraded":"2024-09-14T11:58:01.624820+0000","last_fullsized":"2024-09-14T11:58:01.624820+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:49.953237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3080,"num_read_kb":2791,"num_write":782,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"263'282","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.370814+0000","last_change":"2024-09-14T10:46:44.328019+0000","last_active":"2024-09-14T12:01:19.370814+0000","last_peered":"2024-09-14T12:01:19.370814+0000","last_clean":"2024-09-14T12:01:19.370814+0000","last_became_active":"2024-09-14T10:46:44.327650+0000","last_became_peered":"2024-09-14T10:46:44.327650+0000","last_unstale":"2024-09-14T12:01:19.370814+0000","last_undegraded":"2024-09-14T12:01:19.370814+0000","last_fullsized":"2024-09-14T12:01:19.370814+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:39.047825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":6055,"num_write":990,"num_write_kb":41392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"263'567","reported_seq":2315,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.213898+0000","last_change":"2024-09-14T10:46:46.341743+0000","last_active":"2024-09-14T11:58:37.213898+0000","last_peered":"2024-09-14T11:58:37.213898+0000","last_clean":"2024-09-14T11:58:37.213898+0000","last_became_active":"2024-09-14T10:46:46.341474+0000","last_became_peered":"2024-09-14T10:46:46.341474+0000","last_unstale":"2024-09-14T11:58:37.213898+0000","last_undegraded":"2024-09-14T11:58:37.213898+0000","last_fullsized":"2024-09-14T11:58:37.213898+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:59.495895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3094,"num_read_kb":2877,"num_write":684,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"263'314","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.457060+0000","last_change":"2024-09-14T10:46:44.335194+0000","last_active":"2024-09-14T12:01:18.457060+0000","last_peered":"2024-09-14T12:01:18.457060+0000","last_clean":"2024-09-14T12:01:18.457060+0000","last_became_active":"2024-09-14T10:46:44.334630+0000","last_became_peered":"2024-09-14T10:46:44.334630+0000","last_unstale":"2024-09-14T12:01:18.457060+0000","last_undegraded":"2024-09-14T12:01:18.457060+0000","last_fullsized":"2024-09-14T12:01:18.457060+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:39.166664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134082,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":598,"num_read_kb":14859,"num_write":1023,"num_write_kb":34853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"263'824","reported_seq":2407,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:43.469536+0000","last_change":"2024-09-14T10:46:46.350955+0000","last_active":"2024-09-14T11:59:43.469536+0000","last_peered":"2024-09-14T11:59:43.469536+0000","last_clean":"2024-09-14T11:59:43.469536+0000","last_became_active":"2024-09-14T10:46:46.350391+0000","last_became_peered":"2024-09-14T10:46:46.350391+0000","last_unstale":"2024-09-14T11:59:43.469536+0000","last_undegraded":"2024-09-14T11:59:43.469536+0000","last_fullsized":"2024-09-14T11:59:43.469536+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:02.579006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3863,"num_read_kb":3486,"num_write":1075,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"263'748","reported_seq":2166,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.350687+0000","last_change":"2024-09-14T10:46:46.336012+0000","last_active":"2024-09-14T11:58:44.350687+0000","last_peered":"2024-09-14T11:58:44.350687+0000","last_clean":"2024-09-14T11:58:44.350687+0000","last_became_active":"2024-09-14T10:46:46.335749+0000","last_became_peered":"2024-09-14T10:46:46.335749+0000","last_unstale":"2024-09-14T11:58:44.350687+0000","last_undegraded":"2024-09-14T11:58:44.350687+0000","last_fullsized":"2024-09-14T11:58:44.350687+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:42.586410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3617,"num_read_kb":3235,"num_write":1004,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"263'306","reported_seq":918,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.361253+0000","last_change":"2024-09-14T10:46:44.317211+0000","last_active":"2024-09-14T12:01:19.361253+0000","last_peered":"2024-09-14T12:01:19.361253+0000","last_clean":"2024-09-14T12:01:19.361253+0000","last_became_active":"2024-09-14T10:46:44.316741+0000","last_became_peered":"2024-09-14T10:46:44.316741+0000","last_unstale":"2024-09-14T12:01:19.361253+0000","last_undegraded":"2024-09-14T12:01:19.361253+0000","last_fullsized":"2024-09-14T12:01:19.361253+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:32.808931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133671,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":507,"num_read_kb":26974,"num_write":959,"num_write_kb":33080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"263'803","reported_seq":2496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.146195+0000","last_change":"2024-09-14T10:46:46.346277+0000","last_active":"2024-09-14T12:00:51.146195+0000","last_peered":"2024-09-14T12:00:51.146195+0000","last_clean":"2024-09-14T12:00:51.146195+0000","last_became_active":"2024-09-14T10:46:46.345709+0000","last_became_peered":"2024-09-14T10:46:46.345709+0000","last_unstale":"2024-09-14T12:00:51.146195+0000","last_undegraded":"2024-09-14T12:00:51.146195+0000","last_fullsized":"2024-09-14T12:00:51.146195+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:39.154901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3947,"num_read_kb":3606,"num_write":1038,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"263'367","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.353004+0000","last_change":"2024-09-14T10:46:44.331941+0000","last_active":"2024-09-14T12:01:19.353004+0000","last_peered":"2024-09-14T12:01:19.353004+0000","last_clean":"2024-09-14T12:01:19.353004+0000","last_became_active":"2024-09-14T10:46:44.331599+0000","last_became_peered":"2024-09-14T10:46:44.331599+0000","last_unstale":"2024-09-14T12:01:19.353004+0000","last_undegraded":"2024-09-14T12:01:19.353004+0000","last_fullsized":"2024-09-14T12:01:19.353004+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:14.551208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":622,"num_read_kb":2368,"num_write":1092,"num_write_kb":34113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"263'397","reported_seq":1959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.154005+0000","last_change":"2024-09-14T10:46:46.351133+0000","last_active":"2024-09-14T11:58:46.154005+0000","last_peered":"2024-09-14T11:58:46.154005+0000","last_clean":"2024-09-14T11:58:46.154005+0000","last_became_active":"2024-09-14T10:46:46.350525+0000","last_became_peered":"2024-09-14T10:46:46.350525+0000","last_unstale":"2024-09-14T11:58:46.154005+0000","last_undegraded":"2024-09-14T11:58:46.154005+0000","last_fullsized":"2024-09-14T11:58:46.154005+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:26.504718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2275,"num_read_kb":2173,"num_write":451,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"263'369","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.366438+0000","last_change":"2024-09-14T10:46:44.340215+0000","last_active":"2024-09-14T12:01:19.366438+0000","last_peered":"2024-09-14T12:01:19.366438+0000","last_clean":"2024-09-14T12:01:19.366438+0000","last_became_active":"2024-09-14T10:46:44.339871+0000","last_became_peered":"2024-09-14T10:46:44.339871+0000","last_unstale":"2024-09-14T12:01:19.366438+0000","last_undegraded":"2024-09-14T12:01:19.366438+0000","last_fullsized":"2024-09-14T12:01:19.366438+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:22.901003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":774,"num_read_kb":19273,"num_write":1249,"num_write_kb":53136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"263'1154","reported_seq":2712,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.102743+0000","last_change":"2024-09-14T10:46:46.349949+0000","last_active":"2024-09-14T11:58:40.102743+0000","last_peered":"2024-09-14T11:58:40.102743+0000","last_clean":"2024-09-14T11:58:40.102743+0000","last_became_active":"2024-09-14T10:46:46.349649+0000","last_became_peered":"2024-09-14T10:46:46.349649+0000","last_unstale":"2024-09-14T11:58:40.102743+0000","last_undegraded":"2024-09-14T11:58:40.102743+0000","last_fullsized":"2024-09-14T11:58:40.102743+0000","mapping_epoch":28,"log_start":"263'1100","ondisk_log_start":"263'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":1100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:46.563986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5238,"num_read_kb":4651,"num_write":1596,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"263'343","reported_seq":1077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.372572+0000","last_change":"2024-09-14T10:46:44.326980+0000","last_active":"2024-09-14T12:01:19.372572+0000","last_peered":"2024-09-14T12:01:19.372572+0000","last_clean":"2024-09-14T12:01:19.372572+0000","last_became_active":"2024-09-14T10:46:44.326645+0000","last_became_peered":"2024-09-14T10:46:44.326645+0000","last_unstale":"2024-09-14T12:01:19.372572+0000","last_undegraded":"2024-09-14T12:01:19.372572+0000","last_fullsized":"2024-09-14T12:01:19.372572+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:15.334289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":923,"num_read_kb":14272,"num_write":1148,"num_write_kb":16465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"263'962","reported_seq":2507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.465626+0000","last_change":"2024-09-14T10:46:46.347683+0000","last_active":"2024-09-14T11:59:18.465626+0000","last_peered":"2024-09-14T11:59:18.465626+0000","last_clean":"2024-09-14T11:59:18.465626+0000","last_became_active":"2024-09-14T10:46:46.347420+0000","last_became_peered":"2024-09-14T10:46:46.347420+0000","last_unstale":"2024-09-14T11:59:18.465626+0000","last_undegraded":"2024-09-14T11:59:18.465626+0000","last_fullsized":"2024-09-14T11:59:18.465626+0000","mapping_epoch":28,"log_start":"263'900","ondisk_log_start":"263'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":900,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:54.686257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5046,"num_read_kb":4563,"num_write":1374,"num_write_kb":542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"263'330","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.456962+0000","last_change":"2024-09-14T10:46:44.319508+0000","last_active":"2024-09-14T12:01:18.456962+0000","last_peered":"2024-09-14T12:01:18.456962+0000","last_clean":"2024-09-14T12:01:18.456962+0000","last_became_active":"2024-09-14T10:46:44.319146+0000","last_became_peered":"2024-09-14T10:46:44.319146+0000","last_unstale":"2024-09-14T12:01:18.456962+0000","last_undegraded":"2024-09-14T12:01:18.456962+0000","last_fullsized":"2024-09-14T12:01:18.456962+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:19.324787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2707,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":547,"num_read_kb":40906,"num_write":1026,"num_write_kb":34714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"263'374","reported_seq":1891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.351510+0000","last_change":"2024-09-14T10:46:46.339990+0000","last_active":"2024-09-14T11:58:44.351510+0000","last_peered":"2024-09-14T11:58:44.351510+0000","last_clean":"2024-09-14T11:58:44.351510+0000","last_became_active":"2024-09-14T10:46:46.339710+0000","last_became_peered":"2024-09-14T10:46:46.339710+0000","last_unstale":"2024-09-14T11:58:44.351510+0000","last_undegraded":"2024-09-14T11:58:44.351510+0000","last_fullsized":"2024-09-14T11:58:44.351510+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:06.635346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2075,"num_read_kb":1993,"num_write":416,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"263'288","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.517903+0000","last_change":"2024-09-14T10:46:44.318270+0000","last_active":"2024-09-14T12:01:18.517903+0000","last_peered":"2024-09-14T12:01:18.517903+0000","last_clean":"2024-09-14T12:01:18.517903+0000","last_became_active":"2024-09-14T10:46:44.317895+0000","last_became_peered":"2024-09-14T10:46:44.317895+0000","last_unstale":"2024-09-14T12:01:18.517903+0000","last_undegraded":"2024-09-14T12:01:18.517903+0000","last_fullsized":"2024-09-14T12:01:18.517903+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:29.484018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6321116,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":905,"num_read_kb":22980,"num_write":973,"num_write_kb":27989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"263'130","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.815076+0000","last_change":"2024-09-14T10:46:54.375921+0000","last_active":"2024-09-14T11:59:34.815076+0000","last_peered":"2024-09-14T11:59:34.815076+0000","last_clean":"2024-09-14T11:59:34.815076+0000","last_became_active":"2024-09-14T10:46:54.374769+0000","last_became_peered":"2024-09-14T10:46:54.374769+0000","last_unstale":"2024-09-14T11:59:34.815076+0000","last_undegraded":"2024-09-14T11:59:34.815076+0000","last_fullsized":"2024-09-14T11:59:34.815076+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:49.159300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":165,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"263'434","reported_seq":1984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.153364+0000","last_change":"2024-09-14T10:46:46.340520+0000","last_active":"2024-09-14T11:58:46.153364+0000","last_peered":"2024-09-14T11:58:46.153364+0000","last_clean":"2024-09-14T11:58:46.153364+0000","last_became_active":"2024-09-14T10:46:46.340169+0000","last_became_peered":"2024-09-14T10:46:46.340169+0000","last_unstale":"2024-09-14T11:58:46.153364+0000","last_undegraded":"2024-09-14T11:58:46.153364+0000","last_fullsized":"2024-09-14T11:58:46.153364+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:30.021599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2291,"num_read_kb":2165,"num_write":484,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"263'355","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.534172+0000","last_change":"2024-09-14T10:47:18.794218+0000","last_active":"2024-09-14T12:01:18.534172+0000","last_peered":"2024-09-14T12:01:18.534172+0000","last_clean":"2024-09-14T12:01:18.534172+0000","last_became_active":"2024-09-14T10:47:18.793917+0000","last_became_peered":"2024-09-14T10:47:18.793917+0000","last_unstale":"2024-09-14T12:01:18.534172+0000","last_undegraded":"2024-09-14T12:01:18.534172+0000","last_fullsized":"2024-09-14T12:01:18.534172+0000","mapping_epoch":39,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:04.969640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17175143,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":690,"num_read_kb":48706,"num_write":1283,"num_write_kb":50304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.519271+0000","last_change":"2024-09-14T10:46:48.357072+0000","last_active":"2024-09-14T11:56:55.519271+0000","last_peered":"2024-09-14T11:56:55.519271+0000","last_clean":"2024-09-14T11:56:55.519271+0000","last_became_active":"2024-09-14T10:46:48.356776+0000","last_became_peered":"2024-09-14T10:46:48.356776+0000","last_unstale":"2024-09-14T11:56:55.519271+0000","last_undegraded":"2024-09-14T11:56:55.519271+0000","last_fullsized":"2024-09-14T11:56:55.519271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:33.998552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"263'353","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.009177+0000","last_change":"2024-09-14T10:46:50.360895+0000","last_active":"2024-09-14T12:01:18.009177+0000","last_peered":"2024-09-14T12:01:18.009177+0000","last_clean":"2024-09-14T12:01:18.009177+0000","last_became_active":"2024-09-14T10:46:50.359481+0000","last_became_peered":"2024-09-14T10:46:50.359481+0000","last_unstale":"2024-09-14T12:01:18.009177+0000","last_undegraded":"2024-09-14T12:01:18.009177+0000","last_fullsized":"2024-09-14T12:01:18.009177+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:57.049513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51669,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":564,"num_read_kb":1178,"num_write":444,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.396876+0000","last_change":"2024-09-14T10:46:52.373231+0000","last_active":"2024-09-14T11:57:00.396876+0000","last_peered":"2024-09-14T11:57:00.396876+0000","last_clean":"2024-09-14T11:57:00.396876+0000","last_became_active":"2024-09-14T10:46:52.372941+0000","last_became_peered":"2024-09-14T10:46:52.372941+0000","last_unstale":"2024-09-14T11:57:00.396876+0000","last_undegraded":"2024-09-14T11:57:00.396876+0000","last_fullsized":"2024-09-14T11:57:00.396876+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:39.029048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"263'153","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:57.663650+0000","last_change":"2024-09-14T10:46:54.387774+0000","last_active":"2024-09-14T11:57:57.663650+0000","last_peered":"2024-09-14T11:57:57.663650+0000","last_clean":"2024-09-14T11:57:57.663650+0000","last_became_active":"2024-09-14T10:46:54.387445+0000","last_became_peered":"2024-09-14T10:46:54.387445+0000","last_unstale":"2024-09-14T11:57:57.663650+0000","last_undegraded":"2024-09-14T11:57:57.663650+0000","last_fullsized":"2024-09-14T11:57:57.663650+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:41.372638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":80,"num_write":348,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"263'551","reported_seq":2271,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.139453+0000","last_change":"2024-09-14T10:46:46.340740+0000","last_active":"2024-09-14T12:00:51.139453+0000","last_peered":"2024-09-14T12:00:51.139453+0000","last_clean":"2024-09-14T12:00:51.139453+0000","last_became_active":"2024-09-14T10:46:46.340242+0000","last_became_peered":"2024-09-14T10:46:46.340242+0000","last_unstale":"2024-09-14T12:00:51.139453+0000","last_undegraded":"2024-09-14T12:00:51.139453+0000","last_fullsized":"2024-09-14T12:00:51.139453+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:58.555963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3138,"num_read_kb":2920,"num_write":702,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"263'309","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.495782+0000","last_change":"2024-09-14T10:46:44.335171+0000","last_active":"2024-09-14T12:01:18.495782+0000","last_peered":"2024-09-14T12:01:18.495782+0000","last_clean":"2024-09-14T12:01:18.495782+0000","last_became_active":"2024-09-14T10:46:44.334757+0000","last_became_peered":"2024-09-14T10:46:44.334757+0000","last_unstale":"2024-09-14T12:01:18.495782+0000","last_undegraded":"2024-09-14T12:01:18.495782+0000","last_fullsized":"2024-09-14T12:01:18.495782+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:06.067815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7425373,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":607,"num_read_kb":20083,"num_write":1052,"num_write_kb":20918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:05.634732+0000","last_change":"2024-09-14T10:46:48.352082+0000","last_active":"2024-09-14T11:57:05.634732+0000","last_peered":"2024-09-14T11:57:05.634732+0000","last_clean":"2024-09-14T11:57:05.634732+0000","last_became_active":"2024-09-14T10:46:48.351825+0000","last_became_peered":"2024-09-14T10:46:48.351825+0000","last_unstale":"2024-09-14T11:57:05.634732+0000","last_undegraded":"2024-09-14T11:57:05.634732+0000","last_fullsized":"2024-09-14T11:57:05.634732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:28.324093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"263'101","reported_seq":633,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.413259+0000","last_change":"2024-09-14T10:46:50.360973+0000","last_active":"2024-09-14T11:59:20.413259+0000","last_peered":"2024-09-14T11:59:20.413259+0000","last_clean":"2024-09-14T11:59:20.413259+0000","last_became_active":"2024-09-14T10:46:50.360649+0000","last_became_peered":"2024-09-14T10:46:50.360649+0000","last_unstale":"2024-09-14T11:59:20.413259+0000","last_undegraded":"2024-09-14T11:59:20.413259+0000","last_fullsized":"2024-09-14T11:59:20.413259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:09.131081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.396818+0000","last_change":"2024-09-14T10:46:52.373120+0000","last_active":"2024-09-14T11:57:00.396818+0000","last_peered":"2024-09-14T11:57:00.396818+0000","last_clean":"2024-09-14T11:57:00.396818+0000","last_became_active":"2024-09-14T10:46:52.372770+0000","last_became_peered":"2024-09-14T10:46:52.372770+0000","last_unstale":"2024-09-14T11:57:00.396818+0000","last_undegraded":"2024-09-14T11:57:00.396818+0000","last_fullsized":"2024-09-14T11:57:00.396818+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:37.866381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"263'140","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.088657+0000","last_change":"2024-09-14T10:46:54.389893+0000","last_active":"2024-09-14T11:58:40.088657+0000","last_peered":"2024-09-14T11:58:40.088657+0000","last_clean":"2024-09-14T11:58:40.088657+0000","last_became_active":"2024-09-14T10:46:54.389638+0000","last_became_peered":"2024-09-14T10:46:54.389638+0000","last_unstale":"2024-09-14T11:58:40.088657+0000","last_undegraded":"2024-09-14T11:58:40.088657+0000","last_fullsized":"2024-09-14T11:58:40.088657+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:21.500685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":168,"num_write":356,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"263'449","reported_seq":2187,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.135482+0000","last_change":"2024-09-14T10:46:46.344810+0000","last_active":"2024-09-14T12:00:51.135482+0000","last_peered":"2024-09-14T12:00:51.135482+0000","last_clean":"2024-09-14T12:00:51.135482+0000","last_became_active":"2024-09-14T10:46:46.344509+0000","last_became_peered":"2024-09-14T10:46:46.344509+0000","last_unstale":"2024-09-14T12:00:51.135482+0000","last_undegraded":"2024-09-14T12:00:51.135482+0000","last_fullsized":"2024-09-14T12:00:51.135482+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:33.760349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2693,"num_read_kb":2571,"num_write":507,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"263'330","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.376042+0000","last_change":"2024-09-14T10:46:44.331833+0000","last_active":"2024-09-14T12:01:19.376042+0000","last_peered":"2024-09-14T12:01:19.376042+0000","last_clean":"2024-09-14T12:01:19.376042+0000","last_became_active":"2024-09-14T10:46:44.331464+0000","last_became_peered":"2024-09-14T10:46:44.331464+0000","last_unstale":"2024-09-14T12:01:19.376042+0000","last_undegraded":"2024-09-14T12:01:19.376042+0000","last_fullsized":"2024-09-14T12:01:19.376042+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:29.473170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267319,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":652,"num_read_kb":48168,"num_write":1033,"num_write_kb":26849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.633150+0000","last_change":"2024-09-14T10:46:48.357687+0000","last_active":"2024-09-14T11:56:55.633150+0000","last_peered":"2024-09-14T11:56:55.633150+0000","last_clean":"2024-09-14T11:56:55.633150+0000","last_became_active":"2024-09-14T10:46:48.357301+0000","last_became_peered":"2024-09-14T10:46:48.357301+0000","last_unstale":"2024-09-14T11:56:55.633150+0000","last_undegraded":"2024-09-14T11:56:55.633150+0000","last_fullsized":"2024-09-14T11:56:55.633150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:33.501824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"263'138","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:57.686128+0000","last_change":"2024-09-14T10:46:50.363764+0000","last_active":"2024-09-14T11:57:57.686128+0000","last_peered":"2024-09-14T11:57:57.686128+0000","last_clean":"2024-09-14T11:57:57.686128+0000","last_became_active":"2024-09-14T10:46:50.363495+0000","last_became_peered":"2024-09-14T10:46:50.363495+0000","last_unstale":"2024-09-14T11:57:57.686128+0000","last_undegraded":"2024-09-14T11:57:57.686128+0000","last_fullsized":"2024-09-14T11:57:57.686128+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:49:45.053503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":162,"num_write":114,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"263'792","reported_seq":2727,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.488837+0000","last_change":"2024-09-14T10:46:52.374170+0000","last_active":"2024-09-14T12:01:18.488837+0000","last_peered":"2024-09-14T12:01:18.488837+0000","last_clean":"2024-09-14T12:01:18.488837+0000","last_became_active":"2024-09-14T10:46:52.373886+0000","last_became_peered":"2024-09-14T10:46:52.373886+0000","last_unstale":"2024-09-14T12:01:18.488837+0000","last_undegraded":"2024-09-14T12:01:18.488837+0000","last_fullsized":"2024-09-14T12:01:18.488837+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:54.230847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"263'181","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.721550+0000","last_change":"2024-09-14T10:46:54.388494+0000","last_active":"2024-09-14T11:59:33.721550+0000","last_peered":"2024-09-14T11:59:33.721550+0000","last_clean":"2024-09-14T11:59:33.721550+0000","last_became_active":"2024-09-14T10:46:54.388186+0000","last_became_peered":"2024-09-14T10:46:54.388186+0000","last_unstale":"2024-09-14T11:59:33.721550+0000","last_undegraded":"2024-09-14T11:59:33.721550+0000","last_fullsized":"2024-09-14T11:59:33.721550+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:38.806003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":561,"num_read_kb":561,"num_write":378,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"263'893","reported_seq":2326,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:57.678509+0000","last_change":"2024-09-14T10:46:46.351792+0000","last_active":"2024-09-14T11:57:57.678509+0000","last_peered":"2024-09-14T11:57:57.678509+0000","last_clean":"2024-09-14T11:57:57.678509+0000","last_became_active":"2024-09-14T10:46:46.351453+0000","last_became_peered":"2024-09-14T10:46:46.351453+0000","last_unstale":"2024-09-14T11:57:57.678509+0000","last_undegraded":"2024-09-14T11:57:57.678509+0000","last_fullsized":"2024-09-14T11:57:57.678509+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":800,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:43.929395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4193,"num_read_kb":3693,"num_write":1250,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"263'366","reported_seq":1042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.303300+0000","last_change":"2024-09-14T10:46:44.329000+0000","last_active":"2024-09-14T12:01:19.303300+0000","last_peered":"2024-09-14T12:01:19.303300+0000","last_clean":"2024-09-14T12:01:19.303300+0000","last_became_active":"2024-09-14T10:46:44.328531+0000","last_became_peered":"2024-09-14T10:46:44.328531+0000","last_unstale":"2024-09-14T12:01:19.303300+0000","last_undegraded":"2024-09-14T12:01:19.303300+0000","last_fullsized":"2024-09-14T12:01:19.303300+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:52.656623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":728,"num_read_kb":24160,"num_write":1182,"num_write_kb":50074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.519306+0000","last_change":"2024-09-14T10:46:48.349347+0000","last_active":"2024-09-14T11:56:55.519306+0000","last_peered":"2024-09-14T11:56:55.519306+0000","last_clean":"2024-09-14T11:56:55.519306+0000","last_became_active":"2024-09-14T10:46:48.348899+0000","last_became_peered":"2024-09-14T10:46:48.348899+0000","last_unstale":"2024-09-14T11:56:55.519306+0000","last_undegraded":"2024-09-14T11:56:55.519306+0000","last_fullsized":"2024-09-14T11:56:55.519306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:31.899725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"263'308","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.717489+0000","last_change":"2024-09-14T10:46:50.366037+0000","last_active":"2024-09-14T12:01:17.717489+0000","last_peered":"2024-09-14T12:01:17.717489+0000","last_clean":"2024-09-14T12:01:17.717489+0000","last_became_active":"2024-09-14T10:46:50.365721+0000","last_became_peered":"2024-09-14T10:46:50.365721+0000","last_unstale":"2024-09-14T12:01:17.717489+0000","last_undegraded":"2024-09-14T12:01:17.717489+0000","last_fullsized":"2024-09-14T12:01:17.717489+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:37.431750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47247,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":1144,"num_write":408,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"263'829","reported_seq":2738,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.431796+0000","last_change":"2024-09-14T10:46:52.375010+0000","last_active":"2024-09-14T12:01:17.431796+0000","last_peered":"2024-09-14T12:01:17.431796+0000","last_clean":"2024-09-14T12:01:17.431796+0000","last_became_active":"2024-09-14T10:46:52.374634+0000","last_became_peered":"2024-09-14T10:46:52.374634+0000","last_unstale":"2024-09-14T12:01:17.431796+0000","last_undegraded":"2024-09-14T12:01:17.431796+0000","last_fullsized":"2024-09-14T12:01:17.431796+0000","mapping_epoch":34,"log_start":"263'800","ondisk_log_start":"263'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:57:14.899442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"263'522","reported_seq":2102,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.138196+0000","last_change":"2024-09-14T10:46:46.342236+0000","last_active":"2024-09-14T12:00:51.138196+0000","last_peered":"2024-09-14T12:00:51.138196+0000","last_clean":"2024-09-14T12:00:51.138196+0000","last_became_active":"2024-09-14T10:46:46.341971+0000","last_became_peered":"2024-09-14T10:46:46.341971+0000","last_unstale":"2024-09-14T12:00:51.138196+0000","last_undegraded":"2024-09-14T12:00:51.138196+0000","last_fullsized":"2024-09-14T12:00:51.138196+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:12.438399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2719,"num_read_kb":2513,"num_write":653,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"263'361","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.327021+0000","last_change":"2024-09-14T10:46:44.330242+0000","last_active":"2024-09-14T12:01:19.327021+0000","last_peered":"2024-09-14T12:01:19.327021+0000","last_clean":"2024-09-14T12:01:19.327021+0000","last_became_active":"2024-09-14T10:46:44.329782+0000","last_became_peered":"2024-09-14T10:46:44.329782+0000","last_unstale":"2024-09-14T12:01:19.327021+0000","last_undegraded":"2024-09-14T12:01:19.327021+0000","last_fullsized":"2024-09-14T12:01:19.327021+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:57.094973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":606,"num_read_kb":47823,"num_write":1082,"num_write_kb":48255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.405202+0000","last_change":"2024-09-14T10:46:48.352873+0000","last_active":"2024-09-14T11:58:20.405202+0000","last_peered":"2024-09-14T11:58:20.405202+0000","last_clean":"2024-09-14T11:58:20.405202+0000","last_became_active":"2024-09-14T10:46:48.352584+0000","last_became_peered":"2024-09-14T10:46:48.352584+0000","last_unstale":"2024-09-14T11:58:20.405202+0000","last_undegraded":"2024-09-14T11:58:20.405202+0000","last_fullsized":"2024-09-14T11:58:20.405202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:32.483930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"263'416","reported_seq":1057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.280535+0000","last_change":"2024-09-14T10:46:50.364803+0000","last_active":"2024-09-14T12:01:18.280535+0000","last_peered":"2024-09-14T12:01:18.280535+0000","last_clean":"2024-09-14T12:01:18.280535+0000","last_became_active":"2024-09-14T10:46:50.364438+0000","last_became_peered":"2024-09-14T10:46:50.364438+0000","last_unstale":"2024-09-14T12:01:18.280535+0000","last_undegraded":"2024-09-14T12:01:18.280535+0000","last_fullsized":"2024-09-14T12:01:18.280535+0000","mapping_epoch":32,"log_start":"263'400","ondisk_log_start":"263'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:41.620765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46781,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":687,"num_read_kb":1416,"num_write":538,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.526559+0000","last_change":"2024-09-14T10:46:52.368160+0000","last_active":"2024-09-14T11:58:53.526559+0000","last_peered":"2024-09-14T11:58:53.526559+0000","last_clean":"2024-09-14T11:58:53.526559+0000","last_became_active":"2024-09-14T10:46:52.367874+0000","last_became_peered":"2024-09-14T10:46:52.367874+0000","last_unstale":"2024-09-14T11:58:53.526559+0000","last_undegraded":"2024-09-14T11:58:53.526559+0000","last_fullsized":"2024-09-14T11:58:53.526559+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:15.594681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"263'556","reported_seq":1397,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:52.309850+0000","last_change":"2024-09-14T10:46:54.390213+0000","last_active":"2024-09-14T12:00:52.309850+0000","last_peered":"2024-09-14T12:00:52.309850+0000","last_clean":"2024-09-14T12:00:52.309850+0000","last_became_active":"2024-09-14T10:46:54.389880+0000","last_became_peered":"2024-09-14T10:46:54.389880+0000","last_unstale":"2024-09-14T12:00:52.309850+0000","last_undegraded":"2024-09-14T12:00:52.309850+0000","last_fullsized":"2024-09-14T12:00:52.309850+0000","mapping_epoch":36,"log_start":"263'500","ondisk_log_start":"263'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:56.630763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1361,"num_read_kb":1337,"num_write":1147,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"263'1285","reported_seq":3010,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.405223+0000","last_change":"2024-09-14T10:46:46.343876+0000","last_active":"2024-09-14T11:58:20.405223+0000","last_peered":"2024-09-14T11:58:20.405223+0000","last_clean":"2024-09-14T11:58:20.405223+0000","last_became_active":"2024-09-14T10:46:46.343603+0000","last_became_peered":"2024-09-14T10:46:46.343603+0000","last_unstale":"2024-09-14T11:58:20.405223+0000","last_undegraded":"2024-09-14T11:58:20.405223+0000","last_fullsized":"2024-09-14T11:58:20.405223+0000","mapping_epoch":28,"log_start":"263'1200","ondisk_log_start":"263'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":1200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:55:04.271839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6021,"num_read_kb":5313,"num_write":1785,"num_write_kb":753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"263'327","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.263699+0000","last_change":"2024-09-14T10:46:44.323710+0000","last_active":"2024-09-14T12:01:19.263699+0000","last_peered":"2024-09-14T12:01:19.263699+0000","last_clean":"2024-09-14T12:01:19.263699+0000","last_became_active":"2024-09-14T10:46:44.322816+0000","last_became_peered":"2024-09-14T10:46:44.322816+0000","last_unstale":"2024-09-14T12:01:19.263699+0000","last_undegraded":"2024-09-14T12:01:19.263699+0000","last_fullsized":"2024-09-14T12:01:19.263699+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:37.849009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":492,"num_write":1114,"num_write_kb":29298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:18.521465+0000","last_change":"2024-09-14T10:46:48.352278+0000","last_active":"2024-09-14T11:58:18.521465+0000","last_peered":"2024-09-14T11:58:18.521465+0000","last_clean":"2024-09-14T11:58:18.521465+0000","last_became_active":"2024-09-14T10:46:48.351893+0000","last_became_peered":"2024-09-14T10:46:48.351893+0000","last_unstale":"2024-09-14T11:58:18.521465+0000","last_undegraded":"2024-09-14T11:58:18.521465+0000","last_fullsized":"2024-09-14T11:58:18.521465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:17.258684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"263'265","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.043439+0000","last_change":"2024-09-14T10:46:50.360064+0000","last_active":"2024-09-14T12:01:19.043439+0000","last_peered":"2024-09-14T12:01:19.043439+0000","last_clean":"2024-09-14T12:01:19.043439+0000","last_became_active":"2024-09-14T10:46:50.359434+0000","last_became_peered":"2024-09-14T10:46:50.359434+0000","last_unstale":"2024-09-14T12:01:19.043439+0000","last_undegraded":"2024-09-14T12:01:19.043439+0000","last_fullsized":"2024-09-14T12:01:19.043439+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:38.484631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44011,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":1031,"num_write":356,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.648763+0000","last_change":"2024-09-14T10:46:52.369655+0000","last_active":"2024-09-14T11:58:40.648763+0000","last_peered":"2024-09-14T11:58:40.648763+0000","last_clean":"2024-09-14T11:58:40.648763+0000","last_became_active":"2024-09-14T10:46:52.369353+0000","last_became_peered":"2024-09-14T10:46:52.369353+0000","last_unstale":"2024-09-14T11:58:40.648763+0000","last_undegraded":"2024-09-14T11:58:40.648763+0000","last_fullsized":"2024-09-14T11:58:40.648763+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:30.464066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"263'2541","reported_seq":4365,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:00.417652+0000","last_change":"2024-09-14T10:46:54.383401+0000","last_active":"2024-09-14T12:00:00.417652+0000","last_peered":"2024-09-14T12:00:00.417652+0000","last_clean":"2024-09-14T12:00:00.417652+0000","last_became_active":"2024-09-14T10:46:54.383100+0000","last_became_peered":"2024-09-14T10:46:54.383100+0000","last_unstale":"2024-09-14T12:00:00.417652+0000","last_undegraded":"2024-09-14T12:00:00.417652+0000","last_fullsized":"2024-09-14T12:00:00.417652+0000","mapping_epoch":36,"log_start":"263'2500","ondisk_log_start":"263'2500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":2500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:25.507491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6216,"num_read_kb":6221,"num_write":5164,"num_write_kb":1877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"263'513","reported_seq":2285,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.759401+0000","last_change":"2024-09-14T10:46:46.338242+0000","last_active":"2024-09-14T11:59:29.759401+0000","last_peered":"2024-09-14T11:59:29.759401+0000","last_clean":"2024-09-14T11:59:29.759401+0000","last_became_active":"2024-09-14T10:46:46.337951+0000","last_became_peered":"2024-09-14T10:46:46.337951+0000","last_unstale":"2024-09-14T11:59:29.759401+0000","last_undegraded":"2024-09-14T11:59:29.759401+0000","last_fullsized":"2024-09-14T11:59:29.759401+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":500,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:40.454176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2937,"num_read_kb":2795,"num_write":635,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"263'349","reported_seq":1028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.342519+0000","last_change":"2024-09-14T10:46:44.334345+0000","last_active":"2024-09-14T12:01:19.342519+0000","last_peered":"2024-09-14T12:01:19.342519+0000","last_clean":"2024-09-14T12:01:19.342519+0000","last_became_active":"2024-09-14T10:46:44.331705+0000","last_became_peered":"2024-09-14T10:46:44.331705+0000","last_unstale":"2024-09-14T12:01:19.342519+0000","last_undegraded":"2024-09-14T12:01:19.342519+0000","last_fullsized":"2024-09-14T12:01:19.342519+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:08.805234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":652,"num_read_kb":33315,"num_write":1115,"num_write_kb":35089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.460327+0000","last_change":"2024-09-14T10:46:48.355757+0000","last_active":"2024-09-14T11:58:48.460327+0000","last_peered":"2024-09-14T11:58:48.460327+0000","last_clean":"2024-09-14T11:58:48.460327+0000","last_became_active":"2024-09-14T10:46:48.354092+0000","last_became_peered":"2024-09-14T10:46:48.354092+0000","last_unstale":"2024-09-14T11:58:48.460327+0000","last_undegraded":"2024-09-14T11:58:48.460327+0000","last_fullsized":"2024-09-14T11:58:48.460327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:49.272454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"263'342","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.405360+0000","last_change":"2024-09-14T10:46:50.364160+0000","last_active":"2024-09-14T12:01:18.405360+0000","last_peered":"2024-09-14T12:01:18.405360+0000","last_clean":"2024-09-14T12:01:18.405360+0000","last_became_active":"2024-09-14T10:46:50.363893+0000","last_became_peered":"2024-09-14T10:46:50.363893+0000","last_unstale":"2024-09-14T12:01:18.405360+0000","last_undegraded":"2024-09-14T12:01:18.405360+0000","last_fullsized":"2024-09-14T12:01:18.405360+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:50.322137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44240,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":541,"num_read_kb":1145,"num_write":426,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"263'829","reported_seq":5034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.433012+0000","last_change":"2024-09-14T10:46:52.374414+0000","last_active":"2024-09-14T12:01:17.433012+0000","last_peered":"2024-09-14T12:01:17.433012+0000","last_clean":"2024-09-14T12:01:17.433012+0000","last_became_active":"2024-09-14T10:46:52.374152+0000","last_became_peered":"2024-09-14T10:46:52.374152+0000","last_unstale":"2024-09-14T12:01:17.433012+0000","last_undegraded":"2024-09-14T12:01:17.433012+0000","last_fullsized":"2024-09-14T12:01:17.433012+0000","mapping_epoch":34,"log_start":"263'800","ondisk_log_start":"263'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:31.267699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"263'166","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:50.989484+0000","last_change":"2024-09-14T10:46:54.384757+0000","last_active":"2024-09-14T12:00:50.989484+0000","last_peered":"2024-09-14T12:00:50.989484+0000","last_clean":"2024-09-14T12:00:50.989484+0000","last_became_active":"2024-09-14T10:46:54.383953+0000","last_became_peered":"2024-09-14T10:46:54.383953+0000","last_unstale":"2024-09-14T12:00:50.989484+0000","last_undegraded":"2024-09-14T12:00:50.989484+0000","last_fullsized":"2024-09-14T12:00:50.989484+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:54.206656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":135,"num_write":398,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"263'1056","reported_seq":2528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.757882+0000","last_change":"2024-09-14T10:46:46.348971+0000","last_active":"2024-09-14T11:59:29.757882+0000","last_peered":"2024-09-14T11:59:29.757882+0000","last_clean":"2024-09-14T11:59:29.757882+0000","last_became_active":"2024-09-14T10:46:46.348726+0000","last_became_peered":"2024-09-14T10:46:46.348726+0000","last_unstale":"2024-09-14T11:59:29.757882+0000","last_undegraded":"2024-09-14T11:59:29.757882+0000","last_fullsized":"2024-09-14T11:59:29.757882+0000","mapping_epoch":28,"log_start":"263'1000","ondisk_log_start":"263'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":1000,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:17.855534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4827,"num_read_kb":4287,"num_write":1450,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"263'309","reported_seq":937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.323555+0000","last_change":"2024-09-14T10:46:44.332957+0000","last_active":"2024-09-14T12:01:19.323555+0000","last_peered":"2024-09-14T12:01:19.323555+0000","last_clean":"2024-09-14T12:01:19.323555+0000","last_became_active":"2024-09-14T10:46:44.332535+0000","last_became_peered":"2024-09-14T10:46:44.332535+0000","last_unstale":"2024-09-14T12:01:19.323555+0000","last_undegraded":"2024-09-14T12:01:19.323555+0000","last_fullsized":"2024-09-14T12:01:19.323555+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:28.026211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267347,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":39478,"num_write":1028,"num_write_kb":35728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:28.522894+0000","last_change":"2024-09-14T10:46:48.351883+0000","last_active":"2024-09-14T11:58:28.522894+0000","last_peered":"2024-09-14T11:58:28.522894+0000","last_clean":"2024-09-14T11:58:28.522894+0000","last_became_active":"2024-09-14T10:46:48.351530+0000","last_became_peered":"2024-09-14T10:46:48.351530+0000","last_unstale":"2024-09-14T11:58:28.522894+0000","last_undegraded":"2024-09-14T11:58:28.522894+0000","last_fullsized":"2024-09-14T11:58:28.522894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:09.714239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"263'470","reported_seq":1118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.227822+0000","last_change":"2024-09-14T10:46:50.361756+0000","last_active":"2024-09-14T12:01:19.227822+0000","last_peered":"2024-09-14T12:01:19.227822+0000","last_clean":"2024-09-14T12:01:19.227822+0000","last_became_active":"2024-09-14T10:46:50.361396+0000","last_became_peered":"2024-09-14T10:46:50.361396+0000","last_unstale":"2024-09-14T12:01:19.227822+0000","last_undegraded":"2024-09-14T12:01:19.227822+0000","last_fullsized":"2024-09-14T12:01:19.227822+0000","mapping_epoch":32,"log_start":"263'400","ondisk_log_start":"263'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:24.662180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93223,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":821,"num_read_kb":1952,"num_write":664,"num_write_kb":533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.456158+0000","last_change":"2024-09-14T10:46:52.373915+0000","last_active":"2024-09-14T11:58:23.456158+0000","last_peered":"2024-09-14T11:58:23.456158+0000","last_clean":"2024-09-14T11:58:23.456158+0000","last_became_active":"2024-09-14T10:46:52.373563+0000","last_became_peered":"2024-09-14T10:46:52.373563+0000","last_unstale":"2024-09-14T11:58:23.456158+0000","last_undegraded":"2024-09-14T11:58:23.456158+0000","last_fullsized":"2024-09-14T11:58:23.456158+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:22.900348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"263'160","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:25.446650+0000","last_change":"2024-09-14T10:46:54.389096+0000","last_active":"2024-09-14T11:58:25.446650+0000","last_peered":"2024-09-14T11:58:25.446650+0000","last_clean":"2024-09-14T11:58:25.446650+0000","last_became_active":"2024-09-14T10:46:54.388429+0000","last_became_peered":"2024-09-14T10:46:54.388429+0000","last_unstale":"2024-09-14T11:58:25.446650+0000","last_undegraded":"2024-09-14T11:58:25.446650+0000","last_fullsized":"2024-09-14T11:58:25.446650+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:38.481519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":168,"num_write":381,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"263'889","reported_seq":2640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.496852+0000","last_change":"2024-09-14T10:46:46.344318+0000","last_active":"2024-09-14T11:59:49.496852+0000","last_peered":"2024-09-14T11:59:49.496852+0000","last_clean":"2024-09-14T11:59:49.496852+0000","last_became_active":"2024-09-14T10:46:46.344022+0000","last_became_peered":"2024-09-14T10:46:46.344022+0000","last_unstale":"2024-09-14T11:59:49.496852+0000","last_undegraded":"2024-09-14T11:59:49.496852+0000","last_fullsized":"2024-09-14T11:59:49.496852+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":800,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:44.527085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4406,"num_read_kb":4005,"num_write":1167,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"263'312","reported_seq":980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.371004+0000","last_change":"2024-09-14T10:46:44.318998+0000","last_active":"2024-09-14T12:01:19.371004+0000","last_peered":"2024-09-14T12:01:19.371004+0000","last_clean":"2024-09-14T12:01:19.371004+0000","last_became_active":"2024-09-14T10:46:44.318584+0000","last_became_peered":"2024-09-14T10:46:44.318584+0000","last_unstale":"2024-09-14T12:01:19.371004+0000","last_undegraded":"2024-09-14T12:01:19.371004+0000","last_fullsized":"2024-09-14T12:01:19.371004+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:23.546671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":581,"num_read_kb":7202,"num_write":854,"num_write_kb":20635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.450101+0000","last_change":"2024-09-14T10:46:48.355970+0000","last_active":"2024-09-14T11:58:50.450101+0000","last_peered":"2024-09-14T11:58:50.450101+0000","last_clean":"2024-09-14T11:58:50.450101+0000","last_became_active":"2024-09-14T10:46:48.355691+0000","last_became_peered":"2024-09-14T10:46:48.355691+0000","last_unstale":"2024-09-14T11:58:50.450101+0000","last_undegraded":"2024-09-14T11:58:50.450101+0000","last_fullsized":"2024-09-14T11:58:50.450101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:57.269685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"263'341","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.293202+0000","last_change":"2024-09-14T10:46:50.363028+0000","last_active":"2024-09-14T12:01:19.293202+0000","last_peered":"2024-09-14T12:01:19.293202+0000","last_clean":"2024-09-14T12:01:19.293202+0000","last_became_active":"2024-09-14T10:46:50.362757+0000","last_became_peered":"2024-09-14T10:46:50.362757+0000","last_unstale":"2024-09-14T12:01:19.293202+0000","last_undegraded":"2024-09-14T12:01:19.293202+0000","last_fullsized":"2024-09-14T12:01:19.293202+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:26.991536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":590,"num_read_kb":1339,"num_write":526,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.434234+0000","last_change":"2024-09-14T10:46:52.374126+0000","last_active":"2024-09-14T11:56:55.434234+0000","last_peered":"2024-09-14T11:56:55.434234+0000","last_clean":"2024-09-14T11:56:55.434234+0000","last_became_active":"2024-09-14T10:46:52.373836+0000","last_became_peered":"2024-09-14T10:46:52.373836+0000","last_unstale":"2024-09-14T11:56:55.434234+0000","last_undegraded":"2024-09-14T11:56:55.434234+0000","last_fullsized":"2024-09-14T11:56:55.434234+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:57.883157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"263'94","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:41.091887+0000","last_change":"2024-09-14T10:46:54.387376+0000","last_active":"2024-09-14T12:00:41.091887+0000","last_peered":"2024-09-14T12:00:41.091887+0000","last_clean":"2024-09-14T12:00:41.091887+0000","last_became_active":"2024-09-14T10:46:54.387066+0000","last_became_peered":"2024-09-14T10:46:54.387066+0000","last_unstale":"2024-09-14T12:00:41.091887+0000","last_undegraded":"2024-09-14T12:00:41.091887+0000","last_fullsized":"2024-09-14T12:00:41.091887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:19.903031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":95,"num_write":224,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"263'1164","reported_seq":2674,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.498768+0000","last_change":"2024-09-14T10:46:46.340659+0000","last_active":"2024-09-14T11:59:49.498768+0000","last_peered":"2024-09-14T11:59:49.498768+0000","last_clean":"2024-09-14T11:59:49.498768+0000","last_became_active":"2024-09-14T10:46:46.340228+0000","last_became_peered":"2024-09-14T10:46:46.340228+0000","last_unstale":"2024-09-14T11:59:49.498768+0000","last_undegraded":"2024-09-14T11:59:49.498768+0000","last_fullsized":"2024-09-14T11:59:49.498768+0000","mapping_epoch":28,"log_start":"263'1100","ondisk_log_start":"263'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":1100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:27.760596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5254,"num_read_kb":4633,"num_write":1618,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"263'413","reported_seq":1126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.396142+0000","last_change":"2024-09-14T10:46:44.324787+0000","last_active":"2024-09-14T12:01:19.396142+0000","last_peered":"2024-09-14T12:01:19.396142+0000","last_clean":"2024-09-14T12:01:19.396142+0000","last_became_active":"2024-09-14T10:46:44.324440+0000","last_became_peered":"2024-09-14T10:46:44.324440+0000","last_unstale":"2024-09-14T12:01:19.396142+0000","last_undegraded":"2024-09-14T12:01:19.396142+0000","last_fullsized":"2024-09-14T12:01:19.396142+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:52.318910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":948,"num_read_kb":1994,"num_write":1270,"num_write_kb":27495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.460346+0000","last_change":"2024-09-14T10:46:48.354236+0000","last_active":"2024-09-14T11:58:48.460346+0000","last_peered":"2024-09-14T11:58:48.460346+0000","last_clean":"2024-09-14T11:58:48.460346+0000","last_became_active":"2024-09-14T10:46:48.353513+0000","last_became_peered":"2024-09-14T10:46:48.353513+0000","last_unstale":"2024-09-14T11:58:48.460346+0000","last_undegraded":"2024-09-14T11:58:48.460346+0000","last_fullsized":"2024-09-14T11:58:48.460346+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:10.512984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"263'328","reported_seq":928,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.474147+0000","last_change":"2024-09-14T10:46:50.362779+0000","last_active":"2024-09-14T12:01:17.474147+0000","last_peered":"2024-09-14T12:01:17.474147+0000","last_clean":"2024-09-14T12:01:17.474147+0000","last_became_active":"2024-09-14T10:46:50.362492+0000","last_became_peered":"2024-09-14T10:46:50.362492+0000","last_unstale":"2024-09-14T12:01:17.474147+0000","last_undegraded":"2024-09-14T12:01:17.474147+0000","last_fullsized":"2024-09-14T12:01:17.474147+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:23.999202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56673,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":540,"num_read_kb":1077,"num_write":430,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"263'787","reported_seq":4622,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.428164+0000","last_change":"2024-09-14T10:46:52.375362+0000","last_active":"2024-09-14T12:01:17.428164+0000","last_peered":"2024-09-14T12:01:17.428164+0000","last_clean":"2024-09-14T12:01:17.428164+0000","last_became_active":"2024-09-14T10:46:52.374947+0000","last_became_peered":"2024-09-14T10:46:52.374947+0000","last_unstale":"2024-09-14T12:01:17.428164+0000","last_undegraded":"2024-09-14T12:01:17.428164+0000","last_fullsized":"2024-09-14T12:01:17.428164+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:43.204468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"263'122","reported_seq":650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.113955+0000","last_change":"2024-09-14T10:46:54.382345+0000","last_active":"2024-09-14T11:59:32.113955+0000","last_peered":"2024-09-14T11:59:32.113955+0000","last_clean":"2024-09-14T11:59:32.113955+0000","last_became_active":"2024-09-14T10:46:54.382004+0000","last_became_peered":"2024-09-14T10:46:54.382004+0000","last_unstale":"2024-09-14T11:59:32.113955+0000","last_undegraded":"2024-09-14T11:59:32.113955+0000","last_fullsized":"2024-09-14T11:59:32.113955+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:14.712092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1268,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":189,"num_write":324,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"263'836","reported_seq":2527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.306491+0000","last_change":"2024-09-14T10:46:46.347624+0000","last_active":"2024-09-14T11:58:50.306491+0000","last_peered":"2024-09-14T11:58:50.306491+0000","last_clean":"2024-09-14T11:58:50.306491+0000","last_became_active":"2024-09-14T10:46:46.347307+0000","last_became_peered":"2024-09-14T10:46:46.347307+0000","last_unstale":"2024-09-14T11:58:50.306491+0000","last_undegraded":"2024-09-14T11:58:50.306491+0000","last_fullsized":"2024-09-14T11:58:50.306491+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:17.498211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4222,"num_read_kb":3846,"num_write":1108,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"263'364","reported_seq":1139,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.394169+0000","last_change":"2024-09-14T10:46:44.330921+0000","last_active":"2024-09-14T12:01:19.394169+0000","last_peered":"2024-09-14T12:01:19.394169+0000","last_clean":"2024-09-14T12:01:19.394169+0000","last_became_active":"2024-09-14T10:46:44.330567+0000","last_became_peered":"2024-09-14T10:46:44.330567+0000","last_unstale":"2024-09-14T12:01:19.394169+0000","last_undegraded":"2024-09-14T12:01:19.394169+0000","last_fullsized":"2024-09-14T12:01:19.394169+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:40.240207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":975,"num_read_kb":55651,"num_write":1153,"num_write_kb":35628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1461,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.207601+0000","last_change":"2024-09-14T10:46:48.356084+0000","last_active":"2024-09-14T12:01:17.207601+0000","last_peered":"2024-09-14T12:01:17.207601+0000","last_clean":"2024-09-14T12:01:17.207601+0000","last_became_active":"2024-09-14T10:46:48.355697+0000","last_became_peered":"2024-09-14T10:46:48.355697+0000","last_unstale":"2024-09-14T12:01:17.207601+0000","last_undegraded":"2024-09-14T12:01:17.207601+0000","last_fullsized":"2024-09-14T12:01:17.207601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:15.468545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"263'106","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.526629+0000","last_change":"2024-09-14T10:46:50.369569+0000","last_active":"2024-09-14T11:58:53.526629+0000","last_peered":"2024-09-14T11:58:53.526629+0000","last_clean":"2024-09-14T11:58:53.526629+0000","last_became_active":"2024-09-14T10:46:50.369337+0000","last_became_peered":"2024-09-14T10:46:50.369337+0000","last_unstale":"2024-09-14T11:58:53.526629+0000","last_undegraded":"2024-09-14T11:58:53.526629+0000","last_fullsized":"2024-09-14T11:58:53.526629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:49.461034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"263'803","reported_seq":2611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.186080+0000","last_change":"2024-09-14T10:46:52.374673+0000","last_active":"2024-09-14T12:01:19.186080+0000","last_peered":"2024-09-14T12:01:19.186080+0000","last_clean":"2024-09-14T12:01:19.186080+0000","last_became_active":"2024-09-14T10:46:52.374252+0000","last_became_peered":"2024-09-14T10:46:52.374252+0000","last_unstale":"2024-09-14T12:01:19.186080+0000","last_undegraded":"2024-09-14T12:01:19.186080+0000","last_fullsized":"2024-09-14T12:01:19.186080+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:12.425757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"263'119","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:50.989997+0000","last_change":"2024-09-14T10:46:54.386075+0000","last_active":"2024-09-14T12:00:50.989997+0000","last_peered":"2024-09-14T12:00:50.989997+0000","last_clean":"2024-09-14T12:00:50.989997+0000","last_became_active":"2024-09-14T10:46:54.384249+0000","last_became_peered":"2024-09-14T10:46:54.384249+0000","last_unstale":"2024-09-14T12:00:50.989997+0000","last_undegraded":"2024-09-14T12:00:50.989997+0000","last_fullsized":"2024-09-14T12:00:50.989997+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:21.699653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":125,"num_write":281,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"263'466","reported_seq":1939,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.500118+0000","last_change":"2024-09-14T10:46:46.342756+0000","last_active":"2024-09-14T11:59:49.500118+0000","last_peered":"2024-09-14T11:59:49.500118+0000","last_clean":"2024-09-14T11:59:49.500118+0000","last_became_active":"2024-09-14T10:46:46.342466+0000","last_became_peered":"2024-09-14T10:46:46.342466+0000","last_unstale":"2024-09-14T11:59:49.500118+0000","last_undegraded":"2024-09-14T11:59:49.500118+0000","last_fullsized":"2024-09-14T11:59:49.500118+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:43.804852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2422,"num_read_kb":2241,"num_write":583,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"263'288","reported_seq":915,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.308222+0000","last_change":"2024-09-14T10:46:44.329354+0000","last_active":"2024-09-14T12:01:19.308222+0000","last_peered":"2024-09-14T12:01:19.308222+0000","last_clean":"2024-09-14T12:01:19.308222+0000","last_became_active":"2024-09-14T10:46:44.329014+0000","last_became_peered":"2024-09-14T10:46:44.329014+0000","last_unstale":"2024-09-14T12:01:19.308222+0000","last_undegraded":"2024-09-14T12:01:19.308222+0000","last_fullsized":"2024-09-14T12:01:19.308222+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:32.183184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":506,"num_read_kb":30778,"num_write":881,"num_write_kb":14950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.533075+0000","last_change":"2024-09-14T10:46:48.358952+0000","last_active":"2024-09-14T11:58:50.533075+0000","last_peered":"2024-09-14T11:58:50.533075+0000","last_clean":"2024-09-14T11:58:50.533075+0000","last_became_active":"2024-09-14T10:46:48.358586+0000","last_became_peered":"2024-09-14T10:46:48.358586+0000","last_unstale":"2024-09-14T11:58:50.533075+0000","last_undegraded":"2024-09-14T11:58:50.533075+0000","last_fullsized":"2024-09-14T11:58:50.533075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:11.753221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"263'377","reported_seq":1006,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.075637+0000","last_change":"2024-09-14T10:46:50.367245+0000","last_active":"2024-09-14T12:01:18.075637+0000","last_peered":"2024-09-14T12:01:18.075637+0000","last_clean":"2024-09-14T12:01:18.075637+0000","last_became_active":"2024-09-14T10:46:50.365715+0000","last_became_peered":"2024-09-14T10:46:50.365715+0000","last_unstale":"2024-09-14T12:01:18.075637+0000","last_undegraded":"2024-09-14T12:01:18.075637+0000","last_fullsized":"2024-09-14T12:01:18.075637+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:16.793655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45582,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":610,"num_read_kb":1238,"num_write":470,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.306951+0000","last_change":"2024-09-14T10:46:52.370062+0000","last_active":"2024-09-14T11:58:55.306951+0000","last_peered":"2024-09-14T11:58:55.306951+0000","last_clean":"2024-09-14T11:58:55.306951+0000","last_became_active":"2024-09-14T10:46:52.369746+0000","last_became_peered":"2024-09-14T10:46:52.369746+0000","last_unstale":"2024-09-14T11:58:55.306951+0000","last_undegraded":"2024-09-14T11:58:55.306951+0000","last_fullsized":"2024-09-14T11:58:55.306951+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:38.246502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"263'156","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.673531+0000","last_change":"2024-09-14T10:46:54.384418+0000","last_active":"2024-09-14T11:59:32.673531+0000","last_peered":"2024-09-14T11:59:32.673531+0000","last_clean":"2024-09-14T11:59:32.673531+0000","last_became_active":"2024-09-14T10:46:54.384119+0000","last_became_peered":"2024-09-14T10:46:54.384119+0000","last_unstale":"2024-09-14T11:59:32.673531+0000","last_undegraded":"2024-09-14T11:59:32.673531+0000","last_fullsized":"2024-09-14T11:59:32.673531+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:04.224188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":393,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"263'776","reported_seq":2204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.103437+0000","last_change":"2024-09-14T10:46:46.334782+0000","last_active":"2024-09-14T11:58:05.103437+0000","last_peered":"2024-09-14T11:58:05.103437+0000","last_clean":"2024-09-14T11:58:05.103437+0000","last_became_active":"2024-09-14T10:46:46.334444+0000","last_became_peered":"2024-09-14T10:46:46.334444+0000","last_unstale":"2024-09-14T11:58:05.103437+0000","last_undegraded":"2024-09-14T11:58:05.103437+0000","last_fullsized":"2024-09-14T11:58:05.103437+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:28.537376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3619,"num_read_kb":3234,"num_write":1038,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.407127+0000","last_change":"2024-09-14T10:46:26.241804+0000","last_active":"2024-09-14T11:58:40.407127+0000","last_peered":"2024-09-14T11:58:40.407127+0000","last_clean":"2024-09-14T11:58:40.407127+0000","last_became_active":"2024-09-14T10:46:26.241454+0000","last_became_peered":"2024-09-14T10:46:26.241454+0000","last_unstale":"2024-09-14T11:58:40.407127+0000","last_undegraded":"2024-09-14T11:58:40.407127+0000","last_fullsized":"2024-09-14T11:58:40.407127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:25.229371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:25.229371+0000","last_clean_scrub_stamp":"2024-09-14T10:46:25.229371+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:49.754841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":534,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:25.522947+0000","last_change":"2024-09-14T10:46:35.277926+0000","last_active":"2024-09-14T11:57:25.522947+0000","last_peered":"2024-09-14T11:57:25.522947+0000","last_clean":"2024-09-14T11:57:25.522947+0000","last_became_active":"2024-09-14T10:46:33.413305+0000","last_became_peered":"2024-09-14T10:46:33.413305+0000","last_unstale":"2024-09-14T11:57:25.522947+0000","last_undegraded":"2024-09-14T11:57:25.522947+0000","last_fullsized":"2024-09-14T11:57:25.522947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:13.605387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092058099999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"263'313","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.316155+0000","last_change":"2024-09-14T10:46:44.329784+0000","last_active":"2024-09-14T12:01:19.316155+0000","last_peered":"2024-09-14T12:01:19.316155+0000","last_clean":"2024-09-14T12:01:19.316155+0000","last_became_active":"2024-09-14T10:46:44.329050+0000","last_became_peered":"2024-09-14T10:46:44.329050+0000","last_unstale":"2024-09-14T12:01:19.316155+0000","last_undegraded":"2024-09-14T12:01:19.316155+0000","last_fullsized":"2024-09-14T12:01:19.316155+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:43.544984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":32601,"num_write":1066,"num_write_kb":17351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"38'5","reported_seq":990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.195369+0000","last_change":"2024-09-14T10:46:48.353767+0000","last_active":"2024-09-14T12:01:17.195369+0000","last_peered":"2024-09-14T12:01:17.195369+0000","last_clean":"2024-09-14T12:01:17.195369+0000","last_became_active":"2024-09-14T10:46:48.353319+0000","last_became_peered":"2024-09-14T10:46:48.353319+0000","last_unstale":"2024-09-14T12:01:17.195369+0000","last_undegraded":"2024-09-14T12:01:17.195369+0000","last_fullsized":"2024-09-14T12:01:17.195369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:38.932761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"263'795","reported_seq":1515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.746391+0000","last_change":"2024-09-14T10:46:50.363357+0000","last_active":"2024-09-14T12:01:18.746391+0000","last_peered":"2024-09-14T12:01:18.746391+0000","last_clean":"2024-09-14T12:01:18.746391+0000","last_became_active":"2024-09-14T10:46:50.362908+0000","last_became_peered":"2024-09-14T10:46:50.362908+0000","last_unstale":"2024-09-14T12:01:18.746391+0000","last_undegraded":"2024-09-14T12:01:18.746391+0000","last_fullsized":"2024-09-14T12:01:18.746391+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:43.112130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143024,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1563,"num_read_kb":3671,"num_write":1508,"num_write_kb":1333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.456299+0000","last_change":"2024-09-14T10:46:52.371975+0000","last_active":"2024-09-14T11:58:23.456299+0000","last_peered":"2024-09-14T11:58:23.456299+0000","last_clean":"2024-09-14T11:58:23.456299+0000","last_became_active":"2024-09-14T10:46:52.371684+0000","last_became_peered":"2024-09-14T10:46:52.371684+0000","last_unstale":"2024-09-14T11:58:23.456299+0000","last_undegraded":"2024-09-14T11:58:23.456299+0000","last_fullsized":"2024-09-14T11:58:23.456299+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:40.156605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"263'205","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.737078+0000","last_change":"2024-09-14T10:46:54.382314+0000","last_active":"2024-09-14T11:59:34.737078+0000","last_peered":"2024-09-14T11:59:34.737078+0000","last_clean":"2024-09-14T11:59:34.737078+0000","last_became_active":"2024-09-14T10:46:54.382019+0000","last_became_peered":"2024-09-14T10:46:54.382019+0000","last_unstale":"2024-09-14T11:59:34.737078+0000","last_undegraded":"2024-09-14T11:59:34.737078+0000","last_fullsized":"2024-09-14T11:59:34.737078+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:50.945970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":483,"num_read_kb":466,"num_write":435,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"263'817","reported_seq":2421,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.147601+0000","last_change":"2024-09-14T10:46:46.345582+0000","last_active":"2024-09-14T12:00:51.147601+0000","last_peered":"2024-09-14T12:00:51.147601+0000","last_clean":"2024-09-14T12:00:51.147601+0000","last_became_active":"2024-09-14T10:46:46.345302+0000","last_became_peered":"2024-09-14T10:46:46.345302+0000","last_unstale":"2024-09-14T12:00:51.147601+0000","last_undegraded":"2024-09-14T12:00:51.147601+0000","last_fullsized":"2024-09-14T12:00:51.147601+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:17.727283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3876,"num_read_kb":3495,"num_write":1050,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.531770+0000","last_change":"2024-09-14T10:46:35.277550+0000","last_active":"2024-09-14T11:58:40.531770+0000","last_peered":"2024-09-14T11:58:40.531770+0000","last_clean":"2024-09-14T11:58:40.531770+0000","last_became_active":"2024-09-14T10:46:33.265619+0000","last_became_peered":"2024-09-14T10:46:33.265619+0000","last_unstale":"2024-09-14T11:58:40.531770+0000","last_undegraded":"2024-09-14T11:58:40.531770+0000","last_fullsized":"2024-09-14T11:58:40.531770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:56.062295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058478399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"263'315","reported_seq":1163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.535743+0000","last_change":"2024-09-14T10:46:44.320448+0000","last_active":"2024-09-14T12:01:18.535743+0000","last_peered":"2024-09-14T12:01:18.535743+0000","last_clean":"2024-09-14T12:01:18.535743+0000","last_became_active":"2024-09-14T10:46:44.320087+0000","last_became_peered":"2024-09-14T10:46:44.320087+0000","last_unstale":"2024-09-14T12:01:18.535743+0000","last_undegraded":"2024-09-14T12:01:18.535743+0000","last_fullsized":"2024-09-14T12:01:18.535743+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:18.710537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25054,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":1176,"num_read_kb":9242,"num_write":1094,"num_write_kb":25141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.529481+0000","last_change":"2024-09-14T10:46:48.350940+0000","last_active":"2024-09-14T11:58:20.529481+0000","last_peered":"2024-09-14T11:58:20.529481+0000","last_clean":"2024-09-14T11:58:20.529481+0000","last_became_active":"2024-09-14T10:46:48.350653+0000","last_became_peered":"2024-09-14T10:46:48.350653+0000","last_unstale":"2024-09-14T11:58:20.529481+0000","last_undegraded":"2024-09-14T11:58:20.529481+0000","last_fullsized":"2024-09-14T11:58:20.529481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:11.993887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"263'1395","reported_seq":3236,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.111806+0000","last_change":"2024-09-14T10:46:50.362470+0000","last_active":"2024-09-14T12:01:19.111806+0000","last_peered":"2024-09-14T12:01:19.111806+0000","last_clean":"2024-09-14T12:01:19.111806+0000","last_became_active":"2024-09-14T10:46:50.362128+0000","last_became_peered":"2024-09-14T10:46:50.362128+0000","last_unstale":"2024-09-14T12:01:19.111806+0000","last_undegraded":"2024-09-14T12:01:19.111806+0000","last_fullsized":"2024-09-14T12:01:19.111806+0000","mapping_epoch":32,"log_start":"263'1300","ondisk_log_start":"263'1300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":1300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:16.340703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160652,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2189,"num_read_kb":4301,"num_write":1286,"num_write_kb":1103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.525954+0000","last_change":"2024-09-14T10:46:52.375637+0000","last_active":"2024-09-14T11:57:50.525954+0000","last_peered":"2024-09-14T11:57:50.525954+0000","last_clean":"2024-09-14T11:57:50.525954+0000","last_became_active":"2024-09-14T10:46:52.375344+0000","last_became_peered":"2024-09-14T10:46:52.375344+0000","last_unstale":"2024-09-14T11:57:50.525954+0000","last_undegraded":"2024-09-14T11:57:50.525954+0000","last_fullsized":"2024-09-14T11:57:50.525954+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:28.073066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"263'95","reported_seq":596,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.585158+0000","last_change":"2024-09-14T10:46:54.384671+0000","last_active":"2024-09-14T11:59:33.585158+0000","last_peered":"2024-09-14T11:59:33.585158+0000","last_clean":"2024-09-14T11:59:33.585158+0000","last_became_active":"2024-09-14T10:46:54.384354+0000","last_became_peered":"2024-09-14T10:46:54.384354+0000","last_unstale":"2024-09-14T11:59:33.585158+0000","last_undegraded":"2024-09-14T11:59:33.585158+0000","last_fullsized":"2024-09-14T11:59:33.585158+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:42.323130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":95,"num_write":225,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"263'543","reported_seq":2137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:18.521582+0000","last_change":"2024-09-14T10:46:46.345522+0000","last_active":"2024-09-14T11:58:18.521582+0000","last_peered":"2024-09-14T11:58:18.521582+0000","last_clean":"2024-09-14T11:58:18.521582+0000","last_became_active":"2024-09-14T10:46:46.345234+0000","last_became_peered":"2024-09-14T10:46:46.345234+0000","last_unstale":"2024-09-14T11:58:18.521582+0000","last_undegraded":"2024-09-14T11:58:18.521582+0000","last_fullsized":"2024-09-14T11:58:18.521582+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:05.993847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2916,"num_read_kb":2703,"num_write":726,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:25.438151+0000","last_change":"2024-09-14T10:46:35.332938+0000","last_active":"2024-09-14T11:57:25.438151+0000","last_peered":"2024-09-14T11:57:25.438151+0000","last_clean":"2024-09-14T11:57:25.438151+0000","last_became_active":"2024-09-14T10:46:33.265185+0000","last_became_peered":"2024-09-14T10:46:33.265185+0000","last_unstale":"2024-09-14T11:57:25.438151+0000","last_undegraded":"2024-09-14T11:57:25.438151+0000","last_fullsized":"2024-09-14T11:57:25.438151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:20.170242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000550246,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"263'288","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.376501+0000","last_change":"2024-09-14T10:46:44.327457+0000","last_active":"2024-09-14T12:01:18.376501+0000","last_peered":"2024-09-14T12:01:18.376501+0000","last_clean":"2024-09-14T12:01:18.376501+0000","last_became_active":"2024-09-14T10:46:44.327101+0000","last_became_peered":"2024-09-14T10:46:44.327101+0000","last_unstale":"2024-09-14T12:01:18.376501+0000","last_undegraded":"2024-09-14T12:01:18.376501+0000","last_fullsized":"2024-09-14T12:01:18.376501+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:34.079248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":585,"num_read_kb":99380,"num_write":1012,"num_write_kb":24751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.445762+0000","last_change":"2024-09-14T10:46:48.354125+0000","last_active":"2024-09-14T11:58:20.445762+0000","last_peered":"2024-09-14T11:58:20.445762+0000","last_clean":"2024-09-14T11:58:20.445762+0000","last_became_active":"2024-09-14T10:46:48.353803+0000","last_became_peered":"2024-09-14T10:46:48.353803+0000","last_unstale":"2024-09-14T11:58:20.445762+0000","last_undegraded":"2024-09-14T11:58:20.445762+0000","last_fullsized":"2024-09-14T11:58:20.445762+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:10.885769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"263'303","reported_seq":1752,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:50.881334+0000","last_change":"2024-09-14T10:46:50.365198+0000","last_active":"2024-09-14T12:00:50.881334+0000","last_peered":"2024-09-14T12:00:50.881334+0000","last_clean":"2024-09-14T12:00:50.881334+0000","last_became_active":"2024-09-14T10:46:50.364857+0000","last_became_peered":"2024-09-14T10:46:50.364857+0000","last_unstale":"2024-09-14T12:00:50.881334+0000","last_undegraded":"2024-09-14T12:00:50.881334+0000","last_fullsized":"2024-09-14T12:00:50.881334+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:49.821470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":263,"num_read_kb":255,"num_write":243,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:45.640374+0000","last_change":"2024-09-14T10:46:52.367740+0000","last_active":"2024-09-14T11:57:45.640374+0000","last_peered":"2024-09-14T11:57:45.640374+0000","last_clean":"2024-09-14T11:57:45.640374+0000","last_became_active":"2024-09-14T10:46:52.365738+0000","last_became_peered":"2024-09-14T10:46:52.365738+0000","last_unstale":"2024-09-14T11:57:45.640374+0000","last_undegraded":"2024-09-14T11:57:45.640374+0000","last_fullsized":"2024-09-14T11:57:45.640374+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:55.844741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"263'261","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.991420+0000","last_change":"2024-09-14T10:46:54.379215+0000","last_active":"2024-09-14T11:59:34.991420+0000","last_peered":"2024-09-14T11:59:34.991420+0000","last_clean":"2024-09-14T11:59:34.991420+0000","last_became_active":"2024-09-14T10:46:54.378930+0000","last_became_peered":"2024-09-14T10:46:54.378930+0000","last_unstale":"2024-09-14T11:59:34.991420+0000","last_undegraded":"2024-09-14T11:59:34.991420+0000","last_fullsized":"2024-09-14T11:59:34.991420+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:20.494987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":478,"num_read_kb":502,"num_write":559,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"263'787","reported_seq":2353,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:43.533534+0000","last_change":"2024-09-14T10:46:46.334984+0000","last_active":"2024-09-14T11:59:43.533534+0000","last_peered":"2024-09-14T11:59:43.533534+0000","last_clean":"2024-09-14T11:59:43.533534+0000","last_became_active":"2024-09-14T10:46:46.334679+0000","last_became_peered":"2024-09-14T10:46:46.334679+0000","last_unstale":"2024-09-14T11:59:43.533534+0000","last_undegraded":"2024-09-14T11:59:43.533534+0000","last_fullsized":"2024-09-14T11:59:43.533534+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:52.255486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3681,"num_read_kb":3336,"num_write":1001,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:25.522916+0000","last_change":"2024-09-14T10:46:35.278266+0000","last_active":"2024-09-14T11:57:25.522916+0000","last_peered":"2024-09-14T11:57:25.522916+0000","last_clean":"2024-09-14T11:57:25.522916+0000","last_became_active":"2024-09-14T10:46:33.296172+0000","last_became_peered":"2024-09-14T10:46:33.296172+0000","last_unstale":"2024-09-14T11:57:25.522916+0000","last_undegraded":"2024-09-14T11:57:25.522916+0000","last_fullsized":"2024-09-14T11:57:25.522916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:36.394821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00125464,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"263'339","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.361280+0000","last_change":"2024-09-14T10:46:44.325455+0000","last_active":"2024-09-14T12:01:19.361280+0000","last_peered":"2024-09-14T12:01:19.361280+0000","last_clean":"2024-09-14T12:01:19.361280+0000","last_became_active":"2024-09-14T10:46:44.323974+0000","last_became_peered":"2024-09-14T10:46:44.323974+0000","last_unstale":"2024-09-14T12:01:19.361280+0000","last_undegraded":"2024-09-14T12:01:19.361280+0000","last_fullsized":"2024-09-14T12:01:19.361280+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:51:12.075141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":608,"num_read_kb":7380,"num_write":1200,"num_write_kb":32204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:55.442524+0000","last_change":"2024-09-14T10:46:48.355092+0000","last_active":"2024-09-14T11:57:55.442524+0000","last_peered":"2024-09-14T11:57:55.442524+0000","last_clean":"2024-09-14T11:57:55.442524+0000","last_became_active":"2024-09-14T10:46:48.354786+0000","last_became_peered":"2024-09-14T10:46:48.354786+0000","last_unstale":"2024-09-14T11:57:55.442524+0000","last_undegraded":"2024-09-14T11:57:55.442524+0000","last_fullsized":"2024-09-14T11:57:55.442524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:26.687521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"263'154","reported_seq":714,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:33.477130+0000","last_change":"2024-09-14T10:46:50.363852+0000","last_active":"2024-09-14T12:00:33.477130+0000","last_peered":"2024-09-14T12:00:33.477130+0000","last_clean":"2024-09-14T12:00:33.477130+0000","last_became_active":"2024-09-14T10:46:50.363538+0000","last_became_peered":"2024-09-14T10:46:50.363538+0000","last_unstale":"2024-09-14T12:00:33.477130+0000","last_undegraded":"2024-09-14T12:00:33.477130+0000","last_fullsized":"2024-09-14T12:00:33.477130+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:41.224986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":198,"num_read_kb":192,"num_write":144,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:25.530066+0000","last_change":"2024-09-14T10:46:52.371280+0000","last_active":"2024-09-14T11:58:25.530066+0000","last_peered":"2024-09-14T11:58:25.530066+0000","last_clean":"2024-09-14T11:58:25.530066+0000","last_became_active":"2024-09-14T10:46:52.370968+0000","last_became_peered":"2024-09-14T10:46:52.370968+0000","last_unstale":"2024-09-14T11:58:25.530066+0000","last_undegraded":"2024-09-14T11:58:25.530066+0000","last_fullsized":"2024-09-14T11:58:25.530066+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:12.904159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"263'119","reported_seq":669,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.337447+0000","last_change":"2024-09-14T10:46:54.389298+0000","last_active":"2024-09-14T11:58:44.337447+0000","last_peered":"2024-09-14T11:58:44.337447+0000","last_clean":"2024-09-14T11:58:44.337447+0000","last_became_active":"2024-09-14T10:46:54.388938+0000","last_became_peered":"2024-09-14T10:46:54.388938+0000","last_unstale":"2024-09-14T11:58:44.337447+0000","last_undegraded":"2024-09-14T11:58:44.337447+0000","last_fullsized":"2024-09-14T11:58:44.337447+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:20.842708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":281,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"263'403","reported_seq":1966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.216353+0000","last_change":"2024-09-14T10:46:46.335959+0000","last_active":"2024-09-14T11:58:11.216353+0000","last_peered":"2024-09-14T11:58:11.216353+0000","last_clean":"2024-09-14T11:58:11.216353+0000","last_became_active":"2024-09-14T10:46:46.335681+0000","last_became_peered":"2024-09-14T10:46:46.335681+0000","last_unstale":"2024-09-14T11:58:11.216353+0000","last_undegraded":"2024-09-14T11:58:11.216353+0000","last_fullsized":"2024-09-14T11:58:11.216353+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:24.103452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2240,"num_read_kb":2136,"num_write":448,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"263'321","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.386167+0000","last_change":"2024-09-14T10:46:44.320085+0000","last_active":"2024-09-14T12:01:19.386167+0000","last_peered":"2024-09-14T12:01:19.386167+0000","last_clean":"2024-09-14T12:01:19.386167+0000","last_became_active":"2024-09-14T10:46:44.319714+0000","last_became_peered":"2024-09-14T10:46:44.319714+0000","last_unstale":"2024-09-14T12:01:19.386167+0000","last_undegraded":"2024-09-14T12:01:19.386167+0000","last_fullsized":"2024-09-14T12:01:19.386167+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:11.937757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":599,"num_read_kb":77773,"num_write":1050,"num_write_kb":36142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:23.447048+0000","last_change":"2024-09-14T10:46:35.333110+0000","last_active":"2024-09-14T11:57:23.447048+0000","last_peered":"2024-09-14T11:57:23.447048+0000","last_clean":"2024-09-14T11:57:23.447048+0000","last_became_active":"2024-09-14T10:46:33.296049+0000","last_became_peered":"2024-09-14T10:46:33.296049+0000","last_unstale":"2024-09-14T11:57:23.447048+0000","last_undegraded":"2024-09-14T11:57:23.447048+0000","last_fullsized":"2024-09-14T11:57:23.447048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:58.526433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000560203,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:40.639756+0000","last_change":"2024-09-14T10:46:48.350451+0000","last_active":"2024-09-14T11:57:40.639756+0000","last_peered":"2024-09-14T11:57:40.639756+0000","last_clean":"2024-09-14T11:57:40.639756+0000","last_became_active":"2024-09-14T10:46:48.350088+0000","last_became_peered":"2024-09-14T10:46:48.350088+0000","last_unstale":"2024-09-14T11:57:40.639756+0000","last_undegraded":"2024-09-14T11:57:40.639756+0000","last_fullsized":"2024-09-14T11:57:40.639756+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:29.591738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"263'635","reported_seq":1320,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.802571+0000","last_change":"2024-09-14T10:46:50.363683+0000","last_active":"2024-09-14T12:01:18.802571+0000","last_peered":"2024-09-14T12:01:18.802571+0000","last_clean":"2024-09-14T12:01:18.802571+0000","last_became_active":"2024-09-14T10:46:50.363387+0000","last_became_peered":"2024-09-14T10:46:50.363387+0000","last_unstale":"2024-09-14T12:01:18.802571+0000","last_undegraded":"2024-09-14T12:01:18.802571+0000","last_fullsized":"2024-09-14T12:01:18.802571+0000","mapping_epoch":32,"log_start":"263'600","ondisk_log_start":"263'600","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":600,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:52:29.856170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95765,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1702,"num_read_kb":2954,"num_write":2224,"num_write_kb":2032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:45.299536+0000","last_change":"2024-09-14T10:46:52.374167+0000","last_active":"2024-09-14T11:57:45.299536+0000","last_peered":"2024-09-14T11:57:45.299536+0000","last_clean":"2024-09-14T11:57:45.299536+0000","last_became_active":"2024-09-14T10:46:52.373837+0000","last_became_peered":"2024-09-14T10:46:52.373837+0000","last_unstale":"2024-09-14T11:57:45.299536+0000","last_undegraded":"2024-09-14T11:57:45.299536+0000","last_fullsized":"2024-09-14T11:57:45.299536+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:56.691785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"263'152","reported_seq":660,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.008979+0000","last_change":"2024-09-14T10:46:54.386107+0000","last_active":"2024-09-14T11:59:31.008979+0000","last_peered":"2024-09-14T11:59:31.008979+0000","last_clean":"2024-09-14T11:59:31.008979+0000","last_became_active":"2024-09-14T10:46:54.385835+0000","last_became_peered":"2024-09-14T10:46:54.385835+0000","last_unstale":"2024-09-14T11:59:31.008979+0000","last_undegraded":"2024-09-14T11:59:31.008979+0000","last_fullsized":"2024-09-14T11:59:31.008979+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:18.649909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":168,"num_read_kb":158,"num_write":389,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"263'835","reported_seq":2478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.599452+0000","last_change":"2024-09-14T10:46:46.346336+0000","last_active":"2024-09-14T11:59:33.599452+0000","last_peered":"2024-09-14T11:59:33.599452+0000","last_clean":"2024-09-14T11:59:33.599452+0000","last_became_active":"2024-09-14T10:46:46.346072+0000","last_became_peered":"2024-09-14T10:46:46.346072+0000","last_unstale":"2024-09-14T11:59:33.599452+0000","last_undegraded":"2024-09-14T11:59:33.599452+0000","last_fullsized":"2024-09-14T11:59:33.599452+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:26.721967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4027,"num_read_kb":3636,"num_write":1084,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"263'345","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.530435+0000","last_change":"2024-09-14T10:46:44.318544+0000","last_active":"2024-09-14T12:01:18.530435+0000","last_peered":"2024-09-14T12:01:18.530435+0000","last_clean":"2024-09-14T12:01:18.530435+0000","last_became_active":"2024-09-14T10:46:44.317702+0000","last_became_peered":"2024-09-14T10:46:44.317702+0000","last_unstale":"2024-09-14T12:01:18.530435+0000","last_undegraded":"2024-09-14T12:01:18.530435+0000","last_fullsized":"2024-09-14T12:01:18.530435+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:51.997687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11715436,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":620,"num_read_kb":57005,"num_write":1141,"num_write_kb":30753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:30.523578+0000","last_change":"2024-09-14T10:46:35.277870+0000","last_active":"2024-09-14T11:57:30.523578+0000","last_peered":"2024-09-14T11:57:30.523578+0000","last_clean":"2024-09-14T11:57:30.523578+0000","last_became_active":"2024-09-14T10:46:33.265512+0000","last_became_peered":"2024-09-14T10:46:33.265512+0000","last_unstale":"2024-09-14T11:57:30.523578+0000","last_undegraded":"2024-09-14T11:57:30.523578+0000","last_fullsized":"2024-09-14T11:57:30.523578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:38.583783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088449000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:40.598081+0000","last_change":"2024-09-14T10:46:48.353705+0000","last_active":"2024-09-14T11:57:40.598081+0000","last_peered":"2024-09-14T11:57:40.598081+0000","last_clean":"2024-09-14T11:57:40.598081+0000","last_became_active":"2024-09-14T10:46:48.353394+0000","last_became_peered":"2024-09-14T10:46:48.353394+0000","last_unstale":"2024-09-14T11:57:40.598081+0000","last_undegraded":"2024-09-14T11:57:40.598081+0000","last_fullsized":"2024-09-14T11:57:40.598081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:16.155422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"263'261","reported_seq":847,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.134914+0000","last_change":"2024-09-14T10:46:50.363699+0000","last_active":"2024-09-14T11:59:33.134914+0000","last_peered":"2024-09-14T11:59:33.134914+0000","last_clean":"2024-09-14T11:59:33.134914+0000","last_became_active":"2024-09-14T10:46:50.363436+0000","last_became_peered":"2024-09-14T10:46:50.363436+0000","last_unstale":"2024-09-14T11:59:33.134914+0000","last_undegraded":"2024-09-14T11:59:33.134914+0000","last_fullsized":"2024-09-14T11:59:33.134914+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:29.116427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":321,"num_read_kb":313,"num_write":296,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"263'803","reported_seq":2970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.187710+0000","last_change":"2024-09-14T10:46:52.373730+0000","last_active":"2024-09-14T12:01:19.187710+0000","last_peered":"2024-09-14T12:01:19.187710+0000","last_clean":"2024-09-14T12:01:19.187710+0000","last_became_active":"2024-09-14T10:46:52.373068+0000","last_became_peered":"2024-09-14T10:46:52.373068+0000","last_unstale":"2024-09-14T12:01:19.187710+0000","last_undegraded":"2024-09-14T12:01:19.187710+0000","last_fullsized":"2024-09-14T12:01:19.187710+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:46.138887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"263'136","reported_seq":633,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.453254+0000","last_change":"2024-09-14T10:46:54.388712+0000","last_active":"2024-09-14T11:59:10.453254+0000","last_peered":"2024-09-14T11:59:10.453254+0000","last_clean":"2024-09-14T11:59:10.453254+0000","last_became_active":"2024-09-14T10:46:54.387317+0000","last_became_peered":"2024-09-14T10:46:54.387317+0000","last_unstale":"2024-09-14T11:59:10.453254+0000","last_undegraded":"2024-09-14T11:59:10.453254+0000","last_fullsized":"2024-09-14T11:59:10.453254+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:03.151982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":117,"num_write":309,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"263'1367","reported_seq":3055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.167851+0000","last_change":"2024-09-14T10:46:46.345068+0000","last_active":"2024-09-14T12:00:51.167851+0000","last_peered":"2024-09-14T12:00:51.167851+0000","last_clean":"2024-09-14T12:00:51.167851+0000","last_became_active":"2024-09-14T10:46:46.344799+0000","last_became_peered":"2024-09-14T10:46:46.344799+0000","last_unstale":"2024-09-14T12:00:51.167851+0000","last_undegraded":"2024-09-14T12:00:51.167851+0000","last_fullsized":"2024-09-14T12:00:51.167851+0000","mapping_epoch":28,"log_start":"263'1300","ondisk_log_start":"263'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":1300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:57.271856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6397,"num_read_kb":5617,"num_write":2035,"num_write_kb":974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"263'403","reported_seq":1211,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.335174+0000","last_change":"2024-09-14T10:46:44.324495+0000","last_active":"2024-09-14T12:01:19.335174+0000","last_peered":"2024-09-14T12:01:19.335174+0000","last_clean":"2024-09-14T12:01:19.335174+0000","last_became_active":"2024-09-14T10:46:44.324158+0000","last_became_peered":"2024-09-14T10:46:44.324158+0000","last_unstale":"2024-09-14T12:01:19.335174+0000","last_undegraded":"2024-09-14T12:01:19.335174+0000","last_fullsized":"2024-09-14T12:01:19.335174+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:06.192395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":514873,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1028,"num_read_kb":45406,"num_write":1187,"num_write_kb":52499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.643287+0000","last_change":"2024-09-14T10:46:35.333032+0000","last_active":"2024-09-14T11:58:05.643287+0000","last_peered":"2024-09-14T11:58:05.643287+0000","last_clean":"2024-09-14T11:58:05.643287+0000","last_became_active":"2024-09-14T10:46:33.262218+0000","last_became_peered":"2024-09-14T10:46:33.262218+0000","last_unstale":"2024-09-14T11:58:05.643287+0000","last_undegraded":"2024-09-14T11:58:05.643287+0000","last_fullsized":"2024-09-14T11:58:05.643287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:37.487991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072314099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:40.524716+0000","last_change":"2024-09-14T10:46:48.350207+0000","last_active":"2024-09-14T11:57:40.524716+0000","last_peered":"2024-09-14T11:57:40.524716+0000","last_clean":"2024-09-14T11:57:40.524716+0000","last_became_active":"2024-09-14T10:46:48.349924+0000","last_became_peered":"2024-09-14T10:46:48.349924+0000","last_unstale":"2024-09-14T11:57:40.524716+0000","last_undegraded":"2024-09-14T11:57:40.524716+0000","last_fullsized":"2024-09-14T11:57:40.524716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:06.223225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"263'131","reported_seq":690,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:40.524748+0000","last_change":"2024-09-14T10:46:50.366912+0000","last_active":"2024-09-14T11:57:40.524748+0000","last_peered":"2024-09-14T11:57:40.524748+0000","last_clean":"2024-09-14T11:57:40.524748+0000","last_became_active":"2024-09-14T10:46:50.366610+0000","last_became_peered":"2024-09-14T10:46:50.366610+0000","last_unstale":"2024-09-14T11:57:40.524748+0000","last_undegraded":"2024-09-14T11:57:40.524748+0000","last_fullsized":"2024-09-14T11:57:40.524748+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:08.232971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"263'830","reported_seq":2794,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.430435+0000","last_change":"2024-09-14T10:46:52.371337+0000","last_active":"2024-09-14T12:01:17.430435+0000","last_peered":"2024-09-14T12:01:17.430435+0000","last_clean":"2024-09-14T12:01:17.430435+0000","last_became_active":"2024-09-14T10:46:52.370514+0000","last_became_peered":"2024-09-14T10:46:52.370514+0000","last_unstale":"2024-09-14T12:01:17.430435+0000","last_undegraded":"2024-09-14T12:01:17.430435+0000","last_fullsized":"2024-09-14T12:01:17.430435+0000","mapping_epoch":34,"log_start":"263'800","ondisk_log_start":"263'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":800,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:45.428130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"263'307","reported_seq":847,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.462075+0000","last_change":"2024-09-14T10:46:54.383183+0000","last_active":"2024-09-14T11:58:58.462075+0000","last_peered":"2024-09-14T11:58:58.462075+0000","last_clean":"2024-09-14T11:58:58.462075+0000","last_became_active":"2024-09-14T10:46:54.382860+0000","last_became_peered":"2024-09-14T10:46:54.382860+0000","last_unstale":"2024-09-14T11:58:58.462075+0000","last_undegraded":"2024-09-14T11:58:58.462075+0000","last_fullsized":"2024-09-14T11:58:58.462075+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:04.052225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":895,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":402,"num_read_kb":382,"num_write":591,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"263'1146","reported_seq":2843,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.351752+0000","last_change":"2024-09-14T10:46:46.338805+0000","last_active":"2024-09-14T11:58:44.351752+0000","last_peered":"2024-09-14T11:58:44.351752+0000","last_clean":"2024-09-14T11:58:44.351752+0000","last_became_active":"2024-09-14T10:46:46.338543+0000","last_became_peered":"2024-09-14T10:46:46.338543+0000","last_unstale":"2024-09-14T11:58:44.351752+0000","last_undegraded":"2024-09-14T11:58:44.351752+0000","last_fullsized":"2024-09-14T11:58:44.351752+0000","mapping_epoch":28,"log_start":"263'1100","ondisk_log_start":"263'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":1100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:11.687416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5511,"num_read_kb":4909,"num_write":1576,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"263'347","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.322796+0000","last_change":"2024-09-14T10:46:44.319103+0000","last_active":"2024-09-14T12:01:19.322796+0000","last_peered":"2024-09-14T12:01:19.322796+0000","last_clean":"2024-09-14T12:01:19.322796+0000","last_became_active":"2024-09-14T10:46:44.318777+0000","last_became_peered":"2024-09-14T10:46:44.318777+0000","last_unstale":"2024-09-14T12:01:19.322796+0000","last_undegraded":"2024-09-14T12:01:19.322796+0000","last_fullsized":"2024-09-14T12:01:19.322796+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:25.866596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":579,"num_read_kb":36295,"num_write":1107,"num_write_kb":33618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.527666+0000","last_change":"2024-09-14T10:46:35.277572+0000","last_active":"2024-09-14T11:58:05.527666+0000","last_peered":"2024-09-14T11:58:05.527666+0000","last_clean":"2024-09-14T11:58:05.527666+0000","last_became_active":"2024-09-14T10:46:33.265515+0000","last_became_peered":"2024-09-14T10:46:33.265515+0000","last_unstale":"2024-09-14T11:58:05.527666+0000","last_undegraded":"2024-09-14T11:58:05.527666+0000","last_fullsized":"2024-09-14T11:58:05.527666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:42.848687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061284299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.652272+0000","last_change":"2024-09-14T10:46:48.356581+0000","last_active":"2024-09-14T11:59:05.652272+0000","last_peered":"2024-09-14T11:59:05.652272+0000","last_clean":"2024-09-14T11:59:05.652272+0000","last_became_active":"2024-09-14T10:46:48.354373+0000","last_became_peered":"2024-09-14T10:46:48.354373+0000","last_unstale":"2024-09-14T11:59:05.652272+0000","last_undegraded":"2024-09-14T11:59:05.652272+0000","last_fullsized":"2024-09-14T11:59:05.652272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:11.993887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"263'723","reported_seq":1465,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.170376+0000","last_change":"2024-09-14T10:46:50.362694+0000","last_active":"2024-09-14T12:01:19.170376+0000","last_peered":"2024-09-14T12:01:19.170376+0000","last_clean":"2024-09-14T12:01:19.170376+0000","last_became_active":"2024-09-14T10:46:50.362397+0000","last_became_peered":"2024-09-14T10:46:50.362397+0000","last_unstale":"2024-09-14T12:01:19.170376+0000","last_undegraded":"2024-09-14T12:01:19.170376+0000","last_fullsized":"2024-09-14T12:01:19.170376+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":700,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:52.299380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1285,"num_read_kb":3031,"num_write":1024,"num_write_kb":812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:45.640338+0000","last_change":"2024-09-14T10:46:52.370429+0000","last_active":"2024-09-14T11:57:45.640338+0000","last_peered":"2024-09-14T11:57:45.640338+0000","last_clean":"2024-09-14T11:57:45.640338+0000","last_became_active":"2024-09-14T10:46:52.370107+0000","last_became_peered":"2024-09-14T10:46:52.370107+0000","last_unstale":"2024-09-14T11:57:45.640338+0000","last_undegraded":"2024-09-14T11:57:45.640338+0000","last_fullsized":"2024-09-14T11:57:45.640338+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:57.197530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"263'131","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.306974+0000","last_change":"2024-09-14T10:46:54.384319+0000","last_active":"2024-09-14T11:58:55.306974+0000","last_peered":"2024-09-14T11:58:55.306974+0000","last_clean":"2024-09-14T11:58:55.306974+0000","last_became_active":"2024-09-14T10:46:54.383813+0000","last_became_peered":"2024-09-14T10:46:54.383813+0000","last_unstale":"2024-09-14T11:58:55.306974+0000","last_undegraded":"2024-09-14T11:58:55.306974+0000","last_fullsized":"2024-09-14T11:58:55.306974+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:08.736115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":350,"num_read_kb":289,"num_write":327,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"263'150","reported_seq":710,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.932339+0000","last_change":"2024-09-14T10:46:54.384092+0000","last_active":"2024-09-14T11:59:34.932339+0000","last_peered":"2024-09-14T11:59:34.932339+0000","last_clean":"2024-09-14T11:59:34.932339+0000","last_became_active":"2024-09-14T10:46:54.383742+0000","last_became_peered":"2024-09-14T10:46:54.383742+0000","last_unstale":"2024-09-14T11:59:34.932339+0000","last_undegraded":"2024-09-14T11:59:34.932339+0000","last_fullsized":"2024-09-14T11:59:34.932339+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:33.936406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":212,"num_read_kb":210,"num_write":346,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"263'702","reported_seq":2554,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.142264+0000","last_change":"2024-09-14T10:46:46.338139+0000","last_active":"2024-09-14T12:00:51.142264+0000","last_peered":"2024-09-14T12:00:51.142264+0000","last_clean":"2024-09-14T12:00:51.142264+0000","last_became_active":"2024-09-14T10:46:46.337818+0000","last_became_peered":"2024-09-14T10:46:46.337818+0000","last_unstale":"2024-09-14T12:00:51.142264+0000","last_undegraded":"2024-09-14T12:00:51.142264+0000","last_fullsized":"2024-09-14T12:00:51.142264+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:18.147970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3744,"num_read_kb":3411,"num_write":893,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"263'332","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.317332+0000","last_change":"2024-09-14T10:46:44.335815+0000","last_active":"2024-09-14T12:01:19.317332+0000","last_peered":"2024-09-14T12:01:19.317332+0000","last_clean":"2024-09-14T12:01:19.317332+0000","last_became_active":"2024-09-14T10:46:44.332607+0000","last_became_peered":"2024-09-14T10:46:44.332607+0000","last_unstale":"2024-09-14T12:01:19.317332+0000","last_undegraded":"2024-09-14T12:01:19.317332+0000","last_fullsized":"2024-09-14T12:01:19.317332+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:51.020568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":554,"num_read_kb":15763,"num_write":1023,"num_write_kb":46520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.508136+0000","last_change":"2024-09-14T10:46:48.353763+0000","last_active":"2024-09-14T11:56:48.508136+0000","last_peered":"2024-09-14T11:56:48.508136+0000","last_clean":"2024-09-14T11:56:48.508136+0000","last_became_active":"2024-09-14T10:46:48.353125+0000","last_became_peered":"2024-09-14T10:46:48.353125+0000","last_unstale":"2024-09-14T11:56:48.508136+0000","last_undegraded":"2024-09-14T11:56:48.508136+0000","last_fullsized":"2024-09-14T11:56:48.508136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:13.807709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"263'335","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.352110+0000","last_change":"2024-09-14T10:46:50.365232+0000","last_active":"2024-09-14T12:01:18.352110+0000","last_peered":"2024-09-14T12:01:18.352110+0000","last_clean":"2024-09-14T12:01:18.352110+0000","last_became_active":"2024-09-14T10:46:50.364874+0000","last_became_peered":"2024-09-14T10:46:50.364874+0000","last_unstale":"2024-09-14T12:01:18.352110+0000","last_undegraded":"2024-09-14T12:01:18.352110+0000","last_fullsized":"2024-09-14T12:01:18.352110+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:43.130794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58887,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":550,"num_read_kb":1323,"num_write":450,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.434090+0000","last_change":"2024-09-14T10:46:52.374279+0000","last_active":"2024-09-14T11:56:55.434090+0000","last_peered":"2024-09-14T11:56:55.434090+0000","last_clean":"2024-09-14T11:56:55.434090+0000","last_became_active":"2024-09-14T10:46:52.373982+0000","last_became_peered":"2024-09-14T10:46:52.373982+0000","last_unstale":"2024-09-14T11:56:55.434090+0000","last_undegraded":"2024-09-14T11:56:55.434090+0000","last_fullsized":"2024-09-14T11:56:55.434090+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:41.838813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"263'117","reported_seq":613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.699014+0000","last_change":"2024-09-14T10:46:54.387894+0000","last_active":"2024-09-14T11:59:34.699014+0000","last_peered":"2024-09-14T11:59:34.699014+0000","last_clean":"2024-09-14T11:59:34.699014+0000","last_became_active":"2024-09-14T10:46:54.387552+0000","last_became_peered":"2024-09-14T10:46:54.387552+0000","last_unstale":"2024-09-14T11:59:34.699014+0000","last_undegraded":"2024-09-14T11:59:34.699014+0000","last_fullsized":"2024-09-14T11:59:34.699014+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:39.903611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":107,"num_write":284,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"263'405","reported_seq":1853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.140847+0000","last_change":"2024-09-14T10:46:46.348830+0000","last_active":"2024-09-14T12:00:51.140847+0000","last_peered":"2024-09-14T12:00:51.140847+0000","last_clean":"2024-09-14T12:00:51.140847+0000","last_became_active":"2024-09-14T10:46:46.348040+0000","last_became_peered":"2024-09-14T10:46:46.348040+0000","last_unstale":"2024-09-14T12:00:51.140847+0000","last_undegraded":"2024-09-14T12:00:51.140847+0000","last_fullsized":"2024-09-14T12:00:51.140847+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:14.154127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2178,"num_read_kb":2045,"num_write":462,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"263'336","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.328310+0000","last_change":"2024-09-14T10:46:44.333549+0000","last_active":"2024-09-14T12:01:19.328310+0000","last_peered":"2024-09-14T12:01:19.328310+0000","last_clean":"2024-09-14T12:01:19.328310+0000","last_became_active":"2024-09-14T10:46:44.333195+0000","last_became_peered":"2024-09-14T10:46:44.333195+0000","last_unstale":"2024-09-14T12:01:19.328310+0000","last_undegraded":"2024-09-14T12:01:19.328310+0000","last_fullsized":"2024-09-14T12:01:19.328310+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:18.381740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":77356,"num_write":1081,"num_write_kb":55140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.632326+0000","last_change":"2024-09-14T10:46:48.357298+0000","last_active":"2024-09-14T11:56:50.632326+0000","last_peered":"2024-09-14T11:56:50.632326+0000","last_clean":"2024-09-14T11:56:50.632326+0000","last_became_active":"2024-09-14T10:46:48.357033+0000","last_became_peered":"2024-09-14T10:46:48.357033+0000","last_unstale":"2024-09-14T11:56:50.632326+0000","last_undegraded":"2024-09-14T11:56:50.632326+0000","last_fullsized":"2024-09-14T11:56:50.632326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:02.877431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"263'63","reported_seq":576,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:37.053655+0000","last_change":"2024-09-14T10:46:50.363154+0000","last_active":"2024-09-14T11:57:37.053655+0000","last_peered":"2024-09-14T11:57:37.053655+0000","last_clean":"2024-09-14T11:57:37.053655+0000","last_became_active":"2024-09-14T10:46:50.362878+0000","last_became_peered":"2024-09-14T10:46:50.362878+0000","last_unstale":"2024-09-14T11:57:37.053655+0000","last_undegraded":"2024-09-14T11:57:37.053655+0000","last_fullsized":"2024-09-14T11:57:37.053655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:48.083949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.294045+0000","last_change":"2024-09-14T10:46:52.366285+0000","last_active":"2024-09-14T11:56:55.294045+0000","last_peered":"2024-09-14T11:56:55.294045+0000","last_clean":"2024-09-14T11:56:55.294045+0000","last_became_active":"2024-09-14T10:46:52.365987+0000","last_became_peered":"2024-09-14T10:46:52.365987+0000","last_unstale":"2024-09-14T11:56:55.294045+0000","last_undegraded":"2024-09-14T11:56:55.294045+0000","last_fullsized":"2024-09-14T11:56:55.294045+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:43.965292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"263'198","reported_seq":733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.608962+0000","last_change":"2024-09-14T10:46:54.383562+0000","last_active":"2024-09-14T11:59:33.608962+0000","last_peered":"2024-09-14T11:59:33.608962+0000","last_clean":"2024-09-14T11:59:33.608962+0000","last_became_active":"2024-09-14T10:46:54.383284+0000","last_became_peered":"2024-09-14T10:46:54.383284+0000","last_unstale":"2024-09-14T11:59:33.608962+0000","last_undegraded":"2024-09-14T11:59:33.608962+0000","last_fullsized":"2024-09-14T11:59:33.608962+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:22.704423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":348,"num_read_kb":326,"num_write":460,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"263'463","reported_seq":2089,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:51.553105+0000","last_change":"2024-09-14T10:46:46.341746+0000","last_active":"2024-09-14T11:57:51.553105+0000","last_peered":"2024-09-14T11:57:51.553105+0000","last_clean":"2024-09-14T11:57:51.553105+0000","last_became_active":"2024-09-14T10:46:46.341424+0000","last_became_peered":"2024-09-14T10:46:46.341424+0000","last_unstale":"2024-09-14T11:57:51.553105+0000","last_undegraded":"2024-09-14T11:57:51.553105+0000","last_fullsized":"2024-09-14T11:57:51.553105+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:09.296793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2571,"num_read_kb":2437,"num_write":538,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"263'326","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.370956+0000","last_change":"2024-09-14T10:46:44.322321+0000","last_active":"2024-09-14T12:01:19.370956+0000","last_peered":"2024-09-14T12:01:19.370956+0000","last_clean":"2024-09-14T12:01:19.370956+0000","last_became_active":"2024-09-14T10:46:44.321694+0000","last_became_peered":"2024-09-14T10:46:44.321694+0000","last_unstale":"2024-09-14T12:01:19.370956+0000","last_undegraded":"2024-09-14T12:01:19.370956+0000","last_fullsized":"2024-09-14T12:01:19.370956+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:00.511024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":535,"num_read_kb":12444,"num_write":977,"num_write_kb":13958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.293366+0000","last_change":"2024-09-14T10:46:48.351062+0000","last_active":"2024-09-14T11:56:50.293366+0000","last_peered":"2024-09-14T11:56:50.293366+0000","last_clean":"2024-09-14T11:56:50.293366+0000","last_became_active":"2024-09-14T10:46:48.350714+0000","last_became_peered":"2024-09-14T10:46:48.350714+0000","last_unstale":"2024-09-14T11:56:50.293366+0000","last_undegraded":"2024-09-14T11:56:50.293366+0000","last_fullsized":"2024-09-14T11:56:50.293366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:34.873720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"263'339","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.661096+0000","last_change":"2024-09-14T10:46:50.361153+0000","last_active":"2024-09-14T12:01:17.661096+0000","last_peered":"2024-09-14T12:01:17.661096+0000","last_clean":"2024-09-14T12:01:17.661096+0000","last_became_active":"2024-09-14T10:46:50.360886+0000","last_became_peered":"2024-09-14T10:46:50.360886+0000","last_unstale":"2024-09-14T12:01:17.661096+0000","last_undegraded":"2024-09-14T12:01:17.661096+0000","last_fullsized":"2024-09-14T12:01:17.661096+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:38.621371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50451,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":558,"num_read_kb":1238,"num_write":442,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.396137+0000","last_change":"2024-09-14T10:46:52.375402+0000","last_active":"2024-09-14T11:56:55.396137+0000","last_peered":"2024-09-14T11:56:55.396137+0000","last_clean":"2024-09-14T11:56:55.396137+0000","last_became_active":"2024-09-14T10:46:52.375120+0000","last_became_peered":"2024-09-14T10:46:52.375120+0000","last_unstale":"2024-09-14T11:56:55.396137+0000","last_undegraded":"2024-09-14T11:56:55.396137+0000","last_fullsized":"2024-09-14T11:56:55.396137+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:11.461786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"263'126","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.661848+0000","last_change":"2024-09-14T10:46:54.384403+0000","last_active":"2024-09-14T11:59:34.661848+0000","last_peered":"2024-09-14T11:59:34.661848+0000","last_clean":"2024-09-14T11:59:34.661848+0000","last_became_active":"2024-09-14T10:46:54.384113+0000","last_became_peered":"2024-09-14T10:46:54.384113+0000","last_unstale":"2024-09-14T11:59:34.661848+0000","last_undegraded":"2024-09-14T11:59:34.661848+0000","last_fullsized":"2024-09-14T11:59:34.661848+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:43.036020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":180,"num_read_kb":170,"num_write":302,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"263'376","reported_seq":2022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.915579+0000","last_change":"2024-09-14T10:46:46.346655+0000","last_active":"2024-09-14T11:58:23.915579+0000","last_peered":"2024-09-14T11:58:23.915579+0000","last_clean":"2024-09-14T11:58:23.915579+0000","last_became_active":"2024-09-14T10:46:46.346318+0000","last_became_peered":"2024-09-14T10:46:46.346318+0000","last_unstale":"2024-09-14T11:58:23.915579+0000","last_undegraded":"2024-09-14T11:58:23.915579+0000","last_fullsized":"2024-09-14T11:58:23.915579+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:49.199619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2319,"num_read_kb":2246,"num_write":412,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"263'384","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.450304+0000","last_change":"2024-09-14T10:46:44.333722+0000","last_active":"2024-09-14T12:01:18.450304+0000","last_peered":"2024-09-14T12:01:18.450304+0000","last_clean":"2024-09-14T12:01:18.450304+0000","last_became_active":"2024-09-14T10:46:44.332841+0000","last_became_peered":"2024-09-14T10:46:44.332841+0000","last_unstale":"2024-09-14T12:01:18.450304+0000","last_undegraded":"2024-09-14T12:01:18.450304+0000","last_fullsized":"2024-09-14T12:01:18.450304+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:52.405113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1590622,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":745,"num_read_kb":6861,"num_write":1406,"num_write_kb":25110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.518421+0000","last_change":"2024-09-14T10:46:48.353284+0000","last_active":"2024-09-14T11:56:50.518421+0000","last_peered":"2024-09-14T11:56:50.518421+0000","last_clean":"2024-09-14T11:56:50.518421+0000","last_became_active":"2024-09-14T10:46:48.353010+0000","last_became_peered":"2024-09-14T10:46:48.353010+0000","last_unstale":"2024-09-14T11:56:50.518421+0000","last_undegraded":"2024-09-14T11:56:50.518421+0000","last_fullsized":"2024-09-14T11:56:50.518421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:08.193075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"263'286","reported_seq":868,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.409390+0000","last_change":"2024-09-14T10:46:50.363596+0000","last_active":"2024-09-14T12:01:19.409390+0000","last_peered":"2024-09-14T12:01:19.409390+0000","last_clean":"2024-09-14T12:01:19.409390+0000","last_became_active":"2024-09-14T10:46:50.362723+0000","last_became_peered":"2024-09-14T10:46:50.362723+0000","last_unstale":"2024-09-14T12:01:19.409390+0000","last_undegraded":"2024-09-14T12:01:19.409390+0000","last_fullsized":"2024-09-14T12:01:19.409390+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:44.962512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44996,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":451,"num_read_kb":1030,"num_write":360,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.434159+0000","last_change":"2024-09-14T10:46:52.369320+0000","last_active":"2024-09-14T11:56:55.434159+0000","last_peered":"2024-09-14T11:56:55.434159+0000","last_clean":"2024-09-14T11:56:55.434159+0000","last_became_active":"2024-09-14T10:46:52.369048+0000","last_became_peered":"2024-09-14T10:46:52.369048+0000","last_unstale":"2024-09-14T11:56:55.434159+0000","last_undegraded":"2024-09-14T11:56:55.434159+0000","last_fullsized":"2024-09-14T11:56:55.434159+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:12.392541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"263'554","reported_seq":2332,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.143488+0000","last_change":"2024-09-14T10:46:46.349057+0000","last_active":"2024-09-14T12:00:51.143488+0000","last_peered":"2024-09-14T12:00:51.143488+0000","last_clean":"2024-09-14T12:00:51.143488+0000","last_became_active":"2024-09-14T10:46:46.348774+0000","last_became_peered":"2024-09-14T10:46:46.348774+0000","last_unstale":"2024-09-14T12:00:51.143488+0000","last_undegraded":"2024-09-14T12:00:51.143488+0000","last_fullsized":"2024-09-14T12:00:51.143488+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:39.288295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3189,"num_read_kb":2980,"num_write":657,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"263'374","reported_seq":1058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.415563+0000","last_change":"2024-09-14T10:46:44.335060+0000","last_active":"2024-09-14T12:01:18.415563+0000","last_peered":"2024-09-14T12:01:18.415563+0000","last_clean":"2024-09-14T12:01:18.415563+0000","last_became_active":"2024-09-14T10:46:44.334693+0000","last_became_peered":"2024-09-14T10:46:44.334693+0000","last_unstale":"2024-09-14T12:01:18.415563+0000","last_undegraded":"2024-09-14T12:01:18.415563+0000","last_fullsized":"2024-09-14T12:01:18.415563+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:35.652094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6947652,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":780,"num_read_kb":35701,"num_write":1225,"num_write_kb":25930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"38'3","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.196063+0000","last_change":"2024-09-14T10:46:48.350741+0000","last_active":"2024-09-14T12:01:17.196063+0000","last_peered":"2024-09-14T12:01:17.196063+0000","last_clean":"2024-09-14T12:01:17.196063+0000","last_became_active":"2024-09-14T10:46:48.350469+0000","last_became_peered":"2024-09-14T10:46:48.350469+0000","last_unstale":"2024-09-14T12:01:17.196063+0000","last_undegraded":"2024-09-14T12:01:17.196063+0000","last_fullsized":"2024-09-14T12:01:17.196063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:50.974578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"263'487","reported_seq":1117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.445763+0000","last_change":"2024-09-14T10:46:50.365772+0000","last_active":"2024-09-14T12:01:17.445763+0000","last_peered":"2024-09-14T12:01:17.445763+0000","last_clean":"2024-09-14T12:01:17.445763+0000","last_became_active":"2024-09-14T10:46:50.365486+0000","last_became_peered":"2024-09-14T10:46:50.365486+0000","last_unstale":"2024-09-14T12:01:17.445763+0000","last_undegraded":"2024-09-14T12:01:17.445763+0000","last_fullsized":"2024-09-14T12:01:17.445763+0000","mapping_epoch":32,"log_start":"263'400","ondisk_log_start":"263'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:08:39.304362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109358,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":865,"num_read_kb":1904,"num_write":748,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.294097+0000","last_change":"2024-09-14T10:46:52.372507+0000","last_active":"2024-09-14T11:56:55.294097+0000","last_peered":"2024-09-14T11:56:55.294097+0000","last_clean":"2024-09-14T11:56:55.294097+0000","last_became_active":"2024-09-14T10:46:52.372151+0000","last_became_peered":"2024-09-14T10:46:52.372151+0000","last_unstale":"2024-09-14T11:56:55.294097+0000","last_undegraded":"2024-09-14T11:56:55.294097+0000","last_fullsized":"2024-09-14T11:56:55.294097+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:35.607612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"263'205","reported_seq":716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.552966+0000","last_change":"2024-09-14T10:46:54.386817+0000","last_active":"2024-09-14T11:59:33.552966+0000","last_peered":"2024-09-14T11:59:33.552966+0000","last_clean":"2024-09-14T11:59:33.552966+0000","last_became_active":"2024-09-14T10:46:54.386525+0000","last_became_peered":"2024-09-14T10:46:54.386525+0000","last_unstale":"2024-09-14T11:59:33.552966+0000","last_undegraded":"2024-09-14T11:59:33.552966+0000","last_fullsized":"2024-09-14T11:59:33.552966+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:41.935098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":260,"num_read_kb":259,"num_write":474,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"263'415","reported_seq":2076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.500823+0000","last_change":"2024-09-14T10:46:46.342078+0000","last_active":"2024-09-14T11:59:49.500823+0000","last_peered":"2024-09-14T11:59:49.500823+0000","last_clean":"2024-09-14T11:59:49.500823+0000","last_became_active":"2024-09-14T10:46:46.341559+0000","last_became_peered":"2024-09-14T10:46:46.341559+0000","last_unstale":"2024-09-14T11:59:49.500823+0000","last_undegraded":"2024-09-14T11:59:49.500823+0000","last_fullsized":"2024-09-14T11:59:49.500823+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:25.649976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2371,"num_read_kb":2275,"num_write":467,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"263'282","reported_seq":929,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.283689+0000","last_change":"2024-09-14T10:46:44.320611+0000","last_active":"2024-09-14T12:01:19.283689+0000","last_peered":"2024-09-14T12:01:19.283689+0000","last_clean":"2024-09-14T12:01:19.283689+0000","last_became_active":"2024-09-14T10:46:44.319896+0000","last_became_peered":"2024-09-14T10:46:44.319896+0000","last_unstale":"2024-09-14T12:01:19.283689+0000","last_undegraded":"2024-09-14T12:01:19.283689+0000","last_fullsized":"2024-09-14T12:01:19.283689+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:43.510538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133682,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":524,"num_read_kb":94668,"num_write":900,"num_write_kb":37785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:40.298927+0000","last_change":"2024-09-14T10:46:48.355503+0000","last_active":"2024-09-14T11:57:40.298927+0000","last_peered":"2024-09-14T11:57:40.298927+0000","last_clean":"2024-09-14T11:57:40.298927+0000","last_became_active":"2024-09-14T10:46:48.355149+0000","last_became_peered":"2024-09-14T10:46:48.355149+0000","last_unstale":"2024-09-14T11:57:40.298927+0000","last_undegraded":"2024-09-14T11:57:40.298927+0000","last_fullsized":"2024-09-14T11:57:40.298927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:39.662714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"263'345","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.538027+0000","last_change":"2024-09-14T10:46:50.367103+0000","last_active":"2024-09-14T12:01:17.538027+0000","last_peered":"2024-09-14T12:01:17.538027+0000","last_clean":"2024-09-14T12:01:17.538027+0000","last_became_active":"2024-09-14T10:46:50.366749+0000","last_became_peered":"2024-09-14T10:46:50.366749+0000","last_unstale":"2024-09-14T12:01:17.538027+0000","last_undegraded":"2024-09-14T12:01:17.538027+0000","last_fullsized":"2024-09-14T12:01:17.538027+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:04.127284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49707,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":587,"num_read_kb":1269,"num_write":486,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.442435+0000","last_change":"2024-09-14T10:46:52.368766+0000","last_active":"2024-09-14T11:56:53.442435+0000","last_peered":"2024-09-14T11:56:53.442435+0000","last_clean":"2024-09-14T11:56:53.442435+0000","last_became_active":"2024-09-14T10:46:52.368508+0000","last_became_peered":"2024-09-14T10:46:52.368508+0000","last_unstale":"2024-09-14T11:56:53.442435+0000","last_undegraded":"2024-09-14T11:56:53.442435+0000","last_fullsized":"2024-09-14T11:56:53.442435+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:15.487064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"263'181","reported_seq":1057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.440714+0000","last_change":"2024-09-14T10:46:54.379236+0000","last_active":"2024-09-14T11:59:30.440714+0000","last_peered":"2024-09-14T11:59:30.440714+0000","last_clean":"2024-09-14T11:59:30.440714+0000","last_became_active":"2024-09-14T10:46:54.378938+0000","last_became_peered":"2024-09-14T10:46:54.378938+0000","last_unstale":"2024-09-14T11:59:30.440714+0000","last_undegraded":"2024-09-14T11:59:30.440714+0000","last_fullsized":"2024-09-14T11:59:30.440714+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:53.097947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2044,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":607,"num_read_kb":603,"num_write":505,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"263'637","reported_seq":2298,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.736746+0000","last_change":"2024-09-14T10:46:46.347640+0000","last_active":"2024-09-14T11:59:29.736746+0000","last_peered":"2024-09-14T11:59:29.736746+0000","last_clean":"2024-09-14T11:59:29.736746+0000","last_became_active":"2024-09-14T10:46:46.347362+0000","last_became_peered":"2024-09-14T10:46:46.347362+0000","last_unstale":"2024-09-14T11:59:29.736746+0000","last_undegraded":"2024-09-14T11:59:29.736746+0000","last_fullsized":"2024-09-14T11:59:29.736746+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":600,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:55.139779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3345,"num_read_kb":3056,"num_write":864,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"263'375","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.290468+0000","last_change":"2024-09-14T10:46:44.318782+0000","last_active":"2024-09-14T12:01:19.290468+0000","last_peered":"2024-09-14T12:01:19.290468+0000","last_clean":"2024-09-14T12:01:19.290468+0000","last_became_active":"2024-09-14T10:46:44.318099+0000","last_became_peered":"2024-09-14T10:46:44.318099+0000","last_unstale":"2024-09-14T12:01:19.290468+0000","last_undegraded":"2024-09-14T12:01:19.290468+0000","last_fullsized":"2024-09-14T12:01:19.290468+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:25.257513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133694,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":681,"num_read_kb":1685,"num_write":1259,"num_write_kb":36237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.293501+0000","last_change":"2024-09-14T10:46:48.350499+0000","last_active":"2024-09-14T11:56:50.293501+0000","last_peered":"2024-09-14T11:56:50.293501+0000","last_clean":"2024-09-14T11:56:50.293501+0000","last_became_active":"2024-09-14T10:46:48.350059+0000","last_became_peered":"2024-09-14T10:46:48.350059+0000","last_unstale":"2024-09-14T11:56:50.293501+0000","last_undegraded":"2024-09-14T11:56:50.293501+0000","last_fullsized":"2024-09-14T11:56:50.293501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:42.038929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"263'308","reported_seq":899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.526982+0000","last_change":"2024-09-14T10:46:50.365706+0000","last_active":"2024-09-14T12:01:18.526982+0000","last_peered":"2024-09-14T12:01:18.526982+0000","last_clean":"2024-09-14T12:01:18.526982+0000","last_became_active":"2024-09-14T10:46:50.365393+0000","last_became_peered":"2024-09-14T10:46:50.365393+0000","last_unstale":"2024-09-14T12:01:18.526982+0000","last_undegraded":"2024-09-14T12:01:18.526982+0000","last_fullsized":"2024-09-14T12:01:18.526982+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:00.491603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59332,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":502,"num_read_kb":1090,"num_write":403,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.453197+0000","last_change":"2024-09-14T10:46:52.373436+0000","last_active":"2024-09-14T11:59:10.453197+0000","last_peered":"2024-09-14T11:59:10.453197+0000","last_clean":"2024-09-14T11:59:10.453197+0000","last_became_active":"2024-09-14T10:46:52.373099+0000","last_became_peered":"2024-09-14T10:46:52.373099+0000","last_unstale":"2024-09-14T11:59:10.453197+0000","last_undegraded":"2024-09-14T11:59:10.453197+0000","last_fullsized":"2024-09-14T11:59:10.453197+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:41.461337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"263'143","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:52.308478+0000","last_change":"2024-09-14T10:46:54.385921+0000","last_active":"2024-09-14T12:00:52.308478+0000","last_peered":"2024-09-14T12:00:52.308478+0000","last_clean":"2024-09-14T12:00:52.308478+0000","last_became_active":"2024-09-14T10:46:54.385625+0000","last_became_peered":"2024-09-14T10:46:54.385625+0000","last_unstale":"2024-09-14T12:00:52.308478+0000","last_undegraded":"2024-09-14T12:00:52.308478+0000","last_fullsized":"2024-09-14T12:00:52.308478+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:00.984531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":790,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":228,"num_read_kb":197,"num_write":338,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"263'416","reported_seq":1957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.727179+0000","last_change":"2024-09-14T10:46:46.339137+0000","last_active":"2024-09-14T11:59:29.727179+0000","last_peered":"2024-09-14T11:59:29.727179+0000","last_clean":"2024-09-14T11:59:29.727179+0000","last_became_active":"2024-09-14T10:46:46.338551+0000","last_became_peered":"2024-09-14T10:46:46.338551+0000","last_unstale":"2024-09-14T11:59:29.727179+0000","last_undegraded":"2024-09-14T11:59:29.727179+0000","last_fullsized":"2024-09-14T11:59:29.727179+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:02.429002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2291,"num_read_kb":2170,"num_write":475,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"263'291","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.376172+0000","last_change":"2024-09-14T10:46:44.331964+0000","last_active":"2024-09-14T12:01:19.376172+0000","last_peered":"2024-09-14T12:01:19.376172+0000","last_clean":"2024-09-14T12:01:19.376172+0000","last_became_active":"2024-09-14T10:46:44.331660+0000","last_became_peered":"2024-09-14T10:46:44.331660+0000","last_unstale":"2024-09-14T12:01:19.376172+0000","last_undegraded":"2024-09-14T12:01:19.376172+0000","last_fullsized":"2024-09-14T12:01:19.376172+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:22.697298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":521,"num_read_kb":29638,"num_write":955,"num_write_kb":30451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.632361+0000","last_change":"2024-09-14T10:46:48.350417+0000","last_active":"2024-09-14T11:56:50.632361+0000","last_peered":"2024-09-14T11:56:50.632361+0000","last_clean":"2024-09-14T11:56:50.632361+0000","last_became_active":"2024-09-14T10:46:48.350072+0000","last_became_peered":"2024-09-14T10:46:48.350072+0000","last_unstale":"2024-09-14T11:56:50.632361+0000","last_undegraded":"2024-09-14T11:56:50.632361+0000","last_fullsized":"2024-09-14T11:56:50.632361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:34.764307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"263'125","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.533624+0000","last_change":"2024-09-14T10:46:50.368321+0000","last_active":"2024-09-14T11:58:55.533624+0000","last_peered":"2024-09-14T11:58:55.533624+0000","last_clean":"2024-09-14T11:58:55.533624+0000","last_became_active":"2024-09-14T10:46:50.367991+0000","last_became_peered":"2024-09-14T10:46:50.367991+0000","last_unstale":"2024-09-14T11:58:55.533624+0000","last_undegraded":"2024-09-14T11:58:55.533624+0000","last_fullsized":"2024-09-14T11:58:55.533624+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:39.918895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":126,"num_write":102,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"263'780","reported_seq":2687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.106488+0000","last_change":"2024-09-14T10:46:52.370832+0000","last_active":"2024-09-14T12:01:19.106488+0000","last_peered":"2024-09-14T12:01:19.106488+0000","last_clean":"2024-09-14T12:01:19.106488+0000","last_became_active":"2024-09-14T10:46:52.370446+0000","last_became_peered":"2024-09-14T10:46:52.370446+0000","last_unstale":"2024-09-14T12:01:19.106488+0000","last_undegraded":"2024-09-14T12:01:19.106488+0000","last_fullsized":"2024-09-14T12:01:19.106488+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:05.923305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"263'120","reported_seq":646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.519098+0000","last_change":"2024-09-14T10:46:54.378096+0000","last_active":"2024-09-14T11:56:55.519098+0000","last_peered":"2024-09-14T11:56:55.519098+0000","last_clean":"2024-09-14T11:56:55.519098+0000","last_became_active":"2024-09-14T10:46:54.377788+0000","last_became_peered":"2024-09-14T10:46:54.377788+0000","last_unstale":"2024-09-14T11:56:55.519098+0000","last_undegraded":"2024-09-14T11:56:55.519098+0000","last_fullsized":"2024-09-14T11:56:55.519098+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:20.522136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":221,"num_read_kb":193,"num_write":312,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"263'791","reported_seq":2334,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.734178+0000","last_change":"2024-09-14T10:46:46.352423+0000","last_active":"2024-09-14T11:59:29.734178+0000","last_peered":"2024-09-14T11:59:29.734178+0000","last_clean":"2024-09-14T11:59:29.734178+0000","last_became_active":"2024-09-14T10:46:46.352087+0000","last_became_peered":"2024-09-14T10:46:46.352087+0000","last_unstale":"2024-09-14T11:59:29.734178+0000","last_undegraded":"2024-09-14T11:59:29.734178+0000","last_fullsized":"2024-09-14T11:59:29.734178+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:12.501801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3891,"num_read_kb":3520,"num_write":1035,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"263'316","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.307559+0000","last_change":"2024-09-14T10:46:44.321112+0000","last_active":"2024-09-14T12:01:19.307559+0000","last_peered":"2024-09-14T12:01:19.307559+0000","last_clean":"2024-09-14T12:01:19.307559+0000","last_became_active":"2024-09-14T10:46:44.320689+0000","last_became_peered":"2024-09-14T10:46:44.320689+0000","last_unstale":"2024-09-14T12:01:19.307559+0000","last_undegraded":"2024-09-14T12:01:19.307559+0000","last_fullsized":"2024-09-14T12:01:19.307559+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:11.205586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":532,"num_read_kb":954,"num_write":1107,"num_write_kb":21144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.395545+0000","last_change":"2024-09-14T10:46:48.357357+0000","last_active":"2024-09-14T11:56:50.395545+0000","last_peered":"2024-09-14T11:56:50.395545+0000","last_clean":"2024-09-14T11:56:50.395545+0000","last_became_active":"2024-09-14T10:46:48.357024+0000","last_became_peered":"2024-09-14T10:46:48.357024+0000","last_unstale":"2024-09-14T11:56:50.395545+0000","last_undegraded":"2024-09-14T11:56:50.395545+0000","last_fullsized":"2024-09-14T11:56:50.395545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:57.501469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"263'378","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.928077+0000","last_change":"2024-09-14T10:46:50.362271+0000","last_active":"2024-09-14T12:01:18.928077+0000","last_peered":"2024-09-14T12:01:18.928077+0000","last_clean":"2024-09-14T12:01:18.928077+0000","last_became_active":"2024-09-14T10:46:50.361962+0000","last_became_peered":"2024-09-14T10:46:50.361962+0000","last_unstale":"2024-09-14T12:01:18.928077+0000","last_undegraded":"2024-09-14T12:01:18.928077+0000","last_fullsized":"2024-09-14T12:01:18.928077+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:52.644742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49011,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":601,"num_read_kb":1340,"num_write":486,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.633741+0000","last_change":"2024-09-14T10:46:52.369579+0000","last_active":"2024-09-14T11:57:00.633741+0000","last_peered":"2024-09-14T11:57:00.633741+0000","last_clean":"2024-09-14T11:57:00.633741+0000","last_became_active":"2024-09-14T10:46:52.369262+0000","last_became_peered":"2024-09-14T10:46:52.369262+0000","last_unstale":"2024-09-14T11:57:00.633741+0000","last_undegraded":"2024-09-14T11:57:00.633741+0000","last_fullsized":"2024-09-14T11:57:00.633741+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:35.807345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"263'147","reported_seq":659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.302488+0000","last_change":"2024-09-14T10:46:54.385691+0000","last_active":"2024-09-14T11:59:34.302488+0000","last_peered":"2024-09-14T11:59:34.302488+0000","last_clean":"2024-09-14T11:59:34.302488+0000","last_became_active":"2024-09-14T10:46:54.385235+0000","last_became_peered":"2024-09-14T10:46:54.385235+0000","last_unstale":"2024-09-14T11:59:34.302488+0000","last_undegraded":"2024-09-14T11:59:34.302488+0000","last_fullsized":"2024-09-14T11:59:34.302488+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:33.162523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":187,"num_write":368,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"263'748","reported_seq":2307,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.674695+0000","last_change":"2024-09-14T10:46:46.335431+0000","last_active":"2024-09-14T11:59:34.674695+0000","last_peered":"2024-09-14T11:59:34.674695+0000","last_clean":"2024-09-14T11:59:34.674695+0000","last_became_active":"2024-09-14T10:46:46.335112+0000","last_became_peered":"2024-09-14T10:46:46.335112+0000","last_unstale":"2024-09-14T11:59:34.674695+0000","last_undegraded":"2024-09-14T11:59:34.674695+0000","last_fullsized":"2024-09-14T11:59:34.674695+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:09.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3755,"num_read_kb":3425,"num_write":989,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"263'322","reported_seq":967,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.268474+0000","last_change":"2024-09-14T10:46:44.335176+0000","last_active":"2024-09-14T12:01:19.268474+0000","last_peered":"2024-09-14T12:01:19.268474+0000","last_clean":"2024-09-14T12:01:19.268474+0000","last_became_active":"2024-09-14T10:46:44.332130+0000","last_became_peered":"2024-09-14T10:46:44.332130+0000","last_unstale":"2024-09-14T12:01:19.268474+0000","last_undegraded":"2024-09-14T12:01:19.268474+0000","last_fullsized":"2024-09-14T12:01:19.268474+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:00.407801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":584,"num_read_kb":32074,"num_write":1014,"num_write_kb":20757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.293480+0000","last_change":"2024-09-14T10:46:48.354432+0000","last_active":"2024-09-14T11:56:50.293480+0000","last_peered":"2024-09-14T11:56:50.293480+0000","last_clean":"2024-09-14T11:56:50.293480+0000","last_became_active":"2024-09-14T10:46:48.354108+0000","last_became_peered":"2024-09-14T10:46:48.354108+0000","last_unstale":"2024-09-14T11:56:50.293480+0000","last_undegraded":"2024-09-14T11:56:50.293480+0000","last_fullsized":"2024-09-14T11:56:50.293480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:07.134782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"263'271","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.986296+0000","last_change":"2024-09-14T10:46:50.358462+0000","last_active":"2024-09-14T12:01:18.986296+0000","last_peered":"2024-09-14T12:01:18.986296+0000","last_clean":"2024-09-14T12:01:18.986296+0000","last_became_active":"2024-09-14T10:46:50.358186+0000","last_became_peered":"2024-09-14T10:46:50.358186+0000","last_unstale":"2024-09-14T12:01:18.986296+0000","last_undegraded":"2024-09-14T12:01:18.986296+0000","last_fullsized":"2024-09-14T12:01:18.986296+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:23.418101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46012,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":454,"num_read_kb":1061,"num_write":362,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:05.520539+0000","last_change":"2024-09-14T10:46:52.366046+0000","last_active":"2024-09-14T11:57:05.520539+0000","last_peered":"2024-09-14T11:57:05.520539+0000","last_clean":"2024-09-14T11:57:05.520539+0000","last_became_active":"2024-09-14T10:46:52.365736+0000","last_became_peered":"2024-09-14T10:46:52.365736+0000","last_unstale":"2024-09-14T11:57:05.520539+0000","last_undegraded":"2024-09-14T11:57:05.520539+0000","last_fullsized":"2024-09-14T11:57:05.520539+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:20.721132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"263'123","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.467272+0000","last_change":"2024-09-14T10:46:54.385215+0000","last_active":"2024-09-14T11:59:28.467272+0000","last_peered":"2024-09-14T11:59:28.467272+0000","last_clean":"2024-09-14T11:59:28.467272+0000","last_became_active":"2024-09-14T10:46:54.384303+0000","last_became_peered":"2024-09-14T10:46:54.384303+0000","last_unstale":"2024-09-14T11:59:28.467272+0000","last_undegraded":"2024-09-14T11:59:28.467272+0000","last_fullsized":"2024-09-14T11:59:28.467272+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:28.997409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":957,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":145,"num_write":281,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"263'378","reported_seq":1793,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:21.445410+0000","last_change":"2024-09-14T10:46:46.338858+0000","last_active":"2024-09-14T11:58:21.445410+0000","last_peered":"2024-09-14T11:58:21.445410+0000","last_clean":"2024-09-14T11:58:21.445410+0000","last_became_active":"2024-09-14T10:46:46.338518+0000","last_became_peered":"2024-09-14T10:46:46.338518+0000","last_unstale":"2024-09-14T11:58:21.445410+0000","last_undegraded":"2024-09-14T11:58:21.445410+0000","last_fullsized":"2024-09-14T11:58:21.445410+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:01.075539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2070,"num_read_kb":1951,"num_write":457,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"263'327","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.424856+0000","last_change":"2024-09-14T10:46:44.333207+0000","last_active":"2024-09-14T12:01:18.424856+0000","last_peered":"2024-09-14T12:01:18.424856+0000","last_clean":"2024-09-14T12:01:18.424856+0000","last_became_active":"2024-09-14T10:46:44.332852+0000","last_became_peered":"2024-09-14T10:46:44.332852+0000","last_unstale":"2024-09-14T12:01:18.424856+0000","last_undegraded":"2024-09-14T12:01:18.424856+0000","last_fullsized":"2024-09-14T12:01:18.424856+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:48.357394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244655,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":627,"num_read_kb":10749,"num_write":1185,"num_write_kb":43875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.396096+0000","last_change":"2024-09-14T10:46:48.355870+0000","last_active":"2024-09-14T11:56:55.396096+0000","last_peered":"2024-09-14T11:56:55.396096+0000","last_clean":"2024-09-14T11:56:55.396096+0000","last_became_active":"2024-09-14T10:46:48.355512+0000","last_became_peered":"2024-09-14T10:46:48.355512+0000","last_unstale":"2024-09-14T11:56:55.396096+0000","last_undegraded":"2024-09-14T11:56:55.396096+0000","last_fullsized":"2024-09-14T11:56:55.396096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:43.891041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"263'265","reported_seq":827,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.475186+0000","last_change":"2024-09-14T10:46:50.364736+0000","last_active":"2024-09-14T12:01:18.475186+0000","last_peered":"2024-09-14T12:01:18.475186+0000","last_clean":"2024-09-14T12:01:18.475186+0000","last_became_active":"2024-09-14T10:46:50.364420+0000","last_became_peered":"2024-09-14T10:46:50.364420+0000","last_unstale":"2024-09-14T12:01:18.475186+0000","last_undegraded":"2024-09-14T12:01:18.475186+0000","last_fullsized":"2024-09-14T12:01:18.475186+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:59.631655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45284,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":455,"num_read_kb":1165,"num_write":378,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.519191+0000","last_change":"2024-09-14T10:46:52.374194+0000","last_active":"2024-09-14T11:56:55.519191+0000","last_peered":"2024-09-14T11:56:55.519191+0000","last_clean":"2024-09-14T11:56:55.519191+0000","last_became_active":"2024-09-14T10:46:52.373913+0000","last_became_peered":"2024-09-14T10:46:52.373913+0000","last_unstale":"2024-09-14T11:56:55.519191+0000","last_undegraded":"2024-09-14T11:56:55.519191+0000","last_fullsized":"2024-09-14T11:56:55.519191+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:44.342253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"263'129","reported_seq":1230,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.354353+0000","last_change":"2024-09-14T10:46:54.383936+0000","last_active":"2024-09-14T11:59:30.354353+0000","last_peered":"2024-09-14T11:59:30.354353+0000","last_clean":"2024-09-14T11:59:30.354353+0000","last_became_active":"2024-09-14T10:46:54.383637+0000","last_became_peered":"2024-09-14T10:46:54.383637+0000","last_unstale":"2024-09-14T11:59:30.354353+0000","last_undegraded":"2024-09-14T11:59:30.354353+0000","last_fullsized":"2024-09-14T11:59:30.354353+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:19.327839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":738,"num_read_kb":738,"num_write":285,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"263'441","reported_seq":1899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.598287+0000","last_change":"2024-09-14T10:46:46.342570+0000","last_active":"2024-09-14T11:59:33.598287+0000","last_peered":"2024-09-14T11:59:33.598287+0000","last_clean":"2024-09-14T11:59:33.598287+0000","last_became_active":"2024-09-14T10:46:46.342299+0000","last_became_peered":"2024-09-14T10:46:46.342299+0000","last_unstale":"2024-09-14T11:59:33.598287+0000","last_undegraded":"2024-09-14T11:59:33.598287+0000","last_fullsized":"2024-09-14T11:59:33.598287+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:56.482166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2232,"num_read_kb":2089,"num_write":533,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"263'466","reported_seq":1218,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.379862+0000","last_change":"2024-09-14T10:46:44.321110+0000","last_active":"2024-09-14T12:01:18.379862+0000","last_peered":"2024-09-14T12:01:18.379862+0000","last_clean":"2024-09-14T12:01:18.379862+0000","last_became_active":"2024-09-14T10:46:44.320749+0000","last_became_peered":"2024-09-14T10:46:44.320749+0000","last_unstale":"2024-09-14T12:01:18.379862+0000","last_undegraded":"2024-09-14T12:01:18.379862+0000","last_fullsized":"2024-09-14T12:01:18.379862+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:58.570377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7815,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":1055,"num_read_kb":48118,"num_write":1484,"num_write_kb":57550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:10.635290+0000","last_change":"2024-09-14T10:46:48.353148+0000","last_active":"2024-09-14T11:57:10.635290+0000","last_peered":"2024-09-14T11:57:10.635290+0000","last_clean":"2024-09-14T11:57:10.635290+0000","last_became_active":"2024-09-14T10:46:48.352853+0000","last_became_peered":"2024-09-14T10:46:48.352853+0000","last_unstale":"2024-09-14T11:57:10.635290+0000","last_undegraded":"2024-09-14T11:57:10.635290+0000","last_fullsized":"2024-09-14T11:57:10.635290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:46.305353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"263'304","reported_seq":903,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.639297+0000","last_change":"2024-09-14T10:46:50.369781+0000","last_active":"2024-09-14T12:01:18.639297+0000","last_peered":"2024-09-14T12:01:18.639297+0000","last_clean":"2024-09-14T12:01:18.639297+0000","last_became_active":"2024-09-14T10:46:50.369492+0000","last_became_peered":"2024-09-14T10:46:50.369492+0000","last_unstale":"2024-09-14T12:01:18.639297+0000","last_undegraded":"2024-09-14T12:01:18.639297+0000","last_fullsized":"2024-09-14T12:01:18.639297+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:50.804436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49661,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":1034,"num_write":382,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.633068+0000","last_change":"2024-09-14T10:46:52.373456+0000","last_active":"2024-09-14T11:56:55.633068+0000","last_peered":"2024-09-14T11:56:55.633068+0000","last_clean":"2024-09-14T11:56:55.633068+0000","last_became_active":"2024-09-14T10:46:52.372108+0000","last_became_peered":"2024-09-14T10:46:52.372108+0000","last_unstale":"2024-09-14T11:56:55.633068+0000","last_undegraded":"2024-09-14T11:56:55.633068+0000","last_fullsized":"2024-09-14T11:56:55.633068+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:25.122029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"263'125","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.133558+0000","last_change":"2024-09-14T10:46:54.385169+0000","last_active":"2024-09-14T12:00:51.133558+0000","last_peered":"2024-09-14T12:00:51.133558+0000","last_clean":"2024-09-14T12:00:51.133558+0000","last_became_active":"2024-09-14T10:46:54.384278+0000","last_became_peered":"2024-09-14T10:46:54.384278+0000","last_unstale":"2024-09-14T12:00:51.133558+0000","last_undegraded":"2024-09-14T12:00:51.133558+0000","last_fullsized":"2024-09-14T12:00:51.133558+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:32.418655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":278,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"263'464","reported_seq":2034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.645877+0000","last_change":"2024-09-14T10:46:46.347263+0000","last_active":"2024-09-14T11:58:20.645877+0000","last_peered":"2024-09-14T11:58:20.645877+0000","last_clean":"2024-09-14T11:58:20.645877+0000","last_became_active":"2024-09-14T10:46:46.346994+0000","last_became_peered":"2024-09-14T10:46:46.346994+0000","last_unstale":"2024-09-14T11:58:20.645877+0000","last_undegraded":"2024-09-14T11:58:20.645877+0000","last_fullsized":"2024-09-14T11:58:20.645877+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:52.672214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2420,"num_read_kb":2273,"num_write":546,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"263'389","reported_seq":1145,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.365914+0000","last_change":"2024-09-14T10:46:44.329371+0000","last_active":"2024-09-14T12:01:19.365914+0000","last_peered":"2024-09-14T12:01:19.365914+0000","last_clean":"2024-09-14T12:01:19.365914+0000","last_became_active":"2024-09-14T10:46:44.328946+0000","last_became_peered":"2024-09-14T10:46:44.328946+0000","last_unstale":"2024-09-14T12:01:19.365914+0000","last_undegraded":"2024-09-14T12:01:19.365914+0000","last_fullsized":"2024-09-14T12:01:19.365914+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:41.337845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1017,"num_read_kb":28148,"num_write":1233,"num_write_kb":43814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"263'509","reported_seq":2191,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.915971+0000","last_change":"2024-09-14T10:46:46.343533+0000","last_active":"2024-09-14T11:58:23.915971+0000","last_peered":"2024-09-14T11:58:23.915971+0000","last_clean":"2024-09-14T11:58:23.915971+0000","last_became_active":"2024-09-14T10:46:46.343234+0000","last_became_peered":"2024-09-14T10:46:46.343234+0000","last_unstale":"2024-09-14T11:58:23.915971+0000","last_undegraded":"2024-09-14T11:58:23.915971+0000","last_fullsized":"2024-09-14T11:58:23.915971+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:10.850533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2663,"num_read_kb":2506,"num_write":583,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"263'344","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.370995+0000","last_change":"2024-09-14T10:46:44.317974+0000","last_active":"2024-09-14T12:01:19.370995+0000","last_peered":"2024-09-14T12:01:19.370995+0000","last_clean":"2024-09-14T12:01:19.370995+0000","last_became_active":"2024-09-14T10:46:44.317349+0000","last_became_peered":"2024-09-14T10:46:44.317349+0000","last_unstale":"2024-09-14T12:01:19.370995+0000","last_undegraded":"2024-09-14T12:01:19.370995+0000","last_fullsized":"2024-09-14T12:01:19.370995+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:49.115709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133675,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":5317,"num_write":990,"num_write_kb":25288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"263'447","reported_seq":1996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.498826+0000","last_change":"2024-09-14T10:46:46.347323+0000","last_active":"2024-09-14T11:59:49.498826+0000","last_peered":"2024-09-14T11:59:49.498826+0000","last_clean":"2024-09-14T11:59:49.498826+0000","last_became_active":"2024-09-14T10:46:46.346640+0000","last_became_peered":"2024-09-14T10:46:46.346640+0000","last_unstale":"2024-09-14T11:59:49.498826+0000","last_undegraded":"2024-09-14T11:59:49.498826+0000","last_fullsized":"2024-09-14T11:59:49.498826+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:33.703143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2347,"num_read_kb":2209,"num_write":542,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"263'346","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.403176+0000","last_change":"2024-09-14T10:46:44.328462+0000","last_active":"2024-09-14T12:01:19.403176+0000","last_peered":"2024-09-14T12:01:19.403176+0000","last_clean":"2024-09-14T12:01:19.403176+0000","last_became_active":"2024-09-14T10:46:44.328049+0000","last_became_peered":"2024-09-14T10:46:44.328049+0000","last_unstale":"2024-09-14T12:01:19.403176+0000","last_undegraded":"2024-09-14T12:01:19.403176+0000","last_fullsized":"2024-09-14T12:01:19.403176+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:12.916156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":619,"num_read_kb":2326,"num_write":1082,"num_write_kb":13442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"263'933","reported_seq":2731,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.707652+0000","last_change":"2024-09-14T10:46:46.349041+0000","last_active":"2024-09-14T11:59:34.707652+0000","last_peered":"2024-09-14T11:59:34.707652+0000","last_clean":"2024-09-14T11:59:34.707652+0000","last_became_active":"2024-09-14T10:46:46.346682+0000","last_became_peered":"2024-09-14T10:46:46.346682+0000","last_unstale":"2024-09-14T11:59:34.707652+0000","last_undegraded":"2024-09-14T11:59:34.707652+0000","last_fullsized":"2024-09-14T11:59:34.707652+0000","mapping_epoch":28,"log_start":"263'900","ondisk_log_start":"263'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":900,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:46.804415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4656,"num_read_kb":4197,"num_write":1246,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"263'355","reported_seq":1033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.422474+0000","last_change":"2024-09-14T10:47:19.040942+0000","last_active":"2024-09-14T12:01:18.422474+0000","last_peered":"2024-09-14T12:01:18.422474+0000","last_clean":"2024-09-14T12:01:18.422474+0000","last_became_active":"2024-09-14T10:47:19.040453+0000","last_became_peered":"2024-09-14T10:47:19.040453+0000","last_unstale":"2024-09-14T12:01:18.422474+0000","last_undegraded":"2024-09-14T12:01:18.422474+0000","last_fullsized":"2024-09-14T12:01:18.422474+0000","mapping_epoch":39,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:33.248100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12673081,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":677,"num_read_kb":25388,"num_write":1151,"num_write_kb":37274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"263'507","reported_seq":2207,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.152468+0000","last_change":"2024-09-14T10:46:46.349718+0000","last_active":"2024-09-14T11:58:46.152468+0000","last_peered":"2024-09-14T11:58:46.152468+0000","last_clean":"2024-09-14T11:58:46.152468+0000","last_became_active":"2024-09-14T10:46:46.349465+0000","last_became_peered":"2024-09-14T10:46:46.349465+0000","last_unstale":"2024-09-14T11:58:46.152468+0000","last_undegraded":"2024-09-14T11:58:46.152468+0000","last_fullsized":"2024-09-14T11:58:46.152468+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:17.558471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2847,"num_read_kb":2662,"num_write":617,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"263'310","reported_seq":1018,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.433682+0000","last_change":"2024-09-14T10:46:44.320591+0000","last_active":"2024-09-14T12:01:18.433682+0000","last_peered":"2024-09-14T12:01:18.433682+0000","last_clean":"2024-09-14T12:01:18.433682+0000","last_became_active":"2024-09-14T10:46:44.320218+0000","last_became_peered":"2024-09-14T10:46:44.320218+0000","last_unstale":"2024-09-14T12:01:18.433682+0000","last_undegraded":"2024-09-14T12:01:18.433682+0000","last_fullsized":"2024-09-14T12:01:18.433682+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:23.505336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245238,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":839,"num_read_kb":10863,"num_write":1100,"num_write_kb":35921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"263'436","reported_seq":2109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.916554+0000","last_change":"2024-09-14T10:46:46.342492+0000","last_active":"2024-09-14T11:58:23.916554+0000","last_peered":"2024-09-14T11:58:23.916554+0000","last_clean":"2024-09-14T11:58:23.916554+0000","last_became_active":"2024-09-14T10:46:46.342206+0000","last_became_peered":"2024-09-14T10:46:46.342206+0000","last_unstale":"2024-09-14T11:58:23.916554+0000","last_undegraded":"2024-09-14T11:58:23.916554+0000","last_fullsized":"2024-09-14T11:58:23.916554+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:44.468754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2469,"num_read_kb":2360,"num_write":494,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"263'437","reported_seq":1119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.517316+0000","last_change":"2024-09-14T10:46:44.314850+0000","last_active":"2024-09-14T12:01:18.517316+0000","last_peered":"2024-09-14T12:01:18.517316+0000","last_clean":"2024-09-14T12:01:18.517316+0000","last_became_active":"2024-09-14T10:46:44.314466+0000","last_became_peered":"2024-09-14T10:46:44.314466+0000","last_unstale":"2024-09-14T12:01:18.517316+0000","last_undegraded":"2024-09-14T12:01:18.517316+0000","last_fullsized":"2024-09-14T12:01:18.517316+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:39.202894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1528286,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":900,"num_read_kb":16042,"num_write":1216,"num_write_kb":34508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"263'667","reported_seq":2288,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.136829+0000","last_change":"2024-09-14T10:46:46.342488+0000","last_active":"2024-09-14T12:00:51.136829+0000","last_peered":"2024-09-14T12:00:51.136829+0000","last_clean":"2024-09-14T12:00:51.136829+0000","last_became_active":"2024-09-14T10:46:46.342217+0000","last_became_peered":"2024-09-14T10:46:46.342217+0000","last_unstale":"2024-09-14T12:00:51.136829+0000","last_undegraded":"2024-09-14T12:00:51.136829+0000","last_fullsized":"2024-09-14T12:00:51.136829+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":600,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:03.054708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3344,"num_read_kb":3009,"num_write":894,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"263'322","reported_seq":1064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.397645+0000","last_change":"2024-09-14T10:46:44.324067+0000","last_active":"2024-09-14T12:01:19.397645+0000","last_peered":"2024-09-14T12:01:19.397645+0000","last_clean":"2024-09-14T12:01:19.397645+0000","last_became_active":"2024-09-14T10:46:44.323339+0000","last_became_peered":"2024-09-14T10:46:44.323339+0000","last_unstale":"2024-09-14T12:01:19.397645+0000","last_undegraded":"2024-09-14T12:01:19.397645+0000","last_fullsized":"2024-09-14T12:01:19.397645+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:50.726091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":616,"num_read_kb":14372,"num_write":932,"num_write_kb":14595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'444","reported_seq":1976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.351227+0000","last_change":"2024-09-14T10:46:46.341986+0000","last_active":"2024-09-14T11:58:44.351227+0000","last_peered":"2024-09-14T11:58:44.351227+0000","last_clean":"2024-09-14T11:58:44.351227+0000","last_became_active":"2024-09-14T10:46:46.341731+0000","last_became_peered":"2024-09-14T10:46:46.341731+0000","last_unstale":"2024-09-14T11:58:44.351227+0000","last_undegraded":"2024-09-14T11:58:44.351227+0000","last_fullsized":"2024-09-14T11:58:44.351227+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:05.674327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2390,"num_read_kb":2239,"num_write":538,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"263'341","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.377267+0000","last_change":"2024-09-14T10:46:44.321933+0000","last_active":"2024-09-14T12:01:18.377267+0000","last_peered":"2024-09-14T12:01:18.377267+0000","last_clean":"2024-09-14T12:01:18.377267+0000","last_became_active":"2024-09-14T10:46:44.321604+0000","last_became_peered":"2024-09-14T10:46:44.321604+0000","last_unstale":"2024-09-14T12:01:18.377267+0000","last_undegraded":"2024-09-14T12:01:18.377267+0000","last_fullsized":"2024-09-14T12:01:18.377267+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:42.964237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243315,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":759,"num_read_kb":33590,"num_write":1210,"num_write_kb":22096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"263'970","reported_seq":2678,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.915612+0000","last_change":"2024-09-14T10:46:46.336853+0000","last_active":"2024-09-14T11:58:23.915612+0000","last_peered":"2024-09-14T11:58:23.915612+0000","last_clean":"2024-09-14T11:58:23.915612+0000","last_became_active":"2024-09-14T10:46:46.336508+0000","last_became_peered":"2024-09-14T10:46:46.336508+0000","last_unstale":"2024-09-14T11:58:23.915612+0000","last_undegraded":"2024-09-14T11:58:23.915612+0000","last_fullsized":"2024-09-14T11:58:23.915612+0000","mapping_epoch":28,"log_start":"263'900","ondisk_log_start":"263'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":900,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:08.953818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4671,"num_read_kb":4174,"num_write":1327,"num_write_kb":556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"263'317","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.346999+0000","last_change":"2024-09-14T10:46:44.321413+0000","last_active":"2024-09-14T12:01:19.346999+0000","last_peered":"2024-09-14T12:01:19.346999+0000","last_clean":"2024-09-14T12:01:19.346999+0000","last_became_active":"2024-09-14T10:46:44.321073+0000","last_became_peered":"2024-09-14T10:46:44.321073+0000","last_unstale":"2024-09-14T12:01:19.346999+0000","last_undegraded":"2024-09-14T12:01:19.346999+0000","last_fullsized":"2024-09-14T12:01:19.346999+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:02.410131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":672,"num_read_kb":7284,"num_write":1109,"num_write_kb":7346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"263'352","reported_seq":1803,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.683411+0000","last_change":"2024-09-14T10:46:46.343853+0000","last_active":"2024-09-14T11:59:34.683411+0000","last_peered":"2024-09-14T11:59:34.683411+0000","last_clean":"2024-09-14T11:59:34.683411+0000","last_became_active":"2024-09-14T10:46:46.341188+0000","last_became_peered":"2024-09-14T10:46:46.341188+0000","last_unstale":"2024-09-14T11:59:34.683411+0000","last_undegraded":"2024-09-14T11:59:34.683411+0000","last_fullsized":"2024-09-14T11:59:34.683411+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:55.124703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1965,"num_read_kb":1883,"num_write":389,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"263'360","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.372729+0000","last_change":"2024-09-14T10:46:44.316977+0000","last_active":"2024-09-14T12:01:18.372729+0000","last_peered":"2024-09-14T12:01:18.372729+0000","last_clean":"2024-09-14T12:01:18.372729+0000","last_became_active":"2024-09-14T10:46:44.316633+0000","last_became_peered":"2024-09-14T10:46:44.316633+0000","last_unstale":"2024-09-14T12:01:18.372729+0000","last_undegraded":"2024-09-14T12:01:18.372729+0000","last_fullsized":"2024-09-14T12:01:18.372729+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:02.290580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289618,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":754,"num_read_kb":2329,"num_write":1185,"num_write_kb":27267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"263'778","reported_seq":2432,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.462116+0000","last_change":"2024-09-14T10:46:46.348188+0000","last_active":"2024-09-14T11:58:58.462116+0000","last_peered":"2024-09-14T11:58:58.462116+0000","last_clean":"2024-09-14T11:58:58.462116+0000","last_became_active":"2024-09-14T10:46:46.347941+0000","last_became_peered":"2024-09-14T10:46:46.347941+0000","last_unstale":"2024-09-14T11:58:58.462116+0000","last_undegraded":"2024-09-14T11:58:58.462116+0000","last_fullsized":"2024-09-14T11:58:58.462116+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:09.760195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3936,"num_read_kb":3604,"num_write":1011,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"263'350","reported_seq":1112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.269823+0000","last_change":"2024-09-14T10:46:44.322513+0000","last_active":"2024-09-14T12:01:19.269823+0000","last_peered":"2024-09-14T12:01:19.269823+0000","last_clean":"2024-09-14T12:01:19.269823+0000","last_became_active":"2024-09-14T10:46:44.322149+0000","last_became_peered":"2024-09-14T10:46:44.322149+0000","last_unstale":"2024-09-14T12:01:19.269823+0000","last_undegraded":"2024-09-14T12:01:19.269823+0000","last_fullsized":"2024-09-14T12:01:19.269823+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:02.597943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":929,"num_read_kb":38620,"num_write":1197,"num_write_kb":16629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"263'788","reported_seq":2341,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.709237+0000","last_change":"2024-09-14T10:46:46.340742+0000","last_active":"2024-09-14T11:59:34.709237+0000","last_peered":"2024-09-14T11:59:34.709237+0000","last_clean":"2024-09-14T11:59:34.709237+0000","last_became_active":"2024-09-14T10:46:46.340475+0000","last_became_peered":"2024-09-14T10:46:46.340475+0000","last_unstale":"2024-09-14T11:59:34.709237+0000","last_undegraded":"2024-09-14T11:59:34.709237+0000","last_fullsized":"2024-09-14T11:59:34.709237+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:20.835262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3820,"num_read_kb":3456,"num_write":1020,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"263'314","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.308236+0000","last_change":"2024-09-14T10:46:44.329821+0000","last_active":"2024-09-14T12:01:19.308236+0000","last_peered":"2024-09-14T12:01:19.308236+0000","last_clean":"2024-09-14T12:01:19.308236+0000","last_became_active":"2024-09-14T10:46:44.329386+0000","last_became_peered":"2024-09-14T10:46:44.329386+0000","last_unstale":"2024-09-14T12:01:19.308236+0000","last_undegraded":"2024-09-14T12:01:19.308236+0000","last_fullsized":"2024-09-14T12:01:19.308236+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:52.796065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133721,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":628,"num_read_kb":13742,"num_write":1168,"num_write_kb":24265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"263'489","reported_seq":2188,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.408190+0000","last_change":"2024-09-14T10:46:46.351572+0000","last_active":"2024-09-14T11:58:50.408190+0000","last_peered":"2024-09-14T11:58:50.408190+0000","last_clean":"2024-09-14T11:58:50.408190+0000","last_became_active":"2024-09-14T10:46:46.351291+0000","last_became_peered":"2024-09-14T10:46:46.351291+0000","last_unstale":"2024-09-14T11:58:50.408190+0000","last_undegraded":"2024-09-14T11:58:50.408190+0000","last_fullsized":"2024-09-14T11:58:50.408190+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:43.260116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2678,"num_read_kb":2537,"num_write":593,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"263'343","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.341847+0000","last_change":"2024-09-14T10:46:44.329049+0000","last_active":"2024-09-14T12:01:19.341847+0000","last_peered":"2024-09-14T12:01:19.341847+0000","last_clean":"2024-09-14T12:01:19.341847+0000","last_became_active":"2024-09-14T10:46:44.328509+0000","last_became_peered":"2024-09-14T10:46:44.328509+0000","last_unstale":"2024-09-14T12:01:19.341847+0000","last_undegraded":"2024-09-14T12:01:19.341847+0000","last_fullsized":"2024-09-14T12:01:19.341847+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:39.663145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":629,"num_read_kb":8535,"num_write":1026,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"263'630","reported_seq":2305,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.706431+0000","last_change":"2024-09-14T10:46:46.343531+0000","last_active":"2024-09-14T11:59:34.706431+0000","last_peered":"2024-09-14T11:59:34.706431+0000","last_clean":"2024-09-14T11:59:34.706431+0000","last_became_active":"2024-09-14T10:46:46.343264+0000","last_became_peered":"2024-09-14T10:46:46.343264+0000","last_unstale":"2024-09-14T11:59:34.706431+0000","last_undegraded":"2024-09-14T11:59:34.706431+0000","last_fullsized":"2024-09-14T11:59:34.706431+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":600,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:52.794216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3383,"num_read_kb":3097,"num_write":846,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"263'340","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.364856+0000","last_change":"2024-09-14T10:46:44.335536+0000","last_active":"2024-09-14T12:01:19.364856+0000","last_peered":"2024-09-14T12:01:19.364856+0000","last_clean":"2024-09-14T12:01:19.364856+0000","last_became_active":"2024-09-14T10:46:44.334832+0000","last_became_peered":"2024-09-14T10:46:44.334832+0000","last_unstale":"2024-09-14T12:01:19.364856+0000","last_undegraded":"2024-09-14T12:01:19.364856+0000","last_fullsized":"2024-09-14T12:01:19.364856+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:03.288996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":614,"num_read_kb":31835,"num_write":1126,"num_write_kb":37799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"263'1869","reported_seq":3527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.599717+0000","last_change":"2024-09-14T10:46:46.345486+0000","last_active":"2024-09-14T11:59:33.599717+0000","last_peered":"2024-09-14T11:59:33.599717+0000","last_clean":"2024-09-14T11:59:33.599717+0000","last_became_active":"2024-09-14T10:46:46.344246+0000","last_became_peered":"2024-09-14T10:46:46.344246+0000","last_unstale":"2024-09-14T11:59:33.599717+0000","last_undegraded":"2024-09-14T11:59:33.599717+0000","last_fullsized":"2024-09-14T11:59:33.599717+0000","mapping_epoch":28,"log_start":"263'1800","ondisk_log_start":"263'1800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":1800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:37.648855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8234,"num_read_kb":7178,"num_write":2635,"num_write_kb":1169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"263'380","reported_seq":1025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.382847+0000","last_change":"2024-09-14T10:46:44.331913+0000","last_active":"2024-09-14T12:01:19.382847+0000","last_peered":"2024-09-14T12:01:19.382847+0000","last_clean":"2024-09-14T12:01:19.382847+0000","last_became_active":"2024-09-14T10:46:44.331468+0000","last_became_peered":"2024-09-14T10:46:44.331468+0000","last_unstale":"2024-09-14T12:01:19.382847+0000","last_undegraded":"2024-09-14T12:01:19.382847+0000","last_fullsized":"2024-09-14T12:01:19.382847+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:38.672416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":628,"num_read_kb":40986,"num_write":1142,"num_write_kb":50458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"263'596","reported_seq":2253,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.601844+0000","last_change":"2024-09-14T10:46:46.351650+0000","last_active":"2024-09-14T11:59:33.601844+0000","last_peered":"2024-09-14T11:59:33.601844+0000","last_clean":"2024-09-14T11:59:33.601844+0000","last_became_active":"2024-09-14T10:46:46.351379+0000","last_became_peered":"2024-09-14T10:46:46.351379+0000","last_unstale":"2024-09-14T11:59:33.601844+0000","last_undegraded":"2024-09-14T11:59:33.601844+0000","last_fullsized":"2024-09-14T11:59:33.601844+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:18.174017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3319,"num_read_kb":3081,"num_write":803,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"263'383","reported_seq":1100,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.439929+0000","last_change":"2024-09-14T10:47:18.421792+0000","last_active":"2024-09-14T12:01:18.439929+0000","last_peered":"2024-09-14T12:01:18.439929+0000","last_clean":"2024-09-14T12:01:18.439929+0000","last_became_active":"2024-09-14T10:47:18.421420+0000","last_became_peered":"2024-09-14T10:47:18.421420+0000","last_unstale":"2024-09-14T12:01:18.439929+0000","last_undegraded":"2024-09-14T12:01:18.439929+0000","last_fullsized":"2024-09-14T12:01:18.439929+0000","mapping_epoch":39,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:05.879273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":336,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":980,"num_read_kb":55242,"num_write":1350,"num_write_kb":21886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.30","version":"263'358","reported_seq":1059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.397325+0000","last_change":"2024-09-14T10:46:44.336725+0000","last_active":"2024-09-14T12:01:19.397325+0000","last_peered":"2024-09-14T12:01:19.397325+0000","last_clean":"2024-09-14T12:01:19.397325+0000","last_became_active":"2024-09-14T10:46:44.336397+0000","last_became_peered":"2024-09-14T10:46:44.336397+0000","last_unstale":"2024-09-14T12:01:19.397325+0000","last_undegraded":"2024-09-14T12:01:19.397325+0000","last_fullsized":"2024-09-14T12:01:19.397325+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:23.868126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":768,"num_read_kb":58312,"num_write":1211,"num_write_kb":50973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"263'436","reported_seq":2121,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.706348+0000","last_change":"2024-09-14T10:46:46.352747+0000","last_active":"2024-09-14T11:59:34.706348+0000","last_peered":"2024-09-14T11:59:34.706348+0000","last_clean":"2024-09-14T11:59:34.706348+0000","last_became_active":"2024-09-14T10:46:46.352396+0000","last_became_peered":"2024-09-14T10:46:46.352396+0000","last_unstale":"2024-09-14T11:59:34.706348+0000","last_undegraded":"2024-09-14T11:59:34.706348+0000","last_fullsized":"2024-09-14T11:59:34.706348+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:53.050193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2667,"num_read_kb":2535,"num_write":508,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"263'266","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.471594+0000","last_change":"2024-09-14T10:46:44.331837+0000","last_active":"2024-09-14T12:01:18.471594+0000","last_peered":"2024-09-14T12:01:18.471594+0000","last_clean":"2024-09-14T12:01:18.471594+0000","last_became_active":"2024-09-14T10:46:44.331494+0000","last_became_peered":"2024-09-14T10:46:44.331494+0000","last_unstale":"2024-09-14T12:01:18.471594+0000","last_undegraded":"2024-09-14T12:01:18.471594+0000","last_fullsized":"2024-09-14T12:01:18.471594+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:39.194351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6293269,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":443,"num_read_kb":43363,"num_write":875,"num_write_kb":33511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"263'471","reported_seq":1972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.221996+0000","last_change":"2024-09-14T10:46:46.339727+0000","last_active":"2024-09-14T11:58:15.221996+0000","last_peered":"2024-09-14T11:58:15.221996+0000","last_clean":"2024-09-14T11:58:15.221996+0000","last_became_active":"2024-09-14T10:46:46.339440+0000","last_became_peered":"2024-09-14T10:46:46.339440+0000","last_unstale":"2024-09-14T11:58:15.221996+0000","last_undegraded":"2024-09-14T11:58:15.221996+0000","last_fullsized":"2024-09-14T11:58:15.221996+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:46.085936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2508,"num_read_kb":2330,"num_write":579,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9256,"num_read_kb":6632,"num_write":2794,"num_write_kb":850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":943,"ondisk_log_size":943,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15505,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":15201,"num_read_kb":14853,"num_write":17064,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1688,"ondisk_log_size":1688,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":553,"ondisk_log_size":553,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1584090,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":19094,"num_read_kb":39420,"num_write":16012,"num_write_kb":12069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":708608,"data_stored":398694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2048,"ondisk_log_size":2048,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2425,"num_read_kb":2892,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":218145,"num_read_kb":199614,"num_write":55573,"num_write_kb":18950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3985,"ondisk_log_size":3985,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":122326437,"num_objects":937,"num_object_clones":0,"num_object_copies":2811,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":937,"num_whiteouts":0,"num_read":43610,"num_read_kb":1895594,"num_write":71043,"num_write_kb":2068626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":149217280,"data_stored":149217280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3454,"ondisk_log_size":3454,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":184539,"num_write":157,"num_write_kb":126109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":184485,"num_write":156,"num_write_kb":126109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16883712,"data_stored":16878134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510346,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":225200,"kb_used_data":9252,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":94146640,"statfs":{"total":96636764160,"available":96406159360,"internally_reserved":0,"allocated":9474048,"data_stored":7497795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":220920266},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510345,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":205276,"kb_used_data":11472,"kb_used_omap":1,"kb_used_meta":193534,"kb_avail":94166564,"statfs":{"total":96636764160,"available":96426561536,"internally_reserved":0,"allocated":11747328,"data_stored":9764047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":198179269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510345,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244176,"kb_used_data":14176,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94127664,"statfs":{"total":96636764160,"available":96386727936,"internally_reserved":0,"allocated":14516224,"data_stored":12527301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510345,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127500,"kb_used_data":10092,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94244340,"statfs":{"total":96636764160,"available":96506204160,"internally_reserved":0,"allocated":10334208,"data_stored":8364267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510344,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320452,"kb_used_data":10084,"kb_used_omap":1,"kb_used_meta":310206,"kb_avail":94051388,"statfs":{"total":96636764160,"available":96308621312,"internally_reserved":0,"allocated":10326016,"data_stored":8344841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":317651397},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510344,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112212,"kb_used_data":8700,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94259628,"statfs":{"total":96636764160,"available":96521859072,"internally_reserved":0,"allocated":8908800,"data_stored":6901467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543047,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":207532,"kb_used_data":100060,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94164308,"statfs":{"total":96636764160,"available":96424251392,"internally_reserved":0,"allocated":102461440,"data_stored":100416148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":110033351},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575753,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329420,"kb_used_data":63416,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94042420,"statfs":{"total":96636764160,"available":96299438080,"internally_reserved":0,"allocated":64937984,"data_stored":62923853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4694016,"data_stored":4694016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5550080,"data_stored":5550080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6160384,"data_stored":6160384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10321920,"data_stored":10321920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7557120,"data_stored":7557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":56639488,"data_stored":56639488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53002240,"data_stored":53002240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5292032,"data_stored":5292032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":214710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":178450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":50459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16830464,"data_stored":16827675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:01:21.216 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:01:21.566 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T12:01:21.577 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-14T12:01:21.578 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":2504,"stamp":"2024-09-14T12:01:21.023965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":124568671,"num_objects":1403,"num_object_clones":0,"num_object_copies":3743,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1403,"num_whiteouts":0,"num_read":308080,"num_read_kb":2528096,"num_write":162942,"num_write_kb":2359352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12957,"ondisk_log_size":12957,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1771768,"kb_used_data":227252,"kb_used_omap":12,"kb_used_meta":1543027,"kb_avail":753202952,"statfs":{"total":773094113280,"available":771279822848,"internally_reserved":0,"allocated":232706048,"data_stored":216739719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1580060209},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-527746617,"num_objects":-3442,"num_object_clones":0,"num_object_copies":-10289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3442,"num_whiteouts":0,"num_read":3881,"num_read_kb":3690,"num_write":3667,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005158"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.599297+0000","last_change":"2024-09-14T11:25:20.213046+0000","last_active":"2024-09-14T11:57:50.599297+0000","last_peered":"2024-09-14T11:57:50.599297+0000","last_clean":"2024-09-14T11:57:50.599297+0000","last_became_active":"2024-09-14T11:25:20.212282+0000","last_became_peered":"2024-09-14T11:25:20.212282+0000","last_unstale":"2024-09-14T11:57:50.599297+0000","last_undegraded":"2024-09-14T11:57:50.599297+0000","last_fullsized":"2024-09-14T11:57:50.599297+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:37.717916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"263'3","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.412622+0000","last_change":"2024-09-14T11:06:45.982990+0000","last_active":"2024-09-14T11:59:15.412622+0000","last_peered":"2024-09-14T11:59:15.412622+0000","last_clean":"2024-09-14T11:59:15.412622+0000","last_became_active":"2024-09-14T11:06:45.982702+0000","last_became_peered":"2024-09-14T11:06:45.982702+0000","last_unstale":"2024-09-14T11:59:15.412622+0000","last_undegraded":"2024-09-14T11:59:15.412622+0000","last_fullsized":"2024-09-14T11:59:15.412622+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:59.949376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.432607+0000","last_change":"2024-09-14T11:06:41.918549+0000","last_active":"2024-09-14T11:56:45.432607+0000","last_peered":"2024-09-14T11:56:45.432607+0000","last_clean":"2024-09-14T11:56:45.432607+0000","last_became_active":"2024-09-14T11:06:41.918259+0000","last_became_peered":"2024-09-14T11:06:41.918259+0000","last_unstale":"2024-09-14T11:56:45.432607+0000","last_undegraded":"2024-09-14T11:56:45.432607+0000","last_fullsized":"2024-09-14T11:56:45.432607+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:55.907181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'53","reported_seq":204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.650174+0000","last_change":"2024-09-14T11:02:34.872954+0000","last_active":"2024-09-14T11:58:50.650174+0000","last_peered":"2024-09-14T11:58:50.650174+0000","last_clean":"2024-09-14T11:58:50.650174+0000","last_became_active":"2024-09-14T11:02:34.872682+0000","last_became_peered":"2024-09-14T11:02:34.872682+0000","last_unstale":"2024-09-14T11:58:50.650174+0000","last_undegraded":"2024-09-14T11:58:50.650174+0000","last_fullsized":"2024-09-14T11:58:50.650174+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:01.174737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":419,"num_read_kb":273,"num_write":133,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:53.517430+0000","last_change":"2024-09-14T11:25:20.206920+0000","last_active":"2024-09-14T11:57:53.517430+0000","last_peered":"2024-09-14T11:57:53.517430+0000","last_clean":"2024-09-14T11:57:53.517430+0000","last_became_active":"2024-09-14T11:25:20.206601+0000","last_became_peered":"2024-09-14T11:25:20.206601+0000","last_unstale":"2024-09-14T11:57:53.517430+0000","last_undegraded":"2024-09-14T11:57:53.517430+0000","last_fullsized":"2024-09-14T11:57:53.517430+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:13.234370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"263'13","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.153862+0000","last_change":"2024-09-14T11:06:45.992917+0000","last_active":"2024-09-14T12:01:18.153862+0000","last_peered":"2024-09-14T12:01:18.153862+0000","last_clean":"2024-09-14T12:01:18.153862+0000","last_became_active":"2024-09-14T11:06:45.992612+0000","last_became_peered":"2024-09-14T11:06:45.992612+0000","last_unstale":"2024-09-14T12:01:18.153862+0000","last_undegraded":"2024-09-14T12:01:18.153862+0000","last_fullsized":"2024-09-14T12:01:18.153862+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:36.001623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13883,"num_write":28,"num_write_kb":14907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"263'3","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.464704+0000","last_change":"2024-09-14T11:06:41.912107+0000","last_active":"2024-09-14T11:59:13.464704+0000","last_peered":"2024-09-14T11:59:13.464704+0000","last_clean":"2024-09-14T11:59:13.464704+0000","last_became_active":"2024-09-14T11:06:41.911807+0000","last_became_peered":"2024-09-14T11:06:41.911807+0000","last_unstale":"2024-09-14T11:59:13.464704+0000","last_undegraded":"2024-09-14T11:59:13.464704+0000","last_fullsized":"2024-09-14T11:59:13.464704+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:55.009953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":621,"num_write":3,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"263'41","reported_seq":172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.650153+0000","last_change":"2024-09-14T11:02:34.879623+0000","last_active":"2024-09-14T11:58:50.650153+0000","last_peered":"2024-09-14T11:58:50.650153+0000","last_clean":"2024-09-14T11:58:50.650153+0000","last_became_active":"2024-09-14T11:02:34.879272+0000","last_became_peered":"2024-09-14T11:02:34.879272+0000","last_unstale":"2024-09-14T11:58:50.650153+0000","last_undegraded":"2024-09-14T11:58:50.650153+0000","last_fullsized":"2024-09-14T11:58:50.650153+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:46.038847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":323,"num_read_kb":209,"num_write":113,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.394943+0000","last_change":"2024-09-14T11:25:20.207542+0000","last_active":"2024-09-14T11:56:45.394943+0000","last_peered":"2024-09-14T11:56:45.394943+0000","last_clean":"2024-09-14T11:56:45.394943+0000","last_became_active":"2024-09-14T11:25:20.207226+0000","last_became_peered":"2024-09-14T11:25:20.207226+0000","last_unstale":"2024-09-14T11:56:45.394943+0000","last_undegraded":"2024-09-14T11:56:45.394943+0000","last_fullsized":"2024-09-14T11:56:45.394943+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:55.365914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.461362+0000","last_change":"2024-09-14T11:06:45.981984+0000","last_active":"2024-09-14T11:58:53.461362+0000","last_peered":"2024-09-14T11:58:53.461362+0000","last_clean":"2024-09-14T11:58:53.461362+0000","last_became_active":"2024-09-14T11:06:45.981705+0000","last_became_peered":"2024-09-14T11:06:45.981705+0000","last_unstale":"2024-09-14T11:58:53.461362+0000","last_undegraded":"2024-09-14T11:58:53.461362+0000","last_fullsized":"2024-09-14T11:58:53.461362+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:53.066712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.450843+0000","last_change":"2024-09-14T11:06:41.918237+0000","last_active":"2024-09-14T11:58:55.450843+0000","last_peered":"2024-09-14T11:58:55.450843+0000","last_clean":"2024-09-14T11:58:55.450843+0000","last_became_active":"2024-09-14T11:06:41.917774+0000","last_became_peered":"2024-09-14T11:06:41.917774+0000","last_unstale":"2024-09-14T11:58:55.450843+0000","last_undegraded":"2024-09-14T11:58:55.450843+0000","last_fullsized":"2024-09-14T11:58:55.450843+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:42.986789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'20","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:38.515232+0000","last_change":"2024-09-14T11:02:34.875159+0000","last_active":"2024-09-14T11:57:38.515232+0000","last_peered":"2024-09-14T11:57:38.515232+0000","last_clean":"2024-09-14T11:57:38.515232+0000","last_became_active":"2024-09-14T11:02:34.874685+0000","last_became_peered":"2024-09-14T11:02:34.874685+0000","last_unstale":"2024-09-14T11:57:38.515232+0000","last_undegraded":"2024-09-14T11:57:38.515232+0000","last_fullsized":"2024-09-14T11:57:38.515232+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:21.593031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":99,"num_write":50,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.442366+0000","last_change":"2024-09-14T11:25:20.211504+0000","last_active":"2024-09-14T11:56:53.442366+0000","last_peered":"2024-09-14T11:56:53.442366+0000","last_clean":"2024-09-14T11:56:53.442366+0000","last_became_active":"2024-09-14T11:25:20.211190+0000","last_became_peered":"2024-09-14T11:25:20.211190+0000","last_unstale":"2024-09-14T11:56:53.442366+0000","last_undegraded":"2024-09-14T11:56:53.442366+0000","last_fullsized":"2024-09-14T11:56:53.442366+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:02.921907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"263'7","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:58.480804+0000","last_change":"2024-09-14T11:06:45.980127+0000","last_active":"2024-09-14T12:00:58.480804+0000","last_peered":"2024-09-14T12:00:58.480804+0000","last_clean":"2024-09-14T12:00:58.480804+0000","last_became_active":"2024-09-14T11:06:45.979801+0000","last_became_peered":"2024-09-14T11:06:45.979801+0000","last_unstale":"2024-09-14T12:00:58.480804+0000","last_undegraded":"2024-09-14T12:00:58.480804+0000","last_fullsized":"2024-09-14T12:00:58.480804+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:14.264168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"263'5","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.481620+0000","last_change":"2024-09-14T11:06:41.905310+0000","last_active":"2024-09-14T12:01:17.481620+0000","last_peered":"2024-09-14T12:01:17.481620+0000","last_clean":"2024-09-14T12:01:17.481620+0000","last_became_active":"2024-09-14T11:06:41.905007+0000","last_became_peered":"2024-09-14T11:06:41.905007+0000","last_unstale":"2024-09-14T12:01:17.481620+0000","last_undegraded":"2024-09-14T12:01:17.481620+0000","last_fullsized":"2024-09-14T12:01:17.481620+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:37.875569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'31","reported_seq":132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:38.515217+0000","last_change":"2024-09-14T11:02:34.873370+0000","last_active":"2024-09-14T11:57:38.515217+0000","last_peered":"2024-09-14T11:57:38.515217+0000","last_clean":"2024-09-14T11:57:38.515217+0000","last_became_active":"2024-09-14T11:02:34.873091+0000","last_became_peered":"2024-09-14T11:02:34.873091+0000","last_unstale":"2024-09-14T11:57:38.515217+0000","last_undegraded":"2024-09-14T11:57:38.515217+0000","last_fullsized":"2024-09-14T11:57:38.515217+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:05.952366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":154,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:25.438215+0000","last_change":"2024-09-14T11:25:20.213420+0000","last_active":"2024-09-14T11:57:25.438215+0000","last_peered":"2024-09-14T11:57:25.438215+0000","last_clean":"2024-09-14T11:57:25.438215+0000","last_became_active":"2024-09-14T11:25:20.213064+0000","last_became_peered":"2024-09-14T11:25:20.213064+0000","last_unstale":"2024-09-14T11:57:25.438215+0000","last_undegraded":"2024-09-14T11:57:25.438215+0000","last_fullsized":"2024-09-14T11:57:25.438215+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:55.006063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"263'7","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:55.612856+0000","last_change":"2024-09-14T11:06:45.982348+0000","last_active":"2024-09-14T11:59:55.612856+0000","last_peered":"2024-09-14T11:59:55.612856+0000","last_clean":"2024-09-14T11:59:55.612856+0000","last_became_active":"2024-09-14T11:06:45.977225+0000","last_became_peered":"2024-09-14T11:06:45.977225+0000","last_unstale":"2024-09-14T11:59:55.612856+0000","last_undegraded":"2024-09-14T11:59:55.612856+0000","last_fullsized":"2024-09-14T11:59:55.612856+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:19.723203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20490,"num_write":7,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.447928+0000","last_change":"2024-09-14T11:06:41.916297+0000","last_active":"2024-09-14T11:57:28.447928+0000","last_peered":"2024-09-14T11:57:28.447928+0000","last_clean":"2024-09-14T11:57:28.447928+0000","last_became_active":"2024-09-14T11:06:41.916037+0000","last_became_peered":"2024-09-14T11:06:41.916037+0000","last_unstale":"2024-09-14T11:57:28.447928+0000","last_undegraded":"2024-09-14T11:57:28.447928+0000","last_fullsized":"2024-09-14T11:57:28.447928+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:36.838054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"263'6","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:38.515163+0000","last_change":"2024-09-14T11:02:34.878852+0000","last_active":"2024-09-14T11:57:38.515163+0000","last_peered":"2024-09-14T11:57:38.515163+0000","last_clean":"2024-09-14T11:57:38.515163+0000","last_became_active":"2024-09-14T11:02:34.878477+0000","last_became_peered":"2024-09-14T11:02:34.878477+0000","last_unstale":"2024-09-14T11:57:38.515163+0000","last_undegraded":"2024-09-14T11:57:38.515163+0000","last_fullsized":"2024-09-14T11:57:38.515163+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:50.190261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.648824+0000","last_change":"2024-09-14T11:25:20.211103+0000","last_active":"2024-09-14T11:58:40.648824+0000","last_peered":"2024-09-14T11:58:40.648824+0000","last_clean":"2024-09-14T11:58:40.648824+0000","last_became_active":"2024-09-14T11:25:20.210841+0000","last_became_peered":"2024-09-14T11:25:20.210841+0000","last_unstale":"2024-09-14T11:58:40.648824+0000","last_undegraded":"2024-09-14T11:58:40.648824+0000","last_fullsized":"2024-09-14T11:58:40.648824+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:22.472173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"260'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:30.523488+0000","last_change":"2024-09-14T11:06:45.992541+0000","last_active":"2024-09-14T11:57:30.523488+0000","last_peered":"2024-09-14T11:57:30.523488+0000","last_clean":"2024-09-14T11:57:30.523488+0000","last_became_active":"2024-09-14T11:06:45.992046+0000","last_became_peered":"2024-09-14T11:06:45.992046+0000","last_unstale":"2024-09-14T11:57:30.523488+0000","last_undegraded":"2024-09-14T11:57:30.523488+0000","last_fullsized":"2024-09-14T11:57:30.523488+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:54.123557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:35.524118+0000","last_change":"2024-09-14T11:06:41.909618+0000","last_active":"2024-09-14T11:57:35.524118+0000","last_peered":"2024-09-14T11:57:35.524118+0000","last_clean":"2024-09-14T11:57:35.524118+0000","last_became_active":"2024-09-14T11:06:41.909310+0000","last_became_peered":"2024-09-14T11:06:41.909310+0000","last_unstale":"2024-09-14T11:57:35.524118+0000","last_undegraded":"2024-09-14T11:57:35.524118+0000","last_fullsized":"2024-09-14T11:57:35.524118+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:36.988586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"263'17","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:35.298310+0000","last_change":"2024-09-14T11:02:34.879155+0000","last_active":"2024-09-14T11:57:35.298310+0000","last_peered":"2024-09-14T11:57:35.298310+0000","last_clean":"2024-09-14T11:57:35.298310+0000","last_became_active":"2024-09-14T11:02:34.878859+0000","last_became_peered":"2024-09-14T11:02:34.878859+0000","last_unstale":"2024-09-14T11:57:35.298310+0000","last_undegraded":"2024-09-14T11:57:35.298310+0000","last_fullsized":"2024-09-14T11:57:35.298310+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:06.717501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":82,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.300187+0000","last_change":"2024-09-14T11:25:20.214123+0000","last_active":"2024-09-14T11:57:50.300187+0000","last_peered":"2024-09-14T11:57:50.300187+0000","last_clean":"2024-09-14T11:57:50.300187+0000","last_became_active":"2024-09-14T11:25:20.213540+0000","last_became_peered":"2024-09-14T11:25:20.213540+0000","last_unstale":"2024-09-14T11:57:50.300187+0000","last_undegraded":"2024-09-14T11:57:50.300187+0000","last_fullsized":"2024-09-14T11:57:50.300187+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:22.650940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"260'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.292797+0000","last_change":"2024-09-14T11:06:45.986594+0000","last_active":"2024-09-14T11:56:45.292797+0000","last_peered":"2024-09-14T11:56:45.292797+0000","last_clean":"2024-09-14T11:56:45.292797+0000","last_became_active":"2024-09-14T11:06:45.984536+0000","last_became_peered":"2024-09-14T11:06:45.984536+0000","last_unstale":"2024-09-14T11:56:45.292797+0000","last_undegraded":"2024-09-14T11:56:45.292797+0000","last_fullsized":"2024-09-14T11:56:45.292797+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:50.142830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.592674+0000","last_change":"2024-09-14T11:06:41.917589+0000","last_active":"2024-09-14T11:56:45.592674+0000","last_peered":"2024-09-14T11:56:45.592674+0000","last_clean":"2024-09-14T11:56:45.592674+0000","last_became_active":"2024-09-14T11:06:41.917297+0000","last_became_peered":"2024-09-14T11:06:41.917297+0000","last_unstale":"2024-09-14T11:56:45.592674+0000","last_undegraded":"2024-09-14T11:56:45.592674+0000","last_fullsized":"2024-09-14T11:56:45.592674+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:24.720580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"260'21","reported_seq":118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.445641+0000","last_change":"2024-09-14T11:02:34.877058+0000","last_active":"2024-09-14T11:58:20.445641+0000","last_peered":"2024-09-14T11:58:20.445641+0000","last_clean":"2024-09-14T11:58:20.445641+0000","last_became_active":"2024-09-14T11:02:34.876726+0000","last_became_peered":"2024-09-14T11:02:34.876726+0000","last_unstale":"2024-09-14T11:58:20.445641+0000","last_undegraded":"2024-09-14T11:58:20.445641+0000","last_fullsized":"2024-09-14T11:58:20.445641+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:13.228297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":116,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.599347+0000","last_change":"2024-09-14T11:25:20.214842+0000","last_active":"2024-09-14T11:57:50.599347+0000","last_peered":"2024-09-14T11:57:50.599347+0000","last_clean":"2024-09-14T11:57:50.599347+0000","last_became_active":"2024-09-14T11:25:20.214475+0000","last_became_peered":"2024-09-14T11:25:20.214475+0000","last_unstale":"2024-09-14T11:57:50.599347+0000","last_undegraded":"2024-09-14T11:57:50.599347+0000","last_fullsized":"2024-09-14T11:57:50.599347+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:56.001599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.432562+0000","last_change":"2024-09-14T11:06:45.990723+0000","last_active":"2024-09-14T11:56:45.432562+0000","last_peered":"2024-09-14T11:56:45.432562+0000","last_clean":"2024-09-14T11:56:45.432562+0000","last_became_active":"2024-09-14T11:06:45.990419+0000","last_became_peered":"2024-09-14T11:06:45.990419+0000","last_unstale":"2024-09-14T11:56:45.432562+0000","last_undegraded":"2024-09-14T11:56:45.432562+0000","last_fullsized":"2024-09-14T11:56:45.432562+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:12.253426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"260'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.507306+0000","last_change":"2024-09-14T11:06:41.911568+0000","last_active":"2024-09-14T11:56:43.507306+0000","last_peered":"2024-09-14T11:56:43.507306+0000","last_clean":"2024-09-14T11:56:43.507306+0000","last_became_active":"2024-09-14T11:06:41.910694+0000","last_became_peered":"2024-09-14T11:06:41.910694+0000","last_unstale":"2024-09-14T11:56:43.507306+0000","last_undegraded":"2024-09-14T11:56:43.507306+0000","last_fullsized":"2024-09-14T11:56:43.507306+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:38.517703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"263'21","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:13.520593+0000","last_change":"2024-09-14T11:02:34.873098+0000","last_active":"2024-09-14T11:58:13.520593+0000","last_peered":"2024-09-14T11:58:13.520593+0000","last_clean":"2024-09-14T11:58:13.520593+0000","last_became_active":"2024-09-14T11:02:34.872803+0000","last_became_peered":"2024-09-14T11:02:34.872803+0000","last_unstale":"2024-09-14T11:58:13.520593+0000","last_undegraded":"2024-09-14T11:58:13.520593+0000","last_fullsized":"2024-09-14T11:58:13.520593+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:22.434265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":102,"num_write":56,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:03.453145+0000","last_change":"2024-09-14T11:25:20.208606+0000","last_active":"2024-09-14T11:58:03.453145+0000","last_peered":"2024-09-14T11:58:03.453145+0000","last_clean":"2024-09-14T11:58:03.453145+0000","last_became_active":"2024-09-14T11:25:20.207780+0000","last_became_peered":"2024-09-14T11:25:20.207780+0000","last_unstale":"2024-09-14T11:58:03.453145+0000","last_undegraded":"2024-09-14T11:58:03.453145+0000","last_fullsized":"2024-09-14T11:58:03.453145+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:39.802914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"263'9","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.358375+0000","last_change":"2024-09-14T11:06:45.992867+0000","last_active":"2024-09-14T12:01:18.358375+0000","last_peered":"2024-09-14T12:01:18.358375+0000","last_clean":"2024-09-14T12:01:18.358375+0000","last_became_active":"2024-09-14T11:06:45.992208+0000","last_became_peered":"2024-09-14T11:06:45.992208+0000","last_unstale":"2024-09-14T12:01:18.358375+0000","last_undegraded":"2024-09-14T12:01:18.358375+0000","last_fullsized":"2024-09-14T12:01:18.358375+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:21.488237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":17408,"num_write":14,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"263'8","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:30.546211+0000","last_change":"2024-09-14T11:06:41.915462+0000","last_active":"2024-09-14T12:00:30.546211+0000","last_peered":"2024-09-14T12:00:30.546211+0000","last_clean":"2024-09-14T12:00:30.546211+0000","last_became_active":"2024-09-14T11:06:41.915173+0000","last_became_peered":"2024-09-14T11:06:41.915173+0000","last_unstale":"2024-09-14T12:00:30.546211+0000","last_undegraded":"2024-09-14T12:00:30.546211+0000","last_fullsized":"2024-09-14T12:00:30.546211+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:30.823550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10242,"num_write":13,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"263'15","reported_seq":94,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:10.644198+0000","last_change":"2024-09-14T11:02:34.867951+0000","last_active":"2024-09-14T11:58:10.644198+0000","last_peered":"2024-09-14T11:58:10.644198+0000","last_clean":"2024-09-14T11:58:10.644198+0000","last_became_active":"2024-09-14T11:02:34.867669+0000","last_became_peered":"2024-09-14T11:02:34.867669+0000","last_unstale":"2024-09-14T11:58:10.644198+0000","last_undegraded":"2024-09-14T11:58:10.644198+0000","last_fullsized":"2024-09-14T11:58:10.644198+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:05.093113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":79,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:03.519056+0000","last_change":"2024-09-14T11:25:20.210078+0000","last_active":"2024-09-14T11:58:03.519056+0000","last_peered":"2024-09-14T11:58:03.519056+0000","last_clean":"2024-09-14T11:58:03.519056+0000","last_became_active":"2024-09-14T11:25:20.209801+0000","last_became_peered":"2024-09-14T11:25:20.209801+0000","last_unstale":"2024-09-14T11:58:03.519056+0000","last_undegraded":"2024-09-14T11:58:03.519056+0000","last_fullsized":"2024-09-14T11:58:03.519056+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:20.540163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:18.455327+0000","last_change":"2024-09-14T11:06:45.990540+0000","last_active":"2024-09-14T11:58:18.455327+0000","last_peered":"2024-09-14T11:58:18.455327+0000","last_clean":"2024-09-14T11:58:18.455327+0000","last_became_active":"2024-09-14T11:06:45.990093+0000","last_became_peered":"2024-09-14T11:06:45.990093+0000","last_unstale":"2024-09-14T11:58:18.455327+0000","last_undegraded":"2024-09-14T11:58:18.455327+0000","last_fullsized":"2024-09-14T11:58:18.455327+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:20.070813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"263'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.604354+0000","last_change":"2024-09-14T11:06:41.913660+0000","last_active":"2024-09-14T12:01:17.604354+0000","last_peered":"2024-09-14T12:01:17.604354+0000","last_clean":"2024-09-14T12:01:17.604354+0000","last_became_active":"2024-09-14T11:06:41.913330+0000","last_became_peered":"2024-09-14T11:06:41.913330+0000","last_unstale":"2024-09-14T12:01:17.604354+0000","last_undegraded":"2024-09-14T12:01:17.604354+0000","last_fullsized":"2024-09-14T12:01:17.604354+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:02.767092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"263'51","reported_seq":192,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:10.644171+0000","last_change":"2024-09-14T11:02:34.879784+0000","last_active":"2024-09-14T11:58:10.644171+0000","last_peered":"2024-09-14T11:58:10.644171+0000","last_clean":"2024-09-14T11:58:10.644171+0000","last_became_active":"2024-09-14T11:02:34.879480+0000","last_became_peered":"2024-09-14T11:02:34.879480+0000","last_unstale":"2024-09-14T11:58:10.644171+0000","last_undegraded":"2024-09-14T11:58:10.644171+0000","last_fullsized":"2024-09-14T11:58:10.644171+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:26.792769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":249,"num_write":134,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:00.301161+0000","last_change":"2024-09-14T11:25:20.208545+0000","last_active":"2024-09-14T11:58:00.301161+0000","last_peered":"2024-09-14T11:58:00.301161+0000","last_clean":"2024-09-14T11:58:00.301161+0000","last_became_active":"2024-09-14T11:25:20.208253+0000","last_became_peered":"2024-09-14T11:25:20.208253+0000","last_unstale":"2024-09-14T11:58:00.301161+0000","last_undegraded":"2024-09-14T11:58:00.301161+0000","last_fullsized":"2024-09-14T11:58:00.301161+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:46.409317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:30.439086+0000","last_change":"2024-09-14T11:06:45.986563+0000","last_active":"2024-09-14T11:57:30.439086+0000","last_peered":"2024-09-14T11:57:30.439086+0000","last_clean":"2024-09-14T11:57:30.439086+0000","last_became_active":"2024-09-14T11:06:45.986268+0000","last_became_peered":"2024-09-14T11:06:45.986268+0000","last_unstale":"2024-09-14T11:57:30.439086+0000","last_undegraded":"2024-09-14T11:57:30.439086+0000","last_fullsized":"2024-09-14T11:57:30.439086+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:57.096459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.287810+0000","last_change":"2024-09-14T11:06:41.919231+0000","last_active":"2024-09-14T12:01:18.287810+0000","last_peered":"2024-09-14T12:01:18.287810+0000","last_clean":"2024-09-14T12:01:18.287810+0000","last_became_active":"2024-09-14T11:06:41.918902+0000","last_became_peered":"2024-09-14T11:06:41.918902+0000","last_unstale":"2024-09-14T12:01:18.287810+0000","last_undegraded":"2024-09-14T12:01:18.287810+0000","last_fullsized":"2024-09-14T12:01:18.287810+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:28.218893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"263'3","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:10.444411+0000","last_change":"2024-09-14T11:02:34.877942+0000","last_active":"2024-09-14T11:58:10.444411+0000","last_peered":"2024-09-14T11:58:10.444411+0000","last_clean":"2024-09-14T11:58:10.444411+0000","last_became_active":"2024-09-14T11:02:34.877623+0000","last_became_peered":"2024-09-14T11:02:34.877623+0000","last_unstale":"2024-09-14T11:58:10.444411+0000","last_undegraded":"2024-09-14T11:58:10.444411+0000","last_fullsized":"2024-09-14T11:58:10.444411+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:37.635532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:00.600265+0000","last_change":"2024-09-14T11:25:20.208685+0000","last_active":"2024-09-14T11:58:00.600265+0000","last_peered":"2024-09-14T11:58:00.600265+0000","last_clean":"2024-09-14T11:58:00.600265+0000","last_became_active":"2024-09-14T11:25:20.208411+0000","last_became_peered":"2024-09-14T11:25:20.208411+0000","last_unstale":"2024-09-14T11:58:00.600265+0000","last_undegraded":"2024-09-14T11:58:00.600265+0000","last_fullsized":"2024-09-14T11:58:00.600265+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:34.443942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:30.597082+0000","last_change":"2024-09-14T11:06:45.978750+0000","last_active":"2024-09-14T11:57:30.597082+0000","last_peered":"2024-09-14T11:57:30.597082+0000","last_clean":"2024-09-14T11:57:30.597082+0000","last_became_active":"2024-09-14T11:06:45.978458+0000","last_became_peered":"2024-09-14T11:06:45.978458+0000","last_unstale":"2024-09-14T11:57:30.597082+0000","last_undegraded":"2024-09-14T11:57:30.597082+0000","last_fullsized":"2024-09-14T11:57:30.597082+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:52.428245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:53.471119+0000","last_change":"2024-09-14T11:06:41.916068+0000","last_active":"2024-09-14T11:59:53.471119+0000","last_peered":"2024-09-14T11:59:53.471119+0000","last_clean":"2024-09-14T11:59:53.471119+0000","last_became_active":"2024-09-14T11:06:41.915795+0000","last_became_peered":"2024-09-14T11:06:41.915795+0000","last_unstale":"2024-09-14T11:59:53.471119+0000","last_undegraded":"2024-09-14T11:59:53.471119+0000","last_fullsized":"2024-09-14T11:59:53.471119+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:10.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"263'20","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.531842+0000","last_change":"2024-09-14T11:02:34.881678+0000","last_active":"2024-09-14T11:58:40.531842+0000","last_peered":"2024-09-14T11:58:40.531842+0000","last_clean":"2024-09-14T11:58:40.531842+0000","last_became_active":"2024-09-14T11:02:34.881333+0000","last_became_peered":"2024-09-14T11:02:34.881333+0000","last_unstale":"2024-09-14T11:58:40.531842+0000","last_undegraded":"2024-09-14T11:58:40.531842+0000","last_fullsized":"2024-09-14T11:58:40.531842+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:25.506302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":49,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.441698+0000","last_change":"2024-09-14T11:25:20.209663+0000","last_active":"2024-09-14T11:56:48.441698+0000","last_peered":"2024-09-14T11:56:48.441698+0000","last_clean":"2024-09-14T11:56:48.441698+0000","last_became_active":"2024-09-14T11:25:20.209369+0000","last_became_peered":"2024-09-14T11:25:20.209369+0000","last_unstale":"2024-09-14T11:56:48.441698+0000","last_undegraded":"2024-09-14T11:56:48.441698+0000","last_fullsized":"2024-09-14T11:56:48.441698+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:58.938617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:08.453886+0000","last_change":"2024-09-14T11:06:45.981996+0000","last_active":"2024-09-14T11:58:08.453886+0000","last_peered":"2024-09-14T11:58:08.453886+0000","last_clean":"2024-09-14T11:58:08.453886+0000","last_became_active":"2024-09-14T11:06:45.980211+0000","last_became_peered":"2024-09-14T11:06:45.980211+0000","last_unstale":"2024-09-14T11:58:08.453886+0000","last_undegraded":"2024-09-14T11:58:08.453886+0000","last_fullsized":"2024-09-14T11:58:08.453886+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:03.580856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.403612+0000","last_change":"2024-09-14T11:06:41.903200+0000","last_active":"2024-09-14T11:58:05.403612+0000","last_peered":"2024-09-14T11:58:05.403612+0000","last_clean":"2024-09-14T11:58:05.403612+0000","last_became_active":"2024-09-14T11:06:41.902894+0000","last_became_peered":"2024-09-14T11:06:41.902894+0000","last_unstale":"2024-09-14T11:58:05.403612+0000","last_undegraded":"2024-09-14T11:58:05.403612+0000","last_fullsized":"2024-09-14T11:58:05.403612+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:39.369082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"260'15","reported_seq":101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:35.531184+0000","last_change":"2024-09-14T11:02:34.873962+0000","last_active":"2024-09-14T11:58:35.531184+0000","last_peered":"2024-09-14T11:58:35.531184+0000","last_clean":"2024-09-14T11:58:35.531184+0000","last_became_active":"2024-09-14T11:02:34.873660+0000","last_became_peered":"2024-09-14T11:02:34.873660+0000","last_unstale":"2024-09-14T11:58:35.531184+0000","last_undegraded":"2024-09-14T11:58:35.531184+0000","last_fullsized":"2024-09-14T11:58:35.531184+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:08.878693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":83,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.508214+0000","last_change":"2024-09-14T11:25:20.210810+0000","last_active":"2024-09-14T11:56:48.508214+0000","last_peered":"2024-09-14T11:56:48.508214+0000","last_clean":"2024-09-14T11:56:48.508214+0000","last_became_active":"2024-09-14T11:25:20.210534+0000","last_became_peered":"2024-09-14T11:25:20.210534+0000","last_unstale":"2024-09-14T11:56:48.508214+0000","last_undegraded":"2024-09-14T11:56:48.508214+0000","last_fullsized":"2024-09-14T11:56:48.508214+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:04.144981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:08.453853+0000","last_change":"2024-09-14T11:06:45.985239+0000","last_active":"2024-09-14T11:58:08.453853+0000","last_peered":"2024-09-14T11:58:08.453853+0000","last_clean":"2024-09-14T11:58:08.453853+0000","last_became_active":"2024-09-14T11:06:45.984993+0000","last_became_peered":"2024-09-14T11:06:45.984993+0000","last_unstale":"2024-09-14T11:58:08.453853+0000","last_undegraded":"2024-09-14T11:58:08.453853+0000","last_fullsized":"2024-09-14T11:58:08.453853+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:26.543636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"263'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:23.475632+0000","last_change":"2024-09-14T11:06:41.910546+0000","last_active":"2024-09-14T12:00:23.475632+0000","last_peered":"2024-09-14T12:00:23.475632+0000","last_clean":"2024-09-14T12:00:23.475632+0000","last_became_active":"2024-09-14T11:06:41.910286+0000","last_became_peered":"2024-09-14T11:06:41.910286+0000","last_unstale":"2024-09-14T12:00:23.475632+0000","last_undegraded":"2024-09-14T12:00:23.475632+0000","last_fullsized":"2024-09-14T12:00:23.475632+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:00.405940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"263'55","reported_seq":203,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:35.447992+0000","last_change":"2024-09-14T11:02:34.873185+0000","last_active":"2024-09-14T11:58:35.447992+0000","last_peered":"2024-09-14T11:58:35.447992+0000","last_clean":"2024-09-14T11:58:35.447992+0000","last_became_active":"2024-09-14T11:02:34.872911+0000","last_became_peered":"2024-09-14T11:02:34.872911+0000","last_unstale":"2024-09-14T11:58:35.447992+0000","last_undegraded":"2024-09-14T11:58:35.447992+0000","last_fullsized":"2024-09-14T11:58:35.447992+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:20.423924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":434,"num_read_kb":298,"num_write":132,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.643221+0000","last_change":"2024-09-14T11:25:20.210573+0000","last_active":"2024-09-14T11:58:05.643221+0000","last_peered":"2024-09-14T11:58:05.643221+0000","last_clean":"2024-09-14T11:58:05.643221+0000","last_became_active":"2024-09-14T11:25:20.209547+0000","last_became_peered":"2024-09-14T11:25:20.209547+0000","last_unstale":"2024-09-14T11:58:05.643221+0000","last_undegraded":"2024-09-14T11:58:05.643221+0000","last_fullsized":"2024-09-14T11:58:05.643221+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:48.503085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:25.464893+0000","last_change":"2024-09-14T11:06:45.984844+0000","last_active":"2024-09-14T12:00:25.464893+0000","last_peered":"2024-09-14T12:00:25.464893+0000","last_clean":"2024-09-14T12:00:25.464893+0000","last_became_active":"2024-09-14T11:06:45.984527+0000","last_became_peered":"2024-09-14T11:06:45.984527+0000","last_unstale":"2024-09-14T12:00:25.464893+0000","last_undegraded":"2024-09-14T12:00:25.464893+0000","last_fullsized":"2024-09-14T12:00:25.464893+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:00.029592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"260'9","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.403653+0000","last_change":"2024-09-14T11:06:41.905789+0000","last_active":"2024-09-14T11:58:05.403653+0000","last_peered":"2024-09-14T11:58:05.403653+0000","last_clean":"2024-09-14T11:58:05.403653+0000","last_became_active":"2024-09-14T11:06:41.905088+0000","last_became_peered":"2024-09-14T11:06:41.905088+0000","last_unstale":"2024-09-14T11:58:05.403653+0000","last_undegraded":"2024-09-14T11:58:05.403653+0000","last_fullsized":"2024-09-14T11:58:05.403653+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:26.152725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17408,"num_write":9,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'36","reported_seq":152,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:35.304813+0000","last_change":"2024-09-14T11:02:34.873841+0000","last_active":"2024-09-14T11:58:35.304813+0000","last_peered":"2024-09-14T11:58:35.304813+0000","last_clean":"2024-09-14T11:58:35.304813+0000","last_became_active":"2024-09-14T11:02:34.873560+0000","last_became_peered":"2024-09-14T11:02:34.873560+0000","last_unstale":"2024-09-14T11:58:35.304813+0000","last_undegraded":"2024-09-14T11:58:35.304813+0000","last_fullsized":"2024-09-14T11:58:35.304813+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:07.656019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":270,"num_read_kb":162,"num_write":93,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.508186+0000","last_change":"2024-09-14T11:25:20.206947+0000","last_active":"2024-09-14T11:56:48.508186+0000","last_peered":"2024-09-14T11:56:48.508186+0000","last_clean":"2024-09-14T11:56:48.508186+0000","last_became_active":"2024-09-14T11:25:20.206692+0000","last_became_peered":"2024-09-14T11:25:20.206692+0000","last_unstale":"2024-09-14T11:56:48.508186+0000","last_undegraded":"2024-09-14T11:56:48.508186+0000","last_fullsized":"2024-09-14T11:56:48.508186+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:46.331575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.527582+0000","last_change":"2024-09-14T11:06:45.985776+0000","last_active":"2024-09-14T11:58:05.527582+0000","last_peered":"2024-09-14T11:58:05.527582+0000","last_clean":"2024-09-14T11:58:05.527582+0000","last_became_active":"2024-09-14T11:06:45.985436+0000","last_became_peered":"2024-09-14T11:06:45.985436+0000","last_unstale":"2024-09-14T11:58:05.527582+0000","last_undegraded":"2024-09-14T11:58:05.527582+0000","last_fullsized":"2024-09-14T11:58:05.527582+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:18.777447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.481613+0000","last_change":"2024-09-14T11:06:41.908095+0000","last_active":"2024-09-14T12:01:17.481613+0000","last_peered":"2024-09-14T12:01:17.481613+0000","last_clean":"2024-09-14T12:01:17.481613+0000","last_became_active":"2024-09-14T11:06:41.907791+0000","last_became_peered":"2024-09-14T11:06:41.907791+0000","last_unstale":"2024-09-14T12:01:17.481613+0000","last_undegraded":"2024-09-14T12:01:17.481613+0000","last_fullsized":"2024-09-14T12:01:17.481613+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:19.380573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5124,"num_write":5,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"263'33","reported_seq":149,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:35.447954+0000","last_change":"2024-09-14T11:02:34.876400+0000","last_active":"2024-09-14T11:58:35.447954+0000","last_peered":"2024-09-14T11:58:35.447954+0000","last_clean":"2024-09-14T11:58:35.447954+0000","last_became_active":"2024-09-14T11:02:34.876080+0000","last_became_peered":"2024-09-14T11:02:34.876080+0000","last_unstale":"2024-09-14T11:58:35.447954+0000","last_undegraded":"2024-09-14T11:58:35.447954+0000","last_fullsized":"2024-09-14T11:58:35.447954+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:45.087546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":186,"num_write":88,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:58.452425+0000","last_change":"2024-09-14T11:25:20.205656+0000","last_active":"2024-09-14T11:57:58.452425+0000","last_peered":"2024-09-14T11:57:58.452425+0000","last_clean":"2024-09-14T11:57:58.452425+0000","last_became_active":"2024-09-14T11:25:20.205335+0000","last_became_peered":"2024-09-14T11:25:20.205335+0000","last_unstale":"2024-09-14T11:57:58.452425+0000","last_undegraded":"2024-09-14T11:57:58.452425+0000","last_fullsized":"2024-09-14T11:57:58.452425+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:12.896781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:30.447384+0000","last_change":"2024-09-14T11:06:45.986506+0000","last_active":"2024-09-14T11:58:30.447384+0000","last_peered":"2024-09-14T11:58:30.447384+0000","last_clean":"2024-09-14T11:58:30.447384+0000","last_became_active":"2024-09-14T11:06:45.986225+0000","last_became_peered":"2024-09-14T11:06:45.986225+0000","last_unstale":"2024-09-14T11:58:30.447384+0000","last_undegraded":"2024-09-14T11:58:30.447384+0000","last_fullsized":"2024-09-14T11:58:30.447384+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:18.018900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"263'3","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:45.320227+0000","last_change":"2024-09-14T11:06:41.903610+0000","last_active":"2024-09-14T12:00:45.320227+0000","last_peered":"2024-09-14T12:00:45.320227+0000","last_clean":"2024-09-14T12:00:45.320227+0000","last_became_active":"2024-09-14T11:06:41.903188+0000","last_became_peered":"2024-09-14T11:06:41.903188+0000","last_unstale":"2024-09-14T12:00:45.320227+0000","last_undegraded":"2024-09-14T12:00:45.320227+0000","last_fullsized":"2024-09-14T12:00:45.320227+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:45.086214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"263'55","reported_seq":202,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.451654+0000","last_change":"2024-09-14T11:02:34.878079+0000","last_active":"2024-09-14T11:59:00.451654+0000","last_peered":"2024-09-14T11:59:00.451654+0000","last_clean":"2024-09-14T11:59:00.451654+0000","last_became_active":"2024-09-14T11:02:34.877631+0000","last_became_peered":"2024-09-14T11:02:34.877631+0000","last_unstale":"2024-09-14T11:59:00.451654+0000","last_undegraded":"2024-09-14T11:59:00.451654+0000","last_fullsized":"2024-09-14T11:59:00.451654+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:50.183737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":260,"num_write":147,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.409942+0000","last_change":"2024-09-14T11:25:20.203431+0000","last_active":"2024-09-14T11:59:05.409942+0000","last_peered":"2024-09-14T11:59:05.409942+0000","last_clean":"2024-09-14T11:59:05.409942+0000","last_became_active":"2024-09-14T11:25:20.200061+0000","last_became_peered":"2024-09-14T11:25:20.200061+0000","last_unstale":"2024-09-14T11:59:05.409942+0000","last_undegraded":"2024-09-14T11:59:05.409942+0000","last_fullsized":"2024-09-14T11:59:05.409942+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:15.179721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:45.467828+0000","last_change":"2024-09-14T11:06:45.991468+0000","last_active":"2024-09-14T12:00:45.467828+0000","last_peered":"2024-09-14T12:00:45.467828+0000","last_clean":"2024-09-14T12:00:45.467828+0000","last_became_active":"2024-09-14T11:06:45.991198+0000","last_became_peered":"2024-09-14T11:06:45.991198+0000","last_unstale":"2024-09-14T12:00:45.467828+0000","last_undegraded":"2024-09-14T12:00:45.467828+0000","last_fullsized":"2024-09-14T12:00:45.467828+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:02.331809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"263'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:43.542221+0000","last_change":"2024-09-14T11:06:41.910787+0000","last_active":"2024-09-14T12:00:43.542221+0000","last_peered":"2024-09-14T12:00:43.542221+0000","last_clean":"2024-09-14T12:00:43.542221+0000","last_became_active":"2024-09-14T11:06:41.910512+0000","last_became_peered":"2024-09-14T11:06:41.910512+0000","last_unstale":"2024-09-14T12:00:43.542221+0000","last_undegraded":"2024-09-14T12:00:43.542221+0000","last_fullsized":"2024-09-14T12:00:43.542221+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:20.996429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"263'44","reported_seq":172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.533064+0000","last_change":"2024-09-14T11:02:34.881693+0000","last_active":"2024-09-14T11:58:50.533064+0000","last_peered":"2024-09-14T11:58:50.533064+0000","last_clean":"2024-09-14T11:58:50.533064+0000","last_became_active":"2024-09-14T11:02:34.881341+0000","last_became_peered":"2024-09-14T11:02:34.881341+0000","last_unstale":"2024-09-14T11:58:50.533064+0000","last_undegraded":"2024-09-14T11:58:50.533064+0000","last_fullsized":"2024-09-14T11:58:50.533064+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:36.323501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":339,"num_read_kb":228,"num_write":117,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.525849+0000","last_change":"2024-09-14T11:25:20.210429+0000","last_active":"2024-09-14T11:57:50.525849+0000","last_peered":"2024-09-14T11:57:50.525849+0000","last_clean":"2024-09-14T11:57:50.525849+0000","last_became_active":"2024-09-14T11:25:20.210117+0000","last_became_peered":"2024-09-14T11:25:20.210117+0000","last_unstale":"2024-09-14T11:57:50.525849+0000","last_undegraded":"2024-09-14T11:57:50.525849+0000","last_fullsized":"2024-09-14T11:57:50.525849+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:07.063593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'6","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.152467+0000","last_change":"2024-09-14T11:06:45.992869+0000","last_active":"2024-09-14T12:01:18.152467+0000","last_peered":"2024-09-14T12:01:18.152467+0000","last_clean":"2024-09-14T12:01:18.152467+0000","last_became_active":"2024-09-14T11:06:45.992574+0000","last_became_peered":"2024-09-14T11:06:45.992574+0000","last_unstale":"2024-09-14T12:01:18.152467+0000","last_undegraded":"2024-09-14T12:01:18.152467+0000","last_fullsized":"2024-09-14T12:01:18.152467+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:58.347483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:30.447415+0000","last_change":"2024-09-14T11:06:41.919642+0000","last_active":"2024-09-14T11:58:30.447415+0000","last_peered":"2024-09-14T11:58:30.447415+0000","last_clean":"2024-09-14T11:58:30.447415+0000","last_became_active":"2024-09-14T11:06:41.919330+0000","last_became_peered":"2024-09-14T11:06:41.919330+0000","last_unstale":"2024-09-14T11:58:30.447415+0000","last_undegraded":"2024-09-14T11:58:30.447415+0000","last_fullsized":"2024-09-14T11:58:30.447415+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:18.967454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"263'112","reported_seq":390,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.408228+0000","last_change":"2024-09-14T11:02:34.873664+0000","last_active":"2024-09-14T11:58:50.408228+0000","last_peered":"2024-09-14T11:58:50.408228+0000","last_clean":"2024-09-14T11:58:50.408228+0000","last_became_active":"2024-09-14T11:02:34.873360+0000","last_became_peered":"2024-09-14T11:02:34.873360+0000","last_unstale":"2024-09-14T11:58:50.408228+0000","last_undegraded":"2024-09-14T11:58:50.408228+0000","last_fullsized":"2024-09-14T11:58:50.408228+0000","mapping_epoch":252,"log_start":"263'100","ondisk_log_start":"263'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:33.431081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1014,"num_read_kb":809,"num_write":225,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.401985+0000","last_change":"2024-09-14T11:25:20.200172+0000","last_active":"2024-09-14T11:57:50.401985+0000","last_peered":"2024-09-14T11:57:50.401985+0000","last_clean":"2024-09-14T11:57:50.401985+0000","last_became_active":"2024-09-14T11:25:20.199875+0000","last_became_peered":"2024-09-14T11:25:20.199875+0000","last_unstale":"2024-09-14T11:57:50.401985+0000","last_undegraded":"2024-09-14T11:57:50.401985+0000","last_fullsized":"2024-09-14T11:57:50.401985+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:26.854076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"260'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:33.457900+0000","last_change":"2024-09-14T11:06:45.980652+0000","last_active":"2024-09-14T11:58:33.457900+0000","last_peered":"2024-09-14T11:58:33.457900+0000","last_clean":"2024-09-14T11:58:33.457900+0000","last_became_active":"2024-09-14T11:06:45.980035+0000","last_became_peered":"2024-09-14T11:06:45.980035+0000","last_unstale":"2024-09-14T11:58:33.457900+0000","last_undegraded":"2024-09-14T11:58:33.457900+0000","last_fullsized":"2024-09-14T11:58:33.457900+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:36.733533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:55.469343+0000","last_change":"2024-09-14T11:06:41.917633+0000","last_active":"2024-09-14T12:00:55.469343+0000","last_peered":"2024-09-14T12:00:55.469343+0000","last_clean":"2024-09-14T12:00:55.469343+0000","last_became_active":"2024-09-14T11:06:41.917341+0000","last_became_peered":"2024-09-14T11:06:41.917341+0000","last_unstale":"2024-09-14T12:00:55.469343+0000","last_undegraded":"2024-09-14T12:00:55.469343+0000","last_fullsized":"2024-09-14T12:00:55.469343+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:27.626042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"260'15","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.526593+0000","last_change":"2024-09-14T11:02:34.876368+0000","last_active":"2024-09-14T11:58:53.526593+0000","last_peered":"2024-09-14T11:58:53.526593+0000","last_clean":"2024-09-14T11:58:53.526593+0000","last_became_active":"2024-09-14T11:02:34.876078+0000","last_became_peered":"2024-09-14T11:02:34.876078+0000","last_unstale":"2024-09-14T11:58:53.526593+0000","last_undegraded":"2024-09-14T11:58:53.526593+0000","last_fullsized":"2024-09-14T11:58:53.526593+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:14.606877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":83,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.442454+0000","last_change":"2024-09-14T11:25:20.210430+0000","last_active":"2024-09-14T11:56:53.442454+0000","last_peered":"2024-09-14T11:56:53.442454+0000","last_clean":"2024-09-14T11:56:53.442454+0000","last_became_active":"2024-09-14T11:25:20.210181+0000","last_became_peered":"2024-09-14T11:25:20.210181+0000","last_unstale":"2024-09-14T11:56:53.442454+0000","last_undegraded":"2024-09-14T11:56:53.442454+0000","last_fullsized":"2024-09-14T11:56:53.442454+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:56.596921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.532365+0000","last_change":"2024-09-14T11:06:45.984990+0000","last_active":"2024-09-14T11:58:45.532365+0000","last_peered":"2024-09-14T11:58:45.532365+0000","last_clean":"2024-09-14T11:58:45.532365+0000","last_became_active":"2024-09-14T11:06:45.984696+0000","last_became_peered":"2024-09-14T11:06:45.984696+0000","last_unstale":"2024-09-14T11:58:45.532365+0000","last_undegraded":"2024-09-14T11:58:45.532365+0000","last_fullsized":"2024-09-14T11:58:45.532365+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:17.939743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"263'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:55.469166+0000","last_change":"2024-09-14T11:06:41.914553+0000","last_active":"2024-09-14T12:00:55.469166+0000","last_peered":"2024-09-14T12:00:55.469166+0000","last_clean":"2024-09-14T12:00:55.469166+0000","last_became_active":"2024-09-14T11:06:41.914209+0000","last_became_peered":"2024-09-14T11:06:41.914209+0000","last_unstale":"2024-09-14T12:00:55.469166+0000","last_undegraded":"2024-09-14T12:00:55.469166+0000","last_fullsized":"2024-09-14T12:00:55.469166+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:46.262011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"263'35","reported_seq":148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.526513+0000","last_change":"2024-09-14T11:02:34.880131+0000","last_active":"2024-09-14T11:58:53.526513+0000","last_peered":"2024-09-14T11:58:53.526513+0000","last_clean":"2024-09-14T11:58:53.526513+0000","last_became_active":"2024-09-14T11:02:34.879834+0000","last_became_peered":"2024-09-14T11:02:34.879834+0000","last_unstale":"2024-09-14T11:58:53.526513+0000","last_undegraded":"2024-09-14T11:58:53.526513+0000","last_fullsized":"2024-09-14T11:58:53.526513+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:06.529921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":172,"num_write":95,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.294128+0000","last_change":"2024-09-14T11:25:20.205157+0000","last_active":"2024-09-14T11:56:55.294128+0000","last_peered":"2024-09-14T11:56:55.294128+0000","last_clean":"2024-09-14T11:56:55.294128+0000","last_became_active":"2024-09-14T11:25:20.204834+0000","last_became_peered":"2024-09-14T11:25:20.204834+0000","last_unstale":"2024-09-14T11:56:55.294128+0000","last_undegraded":"2024-09-14T11:56:55.294128+0000","last_fullsized":"2024-09-14T11:56:55.294128+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:44.546050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.305849+0000","last_change":"2024-09-14T11:06:45.986635+0000","last_active":"2024-09-14T11:58:45.305849+0000","last_peered":"2024-09-14T11:58:45.305849+0000","last_clean":"2024-09-14T11:58:45.305849+0000","last_became_active":"2024-09-14T11:06:45.984865+0000","last_became_peered":"2024-09-14T11:06:45.984865+0000","last_unstale":"2024-09-14T11:58:45.305849+0000","last_undegraded":"2024-09-14T11:58:45.305849+0000","last_fullsized":"2024-09-14T11:58:45.305849+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:51.926620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"260'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:43.459476+0000","last_change":"2024-09-14T11:06:41.909800+0000","last_active":"2024-09-14T11:58:43.459476+0000","last_peered":"2024-09-14T11:58:43.459476+0000","last_clean":"2024-09-14T11:58:43.459476+0000","last_became_active":"2024-09-14T11:06:41.909533+0000","last_became_peered":"2024-09-14T11:06:41.909533+0000","last_unstale":"2024-09-14T11:58:43.459476+0000","last_undegraded":"2024-09-14T11:58:43.459476+0000","last_fullsized":"2024-09-14T11:58:43.459476+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:38.325179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"263'25","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.308510+0000","last_change":"2024-09-14T11:02:34.873554+0000","last_active":"2024-09-14T11:59:10.308510+0000","last_peered":"2024-09-14T11:59:10.308510+0000","last_clean":"2024-09-14T11:59:10.308510+0000","last_became_active":"2024-09-14T11:02:34.873259+0000","last_became_peered":"2024-09-14T11:02:34.873259+0000","last_unstale":"2024-09-14T11:59:10.308510+0000","last_undegraded":"2024-09-14T11:59:10.308510+0000","last_fullsized":"2024-09-14T11:59:10.308510+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:05.178830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":129,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.607073+0000","last_change":"2024-09-14T11:25:20.212620+0000","last_active":"2024-09-14T11:59:05.607073+0000","last_peered":"2024-09-14T11:59:05.607073+0000","last_clean":"2024-09-14T11:59:05.607073+0000","last_became_active":"2024-09-14T11:25:20.212293+0000","last_became_peered":"2024-09-14T11:25:20.212293+0000","last_unstale":"2024-09-14T11:59:05.607073+0000","last_undegraded":"2024-09-14T11:59:05.607073+0000","last_fullsized":"2024-09-14T11:59:05.607073+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:10.346864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:33.523575+0000","last_change":"2024-09-14T11:06:45.986687+0000","last_active":"2024-09-14T11:58:33.523575+0000","last_peered":"2024-09-14T11:58:33.523575+0000","last_clean":"2024-09-14T11:58:33.523575+0000","last_became_active":"2024-09-14T11:06:45.986398+0000","last_became_peered":"2024-09-14T11:06:45.986398+0000","last_unstale":"2024-09-14T11:58:33.523575+0000","last_undegraded":"2024-09-14T11:58:33.523575+0000","last_fullsized":"2024-09-14T11:58:33.523575+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:28.445077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"260'10","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.450778+0000","last_change":"2024-09-14T11:06:41.915770+0000","last_active":"2024-09-14T11:58:55.450778+0000","last_peered":"2024-09-14T11:58:55.450778+0000","last_clean":"2024-09-14T11:58:55.450778+0000","last_became_active":"2024-09-14T11:06:41.915491+0000","last_became_peered":"2024-09-14T11:06:41.915491+0000","last_unstale":"2024-09-14T11:58:55.450778+0000","last_undegraded":"2024-09-14T11:58:55.450778+0000","last_fullsized":"2024-09-14T11:58:55.450778+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:33.737820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":40964,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"260'12","reported_seq":91,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.462030+0000","last_change":"2024-09-14T11:02:34.872228+0000","last_active":"2024-09-14T11:58:58.462030+0000","last_peered":"2024-09-14T11:58:58.462030+0000","last_clean":"2024-09-14T11:58:58.462030+0000","last_became_active":"2024-09-14T11:02:34.871352+0000","last_became_peered":"2024-09-14T11:02:34.871352+0000","last_unstale":"2024-09-14T11:58:58.462030+0000","last_undegraded":"2024-09-14T11:58:58.462030+0000","last_fullsized":"2024-09-14T11:58:58.462030+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:29.511969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.452308+0000","last_change":"2024-09-14T11:25:20.214092+0000","last_active":"2024-09-14T11:59:05.452308+0000","last_peered":"2024-09-14T11:59:05.452308+0000","last_clean":"2024-09-14T11:59:05.452308+0000","last_became_active":"2024-09-14T11:25:20.213785+0000","last_became_peered":"2024-09-14T11:25:20.213785+0000","last_unstale":"2024-09-14T11:59:05.452308+0000","last_undegraded":"2024-09-14T11:59:05.452308+0000","last_fullsized":"2024-09-14T11:59:05.452308+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:56.298725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"260'2","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.605100+0000","last_change":"2024-09-14T11:06:45.981838+0000","last_active":"2024-09-14T11:58:45.605100+0000","last_peered":"2024-09-14T11:58:45.605100+0000","last_clean":"2024-09-14T11:58:45.605100+0000","last_became_active":"2024-09-14T11:06:45.981476+0000","last_became_peered":"2024-09-14T11:06:45.981476+0000","last_unstale":"2024-09-14T11:58:45.605100+0000","last_undegraded":"2024-09-14T11:58:45.605100+0000","last_fullsized":"2024-09-14T11:58:45.605100+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:58.441972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"260'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:30.530578+0000","last_change":"2024-09-14T11:06:41.911683+0000","last_active":"2024-09-14T11:58:30.530578+0000","last_peered":"2024-09-14T11:58:30.530578+0000","last_clean":"2024-09-14T11:58:30.530578+0000","last_became_active":"2024-09-14T11:06:41.911413+0000","last_became_peered":"2024-09-14T11:06:41.911413+0000","last_unstale":"2024-09-14T11:58:30.530578+0000","last_undegraded":"2024-09-14T11:58:30.530578+0000","last_fullsized":"2024-09-14T11:58:30.530578+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:52.497275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"263'38","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.606077+0000","last_change":"2024-09-14T11:02:34.879059+0000","last_active":"2024-09-14T11:58:55.606077+0000","last_peered":"2024-09-14T11:58:55.606077+0000","last_clean":"2024-09-14T11:58:55.606077+0000","last_became_active":"2024-09-14T11:02:34.878752+0000","last_became_peered":"2024-09-14T11:02:34.878752+0000","last_unstale":"2024-09-14T11:58:55.606077+0000","last_undegraded":"2024-09-14T11:58:55.606077+0000","last_fullsized":"2024-09-14T11:58:55.606077+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:34.432738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":231,"num_write":89,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.604290+0000","last_change":"2024-09-14T11:25:20.211271+0000","last_active":"2024-09-14T11:58:40.604290+0000","last_peered":"2024-09-14T11:58:40.604290+0000","last_clean":"2024-09-14T11:58:40.604290+0000","last_became_active":"2024-09-14T11:25:20.210999+0000","last_became_peered":"2024-09-14T11:25:20.210999+0000","last_unstale":"2024-09-14T11:58:40.604290+0000","last_undegraded":"2024-09-14T11:58:40.604290+0000","last_fullsized":"2024-09-14T11:58:40.604290+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:13.729258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.462863+0000","last_change":"2024-09-14T11:06:45.982956+0000","last_active":"2024-09-14T11:59:03.462863+0000","last_peered":"2024-09-14T11:59:03.462863+0000","last_clean":"2024-09-14T11:59:03.462863+0000","last_became_active":"2024-09-14T11:06:45.982181+0000","last_became_peered":"2024-09-14T11:06:45.982181+0000","last_unstale":"2024-09-14T11:59:03.462863+0000","last_undegraded":"2024-09-14T11:59:03.462863+0000","last_fullsized":"2024-09-14T11:59:03.462863+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:18.506633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.533019+0000","last_change":"2024-09-14T11:06:41.914378+0000","last_active":"2024-09-14T11:58:50.533019+0000","last_peered":"2024-09-14T11:58:50.533019+0000","last_clean":"2024-09-14T11:58:50.533019+0000","last_became_active":"2024-09-14T11:06:41.913192+0000","last_became_peered":"2024-09-14T11:06:41.913192+0000","last_unstale":"2024-09-14T11:58:50.533019+0000","last_undegraded":"2024-09-14T11:58:50.533019+0000","last_fullsized":"2024-09-14T11:58:50.533019+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:24.679035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"263'32","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.650978+0000","last_change":"2024-09-14T11:02:34.874602+0000","last_active":"2024-09-14T11:58:55.650978+0000","last_peered":"2024-09-14T11:58:55.650978+0000","last_clean":"2024-09-14T11:58:55.650978+0000","last_became_active":"2024-09-14T11:02:34.874328+0000","last_became_peered":"2024-09-14T11:02:34.874328+0000","last_unstale":"2024-09-14T11:58:55.650978+0000","last_undegraded":"2024-09-14T11:58:55.650978+0000","last_fullsized":"2024-09-14T11:58:55.650978+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:09.428522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":246,"num_read_kb":166,"num_write":81,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.604315+0000","last_change":"2024-09-14T11:25:20.213871+0000","last_active":"2024-09-14T11:58:40.604315+0000","last_peered":"2024-09-14T11:58:40.604315+0000","last_clean":"2024-09-14T11:58:40.604315+0000","last_became_active":"2024-09-14T11:25:20.213577+0000","last_became_peered":"2024-09-14T11:25:20.213577+0000","last_unstale":"2024-09-14T11:58:40.604315+0000","last_undegraded":"2024-09-14T11:58:40.604315+0000","last_fullsized":"2024-09-14T11:58:40.604315+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:03.148226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"263'10","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.842742+0000","last_change":"2024-09-14T11:06:45.991127+0000","last_active":"2024-09-14T12:01:17.842742+0000","last_peered":"2024-09-14T12:01:17.842742+0000","last_clean":"2024-09-14T12:01:17.842742+0000","last_became_active":"2024-09-14T11:06:45.990855+0000","last_became_peered":"2024-09-14T11:06:45.990855+0000","last_unstale":"2024-09-14T12:01:17.842742+0000","last_undegraded":"2024-09-14T12:01:17.842742+0000","last_fullsized":"2024-09-14T12:01:17.842742+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:28.658329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6246,"num_write":20,"num_write_kb":2098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"263'8","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:10.670577+0000","last_change":"2024-09-14T11:06:41.913753+0000","last_active":"2024-09-14T12:01:10.670577+0000","last_peered":"2024-09-14T12:01:10.670577+0000","last_clean":"2024-09-14T12:01:10.670577+0000","last_became_active":"2024-09-14T11:06:41.913454+0000","last_became_peered":"2024-09-14T11:06:41.913454+0000","last_unstale":"2024-09-14T12:01:10.670577+0000","last_undegraded":"2024-09-14T12:01:10.670577+0000","last_fullsized":"2024-09-14T12:01:10.670577+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:38.121049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":18,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'130","reported_seq":444,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.533642+0000","last_change":"2024-09-14T11:02:34.879730+0000","last_active":"2024-09-14T11:58:55.533642+0000","last_peered":"2024-09-14T11:58:55.533642+0000","last_clean":"2024-09-14T11:58:55.533642+0000","last_became_active":"2024-09-14T11:02:34.878813+0000","last_became_peered":"2024-09-14T11:02:34.878813+0000","last_unstale":"2024-09-14T11:58:55.533642+0000","last_undegraded":"2024-09-14T11:58:55.533642+0000","last_fullsized":"2024-09-14T11:58:55.533642+0000","mapping_epoch":252,"log_start":"260'100","ondisk_log_start":"260'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:00.256155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1195,"num_read_kb":1160,"num_write":263,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.447900+0000","last_change":"2024-09-14T11:25:20.212941+0000","last_active":"2024-09-14T11:57:28.447900+0000","last_peered":"2024-09-14T11:57:28.447900+0000","last_clean":"2024-09-14T11:57:28.447900+0000","last_became_active":"2024-09-14T11:25:20.212665+0000","last_became_peered":"2024-09-14T11:25:20.212665+0000","last_unstale":"2024-09-14T11:57:28.447900+0000","last_undegraded":"2024-09-14T11:57:28.447900+0000","last_fullsized":"2024-09-14T11:57:28.447900+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:31.076495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.605166+0000","last_change":"2024-09-14T11:06:45.992405+0000","last_active":"2024-09-14T11:58:45.605166+0000","last_peered":"2024-09-14T11:58:45.605166+0000","last_clean":"2024-09-14T11:58:45.605166+0000","last_became_active":"2024-09-14T11:06:45.992066+0000","last_became_peered":"2024-09-14T11:06:45.992066+0000","last_unstale":"2024-09-14T11:58:45.605166+0000","last_undegraded":"2024-09-14T11:58:45.605166+0000","last_fullsized":"2024-09-14T11:58:45.605166+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:42.417189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"260'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.305944+0000","last_change":"2024-09-14T11:06:41.912718+0000","last_active":"2024-09-14T11:58:45.305944+0000","last_peered":"2024-09-14T11:58:45.305944+0000","last_clean":"2024-09-14T11:58:45.305944+0000","last_became_active":"2024-09-14T11:06:41.912405+0000","last_became_peered":"2024-09-14T11:06:41.912405+0000","last_unstale":"2024-09-14T11:58:45.305944+0000","last_undegraded":"2024-09-14T11:58:45.305944+0000","last_fullsized":"2024-09-14T11:58:45.305944+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:12.800532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"263'36","reported_seq":158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.307994+0000","last_change":"2024-09-14T11:02:34.873402+0000","last_active":"2024-09-14T11:59:05.307994+0000","last_peered":"2024-09-14T11:59:05.307994+0000","last_clean":"2024-09-14T11:59:05.307994+0000","last_became_active":"2024-09-14T11:02:34.873089+0000","last_became_peered":"2024-09-14T11:02:34.873089+0000","last_unstale":"2024-09-14T11:59:05.307994+0000","last_undegraded":"2024-09-14T11:59:05.307994+0000","last_fullsized":"2024-09-14T11:59:05.307994+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:47.372158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":295,"num_read_kb":200,"num_write":86,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.531790+0000","last_change":"2024-09-14T11:25:20.210966+0000","last_active":"2024-09-14T11:58:40.531790+0000","last_peered":"2024-09-14T11:58:40.531790+0000","last_clean":"2024-09-14T11:58:40.531790+0000","last_became_active":"2024-09-14T11:25:20.210331+0000","last_became_peered":"2024-09-14T11:25:20.210331+0000","last_unstale":"2024-09-14T11:58:40.531790+0000","last_undegraded":"2024-09-14T11:58:40.531790+0000","last_fullsized":"2024-09-14T11:58:40.531790+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:27.694386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.532467+0000","last_change":"2024-09-14T11:06:45.986136+0000","last_active":"2024-09-14T11:58:45.532467+0000","last_peered":"2024-09-14T11:58:45.532467+0000","last_clean":"2024-09-14T11:58:45.532467+0000","last_became_active":"2024-09-14T11:06:45.985792+0000","last_became_peered":"2024-09-14T11:06:45.985792+0000","last_unstale":"2024-09-14T11:58:45.532467+0000","last_undegraded":"2024-09-14T11:58:45.532467+0000","last_fullsized":"2024-09-14T11:58:45.532467+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:18.428977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.532481+0000","last_change":"2024-09-14T11:06:41.914556+0000","last_active":"2024-09-14T11:58:45.532481+0000","last_peered":"2024-09-14T11:58:45.532481+0000","last_clean":"2024-09-14T11:58:45.532481+0000","last_became_active":"2024-09-14T11:06:41.913214+0000","last_became_peered":"2024-09-14T11:06:41.913214+0000","last_unstale":"2024-09-14T11:58:45.532481+0000","last_undegraded":"2024-09-14T11:58:45.532481+0000","last_fullsized":"2024-09-14T11:58:45.532481+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:05.435530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"263'55","reported_seq":209,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.450078+0000","last_change":"2024-09-14T11:02:34.873880+0000","last_active":"2024-09-14T11:58:50.450078+0000","last_peered":"2024-09-14T11:58:50.450078+0000","last_clean":"2024-09-14T11:58:50.450078+0000","last_became_active":"2024-09-14T11:02:34.873554+0000","last_became_peered":"2024-09-14T11:02:34.873554+0000","last_unstale":"2024-09-14T11:58:50.450078+0000","last_undegraded":"2024-09-14T11:58:50.450078+0000","last_fullsized":"2024-09-14T11:58:50.450078+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:52.441238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":297,"num_write":136,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.441967+0000","last_change":"2024-09-14T11:25:20.209266+0000","last_active":"2024-09-14T11:57:50.441967+0000","last_peered":"2024-09-14T11:57:50.441967+0000","last_clean":"2024-09-14T11:57:50.441967+0000","last_became_active":"2024-09-14T11:25:20.208985+0000","last_became_peered":"2024-09-14T11:25:20.208985+0000","last_unstale":"2024-09-14T11:57:50.441967+0000","last_undegraded":"2024-09-14T11:57:50.441967+0000","last_fullsized":"2024-09-14T11:57:50.441967+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:35.791238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"260'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.650067+0000","last_change":"2024-09-14T11:06:45.987976+0000","last_active":"2024-09-14T11:58:50.650067+0000","last_peered":"2024-09-14T11:58:50.650067+0000","last_clean":"2024-09-14T11:58:50.650067+0000","last_became_active":"2024-09-14T11:06:45.987665+0000","last_became_peered":"2024-09-14T11:06:45.987665+0000","last_unstale":"2024-09-14T11:58:50.650067+0000","last_undegraded":"2024-09-14T11:58:50.650067+0000","last_fullsized":"2024-09-14T11:58:50.650067+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:33.778940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5649,"num_write":5,"num_write_kb":5649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"260'8","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.307436+0000","last_change":"2024-09-14T11:06:41.906763+0000","last_active":"2024-09-14T11:59:00.307436+0000","last_peered":"2024-09-14T11:59:00.307436+0000","last_clean":"2024-09-14T11:59:00.307436+0000","last_became_active":"2024-09-14T11:06:41.906528+0000","last_became_peered":"2024-09-14T11:06:41.906528+0000","last_unstale":"2024-09-14T11:59:00.307436+0000","last_undegraded":"2024-09-14T11:59:00.307436+0000","last_fullsized":"2024-09-14T11:59:00.307436+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:50.072640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"263'49","reported_seq":191,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.306450+0000","last_change":"2024-09-14T11:02:34.869488+0000","last_active":"2024-09-14T11:58:50.306450+0000","last_peered":"2024-09-14T11:58:50.306450+0000","last_clean":"2024-09-14T11:58:50.306450+0000","last_became_active":"2024-09-14T11:02:34.869154+0000","last_became_peered":"2024-09-14T11:02:34.869154+0000","last_unstale":"2024-09-14T11:58:50.306450+0000","last_undegraded":"2024-09-14T11:58:50.306450+0000","last_fullsized":"2024-09-14T11:58:50.306450+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:51.708190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":272,"num_write":122,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.641217+0000","last_change":"2024-09-14T11:25:20.209267+0000","last_active":"2024-09-14T11:57:50.641217+0000","last_peered":"2024-09-14T11:57:50.641217+0000","last_clean":"2024-09-14T11:57:50.641217+0000","last_became_active":"2024-09-14T11:25:20.208992+0000","last_became_peered":"2024-09-14T11:25:20.208992+0000","last_unstale":"2024-09-14T11:57:50.641217+0000","last_undegraded":"2024-09-14T11:57:50.641217+0000","last_fullsized":"2024-09-14T11:57:50.641217+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:33.801493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"263'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.845194+0000","last_change":"2024-09-14T11:06:45.985807+0000","last_active":"2024-09-14T12:01:17.845194+0000","last_peered":"2024-09-14T12:01:17.845194+0000","last_clean":"2024-09-14T12:01:17.845194+0000","last_became_active":"2024-09-14T11:06:45.985518+0000","last_became_peered":"2024-09-14T11:06:45.985518+0000","last_unstale":"2024-09-14T12:01:17.845194+0000","last_undegraded":"2024-09-14T12:01:17.845194+0000","last_fullsized":"2024-09-14T12:01:17.845194+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:53.847804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:55.549750+0000","last_change":"2024-09-14T11:06:41.915181+0000","last_active":"2024-09-14T12:00:55.549750+0000","last_peered":"2024-09-14T12:00:55.549750+0000","last_clean":"2024-09-14T12:00:55.549750+0000","last_became_active":"2024-09-14T11:06:41.914346+0000","last_became_peered":"2024-09-14T11:06:41.914346+0000","last_unstale":"2024-09-14T12:00:55.549750+0000","last_undegraded":"2024-09-14T12:00:55.549750+0000","last_fullsized":"2024-09-14T12:00:55.549750+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:17.184490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"263'33","reported_seq":145,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.532990+0000","last_change":"2024-09-14T11:02:34.880356+0000","last_active":"2024-09-14T11:58:50.532990+0000","last_peered":"2024-09-14T11:58:50.532990+0000","last_clean":"2024-09-14T11:58:50.532990+0000","last_became_active":"2024-09-14T11:02:34.880066+0000","last_became_peered":"2024-09-14T11:02:34.880066+0000","last_unstale":"2024-09-14T11:58:50.532990+0000","last_undegraded":"2024-09-14T11:58:50.532990+0000","last_fullsized":"2024-09-14T11:58:50.532990+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:20.037542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":165,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:43.459528+0000","last_change":"2024-09-14T11:25:20.211431+0000","last_active":"2024-09-14T11:58:43.459528+0000","last_peered":"2024-09-14T11:58:43.459528+0000","last_clean":"2024-09-14T11:58:43.459528+0000","last_became_active":"2024-09-14T11:25:20.208291+0000","last_became_peered":"2024-09-14T11:25:20.208291+0000","last_unstale":"2024-09-14T11:58:43.459528+0000","last_undegraded":"2024-09-14T11:58:43.459528+0000","last_fullsized":"2024-09-14T11:58:43.459528+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:10.519199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"260'3","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.306441+0000","last_change":"2024-09-14T11:06:45.988585+0000","last_active":"2024-09-14T11:58:50.306441+0000","last_peered":"2024-09-14T11:58:50.306441+0000","last_clean":"2024-09-14T11:58:50.306441+0000","last_became_active":"2024-09-14T11:06:45.988268+0000","last_became_peered":"2024-09-14T11:06:45.988268+0000","last_unstale":"2024-09-14T11:58:50.306441+0000","last_undegraded":"2024-09-14T11:58:50.306441+0000","last_fullsized":"2024-09-14T11:58:50.306441+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:29.911599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.525697+0000","last_change":"2024-09-14T11:06:41.910335+0000","last_active":"2024-09-14T11:58:48.525697+0000","last_peered":"2024-09-14T11:58:48.525697+0000","last_clean":"2024-09-14T11:58:48.525697+0000","last_became_active":"2024-09-14T11:06:41.909915+0000","last_became_peered":"2024-09-14T11:06:41.909915+0000","last_unstale":"2024-09-14T11:58:48.525697+0000","last_undegraded":"2024-09-14T11:58:48.525697+0000","last_fullsized":"2024-09-14T11:58:48.525697+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:47.834488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"263'21","reported_seq":116,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.532964+0000","last_change":"2024-09-14T11:02:34.878110+0000","last_active":"2024-09-14T11:58:50.532964+0000","last_peered":"2024-09-14T11:58:50.532964+0000","last_clean":"2024-09-14T11:58:50.532964+0000","last_became_active":"2024-09-14T11:02:34.877791+0000","last_became_peered":"2024-09-14T11:02:34.877791+0000","last_unstale":"2024-09-14T11:58:50.532964+0000","last_undegraded":"2024-09-14T11:58:50.532964+0000","last_fullsized":"2024-09-14T11:58:50.532964+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:00.836048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":103,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.531860+0000","last_change":"2024-09-14T11:25:20.208774+0000","last_active":"2024-09-14T11:58:40.531860+0000","last_peered":"2024-09-14T11:58:40.531860+0000","last_clean":"2024-09-14T11:58:40.531860+0000","last_became_active":"2024-09-14T11:25:20.208495+0000","last_became_peered":"2024-09-14T11:25:20.208495+0000","last_unstale":"2024-09-14T11:58:40.531860+0000","last_undegraded":"2024-09-14T11:58:40.531860+0000","last_fullsized":"2024-09-14T11:58:40.531860+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:18.019657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"263'3","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:55.321309+0000","last_change":"2024-09-14T11:06:45.987276+0000","last_active":"2024-09-14T12:00:55.321309+0000","last_peered":"2024-09-14T12:00:55.321309+0000","last_clean":"2024-09-14T12:00:55.321309+0000","last_became_active":"2024-09-14T11:06:45.986990+0000","last_became_peered":"2024-09-14T11:06:45.986990+0000","last_unstale":"2024-09-14T12:00:55.321309+0000","last_undegraded":"2024-09-14T12:00:55.321309+0000","last_fullsized":"2024-09-14T12:00:55.321309+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:48.346557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.408167+0000","last_change":"2024-09-14T11:06:41.915671+0000","last_active":"2024-09-14T11:58:50.408167+0000","last_peered":"2024-09-14T11:58:50.408167+0000","last_clean":"2024-09-14T11:58:50.408167+0000","last_became_active":"2024-09-14T11:06:41.915372+0000","last_became_peered":"2024-09-14T11:06:41.915372+0000","last_unstale":"2024-09-14T11:58:50.408167+0000","last_undegraded":"2024-09-14T11:58:50.408167+0000","last_fullsized":"2024-09-14T11:58:50.408167+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:08.016650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"263'13","reported_seq":96,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.306383+0000","last_change":"2024-09-14T11:02:34.879297+0000","last_active":"2024-09-14T11:58:50.306383+0000","last_peered":"2024-09-14T11:58:50.306383+0000","last_clean":"2024-09-14T11:58:50.306383+0000","last_became_active":"2024-09-14T11:02:34.879002+0000","last_became_peered":"2024-09-14T11:02:34.879002+0000","last_unstale":"2024-09-14T11:58:50.306383+0000","last_undegraded":"2024-09-14T11:58:50.306383+0000","last_fullsized":"2024-09-14T11:58:50.306383+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:18.663446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":56,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'347","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.365123+0000","last_change":"2024-09-14T10:46:44.332154+0000","last_active":"2024-09-14T12:01:19.365123+0000","last_peered":"2024-09-14T12:01:19.365123+0000","last_clean":"2024-09-14T12:01:19.365123+0000","last_became_active":"2024-09-14T10:46:44.331827+0000","last_became_peered":"2024-09-14T10:46:44.331827+0000","last_unstale":"2024-09-14T12:01:19.365123+0000","last_undegraded":"2024-09-14T12:01:19.365123+0000","last_fullsized":"2024-09-14T12:01:19.365123+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:51.461537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":808,"num_read_kb":10519,"num_write":1133,"num_write_kb":31597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"263'506","reported_seq":2200,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.709310+0000","last_change":"2024-09-14T10:46:46.341235+0000","last_active":"2024-09-14T11:59:34.709310+0000","last_peered":"2024-09-14T11:59:34.709310+0000","last_clean":"2024-09-14T11:59:34.709310+0000","last_became_active":"2024-09-14T10:46:46.340949+0000","last_became_peered":"2024-09-14T10:46:46.340949+0000","last_unstale":"2024-09-14T11:59:34.709310+0000","last_undegraded":"2024-09-14T11:59:34.709310+0000","last_fullsized":"2024-09-14T11:59:34.709310+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:28.432778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2834,"num_read_kb":2670,"num_write":604,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"263'320","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.423872+0000","last_change":"2024-09-14T10:46:44.333346+0000","last_active":"2024-09-14T12:01:18.423872+0000","last_peered":"2024-09-14T12:01:18.423872+0000","last_clean":"2024-09-14T12:01:18.423872+0000","last_became_active":"2024-09-14T10:46:44.332997+0000","last_became_peered":"2024-09-14T10:46:44.332997+0000","last_unstale":"2024-09-14T12:01:18.423872+0000","last_undegraded":"2024-09-14T12:01:18.423872+0000","last_fullsized":"2024-09-14T12:01:18.423872+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:12.331728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5540160,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":550,"num_read_kb":4891,"num_write":1023,"num_write_kb":34401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"263'664","reported_seq":2310,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.149223+0000","last_change":"2024-09-14T10:46:46.340953+0000","last_active":"2024-09-14T12:00:51.149223+0000","last_peered":"2024-09-14T12:00:51.149223+0000","last_clean":"2024-09-14T12:00:51.149223+0000","last_became_active":"2024-09-14T10:46:46.340612+0000","last_became_peered":"2024-09-14T10:46:46.340612+0000","last_unstale":"2024-09-14T12:00:51.149223+0000","last_undegraded":"2024-09-14T12:00:51.149223+0000","last_fullsized":"2024-09-14T12:00:51.149223+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":600,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:41.266834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3359,"num_read_kb":3045,"num_write":872,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"263'294","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.427907+0000","last_change":"2024-09-14T10:46:44.320649+0000","last_active":"2024-09-14T12:01:18.427907+0000","last_peered":"2024-09-14T12:01:18.427907+0000","last_clean":"2024-09-14T12:01:18.427907+0000","last_became_active":"2024-09-14T10:46:44.320254+0000","last_became_peered":"2024-09-14T10:46:44.320254+0000","last_unstale":"2024-09-14T12:01:18.427907+0000","last_undegraded":"2024-09-14T12:01:18.427907+0000","last_fullsized":"2024-09-14T12:01:18.427907+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:19.897879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6377850,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":557,"num_read_kb":18043,"num_write":1126,"num_write_kb":30368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"263'455","reported_seq":1884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.679270+0000","last_change":"2024-09-14T10:46:46.338061+0000","last_active":"2024-09-14T11:59:34.679270+0000","last_peered":"2024-09-14T11:59:34.679270+0000","last_clean":"2024-09-14T11:59:34.679270+0000","last_became_active":"2024-09-14T10:46:46.337092+0000","last_became_peered":"2024-09-14T10:46:46.337092+0000","last_unstale":"2024-09-14T11:59:34.679270+0000","last_undegraded":"2024-09-14T11:59:34.679270+0000","last_fullsized":"2024-09-14T11:59:34.679270+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:11.129363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2407,"num_read_kb":2236,"num_write":590,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"263'320","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.403504+0000","last_change":"2024-09-14T10:46:44.322511+0000","last_active":"2024-09-14T12:01:19.403504+0000","last_peered":"2024-09-14T12:01:19.403504+0000","last_clean":"2024-09-14T12:01:19.403504+0000","last_became_active":"2024-09-14T10:46:44.321098+0000","last_became_peered":"2024-09-14T10:46:44.321098+0000","last_unstale":"2024-09-14T12:01:19.403504+0000","last_undegraded":"2024-09-14T12:01:19.403504+0000","last_fullsized":"2024-09-14T12:01:19.403504+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:44.225925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":621,"num_read_kb":93491,"num_write":1039,"num_write_kb":33828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"263'561","reported_seq":2220,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:21.444561+0000","last_change":"2024-09-14T10:46:46.338161+0000","last_active":"2024-09-14T11:58:21.444561+0000","last_peered":"2024-09-14T11:58:21.444561+0000","last_clean":"2024-09-14T11:58:21.444561+0000","last_became_active":"2024-09-14T10:46:46.337883+0000","last_became_peered":"2024-09-14T10:46:46.337883+0000","last_unstale":"2024-09-14T11:58:21.444561+0000","last_undegraded":"2024-09-14T11:58:21.444561+0000","last_fullsized":"2024-09-14T11:58:21.444561+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:51.194169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3147,"num_read_kb":2923,"num_write":727,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"263'377","reported_seq":1056,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.349667+0000","last_change":"2024-09-14T10:46:44.325129+0000","last_active":"2024-09-14T12:01:19.349667+0000","last_peered":"2024-09-14T12:01:19.349667+0000","last_clean":"2024-09-14T12:01:19.349667+0000","last_became_active":"2024-09-14T10:46:44.324768+0000","last_became_peered":"2024-09-14T10:46:44.324768+0000","last_unstale":"2024-09-14T12:01:19.349667+0000","last_undegraded":"2024-09-14T12:01:19.349667+0000","last_fullsized":"2024-09-14T12:01:19.349667+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:07.568042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":706,"num_read_kb":82703,"num_write":1285,"num_write_kb":36007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"263'447","reported_seq":2074,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.606129+0000","last_change":"2024-09-14T10:46:46.342723+0000","last_active":"2024-09-14T11:58:55.606129+0000","last_peered":"2024-09-14T11:58:55.606129+0000","last_clean":"2024-09-14T11:58:55.606129+0000","last_became_active":"2024-09-14T10:46:46.338973+0000","last_became_peered":"2024-09-14T10:46:46.338973+0000","last_unstale":"2024-09-14T11:58:55.606129+0000","last_undegraded":"2024-09-14T11:58:55.606129+0000","last_fullsized":"2024-09-14T11:58:55.606129+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:09.155102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2500,"num_read_kb":2382,"num_write":507,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"263'357","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.378797+0000","last_change":"2024-09-14T10:46:44.320180+0000","last_active":"2024-09-14T12:01:19.378797+0000","last_peered":"2024-09-14T12:01:19.378797+0000","last_clean":"2024-09-14T12:01:19.378797+0000","last_became_active":"2024-09-14T10:46:44.319801+0000","last_became_peered":"2024-09-14T10:46:44.319801+0000","last_unstale":"2024-09-14T12:01:19.378797+0000","last_undegraded":"2024-09-14T12:01:19.378797+0000","last_fullsized":"2024-09-14T12:01:19.378797+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:56.539279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":563,"num_read_kb":13023,"num_write":1154,"num_write_kb":36371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"263'579","reported_seq":2155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:01.624820+0000","last_change":"2024-09-14T10:46:46.351079+0000","last_active":"2024-09-14T11:58:01.624820+0000","last_peered":"2024-09-14T11:58:01.624820+0000","last_clean":"2024-09-14T11:58:01.624820+0000","last_became_active":"2024-09-14T10:46:46.350776+0000","last_became_peered":"2024-09-14T10:46:46.350776+0000","last_unstale":"2024-09-14T11:58:01.624820+0000","last_undegraded":"2024-09-14T11:58:01.624820+0000","last_fullsized":"2024-09-14T11:58:01.624820+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:49.953237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3080,"num_read_kb":2791,"num_write":782,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"263'282","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.370814+0000","last_change":"2024-09-14T10:46:44.328019+0000","last_active":"2024-09-14T12:01:19.370814+0000","last_peered":"2024-09-14T12:01:19.370814+0000","last_clean":"2024-09-14T12:01:19.370814+0000","last_became_active":"2024-09-14T10:46:44.327650+0000","last_became_peered":"2024-09-14T10:46:44.327650+0000","last_unstale":"2024-09-14T12:01:19.370814+0000","last_undegraded":"2024-09-14T12:01:19.370814+0000","last_fullsized":"2024-09-14T12:01:19.370814+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:39.047825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":6055,"num_write":990,"num_write_kb":41392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"263'567","reported_seq":2315,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.213898+0000","last_change":"2024-09-14T10:46:46.341743+0000","last_active":"2024-09-14T11:58:37.213898+0000","last_peered":"2024-09-14T11:58:37.213898+0000","last_clean":"2024-09-14T11:58:37.213898+0000","last_became_active":"2024-09-14T10:46:46.341474+0000","last_became_peered":"2024-09-14T10:46:46.341474+0000","last_unstale":"2024-09-14T11:58:37.213898+0000","last_undegraded":"2024-09-14T11:58:37.213898+0000","last_fullsized":"2024-09-14T11:58:37.213898+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:59.495895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3094,"num_read_kb":2877,"num_write":684,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"263'314","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.457060+0000","last_change":"2024-09-14T10:46:44.335194+0000","last_active":"2024-09-14T12:01:18.457060+0000","last_peered":"2024-09-14T12:01:18.457060+0000","last_clean":"2024-09-14T12:01:18.457060+0000","last_became_active":"2024-09-14T10:46:44.334630+0000","last_became_peered":"2024-09-14T10:46:44.334630+0000","last_unstale":"2024-09-14T12:01:18.457060+0000","last_undegraded":"2024-09-14T12:01:18.457060+0000","last_fullsized":"2024-09-14T12:01:18.457060+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:39.166664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134082,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":598,"num_read_kb":14859,"num_write":1023,"num_write_kb":34853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"263'824","reported_seq":2407,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:43.469536+0000","last_change":"2024-09-14T10:46:46.350955+0000","last_active":"2024-09-14T11:59:43.469536+0000","last_peered":"2024-09-14T11:59:43.469536+0000","last_clean":"2024-09-14T11:59:43.469536+0000","last_became_active":"2024-09-14T10:46:46.350391+0000","last_became_peered":"2024-09-14T10:46:46.350391+0000","last_unstale":"2024-09-14T11:59:43.469536+0000","last_undegraded":"2024-09-14T11:59:43.469536+0000","last_fullsized":"2024-09-14T11:59:43.469536+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:02.579006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3863,"num_read_kb":3486,"num_write":1075,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"263'748","reported_seq":2166,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.350687+0000","last_change":"2024-09-14T10:46:46.336012+0000","last_active":"2024-09-14T11:58:44.350687+0000","last_peered":"2024-09-14T11:58:44.350687+0000","last_clean":"2024-09-14T11:58:44.350687+0000","last_became_active":"2024-09-14T10:46:46.335749+0000","last_became_peered":"2024-09-14T10:46:46.335749+0000","last_unstale":"2024-09-14T11:58:44.350687+0000","last_undegraded":"2024-09-14T11:58:44.350687+0000","last_fullsized":"2024-09-14T11:58:44.350687+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:42.586410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3617,"num_read_kb":3235,"num_write":1004,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"263'306","reported_seq":918,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.361253+0000","last_change":"2024-09-14T10:46:44.317211+0000","last_active":"2024-09-14T12:01:19.361253+0000","last_peered":"2024-09-14T12:01:19.361253+0000","last_clean":"2024-09-14T12:01:19.361253+0000","last_became_active":"2024-09-14T10:46:44.316741+0000","last_became_peered":"2024-09-14T10:46:44.316741+0000","last_unstale":"2024-09-14T12:01:19.361253+0000","last_undegraded":"2024-09-14T12:01:19.361253+0000","last_fullsized":"2024-09-14T12:01:19.361253+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:32.808931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133671,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":507,"num_read_kb":26974,"num_write":959,"num_write_kb":33080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"263'803","reported_seq":2496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.146195+0000","last_change":"2024-09-14T10:46:46.346277+0000","last_active":"2024-09-14T12:00:51.146195+0000","last_peered":"2024-09-14T12:00:51.146195+0000","last_clean":"2024-09-14T12:00:51.146195+0000","last_became_active":"2024-09-14T10:46:46.345709+0000","last_became_peered":"2024-09-14T10:46:46.345709+0000","last_unstale":"2024-09-14T12:00:51.146195+0000","last_undegraded":"2024-09-14T12:00:51.146195+0000","last_fullsized":"2024-09-14T12:00:51.146195+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:39.154901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3947,"num_read_kb":3606,"num_write":1038,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"263'367","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.353004+0000","last_change":"2024-09-14T10:46:44.331941+0000","last_active":"2024-09-14T12:01:19.353004+0000","last_peered":"2024-09-14T12:01:19.353004+0000","last_clean":"2024-09-14T12:01:19.353004+0000","last_became_active":"2024-09-14T10:46:44.331599+0000","last_became_peered":"2024-09-14T10:46:44.331599+0000","last_unstale":"2024-09-14T12:01:19.353004+0000","last_undegraded":"2024-09-14T12:01:19.353004+0000","last_fullsized":"2024-09-14T12:01:19.353004+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:14.551208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":622,"num_read_kb":2368,"num_write":1092,"num_write_kb":34113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"263'397","reported_seq":1959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.154005+0000","last_change":"2024-09-14T10:46:46.351133+0000","last_active":"2024-09-14T11:58:46.154005+0000","last_peered":"2024-09-14T11:58:46.154005+0000","last_clean":"2024-09-14T11:58:46.154005+0000","last_became_active":"2024-09-14T10:46:46.350525+0000","last_became_peered":"2024-09-14T10:46:46.350525+0000","last_unstale":"2024-09-14T11:58:46.154005+0000","last_undegraded":"2024-09-14T11:58:46.154005+0000","last_fullsized":"2024-09-14T11:58:46.154005+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:26.504718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2275,"num_read_kb":2173,"num_write":451,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"263'369","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.366438+0000","last_change":"2024-09-14T10:46:44.340215+0000","last_active":"2024-09-14T12:01:19.366438+0000","last_peered":"2024-09-14T12:01:19.366438+0000","last_clean":"2024-09-14T12:01:19.366438+0000","last_became_active":"2024-09-14T10:46:44.339871+0000","last_became_peered":"2024-09-14T10:46:44.339871+0000","last_unstale":"2024-09-14T12:01:19.366438+0000","last_undegraded":"2024-09-14T12:01:19.366438+0000","last_fullsized":"2024-09-14T12:01:19.366438+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:22.901003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":774,"num_read_kb":19273,"num_write":1249,"num_write_kb":53136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"263'1154","reported_seq":2712,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.102743+0000","last_change":"2024-09-14T10:46:46.349949+0000","last_active":"2024-09-14T11:58:40.102743+0000","last_peered":"2024-09-14T11:58:40.102743+0000","last_clean":"2024-09-14T11:58:40.102743+0000","last_became_active":"2024-09-14T10:46:46.349649+0000","last_became_peered":"2024-09-14T10:46:46.349649+0000","last_unstale":"2024-09-14T11:58:40.102743+0000","last_undegraded":"2024-09-14T11:58:40.102743+0000","last_fullsized":"2024-09-14T11:58:40.102743+0000","mapping_epoch":28,"log_start":"263'1100","ondisk_log_start":"263'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":1100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:46.563986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5238,"num_read_kb":4651,"num_write":1596,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"263'343","reported_seq":1077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.372572+0000","last_change":"2024-09-14T10:46:44.326980+0000","last_active":"2024-09-14T12:01:19.372572+0000","last_peered":"2024-09-14T12:01:19.372572+0000","last_clean":"2024-09-14T12:01:19.372572+0000","last_became_active":"2024-09-14T10:46:44.326645+0000","last_became_peered":"2024-09-14T10:46:44.326645+0000","last_unstale":"2024-09-14T12:01:19.372572+0000","last_undegraded":"2024-09-14T12:01:19.372572+0000","last_fullsized":"2024-09-14T12:01:19.372572+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:15.334289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":923,"num_read_kb":14272,"num_write":1148,"num_write_kb":16465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"263'962","reported_seq":2507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.465626+0000","last_change":"2024-09-14T10:46:46.347683+0000","last_active":"2024-09-14T11:59:18.465626+0000","last_peered":"2024-09-14T11:59:18.465626+0000","last_clean":"2024-09-14T11:59:18.465626+0000","last_became_active":"2024-09-14T10:46:46.347420+0000","last_became_peered":"2024-09-14T10:46:46.347420+0000","last_unstale":"2024-09-14T11:59:18.465626+0000","last_undegraded":"2024-09-14T11:59:18.465626+0000","last_fullsized":"2024-09-14T11:59:18.465626+0000","mapping_epoch":28,"log_start":"263'900","ondisk_log_start":"263'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":900,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:54.686257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5046,"num_read_kb":4563,"num_write":1374,"num_write_kb":542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"263'330","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.456962+0000","last_change":"2024-09-14T10:46:44.319508+0000","last_active":"2024-09-14T12:01:18.456962+0000","last_peered":"2024-09-14T12:01:18.456962+0000","last_clean":"2024-09-14T12:01:18.456962+0000","last_became_active":"2024-09-14T10:46:44.319146+0000","last_became_peered":"2024-09-14T10:46:44.319146+0000","last_unstale":"2024-09-14T12:01:18.456962+0000","last_undegraded":"2024-09-14T12:01:18.456962+0000","last_fullsized":"2024-09-14T12:01:18.456962+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:19.324787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2707,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":547,"num_read_kb":40906,"num_write":1026,"num_write_kb":34714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"263'374","reported_seq":1891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.351510+0000","last_change":"2024-09-14T10:46:46.339990+0000","last_active":"2024-09-14T11:58:44.351510+0000","last_peered":"2024-09-14T11:58:44.351510+0000","last_clean":"2024-09-14T11:58:44.351510+0000","last_became_active":"2024-09-14T10:46:46.339710+0000","last_became_peered":"2024-09-14T10:46:46.339710+0000","last_unstale":"2024-09-14T11:58:44.351510+0000","last_undegraded":"2024-09-14T11:58:44.351510+0000","last_fullsized":"2024-09-14T11:58:44.351510+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:06.635346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2075,"num_read_kb":1993,"num_write":416,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"263'288","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.517903+0000","last_change":"2024-09-14T10:46:44.318270+0000","last_active":"2024-09-14T12:01:18.517903+0000","last_peered":"2024-09-14T12:01:18.517903+0000","last_clean":"2024-09-14T12:01:18.517903+0000","last_became_active":"2024-09-14T10:46:44.317895+0000","last_became_peered":"2024-09-14T10:46:44.317895+0000","last_unstale":"2024-09-14T12:01:18.517903+0000","last_undegraded":"2024-09-14T12:01:18.517903+0000","last_fullsized":"2024-09-14T12:01:18.517903+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:29.484018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6321116,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":905,"num_read_kb":22980,"num_write":973,"num_write_kb":27989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"263'130","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.815076+0000","last_change":"2024-09-14T10:46:54.375921+0000","last_active":"2024-09-14T11:59:34.815076+0000","last_peered":"2024-09-14T11:59:34.815076+0000","last_clean":"2024-09-14T11:59:34.815076+0000","last_became_active":"2024-09-14T10:46:54.374769+0000","last_became_peered":"2024-09-14T10:46:54.374769+0000","last_unstale":"2024-09-14T11:59:34.815076+0000","last_undegraded":"2024-09-14T11:59:34.815076+0000","last_fullsized":"2024-09-14T11:59:34.815076+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:49.159300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":165,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"263'434","reported_seq":1984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.153364+0000","last_change":"2024-09-14T10:46:46.340520+0000","last_active":"2024-09-14T11:58:46.153364+0000","last_peered":"2024-09-14T11:58:46.153364+0000","last_clean":"2024-09-14T11:58:46.153364+0000","last_became_active":"2024-09-14T10:46:46.340169+0000","last_became_peered":"2024-09-14T10:46:46.340169+0000","last_unstale":"2024-09-14T11:58:46.153364+0000","last_undegraded":"2024-09-14T11:58:46.153364+0000","last_fullsized":"2024-09-14T11:58:46.153364+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:30.021599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2291,"num_read_kb":2165,"num_write":484,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"263'355","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.534172+0000","last_change":"2024-09-14T10:47:18.794218+0000","last_active":"2024-09-14T12:01:18.534172+0000","last_peered":"2024-09-14T12:01:18.534172+0000","last_clean":"2024-09-14T12:01:18.534172+0000","last_became_active":"2024-09-14T10:47:18.793917+0000","last_became_peered":"2024-09-14T10:47:18.793917+0000","last_unstale":"2024-09-14T12:01:18.534172+0000","last_undegraded":"2024-09-14T12:01:18.534172+0000","last_fullsized":"2024-09-14T12:01:18.534172+0000","mapping_epoch":39,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:04.969640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17175143,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":690,"num_read_kb":48706,"num_write":1283,"num_write_kb":50304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.519271+0000","last_change":"2024-09-14T10:46:48.357072+0000","last_active":"2024-09-14T11:56:55.519271+0000","last_peered":"2024-09-14T11:56:55.519271+0000","last_clean":"2024-09-14T11:56:55.519271+0000","last_became_active":"2024-09-14T10:46:48.356776+0000","last_became_peered":"2024-09-14T10:46:48.356776+0000","last_unstale":"2024-09-14T11:56:55.519271+0000","last_undegraded":"2024-09-14T11:56:55.519271+0000","last_fullsized":"2024-09-14T11:56:55.519271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:33.998552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"263'353","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.009177+0000","last_change":"2024-09-14T10:46:50.360895+0000","last_active":"2024-09-14T12:01:18.009177+0000","last_peered":"2024-09-14T12:01:18.009177+0000","last_clean":"2024-09-14T12:01:18.009177+0000","last_became_active":"2024-09-14T10:46:50.359481+0000","last_became_peered":"2024-09-14T10:46:50.359481+0000","last_unstale":"2024-09-14T12:01:18.009177+0000","last_undegraded":"2024-09-14T12:01:18.009177+0000","last_fullsized":"2024-09-14T12:01:18.009177+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:57.049513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51669,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":564,"num_read_kb":1178,"num_write":444,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.396876+0000","last_change":"2024-09-14T10:46:52.373231+0000","last_active":"2024-09-14T11:57:00.396876+0000","last_peered":"2024-09-14T11:57:00.396876+0000","last_clean":"2024-09-14T11:57:00.396876+0000","last_became_active":"2024-09-14T10:46:52.372941+0000","last_became_peered":"2024-09-14T10:46:52.372941+0000","last_unstale":"2024-09-14T11:57:00.396876+0000","last_undegraded":"2024-09-14T11:57:00.396876+0000","last_fullsized":"2024-09-14T11:57:00.396876+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:39.029048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"263'153","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:57.663650+0000","last_change":"2024-09-14T10:46:54.387774+0000","last_active":"2024-09-14T11:57:57.663650+0000","last_peered":"2024-09-14T11:57:57.663650+0000","last_clean":"2024-09-14T11:57:57.663650+0000","last_became_active":"2024-09-14T10:46:54.387445+0000","last_became_peered":"2024-09-14T10:46:54.387445+0000","last_unstale":"2024-09-14T11:57:57.663650+0000","last_undegraded":"2024-09-14T11:57:57.663650+0000","last_fullsized":"2024-09-14T11:57:57.663650+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:41.372638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":80,"num_write":348,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"263'551","reported_seq":2271,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.139453+0000","last_change":"2024-09-14T10:46:46.340740+0000","last_active":"2024-09-14T12:00:51.139453+0000","last_peered":"2024-09-14T12:00:51.139453+0000","last_clean":"2024-09-14T12:00:51.139453+0000","last_became_active":"2024-09-14T10:46:46.340242+0000","last_became_peered":"2024-09-14T10:46:46.340242+0000","last_unstale":"2024-09-14T12:00:51.139453+0000","last_undegraded":"2024-09-14T12:00:51.139453+0000","last_fullsized":"2024-09-14T12:00:51.139453+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:58.555963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3138,"num_read_kb":2920,"num_write":702,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"263'309","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.495782+0000","last_change":"2024-09-14T10:46:44.335171+0000","last_active":"2024-09-14T12:01:18.495782+0000","last_peered":"2024-09-14T12:01:18.495782+0000","last_clean":"2024-09-14T12:01:18.495782+0000","last_became_active":"2024-09-14T10:46:44.334757+0000","last_became_peered":"2024-09-14T10:46:44.334757+0000","last_unstale":"2024-09-14T12:01:18.495782+0000","last_undegraded":"2024-09-14T12:01:18.495782+0000","last_fullsized":"2024-09-14T12:01:18.495782+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:06.067815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7425373,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":607,"num_read_kb":20083,"num_write":1052,"num_write_kb":20918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:05.634732+0000","last_change":"2024-09-14T10:46:48.352082+0000","last_active":"2024-09-14T11:57:05.634732+0000","last_peered":"2024-09-14T11:57:05.634732+0000","last_clean":"2024-09-14T11:57:05.634732+0000","last_became_active":"2024-09-14T10:46:48.351825+0000","last_became_peered":"2024-09-14T10:46:48.351825+0000","last_unstale":"2024-09-14T11:57:05.634732+0000","last_undegraded":"2024-09-14T11:57:05.634732+0000","last_fullsized":"2024-09-14T11:57:05.634732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:28.324093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"263'101","reported_seq":633,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.413259+0000","last_change":"2024-09-14T10:46:50.360973+0000","last_active":"2024-09-14T11:59:20.413259+0000","last_peered":"2024-09-14T11:59:20.413259+0000","last_clean":"2024-09-14T11:59:20.413259+0000","last_became_active":"2024-09-14T10:46:50.360649+0000","last_became_peered":"2024-09-14T10:46:50.360649+0000","last_unstale":"2024-09-14T11:59:20.413259+0000","last_undegraded":"2024-09-14T11:59:20.413259+0000","last_fullsized":"2024-09-14T11:59:20.413259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:09.131081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.396818+0000","last_change":"2024-09-14T10:46:52.373120+0000","last_active":"2024-09-14T11:57:00.396818+0000","last_peered":"2024-09-14T11:57:00.396818+0000","last_clean":"2024-09-14T11:57:00.396818+0000","last_became_active":"2024-09-14T10:46:52.372770+0000","last_became_peered":"2024-09-14T10:46:52.372770+0000","last_unstale":"2024-09-14T11:57:00.396818+0000","last_undegraded":"2024-09-14T11:57:00.396818+0000","last_fullsized":"2024-09-14T11:57:00.396818+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:37.866381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"263'140","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.088657+0000","last_change":"2024-09-14T10:46:54.389893+0000","last_active":"2024-09-14T11:58:40.088657+0000","last_peered":"2024-09-14T11:58:40.088657+0000","last_clean":"2024-09-14T11:58:40.088657+0000","last_became_active":"2024-09-14T10:46:54.389638+0000","last_became_peered":"2024-09-14T10:46:54.389638+0000","last_unstale":"2024-09-14T11:58:40.088657+0000","last_undegraded":"2024-09-14T11:58:40.088657+0000","last_fullsized":"2024-09-14T11:58:40.088657+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:21.500685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":168,"num_write":356,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"263'449","reported_seq":2187,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.135482+0000","last_change":"2024-09-14T10:46:46.344810+0000","last_active":"2024-09-14T12:00:51.135482+0000","last_peered":"2024-09-14T12:00:51.135482+0000","last_clean":"2024-09-14T12:00:51.135482+0000","last_became_active":"2024-09-14T10:46:46.344509+0000","last_became_peered":"2024-09-14T10:46:46.344509+0000","last_unstale":"2024-09-14T12:00:51.135482+0000","last_undegraded":"2024-09-14T12:00:51.135482+0000","last_fullsized":"2024-09-14T12:00:51.135482+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:33.760349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2693,"num_read_kb":2571,"num_write":507,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"263'330","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.376042+0000","last_change":"2024-09-14T10:46:44.331833+0000","last_active":"2024-09-14T12:01:19.376042+0000","last_peered":"2024-09-14T12:01:19.376042+0000","last_clean":"2024-09-14T12:01:19.376042+0000","last_became_active":"2024-09-14T10:46:44.331464+0000","last_became_peered":"2024-09-14T10:46:44.331464+0000","last_unstale":"2024-09-14T12:01:19.376042+0000","last_undegraded":"2024-09-14T12:01:19.376042+0000","last_fullsized":"2024-09-14T12:01:19.376042+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:29.473170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267319,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":652,"num_read_kb":48168,"num_write":1033,"num_write_kb":26849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.633150+0000","last_change":"2024-09-14T10:46:48.357687+0000","last_active":"2024-09-14T11:56:55.633150+0000","last_peered":"2024-09-14T11:56:55.633150+0000","last_clean":"2024-09-14T11:56:55.633150+0000","last_became_active":"2024-09-14T10:46:48.357301+0000","last_became_peered":"2024-09-14T10:46:48.357301+0000","last_unstale":"2024-09-14T11:56:55.633150+0000","last_undegraded":"2024-09-14T11:56:55.633150+0000","last_fullsized":"2024-09-14T11:56:55.633150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:33.501824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"263'138","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:57.686128+0000","last_change":"2024-09-14T10:46:50.363764+0000","last_active":"2024-09-14T11:57:57.686128+0000","last_peered":"2024-09-14T11:57:57.686128+0000","last_clean":"2024-09-14T11:57:57.686128+0000","last_became_active":"2024-09-14T10:46:50.363495+0000","last_became_peered":"2024-09-14T10:46:50.363495+0000","last_unstale":"2024-09-14T11:57:57.686128+0000","last_undegraded":"2024-09-14T11:57:57.686128+0000","last_fullsized":"2024-09-14T11:57:57.686128+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:49:45.053503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":162,"num_write":114,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"263'792","reported_seq":2727,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.488837+0000","last_change":"2024-09-14T10:46:52.374170+0000","last_active":"2024-09-14T12:01:18.488837+0000","last_peered":"2024-09-14T12:01:18.488837+0000","last_clean":"2024-09-14T12:01:18.488837+0000","last_became_active":"2024-09-14T10:46:52.373886+0000","last_became_peered":"2024-09-14T10:46:52.373886+0000","last_unstale":"2024-09-14T12:01:18.488837+0000","last_undegraded":"2024-09-14T12:01:18.488837+0000","last_fullsized":"2024-09-14T12:01:18.488837+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:54.230847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"263'181","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.721550+0000","last_change":"2024-09-14T10:46:54.388494+0000","last_active":"2024-09-14T11:59:33.721550+0000","last_peered":"2024-09-14T11:59:33.721550+0000","last_clean":"2024-09-14T11:59:33.721550+0000","last_became_active":"2024-09-14T10:46:54.388186+0000","last_became_peered":"2024-09-14T10:46:54.388186+0000","last_unstale":"2024-09-14T11:59:33.721550+0000","last_undegraded":"2024-09-14T11:59:33.721550+0000","last_fullsized":"2024-09-14T11:59:33.721550+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:38.806003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":561,"num_read_kb":561,"num_write":378,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"263'893","reported_seq":2326,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:57.678509+0000","last_change":"2024-09-14T10:46:46.351792+0000","last_active":"2024-09-14T11:57:57.678509+0000","last_peered":"2024-09-14T11:57:57.678509+0000","last_clean":"2024-09-14T11:57:57.678509+0000","last_became_active":"2024-09-14T10:46:46.351453+0000","last_became_peered":"2024-09-14T10:46:46.351453+0000","last_unstale":"2024-09-14T11:57:57.678509+0000","last_undegraded":"2024-09-14T11:57:57.678509+0000","last_fullsized":"2024-09-14T11:57:57.678509+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":800,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:43.929395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4193,"num_read_kb":3693,"num_write":1250,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"263'366","reported_seq":1042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.303300+0000","last_change":"2024-09-14T10:46:44.329000+0000","last_active":"2024-09-14T12:01:19.303300+0000","last_peered":"2024-09-14T12:01:19.303300+0000","last_clean":"2024-09-14T12:01:19.303300+0000","last_became_active":"2024-09-14T10:46:44.328531+0000","last_became_peered":"2024-09-14T10:46:44.328531+0000","last_unstale":"2024-09-14T12:01:19.303300+0000","last_undegraded":"2024-09-14T12:01:19.303300+0000","last_fullsized":"2024-09-14T12:01:19.303300+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:52.656623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":728,"num_read_kb":24160,"num_write":1182,"num_write_kb":50074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.519306+0000","last_change":"2024-09-14T10:46:48.349347+0000","last_active":"2024-09-14T11:56:55.519306+0000","last_peered":"2024-09-14T11:56:55.519306+0000","last_clean":"2024-09-14T11:56:55.519306+0000","last_became_active":"2024-09-14T10:46:48.348899+0000","last_became_peered":"2024-09-14T10:46:48.348899+0000","last_unstale":"2024-09-14T11:56:55.519306+0000","last_undegraded":"2024-09-14T11:56:55.519306+0000","last_fullsized":"2024-09-14T11:56:55.519306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:31.899725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"263'308","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.717489+0000","last_change":"2024-09-14T10:46:50.366037+0000","last_active":"2024-09-14T12:01:17.717489+0000","last_peered":"2024-09-14T12:01:17.717489+0000","last_clean":"2024-09-14T12:01:17.717489+0000","last_became_active":"2024-09-14T10:46:50.365721+0000","last_became_peered":"2024-09-14T10:46:50.365721+0000","last_unstale":"2024-09-14T12:01:17.717489+0000","last_undegraded":"2024-09-14T12:01:17.717489+0000","last_fullsized":"2024-09-14T12:01:17.717489+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:37.431750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47247,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":1144,"num_write":408,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"263'829","reported_seq":2738,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.431796+0000","last_change":"2024-09-14T10:46:52.375010+0000","last_active":"2024-09-14T12:01:17.431796+0000","last_peered":"2024-09-14T12:01:17.431796+0000","last_clean":"2024-09-14T12:01:17.431796+0000","last_became_active":"2024-09-14T10:46:52.374634+0000","last_became_peered":"2024-09-14T10:46:52.374634+0000","last_unstale":"2024-09-14T12:01:17.431796+0000","last_undegraded":"2024-09-14T12:01:17.431796+0000","last_fullsized":"2024-09-14T12:01:17.431796+0000","mapping_epoch":34,"log_start":"263'800","ondisk_log_start":"263'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:57:14.899442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"263'522","reported_seq":2102,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.138196+0000","last_change":"2024-09-14T10:46:46.342236+0000","last_active":"2024-09-14T12:00:51.138196+0000","last_peered":"2024-09-14T12:00:51.138196+0000","last_clean":"2024-09-14T12:00:51.138196+0000","last_became_active":"2024-09-14T10:46:46.341971+0000","last_became_peered":"2024-09-14T10:46:46.341971+0000","last_unstale":"2024-09-14T12:00:51.138196+0000","last_undegraded":"2024-09-14T12:00:51.138196+0000","last_fullsized":"2024-09-14T12:00:51.138196+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:12.438399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2719,"num_read_kb":2513,"num_write":653,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"263'361","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.327021+0000","last_change":"2024-09-14T10:46:44.330242+0000","last_active":"2024-09-14T12:01:19.327021+0000","last_peered":"2024-09-14T12:01:19.327021+0000","last_clean":"2024-09-14T12:01:19.327021+0000","last_became_active":"2024-09-14T10:46:44.329782+0000","last_became_peered":"2024-09-14T10:46:44.329782+0000","last_unstale":"2024-09-14T12:01:19.327021+0000","last_undegraded":"2024-09-14T12:01:19.327021+0000","last_fullsized":"2024-09-14T12:01:19.327021+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:57.094973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":606,"num_read_kb":47823,"num_write":1082,"num_write_kb":48255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.405202+0000","last_change":"2024-09-14T10:46:48.352873+0000","last_active":"2024-09-14T11:58:20.405202+0000","last_peered":"2024-09-14T11:58:20.405202+0000","last_clean":"2024-09-14T11:58:20.405202+0000","last_became_active":"2024-09-14T10:46:48.352584+0000","last_became_peered":"2024-09-14T10:46:48.352584+0000","last_unstale":"2024-09-14T11:58:20.405202+0000","last_undegraded":"2024-09-14T11:58:20.405202+0000","last_fullsized":"2024-09-14T11:58:20.405202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:32.483930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"263'416","reported_seq":1057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.280535+0000","last_change":"2024-09-14T10:46:50.364803+0000","last_active":"2024-09-14T12:01:18.280535+0000","last_peered":"2024-09-14T12:01:18.280535+0000","last_clean":"2024-09-14T12:01:18.280535+0000","last_became_active":"2024-09-14T10:46:50.364438+0000","last_became_peered":"2024-09-14T10:46:50.364438+0000","last_unstale":"2024-09-14T12:01:18.280535+0000","last_undegraded":"2024-09-14T12:01:18.280535+0000","last_fullsized":"2024-09-14T12:01:18.280535+0000","mapping_epoch":32,"log_start":"263'400","ondisk_log_start":"263'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:41.620765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46781,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":687,"num_read_kb":1416,"num_write":538,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.526559+0000","last_change":"2024-09-14T10:46:52.368160+0000","last_active":"2024-09-14T11:58:53.526559+0000","last_peered":"2024-09-14T11:58:53.526559+0000","last_clean":"2024-09-14T11:58:53.526559+0000","last_became_active":"2024-09-14T10:46:52.367874+0000","last_became_peered":"2024-09-14T10:46:52.367874+0000","last_unstale":"2024-09-14T11:58:53.526559+0000","last_undegraded":"2024-09-14T11:58:53.526559+0000","last_fullsized":"2024-09-14T11:58:53.526559+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:15.594681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"263'556","reported_seq":1397,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:52.309850+0000","last_change":"2024-09-14T10:46:54.390213+0000","last_active":"2024-09-14T12:00:52.309850+0000","last_peered":"2024-09-14T12:00:52.309850+0000","last_clean":"2024-09-14T12:00:52.309850+0000","last_became_active":"2024-09-14T10:46:54.389880+0000","last_became_peered":"2024-09-14T10:46:54.389880+0000","last_unstale":"2024-09-14T12:00:52.309850+0000","last_undegraded":"2024-09-14T12:00:52.309850+0000","last_fullsized":"2024-09-14T12:00:52.309850+0000","mapping_epoch":36,"log_start":"263'500","ondisk_log_start":"263'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:56.630763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1361,"num_read_kb":1337,"num_write":1147,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"263'1285","reported_seq":3010,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.405223+0000","last_change":"2024-09-14T10:46:46.343876+0000","last_active":"2024-09-14T11:58:20.405223+0000","last_peered":"2024-09-14T11:58:20.405223+0000","last_clean":"2024-09-14T11:58:20.405223+0000","last_became_active":"2024-09-14T10:46:46.343603+0000","last_became_peered":"2024-09-14T10:46:46.343603+0000","last_unstale":"2024-09-14T11:58:20.405223+0000","last_undegraded":"2024-09-14T11:58:20.405223+0000","last_fullsized":"2024-09-14T11:58:20.405223+0000","mapping_epoch":28,"log_start":"263'1200","ondisk_log_start":"263'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":1200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:55:04.271839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6021,"num_read_kb":5313,"num_write":1785,"num_write_kb":753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"263'327","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.263699+0000","last_change":"2024-09-14T10:46:44.323710+0000","last_active":"2024-09-14T12:01:19.263699+0000","last_peered":"2024-09-14T12:01:19.263699+0000","last_clean":"2024-09-14T12:01:19.263699+0000","last_became_active":"2024-09-14T10:46:44.322816+0000","last_became_peered":"2024-09-14T10:46:44.322816+0000","last_unstale":"2024-09-14T12:01:19.263699+0000","last_undegraded":"2024-09-14T12:01:19.263699+0000","last_fullsized":"2024-09-14T12:01:19.263699+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:37.849009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":492,"num_write":1114,"num_write_kb":29298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:18.521465+0000","last_change":"2024-09-14T10:46:48.352278+0000","last_active":"2024-09-14T11:58:18.521465+0000","last_peered":"2024-09-14T11:58:18.521465+0000","last_clean":"2024-09-14T11:58:18.521465+0000","last_became_active":"2024-09-14T10:46:48.351893+0000","last_became_peered":"2024-09-14T10:46:48.351893+0000","last_unstale":"2024-09-14T11:58:18.521465+0000","last_undegraded":"2024-09-14T11:58:18.521465+0000","last_fullsized":"2024-09-14T11:58:18.521465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:17.258684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"263'265","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.043439+0000","last_change":"2024-09-14T10:46:50.360064+0000","last_active":"2024-09-14T12:01:19.043439+0000","last_peered":"2024-09-14T12:01:19.043439+0000","last_clean":"2024-09-14T12:01:19.043439+0000","last_became_active":"2024-09-14T10:46:50.359434+0000","last_became_peered":"2024-09-14T10:46:50.359434+0000","last_unstale":"2024-09-14T12:01:19.043439+0000","last_undegraded":"2024-09-14T12:01:19.043439+0000","last_fullsized":"2024-09-14T12:01:19.043439+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:38.484631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44011,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":1031,"num_write":356,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.648763+0000","last_change":"2024-09-14T10:46:52.369655+0000","last_active":"2024-09-14T11:58:40.648763+0000","last_peered":"2024-09-14T11:58:40.648763+0000","last_clean":"2024-09-14T11:58:40.648763+0000","last_became_active":"2024-09-14T10:46:52.369353+0000","last_became_peered":"2024-09-14T10:46:52.369353+0000","last_unstale":"2024-09-14T11:58:40.648763+0000","last_undegraded":"2024-09-14T11:58:40.648763+0000","last_fullsized":"2024-09-14T11:58:40.648763+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:30.464066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"263'2541","reported_seq":4365,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:00.417652+0000","last_change":"2024-09-14T10:46:54.383401+0000","last_active":"2024-09-14T12:00:00.417652+0000","last_peered":"2024-09-14T12:00:00.417652+0000","last_clean":"2024-09-14T12:00:00.417652+0000","last_became_active":"2024-09-14T10:46:54.383100+0000","last_became_peered":"2024-09-14T10:46:54.383100+0000","last_unstale":"2024-09-14T12:00:00.417652+0000","last_undegraded":"2024-09-14T12:00:00.417652+0000","last_fullsized":"2024-09-14T12:00:00.417652+0000","mapping_epoch":36,"log_start":"263'2500","ondisk_log_start":"263'2500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":2500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:25.507491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6216,"num_read_kb":6221,"num_write":5164,"num_write_kb":1877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"263'513","reported_seq":2285,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.759401+0000","last_change":"2024-09-14T10:46:46.338242+0000","last_active":"2024-09-14T11:59:29.759401+0000","last_peered":"2024-09-14T11:59:29.759401+0000","last_clean":"2024-09-14T11:59:29.759401+0000","last_became_active":"2024-09-14T10:46:46.337951+0000","last_became_peered":"2024-09-14T10:46:46.337951+0000","last_unstale":"2024-09-14T11:59:29.759401+0000","last_undegraded":"2024-09-14T11:59:29.759401+0000","last_fullsized":"2024-09-14T11:59:29.759401+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":500,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:40.454176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2937,"num_read_kb":2795,"num_write":635,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"263'349","reported_seq":1028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.342519+0000","last_change":"2024-09-14T10:46:44.334345+0000","last_active":"2024-09-14T12:01:19.342519+0000","last_peered":"2024-09-14T12:01:19.342519+0000","last_clean":"2024-09-14T12:01:19.342519+0000","last_became_active":"2024-09-14T10:46:44.331705+0000","last_became_peered":"2024-09-14T10:46:44.331705+0000","last_unstale":"2024-09-14T12:01:19.342519+0000","last_undegraded":"2024-09-14T12:01:19.342519+0000","last_fullsized":"2024-09-14T12:01:19.342519+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:08.805234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":652,"num_read_kb":33315,"num_write":1115,"num_write_kb":35089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.460327+0000","last_change":"2024-09-14T10:46:48.355757+0000","last_active":"2024-09-14T11:58:48.460327+0000","last_peered":"2024-09-14T11:58:48.460327+0000","last_clean":"2024-09-14T11:58:48.460327+0000","last_became_active":"2024-09-14T10:46:48.354092+0000","last_became_peered":"2024-09-14T10:46:48.354092+0000","last_unstale":"2024-09-14T11:58:48.460327+0000","last_undegraded":"2024-09-14T11:58:48.460327+0000","last_fullsized":"2024-09-14T11:58:48.460327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:49.272454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"263'342","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.405360+0000","last_change":"2024-09-14T10:46:50.364160+0000","last_active":"2024-09-14T12:01:18.405360+0000","last_peered":"2024-09-14T12:01:18.405360+0000","last_clean":"2024-09-14T12:01:18.405360+0000","last_became_active":"2024-09-14T10:46:50.363893+0000","last_became_peered":"2024-09-14T10:46:50.363893+0000","last_unstale":"2024-09-14T12:01:18.405360+0000","last_undegraded":"2024-09-14T12:01:18.405360+0000","last_fullsized":"2024-09-14T12:01:18.405360+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:50.322137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44240,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":541,"num_read_kb":1145,"num_write":426,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"263'829","reported_seq":5034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.433012+0000","last_change":"2024-09-14T10:46:52.374414+0000","last_active":"2024-09-14T12:01:17.433012+0000","last_peered":"2024-09-14T12:01:17.433012+0000","last_clean":"2024-09-14T12:01:17.433012+0000","last_became_active":"2024-09-14T10:46:52.374152+0000","last_became_peered":"2024-09-14T10:46:52.374152+0000","last_unstale":"2024-09-14T12:01:17.433012+0000","last_undegraded":"2024-09-14T12:01:17.433012+0000","last_fullsized":"2024-09-14T12:01:17.433012+0000","mapping_epoch":34,"log_start":"263'800","ondisk_log_start":"263'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:31.267699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"263'166","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:50.989484+0000","last_change":"2024-09-14T10:46:54.384757+0000","last_active":"2024-09-14T12:00:50.989484+0000","last_peered":"2024-09-14T12:00:50.989484+0000","last_clean":"2024-09-14T12:00:50.989484+0000","last_became_active":"2024-09-14T10:46:54.383953+0000","last_became_peered":"2024-09-14T10:46:54.383953+0000","last_unstale":"2024-09-14T12:00:50.989484+0000","last_undegraded":"2024-09-14T12:00:50.989484+0000","last_fullsized":"2024-09-14T12:00:50.989484+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:54.206656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":135,"num_write":398,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"263'1056","reported_seq":2528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.757882+0000","last_change":"2024-09-14T10:46:46.348971+0000","last_active":"2024-09-14T11:59:29.757882+0000","last_peered":"2024-09-14T11:59:29.757882+0000","last_clean":"2024-09-14T11:59:29.757882+0000","last_became_active":"2024-09-14T10:46:46.348726+0000","last_became_peered":"2024-09-14T10:46:46.348726+0000","last_unstale":"2024-09-14T11:59:29.757882+0000","last_undegraded":"2024-09-14T11:59:29.757882+0000","last_fullsized":"2024-09-14T11:59:29.757882+0000","mapping_epoch":28,"log_start":"263'1000","ondisk_log_start":"263'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":1000,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:17.855534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4827,"num_read_kb":4287,"num_write":1450,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"263'309","reported_seq":937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.323555+0000","last_change":"2024-09-14T10:46:44.332957+0000","last_active":"2024-09-14T12:01:19.323555+0000","last_peered":"2024-09-14T12:01:19.323555+0000","last_clean":"2024-09-14T12:01:19.323555+0000","last_became_active":"2024-09-14T10:46:44.332535+0000","last_became_peered":"2024-09-14T10:46:44.332535+0000","last_unstale":"2024-09-14T12:01:19.323555+0000","last_undegraded":"2024-09-14T12:01:19.323555+0000","last_fullsized":"2024-09-14T12:01:19.323555+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:28.026211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267347,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":39478,"num_write":1028,"num_write_kb":35728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:28.522894+0000","last_change":"2024-09-14T10:46:48.351883+0000","last_active":"2024-09-14T11:58:28.522894+0000","last_peered":"2024-09-14T11:58:28.522894+0000","last_clean":"2024-09-14T11:58:28.522894+0000","last_became_active":"2024-09-14T10:46:48.351530+0000","last_became_peered":"2024-09-14T10:46:48.351530+0000","last_unstale":"2024-09-14T11:58:28.522894+0000","last_undegraded":"2024-09-14T11:58:28.522894+0000","last_fullsized":"2024-09-14T11:58:28.522894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:09.714239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"263'470","reported_seq":1118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.227822+0000","last_change":"2024-09-14T10:46:50.361756+0000","last_active":"2024-09-14T12:01:19.227822+0000","last_peered":"2024-09-14T12:01:19.227822+0000","last_clean":"2024-09-14T12:01:19.227822+0000","last_became_active":"2024-09-14T10:46:50.361396+0000","last_became_peered":"2024-09-14T10:46:50.361396+0000","last_unstale":"2024-09-14T12:01:19.227822+0000","last_undegraded":"2024-09-14T12:01:19.227822+0000","last_fullsized":"2024-09-14T12:01:19.227822+0000","mapping_epoch":32,"log_start":"263'400","ondisk_log_start":"263'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:24.662180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93223,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":821,"num_read_kb":1952,"num_write":664,"num_write_kb":533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.456158+0000","last_change":"2024-09-14T10:46:52.373915+0000","last_active":"2024-09-14T11:58:23.456158+0000","last_peered":"2024-09-14T11:58:23.456158+0000","last_clean":"2024-09-14T11:58:23.456158+0000","last_became_active":"2024-09-14T10:46:52.373563+0000","last_became_peered":"2024-09-14T10:46:52.373563+0000","last_unstale":"2024-09-14T11:58:23.456158+0000","last_undegraded":"2024-09-14T11:58:23.456158+0000","last_fullsized":"2024-09-14T11:58:23.456158+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:22.900348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"263'160","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:25.446650+0000","last_change":"2024-09-14T10:46:54.389096+0000","last_active":"2024-09-14T11:58:25.446650+0000","last_peered":"2024-09-14T11:58:25.446650+0000","last_clean":"2024-09-14T11:58:25.446650+0000","last_became_active":"2024-09-14T10:46:54.388429+0000","last_became_peered":"2024-09-14T10:46:54.388429+0000","last_unstale":"2024-09-14T11:58:25.446650+0000","last_undegraded":"2024-09-14T11:58:25.446650+0000","last_fullsized":"2024-09-14T11:58:25.446650+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:38.481519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":168,"num_write":381,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"263'889","reported_seq":2640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.496852+0000","last_change":"2024-09-14T10:46:46.344318+0000","last_active":"2024-09-14T11:59:49.496852+0000","last_peered":"2024-09-14T11:59:49.496852+0000","last_clean":"2024-09-14T11:59:49.496852+0000","last_became_active":"2024-09-14T10:46:46.344022+0000","last_became_peered":"2024-09-14T10:46:46.344022+0000","last_unstale":"2024-09-14T11:59:49.496852+0000","last_undegraded":"2024-09-14T11:59:49.496852+0000","last_fullsized":"2024-09-14T11:59:49.496852+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":800,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:44.527085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4406,"num_read_kb":4005,"num_write":1167,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"263'312","reported_seq":980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.371004+0000","last_change":"2024-09-14T10:46:44.318998+0000","last_active":"2024-09-14T12:01:19.371004+0000","last_peered":"2024-09-14T12:01:19.371004+0000","last_clean":"2024-09-14T12:01:19.371004+0000","last_became_active":"2024-09-14T10:46:44.318584+0000","last_became_peered":"2024-09-14T10:46:44.318584+0000","last_unstale":"2024-09-14T12:01:19.371004+0000","last_undegraded":"2024-09-14T12:01:19.371004+0000","last_fullsized":"2024-09-14T12:01:19.371004+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:23.546671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":581,"num_read_kb":7202,"num_write":854,"num_write_kb":20635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.450101+0000","last_change":"2024-09-14T10:46:48.355970+0000","last_active":"2024-09-14T11:58:50.450101+0000","last_peered":"2024-09-14T11:58:50.450101+0000","last_clean":"2024-09-14T11:58:50.450101+0000","last_became_active":"2024-09-14T10:46:48.355691+0000","last_became_peered":"2024-09-14T10:46:48.355691+0000","last_unstale":"2024-09-14T11:58:50.450101+0000","last_undegraded":"2024-09-14T11:58:50.450101+0000","last_fullsized":"2024-09-14T11:58:50.450101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:57.269685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"263'341","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.293202+0000","last_change":"2024-09-14T10:46:50.363028+0000","last_active":"2024-09-14T12:01:19.293202+0000","last_peered":"2024-09-14T12:01:19.293202+0000","last_clean":"2024-09-14T12:01:19.293202+0000","last_became_active":"2024-09-14T10:46:50.362757+0000","last_became_peered":"2024-09-14T10:46:50.362757+0000","last_unstale":"2024-09-14T12:01:19.293202+0000","last_undegraded":"2024-09-14T12:01:19.293202+0000","last_fullsized":"2024-09-14T12:01:19.293202+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:26.991536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":590,"num_read_kb":1339,"num_write":526,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.434234+0000","last_change":"2024-09-14T10:46:52.374126+0000","last_active":"2024-09-14T11:56:55.434234+0000","last_peered":"2024-09-14T11:56:55.434234+0000","last_clean":"2024-09-14T11:56:55.434234+0000","last_became_active":"2024-09-14T10:46:52.373836+0000","last_became_peered":"2024-09-14T10:46:52.373836+0000","last_unstale":"2024-09-14T11:56:55.434234+0000","last_undegraded":"2024-09-14T11:56:55.434234+0000","last_fullsized":"2024-09-14T11:56:55.434234+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:57.883157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"263'94","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:41.091887+0000","last_change":"2024-09-14T10:46:54.387376+0000","last_active":"2024-09-14T12:00:41.091887+0000","last_peered":"2024-09-14T12:00:41.091887+0000","last_clean":"2024-09-14T12:00:41.091887+0000","last_became_active":"2024-09-14T10:46:54.387066+0000","last_became_peered":"2024-09-14T10:46:54.387066+0000","last_unstale":"2024-09-14T12:00:41.091887+0000","last_undegraded":"2024-09-14T12:00:41.091887+0000","last_fullsized":"2024-09-14T12:00:41.091887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:19.903031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":95,"num_write":224,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"263'1164","reported_seq":2674,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.498768+0000","last_change":"2024-09-14T10:46:46.340659+0000","last_active":"2024-09-14T11:59:49.498768+0000","last_peered":"2024-09-14T11:59:49.498768+0000","last_clean":"2024-09-14T11:59:49.498768+0000","last_became_active":"2024-09-14T10:46:46.340228+0000","last_became_peered":"2024-09-14T10:46:46.340228+0000","last_unstale":"2024-09-14T11:59:49.498768+0000","last_undegraded":"2024-09-14T11:59:49.498768+0000","last_fullsized":"2024-09-14T11:59:49.498768+0000","mapping_epoch":28,"log_start":"263'1100","ondisk_log_start":"263'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":1100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:27.760596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5254,"num_read_kb":4633,"num_write":1618,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"263'413","reported_seq":1126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.396142+0000","last_change":"2024-09-14T10:46:44.324787+0000","last_active":"2024-09-14T12:01:19.396142+0000","last_peered":"2024-09-14T12:01:19.396142+0000","last_clean":"2024-09-14T12:01:19.396142+0000","last_became_active":"2024-09-14T10:46:44.324440+0000","last_became_peered":"2024-09-14T10:46:44.324440+0000","last_unstale":"2024-09-14T12:01:19.396142+0000","last_undegraded":"2024-09-14T12:01:19.396142+0000","last_fullsized":"2024-09-14T12:01:19.396142+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:52.318910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":948,"num_read_kb":1994,"num_write":1270,"num_write_kb":27495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.460346+0000","last_change":"2024-09-14T10:46:48.354236+0000","last_active":"2024-09-14T11:58:48.460346+0000","last_peered":"2024-09-14T11:58:48.460346+0000","last_clean":"2024-09-14T11:58:48.460346+0000","last_became_active":"2024-09-14T10:46:48.353513+0000","last_became_peered":"2024-09-14T10:46:48.353513+0000","last_unstale":"2024-09-14T11:58:48.460346+0000","last_undegraded":"2024-09-14T11:58:48.460346+0000","last_fullsized":"2024-09-14T11:58:48.460346+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:10.512984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"263'328","reported_seq":928,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.474147+0000","last_change":"2024-09-14T10:46:50.362779+0000","last_active":"2024-09-14T12:01:17.474147+0000","last_peered":"2024-09-14T12:01:17.474147+0000","last_clean":"2024-09-14T12:01:17.474147+0000","last_became_active":"2024-09-14T10:46:50.362492+0000","last_became_peered":"2024-09-14T10:46:50.362492+0000","last_unstale":"2024-09-14T12:01:17.474147+0000","last_undegraded":"2024-09-14T12:01:17.474147+0000","last_fullsized":"2024-09-14T12:01:17.474147+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:23.999202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56673,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":540,"num_read_kb":1077,"num_write":430,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"263'787","reported_seq":4622,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.428164+0000","last_change":"2024-09-14T10:46:52.375362+0000","last_active":"2024-09-14T12:01:17.428164+0000","last_peered":"2024-09-14T12:01:17.428164+0000","last_clean":"2024-09-14T12:01:17.428164+0000","last_became_active":"2024-09-14T10:46:52.374947+0000","last_became_peered":"2024-09-14T10:46:52.374947+0000","last_unstale":"2024-09-14T12:01:17.428164+0000","last_undegraded":"2024-09-14T12:01:17.428164+0000","last_fullsized":"2024-09-14T12:01:17.428164+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:43.204468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"263'122","reported_seq":650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.113955+0000","last_change":"2024-09-14T10:46:54.382345+0000","last_active":"2024-09-14T11:59:32.113955+0000","last_peered":"2024-09-14T11:59:32.113955+0000","last_clean":"2024-09-14T11:59:32.113955+0000","last_became_active":"2024-09-14T10:46:54.382004+0000","last_became_peered":"2024-09-14T10:46:54.382004+0000","last_unstale":"2024-09-14T11:59:32.113955+0000","last_undegraded":"2024-09-14T11:59:32.113955+0000","last_fullsized":"2024-09-14T11:59:32.113955+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:14.712092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1268,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":189,"num_write":324,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"263'836","reported_seq":2527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.306491+0000","last_change":"2024-09-14T10:46:46.347624+0000","last_active":"2024-09-14T11:58:50.306491+0000","last_peered":"2024-09-14T11:58:50.306491+0000","last_clean":"2024-09-14T11:58:50.306491+0000","last_became_active":"2024-09-14T10:46:46.347307+0000","last_became_peered":"2024-09-14T10:46:46.347307+0000","last_unstale":"2024-09-14T11:58:50.306491+0000","last_undegraded":"2024-09-14T11:58:50.306491+0000","last_fullsized":"2024-09-14T11:58:50.306491+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:17.498211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4222,"num_read_kb":3846,"num_write":1108,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"263'364","reported_seq":1139,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.394169+0000","last_change":"2024-09-14T10:46:44.330921+0000","last_active":"2024-09-14T12:01:19.394169+0000","last_peered":"2024-09-14T12:01:19.394169+0000","last_clean":"2024-09-14T12:01:19.394169+0000","last_became_active":"2024-09-14T10:46:44.330567+0000","last_became_peered":"2024-09-14T10:46:44.330567+0000","last_unstale":"2024-09-14T12:01:19.394169+0000","last_undegraded":"2024-09-14T12:01:19.394169+0000","last_fullsized":"2024-09-14T12:01:19.394169+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:40.240207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":975,"num_read_kb":55651,"num_write":1153,"num_write_kb":35628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1461,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.207601+0000","last_change":"2024-09-14T10:46:48.356084+0000","last_active":"2024-09-14T12:01:17.207601+0000","last_peered":"2024-09-14T12:01:17.207601+0000","last_clean":"2024-09-14T12:01:17.207601+0000","last_became_active":"2024-09-14T10:46:48.355697+0000","last_became_peered":"2024-09-14T10:46:48.355697+0000","last_unstale":"2024-09-14T12:01:17.207601+0000","last_undegraded":"2024-09-14T12:01:17.207601+0000","last_fullsized":"2024-09-14T12:01:17.207601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:15.468545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"263'106","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.526629+0000","last_change":"2024-09-14T10:46:50.369569+0000","last_active":"2024-09-14T11:58:53.526629+0000","last_peered":"2024-09-14T11:58:53.526629+0000","last_clean":"2024-09-14T11:58:53.526629+0000","last_became_active":"2024-09-14T10:46:50.369337+0000","last_became_peered":"2024-09-14T10:46:50.369337+0000","last_unstale":"2024-09-14T11:58:53.526629+0000","last_undegraded":"2024-09-14T11:58:53.526629+0000","last_fullsized":"2024-09-14T11:58:53.526629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:49.461034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"263'803","reported_seq":2611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.186080+0000","last_change":"2024-09-14T10:46:52.374673+0000","last_active":"2024-09-14T12:01:19.186080+0000","last_peered":"2024-09-14T12:01:19.186080+0000","last_clean":"2024-09-14T12:01:19.186080+0000","last_became_active":"2024-09-14T10:46:52.374252+0000","last_became_peered":"2024-09-14T10:46:52.374252+0000","last_unstale":"2024-09-14T12:01:19.186080+0000","last_undegraded":"2024-09-14T12:01:19.186080+0000","last_fullsized":"2024-09-14T12:01:19.186080+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:12.425757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"263'119","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:50.989997+0000","last_change":"2024-09-14T10:46:54.386075+0000","last_active":"2024-09-14T12:00:50.989997+0000","last_peered":"2024-09-14T12:00:50.989997+0000","last_clean":"2024-09-14T12:00:50.989997+0000","last_became_active":"2024-09-14T10:46:54.384249+0000","last_became_peered":"2024-09-14T10:46:54.384249+0000","last_unstale":"2024-09-14T12:00:50.989997+0000","last_undegraded":"2024-09-14T12:00:50.989997+0000","last_fullsized":"2024-09-14T12:00:50.989997+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:21.699653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":125,"num_write":281,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"263'466","reported_seq":1939,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.500118+0000","last_change":"2024-09-14T10:46:46.342756+0000","last_active":"2024-09-14T11:59:49.500118+0000","last_peered":"2024-09-14T11:59:49.500118+0000","last_clean":"2024-09-14T11:59:49.500118+0000","last_became_active":"2024-09-14T10:46:46.342466+0000","last_became_peered":"2024-09-14T10:46:46.342466+0000","last_unstale":"2024-09-14T11:59:49.500118+0000","last_undegraded":"2024-09-14T11:59:49.500118+0000","last_fullsized":"2024-09-14T11:59:49.500118+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:43.804852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2422,"num_read_kb":2241,"num_write":583,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"263'288","reported_seq":915,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.308222+0000","last_change":"2024-09-14T10:46:44.329354+0000","last_active":"2024-09-14T12:01:19.308222+0000","last_peered":"2024-09-14T12:01:19.308222+0000","last_clean":"2024-09-14T12:01:19.308222+0000","last_became_active":"2024-09-14T10:46:44.329014+0000","last_became_peered":"2024-09-14T10:46:44.329014+0000","last_unstale":"2024-09-14T12:01:19.308222+0000","last_undegraded":"2024-09-14T12:01:19.308222+0000","last_fullsized":"2024-09-14T12:01:19.308222+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:32.183184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":506,"num_read_kb":30778,"num_write":881,"num_write_kb":14950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.533075+0000","last_change":"2024-09-14T10:46:48.358952+0000","last_active":"2024-09-14T11:58:50.533075+0000","last_peered":"2024-09-14T11:58:50.533075+0000","last_clean":"2024-09-14T11:58:50.533075+0000","last_became_active":"2024-09-14T10:46:48.358586+0000","last_became_peered":"2024-09-14T10:46:48.358586+0000","last_unstale":"2024-09-14T11:58:50.533075+0000","last_undegraded":"2024-09-14T11:58:50.533075+0000","last_fullsized":"2024-09-14T11:58:50.533075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:11.753221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"263'377","reported_seq":1006,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.075637+0000","last_change":"2024-09-14T10:46:50.367245+0000","last_active":"2024-09-14T12:01:18.075637+0000","last_peered":"2024-09-14T12:01:18.075637+0000","last_clean":"2024-09-14T12:01:18.075637+0000","last_became_active":"2024-09-14T10:46:50.365715+0000","last_became_peered":"2024-09-14T10:46:50.365715+0000","last_unstale":"2024-09-14T12:01:18.075637+0000","last_undegraded":"2024-09-14T12:01:18.075637+0000","last_fullsized":"2024-09-14T12:01:18.075637+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:16.793655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45582,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":610,"num_read_kb":1238,"num_write":470,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.306951+0000","last_change":"2024-09-14T10:46:52.370062+0000","last_active":"2024-09-14T11:58:55.306951+0000","last_peered":"2024-09-14T11:58:55.306951+0000","last_clean":"2024-09-14T11:58:55.306951+0000","last_became_active":"2024-09-14T10:46:52.369746+0000","last_became_peered":"2024-09-14T10:46:52.369746+0000","last_unstale":"2024-09-14T11:58:55.306951+0000","last_undegraded":"2024-09-14T11:58:55.306951+0000","last_fullsized":"2024-09-14T11:58:55.306951+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:38.246502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"263'156","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.673531+0000","last_change":"2024-09-14T10:46:54.384418+0000","last_active":"2024-09-14T11:59:32.673531+0000","last_peered":"2024-09-14T11:59:32.673531+0000","last_clean":"2024-09-14T11:59:32.673531+0000","last_became_active":"2024-09-14T10:46:54.384119+0000","last_became_peered":"2024-09-14T10:46:54.384119+0000","last_unstale":"2024-09-14T11:59:32.673531+0000","last_undegraded":"2024-09-14T11:59:32.673531+0000","last_fullsized":"2024-09-14T11:59:32.673531+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:04.224188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":393,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"263'776","reported_seq":2204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.103437+0000","last_change":"2024-09-14T10:46:46.334782+0000","last_active":"2024-09-14T11:58:05.103437+0000","last_peered":"2024-09-14T11:58:05.103437+0000","last_clean":"2024-09-14T11:58:05.103437+0000","last_became_active":"2024-09-14T10:46:46.334444+0000","last_became_peered":"2024-09-14T10:46:46.334444+0000","last_unstale":"2024-09-14T11:58:05.103437+0000","last_undegraded":"2024-09-14T11:58:05.103437+0000","last_fullsized":"2024-09-14T11:58:05.103437+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:28.537376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3619,"num_read_kb":3234,"num_write":1038,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.407127+0000","last_change":"2024-09-14T10:46:26.241804+0000","last_active":"2024-09-14T11:58:40.407127+0000","last_peered":"2024-09-14T11:58:40.407127+0000","last_clean":"2024-09-14T11:58:40.407127+0000","last_became_active":"2024-09-14T10:46:26.241454+0000","last_became_peered":"2024-09-14T10:46:26.241454+0000","last_unstale":"2024-09-14T11:58:40.407127+0000","last_undegraded":"2024-09-14T11:58:40.407127+0000","last_fullsized":"2024-09-14T11:58:40.407127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:25.229371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:25.229371+0000","last_clean_scrub_stamp":"2024-09-14T10:46:25.229371+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:49.754841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":534,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:25.522947+0000","last_change":"2024-09-14T10:46:35.277926+0000","last_active":"2024-09-14T11:57:25.522947+0000","last_peered":"2024-09-14T11:57:25.522947+0000","last_clean":"2024-09-14T11:57:25.522947+0000","last_became_active":"2024-09-14T10:46:33.413305+0000","last_became_peered":"2024-09-14T10:46:33.413305+0000","last_unstale":"2024-09-14T11:57:25.522947+0000","last_undegraded":"2024-09-14T11:57:25.522947+0000","last_fullsized":"2024-09-14T11:57:25.522947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:13.605387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092058099999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"263'313","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.316155+0000","last_change":"2024-09-14T10:46:44.329784+0000","last_active":"2024-09-14T12:01:19.316155+0000","last_peered":"2024-09-14T12:01:19.316155+0000","last_clean":"2024-09-14T12:01:19.316155+0000","last_became_active":"2024-09-14T10:46:44.329050+0000","last_became_peered":"2024-09-14T10:46:44.329050+0000","last_unstale":"2024-09-14T12:01:19.316155+0000","last_undegraded":"2024-09-14T12:01:19.316155+0000","last_fullsized":"2024-09-14T12:01:19.316155+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:43.544984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":32601,"num_write":1066,"num_write_kb":17351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"38'5","reported_seq":990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.195369+0000","last_change":"2024-09-14T10:46:48.353767+0000","last_active":"2024-09-14T12:01:17.195369+0000","last_peered":"2024-09-14T12:01:17.195369+0000","last_clean":"2024-09-14T12:01:17.195369+0000","last_became_active":"2024-09-14T10:46:48.353319+0000","last_became_peered":"2024-09-14T10:46:48.353319+0000","last_unstale":"2024-09-14T12:01:17.195369+0000","last_undegraded":"2024-09-14T12:01:17.195369+0000","last_fullsized":"2024-09-14T12:01:17.195369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:38.932761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"263'795","reported_seq":1515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.746391+0000","last_change":"2024-09-14T10:46:50.363357+0000","last_active":"2024-09-14T12:01:18.746391+0000","last_peered":"2024-09-14T12:01:18.746391+0000","last_clean":"2024-09-14T12:01:18.746391+0000","last_became_active":"2024-09-14T10:46:50.362908+0000","last_became_peered":"2024-09-14T10:46:50.362908+0000","last_unstale":"2024-09-14T12:01:18.746391+0000","last_undegraded":"2024-09-14T12:01:18.746391+0000","last_fullsized":"2024-09-14T12:01:18.746391+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:43.112130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143024,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1563,"num_read_kb":3671,"num_write":1508,"num_write_kb":1333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.456299+0000","last_change":"2024-09-14T10:46:52.371975+0000","last_active":"2024-09-14T11:58:23.456299+0000","last_peered":"2024-09-14T11:58:23.456299+0000","last_clean":"2024-09-14T11:58:23.456299+0000","last_became_active":"2024-09-14T10:46:52.371684+0000","last_became_peered":"2024-09-14T10:46:52.371684+0000","last_unstale":"2024-09-14T11:58:23.456299+0000","last_undegraded":"2024-09-14T11:58:23.456299+0000","last_fullsized":"2024-09-14T11:58:23.456299+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:40.156605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"263'205","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.737078+0000","last_change":"2024-09-14T10:46:54.382314+0000","last_active":"2024-09-14T11:59:34.737078+0000","last_peered":"2024-09-14T11:59:34.737078+0000","last_clean":"2024-09-14T11:59:34.737078+0000","last_became_active":"2024-09-14T10:46:54.382019+0000","last_became_peered":"2024-09-14T10:46:54.382019+0000","last_unstale":"2024-09-14T11:59:34.737078+0000","last_undegraded":"2024-09-14T11:59:34.737078+0000","last_fullsized":"2024-09-14T11:59:34.737078+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:50.945970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":483,"num_read_kb":466,"num_write":435,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"263'817","reported_seq":2421,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.147601+0000","last_change":"2024-09-14T10:46:46.345582+0000","last_active":"2024-09-14T12:00:51.147601+0000","last_peered":"2024-09-14T12:00:51.147601+0000","last_clean":"2024-09-14T12:00:51.147601+0000","last_became_active":"2024-09-14T10:46:46.345302+0000","last_became_peered":"2024-09-14T10:46:46.345302+0000","last_unstale":"2024-09-14T12:00:51.147601+0000","last_undegraded":"2024-09-14T12:00:51.147601+0000","last_fullsized":"2024-09-14T12:00:51.147601+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:17.727283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3876,"num_read_kb":3495,"num_write":1050,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.531770+0000","last_change":"2024-09-14T10:46:35.277550+0000","last_active":"2024-09-14T11:58:40.531770+0000","last_peered":"2024-09-14T11:58:40.531770+0000","last_clean":"2024-09-14T11:58:40.531770+0000","last_became_active":"2024-09-14T10:46:33.265619+0000","last_became_peered":"2024-09-14T10:46:33.265619+0000","last_unstale":"2024-09-14T11:58:40.531770+0000","last_undegraded":"2024-09-14T11:58:40.531770+0000","last_fullsized":"2024-09-14T11:58:40.531770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:56.062295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058478399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"263'315","reported_seq":1163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.535743+0000","last_change":"2024-09-14T10:46:44.320448+0000","last_active":"2024-09-14T12:01:18.535743+0000","last_peered":"2024-09-14T12:01:18.535743+0000","last_clean":"2024-09-14T12:01:18.535743+0000","last_became_active":"2024-09-14T10:46:44.320087+0000","last_became_peered":"2024-09-14T10:46:44.320087+0000","last_unstale":"2024-09-14T12:01:18.535743+0000","last_undegraded":"2024-09-14T12:01:18.535743+0000","last_fullsized":"2024-09-14T12:01:18.535743+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:18.710537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25054,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":1176,"num_read_kb":9242,"num_write":1094,"num_write_kb":25141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.529481+0000","last_change":"2024-09-14T10:46:48.350940+0000","last_active":"2024-09-14T11:58:20.529481+0000","last_peered":"2024-09-14T11:58:20.529481+0000","last_clean":"2024-09-14T11:58:20.529481+0000","last_became_active":"2024-09-14T10:46:48.350653+0000","last_became_peered":"2024-09-14T10:46:48.350653+0000","last_unstale":"2024-09-14T11:58:20.529481+0000","last_undegraded":"2024-09-14T11:58:20.529481+0000","last_fullsized":"2024-09-14T11:58:20.529481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:11.993887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"263'1395","reported_seq":3236,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.111806+0000","last_change":"2024-09-14T10:46:50.362470+0000","last_active":"2024-09-14T12:01:19.111806+0000","last_peered":"2024-09-14T12:01:19.111806+0000","last_clean":"2024-09-14T12:01:19.111806+0000","last_became_active":"2024-09-14T10:46:50.362128+0000","last_became_peered":"2024-09-14T10:46:50.362128+0000","last_unstale":"2024-09-14T12:01:19.111806+0000","last_undegraded":"2024-09-14T12:01:19.111806+0000","last_fullsized":"2024-09-14T12:01:19.111806+0000","mapping_epoch":32,"log_start":"263'1300","ondisk_log_start":"263'1300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":1300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:16.340703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160652,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2189,"num_read_kb":4301,"num_write":1286,"num_write_kb":1103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.525954+0000","last_change":"2024-09-14T10:46:52.375637+0000","last_active":"2024-09-14T11:57:50.525954+0000","last_peered":"2024-09-14T11:57:50.525954+0000","last_clean":"2024-09-14T11:57:50.525954+0000","last_became_active":"2024-09-14T10:46:52.375344+0000","last_became_peered":"2024-09-14T10:46:52.375344+0000","last_unstale":"2024-09-14T11:57:50.525954+0000","last_undegraded":"2024-09-14T11:57:50.525954+0000","last_fullsized":"2024-09-14T11:57:50.525954+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:28.073066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"263'95","reported_seq":596,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.585158+0000","last_change":"2024-09-14T10:46:54.384671+0000","last_active":"2024-09-14T11:59:33.585158+0000","last_peered":"2024-09-14T11:59:33.585158+0000","last_clean":"2024-09-14T11:59:33.585158+0000","last_became_active":"2024-09-14T10:46:54.384354+0000","last_became_peered":"2024-09-14T10:46:54.384354+0000","last_unstale":"2024-09-14T11:59:33.585158+0000","last_undegraded":"2024-09-14T11:59:33.585158+0000","last_fullsized":"2024-09-14T11:59:33.585158+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:42.323130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":95,"num_write":225,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"263'543","reported_seq":2137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:18.521582+0000","last_change":"2024-09-14T10:46:46.345522+0000","last_active":"2024-09-14T11:58:18.521582+0000","last_peered":"2024-09-14T11:58:18.521582+0000","last_clean":"2024-09-14T11:58:18.521582+0000","last_became_active":"2024-09-14T10:46:46.345234+0000","last_became_peered":"2024-09-14T10:46:46.345234+0000","last_unstale":"2024-09-14T11:58:18.521582+0000","last_undegraded":"2024-09-14T11:58:18.521582+0000","last_fullsized":"2024-09-14T11:58:18.521582+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:05.993847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2916,"num_read_kb":2703,"num_write":726,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:25.438151+0000","last_change":"2024-09-14T10:46:35.332938+0000","last_active":"2024-09-14T11:57:25.438151+0000","last_peered":"2024-09-14T11:57:25.438151+0000","last_clean":"2024-09-14T11:57:25.438151+0000","last_became_active":"2024-09-14T10:46:33.265185+0000","last_became_peered":"2024-09-14T10:46:33.265185+0000","last_unstale":"2024-09-14T11:57:25.438151+0000","last_undegraded":"2024-09-14T11:57:25.438151+0000","last_fullsized":"2024-09-14T11:57:25.438151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:20.170242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000550246,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"263'288","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.376501+0000","last_change":"2024-09-14T10:46:44.327457+0000","last_active":"2024-09-14T12:01:18.376501+0000","last_peered":"2024-09-14T12:01:18.376501+0000","last_clean":"2024-09-14T12:01:18.376501+0000","last_became_active":"2024-09-14T10:46:44.327101+0000","last_became_peered":"2024-09-14T10:46:44.327101+0000","last_unstale":"2024-09-14T12:01:18.376501+0000","last_undegraded":"2024-09-14T12:01:18.376501+0000","last_fullsized":"2024-09-14T12:01:18.376501+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:34.079248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":585,"num_read_kb":99380,"num_write":1012,"num_write_kb":24751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.445762+0000","last_change":"2024-09-14T10:46:48.354125+0000","last_active":"2024-09-14T11:58:20.445762+0000","last_peered":"2024-09-14T11:58:20.445762+0000","last_clean":"2024-09-14T11:58:20.445762+0000","last_became_active":"2024-09-14T10:46:48.353803+0000","last_became_peered":"2024-09-14T10:46:48.353803+0000","last_unstale":"2024-09-14T11:58:20.445762+0000","last_undegraded":"2024-09-14T11:58:20.445762+0000","last_fullsized":"2024-09-14T11:58:20.445762+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:10.885769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"263'303","reported_seq":1752,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:50.881334+0000","last_change":"2024-09-14T10:46:50.365198+0000","last_active":"2024-09-14T12:00:50.881334+0000","last_peered":"2024-09-14T12:00:50.881334+0000","last_clean":"2024-09-14T12:00:50.881334+0000","last_became_active":"2024-09-14T10:46:50.364857+0000","last_became_peered":"2024-09-14T10:46:50.364857+0000","last_unstale":"2024-09-14T12:00:50.881334+0000","last_undegraded":"2024-09-14T12:00:50.881334+0000","last_fullsized":"2024-09-14T12:00:50.881334+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:49.821470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":263,"num_read_kb":255,"num_write":243,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:45.640374+0000","last_change":"2024-09-14T10:46:52.367740+0000","last_active":"2024-09-14T11:57:45.640374+0000","last_peered":"2024-09-14T11:57:45.640374+0000","last_clean":"2024-09-14T11:57:45.640374+0000","last_became_active":"2024-09-14T10:46:52.365738+0000","last_became_peered":"2024-09-14T10:46:52.365738+0000","last_unstale":"2024-09-14T11:57:45.640374+0000","last_undegraded":"2024-09-14T11:57:45.640374+0000","last_fullsized":"2024-09-14T11:57:45.640374+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:55.844741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"263'261","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.991420+0000","last_change":"2024-09-14T10:46:54.379215+0000","last_active":"2024-09-14T11:59:34.991420+0000","last_peered":"2024-09-14T11:59:34.991420+0000","last_clean":"2024-09-14T11:59:34.991420+0000","last_became_active":"2024-09-14T10:46:54.378930+0000","last_became_peered":"2024-09-14T10:46:54.378930+0000","last_unstale":"2024-09-14T11:59:34.991420+0000","last_undegraded":"2024-09-14T11:59:34.991420+0000","last_fullsized":"2024-09-14T11:59:34.991420+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:20.494987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":478,"num_read_kb":502,"num_write":559,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"263'787","reported_seq":2353,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:43.533534+0000","last_change":"2024-09-14T10:46:46.334984+0000","last_active":"2024-09-14T11:59:43.533534+0000","last_peered":"2024-09-14T11:59:43.533534+0000","last_clean":"2024-09-14T11:59:43.533534+0000","last_became_active":"2024-09-14T10:46:46.334679+0000","last_became_peered":"2024-09-14T10:46:46.334679+0000","last_unstale":"2024-09-14T11:59:43.533534+0000","last_undegraded":"2024-09-14T11:59:43.533534+0000","last_fullsized":"2024-09-14T11:59:43.533534+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:52.255486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3681,"num_read_kb":3336,"num_write":1001,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:25.522916+0000","last_change":"2024-09-14T10:46:35.278266+0000","last_active":"2024-09-14T11:57:25.522916+0000","last_peered":"2024-09-14T11:57:25.522916+0000","last_clean":"2024-09-14T11:57:25.522916+0000","last_became_active":"2024-09-14T10:46:33.296172+0000","last_became_peered":"2024-09-14T10:46:33.296172+0000","last_unstale":"2024-09-14T11:57:25.522916+0000","last_undegraded":"2024-09-14T11:57:25.522916+0000","last_fullsized":"2024-09-14T11:57:25.522916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:36.394821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00125464,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"263'339","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.361280+0000","last_change":"2024-09-14T10:46:44.325455+0000","last_active":"2024-09-14T12:01:19.361280+0000","last_peered":"2024-09-14T12:01:19.361280+0000","last_clean":"2024-09-14T12:01:19.361280+0000","last_became_active":"2024-09-14T10:46:44.323974+0000","last_became_peered":"2024-09-14T10:46:44.323974+0000","last_unstale":"2024-09-14T12:01:19.361280+0000","last_undegraded":"2024-09-14T12:01:19.361280+0000","last_fullsized":"2024-09-14T12:01:19.361280+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:51:12.075141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":608,"num_read_kb":7380,"num_write":1200,"num_write_kb":32204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:55.442524+0000","last_change":"2024-09-14T10:46:48.355092+0000","last_active":"2024-09-14T11:57:55.442524+0000","last_peered":"2024-09-14T11:57:55.442524+0000","last_clean":"2024-09-14T11:57:55.442524+0000","last_became_active":"2024-09-14T10:46:48.354786+0000","last_became_peered":"2024-09-14T10:46:48.354786+0000","last_unstale":"2024-09-14T11:57:55.442524+0000","last_undegraded":"2024-09-14T11:57:55.442524+0000","last_fullsized":"2024-09-14T11:57:55.442524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:26.687521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"263'154","reported_seq":714,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:33.477130+0000","last_change":"2024-09-14T10:46:50.363852+0000","last_active":"2024-09-14T12:00:33.477130+0000","last_peered":"2024-09-14T12:00:33.477130+0000","last_clean":"2024-09-14T12:00:33.477130+0000","last_became_active":"2024-09-14T10:46:50.363538+0000","last_became_peered":"2024-09-14T10:46:50.363538+0000","last_unstale":"2024-09-14T12:00:33.477130+0000","last_undegraded":"2024-09-14T12:00:33.477130+0000","last_fullsized":"2024-09-14T12:00:33.477130+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:41.224986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":198,"num_read_kb":192,"num_write":144,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:25.530066+0000","last_change":"2024-09-14T10:46:52.371280+0000","last_active":"2024-09-14T11:58:25.530066+0000","last_peered":"2024-09-14T11:58:25.530066+0000","last_clean":"2024-09-14T11:58:25.530066+0000","last_became_active":"2024-09-14T10:46:52.370968+0000","last_became_peered":"2024-09-14T10:46:52.370968+0000","last_unstale":"2024-09-14T11:58:25.530066+0000","last_undegraded":"2024-09-14T11:58:25.530066+0000","last_fullsized":"2024-09-14T11:58:25.530066+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:12.904159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"263'119","reported_seq":669,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.337447+0000","last_change":"2024-09-14T10:46:54.389298+0000","last_active":"2024-09-14T11:58:44.337447+0000","last_peered":"2024-09-14T11:58:44.337447+0000","last_clean":"2024-09-14T11:58:44.337447+0000","last_became_active":"2024-09-14T10:46:54.388938+0000","last_became_peered":"2024-09-14T10:46:54.388938+0000","last_unstale":"2024-09-14T11:58:44.337447+0000","last_undegraded":"2024-09-14T11:58:44.337447+0000","last_fullsized":"2024-09-14T11:58:44.337447+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:20.842708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":281,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"263'403","reported_seq":1966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.216353+0000","last_change":"2024-09-14T10:46:46.335959+0000","last_active":"2024-09-14T11:58:11.216353+0000","last_peered":"2024-09-14T11:58:11.216353+0000","last_clean":"2024-09-14T11:58:11.216353+0000","last_became_active":"2024-09-14T10:46:46.335681+0000","last_became_peered":"2024-09-14T10:46:46.335681+0000","last_unstale":"2024-09-14T11:58:11.216353+0000","last_undegraded":"2024-09-14T11:58:11.216353+0000","last_fullsized":"2024-09-14T11:58:11.216353+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:24.103452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2240,"num_read_kb":2136,"num_write":448,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"263'321","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.386167+0000","last_change":"2024-09-14T10:46:44.320085+0000","last_active":"2024-09-14T12:01:19.386167+0000","last_peered":"2024-09-14T12:01:19.386167+0000","last_clean":"2024-09-14T12:01:19.386167+0000","last_became_active":"2024-09-14T10:46:44.319714+0000","last_became_peered":"2024-09-14T10:46:44.319714+0000","last_unstale":"2024-09-14T12:01:19.386167+0000","last_undegraded":"2024-09-14T12:01:19.386167+0000","last_fullsized":"2024-09-14T12:01:19.386167+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:11.937757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":599,"num_read_kb":77773,"num_write":1050,"num_write_kb":36142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:23.447048+0000","last_change":"2024-09-14T10:46:35.333110+0000","last_active":"2024-09-14T11:57:23.447048+0000","last_peered":"2024-09-14T11:57:23.447048+0000","last_clean":"2024-09-14T11:57:23.447048+0000","last_became_active":"2024-09-14T10:46:33.296049+0000","last_became_peered":"2024-09-14T10:46:33.296049+0000","last_unstale":"2024-09-14T11:57:23.447048+0000","last_undegraded":"2024-09-14T11:57:23.447048+0000","last_fullsized":"2024-09-14T11:57:23.447048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:58.526433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000560203,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:40.639756+0000","last_change":"2024-09-14T10:46:48.350451+0000","last_active":"2024-09-14T11:57:40.639756+0000","last_peered":"2024-09-14T11:57:40.639756+0000","last_clean":"2024-09-14T11:57:40.639756+0000","last_became_active":"2024-09-14T10:46:48.350088+0000","last_became_peered":"2024-09-14T10:46:48.350088+0000","last_unstale":"2024-09-14T11:57:40.639756+0000","last_undegraded":"2024-09-14T11:57:40.639756+0000","last_fullsized":"2024-09-14T11:57:40.639756+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:29.591738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"263'635","reported_seq":1320,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.802571+0000","last_change":"2024-09-14T10:46:50.363683+0000","last_active":"2024-09-14T12:01:18.802571+0000","last_peered":"2024-09-14T12:01:18.802571+0000","last_clean":"2024-09-14T12:01:18.802571+0000","last_became_active":"2024-09-14T10:46:50.363387+0000","last_became_peered":"2024-09-14T10:46:50.363387+0000","last_unstale":"2024-09-14T12:01:18.802571+0000","last_undegraded":"2024-09-14T12:01:18.802571+0000","last_fullsized":"2024-09-14T12:01:18.802571+0000","mapping_epoch":32,"log_start":"263'600","ondisk_log_start":"263'600","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":600,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:52:29.856170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95765,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1702,"num_read_kb":2954,"num_write":2224,"num_write_kb":2032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:45.299536+0000","last_change":"2024-09-14T10:46:52.374167+0000","last_active":"2024-09-14T11:57:45.299536+0000","last_peered":"2024-09-14T11:57:45.299536+0000","last_clean":"2024-09-14T11:57:45.299536+0000","last_became_active":"2024-09-14T10:46:52.373837+0000","last_became_peered":"2024-09-14T10:46:52.373837+0000","last_unstale":"2024-09-14T11:57:45.299536+0000","last_undegraded":"2024-09-14T11:57:45.299536+0000","last_fullsized":"2024-09-14T11:57:45.299536+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:56.691785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"263'152","reported_seq":660,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.008979+0000","last_change":"2024-09-14T10:46:54.386107+0000","last_active":"2024-09-14T11:59:31.008979+0000","last_peered":"2024-09-14T11:59:31.008979+0000","last_clean":"2024-09-14T11:59:31.008979+0000","last_became_active":"2024-09-14T10:46:54.385835+0000","last_became_peered":"2024-09-14T10:46:54.385835+0000","last_unstale":"2024-09-14T11:59:31.008979+0000","last_undegraded":"2024-09-14T11:59:31.008979+0000","last_fullsized":"2024-09-14T11:59:31.008979+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:18.649909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":168,"num_read_kb":158,"num_write":389,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"263'835","reported_seq":2478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.599452+0000","last_change":"2024-09-14T10:46:46.346336+0000","last_active":"2024-09-14T11:59:33.599452+0000","last_peered":"2024-09-14T11:59:33.599452+0000","last_clean":"2024-09-14T11:59:33.599452+0000","last_became_active":"2024-09-14T10:46:46.346072+0000","last_became_peered":"2024-09-14T10:46:46.346072+0000","last_unstale":"2024-09-14T11:59:33.599452+0000","last_undegraded":"2024-09-14T11:59:33.599452+0000","last_fullsized":"2024-09-14T11:59:33.599452+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:26.721967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4027,"num_read_kb":3636,"num_write":1084,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"263'345","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.530435+0000","last_change":"2024-09-14T10:46:44.318544+0000","last_active":"2024-09-14T12:01:18.530435+0000","last_peered":"2024-09-14T12:01:18.530435+0000","last_clean":"2024-09-14T12:01:18.530435+0000","last_became_active":"2024-09-14T10:46:44.317702+0000","last_became_peered":"2024-09-14T10:46:44.317702+0000","last_unstale":"2024-09-14T12:01:18.530435+0000","last_undegraded":"2024-09-14T12:01:18.530435+0000","last_fullsized":"2024-09-14T12:01:18.530435+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:51.997687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11715436,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":620,"num_read_kb":57005,"num_write":1141,"num_write_kb":30753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:30.523578+0000","last_change":"2024-09-14T10:46:35.277870+0000","last_active":"2024-09-14T11:57:30.523578+0000","last_peered":"2024-09-14T11:57:30.523578+0000","last_clean":"2024-09-14T11:57:30.523578+0000","last_became_active":"2024-09-14T10:46:33.265512+0000","last_became_peered":"2024-09-14T10:46:33.265512+0000","last_unstale":"2024-09-14T11:57:30.523578+0000","last_undegraded":"2024-09-14T11:57:30.523578+0000","last_fullsized":"2024-09-14T11:57:30.523578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:38.583783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088449000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:40.598081+0000","last_change":"2024-09-14T10:46:48.353705+0000","last_active":"2024-09-14T11:57:40.598081+0000","last_peered":"2024-09-14T11:57:40.598081+0000","last_clean":"2024-09-14T11:57:40.598081+0000","last_became_active":"2024-09-14T10:46:48.353394+0000","last_became_peered":"2024-09-14T10:46:48.353394+0000","last_unstale":"2024-09-14T11:57:40.598081+0000","last_undegraded":"2024-09-14T11:57:40.598081+0000","last_fullsized":"2024-09-14T11:57:40.598081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:16.155422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"263'261","reported_seq":847,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.134914+0000","last_change":"2024-09-14T10:46:50.363699+0000","last_active":"2024-09-14T11:59:33.134914+0000","last_peered":"2024-09-14T11:59:33.134914+0000","last_clean":"2024-09-14T11:59:33.134914+0000","last_became_active":"2024-09-14T10:46:50.363436+0000","last_became_peered":"2024-09-14T10:46:50.363436+0000","last_unstale":"2024-09-14T11:59:33.134914+0000","last_undegraded":"2024-09-14T11:59:33.134914+0000","last_fullsized":"2024-09-14T11:59:33.134914+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:29.116427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":321,"num_read_kb":313,"num_write":296,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"263'803","reported_seq":2970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.187710+0000","last_change":"2024-09-14T10:46:52.373730+0000","last_active":"2024-09-14T12:01:19.187710+0000","last_peered":"2024-09-14T12:01:19.187710+0000","last_clean":"2024-09-14T12:01:19.187710+0000","last_became_active":"2024-09-14T10:46:52.373068+0000","last_became_peered":"2024-09-14T10:46:52.373068+0000","last_unstale":"2024-09-14T12:01:19.187710+0000","last_undegraded":"2024-09-14T12:01:19.187710+0000","last_fullsized":"2024-09-14T12:01:19.187710+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:46.138887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"263'136","reported_seq":633,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.453254+0000","last_change":"2024-09-14T10:46:54.388712+0000","last_active":"2024-09-14T11:59:10.453254+0000","last_peered":"2024-09-14T11:59:10.453254+0000","last_clean":"2024-09-14T11:59:10.453254+0000","last_became_active":"2024-09-14T10:46:54.387317+0000","last_became_peered":"2024-09-14T10:46:54.387317+0000","last_unstale":"2024-09-14T11:59:10.453254+0000","last_undegraded":"2024-09-14T11:59:10.453254+0000","last_fullsized":"2024-09-14T11:59:10.453254+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:03.151982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":117,"num_write":309,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"263'1367","reported_seq":3055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.167851+0000","last_change":"2024-09-14T10:46:46.345068+0000","last_active":"2024-09-14T12:00:51.167851+0000","last_peered":"2024-09-14T12:00:51.167851+0000","last_clean":"2024-09-14T12:00:51.167851+0000","last_became_active":"2024-09-14T10:46:46.344799+0000","last_became_peered":"2024-09-14T10:46:46.344799+0000","last_unstale":"2024-09-14T12:00:51.167851+0000","last_undegraded":"2024-09-14T12:00:51.167851+0000","last_fullsized":"2024-09-14T12:00:51.167851+0000","mapping_epoch":28,"log_start":"263'1300","ondisk_log_start":"263'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":1300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:57.271856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6397,"num_read_kb":5617,"num_write":2035,"num_write_kb":974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"263'403","reported_seq":1211,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.335174+0000","last_change":"2024-09-14T10:46:44.324495+0000","last_active":"2024-09-14T12:01:19.335174+0000","last_peered":"2024-09-14T12:01:19.335174+0000","last_clean":"2024-09-14T12:01:19.335174+0000","last_became_active":"2024-09-14T10:46:44.324158+0000","last_became_peered":"2024-09-14T10:46:44.324158+0000","last_unstale":"2024-09-14T12:01:19.335174+0000","last_undegraded":"2024-09-14T12:01:19.335174+0000","last_fullsized":"2024-09-14T12:01:19.335174+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:06.192395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":514873,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1028,"num_read_kb":45406,"num_write":1187,"num_write_kb":52499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.643287+0000","last_change":"2024-09-14T10:46:35.333032+0000","last_active":"2024-09-14T11:58:05.643287+0000","last_peered":"2024-09-14T11:58:05.643287+0000","last_clean":"2024-09-14T11:58:05.643287+0000","last_became_active":"2024-09-14T10:46:33.262218+0000","last_became_peered":"2024-09-14T10:46:33.262218+0000","last_unstale":"2024-09-14T11:58:05.643287+0000","last_undegraded":"2024-09-14T11:58:05.643287+0000","last_fullsized":"2024-09-14T11:58:05.643287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:37.487991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072314099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:40.524716+0000","last_change":"2024-09-14T10:46:48.350207+0000","last_active":"2024-09-14T11:57:40.524716+0000","last_peered":"2024-09-14T11:57:40.524716+0000","last_clean":"2024-09-14T11:57:40.524716+0000","last_became_active":"2024-09-14T10:46:48.349924+0000","last_became_peered":"2024-09-14T10:46:48.349924+0000","last_unstale":"2024-09-14T11:57:40.524716+0000","last_undegraded":"2024-09-14T11:57:40.524716+0000","last_fullsized":"2024-09-14T11:57:40.524716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:06.223225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"263'131","reported_seq":690,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:40.524748+0000","last_change":"2024-09-14T10:46:50.366912+0000","last_active":"2024-09-14T11:57:40.524748+0000","last_peered":"2024-09-14T11:57:40.524748+0000","last_clean":"2024-09-14T11:57:40.524748+0000","last_became_active":"2024-09-14T10:46:50.366610+0000","last_became_peered":"2024-09-14T10:46:50.366610+0000","last_unstale":"2024-09-14T11:57:40.524748+0000","last_undegraded":"2024-09-14T11:57:40.524748+0000","last_fullsized":"2024-09-14T11:57:40.524748+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:08.232971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"263'830","reported_seq":2794,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.430435+0000","last_change":"2024-09-14T10:46:52.371337+0000","last_active":"2024-09-14T12:01:17.430435+0000","last_peered":"2024-09-14T12:01:17.430435+0000","last_clean":"2024-09-14T12:01:17.430435+0000","last_became_active":"2024-09-14T10:46:52.370514+0000","last_became_peered":"2024-09-14T10:46:52.370514+0000","last_unstale":"2024-09-14T12:01:17.430435+0000","last_undegraded":"2024-09-14T12:01:17.430435+0000","last_fullsized":"2024-09-14T12:01:17.430435+0000","mapping_epoch":34,"log_start":"263'800","ondisk_log_start":"263'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":800,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:45.428130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"263'307","reported_seq":847,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.462075+0000","last_change":"2024-09-14T10:46:54.383183+0000","last_active":"2024-09-14T11:58:58.462075+0000","last_peered":"2024-09-14T11:58:58.462075+0000","last_clean":"2024-09-14T11:58:58.462075+0000","last_became_active":"2024-09-14T10:46:54.382860+0000","last_became_peered":"2024-09-14T10:46:54.382860+0000","last_unstale":"2024-09-14T11:58:58.462075+0000","last_undegraded":"2024-09-14T11:58:58.462075+0000","last_fullsized":"2024-09-14T11:58:58.462075+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:04.052225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":895,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":402,"num_read_kb":382,"num_write":591,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"263'1146","reported_seq":2843,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.351752+0000","last_change":"2024-09-14T10:46:46.338805+0000","last_active":"2024-09-14T11:58:44.351752+0000","last_peered":"2024-09-14T11:58:44.351752+0000","last_clean":"2024-09-14T11:58:44.351752+0000","last_became_active":"2024-09-14T10:46:46.338543+0000","last_became_peered":"2024-09-14T10:46:46.338543+0000","last_unstale":"2024-09-14T11:58:44.351752+0000","last_undegraded":"2024-09-14T11:58:44.351752+0000","last_fullsized":"2024-09-14T11:58:44.351752+0000","mapping_epoch":28,"log_start":"263'1100","ondisk_log_start":"263'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":1100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:11.687416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5511,"num_read_kb":4909,"num_write":1576,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"263'347","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.322796+0000","last_change":"2024-09-14T10:46:44.319103+0000","last_active":"2024-09-14T12:01:19.322796+0000","last_peered":"2024-09-14T12:01:19.322796+0000","last_clean":"2024-09-14T12:01:19.322796+0000","last_became_active":"2024-09-14T10:46:44.318777+0000","last_became_peered":"2024-09-14T10:46:44.318777+0000","last_unstale":"2024-09-14T12:01:19.322796+0000","last_undegraded":"2024-09-14T12:01:19.322796+0000","last_fullsized":"2024-09-14T12:01:19.322796+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:25.866596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":579,"num_read_kb":36295,"num_write":1107,"num_write_kb":33618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.527666+0000","last_change":"2024-09-14T10:46:35.277572+0000","last_active":"2024-09-14T11:58:05.527666+0000","last_peered":"2024-09-14T11:58:05.527666+0000","last_clean":"2024-09-14T11:58:05.527666+0000","last_became_active":"2024-09-14T10:46:33.265515+0000","last_became_peered":"2024-09-14T10:46:33.265515+0000","last_unstale":"2024-09-14T11:58:05.527666+0000","last_undegraded":"2024-09-14T11:58:05.527666+0000","last_fullsized":"2024-09-14T11:58:05.527666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:42.848687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061284299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.652272+0000","last_change":"2024-09-14T10:46:48.356581+0000","last_active":"2024-09-14T11:59:05.652272+0000","last_peered":"2024-09-14T11:59:05.652272+0000","last_clean":"2024-09-14T11:59:05.652272+0000","last_became_active":"2024-09-14T10:46:48.354373+0000","last_became_peered":"2024-09-14T10:46:48.354373+0000","last_unstale":"2024-09-14T11:59:05.652272+0000","last_undegraded":"2024-09-14T11:59:05.652272+0000","last_fullsized":"2024-09-14T11:59:05.652272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:11.993887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"263'723","reported_seq":1465,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.170376+0000","last_change":"2024-09-14T10:46:50.362694+0000","last_active":"2024-09-14T12:01:19.170376+0000","last_peered":"2024-09-14T12:01:19.170376+0000","last_clean":"2024-09-14T12:01:19.170376+0000","last_became_active":"2024-09-14T10:46:50.362397+0000","last_became_peered":"2024-09-14T10:46:50.362397+0000","last_unstale":"2024-09-14T12:01:19.170376+0000","last_undegraded":"2024-09-14T12:01:19.170376+0000","last_fullsized":"2024-09-14T12:01:19.170376+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":700,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:52.299380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1285,"num_read_kb":3031,"num_write":1024,"num_write_kb":812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:45.640338+0000","last_change":"2024-09-14T10:46:52.370429+0000","last_active":"2024-09-14T11:57:45.640338+0000","last_peered":"2024-09-14T11:57:45.640338+0000","last_clean":"2024-09-14T11:57:45.640338+0000","last_became_active":"2024-09-14T10:46:52.370107+0000","last_became_peered":"2024-09-14T10:46:52.370107+0000","last_unstale":"2024-09-14T11:57:45.640338+0000","last_undegraded":"2024-09-14T11:57:45.640338+0000","last_fullsized":"2024-09-14T11:57:45.640338+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:57.197530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"263'131","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.306974+0000","last_change":"2024-09-14T10:46:54.384319+0000","last_active":"2024-09-14T11:58:55.306974+0000","last_peered":"2024-09-14T11:58:55.306974+0000","last_clean":"2024-09-14T11:58:55.306974+0000","last_became_active":"2024-09-14T10:46:54.383813+0000","last_became_peered":"2024-09-14T10:46:54.383813+0000","last_unstale":"2024-09-14T11:58:55.306974+0000","last_undegraded":"2024-09-14T11:58:55.306974+0000","last_fullsized":"2024-09-14T11:58:55.306974+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:08.736115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":350,"num_read_kb":289,"num_write":327,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"263'150","reported_seq":710,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.932339+0000","last_change":"2024-09-14T10:46:54.384092+0000","last_active":"2024-09-14T11:59:34.932339+0000","last_peered":"2024-09-14T11:59:34.932339+0000","last_clean":"2024-09-14T11:59:34.932339+0000","last_became_active":"2024-09-14T10:46:54.383742+0000","last_became_peered":"2024-09-14T10:46:54.383742+0000","last_unstale":"2024-09-14T11:59:34.932339+0000","last_undegraded":"2024-09-14T11:59:34.932339+0000","last_fullsized":"2024-09-14T11:59:34.932339+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:33.936406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":212,"num_read_kb":210,"num_write":346,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"263'702","reported_seq":2554,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.142264+0000","last_change":"2024-09-14T10:46:46.338139+0000","last_active":"2024-09-14T12:00:51.142264+0000","last_peered":"2024-09-14T12:00:51.142264+0000","last_clean":"2024-09-14T12:00:51.142264+0000","last_became_active":"2024-09-14T10:46:46.337818+0000","last_became_peered":"2024-09-14T10:46:46.337818+0000","last_unstale":"2024-09-14T12:00:51.142264+0000","last_undegraded":"2024-09-14T12:00:51.142264+0000","last_fullsized":"2024-09-14T12:00:51.142264+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:18.147970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3744,"num_read_kb":3411,"num_write":893,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"263'332","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.317332+0000","last_change":"2024-09-14T10:46:44.335815+0000","last_active":"2024-09-14T12:01:19.317332+0000","last_peered":"2024-09-14T12:01:19.317332+0000","last_clean":"2024-09-14T12:01:19.317332+0000","last_became_active":"2024-09-14T10:46:44.332607+0000","last_became_peered":"2024-09-14T10:46:44.332607+0000","last_unstale":"2024-09-14T12:01:19.317332+0000","last_undegraded":"2024-09-14T12:01:19.317332+0000","last_fullsized":"2024-09-14T12:01:19.317332+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:51.020568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":554,"num_read_kb":15763,"num_write":1023,"num_write_kb":46520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.508136+0000","last_change":"2024-09-14T10:46:48.353763+0000","last_active":"2024-09-14T11:56:48.508136+0000","last_peered":"2024-09-14T11:56:48.508136+0000","last_clean":"2024-09-14T11:56:48.508136+0000","last_became_active":"2024-09-14T10:46:48.353125+0000","last_became_peered":"2024-09-14T10:46:48.353125+0000","last_unstale":"2024-09-14T11:56:48.508136+0000","last_undegraded":"2024-09-14T11:56:48.508136+0000","last_fullsized":"2024-09-14T11:56:48.508136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:13.807709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"263'335","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.352110+0000","last_change":"2024-09-14T10:46:50.365232+0000","last_active":"2024-09-14T12:01:18.352110+0000","last_peered":"2024-09-14T12:01:18.352110+0000","last_clean":"2024-09-14T12:01:18.352110+0000","last_became_active":"2024-09-14T10:46:50.364874+0000","last_became_peered":"2024-09-14T10:46:50.364874+0000","last_unstale":"2024-09-14T12:01:18.352110+0000","last_undegraded":"2024-09-14T12:01:18.352110+0000","last_fullsized":"2024-09-14T12:01:18.352110+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:43.130794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58887,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":550,"num_read_kb":1323,"num_write":450,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.434090+0000","last_change":"2024-09-14T10:46:52.374279+0000","last_active":"2024-09-14T11:56:55.434090+0000","last_peered":"2024-09-14T11:56:55.434090+0000","last_clean":"2024-09-14T11:56:55.434090+0000","last_became_active":"2024-09-14T10:46:52.373982+0000","last_became_peered":"2024-09-14T10:46:52.373982+0000","last_unstale":"2024-09-14T11:56:55.434090+0000","last_undegraded":"2024-09-14T11:56:55.434090+0000","last_fullsized":"2024-09-14T11:56:55.434090+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:41.838813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"263'117","reported_seq":613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.699014+0000","last_change":"2024-09-14T10:46:54.387894+0000","last_active":"2024-09-14T11:59:34.699014+0000","last_peered":"2024-09-14T11:59:34.699014+0000","last_clean":"2024-09-14T11:59:34.699014+0000","last_became_active":"2024-09-14T10:46:54.387552+0000","last_became_peered":"2024-09-14T10:46:54.387552+0000","last_unstale":"2024-09-14T11:59:34.699014+0000","last_undegraded":"2024-09-14T11:59:34.699014+0000","last_fullsized":"2024-09-14T11:59:34.699014+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:39.903611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":107,"num_write":284,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"263'405","reported_seq":1853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.140847+0000","last_change":"2024-09-14T10:46:46.348830+0000","last_active":"2024-09-14T12:00:51.140847+0000","last_peered":"2024-09-14T12:00:51.140847+0000","last_clean":"2024-09-14T12:00:51.140847+0000","last_became_active":"2024-09-14T10:46:46.348040+0000","last_became_peered":"2024-09-14T10:46:46.348040+0000","last_unstale":"2024-09-14T12:00:51.140847+0000","last_undegraded":"2024-09-14T12:00:51.140847+0000","last_fullsized":"2024-09-14T12:00:51.140847+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:14.154127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2178,"num_read_kb":2045,"num_write":462,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"263'336","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.328310+0000","last_change":"2024-09-14T10:46:44.333549+0000","last_active":"2024-09-14T12:01:19.328310+0000","last_peered":"2024-09-14T12:01:19.328310+0000","last_clean":"2024-09-14T12:01:19.328310+0000","last_became_active":"2024-09-14T10:46:44.333195+0000","last_became_peered":"2024-09-14T10:46:44.333195+0000","last_unstale":"2024-09-14T12:01:19.328310+0000","last_undegraded":"2024-09-14T12:01:19.328310+0000","last_fullsized":"2024-09-14T12:01:19.328310+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:18.381740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":77356,"num_write":1081,"num_write_kb":55140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.632326+0000","last_change":"2024-09-14T10:46:48.357298+0000","last_active":"2024-09-14T11:56:50.632326+0000","last_peered":"2024-09-14T11:56:50.632326+0000","last_clean":"2024-09-14T11:56:50.632326+0000","last_became_active":"2024-09-14T10:46:48.357033+0000","last_became_peered":"2024-09-14T10:46:48.357033+0000","last_unstale":"2024-09-14T11:56:50.632326+0000","last_undegraded":"2024-09-14T11:56:50.632326+0000","last_fullsized":"2024-09-14T11:56:50.632326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:02.877431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"263'63","reported_seq":576,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:37.053655+0000","last_change":"2024-09-14T10:46:50.363154+0000","last_active":"2024-09-14T11:57:37.053655+0000","last_peered":"2024-09-14T11:57:37.053655+0000","last_clean":"2024-09-14T11:57:37.053655+0000","last_became_active":"2024-09-14T10:46:50.362878+0000","last_became_peered":"2024-09-14T10:46:50.362878+0000","last_unstale":"2024-09-14T11:57:37.053655+0000","last_undegraded":"2024-09-14T11:57:37.053655+0000","last_fullsized":"2024-09-14T11:57:37.053655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:48.083949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.294045+0000","last_change":"2024-09-14T10:46:52.366285+0000","last_active":"2024-09-14T11:56:55.294045+0000","last_peered":"2024-09-14T11:56:55.294045+0000","last_clean":"2024-09-14T11:56:55.294045+0000","last_became_active":"2024-09-14T10:46:52.365987+0000","last_became_peered":"2024-09-14T10:46:52.365987+0000","last_unstale":"2024-09-14T11:56:55.294045+0000","last_undegraded":"2024-09-14T11:56:55.294045+0000","last_fullsized":"2024-09-14T11:56:55.294045+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:43.965292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"263'198","reported_seq":733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.608962+0000","last_change":"2024-09-14T10:46:54.383562+0000","last_active":"2024-09-14T11:59:33.608962+0000","last_peered":"2024-09-14T11:59:33.608962+0000","last_clean":"2024-09-14T11:59:33.608962+0000","last_became_active":"2024-09-14T10:46:54.383284+0000","last_became_peered":"2024-09-14T10:46:54.383284+0000","last_unstale":"2024-09-14T11:59:33.608962+0000","last_undegraded":"2024-09-14T11:59:33.608962+0000","last_fullsized":"2024-09-14T11:59:33.608962+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:22.704423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":348,"num_read_kb":326,"num_write":460,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"263'463","reported_seq":2089,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:51.553105+0000","last_change":"2024-09-14T10:46:46.341746+0000","last_active":"2024-09-14T11:57:51.553105+0000","last_peered":"2024-09-14T11:57:51.553105+0000","last_clean":"2024-09-14T11:57:51.553105+0000","last_became_active":"2024-09-14T10:46:46.341424+0000","last_became_peered":"2024-09-14T10:46:46.341424+0000","last_unstale":"2024-09-14T11:57:51.553105+0000","last_undegraded":"2024-09-14T11:57:51.553105+0000","last_fullsized":"2024-09-14T11:57:51.553105+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:09.296793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2571,"num_read_kb":2437,"num_write":538,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"263'326","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.370956+0000","last_change":"2024-09-14T10:46:44.322321+0000","last_active":"2024-09-14T12:01:19.370956+0000","last_peered":"2024-09-14T12:01:19.370956+0000","last_clean":"2024-09-14T12:01:19.370956+0000","last_became_active":"2024-09-14T10:46:44.321694+0000","last_became_peered":"2024-09-14T10:46:44.321694+0000","last_unstale":"2024-09-14T12:01:19.370956+0000","last_undegraded":"2024-09-14T12:01:19.370956+0000","last_fullsized":"2024-09-14T12:01:19.370956+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:00.511024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":535,"num_read_kb":12444,"num_write":977,"num_write_kb":13958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.293366+0000","last_change":"2024-09-14T10:46:48.351062+0000","last_active":"2024-09-14T11:56:50.293366+0000","last_peered":"2024-09-14T11:56:50.293366+0000","last_clean":"2024-09-14T11:56:50.293366+0000","last_became_active":"2024-09-14T10:46:48.350714+0000","last_became_peered":"2024-09-14T10:46:48.350714+0000","last_unstale":"2024-09-14T11:56:50.293366+0000","last_undegraded":"2024-09-14T11:56:50.293366+0000","last_fullsized":"2024-09-14T11:56:50.293366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:34.873720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"263'339","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.661096+0000","last_change":"2024-09-14T10:46:50.361153+0000","last_active":"2024-09-14T12:01:17.661096+0000","last_peered":"2024-09-14T12:01:17.661096+0000","last_clean":"2024-09-14T12:01:17.661096+0000","last_became_active":"2024-09-14T10:46:50.360886+0000","last_became_peered":"2024-09-14T10:46:50.360886+0000","last_unstale":"2024-09-14T12:01:17.661096+0000","last_undegraded":"2024-09-14T12:01:17.661096+0000","last_fullsized":"2024-09-14T12:01:17.661096+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:38.621371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50451,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":558,"num_read_kb":1238,"num_write":442,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.396137+0000","last_change":"2024-09-14T10:46:52.375402+0000","last_active":"2024-09-14T11:56:55.396137+0000","last_peered":"2024-09-14T11:56:55.396137+0000","last_clean":"2024-09-14T11:56:55.396137+0000","last_became_active":"2024-09-14T10:46:52.375120+0000","last_became_peered":"2024-09-14T10:46:52.375120+0000","last_unstale":"2024-09-14T11:56:55.396137+0000","last_undegraded":"2024-09-14T11:56:55.396137+0000","last_fullsized":"2024-09-14T11:56:55.396137+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:11.461786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"263'126","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.661848+0000","last_change":"2024-09-14T10:46:54.384403+0000","last_active":"2024-09-14T11:59:34.661848+0000","last_peered":"2024-09-14T11:59:34.661848+0000","last_clean":"2024-09-14T11:59:34.661848+0000","last_became_active":"2024-09-14T10:46:54.384113+0000","last_became_peered":"2024-09-14T10:46:54.384113+0000","last_unstale":"2024-09-14T11:59:34.661848+0000","last_undegraded":"2024-09-14T11:59:34.661848+0000","last_fullsized":"2024-09-14T11:59:34.661848+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:43.036020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":180,"num_read_kb":170,"num_write":302,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"263'376","reported_seq":2022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.915579+0000","last_change":"2024-09-14T10:46:46.346655+0000","last_active":"2024-09-14T11:58:23.915579+0000","last_peered":"2024-09-14T11:58:23.915579+0000","last_clean":"2024-09-14T11:58:23.915579+0000","last_became_active":"2024-09-14T10:46:46.346318+0000","last_became_peered":"2024-09-14T10:46:46.346318+0000","last_unstale":"2024-09-14T11:58:23.915579+0000","last_undegraded":"2024-09-14T11:58:23.915579+0000","last_fullsized":"2024-09-14T11:58:23.915579+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:49.199619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2319,"num_read_kb":2246,"num_write":412,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"263'384","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.450304+0000","last_change":"2024-09-14T10:46:44.333722+0000","last_active":"2024-09-14T12:01:18.450304+0000","last_peered":"2024-09-14T12:01:18.450304+0000","last_clean":"2024-09-14T12:01:18.450304+0000","last_became_active":"2024-09-14T10:46:44.332841+0000","last_became_peered":"2024-09-14T10:46:44.332841+0000","last_unstale":"2024-09-14T12:01:18.450304+0000","last_undegraded":"2024-09-14T12:01:18.450304+0000","last_fullsized":"2024-09-14T12:01:18.450304+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:52.405113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1590622,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":745,"num_read_kb":6861,"num_write":1406,"num_write_kb":25110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.518421+0000","last_change":"2024-09-14T10:46:48.353284+0000","last_active":"2024-09-14T11:56:50.518421+0000","last_peered":"2024-09-14T11:56:50.518421+0000","last_clean":"2024-09-14T11:56:50.518421+0000","last_became_active":"2024-09-14T10:46:48.353010+0000","last_became_peered":"2024-09-14T10:46:48.353010+0000","last_unstale":"2024-09-14T11:56:50.518421+0000","last_undegraded":"2024-09-14T11:56:50.518421+0000","last_fullsized":"2024-09-14T11:56:50.518421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:08.193075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"263'286","reported_seq":868,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.409390+0000","last_change":"2024-09-14T10:46:50.363596+0000","last_active":"2024-09-14T12:01:19.409390+0000","last_peered":"2024-09-14T12:01:19.409390+0000","last_clean":"2024-09-14T12:01:19.409390+0000","last_became_active":"2024-09-14T10:46:50.362723+0000","last_became_peered":"2024-09-14T10:46:50.362723+0000","last_unstale":"2024-09-14T12:01:19.409390+0000","last_undegraded":"2024-09-14T12:01:19.409390+0000","last_fullsized":"2024-09-14T12:01:19.409390+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:44.962512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44996,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":451,"num_read_kb":1030,"num_write":360,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.434159+0000","last_change":"2024-09-14T10:46:52.369320+0000","last_active":"2024-09-14T11:56:55.434159+0000","last_peered":"2024-09-14T11:56:55.434159+0000","last_clean":"2024-09-14T11:56:55.434159+0000","last_became_active":"2024-09-14T10:46:52.369048+0000","last_became_peered":"2024-09-14T10:46:52.369048+0000","last_unstale":"2024-09-14T11:56:55.434159+0000","last_undegraded":"2024-09-14T11:56:55.434159+0000","last_fullsized":"2024-09-14T11:56:55.434159+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:12.392541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"263'554","reported_seq":2332,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.143488+0000","last_change":"2024-09-14T10:46:46.349057+0000","last_active":"2024-09-14T12:00:51.143488+0000","last_peered":"2024-09-14T12:00:51.143488+0000","last_clean":"2024-09-14T12:00:51.143488+0000","last_became_active":"2024-09-14T10:46:46.348774+0000","last_became_peered":"2024-09-14T10:46:46.348774+0000","last_unstale":"2024-09-14T12:00:51.143488+0000","last_undegraded":"2024-09-14T12:00:51.143488+0000","last_fullsized":"2024-09-14T12:00:51.143488+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:39.288295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3189,"num_read_kb":2980,"num_write":657,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"263'374","reported_seq":1058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.415563+0000","last_change":"2024-09-14T10:46:44.335060+0000","last_active":"2024-09-14T12:01:18.415563+0000","last_peered":"2024-09-14T12:01:18.415563+0000","last_clean":"2024-09-14T12:01:18.415563+0000","last_became_active":"2024-09-14T10:46:44.334693+0000","last_became_peered":"2024-09-14T10:46:44.334693+0000","last_unstale":"2024-09-14T12:01:18.415563+0000","last_undegraded":"2024-09-14T12:01:18.415563+0000","last_fullsized":"2024-09-14T12:01:18.415563+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:35.652094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6947652,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":780,"num_read_kb":35701,"num_write":1225,"num_write_kb":25930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"38'3","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.196063+0000","last_change":"2024-09-14T10:46:48.350741+0000","last_active":"2024-09-14T12:01:17.196063+0000","last_peered":"2024-09-14T12:01:17.196063+0000","last_clean":"2024-09-14T12:01:17.196063+0000","last_became_active":"2024-09-14T10:46:48.350469+0000","last_became_peered":"2024-09-14T10:46:48.350469+0000","last_unstale":"2024-09-14T12:01:17.196063+0000","last_undegraded":"2024-09-14T12:01:17.196063+0000","last_fullsized":"2024-09-14T12:01:17.196063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:50.974578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"263'487","reported_seq":1117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.445763+0000","last_change":"2024-09-14T10:46:50.365772+0000","last_active":"2024-09-14T12:01:17.445763+0000","last_peered":"2024-09-14T12:01:17.445763+0000","last_clean":"2024-09-14T12:01:17.445763+0000","last_became_active":"2024-09-14T10:46:50.365486+0000","last_became_peered":"2024-09-14T10:46:50.365486+0000","last_unstale":"2024-09-14T12:01:17.445763+0000","last_undegraded":"2024-09-14T12:01:17.445763+0000","last_fullsized":"2024-09-14T12:01:17.445763+0000","mapping_epoch":32,"log_start":"263'400","ondisk_log_start":"263'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:08:39.304362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109358,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":865,"num_read_kb":1904,"num_write":748,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.294097+0000","last_change":"2024-09-14T10:46:52.372507+0000","last_active":"2024-09-14T11:56:55.294097+0000","last_peered":"2024-09-14T11:56:55.294097+0000","last_clean":"2024-09-14T11:56:55.294097+0000","last_became_active":"2024-09-14T10:46:52.372151+0000","last_became_peered":"2024-09-14T10:46:52.372151+0000","last_unstale":"2024-09-14T11:56:55.294097+0000","last_undegraded":"2024-09-14T11:56:55.294097+0000","last_fullsized":"2024-09-14T11:56:55.294097+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:35.607612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"263'205","reported_seq":716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.552966+0000","last_change":"2024-09-14T10:46:54.386817+0000","last_active":"2024-09-14T11:59:33.552966+0000","last_peered":"2024-09-14T11:59:33.552966+0000","last_clean":"2024-09-14T11:59:33.552966+0000","last_became_active":"2024-09-14T10:46:54.386525+0000","last_became_peered":"2024-09-14T10:46:54.386525+0000","last_unstale":"2024-09-14T11:59:33.552966+0000","last_undegraded":"2024-09-14T11:59:33.552966+0000","last_fullsized":"2024-09-14T11:59:33.552966+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:41.935098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":260,"num_read_kb":259,"num_write":474,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"263'415","reported_seq":2076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.500823+0000","last_change":"2024-09-14T10:46:46.342078+0000","last_active":"2024-09-14T11:59:49.500823+0000","last_peered":"2024-09-14T11:59:49.500823+0000","last_clean":"2024-09-14T11:59:49.500823+0000","last_became_active":"2024-09-14T10:46:46.341559+0000","last_became_peered":"2024-09-14T10:46:46.341559+0000","last_unstale":"2024-09-14T11:59:49.500823+0000","last_undegraded":"2024-09-14T11:59:49.500823+0000","last_fullsized":"2024-09-14T11:59:49.500823+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:25.649976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2371,"num_read_kb":2275,"num_write":467,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"263'282","reported_seq":929,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.283689+0000","last_change":"2024-09-14T10:46:44.320611+0000","last_active":"2024-09-14T12:01:19.283689+0000","last_peered":"2024-09-14T12:01:19.283689+0000","last_clean":"2024-09-14T12:01:19.283689+0000","last_became_active":"2024-09-14T10:46:44.319896+0000","last_became_peered":"2024-09-14T10:46:44.319896+0000","last_unstale":"2024-09-14T12:01:19.283689+0000","last_undegraded":"2024-09-14T12:01:19.283689+0000","last_fullsized":"2024-09-14T12:01:19.283689+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:43.510538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133682,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":524,"num_read_kb":94668,"num_write":900,"num_write_kb":37785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:40.298927+0000","last_change":"2024-09-14T10:46:48.355503+0000","last_active":"2024-09-14T11:57:40.298927+0000","last_peered":"2024-09-14T11:57:40.298927+0000","last_clean":"2024-09-14T11:57:40.298927+0000","last_became_active":"2024-09-14T10:46:48.355149+0000","last_became_peered":"2024-09-14T10:46:48.355149+0000","last_unstale":"2024-09-14T11:57:40.298927+0000","last_undegraded":"2024-09-14T11:57:40.298927+0000","last_fullsized":"2024-09-14T11:57:40.298927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:39.662714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"263'345","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.538027+0000","last_change":"2024-09-14T10:46:50.367103+0000","last_active":"2024-09-14T12:01:17.538027+0000","last_peered":"2024-09-14T12:01:17.538027+0000","last_clean":"2024-09-14T12:01:17.538027+0000","last_became_active":"2024-09-14T10:46:50.366749+0000","last_became_peered":"2024-09-14T10:46:50.366749+0000","last_unstale":"2024-09-14T12:01:17.538027+0000","last_undegraded":"2024-09-14T12:01:17.538027+0000","last_fullsized":"2024-09-14T12:01:17.538027+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:04.127284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49707,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":587,"num_read_kb":1269,"num_write":486,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.442435+0000","last_change":"2024-09-14T10:46:52.368766+0000","last_active":"2024-09-14T11:56:53.442435+0000","last_peered":"2024-09-14T11:56:53.442435+0000","last_clean":"2024-09-14T11:56:53.442435+0000","last_became_active":"2024-09-14T10:46:52.368508+0000","last_became_peered":"2024-09-14T10:46:52.368508+0000","last_unstale":"2024-09-14T11:56:53.442435+0000","last_undegraded":"2024-09-14T11:56:53.442435+0000","last_fullsized":"2024-09-14T11:56:53.442435+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:15.487064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"263'181","reported_seq":1057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.440714+0000","last_change":"2024-09-14T10:46:54.379236+0000","last_active":"2024-09-14T11:59:30.440714+0000","last_peered":"2024-09-14T11:59:30.440714+0000","last_clean":"2024-09-14T11:59:30.440714+0000","last_became_active":"2024-09-14T10:46:54.378938+0000","last_became_peered":"2024-09-14T10:46:54.378938+0000","last_unstale":"2024-09-14T11:59:30.440714+0000","last_undegraded":"2024-09-14T11:59:30.440714+0000","last_fullsized":"2024-09-14T11:59:30.440714+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:53.097947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2044,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":607,"num_read_kb":603,"num_write":505,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"263'637","reported_seq":2298,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.736746+0000","last_change":"2024-09-14T10:46:46.347640+0000","last_active":"2024-09-14T11:59:29.736746+0000","last_peered":"2024-09-14T11:59:29.736746+0000","last_clean":"2024-09-14T11:59:29.736746+0000","last_became_active":"2024-09-14T10:46:46.347362+0000","last_became_peered":"2024-09-14T10:46:46.347362+0000","last_unstale":"2024-09-14T11:59:29.736746+0000","last_undegraded":"2024-09-14T11:59:29.736746+0000","last_fullsized":"2024-09-14T11:59:29.736746+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":600,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:55.139779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3345,"num_read_kb":3056,"num_write":864,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"263'375","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.290468+0000","last_change":"2024-09-14T10:46:44.318782+0000","last_active":"2024-09-14T12:01:19.290468+0000","last_peered":"2024-09-14T12:01:19.290468+0000","last_clean":"2024-09-14T12:01:19.290468+0000","last_became_active":"2024-09-14T10:46:44.318099+0000","last_became_peered":"2024-09-14T10:46:44.318099+0000","last_unstale":"2024-09-14T12:01:19.290468+0000","last_undegraded":"2024-09-14T12:01:19.290468+0000","last_fullsized":"2024-09-14T12:01:19.290468+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:25.257513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133694,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":681,"num_read_kb":1685,"num_write":1259,"num_write_kb":36237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.293501+0000","last_change":"2024-09-14T10:46:48.350499+0000","last_active":"2024-09-14T11:56:50.293501+0000","last_peered":"2024-09-14T11:56:50.293501+0000","last_clean":"2024-09-14T11:56:50.293501+0000","last_became_active":"2024-09-14T10:46:48.350059+0000","last_became_peered":"2024-09-14T10:46:48.350059+0000","last_unstale":"2024-09-14T11:56:50.293501+0000","last_undegraded":"2024-09-14T11:56:50.293501+0000","last_fullsized":"2024-09-14T11:56:50.293501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:42.038929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"263'308","reported_seq":899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.526982+0000","last_change":"2024-09-14T10:46:50.365706+0000","last_active":"2024-09-14T12:01:18.526982+0000","last_peered":"2024-09-14T12:01:18.526982+0000","last_clean":"2024-09-14T12:01:18.526982+0000","last_became_active":"2024-09-14T10:46:50.365393+0000","last_became_peered":"2024-09-14T10:46:50.365393+0000","last_unstale":"2024-09-14T12:01:18.526982+0000","last_undegraded":"2024-09-14T12:01:18.526982+0000","last_fullsized":"2024-09-14T12:01:18.526982+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:00.491603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59332,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":502,"num_read_kb":1090,"num_write":403,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.453197+0000","last_change":"2024-09-14T10:46:52.373436+0000","last_active":"2024-09-14T11:59:10.453197+0000","last_peered":"2024-09-14T11:59:10.453197+0000","last_clean":"2024-09-14T11:59:10.453197+0000","last_became_active":"2024-09-14T10:46:52.373099+0000","last_became_peered":"2024-09-14T10:46:52.373099+0000","last_unstale":"2024-09-14T11:59:10.453197+0000","last_undegraded":"2024-09-14T11:59:10.453197+0000","last_fullsized":"2024-09-14T11:59:10.453197+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:41.461337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"263'143","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:52.308478+0000","last_change":"2024-09-14T10:46:54.385921+0000","last_active":"2024-09-14T12:00:52.308478+0000","last_peered":"2024-09-14T12:00:52.308478+0000","last_clean":"2024-09-14T12:00:52.308478+0000","last_became_active":"2024-09-14T10:46:54.385625+0000","last_became_peered":"2024-09-14T10:46:54.385625+0000","last_unstale":"2024-09-14T12:00:52.308478+0000","last_undegraded":"2024-09-14T12:00:52.308478+0000","last_fullsized":"2024-09-14T12:00:52.308478+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:00.984531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":790,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":228,"num_read_kb":197,"num_write":338,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"263'416","reported_seq":1957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.727179+0000","last_change":"2024-09-14T10:46:46.339137+0000","last_active":"2024-09-14T11:59:29.727179+0000","last_peered":"2024-09-14T11:59:29.727179+0000","last_clean":"2024-09-14T11:59:29.727179+0000","last_became_active":"2024-09-14T10:46:46.338551+0000","last_became_peered":"2024-09-14T10:46:46.338551+0000","last_unstale":"2024-09-14T11:59:29.727179+0000","last_undegraded":"2024-09-14T11:59:29.727179+0000","last_fullsized":"2024-09-14T11:59:29.727179+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:02.429002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2291,"num_read_kb":2170,"num_write":475,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"263'291","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.376172+0000","last_change":"2024-09-14T10:46:44.331964+0000","last_active":"2024-09-14T12:01:19.376172+0000","last_peered":"2024-09-14T12:01:19.376172+0000","last_clean":"2024-09-14T12:01:19.376172+0000","last_became_active":"2024-09-14T10:46:44.331660+0000","last_became_peered":"2024-09-14T10:46:44.331660+0000","last_unstale":"2024-09-14T12:01:19.376172+0000","last_undegraded":"2024-09-14T12:01:19.376172+0000","last_fullsized":"2024-09-14T12:01:19.376172+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:22.697298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":521,"num_read_kb":29638,"num_write":955,"num_write_kb":30451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.632361+0000","last_change":"2024-09-14T10:46:48.350417+0000","last_active":"2024-09-14T11:56:50.632361+0000","last_peered":"2024-09-14T11:56:50.632361+0000","last_clean":"2024-09-14T11:56:50.632361+0000","last_became_active":"2024-09-14T10:46:48.350072+0000","last_became_peered":"2024-09-14T10:46:48.350072+0000","last_unstale":"2024-09-14T11:56:50.632361+0000","last_undegraded":"2024-09-14T11:56:50.632361+0000","last_fullsized":"2024-09-14T11:56:50.632361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:34.764307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"263'125","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.533624+0000","last_change":"2024-09-14T10:46:50.368321+0000","last_active":"2024-09-14T11:58:55.533624+0000","last_peered":"2024-09-14T11:58:55.533624+0000","last_clean":"2024-09-14T11:58:55.533624+0000","last_became_active":"2024-09-14T10:46:50.367991+0000","last_became_peered":"2024-09-14T10:46:50.367991+0000","last_unstale":"2024-09-14T11:58:55.533624+0000","last_undegraded":"2024-09-14T11:58:55.533624+0000","last_fullsized":"2024-09-14T11:58:55.533624+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:39.918895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":126,"num_write":102,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"263'780","reported_seq":2687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.106488+0000","last_change":"2024-09-14T10:46:52.370832+0000","last_active":"2024-09-14T12:01:19.106488+0000","last_peered":"2024-09-14T12:01:19.106488+0000","last_clean":"2024-09-14T12:01:19.106488+0000","last_became_active":"2024-09-14T10:46:52.370446+0000","last_became_peered":"2024-09-14T10:46:52.370446+0000","last_unstale":"2024-09-14T12:01:19.106488+0000","last_undegraded":"2024-09-14T12:01:19.106488+0000","last_fullsized":"2024-09-14T12:01:19.106488+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:05.923305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"263'120","reported_seq":646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.519098+0000","last_change":"2024-09-14T10:46:54.378096+0000","last_active":"2024-09-14T11:56:55.519098+0000","last_peered":"2024-09-14T11:56:55.519098+0000","last_clean":"2024-09-14T11:56:55.519098+0000","last_became_active":"2024-09-14T10:46:54.377788+0000","last_became_peered":"2024-09-14T10:46:54.377788+0000","last_unstale":"2024-09-14T11:56:55.519098+0000","last_undegraded":"2024-09-14T11:56:55.519098+0000","last_fullsized":"2024-09-14T11:56:55.519098+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:20.522136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":221,"num_read_kb":193,"num_write":312,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"263'791","reported_seq":2334,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.734178+0000","last_change":"2024-09-14T10:46:46.352423+0000","last_active":"2024-09-14T11:59:29.734178+0000","last_peered":"2024-09-14T11:59:29.734178+0000","last_clean":"2024-09-14T11:59:29.734178+0000","last_became_active":"2024-09-14T10:46:46.352087+0000","last_became_peered":"2024-09-14T10:46:46.352087+0000","last_unstale":"2024-09-14T11:59:29.734178+0000","last_undegraded":"2024-09-14T11:59:29.734178+0000","last_fullsized":"2024-09-14T11:59:29.734178+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:12.501801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3891,"num_read_kb":3520,"num_write":1035,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"263'316","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.307559+0000","last_change":"2024-09-14T10:46:44.321112+0000","last_active":"2024-09-14T12:01:19.307559+0000","last_peered":"2024-09-14T12:01:19.307559+0000","last_clean":"2024-09-14T12:01:19.307559+0000","last_became_active":"2024-09-14T10:46:44.320689+0000","last_became_peered":"2024-09-14T10:46:44.320689+0000","last_unstale":"2024-09-14T12:01:19.307559+0000","last_undegraded":"2024-09-14T12:01:19.307559+0000","last_fullsized":"2024-09-14T12:01:19.307559+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:11.205586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":532,"num_read_kb":954,"num_write":1107,"num_write_kb":21144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.395545+0000","last_change":"2024-09-14T10:46:48.357357+0000","last_active":"2024-09-14T11:56:50.395545+0000","last_peered":"2024-09-14T11:56:50.395545+0000","last_clean":"2024-09-14T11:56:50.395545+0000","last_became_active":"2024-09-14T10:46:48.357024+0000","last_became_peered":"2024-09-14T10:46:48.357024+0000","last_unstale":"2024-09-14T11:56:50.395545+0000","last_undegraded":"2024-09-14T11:56:50.395545+0000","last_fullsized":"2024-09-14T11:56:50.395545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:57.501469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"263'378","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.928077+0000","last_change":"2024-09-14T10:46:50.362271+0000","last_active":"2024-09-14T12:01:18.928077+0000","last_peered":"2024-09-14T12:01:18.928077+0000","last_clean":"2024-09-14T12:01:18.928077+0000","last_became_active":"2024-09-14T10:46:50.361962+0000","last_became_peered":"2024-09-14T10:46:50.361962+0000","last_unstale":"2024-09-14T12:01:18.928077+0000","last_undegraded":"2024-09-14T12:01:18.928077+0000","last_fullsized":"2024-09-14T12:01:18.928077+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:52.644742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49011,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":601,"num_read_kb":1340,"num_write":486,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.633741+0000","last_change":"2024-09-14T10:46:52.369579+0000","last_active":"2024-09-14T11:57:00.633741+0000","last_peered":"2024-09-14T11:57:00.633741+0000","last_clean":"2024-09-14T11:57:00.633741+0000","last_became_active":"2024-09-14T10:46:52.369262+0000","last_became_peered":"2024-09-14T10:46:52.369262+0000","last_unstale":"2024-09-14T11:57:00.633741+0000","last_undegraded":"2024-09-14T11:57:00.633741+0000","last_fullsized":"2024-09-14T11:57:00.633741+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:35.807345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"263'147","reported_seq":659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.302488+0000","last_change":"2024-09-14T10:46:54.385691+0000","last_active":"2024-09-14T11:59:34.302488+0000","last_peered":"2024-09-14T11:59:34.302488+0000","last_clean":"2024-09-14T11:59:34.302488+0000","last_became_active":"2024-09-14T10:46:54.385235+0000","last_became_peered":"2024-09-14T10:46:54.385235+0000","last_unstale":"2024-09-14T11:59:34.302488+0000","last_undegraded":"2024-09-14T11:59:34.302488+0000","last_fullsized":"2024-09-14T11:59:34.302488+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:33.162523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":187,"num_write":368,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"263'748","reported_seq":2307,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.674695+0000","last_change":"2024-09-14T10:46:46.335431+0000","last_active":"2024-09-14T11:59:34.674695+0000","last_peered":"2024-09-14T11:59:34.674695+0000","last_clean":"2024-09-14T11:59:34.674695+0000","last_became_active":"2024-09-14T10:46:46.335112+0000","last_became_peered":"2024-09-14T10:46:46.335112+0000","last_unstale":"2024-09-14T11:59:34.674695+0000","last_undegraded":"2024-09-14T11:59:34.674695+0000","last_fullsized":"2024-09-14T11:59:34.674695+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:09.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3755,"num_read_kb":3425,"num_write":989,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"263'322","reported_seq":967,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.268474+0000","last_change":"2024-09-14T10:46:44.335176+0000","last_active":"2024-09-14T12:01:19.268474+0000","last_peered":"2024-09-14T12:01:19.268474+0000","last_clean":"2024-09-14T12:01:19.268474+0000","last_became_active":"2024-09-14T10:46:44.332130+0000","last_became_peered":"2024-09-14T10:46:44.332130+0000","last_unstale":"2024-09-14T12:01:19.268474+0000","last_undegraded":"2024-09-14T12:01:19.268474+0000","last_fullsized":"2024-09-14T12:01:19.268474+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:00.407801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":584,"num_read_kb":32074,"num_write":1014,"num_write_kb":20757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.293480+0000","last_change":"2024-09-14T10:46:48.354432+0000","last_active":"2024-09-14T11:56:50.293480+0000","last_peered":"2024-09-14T11:56:50.293480+0000","last_clean":"2024-09-14T11:56:50.293480+0000","last_became_active":"2024-09-14T10:46:48.354108+0000","last_became_peered":"2024-09-14T10:46:48.354108+0000","last_unstale":"2024-09-14T11:56:50.293480+0000","last_undegraded":"2024-09-14T11:56:50.293480+0000","last_fullsized":"2024-09-14T11:56:50.293480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:07.134782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"263'271","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.986296+0000","last_change":"2024-09-14T10:46:50.358462+0000","last_active":"2024-09-14T12:01:18.986296+0000","last_peered":"2024-09-14T12:01:18.986296+0000","last_clean":"2024-09-14T12:01:18.986296+0000","last_became_active":"2024-09-14T10:46:50.358186+0000","last_became_peered":"2024-09-14T10:46:50.358186+0000","last_unstale":"2024-09-14T12:01:18.986296+0000","last_undegraded":"2024-09-14T12:01:18.986296+0000","last_fullsized":"2024-09-14T12:01:18.986296+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:23.418101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46012,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":454,"num_read_kb":1061,"num_write":362,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:05.520539+0000","last_change":"2024-09-14T10:46:52.366046+0000","last_active":"2024-09-14T11:57:05.520539+0000","last_peered":"2024-09-14T11:57:05.520539+0000","last_clean":"2024-09-14T11:57:05.520539+0000","last_became_active":"2024-09-14T10:46:52.365736+0000","last_became_peered":"2024-09-14T10:46:52.365736+0000","last_unstale":"2024-09-14T11:57:05.520539+0000","last_undegraded":"2024-09-14T11:57:05.520539+0000","last_fullsized":"2024-09-14T11:57:05.520539+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:20.721132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"263'123","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.467272+0000","last_change":"2024-09-14T10:46:54.385215+0000","last_active":"2024-09-14T11:59:28.467272+0000","last_peered":"2024-09-14T11:59:28.467272+0000","last_clean":"2024-09-14T11:59:28.467272+0000","last_became_active":"2024-09-14T10:46:54.384303+0000","last_became_peered":"2024-09-14T10:46:54.384303+0000","last_unstale":"2024-09-14T11:59:28.467272+0000","last_undegraded":"2024-09-14T11:59:28.467272+0000","last_fullsized":"2024-09-14T11:59:28.467272+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:28.997409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":957,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":145,"num_write":281,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"263'378","reported_seq":1793,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:21.445410+0000","last_change":"2024-09-14T10:46:46.338858+0000","last_active":"2024-09-14T11:58:21.445410+0000","last_peered":"2024-09-14T11:58:21.445410+0000","last_clean":"2024-09-14T11:58:21.445410+0000","last_became_active":"2024-09-14T10:46:46.338518+0000","last_became_peered":"2024-09-14T10:46:46.338518+0000","last_unstale":"2024-09-14T11:58:21.445410+0000","last_undegraded":"2024-09-14T11:58:21.445410+0000","last_fullsized":"2024-09-14T11:58:21.445410+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:01.075539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2070,"num_read_kb":1951,"num_write":457,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"263'327","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.424856+0000","last_change":"2024-09-14T10:46:44.333207+0000","last_active":"2024-09-14T12:01:18.424856+0000","last_peered":"2024-09-14T12:01:18.424856+0000","last_clean":"2024-09-14T12:01:18.424856+0000","last_became_active":"2024-09-14T10:46:44.332852+0000","last_became_peered":"2024-09-14T10:46:44.332852+0000","last_unstale":"2024-09-14T12:01:18.424856+0000","last_undegraded":"2024-09-14T12:01:18.424856+0000","last_fullsized":"2024-09-14T12:01:18.424856+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:48.357394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244655,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":627,"num_read_kb":10749,"num_write":1185,"num_write_kb":43875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.396096+0000","last_change":"2024-09-14T10:46:48.355870+0000","last_active":"2024-09-14T11:56:55.396096+0000","last_peered":"2024-09-14T11:56:55.396096+0000","last_clean":"2024-09-14T11:56:55.396096+0000","last_became_active":"2024-09-14T10:46:48.355512+0000","last_became_peered":"2024-09-14T10:46:48.355512+0000","last_unstale":"2024-09-14T11:56:55.396096+0000","last_undegraded":"2024-09-14T11:56:55.396096+0000","last_fullsized":"2024-09-14T11:56:55.396096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:43.891041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"263'265","reported_seq":827,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.475186+0000","last_change":"2024-09-14T10:46:50.364736+0000","last_active":"2024-09-14T12:01:18.475186+0000","last_peered":"2024-09-14T12:01:18.475186+0000","last_clean":"2024-09-14T12:01:18.475186+0000","last_became_active":"2024-09-14T10:46:50.364420+0000","last_became_peered":"2024-09-14T10:46:50.364420+0000","last_unstale":"2024-09-14T12:01:18.475186+0000","last_undegraded":"2024-09-14T12:01:18.475186+0000","last_fullsized":"2024-09-14T12:01:18.475186+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:59.631655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45284,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":455,"num_read_kb":1165,"num_write":378,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.519191+0000","last_change":"2024-09-14T10:46:52.374194+0000","last_active":"2024-09-14T11:56:55.519191+0000","last_peered":"2024-09-14T11:56:55.519191+0000","last_clean":"2024-09-14T11:56:55.519191+0000","last_became_active":"2024-09-14T10:46:52.373913+0000","last_became_peered":"2024-09-14T10:46:52.373913+0000","last_unstale":"2024-09-14T11:56:55.519191+0000","last_undegraded":"2024-09-14T11:56:55.519191+0000","last_fullsized":"2024-09-14T11:56:55.519191+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:44.342253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"263'129","reported_seq":1230,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.354353+0000","last_change":"2024-09-14T10:46:54.383936+0000","last_active":"2024-09-14T11:59:30.354353+0000","last_peered":"2024-09-14T11:59:30.354353+0000","last_clean":"2024-09-14T11:59:30.354353+0000","last_became_active":"2024-09-14T10:46:54.383637+0000","last_became_peered":"2024-09-14T10:46:54.383637+0000","last_unstale":"2024-09-14T11:59:30.354353+0000","last_undegraded":"2024-09-14T11:59:30.354353+0000","last_fullsized":"2024-09-14T11:59:30.354353+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:19.327839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":738,"num_read_kb":738,"num_write":285,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"263'441","reported_seq":1899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.598287+0000","last_change":"2024-09-14T10:46:46.342570+0000","last_active":"2024-09-14T11:59:33.598287+0000","last_peered":"2024-09-14T11:59:33.598287+0000","last_clean":"2024-09-14T11:59:33.598287+0000","last_became_active":"2024-09-14T10:46:46.342299+0000","last_became_peered":"2024-09-14T10:46:46.342299+0000","last_unstale":"2024-09-14T11:59:33.598287+0000","last_undegraded":"2024-09-14T11:59:33.598287+0000","last_fullsized":"2024-09-14T11:59:33.598287+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:56.482166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2232,"num_read_kb":2089,"num_write":533,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"263'466","reported_seq":1218,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.379862+0000","last_change":"2024-09-14T10:46:44.321110+0000","last_active":"2024-09-14T12:01:18.379862+0000","last_peered":"2024-09-14T12:01:18.379862+0000","last_clean":"2024-09-14T12:01:18.379862+0000","last_became_active":"2024-09-14T10:46:44.320749+0000","last_became_peered":"2024-09-14T10:46:44.320749+0000","last_unstale":"2024-09-14T12:01:18.379862+0000","last_undegraded":"2024-09-14T12:01:18.379862+0000","last_fullsized":"2024-09-14T12:01:18.379862+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:58.570377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7815,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":1055,"num_read_kb":48118,"num_write":1484,"num_write_kb":57550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:10.635290+0000","last_change":"2024-09-14T10:46:48.353148+0000","last_active":"2024-09-14T11:57:10.635290+0000","last_peered":"2024-09-14T11:57:10.635290+0000","last_clean":"2024-09-14T11:57:10.635290+0000","last_became_active":"2024-09-14T10:46:48.352853+0000","last_became_peered":"2024-09-14T10:46:48.352853+0000","last_unstale":"2024-09-14T11:57:10.635290+0000","last_undegraded":"2024-09-14T11:57:10.635290+0000","last_fullsized":"2024-09-14T11:57:10.635290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:46.305353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"263'304","reported_seq":903,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.639297+0000","last_change":"2024-09-14T10:46:50.369781+0000","last_active":"2024-09-14T12:01:18.639297+0000","last_peered":"2024-09-14T12:01:18.639297+0000","last_clean":"2024-09-14T12:01:18.639297+0000","last_became_active":"2024-09-14T10:46:50.369492+0000","last_became_peered":"2024-09-14T10:46:50.369492+0000","last_unstale":"2024-09-14T12:01:18.639297+0000","last_undegraded":"2024-09-14T12:01:18.639297+0000","last_fullsized":"2024-09-14T12:01:18.639297+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:50.804436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49661,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":1034,"num_write":382,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.633068+0000","last_change":"2024-09-14T10:46:52.373456+0000","last_active":"2024-09-14T11:56:55.633068+0000","last_peered":"2024-09-14T11:56:55.633068+0000","last_clean":"2024-09-14T11:56:55.633068+0000","last_became_active":"2024-09-14T10:46:52.372108+0000","last_became_peered":"2024-09-14T10:46:52.372108+0000","last_unstale":"2024-09-14T11:56:55.633068+0000","last_undegraded":"2024-09-14T11:56:55.633068+0000","last_fullsized":"2024-09-14T11:56:55.633068+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:25.122029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"263'125","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.133558+0000","last_change":"2024-09-14T10:46:54.385169+0000","last_active":"2024-09-14T12:00:51.133558+0000","last_peered":"2024-09-14T12:00:51.133558+0000","last_clean":"2024-09-14T12:00:51.133558+0000","last_became_active":"2024-09-14T10:46:54.384278+0000","last_became_peered":"2024-09-14T10:46:54.384278+0000","last_unstale":"2024-09-14T12:00:51.133558+0000","last_undegraded":"2024-09-14T12:00:51.133558+0000","last_fullsized":"2024-09-14T12:00:51.133558+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:32.418655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":278,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"263'464","reported_seq":2034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.645877+0000","last_change":"2024-09-14T10:46:46.347263+0000","last_active":"2024-09-14T11:58:20.645877+0000","last_peered":"2024-09-14T11:58:20.645877+0000","last_clean":"2024-09-14T11:58:20.645877+0000","last_became_active":"2024-09-14T10:46:46.346994+0000","last_became_peered":"2024-09-14T10:46:46.346994+0000","last_unstale":"2024-09-14T11:58:20.645877+0000","last_undegraded":"2024-09-14T11:58:20.645877+0000","last_fullsized":"2024-09-14T11:58:20.645877+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:52.672214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2420,"num_read_kb":2273,"num_write":546,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"263'389","reported_seq":1145,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.365914+0000","last_change":"2024-09-14T10:46:44.329371+0000","last_active":"2024-09-14T12:01:19.365914+0000","last_peered":"2024-09-14T12:01:19.365914+0000","last_clean":"2024-09-14T12:01:19.365914+0000","last_became_active":"2024-09-14T10:46:44.328946+0000","last_became_peered":"2024-09-14T10:46:44.328946+0000","last_unstale":"2024-09-14T12:01:19.365914+0000","last_undegraded":"2024-09-14T12:01:19.365914+0000","last_fullsized":"2024-09-14T12:01:19.365914+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:41.337845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1017,"num_read_kb":28148,"num_write":1233,"num_write_kb":43814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"263'509","reported_seq":2191,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.915971+0000","last_change":"2024-09-14T10:46:46.343533+0000","last_active":"2024-09-14T11:58:23.915971+0000","last_peered":"2024-09-14T11:58:23.915971+0000","last_clean":"2024-09-14T11:58:23.915971+0000","last_became_active":"2024-09-14T10:46:46.343234+0000","last_became_peered":"2024-09-14T10:46:46.343234+0000","last_unstale":"2024-09-14T11:58:23.915971+0000","last_undegraded":"2024-09-14T11:58:23.915971+0000","last_fullsized":"2024-09-14T11:58:23.915971+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:10.850533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2663,"num_read_kb":2506,"num_write":583,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"263'344","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.370995+0000","last_change":"2024-09-14T10:46:44.317974+0000","last_active":"2024-09-14T12:01:19.370995+0000","last_peered":"2024-09-14T12:01:19.370995+0000","last_clean":"2024-09-14T12:01:19.370995+0000","last_became_active":"2024-09-14T10:46:44.317349+0000","last_became_peered":"2024-09-14T10:46:44.317349+0000","last_unstale":"2024-09-14T12:01:19.370995+0000","last_undegraded":"2024-09-14T12:01:19.370995+0000","last_fullsized":"2024-09-14T12:01:19.370995+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:49.115709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133675,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":5317,"num_write":990,"num_write_kb":25288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"263'447","reported_seq":1996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.498826+0000","last_change":"2024-09-14T10:46:46.347323+0000","last_active":"2024-09-14T11:59:49.498826+0000","last_peered":"2024-09-14T11:59:49.498826+0000","last_clean":"2024-09-14T11:59:49.498826+0000","last_became_active":"2024-09-14T10:46:46.346640+0000","last_became_peered":"2024-09-14T10:46:46.346640+0000","last_unstale":"2024-09-14T11:59:49.498826+0000","last_undegraded":"2024-09-14T11:59:49.498826+0000","last_fullsized":"2024-09-14T11:59:49.498826+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:33.703143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2347,"num_read_kb":2209,"num_write":542,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"263'346","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.403176+0000","last_change":"2024-09-14T10:46:44.328462+0000","last_active":"2024-09-14T12:01:19.403176+0000","last_peered":"2024-09-14T12:01:19.403176+0000","last_clean":"2024-09-14T12:01:19.403176+0000","last_became_active":"2024-09-14T10:46:44.328049+0000","last_became_peered":"2024-09-14T10:46:44.328049+0000","last_unstale":"2024-09-14T12:01:19.403176+0000","last_undegraded":"2024-09-14T12:01:19.403176+0000","last_fullsized":"2024-09-14T12:01:19.403176+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:12.916156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":619,"num_read_kb":2326,"num_write":1082,"num_write_kb":13442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"263'933","reported_seq":2731,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.707652+0000","last_change":"2024-09-14T10:46:46.349041+0000","last_active":"2024-09-14T11:59:34.707652+0000","last_peered":"2024-09-14T11:59:34.707652+0000","last_clean":"2024-09-14T11:59:34.707652+0000","last_became_active":"2024-09-14T10:46:46.346682+0000","last_became_peered":"2024-09-14T10:46:46.346682+0000","last_unstale":"2024-09-14T11:59:34.707652+0000","last_undegraded":"2024-09-14T11:59:34.707652+0000","last_fullsized":"2024-09-14T11:59:34.707652+0000","mapping_epoch":28,"log_start":"263'900","ondisk_log_start":"263'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":900,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:46.804415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4656,"num_read_kb":4197,"num_write":1246,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"263'355","reported_seq":1033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.422474+0000","last_change":"2024-09-14T10:47:19.040942+0000","last_active":"2024-09-14T12:01:18.422474+0000","last_peered":"2024-09-14T12:01:18.422474+0000","last_clean":"2024-09-14T12:01:18.422474+0000","last_became_active":"2024-09-14T10:47:19.040453+0000","last_became_peered":"2024-09-14T10:47:19.040453+0000","last_unstale":"2024-09-14T12:01:18.422474+0000","last_undegraded":"2024-09-14T12:01:18.422474+0000","last_fullsized":"2024-09-14T12:01:18.422474+0000","mapping_epoch":39,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:33.248100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12673081,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":677,"num_read_kb":25388,"num_write":1151,"num_write_kb":37274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"263'507","reported_seq":2207,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.152468+0000","last_change":"2024-09-14T10:46:46.349718+0000","last_active":"2024-09-14T11:58:46.152468+0000","last_peered":"2024-09-14T11:58:46.152468+0000","last_clean":"2024-09-14T11:58:46.152468+0000","last_became_active":"2024-09-14T10:46:46.349465+0000","last_became_peered":"2024-09-14T10:46:46.349465+0000","last_unstale":"2024-09-14T11:58:46.152468+0000","last_undegraded":"2024-09-14T11:58:46.152468+0000","last_fullsized":"2024-09-14T11:58:46.152468+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:17.558471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2847,"num_read_kb":2662,"num_write":617,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"263'310","reported_seq":1018,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.433682+0000","last_change":"2024-09-14T10:46:44.320591+0000","last_active":"2024-09-14T12:01:18.433682+0000","last_peered":"2024-09-14T12:01:18.433682+0000","last_clean":"2024-09-14T12:01:18.433682+0000","last_became_active":"2024-09-14T10:46:44.320218+0000","last_became_peered":"2024-09-14T10:46:44.320218+0000","last_unstale":"2024-09-14T12:01:18.433682+0000","last_undegraded":"2024-09-14T12:01:18.433682+0000","last_fullsized":"2024-09-14T12:01:18.433682+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:23.505336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245238,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":839,"num_read_kb":10863,"num_write":1100,"num_write_kb":35921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"263'436","reported_seq":2109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.916554+0000","last_change":"2024-09-14T10:46:46.342492+0000","last_active":"2024-09-14T11:58:23.916554+0000","last_peered":"2024-09-14T11:58:23.916554+0000","last_clean":"2024-09-14T11:58:23.916554+0000","last_became_active":"2024-09-14T10:46:46.342206+0000","last_became_peered":"2024-09-14T10:46:46.342206+0000","last_unstale":"2024-09-14T11:58:23.916554+0000","last_undegraded":"2024-09-14T11:58:23.916554+0000","last_fullsized":"2024-09-14T11:58:23.916554+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:44.468754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2469,"num_read_kb":2360,"num_write":494,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"263'437","reported_seq":1119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.517316+0000","last_change":"2024-09-14T10:46:44.314850+0000","last_active":"2024-09-14T12:01:18.517316+0000","last_peered":"2024-09-14T12:01:18.517316+0000","last_clean":"2024-09-14T12:01:18.517316+0000","last_became_active":"2024-09-14T10:46:44.314466+0000","last_became_peered":"2024-09-14T10:46:44.314466+0000","last_unstale":"2024-09-14T12:01:18.517316+0000","last_undegraded":"2024-09-14T12:01:18.517316+0000","last_fullsized":"2024-09-14T12:01:18.517316+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:39.202894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1528286,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":900,"num_read_kb":16042,"num_write":1216,"num_write_kb":34508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"263'667","reported_seq":2288,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.136829+0000","last_change":"2024-09-14T10:46:46.342488+0000","last_active":"2024-09-14T12:00:51.136829+0000","last_peered":"2024-09-14T12:00:51.136829+0000","last_clean":"2024-09-14T12:00:51.136829+0000","last_became_active":"2024-09-14T10:46:46.342217+0000","last_became_peered":"2024-09-14T10:46:46.342217+0000","last_unstale":"2024-09-14T12:00:51.136829+0000","last_undegraded":"2024-09-14T12:00:51.136829+0000","last_fullsized":"2024-09-14T12:00:51.136829+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":600,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:03.054708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3344,"num_read_kb":3009,"num_write":894,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"263'322","reported_seq":1064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.397645+0000","last_change":"2024-09-14T10:46:44.324067+0000","last_active":"2024-09-14T12:01:19.397645+0000","last_peered":"2024-09-14T12:01:19.397645+0000","last_clean":"2024-09-14T12:01:19.397645+0000","last_became_active":"2024-09-14T10:46:44.323339+0000","last_became_peered":"2024-09-14T10:46:44.323339+0000","last_unstale":"2024-09-14T12:01:19.397645+0000","last_undegraded":"2024-09-14T12:01:19.397645+0000","last_fullsized":"2024-09-14T12:01:19.397645+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:50.726091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":616,"num_read_kb":14372,"num_write":932,"num_write_kb":14595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'444","reported_seq":1976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.351227+0000","last_change":"2024-09-14T10:46:46.341986+0000","last_active":"2024-09-14T11:58:44.351227+0000","last_peered":"2024-09-14T11:58:44.351227+0000","last_clean":"2024-09-14T11:58:44.351227+0000","last_became_active":"2024-09-14T10:46:46.341731+0000","last_became_peered":"2024-09-14T10:46:46.341731+0000","last_unstale":"2024-09-14T11:58:44.351227+0000","last_undegraded":"2024-09-14T11:58:44.351227+0000","last_fullsized":"2024-09-14T11:58:44.351227+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:05.674327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2390,"num_read_kb":2239,"num_write":538,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"263'341","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.377267+0000","last_change":"2024-09-14T10:46:44.321933+0000","last_active":"2024-09-14T12:01:18.377267+0000","last_peered":"2024-09-14T12:01:18.377267+0000","last_clean":"2024-09-14T12:01:18.377267+0000","last_became_active":"2024-09-14T10:46:44.321604+0000","last_became_peered":"2024-09-14T10:46:44.321604+0000","last_unstale":"2024-09-14T12:01:18.377267+0000","last_undegraded":"2024-09-14T12:01:18.377267+0000","last_fullsized":"2024-09-14T12:01:18.377267+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:42.964237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243315,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":759,"num_read_kb":33590,"num_write":1210,"num_write_kb":22096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"263'970","reported_seq":2678,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.915612+0000","last_change":"2024-09-14T10:46:46.336853+0000","last_active":"2024-09-14T11:58:23.915612+0000","last_peered":"2024-09-14T11:58:23.915612+0000","last_clean":"2024-09-14T11:58:23.915612+0000","last_became_active":"2024-09-14T10:46:46.336508+0000","last_became_peered":"2024-09-14T10:46:46.336508+0000","last_unstale":"2024-09-14T11:58:23.915612+0000","last_undegraded":"2024-09-14T11:58:23.915612+0000","last_fullsized":"2024-09-14T11:58:23.915612+0000","mapping_epoch":28,"log_start":"263'900","ondisk_log_start":"263'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":900,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:08.953818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4671,"num_read_kb":4174,"num_write":1327,"num_write_kb":556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"263'317","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.346999+0000","last_change":"2024-09-14T10:46:44.321413+0000","last_active":"2024-09-14T12:01:19.346999+0000","last_peered":"2024-09-14T12:01:19.346999+0000","last_clean":"2024-09-14T12:01:19.346999+0000","last_became_active":"2024-09-14T10:46:44.321073+0000","last_became_peered":"2024-09-14T10:46:44.321073+0000","last_unstale":"2024-09-14T12:01:19.346999+0000","last_undegraded":"2024-09-14T12:01:19.346999+0000","last_fullsized":"2024-09-14T12:01:19.346999+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:02.410131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":672,"num_read_kb":7284,"num_write":1109,"num_write_kb":7346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"263'352","reported_seq":1803,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.683411+0000","last_change":"2024-09-14T10:46:46.343853+0000","last_active":"2024-09-14T11:59:34.683411+0000","last_peered":"2024-09-14T11:59:34.683411+0000","last_clean":"2024-09-14T11:59:34.683411+0000","last_became_active":"2024-09-14T10:46:46.341188+0000","last_became_peered":"2024-09-14T10:46:46.341188+0000","last_unstale":"2024-09-14T11:59:34.683411+0000","last_undegraded":"2024-09-14T11:59:34.683411+0000","last_fullsized":"2024-09-14T11:59:34.683411+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:55.124703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1965,"num_read_kb":1883,"num_write":389,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"263'360","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.372729+0000","last_change":"2024-09-14T10:46:44.316977+0000","last_active":"2024-09-14T12:01:18.372729+0000","last_peered":"2024-09-14T12:01:18.372729+0000","last_clean":"2024-09-14T12:01:18.372729+0000","last_became_active":"2024-09-14T10:46:44.316633+0000","last_became_peered":"2024-09-14T10:46:44.316633+0000","last_unstale":"2024-09-14T12:01:18.372729+0000","last_undegraded":"2024-09-14T12:01:18.372729+0000","last_fullsized":"2024-09-14T12:01:18.372729+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:02.290580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289618,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":754,"num_read_kb":2329,"num_write":1185,"num_write_kb":27267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"263'778","reported_seq":2432,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.462116+0000","last_change":"2024-09-14T10:46:46.348188+0000","last_active":"2024-09-14T11:58:58.462116+0000","last_peered":"2024-09-14T11:58:58.462116+0000","last_clean":"2024-09-14T11:58:58.462116+0000","last_became_active":"2024-09-14T10:46:46.347941+0000","last_became_peered":"2024-09-14T10:46:46.347941+0000","last_unstale":"2024-09-14T11:58:58.462116+0000","last_undegraded":"2024-09-14T11:58:58.462116+0000","last_fullsized":"2024-09-14T11:58:58.462116+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:09.760195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3936,"num_read_kb":3604,"num_write":1011,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"263'350","reported_seq":1112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.269823+0000","last_change":"2024-09-14T10:46:44.322513+0000","last_active":"2024-09-14T12:01:19.269823+0000","last_peered":"2024-09-14T12:01:19.269823+0000","last_clean":"2024-09-14T12:01:19.269823+0000","last_became_active":"2024-09-14T10:46:44.322149+0000","last_became_peered":"2024-09-14T10:46:44.322149+0000","last_unstale":"2024-09-14T12:01:19.269823+0000","last_undegraded":"2024-09-14T12:01:19.269823+0000","last_fullsized":"2024-09-14T12:01:19.269823+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:02.597943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":929,"num_read_kb":38620,"num_write":1197,"num_write_kb":16629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"263'788","reported_seq":2341,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.709237+0000","last_change":"2024-09-14T10:46:46.340742+0000","last_active":"2024-09-14T11:59:34.709237+0000","last_peered":"2024-09-14T11:59:34.709237+0000","last_clean":"2024-09-14T11:59:34.709237+0000","last_became_active":"2024-09-14T10:46:46.340475+0000","last_became_peered":"2024-09-14T10:46:46.340475+0000","last_unstale":"2024-09-14T11:59:34.709237+0000","last_undegraded":"2024-09-14T11:59:34.709237+0000","last_fullsized":"2024-09-14T11:59:34.709237+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:20.835262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3820,"num_read_kb":3456,"num_write":1020,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"263'314","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.308236+0000","last_change":"2024-09-14T10:46:44.329821+0000","last_active":"2024-09-14T12:01:19.308236+0000","last_peered":"2024-09-14T12:01:19.308236+0000","last_clean":"2024-09-14T12:01:19.308236+0000","last_became_active":"2024-09-14T10:46:44.329386+0000","last_became_peered":"2024-09-14T10:46:44.329386+0000","last_unstale":"2024-09-14T12:01:19.308236+0000","last_undegraded":"2024-09-14T12:01:19.308236+0000","last_fullsized":"2024-09-14T12:01:19.308236+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:52.796065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133721,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":628,"num_read_kb":13742,"num_write":1168,"num_write_kb":24265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"263'489","reported_seq":2188,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.408190+0000","last_change":"2024-09-14T10:46:46.351572+0000","last_active":"2024-09-14T11:58:50.408190+0000","last_peered":"2024-09-14T11:58:50.408190+0000","last_clean":"2024-09-14T11:58:50.408190+0000","last_became_active":"2024-09-14T10:46:46.351291+0000","last_became_peered":"2024-09-14T10:46:46.351291+0000","last_unstale":"2024-09-14T11:58:50.408190+0000","last_undegraded":"2024-09-14T11:58:50.408190+0000","last_fullsized":"2024-09-14T11:58:50.408190+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:43.260116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2678,"num_read_kb":2537,"num_write":593,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"263'343","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.341847+0000","last_change":"2024-09-14T10:46:44.329049+0000","last_active":"2024-09-14T12:01:19.341847+0000","last_peered":"2024-09-14T12:01:19.341847+0000","last_clean":"2024-09-14T12:01:19.341847+0000","last_became_active":"2024-09-14T10:46:44.328509+0000","last_became_peered":"2024-09-14T10:46:44.328509+0000","last_unstale":"2024-09-14T12:01:19.341847+0000","last_undegraded":"2024-09-14T12:01:19.341847+0000","last_fullsized":"2024-09-14T12:01:19.341847+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:39.663145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":629,"num_read_kb":8535,"num_write":1026,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"263'630","reported_seq":2305,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.706431+0000","last_change":"2024-09-14T10:46:46.343531+0000","last_active":"2024-09-14T11:59:34.706431+0000","last_peered":"2024-09-14T11:59:34.706431+0000","last_clean":"2024-09-14T11:59:34.706431+0000","last_became_active":"2024-09-14T10:46:46.343264+0000","last_became_peered":"2024-09-14T10:46:46.343264+0000","last_unstale":"2024-09-14T11:59:34.706431+0000","last_undegraded":"2024-09-14T11:59:34.706431+0000","last_fullsized":"2024-09-14T11:59:34.706431+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":600,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:52.794216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3383,"num_read_kb":3097,"num_write":846,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"263'340","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.364856+0000","last_change":"2024-09-14T10:46:44.335536+0000","last_active":"2024-09-14T12:01:19.364856+0000","last_peered":"2024-09-14T12:01:19.364856+0000","last_clean":"2024-09-14T12:01:19.364856+0000","last_became_active":"2024-09-14T10:46:44.334832+0000","last_became_peered":"2024-09-14T10:46:44.334832+0000","last_unstale":"2024-09-14T12:01:19.364856+0000","last_undegraded":"2024-09-14T12:01:19.364856+0000","last_fullsized":"2024-09-14T12:01:19.364856+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:03.288996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":614,"num_read_kb":31835,"num_write":1126,"num_write_kb":37799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"263'1869","reported_seq":3527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.599717+0000","last_change":"2024-09-14T10:46:46.345486+0000","last_active":"2024-09-14T11:59:33.599717+0000","last_peered":"2024-09-14T11:59:33.599717+0000","last_clean":"2024-09-14T11:59:33.599717+0000","last_became_active":"2024-09-14T10:46:46.344246+0000","last_became_peered":"2024-09-14T10:46:46.344246+0000","last_unstale":"2024-09-14T11:59:33.599717+0000","last_undegraded":"2024-09-14T11:59:33.599717+0000","last_fullsized":"2024-09-14T11:59:33.599717+0000","mapping_epoch":28,"log_start":"263'1800","ondisk_log_start":"263'1800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":1800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:37.648855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8234,"num_read_kb":7178,"num_write":2635,"num_write_kb":1169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"263'380","reported_seq":1025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.382847+0000","last_change":"2024-09-14T10:46:44.331913+0000","last_active":"2024-09-14T12:01:19.382847+0000","last_peered":"2024-09-14T12:01:19.382847+0000","last_clean":"2024-09-14T12:01:19.382847+0000","last_became_active":"2024-09-14T10:46:44.331468+0000","last_became_peered":"2024-09-14T10:46:44.331468+0000","last_unstale":"2024-09-14T12:01:19.382847+0000","last_undegraded":"2024-09-14T12:01:19.382847+0000","last_fullsized":"2024-09-14T12:01:19.382847+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:38.672416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":628,"num_read_kb":40986,"num_write":1142,"num_write_kb":50458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"263'596","reported_seq":2253,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.601844+0000","last_change":"2024-09-14T10:46:46.351650+0000","last_active":"2024-09-14T11:59:33.601844+0000","last_peered":"2024-09-14T11:59:33.601844+0000","last_clean":"2024-09-14T11:59:33.601844+0000","last_became_active":"2024-09-14T10:46:46.351379+0000","last_became_peered":"2024-09-14T10:46:46.351379+0000","last_unstale":"2024-09-14T11:59:33.601844+0000","last_undegraded":"2024-09-14T11:59:33.601844+0000","last_fullsized":"2024-09-14T11:59:33.601844+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:18.174017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3319,"num_read_kb":3081,"num_write":803,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"263'383","reported_seq":1100,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.439929+0000","last_change":"2024-09-14T10:47:18.421792+0000","last_active":"2024-09-14T12:01:18.439929+0000","last_peered":"2024-09-14T12:01:18.439929+0000","last_clean":"2024-09-14T12:01:18.439929+0000","last_became_active":"2024-09-14T10:47:18.421420+0000","last_became_peered":"2024-09-14T10:47:18.421420+0000","last_unstale":"2024-09-14T12:01:18.439929+0000","last_undegraded":"2024-09-14T12:01:18.439929+0000","last_fullsized":"2024-09-14T12:01:18.439929+0000","mapping_epoch":39,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:05.879273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":336,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":980,"num_read_kb":55242,"num_write":1350,"num_write_kb":21886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.30","version":"263'358","reported_seq":1059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.397325+0000","last_change":"2024-09-14T10:46:44.336725+0000","last_active":"2024-09-14T12:01:19.397325+0000","last_peered":"2024-09-14T12:01:19.397325+0000","last_clean":"2024-09-14T12:01:19.397325+0000","last_became_active":"2024-09-14T10:46:44.336397+0000","last_became_peered":"2024-09-14T10:46:44.336397+0000","last_unstale":"2024-09-14T12:01:19.397325+0000","last_undegraded":"2024-09-14T12:01:19.397325+0000","last_fullsized":"2024-09-14T12:01:19.397325+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:23.868126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":768,"num_read_kb":58312,"num_write":1211,"num_write_kb":50973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"263'436","reported_seq":2121,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.706348+0000","last_change":"2024-09-14T10:46:46.352747+0000","last_active":"2024-09-14T11:59:34.706348+0000","last_peered":"2024-09-14T11:59:34.706348+0000","last_clean":"2024-09-14T11:59:34.706348+0000","last_became_active":"2024-09-14T10:46:46.352396+0000","last_became_peered":"2024-09-14T10:46:46.352396+0000","last_unstale":"2024-09-14T11:59:34.706348+0000","last_undegraded":"2024-09-14T11:59:34.706348+0000","last_fullsized":"2024-09-14T11:59:34.706348+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:53.050193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2667,"num_read_kb":2535,"num_write":508,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"263'266","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.471594+0000","last_change":"2024-09-14T10:46:44.331837+0000","last_active":"2024-09-14T12:01:18.471594+0000","last_peered":"2024-09-14T12:01:18.471594+0000","last_clean":"2024-09-14T12:01:18.471594+0000","last_became_active":"2024-09-14T10:46:44.331494+0000","last_became_peered":"2024-09-14T10:46:44.331494+0000","last_unstale":"2024-09-14T12:01:18.471594+0000","last_undegraded":"2024-09-14T12:01:18.471594+0000","last_fullsized":"2024-09-14T12:01:18.471594+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:39.194351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6293269,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":443,"num_read_kb":43363,"num_write":875,"num_write_kb":33511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"263'471","reported_seq":1972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.221996+0000","last_change":"2024-09-14T10:46:46.339727+0000","last_active":"2024-09-14T11:58:15.221996+0000","last_peered":"2024-09-14T11:58:15.221996+0000","last_clean":"2024-09-14T11:58:15.221996+0000","last_became_active":"2024-09-14T10:46:46.339440+0000","last_became_peered":"2024-09-14T10:46:46.339440+0000","last_unstale":"2024-09-14T11:58:15.221996+0000","last_undegraded":"2024-09-14T11:58:15.221996+0000","last_fullsized":"2024-09-14T11:58:15.221996+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:46.085936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2508,"num_read_kb":2330,"num_write":579,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9256,"num_read_kb":6632,"num_write":2794,"num_write_kb":850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":943,"ondisk_log_size":943,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15505,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":15201,"num_read_kb":14853,"num_write":17064,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1688,"ondisk_log_size":1688,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":553,"ondisk_log_size":553,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1584090,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":19094,"num_read_kb":39420,"num_write":16012,"num_write_kb":12069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":708608,"data_stored":398694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2048,"ondisk_log_size":2048,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2425,"num_read_kb":2892,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":218145,"num_read_kb":199614,"num_write":55573,"num_write_kb":18950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3985,"ondisk_log_size":3985,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":122326437,"num_objects":937,"num_object_clones":0,"num_object_copies":2811,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":937,"num_whiteouts":0,"num_read":43610,"num_read_kb":1895594,"num_write":71043,"num_write_kb":2068626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":149217280,"data_stored":149217280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3454,"ondisk_log_size":3454,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":184539,"num_write":157,"num_write_kb":126109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":184485,"num_write":156,"num_write_kb":126109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16883712,"data_stored":16878134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510346,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":225200,"kb_used_data":9252,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":94146640,"statfs":{"total":96636764160,"available":96406159360,"internally_reserved":0,"allocated":9474048,"data_stored":7497795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":220920266},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510345,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":205276,"kb_used_data":11472,"kb_used_omap":1,"kb_used_meta":193534,"kb_avail":94166564,"statfs":{"total":96636764160,"available":96426561536,"internally_reserved":0,"allocated":11747328,"data_stored":9764047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":198179269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510345,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244176,"kb_used_data":14176,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94127664,"statfs":{"total":96636764160,"available":96386727936,"internally_reserved":0,"allocated":14516224,"data_stored":12527301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510345,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127500,"kb_used_data":10092,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94244340,"statfs":{"total":96636764160,"available":96506204160,"internally_reserved":0,"allocated":10334208,"data_stored":8364267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510344,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320452,"kb_used_data":10084,"kb_used_omap":1,"kb_used_meta":310206,"kb_avail":94051388,"statfs":{"total":96636764160,"available":96308621312,"internally_reserved":0,"allocated":10326016,"data_stored":8344841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":317651397},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510344,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112212,"kb_used_data":8700,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94259628,"statfs":{"total":96636764160,"available":96521859072,"internally_reserved":0,"allocated":8908800,"data_stored":6901467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543047,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":207532,"kb_used_data":100060,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94164308,"statfs":{"total":96636764160,"available":96424251392,"internally_reserved":0,"allocated":102461440,"data_stored":100416148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":110033351},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575753,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329420,"kb_used_data":63416,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94042420,"statfs":{"total":96636764160,"available":96299438080,"internally_reserved":0,"allocated":64937984,"data_stored":62923853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4694016,"data_stored":4694016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5550080,"data_stored":5550080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6160384,"data_stored":6160384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10321920,"data_stored":10321920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7557120,"data_stored":7557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":56639488,"data_stored":56639488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53002240,"data_stored":53002240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5292032,"data_stored":5292032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":214710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":178450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":50459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16830464,"data_stored":16827675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:01:21.591 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T12:01:21.591 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:01:21.949 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T12:01:21.959 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-14T12:01:21.961 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":2504,"stamp":"2024-09-14T12:01:21.023965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":124568671,"num_objects":1403,"num_object_clones":0,"num_object_copies":3743,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1403,"num_whiteouts":0,"num_read":308080,"num_read_kb":2528096,"num_write":162942,"num_write_kb":2359352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12957,"ondisk_log_size":12957,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1771768,"kb_used_data":227252,"kb_used_omap":12,"kb_used_meta":1543027,"kb_avail":753202952,"statfs":{"total":773094113280,"available":771279822848,"internally_reserved":0,"allocated":232706048,"data_stored":216739719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1580060209},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-527746617,"num_objects":-3442,"num_object_clones":0,"num_object_copies":-10289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3442,"num_whiteouts":0,"num_read":3881,"num_read_kb":3690,"num_write":3667,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005158"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.599297+0000","last_change":"2024-09-14T11:25:20.213046+0000","last_active":"2024-09-14T11:57:50.599297+0000","last_peered":"2024-09-14T11:57:50.599297+0000","last_clean":"2024-09-14T11:57:50.599297+0000","last_became_active":"2024-09-14T11:25:20.212282+0000","last_became_peered":"2024-09-14T11:25:20.212282+0000","last_unstale":"2024-09-14T11:57:50.599297+0000","last_undegraded":"2024-09-14T11:57:50.599297+0000","last_fullsized":"2024-09-14T11:57:50.599297+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:37.717916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"263'3","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.412622+0000","last_change":"2024-09-14T11:06:45.982990+0000","last_active":"2024-09-14T11:59:15.412622+0000","last_peered":"2024-09-14T11:59:15.412622+0000","last_clean":"2024-09-14T11:59:15.412622+0000","last_became_active":"2024-09-14T11:06:45.982702+0000","last_became_peered":"2024-09-14T11:06:45.982702+0000","last_unstale":"2024-09-14T11:59:15.412622+0000","last_undegraded":"2024-09-14T11:59:15.412622+0000","last_fullsized":"2024-09-14T11:59:15.412622+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:59.949376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.432607+0000","last_change":"2024-09-14T11:06:41.918549+0000","last_active":"2024-09-14T11:56:45.432607+0000","last_peered":"2024-09-14T11:56:45.432607+0000","last_clean":"2024-09-14T11:56:45.432607+0000","last_became_active":"2024-09-14T11:06:41.918259+0000","last_became_peered":"2024-09-14T11:06:41.918259+0000","last_unstale":"2024-09-14T11:56:45.432607+0000","last_undegraded":"2024-09-14T11:56:45.432607+0000","last_fullsized":"2024-09-14T11:56:45.432607+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:55.907181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'53","reported_seq":204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.650174+0000","last_change":"2024-09-14T11:02:34.872954+0000","last_active":"2024-09-14T11:58:50.650174+0000","last_peered":"2024-09-14T11:58:50.650174+0000","last_clean":"2024-09-14T11:58:50.650174+0000","last_became_active":"2024-09-14T11:02:34.872682+0000","last_became_peered":"2024-09-14T11:02:34.872682+0000","last_unstale":"2024-09-14T11:58:50.650174+0000","last_undegraded":"2024-09-14T11:58:50.650174+0000","last_fullsized":"2024-09-14T11:58:50.650174+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:01.174737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":419,"num_read_kb":273,"num_write":133,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:53.517430+0000","last_change":"2024-09-14T11:25:20.206920+0000","last_active":"2024-09-14T11:57:53.517430+0000","last_peered":"2024-09-14T11:57:53.517430+0000","last_clean":"2024-09-14T11:57:53.517430+0000","last_became_active":"2024-09-14T11:25:20.206601+0000","last_became_peered":"2024-09-14T11:25:20.206601+0000","last_unstale":"2024-09-14T11:57:53.517430+0000","last_undegraded":"2024-09-14T11:57:53.517430+0000","last_fullsized":"2024-09-14T11:57:53.517430+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:13.234370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"263'13","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.153862+0000","last_change":"2024-09-14T11:06:45.992917+0000","last_active":"2024-09-14T12:01:18.153862+0000","last_peered":"2024-09-14T12:01:18.153862+0000","last_clean":"2024-09-14T12:01:18.153862+0000","last_became_active":"2024-09-14T11:06:45.992612+0000","last_became_peered":"2024-09-14T11:06:45.992612+0000","last_unstale":"2024-09-14T12:01:18.153862+0000","last_undegraded":"2024-09-14T12:01:18.153862+0000","last_fullsized":"2024-09-14T12:01:18.153862+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:36.001623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13883,"num_write":28,"num_write_kb":14907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"263'3","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.464704+0000","last_change":"2024-09-14T11:06:41.912107+0000","last_active":"2024-09-14T11:59:13.464704+0000","last_peered":"2024-09-14T11:59:13.464704+0000","last_clean":"2024-09-14T11:59:13.464704+0000","last_became_active":"2024-09-14T11:06:41.911807+0000","last_became_peered":"2024-09-14T11:06:41.911807+0000","last_unstale":"2024-09-14T11:59:13.464704+0000","last_undegraded":"2024-09-14T11:59:13.464704+0000","last_fullsized":"2024-09-14T11:59:13.464704+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:55.009953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":621,"num_write":3,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"263'41","reported_seq":172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.650153+0000","last_change":"2024-09-14T11:02:34.879623+0000","last_active":"2024-09-14T11:58:50.650153+0000","last_peered":"2024-09-14T11:58:50.650153+0000","last_clean":"2024-09-14T11:58:50.650153+0000","last_became_active":"2024-09-14T11:02:34.879272+0000","last_became_peered":"2024-09-14T11:02:34.879272+0000","last_unstale":"2024-09-14T11:58:50.650153+0000","last_undegraded":"2024-09-14T11:58:50.650153+0000","last_fullsized":"2024-09-14T11:58:50.650153+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:46.038847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":323,"num_read_kb":209,"num_write":113,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.394943+0000","last_change":"2024-09-14T11:25:20.207542+0000","last_active":"2024-09-14T11:56:45.394943+0000","last_peered":"2024-09-14T11:56:45.394943+0000","last_clean":"2024-09-14T11:56:45.394943+0000","last_became_active":"2024-09-14T11:25:20.207226+0000","last_became_peered":"2024-09-14T11:25:20.207226+0000","last_unstale":"2024-09-14T11:56:45.394943+0000","last_undegraded":"2024-09-14T11:56:45.394943+0000","last_fullsized":"2024-09-14T11:56:45.394943+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:55.365914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.461362+0000","last_change":"2024-09-14T11:06:45.981984+0000","last_active":"2024-09-14T11:58:53.461362+0000","last_peered":"2024-09-14T11:58:53.461362+0000","last_clean":"2024-09-14T11:58:53.461362+0000","last_became_active":"2024-09-14T11:06:45.981705+0000","last_became_peered":"2024-09-14T11:06:45.981705+0000","last_unstale":"2024-09-14T11:58:53.461362+0000","last_undegraded":"2024-09-14T11:58:53.461362+0000","last_fullsized":"2024-09-14T11:58:53.461362+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:53.066712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.450843+0000","last_change":"2024-09-14T11:06:41.918237+0000","last_active":"2024-09-14T11:58:55.450843+0000","last_peered":"2024-09-14T11:58:55.450843+0000","last_clean":"2024-09-14T11:58:55.450843+0000","last_became_active":"2024-09-14T11:06:41.917774+0000","last_became_peered":"2024-09-14T11:06:41.917774+0000","last_unstale":"2024-09-14T11:58:55.450843+0000","last_undegraded":"2024-09-14T11:58:55.450843+0000","last_fullsized":"2024-09-14T11:58:55.450843+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:42.986789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'20","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:38.515232+0000","last_change":"2024-09-14T11:02:34.875159+0000","last_active":"2024-09-14T11:57:38.515232+0000","last_peered":"2024-09-14T11:57:38.515232+0000","last_clean":"2024-09-14T11:57:38.515232+0000","last_became_active":"2024-09-14T11:02:34.874685+0000","last_became_peered":"2024-09-14T11:02:34.874685+0000","last_unstale":"2024-09-14T11:57:38.515232+0000","last_undegraded":"2024-09-14T11:57:38.515232+0000","last_fullsized":"2024-09-14T11:57:38.515232+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:21.593031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":99,"num_write":50,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.442366+0000","last_change":"2024-09-14T11:25:20.211504+0000","last_active":"2024-09-14T11:56:53.442366+0000","last_peered":"2024-09-14T11:56:53.442366+0000","last_clean":"2024-09-14T11:56:53.442366+0000","last_became_active":"2024-09-14T11:25:20.211190+0000","last_became_peered":"2024-09-14T11:25:20.211190+0000","last_unstale":"2024-09-14T11:56:53.442366+0000","last_undegraded":"2024-09-14T11:56:53.442366+0000","last_fullsized":"2024-09-14T11:56:53.442366+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:02.921907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"263'7","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:58.480804+0000","last_change":"2024-09-14T11:06:45.980127+0000","last_active":"2024-09-14T12:00:58.480804+0000","last_peered":"2024-09-14T12:00:58.480804+0000","last_clean":"2024-09-14T12:00:58.480804+0000","last_became_active":"2024-09-14T11:06:45.979801+0000","last_became_peered":"2024-09-14T11:06:45.979801+0000","last_unstale":"2024-09-14T12:00:58.480804+0000","last_undegraded":"2024-09-14T12:00:58.480804+0000","last_fullsized":"2024-09-14T12:00:58.480804+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:14.264168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"263'5","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.481620+0000","last_change":"2024-09-14T11:06:41.905310+0000","last_active":"2024-09-14T12:01:17.481620+0000","last_peered":"2024-09-14T12:01:17.481620+0000","last_clean":"2024-09-14T12:01:17.481620+0000","last_became_active":"2024-09-14T11:06:41.905007+0000","last_became_peered":"2024-09-14T11:06:41.905007+0000","last_unstale":"2024-09-14T12:01:17.481620+0000","last_undegraded":"2024-09-14T12:01:17.481620+0000","last_fullsized":"2024-09-14T12:01:17.481620+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:37.875569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'31","reported_seq":132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:38.515217+0000","last_change":"2024-09-14T11:02:34.873370+0000","last_active":"2024-09-14T11:57:38.515217+0000","last_peered":"2024-09-14T11:57:38.515217+0000","last_clean":"2024-09-14T11:57:38.515217+0000","last_became_active":"2024-09-14T11:02:34.873091+0000","last_became_peered":"2024-09-14T11:02:34.873091+0000","last_unstale":"2024-09-14T11:57:38.515217+0000","last_undegraded":"2024-09-14T11:57:38.515217+0000","last_fullsized":"2024-09-14T11:57:38.515217+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:05.952366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":154,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:25.438215+0000","last_change":"2024-09-14T11:25:20.213420+0000","last_active":"2024-09-14T11:57:25.438215+0000","last_peered":"2024-09-14T11:57:25.438215+0000","last_clean":"2024-09-14T11:57:25.438215+0000","last_became_active":"2024-09-14T11:25:20.213064+0000","last_became_peered":"2024-09-14T11:25:20.213064+0000","last_unstale":"2024-09-14T11:57:25.438215+0000","last_undegraded":"2024-09-14T11:57:25.438215+0000","last_fullsized":"2024-09-14T11:57:25.438215+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:55.006063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"263'7","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:55.612856+0000","last_change":"2024-09-14T11:06:45.982348+0000","last_active":"2024-09-14T11:59:55.612856+0000","last_peered":"2024-09-14T11:59:55.612856+0000","last_clean":"2024-09-14T11:59:55.612856+0000","last_became_active":"2024-09-14T11:06:45.977225+0000","last_became_peered":"2024-09-14T11:06:45.977225+0000","last_unstale":"2024-09-14T11:59:55.612856+0000","last_undegraded":"2024-09-14T11:59:55.612856+0000","last_fullsized":"2024-09-14T11:59:55.612856+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:19.723203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20490,"num_write":7,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.447928+0000","last_change":"2024-09-14T11:06:41.916297+0000","last_active":"2024-09-14T11:57:28.447928+0000","last_peered":"2024-09-14T11:57:28.447928+0000","last_clean":"2024-09-14T11:57:28.447928+0000","last_became_active":"2024-09-14T11:06:41.916037+0000","last_became_peered":"2024-09-14T11:06:41.916037+0000","last_unstale":"2024-09-14T11:57:28.447928+0000","last_undegraded":"2024-09-14T11:57:28.447928+0000","last_fullsized":"2024-09-14T11:57:28.447928+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:36.838054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"263'6","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:38.515163+0000","last_change":"2024-09-14T11:02:34.878852+0000","last_active":"2024-09-14T11:57:38.515163+0000","last_peered":"2024-09-14T11:57:38.515163+0000","last_clean":"2024-09-14T11:57:38.515163+0000","last_became_active":"2024-09-14T11:02:34.878477+0000","last_became_peered":"2024-09-14T11:02:34.878477+0000","last_unstale":"2024-09-14T11:57:38.515163+0000","last_undegraded":"2024-09-14T11:57:38.515163+0000","last_fullsized":"2024-09-14T11:57:38.515163+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:50.190261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.648824+0000","last_change":"2024-09-14T11:25:20.211103+0000","last_active":"2024-09-14T11:58:40.648824+0000","last_peered":"2024-09-14T11:58:40.648824+0000","last_clean":"2024-09-14T11:58:40.648824+0000","last_became_active":"2024-09-14T11:25:20.210841+0000","last_became_peered":"2024-09-14T11:25:20.210841+0000","last_unstale":"2024-09-14T11:58:40.648824+0000","last_undegraded":"2024-09-14T11:58:40.648824+0000","last_fullsized":"2024-09-14T11:58:40.648824+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:22.472173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"260'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:30.523488+0000","last_change":"2024-09-14T11:06:45.992541+0000","last_active":"2024-09-14T11:57:30.523488+0000","last_peered":"2024-09-14T11:57:30.523488+0000","last_clean":"2024-09-14T11:57:30.523488+0000","last_became_active":"2024-09-14T11:06:45.992046+0000","last_became_peered":"2024-09-14T11:06:45.992046+0000","last_unstale":"2024-09-14T11:57:30.523488+0000","last_undegraded":"2024-09-14T11:57:30.523488+0000","last_fullsized":"2024-09-14T11:57:30.523488+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:54.123557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:35.524118+0000","last_change":"2024-09-14T11:06:41.909618+0000","last_active":"2024-09-14T11:57:35.524118+0000","last_peered":"2024-09-14T11:57:35.524118+0000","last_clean":"2024-09-14T11:57:35.524118+0000","last_became_active":"2024-09-14T11:06:41.909310+0000","last_became_peered":"2024-09-14T11:06:41.909310+0000","last_unstale":"2024-09-14T11:57:35.524118+0000","last_undegraded":"2024-09-14T11:57:35.524118+0000","last_fullsized":"2024-09-14T11:57:35.524118+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:36.988586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"263'17","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:35.298310+0000","last_change":"2024-09-14T11:02:34.879155+0000","last_active":"2024-09-14T11:57:35.298310+0000","last_peered":"2024-09-14T11:57:35.298310+0000","last_clean":"2024-09-14T11:57:35.298310+0000","last_became_active":"2024-09-14T11:02:34.878859+0000","last_became_peered":"2024-09-14T11:02:34.878859+0000","last_unstale":"2024-09-14T11:57:35.298310+0000","last_undegraded":"2024-09-14T11:57:35.298310+0000","last_fullsized":"2024-09-14T11:57:35.298310+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:06.717501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":82,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.300187+0000","last_change":"2024-09-14T11:25:20.214123+0000","last_active":"2024-09-14T11:57:50.300187+0000","last_peered":"2024-09-14T11:57:50.300187+0000","last_clean":"2024-09-14T11:57:50.300187+0000","last_became_active":"2024-09-14T11:25:20.213540+0000","last_became_peered":"2024-09-14T11:25:20.213540+0000","last_unstale":"2024-09-14T11:57:50.300187+0000","last_undegraded":"2024-09-14T11:57:50.300187+0000","last_fullsized":"2024-09-14T11:57:50.300187+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:22.650940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"260'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.292797+0000","last_change":"2024-09-14T11:06:45.986594+0000","last_active":"2024-09-14T11:56:45.292797+0000","last_peered":"2024-09-14T11:56:45.292797+0000","last_clean":"2024-09-14T11:56:45.292797+0000","last_became_active":"2024-09-14T11:06:45.984536+0000","last_became_peered":"2024-09-14T11:06:45.984536+0000","last_unstale":"2024-09-14T11:56:45.292797+0000","last_undegraded":"2024-09-14T11:56:45.292797+0000","last_fullsized":"2024-09-14T11:56:45.292797+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:50.142830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.592674+0000","last_change":"2024-09-14T11:06:41.917589+0000","last_active":"2024-09-14T11:56:45.592674+0000","last_peered":"2024-09-14T11:56:45.592674+0000","last_clean":"2024-09-14T11:56:45.592674+0000","last_became_active":"2024-09-14T11:06:41.917297+0000","last_became_peered":"2024-09-14T11:06:41.917297+0000","last_unstale":"2024-09-14T11:56:45.592674+0000","last_undegraded":"2024-09-14T11:56:45.592674+0000","last_fullsized":"2024-09-14T11:56:45.592674+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:24.720580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"260'21","reported_seq":118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.445641+0000","last_change":"2024-09-14T11:02:34.877058+0000","last_active":"2024-09-14T11:58:20.445641+0000","last_peered":"2024-09-14T11:58:20.445641+0000","last_clean":"2024-09-14T11:58:20.445641+0000","last_became_active":"2024-09-14T11:02:34.876726+0000","last_became_peered":"2024-09-14T11:02:34.876726+0000","last_unstale":"2024-09-14T11:58:20.445641+0000","last_undegraded":"2024-09-14T11:58:20.445641+0000","last_fullsized":"2024-09-14T11:58:20.445641+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:13.228297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":116,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.599347+0000","last_change":"2024-09-14T11:25:20.214842+0000","last_active":"2024-09-14T11:57:50.599347+0000","last_peered":"2024-09-14T11:57:50.599347+0000","last_clean":"2024-09-14T11:57:50.599347+0000","last_became_active":"2024-09-14T11:25:20.214475+0000","last_became_peered":"2024-09-14T11:25:20.214475+0000","last_unstale":"2024-09-14T11:57:50.599347+0000","last_undegraded":"2024-09-14T11:57:50.599347+0000","last_fullsized":"2024-09-14T11:57:50.599347+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:56.001599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.432562+0000","last_change":"2024-09-14T11:06:45.990723+0000","last_active":"2024-09-14T11:56:45.432562+0000","last_peered":"2024-09-14T11:56:45.432562+0000","last_clean":"2024-09-14T11:56:45.432562+0000","last_became_active":"2024-09-14T11:06:45.990419+0000","last_became_peered":"2024-09-14T11:06:45.990419+0000","last_unstale":"2024-09-14T11:56:45.432562+0000","last_undegraded":"2024-09-14T11:56:45.432562+0000","last_fullsized":"2024-09-14T11:56:45.432562+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:12.253426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"260'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.507306+0000","last_change":"2024-09-14T11:06:41.911568+0000","last_active":"2024-09-14T11:56:43.507306+0000","last_peered":"2024-09-14T11:56:43.507306+0000","last_clean":"2024-09-14T11:56:43.507306+0000","last_became_active":"2024-09-14T11:06:41.910694+0000","last_became_peered":"2024-09-14T11:06:41.910694+0000","last_unstale":"2024-09-14T11:56:43.507306+0000","last_undegraded":"2024-09-14T11:56:43.507306+0000","last_fullsized":"2024-09-14T11:56:43.507306+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:38.517703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"263'21","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:13.520593+0000","last_change":"2024-09-14T11:02:34.873098+0000","last_active":"2024-09-14T11:58:13.520593+0000","last_peered":"2024-09-14T11:58:13.520593+0000","last_clean":"2024-09-14T11:58:13.520593+0000","last_became_active":"2024-09-14T11:02:34.872803+0000","last_became_peered":"2024-09-14T11:02:34.872803+0000","last_unstale":"2024-09-14T11:58:13.520593+0000","last_undegraded":"2024-09-14T11:58:13.520593+0000","last_fullsized":"2024-09-14T11:58:13.520593+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:22.434265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":102,"num_write":56,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:03.453145+0000","last_change":"2024-09-14T11:25:20.208606+0000","last_active":"2024-09-14T11:58:03.453145+0000","last_peered":"2024-09-14T11:58:03.453145+0000","last_clean":"2024-09-14T11:58:03.453145+0000","last_became_active":"2024-09-14T11:25:20.207780+0000","last_became_peered":"2024-09-14T11:25:20.207780+0000","last_unstale":"2024-09-14T11:58:03.453145+0000","last_undegraded":"2024-09-14T11:58:03.453145+0000","last_fullsized":"2024-09-14T11:58:03.453145+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:39.802914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"263'9","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.358375+0000","last_change":"2024-09-14T11:06:45.992867+0000","last_active":"2024-09-14T12:01:18.358375+0000","last_peered":"2024-09-14T12:01:18.358375+0000","last_clean":"2024-09-14T12:01:18.358375+0000","last_became_active":"2024-09-14T11:06:45.992208+0000","last_became_peered":"2024-09-14T11:06:45.992208+0000","last_unstale":"2024-09-14T12:01:18.358375+0000","last_undegraded":"2024-09-14T12:01:18.358375+0000","last_fullsized":"2024-09-14T12:01:18.358375+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:21.488237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":17408,"num_write":14,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"263'8","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:30.546211+0000","last_change":"2024-09-14T11:06:41.915462+0000","last_active":"2024-09-14T12:00:30.546211+0000","last_peered":"2024-09-14T12:00:30.546211+0000","last_clean":"2024-09-14T12:00:30.546211+0000","last_became_active":"2024-09-14T11:06:41.915173+0000","last_became_peered":"2024-09-14T11:06:41.915173+0000","last_unstale":"2024-09-14T12:00:30.546211+0000","last_undegraded":"2024-09-14T12:00:30.546211+0000","last_fullsized":"2024-09-14T12:00:30.546211+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:30.823550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10242,"num_write":13,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"263'15","reported_seq":94,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:10.644198+0000","last_change":"2024-09-14T11:02:34.867951+0000","last_active":"2024-09-14T11:58:10.644198+0000","last_peered":"2024-09-14T11:58:10.644198+0000","last_clean":"2024-09-14T11:58:10.644198+0000","last_became_active":"2024-09-14T11:02:34.867669+0000","last_became_peered":"2024-09-14T11:02:34.867669+0000","last_unstale":"2024-09-14T11:58:10.644198+0000","last_undegraded":"2024-09-14T11:58:10.644198+0000","last_fullsized":"2024-09-14T11:58:10.644198+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:05.093113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":79,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:03.519056+0000","last_change":"2024-09-14T11:25:20.210078+0000","last_active":"2024-09-14T11:58:03.519056+0000","last_peered":"2024-09-14T11:58:03.519056+0000","last_clean":"2024-09-14T11:58:03.519056+0000","last_became_active":"2024-09-14T11:25:20.209801+0000","last_became_peered":"2024-09-14T11:25:20.209801+0000","last_unstale":"2024-09-14T11:58:03.519056+0000","last_undegraded":"2024-09-14T11:58:03.519056+0000","last_fullsized":"2024-09-14T11:58:03.519056+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:20.540163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:18.455327+0000","last_change":"2024-09-14T11:06:45.990540+0000","last_active":"2024-09-14T11:58:18.455327+0000","last_peered":"2024-09-14T11:58:18.455327+0000","last_clean":"2024-09-14T11:58:18.455327+0000","last_became_active":"2024-09-14T11:06:45.990093+0000","last_became_peered":"2024-09-14T11:06:45.990093+0000","last_unstale":"2024-09-14T11:58:18.455327+0000","last_undegraded":"2024-09-14T11:58:18.455327+0000","last_fullsized":"2024-09-14T11:58:18.455327+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:20.070813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"263'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.604354+0000","last_change":"2024-09-14T11:06:41.913660+0000","last_active":"2024-09-14T12:01:17.604354+0000","last_peered":"2024-09-14T12:01:17.604354+0000","last_clean":"2024-09-14T12:01:17.604354+0000","last_became_active":"2024-09-14T11:06:41.913330+0000","last_became_peered":"2024-09-14T11:06:41.913330+0000","last_unstale":"2024-09-14T12:01:17.604354+0000","last_undegraded":"2024-09-14T12:01:17.604354+0000","last_fullsized":"2024-09-14T12:01:17.604354+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:02.767092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"263'51","reported_seq":192,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:10.644171+0000","last_change":"2024-09-14T11:02:34.879784+0000","last_active":"2024-09-14T11:58:10.644171+0000","last_peered":"2024-09-14T11:58:10.644171+0000","last_clean":"2024-09-14T11:58:10.644171+0000","last_became_active":"2024-09-14T11:02:34.879480+0000","last_became_peered":"2024-09-14T11:02:34.879480+0000","last_unstale":"2024-09-14T11:58:10.644171+0000","last_undegraded":"2024-09-14T11:58:10.644171+0000","last_fullsized":"2024-09-14T11:58:10.644171+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:26.792769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":249,"num_write":134,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:00.301161+0000","last_change":"2024-09-14T11:25:20.208545+0000","last_active":"2024-09-14T11:58:00.301161+0000","last_peered":"2024-09-14T11:58:00.301161+0000","last_clean":"2024-09-14T11:58:00.301161+0000","last_became_active":"2024-09-14T11:25:20.208253+0000","last_became_peered":"2024-09-14T11:25:20.208253+0000","last_unstale":"2024-09-14T11:58:00.301161+0000","last_undegraded":"2024-09-14T11:58:00.301161+0000","last_fullsized":"2024-09-14T11:58:00.301161+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:46.409317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:30.439086+0000","last_change":"2024-09-14T11:06:45.986563+0000","last_active":"2024-09-14T11:57:30.439086+0000","last_peered":"2024-09-14T11:57:30.439086+0000","last_clean":"2024-09-14T11:57:30.439086+0000","last_became_active":"2024-09-14T11:06:45.986268+0000","last_became_peered":"2024-09-14T11:06:45.986268+0000","last_unstale":"2024-09-14T11:57:30.439086+0000","last_undegraded":"2024-09-14T11:57:30.439086+0000","last_fullsized":"2024-09-14T11:57:30.439086+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:57.096459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.287810+0000","last_change":"2024-09-14T11:06:41.919231+0000","last_active":"2024-09-14T12:01:18.287810+0000","last_peered":"2024-09-14T12:01:18.287810+0000","last_clean":"2024-09-14T12:01:18.287810+0000","last_became_active":"2024-09-14T11:06:41.918902+0000","last_became_peered":"2024-09-14T11:06:41.918902+0000","last_unstale":"2024-09-14T12:01:18.287810+0000","last_undegraded":"2024-09-14T12:01:18.287810+0000","last_fullsized":"2024-09-14T12:01:18.287810+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:28.218893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"263'3","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:10.444411+0000","last_change":"2024-09-14T11:02:34.877942+0000","last_active":"2024-09-14T11:58:10.444411+0000","last_peered":"2024-09-14T11:58:10.444411+0000","last_clean":"2024-09-14T11:58:10.444411+0000","last_became_active":"2024-09-14T11:02:34.877623+0000","last_became_peered":"2024-09-14T11:02:34.877623+0000","last_unstale":"2024-09-14T11:58:10.444411+0000","last_undegraded":"2024-09-14T11:58:10.444411+0000","last_fullsized":"2024-09-14T11:58:10.444411+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:37.635532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:00.600265+0000","last_change":"2024-09-14T11:25:20.208685+0000","last_active":"2024-09-14T11:58:00.600265+0000","last_peered":"2024-09-14T11:58:00.600265+0000","last_clean":"2024-09-14T11:58:00.600265+0000","last_became_active":"2024-09-14T11:25:20.208411+0000","last_became_peered":"2024-09-14T11:25:20.208411+0000","last_unstale":"2024-09-14T11:58:00.600265+0000","last_undegraded":"2024-09-14T11:58:00.600265+0000","last_fullsized":"2024-09-14T11:58:00.600265+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:34.443942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:30.597082+0000","last_change":"2024-09-14T11:06:45.978750+0000","last_active":"2024-09-14T11:57:30.597082+0000","last_peered":"2024-09-14T11:57:30.597082+0000","last_clean":"2024-09-14T11:57:30.597082+0000","last_became_active":"2024-09-14T11:06:45.978458+0000","last_became_peered":"2024-09-14T11:06:45.978458+0000","last_unstale":"2024-09-14T11:57:30.597082+0000","last_undegraded":"2024-09-14T11:57:30.597082+0000","last_fullsized":"2024-09-14T11:57:30.597082+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:52.428245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:53.471119+0000","last_change":"2024-09-14T11:06:41.916068+0000","last_active":"2024-09-14T11:59:53.471119+0000","last_peered":"2024-09-14T11:59:53.471119+0000","last_clean":"2024-09-14T11:59:53.471119+0000","last_became_active":"2024-09-14T11:06:41.915795+0000","last_became_peered":"2024-09-14T11:06:41.915795+0000","last_unstale":"2024-09-14T11:59:53.471119+0000","last_undegraded":"2024-09-14T11:59:53.471119+0000","last_fullsized":"2024-09-14T11:59:53.471119+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:10.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"263'20","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.531842+0000","last_change":"2024-09-14T11:02:34.881678+0000","last_active":"2024-09-14T11:58:40.531842+0000","last_peered":"2024-09-14T11:58:40.531842+0000","last_clean":"2024-09-14T11:58:40.531842+0000","last_became_active":"2024-09-14T11:02:34.881333+0000","last_became_peered":"2024-09-14T11:02:34.881333+0000","last_unstale":"2024-09-14T11:58:40.531842+0000","last_undegraded":"2024-09-14T11:58:40.531842+0000","last_fullsized":"2024-09-14T11:58:40.531842+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:25.506302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":49,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.441698+0000","last_change":"2024-09-14T11:25:20.209663+0000","last_active":"2024-09-14T11:56:48.441698+0000","last_peered":"2024-09-14T11:56:48.441698+0000","last_clean":"2024-09-14T11:56:48.441698+0000","last_became_active":"2024-09-14T11:25:20.209369+0000","last_became_peered":"2024-09-14T11:25:20.209369+0000","last_unstale":"2024-09-14T11:56:48.441698+0000","last_undegraded":"2024-09-14T11:56:48.441698+0000","last_fullsized":"2024-09-14T11:56:48.441698+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:58.938617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:08.453886+0000","last_change":"2024-09-14T11:06:45.981996+0000","last_active":"2024-09-14T11:58:08.453886+0000","last_peered":"2024-09-14T11:58:08.453886+0000","last_clean":"2024-09-14T11:58:08.453886+0000","last_became_active":"2024-09-14T11:06:45.980211+0000","last_became_peered":"2024-09-14T11:06:45.980211+0000","last_unstale":"2024-09-14T11:58:08.453886+0000","last_undegraded":"2024-09-14T11:58:08.453886+0000","last_fullsized":"2024-09-14T11:58:08.453886+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:03.580856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.403612+0000","last_change":"2024-09-14T11:06:41.903200+0000","last_active":"2024-09-14T11:58:05.403612+0000","last_peered":"2024-09-14T11:58:05.403612+0000","last_clean":"2024-09-14T11:58:05.403612+0000","last_became_active":"2024-09-14T11:06:41.902894+0000","last_became_peered":"2024-09-14T11:06:41.902894+0000","last_unstale":"2024-09-14T11:58:05.403612+0000","last_undegraded":"2024-09-14T11:58:05.403612+0000","last_fullsized":"2024-09-14T11:58:05.403612+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:39.369082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"260'15","reported_seq":101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:35.531184+0000","last_change":"2024-09-14T11:02:34.873962+0000","last_active":"2024-09-14T11:58:35.531184+0000","last_peered":"2024-09-14T11:58:35.531184+0000","last_clean":"2024-09-14T11:58:35.531184+0000","last_became_active":"2024-09-14T11:02:34.873660+0000","last_became_peered":"2024-09-14T11:02:34.873660+0000","last_unstale":"2024-09-14T11:58:35.531184+0000","last_undegraded":"2024-09-14T11:58:35.531184+0000","last_fullsized":"2024-09-14T11:58:35.531184+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:08.878693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":83,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.508214+0000","last_change":"2024-09-14T11:25:20.210810+0000","last_active":"2024-09-14T11:56:48.508214+0000","last_peered":"2024-09-14T11:56:48.508214+0000","last_clean":"2024-09-14T11:56:48.508214+0000","last_became_active":"2024-09-14T11:25:20.210534+0000","last_became_peered":"2024-09-14T11:25:20.210534+0000","last_unstale":"2024-09-14T11:56:48.508214+0000","last_undegraded":"2024-09-14T11:56:48.508214+0000","last_fullsized":"2024-09-14T11:56:48.508214+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:04.144981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:08.453853+0000","last_change":"2024-09-14T11:06:45.985239+0000","last_active":"2024-09-14T11:58:08.453853+0000","last_peered":"2024-09-14T11:58:08.453853+0000","last_clean":"2024-09-14T11:58:08.453853+0000","last_became_active":"2024-09-14T11:06:45.984993+0000","last_became_peered":"2024-09-14T11:06:45.984993+0000","last_unstale":"2024-09-14T11:58:08.453853+0000","last_undegraded":"2024-09-14T11:58:08.453853+0000","last_fullsized":"2024-09-14T11:58:08.453853+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:26.543636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"263'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:23.475632+0000","last_change":"2024-09-14T11:06:41.910546+0000","last_active":"2024-09-14T12:00:23.475632+0000","last_peered":"2024-09-14T12:00:23.475632+0000","last_clean":"2024-09-14T12:00:23.475632+0000","last_became_active":"2024-09-14T11:06:41.910286+0000","last_became_peered":"2024-09-14T11:06:41.910286+0000","last_unstale":"2024-09-14T12:00:23.475632+0000","last_undegraded":"2024-09-14T12:00:23.475632+0000","last_fullsized":"2024-09-14T12:00:23.475632+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:00.405940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"263'55","reported_seq":203,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:35.447992+0000","last_change":"2024-09-14T11:02:34.873185+0000","last_active":"2024-09-14T11:58:35.447992+0000","last_peered":"2024-09-14T11:58:35.447992+0000","last_clean":"2024-09-14T11:58:35.447992+0000","last_became_active":"2024-09-14T11:02:34.872911+0000","last_became_peered":"2024-09-14T11:02:34.872911+0000","last_unstale":"2024-09-14T11:58:35.447992+0000","last_undegraded":"2024-09-14T11:58:35.447992+0000","last_fullsized":"2024-09-14T11:58:35.447992+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:20.423924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":434,"num_read_kb":298,"num_write":132,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.643221+0000","last_change":"2024-09-14T11:25:20.210573+0000","last_active":"2024-09-14T11:58:05.643221+0000","last_peered":"2024-09-14T11:58:05.643221+0000","last_clean":"2024-09-14T11:58:05.643221+0000","last_became_active":"2024-09-14T11:25:20.209547+0000","last_became_peered":"2024-09-14T11:25:20.209547+0000","last_unstale":"2024-09-14T11:58:05.643221+0000","last_undegraded":"2024-09-14T11:58:05.643221+0000","last_fullsized":"2024-09-14T11:58:05.643221+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:48.503085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:25.464893+0000","last_change":"2024-09-14T11:06:45.984844+0000","last_active":"2024-09-14T12:00:25.464893+0000","last_peered":"2024-09-14T12:00:25.464893+0000","last_clean":"2024-09-14T12:00:25.464893+0000","last_became_active":"2024-09-14T11:06:45.984527+0000","last_became_peered":"2024-09-14T11:06:45.984527+0000","last_unstale":"2024-09-14T12:00:25.464893+0000","last_undegraded":"2024-09-14T12:00:25.464893+0000","last_fullsized":"2024-09-14T12:00:25.464893+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:00.029592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"260'9","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.403653+0000","last_change":"2024-09-14T11:06:41.905789+0000","last_active":"2024-09-14T11:58:05.403653+0000","last_peered":"2024-09-14T11:58:05.403653+0000","last_clean":"2024-09-14T11:58:05.403653+0000","last_became_active":"2024-09-14T11:06:41.905088+0000","last_became_peered":"2024-09-14T11:06:41.905088+0000","last_unstale":"2024-09-14T11:58:05.403653+0000","last_undegraded":"2024-09-14T11:58:05.403653+0000","last_fullsized":"2024-09-14T11:58:05.403653+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:26.152725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17408,"num_write":9,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'36","reported_seq":152,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:35.304813+0000","last_change":"2024-09-14T11:02:34.873841+0000","last_active":"2024-09-14T11:58:35.304813+0000","last_peered":"2024-09-14T11:58:35.304813+0000","last_clean":"2024-09-14T11:58:35.304813+0000","last_became_active":"2024-09-14T11:02:34.873560+0000","last_became_peered":"2024-09-14T11:02:34.873560+0000","last_unstale":"2024-09-14T11:58:35.304813+0000","last_undegraded":"2024-09-14T11:58:35.304813+0000","last_fullsized":"2024-09-14T11:58:35.304813+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:07.656019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":270,"num_read_kb":162,"num_write":93,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.508186+0000","last_change":"2024-09-14T11:25:20.206947+0000","last_active":"2024-09-14T11:56:48.508186+0000","last_peered":"2024-09-14T11:56:48.508186+0000","last_clean":"2024-09-14T11:56:48.508186+0000","last_became_active":"2024-09-14T11:25:20.206692+0000","last_became_peered":"2024-09-14T11:25:20.206692+0000","last_unstale":"2024-09-14T11:56:48.508186+0000","last_undegraded":"2024-09-14T11:56:48.508186+0000","last_fullsized":"2024-09-14T11:56:48.508186+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:46.331575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.527582+0000","last_change":"2024-09-14T11:06:45.985776+0000","last_active":"2024-09-14T11:58:05.527582+0000","last_peered":"2024-09-14T11:58:05.527582+0000","last_clean":"2024-09-14T11:58:05.527582+0000","last_became_active":"2024-09-14T11:06:45.985436+0000","last_became_peered":"2024-09-14T11:06:45.985436+0000","last_unstale":"2024-09-14T11:58:05.527582+0000","last_undegraded":"2024-09-14T11:58:05.527582+0000","last_fullsized":"2024-09-14T11:58:05.527582+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:18.777447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.481613+0000","last_change":"2024-09-14T11:06:41.908095+0000","last_active":"2024-09-14T12:01:17.481613+0000","last_peered":"2024-09-14T12:01:17.481613+0000","last_clean":"2024-09-14T12:01:17.481613+0000","last_became_active":"2024-09-14T11:06:41.907791+0000","last_became_peered":"2024-09-14T11:06:41.907791+0000","last_unstale":"2024-09-14T12:01:17.481613+0000","last_undegraded":"2024-09-14T12:01:17.481613+0000","last_fullsized":"2024-09-14T12:01:17.481613+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:19.380573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5124,"num_write":5,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"263'33","reported_seq":149,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:35.447954+0000","last_change":"2024-09-14T11:02:34.876400+0000","last_active":"2024-09-14T11:58:35.447954+0000","last_peered":"2024-09-14T11:58:35.447954+0000","last_clean":"2024-09-14T11:58:35.447954+0000","last_became_active":"2024-09-14T11:02:34.876080+0000","last_became_peered":"2024-09-14T11:02:34.876080+0000","last_unstale":"2024-09-14T11:58:35.447954+0000","last_undegraded":"2024-09-14T11:58:35.447954+0000","last_fullsized":"2024-09-14T11:58:35.447954+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:45.087546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":186,"num_write":88,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:58.452425+0000","last_change":"2024-09-14T11:25:20.205656+0000","last_active":"2024-09-14T11:57:58.452425+0000","last_peered":"2024-09-14T11:57:58.452425+0000","last_clean":"2024-09-14T11:57:58.452425+0000","last_became_active":"2024-09-14T11:25:20.205335+0000","last_became_peered":"2024-09-14T11:25:20.205335+0000","last_unstale":"2024-09-14T11:57:58.452425+0000","last_undegraded":"2024-09-14T11:57:58.452425+0000","last_fullsized":"2024-09-14T11:57:58.452425+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:12.896781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:30.447384+0000","last_change":"2024-09-14T11:06:45.986506+0000","last_active":"2024-09-14T11:58:30.447384+0000","last_peered":"2024-09-14T11:58:30.447384+0000","last_clean":"2024-09-14T11:58:30.447384+0000","last_became_active":"2024-09-14T11:06:45.986225+0000","last_became_peered":"2024-09-14T11:06:45.986225+0000","last_unstale":"2024-09-14T11:58:30.447384+0000","last_undegraded":"2024-09-14T11:58:30.447384+0000","last_fullsized":"2024-09-14T11:58:30.447384+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:18.018900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"263'3","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:45.320227+0000","last_change":"2024-09-14T11:06:41.903610+0000","last_active":"2024-09-14T12:00:45.320227+0000","last_peered":"2024-09-14T12:00:45.320227+0000","last_clean":"2024-09-14T12:00:45.320227+0000","last_became_active":"2024-09-14T11:06:41.903188+0000","last_became_peered":"2024-09-14T11:06:41.903188+0000","last_unstale":"2024-09-14T12:00:45.320227+0000","last_undegraded":"2024-09-14T12:00:45.320227+0000","last_fullsized":"2024-09-14T12:00:45.320227+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:45.086214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"263'55","reported_seq":202,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.451654+0000","last_change":"2024-09-14T11:02:34.878079+0000","last_active":"2024-09-14T11:59:00.451654+0000","last_peered":"2024-09-14T11:59:00.451654+0000","last_clean":"2024-09-14T11:59:00.451654+0000","last_became_active":"2024-09-14T11:02:34.877631+0000","last_became_peered":"2024-09-14T11:02:34.877631+0000","last_unstale":"2024-09-14T11:59:00.451654+0000","last_undegraded":"2024-09-14T11:59:00.451654+0000","last_fullsized":"2024-09-14T11:59:00.451654+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:50.183737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":260,"num_write":147,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.409942+0000","last_change":"2024-09-14T11:25:20.203431+0000","last_active":"2024-09-14T11:59:05.409942+0000","last_peered":"2024-09-14T11:59:05.409942+0000","last_clean":"2024-09-14T11:59:05.409942+0000","last_became_active":"2024-09-14T11:25:20.200061+0000","last_became_peered":"2024-09-14T11:25:20.200061+0000","last_unstale":"2024-09-14T11:59:05.409942+0000","last_undegraded":"2024-09-14T11:59:05.409942+0000","last_fullsized":"2024-09-14T11:59:05.409942+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:15.179721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:45.467828+0000","last_change":"2024-09-14T11:06:45.991468+0000","last_active":"2024-09-14T12:00:45.467828+0000","last_peered":"2024-09-14T12:00:45.467828+0000","last_clean":"2024-09-14T12:00:45.467828+0000","last_became_active":"2024-09-14T11:06:45.991198+0000","last_became_peered":"2024-09-14T11:06:45.991198+0000","last_unstale":"2024-09-14T12:00:45.467828+0000","last_undegraded":"2024-09-14T12:00:45.467828+0000","last_fullsized":"2024-09-14T12:00:45.467828+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:02.331809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"263'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:43.542221+0000","last_change":"2024-09-14T11:06:41.910787+0000","last_active":"2024-09-14T12:00:43.542221+0000","last_peered":"2024-09-14T12:00:43.542221+0000","last_clean":"2024-09-14T12:00:43.542221+0000","last_became_active":"2024-09-14T11:06:41.910512+0000","last_became_peered":"2024-09-14T11:06:41.910512+0000","last_unstale":"2024-09-14T12:00:43.542221+0000","last_undegraded":"2024-09-14T12:00:43.542221+0000","last_fullsized":"2024-09-14T12:00:43.542221+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:20.996429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"263'44","reported_seq":172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.533064+0000","last_change":"2024-09-14T11:02:34.881693+0000","last_active":"2024-09-14T11:58:50.533064+0000","last_peered":"2024-09-14T11:58:50.533064+0000","last_clean":"2024-09-14T11:58:50.533064+0000","last_became_active":"2024-09-14T11:02:34.881341+0000","last_became_peered":"2024-09-14T11:02:34.881341+0000","last_unstale":"2024-09-14T11:58:50.533064+0000","last_undegraded":"2024-09-14T11:58:50.533064+0000","last_fullsized":"2024-09-14T11:58:50.533064+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:36.323501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":339,"num_read_kb":228,"num_write":117,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.525849+0000","last_change":"2024-09-14T11:25:20.210429+0000","last_active":"2024-09-14T11:57:50.525849+0000","last_peered":"2024-09-14T11:57:50.525849+0000","last_clean":"2024-09-14T11:57:50.525849+0000","last_became_active":"2024-09-14T11:25:20.210117+0000","last_became_peered":"2024-09-14T11:25:20.210117+0000","last_unstale":"2024-09-14T11:57:50.525849+0000","last_undegraded":"2024-09-14T11:57:50.525849+0000","last_fullsized":"2024-09-14T11:57:50.525849+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:07.063593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'6","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.152467+0000","last_change":"2024-09-14T11:06:45.992869+0000","last_active":"2024-09-14T12:01:18.152467+0000","last_peered":"2024-09-14T12:01:18.152467+0000","last_clean":"2024-09-14T12:01:18.152467+0000","last_became_active":"2024-09-14T11:06:45.992574+0000","last_became_peered":"2024-09-14T11:06:45.992574+0000","last_unstale":"2024-09-14T12:01:18.152467+0000","last_undegraded":"2024-09-14T12:01:18.152467+0000","last_fullsized":"2024-09-14T12:01:18.152467+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:58.347483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:30.447415+0000","last_change":"2024-09-14T11:06:41.919642+0000","last_active":"2024-09-14T11:58:30.447415+0000","last_peered":"2024-09-14T11:58:30.447415+0000","last_clean":"2024-09-14T11:58:30.447415+0000","last_became_active":"2024-09-14T11:06:41.919330+0000","last_became_peered":"2024-09-14T11:06:41.919330+0000","last_unstale":"2024-09-14T11:58:30.447415+0000","last_undegraded":"2024-09-14T11:58:30.447415+0000","last_fullsized":"2024-09-14T11:58:30.447415+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:18.967454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"263'112","reported_seq":390,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.408228+0000","last_change":"2024-09-14T11:02:34.873664+0000","last_active":"2024-09-14T11:58:50.408228+0000","last_peered":"2024-09-14T11:58:50.408228+0000","last_clean":"2024-09-14T11:58:50.408228+0000","last_became_active":"2024-09-14T11:02:34.873360+0000","last_became_peered":"2024-09-14T11:02:34.873360+0000","last_unstale":"2024-09-14T11:58:50.408228+0000","last_undegraded":"2024-09-14T11:58:50.408228+0000","last_fullsized":"2024-09-14T11:58:50.408228+0000","mapping_epoch":252,"log_start":"263'100","ondisk_log_start":"263'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:33.431081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1014,"num_read_kb":809,"num_write":225,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.401985+0000","last_change":"2024-09-14T11:25:20.200172+0000","last_active":"2024-09-14T11:57:50.401985+0000","last_peered":"2024-09-14T11:57:50.401985+0000","last_clean":"2024-09-14T11:57:50.401985+0000","last_became_active":"2024-09-14T11:25:20.199875+0000","last_became_peered":"2024-09-14T11:25:20.199875+0000","last_unstale":"2024-09-14T11:57:50.401985+0000","last_undegraded":"2024-09-14T11:57:50.401985+0000","last_fullsized":"2024-09-14T11:57:50.401985+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:26.854076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"260'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:33.457900+0000","last_change":"2024-09-14T11:06:45.980652+0000","last_active":"2024-09-14T11:58:33.457900+0000","last_peered":"2024-09-14T11:58:33.457900+0000","last_clean":"2024-09-14T11:58:33.457900+0000","last_became_active":"2024-09-14T11:06:45.980035+0000","last_became_peered":"2024-09-14T11:06:45.980035+0000","last_unstale":"2024-09-14T11:58:33.457900+0000","last_undegraded":"2024-09-14T11:58:33.457900+0000","last_fullsized":"2024-09-14T11:58:33.457900+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:36.733533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:55.469343+0000","last_change":"2024-09-14T11:06:41.917633+0000","last_active":"2024-09-14T12:00:55.469343+0000","last_peered":"2024-09-14T12:00:55.469343+0000","last_clean":"2024-09-14T12:00:55.469343+0000","last_became_active":"2024-09-14T11:06:41.917341+0000","last_became_peered":"2024-09-14T11:06:41.917341+0000","last_unstale":"2024-09-14T12:00:55.469343+0000","last_undegraded":"2024-09-14T12:00:55.469343+0000","last_fullsized":"2024-09-14T12:00:55.469343+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:27.626042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"260'15","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.526593+0000","last_change":"2024-09-14T11:02:34.876368+0000","last_active":"2024-09-14T11:58:53.526593+0000","last_peered":"2024-09-14T11:58:53.526593+0000","last_clean":"2024-09-14T11:58:53.526593+0000","last_became_active":"2024-09-14T11:02:34.876078+0000","last_became_peered":"2024-09-14T11:02:34.876078+0000","last_unstale":"2024-09-14T11:58:53.526593+0000","last_undegraded":"2024-09-14T11:58:53.526593+0000","last_fullsized":"2024-09-14T11:58:53.526593+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:14.606877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":83,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.442454+0000","last_change":"2024-09-14T11:25:20.210430+0000","last_active":"2024-09-14T11:56:53.442454+0000","last_peered":"2024-09-14T11:56:53.442454+0000","last_clean":"2024-09-14T11:56:53.442454+0000","last_became_active":"2024-09-14T11:25:20.210181+0000","last_became_peered":"2024-09-14T11:25:20.210181+0000","last_unstale":"2024-09-14T11:56:53.442454+0000","last_undegraded":"2024-09-14T11:56:53.442454+0000","last_fullsized":"2024-09-14T11:56:53.442454+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:56.596921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.532365+0000","last_change":"2024-09-14T11:06:45.984990+0000","last_active":"2024-09-14T11:58:45.532365+0000","last_peered":"2024-09-14T11:58:45.532365+0000","last_clean":"2024-09-14T11:58:45.532365+0000","last_became_active":"2024-09-14T11:06:45.984696+0000","last_became_peered":"2024-09-14T11:06:45.984696+0000","last_unstale":"2024-09-14T11:58:45.532365+0000","last_undegraded":"2024-09-14T11:58:45.532365+0000","last_fullsized":"2024-09-14T11:58:45.532365+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:17.939743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"263'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:55.469166+0000","last_change":"2024-09-14T11:06:41.914553+0000","last_active":"2024-09-14T12:00:55.469166+0000","last_peered":"2024-09-14T12:00:55.469166+0000","last_clean":"2024-09-14T12:00:55.469166+0000","last_became_active":"2024-09-14T11:06:41.914209+0000","last_became_peered":"2024-09-14T11:06:41.914209+0000","last_unstale":"2024-09-14T12:00:55.469166+0000","last_undegraded":"2024-09-14T12:00:55.469166+0000","last_fullsized":"2024-09-14T12:00:55.469166+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:46.262011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"263'35","reported_seq":148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.526513+0000","last_change":"2024-09-14T11:02:34.880131+0000","last_active":"2024-09-14T11:58:53.526513+0000","last_peered":"2024-09-14T11:58:53.526513+0000","last_clean":"2024-09-14T11:58:53.526513+0000","last_became_active":"2024-09-14T11:02:34.879834+0000","last_became_peered":"2024-09-14T11:02:34.879834+0000","last_unstale":"2024-09-14T11:58:53.526513+0000","last_undegraded":"2024-09-14T11:58:53.526513+0000","last_fullsized":"2024-09-14T11:58:53.526513+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:06.529921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":172,"num_write":95,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.294128+0000","last_change":"2024-09-14T11:25:20.205157+0000","last_active":"2024-09-14T11:56:55.294128+0000","last_peered":"2024-09-14T11:56:55.294128+0000","last_clean":"2024-09-14T11:56:55.294128+0000","last_became_active":"2024-09-14T11:25:20.204834+0000","last_became_peered":"2024-09-14T11:25:20.204834+0000","last_unstale":"2024-09-14T11:56:55.294128+0000","last_undegraded":"2024-09-14T11:56:55.294128+0000","last_fullsized":"2024-09-14T11:56:55.294128+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:44.546050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.305849+0000","last_change":"2024-09-14T11:06:45.986635+0000","last_active":"2024-09-14T11:58:45.305849+0000","last_peered":"2024-09-14T11:58:45.305849+0000","last_clean":"2024-09-14T11:58:45.305849+0000","last_became_active":"2024-09-14T11:06:45.984865+0000","last_became_peered":"2024-09-14T11:06:45.984865+0000","last_unstale":"2024-09-14T11:58:45.305849+0000","last_undegraded":"2024-09-14T11:58:45.305849+0000","last_fullsized":"2024-09-14T11:58:45.305849+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:51.926620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"260'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:43.459476+0000","last_change":"2024-09-14T11:06:41.909800+0000","last_active":"2024-09-14T11:58:43.459476+0000","last_peered":"2024-09-14T11:58:43.459476+0000","last_clean":"2024-09-14T11:58:43.459476+0000","last_became_active":"2024-09-14T11:06:41.909533+0000","last_became_peered":"2024-09-14T11:06:41.909533+0000","last_unstale":"2024-09-14T11:58:43.459476+0000","last_undegraded":"2024-09-14T11:58:43.459476+0000","last_fullsized":"2024-09-14T11:58:43.459476+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:38.325179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"263'25","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.308510+0000","last_change":"2024-09-14T11:02:34.873554+0000","last_active":"2024-09-14T11:59:10.308510+0000","last_peered":"2024-09-14T11:59:10.308510+0000","last_clean":"2024-09-14T11:59:10.308510+0000","last_became_active":"2024-09-14T11:02:34.873259+0000","last_became_peered":"2024-09-14T11:02:34.873259+0000","last_unstale":"2024-09-14T11:59:10.308510+0000","last_undegraded":"2024-09-14T11:59:10.308510+0000","last_fullsized":"2024-09-14T11:59:10.308510+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:05.178830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":129,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.607073+0000","last_change":"2024-09-14T11:25:20.212620+0000","last_active":"2024-09-14T11:59:05.607073+0000","last_peered":"2024-09-14T11:59:05.607073+0000","last_clean":"2024-09-14T11:59:05.607073+0000","last_became_active":"2024-09-14T11:25:20.212293+0000","last_became_peered":"2024-09-14T11:25:20.212293+0000","last_unstale":"2024-09-14T11:59:05.607073+0000","last_undegraded":"2024-09-14T11:59:05.607073+0000","last_fullsized":"2024-09-14T11:59:05.607073+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:10.346864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:33.523575+0000","last_change":"2024-09-14T11:06:45.986687+0000","last_active":"2024-09-14T11:58:33.523575+0000","last_peered":"2024-09-14T11:58:33.523575+0000","last_clean":"2024-09-14T11:58:33.523575+0000","last_became_active":"2024-09-14T11:06:45.986398+0000","last_became_peered":"2024-09-14T11:06:45.986398+0000","last_unstale":"2024-09-14T11:58:33.523575+0000","last_undegraded":"2024-09-14T11:58:33.523575+0000","last_fullsized":"2024-09-14T11:58:33.523575+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:28.445077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"260'10","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.450778+0000","last_change":"2024-09-14T11:06:41.915770+0000","last_active":"2024-09-14T11:58:55.450778+0000","last_peered":"2024-09-14T11:58:55.450778+0000","last_clean":"2024-09-14T11:58:55.450778+0000","last_became_active":"2024-09-14T11:06:41.915491+0000","last_became_peered":"2024-09-14T11:06:41.915491+0000","last_unstale":"2024-09-14T11:58:55.450778+0000","last_undegraded":"2024-09-14T11:58:55.450778+0000","last_fullsized":"2024-09-14T11:58:55.450778+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:33.737820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":40964,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"260'12","reported_seq":91,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.462030+0000","last_change":"2024-09-14T11:02:34.872228+0000","last_active":"2024-09-14T11:58:58.462030+0000","last_peered":"2024-09-14T11:58:58.462030+0000","last_clean":"2024-09-14T11:58:58.462030+0000","last_became_active":"2024-09-14T11:02:34.871352+0000","last_became_peered":"2024-09-14T11:02:34.871352+0000","last_unstale":"2024-09-14T11:58:58.462030+0000","last_undegraded":"2024-09-14T11:58:58.462030+0000","last_fullsized":"2024-09-14T11:58:58.462030+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:29.511969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.452308+0000","last_change":"2024-09-14T11:25:20.214092+0000","last_active":"2024-09-14T11:59:05.452308+0000","last_peered":"2024-09-14T11:59:05.452308+0000","last_clean":"2024-09-14T11:59:05.452308+0000","last_became_active":"2024-09-14T11:25:20.213785+0000","last_became_peered":"2024-09-14T11:25:20.213785+0000","last_unstale":"2024-09-14T11:59:05.452308+0000","last_undegraded":"2024-09-14T11:59:05.452308+0000","last_fullsized":"2024-09-14T11:59:05.452308+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:56.298725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"260'2","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.605100+0000","last_change":"2024-09-14T11:06:45.981838+0000","last_active":"2024-09-14T11:58:45.605100+0000","last_peered":"2024-09-14T11:58:45.605100+0000","last_clean":"2024-09-14T11:58:45.605100+0000","last_became_active":"2024-09-14T11:06:45.981476+0000","last_became_peered":"2024-09-14T11:06:45.981476+0000","last_unstale":"2024-09-14T11:58:45.605100+0000","last_undegraded":"2024-09-14T11:58:45.605100+0000","last_fullsized":"2024-09-14T11:58:45.605100+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:58.441972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"260'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:30.530578+0000","last_change":"2024-09-14T11:06:41.911683+0000","last_active":"2024-09-14T11:58:30.530578+0000","last_peered":"2024-09-14T11:58:30.530578+0000","last_clean":"2024-09-14T11:58:30.530578+0000","last_became_active":"2024-09-14T11:06:41.911413+0000","last_became_peered":"2024-09-14T11:06:41.911413+0000","last_unstale":"2024-09-14T11:58:30.530578+0000","last_undegraded":"2024-09-14T11:58:30.530578+0000","last_fullsized":"2024-09-14T11:58:30.530578+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:52.497275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"263'38","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.606077+0000","last_change":"2024-09-14T11:02:34.879059+0000","last_active":"2024-09-14T11:58:55.606077+0000","last_peered":"2024-09-14T11:58:55.606077+0000","last_clean":"2024-09-14T11:58:55.606077+0000","last_became_active":"2024-09-14T11:02:34.878752+0000","last_became_peered":"2024-09-14T11:02:34.878752+0000","last_unstale":"2024-09-14T11:58:55.606077+0000","last_undegraded":"2024-09-14T11:58:55.606077+0000","last_fullsized":"2024-09-14T11:58:55.606077+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:34.432738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":231,"num_write":89,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.604290+0000","last_change":"2024-09-14T11:25:20.211271+0000","last_active":"2024-09-14T11:58:40.604290+0000","last_peered":"2024-09-14T11:58:40.604290+0000","last_clean":"2024-09-14T11:58:40.604290+0000","last_became_active":"2024-09-14T11:25:20.210999+0000","last_became_peered":"2024-09-14T11:25:20.210999+0000","last_unstale":"2024-09-14T11:58:40.604290+0000","last_undegraded":"2024-09-14T11:58:40.604290+0000","last_fullsized":"2024-09-14T11:58:40.604290+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:13.729258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.462863+0000","last_change":"2024-09-14T11:06:45.982956+0000","last_active":"2024-09-14T11:59:03.462863+0000","last_peered":"2024-09-14T11:59:03.462863+0000","last_clean":"2024-09-14T11:59:03.462863+0000","last_became_active":"2024-09-14T11:06:45.982181+0000","last_became_peered":"2024-09-14T11:06:45.982181+0000","last_unstale":"2024-09-14T11:59:03.462863+0000","last_undegraded":"2024-09-14T11:59:03.462863+0000","last_fullsized":"2024-09-14T11:59:03.462863+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:18.506633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.533019+0000","last_change":"2024-09-14T11:06:41.914378+0000","last_active":"2024-09-14T11:58:50.533019+0000","last_peered":"2024-09-14T11:58:50.533019+0000","last_clean":"2024-09-14T11:58:50.533019+0000","last_became_active":"2024-09-14T11:06:41.913192+0000","last_became_peered":"2024-09-14T11:06:41.913192+0000","last_unstale":"2024-09-14T11:58:50.533019+0000","last_undegraded":"2024-09-14T11:58:50.533019+0000","last_fullsized":"2024-09-14T11:58:50.533019+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:24.679035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"263'32","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.650978+0000","last_change":"2024-09-14T11:02:34.874602+0000","last_active":"2024-09-14T11:58:55.650978+0000","last_peered":"2024-09-14T11:58:55.650978+0000","last_clean":"2024-09-14T11:58:55.650978+0000","last_became_active":"2024-09-14T11:02:34.874328+0000","last_became_peered":"2024-09-14T11:02:34.874328+0000","last_unstale":"2024-09-14T11:58:55.650978+0000","last_undegraded":"2024-09-14T11:58:55.650978+0000","last_fullsized":"2024-09-14T11:58:55.650978+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:09.428522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":246,"num_read_kb":166,"num_write":81,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.604315+0000","last_change":"2024-09-14T11:25:20.213871+0000","last_active":"2024-09-14T11:58:40.604315+0000","last_peered":"2024-09-14T11:58:40.604315+0000","last_clean":"2024-09-14T11:58:40.604315+0000","last_became_active":"2024-09-14T11:25:20.213577+0000","last_became_peered":"2024-09-14T11:25:20.213577+0000","last_unstale":"2024-09-14T11:58:40.604315+0000","last_undegraded":"2024-09-14T11:58:40.604315+0000","last_fullsized":"2024-09-14T11:58:40.604315+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:03.148226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"263'10","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.842742+0000","last_change":"2024-09-14T11:06:45.991127+0000","last_active":"2024-09-14T12:01:17.842742+0000","last_peered":"2024-09-14T12:01:17.842742+0000","last_clean":"2024-09-14T12:01:17.842742+0000","last_became_active":"2024-09-14T11:06:45.990855+0000","last_became_peered":"2024-09-14T11:06:45.990855+0000","last_unstale":"2024-09-14T12:01:17.842742+0000","last_undegraded":"2024-09-14T12:01:17.842742+0000","last_fullsized":"2024-09-14T12:01:17.842742+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:28.658329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6246,"num_write":20,"num_write_kb":2098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"263'8","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:10.670577+0000","last_change":"2024-09-14T11:06:41.913753+0000","last_active":"2024-09-14T12:01:10.670577+0000","last_peered":"2024-09-14T12:01:10.670577+0000","last_clean":"2024-09-14T12:01:10.670577+0000","last_became_active":"2024-09-14T11:06:41.913454+0000","last_became_peered":"2024-09-14T11:06:41.913454+0000","last_unstale":"2024-09-14T12:01:10.670577+0000","last_undegraded":"2024-09-14T12:01:10.670577+0000","last_fullsized":"2024-09-14T12:01:10.670577+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:38.121049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":18,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'130","reported_seq":444,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.533642+0000","last_change":"2024-09-14T11:02:34.879730+0000","last_active":"2024-09-14T11:58:55.533642+0000","last_peered":"2024-09-14T11:58:55.533642+0000","last_clean":"2024-09-14T11:58:55.533642+0000","last_became_active":"2024-09-14T11:02:34.878813+0000","last_became_peered":"2024-09-14T11:02:34.878813+0000","last_unstale":"2024-09-14T11:58:55.533642+0000","last_undegraded":"2024-09-14T11:58:55.533642+0000","last_fullsized":"2024-09-14T11:58:55.533642+0000","mapping_epoch":252,"log_start":"260'100","ondisk_log_start":"260'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:00.256155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1195,"num_read_kb":1160,"num_write":263,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.447900+0000","last_change":"2024-09-14T11:25:20.212941+0000","last_active":"2024-09-14T11:57:28.447900+0000","last_peered":"2024-09-14T11:57:28.447900+0000","last_clean":"2024-09-14T11:57:28.447900+0000","last_became_active":"2024-09-14T11:25:20.212665+0000","last_became_peered":"2024-09-14T11:25:20.212665+0000","last_unstale":"2024-09-14T11:57:28.447900+0000","last_undegraded":"2024-09-14T11:57:28.447900+0000","last_fullsized":"2024-09-14T11:57:28.447900+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:31.076495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.605166+0000","last_change":"2024-09-14T11:06:45.992405+0000","last_active":"2024-09-14T11:58:45.605166+0000","last_peered":"2024-09-14T11:58:45.605166+0000","last_clean":"2024-09-14T11:58:45.605166+0000","last_became_active":"2024-09-14T11:06:45.992066+0000","last_became_peered":"2024-09-14T11:06:45.992066+0000","last_unstale":"2024-09-14T11:58:45.605166+0000","last_undegraded":"2024-09-14T11:58:45.605166+0000","last_fullsized":"2024-09-14T11:58:45.605166+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:42.417189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"260'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.305944+0000","last_change":"2024-09-14T11:06:41.912718+0000","last_active":"2024-09-14T11:58:45.305944+0000","last_peered":"2024-09-14T11:58:45.305944+0000","last_clean":"2024-09-14T11:58:45.305944+0000","last_became_active":"2024-09-14T11:06:41.912405+0000","last_became_peered":"2024-09-14T11:06:41.912405+0000","last_unstale":"2024-09-14T11:58:45.305944+0000","last_undegraded":"2024-09-14T11:58:45.305944+0000","last_fullsized":"2024-09-14T11:58:45.305944+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:12.800532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"263'36","reported_seq":158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.307994+0000","last_change":"2024-09-14T11:02:34.873402+0000","last_active":"2024-09-14T11:59:05.307994+0000","last_peered":"2024-09-14T11:59:05.307994+0000","last_clean":"2024-09-14T11:59:05.307994+0000","last_became_active":"2024-09-14T11:02:34.873089+0000","last_became_peered":"2024-09-14T11:02:34.873089+0000","last_unstale":"2024-09-14T11:59:05.307994+0000","last_undegraded":"2024-09-14T11:59:05.307994+0000","last_fullsized":"2024-09-14T11:59:05.307994+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:47.372158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":295,"num_read_kb":200,"num_write":86,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.531790+0000","last_change":"2024-09-14T11:25:20.210966+0000","last_active":"2024-09-14T11:58:40.531790+0000","last_peered":"2024-09-14T11:58:40.531790+0000","last_clean":"2024-09-14T11:58:40.531790+0000","last_became_active":"2024-09-14T11:25:20.210331+0000","last_became_peered":"2024-09-14T11:25:20.210331+0000","last_unstale":"2024-09-14T11:58:40.531790+0000","last_undegraded":"2024-09-14T11:58:40.531790+0000","last_fullsized":"2024-09-14T11:58:40.531790+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:27.694386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.532467+0000","last_change":"2024-09-14T11:06:45.986136+0000","last_active":"2024-09-14T11:58:45.532467+0000","last_peered":"2024-09-14T11:58:45.532467+0000","last_clean":"2024-09-14T11:58:45.532467+0000","last_became_active":"2024-09-14T11:06:45.985792+0000","last_became_peered":"2024-09-14T11:06:45.985792+0000","last_unstale":"2024-09-14T11:58:45.532467+0000","last_undegraded":"2024-09-14T11:58:45.532467+0000","last_fullsized":"2024-09-14T11:58:45.532467+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:18.428977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.532481+0000","last_change":"2024-09-14T11:06:41.914556+0000","last_active":"2024-09-14T11:58:45.532481+0000","last_peered":"2024-09-14T11:58:45.532481+0000","last_clean":"2024-09-14T11:58:45.532481+0000","last_became_active":"2024-09-14T11:06:41.913214+0000","last_became_peered":"2024-09-14T11:06:41.913214+0000","last_unstale":"2024-09-14T11:58:45.532481+0000","last_undegraded":"2024-09-14T11:58:45.532481+0000","last_fullsized":"2024-09-14T11:58:45.532481+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:05.435530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"263'55","reported_seq":209,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.450078+0000","last_change":"2024-09-14T11:02:34.873880+0000","last_active":"2024-09-14T11:58:50.450078+0000","last_peered":"2024-09-14T11:58:50.450078+0000","last_clean":"2024-09-14T11:58:50.450078+0000","last_became_active":"2024-09-14T11:02:34.873554+0000","last_became_peered":"2024-09-14T11:02:34.873554+0000","last_unstale":"2024-09-14T11:58:50.450078+0000","last_undegraded":"2024-09-14T11:58:50.450078+0000","last_fullsized":"2024-09-14T11:58:50.450078+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:52.441238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":297,"num_write":136,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.441967+0000","last_change":"2024-09-14T11:25:20.209266+0000","last_active":"2024-09-14T11:57:50.441967+0000","last_peered":"2024-09-14T11:57:50.441967+0000","last_clean":"2024-09-14T11:57:50.441967+0000","last_became_active":"2024-09-14T11:25:20.208985+0000","last_became_peered":"2024-09-14T11:25:20.208985+0000","last_unstale":"2024-09-14T11:57:50.441967+0000","last_undegraded":"2024-09-14T11:57:50.441967+0000","last_fullsized":"2024-09-14T11:57:50.441967+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:35.791238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"260'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.650067+0000","last_change":"2024-09-14T11:06:45.987976+0000","last_active":"2024-09-14T11:58:50.650067+0000","last_peered":"2024-09-14T11:58:50.650067+0000","last_clean":"2024-09-14T11:58:50.650067+0000","last_became_active":"2024-09-14T11:06:45.987665+0000","last_became_peered":"2024-09-14T11:06:45.987665+0000","last_unstale":"2024-09-14T11:58:50.650067+0000","last_undegraded":"2024-09-14T11:58:50.650067+0000","last_fullsized":"2024-09-14T11:58:50.650067+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:33.778940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5649,"num_write":5,"num_write_kb":5649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"260'8","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.307436+0000","last_change":"2024-09-14T11:06:41.906763+0000","last_active":"2024-09-14T11:59:00.307436+0000","last_peered":"2024-09-14T11:59:00.307436+0000","last_clean":"2024-09-14T11:59:00.307436+0000","last_became_active":"2024-09-14T11:06:41.906528+0000","last_became_peered":"2024-09-14T11:06:41.906528+0000","last_unstale":"2024-09-14T11:59:00.307436+0000","last_undegraded":"2024-09-14T11:59:00.307436+0000","last_fullsized":"2024-09-14T11:59:00.307436+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:50.072640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"263'49","reported_seq":191,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.306450+0000","last_change":"2024-09-14T11:02:34.869488+0000","last_active":"2024-09-14T11:58:50.306450+0000","last_peered":"2024-09-14T11:58:50.306450+0000","last_clean":"2024-09-14T11:58:50.306450+0000","last_became_active":"2024-09-14T11:02:34.869154+0000","last_became_peered":"2024-09-14T11:02:34.869154+0000","last_unstale":"2024-09-14T11:58:50.306450+0000","last_undegraded":"2024-09-14T11:58:50.306450+0000","last_fullsized":"2024-09-14T11:58:50.306450+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:51.708190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":272,"num_write":122,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.641217+0000","last_change":"2024-09-14T11:25:20.209267+0000","last_active":"2024-09-14T11:57:50.641217+0000","last_peered":"2024-09-14T11:57:50.641217+0000","last_clean":"2024-09-14T11:57:50.641217+0000","last_became_active":"2024-09-14T11:25:20.208992+0000","last_became_peered":"2024-09-14T11:25:20.208992+0000","last_unstale":"2024-09-14T11:57:50.641217+0000","last_undegraded":"2024-09-14T11:57:50.641217+0000","last_fullsized":"2024-09-14T11:57:50.641217+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:33.801493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"263'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.845194+0000","last_change":"2024-09-14T11:06:45.985807+0000","last_active":"2024-09-14T12:01:17.845194+0000","last_peered":"2024-09-14T12:01:17.845194+0000","last_clean":"2024-09-14T12:01:17.845194+0000","last_became_active":"2024-09-14T11:06:45.985518+0000","last_became_peered":"2024-09-14T11:06:45.985518+0000","last_unstale":"2024-09-14T12:01:17.845194+0000","last_undegraded":"2024-09-14T12:01:17.845194+0000","last_fullsized":"2024-09-14T12:01:17.845194+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:53.847804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:55.549750+0000","last_change":"2024-09-14T11:06:41.915181+0000","last_active":"2024-09-14T12:00:55.549750+0000","last_peered":"2024-09-14T12:00:55.549750+0000","last_clean":"2024-09-14T12:00:55.549750+0000","last_became_active":"2024-09-14T11:06:41.914346+0000","last_became_peered":"2024-09-14T11:06:41.914346+0000","last_unstale":"2024-09-14T12:00:55.549750+0000","last_undegraded":"2024-09-14T12:00:55.549750+0000","last_fullsized":"2024-09-14T12:00:55.549750+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:17.184490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"263'33","reported_seq":145,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.532990+0000","last_change":"2024-09-14T11:02:34.880356+0000","last_active":"2024-09-14T11:58:50.532990+0000","last_peered":"2024-09-14T11:58:50.532990+0000","last_clean":"2024-09-14T11:58:50.532990+0000","last_became_active":"2024-09-14T11:02:34.880066+0000","last_became_peered":"2024-09-14T11:02:34.880066+0000","last_unstale":"2024-09-14T11:58:50.532990+0000","last_undegraded":"2024-09-14T11:58:50.532990+0000","last_fullsized":"2024-09-14T11:58:50.532990+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:20.037542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":165,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:43.459528+0000","last_change":"2024-09-14T11:25:20.211431+0000","last_active":"2024-09-14T11:58:43.459528+0000","last_peered":"2024-09-14T11:58:43.459528+0000","last_clean":"2024-09-14T11:58:43.459528+0000","last_became_active":"2024-09-14T11:25:20.208291+0000","last_became_peered":"2024-09-14T11:25:20.208291+0000","last_unstale":"2024-09-14T11:58:43.459528+0000","last_undegraded":"2024-09-14T11:58:43.459528+0000","last_fullsized":"2024-09-14T11:58:43.459528+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:10.519199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"260'3","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.306441+0000","last_change":"2024-09-14T11:06:45.988585+0000","last_active":"2024-09-14T11:58:50.306441+0000","last_peered":"2024-09-14T11:58:50.306441+0000","last_clean":"2024-09-14T11:58:50.306441+0000","last_became_active":"2024-09-14T11:06:45.988268+0000","last_became_peered":"2024-09-14T11:06:45.988268+0000","last_unstale":"2024-09-14T11:58:50.306441+0000","last_undegraded":"2024-09-14T11:58:50.306441+0000","last_fullsized":"2024-09-14T11:58:50.306441+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:29.911599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.525697+0000","last_change":"2024-09-14T11:06:41.910335+0000","last_active":"2024-09-14T11:58:48.525697+0000","last_peered":"2024-09-14T11:58:48.525697+0000","last_clean":"2024-09-14T11:58:48.525697+0000","last_became_active":"2024-09-14T11:06:41.909915+0000","last_became_peered":"2024-09-14T11:06:41.909915+0000","last_unstale":"2024-09-14T11:58:48.525697+0000","last_undegraded":"2024-09-14T11:58:48.525697+0000","last_fullsized":"2024-09-14T11:58:48.525697+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:47.834488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"263'21","reported_seq":116,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.532964+0000","last_change":"2024-09-14T11:02:34.878110+0000","last_active":"2024-09-14T11:58:50.532964+0000","last_peered":"2024-09-14T11:58:50.532964+0000","last_clean":"2024-09-14T11:58:50.532964+0000","last_became_active":"2024-09-14T11:02:34.877791+0000","last_became_peered":"2024-09-14T11:02:34.877791+0000","last_unstale":"2024-09-14T11:58:50.532964+0000","last_undegraded":"2024-09-14T11:58:50.532964+0000","last_fullsized":"2024-09-14T11:58:50.532964+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:00.836048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":103,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.531860+0000","last_change":"2024-09-14T11:25:20.208774+0000","last_active":"2024-09-14T11:58:40.531860+0000","last_peered":"2024-09-14T11:58:40.531860+0000","last_clean":"2024-09-14T11:58:40.531860+0000","last_became_active":"2024-09-14T11:25:20.208495+0000","last_became_peered":"2024-09-14T11:25:20.208495+0000","last_unstale":"2024-09-14T11:58:40.531860+0000","last_undegraded":"2024-09-14T11:58:40.531860+0000","last_fullsized":"2024-09-14T11:58:40.531860+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:18.019657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"263'3","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:55.321309+0000","last_change":"2024-09-14T11:06:45.987276+0000","last_active":"2024-09-14T12:00:55.321309+0000","last_peered":"2024-09-14T12:00:55.321309+0000","last_clean":"2024-09-14T12:00:55.321309+0000","last_became_active":"2024-09-14T11:06:45.986990+0000","last_became_peered":"2024-09-14T11:06:45.986990+0000","last_unstale":"2024-09-14T12:00:55.321309+0000","last_undegraded":"2024-09-14T12:00:55.321309+0000","last_fullsized":"2024-09-14T12:00:55.321309+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:48.346557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.408167+0000","last_change":"2024-09-14T11:06:41.915671+0000","last_active":"2024-09-14T11:58:50.408167+0000","last_peered":"2024-09-14T11:58:50.408167+0000","last_clean":"2024-09-14T11:58:50.408167+0000","last_became_active":"2024-09-14T11:06:41.915372+0000","last_became_peered":"2024-09-14T11:06:41.915372+0000","last_unstale":"2024-09-14T11:58:50.408167+0000","last_undegraded":"2024-09-14T11:58:50.408167+0000","last_fullsized":"2024-09-14T11:58:50.408167+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:08.016650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"263'13","reported_seq":96,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.306383+0000","last_change":"2024-09-14T11:02:34.879297+0000","last_active":"2024-09-14T11:58:50.306383+0000","last_peered":"2024-09-14T11:58:50.306383+0000","last_clean":"2024-09-14T11:58:50.306383+0000","last_became_active":"2024-09-14T11:02:34.879002+0000","last_became_peered":"2024-09-14T11:02:34.879002+0000","last_unstale":"2024-09-14T11:58:50.306383+0000","last_undegraded":"2024-09-14T11:58:50.306383+0000","last_fullsized":"2024-09-14T11:58:50.306383+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:18.663446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":56,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'347","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.365123+0000","last_change":"2024-09-14T10:46:44.332154+0000","last_active":"2024-09-14T12:01:19.365123+0000","last_peered":"2024-09-14T12:01:19.365123+0000","last_clean":"2024-09-14T12:01:19.365123+0000","last_became_active":"2024-09-14T10:46:44.331827+0000","last_became_peered":"2024-09-14T10:46:44.331827+0000","last_unstale":"2024-09-14T12:01:19.365123+0000","last_undegraded":"2024-09-14T12:01:19.365123+0000","last_fullsized":"2024-09-14T12:01:19.365123+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:51.461537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":808,"num_read_kb":10519,"num_write":1133,"num_write_kb":31597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"263'506","reported_seq":2200,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.709310+0000","last_change":"2024-09-14T10:46:46.341235+0000","last_active":"2024-09-14T11:59:34.709310+0000","last_peered":"2024-09-14T11:59:34.709310+0000","last_clean":"2024-09-14T11:59:34.709310+0000","last_became_active":"2024-09-14T10:46:46.340949+0000","last_became_peered":"2024-09-14T10:46:46.340949+0000","last_unstale":"2024-09-14T11:59:34.709310+0000","last_undegraded":"2024-09-14T11:59:34.709310+0000","last_fullsized":"2024-09-14T11:59:34.709310+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:28.432778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2834,"num_read_kb":2670,"num_write":604,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"263'320","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.423872+0000","last_change":"2024-09-14T10:46:44.333346+0000","last_active":"2024-09-14T12:01:18.423872+0000","last_peered":"2024-09-14T12:01:18.423872+0000","last_clean":"2024-09-14T12:01:18.423872+0000","last_became_active":"2024-09-14T10:46:44.332997+0000","last_became_peered":"2024-09-14T10:46:44.332997+0000","last_unstale":"2024-09-14T12:01:18.423872+0000","last_undegraded":"2024-09-14T12:01:18.423872+0000","last_fullsized":"2024-09-14T12:01:18.423872+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:12.331728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5540160,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":550,"num_read_kb":4891,"num_write":1023,"num_write_kb":34401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"263'664","reported_seq":2310,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.149223+0000","last_change":"2024-09-14T10:46:46.340953+0000","last_active":"2024-09-14T12:00:51.149223+0000","last_peered":"2024-09-14T12:00:51.149223+0000","last_clean":"2024-09-14T12:00:51.149223+0000","last_became_active":"2024-09-14T10:46:46.340612+0000","last_became_peered":"2024-09-14T10:46:46.340612+0000","last_unstale":"2024-09-14T12:00:51.149223+0000","last_undegraded":"2024-09-14T12:00:51.149223+0000","last_fullsized":"2024-09-14T12:00:51.149223+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":600,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:41.266834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3359,"num_read_kb":3045,"num_write":872,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"263'294","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.427907+0000","last_change":"2024-09-14T10:46:44.320649+0000","last_active":"2024-09-14T12:01:18.427907+0000","last_peered":"2024-09-14T12:01:18.427907+0000","last_clean":"2024-09-14T12:01:18.427907+0000","last_became_active":"2024-09-14T10:46:44.320254+0000","last_became_peered":"2024-09-14T10:46:44.320254+0000","last_unstale":"2024-09-14T12:01:18.427907+0000","last_undegraded":"2024-09-14T12:01:18.427907+0000","last_fullsized":"2024-09-14T12:01:18.427907+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:19.897879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6377850,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":557,"num_read_kb":18043,"num_write":1126,"num_write_kb":30368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"263'455","reported_seq":1884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.679270+0000","last_change":"2024-09-14T10:46:46.338061+0000","last_active":"2024-09-14T11:59:34.679270+0000","last_peered":"2024-09-14T11:59:34.679270+0000","last_clean":"2024-09-14T11:59:34.679270+0000","last_became_active":"2024-09-14T10:46:46.337092+0000","last_became_peered":"2024-09-14T10:46:46.337092+0000","last_unstale":"2024-09-14T11:59:34.679270+0000","last_undegraded":"2024-09-14T11:59:34.679270+0000","last_fullsized":"2024-09-14T11:59:34.679270+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:11.129363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2407,"num_read_kb":2236,"num_write":590,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"263'320","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.403504+0000","last_change":"2024-09-14T10:46:44.322511+0000","last_active":"2024-09-14T12:01:19.403504+0000","last_peered":"2024-09-14T12:01:19.403504+0000","last_clean":"2024-09-14T12:01:19.403504+0000","last_became_active":"2024-09-14T10:46:44.321098+0000","last_became_peered":"2024-09-14T10:46:44.321098+0000","last_unstale":"2024-09-14T12:01:19.403504+0000","last_undegraded":"2024-09-14T12:01:19.403504+0000","last_fullsized":"2024-09-14T12:01:19.403504+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:44.225925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":621,"num_read_kb":93491,"num_write":1039,"num_write_kb":33828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"263'561","reported_seq":2220,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:21.444561+0000","last_change":"2024-09-14T10:46:46.338161+0000","last_active":"2024-09-14T11:58:21.444561+0000","last_peered":"2024-09-14T11:58:21.444561+0000","last_clean":"2024-09-14T11:58:21.444561+0000","last_became_active":"2024-09-14T10:46:46.337883+0000","last_became_peered":"2024-09-14T10:46:46.337883+0000","last_unstale":"2024-09-14T11:58:21.444561+0000","last_undegraded":"2024-09-14T11:58:21.444561+0000","last_fullsized":"2024-09-14T11:58:21.444561+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:51.194169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3147,"num_read_kb":2923,"num_write":727,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"263'377","reported_seq":1056,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.349667+0000","last_change":"2024-09-14T10:46:44.325129+0000","last_active":"2024-09-14T12:01:19.349667+0000","last_peered":"2024-09-14T12:01:19.349667+0000","last_clean":"2024-09-14T12:01:19.349667+0000","last_became_active":"2024-09-14T10:46:44.324768+0000","last_became_peered":"2024-09-14T10:46:44.324768+0000","last_unstale":"2024-09-14T12:01:19.349667+0000","last_undegraded":"2024-09-14T12:01:19.349667+0000","last_fullsized":"2024-09-14T12:01:19.349667+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:07.568042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":706,"num_read_kb":82703,"num_write":1285,"num_write_kb":36007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"263'447","reported_seq":2074,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.606129+0000","last_change":"2024-09-14T10:46:46.342723+0000","last_active":"2024-09-14T11:58:55.606129+0000","last_peered":"2024-09-14T11:58:55.606129+0000","last_clean":"2024-09-14T11:58:55.606129+0000","last_became_active":"2024-09-14T10:46:46.338973+0000","last_became_peered":"2024-09-14T10:46:46.338973+0000","last_unstale":"2024-09-14T11:58:55.606129+0000","last_undegraded":"2024-09-14T11:58:55.606129+0000","last_fullsized":"2024-09-14T11:58:55.606129+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:09.155102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2500,"num_read_kb":2382,"num_write":507,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"263'357","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.378797+0000","last_change":"2024-09-14T10:46:44.320180+0000","last_active":"2024-09-14T12:01:19.378797+0000","last_peered":"2024-09-14T12:01:19.378797+0000","last_clean":"2024-09-14T12:01:19.378797+0000","last_became_active":"2024-09-14T10:46:44.319801+0000","last_became_peered":"2024-09-14T10:46:44.319801+0000","last_unstale":"2024-09-14T12:01:19.378797+0000","last_undegraded":"2024-09-14T12:01:19.378797+0000","last_fullsized":"2024-09-14T12:01:19.378797+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:56.539279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":563,"num_read_kb":13023,"num_write":1154,"num_write_kb":36371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"263'579","reported_seq":2155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:01.624820+0000","last_change":"2024-09-14T10:46:46.351079+0000","last_active":"2024-09-14T11:58:01.624820+0000","last_peered":"2024-09-14T11:58:01.624820+0000","last_clean":"2024-09-14T11:58:01.624820+0000","last_became_active":"2024-09-14T10:46:46.350776+0000","last_became_peered":"2024-09-14T10:46:46.350776+0000","last_unstale":"2024-09-14T11:58:01.624820+0000","last_undegraded":"2024-09-14T11:58:01.624820+0000","last_fullsized":"2024-09-14T11:58:01.624820+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:49.953237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3080,"num_read_kb":2791,"num_write":782,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"263'282","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.370814+0000","last_change":"2024-09-14T10:46:44.328019+0000","last_active":"2024-09-14T12:01:19.370814+0000","last_peered":"2024-09-14T12:01:19.370814+0000","last_clean":"2024-09-14T12:01:19.370814+0000","last_became_active":"2024-09-14T10:46:44.327650+0000","last_became_peered":"2024-09-14T10:46:44.327650+0000","last_unstale":"2024-09-14T12:01:19.370814+0000","last_undegraded":"2024-09-14T12:01:19.370814+0000","last_fullsized":"2024-09-14T12:01:19.370814+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:39.047825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":6055,"num_write":990,"num_write_kb":41392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"263'567","reported_seq":2315,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.213898+0000","last_change":"2024-09-14T10:46:46.341743+0000","last_active":"2024-09-14T11:58:37.213898+0000","last_peered":"2024-09-14T11:58:37.213898+0000","last_clean":"2024-09-14T11:58:37.213898+0000","last_became_active":"2024-09-14T10:46:46.341474+0000","last_became_peered":"2024-09-14T10:46:46.341474+0000","last_unstale":"2024-09-14T11:58:37.213898+0000","last_undegraded":"2024-09-14T11:58:37.213898+0000","last_fullsized":"2024-09-14T11:58:37.213898+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:59.495895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3094,"num_read_kb":2877,"num_write":684,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"263'314","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.457060+0000","last_change":"2024-09-14T10:46:44.335194+0000","last_active":"2024-09-14T12:01:18.457060+0000","last_peered":"2024-09-14T12:01:18.457060+0000","last_clean":"2024-09-14T12:01:18.457060+0000","last_became_active":"2024-09-14T10:46:44.334630+0000","last_became_peered":"2024-09-14T10:46:44.334630+0000","last_unstale":"2024-09-14T12:01:18.457060+0000","last_undegraded":"2024-09-14T12:01:18.457060+0000","last_fullsized":"2024-09-14T12:01:18.457060+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:39.166664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134082,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":598,"num_read_kb":14859,"num_write":1023,"num_write_kb":34853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"263'824","reported_seq":2407,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:43.469536+0000","last_change":"2024-09-14T10:46:46.350955+0000","last_active":"2024-09-14T11:59:43.469536+0000","last_peered":"2024-09-14T11:59:43.469536+0000","last_clean":"2024-09-14T11:59:43.469536+0000","last_became_active":"2024-09-14T10:46:46.350391+0000","last_became_peered":"2024-09-14T10:46:46.350391+0000","last_unstale":"2024-09-14T11:59:43.469536+0000","last_undegraded":"2024-09-14T11:59:43.469536+0000","last_fullsized":"2024-09-14T11:59:43.469536+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:02.579006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3863,"num_read_kb":3486,"num_write":1075,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"263'748","reported_seq":2166,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.350687+0000","last_change":"2024-09-14T10:46:46.336012+0000","last_active":"2024-09-14T11:58:44.350687+0000","last_peered":"2024-09-14T11:58:44.350687+0000","last_clean":"2024-09-14T11:58:44.350687+0000","last_became_active":"2024-09-14T10:46:46.335749+0000","last_became_peered":"2024-09-14T10:46:46.335749+0000","last_unstale":"2024-09-14T11:58:44.350687+0000","last_undegraded":"2024-09-14T11:58:44.350687+0000","last_fullsized":"2024-09-14T11:58:44.350687+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:42.586410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3617,"num_read_kb":3235,"num_write":1004,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"263'306","reported_seq":918,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.361253+0000","last_change":"2024-09-14T10:46:44.317211+0000","last_active":"2024-09-14T12:01:19.361253+0000","last_peered":"2024-09-14T12:01:19.361253+0000","last_clean":"2024-09-14T12:01:19.361253+0000","last_became_active":"2024-09-14T10:46:44.316741+0000","last_became_peered":"2024-09-14T10:46:44.316741+0000","last_unstale":"2024-09-14T12:01:19.361253+0000","last_undegraded":"2024-09-14T12:01:19.361253+0000","last_fullsized":"2024-09-14T12:01:19.361253+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:32.808931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133671,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":507,"num_read_kb":26974,"num_write":959,"num_write_kb":33080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"263'803","reported_seq":2496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.146195+0000","last_change":"2024-09-14T10:46:46.346277+0000","last_active":"2024-09-14T12:00:51.146195+0000","last_peered":"2024-09-14T12:00:51.146195+0000","last_clean":"2024-09-14T12:00:51.146195+0000","last_became_active":"2024-09-14T10:46:46.345709+0000","last_became_peered":"2024-09-14T10:46:46.345709+0000","last_unstale":"2024-09-14T12:00:51.146195+0000","last_undegraded":"2024-09-14T12:00:51.146195+0000","last_fullsized":"2024-09-14T12:00:51.146195+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:39.154901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3947,"num_read_kb":3606,"num_write":1038,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"263'367","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.353004+0000","last_change":"2024-09-14T10:46:44.331941+0000","last_active":"2024-09-14T12:01:19.353004+0000","last_peered":"2024-09-14T12:01:19.353004+0000","last_clean":"2024-09-14T12:01:19.353004+0000","last_became_active":"2024-09-14T10:46:44.331599+0000","last_became_peered":"2024-09-14T10:46:44.331599+0000","last_unstale":"2024-09-14T12:01:19.353004+0000","last_undegraded":"2024-09-14T12:01:19.353004+0000","last_fullsized":"2024-09-14T12:01:19.353004+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:14.551208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":622,"num_read_kb":2368,"num_write":1092,"num_write_kb":34113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"263'397","reported_seq":1959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.154005+0000","last_change":"2024-09-14T10:46:46.351133+0000","last_active":"2024-09-14T11:58:46.154005+0000","last_peered":"2024-09-14T11:58:46.154005+0000","last_clean":"2024-09-14T11:58:46.154005+0000","last_became_active":"2024-09-14T10:46:46.350525+0000","last_became_peered":"2024-09-14T10:46:46.350525+0000","last_unstale":"2024-09-14T11:58:46.154005+0000","last_undegraded":"2024-09-14T11:58:46.154005+0000","last_fullsized":"2024-09-14T11:58:46.154005+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:26.504718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2275,"num_read_kb":2173,"num_write":451,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"263'369","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.366438+0000","last_change":"2024-09-14T10:46:44.340215+0000","last_active":"2024-09-14T12:01:19.366438+0000","last_peered":"2024-09-14T12:01:19.366438+0000","last_clean":"2024-09-14T12:01:19.366438+0000","last_became_active":"2024-09-14T10:46:44.339871+0000","last_became_peered":"2024-09-14T10:46:44.339871+0000","last_unstale":"2024-09-14T12:01:19.366438+0000","last_undegraded":"2024-09-14T12:01:19.366438+0000","last_fullsized":"2024-09-14T12:01:19.366438+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:22.901003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":774,"num_read_kb":19273,"num_write":1249,"num_write_kb":53136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"263'1154","reported_seq":2712,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.102743+0000","last_change":"2024-09-14T10:46:46.349949+0000","last_active":"2024-09-14T11:58:40.102743+0000","last_peered":"2024-09-14T11:58:40.102743+0000","last_clean":"2024-09-14T11:58:40.102743+0000","last_became_active":"2024-09-14T10:46:46.349649+0000","last_became_peered":"2024-09-14T10:46:46.349649+0000","last_unstale":"2024-09-14T11:58:40.102743+0000","last_undegraded":"2024-09-14T11:58:40.102743+0000","last_fullsized":"2024-09-14T11:58:40.102743+0000","mapping_epoch":28,"log_start":"263'1100","ondisk_log_start":"263'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":1100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:46.563986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5238,"num_read_kb":4651,"num_write":1596,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"263'343","reported_seq":1077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.372572+0000","last_change":"2024-09-14T10:46:44.326980+0000","last_active":"2024-09-14T12:01:19.372572+0000","last_peered":"2024-09-14T12:01:19.372572+0000","last_clean":"2024-09-14T12:01:19.372572+0000","last_became_active":"2024-09-14T10:46:44.326645+0000","last_became_peered":"2024-09-14T10:46:44.326645+0000","last_unstale":"2024-09-14T12:01:19.372572+0000","last_undegraded":"2024-09-14T12:01:19.372572+0000","last_fullsized":"2024-09-14T12:01:19.372572+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:15.334289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":923,"num_read_kb":14272,"num_write":1148,"num_write_kb":16465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"263'962","reported_seq":2507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.465626+0000","last_change":"2024-09-14T10:46:46.347683+0000","last_active":"2024-09-14T11:59:18.465626+0000","last_peered":"2024-09-14T11:59:18.465626+0000","last_clean":"2024-09-14T11:59:18.465626+0000","last_became_active":"2024-09-14T10:46:46.347420+0000","last_became_peered":"2024-09-14T10:46:46.347420+0000","last_unstale":"2024-09-14T11:59:18.465626+0000","last_undegraded":"2024-09-14T11:59:18.465626+0000","last_fullsized":"2024-09-14T11:59:18.465626+0000","mapping_epoch":28,"log_start":"263'900","ondisk_log_start":"263'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":900,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:54.686257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5046,"num_read_kb":4563,"num_write":1374,"num_write_kb":542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"263'330","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.456962+0000","last_change":"2024-09-14T10:46:44.319508+0000","last_active":"2024-09-14T12:01:18.456962+0000","last_peered":"2024-09-14T12:01:18.456962+0000","last_clean":"2024-09-14T12:01:18.456962+0000","last_became_active":"2024-09-14T10:46:44.319146+0000","last_became_peered":"2024-09-14T10:46:44.319146+0000","last_unstale":"2024-09-14T12:01:18.456962+0000","last_undegraded":"2024-09-14T12:01:18.456962+0000","last_fullsized":"2024-09-14T12:01:18.456962+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:19.324787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2707,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":547,"num_read_kb":40906,"num_write":1026,"num_write_kb":34714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"263'374","reported_seq":1891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.351510+0000","last_change":"2024-09-14T10:46:46.339990+0000","last_active":"2024-09-14T11:58:44.351510+0000","last_peered":"2024-09-14T11:58:44.351510+0000","last_clean":"2024-09-14T11:58:44.351510+0000","last_became_active":"2024-09-14T10:46:46.339710+0000","last_became_peered":"2024-09-14T10:46:46.339710+0000","last_unstale":"2024-09-14T11:58:44.351510+0000","last_undegraded":"2024-09-14T11:58:44.351510+0000","last_fullsized":"2024-09-14T11:58:44.351510+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:06.635346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2075,"num_read_kb":1993,"num_write":416,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"263'288","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.517903+0000","last_change":"2024-09-14T10:46:44.318270+0000","last_active":"2024-09-14T12:01:18.517903+0000","last_peered":"2024-09-14T12:01:18.517903+0000","last_clean":"2024-09-14T12:01:18.517903+0000","last_became_active":"2024-09-14T10:46:44.317895+0000","last_became_peered":"2024-09-14T10:46:44.317895+0000","last_unstale":"2024-09-14T12:01:18.517903+0000","last_undegraded":"2024-09-14T12:01:18.517903+0000","last_fullsized":"2024-09-14T12:01:18.517903+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:29.484018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6321116,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":905,"num_read_kb":22980,"num_write":973,"num_write_kb":27989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"263'130","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.815076+0000","last_change":"2024-09-14T10:46:54.375921+0000","last_active":"2024-09-14T11:59:34.815076+0000","last_peered":"2024-09-14T11:59:34.815076+0000","last_clean":"2024-09-14T11:59:34.815076+0000","last_became_active":"2024-09-14T10:46:54.374769+0000","last_became_peered":"2024-09-14T10:46:54.374769+0000","last_unstale":"2024-09-14T11:59:34.815076+0000","last_undegraded":"2024-09-14T11:59:34.815076+0000","last_fullsized":"2024-09-14T11:59:34.815076+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:49.159300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":165,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"263'434","reported_seq":1984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.153364+0000","last_change":"2024-09-14T10:46:46.340520+0000","last_active":"2024-09-14T11:58:46.153364+0000","last_peered":"2024-09-14T11:58:46.153364+0000","last_clean":"2024-09-14T11:58:46.153364+0000","last_became_active":"2024-09-14T10:46:46.340169+0000","last_became_peered":"2024-09-14T10:46:46.340169+0000","last_unstale":"2024-09-14T11:58:46.153364+0000","last_undegraded":"2024-09-14T11:58:46.153364+0000","last_fullsized":"2024-09-14T11:58:46.153364+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:30.021599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2291,"num_read_kb":2165,"num_write":484,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"263'355","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.534172+0000","last_change":"2024-09-14T10:47:18.794218+0000","last_active":"2024-09-14T12:01:18.534172+0000","last_peered":"2024-09-14T12:01:18.534172+0000","last_clean":"2024-09-14T12:01:18.534172+0000","last_became_active":"2024-09-14T10:47:18.793917+0000","last_became_peered":"2024-09-14T10:47:18.793917+0000","last_unstale":"2024-09-14T12:01:18.534172+0000","last_undegraded":"2024-09-14T12:01:18.534172+0000","last_fullsized":"2024-09-14T12:01:18.534172+0000","mapping_epoch":39,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:04.969640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17175143,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":690,"num_read_kb":48706,"num_write":1283,"num_write_kb":50304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.519271+0000","last_change":"2024-09-14T10:46:48.357072+0000","last_active":"2024-09-14T11:56:55.519271+0000","last_peered":"2024-09-14T11:56:55.519271+0000","last_clean":"2024-09-14T11:56:55.519271+0000","last_became_active":"2024-09-14T10:46:48.356776+0000","last_became_peered":"2024-09-14T10:46:48.356776+0000","last_unstale":"2024-09-14T11:56:55.519271+0000","last_undegraded":"2024-09-14T11:56:55.519271+0000","last_fullsized":"2024-09-14T11:56:55.519271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:33.998552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"263'353","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.009177+0000","last_change":"2024-09-14T10:46:50.360895+0000","last_active":"2024-09-14T12:01:18.009177+0000","last_peered":"2024-09-14T12:01:18.009177+0000","last_clean":"2024-09-14T12:01:18.009177+0000","last_became_active":"2024-09-14T10:46:50.359481+0000","last_became_peered":"2024-09-14T10:46:50.359481+0000","last_unstale":"2024-09-14T12:01:18.009177+0000","last_undegraded":"2024-09-14T12:01:18.009177+0000","last_fullsized":"2024-09-14T12:01:18.009177+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:57.049513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51669,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":564,"num_read_kb":1178,"num_write":444,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.396876+0000","last_change":"2024-09-14T10:46:52.373231+0000","last_active":"2024-09-14T11:57:00.396876+0000","last_peered":"2024-09-14T11:57:00.396876+0000","last_clean":"2024-09-14T11:57:00.396876+0000","last_became_active":"2024-09-14T10:46:52.372941+0000","last_became_peered":"2024-09-14T10:46:52.372941+0000","last_unstale":"2024-09-14T11:57:00.396876+0000","last_undegraded":"2024-09-14T11:57:00.396876+0000","last_fullsized":"2024-09-14T11:57:00.396876+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:39.029048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"263'153","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:57.663650+0000","last_change":"2024-09-14T10:46:54.387774+0000","last_active":"2024-09-14T11:57:57.663650+0000","last_peered":"2024-09-14T11:57:57.663650+0000","last_clean":"2024-09-14T11:57:57.663650+0000","last_became_active":"2024-09-14T10:46:54.387445+0000","last_became_peered":"2024-09-14T10:46:54.387445+0000","last_unstale":"2024-09-14T11:57:57.663650+0000","last_undegraded":"2024-09-14T11:57:57.663650+0000","last_fullsized":"2024-09-14T11:57:57.663650+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:41.372638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":80,"num_write":348,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"263'551","reported_seq":2271,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.139453+0000","last_change":"2024-09-14T10:46:46.340740+0000","last_active":"2024-09-14T12:00:51.139453+0000","last_peered":"2024-09-14T12:00:51.139453+0000","last_clean":"2024-09-14T12:00:51.139453+0000","last_became_active":"2024-09-14T10:46:46.340242+0000","last_became_peered":"2024-09-14T10:46:46.340242+0000","last_unstale":"2024-09-14T12:00:51.139453+0000","last_undegraded":"2024-09-14T12:00:51.139453+0000","last_fullsized":"2024-09-14T12:00:51.139453+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:58.555963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3138,"num_read_kb":2920,"num_write":702,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"263'309","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.495782+0000","last_change":"2024-09-14T10:46:44.335171+0000","last_active":"2024-09-14T12:01:18.495782+0000","last_peered":"2024-09-14T12:01:18.495782+0000","last_clean":"2024-09-14T12:01:18.495782+0000","last_became_active":"2024-09-14T10:46:44.334757+0000","last_became_peered":"2024-09-14T10:46:44.334757+0000","last_unstale":"2024-09-14T12:01:18.495782+0000","last_undegraded":"2024-09-14T12:01:18.495782+0000","last_fullsized":"2024-09-14T12:01:18.495782+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:06.067815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7425373,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":607,"num_read_kb":20083,"num_write":1052,"num_write_kb":20918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:05.634732+0000","last_change":"2024-09-14T10:46:48.352082+0000","last_active":"2024-09-14T11:57:05.634732+0000","last_peered":"2024-09-14T11:57:05.634732+0000","last_clean":"2024-09-14T11:57:05.634732+0000","last_became_active":"2024-09-14T10:46:48.351825+0000","last_became_peered":"2024-09-14T10:46:48.351825+0000","last_unstale":"2024-09-14T11:57:05.634732+0000","last_undegraded":"2024-09-14T11:57:05.634732+0000","last_fullsized":"2024-09-14T11:57:05.634732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:28.324093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"263'101","reported_seq":633,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.413259+0000","last_change":"2024-09-14T10:46:50.360973+0000","last_active":"2024-09-14T11:59:20.413259+0000","last_peered":"2024-09-14T11:59:20.413259+0000","last_clean":"2024-09-14T11:59:20.413259+0000","last_became_active":"2024-09-14T10:46:50.360649+0000","last_became_peered":"2024-09-14T10:46:50.360649+0000","last_unstale":"2024-09-14T11:59:20.413259+0000","last_undegraded":"2024-09-14T11:59:20.413259+0000","last_fullsized":"2024-09-14T11:59:20.413259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:09.131081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.396818+0000","last_change":"2024-09-14T10:46:52.373120+0000","last_active":"2024-09-14T11:57:00.396818+0000","last_peered":"2024-09-14T11:57:00.396818+0000","last_clean":"2024-09-14T11:57:00.396818+0000","last_became_active":"2024-09-14T10:46:52.372770+0000","last_became_peered":"2024-09-14T10:46:52.372770+0000","last_unstale":"2024-09-14T11:57:00.396818+0000","last_undegraded":"2024-09-14T11:57:00.396818+0000","last_fullsized":"2024-09-14T11:57:00.396818+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:37.866381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"263'140","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.088657+0000","last_change":"2024-09-14T10:46:54.389893+0000","last_active":"2024-09-14T11:58:40.088657+0000","last_peered":"2024-09-14T11:58:40.088657+0000","last_clean":"2024-09-14T11:58:40.088657+0000","last_became_active":"2024-09-14T10:46:54.389638+0000","last_became_peered":"2024-09-14T10:46:54.389638+0000","last_unstale":"2024-09-14T11:58:40.088657+0000","last_undegraded":"2024-09-14T11:58:40.088657+0000","last_fullsized":"2024-09-14T11:58:40.088657+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:21.500685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":168,"num_write":356,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"263'449","reported_seq":2187,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.135482+0000","last_change":"2024-09-14T10:46:46.344810+0000","last_active":"2024-09-14T12:00:51.135482+0000","last_peered":"2024-09-14T12:00:51.135482+0000","last_clean":"2024-09-14T12:00:51.135482+0000","last_became_active":"2024-09-14T10:46:46.344509+0000","last_became_peered":"2024-09-14T10:46:46.344509+0000","last_unstale":"2024-09-14T12:00:51.135482+0000","last_undegraded":"2024-09-14T12:00:51.135482+0000","last_fullsized":"2024-09-14T12:00:51.135482+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:33.760349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2693,"num_read_kb":2571,"num_write":507,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"263'330","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.376042+0000","last_change":"2024-09-14T10:46:44.331833+0000","last_active":"2024-09-14T12:01:19.376042+0000","last_peered":"2024-09-14T12:01:19.376042+0000","last_clean":"2024-09-14T12:01:19.376042+0000","last_became_active":"2024-09-14T10:46:44.331464+0000","last_became_peered":"2024-09-14T10:46:44.331464+0000","last_unstale":"2024-09-14T12:01:19.376042+0000","last_undegraded":"2024-09-14T12:01:19.376042+0000","last_fullsized":"2024-09-14T12:01:19.376042+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:29.473170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267319,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":652,"num_read_kb":48168,"num_write":1033,"num_write_kb":26849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.633150+0000","last_change":"2024-09-14T10:46:48.357687+0000","last_active":"2024-09-14T11:56:55.633150+0000","last_peered":"2024-09-14T11:56:55.633150+0000","last_clean":"2024-09-14T11:56:55.633150+0000","last_became_active":"2024-09-14T10:46:48.357301+0000","last_became_peered":"2024-09-14T10:46:48.357301+0000","last_unstale":"2024-09-14T11:56:55.633150+0000","last_undegraded":"2024-09-14T11:56:55.633150+0000","last_fullsized":"2024-09-14T11:56:55.633150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:33.501824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"263'138","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:57.686128+0000","last_change":"2024-09-14T10:46:50.363764+0000","last_active":"2024-09-14T11:57:57.686128+0000","last_peered":"2024-09-14T11:57:57.686128+0000","last_clean":"2024-09-14T11:57:57.686128+0000","last_became_active":"2024-09-14T10:46:50.363495+0000","last_became_peered":"2024-09-14T10:46:50.363495+0000","last_unstale":"2024-09-14T11:57:57.686128+0000","last_undegraded":"2024-09-14T11:57:57.686128+0000","last_fullsized":"2024-09-14T11:57:57.686128+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:49:45.053503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":162,"num_write":114,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"263'792","reported_seq":2727,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.488837+0000","last_change":"2024-09-14T10:46:52.374170+0000","last_active":"2024-09-14T12:01:18.488837+0000","last_peered":"2024-09-14T12:01:18.488837+0000","last_clean":"2024-09-14T12:01:18.488837+0000","last_became_active":"2024-09-14T10:46:52.373886+0000","last_became_peered":"2024-09-14T10:46:52.373886+0000","last_unstale":"2024-09-14T12:01:18.488837+0000","last_undegraded":"2024-09-14T12:01:18.488837+0000","last_fullsized":"2024-09-14T12:01:18.488837+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:54.230847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"263'181","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.721550+0000","last_change":"2024-09-14T10:46:54.388494+0000","last_active":"2024-09-14T11:59:33.721550+0000","last_peered":"2024-09-14T11:59:33.721550+0000","last_clean":"2024-09-14T11:59:33.721550+0000","last_became_active":"2024-09-14T10:46:54.388186+0000","last_became_peered":"2024-09-14T10:46:54.388186+0000","last_unstale":"2024-09-14T11:59:33.721550+0000","last_undegraded":"2024-09-14T11:59:33.721550+0000","last_fullsized":"2024-09-14T11:59:33.721550+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:38.806003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":561,"num_read_kb":561,"num_write":378,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"263'893","reported_seq":2326,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:57.678509+0000","last_change":"2024-09-14T10:46:46.351792+0000","last_active":"2024-09-14T11:57:57.678509+0000","last_peered":"2024-09-14T11:57:57.678509+0000","last_clean":"2024-09-14T11:57:57.678509+0000","last_became_active":"2024-09-14T10:46:46.351453+0000","last_became_peered":"2024-09-14T10:46:46.351453+0000","last_unstale":"2024-09-14T11:57:57.678509+0000","last_undegraded":"2024-09-14T11:57:57.678509+0000","last_fullsized":"2024-09-14T11:57:57.678509+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":800,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:43.929395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4193,"num_read_kb":3693,"num_write":1250,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"263'366","reported_seq":1042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.303300+0000","last_change":"2024-09-14T10:46:44.329000+0000","last_active":"2024-09-14T12:01:19.303300+0000","last_peered":"2024-09-14T12:01:19.303300+0000","last_clean":"2024-09-14T12:01:19.303300+0000","last_became_active":"2024-09-14T10:46:44.328531+0000","last_became_peered":"2024-09-14T10:46:44.328531+0000","last_unstale":"2024-09-14T12:01:19.303300+0000","last_undegraded":"2024-09-14T12:01:19.303300+0000","last_fullsized":"2024-09-14T12:01:19.303300+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:52.656623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":728,"num_read_kb":24160,"num_write":1182,"num_write_kb":50074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.519306+0000","last_change":"2024-09-14T10:46:48.349347+0000","last_active":"2024-09-14T11:56:55.519306+0000","last_peered":"2024-09-14T11:56:55.519306+0000","last_clean":"2024-09-14T11:56:55.519306+0000","last_became_active":"2024-09-14T10:46:48.348899+0000","last_became_peered":"2024-09-14T10:46:48.348899+0000","last_unstale":"2024-09-14T11:56:55.519306+0000","last_undegraded":"2024-09-14T11:56:55.519306+0000","last_fullsized":"2024-09-14T11:56:55.519306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:31.899725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"263'308","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.717489+0000","last_change":"2024-09-14T10:46:50.366037+0000","last_active":"2024-09-14T12:01:17.717489+0000","last_peered":"2024-09-14T12:01:17.717489+0000","last_clean":"2024-09-14T12:01:17.717489+0000","last_became_active":"2024-09-14T10:46:50.365721+0000","last_became_peered":"2024-09-14T10:46:50.365721+0000","last_unstale":"2024-09-14T12:01:17.717489+0000","last_undegraded":"2024-09-14T12:01:17.717489+0000","last_fullsized":"2024-09-14T12:01:17.717489+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:37.431750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47247,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":1144,"num_write":408,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"263'829","reported_seq":2738,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.431796+0000","last_change":"2024-09-14T10:46:52.375010+0000","last_active":"2024-09-14T12:01:17.431796+0000","last_peered":"2024-09-14T12:01:17.431796+0000","last_clean":"2024-09-14T12:01:17.431796+0000","last_became_active":"2024-09-14T10:46:52.374634+0000","last_became_peered":"2024-09-14T10:46:52.374634+0000","last_unstale":"2024-09-14T12:01:17.431796+0000","last_undegraded":"2024-09-14T12:01:17.431796+0000","last_fullsized":"2024-09-14T12:01:17.431796+0000","mapping_epoch":34,"log_start":"263'800","ondisk_log_start":"263'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:57:14.899442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"263'522","reported_seq":2102,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.138196+0000","last_change":"2024-09-14T10:46:46.342236+0000","last_active":"2024-09-14T12:00:51.138196+0000","last_peered":"2024-09-14T12:00:51.138196+0000","last_clean":"2024-09-14T12:00:51.138196+0000","last_became_active":"2024-09-14T10:46:46.341971+0000","last_became_peered":"2024-09-14T10:46:46.341971+0000","last_unstale":"2024-09-14T12:00:51.138196+0000","last_undegraded":"2024-09-14T12:00:51.138196+0000","last_fullsized":"2024-09-14T12:00:51.138196+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:12.438399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2719,"num_read_kb":2513,"num_write":653,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"263'361","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.327021+0000","last_change":"2024-09-14T10:46:44.330242+0000","last_active":"2024-09-14T12:01:19.327021+0000","last_peered":"2024-09-14T12:01:19.327021+0000","last_clean":"2024-09-14T12:01:19.327021+0000","last_became_active":"2024-09-14T10:46:44.329782+0000","last_became_peered":"2024-09-14T10:46:44.329782+0000","last_unstale":"2024-09-14T12:01:19.327021+0000","last_undegraded":"2024-09-14T12:01:19.327021+0000","last_fullsized":"2024-09-14T12:01:19.327021+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:57.094973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":606,"num_read_kb":47823,"num_write":1082,"num_write_kb":48255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.405202+0000","last_change":"2024-09-14T10:46:48.352873+0000","last_active":"2024-09-14T11:58:20.405202+0000","last_peered":"2024-09-14T11:58:20.405202+0000","last_clean":"2024-09-14T11:58:20.405202+0000","last_became_active":"2024-09-14T10:46:48.352584+0000","last_became_peered":"2024-09-14T10:46:48.352584+0000","last_unstale":"2024-09-14T11:58:20.405202+0000","last_undegraded":"2024-09-14T11:58:20.405202+0000","last_fullsized":"2024-09-14T11:58:20.405202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:32.483930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"263'416","reported_seq":1057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.280535+0000","last_change":"2024-09-14T10:46:50.364803+0000","last_active":"2024-09-14T12:01:18.280535+0000","last_peered":"2024-09-14T12:01:18.280535+0000","last_clean":"2024-09-14T12:01:18.280535+0000","last_became_active":"2024-09-14T10:46:50.364438+0000","last_became_peered":"2024-09-14T10:46:50.364438+0000","last_unstale":"2024-09-14T12:01:18.280535+0000","last_undegraded":"2024-09-14T12:01:18.280535+0000","last_fullsized":"2024-09-14T12:01:18.280535+0000","mapping_epoch":32,"log_start":"263'400","ondisk_log_start":"263'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:41.620765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46781,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":687,"num_read_kb":1416,"num_write":538,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.526559+0000","last_change":"2024-09-14T10:46:52.368160+0000","last_active":"2024-09-14T11:58:53.526559+0000","last_peered":"2024-09-14T11:58:53.526559+0000","last_clean":"2024-09-14T11:58:53.526559+0000","last_became_active":"2024-09-14T10:46:52.367874+0000","last_became_peered":"2024-09-14T10:46:52.367874+0000","last_unstale":"2024-09-14T11:58:53.526559+0000","last_undegraded":"2024-09-14T11:58:53.526559+0000","last_fullsized":"2024-09-14T11:58:53.526559+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:15.594681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"263'556","reported_seq":1397,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:52.309850+0000","last_change":"2024-09-14T10:46:54.390213+0000","last_active":"2024-09-14T12:00:52.309850+0000","last_peered":"2024-09-14T12:00:52.309850+0000","last_clean":"2024-09-14T12:00:52.309850+0000","last_became_active":"2024-09-14T10:46:54.389880+0000","last_became_peered":"2024-09-14T10:46:54.389880+0000","last_unstale":"2024-09-14T12:00:52.309850+0000","last_undegraded":"2024-09-14T12:00:52.309850+0000","last_fullsized":"2024-09-14T12:00:52.309850+0000","mapping_epoch":36,"log_start":"263'500","ondisk_log_start":"263'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:56.630763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1361,"num_read_kb":1337,"num_write":1147,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"263'1285","reported_seq":3010,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.405223+0000","last_change":"2024-09-14T10:46:46.343876+0000","last_active":"2024-09-14T11:58:20.405223+0000","last_peered":"2024-09-14T11:58:20.405223+0000","last_clean":"2024-09-14T11:58:20.405223+0000","last_became_active":"2024-09-14T10:46:46.343603+0000","last_became_peered":"2024-09-14T10:46:46.343603+0000","last_unstale":"2024-09-14T11:58:20.405223+0000","last_undegraded":"2024-09-14T11:58:20.405223+0000","last_fullsized":"2024-09-14T11:58:20.405223+0000","mapping_epoch":28,"log_start":"263'1200","ondisk_log_start":"263'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":1200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:55:04.271839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6021,"num_read_kb":5313,"num_write":1785,"num_write_kb":753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"263'327","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.263699+0000","last_change":"2024-09-14T10:46:44.323710+0000","last_active":"2024-09-14T12:01:19.263699+0000","last_peered":"2024-09-14T12:01:19.263699+0000","last_clean":"2024-09-14T12:01:19.263699+0000","last_became_active":"2024-09-14T10:46:44.322816+0000","last_became_peered":"2024-09-14T10:46:44.322816+0000","last_unstale":"2024-09-14T12:01:19.263699+0000","last_undegraded":"2024-09-14T12:01:19.263699+0000","last_fullsized":"2024-09-14T12:01:19.263699+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:37.849009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":492,"num_write":1114,"num_write_kb":29298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:18.521465+0000","last_change":"2024-09-14T10:46:48.352278+0000","last_active":"2024-09-14T11:58:18.521465+0000","last_peered":"2024-09-14T11:58:18.521465+0000","last_clean":"2024-09-14T11:58:18.521465+0000","last_became_active":"2024-09-14T10:46:48.351893+0000","last_became_peered":"2024-09-14T10:46:48.351893+0000","last_unstale":"2024-09-14T11:58:18.521465+0000","last_undegraded":"2024-09-14T11:58:18.521465+0000","last_fullsized":"2024-09-14T11:58:18.521465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:17.258684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"263'265","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.043439+0000","last_change":"2024-09-14T10:46:50.360064+0000","last_active":"2024-09-14T12:01:19.043439+0000","last_peered":"2024-09-14T12:01:19.043439+0000","last_clean":"2024-09-14T12:01:19.043439+0000","last_became_active":"2024-09-14T10:46:50.359434+0000","last_became_peered":"2024-09-14T10:46:50.359434+0000","last_unstale":"2024-09-14T12:01:19.043439+0000","last_undegraded":"2024-09-14T12:01:19.043439+0000","last_fullsized":"2024-09-14T12:01:19.043439+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:38.484631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44011,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":1031,"num_write":356,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.648763+0000","last_change":"2024-09-14T10:46:52.369655+0000","last_active":"2024-09-14T11:58:40.648763+0000","last_peered":"2024-09-14T11:58:40.648763+0000","last_clean":"2024-09-14T11:58:40.648763+0000","last_became_active":"2024-09-14T10:46:52.369353+0000","last_became_peered":"2024-09-14T10:46:52.369353+0000","last_unstale":"2024-09-14T11:58:40.648763+0000","last_undegraded":"2024-09-14T11:58:40.648763+0000","last_fullsized":"2024-09-14T11:58:40.648763+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:30.464066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"263'2541","reported_seq":4365,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:00.417652+0000","last_change":"2024-09-14T10:46:54.383401+0000","last_active":"2024-09-14T12:00:00.417652+0000","last_peered":"2024-09-14T12:00:00.417652+0000","last_clean":"2024-09-14T12:00:00.417652+0000","last_became_active":"2024-09-14T10:46:54.383100+0000","last_became_peered":"2024-09-14T10:46:54.383100+0000","last_unstale":"2024-09-14T12:00:00.417652+0000","last_undegraded":"2024-09-14T12:00:00.417652+0000","last_fullsized":"2024-09-14T12:00:00.417652+0000","mapping_epoch":36,"log_start":"263'2500","ondisk_log_start":"263'2500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":2500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:25.507491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6216,"num_read_kb":6221,"num_write":5164,"num_write_kb":1877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"263'513","reported_seq":2285,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.759401+0000","last_change":"2024-09-14T10:46:46.338242+0000","last_active":"2024-09-14T11:59:29.759401+0000","last_peered":"2024-09-14T11:59:29.759401+0000","last_clean":"2024-09-14T11:59:29.759401+0000","last_became_active":"2024-09-14T10:46:46.337951+0000","last_became_peered":"2024-09-14T10:46:46.337951+0000","last_unstale":"2024-09-14T11:59:29.759401+0000","last_undegraded":"2024-09-14T11:59:29.759401+0000","last_fullsized":"2024-09-14T11:59:29.759401+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":500,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:40.454176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2937,"num_read_kb":2795,"num_write":635,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"263'349","reported_seq":1028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.342519+0000","last_change":"2024-09-14T10:46:44.334345+0000","last_active":"2024-09-14T12:01:19.342519+0000","last_peered":"2024-09-14T12:01:19.342519+0000","last_clean":"2024-09-14T12:01:19.342519+0000","last_became_active":"2024-09-14T10:46:44.331705+0000","last_became_peered":"2024-09-14T10:46:44.331705+0000","last_unstale":"2024-09-14T12:01:19.342519+0000","last_undegraded":"2024-09-14T12:01:19.342519+0000","last_fullsized":"2024-09-14T12:01:19.342519+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:08.805234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":652,"num_read_kb":33315,"num_write":1115,"num_write_kb":35089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.460327+0000","last_change":"2024-09-14T10:46:48.355757+0000","last_active":"2024-09-14T11:58:48.460327+0000","last_peered":"2024-09-14T11:58:48.460327+0000","last_clean":"2024-09-14T11:58:48.460327+0000","last_became_active":"2024-09-14T10:46:48.354092+0000","last_became_peered":"2024-09-14T10:46:48.354092+0000","last_unstale":"2024-09-14T11:58:48.460327+0000","last_undegraded":"2024-09-14T11:58:48.460327+0000","last_fullsized":"2024-09-14T11:58:48.460327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:49.272454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"263'342","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.405360+0000","last_change":"2024-09-14T10:46:50.364160+0000","last_active":"2024-09-14T12:01:18.405360+0000","last_peered":"2024-09-14T12:01:18.405360+0000","last_clean":"2024-09-14T12:01:18.405360+0000","last_became_active":"2024-09-14T10:46:50.363893+0000","last_became_peered":"2024-09-14T10:46:50.363893+0000","last_unstale":"2024-09-14T12:01:18.405360+0000","last_undegraded":"2024-09-14T12:01:18.405360+0000","last_fullsized":"2024-09-14T12:01:18.405360+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:50.322137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44240,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":541,"num_read_kb":1145,"num_write":426,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"263'829","reported_seq":5034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.433012+0000","last_change":"2024-09-14T10:46:52.374414+0000","last_active":"2024-09-14T12:01:17.433012+0000","last_peered":"2024-09-14T12:01:17.433012+0000","last_clean":"2024-09-14T12:01:17.433012+0000","last_became_active":"2024-09-14T10:46:52.374152+0000","last_became_peered":"2024-09-14T10:46:52.374152+0000","last_unstale":"2024-09-14T12:01:17.433012+0000","last_undegraded":"2024-09-14T12:01:17.433012+0000","last_fullsized":"2024-09-14T12:01:17.433012+0000","mapping_epoch":34,"log_start":"263'800","ondisk_log_start":"263'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:31.267699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"263'166","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:50.989484+0000","last_change":"2024-09-14T10:46:54.384757+0000","last_active":"2024-09-14T12:00:50.989484+0000","last_peered":"2024-09-14T12:00:50.989484+0000","last_clean":"2024-09-14T12:00:50.989484+0000","last_became_active":"2024-09-14T10:46:54.383953+0000","last_became_peered":"2024-09-14T10:46:54.383953+0000","last_unstale":"2024-09-14T12:00:50.989484+0000","last_undegraded":"2024-09-14T12:00:50.989484+0000","last_fullsized":"2024-09-14T12:00:50.989484+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:54.206656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":135,"num_write":398,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"263'1056","reported_seq":2528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.757882+0000","last_change":"2024-09-14T10:46:46.348971+0000","last_active":"2024-09-14T11:59:29.757882+0000","last_peered":"2024-09-14T11:59:29.757882+0000","last_clean":"2024-09-14T11:59:29.757882+0000","last_became_active":"2024-09-14T10:46:46.348726+0000","last_became_peered":"2024-09-14T10:46:46.348726+0000","last_unstale":"2024-09-14T11:59:29.757882+0000","last_undegraded":"2024-09-14T11:59:29.757882+0000","last_fullsized":"2024-09-14T11:59:29.757882+0000","mapping_epoch":28,"log_start":"263'1000","ondisk_log_start":"263'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":1000,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:17.855534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4827,"num_read_kb":4287,"num_write":1450,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"263'309","reported_seq":937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.323555+0000","last_change":"2024-09-14T10:46:44.332957+0000","last_active":"2024-09-14T12:01:19.323555+0000","last_peered":"2024-09-14T12:01:19.323555+0000","last_clean":"2024-09-14T12:01:19.323555+0000","last_became_active":"2024-09-14T10:46:44.332535+0000","last_became_peered":"2024-09-14T10:46:44.332535+0000","last_unstale":"2024-09-14T12:01:19.323555+0000","last_undegraded":"2024-09-14T12:01:19.323555+0000","last_fullsized":"2024-09-14T12:01:19.323555+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:28.026211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267347,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":39478,"num_write":1028,"num_write_kb":35728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:28.522894+0000","last_change":"2024-09-14T10:46:48.351883+0000","last_active":"2024-09-14T11:58:28.522894+0000","last_peered":"2024-09-14T11:58:28.522894+0000","last_clean":"2024-09-14T11:58:28.522894+0000","last_became_active":"2024-09-14T10:46:48.351530+0000","last_became_peered":"2024-09-14T10:46:48.351530+0000","last_unstale":"2024-09-14T11:58:28.522894+0000","last_undegraded":"2024-09-14T11:58:28.522894+0000","last_fullsized":"2024-09-14T11:58:28.522894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:09.714239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"263'470","reported_seq":1118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.227822+0000","last_change":"2024-09-14T10:46:50.361756+0000","last_active":"2024-09-14T12:01:19.227822+0000","last_peered":"2024-09-14T12:01:19.227822+0000","last_clean":"2024-09-14T12:01:19.227822+0000","last_became_active":"2024-09-14T10:46:50.361396+0000","last_became_peered":"2024-09-14T10:46:50.361396+0000","last_unstale":"2024-09-14T12:01:19.227822+0000","last_undegraded":"2024-09-14T12:01:19.227822+0000","last_fullsized":"2024-09-14T12:01:19.227822+0000","mapping_epoch":32,"log_start":"263'400","ondisk_log_start":"263'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:24.662180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93223,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":821,"num_read_kb":1952,"num_write":664,"num_write_kb":533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.456158+0000","last_change":"2024-09-14T10:46:52.373915+0000","last_active":"2024-09-14T11:58:23.456158+0000","last_peered":"2024-09-14T11:58:23.456158+0000","last_clean":"2024-09-14T11:58:23.456158+0000","last_became_active":"2024-09-14T10:46:52.373563+0000","last_became_peered":"2024-09-14T10:46:52.373563+0000","last_unstale":"2024-09-14T11:58:23.456158+0000","last_undegraded":"2024-09-14T11:58:23.456158+0000","last_fullsized":"2024-09-14T11:58:23.456158+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:22.900348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"263'160","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:25.446650+0000","last_change":"2024-09-14T10:46:54.389096+0000","last_active":"2024-09-14T11:58:25.446650+0000","last_peered":"2024-09-14T11:58:25.446650+0000","last_clean":"2024-09-14T11:58:25.446650+0000","last_became_active":"2024-09-14T10:46:54.388429+0000","last_became_peered":"2024-09-14T10:46:54.388429+0000","last_unstale":"2024-09-14T11:58:25.446650+0000","last_undegraded":"2024-09-14T11:58:25.446650+0000","last_fullsized":"2024-09-14T11:58:25.446650+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:38.481519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":168,"num_write":381,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"263'889","reported_seq":2640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.496852+0000","last_change":"2024-09-14T10:46:46.344318+0000","last_active":"2024-09-14T11:59:49.496852+0000","last_peered":"2024-09-14T11:59:49.496852+0000","last_clean":"2024-09-14T11:59:49.496852+0000","last_became_active":"2024-09-14T10:46:46.344022+0000","last_became_peered":"2024-09-14T10:46:46.344022+0000","last_unstale":"2024-09-14T11:59:49.496852+0000","last_undegraded":"2024-09-14T11:59:49.496852+0000","last_fullsized":"2024-09-14T11:59:49.496852+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":800,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:44.527085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4406,"num_read_kb":4005,"num_write":1167,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"263'312","reported_seq":980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.371004+0000","last_change":"2024-09-14T10:46:44.318998+0000","last_active":"2024-09-14T12:01:19.371004+0000","last_peered":"2024-09-14T12:01:19.371004+0000","last_clean":"2024-09-14T12:01:19.371004+0000","last_became_active":"2024-09-14T10:46:44.318584+0000","last_became_peered":"2024-09-14T10:46:44.318584+0000","last_unstale":"2024-09-14T12:01:19.371004+0000","last_undegraded":"2024-09-14T12:01:19.371004+0000","last_fullsized":"2024-09-14T12:01:19.371004+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:23.546671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":581,"num_read_kb":7202,"num_write":854,"num_write_kb":20635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.450101+0000","last_change":"2024-09-14T10:46:48.355970+0000","last_active":"2024-09-14T11:58:50.450101+0000","last_peered":"2024-09-14T11:58:50.450101+0000","last_clean":"2024-09-14T11:58:50.450101+0000","last_became_active":"2024-09-14T10:46:48.355691+0000","last_became_peered":"2024-09-14T10:46:48.355691+0000","last_unstale":"2024-09-14T11:58:50.450101+0000","last_undegraded":"2024-09-14T11:58:50.450101+0000","last_fullsized":"2024-09-14T11:58:50.450101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:57.269685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"263'341","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.293202+0000","last_change":"2024-09-14T10:46:50.363028+0000","last_active":"2024-09-14T12:01:19.293202+0000","last_peered":"2024-09-14T12:01:19.293202+0000","last_clean":"2024-09-14T12:01:19.293202+0000","last_became_active":"2024-09-14T10:46:50.362757+0000","last_became_peered":"2024-09-14T10:46:50.362757+0000","last_unstale":"2024-09-14T12:01:19.293202+0000","last_undegraded":"2024-09-14T12:01:19.293202+0000","last_fullsized":"2024-09-14T12:01:19.293202+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:26.991536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":590,"num_read_kb":1339,"num_write":526,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.434234+0000","last_change":"2024-09-14T10:46:52.374126+0000","last_active":"2024-09-14T11:56:55.434234+0000","last_peered":"2024-09-14T11:56:55.434234+0000","last_clean":"2024-09-14T11:56:55.434234+0000","last_became_active":"2024-09-14T10:46:52.373836+0000","last_became_peered":"2024-09-14T10:46:52.373836+0000","last_unstale":"2024-09-14T11:56:55.434234+0000","last_undegraded":"2024-09-14T11:56:55.434234+0000","last_fullsized":"2024-09-14T11:56:55.434234+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:57.883157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"263'94","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:41.091887+0000","last_change":"2024-09-14T10:46:54.387376+0000","last_active":"2024-09-14T12:00:41.091887+0000","last_peered":"2024-09-14T12:00:41.091887+0000","last_clean":"2024-09-14T12:00:41.091887+0000","last_became_active":"2024-09-14T10:46:54.387066+0000","last_became_peered":"2024-09-14T10:46:54.387066+0000","last_unstale":"2024-09-14T12:00:41.091887+0000","last_undegraded":"2024-09-14T12:00:41.091887+0000","last_fullsized":"2024-09-14T12:00:41.091887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:19.903031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":95,"num_write":224,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"263'1164","reported_seq":2674,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.498768+0000","last_change":"2024-09-14T10:46:46.340659+0000","last_active":"2024-09-14T11:59:49.498768+0000","last_peered":"2024-09-14T11:59:49.498768+0000","last_clean":"2024-09-14T11:59:49.498768+0000","last_became_active":"2024-09-14T10:46:46.340228+0000","last_became_peered":"2024-09-14T10:46:46.340228+0000","last_unstale":"2024-09-14T11:59:49.498768+0000","last_undegraded":"2024-09-14T11:59:49.498768+0000","last_fullsized":"2024-09-14T11:59:49.498768+0000","mapping_epoch":28,"log_start":"263'1100","ondisk_log_start":"263'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":1100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:27.760596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5254,"num_read_kb":4633,"num_write":1618,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"263'413","reported_seq":1126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.396142+0000","last_change":"2024-09-14T10:46:44.324787+0000","last_active":"2024-09-14T12:01:19.396142+0000","last_peered":"2024-09-14T12:01:19.396142+0000","last_clean":"2024-09-14T12:01:19.396142+0000","last_became_active":"2024-09-14T10:46:44.324440+0000","last_became_peered":"2024-09-14T10:46:44.324440+0000","last_unstale":"2024-09-14T12:01:19.396142+0000","last_undegraded":"2024-09-14T12:01:19.396142+0000","last_fullsized":"2024-09-14T12:01:19.396142+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:52.318910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":948,"num_read_kb":1994,"num_write":1270,"num_write_kb":27495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.460346+0000","last_change":"2024-09-14T10:46:48.354236+0000","last_active":"2024-09-14T11:58:48.460346+0000","last_peered":"2024-09-14T11:58:48.460346+0000","last_clean":"2024-09-14T11:58:48.460346+0000","last_became_active":"2024-09-14T10:46:48.353513+0000","last_became_peered":"2024-09-14T10:46:48.353513+0000","last_unstale":"2024-09-14T11:58:48.460346+0000","last_undegraded":"2024-09-14T11:58:48.460346+0000","last_fullsized":"2024-09-14T11:58:48.460346+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:10.512984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"263'328","reported_seq":928,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.474147+0000","last_change":"2024-09-14T10:46:50.362779+0000","last_active":"2024-09-14T12:01:17.474147+0000","last_peered":"2024-09-14T12:01:17.474147+0000","last_clean":"2024-09-14T12:01:17.474147+0000","last_became_active":"2024-09-14T10:46:50.362492+0000","last_became_peered":"2024-09-14T10:46:50.362492+0000","last_unstale":"2024-09-14T12:01:17.474147+0000","last_undegraded":"2024-09-14T12:01:17.474147+0000","last_fullsized":"2024-09-14T12:01:17.474147+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:23.999202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56673,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":540,"num_read_kb":1077,"num_write":430,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"263'787","reported_seq":4622,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.428164+0000","last_change":"2024-09-14T10:46:52.375362+0000","last_active":"2024-09-14T12:01:17.428164+0000","last_peered":"2024-09-14T12:01:17.428164+0000","last_clean":"2024-09-14T12:01:17.428164+0000","last_became_active":"2024-09-14T10:46:52.374947+0000","last_became_peered":"2024-09-14T10:46:52.374947+0000","last_unstale":"2024-09-14T12:01:17.428164+0000","last_undegraded":"2024-09-14T12:01:17.428164+0000","last_fullsized":"2024-09-14T12:01:17.428164+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:43.204468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"263'122","reported_seq":650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.113955+0000","last_change":"2024-09-14T10:46:54.382345+0000","last_active":"2024-09-14T11:59:32.113955+0000","last_peered":"2024-09-14T11:59:32.113955+0000","last_clean":"2024-09-14T11:59:32.113955+0000","last_became_active":"2024-09-14T10:46:54.382004+0000","last_became_peered":"2024-09-14T10:46:54.382004+0000","last_unstale":"2024-09-14T11:59:32.113955+0000","last_undegraded":"2024-09-14T11:59:32.113955+0000","last_fullsized":"2024-09-14T11:59:32.113955+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:14.712092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1268,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":189,"num_write":324,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"263'836","reported_seq":2527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.306491+0000","last_change":"2024-09-14T10:46:46.347624+0000","last_active":"2024-09-14T11:58:50.306491+0000","last_peered":"2024-09-14T11:58:50.306491+0000","last_clean":"2024-09-14T11:58:50.306491+0000","last_became_active":"2024-09-14T10:46:46.347307+0000","last_became_peered":"2024-09-14T10:46:46.347307+0000","last_unstale":"2024-09-14T11:58:50.306491+0000","last_undegraded":"2024-09-14T11:58:50.306491+0000","last_fullsized":"2024-09-14T11:58:50.306491+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:17.498211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4222,"num_read_kb":3846,"num_write":1108,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"263'364","reported_seq":1139,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.394169+0000","last_change":"2024-09-14T10:46:44.330921+0000","last_active":"2024-09-14T12:01:19.394169+0000","last_peered":"2024-09-14T12:01:19.394169+0000","last_clean":"2024-09-14T12:01:19.394169+0000","last_became_active":"2024-09-14T10:46:44.330567+0000","last_became_peered":"2024-09-14T10:46:44.330567+0000","last_unstale":"2024-09-14T12:01:19.394169+0000","last_undegraded":"2024-09-14T12:01:19.394169+0000","last_fullsized":"2024-09-14T12:01:19.394169+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:40.240207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":975,"num_read_kb":55651,"num_write":1153,"num_write_kb":35628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1461,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.207601+0000","last_change":"2024-09-14T10:46:48.356084+0000","last_active":"2024-09-14T12:01:17.207601+0000","last_peered":"2024-09-14T12:01:17.207601+0000","last_clean":"2024-09-14T12:01:17.207601+0000","last_became_active":"2024-09-14T10:46:48.355697+0000","last_became_peered":"2024-09-14T10:46:48.355697+0000","last_unstale":"2024-09-14T12:01:17.207601+0000","last_undegraded":"2024-09-14T12:01:17.207601+0000","last_fullsized":"2024-09-14T12:01:17.207601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:15.468545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"263'106","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.526629+0000","last_change":"2024-09-14T10:46:50.369569+0000","last_active":"2024-09-14T11:58:53.526629+0000","last_peered":"2024-09-14T11:58:53.526629+0000","last_clean":"2024-09-14T11:58:53.526629+0000","last_became_active":"2024-09-14T10:46:50.369337+0000","last_became_peered":"2024-09-14T10:46:50.369337+0000","last_unstale":"2024-09-14T11:58:53.526629+0000","last_undegraded":"2024-09-14T11:58:53.526629+0000","last_fullsized":"2024-09-14T11:58:53.526629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:49.461034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"263'803","reported_seq":2611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.186080+0000","last_change":"2024-09-14T10:46:52.374673+0000","last_active":"2024-09-14T12:01:19.186080+0000","last_peered":"2024-09-14T12:01:19.186080+0000","last_clean":"2024-09-14T12:01:19.186080+0000","last_became_active":"2024-09-14T10:46:52.374252+0000","last_became_peered":"2024-09-14T10:46:52.374252+0000","last_unstale":"2024-09-14T12:01:19.186080+0000","last_undegraded":"2024-09-14T12:01:19.186080+0000","last_fullsized":"2024-09-14T12:01:19.186080+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:12.425757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"263'119","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:50.989997+0000","last_change":"2024-09-14T10:46:54.386075+0000","last_active":"2024-09-14T12:00:50.989997+0000","last_peered":"2024-09-14T12:00:50.989997+0000","last_clean":"2024-09-14T12:00:50.989997+0000","last_became_active":"2024-09-14T10:46:54.384249+0000","last_became_peered":"2024-09-14T10:46:54.384249+0000","last_unstale":"2024-09-14T12:00:50.989997+0000","last_undegraded":"2024-09-14T12:00:50.989997+0000","last_fullsized":"2024-09-14T12:00:50.989997+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:21.699653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":125,"num_write":281,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"263'466","reported_seq":1939,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.500118+0000","last_change":"2024-09-14T10:46:46.342756+0000","last_active":"2024-09-14T11:59:49.500118+0000","last_peered":"2024-09-14T11:59:49.500118+0000","last_clean":"2024-09-14T11:59:49.500118+0000","last_became_active":"2024-09-14T10:46:46.342466+0000","last_became_peered":"2024-09-14T10:46:46.342466+0000","last_unstale":"2024-09-14T11:59:49.500118+0000","last_undegraded":"2024-09-14T11:59:49.500118+0000","last_fullsized":"2024-09-14T11:59:49.500118+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:43.804852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2422,"num_read_kb":2241,"num_write":583,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"263'288","reported_seq":915,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.308222+0000","last_change":"2024-09-14T10:46:44.329354+0000","last_active":"2024-09-14T12:01:19.308222+0000","last_peered":"2024-09-14T12:01:19.308222+0000","last_clean":"2024-09-14T12:01:19.308222+0000","last_became_active":"2024-09-14T10:46:44.329014+0000","last_became_peered":"2024-09-14T10:46:44.329014+0000","last_unstale":"2024-09-14T12:01:19.308222+0000","last_undegraded":"2024-09-14T12:01:19.308222+0000","last_fullsized":"2024-09-14T12:01:19.308222+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:32.183184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":506,"num_read_kb":30778,"num_write":881,"num_write_kb":14950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.533075+0000","last_change":"2024-09-14T10:46:48.358952+0000","last_active":"2024-09-14T11:58:50.533075+0000","last_peered":"2024-09-14T11:58:50.533075+0000","last_clean":"2024-09-14T11:58:50.533075+0000","last_became_active":"2024-09-14T10:46:48.358586+0000","last_became_peered":"2024-09-14T10:46:48.358586+0000","last_unstale":"2024-09-14T11:58:50.533075+0000","last_undegraded":"2024-09-14T11:58:50.533075+0000","last_fullsized":"2024-09-14T11:58:50.533075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:11.753221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"263'377","reported_seq":1006,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.075637+0000","last_change":"2024-09-14T10:46:50.367245+0000","last_active":"2024-09-14T12:01:18.075637+0000","last_peered":"2024-09-14T12:01:18.075637+0000","last_clean":"2024-09-14T12:01:18.075637+0000","last_became_active":"2024-09-14T10:46:50.365715+0000","last_became_peered":"2024-09-14T10:46:50.365715+0000","last_unstale":"2024-09-14T12:01:18.075637+0000","last_undegraded":"2024-09-14T12:01:18.075637+0000","last_fullsized":"2024-09-14T12:01:18.075637+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:16.793655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45582,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":610,"num_read_kb":1238,"num_write":470,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.306951+0000","last_change":"2024-09-14T10:46:52.370062+0000","last_active":"2024-09-14T11:58:55.306951+0000","last_peered":"2024-09-14T11:58:55.306951+0000","last_clean":"2024-09-14T11:58:55.306951+0000","last_became_active":"2024-09-14T10:46:52.369746+0000","last_became_peered":"2024-09-14T10:46:52.369746+0000","last_unstale":"2024-09-14T11:58:55.306951+0000","last_undegraded":"2024-09-14T11:58:55.306951+0000","last_fullsized":"2024-09-14T11:58:55.306951+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:38.246502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"263'156","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.673531+0000","last_change":"2024-09-14T10:46:54.384418+0000","last_active":"2024-09-14T11:59:32.673531+0000","last_peered":"2024-09-14T11:59:32.673531+0000","last_clean":"2024-09-14T11:59:32.673531+0000","last_became_active":"2024-09-14T10:46:54.384119+0000","last_became_peered":"2024-09-14T10:46:54.384119+0000","last_unstale":"2024-09-14T11:59:32.673531+0000","last_undegraded":"2024-09-14T11:59:32.673531+0000","last_fullsized":"2024-09-14T11:59:32.673531+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:04.224188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":393,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"263'776","reported_seq":2204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.103437+0000","last_change":"2024-09-14T10:46:46.334782+0000","last_active":"2024-09-14T11:58:05.103437+0000","last_peered":"2024-09-14T11:58:05.103437+0000","last_clean":"2024-09-14T11:58:05.103437+0000","last_became_active":"2024-09-14T10:46:46.334444+0000","last_became_peered":"2024-09-14T10:46:46.334444+0000","last_unstale":"2024-09-14T11:58:05.103437+0000","last_undegraded":"2024-09-14T11:58:05.103437+0000","last_fullsized":"2024-09-14T11:58:05.103437+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:28.537376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3619,"num_read_kb":3234,"num_write":1038,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.407127+0000","last_change":"2024-09-14T10:46:26.241804+0000","last_active":"2024-09-14T11:58:40.407127+0000","last_peered":"2024-09-14T11:58:40.407127+0000","last_clean":"2024-09-14T11:58:40.407127+0000","last_became_active":"2024-09-14T10:46:26.241454+0000","last_became_peered":"2024-09-14T10:46:26.241454+0000","last_unstale":"2024-09-14T11:58:40.407127+0000","last_undegraded":"2024-09-14T11:58:40.407127+0000","last_fullsized":"2024-09-14T11:58:40.407127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:25.229371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:25.229371+0000","last_clean_scrub_stamp":"2024-09-14T10:46:25.229371+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:49.754841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":534,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:25.522947+0000","last_change":"2024-09-14T10:46:35.277926+0000","last_active":"2024-09-14T11:57:25.522947+0000","last_peered":"2024-09-14T11:57:25.522947+0000","last_clean":"2024-09-14T11:57:25.522947+0000","last_became_active":"2024-09-14T10:46:33.413305+0000","last_became_peered":"2024-09-14T10:46:33.413305+0000","last_unstale":"2024-09-14T11:57:25.522947+0000","last_undegraded":"2024-09-14T11:57:25.522947+0000","last_fullsized":"2024-09-14T11:57:25.522947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:13.605387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092058099999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"263'313","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.316155+0000","last_change":"2024-09-14T10:46:44.329784+0000","last_active":"2024-09-14T12:01:19.316155+0000","last_peered":"2024-09-14T12:01:19.316155+0000","last_clean":"2024-09-14T12:01:19.316155+0000","last_became_active":"2024-09-14T10:46:44.329050+0000","last_became_peered":"2024-09-14T10:46:44.329050+0000","last_unstale":"2024-09-14T12:01:19.316155+0000","last_undegraded":"2024-09-14T12:01:19.316155+0000","last_fullsized":"2024-09-14T12:01:19.316155+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:43.544984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":32601,"num_write":1066,"num_write_kb":17351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"38'5","reported_seq":990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.195369+0000","last_change":"2024-09-14T10:46:48.353767+0000","last_active":"2024-09-14T12:01:17.195369+0000","last_peered":"2024-09-14T12:01:17.195369+0000","last_clean":"2024-09-14T12:01:17.195369+0000","last_became_active":"2024-09-14T10:46:48.353319+0000","last_became_peered":"2024-09-14T10:46:48.353319+0000","last_unstale":"2024-09-14T12:01:17.195369+0000","last_undegraded":"2024-09-14T12:01:17.195369+0000","last_fullsized":"2024-09-14T12:01:17.195369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:38.932761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"263'795","reported_seq":1515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.746391+0000","last_change":"2024-09-14T10:46:50.363357+0000","last_active":"2024-09-14T12:01:18.746391+0000","last_peered":"2024-09-14T12:01:18.746391+0000","last_clean":"2024-09-14T12:01:18.746391+0000","last_became_active":"2024-09-14T10:46:50.362908+0000","last_became_peered":"2024-09-14T10:46:50.362908+0000","last_unstale":"2024-09-14T12:01:18.746391+0000","last_undegraded":"2024-09-14T12:01:18.746391+0000","last_fullsized":"2024-09-14T12:01:18.746391+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:43.112130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143024,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1563,"num_read_kb":3671,"num_write":1508,"num_write_kb":1333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.456299+0000","last_change":"2024-09-14T10:46:52.371975+0000","last_active":"2024-09-14T11:58:23.456299+0000","last_peered":"2024-09-14T11:58:23.456299+0000","last_clean":"2024-09-14T11:58:23.456299+0000","last_became_active":"2024-09-14T10:46:52.371684+0000","last_became_peered":"2024-09-14T10:46:52.371684+0000","last_unstale":"2024-09-14T11:58:23.456299+0000","last_undegraded":"2024-09-14T11:58:23.456299+0000","last_fullsized":"2024-09-14T11:58:23.456299+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:40.156605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"263'205","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.737078+0000","last_change":"2024-09-14T10:46:54.382314+0000","last_active":"2024-09-14T11:59:34.737078+0000","last_peered":"2024-09-14T11:59:34.737078+0000","last_clean":"2024-09-14T11:59:34.737078+0000","last_became_active":"2024-09-14T10:46:54.382019+0000","last_became_peered":"2024-09-14T10:46:54.382019+0000","last_unstale":"2024-09-14T11:59:34.737078+0000","last_undegraded":"2024-09-14T11:59:34.737078+0000","last_fullsized":"2024-09-14T11:59:34.737078+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:50.945970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":483,"num_read_kb":466,"num_write":435,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"263'817","reported_seq":2421,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.147601+0000","last_change":"2024-09-14T10:46:46.345582+0000","last_active":"2024-09-14T12:00:51.147601+0000","last_peered":"2024-09-14T12:00:51.147601+0000","last_clean":"2024-09-14T12:00:51.147601+0000","last_became_active":"2024-09-14T10:46:46.345302+0000","last_became_peered":"2024-09-14T10:46:46.345302+0000","last_unstale":"2024-09-14T12:00:51.147601+0000","last_undegraded":"2024-09-14T12:00:51.147601+0000","last_fullsized":"2024-09-14T12:00:51.147601+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:17.727283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3876,"num_read_kb":3495,"num_write":1050,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.531770+0000","last_change":"2024-09-14T10:46:35.277550+0000","last_active":"2024-09-14T11:58:40.531770+0000","last_peered":"2024-09-14T11:58:40.531770+0000","last_clean":"2024-09-14T11:58:40.531770+0000","last_became_active":"2024-09-14T10:46:33.265619+0000","last_became_peered":"2024-09-14T10:46:33.265619+0000","last_unstale":"2024-09-14T11:58:40.531770+0000","last_undegraded":"2024-09-14T11:58:40.531770+0000","last_fullsized":"2024-09-14T11:58:40.531770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:56.062295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058478399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"263'315","reported_seq":1163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.535743+0000","last_change":"2024-09-14T10:46:44.320448+0000","last_active":"2024-09-14T12:01:18.535743+0000","last_peered":"2024-09-14T12:01:18.535743+0000","last_clean":"2024-09-14T12:01:18.535743+0000","last_became_active":"2024-09-14T10:46:44.320087+0000","last_became_peered":"2024-09-14T10:46:44.320087+0000","last_unstale":"2024-09-14T12:01:18.535743+0000","last_undegraded":"2024-09-14T12:01:18.535743+0000","last_fullsized":"2024-09-14T12:01:18.535743+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:18.710537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25054,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":1176,"num_read_kb":9242,"num_write":1094,"num_write_kb":25141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.529481+0000","last_change":"2024-09-14T10:46:48.350940+0000","last_active":"2024-09-14T11:58:20.529481+0000","last_peered":"2024-09-14T11:58:20.529481+0000","last_clean":"2024-09-14T11:58:20.529481+0000","last_became_active":"2024-09-14T10:46:48.350653+0000","last_became_peered":"2024-09-14T10:46:48.350653+0000","last_unstale":"2024-09-14T11:58:20.529481+0000","last_undegraded":"2024-09-14T11:58:20.529481+0000","last_fullsized":"2024-09-14T11:58:20.529481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:11.993887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"263'1395","reported_seq":3236,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.111806+0000","last_change":"2024-09-14T10:46:50.362470+0000","last_active":"2024-09-14T12:01:19.111806+0000","last_peered":"2024-09-14T12:01:19.111806+0000","last_clean":"2024-09-14T12:01:19.111806+0000","last_became_active":"2024-09-14T10:46:50.362128+0000","last_became_peered":"2024-09-14T10:46:50.362128+0000","last_unstale":"2024-09-14T12:01:19.111806+0000","last_undegraded":"2024-09-14T12:01:19.111806+0000","last_fullsized":"2024-09-14T12:01:19.111806+0000","mapping_epoch":32,"log_start":"263'1300","ondisk_log_start":"263'1300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":1300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:16.340703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160652,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2189,"num_read_kb":4301,"num_write":1286,"num_write_kb":1103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.525954+0000","last_change":"2024-09-14T10:46:52.375637+0000","last_active":"2024-09-14T11:57:50.525954+0000","last_peered":"2024-09-14T11:57:50.525954+0000","last_clean":"2024-09-14T11:57:50.525954+0000","last_became_active":"2024-09-14T10:46:52.375344+0000","last_became_peered":"2024-09-14T10:46:52.375344+0000","last_unstale":"2024-09-14T11:57:50.525954+0000","last_undegraded":"2024-09-14T11:57:50.525954+0000","last_fullsized":"2024-09-14T11:57:50.525954+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:28.073066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"263'95","reported_seq":596,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.585158+0000","last_change":"2024-09-14T10:46:54.384671+0000","last_active":"2024-09-14T11:59:33.585158+0000","last_peered":"2024-09-14T11:59:33.585158+0000","last_clean":"2024-09-14T11:59:33.585158+0000","last_became_active":"2024-09-14T10:46:54.384354+0000","last_became_peered":"2024-09-14T10:46:54.384354+0000","last_unstale":"2024-09-14T11:59:33.585158+0000","last_undegraded":"2024-09-14T11:59:33.585158+0000","last_fullsized":"2024-09-14T11:59:33.585158+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:42.323130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":95,"num_write":225,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"263'543","reported_seq":2137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:18.521582+0000","last_change":"2024-09-14T10:46:46.345522+0000","last_active":"2024-09-14T11:58:18.521582+0000","last_peered":"2024-09-14T11:58:18.521582+0000","last_clean":"2024-09-14T11:58:18.521582+0000","last_became_active":"2024-09-14T10:46:46.345234+0000","last_became_peered":"2024-09-14T10:46:46.345234+0000","last_unstale":"2024-09-14T11:58:18.521582+0000","last_undegraded":"2024-09-14T11:58:18.521582+0000","last_fullsized":"2024-09-14T11:58:18.521582+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:05.993847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2916,"num_read_kb":2703,"num_write":726,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:25.438151+0000","last_change":"2024-09-14T10:46:35.332938+0000","last_active":"2024-09-14T11:57:25.438151+0000","last_peered":"2024-09-14T11:57:25.438151+0000","last_clean":"2024-09-14T11:57:25.438151+0000","last_became_active":"2024-09-14T10:46:33.265185+0000","last_became_peered":"2024-09-14T10:46:33.265185+0000","last_unstale":"2024-09-14T11:57:25.438151+0000","last_undegraded":"2024-09-14T11:57:25.438151+0000","last_fullsized":"2024-09-14T11:57:25.438151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:20.170242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000550246,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"263'288","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.376501+0000","last_change":"2024-09-14T10:46:44.327457+0000","last_active":"2024-09-14T12:01:18.376501+0000","last_peered":"2024-09-14T12:01:18.376501+0000","last_clean":"2024-09-14T12:01:18.376501+0000","last_became_active":"2024-09-14T10:46:44.327101+0000","last_became_peered":"2024-09-14T10:46:44.327101+0000","last_unstale":"2024-09-14T12:01:18.376501+0000","last_undegraded":"2024-09-14T12:01:18.376501+0000","last_fullsized":"2024-09-14T12:01:18.376501+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:34.079248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":585,"num_read_kb":99380,"num_write":1012,"num_write_kb":24751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.445762+0000","last_change":"2024-09-14T10:46:48.354125+0000","last_active":"2024-09-14T11:58:20.445762+0000","last_peered":"2024-09-14T11:58:20.445762+0000","last_clean":"2024-09-14T11:58:20.445762+0000","last_became_active":"2024-09-14T10:46:48.353803+0000","last_became_peered":"2024-09-14T10:46:48.353803+0000","last_unstale":"2024-09-14T11:58:20.445762+0000","last_undegraded":"2024-09-14T11:58:20.445762+0000","last_fullsized":"2024-09-14T11:58:20.445762+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:10.885769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"263'303","reported_seq":1752,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:50.881334+0000","last_change":"2024-09-14T10:46:50.365198+0000","last_active":"2024-09-14T12:00:50.881334+0000","last_peered":"2024-09-14T12:00:50.881334+0000","last_clean":"2024-09-14T12:00:50.881334+0000","last_became_active":"2024-09-14T10:46:50.364857+0000","last_became_peered":"2024-09-14T10:46:50.364857+0000","last_unstale":"2024-09-14T12:00:50.881334+0000","last_undegraded":"2024-09-14T12:00:50.881334+0000","last_fullsized":"2024-09-14T12:00:50.881334+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:49.821470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":263,"num_read_kb":255,"num_write":243,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:45.640374+0000","last_change":"2024-09-14T10:46:52.367740+0000","last_active":"2024-09-14T11:57:45.640374+0000","last_peered":"2024-09-14T11:57:45.640374+0000","last_clean":"2024-09-14T11:57:45.640374+0000","last_became_active":"2024-09-14T10:46:52.365738+0000","last_became_peered":"2024-09-14T10:46:52.365738+0000","last_unstale":"2024-09-14T11:57:45.640374+0000","last_undegraded":"2024-09-14T11:57:45.640374+0000","last_fullsized":"2024-09-14T11:57:45.640374+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:55.844741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"263'261","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.991420+0000","last_change":"2024-09-14T10:46:54.379215+0000","last_active":"2024-09-14T11:59:34.991420+0000","last_peered":"2024-09-14T11:59:34.991420+0000","last_clean":"2024-09-14T11:59:34.991420+0000","last_became_active":"2024-09-14T10:46:54.378930+0000","last_became_peered":"2024-09-14T10:46:54.378930+0000","last_unstale":"2024-09-14T11:59:34.991420+0000","last_undegraded":"2024-09-14T11:59:34.991420+0000","last_fullsized":"2024-09-14T11:59:34.991420+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:20.494987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":478,"num_read_kb":502,"num_write":559,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"263'787","reported_seq":2353,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:43.533534+0000","last_change":"2024-09-14T10:46:46.334984+0000","last_active":"2024-09-14T11:59:43.533534+0000","last_peered":"2024-09-14T11:59:43.533534+0000","last_clean":"2024-09-14T11:59:43.533534+0000","last_became_active":"2024-09-14T10:46:46.334679+0000","last_became_peered":"2024-09-14T10:46:46.334679+0000","last_unstale":"2024-09-14T11:59:43.533534+0000","last_undegraded":"2024-09-14T11:59:43.533534+0000","last_fullsized":"2024-09-14T11:59:43.533534+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:52.255486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3681,"num_read_kb":3336,"num_write":1001,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:25.522916+0000","last_change":"2024-09-14T10:46:35.278266+0000","last_active":"2024-09-14T11:57:25.522916+0000","last_peered":"2024-09-14T11:57:25.522916+0000","last_clean":"2024-09-14T11:57:25.522916+0000","last_became_active":"2024-09-14T10:46:33.296172+0000","last_became_peered":"2024-09-14T10:46:33.296172+0000","last_unstale":"2024-09-14T11:57:25.522916+0000","last_undegraded":"2024-09-14T11:57:25.522916+0000","last_fullsized":"2024-09-14T11:57:25.522916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:36.394821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00125464,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"263'339","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.361280+0000","last_change":"2024-09-14T10:46:44.325455+0000","last_active":"2024-09-14T12:01:19.361280+0000","last_peered":"2024-09-14T12:01:19.361280+0000","last_clean":"2024-09-14T12:01:19.361280+0000","last_became_active":"2024-09-14T10:46:44.323974+0000","last_became_peered":"2024-09-14T10:46:44.323974+0000","last_unstale":"2024-09-14T12:01:19.361280+0000","last_undegraded":"2024-09-14T12:01:19.361280+0000","last_fullsized":"2024-09-14T12:01:19.361280+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:51:12.075141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":608,"num_read_kb":7380,"num_write":1200,"num_write_kb":32204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:55.442524+0000","last_change":"2024-09-14T10:46:48.355092+0000","last_active":"2024-09-14T11:57:55.442524+0000","last_peered":"2024-09-14T11:57:55.442524+0000","last_clean":"2024-09-14T11:57:55.442524+0000","last_became_active":"2024-09-14T10:46:48.354786+0000","last_became_peered":"2024-09-14T10:46:48.354786+0000","last_unstale":"2024-09-14T11:57:55.442524+0000","last_undegraded":"2024-09-14T11:57:55.442524+0000","last_fullsized":"2024-09-14T11:57:55.442524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:26.687521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"263'154","reported_seq":714,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:33.477130+0000","last_change":"2024-09-14T10:46:50.363852+0000","last_active":"2024-09-14T12:00:33.477130+0000","last_peered":"2024-09-14T12:00:33.477130+0000","last_clean":"2024-09-14T12:00:33.477130+0000","last_became_active":"2024-09-14T10:46:50.363538+0000","last_became_peered":"2024-09-14T10:46:50.363538+0000","last_unstale":"2024-09-14T12:00:33.477130+0000","last_undegraded":"2024-09-14T12:00:33.477130+0000","last_fullsized":"2024-09-14T12:00:33.477130+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:41.224986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":198,"num_read_kb":192,"num_write":144,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:25.530066+0000","last_change":"2024-09-14T10:46:52.371280+0000","last_active":"2024-09-14T11:58:25.530066+0000","last_peered":"2024-09-14T11:58:25.530066+0000","last_clean":"2024-09-14T11:58:25.530066+0000","last_became_active":"2024-09-14T10:46:52.370968+0000","last_became_peered":"2024-09-14T10:46:52.370968+0000","last_unstale":"2024-09-14T11:58:25.530066+0000","last_undegraded":"2024-09-14T11:58:25.530066+0000","last_fullsized":"2024-09-14T11:58:25.530066+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:12.904159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"263'119","reported_seq":669,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.337447+0000","last_change":"2024-09-14T10:46:54.389298+0000","last_active":"2024-09-14T11:58:44.337447+0000","last_peered":"2024-09-14T11:58:44.337447+0000","last_clean":"2024-09-14T11:58:44.337447+0000","last_became_active":"2024-09-14T10:46:54.388938+0000","last_became_peered":"2024-09-14T10:46:54.388938+0000","last_unstale":"2024-09-14T11:58:44.337447+0000","last_undegraded":"2024-09-14T11:58:44.337447+0000","last_fullsized":"2024-09-14T11:58:44.337447+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:20.842708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":281,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"263'403","reported_seq":1966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.216353+0000","last_change":"2024-09-14T10:46:46.335959+0000","last_active":"2024-09-14T11:58:11.216353+0000","last_peered":"2024-09-14T11:58:11.216353+0000","last_clean":"2024-09-14T11:58:11.216353+0000","last_became_active":"2024-09-14T10:46:46.335681+0000","last_became_peered":"2024-09-14T10:46:46.335681+0000","last_unstale":"2024-09-14T11:58:11.216353+0000","last_undegraded":"2024-09-14T11:58:11.216353+0000","last_fullsized":"2024-09-14T11:58:11.216353+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:24.103452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2240,"num_read_kb":2136,"num_write":448,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"263'321","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.386167+0000","last_change":"2024-09-14T10:46:44.320085+0000","last_active":"2024-09-14T12:01:19.386167+0000","last_peered":"2024-09-14T12:01:19.386167+0000","last_clean":"2024-09-14T12:01:19.386167+0000","last_became_active":"2024-09-14T10:46:44.319714+0000","last_became_peered":"2024-09-14T10:46:44.319714+0000","last_unstale":"2024-09-14T12:01:19.386167+0000","last_undegraded":"2024-09-14T12:01:19.386167+0000","last_fullsized":"2024-09-14T12:01:19.386167+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:11.937757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":599,"num_read_kb":77773,"num_write":1050,"num_write_kb":36142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:23.447048+0000","last_change":"2024-09-14T10:46:35.333110+0000","last_active":"2024-09-14T11:57:23.447048+0000","last_peered":"2024-09-14T11:57:23.447048+0000","last_clean":"2024-09-14T11:57:23.447048+0000","last_became_active":"2024-09-14T10:46:33.296049+0000","last_became_peered":"2024-09-14T10:46:33.296049+0000","last_unstale":"2024-09-14T11:57:23.447048+0000","last_undegraded":"2024-09-14T11:57:23.447048+0000","last_fullsized":"2024-09-14T11:57:23.447048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:58.526433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000560203,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:40.639756+0000","last_change":"2024-09-14T10:46:48.350451+0000","last_active":"2024-09-14T11:57:40.639756+0000","last_peered":"2024-09-14T11:57:40.639756+0000","last_clean":"2024-09-14T11:57:40.639756+0000","last_became_active":"2024-09-14T10:46:48.350088+0000","last_became_peered":"2024-09-14T10:46:48.350088+0000","last_unstale":"2024-09-14T11:57:40.639756+0000","last_undegraded":"2024-09-14T11:57:40.639756+0000","last_fullsized":"2024-09-14T11:57:40.639756+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:29.591738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"263'635","reported_seq":1320,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.802571+0000","last_change":"2024-09-14T10:46:50.363683+0000","last_active":"2024-09-14T12:01:18.802571+0000","last_peered":"2024-09-14T12:01:18.802571+0000","last_clean":"2024-09-14T12:01:18.802571+0000","last_became_active":"2024-09-14T10:46:50.363387+0000","last_became_peered":"2024-09-14T10:46:50.363387+0000","last_unstale":"2024-09-14T12:01:18.802571+0000","last_undegraded":"2024-09-14T12:01:18.802571+0000","last_fullsized":"2024-09-14T12:01:18.802571+0000","mapping_epoch":32,"log_start":"263'600","ondisk_log_start":"263'600","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":600,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:52:29.856170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95765,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1702,"num_read_kb":2954,"num_write":2224,"num_write_kb":2032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:45.299536+0000","last_change":"2024-09-14T10:46:52.374167+0000","last_active":"2024-09-14T11:57:45.299536+0000","last_peered":"2024-09-14T11:57:45.299536+0000","last_clean":"2024-09-14T11:57:45.299536+0000","last_became_active":"2024-09-14T10:46:52.373837+0000","last_became_peered":"2024-09-14T10:46:52.373837+0000","last_unstale":"2024-09-14T11:57:45.299536+0000","last_undegraded":"2024-09-14T11:57:45.299536+0000","last_fullsized":"2024-09-14T11:57:45.299536+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:56.691785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"263'152","reported_seq":660,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.008979+0000","last_change":"2024-09-14T10:46:54.386107+0000","last_active":"2024-09-14T11:59:31.008979+0000","last_peered":"2024-09-14T11:59:31.008979+0000","last_clean":"2024-09-14T11:59:31.008979+0000","last_became_active":"2024-09-14T10:46:54.385835+0000","last_became_peered":"2024-09-14T10:46:54.385835+0000","last_unstale":"2024-09-14T11:59:31.008979+0000","last_undegraded":"2024-09-14T11:59:31.008979+0000","last_fullsized":"2024-09-14T11:59:31.008979+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:18.649909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":168,"num_read_kb":158,"num_write":389,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"263'835","reported_seq":2478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.599452+0000","last_change":"2024-09-14T10:46:46.346336+0000","last_active":"2024-09-14T11:59:33.599452+0000","last_peered":"2024-09-14T11:59:33.599452+0000","last_clean":"2024-09-14T11:59:33.599452+0000","last_became_active":"2024-09-14T10:46:46.346072+0000","last_became_peered":"2024-09-14T10:46:46.346072+0000","last_unstale":"2024-09-14T11:59:33.599452+0000","last_undegraded":"2024-09-14T11:59:33.599452+0000","last_fullsized":"2024-09-14T11:59:33.599452+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:26.721967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4027,"num_read_kb":3636,"num_write":1084,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"263'345","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.530435+0000","last_change":"2024-09-14T10:46:44.318544+0000","last_active":"2024-09-14T12:01:18.530435+0000","last_peered":"2024-09-14T12:01:18.530435+0000","last_clean":"2024-09-14T12:01:18.530435+0000","last_became_active":"2024-09-14T10:46:44.317702+0000","last_became_peered":"2024-09-14T10:46:44.317702+0000","last_unstale":"2024-09-14T12:01:18.530435+0000","last_undegraded":"2024-09-14T12:01:18.530435+0000","last_fullsized":"2024-09-14T12:01:18.530435+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:51.997687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11715436,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":620,"num_read_kb":57005,"num_write":1141,"num_write_kb":30753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:30.523578+0000","last_change":"2024-09-14T10:46:35.277870+0000","last_active":"2024-09-14T11:57:30.523578+0000","last_peered":"2024-09-14T11:57:30.523578+0000","last_clean":"2024-09-14T11:57:30.523578+0000","last_became_active":"2024-09-14T10:46:33.265512+0000","last_became_peered":"2024-09-14T10:46:33.265512+0000","last_unstale":"2024-09-14T11:57:30.523578+0000","last_undegraded":"2024-09-14T11:57:30.523578+0000","last_fullsized":"2024-09-14T11:57:30.523578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:38.583783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088449000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:40.598081+0000","last_change":"2024-09-14T10:46:48.353705+0000","last_active":"2024-09-14T11:57:40.598081+0000","last_peered":"2024-09-14T11:57:40.598081+0000","last_clean":"2024-09-14T11:57:40.598081+0000","last_became_active":"2024-09-14T10:46:48.353394+0000","last_became_peered":"2024-09-14T10:46:48.353394+0000","last_unstale":"2024-09-14T11:57:40.598081+0000","last_undegraded":"2024-09-14T11:57:40.598081+0000","last_fullsized":"2024-09-14T11:57:40.598081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:16.155422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"263'261","reported_seq":847,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.134914+0000","last_change":"2024-09-14T10:46:50.363699+0000","last_active":"2024-09-14T11:59:33.134914+0000","last_peered":"2024-09-14T11:59:33.134914+0000","last_clean":"2024-09-14T11:59:33.134914+0000","last_became_active":"2024-09-14T10:46:50.363436+0000","last_became_peered":"2024-09-14T10:46:50.363436+0000","last_unstale":"2024-09-14T11:59:33.134914+0000","last_undegraded":"2024-09-14T11:59:33.134914+0000","last_fullsized":"2024-09-14T11:59:33.134914+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:29.116427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":321,"num_read_kb":313,"num_write":296,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"263'803","reported_seq":2970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.187710+0000","last_change":"2024-09-14T10:46:52.373730+0000","last_active":"2024-09-14T12:01:19.187710+0000","last_peered":"2024-09-14T12:01:19.187710+0000","last_clean":"2024-09-14T12:01:19.187710+0000","last_became_active":"2024-09-14T10:46:52.373068+0000","last_became_peered":"2024-09-14T10:46:52.373068+0000","last_unstale":"2024-09-14T12:01:19.187710+0000","last_undegraded":"2024-09-14T12:01:19.187710+0000","last_fullsized":"2024-09-14T12:01:19.187710+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:46.138887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"263'136","reported_seq":633,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.453254+0000","last_change":"2024-09-14T10:46:54.388712+0000","last_active":"2024-09-14T11:59:10.453254+0000","last_peered":"2024-09-14T11:59:10.453254+0000","last_clean":"2024-09-14T11:59:10.453254+0000","last_became_active":"2024-09-14T10:46:54.387317+0000","last_became_peered":"2024-09-14T10:46:54.387317+0000","last_unstale":"2024-09-14T11:59:10.453254+0000","last_undegraded":"2024-09-14T11:59:10.453254+0000","last_fullsized":"2024-09-14T11:59:10.453254+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:03.151982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":117,"num_write":309,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"263'1367","reported_seq":3055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.167851+0000","last_change":"2024-09-14T10:46:46.345068+0000","last_active":"2024-09-14T12:00:51.167851+0000","last_peered":"2024-09-14T12:00:51.167851+0000","last_clean":"2024-09-14T12:00:51.167851+0000","last_became_active":"2024-09-14T10:46:46.344799+0000","last_became_peered":"2024-09-14T10:46:46.344799+0000","last_unstale":"2024-09-14T12:00:51.167851+0000","last_undegraded":"2024-09-14T12:00:51.167851+0000","last_fullsized":"2024-09-14T12:00:51.167851+0000","mapping_epoch":28,"log_start":"263'1300","ondisk_log_start":"263'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":1300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:57.271856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6397,"num_read_kb":5617,"num_write":2035,"num_write_kb":974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"263'403","reported_seq":1211,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.335174+0000","last_change":"2024-09-14T10:46:44.324495+0000","last_active":"2024-09-14T12:01:19.335174+0000","last_peered":"2024-09-14T12:01:19.335174+0000","last_clean":"2024-09-14T12:01:19.335174+0000","last_became_active":"2024-09-14T10:46:44.324158+0000","last_became_peered":"2024-09-14T10:46:44.324158+0000","last_unstale":"2024-09-14T12:01:19.335174+0000","last_undegraded":"2024-09-14T12:01:19.335174+0000","last_fullsized":"2024-09-14T12:01:19.335174+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:06.192395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":514873,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1028,"num_read_kb":45406,"num_write":1187,"num_write_kb":52499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.643287+0000","last_change":"2024-09-14T10:46:35.333032+0000","last_active":"2024-09-14T11:58:05.643287+0000","last_peered":"2024-09-14T11:58:05.643287+0000","last_clean":"2024-09-14T11:58:05.643287+0000","last_became_active":"2024-09-14T10:46:33.262218+0000","last_became_peered":"2024-09-14T10:46:33.262218+0000","last_unstale":"2024-09-14T11:58:05.643287+0000","last_undegraded":"2024-09-14T11:58:05.643287+0000","last_fullsized":"2024-09-14T11:58:05.643287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:37.487991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072314099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:40.524716+0000","last_change":"2024-09-14T10:46:48.350207+0000","last_active":"2024-09-14T11:57:40.524716+0000","last_peered":"2024-09-14T11:57:40.524716+0000","last_clean":"2024-09-14T11:57:40.524716+0000","last_became_active":"2024-09-14T10:46:48.349924+0000","last_became_peered":"2024-09-14T10:46:48.349924+0000","last_unstale":"2024-09-14T11:57:40.524716+0000","last_undegraded":"2024-09-14T11:57:40.524716+0000","last_fullsized":"2024-09-14T11:57:40.524716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:06.223225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"263'131","reported_seq":690,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:40.524748+0000","last_change":"2024-09-14T10:46:50.366912+0000","last_active":"2024-09-14T11:57:40.524748+0000","last_peered":"2024-09-14T11:57:40.524748+0000","last_clean":"2024-09-14T11:57:40.524748+0000","last_became_active":"2024-09-14T10:46:50.366610+0000","last_became_peered":"2024-09-14T10:46:50.366610+0000","last_unstale":"2024-09-14T11:57:40.524748+0000","last_undegraded":"2024-09-14T11:57:40.524748+0000","last_fullsized":"2024-09-14T11:57:40.524748+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:08.232971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"263'830","reported_seq":2794,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.430435+0000","last_change":"2024-09-14T10:46:52.371337+0000","last_active":"2024-09-14T12:01:17.430435+0000","last_peered":"2024-09-14T12:01:17.430435+0000","last_clean":"2024-09-14T12:01:17.430435+0000","last_became_active":"2024-09-14T10:46:52.370514+0000","last_became_peered":"2024-09-14T10:46:52.370514+0000","last_unstale":"2024-09-14T12:01:17.430435+0000","last_undegraded":"2024-09-14T12:01:17.430435+0000","last_fullsized":"2024-09-14T12:01:17.430435+0000","mapping_epoch":34,"log_start":"263'800","ondisk_log_start":"263'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":800,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:45.428130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"263'307","reported_seq":847,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.462075+0000","last_change":"2024-09-14T10:46:54.383183+0000","last_active":"2024-09-14T11:58:58.462075+0000","last_peered":"2024-09-14T11:58:58.462075+0000","last_clean":"2024-09-14T11:58:58.462075+0000","last_became_active":"2024-09-14T10:46:54.382860+0000","last_became_peered":"2024-09-14T10:46:54.382860+0000","last_unstale":"2024-09-14T11:58:58.462075+0000","last_undegraded":"2024-09-14T11:58:58.462075+0000","last_fullsized":"2024-09-14T11:58:58.462075+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:04.052225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":895,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":402,"num_read_kb":382,"num_write":591,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"263'1146","reported_seq":2843,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.351752+0000","last_change":"2024-09-14T10:46:46.338805+0000","last_active":"2024-09-14T11:58:44.351752+0000","last_peered":"2024-09-14T11:58:44.351752+0000","last_clean":"2024-09-14T11:58:44.351752+0000","last_became_active":"2024-09-14T10:46:46.338543+0000","last_became_peered":"2024-09-14T10:46:46.338543+0000","last_unstale":"2024-09-14T11:58:44.351752+0000","last_undegraded":"2024-09-14T11:58:44.351752+0000","last_fullsized":"2024-09-14T11:58:44.351752+0000","mapping_epoch":28,"log_start":"263'1100","ondisk_log_start":"263'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":1100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:11.687416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5511,"num_read_kb":4909,"num_write":1576,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"263'347","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.322796+0000","last_change":"2024-09-14T10:46:44.319103+0000","last_active":"2024-09-14T12:01:19.322796+0000","last_peered":"2024-09-14T12:01:19.322796+0000","last_clean":"2024-09-14T12:01:19.322796+0000","last_became_active":"2024-09-14T10:46:44.318777+0000","last_became_peered":"2024-09-14T10:46:44.318777+0000","last_unstale":"2024-09-14T12:01:19.322796+0000","last_undegraded":"2024-09-14T12:01:19.322796+0000","last_fullsized":"2024-09-14T12:01:19.322796+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:25.866596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":579,"num_read_kb":36295,"num_write":1107,"num_write_kb":33618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.527666+0000","last_change":"2024-09-14T10:46:35.277572+0000","last_active":"2024-09-14T11:58:05.527666+0000","last_peered":"2024-09-14T11:58:05.527666+0000","last_clean":"2024-09-14T11:58:05.527666+0000","last_became_active":"2024-09-14T10:46:33.265515+0000","last_became_peered":"2024-09-14T10:46:33.265515+0000","last_unstale":"2024-09-14T11:58:05.527666+0000","last_undegraded":"2024-09-14T11:58:05.527666+0000","last_fullsized":"2024-09-14T11:58:05.527666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:42.848687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061284299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.652272+0000","last_change":"2024-09-14T10:46:48.356581+0000","last_active":"2024-09-14T11:59:05.652272+0000","last_peered":"2024-09-14T11:59:05.652272+0000","last_clean":"2024-09-14T11:59:05.652272+0000","last_became_active":"2024-09-14T10:46:48.354373+0000","last_became_peered":"2024-09-14T10:46:48.354373+0000","last_unstale":"2024-09-14T11:59:05.652272+0000","last_undegraded":"2024-09-14T11:59:05.652272+0000","last_fullsized":"2024-09-14T11:59:05.652272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:11.993887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"263'723","reported_seq":1465,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.170376+0000","last_change":"2024-09-14T10:46:50.362694+0000","last_active":"2024-09-14T12:01:19.170376+0000","last_peered":"2024-09-14T12:01:19.170376+0000","last_clean":"2024-09-14T12:01:19.170376+0000","last_became_active":"2024-09-14T10:46:50.362397+0000","last_became_peered":"2024-09-14T10:46:50.362397+0000","last_unstale":"2024-09-14T12:01:19.170376+0000","last_undegraded":"2024-09-14T12:01:19.170376+0000","last_fullsized":"2024-09-14T12:01:19.170376+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":700,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:52.299380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1285,"num_read_kb":3031,"num_write":1024,"num_write_kb":812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:45.640338+0000","last_change":"2024-09-14T10:46:52.370429+0000","last_active":"2024-09-14T11:57:45.640338+0000","last_peered":"2024-09-14T11:57:45.640338+0000","last_clean":"2024-09-14T11:57:45.640338+0000","last_became_active":"2024-09-14T10:46:52.370107+0000","last_became_peered":"2024-09-14T10:46:52.370107+0000","last_unstale":"2024-09-14T11:57:45.640338+0000","last_undegraded":"2024-09-14T11:57:45.640338+0000","last_fullsized":"2024-09-14T11:57:45.640338+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:57.197530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"263'131","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.306974+0000","last_change":"2024-09-14T10:46:54.384319+0000","last_active":"2024-09-14T11:58:55.306974+0000","last_peered":"2024-09-14T11:58:55.306974+0000","last_clean":"2024-09-14T11:58:55.306974+0000","last_became_active":"2024-09-14T10:46:54.383813+0000","last_became_peered":"2024-09-14T10:46:54.383813+0000","last_unstale":"2024-09-14T11:58:55.306974+0000","last_undegraded":"2024-09-14T11:58:55.306974+0000","last_fullsized":"2024-09-14T11:58:55.306974+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:08.736115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":350,"num_read_kb":289,"num_write":327,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"263'150","reported_seq":710,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.932339+0000","last_change":"2024-09-14T10:46:54.384092+0000","last_active":"2024-09-14T11:59:34.932339+0000","last_peered":"2024-09-14T11:59:34.932339+0000","last_clean":"2024-09-14T11:59:34.932339+0000","last_became_active":"2024-09-14T10:46:54.383742+0000","last_became_peered":"2024-09-14T10:46:54.383742+0000","last_unstale":"2024-09-14T11:59:34.932339+0000","last_undegraded":"2024-09-14T11:59:34.932339+0000","last_fullsized":"2024-09-14T11:59:34.932339+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:33.936406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":212,"num_read_kb":210,"num_write":346,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"263'702","reported_seq":2554,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.142264+0000","last_change":"2024-09-14T10:46:46.338139+0000","last_active":"2024-09-14T12:00:51.142264+0000","last_peered":"2024-09-14T12:00:51.142264+0000","last_clean":"2024-09-14T12:00:51.142264+0000","last_became_active":"2024-09-14T10:46:46.337818+0000","last_became_peered":"2024-09-14T10:46:46.337818+0000","last_unstale":"2024-09-14T12:00:51.142264+0000","last_undegraded":"2024-09-14T12:00:51.142264+0000","last_fullsized":"2024-09-14T12:00:51.142264+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:18.147970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3744,"num_read_kb":3411,"num_write":893,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"263'332","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.317332+0000","last_change":"2024-09-14T10:46:44.335815+0000","last_active":"2024-09-14T12:01:19.317332+0000","last_peered":"2024-09-14T12:01:19.317332+0000","last_clean":"2024-09-14T12:01:19.317332+0000","last_became_active":"2024-09-14T10:46:44.332607+0000","last_became_peered":"2024-09-14T10:46:44.332607+0000","last_unstale":"2024-09-14T12:01:19.317332+0000","last_undegraded":"2024-09-14T12:01:19.317332+0000","last_fullsized":"2024-09-14T12:01:19.317332+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:51.020568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":554,"num_read_kb":15763,"num_write":1023,"num_write_kb":46520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.508136+0000","last_change":"2024-09-14T10:46:48.353763+0000","last_active":"2024-09-14T11:56:48.508136+0000","last_peered":"2024-09-14T11:56:48.508136+0000","last_clean":"2024-09-14T11:56:48.508136+0000","last_became_active":"2024-09-14T10:46:48.353125+0000","last_became_peered":"2024-09-14T10:46:48.353125+0000","last_unstale":"2024-09-14T11:56:48.508136+0000","last_undegraded":"2024-09-14T11:56:48.508136+0000","last_fullsized":"2024-09-14T11:56:48.508136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:13.807709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"263'335","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.352110+0000","last_change":"2024-09-14T10:46:50.365232+0000","last_active":"2024-09-14T12:01:18.352110+0000","last_peered":"2024-09-14T12:01:18.352110+0000","last_clean":"2024-09-14T12:01:18.352110+0000","last_became_active":"2024-09-14T10:46:50.364874+0000","last_became_peered":"2024-09-14T10:46:50.364874+0000","last_unstale":"2024-09-14T12:01:18.352110+0000","last_undegraded":"2024-09-14T12:01:18.352110+0000","last_fullsized":"2024-09-14T12:01:18.352110+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:43.130794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58887,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":550,"num_read_kb":1323,"num_write":450,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.434090+0000","last_change":"2024-09-14T10:46:52.374279+0000","last_active":"2024-09-14T11:56:55.434090+0000","last_peered":"2024-09-14T11:56:55.434090+0000","last_clean":"2024-09-14T11:56:55.434090+0000","last_became_active":"2024-09-14T10:46:52.373982+0000","last_became_peered":"2024-09-14T10:46:52.373982+0000","last_unstale":"2024-09-14T11:56:55.434090+0000","last_undegraded":"2024-09-14T11:56:55.434090+0000","last_fullsized":"2024-09-14T11:56:55.434090+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:41.838813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"263'117","reported_seq":613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.699014+0000","last_change":"2024-09-14T10:46:54.387894+0000","last_active":"2024-09-14T11:59:34.699014+0000","last_peered":"2024-09-14T11:59:34.699014+0000","last_clean":"2024-09-14T11:59:34.699014+0000","last_became_active":"2024-09-14T10:46:54.387552+0000","last_became_peered":"2024-09-14T10:46:54.387552+0000","last_unstale":"2024-09-14T11:59:34.699014+0000","last_undegraded":"2024-09-14T11:59:34.699014+0000","last_fullsized":"2024-09-14T11:59:34.699014+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:39.903611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":107,"num_write":284,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"263'405","reported_seq":1853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.140847+0000","last_change":"2024-09-14T10:46:46.348830+0000","last_active":"2024-09-14T12:00:51.140847+0000","last_peered":"2024-09-14T12:00:51.140847+0000","last_clean":"2024-09-14T12:00:51.140847+0000","last_became_active":"2024-09-14T10:46:46.348040+0000","last_became_peered":"2024-09-14T10:46:46.348040+0000","last_unstale":"2024-09-14T12:00:51.140847+0000","last_undegraded":"2024-09-14T12:00:51.140847+0000","last_fullsized":"2024-09-14T12:00:51.140847+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:14.154127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2178,"num_read_kb":2045,"num_write":462,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"263'336","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.328310+0000","last_change":"2024-09-14T10:46:44.333549+0000","last_active":"2024-09-14T12:01:19.328310+0000","last_peered":"2024-09-14T12:01:19.328310+0000","last_clean":"2024-09-14T12:01:19.328310+0000","last_became_active":"2024-09-14T10:46:44.333195+0000","last_became_peered":"2024-09-14T10:46:44.333195+0000","last_unstale":"2024-09-14T12:01:19.328310+0000","last_undegraded":"2024-09-14T12:01:19.328310+0000","last_fullsized":"2024-09-14T12:01:19.328310+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:18.381740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":77356,"num_write":1081,"num_write_kb":55140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.632326+0000","last_change":"2024-09-14T10:46:48.357298+0000","last_active":"2024-09-14T11:56:50.632326+0000","last_peered":"2024-09-14T11:56:50.632326+0000","last_clean":"2024-09-14T11:56:50.632326+0000","last_became_active":"2024-09-14T10:46:48.357033+0000","last_became_peered":"2024-09-14T10:46:48.357033+0000","last_unstale":"2024-09-14T11:56:50.632326+0000","last_undegraded":"2024-09-14T11:56:50.632326+0000","last_fullsized":"2024-09-14T11:56:50.632326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:02.877431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"263'63","reported_seq":576,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:37.053655+0000","last_change":"2024-09-14T10:46:50.363154+0000","last_active":"2024-09-14T11:57:37.053655+0000","last_peered":"2024-09-14T11:57:37.053655+0000","last_clean":"2024-09-14T11:57:37.053655+0000","last_became_active":"2024-09-14T10:46:50.362878+0000","last_became_peered":"2024-09-14T10:46:50.362878+0000","last_unstale":"2024-09-14T11:57:37.053655+0000","last_undegraded":"2024-09-14T11:57:37.053655+0000","last_fullsized":"2024-09-14T11:57:37.053655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:48.083949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.294045+0000","last_change":"2024-09-14T10:46:52.366285+0000","last_active":"2024-09-14T11:56:55.294045+0000","last_peered":"2024-09-14T11:56:55.294045+0000","last_clean":"2024-09-14T11:56:55.294045+0000","last_became_active":"2024-09-14T10:46:52.365987+0000","last_became_peered":"2024-09-14T10:46:52.365987+0000","last_unstale":"2024-09-14T11:56:55.294045+0000","last_undegraded":"2024-09-14T11:56:55.294045+0000","last_fullsized":"2024-09-14T11:56:55.294045+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:43.965292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"263'198","reported_seq":733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.608962+0000","last_change":"2024-09-14T10:46:54.383562+0000","last_active":"2024-09-14T11:59:33.608962+0000","last_peered":"2024-09-14T11:59:33.608962+0000","last_clean":"2024-09-14T11:59:33.608962+0000","last_became_active":"2024-09-14T10:46:54.383284+0000","last_became_peered":"2024-09-14T10:46:54.383284+0000","last_unstale":"2024-09-14T11:59:33.608962+0000","last_undegraded":"2024-09-14T11:59:33.608962+0000","last_fullsized":"2024-09-14T11:59:33.608962+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:22.704423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":348,"num_read_kb":326,"num_write":460,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"263'463","reported_seq":2089,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:51.553105+0000","last_change":"2024-09-14T10:46:46.341746+0000","last_active":"2024-09-14T11:57:51.553105+0000","last_peered":"2024-09-14T11:57:51.553105+0000","last_clean":"2024-09-14T11:57:51.553105+0000","last_became_active":"2024-09-14T10:46:46.341424+0000","last_became_peered":"2024-09-14T10:46:46.341424+0000","last_unstale":"2024-09-14T11:57:51.553105+0000","last_undegraded":"2024-09-14T11:57:51.553105+0000","last_fullsized":"2024-09-14T11:57:51.553105+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:09.296793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2571,"num_read_kb":2437,"num_write":538,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"263'326","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.370956+0000","last_change":"2024-09-14T10:46:44.322321+0000","last_active":"2024-09-14T12:01:19.370956+0000","last_peered":"2024-09-14T12:01:19.370956+0000","last_clean":"2024-09-14T12:01:19.370956+0000","last_became_active":"2024-09-14T10:46:44.321694+0000","last_became_peered":"2024-09-14T10:46:44.321694+0000","last_unstale":"2024-09-14T12:01:19.370956+0000","last_undegraded":"2024-09-14T12:01:19.370956+0000","last_fullsized":"2024-09-14T12:01:19.370956+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:00.511024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":535,"num_read_kb":12444,"num_write":977,"num_write_kb":13958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.293366+0000","last_change":"2024-09-14T10:46:48.351062+0000","last_active":"2024-09-14T11:56:50.293366+0000","last_peered":"2024-09-14T11:56:50.293366+0000","last_clean":"2024-09-14T11:56:50.293366+0000","last_became_active":"2024-09-14T10:46:48.350714+0000","last_became_peered":"2024-09-14T10:46:48.350714+0000","last_unstale":"2024-09-14T11:56:50.293366+0000","last_undegraded":"2024-09-14T11:56:50.293366+0000","last_fullsized":"2024-09-14T11:56:50.293366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:34.873720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"263'339","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.661096+0000","last_change":"2024-09-14T10:46:50.361153+0000","last_active":"2024-09-14T12:01:17.661096+0000","last_peered":"2024-09-14T12:01:17.661096+0000","last_clean":"2024-09-14T12:01:17.661096+0000","last_became_active":"2024-09-14T10:46:50.360886+0000","last_became_peered":"2024-09-14T10:46:50.360886+0000","last_unstale":"2024-09-14T12:01:17.661096+0000","last_undegraded":"2024-09-14T12:01:17.661096+0000","last_fullsized":"2024-09-14T12:01:17.661096+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:38.621371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50451,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":558,"num_read_kb":1238,"num_write":442,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.396137+0000","last_change":"2024-09-14T10:46:52.375402+0000","last_active":"2024-09-14T11:56:55.396137+0000","last_peered":"2024-09-14T11:56:55.396137+0000","last_clean":"2024-09-14T11:56:55.396137+0000","last_became_active":"2024-09-14T10:46:52.375120+0000","last_became_peered":"2024-09-14T10:46:52.375120+0000","last_unstale":"2024-09-14T11:56:55.396137+0000","last_undegraded":"2024-09-14T11:56:55.396137+0000","last_fullsized":"2024-09-14T11:56:55.396137+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:11.461786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"263'126","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.661848+0000","last_change":"2024-09-14T10:46:54.384403+0000","last_active":"2024-09-14T11:59:34.661848+0000","last_peered":"2024-09-14T11:59:34.661848+0000","last_clean":"2024-09-14T11:59:34.661848+0000","last_became_active":"2024-09-14T10:46:54.384113+0000","last_became_peered":"2024-09-14T10:46:54.384113+0000","last_unstale":"2024-09-14T11:59:34.661848+0000","last_undegraded":"2024-09-14T11:59:34.661848+0000","last_fullsized":"2024-09-14T11:59:34.661848+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:43.036020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":180,"num_read_kb":170,"num_write":302,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"263'376","reported_seq":2022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.915579+0000","last_change":"2024-09-14T10:46:46.346655+0000","last_active":"2024-09-14T11:58:23.915579+0000","last_peered":"2024-09-14T11:58:23.915579+0000","last_clean":"2024-09-14T11:58:23.915579+0000","last_became_active":"2024-09-14T10:46:46.346318+0000","last_became_peered":"2024-09-14T10:46:46.346318+0000","last_unstale":"2024-09-14T11:58:23.915579+0000","last_undegraded":"2024-09-14T11:58:23.915579+0000","last_fullsized":"2024-09-14T11:58:23.915579+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:49.199619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2319,"num_read_kb":2246,"num_write":412,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"263'384","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.450304+0000","last_change":"2024-09-14T10:46:44.333722+0000","last_active":"2024-09-14T12:01:18.450304+0000","last_peered":"2024-09-14T12:01:18.450304+0000","last_clean":"2024-09-14T12:01:18.450304+0000","last_became_active":"2024-09-14T10:46:44.332841+0000","last_became_peered":"2024-09-14T10:46:44.332841+0000","last_unstale":"2024-09-14T12:01:18.450304+0000","last_undegraded":"2024-09-14T12:01:18.450304+0000","last_fullsized":"2024-09-14T12:01:18.450304+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:52.405113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1590622,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":745,"num_read_kb":6861,"num_write":1406,"num_write_kb":25110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.518421+0000","last_change":"2024-09-14T10:46:48.353284+0000","last_active":"2024-09-14T11:56:50.518421+0000","last_peered":"2024-09-14T11:56:50.518421+0000","last_clean":"2024-09-14T11:56:50.518421+0000","last_became_active":"2024-09-14T10:46:48.353010+0000","last_became_peered":"2024-09-14T10:46:48.353010+0000","last_unstale":"2024-09-14T11:56:50.518421+0000","last_undegraded":"2024-09-14T11:56:50.518421+0000","last_fullsized":"2024-09-14T11:56:50.518421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:08.193075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"263'286","reported_seq":868,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.409390+0000","last_change":"2024-09-14T10:46:50.363596+0000","last_active":"2024-09-14T12:01:19.409390+0000","last_peered":"2024-09-14T12:01:19.409390+0000","last_clean":"2024-09-14T12:01:19.409390+0000","last_became_active":"2024-09-14T10:46:50.362723+0000","last_became_peered":"2024-09-14T10:46:50.362723+0000","last_unstale":"2024-09-14T12:01:19.409390+0000","last_undegraded":"2024-09-14T12:01:19.409390+0000","last_fullsized":"2024-09-14T12:01:19.409390+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:44.962512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44996,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":451,"num_read_kb":1030,"num_write":360,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.434159+0000","last_change":"2024-09-14T10:46:52.369320+0000","last_active":"2024-09-14T11:56:55.434159+0000","last_peered":"2024-09-14T11:56:55.434159+0000","last_clean":"2024-09-14T11:56:55.434159+0000","last_became_active":"2024-09-14T10:46:52.369048+0000","last_became_peered":"2024-09-14T10:46:52.369048+0000","last_unstale":"2024-09-14T11:56:55.434159+0000","last_undegraded":"2024-09-14T11:56:55.434159+0000","last_fullsized":"2024-09-14T11:56:55.434159+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:12.392541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"263'554","reported_seq":2332,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.143488+0000","last_change":"2024-09-14T10:46:46.349057+0000","last_active":"2024-09-14T12:00:51.143488+0000","last_peered":"2024-09-14T12:00:51.143488+0000","last_clean":"2024-09-14T12:00:51.143488+0000","last_became_active":"2024-09-14T10:46:46.348774+0000","last_became_peered":"2024-09-14T10:46:46.348774+0000","last_unstale":"2024-09-14T12:00:51.143488+0000","last_undegraded":"2024-09-14T12:00:51.143488+0000","last_fullsized":"2024-09-14T12:00:51.143488+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:39.288295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3189,"num_read_kb":2980,"num_write":657,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"263'374","reported_seq":1058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.415563+0000","last_change":"2024-09-14T10:46:44.335060+0000","last_active":"2024-09-14T12:01:18.415563+0000","last_peered":"2024-09-14T12:01:18.415563+0000","last_clean":"2024-09-14T12:01:18.415563+0000","last_became_active":"2024-09-14T10:46:44.334693+0000","last_became_peered":"2024-09-14T10:46:44.334693+0000","last_unstale":"2024-09-14T12:01:18.415563+0000","last_undegraded":"2024-09-14T12:01:18.415563+0000","last_fullsized":"2024-09-14T12:01:18.415563+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:35.652094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6947652,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":780,"num_read_kb":35701,"num_write":1225,"num_write_kb":25930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"38'3","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.196063+0000","last_change":"2024-09-14T10:46:48.350741+0000","last_active":"2024-09-14T12:01:17.196063+0000","last_peered":"2024-09-14T12:01:17.196063+0000","last_clean":"2024-09-14T12:01:17.196063+0000","last_became_active":"2024-09-14T10:46:48.350469+0000","last_became_peered":"2024-09-14T10:46:48.350469+0000","last_unstale":"2024-09-14T12:01:17.196063+0000","last_undegraded":"2024-09-14T12:01:17.196063+0000","last_fullsized":"2024-09-14T12:01:17.196063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:50.974578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"263'487","reported_seq":1117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.445763+0000","last_change":"2024-09-14T10:46:50.365772+0000","last_active":"2024-09-14T12:01:17.445763+0000","last_peered":"2024-09-14T12:01:17.445763+0000","last_clean":"2024-09-14T12:01:17.445763+0000","last_became_active":"2024-09-14T10:46:50.365486+0000","last_became_peered":"2024-09-14T10:46:50.365486+0000","last_unstale":"2024-09-14T12:01:17.445763+0000","last_undegraded":"2024-09-14T12:01:17.445763+0000","last_fullsized":"2024-09-14T12:01:17.445763+0000","mapping_epoch":32,"log_start":"263'400","ondisk_log_start":"263'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:08:39.304362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109358,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":865,"num_read_kb":1904,"num_write":748,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.294097+0000","last_change":"2024-09-14T10:46:52.372507+0000","last_active":"2024-09-14T11:56:55.294097+0000","last_peered":"2024-09-14T11:56:55.294097+0000","last_clean":"2024-09-14T11:56:55.294097+0000","last_became_active":"2024-09-14T10:46:52.372151+0000","last_became_peered":"2024-09-14T10:46:52.372151+0000","last_unstale":"2024-09-14T11:56:55.294097+0000","last_undegraded":"2024-09-14T11:56:55.294097+0000","last_fullsized":"2024-09-14T11:56:55.294097+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:35.607612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"263'205","reported_seq":716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.552966+0000","last_change":"2024-09-14T10:46:54.386817+0000","last_active":"2024-09-14T11:59:33.552966+0000","last_peered":"2024-09-14T11:59:33.552966+0000","last_clean":"2024-09-14T11:59:33.552966+0000","last_became_active":"2024-09-14T10:46:54.386525+0000","last_became_peered":"2024-09-14T10:46:54.386525+0000","last_unstale":"2024-09-14T11:59:33.552966+0000","last_undegraded":"2024-09-14T11:59:33.552966+0000","last_fullsized":"2024-09-14T11:59:33.552966+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:41.935098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":260,"num_read_kb":259,"num_write":474,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"263'415","reported_seq":2076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.500823+0000","last_change":"2024-09-14T10:46:46.342078+0000","last_active":"2024-09-14T11:59:49.500823+0000","last_peered":"2024-09-14T11:59:49.500823+0000","last_clean":"2024-09-14T11:59:49.500823+0000","last_became_active":"2024-09-14T10:46:46.341559+0000","last_became_peered":"2024-09-14T10:46:46.341559+0000","last_unstale":"2024-09-14T11:59:49.500823+0000","last_undegraded":"2024-09-14T11:59:49.500823+0000","last_fullsized":"2024-09-14T11:59:49.500823+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:25.649976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2371,"num_read_kb":2275,"num_write":467,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"263'282","reported_seq":929,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.283689+0000","last_change":"2024-09-14T10:46:44.320611+0000","last_active":"2024-09-14T12:01:19.283689+0000","last_peered":"2024-09-14T12:01:19.283689+0000","last_clean":"2024-09-14T12:01:19.283689+0000","last_became_active":"2024-09-14T10:46:44.319896+0000","last_became_peered":"2024-09-14T10:46:44.319896+0000","last_unstale":"2024-09-14T12:01:19.283689+0000","last_undegraded":"2024-09-14T12:01:19.283689+0000","last_fullsized":"2024-09-14T12:01:19.283689+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:43.510538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133682,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":524,"num_read_kb":94668,"num_write":900,"num_write_kb":37785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:40.298927+0000","last_change":"2024-09-14T10:46:48.355503+0000","last_active":"2024-09-14T11:57:40.298927+0000","last_peered":"2024-09-14T11:57:40.298927+0000","last_clean":"2024-09-14T11:57:40.298927+0000","last_became_active":"2024-09-14T10:46:48.355149+0000","last_became_peered":"2024-09-14T10:46:48.355149+0000","last_unstale":"2024-09-14T11:57:40.298927+0000","last_undegraded":"2024-09-14T11:57:40.298927+0000","last_fullsized":"2024-09-14T11:57:40.298927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:39.662714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"263'345","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.538027+0000","last_change":"2024-09-14T10:46:50.367103+0000","last_active":"2024-09-14T12:01:17.538027+0000","last_peered":"2024-09-14T12:01:17.538027+0000","last_clean":"2024-09-14T12:01:17.538027+0000","last_became_active":"2024-09-14T10:46:50.366749+0000","last_became_peered":"2024-09-14T10:46:50.366749+0000","last_unstale":"2024-09-14T12:01:17.538027+0000","last_undegraded":"2024-09-14T12:01:17.538027+0000","last_fullsized":"2024-09-14T12:01:17.538027+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:04.127284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49707,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":587,"num_read_kb":1269,"num_write":486,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.442435+0000","last_change":"2024-09-14T10:46:52.368766+0000","last_active":"2024-09-14T11:56:53.442435+0000","last_peered":"2024-09-14T11:56:53.442435+0000","last_clean":"2024-09-14T11:56:53.442435+0000","last_became_active":"2024-09-14T10:46:52.368508+0000","last_became_peered":"2024-09-14T10:46:52.368508+0000","last_unstale":"2024-09-14T11:56:53.442435+0000","last_undegraded":"2024-09-14T11:56:53.442435+0000","last_fullsized":"2024-09-14T11:56:53.442435+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:15.487064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"263'181","reported_seq":1057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.440714+0000","last_change":"2024-09-14T10:46:54.379236+0000","last_active":"2024-09-14T11:59:30.440714+0000","last_peered":"2024-09-14T11:59:30.440714+0000","last_clean":"2024-09-14T11:59:30.440714+0000","last_became_active":"2024-09-14T10:46:54.378938+0000","last_became_peered":"2024-09-14T10:46:54.378938+0000","last_unstale":"2024-09-14T11:59:30.440714+0000","last_undegraded":"2024-09-14T11:59:30.440714+0000","last_fullsized":"2024-09-14T11:59:30.440714+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:53.097947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2044,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":607,"num_read_kb":603,"num_write":505,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"263'637","reported_seq":2298,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.736746+0000","last_change":"2024-09-14T10:46:46.347640+0000","last_active":"2024-09-14T11:59:29.736746+0000","last_peered":"2024-09-14T11:59:29.736746+0000","last_clean":"2024-09-14T11:59:29.736746+0000","last_became_active":"2024-09-14T10:46:46.347362+0000","last_became_peered":"2024-09-14T10:46:46.347362+0000","last_unstale":"2024-09-14T11:59:29.736746+0000","last_undegraded":"2024-09-14T11:59:29.736746+0000","last_fullsized":"2024-09-14T11:59:29.736746+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":600,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:55.139779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3345,"num_read_kb":3056,"num_write":864,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"263'375","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.290468+0000","last_change":"2024-09-14T10:46:44.318782+0000","last_active":"2024-09-14T12:01:19.290468+0000","last_peered":"2024-09-14T12:01:19.290468+0000","last_clean":"2024-09-14T12:01:19.290468+0000","last_became_active":"2024-09-14T10:46:44.318099+0000","last_became_peered":"2024-09-14T10:46:44.318099+0000","last_unstale":"2024-09-14T12:01:19.290468+0000","last_undegraded":"2024-09-14T12:01:19.290468+0000","last_fullsized":"2024-09-14T12:01:19.290468+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:25.257513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133694,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":681,"num_read_kb":1685,"num_write":1259,"num_write_kb":36237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.293501+0000","last_change":"2024-09-14T10:46:48.350499+0000","last_active":"2024-09-14T11:56:50.293501+0000","last_peered":"2024-09-14T11:56:50.293501+0000","last_clean":"2024-09-14T11:56:50.293501+0000","last_became_active":"2024-09-14T10:46:48.350059+0000","last_became_peered":"2024-09-14T10:46:48.350059+0000","last_unstale":"2024-09-14T11:56:50.293501+0000","last_undegraded":"2024-09-14T11:56:50.293501+0000","last_fullsized":"2024-09-14T11:56:50.293501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:42.038929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"263'308","reported_seq":899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.526982+0000","last_change":"2024-09-14T10:46:50.365706+0000","last_active":"2024-09-14T12:01:18.526982+0000","last_peered":"2024-09-14T12:01:18.526982+0000","last_clean":"2024-09-14T12:01:18.526982+0000","last_became_active":"2024-09-14T10:46:50.365393+0000","last_became_peered":"2024-09-14T10:46:50.365393+0000","last_unstale":"2024-09-14T12:01:18.526982+0000","last_undegraded":"2024-09-14T12:01:18.526982+0000","last_fullsized":"2024-09-14T12:01:18.526982+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:00.491603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59332,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":502,"num_read_kb":1090,"num_write":403,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.453197+0000","last_change":"2024-09-14T10:46:52.373436+0000","last_active":"2024-09-14T11:59:10.453197+0000","last_peered":"2024-09-14T11:59:10.453197+0000","last_clean":"2024-09-14T11:59:10.453197+0000","last_became_active":"2024-09-14T10:46:52.373099+0000","last_became_peered":"2024-09-14T10:46:52.373099+0000","last_unstale":"2024-09-14T11:59:10.453197+0000","last_undegraded":"2024-09-14T11:59:10.453197+0000","last_fullsized":"2024-09-14T11:59:10.453197+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:41.461337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"263'143","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:52.308478+0000","last_change":"2024-09-14T10:46:54.385921+0000","last_active":"2024-09-14T12:00:52.308478+0000","last_peered":"2024-09-14T12:00:52.308478+0000","last_clean":"2024-09-14T12:00:52.308478+0000","last_became_active":"2024-09-14T10:46:54.385625+0000","last_became_peered":"2024-09-14T10:46:54.385625+0000","last_unstale":"2024-09-14T12:00:52.308478+0000","last_undegraded":"2024-09-14T12:00:52.308478+0000","last_fullsized":"2024-09-14T12:00:52.308478+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:00.984531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":790,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":228,"num_read_kb":197,"num_write":338,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"263'416","reported_seq":1957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.727179+0000","last_change":"2024-09-14T10:46:46.339137+0000","last_active":"2024-09-14T11:59:29.727179+0000","last_peered":"2024-09-14T11:59:29.727179+0000","last_clean":"2024-09-14T11:59:29.727179+0000","last_became_active":"2024-09-14T10:46:46.338551+0000","last_became_peered":"2024-09-14T10:46:46.338551+0000","last_unstale":"2024-09-14T11:59:29.727179+0000","last_undegraded":"2024-09-14T11:59:29.727179+0000","last_fullsized":"2024-09-14T11:59:29.727179+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:02.429002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2291,"num_read_kb":2170,"num_write":475,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"263'291","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.376172+0000","last_change":"2024-09-14T10:46:44.331964+0000","last_active":"2024-09-14T12:01:19.376172+0000","last_peered":"2024-09-14T12:01:19.376172+0000","last_clean":"2024-09-14T12:01:19.376172+0000","last_became_active":"2024-09-14T10:46:44.331660+0000","last_became_peered":"2024-09-14T10:46:44.331660+0000","last_unstale":"2024-09-14T12:01:19.376172+0000","last_undegraded":"2024-09-14T12:01:19.376172+0000","last_fullsized":"2024-09-14T12:01:19.376172+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:22.697298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":521,"num_read_kb":29638,"num_write":955,"num_write_kb":30451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.632361+0000","last_change":"2024-09-14T10:46:48.350417+0000","last_active":"2024-09-14T11:56:50.632361+0000","last_peered":"2024-09-14T11:56:50.632361+0000","last_clean":"2024-09-14T11:56:50.632361+0000","last_became_active":"2024-09-14T10:46:48.350072+0000","last_became_peered":"2024-09-14T10:46:48.350072+0000","last_unstale":"2024-09-14T11:56:50.632361+0000","last_undegraded":"2024-09-14T11:56:50.632361+0000","last_fullsized":"2024-09-14T11:56:50.632361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:34.764307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"263'125","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.533624+0000","last_change":"2024-09-14T10:46:50.368321+0000","last_active":"2024-09-14T11:58:55.533624+0000","last_peered":"2024-09-14T11:58:55.533624+0000","last_clean":"2024-09-14T11:58:55.533624+0000","last_became_active":"2024-09-14T10:46:50.367991+0000","last_became_peered":"2024-09-14T10:46:50.367991+0000","last_unstale":"2024-09-14T11:58:55.533624+0000","last_undegraded":"2024-09-14T11:58:55.533624+0000","last_fullsized":"2024-09-14T11:58:55.533624+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:39.918895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":126,"num_write":102,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"263'780","reported_seq":2687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.106488+0000","last_change":"2024-09-14T10:46:52.370832+0000","last_active":"2024-09-14T12:01:19.106488+0000","last_peered":"2024-09-14T12:01:19.106488+0000","last_clean":"2024-09-14T12:01:19.106488+0000","last_became_active":"2024-09-14T10:46:52.370446+0000","last_became_peered":"2024-09-14T10:46:52.370446+0000","last_unstale":"2024-09-14T12:01:19.106488+0000","last_undegraded":"2024-09-14T12:01:19.106488+0000","last_fullsized":"2024-09-14T12:01:19.106488+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:05.923305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"263'120","reported_seq":646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.519098+0000","last_change":"2024-09-14T10:46:54.378096+0000","last_active":"2024-09-14T11:56:55.519098+0000","last_peered":"2024-09-14T11:56:55.519098+0000","last_clean":"2024-09-14T11:56:55.519098+0000","last_became_active":"2024-09-14T10:46:54.377788+0000","last_became_peered":"2024-09-14T10:46:54.377788+0000","last_unstale":"2024-09-14T11:56:55.519098+0000","last_undegraded":"2024-09-14T11:56:55.519098+0000","last_fullsized":"2024-09-14T11:56:55.519098+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:20.522136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":221,"num_read_kb":193,"num_write":312,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"263'791","reported_seq":2334,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.734178+0000","last_change":"2024-09-14T10:46:46.352423+0000","last_active":"2024-09-14T11:59:29.734178+0000","last_peered":"2024-09-14T11:59:29.734178+0000","last_clean":"2024-09-14T11:59:29.734178+0000","last_became_active":"2024-09-14T10:46:46.352087+0000","last_became_peered":"2024-09-14T10:46:46.352087+0000","last_unstale":"2024-09-14T11:59:29.734178+0000","last_undegraded":"2024-09-14T11:59:29.734178+0000","last_fullsized":"2024-09-14T11:59:29.734178+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:12.501801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3891,"num_read_kb":3520,"num_write":1035,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"263'316","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.307559+0000","last_change":"2024-09-14T10:46:44.321112+0000","last_active":"2024-09-14T12:01:19.307559+0000","last_peered":"2024-09-14T12:01:19.307559+0000","last_clean":"2024-09-14T12:01:19.307559+0000","last_became_active":"2024-09-14T10:46:44.320689+0000","last_became_peered":"2024-09-14T10:46:44.320689+0000","last_unstale":"2024-09-14T12:01:19.307559+0000","last_undegraded":"2024-09-14T12:01:19.307559+0000","last_fullsized":"2024-09-14T12:01:19.307559+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:11.205586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":532,"num_read_kb":954,"num_write":1107,"num_write_kb":21144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.395545+0000","last_change":"2024-09-14T10:46:48.357357+0000","last_active":"2024-09-14T11:56:50.395545+0000","last_peered":"2024-09-14T11:56:50.395545+0000","last_clean":"2024-09-14T11:56:50.395545+0000","last_became_active":"2024-09-14T10:46:48.357024+0000","last_became_peered":"2024-09-14T10:46:48.357024+0000","last_unstale":"2024-09-14T11:56:50.395545+0000","last_undegraded":"2024-09-14T11:56:50.395545+0000","last_fullsized":"2024-09-14T11:56:50.395545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:57.501469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"263'378","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.928077+0000","last_change":"2024-09-14T10:46:50.362271+0000","last_active":"2024-09-14T12:01:18.928077+0000","last_peered":"2024-09-14T12:01:18.928077+0000","last_clean":"2024-09-14T12:01:18.928077+0000","last_became_active":"2024-09-14T10:46:50.361962+0000","last_became_peered":"2024-09-14T10:46:50.361962+0000","last_unstale":"2024-09-14T12:01:18.928077+0000","last_undegraded":"2024-09-14T12:01:18.928077+0000","last_fullsized":"2024-09-14T12:01:18.928077+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:52.644742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49011,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":601,"num_read_kb":1340,"num_write":486,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.633741+0000","last_change":"2024-09-14T10:46:52.369579+0000","last_active":"2024-09-14T11:57:00.633741+0000","last_peered":"2024-09-14T11:57:00.633741+0000","last_clean":"2024-09-14T11:57:00.633741+0000","last_became_active":"2024-09-14T10:46:52.369262+0000","last_became_peered":"2024-09-14T10:46:52.369262+0000","last_unstale":"2024-09-14T11:57:00.633741+0000","last_undegraded":"2024-09-14T11:57:00.633741+0000","last_fullsized":"2024-09-14T11:57:00.633741+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:35.807345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"263'147","reported_seq":659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.302488+0000","last_change":"2024-09-14T10:46:54.385691+0000","last_active":"2024-09-14T11:59:34.302488+0000","last_peered":"2024-09-14T11:59:34.302488+0000","last_clean":"2024-09-14T11:59:34.302488+0000","last_became_active":"2024-09-14T10:46:54.385235+0000","last_became_peered":"2024-09-14T10:46:54.385235+0000","last_unstale":"2024-09-14T11:59:34.302488+0000","last_undegraded":"2024-09-14T11:59:34.302488+0000","last_fullsized":"2024-09-14T11:59:34.302488+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:33.162523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":187,"num_write":368,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"263'748","reported_seq":2307,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.674695+0000","last_change":"2024-09-14T10:46:46.335431+0000","last_active":"2024-09-14T11:59:34.674695+0000","last_peered":"2024-09-14T11:59:34.674695+0000","last_clean":"2024-09-14T11:59:34.674695+0000","last_became_active":"2024-09-14T10:46:46.335112+0000","last_became_peered":"2024-09-14T10:46:46.335112+0000","last_unstale":"2024-09-14T11:59:34.674695+0000","last_undegraded":"2024-09-14T11:59:34.674695+0000","last_fullsized":"2024-09-14T11:59:34.674695+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:09.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3755,"num_read_kb":3425,"num_write":989,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"263'322","reported_seq":967,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.268474+0000","last_change":"2024-09-14T10:46:44.335176+0000","last_active":"2024-09-14T12:01:19.268474+0000","last_peered":"2024-09-14T12:01:19.268474+0000","last_clean":"2024-09-14T12:01:19.268474+0000","last_became_active":"2024-09-14T10:46:44.332130+0000","last_became_peered":"2024-09-14T10:46:44.332130+0000","last_unstale":"2024-09-14T12:01:19.268474+0000","last_undegraded":"2024-09-14T12:01:19.268474+0000","last_fullsized":"2024-09-14T12:01:19.268474+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:00.407801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":584,"num_read_kb":32074,"num_write":1014,"num_write_kb":20757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.293480+0000","last_change":"2024-09-14T10:46:48.354432+0000","last_active":"2024-09-14T11:56:50.293480+0000","last_peered":"2024-09-14T11:56:50.293480+0000","last_clean":"2024-09-14T11:56:50.293480+0000","last_became_active":"2024-09-14T10:46:48.354108+0000","last_became_peered":"2024-09-14T10:46:48.354108+0000","last_unstale":"2024-09-14T11:56:50.293480+0000","last_undegraded":"2024-09-14T11:56:50.293480+0000","last_fullsized":"2024-09-14T11:56:50.293480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:07.134782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"263'271","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.986296+0000","last_change":"2024-09-14T10:46:50.358462+0000","last_active":"2024-09-14T12:01:18.986296+0000","last_peered":"2024-09-14T12:01:18.986296+0000","last_clean":"2024-09-14T12:01:18.986296+0000","last_became_active":"2024-09-14T10:46:50.358186+0000","last_became_peered":"2024-09-14T10:46:50.358186+0000","last_unstale":"2024-09-14T12:01:18.986296+0000","last_undegraded":"2024-09-14T12:01:18.986296+0000","last_fullsized":"2024-09-14T12:01:18.986296+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:23.418101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46012,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":454,"num_read_kb":1061,"num_write":362,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:05.520539+0000","last_change":"2024-09-14T10:46:52.366046+0000","last_active":"2024-09-14T11:57:05.520539+0000","last_peered":"2024-09-14T11:57:05.520539+0000","last_clean":"2024-09-14T11:57:05.520539+0000","last_became_active":"2024-09-14T10:46:52.365736+0000","last_became_peered":"2024-09-14T10:46:52.365736+0000","last_unstale":"2024-09-14T11:57:05.520539+0000","last_undegraded":"2024-09-14T11:57:05.520539+0000","last_fullsized":"2024-09-14T11:57:05.520539+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:20.721132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"263'123","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.467272+0000","last_change":"2024-09-14T10:46:54.385215+0000","last_active":"2024-09-14T11:59:28.467272+0000","last_peered":"2024-09-14T11:59:28.467272+0000","last_clean":"2024-09-14T11:59:28.467272+0000","last_became_active":"2024-09-14T10:46:54.384303+0000","last_became_peered":"2024-09-14T10:46:54.384303+0000","last_unstale":"2024-09-14T11:59:28.467272+0000","last_undegraded":"2024-09-14T11:59:28.467272+0000","last_fullsized":"2024-09-14T11:59:28.467272+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:28.997409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":957,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":145,"num_write":281,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"263'378","reported_seq":1793,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:21.445410+0000","last_change":"2024-09-14T10:46:46.338858+0000","last_active":"2024-09-14T11:58:21.445410+0000","last_peered":"2024-09-14T11:58:21.445410+0000","last_clean":"2024-09-14T11:58:21.445410+0000","last_became_active":"2024-09-14T10:46:46.338518+0000","last_became_peered":"2024-09-14T10:46:46.338518+0000","last_unstale":"2024-09-14T11:58:21.445410+0000","last_undegraded":"2024-09-14T11:58:21.445410+0000","last_fullsized":"2024-09-14T11:58:21.445410+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:01.075539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2070,"num_read_kb":1951,"num_write":457,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"263'327","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.424856+0000","last_change":"2024-09-14T10:46:44.333207+0000","last_active":"2024-09-14T12:01:18.424856+0000","last_peered":"2024-09-14T12:01:18.424856+0000","last_clean":"2024-09-14T12:01:18.424856+0000","last_became_active":"2024-09-14T10:46:44.332852+0000","last_became_peered":"2024-09-14T10:46:44.332852+0000","last_unstale":"2024-09-14T12:01:18.424856+0000","last_undegraded":"2024-09-14T12:01:18.424856+0000","last_fullsized":"2024-09-14T12:01:18.424856+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:48.357394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244655,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":627,"num_read_kb":10749,"num_write":1185,"num_write_kb":43875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.396096+0000","last_change":"2024-09-14T10:46:48.355870+0000","last_active":"2024-09-14T11:56:55.396096+0000","last_peered":"2024-09-14T11:56:55.396096+0000","last_clean":"2024-09-14T11:56:55.396096+0000","last_became_active":"2024-09-14T10:46:48.355512+0000","last_became_peered":"2024-09-14T10:46:48.355512+0000","last_unstale":"2024-09-14T11:56:55.396096+0000","last_undegraded":"2024-09-14T11:56:55.396096+0000","last_fullsized":"2024-09-14T11:56:55.396096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:43.891041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"263'265","reported_seq":827,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.475186+0000","last_change":"2024-09-14T10:46:50.364736+0000","last_active":"2024-09-14T12:01:18.475186+0000","last_peered":"2024-09-14T12:01:18.475186+0000","last_clean":"2024-09-14T12:01:18.475186+0000","last_became_active":"2024-09-14T10:46:50.364420+0000","last_became_peered":"2024-09-14T10:46:50.364420+0000","last_unstale":"2024-09-14T12:01:18.475186+0000","last_undegraded":"2024-09-14T12:01:18.475186+0000","last_fullsized":"2024-09-14T12:01:18.475186+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:59.631655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45284,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":455,"num_read_kb":1165,"num_write":378,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.519191+0000","last_change":"2024-09-14T10:46:52.374194+0000","last_active":"2024-09-14T11:56:55.519191+0000","last_peered":"2024-09-14T11:56:55.519191+0000","last_clean":"2024-09-14T11:56:55.519191+0000","last_became_active":"2024-09-14T10:46:52.373913+0000","last_became_peered":"2024-09-14T10:46:52.373913+0000","last_unstale":"2024-09-14T11:56:55.519191+0000","last_undegraded":"2024-09-14T11:56:55.519191+0000","last_fullsized":"2024-09-14T11:56:55.519191+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:44.342253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"263'129","reported_seq":1230,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.354353+0000","last_change":"2024-09-14T10:46:54.383936+0000","last_active":"2024-09-14T11:59:30.354353+0000","last_peered":"2024-09-14T11:59:30.354353+0000","last_clean":"2024-09-14T11:59:30.354353+0000","last_became_active":"2024-09-14T10:46:54.383637+0000","last_became_peered":"2024-09-14T10:46:54.383637+0000","last_unstale":"2024-09-14T11:59:30.354353+0000","last_undegraded":"2024-09-14T11:59:30.354353+0000","last_fullsized":"2024-09-14T11:59:30.354353+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:19.327839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":738,"num_read_kb":738,"num_write":285,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"263'441","reported_seq":1899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.598287+0000","last_change":"2024-09-14T10:46:46.342570+0000","last_active":"2024-09-14T11:59:33.598287+0000","last_peered":"2024-09-14T11:59:33.598287+0000","last_clean":"2024-09-14T11:59:33.598287+0000","last_became_active":"2024-09-14T10:46:46.342299+0000","last_became_peered":"2024-09-14T10:46:46.342299+0000","last_unstale":"2024-09-14T11:59:33.598287+0000","last_undegraded":"2024-09-14T11:59:33.598287+0000","last_fullsized":"2024-09-14T11:59:33.598287+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:56.482166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2232,"num_read_kb":2089,"num_write":533,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"263'466","reported_seq":1218,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.379862+0000","last_change":"2024-09-14T10:46:44.321110+0000","last_active":"2024-09-14T12:01:18.379862+0000","last_peered":"2024-09-14T12:01:18.379862+0000","last_clean":"2024-09-14T12:01:18.379862+0000","last_became_active":"2024-09-14T10:46:44.320749+0000","last_became_peered":"2024-09-14T10:46:44.320749+0000","last_unstale":"2024-09-14T12:01:18.379862+0000","last_undegraded":"2024-09-14T12:01:18.379862+0000","last_fullsized":"2024-09-14T12:01:18.379862+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:58.570377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7815,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":1055,"num_read_kb":48118,"num_write":1484,"num_write_kb":57550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:10.635290+0000","last_change":"2024-09-14T10:46:48.353148+0000","last_active":"2024-09-14T11:57:10.635290+0000","last_peered":"2024-09-14T11:57:10.635290+0000","last_clean":"2024-09-14T11:57:10.635290+0000","last_became_active":"2024-09-14T10:46:48.352853+0000","last_became_peered":"2024-09-14T10:46:48.352853+0000","last_unstale":"2024-09-14T11:57:10.635290+0000","last_undegraded":"2024-09-14T11:57:10.635290+0000","last_fullsized":"2024-09-14T11:57:10.635290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:46.305353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"263'304","reported_seq":903,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.639297+0000","last_change":"2024-09-14T10:46:50.369781+0000","last_active":"2024-09-14T12:01:18.639297+0000","last_peered":"2024-09-14T12:01:18.639297+0000","last_clean":"2024-09-14T12:01:18.639297+0000","last_became_active":"2024-09-14T10:46:50.369492+0000","last_became_peered":"2024-09-14T10:46:50.369492+0000","last_unstale":"2024-09-14T12:01:18.639297+0000","last_undegraded":"2024-09-14T12:01:18.639297+0000","last_fullsized":"2024-09-14T12:01:18.639297+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:50.804436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49661,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":1034,"num_write":382,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.633068+0000","last_change":"2024-09-14T10:46:52.373456+0000","last_active":"2024-09-14T11:56:55.633068+0000","last_peered":"2024-09-14T11:56:55.633068+0000","last_clean":"2024-09-14T11:56:55.633068+0000","last_became_active":"2024-09-14T10:46:52.372108+0000","last_became_peered":"2024-09-14T10:46:52.372108+0000","last_unstale":"2024-09-14T11:56:55.633068+0000","last_undegraded":"2024-09-14T11:56:55.633068+0000","last_fullsized":"2024-09-14T11:56:55.633068+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:25.122029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"263'125","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.133558+0000","last_change":"2024-09-14T10:46:54.385169+0000","last_active":"2024-09-14T12:00:51.133558+0000","last_peered":"2024-09-14T12:00:51.133558+0000","last_clean":"2024-09-14T12:00:51.133558+0000","last_became_active":"2024-09-14T10:46:54.384278+0000","last_became_peered":"2024-09-14T10:46:54.384278+0000","last_unstale":"2024-09-14T12:00:51.133558+0000","last_undegraded":"2024-09-14T12:00:51.133558+0000","last_fullsized":"2024-09-14T12:00:51.133558+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:32.418655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":278,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"263'464","reported_seq":2034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.645877+0000","last_change":"2024-09-14T10:46:46.347263+0000","last_active":"2024-09-14T11:58:20.645877+0000","last_peered":"2024-09-14T11:58:20.645877+0000","last_clean":"2024-09-14T11:58:20.645877+0000","last_became_active":"2024-09-14T10:46:46.346994+0000","last_became_peered":"2024-09-14T10:46:46.346994+0000","last_unstale":"2024-09-14T11:58:20.645877+0000","last_undegraded":"2024-09-14T11:58:20.645877+0000","last_fullsized":"2024-09-14T11:58:20.645877+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:52.672214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2420,"num_read_kb":2273,"num_write":546,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"263'389","reported_seq":1145,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.365914+0000","last_change":"2024-09-14T10:46:44.329371+0000","last_active":"2024-09-14T12:01:19.365914+0000","last_peered":"2024-09-14T12:01:19.365914+0000","last_clean":"2024-09-14T12:01:19.365914+0000","last_became_active":"2024-09-14T10:46:44.328946+0000","last_became_peered":"2024-09-14T10:46:44.328946+0000","last_unstale":"2024-09-14T12:01:19.365914+0000","last_undegraded":"2024-09-14T12:01:19.365914+0000","last_fullsized":"2024-09-14T12:01:19.365914+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:41.337845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1017,"num_read_kb":28148,"num_write":1233,"num_write_kb":43814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"263'509","reported_seq":2191,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.915971+0000","last_change":"2024-09-14T10:46:46.343533+0000","last_active":"2024-09-14T11:58:23.915971+0000","last_peered":"2024-09-14T11:58:23.915971+0000","last_clean":"2024-09-14T11:58:23.915971+0000","last_became_active":"2024-09-14T10:46:46.343234+0000","last_became_peered":"2024-09-14T10:46:46.343234+0000","last_unstale":"2024-09-14T11:58:23.915971+0000","last_undegraded":"2024-09-14T11:58:23.915971+0000","last_fullsized":"2024-09-14T11:58:23.915971+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:10.850533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2663,"num_read_kb":2506,"num_write":583,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"263'344","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.370995+0000","last_change":"2024-09-14T10:46:44.317974+0000","last_active":"2024-09-14T12:01:19.370995+0000","last_peered":"2024-09-14T12:01:19.370995+0000","last_clean":"2024-09-14T12:01:19.370995+0000","last_became_active":"2024-09-14T10:46:44.317349+0000","last_became_peered":"2024-09-14T10:46:44.317349+0000","last_unstale":"2024-09-14T12:01:19.370995+0000","last_undegraded":"2024-09-14T12:01:19.370995+0000","last_fullsized":"2024-09-14T12:01:19.370995+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:49.115709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133675,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":5317,"num_write":990,"num_write_kb":25288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"263'447","reported_seq":1996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.498826+0000","last_change":"2024-09-14T10:46:46.347323+0000","last_active":"2024-09-14T11:59:49.498826+0000","last_peered":"2024-09-14T11:59:49.498826+0000","last_clean":"2024-09-14T11:59:49.498826+0000","last_became_active":"2024-09-14T10:46:46.346640+0000","last_became_peered":"2024-09-14T10:46:46.346640+0000","last_unstale":"2024-09-14T11:59:49.498826+0000","last_undegraded":"2024-09-14T11:59:49.498826+0000","last_fullsized":"2024-09-14T11:59:49.498826+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:33.703143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2347,"num_read_kb":2209,"num_write":542,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"263'346","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.403176+0000","last_change":"2024-09-14T10:46:44.328462+0000","last_active":"2024-09-14T12:01:19.403176+0000","last_peered":"2024-09-14T12:01:19.403176+0000","last_clean":"2024-09-14T12:01:19.403176+0000","last_became_active":"2024-09-14T10:46:44.328049+0000","last_became_peered":"2024-09-14T10:46:44.328049+0000","last_unstale":"2024-09-14T12:01:19.403176+0000","last_undegraded":"2024-09-14T12:01:19.403176+0000","last_fullsized":"2024-09-14T12:01:19.403176+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:12.916156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":619,"num_read_kb":2326,"num_write":1082,"num_write_kb":13442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"263'933","reported_seq":2731,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.707652+0000","last_change":"2024-09-14T10:46:46.349041+0000","last_active":"2024-09-14T11:59:34.707652+0000","last_peered":"2024-09-14T11:59:34.707652+0000","last_clean":"2024-09-14T11:59:34.707652+0000","last_became_active":"2024-09-14T10:46:46.346682+0000","last_became_peered":"2024-09-14T10:46:46.346682+0000","last_unstale":"2024-09-14T11:59:34.707652+0000","last_undegraded":"2024-09-14T11:59:34.707652+0000","last_fullsized":"2024-09-14T11:59:34.707652+0000","mapping_epoch":28,"log_start":"263'900","ondisk_log_start":"263'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":900,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:46.804415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4656,"num_read_kb":4197,"num_write":1246,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"263'355","reported_seq":1033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.422474+0000","last_change":"2024-09-14T10:47:19.040942+0000","last_active":"2024-09-14T12:01:18.422474+0000","last_peered":"2024-09-14T12:01:18.422474+0000","last_clean":"2024-09-14T12:01:18.422474+0000","last_became_active":"2024-09-14T10:47:19.040453+0000","last_became_peered":"2024-09-14T10:47:19.040453+0000","last_unstale":"2024-09-14T12:01:18.422474+0000","last_undegraded":"2024-09-14T12:01:18.422474+0000","last_fullsized":"2024-09-14T12:01:18.422474+0000","mapping_epoch":39,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:33.248100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12673081,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":677,"num_read_kb":25388,"num_write":1151,"num_write_kb":37274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"263'507","reported_seq":2207,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.152468+0000","last_change":"2024-09-14T10:46:46.349718+0000","last_active":"2024-09-14T11:58:46.152468+0000","last_peered":"2024-09-14T11:58:46.152468+0000","last_clean":"2024-09-14T11:58:46.152468+0000","last_became_active":"2024-09-14T10:46:46.349465+0000","last_became_peered":"2024-09-14T10:46:46.349465+0000","last_unstale":"2024-09-14T11:58:46.152468+0000","last_undegraded":"2024-09-14T11:58:46.152468+0000","last_fullsized":"2024-09-14T11:58:46.152468+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:17.558471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2847,"num_read_kb":2662,"num_write":617,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"263'310","reported_seq":1018,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.433682+0000","last_change":"2024-09-14T10:46:44.320591+0000","last_active":"2024-09-14T12:01:18.433682+0000","last_peered":"2024-09-14T12:01:18.433682+0000","last_clean":"2024-09-14T12:01:18.433682+0000","last_became_active":"2024-09-14T10:46:44.320218+0000","last_became_peered":"2024-09-14T10:46:44.320218+0000","last_unstale":"2024-09-14T12:01:18.433682+0000","last_undegraded":"2024-09-14T12:01:18.433682+0000","last_fullsized":"2024-09-14T12:01:18.433682+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:23.505336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245238,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":839,"num_read_kb":10863,"num_write":1100,"num_write_kb":35921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"263'436","reported_seq":2109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.916554+0000","last_change":"2024-09-14T10:46:46.342492+0000","last_active":"2024-09-14T11:58:23.916554+0000","last_peered":"2024-09-14T11:58:23.916554+0000","last_clean":"2024-09-14T11:58:23.916554+0000","last_became_active":"2024-09-14T10:46:46.342206+0000","last_became_peered":"2024-09-14T10:46:46.342206+0000","last_unstale":"2024-09-14T11:58:23.916554+0000","last_undegraded":"2024-09-14T11:58:23.916554+0000","last_fullsized":"2024-09-14T11:58:23.916554+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:44.468754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2469,"num_read_kb":2360,"num_write":494,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"263'437","reported_seq":1119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.517316+0000","last_change":"2024-09-14T10:46:44.314850+0000","last_active":"2024-09-14T12:01:18.517316+0000","last_peered":"2024-09-14T12:01:18.517316+0000","last_clean":"2024-09-14T12:01:18.517316+0000","last_became_active":"2024-09-14T10:46:44.314466+0000","last_became_peered":"2024-09-14T10:46:44.314466+0000","last_unstale":"2024-09-14T12:01:18.517316+0000","last_undegraded":"2024-09-14T12:01:18.517316+0000","last_fullsized":"2024-09-14T12:01:18.517316+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:39.202894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1528286,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":900,"num_read_kb":16042,"num_write":1216,"num_write_kb":34508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"263'667","reported_seq":2288,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.136829+0000","last_change":"2024-09-14T10:46:46.342488+0000","last_active":"2024-09-14T12:00:51.136829+0000","last_peered":"2024-09-14T12:00:51.136829+0000","last_clean":"2024-09-14T12:00:51.136829+0000","last_became_active":"2024-09-14T10:46:46.342217+0000","last_became_peered":"2024-09-14T10:46:46.342217+0000","last_unstale":"2024-09-14T12:00:51.136829+0000","last_undegraded":"2024-09-14T12:00:51.136829+0000","last_fullsized":"2024-09-14T12:00:51.136829+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":600,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:03.054708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3344,"num_read_kb":3009,"num_write":894,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"263'322","reported_seq":1064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.397645+0000","last_change":"2024-09-14T10:46:44.324067+0000","last_active":"2024-09-14T12:01:19.397645+0000","last_peered":"2024-09-14T12:01:19.397645+0000","last_clean":"2024-09-14T12:01:19.397645+0000","last_became_active":"2024-09-14T10:46:44.323339+0000","last_became_peered":"2024-09-14T10:46:44.323339+0000","last_unstale":"2024-09-14T12:01:19.397645+0000","last_undegraded":"2024-09-14T12:01:19.397645+0000","last_fullsized":"2024-09-14T12:01:19.397645+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:50.726091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":616,"num_read_kb":14372,"num_write":932,"num_write_kb":14595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'444","reported_seq":1976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.351227+0000","last_change":"2024-09-14T10:46:46.341986+0000","last_active":"2024-09-14T11:58:44.351227+0000","last_peered":"2024-09-14T11:58:44.351227+0000","last_clean":"2024-09-14T11:58:44.351227+0000","last_became_active":"2024-09-14T10:46:46.341731+0000","last_became_peered":"2024-09-14T10:46:46.341731+0000","last_unstale":"2024-09-14T11:58:44.351227+0000","last_undegraded":"2024-09-14T11:58:44.351227+0000","last_fullsized":"2024-09-14T11:58:44.351227+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:05.674327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2390,"num_read_kb":2239,"num_write":538,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"263'341","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.377267+0000","last_change":"2024-09-14T10:46:44.321933+0000","last_active":"2024-09-14T12:01:18.377267+0000","last_peered":"2024-09-14T12:01:18.377267+0000","last_clean":"2024-09-14T12:01:18.377267+0000","last_became_active":"2024-09-14T10:46:44.321604+0000","last_became_peered":"2024-09-14T10:46:44.321604+0000","last_unstale":"2024-09-14T12:01:18.377267+0000","last_undegraded":"2024-09-14T12:01:18.377267+0000","last_fullsized":"2024-09-14T12:01:18.377267+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:42.964237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243315,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":759,"num_read_kb":33590,"num_write":1210,"num_write_kb":22096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"263'970","reported_seq":2678,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.915612+0000","last_change":"2024-09-14T10:46:46.336853+0000","last_active":"2024-09-14T11:58:23.915612+0000","last_peered":"2024-09-14T11:58:23.915612+0000","last_clean":"2024-09-14T11:58:23.915612+0000","last_became_active":"2024-09-14T10:46:46.336508+0000","last_became_peered":"2024-09-14T10:46:46.336508+0000","last_unstale":"2024-09-14T11:58:23.915612+0000","last_undegraded":"2024-09-14T11:58:23.915612+0000","last_fullsized":"2024-09-14T11:58:23.915612+0000","mapping_epoch":28,"log_start":"263'900","ondisk_log_start":"263'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":900,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:08.953818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4671,"num_read_kb":4174,"num_write":1327,"num_write_kb":556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"263'317","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.346999+0000","last_change":"2024-09-14T10:46:44.321413+0000","last_active":"2024-09-14T12:01:19.346999+0000","last_peered":"2024-09-14T12:01:19.346999+0000","last_clean":"2024-09-14T12:01:19.346999+0000","last_became_active":"2024-09-14T10:46:44.321073+0000","last_became_peered":"2024-09-14T10:46:44.321073+0000","last_unstale":"2024-09-14T12:01:19.346999+0000","last_undegraded":"2024-09-14T12:01:19.346999+0000","last_fullsized":"2024-09-14T12:01:19.346999+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:02.410131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":672,"num_read_kb":7284,"num_write":1109,"num_write_kb":7346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"263'352","reported_seq":1803,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.683411+0000","last_change":"2024-09-14T10:46:46.343853+0000","last_active":"2024-09-14T11:59:34.683411+0000","last_peered":"2024-09-14T11:59:34.683411+0000","last_clean":"2024-09-14T11:59:34.683411+0000","last_became_active":"2024-09-14T10:46:46.341188+0000","last_became_peered":"2024-09-14T10:46:46.341188+0000","last_unstale":"2024-09-14T11:59:34.683411+0000","last_undegraded":"2024-09-14T11:59:34.683411+0000","last_fullsized":"2024-09-14T11:59:34.683411+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:55.124703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1965,"num_read_kb":1883,"num_write":389,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"263'360","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.372729+0000","last_change":"2024-09-14T10:46:44.316977+0000","last_active":"2024-09-14T12:01:18.372729+0000","last_peered":"2024-09-14T12:01:18.372729+0000","last_clean":"2024-09-14T12:01:18.372729+0000","last_became_active":"2024-09-14T10:46:44.316633+0000","last_became_peered":"2024-09-14T10:46:44.316633+0000","last_unstale":"2024-09-14T12:01:18.372729+0000","last_undegraded":"2024-09-14T12:01:18.372729+0000","last_fullsized":"2024-09-14T12:01:18.372729+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:02.290580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289618,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":754,"num_read_kb":2329,"num_write":1185,"num_write_kb":27267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"263'778","reported_seq":2432,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.462116+0000","last_change":"2024-09-14T10:46:46.348188+0000","last_active":"2024-09-14T11:58:58.462116+0000","last_peered":"2024-09-14T11:58:58.462116+0000","last_clean":"2024-09-14T11:58:58.462116+0000","last_became_active":"2024-09-14T10:46:46.347941+0000","last_became_peered":"2024-09-14T10:46:46.347941+0000","last_unstale":"2024-09-14T11:58:58.462116+0000","last_undegraded":"2024-09-14T11:58:58.462116+0000","last_fullsized":"2024-09-14T11:58:58.462116+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:09.760195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3936,"num_read_kb":3604,"num_write":1011,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"263'350","reported_seq":1112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.269823+0000","last_change":"2024-09-14T10:46:44.322513+0000","last_active":"2024-09-14T12:01:19.269823+0000","last_peered":"2024-09-14T12:01:19.269823+0000","last_clean":"2024-09-14T12:01:19.269823+0000","last_became_active":"2024-09-14T10:46:44.322149+0000","last_became_peered":"2024-09-14T10:46:44.322149+0000","last_unstale":"2024-09-14T12:01:19.269823+0000","last_undegraded":"2024-09-14T12:01:19.269823+0000","last_fullsized":"2024-09-14T12:01:19.269823+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:02.597943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":929,"num_read_kb":38620,"num_write":1197,"num_write_kb":16629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"263'788","reported_seq":2341,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.709237+0000","last_change":"2024-09-14T10:46:46.340742+0000","last_active":"2024-09-14T11:59:34.709237+0000","last_peered":"2024-09-14T11:59:34.709237+0000","last_clean":"2024-09-14T11:59:34.709237+0000","last_became_active":"2024-09-14T10:46:46.340475+0000","last_became_peered":"2024-09-14T10:46:46.340475+0000","last_unstale":"2024-09-14T11:59:34.709237+0000","last_undegraded":"2024-09-14T11:59:34.709237+0000","last_fullsized":"2024-09-14T11:59:34.709237+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:20.835262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3820,"num_read_kb":3456,"num_write":1020,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"263'314","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.308236+0000","last_change":"2024-09-14T10:46:44.329821+0000","last_active":"2024-09-14T12:01:19.308236+0000","last_peered":"2024-09-14T12:01:19.308236+0000","last_clean":"2024-09-14T12:01:19.308236+0000","last_became_active":"2024-09-14T10:46:44.329386+0000","last_became_peered":"2024-09-14T10:46:44.329386+0000","last_unstale":"2024-09-14T12:01:19.308236+0000","last_undegraded":"2024-09-14T12:01:19.308236+0000","last_fullsized":"2024-09-14T12:01:19.308236+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:52.796065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133721,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":628,"num_read_kb":13742,"num_write":1168,"num_write_kb":24265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"263'489","reported_seq":2188,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.408190+0000","last_change":"2024-09-14T10:46:46.351572+0000","last_active":"2024-09-14T11:58:50.408190+0000","last_peered":"2024-09-14T11:58:50.408190+0000","last_clean":"2024-09-14T11:58:50.408190+0000","last_became_active":"2024-09-14T10:46:46.351291+0000","last_became_peered":"2024-09-14T10:46:46.351291+0000","last_unstale":"2024-09-14T11:58:50.408190+0000","last_undegraded":"2024-09-14T11:58:50.408190+0000","last_fullsized":"2024-09-14T11:58:50.408190+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:43.260116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2678,"num_read_kb":2537,"num_write":593,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"263'343","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.341847+0000","last_change":"2024-09-14T10:46:44.329049+0000","last_active":"2024-09-14T12:01:19.341847+0000","last_peered":"2024-09-14T12:01:19.341847+0000","last_clean":"2024-09-14T12:01:19.341847+0000","last_became_active":"2024-09-14T10:46:44.328509+0000","last_became_peered":"2024-09-14T10:46:44.328509+0000","last_unstale":"2024-09-14T12:01:19.341847+0000","last_undegraded":"2024-09-14T12:01:19.341847+0000","last_fullsized":"2024-09-14T12:01:19.341847+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:39.663145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":629,"num_read_kb":8535,"num_write":1026,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"263'630","reported_seq":2305,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.706431+0000","last_change":"2024-09-14T10:46:46.343531+0000","last_active":"2024-09-14T11:59:34.706431+0000","last_peered":"2024-09-14T11:59:34.706431+0000","last_clean":"2024-09-14T11:59:34.706431+0000","last_became_active":"2024-09-14T10:46:46.343264+0000","last_became_peered":"2024-09-14T10:46:46.343264+0000","last_unstale":"2024-09-14T11:59:34.706431+0000","last_undegraded":"2024-09-14T11:59:34.706431+0000","last_fullsized":"2024-09-14T11:59:34.706431+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":600,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:52.794216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3383,"num_read_kb":3097,"num_write":846,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"263'340","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.364856+0000","last_change":"2024-09-14T10:46:44.335536+0000","last_active":"2024-09-14T12:01:19.364856+0000","last_peered":"2024-09-14T12:01:19.364856+0000","last_clean":"2024-09-14T12:01:19.364856+0000","last_became_active":"2024-09-14T10:46:44.334832+0000","last_became_peered":"2024-09-14T10:46:44.334832+0000","last_unstale":"2024-09-14T12:01:19.364856+0000","last_undegraded":"2024-09-14T12:01:19.364856+0000","last_fullsized":"2024-09-14T12:01:19.364856+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:03.288996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":614,"num_read_kb":31835,"num_write":1126,"num_write_kb":37799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"263'1869","reported_seq":3527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.599717+0000","last_change":"2024-09-14T10:46:46.345486+0000","last_active":"2024-09-14T11:59:33.599717+0000","last_peered":"2024-09-14T11:59:33.599717+0000","last_clean":"2024-09-14T11:59:33.599717+0000","last_became_active":"2024-09-14T10:46:46.344246+0000","last_became_peered":"2024-09-14T10:46:46.344246+0000","last_unstale":"2024-09-14T11:59:33.599717+0000","last_undegraded":"2024-09-14T11:59:33.599717+0000","last_fullsized":"2024-09-14T11:59:33.599717+0000","mapping_epoch":28,"log_start":"263'1800","ondisk_log_start":"263'1800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":1800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:37.648855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8234,"num_read_kb":7178,"num_write":2635,"num_write_kb":1169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"263'380","reported_seq":1025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.382847+0000","last_change":"2024-09-14T10:46:44.331913+0000","last_active":"2024-09-14T12:01:19.382847+0000","last_peered":"2024-09-14T12:01:19.382847+0000","last_clean":"2024-09-14T12:01:19.382847+0000","last_became_active":"2024-09-14T10:46:44.331468+0000","last_became_peered":"2024-09-14T10:46:44.331468+0000","last_unstale":"2024-09-14T12:01:19.382847+0000","last_undegraded":"2024-09-14T12:01:19.382847+0000","last_fullsized":"2024-09-14T12:01:19.382847+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:38.672416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":628,"num_read_kb":40986,"num_write":1142,"num_write_kb":50458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"263'596","reported_seq":2253,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.601844+0000","last_change":"2024-09-14T10:46:46.351650+0000","last_active":"2024-09-14T11:59:33.601844+0000","last_peered":"2024-09-14T11:59:33.601844+0000","last_clean":"2024-09-14T11:59:33.601844+0000","last_became_active":"2024-09-14T10:46:46.351379+0000","last_became_peered":"2024-09-14T10:46:46.351379+0000","last_unstale":"2024-09-14T11:59:33.601844+0000","last_undegraded":"2024-09-14T11:59:33.601844+0000","last_fullsized":"2024-09-14T11:59:33.601844+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:18.174017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3319,"num_read_kb":3081,"num_write":803,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"263'383","reported_seq":1100,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.439929+0000","last_change":"2024-09-14T10:47:18.421792+0000","last_active":"2024-09-14T12:01:18.439929+0000","last_peered":"2024-09-14T12:01:18.439929+0000","last_clean":"2024-09-14T12:01:18.439929+0000","last_became_active":"2024-09-14T10:47:18.421420+0000","last_became_peered":"2024-09-14T10:47:18.421420+0000","last_unstale":"2024-09-14T12:01:18.439929+0000","last_undegraded":"2024-09-14T12:01:18.439929+0000","last_fullsized":"2024-09-14T12:01:18.439929+0000","mapping_epoch":39,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:05.879273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":336,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":980,"num_read_kb":55242,"num_write":1350,"num_write_kb":21886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.30","version":"263'358","reported_seq":1059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.397325+0000","last_change":"2024-09-14T10:46:44.336725+0000","last_active":"2024-09-14T12:01:19.397325+0000","last_peered":"2024-09-14T12:01:19.397325+0000","last_clean":"2024-09-14T12:01:19.397325+0000","last_became_active":"2024-09-14T10:46:44.336397+0000","last_became_peered":"2024-09-14T10:46:44.336397+0000","last_unstale":"2024-09-14T12:01:19.397325+0000","last_undegraded":"2024-09-14T12:01:19.397325+0000","last_fullsized":"2024-09-14T12:01:19.397325+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:23.868126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":768,"num_read_kb":58312,"num_write":1211,"num_write_kb":50973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"263'436","reported_seq":2121,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.706348+0000","last_change":"2024-09-14T10:46:46.352747+0000","last_active":"2024-09-14T11:59:34.706348+0000","last_peered":"2024-09-14T11:59:34.706348+0000","last_clean":"2024-09-14T11:59:34.706348+0000","last_became_active":"2024-09-14T10:46:46.352396+0000","last_became_peered":"2024-09-14T10:46:46.352396+0000","last_unstale":"2024-09-14T11:59:34.706348+0000","last_undegraded":"2024-09-14T11:59:34.706348+0000","last_fullsized":"2024-09-14T11:59:34.706348+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:53.050193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2667,"num_read_kb":2535,"num_write":508,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"263'266","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.471594+0000","last_change":"2024-09-14T10:46:44.331837+0000","last_active":"2024-09-14T12:01:18.471594+0000","last_peered":"2024-09-14T12:01:18.471594+0000","last_clean":"2024-09-14T12:01:18.471594+0000","last_became_active":"2024-09-14T10:46:44.331494+0000","last_became_peered":"2024-09-14T10:46:44.331494+0000","last_unstale":"2024-09-14T12:01:18.471594+0000","last_undegraded":"2024-09-14T12:01:18.471594+0000","last_fullsized":"2024-09-14T12:01:18.471594+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:39.194351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6293269,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":443,"num_read_kb":43363,"num_write":875,"num_write_kb":33511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"263'471","reported_seq":1972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.221996+0000","last_change":"2024-09-14T10:46:46.339727+0000","last_active":"2024-09-14T11:58:15.221996+0000","last_peered":"2024-09-14T11:58:15.221996+0000","last_clean":"2024-09-14T11:58:15.221996+0000","last_became_active":"2024-09-14T10:46:46.339440+0000","last_became_peered":"2024-09-14T10:46:46.339440+0000","last_unstale":"2024-09-14T11:58:15.221996+0000","last_undegraded":"2024-09-14T11:58:15.221996+0000","last_fullsized":"2024-09-14T11:58:15.221996+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:46.085936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2508,"num_read_kb":2330,"num_write":579,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9256,"num_read_kb":6632,"num_write":2794,"num_write_kb":850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":943,"ondisk_log_size":943,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15505,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":15201,"num_read_kb":14853,"num_write":17064,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1688,"ondisk_log_size":1688,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":553,"ondisk_log_size":553,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1584090,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":19094,"num_read_kb":39420,"num_write":16012,"num_write_kb":12069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":708608,"data_stored":398694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2048,"ondisk_log_size":2048,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2425,"num_read_kb":2892,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":218145,"num_read_kb":199614,"num_write":55573,"num_write_kb":18950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3985,"ondisk_log_size":3985,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":122326437,"num_objects":937,"num_object_clones":0,"num_object_copies":2811,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":937,"num_whiteouts":0,"num_read":43610,"num_read_kb":1895594,"num_write":71043,"num_write_kb":2068626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":149217280,"data_stored":149217280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3454,"ondisk_log_size":3454,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":184539,"num_write":157,"num_write_kb":126109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":184485,"num_write":156,"num_write_kb":126109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16883712,"data_stored":16878134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510346,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":225200,"kb_used_data":9252,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":94146640,"statfs":{"total":96636764160,"available":96406159360,"internally_reserved":0,"allocated":9474048,"data_stored":7497795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":220920266},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510345,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":205276,"kb_used_data":11472,"kb_used_omap":1,"kb_used_meta":193534,"kb_avail":94166564,"statfs":{"total":96636764160,"available":96426561536,"internally_reserved":0,"allocated":11747328,"data_stored":9764047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":198179269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510345,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244176,"kb_used_data":14176,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94127664,"statfs":{"total":96636764160,"available":96386727936,"internally_reserved":0,"allocated":14516224,"data_stored":12527301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510345,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127500,"kb_used_data":10092,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94244340,"statfs":{"total":96636764160,"available":96506204160,"internally_reserved":0,"allocated":10334208,"data_stored":8364267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510344,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320452,"kb_used_data":10084,"kb_used_omap":1,"kb_used_meta":310206,"kb_avail":94051388,"statfs":{"total":96636764160,"available":96308621312,"internally_reserved":0,"allocated":10326016,"data_stored":8344841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":317651397},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510344,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112212,"kb_used_data":8700,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94259628,"statfs":{"total":96636764160,"available":96521859072,"internally_reserved":0,"allocated":8908800,"data_stored":6901467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543047,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":207532,"kb_used_data":100060,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94164308,"statfs":{"total":96636764160,"available":96424251392,"internally_reserved":0,"allocated":102461440,"data_stored":100416148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":110033351},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575753,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329420,"kb_used_data":63416,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94042420,"statfs":{"total":96636764160,"available":96299438080,"internally_reserved":0,"allocated":64937984,"data_stored":62923853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4694016,"data_stored":4694016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5550080,"data_stored":5550080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6160384,"data_stored":6160384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10321920,"data_stored":10321920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7557120,"data_stored":7557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":56639488,"data_stored":56639488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53002240,"data_stored":53002240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5292032,"data_stored":5292032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":214710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":178450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":50459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16830464,"data_stored":16827675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:01:21.973 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T12:01:22.313 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T12:01:22.314 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":263,"fsid":"b6566dc9-5665-4f7c-861a-3125c3883e3a","created":"2024-09-14T10:46:12.903412+0000","modified":"2024-09-14T11:25:21.191441+0000","last_up_change":"2024-09-14T10:46:24.220378+0000","last_in_change":"2024-09-14T10:46:15.250285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":17,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:46:25.206041+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T10:46:31.320712+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-14T10:46:42.295652+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-14T10:46:44.663080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-14T10:46:46.494180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-14T10:46:48.412624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-14T10:46:50.369886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-14T10:46:52.427213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-14T11:02:33.425536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"254","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-14T11:06:40.448244+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"257","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-14T11:06:44.909631+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"260","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-14T11:25:19.039906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"263","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1ac493c-919c-4291-ab67-463ffca0664f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":1957449887},{"type":"v1","addr":"172.21.15.50:6817","nonce":1957449887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1957449887},{"type":"v1","addr":"172.21.15.50:6819","nonce":1957449887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1957449887},{"type":"v1","addr":"172.21.15.50:6823","nonce":1957449887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1957449887},{"type":"v1","addr":"172.21.15.50:6821","nonce":1957449887}]},"public_addr":"172.21.15.50:6817/1957449887","cluster_addr":"172.21.15.50:6819/1957449887","heartbeat_back_addr":"172.21.15.50:6823/1957449887","heartbeat_front_addr":"172.21.15.50:6821/1957449887","state":["exists","up"]},{"osd":1,"uuid":"8cfeb747-e219-4d25-a8f5-5019198a7753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2565843969},{"type":"v1","addr":"172.21.15.50:6801","nonce":2565843969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2565843969},{"type":"v1","addr":"172.21.15.50:6803","nonce":2565843969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2565843969},{"type":"v1","addr":"172.21.15.50:6807","nonce":2565843969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2565843969},{"type":"v1","addr":"172.21.15.50:6805","nonce":2565843969}]},"public_addr":"172.21.15.50:6801/2565843969","cluster_addr":"172.21.15.50:6803/2565843969","heartbeat_back_addr":"172.21.15.50:6807/2565843969","heartbeat_front_addr":"172.21.15.50:6805/2565843969","state":["exists","up"]},{"osd":2,"uuid":"cc3e2a8a-a85e-49d1-90c5-d2c75de969c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3787956460},{"type":"v1","addr":"172.21.15.50:6809","nonce":3787956460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3787956460},{"type":"v1","addr":"172.21.15.50:6811","nonce":3787956460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3787956460},{"type":"v1","addr":"172.21.15.50:6815","nonce":3787956460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3787956460},{"type":"v1","addr":"172.21.15.50:6813","nonce":3787956460}]},"public_addr":"172.21.15.50:6809/3787956460","cluster_addr":"172.21.15.50:6811/3787956460","heartbeat_back_addr":"172.21.15.50:6815/3787956460","heartbeat_front_addr":"172.21.15.50:6813/3787956460","state":["exists","up"]},{"osd":3,"uuid":"3d9aa8c6-8083-4e43-9263-d1383d8b7014","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":856974303},{"type":"v1","addr":"172.21.15.50:6825","nonce":856974303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":856974303},{"type":"v1","addr":"172.21.15.50:6827","nonce":856974303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":856974303},{"type":"v1","addr":"172.21.15.50:6831","nonce":856974303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":856974303},{"type":"v1","addr":"172.21.15.50:6829","nonce":856974303}]},"public_addr":"172.21.15.50:6825/856974303","cluster_addr":"172.21.15.50:6827/856974303","heartbeat_back_addr":"172.21.15.50:6831/856974303","heartbeat_front_addr":"172.21.15.50:6829/856974303","state":["exists","up"]},{"osd":4,"uuid":"430fa3f7-80b3-4d5e-8b5d-fab67c96b795","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4154782182},{"type":"v1","addr":"172.21.15.118:6817","nonce":4154782182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4154782182},{"type":"v1","addr":"172.21.15.118:6819","nonce":4154782182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4154782182},{"type":"v1","addr":"172.21.15.118:6823","nonce":4154782182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4154782182},{"type":"v1","addr":"172.21.15.118:6821","nonce":4154782182}]},"public_addr":"172.21.15.118:6817/4154782182","cluster_addr":"172.21.15.118:6819/4154782182","heartbeat_back_addr":"172.21.15.118:6823/4154782182","heartbeat_front_addr":"172.21.15.118:6821/4154782182","state":["exists","up"]},{"osd":5,"uuid":"622fe333-dbe0-4de8-b564-1b46a13d9a2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":287234102},{"type":"v1","addr":"172.21.15.118:6801","nonce":287234102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":287234102},{"type":"v1","addr":"172.21.15.118:6803","nonce":287234102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":287234102},{"type":"v1","addr":"172.21.15.118:6807","nonce":287234102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":287234102},{"type":"v1","addr":"172.21.15.118:6805","nonce":287234102}]},"public_addr":"172.21.15.118:6801/287234102","cluster_addr":"172.21.15.118:6803/287234102","heartbeat_back_addr":"172.21.15.118:6807/287234102","heartbeat_front_addr":"172.21.15.118:6805/287234102","state":["exists","up"]},{"osd":6,"uuid":"0b69cf26-b62b-4423-bd98-0b3daf3ff809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2553505309},{"type":"v1","addr":"172.21.15.118:6809","nonce":2553505309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2553505309},{"type":"v1","addr":"172.21.15.118:6811","nonce":2553505309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2553505309},{"type":"v1","addr":"172.21.15.118:6815","nonce":2553505309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2553505309},{"type":"v1","addr":"172.21.15.118:6813","nonce":2553505309}]},"public_addr":"172.21.15.118:6809/2553505309","cluster_addr":"172.21.15.118:6811/2553505309","heartbeat_back_addr":"172.21.15.118:6815/2553505309","heartbeat_front_addr":"172.21.15.118:6813/2553505309","state":["exists","up"]},{"osd":7,"uuid":"7fdbee68-c48f-4c02-8074-f7a5d8d62cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1082138742},{"type":"v1","addr":"172.21.15.118:6827","nonce":1082138742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1082138742},{"type":"v1","addr":"172.21.15.118:6829","nonce":1082138742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1082138742},{"type":"v1","addr":"172.21.15.118:6833","nonce":1082138742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1082138742},{"type":"v1","addr":"172.21.15.118:6831","nonce":1082138742}]},"public_addr":"172.21.15.118:6827/1082138742","cluster_addr":"172.21.15.118:6829/1082138742","heartbeat_back_addr":"172.21.15.118:6833/1082138742","heartbeat_front_addr":"172.21.15.118:6831/1082138742","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.565488+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.305425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.771505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.626204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.828150+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.101749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:21.333748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:46:22.339822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":3,"to":6}]},{"pgid":"3.23","mappings":[{"from":0,"to":6}]},{"pgid":"3.2f","mappings":[{"from":3,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T12:01:23.327 INFO:tasks.ceph:Scrubbing osd.0 2024-09-14T12:01:23.328 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:01:23.484 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-14T12:01:23.484 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:01:23.484 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-14T12:01:23.495 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-14T12:01:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 0 to deep-scrub 2024-09-14T12:01:23.826 INFO:tasks.ceph:Scrubbing osd.1 2024-09-14T12:01:23.826 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:01:23.968 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-14T12:01:23.968 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:01:23.968 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-14T12:01:23.979 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-14T12:01:24.296 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 1 to deep-scrub 2024-09-14T12:01:24.310 INFO:tasks.ceph:Scrubbing osd.2 2024-09-14T12:01:24.310 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:01:24.454 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-14T12:01:24.454 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:01:24.455 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-14T12:01:24.466 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-14T12:01:24.780 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 2 to deep-scrub 2024-09-14T12:01:24.793 INFO:tasks.ceph:Scrubbing osd.3 2024-09-14T12:01:24.794 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:01:24.935 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-14T12:01:24.936 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:01:24.936 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-14T12:01:24.946 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-14T12:01:25.260 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 3 to deep-scrub 2024-09-14T12:01:25.274 INFO:tasks.ceph:Scrubbing osd.4 2024-09-14T12:01:25.274 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:01:25.417 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-14T12:01:25.417 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:01:25.418 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-14T12:01:25.428 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-14T12:01:25.745 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 4 to deep-scrub 2024-09-14T12:01:25.759 INFO:tasks.ceph:Scrubbing osd.5 2024-09-14T12:01:25.759 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:01:25.901 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-14T12:01:25.902 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:01:25.902 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-14T12:01:25.912 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-14T12:01:26.230 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 5 to deep-scrub 2024-09-14T12:01:26.244 INFO:tasks.ceph:Scrubbing osd.6 2024-09-14T12:01:26.244 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:01:26.388 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-14T12:01:26.388 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:01:26.388 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-14T12:01:26.400 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-14T12:01:26.719 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 6 to deep-scrub 2024-09-14T12:01:26.733 INFO:tasks.ceph:Scrubbing osd.7 2024-09-14T12:01:26.734 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:01:26.876 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-14T12:01:26.876 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:01:26.876 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-14T12:01:26.887 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-14T12:01:27.204 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 7 to deep-scrub 2024-09-14T12:01:27.218 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:01:27.556 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T12:01:27.567 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-14T12:01:27.569 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":2507,"stamp":"2024-09-14T12:01:27.026683+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":33086276,"num_objects":745,"num_object_clones":0,"num_object_copies":1770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":745,"num_whiteouts":0,"num_read":308787,"num_read_kb":2528544,"num_write":163626,"num_write_kb":2359360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12838,"ondisk_log_size":12838,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1655932,"kb_used_data":80696,"kb_used_omap":12,"kb_used_meta":1573555,"kb_avail":753318788,"statfs":{"total":773094113280,"available":771398438912,"internally_reserved":0,"allocated":82632704,"data_stored":66726494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1611320881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-619229012,"num_objects":-4100,"num_object_clones":0,"num_object_copies":-12262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4100,"num_whiteouts":0,"num_read":4588,"num_read_kb":4138,"num_write":4351,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005441"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.599297+0000","last_change":"2024-09-14T11:25:20.213046+0000","last_active":"2024-09-14T11:57:50.599297+0000","last_peered":"2024-09-14T11:57:50.599297+0000","last_clean":"2024-09-14T11:57:50.599297+0000","last_became_active":"2024-09-14T11:25:20.212282+0000","last_became_peered":"2024-09-14T11:25:20.212282+0000","last_unstale":"2024-09-14T11:57:50.599297+0000","last_undegraded":"2024-09-14T11:57:50.599297+0000","last_fullsized":"2024-09-14T11:57:50.599297+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:37.717916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"263'3","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.412622+0000","last_change":"2024-09-14T11:06:45.982990+0000","last_active":"2024-09-14T11:59:15.412622+0000","last_peered":"2024-09-14T11:59:15.412622+0000","last_clean":"2024-09-14T11:59:15.412622+0000","last_became_active":"2024-09-14T11:06:45.982702+0000","last_became_peered":"2024-09-14T11:06:45.982702+0000","last_unstale":"2024-09-14T11:59:15.412622+0000","last_undegraded":"2024-09-14T11:59:15.412622+0000","last_fullsized":"2024-09-14T11:59:15.412622+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:59.949376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.432607+0000","last_change":"2024-09-14T11:06:41.918549+0000","last_active":"2024-09-14T11:56:45.432607+0000","last_peered":"2024-09-14T11:56:45.432607+0000","last_clean":"2024-09-14T11:56:45.432607+0000","last_became_active":"2024-09-14T11:06:41.918259+0000","last_became_peered":"2024-09-14T11:06:41.918259+0000","last_unstale":"2024-09-14T11:56:45.432607+0000","last_undegraded":"2024-09-14T11:56:45.432607+0000","last_fullsized":"2024-09-14T11:56:45.432607+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:55.907181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'53","reported_seq":204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.650174+0000","last_change":"2024-09-14T11:02:34.872954+0000","last_active":"2024-09-14T11:58:50.650174+0000","last_peered":"2024-09-14T11:58:50.650174+0000","last_clean":"2024-09-14T11:58:50.650174+0000","last_became_active":"2024-09-14T11:02:34.872682+0000","last_became_peered":"2024-09-14T11:02:34.872682+0000","last_unstale":"2024-09-14T11:58:50.650174+0000","last_undegraded":"2024-09-14T11:58:50.650174+0000","last_fullsized":"2024-09-14T11:58:50.650174+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:01.174737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":419,"num_read_kb":273,"num_write":133,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:53.517430+0000","last_change":"2024-09-14T11:25:20.206920+0000","last_active":"2024-09-14T11:57:53.517430+0000","last_peered":"2024-09-14T11:57:53.517430+0000","last_clean":"2024-09-14T11:57:53.517430+0000","last_became_active":"2024-09-14T11:25:20.206601+0000","last_became_peered":"2024-09-14T11:25:20.206601+0000","last_unstale":"2024-09-14T11:57:53.517430+0000","last_undegraded":"2024-09-14T11:57:53.517430+0000","last_fullsized":"2024-09-14T11:57:53.517430+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:13.234370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"263'13","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.153862+0000","last_change":"2024-09-14T11:06:45.992917+0000","last_active":"2024-09-14T12:01:18.153862+0000","last_peered":"2024-09-14T12:01:18.153862+0000","last_clean":"2024-09-14T12:01:18.153862+0000","last_became_active":"2024-09-14T11:06:45.992612+0000","last_became_peered":"2024-09-14T11:06:45.992612+0000","last_unstale":"2024-09-14T12:01:18.153862+0000","last_undegraded":"2024-09-14T12:01:18.153862+0000","last_fullsized":"2024-09-14T12:01:18.153862+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:36.001623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13883,"num_write":28,"num_write_kb":14907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"263'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.604951+0000","last_change":"2024-09-14T11:06:41.912107+0000","last_active":"2024-09-14T12:01:17.604951+0000","last_peered":"2024-09-14T12:01:17.604951+0000","last_clean":"2024-09-14T12:01:17.604951+0000","last_became_active":"2024-09-14T11:06:41.911807+0000","last_became_peered":"2024-09-14T11:06:41.911807+0000","last_unstale":"2024-09-14T12:01:17.604951+0000","last_undegraded":"2024-09-14T12:01:17.604951+0000","last_fullsized":"2024-09-14T12:01:17.604951+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:55.009953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":621,"num_write":4,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"263'41","reported_seq":172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.650153+0000","last_change":"2024-09-14T11:02:34.879623+0000","last_active":"2024-09-14T11:58:50.650153+0000","last_peered":"2024-09-14T11:58:50.650153+0000","last_clean":"2024-09-14T11:58:50.650153+0000","last_became_active":"2024-09-14T11:02:34.879272+0000","last_became_peered":"2024-09-14T11:02:34.879272+0000","last_unstale":"2024-09-14T11:58:50.650153+0000","last_undegraded":"2024-09-14T11:58:50.650153+0000","last_fullsized":"2024-09-14T11:58:50.650153+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:46.038847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":323,"num_read_kb":209,"num_write":113,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.394943+0000","last_change":"2024-09-14T11:25:20.207542+0000","last_active":"2024-09-14T11:56:45.394943+0000","last_peered":"2024-09-14T11:56:45.394943+0000","last_clean":"2024-09-14T11:56:45.394943+0000","last_became_active":"2024-09-14T11:25:20.207226+0000","last_became_peered":"2024-09-14T11:25:20.207226+0000","last_unstale":"2024-09-14T11:56:45.394943+0000","last_undegraded":"2024-09-14T11:56:45.394943+0000","last_fullsized":"2024-09-14T11:56:45.394943+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:55.365914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.461362+0000","last_change":"2024-09-14T11:06:45.981984+0000","last_active":"2024-09-14T11:58:53.461362+0000","last_peered":"2024-09-14T11:58:53.461362+0000","last_clean":"2024-09-14T11:58:53.461362+0000","last_became_active":"2024-09-14T11:06:45.981705+0000","last_became_peered":"2024-09-14T11:06:45.981705+0000","last_unstale":"2024-09-14T11:58:53.461362+0000","last_undegraded":"2024-09-14T11:58:53.461362+0000","last_fullsized":"2024-09-14T11:58:53.461362+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:53.066712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.450843+0000","last_change":"2024-09-14T11:06:41.918237+0000","last_active":"2024-09-14T11:58:55.450843+0000","last_peered":"2024-09-14T11:58:55.450843+0000","last_clean":"2024-09-14T11:58:55.450843+0000","last_became_active":"2024-09-14T11:06:41.917774+0000","last_became_peered":"2024-09-14T11:06:41.917774+0000","last_unstale":"2024-09-14T11:58:55.450843+0000","last_undegraded":"2024-09-14T11:58:55.450843+0000","last_fullsized":"2024-09-14T11:58:55.450843+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:42.986789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'20","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:38.515232+0000","last_change":"2024-09-14T11:02:34.875159+0000","last_active":"2024-09-14T11:57:38.515232+0000","last_peered":"2024-09-14T11:57:38.515232+0000","last_clean":"2024-09-14T11:57:38.515232+0000","last_became_active":"2024-09-14T11:02:34.874685+0000","last_became_peered":"2024-09-14T11:02:34.874685+0000","last_unstale":"2024-09-14T11:57:38.515232+0000","last_undegraded":"2024-09-14T11:57:38.515232+0000","last_fullsized":"2024-09-14T11:57:38.515232+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:21.593031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":99,"num_write":50,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.442366+0000","last_change":"2024-09-14T11:25:20.211504+0000","last_active":"2024-09-14T11:56:53.442366+0000","last_peered":"2024-09-14T11:56:53.442366+0000","last_clean":"2024-09-14T11:56:53.442366+0000","last_became_active":"2024-09-14T11:25:20.211190+0000","last_became_peered":"2024-09-14T11:25:20.211190+0000","last_unstale":"2024-09-14T11:56:53.442366+0000","last_undegraded":"2024-09-14T11:56:53.442366+0000","last_fullsized":"2024-09-14T11:56:53.442366+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:02.921907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"263'7","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:58.480804+0000","last_change":"2024-09-14T11:06:45.980127+0000","last_active":"2024-09-14T12:00:58.480804+0000","last_peered":"2024-09-14T12:00:58.480804+0000","last_clean":"2024-09-14T12:00:58.480804+0000","last_became_active":"2024-09-14T11:06:45.979801+0000","last_became_peered":"2024-09-14T11:06:45.979801+0000","last_unstale":"2024-09-14T12:00:58.480804+0000","last_undegraded":"2024-09-14T12:00:58.480804+0000","last_fullsized":"2024-09-14T12:00:58.480804+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:14.264168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"263'5","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.481620+0000","last_change":"2024-09-14T11:06:41.905310+0000","last_active":"2024-09-14T12:01:17.481620+0000","last_peered":"2024-09-14T12:01:17.481620+0000","last_clean":"2024-09-14T12:01:17.481620+0000","last_became_active":"2024-09-14T11:06:41.905007+0000","last_became_peered":"2024-09-14T11:06:41.905007+0000","last_unstale":"2024-09-14T12:01:17.481620+0000","last_undegraded":"2024-09-14T12:01:17.481620+0000","last_fullsized":"2024-09-14T12:01:17.481620+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:37.875569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'31","reported_seq":132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:38.515217+0000","last_change":"2024-09-14T11:02:34.873370+0000","last_active":"2024-09-14T11:57:38.515217+0000","last_peered":"2024-09-14T11:57:38.515217+0000","last_clean":"2024-09-14T11:57:38.515217+0000","last_became_active":"2024-09-14T11:02:34.873091+0000","last_became_peered":"2024-09-14T11:02:34.873091+0000","last_unstale":"2024-09-14T11:57:38.515217+0000","last_undegraded":"2024-09-14T11:57:38.515217+0000","last_fullsized":"2024-09-14T11:57:38.515217+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:05.952366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":154,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.455682+0000","last_change":"2024-09-14T11:25:20.213420+0000","last_active":"2024-09-14T11:59:25.455682+0000","last_peered":"2024-09-14T11:59:25.455682+0000","last_clean":"2024-09-14T11:59:25.455682+0000","last_became_active":"2024-09-14T11:25:20.213064+0000","last_became_peered":"2024-09-14T11:25:20.213064+0000","last_unstale":"2024-09-14T11:59:25.455682+0000","last_undegraded":"2024-09-14T11:59:25.455682+0000","last_fullsized":"2024-09-14T11:59:25.455682+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:55.006063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"263'7","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:55.612856+0000","last_change":"2024-09-14T11:06:45.982348+0000","last_active":"2024-09-14T11:59:55.612856+0000","last_peered":"2024-09-14T11:59:55.612856+0000","last_clean":"2024-09-14T11:59:55.612856+0000","last_became_active":"2024-09-14T11:06:45.977225+0000","last_became_peered":"2024-09-14T11:06:45.977225+0000","last_unstale":"2024-09-14T11:59:55.612856+0000","last_undegraded":"2024-09-14T11:59:55.612856+0000","last_fullsized":"2024-09-14T11:59:55.612856+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:19.723203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20490,"num_write":7,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.447928+0000","last_change":"2024-09-14T11:06:41.916297+0000","last_active":"2024-09-14T11:57:28.447928+0000","last_peered":"2024-09-14T11:57:28.447928+0000","last_clean":"2024-09-14T11:57:28.447928+0000","last_became_active":"2024-09-14T11:06:41.916037+0000","last_became_peered":"2024-09-14T11:06:41.916037+0000","last_unstale":"2024-09-14T11:57:28.447928+0000","last_undegraded":"2024-09-14T11:57:28.447928+0000","last_fullsized":"2024-09-14T11:57:28.447928+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:36.838054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"263'6","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:38.515163+0000","last_change":"2024-09-14T11:02:34.878852+0000","last_active":"2024-09-14T11:57:38.515163+0000","last_peered":"2024-09-14T11:57:38.515163+0000","last_clean":"2024-09-14T11:57:38.515163+0000","last_became_active":"2024-09-14T11:02:34.878477+0000","last_became_peered":"2024-09-14T11:02:34.878477+0000","last_unstale":"2024-09-14T11:57:38.515163+0000","last_undegraded":"2024-09-14T11:57:38.515163+0000","last_fullsized":"2024-09-14T11:57:38.515163+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:50.190261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.648824+0000","last_change":"2024-09-14T11:25:20.211103+0000","last_active":"2024-09-14T11:58:40.648824+0000","last_peered":"2024-09-14T11:58:40.648824+0000","last_clean":"2024-09-14T11:58:40.648824+0000","last_became_active":"2024-09-14T11:25:20.210841+0000","last_became_peered":"2024-09-14T11:25:20.210841+0000","last_unstale":"2024-09-14T11:58:40.648824+0000","last_undegraded":"2024-09-14T11:58:40.648824+0000","last_fullsized":"2024-09-14T11:58:40.648824+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:22.472173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"260'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:30.523488+0000","last_change":"2024-09-14T11:06:45.992541+0000","last_active":"2024-09-14T11:57:30.523488+0000","last_peered":"2024-09-14T11:57:30.523488+0000","last_clean":"2024-09-14T11:57:30.523488+0000","last_became_active":"2024-09-14T11:06:45.992046+0000","last_became_peered":"2024-09-14T11:06:45.992046+0000","last_unstale":"2024-09-14T11:57:30.523488+0000","last_undegraded":"2024-09-14T11:57:30.523488+0000","last_fullsized":"2024-09-14T11:57:30.523488+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:54.123557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:35.524118+0000","last_change":"2024-09-14T11:06:41.909618+0000","last_active":"2024-09-14T11:57:35.524118+0000","last_peered":"2024-09-14T11:57:35.524118+0000","last_clean":"2024-09-14T11:57:35.524118+0000","last_became_active":"2024-09-14T11:06:41.909310+0000","last_became_peered":"2024-09-14T11:06:41.909310+0000","last_unstale":"2024-09-14T11:57:35.524118+0000","last_undegraded":"2024-09-14T11:57:35.524118+0000","last_fullsized":"2024-09-14T11:57:35.524118+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:36.988586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"263'17","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:35.298310+0000","last_change":"2024-09-14T11:02:34.879155+0000","last_active":"2024-09-14T11:57:35.298310+0000","last_peered":"2024-09-14T11:57:35.298310+0000","last_clean":"2024-09-14T11:57:35.298310+0000","last_became_active":"2024-09-14T11:02:34.878859+0000","last_became_peered":"2024-09-14T11:02:34.878859+0000","last_unstale":"2024-09-14T11:57:35.298310+0000","last_undegraded":"2024-09-14T11:57:35.298310+0000","last_fullsized":"2024-09-14T11:57:35.298310+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:06.717501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":82,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.300187+0000","last_change":"2024-09-14T11:25:20.214123+0000","last_active":"2024-09-14T11:57:50.300187+0000","last_peered":"2024-09-14T11:57:50.300187+0000","last_clean":"2024-09-14T11:57:50.300187+0000","last_became_active":"2024-09-14T11:25:20.213540+0000","last_became_peered":"2024-09-14T11:25:20.213540+0000","last_unstale":"2024-09-14T11:57:50.300187+0000","last_undegraded":"2024-09-14T11:57:50.300187+0000","last_fullsized":"2024-09-14T11:57:50.300187+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:22.650940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"260'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.292797+0000","last_change":"2024-09-14T11:06:45.986594+0000","last_active":"2024-09-14T11:56:45.292797+0000","last_peered":"2024-09-14T11:56:45.292797+0000","last_clean":"2024-09-14T11:56:45.292797+0000","last_became_active":"2024-09-14T11:06:45.984536+0000","last_became_peered":"2024-09-14T11:06:45.984536+0000","last_unstale":"2024-09-14T11:56:45.292797+0000","last_undegraded":"2024-09-14T11:56:45.292797+0000","last_fullsized":"2024-09-14T11:56:45.292797+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:50.142830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.592674+0000","last_change":"2024-09-14T11:06:41.917589+0000","last_active":"2024-09-14T11:56:45.592674+0000","last_peered":"2024-09-14T11:56:45.592674+0000","last_clean":"2024-09-14T11:56:45.592674+0000","last_became_active":"2024-09-14T11:06:41.917297+0000","last_became_peered":"2024-09-14T11:06:41.917297+0000","last_unstale":"2024-09-14T11:56:45.592674+0000","last_undegraded":"2024-09-14T11:56:45.592674+0000","last_fullsized":"2024-09-14T11:56:45.592674+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:24.720580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"260'21","reported_seq":118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.445641+0000","last_change":"2024-09-14T11:02:34.877058+0000","last_active":"2024-09-14T11:58:20.445641+0000","last_peered":"2024-09-14T11:58:20.445641+0000","last_clean":"2024-09-14T11:58:20.445641+0000","last_became_active":"2024-09-14T11:02:34.876726+0000","last_became_peered":"2024-09-14T11:02:34.876726+0000","last_unstale":"2024-09-14T11:58:20.445641+0000","last_undegraded":"2024-09-14T11:58:20.445641+0000","last_fullsized":"2024-09-14T11:58:20.445641+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:13.228297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":116,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.599347+0000","last_change":"2024-09-14T11:25:20.214842+0000","last_active":"2024-09-14T11:57:50.599347+0000","last_peered":"2024-09-14T11:57:50.599347+0000","last_clean":"2024-09-14T11:57:50.599347+0000","last_became_active":"2024-09-14T11:25:20.214475+0000","last_became_peered":"2024-09-14T11:25:20.214475+0000","last_unstale":"2024-09-14T11:57:50.599347+0000","last_undegraded":"2024-09-14T11:57:50.599347+0000","last_fullsized":"2024-09-14T11:57:50.599347+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:56.001599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.432562+0000","last_change":"2024-09-14T11:06:45.990723+0000","last_active":"2024-09-14T11:56:45.432562+0000","last_peered":"2024-09-14T11:56:45.432562+0000","last_clean":"2024-09-14T11:56:45.432562+0000","last_became_active":"2024-09-14T11:06:45.990419+0000","last_became_peered":"2024-09-14T11:06:45.990419+0000","last_unstale":"2024-09-14T11:56:45.432562+0000","last_undegraded":"2024-09-14T11:56:45.432562+0000","last_fullsized":"2024-09-14T11:56:45.432562+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:12.253426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"260'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.507306+0000","last_change":"2024-09-14T11:06:41.911568+0000","last_active":"2024-09-14T11:56:43.507306+0000","last_peered":"2024-09-14T11:56:43.507306+0000","last_clean":"2024-09-14T11:56:43.507306+0000","last_became_active":"2024-09-14T11:06:41.910694+0000","last_became_peered":"2024-09-14T11:06:41.910694+0000","last_unstale":"2024-09-14T11:56:43.507306+0000","last_undegraded":"2024-09-14T11:56:43.507306+0000","last_fullsized":"2024-09-14T11:56:43.507306+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:38.517703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"263'21","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:13.520593+0000","last_change":"2024-09-14T11:02:34.873098+0000","last_active":"2024-09-14T11:58:13.520593+0000","last_peered":"2024-09-14T11:58:13.520593+0000","last_clean":"2024-09-14T11:58:13.520593+0000","last_became_active":"2024-09-14T11:02:34.872803+0000","last_became_peered":"2024-09-14T11:02:34.872803+0000","last_unstale":"2024-09-14T11:58:13.520593+0000","last_undegraded":"2024-09-14T11:58:13.520593+0000","last_fullsized":"2024-09-14T11:58:13.520593+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:22.434265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":102,"num_write":56,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:03.453145+0000","last_change":"2024-09-14T11:25:20.208606+0000","last_active":"2024-09-14T11:58:03.453145+0000","last_peered":"2024-09-14T11:58:03.453145+0000","last_clean":"2024-09-14T11:58:03.453145+0000","last_became_active":"2024-09-14T11:25:20.207780+0000","last_became_peered":"2024-09-14T11:25:20.207780+0000","last_unstale":"2024-09-14T11:58:03.453145+0000","last_undegraded":"2024-09-14T11:58:03.453145+0000","last_fullsized":"2024-09-14T11:58:03.453145+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:39.802914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"263'9","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.358375+0000","last_change":"2024-09-14T11:06:45.992867+0000","last_active":"2024-09-14T12:01:18.358375+0000","last_peered":"2024-09-14T12:01:18.358375+0000","last_clean":"2024-09-14T12:01:18.358375+0000","last_became_active":"2024-09-14T11:06:45.992208+0000","last_became_peered":"2024-09-14T11:06:45.992208+0000","last_unstale":"2024-09-14T12:01:18.358375+0000","last_undegraded":"2024-09-14T12:01:18.358375+0000","last_fullsized":"2024-09-14T12:01:18.358375+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:21.488237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":17408,"num_write":14,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"263'8","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:30.546211+0000","last_change":"2024-09-14T11:06:41.915462+0000","last_active":"2024-09-14T12:00:30.546211+0000","last_peered":"2024-09-14T12:00:30.546211+0000","last_clean":"2024-09-14T12:00:30.546211+0000","last_became_active":"2024-09-14T11:06:41.915173+0000","last_became_peered":"2024-09-14T11:06:41.915173+0000","last_unstale":"2024-09-14T12:00:30.546211+0000","last_undegraded":"2024-09-14T12:00:30.546211+0000","last_fullsized":"2024-09-14T12:00:30.546211+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:30.823550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10242,"num_write":13,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"263'15","reported_seq":94,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:10.644198+0000","last_change":"2024-09-14T11:02:34.867951+0000","last_active":"2024-09-14T11:58:10.644198+0000","last_peered":"2024-09-14T11:58:10.644198+0000","last_clean":"2024-09-14T11:58:10.644198+0000","last_became_active":"2024-09-14T11:02:34.867669+0000","last_became_peered":"2024-09-14T11:02:34.867669+0000","last_unstale":"2024-09-14T11:58:10.644198+0000","last_undegraded":"2024-09-14T11:58:10.644198+0000","last_fullsized":"2024-09-14T11:58:10.644198+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:05.093113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":79,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:03.519056+0000","last_change":"2024-09-14T11:25:20.210078+0000","last_active":"2024-09-14T11:58:03.519056+0000","last_peered":"2024-09-14T11:58:03.519056+0000","last_clean":"2024-09-14T11:58:03.519056+0000","last_became_active":"2024-09-14T11:25:20.209801+0000","last_became_peered":"2024-09-14T11:25:20.209801+0000","last_unstale":"2024-09-14T11:58:03.519056+0000","last_undegraded":"2024-09-14T11:58:03.519056+0000","last_fullsized":"2024-09-14T11:58:03.519056+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:20.540163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:18.455327+0000","last_change":"2024-09-14T11:06:45.990540+0000","last_active":"2024-09-14T11:58:18.455327+0000","last_peered":"2024-09-14T11:58:18.455327+0000","last_clean":"2024-09-14T11:58:18.455327+0000","last_became_active":"2024-09-14T11:06:45.990093+0000","last_became_peered":"2024-09-14T11:06:45.990093+0000","last_unstale":"2024-09-14T11:58:18.455327+0000","last_undegraded":"2024-09-14T11:58:18.455327+0000","last_fullsized":"2024-09-14T11:58:18.455327+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:20.070813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"263'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.604354+0000","last_change":"2024-09-14T11:06:41.913660+0000","last_active":"2024-09-14T12:01:17.604354+0000","last_peered":"2024-09-14T12:01:17.604354+0000","last_clean":"2024-09-14T12:01:17.604354+0000","last_became_active":"2024-09-14T11:06:41.913330+0000","last_became_peered":"2024-09-14T11:06:41.913330+0000","last_unstale":"2024-09-14T12:01:17.604354+0000","last_undegraded":"2024-09-14T12:01:17.604354+0000","last_fullsized":"2024-09-14T12:01:17.604354+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:02.767092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"263'51","reported_seq":192,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:10.644171+0000","last_change":"2024-09-14T11:02:34.879784+0000","last_active":"2024-09-14T11:58:10.644171+0000","last_peered":"2024-09-14T11:58:10.644171+0000","last_clean":"2024-09-14T11:58:10.644171+0000","last_became_active":"2024-09-14T11:02:34.879480+0000","last_became_peered":"2024-09-14T11:02:34.879480+0000","last_unstale":"2024-09-14T11:58:10.644171+0000","last_undegraded":"2024-09-14T11:58:10.644171+0000","last_fullsized":"2024-09-14T11:58:10.644171+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:26.792769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":249,"num_write":134,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:00.301161+0000","last_change":"2024-09-14T11:25:20.208545+0000","last_active":"2024-09-14T11:58:00.301161+0000","last_peered":"2024-09-14T11:58:00.301161+0000","last_clean":"2024-09-14T11:58:00.301161+0000","last_became_active":"2024-09-14T11:25:20.208253+0000","last_became_peered":"2024-09-14T11:25:20.208253+0000","last_unstale":"2024-09-14T11:58:00.301161+0000","last_undegraded":"2024-09-14T11:58:00.301161+0000","last_fullsized":"2024-09-14T11:58:00.301161+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:46.409317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:30.439086+0000","last_change":"2024-09-14T11:06:45.986563+0000","last_active":"2024-09-14T11:57:30.439086+0000","last_peered":"2024-09-14T11:57:30.439086+0000","last_clean":"2024-09-14T11:57:30.439086+0000","last_became_active":"2024-09-14T11:06:45.986268+0000","last_became_peered":"2024-09-14T11:06:45.986268+0000","last_unstale":"2024-09-14T11:57:30.439086+0000","last_undegraded":"2024-09-14T11:57:30.439086+0000","last_fullsized":"2024-09-14T11:57:30.439086+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:57.096459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.287810+0000","last_change":"2024-09-14T11:06:41.919231+0000","last_active":"2024-09-14T12:01:18.287810+0000","last_peered":"2024-09-14T12:01:18.287810+0000","last_clean":"2024-09-14T12:01:18.287810+0000","last_became_active":"2024-09-14T11:06:41.918902+0000","last_became_peered":"2024-09-14T11:06:41.918902+0000","last_unstale":"2024-09-14T12:01:18.287810+0000","last_undegraded":"2024-09-14T12:01:18.287810+0000","last_fullsized":"2024-09-14T12:01:18.287810+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:28.218893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"263'3","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:10.444411+0000","last_change":"2024-09-14T11:02:34.877942+0000","last_active":"2024-09-14T11:58:10.444411+0000","last_peered":"2024-09-14T11:58:10.444411+0000","last_clean":"2024-09-14T11:58:10.444411+0000","last_became_active":"2024-09-14T11:02:34.877623+0000","last_became_peered":"2024-09-14T11:02:34.877623+0000","last_unstale":"2024-09-14T11:58:10.444411+0000","last_undegraded":"2024-09-14T11:58:10.444411+0000","last_fullsized":"2024-09-14T11:58:10.444411+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:37.635532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:00.600265+0000","last_change":"2024-09-14T11:25:20.208685+0000","last_active":"2024-09-14T11:58:00.600265+0000","last_peered":"2024-09-14T11:58:00.600265+0000","last_clean":"2024-09-14T11:58:00.600265+0000","last_became_active":"2024-09-14T11:25:20.208411+0000","last_became_peered":"2024-09-14T11:25:20.208411+0000","last_unstale":"2024-09-14T11:58:00.600265+0000","last_undegraded":"2024-09-14T11:58:00.600265+0000","last_fullsized":"2024-09-14T11:58:00.600265+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:34.443942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:30.597082+0000","last_change":"2024-09-14T11:06:45.978750+0000","last_active":"2024-09-14T11:57:30.597082+0000","last_peered":"2024-09-14T11:57:30.597082+0000","last_clean":"2024-09-14T11:57:30.597082+0000","last_became_active":"2024-09-14T11:06:45.978458+0000","last_became_peered":"2024-09-14T11:06:45.978458+0000","last_unstale":"2024-09-14T11:57:30.597082+0000","last_undegraded":"2024-09-14T11:57:30.597082+0000","last_fullsized":"2024-09-14T11:57:30.597082+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:52.428245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:53.471119+0000","last_change":"2024-09-14T11:06:41.916068+0000","last_active":"2024-09-14T11:59:53.471119+0000","last_peered":"2024-09-14T11:59:53.471119+0000","last_clean":"2024-09-14T11:59:53.471119+0000","last_became_active":"2024-09-14T11:06:41.915795+0000","last_became_peered":"2024-09-14T11:06:41.915795+0000","last_unstale":"2024-09-14T11:59:53.471119+0000","last_undegraded":"2024-09-14T11:59:53.471119+0000","last_fullsized":"2024-09-14T11:59:53.471119+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:10.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"263'20","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.531842+0000","last_change":"2024-09-14T11:02:34.881678+0000","last_active":"2024-09-14T11:58:40.531842+0000","last_peered":"2024-09-14T11:58:40.531842+0000","last_clean":"2024-09-14T11:58:40.531842+0000","last_became_active":"2024-09-14T11:02:34.881333+0000","last_became_peered":"2024-09-14T11:02:34.881333+0000","last_unstale":"2024-09-14T11:58:40.531842+0000","last_undegraded":"2024-09-14T11:58:40.531842+0000","last_fullsized":"2024-09-14T11:58:40.531842+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:25.506302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":49,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.441698+0000","last_change":"2024-09-14T11:25:20.209663+0000","last_active":"2024-09-14T11:56:48.441698+0000","last_peered":"2024-09-14T11:56:48.441698+0000","last_clean":"2024-09-14T11:56:48.441698+0000","last_became_active":"2024-09-14T11:25:20.209369+0000","last_became_peered":"2024-09-14T11:25:20.209369+0000","last_unstale":"2024-09-14T11:56:48.441698+0000","last_undegraded":"2024-09-14T11:56:48.441698+0000","last_fullsized":"2024-09-14T11:56:48.441698+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:58.938617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:08.453886+0000","last_change":"2024-09-14T11:06:45.981996+0000","last_active":"2024-09-14T11:58:08.453886+0000","last_peered":"2024-09-14T11:58:08.453886+0000","last_clean":"2024-09-14T11:58:08.453886+0000","last_became_active":"2024-09-14T11:06:45.980211+0000","last_became_peered":"2024-09-14T11:06:45.980211+0000","last_unstale":"2024-09-14T11:58:08.453886+0000","last_undegraded":"2024-09-14T11:58:08.453886+0000","last_fullsized":"2024-09-14T11:58:08.453886+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:03.580856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.403612+0000","last_change":"2024-09-14T11:06:41.903200+0000","last_active":"2024-09-14T11:58:05.403612+0000","last_peered":"2024-09-14T11:58:05.403612+0000","last_clean":"2024-09-14T11:58:05.403612+0000","last_became_active":"2024-09-14T11:06:41.902894+0000","last_became_peered":"2024-09-14T11:06:41.902894+0000","last_unstale":"2024-09-14T11:58:05.403612+0000","last_undegraded":"2024-09-14T11:58:05.403612+0000","last_fullsized":"2024-09-14T11:58:05.403612+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:39.369082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"260'15","reported_seq":101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:35.531184+0000","last_change":"2024-09-14T11:02:34.873962+0000","last_active":"2024-09-14T11:58:35.531184+0000","last_peered":"2024-09-14T11:58:35.531184+0000","last_clean":"2024-09-14T11:58:35.531184+0000","last_became_active":"2024-09-14T11:02:34.873660+0000","last_became_peered":"2024-09-14T11:02:34.873660+0000","last_unstale":"2024-09-14T11:58:35.531184+0000","last_undegraded":"2024-09-14T11:58:35.531184+0000","last_fullsized":"2024-09-14T11:58:35.531184+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:08.878693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":83,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.508214+0000","last_change":"2024-09-14T11:25:20.210810+0000","last_active":"2024-09-14T11:56:48.508214+0000","last_peered":"2024-09-14T11:56:48.508214+0000","last_clean":"2024-09-14T11:56:48.508214+0000","last_became_active":"2024-09-14T11:25:20.210534+0000","last_became_peered":"2024-09-14T11:25:20.210534+0000","last_unstale":"2024-09-14T11:56:48.508214+0000","last_undegraded":"2024-09-14T11:56:48.508214+0000","last_fullsized":"2024-09-14T11:56:48.508214+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:04.144981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:08.453853+0000","last_change":"2024-09-14T11:06:45.985239+0000","last_active":"2024-09-14T11:58:08.453853+0000","last_peered":"2024-09-14T11:58:08.453853+0000","last_clean":"2024-09-14T11:58:08.453853+0000","last_became_active":"2024-09-14T11:06:45.984993+0000","last_became_peered":"2024-09-14T11:06:45.984993+0000","last_unstale":"2024-09-14T11:58:08.453853+0000","last_undegraded":"2024-09-14T11:58:08.453853+0000","last_fullsized":"2024-09-14T11:58:08.453853+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:26.543636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"263'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:23.475632+0000","last_change":"2024-09-14T11:06:41.910546+0000","last_active":"2024-09-14T12:00:23.475632+0000","last_peered":"2024-09-14T12:00:23.475632+0000","last_clean":"2024-09-14T12:00:23.475632+0000","last_became_active":"2024-09-14T11:06:41.910286+0000","last_became_peered":"2024-09-14T11:06:41.910286+0000","last_unstale":"2024-09-14T12:00:23.475632+0000","last_undegraded":"2024-09-14T12:00:23.475632+0000","last_fullsized":"2024-09-14T12:00:23.475632+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:00.405940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"263'55","reported_seq":203,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:35.447992+0000","last_change":"2024-09-14T11:02:34.873185+0000","last_active":"2024-09-14T11:58:35.447992+0000","last_peered":"2024-09-14T11:58:35.447992+0000","last_clean":"2024-09-14T11:58:35.447992+0000","last_became_active":"2024-09-14T11:02:34.872911+0000","last_became_peered":"2024-09-14T11:02:34.872911+0000","last_unstale":"2024-09-14T11:58:35.447992+0000","last_undegraded":"2024-09-14T11:58:35.447992+0000","last_fullsized":"2024-09-14T11:58:35.447992+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:20.423924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":434,"num_read_kb":298,"num_write":132,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.643221+0000","last_change":"2024-09-14T11:25:20.210573+0000","last_active":"2024-09-14T11:58:05.643221+0000","last_peered":"2024-09-14T11:58:05.643221+0000","last_clean":"2024-09-14T11:58:05.643221+0000","last_became_active":"2024-09-14T11:25:20.209547+0000","last_became_peered":"2024-09-14T11:25:20.209547+0000","last_unstale":"2024-09-14T11:58:05.643221+0000","last_undegraded":"2024-09-14T11:58:05.643221+0000","last_fullsized":"2024-09-14T11:58:05.643221+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:48.503085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:25.464893+0000","last_change":"2024-09-14T11:06:45.984844+0000","last_active":"2024-09-14T12:00:25.464893+0000","last_peered":"2024-09-14T12:00:25.464893+0000","last_clean":"2024-09-14T12:00:25.464893+0000","last_became_active":"2024-09-14T11:06:45.984527+0000","last_became_peered":"2024-09-14T11:06:45.984527+0000","last_unstale":"2024-09-14T12:00:25.464893+0000","last_undegraded":"2024-09-14T12:00:25.464893+0000","last_fullsized":"2024-09-14T12:00:25.464893+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:00.029592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"260'9","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.403653+0000","last_change":"2024-09-14T11:06:41.905789+0000","last_active":"2024-09-14T11:58:05.403653+0000","last_peered":"2024-09-14T11:58:05.403653+0000","last_clean":"2024-09-14T11:58:05.403653+0000","last_became_active":"2024-09-14T11:06:41.905088+0000","last_became_peered":"2024-09-14T11:06:41.905088+0000","last_unstale":"2024-09-14T11:58:05.403653+0000","last_undegraded":"2024-09-14T11:58:05.403653+0000","last_fullsized":"2024-09-14T11:58:05.403653+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:26.152725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17408,"num_write":9,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'36","reported_seq":152,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:35.304813+0000","last_change":"2024-09-14T11:02:34.873841+0000","last_active":"2024-09-14T11:58:35.304813+0000","last_peered":"2024-09-14T11:58:35.304813+0000","last_clean":"2024-09-14T11:58:35.304813+0000","last_became_active":"2024-09-14T11:02:34.873560+0000","last_became_peered":"2024-09-14T11:02:34.873560+0000","last_unstale":"2024-09-14T11:58:35.304813+0000","last_undegraded":"2024-09-14T11:58:35.304813+0000","last_fullsized":"2024-09-14T11:58:35.304813+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:07.656019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":270,"num_read_kb":162,"num_write":93,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.508186+0000","last_change":"2024-09-14T11:25:20.206947+0000","last_active":"2024-09-14T11:56:48.508186+0000","last_peered":"2024-09-14T11:56:48.508186+0000","last_clean":"2024-09-14T11:56:48.508186+0000","last_became_active":"2024-09-14T11:25:20.206692+0000","last_became_peered":"2024-09-14T11:25:20.206692+0000","last_unstale":"2024-09-14T11:56:48.508186+0000","last_undegraded":"2024-09-14T11:56:48.508186+0000","last_fullsized":"2024-09-14T11:56:48.508186+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:46.331575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.527582+0000","last_change":"2024-09-14T11:06:45.985776+0000","last_active":"2024-09-14T11:58:05.527582+0000","last_peered":"2024-09-14T11:58:05.527582+0000","last_clean":"2024-09-14T11:58:05.527582+0000","last_became_active":"2024-09-14T11:06:45.985436+0000","last_became_peered":"2024-09-14T11:06:45.985436+0000","last_unstale":"2024-09-14T11:58:05.527582+0000","last_undegraded":"2024-09-14T11:58:05.527582+0000","last_fullsized":"2024-09-14T11:58:05.527582+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:18.777447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.481613+0000","last_change":"2024-09-14T11:06:41.908095+0000","last_active":"2024-09-14T12:01:17.481613+0000","last_peered":"2024-09-14T12:01:17.481613+0000","last_clean":"2024-09-14T12:01:17.481613+0000","last_became_active":"2024-09-14T11:06:41.907791+0000","last_became_peered":"2024-09-14T11:06:41.907791+0000","last_unstale":"2024-09-14T12:01:17.481613+0000","last_undegraded":"2024-09-14T12:01:17.481613+0000","last_fullsized":"2024-09-14T12:01:17.481613+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:19.380573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5124,"num_write":5,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"263'33","reported_seq":149,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:35.447954+0000","last_change":"2024-09-14T11:02:34.876400+0000","last_active":"2024-09-14T11:58:35.447954+0000","last_peered":"2024-09-14T11:58:35.447954+0000","last_clean":"2024-09-14T11:58:35.447954+0000","last_became_active":"2024-09-14T11:02:34.876080+0000","last_became_peered":"2024-09-14T11:02:34.876080+0000","last_unstale":"2024-09-14T11:58:35.447954+0000","last_undegraded":"2024-09-14T11:58:35.447954+0000","last_fullsized":"2024-09-14T11:58:35.447954+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:45.087546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":186,"num_write":88,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:58.452425+0000","last_change":"2024-09-14T11:25:20.205656+0000","last_active":"2024-09-14T11:57:58.452425+0000","last_peered":"2024-09-14T11:57:58.452425+0000","last_clean":"2024-09-14T11:57:58.452425+0000","last_became_active":"2024-09-14T11:25:20.205335+0000","last_became_peered":"2024-09-14T11:25:20.205335+0000","last_unstale":"2024-09-14T11:57:58.452425+0000","last_undegraded":"2024-09-14T11:57:58.452425+0000","last_fullsized":"2024-09-14T11:57:58.452425+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:12.896781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:30.447384+0000","last_change":"2024-09-14T11:06:45.986506+0000","last_active":"2024-09-14T11:58:30.447384+0000","last_peered":"2024-09-14T11:58:30.447384+0000","last_clean":"2024-09-14T11:58:30.447384+0000","last_became_active":"2024-09-14T11:06:45.986225+0000","last_became_peered":"2024-09-14T11:06:45.986225+0000","last_unstale":"2024-09-14T11:58:30.447384+0000","last_undegraded":"2024-09-14T11:58:30.447384+0000","last_fullsized":"2024-09-14T11:58:30.447384+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:18.018900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"263'3","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:45.320227+0000","last_change":"2024-09-14T11:06:41.903610+0000","last_active":"2024-09-14T12:00:45.320227+0000","last_peered":"2024-09-14T12:00:45.320227+0000","last_clean":"2024-09-14T12:00:45.320227+0000","last_became_active":"2024-09-14T11:06:41.903188+0000","last_became_peered":"2024-09-14T11:06:41.903188+0000","last_unstale":"2024-09-14T12:00:45.320227+0000","last_undegraded":"2024-09-14T12:00:45.320227+0000","last_fullsized":"2024-09-14T12:00:45.320227+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:45.086214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"263'55","reported_seq":202,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.451654+0000","last_change":"2024-09-14T11:02:34.878079+0000","last_active":"2024-09-14T11:59:00.451654+0000","last_peered":"2024-09-14T11:59:00.451654+0000","last_clean":"2024-09-14T11:59:00.451654+0000","last_became_active":"2024-09-14T11:02:34.877631+0000","last_became_peered":"2024-09-14T11:02:34.877631+0000","last_unstale":"2024-09-14T11:59:00.451654+0000","last_undegraded":"2024-09-14T11:59:00.451654+0000","last_fullsized":"2024-09-14T11:59:00.451654+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:50.183737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":260,"num_write":147,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.409942+0000","last_change":"2024-09-14T11:25:20.203431+0000","last_active":"2024-09-14T11:59:05.409942+0000","last_peered":"2024-09-14T11:59:05.409942+0000","last_clean":"2024-09-14T11:59:05.409942+0000","last_became_active":"2024-09-14T11:25:20.200061+0000","last_became_peered":"2024-09-14T11:25:20.200061+0000","last_unstale":"2024-09-14T11:59:05.409942+0000","last_undegraded":"2024-09-14T11:59:05.409942+0000","last_fullsized":"2024-09-14T11:59:05.409942+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:15.179721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:45.467828+0000","last_change":"2024-09-14T11:06:45.991468+0000","last_active":"2024-09-14T12:00:45.467828+0000","last_peered":"2024-09-14T12:00:45.467828+0000","last_clean":"2024-09-14T12:00:45.467828+0000","last_became_active":"2024-09-14T11:06:45.991198+0000","last_became_peered":"2024-09-14T11:06:45.991198+0000","last_unstale":"2024-09-14T12:00:45.467828+0000","last_undegraded":"2024-09-14T12:00:45.467828+0000","last_fullsized":"2024-09-14T12:00:45.467828+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:02.331809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"263'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:43.542221+0000","last_change":"2024-09-14T11:06:41.910787+0000","last_active":"2024-09-14T12:00:43.542221+0000","last_peered":"2024-09-14T12:00:43.542221+0000","last_clean":"2024-09-14T12:00:43.542221+0000","last_became_active":"2024-09-14T11:06:41.910512+0000","last_became_peered":"2024-09-14T11:06:41.910512+0000","last_unstale":"2024-09-14T12:00:43.542221+0000","last_undegraded":"2024-09-14T12:00:43.542221+0000","last_fullsized":"2024-09-14T12:00:43.542221+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:20.996429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"263'44","reported_seq":172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.533064+0000","last_change":"2024-09-14T11:02:34.881693+0000","last_active":"2024-09-14T11:58:50.533064+0000","last_peered":"2024-09-14T11:58:50.533064+0000","last_clean":"2024-09-14T11:58:50.533064+0000","last_became_active":"2024-09-14T11:02:34.881341+0000","last_became_peered":"2024-09-14T11:02:34.881341+0000","last_unstale":"2024-09-14T11:58:50.533064+0000","last_undegraded":"2024-09-14T11:58:50.533064+0000","last_fullsized":"2024-09-14T11:58:50.533064+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:36.323501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":339,"num_read_kb":228,"num_write":117,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.525849+0000","last_change":"2024-09-14T11:25:20.210429+0000","last_active":"2024-09-14T11:57:50.525849+0000","last_peered":"2024-09-14T11:57:50.525849+0000","last_clean":"2024-09-14T11:57:50.525849+0000","last_became_active":"2024-09-14T11:25:20.210117+0000","last_became_peered":"2024-09-14T11:25:20.210117+0000","last_unstale":"2024-09-14T11:57:50.525849+0000","last_undegraded":"2024-09-14T11:57:50.525849+0000","last_fullsized":"2024-09-14T11:57:50.525849+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:07.063593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'6","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.152467+0000","last_change":"2024-09-14T11:06:45.992869+0000","last_active":"2024-09-14T12:01:18.152467+0000","last_peered":"2024-09-14T12:01:18.152467+0000","last_clean":"2024-09-14T12:01:18.152467+0000","last_became_active":"2024-09-14T11:06:45.992574+0000","last_became_peered":"2024-09-14T11:06:45.992574+0000","last_unstale":"2024-09-14T12:01:18.152467+0000","last_undegraded":"2024-09-14T12:01:18.152467+0000","last_fullsized":"2024-09-14T12:01:18.152467+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:58.347483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:30.447415+0000","last_change":"2024-09-14T11:06:41.919642+0000","last_active":"2024-09-14T11:58:30.447415+0000","last_peered":"2024-09-14T11:58:30.447415+0000","last_clean":"2024-09-14T11:58:30.447415+0000","last_became_active":"2024-09-14T11:06:41.919330+0000","last_became_peered":"2024-09-14T11:06:41.919330+0000","last_unstale":"2024-09-14T11:58:30.447415+0000","last_undegraded":"2024-09-14T11:58:30.447415+0000","last_fullsized":"2024-09-14T11:58:30.447415+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:18.967454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"263'112","reported_seq":390,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.408228+0000","last_change":"2024-09-14T11:02:34.873664+0000","last_active":"2024-09-14T11:58:50.408228+0000","last_peered":"2024-09-14T11:58:50.408228+0000","last_clean":"2024-09-14T11:58:50.408228+0000","last_became_active":"2024-09-14T11:02:34.873360+0000","last_became_peered":"2024-09-14T11:02:34.873360+0000","last_unstale":"2024-09-14T11:58:50.408228+0000","last_undegraded":"2024-09-14T11:58:50.408228+0000","last_fullsized":"2024-09-14T11:58:50.408228+0000","mapping_epoch":252,"log_start":"263'100","ondisk_log_start":"263'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:33.431081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1014,"num_read_kb":809,"num_write":225,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.401985+0000","last_change":"2024-09-14T11:25:20.200172+0000","last_active":"2024-09-14T11:57:50.401985+0000","last_peered":"2024-09-14T11:57:50.401985+0000","last_clean":"2024-09-14T11:57:50.401985+0000","last_became_active":"2024-09-14T11:25:20.199875+0000","last_became_peered":"2024-09-14T11:25:20.199875+0000","last_unstale":"2024-09-14T11:57:50.401985+0000","last_undegraded":"2024-09-14T11:57:50.401985+0000","last_fullsized":"2024-09-14T11:57:50.401985+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:26.854076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"260'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:33.457900+0000","last_change":"2024-09-14T11:06:45.980652+0000","last_active":"2024-09-14T11:58:33.457900+0000","last_peered":"2024-09-14T11:58:33.457900+0000","last_clean":"2024-09-14T11:58:33.457900+0000","last_became_active":"2024-09-14T11:06:45.980035+0000","last_became_peered":"2024-09-14T11:06:45.980035+0000","last_unstale":"2024-09-14T11:58:33.457900+0000","last_undegraded":"2024-09-14T11:58:33.457900+0000","last_fullsized":"2024-09-14T11:58:33.457900+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:36.733533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:55.469343+0000","last_change":"2024-09-14T11:06:41.917633+0000","last_active":"2024-09-14T12:00:55.469343+0000","last_peered":"2024-09-14T12:00:55.469343+0000","last_clean":"2024-09-14T12:00:55.469343+0000","last_became_active":"2024-09-14T11:06:41.917341+0000","last_became_peered":"2024-09-14T11:06:41.917341+0000","last_unstale":"2024-09-14T12:00:55.469343+0000","last_undegraded":"2024-09-14T12:00:55.469343+0000","last_fullsized":"2024-09-14T12:00:55.469343+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:27.626042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"260'15","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.526593+0000","last_change":"2024-09-14T11:02:34.876368+0000","last_active":"2024-09-14T11:58:53.526593+0000","last_peered":"2024-09-14T11:58:53.526593+0000","last_clean":"2024-09-14T11:58:53.526593+0000","last_became_active":"2024-09-14T11:02:34.876078+0000","last_became_peered":"2024-09-14T11:02:34.876078+0000","last_unstale":"2024-09-14T11:58:53.526593+0000","last_undegraded":"2024-09-14T11:58:53.526593+0000","last_fullsized":"2024-09-14T11:58:53.526593+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:14.606877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":83,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.463810+0000","last_change":"2024-09-14T11:25:20.210430+0000","last_active":"2024-09-14T11:59:08.463810+0000","last_peered":"2024-09-14T11:59:08.463810+0000","last_clean":"2024-09-14T11:59:08.463810+0000","last_became_active":"2024-09-14T11:25:20.210181+0000","last_became_peered":"2024-09-14T11:25:20.210181+0000","last_unstale":"2024-09-14T11:59:08.463810+0000","last_undegraded":"2024-09-14T11:59:08.463810+0000","last_fullsized":"2024-09-14T11:59:08.463810+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:56.596921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.532365+0000","last_change":"2024-09-14T11:06:45.984990+0000","last_active":"2024-09-14T11:58:45.532365+0000","last_peered":"2024-09-14T11:58:45.532365+0000","last_clean":"2024-09-14T11:58:45.532365+0000","last_became_active":"2024-09-14T11:06:45.984696+0000","last_became_peered":"2024-09-14T11:06:45.984696+0000","last_unstale":"2024-09-14T11:58:45.532365+0000","last_undegraded":"2024-09-14T11:58:45.532365+0000","last_fullsized":"2024-09-14T11:58:45.532365+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:17.939743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"263'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:55.469166+0000","last_change":"2024-09-14T11:06:41.914553+0000","last_active":"2024-09-14T12:00:55.469166+0000","last_peered":"2024-09-14T12:00:55.469166+0000","last_clean":"2024-09-14T12:00:55.469166+0000","last_became_active":"2024-09-14T11:06:41.914209+0000","last_became_peered":"2024-09-14T11:06:41.914209+0000","last_unstale":"2024-09-14T12:00:55.469166+0000","last_undegraded":"2024-09-14T12:00:55.469166+0000","last_fullsized":"2024-09-14T12:00:55.469166+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:46.262011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"263'35","reported_seq":148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.526513+0000","last_change":"2024-09-14T11:02:34.880131+0000","last_active":"2024-09-14T11:58:53.526513+0000","last_peered":"2024-09-14T11:58:53.526513+0000","last_clean":"2024-09-14T11:58:53.526513+0000","last_became_active":"2024-09-14T11:02:34.879834+0000","last_became_peered":"2024-09-14T11:02:34.879834+0000","last_unstale":"2024-09-14T11:58:53.526513+0000","last_undegraded":"2024-09-14T11:58:53.526513+0000","last_fullsized":"2024-09-14T11:58:53.526513+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:06.529921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":172,"num_write":95,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.308579+0000","last_change":"2024-09-14T11:25:20.205157+0000","last_active":"2024-09-14T11:59:10.308579+0000","last_peered":"2024-09-14T11:59:10.308579+0000","last_clean":"2024-09-14T11:59:10.308579+0000","last_became_active":"2024-09-14T11:25:20.204834+0000","last_became_peered":"2024-09-14T11:25:20.204834+0000","last_unstale":"2024-09-14T11:59:10.308579+0000","last_undegraded":"2024-09-14T11:59:10.308579+0000","last_fullsized":"2024-09-14T11:59:10.308579+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.305849+0000","last_change":"2024-09-14T11:06:45.986635+0000","last_active":"2024-09-14T11:58:45.305849+0000","last_peered":"2024-09-14T11:58:45.305849+0000","last_clean":"2024-09-14T11:58:45.305849+0000","last_became_active":"2024-09-14T11:06:45.984865+0000","last_became_peered":"2024-09-14T11:06:45.984865+0000","last_unstale":"2024-09-14T11:58:45.305849+0000","last_undegraded":"2024-09-14T11:58:45.305849+0000","last_fullsized":"2024-09-14T11:58:45.305849+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:51.926620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"260'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:43.459476+0000","last_change":"2024-09-14T11:06:41.909800+0000","last_active":"2024-09-14T11:58:43.459476+0000","last_peered":"2024-09-14T11:58:43.459476+0000","last_clean":"2024-09-14T11:58:43.459476+0000","last_became_active":"2024-09-14T11:06:41.909533+0000","last_became_peered":"2024-09-14T11:06:41.909533+0000","last_unstale":"2024-09-14T11:58:43.459476+0000","last_undegraded":"2024-09-14T11:58:43.459476+0000","last_fullsized":"2024-09-14T11:58:43.459476+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:38.325179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"263'25","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.308510+0000","last_change":"2024-09-14T11:02:34.873554+0000","last_active":"2024-09-14T11:59:10.308510+0000","last_peered":"2024-09-14T11:59:10.308510+0000","last_clean":"2024-09-14T11:59:10.308510+0000","last_became_active":"2024-09-14T11:02:34.873259+0000","last_became_peered":"2024-09-14T11:02:34.873259+0000","last_unstale":"2024-09-14T11:59:10.308510+0000","last_undegraded":"2024-09-14T11:59:10.308510+0000","last_fullsized":"2024-09-14T11:59:10.308510+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:05.178830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":129,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.607073+0000","last_change":"2024-09-14T11:25:20.212620+0000","last_active":"2024-09-14T11:59:05.607073+0000","last_peered":"2024-09-14T11:59:05.607073+0000","last_clean":"2024-09-14T11:59:05.607073+0000","last_became_active":"2024-09-14T11:25:20.212293+0000","last_became_peered":"2024-09-14T11:25:20.212293+0000","last_unstale":"2024-09-14T11:59:05.607073+0000","last_undegraded":"2024-09-14T11:59:05.607073+0000","last_fullsized":"2024-09-14T11:59:05.607073+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:10.346864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:33.523575+0000","last_change":"2024-09-14T11:06:45.986687+0000","last_active":"2024-09-14T11:58:33.523575+0000","last_peered":"2024-09-14T11:58:33.523575+0000","last_clean":"2024-09-14T11:58:33.523575+0000","last_became_active":"2024-09-14T11:06:45.986398+0000","last_became_peered":"2024-09-14T11:06:45.986398+0000","last_unstale":"2024-09-14T11:58:33.523575+0000","last_undegraded":"2024-09-14T11:58:33.523575+0000","last_fullsized":"2024-09-14T11:58:33.523575+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:28.445077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"260'10","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.450778+0000","last_change":"2024-09-14T11:06:41.915770+0000","last_active":"2024-09-14T11:58:55.450778+0000","last_peered":"2024-09-14T11:58:55.450778+0000","last_clean":"2024-09-14T11:58:55.450778+0000","last_became_active":"2024-09-14T11:06:41.915491+0000","last_became_peered":"2024-09-14T11:06:41.915491+0000","last_unstale":"2024-09-14T11:58:55.450778+0000","last_undegraded":"2024-09-14T11:58:55.450778+0000","last_fullsized":"2024-09-14T11:58:55.450778+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:33.737820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":40964,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"260'12","reported_seq":91,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.462030+0000","last_change":"2024-09-14T11:02:34.872228+0000","last_active":"2024-09-14T11:58:58.462030+0000","last_peered":"2024-09-14T11:58:58.462030+0000","last_clean":"2024-09-14T11:58:58.462030+0000","last_became_active":"2024-09-14T11:02:34.871352+0000","last_became_peered":"2024-09-14T11:02:34.871352+0000","last_unstale":"2024-09-14T11:58:58.462030+0000","last_undegraded":"2024-09-14T11:58:58.462030+0000","last_fullsized":"2024-09-14T11:58:58.462030+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:29.511969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.452308+0000","last_change":"2024-09-14T11:25:20.214092+0000","last_active":"2024-09-14T11:59:05.452308+0000","last_peered":"2024-09-14T11:59:05.452308+0000","last_clean":"2024-09-14T11:59:05.452308+0000","last_became_active":"2024-09-14T11:25:20.213785+0000","last_became_peered":"2024-09-14T11:25:20.213785+0000","last_unstale":"2024-09-14T11:59:05.452308+0000","last_undegraded":"2024-09-14T11:59:05.452308+0000","last_fullsized":"2024-09-14T11:59:05.452308+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:56.298725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"260'2","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.605100+0000","last_change":"2024-09-14T11:06:45.981838+0000","last_active":"2024-09-14T11:58:45.605100+0000","last_peered":"2024-09-14T11:58:45.605100+0000","last_clean":"2024-09-14T11:58:45.605100+0000","last_became_active":"2024-09-14T11:06:45.981476+0000","last_became_peered":"2024-09-14T11:06:45.981476+0000","last_unstale":"2024-09-14T11:58:45.605100+0000","last_undegraded":"2024-09-14T11:58:45.605100+0000","last_fullsized":"2024-09-14T11:58:45.605100+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:58.441972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"260'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:30.530578+0000","last_change":"2024-09-14T11:06:41.911683+0000","last_active":"2024-09-14T11:58:30.530578+0000","last_peered":"2024-09-14T11:58:30.530578+0000","last_clean":"2024-09-14T11:58:30.530578+0000","last_became_active":"2024-09-14T11:06:41.911413+0000","last_became_peered":"2024-09-14T11:06:41.911413+0000","last_unstale":"2024-09-14T11:58:30.530578+0000","last_undegraded":"2024-09-14T11:58:30.530578+0000","last_fullsized":"2024-09-14T11:58:30.530578+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:52.497275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"263'38","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.606077+0000","last_change":"2024-09-14T11:02:34.879059+0000","last_active":"2024-09-14T11:58:55.606077+0000","last_peered":"2024-09-14T11:58:55.606077+0000","last_clean":"2024-09-14T11:58:55.606077+0000","last_became_active":"2024-09-14T11:02:34.878752+0000","last_became_peered":"2024-09-14T11:02:34.878752+0000","last_unstale":"2024-09-14T11:58:55.606077+0000","last_undegraded":"2024-09-14T11:58:55.606077+0000","last_fullsized":"2024-09-14T11:58:55.606077+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:34.432738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":231,"num_write":89,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.604290+0000","last_change":"2024-09-14T11:25:20.211271+0000","last_active":"2024-09-14T11:58:40.604290+0000","last_peered":"2024-09-14T11:58:40.604290+0000","last_clean":"2024-09-14T11:58:40.604290+0000","last_became_active":"2024-09-14T11:25:20.210999+0000","last_became_peered":"2024-09-14T11:25:20.210999+0000","last_unstale":"2024-09-14T11:58:40.604290+0000","last_undegraded":"2024-09-14T11:58:40.604290+0000","last_fullsized":"2024-09-14T11:58:40.604290+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:13.729258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.462863+0000","last_change":"2024-09-14T11:06:45.982956+0000","last_active":"2024-09-14T11:59:03.462863+0000","last_peered":"2024-09-14T11:59:03.462863+0000","last_clean":"2024-09-14T11:59:03.462863+0000","last_became_active":"2024-09-14T11:06:45.982181+0000","last_became_peered":"2024-09-14T11:06:45.982181+0000","last_unstale":"2024-09-14T11:59:03.462863+0000","last_undegraded":"2024-09-14T11:59:03.462863+0000","last_fullsized":"2024-09-14T11:59:03.462863+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:18.506633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.533019+0000","last_change":"2024-09-14T11:06:41.914378+0000","last_active":"2024-09-14T11:58:50.533019+0000","last_peered":"2024-09-14T11:58:50.533019+0000","last_clean":"2024-09-14T11:58:50.533019+0000","last_became_active":"2024-09-14T11:06:41.913192+0000","last_became_peered":"2024-09-14T11:06:41.913192+0000","last_unstale":"2024-09-14T11:58:50.533019+0000","last_undegraded":"2024-09-14T11:58:50.533019+0000","last_fullsized":"2024-09-14T11:58:50.533019+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:24.679035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"263'32","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.650978+0000","last_change":"2024-09-14T11:02:34.874602+0000","last_active":"2024-09-14T11:58:55.650978+0000","last_peered":"2024-09-14T11:58:55.650978+0000","last_clean":"2024-09-14T11:58:55.650978+0000","last_became_active":"2024-09-14T11:02:34.874328+0000","last_became_peered":"2024-09-14T11:02:34.874328+0000","last_unstale":"2024-09-14T11:58:55.650978+0000","last_undegraded":"2024-09-14T11:58:55.650978+0000","last_fullsized":"2024-09-14T11:58:55.650978+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:09.428522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":246,"num_read_kb":166,"num_write":81,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.604315+0000","last_change":"2024-09-14T11:25:20.213871+0000","last_active":"2024-09-14T11:58:40.604315+0000","last_peered":"2024-09-14T11:58:40.604315+0000","last_clean":"2024-09-14T11:58:40.604315+0000","last_became_active":"2024-09-14T11:25:20.213577+0000","last_became_peered":"2024-09-14T11:25:20.213577+0000","last_unstale":"2024-09-14T11:58:40.604315+0000","last_undegraded":"2024-09-14T11:58:40.604315+0000","last_fullsized":"2024-09-14T11:58:40.604315+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:03.148226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"263'10","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.842742+0000","last_change":"2024-09-14T11:06:45.991127+0000","last_active":"2024-09-14T12:01:17.842742+0000","last_peered":"2024-09-14T12:01:17.842742+0000","last_clean":"2024-09-14T12:01:17.842742+0000","last_became_active":"2024-09-14T11:06:45.990855+0000","last_became_peered":"2024-09-14T11:06:45.990855+0000","last_unstale":"2024-09-14T12:01:17.842742+0000","last_undegraded":"2024-09-14T12:01:17.842742+0000","last_fullsized":"2024-09-14T12:01:17.842742+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:28.658329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6246,"num_write":20,"num_write_kb":2098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"263'8","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:10.670577+0000","last_change":"2024-09-14T11:06:41.913753+0000","last_active":"2024-09-14T12:01:10.670577+0000","last_peered":"2024-09-14T12:01:10.670577+0000","last_clean":"2024-09-14T12:01:10.670577+0000","last_became_active":"2024-09-14T11:06:41.913454+0000","last_became_peered":"2024-09-14T11:06:41.913454+0000","last_unstale":"2024-09-14T12:01:10.670577+0000","last_undegraded":"2024-09-14T12:01:10.670577+0000","last_fullsized":"2024-09-14T12:01:10.670577+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:38.121049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":18,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'130","reported_seq":444,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.533642+0000","last_change":"2024-09-14T11:02:34.879730+0000","last_active":"2024-09-14T11:58:55.533642+0000","last_peered":"2024-09-14T11:58:55.533642+0000","last_clean":"2024-09-14T11:58:55.533642+0000","last_became_active":"2024-09-14T11:02:34.878813+0000","last_became_peered":"2024-09-14T11:02:34.878813+0000","last_unstale":"2024-09-14T11:58:55.533642+0000","last_undegraded":"2024-09-14T11:58:55.533642+0000","last_fullsized":"2024-09-14T11:58:55.533642+0000","mapping_epoch":252,"log_start":"260'100","ondisk_log_start":"260'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:00.256155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1195,"num_read_kb":1160,"num_write":263,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.447900+0000","last_change":"2024-09-14T11:25:20.212941+0000","last_active":"2024-09-14T11:57:28.447900+0000","last_peered":"2024-09-14T11:57:28.447900+0000","last_clean":"2024-09-14T11:57:28.447900+0000","last_became_active":"2024-09-14T11:25:20.212665+0000","last_became_peered":"2024-09-14T11:25:20.212665+0000","last_unstale":"2024-09-14T11:57:28.447900+0000","last_undegraded":"2024-09-14T11:57:28.447900+0000","last_fullsized":"2024-09-14T11:57:28.447900+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:31.076495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.605166+0000","last_change":"2024-09-14T11:06:45.992405+0000","last_active":"2024-09-14T11:58:45.605166+0000","last_peered":"2024-09-14T11:58:45.605166+0000","last_clean":"2024-09-14T11:58:45.605166+0000","last_became_active":"2024-09-14T11:06:45.992066+0000","last_became_peered":"2024-09-14T11:06:45.992066+0000","last_unstale":"2024-09-14T11:58:45.605166+0000","last_undegraded":"2024-09-14T11:58:45.605166+0000","last_fullsized":"2024-09-14T11:58:45.605166+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:42.417189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"260'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.305944+0000","last_change":"2024-09-14T11:06:41.912718+0000","last_active":"2024-09-14T11:58:45.305944+0000","last_peered":"2024-09-14T11:58:45.305944+0000","last_clean":"2024-09-14T11:58:45.305944+0000","last_became_active":"2024-09-14T11:06:41.912405+0000","last_became_peered":"2024-09-14T11:06:41.912405+0000","last_unstale":"2024-09-14T11:58:45.305944+0000","last_undegraded":"2024-09-14T11:58:45.305944+0000","last_fullsized":"2024-09-14T11:58:45.305944+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:12.800532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"263'36","reported_seq":158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.307994+0000","last_change":"2024-09-14T11:02:34.873402+0000","last_active":"2024-09-14T11:59:05.307994+0000","last_peered":"2024-09-14T11:59:05.307994+0000","last_clean":"2024-09-14T11:59:05.307994+0000","last_became_active":"2024-09-14T11:02:34.873089+0000","last_became_peered":"2024-09-14T11:02:34.873089+0000","last_unstale":"2024-09-14T11:59:05.307994+0000","last_undegraded":"2024-09-14T11:59:05.307994+0000","last_fullsized":"2024-09-14T11:59:05.307994+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:47.372158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":295,"num_read_kb":200,"num_write":86,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.531790+0000","last_change":"2024-09-14T11:25:20.210966+0000","last_active":"2024-09-14T11:58:40.531790+0000","last_peered":"2024-09-14T11:58:40.531790+0000","last_clean":"2024-09-14T11:58:40.531790+0000","last_became_active":"2024-09-14T11:25:20.210331+0000","last_became_peered":"2024-09-14T11:25:20.210331+0000","last_unstale":"2024-09-14T11:58:40.531790+0000","last_undegraded":"2024-09-14T11:58:40.531790+0000","last_fullsized":"2024-09-14T11:58:40.531790+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:27.694386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.532467+0000","last_change":"2024-09-14T11:06:45.986136+0000","last_active":"2024-09-14T11:58:45.532467+0000","last_peered":"2024-09-14T11:58:45.532467+0000","last_clean":"2024-09-14T11:58:45.532467+0000","last_became_active":"2024-09-14T11:06:45.985792+0000","last_became_peered":"2024-09-14T11:06:45.985792+0000","last_unstale":"2024-09-14T11:58:45.532467+0000","last_undegraded":"2024-09-14T11:58:45.532467+0000","last_fullsized":"2024-09-14T11:58:45.532467+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:18.428977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.532481+0000","last_change":"2024-09-14T11:06:41.914556+0000","last_active":"2024-09-14T11:58:45.532481+0000","last_peered":"2024-09-14T11:58:45.532481+0000","last_clean":"2024-09-14T11:58:45.532481+0000","last_became_active":"2024-09-14T11:06:41.913214+0000","last_became_peered":"2024-09-14T11:06:41.913214+0000","last_unstale":"2024-09-14T11:58:45.532481+0000","last_undegraded":"2024-09-14T11:58:45.532481+0000","last_fullsized":"2024-09-14T11:58:45.532481+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:05.435530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"263'55","reported_seq":209,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.450078+0000","last_change":"2024-09-14T11:02:34.873880+0000","last_active":"2024-09-14T11:58:50.450078+0000","last_peered":"2024-09-14T11:58:50.450078+0000","last_clean":"2024-09-14T11:58:50.450078+0000","last_became_active":"2024-09-14T11:02:34.873554+0000","last_became_peered":"2024-09-14T11:02:34.873554+0000","last_unstale":"2024-09-14T11:58:50.450078+0000","last_undegraded":"2024-09-14T11:58:50.450078+0000","last_fullsized":"2024-09-14T11:58:50.450078+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:52.441238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":297,"num_write":136,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.441967+0000","last_change":"2024-09-14T11:25:20.209266+0000","last_active":"2024-09-14T11:57:50.441967+0000","last_peered":"2024-09-14T11:57:50.441967+0000","last_clean":"2024-09-14T11:57:50.441967+0000","last_became_active":"2024-09-14T11:25:20.208985+0000","last_became_peered":"2024-09-14T11:25:20.208985+0000","last_unstale":"2024-09-14T11:57:50.441967+0000","last_undegraded":"2024-09-14T11:57:50.441967+0000","last_fullsized":"2024-09-14T11:57:50.441967+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:35.791238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"260'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.650067+0000","last_change":"2024-09-14T11:06:45.987976+0000","last_active":"2024-09-14T11:58:50.650067+0000","last_peered":"2024-09-14T11:58:50.650067+0000","last_clean":"2024-09-14T11:58:50.650067+0000","last_became_active":"2024-09-14T11:06:45.987665+0000","last_became_peered":"2024-09-14T11:06:45.987665+0000","last_unstale":"2024-09-14T11:58:50.650067+0000","last_undegraded":"2024-09-14T11:58:50.650067+0000","last_fullsized":"2024-09-14T11:58:50.650067+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:33.778940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5649,"num_write":5,"num_write_kb":5649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"260'8","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.307436+0000","last_change":"2024-09-14T11:06:41.906763+0000","last_active":"2024-09-14T11:59:00.307436+0000","last_peered":"2024-09-14T11:59:00.307436+0000","last_clean":"2024-09-14T11:59:00.307436+0000","last_became_active":"2024-09-14T11:06:41.906528+0000","last_became_peered":"2024-09-14T11:06:41.906528+0000","last_unstale":"2024-09-14T11:59:00.307436+0000","last_undegraded":"2024-09-14T11:59:00.307436+0000","last_fullsized":"2024-09-14T11:59:00.307436+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:50.072640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"263'49","reported_seq":191,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.306450+0000","last_change":"2024-09-14T11:02:34.869488+0000","last_active":"2024-09-14T11:58:50.306450+0000","last_peered":"2024-09-14T11:58:50.306450+0000","last_clean":"2024-09-14T11:58:50.306450+0000","last_became_active":"2024-09-14T11:02:34.869154+0000","last_became_peered":"2024-09-14T11:02:34.869154+0000","last_unstale":"2024-09-14T11:58:50.306450+0000","last_undegraded":"2024-09-14T11:58:50.306450+0000","last_fullsized":"2024-09-14T11:58:50.306450+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:51.708190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":272,"num_write":122,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.641217+0000","last_change":"2024-09-14T11:25:20.209267+0000","last_active":"2024-09-14T11:57:50.641217+0000","last_peered":"2024-09-14T11:57:50.641217+0000","last_clean":"2024-09-14T11:57:50.641217+0000","last_became_active":"2024-09-14T11:25:20.208992+0000","last_became_peered":"2024-09-14T11:25:20.208992+0000","last_unstale":"2024-09-14T11:57:50.641217+0000","last_undegraded":"2024-09-14T11:57:50.641217+0000","last_fullsized":"2024-09-14T11:57:50.641217+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:33.801493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"263'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.845194+0000","last_change":"2024-09-14T11:06:45.985807+0000","last_active":"2024-09-14T12:01:17.845194+0000","last_peered":"2024-09-14T12:01:17.845194+0000","last_clean":"2024-09-14T12:01:17.845194+0000","last_became_active":"2024-09-14T11:06:45.985518+0000","last_became_peered":"2024-09-14T11:06:45.985518+0000","last_unstale":"2024-09-14T12:01:17.845194+0000","last_undegraded":"2024-09-14T12:01:17.845194+0000","last_fullsized":"2024-09-14T12:01:17.845194+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:53.847804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:55.549750+0000","last_change":"2024-09-14T11:06:41.915181+0000","last_active":"2024-09-14T12:00:55.549750+0000","last_peered":"2024-09-14T12:00:55.549750+0000","last_clean":"2024-09-14T12:00:55.549750+0000","last_became_active":"2024-09-14T11:06:41.914346+0000","last_became_peered":"2024-09-14T11:06:41.914346+0000","last_unstale":"2024-09-14T12:00:55.549750+0000","last_undegraded":"2024-09-14T12:00:55.549750+0000","last_fullsized":"2024-09-14T12:00:55.549750+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:17.184490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"263'33","reported_seq":145,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.532990+0000","last_change":"2024-09-14T11:02:34.880356+0000","last_active":"2024-09-14T11:58:50.532990+0000","last_peered":"2024-09-14T11:58:50.532990+0000","last_clean":"2024-09-14T11:58:50.532990+0000","last_became_active":"2024-09-14T11:02:34.880066+0000","last_became_peered":"2024-09-14T11:02:34.880066+0000","last_unstale":"2024-09-14T11:58:50.532990+0000","last_undegraded":"2024-09-14T11:58:50.532990+0000","last_fullsized":"2024-09-14T11:58:50.532990+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:20.037542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":165,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:43.459528+0000","last_change":"2024-09-14T11:25:20.211431+0000","last_active":"2024-09-14T11:58:43.459528+0000","last_peered":"2024-09-14T11:58:43.459528+0000","last_clean":"2024-09-14T11:58:43.459528+0000","last_became_active":"2024-09-14T11:25:20.208291+0000","last_became_peered":"2024-09-14T11:25:20.208291+0000","last_unstale":"2024-09-14T11:58:43.459528+0000","last_undegraded":"2024-09-14T11:58:43.459528+0000","last_fullsized":"2024-09-14T11:58:43.459528+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:10.519199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"260'3","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.306441+0000","last_change":"2024-09-14T11:06:45.988585+0000","last_active":"2024-09-14T11:58:50.306441+0000","last_peered":"2024-09-14T11:58:50.306441+0000","last_clean":"2024-09-14T11:58:50.306441+0000","last_became_active":"2024-09-14T11:06:45.988268+0000","last_became_peered":"2024-09-14T11:06:45.988268+0000","last_unstale":"2024-09-14T11:58:50.306441+0000","last_undegraded":"2024-09-14T11:58:50.306441+0000","last_fullsized":"2024-09-14T11:58:50.306441+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:29.911599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.525697+0000","last_change":"2024-09-14T11:06:41.910335+0000","last_active":"2024-09-14T11:58:48.525697+0000","last_peered":"2024-09-14T11:58:48.525697+0000","last_clean":"2024-09-14T11:58:48.525697+0000","last_became_active":"2024-09-14T11:06:41.909915+0000","last_became_peered":"2024-09-14T11:06:41.909915+0000","last_unstale":"2024-09-14T11:58:48.525697+0000","last_undegraded":"2024-09-14T11:58:48.525697+0000","last_fullsized":"2024-09-14T11:58:48.525697+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:47.834488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"263'21","reported_seq":116,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.532964+0000","last_change":"2024-09-14T11:02:34.878110+0000","last_active":"2024-09-14T11:58:50.532964+0000","last_peered":"2024-09-14T11:58:50.532964+0000","last_clean":"2024-09-14T11:58:50.532964+0000","last_became_active":"2024-09-14T11:02:34.877791+0000","last_became_peered":"2024-09-14T11:02:34.877791+0000","last_unstale":"2024-09-14T11:58:50.532964+0000","last_undegraded":"2024-09-14T11:58:50.532964+0000","last_fullsized":"2024-09-14T11:58:50.532964+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:00.836048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":103,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.531860+0000","last_change":"2024-09-14T11:25:20.208774+0000","last_active":"2024-09-14T11:58:40.531860+0000","last_peered":"2024-09-14T11:58:40.531860+0000","last_clean":"2024-09-14T11:58:40.531860+0000","last_became_active":"2024-09-14T11:25:20.208495+0000","last_became_peered":"2024-09-14T11:25:20.208495+0000","last_unstale":"2024-09-14T11:58:40.531860+0000","last_undegraded":"2024-09-14T11:58:40.531860+0000","last_fullsized":"2024-09-14T11:58:40.531860+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:18.019657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"263'3","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:55.321309+0000","last_change":"2024-09-14T11:06:45.987276+0000","last_active":"2024-09-14T12:00:55.321309+0000","last_peered":"2024-09-14T12:00:55.321309+0000","last_clean":"2024-09-14T12:00:55.321309+0000","last_became_active":"2024-09-14T11:06:45.986990+0000","last_became_peered":"2024-09-14T11:06:45.986990+0000","last_unstale":"2024-09-14T12:00:55.321309+0000","last_undegraded":"2024-09-14T12:00:55.321309+0000","last_fullsized":"2024-09-14T12:00:55.321309+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:48.346557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.408167+0000","last_change":"2024-09-14T11:06:41.915671+0000","last_active":"2024-09-14T11:58:50.408167+0000","last_peered":"2024-09-14T11:58:50.408167+0000","last_clean":"2024-09-14T11:58:50.408167+0000","last_became_active":"2024-09-14T11:06:41.915372+0000","last_became_peered":"2024-09-14T11:06:41.915372+0000","last_unstale":"2024-09-14T11:58:50.408167+0000","last_undegraded":"2024-09-14T11:58:50.408167+0000","last_fullsized":"2024-09-14T11:58:50.408167+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:08.016650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"263'13","reported_seq":96,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.306383+0000","last_change":"2024-09-14T11:02:34.879297+0000","last_active":"2024-09-14T11:58:50.306383+0000","last_peered":"2024-09-14T11:58:50.306383+0000","last_clean":"2024-09-14T11:58:50.306383+0000","last_became_active":"2024-09-14T11:02:34.879002+0000","last_became_peered":"2024-09-14T11:02:34.879002+0000","last_unstale":"2024-09-14T11:58:50.306383+0000","last_undegraded":"2024-09-14T11:58:50.306383+0000","last_fullsized":"2024-09-14T11:58:50.306383+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:18.663446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":56,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'347","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.365123+0000","last_change":"2024-09-14T10:46:44.332154+0000","last_active":"2024-09-14T12:01:19.365123+0000","last_peered":"2024-09-14T12:01:19.365123+0000","last_clean":"2024-09-14T12:01:19.365123+0000","last_became_active":"2024-09-14T10:46:44.331827+0000","last_became_peered":"2024-09-14T10:46:44.331827+0000","last_unstale":"2024-09-14T12:01:19.365123+0000","last_undegraded":"2024-09-14T12:01:19.365123+0000","last_fullsized":"2024-09-14T12:01:19.365123+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:51.461537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":808,"num_read_kb":10519,"num_write":1133,"num_write_kb":31597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"263'506","reported_seq":2200,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.709310+0000","last_change":"2024-09-14T10:46:46.341235+0000","last_active":"2024-09-14T11:59:34.709310+0000","last_peered":"2024-09-14T11:59:34.709310+0000","last_clean":"2024-09-14T11:59:34.709310+0000","last_became_active":"2024-09-14T10:46:46.340949+0000","last_became_peered":"2024-09-14T10:46:46.340949+0000","last_unstale":"2024-09-14T11:59:34.709310+0000","last_undegraded":"2024-09-14T11:59:34.709310+0000","last_fullsized":"2024-09-14T11:59:34.709310+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:28.432778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2834,"num_read_kb":2670,"num_write":604,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"263'354","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.374801+0000","last_change":"2024-09-14T10:46:44.333346+0000","last_active":"2024-09-14T12:01:19.374801+0000","last_peered":"2024-09-14T12:01:19.374801+0000","last_clean":"2024-09-14T12:01:19.374801+0000","last_became_active":"2024-09-14T10:46:44.332997+0000","last_became_peered":"2024-09-14T10:46:44.332997+0000","last_unstale":"2024-09-14T12:01:19.374801+0000","last_undegraded":"2024-09-14T12:01:19.374801+0000","last_fullsized":"2024-09-14T12:01:19.374801+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:12.331728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":584,"num_read_kb":4891,"num_write":1057,"num_write_kb":34401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"263'664","reported_seq":2310,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.149223+0000","last_change":"2024-09-14T10:46:46.340953+0000","last_active":"2024-09-14T12:00:51.149223+0000","last_peered":"2024-09-14T12:00:51.149223+0000","last_clean":"2024-09-14T12:00:51.149223+0000","last_became_active":"2024-09-14T10:46:46.340612+0000","last_became_peered":"2024-09-14T10:46:46.340612+0000","last_unstale":"2024-09-14T12:00:51.149223+0000","last_undegraded":"2024-09-14T12:00:51.149223+0000","last_fullsized":"2024-09-14T12:00:51.149223+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":600,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:41.266834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3359,"num_read_kb":3045,"num_write":872,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"263'315","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.330718+0000","last_change":"2024-09-14T10:46:44.320649+0000","last_active":"2024-09-14T12:01:19.330718+0000","last_peered":"2024-09-14T12:01:19.330718+0000","last_clean":"2024-09-14T12:01:19.330718+0000","last_became_active":"2024-09-14T10:46:44.320254+0000","last_became_peered":"2024-09-14T10:46:44.320254+0000","last_unstale":"2024-09-14T12:01:19.330718+0000","last_undegraded":"2024-09-14T12:01:19.330718+0000","last_fullsized":"2024-09-14T12:01:19.330718+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:19.897879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":578,"num_read_kb":18043,"num_write":1147,"num_write_kb":30368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"263'455","reported_seq":1884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.679270+0000","last_change":"2024-09-14T10:46:46.338061+0000","last_active":"2024-09-14T11:59:34.679270+0000","last_peered":"2024-09-14T11:59:34.679270+0000","last_clean":"2024-09-14T11:59:34.679270+0000","last_became_active":"2024-09-14T10:46:46.337092+0000","last_became_peered":"2024-09-14T10:46:46.337092+0000","last_unstale":"2024-09-14T11:59:34.679270+0000","last_undegraded":"2024-09-14T11:59:34.679270+0000","last_fullsized":"2024-09-14T11:59:34.679270+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:11.129363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2407,"num_read_kb":2236,"num_write":590,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"263'320","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.403504+0000","last_change":"2024-09-14T10:46:44.322511+0000","last_active":"2024-09-14T12:01:19.403504+0000","last_peered":"2024-09-14T12:01:19.403504+0000","last_clean":"2024-09-14T12:01:19.403504+0000","last_became_active":"2024-09-14T10:46:44.321098+0000","last_became_peered":"2024-09-14T10:46:44.321098+0000","last_unstale":"2024-09-14T12:01:19.403504+0000","last_undegraded":"2024-09-14T12:01:19.403504+0000","last_fullsized":"2024-09-14T12:01:19.403504+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:44.225925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":621,"num_read_kb":93491,"num_write":1039,"num_write_kb":33828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"263'561","reported_seq":2220,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:21.444561+0000","last_change":"2024-09-14T10:46:46.338161+0000","last_active":"2024-09-14T11:58:21.444561+0000","last_peered":"2024-09-14T11:58:21.444561+0000","last_clean":"2024-09-14T11:58:21.444561+0000","last_became_active":"2024-09-14T10:46:46.337883+0000","last_became_peered":"2024-09-14T10:46:46.337883+0000","last_unstale":"2024-09-14T11:58:21.444561+0000","last_undegraded":"2024-09-14T11:58:21.444561+0000","last_fullsized":"2024-09-14T11:58:21.444561+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:51.194169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3147,"num_read_kb":2923,"num_write":727,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"263'377","reported_seq":1056,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.349667+0000","last_change":"2024-09-14T10:46:44.325129+0000","last_active":"2024-09-14T12:01:19.349667+0000","last_peered":"2024-09-14T12:01:19.349667+0000","last_clean":"2024-09-14T12:01:19.349667+0000","last_became_active":"2024-09-14T10:46:44.324768+0000","last_became_peered":"2024-09-14T10:46:44.324768+0000","last_unstale":"2024-09-14T12:01:19.349667+0000","last_undegraded":"2024-09-14T12:01:19.349667+0000","last_fullsized":"2024-09-14T12:01:19.349667+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:07.568042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":706,"num_read_kb":82703,"num_write":1285,"num_write_kb":36007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"263'447","reported_seq":2074,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.606129+0000","last_change":"2024-09-14T10:46:46.342723+0000","last_active":"2024-09-14T11:58:55.606129+0000","last_peered":"2024-09-14T11:58:55.606129+0000","last_clean":"2024-09-14T11:58:55.606129+0000","last_became_active":"2024-09-14T10:46:46.338973+0000","last_became_peered":"2024-09-14T10:46:46.338973+0000","last_unstale":"2024-09-14T11:58:55.606129+0000","last_undegraded":"2024-09-14T11:58:55.606129+0000","last_fullsized":"2024-09-14T11:58:55.606129+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:09.155102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2500,"num_read_kb":2382,"num_write":507,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"263'357","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.378797+0000","last_change":"2024-09-14T10:46:44.320180+0000","last_active":"2024-09-14T12:01:19.378797+0000","last_peered":"2024-09-14T12:01:19.378797+0000","last_clean":"2024-09-14T12:01:19.378797+0000","last_became_active":"2024-09-14T10:46:44.319801+0000","last_became_peered":"2024-09-14T10:46:44.319801+0000","last_unstale":"2024-09-14T12:01:19.378797+0000","last_undegraded":"2024-09-14T12:01:19.378797+0000","last_fullsized":"2024-09-14T12:01:19.378797+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:56.539279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":563,"num_read_kb":13023,"num_write":1154,"num_write_kb":36371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"263'579","reported_seq":2155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:01.624820+0000","last_change":"2024-09-14T10:46:46.351079+0000","last_active":"2024-09-14T11:58:01.624820+0000","last_peered":"2024-09-14T11:58:01.624820+0000","last_clean":"2024-09-14T11:58:01.624820+0000","last_became_active":"2024-09-14T10:46:46.350776+0000","last_became_peered":"2024-09-14T10:46:46.350776+0000","last_unstale":"2024-09-14T11:58:01.624820+0000","last_undegraded":"2024-09-14T11:58:01.624820+0000","last_fullsized":"2024-09-14T11:58:01.624820+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:49.953237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3080,"num_read_kb":2791,"num_write":782,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"263'282","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.370814+0000","last_change":"2024-09-14T10:46:44.328019+0000","last_active":"2024-09-14T12:01:19.370814+0000","last_peered":"2024-09-14T12:01:19.370814+0000","last_clean":"2024-09-14T12:01:19.370814+0000","last_became_active":"2024-09-14T10:46:44.327650+0000","last_became_peered":"2024-09-14T10:46:44.327650+0000","last_unstale":"2024-09-14T12:01:19.370814+0000","last_undegraded":"2024-09-14T12:01:19.370814+0000","last_fullsized":"2024-09-14T12:01:19.370814+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:39.047825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":6055,"num_write":990,"num_write_kb":41392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"263'567","reported_seq":2315,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.213898+0000","last_change":"2024-09-14T10:46:46.341743+0000","last_active":"2024-09-14T11:58:37.213898+0000","last_peered":"2024-09-14T11:58:37.213898+0000","last_clean":"2024-09-14T11:58:37.213898+0000","last_became_active":"2024-09-14T10:46:46.341474+0000","last_became_peered":"2024-09-14T10:46:46.341474+0000","last_unstale":"2024-09-14T11:58:37.213898+0000","last_undegraded":"2024-09-14T11:58:37.213898+0000","last_fullsized":"2024-09-14T11:58:37.213898+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:59.495895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3094,"num_read_kb":2877,"num_write":684,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"263'343","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.361311+0000","last_change":"2024-09-14T10:46:44.335194+0000","last_active":"2024-09-14T12:01:19.361311+0000","last_peered":"2024-09-14T12:01:19.361311+0000","last_clean":"2024-09-14T12:01:19.361311+0000","last_became_active":"2024-09-14T10:46:44.334630+0000","last_became_peered":"2024-09-14T10:46:44.334630+0000","last_unstale":"2024-09-14T12:01:19.361311+0000","last_undegraded":"2024-09-14T12:01:19.361311+0000","last_fullsized":"2024-09-14T12:01:19.361311+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:39.166664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":627,"num_read_kb":14860,"num_write":1052,"num_write_kb":34853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"263'824","reported_seq":2407,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:43.469536+0000","last_change":"2024-09-14T10:46:46.350955+0000","last_active":"2024-09-14T11:59:43.469536+0000","last_peered":"2024-09-14T11:59:43.469536+0000","last_clean":"2024-09-14T11:59:43.469536+0000","last_became_active":"2024-09-14T10:46:46.350391+0000","last_became_peered":"2024-09-14T10:46:46.350391+0000","last_unstale":"2024-09-14T11:59:43.469536+0000","last_undegraded":"2024-09-14T11:59:43.469536+0000","last_fullsized":"2024-09-14T11:59:43.469536+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:02.579006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3863,"num_read_kb":3486,"num_write":1075,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"263'748","reported_seq":2166,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.350687+0000","last_change":"2024-09-14T10:46:46.336012+0000","last_active":"2024-09-14T11:58:44.350687+0000","last_peered":"2024-09-14T11:58:44.350687+0000","last_clean":"2024-09-14T11:58:44.350687+0000","last_became_active":"2024-09-14T10:46:46.335749+0000","last_became_peered":"2024-09-14T10:46:46.335749+0000","last_unstale":"2024-09-14T11:58:44.350687+0000","last_undegraded":"2024-09-14T11:58:44.350687+0000","last_fullsized":"2024-09-14T11:58:44.350687+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:42.586410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3617,"num_read_kb":3235,"num_write":1004,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"263'306","reported_seq":918,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.361253+0000","last_change":"2024-09-14T10:46:44.317211+0000","last_active":"2024-09-14T12:01:19.361253+0000","last_peered":"2024-09-14T12:01:19.361253+0000","last_clean":"2024-09-14T12:01:19.361253+0000","last_became_active":"2024-09-14T10:46:44.316741+0000","last_became_peered":"2024-09-14T10:46:44.316741+0000","last_unstale":"2024-09-14T12:01:19.361253+0000","last_undegraded":"2024-09-14T12:01:19.361253+0000","last_fullsized":"2024-09-14T12:01:19.361253+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:32.808931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133671,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":507,"num_read_kb":26974,"num_write":959,"num_write_kb":33080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"263'803","reported_seq":2496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.146195+0000","last_change":"2024-09-14T10:46:46.346277+0000","last_active":"2024-09-14T12:00:51.146195+0000","last_peered":"2024-09-14T12:00:51.146195+0000","last_clean":"2024-09-14T12:00:51.146195+0000","last_became_active":"2024-09-14T10:46:46.345709+0000","last_became_peered":"2024-09-14T10:46:46.345709+0000","last_unstale":"2024-09-14T12:00:51.146195+0000","last_undegraded":"2024-09-14T12:00:51.146195+0000","last_fullsized":"2024-09-14T12:00:51.146195+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:39.154901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3947,"num_read_kb":3606,"num_write":1038,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"263'367","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.353004+0000","last_change":"2024-09-14T10:46:44.331941+0000","last_active":"2024-09-14T12:01:19.353004+0000","last_peered":"2024-09-14T12:01:19.353004+0000","last_clean":"2024-09-14T12:01:19.353004+0000","last_became_active":"2024-09-14T10:46:44.331599+0000","last_became_peered":"2024-09-14T10:46:44.331599+0000","last_unstale":"2024-09-14T12:01:19.353004+0000","last_undegraded":"2024-09-14T12:01:19.353004+0000","last_fullsized":"2024-09-14T12:01:19.353004+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:14.551208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":622,"num_read_kb":2368,"num_write":1092,"num_write_kb":34113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"263'397","reported_seq":1959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.154005+0000","last_change":"2024-09-14T10:46:46.351133+0000","last_active":"2024-09-14T11:58:46.154005+0000","last_peered":"2024-09-14T11:58:46.154005+0000","last_clean":"2024-09-14T11:58:46.154005+0000","last_became_active":"2024-09-14T10:46:46.350525+0000","last_became_peered":"2024-09-14T10:46:46.350525+0000","last_unstale":"2024-09-14T11:58:46.154005+0000","last_undegraded":"2024-09-14T11:58:46.154005+0000","last_fullsized":"2024-09-14T11:58:46.154005+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:26.504718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2275,"num_read_kb":2173,"num_write":451,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"263'369","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.366438+0000","last_change":"2024-09-14T10:46:44.340215+0000","last_active":"2024-09-14T12:01:19.366438+0000","last_peered":"2024-09-14T12:01:19.366438+0000","last_clean":"2024-09-14T12:01:19.366438+0000","last_became_active":"2024-09-14T10:46:44.339871+0000","last_became_peered":"2024-09-14T10:46:44.339871+0000","last_unstale":"2024-09-14T12:01:19.366438+0000","last_undegraded":"2024-09-14T12:01:19.366438+0000","last_fullsized":"2024-09-14T12:01:19.366438+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:22.901003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":774,"num_read_kb":19273,"num_write":1249,"num_write_kb":53136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"263'1154","reported_seq":2712,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.102743+0000","last_change":"2024-09-14T10:46:46.349949+0000","last_active":"2024-09-14T11:58:40.102743+0000","last_peered":"2024-09-14T11:58:40.102743+0000","last_clean":"2024-09-14T11:58:40.102743+0000","last_became_active":"2024-09-14T10:46:46.349649+0000","last_became_peered":"2024-09-14T10:46:46.349649+0000","last_unstale":"2024-09-14T11:58:40.102743+0000","last_undegraded":"2024-09-14T11:58:40.102743+0000","last_fullsized":"2024-09-14T11:58:40.102743+0000","mapping_epoch":28,"log_start":"263'1100","ondisk_log_start":"263'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":1100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:46.563986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5238,"num_read_kb":4651,"num_write":1596,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"263'343","reported_seq":1077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.372572+0000","last_change":"2024-09-14T10:46:44.326980+0000","last_active":"2024-09-14T12:01:19.372572+0000","last_peered":"2024-09-14T12:01:19.372572+0000","last_clean":"2024-09-14T12:01:19.372572+0000","last_became_active":"2024-09-14T10:46:44.326645+0000","last_became_peered":"2024-09-14T10:46:44.326645+0000","last_unstale":"2024-09-14T12:01:19.372572+0000","last_undegraded":"2024-09-14T12:01:19.372572+0000","last_fullsized":"2024-09-14T12:01:19.372572+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:15.334289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":923,"num_read_kb":14272,"num_write":1148,"num_write_kb":16465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"263'962","reported_seq":2507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.465626+0000","last_change":"2024-09-14T10:46:46.347683+0000","last_active":"2024-09-14T11:59:18.465626+0000","last_peered":"2024-09-14T11:59:18.465626+0000","last_clean":"2024-09-14T11:59:18.465626+0000","last_became_active":"2024-09-14T10:46:46.347420+0000","last_became_peered":"2024-09-14T10:46:46.347420+0000","last_unstale":"2024-09-14T11:59:18.465626+0000","last_undegraded":"2024-09-14T11:59:18.465626+0000","last_fullsized":"2024-09-14T11:59:18.465626+0000","mapping_epoch":28,"log_start":"263'900","ondisk_log_start":"263'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":900,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:54.686257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5046,"num_read_kb":4563,"num_write":1374,"num_write_kb":542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"263'377","reported_seq":1018,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.388591+0000","last_change":"2024-09-14T10:46:44.319508+0000","last_active":"2024-09-14T12:01:19.388591+0000","last_peered":"2024-09-14T12:01:19.388591+0000","last_clean":"2024-09-14T12:01:19.388591+0000","last_became_active":"2024-09-14T10:46:44.319146+0000","last_became_peered":"2024-09-14T10:46:44.319146+0000","last_unstale":"2024-09-14T12:01:19.388591+0000","last_undegraded":"2024-09-14T12:01:19.388591+0000","last_fullsized":"2024-09-14T12:01:19.388591+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:19.324787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":594,"num_read_kb":40910,"num_write":1073,"num_write_kb":34714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"263'374","reported_seq":1891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.351510+0000","last_change":"2024-09-14T10:46:46.339990+0000","last_active":"2024-09-14T11:58:44.351510+0000","last_peered":"2024-09-14T11:58:44.351510+0000","last_clean":"2024-09-14T11:58:44.351510+0000","last_became_active":"2024-09-14T10:46:46.339710+0000","last_became_peered":"2024-09-14T10:46:46.339710+0000","last_unstale":"2024-09-14T11:58:44.351510+0000","last_undegraded":"2024-09-14T11:58:44.351510+0000","last_fullsized":"2024-09-14T11:58:44.351510+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:06.635346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2075,"num_read_kb":1993,"num_write":416,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"263'322","reported_seq":1042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.384137+0000","last_change":"2024-09-14T10:46:44.318270+0000","last_active":"2024-09-14T12:01:19.384137+0000","last_peered":"2024-09-14T12:01:19.384137+0000","last_clean":"2024-09-14T12:01:19.384137+0000","last_became_active":"2024-09-14T10:46:44.317895+0000","last_became_peered":"2024-09-14T10:46:44.317895+0000","last_unstale":"2024-09-14T12:01:19.384137+0000","last_undegraded":"2024-09-14T12:01:19.384137+0000","last_fullsized":"2024-09-14T12:01:19.384137+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:29.484018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":939,"num_read_kb":22981,"num_write":1007,"num_write_kb":27989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"263'130","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.815076+0000","last_change":"2024-09-14T10:46:54.375921+0000","last_active":"2024-09-14T11:59:34.815076+0000","last_peered":"2024-09-14T11:59:34.815076+0000","last_clean":"2024-09-14T11:59:34.815076+0000","last_became_active":"2024-09-14T10:46:54.374769+0000","last_became_peered":"2024-09-14T10:46:54.374769+0000","last_unstale":"2024-09-14T11:59:34.815076+0000","last_undegraded":"2024-09-14T11:59:34.815076+0000","last_fullsized":"2024-09-14T11:59:34.815076+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:49.159300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":165,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"263'434","reported_seq":1984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.153364+0000","last_change":"2024-09-14T10:46:46.340520+0000","last_active":"2024-09-14T11:58:46.153364+0000","last_peered":"2024-09-14T11:58:46.153364+0000","last_clean":"2024-09-14T11:58:46.153364+0000","last_became_active":"2024-09-14T10:46:46.340169+0000","last_became_peered":"2024-09-14T10:46:46.340169+0000","last_unstale":"2024-09-14T11:58:46.153364+0000","last_undegraded":"2024-09-14T11:58:46.153364+0000","last_fullsized":"2024-09-14T11:58:46.153364+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:30.021599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2291,"num_read_kb":2165,"num_write":484,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"263'388","reported_seq":1032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.403558+0000","last_change":"2024-09-14T10:47:18.794218+0000","last_active":"2024-09-14T12:01:19.403558+0000","last_peered":"2024-09-14T12:01:19.403558+0000","last_clean":"2024-09-14T12:01:19.403558+0000","last_became_active":"2024-09-14T10:47:18.793917+0000","last_became_peered":"2024-09-14T10:47:18.793917+0000","last_unstale":"2024-09-14T12:01:19.403558+0000","last_undegraded":"2024-09-14T12:01:19.403558+0000","last_fullsized":"2024-09-14T12:01:19.403558+0000","mapping_epoch":39,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:04.969640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":723,"num_read_kb":48707,"num_write":1316,"num_write_kb":50304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.519271+0000","last_change":"2024-09-14T10:46:48.357072+0000","last_active":"2024-09-14T11:56:55.519271+0000","last_peered":"2024-09-14T11:56:55.519271+0000","last_clean":"2024-09-14T11:56:55.519271+0000","last_became_active":"2024-09-14T10:46:48.356776+0000","last_became_peered":"2024-09-14T10:46:48.356776+0000","last_unstale":"2024-09-14T11:56:55.519271+0000","last_undegraded":"2024-09-14T11:56:55.519271+0000","last_fullsized":"2024-09-14T11:56:55.519271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:33.998552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"263'353","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.009177+0000","last_change":"2024-09-14T10:46:50.360895+0000","last_active":"2024-09-14T12:01:18.009177+0000","last_peered":"2024-09-14T12:01:18.009177+0000","last_clean":"2024-09-14T12:01:18.009177+0000","last_became_active":"2024-09-14T10:46:50.359481+0000","last_became_peered":"2024-09-14T10:46:50.359481+0000","last_unstale":"2024-09-14T12:01:18.009177+0000","last_undegraded":"2024-09-14T12:01:18.009177+0000","last_fullsized":"2024-09-14T12:01:18.009177+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:57.049513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51669,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":564,"num_read_kb":1178,"num_write":444,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.396876+0000","last_change":"2024-09-14T10:46:52.373231+0000","last_active":"2024-09-14T11:57:00.396876+0000","last_peered":"2024-09-14T11:57:00.396876+0000","last_clean":"2024-09-14T11:57:00.396876+0000","last_became_active":"2024-09-14T10:46:52.372941+0000","last_became_peered":"2024-09-14T10:46:52.372941+0000","last_unstale":"2024-09-14T11:57:00.396876+0000","last_undegraded":"2024-09-14T11:57:00.396876+0000","last_fullsized":"2024-09-14T11:57:00.396876+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:39.029048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"263'153","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:57.663650+0000","last_change":"2024-09-14T10:46:54.387774+0000","last_active":"2024-09-14T11:57:57.663650+0000","last_peered":"2024-09-14T11:57:57.663650+0000","last_clean":"2024-09-14T11:57:57.663650+0000","last_became_active":"2024-09-14T10:46:54.387445+0000","last_became_peered":"2024-09-14T10:46:54.387445+0000","last_unstale":"2024-09-14T11:57:57.663650+0000","last_undegraded":"2024-09-14T11:57:57.663650+0000","last_fullsized":"2024-09-14T11:57:57.663650+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:41.372638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":80,"num_write":348,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"263'551","reported_seq":2271,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.139453+0000","last_change":"2024-09-14T10:46:46.340740+0000","last_active":"2024-09-14T12:00:51.139453+0000","last_peered":"2024-09-14T12:00:51.139453+0000","last_clean":"2024-09-14T12:00:51.139453+0000","last_became_active":"2024-09-14T10:46:46.340242+0000","last_became_peered":"2024-09-14T10:46:46.340242+0000","last_unstale":"2024-09-14T12:00:51.139453+0000","last_undegraded":"2024-09-14T12:00:51.139453+0000","last_fullsized":"2024-09-14T12:00:51.139453+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:58.555963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3138,"num_read_kb":2920,"num_write":702,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"263'332","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.379535+0000","last_change":"2024-09-14T10:46:44.335171+0000","last_active":"2024-09-14T12:01:19.379535+0000","last_peered":"2024-09-14T12:01:19.379535+0000","last_clean":"2024-09-14T12:01:19.379535+0000","last_became_active":"2024-09-14T10:46:44.334757+0000","last_became_peered":"2024-09-14T10:46:44.334757+0000","last_unstale":"2024-09-14T12:01:19.379535+0000","last_undegraded":"2024-09-14T12:01:19.379535+0000","last_fullsized":"2024-09-14T12:01:19.379535+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:06.067815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133691,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":630,"num_read_kb":20083,"num_write":1075,"num_write_kb":20918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:05.634732+0000","last_change":"2024-09-14T10:46:48.352082+0000","last_active":"2024-09-14T11:57:05.634732+0000","last_peered":"2024-09-14T11:57:05.634732+0000","last_clean":"2024-09-14T11:57:05.634732+0000","last_became_active":"2024-09-14T10:46:48.351825+0000","last_became_peered":"2024-09-14T10:46:48.351825+0000","last_unstale":"2024-09-14T11:57:05.634732+0000","last_undegraded":"2024-09-14T11:57:05.634732+0000","last_fullsized":"2024-09-14T11:57:05.634732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:28.324093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"263'101","reported_seq":633,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.413259+0000","last_change":"2024-09-14T10:46:50.360973+0000","last_active":"2024-09-14T11:59:20.413259+0000","last_peered":"2024-09-14T11:59:20.413259+0000","last_clean":"2024-09-14T11:59:20.413259+0000","last_became_active":"2024-09-14T10:46:50.360649+0000","last_became_peered":"2024-09-14T10:46:50.360649+0000","last_unstale":"2024-09-14T11:59:20.413259+0000","last_undegraded":"2024-09-14T11:59:20.413259+0000","last_fullsized":"2024-09-14T11:59:20.413259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:09.131081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.396818+0000","last_change":"2024-09-14T10:46:52.373120+0000","last_active":"2024-09-14T11:57:00.396818+0000","last_peered":"2024-09-14T11:57:00.396818+0000","last_clean":"2024-09-14T11:57:00.396818+0000","last_became_active":"2024-09-14T10:46:52.372770+0000","last_became_peered":"2024-09-14T10:46:52.372770+0000","last_unstale":"2024-09-14T11:57:00.396818+0000","last_undegraded":"2024-09-14T11:57:00.396818+0000","last_fullsized":"2024-09-14T11:57:00.396818+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:37.866381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"263'140","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.088657+0000","last_change":"2024-09-14T10:46:54.389893+0000","last_active":"2024-09-14T11:58:40.088657+0000","last_peered":"2024-09-14T11:58:40.088657+0000","last_clean":"2024-09-14T11:58:40.088657+0000","last_became_active":"2024-09-14T10:46:54.389638+0000","last_became_peered":"2024-09-14T10:46:54.389638+0000","last_unstale":"2024-09-14T11:58:40.088657+0000","last_undegraded":"2024-09-14T11:58:40.088657+0000","last_fullsized":"2024-09-14T11:58:40.088657+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:21.500685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":168,"num_write":356,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"263'449","reported_seq":2187,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.135482+0000","last_change":"2024-09-14T10:46:46.344810+0000","last_active":"2024-09-14T12:00:51.135482+0000","last_peered":"2024-09-14T12:00:51.135482+0000","last_clean":"2024-09-14T12:00:51.135482+0000","last_became_active":"2024-09-14T10:46:46.344509+0000","last_became_peered":"2024-09-14T10:46:46.344509+0000","last_unstale":"2024-09-14T12:00:51.135482+0000","last_undegraded":"2024-09-14T12:00:51.135482+0000","last_fullsized":"2024-09-14T12:00:51.135482+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:33.760349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2693,"num_read_kb":2571,"num_write":507,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"263'330","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.388743+0000","last_change":"2024-09-14T10:46:44.331833+0000","last_active":"2024-09-14T12:01:19.388743+0000","last_peered":"2024-09-14T12:01:19.388743+0000","last_clean":"2024-09-14T12:01:19.388743+0000","last_became_active":"2024-09-14T10:46:44.331464+0000","last_became_peered":"2024-09-14T10:46:44.331464+0000","last_unstale":"2024-09-14T12:01:19.388743+0000","last_undegraded":"2024-09-14T12:01:19.388743+0000","last_fullsized":"2024-09-14T12:01:19.388743+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267319,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":652,"num_read_kb":48168,"num_write":1033,"num_write_kb":26849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.633150+0000","last_change":"2024-09-14T10:46:48.357687+0000","last_active":"2024-09-14T11:56:55.633150+0000","last_peered":"2024-09-14T11:56:55.633150+0000","last_clean":"2024-09-14T11:56:55.633150+0000","last_became_active":"2024-09-14T10:46:48.357301+0000","last_became_peered":"2024-09-14T10:46:48.357301+0000","last_unstale":"2024-09-14T11:56:55.633150+0000","last_undegraded":"2024-09-14T11:56:55.633150+0000","last_fullsized":"2024-09-14T11:56:55.633150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:33.501824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"263'138","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:57.686128+0000","last_change":"2024-09-14T10:46:50.363764+0000","last_active":"2024-09-14T11:57:57.686128+0000","last_peered":"2024-09-14T11:57:57.686128+0000","last_clean":"2024-09-14T11:57:57.686128+0000","last_became_active":"2024-09-14T10:46:50.363495+0000","last_became_peered":"2024-09-14T10:46:50.363495+0000","last_unstale":"2024-09-14T11:57:57.686128+0000","last_undegraded":"2024-09-14T11:57:57.686128+0000","last_fullsized":"2024-09-14T11:57:57.686128+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:49:45.053503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":162,"num_write":114,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"263'792","reported_seq":2727,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.488837+0000","last_change":"2024-09-14T10:46:52.374170+0000","last_active":"2024-09-14T12:01:18.488837+0000","last_peered":"2024-09-14T12:01:18.488837+0000","last_clean":"2024-09-14T12:01:18.488837+0000","last_became_active":"2024-09-14T10:46:52.373886+0000","last_became_peered":"2024-09-14T10:46:52.373886+0000","last_unstale":"2024-09-14T12:01:18.488837+0000","last_undegraded":"2024-09-14T12:01:18.488837+0000","last_fullsized":"2024-09-14T12:01:18.488837+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:54.230847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"263'181","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.721550+0000","last_change":"2024-09-14T10:46:54.388494+0000","last_active":"2024-09-14T11:59:33.721550+0000","last_peered":"2024-09-14T11:59:33.721550+0000","last_clean":"2024-09-14T11:59:33.721550+0000","last_became_active":"2024-09-14T10:46:54.388186+0000","last_became_peered":"2024-09-14T10:46:54.388186+0000","last_unstale":"2024-09-14T11:59:33.721550+0000","last_undegraded":"2024-09-14T11:59:33.721550+0000","last_fullsized":"2024-09-14T11:59:33.721550+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:38.806003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":561,"num_read_kb":561,"num_write":378,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"263'893","reported_seq":2326,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:57.678509+0000","last_change":"2024-09-14T10:46:46.351792+0000","last_active":"2024-09-14T11:57:57.678509+0000","last_peered":"2024-09-14T11:57:57.678509+0000","last_clean":"2024-09-14T11:57:57.678509+0000","last_became_active":"2024-09-14T10:46:46.351453+0000","last_became_peered":"2024-09-14T10:46:46.351453+0000","last_unstale":"2024-09-14T11:57:57.678509+0000","last_undegraded":"2024-09-14T11:57:57.678509+0000","last_fullsized":"2024-09-14T11:57:57.678509+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":800,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:43.929395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4193,"num_read_kb":3693,"num_write":1250,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"263'366","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.347410+0000","last_change":"2024-09-14T10:46:44.329000+0000","last_active":"2024-09-14T12:01:19.347410+0000","last_peered":"2024-09-14T12:01:19.347410+0000","last_clean":"2024-09-14T12:01:19.347410+0000","last_became_active":"2024-09-14T10:46:44.328531+0000","last_became_peered":"2024-09-14T10:46:44.328531+0000","last_unstale":"2024-09-14T12:01:19.347410+0000","last_undegraded":"2024-09-14T12:01:19.347410+0000","last_fullsized":"2024-09-14T12:01:19.347410+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":728,"num_read_kb":24160,"num_write":1182,"num_write_kb":50074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.519306+0000","last_change":"2024-09-14T10:46:48.349347+0000","last_active":"2024-09-14T11:56:55.519306+0000","last_peered":"2024-09-14T11:56:55.519306+0000","last_clean":"2024-09-14T11:56:55.519306+0000","last_became_active":"2024-09-14T10:46:48.348899+0000","last_became_peered":"2024-09-14T10:46:48.348899+0000","last_unstale":"2024-09-14T11:56:55.519306+0000","last_undegraded":"2024-09-14T11:56:55.519306+0000","last_fullsized":"2024-09-14T11:56:55.519306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:31.899725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"263'308","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.717489+0000","last_change":"2024-09-14T10:46:50.366037+0000","last_active":"2024-09-14T12:01:17.717489+0000","last_peered":"2024-09-14T12:01:17.717489+0000","last_clean":"2024-09-14T12:01:17.717489+0000","last_became_active":"2024-09-14T10:46:50.365721+0000","last_became_peered":"2024-09-14T10:46:50.365721+0000","last_unstale":"2024-09-14T12:01:17.717489+0000","last_undegraded":"2024-09-14T12:01:17.717489+0000","last_fullsized":"2024-09-14T12:01:17.717489+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:37.431750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47247,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":1144,"num_write":408,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"263'830","reported_seq":2739,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.319896+0000","last_change":"2024-09-14T10:46:52.375010+0000","last_active":"2024-09-14T12:01:18.319896+0000","last_peered":"2024-09-14T12:01:18.319896+0000","last_clean":"2024-09-14T12:01:18.319896+0000","last_became_active":"2024-09-14T10:46:52.374634+0000","last_became_peered":"2024-09-14T10:46:52.374634+0000","last_unstale":"2024-09-14T12:01:18.319896+0000","last_undegraded":"2024-09-14T12:01:18.319896+0000","last_fullsized":"2024-09-14T12:01:18.319896+0000","mapping_epoch":34,"log_start":"263'800","ondisk_log_start":"263'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":800,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:57:14.899442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"263'522","reported_seq":2102,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.138196+0000","last_change":"2024-09-14T10:46:46.342236+0000","last_active":"2024-09-14T12:00:51.138196+0000","last_peered":"2024-09-14T12:00:51.138196+0000","last_clean":"2024-09-14T12:00:51.138196+0000","last_became_active":"2024-09-14T10:46:46.341971+0000","last_became_peered":"2024-09-14T10:46:46.341971+0000","last_unstale":"2024-09-14T12:00:51.138196+0000","last_undegraded":"2024-09-14T12:00:51.138196+0000","last_fullsized":"2024-09-14T12:00:51.138196+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:12.438399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2719,"num_read_kb":2513,"num_write":653,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"263'361","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.327021+0000","last_change":"2024-09-14T10:46:44.330242+0000","last_active":"2024-09-14T12:01:19.327021+0000","last_peered":"2024-09-14T12:01:19.327021+0000","last_clean":"2024-09-14T12:01:19.327021+0000","last_became_active":"2024-09-14T10:46:44.329782+0000","last_became_peered":"2024-09-14T10:46:44.329782+0000","last_unstale":"2024-09-14T12:01:19.327021+0000","last_undegraded":"2024-09-14T12:01:19.327021+0000","last_fullsized":"2024-09-14T12:01:19.327021+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:57.094973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":606,"num_read_kb":47823,"num_write":1082,"num_write_kb":48255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.405202+0000","last_change":"2024-09-14T10:46:48.352873+0000","last_active":"2024-09-14T11:58:20.405202+0000","last_peered":"2024-09-14T11:58:20.405202+0000","last_clean":"2024-09-14T11:58:20.405202+0000","last_became_active":"2024-09-14T10:46:48.352584+0000","last_became_peered":"2024-09-14T10:46:48.352584+0000","last_unstale":"2024-09-14T11:58:20.405202+0000","last_undegraded":"2024-09-14T11:58:20.405202+0000","last_fullsized":"2024-09-14T11:58:20.405202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:32.483930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"263'416","reported_seq":1057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.280535+0000","last_change":"2024-09-14T10:46:50.364803+0000","last_active":"2024-09-14T12:01:18.280535+0000","last_peered":"2024-09-14T12:01:18.280535+0000","last_clean":"2024-09-14T12:01:18.280535+0000","last_became_active":"2024-09-14T10:46:50.364438+0000","last_became_peered":"2024-09-14T10:46:50.364438+0000","last_unstale":"2024-09-14T12:01:18.280535+0000","last_undegraded":"2024-09-14T12:01:18.280535+0000","last_fullsized":"2024-09-14T12:01:18.280535+0000","mapping_epoch":32,"log_start":"263'400","ondisk_log_start":"263'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:41.620765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46781,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":687,"num_read_kb":1416,"num_write":538,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.526559+0000","last_change":"2024-09-14T10:46:52.368160+0000","last_active":"2024-09-14T11:58:53.526559+0000","last_peered":"2024-09-14T11:58:53.526559+0000","last_clean":"2024-09-14T11:58:53.526559+0000","last_became_active":"2024-09-14T10:46:52.367874+0000","last_became_peered":"2024-09-14T10:46:52.367874+0000","last_unstale":"2024-09-14T11:58:53.526559+0000","last_undegraded":"2024-09-14T11:58:53.526559+0000","last_fullsized":"2024-09-14T11:58:53.526559+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:15.594681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"263'556","reported_seq":1397,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:52.309850+0000","last_change":"2024-09-14T10:46:54.390213+0000","last_active":"2024-09-14T12:00:52.309850+0000","last_peered":"2024-09-14T12:00:52.309850+0000","last_clean":"2024-09-14T12:00:52.309850+0000","last_became_active":"2024-09-14T10:46:54.389880+0000","last_became_peered":"2024-09-14T10:46:54.389880+0000","last_unstale":"2024-09-14T12:00:52.309850+0000","last_undegraded":"2024-09-14T12:00:52.309850+0000","last_fullsized":"2024-09-14T12:00:52.309850+0000","mapping_epoch":36,"log_start":"263'500","ondisk_log_start":"263'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:56.630763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1361,"num_read_kb":1337,"num_write":1147,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"263'1285","reported_seq":3010,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.405223+0000","last_change":"2024-09-14T10:46:46.343876+0000","last_active":"2024-09-14T11:58:20.405223+0000","last_peered":"2024-09-14T11:58:20.405223+0000","last_clean":"2024-09-14T11:58:20.405223+0000","last_became_active":"2024-09-14T10:46:46.343603+0000","last_became_peered":"2024-09-14T10:46:46.343603+0000","last_unstale":"2024-09-14T11:58:20.405223+0000","last_undegraded":"2024-09-14T11:58:20.405223+0000","last_fullsized":"2024-09-14T11:58:20.405223+0000","mapping_epoch":28,"log_start":"263'1200","ondisk_log_start":"263'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":1200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:55:04.271839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6021,"num_read_kb":5313,"num_write":1785,"num_write_kb":753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"263'327","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.263699+0000","last_change":"2024-09-14T10:46:44.323710+0000","last_active":"2024-09-14T12:01:19.263699+0000","last_peered":"2024-09-14T12:01:19.263699+0000","last_clean":"2024-09-14T12:01:19.263699+0000","last_became_active":"2024-09-14T10:46:44.322816+0000","last_became_peered":"2024-09-14T10:46:44.322816+0000","last_unstale":"2024-09-14T12:01:19.263699+0000","last_undegraded":"2024-09-14T12:01:19.263699+0000","last_fullsized":"2024-09-14T12:01:19.263699+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:37.849009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":492,"num_write":1114,"num_write_kb":29298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:18.521465+0000","last_change":"2024-09-14T10:46:48.352278+0000","last_active":"2024-09-14T11:58:18.521465+0000","last_peered":"2024-09-14T11:58:18.521465+0000","last_clean":"2024-09-14T11:58:18.521465+0000","last_became_active":"2024-09-14T10:46:48.351893+0000","last_became_peered":"2024-09-14T10:46:48.351893+0000","last_unstale":"2024-09-14T11:58:18.521465+0000","last_undegraded":"2024-09-14T11:58:18.521465+0000","last_fullsized":"2024-09-14T11:58:18.521465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:17.258684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"263'265","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.043439+0000","last_change":"2024-09-14T10:46:50.360064+0000","last_active":"2024-09-14T12:01:19.043439+0000","last_peered":"2024-09-14T12:01:19.043439+0000","last_clean":"2024-09-14T12:01:19.043439+0000","last_became_active":"2024-09-14T10:46:50.359434+0000","last_became_peered":"2024-09-14T10:46:50.359434+0000","last_unstale":"2024-09-14T12:01:19.043439+0000","last_undegraded":"2024-09-14T12:01:19.043439+0000","last_fullsized":"2024-09-14T12:01:19.043439+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:38.484631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44011,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":1031,"num_write":356,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.648763+0000","last_change":"2024-09-14T10:46:52.369655+0000","last_active":"2024-09-14T11:58:40.648763+0000","last_peered":"2024-09-14T11:58:40.648763+0000","last_clean":"2024-09-14T11:58:40.648763+0000","last_became_active":"2024-09-14T10:46:52.369353+0000","last_became_peered":"2024-09-14T10:46:52.369353+0000","last_unstale":"2024-09-14T11:58:40.648763+0000","last_undegraded":"2024-09-14T11:58:40.648763+0000","last_fullsized":"2024-09-14T11:58:40.648763+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:30.464066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"263'2541","reported_seq":4365,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:00.417652+0000","last_change":"2024-09-14T10:46:54.383401+0000","last_active":"2024-09-14T12:00:00.417652+0000","last_peered":"2024-09-14T12:00:00.417652+0000","last_clean":"2024-09-14T12:00:00.417652+0000","last_became_active":"2024-09-14T10:46:54.383100+0000","last_became_peered":"2024-09-14T10:46:54.383100+0000","last_unstale":"2024-09-14T12:00:00.417652+0000","last_undegraded":"2024-09-14T12:00:00.417652+0000","last_fullsized":"2024-09-14T12:00:00.417652+0000","mapping_epoch":36,"log_start":"263'2500","ondisk_log_start":"263'2500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":2500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:25.507491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6216,"num_read_kb":6221,"num_write":5164,"num_write_kb":1877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"263'513","reported_seq":2285,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.759401+0000","last_change":"2024-09-14T10:46:46.338242+0000","last_active":"2024-09-14T11:59:29.759401+0000","last_peered":"2024-09-14T11:59:29.759401+0000","last_clean":"2024-09-14T11:59:29.759401+0000","last_became_active":"2024-09-14T10:46:46.337951+0000","last_became_peered":"2024-09-14T10:46:46.337951+0000","last_unstale":"2024-09-14T11:59:29.759401+0000","last_undegraded":"2024-09-14T11:59:29.759401+0000","last_fullsized":"2024-09-14T11:59:29.759401+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":500,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:40.454176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2937,"num_read_kb":2795,"num_write":635,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"263'349","reported_seq":1028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.342519+0000","last_change":"2024-09-14T10:46:44.334345+0000","last_active":"2024-09-14T12:01:19.342519+0000","last_peered":"2024-09-14T12:01:19.342519+0000","last_clean":"2024-09-14T12:01:19.342519+0000","last_became_active":"2024-09-14T10:46:44.331705+0000","last_became_peered":"2024-09-14T10:46:44.331705+0000","last_unstale":"2024-09-14T12:01:19.342519+0000","last_undegraded":"2024-09-14T12:01:19.342519+0000","last_fullsized":"2024-09-14T12:01:19.342519+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:08.805234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":652,"num_read_kb":33315,"num_write":1115,"num_write_kb":35089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.460327+0000","last_change":"2024-09-14T10:46:48.355757+0000","last_active":"2024-09-14T11:58:48.460327+0000","last_peered":"2024-09-14T11:58:48.460327+0000","last_clean":"2024-09-14T11:58:48.460327+0000","last_became_active":"2024-09-14T10:46:48.354092+0000","last_became_peered":"2024-09-14T10:46:48.354092+0000","last_unstale":"2024-09-14T11:58:48.460327+0000","last_undegraded":"2024-09-14T11:58:48.460327+0000","last_fullsized":"2024-09-14T11:58:48.460327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:49.272454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"263'342","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.405360+0000","last_change":"2024-09-14T10:46:50.364160+0000","last_active":"2024-09-14T12:01:18.405360+0000","last_peered":"2024-09-14T12:01:18.405360+0000","last_clean":"2024-09-14T12:01:18.405360+0000","last_became_active":"2024-09-14T10:46:50.363893+0000","last_became_peered":"2024-09-14T10:46:50.363893+0000","last_unstale":"2024-09-14T12:01:18.405360+0000","last_undegraded":"2024-09-14T12:01:18.405360+0000","last_fullsized":"2024-09-14T12:01:18.405360+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:50.322137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44240,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":541,"num_read_kb":1145,"num_write":426,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"263'830","reported_seq":5035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.320600+0000","last_change":"2024-09-14T10:46:52.374414+0000","last_active":"2024-09-14T12:01:18.320600+0000","last_peered":"2024-09-14T12:01:18.320600+0000","last_clean":"2024-09-14T12:01:18.320600+0000","last_became_active":"2024-09-14T10:46:52.374152+0000","last_became_peered":"2024-09-14T10:46:52.374152+0000","last_unstale":"2024-09-14T12:01:18.320600+0000","last_undegraded":"2024-09-14T12:01:18.320600+0000","last_fullsized":"2024-09-14T12:01:18.320600+0000","mapping_epoch":34,"log_start":"263'800","ondisk_log_start":"263'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":800,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:31.267699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"263'166","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:50.989484+0000","last_change":"2024-09-14T10:46:54.384757+0000","last_active":"2024-09-14T12:00:50.989484+0000","last_peered":"2024-09-14T12:00:50.989484+0000","last_clean":"2024-09-14T12:00:50.989484+0000","last_became_active":"2024-09-14T10:46:54.383953+0000","last_became_peered":"2024-09-14T10:46:54.383953+0000","last_unstale":"2024-09-14T12:00:50.989484+0000","last_undegraded":"2024-09-14T12:00:50.989484+0000","last_fullsized":"2024-09-14T12:00:50.989484+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:54.206656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":135,"num_write":398,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"263'1056","reported_seq":2528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.757882+0000","last_change":"2024-09-14T10:46:46.348971+0000","last_active":"2024-09-14T11:59:29.757882+0000","last_peered":"2024-09-14T11:59:29.757882+0000","last_clean":"2024-09-14T11:59:29.757882+0000","last_became_active":"2024-09-14T10:46:46.348726+0000","last_became_peered":"2024-09-14T10:46:46.348726+0000","last_unstale":"2024-09-14T11:59:29.757882+0000","last_undegraded":"2024-09-14T11:59:29.757882+0000","last_fullsized":"2024-09-14T11:59:29.757882+0000","mapping_epoch":28,"log_start":"263'1000","ondisk_log_start":"263'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":1000,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:17.855534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4827,"num_read_kb":4287,"num_write":1450,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"263'309","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:24.291444+0000","last_change":"2024-09-14T12:01:24.291444+0000","last_active":"2024-09-14T12:01:24.291444+0000","last_peered":"2024-09-14T12:01:24.291444+0000","last_clean":"2024-09-14T12:01:24.291444+0000","last_became_active":"2024-09-14T10:46:44.332535+0000","last_became_peered":"2024-09-14T10:46:44.332535+0000","last_unstale":"2024-09-14T12:01:24.291444+0000","last_undegraded":"2024-09-14T12:01:24.291444+0000","last_fullsized":"2024-09-14T12:01:24.291444+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'309","last_scrub_stamp":"2024-09-14T12:01:24.291338+0000","last_deep_scrub":"263'309","last_deep_scrub_stamp":"2024-09-14T12:01:24.291338+0000","last_clean_scrub_stamp":"2024-09-14T12:01:24.291338+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:44.362720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267347,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":39478,"num_write":1028,"num_write_kb":35728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:28.522894+0000","last_change":"2024-09-14T10:46:48.351883+0000","last_active":"2024-09-14T11:58:28.522894+0000","last_peered":"2024-09-14T11:58:28.522894+0000","last_clean":"2024-09-14T11:58:28.522894+0000","last_became_active":"2024-09-14T10:46:48.351530+0000","last_became_peered":"2024-09-14T10:46:48.351530+0000","last_unstale":"2024-09-14T11:58:28.522894+0000","last_undegraded":"2024-09-14T11:58:28.522894+0000","last_fullsized":"2024-09-14T11:58:28.522894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:09.714239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"263'470","reported_seq":1118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.227822+0000","last_change":"2024-09-14T10:46:50.361756+0000","last_active":"2024-09-14T12:01:19.227822+0000","last_peered":"2024-09-14T12:01:19.227822+0000","last_clean":"2024-09-14T12:01:19.227822+0000","last_became_active":"2024-09-14T10:46:50.361396+0000","last_became_peered":"2024-09-14T10:46:50.361396+0000","last_unstale":"2024-09-14T12:01:19.227822+0000","last_undegraded":"2024-09-14T12:01:19.227822+0000","last_fullsized":"2024-09-14T12:01:19.227822+0000","mapping_epoch":32,"log_start":"263'400","ondisk_log_start":"263'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:24.662180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93223,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":821,"num_read_kb":1952,"num_write":664,"num_write_kb":533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.456158+0000","last_change":"2024-09-14T10:46:52.373915+0000","last_active":"2024-09-14T11:58:23.456158+0000","last_peered":"2024-09-14T11:58:23.456158+0000","last_clean":"2024-09-14T11:58:23.456158+0000","last_became_active":"2024-09-14T10:46:52.373563+0000","last_became_peered":"2024-09-14T10:46:52.373563+0000","last_unstale":"2024-09-14T11:58:23.456158+0000","last_undegraded":"2024-09-14T11:58:23.456158+0000","last_fullsized":"2024-09-14T11:58:23.456158+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:22.900348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"263'160","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:25.446650+0000","last_change":"2024-09-14T10:46:54.389096+0000","last_active":"2024-09-14T11:58:25.446650+0000","last_peered":"2024-09-14T11:58:25.446650+0000","last_clean":"2024-09-14T11:58:25.446650+0000","last_became_active":"2024-09-14T10:46:54.388429+0000","last_became_peered":"2024-09-14T10:46:54.388429+0000","last_unstale":"2024-09-14T11:58:25.446650+0000","last_undegraded":"2024-09-14T11:58:25.446650+0000","last_fullsized":"2024-09-14T11:58:25.446650+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:38.481519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":168,"num_write":381,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"263'889","reported_seq":2640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.496852+0000","last_change":"2024-09-14T10:46:46.344318+0000","last_active":"2024-09-14T11:59:49.496852+0000","last_peered":"2024-09-14T11:59:49.496852+0000","last_clean":"2024-09-14T11:59:49.496852+0000","last_became_active":"2024-09-14T10:46:46.344022+0000","last_became_peered":"2024-09-14T10:46:46.344022+0000","last_unstale":"2024-09-14T11:59:49.496852+0000","last_undegraded":"2024-09-14T11:59:49.496852+0000","last_fullsized":"2024-09-14T11:59:49.496852+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":800,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:44.527085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4406,"num_read_kb":4005,"num_write":1167,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"263'312","reported_seq":980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.371004+0000","last_change":"2024-09-14T10:46:44.318998+0000","last_active":"2024-09-14T12:01:19.371004+0000","last_peered":"2024-09-14T12:01:19.371004+0000","last_clean":"2024-09-14T12:01:19.371004+0000","last_became_active":"2024-09-14T10:46:44.318584+0000","last_became_peered":"2024-09-14T10:46:44.318584+0000","last_unstale":"2024-09-14T12:01:19.371004+0000","last_undegraded":"2024-09-14T12:01:19.371004+0000","last_fullsized":"2024-09-14T12:01:19.371004+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:23.546671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":581,"num_read_kb":7202,"num_write":854,"num_write_kb":20635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.450101+0000","last_change":"2024-09-14T10:46:48.355970+0000","last_active":"2024-09-14T11:58:50.450101+0000","last_peered":"2024-09-14T11:58:50.450101+0000","last_clean":"2024-09-14T11:58:50.450101+0000","last_became_active":"2024-09-14T10:46:48.355691+0000","last_became_peered":"2024-09-14T10:46:48.355691+0000","last_unstale":"2024-09-14T11:58:50.450101+0000","last_undegraded":"2024-09-14T11:58:50.450101+0000","last_fullsized":"2024-09-14T11:58:50.450101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:57.269685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"263'341","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.293202+0000","last_change":"2024-09-14T10:46:50.363028+0000","last_active":"2024-09-14T12:01:19.293202+0000","last_peered":"2024-09-14T12:01:19.293202+0000","last_clean":"2024-09-14T12:01:19.293202+0000","last_became_active":"2024-09-14T10:46:50.362757+0000","last_became_peered":"2024-09-14T10:46:50.362757+0000","last_unstale":"2024-09-14T12:01:19.293202+0000","last_undegraded":"2024-09-14T12:01:19.293202+0000","last_fullsized":"2024-09-14T12:01:19.293202+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:26.991536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":590,"num_read_kb":1339,"num_write":526,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.453243+0000","last_change":"2024-09-14T10:46:52.374126+0000","last_active":"2024-09-14T11:59:10.453243+0000","last_peered":"2024-09-14T11:59:10.453243+0000","last_clean":"2024-09-14T11:59:10.453243+0000","last_became_active":"2024-09-14T10:46:52.373836+0000","last_became_peered":"2024-09-14T10:46:52.373836+0000","last_unstale":"2024-09-14T11:59:10.453243+0000","last_undegraded":"2024-09-14T11:59:10.453243+0000","last_fullsized":"2024-09-14T11:59:10.453243+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:57.883157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"263'94","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:41.091887+0000","last_change":"2024-09-14T10:46:54.387376+0000","last_active":"2024-09-14T12:00:41.091887+0000","last_peered":"2024-09-14T12:00:41.091887+0000","last_clean":"2024-09-14T12:00:41.091887+0000","last_became_active":"2024-09-14T10:46:54.387066+0000","last_became_peered":"2024-09-14T10:46:54.387066+0000","last_unstale":"2024-09-14T12:00:41.091887+0000","last_undegraded":"2024-09-14T12:00:41.091887+0000","last_fullsized":"2024-09-14T12:00:41.091887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:19.903031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":95,"num_write":224,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"263'1164","reported_seq":2674,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.498768+0000","last_change":"2024-09-14T10:46:46.340659+0000","last_active":"2024-09-14T11:59:49.498768+0000","last_peered":"2024-09-14T11:59:49.498768+0000","last_clean":"2024-09-14T11:59:49.498768+0000","last_became_active":"2024-09-14T10:46:46.340228+0000","last_became_peered":"2024-09-14T10:46:46.340228+0000","last_unstale":"2024-09-14T11:59:49.498768+0000","last_undegraded":"2024-09-14T11:59:49.498768+0000","last_fullsized":"2024-09-14T11:59:49.498768+0000","mapping_epoch":28,"log_start":"263'1100","ondisk_log_start":"263'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":1100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:27.760596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5254,"num_read_kb":4633,"num_write":1618,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"263'413","reported_seq":1126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.396142+0000","last_change":"2024-09-14T10:46:44.324787+0000","last_active":"2024-09-14T12:01:19.396142+0000","last_peered":"2024-09-14T12:01:19.396142+0000","last_clean":"2024-09-14T12:01:19.396142+0000","last_became_active":"2024-09-14T10:46:44.324440+0000","last_became_peered":"2024-09-14T10:46:44.324440+0000","last_unstale":"2024-09-14T12:01:19.396142+0000","last_undegraded":"2024-09-14T12:01:19.396142+0000","last_fullsized":"2024-09-14T12:01:19.396142+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:52.318910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":948,"num_read_kb":1994,"num_write":1270,"num_write_kb":27495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.460346+0000","last_change":"2024-09-14T10:46:48.354236+0000","last_active":"2024-09-14T11:58:48.460346+0000","last_peered":"2024-09-14T11:58:48.460346+0000","last_clean":"2024-09-14T11:58:48.460346+0000","last_became_active":"2024-09-14T10:46:48.353513+0000","last_became_peered":"2024-09-14T10:46:48.353513+0000","last_unstale":"2024-09-14T11:58:48.460346+0000","last_undegraded":"2024-09-14T11:58:48.460346+0000","last_fullsized":"2024-09-14T11:58:48.460346+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:10.512984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"263'332","reported_seq":937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.858058+0000","last_change":"2024-09-14T10:46:50.362779+0000","last_active":"2024-09-14T12:01:18.858058+0000","last_peered":"2024-09-14T12:01:18.858058+0000","last_clean":"2024-09-14T12:01:18.858058+0000","last_became_active":"2024-09-14T10:46:50.362492+0000","last_became_peered":"2024-09-14T10:46:50.362492+0000","last_unstale":"2024-09-14T12:01:18.858058+0000","last_undegraded":"2024-09-14T12:01:18.858058+0000","last_fullsized":"2024-09-14T12:01:18.858058+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:23.999202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50533,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":553,"num_read_kb":1190,"num_write":436,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"263'787","reported_seq":4622,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.428164+0000","last_change":"2024-09-14T10:46:52.375362+0000","last_active":"2024-09-14T12:01:17.428164+0000","last_peered":"2024-09-14T12:01:17.428164+0000","last_clean":"2024-09-14T12:01:17.428164+0000","last_became_active":"2024-09-14T10:46:52.374947+0000","last_became_peered":"2024-09-14T10:46:52.374947+0000","last_unstale":"2024-09-14T12:01:17.428164+0000","last_undegraded":"2024-09-14T12:01:17.428164+0000","last_fullsized":"2024-09-14T12:01:17.428164+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:43.204468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"263'122","reported_seq":650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.113955+0000","last_change":"2024-09-14T10:46:54.382345+0000","last_active":"2024-09-14T11:59:32.113955+0000","last_peered":"2024-09-14T11:59:32.113955+0000","last_clean":"2024-09-14T11:59:32.113955+0000","last_became_active":"2024-09-14T10:46:54.382004+0000","last_became_peered":"2024-09-14T10:46:54.382004+0000","last_unstale":"2024-09-14T11:59:32.113955+0000","last_undegraded":"2024-09-14T11:59:32.113955+0000","last_fullsized":"2024-09-14T11:59:32.113955+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:14.712092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1268,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":189,"num_write":324,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"263'836","reported_seq":2527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.306491+0000","last_change":"2024-09-14T10:46:46.347624+0000","last_active":"2024-09-14T11:58:50.306491+0000","last_peered":"2024-09-14T11:58:50.306491+0000","last_clean":"2024-09-14T11:58:50.306491+0000","last_became_active":"2024-09-14T10:46:46.347307+0000","last_became_peered":"2024-09-14T10:46:46.347307+0000","last_unstale":"2024-09-14T11:58:50.306491+0000","last_undegraded":"2024-09-14T11:58:50.306491+0000","last_fullsized":"2024-09-14T11:58:50.306491+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:17.498211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4222,"num_read_kb":3846,"num_write":1108,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"263'364","reported_seq":1139,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.394169+0000","last_change":"2024-09-14T10:46:44.330921+0000","last_active":"2024-09-14T12:01:19.394169+0000","last_peered":"2024-09-14T12:01:19.394169+0000","last_clean":"2024-09-14T12:01:19.394169+0000","last_became_active":"2024-09-14T10:46:44.330567+0000","last_became_peered":"2024-09-14T10:46:44.330567+0000","last_unstale":"2024-09-14T12:01:19.394169+0000","last_undegraded":"2024-09-14T12:01:19.394169+0000","last_fullsized":"2024-09-14T12:01:19.394169+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:40.240207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":975,"num_read_kb":55651,"num_write":1153,"num_write_kb":35628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1461,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.207601+0000","last_change":"2024-09-14T10:46:48.356084+0000","last_active":"2024-09-14T12:01:17.207601+0000","last_peered":"2024-09-14T12:01:17.207601+0000","last_clean":"2024-09-14T12:01:17.207601+0000","last_became_active":"2024-09-14T10:46:48.355697+0000","last_became_peered":"2024-09-14T10:46:48.355697+0000","last_unstale":"2024-09-14T12:01:17.207601+0000","last_undegraded":"2024-09-14T12:01:17.207601+0000","last_fullsized":"2024-09-14T12:01:17.207601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:15.468545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"263'106","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.526629+0000","last_change":"2024-09-14T10:46:50.369569+0000","last_active":"2024-09-14T11:58:53.526629+0000","last_peered":"2024-09-14T11:58:53.526629+0000","last_clean":"2024-09-14T11:58:53.526629+0000","last_became_active":"2024-09-14T10:46:50.369337+0000","last_became_peered":"2024-09-14T10:46:50.369337+0000","last_unstale":"2024-09-14T11:58:53.526629+0000","last_undegraded":"2024-09-14T11:58:53.526629+0000","last_fullsized":"2024-09-14T11:58:53.526629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:49.461034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"263'803","reported_seq":2611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.186080+0000","last_change":"2024-09-14T10:46:52.374673+0000","last_active":"2024-09-14T12:01:19.186080+0000","last_peered":"2024-09-14T12:01:19.186080+0000","last_clean":"2024-09-14T12:01:19.186080+0000","last_became_active":"2024-09-14T10:46:52.374252+0000","last_became_peered":"2024-09-14T10:46:52.374252+0000","last_unstale":"2024-09-14T12:01:19.186080+0000","last_undegraded":"2024-09-14T12:01:19.186080+0000","last_fullsized":"2024-09-14T12:01:19.186080+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:12.425757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"263'119","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:50.989997+0000","last_change":"2024-09-14T10:46:54.386075+0000","last_active":"2024-09-14T12:00:50.989997+0000","last_peered":"2024-09-14T12:00:50.989997+0000","last_clean":"2024-09-14T12:00:50.989997+0000","last_became_active":"2024-09-14T10:46:54.384249+0000","last_became_peered":"2024-09-14T10:46:54.384249+0000","last_unstale":"2024-09-14T12:00:50.989997+0000","last_undegraded":"2024-09-14T12:00:50.989997+0000","last_fullsized":"2024-09-14T12:00:50.989997+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:21.699653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":125,"num_write":281,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"263'466","reported_seq":1939,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.500118+0000","last_change":"2024-09-14T10:46:46.342756+0000","last_active":"2024-09-14T11:59:49.500118+0000","last_peered":"2024-09-14T11:59:49.500118+0000","last_clean":"2024-09-14T11:59:49.500118+0000","last_became_active":"2024-09-14T10:46:46.342466+0000","last_became_peered":"2024-09-14T10:46:46.342466+0000","last_unstale":"2024-09-14T11:59:49.500118+0000","last_undegraded":"2024-09-14T11:59:49.500118+0000","last_fullsized":"2024-09-14T11:59:49.500118+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:43.804852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2422,"num_read_kb":2241,"num_write":583,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"263'288","reported_seq":915,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.308222+0000","last_change":"2024-09-14T10:46:44.329354+0000","last_active":"2024-09-14T12:01:19.308222+0000","last_peered":"2024-09-14T12:01:19.308222+0000","last_clean":"2024-09-14T12:01:19.308222+0000","last_became_active":"2024-09-14T10:46:44.329014+0000","last_became_peered":"2024-09-14T10:46:44.329014+0000","last_unstale":"2024-09-14T12:01:19.308222+0000","last_undegraded":"2024-09-14T12:01:19.308222+0000","last_fullsized":"2024-09-14T12:01:19.308222+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:32.183184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":506,"num_read_kb":30778,"num_write":881,"num_write_kb":14950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.533075+0000","last_change":"2024-09-14T10:46:48.358952+0000","last_active":"2024-09-14T11:58:50.533075+0000","last_peered":"2024-09-14T11:58:50.533075+0000","last_clean":"2024-09-14T11:58:50.533075+0000","last_became_active":"2024-09-14T10:46:48.358586+0000","last_became_peered":"2024-09-14T10:46:48.358586+0000","last_unstale":"2024-09-14T11:58:50.533075+0000","last_undegraded":"2024-09-14T11:58:50.533075+0000","last_fullsized":"2024-09-14T11:58:50.533075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:11.753221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"263'377","reported_seq":1006,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.075637+0000","last_change":"2024-09-14T10:46:50.367245+0000","last_active":"2024-09-14T12:01:18.075637+0000","last_peered":"2024-09-14T12:01:18.075637+0000","last_clean":"2024-09-14T12:01:18.075637+0000","last_became_active":"2024-09-14T10:46:50.365715+0000","last_became_peered":"2024-09-14T10:46:50.365715+0000","last_unstale":"2024-09-14T12:01:18.075637+0000","last_undegraded":"2024-09-14T12:01:18.075637+0000","last_fullsized":"2024-09-14T12:01:18.075637+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:16.793655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45582,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":610,"num_read_kb":1238,"num_write":470,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.306951+0000","last_change":"2024-09-14T10:46:52.370062+0000","last_active":"2024-09-14T11:58:55.306951+0000","last_peered":"2024-09-14T11:58:55.306951+0000","last_clean":"2024-09-14T11:58:55.306951+0000","last_became_active":"2024-09-14T10:46:52.369746+0000","last_became_peered":"2024-09-14T10:46:52.369746+0000","last_unstale":"2024-09-14T11:58:55.306951+0000","last_undegraded":"2024-09-14T11:58:55.306951+0000","last_fullsized":"2024-09-14T11:58:55.306951+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:38.246502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"263'156","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.673531+0000","last_change":"2024-09-14T10:46:54.384418+0000","last_active":"2024-09-14T11:59:32.673531+0000","last_peered":"2024-09-14T11:59:32.673531+0000","last_clean":"2024-09-14T11:59:32.673531+0000","last_became_active":"2024-09-14T10:46:54.384119+0000","last_became_peered":"2024-09-14T10:46:54.384119+0000","last_unstale":"2024-09-14T11:59:32.673531+0000","last_undegraded":"2024-09-14T11:59:32.673531+0000","last_fullsized":"2024-09-14T11:59:32.673531+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:04.224188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":393,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"263'776","reported_seq":2204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.103437+0000","last_change":"2024-09-14T10:46:46.334782+0000","last_active":"2024-09-14T11:58:05.103437+0000","last_peered":"2024-09-14T11:58:05.103437+0000","last_clean":"2024-09-14T11:58:05.103437+0000","last_became_active":"2024-09-14T10:46:46.334444+0000","last_became_peered":"2024-09-14T10:46:46.334444+0000","last_unstale":"2024-09-14T11:58:05.103437+0000","last_undegraded":"2024-09-14T11:58:05.103437+0000","last_fullsized":"2024-09-14T11:58:05.103437+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:28.537376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3619,"num_read_kb":3234,"num_write":1038,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:24.785694+0000","last_change":"2024-09-14T12:01:24.785694+0000","last_active":"2024-09-14T12:01:24.785694+0000","last_peered":"2024-09-14T12:01:24.785694+0000","last_clean":"2024-09-14T12:01:24.785694+0000","last_became_active":"2024-09-14T10:46:26.241454+0000","last_became_peered":"2024-09-14T10:46:26.241454+0000","last_unstale":"2024-09-14T12:01:24.785694+0000","last_undegraded":"2024-09-14T12:01:24.785694+0000","last_fullsized":"2024-09-14T12:01:24.785694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-14T12:01:24.785613+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-14T12:01:24.785613+0000","last_clean_scrub_stamp":"2024-09-14T12:01:24.785613+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:57.745824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":534,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:25.522947+0000","last_change":"2024-09-14T10:46:35.277926+0000","last_active":"2024-09-14T11:57:25.522947+0000","last_peered":"2024-09-14T11:57:25.522947+0000","last_clean":"2024-09-14T11:57:25.522947+0000","last_became_active":"2024-09-14T10:46:33.413305+0000","last_became_peered":"2024-09-14T10:46:33.413305+0000","last_unstale":"2024-09-14T11:57:25.522947+0000","last_undegraded":"2024-09-14T11:57:25.522947+0000","last_fullsized":"2024-09-14T11:57:25.522947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:13.605387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092058099999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"263'313","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.316155+0000","last_change":"2024-09-14T10:46:44.329784+0000","last_active":"2024-09-14T12:01:19.316155+0000","last_peered":"2024-09-14T12:01:19.316155+0000","last_clean":"2024-09-14T12:01:19.316155+0000","last_became_active":"2024-09-14T10:46:44.329050+0000","last_became_peered":"2024-09-14T10:46:44.329050+0000","last_unstale":"2024-09-14T12:01:19.316155+0000","last_undegraded":"2024-09-14T12:01:19.316155+0000","last_fullsized":"2024-09-14T12:01:19.316155+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:43.544984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":32601,"num_write":1066,"num_write_kb":17351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"38'5","reported_seq":990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.195369+0000","last_change":"2024-09-14T10:46:48.353767+0000","last_active":"2024-09-14T12:01:17.195369+0000","last_peered":"2024-09-14T12:01:17.195369+0000","last_clean":"2024-09-14T12:01:17.195369+0000","last_became_active":"2024-09-14T10:46:48.353319+0000","last_became_peered":"2024-09-14T10:46:48.353319+0000","last_unstale":"2024-09-14T12:01:17.195369+0000","last_undegraded":"2024-09-14T12:01:17.195369+0000","last_fullsized":"2024-09-14T12:01:17.195369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:38.932761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"263'795","reported_seq":1515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.746391+0000","last_change":"2024-09-14T10:46:50.363357+0000","last_active":"2024-09-14T12:01:18.746391+0000","last_peered":"2024-09-14T12:01:18.746391+0000","last_clean":"2024-09-14T12:01:18.746391+0000","last_became_active":"2024-09-14T10:46:50.362908+0000","last_became_peered":"2024-09-14T10:46:50.362908+0000","last_unstale":"2024-09-14T12:01:18.746391+0000","last_undegraded":"2024-09-14T12:01:18.746391+0000","last_fullsized":"2024-09-14T12:01:18.746391+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:43.112130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143024,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1563,"num_read_kb":3671,"num_write":1508,"num_write_kb":1333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.456299+0000","last_change":"2024-09-14T10:46:52.371975+0000","last_active":"2024-09-14T11:58:23.456299+0000","last_peered":"2024-09-14T11:58:23.456299+0000","last_clean":"2024-09-14T11:58:23.456299+0000","last_became_active":"2024-09-14T10:46:52.371684+0000","last_became_peered":"2024-09-14T10:46:52.371684+0000","last_unstale":"2024-09-14T11:58:23.456299+0000","last_undegraded":"2024-09-14T11:58:23.456299+0000","last_fullsized":"2024-09-14T11:58:23.456299+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:40.156605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"263'205","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.737078+0000","last_change":"2024-09-14T10:46:54.382314+0000","last_active":"2024-09-14T11:59:34.737078+0000","last_peered":"2024-09-14T11:59:34.737078+0000","last_clean":"2024-09-14T11:59:34.737078+0000","last_became_active":"2024-09-14T10:46:54.382019+0000","last_became_peered":"2024-09-14T10:46:54.382019+0000","last_unstale":"2024-09-14T11:59:34.737078+0000","last_undegraded":"2024-09-14T11:59:34.737078+0000","last_fullsized":"2024-09-14T11:59:34.737078+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:50.945970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":483,"num_read_kb":466,"num_write":435,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"263'817","reported_seq":2421,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.147601+0000","last_change":"2024-09-14T10:46:46.345582+0000","last_active":"2024-09-14T12:00:51.147601+0000","last_peered":"2024-09-14T12:00:51.147601+0000","last_clean":"2024-09-14T12:00:51.147601+0000","last_became_active":"2024-09-14T10:46:46.345302+0000","last_became_peered":"2024-09-14T10:46:46.345302+0000","last_unstale":"2024-09-14T12:00:51.147601+0000","last_undegraded":"2024-09-14T12:00:51.147601+0000","last_fullsized":"2024-09-14T12:00:51.147601+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:17.727283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3876,"num_read_kb":3495,"num_write":1050,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.531770+0000","last_change":"2024-09-14T10:46:35.277550+0000","last_active":"2024-09-14T11:58:40.531770+0000","last_peered":"2024-09-14T11:58:40.531770+0000","last_clean":"2024-09-14T11:58:40.531770+0000","last_became_active":"2024-09-14T10:46:33.265619+0000","last_became_peered":"2024-09-14T10:46:33.265619+0000","last_unstale":"2024-09-14T11:58:40.531770+0000","last_undegraded":"2024-09-14T11:58:40.531770+0000","last_fullsized":"2024-09-14T11:58:40.531770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:56.062295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058478399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"263'340","reported_seq":1188,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.361077+0000","last_change":"2024-09-14T10:46:44.320448+0000","last_active":"2024-09-14T12:01:19.361077+0000","last_peered":"2024-09-14T12:01:19.361077+0000","last_clean":"2024-09-14T12:01:19.361077+0000","last_became_active":"2024-09-14T10:46:44.320087+0000","last_became_peered":"2024-09-14T10:46:44.320087+0000","last_unstale":"2024-09-14T12:01:19.361077+0000","last_undegraded":"2024-09-14T12:01:19.361077+0000","last_fullsized":"2024-09-14T12:01:19.361077+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:18.710537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1201,"num_read_kb":9242,"num_write":1119,"num_write_kb":25141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.529481+0000","last_change":"2024-09-14T10:46:48.350940+0000","last_active":"2024-09-14T11:58:20.529481+0000","last_peered":"2024-09-14T11:58:20.529481+0000","last_clean":"2024-09-14T11:58:20.529481+0000","last_became_active":"2024-09-14T10:46:48.350653+0000","last_became_peered":"2024-09-14T10:46:48.350653+0000","last_unstale":"2024-09-14T11:58:20.529481+0000","last_undegraded":"2024-09-14T11:58:20.529481+0000","last_fullsized":"2024-09-14T11:58:20.529481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:11.993887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"263'1395","reported_seq":3236,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.111806+0000","last_change":"2024-09-14T10:46:50.362470+0000","last_active":"2024-09-14T12:01:19.111806+0000","last_peered":"2024-09-14T12:01:19.111806+0000","last_clean":"2024-09-14T12:01:19.111806+0000","last_became_active":"2024-09-14T10:46:50.362128+0000","last_became_peered":"2024-09-14T10:46:50.362128+0000","last_unstale":"2024-09-14T12:01:19.111806+0000","last_undegraded":"2024-09-14T12:01:19.111806+0000","last_fullsized":"2024-09-14T12:01:19.111806+0000","mapping_epoch":32,"log_start":"263'1300","ondisk_log_start":"263'1300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":1300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:16.340703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160652,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2189,"num_read_kb":4301,"num_write":1286,"num_write_kb":1103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.525954+0000","last_change":"2024-09-14T10:46:52.375637+0000","last_active":"2024-09-14T11:57:50.525954+0000","last_peered":"2024-09-14T11:57:50.525954+0000","last_clean":"2024-09-14T11:57:50.525954+0000","last_became_active":"2024-09-14T10:46:52.375344+0000","last_became_peered":"2024-09-14T10:46:52.375344+0000","last_unstale":"2024-09-14T11:57:50.525954+0000","last_undegraded":"2024-09-14T11:57:50.525954+0000","last_fullsized":"2024-09-14T11:57:50.525954+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:28.073066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"263'95","reported_seq":596,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.585158+0000","last_change":"2024-09-14T10:46:54.384671+0000","last_active":"2024-09-14T11:59:33.585158+0000","last_peered":"2024-09-14T11:59:33.585158+0000","last_clean":"2024-09-14T11:59:33.585158+0000","last_became_active":"2024-09-14T10:46:54.384354+0000","last_became_peered":"2024-09-14T10:46:54.384354+0000","last_unstale":"2024-09-14T11:59:33.585158+0000","last_undegraded":"2024-09-14T11:59:33.585158+0000","last_fullsized":"2024-09-14T11:59:33.585158+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:42.323130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":95,"num_write":225,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"263'543","reported_seq":2137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:18.521582+0000","last_change":"2024-09-14T10:46:46.345522+0000","last_active":"2024-09-14T11:58:18.521582+0000","last_peered":"2024-09-14T11:58:18.521582+0000","last_clean":"2024-09-14T11:58:18.521582+0000","last_became_active":"2024-09-14T10:46:46.345234+0000","last_became_peered":"2024-09-14T10:46:46.345234+0000","last_unstale":"2024-09-14T11:58:18.521582+0000","last_undegraded":"2024-09-14T11:58:18.521582+0000","last_fullsized":"2024-09-14T11:58:18.521582+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:05.993847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2916,"num_read_kb":2703,"num_write":726,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:25.438151+0000","last_change":"2024-09-14T10:46:35.332938+0000","last_active":"2024-09-14T11:57:25.438151+0000","last_peered":"2024-09-14T11:57:25.438151+0000","last_clean":"2024-09-14T11:57:25.438151+0000","last_became_active":"2024-09-14T10:46:33.265185+0000","last_became_peered":"2024-09-14T10:46:33.265185+0000","last_unstale":"2024-09-14T11:57:25.438151+0000","last_undegraded":"2024-09-14T11:57:25.438151+0000","last_fullsized":"2024-09-14T11:57:25.438151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:20.170242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000550246,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"263'312","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.318201+0000","last_change":"2024-09-14T10:46:44.327457+0000","last_active":"2024-09-14T12:01:19.318201+0000","last_peered":"2024-09-14T12:01:19.318201+0000","last_clean":"2024-09-14T12:01:19.318201+0000","last_became_active":"2024-09-14T10:46:44.327101+0000","last_became_peered":"2024-09-14T10:46:44.327101+0000","last_unstale":"2024-09-14T12:01:19.318201+0000","last_undegraded":"2024-09-14T12:01:19.318201+0000","last_fullsized":"2024-09-14T12:01:19.318201+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:34.079248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":609,"num_read_kb":99380,"num_write":1036,"num_write_kb":24751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.445762+0000","last_change":"2024-09-14T10:46:48.354125+0000","last_active":"2024-09-14T11:58:20.445762+0000","last_peered":"2024-09-14T11:58:20.445762+0000","last_clean":"2024-09-14T11:58:20.445762+0000","last_became_active":"2024-09-14T10:46:48.353803+0000","last_became_peered":"2024-09-14T10:46:48.353803+0000","last_unstale":"2024-09-14T11:58:20.445762+0000","last_undegraded":"2024-09-14T11:58:20.445762+0000","last_fullsized":"2024-09-14T11:58:20.445762+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:10.885769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"263'303","reported_seq":1752,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:50.881334+0000","last_change":"2024-09-14T10:46:50.365198+0000","last_active":"2024-09-14T12:00:50.881334+0000","last_peered":"2024-09-14T12:00:50.881334+0000","last_clean":"2024-09-14T12:00:50.881334+0000","last_became_active":"2024-09-14T10:46:50.364857+0000","last_became_peered":"2024-09-14T10:46:50.364857+0000","last_unstale":"2024-09-14T12:00:50.881334+0000","last_undegraded":"2024-09-14T12:00:50.881334+0000","last_fullsized":"2024-09-14T12:00:50.881334+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:49.821470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":263,"num_read_kb":255,"num_write":243,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:45.640374+0000","last_change":"2024-09-14T10:46:52.367740+0000","last_active":"2024-09-14T11:57:45.640374+0000","last_peered":"2024-09-14T11:57:45.640374+0000","last_clean":"2024-09-14T11:57:45.640374+0000","last_became_active":"2024-09-14T10:46:52.365738+0000","last_became_peered":"2024-09-14T10:46:52.365738+0000","last_unstale":"2024-09-14T11:57:45.640374+0000","last_undegraded":"2024-09-14T11:57:45.640374+0000","last_fullsized":"2024-09-14T11:57:45.640374+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:55.844741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"263'261","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.991420+0000","last_change":"2024-09-14T10:46:54.379215+0000","last_active":"2024-09-14T11:59:34.991420+0000","last_peered":"2024-09-14T11:59:34.991420+0000","last_clean":"2024-09-14T11:59:34.991420+0000","last_became_active":"2024-09-14T10:46:54.378930+0000","last_became_peered":"2024-09-14T10:46:54.378930+0000","last_unstale":"2024-09-14T11:59:34.991420+0000","last_undegraded":"2024-09-14T11:59:34.991420+0000","last_fullsized":"2024-09-14T11:59:34.991420+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:20.494987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":478,"num_read_kb":502,"num_write":559,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"263'787","reported_seq":2353,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:43.533534+0000","last_change":"2024-09-14T10:46:46.334984+0000","last_active":"2024-09-14T11:59:43.533534+0000","last_peered":"2024-09-14T11:59:43.533534+0000","last_clean":"2024-09-14T11:59:43.533534+0000","last_became_active":"2024-09-14T10:46:46.334679+0000","last_became_peered":"2024-09-14T10:46:46.334679+0000","last_unstale":"2024-09-14T11:59:43.533534+0000","last_undegraded":"2024-09-14T11:59:43.533534+0000","last_fullsized":"2024-09-14T11:59:43.533534+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:52.255486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3681,"num_read_kb":3336,"num_write":1001,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:25.522916+0000","last_change":"2024-09-14T10:46:35.278266+0000","last_active":"2024-09-14T11:57:25.522916+0000","last_peered":"2024-09-14T11:57:25.522916+0000","last_clean":"2024-09-14T11:57:25.522916+0000","last_became_active":"2024-09-14T10:46:33.296172+0000","last_became_peered":"2024-09-14T10:46:33.296172+0000","last_unstale":"2024-09-14T11:57:25.522916+0000","last_undegraded":"2024-09-14T11:57:25.522916+0000","last_fullsized":"2024-09-14T11:57:25.522916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:36.394821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00125464,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"263'339","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:25.269159+0000","last_change":"2024-09-14T12:01:25.269159+0000","last_active":"2024-09-14T12:01:25.269159+0000","last_peered":"2024-09-14T12:01:25.269159+0000","last_clean":"2024-09-14T12:01:25.269159+0000","last_became_active":"2024-09-14T10:46:44.323974+0000","last_became_peered":"2024-09-14T10:46:44.323974+0000","last_unstale":"2024-09-14T12:01:25.269159+0000","last_undegraded":"2024-09-14T12:01:25.269159+0000","last_fullsized":"2024-09-14T12:01:25.269159+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-14T12:01:25.269042+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-14T12:01:25.269042+0000","last_clean_scrub_stamp":"2024-09-14T12:01:25.269042+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:28.484276+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":608,"num_read_kb":7380,"num_write":1200,"num_write_kb":32204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:55.442524+0000","last_change":"2024-09-14T10:46:48.355092+0000","last_active":"2024-09-14T11:57:55.442524+0000","last_peered":"2024-09-14T11:57:55.442524+0000","last_clean":"2024-09-14T11:57:55.442524+0000","last_became_active":"2024-09-14T10:46:48.354786+0000","last_became_peered":"2024-09-14T10:46:48.354786+0000","last_unstale":"2024-09-14T11:57:55.442524+0000","last_undegraded":"2024-09-14T11:57:55.442524+0000","last_fullsized":"2024-09-14T11:57:55.442524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:26.687521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"263'154","reported_seq":714,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:33.477130+0000","last_change":"2024-09-14T10:46:50.363852+0000","last_active":"2024-09-14T12:00:33.477130+0000","last_peered":"2024-09-14T12:00:33.477130+0000","last_clean":"2024-09-14T12:00:33.477130+0000","last_became_active":"2024-09-14T10:46:50.363538+0000","last_became_peered":"2024-09-14T10:46:50.363538+0000","last_unstale":"2024-09-14T12:00:33.477130+0000","last_undegraded":"2024-09-14T12:00:33.477130+0000","last_fullsized":"2024-09-14T12:00:33.477130+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:41.224986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":198,"num_read_kb":192,"num_write":144,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:25.530066+0000","last_change":"2024-09-14T10:46:52.371280+0000","last_active":"2024-09-14T11:58:25.530066+0000","last_peered":"2024-09-14T11:58:25.530066+0000","last_clean":"2024-09-14T11:58:25.530066+0000","last_became_active":"2024-09-14T10:46:52.370968+0000","last_became_peered":"2024-09-14T10:46:52.370968+0000","last_unstale":"2024-09-14T11:58:25.530066+0000","last_undegraded":"2024-09-14T11:58:25.530066+0000","last_fullsized":"2024-09-14T11:58:25.530066+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:12.904159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"263'119","reported_seq":669,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.337447+0000","last_change":"2024-09-14T10:46:54.389298+0000","last_active":"2024-09-14T11:58:44.337447+0000","last_peered":"2024-09-14T11:58:44.337447+0000","last_clean":"2024-09-14T11:58:44.337447+0000","last_became_active":"2024-09-14T10:46:54.388938+0000","last_became_peered":"2024-09-14T10:46:54.388938+0000","last_unstale":"2024-09-14T11:58:44.337447+0000","last_undegraded":"2024-09-14T11:58:44.337447+0000","last_fullsized":"2024-09-14T11:58:44.337447+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:20.842708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":281,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"263'403","reported_seq":1966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.216353+0000","last_change":"2024-09-14T10:46:46.335959+0000","last_active":"2024-09-14T11:58:11.216353+0000","last_peered":"2024-09-14T11:58:11.216353+0000","last_clean":"2024-09-14T11:58:11.216353+0000","last_became_active":"2024-09-14T10:46:46.335681+0000","last_became_peered":"2024-09-14T10:46:46.335681+0000","last_unstale":"2024-09-14T11:58:11.216353+0000","last_undegraded":"2024-09-14T11:58:11.216353+0000","last_fullsized":"2024-09-14T11:58:11.216353+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:24.103452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2240,"num_read_kb":2136,"num_write":448,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"263'321","reported_seq":1010,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:24.914780+0000","last_change":"2024-09-14T12:01:24.914780+0000","last_active":"2024-09-14T12:01:24.914780+0000","last_peered":"2024-09-14T12:01:24.914780+0000","last_clean":"2024-09-14T12:01:24.914780+0000","last_became_active":"2024-09-14T10:46:44.319714+0000","last_became_peered":"2024-09-14T10:46:44.319714+0000","last_unstale":"2024-09-14T12:01:24.914780+0000","last_undegraded":"2024-09-14T12:01:24.914780+0000","last_fullsized":"2024-09-14T12:01:24.914780+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'321","last_scrub_stamp":"2024-09-14T12:01:24.914659+0000","last_deep_scrub":"263'321","last_deep_scrub_stamp":"2024-09-14T12:01:24.914659+0000","last_clean_scrub_stamp":"2024-09-14T12:01:24.914659+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:48.960207+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":599,"num_read_kb":77773,"num_write":1050,"num_write_kb":36142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:23.447048+0000","last_change":"2024-09-14T10:46:35.333110+0000","last_active":"2024-09-14T11:57:23.447048+0000","last_peered":"2024-09-14T11:57:23.447048+0000","last_clean":"2024-09-14T11:57:23.447048+0000","last_became_active":"2024-09-14T10:46:33.296049+0000","last_became_peered":"2024-09-14T10:46:33.296049+0000","last_unstale":"2024-09-14T11:57:23.447048+0000","last_undegraded":"2024-09-14T11:57:23.447048+0000","last_fullsized":"2024-09-14T11:57:23.447048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:58.526433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000560203,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:40.639756+0000","last_change":"2024-09-14T10:46:48.350451+0000","last_active":"2024-09-14T11:57:40.639756+0000","last_peered":"2024-09-14T11:57:40.639756+0000","last_clean":"2024-09-14T11:57:40.639756+0000","last_became_active":"2024-09-14T10:46:48.350088+0000","last_became_peered":"2024-09-14T10:46:48.350088+0000","last_unstale":"2024-09-14T11:57:40.639756+0000","last_undegraded":"2024-09-14T11:57:40.639756+0000","last_fullsized":"2024-09-14T11:57:40.639756+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:29.591738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"263'635","reported_seq":1320,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.802571+0000","last_change":"2024-09-14T10:46:50.363683+0000","last_active":"2024-09-14T12:01:18.802571+0000","last_peered":"2024-09-14T12:01:18.802571+0000","last_clean":"2024-09-14T12:01:18.802571+0000","last_became_active":"2024-09-14T10:46:50.363387+0000","last_became_peered":"2024-09-14T10:46:50.363387+0000","last_unstale":"2024-09-14T12:01:18.802571+0000","last_undegraded":"2024-09-14T12:01:18.802571+0000","last_fullsized":"2024-09-14T12:01:18.802571+0000","mapping_epoch":32,"log_start":"263'600","ondisk_log_start":"263'600","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":600,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:52:29.856170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95765,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1702,"num_read_kb":2954,"num_write":2224,"num_write_kb":2032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:45.299536+0000","last_change":"2024-09-14T10:46:52.374167+0000","last_active":"2024-09-14T11:57:45.299536+0000","last_peered":"2024-09-14T11:57:45.299536+0000","last_clean":"2024-09-14T11:57:45.299536+0000","last_became_active":"2024-09-14T10:46:52.373837+0000","last_became_peered":"2024-09-14T10:46:52.373837+0000","last_unstale":"2024-09-14T11:57:45.299536+0000","last_undegraded":"2024-09-14T11:57:45.299536+0000","last_fullsized":"2024-09-14T11:57:45.299536+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:56.691785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"263'152","reported_seq":660,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.008979+0000","last_change":"2024-09-14T10:46:54.386107+0000","last_active":"2024-09-14T11:59:31.008979+0000","last_peered":"2024-09-14T11:59:31.008979+0000","last_clean":"2024-09-14T11:59:31.008979+0000","last_became_active":"2024-09-14T10:46:54.385835+0000","last_became_peered":"2024-09-14T10:46:54.385835+0000","last_unstale":"2024-09-14T11:59:31.008979+0000","last_undegraded":"2024-09-14T11:59:31.008979+0000","last_fullsized":"2024-09-14T11:59:31.008979+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:18.649909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":168,"num_read_kb":158,"num_write":389,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"263'835","reported_seq":2478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.599452+0000","last_change":"2024-09-14T10:46:46.346336+0000","last_active":"2024-09-14T11:59:33.599452+0000","last_peered":"2024-09-14T11:59:33.599452+0000","last_clean":"2024-09-14T11:59:33.599452+0000","last_became_active":"2024-09-14T10:46:46.346072+0000","last_became_peered":"2024-09-14T10:46:46.346072+0000","last_unstale":"2024-09-14T11:59:33.599452+0000","last_undegraded":"2024-09-14T11:59:33.599452+0000","last_fullsized":"2024-09-14T11:59:33.599452+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:26.721967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4027,"num_read_kb":3636,"num_write":1084,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"263'385","reported_seq":1049,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.403473+0000","last_change":"2024-09-14T10:46:44.318544+0000","last_active":"2024-09-14T12:01:19.403473+0000","last_peered":"2024-09-14T12:01:19.403473+0000","last_clean":"2024-09-14T12:01:19.403473+0000","last_became_active":"2024-09-14T10:46:44.317702+0000","last_became_peered":"2024-09-14T10:46:44.317702+0000","last_unstale":"2024-09-14T12:01:19.403473+0000","last_undegraded":"2024-09-14T12:01:19.403473+0000","last_fullsized":"2024-09-14T12:01:19.403473+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:51.997687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":660,"num_read_kb":57005,"num_write":1181,"num_write_kb":30753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:30.523578+0000","last_change":"2024-09-14T10:46:35.277870+0000","last_active":"2024-09-14T11:57:30.523578+0000","last_peered":"2024-09-14T11:57:30.523578+0000","last_clean":"2024-09-14T11:57:30.523578+0000","last_became_active":"2024-09-14T10:46:33.265512+0000","last_became_peered":"2024-09-14T10:46:33.265512+0000","last_unstale":"2024-09-14T11:57:30.523578+0000","last_undegraded":"2024-09-14T11:57:30.523578+0000","last_fullsized":"2024-09-14T11:57:30.523578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:38.583783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088449000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:40.598081+0000","last_change":"2024-09-14T10:46:48.353705+0000","last_active":"2024-09-14T11:57:40.598081+0000","last_peered":"2024-09-14T11:57:40.598081+0000","last_clean":"2024-09-14T11:57:40.598081+0000","last_became_active":"2024-09-14T10:46:48.353394+0000","last_became_peered":"2024-09-14T10:46:48.353394+0000","last_unstale":"2024-09-14T11:57:40.598081+0000","last_undegraded":"2024-09-14T11:57:40.598081+0000","last_fullsized":"2024-09-14T11:57:40.598081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:16.155422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"263'261","reported_seq":847,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.134914+0000","last_change":"2024-09-14T10:46:50.363699+0000","last_active":"2024-09-14T11:59:33.134914+0000","last_peered":"2024-09-14T11:59:33.134914+0000","last_clean":"2024-09-14T11:59:33.134914+0000","last_became_active":"2024-09-14T10:46:50.363436+0000","last_became_peered":"2024-09-14T10:46:50.363436+0000","last_unstale":"2024-09-14T11:59:33.134914+0000","last_undegraded":"2024-09-14T11:59:33.134914+0000","last_fullsized":"2024-09-14T11:59:33.134914+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:29.116427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":321,"num_read_kb":313,"num_write":296,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"263'803","reported_seq":2970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.187710+0000","last_change":"2024-09-14T10:46:52.373730+0000","last_active":"2024-09-14T12:01:19.187710+0000","last_peered":"2024-09-14T12:01:19.187710+0000","last_clean":"2024-09-14T12:01:19.187710+0000","last_became_active":"2024-09-14T10:46:52.373068+0000","last_became_peered":"2024-09-14T10:46:52.373068+0000","last_unstale":"2024-09-14T12:01:19.187710+0000","last_undegraded":"2024-09-14T12:01:19.187710+0000","last_fullsized":"2024-09-14T12:01:19.187710+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:46.138887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"263'136","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:52.312770+0000","last_change":"2024-09-14T10:46:54.388712+0000","last_active":"2024-09-14T12:00:52.312770+0000","last_peered":"2024-09-14T12:00:52.312770+0000","last_clean":"2024-09-14T12:00:52.312770+0000","last_became_active":"2024-09-14T10:46:54.387317+0000","last_became_peered":"2024-09-14T10:46:54.387317+0000","last_unstale":"2024-09-14T12:00:52.312770+0000","last_undegraded":"2024-09-14T12:00:52.312770+0000","last_fullsized":"2024-09-14T12:00:52.312770+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:03.151982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":117,"num_write":309,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"263'1367","reported_seq":3055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.167851+0000","last_change":"2024-09-14T10:46:46.345068+0000","last_active":"2024-09-14T12:00:51.167851+0000","last_peered":"2024-09-14T12:00:51.167851+0000","last_clean":"2024-09-14T12:00:51.167851+0000","last_became_active":"2024-09-14T10:46:46.344799+0000","last_became_peered":"2024-09-14T10:46:46.344799+0000","last_unstale":"2024-09-14T12:00:51.167851+0000","last_undegraded":"2024-09-14T12:00:51.167851+0000","last_fullsized":"2024-09-14T12:00:51.167851+0000","mapping_epoch":28,"log_start":"263'1300","ondisk_log_start":"263'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":1300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:57.271856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6397,"num_read_kb":5617,"num_write":2035,"num_write_kb":974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"263'403","reported_seq":1211,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.335174+0000","last_change":"2024-09-14T10:46:44.324495+0000","last_active":"2024-09-14T12:01:19.335174+0000","last_peered":"2024-09-14T12:01:19.335174+0000","last_clean":"2024-09-14T12:01:19.335174+0000","last_became_active":"2024-09-14T10:46:44.324158+0000","last_became_peered":"2024-09-14T10:46:44.324158+0000","last_unstale":"2024-09-14T12:01:19.335174+0000","last_undegraded":"2024-09-14T12:01:19.335174+0000","last_fullsized":"2024-09-14T12:01:19.335174+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:06.192395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":514873,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1028,"num_read_kb":45406,"num_write":1187,"num_write_kb":52499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.643287+0000","last_change":"2024-09-14T10:46:35.333032+0000","last_active":"2024-09-14T11:58:05.643287+0000","last_peered":"2024-09-14T11:58:05.643287+0000","last_clean":"2024-09-14T11:58:05.643287+0000","last_became_active":"2024-09-14T10:46:33.262218+0000","last_became_peered":"2024-09-14T10:46:33.262218+0000","last_unstale":"2024-09-14T11:58:05.643287+0000","last_undegraded":"2024-09-14T11:58:05.643287+0000","last_fullsized":"2024-09-14T11:58:05.643287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:37.487991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072314099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:40.524716+0000","last_change":"2024-09-14T10:46:48.350207+0000","last_active":"2024-09-14T11:57:40.524716+0000","last_peered":"2024-09-14T11:57:40.524716+0000","last_clean":"2024-09-14T11:57:40.524716+0000","last_became_active":"2024-09-14T10:46:48.349924+0000","last_became_peered":"2024-09-14T10:46:48.349924+0000","last_unstale":"2024-09-14T11:57:40.524716+0000","last_undegraded":"2024-09-14T11:57:40.524716+0000","last_fullsized":"2024-09-14T11:57:40.524716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:06.223225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"263'131","reported_seq":690,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:40.524748+0000","last_change":"2024-09-14T10:46:50.366912+0000","last_active":"2024-09-14T11:57:40.524748+0000","last_peered":"2024-09-14T11:57:40.524748+0000","last_clean":"2024-09-14T11:57:40.524748+0000","last_became_active":"2024-09-14T10:46:50.366610+0000","last_became_peered":"2024-09-14T10:46:50.366610+0000","last_unstale":"2024-09-14T11:57:40.524748+0000","last_undegraded":"2024-09-14T11:57:40.524748+0000","last_fullsized":"2024-09-14T11:57:40.524748+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:08.232971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"263'831","reported_seq":2795,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.319728+0000","last_change":"2024-09-14T10:46:52.371337+0000","last_active":"2024-09-14T12:01:18.319728+0000","last_peered":"2024-09-14T12:01:18.319728+0000","last_clean":"2024-09-14T12:01:18.319728+0000","last_became_active":"2024-09-14T10:46:52.370514+0000","last_became_peered":"2024-09-14T10:46:52.370514+0000","last_unstale":"2024-09-14T12:01:18.319728+0000","last_undegraded":"2024-09-14T12:01:18.319728+0000","last_fullsized":"2024-09-14T12:01:18.319728+0000","mapping_epoch":34,"log_start":"263'800","ondisk_log_start":"263'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:45.428130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"263'307","reported_seq":847,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.462075+0000","last_change":"2024-09-14T10:46:54.383183+0000","last_active":"2024-09-14T11:58:58.462075+0000","last_peered":"2024-09-14T11:58:58.462075+0000","last_clean":"2024-09-14T11:58:58.462075+0000","last_became_active":"2024-09-14T10:46:54.382860+0000","last_became_peered":"2024-09-14T10:46:54.382860+0000","last_unstale":"2024-09-14T11:58:58.462075+0000","last_undegraded":"2024-09-14T11:58:58.462075+0000","last_fullsized":"2024-09-14T11:58:58.462075+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:04.052225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":895,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":402,"num_read_kb":382,"num_write":591,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"263'1146","reported_seq":2843,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.351752+0000","last_change":"2024-09-14T10:46:46.338805+0000","last_active":"2024-09-14T11:58:44.351752+0000","last_peered":"2024-09-14T11:58:44.351752+0000","last_clean":"2024-09-14T11:58:44.351752+0000","last_became_active":"2024-09-14T10:46:46.338543+0000","last_became_peered":"2024-09-14T10:46:46.338543+0000","last_unstale":"2024-09-14T11:58:44.351752+0000","last_undegraded":"2024-09-14T11:58:44.351752+0000","last_fullsized":"2024-09-14T11:58:44.351752+0000","mapping_epoch":28,"log_start":"263'1100","ondisk_log_start":"263'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":1100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:11.687416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5511,"num_read_kb":4909,"num_write":1576,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"263'347","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.322796+0000","last_change":"2024-09-14T10:46:44.319103+0000","last_active":"2024-09-14T12:01:19.322796+0000","last_peered":"2024-09-14T12:01:19.322796+0000","last_clean":"2024-09-14T12:01:19.322796+0000","last_became_active":"2024-09-14T10:46:44.318777+0000","last_became_peered":"2024-09-14T10:46:44.318777+0000","last_unstale":"2024-09-14T12:01:19.322796+0000","last_undegraded":"2024-09-14T12:01:19.322796+0000","last_fullsized":"2024-09-14T12:01:19.322796+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:25.866596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":579,"num_read_kb":36295,"num_write":1107,"num_write_kb":33618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.527666+0000","last_change":"2024-09-14T10:46:35.277572+0000","last_active":"2024-09-14T11:58:05.527666+0000","last_peered":"2024-09-14T11:58:05.527666+0000","last_clean":"2024-09-14T11:58:05.527666+0000","last_became_active":"2024-09-14T10:46:33.265515+0000","last_became_peered":"2024-09-14T10:46:33.265515+0000","last_unstale":"2024-09-14T11:58:05.527666+0000","last_undegraded":"2024-09-14T11:58:05.527666+0000","last_fullsized":"2024-09-14T11:58:05.527666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:32.251879+0000","last_clean_scrub_stamp":"2024-09-14T10:46:32.251879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:42.848687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061284299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.652272+0000","last_change":"2024-09-14T10:46:48.356581+0000","last_active":"2024-09-14T11:59:05.652272+0000","last_peered":"2024-09-14T11:59:05.652272+0000","last_clean":"2024-09-14T11:59:05.652272+0000","last_became_active":"2024-09-14T10:46:48.354373+0000","last_became_peered":"2024-09-14T10:46:48.354373+0000","last_unstale":"2024-09-14T11:59:05.652272+0000","last_undegraded":"2024-09-14T11:59:05.652272+0000","last_fullsized":"2024-09-14T11:59:05.652272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:11.993887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"263'723","reported_seq":1465,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.170376+0000","last_change":"2024-09-14T10:46:50.362694+0000","last_active":"2024-09-14T12:01:19.170376+0000","last_peered":"2024-09-14T12:01:19.170376+0000","last_clean":"2024-09-14T12:01:19.170376+0000","last_became_active":"2024-09-14T10:46:50.362397+0000","last_became_peered":"2024-09-14T10:46:50.362397+0000","last_unstale":"2024-09-14T12:01:19.170376+0000","last_undegraded":"2024-09-14T12:01:19.170376+0000","last_fullsized":"2024-09-14T12:01:19.170376+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":700,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:52.299380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1285,"num_read_kb":3031,"num_write":1024,"num_write_kb":812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:45.640338+0000","last_change":"2024-09-14T10:46:52.370429+0000","last_active":"2024-09-14T11:57:45.640338+0000","last_peered":"2024-09-14T11:57:45.640338+0000","last_clean":"2024-09-14T11:57:45.640338+0000","last_became_active":"2024-09-14T10:46:52.370107+0000","last_became_peered":"2024-09-14T10:46:52.370107+0000","last_unstale":"2024-09-14T11:57:45.640338+0000","last_undegraded":"2024-09-14T11:57:45.640338+0000","last_fullsized":"2024-09-14T11:57:45.640338+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:57.197530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"263'131","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.306974+0000","last_change":"2024-09-14T10:46:54.384319+0000","last_active":"2024-09-14T11:58:55.306974+0000","last_peered":"2024-09-14T11:58:55.306974+0000","last_clean":"2024-09-14T11:58:55.306974+0000","last_became_active":"2024-09-14T10:46:54.383813+0000","last_became_peered":"2024-09-14T10:46:54.383813+0000","last_unstale":"2024-09-14T11:58:55.306974+0000","last_undegraded":"2024-09-14T11:58:55.306974+0000","last_fullsized":"2024-09-14T11:58:55.306974+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:08.736115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":350,"num_read_kb":289,"num_write":327,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"263'150","reported_seq":710,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.932339+0000","last_change":"2024-09-14T10:46:54.384092+0000","last_active":"2024-09-14T11:59:34.932339+0000","last_peered":"2024-09-14T11:59:34.932339+0000","last_clean":"2024-09-14T11:59:34.932339+0000","last_became_active":"2024-09-14T10:46:54.383742+0000","last_became_peered":"2024-09-14T10:46:54.383742+0000","last_unstale":"2024-09-14T11:59:34.932339+0000","last_undegraded":"2024-09-14T11:59:34.932339+0000","last_fullsized":"2024-09-14T11:59:34.932339+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:33.936406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":212,"num_read_kb":210,"num_write":346,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"263'702","reported_seq":2554,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.142264+0000","last_change":"2024-09-14T10:46:46.338139+0000","last_active":"2024-09-14T12:00:51.142264+0000","last_peered":"2024-09-14T12:00:51.142264+0000","last_clean":"2024-09-14T12:00:51.142264+0000","last_became_active":"2024-09-14T10:46:46.337818+0000","last_became_peered":"2024-09-14T10:46:46.337818+0000","last_unstale":"2024-09-14T12:00:51.142264+0000","last_undegraded":"2024-09-14T12:00:51.142264+0000","last_fullsized":"2024-09-14T12:00:51.142264+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:18.147970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3744,"num_read_kb":3411,"num_write":893,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"263'332","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.317332+0000","last_change":"2024-09-14T10:46:44.335815+0000","last_active":"2024-09-14T12:01:19.317332+0000","last_peered":"2024-09-14T12:01:19.317332+0000","last_clean":"2024-09-14T12:01:19.317332+0000","last_became_active":"2024-09-14T10:46:44.332607+0000","last_became_peered":"2024-09-14T10:46:44.332607+0000","last_unstale":"2024-09-14T12:01:19.317332+0000","last_undegraded":"2024-09-14T12:01:19.317332+0000","last_fullsized":"2024-09-14T12:01:19.317332+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:51.020568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":554,"num_read_kb":15763,"num_write":1023,"num_write_kb":46520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.508136+0000","last_change":"2024-09-14T10:46:48.353763+0000","last_active":"2024-09-14T11:56:48.508136+0000","last_peered":"2024-09-14T11:56:48.508136+0000","last_clean":"2024-09-14T11:56:48.508136+0000","last_became_active":"2024-09-14T10:46:48.353125+0000","last_became_peered":"2024-09-14T10:46:48.353125+0000","last_unstale":"2024-09-14T11:56:48.508136+0000","last_undegraded":"2024-09-14T11:56:48.508136+0000","last_fullsized":"2024-09-14T11:56:48.508136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:13.807709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"263'335","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.352110+0000","last_change":"2024-09-14T10:46:50.365232+0000","last_active":"2024-09-14T12:01:18.352110+0000","last_peered":"2024-09-14T12:01:18.352110+0000","last_clean":"2024-09-14T12:01:18.352110+0000","last_became_active":"2024-09-14T10:46:50.364874+0000","last_became_peered":"2024-09-14T10:46:50.364874+0000","last_unstale":"2024-09-14T12:01:18.352110+0000","last_undegraded":"2024-09-14T12:01:18.352110+0000","last_fullsized":"2024-09-14T12:01:18.352110+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:43.130794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58887,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":550,"num_read_kb":1323,"num_write":450,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.434090+0000","last_change":"2024-09-14T10:46:52.374279+0000","last_active":"2024-09-14T11:56:55.434090+0000","last_peered":"2024-09-14T11:56:55.434090+0000","last_clean":"2024-09-14T11:56:55.434090+0000","last_became_active":"2024-09-14T10:46:52.373982+0000","last_became_peered":"2024-09-14T10:46:52.373982+0000","last_unstale":"2024-09-14T11:56:55.434090+0000","last_undegraded":"2024-09-14T11:56:55.434090+0000","last_fullsized":"2024-09-14T11:56:55.434090+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:41.838813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"263'117","reported_seq":613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.699014+0000","last_change":"2024-09-14T10:46:54.387894+0000","last_active":"2024-09-14T11:59:34.699014+0000","last_peered":"2024-09-14T11:59:34.699014+0000","last_clean":"2024-09-14T11:59:34.699014+0000","last_became_active":"2024-09-14T10:46:54.387552+0000","last_became_peered":"2024-09-14T10:46:54.387552+0000","last_unstale":"2024-09-14T11:59:34.699014+0000","last_undegraded":"2024-09-14T11:59:34.699014+0000","last_fullsized":"2024-09-14T11:59:34.699014+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:39.903611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":107,"num_write":284,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"263'405","reported_seq":1853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.140847+0000","last_change":"2024-09-14T10:46:46.348830+0000","last_active":"2024-09-14T12:00:51.140847+0000","last_peered":"2024-09-14T12:00:51.140847+0000","last_clean":"2024-09-14T12:00:51.140847+0000","last_became_active":"2024-09-14T10:46:46.348040+0000","last_became_peered":"2024-09-14T10:46:46.348040+0000","last_unstale":"2024-09-14T12:00:51.140847+0000","last_undegraded":"2024-09-14T12:00:51.140847+0000","last_fullsized":"2024-09-14T12:00:51.140847+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:14.154127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2178,"num_read_kb":2045,"num_write":462,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"263'336","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.328310+0000","last_change":"2024-09-14T10:46:44.333549+0000","last_active":"2024-09-14T12:01:19.328310+0000","last_peered":"2024-09-14T12:01:19.328310+0000","last_clean":"2024-09-14T12:01:19.328310+0000","last_became_active":"2024-09-14T10:46:44.333195+0000","last_became_peered":"2024-09-14T10:46:44.333195+0000","last_unstale":"2024-09-14T12:01:19.328310+0000","last_undegraded":"2024-09-14T12:01:19.328310+0000","last_fullsized":"2024-09-14T12:01:19.328310+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:18.381740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":77356,"num_write":1081,"num_write_kb":55140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.632326+0000","last_change":"2024-09-14T10:46:48.357298+0000","last_active":"2024-09-14T11:56:50.632326+0000","last_peered":"2024-09-14T11:56:50.632326+0000","last_clean":"2024-09-14T11:56:50.632326+0000","last_became_active":"2024-09-14T10:46:48.357033+0000","last_became_peered":"2024-09-14T10:46:48.357033+0000","last_unstale":"2024-09-14T11:56:50.632326+0000","last_undegraded":"2024-09-14T11:56:50.632326+0000","last_fullsized":"2024-09-14T11:56:50.632326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:02.877431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"263'63","reported_seq":576,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:37.053655+0000","last_change":"2024-09-14T10:46:50.363154+0000","last_active":"2024-09-14T11:57:37.053655+0000","last_peered":"2024-09-14T11:57:37.053655+0000","last_clean":"2024-09-14T11:57:37.053655+0000","last_became_active":"2024-09-14T10:46:50.362878+0000","last_became_peered":"2024-09-14T10:46:50.362878+0000","last_unstale":"2024-09-14T11:57:37.053655+0000","last_undegraded":"2024-09-14T11:57:37.053655+0000","last_fullsized":"2024-09-14T11:57:37.053655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:48.083949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.294045+0000","last_change":"2024-09-14T10:46:52.366285+0000","last_active":"2024-09-14T11:56:55.294045+0000","last_peered":"2024-09-14T11:56:55.294045+0000","last_clean":"2024-09-14T11:56:55.294045+0000","last_became_active":"2024-09-14T10:46:52.365987+0000","last_became_peered":"2024-09-14T10:46:52.365987+0000","last_unstale":"2024-09-14T11:56:55.294045+0000","last_undegraded":"2024-09-14T11:56:55.294045+0000","last_fullsized":"2024-09-14T11:56:55.294045+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:43.965292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"263'198","reported_seq":733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.608962+0000","last_change":"2024-09-14T10:46:54.383562+0000","last_active":"2024-09-14T11:59:33.608962+0000","last_peered":"2024-09-14T11:59:33.608962+0000","last_clean":"2024-09-14T11:59:33.608962+0000","last_became_active":"2024-09-14T10:46:54.383284+0000","last_became_peered":"2024-09-14T10:46:54.383284+0000","last_unstale":"2024-09-14T11:59:33.608962+0000","last_undegraded":"2024-09-14T11:59:33.608962+0000","last_fullsized":"2024-09-14T11:59:33.608962+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:22.704423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":348,"num_read_kb":326,"num_write":460,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"263'463","reported_seq":2089,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:51.553105+0000","last_change":"2024-09-14T10:46:46.341746+0000","last_active":"2024-09-14T11:57:51.553105+0000","last_peered":"2024-09-14T11:57:51.553105+0000","last_clean":"2024-09-14T11:57:51.553105+0000","last_became_active":"2024-09-14T10:46:46.341424+0000","last_became_peered":"2024-09-14T10:46:46.341424+0000","last_unstale":"2024-09-14T11:57:51.553105+0000","last_undegraded":"2024-09-14T11:57:51.553105+0000","last_fullsized":"2024-09-14T11:57:51.553105+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:09.296793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2571,"num_read_kb":2437,"num_write":538,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"263'326","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.370956+0000","last_change":"2024-09-14T10:46:44.322321+0000","last_active":"2024-09-14T12:01:19.370956+0000","last_peered":"2024-09-14T12:01:19.370956+0000","last_clean":"2024-09-14T12:01:19.370956+0000","last_became_active":"2024-09-14T10:46:44.321694+0000","last_became_peered":"2024-09-14T10:46:44.321694+0000","last_unstale":"2024-09-14T12:01:19.370956+0000","last_undegraded":"2024-09-14T12:01:19.370956+0000","last_fullsized":"2024-09-14T12:01:19.370956+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:00.511024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":535,"num_read_kb":12444,"num_write":977,"num_write_kb":13958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.293366+0000","last_change":"2024-09-14T10:46:48.351062+0000","last_active":"2024-09-14T11:56:50.293366+0000","last_peered":"2024-09-14T11:56:50.293366+0000","last_clean":"2024-09-14T11:56:50.293366+0000","last_became_active":"2024-09-14T10:46:48.350714+0000","last_became_peered":"2024-09-14T10:46:48.350714+0000","last_unstale":"2024-09-14T11:56:50.293366+0000","last_undegraded":"2024-09-14T11:56:50.293366+0000","last_fullsized":"2024-09-14T11:56:50.293366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:34.873720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"263'339","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.661096+0000","last_change":"2024-09-14T10:46:50.361153+0000","last_active":"2024-09-14T12:01:17.661096+0000","last_peered":"2024-09-14T12:01:17.661096+0000","last_clean":"2024-09-14T12:01:17.661096+0000","last_became_active":"2024-09-14T10:46:50.360886+0000","last_became_peered":"2024-09-14T10:46:50.360886+0000","last_unstale":"2024-09-14T12:01:17.661096+0000","last_undegraded":"2024-09-14T12:01:17.661096+0000","last_fullsized":"2024-09-14T12:01:17.661096+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:38.621371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50451,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":558,"num_read_kb":1238,"num_write":442,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.396137+0000","last_change":"2024-09-14T10:46:52.375402+0000","last_active":"2024-09-14T11:56:55.396137+0000","last_peered":"2024-09-14T11:56:55.396137+0000","last_clean":"2024-09-14T11:56:55.396137+0000","last_became_active":"2024-09-14T10:46:52.375120+0000","last_became_peered":"2024-09-14T10:46:52.375120+0000","last_unstale":"2024-09-14T11:56:55.396137+0000","last_undegraded":"2024-09-14T11:56:55.396137+0000","last_fullsized":"2024-09-14T11:56:55.396137+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:11.461786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"263'126","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.661848+0000","last_change":"2024-09-14T10:46:54.384403+0000","last_active":"2024-09-14T11:59:34.661848+0000","last_peered":"2024-09-14T11:59:34.661848+0000","last_clean":"2024-09-14T11:59:34.661848+0000","last_became_active":"2024-09-14T10:46:54.384113+0000","last_became_peered":"2024-09-14T10:46:54.384113+0000","last_unstale":"2024-09-14T11:59:34.661848+0000","last_undegraded":"2024-09-14T11:59:34.661848+0000","last_fullsized":"2024-09-14T11:59:34.661848+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:43.036020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":180,"num_read_kb":170,"num_write":302,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"263'376","reported_seq":2022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.915579+0000","last_change":"2024-09-14T10:46:46.346655+0000","last_active":"2024-09-14T11:58:23.915579+0000","last_peered":"2024-09-14T11:58:23.915579+0000","last_clean":"2024-09-14T11:58:23.915579+0000","last_became_active":"2024-09-14T10:46:46.346318+0000","last_became_peered":"2024-09-14T10:46:46.346318+0000","last_unstale":"2024-09-14T11:58:23.915579+0000","last_undegraded":"2024-09-14T11:58:23.915579+0000","last_fullsized":"2024-09-14T11:58:23.915579+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:49.199619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2319,"num_read_kb":2246,"num_write":412,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"263'411","reported_seq":1079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.380526+0000","last_change":"2024-09-14T10:46:44.333722+0000","last_active":"2024-09-14T12:01:19.380526+0000","last_peered":"2024-09-14T12:01:19.380526+0000","last_clean":"2024-09-14T12:01:19.380526+0000","last_became_active":"2024-09-14T10:46:44.332841+0000","last_became_peered":"2024-09-14T10:46:44.332841+0000","last_unstale":"2024-09-14T12:01:19.380526+0000","last_undegraded":"2024-09-14T12:01:19.380526+0000","last_fullsized":"2024-09-14T12:01:19.380526+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:52.405113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133711,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":772,"num_read_kb":6861,"num_write":1433,"num_write_kb":25110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.518421+0000","last_change":"2024-09-14T10:46:48.353284+0000","last_active":"2024-09-14T11:56:50.518421+0000","last_peered":"2024-09-14T11:56:50.518421+0000","last_clean":"2024-09-14T11:56:50.518421+0000","last_became_active":"2024-09-14T10:46:48.353010+0000","last_became_peered":"2024-09-14T10:46:48.353010+0000","last_unstale":"2024-09-14T11:56:50.518421+0000","last_undegraded":"2024-09-14T11:56:50.518421+0000","last_fullsized":"2024-09-14T11:56:50.518421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:08.193075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"263'286","reported_seq":868,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.409390+0000","last_change":"2024-09-14T10:46:50.363596+0000","last_active":"2024-09-14T12:01:19.409390+0000","last_peered":"2024-09-14T12:01:19.409390+0000","last_clean":"2024-09-14T12:01:19.409390+0000","last_became_active":"2024-09-14T10:46:50.362723+0000","last_became_peered":"2024-09-14T10:46:50.362723+0000","last_unstale":"2024-09-14T12:01:19.409390+0000","last_undegraded":"2024-09-14T12:01:19.409390+0000","last_fullsized":"2024-09-14T12:01:19.409390+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:44.962512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44996,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":451,"num_read_kb":1030,"num_write":360,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.434159+0000","last_change":"2024-09-14T10:46:52.369320+0000","last_active":"2024-09-14T11:56:55.434159+0000","last_peered":"2024-09-14T11:56:55.434159+0000","last_clean":"2024-09-14T11:56:55.434159+0000","last_became_active":"2024-09-14T10:46:52.369048+0000","last_became_peered":"2024-09-14T10:46:52.369048+0000","last_unstale":"2024-09-14T11:56:55.434159+0000","last_undegraded":"2024-09-14T11:56:55.434159+0000","last_fullsized":"2024-09-14T11:56:55.434159+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:12.392541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"263'554","reported_seq":2332,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.143488+0000","last_change":"2024-09-14T10:46:46.349057+0000","last_active":"2024-09-14T12:00:51.143488+0000","last_peered":"2024-09-14T12:00:51.143488+0000","last_clean":"2024-09-14T12:00:51.143488+0000","last_became_active":"2024-09-14T10:46:46.348774+0000","last_became_peered":"2024-09-14T10:46:46.348774+0000","last_unstale":"2024-09-14T12:00:51.143488+0000","last_undegraded":"2024-09-14T12:00:51.143488+0000","last_fullsized":"2024-09-14T12:00:51.143488+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:39.288295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3189,"num_read_kb":2980,"num_write":657,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"263'401","reported_seq":1085,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.351647+0000","last_change":"2024-09-14T10:46:44.335060+0000","last_active":"2024-09-14T12:01:19.351647+0000","last_peered":"2024-09-14T12:01:19.351647+0000","last_clean":"2024-09-14T12:01:19.351647+0000","last_became_active":"2024-09-14T10:46:44.334693+0000","last_became_peered":"2024-09-14T10:46:44.334693+0000","last_unstale":"2024-09-14T12:01:19.351647+0000","last_undegraded":"2024-09-14T12:01:19.351647+0000","last_fullsized":"2024-09-14T12:01:19.351647+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:35.652094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1532840,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":807,"num_read_kb":35702,"num_write":1252,"num_write_kb":25930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"38'3","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.196063+0000","last_change":"2024-09-14T10:46:48.350741+0000","last_active":"2024-09-14T12:01:17.196063+0000","last_peered":"2024-09-14T12:01:17.196063+0000","last_clean":"2024-09-14T12:01:17.196063+0000","last_became_active":"2024-09-14T10:46:48.350469+0000","last_became_peered":"2024-09-14T10:46:48.350469+0000","last_unstale":"2024-09-14T12:01:17.196063+0000","last_undegraded":"2024-09-14T12:01:17.196063+0000","last_fullsized":"2024-09-14T12:01:17.196063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:50.974578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"263'495","reported_seq":1135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.354939+0000","last_change":"2024-09-14T10:46:50.365772+0000","last_active":"2024-09-14T12:01:19.354939+0000","last_peered":"2024-09-14T12:01:19.354939+0000","last_clean":"2024-09-14T12:01:19.354939+0000","last_became_active":"2024-09-14T10:46:50.365486+0000","last_became_peered":"2024-09-14T10:46:50.365486+0000","last_unstale":"2024-09-14T12:01:19.354939+0000","last_undegraded":"2024-09-14T12:01:19.354939+0000","last_fullsized":"2024-09-14T12:01:19.354939+0000","mapping_epoch":32,"log_start":"263'400","ondisk_log_start":"263'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:08:39.304362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93124,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":891,"num_read_kb":2144,"num_write":760,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.294097+0000","last_change":"2024-09-14T10:46:52.372507+0000","last_active":"2024-09-14T11:56:55.294097+0000","last_peered":"2024-09-14T11:56:55.294097+0000","last_clean":"2024-09-14T11:56:55.294097+0000","last_became_active":"2024-09-14T10:46:52.372151+0000","last_became_peered":"2024-09-14T10:46:52.372151+0000","last_unstale":"2024-09-14T11:56:55.294097+0000","last_undegraded":"2024-09-14T11:56:55.294097+0000","last_fullsized":"2024-09-14T11:56:55.294097+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:35.607612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"263'205","reported_seq":716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.552966+0000","last_change":"2024-09-14T10:46:54.386817+0000","last_active":"2024-09-14T11:59:33.552966+0000","last_peered":"2024-09-14T11:59:33.552966+0000","last_clean":"2024-09-14T11:59:33.552966+0000","last_became_active":"2024-09-14T10:46:54.386525+0000","last_became_peered":"2024-09-14T10:46:54.386525+0000","last_unstale":"2024-09-14T11:59:33.552966+0000","last_undegraded":"2024-09-14T11:59:33.552966+0000","last_fullsized":"2024-09-14T11:59:33.552966+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:41.935098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":260,"num_read_kb":259,"num_write":474,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"263'415","reported_seq":2076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.500823+0000","last_change":"2024-09-14T10:46:46.342078+0000","last_active":"2024-09-14T11:59:49.500823+0000","last_peered":"2024-09-14T11:59:49.500823+0000","last_clean":"2024-09-14T11:59:49.500823+0000","last_became_active":"2024-09-14T10:46:46.341559+0000","last_became_peered":"2024-09-14T10:46:46.341559+0000","last_unstale":"2024-09-14T11:59:49.500823+0000","last_undegraded":"2024-09-14T11:59:49.500823+0000","last_fullsized":"2024-09-14T11:59:49.500823+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:25.649976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2371,"num_read_kb":2275,"num_write":467,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"263'282","reported_seq":929,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.283689+0000","last_change":"2024-09-14T10:46:44.320611+0000","last_active":"2024-09-14T12:01:19.283689+0000","last_peered":"2024-09-14T12:01:19.283689+0000","last_clean":"2024-09-14T12:01:19.283689+0000","last_became_active":"2024-09-14T10:46:44.319896+0000","last_became_peered":"2024-09-14T10:46:44.319896+0000","last_unstale":"2024-09-14T12:01:19.283689+0000","last_undegraded":"2024-09-14T12:01:19.283689+0000","last_fullsized":"2024-09-14T12:01:19.283689+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:43.510538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133682,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":524,"num_read_kb":94668,"num_write":900,"num_write_kb":37785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:40.298927+0000","last_change":"2024-09-14T10:46:48.355503+0000","last_active":"2024-09-14T11:57:40.298927+0000","last_peered":"2024-09-14T11:57:40.298927+0000","last_clean":"2024-09-14T11:57:40.298927+0000","last_became_active":"2024-09-14T10:46:48.355149+0000","last_became_peered":"2024-09-14T10:46:48.355149+0000","last_unstale":"2024-09-14T11:57:40.298927+0000","last_undegraded":"2024-09-14T11:57:40.298927+0000","last_fullsized":"2024-09-14T11:57:40.298927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:39.662714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"263'345","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.538027+0000","last_change":"2024-09-14T10:46:50.367103+0000","last_active":"2024-09-14T12:01:17.538027+0000","last_peered":"2024-09-14T12:01:17.538027+0000","last_clean":"2024-09-14T12:01:17.538027+0000","last_became_active":"2024-09-14T10:46:50.366749+0000","last_became_peered":"2024-09-14T10:46:50.366749+0000","last_unstale":"2024-09-14T12:01:17.538027+0000","last_undegraded":"2024-09-14T12:01:17.538027+0000","last_fullsized":"2024-09-14T12:01:17.538027+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:04.127284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49707,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":587,"num_read_kb":1269,"num_write":486,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.442435+0000","last_change":"2024-09-14T10:46:52.368766+0000","last_active":"2024-09-14T11:56:53.442435+0000","last_peered":"2024-09-14T11:56:53.442435+0000","last_clean":"2024-09-14T11:56:53.442435+0000","last_became_active":"2024-09-14T10:46:52.368508+0000","last_became_peered":"2024-09-14T10:46:52.368508+0000","last_unstale":"2024-09-14T11:56:53.442435+0000","last_undegraded":"2024-09-14T11:56:53.442435+0000","last_fullsized":"2024-09-14T11:56:53.442435+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:15.487064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"263'181","reported_seq":1057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.440714+0000","last_change":"2024-09-14T10:46:54.379236+0000","last_active":"2024-09-14T11:59:30.440714+0000","last_peered":"2024-09-14T11:59:30.440714+0000","last_clean":"2024-09-14T11:59:30.440714+0000","last_became_active":"2024-09-14T10:46:54.378938+0000","last_became_peered":"2024-09-14T10:46:54.378938+0000","last_unstale":"2024-09-14T11:59:30.440714+0000","last_undegraded":"2024-09-14T11:59:30.440714+0000","last_fullsized":"2024-09-14T11:59:30.440714+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:53.097947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2044,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":607,"num_read_kb":603,"num_write":505,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"263'637","reported_seq":2298,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.736746+0000","last_change":"2024-09-14T10:46:46.347640+0000","last_active":"2024-09-14T11:59:29.736746+0000","last_peered":"2024-09-14T11:59:29.736746+0000","last_clean":"2024-09-14T11:59:29.736746+0000","last_became_active":"2024-09-14T10:46:46.347362+0000","last_became_peered":"2024-09-14T10:46:46.347362+0000","last_unstale":"2024-09-14T11:59:29.736746+0000","last_undegraded":"2024-09-14T11:59:29.736746+0000","last_fullsized":"2024-09-14T11:59:29.736746+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":600,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:55.139779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3345,"num_read_kb":3056,"num_write":864,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"263'375","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.290468+0000","last_change":"2024-09-14T10:46:44.318782+0000","last_active":"2024-09-14T12:01:19.290468+0000","last_peered":"2024-09-14T12:01:19.290468+0000","last_clean":"2024-09-14T12:01:19.290468+0000","last_became_active":"2024-09-14T10:46:44.318099+0000","last_became_peered":"2024-09-14T10:46:44.318099+0000","last_unstale":"2024-09-14T12:01:19.290468+0000","last_undegraded":"2024-09-14T12:01:19.290468+0000","last_fullsized":"2024-09-14T12:01:19.290468+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:25.257513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133694,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":681,"num_read_kb":1685,"num_write":1259,"num_write_kb":36237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.293501+0000","last_change":"2024-09-14T10:46:48.350499+0000","last_active":"2024-09-14T11:56:50.293501+0000","last_peered":"2024-09-14T11:56:50.293501+0000","last_clean":"2024-09-14T11:56:50.293501+0000","last_became_active":"2024-09-14T10:46:48.350059+0000","last_became_peered":"2024-09-14T10:46:48.350059+0000","last_unstale":"2024-09-14T11:56:50.293501+0000","last_undegraded":"2024-09-14T11:56:50.293501+0000","last_fullsized":"2024-09-14T11:56:50.293501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:42.038929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"263'311","reported_seq":903,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.586182+0000","last_change":"2024-09-14T10:46:50.365706+0000","last_active":"2024-09-14T12:01:18.586182+0000","last_peered":"2024-09-14T12:01:18.586182+0000","last_clean":"2024-09-14T12:01:18.586182+0000","last_became_active":"2024-09-14T10:46:50.365393+0000","last_became_peered":"2024-09-14T10:46:50.365393+0000","last_unstale":"2024-09-14T12:01:18.586182+0000","last_undegraded":"2024-09-14T12:01:18.586182+0000","last_fullsized":"2024-09-14T12:01:18.586182+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:00.491603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46624,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":509,"num_read_kb":1174,"num_write":408,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.453197+0000","last_change":"2024-09-14T10:46:52.373436+0000","last_active":"2024-09-14T11:59:10.453197+0000","last_peered":"2024-09-14T11:59:10.453197+0000","last_clean":"2024-09-14T11:59:10.453197+0000","last_became_active":"2024-09-14T10:46:52.373099+0000","last_became_peered":"2024-09-14T10:46:52.373099+0000","last_unstale":"2024-09-14T11:59:10.453197+0000","last_undegraded":"2024-09-14T11:59:10.453197+0000","last_fullsized":"2024-09-14T11:59:10.453197+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:41.461337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"263'143","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:52.308478+0000","last_change":"2024-09-14T10:46:54.385921+0000","last_active":"2024-09-14T12:00:52.308478+0000","last_peered":"2024-09-14T12:00:52.308478+0000","last_clean":"2024-09-14T12:00:52.308478+0000","last_became_active":"2024-09-14T10:46:54.385625+0000","last_became_peered":"2024-09-14T10:46:54.385625+0000","last_unstale":"2024-09-14T12:00:52.308478+0000","last_undegraded":"2024-09-14T12:00:52.308478+0000","last_fullsized":"2024-09-14T12:00:52.308478+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:00.984531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":790,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":228,"num_read_kb":197,"num_write":338,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"263'416","reported_seq":1957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.727179+0000","last_change":"2024-09-14T10:46:46.339137+0000","last_active":"2024-09-14T11:59:29.727179+0000","last_peered":"2024-09-14T11:59:29.727179+0000","last_clean":"2024-09-14T11:59:29.727179+0000","last_became_active":"2024-09-14T10:46:46.338551+0000","last_became_peered":"2024-09-14T10:46:46.338551+0000","last_unstale":"2024-09-14T11:59:29.727179+0000","last_undegraded":"2024-09-14T11:59:29.727179+0000","last_fullsized":"2024-09-14T11:59:29.727179+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:02.429002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2291,"num_read_kb":2170,"num_write":475,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"263'291","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.376172+0000","last_change":"2024-09-14T10:46:44.331964+0000","last_active":"2024-09-14T12:01:19.376172+0000","last_peered":"2024-09-14T12:01:19.376172+0000","last_clean":"2024-09-14T12:01:19.376172+0000","last_became_active":"2024-09-14T10:46:44.331660+0000","last_became_peered":"2024-09-14T10:46:44.331660+0000","last_unstale":"2024-09-14T12:01:19.376172+0000","last_undegraded":"2024-09-14T12:01:19.376172+0000","last_fullsized":"2024-09-14T12:01:19.376172+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:22.697298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":521,"num_read_kb":29638,"num_write":955,"num_write_kb":30451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.632361+0000","last_change":"2024-09-14T10:46:48.350417+0000","last_active":"2024-09-14T11:56:50.632361+0000","last_peered":"2024-09-14T11:56:50.632361+0000","last_clean":"2024-09-14T11:56:50.632361+0000","last_became_active":"2024-09-14T10:46:48.350072+0000","last_became_peered":"2024-09-14T10:46:48.350072+0000","last_unstale":"2024-09-14T11:56:50.632361+0000","last_undegraded":"2024-09-14T11:56:50.632361+0000","last_fullsized":"2024-09-14T11:56:50.632361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:34.764307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"263'125","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.533624+0000","last_change":"2024-09-14T10:46:50.368321+0000","last_active":"2024-09-14T11:58:55.533624+0000","last_peered":"2024-09-14T11:58:55.533624+0000","last_clean":"2024-09-14T11:58:55.533624+0000","last_became_active":"2024-09-14T10:46:50.367991+0000","last_became_peered":"2024-09-14T10:46:50.367991+0000","last_unstale":"2024-09-14T11:58:55.533624+0000","last_undegraded":"2024-09-14T11:58:55.533624+0000","last_fullsized":"2024-09-14T11:58:55.533624+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:39.918895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":126,"num_write":102,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"263'780","reported_seq":2687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.106488+0000","last_change":"2024-09-14T10:46:52.370832+0000","last_active":"2024-09-14T12:01:19.106488+0000","last_peered":"2024-09-14T12:01:19.106488+0000","last_clean":"2024-09-14T12:01:19.106488+0000","last_became_active":"2024-09-14T10:46:52.370446+0000","last_became_peered":"2024-09-14T10:46:52.370446+0000","last_unstale":"2024-09-14T12:01:19.106488+0000","last_undegraded":"2024-09-14T12:01:19.106488+0000","last_fullsized":"2024-09-14T12:01:19.106488+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:05.923305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"263'120","reported_seq":646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.519098+0000","last_change":"2024-09-14T10:46:54.378096+0000","last_active":"2024-09-14T11:56:55.519098+0000","last_peered":"2024-09-14T11:56:55.519098+0000","last_clean":"2024-09-14T11:56:55.519098+0000","last_became_active":"2024-09-14T10:46:54.377788+0000","last_became_peered":"2024-09-14T10:46:54.377788+0000","last_unstale":"2024-09-14T11:56:55.519098+0000","last_undegraded":"2024-09-14T11:56:55.519098+0000","last_fullsized":"2024-09-14T11:56:55.519098+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:20.522136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":221,"num_read_kb":193,"num_write":312,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"263'791","reported_seq":2334,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.734178+0000","last_change":"2024-09-14T10:46:46.352423+0000","last_active":"2024-09-14T11:59:29.734178+0000","last_peered":"2024-09-14T11:59:29.734178+0000","last_clean":"2024-09-14T11:59:29.734178+0000","last_became_active":"2024-09-14T10:46:46.352087+0000","last_became_peered":"2024-09-14T10:46:46.352087+0000","last_unstale":"2024-09-14T11:59:29.734178+0000","last_undegraded":"2024-09-14T11:59:29.734178+0000","last_fullsized":"2024-09-14T11:59:29.734178+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:12.501801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3891,"num_read_kb":3520,"num_write":1035,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"263'316","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.307559+0000","last_change":"2024-09-14T10:46:44.321112+0000","last_active":"2024-09-14T12:01:19.307559+0000","last_peered":"2024-09-14T12:01:19.307559+0000","last_clean":"2024-09-14T12:01:19.307559+0000","last_became_active":"2024-09-14T10:46:44.320689+0000","last_became_peered":"2024-09-14T10:46:44.320689+0000","last_unstale":"2024-09-14T12:01:19.307559+0000","last_undegraded":"2024-09-14T12:01:19.307559+0000","last_fullsized":"2024-09-14T12:01:19.307559+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:11.205586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":532,"num_read_kb":954,"num_write":1107,"num_write_kb":21144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.395545+0000","last_change":"2024-09-14T10:46:48.357357+0000","last_active":"2024-09-14T11:56:50.395545+0000","last_peered":"2024-09-14T11:56:50.395545+0000","last_clean":"2024-09-14T11:56:50.395545+0000","last_became_active":"2024-09-14T10:46:48.357024+0000","last_became_peered":"2024-09-14T10:46:48.357024+0000","last_unstale":"2024-09-14T11:56:50.395545+0000","last_undegraded":"2024-09-14T11:56:50.395545+0000","last_fullsized":"2024-09-14T11:56:50.395545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:57.501469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"263'378","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.928077+0000","last_change":"2024-09-14T10:46:50.362271+0000","last_active":"2024-09-14T12:01:18.928077+0000","last_peered":"2024-09-14T12:01:18.928077+0000","last_clean":"2024-09-14T12:01:18.928077+0000","last_became_active":"2024-09-14T10:46:50.361962+0000","last_became_peered":"2024-09-14T10:46:50.361962+0000","last_unstale":"2024-09-14T12:01:18.928077+0000","last_undegraded":"2024-09-14T12:01:18.928077+0000","last_fullsized":"2024-09-14T12:01:18.928077+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:52.644742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49011,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":601,"num_read_kb":1340,"num_write":486,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.633741+0000","last_change":"2024-09-14T10:46:52.369579+0000","last_active":"2024-09-14T11:57:00.633741+0000","last_peered":"2024-09-14T11:57:00.633741+0000","last_clean":"2024-09-14T11:57:00.633741+0000","last_became_active":"2024-09-14T10:46:52.369262+0000","last_became_peered":"2024-09-14T10:46:52.369262+0000","last_unstale":"2024-09-14T11:57:00.633741+0000","last_undegraded":"2024-09-14T11:57:00.633741+0000","last_fullsized":"2024-09-14T11:57:00.633741+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:35.807345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"263'147","reported_seq":659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.302488+0000","last_change":"2024-09-14T10:46:54.385691+0000","last_active":"2024-09-14T11:59:34.302488+0000","last_peered":"2024-09-14T11:59:34.302488+0000","last_clean":"2024-09-14T11:59:34.302488+0000","last_became_active":"2024-09-14T10:46:54.385235+0000","last_became_peered":"2024-09-14T10:46:54.385235+0000","last_unstale":"2024-09-14T11:59:34.302488+0000","last_undegraded":"2024-09-14T11:59:34.302488+0000","last_fullsized":"2024-09-14T11:59:34.302488+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:33.162523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":187,"num_write":368,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"263'748","reported_seq":2307,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.674695+0000","last_change":"2024-09-14T10:46:46.335431+0000","last_active":"2024-09-14T11:59:34.674695+0000","last_peered":"2024-09-14T11:59:34.674695+0000","last_clean":"2024-09-14T11:59:34.674695+0000","last_became_active":"2024-09-14T10:46:46.335112+0000","last_became_peered":"2024-09-14T10:46:46.335112+0000","last_unstale":"2024-09-14T11:59:34.674695+0000","last_undegraded":"2024-09-14T11:59:34.674695+0000","last_fullsized":"2024-09-14T11:59:34.674695+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:09.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3755,"num_read_kb":3425,"num_write":989,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"263'322","reported_seq":967,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.268474+0000","last_change":"2024-09-14T10:46:44.335176+0000","last_active":"2024-09-14T12:01:19.268474+0000","last_peered":"2024-09-14T12:01:19.268474+0000","last_clean":"2024-09-14T12:01:19.268474+0000","last_became_active":"2024-09-14T10:46:44.332130+0000","last_became_peered":"2024-09-14T10:46:44.332130+0000","last_unstale":"2024-09-14T12:01:19.268474+0000","last_undegraded":"2024-09-14T12:01:19.268474+0000","last_fullsized":"2024-09-14T12:01:19.268474+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:00.407801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":584,"num_read_kb":32074,"num_write":1014,"num_write_kb":20757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.293480+0000","last_change":"2024-09-14T10:46:48.354432+0000","last_active":"2024-09-14T11:56:50.293480+0000","last_peered":"2024-09-14T11:56:50.293480+0000","last_clean":"2024-09-14T11:56:50.293480+0000","last_became_active":"2024-09-14T10:46:48.354108+0000","last_became_peered":"2024-09-14T10:46:48.354108+0000","last_unstale":"2024-09-14T11:56:50.293480+0000","last_undegraded":"2024-09-14T11:56:50.293480+0000","last_fullsized":"2024-09-14T11:56:50.293480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:07.134782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"263'271","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.986296+0000","last_change":"2024-09-14T10:46:50.358462+0000","last_active":"2024-09-14T12:01:18.986296+0000","last_peered":"2024-09-14T12:01:18.986296+0000","last_clean":"2024-09-14T12:01:18.986296+0000","last_became_active":"2024-09-14T10:46:50.358186+0000","last_became_peered":"2024-09-14T10:46:50.358186+0000","last_unstale":"2024-09-14T12:01:18.986296+0000","last_undegraded":"2024-09-14T12:01:18.986296+0000","last_fullsized":"2024-09-14T12:01:18.986296+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:23.418101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46012,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":454,"num_read_kb":1061,"num_write":362,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:05.520539+0000","last_change":"2024-09-14T10:46:52.366046+0000","last_active":"2024-09-14T11:57:05.520539+0000","last_peered":"2024-09-14T11:57:05.520539+0000","last_clean":"2024-09-14T11:57:05.520539+0000","last_became_active":"2024-09-14T10:46:52.365736+0000","last_became_peered":"2024-09-14T10:46:52.365736+0000","last_unstale":"2024-09-14T11:57:05.520539+0000","last_undegraded":"2024-09-14T11:57:05.520539+0000","last_fullsized":"2024-09-14T11:57:05.520539+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:20.721132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"263'123","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.467272+0000","last_change":"2024-09-14T10:46:54.385215+0000","last_active":"2024-09-14T11:59:28.467272+0000","last_peered":"2024-09-14T11:59:28.467272+0000","last_clean":"2024-09-14T11:59:28.467272+0000","last_became_active":"2024-09-14T10:46:54.384303+0000","last_became_peered":"2024-09-14T10:46:54.384303+0000","last_unstale":"2024-09-14T11:59:28.467272+0000","last_undegraded":"2024-09-14T11:59:28.467272+0000","last_fullsized":"2024-09-14T11:59:28.467272+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:28.997409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":957,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":145,"num_write":281,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"263'378","reported_seq":1793,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:21.445410+0000","last_change":"2024-09-14T10:46:46.338858+0000","last_active":"2024-09-14T11:58:21.445410+0000","last_peered":"2024-09-14T11:58:21.445410+0000","last_clean":"2024-09-14T11:58:21.445410+0000","last_became_active":"2024-09-14T10:46:46.338518+0000","last_became_peered":"2024-09-14T10:46:46.338518+0000","last_unstale":"2024-09-14T11:58:21.445410+0000","last_undegraded":"2024-09-14T11:58:21.445410+0000","last_fullsized":"2024-09-14T11:58:21.445410+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:01.075539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2070,"num_read_kb":1951,"num_write":457,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"263'362","reported_seq":1012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.392121+0000","last_change":"2024-09-14T10:46:44.333207+0000","last_active":"2024-09-14T12:01:19.392121+0000","last_peered":"2024-09-14T12:01:19.392121+0000","last_clean":"2024-09-14T12:01:19.392121+0000","last_became_active":"2024-09-14T10:46:44.332852+0000","last_became_peered":"2024-09-14T10:46:44.332852+0000","last_unstale":"2024-09-14T12:01:19.392121+0000","last_undegraded":"2024-09-14T12:01:19.392121+0000","last_fullsized":"2024-09-14T12:01:19.392121+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:48.357394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":662,"num_read_kb":10749,"num_write":1220,"num_write_kb":43875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.396096+0000","last_change":"2024-09-14T10:46:48.355870+0000","last_active":"2024-09-14T11:56:55.396096+0000","last_peered":"2024-09-14T11:56:55.396096+0000","last_clean":"2024-09-14T11:56:55.396096+0000","last_became_active":"2024-09-14T10:46:48.355512+0000","last_became_peered":"2024-09-14T10:46:48.355512+0000","last_unstale":"2024-09-14T11:56:55.396096+0000","last_undegraded":"2024-09-14T11:56:55.396096+0000","last_fullsized":"2024-09-14T11:56:55.396096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:43.891041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"263'265","reported_seq":827,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.475186+0000","last_change":"2024-09-14T10:46:50.364736+0000","last_active":"2024-09-14T12:01:18.475186+0000","last_peered":"2024-09-14T12:01:18.475186+0000","last_clean":"2024-09-14T12:01:18.475186+0000","last_became_active":"2024-09-14T10:46:50.364420+0000","last_became_peered":"2024-09-14T10:46:50.364420+0000","last_unstale":"2024-09-14T12:01:18.475186+0000","last_undegraded":"2024-09-14T12:01:18.475186+0000","last_fullsized":"2024-09-14T12:01:18.475186+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:59.631655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45284,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":455,"num_read_kb":1165,"num_write":378,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.519191+0000","last_change":"2024-09-14T10:46:52.374194+0000","last_active":"2024-09-14T11:56:55.519191+0000","last_peered":"2024-09-14T11:56:55.519191+0000","last_clean":"2024-09-14T11:56:55.519191+0000","last_became_active":"2024-09-14T10:46:52.373913+0000","last_became_peered":"2024-09-14T10:46:52.373913+0000","last_unstale":"2024-09-14T11:56:55.519191+0000","last_undegraded":"2024-09-14T11:56:55.519191+0000","last_fullsized":"2024-09-14T11:56:55.519191+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:44.342253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"263'129","reported_seq":1230,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.354353+0000","last_change":"2024-09-14T10:46:54.383936+0000","last_active":"2024-09-14T11:59:30.354353+0000","last_peered":"2024-09-14T11:59:30.354353+0000","last_clean":"2024-09-14T11:59:30.354353+0000","last_became_active":"2024-09-14T10:46:54.383637+0000","last_became_peered":"2024-09-14T10:46:54.383637+0000","last_unstale":"2024-09-14T11:59:30.354353+0000","last_undegraded":"2024-09-14T11:59:30.354353+0000","last_fullsized":"2024-09-14T11:59:30.354353+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:19.327839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":738,"num_read_kb":738,"num_write":285,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"263'441","reported_seq":1899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.598287+0000","last_change":"2024-09-14T10:46:46.342570+0000","last_active":"2024-09-14T11:59:33.598287+0000","last_peered":"2024-09-14T11:59:33.598287+0000","last_clean":"2024-09-14T11:59:33.598287+0000","last_became_active":"2024-09-14T10:46:46.342299+0000","last_became_peered":"2024-09-14T10:46:46.342299+0000","last_unstale":"2024-09-14T11:59:33.598287+0000","last_undegraded":"2024-09-14T11:59:33.598287+0000","last_fullsized":"2024-09-14T11:59:33.598287+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:56.482166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2232,"num_read_kb":2089,"num_write":533,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"263'512","reported_seq":1264,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.317448+0000","last_change":"2024-09-14T10:46:44.321110+0000","last_active":"2024-09-14T12:01:19.317448+0000","last_peered":"2024-09-14T12:01:19.317448+0000","last_clean":"2024-09-14T12:01:19.317448+0000","last_became_active":"2024-09-14T10:46:44.320749+0000","last_became_peered":"2024-09-14T10:46:44.320749+0000","last_unstale":"2024-09-14T12:01:19.317448+0000","last_undegraded":"2024-09-14T12:01:19.317448+0000","last_fullsized":"2024-09-14T12:01:19.317448+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:58.570377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1101,"num_read_kb":48118,"num_write":1530,"num_write_kb":57550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:10.635290+0000","last_change":"2024-09-14T10:46:48.353148+0000","last_active":"2024-09-14T11:57:10.635290+0000","last_peered":"2024-09-14T11:57:10.635290+0000","last_clean":"2024-09-14T11:57:10.635290+0000","last_became_active":"2024-09-14T10:46:48.352853+0000","last_became_peered":"2024-09-14T10:46:48.352853+0000","last_unstale":"2024-09-14T11:57:10.635290+0000","last_undegraded":"2024-09-14T11:57:10.635290+0000","last_fullsized":"2024-09-14T11:57:10.635290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:46.305353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"263'304","reported_seq":903,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.639297+0000","last_change":"2024-09-14T10:46:50.369781+0000","last_active":"2024-09-14T12:01:18.639297+0000","last_peered":"2024-09-14T12:01:18.639297+0000","last_clean":"2024-09-14T12:01:18.639297+0000","last_became_active":"2024-09-14T10:46:50.369492+0000","last_became_peered":"2024-09-14T10:46:50.369492+0000","last_unstale":"2024-09-14T12:01:18.639297+0000","last_undegraded":"2024-09-14T12:01:18.639297+0000","last_fullsized":"2024-09-14T12:01:18.639297+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:50.804436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49661,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":1034,"num_write":382,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.633068+0000","last_change":"2024-09-14T10:46:52.373456+0000","last_active":"2024-09-14T11:56:55.633068+0000","last_peered":"2024-09-14T11:56:55.633068+0000","last_clean":"2024-09-14T11:56:55.633068+0000","last_became_active":"2024-09-14T10:46:52.372108+0000","last_became_peered":"2024-09-14T10:46:52.372108+0000","last_unstale":"2024-09-14T11:56:55.633068+0000","last_undegraded":"2024-09-14T11:56:55.633068+0000","last_fullsized":"2024-09-14T11:56:55.633068+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:25.122029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"263'125","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.133558+0000","last_change":"2024-09-14T10:46:54.385169+0000","last_active":"2024-09-14T12:00:51.133558+0000","last_peered":"2024-09-14T12:00:51.133558+0000","last_clean":"2024-09-14T12:00:51.133558+0000","last_became_active":"2024-09-14T10:46:54.384278+0000","last_became_peered":"2024-09-14T10:46:54.384278+0000","last_unstale":"2024-09-14T12:00:51.133558+0000","last_undegraded":"2024-09-14T12:00:51.133558+0000","last_fullsized":"2024-09-14T12:00:51.133558+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:32.418655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":278,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"263'464","reported_seq":2034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.645877+0000","last_change":"2024-09-14T10:46:46.347263+0000","last_active":"2024-09-14T11:58:20.645877+0000","last_peered":"2024-09-14T11:58:20.645877+0000","last_clean":"2024-09-14T11:58:20.645877+0000","last_became_active":"2024-09-14T10:46:46.346994+0000","last_became_peered":"2024-09-14T10:46:46.346994+0000","last_unstale":"2024-09-14T11:58:20.645877+0000","last_undegraded":"2024-09-14T11:58:20.645877+0000","last_fullsized":"2024-09-14T11:58:20.645877+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:52.672214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2420,"num_read_kb":2273,"num_write":546,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"263'389","reported_seq":1145,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.365914+0000","last_change":"2024-09-14T10:46:44.329371+0000","last_active":"2024-09-14T12:01:19.365914+0000","last_peered":"2024-09-14T12:01:19.365914+0000","last_clean":"2024-09-14T12:01:19.365914+0000","last_became_active":"2024-09-14T10:46:44.328946+0000","last_became_peered":"2024-09-14T10:46:44.328946+0000","last_unstale":"2024-09-14T12:01:19.365914+0000","last_undegraded":"2024-09-14T12:01:19.365914+0000","last_fullsized":"2024-09-14T12:01:19.365914+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:41.337845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1017,"num_read_kb":28148,"num_write":1233,"num_write_kb":43814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"263'509","reported_seq":2191,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.915971+0000","last_change":"2024-09-14T10:46:46.343533+0000","last_active":"2024-09-14T11:58:23.915971+0000","last_peered":"2024-09-14T11:58:23.915971+0000","last_clean":"2024-09-14T11:58:23.915971+0000","last_became_active":"2024-09-14T10:46:46.343234+0000","last_became_peered":"2024-09-14T10:46:46.343234+0000","last_unstale":"2024-09-14T11:58:23.915971+0000","last_undegraded":"2024-09-14T11:58:23.915971+0000","last_fullsized":"2024-09-14T11:58:23.915971+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:10.850533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2663,"num_read_kb":2506,"num_write":583,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"263'344","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.370995+0000","last_change":"2024-09-14T10:46:44.317974+0000","last_active":"2024-09-14T12:01:19.370995+0000","last_peered":"2024-09-14T12:01:19.370995+0000","last_clean":"2024-09-14T12:01:19.370995+0000","last_became_active":"2024-09-14T10:46:44.317349+0000","last_became_peered":"2024-09-14T10:46:44.317349+0000","last_unstale":"2024-09-14T12:01:19.370995+0000","last_undegraded":"2024-09-14T12:01:19.370995+0000","last_fullsized":"2024-09-14T12:01:19.370995+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:49.115709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133675,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":5317,"num_write":990,"num_write_kb":25288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"263'447","reported_seq":1996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.498826+0000","last_change":"2024-09-14T10:46:46.347323+0000","last_active":"2024-09-14T11:59:49.498826+0000","last_peered":"2024-09-14T11:59:49.498826+0000","last_clean":"2024-09-14T11:59:49.498826+0000","last_became_active":"2024-09-14T10:46:46.346640+0000","last_became_peered":"2024-09-14T10:46:46.346640+0000","last_unstale":"2024-09-14T11:59:49.498826+0000","last_undegraded":"2024-09-14T11:59:49.498826+0000","last_fullsized":"2024-09-14T11:59:49.498826+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:33.703143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2347,"num_read_kb":2209,"num_write":542,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"263'346","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.403176+0000","last_change":"2024-09-14T10:46:44.328462+0000","last_active":"2024-09-14T12:01:19.403176+0000","last_peered":"2024-09-14T12:01:19.403176+0000","last_clean":"2024-09-14T12:01:19.403176+0000","last_became_active":"2024-09-14T10:46:44.328049+0000","last_became_peered":"2024-09-14T10:46:44.328049+0000","last_unstale":"2024-09-14T12:01:19.403176+0000","last_undegraded":"2024-09-14T12:01:19.403176+0000","last_fullsized":"2024-09-14T12:01:19.403176+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:12.916156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":619,"num_read_kb":2326,"num_write":1082,"num_write_kb":13442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"263'933","reported_seq":2731,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.707652+0000","last_change":"2024-09-14T10:46:46.349041+0000","last_active":"2024-09-14T11:59:34.707652+0000","last_peered":"2024-09-14T11:59:34.707652+0000","last_clean":"2024-09-14T11:59:34.707652+0000","last_became_active":"2024-09-14T10:46:46.346682+0000","last_became_peered":"2024-09-14T10:46:46.346682+0000","last_unstale":"2024-09-14T11:59:34.707652+0000","last_undegraded":"2024-09-14T11:59:34.707652+0000","last_fullsized":"2024-09-14T11:59:34.707652+0000","mapping_epoch":28,"log_start":"263'900","ondisk_log_start":"263'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":900,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:46.804415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4656,"num_read_kb":4197,"num_write":1246,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"263'385","reported_seq":1063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.330643+0000","last_change":"2024-09-14T10:47:19.040942+0000","last_active":"2024-09-14T12:01:19.330643+0000","last_peered":"2024-09-14T12:01:19.330643+0000","last_clean":"2024-09-14T12:01:19.330643+0000","last_became_active":"2024-09-14T10:47:19.040453+0000","last_became_peered":"2024-09-14T10:47:19.040453+0000","last_unstale":"2024-09-14T12:01:19.330643+0000","last_undegraded":"2024-09-14T12:01:19.330643+0000","last_fullsized":"2024-09-14T12:01:19.330643+0000","mapping_epoch":39,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:33.248100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133711,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":707,"num_read_kb":25389,"num_write":1181,"num_write_kb":37274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"263'507","reported_seq":2207,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.152468+0000","last_change":"2024-09-14T10:46:46.349718+0000","last_active":"2024-09-14T11:58:46.152468+0000","last_peered":"2024-09-14T11:58:46.152468+0000","last_clean":"2024-09-14T11:58:46.152468+0000","last_became_active":"2024-09-14T10:46:46.349465+0000","last_became_peered":"2024-09-14T10:46:46.349465+0000","last_unstale":"2024-09-14T11:58:46.152468+0000","last_undegraded":"2024-09-14T11:58:46.152468+0000","last_fullsized":"2024-09-14T11:58:46.152468+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:17.558471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2847,"num_read_kb":2662,"num_write":617,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"263'337","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.392927+0000","last_change":"2024-09-14T10:46:44.320591+0000","last_active":"2024-09-14T12:01:19.392927+0000","last_peered":"2024-09-14T12:01:19.392927+0000","last_clean":"2024-09-14T12:01:19.392927+0000","last_became_active":"2024-09-14T10:46:44.320218+0000","last_became_peered":"2024-09-14T10:46:44.320218+0000","last_unstale":"2024-09-14T12:01:19.392927+0000","last_undegraded":"2024-09-14T12:01:19.392927+0000","last_fullsized":"2024-09-14T12:01:19.392927+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:23.505336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":866,"num_read_kb":10863,"num_write":1127,"num_write_kb":35921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"263'436","reported_seq":2109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.916554+0000","last_change":"2024-09-14T10:46:46.342492+0000","last_active":"2024-09-14T11:58:23.916554+0000","last_peered":"2024-09-14T11:58:23.916554+0000","last_clean":"2024-09-14T11:58:23.916554+0000","last_became_active":"2024-09-14T10:46:46.342206+0000","last_became_peered":"2024-09-14T10:46:46.342206+0000","last_unstale":"2024-09-14T11:58:23.916554+0000","last_undegraded":"2024-09-14T11:58:23.916554+0000","last_fullsized":"2024-09-14T11:58:23.916554+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:44.468754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2469,"num_read_kb":2360,"num_write":494,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"263'464","reported_seq":1146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.397427+0000","last_change":"2024-09-14T10:46:44.314850+0000","last_active":"2024-09-14T12:01:19.397427+0000","last_peered":"2024-09-14T12:01:19.397427+0000","last_clean":"2024-09-14T12:01:19.397427+0000","last_became_active":"2024-09-14T10:46:44.314466+0000","last_became_peered":"2024-09-14T10:46:44.314466+0000","last_unstale":"2024-09-14T12:01:19.397427+0000","last_undegraded":"2024-09-14T12:01:19.397427+0000","last_fullsized":"2024-09-14T12:01:19.397427+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:39.202894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":927,"num_read_kb":16042,"num_write":1243,"num_write_kb":34508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"263'667","reported_seq":2288,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.136829+0000","last_change":"2024-09-14T10:46:46.342488+0000","last_active":"2024-09-14T12:00:51.136829+0000","last_peered":"2024-09-14T12:00:51.136829+0000","last_clean":"2024-09-14T12:00:51.136829+0000","last_became_active":"2024-09-14T10:46:46.342217+0000","last_became_peered":"2024-09-14T10:46:46.342217+0000","last_unstale":"2024-09-14T12:00:51.136829+0000","last_undegraded":"2024-09-14T12:00:51.136829+0000","last_fullsized":"2024-09-14T12:00:51.136829+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":600,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:03.054708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3344,"num_read_kb":3009,"num_write":894,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"263'322","reported_seq":1064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.397645+0000","last_change":"2024-09-14T10:46:44.324067+0000","last_active":"2024-09-14T12:01:19.397645+0000","last_peered":"2024-09-14T12:01:19.397645+0000","last_clean":"2024-09-14T12:01:19.397645+0000","last_became_active":"2024-09-14T10:46:44.323339+0000","last_became_peered":"2024-09-14T10:46:44.323339+0000","last_unstale":"2024-09-14T12:01:19.397645+0000","last_undegraded":"2024-09-14T12:01:19.397645+0000","last_fullsized":"2024-09-14T12:01:19.397645+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:50.726091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":616,"num_read_kb":14372,"num_write":932,"num_write_kb":14595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'444","reported_seq":1976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.351227+0000","last_change":"2024-09-14T10:46:46.341986+0000","last_active":"2024-09-14T11:58:44.351227+0000","last_peered":"2024-09-14T11:58:44.351227+0000","last_clean":"2024-09-14T11:58:44.351227+0000","last_became_active":"2024-09-14T10:46:46.341731+0000","last_became_peered":"2024-09-14T10:46:46.341731+0000","last_unstale":"2024-09-14T11:58:44.351227+0000","last_undegraded":"2024-09-14T11:58:44.351227+0000","last_fullsized":"2024-09-14T11:58:44.351227+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:05.674327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2390,"num_read_kb":2239,"num_write":538,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"263'379","reported_seq":1090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.369338+0000","last_change":"2024-09-14T10:46:44.321933+0000","last_active":"2024-09-14T12:01:19.369338+0000","last_peered":"2024-09-14T12:01:19.369338+0000","last_clean":"2024-09-14T12:01:19.369338+0000","last_became_active":"2024-09-14T10:46:44.321604+0000","last_became_peered":"2024-09-14T10:46:44.321604+0000","last_unstale":"2024-09-14T12:01:19.369338+0000","last_undegraded":"2024-09-14T12:01:19.369338+0000","last_fullsized":"2024-09-14T12:01:19.369338+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:42.964237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":797,"num_read_kb":33592,"num_write":1248,"num_write_kb":22096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"263'970","reported_seq":2678,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.915612+0000","last_change":"2024-09-14T10:46:46.336853+0000","last_active":"2024-09-14T11:58:23.915612+0000","last_peered":"2024-09-14T11:58:23.915612+0000","last_clean":"2024-09-14T11:58:23.915612+0000","last_became_active":"2024-09-14T10:46:46.336508+0000","last_became_peered":"2024-09-14T10:46:46.336508+0000","last_unstale":"2024-09-14T11:58:23.915612+0000","last_undegraded":"2024-09-14T11:58:23.915612+0000","last_fullsized":"2024-09-14T11:58:23.915612+0000","mapping_epoch":28,"log_start":"263'900","ondisk_log_start":"263'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":900,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:08.953818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4671,"num_read_kb":4174,"num_write":1327,"num_write_kb":556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"263'317","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.346999+0000","last_change":"2024-09-14T10:46:44.321413+0000","last_active":"2024-09-14T12:01:19.346999+0000","last_peered":"2024-09-14T12:01:19.346999+0000","last_clean":"2024-09-14T12:01:19.346999+0000","last_became_active":"2024-09-14T10:46:44.321073+0000","last_became_peered":"2024-09-14T10:46:44.321073+0000","last_unstale":"2024-09-14T12:01:19.346999+0000","last_undegraded":"2024-09-14T12:01:19.346999+0000","last_fullsized":"2024-09-14T12:01:19.346999+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:02.410131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":672,"num_read_kb":7284,"num_write":1109,"num_write_kb":7346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"263'352","reported_seq":1803,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.683411+0000","last_change":"2024-09-14T10:46:46.343853+0000","last_active":"2024-09-14T11:59:34.683411+0000","last_peered":"2024-09-14T11:59:34.683411+0000","last_clean":"2024-09-14T11:59:34.683411+0000","last_became_active":"2024-09-14T10:46:46.341188+0000","last_became_peered":"2024-09-14T10:46:46.341188+0000","last_unstale":"2024-09-14T11:59:34.683411+0000","last_undegraded":"2024-09-14T11:59:34.683411+0000","last_fullsized":"2024-09-14T11:59:34.683411+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:55.124703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1965,"num_read_kb":1883,"num_write":389,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"263'399","reported_seq":1059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.365198+0000","last_change":"2024-09-14T10:46:44.316977+0000","last_active":"2024-09-14T12:01:19.365198+0000","last_peered":"2024-09-14T12:01:19.365198+0000","last_clean":"2024-09-14T12:01:19.365198+0000","last_became_active":"2024-09-14T10:46:44.316633+0000","last_became_peered":"2024-09-14T10:46:44.316633+0000","last_unstale":"2024-09-14T12:01:19.365198+0000","last_undegraded":"2024-09-14T12:01:19.365198+0000","last_fullsized":"2024-09-14T12:01:19.365198+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:02.290580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":793,"num_read_kb":2329,"num_write":1224,"num_write_kb":27267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"263'778","reported_seq":2432,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.462116+0000","last_change":"2024-09-14T10:46:46.348188+0000","last_active":"2024-09-14T11:58:58.462116+0000","last_peered":"2024-09-14T11:58:58.462116+0000","last_clean":"2024-09-14T11:58:58.462116+0000","last_became_active":"2024-09-14T10:46:46.347941+0000","last_became_peered":"2024-09-14T10:46:46.347941+0000","last_unstale":"2024-09-14T11:58:58.462116+0000","last_undegraded":"2024-09-14T11:58:58.462116+0000","last_fullsized":"2024-09-14T11:58:58.462116+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:09.760195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3936,"num_read_kb":3604,"num_write":1011,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"263'350","reported_seq":1112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.269823+0000","last_change":"2024-09-14T10:46:44.322513+0000","last_active":"2024-09-14T12:01:19.269823+0000","last_peered":"2024-09-14T12:01:19.269823+0000","last_clean":"2024-09-14T12:01:19.269823+0000","last_became_active":"2024-09-14T10:46:44.322149+0000","last_became_peered":"2024-09-14T10:46:44.322149+0000","last_unstale":"2024-09-14T12:01:19.269823+0000","last_undegraded":"2024-09-14T12:01:19.269823+0000","last_fullsized":"2024-09-14T12:01:19.269823+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:02.597943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":929,"num_read_kb":38620,"num_write":1197,"num_write_kb":16629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"263'788","reported_seq":2341,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.709237+0000","last_change":"2024-09-14T10:46:46.340742+0000","last_active":"2024-09-14T11:59:34.709237+0000","last_peered":"2024-09-14T11:59:34.709237+0000","last_clean":"2024-09-14T11:59:34.709237+0000","last_became_active":"2024-09-14T10:46:46.340475+0000","last_became_peered":"2024-09-14T10:46:46.340475+0000","last_unstale":"2024-09-14T11:59:34.709237+0000","last_undegraded":"2024-09-14T11:59:34.709237+0000","last_fullsized":"2024-09-14T11:59:34.709237+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:20.835262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3820,"num_read_kb":3456,"num_write":1020,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"263'314","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.308236+0000","last_change":"2024-09-14T10:46:44.329821+0000","last_active":"2024-09-14T12:01:19.308236+0000","last_peered":"2024-09-14T12:01:19.308236+0000","last_clean":"2024-09-14T12:01:19.308236+0000","last_became_active":"2024-09-14T10:46:44.329386+0000","last_became_peered":"2024-09-14T10:46:44.329386+0000","last_unstale":"2024-09-14T12:01:19.308236+0000","last_undegraded":"2024-09-14T12:01:19.308236+0000","last_fullsized":"2024-09-14T12:01:19.308236+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:52.796065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133721,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":628,"num_read_kb":13742,"num_write":1168,"num_write_kb":24265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"263'489","reported_seq":2188,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.408190+0000","last_change":"2024-09-14T10:46:46.351572+0000","last_active":"2024-09-14T11:58:50.408190+0000","last_peered":"2024-09-14T11:58:50.408190+0000","last_clean":"2024-09-14T11:58:50.408190+0000","last_became_active":"2024-09-14T10:46:46.351291+0000","last_became_peered":"2024-09-14T10:46:46.351291+0000","last_unstale":"2024-09-14T11:58:50.408190+0000","last_undegraded":"2024-09-14T11:58:50.408190+0000","last_fullsized":"2024-09-14T11:58:50.408190+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:43.260116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2678,"num_read_kb":2537,"num_write":593,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"263'343","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.341847+0000","last_change":"2024-09-14T10:46:44.329049+0000","last_active":"2024-09-14T12:01:19.341847+0000","last_peered":"2024-09-14T12:01:19.341847+0000","last_clean":"2024-09-14T12:01:19.341847+0000","last_became_active":"2024-09-14T10:46:44.328509+0000","last_became_peered":"2024-09-14T10:46:44.328509+0000","last_unstale":"2024-09-14T12:01:19.341847+0000","last_undegraded":"2024-09-14T12:01:19.341847+0000","last_fullsized":"2024-09-14T12:01:19.341847+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:39.663145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":629,"num_read_kb":8535,"num_write":1026,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"263'630","reported_seq":2305,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.706431+0000","last_change":"2024-09-14T10:46:46.343531+0000","last_active":"2024-09-14T11:59:34.706431+0000","last_peered":"2024-09-14T11:59:34.706431+0000","last_clean":"2024-09-14T11:59:34.706431+0000","last_became_active":"2024-09-14T10:46:46.343264+0000","last_became_peered":"2024-09-14T10:46:46.343264+0000","last_unstale":"2024-09-14T11:59:34.706431+0000","last_undegraded":"2024-09-14T11:59:34.706431+0000","last_fullsized":"2024-09-14T11:59:34.706431+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":600,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:52.794216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3383,"num_read_kb":3097,"num_write":846,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"263'340","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.364856+0000","last_change":"2024-09-14T10:46:44.335536+0000","last_active":"2024-09-14T12:01:19.364856+0000","last_peered":"2024-09-14T12:01:19.364856+0000","last_clean":"2024-09-14T12:01:19.364856+0000","last_became_active":"2024-09-14T10:46:44.334832+0000","last_became_peered":"2024-09-14T10:46:44.334832+0000","last_unstale":"2024-09-14T12:01:19.364856+0000","last_undegraded":"2024-09-14T12:01:19.364856+0000","last_fullsized":"2024-09-14T12:01:19.364856+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:03.288996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":614,"num_read_kb":31835,"num_write":1126,"num_write_kb":37799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"263'1869","reported_seq":3527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.599717+0000","last_change":"2024-09-14T10:46:46.345486+0000","last_active":"2024-09-14T11:59:33.599717+0000","last_peered":"2024-09-14T11:59:33.599717+0000","last_clean":"2024-09-14T11:59:33.599717+0000","last_became_active":"2024-09-14T10:46:46.344246+0000","last_became_peered":"2024-09-14T10:46:46.344246+0000","last_unstale":"2024-09-14T11:59:33.599717+0000","last_undegraded":"2024-09-14T11:59:33.599717+0000","last_fullsized":"2024-09-14T11:59:33.599717+0000","mapping_epoch":28,"log_start":"263'1800","ondisk_log_start":"263'1800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":1800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:37.648855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8234,"num_read_kb":7178,"num_write":2635,"num_write_kb":1169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"263'380","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.403710+0000","last_change":"2024-09-14T10:46:44.331913+0000","last_active":"2024-09-14T12:01:19.403710+0000","last_peered":"2024-09-14T12:01:19.403710+0000","last_clean":"2024-09-14T12:01:19.403710+0000","last_became_active":"2024-09-14T10:46:44.331468+0000","last_became_peered":"2024-09-14T10:46:44.331468+0000","last_unstale":"2024-09-14T12:01:19.403710+0000","last_undegraded":"2024-09-14T12:01:19.403710+0000","last_fullsized":"2024-09-14T12:01:19.403710+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:38.672416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":628,"num_read_kb":40986,"num_write":1142,"num_write_kb":50458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"263'596","reported_seq":2253,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.601844+0000","last_change":"2024-09-14T10:46:46.351650+0000","last_active":"2024-09-14T11:59:33.601844+0000","last_peered":"2024-09-14T11:59:33.601844+0000","last_clean":"2024-09-14T11:59:33.601844+0000","last_became_active":"2024-09-14T10:46:46.351379+0000","last_became_peered":"2024-09-14T10:46:46.351379+0000","last_unstale":"2024-09-14T11:59:33.601844+0000","last_undegraded":"2024-09-14T11:59:33.601844+0000","last_fullsized":"2024-09-14T11:59:33.601844+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:18.174017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3319,"num_read_kb":3081,"num_write":803,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"263'409","reported_seq":1126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.384120+0000","last_change":"2024-09-14T10:47:18.421792+0000","last_active":"2024-09-14T12:01:19.384120+0000","last_peered":"2024-09-14T12:01:19.384120+0000","last_clean":"2024-09-14T12:01:19.384120+0000","last_became_active":"2024-09-14T10:47:18.421420+0000","last_became_peered":"2024-09-14T10:47:18.421420+0000","last_unstale":"2024-09-14T12:01:19.384120+0000","last_undegraded":"2024-09-14T12:01:19.384120+0000","last_fullsized":"2024-09-14T12:01:19.384120+0000","mapping_epoch":39,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:05.879273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1006,"num_read_kb":55242,"num_write":1376,"num_write_kb":21886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.30","version":"263'358","reported_seq":1060,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.398368+0000","last_change":"2024-09-14T10:46:44.336725+0000","last_active":"2024-09-14T12:01:19.398368+0000","last_peered":"2024-09-14T12:01:19.398368+0000","last_clean":"2024-09-14T12:01:19.398368+0000","last_became_active":"2024-09-14T10:46:44.336397+0000","last_became_peered":"2024-09-14T10:46:44.336397+0000","last_unstale":"2024-09-14T12:01:19.398368+0000","last_undegraded":"2024-09-14T12:01:19.398368+0000","last_fullsized":"2024-09-14T12:01:19.398368+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":768,"num_read_kb":58312,"num_write":1211,"num_write_kb":50973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"263'436","reported_seq":2121,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.706348+0000","last_change":"2024-09-14T10:46:46.352747+0000","last_active":"2024-09-14T11:59:34.706348+0000","last_peered":"2024-09-14T11:59:34.706348+0000","last_clean":"2024-09-14T11:59:34.706348+0000","last_became_active":"2024-09-14T10:46:46.352396+0000","last_became_peered":"2024-09-14T10:46:46.352396+0000","last_unstale":"2024-09-14T11:59:34.706348+0000","last_undegraded":"2024-09-14T11:59:34.706348+0000","last_fullsized":"2024-09-14T11:59:34.706348+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:53.050193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2667,"num_read_kb":2535,"num_write":508,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"263'294","reported_seq":904,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.379983+0000","last_change":"2024-09-14T10:46:44.331837+0000","last_active":"2024-09-14T12:01:19.379983+0000","last_peered":"2024-09-14T12:01:19.379983+0000","last_clean":"2024-09-14T12:01:19.379983+0000","last_became_active":"2024-09-14T10:46:44.331494+0000","last_became_peered":"2024-09-14T10:46:44.331494+0000","last_unstale":"2024-09-14T12:01:19.379983+0000","last_undegraded":"2024-09-14T12:01:19.379983+0000","last_fullsized":"2024-09-14T12:01:19.379983+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:43.292631+0000","last_clean_scrub_stamp":"2024-09-14T10:46:43.292631+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:39.194351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048962,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":471,"num_read_kb":43363,"num_write":903,"num_write_kb":33511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"263'471","reported_seq":1972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.221996+0000","last_change":"2024-09-14T10:46:46.339727+0000","last_active":"2024-09-14T11:58:15.221996+0000","last_peered":"2024-09-14T11:58:15.221996+0000","last_clean":"2024-09-14T11:58:15.221996+0000","last_became_active":"2024-09-14T10:46:46.339440+0000","last_became_peered":"2024-09-14T10:46:46.339440+0000","last_unstale":"2024-09-14T11:58:15.221996+0000","last_undegraded":"2024-09-14T11:58:15.221996+0000","last_fullsized":"2024-09-14T11:58:15.221996+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:46.085936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2508,"num_read_kb":2330,"num_write":579,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9256,"num_read_kb":6632,"num_write":2794,"num_write_kb":850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":943,"ondisk_log_size":943,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15505,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":15201,"num_read_kb":14853,"num_write":17064,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1688,"ondisk_log_size":1688,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":556,"ondisk_log_size":556,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1549008,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":19140,"num_read_kb":39857,"num_write":16035,"num_write_kb":12077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1963,"ondisk_log_size":1963,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2425,"num_read_kb":2892,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":218145,"num_read_kb":199614,"num_write":55573,"num_write_kb":18950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3985,"ondisk_log_size":3985,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":30929583,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":44270,"num_read_kb":1895605,"num_write":71703,"num_write_kb":2068626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":47898624,"data_stored":47898624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3414,"ondisk_log_size":3414,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":184539,"num_write":157,"num_write_kb":126109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":184485,"num_write":157,"num_write_kb":126109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510347,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":225200,"kb_used_data":9252,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":94146640,"statfs":{"total":96636764160,"available":96406159360,"internally_reserved":0,"allocated":9474048,"data_stored":7497795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":220920266},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510346,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":205276,"kb_used_data":11472,"kb_used_omap":1,"kb_used_meta":193534,"kb_avail":94166564,"statfs":{"total":96636764160,"available":96426561536,"internally_reserved":0,"allocated":11747328,"data_stored":9764047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":198179269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510346,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244176,"kb_used_data":14176,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94127664,"statfs":{"total":96636764160,"available":96386727936,"internally_reserved":0,"allocated":14516224,"data_stored":12527301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510346,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127500,"kb_used_data":10092,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94244340,"statfs":{"total":96636764160,"available":96506204160,"internally_reserved":0,"allocated":10334208,"data_stored":8364267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510345,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320452,"kb_used_data":10084,"kb_used_omap":1,"kb_used_meta":310206,"kb_avail":94051388,"statfs":{"total":96636764160,"available":96308621312,"internally_reserved":0,"allocated":10326016,"data_stored":8344841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":317651397},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510345,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112076,"kb_used_data":8700,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94259764,"statfs":{"total":96636764160,"available":96521998336,"internally_reserved":0,"allocated":8908800,"data_stored":6901467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543048,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137520,"kb_used_data":7500,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94234320,"statfs":{"total":96636764160,"available":96495943680,"internally_reserved":0,"allocated":7680000,"data_stored":5672286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132774343},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575754,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":283732,"kb_used_data":9420,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94088108,"statfs":{"total":96636764160,"available":96346222592,"internally_reserved":0,"allocated":9646080,"data_stored":7654490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4694016,"data_stored":4694016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5550080,"data_stored":5550080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6160384,"data_stored":6160384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10321920,"data_stored":10321920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7557120,"data_stored":7557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4857856,"data_stored":4857856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3465216,"data_stored":3465216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5292032,"data_stored":5292032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:01:27.631 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.631 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.631 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.631 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.631 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.631 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.631 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.632 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.632 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.632 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.632 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.632 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.632 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.632 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.632 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.632 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.633 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.633 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.633 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.633 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.633 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.633 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.633 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.633 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.634 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.634 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.634 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.634 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.634 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.634 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.634 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.634 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.634 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.634 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.635 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.635 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.635 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.635 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.635 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.635 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.635 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.636 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.636 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.636 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.636 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.636 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.636 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.636 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.636 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.637 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.637 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.637 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.637 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.637 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.637 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.637 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.637 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.637 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.638 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.638 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.638 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.638 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.638 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.638 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.638 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.638 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.638 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.639 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.639 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.639 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.639 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.639 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.639 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.639 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.639 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.639 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.640 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.640 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.640 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.640 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.640 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.640 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.640 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.640 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.640 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.641 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.641 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.641 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.641 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.641 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.641 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.641 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.641 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.642 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.642 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.642 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.642 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.642 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.642 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.642 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.642 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.642 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.642 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.643 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.643 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.643 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.643 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.643 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.643 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.643 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.643 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.643 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.644 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.644 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.644 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.644 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.644 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.644 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.644 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.644 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.645 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.645 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.645 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.645 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.645 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.645 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.645 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.645 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.646 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.646 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.646 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.646 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.646 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.646 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.646 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.646 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.646 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.647 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.647 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.647 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.647 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.647 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.647 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.647 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.647 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.647 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.647 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.648 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.648 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.648 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.648 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.648 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.648 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.648 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.648 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.648 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.649 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.649 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.649 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.649 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.649 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.649 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.649 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.649 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.649 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.650 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.650 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.650 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.650 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.650 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.650 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.650 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.650 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.650 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.651 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.651 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.651 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.651 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.651 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.651 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.651 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.651 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.651 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.651 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.652 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.652 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.652 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.652 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.652 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.652 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.652 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.652 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.652 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.653 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.653 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.653 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.653 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.653 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.653 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.653 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.653 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.653 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.654 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.654 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.654 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.654 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.654 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.654 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.654 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.654 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.654 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.655 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.655 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.655 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.655 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.655 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.655 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.655 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.655 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.655 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.656 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.656 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.656 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.656 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.656 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.656 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.656 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.656 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.657 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-14T10:46:32.251879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.657 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.657 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.657 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.657 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.657 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.657 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.657 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-14T10:46:32.251879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.657 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.657 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.658 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.658 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.658 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.658 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.658 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-14T10:46:32.251879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.658 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.658 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.658 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.658 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.659 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.659 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.659 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-14T10:46:32.251879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.659 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.659 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.659 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.659 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.659 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.659 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-14T10:46:32.251879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.660 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.660 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.660 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.660 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.660 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.660 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.660 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-14T10:46:32.251879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.660 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.660 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.661 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.661 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.661 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.661 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.661 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-14T10:46:32.251879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.661 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.661 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.661 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.662 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.662 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.662 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.662 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-14T10:46:32.251879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.662 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.662 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.662 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.662 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.662 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.663 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.663 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.663 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.663 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.663 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.663 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.663 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.663 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.663 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.663 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.664 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.664 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.664 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.664 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.664 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.664 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.664 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.664 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.664 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.665 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.665 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.665 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.665 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.665 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.665 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.665 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.665 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.665 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.666 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.666 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.666 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.666 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.666 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.666 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.666 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.666 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.666 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.666 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.667 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.667 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.667 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.667 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.667 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.667 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.667 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.667 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.667 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.668 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.668 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.668 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.668 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.668 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.668 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.668 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.668 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.668 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.669 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.669 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.669 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.669 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.669 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.669 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.669 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.669 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.669 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.670 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.670 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.670 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.670 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.670 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.670 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.670 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.670 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.670 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.671 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.671 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.671 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.671 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.671 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.671 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.671 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.671 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.672 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.672 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.672 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.672 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.672 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.672 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.672 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.672 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.672 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.673 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.673 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.673 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.673 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.673 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.673 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.673 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.673 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.674 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.674 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.674 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.674 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.674 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.674 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.674 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-14T10:46:43.292631+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.674 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:27.674 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T12:01:47.675 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:01:48.026 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T12:01:48.037 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-14T12:01:48.038 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":2517,"stamp":"2024-09-14T12:01:47.036077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":33086276,"num_objects":745,"num_object_clones":0,"num_object_copies":1770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":745,"num_whiteouts":0,"num_read":308787,"num_read_kb":2528544,"num_write":163626,"num_write_kb":2359360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":569853,"num_omap_keys":1339,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12815,"ondisk_log_size":12815,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1654392,"kb_used_data":80696,"kb_used_omap":12,"kb_used_meta":1573555,"kb_avail":753320328,"statfs":{"total":773094113280,"available":771400015872,"internally_reserved":0,"allocated":82632704,"data_stored":66726494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1611320881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":569853,"num_omap_keys":1339,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005590"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.599297+0000","last_change":"2024-09-14T11:25:20.213046+0000","last_active":"2024-09-14T11:57:50.599297+0000","last_peered":"2024-09-14T11:57:50.599297+0000","last_clean":"2024-09-14T11:57:50.599297+0000","last_became_active":"2024-09-14T11:25:20.212282+0000","last_became_peered":"2024-09-14T11:25:20.212282+0000","last_unstale":"2024-09-14T11:57:50.599297+0000","last_undegraded":"2024-09-14T11:57:50.599297+0000","last_fullsized":"2024-09-14T11:57:50.599297+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:37.717916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"263'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.753344+0000","last_change":"2024-09-14T11:06:45.982990+0000","last_active":"2024-09-14T12:01:18.753344+0000","last_peered":"2024-09-14T12:01:18.753344+0000","last_clean":"2024-09-14T12:01:18.753344+0000","last_became_active":"2024-09-14T11:06:45.982702+0000","last_became_peered":"2024-09-14T11:06:45.982702+0000","last_unstale":"2024-09-14T12:01:18.753344+0000","last_undegraded":"2024-09-14T12:01:18.753344+0000","last_fullsized":"2024-09-14T12:01:18.753344+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.453983+0000","last_change":"2024-09-14T11:06:41.918549+0000","last_active":"2024-09-14T11:59:15.453983+0000","last_peered":"2024-09-14T11:59:15.453983+0000","last_clean":"2024-09-14T11:59:15.453983+0000","last_became_active":"2024-09-14T11:06:41.918259+0000","last_became_peered":"2024-09-14T11:06:41.918259+0000","last_unstale":"2024-09-14T11:59:15.453983+0000","last_undegraded":"2024-09-14T11:59:15.453983+0000","last_fullsized":"2024-09-14T11:59:15.453983+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'53","reported_seq":204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.650174+0000","last_change":"2024-09-14T11:02:34.872954+0000","last_active":"2024-09-14T11:58:50.650174+0000","last_peered":"2024-09-14T11:58:50.650174+0000","last_clean":"2024-09-14T11:58:50.650174+0000","last_became_active":"2024-09-14T11:02:34.872682+0000","last_became_peered":"2024-09-14T11:02:34.872682+0000","last_unstale":"2024-09-14T11:58:50.650174+0000","last_undegraded":"2024-09-14T11:58:50.650174+0000","last_fullsized":"2024-09-14T11:58:50.650174+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:01.174737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":419,"num_read_kb":273,"num_write":133,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:53.517430+0000","last_change":"2024-09-14T11:25:20.206920+0000","last_active":"2024-09-14T11:57:53.517430+0000","last_peered":"2024-09-14T11:57:53.517430+0000","last_clean":"2024-09-14T11:57:53.517430+0000","last_became_active":"2024-09-14T11:25:20.206601+0000","last_became_peered":"2024-09-14T11:25:20.206601+0000","last_unstale":"2024-09-14T11:57:53.517430+0000","last_undegraded":"2024-09-14T11:57:53.517430+0000","last_fullsized":"2024-09-14T11:57:53.517430+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:13.234370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"263'13","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.358756+0000","last_change":"2024-09-14T11:06:45.992917+0000","last_active":"2024-09-14T12:01:18.358756+0000","last_peered":"2024-09-14T12:01:18.358756+0000","last_clean":"2024-09-14T12:01:18.358756+0000","last_became_active":"2024-09-14T11:06:45.992612+0000","last_became_peered":"2024-09-14T11:06:45.992612+0000","last_unstale":"2024-09-14T12:01:18.358756+0000","last_undegraded":"2024-09-14T12:01:18.358756+0000","last_fullsized":"2024-09-14T12:01:18.358756+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13883,"num_write":28,"num_write_kb":14907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"263'4","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.117168+0000","last_change":"2024-09-14T11:06:41.912107+0000","last_active":"2024-09-14T12:01:19.117168+0000","last_peered":"2024-09-14T12:01:19.117168+0000","last_clean":"2024-09-14T12:01:19.117168+0000","last_became_active":"2024-09-14T11:06:41.911807+0000","last_became_peered":"2024-09-14T11:06:41.911807+0000","last_unstale":"2024-09-14T12:01:19.117168+0000","last_undegraded":"2024-09-14T12:01:19.117168+0000","last_fullsized":"2024-09-14T12:01:19.117168+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":621,"num_write":4,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"263'41","reported_seq":172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.650153+0000","last_change":"2024-09-14T11:02:34.879623+0000","last_active":"2024-09-14T11:58:50.650153+0000","last_peered":"2024-09-14T11:58:50.650153+0000","last_clean":"2024-09-14T11:58:50.650153+0000","last_became_active":"2024-09-14T11:02:34.879272+0000","last_became_peered":"2024-09-14T11:02:34.879272+0000","last_unstale":"2024-09-14T11:58:50.650153+0000","last_undegraded":"2024-09-14T11:58:50.650153+0000","last_fullsized":"2024-09-14T11:58:50.650153+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:46.038847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":323,"num_read_kb":209,"num_write":113,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.411969+0000","last_change":"2024-09-14T11:25:20.207542+0000","last_active":"2024-09-14T11:59:10.411969+0000","last_peered":"2024-09-14T11:59:10.411969+0000","last_clean":"2024-09-14T11:59:10.411969+0000","last_became_active":"2024-09-14T11:25:20.207226+0000","last_became_peered":"2024-09-14T11:25:20.207226+0000","last_unstale":"2024-09-14T11:59:10.411969+0000","last_undegraded":"2024-09-14T11:59:10.411969+0000","last_fullsized":"2024-09-14T11:59:10.411969+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.461362+0000","last_change":"2024-09-14T11:06:45.981984+0000","last_active":"2024-09-14T11:58:53.461362+0000","last_peered":"2024-09-14T11:58:53.461362+0000","last_clean":"2024-09-14T11:58:53.461362+0000","last_became_active":"2024-09-14T11:06:45.981705+0000","last_became_peered":"2024-09-14T11:06:45.981705+0000","last_unstale":"2024-09-14T11:58:53.461362+0000","last_undegraded":"2024-09-14T11:58:53.461362+0000","last_fullsized":"2024-09-14T11:58:53.461362+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:53.066712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.450843+0000","last_change":"2024-09-14T11:06:41.918237+0000","last_active":"2024-09-14T11:58:55.450843+0000","last_peered":"2024-09-14T11:58:55.450843+0000","last_clean":"2024-09-14T11:58:55.450843+0000","last_became_active":"2024-09-14T11:06:41.917774+0000","last_became_peered":"2024-09-14T11:06:41.917774+0000","last_unstale":"2024-09-14T11:58:55.450843+0000","last_undegraded":"2024-09-14T11:58:55.450843+0000","last_fullsized":"2024-09-14T11:58:55.450843+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:42.986789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'20","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:38.515232+0000","last_change":"2024-09-14T11:02:34.875159+0000","last_active":"2024-09-14T11:57:38.515232+0000","last_peered":"2024-09-14T11:57:38.515232+0000","last_clean":"2024-09-14T11:57:38.515232+0000","last_became_active":"2024-09-14T11:02:34.874685+0000","last_became_peered":"2024-09-14T11:02:34.874685+0000","last_unstale":"2024-09-14T11:57:38.515232+0000","last_undegraded":"2024-09-14T11:57:38.515232+0000","last_fullsized":"2024-09-14T11:57:38.515232+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:21.593031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":99,"num_write":50,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.465555+0000","last_change":"2024-09-14T11:25:20.211504+0000","last_active":"2024-09-14T11:59:18.465555+0000","last_peered":"2024-09-14T11:59:18.465555+0000","last_clean":"2024-09-14T11:59:18.465555+0000","last_became_active":"2024-09-14T11:25:20.211190+0000","last_became_peered":"2024-09-14T11:25:20.211190+0000","last_unstale":"2024-09-14T11:59:18.465555+0000","last_undegraded":"2024-09-14T11:59:18.465555+0000","last_fullsized":"2024-09-14T11:59:18.465555+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"263'7","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:58.480804+0000","last_change":"2024-09-14T11:06:45.980127+0000","last_active":"2024-09-14T12:00:58.480804+0000","last_peered":"2024-09-14T12:00:58.480804+0000","last_clean":"2024-09-14T12:00:58.480804+0000","last_became_active":"2024-09-14T11:06:45.979801+0000","last_became_peered":"2024-09-14T11:06:45.979801+0000","last_unstale":"2024-09-14T12:00:58.480804+0000","last_undegraded":"2024-09-14T12:00:58.480804+0000","last_fullsized":"2024-09-14T12:00:58.480804+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:14.264168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"263'5","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.481620+0000","last_change":"2024-09-14T11:06:41.905310+0000","last_active":"2024-09-14T12:01:17.481620+0000","last_peered":"2024-09-14T12:01:17.481620+0000","last_clean":"2024-09-14T12:01:17.481620+0000","last_became_active":"2024-09-14T11:06:41.905007+0000","last_became_peered":"2024-09-14T11:06:41.905007+0000","last_unstale":"2024-09-14T12:01:17.481620+0000","last_undegraded":"2024-09-14T12:01:17.481620+0000","last_fullsized":"2024-09-14T12:01:17.481620+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:37.875569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'31","reported_seq":132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:38.515217+0000","last_change":"2024-09-14T11:02:34.873370+0000","last_active":"2024-09-14T11:57:38.515217+0000","last_peered":"2024-09-14T11:57:38.515217+0000","last_clean":"2024-09-14T11:57:38.515217+0000","last_became_active":"2024-09-14T11:02:34.873091+0000","last_became_peered":"2024-09-14T11:02:34.873091+0000","last_unstale":"2024-09-14T11:57:38.515217+0000","last_undegraded":"2024-09-14T11:57:38.515217+0000","last_fullsized":"2024-09-14T11:57:38.515217+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:05.952366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":154,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.455682+0000","last_change":"2024-09-14T11:25:20.213420+0000","last_active":"2024-09-14T11:59:25.455682+0000","last_peered":"2024-09-14T11:59:25.455682+0000","last_clean":"2024-09-14T11:59:25.455682+0000","last_became_active":"2024-09-14T11:25:20.213064+0000","last_became_peered":"2024-09-14T11:25:20.213064+0000","last_unstale":"2024-09-14T11:59:25.455682+0000","last_undegraded":"2024-09-14T11:59:25.455682+0000","last_fullsized":"2024-09-14T11:59:25.455682+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:55.006063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"263'7","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:55.612856+0000","last_change":"2024-09-14T11:06:45.982348+0000","last_active":"2024-09-14T11:59:55.612856+0000","last_peered":"2024-09-14T11:59:55.612856+0000","last_clean":"2024-09-14T11:59:55.612856+0000","last_became_active":"2024-09-14T11:06:45.977225+0000","last_became_peered":"2024-09-14T11:06:45.977225+0000","last_unstale":"2024-09-14T11:59:55.612856+0000","last_undegraded":"2024-09-14T11:59:55.612856+0000","last_fullsized":"2024-09-14T11:59:55.612856+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:19.723203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20490,"num_write":7,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.447928+0000","last_change":"2024-09-14T11:06:41.916297+0000","last_active":"2024-09-14T11:57:28.447928+0000","last_peered":"2024-09-14T11:57:28.447928+0000","last_clean":"2024-09-14T11:57:28.447928+0000","last_became_active":"2024-09-14T11:06:41.916037+0000","last_became_peered":"2024-09-14T11:06:41.916037+0000","last_unstale":"2024-09-14T11:57:28.447928+0000","last_undegraded":"2024-09-14T11:57:28.447928+0000","last_fullsized":"2024-09-14T11:57:28.447928+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:36.838054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"263'6","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:38.515163+0000","last_change":"2024-09-14T11:02:34.878852+0000","last_active":"2024-09-14T11:57:38.515163+0000","last_peered":"2024-09-14T11:57:38.515163+0000","last_clean":"2024-09-14T11:57:38.515163+0000","last_became_active":"2024-09-14T11:02:34.878477+0000","last_became_peered":"2024-09-14T11:02:34.878477+0000","last_unstale":"2024-09-14T11:57:38.515163+0000","last_undegraded":"2024-09-14T11:57:38.515163+0000","last_fullsized":"2024-09-14T11:57:38.515163+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:50.190261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.648824+0000","last_change":"2024-09-14T11:25:20.211103+0000","last_active":"2024-09-14T11:58:40.648824+0000","last_peered":"2024-09-14T11:58:40.648824+0000","last_clean":"2024-09-14T11:58:40.648824+0000","last_became_active":"2024-09-14T11:25:20.210841+0000","last_became_peered":"2024-09-14T11:25:20.210841+0000","last_unstale":"2024-09-14T11:58:40.648824+0000","last_undegraded":"2024-09-14T11:58:40.648824+0000","last_fullsized":"2024-09-14T11:58:40.648824+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:22.472173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"260'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:30.523488+0000","last_change":"2024-09-14T11:06:45.992541+0000","last_active":"2024-09-14T11:57:30.523488+0000","last_peered":"2024-09-14T11:57:30.523488+0000","last_clean":"2024-09-14T11:57:30.523488+0000","last_became_active":"2024-09-14T11:06:45.992046+0000","last_became_peered":"2024-09-14T11:06:45.992046+0000","last_unstale":"2024-09-14T11:57:30.523488+0000","last_undegraded":"2024-09-14T11:57:30.523488+0000","last_fullsized":"2024-09-14T11:57:30.523488+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:54.123557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:35.524118+0000","last_change":"2024-09-14T11:06:41.909618+0000","last_active":"2024-09-14T11:57:35.524118+0000","last_peered":"2024-09-14T11:57:35.524118+0000","last_clean":"2024-09-14T11:57:35.524118+0000","last_became_active":"2024-09-14T11:06:41.909310+0000","last_became_peered":"2024-09-14T11:06:41.909310+0000","last_unstale":"2024-09-14T11:57:35.524118+0000","last_undegraded":"2024-09-14T11:57:35.524118+0000","last_fullsized":"2024-09-14T11:57:35.524118+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:36.988586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"263'17","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:35.298310+0000","last_change":"2024-09-14T11:02:34.879155+0000","last_active":"2024-09-14T11:57:35.298310+0000","last_peered":"2024-09-14T11:57:35.298310+0000","last_clean":"2024-09-14T11:57:35.298310+0000","last_became_active":"2024-09-14T11:02:34.878859+0000","last_became_peered":"2024-09-14T11:02:34.878859+0000","last_unstale":"2024-09-14T11:57:35.298310+0000","last_undegraded":"2024-09-14T11:57:35.298310+0000","last_fullsized":"2024-09-14T11:57:35.298310+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:06.717501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":82,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.300187+0000","last_change":"2024-09-14T11:25:20.214123+0000","last_active":"2024-09-14T11:57:50.300187+0000","last_peered":"2024-09-14T11:57:50.300187+0000","last_clean":"2024-09-14T11:57:50.300187+0000","last_became_active":"2024-09-14T11:25:20.213540+0000","last_became_peered":"2024-09-14T11:25:20.213540+0000","last_unstale":"2024-09-14T11:57:50.300187+0000","last_undegraded":"2024-09-14T11:57:50.300187+0000","last_fullsized":"2024-09-14T11:57:50.300187+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:22.650940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.309099+0000","last_change":"2024-09-14T11:06:45.986594+0000","last_active":"2024-09-14T11:59:15.309099+0000","last_peered":"2024-09-14T11:59:15.309099+0000","last_clean":"2024-09-14T11:59:15.309099+0000","last_became_active":"2024-09-14T11:06:45.984536+0000","last_became_peered":"2024-09-14T11:06:45.984536+0000","last_unstale":"2024-09-14T11:59:15.309099+0000","last_undegraded":"2024-09-14T11:59:15.309099+0000","last_fullsized":"2024-09-14T11:59:15.309099+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.608067+0000","last_change":"2024-09-14T11:06:41.917589+0000","last_active":"2024-09-14T11:59:15.608067+0000","last_peered":"2024-09-14T11:59:15.608067+0000","last_clean":"2024-09-14T11:59:15.608067+0000","last_became_active":"2024-09-14T11:06:41.917297+0000","last_became_peered":"2024-09-14T11:06:41.917297+0000","last_unstale":"2024-09-14T11:59:15.608067+0000","last_undegraded":"2024-09-14T11:59:15.608067+0000","last_fullsized":"2024-09-14T11:59:15.608067+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"260'21","reported_seq":118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.445641+0000","last_change":"2024-09-14T11:02:34.877058+0000","last_active":"2024-09-14T11:58:20.445641+0000","last_peered":"2024-09-14T11:58:20.445641+0000","last_clean":"2024-09-14T11:58:20.445641+0000","last_became_active":"2024-09-14T11:02:34.876726+0000","last_became_peered":"2024-09-14T11:02:34.876726+0000","last_unstale":"2024-09-14T11:58:20.445641+0000","last_undegraded":"2024-09-14T11:58:20.445641+0000","last_fullsized":"2024-09-14T11:58:20.445641+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:13.228297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":116,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.599347+0000","last_change":"2024-09-14T11:25:20.214842+0000","last_active":"2024-09-14T11:57:50.599347+0000","last_peered":"2024-09-14T11:57:50.599347+0000","last_clean":"2024-09-14T11:57:50.599347+0000","last_became_active":"2024-09-14T11:25:20.214475+0000","last_became_peered":"2024-09-14T11:25:20.214475+0000","last_unstale":"2024-09-14T11:57:50.599347+0000","last_undegraded":"2024-09-14T11:57:50.599347+0000","last_fullsized":"2024-09-14T11:57:50.599347+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:56.001599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.453947+0000","last_change":"2024-09-14T11:06:45.990723+0000","last_active":"2024-09-14T11:59:15.453947+0000","last_peered":"2024-09-14T11:59:15.453947+0000","last_clean":"2024-09-14T11:59:15.453947+0000","last_became_active":"2024-09-14T11:06:45.990419+0000","last_became_peered":"2024-09-14T11:06:45.990419+0000","last_unstale":"2024-09-14T11:59:15.453947+0000","last_undegraded":"2024-09-14T11:59:15.453947+0000","last_fullsized":"2024-09-14T11:59:15.453947+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"260'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.529672+0000","last_change":"2024-09-14T11:06:41.911568+0000","last_active":"2024-09-14T11:59:13.529672+0000","last_peered":"2024-09-14T11:59:13.529672+0000","last_clean":"2024-09-14T11:59:13.529672+0000","last_became_active":"2024-09-14T11:06:41.910694+0000","last_became_peered":"2024-09-14T11:06:41.910694+0000","last_unstale":"2024-09-14T11:59:13.529672+0000","last_undegraded":"2024-09-14T11:59:13.529672+0000","last_fullsized":"2024-09-14T11:59:13.529672+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"263'21","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:13.520593+0000","last_change":"2024-09-14T11:02:34.873098+0000","last_active":"2024-09-14T11:58:13.520593+0000","last_peered":"2024-09-14T11:58:13.520593+0000","last_clean":"2024-09-14T11:58:13.520593+0000","last_became_active":"2024-09-14T11:02:34.872803+0000","last_became_peered":"2024-09-14T11:02:34.872803+0000","last_unstale":"2024-09-14T11:58:13.520593+0000","last_undegraded":"2024-09-14T11:58:13.520593+0000","last_fullsized":"2024-09-14T11:58:13.520593+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:22.434265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":102,"num_write":56,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:03.453145+0000","last_change":"2024-09-14T11:25:20.208606+0000","last_active":"2024-09-14T11:58:03.453145+0000","last_peered":"2024-09-14T11:58:03.453145+0000","last_clean":"2024-09-14T11:58:03.453145+0000","last_became_active":"2024-09-14T11:25:20.207780+0000","last_became_peered":"2024-09-14T11:25:20.207780+0000","last_unstale":"2024-09-14T11:58:03.453145+0000","last_undegraded":"2024-09-14T11:58:03.453145+0000","last_fullsized":"2024-09-14T11:58:03.453145+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:39.802914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"263'9","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.358375+0000","last_change":"2024-09-14T11:06:45.992867+0000","last_active":"2024-09-14T12:01:18.358375+0000","last_peered":"2024-09-14T12:01:18.358375+0000","last_clean":"2024-09-14T12:01:18.358375+0000","last_became_active":"2024-09-14T11:06:45.992208+0000","last_became_peered":"2024-09-14T11:06:45.992208+0000","last_unstale":"2024-09-14T12:01:18.358375+0000","last_undegraded":"2024-09-14T12:01:18.358375+0000","last_fullsized":"2024-09-14T12:01:18.358375+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:21.488237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":17408,"num_write":14,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"263'8","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:30.546211+0000","last_change":"2024-09-14T11:06:41.915462+0000","last_active":"2024-09-14T12:00:30.546211+0000","last_peered":"2024-09-14T12:00:30.546211+0000","last_clean":"2024-09-14T12:00:30.546211+0000","last_became_active":"2024-09-14T11:06:41.915173+0000","last_became_peered":"2024-09-14T11:06:41.915173+0000","last_unstale":"2024-09-14T12:00:30.546211+0000","last_undegraded":"2024-09-14T12:00:30.546211+0000","last_fullsized":"2024-09-14T12:00:30.546211+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:30.823550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10242,"num_write":13,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"263'15","reported_seq":94,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:10.644198+0000","last_change":"2024-09-14T11:02:34.867951+0000","last_active":"2024-09-14T11:58:10.644198+0000","last_peered":"2024-09-14T11:58:10.644198+0000","last_clean":"2024-09-14T11:58:10.644198+0000","last_became_active":"2024-09-14T11:02:34.867669+0000","last_became_peered":"2024-09-14T11:02:34.867669+0000","last_unstale":"2024-09-14T11:58:10.644198+0000","last_undegraded":"2024-09-14T11:58:10.644198+0000","last_fullsized":"2024-09-14T11:58:10.644198+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:05.093113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":79,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:03.519056+0000","last_change":"2024-09-14T11:25:20.210078+0000","last_active":"2024-09-14T11:58:03.519056+0000","last_peered":"2024-09-14T11:58:03.519056+0000","last_clean":"2024-09-14T11:58:03.519056+0000","last_became_active":"2024-09-14T11:25:20.209801+0000","last_became_peered":"2024-09-14T11:25:20.209801+0000","last_unstale":"2024-09-14T11:58:03.519056+0000","last_undegraded":"2024-09-14T11:58:03.519056+0000","last_fullsized":"2024-09-14T11:58:03.519056+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:20.540163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:18.455327+0000","last_change":"2024-09-14T11:06:45.990540+0000","last_active":"2024-09-14T11:58:18.455327+0000","last_peered":"2024-09-14T11:58:18.455327+0000","last_clean":"2024-09-14T11:58:18.455327+0000","last_became_active":"2024-09-14T11:06:45.990093+0000","last_became_peered":"2024-09-14T11:06:45.990093+0000","last_unstale":"2024-09-14T11:58:18.455327+0000","last_undegraded":"2024-09-14T11:58:18.455327+0000","last_fullsized":"2024-09-14T11:58:18.455327+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:20.070813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"263'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.604354+0000","last_change":"2024-09-14T11:06:41.913660+0000","last_active":"2024-09-14T12:01:17.604354+0000","last_peered":"2024-09-14T12:01:17.604354+0000","last_clean":"2024-09-14T12:01:17.604354+0000","last_became_active":"2024-09-14T11:06:41.913330+0000","last_became_peered":"2024-09-14T11:06:41.913330+0000","last_unstale":"2024-09-14T12:01:17.604354+0000","last_undegraded":"2024-09-14T12:01:17.604354+0000","last_fullsized":"2024-09-14T12:01:17.604354+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:02.767092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"263'51","reported_seq":192,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:10.644171+0000","last_change":"2024-09-14T11:02:34.879784+0000","last_active":"2024-09-14T11:58:10.644171+0000","last_peered":"2024-09-14T11:58:10.644171+0000","last_clean":"2024-09-14T11:58:10.644171+0000","last_became_active":"2024-09-14T11:02:34.879480+0000","last_became_peered":"2024-09-14T11:02:34.879480+0000","last_unstale":"2024-09-14T11:58:10.644171+0000","last_undegraded":"2024-09-14T11:58:10.644171+0000","last_fullsized":"2024-09-14T11:58:10.644171+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:26.792769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":249,"num_write":134,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:00.301161+0000","last_change":"2024-09-14T11:25:20.208545+0000","last_active":"2024-09-14T11:58:00.301161+0000","last_peered":"2024-09-14T11:58:00.301161+0000","last_clean":"2024-09-14T11:58:00.301161+0000","last_became_active":"2024-09-14T11:25:20.208253+0000","last_became_peered":"2024-09-14T11:25:20.208253+0000","last_unstale":"2024-09-14T11:58:00.301161+0000","last_undegraded":"2024-09-14T11:58:00.301161+0000","last_fullsized":"2024-09-14T11:58:00.301161+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:46.409317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:30.439086+0000","last_change":"2024-09-14T11:06:45.986563+0000","last_active":"2024-09-14T11:57:30.439086+0000","last_peered":"2024-09-14T11:57:30.439086+0000","last_clean":"2024-09-14T11:57:30.439086+0000","last_became_active":"2024-09-14T11:06:45.986268+0000","last_became_peered":"2024-09-14T11:06:45.986268+0000","last_unstale":"2024-09-14T11:57:30.439086+0000","last_undegraded":"2024-09-14T11:57:30.439086+0000","last_fullsized":"2024-09-14T11:57:30.439086+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:57.096459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.287810+0000","last_change":"2024-09-14T11:06:41.919231+0000","last_active":"2024-09-14T12:01:18.287810+0000","last_peered":"2024-09-14T12:01:18.287810+0000","last_clean":"2024-09-14T12:01:18.287810+0000","last_became_active":"2024-09-14T11:06:41.918902+0000","last_became_peered":"2024-09-14T11:06:41.918902+0000","last_unstale":"2024-09-14T12:01:18.287810+0000","last_undegraded":"2024-09-14T12:01:18.287810+0000","last_fullsized":"2024-09-14T12:01:18.287810+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:28.218893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"263'3","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:10.444411+0000","last_change":"2024-09-14T11:02:34.877942+0000","last_active":"2024-09-14T11:58:10.444411+0000","last_peered":"2024-09-14T11:58:10.444411+0000","last_clean":"2024-09-14T11:58:10.444411+0000","last_became_active":"2024-09-14T11:02:34.877623+0000","last_became_peered":"2024-09-14T11:02:34.877623+0000","last_unstale":"2024-09-14T11:58:10.444411+0000","last_undegraded":"2024-09-14T11:58:10.444411+0000","last_fullsized":"2024-09-14T11:58:10.444411+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:37.635532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:00.600265+0000","last_change":"2024-09-14T11:25:20.208685+0000","last_active":"2024-09-14T11:58:00.600265+0000","last_peered":"2024-09-14T11:58:00.600265+0000","last_clean":"2024-09-14T11:58:00.600265+0000","last_became_active":"2024-09-14T11:25:20.208411+0000","last_became_peered":"2024-09-14T11:25:20.208411+0000","last_unstale":"2024-09-14T11:58:00.600265+0000","last_undegraded":"2024-09-14T11:58:00.600265+0000","last_fullsized":"2024-09-14T11:58:00.600265+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:34.443942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:30.597082+0000","last_change":"2024-09-14T11:06:45.978750+0000","last_active":"2024-09-14T11:57:30.597082+0000","last_peered":"2024-09-14T11:57:30.597082+0000","last_clean":"2024-09-14T11:57:30.597082+0000","last_became_active":"2024-09-14T11:06:45.978458+0000","last_became_peered":"2024-09-14T11:06:45.978458+0000","last_unstale":"2024-09-14T11:57:30.597082+0000","last_undegraded":"2024-09-14T11:57:30.597082+0000","last_fullsized":"2024-09-14T11:57:30.597082+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:52.428245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:53.471119+0000","last_change":"2024-09-14T11:06:41.916068+0000","last_active":"2024-09-14T11:59:53.471119+0000","last_peered":"2024-09-14T11:59:53.471119+0000","last_clean":"2024-09-14T11:59:53.471119+0000","last_became_active":"2024-09-14T11:06:41.915795+0000","last_became_peered":"2024-09-14T11:06:41.915795+0000","last_unstale":"2024-09-14T11:59:53.471119+0000","last_undegraded":"2024-09-14T11:59:53.471119+0000","last_fullsized":"2024-09-14T11:59:53.471119+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:10.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"263'20","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.531842+0000","last_change":"2024-09-14T11:02:34.881678+0000","last_active":"2024-09-14T11:58:40.531842+0000","last_peered":"2024-09-14T11:58:40.531842+0000","last_clean":"2024-09-14T11:58:40.531842+0000","last_became_active":"2024-09-14T11:02:34.881333+0000","last_became_peered":"2024-09-14T11:02:34.881333+0000","last_unstale":"2024-09-14T11:58:40.531842+0000","last_undegraded":"2024-09-14T11:58:40.531842+0000","last_fullsized":"2024-09-14T11:58:40.531842+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:25.506302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":49,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.464738+0000","last_change":"2024-09-14T11:25:20.209663+0000","last_active":"2024-09-14T11:59:13.464738+0000","last_peered":"2024-09-14T11:59:13.464738+0000","last_clean":"2024-09-14T11:59:13.464738+0000","last_became_active":"2024-09-14T11:25:20.209369+0000","last_became_peered":"2024-09-14T11:25:20.209369+0000","last_unstale":"2024-09-14T11:59:13.464738+0000","last_undegraded":"2024-09-14T11:59:13.464738+0000","last_fullsized":"2024-09-14T11:59:13.464738+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:08.453886+0000","last_change":"2024-09-14T11:06:45.981996+0000","last_active":"2024-09-14T11:58:08.453886+0000","last_peered":"2024-09-14T11:58:08.453886+0000","last_clean":"2024-09-14T11:58:08.453886+0000","last_became_active":"2024-09-14T11:06:45.980211+0000","last_became_peered":"2024-09-14T11:06:45.980211+0000","last_unstale":"2024-09-14T11:58:08.453886+0000","last_undegraded":"2024-09-14T11:58:08.453886+0000","last_fullsized":"2024-09-14T11:58:08.453886+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:03.580856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.403612+0000","last_change":"2024-09-14T11:06:41.903200+0000","last_active":"2024-09-14T11:58:05.403612+0000","last_peered":"2024-09-14T11:58:05.403612+0000","last_clean":"2024-09-14T11:58:05.403612+0000","last_became_active":"2024-09-14T11:06:41.902894+0000","last_became_peered":"2024-09-14T11:06:41.902894+0000","last_unstale":"2024-09-14T11:58:05.403612+0000","last_undegraded":"2024-09-14T11:58:05.403612+0000","last_fullsized":"2024-09-14T11:58:05.403612+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:39.369082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"260'15","reported_seq":101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:35.531184+0000","last_change":"2024-09-14T11:02:34.873962+0000","last_active":"2024-09-14T11:58:35.531184+0000","last_peered":"2024-09-14T11:58:35.531184+0000","last_clean":"2024-09-14T11:58:35.531184+0000","last_became_active":"2024-09-14T11:02:34.873660+0000","last_became_peered":"2024-09-14T11:02:34.873660+0000","last_unstale":"2024-09-14T11:58:35.531184+0000","last_undegraded":"2024-09-14T11:58:35.531184+0000","last_fullsized":"2024-09-14T11:58:35.531184+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:08.878693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":83,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.529739+0000","last_change":"2024-09-14T11:25:20.210810+0000","last_active":"2024-09-14T11:59:13.529739+0000","last_peered":"2024-09-14T11:59:13.529739+0000","last_clean":"2024-09-14T11:59:13.529739+0000","last_became_active":"2024-09-14T11:25:20.210534+0000","last_became_peered":"2024-09-14T11:25:20.210534+0000","last_unstale":"2024-09-14T11:59:13.529739+0000","last_undegraded":"2024-09-14T11:59:13.529739+0000","last_fullsized":"2024-09-14T11:59:13.529739+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:08.453853+0000","last_change":"2024-09-14T11:06:45.985239+0000","last_active":"2024-09-14T11:58:08.453853+0000","last_peered":"2024-09-14T11:58:08.453853+0000","last_clean":"2024-09-14T11:58:08.453853+0000","last_became_active":"2024-09-14T11:06:45.984993+0000","last_became_peered":"2024-09-14T11:06:45.984993+0000","last_unstale":"2024-09-14T11:58:08.453853+0000","last_undegraded":"2024-09-14T11:58:08.453853+0000","last_fullsized":"2024-09-14T11:58:08.453853+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:26.543636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"263'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:23.475632+0000","last_change":"2024-09-14T11:06:41.910546+0000","last_active":"2024-09-14T12:00:23.475632+0000","last_peered":"2024-09-14T12:00:23.475632+0000","last_clean":"2024-09-14T12:00:23.475632+0000","last_became_active":"2024-09-14T11:06:41.910286+0000","last_became_peered":"2024-09-14T11:06:41.910286+0000","last_unstale":"2024-09-14T12:00:23.475632+0000","last_undegraded":"2024-09-14T12:00:23.475632+0000","last_fullsized":"2024-09-14T12:00:23.475632+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:00.405940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"263'55","reported_seq":203,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:35.447992+0000","last_change":"2024-09-14T11:02:34.873185+0000","last_active":"2024-09-14T11:58:35.447992+0000","last_peered":"2024-09-14T11:58:35.447992+0000","last_clean":"2024-09-14T11:58:35.447992+0000","last_became_active":"2024-09-14T11:02:34.872911+0000","last_became_peered":"2024-09-14T11:02:34.872911+0000","last_unstale":"2024-09-14T11:58:35.447992+0000","last_undegraded":"2024-09-14T11:58:35.447992+0000","last_fullsized":"2024-09-14T11:58:35.447992+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:20.423924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":434,"num_read_kb":298,"num_write":132,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.643221+0000","last_change":"2024-09-14T11:25:20.210573+0000","last_active":"2024-09-14T11:58:05.643221+0000","last_peered":"2024-09-14T11:58:05.643221+0000","last_clean":"2024-09-14T11:58:05.643221+0000","last_became_active":"2024-09-14T11:25:20.209547+0000","last_became_peered":"2024-09-14T11:25:20.209547+0000","last_unstale":"2024-09-14T11:58:05.643221+0000","last_undegraded":"2024-09-14T11:58:05.643221+0000","last_fullsized":"2024-09-14T11:58:05.643221+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:48.503085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:25.464893+0000","last_change":"2024-09-14T11:06:45.984844+0000","last_active":"2024-09-14T12:00:25.464893+0000","last_peered":"2024-09-14T12:00:25.464893+0000","last_clean":"2024-09-14T12:00:25.464893+0000","last_became_active":"2024-09-14T11:06:45.984527+0000","last_became_peered":"2024-09-14T11:06:45.984527+0000","last_unstale":"2024-09-14T12:00:25.464893+0000","last_undegraded":"2024-09-14T12:00:25.464893+0000","last_fullsized":"2024-09-14T12:00:25.464893+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:00.029592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"260'9","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.403653+0000","last_change":"2024-09-14T11:06:41.905789+0000","last_active":"2024-09-14T11:58:05.403653+0000","last_peered":"2024-09-14T11:58:05.403653+0000","last_clean":"2024-09-14T11:58:05.403653+0000","last_became_active":"2024-09-14T11:06:41.905088+0000","last_became_peered":"2024-09-14T11:06:41.905088+0000","last_unstale":"2024-09-14T11:58:05.403653+0000","last_undegraded":"2024-09-14T11:58:05.403653+0000","last_fullsized":"2024-09-14T11:58:05.403653+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:26.152725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17408,"num_write":9,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'36","reported_seq":152,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:35.304813+0000","last_change":"2024-09-14T11:02:34.873841+0000","last_active":"2024-09-14T11:58:35.304813+0000","last_peered":"2024-09-14T11:58:35.304813+0000","last_clean":"2024-09-14T11:58:35.304813+0000","last_became_active":"2024-09-14T11:02:34.873560+0000","last_became_peered":"2024-09-14T11:02:34.873560+0000","last_unstale":"2024-09-14T11:58:35.304813+0000","last_undegraded":"2024-09-14T11:58:35.304813+0000","last_fullsized":"2024-09-14T11:58:35.304813+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:07.656019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":270,"num_read_kb":162,"num_write":93,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.529712+0000","last_change":"2024-09-14T11:25:20.206947+0000","last_active":"2024-09-14T11:59:13.529712+0000","last_peered":"2024-09-14T11:59:13.529712+0000","last_clean":"2024-09-14T11:59:13.529712+0000","last_became_active":"2024-09-14T11:25:20.206692+0000","last_became_peered":"2024-09-14T11:25:20.206692+0000","last_unstale":"2024-09-14T11:59:13.529712+0000","last_undegraded":"2024-09-14T11:59:13.529712+0000","last_fullsized":"2024-09-14T11:59:13.529712+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.527582+0000","last_change":"2024-09-14T11:06:45.985776+0000","last_active":"2024-09-14T11:58:05.527582+0000","last_peered":"2024-09-14T11:58:05.527582+0000","last_clean":"2024-09-14T11:58:05.527582+0000","last_became_active":"2024-09-14T11:06:45.985436+0000","last_became_peered":"2024-09-14T11:06:45.985436+0000","last_unstale":"2024-09-14T11:58:05.527582+0000","last_undegraded":"2024-09-14T11:58:05.527582+0000","last_fullsized":"2024-09-14T11:58:05.527582+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:18.777447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.481613+0000","last_change":"2024-09-14T11:06:41.908095+0000","last_active":"2024-09-14T12:01:17.481613+0000","last_peered":"2024-09-14T12:01:17.481613+0000","last_clean":"2024-09-14T12:01:17.481613+0000","last_became_active":"2024-09-14T11:06:41.907791+0000","last_became_peered":"2024-09-14T11:06:41.907791+0000","last_unstale":"2024-09-14T12:01:17.481613+0000","last_undegraded":"2024-09-14T12:01:17.481613+0000","last_fullsized":"2024-09-14T12:01:17.481613+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:19.380573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5124,"num_write":5,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"263'33","reported_seq":149,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:35.447954+0000","last_change":"2024-09-14T11:02:34.876400+0000","last_active":"2024-09-14T11:58:35.447954+0000","last_peered":"2024-09-14T11:58:35.447954+0000","last_clean":"2024-09-14T11:58:35.447954+0000","last_became_active":"2024-09-14T11:02:34.876080+0000","last_became_peered":"2024-09-14T11:02:34.876080+0000","last_unstale":"2024-09-14T11:58:35.447954+0000","last_undegraded":"2024-09-14T11:58:35.447954+0000","last_fullsized":"2024-09-14T11:58:35.447954+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:45.087546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":186,"num_write":88,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:58.452425+0000","last_change":"2024-09-14T11:25:20.205656+0000","last_active":"2024-09-14T11:57:58.452425+0000","last_peered":"2024-09-14T11:57:58.452425+0000","last_clean":"2024-09-14T11:57:58.452425+0000","last_became_active":"2024-09-14T11:25:20.205335+0000","last_became_peered":"2024-09-14T11:25:20.205335+0000","last_unstale":"2024-09-14T11:57:58.452425+0000","last_undegraded":"2024-09-14T11:57:58.452425+0000","last_fullsized":"2024-09-14T11:57:58.452425+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:12.896781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:30.447384+0000","last_change":"2024-09-14T11:06:45.986506+0000","last_active":"2024-09-14T11:58:30.447384+0000","last_peered":"2024-09-14T11:58:30.447384+0000","last_clean":"2024-09-14T11:58:30.447384+0000","last_became_active":"2024-09-14T11:06:45.986225+0000","last_became_peered":"2024-09-14T11:06:45.986225+0000","last_unstale":"2024-09-14T11:58:30.447384+0000","last_undegraded":"2024-09-14T11:58:30.447384+0000","last_fullsized":"2024-09-14T11:58:30.447384+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:18.018900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"263'3","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:45.320227+0000","last_change":"2024-09-14T11:06:41.903610+0000","last_active":"2024-09-14T12:00:45.320227+0000","last_peered":"2024-09-14T12:00:45.320227+0000","last_clean":"2024-09-14T12:00:45.320227+0000","last_became_active":"2024-09-14T11:06:41.903188+0000","last_became_peered":"2024-09-14T11:06:41.903188+0000","last_unstale":"2024-09-14T12:00:45.320227+0000","last_undegraded":"2024-09-14T12:00:45.320227+0000","last_fullsized":"2024-09-14T12:00:45.320227+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:45.086214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"263'55","reported_seq":202,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.451654+0000","last_change":"2024-09-14T11:02:34.878079+0000","last_active":"2024-09-14T11:59:00.451654+0000","last_peered":"2024-09-14T11:59:00.451654+0000","last_clean":"2024-09-14T11:59:00.451654+0000","last_became_active":"2024-09-14T11:02:34.877631+0000","last_became_peered":"2024-09-14T11:02:34.877631+0000","last_unstale":"2024-09-14T11:59:00.451654+0000","last_undegraded":"2024-09-14T11:59:00.451654+0000","last_fullsized":"2024-09-14T11:59:00.451654+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:50.183737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":260,"num_write":147,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.409942+0000","last_change":"2024-09-14T11:25:20.203431+0000","last_active":"2024-09-14T11:59:05.409942+0000","last_peered":"2024-09-14T11:59:05.409942+0000","last_clean":"2024-09-14T11:59:05.409942+0000","last_became_active":"2024-09-14T11:25:20.200061+0000","last_became_peered":"2024-09-14T11:25:20.200061+0000","last_unstale":"2024-09-14T11:59:05.409942+0000","last_undegraded":"2024-09-14T11:59:05.409942+0000","last_fullsized":"2024-09-14T11:59:05.409942+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:15.179721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:45.467828+0000","last_change":"2024-09-14T11:06:45.991468+0000","last_active":"2024-09-14T12:00:45.467828+0000","last_peered":"2024-09-14T12:00:45.467828+0000","last_clean":"2024-09-14T12:00:45.467828+0000","last_became_active":"2024-09-14T11:06:45.991198+0000","last_became_peered":"2024-09-14T11:06:45.991198+0000","last_unstale":"2024-09-14T12:00:45.467828+0000","last_undegraded":"2024-09-14T12:00:45.467828+0000","last_fullsized":"2024-09-14T12:00:45.467828+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:02.331809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"263'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:43.542221+0000","last_change":"2024-09-14T11:06:41.910787+0000","last_active":"2024-09-14T12:00:43.542221+0000","last_peered":"2024-09-14T12:00:43.542221+0000","last_clean":"2024-09-14T12:00:43.542221+0000","last_became_active":"2024-09-14T11:06:41.910512+0000","last_became_peered":"2024-09-14T11:06:41.910512+0000","last_unstale":"2024-09-14T12:00:43.542221+0000","last_undegraded":"2024-09-14T12:00:43.542221+0000","last_fullsized":"2024-09-14T12:00:43.542221+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:20.996429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"263'44","reported_seq":172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.533064+0000","last_change":"2024-09-14T11:02:34.881693+0000","last_active":"2024-09-14T11:58:50.533064+0000","last_peered":"2024-09-14T11:58:50.533064+0000","last_clean":"2024-09-14T11:58:50.533064+0000","last_became_active":"2024-09-14T11:02:34.881341+0000","last_became_peered":"2024-09-14T11:02:34.881341+0000","last_unstale":"2024-09-14T11:58:50.533064+0000","last_undegraded":"2024-09-14T11:58:50.533064+0000","last_fullsized":"2024-09-14T11:58:50.533064+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:36.323501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":339,"num_read_kb":228,"num_write":117,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.525849+0000","last_change":"2024-09-14T11:25:20.210429+0000","last_active":"2024-09-14T11:57:50.525849+0000","last_peered":"2024-09-14T11:57:50.525849+0000","last_clean":"2024-09-14T11:57:50.525849+0000","last_became_active":"2024-09-14T11:25:20.210117+0000","last_became_peered":"2024-09-14T11:25:20.210117+0000","last_unstale":"2024-09-14T11:57:50.525849+0000","last_undegraded":"2024-09-14T11:57:50.525849+0000","last_fullsized":"2024-09-14T11:57:50.525849+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:07.063593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'6","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.152467+0000","last_change":"2024-09-14T11:06:45.992869+0000","last_active":"2024-09-14T12:01:18.152467+0000","last_peered":"2024-09-14T12:01:18.152467+0000","last_clean":"2024-09-14T12:01:18.152467+0000","last_became_active":"2024-09-14T11:06:45.992574+0000","last_became_peered":"2024-09-14T11:06:45.992574+0000","last_unstale":"2024-09-14T12:01:18.152467+0000","last_undegraded":"2024-09-14T12:01:18.152467+0000","last_fullsized":"2024-09-14T12:01:18.152467+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:58.347483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:30.447415+0000","last_change":"2024-09-14T11:06:41.919642+0000","last_active":"2024-09-14T11:58:30.447415+0000","last_peered":"2024-09-14T11:58:30.447415+0000","last_clean":"2024-09-14T11:58:30.447415+0000","last_became_active":"2024-09-14T11:06:41.919330+0000","last_became_peered":"2024-09-14T11:06:41.919330+0000","last_unstale":"2024-09-14T11:58:30.447415+0000","last_undegraded":"2024-09-14T11:58:30.447415+0000","last_fullsized":"2024-09-14T11:58:30.447415+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:18.967454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"263'112","reported_seq":390,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.408228+0000","last_change":"2024-09-14T11:02:34.873664+0000","last_active":"2024-09-14T11:58:50.408228+0000","last_peered":"2024-09-14T11:58:50.408228+0000","last_clean":"2024-09-14T11:58:50.408228+0000","last_became_active":"2024-09-14T11:02:34.873360+0000","last_became_peered":"2024-09-14T11:02:34.873360+0000","last_unstale":"2024-09-14T11:58:50.408228+0000","last_undegraded":"2024-09-14T11:58:50.408228+0000","last_fullsized":"2024-09-14T11:58:50.408228+0000","mapping_epoch":252,"log_start":"263'100","ondisk_log_start":"263'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:33.431081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1014,"num_read_kb":809,"num_write":225,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.401985+0000","last_change":"2024-09-14T11:25:20.200172+0000","last_active":"2024-09-14T11:57:50.401985+0000","last_peered":"2024-09-14T11:57:50.401985+0000","last_clean":"2024-09-14T11:57:50.401985+0000","last_became_active":"2024-09-14T11:25:20.199875+0000","last_became_peered":"2024-09-14T11:25:20.199875+0000","last_unstale":"2024-09-14T11:57:50.401985+0000","last_undegraded":"2024-09-14T11:57:50.401985+0000","last_fullsized":"2024-09-14T11:57:50.401985+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:26.854076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"260'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:33.457900+0000","last_change":"2024-09-14T11:06:45.980652+0000","last_active":"2024-09-14T11:58:33.457900+0000","last_peered":"2024-09-14T11:58:33.457900+0000","last_clean":"2024-09-14T11:58:33.457900+0000","last_became_active":"2024-09-14T11:06:45.980035+0000","last_became_peered":"2024-09-14T11:06:45.980035+0000","last_unstale":"2024-09-14T11:58:33.457900+0000","last_undegraded":"2024-09-14T11:58:33.457900+0000","last_fullsized":"2024-09-14T11:58:33.457900+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:36.733533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:55.469343+0000","last_change":"2024-09-14T11:06:41.917633+0000","last_active":"2024-09-14T12:00:55.469343+0000","last_peered":"2024-09-14T12:00:55.469343+0000","last_clean":"2024-09-14T12:00:55.469343+0000","last_became_active":"2024-09-14T11:06:41.917341+0000","last_became_peered":"2024-09-14T11:06:41.917341+0000","last_unstale":"2024-09-14T12:00:55.469343+0000","last_undegraded":"2024-09-14T12:00:55.469343+0000","last_fullsized":"2024-09-14T12:00:55.469343+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:27.626042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"260'15","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.526593+0000","last_change":"2024-09-14T11:02:34.876368+0000","last_active":"2024-09-14T11:58:53.526593+0000","last_peered":"2024-09-14T11:58:53.526593+0000","last_clean":"2024-09-14T11:58:53.526593+0000","last_became_active":"2024-09-14T11:02:34.876078+0000","last_became_peered":"2024-09-14T11:02:34.876078+0000","last_unstale":"2024-09-14T11:58:53.526593+0000","last_undegraded":"2024-09-14T11:58:53.526593+0000","last_fullsized":"2024-09-14T11:58:53.526593+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:14.606877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":83,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.463810+0000","last_change":"2024-09-14T11:25:20.210430+0000","last_active":"2024-09-14T11:59:08.463810+0000","last_peered":"2024-09-14T11:59:08.463810+0000","last_clean":"2024-09-14T11:59:08.463810+0000","last_became_active":"2024-09-14T11:25:20.210181+0000","last_became_peered":"2024-09-14T11:25:20.210181+0000","last_unstale":"2024-09-14T11:59:08.463810+0000","last_undegraded":"2024-09-14T11:59:08.463810+0000","last_fullsized":"2024-09-14T11:59:08.463810+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:56.596921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.532365+0000","last_change":"2024-09-14T11:06:45.984990+0000","last_active":"2024-09-14T11:58:45.532365+0000","last_peered":"2024-09-14T11:58:45.532365+0000","last_clean":"2024-09-14T11:58:45.532365+0000","last_became_active":"2024-09-14T11:06:45.984696+0000","last_became_peered":"2024-09-14T11:06:45.984696+0000","last_unstale":"2024-09-14T11:58:45.532365+0000","last_undegraded":"2024-09-14T11:58:45.532365+0000","last_fullsized":"2024-09-14T11:58:45.532365+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:17.939743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"263'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:55.469166+0000","last_change":"2024-09-14T11:06:41.914553+0000","last_active":"2024-09-14T12:00:55.469166+0000","last_peered":"2024-09-14T12:00:55.469166+0000","last_clean":"2024-09-14T12:00:55.469166+0000","last_became_active":"2024-09-14T11:06:41.914209+0000","last_became_peered":"2024-09-14T11:06:41.914209+0000","last_unstale":"2024-09-14T12:00:55.469166+0000","last_undegraded":"2024-09-14T12:00:55.469166+0000","last_fullsized":"2024-09-14T12:00:55.469166+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:46.262011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"263'35","reported_seq":148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.526513+0000","last_change":"2024-09-14T11:02:34.880131+0000","last_active":"2024-09-14T11:58:53.526513+0000","last_peered":"2024-09-14T11:58:53.526513+0000","last_clean":"2024-09-14T11:58:53.526513+0000","last_became_active":"2024-09-14T11:02:34.879834+0000","last_became_peered":"2024-09-14T11:02:34.879834+0000","last_unstale":"2024-09-14T11:58:53.526513+0000","last_undegraded":"2024-09-14T11:58:53.526513+0000","last_fullsized":"2024-09-14T11:58:53.526513+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:06.529921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":172,"num_write":95,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.308579+0000","last_change":"2024-09-14T11:25:20.205157+0000","last_active":"2024-09-14T11:59:10.308579+0000","last_peered":"2024-09-14T11:59:10.308579+0000","last_clean":"2024-09-14T11:59:10.308579+0000","last_became_active":"2024-09-14T11:25:20.204834+0000","last_became_peered":"2024-09-14T11:25:20.204834+0000","last_unstale":"2024-09-14T11:59:10.308579+0000","last_undegraded":"2024-09-14T11:59:10.308579+0000","last_fullsized":"2024-09-14T11:59:10.308579+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.305849+0000","last_change":"2024-09-14T11:06:45.986635+0000","last_active":"2024-09-14T11:58:45.305849+0000","last_peered":"2024-09-14T11:58:45.305849+0000","last_clean":"2024-09-14T11:58:45.305849+0000","last_became_active":"2024-09-14T11:06:45.984865+0000","last_became_peered":"2024-09-14T11:06:45.984865+0000","last_unstale":"2024-09-14T11:58:45.305849+0000","last_undegraded":"2024-09-14T11:58:45.305849+0000","last_fullsized":"2024-09-14T11:58:45.305849+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:51.926620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"260'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:43.459476+0000","last_change":"2024-09-14T11:06:41.909800+0000","last_active":"2024-09-14T11:58:43.459476+0000","last_peered":"2024-09-14T11:58:43.459476+0000","last_clean":"2024-09-14T11:58:43.459476+0000","last_became_active":"2024-09-14T11:06:41.909533+0000","last_became_peered":"2024-09-14T11:06:41.909533+0000","last_unstale":"2024-09-14T11:58:43.459476+0000","last_undegraded":"2024-09-14T11:58:43.459476+0000","last_fullsized":"2024-09-14T11:58:43.459476+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:38.325179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"263'25","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.308510+0000","last_change":"2024-09-14T11:02:34.873554+0000","last_active":"2024-09-14T11:59:10.308510+0000","last_peered":"2024-09-14T11:59:10.308510+0000","last_clean":"2024-09-14T11:59:10.308510+0000","last_became_active":"2024-09-14T11:02:34.873259+0000","last_became_peered":"2024-09-14T11:02:34.873259+0000","last_unstale":"2024-09-14T11:59:10.308510+0000","last_undegraded":"2024-09-14T11:59:10.308510+0000","last_fullsized":"2024-09-14T11:59:10.308510+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:05.178830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":129,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.607073+0000","last_change":"2024-09-14T11:25:20.212620+0000","last_active":"2024-09-14T11:59:05.607073+0000","last_peered":"2024-09-14T11:59:05.607073+0000","last_clean":"2024-09-14T11:59:05.607073+0000","last_became_active":"2024-09-14T11:25:20.212293+0000","last_became_peered":"2024-09-14T11:25:20.212293+0000","last_unstale":"2024-09-14T11:59:05.607073+0000","last_undegraded":"2024-09-14T11:59:05.607073+0000","last_fullsized":"2024-09-14T11:59:05.607073+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:10.346864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:33.523575+0000","last_change":"2024-09-14T11:06:45.986687+0000","last_active":"2024-09-14T11:58:33.523575+0000","last_peered":"2024-09-14T11:58:33.523575+0000","last_clean":"2024-09-14T11:58:33.523575+0000","last_became_active":"2024-09-14T11:06:45.986398+0000","last_became_peered":"2024-09-14T11:06:45.986398+0000","last_unstale":"2024-09-14T11:58:33.523575+0000","last_undegraded":"2024-09-14T11:58:33.523575+0000","last_fullsized":"2024-09-14T11:58:33.523575+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:28.445077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"260'10","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.450778+0000","last_change":"2024-09-14T11:06:41.915770+0000","last_active":"2024-09-14T11:58:55.450778+0000","last_peered":"2024-09-14T11:58:55.450778+0000","last_clean":"2024-09-14T11:58:55.450778+0000","last_became_active":"2024-09-14T11:06:41.915491+0000","last_became_peered":"2024-09-14T11:06:41.915491+0000","last_unstale":"2024-09-14T11:58:55.450778+0000","last_undegraded":"2024-09-14T11:58:55.450778+0000","last_fullsized":"2024-09-14T11:58:55.450778+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:33.737820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":40964,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"260'12","reported_seq":91,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.462030+0000","last_change":"2024-09-14T11:02:34.872228+0000","last_active":"2024-09-14T11:58:58.462030+0000","last_peered":"2024-09-14T11:58:58.462030+0000","last_clean":"2024-09-14T11:58:58.462030+0000","last_became_active":"2024-09-14T11:02:34.871352+0000","last_became_peered":"2024-09-14T11:02:34.871352+0000","last_unstale":"2024-09-14T11:58:58.462030+0000","last_undegraded":"2024-09-14T11:58:58.462030+0000","last_fullsized":"2024-09-14T11:58:58.462030+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:29.511969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.452308+0000","last_change":"2024-09-14T11:25:20.214092+0000","last_active":"2024-09-14T11:59:05.452308+0000","last_peered":"2024-09-14T11:59:05.452308+0000","last_clean":"2024-09-14T11:59:05.452308+0000","last_became_active":"2024-09-14T11:25:20.213785+0000","last_became_peered":"2024-09-14T11:25:20.213785+0000","last_unstale":"2024-09-14T11:59:05.452308+0000","last_undegraded":"2024-09-14T11:59:05.452308+0000","last_fullsized":"2024-09-14T11:59:05.452308+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:56.298725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"260'2","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.605100+0000","last_change":"2024-09-14T11:06:45.981838+0000","last_active":"2024-09-14T11:58:45.605100+0000","last_peered":"2024-09-14T11:58:45.605100+0000","last_clean":"2024-09-14T11:58:45.605100+0000","last_became_active":"2024-09-14T11:06:45.981476+0000","last_became_peered":"2024-09-14T11:06:45.981476+0000","last_unstale":"2024-09-14T11:58:45.605100+0000","last_undegraded":"2024-09-14T11:58:45.605100+0000","last_fullsized":"2024-09-14T11:58:45.605100+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:58.441972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"260'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:30.530578+0000","last_change":"2024-09-14T11:06:41.911683+0000","last_active":"2024-09-14T11:58:30.530578+0000","last_peered":"2024-09-14T11:58:30.530578+0000","last_clean":"2024-09-14T11:58:30.530578+0000","last_became_active":"2024-09-14T11:06:41.911413+0000","last_became_peered":"2024-09-14T11:06:41.911413+0000","last_unstale":"2024-09-14T11:58:30.530578+0000","last_undegraded":"2024-09-14T11:58:30.530578+0000","last_fullsized":"2024-09-14T11:58:30.530578+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:52.497275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"263'38","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.606077+0000","last_change":"2024-09-14T11:02:34.879059+0000","last_active":"2024-09-14T11:58:55.606077+0000","last_peered":"2024-09-14T11:58:55.606077+0000","last_clean":"2024-09-14T11:58:55.606077+0000","last_became_active":"2024-09-14T11:02:34.878752+0000","last_became_peered":"2024-09-14T11:02:34.878752+0000","last_unstale":"2024-09-14T11:58:55.606077+0000","last_undegraded":"2024-09-14T11:58:55.606077+0000","last_fullsized":"2024-09-14T11:58:55.606077+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:34.432738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":231,"num_write":89,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.604290+0000","last_change":"2024-09-14T11:25:20.211271+0000","last_active":"2024-09-14T11:58:40.604290+0000","last_peered":"2024-09-14T11:58:40.604290+0000","last_clean":"2024-09-14T11:58:40.604290+0000","last_became_active":"2024-09-14T11:25:20.210999+0000","last_became_peered":"2024-09-14T11:25:20.210999+0000","last_unstale":"2024-09-14T11:58:40.604290+0000","last_undegraded":"2024-09-14T11:58:40.604290+0000","last_fullsized":"2024-09-14T11:58:40.604290+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:13.729258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.462863+0000","last_change":"2024-09-14T11:06:45.982956+0000","last_active":"2024-09-14T11:59:03.462863+0000","last_peered":"2024-09-14T11:59:03.462863+0000","last_clean":"2024-09-14T11:59:03.462863+0000","last_became_active":"2024-09-14T11:06:45.982181+0000","last_became_peered":"2024-09-14T11:06:45.982181+0000","last_unstale":"2024-09-14T11:59:03.462863+0000","last_undegraded":"2024-09-14T11:59:03.462863+0000","last_fullsized":"2024-09-14T11:59:03.462863+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:18.506633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.533019+0000","last_change":"2024-09-14T11:06:41.914378+0000","last_active":"2024-09-14T11:58:50.533019+0000","last_peered":"2024-09-14T11:58:50.533019+0000","last_clean":"2024-09-14T11:58:50.533019+0000","last_became_active":"2024-09-14T11:06:41.913192+0000","last_became_peered":"2024-09-14T11:06:41.913192+0000","last_unstale":"2024-09-14T11:58:50.533019+0000","last_undegraded":"2024-09-14T11:58:50.533019+0000","last_fullsized":"2024-09-14T11:58:50.533019+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:24.679035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"263'32","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.650978+0000","last_change":"2024-09-14T11:02:34.874602+0000","last_active":"2024-09-14T11:58:55.650978+0000","last_peered":"2024-09-14T11:58:55.650978+0000","last_clean":"2024-09-14T11:58:55.650978+0000","last_became_active":"2024-09-14T11:02:34.874328+0000","last_became_peered":"2024-09-14T11:02:34.874328+0000","last_unstale":"2024-09-14T11:58:55.650978+0000","last_undegraded":"2024-09-14T11:58:55.650978+0000","last_fullsized":"2024-09-14T11:58:55.650978+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:09.428522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":246,"num_read_kb":166,"num_write":81,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.604315+0000","last_change":"2024-09-14T11:25:20.213871+0000","last_active":"2024-09-14T11:58:40.604315+0000","last_peered":"2024-09-14T11:58:40.604315+0000","last_clean":"2024-09-14T11:58:40.604315+0000","last_became_active":"2024-09-14T11:25:20.213577+0000","last_became_peered":"2024-09-14T11:25:20.213577+0000","last_unstale":"2024-09-14T11:58:40.604315+0000","last_undegraded":"2024-09-14T11:58:40.604315+0000","last_fullsized":"2024-09-14T11:58:40.604315+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:03.148226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"263'10","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.842742+0000","last_change":"2024-09-14T11:06:45.991127+0000","last_active":"2024-09-14T12:01:17.842742+0000","last_peered":"2024-09-14T12:01:17.842742+0000","last_clean":"2024-09-14T12:01:17.842742+0000","last_became_active":"2024-09-14T11:06:45.990855+0000","last_became_peered":"2024-09-14T11:06:45.990855+0000","last_unstale":"2024-09-14T12:01:17.842742+0000","last_undegraded":"2024-09-14T12:01:17.842742+0000","last_fullsized":"2024-09-14T12:01:17.842742+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:28.658329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6246,"num_write":20,"num_write_kb":2098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"263'8","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:10.670577+0000","last_change":"2024-09-14T11:06:41.913753+0000","last_active":"2024-09-14T12:01:10.670577+0000","last_peered":"2024-09-14T12:01:10.670577+0000","last_clean":"2024-09-14T12:01:10.670577+0000","last_became_active":"2024-09-14T11:06:41.913454+0000","last_became_peered":"2024-09-14T11:06:41.913454+0000","last_unstale":"2024-09-14T12:01:10.670577+0000","last_undegraded":"2024-09-14T12:01:10.670577+0000","last_fullsized":"2024-09-14T12:01:10.670577+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:38.121049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":18,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'130","reported_seq":444,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.533642+0000","last_change":"2024-09-14T11:02:34.879730+0000","last_active":"2024-09-14T11:58:55.533642+0000","last_peered":"2024-09-14T11:58:55.533642+0000","last_clean":"2024-09-14T11:58:55.533642+0000","last_became_active":"2024-09-14T11:02:34.878813+0000","last_became_peered":"2024-09-14T11:02:34.878813+0000","last_unstale":"2024-09-14T11:58:55.533642+0000","last_undegraded":"2024-09-14T11:58:55.533642+0000","last_fullsized":"2024-09-14T11:58:55.533642+0000","mapping_epoch":252,"log_start":"260'100","ondisk_log_start":"260'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:00.256155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1195,"num_read_kb":1160,"num_write":263,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.467146+0000","last_change":"2024-09-14T11:25:20.212941+0000","last_active":"2024-09-14T11:59:28.467146+0000","last_peered":"2024-09-14T11:59:28.467146+0000","last_clean":"2024-09-14T11:59:28.467146+0000","last_became_active":"2024-09-14T11:25:20.212665+0000","last_became_peered":"2024-09-14T11:25:20.212665+0000","last_unstale":"2024-09-14T11:59:28.467146+0000","last_undegraded":"2024-09-14T11:59:28.467146+0000","last_fullsized":"2024-09-14T11:59:28.467146+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.605166+0000","last_change":"2024-09-14T11:06:45.992405+0000","last_active":"2024-09-14T11:58:45.605166+0000","last_peered":"2024-09-14T11:58:45.605166+0000","last_clean":"2024-09-14T11:58:45.605166+0000","last_became_active":"2024-09-14T11:06:45.992066+0000","last_became_peered":"2024-09-14T11:06:45.992066+0000","last_unstale":"2024-09-14T11:58:45.605166+0000","last_undegraded":"2024-09-14T11:58:45.605166+0000","last_fullsized":"2024-09-14T11:58:45.605166+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:42.417189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"260'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.305944+0000","last_change":"2024-09-14T11:06:41.912718+0000","last_active":"2024-09-14T11:58:45.305944+0000","last_peered":"2024-09-14T11:58:45.305944+0000","last_clean":"2024-09-14T11:58:45.305944+0000","last_became_active":"2024-09-14T11:06:41.912405+0000","last_became_peered":"2024-09-14T11:06:41.912405+0000","last_unstale":"2024-09-14T11:58:45.305944+0000","last_undegraded":"2024-09-14T11:58:45.305944+0000","last_fullsized":"2024-09-14T11:58:45.305944+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:12.800532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"263'36","reported_seq":158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.307994+0000","last_change":"2024-09-14T11:02:34.873402+0000","last_active":"2024-09-14T11:59:05.307994+0000","last_peered":"2024-09-14T11:59:05.307994+0000","last_clean":"2024-09-14T11:59:05.307994+0000","last_became_active":"2024-09-14T11:02:34.873089+0000","last_became_peered":"2024-09-14T11:02:34.873089+0000","last_unstale":"2024-09-14T11:59:05.307994+0000","last_undegraded":"2024-09-14T11:59:05.307994+0000","last_fullsized":"2024-09-14T11:59:05.307994+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:47.372158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":295,"num_read_kb":200,"num_write":86,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.531790+0000","last_change":"2024-09-14T11:25:20.210966+0000","last_active":"2024-09-14T11:58:40.531790+0000","last_peered":"2024-09-14T11:58:40.531790+0000","last_clean":"2024-09-14T11:58:40.531790+0000","last_became_active":"2024-09-14T11:25:20.210331+0000","last_became_peered":"2024-09-14T11:25:20.210331+0000","last_unstale":"2024-09-14T11:58:40.531790+0000","last_undegraded":"2024-09-14T11:58:40.531790+0000","last_fullsized":"2024-09-14T11:58:40.531790+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:27.694386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.532467+0000","last_change":"2024-09-14T11:06:45.986136+0000","last_active":"2024-09-14T11:58:45.532467+0000","last_peered":"2024-09-14T11:58:45.532467+0000","last_clean":"2024-09-14T11:58:45.532467+0000","last_became_active":"2024-09-14T11:06:45.985792+0000","last_became_peered":"2024-09-14T11:06:45.985792+0000","last_unstale":"2024-09-14T11:58:45.532467+0000","last_undegraded":"2024-09-14T11:58:45.532467+0000","last_fullsized":"2024-09-14T11:58:45.532467+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:18.428977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.532481+0000","last_change":"2024-09-14T11:06:41.914556+0000","last_active":"2024-09-14T11:58:45.532481+0000","last_peered":"2024-09-14T11:58:45.532481+0000","last_clean":"2024-09-14T11:58:45.532481+0000","last_became_active":"2024-09-14T11:06:41.913214+0000","last_became_peered":"2024-09-14T11:06:41.913214+0000","last_unstale":"2024-09-14T11:58:45.532481+0000","last_undegraded":"2024-09-14T11:58:45.532481+0000","last_fullsized":"2024-09-14T11:58:45.532481+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:05.435530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"263'55","reported_seq":209,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.450078+0000","last_change":"2024-09-14T11:02:34.873880+0000","last_active":"2024-09-14T11:58:50.450078+0000","last_peered":"2024-09-14T11:58:50.450078+0000","last_clean":"2024-09-14T11:58:50.450078+0000","last_became_active":"2024-09-14T11:02:34.873554+0000","last_became_peered":"2024-09-14T11:02:34.873554+0000","last_unstale":"2024-09-14T11:58:50.450078+0000","last_undegraded":"2024-09-14T11:58:50.450078+0000","last_fullsized":"2024-09-14T11:58:50.450078+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:52.441238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":297,"num_write":136,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.441967+0000","last_change":"2024-09-14T11:25:20.209266+0000","last_active":"2024-09-14T11:57:50.441967+0000","last_peered":"2024-09-14T11:57:50.441967+0000","last_clean":"2024-09-14T11:57:50.441967+0000","last_became_active":"2024-09-14T11:25:20.208985+0000","last_became_peered":"2024-09-14T11:25:20.208985+0000","last_unstale":"2024-09-14T11:57:50.441967+0000","last_undegraded":"2024-09-14T11:57:50.441967+0000","last_fullsized":"2024-09-14T11:57:50.441967+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:35.791238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"260'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.650067+0000","last_change":"2024-09-14T11:06:45.987976+0000","last_active":"2024-09-14T11:58:50.650067+0000","last_peered":"2024-09-14T11:58:50.650067+0000","last_clean":"2024-09-14T11:58:50.650067+0000","last_became_active":"2024-09-14T11:06:45.987665+0000","last_became_peered":"2024-09-14T11:06:45.987665+0000","last_unstale":"2024-09-14T11:58:50.650067+0000","last_undegraded":"2024-09-14T11:58:50.650067+0000","last_fullsized":"2024-09-14T11:58:50.650067+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:33.778940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5649,"num_write":5,"num_write_kb":5649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"260'8","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.307436+0000","last_change":"2024-09-14T11:06:41.906763+0000","last_active":"2024-09-14T11:59:00.307436+0000","last_peered":"2024-09-14T11:59:00.307436+0000","last_clean":"2024-09-14T11:59:00.307436+0000","last_became_active":"2024-09-14T11:06:41.906528+0000","last_became_peered":"2024-09-14T11:06:41.906528+0000","last_unstale":"2024-09-14T11:59:00.307436+0000","last_undegraded":"2024-09-14T11:59:00.307436+0000","last_fullsized":"2024-09-14T11:59:00.307436+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:50.072640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"263'49","reported_seq":191,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.306450+0000","last_change":"2024-09-14T11:02:34.869488+0000","last_active":"2024-09-14T11:58:50.306450+0000","last_peered":"2024-09-14T11:58:50.306450+0000","last_clean":"2024-09-14T11:58:50.306450+0000","last_became_active":"2024-09-14T11:02:34.869154+0000","last_became_peered":"2024-09-14T11:02:34.869154+0000","last_unstale":"2024-09-14T11:58:50.306450+0000","last_undegraded":"2024-09-14T11:58:50.306450+0000","last_fullsized":"2024-09-14T11:58:50.306450+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:51.708190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":272,"num_write":122,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.641217+0000","last_change":"2024-09-14T11:25:20.209267+0000","last_active":"2024-09-14T11:57:50.641217+0000","last_peered":"2024-09-14T11:57:50.641217+0000","last_clean":"2024-09-14T11:57:50.641217+0000","last_became_active":"2024-09-14T11:25:20.208992+0000","last_became_peered":"2024-09-14T11:25:20.208992+0000","last_unstale":"2024-09-14T11:57:50.641217+0000","last_undegraded":"2024-09-14T11:57:50.641217+0000","last_fullsized":"2024-09-14T11:57:50.641217+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:33.801493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"263'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.845194+0000","last_change":"2024-09-14T11:06:45.985807+0000","last_active":"2024-09-14T12:01:17.845194+0000","last_peered":"2024-09-14T12:01:17.845194+0000","last_clean":"2024-09-14T12:01:17.845194+0000","last_became_active":"2024-09-14T11:06:45.985518+0000","last_became_peered":"2024-09-14T11:06:45.985518+0000","last_unstale":"2024-09-14T12:01:17.845194+0000","last_undegraded":"2024-09-14T12:01:17.845194+0000","last_fullsized":"2024-09-14T12:01:17.845194+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:53.847804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:55.549750+0000","last_change":"2024-09-14T11:06:41.915181+0000","last_active":"2024-09-14T12:00:55.549750+0000","last_peered":"2024-09-14T12:00:55.549750+0000","last_clean":"2024-09-14T12:00:55.549750+0000","last_became_active":"2024-09-14T11:06:41.914346+0000","last_became_peered":"2024-09-14T11:06:41.914346+0000","last_unstale":"2024-09-14T12:00:55.549750+0000","last_undegraded":"2024-09-14T12:00:55.549750+0000","last_fullsized":"2024-09-14T12:00:55.549750+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:17.184490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"263'33","reported_seq":145,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.532990+0000","last_change":"2024-09-14T11:02:34.880356+0000","last_active":"2024-09-14T11:58:50.532990+0000","last_peered":"2024-09-14T11:58:50.532990+0000","last_clean":"2024-09-14T11:58:50.532990+0000","last_became_active":"2024-09-14T11:02:34.880066+0000","last_became_peered":"2024-09-14T11:02:34.880066+0000","last_unstale":"2024-09-14T11:58:50.532990+0000","last_undegraded":"2024-09-14T11:58:50.532990+0000","last_fullsized":"2024-09-14T11:58:50.532990+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:20.037542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":165,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:43.459528+0000","last_change":"2024-09-14T11:25:20.211431+0000","last_active":"2024-09-14T11:58:43.459528+0000","last_peered":"2024-09-14T11:58:43.459528+0000","last_clean":"2024-09-14T11:58:43.459528+0000","last_became_active":"2024-09-14T11:25:20.208291+0000","last_became_peered":"2024-09-14T11:25:20.208291+0000","last_unstale":"2024-09-14T11:58:43.459528+0000","last_undegraded":"2024-09-14T11:58:43.459528+0000","last_fullsized":"2024-09-14T11:58:43.459528+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:10.519199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"260'3","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.306441+0000","last_change":"2024-09-14T11:06:45.988585+0000","last_active":"2024-09-14T11:58:50.306441+0000","last_peered":"2024-09-14T11:58:50.306441+0000","last_clean":"2024-09-14T11:58:50.306441+0000","last_became_active":"2024-09-14T11:06:45.988268+0000","last_became_peered":"2024-09-14T11:06:45.988268+0000","last_unstale":"2024-09-14T11:58:50.306441+0000","last_undegraded":"2024-09-14T11:58:50.306441+0000","last_fullsized":"2024-09-14T11:58:50.306441+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:29.911599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.525697+0000","last_change":"2024-09-14T11:06:41.910335+0000","last_active":"2024-09-14T11:58:48.525697+0000","last_peered":"2024-09-14T11:58:48.525697+0000","last_clean":"2024-09-14T11:58:48.525697+0000","last_became_active":"2024-09-14T11:06:41.909915+0000","last_became_peered":"2024-09-14T11:06:41.909915+0000","last_unstale":"2024-09-14T11:58:48.525697+0000","last_undegraded":"2024-09-14T11:58:48.525697+0000","last_fullsized":"2024-09-14T11:58:48.525697+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:47.834488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"263'21","reported_seq":116,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.532964+0000","last_change":"2024-09-14T11:02:34.878110+0000","last_active":"2024-09-14T11:58:50.532964+0000","last_peered":"2024-09-14T11:58:50.532964+0000","last_clean":"2024-09-14T11:58:50.532964+0000","last_became_active":"2024-09-14T11:02:34.877791+0000","last_became_peered":"2024-09-14T11:02:34.877791+0000","last_unstale":"2024-09-14T11:58:50.532964+0000","last_undegraded":"2024-09-14T11:58:50.532964+0000","last_fullsized":"2024-09-14T11:58:50.532964+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:00.836048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":103,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.531860+0000","last_change":"2024-09-14T11:25:20.208774+0000","last_active":"2024-09-14T11:58:40.531860+0000","last_peered":"2024-09-14T11:58:40.531860+0000","last_clean":"2024-09-14T11:58:40.531860+0000","last_became_active":"2024-09-14T11:25:20.208495+0000","last_became_peered":"2024-09-14T11:25:20.208495+0000","last_unstale":"2024-09-14T11:58:40.531860+0000","last_undegraded":"2024-09-14T11:58:40.531860+0000","last_fullsized":"2024-09-14T11:58:40.531860+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:18.019657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"263'3","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:55.321309+0000","last_change":"2024-09-14T11:06:45.987276+0000","last_active":"2024-09-14T12:00:55.321309+0000","last_peered":"2024-09-14T12:00:55.321309+0000","last_clean":"2024-09-14T12:00:55.321309+0000","last_became_active":"2024-09-14T11:06:45.986990+0000","last_became_peered":"2024-09-14T11:06:45.986990+0000","last_unstale":"2024-09-14T12:00:55.321309+0000","last_undegraded":"2024-09-14T12:00:55.321309+0000","last_fullsized":"2024-09-14T12:00:55.321309+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:48.346557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.408167+0000","last_change":"2024-09-14T11:06:41.915671+0000","last_active":"2024-09-14T11:58:50.408167+0000","last_peered":"2024-09-14T11:58:50.408167+0000","last_clean":"2024-09-14T11:58:50.408167+0000","last_became_active":"2024-09-14T11:06:41.915372+0000","last_became_peered":"2024-09-14T11:06:41.915372+0000","last_unstale":"2024-09-14T11:58:50.408167+0000","last_undegraded":"2024-09-14T11:58:50.408167+0000","last_fullsized":"2024-09-14T11:58:50.408167+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:08.016650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"263'13","reported_seq":96,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.306383+0000","last_change":"2024-09-14T11:02:34.879297+0000","last_active":"2024-09-14T11:58:50.306383+0000","last_peered":"2024-09-14T11:58:50.306383+0000","last_clean":"2024-09-14T11:58:50.306383+0000","last_became_active":"2024-09-14T11:02:34.879002+0000","last_became_peered":"2024-09-14T11:02:34.879002+0000","last_unstale":"2024-09-14T11:58:50.306383+0000","last_undegraded":"2024-09-14T11:58:50.306383+0000","last_fullsized":"2024-09-14T11:58:50.306383+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:18.663446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":56,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'347","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.278191+0000","last_change":"2024-09-14T12:01:32.278080+0000","last_active":"2024-09-14T12:01:32.278191+0000","last_peered":"2024-09-14T12:01:32.278191+0000","last_clean":"2024-09-14T12:01:32.278191+0000","last_became_active":"2024-09-14T10:46:44.331827+0000","last_became_peered":"2024-09-14T10:46:44.331827+0000","last_unstale":"2024-09-14T12:01:32.278191+0000","last_undegraded":"2024-09-14T12:01:32.278191+0000","last_fullsized":"2024-09-14T12:01:32.278191+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-09-14T12:01:32.277953+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-09-14T12:01:32.277953+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.277953+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:37.814804+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":808,"num_read_kb":10519,"num_write":1133,"num_write_kb":31597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"263'509","reported_seq":2211,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.715729+0000","last_change":"2024-09-14T12:01:37.715729+0000","last_active":"2024-09-14T12:01:37.715729+0000","last_peered":"2024-09-14T12:01:37.715729+0000","last_clean":"2024-09-14T12:01:37.715729+0000","last_became_active":"2024-09-14T10:46:46.340949+0000","last_became_peered":"2024-09-14T10:46:46.340949+0000","last_unstale":"2024-09-14T12:01:37.715729+0000","last_undegraded":"2024-09-14T12:01:37.715729+0000","last_fullsized":"2024-09-14T12:01:37.715729+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'509","last_scrub_stamp":"2024-09-14T12:01:37.715648+0000","last_deep_scrub":"263'509","last_deep_scrub_stamp":"2024-09-14T12:01:37.715648+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.715648+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:12.260760+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2834,"num_read_kb":2670,"num_write":604,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"263'354","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.242836+0000","last_change":"2024-09-14T12:01:38.242836+0000","last_active":"2024-09-14T12:01:38.242836+0000","last_peered":"2024-09-14T12:01:38.242836+0000","last_clean":"2024-09-14T12:01:38.242836+0000","last_became_active":"2024-09-14T10:46:44.332997+0000","last_became_peered":"2024-09-14T10:46:44.332997+0000","last_unstale":"2024-09-14T12:01:38.242836+0000","last_undegraded":"2024-09-14T12:01:38.242836+0000","last_fullsized":"2024-09-14T12:01:38.242836+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'354","last_scrub_stamp":"2024-09-14T12:01:38.242731+0000","last_deep_scrub":"263'354","last_deep_scrub_stamp":"2024-09-14T12:01:38.242731+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.242731+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:20.221917+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":584,"num_read_kb":4891,"num_write":1057,"num_write_kb":34401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"263'664","reported_seq":2310,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.149223+0000","last_change":"2024-09-14T10:46:46.340953+0000","last_active":"2024-09-14T12:00:51.149223+0000","last_peered":"2024-09-14T12:00:51.149223+0000","last_clean":"2024-09-14T12:00:51.149223+0000","last_became_active":"2024-09-14T10:46:46.340612+0000","last_became_peered":"2024-09-14T10:46:46.340612+0000","last_unstale":"2024-09-14T12:00:51.149223+0000","last_undegraded":"2024-09-14T12:00:51.149223+0000","last_fullsized":"2024-09-14T12:00:51.149223+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":600,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:41.266834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3359,"num_read_kb":3045,"num_write":872,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"263'315","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.268681+0000","last_change":"2024-09-14T12:01:37.268681+0000","last_active":"2024-09-14T12:01:37.268681+0000","last_peered":"2024-09-14T12:01:37.268681+0000","last_clean":"2024-09-14T12:01:37.268681+0000","last_became_active":"2024-09-14T10:46:44.320254+0000","last_became_peered":"2024-09-14T10:46:44.320254+0000","last_unstale":"2024-09-14T12:01:37.268681+0000","last_undegraded":"2024-09-14T12:01:37.268681+0000","last_fullsized":"2024-09-14T12:01:37.268681+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'315","last_scrub_stamp":"2024-09-14T12:01:37.268548+0000","last_deep_scrub":"263'315","last_deep_scrub_stamp":"2024-09-14T12:01:37.268548+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.268548+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:39.392560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":578,"num_read_kb":18043,"num_write":1147,"num_write_kb":30368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"263'455","reported_seq":1884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.679270+0000","last_change":"2024-09-14T10:46:46.338061+0000","last_active":"2024-09-14T11:59:34.679270+0000","last_peered":"2024-09-14T11:59:34.679270+0000","last_clean":"2024-09-14T11:59:34.679270+0000","last_became_active":"2024-09-14T10:46:46.337092+0000","last_became_peered":"2024-09-14T10:46:46.337092+0000","last_unstale":"2024-09-14T11:59:34.679270+0000","last_undegraded":"2024-09-14T11:59:34.679270+0000","last_fullsized":"2024-09-14T11:59:34.679270+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:11.129363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2407,"num_read_kb":2236,"num_write":590,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"263'320","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.828433+0000","last_change":"2024-09-14T12:01:30.828433+0000","last_active":"2024-09-14T12:01:30.828433+0000","last_peered":"2024-09-14T12:01:30.828433+0000","last_clean":"2024-09-14T12:01:30.828433+0000","last_became_active":"2024-09-14T10:46:44.321098+0000","last_became_peered":"2024-09-14T10:46:44.321098+0000","last_unstale":"2024-09-14T12:01:30.828433+0000","last_undegraded":"2024-09-14T12:01:30.828433+0000","last_fullsized":"2024-09-14T12:01:30.828433+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'320","last_scrub_stamp":"2024-09-14T12:01:30.828329+0000","last_deep_scrub":"263'320","last_deep_scrub_stamp":"2024-09-14T12:01:30.828329+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.828329+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:12.296951+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":621,"num_read_kb":93491,"num_write":1039,"num_write_kb":33828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"263'564","reported_seq":2231,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.576372+0000","last_change":"2024-09-14T12:01:42.576372+0000","last_active":"2024-09-14T12:01:42.576372+0000","last_peered":"2024-09-14T12:01:42.576372+0000","last_clean":"2024-09-14T12:01:42.576372+0000","last_became_active":"2024-09-14T10:46:46.337883+0000","last_became_peered":"2024-09-14T10:46:46.337883+0000","last_unstale":"2024-09-14T12:01:42.576372+0000","last_undegraded":"2024-09-14T12:01:42.576372+0000","last_fullsized":"2024-09-14T12:01:42.576372+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'564","last_scrub_stamp":"2024-09-14T12:01:42.576290+0000","last_deep_scrub":"263'564","last_deep_scrub_stamp":"2024-09-14T12:01:42.576290+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.576290+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":500,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:57.196401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3147,"num_read_kb":2923,"num_write":727,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"263'377","reported_seq":1065,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.257994+0000","last_change":"2024-09-14T12:01:33.257931+0000","last_active":"2024-09-14T12:01:33.257994+0000","last_peered":"2024-09-14T12:01:33.257994+0000","last_clean":"2024-09-14T12:01:33.257994+0000","last_became_active":"2024-09-14T10:46:44.324768+0000","last_became_peered":"2024-09-14T10:46:44.324768+0000","last_unstale":"2024-09-14T12:01:33.257994+0000","last_undegraded":"2024-09-14T12:01:33.257994+0000","last_fullsized":"2024-09-14T12:01:33.257994+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-14T12:01:33.257829+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-14T12:01:33.257829+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.257829+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:41.419490+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":706,"num_read_kb":82703,"num_write":1285,"num_write_kb":36007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"263'448","reported_seq":2083,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.239959+0000","last_change":"2024-09-14T12:01:41.239959+0000","last_active":"2024-09-14T12:01:41.239959+0000","last_peered":"2024-09-14T12:01:41.239959+0000","last_clean":"2024-09-14T12:01:41.239959+0000","last_became_active":"2024-09-14T10:46:46.338973+0000","last_became_peered":"2024-09-14T10:46:46.338973+0000","last_unstale":"2024-09-14T12:01:41.239959+0000","last_undegraded":"2024-09-14T12:01:41.239959+0000","last_fullsized":"2024-09-14T12:01:41.239959+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'448","last_scrub_stamp":"2024-09-14T12:01:41.239865+0000","last_deep_scrub":"263'448","last_deep_scrub_stamp":"2024-09-14T12:01:41.239865+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.239865+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:15.050347+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2500,"num_read_kb":2382,"num_write":507,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"263'357","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.825671+0000","last_change":"2024-09-14T12:01:29.825614+0000","last_active":"2024-09-14T12:01:29.825671+0000","last_peered":"2024-09-14T12:01:29.825671+0000","last_clean":"2024-09-14T12:01:29.825671+0000","last_became_active":"2024-09-14T10:46:44.319801+0000","last_became_peered":"2024-09-14T10:46:44.319801+0000","last_unstale":"2024-09-14T12:01:29.825671+0000","last_undegraded":"2024-09-14T12:01:29.825671+0000","last_fullsized":"2024-09-14T12:01:29.825671+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'357","last_scrub_stamp":"2024-09-14T12:01:29.825517+0000","last_deep_scrub":"263'357","last_deep_scrub_stamp":"2024-09-14T12:01:29.825517+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.825517+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:51:15.006775+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":563,"num_read_kb":13023,"num_write":1154,"num_write_kb":36371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"263'583","reported_seq":2167,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.269579+0000","last_change":"2024-09-14T12:01:39.269579+0000","last_active":"2024-09-14T12:01:39.269579+0000","last_peered":"2024-09-14T12:01:39.269579+0000","last_clean":"2024-09-14T12:01:39.269579+0000","last_became_active":"2024-09-14T10:46:46.350776+0000","last_became_peered":"2024-09-14T10:46:46.350776+0000","last_unstale":"2024-09-14T12:01:39.269579+0000","last_undegraded":"2024-09-14T12:01:39.269579+0000","last_fullsized":"2024-09-14T12:01:39.269579+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'583","last_scrub_stamp":"2024-09-14T12:01:39.269492+0000","last_deep_scrub":"263'583","last_deep_scrub_stamp":"2024-09-14T12:01:39.269492+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.269492+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:13.396139+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3080,"num_read_kb":2791,"num_write":782,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":908,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"263'282","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.275254+0000","last_change":"2024-09-14T12:01:29.275115+0000","last_active":"2024-09-14T12:01:29.275254+0000","last_peered":"2024-09-14T12:01:29.275254+0000","last_clean":"2024-09-14T12:01:29.275254+0000","last_became_active":"2024-09-14T10:46:44.327650+0000","last_became_peered":"2024-09-14T10:46:44.327650+0000","last_unstale":"2024-09-14T12:01:29.275254+0000","last_undegraded":"2024-09-14T12:01:29.275254+0000","last_fullsized":"2024-09-14T12:01:29.275254+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'282","last_scrub_stamp":"2024-09-14T12:01:29.274975+0000","last_deep_scrub":"263'282","last_deep_scrub_stamp":"2024-09-14T12:01:29.274975+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.274975+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:44.277815+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":6055,"num_write":990,"num_write_kb":41392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"263'569","reported_seq":2325,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.914997+0000","last_change":"2024-09-14T12:01:39.914997+0000","last_active":"2024-09-14T12:01:39.914997+0000","last_peered":"2024-09-14T12:01:39.914997+0000","last_clean":"2024-09-14T12:01:39.914997+0000","last_became_active":"2024-09-14T10:46:46.341474+0000","last_became_peered":"2024-09-14T10:46:46.341474+0000","last_unstale":"2024-09-14T12:01:39.914997+0000","last_undegraded":"2024-09-14T12:01:39.914997+0000","last_fullsized":"2024-09-14T12:01:39.914997+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'569","last_scrub_stamp":"2024-09-14T12:01:39.914912+0000","last_deep_scrub":"263'569","last_deep_scrub_stamp":"2024-09-14T12:01:39.914912+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.914912+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:23.529357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3094,"num_read_kb":2877,"num_write":684,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"263'343","reported_seq":990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.312033+0000","last_change":"2024-09-14T12:01:36.312033+0000","last_active":"2024-09-14T12:01:36.312033+0000","last_peered":"2024-09-14T12:01:36.312033+0000","last_clean":"2024-09-14T12:01:36.312033+0000","last_became_active":"2024-09-14T10:46:44.334630+0000","last_became_peered":"2024-09-14T10:46:44.334630+0000","last_unstale":"2024-09-14T12:01:36.312033+0000","last_undegraded":"2024-09-14T12:01:36.312033+0000","last_fullsized":"2024-09-14T12:01:36.312033+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-14T12:01:36.311932+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-14T12:01:36.311932+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.311932+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:31.732885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":627,"num_read_kb":14860,"num_write":1052,"num_write_kb":34853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"263'824","reported_seq":2407,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:43.469536+0000","last_change":"2024-09-14T10:46:46.350955+0000","last_active":"2024-09-14T11:59:43.469536+0000","last_peered":"2024-09-14T11:59:43.469536+0000","last_clean":"2024-09-14T11:59:43.469536+0000","last_became_active":"2024-09-14T10:46:46.350391+0000","last_became_peered":"2024-09-14T10:46:46.350391+0000","last_unstale":"2024-09-14T11:59:43.469536+0000","last_undegraded":"2024-09-14T11:59:43.469536+0000","last_fullsized":"2024-09-14T11:59:43.469536+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:02.579006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3863,"num_read_kb":3486,"num_write":1075,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"263'750","reported_seq":2177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.757216+0000","last_change":"2024-09-14T12:01:42.757216+0000","last_active":"2024-09-14T12:01:42.757216+0000","last_peered":"2024-09-14T12:01:42.757216+0000","last_clean":"2024-09-14T12:01:42.757216+0000","last_became_active":"2024-09-14T10:46:46.335749+0000","last_became_peered":"2024-09-14T10:46:46.335749+0000","last_unstale":"2024-09-14T12:01:42.757216+0000","last_undegraded":"2024-09-14T12:01:42.757216+0000","last_fullsized":"2024-09-14T12:01:42.757216+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'750","last_scrub_stamp":"2024-09-14T12:01:42.757030+0000","last_deep_scrub":"263'750","last_deep_scrub_stamp":"2024-09-14T12:01:42.757030+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.757030+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:49.714436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3617,"num_read_kb":3235,"num_write":1004,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"263'306","reported_seq":926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.685602+0000","last_change":"2024-09-14T12:01:29.685602+0000","last_active":"2024-09-14T12:01:29.685602+0000","last_peered":"2024-09-14T12:01:29.685602+0000","last_clean":"2024-09-14T12:01:29.685602+0000","last_became_active":"2024-09-14T10:46:44.316741+0000","last_became_peered":"2024-09-14T10:46:44.316741+0000","last_unstale":"2024-09-14T12:01:29.685602+0000","last_undegraded":"2024-09-14T12:01:29.685602+0000","last_fullsized":"2024-09-14T12:01:29.685602+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'306","last_scrub_stamp":"2024-09-14T12:01:29.685467+0000","last_deep_scrub":"263'306","last_deep_scrub_stamp":"2024-09-14T12:01:29.685467+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.685467+0000","objects_scrubbed":4,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:18.640343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133671,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":507,"num_read_kb":26974,"num_write":959,"num_write_kb":33080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"263'805","reported_seq":2507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.299296+0000","last_change":"2024-09-14T12:01:38.299296+0000","last_active":"2024-09-14T12:01:38.299296+0000","last_peered":"2024-09-14T12:01:38.299296+0000","last_clean":"2024-09-14T12:01:38.299296+0000","last_became_active":"2024-09-14T10:46:46.345709+0000","last_became_peered":"2024-09-14T10:46:46.345709+0000","last_unstale":"2024-09-14T12:01:38.299296+0000","last_undegraded":"2024-09-14T12:01:38.299296+0000","last_fullsized":"2024-09-14T12:01:38.299296+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'805","last_scrub_stamp":"2024-09-14T12:01:38.299204+0000","last_deep_scrub":"263'805","last_deep_scrub_stamp":"2024-09-14T12:01:38.299204+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.299204+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:24.140873+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3947,"num_read_kb":3606,"num_write":1038,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"263'367","reported_seq":1016,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.285396+0000","last_change":"2024-09-14T12:01:28.285316+0000","last_active":"2024-09-14T12:01:28.285396+0000","last_peered":"2024-09-14T12:01:28.285396+0000","last_clean":"2024-09-14T12:01:28.285396+0000","last_became_active":"2024-09-14T10:46:44.331599+0000","last_became_peered":"2024-09-14T10:46:44.331599+0000","last_unstale":"2024-09-14T12:01:28.285396+0000","last_undegraded":"2024-09-14T12:01:28.285396+0000","last_fullsized":"2024-09-14T12:01:28.285396+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-09-14T12:01:28.285209+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-09-14T12:01:28.285209+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.285209+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:29.491140+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":622,"num_read_kb":2368,"num_write":1092,"num_write_kb":34113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"263'400","reported_seq":1971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.683623+0000","last_change":"2024-09-14T12:01:36.683566+0000","last_active":"2024-09-14T12:01:36.683623+0000","last_peered":"2024-09-14T12:01:36.683623+0000","last_clean":"2024-09-14T12:01:36.683623+0000","last_became_active":"2024-09-14T10:46:46.350525+0000","last_became_peered":"2024-09-14T10:46:46.350525+0000","last_unstale":"2024-09-14T12:01:36.683623+0000","last_undegraded":"2024-09-14T12:01:36.683623+0000","last_fullsized":"2024-09-14T12:01:36.683623+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'400","last_scrub_stamp":"2024-09-14T12:01:36.683491+0000","last_deep_scrub":"263'400","last_deep_scrub_stamp":"2024-09-14T12:01:36.683491+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.683491+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:32.999277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2275,"num_read_kb":2173,"num_write":451,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"263'369","reported_seq":1054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.276045+0000","last_change":"2024-09-14T12:01:30.275983+0000","last_active":"2024-09-14T12:01:30.276045+0000","last_peered":"2024-09-14T12:01:30.276045+0000","last_clean":"2024-09-14T12:01:30.276045+0000","last_became_active":"2024-09-14T10:46:44.339871+0000","last_became_peered":"2024-09-14T10:46:44.339871+0000","last_unstale":"2024-09-14T12:01:30.276045+0000","last_undegraded":"2024-09-14T12:01:30.276045+0000","last_fullsized":"2024-09-14T12:01:30.276045+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'369","last_scrub_stamp":"2024-09-14T12:01:30.275862+0000","last_deep_scrub":"263'369","last_deep_scrub_stamp":"2024-09-14T12:01:30.275862+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.275862+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:27.494575+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":774,"num_read_kb":19273,"num_write":1249,"num_write_kb":53136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"263'1157","reported_seq":2724,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.847949+0000","last_change":"2024-09-14T12:01:41.847888+0000","last_active":"2024-09-14T12:01:41.847949+0000","last_peered":"2024-09-14T12:01:41.847949+0000","last_clean":"2024-09-14T12:01:41.847949+0000","last_became_active":"2024-09-14T10:46:46.349649+0000","last_became_peered":"2024-09-14T10:46:46.349649+0000","last_unstale":"2024-09-14T12:01:41.847949+0000","last_undegraded":"2024-09-14T12:01:41.847949+0000","last_fullsized":"2024-09-14T12:01:41.847949+0000","mapping_epoch":28,"log_start":"263'1100","ondisk_log_start":"263'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1157","last_scrub_stamp":"2024-09-14T12:01:41.847805+0000","last_deep_scrub":"263'1157","last_deep_scrub_stamp":"2024-09-14T12:01:41.847805+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.847805+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":1100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:14.558545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5238,"num_read_kb":4651,"num_write":1596,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"263'343","reported_seq":1086,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.296535+0000","last_change":"2024-09-14T12:01:34.296459+0000","last_active":"2024-09-14T12:01:34.296535+0000","last_peered":"2024-09-14T12:01:34.296535+0000","last_clean":"2024-09-14T12:01:34.296535+0000","last_became_active":"2024-09-14T10:46:44.326645+0000","last_became_peered":"2024-09-14T10:46:44.326645+0000","last_unstale":"2024-09-14T12:01:34.296535+0000","last_undegraded":"2024-09-14T12:01:34.296535+0000","last_fullsized":"2024-09-14T12:01:34.296535+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-14T12:01:34.296326+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-14T12:01:34.296326+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.296326+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:34.490843+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":923,"num_read_kb":14272,"num_write":1148,"num_write_kb":16465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"263'962","reported_seq":2508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.499691+0000","last_change":"2024-09-14T10:46:46.347683+0000","last_active":"2024-09-14T11:59:49.499691+0000","last_peered":"2024-09-14T11:59:49.499691+0000","last_clean":"2024-09-14T11:59:49.499691+0000","last_became_active":"2024-09-14T10:46:46.347420+0000","last_became_peered":"2024-09-14T10:46:46.347420+0000","last_unstale":"2024-09-14T11:59:49.499691+0000","last_undegraded":"2024-09-14T11:59:49.499691+0000","last_fullsized":"2024-09-14T11:59:49.499691+0000","mapping_epoch":28,"log_start":"263'900","ondisk_log_start":"263'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":900,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5046,"num_read_kb":4563,"num_write":1374,"num_write_kb":542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"263'377","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.755590+0000","last_change":"2024-09-14T12:01:34.755520+0000","last_active":"2024-09-14T12:01:34.755590+0000","last_peered":"2024-09-14T12:01:34.755590+0000","last_clean":"2024-09-14T12:01:34.755590+0000","last_became_active":"2024-09-14T10:46:44.319146+0000","last_became_peered":"2024-09-14T10:46:44.319146+0000","last_unstale":"2024-09-14T12:01:34.755590+0000","last_undegraded":"2024-09-14T12:01:34.755590+0000","last_fullsized":"2024-09-14T12:01:34.755590+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-14T12:01:34.755410+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-14T12:01:34.755410+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.755410+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:11.914432+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":594,"num_read_kb":40910,"num_write":1073,"num_write_kb":34714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"263'375","reported_seq":1901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.707478+0000","last_change":"2024-09-14T12:01:35.707415+0000","last_active":"2024-09-14T12:01:35.707478+0000","last_peered":"2024-09-14T12:01:35.707478+0000","last_clean":"2024-09-14T12:01:35.707478+0000","last_became_active":"2024-09-14T10:46:46.339710+0000","last_became_peered":"2024-09-14T10:46:46.339710+0000","last_unstale":"2024-09-14T12:01:35.707478+0000","last_undegraded":"2024-09-14T12:01:35.707478+0000","last_fullsized":"2024-09-14T12:01:35.707478+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'375","last_scrub_stamp":"2024-09-14T12:01:35.707315+0000","last_deep_scrub":"263'375","last_deep_scrub_stamp":"2024-09-14T12:01:35.707315+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.707315+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:14.828586+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2075,"num_read_kb":1993,"num_write":416,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"263'322","reported_seq":1051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.762601+0000","last_change":"2024-09-14T12:01:33.762529+0000","last_active":"2024-09-14T12:01:33.762601+0000","last_peered":"2024-09-14T12:01:33.762601+0000","last_clean":"2024-09-14T12:01:33.762601+0000","last_became_active":"2024-09-14T10:46:44.317895+0000","last_became_peered":"2024-09-14T10:46:44.317895+0000","last_unstale":"2024-09-14T12:01:33.762601+0000","last_undegraded":"2024-09-14T12:01:33.762601+0000","last_fullsized":"2024-09-14T12:01:33.762601+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'322","last_scrub_stamp":"2024-09-14T12:01:33.762405+0000","last_deep_scrub":"263'322","last_deep_scrub_stamp":"2024-09-14T12:01:33.762405+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.762405+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:37.306350+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":939,"num_read_kb":22981,"num_write":1007,"num_write_kb":27989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"263'130","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.815076+0000","last_change":"2024-09-14T10:46:54.375921+0000","last_active":"2024-09-14T11:59:34.815076+0000","last_peered":"2024-09-14T11:59:34.815076+0000","last_clean":"2024-09-14T11:59:34.815076+0000","last_became_active":"2024-09-14T10:46:54.374769+0000","last_became_peered":"2024-09-14T10:46:54.374769+0000","last_unstale":"2024-09-14T11:59:34.815076+0000","last_undegraded":"2024-09-14T11:59:34.815076+0000","last_fullsized":"2024-09-14T11:59:34.815076+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:49.159300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":165,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"263'434","reported_seq":1993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.832518+0000","last_change":"2024-09-14T12:01:40.832518+0000","last_active":"2024-09-14T12:01:40.832518+0000","last_peered":"2024-09-14T12:01:40.832518+0000","last_clean":"2024-09-14T12:01:40.832518+0000","last_became_active":"2024-09-14T10:46:46.340169+0000","last_became_peered":"2024-09-14T10:46:46.340169+0000","last_unstale":"2024-09-14T12:01:40.832518+0000","last_undegraded":"2024-09-14T12:01:40.832518+0000","last_fullsized":"2024-09-14T12:01:40.832518+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'434","last_scrub_stamp":"2024-09-14T12:01:40.832431+0000","last_deep_scrub":"263'434","last_deep_scrub_stamp":"2024-09-14T12:01:40.832431+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.832431+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:14.426399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2291,"num_read_kb":2165,"num_write":484,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"263'388","reported_seq":1040,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.803949+0000","last_change":"2024-09-14T12:01:32.803949+0000","last_active":"2024-09-14T12:01:32.803949+0000","last_peered":"2024-09-14T12:01:32.803949+0000","last_clean":"2024-09-14T12:01:32.803949+0000","last_became_active":"2024-09-14T10:47:18.793917+0000","last_became_peered":"2024-09-14T10:47:18.793917+0000","last_unstale":"2024-09-14T12:01:32.803949+0000","last_undegraded":"2024-09-14T12:01:32.803949+0000","last_fullsized":"2024-09-14T12:01:32.803949+0000","mapping_epoch":39,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'388","last_scrub_stamp":"2024-09-14T12:01:32.803811+0000","last_deep_scrub":"263'388","last_deep_scrub_stamp":"2024-09-14T12:01:32.803811+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.803811+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:40.563517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":723,"num_read_kb":48707,"num_write":1316,"num_write_kb":50304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.536682+0000","last_change":"2024-09-14T10:46:48.357072+0000","last_active":"2024-09-14T11:59:20.536682+0000","last_peered":"2024-09-14T11:59:20.536682+0000","last_clean":"2024-09-14T11:59:20.536682+0000","last_became_active":"2024-09-14T10:46:48.356776+0000","last_became_peered":"2024-09-14T10:46:48.356776+0000","last_unstale":"2024-09-14T11:59:20.536682+0000","last_undegraded":"2024-09-14T11:59:20.536682+0000","last_fullsized":"2024-09-14T11:59:20.536682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"263'353","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.010109+0000","last_change":"2024-09-14T10:46:50.360895+0000","last_active":"2024-09-14T12:01:18.010109+0000","last_peered":"2024-09-14T12:01:18.010109+0000","last_clean":"2024-09-14T12:01:18.010109+0000","last_became_active":"2024-09-14T10:46:50.359481+0000","last_became_peered":"2024-09-14T10:46:50.359481+0000","last_unstale":"2024-09-14T12:01:18.010109+0000","last_undegraded":"2024-09-14T12:01:18.010109+0000","last_fullsized":"2024-09-14T12:01:18.010109+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51669,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":564,"num_read_kb":1178,"num_write":444,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.396876+0000","last_change":"2024-09-14T10:46:52.373231+0000","last_active":"2024-09-14T11:57:00.396876+0000","last_peered":"2024-09-14T11:57:00.396876+0000","last_clean":"2024-09-14T11:57:00.396876+0000","last_became_active":"2024-09-14T10:46:52.372941+0000","last_became_peered":"2024-09-14T10:46:52.372941+0000","last_unstale":"2024-09-14T11:57:00.396876+0000","last_undegraded":"2024-09-14T11:57:00.396876+0000","last_fullsized":"2024-09-14T11:57:00.396876+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:39.029048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"263'153","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:57.663650+0000","last_change":"2024-09-14T10:46:54.387774+0000","last_active":"2024-09-14T11:57:57.663650+0000","last_peered":"2024-09-14T11:57:57.663650+0000","last_clean":"2024-09-14T11:57:57.663650+0000","last_became_active":"2024-09-14T10:46:54.387445+0000","last_became_peered":"2024-09-14T10:46:54.387445+0000","last_unstale":"2024-09-14T11:57:57.663650+0000","last_undegraded":"2024-09-14T11:57:57.663650+0000","last_fullsized":"2024-09-14T11:57:57.663650+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:41.372638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":80,"num_write":348,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"263'551","reported_seq":2272,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.166949+0000","last_change":"2024-09-14T10:46:46.340740+0000","last_active":"2024-09-14T12:00:51.166949+0000","last_peered":"2024-09-14T12:00:51.166949+0000","last_clean":"2024-09-14T12:00:51.166949+0000","last_became_active":"2024-09-14T10:46:46.340242+0000","last_became_peered":"2024-09-14T10:46:46.340242+0000","last_unstale":"2024-09-14T12:00:51.166949+0000","last_undegraded":"2024-09-14T12:00:51.166949+0000","last_fullsized":"2024-09-14T12:00:51.166949+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3138,"num_read_kb":2920,"num_write":702,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"263'332","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.847264+0000","last_change":"2024-09-14T12:01:30.847264+0000","last_active":"2024-09-14T12:01:30.847264+0000","last_peered":"2024-09-14T12:01:30.847264+0000","last_clean":"2024-09-14T12:01:30.847264+0000","last_became_active":"2024-09-14T10:46:44.334757+0000","last_became_peered":"2024-09-14T10:46:44.334757+0000","last_unstale":"2024-09-14T12:01:30.847264+0000","last_undegraded":"2024-09-14T12:01:30.847264+0000","last_fullsized":"2024-09-14T12:01:30.847264+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'332","last_scrub_stamp":"2024-09-14T12:01:30.847120+0000","last_deep_scrub":"263'332","last_deep_scrub_stamp":"2024-09-14T12:01:30.847120+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.847120+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:08.535049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133691,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":630,"num_read_kb":20083,"num_write":1075,"num_write_kb":20918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.528073+0000","last_change":"2024-09-14T12:01:43.528005+0000","last_active":"2024-09-14T12:01:43.528073+0000","last_peered":"2024-09-14T12:01:43.528073+0000","last_clean":"2024-09-14T12:01:43.528073+0000","last_became_active":"2024-09-14T10:46:48.351825+0000","last_became_peered":"2024-09-14T10:46:48.351825+0000","last_unstale":"2024-09-14T12:01:43.528073+0000","last_undegraded":"2024-09-14T12:01:43.528073+0000","last_fullsized":"2024-09-14T12:01:43.528073+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:43.527908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:43.527908+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.527908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:37.108237+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"263'104","reported_seq":645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.647651+0000","last_change":"2024-09-14T12:01:43.647591+0000","last_active":"2024-09-14T12:01:43.647651+0000","last_peered":"2024-09-14T12:01:43.647651+0000","last_clean":"2024-09-14T12:01:43.647651+0000","last_became_active":"2024-09-14T10:46:50.360649+0000","last_became_peered":"2024-09-14T10:46:50.360649+0000","last_unstale":"2024-09-14T12:01:43.647651+0000","last_undegraded":"2024-09-14T12:01:43.647651+0000","last_fullsized":"2024-09-14T12:01:43.647651+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'104","last_scrub_stamp":"2024-09-14T12:01:43.647503+0000","last_deep_scrub":"263'104","last_deep_scrub_stamp":"2024-09-14T12:01:43.647503+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.647503+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:21.629132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.396818+0000","last_change":"2024-09-14T10:46:52.373120+0000","last_active":"2024-09-14T11:57:00.396818+0000","last_peered":"2024-09-14T11:57:00.396818+0000","last_clean":"2024-09-14T11:57:00.396818+0000","last_became_active":"2024-09-14T10:46:52.372770+0000","last_became_peered":"2024-09-14T10:46:52.372770+0000","last_unstale":"2024-09-14T11:57:00.396818+0000","last_undegraded":"2024-09-14T11:57:00.396818+0000","last_fullsized":"2024-09-14T11:57:00.396818+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:37.866381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"263'140","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.088657+0000","last_change":"2024-09-14T10:46:54.389893+0000","last_active":"2024-09-14T11:58:40.088657+0000","last_peered":"2024-09-14T11:58:40.088657+0000","last_clean":"2024-09-14T11:58:40.088657+0000","last_became_active":"2024-09-14T10:46:54.389638+0000","last_became_peered":"2024-09-14T10:46:54.389638+0000","last_unstale":"2024-09-14T11:58:40.088657+0000","last_undegraded":"2024-09-14T11:58:40.088657+0000","last_fullsized":"2024-09-14T11:58:40.088657+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:21.500685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":168,"num_write":356,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"263'452","reported_seq":2199,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.220802+0000","last_change":"2024-09-14T12:01:41.220735+0000","last_active":"2024-09-14T12:01:41.220802+0000","last_peered":"2024-09-14T12:01:41.220802+0000","last_clean":"2024-09-14T12:01:41.220802+0000","last_became_active":"2024-09-14T10:46:46.344509+0000","last_became_peered":"2024-09-14T10:46:46.344509+0000","last_unstale":"2024-09-14T12:01:41.220802+0000","last_undegraded":"2024-09-14T12:01:41.220802+0000","last_fullsized":"2024-09-14T12:01:41.220802+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'452","last_scrub_stamp":"2024-09-14T12:01:41.220645+0000","last_deep_scrub":"263'452","last_deep_scrub_stamp":"2024-09-14T12:01:41.220645+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.220645+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:35.813843+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2693,"num_read_kb":2571,"num_write":507,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2556,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"263'330","reported_seq":1012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.784580+0000","last_change":"2024-09-14T12:01:33.784580+0000","last_active":"2024-09-14T12:01:33.784580+0000","last_peered":"2024-09-14T12:01:33.784580+0000","last_clean":"2024-09-14T12:01:33.784580+0000","last_became_active":"2024-09-14T10:46:44.331464+0000","last_became_peered":"2024-09-14T10:46:44.331464+0000","last_unstale":"2024-09-14T12:01:33.784580+0000","last_undegraded":"2024-09-14T12:01:33.784580+0000","last_fullsized":"2024-09-14T12:01:33.784580+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'330","last_scrub_stamp":"2024-09-14T12:01:33.784418+0000","last_deep_scrub":"263'330","last_deep_scrub_stamp":"2024-09-14T12:01:33.784418+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.784418+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:35.461645+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267319,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":652,"num_read_kb":48168,"num_write":1033,"num_write_kb":26849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.654540+0000","last_change":"2024-09-14T10:46:48.357687+0000","last_active":"2024-09-14T11:59:20.654540+0000","last_peered":"2024-09-14T11:59:20.654540+0000","last_clean":"2024-09-14T11:59:20.654540+0000","last_became_active":"2024-09-14T10:46:48.357301+0000","last_became_peered":"2024-09-14T10:46:48.357301+0000","last_unstale":"2024-09-14T11:59:20.654540+0000","last_undegraded":"2024-09-14T11:59:20.654540+0000","last_fullsized":"2024-09-14T11:59:20.654540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"263'138","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.655235+0000","last_change":"2024-09-14T10:46:50.363764+0000","last_active":"2024-09-14T11:59:25.655235+0000","last_peered":"2024-09-14T11:59:25.655235+0000","last_clean":"2024-09-14T11:59:25.655235+0000","last_became_active":"2024-09-14T10:46:50.363495+0000","last_became_peered":"2024-09-14T10:46:50.363495+0000","last_unstale":"2024-09-14T11:59:25.655235+0000","last_undegraded":"2024-09-14T11:59:25.655235+0000","last_fullsized":"2024-09-14T11:59:25.655235+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":162,"num_write":114,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"263'792","reported_seq":2727,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.488837+0000","last_change":"2024-09-14T10:46:52.374170+0000","last_active":"2024-09-14T12:01:18.488837+0000","last_peered":"2024-09-14T12:01:18.488837+0000","last_clean":"2024-09-14T12:01:18.488837+0000","last_became_active":"2024-09-14T10:46:52.373886+0000","last_became_peered":"2024-09-14T10:46:52.373886+0000","last_unstale":"2024-09-14T12:01:18.488837+0000","last_undegraded":"2024-09-14T12:01:18.488837+0000","last_fullsized":"2024-09-14T12:01:18.488837+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:54.230847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"263'181","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.721550+0000","last_change":"2024-09-14T10:46:54.388494+0000","last_active":"2024-09-14T11:59:33.721550+0000","last_peered":"2024-09-14T11:59:33.721550+0000","last_clean":"2024-09-14T11:59:33.721550+0000","last_became_active":"2024-09-14T10:46:54.388186+0000","last_became_peered":"2024-09-14T10:46:54.388186+0000","last_unstale":"2024-09-14T11:59:33.721550+0000","last_undegraded":"2024-09-14T11:59:33.721550+0000","last_fullsized":"2024-09-14T11:59:33.721550+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:38.806003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":561,"num_read_kb":561,"num_write":378,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"263'897","reported_seq":2339,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.268109+0000","last_change":"2024-09-14T12:01:42.268055+0000","last_active":"2024-09-14T12:01:42.268109+0000","last_peered":"2024-09-14T12:01:42.268109+0000","last_clean":"2024-09-14T12:01:42.268109+0000","last_became_active":"2024-09-14T10:46:46.351453+0000","last_became_peered":"2024-09-14T10:46:46.351453+0000","last_unstale":"2024-09-14T12:01:42.268109+0000","last_undegraded":"2024-09-14T12:01:42.268109+0000","last_fullsized":"2024-09-14T12:01:42.268109+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'897","last_scrub_stamp":"2024-09-14T12:01:42.267963+0000","last_deep_scrub":"263'897","last_deep_scrub_stamp":"2024-09-14T12:01:42.267963+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.267963+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":800,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:38.136304+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4193,"num_read_kb":3693,"num_write":1250,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"263'366","reported_seq":1051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:25.748065+0000","last_change":"2024-09-14T12:01:25.748065+0000","last_active":"2024-09-14T12:01:25.748065+0000","last_peered":"2024-09-14T12:01:25.748065+0000","last_clean":"2024-09-14T12:01:25.748065+0000","last_became_active":"2024-09-14T10:46:44.328531+0000","last_became_peered":"2024-09-14T10:46:44.328531+0000","last_unstale":"2024-09-14T12:01:25.748065+0000","last_undegraded":"2024-09-14T12:01:25.748065+0000","last_fullsized":"2024-09-14T12:01:25.748065+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'366","last_scrub_stamp":"2024-09-14T12:01:25.747975+0000","last_deep_scrub":"263'366","last_deep_scrub_stamp":"2024-09-14T12:01:25.747975+0000","last_clean_scrub_stamp":"2024-09-14T12:01:25.747975+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:05.853735+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":728,"num_read_kb":24160,"num_write":1182,"num_write_kb":50074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.536711+0000","last_change":"2024-09-14T10:46:48.349347+0000","last_active":"2024-09-14T11:59:20.536711+0000","last_peered":"2024-09-14T11:59:20.536711+0000","last_clean":"2024-09-14T11:59:20.536711+0000","last_became_active":"2024-09-14T10:46:48.348899+0000","last_became_peered":"2024-09-14T10:46:48.348899+0000","last_unstale":"2024-09-14T11:59:20.536711+0000","last_undegraded":"2024-09-14T11:59:20.536711+0000","last_fullsized":"2024-09-14T11:59:20.536711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"263'311","reported_seq":904,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.892505+0000","last_change":"2024-09-14T12:01:43.892436+0000","last_active":"2024-09-14T12:01:43.892505+0000","last_peered":"2024-09-14T12:01:43.892505+0000","last_clean":"2024-09-14T12:01:43.892505+0000","last_became_active":"2024-09-14T10:46:50.365721+0000","last_became_peered":"2024-09-14T10:46:50.365721+0000","last_unstale":"2024-09-14T12:01:43.892505+0000","last_undegraded":"2024-09-14T12:01:43.892505+0000","last_fullsized":"2024-09-14T12:01:43.892505+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-09-14T12:01:43.892336+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-09-14T12:01:43.892336+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.892336+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:51.567901+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47247,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":1144,"num_write":408,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"263'830","reported_seq":2740,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.419611+0000","last_change":"2024-09-14T10:46:52.375010+0000","last_active":"2024-09-14T12:01:19.419611+0000","last_peered":"2024-09-14T12:01:19.419611+0000","last_clean":"2024-09-14T12:01:19.419611+0000","last_became_active":"2024-09-14T10:46:52.374634+0000","last_became_peered":"2024-09-14T10:46:52.374634+0000","last_unstale":"2024-09-14T12:01:19.419611+0000","last_undegraded":"2024-09-14T12:01:19.419611+0000","last_fullsized":"2024-09-14T12:01:19.419611+0000","mapping_epoch":34,"log_start":"263'800","ondisk_log_start":"263'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":800,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"263'525","reported_seq":2113,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.726626+0000","last_change":"2024-09-14T12:01:41.726626+0000","last_active":"2024-09-14T12:01:41.726626+0000","last_peered":"2024-09-14T12:01:41.726626+0000","last_clean":"2024-09-14T12:01:41.726626+0000","last_became_active":"2024-09-14T10:46:46.341971+0000","last_became_peered":"2024-09-14T10:46:46.341971+0000","last_unstale":"2024-09-14T12:01:41.726626+0000","last_undegraded":"2024-09-14T12:01:41.726626+0000","last_fullsized":"2024-09-14T12:01:41.726626+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'525","last_scrub_stamp":"2024-09-14T12:01:41.726541+0000","last_deep_scrub":"263'525","last_deep_scrub_stamp":"2024-09-14T12:01:41.726541+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.726541+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:17.093439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2719,"num_read_kb":2513,"num_write":653,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"263'361","reported_seq":1034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.294867+0000","last_change":"2024-09-14T12:01:27.294867+0000","last_active":"2024-09-14T12:01:27.294867+0000","last_peered":"2024-09-14T12:01:27.294867+0000","last_clean":"2024-09-14T12:01:27.294867+0000","last_became_active":"2024-09-14T10:46:44.329782+0000","last_became_peered":"2024-09-14T10:46:44.329782+0000","last_unstale":"2024-09-14T12:01:27.294867+0000","last_undegraded":"2024-09-14T12:01:27.294867+0000","last_fullsized":"2024-09-14T12:01:27.294867+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'361","last_scrub_stamp":"2024-09-14T12:01:27.294789+0000","last_deep_scrub":"263'361","last_deep_scrub_stamp":"2024-09-14T12:01:27.294789+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.294789+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:54.811209+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":606,"num_read_kb":47823,"num_write":1082,"num_write_kb":48255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.639833+0000","last_change":"2024-09-14T12:01:42.639833+0000","last_active":"2024-09-14T12:01:42.639833+0000","last_peered":"2024-09-14T12:01:42.639833+0000","last_clean":"2024-09-14T12:01:42.639833+0000","last_became_active":"2024-09-14T10:46:48.352584+0000","last_became_peered":"2024-09-14T10:46:48.352584+0000","last_unstale":"2024-09-14T12:01:42.639833+0000","last_undegraded":"2024-09-14T12:01:42.639833+0000","last_fullsized":"2024-09-14T12:01:42.639833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:42.639742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:42.639742+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.639742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:10.999523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"263'424","reported_seq":1073,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.178116+0000","last_change":"2024-09-14T12:01:45.178116+0000","last_active":"2024-09-14T12:01:45.178116+0000","last_peered":"2024-09-14T12:01:45.178116+0000","last_clean":"2024-09-14T12:01:45.178116+0000","last_became_active":"2024-09-14T10:46:50.364438+0000","last_became_peered":"2024-09-14T10:46:50.364438+0000","last_unstale":"2024-09-14T12:01:45.178116+0000","last_undegraded":"2024-09-14T12:01:45.178116+0000","last_fullsized":"2024-09-14T12:01:45.178116+0000","mapping_epoch":32,"log_start":"263'400","ondisk_log_start":"263'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'424","last_scrub_stamp":"2024-09-14T12:01:45.178020+0000","last_deep_scrub":"263'424","last_deep_scrub_stamp":"2024-09-14T12:01:45.178020+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.178020+0000","objects_scrubbed":9,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:54.197314+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46781,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":687,"num_read_kb":1416,"num_write":538,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.526559+0000","last_change":"2024-09-14T10:46:52.368160+0000","last_active":"2024-09-14T11:58:53.526559+0000","last_peered":"2024-09-14T11:58:53.526559+0000","last_clean":"2024-09-14T11:58:53.526559+0000","last_became_active":"2024-09-14T10:46:52.367874+0000","last_became_peered":"2024-09-14T10:46:52.367874+0000","last_unstale":"2024-09-14T11:58:53.526559+0000","last_undegraded":"2024-09-14T11:58:53.526559+0000","last_fullsized":"2024-09-14T11:58:53.526559+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:15.594681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"263'556","reported_seq":1397,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:52.309850+0000","last_change":"2024-09-14T10:46:54.390213+0000","last_active":"2024-09-14T12:00:52.309850+0000","last_peered":"2024-09-14T12:00:52.309850+0000","last_clean":"2024-09-14T12:00:52.309850+0000","last_became_active":"2024-09-14T10:46:54.389880+0000","last_became_peered":"2024-09-14T10:46:54.389880+0000","last_unstale":"2024-09-14T12:00:52.309850+0000","last_undegraded":"2024-09-14T12:00:52.309850+0000","last_fullsized":"2024-09-14T12:00:52.309850+0000","mapping_epoch":36,"log_start":"263'500","ondisk_log_start":"263'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:56.630763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1361,"num_read_kb":1337,"num_write":1147,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"263'1287","reported_seq":3020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.716251+0000","last_change":"2024-09-14T12:01:30.716251+0000","last_active":"2024-09-14T12:01:30.716251+0000","last_peered":"2024-09-14T12:01:30.716251+0000","last_clean":"2024-09-14T12:01:30.716251+0000","last_became_active":"2024-09-14T10:46:46.343603+0000","last_became_peered":"2024-09-14T10:46:46.343603+0000","last_unstale":"2024-09-14T12:01:30.716251+0000","last_undegraded":"2024-09-14T12:01:30.716251+0000","last_fullsized":"2024-09-14T12:01:30.716251+0000","mapping_epoch":28,"log_start":"263'1200","ondisk_log_start":"263'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1287","last_scrub_stamp":"2024-09-14T12:01:30.716161+0000","last_deep_scrub":"263'1287","last_deep_scrub_stamp":"2024-09-14T12:01:30.716161+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.716161+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":1200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:10.862248+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6021,"num_read_kb":5313,"num_write":1785,"num_write_kb":753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"263'327","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:25.890412+0000","last_change":"2024-09-14T12:01:25.890412+0000","last_active":"2024-09-14T12:01:25.890412+0000","last_peered":"2024-09-14T12:01:25.890412+0000","last_clean":"2024-09-14T12:01:25.890412+0000","last_became_active":"2024-09-14T10:46:44.322816+0000","last_became_peered":"2024-09-14T10:46:44.322816+0000","last_unstale":"2024-09-14T12:01:25.890412+0000","last_undegraded":"2024-09-14T12:01:25.890412+0000","last_fullsized":"2024-09-14T12:01:25.890412+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'327","last_scrub_stamp":"2024-09-14T12:01:25.890298+0000","last_deep_scrub":"263'327","last_deep_scrub_stamp":"2024-09-14T12:01:25.890298+0000","last_clean_scrub_stamp":"2024-09-14T12:01:25.890298+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:47.450364+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":492,"num_write":1114,"num_write_kb":29298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.849001+0000","last_change":"2024-09-14T12:01:42.849001+0000","last_active":"2024-09-14T12:01:42.849001+0000","last_peered":"2024-09-14T12:01:42.849001+0000","last_clean":"2024-09-14T12:01:42.849001+0000","last_became_active":"2024-09-14T10:46:48.351893+0000","last_became_peered":"2024-09-14T10:46:48.351893+0000","last_unstale":"2024-09-14T12:01:42.849001+0000","last_undegraded":"2024-09-14T12:01:42.849001+0000","last_fullsized":"2024-09-14T12:01:42.849001+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:42.848916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:42.848916+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.848916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:29.709750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"263'265","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.043439+0000","last_change":"2024-09-14T10:46:50.360064+0000","last_active":"2024-09-14T12:01:19.043439+0000","last_peered":"2024-09-14T12:01:19.043439+0000","last_clean":"2024-09-14T12:01:19.043439+0000","last_became_active":"2024-09-14T10:46:50.359434+0000","last_became_peered":"2024-09-14T10:46:50.359434+0000","last_unstale":"2024-09-14T12:01:19.043439+0000","last_undegraded":"2024-09-14T12:01:19.043439+0000","last_fullsized":"2024-09-14T12:01:19.043439+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:38.484631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44011,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":1031,"num_write":356,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.648763+0000","last_change":"2024-09-14T10:46:52.369655+0000","last_active":"2024-09-14T11:58:40.648763+0000","last_peered":"2024-09-14T11:58:40.648763+0000","last_clean":"2024-09-14T11:58:40.648763+0000","last_became_active":"2024-09-14T10:46:52.369353+0000","last_became_peered":"2024-09-14T10:46:52.369353+0000","last_unstale":"2024-09-14T11:58:40.648763+0000","last_undegraded":"2024-09-14T11:58:40.648763+0000","last_fullsized":"2024-09-14T11:58:40.648763+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:30.464066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"263'2541","reported_seq":4365,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:00.417652+0000","last_change":"2024-09-14T10:46:54.383401+0000","last_active":"2024-09-14T12:00:00.417652+0000","last_peered":"2024-09-14T12:00:00.417652+0000","last_clean":"2024-09-14T12:00:00.417652+0000","last_became_active":"2024-09-14T10:46:54.383100+0000","last_became_peered":"2024-09-14T10:46:54.383100+0000","last_unstale":"2024-09-14T12:00:00.417652+0000","last_undegraded":"2024-09-14T12:00:00.417652+0000","last_fullsized":"2024-09-14T12:00:00.417652+0000","mapping_epoch":36,"log_start":"263'2500","ondisk_log_start":"263'2500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":2500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:25.507491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6216,"num_read_kb":6221,"num_write":5164,"num_write_kb":1877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"263'516","reported_seq":2296,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.851554+0000","last_change":"2024-09-14T12:01:32.851554+0000","last_active":"2024-09-14T12:01:32.851554+0000","last_peered":"2024-09-14T12:01:32.851554+0000","last_clean":"2024-09-14T12:01:32.851554+0000","last_became_active":"2024-09-14T10:46:46.337951+0000","last_became_peered":"2024-09-14T10:46:46.337951+0000","last_unstale":"2024-09-14T12:01:32.851554+0000","last_undegraded":"2024-09-14T12:01:32.851554+0000","last_fullsized":"2024-09-14T12:01:32.851554+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'516","last_scrub_stamp":"2024-09-14T12:01:32.851465+0000","last_deep_scrub":"263'516","last_deep_scrub_stamp":"2024-09-14T12:01:32.851465+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.851465+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:13.273879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2937,"num_read_kb":2795,"num_write":635,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"263'349","reported_seq":1036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.796987+0000","last_change":"2024-09-14T12:01:32.796987+0000","last_active":"2024-09-14T12:01:32.796987+0000","last_peered":"2024-09-14T12:01:32.796987+0000","last_clean":"2024-09-14T12:01:32.796987+0000","last_became_active":"2024-09-14T10:46:44.331705+0000","last_became_peered":"2024-09-14T10:46:44.331705+0000","last_unstale":"2024-09-14T12:01:32.796987+0000","last_undegraded":"2024-09-14T12:01:32.796987+0000","last_fullsized":"2024-09-14T12:01:32.796987+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'349","last_scrub_stamp":"2024-09-14T12:01:32.796840+0000","last_deep_scrub":"263'349","last_deep_scrub_stamp":"2024-09-14T12:01:32.796840+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.796840+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:14.276300+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":652,"num_read_kb":33315,"num_write":1115,"num_write_kb":35089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.460327+0000","last_change":"2024-09-14T10:46:48.355757+0000","last_active":"2024-09-14T11:58:48.460327+0000","last_peered":"2024-09-14T11:58:48.460327+0000","last_clean":"2024-09-14T11:58:48.460327+0000","last_became_active":"2024-09-14T10:46:48.354092+0000","last_became_peered":"2024-09-14T10:46:48.354092+0000","last_unstale":"2024-09-14T11:58:48.460327+0000","last_undegraded":"2024-09-14T11:58:48.460327+0000","last_fullsized":"2024-09-14T11:58:48.460327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:49.272454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"263'342","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.405360+0000","last_change":"2024-09-14T10:46:50.364160+0000","last_active":"2024-09-14T12:01:18.405360+0000","last_peered":"2024-09-14T12:01:18.405360+0000","last_clean":"2024-09-14T12:01:18.405360+0000","last_became_active":"2024-09-14T10:46:50.363893+0000","last_became_peered":"2024-09-14T10:46:50.363893+0000","last_unstale":"2024-09-14T12:01:18.405360+0000","last_undegraded":"2024-09-14T12:01:18.405360+0000","last_fullsized":"2024-09-14T12:01:18.405360+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:50.322137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44240,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":541,"num_read_kb":1145,"num_write":426,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"263'830","reported_seq":5035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.320600+0000","last_change":"2024-09-14T10:46:52.374414+0000","last_active":"2024-09-14T12:01:18.320600+0000","last_peered":"2024-09-14T12:01:18.320600+0000","last_clean":"2024-09-14T12:01:18.320600+0000","last_became_active":"2024-09-14T10:46:52.374152+0000","last_became_peered":"2024-09-14T10:46:52.374152+0000","last_unstale":"2024-09-14T12:01:18.320600+0000","last_undegraded":"2024-09-14T12:01:18.320600+0000","last_fullsized":"2024-09-14T12:01:18.320600+0000","mapping_epoch":34,"log_start":"263'800","ondisk_log_start":"263'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":800,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:31.267699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"263'166","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:50.989484+0000","last_change":"2024-09-14T10:46:54.384757+0000","last_active":"2024-09-14T12:00:50.989484+0000","last_peered":"2024-09-14T12:00:50.989484+0000","last_clean":"2024-09-14T12:00:50.989484+0000","last_became_active":"2024-09-14T10:46:54.383953+0000","last_became_peered":"2024-09-14T10:46:54.383953+0000","last_unstale":"2024-09-14T12:00:50.989484+0000","last_undegraded":"2024-09-14T12:00:50.989484+0000","last_fullsized":"2024-09-14T12:00:50.989484+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:54.206656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":135,"num_write":398,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"263'1058","reported_seq":2538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.273309+0000","last_change":"2024-09-14T12:01:39.273309+0000","last_active":"2024-09-14T12:01:39.273309+0000","last_peered":"2024-09-14T12:01:39.273309+0000","last_clean":"2024-09-14T12:01:39.273309+0000","last_became_active":"2024-09-14T10:46:46.348726+0000","last_became_peered":"2024-09-14T10:46:46.348726+0000","last_unstale":"2024-09-14T12:01:39.273309+0000","last_undegraded":"2024-09-14T12:01:39.273309+0000","last_fullsized":"2024-09-14T12:01:39.273309+0000","mapping_epoch":28,"log_start":"263'1000","ondisk_log_start":"263'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1058","last_scrub_stamp":"2024-09-14T12:01:39.273229+0000","last_deep_scrub":"263'1058","last_deep_scrub_stamp":"2024-09-14T12:01:39.273229+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.273229+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":1000,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:14.478829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4827,"num_read_kb":4287,"num_write":1450,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"263'309","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:24.291444+0000","last_change":"2024-09-14T12:01:24.291444+0000","last_active":"2024-09-14T12:01:24.291444+0000","last_peered":"2024-09-14T12:01:24.291444+0000","last_clean":"2024-09-14T12:01:24.291444+0000","last_became_active":"2024-09-14T10:46:44.332535+0000","last_became_peered":"2024-09-14T10:46:44.332535+0000","last_unstale":"2024-09-14T12:01:24.291444+0000","last_undegraded":"2024-09-14T12:01:24.291444+0000","last_fullsized":"2024-09-14T12:01:24.291444+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'309","last_scrub_stamp":"2024-09-14T12:01:24.291338+0000","last_deep_scrub":"263'309","last_deep_scrub_stamp":"2024-09-14T12:01:24.291338+0000","last_clean_scrub_stamp":"2024-09-14T12:01:24.291338+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:44.362720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267347,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":39478,"num_write":1028,"num_write_kb":35728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:28.522894+0000","last_change":"2024-09-14T10:46:48.351883+0000","last_active":"2024-09-14T11:58:28.522894+0000","last_peered":"2024-09-14T11:58:28.522894+0000","last_clean":"2024-09-14T11:58:28.522894+0000","last_became_active":"2024-09-14T10:46:48.351530+0000","last_became_peered":"2024-09-14T10:46:48.351530+0000","last_unstale":"2024-09-14T11:58:28.522894+0000","last_undegraded":"2024-09-14T11:58:28.522894+0000","last_fullsized":"2024-09-14T11:58:28.522894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:09.714239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"263'470","reported_seq":1118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.227822+0000","last_change":"2024-09-14T10:46:50.361756+0000","last_active":"2024-09-14T12:01:19.227822+0000","last_peered":"2024-09-14T12:01:19.227822+0000","last_clean":"2024-09-14T12:01:19.227822+0000","last_became_active":"2024-09-14T10:46:50.361396+0000","last_became_peered":"2024-09-14T10:46:50.361396+0000","last_unstale":"2024-09-14T12:01:19.227822+0000","last_undegraded":"2024-09-14T12:01:19.227822+0000","last_fullsized":"2024-09-14T12:01:19.227822+0000","mapping_epoch":32,"log_start":"263'400","ondisk_log_start":"263'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:24.662180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93223,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":821,"num_read_kb":1952,"num_write":664,"num_write_kb":533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.456158+0000","last_change":"2024-09-14T10:46:52.373915+0000","last_active":"2024-09-14T11:58:23.456158+0000","last_peered":"2024-09-14T11:58:23.456158+0000","last_clean":"2024-09-14T11:58:23.456158+0000","last_became_active":"2024-09-14T10:46:52.373563+0000","last_became_peered":"2024-09-14T10:46:52.373563+0000","last_unstale":"2024-09-14T11:58:23.456158+0000","last_undegraded":"2024-09-14T11:58:23.456158+0000","last_fullsized":"2024-09-14T11:58:23.456158+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:22.900348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"263'160","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:25.446650+0000","last_change":"2024-09-14T10:46:54.389096+0000","last_active":"2024-09-14T11:58:25.446650+0000","last_peered":"2024-09-14T11:58:25.446650+0000","last_clean":"2024-09-14T11:58:25.446650+0000","last_became_active":"2024-09-14T10:46:54.388429+0000","last_became_peered":"2024-09-14T10:46:54.388429+0000","last_unstale":"2024-09-14T11:58:25.446650+0000","last_undegraded":"2024-09-14T11:58:25.446650+0000","last_fullsized":"2024-09-14T11:58:25.446650+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:38.481519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":168,"num_write":381,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"263'891","reported_seq":2650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.303380+0000","last_change":"2024-09-14T12:01:35.303380+0000","last_active":"2024-09-14T12:01:35.303380+0000","last_peered":"2024-09-14T12:01:35.303380+0000","last_clean":"2024-09-14T12:01:35.303380+0000","last_became_active":"2024-09-14T10:46:46.344022+0000","last_became_peered":"2024-09-14T10:46:46.344022+0000","last_unstale":"2024-09-14T12:01:35.303380+0000","last_undegraded":"2024-09-14T12:01:35.303380+0000","last_fullsized":"2024-09-14T12:01:35.303380+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'891","last_scrub_stamp":"2024-09-14T12:01:35.303277+0000","last_deep_scrub":"263'891","last_deep_scrub_stamp":"2024-09-14T12:01:35.303277+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.303277+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:25.632741+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4406,"num_read_kb":4005,"num_write":1167,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"263'312","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.208032+0000","last_change":"2024-09-14T12:01:28.208032+0000","last_active":"2024-09-14T12:01:28.208032+0000","last_peered":"2024-09-14T12:01:28.208032+0000","last_clean":"2024-09-14T12:01:28.208032+0000","last_became_active":"2024-09-14T10:46:44.318584+0000","last_became_peered":"2024-09-14T10:46:44.318584+0000","last_unstale":"2024-09-14T12:01:28.208032+0000","last_undegraded":"2024-09-14T12:01:28.208032+0000","last_fullsized":"2024-09-14T12:01:28.208032+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-09-14T12:01:28.207930+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-09-14T12:01:28.207930+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.207930+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:00.044887+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":581,"num_read_kb":7202,"num_write":854,"num_write_kb":20635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.042904+0000","last_change":"2024-09-14T12:01:39.042904+0000","last_active":"2024-09-14T12:01:39.042904+0000","last_peered":"2024-09-14T12:01:39.042904+0000","last_clean":"2024-09-14T12:01:39.042904+0000","last_became_active":"2024-09-14T10:46:48.355691+0000","last_became_peered":"2024-09-14T10:46:48.355691+0000","last_unstale":"2024-09-14T12:01:39.042904+0000","last_undegraded":"2024-09-14T12:01:39.042904+0000","last_fullsized":"2024-09-14T12:01:39.042904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:39.042798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:39.042798+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.042798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:39.224689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"263'341","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.293202+0000","last_change":"2024-09-14T10:46:50.363028+0000","last_active":"2024-09-14T12:01:19.293202+0000","last_peered":"2024-09-14T12:01:19.293202+0000","last_clean":"2024-09-14T12:01:19.293202+0000","last_became_active":"2024-09-14T10:46:50.362757+0000","last_became_peered":"2024-09-14T10:46:50.362757+0000","last_unstale":"2024-09-14T12:01:19.293202+0000","last_undegraded":"2024-09-14T12:01:19.293202+0000","last_fullsized":"2024-09-14T12:01:19.293202+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:26.991536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":590,"num_read_kb":1339,"num_write":526,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.030546+0000","last_change":"2024-09-14T12:01:42.030546+0000","last_active":"2024-09-14T12:01:42.030546+0000","last_peered":"2024-09-14T12:01:42.030546+0000","last_clean":"2024-09-14T12:01:42.030546+0000","last_became_active":"2024-09-14T10:46:52.373836+0000","last_became_peered":"2024-09-14T10:46:52.373836+0000","last_unstale":"2024-09-14T12:01:42.030546+0000","last_undegraded":"2024-09-14T12:01:42.030546+0000","last_fullsized":"2024-09-14T12:01:42.030546+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:42.030463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:42.030463+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.030463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:44.156503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"263'94","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:41.091887+0000","last_change":"2024-09-14T10:46:54.387376+0000","last_active":"2024-09-14T12:00:41.091887+0000","last_peered":"2024-09-14T12:00:41.091887+0000","last_clean":"2024-09-14T12:00:41.091887+0000","last_became_active":"2024-09-14T10:46:54.387066+0000","last_became_peered":"2024-09-14T10:46:54.387066+0000","last_unstale":"2024-09-14T12:00:41.091887+0000","last_undegraded":"2024-09-14T12:00:41.091887+0000","last_fullsized":"2024-09-14T12:00:41.091887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:19.903031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":95,"num_write":224,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"263'1166","reported_seq":2684,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.796789+0000","last_change":"2024-09-14T12:01:44.796789+0000","last_active":"2024-09-14T12:01:44.796789+0000","last_peered":"2024-09-14T12:01:44.796789+0000","last_clean":"2024-09-14T12:01:44.796789+0000","last_became_active":"2024-09-14T10:46:46.340228+0000","last_became_peered":"2024-09-14T10:46:46.340228+0000","last_unstale":"2024-09-14T12:01:44.796789+0000","last_undegraded":"2024-09-14T12:01:44.796789+0000","last_fullsized":"2024-09-14T12:01:44.796789+0000","mapping_epoch":28,"log_start":"263'1100","ondisk_log_start":"263'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1166","last_scrub_stamp":"2024-09-14T12:01:44.796699+0000","last_deep_scrub":"263'1166","last_deep_scrub_stamp":"2024-09-14T12:01:44.796699+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.796699+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":1100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:34.655123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5254,"num_read_kb":4633,"num_write":1618,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"263'413","reported_seq":1134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.846104+0000","last_change":"2024-09-14T12:01:31.846104+0000","last_active":"2024-09-14T12:01:31.846104+0000","last_peered":"2024-09-14T12:01:31.846104+0000","last_clean":"2024-09-14T12:01:31.846104+0000","last_became_active":"2024-09-14T10:46:44.324440+0000","last_became_peered":"2024-09-14T10:46:44.324440+0000","last_unstale":"2024-09-14T12:01:31.846104+0000","last_undegraded":"2024-09-14T12:01:31.846104+0000","last_fullsized":"2024-09-14T12:01:31.846104+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'413","last_scrub_stamp":"2024-09-14T12:01:31.845943+0000","last_deep_scrub":"263'413","last_deep_scrub_stamp":"2024-09-14T12:01:31.845943+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.845943+0000","objects_scrubbed":9,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:50.275848+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":948,"num_read_kb":1994,"num_write":1270,"num_write_kb":27495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.460346+0000","last_change":"2024-09-14T10:46:48.354236+0000","last_active":"2024-09-14T11:58:48.460346+0000","last_peered":"2024-09-14T11:58:48.460346+0000","last_clean":"2024-09-14T11:58:48.460346+0000","last_became_active":"2024-09-14T10:46:48.353513+0000","last_became_peered":"2024-09-14T10:46:48.353513+0000","last_unstale":"2024-09-14T11:58:48.460346+0000","last_undegraded":"2024-09-14T11:58:48.460346+0000","last_fullsized":"2024-09-14T11:58:48.460346+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:10.512984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"263'332","reported_seq":937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.858058+0000","last_change":"2024-09-14T10:46:50.362779+0000","last_active":"2024-09-14T12:01:18.858058+0000","last_peered":"2024-09-14T12:01:18.858058+0000","last_clean":"2024-09-14T12:01:18.858058+0000","last_became_active":"2024-09-14T10:46:50.362492+0000","last_became_peered":"2024-09-14T10:46:50.362492+0000","last_unstale":"2024-09-14T12:01:18.858058+0000","last_undegraded":"2024-09-14T12:01:18.858058+0000","last_fullsized":"2024-09-14T12:01:18.858058+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:23.999202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50533,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":553,"num_read_kb":1190,"num_write":436,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"263'787","reported_seq":4630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.985368+0000","last_change":"2024-09-14T12:01:43.985368+0000","last_active":"2024-09-14T12:01:43.985368+0000","last_peered":"2024-09-14T12:01:43.985368+0000","last_clean":"2024-09-14T12:01:43.985368+0000","last_became_active":"2024-09-14T10:46:52.374947+0000","last_became_peered":"2024-09-14T10:46:52.374947+0000","last_unstale":"2024-09-14T12:01:43.985368+0000","last_undegraded":"2024-09-14T12:01:43.985368+0000","last_fullsized":"2024-09-14T12:01:43.985368+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'787","last_scrub_stamp":"2024-09-14T12:01:43.985280+0000","last_deep_scrub":"263'787","last_deep_scrub_stamp":"2024-09-14T12:01:43.985280+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.985280+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:11.916897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"263'122","reported_seq":650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.113955+0000","last_change":"2024-09-14T10:46:54.382345+0000","last_active":"2024-09-14T11:59:32.113955+0000","last_peered":"2024-09-14T11:59:32.113955+0000","last_clean":"2024-09-14T11:59:32.113955+0000","last_became_active":"2024-09-14T10:46:54.382004+0000","last_became_peered":"2024-09-14T10:46:54.382004+0000","last_unstale":"2024-09-14T11:59:32.113955+0000","last_undegraded":"2024-09-14T11:59:32.113955+0000","last_fullsized":"2024-09-14T11:59:32.113955+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:14.712092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1268,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":189,"num_write":324,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"263'838","reported_seq":2537,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.831775+0000","last_change":"2024-09-14T12:01:35.831775+0000","last_active":"2024-09-14T12:01:35.831775+0000","last_peered":"2024-09-14T12:01:35.831775+0000","last_clean":"2024-09-14T12:01:35.831775+0000","last_became_active":"2024-09-14T10:46:46.347307+0000","last_became_peered":"2024-09-14T10:46:46.347307+0000","last_unstale":"2024-09-14T12:01:35.831775+0000","last_undegraded":"2024-09-14T12:01:35.831775+0000","last_fullsized":"2024-09-14T12:01:35.831775+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'838","last_scrub_stamp":"2024-09-14T12:01:35.831680+0000","last_deep_scrub":"263'838","last_deep_scrub_stamp":"2024-09-14T12:01:35.831680+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.831680+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:03.490519+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4222,"num_read_kb":3846,"num_write":1108,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"263'364","reported_seq":1147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.866353+0000","last_change":"2024-09-14T12:01:30.866353+0000","last_active":"2024-09-14T12:01:30.866353+0000","last_peered":"2024-09-14T12:01:30.866353+0000","last_clean":"2024-09-14T12:01:30.866353+0000","last_became_active":"2024-09-14T10:46:44.330567+0000","last_became_peered":"2024-09-14T10:46:44.330567+0000","last_unstale":"2024-09-14T12:01:30.866353+0000","last_undegraded":"2024-09-14T12:01:30.866353+0000","last_fullsized":"2024-09-14T12:01:30.866353+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'364","last_scrub_stamp":"2024-09-14T12:01:30.866244+0000","last_deep_scrub":"263'364","last_deep_scrub_stamp":"2024-09-14T12:01:30.866244+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.866244+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:50.829453+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":975,"num_read_kb":55651,"num_write":1153,"num_write_kb":35628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1471,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.686044+0000","last_change":"2024-09-14T12:01:39.686044+0000","last_active":"2024-09-14T12:01:39.686044+0000","last_peered":"2024-09-14T12:01:39.686044+0000","last_clean":"2024-09-14T12:01:39.686044+0000","last_became_active":"2024-09-14T10:46:48.355697+0000","last_became_peered":"2024-09-14T10:46:48.355697+0000","last_unstale":"2024-09-14T12:01:39.686044+0000","last_undegraded":"2024-09-14T12:01:39.686044+0000","last_fullsized":"2024-09-14T12:01:39.686044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:01:39.685939+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:01:39.685939+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.685939+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:06.999103+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"263'106","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.526629+0000","last_change":"2024-09-14T10:46:50.369569+0000","last_active":"2024-09-14T11:58:53.526629+0000","last_peered":"2024-09-14T11:58:53.526629+0000","last_clean":"2024-09-14T11:58:53.526629+0000","last_became_active":"2024-09-14T10:46:50.369337+0000","last_became_peered":"2024-09-14T10:46:50.369337+0000","last_unstale":"2024-09-14T11:58:53.526629+0000","last_undegraded":"2024-09-14T11:58:53.526629+0000","last_fullsized":"2024-09-14T11:58:53.526629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:49.461034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"263'803","reported_seq":2611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.186080+0000","last_change":"2024-09-14T10:46:52.374673+0000","last_active":"2024-09-14T12:01:19.186080+0000","last_peered":"2024-09-14T12:01:19.186080+0000","last_clean":"2024-09-14T12:01:19.186080+0000","last_became_active":"2024-09-14T10:46:52.374252+0000","last_became_peered":"2024-09-14T10:46:52.374252+0000","last_unstale":"2024-09-14T12:01:19.186080+0000","last_undegraded":"2024-09-14T12:01:19.186080+0000","last_fullsized":"2024-09-14T12:01:19.186080+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:12.425757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"263'119","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:50.989997+0000","last_change":"2024-09-14T10:46:54.386075+0000","last_active":"2024-09-14T12:00:50.989997+0000","last_peered":"2024-09-14T12:00:50.989997+0000","last_clean":"2024-09-14T12:00:50.989997+0000","last_became_active":"2024-09-14T10:46:54.384249+0000","last_became_peered":"2024-09-14T10:46:54.384249+0000","last_unstale":"2024-09-14T12:00:50.989997+0000","last_undegraded":"2024-09-14T12:00:50.989997+0000","last_fullsized":"2024-09-14T12:00:50.989997+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:21.699653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":125,"num_write":281,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"263'469","reported_seq":1950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.122323+0000","last_change":"2024-09-14T12:01:31.122323+0000","last_active":"2024-09-14T12:01:31.122323+0000","last_peered":"2024-09-14T12:01:31.122323+0000","last_clean":"2024-09-14T12:01:31.122323+0000","last_became_active":"2024-09-14T10:46:46.342466+0000","last_became_peered":"2024-09-14T10:46:46.342466+0000","last_unstale":"2024-09-14T12:01:31.122323+0000","last_undegraded":"2024-09-14T12:01:31.122323+0000","last_fullsized":"2024-09-14T12:01:31.122323+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'469","last_scrub_stamp":"2024-09-14T12:01:31.122238+0000","last_deep_scrub":"263'469","last_deep_scrub_stamp":"2024-09-14T12:01:31.122238+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.122238+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:49.197184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2422,"num_read_kb":2241,"num_write":583,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"263'288","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.710818+0000","last_change":"2024-09-14T12:01:30.710818+0000","last_active":"2024-09-14T12:01:30.710818+0000","last_peered":"2024-09-14T12:01:30.710818+0000","last_clean":"2024-09-14T12:01:30.710818+0000","last_became_active":"2024-09-14T10:46:44.329014+0000","last_became_peered":"2024-09-14T10:46:44.329014+0000","last_unstale":"2024-09-14T12:01:30.710818+0000","last_undegraded":"2024-09-14T12:01:30.710818+0000","last_fullsized":"2024-09-14T12:01:30.710818+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'288","last_scrub_stamp":"2024-09-14T12:01:30.710716+0000","last_deep_scrub":"263'288","last_deep_scrub_stamp":"2024-09-14T12:01:30.710716+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.710716+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:53.203004+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":506,"num_read_kb":30778,"num_write":881,"num_write_kb":14950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.533075+0000","last_change":"2024-09-14T10:46:48.358952+0000","last_active":"2024-09-14T11:58:50.533075+0000","last_peered":"2024-09-14T11:58:50.533075+0000","last_clean":"2024-09-14T11:58:50.533075+0000","last_became_active":"2024-09-14T10:46:48.358586+0000","last_became_peered":"2024-09-14T10:46:48.358586+0000","last_unstale":"2024-09-14T11:58:50.533075+0000","last_undegraded":"2024-09-14T11:58:50.533075+0000","last_fullsized":"2024-09-14T11:58:50.533075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:11.753221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"263'377","reported_seq":1006,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.075637+0000","last_change":"2024-09-14T10:46:50.367245+0000","last_active":"2024-09-14T12:01:18.075637+0000","last_peered":"2024-09-14T12:01:18.075637+0000","last_clean":"2024-09-14T12:01:18.075637+0000","last_became_active":"2024-09-14T10:46:50.365715+0000","last_became_peered":"2024-09-14T10:46:50.365715+0000","last_unstale":"2024-09-14T12:01:18.075637+0000","last_undegraded":"2024-09-14T12:01:18.075637+0000","last_fullsized":"2024-09-14T12:01:18.075637+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:16.793655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45582,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":610,"num_read_kb":1238,"num_write":470,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.306951+0000","last_change":"2024-09-14T10:46:52.370062+0000","last_active":"2024-09-14T11:58:55.306951+0000","last_peered":"2024-09-14T11:58:55.306951+0000","last_clean":"2024-09-14T11:58:55.306951+0000","last_became_active":"2024-09-14T10:46:52.369746+0000","last_became_peered":"2024-09-14T10:46:52.369746+0000","last_unstale":"2024-09-14T11:58:55.306951+0000","last_undegraded":"2024-09-14T11:58:55.306951+0000","last_fullsized":"2024-09-14T11:58:55.306951+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:38.246502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"263'156","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.673531+0000","last_change":"2024-09-14T10:46:54.384418+0000","last_active":"2024-09-14T11:59:32.673531+0000","last_peered":"2024-09-14T11:59:32.673531+0000","last_clean":"2024-09-14T11:59:32.673531+0000","last_became_active":"2024-09-14T10:46:54.384119+0000","last_became_peered":"2024-09-14T10:46:54.384119+0000","last_unstale":"2024-09-14T11:59:32.673531+0000","last_undegraded":"2024-09-14T11:59:32.673531+0000","last_fullsized":"2024-09-14T11:59:32.673531+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:04.224188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":393,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"263'777","reported_seq":2213,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.693092+0000","last_change":"2024-09-14T12:01:40.693092+0000","last_active":"2024-09-14T12:01:40.693092+0000","last_peered":"2024-09-14T12:01:40.693092+0000","last_clean":"2024-09-14T12:01:40.693092+0000","last_became_active":"2024-09-14T10:46:46.334444+0000","last_became_peered":"2024-09-14T10:46:46.334444+0000","last_unstale":"2024-09-14T12:01:40.693092+0000","last_undegraded":"2024-09-14T12:01:40.693092+0000","last_fullsized":"2024-09-14T12:01:40.693092+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'777","last_scrub_stamp":"2024-09-14T12:01:40.692994+0000","last_deep_scrub":"263'777","last_deep_scrub_stamp":"2024-09-14T12:01:40.692994+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.692994+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:37.634741+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3619,"num_read_kb":3234,"num_write":1038,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:24.785694+0000","last_change":"2024-09-14T12:01:24.785694+0000","last_active":"2024-09-14T12:01:24.785694+0000","last_peered":"2024-09-14T12:01:24.785694+0000","last_clean":"2024-09-14T12:01:24.785694+0000","last_became_active":"2024-09-14T10:46:26.241454+0000","last_became_peered":"2024-09-14T10:46:26.241454+0000","last_unstale":"2024-09-14T12:01:24.785694+0000","last_undegraded":"2024-09-14T12:01:24.785694+0000","last_fullsized":"2024-09-14T12:01:24.785694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-14T12:01:24.785613+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-14T12:01:24.785613+0000","last_clean_scrub_stamp":"2024-09-14T12:01:24.785613+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:57.745824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":544,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.977324+0000","last_change":"2024-09-14T12:01:26.977273+0000","last_active":"2024-09-14T12:01:26.977324+0000","last_peered":"2024-09-14T12:01:26.977324+0000","last_clean":"2024-09-14T12:01:26.977324+0000","last_became_active":"2024-09-14T10:46:33.413305+0000","last_became_peered":"2024-09-14T10:46:33.413305+0000","last_unstale":"2024-09-14T12:01:26.977324+0000","last_undegraded":"2024-09-14T12:01:26.977324+0000","last_fullsized":"2024-09-14T12:01:26.977324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:01:26.977205+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:01:26.977205+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.977205+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:08.220234+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00092058099999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"263'313","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.725727+0000","last_change":"2024-09-14T12:01:26.725664+0000","last_active":"2024-09-14T12:01:26.725727+0000","last_peered":"2024-09-14T12:01:26.725727+0000","last_clean":"2024-09-14T12:01:26.725727+0000","last_became_active":"2024-09-14T10:46:44.329050+0000","last_became_peered":"2024-09-14T10:46:44.329050+0000","last_unstale":"2024-09-14T12:01:26.725727+0000","last_undegraded":"2024-09-14T12:01:26.725727+0000","last_fullsized":"2024-09-14T12:01:26.725727+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'313","last_scrub_stamp":"2024-09-14T12:01:26.725523+0000","last_deep_scrub":"263'313","last_deep_scrub_stamp":"2024-09-14T12:01:26.725523+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.725523+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:00.339260+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":32601,"num_write":1066,"num_write_kb":17351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"263'6","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.189983+0000","last_change":"2024-09-14T12:01:42.189983+0000","last_active":"2024-09-14T12:01:42.189983+0000","last_peered":"2024-09-14T12:01:42.189983+0000","last_clean":"2024-09-14T12:01:42.189983+0000","last_became_active":"2024-09-14T10:46:48.353319+0000","last_became_peered":"2024-09-14T10:46:48.353319+0000","last_unstale":"2024-09-14T12:01:42.189983+0000","last_undegraded":"2024-09-14T12:01:42.189983+0000","last_fullsized":"2024-09-14T12:01:42.189983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:01:42.189893+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:01:42.189893+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.189893+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:11.020543+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"263'795","reported_seq":1515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.746391+0000","last_change":"2024-09-14T10:46:50.363357+0000","last_active":"2024-09-14T12:01:18.746391+0000","last_peered":"2024-09-14T12:01:18.746391+0000","last_clean":"2024-09-14T12:01:18.746391+0000","last_became_active":"2024-09-14T10:46:50.362908+0000","last_became_peered":"2024-09-14T10:46:50.362908+0000","last_unstale":"2024-09-14T12:01:18.746391+0000","last_undegraded":"2024-09-14T12:01:18.746391+0000","last_fullsized":"2024-09-14T12:01:18.746391+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:43.112130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143024,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1563,"num_read_kb":3671,"num_write":1508,"num_write_kb":1333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:23.456299+0000","last_change":"2024-09-14T10:46:52.371975+0000","last_active":"2024-09-14T11:58:23.456299+0000","last_peered":"2024-09-14T11:58:23.456299+0000","last_clean":"2024-09-14T11:58:23.456299+0000","last_became_active":"2024-09-14T10:46:52.371684+0000","last_became_peered":"2024-09-14T10:46:52.371684+0000","last_unstale":"2024-09-14T11:58:23.456299+0000","last_undegraded":"2024-09-14T11:58:23.456299+0000","last_fullsized":"2024-09-14T11:58:23.456299+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:40.156605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"263'205","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.737078+0000","last_change":"2024-09-14T10:46:54.382314+0000","last_active":"2024-09-14T11:59:34.737078+0000","last_peered":"2024-09-14T11:59:34.737078+0000","last_clean":"2024-09-14T11:59:34.737078+0000","last_became_active":"2024-09-14T10:46:54.382019+0000","last_became_peered":"2024-09-14T10:46:54.382019+0000","last_unstale":"2024-09-14T11:59:34.737078+0000","last_undegraded":"2024-09-14T11:59:34.737078+0000","last_fullsized":"2024-09-14T11:59:34.737078+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:50.945970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":483,"num_read_kb":466,"num_write":435,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"263'817","reported_seq":2429,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.241075+0000","last_change":"2024-09-14T12:01:40.241075+0000","last_active":"2024-09-14T12:01:40.241075+0000","last_peered":"2024-09-14T12:01:40.241075+0000","last_clean":"2024-09-14T12:01:40.241075+0000","last_became_active":"2024-09-14T10:46:46.345302+0000","last_became_peered":"2024-09-14T10:46:46.345302+0000","last_unstale":"2024-09-14T12:01:40.241075+0000","last_undegraded":"2024-09-14T12:01:40.241075+0000","last_fullsized":"2024-09-14T12:01:40.241075+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'817","last_scrub_stamp":"2024-09-14T12:01:40.240992+0000","last_deep_scrub":"263'817","last_deep_scrub_stamp":"2024-09-14T12:01:40.240992+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.240992+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:38.435554+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3876,"num_read_kb":3495,"num_write":1050,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":543,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.885777+0000","last_change":"2024-09-14T12:01:29.885777+0000","last_active":"2024-09-14T12:01:29.885777+0000","last_peered":"2024-09-14T12:01:29.885777+0000","last_clean":"2024-09-14T12:01:29.885777+0000","last_became_active":"2024-09-14T10:46:33.265619+0000","last_became_peered":"2024-09-14T10:46:33.265619+0000","last_unstale":"2024-09-14T12:01:29.885777+0000","last_undegraded":"2024-09-14T12:01:29.885777+0000","last_fullsized":"2024-09-14T12:01:29.885777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:29.885692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:29.885692+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.885692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:24.477677+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00058478399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"263'340","reported_seq":1196,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.870978+0000","last_change":"2024-09-14T12:01:26.870978+0000","last_active":"2024-09-14T12:01:26.870978+0000","last_peered":"2024-09-14T12:01:26.870978+0000","last_clean":"2024-09-14T12:01:26.870978+0000","last_became_active":"2024-09-14T10:46:44.320087+0000","last_became_peered":"2024-09-14T10:46:44.320087+0000","last_unstale":"2024-09-14T12:01:26.870978+0000","last_undegraded":"2024-09-14T12:01:26.870978+0000","last_fullsized":"2024-09-14T12:01:26.870978+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-14T12:01:26.870853+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-14T12:01:26.870853+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.870853+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:41.798493+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1201,"num_read_kb":9242,"num_write":1119,"num_write_kb":25141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:20.529481+0000","last_change":"2024-09-14T10:46:48.350940+0000","last_active":"2024-09-14T11:58:20.529481+0000","last_peered":"2024-09-14T11:58:20.529481+0000","last_clean":"2024-09-14T11:58:20.529481+0000","last_became_active":"2024-09-14T10:46:48.350653+0000","last_became_peered":"2024-09-14T10:46:48.350653+0000","last_unstale":"2024-09-14T11:58:20.529481+0000","last_undegraded":"2024-09-14T11:58:20.529481+0000","last_fullsized":"2024-09-14T11:58:20.529481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:11.993887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"263'1402","reported_seq":3251,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.028181+0000","last_change":"2024-09-14T12:01:43.028181+0000","last_active":"2024-09-14T12:01:43.028181+0000","last_peered":"2024-09-14T12:01:43.028181+0000","last_clean":"2024-09-14T12:01:43.028181+0000","last_became_active":"2024-09-14T10:46:50.362128+0000","last_became_peered":"2024-09-14T10:46:50.362128+0000","last_unstale":"2024-09-14T12:01:43.028181+0000","last_undegraded":"2024-09-14T12:01:43.028181+0000","last_fullsized":"2024-09-14T12:01:43.028181+0000","mapping_epoch":32,"log_start":"263'1300","ondisk_log_start":"263'1300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1402","last_scrub_stamp":"2024-09-14T12:01:43.028081+0000","last_deep_scrub":"263'1402","last_deep_scrub_stamp":"2024-09-14T12:01:43.028081+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.028081+0000","objects_scrubbed":11,"log_size":102,"log_dups_size":1300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:19.538730+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160652,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2189,"num_read_kb":4301,"num_write":1286,"num_write_kb":1103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.525954+0000","last_change":"2024-09-14T10:46:52.375637+0000","last_active":"2024-09-14T11:57:50.525954+0000","last_peered":"2024-09-14T11:57:50.525954+0000","last_clean":"2024-09-14T11:57:50.525954+0000","last_became_active":"2024-09-14T10:46:52.375344+0000","last_became_peered":"2024-09-14T10:46:52.375344+0000","last_unstale":"2024-09-14T11:57:50.525954+0000","last_undegraded":"2024-09-14T11:57:50.525954+0000","last_fullsized":"2024-09-14T11:57:50.525954+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:28.073066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"263'95","reported_seq":596,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.585158+0000","last_change":"2024-09-14T10:46:54.384671+0000","last_active":"2024-09-14T11:59:33.585158+0000","last_peered":"2024-09-14T11:59:33.585158+0000","last_clean":"2024-09-14T11:59:33.585158+0000","last_became_active":"2024-09-14T10:46:54.384354+0000","last_became_peered":"2024-09-14T10:46:54.384354+0000","last_unstale":"2024-09-14T11:59:33.585158+0000","last_undegraded":"2024-09-14T11:59:33.585158+0000","last_fullsized":"2024-09-14T11:59:33.585158+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:42.323130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":95,"num_write":225,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"263'544","reported_seq":2146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.765468+0000","last_change":"2024-09-14T12:01:36.765468+0000","last_active":"2024-09-14T12:01:36.765468+0000","last_peered":"2024-09-14T12:01:36.765468+0000","last_clean":"2024-09-14T12:01:36.765468+0000","last_became_active":"2024-09-14T10:46:46.345234+0000","last_became_peered":"2024-09-14T10:46:46.345234+0000","last_unstale":"2024-09-14T12:01:36.765468+0000","last_undegraded":"2024-09-14T12:01:36.765468+0000","last_fullsized":"2024-09-14T12:01:36.765468+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'544","last_scrub_stamp":"2024-09-14T12:01:36.765372+0000","last_deep_scrub":"263'544","last_deep_scrub_stamp":"2024-09-14T12:01:36.765372+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.765372+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:30.549759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2916,"num_read_kb":2703,"num_write":726,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.209890+0000","last_change":"2024-09-14T12:01:27.209807+0000","last_active":"2024-09-14T12:01:27.209890+0000","last_peered":"2024-09-14T12:01:27.209890+0000","last_clean":"2024-09-14T12:01:27.209890+0000","last_became_active":"2024-09-14T10:46:33.265185+0000","last_became_peered":"2024-09-14T10:46:33.265185+0000","last_unstale":"2024-09-14T12:01:27.209890+0000","last_undegraded":"2024-09-14T12:01:27.209890+0000","last_fullsized":"2024-09-14T12:01:27.209890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:27.209695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:27.209695+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.209695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:02.705899+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000550246,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"263'312","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.345266+0000","last_change":"2024-09-14T12:01:27.345266+0000","last_active":"2024-09-14T12:01:27.345266+0000","last_peered":"2024-09-14T12:01:27.345266+0000","last_clean":"2024-09-14T12:01:27.345266+0000","last_became_active":"2024-09-14T10:46:44.327101+0000","last_became_peered":"2024-09-14T10:46:44.327101+0000","last_unstale":"2024-09-14T12:01:27.345266+0000","last_undegraded":"2024-09-14T12:01:27.345266+0000","last_fullsized":"2024-09-14T12:01:27.345266+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-09-14T12:01:27.345068+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-09-14T12:01:27.345068+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.345068+0000","objects_scrubbed":8,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:53.686484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":609,"num_read_kb":99380,"num_write":1036,"num_write_kb":24751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.052202+0000","last_change":"2024-09-14T12:01:37.052202+0000","last_active":"2024-09-14T12:01:37.052202+0000","last_peered":"2024-09-14T12:01:37.052202+0000","last_clean":"2024-09-14T12:01:37.052202+0000","last_became_active":"2024-09-14T10:46:48.353803+0000","last_became_peered":"2024-09-14T10:46:48.353803+0000","last_unstale":"2024-09-14T12:01:37.052202+0000","last_undegraded":"2024-09-14T12:01:37.052202+0000","last_fullsized":"2024-09-14T12:01:37.052202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:01:37.052124+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:01:37.052124+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.052124+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:29.304883+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"263'312","reported_seq":1769,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.207034+0000","last_change":"2024-09-14T12:01:44.207034+0000","last_active":"2024-09-14T12:01:44.207034+0000","last_peered":"2024-09-14T12:01:44.207034+0000","last_clean":"2024-09-14T12:01:44.207034+0000","last_became_active":"2024-09-14T10:46:50.364857+0000","last_became_peered":"2024-09-14T10:46:50.364857+0000","last_unstale":"2024-09-14T12:01:44.207034+0000","last_undegraded":"2024-09-14T12:01:44.207034+0000","last_fullsized":"2024-09-14T12:01:44.207034+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-09-14T12:01:44.206926+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-09-14T12:01:44.206926+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.206926+0000","objects_scrubbed":9,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:11.199275+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":263,"num_read_kb":255,"num_write":243,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:45.640374+0000","last_change":"2024-09-14T10:46:52.367740+0000","last_active":"2024-09-14T11:57:45.640374+0000","last_peered":"2024-09-14T11:57:45.640374+0000","last_clean":"2024-09-14T11:57:45.640374+0000","last_became_active":"2024-09-14T10:46:52.365738+0000","last_became_peered":"2024-09-14T10:46:52.365738+0000","last_unstale":"2024-09-14T11:57:45.640374+0000","last_undegraded":"2024-09-14T11:57:45.640374+0000","last_fullsized":"2024-09-14T11:57:45.640374+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:55.844741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"263'261","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.991420+0000","last_change":"2024-09-14T10:46:54.379215+0000","last_active":"2024-09-14T11:59:34.991420+0000","last_peered":"2024-09-14T11:59:34.991420+0000","last_clean":"2024-09-14T11:59:34.991420+0000","last_became_active":"2024-09-14T10:46:54.378930+0000","last_became_peered":"2024-09-14T10:46:54.378930+0000","last_unstale":"2024-09-14T11:59:34.991420+0000","last_undegraded":"2024-09-14T11:59:34.991420+0000","last_fullsized":"2024-09-14T11:59:34.991420+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:20.494987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":478,"num_read_kb":502,"num_write":559,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"263'793","reported_seq":2367,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.802934+0000","last_change":"2024-09-14T12:01:37.802934+0000","last_active":"2024-09-14T12:01:37.802934+0000","last_peered":"2024-09-14T12:01:37.802934+0000","last_clean":"2024-09-14T12:01:37.802934+0000","last_became_active":"2024-09-14T10:46:46.334679+0000","last_became_peered":"2024-09-14T10:46:46.334679+0000","last_unstale":"2024-09-14T12:01:37.802934+0000","last_undegraded":"2024-09-14T12:01:37.802934+0000","last_fullsized":"2024-09-14T12:01:37.802934+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'793","last_scrub_stamp":"2024-09-14T12:01:37.802836+0000","last_deep_scrub":"263'793","last_deep_scrub_stamp":"2024-09-14T12:01:37.802836+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.802836+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:55.618222+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3681,"num_read_kb":3336,"num_write":1001,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":545,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.019260+0000","last_change":"2024-09-14T12:01:26.019205+0000","last_active":"2024-09-14T12:01:26.019260+0000","last_peered":"2024-09-14T12:01:26.019260+0000","last_clean":"2024-09-14T12:01:26.019260+0000","last_became_active":"2024-09-14T10:46:33.296172+0000","last_became_peered":"2024-09-14T10:46:33.296172+0000","last_unstale":"2024-09-14T12:01:26.019260+0000","last_undegraded":"2024-09-14T12:01:26.019260+0000","last_fullsized":"2024-09-14T12:01:26.019260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:01:26.019146+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:01:26.019146+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.019146+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:35.727762+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00125464,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"263'339","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:25.269255+0000","last_change":"2024-09-14T12:01:25.269159+0000","last_active":"2024-09-14T12:01:25.269255+0000","last_peered":"2024-09-14T12:01:25.269255+0000","last_clean":"2024-09-14T12:01:25.269255+0000","last_became_active":"2024-09-14T10:46:44.323974+0000","last_became_peered":"2024-09-14T10:46:44.323974+0000","last_unstale":"2024-09-14T12:01:25.269255+0000","last_undegraded":"2024-09-14T12:01:25.269255+0000","last_fullsized":"2024-09-14T12:01:25.269255+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-14T12:01:25.269042+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-14T12:01:25.269042+0000","last_clean_scrub_stamp":"2024-09-14T12:01:25.269042+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:28.484276+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":608,"num_read_kb":7380,"num_write":1200,"num_write_kb":32204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.995958+0000","last_change":"2024-09-14T12:01:40.995958+0000","last_active":"2024-09-14T12:01:40.995958+0000","last_peered":"2024-09-14T12:01:40.995958+0000","last_clean":"2024-09-14T12:01:40.995958+0000","last_became_active":"2024-09-14T10:46:48.354786+0000","last_became_peered":"2024-09-14T10:46:48.354786+0000","last_unstale":"2024-09-14T12:01:40.995958+0000","last_undegraded":"2024-09-14T12:01:40.995958+0000","last_fullsized":"2024-09-14T12:01:40.995958+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:40.995844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:40.995844+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.995844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:43.561954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"263'154","reported_seq":714,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:33.477130+0000","last_change":"2024-09-14T10:46:50.363852+0000","last_active":"2024-09-14T12:00:33.477130+0000","last_peered":"2024-09-14T12:00:33.477130+0000","last_clean":"2024-09-14T12:00:33.477130+0000","last_became_active":"2024-09-14T10:46:50.363538+0000","last_became_peered":"2024-09-14T10:46:50.363538+0000","last_unstale":"2024-09-14T12:00:33.477130+0000","last_undegraded":"2024-09-14T12:00:33.477130+0000","last_fullsized":"2024-09-14T12:00:33.477130+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:41.224986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":198,"num_read_kb":192,"num_write":144,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:25.530066+0000","last_change":"2024-09-14T10:46:52.371280+0000","last_active":"2024-09-14T11:58:25.530066+0000","last_peered":"2024-09-14T11:58:25.530066+0000","last_clean":"2024-09-14T11:58:25.530066+0000","last_became_active":"2024-09-14T10:46:52.370968+0000","last_became_peered":"2024-09-14T10:46:52.370968+0000","last_unstale":"2024-09-14T11:58:25.530066+0000","last_undegraded":"2024-09-14T11:58:25.530066+0000","last_fullsized":"2024-09-14T11:58:25.530066+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:12.904159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"263'119","reported_seq":669,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.337447+0000","last_change":"2024-09-14T10:46:54.389298+0000","last_active":"2024-09-14T11:58:44.337447+0000","last_peered":"2024-09-14T11:58:44.337447+0000","last_clean":"2024-09-14T11:58:44.337447+0000","last_became_active":"2024-09-14T10:46:54.388938+0000","last_became_peered":"2024-09-14T10:46:54.388938+0000","last_unstale":"2024-09-14T11:58:44.337447+0000","last_undegraded":"2024-09-14T11:58:44.337447+0000","last_fullsized":"2024-09-14T11:58:44.337447+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:20.842708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":281,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"263'403","reported_seq":1974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.717482+0000","last_change":"2024-09-14T12:01:35.717482+0000","last_active":"2024-09-14T12:01:35.717482+0000","last_peered":"2024-09-14T12:01:35.717482+0000","last_clean":"2024-09-14T12:01:35.717482+0000","last_became_active":"2024-09-14T10:46:46.335681+0000","last_became_peered":"2024-09-14T10:46:46.335681+0000","last_unstale":"2024-09-14T12:01:35.717482+0000","last_undegraded":"2024-09-14T12:01:35.717482+0000","last_fullsized":"2024-09-14T12:01:35.717482+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'403","last_scrub_stamp":"2024-09-14T12:01:35.717399+0000","last_deep_scrub":"263'403","last_deep_scrub_stamp":"2024-09-14T12:01:35.717399+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.717399+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:32.914757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2240,"num_read_kb":2136,"num_write":448,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"263'321","reported_seq":1010,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:24.914780+0000","last_change":"2024-09-14T12:01:24.914780+0000","last_active":"2024-09-14T12:01:24.914780+0000","last_peered":"2024-09-14T12:01:24.914780+0000","last_clean":"2024-09-14T12:01:24.914780+0000","last_became_active":"2024-09-14T10:46:44.319714+0000","last_became_peered":"2024-09-14T10:46:44.319714+0000","last_unstale":"2024-09-14T12:01:24.914780+0000","last_undegraded":"2024-09-14T12:01:24.914780+0000","last_fullsized":"2024-09-14T12:01:24.914780+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'321","last_scrub_stamp":"2024-09-14T12:01:24.914659+0000","last_deep_scrub":"263'321","last_deep_scrub_stamp":"2024-09-14T12:01:24.914659+0000","last_clean_scrub_stamp":"2024-09-14T12:01:24.914659+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:48.960207+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":599,"num_read_kb":77773,"num_write":1050,"num_write_kb":36142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":537,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.360671+0000","last_change":"2024-09-14T12:01:26.360594+0000","last_active":"2024-09-14T12:01:26.360671+0000","last_peered":"2024-09-14T12:01:26.360671+0000","last_clean":"2024-09-14T12:01:26.360671+0000","last_became_active":"2024-09-14T10:46:33.296049+0000","last_became_peered":"2024-09-14T10:46:33.296049+0000","last_unstale":"2024-09-14T12:01:26.360671+0000","last_undegraded":"2024-09-14T12:01:26.360671+0000","last_fullsized":"2024-09-14T12:01:26.360671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:26.360503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:26.360503+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.360503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:22.237563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000560203,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.560422+0000","last_change":"2024-09-14T12:01:45.560422+0000","last_active":"2024-09-14T12:01:45.560422+0000","last_peered":"2024-09-14T12:01:45.560422+0000","last_clean":"2024-09-14T12:01:45.560422+0000","last_became_active":"2024-09-14T10:46:48.350088+0000","last_became_peered":"2024-09-14T10:46:48.350088+0000","last_unstale":"2024-09-14T12:01:45.560422+0000","last_undegraded":"2024-09-14T12:01:45.560422+0000","last_fullsized":"2024-09-14T12:01:45.560422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:45.560303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:45.560303+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.560303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:17.490367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"263'642","reported_seq":1335,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.053809+0000","last_change":"2024-09-14T12:01:38.053809+0000","last_active":"2024-09-14T12:01:38.053809+0000","last_peered":"2024-09-14T12:01:38.053809+0000","last_clean":"2024-09-14T12:01:38.053809+0000","last_became_active":"2024-09-14T10:46:50.363387+0000","last_became_peered":"2024-09-14T10:46:50.363387+0000","last_unstale":"2024-09-14T12:01:38.053809+0000","last_undegraded":"2024-09-14T12:01:38.053809+0000","last_fullsized":"2024-09-14T12:01:38.053809+0000","mapping_epoch":32,"log_start":"263'600","ondisk_log_start":"263'600","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'642","last_scrub_stamp":"2024-09-14T12:01:38.053687+0000","last_deep_scrub":"263'642","last_deep_scrub_stamp":"2024-09-14T12:01:38.053687+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.053687+0000","objects_scrubbed":9,"log_size":42,"log_dups_size":600,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:59.160442+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95765,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1702,"num_read_kb":2954,"num_write":2224,"num_write_kb":2032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":529556,"num_omap_keys":1194,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.851613+0000","last_change":"2024-09-14T12:01:44.851613+0000","last_active":"2024-09-14T12:01:44.851613+0000","last_peered":"2024-09-14T12:01:44.851613+0000","last_clean":"2024-09-14T12:01:44.851613+0000","last_became_active":"2024-09-14T10:46:52.373837+0000","last_became_peered":"2024-09-14T10:46:52.373837+0000","last_unstale":"2024-09-14T12:01:44.851613+0000","last_undegraded":"2024-09-14T12:01:44.851613+0000","last_fullsized":"2024-09-14T12:01:44.851613+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:44.851435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:44.851435+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.851435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:32.096919+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"263'152","reported_seq":660,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.008979+0000","last_change":"2024-09-14T10:46:54.386107+0000","last_active":"2024-09-14T11:59:31.008979+0000","last_peered":"2024-09-14T11:59:31.008979+0000","last_clean":"2024-09-14T11:59:31.008979+0000","last_became_active":"2024-09-14T10:46:54.385835+0000","last_became_peered":"2024-09-14T10:46:54.385835+0000","last_unstale":"2024-09-14T11:59:31.008979+0000","last_undegraded":"2024-09-14T11:59:31.008979+0000","last_fullsized":"2024-09-14T11:59:31.008979+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:18.649909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":168,"num_read_kb":158,"num_write":389,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"263'836","reported_seq":2487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.821888+0000","last_change":"2024-09-14T12:01:38.821888+0000","last_active":"2024-09-14T12:01:38.821888+0000","last_peered":"2024-09-14T12:01:38.821888+0000","last_clean":"2024-09-14T12:01:38.821888+0000","last_became_active":"2024-09-14T10:46:46.346072+0000","last_became_peered":"2024-09-14T10:46:46.346072+0000","last_unstale":"2024-09-14T12:01:38.821888+0000","last_undegraded":"2024-09-14T12:01:38.821888+0000","last_fullsized":"2024-09-14T12:01:38.821888+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'836","last_scrub_stamp":"2024-09-14T12:01:38.821790+0000","last_deep_scrub":"263'836","last_deep_scrub_stamp":"2024-09-14T12:01:38.821790+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.821790+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:43.972793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4027,"num_read_kb":3636,"num_write":1084,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":476,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"263'385","reported_seq":1057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.833891+0000","last_change":"2024-09-14T12:01:28.833891+0000","last_active":"2024-09-14T12:01:28.833891+0000","last_peered":"2024-09-14T12:01:28.833891+0000","last_clean":"2024-09-14T12:01:28.833891+0000","last_became_active":"2024-09-14T10:46:44.317702+0000","last_became_peered":"2024-09-14T10:46:44.317702+0000","last_unstale":"2024-09-14T12:01:28.833891+0000","last_undegraded":"2024-09-14T12:01:28.833891+0000","last_fullsized":"2024-09-14T12:01:28.833891+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'385","last_scrub_stamp":"2024-09-14T12:01:28.833720+0000","last_deep_scrub":"263'385","last_deep_scrub_stamp":"2024-09-14T12:01:28.833720+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.833720+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:27.096840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":660,"num_read_kb":57005,"num_write":1181,"num_write_kb":30753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":542,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.935330+0000","last_change":"2024-09-14T12:01:27.935287+0000","last_active":"2024-09-14T12:01:27.935330+0000","last_peered":"2024-09-14T12:01:27.935330+0000","last_clean":"2024-09-14T12:01:27.935330+0000","last_became_active":"2024-09-14T10:46:33.265512+0000","last_became_peered":"2024-09-14T10:46:33.265512+0000","last_unstale":"2024-09-14T12:01:27.935330+0000","last_undegraded":"2024-09-14T12:01:27.935330+0000","last_fullsized":"2024-09-14T12:01:27.935330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:27.935219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:27.935219+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.935219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:28.603222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088449000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.260849+0000","last_change":"2024-09-14T12:01:40.260849+0000","last_active":"2024-09-14T12:01:40.260849+0000","last_peered":"2024-09-14T12:01:40.260849+0000","last_clean":"2024-09-14T12:01:40.260849+0000","last_became_active":"2024-09-14T10:46:48.353394+0000","last_became_peered":"2024-09-14T10:46:48.353394+0000","last_unstale":"2024-09-14T12:01:40.260849+0000","last_undegraded":"2024-09-14T12:01:40.260849+0000","last_fullsized":"2024-09-14T12:01:40.260849+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:40.260753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:40.260753+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.260753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:08.593537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"263'261","reported_seq":847,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.134914+0000","last_change":"2024-09-14T10:46:50.363699+0000","last_active":"2024-09-14T11:59:33.134914+0000","last_peered":"2024-09-14T11:59:33.134914+0000","last_clean":"2024-09-14T11:59:33.134914+0000","last_became_active":"2024-09-14T10:46:50.363436+0000","last_became_peered":"2024-09-14T10:46:50.363436+0000","last_unstale":"2024-09-14T11:59:33.134914+0000","last_undegraded":"2024-09-14T11:59:33.134914+0000","last_fullsized":"2024-09-14T11:59:33.134914+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:29.116427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":321,"num_read_kb":313,"num_write":296,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"263'803","reported_seq":2970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.187710+0000","last_change":"2024-09-14T10:46:52.373730+0000","last_active":"2024-09-14T12:01:19.187710+0000","last_peered":"2024-09-14T12:01:19.187710+0000","last_clean":"2024-09-14T12:01:19.187710+0000","last_became_active":"2024-09-14T10:46:52.373068+0000","last_became_peered":"2024-09-14T10:46:52.373068+0000","last_unstale":"2024-09-14T12:01:19.187710+0000","last_undegraded":"2024-09-14T12:01:19.187710+0000","last_fullsized":"2024-09-14T12:01:19.187710+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:46.138887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"263'136","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:52.312770+0000","last_change":"2024-09-14T10:46:54.388712+0000","last_active":"2024-09-14T12:00:52.312770+0000","last_peered":"2024-09-14T12:00:52.312770+0000","last_clean":"2024-09-14T12:00:52.312770+0000","last_became_active":"2024-09-14T10:46:54.387317+0000","last_became_peered":"2024-09-14T10:46:54.387317+0000","last_unstale":"2024-09-14T12:00:52.312770+0000","last_undegraded":"2024-09-14T12:00:52.312770+0000","last_fullsized":"2024-09-14T12:00:52.312770+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:03.151982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":117,"num_write":309,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"263'1368","reported_seq":3064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.720570+0000","last_change":"2024-09-14T12:01:34.720570+0000","last_active":"2024-09-14T12:01:34.720570+0000","last_peered":"2024-09-14T12:01:34.720570+0000","last_clean":"2024-09-14T12:01:34.720570+0000","last_became_active":"2024-09-14T10:46:46.344799+0000","last_became_peered":"2024-09-14T10:46:46.344799+0000","last_unstale":"2024-09-14T12:01:34.720570+0000","last_undegraded":"2024-09-14T12:01:34.720570+0000","last_fullsized":"2024-09-14T12:01:34.720570+0000","mapping_epoch":28,"log_start":"263'1300","ondisk_log_start":"263'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1368","last_scrub_stamp":"2024-09-14T12:01:34.720456+0000","last_deep_scrub":"263'1368","last_deep_scrub_stamp":"2024-09-14T12:01:34.720456+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.720456+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":1300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:58.415618+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6397,"num_read_kb":5617,"num_write":2035,"num_write_kb":974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"263'403","reported_seq":1219,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.693900+0000","last_change":"2024-09-14T12:01:29.693900+0000","last_active":"2024-09-14T12:01:29.693900+0000","last_peered":"2024-09-14T12:01:29.693900+0000","last_clean":"2024-09-14T12:01:29.693900+0000","last_became_active":"2024-09-14T10:46:44.324158+0000","last_became_peered":"2024-09-14T10:46:44.324158+0000","last_unstale":"2024-09-14T12:01:29.693900+0000","last_undegraded":"2024-09-14T12:01:29.693900+0000","last_fullsized":"2024-09-14T12:01:29.693900+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'403","last_scrub_stamp":"2024-09-14T12:01:29.693790+0000","last_deep_scrub":"263'403","last_deep_scrub_stamp":"2024-09-14T12:01:29.693790+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.693790+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:00.163688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":514873,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1028,"num_read_kb":45406,"num_write":1187,"num_write_kb":52499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":539,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.691638+0000","last_change":"2024-09-14T12:01:27.691638+0000","last_active":"2024-09-14T12:01:27.691638+0000","last_peered":"2024-09-14T12:01:27.691638+0000","last_clean":"2024-09-14T12:01:27.691638+0000","last_became_active":"2024-09-14T10:46:33.262218+0000","last_became_peered":"2024-09-14T10:46:33.262218+0000","last_unstale":"2024-09-14T12:01:27.691638+0000","last_undegraded":"2024-09-14T12:01:27.691638+0000","last_fullsized":"2024-09-14T12:01:27.691638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:27.691538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:27.691538+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.691538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:47.244884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072314099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:40.524716+0000","last_change":"2024-09-14T10:46:48.350207+0000","last_active":"2024-09-14T11:57:40.524716+0000","last_peered":"2024-09-14T11:57:40.524716+0000","last_clean":"2024-09-14T11:57:40.524716+0000","last_became_active":"2024-09-14T10:46:48.349924+0000","last_became_peered":"2024-09-14T10:46:48.349924+0000","last_unstale":"2024-09-14T11:57:40.524716+0000","last_undegraded":"2024-09-14T11:57:40.524716+0000","last_fullsized":"2024-09-14T11:57:40.524716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:06.223225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"263'131","reported_seq":690,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:40.524748+0000","last_change":"2024-09-14T10:46:50.366912+0000","last_active":"2024-09-14T11:57:40.524748+0000","last_peered":"2024-09-14T11:57:40.524748+0000","last_clean":"2024-09-14T11:57:40.524748+0000","last_became_active":"2024-09-14T10:46:50.366610+0000","last_became_peered":"2024-09-14T10:46:50.366610+0000","last_unstale":"2024-09-14T11:57:40.524748+0000","last_undegraded":"2024-09-14T11:57:40.524748+0000","last_fullsized":"2024-09-14T11:57:40.524748+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:08.232971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"263'831","reported_seq":2795,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.319728+0000","last_change":"2024-09-14T10:46:52.371337+0000","last_active":"2024-09-14T12:01:18.319728+0000","last_peered":"2024-09-14T12:01:18.319728+0000","last_clean":"2024-09-14T12:01:18.319728+0000","last_became_active":"2024-09-14T10:46:52.370514+0000","last_became_peered":"2024-09-14T10:46:52.370514+0000","last_unstale":"2024-09-14T12:01:18.319728+0000","last_undegraded":"2024-09-14T12:01:18.319728+0000","last_fullsized":"2024-09-14T12:01:18.319728+0000","mapping_epoch":34,"log_start":"263'800","ondisk_log_start":"263'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:45.428130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"263'307","reported_seq":847,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.462075+0000","last_change":"2024-09-14T10:46:54.383183+0000","last_active":"2024-09-14T11:58:58.462075+0000","last_peered":"2024-09-14T11:58:58.462075+0000","last_clean":"2024-09-14T11:58:58.462075+0000","last_became_active":"2024-09-14T10:46:54.382860+0000","last_became_peered":"2024-09-14T10:46:54.382860+0000","last_unstale":"2024-09-14T11:58:58.462075+0000","last_undegraded":"2024-09-14T11:58:58.462075+0000","last_fullsized":"2024-09-14T11:58:58.462075+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:04.052225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":895,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":402,"num_read_kb":382,"num_write":591,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"263'1148","reported_seq":2853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.846208+0000","last_change":"2024-09-14T12:01:31.846208+0000","last_active":"2024-09-14T12:01:31.846208+0000","last_peered":"2024-09-14T12:01:31.846208+0000","last_clean":"2024-09-14T12:01:31.846208+0000","last_became_active":"2024-09-14T10:46:46.338543+0000","last_became_peered":"2024-09-14T10:46:46.338543+0000","last_unstale":"2024-09-14T12:01:31.846208+0000","last_undegraded":"2024-09-14T12:01:31.846208+0000","last_fullsized":"2024-09-14T12:01:31.846208+0000","mapping_epoch":28,"log_start":"263'1100","ondisk_log_start":"263'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1148","last_scrub_stamp":"2024-09-14T12:01:31.846127+0000","last_deep_scrub":"263'1148","last_deep_scrub_stamp":"2024-09-14T12:01:31.846127+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.846127+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":1100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:13.145120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5511,"num_read_kb":4909,"num_write":1576,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1532,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"263'347","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.669051+0000","last_change":"2024-09-14T12:01:28.669051+0000","last_active":"2024-09-14T12:01:28.669051+0000","last_peered":"2024-09-14T12:01:28.669051+0000","last_clean":"2024-09-14T12:01:28.669051+0000","last_became_active":"2024-09-14T10:46:44.318777+0000","last_became_peered":"2024-09-14T10:46:44.318777+0000","last_unstale":"2024-09-14T12:01:28.669051+0000","last_undegraded":"2024-09-14T12:01:28.669051+0000","last_fullsized":"2024-09-14T12:01:28.669051+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-09-14T12:01:28.668927+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-09-14T12:01:28.668927+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.668927+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:05.341520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":579,"num_read_kb":36295,"num_write":1107,"num_write_kb":33618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":540,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.924797+0000","last_change":"2024-09-14T12:01:28.924797+0000","last_active":"2024-09-14T12:01:28.924797+0000","last_peered":"2024-09-14T12:01:28.924797+0000","last_clean":"2024-09-14T12:01:28.924797+0000","last_became_active":"2024-09-14T10:46:33.265515+0000","last_became_peered":"2024-09-14T10:46:33.265515+0000","last_unstale":"2024-09-14T12:01:28.924797+0000","last_undegraded":"2024-09-14T12:01:28.924797+0000","last_fullsized":"2024-09-14T12:01:28.924797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:28.924676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:28.924676+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.924676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:40.550273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061284299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.515366+0000","last_change":"2024-09-14T12:01:44.515366+0000","last_active":"2024-09-14T12:01:44.515366+0000","last_peered":"2024-09-14T12:01:44.515366+0000","last_clean":"2024-09-14T12:01:44.515366+0000","last_became_active":"2024-09-14T10:46:48.354373+0000","last_became_peered":"2024-09-14T10:46:48.354373+0000","last_unstale":"2024-09-14T12:01:44.515366+0000","last_undegraded":"2024-09-14T12:01:44.515366+0000","last_fullsized":"2024-09-14T12:01:44.515366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:44.515279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:44.515279+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.515279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:32.779390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"263'728","reported_seq":1478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.193914+0000","last_change":"2024-09-14T12:01:43.193914+0000","last_active":"2024-09-14T12:01:43.193914+0000","last_peered":"2024-09-14T12:01:43.193914+0000","last_clean":"2024-09-14T12:01:43.193914+0000","last_became_active":"2024-09-14T10:46:50.362397+0000","last_became_peered":"2024-09-14T10:46:50.362397+0000","last_unstale":"2024-09-14T12:01:43.193914+0000","last_undegraded":"2024-09-14T12:01:43.193914+0000","last_fullsized":"2024-09-14T12:01:43.193914+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'728","last_scrub_stamp":"2024-09-14T12:01:43.193809+0000","last_deep_scrub":"263'728","last_deep_scrub_stamp":"2024-09-14T12:01:43.193809+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.193809+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":700,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:59.964839+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1285,"num_read_kb":3031,"num_write":1024,"num_write_kb":812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:45.640338+0000","last_change":"2024-09-14T10:46:52.370429+0000","last_active":"2024-09-14T11:57:45.640338+0000","last_peered":"2024-09-14T11:57:45.640338+0000","last_clean":"2024-09-14T11:57:45.640338+0000","last_became_active":"2024-09-14T10:46:52.370107+0000","last_became_peered":"2024-09-14T10:46:52.370107+0000","last_unstale":"2024-09-14T11:57:45.640338+0000","last_undegraded":"2024-09-14T11:57:45.640338+0000","last_fullsized":"2024-09-14T11:57:45.640338+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:57.197530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"263'131","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.306974+0000","last_change":"2024-09-14T10:46:54.384319+0000","last_active":"2024-09-14T11:58:55.306974+0000","last_peered":"2024-09-14T11:58:55.306974+0000","last_clean":"2024-09-14T11:58:55.306974+0000","last_became_active":"2024-09-14T10:46:54.383813+0000","last_became_peered":"2024-09-14T10:46:54.383813+0000","last_unstale":"2024-09-14T11:58:55.306974+0000","last_undegraded":"2024-09-14T11:58:55.306974+0000","last_fullsized":"2024-09-14T11:58:55.306974+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:08.736115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":350,"num_read_kb":289,"num_write":327,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"263'150","reported_seq":710,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.932339+0000","last_change":"2024-09-14T10:46:54.384092+0000","last_active":"2024-09-14T11:59:34.932339+0000","last_peered":"2024-09-14T11:59:34.932339+0000","last_clean":"2024-09-14T11:59:34.932339+0000","last_became_active":"2024-09-14T10:46:54.383742+0000","last_became_peered":"2024-09-14T10:46:54.383742+0000","last_unstale":"2024-09-14T11:59:34.932339+0000","last_undegraded":"2024-09-14T11:59:34.932339+0000","last_fullsized":"2024-09-14T11:59:34.932339+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:33.936406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":212,"num_read_kb":210,"num_write":346,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"263'703","reported_seq":2564,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.816238+0000","last_change":"2024-09-14T12:01:33.816238+0000","last_active":"2024-09-14T12:01:33.816238+0000","last_peered":"2024-09-14T12:01:33.816238+0000","last_clean":"2024-09-14T12:01:33.816238+0000","last_became_active":"2024-09-14T10:46:46.337818+0000","last_became_peered":"2024-09-14T10:46:46.337818+0000","last_unstale":"2024-09-14T12:01:33.816238+0000","last_undegraded":"2024-09-14T12:01:33.816238+0000","last_fullsized":"2024-09-14T12:01:33.816238+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'703","last_scrub_stamp":"2024-09-14T12:01:33.816161+0000","last_deep_scrub":"263'703","last_deep_scrub_stamp":"2024-09-14T12:01:33.816161+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.816161+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:12.842729+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3744,"num_read_kb":3411,"num_write":893,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2266,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"263'332","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.757635+0000","last_change":"2024-09-14T12:01:36.757635+0000","last_active":"2024-09-14T12:01:36.757635+0000","last_peered":"2024-09-14T12:01:36.757635+0000","last_clean":"2024-09-14T12:01:36.757635+0000","last_became_active":"2024-09-14T10:46:44.332607+0000","last_became_peered":"2024-09-14T10:46:44.332607+0000","last_unstale":"2024-09-14T12:01:36.757635+0000","last_undegraded":"2024-09-14T12:01:36.757635+0000","last_fullsized":"2024-09-14T12:01:36.757635+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'332","last_scrub_stamp":"2024-09-14T12:01:36.757421+0000","last_deep_scrub":"263'332","last_deep_scrub_stamp":"2024-09-14T12:01:36.757421+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.757421+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:10.285355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":554,"num_read_kb":15763,"num_write":1023,"num_write_kb":46520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.528782+0000","last_change":"2024-09-14T10:46:48.353763+0000","last_active":"2024-09-14T11:59:08.528782+0000","last_peered":"2024-09-14T11:59:08.528782+0000","last_clean":"2024-09-14T11:59:08.528782+0000","last_became_active":"2024-09-14T10:46:48.353125+0000","last_became_peered":"2024-09-14T10:46:48.353125+0000","last_unstale":"2024-09-14T11:59:08.528782+0000","last_undegraded":"2024-09-14T11:59:08.528782+0000","last_fullsized":"2024-09-14T11:59:08.528782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"263'335","reported_seq":924,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.353002+0000","last_change":"2024-09-14T10:46:50.365232+0000","last_active":"2024-09-14T12:01:18.353002+0000","last_peered":"2024-09-14T12:01:18.353002+0000","last_clean":"2024-09-14T12:01:18.353002+0000","last_became_active":"2024-09-14T10:46:50.364874+0000","last_became_peered":"2024-09-14T10:46:50.364874+0000","last_unstale":"2024-09-14T12:01:18.353002+0000","last_undegraded":"2024-09-14T12:01:18.353002+0000","last_fullsized":"2024-09-14T12:01:18.353002+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58887,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":550,"num_read_kb":1323,"num_write":450,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.453914+0000","last_change":"2024-09-14T10:46:52.374279+0000","last_active":"2024-09-14T11:59:15.453914+0000","last_peered":"2024-09-14T11:59:15.453914+0000","last_clean":"2024-09-14T11:59:15.453914+0000","last_became_active":"2024-09-14T10:46:52.373982+0000","last_became_peered":"2024-09-14T10:46:52.373982+0000","last_unstale":"2024-09-14T11:59:15.453914+0000","last_undegraded":"2024-09-14T11:59:15.453914+0000","last_fullsized":"2024-09-14T11:59:15.453914+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"263'117","reported_seq":613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.699014+0000","last_change":"2024-09-14T10:46:54.387894+0000","last_active":"2024-09-14T11:59:34.699014+0000","last_peered":"2024-09-14T11:59:34.699014+0000","last_clean":"2024-09-14T11:59:34.699014+0000","last_became_active":"2024-09-14T10:46:54.387552+0000","last_became_peered":"2024-09-14T10:46:54.387552+0000","last_unstale":"2024-09-14T11:59:34.699014+0000","last_undegraded":"2024-09-14T11:59:34.699014+0000","last_fullsized":"2024-09-14T11:59:34.699014+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:39.903611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":107,"num_write":284,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"263'407","reported_seq":1864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.672684+0000","last_change":"2024-09-14T12:01:36.672684+0000","last_active":"2024-09-14T12:01:36.672684+0000","last_peered":"2024-09-14T12:01:36.672684+0000","last_clean":"2024-09-14T12:01:36.672684+0000","last_became_active":"2024-09-14T10:46:46.348040+0000","last_became_peered":"2024-09-14T10:46:46.348040+0000","last_unstale":"2024-09-14T12:01:36.672684+0000","last_undegraded":"2024-09-14T12:01:36.672684+0000","last_fullsized":"2024-09-14T12:01:36.672684+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'407","last_scrub_stamp":"2024-09-14T12:01:36.672588+0000","last_deep_scrub":"263'407","last_deep_scrub_stamp":"2024-09-14T12:01:36.672588+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.672588+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:46.183322+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2178,"num_read_kb":2045,"num_write":462,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"263'336","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.276975+0000","last_change":"2024-09-14T12:01:26.276921+0000","last_active":"2024-09-14T12:01:26.276975+0000","last_peered":"2024-09-14T12:01:26.276975+0000","last_clean":"2024-09-14T12:01:26.276975+0000","last_became_active":"2024-09-14T10:46:44.333195+0000","last_became_peered":"2024-09-14T10:46:44.333195+0000","last_unstale":"2024-09-14T12:01:26.276975+0000","last_undegraded":"2024-09-14T12:01:26.276975+0000","last_fullsized":"2024-09-14T12:01:26.276975+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'336","last_scrub_stamp":"2024-09-14T12:01:26.276834+0000","last_deep_scrub":"263'336","last_deep_scrub_stamp":"2024-09-14T12:01:26.276834+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.276834+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:00:55.874383+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":77356,"num_write":1081,"num_write_kb":55140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.653063+0000","last_change":"2024-09-14T10:46:48.357298+0000","last_active":"2024-09-14T11:59:10.653063+0000","last_peered":"2024-09-14T11:59:10.653063+0000","last_clean":"2024-09-14T11:59:10.653063+0000","last_became_active":"2024-09-14T10:46:48.357033+0000","last_became_peered":"2024-09-14T10:46:48.357033+0000","last_unstale":"2024-09-14T11:59:10.653063+0000","last_undegraded":"2024-09-14T11:59:10.653063+0000","last_fullsized":"2024-09-14T11:59:10.653063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"263'63","reported_seq":577,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.652955+0000","last_change":"2024-09-14T10:46:50.363154+0000","last_active":"2024-09-14T11:59:10.652955+0000","last_peered":"2024-09-14T11:59:10.652955+0000","last_clean":"2024-09-14T11:59:10.652955+0000","last_became_active":"2024-09-14T10:46:50.362878+0000","last_became_peered":"2024-09-14T10:46:50.362878+0000","last_unstale":"2024-09-14T11:59:10.652955+0000","last_undegraded":"2024-09-14T11:59:10.652955+0000","last_fullsized":"2024-09-14T11:59:10.652955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.309038+0000","last_change":"2024-09-14T10:46:52.366285+0000","last_active":"2024-09-14T11:59:15.309038+0000","last_peered":"2024-09-14T11:59:15.309038+0000","last_clean":"2024-09-14T11:59:15.309038+0000","last_became_active":"2024-09-14T10:46:52.365987+0000","last_became_peered":"2024-09-14T10:46:52.365987+0000","last_unstale":"2024-09-14T11:59:15.309038+0000","last_undegraded":"2024-09-14T11:59:15.309038+0000","last_fullsized":"2024-09-14T11:59:15.309038+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"263'198","reported_seq":733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.608962+0000","last_change":"2024-09-14T10:46:54.383562+0000","last_active":"2024-09-14T11:59:33.608962+0000","last_peered":"2024-09-14T11:59:33.608962+0000","last_clean":"2024-09-14T11:59:33.608962+0000","last_became_active":"2024-09-14T10:46:54.383284+0000","last_became_peered":"2024-09-14T10:46:54.383284+0000","last_unstale":"2024-09-14T11:59:33.608962+0000","last_undegraded":"2024-09-14T11:59:33.608962+0000","last_fullsized":"2024-09-14T11:59:33.608962+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:22.704423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":348,"num_read_kb":326,"num_write":460,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"263'466","reported_seq":2101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.701686+0000","last_change":"2024-09-14T12:01:35.701686+0000","last_active":"2024-09-14T12:01:35.701686+0000","last_peered":"2024-09-14T12:01:35.701686+0000","last_clean":"2024-09-14T12:01:35.701686+0000","last_became_active":"2024-09-14T10:46:46.341424+0000","last_became_peered":"2024-09-14T10:46:46.341424+0000","last_unstale":"2024-09-14T12:01:35.701686+0000","last_undegraded":"2024-09-14T12:01:35.701686+0000","last_fullsized":"2024-09-14T12:01:35.701686+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'466","last_scrub_stamp":"2024-09-14T12:01:35.701589+0000","last_deep_scrub":"263'466","last_deep_scrub_stamp":"2024-09-14T12:01:35.701589+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.701589+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:23.244730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2571,"num_read_kb":2437,"num_write":538,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"263'326","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.895420+0000","last_change":"2024-09-14T12:01:27.895339+0000","last_active":"2024-09-14T12:01:27.895420+0000","last_peered":"2024-09-14T12:01:27.895420+0000","last_clean":"2024-09-14T12:01:27.895420+0000","last_became_active":"2024-09-14T10:46:44.321694+0000","last_became_peered":"2024-09-14T10:46:44.321694+0000","last_unstale":"2024-09-14T12:01:27.895420+0000","last_undegraded":"2024-09-14T12:01:27.895420+0000","last_fullsized":"2024-09-14T12:01:27.895420+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'326","last_scrub_stamp":"2024-09-14T12:01:27.895250+0000","last_deep_scrub":"263'326","last_deep_scrub_stamp":"2024-09-14T12:01:27.895250+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.895250+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:46.249003+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":535,"num_read_kb":12444,"num_write":977,"num_write_kb":13958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.839618+0000","last_change":"2024-09-14T12:01:37.839618+0000","last_active":"2024-09-14T12:01:37.839618+0000","last_peered":"2024-09-14T12:01:37.839618+0000","last_clean":"2024-09-14T12:01:37.839618+0000","last_became_active":"2024-09-14T10:46:48.350714+0000","last_became_peered":"2024-09-14T10:46:48.350714+0000","last_unstale":"2024-09-14T12:01:37.839618+0000","last_undegraded":"2024-09-14T12:01:37.839618+0000","last_fullsized":"2024-09-14T12:01:37.839618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:37.839539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:37.839539+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.839539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:51.881085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"263'343","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.015254+0000","last_change":"2024-09-14T12:01:45.015254+0000","last_active":"2024-09-14T12:01:45.015254+0000","last_peered":"2024-09-14T12:01:45.015254+0000","last_clean":"2024-09-14T12:01:45.015254+0000","last_became_active":"2024-09-14T10:46:50.360886+0000","last_became_peered":"2024-09-14T10:46:50.360886+0000","last_unstale":"2024-09-14T12:01:45.015254+0000","last_undegraded":"2024-09-14T12:01:45.015254+0000","last_fullsized":"2024-09-14T12:01:45.015254+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-14T12:01:45.015155+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-14T12:01:45.015155+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.015155+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:22.667188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50451,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":558,"num_read_kb":1238,"num_write":442,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.600309+0000","last_change":"2024-09-14T12:01:44.600309+0000","last_active":"2024-09-14T12:01:44.600309+0000","last_peered":"2024-09-14T12:01:44.600309+0000","last_clean":"2024-09-14T12:01:44.600309+0000","last_became_active":"2024-09-14T10:46:52.375120+0000","last_became_peered":"2024-09-14T10:46:52.375120+0000","last_unstale":"2024-09-14T12:01:44.600309+0000","last_undegraded":"2024-09-14T12:01:44.600309+0000","last_fullsized":"2024-09-14T12:01:44.600309+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:44.600220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:44.600220+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.600220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:15.281267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"263'126","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.661848+0000","last_change":"2024-09-14T10:46:54.384403+0000","last_active":"2024-09-14T11:59:34.661848+0000","last_peered":"2024-09-14T11:59:34.661848+0000","last_clean":"2024-09-14T11:59:34.661848+0000","last_became_active":"2024-09-14T10:46:54.384113+0000","last_became_peered":"2024-09-14T10:46:54.384113+0000","last_unstale":"2024-09-14T11:59:34.661848+0000","last_undegraded":"2024-09-14T11:59:34.661848+0000","last_fullsized":"2024-09-14T11:59:34.661848+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:43.036020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":180,"num_read_kb":170,"num_write":302,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"263'381","reported_seq":2036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.108765+0000","last_change":"2024-09-14T12:01:33.108765+0000","last_active":"2024-09-14T12:01:33.108765+0000","last_peered":"2024-09-14T12:01:33.108765+0000","last_clean":"2024-09-14T12:01:33.108765+0000","last_became_active":"2024-09-14T10:46:46.346318+0000","last_became_peered":"2024-09-14T10:46:46.346318+0000","last_unstale":"2024-09-14T12:01:33.108765+0000","last_undegraded":"2024-09-14T12:01:33.108765+0000","last_fullsized":"2024-09-14T12:01:33.108765+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'381","last_scrub_stamp":"2024-09-14T12:01:33.108674+0000","last_deep_scrub":"263'381","last_deep_scrub_stamp":"2024-09-14T12:01:33.108674+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.108674+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:22.079780+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2319,"num_read_kb":2246,"num_write":412,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2047,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"263'411","reported_seq":1088,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.374129+0000","last_change":"2024-09-14T12:01:28.374029+0000","last_active":"2024-09-14T12:01:28.374129+0000","last_peered":"2024-09-14T12:01:28.374129+0000","last_clean":"2024-09-14T12:01:28.374129+0000","last_became_active":"2024-09-14T10:46:44.332841+0000","last_became_peered":"2024-09-14T10:46:44.332841+0000","last_unstale":"2024-09-14T12:01:28.374129+0000","last_undegraded":"2024-09-14T12:01:28.374129+0000","last_fullsized":"2024-09-14T12:01:28.374129+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-09-14T12:01:28.373852+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-09-14T12:01:28.373852+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.373852+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:25.272342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133711,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":772,"num_read_kb":6861,"num_write":1433,"num_write_kb":25110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.535263+0000","last_change":"2024-09-14T10:46:48.353284+0000","last_active":"2024-09-14T11:59:10.535263+0000","last_peered":"2024-09-14T11:59:10.535263+0000","last_clean":"2024-09-14T11:59:10.535263+0000","last_became_active":"2024-09-14T10:46:48.353010+0000","last_became_peered":"2024-09-14T10:46:48.353010+0000","last_unstale":"2024-09-14T11:59:10.535263+0000","last_undegraded":"2024-09-14T11:59:10.535263+0000","last_fullsized":"2024-09-14T11:59:10.535263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"263'286","reported_seq":869,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.410584+0000","last_change":"2024-09-14T10:46:50.363596+0000","last_active":"2024-09-14T12:01:19.410584+0000","last_peered":"2024-09-14T12:01:19.410584+0000","last_clean":"2024-09-14T12:01:19.410584+0000","last_became_active":"2024-09-14T10:46:50.362723+0000","last_became_peered":"2024-09-14T10:46:50.362723+0000","last_unstale":"2024-09-14T12:01:19.410584+0000","last_undegraded":"2024-09-14T12:01:19.410584+0000","last_fullsized":"2024-09-14T12:01:19.410584+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44996,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":451,"num_read_kb":1030,"num_write":360,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.453970+0000","last_change":"2024-09-14T10:46:52.369320+0000","last_active":"2024-09-14T11:59:15.453970+0000","last_peered":"2024-09-14T11:59:15.453970+0000","last_clean":"2024-09-14T11:59:15.453970+0000","last_became_active":"2024-09-14T10:46:52.369048+0000","last_became_peered":"2024-09-14T10:46:52.369048+0000","last_unstale":"2024-09-14T11:59:15.453970+0000","last_undegraded":"2024-09-14T11:59:15.453970+0000","last_fullsized":"2024-09-14T11:59:15.453970+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"263'556","reported_seq":2342,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.798097+0000","last_change":"2024-09-14T12:01:43.798097+0000","last_active":"2024-09-14T12:01:43.798097+0000","last_peered":"2024-09-14T12:01:43.798097+0000","last_clean":"2024-09-14T12:01:43.798097+0000","last_became_active":"2024-09-14T10:46:46.348774+0000","last_became_peered":"2024-09-14T10:46:46.348774+0000","last_unstale":"2024-09-14T12:01:43.798097+0000","last_undegraded":"2024-09-14T12:01:43.798097+0000","last_fullsized":"2024-09-14T12:01:43.798097+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'556","last_scrub_stamp":"2024-09-14T12:01:43.797996+0000","last_deep_scrub":"263'556","last_deep_scrub_stamp":"2024-09-14T12:01:43.797996+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.797996+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:15.352106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3189,"num_read_kb":2980,"num_write":657,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"263'401","reported_seq":1094,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.391955+0000","last_change":"2024-09-14T12:01:29.391885+0000","last_active":"2024-09-14T12:01:29.391955+0000","last_peered":"2024-09-14T12:01:29.391955+0000","last_clean":"2024-09-14T12:01:29.391955+0000","last_became_active":"2024-09-14T10:46:44.334693+0000","last_became_peered":"2024-09-14T10:46:44.334693+0000","last_unstale":"2024-09-14T12:01:29.391955+0000","last_undegraded":"2024-09-14T12:01:29.391955+0000","last_fullsized":"2024-09-14T12:01:29.391955+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'401","last_scrub_stamp":"2024-09-14T12:01:29.391776+0000","last_deep_scrub":"263'401","last_deep_scrub_stamp":"2024-09-14T12:01:29.391776+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.391776+0000","objects_scrubbed":5,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:21.186717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1532840,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":807,"num_read_kb":35702,"num_write":1252,"num_write_kb":25930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"38'3","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.196063+0000","last_change":"2024-09-14T10:46:48.350741+0000","last_active":"2024-09-14T12:01:17.196063+0000","last_peered":"2024-09-14T12:01:17.196063+0000","last_clean":"2024-09-14T12:01:17.196063+0000","last_became_active":"2024-09-14T10:46:48.350469+0000","last_became_peered":"2024-09-14T10:46:48.350469+0000","last_unstale":"2024-09-14T12:01:17.196063+0000","last_undegraded":"2024-09-14T12:01:17.196063+0000","last_fullsized":"2024-09-14T12:01:17.196063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:50.974578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"263'495","reported_seq":1135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.354939+0000","last_change":"2024-09-14T10:46:50.365772+0000","last_active":"2024-09-14T12:01:19.354939+0000","last_peered":"2024-09-14T12:01:19.354939+0000","last_clean":"2024-09-14T12:01:19.354939+0000","last_became_active":"2024-09-14T10:46:50.365486+0000","last_became_peered":"2024-09-14T10:46:50.365486+0000","last_unstale":"2024-09-14T12:01:19.354939+0000","last_undegraded":"2024-09-14T12:01:19.354939+0000","last_fullsized":"2024-09-14T12:01:19.354939+0000","mapping_epoch":32,"log_start":"263'400","ondisk_log_start":"263'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:08:39.304362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93124,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":891,"num_read_kb":2144,"num_write":760,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.294097+0000","last_change":"2024-09-14T10:46:52.372507+0000","last_active":"2024-09-14T11:56:55.294097+0000","last_peered":"2024-09-14T11:56:55.294097+0000","last_clean":"2024-09-14T11:56:55.294097+0000","last_became_active":"2024-09-14T10:46:52.372151+0000","last_became_peered":"2024-09-14T10:46:52.372151+0000","last_unstale":"2024-09-14T11:56:55.294097+0000","last_undegraded":"2024-09-14T11:56:55.294097+0000","last_fullsized":"2024-09-14T11:56:55.294097+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:35.607612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"263'205","reported_seq":717,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.655793+0000","last_change":"2024-09-14T10:46:54.386817+0000","last_active":"2024-09-14T11:59:33.655793+0000","last_peered":"2024-09-14T11:59:33.655793+0000","last_clean":"2024-09-14T11:59:33.655793+0000","last_became_active":"2024-09-14T10:46:54.386525+0000","last_became_peered":"2024-09-14T10:46:54.386525+0000","last_unstale":"2024-09-14T11:59:33.655793+0000","last_undegraded":"2024-09-14T11:59:33.655793+0000","last_fullsized":"2024-09-14T11:59:33.655793+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":260,"num_read_kb":259,"num_write":474,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"263'419","reported_seq":2088,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.678034+0000","last_change":"2024-09-14T12:01:38.678034+0000","last_active":"2024-09-14T12:01:38.678034+0000","last_peered":"2024-09-14T12:01:38.678034+0000","last_clean":"2024-09-14T12:01:38.678034+0000","last_became_active":"2024-09-14T10:46:46.341559+0000","last_became_peered":"2024-09-14T10:46:46.341559+0000","last_unstale":"2024-09-14T12:01:38.678034+0000","last_undegraded":"2024-09-14T12:01:38.678034+0000","last_fullsized":"2024-09-14T12:01:38.678034+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'419","last_scrub_stamp":"2024-09-14T12:01:38.677944+0000","last_deep_scrub":"263'419","last_deep_scrub_stamp":"2024-09-14T12:01:38.677944+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.677944+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:16.076637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2371,"num_read_kb":2275,"num_write":467,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"263'282","reported_seq":937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.691639+0000","last_change":"2024-09-14T12:01:31.691639+0000","last_active":"2024-09-14T12:01:31.691639+0000","last_peered":"2024-09-14T12:01:31.691639+0000","last_clean":"2024-09-14T12:01:31.691639+0000","last_became_active":"2024-09-14T10:46:44.319896+0000","last_became_peered":"2024-09-14T10:46:44.319896+0000","last_unstale":"2024-09-14T12:01:31.691639+0000","last_undegraded":"2024-09-14T12:01:31.691639+0000","last_fullsized":"2024-09-14T12:01:31.691639+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'282","last_scrub_stamp":"2024-09-14T12:01:31.691521+0000","last_deep_scrub":"263'282","last_deep_scrub_stamp":"2024-09-14T12:01:31.691521+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.691521+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:52.725869+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133682,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":524,"num_read_kb":94668,"num_write":900,"num_write_kb":37785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.928757+0000","last_change":"2024-09-14T12:01:42.928757+0000","last_active":"2024-09-14T12:01:42.928757+0000","last_peered":"2024-09-14T12:01:42.928757+0000","last_clean":"2024-09-14T12:01:42.928757+0000","last_became_active":"2024-09-14T10:46:48.355149+0000","last_became_peered":"2024-09-14T10:46:48.355149+0000","last_unstale":"2024-09-14T12:01:42.928757+0000","last_undegraded":"2024-09-14T12:01:42.928757+0000","last_fullsized":"2024-09-14T12:01:42.928757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:42.928663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:42.928663+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.928663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:09.783248+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"263'345","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.538027+0000","last_change":"2024-09-14T10:46:50.367103+0000","last_active":"2024-09-14T12:01:17.538027+0000","last_peered":"2024-09-14T12:01:17.538027+0000","last_clean":"2024-09-14T12:01:17.538027+0000","last_became_active":"2024-09-14T10:46:50.366749+0000","last_became_peered":"2024-09-14T10:46:50.366749+0000","last_unstale":"2024-09-14T12:01:17.538027+0000","last_undegraded":"2024-09-14T12:01:17.538027+0000","last_fullsized":"2024-09-14T12:01:17.538027+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:04.127284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49707,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":587,"num_read_kb":1269,"num_write":486,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.442435+0000","last_change":"2024-09-14T10:46:52.368766+0000","last_active":"2024-09-14T11:56:53.442435+0000","last_peered":"2024-09-14T11:56:53.442435+0000","last_clean":"2024-09-14T11:56:53.442435+0000","last_became_active":"2024-09-14T10:46:52.368508+0000","last_became_peered":"2024-09-14T10:46:52.368508+0000","last_unstale":"2024-09-14T11:56:53.442435+0000","last_undegraded":"2024-09-14T11:56:53.442435+0000","last_fullsized":"2024-09-14T11:56:53.442435+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:15.487064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"263'181","reported_seq":1058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.917475+0000","last_change":"2024-09-14T10:46:54.379236+0000","last_active":"2024-09-14T11:59:30.917475+0000","last_peered":"2024-09-14T11:59:30.917475+0000","last_clean":"2024-09-14T11:59:30.917475+0000","last_became_active":"2024-09-14T10:46:54.378938+0000","last_became_peered":"2024-09-14T10:46:54.378938+0000","last_unstale":"2024-09-14T11:59:30.917475+0000","last_undegraded":"2024-09-14T11:59:30.917475+0000","last_fullsized":"2024-09-14T11:59:30.917475+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2044,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":607,"num_read_kb":603,"num_write":505,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"263'637","reported_seq":2306,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.079167+0000","last_change":"2024-09-14T12:01:35.079167+0000","last_active":"2024-09-14T12:01:35.079167+0000","last_peered":"2024-09-14T12:01:35.079167+0000","last_clean":"2024-09-14T12:01:35.079167+0000","last_became_active":"2024-09-14T10:46:46.347362+0000","last_became_peered":"2024-09-14T10:46:46.347362+0000","last_unstale":"2024-09-14T12:01:35.079167+0000","last_undegraded":"2024-09-14T12:01:35.079167+0000","last_fullsized":"2024-09-14T12:01:35.079167+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'637","last_scrub_stamp":"2024-09-14T12:01:35.079082+0000","last_deep_scrub":"263'637","last_deep_scrub_stamp":"2024-09-14T12:01:35.079082+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.079082+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":600,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:12.178538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3345,"num_read_kb":3056,"num_write":864,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"263'375","reported_seq":1036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.727303+0000","last_change":"2024-09-14T12:01:26.727237+0000","last_active":"2024-09-14T12:01:26.727303+0000","last_peered":"2024-09-14T12:01:26.727303+0000","last_clean":"2024-09-14T12:01:26.727303+0000","last_became_active":"2024-09-14T10:46:44.318099+0000","last_became_peered":"2024-09-14T10:46:44.318099+0000","last_unstale":"2024-09-14T12:01:26.727303+0000","last_undegraded":"2024-09-14T12:01:26.727303+0000","last_fullsized":"2024-09-14T12:01:26.727303+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'375","last_scrub_stamp":"2024-09-14T12:01:26.727098+0000","last_deep_scrub":"263'375","last_deep_scrub_stamp":"2024-09-14T12:01:26.727098+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.727098+0000","objects_scrubbed":8,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:42.583432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133694,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":681,"num_read_kb":1685,"num_write":1259,"num_write_kb":36237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.899759+0000","last_change":"2024-09-14T12:01:41.899759+0000","last_active":"2024-09-14T12:01:41.899759+0000","last_peered":"2024-09-14T12:01:41.899759+0000","last_clean":"2024-09-14T12:01:41.899759+0000","last_became_active":"2024-09-14T10:46:48.350059+0000","last_became_peered":"2024-09-14T10:46:48.350059+0000","last_unstale":"2024-09-14T12:01:41.899759+0000","last_undegraded":"2024-09-14T12:01:41.899759+0000","last_fullsized":"2024-09-14T12:01:41.899759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:41.899660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:41.899660+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.899660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:49.562202+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"263'311","reported_seq":903,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.586182+0000","last_change":"2024-09-14T10:46:50.365706+0000","last_active":"2024-09-14T12:01:18.586182+0000","last_peered":"2024-09-14T12:01:18.586182+0000","last_clean":"2024-09-14T12:01:18.586182+0000","last_became_active":"2024-09-14T10:46:50.365393+0000","last_became_peered":"2024-09-14T10:46:50.365393+0000","last_unstale":"2024-09-14T12:01:18.586182+0000","last_undegraded":"2024-09-14T12:01:18.586182+0000","last_fullsized":"2024-09-14T12:01:18.586182+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:00.491603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46624,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":509,"num_read_kb":1174,"num_write":408,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.453197+0000","last_change":"2024-09-14T10:46:52.373436+0000","last_active":"2024-09-14T11:59:10.453197+0000","last_peered":"2024-09-14T11:59:10.453197+0000","last_clean":"2024-09-14T11:59:10.453197+0000","last_became_active":"2024-09-14T10:46:52.373099+0000","last_became_peered":"2024-09-14T10:46:52.373099+0000","last_unstale":"2024-09-14T11:59:10.453197+0000","last_undegraded":"2024-09-14T11:59:10.453197+0000","last_fullsized":"2024-09-14T11:59:10.453197+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:41.461337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"263'143","reported_seq":668,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:52.318564+0000","last_change":"2024-09-14T10:46:54.385921+0000","last_active":"2024-09-14T12:00:52.318564+0000","last_peered":"2024-09-14T12:00:52.318564+0000","last_clean":"2024-09-14T12:00:52.318564+0000","last_became_active":"2024-09-14T10:46:54.385625+0000","last_became_peered":"2024-09-14T10:46:54.385625+0000","last_unstale":"2024-09-14T12:00:52.318564+0000","last_undegraded":"2024-09-14T12:00:52.318564+0000","last_fullsized":"2024-09-14T12:00:52.318564+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":790,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":228,"num_read_kb":197,"num_write":338,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"263'418","reported_seq":1967,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.632681+0000","last_change":"2024-09-14T12:01:37.632681+0000","last_active":"2024-09-14T12:01:37.632681+0000","last_peered":"2024-09-14T12:01:37.632681+0000","last_clean":"2024-09-14T12:01:37.632681+0000","last_became_active":"2024-09-14T10:46:46.338551+0000","last_became_peered":"2024-09-14T10:46:46.338551+0000","last_unstale":"2024-09-14T12:01:37.632681+0000","last_undegraded":"2024-09-14T12:01:37.632681+0000","last_fullsized":"2024-09-14T12:01:37.632681+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'418","last_scrub_stamp":"2024-09-14T12:01:37.632564+0000","last_deep_scrub":"263'418","last_deep_scrub_stamp":"2024-09-14T12:01:37.632564+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.632564+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:48.702789+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2291,"num_read_kb":2170,"num_write":475,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"263'291","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.702324+0000","last_change":"2024-09-14T12:01:32.702217+0000","last_active":"2024-09-14T12:01:32.702324+0000","last_peered":"2024-09-14T12:01:32.702324+0000","last_clean":"2024-09-14T12:01:32.702324+0000","last_became_active":"2024-09-14T10:46:44.331660+0000","last_became_peered":"2024-09-14T10:46:44.331660+0000","last_unstale":"2024-09-14T12:01:32.702324+0000","last_undegraded":"2024-09-14T12:01:32.702324+0000","last_fullsized":"2024-09-14T12:01:32.702324+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'291","last_scrub_stamp":"2024-09-14T12:01:32.702040+0000","last_deep_scrub":"263'291","last_deep_scrub_stamp":"2024-09-14T12:01:32.702040+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.702040+0000","objects_scrubbed":9,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:26.595923+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":521,"num_read_kb":29638,"num_write":955,"num_write_kb":30451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.632361+0000","last_change":"2024-09-14T10:46:48.350417+0000","last_active":"2024-09-14T11:56:50.632361+0000","last_peered":"2024-09-14T11:56:50.632361+0000","last_clean":"2024-09-14T11:56:50.632361+0000","last_became_active":"2024-09-14T10:46:48.350072+0000","last_became_peered":"2024-09-14T10:46:48.350072+0000","last_unstale":"2024-09-14T11:56:50.632361+0000","last_undegraded":"2024-09-14T11:56:50.632361+0000","last_fullsized":"2024-09-14T11:56:50.632361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:34.764307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"263'125","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.533624+0000","last_change":"2024-09-14T10:46:50.368321+0000","last_active":"2024-09-14T11:58:55.533624+0000","last_peered":"2024-09-14T11:58:55.533624+0000","last_clean":"2024-09-14T11:58:55.533624+0000","last_became_active":"2024-09-14T10:46:50.367991+0000","last_became_peered":"2024-09-14T10:46:50.367991+0000","last_unstale":"2024-09-14T11:58:55.533624+0000","last_undegraded":"2024-09-14T11:58:55.533624+0000","last_fullsized":"2024-09-14T11:58:55.533624+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:39.918895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":126,"num_write":102,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"263'780","reported_seq":2687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.106488+0000","last_change":"2024-09-14T10:46:52.370832+0000","last_active":"2024-09-14T12:01:19.106488+0000","last_peered":"2024-09-14T12:01:19.106488+0000","last_clean":"2024-09-14T12:01:19.106488+0000","last_became_active":"2024-09-14T10:46:52.370446+0000","last_became_peered":"2024-09-14T10:46:52.370446+0000","last_unstale":"2024-09-14T12:01:19.106488+0000","last_undegraded":"2024-09-14T12:01:19.106488+0000","last_fullsized":"2024-09-14T12:01:19.106488+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:05.923305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"263'120","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.535812+0000","last_change":"2024-09-14T10:46:54.378096+0000","last_active":"2024-09-14T11:59:15.535812+0000","last_peered":"2024-09-14T11:59:15.535812+0000","last_clean":"2024-09-14T11:59:15.535812+0000","last_became_active":"2024-09-14T10:46:54.377788+0000","last_became_peered":"2024-09-14T10:46:54.377788+0000","last_unstale":"2024-09-14T11:59:15.535812+0000","last_undegraded":"2024-09-14T11:59:15.535812+0000","last_fullsized":"2024-09-14T11:59:15.535812+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":221,"num_read_kb":193,"num_write":312,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"263'792","reported_seq":2343,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.869721+0000","last_change":"2024-09-14T12:01:38.869721+0000","last_active":"2024-09-14T12:01:38.869721+0000","last_peered":"2024-09-14T12:01:38.869721+0000","last_clean":"2024-09-14T12:01:38.869721+0000","last_became_active":"2024-09-14T10:46:46.352087+0000","last_became_peered":"2024-09-14T10:46:46.352087+0000","last_unstale":"2024-09-14T12:01:38.869721+0000","last_undegraded":"2024-09-14T12:01:38.869721+0000","last_fullsized":"2024-09-14T12:01:38.869721+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'792","last_scrub_stamp":"2024-09-14T12:01:38.869609+0000","last_deep_scrub":"263'792","last_deep_scrub_stamp":"2024-09-14T12:01:38.869609+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.869609+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:26.016700+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3891,"num_read_kb":3520,"num_write":1035,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"263'316","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.681774+0000","last_change":"2024-09-14T12:01:27.681717+0000","last_active":"2024-09-14T12:01:27.681774+0000","last_peered":"2024-09-14T12:01:27.681774+0000","last_clean":"2024-09-14T12:01:27.681774+0000","last_became_active":"2024-09-14T10:46:44.320689+0000","last_became_peered":"2024-09-14T10:46:44.320689+0000","last_unstale":"2024-09-14T12:01:27.681774+0000","last_undegraded":"2024-09-14T12:01:27.681774+0000","last_fullsized":"2024-09-14T12:01:27.681774+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'316","last_scrub_stamp":"2024-09-14T12:01:27.681619+0000","last_deep_scrub":"263'316","last_deep_scrub_stamp":"2024-09-14T12:01:27.681619+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.681619+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:26.610212+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":532,"num_read_kb":954,"num_write":1107,"num_write_kb":21144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.691672+0000","last_change":"2024-09-14T12:01:40.691672+0000","last_active":"2024-09-14T12:01:40.691672+0000","last_peered":"2024-09-14T12:01:40.691672+0000","last_clean":"2024-09-14T12:01:40.691672+0000","last_became_active":"2024-09-14T10:46:48.357024+0000","last_became_peered":"2024-09-14T10:46:48.357024+0000","last_unstale":"2024-09-14T12:01:40.691672+0000","last_undegraded":"2024-09-14T12:01:40.691672+0000","last_fullsized":"2024-09-14T12:01:40.691672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:40.691553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:40.691553+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.691553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:20.398399+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"263'378","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.928077+0000","last_change":"2024-09-14T10:46:50.362271+0000","last_active":"2024-09-14T12:01:18.928077+0000","last_peered":"2024-09-14T12:01:18.928077+0000","last_clean":"2024-09-14T12:01:18.928077+0000","last_became_active":"2024-09-14T10:46:50.361962+0000","last_became_peered":"2024-09-14T10:46:50.361962+0000","last_unstale":"2024-09-14T12:01:18.928077+0000","last_undegraded":"2024-09-14T12:01:18.928077+0000","last_fullsized":"2024-09-14T12:01:18.928077+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:52.644742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49011,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":601,"num_read_kb":1340,"num_write":486,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.633741+0000","last_change":"2024-09-14T10:46:52.369579+0000","last_active":"2024-09-14T11:57:00.633741+0000","last_peered":"2024-09-14T11:57:00.633741+0000","last_clean":"2024-09-14T11:57:00.633741+0000","last_became_active":"2024-09-14T10:46:52.369262+0000","last_became_peered":"2024-09-14T10:46:52.369262+0000","last_unstale":"2024-09-14T11:57:00.633741+0000","last_undegraded":"2024-09-14T11:57:00.633741+0000","last_fullsized":"2024-09-14T11:57:00.633741+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:35.807345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"263'147","reported_seq":659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.302488+0000","last_change":"2024-09-14T10:46:54.385691+0000","last_active":"2024-09-14T11:59:34.302488+0000","last_peered":"2024-09-14T11:59:34.302488+0000","last_clean":"2024-09-14T11:59:34.302488+0000","last_became_active":"2024-09-14T10:46:54.385235+0000","last_became_peered":"2024-09-14T10:46:54.385235+0000","last_unstale":"2024-09-14T11:59:34.302488+0000","last_undegraded":"2024-09-14T11:59:34.302488+0000","last_fullsized":"2024-09-14T11:59:34.302488+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:33.162523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":187,"num_write":368,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"263'750","reported_seq":2317,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.864145+0000","last_change":"2024-09-14T12:01:36.864145+0000","last_active":"2024-09-14T12:01:36.864145+0000","last_peered":"2024-09-14T12:01:36.864145+0000","last_clean":"2024-09-14T12:01:36.864145+0000","last_became_active":"2024-09-14T10:46:46.335112+0000","last_became_peered":"2024-09-14T10:46:46.335112+0000","last_unstale":"2024-09-14T12:01:36.864145+0000","last_undegraded":"2024-09-14T12:01:36.864145+0000","last_fullsized":"2024-09-14T12:01:36.864145+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'750","last_scrub_stamp":"2024-09-14T12:01:36.864055+0000","last_deep_scrub":"263'750","last_deep_scrub_stamp":"2024-09-14T12:01:36.864055+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.864055+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:44.163046+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3755,"num_read_kb":3425,"num_write":989,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"263'322","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.760058+0000","last_change":"2024-09-14T12:01:34.759992+0000","last_active":"2024-09-14T12:01:34.760058+0000","last_peered":"2024-09-14T12:01:34.760058+0000","last_clean":"2024-09-14T12:01:34.760058+0000","last_became_active":"2024-09-14T10:46:44.332130+0000","last_became_peered":"2024-09-14T10:46:44.332130+0000","last_unstale":"2024-09-14T12:01:34.760058+0000","last_undegraded":"2024-09-14T12:01:34.760058+0000","last_fullsized":"2024-09-14T12:01:34.760058+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'322","last_scrub_stamp":"2024-09-14T12:01:34.759869+0000","last_deep_scrub":"263'322","last_deep_scrub_stamp":"2024-09-14T12:01:34.759869+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.759869+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:56.671464+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":584,"num_read_kb":32074,"num_write":1014,"num_write_kb":20757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.891826+0000","last_change":"2024-09-14T12:01:40.891826+0000","last_active":"2024-09-14T12:01:40.891826+0000","last_peered":"2024-09-14T12:01:40.891826+0000","last_clean":"2024-09-14T12:01:40.891826+0000","last_became_active":"2024-09-14T10:46:48.354108+0000","last_became_peered":"2024-09-14T10:46:48.354108+0000","last_unstale":"2024-09-14T12:01:40.891826+0000","last_undegraded":"2024-09-14T12:01:40.891826+0000","last_fullsized":"2024-09-14T12:01:40.891826+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:40.891732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:40.891732+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.891732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:32.261695+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"263'271","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.987229+0000","last_change":"2024-09-14T10:46:50.358462+0000","last_active":"2024-09-14T12:01:18.987229+0000","last_peered":"2024-09-14T12:01:18.987229+0000","last_clean":"2024-09-14T12:01:18.987229+0000","last_became_active":"2024-09-14T10:46:50.358186+0000","last_became_peered":"2024-09-14T10:46:50.358186+0000","last_unstale":"2024-09-14T12:01:18.987229+0000","last_undegraded":"2024-09-14T12:01:18.987229+0000","last_fullsized":"2024-09-14T12:01:18.987229+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46012,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":454,"num_read_kb":1061,"num_write":362,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:05.520539+0000","last_change":"2024-09-14T10:46:52.366046+0000","last_active":"2024-09-14T11:57:05.520539+0000","last_peered":"2024-09-14T11:57:05.520539+0000","last_clean":"2024-09-14T11:57:05.520539+0000","last_became_active":"2024-09-14T10:46:52.365736+0000","last_became_peered":"2024-09-14T10:46:52.365736+0000","last_unstale":"2024-09-14T11:57:05.520539+0000","last_undegraded":"2024-09-14T11:57:05.520539+0000","last_fullsized":"2024-09-14T11:57:05.520539+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:20.721132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"263'123","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.467272+0000","last_change":"2024-09-14T10:46:54.385215+0000","last_active":"2024-09-14T11:59:28.467272+0000","last_peered":"2024-09-14T11:59:28.467272+0000","last_clean":"2024-09-14T11:59:28.467272+0000","last_became_active":"2024-09-14T10:46:54.384303+0000","last_became_peered":"2024-09-14T10:46:54.384303+0000","last_unstale":"2024-09-14T11:59:28.467272+0000","last_undegraded":"2024-09-14T11:59:28.467272+0000","last_fullsized":"2024-09-14T11:59:28.467272+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:28.997409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":957,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":145,"num_write":281,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"263'378","reported_seq":1801,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.141054+0000","last_change":"2024-09-14T12:01:32.141054+0000","last_active":"2024-09-14T12:01:32.141054+0000","last_peered":"2024-09-14T12:01:32.141054+0000","last_clean":"2024-09-14T12:01:32.141054+0000","last_became_active":"2024-09-14T10:46:46.338518+0000","last_became_peered":"2024-09-14T10:46:46.338518+0000","last_unstale":"2024-09-14T12:01:32.141054+0000","last_undegraded":"2024-09-14T12:01:32.141054+0000","last_fullsized":"2024-09-14T12:01:32.141054+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-14T12:01:32.140969+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-14T12:01:32.140969+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.140969+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:30.472756+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2070,"num_read_kb":1951,"num_write":457,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"263'362","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.372654+0000","last_change":"2024-09-14T12:01:30.372654+0000","last_active":"2024-09-14T12:01:30.372654+0000","last_peered":"2024-09-14T12:01:30.372654+0000","last_clean":"2024-09-14T12:01:30.372654+0000","last_became_active":"2024-09-14T10:46:44.332852+0000","last_became_peered":"2024-09-14T10:46:44.332852+0000","last_unstale":"2024-09-14T12:01:30.372654+0000","last_undegraded":"2024-09-14T12:01:30.372654+0000","last_fullsized":"2024-09-14T12:01:30.372654+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-14T12:01:30.372539+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-14T12:01:30.372539+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.372539+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:57.066912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":662,"num_read_kb":10749,"num_write":1220,"num_write_kb":43875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.676465+0000","last_change":"2024-09-14T12:01:41.676362+0000","last_active":"2024-09-14T12:01:41.676465+0000","last_peered":"2024-09-14T12:01:41.676465+0000","last_clean":"2024-09-14T12:01:41.676465+0000","last_became_active":"2024-09-14T10:46:48.355512+0000","last_became_peered":"2024-09-14T10:46:48.355512+0000","last_unstale":"2024-09-14T12:01:41.676465+0000","last_undegraded":"2024-09-14T12:01:41.676465+0000","last_fullsized":"2024-09-14T12:01:41.676465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:41.676262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:41.676262+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.676262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:42.505362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"263'265","reported_seq":827,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.475186+0000","last_change":"2024-09-14T10:46:50.364736+0000","last_active":"2024-09-14T12:01:18.475186+0000","last_peered":"2024-09-14T12:01:18.475186+0000","last_clean":"2024-09-14T12:01:18.475186+0000","last_became_active":"2024-09-14T10:46:50.364420+0000","last_became_peered":"2024-09-14T10:46:50.364420+0000","last_unstale":"2024-09-14T12:01:18.475186+0000","last_undegraded":"2024-09-14T12:01:18.475186+0000","last_fullsized":"2024-09-14T12:01:18.475186+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:59.631655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45284,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":455,"num_read_kb":1165,"num_write":378,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.519191+0000","last_change":"2024-09-14T10:46:52.374194+0000","last_active":"2024-09-14T11:56:55.519191+0000","last_peered":"2024-09-14T11:56:55.519191+0000","last_clean":"2024-09-14T11:56:55.519191+0000","last_became_active":"2024-09-14T10:46:52.373913+0000","last_became_peered":"2024-09-14T10:46:52.373913+0000","last_unstale":"2024-09-14T11:56:55.519191+0000","last_undegraded":"2024-09-14T11:56:55.519191+0000","last_fullsized":"2024-09-14T11:56:55.519191+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:44.342253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"263'129","reported_seq":1230,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.354353+0000","last_change":"2024-09-14T10:46:54.383936+0000","last_active":"2024-09-14T11:59:30.354353+0000","last_peered":"2024-09-14T11:59:30.354353+0000","last_clean":"2024-09-14T11:59:30.354353+0000","last_became_active":"2024-09-14T10:46:54.383637+0000","last_became_peered":"2024-09-14T10:46:54.383637+0000","last_unstale":"2024-09-14T11:59:30.354353+0000","last_undegraded":"2024-09-14T11:59:30.354353+0000","last_fullsized":"2024-09-14T11:59:30.354353+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:19.327839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":738,"num_read_kb":738,"num_write":285,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"263'446","reported_seq":1913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.792550+0000","last_change":"2024-09-14T12:01:34.792489+0000","last_active":"2024-09-14T12:01:34.792550+0000","last_peered":"2024-09-14T12:01:34.792550+0000","last_clean":"2024-09-14T12:01:34.792550+0000","last_became_active":"2024-09-14T10:46:46.342299+0000","last_became_peered":"2024-09-14T10:46:46.342299+0000","last_unstale":"2024-09-14T12:01:34.792550+0000","last_undegraded":"2024-09-14T12:01:34.792550+0000","last_fullsized":"2024-09-14T12:01:34.792550+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'446","last_scrub_stamp":"2024-09-14T12:01:34.792381+0000","last_deep_scrub":"263'446","last_deep_scrub_stamp":"2024-09-14T12:01:34.792381+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.792381+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:14.733658+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2232,"num_read_kb":2089,"num_write":533,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"263'512","reported_seq":1272,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.363630+0000","last_change":"2024-09-14T12:01:31.363630+0000","last_active":"2024-09-14T12:01:31.363630+0000","last_peered":"2024-09-14T12:01:31.363630+0000","last_clean":"2024-09-14T12:01:31.363630+0000","last_became_active":"2024-09-14T10:46:44.320749+0000","last_became_peered":"2024-09-14T10:46:44.320749+0000","last_unstale":"2024-09-14T12:01:31.363630+0000","last_undegraded":"2024-09-14T12:01:31.363630+0000","last_fullsized":"2024-09-14T12:01:31.363630+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'512","last_scrub_stamp":"2024-09-14T12:01:31.363472+0000","last_deep_scrub":"263'512","last_deep_scrub_stamp":"2024-09-14T12:01:31.363472+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.363472+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:49.759769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1101,"num_read_kb":48118,"num_write":1530,"num_write_kb":57550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:10.635290+0000","last_change":"2024-09-14T10:46:48.353148+0000","last_active":"2024-09-14T11:57:10.635290+0000","last_peered":"2024-09-14T11:57:10.635290+0000","last_clean":"2024-09-14T11:57:10.635290+0000","last_became_active":"2024-09-14T10:46:48.352853+0000","last_became_peered":"2024-09-14T10:46:48.352853+0000","last_unstale":"2024-09-14T11:57:10.635290+0000","last_undegraded":"2024-09-14T11:57:10.635290+0000","last_fullsized":"2024-09-14T11:57:10.635290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:47.329724+0000","last_clean_scrub_stamp":"2024-09-14T10:46:47.329724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:46.305353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"263'304","reported_seq":903,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.639297+0000","last_change":"2024-09-14T10:46:50.369781+0000","last_active":"2024-09-14T12:01:18.639297+0000","last_peered":"2024-09-14T12:01:18.639297+0000","last_clean":"2024-09-14T12:01:18.639297+0000","last_became_active":"2024-09-14T10:46:50.369492+0000","last_became_peered":"2024-09-14T10:46:50.369492+0000","last_unstale":"2024-09-14T12:01:18.639297+0000","last_undegraded":"2024-09-14T12:01:18.639297+0000","last_fullsized":"2024-09-14T12:01:18.639297+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:49.339369+0000","last_clean_scrub_stamp":"2024-09-14T10:46:49.339369+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:50.804436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49661,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":1034,"num_write":382,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.633068+0000","last_change":"2024-09-14T10:46:52.373456+0000","last_active":"2024-09-14T11:56:55.633068+0000","last_peered":"2024-09-14T11:56:55.633068+0000","last_clean":"2024-09-14T11:56:55.633068+0000","last_became_active":"2024-09-14T10:46:52.372108+0000","last_became_peered":"2024-09-14T10:46:52.372108+0000","last_unstale":"2024-09-14T11:56:55.633068+0000","last_undegraded":"2024-09-14T11:56:55.633068+0000","last_fullsized":"2024-09-14T11:56:55.633068+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:25.122029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"263'125","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:51.176278+0000","last_change":"2024-09-14T10:46:54.385169+0000","last_active":"2024-09-14T12:00:51.176278+0000","last_peered":"2024-09-14T12:00:51.176278+0000","last_clean":"2024-09-14T12:00:51.176278+0000","last_became_active":"2024-09-14T10:46:54.384278+0000","last_became_peered":"2024-09-14T10:46:54.384278+0000","last_unstale":"2024-09-14T12:00:51.176278+0000","last_undegraded":"2024-09-14T12:00:51.176278+0000","last_fullsized":"2024-09-14T12:00:51.176278+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":278,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"263'466","reported_seq":2044,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.585291+0000","last_change":"2024-09-14T12:01:40.585291+0000","last_active":"2024-09-14T12:01:40.585291+0000","last_peered":"2024-09-14T12:01:40.585291+0000","last_clean":"2024-09-14T12:01:40.585291+0000","last_became_active":"2024-09-14T10:46:46.346994+0000","last_became_peered":"2024-09-14T10:46:46.346994+0000","last_unstale":"2024-09-14T12:01:40.585291+0000","last_undegraded":"2024-09-14T12:01:40.585291+0000","last_fullsized":"2024-09-14T12:01:40.585291+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'466","last_scrub_stamp":"2024-09-14T12:01:40.585204+0000","last_deep_scrub":"263'466","last_deep_scrub_stamp":"2024-09-14T12:01:40.585204+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.585204+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:50.174388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2420,"num_read_kb":2273,"num_write":546,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"263'389","reported_seq":1154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.853039+0000","last_change":"2024-09-14T12:01:26.852936+0000","last_active":"2024-09-14T12:01:26.853039+0000","last_peered":"2024-09-14T12:01:26.853039+0000","last_clean":"2024-09-14T12:01:26.853039+0000","last_became_active":"2024-09-14T10:46:44.328946+0000","last_became_peered":"2024-09-14T10:46:44.328946+0000","last_unstale":"2024-09-14T12:01:26.853039+0000","last_undegraded":"2024-09-14T12:01:26.853039+0000","last_fullsized":"2024-09-14T12:01:26.853039+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-14T12:01:26.852803+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-14T12:01:26.852803+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.852803+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:56.352304+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1017,"num_read_kb":28148,"num_write":1233,"num_write_kb":43814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"263'510","reported_seq":2200,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.085089+0000","last_change":"2024-09-14T12:01:34.085089+0000","last_active":"2024-09-14T12:01:34.085089+0000","last_peered":"2024-09-14T12:01:34.085089+0000","last_clean":"2024-09-14T12:01:34.085089+0000","last_became_active":"2024-09-14T10:46:46.343234+0000","last_became_peered":"2024-09-14T10:46:46.343234+0000","last_unstale":"2024-09-14T12:01:34.085089+0000","last_undegraded":"2024-09-14T12:01:34.085089+0000","last_fullsized":"2024-09-14T12:01:34.085089+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'510","last_scrub_stamp":"2024-09-14T12:01:34.084985+0000","last_deep_scrub":"263'510","last_deep_scrub_stamp":"2024-09-14T12:01:34.084985+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.084985+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:57:06.583864+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2663,"num_read_kb":2506,"num_write":583,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"263'344","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.196756+0000","last_change":"2024-09-14T12:01:29.196652+0000","last_active":"2024-09-14T12:01:29.196756+0000","last_peered":"2024-09-14T12:01:29.196756+0000","last_clean":"2024-09-14T12:01:29.196756+0000","last_became_active":"2024-09-14T10:46:44.317349+0000","last_became_peered":"2024-09-14T10:46:44.317349+0000","last_unstale":"2024-09-14T12:01:29.196756+0000","last_undegraded":"2024-09-14T12:01:29.196756+0000","last_fullsized":"2024-09-14T12:01:29.196756+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'344","last_scrub_stamp":"2024-09-14T12:01:29.196487+0000","last_deep_scrub":"263'344","last_deep_scrub_stamp":"2024-09-14T12:01:29.196487+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.196487+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:30.071766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133675,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":5317,"num_write":990,"num_write_kb":25288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"263'447","reported_seq":1996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.498826+0000","last_change":"2024-09-14T10:46:46.347323+0000","last_active":"2024-09-14T11:59:49.498826+0000","last_peered":"2024-09-14T11:59:49.498826+0000","last_clean":"2024-09-14T11:59:49.498826+0000","last_became_active":"2024-09-14T10:46:46.346640+0000","last_became_peered":"2024-09-14T10:46:46.346640+0000","last_unstale":"2024-09-14T11:59:49.498826+0000","last_undegraded":"2024-09-14T11:59:49.498826+0000","last_fullsized":"2024-09-14T11:59:49.498826+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:33.703143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2347,"num_read_kb":2209,"num_write":542,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"263'346","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.774624+0000","last_change":"2024-09-14T12:01:35.774558+0000","last_active":"2024-09-14T12:01:35.774624+0000","last_peered":"2024-09-14T12:01:35.774624+0000","last_clean":"2024-09-14T12:01:35.774624+0000","last_became_active":"2024-09-14T10:46:44.328049+0000","last_became_peered":"2024-09-14T10:46:44.328049+0000","last_unstale":"2024-09-14T12:01:35.774624+0000","last_undegraded":"2024-09-14T12:01:35.774624+0000","last_fullsized":"2024-09-14T12:01:35.774624+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'346","last_scrub_stamp":"2024-09-14T12:01:35.774453+0000","last_deep_scrub":"263'346","last_deep_scrub_stamp":"2024-09-14T12:01:35.774453+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.774453+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:20.558053+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":619,"num_read_kb":2326,"num_write":1082,"num_write_kb":13442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"263'933","reported_seq":2731,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.707652+0000","last_change":"2024-09-14T10:46:46.349041+0000","last_active":"2024-09-14T11:59:34.707652+0000","last_peered":"2024-09-14T11:59:34.707652+0000","last_clean":"2024-09-14T11:59:34.707652+0000","last_became_active":"2024-09-14T10:46:46.346682+0000","last_became_peered":"2024-09-14T10:46:46.346682+0000","last_unstale":"2024-09-14T11:59:34.707652+0000","last_undegraded":"2024-09-14T11:59:34.707652+0000","last_fullsized":"2024-09-14T11:59:34.707652+0000","mapping_epoch":28,"log_start":"263'900","ondisk_log_start":"263'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":900,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:46.804415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4656,"num_read_kb":4197,"num_write":1246,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"263'385","reported_seq":1071,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.363079+0000","last_change":"2024-09-14T12:01:32.363079+0000","last_active":"2024-09-14T12:01:32.363079+0000","last_peered":"2024-09-14T12:01:32.363079+0000","last_clean":"2024-09-14T12:01:32.363079+0000","last_became_active":"2024-09-14T10:47:19.040453+0000","last_became_peered":"2024-09-14T10:47:19.040453+0000","last_unstale":"2024-09-14T12:01:32.363079+0000","last_undegraded":"2024-09-14T12:01:32.363079+0000","last_fullsized":"2024-09-14T12:01:32.363079+0000","mapping_epoch":39,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'385","last_scrub_stamp":"2024-09-14T12:01:32.362951+0000","last_deep_scrub":"263'385","last_deep_scrub_stamp":"2024-09-14T12:01:32.362951+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.362951+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:26.035525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133711,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":707,"num_read_kb":25389,"num_write":1181,"num_write_kb":37274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"263'510","reported_seq":2218,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.299613+0000","last_change":"2024-09-14T12:01:43.299613+0000","last_active":"2024-09-14T12:01:43.299613+0000","last_peered":"2024-09-14T12:01:43.299613+0000","last_clean":"2024-09-14T12:01:43.299613+0000","last_became_active":"2024-09-14T10:46:46.349465+0000","last_became_peered":"2024-09-14T10:46:46.349465+0000","last_unstale":"2024-09-14T12:01:43.299613+0000","last_undegraded":"2024-09-14T12:01:43.299613+0000","last_fullsized":"2024-09-14T12:01:43.299613+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'510","last_scrub_stamp":"2024-09-14T12:01:43.299503+0000","last_deep_scrub":"263'510","last_deep_scrub_stamp":"2024-09-14T12:01:43.299503+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.299503+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:27.070133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2847,"num_read_kb":2662,"num_write":617,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"263'337","reported_seq":1053,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.848911+0000","last_change":"2024-09-14T12:01:27.848911+0000","last_active":"2024-09-14T12:01:27.848911+0000","last_peered":"2024-09-14T12:01:27.848911+0000","last_clean":"2024-09-14T12:01:27.848911+0000","last_became_active":"2024-09-14T10:46:44.320218+0000","last_became_peered":"2024-09-14T10:46:44.320218+0000","last_unstale":"2024-09-14T12:01:27.848911+0000","last_undegraded":"2024-09-14T12:01:27.848911+0000","last_fullsized":"2024-09-14T12:01:27.848911+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'337","last_scrub_stamp":"2024-09-14T12:01:27.848821+0000","last_deep_scrub":"263'337","last_deep_scrub_stamp":"2024-09-14T12:01:27.848821+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.848821+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:48.240608+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":866,"num_read_kb":10863,"num_write":1127,"num_write_kb":35921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"263'438","reported_seq":2119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.258935+0000","last_change":"2024-09-14T12:01:36.258935+0000","last_active":"2024-09-14T12:01:36.258935+0000","last_peered":"2024-09-14T12:01:36.258935+0000","last_clean":"2024-09-14T12:01:36.258935+0000","last_became_active":"2024-09-14T10:46:46.342206+0000","last_became_peered":"2024-09-14T10:46:46.342206+0000","last_unstale":"2024-09-14T12:01:36.258935+0000","last_undegraded":"2024-09-14T12:01:36.258935+0000","last_fullsized":"2024-09-14T12:01:36.258935+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'438","last_scrub_stamp":"2024-09-14T12:01:36.258840+0000","last_deep_scrub":"263'438","last_deep_scrub_stamp":"2024-09-14T12:01:36.258840+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.258840+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:55.906019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2469,"num_read_kb":2360,"num_write":494,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"263'464","reported_seq":1154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.798772+0000","last_change":"2024-09-14T12:01:29.798772+0000","last_active":"2024-09-14T12:01:29.798772+0000","last_peered":"2024-09-14T12:01:29.798772+0000","last_clean":"2024-09-14T12:01:29.798772+0000","last_became_active":"2024-09-14T10:46:44.314466+0000","last_became_peered":"2024-09-14T10:46:44.314466+0000","last_unstale":"2024-09-14T12:01:29.798772+0000","last_undegraded":"2024-09-14T12:01:29.798772+0000","last_fullsized":"2024-09-14T12:01:29.798772+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'464","last_scrub_stamp":"2024-09-14T12:01:29.798635+0000","last_deep_scrub":"263'464","last_deep_scrub_stamp":"2024-09-14T12:01:29.798635+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.798635+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:20.335848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":927,"num_read_kb":16042,"num_write":1243,"num_write_kb":34508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"263'667","reported_seq":2296,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.818030+0000","last_change":"2024-09-14T12:01:39.818030+0000","last_active":"2024-09-14T12:01:39.818030+0000","last_peered":"2024-09-14T12:01:39.818030+0000","last_clean":"2024-09-14T12:01:39.818030+0000","last_became_active":"2024-09-14T10:46:46.342217+0000","last_became_peered":"2024-09-14T10:46:46.342217+0000","last_unstale":"2024-09-14T12:01:39.818030+0000","last_undegraded":"2024-09-14T12:01:39.818030+0000","last_fullsized":"2024-09-14T12:01:39.818030+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'667","last_scrub_stamp":"2024-09-14T12:01:39.817940+0000","last_deep_scrub":"263'667","last_deep_scrub_stamp":"2024-09-14T12:01:39.817940+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.817940+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":600,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:34.611710+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3344,"num_read_kb":3009,"num_write":894,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"263'322","reported_seq":1072,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.858345+0000","last_change":"2024-09-14T12:01:28.858345+0000","last_active":"2024-09-14T12:01:28.858345+0000","last_peered":"2024-09-14T12:01:28.858345+0000","last_clean":"2024-09-14T12:01:28.858345+0000","last_became_active":"2024-09-14T10:46:44.323339+0000","last_became_peered":"2024-09-14T10:46:44.323339+0000","last_unstale":"2024-09-14T12:01:28.858345+0000","last_undegraded":"2024-09-14T12:01:28.858345+0000","last_fullsized":"2024-09-14T12:01:28.858345+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'322","last_scrub_stamp":"2024-09-14T12:01:28.858232+0000","last_deep_scrub":"263'322","last_deep_scrub_stamp":"2024-09-14T12:01:28.858232+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.858232+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:01.869819+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":616,"num_read_kb":14372,"num_write":932,"num_write_kb":14595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'445","reported_seq":1985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.722923+0000","last_change":"2024-09-14T12:01:31.722923+0000","last_active":"2024-09-14T12:01:31.722923+0000","last_peered":"2024-09-14T12:01:31.722923+0000","last_clean":"2024-09-14T12:01:31.722923+0000","last_became_active":"2024-09-14T10:46:46.341731+0000","last_became_peered":"2024-09-14T10:46:46.341731+0000","last_unstale":"2024-09-14T12:01:31.722923+0000","last_undegraded":"2024-09-14T12:01:31.722923+0000","last_fullsized":"2024-09-14T12:01:31.722923+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'445","last_scrub_stamp":"2024-09-14T12:01:31.722836+0000","last_deep_scrub":"263'445","last_deep_scrub_stamp":"2024-09-14T12:01:31.722836+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.722836+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:48.676362+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2390,"num_read_kb":2239,"num_write":538,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"263'379","reported_seq":1098,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.300705+0000","last_change":"2024-09-14T12:01:34.300705+0000","last_active":"2024-09-14T12:01:34.300705+0000","last_peered":"2024-09-14T12:01:34.300705+0000","last_clean":"2024-09-14T12:01:34.300705+0000","last_became_active":"2024-09-14T10:46:44.321604+0000","last_became_peered":"2024-09-14T10:46:44.321604+0000","last_unstale":"2024-09-14T12:01:34.300705+0000","last_undegraded":"2024-09-14T12:01:34.300705+0000","last_fullsized":"2024-09-14T12:01:34.300705+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'379","last_scrub_stamp":"2024-09-14T12:01:34.300564+0000","last_deep_scrub":"263'379","last_deep_scrub_stamp":"2024-09-14T12:01:34.300564+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.300564+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:20.332645+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":797,"num_read_kb":33592,"num_write":1248,"num_write_kb":22096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"263'972","reported_seq":2689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.009007+0000","last_change":"2024-09-14T12:01:40.009007+0000","last_active":"2024-09-14T12:01:40.009007+0000","last_peered":"2024-09-14T12:01:40.009007+0000","last_clean":"2024-09-14T12:01:40.009007+0000","last_became_active":"2024-09-14T10:46:46.336508+0000","last_became_peered":"2024-09-14T10:46:46.336508+0000","last_unstale":"2024-09-14T12:01:40.009007+0000","last_undegraded":"2024-09-14T12:01:40.009007+0000","last_fullsized":"2024-09-14T12:01:40.009007+0000","mapping_epoch":28,"log_start":"263'900","ondisk_log_start":"263'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'972","last_scrub_stamp":"2024-09-14T12:01:40.008921+0000","last_deep_scrub":"263'972","last_deep_scrub_stamp":"2024-09-14T12:01:40.008921+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.008921+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":900,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:56.378084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4671,"num_read_kb":4174,"num_write":1327,"num_write_kb":556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"263'317","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.711783+0000","last_change":"2024-09-14T12:01:38.711783+0000","last_active":"2024-09-14T12:01:38.711783+0000","last_peered":"2024-09-14T12:01:38.711783+0000","last_clean":"2024-09-14T12:01:38.711783+0000","last_became_active":"2024-09-14T10:46:44.321073+0000","last_became_peered":"2024-09-14T10:46:44.321073+0000","last_unstale":"2024-09-14T12:01:38.711783+0000","last_undegraded":"2024-09-14T12:01:38.711783+0000","last_fullsized":"2024-09-14T12:01:38.711783+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-14T12:01:38.711668+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-14T12:01:38.711668+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.711668+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:25.942500+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":672,"num_read_kb":7284,"num_write":1109,"num_write_kb":7346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"263'355","reported_seq":1815,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.294986+0000","last_change":"2024-09-14T12:01:37.294986+0000","last_active":"2024-09-14T12:01:37.294986+0000","last_peered":"2024-09-14T12:01:37.294986+0000","last_clean":"2024-09-14T12:01:37.294986+0000","last_became_active":"2024-09-14T10:46:46.341188+0000","last_became_peered":"2024-09-14T10:46:46.341188+0000","last_unstale":"2024-09-14T12:01:37.294986+0000","last_undegraded":"2024-09-14T12:01:37.294986+0000","last_fullsized":"2024-09-14T12:01:37.294986+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'355","last_scrub_stamp":"2024-09-14T12:01:37.294901+0000","last_deep_scrub":"263'355","last_deep_scrub_stamp":"2024-09-14T12:01:37.294901+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.294901+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:47.263774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1965,"num_read_kb":1883,"num_write":389,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"263'399","reported_seq":1067,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.336267+0000","last_change":"2024-09-14T12:01:33.336267+0000","last_active":"2024-09-14T12:01:33.336267+0000","last_peered":"2024-09-14T12:01:33.336267+0000","last_clean":"2024-09-14T12:01:33.336267+0000","last_became_active":"2024-09-14T10:46:44.316633+0000","last_became_peered":"2024-09-14T10:46:44.316633+0000","last_unstale":"2024-09-14T12:01:33.336267+0000","last_undegraded":"2024-09-14T12:01:33.336267+0000","last_fullsized":"2024-09-14T12:01:33.336267+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'399","last_scrub_stamp":"2024-09-14T12:01:33.336171+0000","last_deep_scrub":"263'399","last_deep_scrub_stamp":"2024-09-14T12:01:33.336171+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.336171+0000","objects_scrubbed":5,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:15.311699+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":793,"num_read_kb":2329,"num_write":1224,"num_write_kb":27267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"263'778","reported_seq":2432,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.462116+0000","last_change":"2024-09-14T10:46:46.348188+0000","last_active":"2024-09-14T11:58:58.462116+0000","last_peered":"2024-09-14T11:58:58.462116+0000","last_clean":"2024-09-14T11:58:58.462116+0000","last_became_active":"2024-09-14T10:46:46.347941+0000","last_became_peered":"2024-09-14T10:46:46.347941+0000","last_unstale":"2024-09-14T11:58:58.462116+0000","last_undegraded":"2024-09-14T11:58:58.462116+0000","last_fullsized":"2024-09-14T11:58:58.462116+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:45.315864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:45.315864+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:09.760195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3936,"num_read_kb":3604,"num_write":1011,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"263'350","reported_seq":1120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.684970+0000","last_change":"2024-09-14T12:01:28.684970+0000","last_active":"2024-09-14T12:01:28.684970+0000","last_peered":"2024-09-14T12:01:28.684970+0000","last_clean":"2024-09-14T12:01:28.684970+0000","last_became_active":"2024-09-14T10:46:44.322149+0000","last_became_peered":"2024-09-14T10:46:44.322149+0000","last_unstale":"2024-09-14T12:01:28.684970+0000","last_undegraded":"2024-09-14T12:01:28.684970+0000","last_fullsized":"2024-09-14T12:01:28.684970+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-14T12:01:28.684867+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-14T12:01:28.684867+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.684867+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:58.788732+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":929,"num_read_kb":38620,"num_write":1197,"num_write_kb":16629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"263'793","reported_seq":2354,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.706954+0000","last_change":"2024-09-14T12:01:33.706954+0000","last_active":"2024-09-14T12:01:33.706954+0000","last_peered":"2024-09-14T12:01:33.706954+0000","last_clean":"2024-09-14T12:01:33.706954+0000","last_became_active":"2024-09-14T10:46:46.340475+0000","last_became_peered":"2024-09-14T10:46:46.340475+0000","last_unstale":"2024-09-14T12:01:33.706954+0000","last_undegraded":"2024-09-14T12:01:33.706954+0000","last_fullsized":"2024-09-14T12:01:33.706954+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'793","last_scrub_stamp":"2024-09-14T12:01:33.706869+0000","last_deep_scrub":"263'793","last_deep_scrub_stamp":"2024-09-14T12:01:33.706869+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.706869+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:55.128887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3820,"num_read_kb":3456,"num_write":1020,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"263'314","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.690051+0000","last_change":"2024-09-14T12:01:33.690051+0000","last_active":"2024-09-14T12:01:33.690051+0000","last_peered":"2024-09-14T12:01:33.690051+0000","last_clean":"2024-09-14T12:01:33.690051+0000","last_became_active":"2024-09-14T10:46:44.329386+0000","last_became_peered":"2024-09-14T10:46:44.329386+0000","last_unstale":"2024-09-14T12:01:33.690051+0000","last_undegraded":"2024-09-14T12:01:33.690051+0000","last_fullsized":"2024-09-14T12:01:33.690051+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'314","last_scrub_stamp":"2024-09-14T12:01:33.689906+0000","last_deep_scrub":"263'314","last_deep_scrub_stamp":"2024-09-14T12:01:33.689906+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.689906+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:13.669972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133721,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":628,"num_read_kb":13742,"num_write":1168,"num_write_kb":24265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"263'490","reported_seq":2197,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.754429+0000","last_change":"2024-09-14T12:01:32.754429+0000","last_active":"2024-09-14T12:01:32.754429+0000","last_peered":"2024-09-14T12:01:32.754429+0000","last_clean":"2024-09-14T12:01:32.754429+0000","last_became_active":"2024-09-14T10:46:46.351291+0000","last_became_peered":"2024-09-14T10:46:46.351291+0000","last_unstale":"2024-09-14T12:01:32.754429+0000","last_undegraded":"2024-09-14T12:01:32.754429+0000","last_fullsized":"2024-09-14T12:01:32.754429+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'490","last_scrub_stamp":"2024-09-14T12:01:32.754339+0000","last_deep_scrub":"263'490","last_deep_scrub_stamp":"2024-09-14T12:01:32.754339+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.754339+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:32.023682+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2678,"num_read_kb":2537,"num_write":593,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":894,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"263'343","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.241182+0000","last_change":"2024-09-14T12:01:31.241182+0000","last_active":"2024-09-14T12:01:31.241182+0000","last_peered":"2024-09-14T12:01:31.241182+0000","last_clean":"2024-09-14T12:01:31.241182+0000","last_became_active":"2024-09-14T10:46:44.328509+0000","last_became_peered":"2024-09-14T10:46:44.328509+0000","last_unstale":"2024-09-14T12:01:31.241182+0000","last_undegraded":"2024-09-14T12:01:31.241182+0000","last_fullsized":"2024-09-14T12:01:31.241182+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-14T12:01:31.241061+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-14T12:01:31.241061+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.241061+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:17.044831+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":629,"num_read_kb":8535,"num_write":1026,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"263'632","reported_seq":2315,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.069205+0000","last_change":"2024-09-14T12:01:36.069205+0000","last_active":"2024-09-14T12:01:36.069205+0000","last_peered":"2024-09-14T12:01:36.069205+0000","last_clean":"2024-09-14T12:01:36.069205+0000","last_became_active":"2024-09-14T10:46:46.343264+0000","last_became_peered":"2024-09-14T10:46:46.343264+0000","last_unstale":"2024-09-14T12:01:36.069205+0000","last_undegraded":"2024-09-14T12:01:36.069205+0000","last_fullsized":"2024-09-14T12:01:36.069205+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'632","last_scrub_stamp":"2024-09-14T12:01:36.069122+0000","last_deep_scrub":"263'632","last_deep_scrub_stamp":"2024-09-14T12:01:36.069122+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.069122+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":600,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:42.345376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3383,"num_read_kb":3097,"num_write":846,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"263'340","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.726684+0000","last_change":"2024-09-14T12:01:37.726684+0000","last_active":"2024-09-14T12:01:37.726684+0000","last_peered":"2024-09-14T12:01:37.726684+0000","last_clean":"2024-09-14T12:01:37.726684+0000","last_became_active":"2024-09-14T10:46:44.334832+0000","last_became_peered":"2024-09-14T10:46:44.334832+0000","last_unstale":"2024-09-14T12:01:37.726684+0000","last_undegraded":"2024-09-14T12:01:37.726684+0000","last_fullsized":"2024-09-14T12:01:37.726684+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-14T12:01:37.726545+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-14T12:01:37.726545+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.726545+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:30.213654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":614,"num_read_kb":31835,"num_write":1126,"num_write_kb":37799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"263'1874","reported_seq":3540,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.633710+0000","last_change":"2024-09-14T12:01:39.633710+0000","last_active":"2024-09-14T12:01:39.633710+0000","last_peered":"2024-09-14T12:01:39.633710+0000","last_clean":"2024-09-14T12:01:39.633710+0000","last_became_active":"2024-09-14T10:46:46.344246+0000","last_became_peered":"2024-09-14T10:46:46.344246+0000","last_unstale":"2024-09-14T12:01:39.633710+0000","last_undegraded":"2024-09-14T12:01:39.633710+0000","last_fullsized":"2024-09-14T12:01:39.633710+0000","mapping_epoch":28,"log_start":"263'1800","ondisk_log_start":"263'1800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1874","last_scrub_stamp":"2024-09-14T12:01:39.633604+0000","last_deep_scrub":"263'1874","last_deep_scrub_stamp":"2024-09-14T12:01:39.633604+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.633604+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":1800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:47.360631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8234,"num_read_kb":7178,"num_write":2635,"num_write_kb":1169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"263'380","reported_seq":1034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.159937+0000","last_change":"2024-09-14T12:01:30.159937+0000","last_active":"2024-09-14T12:01:30.159937+0000","last_peered":"2024-09-14T12:01:30.159937+0000","last_clean":"2024-09-14T12:01:30.159937+0000","last_became_active":"2024-09-14T10:46:44.331468+0000","last_became_peered":"2024-09-14T10:46:44.331468+0000","last_unstale":"2024-09-14T12:01:30.159937+0000","last_undegraded":"2024-09-14T12:01:30.159937+0000","last_fullsized":"2024-09-14T12:01:30.159937+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'380","last_scrub_stamp":"2024-09-14T12:01:30.159811+0000","last_deep_scrub":"263'380","last_deep_scrub_stamp":"2024-09-14T12:01:30.159811+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.159811+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:37.605807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":628,"num_read_kb":40986,"num_write":1142,"num_write_kb":50458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"263'599","reported_seq":2264,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.678606+0000","last_change":"2024-09-14T12:01:34.678606+0000","last_active":"2024-09-14T12:01:34.678606+0000","last_peered":"2024-09-14T12:01:34.678606+0000","last_clean":"2024-09-14T12:01:34.678606+0000","last_became_active":"2024-09-14T10:46:46.351379+0000","last_became_peered":"2024-09-14T10:46:46.351379+0000","last_unstale":"2024-09-14T12:01:34.678606+0000","last_undegraded":"2024-09-14T12:01:34.678606+0000","last_fullsized":"2024-09-14T12:01:34.678606+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'599","last_scrub_stamp":"2024-09-14T12:01:34.678513+0000","last_deep_scrub":"263'599","last_deep_scrub_stamp":"2024-09-14T12:01:34.678513+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.678513+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:37.519527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3319,"num_read_kb":3081,"num_write":803,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"263'409","reported_seq":1134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.821133+0000","last_change":"2024-09-14T12:01:31.821133+0000","last_active":"2024-09-14T12:01:31.821133+0000","last_peered":"2024-09-14T12:01:31.821133+0000","last_clean":"2024-09-14T12:01:31.821133+0000","last_became_active":"2024-09-14T10:47:18.421420+0000","last_became_peered":"2024-09-14T10:47:18.421420+0000","last_unstale":"2024-09-14T12:01:31.821133+0000","last_undegraded":"2024-09-14T12:01:31.821133+0000","last_fullsized":"2024-09-14T12:01:31.821133+0000","mapping_epoch":39,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'409","last_scrub_stamp":"2024-09-14T12:01:31.821006+0000","last_deep_scrub":"263'409","last_deep_scrub_stamp":"2024-09-14T12:01:31.821006+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.821006+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:29.377483+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1006,"num_read_kb":55242,"num_write":1376,"num_write_kb":21886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.30","version":"263'358","reported_seq":1068,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.667671+0000","last_change":"2024-09-14T12:01:39.667671+0000","last_active":"2024-09-14T12:01:39.667671+0000","last_peered":"2024-09-14T12:01:39.667671+0000","last_clean":"2024-09-14T12:01:39.667671+0000","last_became_active":"2024-09-14T10:46:44.336397+0000","last_became_peered":"2024-09-14T10:46:44.336397+0000","last_unstale":"2024-09-14T12:01:39.667671+0000","last_undegraded":"2024-09-14T12:01:39.667671+0000","last_fullsized":"2024-09-14T12:01:39.667671+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-09-14T12:01:39.667554+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-09-14T12:01:39.667554+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.667554+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:53.690379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":768,"num_read_kb":58312,"num_write":1211,"num_write_kb":50973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"263'439","reported_seq":2132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.593906+0000","last_change":"2024-09-14T12:01:41.593906+0000","last_active":"2024-09-14T12:01:41.593906+0000","last_peered":"2024-09-14T12:01:41.593906+0000","last_clean":"2024-09-14T12:01:41.593906+0000","last_became_active":"2024-09-14T10:46:46.352396+0000","last_became_peered":"2024-09-14T10:46:46.352396+0000","last_unstale":"2024-09-14T12:01:41.593906+0000","last_undegraded":"2024-09-14T12:01:41.593906+0000","last_fullsized":"2024-09-14T12:01:41.593906+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'439","last_scrub_stamp":"2024-09-14T12:01:41.593806+0000","last_deep_scrub":"263'439","last_deep_scrub_stamp":"2024-09-14T12:01:41.593806+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.593806+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:50.381664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2667,"num_read_kb":2535,"num_write":508,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2571,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"263'294","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.295648+0000","last_change":"2024-09-14T12:01:35.295648+0000","last_active":"2024-09-14T12:01:35.295648+0000","last_peered":"2024-09-14T12:01:35.295648+0000","last_clean":"2024-09-14T12:01:35.295648+0000","last_became_active":"2024-09-14T10:46:44.331494+0000","last_became_peered":"2024-09-14T10:46:44.331494+0000","last_unstale":"2024-09-14T12:01:35.295648+0000","last_undegraded":"2024-09-14T12:01:35.295648+0000","last_fullsized":"2024-09-14T12:01:35.295648+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-14T12:01:35.295543+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-14T12:01:35.295543+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.295543+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:19.923292+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048962,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":471,"num_read_kb":43363,"num_write":903,"num_write_kb":33511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"263'474","reported_seq":1984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.684079+0000","last_change":"2024-09-14T12:01:38.684020+0000","last_active":"2024-09-14T12:01:38.684079+0000","last_peered":"2024-09-14T12:01:38.684079+0000","last_clean":"2024-09-14T12:01:38.684079+0000","last_became_active":"2024-09-14T10:46:46.339440+0000","last_became_peered":"2024-09-14T10:46:46.339440+0000","last_unstale":"2024-09-14T12:01:38.684079+0000","last_undegraded":"2024-09-14T12:01:38.684079+0000","last_fullsized":"2024-09-14T12:01:38.684079+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'474","last_scrub_stamp":"2024-09-14T12:01:38.683932+0000","last_deep_scrub":"263'474","last_deep_scrub_stamp":"2024-09-14T12:01:38.683932+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.683932+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:27.526192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2508,"num_read_kb":2330,"num_write":579,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9256,"num_read_kb":6632,"num_write":2794,"num_write_kb":850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":943,"ondisk_log_size":943,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15505,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":15201,"num_read_kb":14853,"num_write":17064,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1688,"ondisk_log_size":1688,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":556,"ondisk_log_size":556,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1549008,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":19140,"num_read_kb":39857,"num_write":16035,"num_write_kb":12077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":540894,"num_omap_keys":1222,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1809,"ondisk_log_size":1809,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2425,"num_read_kb":2892,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":218145,"num_read_kb":199614,"num_write":55573,"num_write_kb":18950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":28959,"num_omap_keys":117,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4110,"ondisk_log_size":4110,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":30929583,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":44270,"num_read_kb":1895605,"num_write":71703,"num_write_kb":2068626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":47898624,"data_stored":47898624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3414,"ondisk_log_size":3414,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":184539,"num_write":157,"num_write_kb":126109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":184485,"num_write":157,"num_write_kb":126109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510351,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":225012,"kb_used_data":9252,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":94146828,"statfs":{"total":96636764160,"available":96406351872,"internally_reserved":0,"allocated":9474048,"data_stored":7497795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":220920266},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510350,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":205024,"kb_used_data":11472,"kb_used_omap":1,"kb_used_meta":193534,"kb_avail":94166816,"statfs":{"total":96636764160,"available":96426819584,"internally_reserved":0,"allocated":11747328,"data_stored":9764047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":198179269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510350,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243888,"kb_used_data":14176,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94127952,"statfs":{"total":96636764160,"available":96387022848,"internally_reserved":0,"allocated":14516224,"data_stored":12527301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510350,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127356,"kb_used_data":10092,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94244484,"statfs":{"total":96636764160,"available":96506351616,"internally_reserved":0,"allocated":10334208,"data_stored":8364267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510349,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320308,"kb_used_data":10084,"kb_used_omap":1,"kb_used_meta":310206,"kb_avail":94051532,"statfs":{"total":96636764160,"available":96308768768,"internally_reserved":0,"allocated":10326016,"data_stored":8344841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":317651397},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510349,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112076,"kb_used_data":8700,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94259764,"statfs":{"total":96636764160,"available":96521998336,"internally_reserved":0,"allocated":8908800,"data_stored":6901467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543052,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137180,"kb_used_data":7500,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94234660,"statfs":{"total":96636764160,"available":96496291840,"internally_reserved":0,"allocated":7680000,"data_stored":5672286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132774343},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575758,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":283548,"kb_used_data":9420,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94088292,"statfs":{"total":96636764160,"available":96346411008,"internally_reserved":0,"allocated":9646080,"data_stored":7654490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4694016,"data_stored":4694016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5550080,"data_stored":5550080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6160384,"data_stored":6160384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10321920,"data_stored":10321920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7557120,"data_stored":7557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4857856,"data_stored":4857856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3465216,"data_stored":3465216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5292032,"data_stored":5292032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:01:48.052 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.052 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.052 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.052 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.052 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.052 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.053 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.053 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.053 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.053 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.053 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.053 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.053 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.053 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.053 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.053 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.054 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.054 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.054 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.054 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.054 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.054 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.054 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.054 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.054 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.054 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.054 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.055 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.055 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.055 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.055 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.055 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.055 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.055 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.055 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.055 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.055 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.056 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.056 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.056 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.056 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.056 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.056 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.056 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.056 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.056 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.056 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.057 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.057 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.057 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.057 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.057 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.057 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.057 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.057 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.057 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.057 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.058 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.058 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.058 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.058 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.058 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.058 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.058 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.058 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.058 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.058 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.058 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.059 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.059 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.059 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.059 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.059 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.059 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.059 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.059 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.059 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.059 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.059 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.060 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.060 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.060 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.060 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.060 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.060 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.060 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.060 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.060 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.060 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.061 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.061 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.061 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.061 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.061 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.061 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.061 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.061 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.061 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.061 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.062 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.062 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.062 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.062 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.062 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.062 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.062 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.062 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.062 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.062 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.062 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.063 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.063 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.063 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.063 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.063 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.063 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.063 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.063 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.063 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.063 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.064 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.064 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.064 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.064 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.064 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.064 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.064 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.064 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.064 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.064 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.065 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.065 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.065 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.065 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.065 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.065 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.065 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.065 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.066 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.066 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.066 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.066 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.066 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.066 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.066 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.066 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.066 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.067 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.067 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.067 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.067 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.067 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.067 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.067 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.067 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.067 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.068 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.068 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.068 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.068 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.068 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.068 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.068 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.068 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.068 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.069 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.069 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.069 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.069 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.069 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.069 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.069 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.069 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.069 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.070 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.070 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.070 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.070 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.070 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.070 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.070 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.070 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.071 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.071 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.071 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.071 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.071 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.071 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.071 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.071 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.072 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.072 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.072 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.072 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.072 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.072 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.072 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.072 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.072 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.072 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.073 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.073 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.073 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.073 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.073 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.073 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.073 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.073 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.073 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.074 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.074 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.074 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.074 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.074 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.074 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.074 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.074 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.074 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.075 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.075 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.075 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.075 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.075 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.075 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.075 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.075 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.075 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.075 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.076 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-14T10:46:47.329724+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.076 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T10:46:49.339369+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.076 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.076 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.076 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.076 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.077 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-14T10:46:45.315864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:01:48.077 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T12:02:08.078 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:02:08.463 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T12:02:08.474 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-14T12:02:08.477 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":2527,"stamp":"2024-09-14T12:02:07.045818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":33086276,"num_objects":745,"num_object_clones":0,"num_object_copies":1770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":745,"num_whiteouts":0,"num_read":308787,"num_read_kb":2528544,"num_write":163626,"num_write_kb":2359360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":750659,"num_omap_keys":1783,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12860,"ondisk_log_size":12860,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1662712,"kb_used_data":80696,"kb_used_omap":12,"kb_used_meta":1581875,"kb_avail":753312008,"statfs":{"total":773094113280,"available":771391496192,"internally_reserved":0,"allocated":82632704,"data_stored":66726494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1619840561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":140110,"num_omap_keys":348,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005594"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:03.257683+0000","last_change":"2024-09-14T12:02:03.257683+0000","last_active":"2024-09-14T12:02:03.257683+0000","last_peered":"2024-09-14T12:02:03.257683+0000","last_clean":"2024-09-14T12:02:03.257683+0000","last_became_active":"2024-09-14T11:25:20.212282+0000","last_became_peered":"2024-09-14T11:25:20.212282+0000","last_unstale":"2024-09-14T12:02:03.257683+0000","last_undegraded":"2024-09-14T12:02:03.257683+0000","last_fullsized":"2024-09-14T12:02:03.257683+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:03.257592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:03.257592+0000","last_clean_scrub_stamp":"2024-09-14T12:02:03.257592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:34.271743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:00.646533+0000","last_change":"2024-09-14T12:02:00.646533+0000","last_active":"2024-09-14T12:02:00.646533+0000","last_peered":"2024-09-14T12:02:00.646533+0000","last_clean":"2024-09-14T12:02:00.646533+0000","last_became_active":"2024-09-14T11:06:45.982702+0000","last_became_peered":"2024-09-14T11:06:45.982702+0000","last_unstale":"2024-09-14T12:02:00.646533+0000","last_undegraded":"2024-09-14T12:02:00.646533+0000","last_fullsized":"2024-09-14T12:02:00.646533+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:02:00.646437+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:02:00.646437+0000","last_clean_scrub_stamp":"2024-09-14T12:02:00.646437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:31.012809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:04.124732+0000","last_change":"2024-09-14T12:02:04.124732+0000","last_active":"2024-09-14T12:02:04.124732+0000","last_peered":"2024-09-14T12:02:04.124732+0000","last_clean":"2024-09-14T12:02:04.124732+0000","last_became_active":"2024-09-14T11:06:41.918259+0000","last_became_peered":"2024-09-14T11:06:41.918259+0000","last_unstale":"2024-09-14T12:02:04.124732+0000","last_undegraded":"2024-09-14T12:02:04.124732+0000","last_fullsized":"2024-09-14T12:02:04.124732+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:04.124640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:04.124640+0000","last_clean_scrub_stamp":"2024-09-14T12:02:04.124640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:50.520541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'53","reported_seq":204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.650174+0000","last_change":"2024-09-14T11:02:34.872954+0000","last_active":"2024-09-14T11:58:50.650174+0000","last_peered":"2024-09-14T11:58:50.650174+0000","last_clean":"2024-09-14T11:58:50.650174+0000","last_became_active":"2024-09-14T11:02:34.872682+0000","last_became_peered":"2024-09-14T11:02:34.872682+0000","last_unstale":"2024-09-14T11:58:50.650174+0000","last_undegraded":"2024-09-14T11:58:50.650174+0000","last_fullsized":"2024-09-14T11:58:50.650174+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:01.174737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":419,"num_read_kb":273,"num_write":133,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:53.517430+0000","last_change":"2024-09-14T11:25:20.206920+0000","last_active":"2024-09-14T11:57:53.517430+0000","last_peered":"2024-09-14T11:57:53.517430+0000","last_clean":"2024-09-14T11:57:53.517430+0000","last_became_active":"2024-09-14T11:25:20.206601+0000","last_became_peered":"2024-09-14T11:25:20.206601+0000","last_unstale":"2024-09-14T11:57:53.517430+0000","last_undegraded":"2024-09-14T11:57:53.517430+0000","last_fullsized":"2024-09-14T11:57:53.517430+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:13.234370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"263'13","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.358756+0000","last_change":"2024-09-14T11:06:45.992917+0000","last_active":"2024-09-14T12:01:18.358756+0000","last_peered":"2024-09-14T12:01:18.358756+0000","last_clean":"2024-09-14T12:01:18.358756+0000","last_became_active":"2024-09-14T11:06:45.992612+0000","last_became_peered":"2024-09-14T11:06:45.992612+0000","last_unstale":"2024-09-14T12:01:18.358756+0000","last_undegraded":"2024-09-14T12:01:18.358756+0000","last_fullsized":"2024-09-14T12:01:18.358756+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13883,"num_write":28,"num_write_kb":14907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"263'4","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:19.117168+0000","last_change":"2024-09-14T11:06:41.912107+0000","last_active":"2024-09-14T12:01:19.117168+0000","last_peered":"2024-09-14T12:01:19.117168+0000","last_clean":"2024-09-14T12:01:19.117168+0000","last_became_active":"2024-09-14T11:06:41.911807+0000","last_became_peered":"2024-09-14T11:06:41.911807+0000","last_unstale":"2024-09-14T12:01:19.117168+0000","last_undegraded":"2024-09-14T12:01:19.117168+0000","last_fullsized":"2024-09-14T12:01:19.117168+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":621,"num_write":4,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"263'41","reported_seq":172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.650153+0000","last_change":"2024-09-14T11:02:34.879623+0000","last_active":"2024-09-14T11:58:50.650153+0000","last_peered":"2024-09-14T11:58:50.650153+0000","last_clean":"2024-09-14T11:58:50.650153+0000","last_became_active":"2024-09-14T11:02:34.879272+0000","last_became_peered":"2024-09-14T11:02:34.879272+0000","last_unstale":"2024-09-14T11:58:50.650153+0000","last_undegraded":"2024-09-14T11:58:50.650153+0000","last_fullsized":"2024-09-14T11:58:50.650153+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:46.038847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":323,"num_read_kb":209,"num_write":113,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:03.624003+0000","last_change":"2024-09-14T12:02:03.624003+0000","last_active":"2024-09-14T12:02:03.624003+0000","last_peered":"2024-09-14T12:02:03.624003+0000","last_clean":"2024-09-14T12:02:03.624003+0000","last_became_active":"2024-09-14T11:25:20.207226+0000","last_became_peered":"2024-09-14T11:25:20.207226+0000","last_unstale":"2024-09-14T12:02:03.624003+0000","last_undegraded":"2024-09-14T12:02:03.624003+0000","last_fullsized":"2024-09-14T12:02:03.624003+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:03.623912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:03.623912+0000","last_clean_scrub_stamp":"2024-09-14T12:02:03.623912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:53.903225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.461362+0000","last_change":"2024-09-14T11:06:45.981984+0000","last_active":"2024-09-14T11:58:53.461362+0000","last_peered":"2024-09-14T11:58:53.461362+0000","last_clean":"2024-09-14T11:58:53.461362+0000","last_became_active":"2024-09-14T11:06:45.981705+0000","last_became_peered":"2024-09-14T11:06:45.981705+0000","last_unstale":"2024-09-14T11:58:53.461362+0000","last_undegraded":"2024-09-14T11:58:53.461362+0000","last_fullsized":"2024-09-14T11:58:53.461362+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:53.066712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:05.145835+0000","last_change":"2024-09-14T12:02:05.145835+0000","last_active":"2024-09-14T12:02:05.145835+0000","last_peered":"2024-09-14T12:02:05.145835+0000","last_clean":"2024-09-14T12:02:05.145835+0000","last_became_active":"2024-09-14T11:06:41.917774+0000","last_became_peered":"2024-09-14T11:06:41.917774+0000","last_unstale":"2024-09-14T12:02:05.145835+0000","last_undegraded":"2024-09-14T12:02:05.145835+0000","last_fullsized":"2024-09-14T12:02:05.145835+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:05.145751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:05.145751+0000","last_clean_scrub_stamp":"2024-09-14T12:02:05.145751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:52.597873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'20","reported_seq":113,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:02.848808+0000","last_change":"2024-09-14T12:02:02.848808+0000","last_active":"2024-09-14T12:02:02.848808+0000","last_peered":"2024-09-14T12:02:02.848808+0000","last_clean":"2024-09-14T12:02:02.848808+0000","last_became_active":"2024-09-14T11:02:34.874685+0000","last_became_peered":"2024-09-14T11:02:34.874685+0000","last_unstale":"2024-09-14T12:02:02.848808+0000","last_undegraded":"2024-09-14T12:02:02.848808+0000","last_fullsized":"2024-09-14T12:02:02.848808+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'20","last_scrub_stamp":"2024-09-14T12:02:02.848728+0000","last_deep_scrub":"263'20","last_deep_scrub_stamp":"2024-09-14T12:02:02.848728+0000","last_clean_scrub_stamp":"2024-09-14T12:02:02.848728+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:02.320040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":99,"num_write":50,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.465555+0000","last_change":"2024-09-14T11:25:20.211504+0000","last_active":"2024-09-14T11:59:18.465555+0000","last_peered":"2024-09-14T11:59:18.465555+0000","last_clean":"2024-09-14T11:59:18.465555+0000","last_became_active":"2024-09-14T11:25:20.211190+0000","last_became_peered":"2024-09-14T11:25:20.211190+0000","last_unstale":"2024-09-14T11:59:18.465555+0000","last_undegraded":"2024-09-14T11:59:18.465555+0000","last_fullsized":"2024-09-14T11:59:18.465555+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"263'7","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:58.480804+0000","last_change":"2024-09-14T11:06:45.980127+0000","last_active":"2024-09-14T12:00:58.480804+0000","last_peered":"2024-09-14T12:00:58.480804+0000","last_clean":"2024-09-14T12:00:58.480804+0000","last_became_active":"2024-09-14T11:06:45.979801+0000","last_became_peered":"2024-09-14T11:06:45.979801+0000","last_unstale":"2024-09-14T12:00:58.480804+0000","last_undegraded":"2024-09-14T12:00:58.480804+0000","last_fullsized":"2024-09-14T12:00:58.480804+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:14.264168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"263'5","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:59.646348+0000","last_change":"2024-09-14T12:01:59.646348+0000","last_active":"2024-09-14T12:01:59.646348+0000","last_peered":"2024-09-14T12:01:59.646348+0000","last_clean":"2024-09-14T12:01:59.646348+0000","last_became_active":"2024-09-14T11:06:41.905007+0000","last_became_peered":"2024-09-14T11:06:41.905007+0000","last_unstale":"2024-09-14T12:01:59.646348+0000","last_undegraded":"2024-09-14T12:01:59.646348+0000","last_fullsized":"2024-09-14T12:01:59.646348+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T12:01:59.646259+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T12:01:59.646259+0000","last_clean_scrub_stamp":"2024-09-14T12:01:59.646259+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:58.113799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'31","reported_seq":140,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:00.773925+0000","last_change":"2024-09-14T12:02:00.773925+0000","last_active":"2024-09-14T12:02:00.773925+0000","last_peered":"2024-09-14T12:02:00.773925+0000","last_clean":"2024-09-14T12:02:00.773925+0000","last_became_active":"2024-09-14T11:02:34.873091+0000","last_became_peered":"2024-09-14T11:02:34.873091+0000","last_unstale":"2024-09-14T12:02:00.773925+0000","last_undegraded":"2024-09-14T12:02:00.773925+0000","last_fullsized":"2024-09-14T12:02:00.773925+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-14T12:02:00.773836+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-14T12:02:00.773836+0000","last_clean_scrub_stamp":"2024-09-14T12:02:00.773836+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:51.275587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":154,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.455682+0000","last_change":"2024-09-14T11:25:20.213420+0000","last_active":"2024-09-14T11:59:25.455682+0000","last_peered":"2024-09-14T11:59:25.455682+0000","last_clean":"2024-09-14T11:59:25.455682+0000","last_became_active":"2024-09-14T11:25:20.213064+0000","last_became_peered":"2024-09-14T11:25:20.213064+0000","last_unstale":"2024-09-14T11:59:25.455682+0000","last_undegraded":"2024-09-14T11:59:25.455682+0000","last_fullsized":"2024-09-14T11:59:25.455682+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:55.006063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"263'7","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:58.317434+0000","last_change":"2024-09-14T12:01:58.317434+0000","last_active":"2024-09-14T12:01:58.317434+0000","last_peered":"2024-09-14T12:01:58.317434+0000","last_clean":"2024-09-14T12:01:58.317434+0000","last_became_active":"2024-09-14T11:06:45.977225+0000","last_became_peered":"2024-09-14T11:06:45.977225+0000","last_unstale":"2024-09-14T12:01:58.317434+0000","last_undegraded":"2024-09-14T12:01:58.317434+0000","last_fullsized":"2024-09-14T12:01:58.317434+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T12:01:58.317337+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T12:01:58.317337+0000","last_clean_scrub_stamp":"2024-09-14T12:01:58.317337+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:14.168412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20490,"num_write":7,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.447928+0000","last_change":"2024-09-14T11:06:41.916297+0000","last_active":"2024-09-14T11:57:28.447928+0000","last_peered":"2024-09-14T11:57:28.447928+0000","last_clean":"2024-09-14T11:57:28.447928+0000","last_became_active":"2024-09-14T11:06:41.916037+0000","last_became_peered":"2024-09-14T11:06:41.916037+0000","last_unstale":"2024-09-14T11:57:28.447928+0000","last_undegraded":"2024-09-14T11:57:28.447928+0000","last_fullsized":"2024-09-14T11:57:28.447928+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:36.838054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"263'6","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:01.804720+0000","last_change":"2024-09-14T12:02:01.804720+0000","last_active":"2024-09-14T12:02:01.804720+0000","last_peered":"2024-09-14T12:02:01.804720+0000","last_clean":"2024-09-14T12:02:01.804720+0000","last_became_active":"2024-09-14T11:02:34.878477+0000","last_became_peered":"2024-09-14T11:02:34.878477+0000","last_unstale":"2024-09-14T12:02:01.804720+0000","last_undegraded":"2024-09-14T12:02:01.804720+0000","last_fullsized":"2024-09-14T12:02:01.804720+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:02:01.804608+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:02:01.804608+0000","last_clean_scrub_stamp":"2024-09-14T12:02:01.804608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:40.955608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.648824+0000","last_change":"2024-09-14T11:25:20.211103+0000","last_active":"2024-09-14T11:58:40.648824+0000","last_peered":"2024-09-14T11:58:40.648824+0000","last_clean":"2024-09-14T11:58:40.648824+0000","last_became_active":"2024-09-14T11:25:20.210841+0000","last_became_peered":"2024-09-14T11:25:20.210841+0000","last_unstale":"2024-09-14T11:58:40.648824+0000","last_undegraded":"2024-09-14T11:58:40.648824+0000","last_fullsized":"2024-09-14T11:58:40.648824+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:22.472173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"260'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:30.523488+0000","last_change":"2024-09-14T11:06:45.992541+0000","last_active":"2024-09-14T11:57:30.523488+0000","last_peered":"2024-09-14T11:57:30.523488+0000","last_clean":"2024-09-14T11:57:30.523488+0000","last_became_active":"2024-09-14T11:06:45.992046+0000","last_became_peered":"2024-09-14T11:06:45.992046+0000","last_unstale":"2024-09-14T11:57:30.523488+0000","last_undegraded":"2024-09-14T11:57:30.523488+0000","last_fullsized":"2024-09-14T11:57:30.523488+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:54.123557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:35.524118+0000","last_change":"2024-09-14T11:06:41.909618+0000","last_active":"2024-09-14T11:57:35.524118+0000","last_peered":"2024-09-14T11:57:35.524118+0000","last_clean":"2024-09-14T11:57:35.524118+0000","last_became_active":"2024-09-14T11:06:41.909310+0000","last_became_peered":"2024-09-14T11:06:41.909310+0000","last_unstale":"2024-09-14T11:57:35.524118+0000","last_undegraded":"2024-09-14T11:57:35.524118+0000","last_fullsized":"2024-09-14T11:57:35.524118+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:36.988586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"263'17","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:57.887525+0000","last_change":"2024-09-14T12:01:57.887525+0000","last_active":"2024-09-14T12:01:57.887525+0000","last_peered":"2024-09-14T12:01:57.887525+0000","last_clean":"2024-09-14T12:01:57.887525+0000","last_became_active":"2024-09-14T11:02:34.878859+0000","last_became_peered":"2024-09-14T11:02:34.878859+0000","last_unstale":"2024-09-14T12:01:57.887525+0000","last_undegraded":"2024-09-14T12:01:57.887525+0000","last_fullsized":"2024-09-14T12:01:57.887525+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'17","last_scrub_stamp":"2024-09-14T12:01:57.887436+0000","last_deep_scrub":"263'17","last_deep_scrub_stamp":"2024-09-14T12:01:57.887436+0000","last_clean_scrub_stamp":"2024-09-14T12:01:57.887436+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:50.627840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":82,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.300187+0000","last_change":"2024-09-14T11:25:20.214123+0000","last_active":"2024-09-14T11:57:50.300187+0000","last_peered":"2024-09-14T11:57:50.300187+0000","last_clean":"2024-09-14T11:57:50.300187+0000","last_became_active":"2024-09-14T11:25:20.213540+0000","last_became_peered":"2024-09-14T11:25:20.213540+0000","last_unstale":"2024-09-14T11:57:50.300187+0000","last_undegraded":"2024-09-14T11:57:50.300187+0000","last_fullsized":"2024-09-14T11:57:50.300187+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:22.650940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"260'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:04.945602+0000","last_change":"2024-09-14T12:02:04.945602+0000","last_active":"2024-09-14T12:02:04.945602+0000","last_peered":"2024-09-14T12:02:04.945602+0000","last_clean":"2024-09-14T12:02:04.945602+0000","last_became_active":"2024-09-14T11:06:45.984536+0000","last_became_peered":"2024-09-14T11:06:45.984536+0000","last_unstale":"2024-09-14T12:02:04.945602+0000","last_undegraded":"2024-09-14T12:02:04.945602+0000","last_fullsized":"2024-09-14T12:02:04.945602+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T12:02:04.945509+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T12:02:04.945509+0000","last_clean_scrub_stamp":"2024-09-14T12:02:04.945509+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:28.914973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:54.285050+0000","last_change":"2024-09-14T12:01:54.285050+0000","last_active":"2024-09-14T12:01:54.285050+0000","last_peered":"2024-09-14T12:01:54.285050+0000","last_clean":"2024-09-14T12:01:54.285050+0000","last_became_active":"2024-09-14T11:06:41.917297+0000","last_became_peered":"2024-09-14T11:06:41.917297+0000","last_unstale":"2024-09-14T12:01:54.285050+0000","last_undegraded":"2024-09-14T12:01:54.285050+0000","last_fullsized":"2024-09-14T12:01:54.285050+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:54.284954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:54.284954+0000","last_clean_scrub_stamp":"2024-09-14T12:01:54.284954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:26.497930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"260'21","reported_seq":126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:57.211012+0000","last_change":"2024-09-14T12:01:57.211012+0000","last_active":"2024-09-14T12:01:57.211012+0000","last_peered":"2024-09-14T12:01:57.211012+0000","last_clean":"2024-09-14T12:01:57.211012+0000","last_became_active":"2024-09-14T11:02:34.876726+0000","last_became_peered":"2024-09-14T11:02:34.876726+0000","last_unstale":"2024-09-14T12:01:57.211012+0000","last_undegraded":"2024-09-14T12:01:57.211012+0000","last_fullsized":"2024-09-14T12:01:57.211012+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'21","last_scrub_stamp":"2024-09-14T12:01:57.210902+0000","last_deep_scrub":"260'21","last_deep_scrub_stamp":"2024-09-14T12:01:57.210902+0000","last_clean_scrub_stamp":"2024-09-14T12:01:57.210902+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:17.084887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":116,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:04.282573+0000","last_change":"2024-09-14T12:02:04.282573+0000","last_active":"2024-09-14T12:02:04.282573+0000","last_peered":"2024-09-14T12:02:04.282573+0000","last_clean":"2024-09-14T12:02:04.282573+0000","last_became_active":"2024-09-14T11:25:20.214475+0000","last_became_peered":"2024-09-14T11:25:20.214475+0000","last_unstale":"2024-09-14T12:02:04.282573+0000","last_undegraded":"2024-09-14T12:02:04.282573+0000","last_fullsized":"2024-09-14T12:02:04.282573+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:04.282481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:04.282481+0000","last_clean_scrub_stamp":"2024-09-14T12:02:04.282481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:49.955677+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.453947+0000","last_change":"2024-09-14T11:06:45.990723+0000","last_active":"2024-09-14T11:59:15.453947+0000","last_peered":"2024-09-14T11:59:15.453947+0000","last_clean":"2024-09-14T11:59:15.453947+0000","last_became_active":"2024-09-14T11:06:45.990419+0000","last_became_peered":"2024-09-14T11:06:45.990419+0000","last_unstale":"2024-09-14T11:59:15.453947+0000","last_undegraded":"2024-09-14T11:59:15.453947+0000","last_fullsized":"2024-09-14T11:59:15.453947+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"260'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.529672+0000","last_change":"2024-09-14T11:06:41.911568+0000","last_active":"2024-09-14T11:59:13.529672+0000","last_peered":"2024-09-14T11:59:13.529672+0000","last_clean":"2024-09-14T11:59:13.529672+0000","last_became_active":"2024-09-14T11:06:41.910694+0000","last_became_peered":"2024-09-14T11:06:41.910694+0000","last_unstale":"2024-09-14T11:59:13.529672+0000","last_undegraded":"2024-09-14T11:59:13.529672+0000","last_fullsized":"2024-09-14T11:59:13.529672+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"263'21","reported_seq":118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:59.821308+0000","last_change":"2024-09-14T12:01:59.821308+0000","last_active":"2024-09-14T12:01:59.821308+0000","last_peered":"2024-09-14T12:01:59.821308+0000","last_clean":"2024-09-14T12:01:59.821308+0000","last_became_active":"2024-09-14T11:02:34.872803+0000","last_became_peered":"2024-09-14T11:02:34.872803+0000","last_unstale":"2024-09-14T12:01:59.821308+0000","last_undegraded":"2024-09-14T12:01:59.821308+0000","last_fullsized":"2024-09-14T12:01:59.821308+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'21","last_scrub_stamp":"2024-09-14T12:01:59.821192+0000","last_deep_scrub":"263'21","last_deep_scrub_stamp":"2024-09-14T12:01:59.821192+0000","last_clean_scrub_stamp":"2024-09-14T12:01:59.821192+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:10.561664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":102,"num_write":56,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:03.453145+0000","last_change":"2024-09-14T11:25:20.208606+0000","last_active":"2024-09-14T11:58:03.453145+0000","last_peered":"2024-09-14T11:58:03.453145+0000","last_clean":"2024-09-14T11:58:03.453145+0000","last_became_active":"2024-09-14T11:25:20.207780+0000","last_became_peered":"2024-09-14T11:25:20.207780+0000","last_unstale":"2024-09-14T11:58:03.453145+0000","last_undegraded":"2024-09-14T11:58:03.453145+0000","last_fullsized":"2024-09-14T11:58:03.453145+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:39.802914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"263'9","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.358375+0000","last_change":"2024-09-14T11:06:45.992867+0000","last_active":"2024-09-14T12:01:18.358375+0000","last_peered":"2024-09-14T12:01:18.358375+0000","last_clean":"2024-09-14T12:01:18.358375+0000","last_became_active":"2024-09-14T11:06:45.992208+0000","last_became_peered":"2024-09-14T11:06:45.992208+0000","last_unstale":"2024-09-14T12:01:18.358375+0000","last_undegraded":"2024-09-14T12:01:18.358375+0000","last_fullsized":"2024-09-14T12:01:18.358375+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:21.488237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":17408,"num_write":14,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"263'8","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:30.546211+0000","last_change":"2024-09-14T11:06:41.915462+0000","last_active":"2024-09-14T12:00:30.546211+0000","last_peered":"2024-09-14T12:00:30.546211+0000","last_clean":"2024-09-14T12:00:30.546211+0000","last_became_active":"2024-09-14T11:06:41.915173+0000","last_became_peered":"2024-09-14T11:06:41.915173+0000","last_unstale":"2024-09-14T12:00:30.546211+0000","last_undegraded":"2024-09-14T12:00:30.546211+0000","last_fullsized":"2024-09-14T12:00:30.546211+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:30.823550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10242,"num_write":13,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"263'15","reported_seq":94,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:10.644198+0000","last_change":"2024-09-14T11:02:34.867951+0000","last_active":"2024-09-14T11:58:10.644198+0000","last_peered":"2024-09-14T11:58:10.644198+0000","last_clean":"2024-09-14T11:58:10.644198+0000","last_became_active":"2024-09-14T11:02:34.867669+0000","last_became_peered":"2024-09-14T11:02:34.867669+0000","last_unstale":"2024-09-14T11:58:10.644198+0000","last_undegraded":"2024-09-14T11:58:10.644198+0000","last_fullsized":"2024-09-14T11:58:10.644198+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:05.093113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":79,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:03.519056+0000","last_change":"2024-09-14T11:25:20.210078+0000","last_active":"2024-09-14T11:58:03.519056+0000","last_peered":"2024-09-14T11:58:03.519056+0000","last_clean":"2024-09-14T11:58:03.519056+0000","last_became_active":"2024-09-14T11:25:20.209801+0000","last_became_peered":"2024-09-14T11:25:20.209801+0000","last_unstale":"2024-09-14T11:58:03.519056+0000","last_undegraded":"2024-09-14T11:58:03.519056+0000","last_fullsized":"2024-09-14T11:58:03.519056+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:20.540163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:18.455327+0000","last_change":"2024-09-14T11:06:45.990540+0000","last_active":"2024-09-14T11:58:18.455327+0000","last_peered":"2024-09-14T11:58:18.455327+0000","last_clean":"2024-09-14T11:58:18.455327+0000","last_became_active":"2024-09-14T11:06:45.990093+0000","last_became_peered":"2024-09-14T11:06:45.990093+0000","last_unstale":"2024-09-14T11:58:18.455327+0000","last_undegraded":"2024-09-14T11:58:18.455327+0000","last_fullsized":"2024-09-14T11:58:18.455327+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:20.070813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"263'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:53.258189+0000","last_change":"2024-09-14T12:01:53.258189+0000","last_active":"2024-09-14T12:01:53.258189+0000","last_peered":"2024-09-14T12:01:53.258189+0000","last_clean":"2024-09-14T12:01:53.258189+0000","last_became_active":"2024-09-14T11:06:41.913330+0000","last_became_peered":"2024-09-14T11:06:41.913330+0000","last_unstale":"2024-09-14T12:01:53.258189+0000","last_undegraded":"2024-09-14T12:01:53.258189+0000","last_fullsized":"2024-09-14T12:01:53.258189+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T12:01:53.258102+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T12:01:53.258102+0000","last_clean_scrub_stamp":"2024-09-14T12:01:53.258102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:02.121900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"263'51","reported_seq":200,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:03.663366+0000","last_change":"2024-09-14T12:02:03.663366+0000","last_active":"2024-09-14T12:02:03.663366+0000","last_peered":"2024-09-14T12:02:03.663366+0000","last_clean":"2024-09-14T12:02:03.663366+0000","last_became_active":"2024-09-14T11:02:34.879480+0000","last_became_peered":"2024-09-14T11:02:34.879480+0000","last_unstale":"2024-09-14T12:02:03.663366+0000","last_undegraded":"2024-09-14T12:02:03.663366+0000","last_fullsized":"2024-09-14T12:02:03.663366+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'51","last_scrub_stamp":"2024-09-14T12:02:03.663264+0000","last_deep_scrub":"263'51","last_deep_scrub_stamp":"2024-09-14T12:02:03.663264+0000","last_clean_scrub_stamp":"2024-09-14T12:02:03.663264+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:48.283261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":249,"num_write":134,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:00.301161+0000","last_change":"2024-09-14T11:25:20.208545+0000","last_active":"2024-09-14T11:58:00.301161+0000","last_peered":"2024-09-14T11:58:00.301161+0000","last_clean":"2024-09-14T11:58:00.301161+0000","last_became_active":"2024-09-14T11:25:20.208253+0000","last_became_peered":"2024-09-14T11:25:20.208253+0000","last_unstale":"2024-09-14T11:58:00.301161+0000","last_undegraded":"2024-09-14T11:58:00.301161+0000","last_fullsized":"2024-09-14T11:58:00.301161+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:46.409317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:30.439086+0000","last_change":"2024-09-14T11:06:45.986563+0000","last_active":"2024-09-14T11:57:30.439086+0000","last_peered":"2024-09-14T11:57:30.439086+0000","last_clean":"2024-09-14T11:57:30.439086+0000","last_became_active":"2024-09-14T11:06:45.986268+0000","last_became_peered":"2024-09-14T11:06:45.986268+0000","last_unstale":"2024-09-14T11:57:30.439086+0000","last_undegraded":"2024-09-14T11:57:30.439086+0000","last_fullsized":"2024-09-14T11:57:30.439086+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:57.096459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"263'5","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:03.108142+0000","last_change":"2024-09-14T12:02:03.108142+0000","last_active":"2024-09-14T12:02:03.108142+0000","last_peered":"2024-09-14T12:02:03.108142+0000","last_clean":"2024-09-14T12:02:03.108142+0000","last_became_active":"2024-09-14T11:06:41.918902+0000","last_became_peered":"2024-09-14T11:06:41.918902+0000","last_unstale":"2024-09-14T12:02:03.108142+0000","last_undegraded":"2024-09-14T12:02:03.108142+0000","last_fullsized":"2024-09-14T12:02:03.108142+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T12:02:03.108063+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T12:02:03.108063+0000","last_clean_scrub_stamp":"2024-09-14T12:02:03.108063+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:55:47.091374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"263'3","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:56.237034+0000","last_change":"2024-09-14T12:01:56.237034+0000","last_active":"2024-09-14T12:01:56.237034+0000","last_peered":"2024-09-14T12:01:56.237034+0000","last_clean":"2024-09-14T12:01:56.237034+0000","last_became_active":"2024-09-14T11:02:34.877623+0000","last_became_peered":"2024-09-14T11:02:34.877623+0000","last_unstale":"2024-09-14T12:01:56.237034+0000","last_undegraded":"2024-09-14T12:01:56.237034+0000","last_fullsized":"2024-09-14T12:01:56.237034+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:01:56.236952+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:01:56.236952+0000","last_clean_scrub_stamp":"2024-09-14T12:01:56.236952+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:46.845594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:02.282253+0000","last_change":"2024-09-14T12:02:02.282253+0000","last_active":"2024-09-14T12:02:02.282253+0000","last_peered":"2024-09-14T12:02:02.282253+0000","last_clean":"2024-09-14T12:02:02.282253+0000","last_became_active":"2024-09-14T11:25:20.208411+0000","last_became_peered":"2024-09-14T11:25:20.208411+0000","last_unstale":"2024-09-14T12:02:02.282253+0000","last_undegraded":"2024-09-14T12:02:02.282253+0000","last_fullsized":"2024-09-14T12:02:02.282253+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:02.282168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:02.282168+0000","last_clean_scrub_stamp":"2024-09-14T12:02:02.282168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:04.535961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:55.331335+0000","last_change":"2024-09-14T12:01:55.331335+0000","last_active":"2024-09-14T12:01:55.331335+0000","last_peered":"2024-09-14T12:01:55.331335+0000","last_clean":"2024-09-14T12:01:55.331335+0000","last_became_active":"2024-09-14T11:06:45.978458+0000","last_became_peered":"2024-09-14T11:06:45.978458+0000","last_unstale":"2024-09-14T12:01:55.331335+0000","last_undegraded":"2024-09-14T12:01:55.331335+0000","last_fullsized":"2024-09-14T12:01:55.331335+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T12:01:55.331248+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T12:01:55.331248+0000","last_clean_scrub_stamp":"2024-09-14T12:01:55.331248+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:29.427333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:53.471119+0000","last_change":"2024-09-14T11:06:41.916068+0000","last_active":"2024-09-14T11:59:53.471119+0000","last_peered":"2024-09-14T11:59:53.471119+0000","last_clean":"2024-09-14T11:59:53.471119+0000","last_became_active":"2024-09-14T11:06:41.915795+0000","last_became_peered":"2024-09-14T11:06:41.915795+0000","last_unstale":"2024-09-14T11:59:53.471119+0000","last_undegraded":"2024-09-14T11:59:53.471119+0000","last_fullsized":"2024-09-14T11:59:53.471119+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:10.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"263'20","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.531842+0000","last_change":"2024-09-14T11:02:34.881678+0000","last_active":"2024-09-14T11:58:40.531842+0000","last_peered":"2024-09-14T11:58:40.531842+0000","last_clean":"2024-09-14T11:58:40.531842+0000","last_became_active":"2024-09-14T11:02:34.881333+0000","last_became_peered":"2024-09-14T11:02:34.881333+0000","last_unstale":"2024-09-14T11:58:40.531842+0000","last_undegraded":"2024-09-14T11:58:40.531842+0000","last_fullsized":"2024-09-14T11:58:40.531842+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:25.506302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":49,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.464738+0000","last_change":"2024-09-14T11:25:20.209663+0000","last_active":"2024-09-14T11:59:13.464738+0000","last_peered":"2024-09-14T11:59:13.464738+0000","last_clean":"2024-09-14T11:59:13.464738+0000","last_became_active":"2024-09-14T11:25:20.209369+0000","last_became_peered":"2024-09-14T11:25:20.209369+0000","last_unstale":"2024-09-14T11:59:13.464738+0000","last_undegraded":"2024-09-14T11:59:13.464738+0000","last_fullsized":"2024-09-14T11:59:13.464738+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:08.453886+0000","last_change":"2024-09-14T11:06:45.981996+0000","last_active":"2024-09-14T11:58:08.453886+0000","last_peered":"2024-09-14T11:58:08.453886+0000","last_clean":"2024-09-14T11:58:08.453886+0000","last_became_active":"2024-09-14T11:06:45.980211+0000","last_became_peered":"2024-09-14T11:06:45.980211+0000","last_unstale":"2024-09-14T11:58:08.453886+0000","last_undegraded":"2024-09-14T11:58:08.453886+0000","last_fullsized":"2024-09-14T11:58:08.453886+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:03.580856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:55.640163+0000","last_change":"2024-09-14T12:01:55.640163+0000","last_active":"2024-09-14T12:01:55.640163+0000","last_peered":"2024-09-14T12:01:55.640163+0000","last_clean":"2024-09-14T12:01:55.640163+0000","last_became_active":"2024-09-14T11:06:41.902894+0000","last_became_peered":"2024-09-14T11:06:41.902894+0000","last_unstale":"2024-09-14T12:01:55.640163+0000","last_undegraded":"2024-09-14T12:01:55.640163+0000","last_fullsized":"2024-09-14T12:01:55.640163+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:55.640070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:55.640070+0000","last_clean_scrub_stamp":"2024-09-14T12:01:55.640070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:30.116185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"260'15","reported_seq":101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:35.531184+0000","last_change":"2024-09-14T11:02:34.873962+0000","last_active":"2024-09-14T11:58:35.531184+0000","last_peered":"2024-09-14T11:58:35.531184+0000","last_clean":"2024-09-14T11:58:35.531184+0000","last_became_active":"2024-09-14T11:02:34.873660+0000","last_became_peered":"2024-09-14T11:02:34.873660+0000","last_unstale":"2024-09-14T11:58:35.531184+0000","last_undegraded":"2024-09-14T11:58:35.531184+0000","last_fullsized":"2024-09-14T11:58:35.531184+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:08.878693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":83,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.529739+0000","last_change":"2024-09-14T11:25:20.210810+0000","last_active":"2024-09-14T11:59:13.529739+0000","last_peered":"2024-09-14T11:59:13.529739+0000","last_clean":"2024-09-14T11:59:13.529739+0000","last_became_active":"2024-09-14T11:25:20.210534+0000","last_became_peered":"2024-09-14T11:25:20.210534+0000","last_unstale":"2024-09-14T11:59:13.529739+0000","last_undegraded":"2024-09-14T11:59:13.529739+0000","last_fullsized":"2024-09-14T11:59:13.529739+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:08.453853+0000","last_change":"2024-09-14T11:06:45.985239+0000","last_active":"2024-09-14T11:58:08.453853+0000","last_peered":"2024-09-14T11:58:08.453853+0000","last_clean":"2024-09-14T11:58:08.453853+0000","last_became_active":"2024-09-14T11:06:45.984993+0000","last_became_peered":"2024-09-14T11:06:45.984993+0000","last_unstale":"2024-09-14T11:58:08.453853+0000","last_undegraded":"2024-09-14T11:58:08.453853+0000","last_fullsized":"2024-09-14T11:58:08.453853+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:26.543636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"263'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:23.475632+0000","last_change":"2024-09-14T11:06:41.910546+0000","last_active":"2024-09-14T12:00:23.475632+0000","last_peered":"2024-09-14T12:00:23.475632+0000","last_clean":"2024-09-14T12:00:23.475632+0000","last_became_active":"2024-09-14T11:06:41.910286+0000","last_became_peered":"2024-09-14T11:06:41.910286+0000","last_unstale":"2024-09-14T12:00:23.475632+0000","last_undegraded":"2024-09-14T12:00:23.475632+0000","last_fullsized":"2024-09-14T12:00:23.475632+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:00.405940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"263'55","reported_seq":211,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:54.163695+0000","last_change":"2024-09-14T12:01:54.163695+0000","last_active":"2024-09-14T12:01:54.163695+0000","last_peered":"2024-09-14T12:01:54.163695+0000","last_clean":"2024-09-14T12:01:54.163695+0000","last_became_active":"2024-09-14T11:02:34.872911+0000","last_became_peered":"2024-09-14T11:02:34.872911+0000","last_unstale":"2024-09-14T12:01:54.163695+0000","last_undegraded":"2024-09-14T12:01:54.163695+0000","last_fullsized":"2024-09-14T12:01:54.163695+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'55","last_scrub_stamp":"2024-09-14T12:01:54.163587+0000","last_deep_scrub":"263'55","last_deep_scrub_stamp":"2024-09-14T12:01:54.163587+0000","last_clean_scrub_stamp":"2024-09-14T12:01:54.163587+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:22.680045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":434,"num_read_kb":298,"num_write":132,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.643221+0000","last_change":"2024-09-14T11:25:20.210573+0000","last_active":"2024-09-14T11:58:05.643221+0000","last_peered":"2024-09-14T11:58:05.643221+0000","last_clean":"2024-09-14T11:58:05.643221+0000","last_became_active":"2024-09-14T11:25:20.209547+0000","last_became_peered":"2024-09-14T11:25:20.209547+0000","last_unstale":"2024-09-14T11:58:05.643221+0000","last_undegraded":"2024-09-14T11:58:05.643221+0000","last_fullsized":"2024-09-14T11:58:05.643221+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:48.503085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:25.464893+0000","last_change":"2024-09-14T11:06:45.984844+0000","last_active":"2024-09-14T12:00:25.464893+0000","last_peered":"2024-09-14T12:00:25.464893+0000","last_clean":"2024-09-14T12:00:25.464893+0000","last_became_active":"2024-09-14T11:06:45.984527+0000","last_became_peered":"2024-09-14T11:06:45.984527+0000","last_unstale":"2024-09-14T12:00:25.464893+0000","last_undegraded":"2024-09-14T12:00:25.464893+0000","last_fullsized":"2024-09-14T12:00:25.464893+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:00.029592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"260'9","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:04.598723+0000","last_change":"2024-09-14T12:02:04.598723+0000","last_active":"2024-09-14T12:02:04.598723+0000","last_peered":"2024-09-14T12:02:04.598723+0000","last_clean":"2024-09-14T12:02:04.598723+0000","last_became_active":"2024-09-14T11:06:41.905088+0000","last_became_peered":"2024-09-14T11:06:41.905088+0000","last_unstale":"2024-09-14T12:02:04.598723+0000","last_undegraded":"2024-09-14T12:02:04.598723+0000","last_fullsized":"2024-09-14T12:02:04.598723+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'9","last_scrub_stamp":"2024-09-14T12:02:04.598632+0000","last_deep_scrub":"260'9","last_deep_scrub_stamp":"2024-09-14T12:02:04.598632+0000","last_clean_scrub_stamp":"2024-09-14T12:02:04.598632+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:17.521499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17408,"num_write":9,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'36","reported_seq":160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:56.869265+0000","last_change":"2024-09-14T12:01:56.869265+0000","last_active":"2024-09-14T12:01:56.869265+0000","last_peered":"2024-09-14T12:01:56.869265+0000","last_clean":"2024-09-14T12:01:56.869265+0000","last_became_active":"2024-09-14T11:02:34.873560+0000","last_became_peered":"2024-09-14T11:02:34.873560+0000","last_unstale":"2024-09-14T12:01:56.869265+0000","last_undegraded":"2024-09-14T12:01:56.869265+0000","last_fullsized":"2024-09-14T12:01:56.869265+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'36","last_scrub_stamp":"2024-09-14T12:01:56.869155+0000","last_deep_scrub":"263'36","last_deep_scrub_stamp":"2024-09-14T12:01:56.869155+0000","last_clean_scrub_stamp":"2024-09-14T12:01:56.869155+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:21.843658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":270,"num_read_kb":162,"num_write":93,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.529712+0000","last_change":"2024-09-14T11:25:20.206947+0000","last_active":"2024-09-14T11:59:13.529712+0000","last_peered":"2024-09-14T11:59:13.529712+0000","last_clean":"2024-09-14T11:59:13.529712+0000","last_became_active":"2024-09-14T11:25:20.206692+0000","last_became_peered":"2024-09-14T11:25:20.206692+0000","last_unstale":"2024-09-14T11:59:13.529712+0000","last_undegraded":"2024-09-14T11:59:13.529712+0000","last_fullsized":"2024-09-14T11:59:13.529712+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.527582+0000","last_change":"2024-09-14T11:06:45.985776+0000","last_active":"2024-09-14T11:58:05.527582+0000","last_peered":"2024-09-14T11:58:05.527582+0000","last_clean":"2024-09-14T11:58:05.527582+0000","last_became_active":"2024-09-14T11:06:45.985436+0000","last_became_peered":"2024-09-14T11:06:45.985436+0000","last_unstale":"2024-09-14T11:58:05.527582+0000","last_undegraded":"2024-09-14T11:58:05.527582+0000","last_fullsized":"2024-09-14T11:58:05.527582+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:18.777447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"263'5","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:58.605471+0000","last_change":"2024-09-14T12:01:58.605471+0000","last_active":"2024-09-14T12:01:58.605471+0000","last_peered":"2024-09-14T12:01:58.605471+0000","last_clean":"2024-09-14T12:01:58.605471+0000","last_became_active":"2024-09-14T11:06:41.907791+0000","last_became_peered":"2024-09-14T11:06:41.907791+0000","last_unstale":"2024-09-14T12:01:58.605471+0000","last_undegraded":"2024-09-14T12:01:58.605471+0000","last_fullsized":"2024-09-14T12:01:58.605471+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T12:01:58.605369+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T12:01:58.605369+0000","last_clean_scrub_stamp":"2024-09-14T12:01:58.605369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:54.167899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5124,"num_write":5,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"263'33","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:55.202882+0000","last_change":"2024-09-14T12:01:55.202882+0000","last_active":"2024-09-14T12:01:55.202882+0000","last_peered":"2024-09-14T12:01:55.202882+0000","last_clean":"2024-09-14T12:01:55.202882+0000","last_became_active":"2024-09-14T11:02:34.876080+0000","last_became_peered":"2024-09-14T11:02:34.876080+0000","last_unstale":"2024-09-14T12:01:55.202882+0000","last_undegraded":"2024-09-14T12:01:55.202882+0000","last_fullsized":"2024-09-14T12:01:55.202882+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'33","last_scrub_stamp":"2024-09-14T12:01:55.202764+0000","last_deep_scrub":"263'33","last_deep_scrub_stamp":"2024-09-14T12:01:55.202764+0000","last_clean_scrub_stamp":"2024-09-14T12:01:55.202764+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:44.281145+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":186,"num_write":88,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:58.452425+0000","last_change":"2024-09-14T11:25:20.205656+0000","last_active":"2024-09-14T11:57:58.452425+0000","last_peered":"2024-09-14T11:57:58.452425+0000","last_clean":"2024-09-14T11:57:58.452425+0000","last_became_active":"2024-09-14T11:25:20.205335+0000","last_became_peered":"2024-09-14T11:25:20.205335+0000","last_unstale":"2024-09-14T11:57:58.452425+0000","last_undegraded":"2024-09-14T11:57:58.452425+0000","last_fullsized":"2024-09-14T11:57:58.452425+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:12.896781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:30.447384+0000","last_change":"2024-09-14T11:06:45.986506+0000","last_active":"2024-09-14T11:58:30.447384+0000","last_peered":"2024-09-14T11:58:30.447384+0000","last_clean":"2024-09-14T11:58:30.447384+0000","last_became_active":"2024-09-14T11:06:45.986225+0000","last_became_peered":"2024-09-14T11:06:45.986225+0000","last_unstale":"2024-09-14T11:58:30.447384+0000","last_undegraded":"2024-09-14T11:58:30.447384+0000","last_fullsized":"2024-09-14T11:58:30.447384+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:18.018900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"263'3","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:00.946625+0000","last_change":"2024-09-14T12:02:00.946625+0000","last_active":"2024-09-14T12:02:00.946625+0000","last_peered":"2024-09-14T12:02:00.946625+0000","last_clean":"2024-09-14T12:02:00.946625+0000","last_became_active":"2024-09-14T11:06:41.903188+0000","last_became_peered":"2024-09-14T11:06:41.903188+0000","last_unstale":"2024-09-14T12:02:00.946625+0000","last_undegraded":"2024-09-14T12:02:00.946625+0000","last_fullsized":"2024-09-14T12:02:00.946625+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:02:00.946535+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:02:00.946535+0000","last_clean_scrub_stamp":"2024-09-14T12:02:00.946535+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:19.041987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"263'55","reported_seq":210,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:53.164118+0000","last_change":"2024-09-14T12:01:53.164118+0000","last_active":"2024-09-14T12:01:53.164118+0000","last_peered":"2024-09-14T12:01:53.164118+0000","last_clean":"2024-09-14T12:01:53.164118+0000","last_became_active":"2024-09-14T11:02:34.877631+0000","last_became_peered":"2024-09-14T11:02:34.877631+0000","last_unstale":"2024-09-14T12:01:53.164118+0000","last_undegraded":"2024-09-14T12:01:53.164118+0000","last_fullsized":"2024-09-14T12:01:53.164118+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'55","last_scrub_stamp":"2024-09-14T12:01:53.164032+0000","last_deep_scrub":"263'55","last_deep_scrub_stamp":"2024-09-14T12:01:53.164032+0000","last_clean_scrub_stamp":"2024-09-14T12:01:53.164032+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:16.618442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":260,"num_write":147,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:02.633879+0000","last_change":"2024-09-14T12:02:02.633879+0000","last_active":"2024-09-14T12:02:02.633879+0000","last_peered":"2024-09-14T12:02:02.633879+0000","last_clean":"2024-09-14T12:02:02.633879+0000","last_became_active":"2024-09-14T11:25:20.200061+0000","last_became_peered":"2024-09-14T11:25:20.200061+0000","last_unstale":"2024-09-14T12:02:02.633879+0000","last_undegraded":"2024-09-14T12:02:02.633879+0000","last_fullsized":"2024-09-14T12:02:02.633879+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:02.633771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:02.633771+0000","last_clean_scrub_stamp":"2024-09-14T12:02:02.633771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:42.399562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:45.467828+0000","last_change":"2024-09-14T11:06:45.991468+0000","last_active":"2024-09-14T12:00:45.467828+0000","last_peered":"2024-09-14T12:00:45.467828+0000","last_clean":"2024-09-14T12:00:45.467828+0000","last_became_active":"2024-09-14T11:06:45.991198+0000","last_became_peered":"2024-09-14T11:06:45.991198+0000","last_unstale":"2024-09-14T12:00:45.467828+0000","last_undegraded":"2024-09-14T12:00:45.467828+0000","last_fullsized":"2024-09-14T12:00:45.467828+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:02.331809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"263'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:43.542221+0000","last_change":"2024-09-14T11:06:41.910787+0000","last_active":"2024-09-14T12:00:43.542221+0000","last_peered":"2024-09-14T12:00:43.542221+0000","last_clean":"2024-09-14T12:00:43.542221+0000","last_became_active":"2024-09-14T11:06:41.910512+0000","last_became_peered":"2024-09-14T11:06:41.910512+0000","last_unstale":"2024-09-14T12:00:43.542221+0000","last_undegraded":"2024-09-14T12:00:43.542221+0000","last_fullsized":"2024-09-14T12:00:43.542221+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:20.996429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"263'44","reported_seq":172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.533064+0000","last_change":"2024-09-14T11:02:34.881693+0000","last_active":"2024-09-14T11:58:50.533064+0000","last_peered":"2024-09-14T11:58:50.533064+0000","last_clean":"2024-09-14T11:58:50.533064+0000","last_became_active":"2024-09-14T11:02:34.881341+0000","last_became_peered":"2024-09-14T11:02:34.881341+0000","last_unstale":"2024-09-14T11:58:50.533064+0000","last_undegraded":"2024-09-14T11:58:50.533064+0000","last_fullsized":"2024-09-14T11:58:50.533064+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:36.323501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":339,"num_read_kb":228,"num_write":117,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.525849+0000","last_change":"2024-09-14T11:25:20.210429+0000","last_active":"2024-09-14T11:57:50.525849+0000","last_peered":"2024-09-14T11:57:50.525849+0000","last_clean":"2024-09-14T11:57:50.525849+0000","last_became_active":"2024-09-14T11:25:20.210117+0000","last_became_peered":"2024-09-14T11:25:20.210117+0000","last_unstale":"2024-09-14T11:57:50.525849+0000","last_undegraded":"2024-09-14T11:57:50.525849+0000","last_fullsized":"2024-09-14T11:57:50.525849+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:07.063593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'6","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:18.152467+0000","last_change":"2024-09-14T11:06:45.992869+0000","last_active":"2024-09-14T12:01:18.152467+0000","last_peered":"2024-09-14T12:01:18.152467+0000","last_clean":"2024-09-14T12:01:18.152467+0000","last_became_active":"2024-09-14T11:06:45.992574+0000","last_became_peered":"2024-09-14T11:06:45.992574+0000","last_unstale":"2024-09-14T12:01:18.152467+0000","last_undegraded":"2024-09-14T12:01:18.152467+0000","last_fullsized":"2024-09-14T12:01:18.152467+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:58.347483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:01.142843+0000","last_change":"2024-09-14T12:02:01.142843+0000","last_active":"2024-09-14T12:02:01.142843+0000","last_peered":"2024-09-14T12:02:01.142843+0000","last_clean":"2024-09-14T12:02:01.142843+0000","last_became_active":"2024-09-14T11:06:41.919330+0000","last_became_peered":"2024-09-14T11:06:41.919330+0000","last_unstale":"2024-09-14T12:02:01.142843+0000","last_undegraded":"2024-09-14T12:02:01.142843+0000","last_fullsized":"2024-09-14T12:02:01.142843+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:01.142760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:01.142760+0000","last_clean_scrub_stamp":"2024-09-14T12:02:01.142760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:40.749849+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"263'112","reported_seq":398,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:52.702449+0000","last_change":"2024-09-14T12:01:52.702449+0000","last_active":"2024-09-14T12:01:52.702449+0000","last_peered":"2024-09-14T12:01:52.702449+0000","last_clean":"2024-09-14T12:01:52.702449+0000","last_became_active":"2024-09-14T11:02:34.873360+0000","last_became_peered":"2024-09-14T11:02:34.873360+0000","last_unstale":"2024-09-14T12:01:52.702449+0000","last_undegraded":"2024-09-14T12:01:52.702449+0000","last_fullsized":"2024-09-14T12:01:52.702449+0000","mapping_epoch":252,"log_start":"263'100","ondisk_log_start":"263'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'112","last_scrub_stamp":"2024-09-14T12:01:52.702353+0000","last_deep_scrub":"263'112","last_deep_scrub_stamp":"2024-09-14T12:01:52.702353+0000","last_clean_scrub_stamp":"2024-09-14T12:01:52.702353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:20.277676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1014,"num_read_kb":809,"num_write":225,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:01.607623+0000","last_change":"2024-09-14T12:02:01.607623+0000","last_active":"2024-09-14T12:02:01.607623+0000","last_peered":"2024-09-14T12:02:01.607623+0000","last_clean":"2024-09-14T12:02:01.607623+0000","last_became_active":"2024-09-14T11:25:20.199875+0000","last_became_peered":"2024-09-14T11:25:20.199875+0000","last_unstale":"2024-09-14T12:02:01.607623+0000","last_undegraded":"2024-09-14T12:02:01.607623+0000","last_fullsized":"2024-09-14T12:02:01.607623+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:01.607533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:01.607533+0000","last_clean_scrub_stamp":"2024-09-14T12:02:01.607533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:04.607213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"260'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:33.457900+0000","last_change":"2024-09-14T11:06:45.980652+0000","last_active":"2024-09-14T11:58:33.457900+0000","last_peered":"2024-09-14T11:58:33.457900+0000","last_clean":"2024-09-14T11:58:33.457900+0000","last_became_active":"2024-09-14T11:06:45.980035+0000","last_became_peered":"2024-09-14T11:06:45.980035+0000","last_unstale":"2024-09-14T11:58:33.457900+0000","last_undegraded":"2024-09-14T11:58:33.457900+0000","last_fullsized":"2024-09-14T11:58:33.457900+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:36.733533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"263'3","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:02.139036+0000","last_change":"2024-09-14T12:02:02.139036+0000","last_active":"2024-09-14T12:02:02.139036+0000","last_peered":"2024-09-14T12:02:02.139036+0000","last_clean":"2024-09-14T12:02:02.139036+0000","last_became_active":"2024-09-14T11:06:41.917341+0000","last_became_peered":"2024-09-14T11:06:41.917341+0000","last_unstale":"2024-09-14T12:02:02.139036+0000","last_undegraded":"2024-09-14T12:02:02.139036+0000","last_fullsized":"2024-09-14T12:02:02.139036+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:02:02.138945+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:02:02.138945+0000","last_clean_scrub_stamp":"2024-09-14T12:02:02.138945+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:23.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"260'15","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:58.845971+0000","last_change":"2024-09-14T12:01:58.845971+0000","last_active":"2024-09-14T12:01:58.845971+0000","last_peered":"2024-09-14T12:01:58.845971+0000","last_clean":"2024-09-14T12:01:58.845971+0000","last_became_active":"2024-09-14T11:02:34.876078+0000","last_became_peered":"2024-09-14T11:02:34.876078+0000","last_unstale":"2024-09-14T12:01:58.845971+0000","last_undegraded":"2024-09-14T12:01:58.845971+0000","last_fullsized":"2024-09-14T12:01:58.845971+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'15","last_scrub_stamp":"2024-09-14T12:01:58.845874+0000","last_deep_scrub":"260'15","last_deep_scrub_stamp":"2024-09-14T12:01:58.845874+0000","last_clean_scrub_stamp":"2024-09-14T12:01:58.845874+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:38.473311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":83,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.463810+0000","last_change":"2024-09-14T11:25:20.210430+0000","last_active":"2024-09-14T11:59:08.463810+0000","last_peered":"2024-09-14T11:59:08.463810+0000","last_clean":"2024-09-14T11:59:08.463810+0000","last_became_active":"2024-09-14T11:25:20.210181+0000","last_became_peered":"2024-09-14T11:25:20.210181+0000","last_unstale":"2024-09-14T11:59:08.463810+0000","last_undegraded":"2024-09-14T11:59:08.463810+0000","last_fullsized":"2024-09-14T11:59:08.463810+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:56.596921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.532365+0000","last_change":"2024-09-14T11:06:45.984990+0000","last_active":"2024-09-14T11:58:45.532365+0000","last_peered":"2024-09-14T11:58:45.532365+0000","last_clean":"2024-09-14T11:58:45.532365+0000","last_became_active":"2024-09-14T11:06:45.984696+0000","last_became_peered":"2024-09-14T11:06:45.984696+0000","last_unstale":"2024-09-14T11:58:45.532365+0000","last_undegraded":"2024-09-14T11:58:45.532365+0000","last_fullsized":"2024-09-14T11:58:45.532365+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:17.939743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"263'2","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:58.226711+0000","last_change":"2024-09-14T12:01:58.226711+0000","last_active":"2024-09-14T12:01:58.226711+0000","last_peered":"2024-09-14T12:01:58.226711+0000","last_clean":"2024-09-14T12:01:58.226711+0000","last_became_active":"2024-09-14T11:06:41.914209+0000","last_became_peered":"2024-09-14T11:06:41.914209+0000","last_unstale":"2024-09-14T12:01:58.226711+0000","last_undegraded":"2024-09-14T12:01:58.226711+0000","last_fullsized":"2024-09-14T12:01:58.226711+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:01:58.226620+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:01:58.226620+0000","last_clean_scrub_stamp":"2024-09-14T12:01:58.226620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:41.343335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"263'35","reported_seq":156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:57.849960+0000","last_change":"2024-09-14T12:01:57.849960+0000","last_active":"2024-09-14T12:01:57.849960+0000","last_peered":"2024-09-14T12:01:57.849960+0000","last_clean":"2024-09-14T12:01:57.849960+0000","last_became_active":"2024-09-14T11:02:34.879834+0000","last_became_peered":"2024-09-14T11:02:34.879834+0000","last_unstale":"2024-09-14T12:01:57.849960+0000","last_undegraded":"2024-09-14T12:01:57.849960+0000","last_fullsized":"2024-09-14T12:01:57.849960+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'35","last_scrub_stamp":"2024-09-14T12:01:57.849884+0000","last_deep_scrub":"263'35","last_deep_scrub_stamp":"2024-09-14T12:01:57.849884+0000","last_clean_scrub_stamp":"2024-09-14T12:01:57.849884+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:04.537597+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":172,"num_write":95,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.308579+0000","last_change":"2024-09-14T11:25:20.205157+0000","last_active":"2024-09-14T11:59:10.308579+0000","last_peered":"2024-09-14T11:59:10.308579+0000","last_clean":"2024-09-14T11:59:10.308579+0000","last_became_active":"2024-09-14T11:25:20.204834+0000","last_became_peered":"2024-09-14T11:25:20.204834+0000","last_unstale":"2024-09-14T11:59:10.308579+0000","last_undegraded":"2024-09-14T11:59:10.308579+0000","last_fullsized":"2024-09-14T11:59:10.308579+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:02.920733+0000","last_change":"2024-09-14T12:02:02.920733+0000","last_active":"2024-09-14T12:02:02.920733+0000","last_peered":"2024-09-14T12:02:02.920733+0000","last_clean":"2024-09-14T12:02:02.920733+0000","last_became_active":"2024-09-14T11:06:45.984865+0000","last_became_peered":"2024-09-14T11:06:45.984865+0000","last_unstale":"2024-09-14T12:02:02.920733+0000","last_undegraded":"2024-09-14T12:02:02.920733+0000","last_fullsized":"2024-09-14T12:02:02.920733+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:02.920632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:02.920632+0000","last_clean_scrub_stamp":"2024-09-14T12:02:02.920632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:26.835967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"260'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:43.459476+0000","last_change":"2024-09-14T11:06:41.909800+0000","last_active":"2024-09-14T11:58:43.459476+0000","last_peered":"2024-09-14T11:58:43.459476+0000","last_clean":"2024-09-14T11:58:43.459476+0000","last_became_active":"2024-09-14T11:06:41.909533+0000","last_became_peered":"2024-09-14T11:06:41.909533+0000","last_unstale":"2024-09-14T11:58:43.459476+0000","last_undegraded":"2024-09-14T11:58:43.459476+0000","last_fullsized":"2024-09-14T11:58:43.459476+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:38.325179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"263'25","reported_seq":132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:55.872960+0000","last_change":"2024-09-14T12:01:55.872960+0000","last_active":"2024-09-14T12:01:55.872960+0000","last_peered":"2024-09-14T12:01:55.872960+0000","last_clean":"2024-09-14T12:01:55.872960+0000","last_became_active":"2024-09-14T11:02:34.873259+0000","last_became_peered":"2024-09-14T11:02:34.873259+0000","last_unstale":"2024-09-14T12:01:55.872960+0000","last_undegraded":"2024-09-14T12:01:55.872960+0000","last_fullsized":"2024-09-14T12:01:55.872960+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'25","last_scrub_stamp":"2024-09-14T12:01:55.872878+0000","last_deep_scrub":"263'25","last_deep_scrub_stamp":"2024-09-14T12:01:55.872878+0000","last_clean_scrub_stamp":"2024-09-14T12:01:55.872878+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:30.274992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":129,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"263'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:01.281475+0000","last_change":"2024-09-14T12:02:01.281475+0000","last_active":"2024-09-14T12:02:01.281475+0000","last_peered":"2024-09-14T12:02:01.281475+0000","last_clean":"2024-09-14T12:02:01.281475+0000","last_became_active":"2024-09-14T11:25:20.212293+0000","last_became_peered":"2024-09-14T11:25:20.212293+0000","last_unstale":"2024-09-14T12:02:01.281475+0000","last_undegraded":"2024-09-14T12:02:01.281475+0000","last_fullsized":"2024-09-14T12:02:01.281475+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:02:01.281378+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:02:01.281378+0000","last_clean_scrub_stamp":"2024-09-14T12:02:01.281378+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:12.176617+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:33.523575+0000","last_change":"2024-09-14T11:06:45.986687+0000","last_active":"2024-09-14T11:58:33.523575+0000","last_peered":"2024-09-14T11:58:33.523575+0000","last_clean":"2024-09-14T11:58:33.523575+0000","last_became_active":"2024-09-14T11:06:45.986398+0000","last_became_peered":"2024-09-14T11:06:45.986398+0000","last_unstale":"2024-09-14T11:58:33.523575+0000","last_undegraded":"2024-09-14T11:58:33.523575+0000","last_fullsized":"2024-09-14T11:58:33.523575+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:28.445077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"260'10","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:59.177591+0000","last_change":"2024-09-14T12:01:59.177591+0000","last_active":"2024-09-14T12:01:59.177591+0000","last_peered":"2024-09-14T12:01:59.177591+0000","last_clean":"2024-09-14T12:01:59.177591+0000","last_became_active":"2024-09-14T11:06:41.915491+0000","last_became_peered":"2024-09-14T11:06:41.915491+0000","last_unstale":"2024-09-14T12:01:59.177591+0000","last_undegraded":"2024-09-14T12:01:59.177591+0000","last_fullsized":"2024-09-14T12:01:59.177591+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'10","last_scrub_stamp":"2024-09-14T12:01:59.177516+0000","last_deep_scrub":"260'10","last_deep_scrub_stamp":"2024-09-14T12:01:59.177516+0000","last_clean_scrub_stamp":"2024-09-14T12:01:59.177516+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:40.951015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":40964,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"260'12","reported_seq":91,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.462030+0000","last_change":"2024-09-14T11:02:34.872228+0000","last_active":"2024-09-14T11:58:58.462030+0000","last_peered":"2024-09-14T11:58:58.462030+0000","last_clean":"2024-09-14T11:58:58.462030+0000","last_became_active":"2024-09-14T11:02:34.871352+0000","last_became_peered":"2024-09-14T11:02:34.871352+0000","last_unstale":"2024-09-14T11:58:58.462030+0000","last_undegraded":"2024-09-14T11:58:58.462030+0000","last_fullsized":"2024-09-14T11:58:58.462030+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:29.511969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.452308+0000","last_change":"2024-09-14T11:25:20.214092+0000","last_active":"2024-09-14T11:59:05.452308+0000","last_peered":"2024-09-14T11:59:05.452308+0000","last_clean":"2024-09-14T11:59:05.452308+0000","last_became_active":"2024-09-14T11:25:20.213785+0000","last_became_peered":"2024-09-14T11:25:20.213785+0000","last_unstale":"2024-09-14T11:59:05.452308+0000","last_undegraded":"2024-09-14T11:59:05.452308+0000","last_fullsized":"2024-09-14T11:59:05.452308+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:56.298725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"260'2","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:57.339142+0000","last_change":"2024-09-14T12:01:57.339142+0000","last_active":"2024-09-14T12:01:57.339142+0000","last_peered":"2024-09-14T12:01:57.339142+0000","last_clean":"2024-09-14T12:01:57.339142+0000","last_became_active":"2024-09-14T11:06:45.981476+0000","last_became_peered":"2024-09-14T11:06:45.981476+0000","last_unstale":"2024-09-14T12:01:57.339142+0000","last_undegraded":"2024-09-14T12:01:57.339142+0000","last_fullsized":"2024-09-14T12:01:57.339142+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T12:01:57.339050+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T12:01:57.339050+0000","last_clean_scrub_stamp":"2024-09-14T12:01:57.339050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:17.523005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"260'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:30.530578+0000","last_change":"2024-09-14T11:06:41.911683+0000","last_active":"2024-09-14T11:58:30.530578+0000","last_peered":"2024-09-14T11:58:30.530578+0000","last_clean":"2024-09-14T11:58:30.530578+0000","last_became_active":"2024-09-14T11:06:41.911413+0000","last_became_peered":"2024-09-14T11:06:41.911413+0000","last_unstale":"2024-09-14T11:58:30.530578+0000","last_undegraded":"2024-09-14T11:58:30.530578+0000","last_fullsized":"2024-09-14T11:58:30.530578+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:52.497275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"263'38","reported_seq":172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:52.297692+0000","last_change":"2024-09-14T12:01:52.297692+0000","last_active":"2024-09-14T12:01:52.297692+0000","last_peered":"2024-09-14T12:01:52.297692+0000","last_clean":"2024-09-14T12:01:52.297692+0000","last_became_active":"2024-09-14T11:02:34.878752+0000","last_became_peered":"2024-09-14T11:02:34.878752+0000","last_unstale":"2024-09-14T12:01:52.297692+0000","last_undegraded":"2024-09-14T12:01:52.297692+0000","last_fullsized":"2024-09-14T12:01:52.297692+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'38","last_scrub_stamp":"2024-09-14T12:01:52.297591+0000","last_deep_scrub":"263'38","last_deep_scrub_stamp":"2024-09-14T12:01:52.297591+0000","last_clean_scrub_stamp":"2024-09-14T12:01:52.297591+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:53.254453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":231,"num_write":89,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:59.302841+0000","last_change":"2024-09-14T12:01:59.302841+0000","last_active":"2024-09-14T12:01:59.302841+0000","last_peered":"2024-09-14T12:01:59.302841+0000","last_clean":"2024-09-14T12:01:59.302841+0000","last_became_active":"2024-09-14T11:25:20.210999+0000","last_became_peered":"2024-09-14T11:25:20.210999+0000","last_unstale":"2024-09-14T12:01:59.302841+0000","last_undegraded":"2024-09-14T12:01:59.302841+0000","last_fullsized":"2024-09-14T12:01:59.302841+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:59.302753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:59.302753+0000","last_clean_scrub_stamp":"2024-09-14T12:01:59.302753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:55.806305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.462863+0000","last_change":"2024-09-14T11:06:45.982956+0000","last_active":"2024-09-14T11:59:03.462863+0000","last_peered":"2024-09-14T11:59:03.462863+0000","last_clean":"2024-09-14T11:59:03.462863+0000","last_became_active":"2024-09-14T11:06:45.982181+0000","last_became_peered":"2024-09-14T11:06:45.982181+0000","last_unstale":"2024-09-14T11:59:03.462863+0000","last_undegraded":"2024-09-14T11:59:03.462863+0000","last_fullsized":"2024-09-14T11:59:03.462863+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:18.506633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.533019+0000","last_change":"2024-09-14T11:06:41.914378+0000","last_active":"2024-09-14T11:58:50.533019+0000","last_peered":"2024-09-14T11:58:50.533019+0000","last_clean":"2024-09-14T11:58:50.533019+0000","last_became_active":"2024-09-14T11:06:41.913192+0000","last_became_peered":"2024-09-14T11:06:41.913192+0000","last_unstale":"2024-09-14T11:58:50.533019+0000","last_undegraded":"2024-09-14T11:58:50.533019+0000","last_fullsized":"2024-09-14T11:58:50.533019+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:24.679035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"263'32","reported_seq":151,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:04.697710+0000","last_change":"2024-09-14T12:02:04.697710+0000","last_active":"2024-09-14T12:02:04.697710+0000","last_peered":"2024-09-14T12:02:04.697710+0000","last_clean":"2024-09-14T12:02:04.697710+0000","last_became_active":"2024-09-14T11:02:34.874328+0000","last_became_peered":"2024-09-14T11:02:34.874328+0000","last_unstale":"2024-09-14T12:02:04.697710+0000","last_undegraded":"2024-09-14T12:02:04.697710+0000","last_fullsized":"2024-09-14T12:02:04.697710+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'32","last_scrub_stamp":"2024-09-14T12:02:04.697613+0000","last_deep_scrub":"263'32","last_deep_scrub_stamp":"2024-09-14T12:02:04.697613+0000","last_clean_scrub_stamp":"2024-09-14T12:02:04.697613+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:11.839878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":246,"num_read_kb":166,"num_write":81,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:00.318918+0000","last_change":"2024-09-14T12:02:00.318918+0000","last_active":"2024-09-14T12:02:00.318918+0000","last_peered":"2024-09-14T12:02:00.318918+0000","last_clean":"2024-09-14T12:02:00.318918+0000","last_became_active":"2024-09-14T11:25:20.213577+0000","last_became_peered":"2024-09-14T11:25:20.213577+0000","last_unstale":"2024-09-14T12:02:00.318918+0000","last_undegraded":"2024-09-14T12:02:00.318918+0000","last_fullsized":"2024-09-14T12:02:00.318918+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:00.318831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:00.318831+0000","last_clean_scrub_stamp":"2024-09-14T12:02:00.318831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:51.312386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"263'10","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.842742+0000","last_change":"2024-09-14T11:06:45.991127+0000","last_active":"2024-09-14T12:01:17.842742+0000","last_peered":"2024-09-14T12:01:17.842742+0000","last_clean":"2024-09-14T12:01:17.842742+0000","last_became_active":"2024-09-14T11:06:45.990855+0000","last_became_peered":"2024-09-14T11:06:45.990855+0000","last_unstale":"2024-09-14T12:01:17.842742+0000","last_undegraded":"2024-09-14T12:01:17.842742+0000","last_fullsized":"2024-09-14T12:01:17.842742+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:28.658329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6246,"num_write":20,"num_write_kb":2098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"263'8","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:10.670577+0000","last_change":"2024-09-14T11:06:41.913753+0000","last_active":"2024-09-14T12:01:10.670577+0000","last_peered":"2024-09-14T12:01:10.670577+0000","last_clean":"2024-09-14T12:01:10.670577+0000","last_became_active":"2024-09-14T11:06:41.913454+0000","last_became_peered":"2024-09-14T11:06:41.913454+0000","last_unstale":"2024-09-14T12:01:10.670577+0000","last_undegraded":"2024-09-14T12:01:10.670577+0000","last_fullsized":"2024-09-14T12:01:10.670577+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:38.121049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":18,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'130","reported_seq":444,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.533642+0000","last_change":"2024-09-14T11:02:34.879730+0000","last_active":"2024-09-14T11:58:55.533642+0000","last_peered":"2024-09-14T11:58:55.533642+0000","last_clean":"2024-09-14T11:58:55.533642+0000","last_became_active":"2024-09-14T11:02:34.878813+0000","last_became_peered":"2024-09-14T11:02:34.878813+0000","last_unstale":"2024-09-14T11:58:55.533642+0000","last_undegraded":"2024-09-14T11:58:55.533642+0000","last_fullsized":"2024-09-14T11:58:55.533642+0000","mapping_epoch":252,"log_start":"260'100","ondisk_log_start":"260'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:00.256155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1195,"num_read_kb":1160,"num_write":263,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.467146+0000","last_change":"2024-09-14T11:25:20.212941+0000","last_active":"2024-09-14T11:59:28.467146+0000","last_peered":"2024-09-14T11:59:28.467146+0000","last_clean":"2024-09-14T11:59:28.467146+0000","last_became_active":"2024-09-14T11:25:20.212665+0000","last_became_peered":"2024-09-14T11:25:20.212665+0000","last_unstale":"2024-09-14T11:59:28.467146+0000","last_undegraded":"2024-09-14T11:59:28.467146+0000","last_fullsized":"2024-09-14T11:59:28.467146+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:56.329477+0000","last_change":"2024-09-14T12:01:56.329477+0000","last_active":"2024-09-14T12:01:56.329477+0000","last_peered":"2024-09-14T12:01:56.329477+0000","last_clean":"2024-09-14T12:01:56.329477+0000","last_became_active":"2024-09-14T11:06:45.992066+0000","last_became_peered":"2024-09-14T11:06:45.992066+0000","last_unstale":"2024-09-14T12:01:56.329477+0000","last_undegraded":"2024-09-14T12:01:56.329477+0000","last_fullsized":"2024-09-14T12:01:56.329477+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:56.329370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:56.329370+0000","last_clean_scrub_stamp":"2024-09-14T12:01:56.329370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:14.427233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"260'3","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:58.924814+0000","last_change":"2024-09-14T12:01:58.924814+0000","last_active":"2024-09-14T12:01:58.924814+0000","last_peered":"2024-09-14T12:01:58.924814+0000","last_clean":"2024-09-14T12:01:58.924814+0000","last_became_active":"2024-09-14T11:06:41.912405+0000","last_became_peered":"2024-09-14T11:06:41.912405+0000","last_unstale":"2024-09-14T12:01:58.924814+0000","last_undegraded":"2024-09-14T12:01:58.924814+0000","last_fullsized":"2024-09-14T12:01:58.924814+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T12:01:58.924722+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T12:01:58.924722+0000","last_clean_scrub_stamp":"2024-09-14T12:01:58.924722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:20.646458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"263'36","reported_seq":166,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:53.832115+0000","last_change":"2024-09-14T12:01:53.832115+0000","last_active":"2024-09-14T12:01:53.832115+0000","last_peered":"2024-09-14T12:01:53.832115+0000","last_clean":"2024-09-14T12:01:53.832115+0000","last_became_active":"2024-09-14T11:02:34.873089+0000","last_became_peered":"2024-09-14T11:02:34.873089+0000","last_unstale":"2024-09-14T12:01:53.832115+0000","last_undegraded":"2024-09-14T12:01:53.832115+0000","last_fullsized":"2024-09-14T12:01:53.832115+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'36","last_scrub_stamp":"2024-09-14T12:01:53.832028+0000","last_deep_scrub":"263'36","last_deep_scrub_stamp":"2024-09-14T12:01:53.832028+0000","last_clean_scrub_stamp":"2024-09-14T12:01:53.832028+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:15.408768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":295,"num_read_kb":200,"num_write":86,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.531790+0000","last_change":"2024-09-14T11:25:20.210966+0000","last_active":"2024-09-14T11:58:40.531790+0000","last_peered":"2024-09-14T11:58:40.531790+0000","last_clean":"2024-09-14T11:58:40.531790+0000","last_became_active":"2024-09-14T11:25:20.210331+0000","last_became_peered":"2024-09-14T11:25:20.210331+0000","last_unstale":"2024-09-14T11:58:40.531790+0000","last_undegraded":"2024-09-14T11:58:40.531790+0000","last_fullsized":"2024-09-14T11:58:40.531790+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:27.694386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.532467+0000","last_change":"2024-09-14T11:06:45.986136+0000","last_active":"2024-09-14T11:58:45.532467+0000","last_peered":"2024-09-14T11:58:45.532467+0000","last_clean":"2024-09-14T11:58:45.532467+0000","last_became_active":"2024-09-14T11:06:45.985792+0000","last_became_peered":"2024-09-14T11:06:45.985792+0000","last_unstale":"2024-09-14T11:58:45.532467+0000","last_undegraded":"2024-09-14T11:58:45.532467+0000","last_fullsized":"2024-09-14T11:58:45.532467+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:18.428977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.532481+0000","last_change":"2024-09-14T11:06:41.914556+0000","last_active":"2024-09-14T11:58:45.532481+0000","last_peered":"2024-09-14T11:58:45.532481+0000","last_clean":"2024-09-14T11:58:45.532481+0000","last_became_active":"2024-09-14T11:06:41.913214+0000","last_became_peered":"2024-09-14T11:06:41.913214+0000","last_unstale":"2024-09-14T11:58:45.532481+0000","last_undegraded":"2024-09-14T11:58:45.532481+0000","last_fullsized":"2024-09-14T11:58:45.532481+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:05.435530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"263'55","reported_seq":217,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:00.159255+0000","last_change":"2024-09-14T12:02:00.159255+0000","last_active":"2024-09-14T12:02:00.159255+0000","last_peered":"2024-09-14T12:02:00.159255+0000","last_clean":"2024-09-14T12:02:00.159255+0000","last_became_active":"2024-09-14T11:02:34.873554+0000","last_became_peered":"2024-09-14T11:02:34.873554+0000","last_unstale":"2024-09-14T12:02:00.159255+0000","last_undegraded":"2024-09-14T12:02:00.159255+0000","last_fullsized":"2024-09-14T12:02:00.159255+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'55","last_scrub_stamp":"2024-09-14T12:02:00.159178+0000","last_deep_scrub":"263'55","last_deep_scrub_stamp":"2024-09-14T12:02:00.159178+0000","last_clean_scrub_stamp":"2024-09-14T12:02:00.159178+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:11.640741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":297,"num_write":136,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.441967+0000","last_change":"2024-09-14T11:25:20.209266+0000","last_active":"2024-09-14T11:57:50.441967+0000","last_peered":"2024-09-14T11:57:50.441967+0000","last_clean":"2024-09-14T11:57:50.441967+0000","last_became_active":"2024-09-14T11:25:20.208985+0000","last_became_peered":"2024-09-14T11:25:20.208985+0000","last_unstale":"2024-09-14T11:57:50.441967+0000","last_undegraded":"2024-09-14T11:57:50.441967+0000","last_fullsized":"2024-09-14T11:57:50.441967+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:35.791238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"260'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.650067+0000","last_change":"2024-09-14T11:06:45.987976+0000","last_active":"2024-09-14T11:58:50.650067+0000","last_peered":"2024-09-14T11:58:50.650067+0000","last_clean":"2024-09-14T11:58:50.650067+0000","last_became_active":"2024-09-14T11:06:45.987665+0000","last_became_peered":"2024-09-14T11:06:45.987665+0000","last_unstale":"2024-09-14T11:58:50.650067+0000","last_undegraded":"2024-09-14T11:58:50.650067+0000","last_fullsized":"2024-09-14T11:58:50.650067+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:33.778940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5649,"num_write":5,"num_write_kb":5649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"260'8","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:59.952584+0000","last_change":"2024-09-14T12:01:59.952584+0000","last_active":"2024-09-14T12:01:59.952584+0000","last_peered":"2024-09-14T12:01:59.952584+0000","last_clean":"2024-09-14T12:01:59.952584+0000","last_became_active":"2024-09-14T11:06:41.906528+0000","last_became_peered":"2024-09-14T11:06:41.906528+0000","last_unstale":"2024-09-14T12:01:59.952584+0000","last_undegraded":"2024-09-14T12:01:59.952584+0000","last_fullsized":"2024-09-14T12:01:59.952584+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-14T12:01:59.952493+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-14T12:01:59.952493+0000","last_clean_scrub_stamp":"2024-09-14T12:01:59.952493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:37.534736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"263'49","reported_seq":199,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:52.783772+0000","last_change":"2024-09-14T12:01:52.783772+0000","last_active":"2024-09-14T12:01:52.783772+0000","last_peered":"2024-09-14T12:01:52.783772+0000","last_clean":"2024-09-14T12:01:52.783772+0000","last_became_active":"2024-09-14T11:02:34.869154+0000","last_became_peered":"2024-09-14T11:02:34.869154+0000","last_unstale":"2024-09-14T12:01:52.783772+0000","last_undegraded":"2024-09-14T12:01:52.783772+0000","last_fullsized":"2024-09-14T12:01:52.783772+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'49","last_scrub_stamp":"2024-09-14T12:01:52.783668+0000","last_deep_scrub":"263'49","last_deep_scrub_stamp":"2024-09-14T12:01:52.783668+0000","last_clean_scrub_stamp":"2024-09-14T12:01:52.783668+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:21.022547+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":272,"num_write":122,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:50.641217+0000","last_change":"2024-09-14T11:25:20.209267+0000","last_active":"2024-09-14T11:57:50.641217+0000","last_peered":"2024-09-14T11:57:50.641217+0000","last_clean":"2024-09-14T11:57:50.641217+0000","last_became_active":"2024-09-14T11:25:20.208992+0000","last_became_peered":"2024-09-14T11:25:20.208992+0000","last_unstale":"2024-09-14T11:57:50.641217+0000","last_undegraded":"2024-09-14T11:57:50.641217+0000","last_fullsized":"2024-09-14T11:57:50.641217+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:33.801493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"263'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:17.845194+0000","last_change":"2024-09-14T11:06:45.985807+0000","last_active":"2024-09-14T12:01:17.845194+0000","last_peered":"2024-09-14T12:01:17.845194+0000","last_clean":"2024-09-14T12:01:17.845194+0000","last_became_active":"2024-09-14T11:06:45.985518+0000","last_became_peered":"2024-09-14T11:06:45.985518+0000","last_unstale":"2024-09-14T12:01:17.845194+0000","last_undegraded":"2024-09-14T12:01:17.845194+0000","last_fullsized":"2024-09-14T12:01:17.845194+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:53.847804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:55.549750+0000","last_change":"2024-09-14T11:06:41.915181+0000","last_active":"2024-09-14T12:00:55.549750+0000","last_peered":"2024-09-14T12:00:55.549750+0000","last_clean":"2024-09-14T12:00:55.549750+0000","last_became_active":"2024-09-14T11:06:41.914346+0000","last_became_peered":"2024-09-14T11:06:41.914346+0000","last_unstale":"2024-09-14T12:00:55.549750+0000","last_undegraded":"2024-09-14T12:00:55.549750+0000","last_fullsized":"2024-09-14T12:00:55.549750+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:17.184490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"263'33","reported_seq":145,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.532990+0000","last_change":"2024-09-14T11:02:34.880356+0000","last_active":"2024-09-14T11:58:50.532990+0000","last_peered":"2024-09-14T11:58:50.532990+0000","last_clean":"2024-09-14T11:58:50.532990+0000","last_became_active":"2024-09-14T11:02:34.880066+0000","last_became_peered":"2024-09-14T11:02:34.880066+0000","last_unstale":"2024-09-14T11:58:50.532990+0000","last_undegraded":"2024-09-14T11:58:50.532990+0000","last_fullsized":"2024-09-14T11:58:50.532990+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:20.037542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":165,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:43.459528+0000","last_change":"2024-09-14T11:25:20.211431+0000","last_active":"2024-09-14T11:58:43.459528+0000","last_peered":"2024-09-14T11:58:43.459528+0000","last_clean":"2024-09-14T11:58:43.459528+0000","last_became_active":"2024-09-14T11:25:20.208291+0000","last_became_peered":"2024-09-14T11:25:20.208291+0000","last_unstale":"2024-09-14T11:58:43.459528+0000","last_undegraded":"2024-09-14T11:58:43.459528+0000","last_fullsized":"2024-09-14T11:58:43.459528+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:10.519199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"260'3","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:03.897966+0000","last_change":"2024-09-14T12:02:03.897966+0000","last_active":"2024-09-14T12:02:03.897966+0000","last_peered":"2024-09-14T12:02:03.897966+0000","last_clean":"2024-09-14T12:02:03.897966+0000","last_became_active":"2024-09-14T11:06:45.988268+0000","last_became_peered":"2024-09-14T11:06:45.988268+0000","last_unstale":"2024-09-14T12:02:03.897966+0000","last_undegraded":"2024-09-14T12:02:03.897966+0000","last_fullsized":"2024-09-14T12:02:03.897966+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T12:02:03.897879+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T12:02:03.897879+0000","last_clean_scrub_stamp":"2024-09-14T12:02:03.897879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:18.891047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.525697+0000","last_change":"2024-09-14T11:06:41.910335+0000","last_active":"2024-09-14T11:58:48.525697+0000","last_peered":"2024-09-14T11:58:48.525697+0000","last_clean":"2024-09-14T11:58:48.525697+0000","last_became_active":"2024-09-14T11:06:41.909915+0000","last_became_peered":"2024-09-14T11:06:41.909915+0000","last_unstale":"2024-09-14T11:58:48.525697+0000","last_undegraded":"2024-09-14T11:58:48.525697+0000","last_fullsized":"2024-09-14T11:58:48.525697+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:40.890863+0000","last_clean_scrub_stamp":"2024-09-14T11:06:40.890863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:47.834488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"263'21","reported_seq":116,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.532964+0000","last_change":"2024-09-14T11:02:34.878110+0000","last_active":"2024-09-14T11:58:50.532964+0000","last_peered":"2024-09-14T11:58:50.532964+0000","last_clean":"2024-09-14T11:58:50.532964+0000","last_became_active":"2024-09-14T11:02:34.877791+0000","last_became_peered":"2024-09-14T11:02:34.877791+0000","last_unstale":"2024-09-14T11:58:50.532964+0000","last_undegraded":"2024-09-14T11:58:50.532964+0000","last_fullsized":"2024-09-14T11:58:50.532964+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:02:33.850927+0000","last_clean_scrub_stamp":"2024-09-14T11:02:33.850927+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:00.836048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":103,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.531860+0000","last_change":"2024-09-14T11:25:20.208774+0000","last_active":"2024-09-14T11:58:40.531860+0000","last_peered":"2024-09-14T11:58:40.531860+0000","last_clean":"2024-09-14T11:58:40.531860+0000","last_became_active":"2024-09-14T11:25:20.208495+0000","last_became_peered":"2024-09-14T11:25:20.208495+0000","last_unstale":"2024-09-14T11:58:40.531860+0000","last_undegraded":"2024-09-14T11:58:40.531860+0000","last_fullsized":"2024-09-14T11:58:40.531860+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:18.019657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"263'3","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:01.969507+0000","last_change":"2024-09-14T12:02:01.969507+0000","last_active":"2024-09-14T12:02:01.969507+0000","last_peered":"2024-09-14T12:02:01.969507+0000","last_clean":"2024-09-14T12:02:01.969507+0000","last_became_active":"2024-09-14T11:06:45.986990+0000","last_became_peered":"2024-09-14T11:06:45.986990+0000","last_unstale":"2024-09-14T12:02:01.969507+0000","last_undegraded":"2024-09-14T12:02:01.969507+0000","last_fullsized":"2024-09-14T12:02:01.969507+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:02:01.969414+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:02:01.969414+0000","last_clean_scrub_stamp":"2024-09-14T12:02:01.969414+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:59.943974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:54.673980+0000","last_change":"2024-09-14T12:01:54.673980+0000","last_active":"2024-09-14T12:01:54.673980+0000","last_peered":"2024-09-14T12:01:54.673980+0000","last_clean":"2024-09-14T12:01:54.673980+0000","last_became_active":"2024-09-14T11:06:41.915372+0000","last_became_peered":"2024-09-14T11:06:41.915372+0000","last_unstale":"2024-09-14T12:01:54.673980+0000","last_undegraded":"2024-09-14T12:01:54.673980+0000","last_fullsized":"2024-09-14T12:01:54.673980+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:54.673887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:54.673887+0000","last_clean_scrub_stamp":"2024-09-14T12:01:54.673887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:46.613871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"263'13","reported_seq":104,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:54.829095+0000","last_change":"2024-09-14T12:01:54.829095+0000","last_active":"2024-09-14T12:01:54.829095+0000","last_peered":"2024-09-14T12:01:54.829095+0000","last_clean":"2024-09-14T12:01:54.829095+0000","last_became_active":"2024-09-14T11:02:34.879002+0000","last_became_peered":"2024-09-14T11:02:34.879002+0000","last_unstale":"2024-09-14T12:01:54.829095+0000","last_undegraded":"2024-09-14T12:01:54.829095+0000","last_fullsized":"2024-09-14T12:01:54.829095+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-14T12:01:54.829007+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-14T12:01:54.829007+0000","last_clean_scrub_stamp":"2024-09-14T12:01:54.829007+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:39.245401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":56,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'347","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.278191+0000","last_change":"2024-09-14T12:01:32.278080+0000","last_active":"2024-09-14T12:01:32.278191+0000","last_peered":"2024-09-14T12:01:32.278191+0000","last_clean":"2024-09-14T12:01:32.278191+0000","last_became_active":"2024-09-14T10:46:44.331827+0000","last_became_peered":"2024-09-14T10:46:44.331827+0000","last_unstale":"2024-09-14T12:01:32.278191+0000","last_undegraded":"2024-09-14T12:01:32.278191+0000","last_fullsized":"2024-09-14T12:01:32.278191+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-09-14T12:01:32.277953+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-09-14T12:01:32.277953+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.277953+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:37.814804+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":808,"num_read_kb":10519,"num_write":1133,"num_write_kb":31597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"263'509","reported_seq":2212,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.715793+0000","last_change":"2024-09-14T12:01:37.715729+0000","last_active":"2024-09-14T12:01:37.715793+0000","last_peered":"2024-09-14T12:01:37.715793+0000","last_clean":"2024-09-14T12:01:37.715793+0000","last_became_active":"2024-09-14T10:46:46.340949+0000","last_became_peered":"2024-09-14T10:46:46.340949+0000","last_unstale":"2024-09-14T12:01:37.715793+0000","last_undegraded":"2024-09-14T12:01:37.715793+0000","last_fullsized":"2024-09-14T12:01:37.715793+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'509","last_scrub_stamp":"2024-09-14T12:01:37.715648+0000","last_deep_scrub":"263'509","last_deep_scrub_stamp":"2024-09-14T12:01:37.715648+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.715648+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:12.260760+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2834,"num_read_kb":2670,"num_write":604,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"263'354","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.242897+0000","last_change":"2024-09-14T12:01:38.242836+0000","last_active":"2024-09-14T12:01:38.242897+0000","last_peered":"2024-09-14T12:01:38.242897+0000","last_clean":"2024-09-14T12:01:38.242897+0000","last_became_active":"2024-09-14T10:46:44.332997+0000","last_became_peered":"2024-09-14T10:46:44.332997+0000","last_unstale":"2024-09-14T12:01:38.242897+0000","last_undegraded":"2024-09-14T12:01:38.242897+0000","last_fullsized":"2024-09-14T12:01:38.242897+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'354","last_scrub_stamp":"2024-09-14T12:01:38.242731+0000","last_deep_scrub":"263'354","last_deep_scrub_stamp":"2024-09-14T12:01:38.242731+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.242731+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:20.221917+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":584,"num_read_kb":4891,"num_write":1057,"num_write_kb":34401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"263'668","reported_seq":2323,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.842340+0000","last_change":"2024-09-14T12:01:45.842271+0000","last_active":"2024-09-14T12:01:45.842340+0000","last_peered":"2024-09-14T12:01:45.842340+0000","last_clean":"2024-09-14T12:01:45.842340+0000","last_became_active":"2024-09-14T10:46:46.340612+0000","last_became_peered":"2024-09-14T10:46:46.340612+0000","last_unstale":"2024-09-14T12:01:45.842340+0000","last_undegraded":"2024-09-14T12:01:45.842340+0000","last_fullsized":"2024-09-14T12:01:45.842340+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'668","last_scrub_stamp":"2024-09-14T12:01:45.842183+0000","last_deep_scrub":"263'668","last_deep_scrub_stamp":"2024-09-14T12:01:45.842183+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.842183+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":600,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:23.087207+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3359,"num_read_kb":3045,"num_write":872,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"263'315","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.268744+0000","last_change":"2024-09-14T12:01:37.268681+0000","last_active":"2024-09-14T12:01:37.268744+0000","last_peered":"2024-09-14T12:01:37.268744+0000","last_clean":"2024-09-14T12:01:37.268744+0000","last_became_active":"2024-09-14T10:46:44.320254+0000","last_became_peered":"2024-09-14T10:46:44.320254+0000","last_unstale":"2024-09-14T12:01:37.268744+0000","last_undegraded":"2024-09-14T12:01:37.268744+0000","last_fullsized":"2024-09-14T12:01:37.268744+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'315","last_scrub_stamp":"2024-09-14T12:01:37.268548+0000","last_deep_scrub":"263'315","last_deep_scrub_stamp":"2024-09-14T12:01:37.268548+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.268548+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:39.392560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":578,"num_read_kb":18043,"num_write":1147,"num_write_kb":30368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"263'456","reported_seq":1894,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:50.894023+0000","last_change":"2024-09-14T12:01:50.894023+0000","last_active":"2024-09-14T12:01:50.894023+0000","last_peered":"2024-09-14T12:01:50.894023+0000","last_clean":"2024-09-14T12:01:50.894023+0000","last_became_active":"2024-09-14T10:46:46.337092+0000","last_became_peered":"2024-09-14T10:46:46.337092+0000","last_unstale":"2024-09-14T12:01:50.894023+0000","last_undegraded":"2024-09-14T12:01:50.894023+0000","last_fullsized":"2024-09-14T12:01:50.894023+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'456","last_scrub_stamp":"2024-09-14T12:01:50.893935+0000","last_deep_scrub":"263'456","last_deep_scrub_stamp":"2024-09-14T12:01:50.893935+0000","last_clean_scrub_stamp":"2024-09-14T12:01:50.893935+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:36.400620+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2407,"num_read_kb":2236,"num_write":590,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"263'320","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.828433+0000","last_change":"2024-09-14T12:01:30.828433+0000","last_active":"2024-09-14T12:01:30.828433+0000","last_peered":"2024-09-14T12:01:30.828433+0000","last_clean":"2024-09-14T12:01:30.828433+0000","last_became_active":"2024-09-14T10:46:44.321098+0000","last_became_peered":"2024-09-14T10:46:44.321098+0000","last_unstale":"2024-09-14T12:01:30.828433+0000","last_undegraded":"2024-09-14T12:01:30.828433+0000","last_fullsized":"2024-09-14T12:01:30.828433+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'320","last_scrub_stamp":"2024-09-14T12:01:30.828329+0000","last_deep_scrub":"263'320","last_deep_scrub_stamp":"2024-09-14T12:01:30.828329+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.828329+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:12.296951+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":621,"num_read_kb":93491,"num_write":1039,"num_write_kb":33828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"263'564","reported_seq":2232,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.576450+0000","last_change":"2024-09-14T12:01:42.576372+0000","last_active":"2024-09-14T12:01:42.576450+0000","last_peered":"2024-09-14T12:01:42.576450+0000","last_clean":"2024-09-14T12:01:42.576450+0000","last_became_active":"2024-09-14T10:46:46.337883+0000","last_became_peered":"2024-09-14T10:46:46.337883+0000","last_unstale":"2024-09-14T12:01:42.576450+0000","last_undegraded":"2024-09-14T12:01:42.576450+0000","last_fullsized":"2024-09-14T12:01:42.576450+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'564","last_scrub_stamp":"2024-09-14T12:01:42.576290+0000","last_deep_scrub":"263'564","last_deep_scrub_stamp":"2024-09-14T12:01:42.576290+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.576290+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":500,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:57.196401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3147,"num_read_kb":2923,"num_write":727,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"263'377","reported_seq":1065,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.257994+0000","last_change":"2024-09-14T12:01:33.257931+0000","last_active":"2024-09-14T12:01:33.257994+0000","last_peered":"2024-09-14T12:01:33.257994+0000","last_clean":"2024-09-14T12:01:33.257994+0000","last_became_active":"2024-09-14T10:46:44.324768+0000","last_became_peered":"2024-09-14T10:46:44.324768+0000","last_unstale":"2024-09-14T12:01:33.257994+0000","last_undegraded":"2024-09-14T12:01:33.257994+0000","last_fullsized":"2024-09-14T12:01:33.257994+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-14T12:01:33.257829+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-14T12:01:33.257829+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.257829+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:41.419490+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":706,"num_read_kb":82703,"num_write":1285,"num_write_kb":36007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"263'448","reported_seq":2083,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.239959+0000","last_change":"2024-09-14T12:01:41.239959+0000","last_active":"2024-09-14T12:01:41.239959+0000","last_peered":"2024-09-14T12:01:41.239959+0000","last_clean":"2024-09-14T12:01:41.239959+0000","last_became_active":"2024-09-14T10:46:46.338973+0000","last_became_peered":"2024-09-14T10:46:46.338973+0000","last_unstale":"2024-09-14T12:01:41.239959+0000","last_undegraded":"2024-09-14T12:01:41.239959+0000","last_fullsized":"2024-09-14T12:01:41.239959+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'448","last_scrub_stamp":"2024-09-14T12:01:41.239865+0000","last_deep_scrub":"263'448","last_deep_scrub_stamp":"2024-09-14T12:01:41.239865+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.239865+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:15.050347+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2500,"num_read_kb":2382,"num_write":507,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"263'357","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.825671+0000","last_change":"2024-09-14T12:01:29.825614+0000","last_active":"2024-09-14T12:01:29.825671+0000","last_peered":"2024-09-14T12:01:29.825671+0000","last_clean":"2024-09-14T12:01:29.825671+0000","last_became_active":"2024-09-14T10:46:44.319801+0000","last_became_peered":"2024-09-14T10:46:44.319801+0000","last_unstale":"2024-09-14T12:01:29.825671+0000","last_undegraded":"2024-09-14T12:01:29.825671+0000","last_fullsized":"2024-09-14T12:01:29.825671+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'357","last_scrub_stamp":"2024-09-14T12:01:29.825517+0000","last_deep_scrub":"263'357","last_deep_scrub_stamp":"2024-09-14T12:01:29.825517+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.825517+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:51:15.006775+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":563,"num_read_kb":13023,"num_write":1154,"num_write_kb":36371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"263'583","reported_seq":2168,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.269644+0000","last_change":"2024-09-14T12:01:39.269579+0000","last_active":"2024-09-14T12:01:39.269644+0000","last_peered":"2024-09-14T12:01:39.269644+0000","last_clean":"2024-09-14T12:01:39.269644+0000","last_became_active":"2024-09-14T10:46:46.350776+0000","last_became_peered":"2024-09-14T10:46:46.350776+0000","last_unstale":"2024-09-14T12:01:39.269644+0000","last_undegraded":"2024-09-14T12:01:39.269644+0000","last_fullsized":"2024-09-14T12:01:39.269644+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'583","last_scrub_stamp":"2024-09-14T12:01:39.269492+0000","last_deep_scrub":"263'583","last_deep_scrub_stamp":"2024-09-14T12:01:39.269492+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.269492+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:13.396139+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3080,"num_read_kb":2791,"num_write":782,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":908,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"263'282","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.275254+0000","last_change":"2024-09-14T12:01:29.275115+0000","last_active":"2024-09-14T12:01:29.275254+0000","last_peered":"2024-09-14T12:01:29.275254+0000","last_clean":"2024-09-14T12:01:29.275254+0000","last_became_active":"2024-09-14T10:46:44.327650+0000","last_became_peered":"2024-09-14T10:46:44.327650+0000","last_unstale":"2024-09-14T12:01:29.275254+0000","last_undegraded":"2024-09-14T12:01:29.275254+0000","last_fullsized":"2024-09-14T12:01:29.275254+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'282","last_scrub_stamp":"2024-09-14T12:01:29.274975+0000","last_deep_scrub":"263'282","last_deep_scrub_stamp":"2024-09-14T12:01:29.274975+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.274975+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:44.277815+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":6055,"num_write":990,"num_write_kb":41392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"263'569","reported_seq":2326,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.915055+0000","last_change":"2024-09-14T12:01:39.914997+0000","last_active":"2024-09-14T12:01:39.915055+0000","last_peered":"2024-09-14T12:01:39.915055+0000","last_clean":"2024-09-14T12:01:39.915055+0000","last_became_active":"2024-09-14T10:46:46.341474+0000","last_became_peered":"2024-09-14T10:46:46.341474+0000","last_unstale":"2024-09-14T12:01:39.915055+0000","last_undegraded":"2024-09-14T12:01:39.915055+0000","last_fullsized":"2024-09-14T12:01:39.915055+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'569","last_scrub_stamp":"2024-09-14T12:01:39.914912+0000","last_deep_scrub":"263'569","last_deep_scrub_stamp":"2024-09-14T12:01:39.914912+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.914912+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:23.529357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3094,"num_read_kb":2877,"num_write":684,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"263'343","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.312096+0000","last_change":"2024-09-14T12:01:36.312033+0000","last_active":"2024-09-14T12:01:36.312096+0000","last_peered":"2024-09-14T12:01:36.312096+0000","last_clean":"2024-09-14T12:01:36.312096+0000","last_became_active":"2024-09-14T10:46:44.334630+0000","last_became_peered":"2024-09-14T10:46:44.334630+0000","last_unstale":"2024-09-14T12:01:36.312096+0000","last_undegraded":"2024-09-14T12:01:36.312096+0000","last_fullsized":"2024-09-14T12:01:36.312096+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-14T12:01:36.311932+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-14T12:01:36.311932+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.311932+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:31.732885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":627,"num_read_kb":14860,"num_write":1052,"num_write_kb":34853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"263'827","reported_seq":2419,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:47.398338+0000","last_change":"2024-09-14T12:01:47.398279+0000","last_active":"2024-09-14T12:01:47.398338+0000","last_peered":"2024-09-14T12:01:47.398338+0000","last_clean":"2024-09-14T12:01:47.398338+0000","last_became_active":"2024-09-14T10:46:46.350391+0000","last_became_peered":"2024-09-14T10:46:46.350391+0000","last_unstale":"2024-09-14T12:01:47.398338+0000","last_undegraded":"2024-09-14T12:01:47.398338+0000","last_fullsized":"2024-09-14T12:01:47.398338+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'827","last_scrub_stamp":"2024-09-14T12:01:47.398188+0000","last_deep_scrub":"263'827","last_deep_scrub_stamp":"2024-09-14T12:01:47.398188+0000","last_clean_scrub_stamp":"2024-09-14T12:01:47.398188+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:51.317531+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3863,"num_read_kb":3486,"num_write":1075,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"263'750","reported_seq":2177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.757216+0000","last_change":"2024-09-14T12:01:42.757216+0000","last_active":"2024-09-14T12:01:42.757216+0000","last_peered":"2024-09-14T12:01:42.757216+0000","last_clean":"2024-09-14T12:01:42.757216+0000","last_became_active":"2024-09-14T10:46:46.335749+0000","last_became_peered":"2024-09-14T10:46:46.335749+0000","last_unstale":"2024-09-14T12:01:42.757216+0000","last_undegraded":"2024-09-14T12:01:42.757216+0000","last_fullsized":"2024-09-14T12:01:42.757216+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'750","last_scrub_stamp":"2024-09-14T12:01:42.757030+0000","last_deep_scrub":"263'750","last_deep_scrub_stamp":"2024-09-14T12:01:42.757030+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.757030+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:49.714436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3617,"num_read_kb":3235,"num_write":1004,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"263'306","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.685720+0000","last_change":"2024-09-14T12:01:29.685602+0000","last_active":"2024-09-14T12:01:29.685720+0000","last_peered":"2024-09-14T12:01:29.685720+0000","last_clean":"2024-09-14T12:01:29.685720+0000","last_became_active":"2024-09-14T10:46:44.316741+0000","last_became_peered":"2024-09-14T10:46:44.316741+0000","last_unstale":"2024-09-14T12:01:29.685720+0000","last_undegraded":"2024-09-14T12:01:29.685720+0000","last_fullsized":"2024-09-14T12:01:29.685720+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'306","last_scrub_stamp":"2024-09-14T12:01:29.685467+0000","last_deep_scrub":"263'306","last_deep_scrub_stamp":"2024-09-14T12:01:29.685467+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.685467+0000","objects_scrubbed":4,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:18.640343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133671,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":507,"num_read_kb":26974,"num_write":959,"num_write_kb":33080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"263'805","reported_seq":2507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.299296+0000","last_change":"2024-09-14T12:01:38.299296+0000","last_active":"2024-09-14T12:01:38.299296+0000","last_peered":"2024-09-14T12:01:38.299296+0000","last_clean":"2024-09-14T12:01:38.299296+0000","last_became_active":"2024-09-14T10:46:46.345709+0000","last_became_peered":"2024-09-14T10:46:46.345709+0000","last_unstale":"2024-09-14T12:01:38.299296+0000","last_undegraded":"2024-09-14T12:01:38.299296+0000","last_fullsized":"2024-09-14T12:01:38.299296+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'805","last_scrub_stamp":"2024-09-14T12:01:38.299204+0000","last_deep_scrub":"263'805","last_deep_scrub_stamp":"2024-09-14T12:01:38.299204+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.299204+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:24.140873+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3947,"num_read_kb":3606,"num_write":1038,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"263'367","reported_seq":1016,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.285396+0000","last_change":"2024-09-14T12:01:28.285316+0000","last_active":"2024-09-14T12:01:28.285396+0000","last_peered":"2024-09-14T12:01:28.285396+0000","last_clean":"2024-09-14T12:01:28.285396+0000","last_became_active":"2024-09-14T10:46:44.331599+0000","last_became_peered":"2024-09-14T10:46:44.331599+0000","last_unstale":"2024-09-14T12:01:28.285396+0000","last_undegraded":"2024-09-14T12:01:28.285396+0000","last_fullsized":"2024-09-14T12:01:28.285396+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-09-14T12:01:28.285209+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-09-14T12:01:28.285209+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.285209+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:29.491140+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":622,"num_read_kb":2368,"num_write":1092,"num_write_kb":34113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"263'400","reported_seq":1971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.683623+0000","last_change":"2024-09-14T12:01:36.683566+0000","last_active":"2024-09-14T12:01:36.683623+0000","last_peered":"2024-09-14T12:01:36.683623+0000","last_clean":"2024-09-14T12:01:36.683623+0000","last_became_active":"2024-09-14T10:46:46.350525+0000","last_became_peered":"2024-09-14T10:46:46.350525+0000","last_unstale":"2024-09-14T12:01:36.683623+0000","last_undegraded":"2024-09-14T12:01:36.683623+0000","last_fullsized":"2024-09-14T12:01:36.683623+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'400","last_scrub_stamp":"2024-09-14T12:01:36.683491+0000","last_deep_scrub":"263'400","last_deep_scrub_stamp":"2024-09-14T12:01:36.683491+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.683491+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:32.999277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2275,"num_read_kb":2173,"num_write":451,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"263'369","reported_seq":1054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.276045+0000","last_change":"2024-09-14T12:01:30.275983+0000","last_active":"2024-09-14T12:01:30.276045+0000","last_peered":"2024-09-14T12:01:30.276045+0000","last_clean":"2024-09-14T12:01:30.276045+0000","last_became_active":"2024-09-14T10:46:44.339871+0000","last_became_peered":"2024-09-14T10:46:44.339871+0000","last_unstale":"2024-09-14T12:01:30.276045+0000","last_undegraded":"2024-09-14T12:01:30.276045+0000","last_fullsized":"2024-09-14T12:01:30.276045+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'369","last_scrub_stamp":"2024-09-14T12:01:30.275862+0000","last_deep_scrub":"263'369","last_deep_scrub_stamp":"2024-09-14T12:01:30.275862+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.275862+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:27.494575+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":774,"num_read_kb":19273,"num_write":1249,"num_write_kb":53136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"263'1157","reported_seq":2724,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.847949+0000","last_change":"2024-09-14T12:01:41.847888+0000","last_active":"2024-09-14T12:01:41.847949+0000","last_peered":"2024-09-14T12:01:41.847949+0000","last_clean":"2024-09-14T12:01:41.847949+0000","last_became_active":"2024-09-14T10:46:46.349649+0000","last_became_peered":"2024-09-14T10:46:46.349649+0000","last_unstale":"2024-09-14T12:01:41.847949+0000","last_undegraded":"2024-09-14T12:01:41.847949+0000","last_fullsized":"2024-09-14T12:01:41.847949+0000","mapping_epoch":28,"log_start":"263'1100","ondisk_log_start":"263'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1157","last_scrub_stamp":"2024-09-14T12:01:41.847805+0000","last_deep_scrub":"263'1157","last_deep_scrub_stamp":"2024-09-14T12:01:41.847805+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.847805+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":1100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:14.558545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5238,"num_read_kb":4651,"num_write":1596,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"263'343","reported_seq":1086,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.296535+0000","last_change":"2024-09-14T12:01:34.296459+0000","last_active":"2024-09-14T12:01:34.296535+0000","last_peered":"2024-09-14T12:01:34.296535+0000","last_clean":"2024-09-14T12:01:34.296535+0000","last_became_active":"2024-09-14T10:46:44.326645+0000","last_became_peered":"2024-09-14T10:46:44.326645+0000","last_unstale":"2024-09-14T12:01:34.296535+0000","last_undegraded":"2024-09-14T12:01:34.296535+0000","last_fullsized":"2024-09-14T12:01:34.296535+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-14T12:01:34.296326+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-14T12:01:34.296326+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.296326+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:34.490843+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":923,"num_read_kb":14272,"num_write":1148,"num_write_kb":16465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"263'966","reported_seq":2520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:46.377275+0000","last_change":"2024-09-14T12:01:46.377275+0000","last_active":"2024-09-14T12:01:46.377275+0000","last_peered":"2024-09-14T12:01:46.377275+0000","last_clean":"2024-09-14T12:01:46.377275+0000","last_became_active":"2024-09-14T10:46:46.347420+0000","last_became_peered":"2024-09-14T10:46:46.347420+0000","last_unstale":"2024-09-14T12:01:46.377275+0000","last_undegraded":"2024-09-14T12:01:46.377275+0000","last_fullsized":"2024-09-14T12:01:46.377275+0000","mapping_epoch":28,"log_start":"263'900","ondisk_log_start":"263'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'966","last_scrub_stamp":"2024-09-14T12:01:46.377190+0000","last_deep_scrub":"263'966","last_deep_scrub_stamp":"2024-09-14T12:01:46.377190+0000","last_clean_scrub_stamp":"2024-09-14T12:01:46.377190+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":900,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:08.514127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5046,"num_read_kb":4563,"num_write":1374,"num_write_kb":542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"263'377","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.755590+0000","last_change":"2024-09-14T12:01:34.755520+0000","last_active":"2024-09-14T12:01:34.755590+0000","last_peered":"2024-09-14T12:01:34.755590+0000","last_clean":"2024-09-14T12:01:34.755590+0000","last_became_active":"2024-09-14T10:46:44.319146+0000","last_became_peered":"2024-09-14T10:46:44.319146+0000","last_unstale":"2024-09-14T12:01:34.755590+0000","last_undegraded":"2024-09-14T12:01:34.755590+0000","last_fullsized":"2024-09-14T12:01:34.755590+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-14T12:01:34.755410+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-14T12:01:34.755410+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.755410+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:11.914432+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":594,"num_read_kb":40910,"num_write":1073,"num_write_kb":34714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"263'375","reported_seq":1901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.707478+0000","last_change":"2024-09-14T12:01:35.707415+0000","last_active":"2024-09-14T12:01:35.707478+0000","last_peered":"2024-09-14T12:01:35.707478+0000","last_clean":"2024-09-14T12:01:35.707478+0000","last_became_active":"2024-09-14T10:46:46.339710+0000","last_became_peered":"2024-09-14T10:46:46.339710+0000","last_unstale":"2024-09-14T12:01:35.707478+0000","last_undegraded":"2024-09-14T12:01:35.707478+0000","last_fullsized":"2024-09-14T12:01:35.707478+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'375","last_scrub_stamp":"2024-09-14T12:01:35.707315+0000","last_deep_scrub":"263'375","last_deep_scrub_stamp":"2024-09-14T12:01:35.707315+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.707315+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:14.828586+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2075,"num_read_kb":1993,"num_write":416,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"263'322","reported_seq":1051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.762601+0000","last_change":"2024-09-14T12:01:33.762529+0000","last_active":"2024-09-14T12:01:33.762601+0000","last_peered":"2024-09-14T12:01:33.762601+0000","last_clean":"2024-09-14T12:01:33.762601+0000","last_became_active":"2024-09-14T10:46:44.317895+0000","last_became_peered":"2024-09-14T10:46:44.317895+0000","last_unstale":"2024-09-14T12:01:33.762601+0000","last_undegraded":"2024-09-14T12:01:33.762601+0000","last_fullsized":"2024-09-14T12:01:33.762601+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'322","last_scrub_stamp":"2024-09-14T12:01:33.762405+0000","last_deep_scrub":"263'322","last_deep_scrub_stamp":"2024-09-14T12:01:33.762405+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.762405+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:37.306350+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":939,"num_read_kb":22981,"num_write":1007,"num_write_kb":27989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"263'133","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:51.258555+0000","last_change":"2024-09-14T12:01:51.258555+0000","last_active":"2024-09-14T12:01:51.258555+0000","last_peered":"2024-09-14T12:01:51.258555+0000","last_clean":"2024-09-14T12:01:51.258555+0000","last_became_active":"2024-09-14T10:46:54.374769+0000","last_became_peered":"2024-09-14T10:46:54.374769+0000","last_unstale":"2024-09-14T12:01:51.258555+0000","last_undegraded":"2024-09-14T12:01:51.258555+0000","last_fullsized":"2024-09-14T12:01:51.258555+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-14T12:01:51.258466+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-14T12:01:51.258466+0000","last_clean_scrub_stamp":"2024-09-14T12:01:51.258466+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:21.567863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":165,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"263'434","reported_seq":1993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.832518+0000","last_change":"2024-09-14T12:01:40.832518+0000","last_active":"2024-09-14T12:01:40.832518+0000","last_peered":"2024-09-14T12:01:40.832518+0000","last_clean":"2024-09-14T12:01:40.832518+0000","last_became_active":"2024-09-14T10:46:46.340169+0000","last_became_peered":"2024-09-14T10:46:46.340169+0000","last_unstale":"2024-09-14T12:01:40.832518+0000","last_undegraded":"2024-09-14T12:01:40.832518+0000","last_fullsized":"2024-09-14T12:01:40.832518+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'434","last_scrub_stamp":"2024-09-14T12:01:40.832431+0000","last_deep_scrub":"263'434","last_deep_scrub_stamp":"2024-09-14T12:01:40.832431+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.832431+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:14.426399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2291,"num_read_kb":2165,"num_write":484,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"263'388","reported_seq":1041,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.804018+0000","last_change":"2024-09-14T12:01:32.803949+0000","last_active":"2024-09-14T12:01:32.804018+0000","last_peered":"2024-09-14T12:01:32.804018+0000","last_clean":"2024-09-14T12:01:32.804018+0000","last_became_active":"2024-09-14T10:47:18.793917+0000","last_became_peered":"2024-09-14T10:47:18.793917+0000","last_unstale":"2024-09-14T12:01:32.804018+0000","last_undegraded":"2024-09-14T12:01:32.804018+0000","last_fullsized":"2024-09-14T12:01:32.804018+0000","mapping_epoch":39,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'388","last_scrub_stamp":"2024-09-14T12:01:32.803811+0000","last_deep_scrub":"263'388","last_deep_scrub_stamp":"2024-09-14T12:01:32.803811+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.803811+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:40.563517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":723,"num_read_kb":48707,"num_write":1316,"num_write_kb":50304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:53.836847+0000","last_change":"2024-09-14T12:01:53.836847+0000","last_active":"2024-09-14T12:01:53.836847+0000","last_peered":"2024-09-14T12:01:53.836847+0000","last_clean":"2024-09-14T12:01:53.836847+0000","last_became_active":"2024-09-14T10:46:48.356776+0000","last_became_peered":"2024-09-14T10:46:48.356776+0000","last_unstale":"2024-09-14T12:01:53.836847+0000","last_undegraded":"2024-09-14T12:01:53.836847+0000","last_fullsized":"2024-09-14T12:01:53.836847+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:53.836757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:53.836757+0000","last_clean_scrub_stamp":"2024-09-14T12:01:53.836757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:22.747891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"263'358","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:54.575824+0000","last_change":"2024-09-14T12:01:54.575824+0000","last_active":"2024-09-14T12:01:54.575824+0000","last_peered":"2024-09-14T12:01:54.575824+0000","last_clean":"2024-09-14T12:01:54.575824+0000","last_became_active":"2024-09-14T10:46:50.359481+0000","last_became_peered":"2024-09-14T10:46:50.359481+0000","last_unstale":"2024-09-14T12:01:54.575824+0000","last_undegraded":"2024-09-14T12:01:54.575824+0000","last_fullsized":"2024-09-14T12:01:54.575824+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-09-14T12:01:54.575724+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-09-14T12:01:54.575724+0000","last_clean_scrub_stamp":"2024-09-14T12:01:54.575724+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:24.526696+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51669,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":564,"num_read_kb":1178,"num_write":444,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:46.606931+0000","last_change":"2024-09-14T12:01:46.606852+0000","last_active":"2024-09-14T12:01:46.606931+0000","last_peered":"2024-09-14T12:01:46.606931+0000","last_clean":"2024-09-14T12:01:46.606931+0000","last_became_active":"2024-09-14T10:46:52.372941+0000","last_became_peered":"2024-09-14T10:46:52.372941+0000","last_unstale":"2024-09-14T12:01:46.606931+0000","last_undegraded":"2024-09-14T12:01:46.606931+0000","last_fullsized":"2024-09-14T12:01:46.606931+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:46.606763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:46.606763+0000","last_clean_scrub_stamp":"2024-09-14T12:01:46.606763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:57.006977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"263'156","reported_seq":654,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:57.641119+0000","last_change":"2024-09-14T12:01:57.641016+0000","last_active":"2024-09-14T12:01:57.641119+0000","last_peered":"2024-09-14T12:01:57.641119+0000","last_clean":"2024-09-14T12:01:57.641119+0000","last_became_active":"2024-09-14T10:46:54.387445+0000","last_became_peered":"2024-09-14T10:46:54.387445+0000","last_unstale":"2024-09-14T12:01:57.641119+0000","last_undegraded":"2024-09-14T12:01:57.641119+0000","last_fullsized":"2024-09-14T12:01:57.641119+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'156","last_scrub_stamp":"2024-09-14T12:01:57.640905+0000","last_deep_scrub":"263'156","last_deep_scrub_stamp":"2024-09-14T12:01:57.640905+0000","last_clean_scrub_stamp":"2024-09-14T12:01:57.640905+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:04.004929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":80,"num_write":348,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"263'557","reported_seq":2286,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:46.891074+0000","last_change":"2024-09-14T12:01:46.891074+0000","last_active":"2024-09-14T12:01:46.891074+0000","last_peered":"2024-09-14T12:01:46.891074+0000","last_clean":"2024-09-14T12:01:46.891074+0000","last_became_active":"2024-09-14T10:46:46.340242+0000","last_became_peered":"2024-09-14T10:46:46.340242+0000","last_unstale":"2024-09-14T12:01:46.891074+0000","last_undegraded":"2024-09-14T12:01:46.891074+0000","last_fullsized":"2024-09-14T12:01:46.891074+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'557","last_scrub_stamp":"2024-09-14T12:01:46.890977+0000","last_deep_scrub":"263'557","last_deep_scrub_stamp":"2024-09-14T12:01:46.890977+0000","last_clean_scrub_stamp":"2024-09-14T12:01:46.890977+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:49.290795+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3138,"num_read_kb":2920,"num_write":702,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3295,"num_omap_keys":13,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"263'332","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.847264+0000","last_change":"2024-09-14T12:01:30.847264+0000","last_active":"2024-09-14T12:01:30.847264+0000","last_peered":"2024-09-14T12:01:30.847264+0000","last_clean":"2024-09-14T12:01:30.847264+0000","last_became_active":"2024-09-14T10:46:44.334757+0000","last_became_peered":"2024-09-14T10:46:44.334757+0000","last_unstale":"2024-09-14T12:01:30.847264+0000","last_undegraded":"2024-09-14T12:01:30.847264+0000","last_fullsized":"2024-09-14T12:01:30.847264+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'332","last_scrub_stamp":"2024-09-14T12:01:30.847120+0000","last_deep_scrub":"263'332","last_deep_scrub_stamp":"2024-09-14T12:01:30.847120+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.847120+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:08.535049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133691,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":630,"num_read_kb":20083,"num_write":1075,"num_write_kb":20918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.528073+0000","last_change":"2024-09-14T12:01:43.528005+0000","last_active":"2024-09-14T12:01:43.528073+0000","last_peered":"2024-09-14T12:01:43.528073+0000","last_clean":"2024-09-14T12:01:43.528073+0000","last_became_active":"2024-09-14T10:46:48.351825+0000","last_became_peered":"2024-09-14T10:46:48.351825+0000","last_unstale":"2024-09-14T12:01:43.528073+0000","last_undegraded":"2024-09-14T12:01:43.528073+0000","last_fullsized":"2024-09-14T12:01:43.528073+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:43.527908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:43.527908+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.527908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:37.108237+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"263'104","reported_seq":645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.647651+0000","last_change":"2024-09-14T12:01:43.647591+0000","last_active":"2024-09-14T12:01:43.647651+0000","last_peered":"2024-09-14T12:01:43.647651+0000","last_clean":"2024-09-14T12:01:43.647651+0000","last_became_active":"2024-09-14T10:46:50.360649+0000","last_became_peered":"2024-09-14T10:46:50.360649+0000","last_unstale":"2024-09-14T12:01:43.647651+0000","last_undegraded":"2024-09-14T12:01:43.647651+0000","last_fullsized":"2024-09-14T12:01:43.647651+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'104","last_scrub_stamp":"2024-09-14T12:01:43.647503+0000","last_deep_scrub":"263'104","last_deep_scrub_stamp":"2024-09-14T12:01:43.647503+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.647503+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:21.629132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:56.687801+0000","last_change":"2024-09-14T12:01:56.687801+0000","last_active":"2024-09-14T12:01:56.687801+0000","last_peered":"2024-09-14T12:01:56.687801+0000","last_clean":"2024-09-14T12:01:56.687801+0000","last_became_active":"2024-09-14T10:46:52.372770+0000","last_became_peered":"2024-09-14T10:46:52.372770+0000","last_unstale":"2024-09-14T12:01:56.687801+0000","last_undegraded":"2024-09-14T12:01:56.687801+0000","last_fullsized":"2024-09-14T12:01:56.687801+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:56.687704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:56.687704+0000","last_clean_scrub_stamp":"2024-09-14T12:01:56.687704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:38.741747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"263'144","reported_seq":660,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:56.812734+0000","last_change":"2024-09-14T12:01:56.812653+0000","last_active":"2024-09-14T12:01:56.812734+0000","last_peered":"2024-09-14T12:01:56.812734+0000","last_clean":"2024-09-14T12:01:56.812734+0000","last_became_active":"2024-09-14T10:46:54.389638+0000","last_became_peered":"2024-09-14T10:46:54.389638+0000","last_unstale":"2024-09-14T12:01:56.812734+0000","last_undegraded":"2024-09-14T12:01:56.812734+0000","last_fullsized":"2024-09-14T12:01:56.812734+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-14T12:01:56.812551+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-14T12:01:56.812551+0000","last_clean_scrub_stamp":"2024-09-14T12:01:56.812551+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:10.068600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":168,"num_write":356,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"263'452","reported_seq":2199,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.220802+0000","last_change":"2024-09-14T12:01:41.220735+0000","last_active":"2024-09-14T12:01:41.220802+0000","last_peered":"2024-09-14T12:01:41.220802+0000","last_clean":"2024-09-14T12:01:41.220802+0000","last_became_active":"2024-09-14T10:46:46.344509+0000","last_became_peered":"2024-09-14T10:46:46.344509+0000","last_unstale":"2024-09-14T12:01:41.220802+0000","last_undegraded":"2024-09-14T12:01:41.220802+0000","last_fullsized":"2024-09-14T12:01:41.220802+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'452","last_scrub_stamp":"2024-09-14T12:01:41.220645+0000","last_deep_scrub":"263'452","last_deep_scrub_stamp":"2024-09-14T12:01:41.220645+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.220645+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:35.813843+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2693,"num_read_kb":2571,"num_write":507,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2556,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"263'330","reported_seq":1012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.784580+0000","last_change":"2024-09-14T12:01:33.784580+0000","last_active":"2024-09-14T12:01:33.784580+0000","last_peered":"2024-09-14T12:01:33.784580+0000","last_clean":"2024-09-14T12:01:33.784580+0000","last_became_active":"2024-09-14T10:46:44.331464+0000","last_became_peered":"2024-09-14T10:46:44.331464+0000","last_unstale":"2024-09-14T12:01:33.784580+0000","last_undegraded":"2024-09-14T12:01:33.784580+0000","last_fullsized":"2024-09-14T12:01:33.784580+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'330","last_scrub_stamp":"2024-09-14T12:01:33.784418+0000","last_deep_scrub":"263'330","last_deep_scrub_stamp":"2024-09-14T12:01:33.784418+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.784418+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:35.461645+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267319,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":652,"num_read_kb":48168,"num_write":1033,"num_write_kb":26849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:46.531442+0000","last_change":"2024-09-14T12:01:46.531442+0000","last_active":"2024-09-14T12:01:46.531442+0000","last_peered":"2024-09-14T12:01:46.531442+0000","last_clean":"2024-09-14T12:01:46.531442+0000","last_became_active":"2024-09-14T10:46:48.357301+0000","last_became_peered":"2024-09-14T10:46:48.357301+0000","last_unstale":"2024-09-14T12:01:46.531442+0000","last_undegraded":"2024-09-14T12:01:46.531442+0000","last_fullsized":"2024-09-14T12:01:46.531442+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:46.531345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:46.531345+0000","last_clean_scrub_stamp":"2024-09-14T12:01:46.531345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:24.241883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"263'144","reported_seq":706,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:53.618728+0000","last_change":"2024-09-14T12:01:53.618728+0000","last_active":"2024-09-14T12:01:53.618728+0000","last_peered":"2024-09-14T12:01:53.618728+0000","last_clean":"2024-09-14T12:01:53.618728+0000","last_became_active":"2024-09-14T10:46:50.363495+0000","last_became_peered":"2024-09-14T10:46:50.363495+0000","last_unstale":"2024-09-14T12:01:53.618728+0000","last_undegraded":"2024-09-14T12:01:53.618728+0000","last_fullsized":"2024-09-14T12:01:53.618728+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-14T12:01:53.618629+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-14T12:01:53.618629+0000","last_clean_scrub_stamp":"2024-09-14T12:01:53.618629+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:30:16.530507+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":162,"num_write":114,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"263'793","reported_seq":2737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:03.750622+0000","last_change":"2024-09-14T12:02:03.750622+0000","last_active":"2024-09-14T12:02:03.750622+0000","last_peered":"2024-09-14T12:02:03.750622+0000","last_clean":"2024-09-14T12:02:03.750622+0000","last_became_active":"2024-09-14T10:46:52.373886+0000","last_became_peered":"2024-09-14T10:46:52.373886+0000","last_unstale":"2024-09-14T12:02:03.750622+0000","last_undegraded":"2024-09-14T12:02:03.750622+0000","last_fullsized":"2024-09-14T12:02:03.750622+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'793","last_scrub_stamp":"2024-09-14T12:02:03.750525+0000","last_deep_scrub":"263'793","last_deep_scrub_stamp":"2024-09-14T12:02:03.750525+0000","last_clean_scrub_stamp":"2024-09-14T12:02:03.750525+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:17.425492+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"263'183","reported_seq":1015,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:51.826534+0000","last_change":"2024-09-14T12:01:51.826468+0000","last_active":"2024-09-14T12:01:51.826534+0000","last_peered":"2024-09-14T12:01:51.826534+0000","last_clean":"2024-09-14T12:01:51.826534+0000","last_became_active":"2024-09-14T10:46:54.388186+0000","last_became_peered":"2024-09-14T10:46:54.388186+0000","last_unstale":"2024-09-14T12:01:51.826534+0000","last_undegraded":"2024-09-14T12:01:51.826534+0000","last_fullsized":"2024-09-14T12:01:51.826534+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'183","last_scrub_stamp":"2024-09-14T12:01:51.826355+0000","last_deep_scrub":"263'183","last_deep_scrub_stamp":"2024-09-14T12:01:51.826355+0000","last_clean_scrub_stamp":"2024-09-14T12:01:51.826355+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:29.432769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":561,"num_read_kb":561,"num_write":378,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"263'897","reported_seq":2339,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.268109+0000","last_change":"2024-09-14T12:01:42.268055+0000","last_active":"2024-09-14T12:01:42.268109+0000","last_peered":"2024-09-14T12:01:42.268109+0000","last_clean":"2024-09-14T12:01:42.268109+0000","last_became_active":"2024-09-14T10:46:46.351453+0000","last_became_peered":"2024-09-14T10:46:46.351453+0000","last_unstale":"2024-09-14T12:01:42.268109+0000","last_undegraded":"2024-09-14T12:01:42.268109+0000","last_fullsized":"2024-09-14T12:01:42.268109+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'897","last_scrub_stamp":"2024-09-14T12:01:42.267963+0000","last_deep_scrub":"263'897","last_deep_scrub_stamp":"2024-09-14T12:01:42.267963+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.267963+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":800,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:38.136304+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4193,"num_read_kb":3693,"num_write":1250,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"263'366","reported_seq":1051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:25.748065+0000","last_change":"2024-09-14T12:01:25.748065+0000","last_active":"2024-09-14T12:01:25.748065+0000","last_peered":"2024-09-14T12:01:25.748065+0000","last_clean":"2024-09-14T12:01:25.748065+0000","last_became_active":"2024-09-14T10:46:44.328531+0000","last_became_peered":"2024-09-14T10:46:44.328531+0000","last_unstale":"2024-09-14T12:01:25.748065+0000","last_undegraded":"2024-09-14T12:01:25.748065+0000","last_fullsized":"2024-09-14T12:01:25.748065+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'366","last_scrub_stamp":"2024-09-14T12:01:25.747975+0000","last_deep_scrub":"263'366","last_deep_scrub_stamp":"2024-09-14T12:01:25.747975+0000","last_clean_scrub_stamp":"2024-09-14T12:01:25.747975+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:05.853735+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":728,"num_read_kb":24160,"num_write":1182,"num_write_kb":50074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:54.854363+0000","last_change":"2024-09-14T12:01:54.854363+0000","last_active":"2024-09-14T12:01:54.854363+0000","last_peered":"2024-09-14T12:01:54.854363+0000","last_clean":"2024-09-14T12:01:54.854363+0000","last_became_active":"2024-09-14T10:46:48.348899+0000","last_became_peered":"2024-09-14T10:46:48.348899+0000","last_unstale":"2024-09-14T12:01:54.854363+0000","last_undegraded":"2024-09-14T12:01:54.854363+0000","last_fullsized":"2024-09-14T12:01:54.854363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:54.854273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:54.854273+0000","last_clean_scrub_stamp":"2024-09-14T12:01:54.854273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:37.507794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"263'311","reported_seq":904,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.892505+0000","last_change":"2024-09-14T12:01:43.892436+0000","last_active":"2024-09-14T12:01:43.892505+0000","last_peered":"2024-09-14T12:01:43.892505+0000","last_clean":"2024-09-14T12:01:43.892505+0000","last_became_active":"2024-09-14T10:46:50.365721+0000","last_became_peered":"2024-09-14T10:46:50.365721+0000","last_unstale":"2024-09-14T12:01:43.892505+0000","last_undegraded":"2024-09-14T12:01:43.892505+0000","last_fullsized":"2024-09-14T12:01:43.892505+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-09-14T12:01:43.892336+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-09-14T12:01:43.892336+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.892336+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:51.567901+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47247,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":1144,"num_write":408,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"263'831","reported_seq":2749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:56.171172+0000","last_change":"2024-09-14T12:01:56.171172+0000","last_active":"2024-09-14T12:01:56.171172+0000","last_peered":"2024-09-14T12:01:56.171172+0000","last_clean":"2024-09-14T12:01:56.171172+0000","last_became_active":"2024-09-14T10:46:52.374634+0000","last_became_peered":"2024-09-14T10:46:52.374634+0000","last_unstale":"2024-09-14T12:01:56.171172+0000","last_undegraded":"2024-09-14T12:01:56.171172+0000","last_fullsized":"2024-09-14T12:01:56.171172+0000","mapping_epoch":34,"log_start":"263'800","ondisk_log_start":"263'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'831","last_scrub_stamp":"2024-09-14T12:01:56.171077+0000","last_deep_scrub":"263'831","last_deep_scrub_stamp":"2024-09-14T12:01:56.171077+0000","last_clean_scrub_stamp":"2024-09-14T12:01:56.171077+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:37.257995+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"263'525","reported_seq":2113,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.726626+0000","last_change":"2024-09-14T12:01:41.726626+0000","last_active":"2024-09-14T12:01:41.726626+0000","last_peered":"2024-09-14T12:01:41.726626+0000","last_clean":"2024-09-14T12:01:41.726626+0000","last_became_active":"2024-09-14T10:46:46.341971+0000","last_became_peered":"2024-09-14T10:46:46.341971+0000","last_unstale":"2024-09-14T12:01:41.726626+0000","last_undegraded":"2024-09-14T12:01:41.726626+0000","last_fullsized":"2024-09-14T12:01:41.726626+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'525","last_scrub_stamp":"2024-09-14T12:01:41.726541+0000","last_deep_scrub":"263'525","last_deep_scrub_stamp":"2024-09-14T12:01:41.726541+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.726541+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:17.093439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2719,"num_read_kb":2513,"num_write":653,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"263'361","reported_seq":1034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.294867+0000","last_change":"2024-09-14T12:01:27.294867+0000","last_active":"2024-09-14T12:01:27.294867+0000","last_peered":"2024-09-14T12:01:27.294867+0000","last_clean":"2024-09-14T12:01:27.294867+0000","last_became_active":"2024-09-14T10:46:44.329782+0000","last_became_peered":"2024-09-14T10:46:44.329782+0000","last_unstale":"2024-09-14T12:01:27.294867+0000","last_undegraded":"2024-09-14T12:01:27.294867+0000","last_fullsized":"2024-09-14T12:01:27.294867+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'361","last_scrub_stamp":"2024-09-14T12:01:27.294789+0000","last_deep_scrub":"263'361","last_deep_scrub_stamp":"2024-09-14T12:01:27.294789+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.294789+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:54.811209+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":606,"num_read_kb":47823,"num_write":1082,"num_write_kb":48255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.639833+0000","last_change":"2024-09-14T12:01:42.639833+0000","last_active":"2024-09-14T12:01:42.639833+0000","last_peered":"2024-09-14T12:01:42.639833+0000","last_clean":"2024-09-14T12:01:42.639833+0000","last_became_active":"2024-09-14T10:46:48.352584+0000","last_became_peered":"2024-09-14T10:46:48.352584+0000","last_unstale":"2024-09-14T12:01:42.639833+0000","last_undegraded":"2024-09-14T12:01:42.639833+0000","last_fullsized":"2024-09-14T12:01:42.639833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:42.639742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:42.639742+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.639742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:10.999523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"263'424","reported_seq":1073,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.178116+0000","last_change":"2024-09-14T12:01:45.178116+0000","last_active":"2024-09-14T12:01:45.178116+0000","last_peered":"2024-09-14T12:01:45.178116+0000","last_clean":"2024-09-14T12:01:45.178116+0000","last_became_active":"2024-09-14T10:46:50.364438+0000","last_became_peered":"2024-09-14T10:46:50.364438+0000","last_unstale":"2024-09-14T12:01:45.178116+0000","last_undegraded":"2024-09-14T12:01:45.178116+0000","last_fullsized":"2024-09-14T12:01:45.178116+0000","mapping_epoch":32,"log_start":"263'400","ondisk_log_start":"263'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'424","last_scrub_stamp":"2024-09-14T12:01:45.178020+0000","last_deep_scrub":"263'424","last_deep_scrub_stamp":"2024-09-14T12:01:45.178020+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.178020+0000","objects_scrubbed":9,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:54.197314+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46781,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":687,"num_read_kb":1416,"num_write":538,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:53.880177+0000","last_change":"2024-09-14T12:01:53.880177+0000","last_active":"2024-09-14T12:01:53.880177+0000","last_peered":"2024-09-14T12:01:53.880177+0000","last_clean":"2024-09-14T12:01:53.880177+0000","last_became_active":"2024-09-14T10:46:52.367874+0000","last_became_peered":"2024-09-14T10:46:52.367874+0000","last_unstale":"2024-09-14T12:01:53.880177+0000","last_undegraded":"2024-09-14T12:01:53.880177+0000","last_fullsized":"2024-09-14T12:01:53.880177+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:53.880069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:53.880069+0000","last_clean_scrub_stamp":"2024-09-14T12:01:53.880069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:55.097023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"263'560","reported_seq":1410,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:50.846994+0000","last_change":"2024-09-14T12:01:50.846916+0000","last_active":"2024-09-14T12:01:50.846994+0000","last_peered":"2024-09-14T12:01:50.846994+0000","last_clean":"2024-09-14T12:01:50.846994+0000","last_became_active":"2024-09-14T10:46:54.389880+0000","last_became_peered":"2024-09-14T10:46:54.389880+0000","last_unstale":"2024-09-14T12:01:50.846994+0000","last_undegraded":"2024-09-14T12:01:50.846994+0000","last_fullsized":"2024-09-14T12:01:50.846994+0000","mapping_epoch":36,"log_start":"263'500","ondisk_log_start":"263'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'560","last_scrub_stamp":"2024-09-14T12:01:50.846820+0000","last_deep_scrub":"263'560","last_deep_scrub_stamp":"2024-09-14T12:01:50.846820+0000","last_clean_scrub_stamp":"2024-09-14T12:01:50.846820+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:18.830210+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1361,"num_read_kb":1337,"num_write":1147,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"263'1287","reported_seq":3020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.716251+0000","last_change":"2024-09-14T12:01:30.716251+0000","last_active":"2024-09-14T12:01:30.716251+0000","last_peered":"2024-09-14T12:01:30.716251+0000","last_clean":"2024-09-14T12:01:30.716251+0000","last_became_active":"2024-09-14T10:46:46.343603+0000","last_became_peered":"2024-09-14T10:46:46.343603+0000","last_unstale":"2024-09-14T12:01:30.716251+0000","last_undegraded":"2024-09-14T12:01:30.716251+0000","last_fullsized":"2024-09-14T12:01:30.716251+0000","mapping_epoch":28,"log_start":"263'1200","ondisk_log_start":"263'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1287","last_scrub_stamp":"2024-09-14T12:01:30.716161+0000","last_deep_scrub":"263'1287","last_deep_scrub_stamp":"2024-09-14T12:01:30.716161+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.716161+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":1200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:10.862248+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6021,"num_read_kb":5313,"num_write":1785,"num_write_kb":753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"263'327","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:25.890412+0000","last_change":"2024-09-14T12:01:25.890412+0000","last_active":"2024-09-14T12:01:25.890412+0000","last_peered":"2024-09-14T12:01:25.890412+0000","last_clean":"2024-09-14T12:01:25.890412+0000","last_became_active":"2024-09-14T10:46:44.322816+0000","last_became_peered":"2024-09-14T10:46:44.322816+0000","last_unstale":"2024-09-14T12:01:25.890412+0000","last_undegraded":"2024-09-14T12:01:25.890412+0000","last_fullsized":"2024-09-14T12:01:25.890412+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'327","last_scrub_stamp":"2024-09-14T12:01:25.890298+0000","last_deep_scrub":"263'327","last_deep_scrub_stamp":"2024-09-14T12:01:25.890298+0000","last_clean_scrub_stamp":"2024-09-14T12:01:25.890298+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:47.450364+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":492,"num_write":1114,"num_write_kb":29298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.849001+0000","last_change":"2024-09-14T12:01:42.849001+0000","last_active":"2024-09-14T12:01:42.849001+0000","last_peered":"2024-09-14T12:01:42.849001+0000","last_clean":"2024-09-14T12:01:42.849001+0000","last_became_active":"2024-09-14T10:46:48.351893+0000","last_became_peered":"2024-09-14T10:46:48.351893+0000","last_unstale":"2024-09-14T12:01:42.849001+0000","last_undegraded":"2024-09-14T12:01:42.849001+0000","last_fullsized":"2024-09-14T12:01:42.849001+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:42.848916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:42.848916+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.848916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:29.709750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"263'269","reported_seq":862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:51.589483+0000","last_change":"2024-09-14T12:01:51.589483+0000","last_active":"2024-09-14T12:01:51.589483+0000","last_peered":"2024-09-14T12:01:51.589483+0000","last_clean":"2024-09-14T12:01:51.589483+0000","last_became_active":"2024-09-14T10:46:50.359434+0000","last_became_peered":"2024-09-14T10:46:50.359434+0000","last_unstale":"2024-09-14T12:01:51.589483+0000","last_undegraded":"2024-09-14T12:01:51.589483+0000","last_fullsized":"2024-09-14T12:01:51.589483+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'269","last_scrub_stamp":"2024-09-14T12:01:51.589368+0000","last_deep_scrub":"263'269","last_deep_scrub_stamp":"2024-09-14T12:01:51.589368+0000","last_clean_scrub_stamp":"2024-09-14T12:01:51.589368+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:09.071357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44011,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":1031,"num_write":356,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:58.666180+0000","last_change":"2024-09-14T12:01:58.666180+0000","last_active":"2024-09-14T12:01:58.666180+0000","last_peered":"2024-09-14T12:01:58.666180+0000","last_clean":"2024-09-14T12:01:58.666180+0000","last_became_active":"2024-09-14T10:46:52.369353+0000","last_became_peered":"2024-09-14T10:46:52.369353+0000","last_unstale":"2024-09-14T12:01:58.666180+0000","last_undegraded":"2024-09-14T12:01:58.666180+0000","last_fullsized":"2024-09-14T12:01:58.666180+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:58.666096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:58.666096+0000","last_clean_scrub_stamp":"2024-09-14T12:01:58.666096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:41.189959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"263'2544","reported_seq":4377,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:51.727231+0000","last_change":"2024-09-14T12:01:51.727167+0000","last_active":"2024-09-14T12:01:51.727231+0000","last_peered":"2024-09-14T12:01:51.727231+0000","last_clean":"2024-09-14T12:01:51.727231+0000","last_became_active":"2024-09-14T10:46:54.383100+0000","last_became_peered":"2024-09-14T10:46:54.383100+0000","last_unstale":"2024-09-14T12:01:51.727231+0000","last_undegraded":"2024-09-14T12:01:51.727231+0000","last_fullsized":"2024-09-14T12:01:51.727231+0000","mapping_epoch":36,"log_start":"263'2500","ondisk_log_start":"263'2500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2544","last_scrub_stamp":"2024-09-14T12:01:51.727077+0000","last_deep_scrub":"263'2544","last_deep_scrub_stamp":"2024-09-14T12:01:51.727077+0000","last_clean_scrub_stamp":"2024-09-14T12:01:51.727077+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":2500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:47.596101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6216,"num_read_kb":6221,"num_write":5164,"num_write_kb":1877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"263'516","reported_seq":2296,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.851554+0000","last_change":"2024-09-14T12:01:32.851554+0000","last_active":"2024-09-14T12:01:32.851554+0000","last_peered":"2024-09-14T12:01:32.851554+0000","last_clean":"2024-09-14T12:01:32.851554+0000","last_became_active":"2024-09-14T10:46:46.337951+0000","last_became_peered":"2024-09-14T10:46:46.337951+0000","last_unstale":"2024-09-14T12:01:32.851554+0000","last_undegraded":"2024-09-14T12:01:32.851554+0000","last_fullsized":"2024-09-14T12:01:32.851554+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'516","last_scrub_stamp":"2024-09-14T12:01:32.851465+0000","last_deep_scrub":"263'516","last_deep_scrub_stamp":"2024-09-14T12:01:32.851465+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.851465+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:13.273879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2937,"num_read_kb":2795,"num_write":635,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"263'349","reported_seq":1036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.796987+0000","last_change":"2024-09-14T12:01:32.796987+0000","last_active":"2024-09-14T12:01:32.796987+0000","last_peered":"2024-09-14T12:01:32.796987+0000","last_clean":"2024-09-14T12:01:32.796987+0000","last_became_active":"2024-09-14T10:46:44.331705+0000","last_became_peered":"2024-09-14T10:46:44.331705+0000","last_unstale":"2024-09-14T12:01:32.796987+0000","last_undegraded":"2024-09-14T12:01:32.796987+0000","last_fullsized":"2024-09-14T12:01:32.796987+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'349","last_scrub_stamp":"2024-09-14T12:01:32.796840+0000","last_deep_scrub":"263'349","last_deep_scrub_stamp":"2024-09-14T12:01:32.796840+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.796840+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:14.276300+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":652,"num_read_kb":33315,"num_write":1115,"num_write_kb":35089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:49.302175+0000","last_change":"2024-09-14T12:01:49.302175+0000","last_active":"2024-09-14T12:01:49.302175+0000","last_peered":"2024-09-14T12:01:49.302175+0000","last_clean":"2024-09-14T12:01:49.302175+0000","last_became_active":"2024-09-14T10:46:48.354092+0000","last_became_peered":"2024-09-14T10:46:48.354092+0000","last_unstale":"2024-09-14T12:01:49.302175+0000","last_undegraded":"2024-09-14T12:01:49.302175+0000","last_fullsized":"2024-09-14T12:01:49.302175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:49.302099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:49.302099+0000","last_clean_scrub_stamp":"2024-09-14T12:01:49.302099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:05.762462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"263'350","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:57.835614+0000","last_change":"2024-09-14T12:01:57.835614+0000","last_active":"2024-09-14T12:01:57.835614+0000","last_peered":"2024-09-14T12:01:57.835614+0000","last_clean":"2024-09-14T12:01:57.835614+0000","last_became_active":"2024-09-14T10:46:50.363893+0000","last_became_peered":"2024-09-14T10:46:50.363893+0000","last_unstale":"2024-09-14T12:01:57.835614+0000","last_undegraded":"2024-09-14T12:01:57.835614+0000","last_fullsized":"2024-09-14T12:01:57.835614+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-14T12:01:57.835501+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-14T12:01:57.835501+0000","last_clean_scrub_stamp":"2024-09-14T12:01:57.835501+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:50.645404+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44240,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":541,"num_read_kb":1145,"num_write":426,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"263'831","reported_seq":5044,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:55.203848+0000","last_change":"2024-09-14T12:01:55.203848+0000","last_active":"2024-09-14T12:01:55.203848+0000","last_peered":"2024-09-14T12:01:55.203848+0000","last_clean":"2024-09-14T12:01:55.203848+0000","last_became_active":"2024-09-14T10:46:52.374152+0000","last_became_peered":"2024-09-14T10:46:52.374152+0000","last_unstale":"2024-09-14T12:01:55.203848+0000","last_undegraded":"2024-09-14T12:01:55.203848+0000","last_fullsized":"2024-09-14T12:01:55.203848+0000","mapping_epoch":34,"log_start":"263'800","ondisk_log_start":"263'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'831","last_scrub_stamp":"2024-09-14T12:01:55.203757+0000","last_deep_scrub":"263'831","last_deep_scrub_stamp":"2024-09-14T12:01:55.203757+0000","last_clean_scrub_stamp":"2024-09-14T12:01:55.203757+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:14.071131+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"263'167","reported_seq":672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:54.865067+0000","last_change":"2024-09-14T12:01:54.865067+0000","last_active":"2024-09-14T12:01:54.865067+0000","last_peered":"2024-09-14T12:01:54.865067+0000","last_clean":"2024-09-14T12:01:54.865067+0000","last_became_active":"2024-09-14T10:46:54.383953+0000","last_became_peered":"2024-09-14T10:46:54.383953+0000","last_unstale":"2024-09-14T12:01:54.865067+0000","last_undegraded":"2024-09-14T12:01:54.865067+0000","last_fullsized":"2024-09-14T12:01:54.865067+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'167","last_scrub_stamp":"2024-09-14T12:01:54.864971+0000","last_deep_scrub":"263'167","last_deep_scrub_stamp":"2024-09-14T12:01:54.864971+0000","last_clean_scrub_stamp":"2024-09-14T12:01:54.864971+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:49.056018+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":135,"num_write":398,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"263'1058","reported_seq":2538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.273309+0000","last_change":"2024-09-14T12:01:39.273309+0000","last_active":"2024-09-14T12:01:39.273309+0000","last_peered":"2024-09-14T12:01:39.273309+0000","last_clean":"2024-09-14T12:01:39.273309+0000","last_became_active":"2024-09-14T10:46:46.348726+0000","last_became_peered":"2024-09-14T10:46:46.348726+0000","last_unstale":"2024-09-14T12:01:39.273309+0000","last_undegraded":"2024-09-14T12:01:39.273309+0000","last_fullsized":"2024-09-14T12:01:39.273309+0000","mapping_epoch":28,"log_start":"263'1000","ondisk_log_start":"263'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1058","last_scrub_stamp":"2024-09-14T12:01:39.273229+0000","last_deep_scrub":"263'1058","last_deep_scrub_stamp":"2024-09-14T12:01:39.273229+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.273229+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":1000,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:14.478829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4827,"num_read_kb":4287,"num_write":1450,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"263'309","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:24.291444+0000","last_change":"2024-09-14T12:01:24.291444+0000","last_active":"2024-09-14T12:01:24.291444+0000","last_peered":"2024-09-14T12:01:24.291444+0000","last_clean":"2024-09-14T12:01:24.291444+0000","last_became_active":"2024-09-14T10:46:44.332535+0000","last_became_peered":"2024-09-14T10:46:44.332535+0000","last_unstale":"2024-09-14T12:01:24.291444+0000","last_undegraded":"2024-09-14T12:01:24.291444+0000","last_fullsized":"2024-09-14T12:01:24.291444+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'309","last_scrub_stamp":"2024-09-14T12:01:24.291338+0000","last_deep_scrub":"263'309","last_deep_scrub_stamp":"2024-09-14T12:01:24.291338+0000","last_clean_scrub_stamp":"2024-09-14T12:01:24.291338+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:44.362720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267347,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":39478,"num_write":1028,"num_write_kb":35728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.834841+0000","last_change":"2024-09-14T12:01:44.834841+0000","last_active":"2024-09-14T12:01:44.834841+0000","last_peered":"2024-09-14T12:01:44.834841+0000","last_clean":"2024-09-14T12:01:44.834841+0000","last_became_active":"2024-09-14T10:46:48.351530+0000","last_became_peered":"2024-09-14T10:46:48.351530+0000","last_unstale":"2024-09-14T12:01:44.834841+0000","last_undegraded":"2024-09-14T12:01:44.834841+0000","last_fullsized":"2024-09-14T12:01:44.834841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:44.834750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:44.834750+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.834750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:42.216241+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"263'477","reported_seq":1133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:50.580410+0000","last_change":"2024-09-14T12:01:50.580410+0000","last_active":"2024-09-14T12:01:50.580410+0000","last_peered":"2024-09-14T12:01:50.580410+0000","last_clean":"2024-09-14T12:01:50.580410+0000","last_became_active":"2024-09-14T10:46:50.361396+0000","last_became_peered":"2024-09-14T10:46:50.361396+0000","last_unstale":"2024-09-14T12:01:50.580410+0000","last_undegraded":"2024-09-14T12:01:50.580410+0000","last_fullsized":"2024-09-14T12:01:50.580410+0000","mapping_epoch":32,"log_start":"263'400","ondisk_log_start":"263'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'477","last_scrub_stamp":"2024-09-14T12:01:50.580324+0000","last_deep_scrub":"263'477","last_deep_scrub_stamp":"2024-09-14T12:01:50.580324+0000","last_clean_scrub_stamp":"2024-09-14T12:01:50.580324+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:16.911774+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93223,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":821,"num_read_kb":1952,"num_write":664,"num_write_kb":533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:54.212677+0000","last_change":"2024-09-14T12:01:54.212677+0000","last_active":"2024-09-14T12:01:54.212677+0000","last_peered":"2024-09-14T12:01:54.212677+0000","last_clean":"2024-09-14T12:01:54.212677+0000","last_became_active":"2024-09-14T10:46:52.373563+0000","last_became_peered":"2024-09-14T10:46:52.373563+0000","last_unstale":"2024-09-14T12:01:54.212677+0000","last_undegraded":"2024-09-14T12:01:54.212677+0000","last_fullsized":"2024-09-14T12:01:54.212677+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:54.212569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:54.212569+0000","last_clean_scrub_stamp":"2024-09-14T12:01:54.212569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:19.820671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"263'161","reported_seq":679,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:49.100505+0000","last_change":"2024-09-14T12:01:49.100505+0000","last_active":"2024-09-14T12:01:49.100505+0000","last_peered":"2024-09-14T12:01:49.100505+0000","last_clean":"2024-09-14T12:01:49.100505+0000","last_became_active":"2024-09-14T10:46:54.388429+0000","last_became_peered":"2024-09-14T10:46:54.388429+0000","last_unstale":"2024-09-14T12:01:49.100505+0000","last_undegraded":"2024-09-14T12:01:49.100505+0000","last_fullsized":"2024-09-14T12:01:49.100505+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'161","last_scrub_stamp":"2024-09-14T12:01:49.100420+0000","last_deep_scrub":"263'161","last_deep_scrub_stamp":"2024-09-14T12:01:49.100420+0000","last_clean_scrub_stamp":"2024-09-14T12:01:49.100420+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:49.478185+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":168,"num_write":381,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"263'891","reported_seq":2650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.303380+0000","last_change":"2024-09-14T12:01:35.303380+0000","last_active":"2024-09-14T12:01:35.303380+0000","last_peered":"2024-09-14T12:01:35.303380+0000","last_clean":"2024-09-14T12:01:35.303380+0000","last_became_active":"2024-09-14T10:46:46.344022+0000","last_became_peered":"2024-09-14T10:46:46.344022+0000","last_unstale":"2024-09-14T12:01:35.303380+0000","last_undegraded":"2024-09-14T12:01:35.303380+0000","last_fullsized":"2024-09-14T12:01:35.303380+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'891","last_scrub_stamp":"2024-09-14T12:01:35.303277+0000","last_deep_scrub":"263'891","last_deep_scrub_stamp":"2024-09-14T12:01:35.303277+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.303277+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:25.632741+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4406,"num_read_kb":4005,"num_write":1167,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"263'312","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.208032+0000","last_change":"2024-09-14T12:01:28.208032+0000","last_active":"2024-09-14T12:01:28.208032+0000","last_peered":"2024-09-14T12:01:28.208032+0000","last_clean":"2024-09-14T12:01:28.208032+0000","last_became_active":"2024-09-14T10:46:44.318584+0000","last_became_peered":"2024-09-14T10:46:44.318584+0000","last_unstale":"2024-09-14T12:01:28.208032+0000","last_undegraded":"2024-09-14T12:01:28.208032+0000","last_fullsized":"2024-09-14T12:01:28.208032+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-09-14T12:01:28.207930+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-09-14T12:01:28.207930+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.207930+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:00.044887+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":581,"num_read_kb":7202,"num_write":854,"num_write_kb":20635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.042904+0000","last_change":"2024-09-14T12:01:39.042904+0000","last_active":"2024-09-14T12:01:39.042904+0000","last_peered":"2024-09-14T12:01:39.042904+0000","last_clean":"2024-09-14T12:01:39.042904+0000","last_became_active":"2024-09-14T10:46:48.355691+0000","last_became_peered":"2024-09-14T10:46:48.355691+0000","last_unstale":"2024-09-14T12:01:39.042904+0000","last_undegraded":"2024-09-14T12:01:39.042904+0000","last_fullsized":"2024-09-14T12:01:39.042904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:39.042798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:39.042798+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.042798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:39.224689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"263'347","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:53.714755+0000","last_change":"2024-09-14T12:01:53.714755+0000","last_active":"2024-09-14T12:01:53.714755+0000","last_peered":"2024-09-14T12:01:53.714755+0000","last_clean":"2024-09-14T12:01:53.714755+0000","last_became_active":"2024-09-14T10:46:50.362757+0000","last_became_peered":"2024-09-14T10:46:50.362757+0000","last_unstale":"2024-09-14T12:01:53.714755+0000","last_undegraded":"2024-09-14T12:01:53.714755+0000","last_fullsized":"2024-09-14T12:01:53.714755+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-09-14T12:01:53.714667+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-09-14T12:01:53.714667+0000","last_clean_scrub_stamp":"2024-09-14T12:01:53.714667+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:38.487284+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":590,"num_read_kb":1339,"num_write":526,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16394,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.030546+0000","last_change":"2024-09-14T12:01:42.030546+0000","last_active":"2024-09-14T12:01:42.030546+0000","last_peered":"2024-09-14T12:01:42.030546+0000","last_clean":"2024-09-14T12:01:42.030546+0000","last_became_active":"2024-09-14T10:46:52.373836+0000","last_became_peered":"2024-09-14T10:46:52.373836+0000","last_unstale":"2024-09-14T12:01:42.030546+0000","last_undegraded":"2024-09-14T12:01:42.030546+0000","last_fullsized":"2024-09-14T12:01:42.030546+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:42.030463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:42.030463+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.030463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:44.156503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"263'97","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:58.123699+0000","last_change":"2024-09-14T12:01:58.123699+0000","last_active":"2024-09-14T12:01:58.123699+0000","last_peered":"2024-09-14T12:01:58.123699+0000","last_clean":"2024-09-14T12:01:58.123699+0000","last_became_active":"2024-09-14T10:46:54.387066+0000","last_became_peered":"2024-09-14T10:46:54.387066+0000","last_unstale":"2024-09-14T12:01:58.123699+0000","last_undegraded":"2024-09-14T12:01:58.123699+0000","last_fullsized":"2024-09-14T12:01:58.123699+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'97","last_scrub_stamp":"2024-09-14T12:01:58.123609+0000","last_deep_scrub":"263'97","last_deep_scrub_stamp":"2024-09-14T12:01:58.123609+0000","last_clean_scrub_stamp":"2024-09-14T12:01:58.123609+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:47.951710+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":95,"num_write":224,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"263'1166","reported_seq":2684,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.796789+0000","last_change":"2024-09-14T12:01:44.796789+0000","last_active":"2024-09-14T12:01:44.796789+0000","last_peered":"2024-09-14T12:01:44.796789+0000","last_clean":"2024-09-14T12:01:44.796789+0000","last_became_active":"2024-09-14T10:46:46.340228+0000","last_became_peered":"2024-09-14T10:46:46.340228+0000","last_unstale":"2024-09-14T12:01:44.796789+0000","last_undegraded":"2024-09-14T12:01:44.796789+0000","last_fullsized":"2024-09-14T12:01:44.796789+0000","mapping_epoch":28,"log_start":"263'1100","ondisk_log_start":"263'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1166","last_scrub_stamp":"2024-09-14T12:01:44.796699+0000","last_deep_scrub":"263'1166","last_deep_scrub_stamp":"2024-09-14T12:01:44.796699+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.796699+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":1100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:34.655123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5254,"num_read_kb":4633,"num_write":1618,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"263'413","reported_seq":1134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.846104+0000","last_change":"2024-09-14T12:01:31.846104+0000","last_active":"2024-09-14T12:01:31.846104+0000","last_peered":"2024-09-14T12:01:31.846104+0000","last_clean":"2024-09-14T12:01:31.846104+0000","last_became_active":"2024-09-14T10:46:44.324440+0000","last_became_peered":"2024-09-14T10:46:44.324440+0000","last_unstale":"2024-09-14T12:01:31.846104+0000","last_undegraded":"2024-09-14T12:01:31.846104+0000","last_fullsized":"2024-09-14T12:01:31.846104+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'413","last_scrub_stamp":"2024-09-14T12:01:31.845943+0000","last_deep_scrub":"263'413","last_deep_scrub_stamp":"2024-09-14T12:01:31.845943+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.845943+0000","objects_scrubbed":9,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:50.275848+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":948,"num_read_kb":1994,"num_write":1270,"num_write_kb":27495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:48.349358+0000","last_change":"2024-09-14T12:01:48.349358+0000","last_active":"2024-09-14T12:01:48.349358+0000","last_peered":"2024-09-14T12:01:48.349358+0000","last_clean":"2024-09-14T12:01:48.349358+0000","last_became_active":"2024-09-14T10:46:48.353513+0000","last_became_peered":"2024-09-14T10:46:48.353513+0000","last_unstale":"2024-09-14T12:01:48.349358+0000","last_undegraded":"2024-09-14T12:01:48.349358+0000","last_fullsized":"2024-09-14T12:01:48.349358+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:48.349259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:48.349259+0000","last_clean_scrub_stamp":"2024-09-14T12:01:48.349259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:03.618230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"263'339","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:51.317553+0000","last_change":"2024-09-14T12:01:51.317553+0000","last_active":"2024-09-14T12:01:51.317553+0000","last_peered":"2024-09-14T12:01:51.317553+0000","last_clean":"2024-09-14T12:01:51.317553+0000","last_became_active":"2024-09-14T10:46:50.362492+0000","last_became_peered":"2024-09-14T10:46:50.362492+0000","last_unstale":"2024-09-14T12:01:51.317553+0000","last_undegraded":"2024-09-14T12:01:51.317553+0000","last_fullsized":"2024-09-14T12:01:51.317553+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-14T12:01:51.317465+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-14T12:01:51.317465+0000","last_clean_scrub_stamp":"2024-09-14T12:01:51.317465+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:31.165356+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50533,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":553,"num_read_kb":1190,"num_write":436,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"263'787","reported_seq":4630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.985368+0000","last_change":"2024-09-14T12:01:43.985368+0000","last_active":"2024-09-14T12:01:43.985368+0000","last_peered":"2024-09-14T12:01:43.985368+0000","last_clean":"2024-09-14T12:01:43.985368+0000","last_became_active":"2024-09-14T10:46:52.374947+0000","last_became_peered":"2024-09-14T10:46:52.374947+0000","last_unstale":"2024-09-14T12:01:43.985368+0000","last_undegraded":"2024-09-14T12:01:43.985368+0000","last_fullsized":"2024-09-14T12:01:43.985368+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'787","last_scrub_stamp":"2024-09-14T12:01:43.985280+0000","last_deep_scrub":"263'787","last_deep_scrub_stamp":"2024-09-14T12:01:43.985280+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.985280+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:11.916897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"263'126","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:52.860712+0000","last_change":"2024-09-14T12:01:52.860648+0000","last_active":"2024-09-14T12:01:52.860712+0000","last_peered":"2024-09-14T12:01:52.860712+0000","last_clean":"2024-09-14T12:01:52.860712+0000","last_became_active":"2024-09-14T10:46:54.382004+0000","last_became_peered":"2024-09-14T10:46:54.382004+0000","last_unstale":"2024-09-14T12:01:52.860712+0000","last_undegraded":"2024-09-14T12:01:52.860712+0000","last_fullsized":"2024-09-14T12:01:52.860712+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'126","last_scrub_stamp":"2024-09-14T12:01:52.860482+0000","last_deep_scrub":"263'126","last_deep_scrub_stamp":"2024-09-14T12:01:52.860482+0000","last_clean_scrub_stamp":"2024-09-14T12:01:52.860482+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:59.879623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1268,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":189,"num_write":324,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"263'838","reported_seq":2537,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.831775+0000","last_change":"2024-09-14T12:01:35.831775+0000","last_active":"2024-09-14T12:01:35.831775+0000","last_peered":"2024-09-14T12:01:35.831775+0000","last_clean":"2024-09-14T12:01:35.831775+0000","last_became_active":"2024-09-14T10:46:46.347307+0000","last_became_peered":"2024-09-14T10:46:46.347307+0000","last_unstale":"2024-09-14T12:01:35.831775+0000","last_undegraded":"2024-09-14T12:01:35.831775+0000","last_fullsized":"2024-09-14T12:01:35.831775+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'838","last_scrub_stamp":"2024-09-14T12:01:35.831680+0000","last_deep_scrub":"263'838","last_deep_scrub_stamp":"2024-09-14T12:01:35.831680+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.831680+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:03.490519+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4222,"num_read_kb":3846,"num_write":1108,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"263'364","reported_seq":1147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.866353+0000","last_change":"2024-09-14T12:01:30.866353+0000","last_active":"2024-09-14T12:01:30.866353+0000","last_peered":"2024-09-14T12:01:30.866353+0000","last_clean":"2024-09-14T12:01:30.866353+0000","last_became_active":"2024-09-14T10:46:44.330567+0000","last_became_peered":"2024-09-14T10:46:44.330567+0000","last_unstale":"2024-09-14T12:01:30.866353+0000","last_undegraded":"2024-09-14T12:01:30.866353+0000","last_fullsized":"2024-09-14T12:01:30.866353+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'364","last_scrub_stamp":"2024-09-14T12:01:30.866244+0000","last_deep_scrub":"263'364","last_deep_scrub_stamp":"2024-09-14T12:01:30.866244+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.866244+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:50.829453+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":975,"num_read_kb":55651,"num_write":1153,"num_write_kb":35628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1471,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.686044+0000","last_change":"2024-09-14T12:01:39.686044+0000","last_active":"2024-09-14T12:01:39.686044+0000","last_peered":"2024-09-14T12:01:39.686044+0000","last_clean":"2024-09-14T12:01:39.686044+0000","last_became_active":"2024-09-14T10:46:48.355697+0000","last_became_peered":"2024-09-14T10:46:48.355697+0000","last_unstale":"2024-09-14T12:01:39.686044+0000","last_undegraded":"2024-09-14T12:01:39.686044+0000","last_fullsized":"2024-09-14T12:01:39.686044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:01:39.685939+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:01:39.685939+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.685939+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:06.999103+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"263'111","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.813896+0000","last_change":"2024-09-14T12:01:45.813896+0000","last_active":"2024-09-14T12:01:45.813896+0000","last_peered":"2024-09-14T12:01:45.813896+0000","last_clean":"2024-09-14T12:01:45.813896+0000","last_became_active":"2024-09-14T10:46:50.369337+0000","last_became_peered":"2024-09-14T10:46:50.369337+0000","last_unstale":"2024-09-14T12:01:45.813896+0000","last_undegraded":"2024-09-14T12:01:45.813896+0000","last_fullsized":"2024-09-14T12:01:45.813896+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-14T12:01:45.813772+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-14T12:01:45.813772+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.813772+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:18.801223+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"263'803","reported_seq":2619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:48.664818+0000","last_change":"2024-09-14T12:01:48.664818+0000","last_active":"2024-09-14T12:01:48.664818+0000","last_peered":"2024-09-14T12:01:48.664818+0000","last_clean":"2024-09-14T12:01:48.664818+0000","last_became_active":"2024-09-14T10:46:52.374252+0000","last_became_peered":"2024-09-14T10:46:52.374252+0000","last_unstale":"2024-09-14T12:01:48.664818+0000","last_undegraded":"2024-09-14T12:01:48.664818+0000","last_fullsized":"2024-09-14T12:01:48.664818+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'803","last_scrub_stamp":"2024-09-14T12:01:48.664696+0000","last_deep_scrub":"263'803","last_deep_scrub_stamp":"2024-09-14T12:01:48.664696+0000","last_clean_scrub_stamp":"2024-09-14T12:01:48.664696+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:26.360167+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"263'120","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:48.861534+0000","last_change":"2024-09-14T12:01:48.861475+0000","last_active":"2024-09-14T12:01:48.861534+0000","last_peered":"2024-09-14T12:01:48.861534+0000","last_clean":"2024-09-14T12:01:48.861534+0000","last_became_active":"2024-09-14T10:46:54.384249+0000","last_became_peered":"2024-09-14T10:46:54.384249+0000","last_unstale":"2024-09-14T12:01:48.861534+0000","last_undegraded":"2024-09-14T12:01:48.861534+0000","last_fullsized":"2024-09-14T12:01:48.861534+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'120","last_scrub_stamp":"2024-09-14T12:01:48.861368+0000","last_deep_scrub":"263'120","last_deep_scrub_stamp":"2024-09-14T12:01:48.861368+0000","last_clean_scrub_stamp":"2024-09-14T12:01:48.861368+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:00.297961+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":125,"num_write":281,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"263'469","reported_seq":1950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.122323+0000","last_change":"2024-09-14T12:01:31.122323+0000","last_active":"2024-09-14T12:01:31.122323+0000","last_peered":"2024-09-14T12:01:31.122323+0000","last_clean":"2024-09-14T12:01:31.122323+0000","last_became_active":"2024-09-14T10:46:46.342466+0000","last_became_peered":"2024-09-14T10:46:46.342466+0000","last_unstale":"2024-09-14T12:01:31.122323+0000","last_undegraded":"2024-09-14T12:01:31.122323+0000","last_fullsized":"2024-09-14T12:01:31.122323+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'469","last_scrub_stamp":"2024-09-14T12:01:31.122238+0000","last_deep_scrub":"263'469","last_deep_scrub_stamp":"2024-09-14T12:01:31.122238+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.122238+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:49.197184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2422,"num_read_kb":2241,"num_write":583,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"263'288","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.710818+0000","last_change":"2024-09-14T12:01:30.710818+0000","last_active":"2024-09-14T12:01:30.710818+0000","last_peered":"2024-09-14T12:01:30.710818+0000","last_clean":"2024-09-14T12:01:30.710818+0000","last_became_active":"2024-09-14T10:46:44.329014+0000","last_became_peered":"2024-09-14T10:46:44.329014+0000","last_unstale":"2024-09-14T12:01:30.710818+0000","last_undegraded":"2024-09-14T12:01:30.710818+0000","last_fullsized":"2024-09-14T12:01:30.710818+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'288","last_scrub_stamp":"2024-09-14T12:01:30.710716+0000","last_deep_scrub":"263'288","last_deep_scrub_stamp":"2024-09-14T12:01:30.710716+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.710716+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:53.203004+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":506,"num_read_kb":30778,"num_write":881,"num_write_kb":14950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:51.895008+0000","last_change":"2024-09-14T12:01:51.895008+0000","last_active":"2024-09-14T12:01:51.895008+0000","last_peered":"2024-09-14T12:01:51.895008+0000","last_clean":"2024-09-14T12:01:51.895008+0000","last_became_active":"2024-09-14T10:46:48.358586+0000","last_became_peered":"2024-09-14T10:46:48.358586+0000","last_unstale":"2024-09-14T12:01:51.895008+0000","last_undegraded":"2024-09-14T12:01:51.895008+0000","last_fullsized":"2024-09-14T12:01:51.895008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:51.894918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:51.894918+0000","last_clean_scrub_stamp":"2024-09-14T12:01:51.894918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:40.285755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"263'384","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:47.637216+0000","last_change":"2024-09-14T12:01:47.637216+0000","last_active":"2024-09-14T12:01:47.637216+0000","last_peered":"2024-09-14T12:01:47.637216+0000","last_clean":"2024-09-14T12:01:47.637216+0000","last_became_active":"2024-09-14T10:46:50.365715+0000","last_became_peered":"2024-09-14T10:46:50.365715+0000","last_unstale":"2024-09-14T12:01:47.637216+0000","last_undegraded":"2024-09-14T12:01:47.637216+0000","last_fullsized":"2024-09-14T12:01:47.637216+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'384","last_scrub_stamp":"2024-09-14T12:01:47.637092+0000","last_deep_scrub":"263'384","last_deep_scrub_stamp":"2024-09-14T12:01:47.637092+0000","last_clean_scrub_stamp":"2024-09-14T12:01:47.637092+0000","objects_scrubbed":8,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:04.027878+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45582,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":610,"num_read_kb":1238,"num_write":470,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.839972+0000","last_change":"2024-09-14T12:01:45.839972+0000","last_active":"2024-09-14T12:01:45.839972+0000","last_peered":"2024-09-14T12:01:45.839972+0000","last_clean":"2024-09-14T12:01:45.839972+0000","last_became_active":"2024-09-14T10:46:52.369746+0000","last_became_peered":"2024-09-14T10:46:52.369746+0000","last_unstale":"2024-09-14T12:01:45.839972+0000","last_undegraded":"2024-09-14T12:01:45.839972+0000","last_fullsized":"2024-09-14T12:01:45.839972+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:45.839835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:45.839835+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.839835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:36.039659+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"263'159","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:50.116729+0000","last_change":"2024-09-14T12:01:50.116640+0000","last_active":"2024-09-14T12:01:50.116729+0000","last_peered":"2024-09-14T12:01:50.116729+0000","last_clean":"2024-09-14T12:01:50.116729+0000","last_became_active":"2024-09-14T10:46:54.384119+0000","last_became_peered":"2024-09-14T10:46:54.384119+0000","last_unstale":"2024-09-14T12:01:50.116729+0000","last_undegraded":"2024-09-14T12:01:50.116729+0000","last_fullsized":"2024-09-14T12:01:50.116729+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'159","last_scrub_stamp":"2024-09-14T12:01:50.116515+0000","last_deep_scrub":"263'159","last_deep_scrub_stamp":"2024-09-14T12:01:50.116515+0000","last_clean_scrub_stamp":"2024-09-14T12:01:50.116515+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:50.157955+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":393,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"263'777","reported_seq":2214,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.693165+0000","last_change":"2024-09-14T12:01:40.693092+0000","last_active":"2024-09-14T12:01:40.693165+0000","last_peered":"2024-09-14T12:01:40.693165+0000","last_clean":"2024-09-14T12:01:40.693165+0000","last_became_active":"2024-09-14T10:46:46.334444+0000","last_became_peered":"2024-09-14T10:46:46.334444+0000","last_unstale":"2024-09-14T12:01:40.693165+0000","last_undegraded":"2024-09-14T12:01:40.693165+0000","last_fullsized":"2024-09-14T12:01:40.693165+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'777","last_scrub_stamp":"2024-09-14T12:01:40.692994+0000","last_deep_scrub":"263'777","last_deep_scrub_stamp":"2024-09-14T12:01:40.692994+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.692994+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:37.634741+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3619,"num_read_kb":3234,"num_write":1038,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:24.785694+0000","last_change":"2024-09-14T12:01:24.785694+0000","last_active":"2024-09-14T12:01:24.785694+0000","last_peered":"2024-09-14T12:01:24.785694+0000","last_clean":"2024-09-14T12:01:24.785694+0000","last_became_active":"2024-09-14T10:46:26.241454+0000","last_became_peered":"2024-09-14T10:46:26.241454+0000","last_unstale":"2024-09-14T12:01:24.785694+0000","last_undegraded":"2024-09-14T12:01:24.785694+0000","last_fullsized":"2024-09-14T12:01:24.785694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-14T12:01:24.785613+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-14T12:01:24.785613+0000","last_clean_scrub_stamp":"2024-09-14T12:01:24.785613+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:57.745824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":544,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.977324+0000","last_change":"2024-09-14T12:01:26.977273+0000","last_active":"2024-09-14T12:01:26.977324+0000","last_peered":"2024-09-14T12:01:26.977324+0000","last_clean":"2024-09-14T12:01:26.977324+0000","last_became_active":"2024-09-14T10:46:33.413305+0000","last_became_peered":"2024-09-14T10:46:33.413305+0000","last_unstale":"2024-09-14T12:01:26.977324+0000","last_undegraded":"2024-09-14T12:01:26.977324+0000","last_fullsized":"2024-09-14T12:01:26.977324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:01:26.977205+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:01:26.977205+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.977205+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:08.220234+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00092058099999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"263'313","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.725727+0000","last_change":"2024-09-14T12:01:26.725664+0000","last_active":"2024-09-14T12:01:26.725727+0000","last_peered":"2024-09-14T12:01:26.725727+0000","last_clean":"2024-09-14T12:01:26.725727+0000","last_became_active":"2024-09-14T10:46:44.329050+0000","last_became_peered":"2024-09-14T10:46:44.329050+0000","last_unstale":"2024-09-14T12:01:26.725727+0000","last_undegraded":"2024-09-14T12:01:26.725727+0000","last_fullsized":"2024-09-14T12:01:26.725727+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'313","last_scrub_stamp":"2024-09-14T12:01:26.725523+0000","last_deep_scrub":"263'313","last_deep_scrub_stamp":"2024-09-14T12:01:26.725523+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.725523+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:00.339260+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":32601,"num_write":1066,"num_write_kb":17351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"263'6","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.190055+0000","last_change":"2024-09-14T12:01:42.189983+0000","last_active":"2024-09-14T12:01:42.190055+0000","last_peered":"2024-09-14T12:01:42.190055+0000","last_clean":"2024-09-14T12:01:42.190055+0000","last_became_active":"2024-09-14T10:46:48.353319+0000","last_became_peered":"2024-09-14T10:46:48.353319+0000","last_unstale":"2024-09-14T12:01:42.190055+0000","last_undegraded":"2024-09-14T12:01:42.190055+0000","last_fullsized":"2024-09-14T12:01:42.190055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:01:42.189893+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:01:42.189893+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.189893+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:11.020543+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"263'802","reported_seq":1530,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:56.793974+0000","last_change":"2024-09-14T12:01:56.793974+0000","last_active":"2024-09-14T12:01:56.793974+0000","last_peered":"2024-09-14T12:01:56.793974+0000","last_clean":"2024-09-14T12:01:56.793974+0000","last_became_active":"2024-09-14T10:46:50.362908+0000","last_became_peered":"2024-09-14T10:46:50.362908+0000","last_unstale":"2024-09-14T12:01:56.793974+0000","last_undegraded":"2024-09-14T12:01:56.793974+0000","last_fullsized":"2024-09-14T12:01:56.793974+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'802","last_scrub_stamp":"2024-09-14T12:01:56.793882+0000","last_deep_scrub":"263'802","last_deep_scrub_stamp":"2024-09-14T12:01:56.793882+0000","last_clean_scrub_stamp":"2024-09-14T12:01:56.793882+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:52.842437+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143024,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1563,"num_read_kb":3671,"num_write":1508,"num_write_kb":1333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":107076,"num_omap_keys":256,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:52.265705+0000","last_change":"2024-09-14T12:01:52.265705+0000","last_active":"2024-09-14T12:01:52.265705+0000","last_peered":"2024-09-14T12:01:52.265705+0000","last_clean":"2024-09-14T12:01:52.265705+0000","last_became_active":"2024-09-14T10:46:52.371684+0000","last_became_peered":"2024-09-14T10:46:52.371684+0000","last_unstale":"2024-09-14T12:01:52.265705+0000","last_undegraded":"2024-09-14T12:01:52.265705+0000","last_fullsized":"2024-09-14T12:01:52.265705+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:52.265585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:52.265585+0000","last_clean_scrub_stamp":"2024-09-14T12:01:52.265585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:39.262833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"263'209","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:49.266813+0000","last_change":"2024-09-14T12:01:49.266813+0000","last_active":"2024-09-14T12:01:49.266813+0000","last_peered":"2024-09-14T12:01:49.266813+0000","last_clean":"2024-09-14T12:01:49.266813+0000","last_became_active":"2024-09-14T10:46:54.382019+0000","last_became_peered":"2024-09-14T10:46:54.382019+0000","last_unstale":"2024-09-14T12:01:49.266813+0000","last_undegraded":"2024-09-14T12:01:49.266813+0000","last_fullsized":"2024-09-14T12:01:49.266813+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'209","last_scrub_stamp":"2024-09-14T12:01:49.266707+0000","last_deep_scrub":"263'209","last_deep_scrub_stamp":"2024-09-14T12:01:49.266707+0000","last_clean_scrub_stamp":"2024-09-14T12:01:49.266707+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:26.666088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":483,"num_read_kb":466,"num_write":435,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"263'817","reported_seq":2429,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.241075+0000","last_change":"2024-09-14T12:01:40.241075+0000","last_active":"2024-09-14T12:01:40.241075+0000","last_peered":"2024-09-14T12:01:40.241075+0000","last_clean":"2024-09-14T12:01:40.241075+0000","last_became_active":"2024-09-14T10:46:46.345302+0000","last_became_peered":"2024-09-14T10:46:46.345302+0000","last_unstale":"2024-09-14T12:01:40.241075+0000","last_undegraded":"2024-09-14T12:01:40.241075+0000","last_fullsized":"2024-09-14T12:01:40.241075+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'817","last_scrub_stamp":"2024-09-14T12:01:40.240992+0000","last_deep_scrub":"263'817","last_deep_scrub_stamp":"2024-09-14T12:01:40.240992+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.240992+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:38.435554+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3876,"num_read_kb":3495,"num_write":1050,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":543,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.885777+0000","last_change":"2024-09-14T12:01:29.885777+0000","last_active":"2024-09-14T12:01:29.885777+0000","last_peered":"2024-09-14T12:01:29.885777+0000","last_clean":"2024-09-14T12:01:29.885777+0000","last_became_active":"2024-09-14T10:46:33.265619+0000","last_became_peered":"2024-09-14T10:46:33.265619+0000","last_unstale":"2024-09-14T12:01:29.885777+0000","last_undegraded":"2024-09-14T12:01:29.885777+0000","last_fullsized":"2024-09-14T12:01:29.885777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:29.885692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:29.885692+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.885692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:24.477677+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00058478399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"263'340","reported_seq":1197,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.871096+0000","last_change":"2024-09-14T12:01:26.870978+0000","last_active":"2024-09-14T12:01:26.871096+0000","last_peered":"2024-09-14T12:01:26.871096+0000","last_clean":"2024-09-14T12:01:26.871096+0000","last_became_active":"2024-09-14T10:46:44.320087+0000","last_became_peered":"2024-09-14T10:46:44.320087+0000","last_unstale":"2024-09-14T12:01:26.871096+0000","last_undegraded":"2024-09-14T12:01:26.871096+0000","last_fullsized":"2024-09-14T12:01:26.871096+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-14T12:01:26.870853+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-14T12:01:26.870853+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.870853+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:41.798493+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1201,"num_read_kb":9242,"num_write":1119,"num_write_kb":25141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:47.868781+0000","last_change":"2024-09-14T12:01:47.868781+0000","last_active":"2024-09-14T12:01:47.868781+0000","last_peered":"2024-09-14T12:01:47.868781+0000","last_clean":"2024-09-14T12:01:47.868781+0000","last_became_active":"2024-09-14T10:46:48.350653+0000","last_became_peered":"2024-09-14T10:46:48.350653+0000","last_unstale":"2024-09-14T12:01:47.868781+0000","last_undegraded":"2024-09-14T12:01:47.868781+0000","last_fullsized":"2024-09-14T12:01:47.868781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:47.868723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:47.868723+0000","last_clean_scrub_stamp":"2024-09-14T12:01:47.868723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:50.120301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"263'1402","reported_seq":3252,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.028254+0000","last_change":"2024-09-14T12:01:43.028181+0000","last_active":"2024-09-14T12:01:43.028254+0000","last_peered":"2024-09-14T12:01:43.028254+0000","last_clean":"2024-09-14T12:01:43.028254+0000","last_became_active":"2024-09-14T10:46:50.362128+0000","last_became_peered":"2024-09-14T10:46:50.362128+0000","last_unstale":"2024-09-14T12:01:43.028254+0000","last_undegraded":"2024-09-14T12:01:43.028254+0000","last_fullsized":"2024-09-14T12:01:43.028254+0000","mapping_epoch":32,"log_start":"263'1300","ondisk_log_start":"263'1300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1402","last_scrub_stamp":"2024-09-14T12:01:43.028081+0000","last_deep_scrub":"263'1402","last_deep_scrub_stamp":"2024-09-14T12:01:43.028081+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.028081+0000","objects_scrubbed":11,"log_size":102,"log_dups_size":1300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:19.538730+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160652,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2189,"num_read_kb":4301,"num_write":1286,"num_write_kb":1103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:01.827342+0000","last_change":"2024-09-14T12:02:01.827342+0000","last_active":"2024-09-14T12:02:01.827342+0000","last_peered":"2024-09-14T12:02:01.827342+0000","last_clean":"2024-09-14T12:02:01.827342+0000","last_became_active":"2024-09-14T10:46:52.375344+0000","last_became_peered":"2024-09-14T10:46:52.375344+0000","last_unstale":"2024-09-14T12:02:01.827342+0000","last_undegraded":"2024-09-14T12:02:01.827342+0000","last_fullsized":"2024-09-14T12:02:01.827342+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:01.827261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:01.827261+0000","last_clean_scrub_stamp":"2024-09-14T12:02:01.827261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:08.647671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"263'97","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:59.156240+0000","last_change":"2024-09-14T12:01:59.156240+0000","last_active":"2024-09-14T12:01:59.156240+0000","last_peered":"2024-09-14T12:01:59.156240+0000","last_clean":"2024-09-14T12:01:59.156240+0000","last_became_active":"2024-09-14T10:46:54.384354+0000","last_became_peered":"2024-09-14T10:46:54.384354+0000","last_unstale":"2024-09-14T12:01:59.156240+0000","last_undegraded":"2024-09-14T12:01:59.156240+0000","last_fullsized":"2024-09-14T12:01:59.156240+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'97","last_scrub_stamp":"2024-09-14T12:01:59.156142+0000","last_deep_scrub":"263'97","last_deep_scrub_stamp":"2024-09-14T12:01:59.156142+0000","last_clean_scrub_stamp":"2024-09-14T12:01:59.156142+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:46.837849+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":95,"num_write":225,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"263'544","reported_seq":2146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.765468+0000","last_change":"2024-09-14T12:01:36.765468+0000","last_active":"2024-09-14T12:01:36.765468+0000","last_peered":"2024-09-14T12:01:36.765468+0000","last_clean":"2024-09-14T12:01:36.765468+0000","last_became_active":"2024-09-14T10:46:46.345234+0000","last_became_peered":"2024-09-14T10:46:46.345234+0000","last_unstale":"2024-09-14T12:01:36.765468+0000","last_undegraded":"2024-09-14T12:01:36.765468+0000","last_fullsized":"2024-09-14T12:01:36.765468+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'544","last_scrub_stamp":"2024-09-14T12:01:36.765372+0000","last_deep_scrub":"263'544","last_deep_scrub_stamp":"2024-09-14T12:01:36.765372+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.765372+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:30.549759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2916,"num_read_kb":2703,"num_write":726,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.209890+0000","last_change":"2024-09-14T12:01:27.209807+0000","last_active":"2024-09-14T12:01:27.209890+0000","last_peered":"2024-09-14T12:01:27.209890+0000","last_clean":"2024-09-14T12:01:27.209890+0000","last_became_active":"2024-09-14T10:46:33.265185+0000","last_became_peered":"2024-09-14T10:46:33.265185+0000","last_unstale":"2024-09-14T12:01:27.209890+0000","last_undegraded":"2024-09-14T12:01:27.209890+0000","last_fullsized":"2024-09-14T12:01:27.209890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:27.209695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:27.209695+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.209695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:02.705899+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000550246,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"263'312","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.345266+0000","last_change":"2024-09-14T12:01:27.345266+0000","last_active":"2024-09-14T12:01:27.345266+0000","last_peered":"2024-09-14T12:01:27.345266+0000","last_clean":"2024-09-14T12:01:27.345266+0000","last_became_active":"2024-09-14T10:46:44.327101+0000","last_became_peered":"2024-09-14T10:46:44.327101+0000","last_unstale":"2024-09-14T12:01:27.345266+0000","last_undegraded":"2024-09-14T12:01:27.345266+0000","last_fullsized":"2024-09-14T12:01:27.345266+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-09-14T12:01:27.345068+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-09-14T12:01:27.345068+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.345068+0000","objects_scrubbed":8,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:53.686484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":609,"num_read_kb":99380,"num_write":1036,"num_write_kb":24751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.052202+0000","last_change":"2024-09-14T12:01:37.052202+0000","last_active":"2024-09-14T12:01:37.052202+0000","last_peered":"2024-09-14T12:01:37.052202+0000","last_clean":"2024-09-14T12:01:37.052202+0000","last_became_active":"2024-09-14T10:46:48.353803+0000","last_became_peered":"2024-09-14T10:46:48.353803+0000","last_unstale":"2024-09-14T12:01:37.052202+0000","last_undegraded":"2024-09-14T12:01:37.052202+0000","last_fullsized":"2024-09-14T12:01:37.052202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:01:37.052124+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:01:37.052124+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.052124+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:29.304883+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"263'312","reported_seq":1770,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.207090+0000","last_change":"2024-09-14T12:01:44.207034+0000","last_active":"2024-09-14T12:01:44.207090+0000","last_peered":"2024-09-14T12:01:44.207090+0000","last_clean":"2024-09-14T12:01:44.207090+0000","last_became_active":"2024-09-14T10:46:50.364857+0000","last_became_peered":"2024-09-14T10:46:50.364857+0000","last_unstale":"2024-09-14T12:01:44.207090+0000","last_undegraded":"2024-09-14T12:01:44.207090+0000","last_fullsized":"2024-09-14T12:01:44.207090+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-09-14T12:01:44.206926+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-09-14T12:01:44.206926+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.206926+0000","objects_scrubbed":9,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:11.199275+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":263,"num_read_kb":255,"num_write":243,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:57.644275+0000","last_change":"2024-09-14T12:01:57.644275+0000","last_active":"2024-09-14T12:01:57.644275+0000","last_peered":"2024-09-14T12:01:57.644275+0000","last_clean":"2024-09-14T12:01:57.644275+0000","last_became_active":"2024-09-14T10:46:52.365738+0000","last_became_peered":"2024-09-14T10:46:52.365738+0000","last_unstale":"2024-09-14T12:01:57.644275+0000","last_undegraded":"2024-09-14T12:01:57.644275+0000","last_fullsized":"2024-09-14T12:01:57.644275+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:57.644189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:57.644189+0000","last_clean_scrub_stamp":"2024-09-14T12:01:57.644189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:33.830013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"263'264","reported_seq":875,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:02.658513+0000","last_change":"2024-09-14T12:02:02.658513+0000","last_active":"2024-09-14T12:02:02.658513+0000","last_peered":"2024-09-14T12:02:02.658513+0000","last_clean":"2024-09-14T12:02:02.658513+0000","last_became_active":"2024-09-14T10:46:54.378930+0000","last_became_peered":"2024-09-14T10:46:54.378930+0000","last_unstale":"2024-09-14T12:02:02.658513+0000","last_undegraded":"2024-09-14T12:02:02.658513+0000","last_fullsized":"2024-09-14T12:02:02.658513+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'264","last_scrub_stamp":"2024-09-14T12:02:02.658409+0000","last_deep_scrub":"263'264","last_deep_scrub_stamp":"2024-09-14T12:02:02.658409+0000","last_clean_scrub_stamp":"2024-09-14T12:02:02.658409+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:30.425911+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":478,"num_read_kb":502,"num_write":559,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"263'793","reported_seq":2368,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.802995+0000","last_change":"2024-09-14T12:01:37.802934+0000","last_active":"2024-09-14T12:01:37.802995+0000","last_peered":"2024-09-14T12:01:37.802995+0000","last_clean":"2024-09-14T12:01:37.802995+0000","last_became_active":"2024-09-14T10:46:46.334679+0000","last_became_peered":"2024-09-14T10:46:46.334679+0000","last_unstale":"2024-09-14T12:01:37.802995+0000","last_undegraded":"2024-09-14T12:01:37.802995+0000","last_fullsized":"2024-09-14T12:01:37.802995+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'793","last_scrub_stamp":"2024-09-14T12:01:37.802836+0000","last_deep_scrub":"263'793","last_deep_scrub_stamp":"2024-09-14T12:01:37.802836+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.802836+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:55.618222+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3681,"num_read_kb":3336,"num_write":1001,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":545,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.019260+0000","last_change":"2024-09-14T12:01:26.019205+0000","last_active":"2024-09-14T12:01:26.019260+0000","last_peered":"2024-09-14T12:01:26.019260+0000","last_clean":"2024-09-14T12:01:26.019260+0000","last_became_active":"2024-09-14T10:46:33.296172+0000","last_became_peered":"2024-09-14T10:46:33.296172+0000","last_unstale":"2024-09-14T12:01:26.019260+0000","last_undegraded":"2024-09-14T12:01:26.019260+0000","last_fullsized":"2024-09-14T12:01:26.019260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:01:26.019146+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:01:26.019146+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.019146+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:35.727762+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00125464,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"263'339","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:25.269255+0000","last_change":"2024-09-14T12:01:25.269159+0000","last_active":"2024-09-14T12:01:25.269255+0000","last_peered":"2024-09-14T12:01:25.269255+0000","last_clean":"2024-09-14T12:01:25.269255+0000","last_became_active":"2024-09-14T10:46:44.323974+0000","last_became_peered":"2024-09-14T10:46:44.323974+0000","last_unstale":"2024-09-14T12:01:25.269255+0000","last_undegraded":"2024-09-14T12:01:25.269255+0000","last_fullsized":"2024-09-14T12:01:25.269255+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-14T12:01:25.269042+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-14T12:01:25.269042+0000","last_clean_scrub_stamp":"2024-09-14T12:01:25.269042+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:28.484276+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":608,"num_read_kb":7380,"num_write":1200,"num_write_kb":32204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.996038+0000","last_change":"2024-09-14T12:01:40.995958+0000","last_active":"2024-09-14T12:01:40.996038+0000","last_peered":"2024-09-14T12:01:40.996038+0000","last_clean":"2024-09-14T12:01:40.996038+0000","last_became_active":"2024-09-14T10:46:48.354786+0000","last_became_peered":"2024-09-14T10:46:48.354786+0000","last_unstale":"2024-09-14T12:01:40.996038+0000","last_undegraded":"2024-09-14T12:01:40.996038+0000","last_fullsized":"2024-09-14T12:01:40.996038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:40.995844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:40.995844+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.995844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:43.561954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"263'161","reported_seq":729,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:50.315791+0000","last_change":"2024-09-14T12:01:50.315791+0000","last_active":"2024-09-14T12:01:50.315791+0000","last_peered":"2024-09-14T12:01:50.315791+0000","last_clean":"2024-09-14T12:01:50.315791+0000","last_became_active":"2024-09-14T10:46:50.363538+0000","last_became_peered":"2024-09-14T10:46:50.363538+0000","last_unstale":"2024-09-14T12:01:50.315791+0000","last_undegraded":"2024-09-14T12:01:50.315791+0000","last_fullsized":"2024-09-14T12:01:50.315791+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'161","last_scrub_stamp":"2024-09-14T12:01:50.315702+0000","last_deep_scrub":"263'161","last_deep_scrub_stamp":"2024-09-14T12:01:50.315702+0000","last_clean_scrub_stamp":"2024-09-14T12:01:50.315702+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:13.411298+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":198,"num_read_kb":192,"num_write":144,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:04.746554+0000","last_change":"2024-09-14T12:02:04.746554+0000","last_active":"2024-09-14T12:02:04.746554+0000","last_peered":"2024-09-14T12:02:04.746554+0000","last_clean":"2024-09-14T12:02:04.746554+0000","last_became_active":"2024-09-14T10:46:52.370968+0000","last_became_peered":"2024-09-14T10:46:52.370968+0000","last_unstale":"2024-09-14T12:02:04.746554+0000","last_undegraded":"2024-09-14T12:02:04.746554+0000","last_fullsized":"2024-09-14T12:02:04.746554+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:04.746470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:04.746470+0000","last_clean_scrub_stamp":"2024-09-14T12:02:04.746470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:34:30.928161+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"263'119","reported_seq":677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:50.697762+0000","last_change":"2024-09-14T12:01:50.697762+0000","last_active":"2024-09-14T12:01:50.697762+0000","last_peered":"2024-09-14T12:01:50.697762+0000","last_clean":"2024-09-14T12:01:50.697762+0000","last_became_active":"2024-09-14T10:46:54.388938+0000","last_became_peered":"2024-09-14T10:46:54.388938+0000","last_unstale":"2024-09-14T12:01:50.697762+0000","last_undegraded":"2024-09-14T12:01:50.697762+0000","last_fullsized":"2024-09-14T12:01:50.697762+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-14T12:01:50.697663+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-14T12:01:50.697663+0000","last_clean_scrub_stamp":"2024-09-14T12:01:50.697663+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:43.120059+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":281,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"263'403","reported_seq":1975,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.717553+0000","last_change":"2024-09-14T12:01:35.717482+0000","last_active":"2024-09-14T12:01:35.717553+0000","last_peered":"2024-09-14T12:01:35.717553+0000","last_clean":"2024-09-14T12:01:35.717553+0000","last_became_active":"2024-09-14T10:46:46.335681+0000","last_became_peered":"2024-09-14T10:46:46.335681+0000","last_unstale":"2024-09-14T12:01:35.717553+0000","last_undegraded":"2024-09-14T12:01:35.717553+0000","last_fullsized":"2024-09-14T12:01:35.717553+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'403","last_scrub_stamp":"2024-09-14T12:01:35.717399+0000","last_deep_scrub":"263'403","last_deep_scrub_stamp":"2024-09-14T12:01:35.717399+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.717399+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:32.914757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2240,"num_read_kb":2136,"num_write":448,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"263'321","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:24.914885+0000","last_change":"2024-09-14T12:01:24.914780+0000","last_active":"2024-09-14T12:01:24.914885+0000","last_peered":"2024-09-14T12:01:24.914885+0000","last_clean":"2024-09-14T12:01:24.914885+0000","last_became_active":"2024-09-14T10:46:44.319714+0000","last_became_peered":"2024-09-14T10:46:44.319714+0000","last_unstale":"2024-09-14T12:01:24.914885+0000","last_undegraded":"2024-09-14T12:01:24.914885+0000","last_fullsized":"2024-09-14T12:01:24.914885+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'321","last_scrub_stamp":"2024-09-14T12:01:24.914659+0000","last_deep_scrub":"263'321","last_deep_scrub_stamp":"2024-09-14T12:01:24.914659+0000","last_clean_scrub_stamp":"2024-09-14T12:01:24.914659+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:48.960207+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":599,"num_read_kb":77773,"num_write":1050,"num_write_kb":36142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":537,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.360671+0000","last_change":"2024-09-14T12:01:26.360594+0000","last_active":"2024-09-14T12:01:26.360671+0000","last_peered":"2024-09-14T12:01:26.360671+0000","last_clean":"2024-09-14T12:01:26.360671+0000","last_became_active":"2024-09-14T10:46:33.296049+0000","last_became_peered":"2024-09-14T10:46:33.296049+0000","last_unstale":"2024-09-14T12:01:26.360671+0000","last_undegraded":"2024-09-14T12:01:26.360671+0000","last_fullsized":"2024-09-14T12:01:26.360671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:26.360503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:26.360503+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.360503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:22.237563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000560203,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.560481+0000","last_change":"2024-09-14T12:01:45.560422+0000","last_active":"2024-09-14T12:01:45.560481+0000","last_peered":"2024-09-14T12:01:45.560481+0000","last_clean":"2024-09-14T12:01:45.560481+0000","last_became_active":"2024-09-14T10:46:48.350088+0000","last_became_peered":"2024-09-14T10:46:48.350088+0000","last_unstale":"2024-09-14T12:01:45.560481+0000","last_undegraded":"2024-09-14T12:01:45.560481+0000","last_fullsized":"2024-09-14T12:01:45.560481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:45.560303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:45.560303+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.560303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:17.490367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"263'642","reported_seq":1335,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.053809+0000","last_change":"2024-09-14T12:01:38.053809+0000","last_active":"2024-09-14T12:01:38.053809+0000","last_peered":"2024-09-14T12:01:38.053809+0000","last_clean":"2024-09-14T12:01:38.053809+0000","last_became_active":"2024-09-14T10:46:50.363387+0000","last_became_peered":"2024-09-14T10:46:50.363387+0000","last_unstale":"2024-09-14T12:01:38.053809+0000","last_undegraded":"2024-09-14T12:01:38.053809+0000","last_fullsized":"2024-09-14T12:01:38.053809+0000","mapping_epoch":32,"log_start":"263'600","ondisk_log_start":"263'600","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'642","last_scrub_stamp":"2024-09-14T12:01:38.053687+0000","last_deep_scrub":"263'642","last_deep_scrub_stamp":"2024-09-14T12:01:38.053687+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.053687+0000","objects_scrubbed":9,"log_size":42,"log_dups_size":600,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:59.160442+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95765,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1702,"num_read_kb":2954,"num_write":2224,"num_write_kb":2032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":529556,"num_omap_keys":1194,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.851676+0000","last_change":"2024-09-14T12:01:44.851613+0000","last_active":"2024-09-14T12:01:44.851676+0000","last_peered":"2024-09-14T12:01:44.851676+0000","last_clean":"2024-09-14T12:01:44.851676+0000","last_became_active":"2024-09-14T10:46:52.373837+0000","last_became_peered":"2024-09-14T10:46:52.373837+0000","last_unstale":"2024-09-14T12:01:44.851676+0000","last_undegraded":"2024-09-14T12:01:44.851676+0000","last_fullsized":"2024-09-14T12:01:44.851676+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:44.851435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:44.851435+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.851435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:32.096919+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"263'156","reported_seq":672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:01.154325+0000","last_change":"2024-09-14T12:02:01.154325+0000","last_active":"2024-09-14T12:02:01.154325+0000","last_peered":"2024-09-14T12:02:01.154325+0000","last_clean":"2024-09-14T12:02:01.154325+0000","last_became_active":"2024-09-14T10:46:54.385835+0000","last_became_peered":"2024-09-14T10:46:54.385835+0000","last_unstale":"2024-09-14T12:02:01.154325+0000","last_undegraded":"2024-09-14T12:02:01.154325+0000","last_fullsized":"2024-09-14T12:02:01.154325+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'156","last_scrub_stamp":"2024-09-14T12:02:01.154233+0000","last_deep_scrub":"263'156","last_deep_scrub_stamp":"2024-09-14T12:02:01.154233+0000","last_clean_scrub_stamp":"2024-09-14T12:02:01.154233+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:33.941222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":168,"num_read_kb":158,"num_write":389,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"263'836","reported_seq":2488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.821942+0000","last_change":"2024-09-14T12:01:38.821888+0000","last_active":"2024-09-14T12:01:38.821942+0000","last_peered":"2024-09-14T12:01:38.821942+0000","last_clean":"2024-09-14T12:01:38.821942+0000","last_became_active":"2024-09-14T10:46:46.346072+0000","last_became_peered":"2024-09-14T10:46:46.346072+0000","last_unstale":"2024-09-14T12:01:38.821942+0000","last_undegraded":"2024-09-14T12:01:38.821942+0000","last_fullsized":"2024-09-14T12:01:38.821942+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'836","last_scrub_stamp":"2024-09-14T12:01:38.821790+0000","last_deep_scrub":"263'836","last_deep_scrub_stamp":"2024-09-14T12:01:38.821790+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.821790+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:43.972793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4027,"num_read_kb":3636,"num_write":1084,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":476,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"263'385","reported_seq":1058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.833989+0000","last_change":"2024-09-14T12:01:28.833891+0000","last_active":"2024-09-14T12:01:28.833989+0000","last_peered":"2024-09-14T12:01:28.833989+0000","last_clean":"2024-09-14T12:01:28.833989+0000","last_became_active":"2024-09-14T10:46:44.317702+0000","last_became_peered":"2024-09-14T10:46:44.317702+0000","last_unstale":"2024-09-14T12:01:28.833989+0000","last_undegraded":"2024-09-14T12:01:28.833989+0000","last_fullsized":"2024-09-14T12:01:28.833989+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'385","last_scrub_stamp":"2024-09-14T12:01:28.833720+0000","last_deep_scrub":"263'385","last_deep_scrub_stamp":"2024-09-14T12:01:28.833720+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.833720+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:27.096840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":660,"num_read_kb":57005,"num_write":1181,"num_write_kb":30753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":542,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.935330+0000","last_change":"2024-09-14T12:01:27.935287+0000","last_active":"2024-09-14T12:01:27.935330+0000","last_peered":"2024-09-14T12:01:27.935330+0000","last_clean":"2024-09-14T12:01:27.935330+0000","last_became_active":"2024-09-14T10:46:33.265512+0000","last_became_peered":"2024-09-14T10:46:33.265512+0000","last_unstale":"2024-09-14T12:01:27.935330+0000","last_undegraded":"2024-09-14T12:01:27.935330+0000","last_fullsized":"2024-09-14T12:01:27.935330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:27.935219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:27.935219+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.935219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:28.603222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088449000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.260901+0000","last_change":"2024-09-14T12:01:40.260849+0000","last_active":"2024-09-14T12:01:40.260901+0000","last_peered":"2024-09-14T12:01:40.260901+0000","last_clean":"2024-09-14T12:01:40.260901+0000","last_became_active":"2024-09-14T10:46:48.353394+0000","last_became_peered":"2024-09-14T10:46:48.353394+0000","last_unstale":"2024-09-14T12:01:40.260901+0000","last_undegraded":"2024-09-14T12:01:40.260901+0000","last_fullsized":"2024-09-14T12:01:40.260901+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:40.260753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:40.260753+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.260753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:08.593537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"263'269","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:46.792061+0000","last_change":"2024-09-14T12:01:46.791996+0000","last_active":"2024-09-14T12:01:46.792061+0000","last_peered":"2024-09-14T12:01:46.792061+0000","last_clean":"2024-09-14T12:01:46.792061+0000","last_became_active":"2024-09-14T10:46:50.363436+0000","last_became_peered":"2024-09-14T10:46:50.363436+0000","last_unstale":"2024-09-14T12:01:46.792061+0000","last_undegraded":"2024-09-14T12:01:46.792061+0000","last_fullsized":"2024-09-14T12:01:46.792061+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'269","last_scrub_stamp":"2024-09-14T12:01:46.791905+0000","last_deep_scrub":"263'269","last_deep_scrub_stamp":"2024-09-14T12:01:46.791905+0000","last_clean_scrub_stamp":"2024-09-14T12:01:46.791905+0000","objects_scrubbed":8,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:52.672034+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":321,"num_read_kb":313,"num_write":296,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"263'803","reported_seq":2978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.574999+0000","last_change":"2024-09-14T12:01:45.574999+0000","last_active":"2024-09-14T12:01:45.574999+0000","last_peered":"2024-09-14T12:01:45.574999+0000","last_clean":"2024-09-14T12:01:45.574999+0000","last_became_active":"2024-09-14T10:46:52.373068+0000","last_became_peered":"2024-09-14T10:46:52.373068+0000","last_unstale":"2024-09-14T12:01:45.574999+0000","last_undegraded":"2024-09-14T12:01:45.574999+0000","last_fullsized":"2024-09-14T12:01:45.574999+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'803","last_scrub_stamp":"2024-09-14T12:01:45.574879+0000","last_deep_scrub":"263'803","last_deep_scrub_stamp":"2024-09-14T12:01:45.574879+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.574879+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:46.413388+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"263'142","reported_seq":648,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:51.119657+0000","last_change":"2024-09-14T12:01:51.119657+0000","last_active":"2024-09-14T12:01:51.119657+0000","last_peered":"2024-09-14T12:01:51.119657+0000","last_clean":"2024-09-14T12:01:51.119657+0000","last_became_active":"2024-09-14T10:46:54.387317+0000","last_became_peered":"2024-09-14T10:46:54.387317+0000","last_unstale":"2024-09-14T12:01:51.119657+0000","last_undegraded":"2024-09-14T12:01:51.119657+0000","last_fullsized":"2024-09-14T12:01:51.119657+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'142","last_scrub_stamp":"2024-09-14T12:01:51.119533+0000","last_deep_scrub":"263'142","last_deep_scrub_stamp":"2024-09-14T12:01:51.119533+0000","last_clean_scrub_stamp":"2024-09-14T12:01:51.119533+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:19.544541+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":117,"num_write":309,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"263'1368","reported_seq":3064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.720570+0000","last_change":"2024-09-14T12:01:34.720570+0000","last_active":"2024-09-14T12:01:34.720570+0000","last_peered":"2024-09-14T12:01:34.720570+0000","last_clean":"2024-09-14T12:01:34.720570+0000","last_became_active":"2024-09-14T10:46:46.344799+0000","last_became_peered":"2024-09-14T10:46:46.344799+0000","last_unstale":"2024-09-14T12:01:34.720570+0000","last_undegraded":"2024-09-14T12:01:34.720570+0000","last_fullsized":"2024-09-14T12:01:34.720570+0000","mapping_epoch":28,"log_start":"263'1300","ondisk_log_start":"263'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1368","last_scrub_stamp":"2024-09-14T12:01:34.720456+0000","last_deep_scrub":"263'1368","last_deep_scrub_stamp":"2024-09-14T12:01:34.720456+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.720456+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":1300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:58.415618+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6397,"num_read_kb":5617,"num_write":2035,"num_write_kb":974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"263'403","reported_seq":1219,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.693900+0000","last_change":"2024-09-14T12:01:29.693900+0000","last_active":"2024-09-14T12:01:29.693900+0000","last_peered":"2024-09-14T12:01:29.693900+0000","last_clean":"2024-09-14T12:01:29.693900+0000","last_became_active":"2024-09-14T10:46:44.324158+0000","last_became_peered":"2024-09-14T10:46:44.324158+0000","last_unstale":"2024-09-14T12:01:29.693900+0000","last_undegraded":"2024-09-14T12:01:29.693900+0000","last_fullsized":"2024-09-14T12:01:29.693900+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'403","last_scrub_stamp":"2024-09-14T12:01:29.693790+0000","last_deep_scrub":"263'403","last_deep_scrub_stamp":"2024-09-14T12:01:29.693790+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.693790+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:00.163688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":514873,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1028,"num_read_kb":45406,"num_write":1187,"num_write_kb":52499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":539,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.691638+0000","last_change":"2024-09-14T12:01:27.691638+0000","last_active":"2024-09-14T12:01:27.691638+0000","last_peered":"2024-09-14T12:01:27.691638+0000","last_clean":"2024-09-14T12:01:27.691638+0000","last_became_active":"2024-09-14T10:46:33.262218+0000","last_became_peered":"2024-09-14T10:46:33.262218+0000","last_unstale":"2024-09-14T12:01:27.691638+0000","last_undegraded":"2024-09-14T12:01:27.691638+0000","last_fullsized":"2024-09-14T12:01:27.691638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:27.691538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:27.691538+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.691538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:47.244884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072314099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:49.891037+0000","last_change":"2024-09-14T12:01:49.890983+0000","last_active":"2024-09-14T12:01:49.891037+0000","last_peered":"2024-09-14T12:01:49.891037+0000","last_clean":"2024-09-14T12:01:49.891037+0000","last_became_active":"2024-09-14T10:46:48.349924+0000","last_became_peered":"2024-09-14T10:46:48.349924+0000","last_unstale":"2024-09-14T12:01:49.891037+0000","last_undegraded":"2024-09-14T12:01:49.891037+0000","last_fullsized":"2024-09-14T12:01:49.891037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:49.890893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:49.890893+0000","last_clean_scrub_stamp":"2024-09-14T12:01:49.890893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:32.799420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"263'136","reported_seq":704,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:55.821044+0000","last_change":"2024-09-14T12:01:55.821044+0000","last_active":"2024-09-14T12:01:55.821044+0000","last_peered":"2024-09-14T12:01:55.821044+0000","last_clean":"2024-09-14T12:01:55.821044+0000","last_became_active":"2024-09-14T10:46:50.366610+0000","last_became_peered":"2024-09-14T10:46:50.366610+0000","last_unstale":"2024-09-14T12:01:55.821044+0000","last_undegraded":"2024-09-14T12:01:55.821044+0000","last_fullsized":"2024-09-14T12:01:55.821044+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-14T12:01:55.820939+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-14T12:01:55.820939+0000","last_clean_scrub_stamp":"2024-09-14T12:01:55.820939+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:58.153249+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"263'832","reported_seq":2805,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:53.243187+0000","last_change":"2024-09-14T12:01:53.243135+0000","last_active":"2024-09-14T12:01:53.243187+0000","last_peered":"2024-09-14T12:01:53.243187+0000","last_clean":"2024-09-14T12:01:53.243187+0000","last_became_active":"2024-09-14T10:46:52.370514+0000","last_became_peered":"2024-09-14T10:46:52.370514+0000","last_unstale":"2024-09-14T12:01:53.243187+0000","last_undegraded":"2024-09-14T12:01:53.243187+0000","last_fullsized":"2024-09-14T12:01:53.243187+0000","mapping_epoch":34,"log_start":"263'800","ondisk_log_start":"263'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'832","last_scrub_stamp":"2024-09-14T12:01:53.243054+0000","last_deep_scrub":"263'832","last_deep_scrub_stamp":"2024-09-14T12:01:53.243054+0000","last_clean_scrub_stamp":"2024-09-14T12:01:53.243054+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:44.102830+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"263'313","reported_seq":861,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:00.143351+0000","last_change":"2024-09-14T12:02:00.143351+0000","last_active":"2024-09-14T12:02:00.143351+0000","last_peered":"2024-09-14T12:02:00.143351+0000","last_clean":"2024-09-14T12:02:00.143351+0000","last_became_active":"2024-09-14T10:46:54.382860+0000","last_became_peered":"2024-09-14T10:46:54.382860+0000","last_unstale":"2024-09-14T12:02:00.143351+0000","last_undegraded":"2024-09-14T12:02:00.143351+0000","last_fullsized":"2024-09-14T12:02:00.143351+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'313","last_scrub_stamp":"2024-09-14T12:02:00.143252+0000","last_deep_scrub":"263'313","last_deep_scrub_stamp":"2024-09-14T12:02:00.143252+0000","last_clean_scrub_stamp":"2024-09-14T12:02:00.143252+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:06.813748+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":895,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":402,"num_read_kb":382,"num_write":591,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"263'1148","reported_seq":2854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.846285+0000","last_change":"2024-09-14T12:01:31.846208+0000","last_active":"2024-09-14T12:01:31.846285+0000","last_peered":"2024-09-14T12:01:31.846285+0000","last_clean":"2024-09-14T12:01:31.846285+0000","last_became_active":"2024-09-14T10:46:46.338543+0000","last_became_peered":"2024-09-14T10:46:46.338543+0000","last_unstale":"2024-09-14T12:01:31.846285+0000","last_undegraded":"2024-09-14T12:01:31.846285+0000","last_fullsized":"2024-09-14T12:01:31.846285+0000","mapping_epoch":28,"log_start":"263'1100","ondisk_log_start":"263'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1148","last_scrub_stamp":"2024-09-14T12:01:31.846127+0000","last_deep_scrub":"263'1148","last_deep_scrub_stamp":"2024-09-14T12:01:31.846127+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.846127+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":1100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:13.145120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5511,"num_read_kb":4909,"num_write":1576,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1532,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"263'347","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.669051+0000","last_change":"2024-09-14T12:01:28.669051+0000","last_active":"2024-09-14T12:01:28.669051+0000","last_peered":"2024-09-14T12:01:28.669051+0000","last_clean":"2024-09-14T12:01:28.669051+0000","last_became_active":"2024-09-14T10:46:44.318777+0000","last_became_peered":"2024-09-14T10:46:44.318777+0000","last_unstale":"2024-09-14T12:01:28.669051+0000","last_undegraded":"2024-09-14T12:01:28.669051+0000","last_fullsized":"2024-09-14T12:01:28.669051+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-09-14T12:01:28.668927+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-09-14T12:01:28.668927+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.668927+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:05.341520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":579,"num_read_kb":36295,"num_write":1107,"num_write_kb":33618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":540,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.924797+0000","last_change":"2024-09-14T12:01:28.924797+0000","last_active":"2024-09-14T12:01:28.924797+0000","last_peered":"2024-09-14T12:01:28.924797+0000","last_clean":"2024-09-14T12:01:28.924797+0000","last_became_active":"2024-09-14T10:46:33.265515+0000","last_became_peered":"2024-09-14T10:46:33.265515+0000","last_unstale":"2024-09-14T12:01:28.924797+0000","last_undegraded":"2024-09-14T12:01:28.924797+0000","last_fullsized":"2024-09-14T12:01:28.924797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:28.924676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:28.924676+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.924676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:40.550273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061284299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.515366+0000","last_change":"2024-09-14T12:01:44.515366+0000","last_active":"2024-09-14T12:01:44.515366+0000","last_peered":"2024-09-14T12:01:44.515366+0000","last_clean":"2024-09-14T12:01:44.515366+0000","last_became_active":"2024-09-14T10:46:48.354373+0000","last_became_peered":"2024-09-14T10:46:48.354373+0000","last_unstale":"2024-09-14T12:01:44.515366+0000","last_undegraded":"2024-09-14T12:01:44.515366+0000","last_fullsized":"2024-09-14T12:01:44.515366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:44.515279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:44.515279+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.515279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:32.779390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"263'728","reported_seq":1479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.193975+0000","last_change":"2024-09-14T12:01:43.193914+0000","last_active":"2024-09-14T12:01:43.193975+0000","last_peered":"2024-09-14T12:01:43.193975+0000","last_clean":"2024-09-14T12:01:43.193975+0000","last_became_active":"2024-09-14T10:46:50.362397+0000","last_became_peered":"2024-09-14T10:46:50.362397+0000","last_unstale":"2024-09-14T12:01:43.193975+0000","last_undegraded":"2024-09-14T12:01:43.193975+0000","last_fullsized":"2024-09-14T12:01:43.193975+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'728","last_scrub_stamp":"2024-09-14T12:01:43.193809+0000","last_deep_scrub":"263'728","last_deep_scrub_stamp":"2024-09-14T12:01:43.193809+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.193809+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":700,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:59.964839+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1285,"num_read_kb":3031,"num_write":1024,"num_write_kb":812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:56.606946+0000","last_change":"2024-09-14T12:01:56.606946+0000","last_active":"2024-09-14T12:01:56.606946+0000","last_peered":"2024-09-14T12:01:56.606946+0000","last_clean":"2024-09-14T12:01:56.606946+0000","last_became_active":"2024-09-14T10:46:52.370107+0000","last_became_peered":"2024-09-14T10:46:52.370107+0000","last_unstale":"2024-09-14T12:01:56.606946+0000","last_undegraded":"2024-09-14T12:01:56.606946+0000","last_fullsized":"2024-09-14T12:01:56.606946+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:56.606853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:56.606853+0000","last_clean_scrub_stamp":"2024-09-14T12:01:56.606853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:31.667227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"263'134","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:49.886658+0000","last_change":"2024-09-14T12:01:49.886658+0000","last_active":"2024-09-14T12:01:49.886658+0000","last_peered":"2024-09-14T12:01:49.886658+0000","last_clean":"2024-09-14T12:01:49.886658+0000","last_became_active":"2024-09-14T10:46:54.383813+0000","last_became_peered":"2024-09-14T10:46:54.383813+0000","last_unstale":"2024-09-14T12:01:49.886658+0000","last_undegraded":"2024-09-14T12:01:49.886658+0000","last_fullsized":"2024-09-14T12:01:49.886658+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'134","last_scrub_stamp":"2024-09-14T12:01:49.886576+0000","last_deep_scrub":"263'134","last_deep_scrub_stamp":"2024-09-14T12:01:49.886576+0000","last_clean_scrub_stamp":"2024-09-14T12:01:49.886576+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:09.354708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":350,"num_read_kb":289,"num_write":327,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"263'151","reported_seq":720,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:01.687668+0000","last_change":"2024-09-14T12:02:01.687668+0000","last_active":"2024-09-14T12:02:01.687668+0000","last_peered":"2024-09-14T12:02:01.687668+0000","last_clean":"2024-09-14T12:02:01.687668+0000","last_became_active":"2024-09-14T10:46:54.383742+0000","last_became_peered":"2024-09-14T10:46:54.383742+0000","last_unstale":"2024-09-14T12:02:01.687668+0000","last_undegraded":"2024-09-14T12:02:01.687668+0000","last_fullsized":"2024-09-14T12:02:01.687668+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'151","last_scrub_stamp":"2024-09-14T12:02:01.687538+0000","last_deep_scrub":"263'151","last_deep_scrub_stamp":"2024-09-14T12:02:01.687538+0000","last_clean_scrub_stamp":"2024-09-14T12:02:01.687538+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:13.283493+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":212,"num_read_kb":210,"num_write":346,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"263'703","reported_seq":2564,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.816238+0000","last_change":"2024-09-14T12:01:33.816238+0000","last_active":"2024-09-14T12:01:33.816238+0000","last_peered":"2024-09-14T12:01:33.816238+0000","last_clean":"2024-09-14T12:01:33.816238+0000","last_became_active":"2024-09-14T10:46:46.337818+0000","last_became_peered":"2024-09-14T10:46:46.337818+0000","last_unstale":"2024-09-14T12:01:33.816238+0000","last_undegraded":"2024-09-14T12:01:33.816238+0000","last_fullsized":"2024-09-14T12:01:33.816238+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'703","last_scrub_stamp":"2024-09-14T12:01:33.816161+0000","last_deep_scrub":"263'703","last_deep_scrub_stamp":"2024-09-14T12:01:33.816161+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.816161+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:12.842729+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3744,"num_read_kb":3411,"num_write":893,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2266,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"263'332","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.757635+0000","last_change":"2024-09-14T12:01:36.757635+0000","last_active":"2024-09-14T12:01:36.757635+0000","last_peered":"2024-09-14T12:01:36.757635+0000","last_clean":"2024-09-14T12:01:36.757635+0000","last_became_active":"2024-09-14T10:46:44.332607+0000","last_became_peered":"2024-09-14T10:46:44.332607+0000","last_unstale":"2024-09-14T12:01:36.757635+0000","last_undegraded":"2024-09-14T12:01:36.757635+0000","last_fullsized":"2024-09-14T12:01:36.757635+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'332","last_scrub_stamp":"2024-09-14T12:01:36.757421+0000","last_deep_scrub":"263'332","last_deep_scrub_stamp":"2024-09-14T12:01:36.757421+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.757421+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:10.285355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":554,"num_read_kb":15763,"num_write":1023,"num_write_kb":46520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:48.839413+0000","last_change":"2024-09-14T12:01:48.839413+0000","last_active":"2024-09-14T12:01:48.839413+0000","last_peered":"2024-09-14T12:01:48.839413+0000","last_clean":"2024-09-14T12:01:48.839413+0000","last_became_active":"2024-09-14T10:46:48.353125+0000","last_became_peered":"2024-09-14T10:46:48.353125+0000","last_unstale":"2024-09-14T12:01:48.839413+0000","last_undegraded":"2024-09-14T12:01:48.839413+0000","last_fullsized":"2024-09-14T12:01:48.839413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:48.839288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:48.839288+0000","last_clean_scrub_stamp":"2024-09-14T12:01:48.839288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:58.967280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"263'339","reported_seq":936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:47.806535+0000","last_change":"2024-09-14T12:01:47.806535+0000","last_active":"2024-09-14T12:01:47.806535+0000","last_peered":"2024-09-14T12:01:47.806535+0000","last_clean":"2024-09-14T12:01:47.806535+0000","last_became_active":"2024-09-14T10:46:50.364874+0000","last_became_peered":"2024-09-14T10:46:50.364874+0000","last_unstale":"2024-09-14T12:01:47.806535+0000","last_undegraded":"2024-09-14T12:01:47.806535+0000","last_fullsized":"2024-09-14T12:01:47.806535+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-14T12:01:47.806449+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-14T12:01:47.806449+0000","last_clean_scrub_stamp":"2024-09-14T12:01:47.806449+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:34.200759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58887,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":550,"num_read_kb":1323,"num_write":450,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:47.041018+0000","last_change":"2024-09-14T12:01:47.041018+0000","last_active":"2024-09-14T12:01:47.041018+0000","last_peered":"2024-09-14T12:01:47.041018+0000","last_clean":"2024-09-14T12:01:47.041018+0000","last_became_active":"2024-09-14T10:46:52.373982+0000","last_became_peered":"2024-09-14T10:46:52.373982+0000","last_unstale":"2024-09-14T12:01:47.041018+0000","last_undegraded":"2024-09-14T12:01:47.041018+0000","last_fullsized":"2024-09-14T12:01:47.041018+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:47.040933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:47.040933+0000","last_clean_scrub_stamp":"2024-09-14T12:01:47.040933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:05.191928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"263'117","reported_seq":621,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:52.116650+0000","last_change":"2024-09-14T12:01:52.116650+0000","last_active":"2024-09-14T12:01:52.116650+0000","last_peered":"2024-09-14T12:01:52.116650+0000","last_clean":"2024-09-14T12:01:52.116650+0000","last_became_active":"2024-09-14T10:46:54.387552+0000","last_became_peered":"2024-09-14T10:46:54.387552+0000","last_unstale":"2024-09-14T12:01:52.116650+0000","last_undegraded":"2024-09-14T12:01:52.116650+0000","last_fullsized":"2024-09-14T12:01:52.116650+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'117","last_scrub_stamp":"2024-09-14T12:01:52.116556+0000","last_deep_scrub":"263'117","last_deep_scrub_stamp":"2024-09-14T12:01:52.116556+0000","last_clean_scrub_stamp":"2024-09-14T12:01:52.116556+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:05.469835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":107,"num_write":284,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"263'407","reported_seq":1864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.672684+0000","last_change":"2024-09-14T12:01:36.672684+0000","last_active":"2024-09-14T12:01:36.672684+0000","last_peered":"2024-09-14T12:01:36.672684+0000","last_clean":"2024-09-14T12:01:36.672684+0000","last_became_active":"2024-09-14T10:46:46.348040+0000","last_became_peered":"2024-09-14T10:46:46.348040+0000","last_unstale":"2024-09-14T12:01:36.672684+0000","last_undegraded":"2024-09-14T12:01:36.672684+0000","last_fullsized":"2024-09-14T12:01:36.672684+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'407","last_scrub_stamp":"2024-09-14T12:01:36.672588+0000","last_deep_scrub":"263'407","last_deep_scrub_stamp":"2024-09-14T12:01:36.672588+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.672588+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:46.183322+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2178,"num_read_kb":2045,"num_write":462,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"263'336","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.276975+0000","last_change":"2024-09-14T12:01:26.276921+0000","last_active":"2024-09-14T12:01:26.276975+0000","last_peered":"2024-09-14T12:01:26.276975+0000","last_clean":"2024-09-14T12:01:26.276975+0000","last_became_active":"2024-09-14T10:46:44.333195+0000","last_became_peered":"2024-09-14T10:46:44.333195+0000","last_unstale":"2024-09-14T12:01:26.276975+0000","last_undegraded":"2024-09-14T12:01:26.276975+0000","last_fullsized":"2024-09-14T12:01:26.276975+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'336","last_scrub_stamp":"2024-09-14T12:01:26.276834+0000","last_deep_scrub":"263'336","last_deep_scrub_stamp":"2024-09-14T12:01:26.276834+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.276834+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:00:55.874383+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":77356,"num_write":1081,"num_write_kb":55140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:47.513522+0000","last_change":"2024-09-14T12:01:47.513522+0000","last_active":"2024-09-14T12:01:47.513522+0000","last_peered":"2024-09-14T12:01:47.513522+0000","last_clean":"2024-09-14T12:01:47.513522+0000","last_became_active":"2024-09-14T10:46:48.357033+0000","last_became_peered":"2024-09-14T10:46:48.357033+0000","last_unstale":"2024-09-14T12:01:47.513522+0000","last_undegraded":"2024-09-14T12:01:47.513522+0000","last_fullsized":"2024-09-14T12:01:47.513522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:47.513436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:47.513436+0000","last_clean_scrub_stamp":"2024-09-14T12:01:47.513436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:22.660153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"263'66","reported_seq":588,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:52.571492+0000","last_change":"2024-09-14T12:01:52.571492+0000","last_active":"2024-09-14T12:01:52.571492+0000","last_peered":"2024-09-14T12:01:52.571492+0000","last_clean":"2024-09-14T12:01:52.571492+0000","last_became_active":"2024-09-14T10:46:50.362878+0000","last_became_peered":"2024-09-14T10:46:50.362878+0000","last_unstale":"2024-09-14T12:01:52.571492+0000","last_undegraded":"2024-09-14T12:01:52.571492+0000","last_fullsized":"2024-09-14T12:01:52.571492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'66","last_scrub_stamp":"2024-09-14T12:01:52.571399+0000","last_deep_scrub":"263'66","last_deep_scrub_stamp":"2024-09-14T12:01:52.571399+0000","last_clean_scrub_stamp":"2024-09-14T12:01:52.571399+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:05.602319+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:46.793396+0000","last_change":"2024-09-14T12:01:46.793396+0000","last_active":"2024-09-14T12:01:46.793396+0000","last_peered":"2024-09-14T12:01:46.793396+0000","last_clean":"2024-09-14T12:01:46.793396+0000","last_became_active":"2024-09-14T10:46:52.365987+0000","last_became_peered":"2024-09-14T10:46:52.365987+0000","last_unstale":"2024-09-14T12:01:46.793396+0000","last_undegraded":"2024-09-14T12:01:46.793396+0000","last_fullsized":"2024-09-14T12:01:46.793396+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:46.793292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:46.793292+0000","last_clean_scrub_stamp":"2024-09-14T12:01:46.793292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:54.685984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"263'201","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:55.827104+0000","last_change":"2024-09-14T12:01:55.827043+0000","last_active":"2024-09-14T12:01:55.827104+0000","last_peered":"2024-09-14T12:01:55.827104+0000","last_clean":"2024-09-14T12:01:55.827104+0000","last_became_active":"2024-09-14T10:46:54.383284+0000","last_became_peered":"2024-09-14T10:46:54.383284+0000","last_unstale":"2024-09-14T12:01:55.827104+0000","last_undegraded":"2024-09-14T12:01:55.827104+0000","last_fullsized":"2024-09-14T12:01:55.827104+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'201","last_scrub_stamp":"2024-09-14T12:01:55.826936+0000","last_deep_scrub":"263'201","last_deep_scrub_stamp":"2024-09-14T12:01:55.826936+0000","last_clean_scrub_stamp":"2024-09-14T12:01:55.826936+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:17.041024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":348,"num_read_kb":326,"num_write":460,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"263'466","reported_seq":2101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.701686+0000","last_change":"2024-09-14T12:01:35.701686+0000","last_active":"2024-09-14T12:01:35.701686+0000","last_peered":"2024-09-14T12:01:35.701686+0000","last_clean":"2024-09-14T12:01:35.701686+0000","last_became_active":"2024-09-14T10:46:46.341424+0000","last_became_peered":"2024-09-14T10:46:46.341424+0000","last_unstale":"2024-09-14T12:01:35.701686+0000","last_undegraded":"2024-09-14T12:01:35.701686+0000","last_fullsized":"2024-09-14T12:01:35.701686+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'466","last_scrub_stamp":"2024-09-14T12:01:35.701589+0000","last_deep_scrub":"263'466","last_deep_scrub_stamp":"2024-09-14T12:01:35.701589+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.701589+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:23.244730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2571,"num_read_kb":2437,"num_write":538,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"263'326","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.895420+0000","last_change":"2024-09-14T12:01:27.895339+0000","last_active":"2024-09-14T12:01:27.895420+0000","last_peered":"2024-09-14T12:01:27.895420+0000","last_clean":"2024-09-14T12:01:27.895420+0000","last_became_active":"2024-09-14T10:46:44.321694+0000","last_became_peered":"2024-09-14T10:46:44.321694+0000","last_unstale":"2024-09-14T12:01:27.895420+0000","last_undegraded":"2024-09-14T12:01:27.895420+0000","last_fullsized":"2024-09-14T12:01:27.895420+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'326","last_scrub_stamp":"2024-09-14T12:01:27.895250+0000","last_deep_scrub":"263'326","last_deep_scrub_stamp":"2024-09-14T12:01:27.895250+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.895250+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:46.249003+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":535,"num_read_kb":12444,"num_write":977,"num_write_kb":13958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.839618+0000","last_change":"2024-09-14T12:01:37.839618+0000","last_active":"2024-09-14T12:01:37.839618+0000","last_peered":"2024-09-14T12:01:37.839618+0000","last_clean":"2024-09-14T12:01:37.839618+0000","last_became_active":"2024-09-14T10:46:48.350714+0000","last_became_peered":"2024-09-14T10:46:48.350714+0000","last_unstale":"2024-09-14T12:01:37.839618+0000","last_undegraded":"2024-09-14T12:01:37.839618+0000","last_fullsized":"2024-09-14T12:01:37.839618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:37.839539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:37.839539+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.839539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:51.881085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"263'343","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.015254+0000","last_change":"2024-09-14T12:01:45.015254+0000","last_active":"2024-09-14T12:01:45.015254+0000","last_peered":"2024-09-14T12:01:45.015254+0000","last_clean":"2024-09-14T12:01:45.015254+0000","last_became_active":"2024-09-14T10:46:50.360886+0000","last_became_peered":"2024-09-14T10:46:50.360886+0000","last_unstale":"2024-09-14T12:01:45.015254+0000","last_undegraded":"2024-09-14T12:01:45.015254+0000","last_fullsized":"2024-09-14T12:01:45.015254+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-14T12:01:45.015155+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-14T12:01:45.015155+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.015155+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:22.667188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50451,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":558,"num_read_kb":1238,"num_write":442,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.600309+0000","last_change":"2024-09-14T12:01:44.600309+0000","last_active":"2024-09-14T12:01:44.600309+0000","last_peered":"2024-09-14T12:01:44.600309+0000","last_clean":"2024-09-14T12:01:44.600309+0000","last_became_active":"2024-09-14T10:46:52.375120+0000","last_became_peered":"2024-09-14T10:46:52.375120+0000","last_unstale":"2024-09-14T12:01:44.600309+0000","last_undegraded":"2024-09-14T12:01:44.600309+0000","last_fullsized":"2024-09-14T12:01:44.600309+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:44.600220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:44.600220+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.600220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:15.281267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"263'126","reported_seq":648,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.847108+0000","last_change":"2024-09-14T10:46:54.384403+0000","last_active":"2024-09-14T11:59:34.847108+0000","last_peered":"2024-09-14T11:59:34.847108+0000","last_clean":"2024-09-14T11:59:34.847108+0000","last_became_active":"2024-09-14T10:46:54.384113+0000","last_became_peered":"2024-09-14T10:46:54.384113+0000","last_unstale":"2024-09-14T11:59:34.847108+0000","last_undegraded":"2024-09-14T11:59:34.847108+0000","last_fullsized":"2024-09-14T11:59:34.847108+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":180,"num_read_kb":170,"num_write":302,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"263'381","reported_seq":2036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.108765+0000","last_change":"2024-09-14T12:01:33.108765+0000","last_active":"2024-09-14T12:01:33.108765+0000","last_peered":"2024-09-14T12:01:33.108765+0000","last_clean":"2024-09-14T12:01:33.108765+0000","last_became_active":"2024-09-14T10:46:46.346318+0000","last_became_peered":"2024-09-14T10:46:46.346318+0000","last_unstale":"2024-09-14T12:01:33.108765+0000","last_undegraded":"2024-09-14T12:01:33.108765+0000","last_fullsized":"2024-09-14T12:01:33.108765+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'381","last_scrub_stamp":"2024-09-14T12:01:33.108674+0000","last_deep_scrub":"263'381","last_deep_scrub_stamp":"2024-09-14T12:01:33.108674+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.108674+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:22.079780+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2319,"num_read_kb":2246,"num_write":412,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2047,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"263'411","reported_seq":1088,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.374129+0000","last_change":"2024-09-14T12:01:28.374029+0000","last_active":"2024-09-14T12:01:28.374129+0000","last_peered":"2024-09-14T12:01:28.374129+0000","last_clean":"2024-09-14T12:01:28.374129+0000","last_became_active":"2024-09-14T10:46:44.332841+0000","last_became_peered":"2024-09-14T10:46:44.332841+0000","last_unstale":"2024-09-14T12:01:28.374129+0000","last_undegraded":"2024-09-14T12:01:28.374129+0000","last_fullsized":"2024-09-14T12:01:28.374129+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-09-14T12:01:28.373852+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-09-14T12:01:28.373852+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.373852+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:25.272342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133711,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":772,"num_read_kb":6861,"num_write":1433,"num_write_kb":25110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:52.849829+0000","last_change":"2024-09-14T12:01:52.849829+0000","last_active":"2024-09-14T12:01:52.849829+0000","last_peered":"2024-09-14T12:01:52.849829+0000","last_clean":"2024-09-14T12:01:52.849829+0000","last_became_active":"2024-09-14T10:46:48.353010+0000","last_became_peered":"2024-09-14T10:46:48.353010+0000","last_unstale":"2024-09-14T12:01:52.849829+0000","last_undegraded":"2024-09-14T12:01:52.849829+0000","last_fullsized":"2024-09-14T12:01:52.849829+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:52.849742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:52.849742+0000","last_clean_scrub_stamp":"2024-09-14T12:01:52.849742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:37.169755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"263'289","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:47.191562+0000","last_change":"2024-09-14T12:01:47.191562+0000","last_active":"2024-09-14T12:01:47.191562+0000","last_peered":"2024-09-14T12:01:47.191562+0000","last_clean":"2024-09-14T12:01:47.191562+0000","last_became_active":"2024-09-14T10:46:50.362723+0000","last_became_peered":"2024-09-14T10:46:50.362723+0000","last_unstale":"2024-09-14T12:01:47.191562+0000","last_undegraded":"2024-09-14T12:01:47.191562+0000","last_fullsized":"2024-09-14T12:01:47.191562+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'289","last_scrub_stamp":"2024-09-14T12:01:47.191473+0000","last_deep_scrub":"263'289","last_deep_scrub_stamp":"2024-09-14T12:01:47.191473+0000","last_clean_scrub_stamp":"2024-09-14T12:01:47.191473+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:32.942349+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44996,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":451,"num_read_kb":1030,"num_write":360,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:46.048503+0000","last_change":"2024-09-14T12:01:46.048503+0000","last_active":"2024-09-14T12:01:46.048503+0000","last_peered":"2024-09-14T12:01:46.048503+0000","last_clean":"2024-09-14T12:01:46.048503+0000","last_became_active":"2024-09-14T10:46:52.369048+0000","last_became_peered":"2024-09-14T10:46:52.369048+0000","last_unstale":"2024-09-14T12:01:46.048503+0000","last_undegraded":"2024-09-14T12:01:46.048503+0000","last_fullsized":"2024-09-14T12:01:46.048503+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:46.048415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:46.048415+0000","last_clean_scrub_stamp":"2024-09-14T12:01:46.048415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:37.173407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"263'556","reported_seq":2343,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.798201+0000","last_change":"2024-09-14T12:01:43.798097+0000","last_active":"2024-09-14T12:01:43.798201+0000","last_peered":"2024-09-14T12:01:43.798201+0000","last_clean":"2024-09-14T12:01:43.798201+0000","last_became_active":"2024-09-14T10:46:46.348774+0000","last_became_peered":"2024-09-14T10:46:46.348774+0000","last_unstale":"2024-09-14T12:01:43.798201+0000","last_undegraded":"2024-09-14T12:01:43.798201+0000","last_fullsized":"2024-09-14T12:01:43.798201+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'556","last_scrub_stamp":"2024-09-14T12:01:43.797996+0000","last_deep_scrub":"263'556","last_deep_scrub_stamp":"2024-09-14T12:01:43.797996+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.797996+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:15.352106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3189,"num_read_kb":2980,"num_write":657,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"263'401","reported_seq":1094,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.391955+0000","last_change":"2024-09-14T12:01:29.391885+0000","last_active":"2024-09-14T12:01:29.391955+0000","last_peered":"2024-09-14T12:01:29.391955+0000","last_clean":"2024-09-14T12:01:29.391955+0000","last_became_active":"2024-09-14T10:46:44.334693+0000","last_became_peered":"2024-09-14T10:46:44.334693+0000","last_unstale":"2024-09-14T12:01:29.391955+0000","last_undegraded":"2024-09-14T12:01:29.391955+0000","last_fullsized":"2024-09-14T12:01:29.391955+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'401","last_scrub_stamp":"2024-09-14T12:01:29.391776+0000","last_deep_scrub":"263'401","last_deep_scrub_stamp":"2024-09-14T12:01:29.391776+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.391776+0000","objects_scrubbed":5,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:21.186717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1532840,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":807,"num_read_kb":35702,"num_write":1252,"num_write_kb":25930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"263'4","reported_seq":997,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.864111+0000","last_change":"2024-09-14T12:01:43.864111+0000","last_active":"2024-09-14T12:01:43.864111+0000","last_peered":"2024-09-14T12:01:43.864111+0000","last_clean":"2024-09-14T12:01:43.864111+0000","last_became_active":"2024-09-14T10:46:48.350469+0000","last_became_peered":"2024-09-14T10:46:48.350469+0000","last_unstale":"2024-09-14T12:01:43.864111+0000","last_undegraded":"2024-09-14T12:01:43.864111+0000","last_fullsized":"2024-09-14T12:01:43.864111+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:01:43.863982+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:01:43.863982+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.863982+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:27:04.908426+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"263'501","reported_seq":1150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:50.864846+0000","last_change":"2024-09-14T12:01:50.864779+0000","last_active":"2024-09-14T12:01:50.864846+0000","last_peered":"2024-09-14T12:01:50.864846+0000","last_clean":"2024-09-14T12:01:50.864846+0000","last_became_active":"2024-09-14T10:46:50.365486+0000","last_became_peered":"2024-09-14T10:46:50.365486+0000","last_unstale":"2024-09-14T12:01:50.864846+0000","last_undegraded":"2024-09-14T12:01:50.864846+0000","last_fullsized":"2024-09-14T12:01:50.864846+0000","mapping_epoch":32,"log_start":"263'400","ondisk_log_start":"263'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'501","last_scrub_stamp":"2024-09-14T12:01:50.864676+0000","last_deep_scrub":"263'501","last_deep_scrub_stamp":"2024-09-14T12:01:50.864676+0000","last_clean_scrub_stamp":"2024-09-14T12:01:50.864676+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:12.318665+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93124,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":891,"num_read_kb":2144,"num_write":760,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:47.842011+0000","last_change":"2024-09-14T12:01:47.841917+0000","last_active":"2024-09-14T12:01:47.842011+0000","last_peered":"2024-09-14T12:01:47.842011+0000","last_clean":"2024-09-14T12:01:47.842011+0000","last_became_active":"2024-09-14T10:46:52.372151+0000","last_became_peered":"2024-09-14T10:46:52.372151+0000","last_unstale":"2024-09-14T12:01:47.842011+0000","last_undegraded":"2024-09-14T12:01:47.842011+0000","last_fullsized":"2024-09-14T12:01:47.842011+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:47.841832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:47.841832+0000","last_clean_scrub_stamp":"2024-09-14T12:01:47.841832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:42.232450+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"263'207","reported_seq":727,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:02.180825+0000","last_change":"2024-09-14T12:02:02.180825+0000","last_active":"2024-09-14T12:02:02.180825+0000","last_peered":"2024-09-14T12:02:02.180825+0000","last_clean":"2024-09-14T12:02:02.180825+0000","last_became_active":"2024-09-14T10:46:54.386525+0000","last_became_peered":"2024-09-14T10:46:54.386525+0000","last_unstale":"2024-09-14T12:02:02.180825+0000","last_undegraded":"2024-09-14T12:02:02.180825+0000","last_fullsized":"2024-09-14T12:02:02.180825+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'207","last_scrub_stamp":"2024-09-14T12:02:02.180735+0000","last_deep_scrub":"263'207","last_deep_scrub_stamp":"2024-09-14T12:02:02.180735+0000","last_clean_scrub_stamp":"2024-09-14T12:02:02.180735+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:53.469743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":260,"num_read_kb":259,"num_write":474,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"263'419","reported_seq":2088,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.678034+0000","last_change":"2024-09-14T12:01:38.678034+0000","last_active":"2024-09-14T12:01:38.678034+0000","last_peered":"2024-09-14T12:01:38.678034+0000","last_clean":"2024-09-14T12:01:38.678034+0000","last_became_active":"2024-09-14T10:46:46.341559+0000","last_became_peered":"2024-09-14T10:46:46.341559+0000","last_unstale":"2024-09-14T12:01:38.678034+0000","last_undegraded":"2024-09-14T12:01:38.678034+0000","last_fullsized":"2024-09-14T12:01:38.678034+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'419","last_scrub_stamp":"2024-09-14T12:01:38.677944+0000","last_deep_scrub":"263'419","last_deep_scrub_stamp":"2024-09-14T12:01:38.677944+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.677944+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:16.076637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2371,"num_read_kb":2275,"num_write":467,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"263'282","reported_seq":938,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.691728+0000","last_change":"2024-09-14T12:01:31.691639+0000","last_active":"2024-09-14T12:01:31.691728+0000","last_peered":"2024-09-14T12:01:31.691728+0000","last_clean":"2024-09-14T12:01:31.691728+0000","last_became_active":"2024-09-14T10:46:44.319896+0000","last_became_peered":"2024-09-14T10:46:44.319896+0000","last_unstale":"2024-09-14T12:01:31.691728+0000","last_undegraded":"2024-09-14T12:01:31.691728+0000","last_fullsized":"2024-09-14T12:01:31.691728+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'282","last_scrub_stamp":"2024-09-14T12:01:31.691521+0000","last_deep_scrub":"263'282","last_deep_scrub_stamp":"2024-09-14T12:01:31.691521+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.691521+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:52.725869+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133682,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":524,"num_read_kb":94668,"num_write":900,"num_write_kb":37785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.928810+0000","last_change":"2024-09-14T12:01:42.928757+0000","last_active":"2024-09-14T12:01:42.928810+0000","last_peered":"2024-09-14T12:01:42.928810+0000","last_clean":"2024-09-14T12:01:42.928810+0000","last_became_active":"2024-09-14T10:46:48.355149+0000","last_became_peered":"2024-09-14T10:46:48.355149+0000","last_unstale":"2024-09-14T12:01:42.928810+0000","last_undegraded":"2024-09-14T12:01:42.928810+0000","last_fullsized":"2024-09-14T12:01:42.928810+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:42.928663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:42.928663+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.928663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:09.783248+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"263'353","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:58.831540+0000","last_change":"2024-09-14T12:01:58.831540+0000","last_active":"2024-09-14T12:01:58.831540+0000","last_peered":"2024-09-14T12:01:58.831540+0000","last_clean":"2024-09-14T12:01:58.831540+0000","last_became_active":"2024-09-14T10:46:50.366749+0000","last_became_peered":"2024-09-14T10:46:50.366749+0000","last_unstale":"2024-09-14T12:01:58.831540+0000","last_undegraded":"2024-09-14T12:01:58.831540+0000","last_fullsized":"2024-09-14T12:01:58.831540+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'353","last_scrub_stamp":"2024-09-14T12:01:58.831444+0000","last_deep_scrub":"263'353","last_deep_scrub_stamp":"2024-09-14T12:01:58.831444+0000","last_clean_scrub_stamp":"2024-09-14T12:01:58.831444+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:18.190822+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49707,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":587,"num_read_kb":1269,"num_write":486,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:57.154367+0000","last_change":"2024-09-14T12:01:57.154367+0000","last_active":"2024-09-14T12:01:57.154367+0000","last_peered":"2024-09-14T12:01:57.154367+0000","last_clean":"2024-09-14T12:01:57.154367+0000","last_became_active":"2024-09-14T10:46:52.368508+0000","last_became_peered":"2024-09-14T10:46:52.368508+0000","last_unstale":"2024-09-14T12:01:57.154367+0000","last_undegraded":"2024-09-14T12:01:57.154367+0000","last_fullsized":"2024-09-14T12:01:57.154367+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:57.154283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:57.154283+0000","last_clean_scrub_stamp":"2024-09-14T12:01:57.154283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:27.227112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"263'181","reported_seq":1058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.917475+0000","last_change":"2024-09-14T10:46:54.379236+0000","last_active":"2024-09-14T11:59:30.917475+0000","last_peered":"2024-09-14T11:59:30.917475+0000","last_clean":"2024-09-14T11:59:30.917475+0000","last_became_active":"2024-09-14T10:46:54.378938+0000","last_became_peered":"2024-09-14T10:46:54.378938+0000","last_unstale":"2024-09-14T11:59:30.917475+0000","last_undegraded":"2024-09-14T11:59:30.917475+0000","last_fullsized":"2024-09-14T11:59:30.917475+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2044,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":607,"num_read_kb":603,"num_write":505,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"263'637","reported_seq":2307,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.079238+0000","last_change":"2024-09-14T12:01:35.079167+0000","last_active":"2024-09-14T12:01:35.079238+0000","last_peered":"2024-09-14T12:01:35.079238+0000","last_clean":"2024-09-14T12:01:35.079238+0000","last_became_active":"2024-09-14T10:46:46.347362+0000","last_became_peered":"2024-09-14T10:46:46.347362+0000","last_unstale":"2024-09-14T12:01:35.079238+0000","last_undegraded":"2024-09-14T12:01:35.079238+0000","last_fullsized":"2024-09-14T12:01:35.079238+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'637","last_scrub_stamp":"2024-09-14T12:01:35.079082+0000","last_deep_scrub":"263'637","last_deep_scrub_stamp":"2024-09-14T12:01:35.079082+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.079082+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":600,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:12.178538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3345,"num_read_kb":3056,"num_write":864,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"263'375","reported_seq":1036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.727303+0000","last_change":"2024-09-14T12:01:26.727237+0000","last_active":"2024-09-14T12:01:26.727303+0000","last_peered":"2024-09-14T12:01:26.727303+0000","last_clean":"2024-09-14T12:01:26.727303+0000","last_became_active":"2024-09-14T10:46:44.318099+0000","last_became_peered":"2024-09-14T10:46:44.318099+0000","last_unstale":"2024-09-14T12:01:26.727303+0000","last_undegraded":"2024-09-14T12:01:26.727303+0000","last_fullsized":"2024-09-14T12:01:26.727303+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'375","last_scrub_stamp":"2024-09-14T12:01:26.727098+0000","last_deep_scrub":"263'375","last_deep_scrub_stamp":"2024-09-14T12:01:26.727098+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.727098+0000","objects_scrubbed":8,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:42.583432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133694,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":681,"num_read_kb":1685,"num_write":1259,"num_write_kb":36237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.899872+0000","last_change":"2024-09-14T12:01:41.899759+0000","last_active":"2024-09-14T12:01:41.899872+0000","last_peered":"2024-09-14T12:01:41.899872+0000","last_clean":"2024-09-14T12:01:41.899872+0000","last_became_active":"2024-09-14T10:46:48.350059+0000","last_became_peered":"2024-09-14T10:46:48.350059+0000","last_unstale":"2024-09-14T12:01:41.899872+0000","last_undegraded":"2024-09-14T12:01:41.899872+0000","last_fullsized":"2024-09-14T12:01:41.899872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:41.899660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:41.899660+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.899660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:49.562202+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"263'316","reported_seq":917,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:51.849471+0000","last_change":"2024-09-14T12:01:51.849404+0000","last_active":"2024-09-14T12:01:51.849471+0000","last_peered":"2024-09-14T12:01:51.849471+0000","last_clean":"2024-09-14T12:01:51.849471+0000","last_became_active":"2024-09-14T10:46:50.365393+0000","last_became_peered":"2024-09-14T10:46:50.365393+0000","last_unstale":"2024-09-14T12:01:51.849471+0000","last_undegraded":"2024-09-14T12:01:51.849471+0000","last_fullsized":"2024-09-14T12:01:51.849471+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'316","last_scrub_stamp":"2024-09-14T12:01:51.849311+0000","last_deep_scrub":"263'316","last_deep_scrub_stamp":"2024-09-14T12:01:51.849311+0000","last_clean_scrub_stamp":"2024-09-14T12:01:51.849311+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:19.475246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46624,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":509,"num_read_kb":1174,"num_write":408,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:48.058716+0000","last_change":"2024-09-14T12:01:48.058716+0000","last_active":"2024-09-14T12:01:48.058716+0000","last_peered":"2024-09-14T12:01:48.058716+0000","last_clean":"2024-09-14T12:01:48.058716+0000","last_became_active":"2024-09-14T10:46:52.373099+0000","last_became_peered":"2024-09-14T10:46:52.373099+0000","last_unstale":"2024-09-14T12:01:48.058716+0000","last_undegraded":"2024-09-14T12:01:48.058716+0000","last_fullsized":"2024-09-14T12:01:48.058716+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:48.058614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:48.058614+0000","last_clean_scrub_stamp":"2024-09-14T12:01:48.058614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:24.902309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"263'143","reported_seq":668,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:52.318564+0000","last_change":"2024-09-14T10:46:54.385921+0000","last_active":"2024-09-14T12:00:52.318564+0000","last_peered":"2024-09-14T12:00:52.318564+0000","last_clean":"2024-09-14T12:00:52.318564+0000","last_became_active":"2024-09-14T10:46:54.385625+0000","last_became_peered":"2024-09-14T10:46:54.385625+0000","last_unstale":"2024-09-14T12:00:52.318564+0000","last_undegraded":"2024-09-14T12:00:52.318564+0000","last_fullsized":"2024-09-14T12:00:52.318564+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":790,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":228,"num_read_kb":197,"num_write":338,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"263'418","reported_seq":1968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.632743+0000","last_change":"2024-09-14T12:01:37.632681+0000","last_active":"2024-09-14T12:01:37.632743+0000","last_peered":"2024-09-14T12:01:37.632743+0000","last_clean":"2024-09-14T12:01:37.632743+0000","last_became_active":"2024-09-14T10:46:46.338551+0000","last_became_peered":"2024-09-14T10:46:46.338551+0000","last_unstale":"2024-09-14T12:01:37.632743+0000","last_undegraded":"2024-09-14T12:01:37.632743+0000","last_fullsized":"2024-09-14T12:01:37.632743+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'418","last_scrub_stamp":"2024-09-14T12:01:37.632564+0000","last_deep_scrub":"263'418","last_deep_scrub_stamp":"2024-09-14T12:01:37.632564+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.632564+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:48.702789+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2291,"num_read_kb":2170,"num_write":475,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"263'291","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.702324+0000","last_change":"2024-09-14T12:01:32.702217+0000","last_active":"2024-09-14T12:01:32.702324+0000","last_peered":"2024-09-14T12:01:32.702324+0000","last_clean":"2024-09-14T12:01:32.702324+0000","last_became_active":"2024-09-14T10:46:44.331660+0000","last_became_peered":"2024-09-14T10:46:44.331660+0000","last_unstale":"2024-09-14T12:01:32.702324+0000","last_undegraded":"2024-09-14T12:01:32.702324+0000","last_fullsized":"2024-09-14T12:01:32.702324+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'291","last_scrub_stamp":"2024-09-14T12:01:32.702040+0000","last_deep_scrub":"263'291","last_deep_scrub_stamp":"2024-09-14T12:01:32.702040+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.702040+0000","objects_scrubbed":9,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:26.595923+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":521,"num_read_kb":29638,"num_write":955,"num_write_kb":30451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:49.529666+0000","last_change":"2024-09-14T12:01:49.529598+0000","last_active":"2024-09-14T12:01:49.529666+0000","last_peered":"2024-09-14T12:01:49.529666+0000","last_clean":"2024-09-14T12:01:49.529666+0000","last_became_active":"2024-09-14T10:46:48.350072+0000","last_became_peered":"2024-09-14T10:46:48.350072+0000","last_unstale":"2024-09-14T12:01:49.529666+0000","last_undegraded":"2024-09-14T12:01:49.529666+0000","last_fullsized":"2024-09-14T12:01:49.529666+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:49.529513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:49.529513+0000","last_clean_scrub_stamp":"2024-09-14T12:01:49.529513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:28.315817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"263'132","reported_seq":685,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:00.836105+0000","last_change":"2024-09-14T12:02:00.836105+0000","last_active":"2024-09-14T12:02:00.836105+0000","last_peered":"2024-09-14T12:02:00.836105+0000","last_clean":"2024-09-14T12:02:00.836105+0000","last_became_active":"2024-09-14T10:46:50.367991+0000","last_became_peered":"2024-09-14T10:46:50.367991+0000","last_unstale":"2024-09-14T12:02:00.836105+0000","last_undegraded":"2024-09-14T12:02:00.836105+0000","last_fullsized":"2024-09-14T12:02:00.836105+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'132","last_scrub_stamp":"2024-09-14T12:02:00.835968+0000","last_deep_scrub":"263'132","last_deep_scrub_stamp":"2024-09-14T12:02:00.835968+0000","last_clean_scrub_stamp":"2024-09-14T12:02:00.835968+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:07.297080+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":126,"num_write":102,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"263'780","reported_seq":2696,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:48.218375+0000","last_change":"2024-09-14T12:01:48.218326+0000","last_active":"2024-09-14T12:01:48.218375+0000","last_peered":"2024-09-14T12:01:48.218375+0000","last_clean":"2024-09-14T12:01:48.218375+0000","last_became_active":"2024-09-14T10:46:52.370446+0000","last_became_peered":"2024-09-14T10:46:52.370446+0000","last_unstale":"2024-09-14T12:01:48.218375+0000","last_undegraded":"2024-09-14T12:01:48.218375+0000","last_fullsized":"2024-09-14T12:01:48.218375+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'780","last_scrub_stamp":"2024-09-14T12:01:48.218254+0000","last_deep_scrub":"263'780","last_deep_scrub_stamp":"2024-09-14T12:01:48.218254+0000","last_clean_scrub_stamp":"2024-09-14T12:01:48.218254+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:47.221639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"263'120","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.535812+0000","last_change":"2024-09-14T10:46:54.378096+0000","last_active":"2024-09-14T11:59:15.535812+0000","last_peered":"2024-09-14T11:59:15.535812+0000","last_clean":"2024-09-14T11:59:15.535812+0000","last_became_active":"2024-09-14T10:46:54.377788+0000","last_became_peered":"2024-09-14T10:46:54.377788+0000","last_unstale":"2024-09-14T11:59:15.535812+0000","last_undegraded":"2024-09-14T11:59:15.535812+0000","last_fullsized":"2024-09-14T11:59:15.535812+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":221,"num_read_kb":193,"num_write":312,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"263'792","reported_seq":2344,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.869824+0000","last_change":"2024-09-14T12:01:38.869721+0000","last_active":"2024-09-14T12:01:38.869824+0000","last_peered":"2024-09-14T12:01:38.869824+0000","last_clean":"2024-09-14T12:01:38.869824+0000","last_became_active":"2024-09-14T10:46:46.352087+0000","last_became_peered":"2024-09-14T10:46:46.352087+0000","last_unstale":"2024-09-14T12:01:38.869824+0000","last_undegraded":"2024-09-14T12:01:38.869824+0000","last_fullsized":"2024-09-14T12:01:38.869824+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'792","last_scrub_stamp":"2024-09-14T12:01:38.869609+0000","last_deep_scrub":"263'792","last_deep_scrub_stamp":"2024-09-14T12:01:38.869609+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.869609+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:26.016700+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3891,"num_read_kb":3520,"num_write":1035,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"263'316","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.681774+0000","last_change":"2024-09-14T12:01:27.681717+0000","last_active":"2024-09-14T12:01:27.681774+0000","last_peered":"2024-09-14T12:01:27.681774+0000","last_clean":"2024-09-14T12:01:27.681774+0000","last_became_active":"2024-09-14T10:46:44.320689+0000","last_became_peered":"2024-09-14T10:46:44.320689+0000","last_unstale":"2024-09-14T12:01:27.681774+0000","last_undegraded":"2024-09-14T12:01:27.681774+0000","last_fullsized":"2024-09-14T12:01:27.681774+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'316","last_scrub_stamp":"2024-09-14T12:01:27.681619+0000","last_deep_scrub":"263'316","last_deep_scrub_stamp":"2024-09-14T12:01:27.681619+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.681619+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:26.610212+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":532,"num_read_kb":954,"num_write":1107,"num_write_kb":21144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.691769+0000","last_change":"2024-09-14T12:01:40.691672+0000","last_active":"2024-09-14T12:01:40.691769+0000","last_peered":"2024-09-14T12:01:40.691769+0000","last_clean":"2024-09-14T12:01:40.691769+0000","last_became_active":"2024-09-14T10:46:48.357024+0000","last_became_peered":"2024-09-14T10:46:48.357024+0000","last_unstale":"2024-09-14T12:01:40.691769+0000","last_undegraded":"2024-09-14T12:01:40.691769+0000","last_fullsized":"2024-09-14T12:01:40.691769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:40.691553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:40.691553+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.691553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:20.398399+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"263'385","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:46.207002+0000","last_change":"2024-09-14T12:01:46.206932+0000","last_active":"2024-09-14T12:01:46.207002+0000","last_peered":"2024-09-14T12:01:46.207002+0000","last_clean":"2024-09-14T12:01:46.207002+0000","last_became_active":"2024-09-14T10:46:50.361962+0000","last_became_peered":"2024-09-14T10:46:50.361962+0000","last_unstale":"2024-09-14T12:01:46.207002+0000","last_undegraded":"2024-09-14T12:01:46.207002+0000","last_fullsized":"2024-09-14T12:01:46.207002+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'385","last_scrub_stamp":"2024-09-14T12:01:46.206822+0000","last_deep_scrub":"263'385","last_deep_scrub_stamp":"2024-09-14T12:01:46.206822+0000","last_clean_scrub_stamp":"2024-09-14T12:01:46.206822+0000","objects_scrubbed":8,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:07.450497+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49011,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":601,"num_read_kb":1340,"num_write":486,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:59.667395+0000","last_change":"2024-09-14T12:01:59.667395+0000","last_active":"2024-09-14T12:01:59.667395+0000","last_peered":"2024-09-14T12:01:59.667395+0000","last_clean":"2024-09-14T12:01:59.667395+0000","last_became_active":"2024-09-14T10:46:52.369262+0000","last_became_peered":"2024-09-14T10:46:52.369262+0000","last_unstale":"2024-09-14T12:01:59.667395+0000","last_undegraded":"2024-09-14T12:01:59.667395+0000","last_fullsized":"2024-09-14T12:01:59.667395+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:59.667313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:59.667313+0000","last_clean_scrub_stamp":"2024-09-14T12:01:59.667313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:13.006453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"263'149","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:49.662036+0000","last_change":"2024-09-14T12:01:49.661958+0000","last_active":"2024-09-14T12:01:49.662036+0000","last_peered":"2024-09-14T12:01:49.662036+0000","last_clean":"2024-09-14T12:01:49.662036+0000","last_became_active":"2024-09-14T10:46:54.385235+0000","last_became_peered":"2024-09-14T10:46:54.385235+0000","last_unstale":"2024-09-14T12:01:49.662036+0000","last_undegraded":"2024-09-14T12:01:49.662036+0000","last_fullsized":"2024-09-14T12:01:49.662036+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'149","last_scrub_stamp":"2024-09-14T12:01:49.661869+0000","last_deep_scrub":"263'149","last_deep_scrub_stamp":"2024-09-14T12:01:49.661869+0000","last_clean_scrub_stamp":"2024-09-14T12:01:49.661869+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:05.463904+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":187,"num_write":368,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"263'750","reported_seq":2318,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.864213+0000","last_change":"2024-09-14T12:01:36.864145+0000","last_active":"2024-09-14T12:01:36.864213+0000","last_peered":"2024-09-14T12:01:36.864213+0000","last_clean":"2024-09-14T12:01:36.864213+0000","last_became_active":"2024-09-14T10:46:46.335112+0000","last_became_peered":"2024-09-14T10:46:46.335112+0000","last_unstale":"2024-09-14T12:01:36.864213+0000","last_undegraded":"2024-09-14T12:01:36.864213+0000","last_fullsized":"2024-09-14T12:01:36.864213+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'750","last_scrub_stamp":"2024-09-14T12:01:36.864055+0000","last_deep_scrub":"263'750","last_deep_scrub_stamp":"2024-09-14T12:01:36.864055+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.864055+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:44.163046+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3755,"num_read_kb":3425,"num_write":989,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"263'322","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.760058+0000","last_change":"2024-09-14T12:01:34.759992+0000","last_active":"2024-09-14T12:01:34.760058+0000","last_peered":"2024-09-14T12:01:34.760058+0000","last_clean":"2024-09-14T12:01:34.760058+0000","last_became_active":"2024-09-14T10:46:44.332130+0000","last_became_peered":"2024-09-14T10:46:44.332130+0000","last_unstale":"2024-09-14T12:01:34.760058+0000","last_undegraded":"2024-09-14T12:01:34.760058+0000","last_fullsized":"2024-09-14T12:01:34.760058+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'322","last_scrub_stamp":"2024-09-14T12:01:34.759869+0000","last_deep_scrub":"263'322","last_deep_scrub_stamp":"2024-09-14T12:01:34.759869+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.759869+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:56.671464+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":584,"num_read_kb":32074,"num_write":1014,"num_write_kb":20757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.891909+0000","last_change":"2024-09-14T12:01:40.891826+0000","last_active":"2024-09-14T12:01:40.891909+0000","last_peered":"2024-09-14T12:01:40.891909+0000","last_clean":"2024-09-14T12:01:40.891909+0000","last_became_active":"2024-09-14T10:46:48.354108+0000","last_became_peered":"2024-09-14T10:46:48.354108+0000","last_unstale":"2024-09-14T12:01:40.891909+0000","last_undegraded":"2024-09-14T12:01:40.891909+0000","last_fullsized":"2024-09-14T12:01:40.891909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:40.891732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:40.891732+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.891732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:32.261695+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"263'275","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:55.604927+0000","last_change":"2024-09-14T12:01:55.604927+0000","last_active":"2024-09-14T12:01:55.604927+0000","last_peered":"2024-09-14T12:01:55.604927+0000","last_clean":"2024-09-14T12:01:55.604927+0000","last_became_active":"2024-09-14T10:46:50.358186+0000","last_became_peered":"2024-09-14T10:46:50.358186+0000","last_unstale":"2024-09-14T12:01:55.604927+0000","last_undegraded":"2024-09-14T12:01:55.604927+0000","last_fullsized":"2024-09-14T12:01:55.604927+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'275","last_scrub_stamp":"2024-09-14T12:01:55.604828+0000","last_deep_scrub":"263'275","last_deep_scrub_stamp":"2024-09-14T12:01:55.604828+0000","last_clean_scrub_stamp":"2024-09-14T12:01:55.604828+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:49.582183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46012,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":454,"num_read_kb":1061,"num_write":362,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:02.790850+0000","last_change":"2024-09-14T12:02:02.790850+0000","last_active":"2024-09-14T12:02:02.790850+0000","last_peered":"2024-09-14T12:02:02.790850+0000","last_clean":"2024-09-14T12:02:02.790850+0000","last_became_active":"2024-09-14T10:46:52.365736+0000","last_became_peered":"2024-09-14T10:46:52.365736+0000","last_unstale":"2024-09-14T12:02:02.790850+0000","last_undegraded":"2024-09-14T12:02:02.790850+0000","last_fullsized":"2024-09-14T12:02:02.790850+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:02.790754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:02.790754+0000","last_clean_scrub_stamp":"2024-09-14T12:02:02.790754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:29.657420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"263'125","reported_seq":648,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:03.170601+0000","last_change":"2024-09-14T12:02:03.170601+0000","last_active":"2024-09-14T12:02:03.170601+0000","last_peered":"2024-09-14T12:02:03.170601+0000","last_clean":"2024-09-14T12:02:03.170601+0000","last_became_active":"2024-09-14T10:46:54.384303+0000","last_became_peered":"2024-09-14T10:46:54.384303+0000","last_unstale":"2024-09-14T12:02:03.170601+0000","last_undegraded":"2024-09-14T12:02:03.170601+0000","last_fullsized":"2024-09-14T12:02:03.170601+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'125","last_scrub_stamp":"2024-09-14T12:02:03.170516+0000","last_deep_scrub":"263'125","last_deep_scrub_stamp":"2024-09-14T12:02:03.170516+0000","last_clean_scrub_stamp":"2024-09-14T12:02:03.170516+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:15.137603+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":957,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":145,"num_write":281,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"263'378","reported_seq":1802,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.141125+0000","last_change":"2024-09-14T12:01:32.141054+0000","last_active":"2024-09-14T12:01:32.141125+0000","last_peered":"2024-09-14T12:01:32.141125+0000","last_clean":"2024-09-14T12:01:32.141125+0000","last_became_active":"2024-09-14T10:46:46.338518+0000","last_became_peered":"2024-09-14T10:46:46.338518+0000","last_unstale":"2024-09-14T12:01:32.141125+0000","last_undegraded":"2024-09-14T12:01:32.141125+0000","last_fullsized":"2024-09-14T12:01:32.141125+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-14T12:01:32.140969+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-14T12:01:32.140969+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.140969+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:30.472756+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2070,"num_read_kb":1951,"num_write":457,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"263'362","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.372654+0000","last_change":"2024-09-14T12:01:30.372654+0000","last_active":"2024-09-14T12:01:30.372654+0000","last_peered":"2024-09-14T12:01:30.372654+0000","last_clean":"2024-09-14T12:01:30.372654+0000","last_became_active":"2024-09-14T10:46:44.332852+0000","last_became_peered":"2024-09-14T10:46:44.332852+0000","last_unstale":"2024-09-14T12:01:30.372654+0000","last_undegraded":"2024-09-14T12:01:30.372654+0000","last_fullsized":"2024-09-14T12:01:30.372654+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-14T12:01:30.372539+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-14T12:01:30.372539+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.372539+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:57.066912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":662,"num_read_kb":10749,"num_write":1220,"num_write_kb":43875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.676465+0000","last_change":"2024-09-14T12:01:41.676362+0000","last_active":"2024-09-14T12:01:41.676465+0000","last_peered":"2024-09-14T12:01:41.676465+0000","last_clean":"2024-09-14T12:01:41.676465+0000","last_became_active":"2024-09-14T10:46:48.355512+0000","last_became_peered":"2024-09-14T10:46:48.355512+0000","last_unstale":"2024-09-14T12:01:41.676465+0000","last_undegraded":"2024-09-14T12:01:41.676465+0000","last_fullsized":"2024-09-14T12:01:41.676465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:41.676262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:41.676262+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.676262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:42.505362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"263'267","reported_seq":838,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:49.850396+0000","last_change":"2024-09-14T12:01:49.850337+0000","last_active":"2024-09-14T12:01:49.850396+0000","last_peered":"2024-09-14T12:01:49.850396+0000","last_clean":"2024-09-14T12:01:49.850396+0000","last_became_active":"2024-09-14T10:46:50.364420+0000","last_became_peered":"2024-09-14T10:46:50.364420+0000","last_unstale":"2024-09-14T12:01:49.850396+0000","last_undegraded":"2024-09-14T12:01:49.850396+0000","last_fullsized":"2024-09-14T12:01:49.850396+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'267","last_scrub_stamp":"2024-09-14T12:01:49.850246+0000","last_deep_scrub":"263'267","last_deep_scrub_stamp":"2024-09-14T12:01:49.850246+0000","last_clean_scrub_stamp":"2024-09-14T12:01:49.850246+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:15.233761+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45284,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":455,"num_read_kb":1165,"num_write":378,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.537351+0000","last_change":"2024-09-14T10:46:52.374194+0000","last_active":"2024-09-14T11:59:25.537351+0000","last_peered":"2024-09-14T11:59:25.537351+0000","last_clean":"2024-09-14T11:59:25.537351+0000","last_became_active":"2024-09-14T10:46:52.373913+0000","last_became_peered":"2024-09-14T10:46:52.373913+0000","last_unstale":"2024-09-14T11:59:25.537351+0000","last_undegraded":"2024-09-14T11:59:25.537351+0000","last_fullsized":"2024-09-14T11:59:25.537351+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:51.349764+0000","last_clean_scrub_stamp":"2024-09-14T10:46:51.349764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"263'129","reported_seq":1231,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.826724+0000","last_change":"2024-09-14T10:46:54.383936+0000","last_active":"2024-09-14T11:59:30.826724+0000","last_peered":"2024-09-14T11:59:30.826724+0000","last_clean":"2024-09-14T11:59:30.826724+0000","last_became_active":"2024-09-14T10:46:54.383637+0000","last_became_peered":"2024-09-14T10:46:54.383637+0000","last_unstale":"2024-09-14T11:59:30.826724+0000","last_undegraded":"2024-09-14T11:59:30.826724+0000","last_fullsized":"2024-09-14T11:59:30.826724+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:46:53.361864+0000","last_clean_scrub_stamp":"2024-09-14T10:46:53.361864+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":738,"num_read_kb":738,"num_write":285,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"263'446","reported_seq":1913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.792550+0000","last_change":"2024-09-14T12:01:34.792489+0000","last_active":"2024-09-14T12:01:34.792550+0000","last_peered":"2024-09-14T12:01:34.792550+0000","last_clean":"2024-09-14T12:01:34.792550+0000","last_became_active":"2024-09-14T10:46:46.342299+0000","last_became_peered":"2024-09-14T10:46:46.342299+0000","last_unstale":"2024-09-14T12:01:34.792550+0000","last_undegraded":"2024-09-14T12:01:34.792550+0000","last_fullsized":"2024-09-14T12:01:34.792550+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'446","last_scrub_stamp":"2024-09-14T12:01:34.792381+0000","last_deep_scrub":"263'446","last_deep_scrub_stamp":"2024-09-14T12:01:34.792381+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.792381+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:14.733658+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2232,"num_read_kb":2089,"num_write":533,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"263'512","reported_seq":1273,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.363748+0000","last_change":"2024-09-14T12:01:31.363630+0000","last_active":"2024-09-14T12:01:31.363748+0000","last_peered":"2024-09-14T12:01:31.363748+0000","last_clean":"2024-09-14T12:01:31.363748+0000","last_became_active":"2024-09-14T10:46:44.320749+0000","last_became_peered":"2024-09-14T10:46:44.320749+0000","last_unstale":"2024-09-14T12:01:31.363748+0000","last_undegraded":"2024-09-14T12:01:31.363748+0000","last_fullsized":"2024-09-14T12:01:31.363748+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'512","last_scrub_stamp":"2024-09-14T12:01:31.363472+0000","last_deep_scrub":"263'512","last_deep_scrub_stamp":"2024-09-14T12:01:31.363472+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.363472+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:49.759769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1101,"num_read_kb":48118,"num_write":1530,"num_write_kb":57550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:48.548228+0000","last_change":"2024-09-14T12:01:48.548151+0000","last_active":"2024-09-14T12:01:48.548228+0000","last_peered":"2024-09-14T12:01:48.548228+0000","last_clean":"2024-09-14T12:01:48.548228+0000","last_became_active":"2024-09-14T10:46:48.352853+0000","last_became_peered":"2024-09-14T10:46:48.352853+0000","last_unstale":"2024-09-14T12:01:48.548228+0000","last_undegraded":"2024-09-14T12:01:48.548228+0000","last_fullsized":"2024-09-14T12:01:48.548228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:01:48.548073+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:01:48.548073+0000","last_clean_scrub_stamp":"2024-09-14T12:01:48.548073+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:39.485060+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"263'309","reported_seq":917,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:59.871705+0000","last_change":"2024-09-14T12:01:59.871705+0000","last_active":"2024-09-14T12:01:59.871705+0000","last_peered":"2024-09-14T12:01:59.871705+0000","last_clean":"2024-09-14T12:01:59.871705+0000","last_became_active":"2024-09-14T10:46:50.369492+0000","last_became_peered":"2024-09-14T10:46:50.369492+0000","last_unstale":"2024-09-14T12:01:59.871705+0000","last_undegraded":"2024-09-14T12:01:59.871705+0000","last_fullsized":"2024-09-14T12:01:59.871705+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'309","last_scrub_stamp":"2024-09-14T12:01:59.871529+0000","last_deep_scrub":"263'309","last_deep_scrub_stamp":"2024-09-14T12:01:59.871529+0000","last_clean_scrub_stamp":"2024-09-14T12:01:59.871529+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:44.228020+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49661,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":1034,"num_write":382,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:00.657215+0000","last_change":"2024-09-14T12:02:00.657215+0000","last_active":"2024-09-14T12:02:00.657215+0000","last_peered":"2024-09-14T12:02:00.657215+0000","last_clean":"2024-09-14T12:02:00.657215+0000","last_became_active":"2024-09-14T10:46:52.372108+0000","last_became_peered":"2024-09-14T10:46:52.372108+0000","last_unstale":"2024-09-14T12:02:00.657215+0000","last_undegraded":"2024-09-14T12:02:00.657215+0000","last_fullsized":"2024-09-14T12:02:00.657215+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:00.657130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:00.657130+0000","last_clean_scrub_stamp":"2024-09-14T12:02:00.657130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:12.133923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"263'128","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:50.220643+0000","last_change":"2024-09-14T12:01:50.220643+0000","last_active":"2024-09-14T12:01:50.220643+0000","last_peered":"2024-09-14T12:01:50.220643+0000","last_clean":"2024-09-14T12:01:50.220643+0000","last_became_active":"2024-09-14T10:46:54.384278+0000","last_became_peered":"2024-09-14T10:46:54.384278+0000","last_unstale":"2024-09-14T12:01:50.220643+0000","last_undegraded":"2024-09-14T12:01:50.220643+0000","last_fullsized":"2024-09-14T12:01:50.220643+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'128","last_scrub_stamp":"2024-09-14T12:01:50.220551+0000","last_deep_scrub":"263'128","last_deep_scrub_stamp":"2024-09-14T12:01:50.220551+0000","last_clean_scrub_stamp":"2024-09-14T12:01:50.220551+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:16.653583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":278,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"263'466","reported_seq":2044,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.585291+0000","last_change":"2024-09-14T12:01:40.585291+0000","last_active":"2024-09-14T12:01:40.585291+0000","last_peered":"2024-09-14T12:01:40.585291+0000","last_clean":"2024-09-14T12:01:40.585291+0000","last_became_active":"2024-09-14T10:46:46.346994+0000","last_became_peered":"2024-09-14T10:46:46.346994+0000","last_unstale":"2024-09-14T12:01:40.585291+0000","last_undegraded":"2024-09-14T12:01:40.585291+0000","last_fullsized":"2024-09-14T12:01:40.585291+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'466","last_scrub_stamp":"2024-09-14T12:01:40.585204+0000","last_deep_scrub":"263'466","last_deep_scrub_stamp":"2024-09-14T12:01:40.585204+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.585204+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:50.174388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2420,"num_read_kb":2273,"num_write":546,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"263'389","reported_seq":1154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.853039+0000","last_change":"2024-09-14T12:01:26.852936+0000","last_active":"2024-09-14T12:01:26.853039+0000","last_peered":"2024-09-14T12:01:26.853039+0000","last_clean":"2024-09-14T12:01:26.853039+0000","last_became_active":"2024-09-14T10:46:44.328946+0000","last_became_peered":"2024-09-14T10:46:44.328946+0000","last_unstale":"2024-09-14T12:01:26.853039+0000","last_undegraded":"2024-09-14T12:01:26.853039+0000","last_fullsized":"2024-09-14T12:01:26.853039+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-14T12:01:26.852803+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-14T12:01:26.852803+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.852803+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:56.352304+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1017,"num_read_kb":28148,"num_write":1233,"num_write_kb":43814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"263'510","reported_seq":2200,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.085089+0000","last_change":"2024-09-14T12:01:34.085089+0000","last_active":"2024-09-14T12:01:34.085089+0000","last_peered":"2024-09-14T12:01:34.085089+0000","last_clean":"2024-09-14T12:01:34.085089+0000","last_became_active":"2024-09-14T10:46:46.343234+0000","last_became_peered":"2024-09-14T10:46:46.343234+0000","last_unstale":"2024-09-14T12:01:34.085089+0000","last_undegraded":"2024-09-14T12:01:34.085089+0000","last_fullsized":"2024-09-14T12:01:34.085089+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'510","last_scrub_stamp":"2024-09-14T12:01:34.084985+0000","last_deep_scrub":"263'510","last_deep_scrub_stamp":"2024-09-14T12:01:34.084985+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.084985+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:57:06.583864+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2663,"num_read_kb":2506,"num_write":583,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"263'344","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.196756+0000","last_change":"2024-09-14T12:01:29.196652+0000","last_active":"2024-09-14T12:01:29.196756+0000","last_peered":"2024-09-14T12:01:29.196756+0000","last_clean":"2024-09-14T12:01:29.196756+0000","last_became_active":"2024-09-14T10:46:44.317349+0000","last_became_peered":"2024-09-14T10:46:44.317349+0000","last_unstale":"2024-09-14T12:01:29.196756+0000","last_undegraded":"2024-09-14T12:01:29.196756+0000","last_fullsized":"2024-09-14T12:01:29.196756+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'344","last_scrub_stamp":"2024-09-14T12:01:29.196487+0000","last_deep_scrub":"263'344","last_deep_scrub_stamp":"2024-09-14T12:01:29.196487+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.196487+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:30.071766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133675,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":5317,"num_write":990,"num_write_kb":25288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"263'451","reported_seq":2008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:48.854796+0000","last_change":"2024-09-14T12:01:48.854796+0000","last_active":"2024-09-14T12:01:48.854796+0000","last_peered":"2024-09-14T12:01:48.854796+0000","last_clean":"2024-09-14T12:01:48.854796+0000","last_became_active":"2024-09-14T10:46:46.346640+0000","last_became_peered":"2024-09-14T10:46:46.346640+0000","last_unstale":"2024-09-14T12:01:48.854796+0000","last_undegraded":"2024-09-14T12:01:48.854796+0000","last_fullsized":"2024-09-14T12:01:48.854796+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'451","last_scrub_stamp":"2024-09-14T12:01:48.854662+0000","last_deep_scrub":"263'451","last_deep_scrub_stamp":"2024-09-14T12:01:48.854662+0000","last_clean_scrub_stamp":"2024-09-14T12:01:48.854662+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:46.521384+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2347,"num_read_kb":2209,"num_write":542,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"263'346","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.774624+0000","last_change":"2024-09-14T12:01:35.774558+0000","last_active":"2024-09-14T12:01:35.774624+0000","last_peered":"2024-09-14T12:01:35.774624+0000","last_clean":"2024-09-14T12:01:35.774624+0000","last_became_active":"2024-09-14T10:46:44.328049+0000","last_became_peered":"2024-09-14T10:46:44.328049+0000","last_unstale":"2024-09-14T12:01:35.774624+0000","last_undegraded":"2024-09-14T12:01:35.774624+0000","last_fullsized":"2024-09-14T12:01:35.774624+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'346","last_scrub_stamp":"2024-09-14T12:01:35.774453+0000","last_deep_scrub":"263'346","last_deep_scrub_stamp":"2024-09-14T12:01:35.774453+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.774453+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:20.558053+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":619,"num_read_kb":2326,"num_write":1082,"num_write_kb":13442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"263'936","reported_seq":2742,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.297110+0000","last_change":"2024-09-14T12:01:44.297110+0000","last_active":"2024-09-14T12:01:44.297110+0000","last_peered":"2024-09-14T12:01:44.297110+0000","last_clean":"2024-09-14T12:01:44.297110+0000","last_became_active":"2024-09-14T10:46:46.346682+0000","last_became_peered":"2024-09-14T10:46:46.346682+0000","last_unstale":"2024-09-14T12:01:44.297110+0000","last_undegraded":"2024-09-14T12:01:44.297110+0000","last_fullsized":"2024-09-14T12:01:44.297110+0000","mapping_epoch":28,"log_start":"263'900","ondisk_log_start":"263'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'936","last_scrub_stamp":"2024-09-14T12:01:44.296996+0000","last_deep_scrub":"263'936","last_deep_scrub_stamp":"2024-09-14T12:01:44.296996+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.296996+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":900,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:52.496747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4656,"num_read_kb":4197,"num_write":1246,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"263'385","reported_seq":1072,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.363148+0000","last_change":"2024-09-14T12:01:32.363079+0000","last_active":"2024-09-14T12:01:32.363148+0000","last_peered":"2024-09-14T12:01:32.363148+0000","last_clean":"2024-09-14T12:01:32.363148+0000","last_became_active":"2024-09-14T10:47:19.040453+0000","last_became_peered":"2024-09-14T10:47:19.040453+0000","last_unstale":"2024-09-14T12:01:32.363148+0000","last_undegraded":"2024-09-14T12:01:32.363148+0000","last_fullsized":"2024-09-14T12:01:32.363148+0000","mapping_epoch":39,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'385","last_scrub_stamp":"2024-09-14T12:01:32.362951+0000","last_deep_scrub":"263'385","last_deep_scrub_stamp":"2024-09-14T12:01:32.362951+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.362951+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:26.035525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133711,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":707,"num_read_kb":25389,"num_write":1181,"num_write_kb":37274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"263'510","reported_seq":2219,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.299708+0000","last_change":"2024-09-14T12:01:43.299613+0000","last_active":"2024-09-14T12:01:43.299708+0000","last_peered":"2024-09-14T12:01:43.299708+0000","last_clean":"2024-09-14T12:01:43.299708+0000","last_became_active":"2024-09-14T10:46:46.349465+0000","last_became_peered":"2024-09-14T10:46:46.349465+0000","last_unstale":"2024-09-14T12:01:43.299708+0000","last_undegraded":"2024-09-14T12:01:43.299708+0000","last_fullsized":"2024-09-14T12:01:43.299708+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'510","last_scrub_stamp":"2024-09-14T12:01:43.299503+0000","last_deep_scrub":"263'510","last_deep_scrub_stamp":"2024-09-14T12:01:43.299503+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.299503+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:27.070133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2847,"num_read_kb":2662,"num_write":617,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"263'337","reported_seq":1053,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.848911+0000","last_change":"2024-09-14T12:01:27.848911+0000","last_active":"2024-09-14T12:01:27.848911+0000","last_peered":"2024-09-14T12:01:27.848911+0000","last_clean":"2024-09-14T12:01:27.848911+0000","last_became_active":"2024-09-14T10:46:44.320218+0000","last_became_peered":"2024-09-14T10:46:44.320218+0000","last_unstale":"2024-09-14T12:01:27.848911+0000","last_undegraded":"2024-09-14T12:01:27.848911+0000","last_fullsized":"2024-09-14T12:01:27.848911+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'337","last_scrub_stamp":"2024-09-14T12:01:27.848821+0000","last_deep_scrub":"263'337","last_deep_scrub_stamp":"2024-09-14T12:01:27.848821+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.848821+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:48.240608+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":866,"num_read_kb":10863,"num_write":1127,"num_write_kb":35921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"263'438","reported_seq":2120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.259005+0000","last_change":"2024-09-14T12:01:36.258935+0000","last_active":"2024-09-14T12:01:36.259005+0000","last_peered":"2024-09-14T12:01:36.259005+0000","last_clean":"2024-09-14T12:01:36.259005+0000","last_became_active":"2024-09-14T10:46:46.342206+0000","last_became_peered":"2024-09-14T10:46:46.342206+0000","last_unstale":"2024-09-14T12:01:36.259005+0000","last_undegraded":"2024-09-14T12:01:36.259005+0000","last_fullsized":"2024-09-14T12:01:36.259005+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'438","last_scrub_stamp":"2024-09-14T12:01:36.258840+0000","last_deep_scrub":"263'438","last_deep_scrub_stamp":"2024-09-14T12:01:36.258840+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.258840+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:55.906019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2469,"num_read_kb":2360,"num_write":494,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"263'464","reported_seq":1154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.798772+0000","last_change":"2024-09-14T12:01:29.798772+0000","last_active":"2024-09-14T12:01:29.798772+0000","last_peered":"2024-09-14T12:01:29.798772+0000","last_clean":"2024-09-14T12:01:29.798772+0000","last_became_active":"2024-09-14T10:46:44.314466+0000","last_became_peered":"2024-09-14T10:46:44.314466+0000","last_unstale":"2024-09-14T12:01:29.798772+0000","last_undegraded":"2024-09-14T12:01:29.798772+0000","last_fullsized":"2024-09-14T12:01:29.798772+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'464","last_scrub_stamp":"2024-09-14T12:01:29.798635+0000","last_deep_scrub":"263'464","last_deep_scrub_stamp":"2024-09-14T12:01:29.798635+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.798635+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:20.335848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":927,"num_read_kb":16042,"num_write":1243,"num_write_kb":34508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"263'667","reported_seq":2297,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.818090+0000","last_change":"2024-09-14T12:01:39.818030+0000","last_active":"2024-09-14T12:01:39.818090+0000","last_peered":"2024-09-14T12:01:39.818090+0000","last_clean":"2024-09-14T12:01:39.818090+0000","last_became_active":"2024-09-14T10:46:46.342217+0000","last_became_peered":"2024-09-14T10:46:46.342217+0000","last_unstale":"2024-09-14T12:01:39.818090+0000","last_undegraded":"2024-09-14T12:01:39.818090+0000","last_fullsized":"2024-09-14T12:01:39.818090+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'667","last_scrub_stamp":"2024-09-14T12:01:39.817940+0000","last_deep_scrub":"263'667","last_deep_scrub_stamp":"2024-09-14T12:01:39.817940+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.817940+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":600,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:34.611710+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3344,"num_read_kb":3009,"num_write":894,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"263'322","reported_seq":1072,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.858345+0000","last_change":"2024-09-14T12:01:28.858345+0000","last_active":"2024-09-14T12:01:28.858345+0000","last_peered":"2024-09-14T12:01:28.858345+0000","last_clean":"2024-09-14T12:01:28.858345+0000","last_became_active":"2024-09-14T10:46:44.323339+0000","last_became_peered":"2024-09-14T10:46:44.323339+0000","last_unstale":"2024-09-14T12:01:28.858345+0000","last_undegraded":"2024-09-14T12:01:28.858345+0000","last_fullsized":"2024-09-14T12:01:28.858345+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'322","last_scrub_stamp":"2024-09-14T12:01:28.858232+0000","last_deep_scrub":"263'322","last_deep_scrub_stamp":"2024-09-14T12:01:28.858232+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.858232+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:01.869819+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":616,"num_read_kb":14372,"num_write":932,"num_write_kb":14595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'445","reported_seq":1986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.723012+0000","last_change":"2024-09-14T12:01:31.722923+0000","last_active":"2024-09-14T12:01:31.723012+0000","last_peered":"2024-09-14T12:01:31.723012+0000","last_clean":"2024-09-14T12:01:31.723012+0000","last_became_active":"2024-09-14T10:46:46.341731+0000","last_became_peered":"2024-09-14T10:46:46.341731+0000","last_unstale":"2024-09-14T12:01:31.723012+0000","last_undegraded":"2024-09-14T12:01:31.723012+0000","last_fullsized":"2024-09-14T12:01:31.723012+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'445","last_scrub_stamp":"2024-09-14T12:01:31.722836+0000","last_deep_scrub":"263'445","last_deep_scrub_stamp":"2024-09-14T12:01:31.722836+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.722836+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:48.676362+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2390,"num_read_kb":2239,"num_write":538,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"263'379","reported_seq":1098,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.300705+0000","last_change":"2024-09-14T12:01:34.300705+0000","last_active":"2024-09-14T12:01:34.300705+0000","last_peered":"2024-09-14T12:01:34.300705+0000","last_clean":"2024-09-14T12:01:34.300705+0000","last_became_active":"2024-09-14T10:46:44.321604+0000","last_became_peered":"2024-09-14T10:46:44.321604+0000","last_unstale":"2024-09-14T12:01:34.300705+0000","last_undegraded":"2024-09-14T12:01:34.300705+0000","last_fullsized":"2024-09-14T12:01:34.300705+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'379","last_scrub_stamp":"2024-09-14T12:01:34.300564+0000","last_deep_scrub":"263'379","last_deep_scrub_stamp":"2024-09-14T12:01:34.300564+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.300564+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:20.332645+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":797,"num_read_kb":33592,"num_write":1248,"num_write_kb":22096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"263'972","reported_seq":2689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.009007+0000","last_change":"2024-09-14T12:01:40.009007+0000","last_active":"2024-09-14T12:01:40.009007+0000","last_peered":"2024-09-14T12:01:40.009007+0000","last_clean":"2024-09-14T12:01:40.009007+0000","last_became_active":"2024-09-14T10:46:46.336508+0000","last_became_peered":"2024-09-14T10:46:46.336508+0000","last_unstale":"2024-09-14T12:01:40.009007+0000","last_undegraded":"2024-09-14T12:01:40.009007+0000","last_fullsized":"2024-09-14T12:01:40.009007+0000","mapping_epoch":28,"log_start":"263'900","ondisk_log_start":"263'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'972","last_scrub_stamp":"2024-09-14T12:01:40.008921+0000","last_deep_scrub":"263'972","last_deep_scrub_stamp":"2024-09-14T12:01:40.008921+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.008921+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":900,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:56.378084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4671,"num_read_kb":4174,"num_write":1327,"num_write_kb":556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"263'317","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.711783+0000","last_change":"2024-09-14T12:01:38.711783+0000","last_active":"2024-09-14T12:01:38.711783+0000","last_peered":"2024-09-14T12:01:38.711783+0000","last_clean":"2024-09-14T12:01:38.711783+0000","last_became_active":"2024-09-14T10:46:44.321073+0000","last_became_peered":"2024-09-14T10:46:44.321073+0000","last_unstale":"2024-09-14T12:01:38.711783+0000","last_undegraded":"2024-09-14T12:01:38.711783+0000","last_fullsized":"2024-09-14T12:01:38.711783+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-14T12:01:38.711668+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-14T12:01:38.711668+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.711668+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:25.942500+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":672,"num_read_kb":7284,"num_write":1109,"num_write_kb":7346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"263'355","reported_seq":1815,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.294986+0000","last_change":"2024-09-14T12:01:37.294986+0000","last_active":"2024-09-14T12:01:37.294986+0000","last_peered":"2024-09-14T12:01:37.294986+0000","last_clean":"2024-09-14T12:01:37.294986+0000","last_became_active":"2024-09-14T10:46:46.341188+0000","last_became_peered":"2024-09-14T10:46:46.341188+0000","last_unstale":"2024-09-14T12:01:37.294986+0000","last_undegraded":"2024-09-14T12:01:37.294986+0000","last_fullsized":"2024-09-14T12:01:37.294986+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'355","last_scrub_stamp":"2024-09-14T12:01:37.294901+0000","last_deep_scrub":"263'355","last_deep_scrub_stamp":"2024-09-14T12:01:37.294901+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.294901+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:47.263774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1965,"num_read_kb":1883,"num_write":389,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"263'399","reported_seq":1067,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.336267+0000","last_change":"2024-09-14T12:01:33.336267+0000","last_active":"2024-09-14T12:01:33.336267+0000","last_peered":"2024-09-14T12:01:33.336267+0000","last_clean":"2024-09-14T12:01:33.336267+0000","last_became_active":"2024-09-14T10:46:44.316633+0000","last_became_peered":"2024-09-14T10:46:44.316633+0000","last_unstale":"2024-09-14T12:01:33.336267+0000","last_undegraded":"2024-09-14T12:01:33.336267+0000","last_fullsized":"2024-09-14T12:01:33.336267+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'399","last_scrub_stamp":"2024-09-14T12:01:33.336171+0000","last_deep_scrub":"263'399","last_deep_scrub_stamp":"2024-09-14T12:01:33.336171+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.336171+0000","objects_scrubbed":5,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:15.311699+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":793,"num_read_kb":2329,"num_write":1224,"num_write_kb":27267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"263'782","reported_seq":2444,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.342520+0000","last_change":"2024-09-14T12:01:45.342520+0000","last_active":"2024-09-14T12:01:45.342520+0000","last_peered":"2024-09-14T12:01:45.342520+0000","last_clean":"2024-09-14T12:01:45.342520+0000","last_became_active":"2024-09-14T10:46:46.347941+0000","last_became_peered":"2024-09-14T10:46:46.347941+0000","last_unstale":"2024-09-14T12:01:45.342520+0000","last_undegraded":"2024-09-14T12:01:45.342520+0000","last_fullsized":"2024-09-14T12:01:45.342520+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'782","last_scrub_stamp":"2024-09-14T12:01:45.342399+0000","last_deep_scrub":"263'782","last_deep_scrub_stamp":"2024-09-14T12:01:45.342399+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.342399+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:29.700684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3936,"num_read_kb":3604,"num_write":1011,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"263'350","reported_seq":1120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.684970+0000","last_change":"2024-09-14T12:01:28.684970+0000","last_active":"2024-09-14T12:01:28.684970+0000","last_peered":"2024-09-14T12:01:28.684970+0000","last_clean":"2024-09-14T12:01:28.684970+0000","last_became_active":"2024-09-14T10:46:44.322149+0000","last_became_peered":"2024-09-14T10:46:44.322149+0000","last_unstale":"2024-09-14T12:01:28.684970+0000","last_undegraded":"2024-09-14T12:01:28.684970+0000","last_fullsized":"2024-09-14T12:01:28.684970+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-14T12:01:28.684867+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-14T12:01:28.684867+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.684867+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:58.788732+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":929,"num_read_kb":38620,"num_write":1197,"num_write_kb":16629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"263'793","reported_seq":2354,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.706954+0000","last_change":"2024-09-14T12:01:33.706954+0000","last_active":"2024-09-14T12:01:33.706954+0000","last_peered":"2024-09-14T12:01:33.706954+0000","last_clean":"2024-09-14T12:01:33.706954+0000","last_became_active":"2024-09-14T10:46:46.340475+0000","last_became_peered":"2024-09-14T10:46:46.340475+0000","last_unstale":"2024-09-14T12:01:33.706954+0000","last_undegraded":"2024-09-14T12:01:33.706954+0000","last_fullsized":"2024-09-14T12:01:33.706954+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'793","last_scrub_stamp":"2024-09-14T12:01:33.706869+0000","last_deep_scrub":"263'793","last_deep_scrub_stamp":"2024-09-14T12:01:33.706869+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.706869+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:55.128887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3820,"num_read_kb":3456,"num_write":1020,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"263'314","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.690051+0000","last_change":"2024-09-14T12:01:33.690051+0000","last_active":"2024-09-14T12:01:33.690051+0000","last_peered":"2024-09-14T12:01:33.690051+0000","last_clean":"2024-09-14T12:01:33.690051+0000","last_became_active":"2024-09-14T10:46:44.329386+0000","last_became_peered":"2024-09-14T10:46:44.329386+0000","last_unstale":"2024-09-14T12:01:33.690051+0000","last_undegraded":"2024-09-14T12:01:33.690051+0000","last_fullsized":"2024-09-14T12:01:33.690051+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'314","last_scrub_stamp":"2024-09-14T12:01:33.689906+0000","last_deep_scrub":"263'314","last_deep_scrub_stamp":"2024-09-14T12:01:33.689906+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.689906+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:13.669972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133721,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":628,"num_read_kb":13742,"num_write":1168,"num_write_kb":24265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"263'490","reported_seq":2197,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.754429+0000","last_change":"2024-09-14T12:01:32.754429+0000","last_active":"2024-09-14T12:01:32.754429+0000","last_peered":"2024-09-14T12:01:32.754429+0000","last_clean":"2024-09-14T12:01:32.754429+0000","last_became_active":"2024-09-14T10:46:46.351291+0000","last_became_peered":"2024-09-14T10:46:46.351291+0000","last_unstale":"2024-09-14T12:01:32.754429+0000","last_undegraded":"2024-09-14T12:01:32.754429+0000","last_fullsized":"2024-09-14T12:01:32.754429+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'490","last_scrub_stamp":"2024-09-14T12:01:32.754339+0000","last_deep_scrub":"263'490","last_deep_scrub_stamp":"2024-09-14T12:01:32.754339+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.754339+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:32.023682+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2678,"num_read_kb":2537,"num_write":593,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":894,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"263'343","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.241182+0000","last_change":"2024-09-14T12:01:31.241182+0000","last_active":"2024-09-14T12:01:31.241182+0000","last_peered":"2024-09-14T12:01:31.241182+0000","last_clean":"2024-09-14T12:01:31.241182+0000","last_became_active":"2024-09-14T10:46:44.328509+0000","last_became_peered":"2024-09-14T10:46:44.328509+0000","last_unstale":"2024-09-14T12:01:31.241182+0000","last_undegraded":"2024-09-14T12:01:31.241182+0000","last_fullsized":"2024-09-14T12:01:31.241182+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-14T12:01:31.241061+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-14T12:01:31.241061+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.241061+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:17.044831+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":629,"num_read_kb":8535,"num_write":1026,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"263'632","reported_seq":2315,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.069205+0000","last_change":"2024-09-14T12:01:36.069205+0000","last_active":"2024-09-14T12:01:36.069205+0000","last_peered":"2024-09-14T12:01:36.069205+0000","last_clean":"2024-09-14T12:01:36.069205+0000","last_became_active":"2024-09-14T10:46:46.343264+0000","last_became_peered":"2024-09-14T10:46:46.343264+0000","last_unstale":"2024-09-14T12:01:36.069205+0000","last_undegraded":"2024-09-14T12:01:36.069205+0000","last_fullsized":"2024-09-14T12:01:36.069205+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'632","last_scrub_stamp":"2024-09-14T12:01:36.069122+0000","last_deep_scrub":"263'632","last_deep_scrub_stamp":"2024-09-14T12:01:36.069122+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.069122+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":600,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:42.345376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3383,"num_read_kb":3097,"num_write":846,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"263'340","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.726684+0000","last_change":"2024-09-14T12:01:37.726684+0000","last_active":"2024-09-14T12:01:37.726684+0000","last_peered":"2024-09-14T12:01:37.726684+0000","last_clean":"2024-09-14T12:01:37.726684+0000","last_became_active":"2024-09-14T10:46:44.334832+0000","last_became_peered":"2024-09-14T10:46:44.334832+0000","last_unstale":"2024-09-14T12:01:37.726684+0000","last_undegraded":"2024-09-14T12:01:37.726684+0000","last_fullsized":"2024-09-14T12:01:37.726684+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-14T12:01:37.726545+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-14T12:01:37.726545+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.726545+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:30.213654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":614,"num_read_kb":31835,"num_write":1126,"num_write_kb":37799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"263'1874","reported_seq":3540,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.633710+0000","last_change":"2024-09-14T12:01:39.633710+0000","last_active":"2024-09-14T12:01:39.633710+0000","last_peered":"2024-09-14T12:01:39.633710+0000","last_clean":"2024-09-14T12:01:39.633710+0000","last_became_active":"2024-09-14T10:46:46.344246+0000","last_became_peered":"2024-09-14T10:46:46.344246+0000","last_unstale":"2024-09-14T12:01:39.633710+0000","last_undegraded":"2024-09-14T12:01:39.633710+0000","last_fullsized":"2024-09-14T12:01:39.633710+0000","mapping_epoch":28,"log_start":"263'1800","ondisk_log_start":"263'1800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1874","last_scrub_stamp":"2024-09-14T12:01:39.633604+0000","last_deep_scrub":"263'1874","last_deep_scrub_stamp":"2024-09-14T12:01:39.633604+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.633604+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":1800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:47.360631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8234,"num_read_kb":7178,"num_write":2635,"num_write_kb":1169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"263'380","reported_seq":1034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.159937+0000","last_change":"2024-09-14T12:01:30.159937+0000","last_active":"2024-09-14T12:01:30.159937+0000","last_peered":"2024-09-14T12:01:30.159937+0000","last_clean":"2024-09-14T12:01:30.159937+0000","last_became_active":"2024-09-14T10:46:44.331468+0000","last_became_peered":"2024-09-14T10:46:44.331468+0000","last_unstale":"2024-09-14T12:01:30.159937+0000","last_undegraded":"2024-09-14T12:01:30.159937+0000","last_fullsized":"2024-09-14T12:01:30.159937+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'380","last_scrub_stamp":"2024-09-14T12:01:30.159811+0000","last_deep_scrub":"263'380","last_deep_scrub_stamp":"2024-09-14T12:01:30.159811+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.159811+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:37.605807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":628,"num_read_kb":40986,"num_write":1142,"num_write_kb":50458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"263'599","reported_seq":2264,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.678606+0000","last_change":"2024-09-14T12:01:34.678606+0000","last_active":"2024-09-14T12:01:34.678606+0000","last_peered":"2024-09-14T12:01:34.678606+0000","last_clean":"2024-09-14T12:01:34.678606+0000","last_became_active":"2024-09-14T10:46:46.351379+0000","last_became_peered":"2024-09-14T10:46:46.351379+0000","last_unstale":"2024-09-14T12:01:34.678606+0000","last_undegraded":"2024-09-14T12:01:34.678606+0000","last_fullsized":"2024-09-14T12:01:34.678606+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'599","last_scrub_stamp":"2024-09-14T12:01:34.678513+0000","last_deep_scrub":"263'599","last_deep_scrub_stamp":"2024-09-14T12:01:34.678513+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.678513+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:37.519527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3319,"num_read_kb":3081,"num_write":803,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"263'409","reported_seq":1135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.821200+0000","last_change":"2024-09-14T12:01:31.821133+0000","last_active":"2024-09-14T12:01:31.821200+0000","last_peered":"2024-09-14T12:01:31.821200+0000","last_clean":"2024-09-14T12:01:31.821200+0000","last_became_active":"2024-09-14T10:47:18.421420+0000","last_became_peered":"2024-09-14T10:47:18.421420+0000","last_unstale":"2024-09-14T12:01:31.821200+0000","last_undegraded":"2024-09-14T12:01:31.821200+0000","last_fullsized":"2024-09-14T12:01:31.821200+0000","mapping_epoch":39,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'409","last_scrub_stamp":"2024-09-14T12:01:31.821006+0000","last_deep_scrub":"263'409","last_deep_scrub_stamp":"2024-09-14T12:01:31.821006+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.821006+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:29.377483+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1006,"num_read_kb":55242,"num_write":1376,"num_write_kb":21886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.30","version":"263'358","reported_seq":1068,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.667671+0000","last_change":"2024-09-14T12:01:39.667671+0000","last_active":"2024-09-14T12:01:39.667671+0000","last_peered":"2024-09-14T12:01:39.667671+0000","last_clean":"2024-09-14T12:01:39.667671+0000","last_became_active":"2024-09-14T10:46:44.336397+0000","last_became_peered":"2024-09-14T10:46:44.336397+0000","last_unstale":"2024-09-14T12:01:39.667671+0000","last_undegraded":"2024-09-14T12:01:39.667671+0000","last_fullsized":"2024-09-14T12:01:39.667671+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-09-14T12:01:39.667554+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-09-14T12:01:39.667554+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.667554+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:53.690379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":768,"num_read_kb":58312,"num_write":1211,"num_write_kb":50973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"263'439","reported_seq":2133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.593963+0000","last_change":"2024-09-14T12:01:41.593906+0000","last_active":"2024-09-14T12:01:41.593963+0000","last_peered":"2024-09-14T12:01:41.593963+0000","last_clean":"2024-09-14T12:01:41.593963+0000","last_became_active":"2024-09-14T10:46:46.352396+0000","last_became_peered":"2024-09-14T10:46:46.352396+0000","last_unstale":"2024-09-14T12:01:41.593963+0000","last_undegraded":"2024-09-14T12:01:41.593963+0000","last_fullsized":"2024-09-14T12:01:41.593963+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'439","last_scrub_stamp":"2024-09-14T12:01:41.593806+0000","last_deep_scrub":"263'439","last_deep_scrub_stamp":"2024-09-14T12:01:41.593806+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.593806+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:50.381664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2667,"num_read_kb":2535,"num_write":508,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2571,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"263'294","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.295648+0000","last_change":"2024-09-14T12:01:35.295648+0000","last_active":"2024-09-14T12:01:35.295648+0000","last_peered":"2024-09-14T12:01:35.295648+0000","last_clean":"2024-09-14T12:01:35.295648+0000","last_became_active":"2024-09-14T10:46:44.331494+0000","last_became_peered":"2024-09-14T10:46:44.331494+0000","last_unstale":"2024-09-14T12:01:35.295648+0000","last_undegraded":"2024-09-14T12:01:35.295648+0000","last_fullsized":"2024-09-14T12:01:35.295648+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-14T12:01:35.295543+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-14T12:01:35.295543+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.295543+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:19.923292+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048962,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":471,"num_read_kb":43363,"num_write":903,"num_write_kb":33511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"263'474","reported_seq":1984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.684079+0000","last_change":"2024-09-14T12:01:38.684020+0000","last_active":"2024-09-14T12:01:38.684079+0000","last_peered":"2024-09-14T12:01:38.684079+0000","last_clean":"2024-09-14T12:01:38.684079+0000","last_became_active":"2024-09-14T10:46:46.339440+0000","last_became_peered":"2024-09-14T10:46:46.339440+0000","last_unstale":"2024-09-14T12:01:38.684079+0000","last_undegraded":"2024-09-14T12:01:38.684079+0000","last_fullsized":"2024-09-14T12:01:38.684079+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'474","last_scrub_stamp":"2024-09-14T12:01:38.683932+0000","last_deep_scrub":"263'474","last_deep_scrub_stamp":"2024-09-14T12:01:38.683932+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.683932+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:27.526192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2508,"num_read_kb":2330,"num_write":579,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9256,"num_read_kb":6632,"num_write":2794,"num_write_kb":850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":943,"ondisk_log_size":943,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15505,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":15201,"num_read_kb":14853,"num_write":17064,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2690,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1661,"ondisk_log_size":1661,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":560,"ondisk_log_size":560,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1549008,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":19140,"num_read_kb":39857,"num_write":16035,"num_write_kb":12077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":712010,"num_omap_keys":1620,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1845,"ondisk_log_size":1845,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2425,"num_read_kb":2892,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":218145,"num_read_kb":199614,"num_write":55573,"num_write_kb":18950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35771,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4139,"ondisk_log_size":4139,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":30929583,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":44270,"num_read_kb":1895605,"num_write":71703,"num_write_kb":2068626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":47898624,"data_stored":47898624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3414,"ondisk_log_size":3414,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":184539,"num_write":157,"num_write_kb":126109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":184485,"num_write":157,"num_write_kb":126109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510355,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":225012,"kb_used_data":9252,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":94146828,"statfs":{"total":96636764160,"available":96406351872,"internally_reserved":0,"allocated":9474048,"data_stored":7497795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":220920266},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510354,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":205024,"kb_used_data":11472,"kb_used_omap":1,"kb_used_meta":193534,"kb_avail":94166816,"statfs":{"total":96636764160,"available":96426819584,"internally_reserved":0,"allocated":11747328,"data_stored":9764047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":198179269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510354,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243888,"kb_used_data":14176,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94127952,"statfs":{"total":96636764160,"available":96387022848,"internally_reserved":0,"allocated":14516224,"data_stored":12527301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510354,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127356,"kb_used_data":10092,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94244484,"statfs":{"total":96636764160,"available":96506351616,"internally_reserved":0,"allocated":10334208,"data_stored":8364267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510353,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":324468,"kb_used_data":10084,"kb_used_omap":1,"kb_used_meta":314366,"kb_avail":94047372,"statfs":{"total":96636764160,"available":96304508928,"internally_reserved":0,"allocated":10326016,"data_stored":8344841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":321911237},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510353,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116236,"kb_used_data":8700,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94255604,"statfs":{"total":96636764160,"available":96517738496,"internally_reserved":0,"allocated":8908800,"data_stored":6901467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543056,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137180,"kb_used_data":7500,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94234660,"statfs":{"total":96636764160,"available":96496291840,"internally_reserved":0,"allocated":7680000,"data_stored":5672286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132774343},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575762,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":283548,"kb_used_data":9420,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94088292,"statfs":{"total":96636764160,"available":96346411008,"internally_reserved":0,"allocated":9646080,"data_stored":7654490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4694016,"data_stored":4694016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5550080,"data_stored":5550080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6160384,"data_stored":6160384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10321920,"data_stored":10321920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7557120,"data_stored":7557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4857856,"data_stored":4857856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3465216,"data_stored":3465216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5292032,"data_stored":5292032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:02:08.493 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.493 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.494 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.494 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.494 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.494 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.494 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.494 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.494 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.495 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.495 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.495 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.495 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.495 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.495 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.495 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.495 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.496 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.496 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.496 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.496 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.496 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.496 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.496 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.496 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.497 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.497 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.497 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.497 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.497 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.497 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.497 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.497 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.497 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.498 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.498 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.498 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.498 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.498 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.498 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.498 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.498 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.498 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.499 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.499 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.499 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.499 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.499 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.499 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.500 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.500 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.500 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.500 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.500 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.500 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.500 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.500 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.501 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.501 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.501 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.501 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.501 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.501 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.501 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.501 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.502 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.502 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.502 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.502 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:06:40.890863+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.502 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:02:33.850927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=2, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.502 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.504 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.505 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.505 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.505 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.505 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T10:46:51.349764+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.505 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T10:46:53.361864+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=46, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:08.506 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T12:02:28.507 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:02:28.862 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T12:02:28.873 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-14T12:02:28.875 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":2537,"stamp":"2024-09-14T12:02:27.055100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":33086276,"num_objects":745,"num_object_clones":0,"num_object_copies":1770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":745,"num_whiteouts":0,"num_read":308787,"num_read_kb":2528544,"num_write":163626,"num_write_kb":2359360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":751599,"num_omap_keys":1793,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12881,"ondisk_log_size":12881,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1662712,"kb_used_data":80696,"kb_used_omap":12,"kb_used_meta":1581875,"kb_avail":753312008,"statfs":{"total":773094113280,"available":771391496192,"internally_reserved":0,"allocated":82632704,"data_stored":66726494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1619840561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005341"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:03.257683+0000","last_change":"2024-09-14T12:02:03.257683+0000","last_active":"2024-09-14T12:02:03.257683+0000","last_peered":"2024-09-14T12:02:03.257683+0000","last_clean":"2024-09-14T12:02:03.257683+0000","last_became_active":"2024-09-14T11:25:20.212282+0000","last_became_peered":"2024-09-14T11:25:20.212282+0000","last_unstale":"2024-09-14T12:02:03.257683+0000","last_undegraded":"2024-09-14T12:02:03.257683+0000","last_fullsized":"2024-09-14T12:02:03.257683+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:03.257592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:03.257592+0000","last_clean_scrub_stamp":"2024-09-14T12:02:03.257592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:34.271743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:00.646533+0000","last_change":"2024-09-14T12:02:00.646533+0000","last_active":"2024-09-14T12:02:00.646533+0000","last_peered":"2024-09-14T12:02:00.646533+0000","last_clean":"2024-09-14T12:02:00.646533+0000","last_became_active":"2024-09-14T11:06:45.982702+0000","last_became_peered":"2024-09-14T11:06:45.982702+0000","last_unstale":"2024-09-14T12:02:00.646533+0000","last_undegraded":"2024-09-14T12:02:00.646533+0000","last_fullsized":"2024-09-14T12:02:00.646533+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:02:00.646437+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:02:00.646437+0000","last_clean_scrub_stamp":"2024-09-14T12:02:00.646437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:31.012809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:04.124732+0000","last_change":"2024-09-14T12:02:04.124732+0000","last_active":"2024-09-14T12:02:04.124732+0000","last_peered":"2024-09-14T12:02:04.124732+0000","last_clean":"2024-09-14T12:02:04.124732+0000","last_became_active":"2024-09-14T11:06:41.918259+0000","last_became_peered":"2024-09-14T11:06:41.918259+0000","last_unstale":"2024-09-14T12:02:04.124732+0000","last_undegraded":"2024-09-14T12:02:04.124732+0000","last_fullsized":"2024-09-14T12:02:04.124732+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:04.124640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:04.124640+0000","last_clean_scrub_stamp":"2024-09-14T12:02:04.124640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:50.520541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'53","reported_seq":212,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:08.563843+0000","last_change":"2024-09-14T12:02:08.563843+0000","last_active":"2024-09-14T12:02:08.563843+0000","last_peered":"2024-09-14T12:02:08.563843+0000","last_clean":"2024-09-14T12:02:08.563843+0000","last_became_active":"2024-09-14T11:02:34.872682+0000","last_became_peered":"2024-09-14T11:02:34.872682+0000","last_unstale":"2024-09-14T12:02:08.563843+0000","last_undegraded":"2024-09-14T12:02:08.563843+0000","last_fullsized":"2024-09-14T12:02:08.563843+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'53","last_scrub_stamp":"2024-09-14T12:02:08.563752+0000","last_deep_scrub":"263'53","last_deep_scrub_stamp":"2024-09-14T12:02:08.563752+0000","last_clean_scrub_stamp":"2024-09-14T12:02:08.563752+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:29.948023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":419,"num_read_kb":273,"num_write":133,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:10.837755+0000","last_change":"2024-09-14T12:02:10.837755+0000","last_active":"2024-09-14T12:02:10.837755+0000","last_peered":"2024-09-14T12:02:10.837755+0000","last_clean":"2024-09-14T12:02:10.837755+0000","last_became_active":"2024-09-14T11:25:20.206601+0000","last_became_peered":"2024-09-14T11:25:20.206601+0000","last_unstale":"2024-09-14T12:02:10.837755+0000","last_undegraded":"2024-09-14T12:02:10.837755+0000","last_fullsized":"2024-09-14T12:02:10.837755+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:10.837661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:10.837661+0000","last_clean_scrub_stamp":"2024-09-14T12:02:10.837661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:47:21.773563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"263'13","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:05.990919+0000","last_change":"2024-09-14T12:02:05.990919+0000","last_active":"2024-09-14T12:02:05.990919+0000","last_peered":"2024-09-14T12:02:05.990919+0000","last_clean":"2024-09-14T12:02:05.990919+0000","last_became_active":"2024-09-14T11:06:45.992612+0000","last_became_peered":"2024-09-14T11:06:45.992612+0000","last_unstale":"2024-09-14T12:02:05.990919+0000","last_undegraded":"2024-09-14T12:02:05.990919+0000","last_fullsized":"2024-09-14T12:02:05.990919+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-14T12:02:05.990829+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-14T12:02:05.990829+0000","last_clean_scrub_stamp":"2024-09-14T12:02:05.990829+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:27.981820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13883,"num_write":28,"num_write_kb":14907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"263'4","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:09.076743+0000","last_change":"2024-09-14T12:02:09.076743+0000","last_active":"2024-09-14T12:02:09.076743+0000","last_peered":"2024-09-14T12:02:09.076743+0000","last_clean":"2024-09-14T12:02:09.076743+0000","last_became_active":"2024-09-14T11:06:41.911807+0000","last_became_peered":"2024-09-14T11:06:41.911807+0000","last_unstale":"2024-09-14T12:02:09.076743+0000","last_undegraded":"2024-09-14T12:02:09.076743+0000","last_fullsized":"2024-09-14T12:02:09.076743+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:02:09.076648+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:02:09.076648+0000","last_clean_scrub_stamp":"2024-09-14T12:02:09.076648+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:20.151261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":621,"num_write":4,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"263'41","reported_seq":180,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:06.642757+0000","last_change":"2024-09-14T12:02:06.642757+0000","last_active":"2024-09-14T12:02:06.642757+0000","last_peered":"2024-09-14T12:02:06.642757+0000","last_clean":"2024-09-14T12:02:06.642757+0000","last_became_active":"2024-09-14T11:02:34.879272+0000","last_became_peered":"2024-09-14T11:02:34.879272+0000","last_unstale":"2024-09-14T12:02:06.642757+0000","last_undegraded":"2024-09-14T12:02:06.642757+0000","last_fullsized":"2024-09-14T12:02:06.642757+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-14T12:02:06.642672+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-14T12:02:06.642672+0000","last_clean_scrub_stamp":"2024-09-14T12:02:06.642672+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:51.195553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":323,"num_read_kb":209,"num_write":113,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:03.624003+0000","last_change":"2024-09-14T12:02:03.624003+0000","last_active":"2024-09-14T12:02:03.624003+0000","last_peered":"2024-09-14T12:02:03.624003+0000","last_clean":"2024-09-14T12:02:03.624003+0000","last_became_active":"2024-09-14T11:25:20.207226+0000","last_became_peered":"2024-09-14T11:25:20.207226+0000","last_unstale":"2024-09-14T12:02:03.624003+0000","last_undegraded":"2024-09-14T12:02:03.624003+0000","last_fullsized":"2024-09-14T12:02:03.624003+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:03.623912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:03.623912+0000","last_clean_scrub_stamp":"2024-09-14T12:02:03.623912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:53.903225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:17.006001+0000","last_change":"2024-09-14T12:02:17.006001+0000","last_active":"2024-09-14T12:02:17.006001+0000","last_peered":"2024-09-14T12:02:17.006001+0000","last_clean":"2024-09-14T12:02:17.006001+0000","last_became_active":"2024-09-14T11:06:45.981705+0000","last_became_peered":"2024-09-14T11:06:45.981705+0000","last_unstale":"2024-09-14T12:02:17.006001+0000","last_undegraded":"2024-09-14T12:02:17.006001+0000","last_fullsized":"2024-09-14T12:02:17.006001+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:17.005911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:17.005911+0000","last_clean_scrub_stamp":"2024-09-14T12:02:17.005911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:03.745070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:05.145835+0000","last_change":"2024-09-14T12:02:05.145835+0000","last_active":"2024-09-14T12:02:05.145835+0000","last_peered":"2024-09-14T12:02:05.145835+0000","last_clean":"2024-09-14T12:02:05.145835+0000","last_became_active":"2024-09-14T11:06:41.917774+0000","last_became_peered":"2024-09-14T11:06:41.917774+0000","last_unstale":"2024-09-14T12:02:05.145835+0000","last_undegraded":"2024-09-14T12:02:05.145835+0000","last_fullsized":"2024-09-14T12:02:05.145835+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:05.145751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:05.145751+0000","last_clean_scrub_stamp":"2024-09-14T12:02:05.145751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:52.597873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'20","reported_seq":113,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:02.848808+0000","last_change":"2024-09-14T12:02:02.848808+0000","last_active":"2024-09-14T12:02:02.848808+0000","last_peered":"2024-09-14T12:02:02.848808+0000","last_clean":"2024-09-14T12:02:02.848808+0000","last_became_active":"2024-09-14T11:02:34.874685+0000","last_became_peered":"2024-09-14T11:02:34.874685+0000","last_unstale":"2024-09-14T12:02:02.848808+0000","last_undegraded":"2024-09-14T12:02:02.848808+0000","last_fullsized":"2024-09-14T12:02:02.848808+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'20","last_scrub_stamp":"2024-09-14T12:02:02.848728+0000","last_deep_scrub":"263'20","last_deep_scrub_stamp":"2024-09-14T12:02:02.848728+0000","last_clean_scrub_stamp":"2024-09-14T12:02:02.848728+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:02.320040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":99,"num_write":50,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:23.062879+0000","last_change":"2024-09-14T12:02:23.062879+0000","last_active":"2024-09-14T12:02:23.062879+0000","last_peered":"2024-09-14T12:02:23.062879+0000","last_clean":"2024-09-14T12:02:23.062879+0000","last_became_active":"2024-09-14T11:25:20.211190+0000","last_became_peered":"2024-09-14T11:25:20.211190+0000","last_unstale":"2024-09-14T12:02:23.062879+0000","last_undegraded":"2024-09-14T12:02:23.062879+0000","last_fullsized":"2024-09-14T12:02:23.062879+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:23.062795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:23.062795+0000","last_clean_scrub_stamp":"2024-09-14T12:02:23.062795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:46.254824+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"263'7","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:16.026379+0000","last_change":"2024-09-14T12:02:16.026379+0000","last_active":"2024-09-14T12:02:16.026379+0000","last_peered":"2024-09-14T12:02:16.026379+0000","last_clean":"2024-09-14T12:02:16.026379+0000","last_became_active":"2024-09-14T11:06:45.979801+0000","last_became_peered":"2024-09-14T11:06:45.979801+0000","last_unstale":"2024-09-14T12:02:16.026379+0000","last_undegraded":"2024-09-14T12:02:16.026379+0000","last_fullsized":"2024-09-14T12:02:16.026379+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T12:02:16.026280+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T12:02:16.026280+0000","last_clean_scrub_stamp":"2024-09-14T12:02:16.026280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:11.190264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"263'5","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:59.646348+0000","last_change":"2024-09-14T12:01:59.646348+0000","last_active":"2024-09-14T12:01:59.646348+0000","last_peered":"2024-09-14T12:01:59.646348+0000","last_clean":"2024-09-14T12:01:59.646348+0000","last_became_active":"2024-09-14T11:06:41.905007+0000","last_became_peered":"2024-09-14T11:06:41.905007+0000","last_unstale":"2024-09-14T12:01:59.646348+0000","last_undegraded":"2024-09-14T12:01:59.646348+0000","last_fullsized":"2024-09-14T12:01:59.646348+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T12:01:59.646259+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T12:01:59.646259+0000","last_clean_scrub_stamp":"2024-09-14T12:01:59.646259+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:58.113799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'31","reported_seq":140,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:00.773925+0000","last_change":"2024-09-14T12:02:00.773925+0000","last_active":"2024-09-14T12:02:00.773925+0000","last_peered":"2024-09-14T12:02:00.773925+0000","last_clean":"2024-09-14T12:02:00.773925+0000","last_became_active":"2024-09-14T11:02:34.873091+0000","last_became_peered":"2024-09-14T11:02:34.873091+0000","last_unstale":"2024-09-14T12:02:00.773925+0000","last_undegraded":"2024-09-14T12:02:00.773925+0000","last_fullsized":"2024-09-14T12:02:00.773925+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-14T12:02:00.773836+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-14T12:02:00.773836+0000","last_clean_scrub_stamp":"2024-09-14T12:02:00.773836+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:51.275587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":154,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:15.145827+0000","last_change":"2024-09-14T12:02:15.145827+0000","last_active":"2024-09-14T12:02:15.145827+0000","last_peered":"2024-09-14T12:02:15.145827+0000","last_clean":"2024-09-14T12:02:15.145827+0000","last_became_active":"2024-09-14T11:25:20.213064+0000","last_became_peered":"2024-09-14T11:25:20.213064+0000","last_unstale":"2024-09-14T12:02:15.145827+0000","last_undegraded":"2024-09-14T12:02:15.145827+0000","last_fullsized":"2024-09-14T12:02:15.145827+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:15.145733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:15.145733+0000","last_clean_scrub_stamp":"2024-09-14T12:02:15.145733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:14.150385+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"263'7","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:58.317510+0000","last_change":"2024-09-14T12:01:58.317434+0000","last_active":"2024-09-14T12:01:58.317510+0000","last_peered":"2024-09-14T12:01:58.317510+0000","last_clean":"2024-09-14T12:01:58.317510+0000","last_became_active":"2024-09-14T11:06:45.977225+0000","last_became_peered":"2024-09-14T11:06:45.977225+0000","last_unstale":"2024-09-14T12:01:58.317510+0000","last_undegraded":"2024-09-14T12:01:58.317510+0000","last_fullsized":"2024-09-14T12:01:58.317510+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T12:01:58.317337+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T12:01:58.317337+0000","last_clean_scrub_stamp":"2024-09-14T12:01:58.317337+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:14.168412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20490,"num_write":7,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:08.106043+0000","last_change":"2024-09-14T12:02:08.105928+0000","last_active":"2024-09-14T12:02:08.106043+0000","last_peered":"2024-09-14T12:02:08.106043+0000","last_clean":"2024-09-14T12:02:08.106043+0000","last_became_active":"2024-09-14T11:06:41.916037+0000","last_became_peered":"2024-09-14T11:06:41.916037+0000","last_unstale":"2024-09-14T12:02:08.106043+0000","last_undegraded":"2024-09-14T12:02:08.106043+0000","last_fullsized":"2024-09-14T12:02:08.106043+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:08.105832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:08.105832+0000","last_clean_scrub_stamp":"2024-09-14T12:02:08.105832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:32.013801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"263'6","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:01.804720+0000","last_change":"2024-09-14T12:02:01.804720+0000","last_active":"2024-09-14T12:02:01.804720+0000","last_peered":"2024-09-14T12:02:01.804720+0000","last_clean":"2024-09-14T12:02:01.804720+0000","last_became_active":"2024-09-14T11:02:34.878477+0000","last_became_peered":"2024-09-14T11:02:34.878477+0000","last_unstale":"2024-09-14T12:02:01.804720+0000","last_undegraded":"2024-09-14T12:02:01.804720+0000","last_fullsized":"2024-09-14T12:02:01.804720+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:02:01.804608+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:02:01.804608+0000","last_clean_scrub_stamp":"2024-09-14T12:02:01.804608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:40.955608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:12.666798+0000","last_change":"2024-09-14T12:02:12.666798+0000","last_active":"2024-09-14T12:02:12.666798+0000","last_peered":"2024-09-14T12:02:12.666798+0000","last_clean":"2024-09-14T12:02:12.666798+0000","last_became_active":"2024-09-14T11:25:20.210841+0000","last_became_peered":"2024-09-14T11:25:20.210841+0000","last_unstale":"2024-09-14T12:02:12.666798+0000","last_undegraded":"2024-09-14T12:02:12.666798+0000","last_fullsized":"2024-09-14T12:02:12.666798+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:12.666711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:12.666711+0000","last_clean_scrub_stamp":"2024-09-14T12:02:12.666711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:22.335551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"260'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:55.541716+0000","last_change":"2024-09-14T11:06:45.992541+0000","last_active":"2024-09-14T11:59:55.541716+0000","last_peered":"2024-09-14T11:59:55.541716+0000","last_clean":"2024-09-14T11:59:55.541716+0000","last_became_active":"2024-09-14T11:06:45.992046+0000","last_became_peered":"2024-09-14T11:06:45.992046+0000","last_unstale":"2024-09-14T11:59:55.541716+0000","last_undegraded":"2024-09-14T11:59:55.541716+0000","last_fullsized":"2024-09-14T11:59:55.541716+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:22.601166+0000","last_change":"2024-09-14T12:02:22.601052+0000","last_active":"2024-09-14T12:02:22.601166+0000","last_peered":"2024-09-14T12:02:22.601166+0000","last_clean":"2024-09-14T12:02:22.601166+0000","last_became_active":"2024-09-14T11:06:41.909310+0000","last_became_peered":"2024-09-14T11:06:41.909310+0000","last_unstale":"2024-09-14T12:02:22.601166+0000","last_undegraded":"2024-09-14T12:02:22.601166+0000","last_fullsized":"2024-09-14T12:02:22.601166+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:22.600949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:22.600949+0000","last_clean_scrub_stamp":"2024-09-14T12:02:22.600949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:02.814032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"263'17","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:57.887525+0000","last_change":"2024-09-14T12:01:57.887525+0000","last_active":"2024-09-14T12:01:57.887525+0000","last_peered":"2024-09-14T12:01:57.887525+0000","last_clean":"2024-09-14T12:01:57.887525+0000","last_became_active":"2024-09-14T11:02:34.878859+0000","last_became_peered":"2024-09-14T11:02:34.878859+0000","last_unstale":"2024-09-14T12:01:57.887525+0000","last_undegraded":"2024-09-14T12:01:57.887525+0000","last_fullsized":"2024-09-14T12:01:57.887525+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'17","last_scrub_stamp":"2024-09-14T12:01:57.887436+0000","last_deep_scrub":"263'17","last_deep_scrub_stamp":"2024-09-14T12:01:57.887436+0000","last_clean_scrub_stamp":"2024-09-14T12:01:57.887436+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:50.627840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":82,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:08.977057+0000","last_change":"2024-09-14T12:02:08.977057+0000","last_active":"2024-09-14T12:02:08.977057+0000","last_peered":"2024-09-14T12:02:08.977057+0000","last_clean":"2024-09-14T12:02:08.977057+0000","last_became_active":"2024-09-14T11:25:20.213540+0000","last_became_peered":"2024-09-14T11:25:20.213540+0000","last_unstale":"2024-09-14T12:02:08.977057+0000","last_undegraded":"2024-09-14T12:02:08.977057+0000","last_fullsized":"2024-09-14T12:02:08.977057+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:02:08.976982+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:02:08.976982+0000","last_clean_scrub_stamp":"2024-09-14T12:02:08.976982+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:33.584434+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"260'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:04.945602+0000","last_change":"2024-09-14T12:02:04.945602+0000","last_active":"2024-09-14T12:02:04.945602+0000","last_peered":"2024-09-14T12:02:04.945602+0000","last_clean":"2024-09-14T12:02:04.945602+0000","last_became_active":"2024-09-14T11:06:45.984536+0000","last_became_peered":"2024-09-14T11:06:45.984536+0000","last_unstale":"2024-09-14T12:02:04.945602+0000","last_undegraded":"2024-09-14T12:02:04.945602+0000","last_fullsized":"2024-09-14T12:02:04.945602+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T12:02:04.945509+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T12:02:04.945509+0000","last_clean_scrub_stamp":"2024-09-14T12:02:04.945509+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:28.914973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:54.285050+0000","last_change":"2024-09-14T12:01:54.285050+0000","last_active":"2024-09-14T12:01:54.285050+0000","last_peered":"2024-09-14T12:01:54.285050+0000","last_clean":"2024-09-14T12:01:54.285050+0000","last_became_active":"2024-09-14T11:06:41.917297+0000","last_became_peered":"2024-09-14T11:06:41.917297+0000","last_unstale":"2024-09-14T12:01:54.285050+0000","last_undegraded":"2024-09-14T12:01:54.285050+0000","last_fullsized":"2024-09-14T12:01:54.285050+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:54.284954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:54.284954+0000","last_clean_scrub_stamp":"2024-09-14T12:01:54.284954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:26.497930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"260'21","reported_seq":126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:57.211012+0000","last_change":"2024-09-14T12:01:57.211012+0000","last_active":"2024-09-14T12:01:57.211012+0000","last_peered":"2024-09-14T12:01:57.211012+0000","last_clean":"2024-09-14T12:01:57.211012+0000","last_became_active":"2024-09-14T11:02:34.876726+0000","last_became_peered":"2024-09-14T11:02:34.876726+0000","last_unstale":"2024-09-14T12:01:57.211012+0000","last_undegraded":"2024-09-14T12:01:57.211012+0000","last_fullsized":"2024-09-14T12:01:57.211012+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'21","last_scrub_stamp":"2024-09-14T12:01:57.210902+0000","last_deep_scrub":"260'21","last_deep_scrub_stamp":"2024-09-14T12:01:57.210902+0000","last_clean_scrub_stamp":"2024-09-14T12:01:57.210902+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:17.084887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":116,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:04.282573+0000","last_change":"2024-09-14T12:02:04.282573+0000","last_active":"2024-09-14T12:02:04.282573+0000","last_peered":"2024-09-14T12:02:04.282573+0000","last_clean":"2024-09-14T12:02:04.282573+0000","last_became_active":"2024-09-14T11:25:20.214475+0000","last_became_peered":"2024-09-14T11:25:20.214475+0000","last_unstale":"2024-09-14T12:02:04.282573+0000","last_undegraded":"2024-09-14T12:02:04.282573+0000","last_fullsized":"2024-09-14T12:02:04.282573+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:04.282481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:04.282481+0000","last_clean_scrub_stamp":"2024-09-14T12:02:04.282481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:49.955677+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:11.050688+0000","last_change":"2024-09-14T12:02:11.050688+0000","last_active":"2024-09-14T12:02:11.050688+0000","last_peered":"2024-09-14T12:02:11.050688+0000","last_clean":"2024-09-14T12:02:11.050688+0000","last_became_active":"2024-09-14T11:06:45.990419+0000","last_became_peered":"2024-09-14T11:06:45.990419+0000","last_unstale":"2024-09-14T12:02:11.050688+0000","last_undegraded":"2024-09-14T12:02:11.050688+0000","last_fullsized":"2024-09-14T12:02:11.050688+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:11.050595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:11.050595+0000","last_clean_scrub_stamp":"2024-09-14T12:02:11.050595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:14.954398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"260'2","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:05.900273+0000","last_change":"2024-09-14T12:02:05.900273+0000","last_active":"2024-09-14T12:02:05.900273+0000","last_peered":"2024-09-14T12:02:05.900273+0000","last_clean":"2024-09-14T12:02:05.900273+0000","last_became_active":"2024-09-14T11:06:41.910694+0000","last_became_peered":"2024-09-14T11:06:41.910694+0000","last_unstale":"2024-09-14T12:02:05.900273+0000","last_undegraded":"2024-09-14T12:02:05.900273+0000","last_fullsized":"2024-09-14T12:02:05.900273+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T12:02:05.900180+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T12:02:05.900180+0000","last_clean_scrub_stamp":"2024-09-14T12:02:05.900180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:16.384585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"263'21","reported_seq":118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:59.821308+0000","last_change":"2024-09-14T12:01:59.821308+0000","last_active":"2024-09-14T12:01:59.821308+0000","last_peered":"2024-09-14T12:01:59.821308+0000","last_clean":"2024-09-14T12:01:59.821308+0000","last_became_active":"2024-09-14T11:02:34.872803+0000","last_became_peered":"2024-09-14T11:02:34.872803+0000","last_unstale":"2024-09-14T12:01:59.821308+0000","last_undegraded":"2024-09-14T12:01:59.821308+0000","last_fullsized":"2024-09-14T12:01:59.821308+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'21","last_scrub_stamp":"2024-09-14T12:01:59.821192+0000","last_deep_scrub":"263'21","last_deep_scrub_stamp":"2024-09-14T12:01:59.821192+0000","last_clean_scrub_stamp":"2024-09-14T12:01:59.821192+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:10.561664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":102,"num_write":56,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:22.023259+0000","last_change":"2024-09-14T12:02:22.023259+0000","last_active":"2024-09-14T12:02:22.023259+0000","last_peered":"2024-09-14T12:02:22.023259+0000","last_clean":"2024-09-14T12:02:22.023259+0000","last_became_active":"2024-09-14T11:25:20.207780+0000","last_became_peered":"2024-09-14T11:25:20.207780+0000","last_unstale":"2024-09-14T12:02:22.023259+0000","last_undegraded":"2024-09-14T12:02:22.023259+0000","last_fullsized":"2024-09-14T12:02:22.023259+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:22.023158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:22.023158+0000","last_clean_scrub_stamp":"2024-09-14T12:02:22.023158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:36.597026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"263'9","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:10.077251+0000","last_change":"2024-09-14T12:02:10.077134+0000","last_active":"2024-09-14T12:02:10.077251+0000","last_peered":"2024-09-14T12:02:10.077251+0000","last_clean":"2024-09-14T12:02:10.077251+0000","last_became_active":"2024-09-14T11:06:45.992208+0000","last_became_peered":"2024-09-14T11:06:45.992208+0000","last_unstale":"2024-09-14T12:02:10.077251+0000","last_undegraded":"2024-09-14T12:02:10.077251+0000","last_fullsized":"2024-09-14T12:02:10.077251+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-14T12:02:10.077039+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-14T12:02:10.077039+0000","last_clean_scrub_stamp":"2024-09-14T12:02:10.077039+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:40:52.224384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":17408,"num_write":14,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"263'8","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:21.606948+0000","last_change":"2024-09-14T12:02:21.606948+0000","last_active":"2024-09-14T12:02:21.606948+0000","last_peered":"2024-09-14T12:02:21.606948+0000","last_clean":"2024-09-14T12:02:21.606948+0000","last_became_active":"2024-09-14T11:06:41.915173+0000","last_became_peered":"2024-09-14T11:06:41.915173+0000","last_unstale":"2024-09-14T12:02:21.606948+0000","last_undegraded":"2024-09-14T12:02:21.606948+0000","last_fullsized":"2024-09-14T12:02:21.606948+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-14T12:02:21.606850+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-14T12:02:21.606850+0000","last_clean_scrub_stamp":"2024-09-14T12:02:21.606850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:31.555374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10242,"num_write":13,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"263'15","reported_seq":102,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:05.690923+0000","last_change":"2024-09-14T12:02:05.690923+0000","last_active":"2024-09-14T12:02:05.690923+0000","last_peered":"2024-09-14T12:02:05.690923+0000","last_clean":"2024-09-14T12:02:05.690923+0000","last_became_active":"2024-09-14T11:02:34.867669+0000","last_became_peered":"2024-09-14T11:02:34.867669+0000","last_unstale":"2024-09-14T12:02:05.690923+0000","last_undegraded":"2024-09-14T12:02:05.690923+0000","last_fullsized":"2024-09-14T12:02:05.690923+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'15","last_scrub_stamp":"2024-09-14T12:02:05.690838+0000","last_deep_scrub":"263'15","last_deep_scrub_stamp":"2024-09-14T12:02:05.690838+0000","last_clean_scrub_stamp":"2024-09-14T12:02:05.690838+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:20.997093+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":79,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"263'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:07.885877+0000","last_change":"2024-09-14T12:02:07.885877+0000","last_active":"2024-09-14T12:02:07.885877+0000","last_peered":"2024-09-14T12:02:07.885877+0000","last_clean":"2024-09-14T12:02:07.885877+0000","last_became_active":"2024-09-14T11:25:20.209801+0000","last_became_peered":"2024-09-14T11:25:20.209801+0000","last_unstale":"2024-09-14T12:02:07.885877+0000","last_undegraded":"2024-09-14T12:02:07.885877+0000","last_fullsized":"2024-09-14T12:02:07.885877+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:02:07.885758+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:02:07.885758+0000","last_clean_scrub_stamp":"2024-09-14T12:02:07.885758+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:33.696067+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:15.037814+0000","last_change":"2024-09-14T12:02:15.037814+0000","last_active":"2024-09-14T12:02:15.037814+0000","last_peered":"2024-09-14T12:02:15.037814+0000","last_clean":"2024-09-14T12:02:15.037814+0000","last_became_active":"2024-09-14T11:06:45.990093+0000","last_became_peered":"2024-09-14T11:06:45.990093+0000","last_unstale":"2024-09-14T12:02:15.037814+0000","last_undegraded":"2024-09-14T12:02:15.037814+0000","last_fullsized":"2024-09-14T12:02:15.037814+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:15.037724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:15.037724+0000","last_clean_scrub_stamp":"2024-09-14T12:02:15.037724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:32.859285+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"263'5","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:53.258269+0000","last_change":"2024-09-14T12:01:53.258189+0000","last_active":"2024-09-14T12:01:53.258269+0000","last_peered":"2024-09-14T12:01:53.258269+0000","last_clean":"2024-09-14T12:01:53.258269+0000","last_became_active":"2024-09-14T11:06:41.913330+0000","last_became_peered":"2024-09-14T11:06:41.913330+0000","last_unstale":"2024-09-14T12:01:53.258269+0000","last_undegraded":"2024-09-14T12:01:53.258269+0000","last_fullsized":"2024-09-14T12:01:53.258269+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T12:01:53.258102+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T12:01:53.258102+0000","last_clean_scrub_stamp":"2024-09-14T12:01:53.258102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:02.121900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"263'51","reported_seq":200,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:03.663366+0000","last_change":"2024-09-14T12:02:03.663366+0000","last_active":"2024-09-14T12:02:03.663366+0000","last_peered":"2024-09-14T12:02:03.663366+0000","last_clean":"2024-09-14T12:02:03.663366+0000","last_became_active":"2024-09-14T11:02:34.879480+0000","last_became_peered":"2024-09-14T11:02:34.879480+0000","last_unstale":"2024-09-14T12:02:03.663366+0000","last_undegraded":"2024-09-14T12:02:03.663366+0000","last_fullsized":"2024-09-14T12:02:03.663366+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'51","last_scrub_stamp":"2024-09-14T12:02:03.663264+0000","last_deep_scrub":"263'51","last_deep_scrub_stamp":"2024-09-14T12:02:03.663264+0000","last_clean_scrub_stamp":"2024-09-14T12:02:03.663264+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:48.283261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":249,"num_write":134,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:06.989307+0000","last_change":"2024-09-14T12:02:06.989307+0000","last_active":"2024-09-14T12:02:06.989307+0000","last_peered":"2024-09-14T12:02:06.989307+0000","last_clean":"2024-09-14T12:02:06.989307+0000","last_became_active":"2024-09-14T11:25:20.208253+0000","last_became_peered":"2024-09-14T11:25:20.208253+0000","last_unstale":"2024-09-14T12:02:06.989307+0000","last_undegraded":"2024-09-14T12:02:06.989307+0000","last_fullsized":"2024-09-14T12:02:06.989307+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:06.989214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:06.989214+0000","last_clean_scrub_stamp":"2024-09-14T12:02:06.989214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:01.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:14.107185+0000","last_change":"2024-09-14T12:02:14.107113+0000","last_active":"2024-09-14T12:02:14.107185+0000","last_peered":"2024-09-14T12:02:14.107185+0000","last_clean":"2024-09-14T12:02:14.107185+0000","last_became_active":"2024-09-14T11:06:45.986268+0000","last_became_peered":"2024-09-14T11:06:45.986268+0000","last_unstale":"2024-09-14T12:02:14.107185+0000","last_undegraded":"2024-09-14T12:02:14.107185+0000","last_fullsized":"2024-09-14T12:02:14.107185+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:14.107023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:14.107023+0000","last_clean_scrub_stamp":"2024-09-14T12:02:14.107023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:23.049951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"263'5","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:03.108214+0000","last_change":"2024-09-14T12:02:03.108142+0000","last_active":"2024-09-14T12:02:03.108214+0000","last_peered":"2024-09-14T12:02:03.108214+0000","last_clean":"2024-09-14T12:02:03.108214+0000","last_became_active":"2024-09-14T11:06:41.918902+0000","last_became_peered":"2024-09-14T11:06:41.918902+0000","last_unstale":"2024-09-14T12:02:03.108214+0000","last_undegraded":"2024-09-14T12:02:03.108214+0000","last_fullsized":"2024-09-14T12:02:03.108214+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T12:02:03.108063+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T12:02:03.108063+0000","last_clean_scrub_stamp":"2024-09-14T12:02:03.108063+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:55:47.091374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"263'3","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:56.237034+0000","last_change":"2024-09-14T12:01:56.237034+0000","last_active":"2024-09-14T12:01:56.237034+0000","last_peered":"2024-09-14T12:01:56.237034+0000","last_clean":"2024-09-14T12:01:56.237034+0000","last_became_active":"2024-09-14T11:02:34.877623+0000","last_became_peered":"2024-09-14T11:02:34.877623+0000","last_unstale":"2024-09-14T12:01:56.237034+0000","last_undegraded":"2024-09-14T12:01:56.237034+0000","last_fullsized":"2024-09-14T12:01:56.237034+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:01:56.236952+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:01:56.236952+0000","last_clean_scrub_stamp":"2024-09-14T12:01:56.236952+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:46.845594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:02.282253+0000","last_change":"2024-09-14T12:02:02.282253+0000","last_active":"2024-09-14T12:02:02.282253+0000","last_peered":"2024-09-14T12:02:02.282253+0000","last_clean":"2024-09-14T12:02:02.282253+0000","last_became_active":"2024-09-14T11:25:20.208411+0000","last_became_peered":"2024-09-14T11:25:20.208411+0000","last_unstale":"2024-09-14T12:02:02.282253+0000","last_undegraded":"2024-09-14T12:02:02.282253+0000","last_fullsized":"2024-09-14T12:02:02.282253+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:02.282168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:02.282168+0000","last_clean_scrub_stamp":"2024-09-14T12:02:02.282168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:04.535961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:55.331406+0000","last_change":"2024-09-14T12:01:55.331335+0000","last_active":"2024-09-14T12:01:55.331406+0000","last_peered":"2024-09-14T12:01:55.331406+0000","last_clean":"2024-09-14T12:01:55.331406+0000","last_became_active":"2024-09-14T11:06:45.978458+0000","last_became_peered":"2024-09-14T11:06:45.978458+0000","last_unstale":"2024-09-14T12:01:55.331406+0000","last_undegraded":"2024-09-14T12:01:55.331406+0000","last_fullsized":"2024-09-14T12:01:55.331406+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T12:01:55.331248+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T12:01:55.331248+0000","last_clean_scrub_stamp":"2024-09-14T12:01:55.331248+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:29.427333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"263'3","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:07.139003+0000","last_change":"2024-09-14T12:02:07.138921+0000","last_active":"2024-09-14T12:02:07.139003+0000","last_peered":"2024-09-14T12:02:07.139003+0000","last_clean":"2024-09-14T12:02:07.139003+0000","last_became_active":"2024-09-14T11:06:41.915795+0000","last_became_peered":"2024-09-14T11:06:41.915795+0000","last_unstale":"2024-09-14T12:02:07.139003+0000","last_undegraded":"2024-09-14T12:02:07.139003+0000","last_fullsized":"2024-09-14T12:02:07.139003+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:02:07.138794+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:02:07.138794+0000","last_clean_scrub_stamp":"2024-09-14T12:02:07.138794+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:34.271335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"263'20","reported_seq":117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:15.663248+0000","last_change":"2024-09-14T12:02:15.663248+0000","last_active":"2024-09-14T12:02:15.663248+0000","last_peered":"2024-09-14T12:02:15.663248+0000","last_clean":"2024-09-14T12:02:15.663248+0000","last_became_active":"2024-09-14T11:02:34.881333+0000","last_became_peered":"2024-09-14T11:02:34.881333+0000","last_unstale":"2024-09-14T12:02:15.663248+0000","last_undegraded":"2024-09-14T12:02:15.663248+0000","last_fullsized":"2024-09-14T12:02:15.663248+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'20","last_scrub_stamp":"2024-09-14T12:02:15.663136+0000","last_deep_scrub":"263'20","last_deep_scrub_stamp":"2024-09-14T12:02:15.663136+0000","last_clean_scrub_stamp":"2024-09-14T12:02:15.663136+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:54.516222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":49,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.464738+0000","last_change":"2024-09-14T11:25:20.209663+0000","last_active":"2024-09-14T11:59:13.464738+0000","last_peered":"2024-09-14T11:59:13.464738+0000","last_clean":"2024-09-14T11:59:13.464738+0000","last_became_active":"2024-09-14T11:25:20.209369+0000","last_became_peered":"2024-09-14T11:25:20.209369+0000","last_unstale":"2024-09-14T11:59:13.464738+0000","last_undegraded":"2024-09-14T11:59:13.464738+0000","last_fullsized":"2024-09-14T11:59:13.464738+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:14.050120+0000","last_change":"2024-09-14T12:02:14.050120+0000","last_active":"2024-09-14T12:02:14.050120+0000","last_peered":"2024-09-14T12:02:14.050120+0000","last_clean":"2024-09-14T12:02:14.050120+0000","last_became_active":"2024-09-14T11:06:45.980211+0000","last_became_peered":"2024-09-14T11:06:45.980211+0000","last_unstale":"2024-09-14T12:02:14.050120+0000","last_undegraded":"2024-09-14T12:02:14.050120+0000","last_fullsized":"2024-09-14T12:02:14.050120+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:14.050019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:14.050019+0000","last_clean_scrub_stamp":"2024-09-14T12:02:14.050019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:10.346106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:55.640163+0000","last_change":"2024-09-14T12:01:55.640163+0000","last_active":"2024-09-14T12:01:55.640163+0000","last_peered":"2024-09-14T12:01:55.640163+0000","last_clean":"2024-09-14T12:01:55.640163+0000","last_became_active":"2024-09-14T11:06:41.902894+0000","last_became_peered":"2024-09-14T11:06:41.902894+0000","last_unstale":"2024-09-14T12:01:55.640163+0000","last_undegraded":"2024-09-14T12:01:55.640163+0000","last_fullsized":"2024-09-14T12:01:55.640163+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:55.640070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:55.640070+0000","last_clean_scrub_stamp":"2024-09-14T12:01:55.640070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:30.116185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"260'15","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:14.710520+0000","last_change":"2024-09-14T12:02:14.710520+0000","last_active":"2024-09-14T12:02:14.710520+0000","last_peered":"2024-09-14T12:02:14.710520+0000","last_clean":"2024-09-14T12:02:14.710520+0000","last_became_active":"2024-09-14T11:02:34.873660+0000","last_became_peered":"2024-09-14T11:02:34.873660+0000","last_unstale":"2024-09-14T12:02:14.710520+0000","last_undegraded":"2024-09-14T12:02:14.710520+0000","last_fullsized":"2024-09-14T12:02:14.710520+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'15","last_scrub_stamp":"2024-09-14T12:02:14.710419+0000","last_deep_scrub":"260'15","last_deep_scrub_stamp":"2024-09-14T12:02:14.710419+0000","last_clean_scrub_stamp":"2024-09-14T12:02:14.710419+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:33:30.932382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":83,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:09.833063+0000","last_change":"2024-09-14T12:02:09.833063+0000","last_active":"2024-09-14T12:02:09.833063+0000","last_peered":"2024-09-14T12:02:09.833063+0000","last_clean":"2024-09-14T12:02:09.833063+0000","last_became_active":"2024-09-14T11:25:20.210534+0000","last_became_peered":"2024-09-14T11:25:20.210534+0000","last_unstale":"2024-09-14T12:02:09.833063+0000","last_undegraded":"2024-09-14T12:02:09.833063+0000","last_fullsized":"2024-09-14T12:02:09.833063+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:09.832978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:09.832978+0000","last_clean_scrub_stamp":"2024-09-14T12:02:09.832978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:49.563316+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:13.040580+0000","last_change":"2024-09-14T12:02:13.040580+0000","last_active":"2024-09-14T12:02:13.040580+0000","last_peered":"2024-09-14T12:02:13.040580+0000","last_clean":"2024-09-14T12:02:13.040580+0000","last_became_active":"2024-09-14T11:06:45.984993+0000","last_became_peered":"2024-09-14T11:06:45.984993+0000","last_unstale":"2024-09-14T12:02:13.040580+0000","last_undegraded":"2024-09-14T12:02:13.040580+0000","last_fullsized":"2024-09-14T12:02:13.040580+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:13.040497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:13.040497+0000","last_clean_scrub_stamp":"2024-09-14T12:02:13.040497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:48.866466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"263'3","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:06.117796+0000","last_change":"2024-09-14T12:02:06.117796+0000","last_active":"2024-09-14T12:02:06.117796+0000","last_peered":"2024-09-14T12:02:06.117796+0000","last_clean":"2024-09-14T12:02:06.117796+0000","last_became_active":"2024-09-14T11:06:41.910286+0000","last_became_peered":"2024-09-14T11:06:41.910286+0000","last_unstale":"2024-09-14T12:02:06.117796+0000","last_undegraded":"2024-09-14T12:02:06.117796+0000","last_fullsized":"2024-09-14T12:02:06.117796+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:02:06.117717+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:02:06.117717+0000","last_clean_scrub_stamp":"2024-09-14T12:02:06.117717+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:16.663429+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"263'55","reported_seq":211,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:54.163695+0000","last_change":"2024-09-14T12:01:54.163695+0000","last_active":"2024-09-14T12:01:54.163695+0000","last_peered":"2024-09-14T12:01:54.163695+0000","last_clean":"2024-09-14T12:01:54.163695+0000","last_became_active":"2024-09-14T11:02:34.872911+0000","last_became_peered":"2024-09-14T11:02:34.872911+0000","last_unstale":"2024-09-14T12:01:54.163695+0000","last_undegraded":"2024-09-14T12:01:54.163695+0000","last_fullsized":"2024-09-14T12:01:54.163695+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'55","last_scrub_stamp":"2024-09-14T12:01:54.163587+0000","last_deep_scrub":"263'55","last_deep_scrub_stamp":"2024-09-14T12:01:54.163587+0000","last_clean_scrub_stamp":"2024-09-14T12:01:54.163587+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:22.680045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":434,"num_read_kb":298,"num_write":132,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"263'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:11.628358+0000","last_change":"2024-09-14T12:02:11.628358+0000","last_active":"2024-09-14T12:02:11.628358+0000","last_peered":"2024-09-14T12:02:11.628358+0000","last_clean":"2024-09-14T12:02:11.628358+0000","last_became_active":"2024-09-14T11:25:20.209547+0000","last_became_peered":"2024-09-14T11:25:20.209547+0000","last_unstale":"2024-09-14T12:02:11.628358+0000","last_undegraded":"2024-09-14T12:02:11.628358+0000","last_fullsized":"2024-09-14T12:02:11.628358+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:02:11.628262+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:02:11.628262+0000","last_clean_scrub_stamp":"2024-09-14T12:02:11.628262+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:14.488062+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"263'6","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:09.124208+0000","last_change":"2024-09-14T12:02:09.124208+0000","last_active":"2024-09-14T12:02:09.124208+0000","last_peered":"2024-09-14T12:02:09.124208+0000","last_clean":"2024-09-14T12:02:09.124208+0000","last_became_active":"2024-09-14T11:06:45.984527+0000","last_became_peered":"2024-09-14T11:06:45.984527+0000","last_unstale":"2024-09-14T12:02:09.124208+0000","last_undegraded":"2024-09-14T12:02:09.124208+0000","last_fullsized":"2024-09-14T12:02:09.124208+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:02:09.124100+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:02:09.124100+0000","last_clean_scrub_stamp":"2024-09-14T12:02:09.124100+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:46.474797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"260'9","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:04.598723+0000","last_change":"2024-09-14T12:02:04.598723+0000","last_active":"2024-09-14T12:02:04.598723+0000","last_peered":"2024-09-14T12:02:04.598723+0000","last_clean":"2024-09-14T12:02:04.598723+0000","last_became_active":"2024-09-14T11:06:41.905088+0000","last_became_peered":"2024-09-14T11:06:41.905088+0000","last_unstale":"2024-09-14T12:02:04.598723+0000","last_undegraded":"2024-09-14T12:02:04.598723+0000","last_fullsized":"2024-09-14T12:02:04.598723+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'9","last_scrub_stamp":"2024-09-14T12:02:04.598632+0000","last_deep_scrub":"260'9","last_deep_scrub_stamp":"2024-09-14T12:02:04.598632+0000","last_clean_scrub_stamp":"2024-09-14T12:02:04.598632+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:17.521499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17408,"num_write":9,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'36","reported_seq":160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:56.869265+0000","last_change":"2024-09-14T12:01:56.869265+0000","last_active":"2024-09-14T12:01:56.869265+0000","last_peered":"2024-09-14T12:01:56.869265+0000","last_clean":"2024-09-14T12:01:56.869265+0000","last_became_active":"2024-09-14T11:02:34.873560+0000","last_became_peered":"2024-09-14T11:02:34.873560+0000","last_unstale":"2024-09-14T12:01:56.869265+0000","last_undegraded":"2024-09-14T12:01:56.869265+0000","last_fullsized":"2024-09-14T12:01:56.869265+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'36","last_scrub_stamp":"2024-09-14T12:01:56.869155+0000","last_deep_scrub":"263'36","last_deep_scrub_stamp":"2024-09-14T12:01:56.869155+0000","last_clean_scrub_stamp":"2024-09-14T12:01:56.869155+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:21.843658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":270,"num_read_kb":162,"num_write":93,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"263'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:08.838605+0000","last_change":"2024-09-14T12:02:08.838605+0000","last_active":"2024-09-14T12:02:08.838605+0000","last_peered":"2024-09-14T12:02:08.838605+0000","last_clean":"2024-09-14T12:02:08.838605+0000","last_became_active":"2024-09-14T11:25:20.206692+0000","last_became_peered":"2024-09-14T11:25:20.206692+0000","last_unstale":"2024-09-14T12:02:08.838605+0000","last_undegraded":"2024-09-14T12:02:08.838605+0000","last_fullsized":"2024-09-14T12:02:08.838605+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:02:08.838526+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:02:08.838526+0000","last_clean_scrub_stamp":"2024-09-14T12:02:08.838526+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:07.800455+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:05.527582+0000","last_change":"2024-09-14T11:06:45.985776+0000","last_active":"2024-09-14T11:58:05.527582+0000","last_peered":"2024-09-14T11:58:05.527582+0000","last_clean":"2024-09-14T11:58:05.527582+0000","last_became_active":"2024-09-14T11:06:45.985436+0000","last_became_peered":"2024-09-14T11:06:45.985436+0000","last_unstale":"2024-09-14T11:58:05.527582+0000","last_undegraded":"2024-09-14T11:58:05.527582+0000","last_fullsized":"2024-09-14T11:58:05.527582+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:18.777447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"263'5","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:58.605471+0000","last_change":"2024-09-14T12:01:58.605471+0000","last_active":"2024-09-14T12:01:58.605471+0000","last_peered":"2024-09-14T12:01:58.605471+0000","last_clean":"2024-09-14T12:01:58.605471+0000","last_became_active":"2024-09-14T11:06:41.907791+0000","last_became_peered":"2024-09-14T11:06:41.907791+0000","last_unstale":"2024-09-14T12:01:58.605471+0000","last_undegraded":"2024-09-14T12:01:58.605471+0000","last_fullsized":"2024-09-14T12:01:58.605471+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T12:01:58.605369+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T12:01:58.605369+0000","last_clean_scrub_stamp":"2024-09-14T12:01:58.605369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:54.167899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5124,"num_write":5,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"263'33","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:55.202882+0000","last_change":"2024-09-14T12:01:55.202882+0000","last_active":"2024-09-14T12:01:55.202882+0000","last_peered":"2024-09-14T12:01:55.202882+0000","last_clean":"2024-09-14T12:01:55.202882+0000","last_became_active":"2024-09-14T11:02:34.876080+0000","last_became_peered":"2024-09-14T11:02:34.876080+0000","last_unstale":"2024-09-14T12:01:55.202882+0000","last_undegraded":"2024-09-14T12:01:55.202882+0000","last_fullsized":"2024-09-14T12:01:55.202882+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'33","last_scrub_stamp":"2024-09-14T12:01:55.202764+0000","last_deep_scrub":"263'33","last_deep_scrub_stamp":"2024-09-14T12:01:55.202764+0000","last_clean_scrub_stamp":"2024-09-14T12:01:55.202764+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:44.281145+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":186,"num_write":88,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:20.003866+0000","last_change":"2024-09-14T12:02:20.003866+0000","last_active":"2024-09-14T12:02:20.003866+0000","last_peered":"2024-09-14T12:02:20.003866+0000","last_clean":"2024-09-14T12:02:20.003866+0000","last_became_active":"2024-09-14T11:25:20.205335+0000","last_became_peered":"2024-09-14T11:25:20.205335+0000","last_unstale":"2024-09-14T12:02:20.003866+0000","last_undegraded":"2024-09-14T12:02:20.003866+0000","last_fullsized":"2024-09-14T12:02:20.003866+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:20.003781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:20.003781+0000","last_clean_scrub_stamp":"2024-09-14T12:02:20.003781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:36.847122+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:07.173612+0000","last_change":"2024-09-14T12:02:07.173612+0000","last_active":"2024-09-14T12:02:07.173612+0000","last_peered":"2024-09-14T12:02:07.173612+0000","last_clean":"2024-09-14T12:02:07.173612+0000","last_became_active":"2024-09-14T11:06:45.986225+0000","last_became_peered":"2024-09-14T11:06:45.986225+0000","last_unstale":"2024-09-14T12:02:07.173612+0000","last_undegraded":"2024-09-14T12:02:07.173612+0000","last_fullsized":"2024-09-14T12:02:07.173612+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:07.173523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:07.173523+0000","last_clean_scrub_stamp":"2024-09-14T12:02:07.173523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:27.975514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"263'3","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:00.946625+0000","last_change":"2024-09-14T12:02:00.946625+0000","last_active":"2024-09-14T12:02:00.946625+0000","last_peered":"2024-09-14T12:02:00.946625+0000","last_clean":"2024-09-14T12:02:00.946625+0000","last_became_active":"2024-09-14T11:06:41.903188+0000","last_became_peered":"2024-09-14T11:06:41.903188+0000","last_unstale":"2024-09-14T12:02:00.946625+0000","last_undegraded":"2024-09-14T12:02:00.946625+0000","last_fullsized":"2024-09-14T12:02:00.946625+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:02:00.946535+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:02:00.946535+0000","last_clean_scrub_stamp":"2024-09-14T12:02:00.946535+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:19.041987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"263'55","reported_seq":210,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:53.164118+0000","last_change":"2024-09-14T12:01:53.164118+0000","last_active":"2024-09-14T12:01:53.164118+0000","last_peered":"2024-09-14T12:01:53.164118+0000","last_clean":"2024-09-14T12:01:53.164118+0000","last_became_active":"2024-09-14T11:02:34.877631+0000","last_became_peered":"2024-09-14T11:02:34.877631+0000","last_unstale":"2024-09-14T12:01:53.164118+0000","last_undegraded":"2024-09-14T12:01:53.164118+0000","last_fullsized":"2024-09-14T12:01:53.164118+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'55","last_scrub_stamp":"2024-09-14T12:01:53.164032+0000","last_deep_scrub":"263'55","last_deep_scrub_stamp":"2024-09-14T12:01:53.164032+0000","last_clean_scrub_stamp":"2024-09-14T12:01:53.164032+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:16.618442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":260,"num_write":147,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:02.633879+0000","last_change":"2024-09-14T12:02:02.633879+0000","last_active":"2024-09-14T12:02:02.633879+0000","last_peered":"2024-09-14T12:02:02.633879+0000","last_clean":"2024-09-14T12:02:02.633879+0000","last_became_active":"2024-09-14T11:25:20.200061+0000","last_became_peered":"2024-09-14T11:25:20.200061+0000","last_unstale":"2024-09-14T12:02:02.633879+0000","last_undegraded":"2024-09-14T12:02:02.633879+0000","last_fullsized":"2024-09-14T12:02:02.633879+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:02.633771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:02.633771+0000","last_clean_scrub_stamp":"2024-09-14T12:02:02.633771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:42.399562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"263'2","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:06.193129+0000","last_change":"2024-09-14T12:02:06.193129+0000","last_active":"2024-09-14T12:02:06.193129+0000","last_peered":"2024-09-14T12:02:06.193129+0000","last_clean":"2024-09-14T12:02:06.193129+0000","last_became_active":"2024-09-14T11:06:45.991198+0000","last_became_peered":"2024-09-14T11:06:45.991198+0000","last_unstale":"2024-09-14T12:02:06.193129+0000","last_undegraded":"2024-09-14T12:02:06.193129+0000","last_fullsized":"2024-09-14T12:02:06.193129+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:02:06.193045+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:02:06.193045+0000","last_clean_scrub_stamp":"2024-09-14T12:02:06.193045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:34.954633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"263'3","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:04.883006+0000","last_change":"2024-09-14T12:02:04.883006+0000","last_active":"2024-09-14T12:02:04.883006+0000","last_peered":"2024-09-14T12:02:04.883006+0000","last_clean":"2024-09-14T12:02:04.883006+0000","last_became_active":"2024-09-14T11:06:41.910512+0000","last_became_peered":"2024-09-14T11:06:41.910512+0000","last_unstale":"2024-09-14T12:02:04.883006+0000","last_undegraded":"2024-09-14T12:02:04.883006+0000","last_fullsized":"2024-09-14T12:02:04.883006+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:02:04.882922+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:02:04.882922+0000","last_clean_scrub_stamp":"2024-09-14T12:02:04.882922+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:31.861257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"263'44","reported_seq":180,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:17.689562+0000","last_change":"2024-09-14T12:02:17.689562+0000","last_active":"2024-09-14T12:02:17.689562+0000","last_peered":"2024-09-14T12:02:17.689562+0000","last_clean":"2024-09-14T12:02:17.689562+0000","last_became_active":"2024-09-14T11:02:34.881341+0000","last_became_peered":"2024-09-14T11:02:34.881341+0000","last_unstale":"2024-09-14T12:02:17.689562+0000","last_undegraded":"2024-09-14T12:02:17.689562+0000","last_fullsized":"2024-09-14T12:02:17.689562+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'44","last_scrub_stamp":"2024-09-14T12:02:17.689454+0000","last_deep_scrub":"263'44","last_deep_scrub_stamp":"2024-09-14T12:02:17.689454+0000","last_clean_scrub_stamp":"2024-09-14T12:02:17.689454+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:43.935314+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":339,"num_read_kb":228,"num_write":117,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:00:00.542294+0000","last_change":"2024-09-14T11:25:20.210429+0000","last_active":"2024-09-14T12:00:00.542294+0000","last_peered":"2024-09-14T12:00:00.542294+0000","last_clean":"2024-09-14T12:00:00.542294+0000","last_became_active":"2024-09-14T11:25:20.210117+0000","last_became_peered":"2024-09-14T11:25:20.210117+0000","last_unstale":"2024-09-14T12:00:00.542294+0000","last_undegraded":"2024-09-14T12:00:00.542294+0000","last_fullsized":"2024-09-14T12:00:00.542294+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'6","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:08.128651+0000","last_change":"2024-09-14T12:02:08.128651+0000","last_active":"2024-09-14T12:02:08.128651+0000","last_peered":"2024-09-14T12:02:08.128651+0000","last_clean":"2024-09-14T12:02:08.128651+0000","last_became_active":"2024-09-14T11:06:45.992574+0000","last_became_peered":"2024-09-14T11:06:45.992574+0000","last_unstale":"2024-09-14T12:02:08.128651+0000","last_undegraded":"2024-09-14T12:02:08.128651+0000","last_fullsized":"2024-09-14T12:02:08.128651+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:02:08.128560+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:02:08.128560+0000","last_clean_scrub_stamp":"2024-09-14T12:02:08.128560+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:51.137988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:01.142843+0000","last_change":"2024-09-14T12:02:01.142843+0000","last_active":"2024-09-14T12:02:01.142843+0000","last_peered":"2024-09-14T12:02:01.142843+0000","last_clean":"2024-09-14T12:02:01.142843+0000","last_became_active":"2024-09-14T11:06:41.919330+0000","last_became_peered":"2024-09-14T11:06:41.919330+0000","last_unstale":"2024-09-14T12:02:01.142843+0000","last_undegraded":"2024-09-14T12:02:01.142843+0000","last_fullsized":"2024-09-14T12:02:01.142843+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:01.142760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:01.142760+0000","last_clean_scrub_stamp":"2024-09-14T12:02:01.142760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:40.749849+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"263'112","reported_seq":398,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:52.702449+0000","last_change":"2024-09-14T12:01:52.702449+0000","last_active":"2024-09-14T12:01:52.702449+0000","last_peered":"2024-09-14T12:01:52.702449+0000","last_clean":"2024-09-14T12:01:52.702449+0000","last_became_active":"2024-09-14T11:02:34.873360+0000","last_became_peered":"2024-09-14T11:02:34.873360+0000","last_unstale":"2024-09-14T12:01:52.702449+0000","last_undegraded":"2024-09-14T12:01:52.702449+0000","last_fullsized":"2024-09-14T12:01:52.702449+0000","mapping_epoch":252,"log_start":"263'100","ondisk_log_start":"263'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'112","last_scrub_stamp":"2024-09-14T12:01:52.702353+0000","last_deep_scrub":"263'112","last_deep_scrub_stamp":"2024-09-14T12:01:52.702353+0000","last_clean_scrub_stamp":"2024-09-14T12:01:52.702353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:20.277676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1014,"num_read_kb":809,"num_write":225,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:01.607680+0000","last_change":"2024-09-14T12:02:01.607623+0000","last_active":"2024-09-14T12:02:01.607680+0000","last_peered":"2024-09-14T12:02:01.607680+0000","last_clean":"2024-09-14T12:02:01.607680+0000","last_became_active":"2024-09-14T11:25:20.199875+0000","last_became_peered":"2024-09-14T11:25:20.199875+0000","last_unstale":"2024-09-14T12:02:01.607680+0000","last_undegraded":"2024-09-14T12:02:01.607680+0000","last_fullsized":"2024-09-14T12:02:01.607680+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:01.607533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:01.607533+0000","last_clean_scrub_stamp":"2024-09-14T12:02:01.607533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:04.607213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"260'2","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:12.035095+0000","last_change":"2024-09-14T12:02:12.035095+0000","last_active":"2024-09-14T12:02:12.035095+0000","last_peered":"2024-09-14T12:02:12.035095+0000","last_clean":"2024-09-14T12:02:12.035095+0000","last_became_active":"2024-09-14T11:06:45.980035+0000","last_became_peered":"2024-09-14T11:06:45.980035+0000","last_unstale":"2024-09-14T12:02:12.035095+0000","last_undegraded":"2024-09-14T12:02:12.035095+0000","last_fullsized":"2024-09-14T12:02:12.035095+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T12:02:12.035010+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T12:02:12.035010+0000","last_clean_scrub_stamp":"2024-09-14T12:02:12.035010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:30.889757+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"263'3","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:02.139036+0000","last_change":"2024-09-14T12:02:02.139036+0000","last_active":"2024-09-14T12:02:02.139036+0000","last_peered":"2024-09-14T12:02:02.139036+0000","last_clean":"2024-09-14T12:02:02.139036+0000","last_became_active":"2024-09-14T11:06:41.917341+0000","last_became_peered":"2024-09-14T11:06:41.917341+0000","last_unstale":"2024-09-14T12:02:02.139036+0000","last_undegraded":"2024-09-14T12:02:02.139036+0000","last_fullsized":"2024-09-14T12:02:02.139036+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:02:02.138945+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:02:02.138945+0000","last_clean_scrub_stamp":"2024-09-14T12:02:02.138945+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:23.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"260'15","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:58.845971+0000","last_change":"2024-09-14T12:01:58.845971+0000","last_active":"2024-09-14T12:01:58.845971+0000","last_peered":"2024-09-14T12:01:58.845971+0000","last_clean":"2024-09-14T12:01:58.845971+0000","last_became_active":"2024-09-14T11:02:34.876078+0000","last_became_peered":"2024-09-14T11:02:34.876078+0000","last_unstale":"2024-09-14T12:01:58.845971+0000","last_undegraded":"2024-09-14T12:01:58.845971+0000","last_fullsized":"2024-09-14T12:01:58.845971+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'15","last_scrub_stamp":"2024-09-14T12:01:58.845874+0000","last_deep_scrub":"260'15","last_deep_scrub_stamp":"2024-09-14T12:01:58.845874+0000","last_clean_scrub_stamp":"2024-09-14T12:01:58.845874+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:38.473311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":83,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:21.049038+0000","last_change":"2024-09-14T12:02:21.049038+0000","last_active":"2024-09-14T12:02:21.049038+0000","last_peered":"2024-09-14T12:02:21.049038+0000","last_clean":"2024-09-14T12:02:21.049038+0000","last_became_active":"2024-09-14T11:25:20.210181+0000","last_became_peered":"2024-09-14T11:25:20.210181+0000","last_unstale":"2024-09-14T12:02:21.049038+0000","last_undegraded":"2024-09-14T12:02:21.049038+0000","last_fullsized":"2024-09-14T12:02:21.049038+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:21.048947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:21.048947+0000","last_clean_scrub_stamp":"2024-09-14T12:02:21.048947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:33.468565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.532365+0000","last_change":"2024-09-14T11:06:45.984990+0000","last_active":"2024-09-14T11:58:45.532365+0000","last_peered":"2024-09-14T11:58:45.532365+0000","last_clean":"2024-09-14T11:58:45.532365+0000","last_became_active":"2024-09-14T11:06:45.984696+0000","last_became_peered":"2024-09-14T11:06:45.984696+0000","last_unstale":"2024-09-14T11:58:45.532365+0000","last_undegraded":"2024-09-14T11:58:45.532365+0000","last_fullsized":"2024-09-14T11:58:45.532365+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:44.963325+0000","last_clean_scrub_stamp":"2024-09-14T11:06:44.963325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:17.939743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"263'2","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:58.226711+0000","last_change":"2024-09-14T12:01:58.226711+0000","last_active":"2024-09-14T12:01:58.226711+0000","last_peered":"2024-09-14T12:01:58.226711+0000","last_clean":"2024-09-14T12:01:58.226711+0000","last_became_active":"2024-09-14T11:06:41.914209+0000","last_became_peered":"2024-09-14T11:06:41.914209+0000","last_unstale":"2024-09-14T12:01:58.226711+0000","last_undegraded":"2024-09-14T12:01:58.226711+0000","last_fullsized":"2024-09-14T12:01:58.226711+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:01:58.226620+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:01:58.226620+0000","last_clean_scrub_stamp":"2024-09-14T12:01:58.226620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:41.343335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"263'35","reported_seq":156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:57.849960+0000","last_change":"2024-09-14T12:01:57.849960+0000","last_active":"2024-09-14T12:01:57.849960+0000","last_peered":"2024-09-14T12:01:57.849960+0000","last_clean":"2024-09-14T12:01:57.849960+0000","last_became_active":"2024-09-14T11:02:34.879834+0000","last_became_peered":"2024-09-14T11:02:34.879834+0000","last_unstale":"2024-09-14T12:01:57.849960+0000","last_undegraded":"2024-09-14T12:01:57.849960+0000","last_fullsized":"2024-09-14T12:01:57.849960+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'35","last_scrub_stamp":"2024-09-14T12:01:57.849884+0000","last_deep_scrub":"263'35","last_deep_scrub_stamp":"2024-09-14T12:01:57.849884+0000","last_clean_scrub_stamp":"2024-09-14T12:01:57.849884+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:04.537597+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":172,"num_write":95,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:07.982070+0000","last_change":"2024-09-14T12:02:07.982070+0000","last_active":"2024-09-14T12:02:07.982070+0000","last_peered":"2024-09-14T12:02:07.982070+0000","last_clean":"2024-09-14T12:02:07.982070+0000","last_became_active":"2024-09-14T11:25:20.204834+0000","last_became_peered":"2024-09-14T11:25:20.204834+0000","last_unstale":"2024-09-14T12:02:07.982070+0000","last_undegraded":"2024-09-14T12:02:07.982070+0000","last_fullsized":"2024-09-14T12:02:07.982070+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:07.981967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:07.981967+0000","last_clean_scrub_stamp":"2024-09-14T12:02:07.981967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:31.022610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:02.920733+0000","last_change":"2024-09-14T12:02:02.920733+0000","last_active":"2024-09-14T12:02:02.920733+0000","last_peered":"2024-09-14T12:02:02.920733+0000","last_clean":"2024-09-14T12:02:02.920733+0000","last_became_active":"2024-09-14T11:06:45.984865+0000","last_became_peered":"2024-09-14T11:06:45.984865+0000","last_unstale":"2024-09-14T12:02:02.920733+0000","last_undegraded":"2024-09-14T12:02:02.920733+0000","last_fullsized":"2024-09-14T12:02:02.920733+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:02.920632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:02.920632+0000","last_clean_scrub_stamp":"2024-09-14T12:02:02.920632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:26.835967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"260'3","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:05.125197+0000","last_change":"2024-09-14T12:02:05.125197+0000","last_active":"2024-09-14T12:02:05.125197+0000","last_peered":"2024-09-14T12:02:05.125197+0000","last_clean":"2024-09-14T12:02:05.125197+0000","last_became_active":"2024-09-14T11:06:41.909533+0000","last_became_peered":"2024-09-14T11:06:41.909533+0000","last_unstale":"2024-09-14T12:02:05.125197+0000","last_undegraded":"2024-09-14T12:02:05.125197+0000","last_fullsized":"2024-09-14T12:02:05.125197+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T12:02:05.125101+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T12:02:05.125101+0000","last_clean_scrub_stamp":"2024-09-14T12:02:05.125101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:17.037553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"263'25","reported_seq":132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:55.872960+0000","last_change":"2024-09-14T12:01:55.872960+0000","last_active":"2024-09-14T12:01:55.872960+0000","last_peered":"2024-09-14T12:01:55.872960+0000","last_clean":"2024-09-14T12:01:55.872960+0000","last_became_active":"2024-09-14T11:02:34.873259+0000","last_became_peered":"2024-09-14T11:02:34.873259+0000","last_unstale":"2024-09-14T12:01:55.872960+0000","last_undegraded":"2024-09-14T12:01:55.872960+0000","last_fullsized":"2024-09-14T12:01:55.872960+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'25","last_scrub_stamp":"2024-09-14T12:01:55.872878+0000","last_deep_scrub":"263'25","last_deep_scrub_stamp":"2024-09-14T12:01:55.872878+0000","last_clean_scrub_stamp":"2024-09-14T12:01:55.872878+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:30.274992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":129,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"263'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:01.281475+0000","last_change":"2024-09-14T12:02:01.281475+0000","last_active":"2024-09-14T12:02:01.281475+0000","last_peered":"2024-09-14T12:02:01.281475+0000","last_clean":"2024-09-14T12:02:01.281475+0000","last_became_active":"2024-09-14T11:25:20.212293+0000","last_became_peered":"2024-09-14T11:25:20.212293+0000","last_unstale":"2024-09-14T12:02:01.281475+0000","last_undegraded":"2024-09-14T12:02:01.281475+0000","last_fullsized":"2024-09-14T12:02:01.281475+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:02:01.281378+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:02:01.281378+0000","last_clean_scrub_stamp":"2024-09-14T12:02:01.281378+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:12.176617+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:06.873026+0000","last_change":"2024-09-14T12:02:06.873026+0000","last_active":"2024-09-14T12:02:06.873026+0000","last_peered":"2024-09-14T12:02:06.873026+0000","last_clean":"2024-09-14T12:02:06.873026+0000","last_became_active":"2024-09-14T11:06:45.986398+0000","last_became_peered":"2024-09-14T11:06:45.986398+0000","last_unstale":"2024-09-14T12:02:06.873026+0000","last_undegraded":"2024-09-14T12:02:06.873026+0000","last_fullsized":"2024-09-14T12:02:06.873026+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:06.872903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:06.872903+0000","last_clean_scrub_stamp":"2024-09-14T12:02:06.872903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:09.600104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"260'10","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:59.177591+0000","last_change":"2024-09-14T12:01:59.177591+0000","last_active":"2024-09-14T12:01:59.177591+0000","last_peered":"2024-09-14T12:01:59.177591+0000","last_clean":"2024-09-14T12:01:59.177591+0000","last_became_active":"2024-09-14T11:06:41.915491+0000","last_became_peered":"2024-09-14T11:06:41.915491+0000","last_unstale":"2024-09-14T12:01:59.177591+0000","last_undegraded":"2024-09-14T12:01:59.177591+0000","last_fullsized":"2024-09-14T12:01:59.177591+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'10","last_scrub_stamp":"2024-09-14T12:01:59.177516+0000","last_deep_scrub":"260'10","last_deep_scrub_stamp":"2024-09-14T12:01:59.177516+0000","last_clean_scrub_stamp":"2024-09-14T12:01:59.177516+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:40.951015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":40964,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"260'12","reported_seq":99,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:04.164519+0000","last_change":"2024-09-14T12:02:04.164519+0000","last_active":"2024-09-14T12:02:04.164519+0000","last_peered":"2024-09-14T12:02:04.164519+0000","last_clean":"2024-09-14T12:02:04.164519+0000","last_became_active":"2024-09-14T11:02:34.871352+0000","last_became_peered":"2024-09-14T11:02:34.871352+0000","last_unstale":"2024-09-14T12:02:04.164519+0000","last_undegraded":"2024-09-14T12:02:04.164519+0000","last_fullsized":"2024-09-14T12:02:04.164519+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'12","last_scrub_stamp":"2024-09-14T12:02:04.164434+0000","last_deep_scrub":"260'12","last_deep_scrub_stamp":"2024-09-14T12:02:04.164434+0000","last_clean_scrub_stamp":"2024-09-14T12:02:04.164434+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:05.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:12.039602+0000","last_change":"2024-09-14T12:02:12.039602+0000","last_active":"2024-09-14T12:02:12.039602+0000","last_peered":"2024-09-14T12:02:12.039602+0000","last_clean":"2024-09-14T12:02:12.039602+0000","last_became_active":"2024-09-14T11:25:20.213785+0000","last_became_peered":"2024-09-14T11:25:20.213785+0000","last_unstale":"2024-09-14T12:02:12.039602+0000","last_undegraded":"2024-09-14T12:02:12.039602+0000","last_fullsized":"2024-09-14T12:02:12.039602+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:12.039516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:12.039516+0000","last_clean_scrub_stamp":"2024-09-14T12:02:12.039516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:26.089026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"260'2","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:57.339142+0000","last_change":"2024-09-14T12:01:57.339142+0000","last_active":"2024-09-14T12:01:57.339142+0000","last_peered":"2024-09-14T12:01:57.339142+0000","last_clean":"2024-09-14T12:01:57.339142+0000","last_became_active":"2024-09-14T11:06:45.981476+0000","last_became_peered":"2024-09-14T11:06:45.981476+0000","last_unstale":"2024-09-14T12:01:57.339142+0000","last_undegraded":"2024-09-14T12:01:57.339142+0000","last_fullsized":"2024-09-14T12:01:57.339142+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T12:01:57.339050+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T12:01:57.339050+0000","last_clean_scrub_stamp":"2024-09-14T12:01:57.339050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:17.523005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"260'2","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:20.654700+0000","last_change":"2024-09-14T12:02:20.654700+0000","last_active":"2024-09-14T12:02:20.654700+0000","last_peered":"2024-09-14T12:02:20.654700+0000","last_clean":"2024-09-14T12:02:20.654700+0000","last_became_active":"2024-09-14T11:06:41.911413+0000","last_became_peered":"2024-09-14T11:06:41.911413+0000","last_unstale":"2024-09-14T12:02:20.654700+0000","last_undegraded":"2024-09-14T12:02:20.654700+0000","last_fullsized":"2024-09-14T12:02:20.654700+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T12:02:20.654598+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T12:02:20.654598+0000","last_clean_scrub_stamp":"2024-09-14T12:02:20.654598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:43.066086+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"263'38","reported_seq":172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:52.297692+0000","last_change":"2024-09-14T12:01:52.297692+0000","last_active":"2024-09-14T12:01:52.297692+0000","last_peered":"2024-09-14T12:01:52.297692+0000","last_clean":"2024-09-14T12:01:52.297692+0000","last_became_active":"2024-09-14T11:02:34.878752+0000","last_became_peered":"2024-09-14T11:02:34.878752+0000","last_unstale":"2024-09-14T12:01:52.297692+0000","last_undegraded":"2024-09-14T12:01:52.297692+0000","last_fullsized":"2024-09-14T12:01:52.297692+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'38","last_scrub_stamp":"2024-09-14T12:01:52.297591+0000","last_deep_scrub":"263'38","last_deep_scrub_stamp":"2024-09-14T12:01:52.297591+0000","last_clean_scrub_stamp":"2024-09-14T12:01:52.297591+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:53.254453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":231,"num_write":89,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:59.302841+0000","last_change":"2024-09-14T12:01:59.302841+0000","last_active":"2024-09-14T12:01:59.302841+0000","last_peered":"2024-09-14T12:01:59.302841+0000","last_clean":"2024-09-14T12:01:59.302841+0000","last_became_active":"2024-09-14T11:25:20.210999+0000","last_became_peered":"2024-09-14T11:25:20.210999+0000","last_unstale":"2024-09-14T12:01:59.302841+0000","last_undegraded":"2024-09-14T12:01:59.302841+0000","last_fullsized":"2024-09-14T12:01:59.302841+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:59.302753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:59.302753+0000","last_clean_scrub_stamp":"2024-09-14T12:01:59.302753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:55.806305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:11.068048+0000","last_change":"2024-09-14T12:02:11.068048+0000","last_active":"2024-09-14T12:02:11.068048+0000","last_peered":"2024-09-14T12:02:11.068048+0000","last_clean":"2024-09-14T12:02:11.068048+0000","last_became_active":"2024-09-14T11:06:45.982181+0000","last_became_peered":"2024-09-14T11:06:45.982181+0000","last_unstale":"2024-09-14T12:02:11.068048+0000","last_undegraded":"2024-09-14T12:02:11.068048+0000","last_fullsized":"2024-09-14T12:02:11.068048+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:11.067962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:11.067962+0000","last_clean_scrub_stamp":"2024-09-14T12:02:11.067962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:07.109261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:18.698541+0000","last_change":"2024-09-14T12:02:18.698541+0000","last_active":"2024-09-14T12:02:18.698541+0000","last_peered":"2024-09-14T12:02:18.698541+0000","last_clean":"2024-09-14T12:02:18.698541+0000","last_became_active":"2024-09-14T11:06:41.913192+0000","last_became_peered":"2024-09-14T11:06:41.913192+0000","last_unstale":"2024-09-14T12:02:18.698541+0000","last_undegraded":"2024-09-14T12:02:18.698541+0000","last_fullsized":"2024-09-14T12:02:18.698541+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:18.698452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:18.698452+0000","last_clean_scrub_stamp":"2024-09-14T12:02:18.698452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:36.623923+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"263'32","reported_seq":151,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:04.697710+0000","last_change":"2024-09-14T12:02:04.697710+0000","last_active":"2024-09-14T12:02:04.697710+0000","last_peered":"2024-09-14T12:02:04.697710+0000","last_clean":"2024-09-14T12:02:04.697710+0000","last_became_active":"2024-09-14T11:02:34.874328+0000","last_became_peered":"2024-09-14T11:02:34.874328+0000","last_unstale":"2024-09-14T12:02:04.697710+0000","last_undegraded":"2024-09-14T12:02:04.697710+0000","last_fullsized":"2024-09-14T12:02:04.697710+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'32","last_scrub_stamp":"2024-09-14T12:02:04.697613+0000","last_deep_scrub":"263'32","last_deep_scrub_stamp":"2024-09-14T12:02:04.697613+0000","last_clean_scrub_stamp":"2024-09-14T12:02:04.697613+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:11.839878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":246,"num_read_kb":166,"num_write":81,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:00.318918+0000","last_change":"2024-09-14T12:02:00.318918+0000","last_active":"2024-09-14T12:02:00.318918+0000","last_peered":"2024-09-14T12:02:00.318918+0000","last_clean":"2024-09-14T12:02:00.318918+0000","last_became_active":"2024-09-14T11:25:20.213577+0000","last_became_peered":"2024-09-14T11:25:20.213577+0000","last_unstale":"2024-09-14T12:02:00.318918+0000","last_undegraded":"2024-09-14T12:02:00.318918+0000","last_fullsized":"2024-09-14T12:02:00.318918+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:00.318831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:00.318831+0000","last_clean_scrub_stamp":"2024-09-14T12:02:00.318831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:51.312386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"263'10","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:10.039257+0000","last_change":"2024-09-14T12:02:10.039257+0000","last_active":"2024-09-14T12:02:10.039257+0000","last_peered":"2024-09-14T12:02:10.039257+0000","last_clean":"2024-09-14T12:02:10.039257+0000","last_became_active":"2024-09-14T11:06:45.990855+0000","last_became_peered":"2024-09-14T11:06:45.990855+0000","last_unstale":"2024-09-14T12:02:10.039257+0000","last_undegraded":"2024-09-14T12:02:10.039257+0000","last_fullsized":"2024-09-14T12:02:10.039257+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-09-14T12:02:10.039171+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-09-14T12:02:10.039171+0000","last_clean_scrub_stamp":"2024-09-14T12:02:10.039171+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:49.857634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6246,"num_write":20,"num_write_kb":2098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"263'8","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:07.603786+0000","last_change":"2024-09-14T12:02:07.603786+0000","last_active":"2024-09-14T12:02:07.603786+0000","last_peered":"2024-09-14T12:02:07.603786+0000","last_clean":"2024-09-14T12:02:07.603786+0000","last_became_active":"2024-09-14T11:06:41.913454+0000","last_became_peered":"2024-09-14T11:06:41.913454+0000","last_unstale":"2024-09-14T12:02:07.603786+0000","last_undegraded":"2024-09-14T12:02:07.603786+0000","last_fullsized":"2024-09-14T12:02:07.603786+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-14T12:02:07.603699+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-14T12:02:07.603699+0000","last_clean_scrub_stamp":"2024-09-14T12:02:07.603699+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:58.576518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":18,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'130","reported_seq":452,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:13.668831+0000","last_change":"2024-09-14T12:02:13.668831+0000","last_active":"2024-09-14T12:02:13.668831+0000","last_peered":"2024-09-14T12:02:13.668831+0000","last_clean":"2024-09-14T12:02:13.668831+0000","last_became_active":"2024-09-14T11:02:34.878813+0000","last_became_peered":"2024-09-14T11:02:34.878813+0000","last_unstale":"2024-09-14T12:02:13.668831+0000","last_undegraded":"2024-09-14T12:02:13.668831+0000","last_fullsized":"2024-09-14T12:02:13.668831+0000","mapping_epoch":252,"log_start":"260'100","ondisk_log_start":"260'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'130","last_scrub_stamp":"2024-09-14T12:02:13.668739+0000","last_deep_scrub":"263'130","last_deep_scrub_stamp":"2024-09-14T12:02:13.668739+0000","last_clean_scrub_stamp":"2024-09-14T12:02:13.668739+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:28.464724+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1195,"num_read_kb":1160,"num_write":263,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:18.992177+0000","last_change":"2024-09-14T12:02:18.992177+0000","last_active":"2024-09-14T12:02:18.992177+0000","last_peered":"2024-09-14T12:02:18.992177+0000","last_clean":"2024-09-14T12:02:18.992177+0000","last_became_active":"2024-09-14T11:25:20.212665+0000","last_became_peered":"2024-09-14T11:25:20.212665+0000","last_unstale":"2024-09-14T12:02:18.992177+0000","last_undegraded":"2024-09-14T12:02:18.992177+0000","last_fullsized":"2024-09-14T12:02:18.992177+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:18.992078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:18.992078+0000","last_clean_scrub_stamp":"2024-09-14T12:02:18.992078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:41.949050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:56.329477+0000","last_change":"2024-09-14T12:01:56.329477+0000","last_active":"2024-09-14T12:01:56.329477+0000","last_peered":"2024-09-14T12:01:56.329477+0000","last_clean":"2024-09-14T12:01:56.329477+0000","last_became_active":"2024-09-14T11:06:45.992066+0000","last_became_peered":"2024-09-14T11:06:45.992066+0000","last_unstale":"2024-09-14T12:01:56.329477+0000","last_undegraded":"2024-09-14T12:01:56.329477+0000","last_fullsized":"2024-09-14T12:01:56.329477+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:56.329370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:56.329370+0000","last_clean_scrub_stamp":"2024-09-14T12:01:56.329370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:14.427233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"260'3","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:58.924814+0000","last_change":"2024-09-14T12:01:58.924814+0000","last_active":"2024-09-14T12:01:58.924814+0000","last_peered":"2024-09-14T12:01:58.924814+0000","last_clean":"2024-09-14T12:01:58.924814+0000","last_became_active":"2024-09-14T11:06:41.912405+0000","last_became_peered":"2024-09-14T11:06:41.912405+0000","last_unstale":"2024-09-14T12:01:58.924814+0000","last_undegraded":"2024-09-14T12:01:58.924814+0000","last_fullsized":"2024-09-14T12:01:58.924814+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T12:01:58.924722+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T12:01:58.924722+0000","last_clean_scrub_stamp":"2024-09-14T12:01:58.924722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:20.646458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"263'36","reported_seq":166,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:53.832115+0000","last_change":"2024-09-14T12:01:53.832115+0000","last_active":"2024-09-14T12:01:53.832115+0000","last_peered":"2024-09-14T12:01:53.832115+0000","last_clean":"2024-09-14T12:01:53.832115+0000","last_became_active":"2024-09-14T11:02:34.873089+0000","last_became_peered":"2024-09-14T11:02:34.873089+0000","last_unstale":"2024-09-14T12:01:53.832115+0000","last_undegraded":"2024-09-14T12:01:53.832115+0000","last_fullsized":"2024-09-14T12:01:53.832115+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'36","last_scrub_stamp":"2024-09-14T12:01:53.832028+0000","last_deep_scrub":"263'36","last_deep_scrub_stamp":"2024-09-14T12:01:53.832028+0000","last_clean_scrub_stamp":"2024-09-14T12:01:53.832028+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:15.408768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":295,"num_read_kb":200,"num_write":86,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.531790+0000","last_change":"2024-09-14T11:25:20.210966+0000","last_active":"2024-09-14T11:58:40.531790+0000","last_peered":"2024-09-14T11:58:40.531790+0000","last_clean":"2024-09-14T11:58:40.531790+0000","last_became_active":"2024-09-14T11:25:20.210331+0000","last_became_peered":"2024-09-14T11:25:20.210331+0000","last_unstale":"2024-09-14T11:58:40.531790+0000","last_undegraded":"2024-09-14T11:58:40.531790+0000","last_fullsized":"2024-09-14T11:58:40.531790+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:27.694386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:24.586188+0000","last_change":"2024-09-14T12:02:24.586188+0000","last_active":"2024-09-14T12:02:24.586188+0000","last_peered":"2024-09-14T12:02:24.586188+0000","last_clean":"2024-09-14T12:02:24.586188+0000","last_became_active":"2024-09-14T11:06:45.985792+0000","last_became_peered":"2024-09-14T11:06:45.985792+0000","last_unstale":"2024-09-14T12:02:24.586188+0000","last_undegraded":"2024-09-14T12:02:24.586188+0000","last_fullsized":"2024-09-14T12:02:24.586188+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:24.586081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:24.586081+0000","last_clean_scrub_stamp":"2024-09-14T12:02:24.586081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:41.061641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:19.690194+0000","last_change":"2024-09-14T12:02:19.690194+0000","last_active":"2024-09-14T12:02:19.690194+0000","last_peered":"2024-09-14T12:02:19.690194+0000","last_clean":"2024-09-14T12:02:19.690194+0000","last_became_active":"2024-09-14T11:06:41.913214+0000","last_became_peered":"2024-09-14T11:06:41.913214+0000","last_unstale":"2024-09-14T12:02:19.690194+0000","last_undegraded":"2024-09-14T12:02:19.690194+0000","last_fullsized":"2024-09-14T12:02:19.690194+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:19.690097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:19.690097+0000","last_clean_scrub_stamp":"2024-09-14T12:02:19.690097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:57.245612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"263'55","reported_seq":217,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:00.159255+0000","last_change":"2024-09-14T12:02:00.159255+0000","last_active":"2024-09-14T12:02:00.159255+0000","last_peered":"2024-09-14T12:02:00.159255+0000","last_clean":"2024-09-14T12:02:00.159255+0000","last_became_active":"2024-09-14T11:02:34.873554+0000","last_became_peered":"2024-09-14T11:02:34.873554+0000","last_unstale":"2024-09-14T12:02:00.159255+0000","last_undegraded":"2024-09-14T12:02:00.159255+0000","last_fullsized":"2024-09-14T12:02:00.159255+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'55","last_scrub_stamp":"2024-09-14T12:02:00.159178+0000","last_deep_scrub":"263'55","last_deep_scrub_stamp":"2024-09-14T12:02:00.159178+0000","last_clean_scrub_stamp":"2024-09-14T12:02:00.159178+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:11.640741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":297,"num_write":136,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"263'2","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:13.063258+0000","last_change":"2024-09-14T12:02:13.063258+0000","last_active":"2024-09-14T12:02:13.063258+0000","last_peered":"2024-09-14T12:02:13.063258+0000","last_clean":"2024-09-14T12:02:13.063258+0000","last_became_active":"2024-09-14T11:25:20.208985+0000","last_became_peered":"2024-09-14T11:25:20.208985+0000","last_unstale":"2024-09-14T12:02:13.063258+0000","last_undegraded":"2024-09-14T12:02:13.063258+0000","last_fullsized":"2024-09-14T12:02:13.063258+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:02:13.063141+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:02:13.063141+0000","last_clean_scrub_stamp":"2024-09-14T12:02:13.063141+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:14.600067+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"260'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:09.570212+0000","last_change":"2024-09-14T12:02:09.570212+0000","last_active":"2024-09-14T12:02:09.570212+0000","last_peered":"2024-09-14T12:02:09.570212+0000","last_clean":"2024-09-14T12:02:09.570212+0000","last_became_active":"2024-09-14T11:06:45.987665+0000","last_became_peered":"2024-09-14T11:06:45.987665+0000","last_unstale":"2024-09-14T12:02:09.570212+0000","last_undegraded":"2024-09-14T12:02:09.570212+0000","last_fullsized":"2024-09-14T12:02:09.570212+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T12:02:09.570128+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T12:02:09.570128+0000","last_clean_scrub_stamp":"2024-09-14T12:02:09.570128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:38.939945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5649,"num_write":5,"num_write_kb":5649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"260'8","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:59.952584+0000","last_change":"2024-09-14T12:01:59.952584+0000","last_active":"2024-09-14T12:01:59.952584+0000","last_peered":"2024-09-14T12:01:59.952584+0000","last_clean":"2024-09-14T12:01:59.952584+0000","last_became_active":"2024-09-14T11:06:41.906528+0000","last_became_peered":"2024-09-14T11:06:41.906528+0000","last_unstale":"2024-09-14T12:01:59.952584+0000","last_undegraded":"2024-09-14T12:01:59.952584+0000","last_fullsized":"2024-09-14T12:01:59.952584+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-14T12:01:59.952493+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-14T12:01:59.952493+0000","last_clean_scrub_stamp":"2024-09-14T12:01:59.952493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:37.534736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"263'49","reported_seq":199,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:52.783772+0000","last_change":"2024-09-14T12:01:52.783772+0000","last_active":"2024-09-14T12:01:52.783772+0000","last_peered":"2024-09-14T12:01:52.783772+0000","last_clean":"2024-09-14T12:01:52.783772+0000","last_became_active":"2024-09-14T11:02:34.869154+0000","last_became_peered":"2024-09-14T11:02:34.869154+0000","last_unstale":"2024-09-14T12:01:52.783772+0000","last_undegraded":"2024-09-14T12:01:52.783772+0000","last_fullsized":"2024-09-14T12:01:52.783772+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'49","last_scrub_stamp":"2024-09-14T12:01:52.783668+0000","last_deep_scrub":"263'49","last_deep_scrub_stamp":"2024-09-14T12:01:52.783668+0000","last_clean_scrub_stamp":"2024-09-14T12:01:52.783668+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:21.022547+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":272,"num_write":122,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:10.613230+0000","last_change":"2024-09-14T12:02:10.613125+0000","last_active":"2024-09-14T12:02:10.613230+0000","last_peered":"2024-09-14T12:02:10.613230+0000","last_clean":"2024-09-14T12:02:10.613230+0000","last_became_active":"2024-09-14T11:25:20.208992+0000","last_became_peered":"2024-09-14T11:25:20.208992+0000","last_unstale":"2024-09-14T12:02:10.613230+0000","last_undegraded":"2024-09-14T12:02:10.613230+0000","last_fullsized":"2024-09-14T12:02:10.613230+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:10.612998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:10.612998+0000","last_clean_scrub_stamp":"2024-09-14T12:02:10.612998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:58.370057+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"263'5","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:23.581992+0000","last_change":"2024-09-14T12:02:23.581992+0000","last_active":"2024-09-14T12:02:23.581992+0000","last_peered":"2024-09-14T12:02:23.581992+0000","last_clean":"2024-09-14T12:02:23.581992+0000","last_became_active":"2024-09-14T11:06:45.985518+0000","last_became_peered":"2024-09-14T11:06:45.985518+0000","last_unstale":"2024-09-14T12:02:23.581992+0000","last_undegraded":"2024-09-14T12:02:23.581992+0000","last_fullsized":"2024-09-14T12:02:23.581992+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T12:02:23.581898+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T12:02:23.581898+0000","last_clean_scrub_stamp":"2024-09-14T12:02:23.581898+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:23.519228+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"263'3","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:16.657970+0000","last_change":"2024-09-14T12:02:16.657970+0000","last_active":"2024-09-14T12:02:16.657970+0000","last_peered":"2024-09-14T12:02:16.657970+0000","last_clean":"2024-09-14T12:02:16.657970+0000","last_became_active":"2024-09-14T11:06:41.914346+0000","last_became_peered":"2024-09-14T11:06:41.914346+0000","last_unstale":"2024-09-14T12:02:16.657970+0000","last_undegraded":"2024-09-14T12:02:16.657970+0000","last_fullsized":"2024-09-14T12:02:16.657970+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:02:16.657881+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:02:16.657881+0000","last_clean_scrub_stamp":"2024-09-14T12:02:16.657881+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:53.958965+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"263'33","reported_seq":153,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:12.643498+0000","last_change":"2024-09-14T12:02:12.643498+0000","last_active":"2024-09-14T12:02:12.643498+0000","last_peered":"2024-09-14T12:02:12.643498+0000","last_clean":"2024-09-14T12:02:12.643498+0000","last_became_active":"2024-09-14T11:02:34.880066+0000","last_became_peered":"2024-09-14T11:02:34.880066+0000","last_unstale":"2024-09-14T12:02:12.643498+0000","last_undegraded":"2024-09-14T12:02:12.643498+0000","last_fullsized":"2024-09-14T12:02:12.643498+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'33","last_scrub_stamp":"2024-09-14T12:02:12.643368+0000","last_deep_scrub":"263'33","last_deep_scrub_stamp":"2024-09-14T12:02:12.643368+0000","last_clean_scrub_stamp":"2024-09-14T12:02:12.643368+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:05.743078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":165,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:17.997711+0000","last_change":"2024-09-14T12:02:17.997711+0000","last_active":"2024-09-14T12:02:17.997711+0000","last_peered":"2024-09-14T12:02:17.997711+0000","last_clean":"2024-09-14T12:02:17.997711+0000","last_became_active":"2024-09-14T11:25:20.208291+0000","last_became_peered":"2024-09-14T11:25:20.208291+0000","last_unstale":"2024-09-14T12:02:17.997711+0000","last_undegraded":"2024-09-14T12:02:17.997711+0000","last_fullsized":"2024-09-14T12:02:17.997711+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:17.997625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:17.997625+0000","last_clean_scrub_stamp":"2024-09-14T12:02:17.997625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:22.806458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"260'3","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:03.897966+0000","last_change":"2024-09-14T12:02:03.897966+0000","last_active":"2024-09-14T12:02:03.897966+0000","last_peered":"2024-09-14T12:02:03.897966+0000","last_clean":"2024-09-14T12:02:03.897966+0000","last_became_active":"2024-09-14T11:06:45.988268+0000","last_became_peered":"2024-09-14T11:06:45.988268+0000","last_unstale":"2024-09-14T12:02:03.897966+0000","last_undegraded":"2024-09-14T12:02:03.897966+0000","last_fullsized":"2024-09-14T12:02:03.897966+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T12:02:03.897879+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T12:02:03.897879+0000","last_clean_scrub_stamp":"2024-09-14T12:02:03.897879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:18.891047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:03.839558+0000","last_change":"2024-09-14T12:02:03.839558+0000","last_active":"2024-09-14T12:02:03.839558+0000","last_peered":"2024-09-14T12:02:03.839558+0000","last_clean":"2024-09-14T12:02:03.839558+0000","last_became_active":"2024-09-14T11:06:41.909915+0000","last_became_peered":"2024-09-14T11:06:41.909915+0000","last_unstale":"2024-09-14T12:02:03.839558+0000","last_undegraded":"2024-09-14T12:02:03.839558+0000","last_fullsized":"2024-09-14T12:02:03.839558+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:03.839467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:03.839467+0000","last_clean_scrub_stamp":"2024-09-14T12:02:03.839467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:27.313760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"263'21","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:11.661293+0000","last_change":"2024-09-14T12:02:11.661293+0000","last_active":"2024-09-14T12:02:11.661293+0000","last_peered":"2024-09-14T12:02:11.661293+0000","last_clean":"2024-09-14T12:02:11.661293+0000","last_became_active":"2024-09-14T11:02:34.877791+0000","last_became_peered":"2024-09-14T11:02:34.877791+0000","last_unstale":"2024-09-14T12:02:11.661293+0000","last_undegraded":"2024-09-14T12:02:11.661293+0000","last_fullsized":"2024-09-14T12:02:11.661293+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'21","last_scrub_stamp":"2024-09-14T12:02:11.661188+0000","last_deep_scrub":"263'21","last_deep_scrub_stamp":"2024-09-14T12:02:11.661188+0000","last_clean_scrub_stamp":"2024-09-14T12:02:11.661188+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:34.084256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":103,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:40.531860+0000","last_change":"2024-09-14T11:25:20.208774+0000","last_active":"2024-09-14T11:58:40.531860+0000","last_peered":"2024-09-14T11:58:40.531860+0000","last_clean":"2024-09-14T11:58:40.531860+0000","last_became_active":"2024-09-14T11:25:20.208495+0000","last_became_peered":"2024-09-14T11:25:20.208495+0000","last_unstale":"2024-09-14T11:58:40.531860+0000","last_undegraded":"2024-09-14T11:58:40.531860+0000","last_fullsized":"2024-09-14T11:58:40.531860+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:19.187758+0000","last_clean_scrub_stamp":"2024-09-14T11:25:19.187758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:18.019657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"263'3","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:01.969507+0000","last_change":"2024-09-14T12:02:01.969507+0000","last_active":"2024-09-14T12:02:01.969507+0000","last_peered":"2024-09-14T12:02:01.969507+0000","last_clean":"2024-09-14T12:02:01.969507+0000","last_became_active":"2024-09-14T11:06:45.986990+0000","last_became_peered":"2024-09-14T11:06:45.986990+0000","last_unstale":"2024-09-14T12:02:01.969507+0000","last_undegraded":"2024-09-14T12:02:01.969507+0000","last_fullsized":"2024-09-14T12:02:01.969507+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:02:01.969414+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:02:01.969414+0000","last_clean_scrub_stamp":"2024-09-14T12:02:01.969414+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:59.943974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:54.673980+0000","last_change":"2024-09-14T12:01:54.673980+0000","last_active":"2024-09-14T12:01:54.673980+0000","last_peered":"2024-09-14T12:01:54.673980+0000","last_clean":"2024-09-14T12:01:54.673980+0000","last_became_active":"2024-09-14T11:06:41.915372+0000","last_became_peered":"2024-09-14T11:06:41.915372+0000","last_unstale":"2024-09-14T12:01:54.673980+0000","last_undegraded":"2024-09-14T12:01:54.673980+0000","last_fullsized":"2024-09-14T12:01:54.673980+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:54.673887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:54.673887+0000","last_clean_scrub_stamp":"2024-09-14T12:01:54.673887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:46.613871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"263'13","reported_seq":104,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:54.829095+0000","last_change":"2024-09-14T12:01:54.829095+0000","last_active":"2024-09-14T12:01:54.829095+0000","last_peered":"2024-09-14T12:01:54.829095+0000","last_clean":"2024-09-14T12:01:54.829095+0000","last_became_active":"2024-09-14T11:02:34.879002+0000","last_became_peered":"2024-09-14T11:02:34.879002+0000","last_unstale":"2024-09-14T12:01:54.829095+0000","last_undegraded":"2024-09-14T12:01:54.829095+0000","last_fullsized":"2024-09-14T12:01:54.829095+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-14T12:01:54.829007+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-14T12:01:54.829007+0000","last_clean_scrub_stamp":"2024-09-14T12:01:54.829007+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:39.245401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":56,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'347","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.278191+0000","last_change":"2024-09-14T12:01:32.278080+0000","last_active":"2024-09-14T12:01:32.278191+0000","last_peered":"2024-09-14T12:01:32.278191+0000","last_clean":"2024-09-14T12:01:32.278191+0000","last_became_active":"2024-09-14T10:46:44.331827+0000","last_became_peered":"2024-09-14T10:46:44.331827+0000","last_unstale":"2024-09-14T12:01:32.278191+0000","last_undegraded":"2024-09-14T12:01:32.278191+0000","last_fullsized":"2024-09-14T12:01:32.278191+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-09-14T12:01:32.277953+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-09-14T12:01:32.277953+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.277953+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:37.814804+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":808,"num_read_kb":10519,"num_write":1133,"num_write_kb":31597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"263'509","reported_seq":2212,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.715793+0000","last_change":"2024-09-14T12:01:37.715729+0000","last_active":"2024-09-14T12:01:37.715793+0000","last_peered":"2024-09-14T12:01:37.715793+0000","last_clean":"2024-09-14T12:01:37.715793+0000","last_became_active":"2024-09-14T10:46:46.340949+0000","last_became_peered":"2024-09-14T10:46:46.340949+0000","last_unstale":"2024-09-14T12:01:37.715793+0000","last_undegraded":"2024-09-14T12:01:37.715793+0000","last_fullsized":"2024-09-14T12:01:37.715793+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'509","last_scrub_stamp":"2024-09-14T12:01:37.715648+0000","last_deep_scrub":"263'509","last_deep_scrub_stamp":"2024-09-14T12:01:37.715648+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.715648+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:12.260760+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2834,"num_read_kb":2670,"num_write":604,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"263'354","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.242897+0000","last_change":"2024-09-14T12:01:38.242836+0000","last_active":"2024-09-14T12:01:38.242897+0000","last_peered":"2024-09-14T12:01:38.242897+0000","last_clean":"2024-09-14T12:01:38.242897+0000","last_became_active":"2024-09-14T10:46:44.332997+0000","last_became_peered":"2024-09-14T10:46:44.332997+0000","last_unstale":"2024-09-14T12:01:38.242897+0000","last_undegraded":"2024-09-14T12:01:38.242897+0000","last_fullsized":"2024-09-14T12:01:38.242897+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'354","last_scrub_stamp":"2024-09-14T12:01:38.242731+0000","last_deep_scrub":"263'354","last_deep_scrub_stamp":"2024-09-14T12:01:38.242731+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.242731+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:20.221917+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":584,"num_read_kb":4891,"num_write":1057,"num_write_kb":34401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"263'668","reported_seq":2323,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.842340+0000","last_change":"2024-09-14T12:01:45.842271+0000","last_active":"2024-09-14T12:01:45.842340+0000","last_peered":"2024-09-14T12:01:45.842340+0000","last_clean":"2024-09-14T12:01:45.842340+0000","last_became_active":"2024-09-14T10:46:46.340612+0000","last_became_peered":"2024-09-14T10:46:46.340612+0000","last_unstale":"2024-09-14T12:01:45.842340+0000","last_undegraded":"2024-09-14T12:01:45.842340+0000","last_fullsized":"2024-09-14T12:01:45.842340+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'668","last_scrub_stamp":"2024-09-14T12:01:45.842183+0000","last_deep_scrub":"263'668","last_deep_scrub_stamp":"2024-09-14T12:01:45.842183+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.842183+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":600,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:23.087207+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3359,"num_read_kb":3045,"num_write":872,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"263'315","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.268744+0000","last_change":"2024-09-14T12:01:37.268681+0000","last_active":"2024-09-14T12:01:37.268744+0000","last_peered":"2024-09-14T12:01:37.268744+0000","last_clean":"2024-09-14T12:01:37.268744+0000","last_became_active":"2024-09-14T10:46:44.320254+0000","last_became_peered":"2024-09-14T10:46:44.320254+0000","last_unstale":"2024-09-14T12:01:37.268744+0000","last_undegraded":"2024-09-14T12:01:37.268744+0000","last_fullsized":"2024-09-14T12:01:37.268744+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'315","last_scrub_stamp":"2024-09-14T12:01:37.268548+0000","last_deep_scrub":"263'315","last_deep_scrub_stamp":"2024-09-14T12:01:37.268548+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.268548+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:39.392560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":578,"num_read_kb":18043,"num_write":1147,"num_write_kb":30368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"263'456","reported_seq":1894,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:50.894023+0000","last_change":"2024-09-14T12:01:50.894023+0000","last_active":"2024-09-14T12:01:50.894023+0000","last_peered":"2024-09-14T12:01:50.894023+0000","last_clean":"2024-09-14T12:01:50.894023+0000","last_became_active":"2024-09-14T10:46:46.337092+0000","last_became_peered":"2024-09-14T10:46:46.337092+0000","last_unstale":"2024-09-14T12:01:50.894023+0000","last_undegraded":"2024-09-14T12:01:50.894023+0000","last_fullsized":"2024-09-14T12:01:50.894023+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'456","last_scrub_stamp":"2024-09-14T12:01:50.893935+0000","last_deep_scrub":"263'456","last_deep_scrub_stamp":"2024-09-14T12:01:50.893935+0000","last_clean_scrub_stamp":"2024-09-14T12:01:50.893935+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:36.400620+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2407,"num_read_kb":2236,"num_write":590,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"263'320","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.828433+0000","last_change":"2024-09-14T12:01:30.828433+0000","last_active":"2024-09-14T12:01:30.828433+0000","last_peered":"2024-09-14T12:01:30.828433+0000","last_clean":"2024-09-14T12:01:30.828433+0000","last_became_active":"2024-09-14T10:46:44.321098+0000","last_became_peered":"2024-09-14T10:46:44.321098+0000","last_unstale":"2024-09-14T12:01:30.828433+0000","last_undegraded":"2024-09-14T12:01:30.828433+0000","last_fullsized":"2024-09-14T12:01:30.828433+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'320","last_scrub_stamp":"2024-09-14T12:01:30.828329+0000","last_deep_scrub":"263'320","last_deep_scrub_stamp":"2024-09-14T12:01:30.828329+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.828329+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:12.296951+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":621,"num_read_kb":93491,"num_write":1039,"num_write_kb":33828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"263'564","reported_seq":2232,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.576450+0000","last_change":"2024-09-14T12:01:42.576372+0000","last_active":"2024-09-14T12:01:42.576450+0000","last_peered":"2024-09-14T12:01:42.576450+0000","last_clean":"2024-09-14T12:01:42.576450+0000","last_became_active":"2024-09-14T10:46:46.337883+0000","last_became_peered":"2024-09-14T10:46:46.337883+0000","last_unstale":"2024-09-14T12:01:42.576450+0000","last_undegraded":"2024-09-14T12:01:42.576450+0000","last_fullsized":"2024-09-14T12:01:42.576450+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'564","last_scrub_stamp":"2024-09-14T12:01:42.576290+0000","last_deep_scrub":"263'564","last_deep_scrub_stamp":"2024-09-14T12:01:42.576290+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.576290+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":500,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:57.196401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3147,"num_read_kb":2923,"num_write":727,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"263'377","reported_seq":1065,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.257994+0000","last_change":"2024-09-14T12:01:33.257931+0000","last_active":"2024-09-14T12:01:33.257994+0000","last_peered":"2024-09-14T12:01:33.257994+0000","last_clean":"2024-09-14T12:01:33.257994+0000","last_became_active":"2024-09-14T10:46:44.324768+0000","last_became_peered":"2024-09-14T10:46:44.324768+0000","last_unstale":"2024-09-14T12:01:33.257994+0000","last_undegraded":"2024-09-14T12:01:33.257994+0000","last_fullsized":"2024-09-14T12:01:33.257994+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-14T12:01:33.257829+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-14T12:01:33.257829+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.257829+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:41.419490+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":706,"num_read_kb":82703,"num_write":1285,"num_write_kb":36007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"263'448","reported_seq":2083,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.239959+0000","last_change":"2024-09-14T12:01:41.239959+0000","last_active":"2024-09-14T12:01:41.239959+0000","last_peered":"2024-09-14T12:01:41.239959+0000","last_clean":"2024-09-14T12:01:41.239959+0000","last_became_active":"2024-09-14T10:46:46.338973+0000","last_became_peered":"2024-09-14T10:46:46.338973+0000","last_unstale":"2024-09-14T12:01:41.239959+0000","last_undegraded":"2024-09-14T12:01:41.239959+0000","last_fullsized":"2024-09-14T12:01:41.239959+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'448","last_scrub_stamp":"2024-09-14T12:01:41.239865+0000","last_deep_scrub":"263'448","last_deep_scrub_stamp":"2024-09-14T12:01:41.239865+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.239865+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:15.050347+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2500,"num_read_kb":2382,"num_write":507,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"263'357","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.825671+0000","last_change":"2024-09-14T12:01:29.825614+0000","last_active":"2024-09-14T12:01:29.825671+0000","last_peered":"2024-09-14T12:01:29.825671+0000","last_clean":"2024-09-14T12:01:29.825671+0000","last_became_active":"2024-09-14T10:46:44.319801+0000","last_became_peered":"2024-09-14T10:46:44.319801+0000","last_unstale":"2024-09-14T12:01:29.825671+0000","last_undegraded":"2024-09-14T12:01:29.825671+0000","last_fullsized":"2024-09-14T12:01:29.825671+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'357","last_scrub_stamp":"2024-09-14T12:01:29.825517+0000","last_deep_scrub":"263'357","last_deep_scrub_stamp":"2024-09-14T12:01:29.825517+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.825517+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:51:15.006775+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":563,"num_read_kb":13023,"num_write":1154,"num_write_kb":36371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"263'583","reported_seq":2168,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.269644+0000","last_change":"2024-09-14T12:01:39.269579+0000","last_active":"2024-09-14T12:01:39.269644+0000","last_peered":"2024-09-14T12:01:39.269644+0000","last_clean":"2024-09-14T12:01:39.269644+0000","last_became_active":"2024-09-14T10:46:46.350776+0000","last_became_peered":"2024-09-14T10:46:46.350776+0000","last_unstale":"2024-09-14T12:01:39.269644+0000","last_undegraded":"2024-09-14T12:01:39.269644+0000","last_fullsized":"2024-09-14T12:01:39.269644+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'583","last_scrub_stamp":"2024-09-14T12:01:39.269492+0000","last_deep_scrub":"263'583","last_deep_scrub_stamp":"2024-09-14T12:01:39.269492+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.269492+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:13.396139+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3080,"num_read_kb":2791,"num_write":782,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":908,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"263'282","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.275254+0000","last_change":"2024-09-14T12:01:29.275115+0000","last_active":"2024-09-14T12:01:29.275254+0000","last_peered":"2024-09-14T12:01:29.275254+0000","last_clean":"2024-09-14T12:01:29.275254+0000","last_became_active":"2024-09-14T10:46:44.327650+0000","last_became_peered":"2024-09-14T10:46:44.327650+0000","last_unstale":"2024-09-14T12:01:29.275254+0000","last_undegraded":"2024-09-14T12:01:29.275254+0000","last_fullsized":"2024-09-14T12:01:29.275254+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'282","last_scrub_stamp":"2024-09-14T12:01:29.274975+0000","last_deep_scrub":"263'282","last_deep_scrub_stamp":"2024-09-14T12:01:29.274975+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.274975+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:44.277815+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":6055,"num_write":990,"num_write_kb":41392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"263'569","reported_seq":2326,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.915055+0000","last_change":"2024-09-14T12:01:39.914997+0000","last_active":"2024-09-14T12:01:39.915055+0000","last_peered":"2024-09-14T12:01:39.915055+0000","last_clean":"2024-09-14T12:01:39.915055+0000","last_became_active":"2024-09-14T10:46:46.341474+0000","last_became_peered":"2024-09-14T10:46:46.341474+0000","last_unstale":"2024-09-14T12:01:39.915055+0000","last_undegraded":"2024-09-14T12:01:39.915055+0000","last_fullsized":"2024-09-14T12:01:39.915055+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'569","last_scrub_stamp":"2024-09-14T12:01:39.914912+0000","last_deep_scrub":"263'569","last_deep_scrub_stamp":"2024-09-14T12:01:39.914912+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.914912+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:23.529357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3094,"num_read_kb":2877,"num_write":684,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"263'343","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.312096+0000","last_change":"2024-09-14T12:01:36.312033+0000","last_active":"2024-09-14T12:01:36.312096+0000","last_peered":"2024-09-14T12:01:36.312096+0000","last_clean":"2024-09-14T12:01:36.312096+0000","last_became_active":"2024-09-14T10:46:44.334630+0000","last_became_peered":"2024-09-14T10:46:44.334630+0000","last_unstale":"2024-09-14T12:01:36.312096+0000","last_undegraded":"2024-09-14T12:01:36.312096+0000","last_fullsized":"2024-09-14T12:01:36.312096+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-14T12:01:36.311932+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-14T12:01:36.311932+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.311932+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:31.732885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":627,"num_read_kb":14860,"num_write":1052,"num_write_kb":34853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"263'827","reported_seq":2419,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:47.398338+0000","last_change":"2024-09-14T12:01:47.398279+0000","last_active":"2024-09-14T12:01:47.398338+0000","last_peered":"2024-09-14T12:01:47.398338+0000","last_clean":"2024-09-14T12:01:47.398338+0000","last_became_active":"2024-09-14T10:46:46.350391+0000","last_became_peered":"2024-09-14T10:46:46.350391+0000","last_unstale":"2024-09-14T12:01:47.398338+0000","last_undegraded":"2024-09-14T12:01:47.398338+0000","last_fullsized":"2024-09-14T12:01:47.398338+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'827","last_scrub_stamp":"2024-09-14T12:01:47.398188+0000","last_deep_scrub":"263'827","last_deep_scrub_stamp":"2024-09-14T12:01:47.398188+0000","last_clean_scrub_stamp":"2024-09-14T12:01:47.398188+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:51.317531+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3863,"num_read_kb":3486,"num_write":1075,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"263'750","reported_seq":2177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.757216+0000","last_change":"2024-09-14T12:01:42.757216+0000","last_active":"2024-09-14T12:01:42.757216+0000","last_peered":"2024-09-14T12:01:42.757216+0000","last_clean":"2024-09-14T12:01:42.757216+0000","last_became_active":"2024-09-14T10:46:46.335749+0000","last_became_peered":"2024-09-14T10:46:46.335749+0000","last_unstale":"2024-09-14T12:01:42.757216+0000","last_undegraded":"2024-09-14T12:01:42.757216+0000","last_fullsized":"2024-09-14T12:01:42.757216+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'750","last_scrub_stamp":"2024-09-14T12:01:42.757030+0000","last_deep_scrub":"263'750","last_deep_scrub_stamp":"2024-09-14T12:01:42.757030+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.757030+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:49.714436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3617,"num_read_kb":3235,"num_write":1004,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"263'306","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.685720+0000","last_change":"2024-09-14T12:01:29.685602+0000","last_active":"2024-09-14T12:01:29.685720+0000","last_peered":"2024-09-14T12:01:29.685720+0000","last_clean":"2024-09-14T12:01:29.685720+0000","last_became_active":"2024-09-14T10:46:44.316741+0000","last_became_peered":"2024-09-14T10:46:44.316741+0000","last_unstale":"2024-09-14T12:01:29.685720+0000","last_undegraded":"2024-09-14T12:01:29.685720+0000","last_fullsized":"2024-09-14T12:01:29.685720+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'306","last_scrub_stamp":"2024-09-14T12:01:29.685467+0000","last_deep_scrub":"263'306","last_deep_scrub_stamp":"2024-09-14T12:01:29.685467+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.685467+0000","objects_scrubbed":4,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:18.640343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133671,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":507,"num_read_kb":26974,"num_write":959,"num_write_kb":33080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"263'805","reported_seq":2507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.299296+0000","last_change":"2024-09-14T12:01:38.299296+0000","last_active":"2024-09-14T12:01:38.299296+0000","last_peered":"2024-09-14T12:01:38.299296+0000","last_clean":"2024-09-14T12:01:38.299296+0000","last_became_active":"2024-09-14T10:46:46.345709+0000","last_became_peered":"2024-09-14T10:46:46.345709+0000","last_unstale":"2024-09-14T12:01:38.299296+0000","last_undegraded":"2024-09-14T12:01:38.299296+0000","last_fullsized":"2024-09-14T12:01:38.299296+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'805","last_scrub_stamp":"2024-09-14T12:01:38.299204+0000","last_deep_scrub":"263'805","last_deep_scrub_stamp":"2024-09-14T12:01:38.299204+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.299204+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:24.140873+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3947,"num_read_kb":3606,"num_write":1038,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"263'367","reported_seq":1016,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.285396+0000","last_change":"2024-09-14T12:01:28.285316+0000","last_active":"2024-09-14T12:01:28.285396+0000","last_peered":"2024-09-14T12:01:28.285396+0000","last_clean":"2024-09-14T12:01:28.285396+0000","last_became_active":"2024-09-14T10:46:44.331599+0000","last_became_peered":"2024-09-14T10:46:44.331599+0000","last_unstale":"2024-09-14T12:01:28.285396+0000","last_undegraded":"2024-09-14T12:01:28.285396+0000","last_fullsized":"2024-09-14T12:01:28.285396+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-09-14T12:01:28.285209+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-09-14T12:01:28.285209+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.285209+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:29.491140+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":622,"num_read_kb":2368,"num_write":1092,"num_write_kb":34113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"263'400","reported_seq":1971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.683623+0000","last_change":"2024-09-14T12:01:36.683566+0000","last_active":"2024-09-14T12:01:36.683623+0000","last_peered":"2024-09-14T12:01:36.683623+0000","last_clean":"2024-09-14T12:01:36.683623+0000","last_became_active":"2024-09-14T10:46:46.350525+0000","last_became_peered":"2024-09-14T10:46:46.350525+0000","last_unstale":"2024-09-14T12:01:36.683623+0000","last_undegraded":"2024-09-14T12:01:36.683623+0000","last_fullsized":"2024-09-14T12:01:36.683623+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'400","last_scrub_stamp":"2024-09-14T12:01:36.683491+0000","last_deep_scrub":"263'400","last_deep_scrub_stamp":"2024-09-14T12:01:36.683491+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.683491+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:32.999277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2275,"num_read_kb":2173,"num_write":451,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"263'369","reported_seq":1054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.276045+0000","last_change":"2024-09-14T12:01:30.275983+0000","last_active":"2024-09-14T12:01:30.276045+0000","last_peered":"2024-09-14T12:01:30.276045+0000","last_clean":"2024-09-14T12:01:30.276045+0000","last_became_active":"2024-09-14T10:46:44.339871+0000","last_became_peered":"2024-09-14T10:46:44.339871+0000","last_unstale":"2024-09-14T12:01:30.276045+0000","last_undegraded":"2024-09-14T12:01:30.276045+0000","last_fullsized":"2024-09-14T12:01:30.276045+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'369","last_scrub_stamp":"2024-09-14T12:01:30.275862+0000","last_deep_scrub":"263'369","last_deep_scrub_stamp":"2024-09-14T12:01:30.275862+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.275862+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:27.494575+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":774,"num_read_kb":19273,"num_write":1249,"num_write_kb":53136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"263'1157","reported_seq":2724,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.847949+0000","last_change":"2024-09-14T12:01:41.847888+0000","last_active":"2024-09-14T12:01:41.847949+0000","last_peered":"2024-09-14T12:01:41.847949+0000","last_clean":"2024-09-14T12:01:41.847949+0000","last_became_active":"2024-09-14T10:46:46.349649+0000","last_became_peered":"2024-09-14T10:46:46.349649+0000","last_unstale":"2024-09-14T12:01:41.847949+0000","last_undegraded":"2024-09-14T12:01:41.847949+0000","last_fullsized":"2024-09-14T12:01:41.847949+0000","mapping_epoch":28,"log_start":"263'1100","ondisk_log_start":"263'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1157","last_scrub_stamp":"2024-09-14T12:01:41.847805+0000","last_deep_scrub":"263'1157","last_deep_scrub_stamp":"2024-09-14T12:01:41.847805+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.847805+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":1100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:14.558545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5238,"num_read_kb":4651,"num_write":1596,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"263'343","reported_seq":1086,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.296535+0000","last_change":"2024-09-14T12:01:34.296459+0000","last_active":"2024-09-14T12:01:34.296535+0000","last_peered":"2024-09-14T12:01:34.296535+0000","last_clean":"2024-09-14T12:01:34.296535+0000","last_became_active":"2024-09-14T10:46:44.326645+0000","last_became_peered":"2024-09-14T10:46:44.326645+0000","last_unstale":"2024-09-14T12:01:34.296535+0000","last_undegraded":"2024-09-14T12:01:34.296535+0000","last_fullsized":"2024-09-14T12:01:34.296535+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-14T12:01:34.296326+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-14T12:01:34.296326+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.296326+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:34.490843+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":923,"num_read_kb":14272,"num_write":1148,"num_write_kb":16465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"263'966","reported_seq":2520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:46.377275+0000","last_change":"2024-09-14T12:01:46.377275+0000","last_active":"2024-09-14T12:01:46.377275+0000","last_peered":"2024-09-14T12:01:46.377275+0000","last_clean":"2024-09-14T12:01:46.377275+0000","last_became_active":"2024-09-14T10:46:46.347420+0000","last_became_peered":"2024-09-14T10:46:46.347420+0000","last_unstale":"2024-09-14T12:01:46.377275+0000","last_undegraded":"2024-09-14T12:01:46.377275+0000","last_fullsized":"2024-09-14T12:01:46.377275+0000","mapping_epoch":28,"log_start":"263'900","ondisk_log_start":"263'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'966","last_scrub_stamp":"2024-09-14T12:01:46.377190+0000","last_deep_scrub":"263'966","last_deep_scrub_stamp":"2024-09-14T12:01:46.377190+0000","last_clean_scrub_stamp":"2024-09-14T12:01:46.377190+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":900,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:08.514127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5046,"num_read_kb":4563,"num_write":1374,"num_write_kb":542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"263'377","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.755590+0000","last_change":"2024-09-14T12:01:34.755520+0000","last_active":"2024-09-14T12:01:34.755590+0000","last_peered":"2024-09-14T12:01:34.755590+0000","last_clean":"2024-09-14T12:01:34.755590+0000","last_became_active":"2024-09-14T10:46:44.319146+0000","last_became_peered":"2024-09-14T10:46:44.319146+0000","last_unstale":"2024-09-14T12:01:34.755590+0000","last_undegraded":"2024-09-14T12:01:34.755590+0000","last_fullsized":"2024-09-14T12:01:34.755590+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-14T12:01:34.755410+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-14T12:01:34.755410+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.755410+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:11.914432+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":594,"num_read_kb":40910,"num_write":1073,"num_write_kb":34714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"263'375","reported_seq":1901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.707478+0000","last_change":"2024-09-14T12:01:35.707415+0000","last_active":"2024-09-14T12:01:35.707478+0000","last_peered":"2024-09-14T12:01:35.707478+0000","last_clean":"2024-09-14T12:01:35.707478+0000","last_became_active":"2024-09-14T10:46:46.339710+0000","last_became_peered":"2024-09-14T10:46:46.339710+0000","last_unstale":"2024-09-14T12:01:35.707478+0000","last_undegraded":"2024-09-14T12:01:35.707478+0000","last_fullsized":"2024-09-14T12:01:35.707478+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'375","last_scrub_stamp":"2024-09-14T12:01:35.707315+0000","last_deep_scrub":"263'375","last_deep_scrub_stamp":"2024-09-14T12:01:35.707315+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.707315+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:14.828586+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2075,"num_read_kb":1993,"num_write":416,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"263'322","reported_seq":1051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.762601+0000","last_change":"2024-09-14T12:01:33.762529+0000","last_active":"2024-09-14T12:01:33.762601+0000","last_peered":"2024-09-14T12:01:33.762601+0000","last_clean":"2024-09-14T12:01:33.762601+0000","last_became_active":"2024-09-14T10:46:44.317895+0000","last_became_peered":"2024-09-14T10:46:44.317895+0000","last_unstale":"2024-09-14T12:01:33.762601+0000","last_undegraded":"2024-09-14T12:01:33.762601+0000","last_fullsized":"2024-09-14T12:01:33.762601+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'322","last_scrub_stamp":"2024-09-14T12:01:33.762405+0000","last_deep_scrub":"263'322","last_deep_scrub_stamp":"2024-09-14T12:01:33.762405+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.762405+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:37.306350+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":939,"num_read_kb":22981,"num_write":1007,"num_write_kb":27989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"263'133","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:51.258555+0000","last_change":"2024-09-14T12:01:51.258555+0000","last_active":"2024-09-14T12:01:51.258555+0000","last_peered":"2024-09-14T12:01:51.258555+0000","last_clean":"2024-09-14T12:01:51.258555+0000","last_became_active":"2024-09-14T10:46:54.374769+0000","last_became_peered":"2024-09-14T10:46:54.374769+0000","last_unstale":"2024-09-14T12:01:51.258555+0000","last_undegraded":"2024-09-14T12:01:51.258555+0000","last_fullsized":"2024-09-14T12:01:51.258555+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-14T12:01:51.258466+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-14T12:01:51.258466+0000","last_clean_scrub_stamp":"2024-09-14T12:01:51.258466+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:21.567863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":165,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"263'434","reported_seq":1993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.832518+0000","last_change":"2024-09-14T12:01:40.832518+0000","last_active":"2024-09-14T12:01:40.832518+0000","last_peered":"2024-09-14T12:01:40.832518+0000","last_clean":"2024-09-14T12:01:40.832518+0000","last_became_active":"2024-09-14T10:46:46.340169+0000","last_became_peered":"2024-09-14T10:46:46.340169+0000","last_unstale":"2024-09-14T12:01:40.832518+0000","last_undegraded":"2024-09-14T12:01:40.832518+0000","last_fullsized":"2024-09-14T12:01:40.832518+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'434","last_scrub_stamp":"2024-09-14T12:01:40.832431+0000","last_deep_scrub":"263'434","last_deep_scrub_stamp":"2024-09-14T12:01:40.832431+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.832431+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:14.426399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2291,"num_read_kb":2165,"num_write":484,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"263'388","reported_seq":1041,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.804018+0000","last_change":"2024-09-14T12:01:32.803949+0000","last_active":"2024-09-14T12:01:32.804018+0000","last_peered":"2024-09-14T12:01:32.804018+0000","last_clean":"2024-09-14T12:01:32.804018+0000","last_became_active":"2024-09-14T10:47:18.793917+0000","last_became_peered":"2024-09-14T10:47:18.793917+0000","last_unstale":"2024-09-14T12:01:32.804018+0000","last_undegraded":"2024-09-14T12:01:32.804018+0000","last_fullsized":"2024-09-14T12:01:32.804018+0000","mapping_epoch":39,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'388","last_scrub_stamp":"2024-09-14T12:01:32.803811+0000","last_deep_scrub":"263'388","last_deep_scrub_stamp":"2024-09-14T12:01:32.803811+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.803811+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:40.563517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":723,"num_read_kb":48707,"num_write":1316,"num_write_kb":50304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:53.836847+0000","last_change":"2024-09-14T12:01:53.836847+0000","last_active":"2024-09-14T12:01:53.836847+0000","last_peered":"2024-09-14T12:01:53.836847+0000","last_clean":"2024-09-14T12:01:53.836847+0000","last_became_active":"2024-09-14T10:46:48.356776+0000","last_became_peered":"2024-09-14T10:46:48.356776+0000","last_unstale":"2024-09-14T12:01:53.836847+0000","last_undegraded":"2024-09-14T12:01:53.836847+0000","last_fullsized":"2024-09-14T12:01:53.836847+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:53.836757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:53.836757+0000","last_clean_scrub_stamp":"2024-09-14T12:01:53.836757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:22.747891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"263'358","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:54.575824+0000","last_change":"2024-09-14T12:01:54.575824+0000","last_active":"2024-09-14T12:01:54.575824+0000","last_peered":"2024-09-14T12:01:54.575824+0000","last_clean":"2024-09-14T12:01:54.575824+0000","last_became_active":"2024-09-14T10:46:50.359481+0000","last_became_peered":"2024-09-14T10:46:50.359481+0000","last_unstale":"2024-09-14T12:01:54.575824+0000","last_undegraded":"2024-09-14T12:01:54.575824+0000","last_fullsized":"2024-09-14T12:01:54.575824+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-09-14T12:01:54.575724+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-09-14T12:01:54.575724+0000","last_clean_scrub_stamp":"2024-09-14T12:01:54.575724+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:24.526696+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51669,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":564,"num_read_kb":1178,"num_write":444,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:46.606931+0000","last_change":"2024-09-14T12:01:46.606852+0000","last_active":"2024-09-14T12:01:46.606931+0000","last_peered":"2024-09-14T12:01:46.606931+0000","last_clean":"2024-09-14T12:01:46.606931+0000","last_became_active":"2024-09-14T10:46:52.372941+0000","last_became_peered":"2024-09-14T10:46:52.372941+0000","last_unstale":"2024-09-14T12:01:46.606931+0000","last_undegraded":"2024-09-14T12:01:46.606931+0000","last_fullsized":"2024-09-14T12:01:46.606931+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:46.606763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:46.606763+0000","last_clean_scrub_stamp":"2024-09-14T12:01:46.606763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:57.006977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"263'156","reported_seq":654,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:57.641119+0000","last_change":"2024-09-14T12:01:57.641016+0000","last_active":"2024-09-14T12:01:57.641119+0000","last_peered":"2024-09-14T12:01:57.641119+0000","last_clean":"2024-09-14T12:01:57.641119+0000","last_became_active":"2024-09-14T10:46:54.387445+0000","last_became_peered":"2024-09-14T10:46:54.387445+0000","last_unstale":"2024-09-14T12:01:57.641119+0000","last_undegraded":"2024-09-14T12:01:57.641119+0000","last_fullsized":"2024-09-14T12:01:57.641119+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'156","last_scrub_stamp":"2024-09-14T12:01:57.640905+0000","last_deep_scrub":"263'156","last_deep_scrub_stamp":"2024-09-14T12:01:57.640905+0000","last_clean_scrub_stamp":"2024-09-14T12:01:57.640905+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:04.004929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":80,"num_write":348,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"263'557","reported_seq":2286,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:46.891074+0000","last_change":"2024-09-14T12:01:46.891074+0000","last_active":"2024-09-14T12:01:46.891074+0000","last_peered":"2024-09-14T12:01:46.891074+0000","last_clean":"2024-09-14T12:01:46.891074+0000","last_became_active":"2024-09-14T10:46:46.340242+0000","last_became_peered":"2024-09-14T10:46:46.340242+0000","last_unstale":"2024-09-14T12:01:46.891074+0000","last_undegraded":"2024-09-14T12:01:46.891074+0000","last_fullsized":"2024-09-14T12:01:46.891074+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'557","last_scrub_stamp":"2024-09-14T12:01:46.890977+0000","last_deep_scrub":"263'557","last_deep_scrub_stamp":"2024-09-14T12:01:46.890977+0000","last_clean_scrub_stamp":"2024-09-14T12:01:46.890977+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:49.290795+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3138,"num_read_kb":2920,"num_write":702,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3295,"num_omap_keys":13,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"263'332","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.847264+0000","last_change":"2024-09-14T12:01:30.847264+0000","last_active":"2024-09-14T12:01:30.847264+0000","last_peered":"2024-09-14T12:01:30.847264+0000","last_clean":"2024-09-14T12:01:30.847264+0000","last_became_active":"2024-09-14T10:46:44.334757+0000","last_became_peered":"2024-09-14T10:46:44.334757+0000","last_unstale":"2024-09-14T12:01:30.847264+0000","last_undegraded":"2024-09-14T12:01:30.847264+0000","last_fullsized":"2024-09-14T12:01:30.847264+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'332","last_scrub_stamp":"2024-09-14T12:01:30.847120+0000","last_deep_scrub":"263'332","last_deep_scrub_stamp":"2024-09-14T12:01:30.847120+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.847120+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:08.535049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133691,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":630,"num_read_kb":20083,"num_write":1075,"num_write_kb":20918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.528073+0000","last_change":"2024-09-14T12:01:43.528005+0000","last_active":"2024-09-14T12:01:43.528073+0000","last_peered":"2024-09-14T12:01:43.528073+0000","last_clean":"2024-09-14T12:01:43.528073+0000","last_became_active":"2024-09-14T10:46:48.351825+0000","last_became_peered":"2024-09-14T10:46:48.351825+0000","last_unstale":"2024-09-14T12:01:43.528073+0000","last_undegraded":"2024-09-14T12:01:43.528073+0000","last_fullsized":"2024-09-14T12:01:43.528073+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:43.527908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:43.527908+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.527908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:37.108237+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"263'104","reported_seq":645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.647651+0000","last_change":"2024-09-14T12:01:43.647591+0000","last_active":"2024-09-14T12:01:43.647651+0000","last_peered":"2024-09-14T12:01:43.647651+0000","last_clean":"2024-09-14T12:01:43.647651+0000","last_became_active":"2024-09-14T10:46:50.360649+0000","last_became_peered":"2024-09-14T10:46:50.360649+0000","last_unstale":"2024-09-14T12:01:43.647651+0000","last_undegraded":"2024-09-14T12:01:43.647651+0000","last_fullsized":"2024-09-14T12:01:43.647651+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'104","last_scrub_stamp":"2024-09-14T12:01:43.647503+0000","last_deep_scrub":"263'104","last_deep_scrub_stamp":"2024-09-14T12:01:43.647503+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.647503+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:21.629132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:56.687801+0000","last_change":"2024-09-14T12:01:56.687801+0000","last_active":"2024-09-14T12:01:56.687801+0000","last_peered":"2024-09-14T12:01:56.687801+0000","last_clean":"2024-09-14T12:01:56.687801+0000","last_became_active":"2024-09-14T10:46:52.372770+0000","last_became_peered":"2024-09-14T10:46:52.372770+0000","last_unstale":"2024-09-14T12:01:56.687801+0000","last_undegraded":"2024-09-14T12:01:56.687801+0000","last_fullsized":"2024-09-14T12:01:56.687801+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:56.687704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:56.687704+0000","last_clean_scrub_stamp":"2024-09-14T12:01:56.687704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:38.741747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"263'144","reported_seq":660,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:56.812734+0000","last_change":"2024-09-14T12:01:56.812653+0000","last_active":"2024-09-14T12:01:56.812734+0000","last_peered":"2024-09-14T12:01:56.812734+0000","last_clean":"2024-09-14T12:01:56.812734+0000","last_became_active":"2024-09-14T10:46:54.389638+0000","last_became_peered":"2024-09-14T10:46:54.389638+0000","last_unstale":"2024-09-14T12:01:56.812734+0000","last_undegraded":"2024-09-14T12:01:56.812734+0000","last_fullsized":"2024-09-14T12:01:56.812734+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-14T12:01:56.812551+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-14T12:01:56.812551+0000","last_clean_scrub_stamp":"2024-09-14T12:01:56.812551+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:10.068600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":168,"num_write":356,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"263'452","reported_seq":2199,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.220802+0000","last_change":"2024-09-14T12:01:41.220735+0000","last_active":"2024-09-14T12:01:41.220802+0000","last_peered":"2024-09-14T12:01:41.220802+0000","last_clean":"2024-09-14T12:01:41.220802+0000","last_became_active":"2024-09-14T10:46:46.344509+0000","last_became_peered":"2024-09-14T10:46:46.344509+0000","last_unstale":"2024-09-14T12:01:41.220802+0000","last_undegraded":"2024-09-14T12:01:41.220802+0000","last_fullsized":"2024-09-14T12:01:41.220802+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'452","last_scrub_stamp":"2024-09-14T12:01:41.220645+0000","last_deep_scrub":"263'452","last_deep_scrub_stamp":"2024-09-14T12:01:41.220645+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.220645+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:35.813843+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2693,"num_read_kb":2571,"num_write":507,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2556,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"263'330","reported_seq":1012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.784580+0000","last_change":"2024-09-14T12:01:33.784580+0000","last_active":"2024-09-14T12:01:33.784580+0000","last_peered":"2024-09-14T12:01:33.784580+0000","last_clean":"2024-09-14T12:01:33.784580+0000","last_became_active":"2024-09-14T10:46:44.331464+0000","last_became_peered":"2024-09-14T10:46:44.331464+0000","last_unstale":"2024-09-14T12:01:33.784580+0000","last_undegraded":"2024-09-14T12:01:33.784580+0000","last_fullsized":"2024-09-14T12:01:33.784580+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'330","last_scrub_stamp":"2024-09-14T12:01:33.784418+0000","last_deep_scrub":"263'330","last_deep_scrub_stamp":"2024-09-14T12:01:33.784418+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.784418+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:35.461645+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267319,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":652,"num_read_kb":48168,"num_write":1033,"num_write_kb":26849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:46.531442+0000","last_change":"2024-09-14T12:01:46.531442+0000","last_active":"2024-09-14T12:01:46.531442+0000","last_peered":"2024-09-14T12:01:46.531442+0000","last_clean":"2024-09-14T12:01:46.531442+0000","last_became_active":"2024-09-14T10:46:48.357301+0000","last_became_peered":"2024-09-14T10:46:48.357301+0000","last_unstale":"2024-09-14T12:01:46.531442+0000","last_undegraded":"2024-09-14T12:01:46.531442+0000","last_fullsized":"2024-09-14T12:01:46.531442+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:46.531345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:46.531345+0000","last_clean_scrub_stamp":"2024-09-14T12:01:46.531345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:24.241883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"263'144","reported_seq":706,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:53.618728+0000","last_change":"2024-09-14T12:01:53.618728+0000","last_active":"2024-09-14T12:01:53.618728+0000","last_peered":"2024-09-14T12:01:53.618728+0000","last_clean":"2024-09-14T12:01:53.618728+0000","last_became_active":"2024-09-14T10:46:50.363495+0000","last_became_peered":"2024-09-14T10:46:50.363495+0000","last_unstale":"2024-09-14T12:01:53.618728+0000","last_undegraded":"2024-09-14T12:01:53.618728+0000","last_fullsized":"2024-09-14T12:01:53.618728+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-14T12:01:53.618629+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-14T12:01:53.618629+0000","last_clean_scrub_stamp":"2024-09-14T12:01:53.618629+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:30:16.530507+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":162,"num_write":114,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"263'793","reported_seq":2737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:03.750622+0000","last_change":"2024-09-14T12:02:03.750622+0000","last_active":"2024-09-14T12:02:03.750622+0000","last_peered":"2024-09-14T12:02:03.750622+0000","last_clean":"2024-09-14T12:02:03.750622+0000","last_became_active":"2024-09-14T10:46:52.373886+0000","last_became_peered":"2024-09-14T10:46:52.373886+0000","last_unstale":"2024-09-14T12:02:03.750622+0000","last_undegraded":"2024-09-14T12:02:03.750622+0000","last_fullsized":"2024-09-14T12:02:03.750622+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'793","last_scrub_stamp":"2024-09-14T12:02:03.750525+0000","last_deep_scrub":"263'793","last_deep_scrub_stamp":"2024-09-14T12:02:03.750525+0000","last_clean_scrub_stamp":"2024-09-14T12:02:03.750525+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:17.425492+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"263'183","reported_seq":1015,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:51.826534+0000","last_change":"2024-09-14T12:01:51.826468+0000","last_active":"2024-09-14T12:01:51.826534+0000","last_peered":"2024-09-14T12:01:51.826534+0000","last_clean":"2024-09-14T12:01:51.826534+0000","last_became_active":"2024-09-14T10:46:54.388186+0000","last_became_peered":"2024-09-14T10:46:54.388186+0000","last_unstale":"2024-09-14T12:01:51.826534+0000","last_undegraded":"2024-09-14T12:01:51.826534+0000","last_fullsized":"2024-09-14T12:01:51.826534+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'183","last_scrub_stamp":"2024-09-14T12:01:51.826355+0000","last_deep_scrub":"263'183","last_deep_scrub_stamp":"2024-09-14T12:01:51.826355+0000","last_clean_scrub_stamp":"2024-09-14T12:01:51.826355+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:29.432769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":561,"num_read_kb":561,"num_write":378,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"263'897","reported_seq":2339,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.268109+0000","last_change":"2024-09-14T12:01:42.268055+0000","last_active":"2024-09-14T12:01:42.268109+0000","last_peered":"2024-09-14T12:01:42.268109+0000","last_clean":"2024-09-14T12:01:42.268109+0000","last_became_active":"2024-09-14T10:46:46.351453+0000","last_became_peered":"2024-09-14T10:46:46.351453+0000","last_unstale":"2024-09-14T12:01:42.268109+0000","last_undegraded":"2024-09-14T12:01:42.268109+0000","last_fullsized":"2024-09-14T12:01:42.268109+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'897","last_scrub_stamp":"2024-09-14T12:01:42.267963+0000","last_deep_scrub":"263'897","last_deep_scrub_stamp":"2024-09-14T12:01:42.267963+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.267963+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":800,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:38.136304+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4193,"num_read_kb":3693,"num_write":1250,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"263'366","reported_seq":1051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:25.748065+0000","last_change":"2024-09-14T12:01:25.748065+0000","last_active":"2024-09-14T12:01:25.748065+0000","last_peered":"2024-09-14T12:01:25.748065+0000","last_clean":"2024-09-14T12:01:25.748065+0000","last_became_active":"2024-09-14T10:46:44.328531+0000","last_became_peered":"2024-09-14T10:46:44.328531+0000","last_unstale":"2024-09-14T12:01:25.748065+0000","last_undegraded":"2024-09-14T12:01:25.748065+0000","last_fullsized":"2024-09-14T12:01:25.748065+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'366","last_scrub_stamp":"2024-09-14T12:01:25.747975+0000","last_deep_scrub":"263'366","last_deep_scrub_stamp":"2024-09-14T12:01:25.747975+0000","last_clean_scrub_stamp":"2024-09-14T12:01:25.747975+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:05.853735+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":728,"num_read_kb":24160,"num_write":1182,"num_write_kb":50074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:54.854363+0000","last_change":"2024-09-14T12:01:54.854363+0000","last_active":"2024-09-14T12:01:54.854363+0000","last_peered":"2024-09-14T12:01:54.854363+0000","last_clean":"2024-09-14T12:01:54.854363+0000","last_became_active":"2024-09-14T10:46:48.348899+0000","last_became_peered":"2024-09-14T10:46:48.348899+0000","last_unstale":"2024-09-14T12:01:54.854363+0000","last_undegraded":"2024-09-14T12:01:54.854363+0000","last_fullsized":"2024-09-14T12:01:54.854363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:54.854273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:54.854273+0000","last_clean_scrub_stamp":"2024-09-14T12:01:54.854273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:37.507794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"263'311","reported_seq":904,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.892505+0000","last_change":"2024-09-14T12:01:43.892436+0000","last_active":"2024-09-14T12:01:43.892505+0000","last_peered":"2024-09-14T12:01:43.892505+0000","last_clean":"2024-09-14T12:01:43.892505+0000","last_became_active":"2024-09-14T10:46:50.365721+0000","last_became_peered":"2024-09-14T10:46:50.365721+0000","last_unstale":"2024-09-14T12:01:43.892505+0000","last_undegraded":"2024-09-14T12:01:43.892505+0000","last_fullsized":"2024-09-14T12:01:43.892505+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-09-14T12:01:43.892336+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-09-14T12:01:43.892336+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.892336+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:51.567901+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47247,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":1144,"num_write":408,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"263'831","reported_seq":2749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:56.171172+0000","last_change":"2024-09-14T12:01:56.171172+0000","last_active":"2024-09-14T12:01:56.171172+0000","last_peered":"2024-09-14T12:01:56.171172+0000","last_clean":"2024-09-14T12:01:56.171172+0000","last_became_active":"2024-09-14T10:46:52.374634+0000","last_became_peered":"2024-09-14T10:46:52.374634+0000","last_unstale":"2024-09-14T12:01:56.171172+0000","last_undegraded":"2024-09-14T12:01:56.171172+0000","last_fullsized":"2024-09-14T12:01:56.171172+0000","mapping_epoch":34,"log_start":"263'800","ondisk_log_start":"263'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'831","last_scrub_stamp":"2024-09-14T12:01:56.171077+0000","last_deep_scrub":"263'831","last_deep_scrub_stamp":"2024-09-14T12:01:56.171077+0000","last_clean_scrub_stamp":"2024-09-14T12:01:56.171077+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:37.257995+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"263'525","reported_seq":2113,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.726626+0000","last_change":"2024-09-14T12:01:41.726626+0000","last_active":"2024-09-14T12:01:41.726626+0000","last_peered":"2024-09-14T12:01:41.726626+0000","last_clean":"2024-09-14T12:01:41.726626+0000","last_became_active":"2024-09-14T10:46:46.341971+0000","last_became_peered":"2024-09-14T10:46:46.341971+0000","last_unstale":"2024-09-14T12:01:41.726626+0000","last_undegraded":"2024-09-14T12:01:41.726626+0000","last_fullsized":"2024-09-14T12:01:41.726626+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'525","last_scrub_stamp":"2024-09-14T12:01:41.726541+0000","last_deep_scrub":"263'525","last_deep_scrub_stamp":"2024-09-14T12:01:41.726541+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.726541+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:17.093439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2719,"num_read_kb":2513,"num_write":653,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"263'361","reported_seq":1034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.294867+0000","last_change":"2024-09-14T12:01:27.294867+0000","last_active":"2024-09-14T12:01:27.294867+0000","last_peered":"2024-09-14T12:01:27.294867+0000","last_clean":"2024-09-14T12:01:27.294867+0000","last_became_active":"2024-09-14T10:46:44.329782+0000","last_became_peered":"2024-09-14T10:46:44.329782+0000","last_unstale":"2024-09-14T12:01:27.294867+0000","last_undegraded":"2024-09-14T12:01:27.294867+0000","last_fullsized":"2024-09-14T12:01:27.294867+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'361","last_scrub_stamp":"2024-09-14T12:01:27.294789+0000","last_deep_scrub":"263'361","last_deep_scrub_stamp":"2024-09-14T12:01:27.294789+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.294789+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:54.811209+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":606,"num_read_kb":47823,"num_write":1082,"num_write_kb":48255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.639833+0000","last_change":"2024-09-14T12:01:42.639833+0000","last_active":"2024-09-14T12:01:42.639833+0000","last_peered":"2024-09-14T12:01:42.639833+0000","last_clean":"2024-09-14T12:01:42.639833+0000","last_became_active":"2024-09-14T10:46:48.352584+0000","last_became_peered":"2024-09-14T10:46:48.352584+0000","last_unstale":"2024-09-14T12:01:42.639833+0000","last_undegraded":"2024-09-14T12:01:42.639833+0000","last_fullsized":"2024-09-14T12:01:42.639833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:42.639742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:42.639742+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.639742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:10.999523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"263'424","reported_seq":1073,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.178116+0000","last_change":"2024-09-14T12:01:45.178116+0000","last_active":"2024-09-14T12:01:45.178116+0000","last_peered":"2024-09-14T12:01:45.178116+0000","last_clean":"2024-09-14T12:01:45.178116+0000","last_became_active":"2024-09-14T10:46:50.364438+0000","last_became_peered":"2024-09-14T10:46:50.364438+0000","last_unstale":"2024-09-14T12:01:45.178116+0000","last_undegraded":"2024-09-14T12:01:45.178116+0000","last_fullsized":"2024-09-14T12:01:45.178116+0000","mapping_epoch":32,"log_start":"263'400","ondisk_log_start":"263'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'424","last_scrub_stamp":"2024-09-14T12:01:45.178020+0000","last_deep_scrub":"263'424","last_deep_scrub_stamp":"2024-09-14T12:01:45.178020+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.178020+0000","objects_scrubbed":9,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:54.197314+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46781,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":687,"num_read_kb":1416,"num_write":538,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:53.880177+0000","last_change":"2024-09-14T12:01:53.880177+0000","last_active":"2024-09-14T12:01:53.880177+0000","last_peered":"2024-09-14T12:01:53.880177+0000","last_clean":"2024-09-14T12:01:53.880177+0000","last_became_active":"2024-09-14T10:46:52.367874+0000","last_became_peered":"2024-09-14T10:46:52.367874+0000","last_unstale":"2024-09-14T12:01:53.880177+0000","last_undegraded":"2024-09-14T12:01:53.880177+0000","last_fullsized":"2024-09-14T12:01:53.880177+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:53.880069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:53.880069+0000","last_clean_scrub_stamp":"2024-09-14T12:01:53.880069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:55.097023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"263'560","reported_seq":1410,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:50.846994+0000","last_change":"2024-09-14T12:01:50.846916+0000","last_active":"2024-09-14T12:01:50.846994+0000","last_peered":"2024-09-14T12:01:50.846994+0000","last_clean":"2024-09-14T12:01:50.846994+0000","last_became_active":"2024-09-14T10:46:54.389880+0000","last_became_peered":"2024-09-14T10:46:54.389880+0000","last_unstale":"2024-09-14T12:01:50.846994+0000","last_undegraded":"2024-09-14T12:01:50.846994+0000","last_fullsized":"2024-09-14T12:01:50.846994+0000","mapping_epoch":36,"log_start":"263'500","ondisk_log_start":"263'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'560","last_scrub_stamp":"2024-09-14T12:01:50.846820+0000","last_deep_scrub":"263'560","last_deep_scrub_stamp":"2024-09-14T12:01:50.846820+0000","last_clean_scrub_stamp":"2024-09-14T12:01:50.846820+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:18.830210+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1361,"num_read_kb":1337,"num_write":1147,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"263'1287","reported_seq":3020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.716251+0000","last_change":"2024-09-14T12:01:30.716251+0000","last_active":"2024-09-14T12:01:30.716251+0000","last_peered":"2024-09-14T12:01:30.716251+0000","last_clean":"2024-09-14T12:01:30.716251+0000","last_became_active":"2024-09-14T10:46:46.343603+0000","last_became_peered":"2024-09-14T10:46:46.343603+0000","last_unstale":"2024-09-14T12:01:30.716251+0000","last_undegraded":"2024-09-14T12:01:30.716251+0000","last_fullsized":"2024-09-14T12:01:30.716251+0000","mapping_epoch":28,"log_start":"263'1200","ondisk_log_start":"263'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1287","last_scrub_stamp":"2024-09-14T12:01:30.716161+0000","last_deep_scrub":"263'1287","last_deep_scrub_stamp":"2024-09-14T12:01:30.716161+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.716161+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":1200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:10.862248+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6021,"num_read_kb":5313,"num_write":1785,"num_write_kb":753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"263'327","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:25.890412+0000","last_change":"2024-09-14T12:01:25.890412+0000","last_active":"2024-09-14T12:01:25.890412+0000","last_peered":"2024-09-14T12:01:25.890412+0000","last_clean":"2024-09-14T12:01:25.890412+0000","last_became_active":"2024-09-14T10:46:44.322816+0000","last_became_peered":"2024-09-14T10:46:44.322816+0000","last_unstale":"2024-09-14T12:01:25.890412+0000","last_undegraded":"2024-09-14T12:01:25.890412+0000","last_fullsized":"2024-09-14T12:01:25.890412+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'327","last_scrub_stamp":"2024-09-14T12:01:25.890298+0000","last_deep_scrub":"263'327","last_deep_scrub_stamp":"2024-09-14T12:01:25.890298+0000","last_clean_scrub_stamp":"2024-09-14T12:01:25.890298+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:47.450364+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":492,"num_write":1114,"num_write_kb":29298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.849001+0000","last_change":"2024-09-14T12:01:42.849001+0000","last_active":"2024-09-14T12:01:42.849001+0000","last_peered":"2024-09-14T12:01:42.849001+0000","last_clean":"2024-09-14T12:01:42.849001+0000","last_became_active":"2024-09-14T10:46:48.351893+0000","last_became_peered":"2024-09-14T10:46:48.351893+0000","last_unstale":"2024-09-14T12:01:42.849001+0000","last_undegraded":"2024-09-14T12:01:42.849001+0000","last_fullsized":"2024-09-14T12:01:42.849001+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:42.848916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:42.848916+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.848916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:29.709750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"263'269","reported_seq":862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:51.589483+0000","last_change":"2024-09-14T12:01:51.589483+0000","last_active":"2024-09-14T12:01:51.589483+0000","last_peered":"2024-09-14T12:01:51.589483+0000","last_clean":"2024-09-14T12:01:51.589483+0000","last_became_active":"2024-09-14T10:46:50.359434+0000","last_became_peered":"2024-09-14T10:46:50.359434+0000","last_unstale":"2024-09-14T12:01:51.589483+0000","last_undegraded":"2024-09-14T12:01:51.589483+0000","last_fullsized":"2024-09-14T12:01:51.589483+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'269","last_scrub_stamp":"2024-09-14T12:01:51.589368+0000","last_deep_scrub":"263'269","last_deep_scrub_stamp":"2024-09-14T12:01:51.589368+0000","last_clean_scrub_stamp":"2024-09-14T12:01:51.589368+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:09.071357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44011,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":1031,"num_write":356,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:58.666180+0000","last_change":"2024-09-14T12:01:58.666180+0000","last_active":"2024-09-14T12:01:58.666180+0000","last_peered":"2024-09-14T12:01:58.666180+0000","last_clean":"2024-09-14T12:01:58.666180+0000","last_became_active":"2024-09-14T10:46:52.369353+0000","last_became_peered":"2024-09-14T10:46:52.369353+0000","last_unstale":"2024-09-14T12:01:58.666180+0000","last_undegraded":"2024-09-14T12:01:58.666180+0000","last_fullsized":"2024-09-14T12:01:58.666180+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:58.666096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:58.666096+0000","last_clean_scrub_stamp":"2024-09-14T12:01:58.666096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:41.189959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"263'2544","reported_seq":4377,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:51.727231+0000","last_change":"2024-09-14T12:01:51.727167+0000","last_active":"2024-09-14T12:01:51.727231+0000","last_peered":"2024-09-14T12:01:51.727231+0000","last_clean":"2024-09-14T12:01:51.727231+0000","last_became_active":"2024-09-14T10:46:54.383100+0000","last_became_peered":"2024-09-14T10:46:54.383100+0000","last_unstale":"2024-09-14T12:01:51.727231+0000","last_undegraded":"2024-09-14T12:01:51.727231+0000","last_fullsized":"2024-09-14T12:01:51.727231+0000","mapping_epoch":36,"log_start":"263'2500","ondisk_log_start":"263'2500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2544","last_scrub_stamp":"2024-09-14T12:01:51.727077+0000","last_deep_scrub":"263'2544","last_deep_scrub_stamp":"2024-09-14T12:01:51.727077+0000","last_clean_scrub_stamp":"2024-09-14T12:01:51.727077+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":2500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:47.596101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6216,"num_read_kb":6221,"num_write":5164,"num_write_kb":1877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"263'516","reported_seq":2296,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.851554+0000","last_change":"2024-09-14T12:01:32.851554+0000","last_active":"2024-09-14T12:01:32.851554+0000","last_peered":"2024-09-14T12:01:32.851554+0000","last_clean":"2024-09-14T12:01:32.851554+0000","last_became_active":"2024-09-14T10:46:46.337951+0000","last_became_peered":"2024-09-14T10:46:46.337951+0000","last_unstale":"2024-09-14T12:01:32.851554+0000","last_undegraded":"2024-09-14T12:01:32.851554+0000","last_fullsized":"2024-09-14T12:01:32.851554+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'516","last_scrub_stamp":"2024-09-14T12:01:32.851465+0000","last_deep_scrub":"263'516","last_deep_scrub_stamp":"2024-09-14T12:01:32.851465+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.851465+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:13.273879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2937,"num_read_kb":2795,"num_write":635,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"263'349","reported_seq":1036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.796987+0000","last_change":"2024-09-14T12:01:32.796987+0000","last_active":"2024-09-14T12:01:32.796987+0000","last_peered":"2024-09-14T12:01:32.796987+0000","last_clean":"2024-09-14T12:01:32.796987+0000","last_became_active":"2024-09-14T10:46:44.331705+0000","last_became_peered":"2024-09-14T10:46:44.331705+0000","last_unstale":"2024-09-14T12:01:32.796987+0000","last_undegraded":"2024-09-14T12:01:32.796987+0000","last_fullsized":"2024-09-14T12:01:32.796987+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'349","last_scrub_stamp":"2024-09-14T12:01:32.796840+0000","last_deep_scrub":"263'349","last_deep_scrub_stamp":"2024-09-14T12:01:32.796840+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.796840+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:14.276300+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":652,"num_read_kb":33315,"num_write":1115,"num_write_kb":35089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:49.302175+0000","last_change":"2024-09-14T12:01:49.302175+0000","last_active":"2024-09-14T12:01:49.302175+0000","last_peered":"2024-09-14T12:01:49.302175+0000","last_clean":"2024-09-14T12:01:49.302175+0000","last_became_active":"2024-09-14T10:46:48.354092+0000","last_became_peered":"2024-09-14T10:46:48.354092+0000","last_unstale":"2024-09-14T12:01:49.302175+0000","last_undegraded":"2024-09-14T12:01:49.302175+0000","last_fullsized":"2024-09-14T12:01:49.302175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:49.302099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:49.302099+0000","last_clean_scrub_stamp":"2024-09-14T12:01:49.302099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:05.762462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"263'350","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:57.835614+0000","last_change":"2024-09-14T12:01:57.835614+0000","last_active":"2024-09-14T12:01:57.835614+0000","last_peered":"2024-09-14T12:01:57.835614+0000","last_clean":"2024-09-14T12:01:57.835614+0000","last_became_active":"2024-09-14T10:46:50.363893+0000","last_became_peered":"2024-09-14T10:46:50.363893+0000","last_unstale":"2024-09-14T12:01:57.835614+0000","last_undegraded":"2024-09-14T12:01:57.835614+0000","last_fullsized":"2024-09-14T12:01:57.835614+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-14T12:01:57.835501+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-14T12:01:57.835501+0000","last_clean_scrub_stamp":"2024-09-14T12:01:57.835501+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:50.645404+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44240,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":541,"num_read_kb":1145,"num_write":426,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"263'831","reported_seq":5044,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:55.203848+0000","last_change":"2024-09-14T12:01:55.203848+0000","last_active":"2024-09-14T12:01:55.203848+0000","last_peered":"2024-09-14T12:01:55.203848+0000","last_clean":"2024-09-14T12:01:55.203848+0000","last_became_active":"2024-09-14T10:46:52.374152+0000","last_became_peered":"2024-09-14T10:46:52.374152+0000","last_unstale":"2024-09-14T12:01:55.203848+0000","last_undegraded":"2024-09-14T12:01:55.203848+0000","last_fullsized":"2024-09-14T12:01:55.203848+0000","mapping_epoch":34,"log_start":"263'800","ondisk_log_start":"263'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'831","last_scrub_stamp":"2024-09-14T12:01:55.203757+0000","last_deep_scrub":"263'831","last_deep_scrub_stamp":"2024-09-14T12:01:55.203757+0000","last_clean_scrub_stamp":"2024-09-14T12:01:55.203757+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:14.071131+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"263'167","reported_seq":672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:54.865067+0000","last_change":"2024-09-14T12:01:54.865067+0000","last_active":"2024-09-14T12:01:54.865067+0000","last_peered":"2024-09-14T12:01:54.865067+0000","last_clean":"2024-09-14T12:01:54.865067+0000","last_became_active":"2024-09-14T10:46:54.383953+0000","last_became_peered":"2024-09-14T10:46:54.383953+0000","last_unstale":"2024-09-14T12:01:54.865067+0000","last_undegraded":"2024-09-14T12:01:54.865067+0000","last_fullsized":"2024-09-14T12:01:54.865067+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'167","last_scrub_stamp":"2024-09-14T12:01:54.864971+0000","last_deep_scrub":"263'167","last_deep_scrub_stamp":"2024-09-14T12:01:54.864971+0000","last_clean_scrub_stamp":"2024-09-14T12:01:54.864971+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:49.056018+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":135,"num_write":398,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"263'1058","reported_seq":2538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.273309+0000","last_change":"2024-09-14T12:01:39.273309+0000","last_active":"2024-09-14T12:01:39.273309+0000","last_peered":"2024-09-14T12:01:39.273309+0000","last_clean":"2024-09-14T12:01:39.273309+0000","last_became_active":"2024-09-14T10:46:46.348726+0000","last_became_peered":"2024-09-14T10:46:46.348726+0000","last_unstale":"2024-09-14T12:01:39.273309+0000","last_undegraded":"2024-09-14T12:01:39.273309+0000","last_fullsized":"2024-09-14T12:01:39.273309+0000","mapping_epoch":28,"log_start":"263'1000","ondisk_log_start":"263'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1058","last_scrub_stamp":"2024-09-14T12:01:39.273229+0000","last_deep_scrub":"263'1058","last_deep_scrub_stamp":"2024-09-14T12:01:39.273229+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.273229+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":1000,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:14.478829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4827,"num_read_kb":4287,"num_write":1450,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"263'309","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:24.291444+0000","last_change":"2024-09-14T12:01:24.291444+0000","last_active":"2024-09-14T12:01:24.291444+0000","last_peered":"2024-09-14T12:01:24.291444+0000","last_clean":"2024-09-14T12:01:24.291444+0000","last_became_active":"2024-09-14T10:46:44.332535+0000","last_became_peered":"2024-09-14T10:46:44.332535+0000","last_unstale":"2024-09-14T12:01:24.291444+0000","last_undegraded":"2024-09-14T12:01:24.291444+0000","last_fullsized":"2024-09-14T12:01:24.291444+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'309","last_scrub_stamp":"2024-09-14T12:01:24.291338+0000","last_deep_scrub":"263'309","last_deep_scrub_stamp":"2024-09-14T12:01:24.291338+0000","last_clean_scrub_stamp":"2024-09-14T12:01:24.291338+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:44.362720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267347,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":39478,"num_write":1028,"num_write_kb":35728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.834841+0000","last_change":"2024-09-14T12:01:44.834841+0000","last_active":"2024-09-14T12:01:44.834841+0000","last_peered":"2024-09-14T12:01:44.834841+0000","last_clean":"2024-09-14T12:01:44.834841+0000","last_became_active":"2024-09-14T10:46:48.351530+0000","last_became_peered":"2024-09-14T10:46:48.351530+0000","last_unstale":"2024-09-14T12:01:44.834841+0000","last_undegraded":"2024-09-14T12:01:44.834841+0000","last_fullsized":"2024-09-14T12:01:44.834841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:44.834750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:44.834750+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.834750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:42.216241+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"263'477","reported_seq":1133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:50.580410+0000","last_change":"2024-09-14T12:01:50.580410+0000","last_active":"2024-09-14T12:01:50.580410+0000","last_peered":"2024-09-14T12:01:50.580410+0000","last_clean":"2024-09-14T12:01:50.580410+0000","last_became_active":"2024-09-14T10:46:50.361396+0000","last_became_peered":"2024-09-14T10:46:50.361396+0000","last_unstale":"2024-09-14T12:01:50.580410+0000","last_undegraded":"2024-09-14T12:01:50.580410+0000","last_fullsized":"2024-09-14T12:01:50.580410+0000","mapping_epoch":32,"log_start":"263'400","ondisk_log_start":"263'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'477","last_scrub_stamp":"2024-09-14T12:01:50.580324+0000","last_deep_scrub":"263'477","last_deep_scrub_stamp":"2024-09-14T12:01:50.580324+0000","last_clean_scrub_stamp":"2024-09-14T12:01:50.580324+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:16.911774+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93223,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":821,"num_read_kb":1952,"num_write":664,"num_write_kb":533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:54.212677+0000","last_change":"2024-09-14T12:01:54.212677+0000","last_active":"2024-09-14T12:01:54.212677+0000","last_peered":"2024-09-14T12:01:54.212677+0000","last_clean":"2024-09-14T12:01:54.212677+0000","last_became_active":"2024-09-14T10:46:52.373563+0000","last_became_peered":"2024-09-14T10:46:52.373563+0000","last_unstale":"2024-09-14T12:01:54.212677+0000","last_undegraded":"2024-09-14T12:01:54.212677+0000","last_fullsized":"2024-09-14T12:01:54.212677+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:54.212569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:54.212569+0000","last_clean_scrub_stamp":"2024-09-14T12:01:54.212569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:19.820671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"263'161","reported_seq":679,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:49.100505+0000","last_change":"2024-09-14T12:01:49.100505+0000","last_active":"2024-09-14T12:01:49.100505+0000","last_peered":"2024-09-14T12:01:49.100505+0000","last_clean":"2024-09-14T12:01:49.100505+0000","last_became_active":"2024-09-14T10:46:54.388429+0000","last_became_peered":"2024-09-14T10:46:54.388429+0000","last_unstale":"2024-09-14T12:01:49.100505+0000","last_undegraded":"2024-09-14T12:01:49.100505+0000","last_fullsized":"2024-09-14T12:01:49.100505+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'161","last_scrub_stamp":"2024-09-14T12:01:49.100420+0000","last_deep_scrub":"263'161","last_deep_scrub_stamp":"2024-09-14T12:01:49.100420+0000","last_clean_scrub_stamp":"2024-09-14T12:01:49.100420+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:49.478185+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":168,"num_write":381,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"263'891","reported_seq":2650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.303380+0000","last_change":"2024-09-14T12:01:35.303380+0000","last_active":"2024-09-14T12:01:35.303380+0000","last_peered":"2024-09-14T12:01:35.303380+0000","last_clean":"2024-09-14T12:01:35.303380+0000","last_became_active":"2024-09-14T10:46:46.344022+0000","last_became_peered":"2024-09-14T10:46:46.344022+0000","last_unstale":"2024-09-14T12:01:35.303380+0000","last_undegraded":"2024-09-14T12:01:35.303380+0000","last_fullsized":"2024-09-14T12:01:35.303380+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'891","last_scrub_stamp":"2024-09-14T12:01:35.303277+0000","last_deep_scrub":"263'891","last_deep_scrub_stamp":"2024-09-14T12:01:35.303277+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.303277+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:25.632741+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4406,"num_read_kb":4005,"num_write":1167,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"263'312","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.208032+0000","last_change":"2024-09-14T12:01:28.208032+0000","last_active":"2024-09-14T12:01:28.208032+0000","last_peered":"2024-09-14T12:01:28.208032+0000","last_clean":"2024-09-14T12:01:28.208032+0000","last_became_active":"2024-09-14T10:46:44.318584+0000","last_became_peered":"2024-09-14T10:46:44.318584+0000","last_unstale":"2024-09-14T12:01:28.208032+0000","last_undegraded":"2024-09-14T12:01:28.208032+0000","last_fullsized":"2024-09-14T12:01:28.208032+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-09-14T12:01:28.207930+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-09-14T12:01:28.207930+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.207930+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:00.044887+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":581,"num_read_kb":7202,"num_write":854,"num_write_kb":20635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.042904+0000","last_change":"2024-09-14T12:01:39.042904+0000","last_active":"2024-09-14T12:01:39.042904+0000","last_peered":"2024-09-14T12:01:39.042904+0000","last_clean":"2024-09-14T12:01:39.042904+0000","last_became_active":"2024-09-14T10:46:48.355691+0000","last_became_peered":"2024-09-14T10:46:48.355691+0000","last_unstale":"2024-09-14T12:01:39.042904+0000","last_undegraded":"2024-09-14T12:01:39.042904+0000","last_fullsized":"2024-09-14T12:01:39.042904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:39.042798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:39.042798+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.042798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:39.224689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"263'347","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:53.714755+0000","last_change":"2024-09-14T12:01:53.714755+0000","last_active":"2024-09-14T12:01:53.714755+0000","last_peered":"2024-09-14T12:01:53.714755+0000","last_clean":"2024-09-14T12:01:53.714755+0000","last_became_active":"2024-09-14T10:46:50.362757+0000","last_became_peered":"2024-09-14T10:46:50.362757+0000","last_unstale":"2024-09-14T12:01:53.714755+0000","last_undegraded":"2024-09-14T12:01:53.714755+0000","last_fullsized":"2024-09-14T12:01:53.714755+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-09-14T12:01:53.714667+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-09-14T12:01:53.714667+0000","last_clean_scrub_stamp":"2024-09-14T12:01:53.714667+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:38.487284+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":590,"num_read_kb":1339,"num_write":526,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16394,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.030546+0000","last_change":"2024-09-14T12:01:42.030546+0000","last_active":"2024-09-14T12:01:42.030546+0000","last_peered":"2024-09-14T12:01:42.030546+0000","last_clean":"2024-09-14T12:01:42.030546+0000","last_became_active":"2024-09-14T10:46:52.373836+0000","last_became_peered":"2024-09-14T10:46:52.373836+0000","last_unstale":"2024-09-14T12:01:42.030546+0000","last_undegraded":"2024-09-14T12:01:42.030546+0000","last_fullsized":"2024-09-14T12:01:42.030546+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:42.030463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:42.030463+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.030463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:44.156503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"263'97","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:58.123699+0000","last_change":"2024-09-14T12:01:58.123699+0000","last_active":"2024-09-14T12:01:58.123699+0000","last_peered":"2024-09-14T12:01:58.123699+0000","last_clean":"2024-09-14T12:01:58.123699+0000","last_became_active":"2024-09-14T10:46:54.387066+0000","last_became_peered":"2024-09-14T10:46:54.387066+0000","last_unstale":"2024-09-14T12:01:58.123699+0000","last_undegraded":"2024-09-14T12:01:58.123699+0000","last_fullsized":"2024-09-14T12:01:58.123699+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'97","last_scrub_stamp":"2024-09-14T12:01:58.123609+0000","last_deep_scrub":"263'97","last_deep_scrub_stamp":"2024-09-14T12:01:58.123609+0000","last_clean_scrub_stamp":"2024-09-14T12:01:58.123609+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:47.951710+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":95,"num_write":224,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"263'1166","reported_seq":2684,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.796789+0000","last_change":"2024-09-14T12:01:44.796789+0000","last_active":"2024-09-14T12:01:44.796789+0000","last_peered":"2024-09-14T12:01:44.796789+0000","last_clean":"2024-09-14T12:01:44.796789+0000","last_became_active":"2024-09-14T10:46:46.340228+0000","last_became_peered":"2024-09-14T10:46:46.340228+0000","last_unstale":"2024-09-14T12:01:44.796789+0000","last_undegraded":"2024-09-14T12:01:44.796789+0000","last_fullsized":"2024-09-14T12:01:44.796789+0000","mapping_epoch":28,"log_start":"263'1100","ondisk_log_start":"263'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1166","last_scrub_stamp":"2024-09-14T12:01:44.796699+0000","last_deep_scrub":"263'1166","last_deep_scrub_stamp":"2024-09-14T12:01:44.796699+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.796699+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":1100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:34.655123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5254,"num_read_kb":4633,"num_write":1618,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"263'413","reported_seq":1134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.846104+0000","last_change":"2024-09-14T12:01:31.846104+0000","last_active":"2024-09-14T12:01:31.846104+0000","last_peered":"2024-09-14T12:01:31.846104+0000","last_clean":"2024-09-14T12:01:31.846104+0000","last_became_active":"2024-09-14T10:46:44.324440+0000","last_became_peered":"2024-09-14T10:46:44.324440+0000","last_unstale":"2024-09-14T12:01:31.846104+0000","last_undegraded":"2024-09-14T12:01:31.846104+0000","last_fullsized":"2024-09-14T12:01:31.846104+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'413","last_scrub_stamp":"2024-09-14T12:01:31.845943+0000","last_deep_scrub":"263'413","last_deep_scrub_stamp":"2024-09-14T12:01:31.845943+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.845943+0000","objects_scrubbed":9,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:50.275848+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":948,"num_read_kb":1994,"num_write":1270,"num_write_kb":27495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:48.349358+0000","last_change":"2024-09-14T12:01:48.349358+0000","last_active":"2024-09-14T12:01:48.349358+0000","last_peered":"2024-09-14T12:01:48.349358+0000","last_clean":"2024-09-14T12:01:48.349358+0000","last_became_active":"2024-09-14T10:46:48.353513+0000","last_became_peered":"2024-09-14T10:46:48.353513+0000","last_unstale":"2024-09-14T12:01:48.349358+0000","last_undegraded":"2024-09-14T12:01:48.349358+0000","last_fullsized":"2024-09-14T12:01:48.349358+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:48.349259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:48.349259+0000","last_clean_scrub_stamp":"2024-09-14T12:01:48.349259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:03.618230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"263'339","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:51.317553+0000","last_change":"2024-09-14T12:01:51.317553+0000","last_active":"2024-09-14T12:01:51.317553+0000","last_peered":"2024-09-14T12:01:51.317553+0000","last_clean":"2024-09-14T12:01:51.317553+0000","last_became_active":"2024-09-14T10:46:50.362492+0000","last_became_peered":"2024-09-14T10:46:50.362492+0000","last_unstale":"2024-09-14T12:01:51.317553+0000","last_undegraded":"2024-09-14T12:01:51.317553+0000","last_fullsized":"2024-09-14T12:01:51.317553+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-14T12:01:51.317465+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-14T12:01:51.317465+0000","last_clean_scrub_stamp":"2024-09-14T12:01:51.317465+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:31.165356+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50533,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":553,"num_read_kb":1190,"num_write":436,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"263'787","reported_seq":4630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.985368+0000","last_change":"2024-09-14T12:01:43.985368+0000","last_active":"2024-09-14T12:01:43.985368+0000","last_peered":"2024-09-14T12:01:43.985368+0000","last_clean":"2024-09-14T12:01:43.985368+0000","last_became_active":"2024-09-14T10:46:52.374947+0000","last_became_peered":"2024-09-14T10:46:52.374947+0000","last_unstale":"2024-09-14T12:01:43.985368+0000","last_undegraded":"2024-09-14T12:01:43.985368+0000","last_fullsized":"2024-09-14T12:01:43.985368+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'787","last_scrub_stamp":"2024-09-14T12:01:43.985280+0000","last_deep_scrub":"263'787","last_deep_scrub_stamp":"2024-09-14T12:01:43.985280+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.985280+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:11.916897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"263'126","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:52.860712+0000","last_change":"2024-09-14T12:01:52.860648+0000","last_active":"2024-09-14T12:01:52.860712+0000","last_peered":"2024-09-14T12:01:52.860712+0000","last_clean":"2024-09-14T12:01:52.860712+0000","last_became_active":"2024-09-14T10:46:54.382004+0000","last_became_peered":"2024-09-14T10:46:54.382004+0000","last_unstale":"2024-09-14T12:01:52.860712+0000","last_undegraded":"2024-09-14T12:01:52.860712+0000","last_fullsized":"2024-09-14T12:01:52.860712+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'126","last_scrub_stamp":"2024-09-14T12:01:52.860482+0000","last_deep_scrub":"263'126","last_deep_scrub_stamp":"2024-09-14T12:01:52.860482+0000","last_clean_scrub_stamp":"2024-09-14T12:01:52.860482+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:59.879623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1268,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":189,"num_write":324,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"263'838","reported_seq":2537,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.831775+0000","last_change":"2024-09-14T12:01:35.831775+0000","last_active":"2024-09-14T12:01:35.831775+0000","last_peered":"2024-09-14T12:01:35.831775+0000","last_clean":"2024-09-14T12:01:35.831775+0000","last_became_active":"2024-09-14T10:46:46.347307+0000","last_became_peered":"2024-09-14T10:46:46.347307+0000","last_unstale":"2024-09-14T12:01:35.831775+0000","last_undegraded":"2024-09-14T12:01:35.831775+0000","last_fullsized":"2024-09-14T12:01:35.831775+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'838","last_scrub_stamp":"2024-09-14T12:01:35.831680+0000","last_deep_scrub":"263'838","last_deep_scrub_stamp":"2024-09-14T12:01:35.831680+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.831680+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:03.490519+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4222,"num_read_kb":3846,"num_write":1108,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"263'364","reported_seq":1147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.866353+0000","last_change":"2024-09-14T12:01:30.866353+0000","last_active":"2024-09-14T12:01:30.866353+0000","last_peered":"2024-09-14T12:01:30.866353+0000","last_clean":"2024-09-14T12:01:30.866353+0000","last_became_active":"2024-09-14T10:46:44.330567+0000","last_became_peered":"2024-09-14T10:46:44.330567+0000","last_unstale":"2024-09-14T12:01:30.866353+0000","last_undegraded":"2024-09-14T12:01:30.866353+0000","last_fullsized":"2024-09-14T12:01:30.866353+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'364","last_scrub_stamp":"2024-09-14T12:01:30.866244+0000","last_deep_scrub":"263'364","last_deep_scrub_stamp":"2024-09-14T12:01:30.866244+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.866244+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:50.829453+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":975,"num_read_kb":55651,"num_write":1153,"num_write_kb":35628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1471,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.686044+0000","last_change":"2024-09-14T12:01:39.686044+0000","last_active":"2024-09-14T12:01:39.686044+0000","last_peered":"2024-09-14T12:01:39.686044+0000","last_clean":"2024-09-14T12:01:39.686044+0000","last_became_active":"2024-09-14T10:46:48.355697+0000","last_became_peered":"2024-09-14T10:46:48.355697+0000","last_unstale":"2024-09-14T12:01:39.686044+0000","last_undegraded":"2024-09-14T12:01:39.686044+0000","last_fullsized":"2024-09-14T12:01:39.686044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:01:39.685939+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:01:39.685939+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.685939+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:06.999103+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"263'111","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.813896+0000","last_change":"2024-09-14T12:01:45.813896+0000","last_active":"2024-09-14T12:01:45.813896+0000","last_peered":"2024-09-14T12:01:45.813896+0000","last_clean":"2024-09-14T12:01:45.813896+0000","last_became_active":"2024-09-14T10:46:50.369337+0000","last_became_peered":"2024-09-14T10:46:50.369337+0000","last_unstale":"2024-09-14T12:01:45.813896+0000","last_undegraded":"2024-09-14T12:01:45.813896+0000","last_fullsized":"2024-09-14T12:01:45.813896+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-14T12:01:45.813772+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-14T12:01:45.813772+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.813772+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:18.801223+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"263'803","reported_seq":2619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:48.664818+0000","last_change":"2024-09-14T12:01:48.664818+0000","last_active":"2024-09-14T12:01:48.664818+0000","last_peered":"2024-09-14T12:01:48.664818+0000","last_clean":"2024-09-14T12:01:48.664818+0000","last_became_active":"2024-09-14T10:46:52.374252+0000","last_became_peered":"2024-09-14T10:46:52.374252+0000","last_unstale":"2024-09-14T12:01:48.664818+0000","last_undegraded":"2024-09-14T12:01:48.664818+0000","last_fullsized":"2024-09-14T12:01:48.664818+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'803","last_scrub_stamp":"2024-09-14T12:01:48.664696+0000","last_deep_scrub":"263'803","last_deep_scrub_stamp":"2024-09-14T12:01:48.664696+0000","last_clean_scrub_stamp":"2024-09-14T12:01:48.664696+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:26.360167+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"263'120","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:48.861534+0000","last_change":"2024-09-14T12:01:48.861475+0000","last_active":"2024-09-14T12:01:48.861534+0000","last_peered":"2024-09-14T12:01:48.861534+0000","last_clean":"2024-09-14T12:01:48.861534+0000","last_became_active":"2024-09-14T10:46:54.384249+0000","last_became_peered":"2024-09-14T10:46:54.384249+0000","last_unstale":"2024-09-14T12:01:48.861534+0000","last_undegraded":"2024-09-14T12:01:48.861534+0000","last_fullsized":"2024-09-14T12:01:48.861534+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'120","last_scrub_stamp":"2024-09-14T12:01:48.861368+0000","last_deep_scrub":"263'120","last_deep_scrub_stamp":"2024-09-14T12:01:48.861368+0000","last_clean_scrub_stamp":"2024-09-14T12:01:48.861368+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:00.297961+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":125,"num_write":281,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"263'469","reported_seq":1950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.122323+0000","last_change":"2024-09-14T12:01:31.122323+0000","last_active":"2024-09-14T12:01:31.122323+0000","last_peered":"2024-09-14T12:01:31.122323+0000","last_clean":"2024-09-14T12:01:31.122323+0000","last_became_active":"2024-09-14T10:46:46.342466+0000","last_became_peered":"2024-09-14T10:46:46.342466+0000","last_unstale":"2024-09-14T12:01:31.122323+0000","last_undegraded":"2024-09-14T12:01:31.122323+0000","last_fullsized":"2024-09-14T12:01:31.122323+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'469","last_scrub_stamp":"2024-09-14T12:01:31.122238+0000","last_deep_scrub":"263'469","last_deep_scrub_stamp":"2024-09-14T12:01:31.122238+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.122238+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:49.197184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2422,"num_read_kb":2241,"num_write":583,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"263'288","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.710818+0000","last_change":"2024-09-14T12:01:30.710818+0000","last_active":"2024-09-14T12:01:30.710818+0000","last_peered":"2024-09-14T12:01:30.710818+0000","last_clean":"2024-09-14T12:01:30.710818+0000","last_became_active":"2024-09-14T10:46:44.329014+0000","last_became_peered":"2024-09-14T10:46:44.329014+0000","last_unstale":"2024-09-14T12:01:30.710818+0000","last_undegraded":"2024-09-14T12:01:30.710818+0000","last_fullsized":"2024-09-14T12:01:30.710818+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'288","last_scrub_stamp":"2024-09-14T12:01:30.710716+0000","last_deep_scrub":"263'288","last_deep_scrub_stamp":"2024-09-14T12:01:30.710716+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.710716+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:53.203004+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":506,"num_read_kb":30778,"num_write":881,"num_write_kb":14950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:51.895008+0000","last_change":"2024-09-14T12:01:51.895008+0000","last_active":"2024-09-14T12:01:51.895008+0000","last_peered":"2024-09-14T12:01:51.895008+0000","last_clean":"2024-09-14T12:01:51.895008+0000","last_became_active":"2024-09-14T10:46:48.358586+0000","last_became_peered":"2024-09-14T10:46:48.358586+0000","last_unstale":"2024-09-14T12:01:51.895008+0000","last_undegraded":"2024-09-14T12:01:51.895008+0000","last_fullsized":"2024-09-14T12:01:51.895008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:51.894918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:51.894918+0000","last_clean_scrub_stamp":"2024-09-14T12:01:51.894918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:40.285755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"263'384","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:47.637216+0000","last_change":"2024-09-14T12:01:47.637216+0000","last_active":"2024-09-14T12:01:47.637216+0000","last_peered":"2024-09-14T12:01:47.637216+0000","last_clean":"2024-09-14T12:01:47.637216+0000","last_became_active":"2024-09-14T10:46:50.365715+0000","last_became_peered":"2024-09-14T10:46:50.365715+0000","last_unstale":"2024-09-14T12:01:47.637216+0000","last_undegraded":"2024-09-14T12:01:47.637216+0000","last_fullsized":"2024-09-14T12:01:47.637216+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'384","last_scrub_stamp":"2024-09-14T12:01:47.637092+0000","last_deep_scrub":"263'384","last_deep_scrub_stamp":"2024-09-14T12:01:47.637092+0000","last_clean_scrub_stamp":"2024-09-14T12:01:47.637092+0000","objects_scrubbed":8,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:04.027878+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45582,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":610,"num_read_kb":1238,"num_write":470,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.839972+0000","last_change":"2024-09-14T12:01:45.839972+0000","last_active":"2024-09-14T12:01:45.839972+0000","last_peered":"2024-09-14T12:01:45.839972+0000","last_clean":"2024-09-14T12:01:45.839972+0000","last_became_active":"2024-09-14T10:46:52.369746+0000","last_became_peered":"2024-09-14T10:46:52.369746+0000","last_unstale":"2024-09-14T12:01:45.839972+0000","last_undegraded":"2024-09-14T12:01:45.839972+0000","last_fullsized":"2024-09-14T12:01:45.839972+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:45.839835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:45.839835+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.839835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:36.039659+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"263'159","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:50.116729+0000","last_change":"2024-09-14T12:01:50.116640+0000","last_active":"2024-09-14T12:01:50.116729+0000","last_peered":"2024-09-14T12:01:50.116729+0000","last_clean":"2024-09-14T12:01:50.116729+0000","last_became_active":"2024-09-14T10:46:54.384119+0000","last_became_peered":"2024-09-14T10:46:54.384119+0000","last_unstale":"2024-09-14T12:01:50.116729+0000","last_undegraded":"2024-09-14T12:01:50.116729+0000","last_fullsized":"2024-09-14T12:01:50.116729+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'159","last_scrub_stamp":"2024-09-14T12:01:50.116515+0000","last_deep_scrub":"263'159","last_deep_scrub_stamp":"2024-09-14T12:01:50.116515+0000","last_clean_scrub_stamp":"2024-09-14T12:01:50.116515+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:50.157955+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":393,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"263'777","reported_seq":2214,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.693165+0000","last_change":"2024-09-14T12:01:40.693092+0000","last_active":"2024-09-14T12:01:40.693165+0000","last_peered":"2024-09-14T12:01:40.693165+0000","last_clean":"2024-09-14T12:01:40.693165+0000","last_became_active":"2024-09-14T10:46:46.334444+0000","last_became_peered":"2024-09-14T10:46:46.334444+0000","last_unstale":"2024-09-14T12:01:40.693165+0000","last_undegraded":"2024-09-14T12:01:40.693165+0000","last_fullsized":"2024-09-14T12:01:40.693165+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'777","last_scrub_stamp":"2024-09-14T12:01:40.692994+0000","last_deep_scrub":"263'777","last_deep_scrub_stamp":"2024-09-14T12:01:40.692994+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.692994+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:37.634741+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3619,"num_read_kb":3234,"num_write":1038,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:24.785694+0000","last_change":"2024-09-14T12:01:24.785694+0000","last_active":"2024-09-14T12:01:24.785694+0000","last_peered":"2024-09-14T12:01:24.785694+0000","last_clean":"2024-09-14T12:01:24.785694+0000","last_became_active":"2024-09-14T10:46:26.241454+0000","last_became_peered":"2024-09-14T10:46:26.241454+0000","last_unstale":"2024-09-14T12:01:24.785694+0000","last_undegraded":"2024-09-14T12:01:24.785694+0000","last_fullsized":"2024-09-14T12:01:24.785694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-14T12:01:24.785613+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-14T12:01:24.785613+0000","last_clean_scrub_stamp":"2024-09-14T12:01:24.785613+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:57.745824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":544,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.977324+0000","last_change":"2024-09-14T12:01:26.977273+0000","last_active":"2024-09-14T12:01:26.977324+0000","last_peered":"2024-09-14T12:01:26.977324+0000","last_clean":"2024-09-14T12:01:26.977324+0000","last_became_active":"2024-09-14T10:46:33.413305+0000","last_became_peered":"2024-09-14T10:46:33.413305+0000","last_unstale":"2024-09-14T12:01:26.977324+0000","last_undegraded":"2024-09-14T12:01:26.977324+0000","last_fullsized":"2024-09-14T12:01:26.977324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:01:26.977205+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:01:26.977205+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.977205+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:08.220234+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00092058099999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"263'313","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.725727+0000","last_change":"2024-09-14T12:01:26.725664+0000","last_active":"2024-09-14T12:01:26.725727+0000","last_peered":"2024-09-14T12:01:26.725727+0000","last_clean":"2024-09-14T12:01:26.725727+0000","last_became_active":"2024-09-14T10:46:44.329050+0000","last_became_peered":"2024-09-14T10:46:44.329050+0000","last_unstale":"2024-09-14T12:01:26.725727+0000","last_undegraded":"2024-09-14T12:01:26.725727+0000","last_fullsized":"2024-09-14T12:01:26.725727+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'313","last_scrub_stamp":"2024-09-14T12:01:26.725523+0000","last_deep_scrub":"263'313","last_deep_scrub_stamp":"2024-09-14T12:01:26.725523+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.725523+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:00.339260+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":32601,"num_write":1066,"num_write_kb":17351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"263'6","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.190055+0000","last_change":"2024-09-14T12:01:42.189983+0000","last_active":"2024-09-14T12:01:42.190055+0000","last_peered":"2024-09-14T12:01:42.190055+0000","last_clean":"2024-09-14T12:01:42.190055+0000","last_became_active":"2024-09-14T10:46:48.353319+0000","last_became_peered":"2024-09-14T10:46:48.353319+0000","last_unstale":"2024-09-14T12:01:42.190055+0000","last_undegraded":"2024-09-14T12:01:42.190055+0000","last_fullsized":"2024-09-14T12:01:42.190055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:01:42.189893+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:01:42.189893+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.189893+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:11.020543+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"263'802","reported_seq":1530,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:56.793974+0000","last_change":"2024-09-14T12:01:56.793974+0000","last_active":"2024-09-14T12:01:56.793974+0000","last_peered":"2024-09-14T12:01:56.793974+0000","last_clean":"2024-09-14T12:01:56.793974+0000","last_became_active":"2024-09-14T10:46:50.362908+0000","last_became_peered":"2024-09-14T10:46:50.362908+0000","last_unstale":"2024-09-14T12:01:56.793974+0000","last_undegraded":"2024-09-14T12:01:56.793974+0000","last_fullsized":"2024-09-14T12:01:56.793974+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'802","last_scrub_stamp":"2024-09-14T12:01:56.793882+0000","last_deep_scrub":"263'802","last_deep_scrub_stamp":"2024-09-14T12:01:56.793882+0000","last_clean_scrub_stamp":"2024-09-14T12:01:56.793882+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:52.842437+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143024,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1563,"num_read_kb":3671,"num_write":1508,"num_write_kb":1333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":107076,"num_omap_keys":256,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:52.265705+0000","last_change":"2024-09-14T12:01:52.265705+0000","last_active":"2024-09-14T12:01:52.265705+0000","last_peered":"2024-09-14T12:01:52.265705+0000","last_clean":"2024-09-14T12:01:52.265705+0000","last_became_active":"2024-09-14T10:46:52.371684+0000","last_became_peered":"2024-09-14T10:46:52.371684+0000","last_unstale":"2024-09-14T12:01:52.265705+0000","last_undegraded":"2024-09-14T12:01:52.265705+0000","last_fullsized":"2024-09-14T12:01:52.265705+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:52.265585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:52.265585+0000","last_clean_scrub_stamp":"2024-09-14T12:01:52.265585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:39.262833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"263'209","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:49.266813+0000","last_change":"2024-09-14T12:01:49.266813+0000","last_active":"2024-09-14T12:01:49.266813+0000","last_peered":"2024-09-14T12:01:49.266813+0000","last_clean":"2024-09-14T12:01:49.266813+0000","last_became_active":"2024-09-14T10:46:54.382019+0000","last_became_peered":"2024-09-14T10:46:54.382019+0000","last_unstale":"2024-09-14T12:01:49.266813+0000","last_undegraded":"2024-09-14T12:01:49.266813+0000","last_fullsized":"2024-09-14T12:01:49.266813+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'209","last_scrub_stamp":"2024-09-14T12:01:49.266707+0000","last_deep_scrub":"263'209","last_deep_scrub_stamp":"2024-09-14T12:01:49.266707+0000","last_clean_scrub_stamp":"2024-09-14T12:01:49.266707+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:26.666088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":483,"num_read_kb":466,"num_write":435,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"263'817","reported_seq":2429,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.241075+0000","last_change":"2024-09-14T12:01:40.241075+0000","last_active":"2024-09-14T12:01:40.241075+0000","last_peered":"2024-09-14T12:01:40.241075+0000","last_clean":"2024-09-14T12:01:40.241075+0000","last_became_active":"2024-09-14T10:46:46.345302+0000","last_became_peered":"2024-09-14T10:46:46.345302+0000","last_unstale":"2024-09-14T12:01:40.241075+0000","last_undegraded":"2024-09-14T12:01:40.241075+0000","last_fullsized":"2024-09-14T12:01:40.241075+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'817","last_scrub_stamp":"2024-09-14T12:01:40.240992+0000","last_deep_scrub":"263'817","last_deep_scrub_stamp":"2024-09-14T12:01:40.240992+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.240992+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:38.435554+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3876,"num_read_kb":3495,"num_write":1050,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":543,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.885777+0000","last_change":"2024-09-14T12:01:29.885777+0000","last_active":"2024-09-14T12:01:29.885777+0000","last_peered":"2024-09-14T12:01:29.885777+0000","last_clean":"2024-09-14T12:01:29.885777+0000","last_became_active":"2024-09-14T10:46:33.265619+0000","last_became_peered":"2024-09-14T10:46:33.265619+0000","last_unstale":"2024-09-14T12:01:29.885777+0000","last_undegraded":"2024-09-14T12:01:29.885777+0000","last_fullsized":"2024-09-14T12:01:29.885777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:29.885692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:29.885692+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.885692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:24.477677+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00058478399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"263'340","reported_seq":1197,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.871096+0000","last_change":"2024-09-14T12:01:26.870978+0000","last_active":"2024-09-14T12:01:26.871096+0000","last_peered":"2024-09-14T12:01:26.871096+0000","last_clean":"2024-09-14T12:01:26.871096+0000","last_became_active":"2024-09-14T10:46:44.320087+0000","last_became_peered":"2024-09-14T10:46:44.320087+0000","last_unstale":"2024-09-14T12:01:26.871096+0000","last_undegraded":"2024-09-14T12:01:26.871096+0000","last_fullsized":"2024-09-14T12:01:26.871096+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-14T12:01:26.870853+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-14T12:01:26.870853+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.870853+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:41.798493+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1201,"num_read_kb":9242,"num_write":1119,"num_write_kb":25141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:47.868781+0000","last_change":"2024-09-14T12:01:47.868781+0000","last_active":"2024-09-14T12:01:47.868781+0000","last_peered":"2024-09-14T12:01:47.868781+0000","last_clean":"2024-09-14T12:01:47.868781+0000","last_became_active":"2024-09-14T10:46:48.350653+0000","last_became_peered":"2024-09-14T10:46:48.350653+0000","last_unstale":"2024-09-14T12:01:47.868781+0000","last_undegraded":"2024-09-14T12:01:47.868781+0000","last_fullsized":"2024-09-14T12:01:47.868781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:47.868723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:47.868723+0000","last_clean_scrub_stamp":"2024-09-14T12:01:47.868723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:50.120301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"263'1402","reported_seq":3252,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.028254+0000","last_change":"2024-09-14T12:01:43.028181+0000","last_active":"2024-09-14T12:01:43.028254+0000","last_peered":"2024-09-14T12:01:43.028254+0000","last_clean":"2024-09-14T12:01:43.028254+0000","last_became_active":"2024-09-14T10:46:50.362128+0000","last_became_peered":"2024-09-14T10:46:50.362128+0000","last_unstale":"2024-09-14T12:01:43.028254+0000","last_undegraded":"2024-09-14T12:01:43.028254+0000","last_fullsized":"2024-09-14T12:01:43.028254+0000","mapping_epoch":32,"log_start":"263'1300","ondisk_log_start":"263'1300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1402","last_scrub_stamp":"2024-09-14T12:01:43.028081+0000","last_deep_scrub":"263'1402","last_deep_scrub_stamp":"2024-09-14T12:01:43.028081+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.028081+0000","objects_scrubbed":11,"log_size":102,"log_dups_size":1300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:19.538730+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160652,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2189,"num_read_kb":4301,"num_write":1286,"num_write_kb":1103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:01.827342+0000","last_change":"2024-09-14T12:02:01.827342+0000","last_active":"2024-09-14T12:02:01.827342+0000","last_peered":"2024-09-14T12:02:01.827342+0000","last_clean":"2024-09-14T12:02:01.827342+0000","last_became_active":"2024-09-14T10:46:52.375344+0000","last_became_peered":"2024-09-14T10:46:52.375344+0000","last_unstale":"2024-09-14T12:02:01.827342+0000","last_undegraded":"2024-09-14T12:02:01.827342+0000","last_fullsized":"2024-09-14T12:02:01.827342+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:01.827261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:01.827261+0000","last_clean_scrub_stamp":"2024-09-14T12:02:01.827261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:08.647671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"263'97","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:59.156240+0000","last_change":"2024-09-14T12:01:59.156240+0000","last_active":"2024-09-14T12:01:59.156240+0000","last_peered":"2024-09-14T12:01:59.156240+0000","last_clean":"2024-09-14T12:01:59.156240+0000","last_became_active":"2024-09-14T10:46:54.384354+0000","last_became_peered":"2024-09-14T10:46:54.384354+0000","last_unstale":"2024-09-14T12:01:59.156240+0000","last_undegraded":"2024-09-14T12:01:59.156240+0000","last_fullsized":"2024-09-14T12:01:59.156240+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'97","last_scrub_stamp":"2024-09-14T12:01:59.156142+0000","last_deep_scrub":"263'97","last_deep_scrub_stamp":"2024-09-14T12:01:59.156142+0000","last_clean_scrub_stamp":"2024-09-14T12:01:59.156142+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:46.837849+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":95,"num_write":225,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"263'544","reported_seq":2146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.765468+0000","last_change":"2024-09-14T12:01:36.765468+0000","last_active":"2024-09-14T12:01:36.765468+0000","last_peered":"2024-09-14T12:01:36.765468+0000","last_clean":"2024-09-14T12:01:36.765468+0000","last_became_active":"2024-09-14T10:46:46.345234+0000","last_became_peered":"2024-09-14T10:46:46.345234+0000","last_unstale":"2024-09-14T12:01:36.765468+0000","last_undegraded":"2024-09-14T12:01:36.765468+0000","last_fullsized":"2024-09-14T12:01:36.765468+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'544","last_scrub_stamp":"2024-09-14T12:01:36.765372+0000","last_deep_scrub":"263'544","last_deep_scrub_stamp":"2024-09-14T12:01:36.765372+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.765372+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:30.549759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2916,"num_read_kb":2703,"num_write":726,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.209890+0000","last_change":"2024-09-14T12:01:27.209807+0000","last_active":"2024-09-14T12:01:27.209890+0000","last_peered":"2024-09-14T12:01:27.209890+0000","last_clean":"2024-09-14T12:01:27.209890+0000","last_became_active":"2024-09-14T10:46:33.265185+0000","last_became_peered":"2024-09-14T10:46:33.265185+0000","last_unstale":"2024-09-14T12:01:27.209890+0000","last_undegraded":"2024-09-14T12:01:27.209890+0000","last_fullsized":"2024-09-14T12:01:27.209890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:27.209695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:27.209695+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.209695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:02.705899+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000550246,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"263'312","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.345266+0000","last_change":"2024-09-14T12:01:27.345266+0000","last_active":"2024-09-14T12:01:27.345266+0000","last_peered":"2024-09-14T12:01:27.345266+0000","last_clean":"2024-09-14T12:01:27.345266+0000","last_became_active":"2024-09-14T10:46:44.327101+0000","last_became_peered":"2024-09-14T10:46:44.327101+0000","last_unstale":"2024-09-14T12:01:27.345266+0000","last_undegraded":"2024-09-14T12:01:27.345266+0000","last_fullsized":"2024-09-14T12:01:27.345266+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-09-14T12:01:27.345068+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-09-14T12:01:27.345068+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.345068+0000","objects_scrubbed":8,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:53.686484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":609,"num_read_kb":99380,"num_write":1036,"num_write_kb":24751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.052202+0000","last_change":"2024-09-14T12:01:37.052202+0000","last_active":"2024-09-14T12:01:37.052202+0000","last_peered":"2024-09-14T12:01:37.052202+0000","last_clean":"2024-09-14T12:01:37.052202+0000","last_became_active":"2024-09-14T10:46:48.353803+0000","last_became_peered":"2024-09-14T10:46:48.353803+0000","last_unstale":"2024-09-14T12:01:37.052202+0000","last_undegraded":"2024-09-14T12:01:37.052202+0000","last_fullsized":"2024-09-14T12:01:37.052202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:01:37.052124+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:01:37.052124+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.052124+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:29.304883+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"263'312","reported_seq":1770,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.207090+0000","last_change":"2024-09-14T12:01:44.207034+0000","last_active":"2024-09-14T12:01:44.207090+0000","last_peered":"2024-09-14T12:01:44.207090+0000","last_clean":"2024-09-14T12:01:44.207090+0000","last_became_active":"2024-09-14T10:46:50.364857+0000","last_became_peered":"2024-09-14T10:46:50.364857+0000","last_unstale":"2024-09-14T12:01:44.207090+0000","last_undegraded":"2024-09-14T12:01:44.207090+0000","last_fullsized":"2024-09-14T12:01:44.207090+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-09-14T12:01:44.206926+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-09-14T12:01:44.206926+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.206926+0000","objects_scrubbed":9,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:11.199275+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":263,"num_read_kb":255,"num_write":243,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:57.644275+0000","last_change":"2024-09-14T12:01:57.644275+0000","last_active":"2024-09-14T12:01:57.644275+0000","last_peered":"2024-09-14T12:01:57.644275+0000","last_clean":"2024-09-14T12:01:57.644275+0000","last_became_active":"2024-09-14T10:46:52.365738+0000","last_became_peered":"2024-09-14T10:46:52.365738+0000","last_unstale":"2024-09-14T12:01:57.644275+0000","last_undegraded":"2024-09-14T12:01:57.644275+0000","last_fullsized":"2024-09-14T12:01:57.644275+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:57.644189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:57.644189+0000","last_clean_scrub_stamp":"2024-09-14T12:01:57.644189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:33.830013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"263'264","reported_seq":875,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:02.658513+0000","last_change":"2024-09-14T12:02:02.658513+0000","last_active":"2024-09-14T12:02:02.658513+0000","last_peered":"2024-09-14T12:02:02.658513+0000","last_clean":"2024-09-14T12:02:02.658513+0000","last_became_active":"2024-09-14T10:46:54.378930+0000","last_became_peered":"2024-09-14T10:46:54.378930+0000","last_unstale":"2024-09-14T12:02:02.658513+0000","last_undegraded":"2024-09-14T12:02:02.658513+0000","last_fullsized":"2024-09-14T12:02:02.658513+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'264","last_scrub_stamp":"2024-09-14T12:02:02.658409+0000","last_deep_scrub":"263'264","last_deep_scrub_stamp":"2024-09-14T12:02:02.658409+0000","last_clean_scrub_stamp":"2024-09-14T12:02:02.658409+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:30.425911+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":478,"num_read_kb":502,"num_write":559,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"263'793","reported_seq":2368,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.802995+0000","last_change":"2024-09-14T12:01:37.802934+0000","last_active":"2024-09-14T12:01:37.802995+0000","last_peered":"2024-09-14T12:01:37.802995+0000","last_clean":"2024-09-14T12:01:37.802995+0000","last_became_active":"2024-09-14T10:46:46.334679+0000","last_became_peered":"2024-09-14T10:46:46.334679+0000","last_unstale":"2024-09-14T12:01:37.802995+0000","last_undegraded":"2024-09-14T12:01:37.802995+0000","last_fullsized":"2024-09-14T12:01:37.802995+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'793","last_scrub_stamp":"2024-09-14T12:01:37.802836+0000","last_deep_scrub":"263'793","last_deep_scrub_stamp":"2024-09-14T12:01:37.802836+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.802836+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:55.618222+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3681,"num_read_kb":3336,"num_write":1001,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":545,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.019260+0000","last_change":"2024-09-14T12:01:26.019205+0000","last_active":"2024-09-14T12:01:26.019260+0000","last_peered":"2024-09-14T12:01:26.019260+0000","last_clean":"2024-09-14T12:01:26.019260+0000","last_became_active":"2024-09-14T10:46:33.296172+0000","last_became_peered":"2024-09-14T10:46:33.296172+0000","last_unstale":"2024-09-14T12:01:26.019260+0000","last_undegraded":"2024-09-14T12:01:26.019260+0000","last_fullsized":"2024-09-14T12:01:26.019260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:01:26.019146+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:01:26.019146+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.019146+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:35.727762+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00125464,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"263'339","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:25.269255+0000","last_change":"2024-09-14T12:01:25.269159+0000","last_active":"2024-09-14T12:01:25.269255+0000","last_peered":"2024-09-14T12:01:25.269255+0000","last_clean":"2024-09-14T12:01:25.269255+0000","last_became_active":"2024-09-14T10:46:44.323974+0000","last_became_peered":"2024-09-14T10:46:44.323974+0000","last_unstale":"2024-09-14T12:01:25.269255+0000","last_undegraded":"2024-09-14T12:01:25.269255+0000","last_fullsized":"2024-09-14T12:01:25.269255+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-14T12:01:25.269042+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-14T12:01:25.269042+0000","last_clean_scrub_stamp":"2024-09-14T12:01:25.269042+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:28.484276+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":608,"num_read_kb":7380,"num_write":1200,"num_write_kb":32204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.996038+0000","last_change":"2024-09-14T12:01:40.995958+0000","last_active":"2024-09-14T12:01:40.996038+0000","last_peered":"2024-09-14T12:01:40.996038+0000","last_clean":"2024-09-14T12:01:40.996038+0000","last_became_active":"2024-09-14T10:46:48.354786+0000","last_became_peered":"2024-09-14T10:46:48.354786+0000","last_unstale":"2024-09-14T12:01:40.996038+0000","last_undegraded":"2024-09-14T12:01:40.996038+0000","last_fullsized":"2024-09-14T12:01:40.996038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:40.995844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:40.995844+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.995844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:43.561954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"263'161","reported_seq":729,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:50.315791+0000","last_change":"2024-09-14T12:01:50.315791+0000","last_active":"2024-09-14T12:01:50.315791+0000","last_peered":"2024-09-14T12:01:50.315791+0000","last_clean":"2024-09-14T12:01:50.315791+0000","last_became_active":"2024-09-14T10:46:50.363538+0000","last_became_peered":"2024-09-14T10:46:50.363538+0000","last_unstale":"2024-09-14T12:01:50.315791+0000","last_undegraded":"2024-09-14T12:01:50.315791+0000","last_fullsized":"2024-09-14T12:01:50.315791+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'161","last_scrub_stamp":"2024-09-14T12:01:50.315702+0000","last_deep_scrub":"263'161","last_deep_scrub_stamp":"2024-09-14T12:01:50.315702+0000","last_clean_scrub_stamp":"2024-09-14T12:01:50.315702+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:13.411298+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":198,"num_read_kb":192,"num_write":144,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:04.746554+0000","last_change":"2024-09-14T12:02:04.746554+0000","last_active":"2024-09-14T12:02:04.746554+0000","last_peered":"2024-09-14T12:02:04.746554+0000","last_clean":"2024-09-14T12:02:04.746554+0000","last_became_active":"2024-09-14T10:46:52.370968+0000","last_became_peered":"2024-09-14T10:46:52.370968+0000","last_unstale":"2024-09-14T12:02:04.746554+0000","last_undegraded":"2024-09-14T12:02:04.746554+0000","last_fullsized":"2024-09-14T12:02:04.746554+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:04.746470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:04.746470+0000","last_clean_scrub_stamp":"2024-09-14T12:02:04.746470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:34:30.928161+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"263'119","reported_seq":677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:50.697762+0000","last_change":"2024-09-14T12:01:50.697762+0000","last_active":"2024-09-14T12:01:50.697762+0000","last_peered":"2024-09-14T12:01:50.697762+0000","last_clean":"2024-09-14T12:01:50.697762+0000","last_became_active":"2024-09-14T10:46:54.388938+0000","last_became_peered":"2024-09-14T10:46:54.388938+0000","last_unstale":"2024-09-14T12:01:50.697762+0000","last_undegraded":"2024-09-14T12:01:50.697762+0000","last_fullsized":"2024-09-14T12:01:50.697762+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-14T12:01:50.697663+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-14T12:01:50.697663+0000","last_clean_scrub_stamp":"2024-09-14T12:01:50.697663+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:43.120059+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":281,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"263'403","reported_seq":1975,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.717553+0000","last_change":"2024-09-14T12:01:35.717482+0000","last_active":"2024-09-14T12:01:35.717553+0000","last_peered":"2024-09-14T12:01:35.717553+0000","last_clean":"2024-09-14T12:01:35.717553+0000","last_became_active":"2024-09-14T10:46:46.335681+0000","last_became_peered":"2024-09-14T10:46:46.335681+0000","last_unstale":"2024-09-14T12:01:35.717553+0000","last_undegraded":"2024-09-14T12:01:35.717553+0000","last_fullsized":"2024-09-14T12:01:35.717553+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'403","last_scrub_stamp":"2024-09-14T12:01:35.717399+0000","last_deep_scrub":"263'403","last_deep_scrub_stamp":"2024-09-14T12:01:35.717399+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.717399+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:32.914757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2240,"num_read_kb":2136,"num_write":448,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"263'321","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:24.914885+0000","last_change":"2024-09-14T12:01:24.914780+0000","last_active":"2024-09-14T12:01:24.914885+0000","last_peered":"2024-09-14T12:01:24.914885+0000","last_clean":"2024-09-14T12:01:24.914885+0000","last_became_active":"2024-09-14T10:46:44.319714+0000","last_became_peered":"2024-09-14T10:46:44.319714+0000","last_unstale":"2024-09-14T12:01:24.914885+0000","last_undegraded":"2024-09-14T12:01:24.914885+0000","last_fullsized":"2024-09-14T12:01:24.914885+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'321","last_scrub_stamp":"2024-09-14T12:01:24.914659+0000","last_deep_scrub":"263'321","last_deep_scrub_stamp":"2024-09-14T12:01:24.914659+0000","last_clean_scrub_stamp":"2024-09-14T12:01:24.914659+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:48.960207+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":599,"num_read_kb":77773,"num_write":1050,"num_write_kb":36142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":537,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.360671+0000","last_change":"2024-09-14T12:01:26.360594+0000","last_active":"2024-09-14T12:01:26.360671+0000","last_peered":"2024-09-14T12:01:26.360671+0000","last_clean":"2024-09-14T12:01:26.360671+0000","last_became_active":"2024-09-14T10:46:33.296049+0000","last_became_peered":"2024-09-14T10:46:33.296049+0000","last_unstale":"2024-09-14T12:01:26.360671+0000","last_undegraded":"2024-09-14T12:01:26.360671+0000","last_fullsized":"2024-09-14T12:01:26.360671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:26.360503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:26.360503+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.360503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:22.237563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000560203,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.560481+0000","last_change":"2024-09-14T12:01:45.560422+0000","last_active":"2024-09-14T12:01:45.560481+0000","last_peered":"2024-09-14T12:01:45.560481+0000","last_clean":"2024-09-14T12:01:45.560481+0000","last_became_active":"2024-09-14T10:46:48.350088+0000","last_became_peered":"2024-09-14T10:46:48.350088+0000","last_unstale":"2024-09-14T12:01:45.560481+0000","last_undegraded":"2024-09-14T12:01:45.560481+0000","last_fullsized":"2024-09-14T12:01:45.560481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:45.560303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:45.560303+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.560303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:17.490367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"263'642","reported_seq":1335,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.053809+0000","last_change":"2024-09-14T12:01:38.053809+0000","last_active":"2024-09-14T12:01:38.053809+0000","last_peered":"2024-09-14T12:01:38.053809+0000","last_clean":"2024-09-14T12:01:38.053809+0000","last_became_active":"2024-09-14T10:46:50.363387+0000","last_became_peered":"2024-09-14T10:46:50.363387+0000","last_unstale":"2024-09-14T12:01:38.053809+0000","last_undegraded":"2024-09-14T12:01:38.053809+0000","last_fullsized":"2024-09-14T12:01:38.053809+0000","mapping_epoch":32,"log_start":"263'600","ondisk_log_start":"263'600","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'642","last_scrub_stamp":"2024-09-14T12:01:38.053687+0000","last_deep_scrub":"263'642","last_deep_scrub_stamp":"2024-09-14T12:01:38.053687+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.053687+0000","objects_scrubbed":9,"log_size":42,"log_dups_size":600,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:59.160442+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95765,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1702,"num_read_kb":2954,"num_write":2224,"num_write_kb":2032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":529556,"num_omap_keys":1194,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.851676+0000","last_change":"2024-09-14T12:01:44.851613+0000","last_active":"2024-09-14T12:01:44.851676+0000","last_peered":"2024-09-14T12:01:44.851676+0000","last_clean":"2024-09-14T12:01:44.851676+0000","last_became_active":"2024-09-14T10:46:52.373837+0000","last_became_peered":"2024-09-14T10:46:52.373837+0000","last_unstale":"2024-09-14T12:01:44.851676+0000","last_undegraded":"2024-09-14T12:01:44.851676+0000","last_fullsized":"2024-09-14T12:01:44.851676+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:44.851435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:44.851435+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.851435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:32.096919+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"263'156","reported_seq":672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:01.154325+0000","last_change":"2024-09-14T12:02:01.154325+0000","last_active":"2024-09-14T12:02:01.154325+0000","last_peered":"2024-09-14T12:02:01.154325+0000","last_clean":"2024-09-14T12:02:01.154325+0000","last_became_active":"2024-09-14T10:46:54.385835+0000","last_became_peered":"2024-09-14T10:46:54.385835+0000","last_unstale":"2024-09-14T12:02:01.154325+0000","last_undegraded":"2024-09-14T12:02:01.154325+0000","last_fullsized":"2024-09-14T12:02:01.154325+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'156","last_scrub_stamp":"2024-09-14T12:02:01.154233+0000","last_deep_scrub":"263'156","last_deep_scrub_stamp":"2024-09-14T12:02:01.154233+0000","last_clean_scrub_stamp":"2024-09-14T12:02:01.154233+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:33.941222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":168,"num_read_kb":158,"num_write":389,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"263'836","reported_seq":2488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.821942+0000","last_change":"2024-09-14T12:01:38.821888+0000","last_active":"2024-09-14T12:01:38.821942+0000","last_peered":"2024-09-14T12:01:38.821942+0000","last_clean":"2024-09-14T12:01:38.821942+0000","last_became_active":"2024-09-14T10:46:46.346072+0000","last_became_peered":"2024-09-14T10:46:46.346072+0000","last_unstale":"2024-09-14T12:01:38.821942+0000","last_undegraded":"2024-09-14T12:01:38.821942+0000","last_fullsized":"2024-09-14T12:01:38.821942+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'836","last_scrub_stamp":"2024-09-14T12:01:38.821790+0000","last_deep_scrub":"263'836","last_deep_scrub_stamp":"2024-09-14T12:01:38.821790+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.821790+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:43.972793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4027,"num_read_kb":3636,"num_write":1084,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":476,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"263'385","reported_seq":1058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.833989+0000","last_change":"2024-09-14T12:01:28.833891+0000","last_active":"2024-09-14T12:01:28.833989+0000","last_peered":"2024-09-14T12:01:28.833989+0000","last_clean":"2024-09-14T12:01:28.833989+0000","last_became_active":"2024-09-14T10:46:44.317702+0000","last_became_peered":"2024-09-14T10:46:44.317702+0000","last_unstale":"2024-09-14T12:01:28.833989+0000","last_undegraded":"2024-09-14T12:01:28.833989+0000","last_fullsized":"2024-09-14T12:01:28.833989+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'385","last_scrub_stamp":"2024-09-14T12:01:28.833720+0000","last_deep_scrub":"263'385","last_deep_scrub_stamp":"2024-09-14T12:01:28.833720+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.833720+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:27.096840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":660,"num_read_kb":57005,"num_write":1181,"num_write_kb":30753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":542,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.935330+0000","last_change":"2024-09-14T12:01:27.935287+0000","last_active":"2024-09-14T12:01:27.935330+0000","last_peered":"2024-09-14T12:01:27.935330+0000","last_clean":"2024-09-14T12:01:27.935330+0000","last_became_active":"2024-09-14T10:46:33.265512+0000","last_became_peered":"2024-09-14T10:46:33.265512+0000","last_unstale":"2024-09-14T12:01:27.935330+0000","last_undegraded":"2024-09-14T12:01:27.935330+0000","last_fullsized":"2024-09-14T12:01:27.935330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:27.935219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:27.935219+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.935219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:28.603222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088449000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.260901+0000","last_change":"2024-09-14T12:01:40.260849+0000","last_active":"2024-09-14T12:01:40.260901+0000","last_peered":"2024-09-14T12:01:40.260901+0000","last_clean":"2024-09-14T12:01:40.260901+0000","last_became_active":"2024-09-14T10:46:48.353394+0000","last_became_peered":"2024-09-14T10:46:48.353394+0000","last_unstale":"2024-09-14T12:01:40.260901+0000","last_undegraded":"2024-09-14T12:01:40.260901+0000","last_fullsized":"2024-09-14T12:01:40.260901+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:40.260753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:40.260753+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.260753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:08.593537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"263'269","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:46.792061+0000","last_change":"2024-09-14T12:01:46.791996+0000","last_active":"2024-09-14T12:01:46.792061+0000","last_peered":"2024-09-14T12:01:46.792061+0000","last_clean":"2024-09-14T12:01:46.792061+0000","last_became_active":"2024-09-14T10:46:50.363436+0000","last_became_peered":"2024-09-14T10:46:50.363436+0000","last_unstale":"2024-09-14T12:01:46.792061+0000","last_undegraded":"2024-09-14T12:01:46.792061+0000","last_fullsized":"2024-09-14T12:01:46.792061+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'269","last_scrub_stamp":"2024-09-14T12:01:46.791905+0000","last_deep_scrub":"263'269","last_deep_scrub_stamp":"2024-09-14T12:01:46.791905+0000","last_clean_scrub_stamp":"2024-09-14T12:01:46.791905+0000","objects_scrubbed":8,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:52.672034+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":321,"num_read_kb":313,"num_write":296,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"263'803","reported_seq":2978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.574999+0000","last_change":"2024-09-14T12:01:45.574999+0000","last_active":"2024-09-14T12:01:45.574999+0000","last_peered":"2024-09-14T12:01:45.574999+0000","last_clean":"2024-09-14T12:01:45.574999+0000","last_became_active":"2024-09-14T10:46:52.373068+0000","last_became_peered":"2024-09-14T10:46:52.373068+0000","last_unstale":"2024-09-14T12:01:45.574999+0000","last_undegraded":"2024-09-14T12:01:45.574999+0000","last_fullsized":"2024-09-14T12:01:45.574999+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'803","last_scrub_stamp":"2024-09-14T12:01:45.574879+0000","last_deep_scrub":"263'803","last_deep_scrub_stamp":"2024-09-14T12:01:45.574879+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.574879+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:46.413388+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"263'142","reported_seq":648,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:51.119657+0000","last_change":"2024-09-14T12:01:51.119657+0000","last_active":"2024-09-14T12:01:51.119657+0000","last_peered":"2024-09-14T12:01:51.119657+0000","last_clean":"2024-09-14T12:01:51.119657+0000","last_became_active":"2024-09-14T10:46:54.387317+0000","last_became_peered":"2024-09-14T10:46:54.387317+0000","last_unstale":"2024-09-14T12:01:51.119657+0000","last_undegraded":"2024-09-14T12:01:51.119657+0000","last_fullsized":"2024-09-14T12:01:51.119657+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'142","last_scrub_stamp":"2024-09-14T12:01:51.119533+0000","last_deep_scrub":"263'142","last_deep_scrub_stamp":"2024-09-14T12:01:51.119533+0000","last_clean_scrub_stamp":"2024-09-14T12:01:51.119533+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:19.544541+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":117,"num_write":309,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"263'1368","reported_seq":3064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.720570+0000","last_change":"2024-09-14T12:01:34.720570+0000","last_active":"2024-09-14T12:01:34.720570+0000","last_peered":"2024-09-14T12:01:34.720570+0000","last_clean":"2024-09-14T12:01:34.720570+0000","last_became_active":"2024-09-14T10:46:46.344799+0000","last_became_peered":"2024-09-14T10:46:46.344799+0000","last_unstale":"2024-09-14T12:01:34.720570+0000","last_undegraded":"2024-09-14T12:01:34.720570+0000","last_fullsized":"2024-09-14T12:01:34.720570+0000","mapping_epoch":28,"log_start":"263'1300","ondisk_log_start":"263'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1368","last_scrub_stamp":"2024-09-14T12:01:34.720456+0000","last_deep_scrub":"263'1368","last_deep_scrub_stamp":"2024-09-14T12:01:34.720456+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.720456+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":1300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:58.415618+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6397,"num_read_kb":5617,"num_write":2035,"num_write_kb":974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"263'403","reported_seq":1219,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.693900+0000","last_change":"2024-09-14T12:01:29.693900+0000","last_active":"2024-09-14T12:01:29.693900+0000","last_peered":"2024-09-14T12:01:29.693900+0000","last_clean":"2024-09-14T12:01:29.693900+0000","last_became_active":"2024-09-14T10:46:44.324158+0000","last_became_peered":"2024-09-14T10:46:44.324158+0000","last_unstale":"2024-09-14T12:01:29.693900+0000","last_undegraded":"2024-09-14T12:01:29.693900+0000","last_fullsized":"2024-09-14T12:01:29.693900+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'403","last_scrub_stamp":"2024-09-14T12:01:29.693790+0000","last_deep_scrub":"263'403","last_deep_scrub_stamp":"2024-09-14T12:01:29.693790+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.693790+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:00.163688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":514873,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1028,"num_read_kb":45406,"num_write":1187,"num_write_kb":52499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":540,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.691699+0000","last_change":"2024-09-14T12:01:27.691638+0000","last_active":"2024-09-14T12:01:27.691699+0000","last_peered":"2024-09-14T12:01:27.691699+0000","last_clean":"2024-09-14T12:01:27.691699+0000","last_became_active":"2024-09-14T10:46:33.262218+0000","last_became_peered":"2024-09-14T10:46:33.262218+0000","last_unstale":"2024-09-14T12:01:27.691699+0000","last_undegraded":"2024-09-14T12:01:27.691699+0000","last_fullsized":"2024-09-14T12:01:27.691699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:27.691538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:27.691538+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.691538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:47.244884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072314099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:49.891037+0000","last_change":"2024-09-14T12:01:49.890983+0000","last_active":"2024-09-14T12:01:49.891037+0000","last_peered":"2024-09-14T12:01:49.891037+0000","last_clean":"2024-09-14T12:01:49.891037+0000","last_became_active":"2024-09-14T10:46:48.349924+0000","last_became_peered":"2024-09-14T10:46:48.349924+0000","last_unstale":"2024-09-14T12:01:49.891037+0000","last_undegraded":"2024-09-14T12:01:49.891037+0000","last_fullsized":"2024-09-14T12:01:49.891037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:49.890893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:49.890893+0000","last_clean_scrub_stamp":"2024-09-14T12:01:49.890893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:32.799420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"263'136","reported_seq":704,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:55.821044+0000","last_change":"2024-09-14T12:01:55.821044+0000","last_active":"2024-09-14T12:01:55.821044+0000","last_peered":"2024-09-14T12:01:55.821044+0000","last_clean":"2024-09-14T12:01:55.821044+0000","last_became_active":"2024-09-14T10:46:50.366610+0000","last_became_peered":"2024-09-14T10:46:50.366610+0000","last_unstale":"2024-09-14T12:01:55.821044+0000","last_undegraded":"2024-09-14T12:01:55.821044+0000","last_fullsized":"2024-09-14T12:01:55.821044+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-14T12:01:55.820939+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-14T12:01:55.820939+0000","last_clean_scrub_stamp":"2024-09-14T12:01:55.820939+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:58.153249+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"263'832","reported_seq":2805,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:53.243187+0000","last_change":"2024-09-14T12:01:53.243135+0000","last_active":"2024-09-14T12:01:53.243187+0000","last_peered":"2024-09-14T12:01:53.243187+0000","last_clean":"2024-09-14T12:01:53.243187+0000","last_became_active":"2024-09-14T10:46:52.370514+0000","last_became_peered":"2024-09-14T10:46:52.370514+0000","last_unstale":"2024-09-14T12:01:53.243187+0000","last_undegraded":"2024-09-14T12:01:53.243187+0000","last_fullsized":"2024-09-14T12:01:53.243187+0000","mapping_epoch":34,"log_start":"263'800","ondisk_log_start":"263'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'832","last_scrub_stamp":"2024-09-14T12:01:53.243054+0000","last_deep_scrub":"263'832","last_deep_scrub_stamp":"2024-09-14T12:01:53.243054+0000","last_clean_scrub_stamp":"2024-09-14T12:01:53.243054+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:44.102830+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"263'313","reported_seq":861,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:00.143351+0000","last_change":"2024-09-14T12:02:00.143351+0000","last_active":"2024-09-14T12:02:00.143351+0000","last_peered":"2024-09-14T12:02:00.143351+0000","last_clean":"2024-09-14T12:02:00.143351+0000","last_became_active":"2024-09-14T10:46:54.382860+0000","last_became_peered":"2024-09-14T10:46:54.382860+0000","last_unstale":"2024-09-14T12:02:00.143351+0000","last_undegraded":"2024-09-14T12:02:00.143351+0000","last_fullsized":"2024-09-14T12:02:00.143351+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'313","last_scrub_stamp":"2024-09-14T12:02:00.143252+0000","last_deep_scrub":"263'313","last_deep_scrub_stamp":"2024-09-14T12:02:00.143252+0000","last_clean_scrub_stamp":"2024-09-14T12:02:00.143252+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:06.813748+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":895,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":402,"num_read_kb":382,"num_write":591,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"263'1148","reported_seq":2854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.846285+0000","last_change":"2024-09-14T12:01:31.846208+0000","last_active":"2024-09-14T12:01:31.846285+0000","last_peered":"2024-09-14T12:01:31.846285+0000","last_clean":"2024-09-14T12:01:31.846285+0000","last_became_active":"2024-09-14T10:46:46.338543+0000","last_became_peered":"2024-09-14T10:46:46.338543+0000","last_unstale":"2024-09-14T12:01:31.846285+0000","last_undegraded":"2024-09-14T12:01:31.846285+0000","last_fullsized":"2024-09-14T12:01:31.846285+0000","mapping_epoch":28,"log_start":"263'1100","ondisk_log_start":"263'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1148","last_scrub_stamp":"2024-09-14T12:01:31.846127+0000","last_deep_scrub":"263'1148","last_deep_scrub_stamp":"2024-09-14T12:01:31.846127+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.846127+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":1100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:13.145120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5511,"num_read_kb":4909,"num_write":1576,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1532,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"263'347","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.669051+0000","last_change":"2024-09-14T12:01:28.669051+0000","last_active":"2024-09-14T12:01:28.669051+0000","last_peered":"2024-09-14T12:01:28.669051+0000","last_clean":"2024-09-14T12:01:28.669051+0000","last_became_active":"2024-09-14T10:46:44.318777+0000","last_became_peered":"2024-09-14T10:46:44.318777+0000","last_unstale":"2024-09-14T12:01:28.669051+0000","last_undegraded":"2024-09-14T12:01:28.669051+0000","last_fullsized":"2024-09-14T12:01:28.669051+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-09-14T12:01:28.668927+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-09-14T12:01:28.668927+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.668927+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:05.341520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":579,"num_read_kb":36295,"num_write":1107,"num_write_kb":33618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":541,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.924857+0000","last_change":"2024-09-14T12:01:28.924797+0000","last_active":"2024-09-14T12:01:28.924857+0000","last_peered":"2024-09-14T12:01:28.924857+0000","last_clean":"2024-09-14T12:01:28.924857+0000","last_became_active":"2024-09-14T10:46:33.265515+0000","last_became_peered":"2024-09-14T10:46:33.265515+0000","last_unstale":"2024-09-14T12:01:28.924857+0000","last_undegraded":"2024-09-14T12:01:28.924857+0000","last_fullsized":"2024-09-14T12:01:28.924857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:28.924676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:28.924676+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.924676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:40.550273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061284299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.515366+0000","last_change":"2024-09-14T12:01:44.515366+0000","last_active":"2024-09-14T12:01:44.515366+0000","last_peered":"2024-09-14T12:01:44.515366+0000","last_clean":"2024-09-14T12:01:44.515366+0000","last_became_active":"2024-09-14T10:46:48.354373+0000","last_became_peered":"2024-09-14T10:46:48.354373+0000","last_unstale":"2024-09-14T12:01:44.515366+0000","last_undegraded":"2024-09-14T12:01:44.515366+0000","last_fullsized":"2024-09-14T12:01:44.515366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:44.515279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:44.515279+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.515279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:32.779390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"263'728","reported_seq":1479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.193975+0000","last_change":"2024-09-14T12:01:43.193914+0000","last_active":"2024-09-14T12:01:43.193975+0000","last_peered":"2024-09-14T12:01:43.193975+0000","last_clean":"2024-09-14T12:01:43.193975+0000","last_became_active":"2024-09-14T10:46:50.362397+0000","last_became_peered":"2024-09-14T10:46:50.362397+0000","last_unstale":"2024-09-14T12:01:43.193975+0000","last_undegraded":"2024-09-14T12:01:43.193975+0000","last_fullsized":"2024-09-14T12:01:43.193975+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'728","last_scrub_stamp":"2024-09-14T12:01:43.193809+0000","last_deep_scrub":"263'728","last_deep_scrub_stamp":"2024-09-14T12:01:43.193809+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.193809+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":700,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:59.964839+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1285,"num_read_kb":3031,"num_write":1024,"num_write_kb":812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:56.606946+0000","last_change":"2024-09-14T12:01:56.606946+0000","last_active":"2024-09-14T12:01:56.606946+0000","last_peered":"2024-09-14T12:01:56.606946+0000","last_clean":"2024-09-14T12:01:56.606946+0000","last_became_active":"2024-09-14T10:46:52.370107+0000","last_became_peered":"2024-09-14T10:46:52.370107+0000","last_unstale":"2024-09-14T12:01:56.606946+0000","last_undegraded":"2024-09-14T12:01:56.606946+0000","last_fullsized":"2024-09-14T12:01:56.606946+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:56.606853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:56.606853+0000","last_clean_scrub_stamp":"2024-09-14T12:01:56.606853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:31.667227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"263'134","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:49.886658+0000","last_change":"2024-09-14T12:01:49.886658+0000","last_active":"2024-09-14T12:01:49.886658+0000","last_peered":"2024-09-14T12:01:49.886658+0000","last_clean":"2024-09-14T12:01:49.886658+0000","last_became_active":"2024-09-14T10:46:54.383813+0000","last_became_peered":"2024-09-14T10:46:54.383813+0000","last_unstale":"2024-09-14T12:01:49.886658+0000","last_undegraded":"2024-09-14T12:01:49.886658+0000","last_fullsized":"2024-09-14T12:01:49.886658+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'134","last_scrub_stamp":"2024-09-14T12:01:49.886576+0000","last_deep_scrub":"263'134","last_deep_scrub_stamp":"2024-09-14T12:01:49.886576+0000","last_clean_scrub_stamp":"2024-09-14T12:01:49.886576+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:09.354708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":350,"num_read_kb":289,"num_write":327,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"263'151","reported_seq":720,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:01.687668+0000","last_change":"2024-09-14T12:02:01.687668+0000","last_active":"2024-09-14T12:02:01.687668+0000","last_peered":"2024-09-14T12:02:01.687668+0000","last_clean":"2024-09-14T12:02:01.687668+0000","last_became_active":"2024-09-14T10:46:54.383742+0000","last_became_peered":"2024-09-14T10:46:54.383742+0000","last_unstale":"2024-09-14T12:02:01.687668+0000","last_undegraded":"2024-09-14T12:02:01.687668+0000","last_fullsized":"2024-09-14T12:02:01.687668+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'151","last_scrub_stamp":"2024-09-14T12:02:01.687538+0000","last_deep_scrub":"263'151","last_deep_scrub_stamp":"2024-09-14T12:02:01.687538+0000","last_clean_scrub_stamp":"2024-09-14T12:02:01.687538+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:13.283493+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":212,"num_read_kb":210,"num_write":346,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"263'703","reported_seq":2564,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.816238+0000","last_change":"2024-09-14T12:01:33.816238+0000","last_active":"2024-09-14T12:01:33.816238+0000","last_peered":"2024-09-14T12:01:33.816238+0000","last_clean":"2024-09-14T12:01:33.816238+0000","last_became_active":"2024-09-14T10:46:46.337818+0000","last_became_peered":"2024-09-14T10:46:46.337818+0000","last_unstale":"2024-09-14T12:01:33.816238+0000","last_undegraded":"2024-09-14T12:01:33.816238+0000","last_fullsized":"2024-09-14T12:01:33.816238+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'703","last_scrub_stamp":"2024-09-14T12:01:33.816161+0000","last_deep_scrub":"263'703","last_deep_scrub_stamp":"2024-09-14T12:01:33.816161+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.816161+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:12.842729+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3744,"num_read_kb":3411,"num_write":893,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2266,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"263'332","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.757635+0000","last_change":"2024-09-14T12:01:36.757635+0000","last_active":"2024-09-14T12:01:36.757635+0000","last_peered":"2024-09-14T12:01:36.757635+0000","last_clean":"2024-09-14T12:01:36.757635+0000","last_became_active":"2024-09-14T10:46:44.332607+0000","last_became_peered":"2024-09-14T10:46:44.332607+0000","last_unstale":"2024-09-14T12:01:36.757635+0000","last_undegraded":"2024-09-14T12:01:36.757635+0000","last_fullsized":"2024-09-14T12:01:36.757635+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'332","last_scrub_stamp":"2024-09-14T12:01:36.757421+0000","last_deep_scrub":"263'332","last_deep_scrub_stamp":"2024-09-14T12:01:36.757421+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.757421+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:10.285355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":554,"num_read_kb":15763,"num_write":1023,"num_write_kb":46520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:48.839413+0000","last_change":"2024-09-14T12:01:48.839413+0000","last_active":"2024-09-14T12:01:48.839413+0000","last_peered":"2024-09-14T12:01:48.839413+0000","last_clean":"2024-09-14T12:01:48.839413+0000","last_became_active":"2024-09-14T10:46:48.353125+0000","last_became_peered":"2024-09-14T10:46:48.353125+0000","last_unstale":"2024-09-14T12:01:48.839413+0000","last_undegraded":"2024-09-14T12:01:48.839413+0000","last_fullsized":"2024-09-14T12:01:48.839413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:48.839288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:48.839288+0000","last_clean_scrub_stamp":"2024-09-14T12:01:48.839288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:58.967280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"263'339","reported_seq":936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:47.806535+0000","last_change":"2024-09-14T12:01:47.806535+0000","last_active":"2024-09-14T12:01:47.806535+0000","last_peered":"2024-09-14T12:01:47.806535+0000","last_clean":"2024-09-14T12:01:47.806535+0000","last_became_active":"2024-09-14T10:46:50.364874+0000","last_became_peered":"2024-09-14T10:46:50.364874+0000","last_unstale":"2024-09-14T12:01:47.806535+0000","last_undegraded":"2024-09-14T12:01:47.806535+0000","last_fullsized":"2024-09-14T12:01:47.806535+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-14T12:01:47.806449+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-14T12:01:47.806449+0000","last_clean_scrub_stamp":"2024-09-14T12:01:47.806449+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:34.200759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58887,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":550,"num_read_kb":1323,"num_write":450,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:47.041018+0000","last_change":"2024-09-14T12:01:47.041018+0000","last_active":"2024-09-14T12:01:47.041018+0000","last_peered":"2024-09-14T12:01:47.041018+0000","last_clean":"2024-09-14T12:01:47.041018+0000","last_became_active":"2024-09-14T10:46:52.373982+0000","last_became_peered":"2024-09-14T10:46:52.373982+0000","last_unstale":"2024-09-14T12:01:47.041018+0000","last_undegraded":"2024-09-14T12:01:47.041018+0000","last_fullsized":"2024-09-14T12:01:47.041018+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:47.040933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:47.040933+0000","last_clean_scrub_stamp":"2024-09-14T12:01:47.040933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:05.191928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"263'117","reported_seq":621,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:52.116650+0000","last_change":"2024-09-14T12:01:52.116650+0000","last_active":"2024-09-14T12:01:52.116650+0000","last_peered":"2024-09-14T12:01:52.116650+0000","last_clean":"2024-09-14T12:01:52.116650+0000","last_became_active":"2024-09-14T10:46:54.387552+0000","last_became_peered":"2024-09-14T10:46:54.387552+0000","last_unstale":"2024-09-14T12:01:52.116650+0000","last_undegraded":"2024-09-14T12:01:52.116650+0000","last_fullsized":"2024-09-14T12:01:52.116650+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'117","last_scrub_stamp":"2024-09-14T12:01:52.116556+0000","last_deep_scrub":"263'117","last_deep_scrub_stamp":"2024-09-14T12:01:52.116556+0000","last_clean_scrub_stamp":"2024-09-14T12:01:52.116556+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:05.469835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":107,"num_write":284,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"263'407","reported_seq":1864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.672684+0000","last_change":"2024-09-14T12:01:36.672684+0000","last_active":"2024-09-14T12:01:36.672684+0000","last_peered":"2024-09-14T12:01:36.672684+0000","last_clean":"2024-09-14T12:01:36.672684+0000","last_became_active":"2024-09-14T10:46:46.348040+0000","last_became_peered":"2024-09-14T10:46:46.348040+0000","last_unstale":"2024-09-14T12:01:36.672684+0000","last_undegraded":"2024-09-14T12:01:36.672684+0000","last_fullsized":"2024-09-14T12:01:36.672684+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'407","last_scrub_stamp":"2024-09-14T12:01:36.672588+0000","last_deep_scrub":"263'407","last_deep_scrub_stamp":"2024-09-14T12:01:36.672588+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.672588+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:46.183322+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2178,"num_read_kb":2045,"num_write":462,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"263'336","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.276975+0000","last_change":"2024-09-14T12:01:26.276921+0000","last_active":"2024-09-14T12:01:26.276975+0000","last_peered":"2024-09-14T12:01:26.276975+0000","last_clean":"2024-09-14T12:01:26.276975+0000","last_became_active":"2024-09-14T10:46:44.333195+0000","last_became_peered":"2024-09-14T10:46:44.333195+0000","last_unstale":"2024-09-14T12:01:26.276975+0000","last_undegraded":"2024-09-14T12:01:26.276975+0000","last_fullsized":"2024-09-14T12:01:26.276975+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'336","last_scrub_stamp":"2024-09-14T12:01:26.276834+0000","last_deep_scrub":"263'336","last_deep_scrub_stamp":"2024-09-14T12:01:26.276834+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.276834+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:00:55.874383+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":77356,"num_write":1081,"num_write_kb":55140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:47.513522+0000","last_change":"2024-09-14T12:01:47.513522+0000","last_active":"2024-09-14T12:01:47.513522+0000","last_peered":"2024-09-14T12:01:47.513522+0000","last_clean":"2024-09-14T12:01:47.513522+0000","last_became_active":"2024-09-14T10:46:48.357033+0000","last_became_peered":"2024-09-14T10:46:48.357033+0000","last_unstale":"2024-09-14T12:01:47.513522+0000","last_undegraded":"2024-09-14T12:01:47.513522+0000","last_fullsized":"2024-09-14T12:01:47.513522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:47.513436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:47.513436+0000","last_clean_scrub_stamp":"2024-09-14T12:01:47.513436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:22.660153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"263'66","reported_seq":588,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:52.571492+0000","last_change":"2024-09-14T12:01:52.571492+0000","last_active":"2024-09-14T12:01:52.571492+0000","last_peered":"2024-09-14T12:01:52.571492+0000","last_clean":"2024-09-14T12:01:52.571492+0000","last_became_active":"2024-09-14T10:46:50.362878+0000","last_became_peered":"2024-09-14T10:46:50.362878+0000","last_unstale":"2024-09-14T12:01:52.571492+0000","last_undegraded":"2024-09-14T12:01:52.571492+0000","last_fullsized":"2024-09-14T12:01:52.571492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'66","last_scrub_stamp":"2024-09-14T12:01:52.571399+0000","last_deep_scrub":"263'66","last_deep_scrub_stamp":"2024-09-14T12:01:52.571399+0000","last_clean_scrub_stamp":"2024-09-14T12:01:52.571399+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:05.602319+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:46.793396+0000","last_change":"2024-09-14T12:01:46.793396+0000","last_active":"2024-09-14T12:01:46.793396+0000","last_peered":"2024-09-14T12:01:46.793396+0000","last_clean":"2024-09-14T12:01:46.793396+0000","last_became_active":"2024-09-14T10:46:52.365987+0000","last_became_peered":"2024-09-14T10:46:52.365987+0000","last_unstale":"2024-09-14T12:01:46.793396+0000","last_undegraded":"2024-09-14T12:01:46.793396+0000","last_fullsized":"2024-09-14T12:01:46.793396+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:46.793292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:46.793292+0000","last_clean_scrub_stamp":"2024-09-14T12:01:46.793292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:54.685984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"263'201","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:55.827104+0000","last_change":"2024-09-14T12:01:55.827043+0000","last_active":"2024-09-14T12:01:55.827104+0000","last_peered":"2024-09-14T12:01:55.827104+0000","last_clean":"2024-09-14T12:01:55.827104+0000","last_became_active":"2024-09-14T10:46:54.383284+0000","last_became_peered":"2024-09-14T10:46:54.383284+0000","last_unstale":"2024-09-14T12:01:55.827104+0000","last_undegraded":"2024-09-14T12:01:55.827104+0000","last_fullsized":"2024-09-14T12:01:55.827104+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'201","last_scrub_stamp":"2024-09-14T12:01:55.826936+0000","last_deep_scrub":"263'201","last_deep_scrub_stamp":"2024-09-14T12:01:55.826936+0000","last_clean_scrub_stamp":"2024-09-14T12:01:55.826936+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:17.041024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":348,"num_read_kb":326,"num_write":460,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"263'466","reported_seq":2101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.701686+0000","last_change":"2024-09-14T12:01:35.701686+0000","last_active":"2024-09-14T12:01:35.701686+0000","last_peered":"2024-09-14T12:01:35.701686+0000","last_clean":"2024-09-14T12:01:35.701686+0000","last_became_active":"2024-09-14T10:46:46.341424+0000","last_became_peered":"2024-09-14T10:46:46.341424+0000","last_unstale":"2024-09-14T12:01:35.701686+0000","last_undegraded":"2024-09-14T12:01:35.701686+0000","last_fullsized":"2024-09-14T12:01:35.701686+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'466","last_scrub_stamp":"2024-09-14T12:01:35.701589+0000","last_deep_scrub":"263'466","last_deep_scrub_stamp":"2024-09-14T12:01:35.701589+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.701589+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:23.244730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2571,"num_read_kb":2437,"num_write":538,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"263'326","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.895420+0000","last_change":"2024-09-14T12:01:27.895339+0000","last_active":"2024-09-14T12:01:27.895420+0000","last_peered":"2024-09-14T12:01:27.895420+0000","last_clean":"2024-09-14T12:01:27.895420+0000","last_became_active":"2024-09-14T10:46:44.321694+0000","last_became_peered":"2024-09-14T10:46:44.321694+0000","last_unstale":"2024-09-14T12:01:27.895420+0000","last_undegraded":"2024-09-14T12:01:27.895420+0000","last_fullsized":"2024-09-14T12:01:27.895420+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'326","last_scrub_stamp":"2024-09-14T12:01:27.895250+0000","last_deep_scrub":"263'326","last_deep_scrub_stamp":"2024-09-14T12:01:27.895250+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.895250+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:46.249003+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":535,"num_read_kb":12444,"num_write":977,"num_write_kb":13958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.839618+0000","last_change":"2024-09-14T12:01:37.839618+0000","last_active":"2024-09-14T12:01:37.839618+0000","last_peered":"2024-09-14T12:01:37.839618+0000","last_clean":"2024-09-14T12:01:37.839618+0000","last_became_active":"2024-09-14T10:46:48.350714+0000","last_became_peered":"2024-09-14T10:46:48.350714+0000","last_unstale":"2024-09-14T12:01:37.839618+0000","last_undegraded":"2024-09-14T12:01:37.839618+0000","last_fullsized":"2024-09-14T12:01:37.839618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:37.839539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:37.839539+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.839539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:51.881085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"263'343","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.015254+0000","last_change":"2024-09-14T12:01:45.015254+0000","last_active":"2024-09-14T12:01:45.015254+0000","last_peered":"2024-09-14T12:01:45.015254+0000","last_clean":"2024-09-14T12:01:45.015254+0000","last_became_active":"2024-09-14T10:46:50.360886+0000","last_became_peered":"2024-09-14T10:46:50.360886+0000","last_unstale":"2024-09-14T12:01:45.015254+0000","last_undegraded":"2024-09-14T12:01:45.015254+0000","last_fullsized":"2024-09-14T12:01:45.015254+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-14T12:01:45.015155+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-14T12:01:45.015155+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.015155+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:22.667188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50451,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":558,"num_read_kb":1238,"num_write":442,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.600309+0000","last_change":"2024-09-14T12:01:44.600309+0000","last_active":"2024-09-14T12:01:44.600309+0000","last_peered":"2024-09-14T12:01:44.600309+0000","last_clean":"2024-09-14T12:01:44.600309+0000","last_became_active":"2024-09-14T10:46:52.375120+0000","last_became_peered":"2024-09-14T10:46:52.375120+0000","last_unstale":"2024-09-14T12:01:44.600309+0000","last_undegraded":"2024-09-14T12:01:44.600309+0000","last_fullsized":"2024-09-14T12:01:44.600309+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:44.600220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:44.600220+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.600220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:15.281267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"263'127","reported_seq":657,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:10.677184+0000","last_change":"2024-09-14T12:02:10.677184+0000","last_active":"2024-09-14T12:02:10.677184+0000","last_peered":"2024-09-14T12:02:10.677184+0000","last_clean":"2024-09-14T12:02:10.677184+0000","last_became_active":"2024-09-14T10:46:54.384113+0000","last_became_peered":"2024-09-14T10:46:54.384113+0000","last_unstale":"2024-09-14T12:02:10.677184+0000","last_undegraded":"2024-09-14T12:02:10.677184+0000","last_fullsized":"2024-09-14T12:02:10.677184+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'127","last_scrub_stamp":"2024-09-14T12:02:10.677084+0000","last_deep_scrub":"263'127","last_deep_scrub_stamp":"2024-09-14T12:02:10.677084+0000","last_clean_scrub_stamp":"2024-09-14T12:02:10.677084+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:11.369479+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":180,"num_read_kb":170,"num_write":302,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"263'381","reported_seq":2036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.108765+0000","last_change":"2024-09-14T12:01:33.108765+0000","last_active":"2024-09-14T12:01:33.108765+0000","last_peered":"2024-09-14T12:01:33.108765+0000","last_clean":"2024-09-14T12:01:33.108765+0000","last_became_active":"2024-09-14T10:46:46.346318+0000","last_became_peered":"2024-09-14T10:46:46.346318+0000","last_unstale":"2024-09-14T12:01:33.108765+0000","last_undegraded":"2024-09-14T12:01:33.108765+0000","last_fullsized":"2024-09-14T12:01:33.108765+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'381","last_scrub_stamp":"2024-09-14T12:01:33.108674+0000","last_deep_scrub":"263'381","last_deep_scrub_stamp":"2024-09-14T12:01:33.108674+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.108674+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:22.079780+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2319,"num_read_kb":2246,"num_write":412,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2047,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"263'411","reported_seq":1088,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.374129+0000","last_change":"2024-09-14T12:01:28.374029+0000","last_active":"2024-09-14T12:01:28.374129+0000","last_peered":"2024-09-14T12:01:28.374129+0000","last_clean":"2024-09-14T12:01:28.374129+0000","last_became_active":"2024-09-14T10:46:44.332841+0000","last_became_peered":"2024-09-14T10:46:44.332841+0000","last_unstale":"2024-09-14T12:01:28.374129+0000","last_undegraded":"2024-09-14T12:01:28.374129+0000","last_fullsized":"2024-09-14T12:01:28.374129+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-09-14T12:01:28.373852+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-09-14T12:01:28.373852+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.373852+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:25.272342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133711,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":772,"num_read_kb":6861,"num_write":1433,"num_write_kb":25110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:52.849829+0000","last_change":"2024-09-14T12:01:52.849829+0000","last_active":"2024-09-14T12:01:52.849829+0000","last_peered":"2024-09-14T12:01:52.849829+0000","last_clean":"2024-09-14T12:01:52.849829+0000","last_became_active":"2024-09-14T10:46:48.353010+0000","last_became_peered":"2024-09-14T10:46:48.353010+0000","last_unstale":"2024-09-14T12:01:52.849829+0000","last_undegraded":"2024-09-14T12:01:52.849829+0000","last_fullsized":"2024-09-14T12:01:52.849829+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:52.849742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:52.849742+0000","last_clean_scrub_stamp":"2024-09-14T12:01:52.849742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:37.169755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"263'289","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:47.191562+0000","last_change":"2024-09-14T12:01:47.191562+0000","last_active":"2024-09-14T12:01:47.191562+0000","last_peered":"2024-09-14T12:01:47.191562+0000","last_clean":"2024-09-14T12:01:47.191562+0000","last_became_active":"2024-09-14T10:46:50.362723+0000","last_became_peered":"2024-09-14T10:46:50.362723+0000","last_unstale":"2024-09-14T12:01:47.191562+0000","last_undegraded":"2024-09-14T12:01:47.191562+0000","last_fullsized":"2024-09-14T12:01:47.191562+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'289","last_scrub_stamp":"2024-09-14T12:01:47.191473+0000","last_deep_scrub":"263'289","last_deep_scrub_stamp":"2024-09-14T12:01:47.191473+0000","last_clean_scrub_stamp":"2024-09-14T12:01:47.191473+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:32.942349+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44996,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":451,"num_read_kb":1030,"num_write":360,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:46.048503+0000","last_change":"2024-09-14T12:01:46.048503+0000","last_active":"2024-09-14T12:01:46.048503+0000","last_peered":"2024-09-14T12:01:46.048503+0000","last_clean":"2024-09-14T12:01:46.048503+0000","last_became_active":"2024-09-14T10:46:52.369048+0000","last_became_peered":"2024-09-14T10:46:52.369048+0000","last_unstale":"2024-09-14T12:01:46.048503+0000","last_undegraded":"2024-09-14T12:01:46.048503+0000","last_fullsized":"2024-09-14T12:01:46.048503+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:46.048415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:46.048415+0000","last_clean_scrub_stamp":"2024-09-14T12:01:46.048415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:37.173407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"263'556","reported_seq":2343,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.798201+0000","last_change":"2024-09-14T12:01:43.798097+0000","last_active":"2024-09-14T12:01:43.798201+0000","last_peered":"2024-09-14T12:01:43.798201+0000","last_clean":"2024-09-14T12:01:43.798201+0000","last_became_active":"2024-09-14T10:46:46.348774+0000","last_became_peered":"2024-09-14T10:46:46.348774+0000","last_unstale":"2024-09-14T12:01:43.798201+0000","last_undegraded":"2024-09-14T12:01:43.798201+0000","last_fullsized":"2024-09-14T12:01:43.798201+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'556","last_scrub_stamp":"2024-09-14T12:01:43.797996+0000","last_deep_scrub":"263'556","last_deep_scrub_stamp":"2024-09-14T12:01:43.797996+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.797996+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:15.352106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3189,"num_read_kb":2980,"num_write":657,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"263'401","reported_seq":1094,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.391955+0000","last_change":"2024-09-14T12:01:29.391885+0000","last_active":"2024-09-14T12:01:29.391955+0000","last_peered":"2024-09-14T12:01:29.391955+0000","last_clean":"2024-09-14T12:01:29.391955+0000","last_became_active":"2024-09-14T10:46:44.334693+0000","last_became_peered":"2024-09-14T10:46:44.334693+0000","last_unstale":"2024-09-14T12:01:29.391955+0000","last_undegraded":"2024-09-14T12:01:29.391955+0000","last_fullsized":"2024-09-14T12:01:29.391955+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'401","last_scrub_stamp":"2024-09-14T12:01:29.391776+0000","last_deep_scrub":"263'401","last_deep_scrub_stamp":"2024-09-14T12:01:29.391776+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.391776+0000","objects_scrubbed":5,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:21.186717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1532840,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":807,"num_read_kb":35702,"num_write":1252,"num_write_kb":25930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"263'4","reported_seq":997,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.864111+0000","last_change":"2024-09-14T12:01:43.864111+0000","last_active":"2024-09-14T12:01:43.864111+0000","last_peered":"2024-09-14T12:01:43.864111+0000","last_clean":"2024-09-14T12:01:43.864111+0000","last_became_active":"2024-09-14T10:46:48.350469+0000","last_became_peered":"2024-09-14T10:46:48.350469+0000","last_unstale":"2024-09-14T12:01:43.864111+0000","last_undegraded":"2024-09-14T12:01:43.864111+0000","last_fullsized":"2024-09-14T12:01:43.864111+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:01:43.863982+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:01:43.863982+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.863982+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:27:04.908426+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"263'501","reported_seq":1150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:50.864846+0000","last_change":"2024-09-14T12:01:50.864779+0000","last_active":"2024-09-14T12:01:50.864846+0000","last_peered":"2024-09-14T12:01:50.864846+0000","last_clean":"2024-09-14T12:01:50.864846+0000","last_became_active":"2024-09-14T10:46:50.365486+0000","last_became_peered":"2024-09-14T10:46:50.365486+0000","last_unstale":"2024-09-14T12:01:50.864846+0000","last_undegraded":"2024-09-14T12:01:50.864846+0000","last_fullsized":"2024-09-14T12:01:50.864846+0000","mapping_epoch":32,"log_start":"263'400","ondisk_log_start":"263'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'501","last_scrub_stamp":"2024-09-14T12:01:50.864676+0000","last_deep_scrub":"263'501","last_deep_scrub_stamp":"2024-09-14T12:01:50.864676+0000","last_clean_scrub_stamp":"2024-09-14T12:01:50.864676+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:12.318665+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93124,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":891,"num_read_kb":2144,"num_write":760,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:47.842011+0000","last_change":"2024-09-14T12:01:47.841917+0000","last_active":"2024-09-14T12:01:47.842011+0000","last_peered":"2024-09-14T12:01:47.842011+0000","last_clean":"2024-09-14T12:01:47.842011+0000","last_became_active":"2024-09-14T10:46:52.372151+0000","last_became_peered":"2024-09-14T10:46:52.372151+0000","last_unstale":"2024-09-14T12:01:47.842011+0000","last_undegraded":"2024-09-14T12:01:47.842011+0000","last_fullsized":"2024-09-14T12:01:47.842011+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:47.841832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:47.841832+0000","last_clean_scrub_stamp":"2024-09-14T12:01:47.841832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:42.232450+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"263'207","reported_seq":727,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:02.180825+0000","last_change":"2024-09-14T12:02:02.180825+0000","last_active":"2024-09-14T12:02:02.180825+0000","last_peered":"2024-09-14T12:02:02.180825+0000","last_clean":"2024-09-14T12:02:02.180825+0000","last_became_active":"2024-09-14T10:46:54.386525+0000","last_became_peered":"2024-09-14T10:46:54.386525+0000","last_unstale":"2024-09-14T12:02:02.180825+0000","last_undegraded":"2024-09-14T12:02:02.180825+0000","last_fullsized":"2024-09-14T12:02:02.180825+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'207","last_scrub_stamp":"2024-09-14T12:02:02.180735+0000","last_deep_scrub":"263'207","last_deep_scrub_stamp":"2024-09-14T12:02:02.180735+0000","last_clean_scrub_stamp":"2024-09-14T12:02:02.180735+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:53.469743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":260,"num_read_kb":259,"num_write":474,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"263'419","reported_seq":2088,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.678034+0000","last_change":"2024-09-14T12:01:38.678034+0000","last_active":"2024-09-14T12:01:38.678034+0000","last_peered":"2024-09-14T12:01:38.678034+0000","last_clean":"2024-09-14T12:01:38.678034+0000","last_became_active":"2024-09-14T10:46:46.341559+0000","last_became_peered":"2024-09-14T10:46:46.341559+0000","last_unstale":"2024-09-14T12:01:38.678034+0000","last_undegraded":"2024-09-14T12:01:38.678034+0000","last_fullsized":"2024-09-14T12:01:38.678034+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'419","last_scrub_stamp":"2024-09-14T12:01:38.677944+0000","last_deep_scrub":"263'419","last_deep_scrub_stamp":"2024-09-14T12:01:38.677944+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.677944+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:16.076637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2371,"num_read_kb":2275,"num_write":467,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"263'282","reported_seq":938,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.691728+0000","last_change":"2024-09-14T12:01:31.691639+0000","last_active":"2024-09-14T12:01:31.691728+0000","last_peered":"2024-09-14T12:01:31.691728+0000","last_clean":"2024-09-14T12:01:31.691728+0000","last_became_active":"2024-09-14T10:46:44.319896+0000","last_became_peered":"2024-09-14T10:46:44.319896+0000","last_unstale":"2024-09-14T12:01:31.691728+0000","last_undegraded":"2024-09-14T12:01:31.691728+0000","last_fullsized":"2024-09-14T12:01:31.691728+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'282","last_scrub_stamp":"2024-09-14T12:01:31.691521+0000","last_deep_scrub":"263'282","last_deep_scrub_stamp":"2024-09-14T12:01:31.691521+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.691521+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:52.725869+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133682,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":524,"num_read_kb":94668,"num_write":900,"num_write_kb":37785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.928810+0000","last_change":"2024-09-14T12:01:42.928757+0000","last_active":"2024-09-14T12:01:42.928810+0000","last_peered":"2024-09-14T12:01:42.928810+0000","last_clean":"2024-09-14T12:01:42.928810+0000","last_became_active":"2024-09-14T10:46:48.355149+0000","last_became_peered":"2024-09-14T10:46:48.355149+0000","last_unstale":"2024-09-14T12:01:42.928810+0000","last_undegraded":"2024-09-14T12:01:42.928810+0000","last_fullsized":"2024-09-14T12:01:42.928810+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:42.928663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:42.928663+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.928663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:09.783248+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"263'353","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:58.831540+0000","last_change":"2024-09-14T12:01:58.831540+0000","last_active":"2024-09-14T12:01:58.831540+0000","last_peered":"2024-09-14T12:01:58.831540+0000","last_clean":"2024-09-14T12:01:58.831540+0000","last_became_active":"2024-09-14T10:46:50.366749+0000","last_became_peered":"2024-09-14T10:46:50.366749+0000","last_unstale":"2024-09-14T12:01:58.831540+0000","last_undegraded":"2024-09-14T12:01:58.831540+0000","last_fullsized":"2024-09-14T12:01:58.831540+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'353","last_scrub_stamp":"2024-09-14T12:01:58.831444+0000","last_deep_scrub":"263'353","last_deep_scrub_stamp":"2024-09-14T12:01:58.831444+0000","last_clean_scrub_stamp":"2024-09-14T12:01:58.831444+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:18.190822+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49707,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":587,"num_read_kb":1269,"num_write":486,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:57.154367+0000","last_change":"2024-09-14T12:01:57.154367+0000","last_active":"2024-09-14T12:01:57.154367+0000","last_peered":"2024-09-14T12:01:57.154367+0000","last_clean":"2024-09-14T12:01:57.154367+0000","last_became_active":"2024-09-14T10:46:52.368508+0000","last_became_peered":"2024-09-14T10:46:52.368508+0000","last_unstale":"2024-09-14T12:01:57.154367+0000","last_undegraded":"2024-09-14T12:01:57.154367+0000","last_fullsized":"2024-09-14T12:01:57.154367+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:57.154283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:57.154283+0000","last_clean_scrub_stamp":"2024-09-14T12:01:57.154283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:27.227112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"263'188","reported_seq":1073,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:08.679568+0000","last_change":"2024-09-14T12:02:08.679568+0000","last_active":"2024-09-14T12:02:08.679568+0000","last_peered":"2024-09-14T12:02:08.679568+0000","last_clean":"2024-09-14T12:02:08.679568+0000","last_became_active":"2024-09-14T10:46:54.378938+0000","last_became_peered":"2024-09-14T10:46:54.378938+0000","last_unstale":"2024-09-14T12:02:08.679568+0000","last_undegraded":"2024-09-14T12:02:08.679568+0000","last_fullsized":"2024-09-14T12:02:08.679568+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'188","last_scrub_stamp":"2024-09-14T12:02:08.679492+0000","last_deep_scrub":"263'188","last_deep_scrub_stamp":"2024-09-14T12:02:08.679492+0000","last_clean_scrub_stamp":"2024-09-14T12:02:08.679492+0000","objects_scrubbed":7,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:00.165220+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2044,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":607,"num_read_kb":603,"num_write":505,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"263'637","reported_seq":2307,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.079238+0000","last_change":"2024-09-14T12:01:35.079167+0000","last_active":"2024-09-14T12:01:35.079238+0000","last_peered":"2024-09-14T12:01:35.079238+0000","last_clean":"2024-09-14T12:01:35.079238+0000","last_became_active":"2024-09-14T10:46:46.347362+0000","last_became_peered":"2024-09-14T10:46:46.347362+0000","last_unstale":"2024-09-14T12:01:35.079238+0000","last_undegraded":"2024-09-14T12:01:35.079238+0000","last_fullsized":"2024-09-14T12:01:35.079238+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'637","last_scrub_stamp":"2024-09-14T12:01:35.079082+0000","last_deep_scrub":"263'637","last_deep_scrub_stamp":"2024-09-14T12:01:35.079082+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.079082+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":600,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:12.178538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3345,"num_read_kb":3056,"num_write":864,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"263'375","reported_seq":1036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.727303+0000","last_change":"2024-09-14T12:01:26.727237+0000","last_active":"2024-09-14T12:01:26.727303+0000","last_peered":"2024-09-14T12:01:26.727303+0000","last_clean":"2024-09-14T12:01:26.727303+0000","last_became_active":"2024-09-14T10:46:44.318099+0000","last_became_peered":"2024-09-14T10:46:44.318099+0000","last_unstale":"2024-09-14T12:01:26.727303+0000","last_undegraded":"2024-09-14T12:01:26.727303+0000","last_fullsized":"2024-09-14T12:01:26.727303+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'375","last_scrub_stamp":"2024-09-14T12:01:26.727098+0000","last_deep_scrub":"263'375","last_deep_scrub_stamp":"2024-09-14T12:01:26.727098+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.727098+0000","objects_scrubbed":8,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:42.583432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133694,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":681,"num_read_kb":1685,"num_write":1259,"num_write_kb":36237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.899872+0000","last_change":"2024-09-14T12:01:41.899759+0000","last_active":"2024-09-14T12:01:41.899872+0000","last_peered":"2024-09-14T12:01:41.899872+0000","last_clean":"2024-09-14T12:01:41.899872+0000","last_became_active":"2024-09-14T10:46:48.350059+0000","last_became_peered":"2024-09-14T10:46:48.350059+0000","last_unstale":"2024-09-14T12:01:41.899872+0000","last_undegraded":"2024-09-14T12:01:41.899872+0000","last_fullsized":"2024-09-14T12:01:41.899872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:41.899660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:41.899660+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.899660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:49.562202+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"263'316","reported_seq":917,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:51.849471+0000","last_change":"2024-09-14T12:01:51.849404+0000","last_active":"2024-09-14T12:01:51.849471+0000","last_peered":"2024-09-14T12:01:51.849471+0000","last_clean":"2024-09-14T12:01:51.849471+0000","last_became_active":"2024-09-14T10:46:50.365393+0000","last_became_peered":"2024-09-14T10:46:50.365393+0000","last_unstale":"2024-09-14T12:01:51.849471+0000","last_undegraded":"2024-09-14T12:01:51.849471+0000","last_fullsized":"2024-09-14T12:01:51.849471+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'316","last_scrub_stamp":"2024-09-14T12:01:51.849311+0000","last_deep_scrub":"263'316","last_deep_scrub_stamp":"2024-09-14T12:01:51.849311+0000","last_clean_scrub_stamp":"2024-09-14T12:01:51.849311+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:19.475246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46624,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":509,"num_read_kb":1174,"num_write":408,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:48.058716+0000","last_change":"2024-09-14T12:01:48.058716+0000","last_active":"2024-09-14T12:01:48.058716+0000","last_peered":"2024-09-14T12:01:48.058716+0000","last_clean":"2024-09-14T12:01:48.058716+0000","last_became_active":"2024-09-14T10:46:52.373099+0000","last_became_peered":"2024-09-14T10:46:52.373099+0000","last_unstale":"2024-09-14T12:01:48.058716+0000","last_undegraded":"2024-09-14T12:01:48.058716+0000","last_fullsized":"2024-09-14T12:01:48.058716+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:48.058614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:48.058614+0000","last_clean_scrub_stamp":"2024-09-14T12:01:48.058614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:24.902309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"263'147","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:06.683872+0000","last_change":"2024-09-14T12:02:06.683872+0000","last_active":"2024-09-14T12:02:06.683872+0000","last_peered":"2024-09-14T12:02:06.683872+0000","last_clean":"2024-09-14T12:02:06.683872+0000","last_became_active":"2024-09-14T10:46:54.385625+0000","last_became_peered":"2024-09-14T10:46:54.385625+0000","last_unstale":"2024-09-14T12:02:06.683872+0000","last_undegraded":"2024-09-14T12:02:06.683872+0000","last_fullsized":"2024-09-14T12:02:06.683872+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'147","last_scrub_stamp":"2024-09-14T12:02:06.683765+0000","last_deep_scrub":"263'147","last_deep_scrub_stamp":"2024-09-14T12:02:06.683765+0000","last_clean_scrub_stamp":"2024-09-14T12:02:06.683765+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:10.241060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":790,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":228,"num_read_kb":197,"num_write":338,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"263'418","reported_seq":1968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.632743+0000","last_change":"2024-09-14T12:01:37.632681+0000","last_active":"2024-09-14T12:01:37.632743+0000","last_peered":"2024-09-14T12:01:37.632743+0000","last_clean":"2024-09-14T12:01:37.632743+0000","last_became_active":"2024-09-14T10:46:46.338551+0000","last_became_peered":"2024-09-14T10:46:46.338551+0000","last_unstale":"2024-09-14T12:01:37.632743+0000","last_undegraded":"2024-09-14T12:01:37.632743+0000","last_fullsized":"2024-09-14T12:01:37.632743+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'418","last_scrub_stamp":"2024-09-14T12:01:37.632564+0000","last_deep_scrub":"263'418","last_deep_scrub_stamp":"2024-09-14T12:01:37.632564+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.632564+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:48.702789+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2291,"num_read_kb":2170,"num_write":475,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"263'291","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.702324+0000","last_change":"2024-09-14T12:01:32.702217+0000","last_active":"2024-09-14T12:01:32.702324+0000","last_peered":"2024-09-14T12:01:32.702324+0000","last_clean":"2024-09-14T12:01:32.702324+0000","last_became_active":"2024-09-14T10:46:44.331660+0000","last_became_peered":"2024-09-14T10:46:44.331660+0000","last_unstale":"2024-09-14T12:01:32.702324+0000","last_undegraded":"2024-09-14T12:01:32.702324+0000","last_fullsized":"2024-09-14T12:01:32.702324+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'291","last_scrub_stamp":"2024-09-14T12:01:32.702040+0000","last_deep_scrub":"263'291","last_deep_scrub_stamp":"2024-09-14T12:01:32.702040+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.702040+0000","objects_scrubbed":9,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:26.595923+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":521,"num_read_kb":29638,"num_write":955,"num_write_kb":30451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:49.529666+0000","last_change":"2024-09-14T12:01:49.529598+0000","last_active":"2024-09-14T12:01:49.529666+0000","last_peered":"2024-09-14T12:01:49.529666+0000","last_clean":"2024-09-14T12:01:49.529666+0000","last_became_active":"2024-09-14T10:46:48.350072+0000","last_became_peered":"2024-09-14T10:46:48.350072+0000","last_unstale":"2024-09-14T12:01:49.529666+0000","last_undegraded":"2024-09-14T12:01:49.529666+0000","last_fullsized":"2024-09-14T12:01:49.529666+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:49.529513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:49.529513+0000","last_clean_scrub_stamp":"2024-09-14T12:01:49.529513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:28.315817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"263'132","reported_seq":685,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:00.836105+0000","last_change":"2024-09-14T12:02:00.836105+0000","last_active":"2024-09-14T12:02:00.836105+0000","last_peered":"2024-09-14T12:02:00.836105+0000","last_clean":"2024-09-14T12:02:00.836105+0000","last_became_active":"2024-09-14T10:46:50.367991+0000","last_became_peered":"2024-09-14T10:46:50.367991+0000","last_unstale":"2024-09-14T12:02:00.836105+0000","last_undegraded":"2024-09-14T12:02:00.836105+0000","last_fullsized":"2024-09-14T12:02:00.836105+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'132","last_scrub_stamp":"2024-09-14T12:02:00.835968+0000","last_deep_scrub":"263'132","last_deep_scrub_stamp":"2024-09-14T12:02:00.835968+0000","last_clean_scrub_stamp":"2024-09-14T12:02:00.835968+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:07.297080+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":126,"num_write":102,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"263'780","reported_seq":2696,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:48.218375+0000","last_change":"2024-09-14T12:01:48.218326+0000","last_active":"2024-09-14T12:01:48.218375+0000","last_peered":"2024-09-14T12:01:48.218375+0000","last_clean":"2024-09-14T12:01:48.218375+0000","last_became_active":"2024-09-14T10:46:52.370446+0000","last_became_peered":"2024-09-14T10:46:52.370446+0000","last_unstale":"2024-09-14T12:01:48.218375+0000","last_undegraded":"2024-09-14T12:01:48.218375+0000","last_fullsized":"2024-09-14T12:01:48.218375+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'780","last_scrub_stamp":"2024-09-14T12:01:48.218254+0000","last_deep_scrub":"263'780","last_deep_scrub_stamp":"2024-09-14T12:01:48.218254+0000","last_clean_scrub_stamp":"2024-09-14T12:01:48.218254+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:47.221639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"263'121","reported_seq":656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:07.698920+0000","last_change":"2024-09-14T12:02:07.698920+0000","last_active":"2024-09-14T12:02:07.698920+0000","last_peered":"2024-09-14T12:02:07.698920+0000","last_clean":"2024-09-14T12:02:07.698920+0000","last_became_active":"2024-09-14T10:46:54.377788+0000","last_became_peered":"2024-09-14T10:46:54.377788+0000","last_unstale":"2024-09-14T12:02:07.698920+0000","last_undegraded":"2024-09-14T12:02:07.698920+0000","last_fullsized":"2024-09-14T12:02:07.698920+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'121","last_scrub_stamp":"2024-09-14T12:02:07.698832+0000","last_deep_scrub":"263'121","last_deep_scrub_stamp":"2024-09-14T12:02:07.698832+0000","last_clean_scrub_stamp":"2024-09-14T12:02:07.698832+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:06.345657+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":221,"num_read_kb":193,"num_write":312,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"263'792","reported_seq":2344,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.869824+0000","last_change":"2024-09-14T12:01:38.869721+0000","last_active":"2024-09-14T12:01:38.869824+0000","last_peered":"2024-09-14T12:01:38.869824+0000","last_clean":"2024-09-14T12:01:38.869824+0000","last_became_active":"2024-09-14T10:46:46.352087+0000","last_became_peered":"2024-09-14T10:46:46.352087+0000","last_unstale":"2024-09-14T12:01:38.869824+0000","last_undegraded":"2024-09-14T12:01:38.869824+0000","last_fullsized":"2024-09-14T12:01:38.869824+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'792","last_scrub_stamp":"2024-09-14T12:01:38.869609+0000","last_deep_scrub":"263'792","last_deep_scrub_stamp":"2024-09-14T12:01:38.869609+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.869609+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:26.016700+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3891,"num_read_kb":3520,"num_write":1035,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"263'316","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.681774+0000","last_change":"2024-09-14T12:01:27.681717+0000","last_active":"2024-09-14T12:01:27.681774+0000","last_peered":"2024-09-14T12:01:27.681774+0000","last_clean":"2024-09-14T12:01:27.681774+0000","last_became_active":"2024-09-14T10:46:44.320689+0000","last_became_peered":"2024-09-14T10:46:44.320689+0000","last_unstale":"2024-09-14T12:01:27.681774+0000","last_undegraded":"2024-09-14T12:01:27.681774+0000","last_fullsized":"2024-09-14T12:01:27.681774+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'316","last_scrub_stamp":"2024-09-14T12:01:27.681619+0000","last_deep_scrub":"263'316","last_deep_scrub_stamp":"2024-09-14T12:01:27.681619+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.681619+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:26.610212+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":532,"num_read_kb":954,"num_write":1107,"num_write_kb":21144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.691769+0000","last_change":"2024-09-14T12:01:40.691672+0000","last_active":"2024-09-14T12:01:40.691769+0000","last_peered":"2024-09-14T12:01:40.691769+0000","last_clean":"2024-09-14T12:01:40.691769+0000","last_became_active":"2024-09-14T10:46:48.357024+0000","last_became_peered":"2024-09-14T10:46:48.357024+0000","last_unstale":"2024-09-14T12:01:40.691769+0000","last_undegraded":"2024-09-14T12:01:40.691769+0000","last_fullsized":"2024-09-14T12:01:40.691769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:40.691553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:40.691553+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.691553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:20.398399+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"263'385","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:46.207002+0000","last_change":"2024-09-14T12:01:46.206932+0000","last_active":"2024-09-14T12:01:46.207002+0000","last_peered":"2024-09-14T12:01:46.207002+0000","last_clean":"2024-09-14T12:01:46.207002+0000","last_became_active":"2024-09-14T10:46:50.361962+0000","last_became_peered":"2024-09-14T10:46:50.361962+0000","last_unstale":"2024-09-14T12:01:46.207002+0000","last_undegraded":"2024-09-14T12:01:46.207002+0000","last_fullsized":"2024-09-14T12:01:46.207002+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'385","last_scrub_stamp":"2024-09-14T12:01:46.206822+0000","last_deep_scrub":"263'385","last_deep_scrub_stamp":"2024-09-14T12:01:46.206822+0000","last_clean_scrub_stamp":"2024-09-14T12:01:46.206822+0000","objects_scrubbed":8,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:07.450497+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49011,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":601,"num_read_kb":1340,"num_write":486,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:59.667395+0000","last_change":"2024-09-14T12:01:59.667395+0000","last_active":"2024-09-14T12:01:59.667395+0000","last_peered":"2024-09-14T12:01:59.667395+0000","last_clean":"2024-09-14T12:01:59.667395+0000","last_became_active":"2024-09-14T10:46:52.369262+0000","last_became_peered":"2024-09-14T10:46:52.369262+0000","last_unstale":"2024-09-14T12:01:59.667395+0000","last_undegraded":"2024-09-14T12:01:59.667395+0000","last_fullsized":"2024-09-14T12:01:59.667395+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:59.667313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:59.667313+0000","last_clean_scrub_stamp":"2024-09-14T12:01:59.667313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:13.006453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"263'149","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:49.662036+0000","last_change":"2024-09-14T12:01:49.661958+0000","last_active":"2024-09-14T12:01:49.662036+0000","last_peered":"2024-09-14T12:01:49.662036+0000","last_clean":"2024-09-14T12:01:49.662036+0000","last_became_active":"2024-09-14T10:46:54.385235+0000","last_became_peered":"2024-09-14T10:46:54.385235+0000","last_unstale":"2024-09-14T12:01:49.662036+0000","last_undegraded":"2024-09-14T12:01:49.662036+0000","last_fullsized":"2024-09-14T12:01:49.662036+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'149","last_scrub_stamp":"2024-09-14T12:01:49.661869+0000","last_deep_scrub":"263'149","last_deep_scrub_stamp":"2024-09-14T12:01:49.661869+0000","last_clean_scrub_stamp":"2024-09-14T12:01:49.661869+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:05.463904+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":187,"num_write":368,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"263'750","reported_seq":2318,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.864213+0000","last_change":"2024-09-14T12:01:36.864145+0000","last_active":"2024-09-14T12:01:36.864213+0000","last_peered":"2024-09-14T12:01:36.864213+0000","last_clean":"2024-09-14T12:01:36.864213+0000","last_became_active":"2024-09-14T10:46:46.335112+0000","last_became_peered":"2024-09-14T10:46:46.335112+0000","last_unstale":"2024-09-14T12:01:36.864213+0000","last_undegraded":"2024-09-14T12:01:36.864213+0000","last_fullsized":"2024-09-14T12:01:36.864213+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'750","last_scrub_stamp":"2024-09-14T12:01:36.864055+0000","last_deep_scrub":"263'750","last_deep_scrub_stamp":"2024-09-14T12:01:36.864055+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.864055+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:44.163046+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3755,"num_read_kb":3425,"num_write":989,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"263'322","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.760058+0000","last_change":"2024-09-14T12:01:34.759992+0000","last_active":"2024-09-14T12:01:34.760058+0000","last_peered":"2024-09-14T12:01:34.760058+0000","last_clean":"2024-09-14T12:01:34.760058+0000","last_became_active":"2024-09-14T10:46:44.332130+0000","last_became_peered":"2024-09-14T10:46:44.332130+0000","last_unstale":"2024-09-14T12:01:34.760058+0000","last_undegraded":"2024-09-14T12:01:34.760058+0000","last_fullsized":"2024-09-14T12:01:34.760058+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'322","last_scrub_stamp":"2024-09-14T12:01:34.759869+0000","last_deep_scrub":"263'322","last_deep_scrub_stamp":"2024-09-14T12:01:34.759869+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.759869+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:56.671464+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":584,"num_read_kb":32074,"num_write":1014,"num_write_kb":20757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.891909+0000","last_change":"2024-09-14T12:01:40.891826+0000","last_active":"2024-09-14T12:01:40.891909+0000","last_peered":"2024-09-14T12:01:40.891909+0000","last_clean":"2024-09-14T12:01:40.891909+0000","last_became_active":"2024-09-14T10:46:48.354108+0000","last_became_peered":"2024-09-14T10:46:48.354108+0000","last_unstale":"2024-09-14T12:01:40.891909+0000","last_undegraded":"2024-09-14T12:01:40.891909+0000","last_fullsized":"2024-09-14T12:01:40.891909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:40.891732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:40.891732+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.891732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:32.261695+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"263'275","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:55.604927+0000","last_change":"2024-09-14T12:01:55.604927+0000","last_active":"2024-09-14T12:01:55.604927+0000","last_peered":"2024-09-14T12:01:55.604927+0000","last_clean":"2024-09-14T12:01:55.604927+0000","last_became_active":"2024-09-14T10:46:50.358186+0000","last_became_peered":"2024-09-14T10:46:50.358186+0000","last_unstale":"2024-09-14T12:01:55.604927+0000","last_undegraded":"2024-09-14T12:01:55.604927+0000","last_fullsized":"2024-09-14T12:01:55.604927+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'275","last_scrub_stamp":"2024-09-14T12:01:55.604828+0000","last_deep_scrub":"263'275","last_deep_scrub_stamp":"2024-09-14T12:01:55.604828+0000","last_clean_scrub_stamp":"2024-09-14T12:01:55.604828+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:49.582183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46012,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":454,"num_read_kb":1061,"num_write":362,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:02.790850+0000","last_change":"2024-09-14T12:02:02.790850+0000","last_active":"2024-09-14T12:02:02.790850+0000","last_peered":"2024-09-14T12:02:02.790850+0000","last_clean":"2024-09-14T12:02:02.790850+0000","last_became_active":"2024-09-14T10:46:52.365736+0000","last_became_peered":"2024-09-14T10:46:52.365736+0000","last_unstale":"2024-09-14T12:02:02.790850+0000","last_undegraded":"2024-09-14T12:02:02.790850+0000","last_fullsized":"2024-09-14T12:02:02.790850+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:02.790754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:02.790754+0000","last_clean_scrub_stamp":"2024-09-14T12:02:02.790754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:29.657420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"263'125","reported_seq":648,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:03.170601+0000","last_change":"2024-09-14T12:02:03.170601+0000","last_active":"2024-09-14T12:02:03.170601+0000","last_peered":"2024-09-14T12:02:03.170601+0000","last_clean":"2024-09-14T12:02:03.170601+0000","last_became_active":"2024-09-14T10:46:54.384303+0000","last_became_peered":"2024-09-14T10:46:54.384303+0000","last_unstale":"2024-09-14T12:02:03.170601+0000","last_undegraded":"2024-09-14T12:02:03.170601+0000","last_fullsized":"2024-09-14T12:02:03.170601+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'125","last_scrub_stamp":"2024-09-14T12:02:03.170516+0000","last_deep_scrub":"263'125","last_deep_scrub_stamp":"2024-09-14T12:02:03.170516+0000","last_clean_scrub_stamp":"2024-09-14T12:02:03.170516+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:15.137603+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":957,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":145,"num_write":281,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"263'378","reported_seq":1802,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.141125+0000","last_change":"2024-09-14T12:01:32.141054+0000","last_active":"2024-09-14T12:01:32.141125+0000","last_peered":"2024-09-14T12:01:32.141125+0000","last_clean":"2024-09-14T12:01:32.141125+0000","last_became_active":"2024-09-14T10:46:46.338518+0000","last_became_peered":"2024-09-14T10:46:46.338518+0000","last_unstale":"2024-09-14T12:01:32.141125+0000","last_undegraded":"2024-09-14T12:01:32.141125+0000","last_fullsized":"2024-09-14T12:01:32.141125+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-14T12:01:32.140969+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-14T12:01:32.140969+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.140969+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:30.472756+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2070,"num_read_kb":1951,"num_write":457,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"263'362","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.372654+0000","last_change":"2024-09-14T12:01:30.372654+0000","last_active":"2024-09-14T12:01:30.372654+0000","last_peered":"2024-09-14T12:01:30.372654+0000","last_clean":"2024-09-14T12:01:30.372654+0000","last_became_active":"2024-09-14T10:46:44.332852+0000","last_became_peered":"2024-09-14T10:46:44.332852+0000","last_unstale":"2024-09-14T12:01:30.372654+0000","last_undegraded":"2024-09-14T12:01:30.372654+0000","last_fullsized":"2024-09-14T12:01:30.372654+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-14T12:01:30.372539+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-14T12:01:30.372539+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.372539+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:57.066912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":662,"num_read_kb":10749,"num_write":1220,"num_write_kb":43875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.676465+0000","last_change":"2024-09-14T12:01:41.676362+0000","last_active":"2024-09-14T12:01:41.676465+0000","last_peered":"2024-09-14T12:01:41.676465+0000","last_clean":"2024-09-14T12:01:41.676465+0000","last_became_active":"2024-09-14T10:46:48.355512+0000","last_became_peered":"2024-09-14T10:46:48.355512+0000","last_unstale":"2024-09-14T12:01:41.676465+0000","last_undegraded":"2024-09-14T12:01:41.676465+0000","last_fullsized":"2024-09-14T12:01:41.676465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:41.676262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:41.676262+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.676262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:42.505362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"263'267","reported_seq":838,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:49.850396+0000","last_change":"2024-09-14T12:01:49.850337+0000","last_active":"2024-09-14T12:01:49.850396+0000","last_peered":"2024-09-14T12:01:49.850396+0000","last_clean":"2024-09-14T12:01:49.850396+0000","last_became_active":"2024-09-14T10:46:50.364420+0000","last_became_peered":"2024-09-14T10:46:50.364420+0000","last_unstale":"2024-09-14T12:01:49.850396+0000","last_undegraded":"2024-09-14T12:01:49.850396+0000","last_fullsized":"2024-09-14T12:01:49.850396+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'267","last_scrub_stamp":"2024-09-14T12:01:49.850246+0000","last_deep_scrub":"263'267","last_deep_scrub_stamp":"2024-09-14T12:01:49.850246+0000","last_clean_scrub_stamp":"2024-09-14T12:01:49.850246+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:15.233761+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45284,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":455,"num_read_kb":1165,"num_write":378,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:05.713470+0000","last_change":"2024-09-14T12:02:05.713470+0000","last_active":"2024-09-14T12:02:05.713470+0000","last_peered":"2024-09-14T12:02:05.713470+0000","last_clean":"2024-09-14T12:02:05.713470+0000","last_became_active":"2024-09-14T10:46:52.373913+0000","last_became_peered":"2024-09-14T10:46:52.373913+0000","last_unstale":"2024-09-14T12:02:05.713470+0000","last_undegraded":"2024-09-14T12:02:05.713470+0000","last_fullsized":"2024-09-14T12:02:05.713470+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:05.713377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:05.713377+0000","last_clean_scrub_stamp":"2024-09-14T12:02:05.713377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:17.741274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"263'132","reported_seq":1242,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:09.650742+0000","last_change":"2024-09-14T12:02:09.650742+0000","last_active":"2024-09-14T12:02:09.650742+0000","last_peered":"2024-09-14T12:02:09.650742+0000","last_clean":"2024-09-14T12:02:09.650742+0000","last_became_active":"2024-09-14T10:46:54.383637+0000","last_became_peered":"2024-09-14T10:46:54.383637+0000","last_unstale":"2024-09-14T12:02:09.650742+0000","last_undegraded":"2024-09-14T12:02:09.650742+0000","last_fullsized":"2024-09-14T12:02:09.650742+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'132","last_scrub_stamp":"2024-09-14T12:02:09.650638+0000","last_deep_scrub":"263'132","last_deep_scrub_stamp":"2024-09-14T12:02:09.650638+0000","last_clean_scrub_stamp":"2024-09-14T12:02:09.650638+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:21.941731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":738,"num_read_kb":738,"num_write":285,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"263'446","reported_seq":1913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.792550+0000","last_change":"2024-09-14T12:01:34.792489+0000","last_active":"2024-09-14T12:01:34.792550+0000","last_peered":"2024-09-14T12:01:34.792550+0000","last_clean":"2024-09-14T12:01:34.792550+0000","last_became_active":"2024-09-14T10:46:46.342299+0000","last_became_peered":"2024-09-14T10:46:46.342299+0000","last_unstale":"2024-09-14T12:01:34.792550+0000","last_undegraded":"2024-09-14T12:01:34.792550+0000","last_fullsized":"2024-09-14T12:01:34.792550+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'446","last_scrub_stamp":"2024-09-14T12:01:34.792381+0000","last_deep_scrub":"263'446","last_deep_scrub_stamp":"2024-09-14T12:01:34.792381+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.792381+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:14.733658+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2232,"num_read_kb":2089,"num_write":533,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"263'512","reported_seq":1273,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.363748+0000","last_change":"2024-09-14T12:01:31.363630+0000","last_active":"2024-09-14T12:01:31.363748+0000","last_peered":"2024-09-14T12:01:31.363748+0000","last_clean":"2024-09-14T12:01:31.363748+0000","last_became_active":"2024-09-14T10:46:44.320749+0000","last_became_peered":"2024-09-14T10:46:44.320749+0000","last_unstale":"2024-09-14T12:01:31.363748+0000","last_undegraded":"2024-09-14T12:01:31.363748+0000","last_fullsized":"2024-09-14T12:01:31.363748+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'512","last_scrub_stamp":"2024-09-14T12:01:31.363472+0000","last_deep_scrub":"263'512","last_deep_scrub_stamp":"2024-09-14T12:01:31.363472+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.363472+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:49.759769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1101,"num_read_kb":48118,"num_write":1530,"num_write_kb":57550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:48.548228+0000","last_change":"2024-09-14T12:01:48.548151+0000","last_active":"2024-09-14T12:01:48.548228+0000","last_peered":"2024-09-14T12:01:48.548228+0000","last_clean":"2024-09-14T12:01:48.548228+0000","last_became_active":"2024-09-14T10:46:48.352853+0000","last_became_peered":"2024-09-14T10:46:48.352853+0000","last_unstale":"2024-09-14T12:01:48.548228+0000","last_undegraded":"2024-09-14T12:01:48.548228+0000","last_fullsized":"2024-09-14T12:01:48.548228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:01:48.548073+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:01:48.548073+0000","last_clean_scrub_stamp":"2024-09-14T12:01:48.548073+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:39.485060+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"263'309","reported_seq":917,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:59.871705+0000","last_change":"2024-09-14T12:01:59.871705+0000","last_active":"2024-09-14T12:01:59.871705+0000","last_peered":"2024-09-14T12:01:59.871705+0000","last_clean":"2024-09-14T12:01:59.871705+0000","last_became_active":"2024-09-14T10:46:50.369492+0000","last_became_peered":"2024-09-14T10:46:50.369492+0000","last_unstale":"2024-09-14T12:01:59.871705+0000","last_undegraded":"2024-09-14T12:01:59.871705+0000","last_fullsized":"2024-09-14T12:01:59.871705+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'309","last_scrub_stamp":"2024-09-14T12:01:59.871529+0000","last_deep_scrub":"263'309","last_deep_scrub_stamp":"2024-09-14T12:01:59.871529+0000","last_clean_scrub_stamp":"2024-09-14T12:01:59.871529+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:44.228020+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49661,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":1034,"num_write":382,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:00.657215+0000","last_change":"2024-09-14T12:02:00.657215+0000","last_active":"2024-09-14T12:02:00.657215+0000","last_peered":"2024-09-14T12:02:00.657215+0000","last_clean":"2024-09-14T12:02:00.657215+0000","last_became_active":"2024-09-14T10:46:52.372108+0000","last_became_peered":"2024-09-14T10:46:52.372108+0000","last_unstale":"2024-09-14T12:02:00.657215+0000","last_undegraded":"2024-09-14T12:02:00.657215+0000","last_fullsized":"2024-09-14T12:02:00.657215+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:00.657130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:00.657130+0000","last_clean_scrub_stamp":"2024-09-14T12:02:00.657130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:12.133923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"263'128","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:50.220643+0000","last_change":"2024-09-14T12:01:50.220643+0000","last_active":"2024-09-14T12:01:50.220643+0000","last_peered":"2024-09-14T12:01:50.220643+0000","last_clean":"2024-09-14T12:01:50.220643+0000","last_became_active":"2024-09-14T10:46:54.384278+0000","last_became_peered":"2024-09-14T10:46:54.384278+0000","last_unstale":"2024-09-14T12:01:50.220643+0000","last_undegraded":"2024-09-14T12:01:50.220643+0000","last_fullsized":"2024-09-14T12:01:50.220643+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'128","last_scrub_stamp":"2024-09-14T12:01:50.220551+0000","last_deep_scrub":"263'128","last_deep_scrub_stamp":"2024-09-14T12:01:50.220551+0000","last_clean_scrub_stamp":"2024-09-14T12:01:50.220551+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:16.653583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":278,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"263'466","reported_seq":2044,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.585291+0000","last_change":"2024-09-14T12:01:40.585291+0000","last_active":"2024-09-14T12:01:40.585291+0000","last_peered":"2024-09-14T12:01:40.585291+0000","last_clean":"2024-09-14T12:01:40.585291+0000","last_became_active":"2024-09-14T10:46:46.346994+0000","last_became_peered":"2024-09-14T10:46:46.346994+0000","last_unstale":"2024-09-14T12:01:40.585291+0000","last_undegraded":"2024-09-14T12:01:40.585291+0000","last_fullsized":"2024-09-14T12:01:40.585291+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'466","last_scrub_stamp":"2024-09-14T12:01:40.585204+0000","last_deep_scrub":"263'466","last_deep_scrub_stamp":"2024-09-14T12:01:40.585204+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.585204+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:50.174388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2420,"num_read_kb":2273,"num_write":546,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"263'389","reported_seq":1154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.853039+0000","last_change":"2024-09-14T12:01:26.852936+0000","last_active":"2024-09-14T12:01:26.853039+0000","last_peered":"2024-09-14T12:01:26.853039+0000","last_clean":"2024-09-14T12:01:26.853039+0000","last_became_active":"2024-09-14T10:46:44.328946+0000","last_became_peered":"2024-09-14T10:46:44.328946+0000","last_unstale":"2024-09-14T12:01:26.853039+0000","last_undegraded":"2024-09-14T12:01:26.853039+0000","last_fullsized":"2024-09-14T12:01:26.853039+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-14T12:01:26.852803+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-14T12:01:26.852803+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.852803+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:56.352304+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1017,"num_read_kb":28148,"num_write":1233,"num_write_kb":43814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"263'510","reported_seq":2200,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.085089+0000","last_change":"2024-09-14T12:01:34.085089+0000","last_active":"2024-09-14T12:01:34.085089+0000","last_peered":"2024-09-14T12:01:34.085089+0000","last_clean":"2024-09-14T12:01:34.085089+0000","last_became_active":"2024-09-14T10:46:46.343234+0000","last_became_peered":"2024-09-14T10:46:46.343234+0000","last_unstale":"2024-09-14T12:01:34.085089+0000","last_undegraded":"2024-09-14T12:01:34.085089+0000","last_fullsized":"2024-09-14T12:01:34.085089+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'510","last_scrub_stamp":"2024-09-14T12:01:34.084985+0000","last_deep_scrub":"263'510","last_deep_scrub_stamp":"2024-09-14T12:01:34.084985+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.084985+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:57:06.583864+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2663,"num_read_kb":2506,"num_write":583,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"263'344","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.196756+0000","last_change":"2024-09-14T12:01:29.196652+0000","last_active":"2024-09-14T12:01:29.196756+0000","last_peered":"2024-09-14T12:01:29.196756+0000","last_clean":"2024-09-14T12:01:29.196756+0000","last_became_active":"2024-09-14T10:46:44.317349+0000","last_became_peered":"2024-09-14T10:46:44.317349+0000","last_unstale":"2024-09-14T12:01:29.196756+0000","last_undegraded":"2024-09-14T12:01:29.196756+0000","last_fullsized":"2024-09-14T12:01:29.196756+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'344","last_scrub_stamp":"2024-09-14T12:01:29.196487+0000","last_deep_scrub":"263'344","last_deep_scrub_stamp":"2024-09-14T12:01:29.196487+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.196487+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:30.071766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133675,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":5317,"num_write":990,"num_write_kb":25288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"263'451","reported_seq":2008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:48.854796+0000","last_change":"2024-09-14T12:01:48.854796+0000","last_active":"2024-09-14T12:01:48.854796+0000","last_peered":"2024-09-14T12:01:48.854796+0000","last_clean":"2024-09-14T12:01:48.854796+0000","last_became_active":"2024-09-14T10:46:46.346640+0000","last_became_peered":"2024-09-14T10:46:46.346640+0000","last_unstale":"2024-09-14T12:01:48.854796+0000","last_undegraded":"2024-09-14T12:01:48.854796+0000","last_fullsized":"2024-09-14T12:01:48.854796+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'451","last_scrub_stamp":"2024-09-14T12:01:48.854662+0000","last_deep_scrub":"263'451","last_deep_scrub_stamp":"2024-09-14T12:01:48.854662+0000","last_clean_scrub_stamp":"2024-09-14T12:01:48.854662+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:46.521384+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2347,"num_read_kb":2209,"num_write":542,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"263'346","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.774624+0000","last_change":"2024-09-14T12:01:35.774558+0000","last_active":"2024-09-14T12:01:35.774624+0000","last_peered":"2024-09-14T12:01:35.774624+0000","last_clean":"2024-09-14T12:01:35.774624+0000","last_became_active":"2024-09-14T10:46:44.328049+0000","last_became_peered":"2024-09-14T10:46:44.328049+0000","last_unstale":"2024-09-14T12:01:35.774624+0000","last_undegraded":"2024-09-14T12:01:35.774624+0000","last_fullsized":"2024-09-14T12:01:35.774624+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'346","last_scrub_stamp":"2024-09-14T12:01:35.774453+0000","last_deep_scrub":"263'346","last_deep_scrub_stamp":"2024-09-14T12:01:35.774453+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.774453+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:20.558053+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":619,"num_read_kb":2326,"num_write":1082,"num_write_kb":13442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"263'936","reported_seq":2742,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.297110+0000","last_change":"2024-09-14T12:01:44.297110+0000","last_active":"2024-09-14T12:01:44.297110+0000","last_peered":"2024-09-14T12:01:44.297110+0000","last_clean":"2024-09-14T12:01:44.297110+0000","last_became_active":"2024-09-14T10:46:46.346682+0000","last_became_peered":"2024-09-14T10:46:46.346682+0000","last_unstale":"2024-09-14T12:01:44.297110+0000","last_undegraded":"2024-09-14T12:01:44.297110+0000","last_fullsized":"2024-09-14T12:01:44.297110+0000","mapping_epoch":28,"log_start":"263'900","ondisk_log_start":"263'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'936","last_scrub_stamp":"2024-09-14T12:01:44.296996+0000","last_deep_scrub":"263'936","last_deep_scrub_stamp":"2024-09-14T12:01:44.296996+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.296996+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":900,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:52.496747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4656,"num_read_kb":4197,"num_write":1246,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"263'385","reported_seq":1072,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.363148+0000","last_change":"2024-09-14T12:01:32.363079+0000","last_active":"2024-09-14T12:01:32.363148+0000","last_peered":"2024-09-14T12:01:32.363148+0000","last_clean":"2024-09-14T12:01:32.363148+0000","last_became_active":"2024-09-14T10:47:19.040453+0000","last_became_peered":"2024-09-14T10:47:19.040453+0000","last_unstale":"2024-09-14T12:01:32.363148+0000","last_undegraded":"2024-09-14T12:01:32.363148+0000","last_fullsized":"2024-09-14T12:01:32.363148+0000","mapping_epoch":39,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'385","last_scrub_stamp":"2024-09-14T12:01:32.362951+0000","last_deep_scrub":"263'385","last_deep_scrub_stamp":"2024-09-14T12:01:32.362951+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.362951+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:26.035525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133711,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":707,"num_read_kb":25389,"num_write":1181,"num_write_kb":37274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"263'510","reported_seq":2219,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.299708+0000","last_change":"2024-09-14T12:01:43.299613+0000","last_active":"2024-09-14T12:01:43.299708+0000","last_peered":"2024-09-14T12:01:43.299708+0000","last_clean":"2024-09-14T12:01:43.299708+0000","last_became_active":"2024-09-14T10:46:46.349465+0000","last_became_peered":"2024-09-14T10:46:46.349465+0000","last_unstale":"2024-09-14T12:01:43.299708+0000","last_undegraded":"2024-09-14T12:01:43.299708+0000","last_fullsized":"2024-09-14T12:01:43.299708+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'510","last_scrub_stamp":"2024-09-14T12:01:43.299503+0000","last_deep_scrub":"263'510","last_deep_scrub_stamp":"2024-09-14T12:01:43.299503+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.299503+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:27.070133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2847,"num_read_kb":2662,"num_write":617,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"263'337","reported_seq":1053,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.848911+0000","last_change":"2024-09-14T12:01:27.848911+0000","last_active":"2024-09-14T12:01:27.848911+0000","last_peered":"2024-09-14T12:01:27.848911+0000","last_clean":"2024-09-14T12:01:27.848911+0000","last_became_active":"2024-09-14T10:46:44.320218+0000","last_became_peered":"2024-09-14T10:46:44.320218+0000","last_unstale":"2024-09-14T12:01:27.848911+0000","last_undegraded":"2024-09-14T12:01:27.848911+0000","last_fullsized":"2024-09-14T12:01:27.848911+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'337","last_scrub_stamp":"2024-09-14T12:01:27.848821+0000","last_deep_scrub":"263'337","last_deep_scrub_stamp":"2024-09-14T12:01:27.848821+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.848821+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:48.240608+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":866,"num_read_kb":10863,"num_write":1127,"num_write_kb":35921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"263'438","reported_seq":2120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.259005+0000","last_change":"2024-09-14T12:01:36.258935+0000","last_active":"2024-09-14T12:01:36.259005+0000","last_peered":"2024-09-14T12:01:36.259005+0000","last_clean":"2024-09-14T12:01:36.259005+0000","last_became_active":"2024-09-14T10:46:46.342206+0000","last_became_peered":"2024-09-14T10:46:46.342206+0000","last_unstale":"2024-09-14T12:01:36.259005+0000","last_undegraded":"2024-09-14T12:01:36.259005+0000","last_fullsized":"2024-09-14T12:01:36.259005+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'438","last_scrub_stamp":"2024-09-14T12:01:36.258840+0000","last_deep_scrub":"263'438","last_deep_scrub_stamp":"2024-09-14T12:01:36.258840+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.258840+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:55.906019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2469,"num_read_kb":2360,"num_write":494,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"263'464","reported_seq":1154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.798772+0000","last_change":"2024-09-14T12:01:29.798772+0000","last_active":"2024-09-14T12:01:29.798772+0000","last_peered":"2024-09-14T12:01:29.798772+0000","last_clean":"2024-09-14T12:01:29.798772+0000","last_became_active":"2024-09-14T10:46:44.314466+0000","last_became_peered":"2024-09-14T10:46:44.314466+0000","last_unstale":"2024-09-14T12:01:29.798772+0000","last_undegraded":"2024-09-14T12:01:29.798772+0000","last_fullsized":"2024-09-14T12:01:29.798772+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'464","last_scrub_stamp":"2024-09-14T12:01:29.798635+0000","last_deep_scrub":"263'464","last_deep_scrub_stamp":"2024-09-14T12:01:29.798635+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.798635+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:20.335848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":927,"num_read_kb":16042,"num_write":1243,"num_write_kb":34508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"263'667","reported_seq":2297,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.818090+0000","last_change":"2024-09-14T12:01:39.818030+0000","last_active":"2024-09-14T12:01:39.818090+0000","last_peered":"2024-09-14T12:01:39.818090+0000","last_clean":"2024-09-14T12:01:39.818090+0000","last_became_active":"2024-09-14T10:46:46.342217+0000","last_became_peered":"2024-09-14T10:46:46.342217+0000","last_unstale":"2024-09-14T12:01:39.818090+0000","last_undegraded":"2024-09-14T12:01:39.818090+0000","last_fullsized":"2024-09-14T12:01:39.818090+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'667","last_scrub_stamp":"2024-09-14T12:01:39.817940+0000","last_deep_scrub":"263'667","last_deep_scrub_stamp":"2024-09-14T12:01:39.817940+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.817940+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":600,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:34.611710+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3344,"num_read_kb":3009,"num_write":894,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"263'322","reported_seq":1072,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.858345+0000","last_change":"2024-09-14T12:01:28.858345+0000","last_active":"2024-09-14T12:01:28.858345+0000","last_peered":"2024-09-14T12:01:28.858345+0000","last_clean":"2024-09-14T12:01:28.858345+0000","last_became_active":"2024-09-14T10:46:44.323339+0000","last_became_peered":"2024-09-14T10:46:44.323339+0000","last_unstale":"2024-09-14T12:01:28.858345+0000","last_undegraded":"2024-09-14T12:01:28.858345+0000","last_fullsized":"2024-09-14T12:01:28.858345+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'322","last_scrub_stamp":"2024-09-14T12:01:28.858232+0000","last_deep_scrub":"263'322","last_deep_scrub_stamp":"2024-09-14T12:01:28.858232+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.858232+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:01.869819+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":616,"num_read_kb":14372,"num_write":932,"num_write_kb":14595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'445","reported_seq":1986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.723012+0000","last_change":"2024-09-14T12:01:31.722923+0000","last_active":"2024-09-14T12:01:31.723012+0000","last_peered":"2024-09-14T12:01:31.723012+0000","last_clean":"2024-09-14T12:01:31.723012+0000","last_became_active":"2024-09-14T10:46:46.341731+0000","last_became_peered":"2024-09-14T10:46:46.341731+0000","last_unstale":"2024-09-14T12:01:31.723012+0000","last_undegraded":"2024-09-14T12:01:31.723012+0000","last_fullsized":"2024-09-14T12:01:31.723012+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'445","last_scrub_stamp":"2024-09-14T12:01:31.722836+0000","last_deep_scrub":"263'445","last_deep_scrub_stamp":"2024-09-14T12:01:31.722836+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.722836+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:48.676362+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2390,"num_read_kb":2239,"num_write":538,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"263'379","reported_seq":1098,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.300705+0000","last_change":"2024-09-14T12:01:34.300705+0000","last_active":"2024-09-14T12:01:34.300705+0000","last_peered":"2024-09-14T12:01:34.300705+0000","last_clean":"2024-09-14T12:01:34.300705+0000","last_became_active":"2024-09-14T10:46:44.321604+0000","last_became_peered":"2024-09-14T10:46:44.321604+0000","last_unstale":"2024-09-14T12:01:34.300705+0000","last_undegraded":"2024-09-14T12:01:34.300705+0000","last_fullsized":"2024-09-14T12:01:34.300705+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'379","last_scrub_stamp":"2024-09-14T12:01:34.300564+0000","last_deep_scrub":"263'379","last_deep_scrub_stamp":"2024-09-14T12:01:34.300564+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.300564+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:20.332645+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":797,"num_read_kb":33592,"num_write":1248,"num_write_kb":22096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"263'972","reported_seq":2689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.009007+0000","last_change":"2024-09-14T12:01:40.009007+0000","last_active":"2024-09-14T12:01:40.009007+0000","last_peered":"2024-09-14T12:01:40.009007+0000","last_clean":"2024-09-14T12:01:40.009007+0000","last_became_active":"2024-09-14T10:46:46.336508+0000","last_became_peered":"2024-09-14T10:46:46.336508+0000","last_unstale":"2024-09-14T12:01:40.009007+0000","last_undegraded":"2024-09-14T12:01:40.009007+0000","last_fullsized":"2024-09-14T12:01:40.009007+0000","mapping_epoch":28,"log_start":"263'900","ondisk_log_start":"263'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'972","last_scrub_stamp":"2024-09-14T12:01:40.008921+0000","last_deep_scrub":"263'972","last_deep_scrub_stamp":"2024-09-14T12:01:40.008921+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.008921+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":900,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:56.378084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4671,"num_read_kb":4174,"num_write":1327,"num_write_kb":556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"263'317","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.711783+0000","last_change":"2024-09-14T12:01:38.711783+0000","last_active":"2024-09-14T12:01:38.711783+0000","last_peered":"2024-09-14T12:01:38.711783+0000","last_clean":"2024-09-14T12:01:38.711783+0000","last_became_active":"2024-09-14T10:46:44.321073+0000","last_became_peered":"2024-09-14T10:46:44.321073+0000","last_unstale":"2024-09-14T12:01:38.711783+0000","last_undegraded":"2024-09-14T12:01:38.711783+0000","last_fullsized":"2024-09-14T12:01:38.711783+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-14T12:01:38.711668+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-14T12:01:38.711668+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.711668+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:25.942500+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":672,"num_read_kb":7284,"num_write":1109,"num_write_kb":7346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"263'355","reported_seq":1815,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.294986+0000","last_change":"2024-09-14T12:01:37.294986+0000","last_active":"2024-09-14T12:01:37.294986+0000","last_peered":"2024-09-14T12:01:37.294986+0000","last_clean":"2024-09-14T12:01:37.294986+0000","last_became_active":"2024-09-14T10:46:46.341188+0000","last_became_peered":"2024-09-14T10:46:46.341188+0000","last_unstale":"2024-09-14T12:01:37.294986+0000","last_undegraded":"2024-09-14T12:01:37.294986+0000","last_fullsized":"2024-09-14T12:01:37.294986+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'355","last_scrub_stamp":"2024-09-14T12:01:37.294901+0000","last_deep_scrub":"263'355","last_deep_scrub_stamp":"2024-09-14T12:01:37.294901+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.294901+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:47.263774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1965,"num_read_kb":1883,"num_write":389,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"263'399","reported_seq":1067,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.336267+0000","last_change":"2024-09-14T12:01:33.336267+0000","last_active":"2024-09-14T12:01:33.336267+0000","last_peered":"2024-09-14T12:01:33.336267+0000","last_clean":"2024-09-14T12:01:33.336267+0000","last_became_active":"2024-09-14T10:46:44.316633+0000","last_became_peered":"2024-09-14T10:46:44.316633+0000","last_unstale":"2024-09-14T12:01:33.336267+0000","last_undegraded":"2024-09-14T12:01:33.336267+0000","last_fullsized":"2024-09-14T12:01:33.336267+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'399","last_scrub_stamp":"2024-09-14T12:01:33.336171+0000","last_deep_scrub":"263'399","last_deep_scrub_stamp":"2024-09-14T12:01:33.336171+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.336171+0000","objects_scrubbed":5,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:15.311699+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":793,"num_read_kb":2329,"num_write":1224,"num_write_kb":27267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"263'782","reported_seq":2444,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.342520+0000","last_change":"2024-09-14T12:01:45.342520+0000","last_active":"2024-09-14T12:01:45.342520+0000","last_peered":"2024-09-14T12:01:45.342520+0000","last_clean":"2024-09-14T12:01:45.342520+0000","last_became_active":"2024-09-14T10:46:46.347941+0000","last_became_peered":"2024-09-14T10:46:46.347941+0000","last_unstale":"2024-09-14T12:01:45.342520+0000","last_undegraded":"2024-09-14T12:01:45.342520+0000","last_fullsized":"2024-09-14T12:01:45.342520+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'782","last_scrub_stamp":"2024-09-14T12:01:45.342399+0000","last_deep_scrub":"263'782","last_deep_scrub_stamp":"2024-09-14T12:01:45.342399+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.342399+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:29.700684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3936,"num_read_kb":3604,"num_write":1011,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"263'350","reported_seq":1120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.684970+0000","last_change":"2024-09-14T12:01:28.684970+0000","last_active":"2024-09-14T12:01:28.684970+0000","last_peered":"2024-09-14T12:01:28.684970+0000","last_clean":"2024-09-14T12:01:28.684970+0000","last_became_active":"2024-09-14T10:46:44.322149+0000","last_became_peered":"2024-09-14T10:46:44.322149+0000","last_unstale":"2024-09-14T12:01:28.684970+0000","last_undegraded":"2024-09-14T12:01:28.684970+0000","last_fullsized":"2024-09-14T12:01:28.684970+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-14T12:01:28.684867+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-14T12:01:28.684867+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.684867+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:58.788732+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":929,"num_read_kb":38620,"num_write":1197,"num_write_kb":16629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"263'793","reported_seq":2354,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.706954+0000","last_change":"2024-09-14T12:01:33.706954+0000","last_active":"2024-09-14T12:01:33.706954+0000","last_peered":"2024-09-14T12:01:33.706954+0000","last_clean":"2024-09-14T12:01:33.706954+0000","last_became_active":"2024-09-14T10:46:46.340475+0000","last_became_peered":"2024-09-14T10:46:46.340475+0000","last_unstale":"2024-09-14T12:01:33.706954+0000","last_undegraded":"2024-09-14T12:01:33.706954+0000","last_fullsized":"2024-09-14T12:01:33.706954+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'793","last_scrub_stamp":"2024-09-14T12:01:33.706869+0000","last_deep_scrub":"263'793","last_deep_scrub_stamp":"2024-09-14T12:01:33.706869+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.706869+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:55.128887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3820,"num_read_kb":3456,"num_write":1020,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"263'314","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.690051+0000","last_change":"2024-09-14T12:01:33.690051+0000","last_active":"2024-09-14T12:01:33.690051+0000","last_peered":"2024-09-14T12:01:33.690051+0000","last_clean":"2024-09-14T12:01:33.690051+0000","last_became_active":"2024-09-14T10:46:44.329386+0000","last_became_peered":"2024-09-14T10:46:44.329386+0000","last_unstale":"2024-09-14T12:01:33.690051+0000","last_undegraded":"2024-09-14T12:01:33.690051+0000","last_fullsized":"2024-09-14T12:01:33.690051+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'314","last_scrub_stamp":"2024-09-14T12:01:33.689906+0000","last_deep_scrub":"263'314","last_deep_scrub_stamp":"2024-09-14T12:01:33.689906+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.689906+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:13.669972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133721,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":628,"num_read_kb":13742,"num_write":1168,"num_write_kb":24265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"263'490","reported_seq":2197,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.754429+0000","last_change":"2024-09-14T12:01:32.754429+0000","last_active":"2024-09-14T12:01:32.754429+0000","last_peered":"2024-09-14T12:01:32.754429+0000","last_clean":"2024-09-14T12:01:32.754429+0000","last_became_active":"2024-09-14T10:46:46.351291+0000","last_became_peered":"2024-09-14T10:46:46.351291+0000","last_unstale":"2024-09-14T12:01:32.754429+0000","last_undegraded":"2024-09-14T12:01:32.754429+0000","last_fullsized":"2024-09-14T12:01:32.754429+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'490","last_scrub_stamp":"2024-09-14T12:01:32.754339+0000","last_deep_scrub":"263'490","last_deep_scrub_stamp":"2024-09-14T12:01:32.754339+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.754339+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:32.023682+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2678,"num_read_kb":2537,"num_write":593,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":894,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"263'343","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.241182+0000","last_change":"2024-09-14T12:01:31.241182+0000","last_active":"2024-09-14T12:01:31.241182+0000","last_peered":"2024-09-14T12:01:31.241182+0000","last_clean":"2024-09-14T12:01:31.241182+0000","last_became_active":"2024-09-14T10:46:44.328509+0000","last_became_peered":"2024-09-14T10:46:44.328509+0000","last_unstale":"2024-09-14T12:01:31.241182+0000","last_undegraded":"2024-09-14T12:01:31.241182+0000","last_fullsized":"2024-09-14T12:01:31.241182+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-14T12:01:31.241061+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-14T12:01:31.241061+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.241061+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:17.044831+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":629,"num_read_kb":8535,"num_write":1026,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"263'632","reported_seq":2315,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.069205+0000","last_change":"2024-09-14T12:01:36.069205+0000","last_active":"2024-09-14T12:01:36.069205+0000","last_peered":"2024-09-14T12:01:36.069205+0000","last_clean":"2024-09-14T12:01:36.069205+0000","last_became_active":"2024-09-14T10:46:46.343264+0000","last_became_peered":"2024-09-14T10:46:46.343264+0000","last_unstale":"2024-09-14T12:01:36.069205+0000","last_undegraded":"2024-09-14T12:01:36.069205+0000","last_fullsized":"2024-09-14T12:01:36.069205+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'632","last_scrub_stamp":"2024-09-14T12:01:36.069122+0000","last_deep_scrub":"263'632","last_deep_scrub_stamp":"2024-09-14T12:01:36.069122+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.069122+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":600,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:42.345376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3383,"num_read_kb":3097,"num_write":846,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"263'340","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.726684+0000","last_change":"2024-09-14T12:01:37.726684+0000","last_active":"2024-09-14T12:01:37.726684+0000","last_peered":"2024-09-14T12:01:37.726684+0000","last_clean":"2024-09-14T12:01:37.726684+0000","last_became_active":"2024-09-14T10:46:44.334832+0000","last_became_peered":"2024-09-14T10:46:44.334832+0000","last_unstale":"2024-09-14T12:01:37.726684+0000","last_undegraded":"2024-09-14T12:01:37.726684+0000","last_fullsized":"2024-09-14T12:01:37.726684+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-14T12:01:37.726545+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-14T12:01:37.726545+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.726545+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:30.213654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":614,"num_read_kb":31835,"num_write":1126,"num_write_kb":37799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"263'1874","reported_seq":3540,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.633710+0000","last_change":"2024-09-14T12:01:39.633710+0000","last_active":"2024-09-14T12:01:39.633710+0000","last_peered":"2024-09-14T12:01:39.633710+0000","last_clean":"2024-09-14T12:01:39.633710+0000","last_became_active":"2024-09-14T10:46:46.344246+0000","last_became_peered":"2024-09-14T10:46:46.344246+0000","last_unstale":"2024-09-14T12:01:39.633710+0000","last_undegraded":"2024-09-14T12:01:39.633710+0000","last_fullsized":"2024-09-14T12:01:39.633710+0000","mapping_epoch":28,"log_start":"263'1800","ondisk_log_start":"263'1800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1874","last_scrub_stamp":"2024-09-14T12:01:39.633604+0000","last_deep_scrub":"263'1874","last_deep_scrub_stamp":"2024-09-14T12:01:39.633604+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.633604+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":1800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:47.360631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8234,"num_read_kb":7178,"num_write":2635,"num_write_kb":1169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"263'380","reported_seq":1034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.159937+0000","last_change":"2024-09-14T12:01:30.159937+0000","last_active":"2024-09-14T12:01:30.159937+0000","last_peered":"2024-09-14T12:01:30.159937+0000","last_clean":"2024-09-14T12:01:30.159937+0000","last_became_active":"2024-09-14T10:46:44.331468+0000","last_became_peered":"2024-09-14T10:46:44.331468+0000","last_unstale":"2024-09-14T12:01:30.159937+0000","last_undegraded":"2024-09-14T12:01:30.159937+0000","last_fullsized":"2024-09-14T12:01:30.159937+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'380","last_scrub_stamp":"2024-09-14T12:01:30.159811+0000","last_deep_scrub":"263'380","last_deep_scrub_stamp":"2024-09-14T12:01:30.159811+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.159811+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:37.605807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":628,"num_read_kb":40986,"num_write":1142,"num_write_kb":50458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"263'599","reported_seq":2264,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.678606+0000","last_change":"2024-09-14T12:01:34.678606+0000","last_active":"2024-09-14T12:01:34.678606+0000","last_peered":"2024-09-14T12:01:34.678606+0000","last_clean":"2024-09-14T12:01:34.678606+0000","last_became_active":"2024-09-14T10:46:46.351379+0000","last_became_peered":"2024-09-14T10:46:46.351379+0000","last_unstale":"2024-09-14T12:01:34.678606+0000","last_undegraded":"2024-09-14T12:01:34.678606+0000","last_fullsized":"2024-09-14T12:01:34.678606+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'599","last_scrub_stamp":"2024-09-14T12:01:34.678513+0000","last_deep_scrub":"263'599","last_deep_scrub_stamp":"2024-09-14T12:01:34.678513+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.678513+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:37.519527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3319,"num_read_kb":3081,"num_write":803,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"263'409","reported_seq":1135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.821200+0000","last_change":"2024-09-14T12:01:31.821133+0000","last_active":"2024-09-14T12:01:31.821200+0000","last_peered":"2024-09-14T12:01:31.821200+0000","last_clean":"2024-09-14T12:01:31.821200+0000","last_became_active":"2024-09-14T10:47:18.421420+0000","last_became_peered":"2024-09-14T10:47:18.421420+0000","last_unstale":"2024-09-14T12:01:31.821200+0000","last_undegraded":"2024-09-14T12:01:31.821200+0000","last_fullsized":"2024-09-14T12:01:31.821200+0000","mapping_epoch":39,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'409","last_scrub_stamp":"2024-09-14T12:01:31.821006+0000","last_deep_scrub":"263'409","last_deep_scrub_stamp":"2024-09-14T12:01:31.821006+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.821006+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:29.377483+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1006,"num_read_kb":55242,"num_write":1376,"num_write_kb":21886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.30","version":"263'358","reported_seq":1068,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.667671+0000","last_change":"2024-09-14T12:01:39.667671+0000","last_active":"2024-09-14T12:01:39.667671+0000","last_peered":"2024-09-14T12:01:39.667671+0000","last_clean":"2024-09-14T12:01:39.667671+0000","last_became_active":"2024-09-14T10:46:44.336397+0000","last_became_peered":"2024-09-14T10:46:44.336397+0000","last_unstale":"2024-09-14T12:01:39.667671+0000","last_undegraded":"2024-09-14T12:01:39.667671+0000","last_fullsized":"2024-09-14T12:01:39.667671+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-09-14T12:01:39.667554+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-09-14T12:01:39.667554+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.667554+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:53.690379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":768,"num_read_kb":58312,"num_write":1211,"num_write_kb":50973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"263'439","reported_seq":2133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.593963+0000","last_change":"2024-09-14T12:01:41.593906+0000","last_active":"2024-09-14T12:01:41.593963+0000","last_peered":"2024-09-14T12:01:41.593963+0000","last_clean":"2024-09-14T12:01:41.593963+0000","last_became_active":"2024-09-14T10:46:46.352396+0000","last_became_peered":"2024-09-14T10:46:46.352396+0000","last_unstale":"2024-09-14T12:01:41.593963+0000","last_undegraded":"2024-09-14T12:01:41.593963+0000","last_fullsized":"2024-09-14T12:01:41.593963+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'439","last_scrub_stamp":"2024-09-14T12:01:41.593806+0000","last_deep_scrub":"263'439","last_deep_scrub_stamp":"2024-09-14T12:01:41.593806+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.593806+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:50.381664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2667,"num_read_kb":2535,"num_write":508,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2571,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"263'294","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.295648+0000","last_change":"2024-09-14T12:01:35.295648+0000","last_active":"2024-09-14T12:01:35.295648+0000","last_peered":"2024-09-14T12:01:35.295648+0000","last_clean":"2024-09-14T12:01:35.295648+0000","last_became_active":"2024-09-14T10:46:44.331494+0000","last_became_peered":"2024-09-14T10:46:44.331494+0000","last_unstale":"2024-09-14T12:01:35.295648+0000","last_undegraded":"2024-09-14T12:01:35.295648+0000","last_fullsized":"2024-09-14T12:01:35.295648+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-14T12:01:35.295543+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-14T12:01:35.295543+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.295543+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:19.923292+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048962,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":471,"num_read_kb":43363,"num_write":903,"num_write_kb":33511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"263'474","reported_seq":1984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.684079+0000","last_change":"2024-09-14T12:01:38.684020+0000","last_active":"2024-09-14T12:01:38.684079+0000","last_peered":"2024-09-14T12:01:38.684079+0000","last_clean":"2024-09-14T12:01:38.684079+0000","last_became_active":"2024-09-14T10:46:46.339440+0000","last_became_peered":"2024-09-14T10:46:46.339440+0000","last_unstale":"2024-09-14T12:01:38.684079+0000","last_undegraded":"2024-09-14T12:01:38.684079+0000","last_fullsized":"2024-09-14T12:01:38.684079+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'474","last_scrub_stamp":"2024-09-14T12:01:38.683932+0000","last_deep_scrub":"263'474","last_deep_scrub_stamp":"2024-09-14T12:01:38.683932+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.683932+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:27.526192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2508,"num_read_kb":2330,"num_write":579,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9256,"num_read_kb":6632,"num_write":2794,"num_write_kb":850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":943,"ondisk_log_size":943,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15505,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":15201,"num_read_kb":14853,"num_write":17064,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2690,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1677,"ondisk_log_size":1677,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":560,"ondisk_log_size":560,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1549008,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":19140,"num_read_kb":39857,"num_write":16035,"num_write_kb":12077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":712010,"num_omap_keys":1620,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1845,"ondisk_log_size":1845,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2425,"num_read_kb":2892,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":218145,"num_read_kb":199614,"num_write":55573,"num_write_kb":18950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35771,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4139,"ondisk_log_size":4139,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":30929583,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":44270,"num_read_kb":1895605,"num_write":71703,"num_write_kb":2068626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":47898624,"data_stored":47898624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3414,"ondisk_log_size":3414,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":184539,"num_write":157,"num_write_kb":126109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":184485,"num_write":157,"num_write_kb":126109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510359,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":225012,"kb_used_data":9252,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":94146828,"statfs":{"total":96636764160,"available":96406351872,"internally_reserved":0,"allocated":9474048,"data_stored":7497795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":220920266},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510358,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":205024,"kb_used_data":11472,"kb_used_omap":1,"kb_used_meta":193534,"kb_avail":94166816,"statfs":{"total":96636764160,"available":96426819584,"internally_reserved":0,"allocated":11747328,"data_stored":9764047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":198179269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510358,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243888,"kb_used_data":14176,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94127952,"statfs":{"total":96636764160,"available":96387022848,"internally_reserved":0,"allocated":14516224,"data_stored":12527301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510359,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127356,"kb_used_data":10092,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94244484,"statfs":{"total":96636764160,"available":96506351616,"internally_reserved":0,"allocated":10334208,"data_stored":8364267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510357,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":324468,"kb_used_data":10084,"kb_used_omap":1,"kb_used_meta":314366,"kb_avail":94047372,"statfs":{"total":96636764160,"available":96304508928,"internally_reserved":0,"allocated":10326016,"data_stored":8344841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":321911237},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510357,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116236,"kb_used_data":8700,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94255604,"statfs":{"total":96636764160,"available":96517738496,"internally_reserved":0,"allocated":8908800,"data_stored":6901467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543060,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137180,"kb_used_data":7500,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94234660,"statfs":{"total":96636764160,"available":96496291840,"internally_reserved":0,"allocated":7680000,"data_stored":5672286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132774343},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575766,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":283548,"kb_used_data":9420,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94088292,"statfs":{"total":96636764160,"available":96346411008,"internally_reserved":0,"allocated":9646080,"data_stored":7654490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4694016,"data_stored":4694016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5550080,"data_stored":5550080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6160384,"data_stored":6160384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10321920,"data_stored":10321920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7557120,"data_stored":7557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4857856,"data_stored":4857856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3465216,"data_stored":3465216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5292032,"data_stored":5292032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:02:28.889 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:28.889 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:28.889 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:28.890 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:28.890 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:06:44.963325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:28.890 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:28.890 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:25:19.187758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:02:28.893 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T12:02:48.894 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:02:49.247 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-14T12:02:49.258 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-14T12:02:49.260 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":2548,"stamp":"2024-09-14T12:02:49.065303+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":33086276,"num_objects":745,"num_object_clones":0,"num_object_copies":1770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":745,"num_whiteouts":0,"num_read":308787,"num_read_kb":2528544,"num_write":163626,"num_write_kb":2359360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":751599,"num_omap_keys":1793,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12881,"ondisk_log_size":12881,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1662712,"kb_used_data":80696,"kb_used_omap":12,"kb_used_meta":1581875,"kb_avail":753312008,"statfs":{"total":773094113280,"available":771391496192,"internally_reserved":0,"allocated":82632704,"data_stored":66726494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1619840561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005416"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:03.257683+0000","last_change":"2024-09-14T12:02:03.257683+0000","last_active":"2024-09-14T12:02:03.257683+0000","last_peered":"2024-09-14T12:02:03.257683+0000","last_clean":"2024-09-14T12:02:03.257683+0000","last_became_active":"2024-09-14T11:25:20.212282+0000","last_became_peered":"2024-09-14T11:25:20.212282+0000","last_unstale":"2024-09-14T12:02:03.257683+0000","last_undegraded":"2024-09-14T12:02:03.257683+0000","last_fullsized":"2024-09-14T12:02:03.257683+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:03.257592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:03.257592+0000","last_clean_scrub_stamp":"2024-09-14T12:02:03.257592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:34.271743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:00.646533+0000","last_change":"2024-09-14T12:02:00.646533+0000","last_active":"2024-09-14T12:02:00.646533+0000","last_peered":"2024-09-14T12:02:00.646533+0000","last_clean":"2024-09-14T12:02:00.646533+0000","last_became_active":"2024-09-14T11:06:45.982702+0000","last_became_peered":"2024-09-14T11:06:45.982702+0000","last_unstale":"2024-09-14T12:02:00.646533+0000","last_undegraded":"2024-09-14T12:02:00.646533+0000","last_fullsized":"2024-09-14T12:02:00.646533+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:02:00.646437+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:02:00.646437+0000","last_clean_scrub_stamp":"2024-09-14T12:02:00.646437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:31.012809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:04.124732+0000","last_change":"2024-09-14T12:02:04.124732+0000","last_active":"2024-09-14T12:02:04.124732+0000","last_peered":"2024-09-14T12:02:04.124732+0000","last_clean":"2024-09-14T12:02:04.124732+0000","last_became_active":"2024-09-14T11:06:41.918259+0000","last_became_peered":"2024-09-14T11:06:41.918259+0000","last_unstale":"2024-09-14T12:02:04.124732+0000","last_undegraded":"2024-09-14T12:02:04.124732+0000","last_fullsized":"2024-09-14T12:02:04.124732+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:04.124640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:04.124640+0000","last_clean_scrub_stamp":"2024-09-14T12:02:04.124640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:50.520541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'53","reported_seq":212,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:08.563843+0000","last_change":"2024-09-14T12:02:08.563843+0000","last_active":"2024-09-14T12:02:08.563843+0000","last_peered":"2024-09-14T12:02:08.563843+0000","last_clean":"2024-09-14T12:02:08.563843+0000","last_became_active":"2024-09-14T11:02:34.872682+0000","last_became_peered":"2024-09-14T11:02:34.872682+0000","last_unstale":"2024-09-14T12:02:08.563843+0000","last_undegraded":"2024-09-14T12:02:08.563843+0000","last_fullsized":"2024-09-14T12:02:08.563843+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'53","last_scrub_stamp":"2024-09-14T12:02:08.563752+0000","last_deep_scrub":"263'53","last_deep_scrub_stamp":"2024-09-14T12:02:08.563752+0000","last_clean_scrub_stamp":"2024-09-14T12:02:08.563752+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:29.948023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":419,"num_read_kb":273,"num_write":133,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:10.837755+0000","last_change":"2024-09-14T12:02:10.837755+0000","last_active":"2024-09-14T12:02:10.837755+0000","last_peered":"2024-09-14T12:02:10.837755+0000","last_clean":"2024-09-14T12:02:10.837755+0000","last_became_active":"2024-09-14T11:25:20.206601+0000","last_became_peered":"2024-09-14T11:25:20.206601+0000","last_unstale":"2024-09-14T12:02:10.837755+0000","last_undegraded":"2024-09-14T12:02:10.837755+0000","last_fullsized":"2024-09-14T12:02:10.837755+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:10.837661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:10.837661+0000","last_clean_scrub_stamp":"2024-09-14T12:02:10.837661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:47:21.773563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"263'13","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:05.990919+0000","last_change":"2024-09-14T12:02:05.990919+0000","last_active":"2024-09-14T12:02:05.990919+0000","last_peered":"2024-09-14T12:02:05.990919+0000","last_clean":"2024-09-14T12:02:05.990919+0000","last_became_active":"2024-09-14T11:06:45.992612+0000","last_became_peered":"2024-09-14T11:06:45.992612+0000","last_unstale":"2024-09-14T12:02:05.990919+0000","last_undegraded":"2024-09-14T12:02:05.990919+0000","last_fullsized":"2024-09-14T12:02:05.990919+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-14T12:02:05.990829+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-14T12:02:05.990829+0000","last_clean_scrub_stamp":"2024-09-14T12:02:05.990829+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:27.981820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13883,"num_write":28,"num_write_kb":14907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"263'4","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:09.076743+0000","last_change":"2024-09-14T12:02:09.076743+0000","last_active":"2024-09-14T12:02:09.076743+0000","last_peered":"2024-09-14T12:02:09.076743+0000","last_clean":"2024-09-14T12:02:09.076743+0000","last_became_active":"2024-09-14T11:06:41.911807+0000","last_became_peered":"2024-09-14T11:06:41.911807+0000","last_unstale":"2024-09-14T12:02:09.076743+0000","last_undegraded":"2024-09-14T12:02:09.076743+0000","last_fullsized":"2024-09-14T12:02:09.076743+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:02:09.076648+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:02:09.076648+0000","last_clean_scrub_stamp":"2024-09-14T12:02:09.076648+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:20.151261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":621,"num_write":4,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"263'41","reported_seq":180,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:06.642757+0000","last_change":"2024-09-14T12:02:06.642757+0000","last_active":"2024-09-14T12:02:06.642757+0000","last_peered":"2024-09-14T12:02:06.642757+0000","last_clean":"2024-09-14T12:02:06.642757+0000","last_became_active":"2024-09-14T11:02:34.879272+0000","last_became_peered":"2024-09-14T11:02:34.879272+0000","last_unstale":"2024-09-14T12:02:06.642757+0000","last_undegraded":"2024-09-14T12:02:06.642757+0000","last_fullsized":"2024-09-14T12:02:06.642757+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-14T12:02:06.642672+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-14T12:02:06.642672+0000","last_clean_scrub_stamp":"2024-09-14T12:02:06.642672+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:51.195553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":323,"num_read_kb":209,"num_write":113,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:03.624003+0000","last_change":"2024-09-14T12:02:03.624003+0000","last_active":"2024-09-14T12:02:03.624003+0000","last_peered":"2024-09-14T12:02:03.624003+0000","last_clean":"2024-09-14T12:02:03.624003+0000","last_became_active":"2024-09-14T11:25:20.207226+0000","last_became_peered":"2024-09-14T11:25:20.207226+0000","last_unstale":"2024-09-14T12:02:03.624003+0000","last_undegraded":"2024-09-14T12:02:03.624003+0000","last_fullsized":"2024-09-14T12:02:03.624003+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:03.623912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:03.623912+0000","last_clean_scrub_stamp":"2024-09-14T12:02:03.623912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:53.903225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:17.006001+0000","last_change":"2024-09-14T12:02:17.006001+0000","last_active":"2024-09-14T12:02:17.006001+0000","last_peered":"2024-09-14T12:02:17.006001+0000","last_clean":"2024-09-14T12:02:17.006001+0000","last_became_active":"2024-09-14T11:06:45.981705+0000","last_became_peered":"2024-09-14T11:06:45.981705+0000","last_unstale":"2024-09-14T12:02:17.006001+0000","last_undegraded":"2024-09-14T12:02:17.006001+0000","last_fullsized":"2024-09-14T12:02:17.006001+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:17.005911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:17.005911+0000","last_clean_scrub_stamp":"2024-09-14T12:02:17.005911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:03.745070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:05.145835+0000","last_change":"2024-09-14T12:02:05.145835+0000","last_active":"2024-09-14T12:02:05.145835+0000","last_peered":"2024-09-14T12:02:05.145835+0000","last_clean":"2024-09-14T12:02:05.145835+0000","last_became_active":"2024-09-14T11:06:41.917774+0000","last_became_peered":"2024-09-14T11:06:41.917774+0000","last_unstale":"2024-09-14T12:02:05.145835+0000","last_undegraded":"2024-09-14T12:02:05.145835+0000","last_fullsized":"2024-09-14T12:02:05.145835+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:05.145751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:05.145751+0000","last_clean_scrub_stamp":"2024-09-14T12:02:05.145751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:52.597873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'20","reported_seq":114,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:02.848881+0000","last_change":"2024-09-14T12:02:02.848808+0000","last_active":"2024-09-14T12:02:02.848881+0000","last_peered":"2024-09-14T12:02:02.848881+0000","last_clean":"2024-09-14T12:02:02.848881+0000","last_became_active":"2024-09-14T11:02:34.874685+0000","last_became_peered":"2024-09-14T11:02:34.874685+0000","last_unstale":"2024-09-14T12:02:02.848881+0000","last_undegraded":"2024-09-14T12:02:02.848881+0000","last_fullsized":"2024-09-14T12:02:02.848881+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'20","last_scrub_stamp":"2024-09-14T12:02:02.848728+0000","last_deep_scrub":"263'20","last_deep_scrub_stamp":"2024-09-14T12:02:02.848728+0000","last_clean_scrub_stamp":"2024-09-14T12:02:02.848728+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:02.320040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":99,"num_write":50,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:23.062879+0000","last_change":"2024-09-14T12:02:23.062879+0000","last_active":"2024-09-14T12:02:23.062879+0000","last_peered":"2024-09-14T12:02:23.062879+0000","last_clean":"2024-09-14T12:02:23.062879+0000","last_became_active":"2024-09-14T11:25:20.211190+0000","last_became_peered":"2024-09-14T11:25:20.211190+0000","last_unstale":"2024-09-14T12:02:23.062879+0000","last_undegraded":"2024-09-14T12:02:23.062879+0000","last_fullsized":"2024-09-14T12:02:23.062879+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:23.062795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:23.062795+0000","last_clean_scrub_stamp":"2024-09-14T12:02:23.062795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:46.254824+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"263'7","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:16.026379+0000","last_change":"2024-09-14T12:02:16.026379+0000","last_active":"2024-09-14T12:02:16.026379+0000","last_peered":"2024-09-14T12:02:16.026379+0000","last_clean":"2024-09-14T12:02:16.026379+0000","last_became_active":"2024-09-14T11:06:45.979801+0000","last_became_peered":"2024-09-14T11:06:45.979801+0000","last_unstale":"2024-09-14T12:02:16.026379+0000","last_undegraded":"2024-09-14T12:02:16.026379+0000","last_fullsized":"2024-09-14T12:02:16.026379+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T12:02:16.026280+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T12:02:16.026280+0000","last_clean_scrub_stamp":"2024-09-14T12:02:16.026280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:11.190264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"263'5","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:59.646348+0000","last_change":"2024-09-14T12:01:59.646348+0000","last_active":"2024-09-14T12:01:59.646348+0000","last_peered":"2024-09-14T12:01:59.646348+0000","last_clean":"2024-09-14T12:01:59.646348+0000","last_became_active":"2024-09-14T11:06:41.905007+0000","last_became_peered":"2024-09-14T11:06:41.905007+0000","last_unstale":"2024-09-14T12:01:59.646348+0000","last_undegraded":"2024-09-14T12:01:59.646348+0000","last_fullsized":"2024-09-14T12:01:59.646348+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T12:01:59.646259+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T12:01:59.646259+0000","last_clean_scrub_stamp":"2024-09-14T12:01:59.646259+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:58.113799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'31","reported_seq":141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:00.774012+0000","last_change":"2024-09-14T12:02:00.773925+0000","last_active":"2024-09-14T12:02:00.774012+0000","last_peered":"2024-09-14T12:02:00.774012+0000","last_clean":"2024-09-14T12:02:00.774012+0000","last_became_active":"2024-09-14T11:02:34.873091+0000","last_became_peered":"2024-09-14T11:02:34.873091+0000","last_unstale":"2024-09-14T12:02:00.774012+0000","last_undegraded":"2024-09-14T12:02:00.774012+0000","last_fullsized":"2024-09-14T12:02:00.774012+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-14T12:02:00.773836+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-14T12:02:00.773836+0000","last_clean_scrub_stamp":"2024-09-14T12:02:00.773836+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:51.275587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":154,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:15.145827+0000","last_change":"2024-09-14T12:02:15.145827+0000","last_active":"2024-09-14T12:02:15.145827+0000","last_peered":"2024-09-14T12:02:15.145827+0000","last_clean":"2024-09-14T12:02:15.145827+0000","last_became_active":"2024-09-14T11:25:20.213064+0000","last_became_peered":"2024-09-14T11:25:20.213064+0000","last_unstale":"2024-09-14T12:02:15.145827+0000","last_undegraded":"2024-09-14T12:02:15.145827+0000","last_fullsized":"2024-09-14T12:02:15.145827+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:15.145733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:15.145733+0000","last_clean_scrub_stamp":"2024-09-14T12:02:15.145733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:14.150385+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"263'7","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:58.317510+0000","last_change":"2024-09-14T12:01:58.317434+0000","last_active":"2024-09-14T12:01:58.317510+0000","last_peered":"2024-09-14T12:01:58.317510+0000","last_clean":"2024-09-14T12:01:58.317510+0000","last_became_active":"2024-09-14T11:06:45.977225+0000","last_became_peered":"2024-09-14T11:06:45.977225+0000","last_unstale":"2024-09-14T12:01:58.317510+0000","last_undegraded":"2024-09-14T12:01:58.317510+0000","last_fullsized":"2024-09-14T12:01:58.317510+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T12:01:58.317337+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T12:01:58.317337+0000","last_clean_scrub_stamp":"2024-09-14T12:01:58.317337+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:14.168412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20490,"num_write":7,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:08.106043+0000","last_change":"2024-09-14T12:02:08.105928+0000","last_active":"2024-09-14T12:02:08.106043+0000","last_peered":"2024-09-14T12:02:08.106043+0000","last_clean":"2024-09-14T12:02:08.106043+0000","last_became_active":"2024-09-14T11:06:41.916037+0000","last_became_peered":"2024-09-14T11:06:41.916037+0000","last_unstale":"2024-09-14T12:02:08.106043+0000","last_undegraded":"2024-09-14T12:02:08.106043+0000","last_fullsized":"2024-09-14T12:02:08.106043+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:08.105832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:08.105832+0000","last_clean_scrub_stamp":"2024-09-14T12:02:08.105832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:32.013801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"263'6","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:01.804812+0000","last_change":"2024-09-14T12:02:01.804720+0000","last_active":"2024-09-14T12:02:01.804812+0000","last_peered":"2024-09-14T12:02:01.804812+0000","last_clean":"2024-09-14T12:02:01.804812+0000","last_became_active":"2024-09-14T11:02:34.878477+0000","last_became_peered":"2024-09-14T11:02:34.878477+0000","last_unstale":"2024-09-14T12:02:01.804812+0000","last_undegraded":"2024-09-14T12:02:01.804812+0000","last_fullsized":"2024-09-14T12:02:01.804812+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:02:01.804608+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:02:01.804608+0000","last_clean_scrub_stamp":"2024-09-14T12:02:01.804608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:40.955608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:12.666798+0000","last_change":"2024-09-14T12:02:12.666798+0000","last_active":"2024-09-14T12:02:12.666798+0000","last_peered":"2024-09-14T12:02:12.666798+0000","last_clean":"2024-09-14T12:02:12.666798+0000","last_became_active":"2024-09-14T11:25:20.210841+0000","last_became_peered":"2024-09-14T11:25:20.210841+0000","last_unstale":"2024-09-14T12:02:12.666798+0000","last_undegraded":"2024-09-14T12:02:12.666798+0000","last_fullsized":"2024-09-14T12:02:12.666798+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:12.666711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:12.666711+0000","last_clean_scrub_stamp":"2024-09-14T12:02:12.666711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:22.335551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"260'5","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:26.661997+0000","last_change":"2024-09-14T12:02:26.661997+0000","last_active":"2024-09-14T12:02:26.661997+0000","last_peered":"2024-09-14T12:02:26.661997+0000","last_clean":"2024-09-14T12:02:26.661997+0000","last_became_active":"2024-09-14T11:06:45.992046+0000","last_became_peered":"2024-09-14T11:06:45.992046+0000","last_unstale":"2024-09-14T12:02:26.661997+0000","last_undegraded":"2024-09-14T12:02:26.661997+0000","last_fullsized":"2024-09-14T12:02:26.661997+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T12:02:26.661901+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T12:02:26.661901+0000","last_clean_scrub_stamp":"2024-09-14T12:02:26.661901+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:42.640879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:22.601166+0000","last_change":"2024-09-14T12:02:22.601052+0000","last_active":"2024-09-14T12:02:22.601166+0000","last_peered":"2024-09-14T12:02:22.601166+0000","last_clean":"2024-09-14T12:02:22.601166+0000","last_became_active":"2024-09-14T11:06:41.909310+0000","last_became_peered":"2024-09-14T11:06:41.909310+0000","last_unstale":"2024-09-14T12:02:22.601166+0000","last_undegraded":"2024-09-14T12:02:22.601166+0000","last_fullsized":"2024-09-14T12:02:22.601166+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:22.600949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:22.600949+0000","last_clean_scrub_stamp":"2024-09-14T12:02:22.600949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:02.814032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"263'17","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:57.887596+0000","last_change":"2024-09-14T12:01:57.887525+0000","last_active":"2024-09-14T12:01:57.887596+0000","last_peered":"2024-09-14T12:01:57.887596+0000","last_clean":"2024-09-14T12:01:57.887596+0000","last_became_active":"2024-09-14T11:02:34.878859+0000","last_became_peered":"2024-09-14T11:02:34.878859+0000","last_unstale":"2024-09-14T12:01:57.887596+0000","last_undegraded":"2024-09-14T12:01:57.887596+0000","last_fullsized":"2024-09-14T12:01:57.887596+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'17","last_scrub_stamp":"2024-09-14T12:01:57.887436+0000","last_deep_scrub":"263'17","last_deep_scrub_stamp":"2024-09-14T12:01:57.887436+0000","last_clean_scrub_stamp":"2024-09-14T12:01:57.887436+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:50.627840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":82,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:08.977057+0000","last_change":"2024-09-14T12:02:08.977057+0000","last_active":"2024-09-14T12:02:08.977057+0000","last_peered":"2024-09-14T12:02:08.977057+0000","last_clean":"2024-09-14T12:02:08.977057+0000","last_became_active":"2024-09-14T11:25:20.213540+0000","last_became_peered":"2024-09-14T11:25:20.213540+0000","last_unstale":"2024-09-14T12:02:08.977057+0000","last_undegraded":"2024-09-14T12:02:08.977057+0000","last_fullsized":"2024-09-14T12:02:08.977057+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:02:08.976982+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:02:08.976982+0000","last_clean_scrub_stamp":"2024-09-14T12:02:08.976982+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:33.584434+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"260'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:04.945602+0000","last_change":"2024-09-14T12:02:04.945602+0000","last_active":"2024-09-14T12:02:04.945602+0000","last_peered":"2024-09-14T12:02:04.945602+0000","last_clean":"2024-09-14T12:02:04.945602+0000","last_became_active":"2024-09-14T11:06:45.984536+0000","last_became_peered":"2024-09-14T11:06:45.984536+0000","last_unstale":"2024-09-14T12:02:04.945602+0000","last_undegraded":"2024-09-14T12:02:04.945602+0000","last_fullsized":"2024-09-14T12:02:04.945602+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T12:02:04.945509+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T12:02:04.945509+0000","last_clean_scrub_stamp":"2024-09-14T12:02:04.945509+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:28.914973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:54.285050+0000","last_change":"2024-09-14T12:01:54.285050+0000","last_active":"2024-09-14T12:01:54.285050+0000","last_peered":"2024-09-14T12:01:54.285050+0000","last_clean":"2024-09-14T12:01:54.285050+0000","last_became_active":"2024-09-14T11:06:41.917297+0000","last_became_peered":"2024-09-14T11:06:41.917297+0000","last_unstale":"2024-09-14T12:01:54.285050+0000","last_undegraded":"2024-09-14T12:01:54.285050+0000","last_fullsized":"2024-09-14T12:01:54.285050+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:54.284954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:54.284954+0000","last_clean_scrub_stamp":"2024-09-14T12:01:54.284954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:26.497930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"260'21","reported_seq":126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:57.211012+0000","last_change":"2024-09-14T12:01:57.211012+0000","last_active":"2024-09-14T12:01:57.211012+0000","last_peered":"2024-09-14T12:01:57.211012+0000","last_clean":"2024-09-14T12:01:57.211012+0000","last_became_active":"2024-09-14T11:02:34.876726+0000","last_became_peered":"2024-09-14T11:02:34.876726+0000","last_unstale":"2024-09-14T12:01:57.211012+0000","last_undegraded":"2024-09-14T12:01:57.211012+0000","last_fullsized":"2024-09-14T12:01:57.211012+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'21","last_scrub_stamp":"2024-09-14T12:01:57.210902+0000","last_deep_scrub":"260'21","last_deep_scrub_stamp":"2024-09-14T12:01:57.210902+0000","last_clean_scrub_stamp":"2024-09-14T12:01:57.210902+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:17.084887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":116,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:04.282573+0000","last_change":"2024-09-14T12:02:04.282573+0000","last_active":"2024-09-14T12:02:04.282573+0000","last_peered":"2024-09-14T12:02:04.282573+0000","last_clean":"2024-09-14T12:02:04.282573+0000","last_became_active":"2024-09-14T11:25:20.214475+0000","last_became_peered":"2024-09-14T11:25:20.214475+0000","last_unstale":"2024-09-14T12:02:04.282573+0000","last_undegraded":"2024-09-14T12:02:04.282573+0000","last_fullsized":"2024-09-14T12:02:04.282573+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:04.282481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:04.282481+0000","last_clean_scrub_stamp":"2024-09-14T12:02:04.282481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:49.955677+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:11.050688+0000","last_change":"2024-09-14T12:02:11.050688+0000","last_active":"2024-09-14T12:02:11.050688+0000","last_peered":"2024-09-14T12:02:11.050688+0000","last_clean":"2024-09-14T12:02:11.050688+0000","last_became_active":"2024-09-14T11:06:45.990419+0000","last_became_peered":"2024-09-14T11:06:45.990419+0000","last_unstale":"2024-09-14T12:02:11.050688+0000","last_undegraded":"2024-09-14T12:02:11.050688+0000","last_fullsized":"2024-09-14T12:02:11.050688+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:11.050595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:11.050595+0000","last_clean_scrub_stamp":"2024-09-14T12:02:11.050595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:14.954398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"260'2","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:05.900273+0000","last_change":"2024-09-14T12:02:05.900273+0000","last_active":"2024-09-14T12:02:05.900273+0000","last_peered":"2024-09-14T12:02:05.900273+0000","last_clean":"2024-09-14T12:02:05.900273+0000","last_became_active":"2024-09-14T11:06:41.910694+0000","last_became_peered":"2024-09-14T11:06:41.910694+0000","last_unstale":"2024-09-14T12:02:05.900273+0000","last_undegraded":"2024-09-14T12:02:05.900273+0000","last_fullsized":"2024-09-14T12:02:05.900273+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T12:02:05.900180+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T12:02:05.900180+0000","last_clean_scrub_stamp":"2024-09-14T12:02:05.900180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:16.384585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"263'21","reported_seq":118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:59.821308+0000","last_change":"2024-09-14T12:01:59.821308+0000","last_active":"2024-09-14T12:01:59.821308+0000","last_peered":"2024-09-14T12:01:59.821308+0000","last_clean":"2024-09-14T12:01:59.821308+0000","last_became_active":"2024-09-14T11:02:34.872803+0000","last_became_peered":"2024-09-14T11:02:34.872803+0000","last_unstale":"2024-09-14T12:01:59.821308+0000","last_undegraded":"2024-09-14T12:01:59.821308+0000","last_fullsized":"2024-09-14T12:01:59.821308+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'21","last_scrub_stamp":"2024-09-14T12:01:59.821192+0000","last_deep_scrub":"263'21","last_deep_scrub_stamp":"2024-09-14T12:01:59.821192+0000","last_clean_scrub_stamp":"2024-09-14T12:01:59.821192+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:10.561664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":102,"num_write":56,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:22.023385+0000","last_change":"2024-09-14T12:02:22.023259+0000","last_active":"2024-09-14T12:02:22.023385+0000","last_peered":"2024-09-14T12:02:22.023385+0000","last_clean":"2024-09-14T12:02:22.023385+0000","last_became_active":"2024-09-14T11:25:20.207780+0000","last_became_peered":"2024-09-14T11:25:20.207780+0000","last_unstale":"2024-09-14T12:02:22.023385+0000","last_undegraded":"2024-09-14T12:02:22.023385+0000","last_fullsized":"2024-09-14T12:02:22.023385+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:22.023158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:22.023158+0000","last_clean_scrub_stamp":"2024-09-14T12:02:22.023158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:36.597026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"263'9","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:10.077251+0000","last_change":"2024-09-14T12:02:10.077134+0000","last_active":"2024-09-14T12:02:10.077251+0000","last_peered":"2024-09-14T12:02:10.077251+0000","last_clean":"2024-09-14T12:02:10.077251+0000","last_became_active":"2024-09-14T11:06:45.992208+0000","last_became_peered":"2024-09-14T11:06:45.992208+0000","last_unstale":"2024-09-14T12:02:10.077251+0000","last_undegraded":"2024-09-14T12:02:10.077251+0000","last_fullsized":"2024-09-14T12:02:10.077251+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-14T12:02:10.077039+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-14T12:02:10.077039+0000","last_clean_scrub_stamp":"2024-09-14T12:02:10.077039+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:40:52.224384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":17408,"num_write":14,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"263'8","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:21.606948+0000","last_change":"2024-09-14T12:02:21.606948+0000","last_active":"2024-09-14T12:02:21.606948+0000","last_peered":"2024-09-14T12:02:21.606948+0000","last_clean":"2024-09-14T12:02:21.606948+0000","last_became_active":"2024-09-14T11:06:41.915173+0000","last_became_peered":"2024-09-14T11:06:41.915173+0000","last_unstale":"2024-09-14T12:02:21.606948+0000","last_undegraded":"2024-09-14T12:02:21.606948+0000","last_fullsized":"2024-09-14T12:02:21.606948+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-14T12:02:21.606850+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-14T12:02:21.606850+0000","last_clean_scrub_stamp":"2024-09-14T12:02:21.606850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:31.555374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10242,"num_write":13,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"263'15","reported_seq":102,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:05.690923+0000","last_change":"2024-09-14T12:02:05.690923+0000","last_active":"2024-09-14T12:02:05.690923+0000","last_peered":"2024-09-14T12:02:05.690923+0000","last_clean":"2024-09-14T12:02:05.690923+0000","last_became_active":"2024-09-14T11:02:34.867669+0000","last_became_peered":"2024-09-14T11:02:34.867669+0000","last_unstale":"2024-09-14T12:02:05.690923+0000","last_undegraded":"2024-09-14T12:02:05.690923+0000","last_fullsized":"2024-09-14T12:02:05.690923+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'15","last_scrub_stamp":"2024-09-14T12:02:05.690838+0000","last_deep_scrub":"263'15","last_deep_scrub_stamp":"2024-09-14T12:02:05.690838+0000","last_clean_scrub_stamp":"2024-09-14T12:02:05.690838+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:20.997093+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":79,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"263'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:07.885954+0000","last_change":"2024-09-14T12:02:07.885877+0000","last_active":"2024-09-14T12:02:07.885954+0000","last_peered":"2024-09-14T12:02:07.885954+0000","last_clean":"2024-09-14T12:02:07.885954+0000","last_became_active":"2024-09-14T11:25:20.209801+0000","last_became_peered":"2024-09-14T11:25:20.209801+0000","last_unstale":"2024-09-14T12:02:07.885954+0000","last_undegraded":"2024-09-14T12:02:07.885954+0000","last_fullsized":"2024-09-14T12:02:07.885954+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:02:07.885758+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:02:07.885758+0000","last_clean_scrub_stamp":"2024-09-14T12:02:07.885758+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:33.696067+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:15.037814+0000","last_change":"2024-09-14T12:02:15.037814+0000","last_active":"2024-09-14T12:02:15.037814+0000","last_peered":"2024-09-14T12:02:15.037814+0000","last_clean":"2024-09-14T12:02:15.037814+0000","last_became_active":"2024-09-14T11:06:45.990093+0000","last_became_peered":"2024-09-14T11:06:45.990093+0000","last_unstale":"2024-09-14T12:02:15.037814+0000","last_undegraded":"2024-09-14T12:02:15.037814+0000","last_fullsized":"2024-09-14T12:02:15.037814+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:15.037724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:15.037724+0000","last_clean_scrub_stamp":"2024-09-14T12:02:15.037724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:32.859285+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"263'5","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:53.258269+0000","last_change":"2024-09-14T12:01:53.258189+0000","last_active":"2024-09-14T12:01:53.258269+0000","last_peered":"2024-09-14T12:01:53.258269+0000","last_clean":"2024-09-14T12:01:53.258269+0000","last_became_active":"2024-09-14T11:06:41.913330+0000","last_became_peered":"2024-09-14T11:06:41.913330+0000","last_unstale":"2024-09-14T12:01:53.258269+0000","last_undegraded":"2024-09-14T12:01:53.258269+0000","last_fullsized":"2024-09-14T12:01:53.258269+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T12:01:53.258102+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T12:01:53.258102+0000","last_clean_scrub_stamp":"2024-09-14T12:01:53.258102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:02.121900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"263'51","reported_seq":200,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:03.663366+0000","last_change":"2024-09-14T12:02:03.663366+0000","last_active":"2024-09-14T12:02:03.663366+0000","last_peered":"2024-09-14T12:02:03.663366+0000","last_clean":"2024-09-14T12:02:03.663366+0000","last_became_active":"2024-09-14T11:02:34.879480+0000","last_became_peered":"2024-09-14T11:02:34.879480+0000","last_unstale":"2024-09-14T12:02:03.663366+0000","last_undegraded":"2024-09-14T12:02:03.663366+0000","last_fullsized":"2024-09-14T12:02:03.663366+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'51","last_scrub_stamp":"2024-09-14T12:02:03.663264+0000","last_deep_scrub":"263'51","last_deep_scrub_stamp":"2024-09-14T12:02:03.663264+0000","last_clean_scrub_stamp":"2024-09-14T12:02:03.663264+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:48.283261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":249,"num_write":134,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:06.989393+0000","last_change":"2024-09-14T12:02:06.989307+0000","last_active":"2024-09-14T12:02:06.989393+0000","last_peered":"2024-09-14T12:02:06.989393+0000","last_clean":"2024-09-14T12:02:06.989393+0000","last_became_active":"2024-09-14T11:25:20.208253+0000","last_became_peered":"2024-09-14T11:25:20.208253+0000","last_unstale":"2024-09-14T12:02:06.989393+0000","last_undegraded":"2024-09-14T12:02:06.989393+0000","last_fullsized":"2024-09-14T12:02:06.989393+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:06.989214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:06.989214+0000","last_clean_scrub_stamp":"2024-09-14T12:02:06.989214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:01.638626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:14.107185+0000","last_change":"2024-09-14T12:02:14.107113+0000","last_active":"2024-09-14T12:02:14.107185+0000","last_peered":"2024-09-14T12:02:14.107185+0000","last_clean":"2024-09-14T12:02:14.107185+0000","last_became_active":"2024-09-14T11:06:45.986268+0000","last_became_peered":"2024-09-14T11:06:45.986268+0000","last_unstale":"2024-09-14T12:02:14.107185+0000","last_undegraded":"2024-09-14T12:02:14.107185+0000","last_fullsized":"2024-09-14T12:02:14.107185+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:14.107023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:14.107023+0000","last_clean_scrub_stamp":"2024-09-14T12:02:14.107023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:23.049951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"263'5","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:03.108214+0000","last_change":"2024-09-14T12:02:03.108142+0000","last_active":"2024-09-14T12:02:03.108214+0000","last_peered":"2024-09-14T12:02:03.108214+0000","last_clean":"2024-09-14T12:02:03.108214+0000","last_became_active":"2024-09-14T11:06:41.918902+0000","last_became_peered":"2024-09-14T11:06:41.918902+0000","last_unstale":"2024-09-14T12:02:03.108214+0000","last_undegraded":"2024-09-14T12:02:03.108214+0000","last_fullsized":"2024-09-14T12:02:03.108214+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T12:02:03.108063+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T12:02:03.108063+0000","last_clean_scrub_stamp":"2024-09-14T12:02:03.108063+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:55:47.091374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"263'3","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:56.237034+0000","last_change":"2024-09-14T12:01:56.237034+0000","last_active":"2024-09-14T12:01:56.237034+0000","last_peered":"2024-09-14T12:01:56.237034+0000","last_clean":"2024-09-14T12:01:56.237034+0000","last_became_active":"2024-09-14T11:02:34.877623+0000","last_became_peered":"2024-09-14T11:02:34.877623+0000","last_unstale":"2024-09-14T12:01:56.237034+0000","last_undegraded":"2024-09-14T12:01:56.237034+0000","last_fullsized":"2024-09-14T12:01:56.237034+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:01:56.236952+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:01:56.236952+0000","last_clean_scrub_stamp":"2024-09-14T12:01:56.236952+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:46.845594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:02.282319+0000","last_change":"2024-09-14T12:02:02.282253+0000","last_active":"2024-09-14T12:02:02.282319+0000","last_peered":"2024-09-14T12:02:02.282319+0000","last_clean":"2024-09-14T12:02:02.282319+0000","last_became_active":"2024-09-14T11:25:20.208411+0000","last_became_peered":"2024-09-14T11:25:20.208411+0000","last_unstale":"2024-09-14T12:02:02.282319+0000","last_undegraded":"2024-09-14T12:02:02.282319+0000","last_fullsized":"2024-09-14T12:02:02.282319+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:02.282168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:02.282168+0000","last_clean_scrub_stamp":"2024-09-14T12:02:02.282168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:04.535961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:55.331406+0000","last_change":"2024-09-14T12:01:55.331335+0000","last_active":"2024-09-14T12:01:55.331406+0000","last_peered":"2024-09-14T12:01:55.331406+0000","last_clean":"2024-09-14T12:01:55.331406+0000","last_became_active":"2024-09-14T11:06:45.978458+0000","last_became_peered":"2024-09-14T11:06:45.978458+0000","last_unstale":"2024-09-14T12:01:55.331406+0000","last_undegraded":"2024-09-14T12:01:55.331406+0000","last_fullsized":"2024-09-14T12:01:55.331406+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T12:01:55.331248+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T12:01:55.331248+0000","last_clean_scrub_stamp":"2024-09-14T12:01:55.331248+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:29.427333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"263'3","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:07.139003+0000","last_change":"2024-09-14T12:02:07.138921+0000","last_active":"2024-09-14T12:02:07.139003+0000","last_peered":"2024-09-14T12:02:07.139003+0000","last_clean":"2024-09-14T12:02:07.139003+0000","last_became_active":"2024-09-14T11:06:41.915795+0000","last_became_peered":"2024-09-14T11:06:41.915795+0000","last_unstale":"2024-09-14T12:02:07.139003+0000","last_undegraded":"2024-09-14T12:02:07.139003+0000","last_fullsized":"2024-09-14T12:02:07.139003+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:02:07.138794+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:02:07.138794+0000","last_clean_scrub_stamp":"2024-09-14T12:02:07.138794+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:34.271335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"263'20","reported_seq":117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:15.663248+0000","last_change":"2024-09-14T12:02:15.663248+0000","last_active":"2024-09-14T12:02:15.663248+0000","last_peered":"2024-09-14T12:02:15.663248+0000","last_clean":"2024-09-14T12:02:15.663248+0000","last_became_active":"2024-09-14T11:02:34.881333+0000","last_became_peered":"2024-09-14T11:02:34.881333+0000","last_unstale":"2024-09-14T12:02:15.663248+0000","last_undegraded":"2024-09-14T12:02:15.663248+0000","last_fullsized":"2024-09-14T12:02:15.663248+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'20","last_scrub_stamp":"2024-09-14T12:02:15.663136+0000","last_deep_scrub":"263'20","last_deep_scrub_stamp":"2024-09-14T12:02:15.663136+0000","last_clean_scrub_stamp":"2024-09-14T12:02:15.663136+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:54.516222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":49,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:24.096194+0000","last_change":"2024-09-14T12:02:24.096194+0000","last_active":"2024-09-14T12:02:24.096194+0000","last_peered":"2024-09-14T12:02:24.096194+0000","last_clean":"2024-09-14T12:02:24.096194+0000","last_became_active":"2024-09-14T11:25:20.209369+0000","last_became_peered":"2024-09-14T11:25:20.209369+0000","last_unstale":"2024-09-14T12:02:24.096194+0000","last_undegraded":"2024-09-14T12:02:24.096194+0000","last_fullsized":"2024-09-14T12:02:24.096194+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:24.096092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:24.096092+0000","last_clean_scrub_stamp":"2024-09-14T12:02:24.096092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:07.119467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:14.050233+0000","last_change":"2024-09-14T12:02:14.050120+0000","last_active":"2024-09-14T12:02:14.050233+0000","last_peered":"2024-09-14T12:02:14.050233+0000","last_clean":"2024-09-14T12:02:14.050233+0000","last_became_active":"2024-09-14T11:06:45.980211+0000","last_became_peered":"2024-09-14T11:06:45.980211+0000","last_unstale":"2024-09-14T12:02:14.050233+0000","last_undegraded":"2024-09-14T12:02:14.050233+0000","last_fullsized":"2024-09-14T12:02:14.050233+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:14.050019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:14.050019+0000","last_clean_scrub_stamp":"2024-09-14T12:02:14.050019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:10.346106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:55.640234+0000","last_change":"2024-09-14T12:01:55.640163+0000","last_active":"2024-09-14T12:01:55.640234+0000","last_peered":"2024-09-14T12:01:55.640234+0000","last_clean":"2024-09-14T12:01:55.640234+0000","last_became_active":"2024-09-14T11:06:41.902894+0000","last_became_peered":"2024-09-14T11:06:41.902894+0000","last_unstale":"2024-09-14T12:01:55.640234+0000","last_undegraded":"2024-09-14T12:01:55.640234+0000","last_fullsized":"2024-09-14T12:01:55.640234+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:55.640070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:55.640070+0000","last_clean_scrub_stamp":"2024-09-14T12:01:55.640070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:30.116185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"260'15","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:14.710520+0000","last_change":"2024-09-14T12:02:14.710520+0000","last_active":"2024-09-14T12:02:14.710520+0000","last_peered":"2024-09-14T12:02:14.710520+0000","last_clean":"2024-09-14T12:02:14.710520+0000","last_became_active":"2024-09-14T11:02:34.873660+0000","last_became_peered":"2024-09-14T11:02:34.873660+0000","last_unstale":"2024-09-14T12:02:14.710520+0000","last_undegraded":"2024-09-14T12:02:14.710520+0000","last_fullsized":"2024-09-14T12:02:14.710520+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'15","last_scrub_stamp":"2024-09-14T12:02:14.710419+0000","last_deep_scrub":"260'15","last_deep_scrub_stamp":"2024-09-14T12:02:14.710419+0000","last_clean_scrub_stamp":"2024-09-14T12:02:14.710419+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:33:30.932382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":83,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:09.833063+0000","last_change":"2024-09-14T12:02:09.833063+0000","last_active":"2024-09-14T12:02:09.833063+0000","last_peered":"2024-09-14T12:02:09.833063+0000","last_clean":"2024-09-14T12:02:09.833063+0000","last_became_active":"2024-09-14T11:25:20.210534+0000","last_became_peered":"2024-09-14T11:25:20.210534+0000","last_unstale":"2024-09-14T12:02:09.833063+0000","last_undegraded":"2024-09-14T12:02:09.833063+0000","last_fullsized":"2024-09-14T12:02:09.833063+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:09.832978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:09.832978+0000","last_clean_scrub_stamp":"2024-09-14T12:02:09.832978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:49.563316+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:13.040657+0000","last_change":"2024-09-14T12:02:13.040580+0000","last_active":"2024-09-14T12:02:13.040657+0000","last_peered":"2024-09-14T12:02:13.040657+0000","last_clean":"2024-09-14T12:02:13.040657+0000","last_became_active":"2024-09-14T11:06:45.984993+0000","last_became_peered":"2024-09-14T11:06:45.984993+0000","last_unstale":"2024-09-14T12:02:13.040657+0000","last_undegraded":"2024-09-14T12:02:13.040657+0000","last_fullsized":"2024-09-14T12:02:13.040657+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:13.040497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:13.040497+0000","last_clean_scrub_stamp":"2024-09-14T12:02:13.040497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:48.866466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"263'3","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:06.117859+0000","last_change":"2024-09-14T12:02:06.117796+0000","last_active":"2024-09-14T12:02:06.117859+0000","last_peered":"2024-09-14T12:02:06.117859+0000","last_clean":"2024-09-14T12:02:06.117859+0000","last_became_active":"2024-09-14T11:06:41.910286+0000","last_became_peered":"2024-09-14T11:06:41.910286+0000","last_unstale":"2024-09-14T12:02:06.117859+0000","last_undegraded":"2024-09-14T12:02:06.117859+0000","last_fullsized":"2024-09-14T12:02:06.117859+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:02:06.117717+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:02:06.117717+0000","last_clean_scrub_stamp":"2024-09-14T12:02:06.117717+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:16.663429+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"263'55","reported_seq":211,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:54.163695+0000","last_change":"2024-09-14T12:01:54.163695+0000","last_active":"2024-09-14T12:01:54.163695+0000","last_peered":"2024-09-14T12:01:54.163695+0000","last_clean":"2024-09-14T12:01:54.163695+0000","last_became_active":"2024-09-14T11:02:34.872911+0000","last_became_peered":"2024-09-14T11:02:34.872911+0000","last_unstale":"2024-09-14T12:01:54.163695+0000","last_undegraded":"2024-09-14T12:01:54.163695+0000","last_fullsized":"2024-09-14T12:01:54.163695+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'55","last_scrub_stamp":"2024-09-14T12:01:54.163587+0000","last_deep_scrub":"263'55","last_deep_scrub_stamp":"2024-09-14T12:01:54.163587+0000","last_clean_scrub_stamp":"2024-09-14T12:01:54.163587+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:22.680045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":434,"num_read_kb":298,"num_write":132,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"263'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:11.628452+0000","last_change":"2024-09-14T12:02:11.628358+0000","last_active":"2024-09-14T12:02:11.628452+0000","last_peered":"2024-09-14T12:02:11.628452+0000","last_clean":"2024-09-14T12:02:11.628452+0000","last_became_active":"2024-09-14T11:25:20.209547+0000","last_became_peered":"2024-09-14T11:25:20.209547+0000","last_unstale":"2024-09-14T12:02:11.628452+0000","last_undegraded":"2024-09-14T12:02:11.628452+0000","last_fullsized":"2024-09-14T12:02:11.628452+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:02:11.628262+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:02:11.628262+0000","last_clean_scrub_stamp":"2024-09-14T12:02:11.628262+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:14.488062+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"263'6","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:09.124314+0000","last_change":"2024-09-14T12:02:09.124208+0000","last_active":"2024-09-14T12:02:09.124314+0000","last_peered":"2024-09-14T12:02:09.124314+0000","last_clean":"2024-09-14T12:02:09.124314+0000","last_became_active":"2024-09-14T11:06:45.984527+0000","last_became_peered":"2024-09-14T11:06:45.984527+0000","last_unstale":"2024-09-14T12:02:09.124314+0000","last_undegraded":"2024-09-14T12:02:09.124314+0000","last_fullsized":"2024-09-14T12:02:09.124314+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:02:09.124100+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:02:09.124100+0000","last_clean_scrub_stamp":"2024-09-14T12:02:09.124100+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:46.474797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"260'9","reported_seq":75,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:04.598810+0000","last_change":"2024-09-14T12:02:04.598723+0000","last_active":"2024-09-14T12:02:04.598810+0000","last_peered":"2024-09-14T12:02:04.598810+0000","last_clean":"2024-09-14T12:02:04.598810+0000","last_became_active":"2024-09-14T11:06:41.905088+0000","last_became_peered":"2024-09-14T11:06:41.905088+0000","last_unstale":"2024-09-14T12:02:04.598810+0000","last_undegraded":"2024-09-14T12:02:04.598810+0000","last_fullsized":"2024-09-14T12:02:04.598810+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'9","last_scrub_stamp":"2024-09-14T12:02:04.598632+0000","last_deep_scrub":"260'9","last_deep_scrub_stamp":"2024-09-14T12:02:04.598632+0000","last_clean_scrub_stamp":"2024-09-14T12:02:04.598632+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:17.521499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17408,"num_write":9,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'36","reported_seq":160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:56.869265+0000","last_change":"2024-09-14T12:01:56.869265+0000","last_active":"2024-09-14T12:01:56.869265+0000","last_peered":"2024-09-14T12:01:56.869265+0000","last_clean":"2024-09-14T12:01:56.869265+0000","last_became_active":"2024-09-14T11:02:34.873560+0000","last_became_peered":"2024-09-14T11:02:34.873560+0000","last_unstale":"2024-09-14T12:01:56.869265+0000","last_undegraded":"2024-09-14T12:01:56.869265+0000","last_fullsized":"2024-09-14T12:01:56.869265+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'36","last_scrub_stamp":"2024-09-14T12:01:56.869155+0000","last_deep_scrub":"263'36","last_deep_scrub_stamp":"2024-09-14T12:01:56.869155+0000","last_clean_scrub_stamp":"2024-09-14T12:01:56.869155+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:21.843658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":270,"num_read_kb":162,"num_write":93,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"263'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:08.838605+0000","last_change":"2024-09-14T12:02:08.838605+0000","last_active":"2024-09-14T12:02:08.838605+0000","last_peered":"2024-09-14T12:02:08.838605+0000","last_clean":"2024-09-14T12:02:08.838605+0000","last_became_active":"2024-09-14T11:25:20.206692+0000","last_became_peered":"2024-09-14T11:25:20.206692+0000","last_unstale":"2024-09-14T12:02:08.838605+0000","last_undegraded":"2024-09-14T12:02:08.838605+0000","last_fullsized":"2024-09-14T12:02:08.838605+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:02:08.838526+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:02:08.838526+0000","last_clean_scrub_stamp":"2024-09-14T12:02:08.838526+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:07.800455+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"260'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:27.658251+0000","last_change":"2024-09-14T12:02:27.658190+0000","last_active":"2024-09-14T12:02:27.658251+0000","last_peered":"2024-09-14T12:02:27.658251+0000","last_clean":"2024-09-14T12:02:27.658251+0000","last_became_active":"2024-09-14T11:06:45.985436+0000","last_became_peered":"2024-09-14T11:06:45.985436+0000","last_unstale":"2024-09-14T12:02:27.658251+0000","last_undegraded":"2024-09-14T12:02:27.658251+0000","last_fullsized":"2024-09-14T12:02:27.658251+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T12:02:27.658089+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T12:02:27.658089+0000","last_clean_scrub_stamp":"2024-09-14T12:02:27.658089+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:29.953138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"263'5","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:58.605537+0000","last_change":"2024-09-14T12:01:58.605471+0000","last_active":"2024-09-14T12:01:58.605537+0000","last_peered":"2024-09-14T12:01:58.605537+0000","last_clean":"2024-09-14T12:01:58.605537+0000","last_became_active":"2024-09-14T11:06:41.907791+0000","last_became_peered":"2024-09-14T11:06:41.907791+0000","last_unstale":"2024-09-14T12:01:58.605537+0000","last_undegraded":"2024-09-14T12:01:58.605537+0000","last_fullsized":"2024-09-14T12:01:58.605537+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T12:01:58.605369+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T12:01:58.605369+0000","last_clean_scrub_stamp":"2024-09-14T12:01:58.605369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:54.167899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5124,"num_write":5,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"263'33","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:55.202882+0000","last_change":"2024-09-14T12:01:55.202882+0000","last_active":"2024-09-14T12:01:55.202882+0000","last_peered":"2024-09-14T12:01:55.202882+0000","last_clean":"2024-09-14T12:01:55.202882+0000","last_became_active":"2024-09-14T11:02:34.876080+0000","last_became_peered":"2024-09-14T11:02:34.876080+0000","last_unstale":"2024-09-14T12:01:55.202882+0000","last_undegraded":"2024-09-14T12:01:55.202882+0000","last_fullsized":"2024-09-14T12:01:55.202882+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'33","last_scrub_stamp":"2024-09-14T12:01:55.202764+0000","last_deep_scrub":"263'33","last_deep_scrub_stamp":"2024-09-14T12:01:55.202764+0000","last_clean_scrub_stamp":"2024-09-14T12:01:55.202764+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:44.281145+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":186,"num_write":88,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:20.003866+0000","last_change":"2024-09-14T12:02:20.003866+0000","last_active":"2024-09-14T12:02:20.003866+0000","last_peered":"2024-09-14T12:02:20.003866+0000","last_clean":"2024-09-14T12:02:20.003866+0000","last_became_active":"2024-09-14T11:25:20.205335+0000","last_became_peered":"2024-09-14T11:25:20.205335+0000","last_unstale":"2024-09-14T12:02:20.003866+0000","last_undegraded":"2024-09-14T12:02:20.003866+0000","last_fullsized":"2024-09-14T12:02:20.003866+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:20.003781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:20.003781+0000","last_clean_scrub_stamp":"2024-09-14T12:02:20.003781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:36.847122+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:07.173612+0000","last_change":"2024-09-14T12:02:07.173612+0000","last_active":"2024-09-14T12:02:07.173612+0000","last_peered":"2024-09-14T12:02:07.173612+0000","last_clean":"2024-09-14T12:02:07.173612+0000","last_became_active":"2024-09-14T11:06:45.986225+0000","last_became_peered":"2024-09-14T11:06:45.986225+0000","last_unstale":"2024-09-14T12:02:07.173612+0000","last_undegraded":"2024-09-14T12:02:07.173612+0000","last_fullsized":"2024-09-14T12:02:07.173612+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:07.173523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:07.173523+0000","last_clean_scrub_stamp":"2024-09-14T12:02:07.173523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:27.975514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"263'3","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:00.946625+0000","last_change":"2024-09-14T12:02:00.946625+0000","last_active":"2024-09-14T12:02:00.946625+0000","last_peered":"2024-09-14T12:02:00.946625+0000","last_clean":"2024-09-14T12:02:00.946625+0000","last_became_active":"2024-09-14T11:06:41.903188+0000","last_became_peered":"2024-09-14T11:06:41.903188+0000","last_unstale":"2024-09-14T12:02:00.946625+0000","last_undegraded":"2024-09-14T12:02:00.946625+0000","last_fullsized":"2024-09-14T12:02:00.946625+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:02:00.946535+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:02:00.946535+0000","last_clean_scrub_stamp":"2024-09-14T12:02:00.946535+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:19.041987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"263'55","reported_seq":210,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:53.164118+0000","last_change":"2024-09-14T12:01:53.164118+0000","last_active":"2024-09-14T12:01:53.164118+0000","last_peered":"2024-09-14T12:01:53.164118+0000","last_clean":"2024-09-14T12:01:53.164118+0000","last_became_active":"2024-09-14T11:02:34.877631+0000","last_became_peered":"2024-09-14T11:02:34.877631+0000","last_unstale":"2024-09-14T12:01:53.164118+0000","last_undegraded":"2024-09-14T12:01:53.164118+0000","last_fullsized":"2024-09-14T12:01:53.164118+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'55","last_scrub_stamp":"2024-09-14T12:01:53.164032+0000","last_deep_scrub":"263'55","last_deep_scrub_stamp":"2024-09-14T12:01:53.164032+0000","last_clean_scrub_stamp":"2024-09-14T12:01:53.164032+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:16.618442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":260,"num_write":147,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:02.633879+0000","last_change":"2024-09-14T12:02:02.633879+0000","last_active":"2024-09-14T12:02:02.633879+0000","last_peered":"2024-09-14T12:02:02.633879+0000","last_clean":"2024-09-14T12:02:02.633879+0000","last_became_active":"2024-09-14T11:25:20.200061+0000","last_became_peered":"2024-09-14T11:25:20.200061+0000","last_unstale":"2024-09-14T12:02:02.633879+0000","last_undegraded":"2024-09-14T12:02:02.633879+0000","last_fullsized":"2024-09-14T12:02:02.633879+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:02.633771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:02.633771+0000","last_clean_scrub_stamp":"2024-09-14T12:02:02.633771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:42.399562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"263'2","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:06.193129+0000","last_change":"2024-09-14T12:02:06.193129+0000","last_active":"2024-09-14T12:02:06.193129+0000","last_peered":"2024-09-14T12:02:06.193129+0000","last_clean":"2024-09-14T12:02:06.193129+0000","last_became_active":"2024-09-14T11:06:45.991198+0000","last_became_peered":"2024-09-14T11:06:45.991198+0000","last_unstale":"2024-09-14T12:02:06.193129+0000","last_undegraded":"2024-09-14T12:02:06.193129+0000","last_fullsized":"2024-09-14T12:02:06.193129+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:02:06.193045+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:02:06.193045+0000","last_clean_scrub_stamp":"2024-09-14T12:02:06.193045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:34.954633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"263'3","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:04.883006+0000","last_change":"2024-09-14T12:02:04.883006+0000","last_active":"2024-09-14T12:02:04.883006+0000","last_peered":"2024-09-14T12:02:04.883006+0000","last_clean":"2024-09-14T12:02:04.883006+0000","last_became_active":"2024-09-14T11:06:41.910512+0000","last_became_peered":"2024-09-14T11:06:41.910512+0000","last_unstale":"2024-09-14T12:02:04.883006+0000","last_undegraded":"2024-09-14T12:02:04.883006+0000","last_fullsized":"2024-09-14T12:02:04.883006+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:02:04.882922+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:02:04.882922+0000","last_clean_scrub_stamp":"2024-09-14T12:02:04.882922+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:31.861257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"263'44","reported_seq":180,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:17.689562+0000","last_change":"2024-09-14T12:02:17.689562+0000","last_active":"2024-09-14T12:02:17.689562+0000","last_peered":"2024-09-14T12:02:17.689562+0000","last_clean":"2024-09-14T12:02:17.689562+0000","last_became_active":"2024-09-14T11:02:34.881341+0000","last_became_peered":"2024-09-14T11:02:34.881341+0000","last_unstale":"2024-09-14T12:02:17.689562+0000","last_undegraded":"2024-09-14T12:02:17.689562+0000","last_fullsized":"2024-09-14T12:02:17.689562+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'44","last_scrub_stamp":"2024-09-14T12:02:17.689454+0000","last_deep_scrub":"263'44","last_deep_scrub_stamp":"2024-09-14T12:02:17.689454+0000","last_clean_scrub_stamp":"2024-09-14T12:02:17.689454+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:43.935314+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":339,"num_read_kb":228,"num_write":117,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:29.671212+0000","last_change":"2024-09-14T12:02:29.671212+0000","last_active":"2024-09-14T12:02:29.671212+0000","last_peered":"2024-09-14T12:02:29.671212+0000","last_clean":"2024-09-14T12:02:29.671212+0000","last_became_active":"2024-09-14T11:25:20.210117+0000","last_became_peered":"2024-09-14T11:25:20.210117+0000","last_unstale":"2024-09-14T12:02:29.671212+0000","last_undegraded":"2024-09-14T12:02:29.671212+0000","last_fullsized":"2024-09-14T12:02:29.671212+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:29.671108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:29.671108+0000","last_clean_scrub_stamp":"2024-09-14T12:02:29.671108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:13.215424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'6","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:08.128651+0000","last_change":"2024-09-14T12:02:08.128651+0000","last_active":"2024-09-14T12:02:08.128651+0000","last_peered":"2024-09-14T12:02:08.128651+0000","last_clean":"2024-09-14T12:02:08.128651+0000","last_became_active":"2024-09-14T11:06:45.992574+0000","last_became_peered":"2024-09-14T11:06:45.992574+0000","last_unstale":"2024-09-14T12:02:08.128651+0000","last_undegraded":"2024-09-14T12:02:08.128651+0000","last_fullsized":"2024-09-14T12:02:08.128651+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:02:08.128560+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:02:08.128560+0000","last_clean_scrub_stamp":"2024-09-14T12:02:08.128560+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:51.137988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:01.142843+0000","last_change":"2024-09-14T12:02:01.142843+0000","last_active":"2024-09-14T12:02:01.142843+0000","last_peered":"2024-09-14T12:02:01.142843+0000","last_clean":"2024-09-14T12:02:01.142843+0000","last_became_active":"2024-09-14T11:06:41.919330+0000","last_became_peered":"2024-09-14T11:06:41.919330+0000","last_unstale":"2024-09-14T12:02:01.142843+0000","last_undegraded":"2024-09-14T12:02:01.142843+0000","last_fullsized":"2024-09-14T12:02:01.142843+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:01.142760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:01.142760+0000","last_clean_scrub_stamp":"2024-09-14T12:02:01.142760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:40.749849+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"263'112","reported_seq":398,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:52.702449+0000","last_change":"2024-09-14T12:01:52.702449+0000","last_active":"2024-09-14T12:01:52.702449+0000","last_peered":"2024-09-14T12:01:52.702449+0000","last_clean":"2024-09-14T12:01:52.702449+0000","last_became_active":"2024-09-14T11:02:34.873360+0000","last_became_peered":"2024-09-14T11:02:34.873360+0000","last_unstale":"2024-09-14T12:01:52.702449+0000","last_undegraded":"2024-09-14T12:01:52.702449+0000","last_fullsized":"2024-09-14T12:01:52.702449+0000","mapping_epoch":252,"log_start":"263'100","ondisk_log_start":"263'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'112","last_scrub_stamp":"2024-09-14T12:01:52.702353+0000","last_deep_scrub":"263'112","last_deep_scrub_stamp":"2024-09-14T12:01:52.702353+0000","last_clean_scrub_stamp":"2024-09-14T12:01:52.702353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:20.277676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1014,"num_read_kb":809,"num_write":225,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:01.607680+0000","last_change":"2024-09-14T12:02:01.607623+0000","last_active":"2024-09-14T12:02:01.607680+0000","last_peered":"2024-09-14T12:02:01.607680+0000","last_clean":"2024-09-14T12:02:01.607680+0000","last_became_active":"2024-09-14T11:25:20.199875+0000","last_became_peered":"2024-09-14T11:25:20.199875+0000","last_unstale":"2024-09-14T12:02:01.607680+0000","last_undegraded":"2024-09-14T12:02:01.607680+0000","last_fullsized":"2024-09-14T12:02:01.607680+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:01.607533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:01.607533+0000","last_clean_scrub_stamp":"2024-09-14T12:02:01.607533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:04.607213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"260'2","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:12.035095+0000","last_change":"2024-09-14T12:02:12.035095+0000","last_active":"2024-09-14T12:02:12.035095+0000","last_peered":"2024-09-14T12:02:12.035095+0000","last_clean":"2024-09-14T12:02:12.035095+0000","last_became_active":"2024-09-14T11:06:45.980035+0000","last_became_peered":"2024-09-14T11:06:45.980035+0000","last_unstale":"2024-09-14T12:02:12.035095+0000","last_undegraded":"2024-09-14T12:02:12.035095+0000","last_fullsized":"2024-09-14T12:02:12.035095+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T12:02:12.035010+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T12:02:12.035010+0000","last_clean_scrub_stamp":"2024-09-14T12:02:12.035010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:30.889757+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"263'3","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:02.139036+0000","last_change":"2024-09-14T12:02:02.139036+0000","last_active":"2024-09-14T12:02:02.139036+0000","last_peered":"2024-09-14T12:02:02.139036+0000","last_clean":"2024-09-14T12:02:02.139036+0000","last_became_active":"2024-09-14T11:06:41.917341+0000","last_became_peered":"2024-09-14T11:06:41.917341+0000","last_unstale":"2024-09-14T12:02:02.139036+0000","last_undegraded":"2024-09-14T12:02:02.139036+0000","last_fullsized":"2024-09-14T12:02:02.139036+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:02:02.138945+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:02:02.138945+0000","last_clean_scrub_stamp":"2024-09-14T12:02:02.138945+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:23.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"260'15","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:58.845971+0000","last_change":"2024-09-14T12:01:58.845971+0000","last_active":"2024-09-14T12:01:58.845971+0000","last_peered":"2024-09-14T12:01:58.845971+0000","last_clean":"2024-09-14T12:01:58.845971+0000","last_became_active":"2024-09-14T11:02:34.876078+0000","last_became_peered":"2024-09-14T11:02:34.876078+0000","last_unstale":"2024-09-14T12:01:58.845971+0000","last_undegraded":"2024-09-14T12:01:58.845971+0000","last_fullsized":"2024-09-14T12:01:58.845971+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'15","last_scrub_stamp":"2024-09-14T12:01:58.845874+0000","last_deep_scrub":"260'15","last_deep_scrub_stamp":"2024-09-14T12:01:58.845874+0000","last_clean_scrub_stamp":"2024-09-14T12:01:58.845874+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:38.473311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":83,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:21.049038+0000","last_change":"2024-09-14T12:02:21.049038+0000","last_active":"2024-09-14T12:02:21.049038+0000","last_peered":"2024-09-14T12:02:21.049038+0000","last_clean":"2024-09-14T12:02:21.049038+0000","last_became_active":"2024-09-14T11:25:20.210181+0000","last_became_peered":"2024-09-14T11:25:20.210181+0000","last_unstale":"2024-09-14T12:02:21.049038+0000","last_undegraded":"2024-09-14T12:02:21.049038+0000","last_fullsized":"2024-09-14T12:02:21.049038+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:21.048947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:21.048947+0000","last_clean_scrub_stamp":"2024-09-14T12:02:21.048947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:33.468565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:25.630166+0000","last_change":"2024-09-14T12:02:25.630166+0000","last_active":"2024-09-14T12:02:25.630166+0000","last_peered":"2024-09-14T12:02:25.630166+0000","last_clean":"2024-09-14T12:02:25.630166+0000","last_became_active":"2024-09-14T11:06:45.984696+0000","last_became_peered":"2024-09-14T11:06:45.984696+0000","last_unstale":"2024-09-14T12:02:25.630166+0000","last_undegraded":"2024-09-14T12:02:25.630166+0000","last_fullsized":"2024-09-14T12:02:25.630166+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:25.630057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:25.630057+0000","last_clean_scrub_stamp":"2024-09-14T12:02:25.630057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:05.503867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"263'2","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:58.226711+0000","last_change":"2024-09-14T12:01:58.226711+0000","last_active":"2024-09-14T12:01:58.226711+0000","last_peered":"2024-09-14T12:01:58.226711+0000","last_clean":"2024-09-14T12:01:58.226711+0000","last_became_active":"2024-09-14T11:06:41.914209+0000","last_became_peered":"2024-09-14T11:06:41.914209+0000","last_unstale":"2024-09-14T12:01:58.226711+0000","last_undegraded":"2024-09-14T12:01:58.226711+0000","last_fullsized":"2024-09-14T12:01:58.226711+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:01:58.226620+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:01:58.226620+0000","last_clean_scrub_stamp":"2024-09-14T12:01:58.226620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:41.343335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"263'35","reported_seq":156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:57.849960+0000","last_change":"2024-09-14T12:01:57.849960+0000","last_active":"2024-09-14T12:01:57.849960+0000","last_peered":"2024-09-14T12:01:57.849960+0000","last_clean":"2024-09-14T12:01:57.849960+0000","last_became_active":"2024-09-14T11:02:34.879834+0000","last_became_peered":"2024-09-14T11:02:34.879834+0000","last_unstale":"2024-09-14T12:01:57.849960+0000","last_undegraded":"2024-09-14T12:01:57.849960+0000","last_fullsized":"2024-09-14T12:01:57.849960+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'35","last_scrub_stamp":"2024-09-14T12:01:57.849884+0000","last_deep_scrub":"263'35","last_deep_scrub_stamp":"2024-09-14T12:01:57.849884+0000","last_clean_scrub_stamp":"2024-09-14T12:01:57.849884+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:04.537597+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":172,"num_write":95,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:07.982070+0000","last_change":"2024-09-14T12:02:07.982070+0000","last_active":"2024-09-14T12:02:07.982070+0000","last_peered":"2024-09-14T12:02:07.982070+0000","last_clean":"2024-09-14T12:02:07.982070+0000","last_became_active":"2024-09-14T11:25:20.204834+0000","last_became_peered":"2024-09-14T11:25:20.204834+0000","last_unstale":"2024-09-14T12:02:07.982070+0000","last_undegraded":"2024-09-14T12:02:07.982070+0000","last_fullsized":"2024-09-14T12:02:07.982070+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:07.981967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:07.981967+0000","last_clean_scrub_stamp":"2024-09-14T12:02:07.981967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:31.022610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:02.920733+0000","last_change":"2024-09-14T12:02:02.920733+0000","last_active":"2024-09-14T12:02:02.920733+0000","last_peered":"2024-09-14T12:02:02.920733+0000","last_clean":"2024-09-14T12:02:02.920733+0000","last_became_active":"2024-09-14T11:06:45.984865+0000","last_became_peered":"2024-09-14T11:06:45.984865+0000","last_unstale":"2024-09-14T12:02:02.920733+0000","last_undegraded":"2024-09-14T12:02:02.920733+0000","last_fullsized":"2024-09-14T12:02:02.920733+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:02.920632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:02.920632+0000","last_clean_scrub_stamp":"2024-09-14T12:02:02.920632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:26.835967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"260'3","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:05.125197+0000","last_change":"2024-09-14T12:02:05.125197+0000","last_active":"2024-09-14T12:02:05.125197+0000","last_peered":"2024-09-14T12:02:05.125197+0000","last_clean":"2024-09-14T12:02:05.125197+0000","last_became_active":"2024-09-14T11:06:41.909533+0000","last_became_peered":"2024-09-14T11:06:41.909533+0000","last_unstale":"2024-09-14T12:02:05.125197+0000","last_undegraded":"2024-09-14T12:02:05.125197+0000","last_fullsized":"2024-09-14T12:02:05.125197+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T12:02:05.125101+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T12:02:05.125101+0000","last_clean_scrub_stamp":"2024-09-14T12:02:05.125101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:17.037553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"263'25","reported_seq":132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:55.872960+0000","last_change":"2024-09-14T12:01:55.872960+0000","last_active":"2024-09-14T12:01:55.872960+0000","last_peered":"2024-09-14T12:01:55.872960+0000","last_clean":"2024-09-14T12:01:55.872960+0000","last_became_active":"2024-09-14T11:02:34.873259+0000","last_became_peered":"2024-09-14T11:02:34.873259+0000","last_unstale":"2024-09-14T12:01:55.872960+0000","last_undegraded":"2024-09-14T12:01:55.872960+0000","last_fullsized":"2024-09-14T12:01:55.872960+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'25","last_scrub_stamp":"2024-09-14T12:01:55.872878+0000","last_deep_scrub":"263'25","last_deep_scrub_stamp":"2024-09-14T12:01:55.872878+0000","last_clean_scrub_stamp":"2024-09-14T12:01:55.872878+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:30.274992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":129,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"263'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:01.281475+0000","last_change":"2024-09-14T12:02:01.281475+0000","last_active":"2024-09-14T12:02:01.281475+0000","last_peered":"2024-09-14T12:02:01.281475+0000","last_clean":"2024-09-14T12:02:01.281475+0000","last_became_active":"2024-09-14T11:25:20.212293+0000","last_became_peered":"2024-09-14T11:25:20.212293+0000","last_unstale":"2024-09-14T12:02:01.281475+0000","last_undegraded":"2024-09-14T12:02:01.281475+0000","last_fullsized":"2024-09-14T12:02:01.281475+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:02:01.281378+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:02:01.281378+0000","last_clean_scrub_stamp":"2024-09-14T12:02:01.281378+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:12.176617+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:06.873026+0000","last_change":"2024-09-14T12:02:06.873026+0000","last_active":"2024-09-14T12:02:06.873026+0000","last_peered":"2024-09-14T12:02:06.873026+0000","last_clean":"2024-09-14T12:02:06.873026+0000","last_became_active":"2024-09-14T11:06:45.986398+0000","last_became_peered":"2024-09-14T11:06:45.986398+0000","last_unstale":"2024-09-14T12:02:06.873026+0000","last_undegraded":"2024-09-14T12:02:06.873026+0000","last_fullsized":"2024-09-14T12:02:06.873026+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:06.872903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:06.872903+0000","last_clean_scrub_stamp":"2024-09-14T12:02:06.872903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:09.600104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"260'10","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:59.177591+0000","last_change":"2024-09-14T12:01:59.177591+0000","last_active":"2024-09-14T12:01:59.177591+0000","last_peered":"2024-09-14T12:01:59.177591+0000","last_clean":"2024-09-14T12:01:59.177591+0000","last_became_active":"2024-09-14T11:06:41.915491+0000","last_became_peered":"2024-09-14T11:06:41.915491+0000","last_unstale":"2024-09-14T12:01:59.177591+0000","last_undegraded":"2024-09-14T12:01:59.177591+0000","last_fullsized":"2024-09-14T12:01:59.177591+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'10","last_scrub_stamp":"2024-09-14T12:01:59.177516+0000","last_deep_scrub":"260'10","last_deep_scrub_stamp":"2024-09-14T12:01:59.177516+0000","last_clean_scrub_stamp":"2024-09-14T12:01:59.177516+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:40.951015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":40964,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"260'12","reported_seq":99,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:04.164519+0000","last_change":"2024-09-14T12:02:04.164519+0000","last_active":"2024-09-14T12:02:04.164519+0000","last_peered":"2024-09-14T12:02:04.164519+0000","last_clean":"2024-09-14T12:02:04.164519+0000","last_became_active":"2024-09-14T11:02:34.871352+0000","last_became_peered":"2024-09-14T11:02:34.871352+0000","last_unstale":"2024-09-14T12:02:04.164519+0000","last_undegraded":"2024-09-14T12:02:04.164519+0000","last_fullsized":"2024-09-14T12:02:04.164519+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'12","last_scrub_stamp":"2024-09-14T12:02:04.164434+0000","last_deep_scrub":"260'12","last_deep_scrub_stamp":"2024-09-14T12:02:04.164434+0000","last_clean_scrub_stamp":"2024-09-14T12:02:04.164434+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:05.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:12.039602+0000","last_change":"2024-09-14T12:02:12.039602+0000","last_active":"2024-09-14T12:02:12.039602+0000","last_peered":"2024-09-14T12:02:12.039602+0000","last_clean":"2024-09-14T12:02:12.039602+0000","last_became_active":"2024-09-14T11:25:20.213785+0000","last_became_peered":"2024-09-14T11:25:20.213785+0000","last_unstale":"2024-09-14T12:02:12.039602+0000","last_undegraded":"2024-09-14T12:02:12.039602+0000","last_fullsized":"2024-09-14T12:02:12.039602+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:12.039516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:12.039516+0000","last_clean_scrub_stamp":"2024-09-14T12:02:12.039516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:26.089026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"260'2","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:57.339142+0000","last_change":"2024-09-14T12:01:57.339142+0000","last_active":"2024-09-14T12:01:57.339142+0000","last_peered":"2024-09-14T12:01:57.339142+0000","last_clean":"2024-09-14T12:01:57.339142+0000","last_became_active":"2024-09-14T11:06:45.981476+0000","last_became_peered":"2024-09-14T11:06:45.981476+0000","last_unstale":"2024-09-14T12:01:57.339142+0000","last_undegraded":"2024-09-14T12:01:57.339142+0000","last_fullsized":"2024-09-14T12:01:57.339142+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T12:01:57.339050+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T12:01:57.339050+0000","last_clean_scrub_stamp":"2024-09-14T12:01:57.339050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:17.523005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"260'2","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:20.654700+0000","last_change":"2024-09-14T12:02:20.654700+0000","last_active":"2024-09-14T12:02:20.654700+0000","last_peered":"2024-09-14T12:02:20.654700+0000","last_clean":"2024-09-14T12:02:20.654700+0000","last_became_active":"2024-09-14T11:06:41.911413+0000","last_became_peered":"2024-09-14T11:06:41.911413+0000","last_unstale":"2024-09-14T12:02:20.654700+0000","last_undegraded":"2024-09-14T12:02:20.654700+0000","last_fullsized":"2024-09-14T12:02:20.654700+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T12:02:20.654598+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T12:02:20.654598+0000","last_clean_scrub_stamp":"2024-09-14T12:02:20.654598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:43.066086+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"263'38","reported_seq":172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:52.297692+0000","last_change":"2024-09-14T12:01:52.297692+0000","last_active":"2024-09-14T12:01:52.297692+0000","last_peered":"2024-09-14T12:01:52.297692+0000","last_clean":"2024-09-14T12:01:52.297692+0000","last_became_active":"2024-09-14T11:02:34.878752+0000","last_became_peered":"2024-09-14T11:02:34.878752+0000","last_unstale":"2024-09-14T12:01:52.297692+0000","last_undegraded":"2024-09-14T12:01:52.297692+0000","last_fullsized":"2024-09-14T12:01:52.297692+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'38","last_scrub_stamp":"2024-09-14T12:01:52.297591+0000","last_deep_scrub":"263'38","last_deep_scrub_stamp":"2024-09-14T12:01:52.297591+0000","last_clean_scrub_stamp":"2024-09-14T12:01:52.297591+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:53.254453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":231,"num_write":89,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:59.302841+0000","last_change":"2024-09-14T12:01:59.302841+0000","last_active":"2024-09-14T12:01:59.302841+0000","last_peered":"2024-09-14T12:01:59.302841+0000","last_clean":"2024-09-14T12:01:59.302841+0000","last_became_active":"2024-09-14T11:25:20.210999+0000","last_became_peered":"2024-09-14T11:25:20.210999+0000","last_unstale":"2024-09-14T12:01:59.302841+0000","last_undegraded":"2024-09-14T12:01:59.302841+0000","last_fullsized":"2024-09-14T12:01:59.302841+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:59.302753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:59.302753+0000","last_clean_scrub_stamp":"2024-09-14T12:01:59.302753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:55.806305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:11.068048+0000","last_change":"2024-09-14T12:02:11.068048+0000","last_active":"2024-09-14T12:02:11.068048+0000","last_peered":"2024-09-14T12:02:11.068048+0000","last_clean":"2024-09-14T12:02:11.068048+0000","last_became_active":"2024-09-14T11:06:45.982181+0000","last_became_peered":"2024-09-14T11:06:45.982181+0000","last_unstale":"2024-09-14T12:02:11.068048+0000","last_undegraded":"2024-09-14T12:02:11.068048+0000","last_fullsized":"2024-09-14T12:02:11.068048+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:11.067962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:11.067962+0000","last_clean_scrub_stamp":"2024-09-14T12:02:11.067962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:07.109261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:18.698541+0000","last_change":"2024-09-14T12:02:18.698541+0000","last_active":"2024-09-14T12:02:18.698541+0000","last_peered":"2024-09-14T12:02:18.698541+0000","last_clean":"2024-09-14T12:02:18.698541+0000","last_became_active":"2024-09-14T11:06:41.913192+0000","last_became_peered":"2024-09-14T11:06:41.913192+0000","last_unstale":"2024-09-14T12:02:18.698541+0000","last_undegraded":"2024-09-14T12:02:18.698541+0000","last_fullsized":"2024-09-14T12:02:18.698541+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:18.698452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:18.698452+0000","last_clean_scrub_stamp":"2024-09-14T12:02:18.698452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:36.623923+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"263'32","reported_seq":151,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:04.697710+0000","last_change":"2024-09-14T12:02:04.697710+0000","last_active":"2024-09-14T12:02:04.697710+0000","last_peered":"2024-09-14T12:02:04.697710+0000","last_clean":"2024-09-14T12:02:04.697710+0000","last_became_active":"2024-09-14T11:02:34.874328+0000","last_became_peered":"2024-09-14T11:02:34.874328+0000","last_unstale":"2024-09-14T12:02:04.697710+0000","last_undegraded":"2024-09-14T12:02:04.697710+0000","last_fullsized":"2024-09-14T12:02:04.697710+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'32","last_scrub_stamp":"2024-09-14T12:02:04.697613+0000","last_deep_scrub":"263'32","last_deep_scrub_stamp":"2024-09-14T12:02:04.697613+0000","last_clean_scrub_stamp":"2024-09-14T12:02:04.697613+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:11.839878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":246,"num_read_kb":166,"num_write":81,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:00.318918+0000","last_change":"2024-09-14T12:02:00.318918+0000","last_active":"2024-09-14T12:02:00.318918+0000","last_peered":"2024-09-14T12:02:00.318918+0000","last_clean":"2024-09-14T12:02:00.318918+0000","last_became_active":"2024-09-14T11:25:20.213577+0000","last_became_peered":"2024-09-14T11:25:20.213577+0000","last_unstale":"2024-09-14T12:02:00.318918+0000","last_undegraded":"2024-09-14T12:02:00.318918+0000","last_fullsized":"2024-09-14T12:02:00.318918+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:00.318831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:00.318831+0000","last_clean_scrub_stamp":"2024-09-14T12:02:00.318831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:51.312386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"263'10","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:10.039257+0000","last_change":"2024-09-14T12:02:10.039257+0000","last_active":"2024-09-14T12:02:10.039257+0000","last_peered":"2024-09-14T12:02:10.039257+0000","last_clean":"2024-09-14T12:02:10.039257+0000","last_became_active":"2024-09-14T11:06:45.990855+0000","last_became_peered":"2024-09-14T11:06:45.990855+0000","last_unstale":"2024-09-14T12:02:10.039257+0000","last_undegraded":"2024-09-14T12:02:10.039257+0000","last_fullsized":"2024-09-14T12:02:10.039257+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-09-14T12:02:10.039171+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-09-14T12:02:10.039171+0000","last_clean_scrub_stamp":"2024-09-14T12:02:10.039171+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:49.857634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6246,"num_write":20,"num_write_kb":2098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"263'8","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:07.603786+0000","last_change":"2024-09-14T12:02:07.603786+0000","last_active":"2024-09-14T12:02:07.603786+0000","last_peered":"2024-09-14T12:02:07.603786+0000","last_clean":"2024-09-14T12:02:07.603786+0000","last_became_active":"2024-09-14T11:06:41.913454+0000","last_became_peered":"2024-09-14T11:06:41.913454+0000","last_unstale":"2024-09-14T12:02:07.603786+0000","last_undegraded":"2024-09-14T12:02:07.603786+0000","last_fullsized":"2024-09-14T12:02:07.603786+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-14T12:02:07.603699+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-14T12:02:07.603699+0000","last_clean_scrub_stamp":"2024-09-14T12:02:07.603699+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:58.576518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":18,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'130","reported_seq":452,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:13.668831+0000","last_change":"2024-09-14T12:02:13.668831+0000","last_active":"2024-09-14T12:02:13.668831+0000","last_peered":"2024-09-14T12:02:13.668831+0000","last_clean":"2024-09-14T12:02:13.668831+0000","last_became_active":"2024-09-14T11:02:34.878813+0000","last_became_peered":"2024-09-14T11:02:34.878813+0000","last_unstale":"2024-09-14T12:02:13.668831+0000","last_undegraded":"2024-09-14T12:02:13.668831+0000","last_fullsized":"2024-09-14T12:02:13.668831+0000","mapping_epoch":252,"log_start":"260'100","ondisk_log_start":"260'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'130","last_scrub_stamp":"2024-09-14T12:02:13.668739+0000","last_deep_scrub":"263'130","last_deep_scrub_stamp":"2024-09-14T12:02:13.668739+0000","last_clean_scrub_stamp":"2024-09-14T12:02:13.668739+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:28.464724+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1195,"num_read_kb":1160,"num_write":263,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:18.992177+0000","last_change":"2024-09-14T12:02:18.992177+0000","last_active":"2024-09-14T12:02:18.992177+0000","last_peered":"2024-09-14T12:02:18.992177+0000","last_clean":"2024-09-14T12:02:18.992177+0000","last_became_active":"2024-09-14T11:25:20.212665+0000","last_became_peered":"2024-09-14T11:25:20.212665+0000","last_unstale":"2024-09-14T12:02:18.992177+0000","last_undegraded":"2024-09-14T12:02:18.992177+0000","last_fullsized":"2024-09-14T12:02:18.992177+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:18.992078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:18.992078+0000","last_clean_scrub_stamp":"2024-09-14T12:02:18.992078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:41.949050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:56.329477+0000","last_change":"2024-09-14T12:01:56.329477+0000","last_active":"2024-09-14T12:01:56.329477+0000","last_peered":"2024-09-14T12:01:56.329477+0000","last_clean":"2024-09-14T12:01:56.329477+0000","last_became_active":"2024-09-14T11:06:45.992066+0000","last_became_peered":"2024-09-14T11:06:45.992066+0000","last_unstale":"2024-09-14T12:01:56.329477+0000","last_undegraded":"2024-09-14T12:01:56.329477+0000","last_fullsized":"2024-09-14T12:01:56.329477+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:56.329370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:56.329370+0000","last_clean_scrub_stamp":"2024-09-14T12:01:56.329370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:14.427233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"260'3","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:58.924814+0000","last_change":"2024-09-14T12:01:58.924814+0000","last_active":"2024-09-14T12:01:58.924814+0000","last_peered":"2024-09-14T12:01:58.924814+0000","last_clean":"2024-09-14T12:01:58.924814+0000","last_became_active":"2024-09-14T11:06:41.912405+0000","last_became_peered":"2024-09-14T11:06:41.912405+0000","last_unstale":"2024-09-14T12:01:58.924814+0000","last_undegraded":"2024-09-14T12:01:58.924814+0000","last_fullsized":"2024-09-14T12:01:58.924814+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T12:01:58.924722+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T12:01:58.924722+0000","last_clean_scrub_stamp":"2024-09-14T12:01:58.924722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:20.646458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"263'36","reported_seq":166,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:53.832115+0000","last_change":"2024-09-14T12:01:53.832115+0000","last_active":"2024-09-14T12:01:53.832115+0000","last_peered":"2024-09-14T12:01:53.832115+0000","last_clean":"2024-09-14T12:01:53.832115+0000","last_became_active":"2024-09-14T11:02:34.873089+0000","last_became_peered":"2024-09-14T11:02:34.873089+0000","last_unstale":"2024-09-14T12:01:53.832115+0000","last_undegraded":"2024-09-14T12:01:53.832115+0000","last_fullsized":"2024-09-14T12:01:53.832115+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'36","last_scrub_stamp":"2024-09-14T12:01:53.832028+0000","last_deep_scrub":"263'36","last_deep_scrub_stamp":"2024-09-14T12:01:53.832028+0000","last_clean_scrub_stamp":"2024-09-14T12:01:53.832028+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:15.408768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":295,"num_read_kb":200,"num_write":86,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:28.672285+0000","last_change":"2024-09-14T12:02:28.672285+0000","last_active":"2024-09-14T12:02:28.672285+0000","last_peered":"2024-09-14T12:02:28.672285+0000","last_clean":"2024-09-14T12:02:28.672285+0000","last_became_active":"2024-09-14T11:25:20.210331+0000","last_became_peered":"2024-09-14T11:25:20.210331+0000","last_unstale":"2024-09-14T12:02:28.672285+0000","last_undegraded":"2024-09-14T12:02:28.672285+0000","last_fullsized":"2024-09-14T12:02:28.672285+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:28.672212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:28.672212+0000","last_clean_scrub_stamp":"2024-09-14T12:02:28.672212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:04.778503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:24.586188+0000","last_change":"2024-09-14T12:02:24.586188+0000","last_active":"2024-09-14T12:02:24.586188+0000","last_peered":"2024-09-14T12:02:24.586188+0000","last_clean":"2024-09-14T12:02:24.586188+0000","last_became_active":"2024-09-14T11:06:45.985792+0000","last_became_peered":"2024-09-14T11:06:45.985792+0000","last_unstale":"2024-09-14T12:02:24.586188+0000","last_undegraded":"2024-09-14T12:02:24.586188+0000","last_fullsized":"2024-09-14T12:02:24.586188+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:24.586081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:24.586081+0000","last_clean_scrub_stamp":"2024-09-14T12:02:24.586081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:41.061641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:19.690194+0000","last_change":"2024-09-14T12:02:19.690194+0000","last_active":"2024-09-14T12:02:19.690194+0000","last_peered":"2024-09-14T12:02:19.690194+0000","last_clean":"2024-09-14T12:02:19.690194+0000","last_became_active":"2024-09-14T11:06:41.913214+0000","last_became_peered":"2024-09-14T11:06:41.913214+0000","last_unstale":"2024-09-14T12:02:19.690194+0000","last_undegraded":"2024-09-14T12:02:19.690194+0000","last_fullsized":"2024-09-14T12:02:19.690194+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:19.690097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:19.690097+0000","last_clean_scrub_stamp":"2024-09-14T12:02:19.690097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:57.245612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"263'55","reported_seq":217,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:00.159255+0000","last_change":"2024-09-14T12:02:00.159255+0000","last_active":"2024-09-14T12:02:00.159255+0000","last_peered":"2024-09-14T12:02:00.159255+0000","last_clean":"2024-09-14T12:02:00.159255+0000","last_became_active":"2024-09-14T11:02:34.873554+0000","last_became_peered":"2024-09-14T11:02:34.873554+0000","last_unstale":"2024-09-14T12:02:00.159255+0000","last_undegraded":"2024-09-14T12:02:00.159255+0000","last_fullsized":"2024-09-14T12:02:00.159255+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'55","last_scrub_stamp":"2024-09-14T12:02:00.159178+0000","last_deep_scrub":"263'55","last_deep_scrub_stamp":"2024-09-14T12:02:00.159178+0000","last_clean_scrub_stamp":"2024-09-14T12:02:00.159178+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:11.640741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":297,"num_write":136,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"263'2","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:13.063258+0000","last_change":"2024-09-14T12:02:13.063258+0000","last_active":"2024-09-14T12:02:13.063258+0000","last_peered":"2024-09-14T12:02:13.063258+0000","last_clean":"2024-09-14T12:02:13.063258+0000","last_became_active":"2024-09-14T11:25:20.208985+0000","last_became_peered":"2024-09-14T11:25:20.208985+0000","last_unstale":"2024-09-14T12:02:13.063258+0000","last_undegraded":"2024-09-14T12:02:13.063258+0000","last_fullsized":"2024-09-14T12:02:13.063258+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:02:13.063141+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:02:13.063141+0000","last_clean_scrub_stamp":"2024-09-14T12:02:13.063141+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:14.600067+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"260'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:09.570212+0000","last_change":"2024-09-14T12:02:09.570212+0000","last_active":"2024-09-14T12:02:09.570212+0000","last_peered":"2024-09-14T12:02:09.570212+0000","last_clean":"2024-09-14T12:02:09.570212+0000","last_became_active":"2024-09-14T11:06:45.987665+0000","last_became_peered":"2024-09-14T11:06:45.987665+0000","last_unstale":"2024-09-14T12:02:09.570212+0000","last_undegraded":"2024-09-14T12:02:09.570212+0000","last_fullsized":"2024-09-14T12:02:09.570212+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T12:02:09.570128+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T12:02:09.570128+0000","last_clean_scrub_stamp":"2024-09-14T12:02:09.570128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:38.939945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5649,"num_write":5,"num_write_kb":5649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"260'8","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:59.952584+0000","last_change":"2024-09-14T12:01:59.952584+0000","last_active":"2024-09-14T12:01:59.952584+0000","last_peered":"2024-09-14T12:01:59.952584+0000","last_clean":"2024-09-14T12:01:59.952584+0000","last_became_active":"2024-09-14T11:06:41.906528+0000","last_became_peered":"2024-09-14T11:06:41.906528+0000","last_unstale":"2024-09-14T12:01:59.952584+0000","last_undegraded":"2024-09-14T12:01:59.952584+0000","last_fullsized":"2024-09-14T12:01:59.952584+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-14T12:01:59.952493+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-14T12:01:59.952493+0000","last_clean_scrub_stamp":"2024-09-14T12:01:59.952493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:37.534736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"263'49","reported_seq":199,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:52.783772+0000","last_change":"2024-09-14T12:01:52.783772+0000","last_active":"2024-09-14T12:01:52.783772+0000","last_peered":"2024-09-14T12:01:52.783772+0000","last_clean":"2024-09-14T12:01:52.783772+0000","last_became_active":"2024-09-14T11:02:34.869154+0000","last_became_peered":"2024-09-14T11:02:34.869154+0000","last_unstale":"2024-09-14T12:01:52.783772+0000","last_undegraded":"2024-09-14T12:01:52.783772+0000","last_fullsized":"2024-09-14T12:01:52.783772+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'49","last_scrub_stamp":"2024-09-14T12:01:52.783668+0000","last_deep_scrub":"263'49","last_deep_scrub_stamp":"2024-09-14T12:01:52.783668+0000","last_clean_scrub_stamp":"2024-09-14T12:01:52.783668+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:21.022547+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":272,"num_write":122,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:10.613230+0000","last_change":"2024-09-14T12:02:10.613125+0000","last_active":"2024-09-14T12:02:10.613230+0000","last_peered":"2024-09-14T12:02:10.613230+0000","last_clean":"2024-09-14T12:02:10.613230+0000","last_became_active":"2024-09-14T11:25:20.208992+0000","last_became_peered":"2024-09-14T11:25:20.208992+0000","last_unstale":"2024-09-14T12:02:10.613230+0000","last_undegraded":"2024-09-14T12:02:10.613230+0000","last_fullsized":"2024-09-14T12:02:10.613230+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:10.612998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:10.612998+0000","last_clean_scrub_stamp":"2024-09-14T12:02:10.612998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:58.370057+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"263'5","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:23.581992+0000","last_change":"2024-09-14T12:02:23.581992+0000","last_active":"2024-09-14T12:02:23.581992+0000","last_peered":"2024-09-14T12:02:23.581992+0000","last_clean":"2024-09-14T12:02:23.581992+0000","last_became_active":"2024-09-14T11:06:45.985518+0000","last_became_peered":"2024-09-14T11:06:45.985518+0000","last_unstale":"2024-09-14T12:02:23.581992+0000","last_undegraded":"2024-09-14T12:02:23.581992+0000","last_fullsized":"2024-09-14T12:02:23.581992+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T12:02:23.581898+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T12:02:23.581898+0000","last_clean_scrub_stamp":"2024-09-14T12:02:23.581898+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:23.519228+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"263'3","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:16.657970+0000","last_change":"2024-09-14T12:02:16.657970+0000","last_active":"2024-09-14T12:02:16.657970+0000","last_peered":"2024-09-14T12:02:16.657970+0000","last_clean":"2024-09-14T12:02:16.657970+0000","last_became_active":"2024-09-14T11:06:41.914346+0000","last_became_peered":"2024-09-14T11:06:41.914346+0000","last_unstale":"2024-09-14T12:02:16.657970+0000","last_undegraded":"2024-09-14T12:02:16.657970+0000","last_fullsized":"2024-09-14T12:02:16.657970+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:02:16.657881+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:02:16.657881+0000","last_clean_scrub_stamp":"2024-09-14T12:02:16.657881+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:53.958965+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"263'33","reported_seq":153,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:12.643498+0000","last_change":"2024-09-14T12:02:12.643498+0000","last_active":"2024-09-14T12:02:12.643498+0000","last_peered":"2024-09-14T12:02:12.643498+0000","last_clean":"2024-09-14T12:02:12.643498+0000","last_became_active":"2024-09-14T11:02:34.880066+0000","last_became_peered":"2024-09-14T11:02:34.880066+0000","last_unstale":"2024-09-14T12:02:12.643498+0000","last_undegraded":"2024-09-14T12:02:12.643498+0000","last_fullsized":"2024-09-14T12:02:12.643498+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'33","last_scrub_stamp":"2024-09-14T12:02:12.643368+0000","last_deep_scrub":"263'33","last_deep_scrub_stamp":"2024-09-14T12:02:12.643368+0000","last_clean_scrub_stamp":"2024-09-14T12:02:12.643368+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:05.743078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":165,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:17.997711+0000","last_change":"2024-09-14T12:02:17.997711+0000","last_active":"2024-09-14T12:02:17.997711+0000","last_peered":"2024-09-14T12:02:17.997711+0000","last_clean":"2024-09-14T12:02:17.997711+0000","last_became_active":"2024-09-14T11:25:20.208291+0000","last_became_peered":"2024-09-14T11:25:20.208291+0000","last_unstale":"2024-09-14T12:02:17.997711+0000","last_undegraded":"2024-09-14T12:02:17.997711+0000","last_fullsized":"2024-09-14T12:02:17.997711+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:17.997625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:17.997625+0000","last_clean_scrub_stamp":"2024-09-14T12:02:17.997625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:22.806458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"260'3","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:03.897966+0000","last_change":"2024-09-14T12:02:03.897966+0000","last_active":"2024-09-14T12:02:03.897966+0000","last_peered":"2024-09-14T12:02:03.897966+0000","last_clean":"2024-09-14T12:02:03.897966+0000","last_became_active":"2024-09-14T11:06:45.988268+0000","last_became_peered":"2024-09-14T11:06:45.988268+0000","last_unstale":"2024-09-14T12:02:03.897966+0000","last_undegraded":"2024-09-14T12:02:03.897966+0000","last_fullsized":"2024-09-14T12:02:03.897966+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T12:02:03.897879+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T12:02:03.897879+0000","last_clean_scrub_stamp":"2024-09-14T12:02:03.897879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:18.891047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:03.839558+0000","last_change":"2024-09-14T12:02:03.839558+0000","last_active":"2024-09-14T12:02:03.839558+0000","last_peered":"2024-09-14T12:02:03.839558+0000","last_clean":"2024-09-14T12:02:03.839558+0000","last_became_active":"2024-09-14T11:06:41.909915+0000","last_became_peered":"2024-09-14T11:06:41.909915+0000","last_unstale":"2024-09-14T12:02:03.839558+0000","last_undegraded":"2024-09-14T12:02:03.839558+0000","last_fullsized":"2024-09-14T12:02:03.839558+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:03.839467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:03.839467+0000","last_clean_scrub_stamp":"2024-09-14T12:02:03.839467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:27.313760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"263'21","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:11.661293+0000","last_change":"2024-09-14T12:02:11.661293+0000","last_active":"2024-09-14T12:02:11.661293+0000","last_peered":"2024-09-14T12:02:11.661293+0000","last_clean":"2024-09-14T12:02:11.661293+0000","last_became_active":"2024-09-14T11:02:34.877791+0000","last_became_peered":"2024-09-14T11:02:34.877791+0000","last_unstale":"2024-09-14T12:02:11.661293+0000","last_undegraded":"2024-09-14T12:02:11.661293+0000","last_fullsized":"2024-09-14T12:02:11.661293+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'21","last_scrub_stamp":"2024-09-14T12:02:11.661188+0000","last_deep_scrub":"263'21","last_deep_scrub_stamp":"2024-09-14T12:02:11.661188+0000","last_clean_scrub_stamp":"2024-09-14T12:02:11.661188+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:34.084256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":103,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:30.622744+0000","last_change":"2024-09-14T12:02:30.622744+0000","last_active":"2024-09-14T12:02:30.622744+0000","last_peered":"2024-09-14T12:02:30.622744+0000","last_clean":"2024-09-14T12:02:30.622744+0000","last_became_active":"2024-09-14T11:25:20.208495+0000","last_became_peered":"2024-09-14T11:25:20.208495+0000","last_unstale":"2024-09-14T12:02:30.622744+0000","last_undegraded":"2024-09-14T12:02:30.622744+0000","last_fullsized":"2024-09-14T12:02:30.622744+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:30.622649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:30.622649+0000","last_clean_scrub_stamp":"2024-09-14T12:02:30.622649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:19.480252+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"263'3","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:01.969507+0000","last_change":"2024-09-14T12:02:01.969507+0000","last_active":"2024-09-14T12:02:01.969507+0000","last_peered":"2024-09-14T12:02:01.969507+0000","last_clean":"2024-09-14T12:02:01.969507+0000","last_became_active":"2024-09-14T11:06:45.986990+0000","last_became_peered":"2024-09-14T11:06:45.986990+0000","last_unstale":"2024-09-14T12:02:01.969507+0000","last_undegraded":"2024-09-14T12:02:01.969507+0000","last_fullsized":"2024-09-14T12:02:01.969507+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:02:01.969414+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:02:01.969414+0000","last_clean_scrub_stamp":"2024-09-14T12:02:01.969414+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:59.943974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:54.673980+0000","last_change":"2024-09-14T12:01:54.673980+0000","last_active":"2024-09-14T12:01:54.673980+0000","last_peered":"2024-09-14T12:01:54.673980+0000","last_clean":"2024-09-14T12:01:54.673980+0000","last_became_active":"2024-09-14T11:06:41.915372+0000","last_became_peered":"2024-09-14T11:06:41.915372+0000","last_unstale":"2024-09-14T12:01:54.673980+0000","last_undegraded":"2024-09-14T12:01:54.673980+0000","last_fullsized":"2024-09-14T12:01:54.673980+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:54.673887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:54.673887+0000","last_clean_scrub_stamp":"2024-09-14T12:01:54.673887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:46.613871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"263'13","reported_seq":104,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:54.829095+0000","last_change":"2024-09-14T12:01:54.829095+0000","last_active":"2024-09-14T12:01:54.829095+0000","last_peered":"2024-09-14T12:01:54.829095+0000","last_clean":"2024-09-14T12:01:54.829095+0000","last_became_active":"2024-09-14T11:02:34.879002+0000","last_became_peered":"2024-09-14T11:02:34.879002+0000","last_unstale":"2024-09-14T12:01:54.829095+0000","last_undegraded":"2024-09-14T12:01:54.829095+0000","last_fullsized":"2024-09-14T12:01:54.829095+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-14T12:01:54.829007+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-14T12:01:54.829007+0000","last_clean_scrub_stamp":"2024-09-14T12:01:54.829007+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:39.245401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":56,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'347","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.278191+0000","last_change":"2024-09-14T12:01:32.278080+0000","last_active":"2024-09-14T12:01:32.278191+0000","last_peered":"2024-09-14T12:01:32.278191+0000","last_clean":"2024-09-14T12:01:32.278191+0000","last_became_active":"2024-09-14T10:46:44.331827+0000","last_became_peered":"2024-09-14T10:46:44.331827+0000","last_unstale":"2024-09-14T12:01:32.278191+0000","last_undegraded":"2024-09-14T12:01:32.278191+0000","last_fullsized":"2024-09-14T12:01:32.278191+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-09-14T12:01:32.277953+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-09-14T12:01:32.277953+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.277953+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:37.814804+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":808,"num_read_kb":10519,"num_write":1133,"num_write_kb":31597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"263'509","reported_seq":2212,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.715793+0000","last_change":"2024-09-14T12:01:37.715729+0000","last_active":"2024-09-14T12:01:37.715793+0000","last_peered":"2024-09-14T12:01:37.715793+0000","last_clean":"2024-09-14T12:01:37.715793+0000","last_became_active":"2024-09-14T10:46:46.340949+0000","last_became_peered":"2024-09-14T10:46:46.340949+0000","last_unstale":"2024-09-14T12:01:37.715793+0000","last_undegraded":"2024-09-14T12:01:37.715793+0000","last_fullsized":"2024-09-14T12:01:37.715793+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'509","last_scrub_stamp":"2024-09-14T12:01:37.715648+0000","last_deep_scrub":"263'509","last_deep_scrub_stamp":"2024-09-14T12:01:37.715648+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.715648+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:12.260760+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2834,"num_read_kb":2670,"num_write":604,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"263'354","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.242897+0000","last_change":"2024-09-14T12:01:38.242836+0000","last_active":"2024-09-14T12:01:38.242897+0000","last_peered":"2024-09-14T12:01:38.242897+0000","last_clean":"2024-09-14T12:01:38.242897+0000","last_became_active":"2024-09-14T10:46:44.332997+0000","last_became_peered":"2024-09-14T10:46:44.332997+0000","last_unstale":"2024-09-14T12:01:38.242897+0000","last_undegraded":"2024-09-14T12:01:38.242897+0000","last_fullsized":"2024-09-14T12:01:38.242897+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'354","last_scrub_stamp":"2024-09-14T12:01:38.242731+0000","last_deep_scrub":"263'354","last_deep_scrub_stamp":"2024-09-14T12:01:38.242731+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.242731+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:20.221917+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":584,"num_read_kb":4891,"num_write":1057,"num_write_kb":34401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"263'668","reported_seq":2323,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.842340+0000","last_change":"2024-09-14T12:01:45.842271+0000","last_active":"2024-09-14T12:01:45.842340+0000","last_peered":"2024-09-14T12:01:45.842340+0000","last_clean":"2024-09-14T12:01:45.842340+0000","last_became_active":"2024-09-14T10:46:46.340612+0000","last_became_peered":"2024-09-14T10:46:46.340612+0000","last_unstale":"2024-09-14T12:01:45.842340+0000","last_undegraded":"2024-09-14T12:01:45.842340+0000","last_fullsized":"2024-09-14T12:01:45.842340+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'668","last_scrub_stamp":"2024-09-14T12:01:45.842183+0000","last_deep_scrub":"263'668","last_deep_scrub_stamp":"2024-09-14T12:01:45.842183+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.842183+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":600,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:23.087207+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3359,"num_read_kb":3045,"num_write":872,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"263'315","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.268744+0000","last_change":"2024-09-14T12:01:37.268681+0000","last_active":"2024-09-14T12:01:37.268744+0000","last_peered":"2024-09-14T12:01:37.268744+0000","last_clean":"2024-09-14T12:01:37.268744+0000","last_became_active":"2024-09-14T10:46:44.320254+0000","last_became_peered":"2024-09-14T10:46:44.320254+0000","last_unstale":"2024-09-14T12:01:37.268744+0000","last_undegraded":"2024-09-14T12:01:37.268744+0000","last_fullsized":"2024-09-14T12:01:37.268744+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'315","last_scrub_stamp":"2024-09-14T12:01:37.268548+0000","last_deep_scrub":"263'315","last_deep_scrub_stamp":"2024-09-14T12:01:37.268548+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.268548+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:39.392560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":578,"num_read_kb":18043,"num_write":1147,"num_write_kb":30368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"263'456","reported_seq":1894,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:50.894023+0000","last_change":"2024-09-14T12:01:50.894023+0000","last_active":"2024-09-14T12:01:50.894023+0000","last_peered":"2024-09-14T12:01:50.894023+0000","last_clean":"2024-09-14T12:01:50.894023+0000","last_became_active":"2024-09-14T10:46:46.337092+0000","last_became_peered":"2024-09-14T10:46:46.337092+0000","last_unstale":"2024-09-14T12:01:50.894023+0000","last_undegraded":"2024-09-14T12:01:50.894023+0000","last_fullsized":"2024-09-14T12:01:50.894023+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'456","last_scrub_stamp":"2024-09-14T12:01:50.893935+0000","last_deep_scrub":"263'456","last_deep_scrub_stamp":"2024-09-14T12:01:50.893935+0000","last_clean_scrub_stamp":"2024-09-14T12:01:50.893935+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:36.400620+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2407,"num_read_kb":2236,"num_write":590,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"263'320","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.828433+0000","last_change":"2024-09-14T12:01:30.828433+0000","last_active":"2024-09-14T12:01:30.828433+0000","last_peered":"2024-09-14T12:01:30.828433+0000","last_clean":"2024-09-14T12:01:30.828433+0000","last_became_active":"2024-09-14T10:46:44.321098+0000","last_became_peered":"2024-09-14T10:46:44.321098+0000","last_unstale":"2024-09-14T12:01:30.828433+0000","last_undegraded":"2024-09-14T12:01:30.828433+0000","last_fullsized":"2024-09-14T12:01:30.828433+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'320","last_scrub_stamp":"2024-09-14T12:01:30.828329+0000","last_deep_scrub":"263'320","last_deep_scrub_stamp":"2024-09-14T12:01:30.828329+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.828329+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:12.296951+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":621,"num_read_kb":93491,"num_write":1039,"num_write_kb":33828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"263'564","reported_seq":2232,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.576450+0000","last_change":"2024-09-14T12:01:42.576372+0000","last_active":"2024-09-14T12:01:42.576450+0000","last_peered":"2024-09-14T12:01:42.576450+0000","last_clean":"2024-09-14T12:01:42.576450+0000","last_became_active":"2024-09-14T10:46:46.337883+0000","last_became_peered":"2024-09-14T10:46:46.337883+0000","last_unstale":"2024-09-14T12:01:42.576450+0000","last_undegraded":"2024-09-14T12:01:42.576450+0000","last_fullsized":"2024-09-14T12:01:42.576450+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'564","last_scrub_stamp":"2024-09-14T12:01:42.576290+0000","last_deep_scrub":"263'564","last_deep_scrub_stamp":"2024-09-14T12:01:42.576290+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.576290+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":500,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:57.196401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3147,"num_read_kb":2923,"num_write":727,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"263'377","reported_seq":1065,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.257994+0000","last_change":"2024-09-14T12:01:33.257931+0000","last_active":"2024-09-14T12:01:33.257994+0000","last_peered":"2024-09-14T12:01:33.257994+0000","last_clean":"2024-09-14T12:01:33.257994+0000","last_became_active":"2024-09-14T10:46:44.324768+0000","last_became_peered":"2024-09-14T10:46:44.324768+0000","last_unstale":"2024-09-14T12:01:33.257994+0000","last_undegraded":"2024-09-14T12:01:33.257994+0000","last_fullsized":"2024-09-14T12:01:33.257994+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-14T12:01:33.257829+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-14T12:01:33.257829+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.257829+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:41.419490+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":706,"num_read_kb":82703,"num_write":1285,"num_write_kb":36007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"263'448","reported_seq":2083,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.239959+0000","last_change":"2024-09-14T12:01:41.239959+0000","last_active":"2024-09-14T12:01:41.239959+0000","last_peered":"2024-09-14T12:01:41.239959+0000","last_clean":"2024-09-14T12:01:41.239959+0000","last_became_active":"2024-09-14T10:46:46.338973+0000","last_became_peered":"2024-09-14T10:46:46.338973+0000","last_unstale":"2024-09-14T12:01:41.239959+0000","last_undegraded":"2024-09-14T12:01:41.239959+0000","last_fullsized":"2024-09-14T12:01:41.239959+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'448","last_scrub_stamp":"2024-09-14T12:01:41.239865+0000","last_deep_scrub":"263'448","last_deep_scrub_stamp":"2024-09-14T12:01:41.239865+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.239865+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:15.050347+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2500,"num_read_kb":2382,"num_write":507,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"263'357","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.825671+0000","last_change":"2024-09-14T12:01:29.825614+0000","last_active":"2024-09-14T12:01:29.825671+0000","last_peered":"2024-09-14T12:01:29.825671+0000","last_clean":"2024-09-14T12:01:29.825671+0000","last_became_active":"2024-09-14T10:46:44.319801+0000","last_became_peered":"2024-09-14T10:46:44.319801+0000","last_unstale":"2024-09-14T12:01:29.825671+0000","last_undegraded":"2024-09-14T12:01:29.825671+0000","last_fullsized":"2024-09-14T12:01:29.825671+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'357","last_scrub_stamp":"2024-09-14T12:01:29.825517+0000","last_deep_scrub":"263'357","last_deep_scrub_stamp":"2024-09-14T12:01:29.825517+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.825517+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:51:15.006775+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":563,"num_read_kb":13023,"num_write":1154,"num_write_kb":36371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"263'583","reported_seq":2168,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.269644+0000","last_change":"2024-09-14T12:01:39.269579+0000","last_active":"2024-09-14T12:01:39.269644+0000","last_peered":"2024-09-14T12:01:39.269644+0000","last_clean":"2024-09-14T12:01:39.269644+0000","last_became_active":"2024-09-14T10:46:46.350776+0000","last_became_peered":"2024-09-14T10:46:46.350776+0000","last_unstale":"2024-09-14T12:01:39.269644+0000","last_undegraded":"2024-09-14T12:01:39.269644+0000","last_fullsized":"2024-09-14T12:01:39.269644+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'583","last_scrub_stamp":"2024-09-14T12:01:39.269492+0000","last_deep_scrub":"263'583","last_deep_scrub_stamp":"2024-09-14T12:01:39.269492+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.269492+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:13.396139+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3080,"num_read_kb":2791,"num_write":782,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":908,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"263'282","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.275254+0000","last_change":"2024-09-14T12:01:29.275115+0000","last_active":"2024-09-14T12:01:29.275254+0000","last_peered":"2024-09-14T12:01:29.275254+0000","last_clean":"2024-09-14T12:01:29.275254+0000","last_became_active":"2024-09-14T10:46:44.327650+0000","last_became_peered":"2024-09-14T10:46:44.327650+0000","last_unstale":"2024-09-14T12:01:29.275254+0000","last_undegraded":"2024-09-14T12:01:29.275254+0000","last_fullsized":"2024-09-14T12:01:29.275254+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'282","last_scrub_stamp":"2024-09-14T12:01:29.274975+0000","last_deep_scrub":"263'282","last_deep_scrub_stamp":"2024-09-14T12:01:29.274975+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.274975+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:44.277815+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":6055,"num_write":990,"num_write_kb":41392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"263'569","reported_seq":2326,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.915055+0000","last_change":"2024-09-14T12:01:39.914997+0000","last_active":"2024-09-14T12:01:39.915055+0000","last_peered":"2024-09-14T12:01:39.915055+0000","last_clean":"2024-09-14T12:01:39.915055+0000","last_became_active":"2024-09-14T10:46:46.341474+0000","last_became_peered":"2024-09-14T10:46:46.341474+0000","last_unstale":"2024-09-14T12:01:39.915055+0000","last_undegraded":"2024-09-14T12:01:39.915055+0000","last_fullsized":"2024-09-14T12:01:39.915055+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'569","last_scrub_stamp":"2024-09-14T12:01:39.914912+0000","last_deep_scrub":"263'569","last_deep_scrub_stamp":"2024-09-14T12:01:39.914912+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.914912+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:23.529357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3094,"num_read_kb":2877,"num_write":684,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"263'343","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.312096+0000","last_change":"2024-09-14T12:01:36.312033+0000","last_active":"2024-09-14T12:01:36.312096+0000","last_peered":"2024-09-14T12:01:36.312096+0000","last_clean":"2024-09-14T12:01:36.312096+0000","last_became_active":"2024-09-14T10:46:44.334630+0000","last_became_peered":"2024-09-14T10:46:44.334630+0000","last_unstale":"2024-09-14T12:01:36.312096+0000","last_undegraded":"2024-09-14T12:01:36.312096+0000","last_fullsized":"2024-09-14T12:01:36.312096+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-14T12:01:36.311932+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-14T12:01:36.311932+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.311932+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:31.732885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":627,"num_read_kb":14860,"num_write":1052,"num_write_kb":34853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"263'827","reported_seq":2419,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:47.398338+0000","last_change":"2024-09-14T12:01:47.398279+0000","last_active":"2024-09-14T12:01:47.398338+0000","last_peered":"2024-09-14T12:01:47.398338+0000","last_clean":"2024-09-14T12:01:47.398338+0000","last_became_active":"2024-09-14T10:46:46.350391+0000","last_became_peered":"2024-09-14T10:46:46.350391+0000","last_unstale":"2024-09-14T12:01:47.398338+0000","last_undegraded":"2024-09-14T12:01:47.398338+0000","last_fullsized":"2024-09-14T12:01:47.398338+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'827","last_scrub_stamp":"2024-09-14T12:01:47.398188+0000","last_deep_scrub":"263'827","last_deep_scrub_stamp":"2024-09-14T12:01:47.398188+0000","last_clean_scrub_stamp":"2024-09-14T12:01:47.398188+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:51.317531+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3863,"num_read_kb":3486,"num_write":1075,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"263'750","reported_seq":2177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.757216+0000","last_change":"2024-09-14T12:01:42.757216+0000","last_active":"2024-09-14T12:01:42.757216+0000","last_peered":"2024-09-14T12:01:42.757216+0000","last_clean":"2024-09-14T12:01:42.757216+0000","last_became_active":"2024-09-14T10:46:46.335749+0000","last_became_peered":"2024-09-14T10:46:46.335749+0000","last_unstale":"2024-09-14T12:01:42.757216+0000","last_undegraded":"2024-09-14T12:01:42.757216+0000","last_fullsized":"2024-09-14T12:01:42.757216+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'750","last_scrub_stamp":"2024-09-14T12:01:42.757030+0000","last_deep_scrub":"263'750","last_deep_scrub_stamp":"2024-09-14T12:01:42.757030+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.757030+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:49.714436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3617,"num_read_kb":3235,"num_write":1004,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"263'306","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.685720+0000","last_change":"2024-09-14T12:01:29.685602+0000","last_active":"2024-09-14T12:01:29.685720+0000","last_peered":"2024-09-14T12:01:29.685720+0000","last_clean":"2024-09-14T12:01:29.685720+0000","last_became_active":"2024-09-14T10:46:44.316741+0000","last_became_peered":"2024-09-14T10:46:44.316741+0000","last_unstale":"2024-09-14T12:01:29.685720+0000","last_undegraded":"2024-09-14T12:01:29.685720+0000","last_fullsized":"2024-09-14T12:01:29.685720+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'306","last_scrub_stamp":"2024-09-14T12:01:29.685467+0000","last_deep_scrub":"263'306","last_deep_scrub_stamp":"2024-09-14T12:01:29.685467+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.685467+0000","objects_scrubbed":4,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:18.640343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133671,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":507,"num_read_kb":26974,"num_write":959,"num_write_kb":33080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"263'805","reported_seq":2507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.299296+0000","last_change":"2024-09-14T12:01:38.299296+0000","last_active":"2024-09-14T12:01:38.299296+0000","last_peered":"2024-09-14T12:01:38.299296+0000","last_clean":"2024-09-14T12:01:38.299296+0000","last_became_active":"2024-09-14T10:46:46.345709+0000","last_became_peered":"2024-09-14T10:46:46.345709+0000","last_unstale":"2024-09-14T12:01:38.299296+0000","last_undegraded":"2024-09-14T12:01:38.299296+0000","last_fullsized":"2024-09-14T12:01:38.299296+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'805","last_scrub_stamp":"2024-09-14T12:01:38.299204+0000","last_deep_scrub":"263'805","last_deep_scrub_stamp":"2024-09-14T12:01:38.299204+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.299204+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:24.140873+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3947,"num_read_kb":3606,"num_write":1038,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"263'367","reported_seq":1016,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.285396+0000","last_change":"2024-09-14T12:01:28.285316+0000","last_active":"2024-09-14T12:01:28.285396+0000","last_peered":"2024-09-14T12:01:28.285396+0000","last_clean":"2024-09-14T12:01:28.285396+0000","last_became_active":"2024-09-14T10:46:44.331599+0000","last_became_peered":"2024-09-14T10:46:44.331599+0000","last_unstale":"2024-09-14T12:01:28.285396+0000","last_undegraded":"2024-09-14T12:01:28.285396+0000","last_fullsized":"2024-09-14T12:01:28.285396+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-09-14T12:01:28.285209+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-09-14T12:01:28.285209+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.285209+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:29.491140+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":622,"num_read_kb":2368,"num_write":1092,"num_write_kb":34113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"263'400","reported_seq":1971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.683623+0000","last_change":"2024-09-14T12:01:36.683566+0000","last_active":"2024-09-14T12:01:36.683623+0000","last_peered":"2024-09-14T12:01:36.683623+0000","last_clean":"2024-09-14T12:01:36.683623+0000","last_became_active":"2024-09-14T10:46:46.350525+0000","last_became_peered":"2024-09-14T10:46:46.350525+0000","last_unstale":"2024-09-14T12:01:36.683623+0000","last_undegraded":"2024-09-14T12:01:36.683623+0000","last_fullsized":"2024-09-14T12:01:36.683623+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'400","last_scrub_stamp":"2024-09-14T12:01:36.683491+0000","last_deep_scrub":"263'400","last_deep_scrub_stamp":"2024-09-14T12:01:36.683491+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.683491+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:32.999277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2275,"num_read_kb":2173,"num_write":451,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"263'369","reported_seq":1054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.276045+0000","last_change":"2024-09-14T12:01:30.275983+0000","last_active":"2024-09-14T12:01:30.276045+0000","last_peered":"2024-09-14T12:01:30.276045+0000","last_clean":"2024-09-14T12:01:30.276045+0000","last_became_active":"2024-09-14T10:46:44.339871+0000","last_became_peered":"2024-09-14T10:46:44.339871+0000","last_unstale":"2024-09-14T12:01:30.276045+0000","last_undegraded":"2024-09-14T12:01:30.276045+0000","last_fullsized":"2024-09-14T12:01:30.276045+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'369","last_scrub_stamp":"2024-09-14T12:01:30.275862+0000","last_deep_scrub":"263'369","last_deep_scrub_stamp":"2024-09-14T12:01:30.275862+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.275862+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:27.494575+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":774,"num_read_kb":19273,"num_write":1249,"num_write_kb":53136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"263'1157","reported_seq":2724,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.847949+0000","last_change":"2024-09-14T12:01:41.847888+0000","last_active":"2024-09-14T12:01:41.847949+0000","last_peered":"2024-09-14T12:01:41.847949+0000","last_clean":"2024-09-14T12:01:41.847949+0000","last_became_active":"2024-09-14T10:46:46.349649+0000","last_became_peered":"2024-09-14T10:46:46.349649+0000","last_unstale":"2024-09-14T12:01:41.847949+0000","last_undegraded":"2024-09-14T12:01:41.847949+0000","last_fullsized":"2024-09-14T12:01:41.847949+0000","mapping_epoch":28,"log_start":"263'1100","ondisk_log_start":"263'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1157","last_scrub_stamp":"2024-09-14T12:01:41.847805+0000","last_deep_scrub":"263'1157","last_deep_scrub_stamp":"2024-09-14T12:01:41.847805+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.847805+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":1100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:14.558545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5238,"num_read_kb":4651,"num_write":1596,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"263'343","reported_seq":1086,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.296535+0000","last_change":"2024-09-14T12:01:34.296459+0000","last_active":"2024-09-14T12:01:34.296535+0000","last_peered":"2024-09-14T12:01:34.296535+0000","last_clean":"2024-09-14T12:01:34.296535+0000","last_became_active":"2024-09-14T10:46:44.326645+0000","last_became_peered":"2024-09-14T10:46:44.326645+0000","last_unstale":"2024-09-14T12:01:34.296535+0000","last_undegraded":"2024-09-14T12:01:34.296535+0000","last_fullsized":"2024-09-14T12:01:34.296535+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-14T12:01:34.296326+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-14T12:01:34.296326+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.296326+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:34.490843+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":923,"num_read_kb":14272,"num_write":1148,"num_write_kb":16465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"263'966","reported_seq":2520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:46.377275+0000","last_change":"2024-09-14T12:01:46.377275+0000","last_active":"2024-09-14T12:01:46.377275+0000","last_peered":"2024-09-14T12:01:46.377275+0000","last_clean":"2024-09-14T12:01:46.377275+0000","last_became_active":"2024-09-14T10:46:46.347420+0000","last_became_peered":"2024-09-14T10:46:46.347420+0000","last_unstale":"2024-09-14T12:01:46.377275+0000","last_undegraded":"2024-09-14T12:01:46.377275+0000","last_fullsized":"2024-09-14T12:01:46.377275+0000","mapping_epoch":28,"log_start":"263'900","ondisk_log_start":"263'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'966","last_scrub_stamp":"2024-09-14T12:01:46.377190+0000","last_deep_scrub":"263'966","last_deep_scrub_stamp":"2024-09-14T12:01:46.377190+0000","last_clean_scrub_stamp":"2024-09-14T12:01:46.377190+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":900,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:08.514127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5046,"num_read_kb":4563,"num_write":1374,"num_write_kb":542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"263'377","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.755590+0000","last_change":"2024-09-14T12:01:34.755520+0000","last_active":"2024-09-14T12:01:34.755590+0000","last_peered":"2024-09-14T12:01:34.755590+0000","last_clean":"2024-09-14T12:01:34.755590+0000","last_became_active":"2024-09-14T10:46:44.319146+0000","last_became_peered":"2024-09-14T10:46:44.319146+0000","last_unstale":"2024-09-14T12:01:34.755590+0000","last_undegraded":"2024-09-14T12:01:34.755590+0000","last_fullsized":"2024-09-14T12:01:34.755590+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-14T12:01:34.755410+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-14T12:01:34.755410+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.755410+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:11.914432+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":594,"num_read_kb":40910,"num_write":1073,"num_write_kb":34714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"263'375","reported_seq":1901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.707478+0000","last_change":"2024-09-14T12:01:35.707415+0000","last_active":"2024-09-14T12:01:35.707478+0000","last_peered":"2024-09-14T12:01:35.707478+0000","last_clean":"2024-09-14T12:01:35.707478+0000","last_became_active":"2024-09-14T10:46:46.339710+0000","last_became_peered":"2024-09-14T10:46:46.339710+0000","last_unstale":"2024-09-14T12:01:35.707478+0000","last_undegraded":"2024-09-14T12:01:35.707478+0000","last_fullsized":"2024-09-14T12:01:35.707478+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'375","last_scrub_stamp":"2024-09-14T12:01:35.707315+0000","last_deep_scrub":"263'375","last_deep_scrub_stamp":"2024-09-14T12:01:35.707315+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.707315+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:14.828586+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2075,"num_read_kb":1993,"num_write":416,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"263'322","reported_seq":1051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.762601+0000","last_change":"2024-09-14T12:01:33.762529+0000","last_active":"2024-09-14T12:01:33.762601+0000","last_peered":"2024-09-14T12:01:33.762601+0000","last_clean":"2024-09-14T12:01:33.762601+0000","last_became_active":"2024-09-14T10:46:44.317895+0000","last_became_peered":"2024-09-14T10:46:44.317895+0000","last_unstale":"2024-09-14T12:01:33.762601+0000","last_undegraded":"2024-09-14T12:01:33.762601+0000","last_fullsized":"2024-09-14T12:01:33.762601+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'322","last_scrub_stamp":"2024-09-14T12:01:33.762405+0000","last_deep_scrub":"263'322","last_deep_scrub_stamp":"2024-09-14T12:01:33.762405+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.762405+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:37.306350+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":939,"num_read_kb":22981,"num_write":1007,"num_write_kb":27989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"263'133","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:51.258555+0000","last_change":"2024-09-14T12:01:51.258555+0000","last_active":"2024-09-14T12:01:51.258555+0000","last_peered":"2024-09-14T12:01:51.258555+0000","last_clean":"2024-09-14T12:01:51.258555+0000","last_became_active":"2024-09-14T10:46:54.374769+0000","last_became_peered":"2024-09-14T10:46:54.374769+0000","last_unstale":"2024-09-14T12:01:51.258555+0000","last_undegraded":"2024-09-14T12:01:51.258555+0000","last_fullsized":"2024-09-14T12:01:51.258555+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-14T12:01:51.258466+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-14T12:01:51.258466+0000","last_clean_scrub_stamp":"2024-09-14T12:01:51.258466+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:21.567863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":165,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"263'434","reported_seq":1993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.832518+0000","last_change":"2024-09-14T12:01:40.832518+0000","last_active":"2024-09-14T12:01:40.832518+0000","last_peered":"2024-09-14T12:01:40.832518+0000","last_clean":"2024-09-14T12:01:40.832518+0000","last_became_active":"2024-09-14T10:46:46.340169+0000","last_became_peered":"2024-09-14T10:46:46.340169+0000","last_unstale":"2024-09-14T12:01:40.832518+0000","last_undegraded":"2024-09-14T12:01:40.832518+0000","last_fullsized":"2024-09-14T12:01:40.832518+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'434","last_scrub_stamp":"2024-09-14T12:01:40.832431+0000","last_deep_scrub":"263'434","last_deep_scrub_stamp":"2024-09-14T12:01:40.832431+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.832431+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:14.426399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2291,"num_read_kb":2165,"num_write":484,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"263'388","reported_seq":1041,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.804018+0000","last_change":"2024-09-14T12:01:32.803949+0000","last_active":"2024-09-14T12:01:32.804018+0000","last_peered":"2024-09-14T12:01:32.804018+0000","last_clean":"2024-09-14T12:01:32.804018+0000","last_became_active":"2024-09-14T10:47:18.793917+0000","last_became_peered":"2024-09-14T10:47:18.793917+0000","last_unstale":"2024-09-14T12:01:32.804018+0000","last_undegraded":"2024-09-14T12:01:32.804018+0000","last_fullsized":"2024-09-14T12:01:32.804018+0000","mapping_epoch":39,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'388","last_scrub_stamp":"2024-09-14T12:01:32.803811+0000","last_deep_scrub":"263'388","last_deep_scrub_stamp":"2024-09-14T12:01:32.803811+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.803811+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:40.563517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":723,"num_read_kb":48707,"num_write":1316,"num_write_kb":50304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:53.836847+0000","last_change":"2024-09-14T12:01:53.836847+0000","last_active":"2024-09-14T12:01:53.836847+0000","last_peered":"2024-09-14T12:01:53.836847+0000","last_clean":"2024-09-14T12:01:53.836847+0000","last_became_active":"2024-09-14T10:46:48.356776+0000","last_became_peered":"2024-09-14T10:46:48.356776+0000","last_unstale":"2024-09-14T12:01:53.836847+0000","last_undegraded":"2024-09-14T12:01:53.836847+0000","last_fullsized":"2024-09-14T12:01:53.836847+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:53.836757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:53.836757+0000","last_clean_scrub_stamp":"2024-09-14T12:01:53.836757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:22.747891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"263'358","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:54.575824+0000","last_change":"2024-09-14T12:01:54.575824+0000","last_active":"2024-09-14T12:01:54.575824+0000","last_peered":"2024-09-14T12:01:54.575824+0000","last_clean":"2024-09-14T12:01:54.575824+0000","last_became_active":"2024-09-14T10:46:50.359481+0000","last_became_peered":"2024-09-14T10:46:50.359481+0000","last_unstale":"2024-09-14T12:01:54.575824+0000","last_undegraded":"2024-09-14T12:01:54.575824+0000","last_fullsized":"2024-09-14T12:01:54.575824+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-09-14T12:01:54.575724+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-09-14T12:01:54.575724+0000","last_clean_scrub_stamp":"2024-09-14T12:01:54.575724+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:24.526696+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51669,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":564,"num_read_kb":1178,"num_write":444,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:46.606931+0000","last_change":"2024-09-14T12:01:46.606852+0000","last_active":"2024-09-14T12:01:46.606931+0000","last_peered":"2024-09-14T12:01:46.606931+0000","last_clean":"2024-09-14T12:01:46.606931+0000","last_became_active":"2024-09-14T10:46:52.372941+0000","last_became_peered":"2024-09-14T10:46:52.372941+0000","last_unstale":"2024-09-14T12:01:46.606931+0000","last_undegraded":"2024-09-14T12:01:46.606931+0000","last_fullsized":"2024-09-14T12:01:46.606931+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:46.606763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:46.606763+0000","last_clean_scrub_stamp":"2024-09-14T12:01:46.606763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:57.006977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"263'156","reported_seq":654,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:57.641119+0000","last_change":"2024-09-14T12:01:57.641016+0000","last_active":"2024-09-14T12:01:57.641119+0000","last_peered":"2024-09-14T12:01:57.641119+0000","last_clean":"2024-09-14T12:01:57.641119+0000","last_became_active":"2024-09-14T10:46:54.387445+0000","last_became_peered":"2024-09-14T10:46:54.387445+0000","last_unstale":"2024-09-14T12:01:57.641119+0000","last_undegraded":"2024-09-14T12:01:57.641119+0000","last_fullsized":"2024-09-14T12:01:57.641119+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'156","last_scrub_stamp":"2024-09-14T12:01:57.640905+0000","last_deep_scrub":"263'156","last_deep_scrub_stamp":"2024-09-14T12:01:57.640905+0000","last_clean_scrub_stamp":"2024-09-14T12:01:57.640905+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:04.004929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":80,"num_write":348,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"263'557","reported_seq":2286,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:46.891074+0000","last_change":"2024-09-14T12:01:46.891074+0000","last_active":"2024-09-14T12:01:46.891074+0000","last_peered":"2024-09-14T12:01:46.891074+0000","last_clean":"2024-09-14T12:01:46.891074+0000","last_became_active":"2024-09-14T10:46:46.340242+0000","last_became_peered":"2024-09-14T10:46:46.340242+0000","last_unstale":"2024-09-14T12:01:46.891074+0000","last_undegraded":"2024-09-14T12:01:46.891074+0000","last_fullsized":"2024-09-14T12:01:46.891074+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'557","last_scrub_stamp":"2024-09-14T12:01:46.890977+0000","last_deep_scrub":"263'557","last_deep_scrub_stamp":"2024-09-14T12:01:46.890977+0000","last_clean_scrub_stamp":"2024-09-14T12:01:46.890977+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:49.290795+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3138,"num_read_kb":2920,"num_write":702,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3295,"num_omap_keys":13,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"263'332","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.847264+0000","last_change":"2024-09-14T12:01:30.847264+0000","last_active":"2024-09-14T12:01:30.847264+0000","last_peered":"2024-09-14T12:01:30.847264+0000","last_clean":"2024-09-14T12:01:30.847264+0000","last_became_active":"2024-09-14T10:46:44.334757+0000","last_became_peered":"2024-09-14T10:46:44.334757+0000","last_unstale":"2024-09-14T12:01:30.847264+0000","last_undegraded":"2024-09-14T12:01:30.847264+0000","last_fullsized":"2024-09-14T12:01:30.847264+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'332","last_scrub_stamp":"2024-09-14T12:01:30.847120+0000","last_deep_scrub":"263'332","last_deep_scrub_stamp":"2024-09-14T12:01:30.847120+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.847120+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:08.535049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133691,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":630,"num_read_kb":20083,"num_write":1075,"num_write_kb":20918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.528073+0000","last_change":"2024-09-14T12:01:43.528005+0000","last_active":"2024-09-14T12:01:43.528073+0000","last_peered":"2024-09-14T12:01:43.528073+0000","last_clean":"2024-09-14T12:01:43.528073+0000","last_became_active":"2024-09-14T10:46:48.351825+0000","last_became_peered":"2024-09-14T10:46:48.351825+0000","last_unstale":"2024-09-14T12:01:43.528073+0000","last_undegraded":"2024-09-14T12:01:43.528073+0000","last_fullsized":"2024-09-14T12:01:43.528073+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:43.527908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:43.527908+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.527908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:37.108237+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"263'104","reported_seq":645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.647651+0000","last_change":"2024-09-14T12:01:43.647591+0000","last_active":"2024-09-14T12:01:43.647651+0000","last_peered":"2024-09-14T12:01:43.647651+0000","last_clean":"2024-09-14T12:01:43.647651+0000","last_became_active":"2024-09-14T10:46:50.360649+0000","last_became_peered":"2024-09-14T10:46:50.360649+0000","last_unstale":"2024-09-14T12:01:43.647651+0000","last_undegraded":"2024-09-14T12:01:43.647651+0000","last_fullsized":"2024-09-14T12:01:43.647651+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'104","last_scrub_stamp":"2024-09-14T12:01:43.647503+0000","last_deep_scrub":"263'104","last_deep_scrub_stamp":"2024-09-14T12:01:43.647503+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.647503+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:21.629132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:56.687801+0000","last_change":"2024-09-14T12:01:56.687801+0000","last_active":"2024-09-14T12:01:56.687801+0000","last_peered":"2024-09-14T12:01:56.687801+0000","last_clean":"2024-09-14T12:01:56.687801+0000","last_became_active":"2024-09-14T10:46:52.372770+0000","last_became_peered":"2024-09-14T10:46:52.372770+0000","last_unstale":"2024-09-14T12:01:56.687801+0000","last_undegraded":"2024-09-14T12:01:56.687801+0000","last_fullsized":"2024-09-14T12:01:56.687801+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:56.687704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:56.687704+0000","last_clean_scrub_stamp":"2024-09-14T12:01:56.687704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:38.741747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"263'144","reported_seq":660,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:56.812734+0000","last_change":"2024-09-14T12:01:56.812653+0000","last_active":"2024-09-14T12:01:56.812734+0000","last_peered":"2024-09-14T12:01:56.812734+0000","last_clean":"2024-09-14T12:01:56.812734+0000","last_became_active":"2024-09-14T10:46:54.389638+0000","last_became_peered":"2024-09-14T10:46:54.389638+0000","last_unstale":"2024-09-14T12:01:56.812734+0000","last_undegraded":"2024-09-14T12:01:56.812734+0000","last_fullsized":"2024-09-14T12:01:56.812734+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-14T12:01:56.812551+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-14T12:01:56.812551+0000","last_clean_scrub_stamp":"2024-09-14T12:01:56.812551+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:10.068600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":168,"num_write":356,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"263'452","reported_seq":2199,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.220802+0000","last_change":"2024-09-14T12:01:41.220735+0000","last_active":"2024-09-14T12:01:41.220802+0000","last_peered":"2024-09-14T12:01:41.220802+0000","last_clean":"2024-09-14T12:01:41.220802+0000","last_became_active":"2024-09-14T10:46:46.344509+0000","last_became_peered":"2024-09-14T10:46:46.344509+0000","last_unstale":"2024-09-14T12:01:41.220802+0000","last_undegraded":"2024-09-14T12:01:41.220802+0000","last_fullsized":"2024-09-14T12:01:41.220802+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'452","last_scrub_stamp":"2024-09-14T12:01:41.220645+0000","last_deep_scrub":"263'452","last_deep_scrub_stamp":"2024-09-14T12:01:41.220645+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.220645+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:35.813843+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2693,"num_read_kb":2571,"num_write":507,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2556,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"263'330","reported_seq":1012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.784580+0000","last_change":"2024-09-14T12:01:33.784580+0000","last_active":"2024-09-14T12:01:33.784580+0000","last_peered":"2024-09-14T12:01:33.784580+0000","last_clean":"2024-09-14T12:01:33.784580+0000","last_became_active":"2024-09-14T10:46:44.331464+0000","last_became_peered":"2024-09-14T10:46:44.331464+0000","last_unstale":"2024-09-14T12:01:33.784580+0000","last_undegraded":"2024-09-14T12:01:33.784580+0000","last_fullsized":"2024-09-14T12:01:33.784580+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'330","last_scrub_stamp":"2024-09-14T12:01:33.784418+0000","last_deep_scrub":"263'330","last_deep_scrub_stamp":"2024-09-14T12:01:33.784418+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.784418+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:35.461645+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267319,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":652,"num_read_kb":48168,"num_write":1033,"num_write_kb":26849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:46.531442+0000","last_change":"2024-09-14T12:01:46.531442+0000","last_active":"2024-09-14T12:01:46.531442+0000","last_peered":"2024-09-14T12:01:46.531442+0000","last_clean":"2024-09-14T12:01:46.531442+0000","last_became_active":"2024-09-14T10:46:48.357301+0000","last_became_peered":"2024-09-14T10:46:48.357301+0000","last_unstale":"2024-09-14T12:01:46.531442+0000","last_undegraded":"2024-09-14T12:01:46.531442+0000","last_fullsized":"2024-09-14T12:01:46.531442+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:46.531345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:46.531345+0000","last_clean_scrub_stamp":"2024-09-14T12:01:46.531345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:24.241883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"263'144","reported_seq":706,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:53.618728+0000","last_change":"2024-09-14T12:01:53.618728+0000","last_active":"2024-09-14T12:01:53.618728+0000","last_peered":"2024-09-14T12:01:53.618728+0000","last_clean":"2024-09-14T12:01:53.618728+0000","last_became_active":"2024-09-14T10:46:50.363495+0000","last_became_peered":"2024-09-14T10:46:50.363495+0000","last_unstale":"2024-09-14T12:01:53.618728+0000","last_undegraded":"2024-09-14T12:01:53.618728+0000","last_fullsized":"2024-09-14T12:01:53.618728+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-14T12:01:53.618629+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-14T12:01:53.618629+0000","last_clean_scrub_stamp":"2024-09-14T12:01:53.618629+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:30:16.530507+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":162,"num_write":114,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"263'793","reported_seq":2737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:03.750622+0000","last_change":"2024-09-14T12:02:03.750622+0000","last_active":"2024-09-14T12:02:03.750622+0000","last_peered":"2024-09-14T12:02:03.750622+0000","last_clean":"2024-09-14T12:02:03.750622+0000","last_became_active":"2024-09-14T10:46:52.373886+0000","last_became_peered":"2024-09-14T10:46:52.373886+0000","last_unstale":"2024-09-14T12:02:03.750622+0000","last_undegraded":"2024-09-14T12:02:03.750622+0000","last_fullsized":"2024-09-14T12:02:03.750622+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'793","last_scrub_stamp":"2024-09-14T12:02:03.750525+0000","last_deep_scrub":"263'793","last_deep_scrub_stamp":"2024-09-14T12:02:03.750525+0000","last_clean_scrub_stamp":"2024-09-14T12:02:03.750525+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:17.425492+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"263'183","reported_seq":1015,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:51.826534+0000","last_change":"2024-09-14T12:01:51.826468+0000","last_active":"2024-09-14T12:01:51.826534+0000","last_peered":"2024-09-14T12:01:51.826534+0000","last_clean":"2024-09-14T12:01:51.826534+0000","last_became_active":"2024-09-14T10:46:54.388186+0000","last_became_peered":"2024-09-14T10:46:54.388186+0000","last_unstale":"2024-09-14T12:01:51.826534+0000","last_undegraded":"2024-09-14T12:01:51.826534+0000","last_fullsized":"2024-09-14T12:01:51.826534+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'183","last_scrub_stamp":"2024-09-14T12:01:51.826355+0000","last_deep_scrub":"263'183","last_deep_scrub_stamp":"2024-09-14T12:01:51.826355+0000","last_clean_scrub_stamp":"2024-09-14T12:01:51.826355+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:29.432769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":561,"num_read_kb":561,"num_write":378,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"263'897","reported_seq":2339,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.268109+0000","last_change":"2024-09-14T12:01:42.268055+0000","last_active":"2024-09-14T12:01:42.268109+0000","last_peered":"2024-09-14T12:01:42.268109+0000","last_clean":"2024-09-14T12:01:42.268109+0000","last_became_active":"2024-09-14T10:46:46.351453+0000","last_became_peered":"2024-09-14T10:46:46.351453+0000","last_unstale":"2024-09-14T12:01:42.268109+0000","last_undegraded":"2024-09-14T12:01:42.268109+0000","last_fullsized":"2024-09-14T12:01:42.268109+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'897","last_scrub_stamp":"2024-09-14T12:01:42.267963+0000","last_deep_scrub":"263'897","last_deep_scrub_stamp":"2024-09-14T12:01:42.267963+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.267963+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":800,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:38.136304+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4193,"num_read_kb":3693,"num_write":1250,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"263'366","reported_seq":1051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:25.748065+0000","last_change":"2024-09-14T12:01:25.748065+0000","last_active":"2024-09-14T12:01:25.748065+0000","last_peered":"2024-09-14T12:01:25.748065+0000","last_clean":"2024-09-14T12:01:25.748065+0000","last_became_active":"2024-09-14T10:46:44.328531+0000","last_became_peered":"2024-09-14T10:46:44.328531+0000","last_unstale":"2024-09-14T12:01:25.748065+0000","last_undegraded":"2024-09-14T12:01:25.748065+0000","last_fullsized":"2024-09-14T12:01:25.748065+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'366","last_scrub_stamp":"2024-09-14T12:01:25.747975+0000","last_deep_scrub":"263'366","last_deep_scrub_stamp":"2024-09-14T12:01:25.747975+0000","last_clean_scrub_stamp":"2024-09-14T12:01:25.747975+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:05.853735+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":728,"num_read_kb":24160,"num_write":1182,"num_write_kb":50074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:54.854363+0000","last_change":"2024-09-14T12:01:54.854363+0000","last_active":"2024-09-14T12:01:54.854363+0000","last_peered":"2024-09-14T12:01:54.854363+0000","last_clean":"2024-09-14T12:01:54.854363+0000","last_became_active":"2024-09-14T10:46:48.348899+0000","last_became_peered":"2024-09-14T10:46:48.348899+0000","last_unstale":"2024-09-14T12:01:54.854363+0000","last_undegraded":"2024-09-14T12:01:54.854363+0000","last_fullsized":"2024-09-14T12:01:54.854363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:54.854273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:54.854273+0000","last_clean_scrub_stamp":"2024-09-14T12:01:54.854273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:37.507794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"263'311","reported_seq":904,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.892505+0000","last_change":"2024-09-14T12:01:43.892436+0000","last_active":"2024-09-14T12:01:43.892505+0000","last_peered":"2024-09-14T12:01:43.892505+0000","last_clean":"2024-09-14T12:01:43.892505+0000","last_became_active":"2024-09-14T10:46:50.365721+0000","last_became_peered":"2024-09-14T10:46:50.365721+0000","last_unstale":"2024-09-14T12:01:43.892505+0000","last_undegraded":"2024-09-14T12:01:43.892505+0000","last_fullsized":"2024-09-14T12:01:43.892505+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-09-14T12:01:43.892336+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-09-14T12:01:43.892336+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.892336+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:51.567901+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47247,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":1144,"num_write":408,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"263'831","reported_seq":2749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:56.171172+0000","last_change":"2024-09-14T12:01:56.171172+0000","last_active":"2024-09-14T12:01:56.171172+0000","last_peered":"2024-09-14T12:01:56.171172+0000","last_clean":"2024-09-14T12:01:56.171172+0000","last_became_active":"2024-09-14T10:46:52.374634+0000","last_became_peered":"2024-09-14T10:46:52.374634+0000","last_unstale":"2024-09-14T12:01:56.171172+0000","last_undegraded":"2024-09-14T12:01:56.171172+0000","last_fullsized":"2024-09-14T12:01:56.171172+0000","mapping_epoch":34,"log_start":"263'800","ondisk_log_start":"263'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'831","last_scrub_stamp":"2024-09-14T12:01:56.171077+0000","last_deep_scrub":"263'831","last_deep_scrub_stamp":"2024-09-14T12:01:56.171077+0000","last_clean_scrub_stamp":"2024-09-14T12:01:56.171077+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:37.257995+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"263'525","reported_seq":2114,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.726688+0000","last_change":"2024-09-14T12:01:41.726626+0000","last_active":"2024-09-14T12:01:41.726688+0000","last_peered":"2024-09-14T12:01:41.726688+0000","last_clean":"2024-09-14T12:01:41.726688+0000","last_became_active":"2024-09-14T10:46:46.341971+0000","last_became_peered":"2024-09-14T10:46:46.341971+0000","last_unstale":"2024-09-14T12:01:41.726688+0000","last_undegraded":"2024-09-14T12:01:41.726688+0000","last_fullsized":"2024-09-14T12:01:41.726688+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'525","last_scrub_stamp":"2024-09-14T12:01:41.726541+0000","last_deep_scrub":"263'525","last_deep_scrub_stamp":"2024-09-14T12:01:41.726541+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.726541+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:17.093439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2719,"num_read_kb":2513,"num_write":653,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"263'361","reported_seq":1034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.294867+0000","last_change":"2024-09-14T12:01:27.294867+0000","last_active":"2024-09-14T12:01:27.294867+0000","last_peered":"2024-09-14T12:01:27.294867+0000","last_clean":"2024-09-14T12:01:27.294867+0000","last_became_active":"2024-09-14T10:46:44.329782+0000","last_became_peered":"2024-09-14T10:46:44.329782+0000","last_unstale":"2024-09-14T12:01:27.294867+0000","last_undegraded":"2024-09-14T12:01:27.294867+0000","last_fullsized":"2024-09-14T12:01:27.294867+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'361","last_scrub_stamp":"2024-09-14T12:01:27.294789+0000","last_deep_scrub":"263'361","last_deep_scrub_stamp":"2024-09-14T12:01:27.294789+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.294789+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:54.811209+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":606,"num_read_kb":47823,"num_write":1082,"num_write_kb":48255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.639919+0000","last_change":"2024-09-14T12:01:42.639833+0000","last_active":"2024-09-14T12:01:42.639919+0000","last_peered":"2024-09-14T12:01:42.639919+0000","last_clean":"2024-09-14T12:01:42.639919+0000","last_became_active":"2024-09-14T10:46:48.352584+0000","last_became_peered":"2024-09-14T10:46:48.352584+0000","last_unstale":"2024-09-14T12:01:42.639919+0000","last_undegraded":"2024-09-14T12:01:42.639919+0000","last_fullsized":"2024-09-14T12:01:42.639919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:42.639742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:42.639742+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.639742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:10.999523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"263'424","reported_seq":1074,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.178179+0000","last_change":"2024-09-14T12:01:45.178116+0000","last_active":"2024-09-14T12:01:45.178179+0000","last_peered":"2024-09-14T12:01:45.178179+0000","last_clean":"2024-09-14T12:01:45.178179+0000","last_became_active":"2024-09-14T10:46:50.364438+0000","last_became_peered":"2024-09-14T10:46:50.364438+0000","last_unstale":"2024-09-14T12:01:45.178179+0000","last_undegraded":"2024-09-14T12:01:45.178179+0000","last_fullsized":"2024-09-14T12:01:45.178179+0000","mapping_epoch":32,"log_start":"263'400","ondisk_log_start":"263'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'424","last_scrub_stamp":"2024-09-14T12:01:45.178020+0000","last_deep_scrub":"263'424","last_deep_scrub_stamp":"2024-09-14T12:01:45.178020+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.178020+0000","objects_scrubbed":9,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:54.197314+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46781,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":687,"num_read_kb":1416,"num_write":538,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:53.880177+0000","last_change":"2024-09-14T12:01:53.880177+0000","last_active":"2024-09-14T12:01:53.880177+0000","last_peered":"2024-09-14T12:01:53.880177+0000","last_clean":"2024-09-14T12:01:53.880177+0000","last_became_active":"2024-09-14T10:46:52.367874+0000","last_became_peered":"2024-09-14T10:46:52.367874+0000","last_unstale":"2024-09-14T12:01:53.880177+0000","last_undegraded":"2024-09-14T12:01:53.880177+0000","last_fullsized":"2024-09-14T12:01:53.880177+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:53.880069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:53.880069+0000","last_clean_scrub_stamp":"2024-09-14T12:01:53.880069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:55.097023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"263'560","reported_seq":1410,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:50.846994+0000","last_change":"2024-09-14T12:01:50.846916+0000","last_active":"2024-09-14T12:01:50.846994+0000","last_peered":"2024-09-14T12:01:50.846994+0000","last_clean":"2024-09-14T12:01:50.846994+0000","last_became_active":"2024-09-14T10:46:54.389880+0000","last_became_peered":"2024-09-14T10:46:54.389880+0000","last_unstale":"2024-09-14T12:01:50.846994+0000","last_undegraded":"2024-09-14T12:01:50.846994+0000","last_fullsized":"2024-09-14T12:01:50.846994+0000","mapping_epoch":36,"log_start":"263'500","ondisk_log_start":"263'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'560","last_scrub_stamp":"2024-09-14T12:01:50.846820+0000","last_deep_scrub":"263'560","last_deep_scrub_stamp":"2024-09-14T12:01:50.846820+0000","last_clean_scrub_stamp":"2024-09-14T12:01:50.846820+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:18.830210+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1361,"num_read_kb":1337,"num_write":1147,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"263'1287","reported_seq":3021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.716325+0000","last_change":"2024-09-14T12:01:30.716251+0000","last_active":"2024-09-14T12:01:30.716325+0000","last_peered":"2024-09-14T12:01:30.716325+0000","last_clean":"2024-09-14T12:01:30.716325+0000","last_became_active":"2024-09-14T10:46:46.343603+0000","last_became_peered":"2024-09-14T10:46:46.343603+0000","last_unstale":"2024-09-14T12:01:30.716325+0000","last_undegraded":"2024-09-14T12:01:30.716325+0000","last_fullsized":"2024-09-14T12:01:30.716325+0000","mapping_epoch":28,"log_start":"263'1200","ondisk_log_start":"263'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1287","last_scrub_stamp":"2024-09-14T12:01:30.716161+0000","last_deep_scrub":"263'1287","last_deep_scrub_stamp":"2024-09-14T12:01:30.716161+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.716161+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":1200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:10.862248+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6021,"num_read_kb":5313,"num_write":1785,"num_write_kb":753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"263'327","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:25.890412+0000","last_change":"2024-09-14T12:01:25.890412+0000","last_active":"2024-09-14T12:01:25.890412+0000","last_peered":"2024-09-14T12:01:25.890412+0000","last_clean":"2024-09-14T12:01:25.890412+0000","last_became_active":"2024-09-14T10:46:44.322816+0000","last_became_peered":"2024-09-14T10:46:44.322816+0000","last_unstale":"2024-09-14T12:01:25.890412+0000","last_undegraded":"2024-09-14T12:01:25.890412+0000","last_fullsized":"2024-09-14T12:01:25.890412+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'327","last_scrub_stamp":"2024-09-14T12:01:25.890298+0000","last_deep_scrub":"263'327","last_deep_scrub_stamp":"2024-09-14T12:01:25.890298+0000","last_clean_scrub_stamp":"2024-09-14T12:01:25.890298+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:47.450364+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":492,"num_write":1114,"num_write_kb":29298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.849057+0000","last_change":"2024-09-14T12:01:42.849001+0000","last_active":"2024-09-14T12:01:42.849057+0000","last_peered":"2024-09-14T12:01:42.849057+0000","last_clean":"2024-09-14T12:01:42.849057+0000","last_became_active":"2024-09-14T10:46:48.351893+0000","last_became_peered":"2024-09-14T10:46:48.351893+0000","last_unstale":"2024-09-14T12:01:42.849057+0000","last_undegraded":"2024-09-14T12:01:42.849057+0000","last_fullsized":"2024-09-14T12:01:42.849057+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:42.848916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:42.848916+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.848916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:29.709750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"263'269","reported_seq":862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:51.589483+0000","last_change":"2024-09-14T12:01:51.589483+0000","last_active":"2024-09-14T12:01:51.589483+0000","last_peered":"2024-09-14T12:01:51.589483+0000","last_clean":"2024-09-14T12:01:51.589483+0000","last_became_active":"2024-09-14T10:46:50.359434+0000","last_became_peered":"2024-09-14T10:46:50.359434+0000","last_unstale":"2024-09-14T12:01:51.589483+0000","last_undegraded":"2024-09-14T12:01:51.589483+0000","last_fullsized":"2024-09-14T12:01:51.589483+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'269","last_scrub_stamp":"2024-09-14T12:01:51.589368+0000","last_deep_scrub":"263'269","last_deep_scrub_stamp":"2024-09-14T12:01:51.589368+0000","last_clean_scrub_stamp":"2024-09-14T12:01:51.589368+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:09.071357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44011,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":1031,"num_write":356,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:58.666180+0000","last_change":"2024-09-14T12:01:58.666180+0000","last_active":"2024-09-14T12:01:58.666180+0000","last_peered":"2024-09-14T12:01:58.666180+0000","last_clean":"2024-09-14T12:01:58.666180+0000","last_became_active":"2024-09-14T10:46:52.369353+0000","last_became_peered":"2024-09-14T10:46:52.369353+0000","last_unstale":"2024-09-14T12:01:58.666180+0000","last_undegraded":"2024-09-14T12:01:58.666180+0000","last_fullsized":"2024-09-14T12:01:58.666180+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:58.666096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:58.666096+0000","last_clean_scrub_stamp":"2024-09-14T12:01:58.666096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:41.189959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"263'2544","reported_seq":4377,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:51.727231+0000","last_change":"2024-09-14T12:01:51.727167+0000","last_active":"2024-09-14T12:01:51.727231+0000","last_peered":"2024-09-14T12:01:51.727231+0000","last_clean":"2024-09-14T12:01:51.727231+0000","last_became_active":"2024-09-14T10:46:54.383100+0000","last_became_peered":"2024-09-14T10:46:54.383100+0000","last_unstale":"2024-09-14T12:01:51.727231+0000","last_undegraded":"2024-09-14T12:01:51.727231+0000","last_fullsized":"2024-09-14T12:01:51.727231+0000","mapping_epoch":36,"log_start":"263'2500","ondisk_log_start":"263'2500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2544","last_scrub_stamp":"2024-09-14T12:01:51.727077+0000","last_deep_scrub":"263'2544","last_deep_scrub_stamp":"2024-09-14T12:01:51.727077+0000","last_clean_scrub_stamp":"2024-09-14T12:01:51.727077+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":2500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:47.596101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6216,"num_read_kb":6221,"num_write":5164,"num_write_kb":1877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"263'516","reported_seq":2296,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.851554+0000","last_change":"2024-09-14T12:01:32.851554+0000","last_active":"2024-09-14T12:01:32.851554+0000","last_peered":"2024-09-14T12:01:32.851554+0000","last_clean":"2024-09-14T12:01:32.851554+0000","last_became_active":"2024-09-14T10:46:46.337951+0000","last_became_peered":"2024-09-14T10:46:46.337951+0000","last_unstale":"2024-09-14T12:01:32.851554+0000","last_undegraded":"2024-09-14T12:01:32.851554+0000","last_fullsized":"2024-09-14T12:01:32.851554+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'516","last_scrub_stamp":"2024-09-14T12:01:32.851465+0000","last_deep_scrub":"263'516","last_deep_scrub_stamp":"2024-09-14T12:01:32.851465+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.851465+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:13.273879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2937,"num_read_kb":2795,"num_write":635,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"263'349","reported_seq":1036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.796987+0000","last_change":"2024-09-14T12:01:32.796987+0000","last_active":"2024-09-14T12:01:32.796987+0000","last_peered":"2024-09-14T12:01:32.796987+0000","last_clean":"2024-09-14T12:01:32.796987+0000","last_became_active":"2024-09-14T10:46:44.331705+0000","last_became_peered":"2024-09-14T10:46:44.331705+0000","last_unstale":"2024-09-14T12:01:32.796987+0000","last_undegraded":"2024-09-14T12:01:32.796987+0000","last_fullsized":"2024-09-14T12:01:32.796987+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'349","last_scrub_stamp":"2024-09-14T12:01:32.796840+0000","last_deep_scrub":"263'349","last_deep_scrub_stamp":"2024-09-14T12:01:32.796840+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.796840+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:14.276300+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":652,"num_read_kb":33315,"num_write":1115,"num_write_kb":35089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:49.302175+0000","last_change":"2024-09-14T12:01:49.302175+0000","last_active":"2024-09-14T12:01:49.302175+0000","last_peered":"2024-09-14T12:01:49.302175+0000","last_clean":"2024-09-14T12:01:49.302175+0000","last_became_active":"2024-09-14T10:46:48.354092+0000","last_became_peered":"2024-09-14T10:46:48.354092+0000","last_unstale":"2024-09-14T12:01:49.302175+0000","last_undegraded":"2024-09-14T12:01:49.302175+0000","last_fullsized":"2024-09-14T12:01:49.302175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:49.302099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:49.302099+0000","last_clean_scrub_stamp":"2024-09-14T12:01:49.302099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:05.762462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"263'350","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:57.835684+0000","last_change":"2024-09-14T12:01:57.835614+0000","last_active":"2024-09-14T12:01:57.835684+0000","last_peered":"2024-09-14T12:01:57.835684+0000","last_clean":"2024-09-14T12:01:57.835684+0000","last_became_active":"2024-09-14T10:46:50.363893+0000","last_became_peered":"2024-09-14T10:46:50.363893+0000","last_unstale":"2024-09-14T12:01:57.835684+0000","last_undegraded":"2024-09-14T12:01:57.835684+0000","last_fullsized":"2024-09-14T12:01:57.835684+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-14T12:01:57.835501+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-14T12:01:57.835501+0000","last_clean_scrub_stamp":"2024-09-14T12:01:57.835501+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:50.645404+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44240,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":541,"num_read_kb":1145,"num_write":426,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"263'831","reported_seq":5045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:55.203922+0000","last_change":"2024-09-14T12:01:55.203848+0000","last_active":"2024-09-14T12:01:55.203922+0000","last_peered":"2024-09-14T12:01:55.203922+0000","last_clean":"2024-09-14T12:01:55.203922+0000","last_became_active":"2024-09-14T10:46:52.374152+0000","last_became_peered":"2024-09-14T10:46:52.374152+0000","last_unstale":"2024-09-14T12:01:55.203922+0000","last_undegraded":"2024-09-14T12:01:55.203922+0000","last_fullsized":"2024-09-14T12:01:55.203922+0000","mapping_epoch":34,"log_start":"263'800","ondisk_log_start":"263'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'831","last_scrub_stamp":"2024-09-14T12:01:55.203757+0000","last_deep_scrub":"263'831","last_deep_scrub_stamp":"2024-09-14T12:01:55.203757+0000","last_clean_scrub_stamp":"2024-09-14T12:01:55.203757+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:14.071131+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"263'167","reported_seq":673,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:54.865184+0000","last_change":"2024-09-14T12:01:54.865067+0000","last_active":"2024-09-14T12:01:54.865184+0000","last_peered":"2024-09-14T12:01:54.865184+0000","last_clean":"2024-09-14T12:01:54.865184+0000","last_became_active":"2024-09-14T10:46:54.383953+0000","last_became_peered":"2024-09-14T10:46:54.383953+0000","last_unstale":"2024-09-14T12:01:54.865184+0000","last_undegraded":"2024-09-14T12:01:54.865184+0000","last_fullsized":"2024-09-14T12:01:54.865184+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'167","last_scrub_stamp":"2024-09-14T12:01:54.864971+0000","last_deep_scrub":"263'167","last_deep_scrub_stamp":"2024-09-14T12:01:54.864971+0000","last_clean_scrub_stamp":"2024-09-14T12:01:54.864971+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:49.056018+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":135,"num_write":398,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"263'1058","reported_seq":2538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.273309+0000","last_change":"2024-09-14T12:01:39.273309+0000","last_active":"2024-09-14T12:01:39.273309+0000","last_peered":"2024-09-14T12:01:39.273309+0000","last_clean":"2024-09-14T12:01:39.273309+0000","last_became_active":"2024-09-14T10:46:46.348726+0000","last_became_peered":"2024-09-14T10:46:46.348726+0000","last_unstale":"2024-09-14T12:01:39.273309+0000","last_undegraded":"2024-09-14T12:01:39.273309+0000","last_fullsized":"2024-09-14T12:01:39.273309+0000","mapping_epoch":28,"log_start":"263'1000","ondisk_log_start":"263'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1058","last_scrub_stamp":"2024-09-14T12:01:39.273229+0000","last_deep_scrub":"263'1058","last_deep_scrub_stamp":"2024-09-14T12:01:39.273229+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.273229+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":1000,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:14.478829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4827,"num_read_kb":4287,"num_write":1450,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"263'309","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:24.291444+0000","last_change":"2024-09-14T12:01:24.291444+0000","last_active":"2024-09-14T12:01:24.291444+0000","last_peered":"2024-09-14T12:01:24.291444+0000","last_clean":"2024-09-14T12:01:24.291444+0000","last_became_active":"2024-09-14T10:46:44.332535+0000","last_became_peered":"2024-09-14T10:46:44.332535+0000","last_unstale":"2024-09-14T12:01:24.291444+0000","last_undegraded":"2024-09-14T12:01:24.291444+0000","last_fullsized":"2024-09-14T12:01:24.291444+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'309","last_scrub_stamp":"2024-09-14T12:01:24.291338+0000","last_deep_scrub":"263'309","last_deep_scrub_stamp":"2024-09-14T12:01:24.291338+0000","last_clean_scrub_stamp":"2024-09-14T12:01:24.291338+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:44.362720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267347,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":39478,"num_write":1028,"num_write_kb":35728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.834918+0000","last_change":"2024-09-14T12:01:44.834841+0000","last_active":"2024-09-14T12:01:44.834918+0000","last_peered":"2024-09-14T12:01:44.834918+0000","last_clean":"2024-09-14T12:01:44.834918+0000","last_became_active":"2024-09-14T10:46:48.351530+0000","last_became_peered":"2024-09-14T10:46:48.351530+0000","last_unstale":"2024-09-14T12:01:44.834918+0000","last_undegraded":"2024-09-14T12:01:44.834918+0000","last_fullsized":"2024-09-14T12:01:44.834918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:44.834750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:44.834750+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.834750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:42.216241+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"263'477","reported_seq":1134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:50.580479+0000","last_change":"2024-09-14T12:01:50.580410+0000","last_active":"2024-09-14T12:01:50.580479+0000","last_peered":"2024-09-14T12:01:50.580479+0000","last_clean":"2024-09-14T12:01:50.580479+0000","last_became_active":"2024-09-14T10:46:50.361396+0000","last_became_peered":"2024-09-14T10:46:50.361396+0000","last_unstale":"2024-09-14T12:01:50.580479+0000","last_undegraded":"2024-09-14T12:01:50.580479+0000","last_fullsized":"2024-09-14T12:01:50.580479+0000","mapping_epoch":32,"log_start":"263'400","ondisk_log_start":"263'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'477","last_scrub_stamp":"2024-09-14T12:01:50.580324+0000","last_deep_scrub":"263'477","last_deep_scrub_stamp":"2024-09-14T12:01:50.580324+0000","last_clean_scrub_stamp":"2024-09-14T12:01:50.580324+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:16.911774+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93223,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":821,"num_read_kb":1952,"num_write":664,"num_write_kb":533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:54.212783+0000","last_change":"2024-09-14T12:01:54.212677+0000","last_active":"2024-09-14T12:01:54.212783+0000","last_peered":"2024-09-14T12:01:54.212783+0000","last_clean":"2024-09-14T12:01:54.212783+0000","last_became_active":"2024-09-14T10:46:52.373563+0000","last_became_peered":"2024-09-14T10:46:52.373563+0000","last_unstale":"2024-09-14T12:01:54.212783+0000","last_undegraded":"2024-09-14T12:01:54.212783+0000","last_fullsized":"2024-09-14T12:01:54.212783+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:54.212569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:54.212569+0000","last_clean_scrub_stamp":"2024-09-14T12:01:54.212569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:19.820671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"263'161","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:49.100566+0000","last_change":"2024-09-14T12:01:49.100505+0000","last_active":"2024-09-14T12:01:49.100566+0000","last_peered":"2024-09-14T12:01:49.100566+0000","last_clean":"2024-09-14T12:01:49.100566+0000","last_became_active":"2024-09-14T10:46:54.388429+0000","last_became_peered":"2024-09-14T10:46:54.388429+0000","last_unstale":"2024-09-14T12:01:49.100566+0000","last_undegraded":"2024-09-14T12:01:49.100566+0000","last_fullsized":"2024-09-14T12:01:49.100566+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'161","last_scrub_stamp":"2024-09-14T12:01:49.100420+0000","last_deep_scrub":"263'161","last_deep_scrub_stamp":"2024-09-14T12:01:49.100420+0000","last_clean_scrub_stamp":"2024-09-14T12:01:49.100420+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:49.478185+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":168,"num_write":381,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"263'891","reported_seq":2650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.303380+0000","last_change":"2024-09-14T12:01:35.303380+0000","last_active":"2024-09-14T12:01:35.303380+0000","last_peered":"2024-09-14T12:01:35.303380+0000","last_clean":"2024-09-14T12:01:35.303380+0000","last_became_active":"2024-09-14T10:46:46.344022+0000","last_became_peered":"2024-09-14T10:46:46.344022+0000","last_unstale":"2024-09-14T12:01:35.303380+0000","last_undegraded":"2024-09-14T12:01:35.303380+0000","last_fullsized":"2024-09-14T12:01:35.303380+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'891","last_scrub_stamp":"2024-09-14T12:01:35.303277+0000","last_deep_scrub":"263'891","last_deep_scrub_stamp":"2024-09-14T12:01:35.303277+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.303277+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:25.632741+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4406,"num_read_kb":4005,"num_write":1167,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"263'312","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.208032+0000","last_change":"2024-09-14T12:01:28.208032+0000","last_active":"2024-09-14T12:01:28.208032+0000","last_peered":"2024-09-14T12:01:28.208032+0000","last_clean":"2024-09-14T12:01:28.208032+0000","last_became_active":"2024-09-14T10:46:44.318584+0000","last_became_peered":"2024-09-14T10:46:44.318584+0000","last_unstale":"2024-09-14T12:01:28.208032+0000","last_undegraded":"2024-09-14T12:01:28.208032+0000","last_fullsized":"2024-09-14T12:01:28.208032+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-09-14T12:01:28.207930+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-09-14T12:01:28.207930+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.207930+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:00.044887+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":581,"num_read_kb":7202,"num_write":854,"num_write_kb":20635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.042904+0000","last_change":"2024-09-14T12:01:39.042904+0000","last_active":"2024-09-14T12:01:39.042904+0000","last_peered":"2024-09-14T12:01:39.042904+0000","last_clean":"2024-09-14T12:01:39.042904+0000","last_became_active":"2024-09-14T10:46:48.355691+0000","last_became_peered":"2024-09-14T10:46:48.355691+0000","last_unstale":"2024-09-14T12:01:39.042904+0000","last_undegraded":"2024-09-14T12:01:39.042904+0000","last_fullsized":"2024-09-14T12:01:39.042904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:39.042798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:39.042798+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.042798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:39.224689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"263'347","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:53.714755+0000","last_change":"2024-09-14T12:01:53.714755+0000","last_active":"2024-09-14T12:01:53.714755+0000","last_peered":"2024-09-14T12:01:53.714755+0000","last_clean":"2024-09-14T12:01:53.714755+0000","last_became_active":"2024-09-14T10:46:50.362757+0000","last_became_peered":"2024-09-14T10:46:50.362757+0000","last_unstale":"2024-09-14T12:01:53.714755+0000","last_undegraded":"2024-09-14T12:01:53.714755+0000","last_fullsized":"2024-09-14T12:01:53.714755+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-09-14T12:01:53.714667+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-09-14T12:01:53.714667+0000","last_clean_scrub_stamp":"2024-09-14T12:01:53.714667+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:38.487284+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":590,"num_read_kb":1339,"num_write":526,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16394,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.030546+0000","last_change":"2024-09-14T12:01:42.030546+0000","last_active":"2024-09-14T12:01:42.030546+0000","last_peered":"2024-09-14T12:01:42.030546+0000","last_clean":"2024-09-14T12:01:42.030546+0000","last_became_active":"2024-09-14T10:46:52.373836+0000","last_became_peered":"2024-09-14T10:46:52.373836+0000","last_unstale":"2024-09-14T12:01:42.030546+0000","last_undegraded":"2024-09-14T12:01:42.030546+0000","last_fullsized":"2024-09-14T12:01:42.030546+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:42.030463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:42.030463+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.030463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:44.156503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"263'97","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:58.123699+0000","last_change":"2024-09-14T12:01:58.123699+0000","last_active":"2024-09-14T12:01:58.123699+0000","last_peered":"2024-09-14T12:01:58.123699+0000","last_clean":"2024-09-14T12:01:58.123699+0000","last_became_active":"2024-09-14T10:46:54.387066+0000","last_became_peered":"2024-09-14T10:46:54.387066+0000","last_unstale":"2024-09-14T12:01:58.123699+0000","last_undegraded":"2024-09-14T12:01:58.123699+0000","last_fullsized":"2024-09-14T12:01:58.123699+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'97","last_scrub_stamp":"2024-09-14T12:01:58.123609+0000","last_deep_scrub":"263'97","last_deep_scrub_stamp":"2024-09-14T12:01:58.123609+0000","last_clean_scrub_stamp":"2024-09-14T12:01:58.123609+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:47.951710+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":95,"num_write":224,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"263'1166","reported_seq":2684,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.796789+0000","last_change":"2024-09-14T12:01:44.796789+0000","last_active":"2024-09-14T12:01:44.796789+0000","last_peered":"2024-09-14T12:01:44.796789+0000","last_clean":"2024-09-14T12:01:44.796789+0000","last_became_active":"2024-09-14T10:46:46.340228+0000","last_became_peered":"2024-09-14T10:46:46.340228+0000","last_unstale":"2024-09-14T12:01:44.796789+0000","last_undegraded":"2024-09-14T12:01:44.796789+0000","last_fullsized":"2024-09-14T12:01:44.796789+0000","mapping_epoch":28,"log_start":"263'1100","ondisk_log_start":"263'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1166","last_scrub_stamp":"2024-09-14T12:01:44.796699+0000","last_deep_scrub":"263'1166","last_deep_scrub_stamp":"2024-09-14T12:01:44.796699+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.796699+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":1100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:34.655123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5254,"num_read_kb":4633,"num_write":1618,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"263'413","reported_seq":1135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.846170+0000","last_change":"2024-09-14T12:01:31.846104+0000","last_active":"2024-09-14T12:01:31.846170+0000","last_peered":"2024-09-14T12:01:31.846170+0000","last_clean":"2024-09-14T12:01:31.846170+0000","last_became_active":"2024-09-14T10:46:44.324440+0000","last_became_peered":"2024-09-14T10:46:44.324440+0000","last_unstale":"2024-09-14T12:01:31.846170+0000","last_undegraded":"2024-09-14T12:01:31.846170+0000","last_fullsized":"2024-09-14T12:01:31.846170+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'413","last_scrub_stamp":"2024-09-14T12:01:31.845943+0000","last_deep_scrub":"263'413","last_deep_scrub_stamp":"2024-09-14T12:01:31.845943+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.845943+0000","objects_scrubbed":9,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:50.275848+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":948,"num_read_kb":1994,"num_write":1270,"num_write_kb":27495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:48.349358+0000","last_change":"2024-09-14T12:01:48.349358+0000","last_active":"2024-09-14T12:01:48.349358+0000","last_peered":"2024-09-14T12:01:48.349358+0000","last_clean":"2024-09-14T12:01:48.349358+0000","last_became_active":"2024-09-14T10:46:48.353513+0000","last_became_peered":"2024-09-14T10:46:48.353513+0000","last_unstale":"2024-09-14T12:01:48.349358+0000","last_undegraded":"2024-09-14T12:01:48.349358+0000","last_fullsized":"2024-09-14T12:01:48.349358+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:48.349259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:48.349259+0000","last_clean_scrub_stamp":"2024-09-14T12:01:48.349259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:03.618230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"263'339","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:51.317553+0000","last_change":"2024-09-14T12:01:51.317553+0000","last_active":"2024-09-14T12:01:51.317553+0000","last_peered":"2024-09-14T12:01:51.317553+0000","last_clean":"2024-09-14T12:01:51.317553+0000","last_became_active":"2024-09-14T10:46:50.362492+0000","last_became_peered":"2024-09-14T10:46:50.362492+0000","last_unstale":"2024-09-14T12:01:51.317553+0000","last_undegraded":"2024-09-14T12:01:51.317553+0000","last_fullsized":"2024-09-14T12:01:51.317553+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-14T12:01:51.317465+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-14T12:01:51.317465+0000","last_clean_scrub_stamp":"2024-09-14T12:01:51.317465+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:31.165356+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50533,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":553,"num_read_kb":1190,"num_write":436,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"263'787","reported_seq":4630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.985368+0000","last_change":"2024-09-14T12:01:43.985368+0000","last_active":"2024-09-14T12:01:43.985368+0000","last_peered":"2024-09-14T12:01:43.985368+0000","last_clean":"2024-09-14T12:01:43.985368+0000","last_became_active":"2024-09-14T10:46:52.374947+0000","last_became_peered":"2024-09-14T10:46:52.374947+0000","last_unstale":"2024-09-14T12:01:43.985368+0000","last_undegraded":"2024-09-14T12:01:43.985368+0000","last_fullsized":"2024-09-14T12:01:43.985368+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'787","last_scrub_stamp":"2024-09-14T12:01:43.985280+0000","last_deep_scrub":"263'787","last_deep_scrub_stamp":"2024-09-14T12:01:43.985280+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.985280+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:11.916897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"263'126","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:52.860712+0000","last_change":"2024-09-14T12:01:52.860648+0000","last_active":"2024-09-14T12:01:52.860712+0000","last_peered":"2024-09-14T12:01:52.860712+0000","last_clean":"2024-09-14T12:01:52.860712+0000","last_became_active":"2024-09-14T10:46:54.382004+0000","last_became_peered":"2024-09-14T10:46:54.382004+0000","last_unstale":"2024-09-14T12:01:52.860712+0000","last_undegraded":"2024-09-14T12:01:52.860712+0000","last_fullsized":"2024-09-14T12:01:52.860712+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'126","last_scrub_stamp":"2024-09-14T12:01:52.860482+0000","last_deep_scrub":"263'126","last_deep_scrub_stamp":"2024-09-14T12:01:52.860482+0000","last_clean_scrub_stamp":"2024-09-14T12:01:52.860482+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:59.879623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1268,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":189,"num_write":324,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"263'838","reported_seq":2537,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.831775+0000","last_change":"2024-09-14T12:01:35.831775+0000","last_active":"2024-09-14T12:01:35.831775+0000","last_peered":"2024-09-14T12:01:35.831775+0000","last_clean":"2024-09-14T12:01:35.831775+0000","last_became_active":"2024-09-14T10:46:46.347307+0000","last_became_peered":"2024-09-14T10:46:46.347307+0000","last_unstale":"2024-09-14T12:01:35.831775+0000","last_undegraded":"2024-09-14T12:01:35.831775+0000","last_fullsized":"2024-09-14T12:01:35.831775+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'838","last_scrub_stamp":"2024-09-14T12:01:35.831680+0000","last_deep_scrub":"263'838","last_deep_scrub_stamp":"2024-09-14T12:01:35.831680+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.831680+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:03.490519+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4222,"num_read_kb":3846,"num_write":1108,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"263'364","reported_seq":1148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.866429+0000","last_change":"2024-09-14T12:01:30.866353+0000","last_active":"2024-09-14T12:01:30.866429+0000","last_peered":"2024-09-14T12:01:30.866429+0000","last_clean":"2024-09-14T12:01:30.866429+0000","last_became_active":"2024-09-14T10:46:44.330567+0000","last_became_peered":"2024-09-14T10:46:44.330567+0000","last_unstale":"2024-09-14T12:01:30.866429+0000","last_undegraded":"2024-09-14T12:01:30.866429+0000","last_fullsized":"2024-09-14T12:01:30.866429+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'364","last_scrub_stamp":"2024-09-14T12:01:30.866244+0000","last_deep_scrub":"263'364","last_deep_scrub_stamp":"2024-09-14T12:01:30.866244+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.866244+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:50.829453+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":975,"num_read_kb":55651,"num_write":1153,"num_write_kb":35628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1471,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.686044+0000","last_change":"2024-09-14T12:01:39.686044+0000","last_active":"2024-09-14T12:01:39.686044+0000","last_peered":"2024-09-14T12:01:39.686044+0000","last_clean":"2024-09-14T12:01:39.686044+0000","last_became_active":"2024-09-14T10:46:48.355697+0000","last_became_peered":"2024-09-14T10:46:48.355697+0000","last_unstale":"2024-09-14T12:01:39.686044+0000","last_undegraded":"2024-09-14T12:01:39.686044+0000","last_fullsized":"2024-09-14T12:01:39.686044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:01:39.685939+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:01:39.685939+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.685939+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:06.999103+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"263'111","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.813896+0000","last_change":"2024-09-14T12:01:45.813896+0000","last_active":"2024-09-14T12:01:45.813896+0000","last_peered":"2024-09-14T12:01:45.813896+0000","last_clean":"2024-09-14T12:01:45.813896+0000","last_became_active":"2024-09-14T10:46:50.369337+0000","last_became_peered":"2024-09-14T10:46:50.369337+0000","last_unstale":"2024-09-14T12:01:45.813896+0000","last_undegraded":"2024-09-14T12:01:45.813896+0000","last_fullsized":"2024-09-14T12:01:45.813896+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-14T12:01:45.813772+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-14T12:01:45.813772+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.813772+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:18.801223+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"263'803","reported_seq":2619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:48.664818+0000","last_change":"2024-09-14T12:01:48.664818+0000","last_active":"2024-09-14T12:01:48.664818+0000","last_peered":"2024-09-14T12:01:48.664818+0000","last_clean":"2024-09-14T12:01:48.664818+0000","last_became_active":"2024-09-14T10:46:52.374252+0000","last_became_peered":"2024-09-14T10:46:52.374252+0000","last_unstale":"2024-09-14T12:01:48.664818+0000","last_undegraded":"2024-09-14T12:01:48.664818+0000","last_fullsized":"2024-09-14T12:01:48.664818+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'803","last_scrub_stamp":"2024-09-14T12:01:48.664696+0000","last_deep_scrub":"263'803","last_deep_scrub_stamp":"2024-09-14T12:01:48.664696+0000","last_clean_scrub_stamp":"2024-09-14T12:01:48.664696+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:26.360167+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"263'120","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:48.861534+0000","last_change":"2024-09-14T12:01:48.861475+0000","last_active":"2024-09-14T12:01:48.861534+0000","last_peered":"2024-09-14T12:01:48.861534+0000","last_clean":"2024-09-14T12:01:48.861534+0000","last_became_active":"2024-09-14T10:46:54.384249+0000","last_became_peered":"2024-09-14T10:46:54.384249+0000","last_unstale":"2024-09-14T12:01:48.861534+0000","last_undegraded":"2024-09-14T12:01:48.861534+0000","last_fullsized":"2024-09-14T12:01:48.861534+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'120","last_scrub_stamp":"2024-09-14T12:01:48.861368+0000","last_deep_scrub":"263'120","last_deep_scrub_stamp":"2024-09-14T12:01:48.861368+0000","last_clean_scrub_stamp":"2024-09-14T12:01:48.861368+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:00.297961+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":125,"num_write":281,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"263'469","reported_seq":1950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.122323+0000","last_change":"2024-09-14T12:01:31.122323+0000","last_active":"2024-09-14T12:01:31.122323+0000","last_peered":"2024-09-14T12:01:31.122323+0000","last_clean":"2024-09-14T12:01:31.122323+0000","last_became_active":"2024-09-14T10:46:46.342466+0000","last_became_peered":"2024-09-14T10:46:46.342466+0000","last_unstale":"2024-09-14T12:01:31.122323+0000","last_undegraded":"2024-09-14T12:01:31.122323+0000","last_fullsized":"2024-09-14T12:01:31.122323+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'469","last_scrub_stamp":"2024-09-14T12:01:31.122238+0000","last_deep_scrub":"263'469","last_deep_scrub_stamp":"2024-09-14T12:01:31.122238+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.122238+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:49.197184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2422,"num_read_kb":2241,"num_write":583,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"263'288","reported_seq":924,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.710877+0000","last_change":"2024-09-14T12:01:30.710818+0000","last_active":"2024-09-14T12:01:30.710877+0000","last_peered":"2024-09-14T12:01:30.710877+0000","last_clean":"2024-09-14T12:01:30.710877+0000","last_became_active":"2024-09-14T10:46:44.329014+0000","last_became_peered":"2024-09-14T10:46:44.329014+0000","last_unstale":"2024-09-14T12:01:30.710877+0000","last_undegraded":"2024-09-14T12:01:30.710877+0000","last_fullsized":"2024-09-14T12:01:30.710877+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'288","last_scrub_stamp":"2024-09-14T12:01:30.710716+0000","last_deep_scrub":"263'288","last_deep_scrub_stamp":"2024-09-14T12:01:30.710716+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.710716+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:53.203004+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":506,"num_read_kb":30778,"num_write":881,"num_write_kb":14950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:51.895008+0000","last_change":"2024-09-14T12:01:51.895008+0000","last_active":"2024-09-14T12:01:51.895008+0000","last_peered":"2024-09-14T12:01:51.895008+0000","last_clean":"2024-09-14T12:01:51.895008+0000","last_became_active":"2024-09-14T10:46:48.358586+0000","last_became_peered":"2024-09-14T10:46:48.358586+0000","last_unstale":"2024-09-14T12:01:51.895008+0000","last_undegraded":"2024-09-14T12:01:51.895008+0000","last_fullsized":"2024-09-14T12:01:51.895008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:51.894918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:51.894918+0000","last_clean_scrub_stamp":"2024-09-14T12:01:51.894918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:40.285755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"263'384","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:47.637216+0000","last_change":"2024-09-14T12:01:47.637216+0000","last_active":"2024-09-14T12:01:47.637216+0000","last_peered":"2024-09-14T12:01:47.637216+0000","last_clean":"2024-09-14T12:01:47.637216+0000","last_became_active":"2024-09-14T10:46:50.365715+0000","last_became_peered":"2024-09-14T10:46:50.365715+0000","last_unstale":"2024-09-14T12:01:47.637216+0000","last_undegraded":"2024-09-14T12:01:47.637216+0000","last_fullsized":"2024-09-14T12:01:47.637216+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'384","last_scrub_stamp":"2024-09-14T12:01:47.637092+0000","last_deep_scrub":"263'384","last_deep_scrub_stamp":"2024-09-14T12:01:47.637092+0000","last_clean_scrub_stamp":"2024-09-14T12:01:47.637092+0000","objects_scrubbed":8,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:04.027878+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45582,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":610,"num_read_kb":1238,"num_write":470,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.839972+0000","last_change":"2024-09-14T12:01:45.839972+0000","last_active":"2024-09-14T12:01:45.839972+0000","last_peered":"2024-09-14T12:01:45.839972+0000","last_clean":"2024-09-14T12:01:45.839972+0000","last_became_active":"2024-09-14T10:46:52.369746+0000","last_became_peered":"2024-09-14T10:46:52.369746+0000","last_unstale":"2024-09-14T12:01:45.839972+0000","last_undegraded":"2024-09-14T12:01:45.839972+0000","last_fullsized":"2024-09-14T12:01:45.839972+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:45.839835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:45.839835+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.839835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:36.039659+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"263'159","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:50.116729+0000","last_change":"2024-09-14T12:01:50.116640+0000","last_active":"2024-09-14T12:01:50.116729+0000","last_peered":"2024-09-14T12:01:50.116729+0000","last_clean":"2024-09-14T12:01:50.116729+0000","last_became_active":"2024-09-14T10:46:54.384119+0000","last_became_peered":"2024-09-14T10:46:54.384119+0000","last_unstale":"2024-09-14T12:01:50.116729+0000","last_undegraded":"2024-09-14T12:01:50.116729+0000","last_fullsized":"2024-09-14T12:01:50.116729+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'159","last_scrub_stamp":"2024-09-14T12:01:50.116515+0000","last_deep_scrub":"263'159","last_deep_scrub_stamp":"2024-09-14T12:01:50.116515+0000","last_clean_scrub_stamp":"2024-09-14T12:01:50.116515+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:50.157955+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":393,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"263'777","reported_seq":2214,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.693165+0000","last_change":"2024-09-14T12:01:40.693092+0000","last_active":"2024-09-14T12:01:40.693165+0000","last_peered":"2024-09-14T12:01:40.693165+0000","last_clean":"2024-09-14T12:01:40.693165+0000","last_became_active":"2024-09-14T10:46:46.334444+0000","last_became_peered":"2024-09-14T10:46:46.334444+0000","last_unstale":"2024-09-14T12:01:40.693165+0000","last_undegraded":"2024-09-14T12:01:40.693165+0000","last_fullsized":"2024-09-14T12:01:40.693165+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'777","last_scrub_stamp":"2024-09-14T12:01:40.692994+0000","last_deep_scrub":"263'777","last_deep_scrub_stamp":"2024-09-14T12:01:40.692994+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.692994+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:37.634741+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3619,"num_read_kb":3234,"num_write":1038,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:24.785750+0000","last_change":"2024-09-14T12:01:24.785694+0000","last_active":"2024-09-14T12:01:24.785750+0000","last_peered":"2024-09-14T12:01:24.785750+0000","last_clean":"2024-09-14T12:01:24.785750+0000","last_became_active":"2024-09-14T10:46:26.241454+0000","last_became_peered":"2024-09-14T10:46:26.241454+0000","last_unstale":"2024-09-14T12:01:24.785750+0000","last_undegraded":"2024-09-14T12:01:24.785750+0000","last_fullsized":"2024-09-14T12:01:24.785750+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-14T12:01:24.785613+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-14T12:01:24.785613+0000","last_clean_scrub_stamp":"2024-09-14T12:01:24.785613+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:57.745824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":544,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.977324+0000","last_change":"2024-09-14T12:01:26.977273+0000","last_active":"2024-09-14T12:01:26.977324+0000","last_peered":"2024-09-14T12:01:26.977324+0000","last_clean":"2024-09-14T12:01:26.977324+0000","last_became_active":"2024-09-14T10:46:33.413305+0000","last_became_peered":"2024-09-14T10:46:33.413305+0000","last_unstale":"2024-09-14T12:01:26.977324+0000","last_undegraded":"2024-09-14T12:01:26.977324+0000","last_fullsized":"2024-09-14T12:01:26.977324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:01:26.977205+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:01:26.977205+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.977205+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:08.220234+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00092058099999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"263'313","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.725727+0000","last_change":"2024-09-14T12:01:26.725664+0000","last_active":"2024-09-14T12:01:26.725727+0000","last_peered":"2024-09-14T12:01:26.725727+0000","last_clean":"2024-09-14T12:01:26.725727+0000","last_became_active":"2024-09-14T10:46:44.329050+0000","last_became_peered":"2024-09-14T10:46:44.329050+0000","last_unstale":"2024-09-14T12:01:26.725727+0000","last_undegraded":"2024-09-14T12:01:26.725727+0000","last_fullsized":"2024-09-14T12:01:26.725727+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'313","last_scrub_stamp":"2024-09-14T12:01:26.725523+0000","last_deep_scrub":"263'313","last_deep_scrub_stamp":"2024-09-14T12:01:26.725523+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.725523+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:00.339260+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":32601,"num_write":1066,"num_write_kb":17351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"263'6","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.190055+0000","last_change":"2024-09-14T12:01:42.189983+0000","last_active":"2024-09-14T12:01:42.190055+0000","last_peered":"2024-09-14T12:01:42.190055+0000","last_clean":"2024-09-14T12:01:42.190055+0000","last_became_active":"2024-09-14T10:46:48.353319+0000","last_became_peered":"2024-09-14T10:46:48.353319+0000","last_unstale":"2024-09-14T12:01:42.190055+0000","last_undegraded":"2024-09-14T12:01:42.190055+0000","last_fullsized":"2024-09-14T12:01:42.190055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:01:42.189893+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:01:42.189893+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.189893+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:11.020543+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"263'802","reported_seq":1531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:56.794033+0000","last_change":"2024-09-14T12:01:56.793974+0000","last_active":"2024-09-14T12:01:56.794033+0000","last_peered":"2024-09-14T12:01:56.794033+0000","last_clean":"2024-09-14T12:01:56.794033+0000","last_became_active":"2024-09-14T10:46:50.362908+0000","last_became_peered":"2024-09-14T10:46:50.362908+0000","last_unstale":"2024-09-14T12:01:56.794033+0000","last_undegraded":"2024-09-14T12:01:56.794033+0000","last_fullsized":"2024-09-14T12:01:56.794033+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'802","last_scrub_stamp":"2024-09-14T12:01:56.793882+0000","last_deep_scrub":"263'802","last_deep_scrub_stamp":"2024-09-14T12:01:56.793882+0000","last_clean_scrub_stamp":"2024-09-14T12:01:56.793882+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:52.842437+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143024,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1563,"num_read_kb":3671,"num_write":1508,"num_write_kb":1333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":107076,"num_omap_keys":256,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:52.265791+0000","last_change":"2024-09-14T12:01:52.265705+0000","last_active":"2024-09-14T12:01:52.265791+0000","last_peered":"2024-09-14T12:01:52.265791+0000","last_clean":"2024-09-14T12:01:52.265791+0000","last_became_active":"2024-09-14T10:46:52.371684+0000","last_became_peered":"2024-09-14T10:46:52.371684+0000","last_unstale":"2024-09-14T12:01:52.265791+0000","last_undegraded":"2024-09-14T12:01:52.265791+0000","last_fullsized":"2024-09-14T12:01:52.265791+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:52.265585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:52.265585+0000","last_clean_scrub_stamp":"2024-09-14T12:01:52.265585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:39.262833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"263'209","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:49.266916+0000","last_change":"2024-09-14T12:01:49.266813+0000","last_active":"2024-09-14T12:01:49.266916+0000","last_peered":"2024-09-14T12:01:49.266916+0000","last_clean":"2024-09-14T12:01:49.266916+0000","last_became_active":"2024-09-14T10:46:54.382019+0000","last_became_peered":"2024-09-14T10:46:54.382019+0000","last_unstale":"2024-09-14T12:01:49.266916+0000","last_undegraded":"2024-09-14T12:01:49.266916+0000","last_fullsized":"2024-09-14T12:01:49.266916+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'209","last_scrub_stamp":"2024-09-14T12:01:49.266707+0000","last_deep_scrub":"263'209","last_deep_scrub_stamp":"2024-09-14T12:01:49.266707+0000","last_clean_scrub_stamp":"2024-09-14T12:01:49.266707+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:26.666088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":483,"num_read_kb":466,"num_write":435,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"263'817","reported_seq":2430,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.241130+0000","last_change":"2024-09-14T12:01:40.241075+0000","last_active":"2024-09-14T12:01:40.241130+0000","last_peered":"2024-09-14T12:01:40.241130+0000","last_clean":"2024-09-14T12:01:40.241130+0000","last_became_active":"2024-09-14T10:46:46.345302+0000","last_became_peered":"2024-09-14T10:46:46.345302+0000","last_unstale":"2024-09-14T12:01:40.241130+0000","last_undegraded":"2024-09-14T12:01:40.241130+0000","last_fullsized":"2024-09-14T12:01:40.241130+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'817","last_scrub_stamp":"2024-09-14T12:01:40.240992+0000","last_deep_scrub":"263'817","last_deep_scrub_stamp":"2024-09-14T12:01:40.240992+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.240992+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:38.435554+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3876,"num_read_kb":3495,"num_write":1050,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":544,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.885845+0000","last_change":"2024-09-14T12:01:29.885777+0000","last_active":"2024-09-14T12:01:29.885845+0000","last_peered":"2024-09-14T12:01:29.885845+0000","last_clean":"2024-09-14T12:01:29.885845+0000","last_became_active":"2024-09-14T10:46:33.265619+0000","last_became_peered":"2024-09-14T10:46:33.265619+0000","last_unstale":"2024-09-14T12:01:29.885845+0000","last_undegraded":"2024-09-14T12:01:29.885845+0000","last_fullsized":"2024-09-14T12:01:29.885845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:29.885692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:29.885692+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.885692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:24.477677+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00058478399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"263'340","reported_seq":1197,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.871096+0000","last_change":"2024-09-14T12:01:26.870978+0000","last_active":"2024-09-14T12:01:26.871096+0000","last_peered":"2024-09-14T12:01:26.871096+0000","last_clean":"2024-09-14T12:01:26.871096+0000","last_became_active":"2024-09-14T10:46:44.320087+0000","last_became_peered":"2024-09-14T10:46:44.320087+0000","last_unstale":"2024-09-14T12:01:26.871096+0000","last_undegraded":"2024-09-14T12:01:26.871096+0000","last_fullsized":"2024-09-14T12:01:26.871096+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-14T12:01:26.870853+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-14T12:01:26.870853+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.870853+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:41.798493+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1201,"num_read_kb":9242,"num_write":1119,"num_write_kb":25141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:47.868827+0000","last_change":"2024-09-14T12:01:47.868781+0000","last_active":"2024-09-14T12:01:47.868827+0000","last_peered":"2024-09-14T12:01:47.868827+0000","last_clean":"2024-09-14T12:01:47.868827+0000","last_became_active":"2024-09-14T10:46:48.350653+0000","last_became_peered":"2024-09-14T10:46:48.350653+0000","last_unstale":"2024-09-14T12:01:47.868827+0000","last_undegraded":"2024-09-14T12:01:47.868827+0000","last_fullsized":"2024-09-14T12:01:47.868827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:47.868723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:47.868723+0000","last_clean_scrub_stamp":"2024-09-14T12:01:47.868723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:50.120301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"263'1402","reported_seq":3252,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.028254+0000","last_change":"2024-09-14T12:01:43.028181+0000","last_active":"2024-09-14T12:01:43.028254+0000","last_peered":"2024-09-14T12:01:43.028254+0000","last_clean":"2024-09-14T12:01:43.028254+0000","last_became_active":"2024-09-14T10:46:50.362128+0000","last_became_peered":"2024-09-14T10:46:50.362128+0000","last_unstale":"2024-09-14T12:01:43.028254+0000","last_undegraded":"2024-09-14T12:01:43.028254+0000","last_fullsized":"2024-09-14T12:01:43.028254+0000","mapping_epoch":32,"log_start":"263'1300","ondisk_log_start":"263'1300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1402","last_scrub_stamp":"2024-09-14T12:01:43.028081+0000","last_deep_scrub":"263'1402","last_deep_scrub_stamp":"2024-09-14T12:01:43.028081+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.028081+0000","objects_scrubbed":11,"log_size":102,"log_dups_size":1300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:19.538730+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160652,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2189,"num_read_kb":4301,"num_write":1286,"num_write_kb":1103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:01.827342+0000","last_change":"2024-09-14T12:02:01.827342+0000","last_active":"2024-09-14T12:02:01.827342+0000","last_peered":"2024-09-14T12:02:01.827342+0000","last_clean":"2024-09-14T12:02:01.827342+0000","last_became_active":"2024-09-14T10:46:52.375344+0000","last_became_peered":"2024-09-14T10:46:52.375344+0000","last_unstale":"2024-09-14T12:02:01.827342+0000","last_undegraded":"2024-09-14T12:02:01.827342+0000","last_fullsized":"2024-09-14T12:02:01.827342+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:01.827261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:01.827261+0000","last_clean_scrub_stamp":"2024-09-14T12:02:01.827261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:08.647671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"263'97","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:59.156240+0000","last_change":"2024-09-14T12:01:59.156240+0000","last_active":"2024-09-14T12:01:59.156240+0000","last_peered":"2024-09-14T12:01:59.156240+0000","last_clean":"2024-09-14T12:01:59.156240+0000","last_became_active":"2024-09-14T10:46:54.384354+0000","last_became_peered":"2024-09-14T10:46:54.384354+0000","last_unstale":"2024-09-14T12:01:59.156240+0000","last_undegraded":"2024-09-14T12:01:59.156240+0000","last_fullsized":"2024-09-14T12:01:59.156240+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'97","last_scrub_stamp":"2024-09-14T12:01:59.156142+0000","last_deep_scrub":"263'97","last_deep_scrub_stamp":"2024-09-14T12:01:59.156142+0000","last_clean_scrub_stamp":"2024-09-14T12:01:59.156142+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:46.837849+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":95,"num_write":225,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"263'544","reported_seq":2147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.765527+0000","last_change":"2024-09-14T12:01:36.765468+0000","last_active":"2024-09-14T12:01:36.765527+0000","last_peered":"2024-09-14T12:01:36.765527+0000","last_clean":"2024-09-14T12:01:36.765527+0000","last_became_active":"2024-09-14T10:46:46.345234+0000","last_became_peered":"2024-09-14T10:46:46.345234+0000","last_unstale":"2024-09-14T12:01:36.765527+0000","last_undegraded":"2024-09-14T12:01:36.765527+0000","last_fullsized":"2024-09-14T12:01:36.765527+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'544","last_scrub_stamp":"2024-09-14T12:01:36.765372+0000","last_deep_scrub":"263'544","last_deep_scrub_stamp":"2024-09-14T12:01:36.765372+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.765372+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:30.549759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2916,"num_read_kb":2703,"num_write":726,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.209890+0000","last_change":"2024-09-14T12:01:27.209807+0000","last_active":"2024-09-14T12:01:27.209890+0000","last_peered":"2024-09-14T12:01:27.209890+0000","last_clean":"2024-09-14T12:01:27.209890+0000","last_became_active":"2024-09-14T10:46:33.265185+0000","last_became_peered":"2024-09-14T10:46:33.265185+0000","last_unstale":"2024-09-14T12:01:27.209890+0000","last_undegraded":"2024-09-14T12:01:27.209890+0000","last_fullsized":"2024-09-14T12:01:27.209890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:27.209695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:27.209695+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.209695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:02.705899+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000550246,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"263'312","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.345266+0000","last_change":"2024-09-14T12:01:27.345266+0000","last_active":"2024-09-14T12:01:27.345266+0000","last_peered":"2024-09-14T12:01:27.345266+0000","last_clean":"2024-09-14T12:01:27.345266+0000","last_became_active":"2024-09-14T10:46:44.327101+0000","last_became_peered":"2024-09-14T10:46:44.327101+0000","last_unstale":"2024-09-14T12:01:27.345266+0000","last_undegraded":"2024-09-14T12:01:27.345266+0000","last_fullsized":"2024-09-14T12:01:27.345266+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-09-14T12:01:27.345068+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-09-14T12:01:27.345068+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.345068+0000","objects_scrubbed":8,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:53.686484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":609,"num_read_kb":99380,"num_write":1036,"num_write_kb":24751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.052282+0000","last_change":"2024-09-14T12:01:37.052202+0000","last_active":"2024-09-14T12:01:37.052282+0000","last_peered":"2024-09-14T12:01:37.052282+0000","last_clean":"2024-09-14T12:01:37.052282+0000","last_became_active":"2024-09-14T10:46:48.353803+0000","last_became_peered":"2024-09-14T10:46:48.353803+0000","last_unstale":"2024-09-14T12:01:37.052282+0000","last_undegraded":"2024-09-14T12:01:37.052282+0000","last_fullsized":"2024-09-14T12:01:37.052282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:01:37.052124+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:01:37.052124+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.052124+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:29.304883+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"263'312","reported_seq":1770,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.207090+0000","last_change":"2024-09-14T12:01:44.207034+0000","last_active":"2024-09-14T12:01:44.207090+0000","last_peered":"2024-09-14T12:01:44.207090+0000","last_clean":"2024-09-14T12:01:44.207090+0000","last_became_active":"2024-09-14T10:46:50.364857+0000","last_became_peered":"2024-09-14T10:46:50.364857+0000","last_unstale":"2024-09-14T12:01:44.207090+0000","last_undegraded":"2024-09-14T12:01:44.207090+0000","last_fullsized":"2024-09-14T12:01:44.207090+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-09-14T12:01:44.206926+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-09-14T12:01:44.206926+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.206926+0000","objects_scrubbed":9,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:11.199275+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":263,"num_read_kb":255,"num_write":243,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:57.644275+0000","last_change":"2024-09-14T12:01:57.644275+0000","last_active":"2024-09-14T12:01:57.644275+0000","last_peered":"2024-09-14T12:01:57.644275+0000","last_clean":"2024-09-14T12:01:57.644275+0000","last_became_active":"2024-09-14T10:46:52.365738+0000","last_became_peered":"2024-09-14T10:46:52.365738+0000","last_unstale":"2024-09-14T12:01:57.644275+0000","last_undegraded":"2024-09-14T12:01:57.644275+0000","last_fullsized":"2024-09-14T12:01:57.644275+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:57.644189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:57.644189+0000","last_clean_scrub_stamp":"2024-09-14T12:01:57.644189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:33.830013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"263'264","reported_seq":875,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:02.658513+0000","last_change":"2024-09-14T12:02:02.658513+0000","last_active":"2024-09-14T12:02:02.658513+0000","last_peered":"2024-09-14T12:02:02.658513+0000","last_clean":"2024-09-14T12:02:02.658513+0000","last_became_active":"2024-09-14T10:46:54.378930+0000","last_became_peered":"2024-09-14T10:46:54.378930+0000","last_unstale":"2024-09-14T12:02:02.658513+0000","last_undegraded":"2024-09-14T12:02:02.658513+0000","last_fullsized":"2024-09-14T12:02:02.658513+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'264","last_scrub_stamp":"2024-09-14T12:02:02.658409+0000","last_deep_scrub":"263'264","last_deep_scrub_stamp":"2024-09-14T12:02:02.658409+0000","last_clean_scrub_stamp":"2024-09-14T12:02:02.658409+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:30.425911+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":478,"num_read_kb":502,"num_write":559,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"263'793","reported_seq":2368,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.802995+0000","last_change":"2024-09-14T12:01:37.802934+0000","last_active":"2024-09-14T12:01:37.802995+0000","last_peered":"2024-09-14T12:01:37.802995+0000","last_clean":"2024-09-14T12:01:37.802995+0000","last_became_active":"2024-09-14T10:46:46.334679+0000","last_became_peered":"2024-09-14T10:46:46.334679+0000","last_unstale":"2024-09-14T12:01:37.802995+0000","last_undegraded":"2024-09-14T12:01:37.802995+0000","last_fullsized":"2024-09-14T12:01:37.802995+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'793","last_scrub_stamp":"2024-09-14T12:01:37.802836+0000","last_deep_scrub":"263'793","last_deep_scrub_stamp":"2024-09-14T12:01:37.802836+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.802836+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:55.618222+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3681,"num_read_kb":3336,"num_write":1001,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":545,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.019260+0000","last_change":"2024-09-14T12:01:26.019205+0000","last_active":"2024-09-14T12:01:26.019260+0000","last_peered":"2024-09-14T12:01:26.019260+0000","last_clean":"2024-09-14T12:01:26.019260+0000","last_became_active":"2024-09-14T10:46:33.296172+0000","last_became_peered":"2024-09-14T10:46:33.296172+0000","last_unstale":"2024-09-14T12:01:26.019260+0000","last_undegraded":"2024-09-14T12:01:26.019260+0000","last_fullsized":"2024-09-14T12:01:26.019260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:01:26.019146+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:01:26.019146+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.019146+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:35.727762+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00125464,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"263'339","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:25.269255+0000","last_change":"2024-09-14T12:01:25.269159+0000","last_active":"2024-09-14T12:01:25.269255+0000","last_peered":"2024-09-14T12:01:25.269255+0000","last_clean":"2024-09-14T12:01:25.269255+0000","last_became_active":"2024-09-14T10:46:44.323974+0000","last_became_peered":"2024-09-14T10:46:44.323974+0000","last_unstale":"2024-09-14T12:01:25.269255+0000","last_undegraded":"2024-09-14T12:01:25.269255+0000","last_fullsized":"2024-09-14T12:01:25.269255+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-14T12:01:25.269042+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-14T12:01:25.269042+0000","last_clean_scrub_stamp":"2024-09-14T12:01:25.269042+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:28.484276+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":608,"num_read_kb":7380,"num_write":1200,"num_write_kb":32204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.996038+0000","last_change":"2024-09-14T12:01:40.995958+0000","last_active":"2024-09-14T12:01:40.996038+0000","last_peered":"2024-09-14T12:01:40.996038+0000","last_clean":"2024-09-14T12:01:40.996038+0000","last_became_active":"2024-09-14T10:46:48.354786+0000","last_became_peered":"2024-09-14T10:46:48.354786+0000","last_unstale":"2024-09-14T12:01:40.996038+0000","last_undegraded":"2024-09-14T12:01:40.996038+0000","last_fullsized":"2024-09-14T12:01:40.996038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:40.995844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:40.995844+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.995844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:43.561954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"263'161","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:50.315847+0000","last_change":"2024-09-14T12:01:50.315791+0000","last_active":"2024-09-14T12:01:50.315847+0000","last_peered":"2024-09-14T12:01:50.315847+0000","last_clean":"2024-09-14T12:01:50.315847+0000","last_became_active":"2024-09-14T10:46:50.363538+0000","last_became_peered":"2024-09-14T10:46:50.363538+0000","last_unstale":"2024-09-14T12:01:50.315847+0000","last_undegraded":"2024-09-14T12:01:50.315847+0000","last_fullsized":"2024-09-14T12:01:50.315847+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'161","last_scrub_stamp":"2024-09-14T12:01:50.315702+0000","last_deep_scrub":"263'161","last_deep_scrub_stamp":"2024-09-14T12:01:50.315702+0000","last_clean_scrub_stamp":"2024-09-14T12:01:50.315702+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:13.411298+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":198,"num_read_kb":192,"num_write":144,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:04.746608+0000","last_change":"2024-09-14T12:02:04.746554+0000","last_active":"2024-09-14T12:02:04.746608+0000","last_peered":"2024-09-14T12:02:04.746608+0000","last_clean":"2024-09-14T12:02:04.746608+0000","last_became_active":"2024-09-14T10:46:52.370968+0000","last_became_peered":"2024-09-14T10:46:52.370968+0000","last_unstale":"2024-09-14T12:02:04.746608+0000","last_undegraded":"2024-09-14T12:02:04.746608+0000","last_fullsized":"2024-09-14T12:02:04.746608+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:04.746470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:04.746470+0000","last_clean_scrub_stamp":"2024-09-14T12:02:04.746470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:34:30.928161+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"263'119","reported_seq":678,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:50.697828+0000","last_change":"2024-09-14T12:01:50.697762+0000","last_active":"2024-09-14T12:01:50.697828+0000","last_peered":"2024-09-14T12:01:50.697828+0000","last_clean":"2024-09-14T12:01:50.697828+0000","last_became_active":"2024-09-14T10:46:54.388938+0000","last_became_peered":"2024-09-14T10:46:54.388938+0000","last_unstale":"2024-09-14T12:01:50.697828+0000","last_undegraded":"2024-09-14T12:01:50.697828+0000","last_fullsized":"2024-09-14T12:01:50.697828+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-14T12:01:50.697663+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-14T12:01:50.697663+0000","last_clean_scrub_stamp":"2024-09-14T12:01:50.697663+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:43.120059+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":281,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"263'403","reported_seq":1975,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.717553+0000","last_change":"2024-09-14T12:01:35.717482+0000","last_active":"2024-09-14T12:01:35.717553+0000","last_peered":"2024-09-14T12:01:35.717553+0000","last_clean":"2024-09-14T12:01:35.717553+0000","last_became_active":"2024-09-14T10:46:46.335681+0000","last_became_peered":"2024-09-14T10:46:46.335681+0000","last_unstale":"2024-09-14T12:01:35.717553+0000","last_undegraded":"2024-09-14T12:01:35.717553+0000","last_fullsized":"2024-09-14T12:01:35.717553+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'403","last_scrub_stamp":"2024-09-14T12:01:35.717399+0000","last_deep_scrub":"263'403","last_deep_scrub_stamp":"2024-09-14T12:01:35.717399+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.717399+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:32.914757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2240,"num_read_kb":2136,"num_write":448,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"263'321","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:24.914885+0000","last_change":"2024-09-14T12:01:24.914780+0000","last_active":"2024-09-14T12:01:24.914885+0000","last_peered":"2024-09-14T12:01:24.914885+0000","last_clean":"2024-09-14T12:01:24.914885+0000","last_became_active":"2024-09-14T10:46:44.319714+0000","last_became_peered":"2024-09-14T10:46:44.319714+0000","last_unstale":"2024-09-14T12:01:24.914885+0000","last_undegraded":"2024-09-14T12:01:24.914885+0000","last_fullsized":"2024-09-14T12:01:24.914885+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'321","last_scrub_stamp":"2024-09-14T12:01:24.914659+0000","last_deep_scrub":"263'321","last_deep_scrub_stamp":"2024-09-14T12:01:24.914659+0000","last_clean_scrub_stamp":"2024-09-14T12:01:24.914659+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:48.960207+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":599,"num_read_kb":77773,"num_write":1050,"num_write_kb":36142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":537,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.360671+0000","last_change":"2024-09-14T12:01:26.360594+0000","last_active":"2024-09-14T12:01:26.360671+0000","last_peered":"2024-09-14T12:01:26.360671+0000","last_clean":"2024-09-14T12:01:26.360671+0000","last_became_active":"2024-09-14T10:46:33.296049+0000","last_became_peered":"2024-09-14T10:46:33.296049+0000","last_unstale":"2024-09-14T12:01:26.360671+0000","last_undegraded":"2024-09-14T12:01:26.360671+0000","last_fullsized":"2024-09-14T12:01:26.360671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:26.360503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:26.360503+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.360503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:22.237563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000560203,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.560481+0000","last_change":"2024-09-14T12:01:45.560422+0000","last_active":"2024-09-14T12:01:45.560481+0000","last_peered":"2024-09-14T12:01:45.560481+0000","last_clean":"2024-09-14T12:01:45.560481+0000","last_became_active":"2024-09-14T10:46:48.350088+0000","last_became_peered":"2024-09-14T10:46:48.350088+0000","last_unstale":"2024-09-14T12:01:45.560481+0000","last_undegraded":"2024-09-14T12:01:45.560481+0000","last_fullsized":"2024-09-14T12:01:45.560481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:45.560303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:45.560303+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.560303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:17.490367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"263'642","reported_seq":1335,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.053809+0000","last_change":"2024-09-14T12:01:38.053809+0000","last_active":"2024-09-14T12:01:38.053809+0000","last_peered":"2024-09-14T12:01:38.053809+0000","last_clean":"2024-09-14T12:01:38.053809+0000","last_became_active":"2024-09-14T10:46:50.363387+0000","last_became_peered":"2024-09-14T10:46:50.363387+0000","last_unstale":"2024-09-14T12:01:38.053809+0000","last_undegraded":"2024-09-14T12:01:38.053809+0000","last_fullsized":"2024-09-14T12:01:38.053809+0000","mapping_epoch":32,"log_start":"263'600","ondisk_log_start":"263'600","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'642","last_scrub_stamp":"2024-09-14T12:01:38.053687+0000","last_deep_scrub":"263'642","last_deep_scrub_stamp":"2024-09-14T12:01:38.053687+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.053687+0000","objects_scrubbed":9,"log_size":42,"log_dups_size":600,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:59.160442+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95765,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1702,"num_read_kb":2954,"num_write":2224,"num_write_kb":2032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":529556,"num_omap_keys":1194,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.851676+0000","last_change":"2024-09-14T12:01:44.851613+0000","last_active":"2024-09-14T12:01:44.851676+0000","last_peered":"2024-09-14T12:01:44.851676+0000","last_clean":"2024-09-14T12:01:44.851676+0000","last_became_active":"2024-09-14T10:46:52.373837+0000","last_became_peered":"2024-09-14T10:46:52.373837+0000","last_unstale":"2024-09-14T12:01:44.851676+0000","last_undegraded":"2024-09-14T12:01:44.851676+0000","last_fullsized":"2024-09-14T12:01:44.851676+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:44.851435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:44.851435+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.851435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:32.096919+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"263'156","reported_seq":672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:01.154325+0000","last_change":"2024-09-14T12:02:01.154325+0000","last_active":"2024-09-14T12:02:01.154325+0000","last_peered":"2024-09-14T12:02:01.154325+0000","last_clean":"2024-09-14T12:02:01.154325+0000","last_became_active":"2024-09-14T10:46:54.385835+0000","last_became_peered":"2024-09-14T10:46:54.385835+0000","last_unstale":"2024-09-14T12:02:01.154325+0000","last_undegraded":"2024-09-14T12:02:01.154325+0000","last_fullsized":"2024-09-14T12:02:01.154325+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'156","last_scrub_stamp":"2024-09-14T12:02:01.154233+0000","last_deep_scrub":"263'156","last_deep_scrub_stamp":"2024-09-14T12:02:01.154233+0000","last_clean_scrub_stamp":"2024-09-14T12:02:01.154233+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:33.941222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":168,"num_read_kb":158,"num_write":389,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"263'836","reported_seq":2488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.821942+0000","last_change":"2024-09-14T12:01:38.821888+0000","last_active":"2024-09-14T12:01:38.821942+0000","last_peered":"2024-09-14T12:01:38.821942+0000","last_clean":"2024-09-14T12:01:38.821942+0000","last_became_active":"2024-09-14T10:46:46.346072+0000","last_became_peered":"2024-09-14T10:46:46.346072+0000","last_unstale":"2024-09-14T12:01:38.821942+0000","last_undegraded":"2024-09-14T12:01:38.821942+0000","last_fullsized":"2024-09-14T12:01:38.821942+0000","mapping_epoch":28,"log_start":"263'800","ondisk_log_start":"263'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'836","last_scrub_stamp":"2024-09-14T12:01:38.821790+0000","last_deep_scrub":"263'836","last_deep_scrub_stamp":"2024-09-14T12:01:38.821790+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.821790+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:43.972793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4027,"num_read_kb":3636,"num_write":1084,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":476,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"263'385","reported_seq":1058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.833989+0000","last_change":"2024-09-14T12:01:28.833891+0000","last_active":"2024-09-14T12:01:28.833989+0000","last_peered":"2024-09-14T12:01:28.833989+0000","last_clean":"2024-09-14T12:01:28.833989+0000","last_became_active":"2024-09-14T10:46:44.317702+0000","last_became_peered":"2024-09-14T10:46:44.317702+0000","last_unstale":"2024-09-14T12:01:28.833989+0000","last_undegraded":"2024-09-14T12:01:28.833989+0000","last_fullsized":"2024-09-14T12:01:28.833989+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'385","last_scrub_stamp":"2024-09-14T12:01:28.833720+0000","last_deep_scrub":"263'385","last_deep_scrub_stamp":"2024-09-14T12:01:28.833720+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.833720+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:27.096840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":660,"num_read_kb":57005,"num_write":1181,"num_write_kb":30753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":542,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.935330+0000","last_change":"2024-09-14T12:01:27.935287+0000","last_active":"2024-09-14T12:01:27.935330+0000","last_peered":"2024-09-14T12:01:27.935330+0000","last_clean":"2024-09-14T12:01:27.935330+0000","last_became_active":"2024-09-14T10:46:33.265512+0000","last_became_peered":"2024-09-14T10:46:33.265512+0000","last_unstale":"2024-09-14T12:01:27.935330+0000","last_undegraded":"2024-09-14T12:01:27.935330+0000","last_fullsized":"2024-09-14T12:01:27.935330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:27.935219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:27.935219+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.935219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:28.603222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088449000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.260901+0000","last_change":"2024-09-14T12:01:40.260849+0000","last_active":"2024-09-14T12:01:40.260901+0000","last_peered":"2024-09-14T12:01:40.260901+0000","last_clean":"2024-09-14T12:01:40.260901+0000","last_became_active":"2024-09-14T10:46:48.353394+0000","last_became_peered":"2024-09-14T10:46:48.353394+0000","last_unstale":"2024-09-14T12:01:40.260901+0000","last_undegraded":"2024-09-14T12:01:40.260901+0000","last_fullsized":"2024-09-14T12:01:40.260901+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:40.260753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:40.260753+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.260753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:08.593537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"263'269","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:46.792061+0000","last_change":"2024-09-14T12:01:46.791996+0000","last_active":"2024-09-14T12:01:46.792061+0000","last_peered":"2024-09-14T12:01:46.792061+0000","last_clean":"2024-09-14T12:01:46.792061+0000","last_became_active":"2024-09-14T10:46:50.363436+0000","last_became_peered":"2024-09-14T10:46:50.363436+0000","last_unstale":"2024-09-14T12:01:46.792061+0000","last_undegraded":"2024-09-14T12:01:46.792061+0000","last_fullsized":"2024-09-14T12:01:46.792061+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'269","last_scrub_stamp":"2024-09-14T12:01:46.791905+0000","last_deep_scrub":"263'269","last_deep_scrub_stamp":"2024-09-14T12:01:46.791905+0000","last_clean_scrub_stamp":"2024-09-14T12:01:46.791905+0000","objects_scrubbed":8,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:52.672034+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":321,"num_read_kb":313,"num_write":296,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"263'803","reported_seq":2978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.574999+0000","last_change":"2024-09-14T12:01:45.574999+0000","last_active":"2024-09-14T12:01:45.574999+0000","last_peered":"2024-09-14T12:01:45.574999+0000","last_clean":"2024-09-14T12:01:45.574999+0000","last_became_active":"2024-09-14T10:46:52.373068+0000","last_became_peered":"2024-09-14T10:46:52.373068+0000","last_unstale":"2024-09-14T12:01:45.574999+0000","last_undegraded":"2024-09-14T12:01:45.574999+0000","last_fullsized":"2024-09-14T12:01:45.574999+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'803","last_scrub_stamp":"2024-09-14T12:01:45.574879+0000","last_deep_scrub":"263'803","last_deep_scrub_stamp":"2024-09-14T12:01:45.574879+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.574879+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:46.413388+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"263'142","reported_seq":648,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:51.119657+0000","last_change":"2024-09-14T12:01:51.119657+0000","last_active":"2024-09-14T12:01:51.119657+0000","last_peered":"2024-09-14T12:01:51.119657+0000","last_clean":"2024-09-14T12:01:51.119657+0000","last_became_active":"2024-09-14T10:46:54.387317+0000","last_became_peered":"2024-09-14T10:46:54.387317+0000","last_unstale":"2024-09-14T12:01:51.119657+0000","last_undegraded":"2024-09-14T12:01:51.119657+0000","last_fullsized":"2024-09-14T12:01:51.119657+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'142","last_scrub_stamp":"2024-09-14T12:01:51.119533+0000","last_deep_scrub":"263'142","last_deep_scrub_stamp":"2024-09-14T12:01:51.119533+0000","last_clean_scrub_stamp":"2024-09-14T12:01:51.119533+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:19.544541+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":117,"num_write":309,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"263'1368","reported_seq":3064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.720570+0000","last_change":"2024-09-14T12:01:34.720570+0000","last_active":"2024-09-14T12:01:34.720570+0000","last_peered":"2024-09-14T12:01:34.720570+0000","last_clean":"2024-09-14T12:01:34.720570+0000","last_became_active":"2024-09-14T10:46:46.344799+0000","last_became_peered":"2024-09-14T10:46:46.344799+0000","last_unstale":"2024-09-14T12:01:34.720570+0000","last_undegraded":"2024-09-14T12:01:34.720570+0000","last_fullsized":"2024-09-14T12:01:34.720570+0000","mapping_epoch":28,"log_start":"263'1300","ondisk_log_start":"263'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1368","last_scrub_stamp":"2024-09-14T12:01:34.720456+0000","last_deep_scrub":"263'1368","last_deep_scrub_stamp":"2024-09-14T12:01:34.720456+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.720456+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":1300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:58.415618+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6397,"num_read_kb":5617,"num_write":2035,"num_write_kb":974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"263'403","reported_seq":1220,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.693964+0000","last_change":"2024-09-14T12:01:29.693900+0000","last_active":"2024-09-14T12:01:29.693964+0000","last_peered":"2024-09-14T12:01:29.693964+0000","last_clean":"2024-09-14T12:01:29.693964+0000","last_became_active":"2024-09-14T10:46:44.324158+0000","last_became_peered":"2024-09-14T10:46:44.324158+0000","last_unstale":"2024-09-14T12:01:29.693964+0000","last_undegraded":"2024-09-14T12:01:29.693964+0000","last_fullsized":"2024-09-14T12:01:29.693964+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'403","last_scrub_stamp":"2024-09-14T12:01:29.693790+0000","last_deep_scrub":"263'403","last_deep_scrub_stamp":"2024-09-14T12:01:29.693790+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.693790+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:00.163688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":514873,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1028,"num_read_kb":45406,"num_write":1187,"num_write_kb":52499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":540,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.691699+0000","last_change":"2024-09-14T12:01:27.691638+0000","last_active":"2024-09-14T12:01:27.691699+0000","last_peered":"2024-09-14T12:01:27.691699+0000","last_clean":"2024-09-14T12:01:27.691699+0000","last_became_active":"2024-09-14T10:46:33.262218+0000","last_became_peered":"2024-09-14T10:46:33.262218+0000","last_unstale":"2024-09-14T12:01:27.691699+0000","last_undegraded":"2024-09-14T12:01:27.691699+0000","last_fullsized":"2024-09-14T12:01:27.691699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:27.691538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:27.691538+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.691538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:47.244884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072314099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:49.891037+0000","last_change":"2024-09-14T12:01:49.890983+0000","last_active":"2024-09-14T12:01:49.891037+0000","last_peered":"2024-09-14T12:01:49.891037+0000","last_clean":"2024-09-14T12:01:49.891037+0000","last_became_active":"2024-09-14T10:46:48.349924+0000","last_became_peered":"2024-09-14T10:46:48.349924+0000","last_unstale":"2024-09-14T12:01:49.891037+0000","last_undegraded":"2024-09-14T12:01:49.891037+0000","last_fullsized":"2024-09-14T12:01:49.891037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:49.890893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:49.890893+0000","last_clean_scrub_stamp":"2024-09-14T12:01:49.890893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:32.799420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"263'136","reported_seq":704,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:55.821044+0000","last_change":"2024-09-14T12:01:55.821044+0000","last_active":"2024-09-14T12:01:55.821044+0000","last_peered":"2024-09-14T12:01:55.821044+0000","last_clean":"2024-09-14T12:01:55.821044+0000","last_became_active":"2024-09-14T10:46:50.366610+0000","last_became_peered":"2024-09-14T10:46:50.366610+0000","last_unstale":"2024-09-14T12:01:55.821044+0000","last_undegraded":"2024-09-14T12:01:55.821044+0000","last_fullsized":"2024-09-14T12:01:55.821044+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-14T12:01:55.820939+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-14T12:01:55.820939+0000","last_clean_scrub_stamp":"2024-09-14T12:01:55.820939+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:58.153249+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"263'832","reported_seq":2805,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:53.243187+0000","last_change":"2024-09-14T12:01:53.243135+0000","last_active":"2024-09-14T12:01:53.243187+0000","last_peered":"2024-09-14T12:01:53.243187+0000","last_clean":"2024-09-14T12:01:53.243187+0000","last_became_active":"2024-09-14T10:46:52.370514+0000","last_became_peered":"2024-09-14T10:46:52.370514+0000","last_unstale":"2024-09-14T12:01:53.243187+0000","last_undegraded":"2024-09-14T12:01:53.243187+0000","last_fullsized":"2024-09-14T12:01:53.243187+0000","mapping_epoch":34,"log_start":"263'800","ondisk_log_start":"263'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'832","last_scrub_stamp":"2024-09-14T12:01:53.243054+0000","last_deep_scrub":"263'832","last_deep_scrub_stamp":"2024-09-14T12:01:53.243054+0000","last_clean_scrub_stamp":"2024-09-14T12:01:53.243054+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:44.102830+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"263'313","reported_seq":861,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:00.143351+0000","last_change":"2024-09-14T12:02:00.143351+0000","last_active":"2024-09-14T12:02:00.143351+0000","last_peered":"2024-09-14T12:02:00.143351+0000","last_clean":"2024-09-14T12:02:00.143351+0000","last_became_active":"2024-09-14T10:46:54.382860+0000","last_became_peered":"2024-09-14T10:46:54.382860+0000","last_unstale":"2024-09-14T12:02:00.143351+0000","last_undegraded":"2024-09-14T12:02:00.143351+0000","last_fullsized":"2024-09-14T12:02:00.143351+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'313","last_scrub_stamp":"2024-09-14T12:02:00.143252+0000","last_deep_scrub":"263'313","last_deep_scrub_stamp":"2024-09-14T12:02:00.143252+0000","last_clean_scrub_stamp":"2024-09-14T12:02:00.143252+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:06.813748+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":895,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":402,"num_read_kb":382,"num_write":591,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"263'1148","reported_seq":2854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.846285+0000","last_change":"2024-09-14T12:01:31.846208+0000","last_active":"2024-09-14T12:01:31.846285+0000","last_peered":"2024-09-14T12:01:31.846285+0000","last_clean":"2024-09-14T12:01:31.846285+0000","last_became_active":"2024-09-14T10:46:46.338543+0000","last_became_peered":"2024-09-14T10:46:46.338543+0000","last_unstale":"2024-09-14T12:01:31.846285+0000","last_undegraded":"2024-09-14T12:01:31.846285+0000","last_fullsized":"2024-09-14T12:01:31.846285+0000","mapping_epoch":28,"log_start":"263'1100","ondisk_log_start":"263'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1148","last_scrub_stamp":"2024-09-14T12:01:31.846127+0000","last_deep_scrub":"263'1148","last_deep_scrub_stamp":"2024-09-14T12:01:31.846127+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.846127+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":1100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:13.145120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5511,"num_read_kb":4909,"num_write":1576,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1532,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"263'347","reported_seq":1005,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.669113+0000","last_change":"2024-09-14T12:01:28.669051+0000","last_active":"2024-09-14T12:01:28.669113+0000","last_peered":"2024-09-14T12:01:28.669113+0000","last_clean":"2024-09-14T12:01:28.669113+0000","last_became_active":"2024-09-14T10:46:44.318777+0000","last_became_peered":"2024-09-14T10:46:44.318777+0000","last_unstale":"2024-09-14T12:01:28.669113+0000","last_undegraded":"2024-09-14T12:01:28.669113+0000","last_fullsized":"2024-09-14T12:01:28.669113+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-09-14T12:01:28.668927+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-09-14T12:01:28.668927+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.668927+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:05.341520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":579,"num_read_kb":36295,"num_write":1107,"num_write_kb":33618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":541,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.924857+0000","last_change":"2024-09-14T12:01:28.924797+0000","last_active":"2024-09-14T12:01:28.924857+0000","last_peered":"2024-09-14T12:01:28.924857+0000","last_clean":"2024-09-14T12:01:28.924857+0000","last_became_active":"2024-09-14T10:46:33.265515+0000","last_became_peered":"2024-09-14T10:46:33.265515+0000","last_unstale":"2024-09-14T12:01:28.924857+0000","last_undegraded":"2024-09-14T12:01:28.924857+0000","last_fullsized":"2024-09-14T12:01:28.924857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:28.924676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:28.924676+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.924676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:40.550273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061284299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.515366+0000","last_change":"2024-09-14T12:01:44.515366+0000","last_active":"2024-09-14T12:01:44.515366+0000","last_peered":"2024-09-14T12:01:44.515366+0000","last_clean":"2024-09-14T12:01:44.515366+0000","last_became_active":"2024-09-14T10:46:48.354373+0000","last_became_peered":"2024-09-14T10:46:48.354373+0000","last_unstale":"2024-09-14T12:01:44.515366+0000","last_undegraded":"2024-09-14T12:01:44.515366+0000","last_fullsized":"2024-09-14T12:01:44.515366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:44.515279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:44.515279+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.515279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:32.779390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"263'728","reported_seq":1479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.193975+0000","last_change":"2024-09-14T12:01:43.193914+0000","last_active":"2024-09-14T12:01:43.193975+0000","last_peered":"2024-09-14T12:01:43.193975+0000","last_clean":"2024-09-14T12:01:43.193975+0000","last_became_active":"2024-09-14T10:46:50.362397+0000","last_became_peered":"2024-09-14T10:46:50.362397+0000","last_unstale":"2024-09-14T12:01:43.193975+0000","last_undegraded":"2024-09-14T12:01:43.193975+0000","last_fullsized":"2024-09-14T12:01:43.193975+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'728","last_scrub_stamp":"2024-09-14T12:01:43.193809+0000","last_deep_scrub":"263'728","last_deep_scrub_stamp":"2024-09-14T12:01:43.193809+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.193809+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":700,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:59.964839+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1285,"num_read_kb":3031,"num_write":1024,"num_write_kb":812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:56.606946+0000","last_change":"2024-09-14T12:01:56.606946+0000","last_active":"2024-09-14T12:01:56.606946+0000","last_peered":"2024-09-14T12:01:56.606946+0000","last_clean":"2024-09-14T12:01:56.606946+0000","last_became_active":"2024-09-14T10:46:52.370107+0000","last_became_peered":"2024-09-14T10:46:52.370107+0000","last_unstale":"2024-09-14T12:01:56.606946+0000","last_undegraded":"2024-09-14T12:01:56.606946+0000","last_fullsized":"2024-09-14T12:01:56.606946+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:56.606853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:56.606853+0000","last_clean_scrub_stamp":"2024-09-14T12:01:56.606853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:31.667227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"263'134","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:49.886658+0000","last_change":"2024-09-14T12:01:49.886658+0000","last_active":"2024-09-14T12:01:49.886658+0000","last_peered":"2024-09-14T12:01:49.886658+0000","last_clean":"2024-09-14T12:01:49.886658+0000","last_became_active":"2024-09-14T10:46:54.383813+0000","last_became_peered":"2024-09-14T10:46:54.383813+0000","last_unstale":"2024-09-14T12:01:49.886658+0000","last_undegraded":"2024-09-14T12:01:49.886658+0000","last_fullsized":"2024-09-14T12:01:49.886658+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'134","last_scrub_stamp":"2024-09-14T12:01:49.886576+0000","last_deep_scrub":"263'134","last_deep_scrub_stamp":"2024-09-14T12:01:49.886576+0000","last_clean_scrub_stamp":"2024-09-14T12:01:49.886576+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:09.354708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":350,"num_read_kb":289,"num_write":327,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"263'151","reported_seq":720,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:01.687668+0000","last_change":"2024-09-14T12:02:01.687668+0000","last_active":"2024-09-14T12:02:01.687668+0000","last_peered":"2024-09-14T12:02:01.687668+0000","last_clean":"2024-09-14T12:02:01.687668+0000","last_became_active":"2024-09-14T10:46:54.383742+0000","last_became_peered":"2024-09-14T10:46:54.383742+0000","last_unstale":"2024-09-14T12:02:01.687668+0000","last_undegraded":"2024-09-14T12:02:01.687668+0000","last_fullsized":"2024-09-14T12:02:01.687668+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'151","last_scrub_stamp":"2024-09-14T12:02:01.687538+0000","last_deep_scrub":"263'151","last_deep_scrub_stamp":"2024-09-14T12:02:01.687538+0000","last_clean_scrub_stamp":"2024-09-14T12:02:01.687538+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:13.283493+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":212,"num_read_kb":210,"num_write":346,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"263'703","reported_seq":2564,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.816238+0000","last_change":"2024-09-14T12:01:33.816238+0000","last_active":"2024-09-14T12:01:33.816238+0000","last_peered":"2024-09-14T12:01:33.816238+0000","last_clean":"2024-09-14T12:01:33.816238+0000","last_became_active":"2024-09-14T10:46:46.337818+0000","last_became_peered":"2024-09-14T10:46:46.337818+0000","last_unstale":"2024-09-14T12:01:33.816238+0000","last_undegraded":"2024-09-14T12:01:33.816238+0000","last_fullsized":"2024-09-14T12:01:33.816238+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'703","last_scrub_stamp":"2024-09-14T12:01:33.816161+0000","last_deep_scrub":"263'703","last_deep_scrub_stamp":"2024-09-14T12:01:33.816161+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.816161+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:12.842729+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3744,"num_read_kb":3411,"num_write":893,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2266,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"263'332","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.757635+0000","last_change":"2024-09-14T12:01:36.757635+0000","last_active":"2024-09-14T12:01:36.757635+0000","last_peered":"2024-09-14T12:01:36.757635+0000","last_clean":"2024-09-14T12:01:36.757635+0000","last_became_active":"2024-09-14T10:46:44.332607+0000","last_became_peered":"2024-09-14T10:46:44.332607+0000","last_unstale":"2024-09-14T12:01:36.757635+0000","last_undegraded":"2024-09-14T12:01:36.757635+0000","last_fullsized":"2024-09-14T12:01:36.757635+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'332","last_scrub_stamp":"2024-09-14T12:01:36.757421+0000","last_deep_scrub":"263'332","last_deep_scrub_stamp":"2024-09-14T12:01:36.757421+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.757421+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:10.285355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":554,"num_read_kb":15763,"num_write":1023,"num_write_kb":46520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:48.839413+0000","last_change":"2024-09-14T12:01:48.839413+0000","last_active":"2024-09-14T12:01:48.839413+0000","last_peered":"2024-09-14T12:01:48.839413+0000","last_clean":"2024-09-14T12:01:48.839413+0000","last_became_active":"2024-09-14T10:46:48.353125+0000","last_became_peered":"2024-09-14T10:46:48.353125+0000","last_unstale":"2024-09-14T12:01:48.839413+0000","last_undegraded":"2024-09-14T12:01:48.839413+0000","last_fullsized":"2024-09-14T12:01:48.839413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:48.839288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:48.839288+0000","last_clean_scrub_stamp":"2024-09-14T12:01:48.839288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:58.967280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"263'339","reported_seq":936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:47.806535+0000","last_change":"2024-09-14T12:01:47.806535+0000","last_active":"2024-09-14T12:01:47.806535+0000","last_peered":"2024-09-14T12:01:47.806535+0000","last_clean":"2024-09-14T12:01:47.806535+0000","last_became_active":"2024-09-14T10:46:50.364874+0000","last_became_peered":"2024-09-14T10:46:50.364874+0000","last_unstale":"2024-09-14T12:01:47.806535+0000","last_undegraded":"2024-09-14T12:01:47.806535+0000","last_fullsized":"2024-09-14T12:01:47.806535+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-14T12:01:47.806449+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-14T12:01:47.806449+0000","last_clean_scrub_stamp":"2024-09-14T12:01:47.806449+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:34.200759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58887,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":550,"num_read_kb":1323,"num_write":450,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:47.041018+0000","last_change":"2024-09-14T12:01:47.041018+0000","last_active":"2024-09-14T12:01:47.041018+0000","last_peered":"2024-09-14T12:01:47.041018+0000","last_clean":"2024-09-14T12:01:47.041018+0000","last_became_active":"2024-09-14T10:46:52.373982+0000","last_became_peered":"2024-09-14T10:46:52.373982+0000","last_unstale":"2024-09-14T12:01:47.041018+0000","last_undegraded":"2024-09-14T12:01:47.041018+0000","last_fullsized":"2024-09-14T12:01:47.041018+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:47.040933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:47.040933+0000","last_clean_scrub_stamp":"2024-09-14T12:01:47.040933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:05.191928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"263'117","reported_seq":621,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:52.116650+0000","last_change":"2024-09-14T12:01:52.116650+0000","last_active":"2024-09-14T12:01:52.116650+0000","last_peered":"2024-09-14T12:01:52.116650+0000","last_clean":"2024-09-14T12:01:52.116650+0000","last_became_active":"2024-09-14T10:46:54.387552+0000","last_became_peered":"2024-09-14T10:46:54.387552+0000","last_unstale":"2024-09-14T12:01:52.116650+0000","last_undegraded":"2024-09-14T12:01:52.116650+0000","last_fullsized":"2024-09-14T12:01:52.116650+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'117","last_scrub_stamp":"2024-09-14T12:01:52.116556+0000","last_deep_scrub":"263'117","last_deep_scrub_stamp":"2024-09-14T12:01:52.116556+0000","last_clean_scrub_stamp":"2024-09-14T12:01:52.116556+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:05.469835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":107,"num_write":284,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"263'407","reported_seq":1864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.672684+0000","last_change":"2024-09-14T12:01:36.672684+0000","last_active":"2024-09-14T12:01:36.672684+0000","last_peered":"2024-09-14T12:01:36.672684+0000","last_clean":"2024-09-14T12:01:36.672684+0000","last_became_active":"2024-09-14T10:46:46.348040+0000","last_became_peered":"2024-09-14T10:46:46.348040+0000","last_unstale":"2024-09-14T12:01:36.672684+0000","last_undegraded":"2024-09-14T12:01:36.672684+0000","last_fullsized":"2024-09-14T12:01:36.672684+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'407","last_scrub_stamp":"2024-09-14T12:01:36.672588+0000","last_deep_scrub":"263'407","last_deep_scrub_stamp":"2024-09-14T12:01:36.672588+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.672588+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:46.183322+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2178,"num_read_kb":2045,"num_write":462,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"263'336","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.276975+0000","last_change":"2024-09-14T12:01:26.276921+0000","last_active":"2024-09-14T12:01:26.276975+0000","last_peered":"2024-09-14T12:01:26.276975+0000","last_clean":"2024-09-14T12:01:26.276975+0000","last_became_active":"2024-09-14T10:46:44.333195+0000","last_became_peered":"2024-09-14T10:46:44.333195+0000","last_unstale":"2024-09-14T12:01:26.276975+0000","last_undegraded":"2024-09-14T12:01:26.276975+0000","last_fullsized":"2024-09-14T12:01:26.276975+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'336","last_scrub_stamp":"2024-09-14T12:01:26.276834+0000","last_deep_scrub":"263'336","last_deep_scrub_stamp":"2024-09-14T12:01:26.276834+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.276834+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:00:55.874383+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":77356,"num_write":1081,"num_write_kb":55140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:47.513522+0000","last_change":"2024-09-14T12:01:47.513522+0000","last_active":"2024-09-14T12:01:47.513522+0000","last_peered":"2024-09-14T12:01:47.513522+0000","last_clean":"2024-09-14T12:01:47.513522+0000","last_became_active":"2024-09-14T10:46:48.357033+0000","last_became_peered":"2024-09-14T10:46:48.357033+0000","last_unstale":"2024-09-14T12:01:47.513522+0000","last_undegraded":"2024-09-14T12:01:47.513522+0000","last_fullsized":"2024-09-14T12:01:47.513522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:47.513436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:47.513436+0000","last_clean_scrub_stamp":"2024-09-14T12:01:47.513436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:22.660153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"263'66","reported_seq":588,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:52.571492+0000","last_change":"2024-09-14T12:01:52.571492+0000","last_active":"2024-09-14T12:01:52.571492+0000","last_peered":"2024-09-14T12:01:52.571492+0000","last_clean":"2024-09-14T12:01:52.571492+0000","last_became_active":"2024-09-14T10:46:50.362878+0000","last_became_peered":"2024-09-14T10:46:50.362878+0000","last_unstale":"2024-09-14T12:01:52.571492+0000","last_undegraded":"2024-09-14T12:01:52.571492+0000","last_fullsized":"2024-09-14T12:01:52.571492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'66","last_scrub_stamp":"2024-09-14T12:01:52.571399+0000","last_deep_scrub":"263'66","last_deep_scrub_stamp":"2024-09-14T12:01:52.571399+0000","last_clean_scrub_stamp":"2024-09-14T12:01:52.571399+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:05.602319+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:46.793396+0000","last_change":"2024-09-14T12:01:46.793396+0000","last_active":"2024-09-14T12:01:46.793396+0000","last_peered":"2024-09-14T12:01:46.793396+0000","last_clean":"2024-09-14T12:01:46.793396+0000","last_became_active":"2024-09-14T10:46:52.365987+0000","last_became_peered":"2024-09-14T10:46:52.365987+0000","last_unstale":"2024-09-14T12:01:46.793396+0000","last_undegraded":"2024-09-14T12:01:46.793396+0000","last_fullsized":"2024-09-14T12:01:46.793396+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:46.793292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:46.793292+0000","last_clean_scrub_stamp":"2024-09-14T12:01:46.793292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:54.685984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"263'201","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:55.827104+0000","last_change":"2024-09-14T12:01:55.827043+0000","last_active":"2024-09-14T12:01:55.827104+0000","last_peered":"2024-09-14T12:01:55.827104+0000","last_clean":"2024-09-14T12:01:55.827104+0000","last_became_active":"2024-09-14T10:46:54.383284+0000","last_became_peered":"2024-09-14T10:46:54.383284+0000","last_unstale":"2024-09-14T12:01:55.827104+0000","last_undegraded":"2024-09-14T12:01:55.827104+0000","last_fullsized":"2024-09-14T12:01:55.827104+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'201","last_scrub_stamp":"2024-09-14T12:01:55.826936+0000","last_deep_scrub":"263'201","last_deep_scrub_stamp":"2024-09-14T12:01:55.826936+0000","last_clean_scrub_stamp":"2024-09-14T12:01:55.826936+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:17.041024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":348,"num_read_kb":326,"num_write":460,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"263'466","reported_seq":2101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.701686+0000","last_change":"2024-09-14T12:01:35.701686+0000","last_active":"2024-09-14T12:01:35.701686+0000","last_peered":"2024-09-14T12:01:35.701686+0000","last_clean":"2024-09-14T12:01:35.701686+0000","last_became_active":"2024-09-14T10:46:46.341424+0000","last_became_peered":"2024-09-14T10:46:46.341424+0000","last_unstale":"2024-09-14T12:01:35.701686+0000","last_undegraded":"2024-09-14T12:01:35.701686+0000","last_fullsized":"2024-09-14T12:01:35.701686+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'466","last_scrub_stamp":"2024-09-14T12:01:35.701589+0000","last_deep_scrub":"263'466","last_deep_scrub_stamp":"2024-09-14T12:01:35.701589+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.701589+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:23.244730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2571,"num_read_kb":2437,"num_write":538,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"263'326","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.895420+0000","last_change":"2024-09-14T12:01:27.895339+0000","last_active":"2024-09-14T12:01:27.895420+0000","last_peered":"2024-09-14T12:01:27.895420+0000","last_clean":"2024-09-14T12:01:27.895420+0000","last_became_active":"2024-09-14T10:46:44.321694+0000","last_became_peered":"2024-09-14T10:46:44.321694+0000","last_unstale":"2024-09-14T12:01:27.895420+0000","last_undegraded":"2024-09-14T12:01:27.895420+0000","last_fullsized":"2024-09-14T12:01:27.895420+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'326","last_scrub_stamp":"2024-09-14T12:01:27.895250+0000","last_deep_scrub":"263'326","last_deep_scrub_stamp":"2024-09-14T12:01:27.895250+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.895250+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:46.249003+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":535,"num_read_kb":12444,"num_write":977,"num_write_kb":13958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.839618+0000","last_change":"2024-09-14T12:01:37.839618+0000","last_active":"2024-09-14T12:01:37.839618+0000","last_peered":"2024-09-14T12:01:37.839618+0000","last_clean":"2024-09-14T12:01:37.839618+0000","last_became_active":"2024-09-14T10:46:48.350714+0000","last_became_peered":"2024-09-14T10:46:48.350714+0000","last_unstale":"2024-09-14T12:01:37.839618+0000","last_undegraded":"2024-09-14T12:01:37.839618+0000","last_fullsized":"2024-09-14T12:01:37.839618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:37.839539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:37.839539+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.839539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:51.881085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"263'343","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.015254+0000","last_change":"2024-09-14T12:01:45.015254+0000","last_active":"2024-09-14T12:01:45.015254+0000","last_peered":"2024-09-14T12:01:45.015254+0000","last_clean":"2024-09-14T12:01:45.015254+0000","last_became_active":"2024-09-14T10:46:50.360886+0000","last_became_peered":"2024-09-14T10:46:50.360886+0000","last_unstale":"2024-09-14T12:01:45.015254+0000","last_undegraded":"2024-09-14T12:01:45.015254+0000","last_fullsized":"2024-09-14T12:01:45.015254+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-14T12:01:45.015155+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-14T12:01:45.015155+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.015155+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:22.667188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50451,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":558,"num_read_kb":1238,"num_write":442,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.600309+0000","last_change":"2024-09-14T12:01:44.600309+0000","last_active":"2024-09-14T12:01:44.600309+0000","last_peered":"2024-09-14T12:01:44.600309+0000","last_clean":"2024-09-14T12:01:44.600309+0000","last_became_active":"2024-09-14T10:46:52.375120+0000","last_became_peered":"2024-09-14T10:46:52.375120+0000","last_unstale":"2024-09-14T12:01:44.600309+0000","last_undegraded":"2024-09-14T12:01:44.600309+0000","last_fullsized":"2024-09-14T12:01:44.600309+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:44.600220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:44.600220+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.600220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:15.281267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"263'127","reported_seq":657,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:10.677184+0000","last_change":"2024-09-14T12:02:10.677184+0000","last_active":"2024-09-14T12:02:10.677184+0000","last_peered":"2024-09-14T12:02:10.677184+0000","last_clean":"2024-09-14T12:02:10.677184+0000","last_became_active":"2024-09-14T10:46:54.384113+0000","last_became_peered":"2024-09-14T10:46:54.384113+0000","last_unstale":"2024-09-14T12:02:10.677184+0000","last_undegraded":"2024-09-14T12:02:10.677184+0000","last_fullsized":"2024-09-14T12:02:10.677184+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'127","last_scrub_stamp":"2024-09-14T12:02:10.677084+0000","last_deep_scrub":"263'127","last_deep_scrub_stamp":"2024-09-14T12:02:10.677084+0000","last_clean_scrub_stamp":"2024-09-14T12:02:10.677084+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:11.369479+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":180,"num_read_kb":170,"num_write":302,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"263'381","reported_seq":2036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.108765+0000","last_change":"2024-09-14T12:01:33.108765+0000","last_active":"2024-09-14T12:01:33.108765+0000","last_peered":"2024-09-14T12:01:33.108765+0000","last_clean":"2024-09-14T12:01:33.108765+0000","last_became_active":"2024-09-14T10:46:46.346318+0000","last_became_peered":"2024-09-14T10:46:46.346318+0000","last_unstale":"2024-09-14T12:01:33.108765+0000","last_undegraded":"2024-09-14T12:01:33.108765+0000","last_fullsized":"2024-09-14T12:01:33.108765+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'381","last_scrub_stamp":"2024-09-14T12:01:33.108674+0000","last_deep_scrub":"263'381","last_deep_scrub_stamp":"2024-09-14T12:01:33.108674+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.108674+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:22.079780+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2319,"num_read_kb":2246,"num_write":412,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2047,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"263'411","reported_seq":1088,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.374129+0000","last_change":"2024-09-14T12:01:28.374029+0000","last_active":"2024-09-14T12:01:28.374129+0000","last_peered":"2024-09-14T12:01:28.374129+0000","last_clean":"2024-09-14T12:01:28.374129+0000","last_became_active":"2024-09-14T10:46:44.332841+0000","last_became_peered":"2024-09-14T10:46:44.332841+0000","last_unstale":"2024-09-14T12:01:28.374129+0000","last_undegraded":"2024-09-14T12:01:28.374129+0000","last_fullsized":"2024-09-14T12:01:28.374129+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-09-14T12:01:28.373852+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-09-14T12:01:28.373852+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.373852+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:25.272342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133711,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":772,"num_read_kb":6861,"num_write":1433,"num_write_kb":25110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:52.849829+0000","last_change":"2024-09-14T12:01:52.849829+0000","last_active":"2024-09-14T12:01:52.849829+0000","last_peered":"2024-09-14T12:01:52.849829+0000","last_clean":"2024-09-14T12:01:52.849829+0000","last_became_active":"2024-09-14T10:46:48.353010+0000","last_became_peered":"2024-09-14T10:46:48.353010+0000","last_unstale":"2024-09-14T12:01:52.849829+0000","last_undegraded":"2024-09-14T12:01:52.849829+0000","last_fullsized":"2024-09-14T12:01:52.849829+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:52.849742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:52.849742+0000","last_clean_scrub_stamp":"2024-09-14T12:01:52.849742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:37.169755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"263'289","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:47.191562+0000","last_change":"2024-09-14T12:01:47.191562+0000","last_active":"2024-09-14T12:01:47.191562+0000","last_peered":"2024-09-14T12:01:47.191562+0000","last_clean":"2024-09-14T12:01:47.191562+0000","last_became_active":"2024-09-14T10:46:50.362723+0000","last_became_peered":"2024-09-14T10:46:50.362723+0000","last_unstale":"2024-09-14T12:01:47.191562+0000","last_undegraded":"2024-09-14T12:01:47.191562+0000","last_fullsized":"2024-09-14T12:01:47.191562+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'289","last_scrub_stamp":"2024-09-14T12:01:47.191473+0000","last_deep_scrub":"263'289","last_deep_scrub_stamp":"2024-09-14T12:01:47.191473+0000","last_clean_scrub_stamp":"2024-09-14T12:01:47.191473+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:32.942349+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44996,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":451,"num_read_kb":1030,"num_write":360,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:46.048503+0000","last_change":"2024-09-14T12:01:46.048503+0000","last_active":"2024-09-14T12:01:46.048503+0000","last_peered":"2024-09-14T12:01:46.048503+0000","last_clean":"2024-09-14T12:01:46.048503+0000","last_became_active":"2024-09-14T10:46:52.369048+0000","last_became_peered":"2024-09-14T10:46:52.369048+0000","last_unstale":"2024-09-14T12:01:46.048503+0000","last_undegraded":"2024-09-14T12:01:46.048503+0000","last_fullsized":"2024-09-14T12:01:46.048503+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:46.048415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:46.048415+0000","last_clean_scrub_stamp":"2024-09-14T12:01:46.048415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:37.173407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"263'556","reported_seq":2343,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.798201+0000","last_change":"2024-09-14T12:01:43.798097+0000","last_active":"2024-09-14T12:01:43.798201+0000","last_peered":"2024-09-14T12:01:43.798201+0000","last_clean":"2024-09-14T12:01:43.798201+0000","last_became_active":"2024-09-14T10:46:46.348774+0000","last_became_peered":"2024-09-14T10:46:46.348774+0000","last_unstale":"2024-09-14T12:01:43.798201+0000","last_undegraded":"2024-09-14T12:01:43.798201+0000","last_fullsized":"2024-09-14T12:01:43.798201+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'556","last_scrub_stamp":"2024-09-14T12:01:43.797996+0000","last_deep_scrub":"263'556","last_deep_scrub_stamp":"2024-09-14T12:01:43.797996+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.797996+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:15.352106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3189,"num_read_kb":2980,"num_write":657,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"263'401","reported_seq":1094,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.391955+0000","last_change":"2024-09-14T12:01:29.391885+0000","last_active":"2024-09-14T12:01:29.391955+0000","last_peered":"2024-09-14T12:01:29.391955+0000","last_clean":"2024-09-14T12:01:29.391955+0000","last_became_active":"2024-09-14T10:46:44.334693+0000","last_became_peered":"2024-09-14T10:46:44.334693+0000","last_unstale":"2024-09-14T12:01:29.391955+0000","last_undegraded":"2024-09-14T12:01:29.391955+0000","last_fullsized":"2024-09-14T12:01:29.391955+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'401","last_scrub_stamp":"2024-09-14T12:01:29.391776+0000","last_deep_scrub":"263'401","last_deep_scrub_stamp":"2024-09-14T12:01:29.391776+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.391776+0000","objects_scrubbed":5,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:21.186717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1532840,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":807,"num_read_kb":35702,"num_write":1252,"num_write_kb":25930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"263'4","reported_seq":997,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.864111+0000","last_change":"2024-09-14T12:01:43.864111+0000","last_active":"2024-09-14T12:01:43.864111+0000","last_peered":"2024-09-14T12:01:43.864111+0000","last_clean":"2024-09-14T12:01:43.864111+0000","last_became_active":"2024-09-14T10:46:48.350469+0000","last_became_peered":"2024-09-14T10:46:48.350469+0000","last_unstale":"2024-09-14T12:01:43.864111+0000","last_undegraded":"2024-09-14T12:01:43.864111+0000","last_fullsized":"2024-09-14T12:01:43.864111+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:01:43.863982+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:01:43.863982+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.863982+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:27:04.908426+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"263'501","reported_seq":1150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:50.864846+0000","last_change":"2024-09-14T12:01:50.864779+0000","last_active":"2024-09-14T12:01:50.864846+0000","last_peered":"2024-09-14T12:01:50.864846+0000","last_clean":"2024-09-14T12:01:50.864846+0000","last_became_active":"2024-09-14T10:46:50.365486+0000","last_became_peered":"2024-09-14T10:46:50.365486+0000","last_unstale":"2024-09-14T12:01:50.864846+0000","last_undegraded":"2024-09-14T12:01:50.864846+0000","last_fullsized":"2024-09-14T12:01:50.864846+0000","mapping_epoch":32,"log_start":"263'400","ondisk_log_start":"263'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'501","last_scrub_stamp":"2024-09-14T12:01:50.864676+0000","last_deep_scrub":"263'501","last_deep_scrub_stamp":"2024-09-14T12:01:50.864676+0000","last_clean_scrub_stamp":"2024-09-14T12:01:50.864676+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:12.318665+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93124,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":891,"num_read_kb":2144,"num_write":760,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:47.842011+0000","last_change":"2024-09-14T12:01:47.841917+0000","last_active":"2024-09-14T12:01:47.842011+0000","last_peered":"2024-09-14T12:01:47.842011+0000","last_clean":"2024-09-14T12:01:47.842011+0000","last_became_active":"2024-09-14T10:46:52.372151+0000","last_became_peered":"2024-09-14T10:46:52.372151+0000","last_unstale":"2024-09-14T12:01:47.842011+0000","last_undegraded":"2024-09-14T12:01:47.842011+0000","last_fullsized":"2024-09-14T12:01:47.842011+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:47.841832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:47.841832+0000","last_clean_scrub_stamp":"2024-09-14T12:01:47.841832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:42.232450+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"263'207","reported_seq":727,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:02.180825+0000","last_change":"2024-09-14T12:02:02.180825+0000","last_active":"2024-09-14T12:02:02.180825+0000","last_peered":"2024-09-14T12:02:02.180825+0000","last_clean":"2024-09-14T12:02:02.180825+0000","last_became_active":"2024-09-14T10:46:54.386525+0000","last_became_peered":"2024-09-14T10:46:54.386525+0000","last_unstale":"2024-09-14T12:02:02.180825+0000","last_undegraded":"2024-09-14T12:02:02.180825+0000","last_fullsized":"2024-09-14T12:02:02.180825+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'207","last_scrub_stamp":"2024-09-14T12:02:02.180735+0000","last_deep_scrub":"263'207","last_deep_scrub_stamp":"2024-09-14T12:02:02.180735+0000","last_clean_scrub_stamp":"2024-09-14T12:02:02.180735+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:53.469743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":260,"num_read_kb":259,"num_write":474,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"263'419","reported_seq":2088,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.678034+0000","last_change":"2024-09-14T12:01:38.678034+0000","last_active":"2024-09-14T12:01:38.678034+0000","last_peered":"2024-09-14T12:01:38.678034+0000","last_clean":"2024-09-14T12:01:38.678034+0000","last_became_active":"2024-09-14T10:46:46.341559+0000","last_became_peered":"2024-09-14T10:46:46.341559+0000","last_unstale":"2024-09-14T12:01:38.678034+0000","last_undegraded":"2024-09-14T12:01:38.678034+0000","last_fullsized":"2024-09-14T12:01:38.678034+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'419","last_scrub_stamp":"2024-09-14T12:01:38.677944+0000","last_deep_scrub":"263'419","last_deep_scrub_stamp":"2024-09-14T12:01:38.677944+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.677944+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:16.076637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2371,"num_read_kb":2275,"num_write":467,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"263'282","reported_seq":938,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.691728+0000","last_change":"2024-09-14T12:01:31.691639+0000","last_active":"2024-09-14T12:01:31.691728+0000","last_peered":"2024-09-14T12:01:31.691728+0000","last_clean":"2024-09-14T12:01:31.691728+0000","last_became_active":"2024-09-14T10:46:44.319896+0000","last_became_peered":"2024-09-14T10:46:44.319896+0000","last_unstale":"2024-09-14T12:01:31.691728+0000","last_undegraded":"2024-09-14T12:01:31.691728+0000","last_fullsized":"2024-09-14T12:01:31.691728+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'282","last_scrub_stamp":"2024-09-14T12:01:31.691521+0000","last_deep_scrub":"263'282","last_deep_scrub_stamp":"2024-09-14T12:01:31.691521+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.691521+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:52.725869+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133682,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":524,"num_read_kb":94668,"num_write":900,"num_write_kb":37785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:42.928810+0000","last_change":"2024-09-14T12:01:42.928757+0000","last_active":"2024-09-14T12:01:42.928810+0000","last_peered":"2024-09-14T12:01:42.928810+0000","last_clean":"2024-09-14T12:01:42.928810+0000","last_became_active":"2024-09-14T10:46:48.355149+0000","last_became_peered":"2024-09-14T10:46:48.355149+0000","last_unstale":"2024-09-14T12:01:42.928810+0000","last_undegraded":"2024-09-14T12:01:42.928810+0000","last_fullsized":"2024-09-14T12:01:42.928810+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:42.928663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:42.928663+0000","last_clean_scrub_stamp":"2024-09-14T12:01:42.928663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:09.783248+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"263'353","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:58.831540+0000","last_change":"2024-09-14T12:01:58.831540+0000","last_active":"2024-09-14T12:01:58.831540+0000","last_peered":"2024-09-14T12:01:58.831540+0000","last_clean":"2024-09-14T12:01:58.831540+0000","last_became_active":"2024-09-14T10:46:50.366749+0000","last_became_peered":"2024-09-14T10:46:50.366749+0000","last_unstale":"2024-09-14T12:01:58.831540+0000","last_undegraded":"2024-09-14T12:01:58.831540+0000","last_fullsized":"2024-09-14T12:01:58.831540+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'353","last_scrub_stamp":"2024-09-14T12:01:58.831444+0000","last_deep_scrub":"263'353","last_deep_scrub_stamp":"2024-09-14T12:01:58.831444+0000","last_clean_scrub_stamp":"2024-09-14T12:01:58.831444+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:18.190822+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49707,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":587,"num_read_kb":1269,"num_write":486,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:57.154367+0000","last_change":"2024-09-14T12:01:57.154367+0000","last_active":"2024-09-14T12:01:57.154367+0000","last_peered":"2024-09-14T12:01:57.154367+0000","last_clean":"2024-09-14T12:01:57.154367+0000","last_became_active":"2024-09-14T10:46:52.368508+0000","last_became_peered":"2024-09-14T10:46:52.368508+0000","last_unstale":"2024-09-14T12:01:57.154367+0000","last_undegraded":"2024-09-14T12:01:57.154367+0000","last_fullsized":"2024-09-14T12:01:57.154367+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:57.154283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:57.154283+0000","last_clean_scrub_stamp":"2024-09-14T12:01:57.154283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:27.227112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"263'188","reported_seq":1073,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:08.679568+0000","last_change":"2024-09-14T12:02:08.679568+0000","last_active":"2024-09-14T12:02:08.679568+0000","last_peered":"2024-09-14T12:02:08.679568+0000","last_clean":"2024-09-14T12:02:08.679568+0000","last_became_active":"2024-09-14T10:46:54.378938+0000","last_became_peered":"2024-09-14T10:46:54.378938+0000","last_unstale":"2024-09-14T12:02:08.679568+0000","last_undegraded":"2024-09-14T12:02:08.679568+0000","last_fullsized":"2024-09-14T12:02:08.679568+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'188","last_scrub_stamp":"2024-09-14T12:02:08.679492+0000","last_deep_scrub":"263'188","last_deep_scrub_stamp":"2024-09-14T12:02:08.679492+0000","last_clean_scrub_stamp":"2024-09-14T12:02:08.679492+0000","objects_scrubbed":7,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:00.165220+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2044,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":607,"num_read_kb":603,"num_write":505,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"263'637","reported_seq":2307,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.079238+0000","last_change":"2024-09-14T12:01:35.079167+0000","last_active":"2024-09-14T12:01:35.079238+0000","last_peered":"2024-09-14T12:01:35.079238+0000","last_clean":"2024-09-14T12:01:35.079238+0000","last_became_active":"2024-09-14T10:46:46.347362+0000","last_became_peered":"2024-09-14T10:46:46.347362+0000","last_unstale":"2024-09-14T12:01:35.079238+0000","last_undegraded":"2024-09-14T12:01:35.079238+0000","last_fullsized":"2024-09-14T12:01:35.079238+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'637","last_scrub_stamp":"2024-09-14T12:01:35.079082+0000","last_deep_scrub":"263'637","last_deep_scrub_stamp":"2024-09-14T12:01:35.079082+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.079082+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":600,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:12.178538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3345,"num_read_kb":3056,"num_write":864,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"263'375","reported_seq":1036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.727303+0000","last_change":"2024-09-14T12:01:26.727237+0000","last_active":"2024-09-14T12:01:26.727303+0000","last_peered":"2024-09-14T12:01:26.727303+0000","last_clean":"2024-09-14T12:01:26.727303+0000","last_became_active":"2024-09-14T10:46:44.318099+0000","last_became_peered":"2024-09-14T10:46:44.318099+0000","last_unstale":"2024-09-14T12:01:26.727303+0000","last_undegraded":"2024-09-14T12:01:26.727303+0000","last_fullsized":"2024-09-14T12:01:26.727303+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'375","last_scrub_stamp":"2024-09-14T12:01:26.727098+0000","last_deep_scrub":"263'375","last_deep_scrub_stamp":"2024-09-14T12:01:26.727098+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.727098+0000","objects_scrubbed":8,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:42.583432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133694,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":681,"num_read_kb":1685,"num_write":1259,"num_write_kb":36237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.899872+0000","last_change":"2024-09-14T12:01:41.899759+0000","last_active":"2024-09-14T12:01:41.899872+0000","last_peered":"2024-09-14T12:01:41.899872+0000","last_clean":"2024-09-14T12:01:41.899872+0000","last_became_active":"2024-09-14T10:46:48.350059+0000","last_became_peered":"2024-09-14T10:46:48.350059+0000","last_unstale":"2024-09-14T12:01:41.899872+0000","last_undegraded":"2024-09-14T12:01:41.899872+0000","last_fullsized":"2024-09-14T12:01:41.899872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:41.899660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:41.899660+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.899660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:49.562202+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"263'316","reported_seq":917,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:51.849471+0000","last_change":"2024-09-14T12:01:51.849404+0000","last_active":"2024-09-14T12:01:51.849471+0000","last_peered":"2024-09-14T12:01:51.849471+0000","last_clean":"2024-09-14T12:01:51.849471+0000","last_became_active":"2024-09-14T10:46:50.365393+0000","last_became_peered":"2024-09-14T10:46:50.365393+0000","last_unstale":"2024-09-14T12:01:51.849471+0000","last_undegraded":"2024-09-14T12:01:51.849471+0000","last_fullsized":"2024-09-14T12:01:51.849471+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'316","last_scrub_stamp":"2024-09-14T12:01:51.849311+0000","last_deep_scrub":"263'316","last_deep_scrub_stamp":"2024-09-14T12:01:51.849311+0000","last_clean_scrub_stamp":"2024-09-14T12:01:51.849311+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:19.475246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46624,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":509,"num_read_kb":1174,"num_write":408,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:48.058716+0000","last_change":"2024-09-14T12:01:48.058716+0000","last_active":"2024-09-14T12:01:48.058716+0000","last_peered":"2024-09-14T12:01:48.058716+0000","last_clean":"2024-09-14T12:01:48.058716+0000","last_became_active":"2024-09-14T10:46:52.373099+0000","last_became_peered":"2024-09-14T10:46:52.373099+0000","last_unstale":"2024-09-14T12:01:48.058716+0000","last_undegraded":"2024-09-14T12:01:48.058716+0000","last_fullsized":"2024-09-14T12:01:48.058716+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:48.058614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:48.058614+0000","last_clean_scrub_stamp":"2024-09-14T12:01:48.058614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:24.902309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"263'147","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:06.683872+0000","last_change":"2024-09-14T12:02:06.683872+0000","last_active":"2024-09-14T12:02:06.683872+0000","last_peered":"2024-09-14T12:02:06.683872+0000","last_clean":"2024-09-14T12:02:06.683872+0000","last_became_active":"2024-09-14T10:46:54.385625+0000","last_became_peered":"2024-09-14T10:46:54.385625+0000","last_unstale":"2024-09-14T12:02:06.683872+0000","last_undegraded":"2024-09-14T12:02:06.683872+0000","last_fullsized":"2024-09-14T12:02:06.683872+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'147","last_scrub_stamp":"2024-09-14T12:02:06.683765+0000","last_deep_scrub":"263'147","last_deep_scrub_stamp":"2024-09-14T12:02:06.683765+0000","last_clean_scrub_stamp":"2024-09-14T12:02:06.683765+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:10.241060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":790,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":228,"num_read_kb":197,"num_write":338,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"263'418","reported_seq":1968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.632743+0000","last_change":"2024-09-14T12:01:37.632681+0000","last_active":"2024-09-14T12:01:37.632743+0000","last_peered":"2024-09-14T12:01:37.632743+0000","last_clean":"2024-09-14T12:01:37.632743+0000","last_became_active":"2024-09-14T10:46:46.338551+0000","last_became_peered":"2024-09-14T10:46:46.338551+0000","last_unstale":"2024-09-14T12:01:37.632743+0000","last_undegraded":"2024-09-14T12:01:37.632743+0000","last_fullsized":"2024-09-14T12:01:37.632743+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'418","last_scrub_stamp":"2024-09-14T12:01:37.632564+0000","last_deep_scrub":"263'418","last_deep_scrub_stamp":"2024-09-14T12:01:37.632564+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.632564+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:48.702789+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2291,"num_read_kb":2170,"num_write":475,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"263'291","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.702324+0000","last_change":"2024-09-14T12:01:32.702217+0000","last_active":"2024-09-14T12:01:32.702324+0000","last_peered":"2024-09-14T12:01:32.702324+0000","last_clean":"2024-09-14T12:01:32.702324+0000","last_became_active":"2024-09-14T10:46:44.331660+0000","last_became_peered":"2024-09-14T10:46:44.331660+0000","last_unstale":"2024-09-14T12:01:32.702324+0000","last_undegraded":"2024-09-14T12:01:32.702324+0000","last_fullsized":"2024-09-14T12:01:32.702324+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'291","last_scrub_stamp":"2024-09-14T12:01:32.702040+0000","last_deep_scrub":"263'291","last_deep_scrub_stamp":"2024-09-14T12:01:32.702040+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.702040+0000","objects_scrubbed":9,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:26.595923+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":521,"num_read_kb":29638,"num_write":955,"num_write_kb":30451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:49.529666+0000","last_change":"2024-09-14T12:01:49.529598+0000","last_active":"2024-09-14T12:01:49.529666+0000","last_peered":"2024-09-14T12:01:49.529666+0000","last_clean":"2024-09-14T12:01:49.529666+0000","last_became_active":"2024-09-14T10:46:48.350072+0000","last_became_peered":"2024-09-14T10:46:48.350072+0000","last_unstale":"2024-09-14T12:01:49.529666+0000","last_undegraded":"2024-09-14T12:01:49.529666+0000","last_fullsized":"2024-09-14T12:01:49.529666+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:49.529513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:49.529513+0000","last_clean_scrub_stamp":"2024-09-14T12:01:49.529513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:28.315817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"263'132","reported_seq":685,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:00.836105+0000","last_change":"2024-09-14T12:02:00.836105+0000","last_active":"2024-09-14T12:02:00.836105+0000","last_peered":"2024-09-14T12:02:00.836105+0000","last_clean":"2024-09-14T12:02:00.836105+0000","last_became_active":"2024-09-14T10:46:50.367991+0000","last_became_peered":"2024-09-14T10:46:50.367991+0000","last_unstale":"2024-09-14T12:02:00.836105+0000","last_undegraded":"2024-09-14T12:02:00.836105+0000","last_fullsized":"2024-09-14T12:02:00.836105+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'132","last_scrub_stamp":"2024-09-14T12:02:00.835968+0000","last_deep_scrub":"263'132","last_deep_scrub_stamp":"2024-09-14T12:02:00.835968+0000","last_clean_scrub_stamp":"2024-09-14T12:02:00.835968+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:07.297080+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":126,"num_write":102,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"263'780","reported_seq":2696,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:48.218375+0000","last_change":"2024-09-14T12:01:48.218326+0000","last_active":"2024-09-14T12:01:48.218375+0000","last_peered":"2024-09-14T12:01:48.218375+0000","last_clean":"2024-09-14T12:01:48.218375+0000","last_became_active":"2024-09-14T10:46:52.370446+0000","last_became_peered":"2024-09-14T10:46:52.370446+0000","last_unstale":"2024-09-14T12:01:48.218375+0000","last_undegraded":"2024-09-14T12:01:48.218375+0000","last_fullsized":"2024-09-14T12:01:48.218375+0000","mapping_epoch":34,"log_start":"263'700","ondisk_log_start":"263'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'780","last_scrub_stamp":"2024-09-14T12:01:48.218254+0000","last_deep_scrub":"263'780","last_deep_scrub_stamp":"2024-09-14T12:01:48.218254+0000","last_clean_scrub_stamp":"2024-09-14T12:01:48.218254+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:47.221639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"263'121","reported_seq":656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:07.698920+0000","last_change":"2024-09-14T12:02:07.698920+0000","last_active":"2024-09-14T12:02:07.698920+0000","last_peered":"2024-09-14T12:02:07.698920+0000","last_clean":"2024-09-14T12:02:07.698920+0000","last_became_active":"2024-09-14T10:46:54.377788+0000","last_became_peered":"2024-09-14T10:46:54.377788+0000","last_unstale":"2024-09-14T12:02:07.698920+0000","last_undegraded":"2024-09-14T12:02:07.698920+0000","last_fullsized":"2024-09-14T12:02:07.698920+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'121","last_scrub_stamp":"2024-09-14T12:02:07.698832+0000","last_deep_scrub":"263'121","last_deep_scrub_stamp":"2024-09-14T12:02:07.698832+0000","last_clean_scrub_stamp":"2024-09-14T12:02:07.698832+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:06.345657+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":221,"num_read_kb":193,"num_write":312,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"263'792","reported_seq":2344,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.869824+0000","last_change":"2024-09-14T12:01:38.869721+0000","last_active":"2024-09-14T12:01:38.869824+0000","last_peered":"2024-09-14T12:01:38.869824+0000","last_clean":"2024-09-14T12:01:38.869824+0000","last_became_active":"2024-09-14T10:46:46.352087+0000","last_became_peered":"2024-09-14T10:46:46.352087+0000","last_unstale":"2024-09-14T12:01:38.869824+0000","last_undegraded":"2024-09-14T12:01:38.869824+0000","last_fullsized":"2024-09-14T12:01:38.869824+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'792","last_scrub_stamp":"2024-09-14T12:01:38.869609+0000","last_deep_scrub":"263'792","last_deep_scrub_stamp":"2024-09-14T12:01:38.869609+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.869609+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:26.016700+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3891,"num_read_kb":3520,"num_write":1035,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"263'316","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.681774+0000","last_change":"2024-09-14T12:01:27.681717+0000","last_active":"2024-09-14T12:01:27.681774+0000","last_peered":"2024-09-14T12:01:27.681774+0000","last_clean":"2024-09-14T12:01:27.681774+0000","last_became_active":"2024-09-14T10:46:44.320689+0000","last_became_peered":"2024-09-14T10:46:44.320689+0000","last_unstale":"2024-09-14T12:01:27.681774+0000","last_undegraded":"2024-09-14T12:01:27.681774+0000","last_fullsized":"2024-09-14T12:01:27.681774+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'316","last_scrub_stamp":"2024-09-14T12:01:27.681619+0000","last_deep_scrub":"263'316","last_deep_scrub_stamp":"2024-09-14T12:01:27.681619+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.681619+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:26.610212+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":532,"num_read_kb":954,"num_write":1107,"num_write_kb":21144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.691769+0000","last_change":"2024-09-14T12:01:40.691672+0000","last_active":"2024-09-14T12:01:40.691769+0000","last_peered":"2024-09-14T12:01:40.691769+0000","last_clean":"2024-09-14T12:01:40.691769+0000","last_became_active":"2024-09-14T10:46:48.357024+0000","last_became_peered":"2024-09-14T10:46:48.357024+0000","last_unstale":"2024-09-14T12:01:40.691769+0000","last_undegraded":"2024-09-14T12:01:40.691769+0000","last_fullsized":"2024-09-14T12:01:40.691769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:40.691553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:40.691553+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.691553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:20.398399+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"263'385","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:46.207002+0000","last_change":"2024-09-14T12:01:46.206932+0000","last_active":"2024-09-14T12:01:46.207002+0000","last_peered":"2024-09-14T12:01:46.207002+0000","last_clean":"2024-09-14T12:01:46.207002+0000","last_became_active":"2024-09-14T10:46:50.361962+0000","last_became_peered":"2024-09-14T10:46:50.361962+0000","last_unstale":"2024-09-14T12:01:46.207002+0000","last_undegraded":"2024-09-14T12:01:46.207002+0000","last_fullsized":"2024-09-14T12:01:46.207002+0000","mapping_epoch":32,"log_start":"263'300","ondisk_log_start":"263'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'385","last_scrub_stamp":"2024-09-14T12:01:46.206822+0000","last_deep_scrub":"263'385","last_deep_scrub_stamp":"2024-09-14T12:01:46.206822+0000","last_clean_scrub_stamp":"2024-09-14T12:01:46.206822+0000","objects_scrubbed":8,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:07.450497+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49011,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":601,"num_read_kb":1340,"num_write":486,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:59.667395+0000","last_change":"2024-09-14T12:01:59.667395+0000","last_active":"2024-09-14T12:01:59.667395+0000","last_peered":"2024-09-14T12:01:59.667395+0000","last_clean":"2024-09-14T12:01:59.667395+0000","last_became_active":"2024-09-14T10:46:52.369262+0000","last_became_peered":"2024-09-14T10:46:52.369262+0000","last_unstale":"2024-09-14T12:01:59.667395+0000","last_undegraded":"2024-09-14T12:01:59.667395+0000","last_fullsized":"2024-09-14T12:01:59.667395+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:59.667313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:59.667313+0000","last_clean_scrub_stamp":"2024-09-14T12:01:59.667313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:13.006453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"263'149","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:49.662036+0000","last_change":"2024-09-14T12:01:49.661958+0000","last_active":"2024-09-14T12:01:49.662036+0000","last_peered":"2024-09-14T12:01:49.662036+0000","last_clean":"2024-09-14T12:01:49.662036+0000","last_became_active":"2024-09-14T10:46:54.385235+0000","last_became_peered":"2024-09-14T10:46:54.385235+0000","last_unstale":"2024-09-14T12:01:49.662036+0000","last_undegraded":"2024-09-14T12:01:49.662036+0000","last_fullsized":"2024-09-14T12:01:49.662036+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'149","last_scrub_stamp":"2024-09-14T12:01:49.661869+0000","last_deep_scrub":"263'149","last_deep_scrub_stamp":"2024-09-14T12:01:49.661869+0000","last_clean_scrub_stamp":"2024-09-14T12:01:49.661869+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:05.463904+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":187,"num_write":368,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"263'750","reported_seq":2318,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.864213+0000","last_change":"2024-09-14T12:01:36.864145+0000","last_active":"2024-09-14T12:01:36.864213+0000","last_peered":"2024-09-14T12:01:36.864213+0000","last_clean":"2024-09-14T12:01:36.864213+0000","last_became_active":"2024-09-14T10:46:46.335112+0000","last_became_peered":"2024-09-14T10:46:46.335112+0000","last_unstale":"2024-09-14T12:01:36.864213+0000","last_undegraded":"2024-09-14T12:01:36.864213+0000","last_fullsized":"2024-09-14T12:01:36.864213+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'750","last_scrub_stamp":"2024-09-14T12:01:36.864055+0000","last_deep_scrub":"263'750","last_deep_scrub_stamp":"2024-09-14T12:01:36.864055+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.864055+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:44.163046+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3755,"num_read_kb":3425,"num_write":989,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"263'322","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.760058+0000","last_change":"2024-09-14T12:01:34.759992+0000","last_active":"2024-09-14T12:01:34.760058+0000","last_peered":"2024-09-14T12:01:34.760058+0000","last_clean":"2024-09-14T12:01:34.760058+0000","last_became_active":"2024-09-14T10:46:44.332130+0000","last_became_peered":"2024-09-14T10:46:44.332130+0000","last_unstale":"2024-09-14T12:01:34.760058+0000","last_undegraded":"2024-09-14T12:01:34.760058+0000","last_fullsized":"2024-09-14T12:01:34.760058+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'322","last_scrub_stamp":"2024-09-14T12:01:34.759869+0000","last_deep_scrub":"263'322","last_deep_scrub_stamp":"2024-09-14T12:01:34.759869+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.759869+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:56.671464+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":584,"num_read_kb":32074,"num_write":1014,"num_write_kb":20757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.891909+0000","last_change":"2024-09-14T12:01:40.891826+0000","last_active":"2024-09-14T12:01:40.891909+0000","last_peered":"2024-09-14T12:01:40.891909+0000","last_clean":"2024-09-14T12:01:40.891909+0000","last_became_active":"2024-09-14T10:46:48.354108+0000","last_became_peered":"2024-09-14T10:46:48.354108+0000","last_unstale":"2024-09-14T12:01:40.891909+0000","last_undegraded":"2024-09-14T12:01:40.891909+0000","last_fullsized":"2024-09-14T12:01:40.891909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:40.891732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:40.891732+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.891732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:32.261695+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"263'275","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:55.604927+0000","last_change":"2024-09-14T12:01:55.604927+0000","last_active":"2024-09-14T12:01:55.604927+0000","last_peered":"2024-09-14T12:01:55.604927+0000","last_clean":"2024-09-14T12:01:55.604927+0000","last_became_active":"2024-09-14T10:46:50.358186+0000","last_became_peered":"2024-09-14T10:46:50.358186+0000","last_unstale":"2024-09-14T12:01:55.604927+0000","last_undegraded":"2024-09-14T12:01:55.604927+0000","last_fullsized":"2024-09-14T12:01:55.604927+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'275","last_scrub_stamp":"2024-09-14T12:01:55.604828+0000","last_deep_scrub":"263'275","last_deep_scrub_stamp":"2024-09-14T12:01:55.604828+0000","last_clean_scrub_stamp":"2024-09-14T12:01:55.604828+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:49.582183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46012,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":454,"num_read_kb":1061,"num_write":362,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:02.790850+0000","last_change":"2024-09-14T12:02:02.790850+0000","last_active":"2024-09-14T12:02:02.790850+0000","last_peered":"2024-09-14T12:02:02.790850+0000","last_clean":"2024-09-14T12:02:02.790850+0000","last_became_active":"2024-09-14T10:46:52.365736+0000","last_became_peered":"2024-09-14T10:46:52.365736+0000","last_unstale":"2024-09-14T12:02:02.790850+0000","last_undegraded":"2024-09-14T12:02:02.790850+0000","last_fullsized":"2024-09-14T12:02:02.790850+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:02.790754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:02.790754+0000","last_clean_scrub_stamp":"2024-09-14T12:02:02.790754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:29.657420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"263'125","reported_seq":648,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:03.170601+0000","last_change":"2024-09-14T12:02:03.170601+0000","last_active":"2024-09-14T12:02:03.170601+0000","last_peered":"2024-09-14T12:02:03.170601+0000","last_clean":"2024-09-14T12:02:03.170601+0000","last_became_active":"2024-09-14T10:46:54.384303+0000","last_became_peered":"2024-09-14T10:46:54.384303+0000","last_unstale":"2024-09-14T12:02:03.170601+0000","last_undegraded":"2024-09-14T12:02:03.170601+0000","last_fullsized":"2024-09-14T12:02:03.170601+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'125","last_scrub_stamp":"2024-09-14T12:02:03.170516+0000","last_deep_scrub":"263'125","last_deep_scrub_stamp":"2024-09-14T12:02:03.170516+0000","last_clean_scrub_stamp":"2024-09-14T12:02:03.170516+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:15.137603+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":957,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":145,"num_write":281,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"263'378","reported_seq":1802,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.141125+0000","last_change":"2024-09-14T12:01:32.141054+0000","last_active":"2024-09-14T12:01:32.141125+0000","last_peered":"2024-09-14T12:01:32.141125+0000","last_clean":"2024-09-14T12:01:32.141125+0000","last_became_active":"2024-09-14T10:46:46.338518+0000","last_became_peered":"2024-09-14T10:46:46.338518+0000","last_unstale":"2024-09-14T12:01:32.141125+0000","last_undegraded":"2024-09-14T12:01:32.141125+0000","last_fullsized":"2024-09-14T12:01:32.141125+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-14T12:01:32.140969+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-14T12:01:32.140969+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.140969+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:30.472756+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2070,"num_read_kb":1951,"num_write":457,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"263'362","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.372654+0000","last_change":"2024-09-14T12:01:30.372654+0000","last_active":"2024-09-14T12:01:30.372654+0000","last_peered":"2024-09-14T12:01:30.372654+0000","last_clean":"2024-09-14T12:01:30.372654+0000","last_became_active":"2024-09-14T10:46:44.332852+0000","last_became_peered":"2024-09-14T10:46:44.332852+0000","last_unstale":"2024-09-14T12:01:30.372654+0000","last_undegraded":"2024-09-14T12:01:30.372654+0000","last_fullsized":"2024-09-14T12:01:30.372654+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-14T12:01:30.372539+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-14T12:01:30.372539+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.372539+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:57.066912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":662,"num_read_kb":10749,"num_write":1220,"num_write_kb":43875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.676465+0000","last_change":"2024-09-14T12:01:41.676362+0000","last_active":"2024-09-14T12:01:41.676465+0000","last_peered":"2024-09-14T12:01:41.676465+0000","last_clean":"2024-09-14T12:01:41.676465+0000","last_became_active":"2024-09-14T10:46:48.355512+0000","last_became_peered":"2024-09-14T10:46:48.355512+0000","last_unstale":"2024-09-14T12:01:41.676465+0000","last_undegraded":"2024-09-14T12:01:41.676465+0000","last_fullsized":"2024-09-14T12:01:41.676465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:01:41.676262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:01:41.676262+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.676262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:42.505362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"263'267","reported_seq":838,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:49.850396+0000","last_change":"2024-09-14T12:01:49.850337+0000","last_active":"2024-09-14T12:01:49.850396+0000","last_peered":"2024-09-14T12:01:49.850396+0000","last_clean":"2024-09-14T12:01:49.850396+0000","last_became_active":"2024-09-14T10:46:50.364420+0000","last_became_peered":"2024-09-14T10:46:50.364420+0000","last_unstale":"2024-09-14T12:01:49.850396+0000","last_undegraded":"2024-09-14T12:01:49.850396+0000","last_fullsized":"2024-09-14T12:01:49.850396+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'267","last_scrub_stamp":"2024-09-14T12:01:49.850246+0000","last_deep_scrub":"263'267","last_deep_scrub_stamp":"2024-09-14T12:01:49.850246+0000","last_clean_scrub_stamp":"2024-09-14T12:01:49.850246+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:15.233761+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45284,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":455,"num_read_kb":1165,"num_write":378,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:05.713470+0000","last_change":"2024-09-14T12:02:05.713470+0000","last_active":"2024-09-14T12:02:05.713470+0000","last_peered":"2024-09-14T12:02:05.713470+0000","last_clean":"2024-09-14T12:02:05.713470+0000","last_became_active":"2024-09-14T10:46:52.373913+0000","last_became_peered":"2024-09-14T10:46:52.373913+0000","last_unstale":"2024-09-14T12:02:05.713470+0000","last_undegraded":"2024-09-14T12:02:05.713470+0000","last_fullsized":"2024-09-14T12:02:05.713470+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:05.713377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:05.713377+0000","last_clean_scrub_stamp":"2024-09-14T12:02:05.713377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:17.741274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"263'132","reported_seq":1242,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:09.650742+0000","last_change":"2024-09-14T12:02:09.650742+0000","last_active":"2024-09-14T12:02:09.650742+0000","last_peered":"2024-09-14T12:02:09.650742+0000","last_clean":"2024-09-14T12:02:09.650742+0000","last_became_active":"2024-09-14T10:46:54.383637+0000","last_became_peered":"2024-09-14T10:46:54.383637+0000","last_unstale":"2024-09-14T12:02:09.650742+0000","last_undegraded":"2024-09-14T12:02:09.650742+0000","last_fullsized":"2024-09-14T12:02:09.650742+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'132","last_scrub_stamp":"2024-09-14T12:02:09.650638+0000","last_deep_scrub":"263'132","last_deep_scrub_stamp":"2024-09-14T12:02:09.650638+0000","last_clean_scrub_stamp":"2024-09-14T12:02:09.650638+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:21.941731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":738,"num_read_kb":738,"num_write":285,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"263'446","reported_seq":1913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.792550+0000","last_change":"2024-09-14T12:01:34.792489+0000","last_active":"2024-09-14T12:01:34.792550+0000","last_peered":"2024-09-14T12:01:34.792550+0000","last_clean":"2024-09-14T12:01:34.792550+0000","last_became_active":"2024-09-14T10:46:46.342299+0000","last_became_peered":"2024-09-14T10:46:46.342299+0000","last_unstale":"2024-09-14T12:01:34.792550+0000","last_undegraded":"2024-09-14T12:01:34.792550+0000","last_fullsized":"2024-09-14T12:01:34.792550+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'446","last_scrub_stamp":"2024-09-14T12:01:34.792381+0000","last_deep_scrub":"263'446","last_deep_scrub_stamp":"2024-09-14T12:01:34.792381+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.792381+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:14.733658+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2232,"num_read_kb":2089,"num_write":533,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"263'512","reported_seq":1273,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.363748+0000","last_change":"2024-09-14T12:01:31.363630+0000","last_active":"2024-09-14T12:01:31.363748+0000","last_peered":"2024-09-14T12:01:31.363748+0000","last_clean":"2024-09-14T12:01:31.363748+0000","last_became_active":"2024-09-14T10:46:44.320749+0000","last_became_peered":"2024-09-14T10:46:44.320749+0000","last_unstale":"2024-09-14T12:01:31.363748+0000","last_undegraded":"2024-09-14T12:01:31.363748+0000","last_fullsized":"2024-09-14T12:01:31.363748+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'512","last_scrub_stamp":"2024-09-14T12:01:31.363472+0000","last_deep_scrub":"263'512","last_deep_scrub_stamp":"2024-09-14T12:01:31.363472+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.363472+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:49.759769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1101,"num_read_kb":48118,"num_write":1530,"num_write_kb":57550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:48.548228+0000","last_change":"2024-09-14T12:01:48.548151+0000","last_active":"2024-09-14T12:01:48.548228+0000","last_peered":"2024-09-14T12:01:48.548228+0000","last_clean":"2024-09-14T12:01:48.548228+0000","last_became_active":"2024-09-14T10:46:48.352853+0000","last_became_peered":"2024-09-14T10:46:48.352853+0000","last_unstale":"2024-09-14T12:01:48.548228+0000","last_undegraded":"2024-09-14T12:01:48.548228+0000","last_fullsized":"2024-09-14T12:01:48.548228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:01:48.548073+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:01:48.548073+0000","last_clean_scrub_stamp":"2024-09-14T12:01:48.548073+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:39.485060+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"263'309","reported_seq":917,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:59.871705+0000","last_change":"2024-09-14T12:01:59.871705+0000","last_active":"2024-09-14T12:01:59.871705+0000","last_peered":"2024-09-14T12:01:59.871705+0000","last_clean":"2024-09-14T12:01:59.871705+0000","last_became_active":"2024-09-14T10:46:50.369492+0000","last_became_peered":"2024-09-14T10:46:50.369492+0000","last_unstale":"2024-09-14T12:01:59.871705+0000","last_undegraded":"2024-09-14T12:01:59.871705+0000","last_fullsized":"2024-09-14T12:01:59.871705+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'309","last_scrub_stamp":"2024-09-14T12:01:59.871529+0000","last_deep_scrub":"263'309","last_deep_scrub_stamp":"2024-09-14T12:01:59.871529+0000","last_clean_scrub_stamp":"2024-09-14T12:01:59.871529+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:44.228020+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49661,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":1034,"num_write":382,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:02:00.657215+0000","last_change":"2024-09-14T12:02:00.657215+0000","last_active":"2024-09-14T12:02:00.657215+0000","last_peered":"2024-09-14T12:02:00.657215+0000","last_clean":"2024-09-14T12:02:00.657215+0000","last_became_active":"2024-09-14T10:46:52.372108+0000","last_became_peered":"2024-09-14T10:46:52.372108+0000","last_unstale":"2024-09-14T12:02:00.657215+0000","last_undegraded":"2024-09-14T12:02:00.657215+0000","last_fullsized":"2024-09-14T12:02:00.657215+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:02:00.657130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:02:00.657130+0000","last_clean_scrub_stamp":"2024-09-14T12:02:00.657130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:12.133923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"263'128","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:50.220643+0000","last_change":"2024-09-14T12:01:50.220643+0000","last_active":"2024-09-14T12:01:50.220643+0000","last_peered":"2024-09-14T12:01:50.220643+0000","last_clean":"2024-09-14T12:01:50.220643+0000","last_became_active":"2024-09-14T10:46:54.384278+0000","last_became_peered":"2024-09-14T10:46:54.384278+0000","last_unstale":"2024-09-14T12:01:50.220643+0000","last_undegraded":"2024-09-14T12:01:50.220643+0000","last_fullsized":"2024-09-14T12:01:50.220643+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'128","last_scrub_stamp":"2024-09-14T12:01:50.220551+0000","last_deep_scrub":"263'128","last_deep_scrub_stamp":"2024-09-14T12:01:50.220551+0000","last_clean_scrub_stamp":"2024-09-14T12:01:50.220551+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:16.653583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":86,"num_write":278,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"263'466","reported_seq":2045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.585366+0000","last_change":"2024-09-14T12:01:40.585291+0000","last_active":"2024-09-14T12:01:40.585366+0000","last_peered":"2024-09-14T12:01:40.585366+0000","last_clean":"2024-09-14T12:01:40.585366+0000","last_became_active":"2024-09-14T10:46:46.346994+0000","last_became_peered":"2024-09-14T10:46:46.346994+0000","last_unstale":"2024-09-14T12:01:40.585366+0000","last_undegraded":"2024-09-14T12:01:40.585366+0000","last_fullsized":"2024-09-14T12:01:40.585366+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'466","last_scrub_stamp":"2024-09-14T12:01:40.585204+0000","last_deep_scrub":"263'466","last_deep_scrub_stamp":"2024-09-14T12:01:40.585204+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.585204+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:50.174388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2420,"num_read_kb":2273,"num_write":546,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"263'389","reported_seq":1154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:26.853039+0000","last_change":"2024-09-14T12:01:26.852936+0000","last_active":"2024-09-14T12:01:26.853039+0000","last_peered":"2024-09-14T12:01:26.853039+0000","last_clean":"2024-09-14T12:01:26.853039+0000","last_became_active":"2024-09-14T10:46:44.328946+0000","last_became_peered":"2024-09-14T10:46:44.328946+0000","last_unstale":"2024-09-14T12:01:26.853039+0000","last_undegraded":"2024-09-14T12:01:26.853039+0000","last_fullsized":"2024-09-14T12:01:26.853039+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-14T12:01:26.852803+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-14T12:01:26.852803+0000","last_clean_scrub_stamp":"2024-09-14T12:01:26.852803+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:56.352304+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1017,"num_read_kb":28148,"num_write":1233,"num_write_kb":43814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"263'510","reported_seq":2201,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.085204+0000","last_change":"2024-09-14T12:01:34.085089+0000","last_active":"2024-09-14T12:01:34.085204+0000","last_peered":"2024-09-14T12:01:34.085204+0000","last_clean":"2024-09-14T12:01:34.085204+0000","last_became_active":"2024-09-14T10:46:46.343234+0000","last_became_peered":"2024-09-14T10:46:46.343234+0000","last_unstale":"2024-09-14T12:01:34.085204+0000","last_undegraded":"2024-09-14T12:01:34.085204+0000","last_fullsized":"2024-09-14T12:01:34.085204+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'510","last_scrub_stamp":"2024-09-14T12:01:34.084985+0000","last_deep_scrub":"263'510","last_deep_scrub_stamp":"2024-09-14T12:01:34.084985+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.084985+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:57:06.583864+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2663,"num_read_kb":2506,"num_write":583,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"263'344","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.196756+0000","last_change":"2024-09-14T12:01:29.196652+0000","last_active":"2024-09-14T12:01:29.196756+0000","last_peered":"2024-09-14T12:01:29.196756+0000","last_clean":"2024-09-14T12:01:29.196756+0000","last_became_active":"2024-09-14T10:46:44.317349+0000","last_became_peered":"2024-09-14T10:46:44.317349+0000","last_unstale":"2024-09-14T12:01:29.196756+0000","last_undegraded":"2024-09-14T12:01:29.196756+0000","last_fullsized":"2024-09-14T12:01:29.196756+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'344","last_scrub_stamp":"2024-09-14T12:01:29.196487+0000","last_deep_scrub":"263'344","last_deep_scrub_stamp":"2024-09-14T12:01:29.196487+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.196487+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:30.071766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133675,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":5317,"num_write":990,"num_write_kb":25288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"263'451","reported_seq":2009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:48.854900+0000","last_change":"2024-09-14T12:01:48.854796+0000","last_active":"2024-09-14T12:01:48.854900+0000","last_peered":"2024-09-14T12:01:48.854900+0000","last_clean":"2024-09-14T12:01:48.854900+0000","last_became_active":"2024-09-14T10:46:46.346640+0000","last_became_peered":"2024-09-14T10:46:46.346640+0000","last_unstale":"2024-09-14T12:01:48.854900+0000","last_undegraded":"2024-09-14T12:01:48.854900+0000","last_fullsized":"2024-09-14T12:01:48.854900+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'451","last_scrub_stamp":"2024-09-14T12:01:48.854662+0000","last_deep_scrub":"263'451","last_deep_scrub_stamp":"2024-09-14T12:01:48.854662+0000","last_clean_scrub_stamp":"2024-09-14T12:01:48.854662+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:46.521384+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2347,"num_read_kb":2209,"num_write":542,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"263'346","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.774624+0000","last_change":"2024-09-14T12:01:35.774558+0000","last_active":"2024-09-14T12:01:35.774624+0000","last_peered":"2024-09-14T12:01:35.774624+0000","last_clean":"2024-09-14T12:01:35.774624+0000","last_became_active":"2024-09-14T10:46:44.328049+0000","last_became_peered":"2024-09-14T10:46:44.328049+0000","last_unstale":"2024-09-14T12:01:35.774624+0000","last_undegraded":"2024-09-14T12:01:35.774624+0000","last_fullsized":"2024-09-14T12:01:35.774624+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'346","last_scrub_stamp":"2024-09-14T12:01:35.774453+0000","last_deep_scrub":"263'346","last_deep_scrub_stamp":"2024-09-14T12:01:35.774453+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.774453+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:20.558053+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":619,"num_read_kb":2326,"num_write":1082,"num_write_kb":13442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"263'936","reported_seq":2743,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:44.297165+0000","last_change":"2024-09-14T12:01:44.297110+0000","last_active":"2024-09-14T12:01:44.297165+0000","last_peered":"2024-09-14T12:01:44.297165+0000","last_clean":"2024-09-14T12:01:44.297165+0000","last_became_active":"2024-09-14T10:46:46.346682+0000","last_became_peered":"2024-09-14T10:46:46.346682+0000","last_unstale":"2024-09-14T12:01:44.297165+0000","last_undegraded":"2024-09-14T12:01:44.297165+0000","last_fullsized":"2024-09-14T12:01:44.297165+0000","mapping_epoch":28,"log_start":"263'900","ondisk_log_start":"263'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'936","last_scrub_stamp":"2024-09-14T12:01:44.296996+0000","last_deep_scrub":"263'936","last_deep_scrub_stamp":"2024-09-14T12:01:44.296996+0000","last_clean_scrub_stamp":"2024-09-14T12:01:44.296996+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":900,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:52.496747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4656,"num_read_kb":4197,"num_write":1246,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"263'385","reported_seq":1072,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.363148+0000","last_change":"2024-09-14T12:01:32.363079+0000","last_active":"2024-09-14T12:01:32.363148+0000","last_peered":"2024-09-14T12:01:32.363148+0000","last_clean":"2024-09-14T12:01:32.363148+0000","last_became_active":"2024-09-14T10:47:19.040453+0000","last_became_peered":"2024-09-14T10:47:19.040453+0000","last_unstale":"2024-09-14T12:01:32.363148+0000","last_undegraded":"2024-09-14T12:01:32.363148+0000","last_fullsized":"2024-09-14T12:01:32.363148+0000","mapping_epoch":39,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'385","last_scrub_stamp":"2024-09-14T12:01:32.362951+0000","last_deep_scrub":"263'385","last_deep_scrub_stamp":"2024-09-14T12:01:32.362951+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.362951+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:26.035525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133711,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":707,"num_read_kb":25389,"num_write":1181,"num_write_kb":37274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"263'510","reported_seq":2219,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:43.299708+0000","last_change":"2024-09-14T12:01:43.299613+0000","last_active":"2024-09-14T12:01:43.299708+0000","last_peered":"2024-09-14T12:01:43.299708+0000","last_clean":"2024-09-14T12:01:43.299708+0000","last_became_active":"2024-09-14T10:46:46.349465+0000","last_became_peered":"2024-09-14T10:46:46.349465+0000","last_unstale":"2024-09-14T12:01:43.299708+0000","last_undegraded":"2024-09-14T12:01:43.299708+0000","last_fullsized":"2024-09-14T12:01:43.299708+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'510","last_scrub_stamp":"2024-09-14T12:01:43.299503+0000","last_deep_scrub":"263'510","last_deep_scrub_stamp":"2024-09-14T12:01:43.299503+0000","last_clean_scrub_stamp":"2024-09-14T12:01:43.299503+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:27.070133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2847,"num_read_kb":2662,"num_write":617,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"263'337","reported_seq":1054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:27.848973+0000","last_change":"2024-09-14T12:01:27.848911+0000","last_active":"2024-09-14T12:01:27.848973+0000","last_peered":"2024-09-14T12:01:27.848973+0000","last_clean":"2024-09-14T12:01:27.848973+0000","last_became_active":"2024-09-14T10:46:44.320218+0000","last_became_peered":"2024-09-14T10:46:44.320218+0000","last_unstale":"2024-09-14T12:01:27.848973+0000","last_undegraded":"2024-09-14T12:01:27.848973+0000","last_fullsized":"2024-09-14T12:01:27.848973+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'337","last_scrub_stamp":"2024-09-14T12:01:27.848821+0000","last_deep_scrub":"263'337","last_deep_scrub_stamp":"2024-09-14T12:01:27.848821+0000","last_clean_scrub_stamp":"2024-09-14T12:01:27.848821+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:48.240608+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":866,"num_read_kb":10863,"num_write":1127,"num_write_kb":35921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"263'438","reported_seq":2120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.259005+0000","last_change":"2024-09-14T12:01:36.258935+0000","last_active":"2024-09-14T12:01:36.259005+0000","last_peered":"2024-09-14T12:01:36.259005+0000","last_clean":"2024-09-14T12:01:36.259005+0000","last_became_active":"2024-09-14T10:46:46.342206+0000","last_became_peered":"2024-09-14T10:46:46.342206+0000","last_unstale":"2024-09-14T12:01:36.259005+0000","last_undegraded":"2024-09-14T12:01:36.259005+0000","last_fullsized":"2024-09-14T12:01:36.259005+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'438","last_scrub_stamp":"2024-09-14T12:01:36.258840+0000","last_deep_scrub":"263'438","last_deep_scrub_stamp":"2024-09-14T12:01:36.258840+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.258840+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:55.906019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2469,"num_read_kb":2360,"num_write":494,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"263'464","reported_seq":1155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:29.798866+0000","last_change":"2024-09-14T12:01:29.798772+0000","last_active":"2024-09-14T12:01:29.798866+0000","last_peered":"2024-09-14T12:01:29.798866+0000","last_clean":"2024-09-14T12:01:29.798866+0000","last_became_active":"2024-09-14T10:46:44.314466+0000","last_became_peered":"2024-09-14T10:46:44.314466+0000","last_unstale":"2024-09-14T12:01:29.798866+0000","last_undegraded":"2024-09-14T12:01:29.798866+0000","last_fullsized":"2024-09-14T12:01:29.798866+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'464","last_scrub_stamp":"2024-09-14T12:01:29.798635+0000","last_deep_scrub":"263'464","last_deep_scrub_stamp":"2024-09-14T12:01:29.798635+0000","last_clean_scrub_stamp":"2024-09-14T12:01:29.798635+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:20.335848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":927,"num_read_kb":16042,"num_write":1243,"num_write_kb":34508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"263'667","reported_seq":2297,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.818090+0000","last_change":"2024-09-14T12:01:39.818030+0000","last_active":"2024-09-14T12:01:39.818090+0000","last_peered":"2024-09-14T12:01:39.818090+0000","last_clean":"2024-09-14T12:01:39.818090+0000","last_became_active":"2024-09-14T10:46:46.342217+0000","last_became_peered":"2024-09-14T10:46:46.342217+0000","last_unstale":"2024-09-14T12:01:39.818090+0000","last_undegraded":"2024-09-14T12:01:39.818090+0000","last_fullsized":"2024-09-14T12:01:39.818090+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'667","last_scrub_stamp":"2024-09-14T12:01:39.817940+0000","last_deep_scrub":"263'667","last_deep_scrub_stamp":"2024-09-14T12:01:39.817940+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.817940+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":600,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:34.611710+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3344,"num_read_kb":3009,"num_write":894,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"263'322","reported_seq":1073,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.858419+0000","last_change":"2024-09-14T12:01:28.858345+0000","last_active":"2024-09-14T12:01:28.858419+0000","last_peered":"2024-09-14T12:01:28.858419+0000","last_clean":"2024-09-14T12:01:28.858419+0000","last_became_active":"2024-09-14T10:46:44.323339+0000","last_became_peered":"2024-09-14T10:46:44.323339+0000","last_unstale":"2024-09-14T12:01:28.858419+0000","last_undegraded":"2024-09-14T12:01:28.858419+0000","last_fullsized":"2024-09-14T12:01:28.858419+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'322","last_scrub_stamp":"2024-09-14T12:01:28.858232+0000","last_deep_scrub":"263'322","last_deep_scrub_stamp":"2024-09-14T12:01:28.858232+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.858232+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:01.869819+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":616,"num_read_kb":14372,"num_write":932,"num_write_kb":14595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'445","reported_seq":1986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.723012+0000","last_change":"2024-09-14T12:01:31.722923+0000","last_active":"2024-09-14T12:01:31.723012+0000","last_peered":"2024-09-14T12:01:31.723012+0000","last_clean":"2024-09-14T12:01:31.723012+0000","last_became_active":"2024-09-14T10:46:46.341731+0000","last_became_peered":"2024-09-14T10:46:46.341731+0000","last_unstale":"2024-09-14T12:01:31.723012+0000","last_undegraded":"2024-09-14T12:01:31.723012+0000","last_fullsized":"2024-09-14T12:01:31.723012+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'445","last_scrub_stamp":"2024-09-14T12:01:31.722836+0000","last_deep_scrub":"263'445","last_deep_scrub_stamp":"2024-09-14T12:01:31.722836+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.722836+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:48.676362+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2390,"num_read_kb":2239,"num_write":538,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"263'379","reported_seq":1099,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.300774+0000","last_change":"2024-09-14T12:01:34.300705+0000","last_active":"2024-09-14T12:01:34.300774+0000","last_peered":"2024-09-14T12:01:34.300774+0000","last_clean":"2024-09-14T12:01:34.300774+0000","last_became_active":"2024-09-14T10:46:44.321604+0000","last_became_peered":"2024-09-14T10:46:44.321604+0000","last_unstale":"2024-09-14T12:01:34.300774+0000","last_undegraded":"2024-09-14T12:01:34.300774+0000","last_fullsized":"2024-09-14T12:01:34.300774+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'379","last_scrub_stamp":"2024-09-14T12:01:34.300564+0000","last_deep_scrub":"263'379","last_deep_scrub_stamp":"2024-09-14T12:01:34.300564+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.300564+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:20.332645+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":797,"num_read_kb":33592,"num_write":1248,"num_write_kb":22096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"263'972","reported_seq":2689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:40.009007+0000","last_change":"2024-09-14T12:01:40.009007+0000","last_active":"2024-09-14T12:01:40.009007+0000","last_peered":"2024-09-14T12:01:40.009007+0000","last_clean":"2024-09-14T12:01:40.009007+0000","last_became_active":"2024-09-14T10:46:46.336508+0000","last_became_peered":"2024-09-14T10:46:46.336508+0000","last_unstale":"2024-09-14T12:01:40.009007+0000","last_undegraded":"2024-09-14T12:01:40.009007+0000","last_fullsized":"2024-09-14T12:01:40.009007+0000","mapping_epoch":28,"log_start":"263'900","ondisk_log_start":"263'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'972","last_scrub_stamp":"2024-09-14T12:01:40.008921+0000","last_deep_scrub":"263'972","last_deep_scrub_stamp":"2024-09-14T12:01:40.008921+0000","last_clean_scrub_stamp":"2024-09-14T12:01:40.008921+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":900,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:56.378084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4671,"num_read_kb":4174,"num_write":1327,"num_write_kb":556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"263'317","reported_seq":997,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.711857+0000","last_change":"2024-09-14T12:01:38.711783+0000","last_active":"2024-09-14T12:01:38.711857+0000","last_peered":"2024-09-14T12:01:38.711857+0000","last_clean":"2024-09-14T12:01:38.711857+0000","last_became_active":"2024-09-14T10:46:44.321073+0000","last_became_peered":"2024-09-14T10:46:44.321073+0000","last_unstale":"2024-09-14T12:01:38.711857+0000","last_undegraded":"2024-09-14T12:01:38.711857+0000","last_fullsized":"2024-09-14T12:01:38.711857+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-14T12:01:38.711668+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-14T12:01:38.711668+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.711668+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:25.942500+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":672,"num_read_kb":7284,"num_write":1109,"num_write_kb":7346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"263'355","reported_seq":1815,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.294986+0000","last_change":"2024-09-14T12:01:37.294986+0000","last_active":"2024-09-14T12:01:37.294986+0000","last_peered":"2024-09-14T12:01:37.294986+0000","last_clean":"2024-09-14T12:01:37.294986+0000","last_became_active":"2024-09-14T10:46:46.341188+0000","last_became_peered":"2024-09-14T10:46:46.341188+0000","last_unstale":"2024-09-14T12:01:37.294986+0000","last_undegraded":"2024-09-14T12:01:37.294986+0000","last_fullsized":"2024-09-14T12:01:37.294986+0000","mapping_epoch":28,"log_start":"263'300","ondisk_log_start":"263'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'355","last_scrub_stamp":"2024-09-14T12:01:37.294901+0000","last_deep_scrub":"263'355","last_deep_scrub_stamp":"2024-09-14T12:01:37.294901+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.294901+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:47.263774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1965,"num_read_kb":1883,"num_write":389,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"263'399","reported_seq":1067,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.336267+0000","last_change":"2024-09-14T12:01:33.336267+0000","last_active":"2024-09-14T12:01:33.336267+0000","last_peered":"2024-09-14T12:01:33.336267+0000","last_clean":"2024-09-14T12:01:33.336267+0000","last_became_active":"2024-09-14T10:46:44.316633+0000","last_became_peered":"2024-09-14T10:46:44.316633+0000","last_unstale":"2024-09-14T12:01:33.336267+0000","last_undegraded":"2024-09-14T12:01:33.336267+0000","last_fullsized":"2024-09-14T12:01:33.336267+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'399","last_scrub_stamp":"2024-09-14T12:01:33.336171+0000","last_deep_scrub":"263'399","last_deep_scrub_stamp":"2024-09-14T12:01:33.336171+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.336171+0000","objects_scrubbed":5,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:15.311699+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":793,"num_read_kb":2329,"num_write":1224,"num_write_kb":27267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"263'782","reported_seq":2444,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:45.342520+0000","last_change":"2024-09-14T12:01:45.342520+0000","last_active":"2024-09-14T12:01:45.342520+0000","last_peered":"2024-09-14T12:01:45.342520+0000","last_clean":"2024-09-14T12:01:45.342520+0000","last_became_active":"2024-09-14T10:46:46.347941+0000","last_became_peered":"2024-09-14T10:46:46.347941+0000","last_unstale":"2024-09-14T12:01:45.342520+0000","last_undegraded":"2024-09-14T12:01:45.342520+0000","last_fullsized":"2024-09-14T12:01:45.342520+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'782","last_scrub_stamp":"2024-09-14T12:01:45.342399+0000","last_deep_scrub":"263'782","last_deep_scrub_stamp":"2024-09-14T12:01:45.342399+0000","last_clean_scrub_stamp":"2024-09-14T12:01:45.342399+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:29.700684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3936,"num_read_kb":3604,"num_write":1011,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"263'350","reported_seq":1120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:28.684970+0000","last_change":"2024-09-14T12:01:28.684970+0000","last_active":"2024-09-14T12:01:28.684970+0000","last_peered":"2024-09-14T12:01:28.684970+0000","last_clean":"2024-09-14T12:01:28.684970+0000","last_became_active":"2024-09-14T10:46:44.322149+0000","last_became_peered":"2024-09-14T10:46:44.322149+0000","last_unstale":"2024-09-14T12:01:28.684970+0000","last_undegraded":"2024-09-14T12:01:28.684970+0000","last_fullsized":"2024-09-14T12:01:28.684970+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-14T12:01:28.684867+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-14T12:01:28.684867+0000","last_clean_scrub_stamp":"2024-09-14T12:01:28.684867+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:58.788732+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":929,"num_read_kb":38620,"num_write":1197,"num_write_kb":16629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"263'793","reported_seq":2354,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.706954+0000","last_change":"2024-09-14T12:01:33.706954+0000","last_active":"2024-09-14T12:01:33.706954+0000","last_peered":"2024-09-14T12:01:33.706954+0000","last_clean":"2024-09-14T12:01:33.706954+0000","last_became_active":"2024-09-14T10:46:46.340475+0000","last_became_peered":"2024-09-14T10:46:46.340475+0000","last_unstale":"2024-09-14T12:01:33.706954+0000","last_undegraded":"2024-09-14T12:01:33.706954+0000","last_fullsized":"2024-09-14T12:01:33.706954+0000","mapping_epoch":28,"log_start":"263'700","ondisk_log_start":"263'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'793","last_scrub_stamp":"2024-09-14T12:01:33.706869+0000","last_deep_scrub":"263'793","last_deep_scrub_stamp":"2024-09-14T12:01:33.706869+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.706869+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:55.128887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3820,"num_read_kb":3456,"num_write":1020,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"263'314","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:33.690051+0000","last_change":"2024-09-14T12:01:33.690051+0000","last_active":"2024-09-14T12:01:33.690051+0000","last_peered":"2024-09-14T12:01:33.690051+0000","last_clean":"2024-09-14T12:01:33.690051+0000","last_became_active":"2024-09-14T10:46:44.329386+0000","last_became_peered":"2024-09-14T10:46:44.329386+0000","last_unstale":"2024-09-14T12:01:33.690051+0000","last_undegraded":"2024-09-14T12:01:33.690051+0000","last_fullsized":"2024-09-14T12:01:33.690051+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'314","last_scrub_stamp":"2024-09-14T12:01:33.689906+0000","last_deep_scrub":"263'314","last_deep_scrub_stamp":"2024-09-14T12:01:33.689906+0000","last_clean_scrub_stamp":"2024-09-14T12:01:33.689906+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:13.669972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133721,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":628,"num_read_kb":13742,"num_write":1168,"num_write_kb":24265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"263'490","reported_seq":2197,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:32.754429+0000","last_change":"2024-09-14T12:01:32.754429+0000","last_active":"2024-09-14T12:01:32.754429+0000","last_peered":"2024-09-14T12:01:32.754429+0000","last_clean":"2024-09-14T12:01:32.754429+0000","last_became_active":"2024-09-14T10:46:46.351291+0000","last_became_peered":"2024-09-14T10:46:46.351291+0000","last_unstale":"2024-09-14T12:01:32.754429+0000","last_undegraded":"2024-09-14T12:01:32.754429+0000","last_fullsized":"2024-09-14T12:01:32.754429+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'490","last_scrub_stamp":"2024-09-14T12:01:32.754339+0000","last_deep_scrub":"263'490","last_deep_scrub_stamp":"2024-09-14T12:01:32.754339+0000","last_clean_scrub_stamp":"2024-09-14T12:01:32.754339+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:32.023682+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2678,"num_read_kb":2537,"num_write":593,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":894,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"263'343","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.241182+0000","last_change":"2024-09-14T12:01:31.241182+0000","last_active":"2024-09-14T12:01:31.241182+0000","last_peered":"2024-09-14T12:01:31.241182+0000","last_clean":"2024-09-14T12:01:31.241182+0000","last_became_active":"2024-09-14T10:46:44.328509+0000","last_became_peered":"2024-09-14T10:46:44.328509+0000","last_unstale":"2024-09-14T12:01:31.241182+0000","last_undegraded":"2024-09-14T12:01:31.241182+0000","last_fullsized":"2024-09-14T12:01:31.241182+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-14T12:01:31.241061+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-14T12:01:31.241061+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.241061+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:17.044831+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":629,"num_read_kb":8535,"num_write":1026,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"263'632","reported_seq":2315,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:36.069205+0000","last_change":"2024-09-14T12:01:36.069205+0000","last_active":"2024-09-14T12:01:36.069205+0000","last_peered":"2024-09-14T12:01:36.069205+0000","last_clean":"2024-09-14T12:01:36.069205+0000","last_became_active":"2024-09-14T10:46:46.343264+0000","last_became_peered":"2024-09-14T10:46:46.343264+0000","last_unstale":"2024-09-14T12:01:36.069205+0000","last_undegraded":"2024-09-14T12:01:36.069205+0000","last_fullsized":"2024-09-14T12:01:36.069205+0000","mapping_epoch":28,"log_start":"263'600","ondisk_log_start":"263'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'632","last_scrub_stamp":"2024-09-14T12:01:36.069122+0000","last_deep_scrub":"263'632","last_deep_scrub_stamp":"2024-09-14T12:01:36.069122+0000","last_clean_scrub_stamp":"2024-09-14T12:01:36.069122+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":600,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:42.345376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3383,"num_read_kb":3097,"num_write":846,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"263'340","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:37.726684+0000","last_change":"2024-09-14T12:01:37.726684+0000","last_active":"2024-09-14T12:01:37.726684+0000","last_peered":"2024-09-14T12:01:37.726684+0000","last_clean":"2024-09-14T12:01:37.726684+0000","last_became_active":"2024-09-14T10:46:44.334832+0000","last_became_peered":"2024-09-14T10:46:44.334832+0000","last_unstale":"2024-09-14T12:01:37.726684+0000","last_undegraded":"2024-09-14T12:01:37.726684+0000","last_fullsized":"2024-09-14T12:01:37.726684+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-14T12:01:37.726545+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-14T12:01:37.726545+0000","last_clean_scrub_stamp":"2024-09-14T12:01:37.726545+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:30.213654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":614,"num_read_kb":31835,"num_write":1126,"num_write_kb":37799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"263'1874","reported_seq":3540,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.633710+0000","last_change":"2024-09-14T12:01:39.633710+0000","last_active":"2024-09-14T12:01:39.633710+0000","last_peered":"2024-09-14T12:01:39.633710+0000","last_clean":"2024-09-14T12:01:39.633710+0000","last_became_active":"2024-09-14T10:46:46.344246+0000","last_became_peered":"2024-09-14T10:46:46.344246+0000","last_unstale":"2024-09-14T12:01:39.633710+0000","last_undegraded":"2024-09-14T12:01:39.633710+0000","last_fullsized":"2024-09-14T12:01:39.633710+0000","mapping_epoch":28,"log_start":"263'1800","ondisk_log_start":"263'1800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1874","last_scrub_stamp":"2024-09-14T12:01:39.633604+0000","last_deep_scrub":"263'1874","last_deep_scrub_stamp":"2024-09-14T12:01:39.633604+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.633604+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":1800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:47.360631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8234,"num_read_kb":7178,"num_write":2635,"num_write_kb":1169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"263'380","reported_seq":1034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:30.159937+0000","last_change":"2024-09-14T12:01:30.159937+0000","last_active":"2024-09-14T12:01:30.159937+0000","last_peered":"2024-09-14T12:01:30.159937+0000","last_clean":"2024-09-14T12:01:30.159937+0000","last_became_active":"2024-09-14T10:46:44.331468+0000","last_became_peered":"2024-09-14T10:46:44.331468+0000","last_unstale":"2024-09-14T12:01:30.159937+0000","last_undegraded":"2024-09-14T12:01:30.159937+0000","last_fullsized":"2024-09-14T12:01:30.159937+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'380","last_scrub_stamp":"2024-09-14T12:01:30.159811+0000","last_deep_scrub":"263'380","last_deep_scrub_stamp":"2024-09-14T12:01:30.159811+0000","last_clean_scrub_stamp":"2024-09-14T12:01:30.159811+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:37.605807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":628,"num_read_kb":40986,"num_write":1142,"num_write_kb":50458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"263'599","reported_seq":2264,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:34.678606+0000","last_change":"2024-09-14T12:01:34.678606+0000","last_active":"2024-09-14T12:01:34.678606+0000","last_peered":"2024-09-14T12:01:34.678606+0000","last_clean":"2024-09-14T12:01:34.678606+0000","last_became_active":"2024-09-14T10:46:46.351379+0000","last_became_peered":"2024-09-14T10:46:46.351379+0000","last_unstale":"2024-09-14T12:01:34.678606+0000","last_undegraded":"2024-09-14T12:01:34.678606+0000","last_fullsized":"2024-09-14T12:01:34.678606+0000","mapping_epoch":28,"log_start":"263'500","ondisk_log_start":"263'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'599","last_scrub_stamp":"2024-09-14T12:01:34.678513+0000","last_deep_scrub":"263'599","last_deep_scrub_stamp":"2024-09-14T12:01:34.678513+0000","last_clean_scrub_stamp":"2024-09-14T12:01:34.678513+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:37.519527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3319,"num_read_kb":3081,"num_write":803,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"263'409","reported_seq":1135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:31.821200+0000","last_change":"2024-09-14T12:01:31.821133+0000","last_active":"2024-09-14T12:01:31.821200+0000","last_peered":"2024-09-14T12:01:31.821200+0000","last_clean":"2024-09-14T12:01:31.821200+0000","last_became_active":"2024-09-14T10:47:18.421420+0000","last_became_peered":"2024-09-14T10:47:18.421420+0000","last_unstale":"2024-09-14T12:01:31.821200+0000","last_undegraded":"2024-09-14T12:01:31.821200+0000","last_fullsized":"2024-09-14T12:01:31.821200+0000","mapping_epoch":39,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'409","last_scrub_stamp":"2024-09-14T12:01:31.821006+0000","last_deep_scrub":"263'409","last_deep_scrub_stamp":"2024-09-14T12:01:31.821006+0000","last_clean_scrub_stamp":"2024-09-14T12:01:31.821006+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:29.377483+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1006,"num_read_kb":55242,"num_write":1376,"num_write_kb":21886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.30","version":"263'358","reported_seq":1068,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:39.667671+0000","last_change":"2024-09-14T12:01:39.667671+0000","last_active":"2024-09-14T12:01:39.667671+0000","last_peered":"2024-09-14T12:01:39.667671+0000","last_clean":"2024-09-14T12:01:39.667671+0000","last_became_active":"2024-09-14T10:46:44.336397+0000","last_became_peered":"2024-09-14T10:46:44.336397+0000","last_unstale":"2024-09-14T12:01:39.667671+0000","last_undegraded":"2024-09-14T12:01:39.667671+0000","last_fullsized":"2024-09-14T12:01:39.667671+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-09-14T12:01:39.667554+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-09-14T12:01:39.667554+0000","last_clean_scrub_stamp":"2024-09-14T12:01:39.667554+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:53.690379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":768,"num_read_kb":58312,"num_write":1211,"num_write_kb":50973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"263'439","reported_seq":2133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:41.593963+0000","last_change":"2024-09-14T12:01:41.593906+0000","last_active":"2024-09-14T12:01:41.593963+0000","last_peered":"2024-09-14T12:01:41.593963+0000","last_clean":"2024-09-14T12:01:41.593963+0000","last_became_active":"2024-09-14T10:46:46.352396+0000","last_became_peered":"2024-09-14T10:46:46.352396+0000","last_unstale":"2024-09-14T12:01:41.593963+0000","last_undegraded":"2024-09-14T12:01:41.593963+0000","last_fullsized":"2024-09-14T12:01:41.593963+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'439","last_scrub_stamp":"2024-09-14T12:01:41.593806+0000","last_deep_scrub":"263'439","last_deep_scrub_stamp":"2024-09-14T12:01:41.593806+0000","last_clean_scrub_stamp":"2024-09-14T12:01:41.593806+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:50.381664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2667,"num_read_kb":2535,"num_write":508,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2571,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"263'294","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:35.295648+0000","last_change":"2024-09-14T12:01:35.295648+0000","last_active":"2024-09-14T12:01:35.295648+0000","last_peered":"2024-09-14T12:01:35.295648+0000","last_clean":"2024-09-14T12:01:35.295648+0000","last_became_active":"2024-09-14T10:46:44.331494+0000","last_became_peered":"2024-09-14T10:46:44.331494+0000","last_unstale":"2024-09-14T12:01:35.295648+0000","last_undegraded":"2024-09-14T12:01:35.295648+0000","last_fullsized":"2024-09-14T12:01:35.295648+0000","mapping_epoch":26,"log_start":"263'200","ondisk_log_start":"263'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-14T12:01:35.295543+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-14T12:01:35.295543+0000","last_clean_scrub_stamp":"2024-09-14T12:01:35.295543+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:19.923292+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048962,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":471,"num_read_kb":43363,"num_write":903,"num_write_kb":33511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"263'474","reported_seq":1984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:01:38.684079+0000","last_change":"2024-09-14T12:01:38.684020+0000","last_active":"2024-09-14T12:01:38.684079+0000","last_peered":"2024-09-14T12:01:38.684079+0000","last_clean":"2024-09-14T12:01:38.684079+0000","last_became_active":"2024-09-14T10:46:46.339440+0000","last_became_peered":"2024-09-14T10:46:46.339440+0000","last_unstale":"2024-09-14T12:01:38.684079+0000","last_undegraded":"2024-09-14T12:01:38.684079+0000","last_fullsized":"2024-09-14T12:01:38.684079+0000","mapping_epoch":28,"log_start":"263'400","ondisk_log_start":"263'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'474","last_scrub_stamp":"2024-09-14T12:01:38.683932+0000","last_deep_scrub":"263'474","last_deep_scrub_stamp":"2024-09-14T12:01:38.683932+0000","last_clean_scrub_stamp":"2024-09-14T12:01:38.683932+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:27.526192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2508,"num_read_kb":2330,"num_write":579,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9256,"num_read_kb":6632,"num_write":2794,"num_write_kb":850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":943,"ondisk_log_size":943,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15505,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":15201,"num_read_kb":14853,"num_write":17064,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2690,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1677,"ondisk_log_size":1677,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":560,"ondisk_log_size":560,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1549008,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":19140,"num_read_kb":39857,"num_write":16035,"num_write_kb":12077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":712010,"num_omap_keys":1620,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1845,"ondisk_log_size":1845,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2425,"num_read_kb":2892,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":218145,"num_read_kb":199614,"num_write":55573,"num_write_kb":18950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35771,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4139,"ondisk_log_size":4139,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":30929583,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":44270,"num_read_kb":1895605,"num_write":71703,"num_write_kb":2068626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":47898624,"data_stored":47898624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3414,"ondisk_log_size":3414,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":184539,"num_write":157,"num_write_kb":126109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":184485,"num_write":157,"num_write_kb":126109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510363,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":225012,"kb_used_data":9252,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":94146828,"statfs":{"total":96636764160,"available":96406351872,"internally_reserved":0,"allocated":9474048,"data_stored":7497795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":220920266},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510362,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":205024,"kb_used_data":11472,"kb_used_omap":1,"kb_used_meta":193534,"kb_avail":94166816,"statfs":{"total":96636764160,"available":96426819584,"internally_reserved":0,"allocated":11747328,"data_stored":9764047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":198179269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510362,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243888,"kb_used_data":14176,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94127952,"statfs":{"total":96636764160,"available":96387022848,"internally_reserved":0,"allocated":14516224,"data_stored":12527301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510363,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127356,"kb_used_data":10092,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94244484,"statfs":{"total":96636764160,"available":96506351616,"internally_reserved":0,"allocated":10334208,"data_stored":8364267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510361,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":324468,"kb_used_data":10084,"kb_used_omap":1,"kb_used_meta":314366,"kb_avail":94047372,"statfs":{"total":96636764160,"available":96304508928,"internally_reserved":0,"allocated":10326016,"data_stored":8344841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":321911237},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510361,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116236,"kb_used_data":8700,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94255604,"statfs":{"total":96636764160,"available":96517738496,"internally_reserved":0,"allocated":8908800,"data_stored":6901467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543065,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137180,"kb_used_data":7500,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94234660,"statfs":{"total":96636764160,"available":96496291840,"internally_reserved":0,"allocated":7680000,"data_stored":5672286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132774343},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575771,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":283548,"kb_used_data":9420,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94088292,"statfs":{"total":96636764160,"available":96346411008,"internally_reserved":0,"allocated":9646080,"data_stored":7654490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4694016,"data_stored":4694016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5550080,"data_stored":5550080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6160384,"data_stored":6160384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10321920,"data_stored":10321920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7557120,"data_stored":7557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4857856,"data_stored":4857856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3465216,"data_stored":3465216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5292032,"data_stored":5292032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":2916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:02:49.277 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-14T12:02:49.629 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-14T12:02:49.629 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-14T12:02:49.629 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-14T12:02:49.629 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:02:49.674 INFO:tasks.ceph.osd.0:Stopped 2024-09-14T12:02:49.675 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-14T12:02:49.675 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:02:49.722 INFO:tasks.ceph.osd.1:Stopped 2024-09-14T12:02:49.722 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-14T12:02:49.722 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:02:49.767 INFO:tasks.ceph.osd.2:Stopped 2024-09-14T12:02:49.767 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-14T12:02:49.767 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:02:49.814 INFO:tasks.ceph.osd.3:Stopped 2024-09-14T12:02:49.815 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-14T12:02:49.815 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:02:49.870 INFO:tasks.ceph.osd.4:Stopped 2024-09-14T12:02:49.870 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-14T12:02:49.871 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:02:49.931 INFO:tasks.ceph.osd.5:Stopped 2024-09-14T12:02:49.932 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-14T12:02:49.932 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:02:49.977 INFO:tasks.ceph.osd.6:Stopped 2024-09-14T12:02:49.977 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-14T12:02:49.977 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:02:50.028 INFO:tasks.ceph.osd.7:Stopped 2024-09-14T12:02:50.028 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-14T12:02:50.028 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-14T12:02:50.029 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:02:50.053 INFO:tasks.ceph.mgr.y:Stopped 2024-09-14T12:02:50.053 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-14T12:02:50.053 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:02:50.082 INFO:tasks.ceph.mgr.x:Stopped 2024-09-14T12:02:50.083 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-14T12:02:50.083 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-14T12:02:50.083 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:02:50.111 INFO:tasks.ceph.mon.a:Stopped 2024-09-14T12:02:50.111 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-14T12:02:50.111 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:02:50.164 INFO:tasks.ceph.mon.c:Stopped 2024-09-14T12:02:50.165 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-14T12:02:50.165 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:02:50.177 INFO:tasks.ceph.mon.b:Stopped 2024-09-14T12:02:50.177 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-14T12:02:50.177 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-14T12:02:50.248 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-14T12:02:50.248 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-14T12:02:50.555 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-14T12:02:50.556 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-14T12:02:50.671 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-14T12:02:50.671 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-14T12:02:50.754 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-14T12:02:50.754 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-14T12:02:50.835 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi118.front.sepia.ceph.com 2024-09-14T12:02:50.835 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-14T12:02:50.980 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi118.front.sepia.ceph.com 2024-09-14T12:02:50.981 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-14T12:02:51.068 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi118.front.sepia.ceph.com 2024-09-14T12:02:51.069 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-14T12:02:51.140 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi118.front.sepia.ceph.com 2024-09-14T12:02:51.141 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-14T12:02:51.221 INFO:tasks.ceph:Archiving mon data... 2024-09-14T12:02:51.222 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904124/data/mon.a.tgz 2024-09-14T12:02:51.222 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-09-14T12:02:51.253 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.tkrhIGHzuB 2024-09-14T12:02:51.253 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.tkrhIGHzuB 2024-09-14T12:02:51.440 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.tkrhIGHzuB 2024-09-14T12:02:51.552 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.tkrhIGHzuB is 467KB 2024-09-14T12:02:51.650 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.tkrhIGHzuB 2024-09-14T12:02:51.679 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904124/data/mon.c.tgz 2024-09-14T12:02:51.679 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-09-14T12:02:51.748 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.oFLcAD9sfS 2024-09-14T12:02:51.748 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.oFLcAD9sfS 2024-09-14T12:02:51.926 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.oFLcAD9sfS 2024-09-14T12:02:52.038 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.oFLcAD9sfS is 471KB 2024-09-14T12:02:52.121 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.oFLcAD9sfS 2024-09-14T12:02:52.150 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904124/data/mon.b.tgz 2024-09-14T12:02:52.150 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2024-09-14T12:02:52.185 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.1N8nWJc4x3 2024-09-14T12:02:52.185 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.1N8nWJc4x3 2024-09-14T12:02:52.370 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.1N8nWJc4x3 2024-09-14T12:02:52.481 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.1N8nWJc4x3 is 471KB 2024-09-14T12:02:52.577 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.1N8nWJc4x3 2024-09-14T12:02:52.606 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-14T12:02:52.606 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T12:02:52.609 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T12:02:52.795 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T12:02:52.824 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T12:02:52.824 INFO:tasks.ceph:Archiving crash dumps... 2024-09-14T12:02:52.826 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904124/remote/smithi050/crash 2024-09-14T12:02:52.827 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T12:02:52.867 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904124/remote/smithi118/crash 2024-09-14T12:02:52.868 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T12:02:52.906 INFO:tasks.ceph:Compressing logs... 2024-09-14T12:02:52.906 DEBUG:teuthology.orchestra.run.smithi050:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T12:02:52.912 DEBUG:teuthology.orchestra.run.smithi118:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T12:02:52.948 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-14T12:02:52.954 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81947.log 2024-09-14T12:02:52.954 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57776.log 2024-09-14T12:02:52.954 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.81947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80180.log 2024-09-14T12:02:52.954 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.81947.log.gz 2024-09-14T12:02:52.954 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90783.log 2024-09-14T12:02:52.954 INFO:teuthology.orchestra.run.smithi050.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.57776.log.gz 2024-09-14T12:02:52.955 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68744.log 2024-09-14T12:02:52.955 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.80180.log: /var/log/ceph/ceph-client.admin.90783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189729.log 2024-09-14T12:02:52.955 INFO:teuthology.orchestra.run.smithi050.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.80180.log.gz 2024-09-14T12:02:52.955 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.68744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38159.log 2024-09-14T12:02:52.955 INFO:teuthology.orchestra.run.smithi050.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.90783.log.gz 2024-09-14T12:02:52.955 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.189729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40722.log 2024-09-14T12:02:52.955 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189729.log.gz 2024-09-14T12:02:52.955 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174567.log 2024-09-14T12:02:52.955 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38159.log.gz 2024-09-14T12:02:52.955 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.40722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37784.log 2024-09-14T12:02:52.955 INFO:teuthology.orchestra.run.smithi050.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.40722.log.gz 2024-09-14T12:02:52.955 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.174567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136728.log 2024-09-14T12:02:52.955 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68744.log.gz 2024-09-14T12:02:52.955 INFO:teuthology.orchestra.run.smithi050.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.174567.log.gz 2024-09-14T12:02:52.955 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107275.log 2024-09-14T12:02:52.956 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37784.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37784.log.gz 2024-09-14T12:02:52.956 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.136728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39033.log 2024-09-14T12:02:52.956 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.107275.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.136728.log.gz 2024-09-14T12:02:52.956 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118469.log 2024-09-14T12:02:52.956 INFO:teuthology.orchestra.run.smithi050.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.107275.log.gz 2024-09-14T12:02:52.956 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160291.log 2024-09-14T12:02:52.956 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39033.log.gz 2024-09-14T12:02:52.956 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.118469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171379.log 2024-09-14T12:02:52.956 INFO:teuthology.orchestra.run.smithi050.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.118469.log.gz 2024-09-14T12:02:52.956 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.160291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38372.log 2024-09-14T12:02:52.956 INFO:teuthology.orchestra.run.smithi050.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.160291.log.gz 2024-09-14T12:02:52.956 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.171379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49434.log 2024-09-14T12:02:52.956 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113757.log 92.2% 2024-09-14T12:02:52.956 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.171379.log.gz 2024-09-14T12:02:52.956 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38372.log.gz 2024-09-14T12:02:52.957 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.49434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117291.log 2024-09-14T12:02:52.997 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32644.log 2024-09-14T12:02:52.997 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32831.log 2024-09-14T12:02:52.997 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32688.log 2024-09-14T12:02:52.997 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32644.log.gz 2024-09-14T12:02:52.998 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32831.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-14T12:02:52.998 INFO:teuthology.orchestra.run.smithi118.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32831.log.gz 2024-09-14T12:02:52.998 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32600.log 2024-09-14T12:02:52.998 INFO:teuthology.orchestra.run.smithi118.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32688.log.gz 2024-09-14T12:02:52.998 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-14T12:02:52.998 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32600.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T12:02:52.998 INFO:teuthology.orchestra.run.smithi118.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32600.log.gz 2024-09-14T12:02:52.998 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32732.log 2024-09-14T12:02:52.998 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32787.log 2024-09-14T12:02:52.998 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32732.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-osd.6.log -- replaced with /var/log/ceph/ceph-client.admin.32732.log.gz 2024-09-14T12:02:52.998 INFO:teuthology.orchestra.run.smithi118.stderr: 2024-09-14T12:02:52.998 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32787.log.gz 2024-09-14T12:02:52.998 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-14T12:02:52.998 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T12:02:52.999 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32875.log 2024-09-14T12:02:52.999 INFO:teuthology.orchestra.run.smithi118.stderr: 90.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T12:02:52.999 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-14T12:02:52.999 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32875.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-14T12:02:52.999 INFO:teuthology.orchestra.run.smithi118.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32875.log.gz 2024-09-14T12:02:52.999 INFO:teuthology.orchestra.run.smithi118.stderr:gzip/var/log/ceph/ceph-mgr.x.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32919.log 2024-09-14T12:02:52.999 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.32919.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32919.log.gz 2024-09-14T12:02:53.000 INFO:teuthology.orchestra.run.smithi118.stderr: 87.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T12:02:53.038 INFO:teuthology.orchestra.run.smithi050.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.49434.log.gz/var/log/ceph/ceph-client.admin.113757.log: 2024-09-14T12:02:53.038 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99029.log 2024-09-14T12:02:53.038 INFO:teuthology.orchestra.run.smithi050.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.113757.log.gz 2024-09-14T12:02:53.038 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.117291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101974.log 2024-09-14T12:02:53.038 INFO:teuthology.orchestra.run.smithi050.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.117291.log.gz 2024-09-14T12:02:53.038 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.99029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192450.log 2024-09-14T12:02:53.039 INFO:teuthology.orchestra.run.smithi050.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.99029.log.gz 2024-09-14T12:02:53.039 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144975.log 2024-09-14T12:02:53.039 INFO:teuthology.orchestra.run.smithi050.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.101974.log.gz 2024-09-14T12:02:53.039 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.192450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92550.log 2024-09-14T12:02:53.039 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192450.log.gz 2024-09-14T12:02:53.039 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40119.log 2024-09-14T12:02:53.039 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.144975.log: /var/log/ceph/ceph-client.admin.92550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83714.log 2024-09-14T12:02:53.039 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.144975.log.gz 2024-09-14T12:02:53.039 INFO:teuthology.orchestra.run.smithi050.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.92550.log.gz 2024-09-14T12:02:53.039 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.40119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52475.log 2024-09-14T12:02:53.039 INFO:teuthology.orchestra.run.smithi050.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.40119.log.gz 2024-09-14T12:02:53.039 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192266.log 2024-09-14T12:02:53.039 INFO:teuthology.orchestra.run.smithi050.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.83714.log.gz 2024-09-14T12:02:53.040 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102563.log 2024-09-14T12:02:53.040 INFO:teuthology.orchestra.run.smithi050.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.52475.log.gz 2024-09-14T12:02:53.040 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.192266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53653.log 2024-09-14T12:02:53.040 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192266.log.gz 2024-09-14T12:02:53.040 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38021.log 2024-09-14T12:02:53.040 INFO:teuthology.orchestra.run.smithi050.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.102563.log.gz 2024-09-14T12:02:53.040 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182998.log 2024-09-14T12:02:53.040 INFO:teuthology.orchestra.run.smithi050.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.53653.log.gz 2024-09-14T12:02:53.040 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38021.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-14T12:02:53.040 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38021.log.gz 2024-09-14T12:02:53.040 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.182998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182389.log 2024-09-14T12:02:53.040 INFO:teuthology.orchestra.run.smithi050.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.182998.log.gz 2024-09-14T12:02:53.040 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192174.log 2024-09-14T12:02:53.040 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.182389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120236.log 2024-09-14T12:02:53.041 INFO:teuthology.orchestra.run.smithi050.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.182389.log.gz 2024-09-14T12:02:53.041 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.192174.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ops-log-ceph-client.0.log 2024-09-14T12:02:53.041 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.192174.log.gz 2024-09-14T12:02:53.041 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166299.log 2024-09-14T12:02:53.041 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.120236.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.120236.log.gz 2024-09-14T12:02:53.041 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38987.log 2024-09-14T12:02:53.041 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.166299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178735.log 2024-09-14T12:02:53.041 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68125.log 2024-09-14T12:02:53.041 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% 86.8% -- replaced with /var/log/ceph/ceph-client.admin.166299.log.gz 2024-09-14T12:02:53.041 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38987.log.gz 2024-09-14T12:02:53.041 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.178735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188999.log 2024-09-14T12:02:53.041 INFO:teuthology.orchestra.run.smithi050.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.178735.log.gz 2024-09-14T12:02:53.041 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115524.log 2024-09-14T12:02:53.042 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.68125.log: /var/log/ceph/ceph-client.admin.188999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192082.log 2024-09-14T12:02:53.042 INFO:teuthology.orchestra.run.smithi050.stderr: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.188999.log.gz 2024-09-14T12:02:53.042 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.115524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140851.log 2024-09-14T12:02:53.042 INFO:teuthology.orchestra.run.smithi050.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.115524.log.gz 2024-09-14T12:02:53.042 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.192082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69996.log 2024-09-14T12:02:53.042 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192082.log.gz 2024-09-14T12:02:53.042 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38067.log 2024-09-14T12:02:53.042 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.140851.log: /var/log/ceph/ceph-client.admin.69996.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.140851.log.gz 2024-09-14T12:02:53.042 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111401.log 2024-09-14T12:02:53.042 INFO:teuthology.orchestra.run.smithi050.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.68125.log.gz 2024-09-14T12:02:53.042 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38067.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38067.log.gz -5 2024-09-14T12:02:53.042 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.0.179344.log 2024-09-14T12:02:53.042 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.111401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173351.log 2024-09-14T12:02:53.042 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.179344.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111401.log.gz 2024-09-14T12:02:53.042 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65647.log 2024-09-14T12:02:53.042 INFO:teuthology.orchestra.run.smithi050.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.179344.log.gz 2024-09-14T12:02:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.173351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52451.log 2024-09-14T12:02:53.043 INFO:teuthology.orchestra.run.smithi050.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.69996.log.gz 2024-09-14T12:02:53.043 INFO:teuthology.orchestra.run.smithi050.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.173351.log.gz 2024-09-14T12:02:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94317.log 2024-09-14T12:02:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140262.log 2024-09-14T12:02:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52451.log.gz 2024-09-14T12:02:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.94317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70616.log 2024-09-14T12:02:53.043 INFO:teuthology.orchestra.run.smithi050.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.65647.log.gz 2024-09-14T12:02:53.043 INFO:teuthology.orchestra.run.smithi050.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.94317.log.gz 2024-09-14T12:02:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.140262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192634.log 2024-09-14T12:02:53.043 INFO:teuthology.orchestra.run.smithi050.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.140262.log.gz 2024-09-14T12:02:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87838.log 2024-09-14T12:02:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.70616.log: /var/log/ceph/ceph-client.admin.192634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39487.log 2024-09-14T12:02:53.043 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192634.log.gz 2024-09-14T12:02:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47667.log 2024-09-14T12:02:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.87838.log: /var/log/ceph/ceph-client.admin.39487.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39487.log.gz 2024-09-14T12:02:53.044 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% --verbose -- /var/log/ceph/ceph-client.admin.163258.log 2024-09-14T12:02:53.044 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.87838.log.gz 2024-09-14T12:02:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.47667.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.143796.log 2024-09-14T12:02:53.044 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70616.log.gz 2024-09-14T12:02:53.044 INFO:teuthology.orchestra.run.smithi050.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.47667.log.gz 2024-09-14T12:02:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.163258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39510.log 2024-09-14T12:02:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.143796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149687.log 2024-09-14T12:02:53.044 INFO:teuthology.orchestra.run.smithi050.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.163258.log.gz 2024-09-14T12:02:53.044 INFO:teuthology.orchestra.run.smithi050.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.143796.log.gz 2024-09-14T12:02:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.39510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123770.log 2024-09-14T12:02:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-client.admin.149687.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.143207.log 2024-09-14T12:02:53.044 INFO:teuthology.orchestra.run.smithi050.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.149687.log.gz 2024-09-14T12:02:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.123770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86070.log 2024-09-14T12:02:53.045 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.123770.log.gz 2024-09-14T12:02:53.045 INFO:teuthology.orchestra.run.smithi050.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.0.39510.log.gz 2024-09-14T12:02:53.045 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.143207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151454.log 2024-09-14T12:02:53.045 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120825.log 2024-09-14T12:02:53.045 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.86070.log: 81.8%/var/log/ceph/ceph-client.admin.151454.log: -- replaced with /var/log/ceph/ceph-client.admin.86070.log.gz 2024-09-14T12:02:53.045 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184825.log 2024-09-14T12:02:53.045 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.120825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106097.log 2024-09-14T12:02:53.045 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.184825.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.120825.log.gz 2024-09-14T12:02:53.045 INFO:teuthology.orchestra.run.smithi050.stderr:gzip 86.6% -- replaced with /var/log/ceph/ceph-client.admin.143207.log.gz 2024-09-14T12:02:53.045 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.168973.log 2024-09-14T12:02:53.045 INFO:teuthology.orchestra.run.smithi050.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.184825.log.gz 2024-09-14T12:02:53.045 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38366.log 2024-09-14T12:02:53.045 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106097.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.151454.log.gz 2024-09-14T12:02:53.046 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.168973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158524.log 2024-09-14T12:02:53.046 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.106097.log.gz 2024-09-14T12:02:53.046 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119647.log 2024-09-14T12:02:53.046 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38366.log: /var/log/ceph/ceph-client.admin.158524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50660.log 2024-09-14T12:02:53.046 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38366.log.gz 2024-09-14T12:02:53.046 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.119647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176270.log 2024-09-14T12:02:53.046 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.158524.log.gz 2024-09-14T12:02:53.046 INFO:teuthology.orchestra.run.smithi050.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.119647.log.gz 2024-09-14T12:02:53.046 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.50660.log: 85.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109042.log 2024-09-14T12:02:53.046 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50660.log.gz 2024-09-14T12:02:53.046 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.176270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148509.log 2024-09-14T12:02:53.046 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.109042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38734.log 2024-09-14T12:02:53.046 INFO:teuthology.orchestra.run.smithi050.stderr: 81.1%/var/log/ceph/ceph-client.admin.148509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58389.log 2024-09-14T12:02:53.046 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.109042.log.gz 2024-09-14T12:02:53.047 INFO:teuthology.orchestra.run.smithi050.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.148509.log.gz 2024-09-14T12:02:53.047 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38734.log.gz 2024-09-14T12:02:53.047 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50023.log 2024-09-14T12:02:53.047 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.168973.log.gz 2024-09-14T12:02:53.047 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58389.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.176270.log.gz 2024-09-14T12:02:53.047 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58389.log.gz 2024-09-14T12:02:53.047 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193051.log 2024-09-14T12:02:53.047 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78115.log 2024-09-14T12:02:53.047 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.50023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50023.log.gz 2024-09-14T12:02:53.047 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.193051.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26699.log 2024-09-14T12:02:53.047 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193051.log.gz 2024-09-14T12:02:53.047 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189754.log 2024-09-14T12:02:53.047 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.78115.log: /var/log/ceph/ceph.tmp-client.admin.26699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192726.log 2024-09-14T12:02:53.047 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26699.log.gz 2024-09-14T12:02:53.047 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.189754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61406.log 2024-09-14T12:02:53.048 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189754.log.gz 2024-09-14T12:02:53.048 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5/var/log/ceph/ceph-client.admin.192726.log: --verbose -- /var/log/ceph/ceph-client.admin.172595.log 2024-09-14T12:02:53.048 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192726.log.gz 2024-09-14T12:02:53.048 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.61406.log: -- /var/log/ceph/ceph-client.admin.60180.log 2024-09-14T12:02:53.048 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.172595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60793.log 2024-09-14T12:02:53.048 INFO:teuthology.orchestra.run.smithi050.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.61406.log.gz 2024-09-14T12:02:53.048 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129071.log 2024-09-14T12:02:53.048 INFO:teuthology.orchestra.run.smithi050.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.172595.log.gz 2024-09-14T12:02:53.048 INFO:teuthology.orchestra.run.smithi050.stderr:gzip 85.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.60180.log.gz --verbose 2024-09-14T12:02:53.048 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.127304.log 2024-09-14T12:02:53.048 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60793.log: /var/log/ceph/ceph-client.admin.129071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159113.log 2024-09-14T12:02:53.048 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60793.log.gz 91.8% -- replaced with /var/log/ceph/ceph-client.0.78115.log.gz 2024-09-14T12:02:53.048 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-14T12:02:53.048 INFO:teuthology.orchestra.run.smithi050.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.129071.log.gz 2024-09-14T12:02:53.048 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.127304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131427.log 2024-09-14T12:02:53.049 INFO:teuthology.orchestra.run.smithi050.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.127304.log.gz 2024-09-14T12:02:53.049 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.159113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184216.log 2024-09-14T12:02:53.049 INFO:teuthology.orchestra.run.smithi050.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.159113.log.gz 2024-09-14T12:02:53.049 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192496.log 2024-09-14T12:02:53.049 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.131427.log: /var/log/ceph/ceph-client.0.184216.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.131427.log.gz 2024-09-14T12:02:53.049 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91372.log 2024-09-14T12:02:53.049 INFO:teuthology.orchestra.run.smithi050.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.184216.log.gz 2024-09-14T12:02:53.049 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.192496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185434.log 2024-09-14T12:02:53.049 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192496.log.gz 2024-09-14T12:02:53.049 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.91372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63731.log 2024-09-14T12:02:53.049 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.185434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38941.log 2024-09-14T12:02:53.049 INFO:teuthology.orchestra.run.smithi050.stderr: 83.9%/var/log/ceph/ceph-client.admin.63731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142029.log 2024-09-14T12:02:53.049 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.0.185434.log.gz 2024-09-14T12:02:53.049 INFO:teuthology.orchestra.run.smithi050.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.63731.log.gz 2024-09-14T12:02:53.050 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165710.log 2024-09-14T12:02:53.050 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38941.log.gz 2024-09-14T12:02:53.050 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.142029.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.91372.log.gzgzip 2024-09-14T12:02:53.050 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.192910.log 2024-09-14T12:02:53.050 INFO:teuthology.orchestra.run.smithi050.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.142029.log.gz 2024-09-14T12:02:53.050 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63669.log 2024-09-14T12:02:53.050 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.165710.log: /var/log/ceph/ceph-client.admin.192910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103152.log 2024-09-14T12:02:53.050 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192910.log.gz 2024-09-14T12:02:53.050 INFO:teuthology.orchestra.run.smithi050.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.165710.log.gz 2024-09-14T12:02:53.050 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141440.log 2024-09-14T12:02:53.050 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63669.log: 57.6% -- replaced with /var/log/ceph/ceph-client.admin.63669.log.gz 2024-09-14T12:02:53.050 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189778.log 2024-09-14T12:02:53.050 INFO:teuthology.orchestra.run.smithi050.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.103152.log.gz 2024-09-14T12:02:53.050 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.141440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.186652.log 2024-09-14T12:02:53.050 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.189778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156757.log 2024-09-14T12:02:53.050 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.141440.log.gz 2024-09-14T12:02:53.051 INFO:teuthology.orchestra.run.smithi050.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.189778.log.gz 2024-09-14T12:02:53.051 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.186652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192680.log 2024-09-14T12:02:53.051 INFO:teuthology.orchestra.run.smithi050.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.186652.log.gz 2024-09-14T12:02:53.051 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.156757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106686.log 2024-09-14T12:02:53.051 INFO:teuthology.orchestra.run.smithi050.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.156757.log.gz 2024-09-14T12:02:53.051 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T12:02:53.051 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.192680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192680.log.gz 2024-09-14T12:02:53.051 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124948.log 2024-09-14T12:02:53.051 INFO:teuthology.orchestra.run.smithi050.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.106686.log.gz 2024-09-14T12:02:53.051 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124359.log 2024-09-14T12:02:53.051 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.124948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192312.log 2024-09-14T12:02:53.051 INFO:teuthology.orchestra.run.smithi050.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.124948.log.gz 2024-09-14T12:02:53.051 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.124359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46157.log 2024-09-14T12:02:53.051 INFO:teuthology.orchestra.run.smithi050.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.124359.log.gz 2024-09-14T12:02:53.051 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-client.admin.192312.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.128482.log 2024-09-14T12:02:53.052 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192312.log.gz 2024-09-14T12:02:53.052 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44394.log 2024-09-14T12:02:53.052 INFO:teuthology.orchestra.run.smithi050.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.46157.log.gz 2024-09-14T12:02:53.052 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.128482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74802.log 2024-09-14T12:02:53.052 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.44394.log: gzip -5 --verbose 43.9% -- replaced with /var/log/ceph/ceph-client.0.44394.log.gz 2024-09-14T12:02:53.052 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.54242.log 2024-09-14T12:02:53.052 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.74802.log: gzip -5 --verbose 94.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T12:02:53.052 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.89016.log 2024-09-14T12:02:53.052 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.54242.log: 86.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153222.log 2024-09-14T12:02:53.052 INFO:teuthology.orchestra.run.smithi050.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.54242.log.gz 2024-09-14T12:02:53.052 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.128482.log.gz 2024-09-14T12:02:53.052 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.74802.log.gz 2024-09-14T12:02:53.052 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.89016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121414.log 2024-09-14T12:02:53.052 INFO:teuthology.orchestra.run.smithi050.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.89016.log.gz 2024-09-14T12:02:53.053 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.153222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91961.log 2024-09-14T12:02:53.053 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.121414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38368.log 2024-09-14T12:02:53.053 INFO:teuthology.orchestra.run.smithi050.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.121414.log.gz 2024-09-14T12:02:53.053 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.91961.log: gzip -5 --verbose 81.8% -- replaced with /var/log/ceph/ceph-client.admin.91961.log.gz 2024-09-14T12:02:53.053 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.0.78724.log 2024-09-14T12:02:53.053 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38368.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.153222.log.gz 2024-09-14T12:02:53.053 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38368.log.gz 2024-09-14T12:02:53.053 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39311.log 2024-09-14T12:02:53.053 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154989.log 2024-09-14T12:02:53.053 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.78724.log: /var/log/ceph/ceph-client.admin.39311.log: gzip 80.0% -- replaced with /var/log/ceph/ceph-client.0.78724.log.gz 2024-09-14T12:02:53.053 INFO:teuthology.orchestra.run.smithi050.stderr: -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39311.log.gz 2024-09-14T12:02:53.053 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.66886.log 2024-09-14T12:02:53.053 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.154989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193005.log 2024-09-14T12:02:53.053 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163895.log 2024-09-14T12:02:53.053 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.193005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193005.log.gz 2024-09-14T12:02:53.054 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130249.log 2024-09-14T12:02:53.054 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.163895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55420.log 2024-09-14T12:02:53.054 INFO:teuthology.orchestra.run.smithi050.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.154989.log.gz 2024-09-14T12:02:53.054 INFO:teuthology.orchestra.run.smithi050.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.163895.log.gz 2024-09-14T12:02:53.054 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.130249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188409.log 2024-09-14T12:02:53.054 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.130249.log.gz 2024-09-14T12:02:53.054 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.55420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134961.log 2024-09-14T12:02:53.054 INFO:teuthology.orchestra.run.smithi050.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.55420.log.gz 2024-09-14T12:02:53.054 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.188409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189659.log 2024-09-14T12:02:53.054 INFO:teuthology.orchestra.run.smithi050.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.188409.log.gz 2024-09-14T12:02:53.054 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.134961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38573.log 2024-09-14T12:02:53.054 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.189659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69363.log 2024-09-14T12:02:53.054 INFO:teuthology.orchestra.run.smithi050.stderr: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.189659.log.gz 2024-09-14T12:02:53.054 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56009.log 2024-09-14T12:02:53.054 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38573.log.gz 2024-09-14T12:02:53.055 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152043.log 2024-09-14T12:02:53.055 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.69363.log: /var/log/ceph/ceph-client.admin.56009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59002.log 2024-09-14T12:02:53.055 INFO:teuthology.orchestra.run.smithi050.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.134961.log.gz 2024-09-14T12:02:53.055 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.152043.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.56009.log.gz 2024-09-14T12:02:53.055 INFO:teuthology.orchestra.run.smithi050.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.66886.log.gz 2024-09-14T12:02:53.055 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose 81.6% -- /var/log/ceph/ops-log-ceph-client.admin.log -- replaced with /var/log/ceph/ceph-client.admin.152043.log.gz 2024-09-14T12:02:53.055 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-14T12:02:53.055 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134372.log 2024-09-14T12:02:53.055 INFO:teuthology.orchestra.run.smithi050.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.59002.log.gz/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79591.log 2024-09-14T12:02:53.055 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-14T12:02:53.055 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.134372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32791.log 2024-09-14T12:02:53.055 INFO:teuthology.orchestra.run.smithi050.stderr: 81.5%/var/log/ceph/ceph-client.admin.79591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156167.log 2024-09-14T12:02:53.055 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.134372.log.gz 2024-09-14T12:02:53.055 INFO:teuthology.orchestra.run.smithi050.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.79591.log.gz 2024-09-14T12:02:53.055 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32791.log.gz 2024-09-14T12:02:53.055 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192772.log 2024-09-14T12:02:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.156167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51249.log 2024-09-14T12:02:53.056 INFO:teuthology.orchestra.run.smithi050.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.156167.log.gz/var/log/ceph/ceph-client.admin.192772.log: 2024-09-14T12:02:53.056 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192772.log.gz 2024-09-14T12:02:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137906.log 2024-09-14T12:02:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.51249.log: -- /var/log/ceph/ceph-client.admin.86659.log 2024-09-14T12:02:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.137906.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.51249.log.gz 2024-09-14T12:02:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- 81.6% -- replaced with /var/log/ceph/ceph-client.admin.137906.log.gz 2024-09-14T12:02:53.056 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.83125.log 2024-09-14T12:02:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.86659.log: -- /var/log/ceph/ceph-client.admin.157935.log 2024-09-14T12:02:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.83125.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.86659.log.gz 2024-09-14T12:02:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- 81.8% /var/log/ceph/ceph-client.admin.51838.log 2024-09-14T12:02:53.056 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.83125.log.gz 2024-09-14T12:02:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.157935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43188.log 94.2% 2024-09-14T12:02:53.056 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-14T12:02:53.056 INFO:teuthology.orchestra.run.smithi050.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.157935.log.gz 2024-09-14T12:02:53.057 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116113.log 2024-09-14T12:02:53.057 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.51838.log: /var/log/ceph/ceph-client.0.43188.log: gzip -5 85.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.51838.log.gz -- 2024-09-14T12:02:53.057 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.155578.log 2024-09-14T12:02:53.057 INFO:teuthology.orchestra.run.smithi050.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.43188.log.gz 2024-09-14T12:02:53.057 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76574.log 2024-09-14T12:02:53.057 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.116113.log: /var/log/ceph/ceph-client.admin.155578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99618.log 2024-09-14T12:02:53.057 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116113.log.gz 2024-09-14T12:02:53.057 INFO:teuthology.orchestra.run.smithi050.stderr: 81.9%/var/log/ceph/ceph-client.admin.76574.log: -- replaced with /var/log/ceph/ceph-client.admin.155578.log.gz 2024-09-14T12:02:53.057 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127893.log 2024-09-14T12:02:53.057 INFO:teuthology.orchestra.run.smithi050.stderr: 24.7% -- replaced with /var/log/ceph/ceph-client.admin.76574.log.gz 2024-09-14T12:02:53.057 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-14T12:02:53.057 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.99618.log: /var/log/ceph/ceph-client.admin.127893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164484.log 2024-09-14T12:02:53.057 INFO:teuthology.orchestra.run.smithi050.stderr: 81.8%gzip -5/var/log/ceph/ceph-mon.c.log: --verbose -- /var/log/ceph/ceph-client.admin.147920.log 2024-09-14T12:02:53.057 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.127893.log.gz 2024-09-14T12:02:53.057 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.164484.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.164484.log.gz 2024-09-14T12:02:53.058 INFO:teuthology.orchestra.run.smithi050.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.99618.log.gz 2024-09-14T12:02:53.058 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96673.log 2024-09-14T12:02:53.058 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.147920.log: gzip -5 --verbose 81.7% -- replaced with /var/log/ceph/ceph-client.admin.147920.log.gz 2024-09-14T12:02:53.058 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.104330.log 2024-09-14T12:02:53.058 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41976.log 81.6% -- replaced with /var/log/ceph/ceph-client.admin.96673.log.gz 2024-09-14T12:02:53.058 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-14T12:02:53.058 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38113.log 2024-09-14T12:02:53.058 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104330.log.gz 2024-09-14T12:02:53.058 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.41976.log: gzip -5 80.4% --verbose -- /var/log/ceph/ceph-client.admin.154400.log 2024-09-14T12:02:53.058 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.0.41976.log.gz 2024-09-14T12:02:53.058 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38113.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.38113.log.gz 2024-09-14T12:02:53.058 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.111990.log 2024-09-14T12:02:53.058 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56598.log/var/log/ceph/ceph-client.admin.154400.log: 2024-09-14T12:02:53.058 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.111990.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.154400.log.gz 2024-09-14T12:02:53.058 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144385.log 2024-09-14T12:02:53.058 INFO:teuthology.orchestra.run.smithi050.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.111990.log.gz 2024-09-14T12:02:53.059 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192036.log 2024-09-14T12:02:53.059 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.56598.log: /var/log/ceph/ceph-client.admin.144385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42585.log 2024-09-14T12:02:53.059 INFO:teuthology.orchestra.run.smithi050.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.56598.log.gz 2024-09-14T12:02:53.059 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.192036.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.144385.log.gz 2024-09-14T12:02:53.059 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192036.log.gz 2024-09-14T12:02:53.059 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82536.log 2024-09-14T12:02:53.059 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63147.log 2024-09-14T12:02:53.059 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.42585.log: /var/log/ceph/ceph-client.admin.82536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181171.log 2024-09-14T12:02:53.059 INFO:teuthology.orchestra.run.smithi050.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.42585.log.gz 2024-09-14T12:02:53.059 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63147.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.82536.log.gz 2024-09-14T12:02:53.059 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138495.log 2024-09-14T12:02:53.059 INFO:teuthology.orchestra.run.smithi050.stderr: 55.2% -- replaced with /var/log/ceph/ceph-client.admin.63147.log.gz 2024-09-14T12:02:53.059 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175175.log 2024-09-14T12:02:53.059 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.181171.log: /var/log/ceph/ceph-client.admin.138495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46752.log 2024-09-14T12:02:53.059 INFO:teuthology.orchestra.run.smithi050.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.181171.log.gz 2024-09-14T12:02:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.175175.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.138495.log.gz 2024-09-14T12:02:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72534.log 2024-09-14T12:02:53.060 INFO:teuthology.orchestra.run.smithi050.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.175175.log.gz 2024-09-14T12:02:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71251.log 2024-09-14T12:02:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.46752.log: /var/log/ceph/ceph-client.admin.72534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.186043.log 2024-09-14T12:02:53.060 INFO:teuthology.orchestra.run.smithi050.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.46752.log.gz 2024-09-14T12:02:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.71251.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.72534.log.gz 2024-09-14T12:02:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132605.log 2024-09-14T12:02:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157346.log 2024-09-14T12:02:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.186043.log: /var/log/ceph/ceph-client.admin.132605.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.186043.log.gz 2024-09-14T12:02:53.060 INFO:teuthology.orchestra.run.smithi050.stderr: 81.7% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71251.log.gz 2024-09-14T12:02:53.060 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.132605.log.gz 2024-09-14T12:02:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.191179.log 2024-09-14T12:02:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93728.log 2024-09-14T12:02:53.061 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.157346.log: /var/log/ceph/ceph-client.0.191179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64263.log 2024-09-14T12:02:53.061 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.93728.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.157346.log.gz 2024-09-14T12:02:53.061 INFO:teuthology.orchestra.run.smithi050.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.93728.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38373.log 2024-09-14T12:02:53.061 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-14T12:02:53.061 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133194.log 2024-09-14T12:02:53.061 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38373.log: /var/log/ceph/ceph-client.admin.64263.log: 0.0% 19.9% -- replaced with /var/log/ceph/ceph-client.admin.64263.log.gz 2024-09-14T12:02:53.061 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38373.log.gz 2024-09-14T12:02:53.061 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-14T12:02:53.061 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84892.log 2024-09-14T12:02:53.061 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.133194.log: /var/log/ceph/ceph-mon.a.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.133194.log.gz 2024-09-14T12:02:53.061 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162669.log 2024-09-14T12:02:53.061 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84892.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.84892.log.gz 2024-09-14T12:02:53.061 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58365.log 2024-09-14T12:02:53.061 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.162669.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.162669.log.gz 2024-09-14T12:02:53.061 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38736.log 2024-09-14T12:02:53.061 INFO:teuthology.orchestra.run.smithi050.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.69363.log.gz 2024-09-14T12:02:53.062 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58365.log.gz 2024-09-14T12:02:53.062 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122592.log 2024-09-14T12:02:53.062 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38736.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125537.log 2024-09-14T12:02:53.062 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38736.log.gz 2024-09-14T12:02:53.062 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60769.log 2024-09-14T12:02:53.062 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.122592.log: /var/log/ceph/ceph-client.admin.125537.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.125537.log.gz 2024-09-14T12:02:53.062 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95495.log 2024-09-14T12:02:53.062 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60769.log.gz 2024-09-14T12:02:53.062 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33141.log 2024-09-14T12:02:53.062 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95495.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.122592.log.gz 2024-09-14T12:02:53.062 INFO:teuthology.orchestra.run.smithi050.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.95495.log.gz 2024-09-14T12:02:53.062 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192358.log 2024-09-14T12:02:53.062 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183607.log 2024-09-14T12:02:53.062 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.192358.log: /var/log/ceph/ceph-client.admin.33141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33141.log.gz 2024-09-14T12:02:53.062 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192358.log.gz 2024-09-14T12:02:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169581.log 2024-09-14T12:02:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.183607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192588.log 83.7% -- replaced with /var/log/ceph/ceph-client.0.183607.log.gz 2024-09-14T12:02:53.063 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-14T12:02:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192220.log 2024-09-14T12:02:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.192588.log: /var/log/ceph/ceph-client.admin.169581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192588.log.gz 2024-09-14T12:02:53.063 INFO:teuthology.orchestra.run.smithi050.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.169581.log.gz 2024-09-14T12:02:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62894.log 2024-09-14T12:02:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.192220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192220.log.gz 2024-09-14T12:02:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90194.log 2024-09-14T12:02:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.62894.log: 62.5% -- replaced with /var/log/ceph/ceph-client.admin.62894.log.gz 2024-09-14T12:02:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139084.log 2024-09-14T12:02:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189045.log 2024-09-14T12:02:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.90194.log: /var/log/ceph/ceph-client.admin.139084.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.90194.log.gz 2024-09-14T12:02:53.063 INFO:teuthology.orchestra.run.smithi050.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.139084.log.gz 2024-09-14T12:02:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110223.log 2024-09-14T12:02:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.189045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189045.log.gz 2024-09-14T12:02:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114346.log 2024-09-14T12:02:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-14T12:02:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.110223.log: /var/log/ceph/ceph-client.admin.114346.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.110223.log.gz 2024-09-14T12:02:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149098.log 2024-09-14T12:02:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.2.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.114346.log.gz 2024-09-14T12:02:53.076 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52427.log 2024-09-14T12:02:53.076 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.149098.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.149098.log.gz 2024-09-14T12:02:53.076 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107864.log 2024-09-14T12:02:53.077 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.52427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52427.log.gz 2024-09-14T12:02:53.077 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100796.log 2024-09-14T12:02:53.077 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.107864.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.107864.log.gz 2024-09-14T12:02:53.077 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33240.log 2024-09-14T12:02:53.077 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100796.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.100796.log.gz 2024-09-14T12:02:53.077 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122003.log 2024-09-14T12:02:53.077 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33240.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33240.log.gz 2024-09-14T12:02:53.077 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162080.log 2024-09-14T12:02:53.077 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.122003.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.122003.log.gz 2024-09-14T12:02:53.077 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-09-14T12:02:53.077 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.162080.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.162080.log.gz 2024-09-14T12:02:53.077 INFO:teuthology.orchestra.run.smithi050.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.0.191179.log.gz 2024-09-14T12:02:53.077 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181780.log 2024-09-14T12:02:53.077 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/valgrind/ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98440.log 2024-09-14T12:02:53.078 INFO:teuthology.orchestra.run.smithi050.stderr: 62.6% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-09-14T12:02:53.078 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.181780.log: 84.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123181.log 2024-09-14T12:02:53.078 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.0.181780.log.gz 2024-09-14T12:02:53.078 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.98440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112579.log 2024-09-14T12:02:53.078 INFO:teuthology.orchestra.run.smithi050.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.98440.log.gz 2024-09-14T12:02:53.078 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.123181.log: 81.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77352.log 2024-09-14T12:02:53.078 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.123181.log.gz 2024-09-14T12:02:53.078 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.112579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75392.log 2024-09-14T12:02:53.078 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.77352.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.112579.log.gz 2024-09-14T12:02:53.078 INFO:teuthology.orchestra.run.smithi050.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.0.77352.log.gz 2024-09-14T12:02:53.078 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104919.log 2024-09-14T12:02:53.078 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108453.log 2024-09-14T12:02:53.078 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.75392.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.75392.log.gz 2024-09-14T12:02:53.078 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104919.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.104919.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38369.log 2024-09-14T12:02:53.078 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-14T12:02:53.078 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.108453.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-14T12:02:53.079 INFO:teuthology.orchestra.run.smithi050.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.108453.log.gz 2024-09-14T12:02:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38369.log.gz 2024-09-14T12:02:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38738.log 2024-09-14T12:02:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96084.log 2024-09-14T12:02:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38738.log.gz 2024-09-14T12:02:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57187.log 2024-09-14T12:02:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96084.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96084.log.gz 2024-09-14T12:02:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65028.log 2024-09-14T12:02:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.57187.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.57187.log.gz 2024-09-14T12:02:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39443.log 2024-09-14T12:02:53.080 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.65028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135550.log 2024-09-14T12:02:53.080 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39443.log.gz 2024-09-14T12:02:53.083 INFO:teuthology.orchestra.run.smithi050.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.65028.log.gz 2024-09-14T12:02:53.084 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165073.log 2024-09-14T12:02:53.085 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.135550.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.135550.log.gz 2024-09-14T12:02:53.085 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T12:02:53.086 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.165073.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.165073.log.gz 2024-09-14T12:02:53.086 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145564.log 2024-09-14T12:02:53.088 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.log: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-14T12:02:53.091 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191990.log 2024-09-14T12:02:53.091 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.145564.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.145564.log.gz 2024-09-14T12:02:53.091 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126715.log 2024-09-14T12:02:53.091 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.191990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191990.log.gz 2024-09-14T12:02:53.091 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177517.log 2024-09-14T12:02:53.092 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.126715.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.126715.log.gz 2024-09-14T12:02:53.092 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97851.log 2024-09-14T12:02:53.092 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.177517.log: 83.8% -- replaced with /var/log/ceph/ceph-client.0.177517.log.gz 2024-09-14T12:02:53.094 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38371.log 2024-09-14T12:02:53.094 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97851.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97851.log.gz 2024-09-14T12:02:53.094 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94906.log 2024-09-14T12:02:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38371.log.gz 2024-09-14T12:02:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192958.log 2024-09-14T12:02:53.096 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.94906.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.94906.log.gz 2024-09-14T12:02:53.096 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152632.log 2024-09-14T12:02:53.097 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.192958.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192958.log.gz 2024-09-14T12:02:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38735.log 2024-09-14T12:02:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.152632.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.152632.log.gz 2024-09-14T12:02:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150276.log 2024-09-14T12:02:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38735.log.gz 2024-09-14T12:02:53.100 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150865.log 2024-09-14T12:02:53.100 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.150276.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.150276.log.gz 2024-09-14T12:02:53.101 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159702.log 2024-09-14T12:02:53.101 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.150865.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.150865.log.gz 2024-09-14T12:02:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73621.log 2024-09-14T12:02:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.159702.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.159702.log.gz 2024-09-14T12:02:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160902.log 2024-09-14T12:02:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.73621.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.73621.log.gz 93.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T12:02:53.105 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-14T12:02:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59591.log 2024-09-14T12:02:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.160902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37962.log 2024-09-14T12:02:53.106 INFO:teuthology.orchestra.run.smithi050.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.160902.log.gz 2024-09-14T12:02:53.126 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.59591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75983.log 2024-09-14T12:02:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37962.log: 95.1% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37962.log.gz 2024-09-14T12:02:53.127 INFO:teuthology.orchestra.run.smithi050.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.59591.log.gz 2024-09-14T12:02:53.127 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-14T12:02:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180562.log 2024-09-14T12:02:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.75983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100207.log 2024-09-14T12:02:53.127 INFO:teuthology.orchestra.run.smithi050.stderr: 80.8%/var/log/ceph/ceph-client.0.180562.log: -- replaced with /var/log/ceph/ceph-client.admin.75983.log.gz 2024-09-14T12:02:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48256.log 2024-09-14T12:02:53.127 INFO:teuthology.orchestra.run.smithi050.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.0.180562.log.gz 2024-09-14T12:02:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126126.log 2024-09-14T12:02:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100207.log: 82.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74210.log 2024-09-14T12:02:53.127 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.100207.log.gz 2024-09-14T12:02:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48256.log: /var/log/ceph/ceph-client.admin.126126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189705.log 2024-09-14T12:02:53.127 INFO:teuthology.orchestra.run.smithi050.stderr: 81.7% 83.2% -- replaced with /var/log/ceph/ceph-client.admin.48256.log.gz 2024-09-14T12:02:53.128 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.126126.log.gz 2024-09-14T12:02:53.128 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.74210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191944.log 2024-09-14T12:02:53.128 INFO:teuthology.orchestra.run.smithi050.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.74210.log.gz 2024-09-14T12:02:53.128 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.189705.log: -- /var/log/ceph/ceph-client.admin.58413.log 2024-09-14T12:02:53.128 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189705.log.gz 2024-09-14T12:02:53.128 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.191944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191944.log.gz 2024-09-14T12:02:53.128 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178126.log 2024-09-14T12:02:53.128 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.58413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187820.log 2024-09-14T12:02:53.128 INFO:teuthology.orchestra.run.smithi050.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.58413.log.gz 2024-09-14T12:02:53.128 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.178126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80769.log 2024-09-14T12:02:53.128 INFO:teuthology.orchestra.run.smithi050.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.178126.log.gz 2024-09-14T12:02:53.128 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.187820.log: gzip -5 --verbose 82.5% -- replaced with /var/log/ceph/ceph-client.admin.187820.log.gz 2024-09-14T12:02:53.128 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.38367.log 2024-09-14T12:02:53.129 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.80769.log: gzip -5 --verbose 81.4% -- replaced with /var/log/ceph/ceph-client.admin.80769.log.gz 2024-09-14T12:02:53.129 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.71870.log 2024-09-14T12:02:53.129 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38367.log.gz 2024-09-14T12:02:53.129 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189069.log 2024-09-14T12:02:53.129 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.71870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133783.log 2024-09-14T12:02:53.129 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.189069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87249.log 2024-09-14T12:02:53.129 INFO:teuthology.orchestra.run.smithi050.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.189069.log.gz 2024-09-14T12:02:53.129 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.133783.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.133783.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139673.log 2024-09-14T12:02:53.129 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-14T12:02:53.129 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41331.log 2024-09-14T12:02:53.129 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.87249.log: /var/log/ceph/ceph-client.admin.139673.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.87249.log.gz 2024-09-14T12:02:53.129 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.139673.log.gz 2024-09-14T12:02:53.129 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192542.log 2024-09-14T12:02:53.129 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.41331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50047.log 2024-09-14T12:02:53.130 INFO:teuthology.orchestra.run.smithi050.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.41331.log.gz 2024-09-14T12:02:53.130 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.192542.log: gzip -5 91.8% -- replaced with /var/log/ceph/ceph-client.admin.71870.log.gz 2024-09-14T12:02:53.130 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.64439.log 2024-09-14T12:02:53.130 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0%/var/log/ceph/ceph-client.admin.50047.log: -- replaced with /var/log/ceph/ceph-client.admin.192542.log.gz 2024-09-14T12:02:53.130 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50047.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114935.log 2024-09-14T12:02:53.130 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-14T12:02:53.130 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54831.log 2024-09-14T12:02:53.130 INFO:teuthology.orchestra.run.smithi050.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.64439.log.gz 2024-09-14T12:02:53.130 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192818.log 2024-09-14T12:02:53.130 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.114935.log: /var/log/ceph/ceph-client.admin.54831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165686.log 2024-09-14T12:02:53.130 INFO:teuthology.orchestra.run.smithi050.stderr: 81.7%/var/log/ceph/ceph-client.admin.192818.log: -- replaced with /var/log/ceph/ceph-client.admin.114935.log.gz 2024-09-14T12:02:53.130 INFO:teuthology.orchestra.run.smithi050.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.54831.log.gz 2024-09-14T12:02:53.130 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192818.log.gz 2024-09-14T12:02:53.131 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48845.log 2024-09-14T12:02:53.131 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.165686.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165686.log.gz 2024-09-14T12:02:53.131 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.147331.log 2024-09-14T12:02:53.131 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.48845.log: gzip 81.9% -5 --verbose -- /var/log/ceph/ceph-client.admin.136139.log 2024-09-14T12:02:53.131 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48845.log.gz 2024-09-14T12:02:53.131 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.147331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103741.log 2024-09-14T12:02:53.131 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.136139.log: /var/log/ceph/ceph-client.admin.39355.log 2024-09-14T12:02:53.131 INFO:teuthology.orchestra.run.smithi050.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.136139.log.gz 2024-09-14T12:02:53.131 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67506.log 2024-09-14T12:02:53.131 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39355.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.147331.log.gz 2024-09-14T12:02:53.131 INFO:teuthology.orchestra.run.smithi050.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.103741.log.gz 2024-09-14T12:02:53.131 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39355.log.gz 2024-09-14T12:02:53.131 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76743.log 2024-09-14T12:02:53.132 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.67506.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T12:02:53.132 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.76743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137317.log 2024-09-14T12:02:53.132 INFO:teuthology.orchestra.run.smithi050.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.0.76743.log.gz/var/log/ceph/rgw.ceph.client.0.log: 2024-09-14T12:02:53.132 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192404.log 2024-09-14T12:02:53.132 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.137317.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.137317.log.gz 2024-09-14T12:02:53.132 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63260.log 2024-09-14T12:02:53.132 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.192404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192404.log.gz 2024-09-14T12:02:53.153 INFO:teuthology.orchestra.run.smithi050.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.67506.log.gz 2024-09-14T12:02:53.153 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61995.log 2024-09-14T12:02:53.153 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89605.log 2024-09-14T12:02:53.153 INFO:teuthology.orchestra.run.smithi050.stderr: 51.5% -- replaced with /var/log/ceph/ceph-client.admin.63260.log.gz 2024-09-14T12:02:53.153 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.61995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193095.log 2024-09-14T12:02:53.153 INFO:teuthology.orchestra.run.smithi050.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.61995.log.gz 2024-09-14T12:02:53.153 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.89605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38741.log 2024-09-14T12:02:53.153 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.193095.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.89605.log.gz 2024-09-14T12:02:53.153 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193095.log.gz 2024-09-14T12:02:53.154 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63543.log 2024-09-14T12:02:53.154 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38741.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171987.log 2024-09-14T12:02:53.154 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-14T12:02:53.154 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84303.log 2024-09-14T12:02:53.154 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63543.log: /var/log/ceph/ceph-client.admin.171987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63543.log.gz 2024-09-14T12:02:53.154 INFO:teuthology.orchestra.run.smithi050.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.171987.log.gz 2024-09-14T12:02:53.154 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97262.log 2024-09-14T12:02:53.154 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.84303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39399.log 2024-09-14T12:02:53.154 INFO:teuthology.orchestra.run.smithi050.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.84303.log.gz 2024-09-14T12:02:53.154 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160881.log 2024-09-14T12:02:53.154 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39399.log.gz 2024-09-14T12:02:53.154 INFO:teuthology.orchestra.run.smithi050.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.97262.log.gz 2024-09-14T12:02:53.154 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85481.log 2024-09-14T12:02:53.154 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.160881.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161491.log 2024-09-14T12:02:53.155 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.160881.log.gz 2024-09-14T12:02:53.155 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189021.log 2024-09-14T12:02:53.155 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.85481.log: /var/log/ceph/ceph-client.admin.161491.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.85481.log.gz 2024-09-14T12:02:53.155 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.161491.log.gz 2024-09-14T12:02:53.155 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.190474.log 2024-09-14T12:02:53.155 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38731.log 2024-09-14T12:02:53.155 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.190474.log: /var/log/ceph/ceph-client.admin.189021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189021.log.gz 2024-09-14T12:02:53.155 INFO:teuthology.orchestra.run.smithi050.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.190474.log.gz 2024-09-14T12:02:53.155 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63466.log 2024-09-14T12:02:53.155 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-client.admin.38731.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38370.log 2024-09-14T12:02:53.155 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38731.log.gz 2024-09-14T12:02:53.155 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81358.log 2024-09-14T12:02:53.155 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38370.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.63466.log.gz 2024-09-14T12:02:53.156 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38370.log.gz 2024-09-14T12:02:53.156 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132016.log 2024-09-14T12:02:53.156 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.81358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130838.log 2024-09-14T12:02:53.156 INFO:teuthology.orchestra.run.smithi050.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.81358.log.gz 2024-09-14T12:02:53.156 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.132016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116702.log 2024-09-14T12:02:53.156 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.130838.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.132016.log.gz 81.5% -- replaced with /var/log/ceph/ceph-client.admin.130838.log.gz 2024-09-14T12:02:53.156 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-14T12:02:53.156 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93139.log 2024-09-14T12:02:53.156 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.116702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37875.log 2024-09-14T12:02:53.156 INFO:teuthology.orchestra.run.smithi050.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.116702.log.gz 2024-09-14T12:02:53.156 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.93139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165662.log 2024-09-14T12:02:53.156 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37875.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.93139.log.gz 2024-09-14T12:02:53.156 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37875.log.gz 2024-09-14T12:02:53.156 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66267.log 2024-09-14T12:02:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-client.admin.165662.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.129660.log 2024-09-14T12:02:53.157 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165662.log.gz 2024-09-14T12:02:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.66267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60817.log 2024-09-14T12:02:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.129660.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.129660.log.gz 2024-09-14T12:02:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192128.log 2024-09-14T12:02:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.60817.log: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.60817.log.gz 2024-09-14T12:02:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113168.log 2024-09-14T12:02:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.192128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192128.log.gz 2024-09-14T12:02:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63605.log 2024-09-14T12:02:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.113168.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.113168.log.gz 2024-09-14T12:02:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38739.log 2024-09-14T12:02:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.63605.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.66267.log.gz 2024-09-14T12:02:53.169 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50071.log 2024-09-14T12:02:53.169 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38739.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38739.log.gz 2024-09-14T12:02:53.170 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153811.log 2024-09-14T12:02:53.170 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.50071.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.50071.log.gz 2024-09-14T12:02:53.170 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142618.log 2024-09-14T12:02:53.170 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.153811.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.153811.log.gz 2024-09-14T12:02:53.170 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168324.log 2024-09-14T12:02:53.170 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.142618.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.142618.log.gz 2024-09-14T12:02:53.170 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173959.log 2024-09-14T12:02:53.170 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.168324.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.168324.log.gz 2024-09-14T12:02:53.170 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176878.log 2024-09-14T12:02:53.170 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.173959.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.173959.log.gz 2024-09-14T12:02:53.170 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101385.log 2024-09-14T12:02:53.170 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.176878.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.176878.log.gz 2024-09-14T12:02:53.170 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53064.log 2024-09-14T12:02:53.170 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101385.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101385.log.gz 2024-09-14T12:02:53.170 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88427.log 2024-09-14T12:02:53.171 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.53064.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63605.log.gz 2024-09-14T12:02:53.171 INFO:teuthology.orchestra.run.smithi050.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.53064.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192864.log 2024-09-14T12:02:53.171 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-14T12:02:53.171 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.88427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43791.log 2024-09-14T12:02:53.171 INFO:teuthology.orchestra.run.smithi050.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.88427.log.gz 2024-09-14T12:02:53.171 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179953.log 2024-09-14T12:02:53.171 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.192864.log: /var/log/ceph/ceph-client.0.43791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192864.log.gz 2024-09-14T12:02:53.171 INFO:teuthology.orchestra.run.smithi050.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.43791.log.gz 2024-09-14T12:02:53.171 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117880.log 2024-09-14T12:02:53.171 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.0.179953.log: /var/log/ceph/ceph-osd.3.log 2024-09-14T12:02:53.171 INFO:teuthology.orchestra.run.smithi050.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.0.179953.log.gz 2024-09-14T12:02:53.171 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.117880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78062.log 2024-09-14T12:02:53.171 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.3.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.117880.log.gz 2024-09-14T12:02:53.171 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37939.log 2024-09-14T12:02:53.177 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.78062.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.78062.log.gz 2024-09-14T12:02:53.177 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163871.log 2024-09-14T12:02:53.177 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37939.log.gz 2024-09-14T12:02:53.177 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163847.log 2024-09-14T12:02:53.177 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.163871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163871.log.gz 2024-09-14T12:02:53.177 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64327.log 2024-09-14T12:02:53.177 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.163847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163847.log.gz 2024-09-14T12:02:53.177 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146153.log 2024-09-14T12:02:53.177 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.64327.log: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.64327.log.gz 2024-09-14T12:02:53.177 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110812.log 2024-09-14T12:02:53.177 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.146153.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.146153.log.gz 2024-09-14T12:02:53.177 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166888.log 2024-09-14T12:02:53.179 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.110812.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.110812.log.gz 2024-09-14T12:02:53.179 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170771.log 2024-09-14T12:02:53.179 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.166888.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.166888.log.gz 2024-09-14T12:02:53.179 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105508.log 2024-09-14T12:02:53.181 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.170771.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.170771.log.gz 2024-09-14T12:02:53.181 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109634.log 2024-09-14T12:02:53.182 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.105508.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.105508.log.gz 2024-09-14T12:02:53.183 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119058.log 2024-09-14T12:02:53.183 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.109634.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109634.log.gz 2024-09-14T12:02:53.184 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189681.log 2024-09-14T12:02:53.185 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.119058.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.119058.log.gz 2024-09-14T12:02:53.186 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146742.log 2024-09-14T12:02:53.186 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.189681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189681.log.gz 2024-09-14T12:02:53.187 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.146742.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.146742.log.gz 2024-09-14T12:02:53.676 INFO:teuthology.orchestra.run.smithi118.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-14T12:02:53.919 INFO:teuthology.orchestra.run.smithi050.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-14T12:02:54.061 INFO:teuthology.orchestra.run.smithi118.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-14T12:02:55.782 INFO:teuthology.orchestra.run.smithi050.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-14T12:02:56.935 INFO:teuthology.orchestra.run.smithi050.stderr: 92.3% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-14T12:03:02.706 INFO:teuthology.orchestra.run.smithi118.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-14T12:03:03.615 INFO:teuthology.orchestra.run.smithi050.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-14T12:03:03.797 INFO:teuthology.orchestra.run.smithi050.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-14T12:03:04.363 INFO:teuthology.orchestra.run.smithi118.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-14T12:03:06.918 INFO:teuthology.orchestra.run.smithi050.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-14T12:03:07.111 INFO:teuthology.orchestra.run.smithi118.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-14T12:03:14.896 INFO:teuthology.orchestra.run.smithi118.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-14T12:03:14.898 INFO:teuthology.orchestra.run.smithi118.stderr: 2024-09-14T12:03:14.898 INFO:teuthology.orchestra.run.smithi118.stderr:real 0m21.922s 2024-09-14T12:03:14.899 INFO:teuthology.orchestra.run.smithi118.stderr:user 0m56.766s 2024-09-14T12:03:14.899 INFO:teuthology.orchestra.run.smithi118.stderr:sys 0m2.036s 2024-09-14T12:03:15.921 INFO:teuthology.orchestra.run.smithi050.stderr: 94.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-14T12:03:15.923 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-14T12:03:15.923 INFO:teuthology.orchestra.run.smithi050.stderr:real 0m22.985s 2024-09-14T12:03:15.923 INFO:teuthology.orchestra.run.smithi050.stderr:user 1m3.886s 2024-09-14T12:03:15.923 INFO:teuthology.orchestra.run.smithi050.stderr:sys 0m2.311s 2024-09-14T12:03:15.924 INFO:tasks.ceph:Archiving logs... 2024-09-14T12:03:15.924 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904124/remote/smithi050/log 2024-09-14T12:03:15.925 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T12:03:24.085 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904124/remote/smithi118/log 2024-09-14T12:03:24.086 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T12:03:31.755 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-14T12:03:31.767 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-14T12:03:31.768 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T12:03:31.770 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T12:03:31.881 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-14T12:03:31.891 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-14T12:03:31.892 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T12:03:31.894 DEBUG:teuthology.orchestra.run.smithi118:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T12:03:31.924 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2024-09-14T12:03:31.926 INFO:teuthology.orchestra.run.smithi118.stderr:bash: line 1: ntpq: command not found 2024-09-14T12:03:31.929 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T12:03:31.930 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2024-09-14T12:03:31.930 INFO:teuthology.orchestra.run.smithi050.stdout:^* hv01.front.sepia.ceph.com 3 6 377 30 +2021us[+1931us] +/- 46ms 2024-09-14T12:03:31.930 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 29 +2832us[+2832us] +/- 61ms 2024-09-14T12:03:31.930 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 -10ms[ -10ms] +/- 105ms 2024-09-14T12:03:31.930 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T12:03:31.930 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T12:03:31.930 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2024-09-14T12:03:31.930 INFO:teuthology.orchestra.run.smithi118.stdout:^* hv01.front.sepia.ceph.com 3 6 377 29 +2025us[+2021us] +/- 46ms 2024-09-14T12:03:31.930 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 88 +2827us[+2824us] +/- 60ms 2024-09-14T12:03:31.931 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 30 -10ms[ -10ms] +/- 105ms 2024-09-14T12:03:31.931 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T12:03:31.931 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-14T12:03:31.942 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-14T12:03:31.942 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-14T12:03:31.973 DEBUG:teuthology.orchestra.run.smithi050:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T12:03:32.056 DEBUG:teuthology.orchestra.run.smithi118:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T12:03:32.138 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T12:03:32.181 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:03:32.181 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T12:03:32.224 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:03:32.225 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-14T12:03:32.235 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-14T12:03:32.281 INFO:teuthology.task.internal:Duration was 5049.972511 seconds 2024-09-14T12:03:32.281 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-14T12:03:32.323 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-14T12:03:32.323 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T12:03:32.326 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T12:03:32.378 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T12:03:32.379 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T12:03:32.826 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-14T12:03:32.826 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2024-09-14T12:03:32.826 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T12:03:32.862 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi118.front.sepia.ceph.com 2024-09-14T12:03:32.862 DEBUG:teuthology.orchestra.run.smithi118:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T12:03:32.902 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-14T12:03:32.902 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T12:03:32.905 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T12:03:32.983 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-14T12:03:32.983 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T12:03:32.985 DEBUG:teuthology.orchestra.run.smithi118:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T12:03:33.137 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-14T12:03:33.148 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-14T12:03:33.148 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T12:03:33.188 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T12:03:33.226 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-14T12:03:33.238 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T12:03:33.240 DEBUG:teuthology.orchestra.run.smithi118:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T12:03:33.276 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2024-09-14T12:03:33.303 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = core 2024-09-14T12:03:33.347 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T12:03:33.375 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:03:33.375 DEBUG:teuthology.orchestra.run.smithi118:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T12:03:33.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:03:33.414 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-14T12:03:33.424 INFO:teuthology.task.internal:Transferring archived files... 2024-09-14T12:03:33.425 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904124/remote/smithi050 2024-09-14T12:03:33.425 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T12:03:33.475 DEBUG:teuthology.misc:Transferring archived files from smithi118:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904124/remote/smithi118 2024-09-14T12:03:33.475 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T12:03:33.521 INFO:teuthology.task.internal:Removing archive directory... 2024-09-14T12:03:33.521 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T12:03:33.523 DEBUG:teuthology.orchestra.run.smithi118:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T12:03:33.585 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-14T12:03:33.596 INFO:teuthology.task.internal:Not uploading archives. 2024-09-14T12:03:33.596 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-14T12:03:33.623 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-14T12:03:33.624 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T12:03:33.626 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T12:03:33.654 INFO:teuthology.orchestra.run.smithi118.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 12:03 /home/ubuntu/cephtest 2024-09-14T12:03:33.654 INFO:teuthology.orchestra.run.smithi050.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 12:03 /home/ubuntu/cephtest 2024-09-14T12:03:33.655 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-14T12:03:33.666 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-14T12:03:33.744 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 5049.972510814667 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-14T12:03:33.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T12:03:33.831 INFO:teuthology.run:pass